-- Logs begin at Sat 2022-09-24 20:01:15 UTC, end at Sat 2022-09-24 22:17:47 UTC. -- Sep 24 20:38:25.783365 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Sep 24 20:38:25.792051 ncdv-master-1 devstack@n-api.service[124062]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 24 20:38:25.794156 ncdv-master-1 devstack@n-api.service[124062]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 24 20:38:25 2022] *** Sep 24 20:38:25.794156 ncdv-master-1 devstack@n-api.service[124062]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 24 20:38:25.794156 ncdv-master-1 devstack@n-api.service[124062]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 24 20:38:25.794156 ncdv-master-1 devstack@n-api.service[124062]: nodename: ncdv-master-1 Sep 24 20:38:25.794156 ncdv-master-1 devstack@n-api.service[124062]: machine: x86_64 Sep 24 20:38:25.794156 ncdv-master-1 devstack@n-api.service[124062]: clock source: unix Sep 24 20:38:25.794156 ncdv-master-1 devstack@n-api.service[124062]: pcre jit disabled Sep 24 20:38:25.794156 ncdv-master-1 devstack@n-api.service[124062]: detected number of CPU cores: 4 Sep 24 20:38:25.794156 ncdv-master-1 devstack@n-api.service[124062]: current working directory: / Sep 24 20:38:25.794156 ncdv-master-1 devstack@n-api.service[124062]: detected binary path: /usr/bin/uwsgi-core Sep 24 20:38:25.794156 ncdv-master-1 devstack@n-api.service[124062]: your processes number limit is 47680 Sep 24 20:38:25.794156 ncdv-master-1 devstack@n-api.service[124062]: your memory page size is 4096 bytes Sep 24 20:38:25.794156 ncdv-master-1 devstack@n-api.service[124062]: detected max file descriptor number: 2048 Sep 24 20:38:25.794156 ncdv-master-1 devstack@n-api.service[124062]: lock engine: pthread robust mutexes Sep 24 20:38:25.795164 ncdv-master-1 devstack@n-api.service[124062]: thunder lock: enabled Sep 24 20:38:25.795164 ncdv-master-1 devstack@n-api.service[124062]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 24 20:38:25.795164 ncdv-master-1 devstack@n-api.service[124062]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 24 20:38:25.838598 ncdv-master-1 devstack@n-api.service[124062]: Python main interpreter initialized at 0x5609b71cd9c0 Sep 24 20:38:25.838598 ncdv-master-1 devstack@n-api.service[124062]: python threads support enabled Sep 24 20:38:25.838598 ncdv-master-1 devstack@n-api.service[124062]: your server socket listen backlog is limited to 100 connections Sep 24 20:38:25.838598 ncdv-master-1 devstack@n-api.service[124062]: your mercy for graceful operations on workers is 90 seconds Sep 24 20:38:25.838957 ncdv-master-1 devstack@n-api.service[124062]: mapped 403077 bytes (393 KB) for 2 cores Sep 24 20:38:25.839036 ncdv-master-1 devstack@n-api.service[124062]: *** Operational MODE: preforking *** Sep 24 20:38:25.839239 ncdv-master-1 devstack@n-api.service[124062]: *** uWSGI is running in multiple interpreter mode *** Sep 24 20:38:25.839239 ncdv-master-1 devstack@n-api.service[124062]: spawned uWSGI master process (pid: 124062) Sep 24 20:38:25.839425 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Sep 24 20:38:25.841045 ncdv-master-1 devstack@n-api.service[124062]: spawned uWSGI worker 1 (pid: 124063, cores: 1) Sep 24 20:38:25.841045 ncdv-master-1 devstack@n-api.service[124062]: spawned uWSGI worker 2 (pid: 124064, cores: 1) Sep 24 20:38:25.841045 ncdv-master-1 devstack@n-api.service[124062]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 24 20:38:27.152178 ncdv-master-1 devstack@n-api.service[124063]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 24 20:38:27.154268 ncdv-master-1 devstack@n-api.service[124064]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 24 20:38:27.835908 ncdv-master-1 devstack@n-api.service[124063]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 20:38:27.835908 ncdv-master-1 devstack@n-api.service[124063]: from cryptography.utils import int_from_bytes Sep 24 20:38:27.836221 ncdv-master-1 devstack@n-api.service[124063]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 20:38:27.836221 ncdv-master-1 devstack@n-api.service[124063]: from cryptography.utils import int_from_bytes Sep 24 20:38:27.837454 ncdv-master-1 devstack@n-api.service[124064]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 20:38:27.837454 ncdv-master-1 devstack@n-api.service[124064]: from cryptography.utils import int_from_bytes Sep 24 20:38:27.837770 ncdv-master-1 devstack@n-api.service[124064]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 20:38:27.837770 ncdv-master-1 devstack@n-api.service[124064]: from cryptography.utils import int_from_bytes Sep 24 20:38:30.437501 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 24 20:38:30.438100 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 24 20:38:30.438469 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 24 20:38:30.438588 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 24 20:38:30.438687 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 24 20:38:30.438756 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 24 20:38:30.438833 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 24 20:38:30.438902 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 24 20:38:30.438978 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 24 20:38:30.439052 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 24 20:38:30.439288 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.439398 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.439609 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.439714 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.439926 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.440010 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.440245 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.440349 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.440579 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.440732 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.441060 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.441165 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.441259 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.441351 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.441716 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.441824 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.441824 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.441977 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.442061 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.442145 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.442441 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.442587 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.442842 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.442940 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.443048 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.443215 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.443343 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.443436 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.443811 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.443930 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.444027 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.444111 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.444484 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.444585 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.444585 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.444745 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.445095 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.445203 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.445359 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.445466 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.445779 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.445890 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.446083 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.446185 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.446395 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.446518 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.446788 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.446895 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.447103 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.447209 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.447413 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.447515 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.447731 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.447917 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.448037 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.448122 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.448359 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.448477 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.448666 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.448770 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.449107 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.449253 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.449510 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.449627 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.449708 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.450348 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.450539 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.450756 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.450971 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.451149 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.451333 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.451436 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.451583 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.451750 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.451905 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.452075 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.452217 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.452400 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.452520 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.452708 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.452848 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.453036 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.453168 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.453357 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.453487 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.453675 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.453806 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.453995 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.454093 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.454297 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.454388 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.454625 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.454726 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.454934 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.455034 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.455254 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.455340 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.455557 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.455648 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.455844 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.455929 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.456096 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.456180 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.456399 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.456490 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.456718 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.456803 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.457038 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.457123 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.457307 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.457411 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.457556 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.457644 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.457830 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.457977 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.458145 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.458243 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.458465 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.458607 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.458791 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.458886 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.459094 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.459179 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.459396 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.459479 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.459700 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.459787 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.460000 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.460084 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.460302 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.460386 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.460604 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.460813 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.460909 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.460995 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.461213 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.461299 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.461528 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.461612 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.461834 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.461918 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.462140 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.462230 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.462460 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.462590 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.462806 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.462891 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.463114 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.463207 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.463420 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.463513 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.463759 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.463850 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.464068 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.464159 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.464372 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.464468 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.464690 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.464783 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.464996 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.465092 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.465304 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.465398 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.466169 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.466322 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.466474 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.466658 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.466806 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.467014 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.467132 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.467326 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.467439 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.467581 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.467676 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.467884 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.468017 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.468189 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.468341 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.468513 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.468607 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.468820 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.468906 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.469128 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.469213 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.469437 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.469530 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.469750 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.469891 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.470041 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.470125 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.470345 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.470544 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.470672 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.470756 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.470980 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.471076 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.471279 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.471374 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.471582 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.471667 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.471883 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.471966 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.472188 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.472287 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.472490 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.472574 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.472795 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.472886 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.473112 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.473197 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.473433 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.473516 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.473740 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.473837 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.474044 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.474177 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.474348 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.474444 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.474676 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.474764 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.474998 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.475085 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.475299 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.475382 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.475603 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.475687 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.475923 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.476008 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.476229 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.476320 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.476531 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.476614 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.476850 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.476948 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.477157 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.477241 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.477459 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.477549 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.477777 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.477869 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.478077 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.478171 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.478382 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.478474 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.478725 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.478811 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.479031 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.479117 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.479335 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.479428 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.479638 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.479722 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.479940 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.480026 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.480242 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.480335 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.480545 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.480637 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.480847 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.480933 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.481177 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.481307 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.481491 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.481723 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.481822 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.482055 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.482152 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.482382 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.482479 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.482719 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.482816 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.483042 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.483154 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.483325 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.483430 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.483647 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:38:30.483752 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.483986 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.484091 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.484321 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.484422 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.484635 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.484748 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.484964 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.485058 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.485296 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.485381 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.485617 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.485702 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.485931 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.486017 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.486239 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.486322 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.486573 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.486672 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.486898 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.486991 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.487210 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.487300 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.487522 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.487605 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.487833 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.487917 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.488149 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.488242 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.488462 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.488556 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.488787 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.488879 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.489101 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.489185 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.489417 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.489503 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.489730 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.489817 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.490041 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.490128 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.490359 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.490453 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.490705 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.490803 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.491018 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.491103 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.491327 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.491503 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.491666 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.491754 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.491991 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.492082 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.492307 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.492399 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.492628 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.492714 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.492942 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.493029 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.493249 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.493342 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.493560 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.493653 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.493871 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.493956 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.494208 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.494308 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.494545 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.494638 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.494858 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.494967 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.495171 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.495263 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.495481 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.495565 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.495799 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.495884 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.496109 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.496194 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.496418 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.496504 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.496760 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.496912 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.497070 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.497208 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.497397 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.497522 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.497731 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.497820 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.498046 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.498134 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.498370 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.498465 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.498709 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.498808 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.499021 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.499108 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.499337 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.499421 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.499649 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.499742 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.499961 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.500095 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.500267 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.500351 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.500572 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.500665 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.500872 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.500964 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.501174 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.501259 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.501480 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.501587 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.501778 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.501910 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.502098 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.502246 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.502424 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.502580 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.502756 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.502917 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.503088 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.503227 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.503396 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.503538 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.503706 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.503861 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.504053 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.504192 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.504343 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.504485 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.504614 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.504747 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.504912 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.505053 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.505220 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.505361 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.505524 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.505688 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.505849 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.506001 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.506159 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.506309 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.506464 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.506662 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.506811 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.506969 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.507116 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.507275 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.507421 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.507592 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.507736 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.507902 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.508045 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.508215 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.508350 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.508528 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.508653 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.508839 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.508964 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.509162 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.509287 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.509475 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.509603 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.509788 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.509913 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.510124 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.510231 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.510455 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.510642 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.510788 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.510950 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.511115 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.511277 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.511439 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.511601 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.511756 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.511914 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.512064 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.512220 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.512905 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.513134 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.513250 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.513443 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.513669 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.513766 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.513982 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.514094 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.514296 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.514398 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.514632 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.514751 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.514944 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.515117 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.515261 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.515397 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.515534 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.515688 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.515836 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.515978 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.516136 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.516272 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.516445 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.516580 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.516729 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.516857 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.517036 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.517166 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.517341 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.517480 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.517685 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.517826 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.517991 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.518119 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.518329 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.518475 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.518689 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.518776 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.519008 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.519099 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.519330 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.519431 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.519643 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.519727 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.519962 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.520048 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.520272 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.520364 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.520581 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.520665 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.520888 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.520971 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.521197 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.521363 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.521528 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.521626 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.521841 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.521940 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.522157 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.522249 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.522465 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.522583 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.522813 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.522897 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.523122 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.523209 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.523439 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.523523 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.523742 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.523826 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.524055 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.524139 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.524394 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.524479 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.524725 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.524847 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.525040 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.525124 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.525612 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.525698 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.525924 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.526008 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.526239 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.526326 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.526571 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.526660 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.526882 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.526983 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.527195 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.527287 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.527502 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.527593 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.527818 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.527999 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.528699 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.528789 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.529020 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.529242 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.529327 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.529566 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.529661 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.529904 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.529989 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.530226 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.530347 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.530569 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.530661 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.530892 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.530987 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.531196 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.531297 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.531532 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.531696 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.531849 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.531997 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.532161 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.532284 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.532488 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.532618 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.532838 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.532984 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.533175 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.533371 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.533648 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.533740 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.533890 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.533973 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.534052 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.534325 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.534425 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.534652 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.534773 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.534962 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.535115 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.535274 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.535567 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.535662 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.535881 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.535984 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.536187 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.536282 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.536491 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.536585 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.536795 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.536890 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.537104 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.537206 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.537413 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.537507 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.537717 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.537824 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.538032 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.538125 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.538349 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.538449 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.538681 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.538853 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.538988 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.539178 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.539312 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.539503 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.539624 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.539810 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.539929 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.540118 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.540235 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.540444 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.540539 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.540756 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.540868 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.541063 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.541180 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.541368 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.541484 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.541673 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.541798 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.542019 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.542108 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.542331 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.542418 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.542660 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.542751 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.542977 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.543066 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.543299 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.543397 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.543647 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.543741 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.543977 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.544236 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.544372 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.544650 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.544742 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.544893 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.545061 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.545339 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.545447 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.545540 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.545623 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.545822 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.545909 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.546131 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.546217 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.546440 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.546556 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.546775 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.546862 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.547086 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.547182 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.547394 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.547497 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.547712 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.547798 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.548023 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.548289 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.548388 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.548622 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.548756 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.548930 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.549016 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.549248 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.549337 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.549599 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.549821 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.549991 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.550153 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.550241 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.550469 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.550596 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.550813 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.550901 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.551167 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.551268 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.551475 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.551571 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.551783 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.551871 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.552091 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.552237 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.552404 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.552501 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.552710 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.552798 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.553016 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.553101 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.553318 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.553413 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.553628 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.553748 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.553934 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.554032 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.554237 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.554332 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.554560 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.554656 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.554865 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.554974 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.555176 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.555263 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.555481 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.555566 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.555785 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.555869 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.556089 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.556174 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.556392 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.556476 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.556709 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.556794 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.557014 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.557100 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.557316 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.557440 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.557621 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.557718 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.557948 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.558033 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.558253 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.558336 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.558578 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.558680 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.558886 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.558973 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.559456 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.559562 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.559643 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.559793 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.559888 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.560103 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.560190 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.560447 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.560544 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.560779 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.560865 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.561081 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.561166 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.561393 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.561487 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.561701 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.561795 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.562007 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.562093 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.562319 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.562465 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.562651 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.562781 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.562958 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.563044 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.563265 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.563368 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.563569 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.563655 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.563871 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.563964 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.564175 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.564261 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.564481 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.564611 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.564784 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.564906 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.565088 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.565175 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.565388 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.565475 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.565695 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.565782 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.565998 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.566083 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.566298 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.566382 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.566628 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.566729 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.566931 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.567027 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.567236 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.567320 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.567538 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.567622 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.567842 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.567928 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.568143 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.568227 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.568449 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.568542 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.568749 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.568833 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.569048 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.569136 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.569356 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.569455 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.569678 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.569810 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.569964 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.570050 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.570268 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.570364 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.570625 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.570714 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.570933 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.571020 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.571234 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.571328 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.571544 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.571630 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.571854 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.571946 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.572159 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.572254 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.572465 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.572562 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.572762 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.572847 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.573063 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.573148 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.573366 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.573451 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.573672 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.573760 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.573981 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.574067 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.574285 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.574368 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.574608 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.574711 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.575445 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.575594 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.575766 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.575917 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.576068 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.576286 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.576374 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.576453 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.576624 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.576735 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.576927 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.577043 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.577230 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.577349 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.577532 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.577657 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.577836 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.578002 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.578159 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.578308 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.578468 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.578694 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.578780 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.579003 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.579090 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.579320 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.579405 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.579640 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.579739 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.579952 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.580037 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.580262 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.580349 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.580576 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.580670 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.580881 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.580967 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.581195 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.581280 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.581505 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.581598 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.581818 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.581903 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.582121 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.582213 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.582424 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.582607 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.582765 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.582859 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.583074 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.583161 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.583382 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.583471 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.583681 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.583765 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.583985 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.584071 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.584308 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.584402 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.584616 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.584700 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.584922 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.585015 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.585241 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.585327 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.585555 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.585712 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.585866 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.585981 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.586176 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.586262 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.586485 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.586620 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.586817 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.586916 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.587129 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.587216 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.587445 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.587531 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.587754 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.587848 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.588060 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.588147 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.588369 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.588453 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.588675 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.588767 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.588980 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.589120 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.589288 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.589372 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.589594 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.589692 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.589895 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.589986 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.590204 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.590290 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.590520 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.590649 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.591404 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.591560 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.591725 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.591881 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.592001 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.592210 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.592297 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.592524 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.592617 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.592835 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.592933 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.593142 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.593228 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.593451 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.593600 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.593762 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.593912 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.594077 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.594250 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.594393 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.594545 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.594725 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.594856 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.595143 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.595228 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.595455 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.595579 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.595766 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.595862 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.596069 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.596162 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.596374 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.596485 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.596680 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.596779 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.596989 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.597075 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.597315 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.597412 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.597624 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.597710 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.597927 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.598012 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.598233 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.598326 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.598580 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.598670 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.598885 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.598979 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.599189 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.599283 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.599493 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.599701 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.599916 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.600063 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.600147 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.600241 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.600533 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.600630 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.600975 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.601122 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.601234 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.601352 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.601634 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.601780 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.601869 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.602047 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.602188 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.602475 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.602615 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.602879 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.603016 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.603205 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.603317 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.603530 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.603658 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.603855 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.603968 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.604159 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.604270 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.604471 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.604597 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.604779 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.604893 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.605101 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.605216 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.605423 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.605543 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.605730 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.605841 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.606066 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.606215 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.606402 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.606645 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.606766 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.606872 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.607147 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.607269 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.607410 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.607503 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.607713 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.607799 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.608024 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.608118 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.608331 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.608419 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.608642 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.608727 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.608947 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.609032 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.609256 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.609349 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.609581 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.609667 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.609888 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.609991 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.610199 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.610332 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.610557 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.610655 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.610840 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.610936 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.611147 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.611233 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.611452 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.611537 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.611764 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.611857 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.612066 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.612161 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.612372 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.612457 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.612678 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.612772 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.612984 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.613083 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.613306 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.613405 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.613612 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.613706 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.613934 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.614029 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.614244 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.614330 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.614581 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.614685 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.614891 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.614984 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.615195 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.615286 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.615518 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.615612 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.615828 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.615921 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.616131 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.616217 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.616436 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.616525 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.616746 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.616872 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.617078 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.617185 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.617386 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.617485 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.617707 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.617792 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.618031 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.618129 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.618343 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.618428 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.618680 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.618765 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.619003 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.619102 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.619311 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.619412 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.619617 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.619703 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.619928 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.620023 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.620229 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.620313 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.620535 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.620635 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.620837 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.620933 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.621143 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.621228 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.621443 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.621535 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.621773 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.621920 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.622072 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.622233 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.622385 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.622481 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.622703 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.622792 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.623019 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.623140 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.623322 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.623423 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.623623 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.623721 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.623928 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.624027 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.624229 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.624328 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.624550 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.624647 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.624882 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.624986 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.625181 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.625323 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.625470 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.625557 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.625775 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.625860 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.626102 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.626197 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.626408 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.626511 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.626747 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.626870 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.627063 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.627169 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.627384 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.627470 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.627699 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.627783 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.628012 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.628115 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.628345 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.629312 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.629510 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.629655 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.629822 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.629975 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.630120 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.630263 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.630263 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.630679 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.630846 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.631000 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.631153 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.631296 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.631438 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.631580 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.631731 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.631894 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.631894 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.632176 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.632318 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.632461 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.632612 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.632755 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.632897 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.633053 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.633290 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.633449 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.633592 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.633746 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.633889 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.634032 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.634173 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.634326 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.634469 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.634671 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.634671 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.634942 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.635095 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.635255 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.635578 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.635730 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.635873 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.636029 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.636029 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.636309 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.636309 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.636589 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.636736 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.636887 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.637030 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.637172 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.637912 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.638130 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.638392 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.638728 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.638728 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.639055 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.639055 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.639201 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.639201 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.639356 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.639356 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.639554 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.639633 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.639710 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.639797 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.639876 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.639954 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.640030 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.640114 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.640202 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.640281 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.640359 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.640464 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.640557 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.640785 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.640898 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.641094 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.641187 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.641409 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.641495 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.641721 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.641816 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.642039 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.642125 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.642375 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.642588 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.642723 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.642908 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.643039 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.643244 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.643388 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.643573 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.643668 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.643901 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.644167 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.644259 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.644484 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.644569 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.644820 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.644907 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.645127 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.645211 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.645435 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.645601 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.645748 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.645835 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.646057 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.646152 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.646365 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.646464 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.646704 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.646797 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.647013 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.647107 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.647316 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.647409 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.647625 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.647708 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.647933 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.648019 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.648257 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.648463 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.648570 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.648818 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.648911 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.649140 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.649238 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.649472 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.649630 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.649803 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.650003 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.650124 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.650631 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.650724 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.650957 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.651057 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.651287 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.651373 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.651618 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.651705 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.651934 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.652019 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.652242 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.652326 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.652548 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.652633 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.652870 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.653006 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.653705 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.653877 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.654010 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.654096 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.654317 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.654411 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.654646 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.654752 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.654951 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.655035 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.655263 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.655348 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.655572 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.655665 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.655876 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.655960 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.656179 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.656270 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.656479 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.656573 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.656781 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.656866 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.657085 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.657179 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.657390 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.657483 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.657695 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.657792 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.658006 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.658100 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.658307 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.658402 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.658633 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.658736 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.658937 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.659030 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.659240 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.659333 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.659553 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.659694 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.659858 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.659944 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.660169 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.660255 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.660474 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.660560 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.660784 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.660882 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.661092 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.661190 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.661404 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.661490 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.661714 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.661809 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.662037 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.662122 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.662344 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.662429 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.662672 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.662776 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.662989 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.663075 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.663300 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.663386 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.663623 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.663848 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.663935 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.664186 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.664272 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.664508 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.664602 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.664841 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.664940 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.665175 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.665386 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.665472 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.665729 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.665816 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.666055 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.666149 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.666378 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.666462 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.666716 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.666806 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.667028 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.667114 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.667338 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.667424 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.667648 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.667735 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.667961 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.668047 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.668271 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.668366 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.668602 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.668695 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.668914 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.669036 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.669226 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.669465 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.669594 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.669696 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.669830 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.669933 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.670127 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.670228 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.670439 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.670547 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.670788 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.670874 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.671159 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.671259 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.671439 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.671533 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.671753 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.671846 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.672067 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.672155 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.672377 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.672465 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.672691 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.672778 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.672998 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.673084 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.673309 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.673395 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.673618 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.673712 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.673928 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.674015 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.674242 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.674336 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.674577 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.674683 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.674890 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.674977 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.675196 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.675281 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.675502 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.675818 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.675906 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.676147 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.676234 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.676461 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.676558 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.676766 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.676852 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.677110 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.677438 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.677523 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.677765 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.677851 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.678077 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.678176 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.678397 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.678484 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.678733 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.678830 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.679059 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.679145 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.679386 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.679487 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.679699 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.679839 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.680021 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.680107 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.680326 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.680420 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.680633 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.680728 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.680936 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.681022 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.681253 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.681397 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.681571 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.681676 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.681880 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.681980 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.682184 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.682294 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.682488 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.682607 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.682818 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.682906 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.683118 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.683216 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.683418 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.683522 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.683725 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.683821 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.684026 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.684629 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.684857 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.685015 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.685147 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.685361 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.685610 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.685702 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.685924 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.686014 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.686233 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.686335 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.686556 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.686657 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.686862 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.686963 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.687170 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.687281 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.687471 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.687604 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.687772 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.687861 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.688070 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.688167 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.688372 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.688460 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.688671 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.688758 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.688973 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.689070 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.689277 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.689367 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.689582 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.689692 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.689882 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.689989 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.690184 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.690280 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.690531 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.690621 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.690860 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.690951 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.691181 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.691282 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.691504 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.691606 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.691811 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.691904 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.692115 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.692210 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.692432 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.692518 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.692744 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.692833 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.693052 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.693142 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.693361 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.693459 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.693670 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.693757 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.693977 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.694065 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.694299 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.694407 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.694623 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.694716 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.694935 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.695023 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.695246 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.695344 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.695554 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.695642 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.695862 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.695950 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.696179 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.696282 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.696497 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.696587 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.696809 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.696895 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.697136 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.697223 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.697446 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.697534 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.697758 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.697855 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.698070 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.698159 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.698379 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.698466 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.698713 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.698812 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.699028 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.699118 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.699338 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.699428 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.699653 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.699845 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.700646 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.700812 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.700969 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.701123 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.701271 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.701426 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.701586 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.701743 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.701898 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.702058 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.702218 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.702404 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.702556 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.702763 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.702893 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.703103 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.703203 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.703420 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.703507 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.703836 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.703923 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.704167 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.704267 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.704500 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.704585 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.704813 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.704907 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.705118 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.705216 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.705362 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 24 20:38:30.705477 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.705793 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.706106 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.706413 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:38:30.706682 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 24 20:38:30.771219 ncdv-master-1 devstack@n-api.service[124063]: INFO dbcounter [None req-7089e29f-34eb-475c-bad3-324f914e9941 None None] Registered counter for database nova_api Sep 24 20:38:30.772628 ncdv-master-1 devstack@n-api.service[124064]: INFO dbcounter [None req-2a7c9d1c-1a1c-4097-a826-dd2daf8b3e4b None None] Registered counter for database nova_api Sep 24 20:38:30.793420 ncdv-master-1 devstack@n-api.service[124063]: DEBUG oslo_db.sqlalchemy.engines [None req-7089e29f-34eb-475c-bad3-324f914e9941 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124063) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 20:38:30.795784 ncdv-master-1 devstack@n-api.service[124064]: DEBUG oslo_db.sqlalchemy.engines [None req-2a7c9d1c-1a1c-4097-a826-dd2daf8b3e4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124064) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 20:38:30.800573 ncdv-master-1 devstack@n-api.service[124063]: DEBUG dbcounter [-] [124063] Writer thread running {{(pid=124063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 20:38:30.802442 ncdv-master-1 devstack@n-api.service[124064]: DEBUG dbcounter [-] [124064] Writer thread running {{(pid=124064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 20:38:30.859631 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.context [None req-2a7c9d1c-1a1c-4097-a826-dd2daf8b3e4b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),788aecb6-32dc-4b71-909a-be050455aded(cell1) {{(pid=124064) load_cells /opt/stack/nova/nova/context.py:464}} Sep 24 20:38:30.863571 ncdv-master-1 devstack@n-api.service[124064]: DEBUG oslo_concurrency.lockutils [None req-2a7c9d1c-1a1c-4097-a826-dd2daf8b3e4b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:38:30.863692 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.context [None req-7089e29f-34eb-475c-bad3-324f914e9941 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),788aecb6-32dc-4b71-909a-be050455aded(cell1) {{(pid=124063) load_cells /opt/stack/nova/nova/context.py:464}} Sep 24 20:38:30.863995 ncdv-master-1 devstack@n-api.service[124064]: DEBUG oslo_concurrency.lockutils [None req-2a7c9d1c-1a1c-4097-a826-dd2daf8b3e4b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:38:30.865552 ncdv-master-1 devstack@n-api.service[124064]: DEBUG oslo_concurrency.lockutils [None req-2a7c9d1c-1a1c-4097-a826-dd2daf8b3e4b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:38:30.866266 ncdv-master-1 devstack@n-api.service[124064]: DEBUG oslo_concurrency.lockutils [None req-2a7c9d1c-1a1c-4097-a826-dd2daf8b3e4b None None] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:38:30.866737 ncdv-master-1 devstack@n-api.service[124064]: DEBUG oslo_concurrency.lockutils [None req-2a7c9d1c-1a1c-4097-a826-dd2daf8b3e4b None None] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:38:30.867541 ncdv-master-1 devstack@n-api.service[124063]: DEBUG oslo_concurrency.lockutils [None req-7089e29f-34eb-475c-bad3-324f914e9941 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:38:30.867926 ncdv-master-1 devstack@n-api.service[124063]: DEBUG oslo_concurrency.lockutils [None req-7089e29f-34eb-475c-bad3-324f914e9941 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:38:30.868702 ncdv-master-1 devstack@n-api.service[124064]: DEBUG oslo_concurrency.lockutils [None req-2a7c9d1c-1a1c-4097-a826-dd2daf8b3e4b None None] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:38:30.869547 ncdv-master-1 devstack@n-api.service[124063]: DEBUG oslo_concurrency.lockutils [None req-7089e29f-34eb-475c-bad3-324f914e9941 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:38:30.870194 ncdv-master-1 devstack@n-api.service[124063]: DEBUG oslo_concurrency.lockutils [None req-7089e29f-34eb-475c-bad3-324f914e9941 None None] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:38:30.870659 ncdv-master-1 devstack@n-api.service[124063]: DEBUG oslo_concurrency.lockutils [None req-7089e29f-34eb-475c-bad3-324f914e9941 None None] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:38:30.870779 ncdv-master-1 devstack@n-api.service[124064]: INFO dbcounter [None req-2a7c9d1c-1a1c-4097-a826-dd2daf8b3e4b None None] Registered counter for database nova_cell0 Sep 24 20:38:30.873163 ncdv-master-1 devstack@n-api.service[124063]: DEBUG oslo_concurrency.lockutils [None req-7089e29f-34eb-475c-bad3-324f914e9941 None None] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:38:30.875375 ncdv-master-1 devstack@n-api.service[124063]: INFO dbcounter [None req-7089e29f-34eb-475c-bad3-324f914e9941 None None] Registered counter for database nova_cell0 Sep 24 20:38:30.876965 ncdv-master-1 devstack@n-api.service[124064]: INFO dbcounter [None req-2a7c9d1c-1a1c-4097-a826-dd2daf8b3e4b None None] Registered counter for database nova_cell1 Sep 24 20:38:30.880803 ncdv-master-1 devstack@n-api.service[124063]: INFO dbcounter [None req-7089e29f-34eb-475c-bad3-324f914e9941 None None] Registered counter for database nova_cell1 Sep 24 20:38:30.886553 ncdv-master-1 devstack@n-api.service[124064]: DEBUG oslo_db.sqlalchemy.engines [None req-2a7c9d1c-1a1c-4097-a826-dd2daf8b3e4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124064) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 20:38:30.886553 ncdv-master-1 devstack@n-api.service[124064]: DEBUG oslo_db.sqlalchemy.engines [None req-2a7c9d1c-1a1c-4097-a826-dd2daf8b3e4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124064) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 20:38:30.890824 ncdv-master-1 devstack@n-api.service[124063]: DEBUG oslo_db.sqlalchemy.engines [None req-7089e29f-34eb-475c-bad3-324f914e9941 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124063) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 20:38:30.892585 ncdv-master-1 devstack@n-api.service[124063]: DEBUG oslo_db.sqlalchemy.engines [None req-7089e29f-34eb-475c-bad3-324f914e9941 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124063) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 20:38:30.893231 ncdv-master-1 devstack@n-api.service[124064]: DEBUG dbcounter [-] [124064] Writer thread running {{(pid=124064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 20:38:30.895301 ncdv-master-1 devstack@n-api.service[124064]: DEBUG dbcounter [-] [124064] Writer thread running {{(pid=124064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 20:38:30.898450 ncdv-master-1 devstack@n-api.service[124063]: DEBUG dbcounter [-] [124063] Writer thread running {{(pid=124063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 20:38:30.900832 ncdv-master-1 devstack@n-api.service[124063]: DEBUG dbcounter [-] [124063] Writer thread running {{(pid=124063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 20:38:31.040510 ncdv-master-1 devstack@n-api.service[124064]: INFO dbcounter [None req-2a7c9d1c-1a1c-4097-a826-dd2daf8b3e4b None None] Registered counter for database nova_cell0 Sep 24 20:38:31.044685 ncdv-master-1 devstack@n-api.service[124063]: INFO dbcounter [None req-7089e29f-34eb-475c-bad3-324f914e9941 None None] Registered counter for database nova_cell0 Sep 24 20:38:31.050140 ncdv-master-1 devstack@n-api.service[124064]: DEBUG oslo_db.sqlalchemy.engines [None req-2a7c9d1c-1a1c-4097-a826-dd2daf8b3e4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124064) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 20:38:31.053742 ncdv-master-1 devstack@n-api.service[124063]: DEBUG oslo_db.sqlalchemy.engines [None req-7089e29f-34eb-475c-bad3-324f914e9941 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124063) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 20:38:31.055075 ncdv-master-1 devstack@n-api.service[124064]: DEBUG dbcounter [-] [124064] Writer thread running {{(pid=124064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 20:38:31.058324 ncdv-master-1 devstack@n-api.service[124063]: DEBUG dbcounter [-] [124063] Writer thread running {{(pid=124063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 20:38:31.516463 ncdv-master-1 devstack@n-api.service[124063]: WARNING keystonemiddleware.auth_token [None req-7089e29f-34eb-475c-bad3-324f914e9941 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 20:38:31.523809 ncdv-master-1 devstack@n-api.service[124063]: WARNING keystonemiddleware.auth_token [None req-7089e29f-34eb-475c-bad3-324f914e9941 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 20:38:31.525483 ncdv-master-1 devstack@n-api.service[124064]: WARNING keystonemiddleware.auth_token [None req-2a7c9d1c-1a1c-4097-a826-dd2daf8b3e4b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 20:38:31.533112 ncdv-master-1 devstack@n-api.service[124064]: WARNING keystonemiddleware.auth_token [None req-2a7c9d1c-1a1c-4097-a826-dd2daf8b3e4b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 20:38:31.750592 ncdv-master-1 devstack@n-api.service[124063]: WARNING keystonemiddleware.auth_token [None req-7089e29f-34eb-475c-bad3-324f914e9941 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 20:38:31.756614 ncdv-master-1 devstack@n-api.service[124063]: WARNING keystonemiddleware.auth_token [None req-7089e29f-34eb-475c-bad3-324f914e9941 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 20:38:31.761583 ncdv-master-1 devstack@n-api.service[124064]: WARNING keystonemiddleware.auth_token [None req-2a7c9d1c-1a1c-4097-a826-dd2daf8b3e4b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 20:38:31.761963 ncdv-master-1 devstack@n-api.service[124063]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5609b71cd9c0 pid: 124063 (default app) Sep 24 20:38:31.764614 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-7089e29f-34eb-475c-bad3-324f914e9941 None None] Calling method '>' {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:38:31.765810 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.requestlog [None req-7089e29f-34eb-475c-bad3-324f914e9941 None None] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001750 Sep 24 20:38:31.766237 ncdv-master-1 devstack@n-api.service[124063]: [pid: 124063|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 788 bytes} [Sat Sep 24 20:38:31 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:38:31.768321 ncdv-master-1 devstack@n-api.service[124064]: WARNING keystonemiddleware.auth_token [None req-2a7c9d1c-1a1c-4097-a826-dd2daf8b3e4b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 20:38:31.773579 ncdv-master-1 devstack@n-api.service[124064]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5609b71cd9c0 pid: 124064 (default app) Sep 24 20:40:00.466385 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-7089e29f-34eb-475c-bad3-324f914e9941 None None] Calling method '>' {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:40:00.468062 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.requestlog [None req-7089e29f-34eb-475c-bad3-324f914e9941 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002204 Sep 24 20:40:00.468622 ncdv-master-1 devstack@n-api.service[124063]: [pid: 124063|app: 0|req: 2/2] 10.222.0.52 () {54 vars in 931 bytes} [Sat Sep 24 20:40:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:40:00.480557 ncdv-master-1 devstack@n-api.service[124064]: DEBUG dbcounter [-] [124064] Writing DB stats nova_api:SELECT=3 {{(pid=124064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:40:00.482738 ncdv-master-1 devstack@n-api.service[124064]: DEBUG dbcounter [-] [124064] Writing DB stats nova_cell1:SELECT=3 {{(pid=124064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:40:00.483733 ncdv-master-1 devstack@n-api.service[124064]: DEBUG dbcounter [-] [124064] Writing DB stats nova_cell0:SELECT=3 {{(pid=124064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:40:00.484612 ncdv-master-1 devstack@n-api.service[124064]: DEBUG dbcounter [-] [124064] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=124064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:40:01.362080 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-f10a71db-7398-4f96-99c0-de95ad597ff2 admin admin] Calling method '>' {{(pid=124064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:40:01.395077 ncdv-master-1 devstack@n-api.service[124064]: INFO nova.api.openstack.requestlog [None req-f10a71db-7398-4f96-99c0-de95ad597ff2 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.919499 Sep 24 20:40:01.395843 ncdv-master-1 devstack@n-api.service[124064]: [pid: 124064|app: 0|req: 1/3] 10.222.0.52 () {60 vars in 1292 bytes} [Sat Sep 24 20:40:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:40:04.362634 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-7089e29f-34eb-475c-bad3-324f914e9941 None None] Calling method '>' {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:40:04.363632 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.requestlog [None req-7089e29f-34eb-475c-bad3-324f914e9941 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Sep 24 20:40:04.364244 ncdv-master-1 devstack@n-api.service[124063]: [pid: 124063|app: 0|req: 3/4] 10.222.0.52 () {54 vars in 931 bytes} [Sat Sep 24 20:40:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:40:04.804963 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-d75a8335-c7b3-4675-82f4-2898a6b72806 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "cirros256", "rxtx_factor": 1.0, "ram": 256, "swap": 0, "os-flavor-access:is_public": true, "id": "c1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=124064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:40:04.854324 ncdv-master-1 devstack@n-api.service[124064]: INFO nova.api.openstack.requestlog [None req-d75a8335-c7b3-4675-82f4-2898a6b72806 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.484133 Sep 24 20:40:04.854924 ncdv-master-1 devstack@n-api.service[124064]: [pid: 124064|app: 0|req: 2/5] 10.222.0.52 () {64 vars in 1283 bytes} [Sat Sep 24 20:40:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:40:04.870406 ncdv-master-1 devstack@n-api.service[124063]: DEBUG dbcounter [-] [124063] Writing DB stats nova_api:SELECT=3 {{(pid=124063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:40:04.871340 ncdv-master-1 devstack@n-api.service[124063]: DEBUG dbcounter [-] [124063] Writing DB stats nova_cell1:SELECT=3 {{(pid=124063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:40:04.872878 ncdv-master-1 devstack@n-api.service[124063]: DEBUG dbcounter [-] [124063] Writing DB stats nova_cell0:SELECT=3 {{(pid=124063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:40:04.873633 ncdv-master-1 devstack@n-api.service[124063]: DEBUG dbcounter [-] [124063] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=124063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:40:05.079178 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-157f1e9a-7952-41ab-979a-41d54b89d2dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:40:05.148473 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.requestlog [None req-157f1e9a-7952-41ab-979a-41d54b89d2dc admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284221 Sep 24 20:40:05.149058 ncdv-master-1 devstack@n-api.service[124063]: [pid: 124063|app: 0|req: 4/6] 10.222.0.52 () {64 vars in 1336 bytes} [Sat Sep 24 20:40:04 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:40:08.174173 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-d75a8335-c7b3-4675-82f4-2898a6b72806 admin admin] Calling method '>' {{(pid=124064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:40:08.175773 ncdv-master-1 devstack@n-api.service[124064]: INFO nova.api.openstack.requestlog [None req-d75a8335-c7b3-4675-82f4-2898a6b72806 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002123 Sep 24 20:40:08.181431 ncdv-master-1 devstack@n-api.service[124064]: [pid: 124064|app: 0|req: 3/7] 10.222.0.52 () {54 vars in 931 bytes} [Sat Sep 24 20:40:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:40:09.024909 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-22fde85b-4271-43b0-b2c9-84865fee2e44 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "name": "ds512M", "rxtx_factor": 1.0, "disk": 5, "id": "d1"}} {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:40:09.082709 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.requestlog [None req-22fde85b-4271-43b0-b2c9-84865fee2e44 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.899298 Sep 24 20:40:09.083565 ncdv-master-1 devstack@n-api.service[124063]: [pid: 124063|app: 0|req: 5/8] 10.222.0.52 () {64 vars in 1283 bytes} [Sat Sep 24 20:40:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:40:09.096777 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-942393f1-879e-4971-abd8-fadcba0b388b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:40:09.145627 ncdv-master-1 devstack@n-api.service[124064]: INFO nova.api.openstack.requestlog [None req-942393f1-879e-4971-abd8-fadcba0b388b admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052893 Sep 24 20:40:09.147368 ncdv-master-1 devstack@n-api.service[124064]: [pid: 124064|app: 0|req: 4/9] 10.222.0.52 () {64 vars in 1336 bytes} [Sat Sep 24 20:40:09 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:40:12.465645 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-22fde85b-4271-43b0-b2c9-84865fee2e44 admin admin] Calling method '>' {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:40:12.467413 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.requestlog [None req-22fde85b-4271-43b0-b2c9-84865fee2e44 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002510 Sep 24 20:40:12.467966 ncdv-master-1 devstack@n-api.service[124063]: [pid: 124063|app: 0|req: 6/10] 10.222.0.52 () {54 vars in 931 bytes} [Sat Sep 24 20:40:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:40:13.014786 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-c8f10805-8609-433d-a7fa-65c716f23caf admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "ram": 1024, "id": "d2", "disk": 10, "os-flavor-access:is_public": true, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=124064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:40:13.034361 ncdv-master-1 devstack@n-api.service[124064]: INFO nova.api.openstack.requestlog [None req-c8f10805-8609-433d-a7fa-65c716f23caf admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.559858 Sep 24 20:40:13.047046 ncdv-master-1 devstack@n-api.service[124064]: [pid: 124064|app: 0|req: 5/11] 10.222.0.52 () {64 vars in 1283 bytes} [Sat Sep 24 20:40:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 20:40:13.052436 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-0830983b-6cf3-41ea-8cb5-6b420dec7fc8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:40:13.081046 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.requestlog [None req-0830983b-6cf3-41ea-8cb5-6b420dec7fc8 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032227 Sep 24 20:40:13.081636 ncdv-master-1 devstack@n-api.service[124063]: [pid: 124063|app: 0|req: 7/12] 10.222.0.52 () {64 vars in 1336 bytes} [Sat Sep 24 20:40:13 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:40:16.392422 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-c8f10805-8609-433d-a7fa-65c716f23caf admin admin] Calling method '>' {{(pid=124064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:40:16.393528 ncdv-master-1 devstack@n-api.service[124064]: INFO nova.api.openstack.requestlog [None req-c8f10805-8609-433d-a7fa-65c716f23caf admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Sep 24 20:40:16.393940 ncdv-master-1 devstack@n-api.service[124064]: [pid: 124064|app: 0|req: 6/13] 10.222.0.52 () {54 vars in 931 bytes} [Sat Sep 24 20:40:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:40:16.811640 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-8c75ae16-ac52-4eab-9cd7-dc6697a62ca4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "ram": 2048, "vcpus": 2, "id": "d3", "os-flavor-access:is_public": true, "disk": 10}} {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:40:16.831969 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.requestlog [None req-8c75ae16-ac52-4eab-9cd7-dc6697a62ca4 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.431141 Sep 24 20:40:16.832563 ncdv-master-1 devstack@n-api.service[124063]: [pid: 124063|app: 0|req: 8/14] 10.222.0.52 () {64 vars in 1283 bytes} [Sat Sep 24 20:40:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:40:16.845525 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-40e44c2f-34c8-4d51-b191-01e04175fe5e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:40:16.872236 ncdv-master-1 devstack@n-api.service[124064]: INFO nova.api.openstack.requestlog [None req-40e44c2f-34c8-4d51-b191-01e04175fe5e admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030457 Sep 24 20:40:16.872810 ncdv-master-1 devstack@n-api.service[124064]: [pid: 124064|app: 0|req: 7/15] 10.222.0.52 () {64 vars in 1336 bytes} [Sat Sep 24 20:40:16 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:40:19.819846 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-8c75ae16-ac52-4eab-9cd7-dc6697a62ca4 admin admin] Calling method '>' {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:40:19.821645 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.requestlog [None req-8c75ae16-ac52-4eab-9cd7-dc6697a62ca4 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002230 Sep 24 20:40:19.822251 ncdv-master-1 devstack@n-api.service[124063]: [pid: 124063|app: 0|req: 9/16] 10.222.0.52 () {54 vars in 931 bytes} [Sat Sep 24 20:40:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:40:20.248053 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-42a96d14-ea5a-436a-aa06-d59d19ee9ff1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "d4", "vcpus": 4, "ram": 4096, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G"}} {{(pid=124064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:40:20.268136 ncdv-master-1 devstack@n-api.service[124064]: INFO nova.api.openstack.requestlog [None req-42a96d14-ea5a-436a-aa06-d59d19ee9ff1 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.437706 Sep 24 20:40:20.268946 ncdv-master-1 devstack@n-api.service[124064]: [pid: 124064|app: 0|req: 8/17] 10.222.0.52 () {64 vars in 1283 bytes} [Sat Sep 24 20:40:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:40:20.281946 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-35f6fa17-5911-4c45-94fc-b7ea6d7df583 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:40:20.306387 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.requestlog [None req-35f6fa17-5911-4c45-94fc-b7ea6d7df583 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028935 Sep 24 20:40:20.317613 ncdv-master-1 devstack@n-api.service[124063]: [pid: 124063|app: 0|req: 10/18] 10.222.0.52 () {64 vars in 1336 bytes} [Sat Sep 24 20:40:20 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:40:23.439766 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-42a96d14-ea5a-436a-aa06-d59d19ee9ff1 admin admin] Calling method '>' {{(pid=124064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:40:23.440847 ncdv-master-1 devstack@n-api.service[124064]: INFO nova.api.openstack.requestlog [None req-42a96d14-ea5a-436a-aa06-d59d19ee9ff1 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Sep 24 20:40:23.441327 ncdv-master-1 devstack@n-api.service[124064]: [pid: 124064|app: 0|req: 9/19] 10.222.0.52 () {54 vars in 931 bytes} [Sat Sep 24 20:40:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:40:23.926976 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-e63c3c3a-aa81-4887-9518-04853efc4d9c admin admin] Calling method '>' {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:40:23.972818 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.requestlog [None req-e63c3c3a-aa81-4887-9518-04853efc4d9c admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.524419 Sep 24 20:40:23.973761 ncdv-master-1 devstack@n-api.service[124063]: [pid: 124063|app: 0|req: 11/20] 10.222.0.52 () {60 vars in 1292 bytes} [Sat Sep 24 20:40:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:40:27.291604 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-42a96d14-ea5a-436a-aa06-d59d19ee9ff1 admin admin] Calling method '>' {{(pid=124064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:40:27.293182 ncdv-master-1 devstack@n-api.service[124064]: INFO nova.api.openstack.requestlog [None req-42a96d14-ea5a-436a-aa06-d59d19ee9ff1 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002012 Sep 24 20:40:27.293609 ncdv-master-1 devstack@n-api.service[124064]: [pid: 124064|app: 0|req: 10/21] 10.222.0.52 () {54 vars in 931 bytes} [Sat Sep 24 20:40:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:40:27.744673 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-3e2e6f3b-1e4a-4f52-beab-4503e218a227 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "id": "1", "name": "m1.tiny"}} {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:40:27.776582 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.requestlog [None req-3e2e6f3b-1e4a-4f52-beab-4503e218a227 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.476132 Sep 24 20:40:27.777124 ncdv-master-1 devstack@n-api.service[124063]: [pid: 124063|app: 0|req: 12/22] 10.222.0.52 () {64 vars in 1283 bytes} [Sat Sep 24 20:40:27 2022] POST /compute/v2.1/flavors => generated 402 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 20:40:27.789692 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-cb6e9c9c-6703-4eba-9a0b-fa05df6ffc01 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:40:27.818058 ncdv-master-1 devstack@n-api.service[124064]: INFO nova.api.openstack.requestlog [None req-cb6e9c9c-6703-4eba-9a0b-fa05df6ffc01 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031954 Sep 24 20:40:27.818727 ncdv-master-1 devstack@n-api.service[124064]: [pid: 124064|app: 0|req: 11/23] 10.222.0.52 () {64 vars in 1333 bytes} [Sat Sep 24 20:40:27 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:40:30.937076 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-3e2e6f3b-1e4a-4f52-beab-4503e218a227 admin admin] Calling method '>' {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:40:30.938090 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.requestlog [None req-3e2e6f3b-1e4a-4f52-beab-4503e218a227 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Sep 24 20:40:30.938513 ncdv-master-1 devstack@n-api.service[124063]: [pid: 124063|app: 0|req: 13/24] 10.222.0.52 () {54 vars in 931 bytes} [Sat Sep 24 20:40:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:40:31.343542 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-804c91a4-fddc-49ba-8639-1691a5a500e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "m1.small", "rxtx_factor": 1.0, "ram": 2048, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=124064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:40:31.349087 ncdv-master-1 devstack@n-api.service[124064]: DEBUG dbcounter [-] [124064] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=124064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:40:31.365872 ncdv-master-1 devstack@n-api.service[124064]: INFO nova.api.openstack.requestlog [None req-804c91a4-fddc-49ba-8639-1691a5a500e2 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.421331 Sep 24 20:40:31.366457 ncdv-master-1 devstack@n-api.service[124064]: [pid: 124064|app: 0|req: 12/25] 10.222.0.52 () {64 vars in 1283 bytes} [Sat Sep 24 20:40:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:40:31.379360 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-eadc745d-6961-4d4d-8cbd-401302168872 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:40:31.402155 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.requestlog [None req-eadc745d-6961-4d4d-8cbd-401302168872 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026520 Sep 24 20:40:31.402828 ncdv-master-1 devstack@n-api.service[124063]: [pid: 124063|app: 0|req: 14/26] 10.222.0.52 () {64 vars in 1333 bytes} [Sat Sep 24 20:40:31 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:40:34.371611 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-804c91a4-fddc-49ba-8639-1691a5a500e2 admin admin] Calling method '>' {{(pid=124064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:40:34.372668 ncdv-master-1 devstack@n-api.service[124064]: INFO nova.api.openstack.requestlog [None req-804c91a4-fddc-49ba-8639-1691a5a500e2 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Sep 24 20:40:34.373064 ncdv-master-1 devstack@n-api.service[124064]: [pid: 124064|app: 0|req: 13/27] 10.222.0.52 () {54 vars in 931 bytes} [Sat Sep 24 20:40:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:40:34.833217 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-5ac57a4d-d254-408a-b99f-15dc3e001e44 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "disk": 40, "vcpus": 2, "os-flavor-access:is_public": true, "id": "3", "name": "m1.medium"}} {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:40:34.856589 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.requestlog [None req-5ac57a4d-d254-408a-b99f-15dc3e001e44 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.476436 Sep 24 20:40:34.857484 ncdv-master-1 devstack@n-api.service[124063]: [pid: 124063|app: 0|req: 15/28] 10.222.0.52 () {64 vars in 1283 bytes} [Sat Sep 24 20:40:34 2022] POST /compute/v2.1/flavors => generated 406 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 20:40:34.870704 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-85e17bbc-641d-4149-b14d-bab6c622b1cb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:40:34.899971 ncdv-master-1 devstack@n-api.service[124064]: INFO nova.api.openstack.requestlog [None req-85e17bbc-641d-4149-b14d-bab6c622b1cb admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034052 Sep 24 20:40:34.900865 ncdv-master-1 devstack@n-api.service[124064]: [pid: 124064|app: 0|req: 14/29] 10.222.0.52 () {64 vars in 1333 bytes} [Sat Sep 24 20:40:34 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:40:37.948329 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-5ac57a4d-d254-408a-b99f-15dc3e001e44 admin admin] Calling method '>' {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:40:37.949246 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.requestlog [None req-5ac57a4d-d254-408a-b99f-15dc3e001e44 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 24 20:40:37.950349 ncdv-master-1 devstack@n-api.service[124063]: [pid: 124063|app: 0|req: 16/30] 10.222.0.52 () {54 vars in 931 bytes} [Sat Sep 24 20:40:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:40:38.384258 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-51de5ed0-dc85-4a89-b137-0c845dbe947c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "ram": 8192, "rxtx_factor": 1.0, "disk": 80, "vcpus": 4, "name": "m1.large", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=124064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:40:38.408313 ncdv-master-1 devstack@n-api.service[124064]: INFO nova.api.openstack.requestlog [None req-51de5ed0-dc85-4a89-b137-0c845dbe947c admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.451375 Sep 24 20:40:38.416561 ncdv-master-1 devstack@n-api.service[124064]: [pid: 124064|app: 0|req: 15/31] 10.222.0.52 () {64 vars in 1283 bytes} [Sat Sep 24 20:40:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 20:40:38.421520 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-5c7998f1-be6e-4dec-b55a-bb2e471574d6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:40:38.426998 ncdv-master-1 devstack@n-api.service[124063]: DEBUG dbcounter [-] [124063] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=124063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:40:38.451393 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.requestlog [None req-5c7998f1-be6e-4dec-b55a-bb2e471574d6 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033616 Sep 24 20:40:38.458644 ncdv-master-1 devstack@n-api.service[124063]: [pid: 124063|app: 0|req: 17/32] 10.222.0.52 () {64 vars in 1333 bytes} [Sat Sep 24 20:40:38 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:40:41.396723 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-51de5ed0-dc85-4a89-b137-0c845dbe947c admin admin] Calling method '>' {{(pid=124064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:40:41.398389 ncdv-master-1 devstack@n-api.service[124064]: INFO nova.api.openstack.requestlog [None req-51de5ed0-dc85-4a89-b137-0c845dbe947c admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002105 Sep 24 20:40:41.398977 ncdv-master-1 devstack@n-api.service[124064]: [pid: 124064|app: 0|req: 16/33] 10.222.0.52 () {54 vars in 931 bytes} [Sat Sep 24 20:40:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:40:41.877849 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-a922f4c8-480a-478e-ae00-8135ff15a03e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "swap": 0, "os-flavor-access:is_public": true, "disk": 160, "rxtx_factor": 1.0, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "vcpus": 8}} {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:40:41.907763 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.requestlog [None req-a922f4c8-480a-478e-ae00-8135ff15a03e admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.502581 Sep 24 20:40:41.908354 ncdv-master-1 devstack@n-api.service[124063]: [pid: 124063|app: 0|req: 18/34] 10.222.0.52 () {64 vars in 1283 bytes} [Sat Sep 24 20:40:41 2022] POST /compute/v2.1/flavors => generated 408 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:40:41.921121 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-24023884-6758-4f6f-92c3-4559c366e29f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:40:41.949331 ncdv-master-1 devstack@n-api.service[124064]: INFO nova.api.openstack.requestlog [None req-24023884-6758-4f6f-92c3-4559c366e29f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032689 Sep 24 20:40:41.950380 ncdv-master-1 devstack@n-api.service[124064]: [pid: 124064|app: 0|req: 17/35] 10.222.0.52 () {64 vars in 1333 bytes} [Sat Sep 24 20:40:41 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:41:01.479958 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-a922f4c8-480a-478e-ae00-8135ff15a03e admin admin] Calling method '>' {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:41:01.481344 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.requestlog [None req-a922f4c8-480a-478e-ae00-8135ff15a03e admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001648 Sep 24 20:41:01.481753 ncdv-master-1 devstack@n-api.service[124063]: [pid: 124063|app: 0|req: 19/36] 10.222.0.52 () {54 vars in 931 bytes} [Sat Sep 24 20:41:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:41:01.492353 ncdv-master-1 devstack@n-api.service[124064]: DEBUG dbcounter [-] [124064] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=124064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:41:01.871868 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-5008b37a-6a33-4c0a-9794-bdeffe2dfc59 admin admin] Calling method '>' {{(pid=124064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:41:01.890510 ncdv-master-1 devstack@n-api.service[124064]: INFO nova.api.openstack.requestlog [None req-5008b37a-6a33-4c0a-9794-bdeffe2dfc59 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.402600 Sep 24 20:41:01.891045 ncdv-master-1 devstack@n-api.service[124064]: [pid: 124064|app: 0|req: 18/37] 10.222.0.52 () {60 vars in 1292 bytes} [Sat Sep 24 20:41:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:41:03.804501 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-a922f4c8-480a-478e-ae00-8135ff15a03e admin admin] Calling method '>' {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:41:03.805537 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.requestlog [None req-a922f4c8-480a-478e-ae00-8135ff15a03e admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 24 20:41:03.805940 ncdv-master-1 devstack@n-api.service[124063]: [pid: 124063|app: 0|req: 20/38] 10.222.0.52 () {56 vars in 1074 bytes} [Sat Sep 24 20:41:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:41:04.396243 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-9194f77b-dee3-4286-9ba9-5dd40bfa0347 admin admin] Calling method '>' {{(pid=124064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:41:04.401434 ncdv-master-1 devstack@n-api.service[124064]: INFO nova.api.openstack.wsgi [None req-9194f77b-dee3-4286-9ba9-5dd40bfa0347 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 24 20:41:04.413686 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-9194f77b-dee3-4286-9ba9-5dd40bfa0347 admin admin] Request method failure captured: Sep 24 20:41:04.413686 ncdv-master-1 devstack@n-api.service[124064]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 24 20:41:04.413686 ncdv-master-1 devstack@n-api.service[124064]: Accept: application/json Sep 24 20:41:04.413686 ncdv-master-1 devstack@n-api.service[124064]: Accept-Encoding: gzip, deflate Sep 24 20:41:04.413686 ncdv-master-1 devstack@n-api.service[124064]: Connection: keep-alive Sep 24 20:41:04.413686 ncdv-master-1 devstack@n-api.service[124064]: Content-Length: 0 Sep 24 20:41:04.413686 ncdv-master-1 devstack@n-api.service[124064]: Host: 10.222.0.52 Sep 24 20:41:04.413686 ncdv-master-1 devstack@n-api.service[124064]: Openstack-Api-Version: compute 2.92 Sep 24 20:41:04.413686 ncdv-master-1 devstack@n-api.service[124064]: Openstack-System-Scope: None Sep 24 20:41:04.413686 ncdv-master-1 devstack@n-api.service[124064]: User-Agent: python-novaclient Sep 24 20:41:04.413686 ncdv-master-1 devstack@n-api.service[124064]: X-Auth-Token: gAAAAABjL2tfgLnTVw56p5uHLzUkQzI-aeX5kJpY7rYjOC8c98HLh68HGnrPrlb3-UB9JUIn0TvYaqDXYiF4GnRBz0TgpBQZKUggBs_7GENRybisy3jT16X_9zuhyLSuAMphlW8iQpNblE8RTrRyq9SYgvpI1cJAcuFJua_gcDmBGTfXxuRYdBU Sep 24 20:41:04.413686 ncdv-master-1 devstack@n-api.service[124064]: X-Domain-Id: None Sep 24 20:41:04.413686 ncdv-master-1 devstack@n-api.service[124064]: X-Domain-Name: None Sep 24 20:41:04.413686 ncdv-master-1 devstack@n-api.service[124064]: X-Identity-Status: Confirmed Sep 24 20:41:04.413686 ncdv-master-1 devstack@n-api.service[124064]: X-Is-Admin-Project: True Sep 24 20:41:04.413686 ncdv-master-1 devstack@n-api.service[124064]: X-Openstack-Nova-Api-Version: 2.92 Sep 24 20:41:04.413686 ncdv-master-1 devstack@n-api.service[124064]: X-Project-Domain-Id: default Sep 24 20:41:04.413686 ncdv-master-1 devstack@n-api.service[124064]: X-Project-Domain-Name: Default Sep 24 20:41:04.413686 ncdv-master-1 devstack@n-api.service[124064]: X-Project-Id: a8f45f34e55f4f50b20d34824a4e60af Sep 24 20:41:04.413686 ncdv-master-1 devstack@n-api.service[124064]: X-Project-Name: admin Sep 24 20:41:04.413686 ncdv-master-1 devstack@n-api.service[124064]: X-Role: admin,reader,member Sep 24 20:41:04.413686 ncdv-master-1 devstack@n-api.service[124064]: X-Roles: admin,reader,member Sep 24 20:41:04.415482 ncdv-master-1 devstack@n-api.service[124064]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a8f45f34e55f4f50b20d34824a4e60af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a8f45f34e55f4f50b20d34824a4e60af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a8f45f34e55f4f50b20d34824a4e60af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a8f45f34e55f4f50b20d34824a4e60af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:41:04.415482 ncdv-master-1 devstack@n-api.service[124064]: X-Tenant: admin Sep 24 20:41:04.415482 ncdv-master-1 devstack@n-api.service[124064]: X-Tenant-Id: a8f45f34e55f4f50b20d34824a4e60af Sep 24 20:41:04.415482 ncdv-master-1 devstack@n-api.service[124064]: X-Tenant-Name: admin Sep 24 20:41:04.415482 ncdv-master-1 devstack@n-api.service[124064]: X-User: admin Sep 24 20:41:04.415482 ncdv-master-1 devstack@n-api.service[124064]: X-User-Domain-Id: default Sep 24 20:41:04.415482 ncdv-master-1 devstack@n-api.service[124064]: X-User-Domain-Name: Default Sep 24 20:41:04.415482 ncdv-master-1 devstack@n-api.service[124064]: X-User-Id: b34a84022bc34fe0bb926f7c649f3ee4 Sep 24 20:41:04.415482 ncdv-master-1 devstack@n-api.service[124064]: X-User-Name: admin Sep 24 20:41:04.415482 ncdv-master-1 devstack@n-api.service[124064]: method: > Sep 24 20:41:04.415482 ncdv-master-1 devstack@n-api.service[124064]: exception: Flavor 42 could not be found. Sep 24 20:41:04.415482 ncdv-master-1 devstack@n-api.service[124064]: action_args: {'id': '42'} Sep 24 20:41:04.415482 ncdv-master-1 devstack@n-api.service[124064]: {{(pid=124064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:41:04.415482 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:41:04.416510 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 24 20:41:04.416510 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 24 20:41:04.416510 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 24 20:41:04.416510 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 24 20:41:04.416510 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 20:41:04.416510 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 20:41:04.416510 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 24 20:41:04.416510 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 24 20:41:04.416510 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 24 20:41:04.416510 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:41:04.416510 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 24 20:41:04.416510 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 24 20:41:04.416510 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 24 20:41:04.416510 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi Sep 24 20:41:04.416510 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:41:04.416510 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi Sep 24 20:41:04.416510 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:41:04.416510 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:41:04.416510 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:41:04.418712 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:41:04.418712 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:41:04.418712 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:41:04.418712 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:41:04.418712 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 24 20:41:04.418712 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:41:04.418712 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 24 20:41:04.418712 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi Sep 24 20:41:04.418712 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:41:04.418712 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi Sep 24 20:41:04.418712 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:41:04.418712 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:41:04.418712 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:41:04.418712 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:41:04.418712 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:41:04.418712 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 24 20:41:04.418712 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi Sep 24 20:41:04.418712 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-9194f77b-dee3-4286-9ba9-5dd40bfa0347 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=124064) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:41:04.420278 ncdv-master-1 devstack@n-api.service[124064]: INFO nova.api.openstack.requestlog [None req-9194f77b-dee3-4286-9ba9-5dd40bfa0347 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.404880 Sep 24 20:41:04.420278 ncdv-master-1 devstack@n-api.service[124064]: [pid: 124064|app: 0|req: 19/39] 10.222.0.52 () {60 vars in 1190 bytes} [Sat Sep 24 20:41:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 24 20:41:04.425721 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-50db1a22-68ce-4ad0-905a-e18a765a8676 admin admin] Calling method '>' {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:41:04.429796 ncdv-master-1 devstack@n-api.service[124063]: DEBUG dbcounter [-] [124063] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=124063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:41:04.448955 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.requestlog [None req-50db1a22-68ce-4ad0-905a-e18a765a8676 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026796 Sep 24 20:41:04.449657 ncdv-master-1 devstack@n-api.service[124063]: [pid: 124063|app: 0|req: 21/40] 10.222.0.52 () {60 vars in 1210 bytes} [Sat Sep 24 20:41:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:41:04.460609 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-21b6ddcb-d363-4791-a359-04f7e4b93160 admin admin] Calling method '>' {{(pid=124064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:41:04.483917 ncdv-master-1 devstack@n-api.service[124064]: INFO nova.api.openstack.requestlog [None req-21b6ddcb-d363-4791-a359-04f7e4b93160 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027834 Sep 24 20:41:04.484456 ncdv-master-1 devstack@n-api.service[124064]: [pid: 124064|app: 0|req: 20/41] 10.222.0.52 () {60 vars in 1210 bytes} [Sat Sep 24 20:41:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:41:04.493932 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-16f0500f-e093-4f3b-8a38-4ca614b230de admin admin] Calling method '>' {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:41:04.499718 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.wsgi [None req-16f0500f-e093-4f3b-8a38-4ca614b230de admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 24 20:41:04.502965 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-16f0500f-e093-4f3b-8a38-4ca614b230de admin admin] Request method failure captured: Sep 24 20:41:04.502965 ncdv-master-1 devstack@n-api.service[124063]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 24 20:41:04.502965 ncdv-master-1 devstack@n-api.service[124063]: Accept: application/json Sep 24 20:41:04.502965 ncdv-master-1 devstack@n-api.service[124063]: Accept-Encoding: gzip, deflate Sep 24 20:41:04.502965 ncdv-master-1 devstack@n-api.service[124063]: Connection: keep-alive Sep 24 20:41:04.502965 ncdv-master-1 devstack@n-api.service[124063]: Content-Length: 0 Sep 24 20:41:04.502965 ncdv-master-1 devstack@n-api.service[124063]: Host: 10.222.0.52 Sep 24 20:41:04.502965 ncdv-master-1 devstack@n-api.service[124063]: Openstack-Api-Version: compute 2.92 Sep 24 20:41:04.502965 ncdv-master-1 devstack@n-api.service[124063]: Openstack-System-Scope: None Sep 24 20:41:04.502965 ncdv-master-1 devstack@n-api.service[124063]: User-Agent: python-novaclient Sep 24 20:41:04.502965 ncdv-master-1 devstack@n-api.service[124063]: X-Auth-Token: gAAAAABjL2tfgLnTVw56p5uHLzUkQzI-aeX5kJpY7rYjOC8c98HLh68HGnrPrlb3-UB9JUIn0TvYaqDXYiF4GnRBz0TgpBQZKUggBs_7GENRybisy3jT16X_9zuhyLSuAMphlW8iQpNblE8RTrRyq9SYgvpI1cJAcuFJua_gcDmBGTfXxuRYdBU Sep 24 20:41:04.502965 ncdv-master-1 devstack@n-api.service[124063]: X-Domain-Id: None Sep 24 20:41:04.502965 ncdv-master-1 devstack@n-api.service[124063]: X-Domain-Name: None Sep 24 20:41:04.502965 ncdv-master-1 devstack@n-api.service[124063]: X-Identity-Status: Confirmed Sep 24 20:41:04.502965 ncdv-master-1 devstack@n-api.service[124063]: X-Is-Admin-Project: True Sep 24 20:41:04.502965 ncdv-master-1 devstack@n-api.service[124063]: X-Openstack-Nova-Api-Version: 2.92 Sep 24 20:41:04.502965 ncdv-master-1 devstack@n-api.service[124063]: X-Project-Domain-Id: default Sep 24 20:41:04.502965 ncdv-master-1 devstack@n-api.service[124063]: X-Project-Domain-Name: Default Sep 24 20:41:04.502965 ncdv-master-1 devstack@n-api.service[124063]: X-Project-Id: a8f45f34e55f4f50b20d34824a4e60af Sep 24 20:41:04.502965 ncdv-master-1 devstack@n-api.service[124063]: X-Project-Name: admin Sep 24 20:41:04.502965 ncdv-master-1 devstack@n-api.service[124063]: X-Role: admin,reader,member Sep 24 20:41:04.502965 ncdv-master-1 devstack@n-api.service[124063]: X-Roles: admin,reader,member Sep 24 20:41:04.504502 ncdv-master-1 devstack@n-api.service[124063]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a8f45f34e55f4f50b20d34824a4e60af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a8f45f34e55f4f50b20d34824a4e60af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a8f45f34e55f4f50b20d34824a4e60af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a8f45f34e55f4f50b20d34824a4e60af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:41:04.504502 ncdv-master-1 devstack@n-api.service[124063]: X-Tenant: admin Sep 24 20:41:04.504502 ncdv-master-1 devstack@n-api.service[124063]: X-Tenant-Id: a8f45f34e55f4f50b20d34824a4e60af Sep 24 20:41:04.504502 ncdv-master-1 devstack@n-api.service[124063]: X-Tenant-Name: admin Sep 24 20:41:04.504502 ncdv-master-1 devstack@n-api.service[124063]: X-User: admin Sep 24 20:41:04.504502 ncdv-master-1 devstack@n-api.service[124063]: X-User-Domain-Id: default Sep 24 20:41:04.504502 ncdv-master-1 devstack@n-api.service[124063]: X-User-Domain-Name: Default Sep 24 20:41:04.504502 ncdv-master-1 devstack@n-api.service[124063]: X-User-Id: b34a84022bc34fe0bb926f7c649f3ee4 Sep 24 20:41:04.504502 ncdv-master-1 devstack@n-api.service[124063]: X-User-Name: admin Sep 24 20:41:04.504502 ncdv-master-1 devstack@n-api.service[124063]: method: > Sep 24 20:41:04.504502 ncdv-master-1 devstack@n-api.service[124063]: exception: Flavor 42 could not be found. Sep 24 20:41:04.504502 ncdv-master-1 devstack@n-api.service[124063]: action_args: {'id': '42'} Sep 24 20:41:04.504502 ncdv-master-1 devstack@n-api.service[124063]: {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:41:04.504502 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:41:04.505395 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 24 20:41:04.505395 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 24 20:41:04.505395 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 24 20:41:04.505395 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 24 20:41:04.505395 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 20:41:04.505395 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 20:41:04.505395 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 24 20:41:04.505395 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 24 20:41:04.505395 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 24 20:41:04.505395 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:41:04.505395 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 24 20:41:04.505395 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 24 20:41:04.505395 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 24 20:41:04.505395 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi Sep 24 20:41:04.505395 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:41:04.505395 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi Sep 24 20:41:04.505395 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:41:04.505395 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:41:04.505395 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:41:04.506714 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:41:04.506714 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:41:04.506714 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:41:04.506714 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:41:04.506714 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 24 20:41:04.506714 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:41:04.506714 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 24 20:41:04.506714 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi Sep 24 20:41:04.506714 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:41:04.506714 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi Sep 24 20:41:04.506714 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:41:04.506714 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:41:04.506714 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:41:04.506714 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:41:04.506714 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:41:04.506714 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 24 20:41:04.506714 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi Sep 24 20:41:04.506714 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-16f0500f-e093-4f3b-8a38-4ca614b230de admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=124063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:41:04.507980 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.requestlog [None req-16f0500f-e093-4f3b-8a38-4ca614b230de admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014001 Sep 24 20:41:04.507980 ncdv-master-1 devstack@n-api.service[124063]: [pid: 124063|app: 0|req: 22/42] 10.222.0.52 () {60 vars in 1190 bytes} [Sat Sep 24 20:41:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 24 20:41:06.309875 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-21b6ddcb-d363-4791-a359-04f7e4b93160 admin admin] Calling method '>' {{(pid=124064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:41:06.310908 ncdv-master-1 devstack@n-api.service[124064]: INFO nova.api.openstack.requestlog [None req-21b6ddcb-d363-4791-a359-04f7e4b93160 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002081 Sep 24 20:41:06.311306 ncdv-master-1 devstack@n-api.service[124064]: [pid: 124064|app: 0|req: 21/43] 10.222.0.52 () {56 vars in 1074 bytes} [Sat Sep 24 20:41:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:41:06.861853 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-a6f86530-6ae2-4932-b3ed-af5a2307c75b admin admin] Calling method '>' {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:41:06.866926 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.wsgi [None req-a6f86530-6ae2-4932-b3ed-af5a2307c75b admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 24 20:41:06.868429 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-a6f86530-6ae2-4932-b3ed-af5a2307c75b admin admin] Request method failure captured: Sep 24 20:41:06.868429 ncdv-master-1 devstack@n-api.service[124063]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 24 20:41:06.868429 ncdv-master-1 devstack@n-api.service[124063]: Accept: application/json Sep 24 20:41:06.868429 ncdv-master-1 devstack@n-api.service[124063]: Accept-Encoding: gzip, deflate Sep 24 20:41:06.868429 ncdv-master-1 devstack@n-api.service[124063]: Connection: keep-alive Sep 24 20:41:06.868429 ncdv-master-1 devstack@n-api.service[124063]: Content-Length: 0 Sep 24 20:41:06.868429 ncdv-master-1 devstack@n-api.service[124063]: Host: 10.222.0.52 Sep 24 20:41:06.868429 ncdv-master-1 devstack@n-api.service[124063]: Openstack-Api-Version: compute 2.92 Sep 24 20:41:06.868429 ncdv-master-1 devstack@n-api.service[124063]: Openstack-System-Scope: None Sep 24 20:41:06.868429 ncdv-master-1 devstack@n-api.service[124063]: User-Agent: python-novaclient Sep 24 20:41:06.868429 ncdv-master-1 devstack@n-api.service[124063]: X-Auth-Token: gAAAAABjL2tiOvNUSQYDpbnJZE8eYKS0awRXa4EunboYJWuJ63r36DxdlUrX_0PKruE_IPsxrETd-mrqVsP0PVyAWoZZXjASxfRnPsMmtnJtBvqGmEhCJXskOT2gyv_Z10qNlFjgepln0QlDPk_wIQZNxTI678zPLL9mqCXV4fwZx0j9lJdrbjA Sep 24 20:41:06.868429 ncdv-master-1 devstack@n-api.service[124063]: X-Domain-Id: None Sep 24 20:41:06.868429 ncdv-master-1 devstack@n-api.service[124063]: X-Domain-Name: None Sep 24 20:41:06.868429 ncdv-master-1 devstack@n-api.service[124063]: X-Identity-Status: Confirmed Sep 24 20:41:06.868429 ncdv-master-1 devstack@n-api.service[124063]: X-Is-Admin-Project: True Sep 24 20:41:06.868429 ncdv-master-1 devstack@n-api.service[124063]: X-Openstack-Nova-Api-Version: 2.92 Sep 24 20:41:06.868429 ncdv-master-1 devstack@n-api.service[124063]: X-Project-Domain-Id: default Sep 24 20:41:06.868429 ncdv-master-1 devstack@n-api.service[124063]: X-Project-Domain-Name: Default Sep 24 20:41:06.868429 ncdv-master-1 devstack@n-api.service[124063]: X-Project-Id: a8f45f34e55f4f50b20d34824a4e60af Sep 24 20:41:06.868429 ncdv-master-1 devstack@n-api.service[124063]: X-Project-Name: admin Sep 24 20:41:06.868429 ncdv-master-1 devstack@n-api.service[124063]: X-Role: admin,reader,member Sep 24 20:41:06.868429 ncdv-master-1 devstack@n-api.service[124063]: X-Roles: admin,reader,member Sep 24 20:41:06.869851 ncdv-master-1 devstack@n-api.service[124063]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a8f45f34e55f4f50b20d34824a4e60af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a8f45f34e55f4f50b20d34824a4e60af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a8f45f34e55f4f50b20d34824a4e60af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a8f45f34e55f4f50b20d34824a4e60af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:41:06.869851 ncdv-master-1 devstack@n-api.service[124063]: X-Tenant: admin Sep 24 20:41:06.869851 ncdv-master-1 devstack@n-api.service[124063]: X-Tenant-Id: a8f45f34e55f4f50b20d34824a4e60af Sep 24 20:41:06.869851 ncdv-master-1 devstack@n-api.service[124063]: X-Tenant-Name: admin Sep 24 20:41:06.869851 ncdv-master-1 devstack@n-api.service[124063]: X-User: admin Sep 24 20:41:06.869851 ncdv-master-1 devstack@n-api.service[124063]: X-User-Domain-Id: default Sep 24 20:41:06.869851 ncdv-master-1 devstack@n-api.service[124063]: X-User-Domain-Name: Default Sep 24 20:41:06.869851 ncdv-master-1 devstack@n-api.service[124063]: X-User-Id: b34a84022bc34fe0bb926f7c649f3ee4 Sep 24 20:41:06.869851 ncdv-master-1 devstack@n-api.service[124063]: X-User-Name: admin Sep 24 20:41:06.869851 ncdv-master-1 devstack@n-api.service[124063]: method: > Sep 24 20:41:06.869851 ncdv-master-1 devstack@n-api.service[124063]: exception: Flavor 84 could not be found. Sep 24 20:41:06.869851 ncdv-master-1 devstack@n-api.service[124063]: action_args: {'id': '84'} Sep 24 20:41:06.869851 ncdv-master-1 devstack@n-api.service[124063]: {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:41:06.869851 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:41:06.871498 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 24 20:41:06.871498 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 24 20:41:06.871498 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 24 20:41:06.871498 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 24 20:41:06.871498 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 20:41:06.871498 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 20:41:06.871498 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 24 20:41:06.871498 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 24 20:41:06.871498 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 24 20:41:06.871498 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:41:06.871498 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 24 20:41:06.871498 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 24 20:41:06.871498 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 24 20:41:06.871498 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi Sep 24 20:41:06.871498 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:41:06.871498 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi Sep 24 20:41:06.871498 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:41:06.871498 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:41:06.871498 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:41:06.873163 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:41:06.873163 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:41:06.873163 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:41:06.873163 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:41:06.873163 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 24 20:41:06.873163 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:41:06.873163 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 24 20:41:06.873163 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi Sep 24 20:41:06.873163 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:41:06.873163 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi Sep 24 20:41:06.873163 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:41:06.873163 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:41:06.873163 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:41:06.873163 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:41:06.873163 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:41:06.873163 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 24 20:41:06.873163 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi Sep 24 20:41:06.873163 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-a6f86530-6ae2-4932-b3ed-af5a2307c75b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=124063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:41:06.874396 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.requestlog [None req-a6f86530-6ae2-4932-b3ed-af5a2307c75b admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.409728 Sep 24 20:41:06.874396 ncdv-master-1 devstack@n-api.service[124063]: [pid: 124063|app: 0|req: 23/44] 10.222.0.52 () {60 vars in 1190 bytes} [Sat Sep 24 20:41:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 411 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 24 20:41:06.880126 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-e93c8780-38d7-4160-a8ec-07f43543aff9 admin admin] Calling method '>' {{(pid=124064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:41:06.899027 ncdv-master-1 devstack@n-api.service[124064]: INFO nova.api.openstack.requestlog [None req-e93c8780-38d7-4160-a8ec-07f43543aff9 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.022581 Sep 24 20:41:06.899572 ncdv-master-1 devstack@n-api.service[124064]: [pid: 124064|app: 0|req: 22/45] 10.222.0.52 () {60 vars in 1210 bytes} [Sat Sep 24 20:41:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:41:06.909772 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-ac08b30c-5674-4f4c-8adf-7e529a7fe954 admin admin] Calling method '>' {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:41:06.926395 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.requestlog [None req-ac08b30c-5674-4f4c-8adf-7e529a7fe954 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020238 Sep 24 20:41:06.926970 ncdv-master-1 devstack@n-api.service[124063]: [pid: 124063|app: 0|req: 24/46] 10.222.0.52 () {60 vars in 1210 bytes} [Sat Sep 24 20:41:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:41:06.936747 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-78592351-2810-48d0-aef9-73eea711df19 admin admin] Calling method '>' {{(pid=124064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:41:06.941689 ncdv-master-1 devstack@n-api.service[124064]: INFO nova.api.openstack.wsgi [None req-78592351-2810-48d0-aef9-73eea711df19 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 24 20:41:06.943226 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-78592351-2810-48d0-aef9-73eea711df19 admin admin] Request method failure captured: Sep 24 20:41:06.943226 ncdv-master-1 devstack@n-api.service[124064]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 24 20:41:06.943226 ncdv-master-1 devstack@n-api.service[124064]: Accept: application/json Sep 24 20:41:06.943226 ncdv-master-1 devstack@n-api.service[124064]: Accept-Encoding: gzip, deflate Sep 24 20:41:06.943226 ncdv-master-1 devstack@n-api.service[124064]: Connection: keep-alive Sep 24 20:41:06.943226 ncdv-master-1 devstack@n-api.service[124064]: Content-Length: 0 Sep 24 20:41:06.943226 ncdv-master-1 devstack@n-api.service[124064]: Host: 10.222.0.52 Sep 24 20:41:06.943226 ncdv-master-1 devstack@n-api.service[124064]: Openstack-Api-Version: compute 2.92 Sep 24 20:41:06.943226 ncdv-master-1 devstack@n-api.service[124064]: Openstack-System-Scope: None Sep 24 20:41:06.943226 ncdv-master-1 devstack@n-api.service[124064]: User-Agent: python-novaclient Sep 24 20:41:06.943226 ncdv-master-1 devstack@n-api.service[124064]: X-Auth-Token: gAAAAABjL2tiOvNUSQYDpbnJZE8eYKS0awRXa4EunboYJWuJ63r36DxdlUrX_0PKruE_IPsxrETd-mrqVsP0PVyAWoZZXjASxfRnPsMmtnJtBvqGmEhCJXskOT2gyv_Z10qNlFjgepln0QlDPk_wIQZNxTI678zPLL9mqCXV4fwZx0j9lJdrbjA Sep 24 20:41:06.943226 ncdv-master-1 devstack@n-api.service[124064]: X-Domain-Id: None Sep 24 20:41:06.943226 ncdv-master-1 devstack@n-api.service[124064]: X-Domain-Name: None Sep 24 20:41:06.943226 ncdv-master-1 devstack@n-api.service[124064]: X-Identity-Status: Confirmed Sep 24 20:41:06.943226 ncdv-master-1 devstack@n-api.service[124064]: X-Is-Admin-Project: True Sep 24 20:41:06.943226 ncdv-master-1 devstack@n-api.service[124064]: X-Openstack-Nova-Api-Version: 2.92 Sep 24 20:41:06.943226 ncdv-master-1 devstack@n-api.service[124064]: X-Project-Domain-Id: default Sep 24 20:41:06.943226 ncdv-master-1 devstack@n-api.service[124064]: X-Project-Domain-Name: Default Sep 24 20:41:06.943226 ncdv-master-1 devstack@n-api.service[124064]: X-Project-Id: a8f45f34e55f4f50b20d34824a4e60af Sep 24 20:41:06.943226 ncdv-master-1 devstack@n-api.service[124064]: X-Project-Name: admin Sep 24 20:41:06.943226 ncdv-master-1 devstack@n-api.service[124064]: X-Role: admin,reader,member Sep 24 20:41:06.943226 ncdv-master-1 devstack@n-api.service[124064]: X-Roles: admin,reader,member Sep 24 20:41:06.944723 ncdv-master-1 devstack@n-api.service[124064]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a8f45f34e55f4f50b20d34824a4e60af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a8f45f34e55f4f50b20d34824a4e60af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a8f45f34e55f4f50b20d34824a4e60af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a8f45f34e55f4f50b20d34824a4e60af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:41:06.944723 ncdv-master-1 devstack@n-api.service[124064]: X-Tenant: admin Sep 24 20:41:06.944723 ncdv-master-1 devstack@n-api.service[124064]: X-Tenant-Id: a8f45f34e55f4f50b20d34824a4e60af Sep 24 20:41:06.944723 ncdv-master-1 devstack@n-api.service[124064]: X-Tenant-Name: admin Sep 24 20:41:06.944723 ncdv-master-1 devstack@n-api.service[124064]: X-User: admin Sep 24 20:41:06.944723 ncdv-master-1 devstack@n-api.service[124064]: X-User-Domain-Id: default Sep 24 20:41:06.944723 ncdv-master-1 devstack@n-api.service[124064]: X-User-Domain-Name: Default Sep 24 20:41:06.944723 ncdv-master-1 devstack@n-api.service[124064]: X-User-Id: b34a84022bc34fe0bb926f7c649f3ee4 Sep 24 20:41:06.944723 ncdv-master-1 devstack@n-api.service[124064]: X-User-Name: admin Sep 24 20:41:06.944723 ncdv-master-1 devstack@n-api.service[124064]: method: > Sep 24 20:41:06.944723 ncdv-master-1 devstack@n-api.service[124064]: exception: Flavor 84 could not be found. Sep 24 20:41:06.944723 ncdv-master-1 devstack@n-api.service[124064]: action_args: {'id': '84'} Sep 24 20:41:06.944723 ncdv-master-1 devstack@n-api.service[124064]: {{(pid=124064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:41:06.944723 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:41:06.945739 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 24 20:41:06.945739 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 24 20:41:06.945739 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 24 20:41:06.945739 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 24 20:41:06.945739 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 20:41:06.945739 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 20:41:06.945739 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 24 20:41:06.945739 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 24 20:41:06.945739 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 24 20:41:06.945739 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:41:06.945739 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 24 20:41:06.945739 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 24 20:41:06.945739 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 24 20:41:06.945739 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi Sep 24 20:41:06.945739 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:41:06.945739 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi Sep 24 20:41:06.945739 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:41:06.945739 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:41:06.945739 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:41:06.947133 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:41:06.947133 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:41:06.947133 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:41:06.947133 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:41:06.947133 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 24 20:41:06.947133 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:41:06.947133 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 24 20:41:06.947133 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi Sep 24 20:41:06.947133 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:41:06.947133 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi Sep 24 20:41:06.947133 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:41:06.947133 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:41:06.947133 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:41:06.947133 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:41:06.947133 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:41:06.947133 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 24 20:41:06.947133 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi Sep 24 20:41:06.947133 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-78592351-2810-48d0-aef9-73eea711df19 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=124064) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:41:06.948496 ncdv-master-1 devstack@n-api.service[124064]: INFO nova.api.openstack.requestlog [None req-78592351-2810-48d0-aef9-73eea711df19 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011894 Sep 24 20:41:06.948496 ncdv-master-1 devstack@n-api.service[124064]: [pid: 124064|app: 0|req: 23/47] 10.222.0.52 () {60 vars in 1190 bytes} [Sat Sep 24 20:41:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 24 20:41:08.729839 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-ac08b30c-5674-4f4c-8adf-7e529a7fe954 admin admin] Calling method '>' {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:41:08.731487 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.requestlog [None req-ac08b30c-5674-4f4c-8adf-7e529a7fe954 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002079 Sep 24 20:41:08.731919 ncdv-master-1 devstack@n-api.service[124063]: [pid: 124063|app: 0|req: 25/48] 10.222.0.52 () {56 vars in 1074 bytes} [Sat Sep 24 20:41:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:41:09.263057 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-3b4f63bd-ae03-4035-92d8-3ee008f3bea9 admin admin] Calling method '>' {{(pid=124064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:41:09.268880 ncdv-master-1 devstack@n-api.service[124064]: INFO nova.api.openstack.wsgi [None req-3b4f63bd-ae03-4035-92d8-3ee008f3bea9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 24 20:41:09.270407 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-3b4f63bd-ae03-4035-92d8-3ee008f3bea9 admin admin] Request method failure captured: Sep 24 20:41:09.270407 ncdv-master-1 devstack@n-api.service[124064]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 24 20:41:09.270407 ncdv-master-1 devstack@n-api.service[124064]: Accept: application/json Sep 24 20:41:09.270407 ncdv-master-1 devstack@n-api.service[124064]: Accept-Encoding: gzip, deflate Sep 24 20:41:09.270407 ncdv-master-1 devstack@n-api.service[124064]: Connection: keep-alive Sep 24 20:41:09.270407 ncdv-master-1 devstack@n-api.service[124064]: Content-Length: 0 Sep 24 20:41:09.270407 ncdv-master-1 devstack@n-api.service[124064]: Host: 10.222.0.52 Sep 24 20:41:09.270407 ncdv-master-1 devstack@n-api.service[124064]: Openstack-Api-Version: compute 2.92 Sep 24 20:41:09.270407 ncdv-master-1 devstack@n-api.service[124064]: Openstack-System-Scope: None Sep 24 20:41:09.270407 ncdv-master-1 devstack@n-api.service[124064]: User-Agent: python-novaclient Sep 24 20:41:09.270407 ncdv-master-1 devstack@n-api.service[124064]: X-Auth-Token: gAAAAABjL2tknzBH2vlM8ZC3BypRBfl5F6-jrARze-OZzJ0ZTzbdxeRQsACp_BnI9sAD3jeIbKa1T7MQ-IdzsPmqGGQlTk3wTYcHVOHsdz85hpuHi4ZzuK3kdTwgNbPmjgltMDJvShPX1kykiuDDuauTtt3JN2RhLuw-MPWfES_xrpWoBTytJPg Sep 24 20:41:09.270407 ncdv-master-1 devstack@n-api.service[124064]: X-Domain-Id: None Sep 24 20:41:09.270407 ncdv-master-1 devstack@n-api.service[124064]: X-Domain-Name: None Sep 24 20:41:09.270407 ncdv-master-1 devstack@n-api.service[124064]: X-Identity-Status: Confirmed Sep 24 20:41:09.270407 ncdv-master-1 devstack@n-api.service[124064]: X-Is-Admin-Project: True Sep 24 20:41:09.270407 ncdv-master-1 devstack@n-api.service[124064]: X-Openstack-Nova-Api-Version: 2.92 Sep 24 20:41:09.270407 ncdv-master-1 devstack@n-api.service[124064]: X-Project-Domain-Id: default Sep 24 20:41:09.270407 ncdv-master-1 devstack@n-api.service[124064]: X-Project-Domain-Name: Default Sep 24 20:41:09.270407 ncdv-master-1 devstack@n-api.service[124064]: X-Project-Id: a8f45f34e55f4f50b20d34824a4e60af Sep 24 20:41:09.270407 ncdv-master-1 devstack@n-api.service[124064]: X-Project-Name: admin Sep 24 20:41:09.270407 ncdv-master-1 devstack@n-api.service[124064]: X-Role: admin,reader,member Sep 24 20:41:09.270407 ncdv-master-1 devstack@n-api.service[124064]: X-Roles: admin,reader,member Sep 24 20:41:09.271944 ncdv-master-1 devstack@n-api.service[124064]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a8f45f34e55f4f50b20d34824a4e60af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a8f45f34e55f4f50b20d34824a4e60af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a8f45f34e55f4f50b20d34824a4e60af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a8f45f34e55f4f50b20d34824a4e60af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:41:09.271944 ncdv-master-1 devstack@n-api.service[124064]: X-Tenant: admin Sep 24 20:41:09.271944 ncdv-master-1 devstack@n-api.service[124064]: X-Tenant-Id: a8f45f34e55f4f50b20d34824a4e60af Sep 24 20:41:09.271944 ncdv-master-1 devstack@n-api.service[124064]: X-Tenant-Name: admin Sep 24 20:41:09.271944 ncdv-master-1 devstack@n-api.service[124064]: X-User: admin Sep 24 20:41:09.271944 ncdv-master-1 devstack@n-api.service[124064]: X-User-Domain-Id: default Sep 24 20:41:09.271944 ncdv-master-1 devstack@n-api.service[124064]: X-User-Domain-Name: Default Sep 24 20:41:09.271944 ncdv-master-1 devstack@n-api.service[124064]: X-User-Id: b34a84022bc34fe0bb926f7c649f3ee4 Sep 24 20:41:09.271944 ncdv-master-1 devstack@n-api.service[124064]: X-User-Name: admin Sep 24 20:41:09.271944 ncdv-master-1 devstack@n-api.service[124064]: method: > Sep 24 20:41:09.271944 ncdv-master-1 devstack@n-api.service[124064]: exception: Flavor 451 could not be found. Sep 24 20:41:09.271944 ncdv-master-1 devstack@n-api.service[124064]: action_args: {'id': '451'} Sep 24 20:41:09.271944 ncdv-master-1 devstack@n-api.service[124064]: {{(pid=124064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:41:09.271944 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:41:09.273076 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 24 20:41:09.273076 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 24 20:41:09.273076 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 24 20:41:09.273076 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 24 20:41:09.273076 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 20:41:09.273076 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 20:41:09.273076 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 24 20:41:09.273076 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 24 20:41:09.273076 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 24 20:41:09.273076 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:41:09.273076 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 24 20:41:09.273076 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 24 20:41:09.273076 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 24 20:41:09.273076 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi Sep 24 20:41:09.273076 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:41:09.273076 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi Sep 24 20:41:09.273076 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:41:09.273076 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:41:09.273076 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:41:09.274483 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:41:09.274483 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:41:09.274483 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:41:09.274483 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:41:09.274483 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 24 20:41:09.274483 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:41:09.274483 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 24 20:41:09.274483 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi Sep 24 20:41:09.274483 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:41:09.274483 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi Sep 24 20:41:09.274483 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:41:09.274483 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:41:09.274483 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:41:09.274483 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:41:09.274483 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:41:09.274483 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 24 20:41:09.274483 ncdv-master-1 devstack@n-api.service[124064]: ERROR nova.api.openstack.wsgi Sep 24 20:41:09.274483 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-3b4f63bd-ae03-4035-92d8-3ee008f3bea9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=124064) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:41:09.275792 ncdv-master-1 devstack@n-api.service[124064]: INFO nova.api.openstack.requestlog [None req-3b4f63bd-ae03-4035-92d8-3ee008f3bea9 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.393857 Sep 24 20:41:09.275792 ncdv-master-1 devstack@n-api.service[124064]: [pid: 124064|app: 0|req: 24/49] 10.222.0.52 () {60 vars in 1193 bytes} [Sat Sep 24 20:41:08 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 24 20:41:09.282682 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-fb6500b6-6679-4c72-a258-7961ca4e2518 admin admin] Calling method '>' {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:41:09.298533 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.requestlog [None req-fb6500b6-6679-4c72-a258-7961ca4e2518 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020026 Sep 24 20:41:09.299102 ncdv-master-1 devstack@n-api.service[124063]: [pid: 124063|app: 0|req: 26/50] 10.222.0.52 () {60 vars in 1210 bytes} [Sat Sep 24 20:41:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:41:09.309239 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-6b6363ee-2c1d-4be1-b1b1-8f2da27ab9aa admin admin] Calling method '>' {{(pid=124064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:41:09.324432 ncdv-master-1 devstack@n-api.service[124064]: INFO nova.api.openstack.requestlog [None req-6b6363ee-2c1d-4be1-b1b1-8f2da27ab9aa admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019171 Sep 24 20:41:09.324956 ncdv-master-1 devstack@n-api.service[124064]: [pid: 124064|app: 0|req: 25/51] 10.222.0.52 () {60 vars in 1210 bytes} [Sat Sep 24 20:41:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:41:09.334283 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-9445871f-d97c-4e38-a10a-830d070f3fe9 admin admin] Calling method '>' {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:41:09.339297 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.wsgi [None req-9445871f-d97c-4e38-a10a-830d070f3fe9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 24 20:41:09.341021 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-9445871f-d97c-4e38-a10a-830d070f3fe9 admin admin] Request method failure captured: Sep 24 20:41:09.341021 ncdv-master-1 devstack@n-api.service[124063]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 24 20:41:09.341021 ncdv-master-1 devstack@n-api.service[124063]: Accept: application/json Sep 24 20:41:09.341021 ncdv-master-1 devstack@n-api.service[124063]: Accept-Encoding: gzip, deflate Sep 24 20:41:09.341021 ncdv-master-1 devstack@n-api.service[124063]: Connection: keep-alive Sep 24 20:41:09.341021 ncdv-master-1 devstack@n-api.service[124063]: Content-Length: 0 Sep 24 20:41:09.341021 ncdv-master-1 devstack@n-api.service[124063]: Host: 10.222.0.52 Sep 24 20:41:09.341021 ncdv-master-1 devstack@n-api.service[124063]: Openstack-Api-Version: compute 2.92 Sep 24 20:41:09.341021 ncdv-master-1 devstack@n-api.service[124063]: Openstack-System-Scope: None Sep 24 20:41:09.341021 ncdv-master-1 devstack@n-api.service[124063]: User-Agent: python-novaclient Sep 24 20:41:09.341021 ncdv-master-1 devstack@n-api.service[124063]: X-Auth-Token: gAAAAABjL2tknzBH2vlM8ZC3BypRBfl5F6-jrARze-OZzJ0ZTzbdxeRQsACp_BnI9sAD3jeIbKa1T7MQ-IdzsPmqGGQlTk3wTYcHVOHsdz85hpuHi4ZzuK3kdTwgNbPmjgltMDJvShPX1kykiuDDuauTtt3JN2RhLuw-MPWfES_xrpWoBTytJPg Sep 24 20:41:09.341021 ncdv-master-1 devstack@n-api.service[124063]: X-Domain-Id: None Sep 24 20:41:09.341021 ncdv-master-1 devstack@n-api.service[124063]: X-Domain-Name: None Sep 24 20:41:09.341021 ncdv-master-1 devstack@n-api.service[124063]: X-Identity-Status: Confirmed Sep 24 20:41:09.341021 ncdv-master-1 devstack@n-api.service[124063]: X-Is-Admin-Project: True Sep 24 20:41:09.341021 ncdv-master-1 devstack@n-api.service[124063]: X-Openstack-Nova-Api-Version: 2.92 Sep 24 20:41:09.341021 ncdv-master-1 devstack@n-api.service[124063]: X-Project-Domain-Id: default Sep 24 20:41:09.341021 ncdv-master-1 devstack@n-api.service[124063]: X-Project-Domain-Name: Default Sep 24 20:41:09.341021 ncdv-master-1 devstack@n-api.service[124063]: X-Project-Id: a8f45f34e55f4f50b20d34824a4e60af Sep 24 20:41:09.341021 ncdv-master-1 devstack@n-api.service[124063]: X-Project-Name: admin Sep 24 20:41:09.341021 ncdv-master-1 devstack@n-api.service[124063]: X-Role: admin,reader,member Sep 24 20:41:09.341021 ncdv-master-1 devstack@n-api.service[124063]: X-Roles: admin,reader,member Sep 24 20:41:09.342709 ncdv-master-1 devstack@n-api.service[124063]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a8f45f34e55f4f50b20d34824a4e60af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a8f45f34e55f4f50b20d34824a4e60af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a8f45f34e55f4f50b20d34824a4e60af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a8f45f34e55f4f50b20d34824a4e60af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:41:09.342709 ncdv-master-1 devstack@n-api.service[124063]: X-Tenant: admin Sep 24 20:41:09.342709 ncdv-master-1 devstack@n-api.service[124063]: X-Tenant-Id: a8f45f34e55f4f50b20d34824a4e60af Sep 24 20:41:09.342709 ncdv-master-1 devstack@n-api.service[124063]: X-Tenant-Name: admin Sep 24 20:41:09.342709 ncdv-master-1 devstack@n-api.service[124063]: X-User: admin Sep 24 20:41:09.342709 ncdv-master-1 devstack@n-api.service[124063]: X-User-Domain-Id: default Sep 24 20:41:09.342709 ncdv-master-1 devstack@n-api.service[124063]: X-User-Domain-Name: Default Sep 24 20:41:09.342709 ncdv-master-1 devstack@n-api.service[124063]: X-User-Id: b34a84022bc34fe0bb926f7c649f3ee4 Sep 24 20:41:09.342709 ncdv-master-1 devstack@n-api.service[124063]: X-User-Name: admin Sep 24 20:41:09.342709 ncdv-master-1 devstack@n-api.service[124063]: method: > Sep 24 20:41:09.342709 ncdv-master-1 devstack@n-api.service[124063]: exception: Flavor 451 could not be found. Sep 24 20:41:09.342709 ncdv-master-1 devstack@n-api.service[124063]: action_args: {'id': '451'} Sep 24 20:41:09.342709 ncdv-master-1 devstack@n-api.service[124063]: {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:41:09.342709 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:41:09.343910 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 24 20:41:09.343910 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 24 20:41:09.343910 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 24 20:41:09.343910 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 24 20:41:09.343910 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 20:41:09.343910 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 20:41:09.343910 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 24 20:41:09.343910 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 24 20:41:09.343910 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 24 20:41:09.343910 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:41:09.343910 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 24 20:41:09.343910 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 24 20:41:09.343910 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 24 20:41:09.343910 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi Sep 24 20:41:09.343910 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:41:09.343910 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi Sep 24 20:41:09.343910 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:41:09.343910 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:41:09.343910 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:41:09.345328 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:41:09.345328 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:41:09.345328 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:41:09.345328 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:41:09.345328 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 24 20:41:09.345328 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:41:09.345328 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 24 20:41:09.345328 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi Sep 24 20:41:09.345328 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:41:09.345328 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi Sep 24 20:41:09.345328 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:41:09.345328 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:41:09.345328 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:41:09.345328 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:41:09.345328 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:41:09.345328 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 24 20:41:09.345328 ncdv-master-1 devstack@n-api.service[124063]: ERROR nova.api.openstack.wsgi Sep 24 20:41:09.345328 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-9445871f-d97c-4e38-a10a-830d070f3fe9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=124063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:41:09.346593 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.requestlog [None req-9445871f-d97c-4e38-a10a-830d070f3fe9 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011672 Sep 24 20:41:09.346593 ncdv-master-1 devstack@n-api.service[124063]: [pid: 124063|app: 0|req: 27/52] 10.222.0.52 () {60 vars in 1193 bytes} [Sat Sep 24 20:41:09 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 24 20:41:11.117192 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-6b6363ee-2c1d-4be1-b1b1-8f2da27ab9aa admin admin] Calling method '>' {{(pid=124064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:41:11.118190 ncdv-master-1 devstack@n-api.service[124064]: INFO nova.api.openstack.requestlog [None req-6b6363ee-2c1d-4be1-b1b1-8f2da27ab9aa admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Sep 24 20:41:11.118643 ncdv-master-1 devstack@n-api.service[124064]: [pid: 124064|app: 0|req: 26/53] 10.222.0.52 () {56 vars in 1074 bytes} [Sat Sep 24 20:41:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:41:11.656771 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-49a433cf-3d8e-4e24-b524-7df3345e5e84 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:41:11.675827 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.requestlog [None req-49a433cf-3d8e-4e24-b524-7df3345e5e84 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.407461 Sep 24 20:41:11.676357 ncdv-master-1 devstack@n-api.service[124063]: [pid: 124063|app: 0|req: 28/54] 10.222.0.52 () {64 vars in 1235 bytes} [Sat Sep 24 20:41:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:41:13.460673 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-6b6363ee-2c1d-4be1-b1b1-8f2da27ab9aa admin admin] Calling method '>' {{(pid=124064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:41:13.461699 ncdv-master-1 devstack@n-api.service[124064]: INFO nova.api.openstack.requestlog [None req-6b6363ee-2c1d-4be1-b1b1-8f2da27ab9aa admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 24 20:41:13.462082 ncdv-master-1 devstack@n-api.service[124064]: [pid: 124064|app: 0|req: 27/55] 10.222.0.52 () {56 vars in 1074 bytes} [Sat Sep 24 20:41:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:41:13.994434 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-c00ef83d-6d2c-49b0-97f4-57169047ffd1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:41:14.013565 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.requestlog [None req-c00ef83d-6d2c-49b0-97f4-57169047ffd1 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.402702 Sep 24 20:41:14.014230 ncdv-master-1 devstack@n-api.service[124063]: [pid: 124063|app: 0|req: 29/56] 10.222.0.52 () {64 vars in 1235 bytes} [Sat Sep 24 20:41:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:41:15.798126 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-6b6363ee-2c1d-4be1-b1b1-8f2da27ab9aa admin admin] Calling method '>' {{(pid=124064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:41:15.799182 ncdv-master-1 devstack@n-api.service[124064]: INFO nova.api.openstack.requestlog [None req-6b6363ee-2c1d-4be1-b1b1-8f2da27ab9aa admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Sep 24 20:41:15.799567 ncdv-master-1 devstack@n-api.service[124064]: [pid: 124064|app: 0|req: 28/57] 10.222.0.52 () {56 vars in 1074 bytes} [Sat Sep 24 20:41:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:41:16.332979 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-aca5a0ab-8e30-4cb1-897b-4e6d401af1cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:41:16.351653 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.requestlog [None req-aca5a0ab-8e30-4cb1-897b-4e6d401af1cf admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.399584 Sep 24 20:41:16.352188 ncdv-master-1 devstack@n-api.service[124063]: [pid: 124063|app: 0|req: 30/58] 10.222.0.52 () {64 vars in 1235 bytes} [Sat Sep 24 20:41:15 2022] POST /compute/v2.1/flavors => generated 407 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:41:18.318332 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-6b6363ee-2c1d-4be1-b1b1-8f2da27ab9aa admin admin] Calling method '>' {{(pid=124064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:41:18.319388 ncdv-master-1 devstack@n-api.service[124064]: INFO nova.api.openstack.requestlog [None req-6b6363ee-2c1d-4be1-b1b1-8f2da27ab9aa admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Sep 24 20:41:18.319774 ncdv-master-1 devstack@n-api.service[124064]: [pid: 124064|app: 0|req: 29/59] 10.222.0.52 () {56 vars in 1074 bytes} [Sat Sep 24 20:41:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:41:18.855102 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-40a95754-c311-4f05-87e6-362c36039e78 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:41:18.875695 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.requestlog [None req-40a95754-c311-4f05-87e6-362c36039e78 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.406532 Sep 24 20:41:18.876241 ncdv-master-1 devstack@n-api.service[124063]: [pid: 124063|app: 0|req: 31/60] 10.222.0.52 () {64 vars in 1235 bytes} [Sat Sep 24 20:41:18 2022] POST /compute/v2.1/flavors => generated 409 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:41:20.659084 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-6b6363ee-2c1d-4be1-b1b1-8f2da27ab9aa admin admin] Calling method '>' {{(pid=124064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:41:20.660123 ncdv-master-1 devstack@n-api.service[124064]: INFO nova.api.openstack.requestlog [None req-6b6363ee-2c1d-4be1-b1b1-8f2da27ab9aa admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Sep 24 20:41:20.660634 ncdv-master-1 devstack@n-api.service[124064]: [pid: 124064|app: 0|req: 30/61] 10.222.0.52 () {56 vars in 1074 bytes} [Sat Sep 24 20:41:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:41:21.193310 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-09dafe1a-b785-415f-99f7-46baa2d3160a admin admin] Calling method '>' {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:41:21.213525 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.requestlog [None req-09dafe1a-b785-415f-99f7-46baa2d3160a admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.401835 Sep 24 20:41:21.214057 ncdv-master-1 devstack@n-api.service[124063]: [pid: 124063|app: 0|req: 32/62] 10.222.0.52 () {60 vars in 1202 bytes} [Sat Sep 24 20:41:20 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:42:26.692139 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-6b6363ee-2c1d-4be1-b1b1-8f2da27ab9aa admin admin] Calling method '>' {{(pid=124064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:42:26.693157 ncdv-master-1 devstack@n-api.service[124064]: INFO nova.api.openstack.requestlog [None req-6b6363ee-2c1d-4be1-b1b1-8f2da27ab9aa admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Sep 24 20:42:26.693548 ncdv-master-1 devstack@n-api.service[124064]: [pid: 124064|app: 0|req: 31/63] 10.222.0.52 () {54 vars in 931 bytes} [Sat Sep 24 20:42:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:42:26.701266 ncdv-master-1 devstack@n-api.service[124063]: DEBUG dbcounter [-] [124063] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=124063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:42:27.223403 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-816b3cab-08e8-4ee3-9afd-1ff2fdd3cb6b admin admin] Calling method '>' {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:42:27.243562 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.requestlog [None req-816b3cab-08e8-4ee3-9afd-1ff2fdd3cb6b admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.543693 Sep 24 20:42:27.244266 ncdv-master-1 devstack@n-api.service[124063]: [pid: 124063|app: 0|req: 33/64] 10.222.0.52 () {60 vars in 1292 bytes} [Sat Sep 24 20:42:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:42:27.265978 ncdv-master-1 devstack@n-api.service[124064]: DEBUG dbcounter [-] [124064] Writing DB stats nova_api:SELECT=14 {{(pid=124064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:42:27.269759 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-e0887bea-c7bb-46fb-9ebb-2d0183e9cdae admin admin] Calling method '>' {{(pid=124064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:42:27.277971 ncdv-master-1 devstack@n-api.service[124064]: INFO nova.api.openstack.requestlog [None req-e0887bea-c7bb-46fb-9ebb-2d0183e9cdae admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013383 Sep 24 20:42:27.278491 ncdv-master-1 devstack@n-api.service[124064]: [pid: 124064|app: 0|req: 32/65] 10.222.0.52 () {60 vars in 1283 bytes} [Sat Sep 24 20:42:27 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:42:27.290182 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-32904faa-3ed1-4671-b940-bb96a655540a admin admin] Calling method '>' {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:42:27.297495 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.requestlog [None req-32904faa-3ed1-4671-b940-bb96a655540a admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010877 Sep 24 20:42:27.298007 ncdv-master-1 devstack@n-api.service[124063]: [pid: 124063|app: 0|req: 34/66] 10.222.0.52 () {60 vars in 1286 bytes} [Sat Sep 24 20:42:27 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:42:27.309748 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-66573d53-4c91-490f-b4ab-e4eb482820b4 admin admin] Calling method '>' {{(pid=124064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:42:27.316910 ncdv-master-1 devstack@n-api.service[124064]: INFO nova.api.openstack.requestlog [None req-66573d53-4c91-490f-b4ab-e4eb482820b4 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011214 Sep 24 20:42:27.317417 ncdv-master-1 devstack@n-api.service[124064]: [pid: 124064|app: 0|req: 33/67] 10.222.0.52 () {60 vars in 1286 bytes} [Sat Sep 24 20:42:27 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:42:27.329292 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-ab03e30d-26dd-431f-b2dd-556f0f5b11d2 admin admin] Calling method '>' {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:42:27.337138 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.requestlog [None req-ab03e30d-26dd-431f-b2dd-556f0f5b11d2 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011197 Sep 24 20:42:27.337499 ncdv-master-1 devstack@n-api.service[124063]: [pid: 124063|app: 0|req: 35/68] 10.222.0.52 () {60 vars in 1283 bytes} [Sat Sep 24 20:42:27 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:48:00.500146 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-66573d53-4c91-490f-b4ab-e4eb482820b4 admin admin] Calling method '>' {{(pid=124064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:48:00.501153 ncdv-master-1 devstack@n-api.service[124064]: INFO nova.api.openstack.requestlog [None req-66573d53-4c91-490f-b4ab-e4eb482820b4 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001655 Sep 24 20:48:00.501541 ncdv-master-1 devstack@n-api.service[124064]: [pid: 124064|app: 0|req: 34/69] 10.222.0.52 () {56 vars in 1074 bytes} [Sat Sep 24 20:48:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:48:00.653329 ncdv-master-1 devstack@n-api.service[124063]: DEBUG dbcounter [-] [124063] Writing DB stats nova_api:SELECT=6 {{(pid=124063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:48:00.793855 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-30654ca0-5c56-444e-b0ea-7c59b2b62026 admin admin] Calling method '>' {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:48:00.799292 ncdv-master-1 devstack@n-api.service[124063]: DEBUG oslo_concurrency.lockutils [None req-30654ca0-5c56-444e-b0ea-7c59b2b62026 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:48:00.799757 ncdv-master-1 devstack@n-api.service[124063]: DEBUG oslo_concurrency.lockutils [None req-30654ca0-5c56-444e-b0ea-7c59b2b62026 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:48:00.800184 ncdv-master-1 devstack@n-api.service[124063]: DEBUG oslo_concurrency.lockutils [None req-30654ca0-5c56-444e-b0ea-7c59b2b62026 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:48:00.800881 ncdv-master-1 devstack@n-api.service[124063]: DEBUG oslo_concurrency.lockutils [None req-30654ca0-5c56-444e-b0ea-7c59b2b62026 admin admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:48:00.801321 ncdv-master-1 devstack@n-api.service[124063]: DEBUG oslo_concurrency.lockutils [None req-30654ca0-5c56-444e-b0ea-7c59b2b62026 admin admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:48:00.801729 ncdv-master-1 devstack@n-api.service[124063]: DEBUG oslo_concurrency.lockutils [None req-30654ca0-5c56-444e-b0ea-7c59b2b62026 admin admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:48:00.839549 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.requestlog [None req-30654ca0-5c56-444e-b0ea-7c59b2b62026 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.92 time: 0.187662 Sep 24 20:48:00.840105 ncdv-master-1 devstack@n-api.service[124063]: [pid: 124063|app: 0|req: 36/70] 10.222.0.52 () {60 vars in 1193 bytes} [Sat Sep 24 20:48:00 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:48:02.471332 ncdv-master-1 devstack@n-api.service[124064]: DEBUG nova.api.openstack.wsgi [None req-66573d53-4c91-490f-b4ab-e4eb482820b4 admin admin] Calling method '>' {{(pid=124064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:48:02.472375 ncdv-master-1 devstack@n-api.service[124064]: INFO nova.api.openstack.requestlog [None req-66573d53-4c91-490f-b4ab-e4eb482820b4 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Sep 24 20:48:02.472789 ncdv-master-1 devstack@n-api.service[124064]: [pid: 124064|app: 0|req: 35/71] 10.222.0.52 () {56 vars in 1074 bytes} [Sat Sep 24 20:48:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:48:02.676607 ncdv-master-1 devstack@n-api.service[124063]: DEBUG nova.api.openstack.wsgi [None req-8948a0da-7975-4c5d-be6c-e2ed959855d5 admin admin] Calling method '>' {{(pid=124063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:48:02.680035 ncdv-master-1 devstack@n-api.service[124063]: DEBUG oslo_concurrency.lockutils [None req-8948a0da-7975-4c5d-be6c-e2ed959855d5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:48:02.680443 ncdv-master-1 devstack@n-api.service[124063]: DEBUG oslo_concurrency.lockutils [None req-8948a0da-7975-4c5d-be6c-e2ed959855d5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:48:02.680861 ncdv-master-1 devstack@n-api.service[124063]: DEBUG oslo_concurrency.lockutils [None req-8948a0da-7975-4c5d-be6c-e2ed959855d5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:48:02.681559 ncdv-master-1 devstack@n-api.service[124063]: DEBUG oslo_concurrency.lockutils [None req-8948a0da-7975-4c5d-be6c-e2ed959855d5 admin admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:48:02.681993 ncdv-master-1 devstack@n-api.service[124063]: DEBUG oslo_concurrency.lockutils [None req-8948a0da-7975-4c5d-be6c-e2ed959855d5 admin admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:48:02.682401 ncdv-master-1 devstack@n-api.service[124063]: DEBUG oslo_concurrency.lockutils [None req-8948a0da-7975-4c5d-be6c-e2ed959855d5 admin admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:48:02.704764 ncdv-master-1 devstack@n-api.service[124063]: INFO nova.api.openstack.requestlog [None req-8948a0da-7975-4c5d-be6c-e2ed959855d5 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.92 time: 0.080850 Sep 24 20:48:02.705297 ncdv-master-1 devstack@n-api.service[124063]: [pid: 124063|app: 0|req: 37/72] 10.222.0.52 () {60 vars in 1193 bytes} [Sat Sep 24 20:48:02 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:48:48.664701 ncdv-master-1 devstack@n-api.service[124062]: Sat Sep 24 20:48:48 2022 - graceful shutdown triggered... Sep 24 20:48:48.665261 ncdv-master-1 devstack@n-api.service[124064]: Gracefully killing worker 2 (pid: 124064)... Sep 24 20:48:48.664828 ncdv-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Sep 24 20:48:48.666083 ncdv-master-1 devstack@n-api.service[124063]: Gracefully killing worker 1 (pid: 124063)... Sep 24 20:48:48.801813 ncdv-master-1 devstack@n-api.service[124064]: DEBUG dbcounter [-] [124064] Writing DB stats nova_api:SELECT=4 {{(pid=124064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:48:49.665731 ncdv-master-1 devstack@n-api.service[124062]: worker 1 buried after 1 seconds Sep 24 20:48:49.665731 ncdv-master-1 devstack@n-api.service[124062]: worker 2 buried after 1 seconds Sep 24 20:48:49.665731 ncdv-master-1 devstack@n-api.service[124062]: goodbye to uWSGI. Sep 24 20:48:49.667336 ncdv-master-1 systemd[1]: devstack@n-api.service: Succeeded. Sep 24 20:48:49.667903 ncdv-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Sep 24 20:48:49.670728 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Sep 24 20:48:49.704337 ncdv-master-1 devstack@n-api.service[140501]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 24 20:48:49.706350 ncdv-master-1 devstack@n-api.service[140501]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 24 20:48:49 2022] *** Sep 24 20:48:49.706350 ncdv-master-1 devstack@n-api.service[140501]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 24 20:48:49.706350 ncdv-master-1 devstack@n-api.service[140501]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 24 20:48:49.706350 ncdv-master-1 devstack@n-api.service[140501]: nodename: ncdv-master-1 Sep 24 20:48:49.706350 ncdv-master-1 devstack@n-api.service[140501]: machine: x86_64 Sep 24 20:48:49.706350 ncdv-master-1 devstack@n-api.service[140501]: clock source: unix Sep 24 20:48:49.706350 ncdv-master-1 devstack@n-api.service[140501]: pcre jit disabled Sep 24 20:48:49.706350 ncdv-master-1 devstack@n-api.service[140501]: detected number of CPU cores: 4 Sep 24 20:48:49.706350 ncdv-master-1 devstack@n-api.service[140501]: current working directory: / Sep 24 20:48:49.706350 ncdv-master-1 devstack@n-api.service[140501]: detected binary path: /usr/bin/uwsgi-core Sep 24 20:48:49.706350 ncdv-master-1 devstack@n-api.service[140501]: your processes number limit is 47680 Sep 24 20:48:49.706350 ncdv-master-1 devstack@n-api.service[140501]: your memory page size is 4096 bytes Sep 24 20:48:49.706350 ncdv-master-1 devstack@n-api.service[140501]: detected max file descriptor number: 2048 Sep 24 20:48:49.706350 ncdv-master-1 devstack@n-api.service[140501]: lock engine: pthread robust mutexes Sep 24 20:48:49.707955 ncdv-master-1 devstack@n-api.service[140501]: thunder lock: enabled Sep 24 20:48:49.707955 ncdv-master-1 devstack@n-api.service[140501]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 24 20:48:49.707955 ncdv-master-1 devstack@n-api.service[140501]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 24 20:48:49.754167 ncdv-master-1 devstack@n-api.service[140501]: Python main interpreter initialized at 0x56277c57c9c0 Sep 24 20:48:49.754167 ncdv-master-1 devstack@n-api.service[140501]: python threads support enabled Sep 24 20:48:49.754167 ncdv-master-1 devstack@n-api.service[140501]: your server socket listen backlog is limited to 100 connections Sep 24 20:48:49.754167 ncdv-master-1 devstack@n-api.service[140501]: your mercy for graceful operations on workers is 90 seconds Sep 24 20:48:49.754681 ncdv-master-1 devstack@n-api.service[140501]: mapped 403077 bytes (393 KB) for 2 cores Sep 24 20:48:49.754681 ncdv-master-1 devstack@n-api.service[140501]: *** Operational MODE: preforking *** Sep 24 20:48:49.754933 ncdv-master-1 devstack@n-api.service[140501]: *** uWSGI is running in multiple interpreter mode *** Sep 24 20:48:49.754933 ncdv-master-1 devstack@n-api.service[140501]: spawned uWSGI master process (pid: 140501) Sep 24 20:48:49.755141 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Sep 24 20:48:49.755795 ncdv-master-1 devstack@n-api.service[140501]: spawned uWSGI worker 1 (pid: 140516, cores: 1) Sep 24 20:48:49.761037 ncdv-master-1 devstack@n-api.service[140501]: spawned uWSGI worker 2 (pid: 140517, cores: 1) Sep 24 20:48:49.761037 ncdv-master-1 devstack@n-api.service[140501]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 24 20:48:51.098842 ncdv-master-1 devstack@n-api.service[140516]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 24 20:48:51.129219 ncdv-master-1 devstack@n-api.service[140517]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 24 20:48:51.868802 ncdv-master-1 devstack@n-api.service[140516]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 20:48:51.868802 ncdv-master-1 devstack@n-api.service[140516]: from cryptography.utils import int_from_bytes Sep 24 20:48:51.869151 ncdv-master-1 devstack@n-api.service[140516]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 20:48:51.869151 ncdv-master-1 devstack@n-api.service[140516]: from cryptography.utils import int_from_bytes Sep 24 20:48:51.962293 ncdv-master-1 devstack@n-api.service[140517]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 20:48:51.962293 ncdv-master-1 devstack@n-api.service[140517]: from cryptography.utils import int_from_bytes Sep 24 20:48:51.962778 ncdv-master-1 devstack@n-api.service[140517]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 20:48:51.962778 ncdv-master-1 devstack@n-api.service[140517]: from cryptography.utils import int_from_bytes Sep 24 20:48:54.411615 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 24 20:48:54.412249 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 24 20:48:54.412605 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 24 20:48:54.412795 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 24 20:48:54.413043 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 24 20:48:54.413436 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.413859 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.414075 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.414389 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.414756 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.415074 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.415401 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.415726 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.416061 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.416325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.416640 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.416968 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.417299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.417611 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.417925 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.418249 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.418579 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.418907 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.419216 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.419724 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.421064 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.421064 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.421064 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.421363 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.421647 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.421940 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.422264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.422602 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.422936 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.423249 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.423670 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.423977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.424286 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.424602 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.425020 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.426703 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.427089 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.427416 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.427752 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.428072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.428413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.428742 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.429067 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.429396 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.429705 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.430035 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.430338 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.430689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.431016 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.431310 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.431565 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.431874 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.432202 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.432529 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.432859 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.433116 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.433369 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.433696 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.434023 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.434331 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.434666 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.434981 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.435297 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.435610 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.435922 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.436234 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.436545 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.436871 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.438333 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.438333 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.438333 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.438333 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.438659 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.438864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.439115 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.439465 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.439791 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.440106 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.440429 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.440782 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.442297 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.442732 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.443056 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.443394 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.443732 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.444047 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.444314 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.444621 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.444934 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.445264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.445577 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.445909 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.446198 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.446527 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.446855 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.447168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.447481 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.447795 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.448108 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.448517 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.448735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.449047 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.449357 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.449667 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.449996 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.450323 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.450655 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.450966 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.451277 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.451588 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.451914 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.452223 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.452535 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.452862 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.453174 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.453483 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.453808 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.454117 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.454430 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.454793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.455098 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.455410 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.455732 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.456044 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.456376 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.457383 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.457951 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.458272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.458611 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.458931 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.459242 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.459551 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.459877 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.460205 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.460517 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.460830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.461138 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.461463 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.461807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.462146 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.462559 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.462847 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.463186 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.463510 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.463828 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.464146 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.464463 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.464800 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.465120 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.465438 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.465762 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.466077 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.466399 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.466758 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.467081 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.467405 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.467726 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.468043 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.468363 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.468912 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.469080 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.469323 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.469675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.470021 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.470387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.470790 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.471126 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.471443 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.471760 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.472131 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.473773 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.473773 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.474103 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.474330 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.474679 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.475012 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.475418 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.475744 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.476066 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.476384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.476704 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.477050 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.477372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.477702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.478097 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.478335 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.478682 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.479003 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.479318 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.479634 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.479946 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.480256 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.480570 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.480884 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.481189 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.481518 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.481854 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.482168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.482525 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.482842 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.483159 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.483475 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.483794 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.484105 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.484422 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.484738 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.485045 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.485373 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.485690 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.485997 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.486329 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.486679 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.486994 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.487310 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.487651 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.488098 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.488660 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.488992 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.489912 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.489912 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.490292 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.490292 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.490698 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.490936 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.491267 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.491599 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.491925 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.492236 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.492555 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.492868 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.493182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.493488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.493803 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.494115 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.494427 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.494783 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.495095 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.495405 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.495738 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.496054 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.496367 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.496681 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.497001 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.497336 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.497648 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.497998 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.498345 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.498702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.499035 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.499354 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.499678 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.499997 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.500315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.500632 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.500947 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.501300 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.501677 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.501893 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.502209 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.502794 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.502962 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.503347 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.503863 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.504369 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.504724 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.505068 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.505393 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.505723 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.506043 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.506363 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.506777 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.507100 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.507420 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.507741 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.508063 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.508379 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.508703 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.509024 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.509353 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.509670 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.509993 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.510304 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.510654 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.511081 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.511330 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.511640 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.511958 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.512286 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.512604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.512919 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.513234 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.513544 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.513856 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.514171 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.514489 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.514824 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.515139 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.515450 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.515769 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.516083 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.516391 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.516699 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.517014 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.517340 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.517666 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.517980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.518307 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.518638 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.519537 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.520097 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.520418 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.520728 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.521038 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.521350 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.521702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.522016 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.522325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.522675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.523005 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.523321 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.523644 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.523959 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.524275 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.524602 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.524940 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.525236 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.525550 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.525864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.526177 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.526771 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.527096 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.528022 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.528022 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.528022 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.528316 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.528631 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.528949 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.529552 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.529893 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.530217 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.530569 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.530930 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.531255 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.531593 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.531931 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.532248 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.532560 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.532879 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.533190 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.533501 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.533872 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.534123 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.534436 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.535409 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.536025 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.536317 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.536630 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.536946 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.537258 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.537582 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.537894 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.538213 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.538537 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.538866 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.539181 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.539497 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.539809 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.540119 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.540465 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.540775 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.541121 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.541455 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.541803 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.542114 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.542421 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.542774 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.543084 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.543395 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.543702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.544014 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.544325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.544633 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.544943 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.545254 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.545572 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.545878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.546182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.546515 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.546821 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.547139 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.547454 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.547759 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.548065 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.548376 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.548685 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.548990 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.549306 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.549613 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.549932 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.550299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.550892 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.551211 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.551529 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.551842 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.552152 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.552481 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.552796 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.553107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.553417 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.553733 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.554041 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.554347 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.554689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.555018 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.555338 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.555647 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.555961 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.556268 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.556575 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.556882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.557193 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.557501 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.557806 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.558114 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.558420 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.558751 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.559081 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.559399 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.559704 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.560012 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.560317 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.560661 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.560966 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.561329 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.561639 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.561958 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.562281 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.562618 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.562933 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.563253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.563560 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.563879 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.564194 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.564513 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.564827 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.565126 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.565454 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.565796 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.566608 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.566871 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.567164 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.567496 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.567810 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.568133 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.568452 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.568768 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.569086 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.569410 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.569728 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.570231 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.570602 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.570927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.571426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.571549 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.571897 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.572183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.572493 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.572822 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.573136 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.573446 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.573676 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 24 20:48:54.574098 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.574196 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 24 20:48:54.574295 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.574444 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.574647 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 24 20:48:54.574749 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.574861 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 24 20:48:54.575111 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.575217 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 24 20:48:54.575432 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.575577 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.575825 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.575955 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.576137 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.576235 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.576453 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.576552 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.576768 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.576878 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.577088 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.577182 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.577410 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.577508 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.577722 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.577870 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.578054 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.578200 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.578322 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.578468 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.578692 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.578808 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.579026 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.579121 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.579356 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.579459 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.579669 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.579773 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.579982 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.580076 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.580313 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.580408 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.580624 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.580720 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.580936 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.581031 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.581246 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.581875 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.582276 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.582444 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.582677 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.582878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.582974 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.583223 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.583333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.583661 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.583982 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.584298 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.584633 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.584768 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.584974 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.585068 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.585304 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.585424 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.585645 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.585753 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.585969 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.586074 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.586300 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.586392 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.586642 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.586771 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.586965 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.587079 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.587286 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.587444 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.587620 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.587722 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.587952 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.588047 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.588277 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.588388 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.588596 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.588750 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.588907 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.589012 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.589245 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.589355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.589574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.589677 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.589892 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.589987 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.590220 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.590328 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.590622 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.590731 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.590953 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.591056 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.591280 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.591374 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.591588 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.591688 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.591903 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.592004 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.592219 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.592312 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.592529 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.592634 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.592840 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.592933 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.593147 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.593241 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.593399 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.593501 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.593716 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.593830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.594043 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.594203 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.594368 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.594609 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.594764 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.594937 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.595177 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.595341 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.595447 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.595536 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.595621 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.595722 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.595837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.595931 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.596150 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.596289 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.596463 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.596560 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.596775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.596974 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.597680 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.597810 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.598180 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.598532 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.598850 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.599159 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.599491 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.599627 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.599818 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.599948 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.600151 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.600278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.600465 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.600584 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.600794 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.600963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.601207 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.601336 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.601457 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.601576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.601769 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.601924 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.602118 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.602247 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.602448 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.602947 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.603086 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.603224 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.603362 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.603500 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.603792 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.603946 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.604104 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.604196 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.604450 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.604633 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.604738 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.604902 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.605066 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.605294 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.605439 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.605624 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.605832 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.606024 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.606186 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.606288 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.606556 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.606656 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.606872 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.606967 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.607187 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.607281 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.607501 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.607593 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.607812 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.607906 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.608130 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.608251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.608445 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.608558 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.608762 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.609631 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.609785 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.609874 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.609948 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.610031 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.610118 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.610198 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.610280 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.610353 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.610432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.610621 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.610731 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.610935 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.611037 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.611264 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.611373 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.611592 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.611686 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.611903 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.612004 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.612216 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.612310 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.612529 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.612656 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.612874 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.613059 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.613655 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.613802 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.613892 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.613968 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.614367 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.614541 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.615080 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.615168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.615242 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.615314 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.615400 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.615618 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.615724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.615724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.615874 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.615946 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.616032 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.616113 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.616613 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.616700 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.616773 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.616853 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.617922 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.618019 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.618102 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.618181 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.618254 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.618325 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.618404 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.618484 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.618484 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.618659 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.618744 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.618838 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.618932 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.619017 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.619098 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.619271 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.619387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.619661 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.619779 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.619905 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.619999 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.620234 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.620344 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.620548 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.620651 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.620862 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.620957 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.621173 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.621275 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.621495 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.621590 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:48:54.621839 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.621942 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.622177 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.622280 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.622538 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.622672 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.622893 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.623008 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.623236 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.623357 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.623563 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.623665 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.623904 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.623996 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.624214 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.624308 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.624590 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.624685 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.624920 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.625013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.625239 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.625332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.625565 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.625682 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.625887 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.625991 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.626209 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.626301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.626553 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.626661 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.626881 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.626982 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.627207 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.627311 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.627527 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.627627 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.627849 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.627950 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.628169 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.628947 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.629067 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.629402 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.629771 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.629953 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.630089 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.630244 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.630426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.630618 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.630941 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.631027 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.631274 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.631366 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.631603 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.631693 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.631953 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.632155 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.632293 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.632487 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.632627 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.632840 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.632953 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.633190 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.633290 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.633534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.633630 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.633863 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.633957 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.634199 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.634282 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.634564 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.634667 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.634888 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.634971 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.635208 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.635303 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.635534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.635624 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.635853 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.635967 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.636171 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.636274 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.636485 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.636575 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.636818 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.637137 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.637473 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.637794 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.638347 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.638736 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.639071 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.639168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.639375 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.639459 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.639749 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.639869 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.640103 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.640210 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.640437 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.640520 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.641147 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.641234 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.641234 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.641453 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.641797 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.641885 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.642122 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.642246 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.642442 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.642609 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.642789 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.642947 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.643120 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.643281 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.643444 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.643618 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.643761 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.644520 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.644696 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.644915 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.645000 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.645166 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.645298 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.645490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.645616 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.645962 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.646317 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.650528 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.651747 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.651875 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.651959 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.652035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.652035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.652168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.652251 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.652334 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.652408 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.652488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.652570 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.652652 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.652752 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.652850 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.652938 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.653023 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.653108 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.653197 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.653280 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.653374 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.653469 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.653556 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.653649 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.653739 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.653828 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.653915 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.654008 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.654103 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.654198 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.654291 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.654390 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.654484 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.654592 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.654691 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.654785 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.654872 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.654967 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.655055 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.655155 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.655243 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.655329 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.655329 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.655503 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.655590 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.655674 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.655674 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.655829 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.655829 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.656000 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.656086 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.656178 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.656265 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.656354 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.656442 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.656541 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.656637 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.656637 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.656803 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.656888 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.656982 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.657070 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.657193 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.657373 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.657516 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.657687 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.657837 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.658006 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.658157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.658317 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.658524 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.658638 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.658853 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.658949 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.659212 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.659322 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.659547 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.659655 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.659913 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.660056 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.660399 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.660506 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.660718 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.660840 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.661029 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.661143 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.661343 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.661438 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.661707 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.661819 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.661983 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.662087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.662309 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.662405 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.662654 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.662752 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.662976 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.663151 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.663296 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.663391 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.663621 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.663731 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.663953 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.664056 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.664275 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.664385 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.664596 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.664699 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.664918 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.665021 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.665238 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.665342 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.665558 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.665659 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.665878 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.665971 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.666195 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.666297 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.666554 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.666669 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.666861 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.666955 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.667203 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.667501 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.667605 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.667831 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.668064 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.668274 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.668597 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.668699 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.668926 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.669325 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.669443 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.669572 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.669901 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.670006 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.670254 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.670521 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.670646 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.671185 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.671294 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.671516 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.671811 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.671914 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.672210 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.672381 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.672549 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.672886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.672980 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.673201 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.673386 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.673516 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.673729 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.673824 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.674068 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.674162 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.674404 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.674558 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.674773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.674880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.675108 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.675293 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.675421 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.675651 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.675771 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.675978 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.676242 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.676364 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.678007 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.678129 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.678216 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.678301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.678392 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.678477 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.678594 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.678679 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.678754 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.678828 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.678900 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.678986 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.679069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.679201 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.679288 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.679382 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.679471 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.679547 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.679628 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.679711 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.679786 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.679867 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.679950 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.680173 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.680280 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.680542 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.680639 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.680799 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.680911 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.681251 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.681612 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.681900 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.682222 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.682562 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.682676 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.682910 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.683054 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.683207 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.683432 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.683531 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.683784 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.683869 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.684130 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.684234 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.684459 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.684553 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.684780 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.684866 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.685112 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.685195 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.685446 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.685543 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.685760 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.685845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.686073 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.686165 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.686406 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.686521 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.687548 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.687732 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.687896 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.688059 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.688226 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.688386 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.688547 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.688701 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.688853 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.689005 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.689173 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.689380 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.689547 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.689701 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.689864 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.690015 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.690205 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.690442 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.690640 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.691678 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.691930 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.692348 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.723298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.723298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.723777 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.723921 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.723921 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.724201 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.724445 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.724642 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.724782 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.724913 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.725054 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.725054 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.725303 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.725449 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.725581 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.725722 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.725855 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.725998 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.726130 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.726262 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.726392 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.726554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.726694 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.726836 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.727061 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.727201 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.727409 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.727544 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.727675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.727675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.727938 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.728085 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.728219 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.728351 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.728483 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.728614 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.728745 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.728886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.729019 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.729172 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.729306 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.729529 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.729736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.729878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.730012 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.730144 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.730277 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.730410 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.730582 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.731081 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.731218 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.731351 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.731484 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.731626 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.731768 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.732079 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.732223 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.732357 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=140516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 24 20:48:54.732511 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.732511 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.732511 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.732511 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.732511 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.732511 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.732511 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.732511 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.736956 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.736956 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.736956 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.736956 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.736956 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.736956 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.736956 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.736956 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.738095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.738095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.738095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.738095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.738095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.738095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.738095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.738095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.739301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.739301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.739301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.739301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.739301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.739301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.739301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.739301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.740432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.740432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.740432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.740432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.740432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.740432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.740432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.740432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.741421 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.741421 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.741421 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.741421 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.741421 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.741421 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.741421 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.741421 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.743524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.743524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.743524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.743524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.743524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.743524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.743524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.743524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.747747 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.747747 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.747747 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.747747 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.747747 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.747747 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.747747 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.747747 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.748800 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.748800 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.748800 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.748800 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.748800 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.748800 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.748800 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.748800 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.750462 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.750462 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.750462 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.750462 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.750462 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.750462 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.750462 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.750462 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.751493 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.751493 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.751493 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.751493 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.751493 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.751493 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.751493 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.751493 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.752879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.752879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.752879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.752879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.752879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.752879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.752879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.752879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.755475 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.755475 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.755475 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.755475 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.755475 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.755475 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.755475 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.755475 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.756830 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.756830 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.756830 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.756830 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.756830 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.756830 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.756830 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.756830 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.758152 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.758152 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.758152 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.758152 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.758152 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.758152 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.758152 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.758152 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.759814 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.759814 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.759814 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.759814 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.759814 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.759814 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.759814 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.759814 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.761082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.761082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.761082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.761082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.761082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.761082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.761082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.761082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.762266 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.762266 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.762266 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.762266 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.762266 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.762266 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.762266 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.762266 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.763785 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.763785 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.763785 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.763785 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.763785 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.763785 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.763785 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.763785 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.764918 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.764918 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.764918 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.764918 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.764918 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.764918 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.764918 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.764918 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.765895 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.765895 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.765895 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.765895 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.765895 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.765895 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.765895 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.765895 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.767007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.767007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.767007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.767007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.767007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.767007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.767007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.767007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.768209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.768209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.768209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.768209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.768209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.768209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.768209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.768209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.769831 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.769831 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.769831 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.769831 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.769831 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.769831 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.769831 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.769831 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.771114 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.771114 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.771114 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.771114 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.771114 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.771114 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.771114 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.771114 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.772134 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.772134 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.772134 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.772134 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.772134 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.772952 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.772952 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.772952 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.773506 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.773506 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.773773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.774013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.774333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.774693 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.775017 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.775332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.775646 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.775959 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.776547 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.776873 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.777204 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.777526 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.777840 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.778151 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.778464 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.778842 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.779157 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.779496 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.779817 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.780157 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.780482 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.780808 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.781131 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.781453 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.781775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.782101 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.782423 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.782906 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.783104 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.783427 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.783757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.784429 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.785190 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.785522 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.785999 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.786141 ncdv-master-1 devstack@n-api.service[140516]: INFO dbcounter [None req-f5737565-e668-497d-80a8-fd89e1abe551 None None] Registered counter for database nova_api Sep 24 20:48:54.786329 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.786685 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.787010 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.787333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.787660 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.787981 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.788300 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.788644 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.788978 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.789318 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.789667 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.789999 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.790405 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.790691 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.791016 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.791389 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.791714 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.792029 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.792352 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.792675 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.793102 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.793311 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.794271 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.794271 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.794271 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.794850 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.794990 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.795202 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.795523 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.795858 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.796200 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.796531 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.796854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.797174 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.797496 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.798735 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.799072 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.799429 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.799772 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.800198 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.801255 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.801605 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.801953 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.802275 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.802620 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.802962 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.803387 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.803615 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.803889 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.804211 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.804565 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.805632 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.805632 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.805930 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.806068 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.806385 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.806780 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.807109 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.807438 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.807878 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.808204 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.808383 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.808702 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.809023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.809344 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.809660 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.809982 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.810309 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.810657 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.810890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_db.sqlalchemy.engines [None req-f5737565-e668-497d-80a8-fd89e1abe551 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140516) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 20:48:54.811142 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.811413 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.811588 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.811922 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.812237 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.812553 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.812944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.813711 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.813904 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.814135 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.814544 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.814841 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.815131 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.815425 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.815804 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.816328 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.816689 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.817063 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.817388 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.817705 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.818050 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.818225 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writer thread running {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 20:48:54.818469 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.818718 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.819163 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.819372 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.819709 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.820039 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.820360 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.820723 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.821049 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.821642 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.821984 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.822316 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.822697 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.823043 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.823434 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.823940 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.824099 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.824289 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.824668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.824960 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.825239 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.825551 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.825869 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.826188 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.826629 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.826864 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.827184 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.827505 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.827824 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.828143 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.828520 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.828773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.829096 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.829450 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.829782 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.830108 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.830432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.830846 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.831168 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.831607 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.831862 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.832179 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.832502 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.832843 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.833165 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.833566 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.833998 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.834252 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.834615 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.834949 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.835266 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.835598 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.835932 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.836251 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.836578 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.836899 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.837237 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.837587 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.837925 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.838261 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.838598 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.838907 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.839220 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.839540 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.841129 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.841129 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.841129 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.841129 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.841757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.841757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.842019 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.842301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.842639 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.842959 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.843833 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.843833 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.844410 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.844410 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.844686 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.844824 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.845064 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.845377 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.845712 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.845993 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.846308 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.846632 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.847502 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.847852 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.848178 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.848610 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.848850 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.849135 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.849452 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.849783 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.850121 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.850446 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.850792 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.851132 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.851452 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.851772 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.852093 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.852413 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.852759 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.853080 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.853417 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.853754 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.854071 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.854461 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.854743 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.855072 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.855458 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.855712 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.856050 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.856418 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.856687 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.857009 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.857328 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.857649 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.857971 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.858290 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.858658 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.858972 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.859294 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.859629 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.859972 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.860292 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.860627 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.860964 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.861325 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.861661 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.861998 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.862336 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.862741 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.863552 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.863942 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:48:54.864183 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=140517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 24 20:48:54.876655 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.context [None req-f5737565-e668-497d-80a8-fd89e1abe551 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),788aecb6-32dc-4b71-909a-be050455aded(cell1) {{(pid=140516) load_cells /opt/stack/nova/nova/context.py:464}} Sep 24 20:48:54.881030 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f5737565-e668-497d-80a8-fd89e1abe551 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:48:54.881515 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f5737565-e668-497d-80a8-fd89e1abe551 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:48:54.883145 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f5737565-e668-497d-80a8-fd89e1abe551 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:48:54.883894 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f5737565-e668-497d-80a8-fd89e1abe551 None None] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:48:54.884386 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f5737565-e668-497d-80a8-fd89e1abe551 None None] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:48:54.886343 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f5737565-e668-497d-80a8-fd89e1abe551 None None] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:48:54.888355 ncdv-master-1 devstack@n-api.service[140516]: INFO dbcounter [None req-f5737565-e668-497d-80a8-fd89e1abe551 None None] Registered counter for database nova_cell0 Sep 24 20:48:54.893372 ncdv-master-1 devstack@n-api.service[140516]: INFO dbcounter [None req-f5737565-e668-497d-80a8-fd89e1abe551 None None] Registered counter for database nova_cell1 Sep 24 20:48:54.904090 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_db.sqlalchemy.engines [None req-f5737565-e668-497d-80a8-fd89e1abe551 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140516) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 20:48:54.905053 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_db.sqlalchemy.engines [None req-f5737565-e668-497d-80a8-fd89e1abe551 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140516) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 20:48:54.909010 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writer thread running {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 20:48:54.934423 ncdv-master-1 devstack@n-api.service[140517]: INFO dbcounter [None req-54d0c03d-8d7a-435e-b445-005383d50be4 None None] Registered counter for database nova_api Sep 24 20:48:54.954223 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_db.sqlalchemy.engines [None req-54d0c03d-8d7a-435e-b445-005383d50be4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 20:48:54.961853 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writer thread running {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 20:48:55.018734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.context [None req-54d0c03d-8d7a-435e-b445-005383d50be4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),788aecb6-32dc-4b71-909a-be050455aded(cell1) {{(pid=140517) load_cells /opt/stack/nova/nova/context.py:464}} Sep 24 20:48:55.023467 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54d0c03d-8d7a-435e-b445-005383d50be4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:48:55.023950 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54d0c03d-8d7a-435e-b445-005383d50be4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:48:55.025552 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54d0c03d-8d7a-435e-b445-005383d50be4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:48:55.026570 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54d0c03d-8d7a-435e-b445-005383d50be4 None None] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:48:55.027041 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54d0c03d-8d7a-435e-b445-005383d50be4 None None] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:48:55.029039 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54d0c03d-8d7a-435e-b445-005383d50be4 None None] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:48:55.031041 ncdv-master-1 devstack@n-api.service[140517]: INFO dbcounter [None req-54d0c03d-8d7a-435e-b445-005383d50be4 None None] Registered counter for database nova_cell0 Sep 24 20:48:55.035729 ncdv-master-1 devstack@n-api.service[140517]: INFO dbcounter [None req-54d0c03d-8d7a-435e-b445-005383d50be4 None None] Registered counter for database nova_cell1 Sep 24 20:48:55.043169 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_db.sqlalchemy.engines [None req-54d0c03d-8d7a-435e-b445-005383d50be4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 20:48:55.044968 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_db.sqlalchemy.engines [None req-54d0c03d-8d7a-435e-b445-005383d50be4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 20:48:55.051495 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writer thread running {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 20:48:55.052496 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writer thread running {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 20:48:55.052821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writer thread running {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 20:48:55.062466 ncdv-master-1 devstack@n-api.service[140516]: INFO dbcounter [None req-f5737565-e668-497d-80a8-fd89e1abe551 None None] Registered counter for database nova_cell0 Sep 24 20:48:55.069695 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_db.sqlalchemy.engines [None req-f5737565-e668-497d-80a8-fd89e1abe551 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140516) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 20:48:55.074518 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writer thread running {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 20:48:55.202149 ncdv-master-1 devstack@n-api.service[140517]: INFO dbcounter [None req-54d0c03d-8d7a-435e-b445-005383d50be4 None None] Registered counter for database nova_cell0 Sep 24 20:48:55.209866 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_db.sqlalchemy.engines [None req-54d0c03d-8d7a-435e-b445-005383d50be4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 20:48:55.215007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writer thread running {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 20:48:55.533732 ncdv-master-1 devstack@n-api.service[140516]: WARNING keystonemiddleware.auth_token [None req-f5737565-e668-497d-80a8-fd89e1abe551 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 20:48:55.542749 ncdv-master-1 devstack@n-api.service[140516]: WARNING keystonemiddleware.auth_token [None req-f5737565-e668-497d-80a8-fd89e1abe551 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 20:48:55.673992 ncdv-master-1 devstack@n-api.service[140517]: WARNING keystonemiddleware.auth_token [None req-54d0c03d-8d7a-435e-b445-005383d50be4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 20:48:55.682218 ncdv-master-1 devstack@n-api.service[140517]: WARNING keystonemiddleware.auth_token [None req-54d0c03d-8d7a-435e-b445-005383d50be4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 20:48:55.775297 ncdv-master-1 devstack@n-api.service[140516]: WARNING keystonemiddleware.auth_token [None req-f5737565-e668-497d-80a8-fd89e1abe551 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 20:48:55.781612 ncdv-master-1 devstack@n-api.service[140516]: WARNING keystonemiddleware.auth_token [None req-f5737565-e668-497d-80a8-fd89e1abe551 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 20:48:55.787634 ncdv-master-1 devstack@n-api.service[140516]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56277c57c9c0 pid: 140516 (default app) Sep 24 20:48:55.914035 ncdv-master-1 devstack@n-api.service[140517]: WARNING keystonemiddleware.auth_token [None req-54d0c03d-8d7a-435e-b445-005383d50be4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 20:48:55.920298 ncdv-master-1 devstack@n-api.service[140517]: WARNING keystonemiddleware.auth_token [None req-54d0c03d-8d7a-435e-b445-005383d50be4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 20:48:55.925584 ncdv-master-1 devstack@n-api.service[140517]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56277c57c9c0 pid: 140517 (default app) Sep 24 20:49:37.976332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:49:37.977268 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:49:37.981916 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:49:37.984428 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:49:39.143229 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:49:39.144820 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:49:39.148261 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:49:39.152168 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:49:40.080314 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e0107eea-ed88-4526-a75f-9b68896f21f1 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:40.096038 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e0107eea-ed88-4526-a75f-9b68896f21f1 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:40.096382 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e0107eea-ed88-4526-a75f-9b68896f21f1 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:40.097102 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e0107eea-ed88-4526-a75f-9b68896f21f1 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:40.098125 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e0107eea-ed88-4526-a75f-9b68896f21f1 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:40.099308 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e0107eea-ed88-4526-a75f-9b68896f21f1 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:40.099828 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e0107eea-ed88-4526-a75f-9b68896f21f1 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:40.175163 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e0107eea-ed88-4526-a75f-9b68896f21f1 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 2.205373 Sep 24 20:49:40.175828 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1/1] 10.222.0.52 () {58 vars in 1176 bytes} [Sat Sep 24 20:49:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 2208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:49:40.593827 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3fdd720c-29cb-40ea-bd32-6383f174c220 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1918797363", "id": 716030285, "os-flavor-access:is_public": "True"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:40.731871 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3fdd720c-29cb-40ea-bd32-6383f174c220 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.554799 Sep 24 20:49:40.735713 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2/2] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:49:40 2022] POST /compute/v2.1/flavors => generated 427 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:49:40.895892 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dab60305-7b88-4972-b6d1-c5a4c55cf558 tempest-AggregatesAdminTestV241-1648698894 tempest-AggregatesAdminTestV241-1648698894-project-admin] Calling method '.version_select at 0x7f4b0e144550>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:40.915388 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dab60305-7b88-4972-b6d1-c5a4c55cf558 tempest-AggregatesAdminTestV241-1648698894 tempest-AggregatesAdminTestV241-1648698894-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),788aecb6-32dc-4b71-909a-be050455aded(cell1) {{(pid=140517) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 24 20:49:40.916158 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dab60305-7b88-4972-b6d1-c5a4c55cf558 tempest-AggregatesAdminTestV241-1648698894 tempest-AggregatesAdminTestV241-1648698894-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:40.916653 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dab60305-7b88-4972-b6d1-c5a4c55cf558 tempest-AggregatesAdminTestV241-1648698894 tempest-AggregatesAdminTestV241-1648698894-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:40.917091 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dab60305-7b88-4972-b6d1-c5a4c55cf558 tempest-AggregatesAdminTestV241-1648698894 tempest-AggregatesAdminTestV241-1648698894-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:40.982186 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dab60305-7b88-4972-b6d1-c5a4c55cf558 tempest-AggregatesAdminTestV241-1648698894 tempest-AggregatesAdminTestV241-1648698894-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:40.982717 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dab60305-7b88-4972-b6d1-c5a4c55cf558 tempest-AggregatesAdminTestV241-1648698894 tempest-AggregatesAdminTestV241-1648698894-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:40.986980 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dab60305-7b88-4972-b6d1-c5a4c55cf558 tempest-AggregatesAdminTestV241-1648698894 tempest-AggregatesAdminTestV241-1648698894-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:40.992099 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-67e62128-3e8d-4066-9c03-cef8ac4c304f tempest-FlavorMetadataValidation-1250002644 tempest-FlavorMetadataValidation-1250002644-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-2146072901", "id": 97374914, "os-flavor-access:is_public": "True"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:41.018929 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dab60305-7b88-4972-b6d1-c5a4c55cf558 tempest-AggregatesAdminTestV241-1648698894 tempest-AggregatesAdminTestV241-1648698894-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:41.020404 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dab60305-7b88-4972-b6d1-c5a4c55cf558 tempest-AggregatesAdminTestV241-1648698894 tempest-AggregatesAdminTestV241-1648698894-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:41.020914 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dab60305-7b88-4972-b6d1-c5a4c55cf558 tempest-AggregatesAdminTestV241-1648698894 tempest-AggregatesAdminTestV241-1648698894-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:41.023585 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-67e62128-3e8d-4066-9c03-cef8ac4c304f tempest-FlavorMetadataValidation-1250002644 tempest-FlavorMetadataValidation-1250002644-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.86 time: 0.282351 Sep 24 20:49:41.033732 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dab60305-7b88-4972-b6d1-c5a4c55cf558 tempest-AggregatesAdminTestV241-1648698894 tempest-AggregatesAdminTestV241-1648698894-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.898786 Sep 24 20:49:41.036586 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3/3] 10.222.0.52 () {62 vars in 1188 bytes} [Sat Sep 24 20:49:40 2022] POST /compute/v2.1/flavors => generated 465 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:49:41.040954 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1/4] 10.222.0.52 () {60 vars in 1208 bytes} [Sat Sep 24 20:49:39 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:49:41.056221 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1b20e4d3-1a31-4145-ae6a-19074c6ebd81 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1919640542"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:41.060634 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.aggregate [None req-1b20e4d3-1a31-4145-ae6a-19074c6ebd81 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Generated uuid d19b0792-5302-4795-9100-c222bc7ba580 for aggregate {{(pid=140516) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 24 20:49:41.184801 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1b20e4d3-1a31-4145-ae6a-19074c6ebd81 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.146363 Sep 24 20:49:41.187215 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 4/5] 10.222.0.52 () {60 vars in 1164 bytes} [Sat Sep 24 20:49:41 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:49:41.192939 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ce2a005e-a50e-4854-8e1f-e928a26f9c69 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:41.234539 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ce2a005e-a50e-4854-8e1f-e928a26f9c69 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/716030285" status: 202 len: 0 microversion: 2.1 time: 0.045710 Sep 24 20:49:41.238118 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 5/6] 10.222.0.52 () {58 vars in 1158 bytes} [Sat Sep 24 20:49:41 2022] DELETE /compute/v2.1/flavors/716030285 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:49:41.381734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d689b4ae-72d6-40f4-a22a-80892e634ea7 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Calling method '.version_select at 0x7f4b0e0d1ca0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:41.382995 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d689b4ae-72d6-40f4-a22a-80892e634ea7 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:41.383405 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d689b4ae-72d6-40f4-a22a-80892e634ea7 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:41.383840 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d689b4ae-72d6-40f4-a22a-80892e634ea7 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:41.431279 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5a708c5f-5cbe-4690-9fc3-4c05168a3f81 tempest-AZAdminV2TestJSON-207024148 tempest-AZAdminV2TestJSON-207024148-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:41.433618 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5a708c5f-5cbe-4690-9fc3-4c05168a3f81 tempest-AZAdminV2TestJSON-207024148 tempest-AZAdminV2TestJSON-207024148-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:41.434380 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5a708c5f-5cbe-4690-9fc3-4c05168a3f81 tempest-AZAdminV2TestJSON-207024148 tempest-AZAdminV2TestJSON-207024148-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:41.435266 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5a708c5f-5cbe-4690-9fc3-4c05168a3f81 tempest-AZAdminV2TestJSON-207024148 tempest-AZAdminV2TestJSON-207024148-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:41.436355 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5a708c5f-5cbe-4690-9fc3-4c05168a3f81 tempest-AZAdminV2TestJSON-207024148 tempest-AZAdminV2TestJSON-207024148-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:41.437142 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5a708c5f-5cbe-4690-9fc3-4c05168a3f81 tempest-AZAdminV2TestJSON-207024148 tempest-AZAdminV2TestJSON-207024148-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:41.438615 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d689b4ae-72d6-40f4-a22a-80892e634ea7 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:41.439238 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5a708c5f-5cbe-4690-9fc3-4c05168a3f81 tempest-AZAdminV2TestJSON-207024148 tempest-AZAdminV2TestJSON-207024148-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:41.439736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d689b4ae-72d6-40f4-a22a-80892e634ea7 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:41.440320 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d689b4ae-72d6-40f4-a22a-80892e634ea7 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:41.458773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d689b4ae-72d6-40f4-a22a-80892e634ea7 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:41.459278 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d689b4ae-72d6-40f4-a22a-80892e634ea7 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:41.459881 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d689b4ae-72d6-40f4-a22a-80892e634ea7 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:41.467962 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5a708c5f-5cbe-4690-9fc3-4c05168a3f81 tempest-AZAdminV2TestJSON-207024148 tempest-AZAdminV2TestJSON-207024148-project-admin] 10.222.0.52 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.227908 Sep 24 20:49:41.470447 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 6/7] 10.222.0.52 () {58 vars in 1164 bytes} [Sat Sep 24 20:49:41 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:49:41.475753 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d689b4ae-72d6-40f4-a22a-80892e634ea7 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.433371 Sep 24 20:49:41.476389 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2/8] 10.222.0.52 () {58 vars in 1167 bytes} [Sat Sep 24 20:49:41 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:49:41.479789 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-305ec162-80c0-4512-8659-c316db32e1db tempest-FlavorMetadataValidation-1250002644 tempest-FlavorMetadataValidation-1250002644-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:41.483141 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d9d71592-a424-48b8-9a32-19bb7fa9e8c2 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:41.536722 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d9d71592-a424-48b8-9a32-19bb7fa9e8c2 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:41.537556 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d9d71592-a424-48b8-9a32-19bb7fa9e8c2 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:41.538346 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d9d71592-a424-48b8-9a32-19bb7fa9e8c2 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:41.864500 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-305ec162-80c0-4512-8659-c316db32e1db tempest-FlavorMetadataValidation-1250002644 tempest-FlavorMetadataValidation-1250002644-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/97374914/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.392079 Sep 24 20:49:41.865599 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 7/9] 10.222.0.52 () {62 vars in 1259 bytes} [Sat Sep 24 20:49:41 2022] POST /compute/v2.1/flavors/97374914/os-extra_specs => generated 62 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:49:41.874364 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-67623296-a754-4d46-9e04-60b4044d7725 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:41.911379 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-67623296-a754-4d46-9e04-60b4044d7725 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5407 microversion: 2.1 time: 0.043864 Sep 24 20:49:41.912418 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 8/10] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:49:41 2022] GET /compute/v2.1/flavors/detail => generated 5407 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:49:41.918053 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d1773841-f814-47b9-95d9-3b92dc39a2a7 tempest-AZAdminV2TestJSON-207024148 tempest-AZAdminV2TestJSON-207024148-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:41.920277 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d1773841-f814-47b9-95d9-3b92dc39a2a7 tempest-AZAdminV2TestJSON-207024148 tempest-AZAdminV2TestJSON-207024148-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:41.921093 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d1773841-f814-47b9-95d9-3b92dc39a2a7 tempest-AZAdminV2TestJSON-207024148 tempest-AZAdminV2TestJSON-207024148-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:41.922645 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d1773841-f814-47b9-95d9-3b92dc39a2a7 tempest-AZAdminV2TestJSON-207024148 tempest-AZAdminV2TestJSON-207024148-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:41.924161 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d1773841-f814-47b9-95d9-3b92dc39a2a7 tempest-AZAdminV2TestJSON-207024148 tempest-AZAdminV2TestJSON-207024148-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:41.924880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d1773841-f814-47b9-95d9-3b92dc39a2a7 tempest-AZAdminV2TestJSON-207024148 tempest-AZAdminV2TestJSON-207024148-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:41.925489 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d1773841-f814-47b9-95d9-3b92dc39a2a7 tempest-AZAdminV2TestJSON-207024148 tempest-AZAdminV2TestJSON-207024148-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:41.961677 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d1773841-f814-47b9-95d9-3b92dc39a2a7 tempest-AZAdminV2TestJSON-207024148 tempest-AZAdminV2TestJSON-207024148-project-admin] 10.222.0.52 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.047780 Sep 24 20:49:41.962616 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 9/11] 10.222.0.52 () {58 vars in 1185 bytes} [Sat Sep 24 20:49:41 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:49:41.967521 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c2d9e4ff-e6a2-42b5-a2db-82b38556ad39 tempest-FlavorMetadataValidation-1250002644 tempest-FlavorMetadataValidation-1250002644-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:41.996450 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c2d9e4ff-e6a2-42b5-a2db-82b38556ad39 tempest-FlavorMetadataValidation-1250002644 tempest-FlavorMetadataValidation-1250002644-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/97374914" status: 202 len: 0 microversion: 2.86 time: 0.031260 Sep 24 20:49:41.998731 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 10/12] 10.222.0.52 () {60 vars in 1196 bytes} [Sat Sep 24 20:49:41 2022] DELETE /compute/v2.1/flavors/97374914 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:49:42.008865 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-52ec5dde-5828-44e8-9dde-9ac4feee989a tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1799408253", "id": 849748169, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:42.109114 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-52ec5dde-5828-44e8-9dde-9ac4feee989a tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.109053 Sep 24 20:49:42.113237 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 11/13] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:49:41 2022] POST /compute/v2.1/flavors => generated 414 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:49:42.118681 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cff1a3d4-84e9-4cfa-8170-fbc60c6f26cb tempest-FlavorMetadataValidation-1250002644 tempest-FlavorMetadataValidation-1250002644-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:42.120311 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d9d71592-a424-48b8-9a32-19bb7fa9e8c2 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 242 microversion: 2.1 time: 0.642402 Sep 24 20:49:42.122093 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3/14] 10.222.0.52 () {60 vars in 1191 bytes} [Sat Sep 24 20:49:41 2022] POST /compute/v2.1/os-aggregates/1/action => generated 242 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:49:42.131045 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4ee0b132-7e88-4f43-8c25-ea4a0eec70a3 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:42.142710 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cff1a3d4-84e9-4cfa-8170-fbc60c6f26cb tempest-FlavorMetadataValidation-1250002644 tempest-FlavorMetadataValidation-1250002644-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 6221 microversion: 2.86 time: 0.028008 Sep 24 20:49:42.143402 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 12/15] 10.222.0.52 () {60 vars in 1187 bytes} [Sat Sep 24 20:49:42 2022] GET /compute/v2.1/flavors/detail => generated 6221 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:49:42.148148 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b485f7dc-05e2-41ba-9c71-b39c1c5dd76c tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:42.169796 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b485f7dc-05e2-41ba-9c71-b39c1c5dd76c tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:42.170679 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b485f7dc-05e2-41ba-9c71-b39c1c5dd76c tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:42.171476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b485f7dc-05e2-41ba-9c71-b39c1c5dd76c tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:42.201319 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4ee0b132-7e88-4f43-8c25-ea4a0eec70a3 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.076941 Sep 24 20:49:42.202583 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 4/16] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:49:42 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:49:42.223296 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-feca4c08-244e-464b-ab60-a50f381a95d2 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:42.242812 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-b485f7dc-05e2-41ba-9c71-b39c1c5dd76c tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] HTTP exception thrown: Aggregate 1 already has host nch1-master-1. Sep 24 20:49:42.273782 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-feca4c08-244e-464b-ab60-a50f381a95d2 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/849748169" status: 202 len: 0 microversion: 2.1 time: 0.054282 Sep 24 20:49:42.278522 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 5/17] 10.222.0.52 () {58 vars in 1158 bytes} [Sat Sep 24 20:49:42 2022] DELETE /compute/v2.1/flavors/849748169 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 20:49:42.279942 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b485f7dc-05e2-41ba-9c71-b39c1c5dd76c tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Request method failure captured: Sep 24 20:49:42.279942 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Sep 24 20:49:42.279942 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:49:42.279942 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:49:42.279942 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:49:42.279942 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 39 Sep 24 20:49:42.279942 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:49:42.279942 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:49:42.279942 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:49:42.279942 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:49:42.279942 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL21hJ1CF2mkJt96SF7DXZ-9JiF-EYzXLBX_u18XtsNx4b5ZsbCRUZiIBh8c91Zj8sUeE_NpuXiCn8rHgr7lpUQJ_sg_RfrSOzo6ap18kYx-Cjq5KPhNfIuZAcscKQLqI9EupePrTfOxBsrQGp58MXaN4jwib7gEdIeMceQ-kLhleWb0 Sep 24 20:49:42.279942 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:49:42.279942 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:49:42.279942 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:49:42.279942 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:49:42.279942 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:49:42.279942 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:49:42.279942 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 79afe6f2d12f45e994b77b96c44f8239 Sep 24 20:49:42.279942 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-422514215 Sep 24 20:49:42.279942 ncdv-master-1 devstack@n-api.service[140516]: X-Role: admin,reader,member Sep 24 20:49:42.279942 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: admin,reader,member Sep 24 20:49:42.281033 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/79afe6f2d12f45e994b77b96c44f8239"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_79afe6f2d12f45e994b77b96c44f8239"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/79afe6f2d12f45e994b77b96c44f8239"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/79afe6f2d12f45e994b77b96c44f8239"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:49:42.281033 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-422514215 Sep 24 20:49:42.281033 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 79afe6f2d12f45e994b77b96c44f8239 Sep 24 20:49:42.281033 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-422514215 Sep 24 20:49:42.281033 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin Sep 24 20:49:42.281033 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:49:42.281033 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:49:42.281033 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 64a47c4d366e4af88ff0386e79158e85 Sep 24 20:49:42.281033 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin Sep 24 20:49:42.281033 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 20:49:42.281033 ncdv-master-1 devstack@n-api.service[140516]: {"add_host": {"host": "nch1-master-1"}} Sep 24 20:49:42.281033 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:49:42.281033 ncdv-master-1 devstack@n-api.service[140516]: exception: Aggregate 1 already has host nch1-master-1. Sep 24 20:49:42.281731 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '1', 'body': {'add_host': {'host': 'nch1-master-1'}}} Sep 24 20:49:42.281731 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:49:42.281731 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:42.281731 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 24 20:49:42.281731 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 24 20:49:42.281731 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 24 20:49:42.281731 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 24 20:49:42.281731 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 24 20:49:42.281731 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 24 20:49:42.281731 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 24 20:49:42.281731 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 24 20:49:42.281731 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 24 20:49:42.281731 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 24 20:49:42.281731 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 24 20:49:42.281731 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result.read() Sep 24 20:49:42.281731 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 24 20:49:42.281731 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 24 20:49:42.281731 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 24 20:49:42.281731 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 24 20:49:42.282675 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 24 20:49:42.282675 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 24 20:49:42.282675 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 24 20:49:42.282675 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 24 20:49:42.282675 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'nch1-master-1-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 24 20:49:42.282675 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:42.282675 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 24 20:49:42.282675 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:42.282675 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:42.282675 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Sep 24 20:49:42.282675 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Sep 24 20:49:42.282675 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 24 20:49:42.282675 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi session.flush() Sep 24 20:49:42.282675 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 24 20:49:42.282675 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 24 20:49:42.282675 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 24 20:49:42.282675 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 24 20:49:42.282675 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 24 20:49:42.282675 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 24 20:49:42.283578 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 24 20:49:42.283578 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception Sep 24 20:49:42.283578 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 24 20:49:42.283578 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 24 20:49:42.283578 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 24 20:49:42.283578 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 24 20:49:42.283578 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 24 20:49:42.283578 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 24 20:49:42.283578 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 24 20:49:42.283578 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 24 20:49:42.283578 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 24 20:49:42.283578 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 24 20:49:42.283578 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 24 20:49:42.283578 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 24 20:49:42.283578 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 24 20:49:42.283578 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 24 20:49:42.283578 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 24 20:49:42.283578 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 24 20:49:42.284470 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 24 20:49:42.284470 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 24 20:49:42.284470 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 24 20:49:42.284470 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 24 20:49:42.284470 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 24 20:49:42.284470 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception Sep 24 20:49:42.284470 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 24 20:49:42.284470 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 24 20:49:42.284470 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 24 20:49:42.284470 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 24 20:49:42.284470 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 24 20:49:42.284470 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 24 20:49:42.284470 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 24 20:49:42.284470 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 24 20:49:42.284470 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 24 20:49:42.284470 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 24 20:49:42.284470 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 24 20:49:42.284470 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result.read() Sep 24 20:49:42.285287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 24 20:49:42.285287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 24 20:49:42.285287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 24 20:49:42.285287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 24 20:49:42.285287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 24 20:49:42.285287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 24 20:49:42.285287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 24 20:49:42.285287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 24 20:49:42.285287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'nch1-master-1-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 24 20:49:42.285287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Sep 24 20:49:42.285287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 24, 20, 49, 42, 210740), 'updated_at': None, 'host': 'nch1-master-1', 'aggregate_id': 1}] Sep 24 20:49:42.285287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 24 20:49:42.285287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:42.285287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:49:42.285287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:42.285287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:42.285287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 24 20:49:42.286078 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 24 20:49:42.286078 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 24 20:49:42.286078 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 24 20:49:42.286078 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:49:42.286078 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:49:42.286078 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:49:42.286078 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:49:42.286078 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 24 20:49:42.286078 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 24 20:49:42.286078 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Sep 24 20:49:42.286078 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Sep 24 20:49:42.286078 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 24 20:49:42.286078 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 24 20:49:42.286078 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Sep 24 20:49:42.286078 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Sep 24 20:49:42.286078 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Sep 24 20:49:42.286078 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Sep 24 20:49:42.286078 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host nch1-master-1. Sep 24 20:49:42.286078 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:42.286078 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:49:42.289361 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:42.289361 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:42.289361 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:49:42.289361 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:49:42.289361 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:49:42.289361 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:49:42.289361 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:49:42.289361 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:49:42.289361 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:49:42.289361 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:49:42.289361 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Sep 24 20:49:42.289361 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 24 20:49:42.289361 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host nch1-master-1. Sep 24 20:49:42.289361 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:42.289361 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:49:42.289361 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:42.289361 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:42.289361 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:49:42.289361 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:49:42.289361 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:49:42.289361 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:49:42.292253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host nch1-master-1. Sep 24 20:49:42.292253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:42.292909 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b485f7dc-05e2-41ba-9c71-b39c1c5dd76c tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Returning 409 to user: Aggregate 1 already has host nch1-master-1. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:49:42.294240 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b485f7dc-05e2-41ba-9c71-b39c1c5dd76c tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.149516 Sep 24 20:49:42.295366 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 13/18] 10.222.0.52 () {60 vars in 1191 bytes} [Sat Sep 24 20:49:42 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 151 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Sep 24 20:49:42.300356 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4b40adb7-29a6-4f81-bba4-094be048168b tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:42.304710 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bf0f63f6-3498-44e9-9c6f-4336f92e9c51 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:42.320585 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bf0f63f6-3498-44e9-9c6f-4336f92e9c51 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:42.322135 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bf0f63f6-3498-44e9-9c6f-4336f92e9c51 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:42.322932 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bf0f63f6-3498-44e9-9c6f-4336f92e9c51 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:42.324213 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4b40adb7-29a6-4f81-bba4-094be048168b tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042617 Sep 24 20:49:42.335604 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 6/19] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:49:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:49:42.350747 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-baa195fc-9ee3-41d0-ba95-476ad58b4ae5 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1990758674", "id": 607627742, "os-flavor-access:is_public": "True"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:42.416400 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-baa195fc-9ee3-41d0-ba95-476ad58b4ae5 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.073568 Sep 24 20:49:42.426647 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 7/20] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:49:42 2022] POST /compute/v2.1/flavors => generated 426 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:49:42.435130 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e473483f-afd6-4c00-ba30-fd30f008fb2e tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:42.459630 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e473483f-afd6-4c00-ba30-fd30f008fb2e tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/607627742" status: 202 len: 0 microversion: 2.1 time: 0.031291 Sep 24 20:49:42.460551 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 8/21] 10.222.0.52 () {58 vars in 1158 bytes} [Sat Sep 24 20:49:42 2022] DELETE /compute/v2.1/flavors/607627742 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:49:42.470039 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-339d2beb-d933-4294-bd23-a1f8203fcf19 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:42.493444 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-339d2beb-d933-4294-bd23-a1f8203fcf19 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028187 Sep 24 20:49:42.507809 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 9/22] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:49:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:49:42.519064 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9edf8204-6d8c-422d-b948-fb681196afb6 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1662894190", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:42.550910 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9edf8204-6d8c-422d-b948-fb681196afb6 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.034432 Sep 24 20:49:42.561996 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 10/23] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:49:42 2022] POST /compute/v2.1/flavors => generated 507 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:49:42.576812 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-03f094ed-7f85-4167-84fe-d18e62d78358 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:42.644282 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-03f094ed-7f85-4167-84fe-d18e62d78358 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/8206561f-608b-42bb-9542-6570a3dac84b" status: 202 len: 0 microversion: 2.1 time: 0.061244 Sep 24 20:49:42.644282 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 11/24] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:49:42 2022] DELETE /compute/v2.1/flavors/8206561f-608b-42bb-9542-6570a3dac84b => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:49:42.648166 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5bfc0133-c7fc-46de-8176-3b5482a6a845 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:42.677750 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5bfc0133-c7fc-46de-8176-3b5482a6a845 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033266 Sep 24 20:49:42.678541 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 12/25] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:49:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:49:42.707966 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-157cb06d-16ff-4f18-af2c-806d439b9bd8 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1995273688", "id": "b1301d46-f33b-46c3-87c2-4835b66d6a7b", "os-flavor-access:is_public": "True"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:42.751142 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-157cb06d-16ff-4f18-af2c-806d439b9bd8 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.055521 Sep 24 20:49:42.759942 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 13/26] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:49:42 2022] POST /compute/v2.1/flavors => generated 507 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:49:42.765928 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8c4c1346-eeb8-415b-a2df-0d53d9221dd6 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:42.802896 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8c4c1346-eeb8-415b-a2df-0d53d9221dd6 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/b1301d46-f33b-46c3-87c2-4835b66d6a7b" status: 202 len: 0 microversion: 2.1 time: 0.041414 Sep 24 20:49:42.803990 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 14/27] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:49:42 2022] DELETE /compute/v2.1/flavors/b1301d46-f33b-46c3-87c2-4835b66d6a7b => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:49:42.813873 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-41a57148-0689-4386-b965-eb52d312ab23 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:42.845909 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-41a57148-0689-4386-b965-eb52d312ab23 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037158 Sep 24 20:49:42.846586 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 15/28] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:49:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:49:42.866986 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2da4d2f9-1050-4906-aab8-5bb6b0aa0387 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-382769551", "id": 1820265896, "os-flavor-access:is_public": "True"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:42.890222 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2da4d2f9-1050-4906-aab8-5bb6b0aa0387 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.027717 Sep 24 20:49:42.891165 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 16/29] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:49:42 2022] POST /compute/v2.1/flavors => generated 413 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:49:42.903866 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-74dae4ad-ad63-401b-8d4b-6bc3d04a7543 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:42.917902 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-74dae4ad-ad63-401b-8d4b-6bc3d04a7543 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/1820265896" status: 200 len: 413 microversion: 2.1 time: 0.018302 Sep 24 20:49:42.918486 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 17/30] 10.222.0.52 () {58 vars in 1158 bytes} [Sat Sep 24 20:49:42 2022] GET /compute/v2.1/flavors/1820265896 => generated 413 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:49:43.368271 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bf0f63f6-3498-44e9-9c6f-4336f92e9c51 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 227 microversion: 2.1 time: 1.067730 Sep 24 20:49:43.371790 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 14/31] 10.222.0.52 () {60 vars in 1191 bytes} [Sat Sep 24 20:49:42 2022] POST /compute/v2.1/os-aggregates/1/action => generated 227 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:49:43.391923 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d334857c-52c4-4cf7-bcf4-1c685b9480b5 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:43.467339 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d334857c-52c4-4cf7-bcf4-1c685b9480b5 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.089280 Sep 24 20:49:43.468158 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 15/32] 10.222.0.52 () {58 vars in 1152 bytes} [Sat Sep 24 20:49:43 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 24 20:49:43.486689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-31b2dbf8-5b12-4efd-bc7c-3c8e884e2da1 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1955295306"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:43.492701 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.aggregate [None req-31b2dbf8-5b12-4efd-bc7c-3c8e884e2da1 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Generated uuid a4cab117-a5e2-45eb-8078-fa0ed8a027c7 for aggregate {{(pid=140516) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 24 20:49:43.568563 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-31b2dbf8-5b12-4efd-bc7c-3c8e884e2da1 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.093117 Sep 24 20:49:43.575368 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 16/33] 10.222.0.52 () {60 vars in 1164 bytes} [Sat Sep 24 20:49:43 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:49:43.588613 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f5afcd3c-e03d-4196-98e1-d453f11e9e96 tempest-AggregatesAdminTestV241-1648698894 tempest-AggregatesAdminTestV241-1648698894-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1474855135"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:43.592149 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.aggregate [None req-f5afcd3c-e03d-4196-98e1-d453f11e9e96 tempest-AggregatesAdminTestV241-1648698894 tempest-AggregatesAdminTestV241-1648698894-project-admin] Generated uuid 7746f6a6-3e4f-494a-84fa-5030d764e774 for aggregate {{(pid=140516) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 24 20:49:43.643188 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f5afcd3c-e03d-4196-98e1-d453f11e9e96 tempest-AggregatesAdminTestV241-1648698894 tempest-AggregatesAdminTestV241-1648698894-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.070558 Sep 24 20:49:43.644149 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 17/34] 10.222.0.52 () {62 vars in 1205 bytes} [Sat Sep 24 20:49:43 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:49:43.821639 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-92dce6de-7b0a-462f-acd2-7ea05b21c9c3 tempest-FlavorsV261TestJSON-199266187 tempest-FlavorsV261TestJSON-199266187-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-420316432", "id": 360547118, "os-flavor-access:is_public": "True"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:43.824772 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1f33c2e5-79c2-4192-ad84-7bb73b881e42 tempest-FlavorsAdminTestJSON-2046652293 tempest-FlavorsAdminTestJSON-2046652293-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:43.852156 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-92dce6de-7b0a-462f-acd2-7ea05b21c9c3 tempest-FlavorsV261TestJSON-199266187 tempest-FlavorsV261TestJSON-199266187-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 0.206500 Sep 24 20:49:43.853818 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 18/35] 10.222.0.52 () {62 vars in 1188 bytes} [Sat Sep 24 20:49:43 2022] POST /compute/v2.1/flavors => generated 464 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:49:43.933639 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1f33c2e5-79c2-4192-ad84-7bb73b881e42 tempest-FlavorsAdminTestJSON-2046652293 tempest-FlavorsAdminTestJSON-2046652293-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5808 microversion: 2.1 time: 0.998213 Sep 24 20:49:43.934552 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 18/36] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:49:42 2022] GET /compute/v2.1/flavors/detail => generated 5808 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:49:43.951981 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4563940e-591e-4a73-8090-2b9c824d4fe0 tempest-AggregatesAdminTestV241-1648698894 tempest-AggregatesAdminTestV241-1648698894-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-181838139"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:44.114105 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4563940e-591e-4a73-8090-2b9c824d4fe0 tempest-AggregatesAdminTestV241-1648698894 tempest-AggregatesAdminTestV241-1648698894-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-aggregates/3" status: 200 len: 298 microversion: 2.41 time: 0.173886 Sep 24 20:49:44.117817 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 19/37] 10.222.0.52 () {62 vars in 1210 bytes} [Sat Sep 24 20:49:43 2022] PUT /compute/v2.1/os-aggregates/3 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:49:44.148368 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1f0ccfed-f4a7-4b3d-af43-7eb96fd354f8 tempest-AggregatesAdminNegativeTestJSON-1230891279 tempest-AggregatesAdminNegativeTestJSON-1230891279-project] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:44.159198 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1f0ccfed-f4a7-4b3d-af43-7eb96fd354f8 tempest-AggregatesAdminNegativeTestJSON-1230891279 tempest-AggregatesAdminNegativeTestJSON-1230891279-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '7af773989be84d47a75f107f9acc8c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea3cc3ecfc941758415b8324faf7644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:49:44.162412 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1f0ccfed-f4a7-4b3d-af43-7eb96fd354f8 tempest-AggregatesAdminNegativeTestJSON-1230891279 tempest-AggregatesAdminNegativeTestJSON-1230891279-project] Request method failure captured: Sep 24 20:49:44.162412 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Sep 24 20:49:44.162412 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:49:44.162412 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:49:44.162412 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:49:44.162412 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 39 Sep 24 20:49:44.162412 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:49:44.162412 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:49:44.162412 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:49:44.162412 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:49:44.162412 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL21f4RaHWOrhnWIuWpqpkYL7mjtuC3JO0zkKes6TNKdr9u-3PrJszigST82y1DkYyYALY5dcIqGyY_wqVkqcf1PlFdiccA0koW5cnrJibJwQ7J25YdRK_gokc5lYfP_EUDwUNskhksknLFgudTSUIRQj8Uexajfgt9ef1kslJZSDYDY Sep 24 20:49:44.162412 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:49:44.162412 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:49:44.162412 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:49:44.162412 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:49:44.162412 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:49:44.162412 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:49:44.162412 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 6ea3cc3ecfc941758415b8324faf7644 Sep 24 20:49:44.162412 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1230891279 Sep 24 20:49:44.162412 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:49:44.162412 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:49:44.163480 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6ea3cc3ecfc941758415b8324faf7644"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6ea3cc3ecfc941758415b8324faf7644"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6ea3cc3ecfc941758415b8324faf7644"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6ea3cc3ecfc941758415b8324faf7644"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:49:44.163480 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1230891279 Sep 24 20:49:44.163480 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 6ea3cc3ecfc941758415b8324faf7644 Sep 24 20:49:44.163480 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1230891279 Sep 24 20:49:44.163480 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-AggregatesAdminNegativeTestJSON-1230891279-project Sep 24 20:49:44.163480 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:49:44.163480 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:49:44.163480 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 7af773989be84d47a75f107f9acc8c69 Sep 24 20:49:44.163480 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1230891279-project Sep 24 20:49:44.163480 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 20:49:44.163480 ncdv-master-1 devstack@n-api.service[140516]: {"add_host": {"host": "nch1-master-1"}} Sep 24 20:49:44.163480 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:49:44.163480 ncdv-master-1 devstack@n-api.service[140516]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 24 20:49:44.164336 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '2', 'body': {'add_host': {'host': 'nch1-master-1'}}} Sep 24 20:49:44.164336 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:49:44.164336 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:44.164336 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:49:44.164336 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:49:44.164336 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:49:44.164336 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:49:44.164336 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:49:44.164336 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:49:44.164336 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:49:44.164336 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:49:44.164336 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Sep 24 20:49:44.164336 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Sep 24 20:49:44.164336 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 24 20:49:44.164336 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 24 20:49:44.164336 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 24 20:49:44.164336 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 24 20:49:44.164336 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:49:44.164336 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:49:44.165266 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:49:44.165266 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:49:44.165266 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 24 20:49:44.165266 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 24 20:49:44.165266 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 24 20:49:44.165266 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 24 20:49:44.165266 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 24 20:49:44.165266 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 24 20:49:44.165266 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 24 20:49:44.165266 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:44.165266 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:49:44.165266 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:44.165266 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:44.165266 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:49:44.165266 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:49:44.165266 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 24 20:49:44.165266 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 24 20:49:44.165266 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 24 20:49:44.165266 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:44.166190 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1f0ccfed-f4a7-4b3d-af43-7eb96fd354f8 tempest-AggregatesAdminNegativeTestJSON-1230891279 tempest-AggregatesAdminNegativeTestJSON-1230891279-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:49:44.166190 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1f0ccfed-f4a7-4b3d-af43-7eb96fd354f8 tempest-AggregatesAdminNegativeTestJSON-1230891279 tempest-AggregatesAdminNegativeTestJSON-1230891279-project] 10.222.0.52 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.309537 Sep 24 20:49:44.166190 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 19/38] 10.222.0.52 () {60 vars in 1191 bytes} [Sat Sep 24 20:49:43 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 311 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:49:44.179764 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0d5b0ce0-18ef-4ee6-abbc-dc77cbcd45d9 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:44.231513 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0d5b0ce0-18ef-4ee6-abbc-dc77cbcd45d9 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1820265896" status: 202 len: 0 microversion: 2.1 time: 0.064569 Sep 24 20:49:44.232180 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 20/39] 10.222.0.52 () {58 vars in 1161 bytes} [Sat Sep 24 20:49:44 2022] DELETE /compute/v2.1/flavors/1820265896 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:49:44.240599 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d82d6a60-55de-420b-b190-8a693038e30a tempest-AggregatesAdminTestV241-1648698894 tempest-AggregatesAdminTestV241-1648698894-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:44.260016 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=10,nova_api:DELETE=12,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:49:44.264276 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d82d6a60-55de-420b-b190-8a693038e30a tempest-AggregatesAdminTestV241-1648698894 tempest-AggregatesAdminTestV241-1648698894-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 298 microversion: 2.41 time: 0.030650 Sep 24 20:49:44.265991 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 21/40] 10.222.0.52 () {60 vars in 1190 bytes} [Sat Sep 24 20:49:44 2022] GET /compute/v2.1/os-aggregates/3 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:49:44.271796 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-91597a95-14eb-4897-b1b0-6f23a846ad14 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:44.323790 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-258bdf38-a120-4101-9502-d3a37a43dda0 tempest-FlavorsV261TestJSON-655785932 tempest-FlavorsV261TestJSON-655785932-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:44.332241 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-91597a95-14eb-4897-b1b0-6f23a846ad14 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.060434 Sep 24 20:49:44.333170 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 22/41] 10.222.0.52 () {58 vars in 1152 bytes} [Sat Sep 24 20:49:44 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 24 20:49:44.348677 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7b3dc5f0-8b48-412c-83e6-4a2f0879be93 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:44.353943 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-258bdf38-a120-4101-9502-d3a37a43dda0 tempest-FlavorsV261TestJSON-655785932 tempest-FlavorsV261TestJSON-655785932-project] 10.222.0.52 "GET /compute/v2.1/flavors/360547118" status: 200 len: 464 microversion: 2.61 time: 0.234725 Sep 24 20:49:44.355010 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 20/42] 10.222.0.52 () {60 vars in 1196 bytes} [Sat Sep 24 20:49:44 2022] GET /compute/v2.1/flavors/360547118 => generated 464 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:49:44.368596 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6b9bf167-0845-42ec-95f1-cb6aaea70fb9 tempest-AggregatesAdminTestV241-1648698894 tempest-AggregatesAdminTestV241-1648698894-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:44.384592 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7b3dc5f0-8b48-412c-83e6-4a2f0879be93 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.048277 Sep 24 20:49:44.387355 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 23/43] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:49:44 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:49:44.395299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cf70ac4d-079e-45d7-a236-1a6d9024130e tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-131102106"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:44.396407 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b9bf167-0845-42ec-95f1-cb6aaea70fb9 tempest-AggregatesAdminTestV241-1648698894 tempest-AggregatesAdminTestV241-1648698894-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:44.400991 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.aggregate [None req-cf70ac4d-079e-45d7-a236-1a6d9024130e tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Generated uuid d64fd172-f101-4fd5-a127-7da07c66771d for aggregate {{(pid=140516) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 24 20:49:44.409341 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b9bf167-0845-42ec-95f1-cb6aaea70fb9 tempest-AggregatesAdminTestV241-1648698894 tempest-AggregatesAdminTestV241-1648698894-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:44.410296 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b9bf167-0845-42ec-95f1-cb6aaea70fb9 tempest-AggregatesAdminTestV241-1648698894 tempest-AggregatesAdminTestV241-1648698894-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:44.446311 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cf70ac4d-079e-45d7-a236-1a6d9024130e tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.056197 Sep 24 20:49:44.446964 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 24/44] 10.222.0.52 () {60 vars in 1164 bytes} [Sat Sep 24 20:49:44 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:49:44.464758 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-07a71467-154e-4a08-ba98-64923d76a833 tempest-FlavorsV261TestJSON-199266187 tempest-FlavorsV261TestJSON-199266187-project-admin] Action: 'update', calling method: .version_select at 0x7f4b0e4fb430>, body: {"flavor": {"description": "new"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:44.530731 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-07a71467-154e-4a08-ba98-64923d76a833 tempest-FlavorsV261TestJSON-199266187 tempest-FlavorsV261TestJSON-199266187-project-admin] 10.222.0.52 "PUT /compute/v2.1/flavors/360547118" status: 200 len: 465 microversion: 2.61 time: 0.073641 Sep 24 20:49:44.531343 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 25/45] 10.222.0.52 () {62 vars in 1216 bytes} [Sat Sep 24 20:49:44 2022] PUT /compute/v2.1/flavors/360547118 => generated 465 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:49:44.565313 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-45b53c0e-5600-46b2-9236-ef1bf0c28c77 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-872833880", "id": 528443546, "os-flavor-access:is_public": "False"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:44.609493 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-45b53c0e-5600-46b2-9236-ef1bf0c28c77 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.076288 Sep 24 20:49:44.611461 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 26/46] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:49:44 2022] POST /compute/v2.1/flavors => generated 426 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:49:44.624952 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-942cf082-980f-453f-ad1c-45840f126b15 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-2061033437"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:44.643979 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-942cf082-980f-453f-ad1c-45840f126b15 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),788aecb6-32dc-4b71-909a-be050455aded(cell1) {{(pid=140516) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 24 20:49:44.644890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-942cf082-980f-453f-ad1c-45840f126b15 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:44.645461 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-942cf082-980f-453f-ad1c-45840f126b15 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:44.646636 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-942cf082-980f-453f-ad1c-45840f126b15 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:44.657435 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-942cf082-980f-453f-ad1c-45840f126b15 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:44.658345 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-942cf082-980f-453f-ad1c-45840f126b15 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:44.658954 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-942cf082-980f-453f-ad1c-45840f126b15 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:44.674660 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-942cf082-980f-453f-ad1c-45840f126b15 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-2061033437 could not be found. Sep 24 20:49:44.676787 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6b9bf167-0845-42ec-95f1-cb6aaea70fb9 tempest-AggregatesAdminTestV241-1648698894 tempest-AggregatesAdminTestV241-1648698894-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 313 microversion: 2.41 time: 0.320425 Sep 24 20:49:44.677737 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 21/47] 10.222.0.52 () {62 vars in 1232 bytes} [Sat Sep 24 20:49:44 2022] POST /compute/v2.1/os-aggregates/3/action => generated 313 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:49:44.682912 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-942cf082-980f-453f-ad1c-45840f126b15 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Request method failure captured: Sep 24 20:49:44.682912 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Sep 24 20:49:44.682912 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:49:44.682912 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:49:44.682912 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:49:44.682912 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 58 Sep 24 20:49:44.682912 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:49:44.682912 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:49:44.682912 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:49:44.682912 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:49:44.682912 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL21hJ1CF2mkJt96SF7DXZ-9JiF-EYzXLBX_u18XtsNx4b5ZsbCRUZiIBh8c91Zj8sUeE_NpuXiCn8rHgr7lpUQJ_sg_RfrSOzo6ap18kYx-Cjq5KPhNfIuZAcscKQLqI9EupePrTfOxBsrQGp58MXaN4jwib7gEdIeMceQ-kLhleWb0 Sep 24 20:49:44.682912 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:49:44.682912 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:49:44.682912 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:49:44.682912 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:49:44.682912 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:49:44.682912 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:49:44.682912 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 79afe6f2d12f45e994b77b96c44f8239 Sep 24 20:49:44.682912 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-422514215 Sep 24 20:49:44.682912 ncdv-master-1 devstack@n-api.service[140516]: X-Role: admin,reader,member Sep 24 20:49:44.682912 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: admin,reader,member Sep 24 20:49:44.684245 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/79afe6f2d12f45e994b77b96c44f8239"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_79afe6f2d12f45e994b77b96c44f8239"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/79afe6f2d12f45e994b77b96c44f8239"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/79afe6f2d12f45e994b77b96c44f8239"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:49:44.684245 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-422514215 Sep 24 20:49:44.684245 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 79afe6f2d12f45e994b77b96c44f8239 Sep 24 20:49:44.684245 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-422514215 Sep 24 20:49:44.684245 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin Sep 24 20:49:44.684245 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:49:44.684245 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:49:44.684245 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 64a47c4d366e4af88ff0386e79158e85 Sep 24 20:49:44.684245 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin Sep 24 20:49:44.684245 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 20:49:44.684245 ncdv-master-1 devstack@n-api.service[140516]: {"add_host": {"host": "tempest-nonexist_host-2061033437"}} Sep 24 20:49:44.684245 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:49:44.684245 ncdv-master-1 devstack@n-api.service[140516]: exception: Compute host tempest-nonexist_host-2061033437 could not be found. Sep 24 20:49:44.685034 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-2061033437'}}} Sep 24 20:49:44.685034 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:49:44.685034 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:44.685034 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 24 20:49:44.685034 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 24 20:49:44.685034 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 20:49:44.685034 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 20:49:44.685034 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 24 20:49:44.685034 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 24 20:49:44.685034 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 24 20:49:44.685034 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 24 20:49:44.685034 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 24 20:49:44.685034 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 24 20:49:44.685034 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-2061033437' is not mapped to any cell Sep 24 20:49:44.685034 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:44.685034 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:49:44.685034 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:44.685034 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:44.685034 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 24 20:49:44.686202 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 24 20:49:44.686202 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 24 20:49:44.686202 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 24 20:49:44.686202 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 24 20:49:44.686202 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:44.686202 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:49:44.686202 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:44.686202 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:44.686202 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 24 20:49:44.686202 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 24 20:49:44.686202 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 24 20:49:44.686202 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 24 20:49:44.686202 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:49:44.686202 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:49:44.686202 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:49:44.686202 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:49:44.686202 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 24 20:49:44.686202 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 24 20:49:44.686202 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Sep 24 20:49:44.686202 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Sep 24 20:49:44.687552 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 24 20:49:44.687552 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 24 20:49:44.687552 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-2061033437 could not be found. Sep 24 20:49:44.687552 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:44.687552 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:49:44.687552 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:44.687552 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:44.687552 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:49:44.687552 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:49:44.687552 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:49:44.687552 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:49:44.687552 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:49:44.687552 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:49:44.687552 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:49:44.687552 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:49:44.687552 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Sep 24 20:49:44.687552 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:49:44.687552 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-2061033437 could not be found. Sep 24 20:49:44.687552 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:44.687552 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:49:44.687552 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:44.689503 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:44.689503 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:49:44.689503 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:49:44.689503 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:49:44.689503 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:49:44.689503 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-2061033437 could not be found. Sep 24 20:49:44.689503 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:44.691756 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-942cf082-980f-453f-ad1c-45840f126b15 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-2061033437 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:49:44.692988 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f08f3799-4ae4-48c9-a2ad-6c7bb22112e2 tempest-FlavorsV261TestJSON-655785932 tempest-FlavorsV261TestJSON-655785932-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:44.694071 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-942cf082-980f-453f-ad1c-45840f126b15 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 111 microversion: 2.1 time: 0.073842 Sep 24 20:49:44.694828 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 27/48] 10.222.0.52 () {60 vars in 1191 bytes} [Sat Sep 24 20:49:44 2022] POST /compute/v2.1/os-aggregates/4/action => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:49:44.703072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9f76e250-e73c-434a-9001-f9dd3fd5b40f tempest-FlavorsAdminTestJSON-2046652293 tempest-FlavorsAdminTestJSON-2046652293-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "528443546"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:44.752221 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f08f3799-4ae4-48c9-a2ad-6c7bb22112e2 tempest-FlavorsV261TestJSON-655785932 tempest-FlavorsV261TestJSON-655785932-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 6246 microversion: 2.61 time: 0.073374 Sep 24 20:49:44.753245 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 22/49] 10.222.0.52 () {60 vars in 1187 bytes} [Sat Sep 24 20:49:44 2022] GET /compute/v2.1/flavors/detail => generated 6246 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:49:44.765611 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-9f76e250-e73c-434a-9001-f9dd3fd5b40f tempest-FlavorsAdminTestJSON-2046652293 tempest-FlavorsAdminTestJSON-2046652293-project] HTTP exception thrown: Flavor 528443546 could not be found. Sep 24 20:49:44.769504 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9f76e250-e73c-434a-9001-f9dd3fd5b40f tempest-FlavorsAdminTestJSON-2046652293 tempest-FlavorsAdminTestJSON-2046652293-project] Request method failure captured: Sep 24 20:49:44.769504 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 24 20:49:44.769504 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:49:44.769504 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:49:44.769504 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:49:44.769504 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 106 Sep 24 20:49:44.769504 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:49:44.769504 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:49:44.769504 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:49:44.769504 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:49:44.769504 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL21g7QjbgOolk8YBQWrj2mID1EF5NZEFRLHu6prY_icqRtqqNcjn8e3VpPOcsmCsEQkSOEOEaaqIkjzyrIGszGhvHDlBYSwpkWUtjClDGKTS4VfDbvc_uN_WKBjgNY7QcNDRpzYFqe690Fcd4nWIjgANdKu3V7TOX_Ndojignc0ynWs Sep 24 20:49:44.769504 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:49:44.769504 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:49:44.769504 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:49:44.769504 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:49:44.769504 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:49:44.769504 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:49:44.769504 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 084b640ae5ed4ce683962557ecdd84ec Sep 24 20:49:44.769504 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-FlavorsAdminTestJSON-2046652293 Sep 24 20:49:44.769504 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:49:44.769504 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:49:44.770665 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/084b640ae5ed4ce683962557ecdd84ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_084b640ae5ed4ce683962557ecdd84ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/084b640ae5ed4ce683962557ecdd84ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/084b640ae5ed4ce683962557ecdd84ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:49:44.770665 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-FlavorsAdminTestJSON-2046652293 Sep 24 20:49:44.770665 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 084b640ae5ed4ce683962557ecdd84ec Sep 24 20:49:44.770665 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-2046652293 Sep 24 20:49:44.770665 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-FlavorsAdminTestJSON-2046652293-project Sep 24 20:49:44.770665 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:49:44.770665 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:49:44.770665 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: fb4bd7ce915e4b329d3f8cf1ee5f2d3f Sep 24 20:49:44.770665 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-FlavorsAdminTestJSON-2046652293-project Sep 24 20:49:44.770665 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 20:49:44.770665 ncdv-master-1 devstack@n-api.service[140516]: {"server": {"name": "test", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "528443546"}} Sep 24 20:49:44.770665 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:49:44.770665 ncdv-master-1 devstack@n-api.service[140516]: exception: Flavor 528443546 could not be found. Sep 24 20:49:44.771309 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '4c30e8e9-8fb2-4377-83f1-98322cb17799', 'flavorRef': '528443546'}}} Sep 24 20:49:44.771309 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:49:44.771309 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:44.771309 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 24 20:49:44.771309 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 24 20:49:44.771309 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 24 20:49:44.771309 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 24 20:49:44.771309 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 20:49:44.771309 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 20:49:44.771309 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 24 20:49:44.771309 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 24 20:49:44.771309 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 24 20:49:44.771309 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:49:44.771309 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 24 20:49:44.771309 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 24 20:49:44.771309 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 528443546 could not be found. Sep 24 20:49:44.771309 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:44.771309 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:49:44.771309 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:44.771309 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:44.772529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:49:44.772529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:49:44.772529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:49:44.772529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:49:44.772529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:49:44.772529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:49:44.772529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:49:44.772529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:49:44.772529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:49:44.772529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:49:44.772529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:49:44.772529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:49:44.772529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 24 20:49:44.772529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 24 20:49:44.772529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 24 20:49:44.772529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 528443546 could not be found. Sep 24 20:49:44.772529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:44.772529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:49:44.772529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:44.772529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:44.772529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:49:44.773546 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:49:44.773546 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:49:44.773546 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:49:44.773546 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 528443546 could not be found. Sep 24 20:49:44.773546 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:44.774911 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9f76e250-e73c-434a-9001-f9dd3fd5b40f tempest-FlavorsAdminTestJSON-2046652293 tempest-FlavorsAdminTestJSON-2046652293-project] Returning 400 to user: Flavor 528443546 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:49:44.776182 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9f76e250-e73c-434a-9001-f9dd3fd5b40f tempest-FlavorsAdminTestJSON-2046652293 tempest-FlavorsAdminTestJSON-2046652293-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.079288 Sep 24 20:49:44.776513 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ed0cbbb8-d7db-4d6f-87e2-edd0505a6994 tempest-AggregatesAdminTestV241-1648698894 tempest-AggregatesAdminTestV241-1648698894-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:44.777065 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 28/50] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:49:44 2022] POST /compute/v2.1/servers => generated 80 bytes in 81 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 24 20:49:44.783470 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-074137d6-58d3-4bd1-8abe-14c020b5d041 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:44.814277 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed0cbbb8-d7db-4d6f-87e2-edd0505a6994 tempest-AggregatesAdminTestV241-1648698894 tempest-AggregatesAdminTestV241-1648698894-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:44.814793 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed0cbbb8-d7db-4d6f-87e2-edd0505a6994 tempest-AggregatesAdminTestV241-1648698894 tempest-AggregatesAdminTestV241-1648698894-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:44.815232 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed0cbbb8-d7db-4d6f-87e2-edd0505a6994 tempest-AggregatesAdminTestV241-1648698894 tempest-AggregatesAdminTestV241-1648698894-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:44.837165 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-074137d6-58d3-4bd1-8abe-14c020b5d041 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.058751 Sep 24 20:49:44.838708 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 29/51] 10.222.0.52 () {58 vars in 1152 bytes} [Sat Sep 24 20:49:44 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 24 20:49:44.844061 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-68adf7e7-52d5-4e16-92de-e0497be625f6 tempest-FlavorsV261TestJSON-655785932 tempest-FlavorsV261TestJSON-655785932-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:44.895069 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-68adf7e7-52d5-4e16-92de-e0497be625f6 tempest-FlavorsV261TestJSON-655785932 tempest-FlavorsV261TestJSON-655785932-project] 10.222.0.52 "GET /compute/v2.1/flavors" status: 200 len: 3153 microversion: 2.61 time: 0.054157 Sep 24 20:49:44.895707 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 30/52] 10.222.0.52 () {60 vars in 1166 bytes} [Sat Sep 24 20:49:44 2022] GET /compute/v2.1/flavors => generated 3153 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:49:44.905362 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5cbeafea-b8f4-4c68-9a1e-eed5113e4429 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:44.924826 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5cbeafea-b8f4-4c68-9a1e-eed5113e4429 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/528443546" status: 202 len: 0 microversion: 2.1 time: 0.023378 Sep 24 20:49:44.925772 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 31/53] 10.222.0.52 () {58 vars in 1158 bytes} [Sat Sep 24 20:49:44 2022] DELETE /compute/v2.1/flavors/528443546 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:49:44.931945 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d51b62a0-a692-4f9c-9460-b564d08d3dd2 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:44.941925 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d51b62a0-a692-4f9c-9460-b564d08d3dd2 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Request method failure captured: Sep 24 20:49:44.941925 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 24 20:49:44.941925 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:49:44.941925 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:49:44.941925 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:49:44.941925 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 283 Sep 24 20:49:44.941925 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:49:44.941925 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:49:44.941925 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:49:44.941925 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:49:44.941925 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL21hJ1CF2mkJt96SF7DXZ-9JiF-EYzXLBX_u18XtsNx4b5ZsbCRUZiIBh8c91Zj8sUeE_NpuXiCn8rHgr7lpUQJ_sg_RfrSOzo6ap18kYx-Cjq5KPhNfIuZAcscKQLqI9EupePrTfOxBsrQGp58MXaN4jwib7gEdIeMceQ-kLhleWb0 Sep 24 20:49:44.941925 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:49:44.941925 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:49:44.941925 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:49:44.941925 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:49:44.941925 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:49:44.941925 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:49:44.941925 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 79afe6f2d12f45e994b77b96c44f8239 Sep 24 20:49:44.941925 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-422514215 Sep 24 20:49:44.941925 ncdv-master-1 devstack@n-api.service[140516]: X-Role: admin,reader,member Sep 24 20:49:44.941925 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: admin,reader,member Sep 24 20:49:44.944730 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/79afe6f2d12f45e994b77b96c44f8239"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_79afe6f2d12f45e994b77b96c44f8239"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/79afe6f2d12f45e994b77b96c44f8239"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/79afe6f2d12f45e994b77b96c44f8239"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:49:44.944730 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-422514215 Sep 24 20:49:44.944730 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 79afe6f2d12f45e994b77b96c44f8239 Sep 24 20:49:44.944730 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-422514215 Sep 24 20:49:44.944730 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin Sep 24 20:49:44.944730 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:49:44.944730 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:49:44.944730 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 64a47c4d366e4af88ff0386e79158e85 Sep 24 20:49:44.944730 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin Sep 24 20:49:44.944730 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 20:49:44.945301 ncdv-master-1 devstack@n-api.service[140516]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 24 20:49:44.945301 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:49:44.945301 ncdv-master-1 devstack@n-api.service[140516]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 24 20:49:44.945301 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 24 20:49:44.945301 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:49:44.945301 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:44.945301 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 20:49:44.945301 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 20:49:44.945301 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 20:49:44.945301 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise error Sep 24 20:49:44.945821 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 24 20:49:44.945821 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:44.945821 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Sep 24 20:49:44.945821 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 24 20:49:44.945821 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:44.945821 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 24 20:49:44.945821 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 24 20:49:44.945821 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:44.945821 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:49:44.945821 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:44.945821 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:44.945821 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:49:44.945821 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:49:44.945821 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:49:44.945821 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:49:44.945821 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:49:44.945821 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:49:44.946660 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:49:44.946660 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:49:44.946660 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 20:49:44.946660 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 20:49:44.946660 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 20:49:44.946660 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 20:49:44.946660 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 20:49:44.946660 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 20:49:44.946660 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 24 20:49:44.946660 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:44.946660 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:49:44.946660 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:44.946660 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:44.946660 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:49:44.946660 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:49:44.947384 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 20:49:44.947384 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 20:49:44.947384 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 24 20:49:44.947384 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:44.947384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d51b62a0-a692-4f9c-9460-b564d08d3dd2 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:49:44.947673 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d51b62a0-a692-4f9c-9460-b564d08d3dd2 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.017646 Sep 24 20:49:44.949984 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 32/54] 10.222.0.52 () {60 vars in 1165 bytes} [Sat Sep 24 20:49:44 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 20:49:44.959624 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ac884fc0-ea75-49ad-9224-a54d1a7e6951 tempest-FlavorsV261TestJSON-199266187 tempest-FlavorsV261TestJSON-199266187-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:44.983637 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ac884fc0-ea75-49ad-9224-a54d1a7e6951 tempest-FlavorsV261TestJSON-199266187 tempest-FlavorsV261TestJSON-199266187-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/360547118" status: 202 len: 0 microversion: 2.61 time: 0.031818 Sep 24 20:49:44.984288 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 33/55] 10.222.0.52 () {60 vars in 1199 bytes} [Sat Sep 24 20:49:44 2022] DELETE /compute/v2.1/flavors/360547118 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:49:44.994182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2c353ff0-9057-44c0-9c1a-0957b71b5bd5 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:45.019159 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2c353ff0-9057-44c0-9c1a-0957b71b5bd5 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029062 Sep 24 20:49:45.019388 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ed0cbbb8-d7db-4d6f-87e2-edd0505a6994 tempest-AggregatesAdminTestV241-1648698894 tempest-AggregatesAdminTestV241-1648698894-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 298 microversion: 2.41 time: 0.263256 Sep 24 20:49:45.023468 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 23/56] 10.222.0.52 () {62 vars in 1232 bytes} [Sat Sep 24 20:49:44 2022] POST /compute/v2.1/os-aggregates/3/action => generated 298 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:49:45.033259 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 34/57] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:49:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:49:45.035719 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1223c4ed-72f4-4524-a94c-28302853e5cb tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:45.041228 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4b07c8b1-2038-4138-a10b-7f9bdc594e34 tempest-FlavorsV261TestJSON-199266187 tempest-FlavorsV261TestJSON-199266187-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:45.045951 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1223c4ed-72f4-4524-a94c-28302853e5cb tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Request method failure captured: Sep 24 20:49:45.045951 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 24 20:49:45.045951 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:49:45.045951 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:49:45.045951 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:49:45.045951 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 27 Sep 24 20:49:45.045951 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:49:45.045951 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:49:45.045951 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:49:45.045951 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:49:45.045951 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL21hJ1CF2mkJt96SF7DXZ-9JiF-EYzXLBX_u18XtsNx4b5ZsbCRUZiIBh8c91Zj8sUeE_NpuXiCn8rHgr7lpUQJ_sg_RfrSOzo6ap18kYx-Cjq5KPhNfIuZAcscKQLqI9EupePrTfOxBsrQGp58MXaN4jwib7gEdIeMceQ-kLhleWb0 Sep 24 20:49:45.045951 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:49:45.045951 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:49:45.045951 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:49:45.045951 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:49:45.045951 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:49:45.045951 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:49:45.045951 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 79afe6f2d12f45e994b77b96c44f8239 Sep 24 20:49:45.045951 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-422514215 Sep 24 20:49:45.045951 ncdv-master-1 devstack@n-api.service[140517]: X-Role: admin,reader,member Sep 24 20:49:45.045951 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: admin,reader,member Sep 24 20:49:45.047121 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/79afe6f2d12f45e994b77b96c44f8239"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_79afe6f2d12f45e994b77b96c44f8239"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/79afe6f2d12f45e994b77b96c44f8239"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/79afe6f2d12f45e994b77b96c44f8239"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:49:45.047121 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-422514215 Sep 24 20:49:45.047121 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 79afe6f2d12f45e994b77b96c44f8239 Sep 24 20:49:45.047121 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-422514215 Sep 24 20:49:45.047121 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin Sep 24 20:49:45.047121 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:49:45.047121 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:49:45.047121 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 64a47c4d366e4af88ff0386e79158e85 Sep 24 20:49:45.047121 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin Sep 24 20:49:45.047121 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 20:49:45.047121 ncdv-master-1 devstack@n-api.service[140517]: {"aggregate": {"name": ""}} Sep 24 20:49:45.047121 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:49:45.047121 ncdv-master-1 devstack@n-api.service[140517]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 24 20:49:45.048887 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'body': {'aggregate': {'name': ''}}} Sep 24 20:49:45.048887 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:49:45.048887 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:45.048887 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 20:49:45.048887 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 20:49:45.048887 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 20:49:45.048887 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise error Sep 24 20:49:45.048887 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 24 20:49:45.048887 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:49:45.048887 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Sep 24 20:49:45.048887 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 24 20:49:45.048887 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:49:45.048887 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 24 20:49:45.048887 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi '' Sep 24 20:49:45.048887 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:49:45.048887 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:49:45.048887 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:49:45.048887 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:45.048887 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:49:45.048887 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:49:45.048887 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:49:45.048887 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:49:45.048887 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:49:45.051038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:49:45.051038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:49:45.051038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:49:45.051038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 20:49:45.051038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 20:49:45.051038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 20:49:45.051038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 20:49:45.051038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 20:49:45.051038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 20:49:45.051038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 24 20:49:45.051038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:49:45.051038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:49:45.051038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:49:45.051038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:45.051038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:49:45.051038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:49:45.051038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 20:49:45.051038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 20:49:45.051038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 24 20:49:45.051038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:49:45.053181 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1223c4ed-72f4-4524-a94c-28302853e5cb tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:49:45.053181 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1223c4ed-72f4-4524-a94c-28302853e5cb tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.022748 Sep 24 20:49:45.069636 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 24/58] 10.222.0.52 () {60 vars in 1164 bytes} [Sat Sep 24 20:49:45 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 20:49:45.082450 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4451dc45-6877-48f3-b219-c1b4753ff53c tempest-AggregatesAdminTestV241-1648698894 tempest-AggregatesAdminTestV241-1648698894-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:45.089436 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6,nova_api:DELETE=13,nova_api:UPDATE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:49:45.092013 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4b07c8b1-2038-4138-a10b-7f9bdc594e34 tempest-FlavorsV261TestJSON-199266187 tempest-FlavorsV261TestJSON-199266187-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.057391 Sep 24 20:49:45.092838 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 35/59] 10.222.0.52 () {60 vars in 1187 bytes} [Sat Sep 24 20:49:45 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:49:45.099660 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-384491a2-5ab5-42ad-b1ad-0d6cd1d1ed1e tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2116488383", "id": 1672366765, "os-flavor-access:is_public": "False"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:45.148395 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4451dc45-6877-48f3-b219-c1b4753ff53c tempest-AggregatesAdminTestV241-1648698894 tempest-AggregatesAdminTestV241-1648698894-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.41 time: 0.082250 Sep 24 20:49:45.152042 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 25/60] 10.222.0.52 () {60 vars in 1193 bytes} [Sat Sep 24 20:49:45 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:49:45.164471 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-384491a2-5ab5-42ad-b1ad-0d6cd1d1ed1e tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.068158 Sep 24 20:49:45.173491 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 36/61] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:49:45 2022] POST /compute/v2.1/flavors => generated 415 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:49:45.178426 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a9e1afdb-dfe4-4125-b7fe-85a5b3d8b6f1 tempest-AggregatesAdminNegativeTestJSON-1230891279 tempest-AggregatesAdminNegativeTestJSON-1230891279-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-220392936"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:45.181542 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-71242a8e-01a6-40d0-aa49-4196bcd1bb59 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-4236069", "name": "tempest-test_aggregate-1915895231"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:45.187238 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a9e1afdb-dfe4-4125-b7fe-85a5b3d8b6f1 tempest-AggregatesAdminNegativeTestJSON-1230891279 tempest-AggregatesAdminNegativeTestJSON-1230891279-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '7af773989be84d47a75f107f9acc8c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea3cc3ecfc941758415b8324faf7644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:49:45.199998 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a9e1afdb-dfe4-4125-b7fe-85a5b3d8b6f1 tempest-AggregatesAdminNegativeTestJSON-1230891279 tempest-AggregatesAdminNegativeTestJSON-1230891279-project] Request method failure captured: Sep 24 20:49:45.199998 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 24 20:49:45.199998 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:49:45.199998 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:49:45.199998 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:49:45.199998 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 59 Sep 24 20:49:45.199998 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:49:45.199998 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:49:45.199998 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:49:45.199998 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:49:45.199998 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL21f4RaHWOrhnWIuWpqpkYL7mjtuC3JO0zkKes6TNKdr9u-3PrJszigST82y1DkYyYALY5dcIqGyY_wqVkqcf1PlFdiccA0koW5cnrJibJwQ7J25YdRK_gokc5lYfP_EUDwUNskhksknLFgudTSUIRQj8Uexajfgt9ef1kslJZSDYDY Sep 24 20:49:45.199998 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:49:45.199998 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:49:45.199998 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:49:45.199998 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:49:45.199998 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:49:45.199998 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:49:45.199998 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 6ea3cc3ecfc941758415b8324faf7644 Sep 24 20:49:45.199998 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1230891279 Sep 24 20:49:45.199998 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:49:45.199998 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:49:45.201235 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6ea3cc3ecfc941758415b8324faf7644"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6ea3cc3ecfc941758415b8324faf7644"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6ea3cc3ecfc941758415b8324faf7644"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6ea3cc3ecfc941758415b8324faf7644"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:49:45.201235 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1230891279 Sep 24 20:49:45.201235 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 6ea3cc3ecfc941758415b8324faf7644 Sep 24 20:49:45.201235 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1230891279 Sep 24 20:49:45.201235 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-AggregatesAdminNegativeTestJSON-1230891279-project Sep 24 20:49:45.201235 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:49:45.201235 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:49:45.201235 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 7af773989be84d47a75f107f9acc8c69 Sep 24 20:49:45.201235 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1230891279-project Sep 24 20:49:45.201235 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 20:49:45.201235 ncdv-master-1 devstack@n-api.service[140517]: {"aggregate": {"name": "tempest-test_aggregate-220392936"}} Sep 24 20:49:45.201235 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:49:45.201235 ncdv-master-1 devstack@n-api.service[140517]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 24 20:49:45.201898 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-220392936'}}} Sep 24 20:49:45.201898 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:49:45.201898 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:45.201898 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:49:45.201898 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:49:45.201898 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:49:45.201898 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:49:45.201898 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:49:45.201898 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:49:45.201898 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:49:45.201898 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:49:45.201898 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:49:45.201898 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:49:45.201898 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Sep 24 20:49:45.201898 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Sep 24 20:49:45.201898 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 24 20:49:45.201898 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 24 20:49:45.201898 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 24 20:49:45.201898 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 24 20:49:45.202888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:49:45.202888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:49:45.202888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:49:45.202888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:49:45.202888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 24 20:49:45.202888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 24 20:49:45.202888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 24 20:49:45.202888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 24 20:49:45.202888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 24 20:49:45.202888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 24 20:49:45.202888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 24 20:49:45.202888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:49:45.202888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:49:45.202888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:49:45.202888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:45.202888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:49:45.202888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:49:45.202888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 24 20:49:45.202888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 24 20:49:45.202888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 24 20:49:45.204423 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:49:45.204423 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a9e1afdb-dfe4-4125-b7fe-85a5b3d8b6f1 tempest-AggregatesAdminNegativeTestJSON-1230891279 tempest-AggregatesAdminNegativeTestJSON-1230891279-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:49:45.204423 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a9e1afdb-dfe4-4125-b7fe-85a5b3d8b6f1 tempest-AggregatesAdminNegativeTestJSON-1230891279 tempest-AggregatesAdminNegativeTestJSON-1230891279-project] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.049272 Sep 24 20:49:45.205883 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 26/62] 10.222.0.52 () {60 vars in 1164 bytes} [Sat Sep 24 20:49:45 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 53 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:49:45.215113 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.aggregate [None req-71242a8e-01a6-40d0-aa49-4196bcd1bb59 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Generated uuid 50b68aad-8c28-4f2f-aca6-df69278967be for aggregate {{(pid=140516) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 24 20:49:45.216052 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-eb9731b7-70c2-4cfb-a7fb-fe1df35f4ea9 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2123539080", "id": 2051674329, "os-flavor-access:is_public": "True"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:45.268818 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-eb9731b7-70c2-4cfb-a7fb-fe1df35f4ea9 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.059740 Sep 24 20:49:45.273513 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 27/63] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:49:45 2022] POST /compute/v2.1/flavors => generated 414 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:49:45.291620 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-71242a8e-01a6-40d0-aa49-4196bcd1bb59 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 219 microversion: 2.1 time: 0.115264 Sep 24 20:49:45.292888 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8697572e-49e5-422b-948a-c149a19af3ad tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-442608236"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:45.305302 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 37/64] 10.222.0.52 () {60 vars in 1165 bytes} [Sat Sep 24 20:49:45 2022] POST /compute/v2.1/os-aggregates => generated 219 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:49:45.305969 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.aggregate [None req-8697572e-49e5-422b-948a-c149a19af3ad tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Generated uuid 721669c7-290e-4c4d-af66-0dbe63427b86 for aggregate {{(pid=140517) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 24 20:49:45.316195 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-beb45695-a0ad-4ac8-86a1-a79920d7a6ed tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:45.384491 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-beb45695-a0ad-4ac8-86a1-a79920d7a6ed tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.075052 Sep 24 20:49:45.385116 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 38/65] 10.222.0.52 () {58 vars in 1169 bytes} [Sat Sep 24 20:49:45 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:49:45.391548 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b817c559-1574-4aa2-8fc8-28daa6bf29ea tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:45.415416 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8697572e-49e5-422b-948a-c149a19af3ad tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.140245 Sep 24 20:49:45.417644 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 28/66] 10.222.0.52 () {60 vars in 1164 bytes} [Sat Sep 24 20:49:45 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:49:45.420066 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b817c559-1574-4aa2-8fc8-28daa6bf29ea tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.032869 Sep 24 20:49:45.426690 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 39/67] 10.222.0.52 () {58 vars in 1143 bytes} [Sat Sep 24 20:49:45 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:49:45.431831 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c7409155-52de-4821-b460-03215b142037 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:45.434589 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c9dc95d3-f77a-41aa-b306-ecf161126900 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-442608236"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:45.440417 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.aggregate [None req-c9dc95d3-f77a-41aa-b306-ecf161126900 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Generated uuid 020118fe-dda1-49cd-92b3-9d4c76daa3f6 for aggregate {{(pid=140516) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 24 20:49:45.449916 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-c9dc95d3-f77a-41aa-b306-ecf161126900 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-442608236 already exists. Sep 24 20:49:45.456465 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c9dc95d3-f77a-41aa-b306-ecf161126900 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Request method failure captured: Sep 24 20:49:45.456465 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 24 20:49:45.456465 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:49:45.456465 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:49:45.456465 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:49:45.456465 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 59 Sep 24 20:49:45.456465 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:49:45.456465 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:49:45.456465 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:49:45.456465 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:49:45.456465 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL21hJ1CF2mkJt96SF7DXZ-9JiF-EYzXLBX_u18XtsNx4b5ZsbCRUZiIBh8c91Zj8sUeE_NpuXiCn8rHgr7lpUQJ_sg_RfrSOzo6ap18kYx-Cjq5KPhNfIuZAcscKQLqI9EupePrTfOxBsrQGp58MXaN4jwib7gEdIeMceQ-kLhleWb0 Sep 24 20:49:45.456465 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:49:45.456465 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:49:45.456465 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:49:45.456465 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:49:45.456465 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:49:45.456465 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:49:45.456465 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 79afe6f2d12f45e994b77b96c44f8239 Sep 24 20:49:45.456465 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-422514215 Sep 24 20:49:45.456465 ncdv-master-1 devstack@n-api.service[140516]: X-Role: admin,reader,member Sep 24 20:49:45.456465 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: admin,reader,member Sep 24 20:49:45.457814 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/79afe6f2d12f45e994b77b96c44f8239"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_79afe6f2d12f45e994b77b96c44f8239"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/79afe6f2d12f45e994b77b96c44f8239"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/79afe6f2d12f45e994b77b96c44f8239"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:49:45.457814 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-422514215 Sep 24 20:49:45.457814 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 79afe6f2d12f45e994b77b96c44f8239 Sep 24 20:49:45.457814 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-422514215 Sep 24 20:49:45.457814 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin Sep 24 20:49:45.457814 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:49:45.457814 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:49:45.457814 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 64a47c4d366e4af88ff0386e79158e85 Sep 24 20:49:45.457814 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin Sep 24 20:49:45.457814 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 20:49:45.457814 ncdv-master-1 devstack@n-api.service[140516]: {"aggregate": {"name": "tempest-test_aggregate-442608236"}} Sep 24 20:49:45.457814 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:49:45.457814 ncdv-master-1 devstack@n-api.service[140516]: exception: Aggregate tempest-test_aggregate-442608236 already exists. Sep 24 20:49:45.458447 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-442608236'}}} Sep 24 20:49:45.458447 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:49:45.458447 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:45.458447 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Sep 24 20:49:45.458447 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Sep 24 20:49:45.458447 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 24 20:49:45.458447 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 24 20:49:45.458447 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:49:45.458447 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:49:45.458447 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:49:45.458447 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:49:45.458447 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 24 20:49:45.458447 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 24 20:49:45.458447 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Sep 24 20:49:45.458447 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi aggregate.create() Sep 24 20:49:45.458447 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 24 20:49:45.458447 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 24 20:49:45.458447 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Sep 24 20:49:45.458447 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Sep 24 20:49:45.459405 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 24 20:49:45.459405 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 24 20:49:45.459405 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Sep 24 20:49:45.459405 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Sep 24 20:49:45.459405 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-442608236 already exists. Sep 24 20:49:45.459405 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:45.459405 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:49:45.459405 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:45.459405 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:45.459405 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:49:45.459405 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:49:45.459405 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:49:45.459405 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:49:45.459405 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:49:45.459405 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:49:45.459405 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:49:45.459405 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:49:45.459405 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:49:45.459405 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:49:45.459405 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Sep 24 20:49:45.460448 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 24 20:49:45.460448 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-442608236 already exists. Sep 24 20:49:45.460448 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:45.460448 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:49:45.460448 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:45.460448 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:45.460448 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:49:45.460448 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:49:45.460448 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:49:45.460448 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:49:45.460448 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-442608236 already exists. Sep 24 20:49:45.460448 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:45.462602 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c9dc95d3-f77a-41aa-b306-ecf161126900 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-442608236 already exists. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:49:45.464160 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c9dc95d3-f77a-41aa-b306-ecf161126900 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.034860 Sep 24 20:49:45.465436 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 40/68] 10.222.0.52 () {60 vars in 1164 bytes} [Sat Sep 24 20:49:45 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 38 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 24 20:49:45.474201 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7774175f-904d-4751-bd87-90348b47895a tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:45.489179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7774175f-904d-4751-bd87-90348b47895a tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:45.490129 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7774175f-904d-4751-bd87-90348b47895a tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:45.490952 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7774175f-904d-4751-bd87-90348b47895a tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:45.491223 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c7409155-52de-4821-b460-03215b142037 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.071494 Sep 24 20:49:45.492034 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 29/69] 10.222.0.52 () {58 vars in 1177 bytes} [Sat Sep 24 20:49:45 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:49:45.512030 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6c7f393a-d14a-45ae-bfca-841c7eb37141 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:45.544707 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6c7f393a-d14a-45ae-bfca-841c7eb37141 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.041350 Sep 24 20:49:45.550331 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 30/70] 10.222.0.52 () {58 vars in 1152 bytes} [Sat Sep 24 20:49:45 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 24 20:49:45.556802 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f184bafc-6a45-4cd5-9e5c-641cada0caf8 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:45.577889 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f184bafc-6a45-4cd5-9e5c-641cada0caf8 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.024144 Sep 24 20:49:45.582720 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 31/71] 10.222.0.52 () {58 vars in 1171 bytes} [Sat Sep 24 20:49:45 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:49:45.596417 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-429c425c-3f69-48bd-9955-c4d410bc1c37 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1080112342"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:45.615797 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.aggregate [None req-429c425c-3f69-48bd-9955-c4d410bc1c37 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Generated uuid f2d481b3-5e16-494c-99ab-0e975bac4e0f for aggregate {{(pid=140517) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 24 20:49:45.691940 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-429c425c-3f69-48bd-9955-c4d410bc1c37 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.107650 Sep 24 20:49:45.692552 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 32/72] 10.222.0.52 () {60 vars in 1164 bytes} [Sat Sep 24 20:49:45 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:49:45.713240 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-60dbbe87-d4ae-42ef-9743-c920477fb97f tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:45.732074 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-60dbbe87-d4ae-42ef-9743-c920477fb97f tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.031621 Sep 24 20:49:45.733369 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7774175f-904d-4751-bd87-90348b47895a tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 309 microversion: 2.1 time: 0.266196 Sep 24 20:49:45.734148 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 41/73] 10.222.0.52 () {60 vars in 1191 bytes} [Sat Sep 24 20:49:45 2022] POST /compute/v2.1/os-aggregates/5/action => generated 309 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:49:45.742744 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 33/74] 10.222.0.52 () {58 vars in 1169 bytes} [Sat Sep 24 20:49:45 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:49:45.746331 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-513ca476-e5ea-4b63-b027-21a87158c8b4 tempest-AggregatesAdminNegativeTestJSON-1230891279 tempest-AggregatesAdminNegativeTestJSON-1230891279-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:45.752659 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-513ca476-e5ea-4b63-b027-21a87158c8b4 tempest-AggregatesAdminNegativeTestJSON-1230891279 tempest-AggregatesAdminNegativeTestJSON-1230891279-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '7af773989be84d47a75f107f9acc8c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea3cc3ecfc941758415b8324faf7644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:49:45.754585 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-513ca476-e5ea-4b63-b027-21a87158c8b4 tempest-AggregatesAdminNegativeTestJSON-1230891279 tempest-AggregatesAdminNegativeTestJSON-1230891279-project] Request method failure captured: Sep 24 20:49:45.754585 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Sep 24 20:49:45.754585 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:49:45.754585 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:49:45.754585 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:49:45.754585 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:49:45.754585 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:49:45.754585 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:49:45.754585 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:49:45.754585 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:49:45.754585 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL21f4RaHWOrhnWIuWpqpkYL7mjtuC3JO0zkKes6TNKdr9u-3PrJszigST82y1DkYyYALY5dcIqGyY_wqVkqcf1PlFdiccA0koW5cnrJibJwQ7J25YdRK_gokc5lYfP_EUDwUNskhksknLFgudTSUIRQj8Uexajfgt9ef1kslJZSDYDY Sep 24 20:49:45.754585 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:49:45.754585 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:49:45.754585 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:49:45.754585 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:49:45.754585 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:49:45.754585 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:49:45.754585 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 6ea3cc3ecfc941758415b8324faf7644 Sep 24 20:49:45.754585 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1230891279 Sep 24 20:49:45.754585 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:49:45.754585 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:49:45.755967 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6ea3cc3ecfc941758415b8324faf7644"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6ea3cc3ecfc941758415b8324faf7644"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6ea3cc3ecfc941758415b8324faf7644"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6ea3cc3ecfc941758415b8324faf7644"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:49:45.755967 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1230891279 Sep 24 20:49:45.755967 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 6ea3cc3ecfc941758415b8324faf7644 Sep 24 20:49:45.755967 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1230891279 Sep 24 20:49:45.755967 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-AggregatesAdminNegativeTestJSON-1230891279-project Sep 24 20:49:45.755967 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:49:45.755967 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:49:45.755967 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 7af773989be84d47a75f107f9acc8c69 Sep 24 20:49:45.755967 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1230891279-project Sep 24 20:49:45.755967 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:49:45.755967 ncdv-master-1 devstack@n-api.service[140516]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 24 20:49:45.755967 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '7'} Sep 24 20:49:45.756617 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:49:45.756617 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:45.756617 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:49:45.756617 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:49:45.756617 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:49:45.756617 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:49:45.756617 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:49:45.756617 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:49:45.756617 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Sep 24 20:49:45.756617 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Sep 24 20:49:45.756617 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 24 20:49:45.756617 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 24 20:49:45.756617 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 24 20:49:45.756617 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 24 20:49:45.756617 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:49:45.756617 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:49:45.756617 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:49:45.756617 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:49:45.756617 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 24 20:49:45.757558 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 24 20:49:45.757558 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 24 20:49:45.757558 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 24 20:49:45.757558 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 24 20:49:45.757558 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 24 20:49:45.757558 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 24 20:49:45.757558 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:45.757558 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:49:45.757558 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:45.757558 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:45.757558 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:49:45.757558 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:49:45.757558 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 24 20:49:45.757558 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 24 20:49:45.757558 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 24 20:49:45.757558 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:45.758322 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d3774be7-8574-4608-89a6-6b08776075e5 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:45.758392 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-513ca476-e5ea-4b63-b027-21a87158c8b4 tempest-AggregatesAdminNegativeTestJSON-1230891279 tempest-AggregatesAdminNegativeTestJSON-1230891279-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:49:45.758392 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-513ca476-e5ea-4b63-b027-21a87158c8b4 tempest-AggregatesAdminNegativeTestJSON-1230891279 tempest-AggregatesAdminNegativeTestJSON-1230891279-project] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.020953 Sep 24 20:49:45.761360 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 42/75] 10.222.0.52 () {58 vars in 1152 bytes} [Sat Sep 24 20:49:45 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:49:45.775514 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5f48cfd4-8c29-427d-aedf-9492328afee1 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:45.826441 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d3774be7-8574-4608-89a6-6b08776075e5 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.081951 Sep 24 20:49:45.832761 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 34/76] 10.222.0.52 () {58 vars in 1169 bytes} [Sat Sep 24 20:49:45 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:49:45.850650 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5f48cfd4-8c29-427d-aedf-9492328afee1 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.084697 Sep 24 20:49:45.851477 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 43/77] 10.222.0.52 () {58 vars in 1152 bytes} [Sat Sep 24 20:49:45 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 24 20:49:45.856509 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-243d4bfb-a149-405b-9e32-a4b1cd7c9cc6 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:45.860694 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-73144e2e-0d8c-4255-8424-76c56a4f8e2d tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:45.873593 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-73144e2e-0d8c-4255-8424-76c56a4f8e2d tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 24 20:49:45.876578 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-73144e2e-0d8c-4255-8424-76c56a4f8e2d tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Request method failure captured: Sep 24 20:49:45.876578 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 24 20:49:45.876578 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:49:45.876578 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:49:45.876578 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:49:45.876578 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:49:45.876578 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:49:45.876578 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:49:45.876578 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:49:45.876578 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:49:45.876578 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL21hJ1CF2mkJt96SF7DXZ-9JiF-EYzXLBX_u18XtsNx4b5ZsbCRUZiIBh8c91Zj8sUeE_NpuXiCn8rHgr7lpUQJ_sg_RfrSOzo6ap18kYx-Cjq5KPhNfIuZAcscKQLqI9EupePrTfOxBsrQGp58MXaN4jwib7gEdIeMceQ-kLhleWb0 Sep 24 20:49:45.876578 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:49:45.876578 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:49:45.876578 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:49:45.876578 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:49:45.876578 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:49:45.876578 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:49:45.876578 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 79afe6f2d12f45e994b77b96c44f8239 Sep 24 20:49:45.876578 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-422514215 Sep 24 20:49:45.876578 ncdv-master-1 devstack@n-api.service[140516]: X-Role: admin,reader,member Sep 24 20:49:45.876578 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: admin,reader,member Sep 24 20:49:45.877655 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/79afe6f2d12f45e994b77b96c44f8239"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_79afe6f2d12f45e994b77b96c44f8239"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/79afe6f2d12f45e994b77b96c44f8239"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/79afe6f2d12f45e994b77b96c44f8239"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:49:45.877655 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-422514215 Sep 24 20:49:45.877655 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 79afe6f2d12f45e994b77b96c44f8239 Sep 24 20:49:45.877655 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-422514215 Sep 24 20:49:45.877655 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin Sep 24 20:49:45.877655 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:49:45.877655 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:49:45.877655 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 64a47c4d366e4af88ff0386e79158e85 Sep 24 20:49:45.877655 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin Sep 24 20:49:45.877655 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:49:45.877655 ncdv-master-1 devstack@n-api.service[140516]: exception: Aggregate -1 could not be found. Sep 24 20:49:45.877655 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '-1'} Sep 24 20:49:45.878238 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:49:45.878238 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:45.878238 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 24 20:49:45.878238 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 24 20:49:45.878238 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 24 20:49:45.878238 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 24 20:49:45.878238 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:49:45.878238 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:49:45.878238 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:49:45.878238 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:49:45.878238 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 24 20:49:45.878238 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 24 20:49:45.878238 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 24 20:49:45.878238 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 24 20:49:45.878238 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 20:49:45.878238 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 20:49:45.878238 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 24 20:49:45.878238 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 24 20:49:45.878238 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 24 20:49:45.879195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 24 20:49:45.879195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 24 20:49:45.879195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 24 20:49:45.879195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 24 20:49:45.879195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:45.879195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:49:45.879195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:45.879195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:45.879195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:49:45.879195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:49:45.879195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:49:45.879195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:49:45.879195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:49:45.879195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:49:45.879195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 24 20:49:45.879195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:49:45.879195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 24 20:49:45.879195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:45.879195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:49:45.879195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:45.879195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:45.880266 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:49:45.880266 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:49:45.880266 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:49:45.880266 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:49:45.880266 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 24 20:49:45.880266 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:45.880266 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-73144e2e-0d8c-4255-8424-76c56a4f8e2d tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:49:45.880266 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-73144e2e-0d8c-4255-8424-76c56a4f8e2d tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.022181 Sep 24 20:49:45.880266 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 44/78] 10.222.0.52 () {58 vars in 1155 bytes} [Sat Sep 24 20:49:45 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 24 20:49:45.899340 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a70966f0-673f-4bb1-9d1a-1ac6a9c8b59f tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-136788379"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:45.903815 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.aggregate [None req-a70966f0-673f-4bb1-9d1a-1ac6a9c8b59f tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Generated uuid e3fc2131-d1a8-4be2-9cfa-739612898d4b for aggregate {{(pid=140516) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 24 20:49:45.928833 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-243d4bfb-a149-405b-9e32-a4b1cd7c9cc6 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.075992 Sep 24 20:49:45.930623 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 35/79] 10.222.0.52 () {58 vars in 1175 bytes} [Sat Sep 24 20:49:45 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:49:45.951931 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a70966f0-673f-4bb1-9d1a-1ac6a9c8b59f tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.067654 Sep 24 20:49:45.957384 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8f2e3c7e-3de5-431c-8c84-e2b980729bf1 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:45.960702 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 45/80] 10.222.0.52 () {60 vars in 1164 bytes} [Sat Sep 24 20:49:45 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:49:45.966802 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-04e6f557-8c8d-4059-bbb4-e73653f86ba8 tempest-AggregatesAdminNegativeTestJSON-1230891279 tempest-AggregatesAdminNegativeTestJSON-1230891279-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:45.968415 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-04e6f557-8c8d-4059-bbb4-e73653f86ba8 tempest-AggregatesAdminNegativeTestJSON-1230891279 tempest-AggregatesAdminNegativeTestJSON-1230891279-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '7af773989be84d47a75f107f9acc8c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea3cc3ecfc941758415b8324faf7644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:49:45.971093 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-04e6f557-8c8d-4059-bbb4-e73653f86ba8 tempest-AggregatesAdminNegativeTestJSON-1230891279 tempest-AggregatesAdminNegativeTestJSON-1230891279-project] Request method failure captured: Sep 24 20:49:45.971093 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Sep 24 20:49:45.971093 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:49:45.971093 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:49:45.971093 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:49:45.971093 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:49:45.971093 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:49:45.971093 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:49:45.971093 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:49:45.971093 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:49:45.971093 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL21f4RaHWOrhnWIuWpqpkYL7mjtuC3JO0zkKes6TNKdr9u-3PrJszigST82y1DkYyYALY5dcIqGyY_wqVkqcf1PlFdiccA0koW5cnrJibJwQ7J25YdRK_gokc5lYfP_EUDwUNskhksknLFgudTSUIRQj8Uexajfgt9ef1kslJZSDYDY Sep 24 20:49:45.971093 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:49:45.971093 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:49:45.971093 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:49:45.971093 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:49:45.971093 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:49:45.971093 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:49:45.971093 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 6ea3cc3ecfc941758415b8324faf7644 Sep 24 20:49:45.971093 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1230891279 Sep 24 20:49:45.971093 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:49:45.971093 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:49:45.972249 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6ea3cc3ecfc941758415b8324faf7644"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6ea3cc3ecfc941758415b8324faf7644"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6ea3cc3ecfc941758415b8324faf7644"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6ea3cc3ecfc941758415b8324faf7644"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:49:45.972249 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1230891279 Sep 24 20:49:45.972249 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 6ea3cc3ecfc941758415b8324faf7644 Sep 24 20:49:45.972249 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1230891279 Sep 24 20:49:45.972249 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-AggregatesAdminNegativeTestJSON-1230891279-project Sep 24 20:49:45.972249 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:49:45.972249 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:49:45.972249 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 7af773989be84d47a75f107f9acc8c69 Sep 24 20:49:45.972249 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1230891279-project Sep 24 20:49:45.972249 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:49:45.972249 ncdv-master-1 devstack@n-api.service[140516]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 24 20:49:45.972249 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '8'} Sep 24 20:49:45.972843 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:49:45.972843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:45.972843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:49:45.972843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:49:45.972843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:49:45.972843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:49:45.972843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:49:45.972843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:49:45.972843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Sep 24 20:49:45.972843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Sep 24 20:49:45.972843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 24 20:49:45.972843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 24 20:49:45.972843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 24 20:49:45.972843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 24 20:49:45.972843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:49:45.972843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:49:45.972843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:49:45.972843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:49:45.972843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 24 20:49:45.973817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 24 20:49:45.973817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 24 20:49:45.973817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 24 20:49:45.973817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 24 20:49:45.973817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 24 20:49:45.973817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 24 20:49:45.973817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:45.973817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:49:45.973817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:45.973817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:45.973817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:49:45.973817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:49:45.973817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 24 20:49:45.973817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 24 20:49:45.973817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 24 20:49:45.973817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:45.973817 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-04e6f557-8c8d-4059-bbb4-e73653f86ba8 tempest-AggregatesAdminNegativeTestJSON-1230891279 tempest-AggregatesAdminNegativeTestJSON-1230891279-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:49:45.974686 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-04e6f557-8c8d-4059-bbb4-e73653f86ba8 tempest-AggregatesAdminNegativeTestJSON-1230891279 tempest-AggregatesAdminNegativeTestJSON-1230891279-project] 10.222.0.52 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.010825 Sep 24 20:49:45.982531 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 46/81] 10.222.0.52 () {58 vars in 1149 bytes} [Sat Sep 24 20:49:45 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:49:45.990761 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e4c5ccdf-b4d4-4f09-9dcb-d396f4f0be8e tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:46.006959 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=13,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:49:46.031807 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e4c5ccdf-b4d4-4f09-9dcb-d396f4f0be8e tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.046863 Sep 24 20:49:46.033036 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 47/82] 10.222.0.52 () {58 vars in 1152 bytes} [Sat Sep 24 20:49:45 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 24 20:49:46.044076 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4fbbe9fb-c016-4fe4-a017-2086c4285442 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:46.050424 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8f2e3c7e-3de5-431c-8c84-e2b980729bf1 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.098184 Sep 24 20:49:46.051168 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 36/83] 10.222.0.52 () {58 vars in 1173 bytes} [Sat Sep 24 20:49:45 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:49:46.072556 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0464ed2f-de4a-43ca-bd3c-247fddb56c54 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:46.081689 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-4fbbe9fb-c016-4fe4-a017-2086c4285442 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 24 20:49:46.083668 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4fbbe9fb-c016-4fe4-a017-2086c4285442 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Request method failure captured: Sep 24 20:49:46.083668 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 24 20:49:46.083668 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:49:46.083668 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:49:46.083668 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:49:46.083668 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:49:46.083668 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:49:46.083668 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:49:46.083668 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:49:46.083668 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:49:46.083668 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL21hJ1CF2mkJt96SF7DXZ-9JiF-EYzXLBX_u18XtsNx4b5ZsbCRUZiIBh8c91Zj8sUeE_NpuXiCn8rHgr7lpUQJ_sg_RfrSOzo6ap18kYx-Cjq5KPhNfIuZAcscKQLqI9EupePrTfOxBsrQGp58MXaN4jwib7gEdIeMceQ-kLhleWb0 Sep 24 20:49:46.083668 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:49:46.083668 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:49:46.083668 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:49:46.083668 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:49:46.083668 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:49:46.083668 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:49:46.083668 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 79afe6f2d12f45e994b77b96c44f8239 Sep 24 20:49:46.083668 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-422514215 Sep 24 20:49:46.083668 ncdv-master-1 devstack@n-api.service[140516]: X-Role: admin,reader,member Sep 24 20:49:46.083668 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: admin,reader,member Sep 24 20:49:46.084784 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/79afe6f2d12f45e994b77b96c44f8239"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_79afe6f2d12f45e994b77b96c44f8239"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/79afe6f2d12f45e994b77b96c44f8239"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/79afe6f2d12f45e994b77b96c44f8239"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:49:46.084784 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-422514215 Sep 24 20:49:46.084784 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 79afe6f2d12f45e994b77b96c44f8239 Sep 24 20:49:46.084784 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-422514215 Sep 24 20:49:46.084784 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin Sep 24 20:49:46.084784 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:49:46.084784 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:49:46.084784 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 64a47c4d366e4af88ff0386e79158e85 Sep 24 20:49:46.084784 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin Sep 24 20:49:46.084784 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:49:46.084784 ncdv-master-1 devstack@n-api.service[140516]: exception: Aggregate -1 could not be found. Sep 24 20:49:46.084784 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '-1'} Sep 24 20:49:46.085379 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:49:46.085379 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:46.085379 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 24 20:49:46.085379 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 24 20:49:46.085379 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 24 20:49:46.085379 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 24 20:49:46.085379 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 20:49:46.085379 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 20:49:46.085379 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 24 20:49:46.085379 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 24 20:49:46.085379 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 24 20:49:46.085379 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 24 20:49:46.085379 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 24 20:49:46.085379 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 24 20:49:46.085379 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 24 20:49:46.085379 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:46.085379 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:49:46.085379 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:46.085379 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:46.085379 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:49:46.086372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:49:46.086372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:49:46.086372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:49:46.086372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:49:46.086372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:49:46.086372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 24 20:49:46.086372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:49:46.086372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 24 20:49:46.086372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:46.086372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:49:46.086372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:46.086372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:46.086372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:49:46.086372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:49:46.086372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:49:46.086372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:49:46.086372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 24 20:49:46.086372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:46.087337 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4fbbe9fb-c016-4fe4-a017-2086c4285442 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:49:46.089677 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4fbbe9fb-c016-4fe4-a017-2086c4285442 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.050312 Sep 24 20:49:46.095160 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 48/84] 10.222.0.52 () {58 vars in 1152 bytes} [Sat Sep 24 20:49:46 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 20:49:46.102066 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ef58a66e-7fc4-4370-870f-61c18397f050 tempest-AggregatesAdminNegativeTestJSON-1230891279 tempest-AggregatesAdminNegativeTestJSON-1230891279-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:46.103885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ef58a66e-7fc4-4370-870f-61c18397f050 tempest-AggregatesAdminNegativeTestJSON-1230891279 tempest-AggregatesAdminNegativeTestJSON-1230891279-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '7af773989be84d47a75f107f9acc8c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea3cc3ecfc941758415b8324faf7644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:49:46.105579 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ef58a66e-7fc4-4370-870f-61c18397f050 tempest-AggregatesAdminNegativeTestJSON-1230891279 tempest-AggregatesAdminNegativeTestJSON-1230891279-project] Request method failure captured: Sep 24 20:49:46.105579 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Sep 24 20:49:46.105579 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:49:46.105579 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:49:46.105579 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:49:46.105579 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:49:46.105579 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:49:46.105579 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:49:46.105579 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:49:46.105579 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:49:46.105579 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL21f4RaHWOrhnWIuWpqpkYL7mjtuC3JO0zkKes6TNKdr9u-3PrJszigST82y1DkYyYALY5dcIqGyY_wqVkqcf1PlFdiccA0koW5cnrJibJwQ7J25YdRK_gokc5lYfP_EUDwUNskhksknLFgudTSUIRQj8Uexajfgt9ef1kslJZSDYDY Sep 24 20:49:46.105579 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:49:46.105579 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:49:46.105579 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:49:46.105579 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:49:46.105579 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:49:46.105579 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:49:46.105579 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 6ea3cc3ecfc941758415b8324faf7644 Sep 24 20:49:46.105579 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1230891279 Sep 24 20:49:46.105579 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:49:46.105579 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:49:46.106820 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6ea3cc3ecfc941758415b8324faf7644"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6ea3cc3ecfc941758415b8324faf7644"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6ea3cc3ecfc941758415b8324faf7644"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6ea3cc3ecfc941758415b8324faf7644"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:49:46.106820 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1230891279 Sep 24 20:49:46.106820 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 6ea3cc3ecfc941758415b8324faf7644 Sep 24 20:49:46.106820 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1230891279 Sep 24 20:49:46.106820 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-AggregatesAdminNegativeTestJSON-1230891279-project Sep 24 20:49:46.106820 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:49:46.106820 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:49:46.106820 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 7af773989be84d47a75f107f9acc8c69 Sep 24 20:49:46.106820 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1230891279-project Sep 24 20:49:46.106820 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:49:46.106820 ncdv-master-1 devstack@n-api.service[140516]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 24 20:49:46.106820 ncdv-master-1 devstack@n-api.service[140516]: action_args: {} Sep 24 20:49:46.107460 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:49:46.107460 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:46.107460 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:49:46.107460 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:49:46.107460 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:49:46.107460 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:49:46.107460 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:49:46.107460 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:49:46.107460 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Sep 24 20:49:46.107460 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Sep 24 20:49:46.107460 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 24 20:49:46.107460 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 24 20:49:46.107460 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 24 20:49:46.107460 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 24 20:49:46.107460 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:49:46.107460 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:49:46.107460 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:49:46.107460 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:49:46.107460 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 24 20:49:46.108409 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 24 20:49:46.108409 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 24 20:49:46.108409 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 24 20:49:46.108409 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 24 20:49:46.108409 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 24 20:49:46.108409 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 24 20:49:46.108409 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:46.108409 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:49:46.108409 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:46.108409 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:46.108409 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:49:46.108409 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:49:46.108409 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 24 20:49:46.108409 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 24 20:49:46.108409 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 24 20:49:46.108409 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:46.108409 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ef58a66e-7fc4-4370-870f-61c18397f050 tempest-AggregatesAdminNegativeTestJSON-1230891279 tempest-AggregatesAdminNegativeTestJSON-1230891279-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:49:46.109241 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ef58a66e-7fc4-4370-870f-61c18397f050 tempest-AggregatesAdminNegativeTestJSON-1230891279 tempest-AggregatesAdminNegativeTestJSON-1230891279-project] 10.222.0.52 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.010494 Sep 24 20:49:46.115465 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 49/85] 10.222.0.52 () {58 vars in 1143 bytes} [Sat Sep 24 20:49:46 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:49:46.135300 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0464ed2f-de4a-43ca-bd3c-247fddb56c54 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.067946 Sep 24 20:49:46.135916 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 37/86] 10.222.0.52 () {58 vars in 1169 bytes} [Sat Sep 24 20:49:46 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:49:46.162284 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-48281272-bacf-4f1d-86f1-8fb98d655de8 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:46.196664 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-48281272-bacf-4f1d-86f1-8fb98d655de8 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/2051674329" status: 202 len: 0 microversion: 2.1 time: 0.044035 Sep 24 20:49:46.197253 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 50/87] 10.222.0.52 () {58 vars in 1161 bytes} [Sat Sep 24 20:49:46 2022] DELETE /compute/v2.1/flavors/2051674329 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 20:49:46.206112 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6a6ec163-e663-43ad-9e84-6d4220f5e60d tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:46.233579 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6a6ec163-e663-43ad-9e84-6d4220f5e60d tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031930 Sep 24 20:49:46.235119 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 38/88] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:49:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:49:46.254029 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-09d67614-4582-45b0-bfab-a45544bf4d9e tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:46.275070 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-09d67614-4582-45b0-bfab-a45544bf4d9e tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1672366765" status: 202 len: 0 microversion: 2.1 time: 0.025059 Sep 24 20:49:46.275896 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 51/89] 10.222.0.52 () {58 vars in 1161 bytes} [Sat Sep 24 20:49:46 2022] DELETE /compute/v2.1/flavors/1672366765 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:49:46.286736 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-00b7e21f-6bd8-4972-871e-695e878f4ad6 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:46.312143 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-00b7e21f-6bd8-4972-871e-695e878f4ad6 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031118 Sep 24 20:49:46.326530 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 52/90] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:49:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:49:46.337836 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-480d4595-78d2-4957-ac7e-af23f979dc9c tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-495157285", "id": 1162410787, "os-flavor-access:is_public": "False"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:46.364749 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-480d4595-78d2-4957-ac7e-af23f979dc9c tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.033243 Sep 24 20:49:46.366030 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 53/91] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:49:46 2022] POST /compute/v2.1/flavors => generated 414 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:49:46.378420 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-37344ed5-1fc7-46fa-8e7e-156dee3bffe7 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:46.405948 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-37344ed5-1fc7-46fa-8e7e-156dee3bffe7 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032096 Sep 24 20:49:46.407872 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 54/92] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:49:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:49:46.425773 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-670d0460-fcb2-40d3-a391-6a2e004ef2aa tempest-FlavorsAdminTestJSON-2046652293 tempest-FlavorsAdminTestJSON-2046652293-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:46.446124 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-670d0460-fcb2-40d3-a391-6a2e004ef2aa tempest-FlavorsAdminTestJSON-2046652293 tempest-FlavorsAdminTestJSON-2046652293-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024574 Sep 24 20:49:46.447074 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 55/93] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:49:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:49:46.465415 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f75b3c6e-89ae-4f7f-8761-5331edfe7197 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:46.490562 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f75b3c6e-89ae-4f7f-8761-5331edfe7197 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1162410787" status: 202 len: 0 microversion: 2.1 time: 0.025461 Sep 24 20:49:46.491135 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 56/94] 10.222.0.52 () {58 vars in 1161 bytes} [Sat Sep 24 20:49:46 2022] DELETE /compute/v2.1/flavors/1162410787 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 20:49:46.499328 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-58604aba-8d08-4501-a38b-3679119591bd tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:46.550764 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-58604aba-8d08-4501-a38b-3679119591bd tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054977 Sep 24 20:49:46.553104 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 57/95] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:49:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:49:46.583172 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e2e22372-7315-465c-858b-2a29b67e574f tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1757846645", "id": 1696784315, "os-flavor-access:is_public": "True"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:46.628184 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e2e22372-7315-465c-858b-2a29b67e574f tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.049900 Sep 24 20:49:46.637918 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 58/96] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:49:46 2022] POST /compute/v2.1/flavors => generated 414 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:49:46.654201 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e96385fc-d7bb-4b33-8c05-ea4f3f1b06d3 tempest-FlavorsAdminTestJSON-2046652293 tempest-FlavorsAdminTestJSON-2046652293-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:46.694982 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e96385fc-d7bb-4b33-8c05-ea4f3f1b06d3 tempest-FlavorsAdminTestJSON-2046652293 tempest-FlavorsAdminTestJSON-2046652293-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.046779 Sep 24 20:49:46.698602 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 59/97] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:49:46 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:49:46.716771 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0825676e-0084-49d2-8158-c4883b6fbfa8 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:46.737672 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0825676e-0084-49d2-8158-c4883b6fbfa8 tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1696784315" status: 202 len: 0 microversion: 2.1 time: 0.024657 Sep 24 20:49:46.741282 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 60/98] 10.222.0.52 () {58 vars in 1161 bytes} [Sat Sep 24 20:49:46 2022] DELETE /compute/v2.1/flavors/1696784315 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 20:49:46.747000 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-aa5ad0e1-45f0-4adc-9ca9-85accac3577a tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:46.771105 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-aa5ad0e1-45f0-4adc-9ca9-85accac3577a tempest-FlavorsAdminTestJSON-250906121 tempest-FlavorsAdminTestJSON-250906121-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028162 Sep 24 20:49:46.772724 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 61/99] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:49:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:49:47.033280 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c0d8be11-b0f7-4966-a498-9dc948719ca9 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1916871904", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "availability_zone": "tempest-test_az-4236069"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:47.075037 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0d8be11-b0f7-4966-a498-9dc948719ca9 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:47.080167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0d8be11-b0f7-4966-a498-9dc948719ca9 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:47.080700 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0d8be11-b0f7-4966-a498-9dc948719ca9 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:47.083898 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0d8be11-b0f7-4966-a498-9dc948719ca9 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:47.084400 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0d8be11-b0f7-4966-a498-9dc948719ca9 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:47.084858 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0d8be11-b0f7-4966-a498-9dc948719ca9 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:48.852737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-c0d8be11-b0f7-4966-a498-9dc948719ca9 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] validate_networks() for None {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:49:49.426178 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-c0d8be11-b0f7-4966-a498-9dc948719ca9 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:49:49.426882 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-c0d8be11-b0f7-4966-a498-9dc948719ca9 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:49:49.427523 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-c0d8be11-b0f7-4966-a498-9dc948719ca9 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:49:49.428126 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-c0d8be11-b0f7-4966-a498-9dc948719ca9 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:49:49.428519 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-c0d8be11-b0f7-4966-a498-9dc948719ca9 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:49:49.461378 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0d8be11-b0f7-4966-a498-9dc948719ca9 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:49.461938 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0d8be11-b0f7-4966-a498-9dc948719ca9 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:49.462394 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0d8be11-b0f7-4966-a498-9dc948719ca9 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:49.463534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0d8be11-b0f7-4966-a498-9dc948719ca9 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:49.463992 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0d8be11-b0f7-4966-a498-9dc948719ca9 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:49.471011 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0d8be11-b0f7-4966-a498-9dc948719ca9 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:49.551634 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-c0d8be11-b0f7-4966-a498-9dc948719ca9 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Getting quotas for project a9e62e74103b45cc81dfe7900c0baf5a. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:49:49.572516 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-c0d8be11-b0f7-4966-a498-9dc948719ca9 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Getting quotas for user 2c01bfb1e8464616aceb3b73c958eb3f and project a9e62e74103b45cc81dfe7900c0baf5a. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:49:49.596003 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c0d8be11-b0f7-4966-a498-9dc948719ca9 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:49:49.601888 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c0d8be11-b0f7-4966-a498-9dc948719ca9 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] [instance: 650cae0b-7b94-4c33-a526-5cc80548c0db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:49:49.701205 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c0d8be11-b0f7-4966-a498-9dc948719ca9 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.437699 Sep 24 20:49:49.704576 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 39/100] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:49:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 3442 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 24 20:49:49.717013 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8b12809d-9356-457f-ba7b-1f357afba18a tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:49.718760 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8b12809d-9356-457f-ba7b-1f357afba18a tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] [instance: 650cae0b-7b94-4c33-a526-5cc80548c0db] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:49:52.022854 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8b12809d-9356-457f-ba7b-1f357afba18a tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01bfb1e8464616aceb3b73c958eb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e62e74103b45cc81dfe7900c0baf5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:49:52.053328 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8b12809d-9356-457f-ba7b-1f357afba18a tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] 10.222.0.52 "GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db" status: 200 len: 1240 microversion: 2.1 time: 2.341118 Sep 24 20:49:52.054811 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 62/101] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:49:49 2022] GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db => generated 1240 bytes in 2343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:49:53.083544 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b5e247ed-4d05-42fe-815d-523d19d14eb0 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:53.085352 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b5e247ed-4d05-42fe-815d-523d19d14eb0 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] [instance: 650cae0b-7b94-4c33-a526-5cc80548c0db] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:49:53.139097 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b5e247ed-4d05-42fe-815d-523d19d14eb0 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:53.144133 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b5e247ed-4d05-42fe-815d-523d19d14eb0 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:53.147559 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b5e247ed-4d05-42fe-815d-523d19d14eb0 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:53.148554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b5e247ed-4d05-42fe-815d-523d19d14eb0 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:53.150798 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b5e247ed-4d05-42fe-815d-523d19d14eb0 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:53.152020 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b5e247ed-4d05-42fe-815d-523d19d14eb0 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:54.124576 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b5e247ed-4d05-42fe-815d-523d19d14eb0 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01bfb1e8464616aceb3b73c958eb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e62e74103b45cc81dfe7900c0baf5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:49:54.173569 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b5e247ed-4d05-42fe-815d-523d19d14eb0 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] 10.222.0.52 "GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db" status: 200 len: 1306 microversion: 2.1 time: 1.096344 Sep 24 20:49:54.177340 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 40/102] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:49:53 2022] GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db => generated 1306 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:49:54.301195 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-124934ba-2bc4-497f-9d17-ac678fec3267 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1020742014", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:54.458357 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-124934ba-2bc4-497f-9d17-ac678fec3267 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] validate_networks() for None {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:49:54.657006 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=8 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:49:54.828258 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7b74f0b7-c0e5-4ef7-bd57-f2cd6af9c2da tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] Calling method '.version_select at 0x7f4b0d6a7700>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:54.834715 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b74f0b7-c0e5-4ef7-bd57-f2cd6af9c2da tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:54.836172 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b74f0b7-c0e5-4ef7-bd57-f2cd6af9c2da tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:54.838451 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b74f0b7-c0e5-4ef7-bd57-f2cd6af9c2da tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:54.877758 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b74f0b7-c0e5-4ef7-bd57-f2cd6af9c2da tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:54.879380 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b74f0b7-c0e5-4ef7-bd57-f2cd6af9c2da tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:54.879837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b74f0b7-c0e5-4ef7-bd57-f2cd6af9c2da tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:54.943412 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b74f0b7-c0e5-4ef7-bd57-f2cd6af9c2da tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:54.944932 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b74f0b7-c0e5-4ef7-bd57-f2cd6af9c2da tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:54.945744 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b74f0b7-c0e5-4ef7-bd57-f2cd6af9c2da tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:54.961890 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b74f0b7-c0e5-4ef7-bd57-f2cd6af9c2da tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:54.963852 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b74f0b7-c0e5-4ef7-bd57-f2cd6af9c2da tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:54.978428 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b74f0b7-c0e5-4ef7-bd57-f2cd6af9c2da tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:55.007255 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b74f0b7-c0e5-4ef7-bd57-f2cd6af9c2da tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:55.009079 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b74f0b7-c0e5-4ef7-bd57-f2cd6af9c2da tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:55.009849 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b74f0b7-c0e5-4ef7-bd57-f2cd6af9c2da tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:55.031496 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7b74f0b7-c0e5-4ef7-bd57-f2cd6af9c2da tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1664 microversion: 2.53 time: 0.852737 Sep 24 20:49:55.039290 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 41/103] 10.222.0.52 () {60 vars in 1243 bytes} [Sat Sep 24 20:49:54 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1664 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:49:55.058643 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3769df2b-8c6f-4ae7-89d1-9448864b1e06 tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] Calling method '.version_select at 0x7f4b0d485ca0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:55.066780 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3769df2b-8c6f-4ae7-89d1-9448864b1e06 tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:55.067702 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3769df2b-8c6f-4ae7-89d1-9448864b1e06 tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:55.068362 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3769df2b-8c6f-4ae7-89d1-9448864b1e06 tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:55.102143 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3769df2b-8c6f-4ae7-89d1-9448864b1e06 tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:55.103677 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3769df2b-8c6f-4ae7-89d1-9448864b1e06 tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:55.104501 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3769df2b-8c6f-4ae7-89d1-9448864b1e06 tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:55.130060 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-124934ba-2bc4-497f-9d17-ac678fec3267 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:49:55.130572 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-124934ba-2bc4-497f-9d17-ac678fec3267 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:49:55.131113 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-124934ba-2bc4-497f-9d17-ac678fec3267 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:49:55.131541 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-124934ba-2bc4-497f-9d17-ac678fec3267 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:49:55.132079 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-124934ba-2bc4-497f-9d17-ac678fec3267 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:49:55.160398 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-124934ba-2bc4-497f-9d17-ac678fec3267 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:55.174552 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-124934ba-2bc4-497f-9d17-ac678fec3267 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:55.176603 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-124934ba-2bc4-497f-9d17-ac678fec3267 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:55.183394 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3769df2b-8c6f-4ae7-89d1-9448864b1e06 tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:55.183891 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-124934ba-2bc4-497f-9d17-ac678fec3267 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:55.185064 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3769df2b-8c6f-4ae7-89d1-9448864b1e06 tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:55.185715 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-124934ba-2bc4-497f-9d17-ac678fec3267 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:55.186358 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-124934ba-2bc4-497f-9d17-ac678fec3267 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:55.187065 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3769df2b-8c6f-4ae7-89d1-9448864b1e06 tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:55.212809 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3769df2b-8c6f-4ae7-89d1-9448864b1e06 tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:55.223314 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3769df2b-8c6f-4ae7-89d1-9448864b1e06 tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:55.224148 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3769df2b-8c6f-4ae7-89d1-9448864b1e06 tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:55.260934 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3769df2b-8c6f-4ae7-89d1-9448864b1e06 tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:55.261650 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3769df2b-8c6f-4ae7-89d1-9448864b1e06 tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:55.262299 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3769df2b-8c6f-4ae7-89d1-9448864b1e06 tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:55.277448 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3769df2b-8c6f-4ae7-89d1-9448864b1e06 tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 357 microversion: 2.53 time: 0.223838 Sep 24 20:49:55.278247 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 42/104] 10.222.0.52 () {60 vars in 1222 bytes} [Sat Sep 24 20:49:55 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 357 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 20:49:55.281930 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-124934ba-2bc4-497f-9d17-ac678fec3267 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Getting quotas for project c3800968cd944059a397e9c6b35f976d. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:49:55.287451 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-20e3b534-30b7-4b32-b40c-d016c653646d tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:55.297522 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-20e3b534-30b7-4b32-b40c-d016c653646d tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] [instance: 650cae0b-7b94-4c33-a526-5cc80548c0db] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:49:55.301269 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-124934ba-2bc4-497f-9d17-ac678fec3267 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Getting quotas for user 50d8a91794144d73a8942f5c3bac8cc8 and project c3800968cd944059a397e9c6b35f976d. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:49:55.314415 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-20e3b534-30b7-4b32-b40c-d016c653646d tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:55.319537 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-20e3b534-30b7-4b32-b40c-d016c653646d tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:55.320290 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-20e3b534-30b7-4b32-b40c-d016c653646d tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:55.321326 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-20e3b534-30b7-4b32-b40c-d016c653646d tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:55.322012 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-20e3b534-30b7-4b32-b40c-d016c653646d tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:55.322764 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-20e3b534-30b7-4b32-b40c-d016c653646d tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:55.336713 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-124934ba-2bc4-497f-9d17-ac678fec3267 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:49:55.349251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-124934ba-2bc4-497f-9d17-ac678fec3267 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:49:55.490685 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-124934ba-2bc4-497f-9d17-ac678fec3267 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.931841 Sep 24 20:49:55.501423 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 63/105] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:49:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:49:55.546920 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bf3dc601-db86-4cd9-b280-2838cb1510b6 tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] Calling method '.version_select at 0x7f4b0d1fe0d0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:55.555817 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bf3dc601-db86-4cd9-b280-2838cb1510b6 tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:55.557343 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bf3dc601-db86-4cd9-b280-2838cb1510b6 tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:55.559185 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bf3dc601-db86-4cd9-b280-2838cb1510b6 tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:55.622439 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bf3dc601-db86-4cd9-b280-2838cb1510b6 tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:55.625737 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bf3dc601-db86-4cd9-b280-2838cb1510b6 tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:55.632919 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bf3dc601-db86-4cd9-b280-2838cb1510b6 tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:55.650712 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bf3dc601-db86-4cd9-b280-2838cb1510b6 tempest-HypervisorAdminV253TestBase-1410115301 tempest-HypervisorAdminV253TestBase-1410115301-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/8b749e43-2430-46b4-a49c-6f442ece7174" status: 200 len: 792 microversion: 2.53 time: 0.143201 Sep 24 20:49:55.659435 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 64/106] 10.222.0.52 () {60 vars in 1298 bytes} [Sat Sep 24 20:49:55 2022] GET /compute/v2.1/os-hypervisors/8b749e43-2430-46b4-a49c-6f442ece7174 => generated 792 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:49:55.684477 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-329f4251-7396-4a88-a862-6db48077af98 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:55.685100 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-329f4251-7396-4a88-a862-6db48077af98 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:49:56.489696 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-329f4251-7396-4a88-a862-6db48077af98 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8a91794144d73a8942f5c3bac8cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3800968cd944059a397e9c6b35f976d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:49:56.502217 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-329f4251-7396-4a88-a862-6db48077af98 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1" status: 200 len: 1220 microversion: 2.1 time: 0.841550 Sep 24 20:49:56.503990 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 65/107] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:49:55 2022] GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 => generated 1220 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:49:56.566012 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-20e3b534-30b7-4b32-b40c-d016c653646d tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01bfb1e8464616aceb3b73c958eb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e62e74103b45cc81dfe7900c0baf5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:49:56.579671 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-20e3b534-30b7-4b32-b40c-d016c653646d tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] 10.222.0.52 "GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db" status: 200 len: 1294 microversion: 2.1 time: 1.297103 Sep 24 20:49:56.581887 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 43/108] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:49:55 2022] GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db => generated 1294 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:49:57.019693 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-610b3460-efb7-4a9a-bae8-5fe941b615f6 tempest-AZAdminNegativeTestJSON-969110232 tempest-AZAdminNegativeTestJSON-969110232-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:57.024771 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-610b3460-efb7-4a9a-bae8-5fe941b615f6 tempest-AZAdminNegativeTestJSON-969110232 tempest-AZAdminNegativeTestJSON-969110232-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '40bb8d1e3f184350a8dd178699af1f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cebe12de27243c5b9be5ed421ebdb6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:49:57.035945 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-610b3460-efb7-4a9a-bae8-5fe941b615f6 tempest-AZAdminNegativeTestJSON-969110232 tempest-AZAdminNegativeTestJSON-969110232-project] Request method failure captured: Sep 24 20:49:57.035945 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Sep 24 20:49:57.035945 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:49:57.035945 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:49:57.035945 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:49:57.035945 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:49:57.035945 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:49:57.035945 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:49:57.035945 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:49:57.035945 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:49:57.035945 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL21wfF7Qkq4A41NXW-kKDGuuDPOB1SIUXXhb7eA5DkNltgJA_58mEE36jrLAxCM0nJZsY8hYS71kK2x0YX9Ne1WJHpAj_WxAsLEDfSPG8Ni9hWRHur3qPSPU0k109iPMe1dFqLO3Gv7izfVjKWJOGuxSdt70njkb9mibg2WS5X5bcpc Sep 24 20:49:57.035945 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:49:57.035945 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:49:57.035945 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:49:57.035945 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:49:57.035945 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:49:57.035945 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:49:57.035945 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 2cebe12de27243c5b9be5ed421ebdb6e Sep 24 20:49:57.035945 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-AZAdminNegativeTestJSON-969110232 Sep 24 20:49:57.035945 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:49:57.035945 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:49:57.038228 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2cebe12de27243c5b9be5ed421ebdb6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2cebe12de27243c5b9be5ed421ebdb6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2cebe12de27243c5b9be5ed421ebdb6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2cebe12de27243c5b9be5ed421ebdb6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:49:57.038228 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-AZAdminNegativeTestJSON-969110232 Sep 24 20:49:57.038228 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 2cebe12de27243c5b9be5ed421ebdb6e Sep 24 20:49:57.038228 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-969110232 Sep 24 20:49:57.038228 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-AZAdminNegativeTestJSON-969110232-project Sep 24 20:49:57.038228 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:49:57.038228 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:49:57.038228 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 40bb8d1e3f184350a8dd178699af1f9b Sep 24 20:49:57.038228 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-AZAdminNegativeTestJSON-969110232-project Sep 24 20:49:57.038228 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:49:57.038228 ncdv-master-1 devstack@n-api.service[140516]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 24 20:49:57.038228 ncdv-master-1 devstack@n-api.service[140516]: action_args: {} Sep 24 20:49:57.039281 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:49:57.039281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:57.039281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:49:57.039281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:49:57.039281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:49:57.039281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:49:57.039281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:49:57.039281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:49:57.039281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Sep 24 20:49:57.039281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Sep 24 20:49:57.039281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 24 20:49:57.039281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 24 20:49:57.039281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 24 20:49:57.039281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 24 20:49:57.039281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:49:57.039281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:49:57.039281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:49:57.039281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:49:57.039281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 24 20:49:57.040780 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 24 20:49:57.040780 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 24 20:49:57.040780 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 24 20:49:57.040780 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 24 20:49:57.040780 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 24 20:49:57.040780 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 24 20:49:57.040780 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:57.040780 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:49:57.040780 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:57.040780 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:57.040780 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:49:57.040780 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:49:57.040780 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 24 20:49:57.040780 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 24 20:49:57.040780 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 24 20:49:57.040780 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:57.051464 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-610b3460-efb7-4a9a-bae8-5fe941b615f6 tempest-AZAdminNegativeTestJSON-969110232 tempest-AZAdminNegativeTestJSON-969110232-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:49:57.052561 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-610b3460-efb7-4a9a-bae8-5fe941b615f6 tempest-AZAdminNegativeTestJSON-969110232 tempest-AZAdminNegativeTestJSON-969110232-project] 10.222.0.52 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.545289 Sep 24 20:49:57.061684 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 66/109] 10.222.0.52 () {58 vars in 1185 bytes} [Sat Sep 24 20:49:56 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 557 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:49:57.347355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7078e5dc-5420-476d-ace1-16cffc0337b7 tempest-InstanceUsageAuditLogNegativeTestJSON-1765724414 tempest-InstanceUsageAuditLogNegativeTestJSON-1765724414-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:57.355256 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-7078e5dc-5420-476d-ace1-16cffc0337b7 tempest-InstanceUsageAuditLogNegativeTestJSON-1765724414 tempest-InstanceUsageAuditLogNegativeTestJSON-1765724414-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Sep 24 20:49:57.366234 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7078e5dc-5420-476d-ace1-16cffc0337b7 tempest-InstanceUsageAuditLogNegativeTestJSON-1765724414 tempest-InstanceUsageAuditLogNegativeTestJSON-1765724414-project-admin] Request method failure captured: Sep 24 20:49:57.366234 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Sep 24 20:49:57.366234 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:49:57.366234 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:49:57.366234 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:49:57.366234 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:49:57.366234 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:49:57.366234 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:49:57.366234 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:49:57.366234 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:49:57.366234 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL210Ioy89JrZL1u3tz3Zst4tWjpFysFUrrS_TaerpjEuPd4zxazP1e_mJfIqHKlVnjFGH3bV1NDfv2NsSE6WkA09O9X3wHmDufisclDajOyXnA3sHuVyevJJio985X3qaSBbVmMWdJBxZ-SaX_GNMTk-7Qt_jK9ZdN4zUvU4Og75Qp8 Sep 24 20:49:57.366234 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:49:57.366234 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:49:57.366234 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:49:57.366234 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:49:57.366234 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:49:57.366234 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:49:57.366234 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 08c5c7add4b946be9f61ffaf4badb33e Sep 24 20:49:57.366234 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1765724414 Sep 24 20:49:57.366234 ncdv-master-1 devstack@n-api.service[140517]: X-Role: admin,reader,member Sep 24 20:49:57.366234 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: admin,reader,member Sep 24 20:49:57.367789 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/08c5c7add4b946be9f61ffaf4badb33e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_08c5c7add4b946be9f61ffaf4badb33e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/08c5c7add4b946be9f61ffaf4badb33e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/08c5c7add4b946be9f61ffaf4badb33e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:49:57.367789 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1765724414 Sep 24 20:49:57.367789 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 08c5c7add4b946be9f61ffaf4badb33e Sep 24 20:49:57.367789 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1765724414 Sep 24 20:49:57.367789 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1765724414-project-admin Sep 24 20:49:57.367789 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:49:57.367789 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:49:57.367789 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: e8b307de1eea436b85505a55d8938f3e Sep 24 20:49:57.367789 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1765724414-project-admin Sep 24 20:49:57.367789 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:49:57.367789 ncdv-master-1 devstack@n-api.service[140517]: exception: Invalid timestamp for date invalid_time Sep 24 20:49:57.369090 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'invalid_time'} Sep 24 20:49:57.369090 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:49:57.369090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:57.369090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Sep 24 20:49:57.369090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Sep 24 20:49:57.369090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Sep 24 20:49:57.369090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Sep 24 20:49:57.369090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Sep 24 20:49:57.369090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Sep 24 20:49:57.369090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Sep 24 20:49:57.369090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:49:57.369090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:49:57.369090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:49:57.369090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:57.369090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:49:57.369090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:49:57.369090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:49:57.369090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:49:57.369090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:49:57.369090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:49:57.371065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Sep 24 20:49:57.371065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Sep 24 20:49:57.371065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Sep 24 20:49:57.371065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:49:57.371065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:49:57.371065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:49:57.371065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:57.371065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:49:57.371065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:49:57.371065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:49:57.371065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:49:57.371065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Sep 24 20:49:57.371065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:49:57.374037 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7078e5dc-5420-476d-ace1-16cffc0337b7 tempest-InstanceUsageAuditLogNegativeTestJSON-1765724414 tempest-InstanceUsageAuditLogNegativeTestJSON-1765724414-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:49:57.375331 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7078e5dc-5420-476d-ace1-16cffc0337b7 tempest-InstanceUsageAuditLogNegativeTestJSON-1765724414 tempest-InstanceUsageAuditLogNegativeTestJSON-1765724414-project-admin] 10.222.0.52 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.331768 Sep 24 20:49:57.376704 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 44/110] 10.222.0.52 () {58 vars in 1224 bytes} [Sat Sep 24 20:49:57 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 340 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 24 20:49:57.537867 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9c7b2813-e59f-46fb-a94a-8a242cb39c6e tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:57.538908 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9c7b2813-e59f-46fb-a94a-8a242cb39c6e tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:49:57.792448 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9c7b2813-e59f-46fb-a94a-8a242cb39c6e tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8a91794144d73a8942f5c3bac8cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3800968cd944059a397e9c6b35f976d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:49:57.820976 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9c7b2813-e59f-46fb-a94a-8a242cb39c6e tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1" status: 200 len: 1220 microversion: 2.1 time: 0.296034 Sep 24 20:49:57.829506 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 45/111] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:49:57 2022] GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 => generated 1220 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:49:57.848818 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-58c4d293-27d4-45d1-b7b3-331ce56a0a47 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:57.849441 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-58c4d293-27d4-45d1-b7b3-331ce56a0a47 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] [instance: 650cae0b-7b94-4c33-a526-5cc80548c0db] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:49:57.872112 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58c4d293-27d4-45d1-b7b3-331ce56a0a47 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:57.874980 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58c4d293-27d4-45d1-b7b3-331ce56a0a47 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:57.878479 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58c4d293-27d4-45d1-b7b3-331ce56a0a47 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:57.895736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58c4d293-27d4-45d1-b7b3-331ce56a0a47 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:57.896347 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58c4d293-27d4-45d1-b7b3-331ce56a0a47 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:57.896969 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58c4d293-27d4-45d1-b7b3-331ce56a0a47 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:58.192963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c48f7822-5996-4755-bb41-79a103343c0c tempest-InstanceUsageAuditLogNegativeTestJSON-573987302 tempest-InstanceUsageAuditLogNegativeTestJSON-573987302-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:58.197625 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c48f7822-5996-4755-bb41-79a103343c0c tempest-InstanceUsageAuditLogNegativeTestJSON-573987302 tempest-InstanceUsageAuditLogNegativeTestJSON-573987302-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'f10d9ba7b6dd477ba7f359a3c33938fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acef8993ec2043f09bc31103aaa55c26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:49:58.205961 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c48f7822-5996-4755-bb41-79a103343c0c tempest-InstanceUsageAuditLogNegativeTestJSON-573987302 tempest-InstanceUsageAuditLogNegativeTestJSON-573987302-project] Request method failure captured: Sep 24 20:49:58.205961 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Sep 24 20:49:58.205961 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:49:58.205961 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:49:58.205961 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:49:58.205961 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:49:58.205961 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:49:58.205961 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:49:58.205961 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:49:58.205961 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:49:58.205961 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL21yh_KnnMiCmH1kJqvz71tiJwDfCgV1ilP4BhkY269JHROjBqw7ivaqNCtG6P1F_R2r5oMk73qwDRLkxWzQQfrJEw2LWpzxTMRdpT6u-ytWLqj_0o7RFVKJ1m8k_Zjg6aZU6_XHnwRaw09Gp39dfrXwGvXyV_ix28XudvphjGbVB7g Sep 24 20:49:58.205961 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:49:58.205961 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:49:58.205961 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:49:58.205961 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:49:58.205961 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:49:58.205961 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:49:58.205961 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: acef8993ec2043f09bc31103aaa55c26 Sep 24 20:49:58.205961 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-573987302 Sep 24 20:49:58.205961 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:49:58.205961 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:49:58.207410 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/acef8993ec2043f09bc31103aaa55c26"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_acef8993ec2043f09bc31103aaa55c26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/acef8993ec2043f09bc31103aaa55c26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/acef8993ec2043f09bc31103aaa55c26"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:49:58.207410 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-573987302 Sep 24 20:49:58.207410 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: acef8993ec2043f09bc31103aaa55c26 Sep 24 20:49:58.207410 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-573987302 Sep 24 20:49:58.207410 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-573987302-project Sep 24 20:49:58.207410 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:49:58.207410 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:49:58.207410 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: f10d9ba7b6dd477ba7f359a3c33938fc Sep 24 20:49:58.207410 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-573987302-project Sep 24 20:49:58.207410 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:49:58.208071 ncdv-master-1 devstack@n-api.service[140516]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 24 20:49:58.208071 ncdv-master-1 devstack@n-api.service[140516]: action_args: {} Sep 24 20:49:58.208071 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:49:58.208071 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:58.208071 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:49:58.208071 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:49:58.208071 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:49:58.208071 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:49:58.208071 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:49:58.208071 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:49:58.208071 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Sep 24 20:49:58.208071 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Sep 24 20:49:58.208071 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 24 20:49:58.208071 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 24 20:49:58.208071 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 24 20:49:58.208071 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 24 20:49:58.208071 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:49:58.208071 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:49:58.208071 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:49:58.208071 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:49:58.209303 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 24 20:49:58.209303 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 24 20:49:58.209303 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 24 20:49:58.209303 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 24 20:49:58.209303 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 24 20:49:58.209303 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 24 20:49:58.209303 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 24 20:49:58.209303 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:58.209303 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:49:58.209303 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:58.209303 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:58.209303 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:49:58.209303 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:49:58.209303 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 24 20:49:58.209303 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 24 20:49:58.209303 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 24 20:49:58.209303 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:58.212444 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c48f7822-5996-4755-bb41-79a103343c0c tempest-InstanceUsageAuditLogNegativeTestJSON-573987302 tempest-InstanceUsageAuditLogNegativeTestJSON-573987302-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:49:58.214397 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c48f7822-5996-4755-bb41-79a103343c0c tempest-InstanceUsageAuditLogNegativeTestJSON-573987302 tempest-InstanceUsageAuditLogNegativeTestJSON-573987302-project] 10.222.0.52 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.829914 Sep 24 20:49:58.220914 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 67/112] 10.222.0.52 () {58 vars in 1185 bytes} [Sat Sep 24 20:49:57 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 837 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:49:58.466384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bab840a0-11f7-43fc-a78e-1879194908bc tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:58.478118 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bab840a0-11f7-43fc-a78e-1879194908bc tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.254583 Sep 24 20:49:58.479037 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 68/113] 10.222.0.52 () {58 vars in 1137 bytes} [Sat Sep 24 20:49:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:49:58.484369 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a4fab885-76a4-4edb-9a10-e04f99d3e5cd tempest-InstanceUsageAuditLogNegativeTestJSON-573987302 tempest-InstanceUsageAuditLogNegativeTestJSON-573987302-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:58.486360 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a4fab885-76a4-4edb-9a10-e04f99d3e5cd tempest-InstanceUsageAuditLogNegativeTestJSON-573987302 tempest-InstanceUsageAuditLogNegativeTestJSON-573987302-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'f10d9ba7b6dd477ba7f359a3c33938fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acef8993ec2043f09bc31103aaa55c26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:49:58.488167 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a4fab885-76a4-4edb-9a10-e04f99d3e5cd tempest-InstanceUsageAuditLogNegativeTestJSON-573987302 tempest-InstanceUsageAuditLogNegativeTestJSON-573987302-project] Request method failure captured: Sep 24 20:49:58.488167 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-09-24%2020:49:58 HTTP/1.1 Sep 24 20:49:58.488167 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:49:58.488167 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:49:58.488167 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:49:58.488167 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:49:58.488167 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:49:58.488167 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:49:58.488167 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:49:58.488167 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:49:58.488167 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL21yh_KnnMiCmH1kJqvz71tiJwDfCgV1ilP4BhkY269JHROjBqw7ivaqNCtG6P1F_R2r5oMk73qwDRLkxWzQQfrJEw2LWpzxTMRdpT6u-ytWLqj_0o7RFVKJ1m8k_Zjg6aZU6_XHnwRaw09Gp39dfrXwGvXyV_ix28XudvphjGbVB7g Sep 24 20:49:58.488167 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:49:58.488167 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:49:58.488167 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:49:58.488167 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:49:58.488167 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:49:58.488167 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:49:58.488167 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: acef8993ec2043f09bc31103aaa55c26 Sep 24 20:49:58.488167 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-573987302 Sep 24 20:49:58.488167 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:49:58.488167 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:49:58.489398 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/acef8993ec2043f09bc31103aaa55c26"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_acef8993ec2043f09bc31103aaa55c26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/acef8993ec2043f09bc31103aaa55c26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/acef8993ec2043f09bc31103aaa55c26"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:49:58.489398 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-573987302 Sep 24 20:49:58.489398 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: acef8993ec2043f09bc31103aaa55c26 Sep 24 20:49:58.489398 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-573987302 Sep 24 20:49:58.489398 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-573987302-project Sep 24 20:49:58.489398 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:49:58.489398 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:49:58.489398 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: f10d9ba7b6dd477ba7f359a3c33938fc Sep 24 20:49:58.489398 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-573987302-project Sep 24 20:49:58.489398 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:49:58.489911 ncdv-master-1 devstack@n-api.service[140516]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 24 20:49:58.489911 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '2022-09-24 20:49:58'} Sep 24 20:49:58.489911 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:49:58.489911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:58.489911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:49:58.489911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:49:58.489911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:49:58.489911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:49:58.489911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:49:58.489911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:49:58.489911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Sep 24 20:49:58.489911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Sep 24 20:49:58.489911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 24 20:49:58.489911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 24 20:49:58.489911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 24 20:49:58.489911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 24 20:49:58.489911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:49:58.489911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:49:58.489911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:49:58.489911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:49:58.491190 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 24 20:49:58.491190 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 24 20:49:58.491190 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 24 20:49:58.491190 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 24 20:49:58.491190 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 24 20:49:58.491190 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 24 20:49:58.491190 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 24 20:49:58.491190 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:58.491190 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:49:58.491190 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:58.491190 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:49:58.491190 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:49:58.491190 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:49:58.491190 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 24 20:49:58.491190 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 24 20:49:58.491190 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 24 20:49:58.491190 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:49:58.494130 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a4fab885-76a4-4edb-9a10-e04f99d3e5cd tempest-InstanceUsageAuditLogNegativeTestJSON-573987302 tempest-InstanceUsageAuditLogNegativeTestJSON-573987302-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:49:58.507629 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a4fab885-76a4-4edb-9a10-e04f99d3e5cd tempest-InstanceUsageAuditLogNegativeTestJSON-573987302 tempest-InstanceUsageAuditLogNegativeTestJSON-573987302-project] 10.222.0.52 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-24 20:49:58" status: 403 len: 128 microversion: 2.1 time: 0.027216 Sep 24 20:49:58.508590 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 69/114] 10.222.0.52 () {58 vars in 1251 bytes} [Sat Sep 24 20:49:58 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-24%2020%3A49%3A58 => generated 128 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:49:58.565588 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-58c4d293-27d4-45d1-b7b3-331ce56a0a47 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01bfb1e8464616aceb3b73c958eb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e62e74103b45cc81dfe7900c0baf5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:49:58.578823 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-58c4d293-27d4-45d1-b7b3-331ce56a0a47 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] 10.222.0.52 "GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db" status: 200 len: 1336 microversion: 2.1 time: 0.746799 Sep 24 20:49:58.579632 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 46/115] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:49:57 2022] GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db => generated 1336 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:49:58.836116 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-03af950b-aa3e-4ffd-bfa8-89265c0b2e1f tempest-ServersWithSpecificFlavorTestJSON-592449782 tempest-ServersWithSpecificFlavorTestJSON-592449782-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-852997828", "id": 1835620820, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:58.852221 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b861e94f-8c99-4f19-9404-826687883f8c tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:58.855259 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b861e94f-8c99-4f19-9404-826687883f8c tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:49:58.876521 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b861e94f-8c99-4f19-9404-826687883f8c tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:58.881094 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b861e94f-8c99-4f19-9404-826687883f8c tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:58.882232 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b861e94f-8c99-4f19-9404-826687883f8c tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:58.886585 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b861e94f-8c99-4f19-9404-826687883f8c tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:58.888116 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b861e94f-8c99-4f19-9404-826687883f8c tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:58.889044 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b861e94f-8c99-4f19-9404-826687883f8c tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:58.891717 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-03af950b-aa3e-4ffd-bfa8-89265c0b2e1f tempest-ServersWithSpecificFlavorTestJSON-592449782 tempest-ServersWithSpecificFlavorTestJSON-592449782-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.381476 Sep 24 20:49:58.897330 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 70/116] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:49:58 2022] POST /compute/v2.1/flavors => generated 424 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:49:58.920088 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d2e55ba3-aa98-41a9-8403-a29f3c31fc0e tempest-ServersWithSpecificFlavorTestJSON-592449782 tempest-ServersWithSpecificFlavorTestJSON-592449782-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:58.942708 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d2e55ba3-aa98-41a9-8403-a29f3c31fc0e tempest-ServersWithSpecificFlavorTestJSON-592449782 tempest-ServersWithSpecificFlavorTestJSON-592449782-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.041050 Sep 24 20:49:58.958222 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 71/117] 10.222.0.52 () {58 vars in 1182 bytes} [Sat Sep 24 20:49:58 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:49:58.969107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7bc2c477-c2f5-4b15-9bd4-2b15eb56efdf tempest-ServersWithSpecificFlavorTestJSON-592449782 tempest-ServersWithSpecificFlavorTestJSON-592449782-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1181797676", "id": 285405344, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:59.034919 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7bc2c477-c2f5-4b15-9bd4-2b15eb56efdf tempest-ServersWithSpecificFlavorTestJSON-592449782 tempest-ServersWithSpecificFlavorTestJSON-592449782-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.071061 Sep 24 20:49:59.037299 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 72/118] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:49:58 2022] POST /compute/v2.1/flavors => generated 422 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:49:59.050113 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7db5ef56-8bd6-464d-9dbc-b3bbb2c61916 tempest-ServersWithSpecificFlavorTestJSON-592449782 tempest-ServersWithSpecificFlavorTestJSON-592449782-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:59.077256 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7db5ef56-8bd6-464d-9dbc-b3bbb2c61916 tempest-ServersWithSpecificFlavorTestJSON-592449782 tempest-ServersWithSpecificFlavorTestJSON-592449782-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.032019 Sep 24 20:49:59.079986 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 73/119] 10.222.0.52 () {58 vars in 1182 bytes} [Sat Sep 24 20:49:59 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:49:59.094378 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b861e94f-8c99-4f19-9404-826687883f8c tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8a91794144d73a8942f5c3bac8cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3800968cd944059a397e9c6b35f976d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:49:59.097870 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cc14c175-3adb-45a6-bd27-6e757001759b tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Action: 'create', calling method: .version_select at 0x7f4b0d151dc0>, body: {"keypair": {"name": "tempest-keypair-1715256276", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxMSj8I1WivVm6T3x2DhYZ8bqdvmc8faYgg+XaBnRSeCNST7gk/SghTOSXTnRMPMhvyHiGbiRM+UNqW/xeHU34EuOwQL9sTq1YXuzIK79R1MKzvVw+O93nehSQWOWFsZg=="}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:49:59.117106 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b861e94f-8c99-4f19-9404-826687883f8c tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1" status: 200 len: 1272 microversion: 2.1 time: 0.268784 Sep 24 20:49:59.120313 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 47/120] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:49:58 2022] GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 => generated 1272 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:49:59.196347 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-cc14c175-3adb-45a6-bd27-6e757001759b tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Getting quotas for project 478a31be22cc451b92af447ed8d81242. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:49:59.201908 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-cc14c175-3adb-45a6-bd27-6e757001759b tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Getting quotas for user d278977b201c48dda2d73823fbfe4833 and project 478a31be22cc451b92af447ed8d81242. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:49:59.216660 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:DELETE=13,nova_api:SELECT=80,nova_api:INSERT=7 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:49:59.263413 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cc14c175-3adb-45a6-bd27-6e757001759b tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.172939 Sep 24 20:49:59.268403 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 74/121] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 20:49:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:49:59.604915 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ba83c633-1299-4d32-9af3-f9a31eeefd74 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:49:59.605554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ba83c633-1299-4d32-9af3-f9a31eeefd74 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] [instance: 650cae0b-7b94-4c33-a526-5cc80548c0db] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:49:59.607642 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=4 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:49:59.626197 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ba83c633-1299-4d32-9af3-f9a31eeefd74 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:59.627372 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ba83c633-1299-4d32-9af3-f9a31eeefd74 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:59.628145 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ba83c633-1299-4d32-9af3-f9a31eeefd74 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:49:59.629390 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ba83c633-1299-4d32-9af3-f9a31eeefd74 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:49:59.630132 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ba83c633-1299-4d32-9af3-f9a31eeefd74 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:49:59.630876 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ba83c633-1299-4d32-9af3-f9a31eeefd74 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:00.164055 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b86e9676-b197-4e34-b9be-00c0ed241a79 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:00.164794 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b86e9676-b197-4e34-b9be-00c0ed241a79 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:00.183923 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b86e9676-b197-4e34-b9be-00c0ed241a79 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:00.184664 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b86e9676-b197-4e34-b9be-00c0ed241a79 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:00.186693 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b86e9676-b197-4e34-b9be-00c0ed241a79 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:00.188734 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b86e9676-b197-4e34-b9be-00c0ed241a79 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:00.191515 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b86e9676-b197-4e34-b9be-00c0ed241a79 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:00.192453 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b86e9676-b197-4e34-b9be-00c0ed241a79 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:00.711903 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ba83c633-1299-4d32-9af3-f9a31eeefd74 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01bfb1e8464616aceb3b73c958eb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e62e74103b45cc81dfe7900c0baf5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:00.731770 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ba83c633-1299-4d32-9af3-f9a31eeefd74 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] 10.222.0.52 "GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db" status: 200 len: 1336 microversion: 2.1 time: 1.131822 Sep 24 20:50:00.757407 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 48/122] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:49:59 2022] GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db => generated 1336 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:01.052092 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b86e9676-b197-4e34-b9be-00c0ed241a79 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8a91794144d73a8942f5c3bac8cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3800968cd944059a397e9c6b35f976d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:01.087123 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b86e9676-b197-4e34-b9be-00c0ed241a79 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1" status: 200 len: 1278 microversion: 2.1 time: 0.929883 Sep 24 20:50:01.088227 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 75/123] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:00 2022] GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 => generated 1278 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:01.766277 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c6a258d3-c87b-4769-b771-bd6c2860fbf7 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:01.766277 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c6a258d3-c87b-4769-b771-bd6c2860fbf7 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] [instance: 650cae0b-7b94-4c33-a526-5cc80548c0db] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:01.792275 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c6a258d3-c87b-4769-b771-bd6c2860fbf7 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:01.792737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c6a258d3-c87b-4769-b771-bd6c2860fbf7 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:01.799366 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c6a258d3-c87b-4769-b771-bd6c2860fbf7 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:01.802771 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c6a258d3-c87b-4769-b771-bd6c2860fbf7 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:01.810748 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c6a258d3-c87b-4769-b771-bd6c2860fbf7 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:01.813642 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c6a258d3-c87b-4769-b771-bd6c2860fbf7 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:02.116740 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-71389f83-73e5-4fa6-83aa-36e9fca739fb tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:02.117554 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-71389f83-73e5-4fa6-83aa-36e9fca739fb tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:02.138276 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71389f83-73e5-4fa6-83aa-36e9fca739fb tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:02.139148 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71389f83-73e5-4fa6-83aa-36e9fca739fb tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:02.140680 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71389f83-73e5-4fa6-83aa-36e9fca739fb tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:02.143551 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71389f83-73e5-4fa6-83aa-36e9fca739fb tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:02.148522 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71389f83-73e5-4fa6-83aa-36e9fca739fb tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:02.151061 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71389f83-73e5-4fa6-83aa-36e9fca739fb tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:02.581454 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-71389f83-73e5-4fa6-83aa-36e9fca739fb tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8a91794144d73a8942f5c3bac8cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3800968cd944059a397e9c6b35f976d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:02.597337 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-71389f83-73e5-4fa6-83aa-36e9fca739fb tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1" status: 200 len: 1278 microversion: 2.1 time: 0.478579 Sep 24 20:50:02.615561 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 76/124] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:02 2022] GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 => generated 1278 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:03.598922 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c6a258d3-c87b-4769-b771-bd6c2860fbf7 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01bfb1e8464616aceb3b73c958eb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e62e74103b45cc81dfe7900c0baf5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:03.613598 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c6a258d3-c87b-4769-b771-bd6c2860fbf7 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] 10.222.0.52 "GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db" status: 200 len: 1336 microversion: 2.1 time: 1.860447 Sep 24 20:50:03.623204 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 49/125] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:01 2022] GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db => generated 1336 bytes in 1871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:03.639125 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0dc59e4f-74a4-4b08-94ca-85350f304951 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:03.644090 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0dc59e4f-74a4-4b08-94ca-85350f304951 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:03.663847 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0dc59e4f-74a4-4b08-94ca-85350f304951 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:03.672101 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0dc59e4f-74a4-4b08-94ca-85350f304951 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:03.681205 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0dc59e4f-74a4-4b08-94ca-85350f304951 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:03.684132 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0dc59e4f-74a4-4b08-94ca-85350f304951 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:03.687804 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0dc59e4f-74a4-4b08-94ca-85350f304951 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:03.692769 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0dc59e4f-74a4-4b08-94ca-85350f304951 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:04.283112 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0dc59e4f-74a4-4b08-94ca-85350f304951 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8a91794144d73a8942f5c3bac8cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3800968cd944059a397e9c6b35f976d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:04.299829 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0dc59e4f-74a4-4b08-94ca-85350f304951 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1" status: 200 len: 1278 microversion: 2.1 time: 0.679157 Sep 24 20:50:04.304108 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 77/126] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:03 2022] GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 => generated 1278 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:04.650781 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1f038358-38b6-4eb8-8e0b-4db6c53580b9 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:04.651415 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1f038358-38b6-4eb8-8e0b-4db6c53580b9 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] [instance: 650cae0b-7b94-4c33-a526-5cc80548c0db] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:04.672614 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1f038358-38b6-4eb8-8e0b-4db6c53580b9 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:04.673662 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1f038358-38b6-4eb8-8e0b-4db6c53580b9 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:04.675734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1f038358-38b6-4eb8-8e0b-4db6c53580b9 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:04.678110 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1f038358-38b6-4eb8-8e0b-4db6c53580b9 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:04.679903 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1f038358-38b6-4eb8-8e0b-4db6c53580b9 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:04.683367 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1f038358-38b6-4eb8-8e0b-4db6c53580b9 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:05.334110 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1ea2c34c-44a8-47ee-9074-2efa9ccfce67 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:05.335024 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1ea2c34c-44a8-47ee-9074-2efa9ccfce67 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:05.351304 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:50:05.364192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1ea2c34c-44a8-47ee-9074-2efa9ccfce67 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:05.372704 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1ea2c34c-44a8-47ee-9074-2efa9ccfce67 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:05.373547 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1ea2c34c-44a8-47ee-9074-2efa9ccfce67 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:05.388618 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1ea2c34c-44a8-47ee-9074-2efa9ccfce67 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:05.390376 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1ea2c34c-44a8-47ee-9074-2efa9ccfce67 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:05.395318 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1ea2c34c-44a8-47ee-9074-2efa9ccfce67 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:06.255785 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1ea2c34c-44a8-47ee-9074-2efa9ccfce67 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8a91794144d73a8942f5c3bac8cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3800968cd944059a397e9c6b35f976d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:06.277279 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1ea2c34c-44a8-47ee-9074-2efa9ccfce67 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1" status: 200 len: 1278 microversion: 2.1 time: 0.947125 Sep 24 20:50:06.303274 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 78/127] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:05 2022] GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 => generated 1278 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:07.463114 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-c7c2df71-7091-4688-a7c3-4b293d75e107 req-a849b380-f8c7-4493-bc6e-c4a5cdbff013 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "650cae0b-7b94-4c33-a526-5cc80548c0db", "tag": "5f721dd0-8223-41cc-ad71-4ac5294e10ed"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:07.512498 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c7c2df71-7091-4688-a7c3-4b293d75e107 req-a849b380-f8c7-4493-bc6e-c4a5cdbff013 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:07.513127 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c7c2df71-7091-4688-a7c3-4b293d75e107 req-a849b380-f8c7-4493-bc6e-c4a5cdbff013 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:07.513728 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c7c2df71-7091-4688-a7c3-4b293d75e107 req-a849b380-f8c7-4493-bc6e-c4a5cdbff013 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:07.605140 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-c7c2df71-7091-4688-a7c3-4b293d75e107 req-a849b380-f8c7-4493-bc6e-c4a5cdbff013 service nova] Creating event network-changed:5f721dd0-8223-41cc-ad71-4ac5294e10ed for instance 650cae0b-7b94-4c33-a526-5cc80548c0db on nch1-master-1 Sep 24 20:50:07.605910 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c7c2df71-7091-4688-a7c3-4b293d75e107 req-a849b380-f8c7-4493-bc6e-c4a5cdbff013 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=140516) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 24 20:50:07.606417 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c7c2df71-7091-4688-a7c3-4b293d75e107 req-a849b380-f8c7-4493-bc6e-c4a5cdbff013 service nova] Acquired lock "compute-rpcapi-router" {{(pid=140516) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 24 20:50:07.607696 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-356d0075-4638-437e-9cad-e6c93df281b5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:07.609059 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-356d0075-4638-437e-9cad-e6c93df281b5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:07.611910 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-356d0075-4638-437e-9cad-e6c93df281b5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:07.613012 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-356d0075-4638-437e-9cad-e6c93df281b5 None None] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:07.613871 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-356d0075-4638-437e-9cad-e6c93df281b5 None None] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:07.617127 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-356d0075-4638-437e-9cad-e6c93df281b5 None None] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:07.643141 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.compute.rpcapi [None req-356d0075-4638-437e-9cad-e6c93df281b5 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 24 20:50:07.646945 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-356d0075-4638-437e-9cad-e6c93df281b5 None None] Releasing lock "compute-rpcapi-router" {{(pid=140516) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 24 20:50:07.685763 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-356d0075-4638-437e-9cad-e6c93df281b5 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.381061 Sep 24 20:50:07.687918 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 79/128] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:07.689420 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1f038358-38b6-4eb8-8e0b-4db6c53580b9 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01bfb1e8464616aceb3b73c958eb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e62e74103b45cc81dfe7900c0baf5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:07.711574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9740f34b-4630-481f-a1e8-07129e6f6836 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:07.717382 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1f038358-38b6-4eb8-8e0b-4db6c53580b9 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] 10.222.0.52 "GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db" status: 200 len: 1336 microversion: 2.1 time: 3.068963 Sep 24 20:50:07.735543 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 50/129] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:04 2022] GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db => generated 1336 bytes in 3075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:50:07.738534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9740f34b-4630-481f-a1e8-07129e6f6836 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:07.755141 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9740f34b-4630-481f-a1e8-07129e6f6836 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:07.767139 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9740f34b-4630-481f-a1e8-07129e6f6836 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:07.768244 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9740f34b-4630-481f-a1e8-07129e6f6836 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:07.773115 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9740f34b-4630-481f-a1e8-07129e6f6836 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:07.774217 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9740f34b-4630-481f-a1e8-07129e6f6836 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:07.775254 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9740f34b-4630-481f-a1e8-07129e6f6836 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:08.751485 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-94d7d56d-d036-4975-8081-d8212612ffd8 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:08.753322 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-94d7d56d-d036-4975-8081-d8212612ffd8 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] [instance: 650cae0b-7b94-4c33-a526-5cc80548c0db] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:08.758300 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=8 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:50:08.818810 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-94d7d56d-d036-4975-8081-d8212612ffd8 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:08.844365 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-94d7d56d-d036-4975-8081-d8212612ffd8 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:08.845203 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-94d7d56d-d036-4975-8081-d8212612ffd8 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:08.848227 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-94d7d56d-d036-4975-8081-d8212612ffd8 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:08.853744 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-94d7d56d-d036-4975-8081-d8212612ffd8 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:08.856087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-94d7d56d-d036-4975-8081-d8212612ffd8 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:09.216005 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=14 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:50:09.361500 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9740f34b-4630-481f-a1e8-07129e6f6836 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8a91794144d73a8942f5c3bac8cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3800968cd944059a397e9c6b35f976d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:09.372557 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=57 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:50:09.380824 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9740f34b-4630-481f-a1e8-07129e6f6836 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1" status: 200 len: 1320 microversion: 2.1 time: 1.686140 Sep 24 20:50:09.395466 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 80/130] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:07 2022] GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 => generated 1320 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:10.423460 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2f15cd06-5a26-4e11-98e0-8919b94f0f27 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:10.424199 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2f15cd06-5a26-4e11-98e0-8919b94f0f27 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:10.473346 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f15cd06-5a26-4e11-98e0-8919b94f0f27 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:10.473953 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f15cd06-5a26-4e11-98e0-8919b94f0f27 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:10.474518 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f15cd06-5a26-4e11-98e0-8919b94f0f27 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:10.495991 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f15cd06-5a26-4e11-98e0-8919b94f0f27 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:10.496563 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f15cd06-5a26-4e11-98e0-8919b94f0f27 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:10.497115 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f15cd06-5a26-4e11-98e0-8919b94f0f27 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:11.219718 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-94d7d56d-d036-4975-8081-d8212612ffd8 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01bfb1e8464616aceb3b73c958eb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e62e74103b45cc81dfe7900c0baf5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:11.222920 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=99 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:50:11.241802 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-94d7d56d-d036-4975-8081-d8212612ffd8 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] 10.222.0.52 "GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db" status: 200 len: 1336 microversion: 2.1 time: 2.495697 Sep 24 20:50:11.262960 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 51/131] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:08 2022] GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db => generated 1336 bytes in 2517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:11.589476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2f15cd06-5a26-4e11-98e0-8919b94f0f27 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8a91794144d73a8942f5c3bac8cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3800968cd944059a397e9c6b35f976d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:11.600583 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2f15cd06-5a26-4e11-98e0-8919b94f0f27 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1" status: 200 len: 1320 microversion: 2.1 time: 1.181644 Sep 24 20:50:11.616801 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 81/132] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:10 2022] GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 => generated 1320 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:50:12.288807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a949a99c-6c3f-47c8-ba60-6908f049ac3b tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:12.289476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a949a99c-6c3f-47c8-ba60-6908f049ac3b tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] [instance: 650cae0b-7b94-4c33-a526-5cc80548c0db] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:12.318242 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a949a99c-6c3f-47c8-ba60-6908f049ac3b tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:12.328699 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a949a99c-6c3f-47c8-ba60-6908f049ac3b tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:12.329382 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a949a99c-6c3f-47c8-ba60-6908f049ac3b tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:12.330300 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a949a99c-6c3f-47c8-ba60-6908f049ac3b tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:12.330990 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a949a99c-6c3f-47c8-ba60-6908f049ac3b tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:12.336221 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a949a99c-6c3f-47c8-ba60-6908f049ac3b tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:12.572167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-57809d54-ac23-41de-b148-cb8614a37c18 tempest-HypervisorAdminNegativeTestJSON-1150505152 tempest-HypervisorAdminNegativeTestJSON-1150505152-project] Calling method '.version_select at 0x7f4b0d4430d0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:12.574944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-57809d54-ac23-41de-b148-cb8614a37c18 tempest-HypervisorAdminNegativeTestJSON-1150505152 tempest-HypervisorAdminNegativeTestJSON-1150505152-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'd8eebdb35d754b39b1b551a25e5195cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82024a37b59b4790b869f387793fd5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:12.580300 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-57809d54-ac23-41de-b148-cb8614a37c18 tempest-HypervisorAdminNegativeTestJSON-1150505152 tempest-HypervisorAdminNegativeTestJSON-1150505152-project] Request method failure captured: Sep 24 20:50:12.580300 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Sep 24 20:50:12.580300 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:50:12.580300 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:50:12.580300 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:50:12.580300 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:50:12.580300 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:50:12.580300 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:50:12.580300 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:50:12.580300 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:50:12.580300 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL22BUaGsCfr1jdijYXHA4o14mdi-lbiWJ7Une9ArnjvdaU5dIZfay75rmgRI5skUzTJF6s0HdhAd_VRHDw7brByZ3WnZKXAndUobnsLWRRJ--oEVJOnudm_n0Yngu4BboK8C2d9EazrdRSJw3vD8bBhLhnOsQkNTkuMG2jKFfDQ9D64 Sep 24 20:50:12.580300 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:50:12.580300 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:50:12.580300 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:50:12.580300 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:50:12.580300 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:50:12.580300 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:50:12.580300 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 82024a37b59b4790b869f387793fd5bc Sep 24 20:50:12.580300 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1150505152 Sep 24 20:50:12.580300 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:50:12.580300 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:50:12.581752 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/82024a37b59b4790b869f387793fd5bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_82024a37b59b4790b869f387793fd5bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/82024a37b59b4790b869f387793fd5bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/82024a37b59b4790b869f387793fd5bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:50:12.581752 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1150505152 Sep 24 20:50:12.581752 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 82024a37b59b4790b869f387793fd5bc Sep 24 20:50:12.581752 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1150505152 Sep 24 20:50:12.581752 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-HypervisorAdminNegativeTestJSON-1150505152-project Sep 24 20:50:12.581752 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:50:12.581752 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:50:12.581752 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: d8eebdb35d754b39b1b551a25e5195cb Sep 24 20:50:12.581752 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1150505152-project Sep 24 20:50:12.581752 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 20:50:12.581752 ncdv-master-1 devstack@n-api.service[140517]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 24 20:50:12.581752 ncdv-master-1 devstack@n-api.service[140517]: action_args: {} Sep 24 20:50:12.581752 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:50:12.582913 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:12.582913 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:50:12.582913 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:50:12.582913 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:50:12.582913 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:50:12.582913 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:50:12.582913 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:50:12.582913 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:50:12.582913 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:50:12.582913 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Sep 24 20:50:12.582913 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._detail(req) Sep 24 20:50:12.582913 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Sep 24 20:50:12.582913 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Sep 24 20:50:12.582913 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 24 20:50:12.582913 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 24 20:50:12.582913 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 24 20:50:12.582913 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 24 20:50:12.582913 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:50:12.582913 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:50:12.584839 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:50:12.584839 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:50:12.584839 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 24 20:50:12.584839 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 24 20:50:12.584839 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 24 20:50:12.584839 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 24 20:50:12.584839 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 24 20:50:12.584839 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 24 20:50:12.584839 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 24 20:50:12.584839 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:12.584839 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:50:12.584839 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:12.584839 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:12.584839 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:50:12.584839 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:50:12.584839 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 24 20:50:12.584839 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 24 20:50:12.584839 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 24 20:50:12.584839 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:12.595717 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-57809d54-ac23-41de-b148-cb8614a37c18 tempest-HypervisorAdminNegativeTestJSON-1150505152 tempest-HypervisorAdminNegativeTestJSON-1150505152-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:50:12.599230 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-57809d54-ac23-41de-b148-cb8614a37c18 tempest-HypervisorAdminNegativeTestJSON-1150505152 tempest-HypervisorAdminNegativeTestJSON-1150505152-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.653168 Sep 24 20:50:12.600221 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 52/133] 10.222.0.52 () {58 vars in 1167 bytes} [Sat Sep 24 20:50:11 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 655 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 24 20:50:12.616929 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-577d10fd-7ceb-4208-8238-99a9f96280c9 tempest-HypervisorAdminNegativeTestJSON-1150505152 tempest-HypervisorAdminNegativeTestJSON-1150505152-project] Calling method '.version_select at 0x7f4b0d3c9430>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:12.641663 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-577d10fd-7ceb-4208-8238-99a9f96280c9 tempest-HypervisorAdminNegativeTestJSON-1150505152 tempest-HypervisorAdminNegativeTestJSON-1150505152-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'd8eebdb35d754b39b1b551a25e5195cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82024a37b59b4790b869f387793fd5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:12.645855 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-577d10fd-7ceb-4208-8238-99a9f96280c9 tempest-HypervisorAdminNegativeTestJSON-1150505152 tempest-HypervisorAdminNegativeTestJSON-1150505152-project] Request method failure captured: Sep 24 20:50:12.645855 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Sep 24 20:50:12.645855 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:50:12.645855 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:50:12.645855 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:50:12.645855 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:50:12.645855 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:50:12.645855 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:50:12.645855 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:50:12.645855 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:50:12.645855 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL22BUaGsCfr1jdijYXHA4o14mdi-lbiWJ7Une9ArnjvdaU5dIZfay75rmgRI5skUzTJF6s0HdhAd_VRHDw7brByZ3WnZKXAndUobnsLWRRJ--oEVJOnudm_n0Yngu4BboK8C2d9EazrdRSJw3vD8bBhLhnOsQkNTkuMG2jKFfDQ9D64 Sep 24 20:50:12.645855 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:50:12.645855 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:50:12.645855 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:50:12.645855 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:50:12.645855 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:50:12.645855 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:50:12.645855 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 82024a37b59b4790b869f387793fd5bc Sep 24 20:50:12.645855 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1150505152 Sep 24 20:50:12.645855 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:50:12.645855 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:50:12.647523 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/82024a37b59b4790b869f387793fd5bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_82024a37b59b4790b869f387793fd5bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/82024a37b59b4790b869f387793fd5bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/82024a37b59b4790b869f387793fd5bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:50:12.647523 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1150505152 Sep 24 20:50:12.647523 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 82024a37b59b4790b869f387793fd5bc Sep 24 20:50:12.647523 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1150505152 Sep 24 20:50:12.647523 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-HypervisorAdminNegativeTestJSON-1150505152-project Sep 24 20:50:12.647523 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:50:12.647523 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:50:12.647523 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: d8eebdb35d754b39b1b551a25e5195cb Sep 24 20:50:12.647523 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1150505152-project Sep 24 20:50:12.647523 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 20:50:12.647523 ncdv-master-1 devstack@n-api.service[140517]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 24 20:50:12.647523 ncdv-master-1 devstack@n-api.service[140517]: action_args: {} Sep 24 20:50:12.647523 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:50:12.648563 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:12.648563 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:50:12.648563 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:50:12.648563 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:50:12.648563 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:50:12.648563 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:50:12.648563 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:50:12.648563 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:50:12.648563 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:50:12.648563 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Sep 24 20:50:12.648563 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 24 20:50:12.648563 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Sep 24 20:50:12.648563 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Sep 24 20:50:12.648563 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 24 20:50:12.648563 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 24 20:50:12.648563 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 24 20:50:12.648563 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 24 20:50:12.648563 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:50:12.648563 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:50:12.650158 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:50:12.650158 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:50:12.650158 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 24 20:50:12.650158 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 24 20:50:12.650158 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 24 20:50:12.650158 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 24 20:50:12.650158 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 24 20:50:12.650158 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 24 20:50:12.650158 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 24 20:50:12.650158 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:12.650158 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:50:12.650158 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:12.650158 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:12.650158 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:50:12.650158 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:50:12.650158 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 24 20:50:12.650158 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 24 20:50:12.650158 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 24 20:50:12.650158 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:12.653125 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-577d10fd-7ceb-4208-8238-99a9f96280c9 tempest-HypervisorAdminNegativeTestJSON-1150505152 tempest-HypervisorAdminNegativeTestJSON-1150505152-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:50:12.654526 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-577d10fd-7ceb-4208-8238-99a9f96280c9 tempest-HypervisorAdminNegativeTestJSON-1150505152 tempest-HypervisorAdminNegativeTestJSON-1150505152-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.046665 Sep 24 20:50:12.664033 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 53/134] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:50:12 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 56 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:50:12.674783 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f93b01d7-7401-4e74-a28f-6c3b66e4ebe2 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:12.682852 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f93b01d7-7401-4e74-a28f-6c3b66e4ebe2 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:12.698460 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f93b01d7-7401-4e74-a28f-6c3b66e4ebe2 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:12.699296 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f93b01d7-7401-4e74-a28f-6c3b66e4ebe2 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:12.707672 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f93b01d7-7401-4e74-a28f-6c3b66e4ebe2 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:12.709469 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f93b01d7-7401-4e74-a28f-6c3b66e4ebe2 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:12.710139 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f93b01d7-7401-4e74-a28f-6c3b66e4ebe2 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:12.710779 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f93b01d7-7401-4e74-a28f-6c3b66e4ebe2 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:13.644286 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a949a99c-6c3f-47c8-ba60-6908f049ac3b tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01bfb1e8464616aceb3b73c958eb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e62e74103b45cc81dfe7900c0baf5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:13.649827 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f93b01d7-7401-4e74-a28f-6c3b66e4ebe2 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8a91794144d73a8942f5c3bac8cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3800968cd944059a397e9c6b35f976d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:13.671479 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a949a99c-6c3f-47c8-ba60-6908f049ac3b tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] 10.222.0.52 "GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db" status: 200 len: 1336 microversion: 2.1 time: 1.385944 Sep 24 20:50:13.673529 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 82/135] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:12 2022] GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db => generated 1336 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:13.677355 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f93b01d7-7401-4e74-a28f-6c3b66e4ebe2 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1" status: 200 len: 1320 microversion: 2.1 time: 1.011251 Sep 24 20:50:13.681175 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 54/136] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:12 2022] GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 => generated 1320 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:13.683218 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-613f0195-5379-4dda-8a13-cda41307f1ec tempest-HypervisorAdminNegativeTestJSON-1150505152 tempest-HypervisorAdminNegativeTestJSON-1150505152-project] Calling method '.version_select at 0x7f4b0d081430>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:13.685765 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-613f0195-5379-4dda-8a13-cda41307f1ec tempest-HypervisorAdminNegativeTestJSON-1150505152 tempest-HypervisorAdminNegativeTestJSON-1150505152-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'd8eebdb35d754b39b1b551a25e5195cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82024a37b59b4790b869f387793fd5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:13.688230 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-613f0195-5379-4dda-8a13-cda41307f1ec tempest-HypervisorAdminNegativeTestJSON-1150505152 tempest-HypervisorAdminNegativeTestJSON-1150505152-project] Request method failure captured: Sep 24 20:50:13.688230 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Sep 24 20:50:13.688230 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:50:13.688230 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:50:13.688230 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:50:13.688230 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:50:13.688230 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:50:13.688230 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:50:13.688230 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:50:13.688230 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:50:13.688230 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL22BUaGsCfr1jdijYXHA4o14mdi-lbiWJ7Une9ArnjvdaU5dIZfay75rmgRI5skUzTJF6s0HdhAd_VRHDw7brByZ3WnZKXAndUobnsLWRRJ--oEVJOnudm_n0Yngu4BboK8C2d9EazrdRSJw3vD8bBhLhnOsQkNTkuMG2jKFfDQ9D64 Sep 24 20:50:13.688230 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:50:13.688230 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:50:13.688230 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:50:13.688230 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:50:13.688230 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:50:13.688230 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:50:13.688230 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 82024a37b59b4790b869f387793fd5bc Sep 24 20:50:13.688230 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1150505152 Sep 24 20:50:13.688230 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:50:13.688230 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:50:13.689338 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/82024a37b59b4790b869f387793fd5bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_82024a37b59b4790b869f387793fd5bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/82024a37b59b4790b869f387793fd5bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/82024a37b59b4790b869f387793fd5bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:50:13.689338 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1150505152 Sep 24 20:50:13.689338 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 82024a37b59b4790b869f387793fd5bc Sep 24 20:50:13.689338 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1150505152 Sep 24 20:50:13.689338 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-HypervisorAdminNegativeTestJSON-1150505152-project Sep 24 20:50:13.689338 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:50:13.689338 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:50:13.689338 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: d8eebdb35d754b39b1b551a25e5195cb Sep 24 20:50:13.689338 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1150505152-project Sep 24 20:50:13.689338 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:50:13.689338 ncdv-master-1 devstack@n-api.service[140516]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 24 20:50:13.689338 ncdv-master-1 devstack@n-api.service[140516]: action_args: {} Sep 24 20:50:13.689338 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:50:13.690022 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:13.690022 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:50:13.690022 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:50:13.690022 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:50:13.690022 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:50:13.690022 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:50:13.690022 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:50:13.690022 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:50:13.690022 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:50:13.690022 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Sep 24 20:50:13.690022 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Sep 24 20:50:13.690022 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 24 20:50:13.690022 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 24 20:50:13.690022 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 24 20:50:13.690022 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 24 20:50:13.690022 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:50:13.690022 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:50:13.690022 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:50:13.690022 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:50:13.691035 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 24 20:50:13.691035 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 24 20:50:13.691035 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 24 20:50:13.691035 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 24 20:50:13.691035 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 24 20:50:13.691035 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 24 20:50:13.691035 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 24 20:50:13.691035 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:13.691035 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:50:13.691035 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:13.691035 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:13.691035 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:50:13.691035 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:50:13.691035 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 24 20:50:13.691035 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 24 20:50:13.691035 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 24 20:50:13.691035 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:13.692934 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-613f0195-5379-4dda-8a13-cda41307f1ec tempest-HypervisorAdminNegativeTestJSON-1150505152 tempest-HypervisorAdminNegativeTestJSON-1150505152-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:50:13.694687 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-613f0195-5379-4dda-8a13-cda41307f1ec tempest-HypervisorAdminNegativeTestJSON-1150505152 tempest-HypervisorAdminNegativeTestJSON-1150505152-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.019100 Sep 24 20:50:13.695469 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 83/137] 10.222.0.52 () {58 vars in 1179 bytes} [Sat Sep 24 20:50:13 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:50:14.091157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-bb5d8237-4781-464b-8a70-36e8411f5206 req-759ddb60-5c2e-4e81-be1a-e85cd7a6a4f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c7ac6b8-6436-4f54-abad-8d782b4eb5e1", "tag": "62020081-009a-494e-a571-75ec298caf16"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:14.131870 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-bb5d8237-4781-464b-8a70-36e8411f5206 req-759ddb60-5c2e-4e81-be1a-e85cd7a6a4f2 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:14.133014 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-bb5d8237-4781-464b-8a70-36e8411f5206 req-759ddb60-5c2e-4e81-be1a-e85cd7a6a4f2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:14.133627 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-bb5d8237-4781-464b-8a70-36e8411f5206 req-759ddb60-5c2e-4e81-be1a-e85cd7a6a4f2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:14.155057 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-802a201c-68d3-46a6-90cb-70ecc536c2b2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-777472188", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:14.176079 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-bb5d8237-4781-464b-8a70-36e8411f5206 req-759ddb60-5c2e-4e81-be1a-e85cd7a6a4f2 service nova] Creating event network-changed:62020081-009a-494e-a571-75ec298caf16 for instance 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 on nch2-master-1 Sep 24 20:50:14.190653 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-bb5d8237-4781-464b-8a70-36e8411f5206 req-759ddb60-5c2e-4e81-be1a-e85cd7a6a4f2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.483108 Sep 24 20:50:14.193061 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 84/138] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:14.202976 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-74bd4104-c6f0-4529-a46a-73d705bc06e5 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1528306114", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "285405344", "adminPass": "***", "networks": [{"uuid": "d9321d34-d679-4ed7-935d-3b84684d66b9"}], "security_groups": [{"name": "tempest-securitygroup--1471433951"}], "key_name": "tempest-keypair-1715256276", "user_data": "}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:14.389260 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-802a201c-68d3-46a6-90cb-70ecc536c2b2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] validate_networks() for None {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:50:14.598574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-74bd4104-c6f0-4529-a46a-73d705bc06e5 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] validate_networks() for [('d9321d34-d679-4ed7-935d-3b84684d66b9', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:50:14.954815 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-802a201c-68d3-46a6-90cb-70ecc536c2b2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:50:14.955409 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-802a201c-68d3-46a6-90cb-70ecc536c2b2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:50:14.955718 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-802a201c-68d3-46a6-90cb-70ecc536c2b2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:50:14.956169 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-802a201c-68d3-46a6-90cb-70ecc536c2b2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:50:14.956537 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-802a201c-68d3-46a6-90cb-70ecc536c2b2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:50:14.958571 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=4,nova_api:INSERT=6 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:50:14.980970 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-802a201c-68d3-46a6-90cb-70ecc536c2b2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:14.989268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-802a201c-68d3-46a6-90cb-70ecc536c2b2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:14.990906 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-802a201c-68d3-46a6-90cb-70ecc536c2b2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:14.992708 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-802a201c-68d3-46a6-90cb-70ecc536c2b2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:14.994782 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-802a201c-68d3-46a6-90cb-70ecc536c2b2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:14.996637 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-802a201c-68d3-46a6-90cb-70ecc536c2b2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:15.062054 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-802a201c-68d3-46a6-90cb-70ecc536c2b2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Getting quotas for project 349d3aa8627644d59867a744695f2579. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:50:15.072617 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-802a201c-68d3-46a6-90cb-70ecc536c2b2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Getting quotas for user 93982876b1e24efb8ffa8c009532343a and project 349d3aa8627644d59867a744695f2579. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:50:15.085936 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-802a201c-68d3-46a6-90cb-70ecc536c2b2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:50:15.088522 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-802a201c-68d3-46a6-90cb-70ecc536c2b2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:50:15.167622 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-802a201c-68d3-46a6-90cb-70ecc536c2b2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.484845 Sep 24 20:50:15.175627 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 55/139] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:50:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:50:15.537330 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a52b4ea1-cccc-45c2-8ac5-c3855535c9dc tempest-HypervisorAdminNegativeTestJSON-1798361765 tempest-HypervisorAdminNegativeTestJSON-1798361765-project-admin] Calling method '.version_select at 0x7f4b0d3c9ca0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:15.541752 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a52b4ea1-cccc-45c2-8ac5-c3855535c9dc tempest-HypervisorAdminNegativeTestJSON-1798361765 tempest-HypervisorAdminNegativeTestJSON-1798361765-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:15.542731 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a52b4ea1-cccc-45c2-8ac5-c3855535c9dc tempest-HypervisorAdminNegativeTestJSON-1798361765 tempest-HypervisorAdminNegativeTestJSON-1798361765-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:15.543655 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a52b4ea1-cccc-45c2-8ac5-c3855535c9dc tempest-HypervisorAdminNegativeTestJSON-1798361765 tempest-HypervisorAdminNegativeTestJSON-1798361765-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:15.583857 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a52b4ea1-cccc-45c2-8ac5-c3855535c9dc tempest-HypervisorAdminNegativeTestJSON-1798361765 tempest-HypervisorAdminNegativeTestJSON-1798361765-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:15.584365 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a52b4ea1-cccc-45c2-8ac5-c3855535c9dc tempest-HypervisorAdminNegativeTestJSON-1798361765 tempest-HypervisorAdminNegativeTestJSON-1798361765-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:15.584817 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a52b4ea1-cccc-45c2-8ac5-c3855535c9dc tempest-HypervisorAdminNegativeTestJSON-1798361765 tempest-HypervisorAdminNegativeTestJSON-1798361765-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:15.629176 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a52b4ea1-cccc-45c2-8ac5-c3855535c9dc tempest-HypervisorAdminNegativeTestJSON-1798361765 tempest-HypervisorAdminNegativeTestJSON-1798361765-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:15.635361 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a52b4ea1-cccc-45c2-8ac5-c3855535c9dc tempest-HypervisorAdminNegativeTestJSON-1798361765 tempest-HypervisorAdminNegativeTestJSON-1798361765-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:15.635931 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a52b4ea1-cccc-45c2-8ac5-c3855535c9dc tempest-HypervisorAdminNegativeTestJSON-1798361765 tempest-HypervisorAdminNegativeTestJSON-1798361765-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:15.650898 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a52b4ea1-cccc-45c2-8ac5-c3855535c9dc tempest-HypervisorAdminNegativeTestJSON-1798361765 tempest-HypervisorAdminNegativeTestJSON-1798361765-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.475991 Sep 24 20:50:15.660316 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 56/140] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:50:15 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:16.075915 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fde6df53-5945-471e-9219-b292df79a59f tempest-QuotaClassesAdminTestJSON-996949242 tempest-QuotaClassesAdminTestJSON-996949242-project-admin] Calling method '.version_select at 0x7f4b0d3c9f70>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:16.123091 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fde6df53-5945-471e-9219-b292df79a59f tempest-QuotaClassesAdminTestJSON-996949242 tempest-QuotaClassesAdminTestJSON-996949242-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.461470 Sep 24 20:50:16.124366 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 57/141] 10.222.0.52 () {58 vars in 1185 bytes} [Sat Sep 24 20:50:15 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:16.135881 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1a1ff92a-cf1f-47b0-9436-6b0a0f6cbe7f tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:16.136684 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1a1ff92a-cf1f-47b0-9436-6b0a0f6cbe7f tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] [instance: 650cae0b-7b94-4c33-a526-5cc80548c0db] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:16.158374 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a1ff92a-cf1f-47b0-9436-6b0a0f6cbe7f tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:16.158904 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a1ff92a-cf1f-47b0-9436-6b0a0f6cbe7f tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:16.159348 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a1ff92a-cf1f-47b0-9436-6b0a0f6cbe7f tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:16.159982 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-74bd4104-c6f0-4529-a46a-73d705bc06e5 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:50:16.160419 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a1ff92a-cf1f-47b0-9436-6b0a0f6cbe7f tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:16.160506 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a1ff92a-cf1f-47b0-9436-6b0a0f6cbe7f tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:16.160588 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-74bd4104-c6f0-4529-a46a-73d705bc06e5 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:50:16.160948 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a1ff92a-cf1f-47b0-9436-6b0a0f6cbe7f tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:16.161207 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-74bd4104-c6f0-4529-a46a-73d705bc06e5 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:50:16.161694 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-74bd4104-c6f0-4529-a46a-73d705bc06e5 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:50:16.162180 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-74bd4104-c6f0-4529-a46a-73d705bc06e5 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:50:16.194748 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-74bd4104-c6f0-4529-a46a-73d705bc06e5 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:16.195349 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-74bd4104-c6f0-4529-a46a-73d705bc06e5 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:16.195864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-74bd4104-c6f0-4529-a46a-73d705bc06e5 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:16.196682 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-74bd4104-c6f0-4529-a46a-73d705bc06e5 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:16.197218 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-74bd4104-c6f0-4529-a46a-73d705bc06e5 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:16.197720 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-74bd4104-c6f0-4529-a46a-73d705bc06e5 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:16.235075 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-74bd4104-c6f0-4529-a46a-73d705bc06e5 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Getting quotas for project 478a31be22cc451b92af447ed8d81242. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:50:16.240636 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-74bd4104-c6f0-4529-a46a-73d705bc06e5 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Getting quotas for user d278977b201c48dda2d73823fbfe4833 and project 478a31be22cc451b92af447ed8d81242. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:50:16.254630 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-74bd4104-c6f0-4529-a46a-73d705bc06e5 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:50:16.257221 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-74bd4104-c6f0-4529-a46a-73d705bc06e5 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 9b0e9940-f6ac-46d5-8898-1e4ba56119b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:50:16.332621 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-74bd4104-c6f0-4529-a46a-73d705bc06e5 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.138117 Sep 24 20:50:16.339637 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 85/142] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:50:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 2146 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:50:16.346352 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d66942ed-7af1-4dd3-9e62-2fb7442f2b9b tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:16.354956 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d66942ed-7af1-4dd3-9e62-2fb7442f2b9b tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:16.362628 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d66942ed-7af1-4dd3-9e62-2fb7442f2b9b tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:16.364886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d66942ed-7af1-4dd3-9e62-2fb7442f2b9b tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:16.366252 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d66942ed-7af1-4dd3-9e62-2fb7442f2b9b tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:16.367177 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d66942ed-7af1-4dd3-9e62-2fb7442f2b9b tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:16.368335 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d66942ed-7af1-4dd3-9e62-2fb7442f2b9b tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:16.369094 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d66942ed-7af1-4dd3-9e62-2fb7442f2b9b tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:16.422851 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1a1ff92a-cf1f-47b0-9436-6b0a0f6cbe7f tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01bfb1e8464616aceb3b73c958eb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e62e74103b45cc81dfe7900c0baf5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:16.438705 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1a1ff92a-cf1f-47b0-9436-6b0a0f6cbe7f tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] 10.222.0.52 "GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db" status: 200 len: 1336 microversion: 2.1 time: 0.312772 Sep 24 20:50:16.440043 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 58/143] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:16 2022] GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db => generated 1336 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:16.446609 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4ced4064-f905-433e-9cf3-7af70618ed37 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:16.447488 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4ced4064-f905-433e-9cf3-7af70618ed37 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:16.457461 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ced4064-f905-433e-9cf3-7af70618ed37 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:16.458555 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ced4064-f905-433e-9cf3-7af70618ed37 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:16.459300 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ced4064-f905-433e-9cf3-7af70618ed37 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:16.460221 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ced4064-f905-433e-9cf3-7af70618ed37 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:16.461207 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ced4064-f905-433e-9cf3-7af70618ed37 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:16.462655 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ced4064-f905-433e-9cf3-7af70618ed37 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:16.573230 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4ced4064-f905-433e-9cf3-7af70618ed37 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:16.585224 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4ced4064-f905-433e-9cf3-7af70618ed37 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1235 microversion: 2.1 time: 0.143590 Sep 24 20:50:16.586278 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 59/144] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:16 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1235 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:16.591326 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-eb4895ea-8315-4376-8d76-defe9a89f47d tempest-HypervisorAdminNegativeTestJSON-1150505152 tempest-HypervisorAdminNegativeTestJSON-1150505152-project] Calling method '.version_select at 0x7f4b0d3a1940>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:16.594615 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-eb4895ea-8315-4376-8d76-defe9a89f47d tempest-HypervisorAdminNegativeTestJSON-1150505152 tempest-HypervisorAdminNegativeTestJSON-1150505152-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'd8eebdb35d754b39b1b551a25e5195cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82024a37b59b4790b869f387793fd5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:16.596730 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-eb4895ea-8315-4376-8d76-defe9a89f47d tempest-HypervisorAdminNegativeTestJSON-1150505152 tempest-HypervisorAdminNegativeTestJSON-1150505152-project] Request method failure captured: Sep 24 20:50:16.596730 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Sep 24 20:50:16.596730 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:50:16.596730 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:50:16.596730 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:50:16.596730 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:50:16.596730 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:50:16.596730 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:50:16.596730 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:50:16.596730 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:50:16.596730 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL22BUaGsCfr1jdijYXHA4o14mdi-lbiWJ7Une9ArnjvdaU5dIZfay75rmgRI5skUzTJF6s0HdhAd_VRHDw7brByZ3WnZKXAndUobnsLWRRJ--oEVJOnudm_n0Yngu4BboK8C2d9EazrdRSJw3vD8bBhLhnOsQkNTkuMG2jKFfDQ9D64 Sep 24 20:50:16.596730 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:50:16.596730 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:50:16.596730 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:50:16.596730 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:50:16.596730 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:50:16.596730 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:50:16.596730 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 82024a37b59b4790b869f387793fd5bc Sep 24 20:50:16.596730 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1150505152 Sep 24 20:50:16.596730 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:50:16.596730 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:50:16.598272 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/82024a37b59b4790b869f387793fd5bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_82024a37b59b4790b869f387793fd5bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/82024a37b59b4790b869f387793fd5bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/82024a37b59b4790b869f387793fd5bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:50:16.598272 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1150505152 Sep 24 20:50:16.598272 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 82024a37b59b4790b869f387793fd5bc Sep 24 20:50:16.598272 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1150505152 Sep 24 20:50:16.598272 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-HypervisorAdminNegativeTestJSON-1150505152-project Sep 24 20:50:16.598272 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:50:16.598272 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:50:16.598272 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: d8eebdb35d754b39b1b551a25e5195cb Sep 24 20:50:16.598272 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1150505152-project Sep 24 20:50:16.598272 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 20:50:16.598272 ncdv-master-1 devstack@n-api.service[140517]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 24 20:50:16.598272 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '1'} Sep 24 20:50:16.598272 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:50:16.599152 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:16.599152 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:50:16.599152 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:50:16.599152 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:50:16.599152 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:50:16.599152 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:50:16.599152 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:50:16.599152 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:50:16.599152 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:50:16.599152 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Sep 24 20:50:16.599152 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Sep 24 20:50:16.599152 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 24 20:50:16.599152 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 24 20:50:16.599152 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 24 20:50:16.599152 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 24 20:50:16.599152 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:50:16.599152 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:50:16.599152 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:50:16.599152 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:50:16.600358 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 24 20:50:16.600358 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 24 20:50:16.600358 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 24 20:50:16.600358 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 24 20:50:16.600358 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 24 20:50:16.600358 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 24 20:50:16.600358 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 24 20:50:16.600358 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:16.600358 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:50:16.600358 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:16.600358 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:16.600358 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:50:16.600358 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:50:16.600358 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 24 20:50:16.600358 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 24 20:50:16.600358 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 24 20:50:16.600358 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:16.602398 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-eb4895ea-8315-4376-8d76-defe9a89f47d tempest-HypervisorAdminNegativeTestJSON-1150505152 tempest-HypervisorAdminNegativeTestJSON-1150505152-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:50:16.603938 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-eb4895ea-8315-4376-8d76-defe9a89f47d tempest-HypervisorAdminNegativeTestJSON-1150505152 tempest-HypervisorAdminNegativeTestJSON-1150505152-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.016290 Sep 24 20:50:16.605293 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 60/145] 10.222.0.52 () {58 vars in 1173 bytes} [Sat Sep 24 20:50:16 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:50:16.612743 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-30ef0d23-fac7-4c3e-bec3-5c5d59babe73 tempest-QuotaClassesAdminTestJSON-996949242 tempest-QuotaClassesAdminTestJSON-996949242-project-admin] Action: 'update', calling method: .version_select at 0x7f4b0d4850d0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:16.658535 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d66942ed-7af1-4dd3-9e62-2fb7442f2b9b tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8a91794144d73a8942f5c3bac8cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3800968cd944059a397e9c6b35f976d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:16.674222 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d66942ed-7af1-4dd3-9e62-2fb7442f2b9b tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1" status: 200 len: 1320 microversion: 2.1 time: 0.333186 Sep 24 20:50:16.675171 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 86/146] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:16 2022] GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 => generated 1320 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:16.685260 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-480018cd-ff04-4c66-8367-4401bb890dec tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:16.686528 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-480018cd-ff04-4c66-8367-4401bb890dec tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 9b0e9940-f6ac-46d5-8898-1e4ba56119b3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:16.804011 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-480018cd-ff04-4c66-8367-4401bb890dec tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278977b201c48dda2d73823fbfe4833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a31be22cc451b92af447ed8d81242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:16.818475 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-480018cd-ff04-4c66-8367-4401bb890dec tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3" status: 200 len: 1263 microversion: 2.1 time: 0.140211 Sep 24 20:50:16.821708 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 87/147] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:16 2022] GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3 => generated 1263 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:16.832103 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7b1137c9-3377-4071-8715-7a3c7e85e573 tempest-HypervisorAdminNegativeTestJSON-1798361765 tempest-HypervisorAdminNegativeTestJSON-1798361765-project-admin] Calling method '.version_select at 0x7f4b0d081040>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:16.836682 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-7b1137c9-3377-4071-8715-7a3c7e85e573 tempest-HypervisorAdminNegativeTestJSON-1798361765 tempest-HypervisorAdminNegativeTestJSON-1798361765-project-admin] HTTP exception thrown: Hypervisor with ID '48a720ee-5371-4b07-bfa9-793dbeeb1e04' could not be found. Sep 24 20:50:16.872829 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7b1137c9-3377-4071-8715-7a3c7e85e573 tempest-HypervisorAdminNegativeTestJSON-1798361765 tempest-HypervisorAdminNegativeTestJSON-1798361765-project-admin] Request method failure captured: Sep 24 20:50:16.872829 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/os-hypervisors/48a720ee-5371-4b07-bfa9-793dbeeb1e04/uptime HTTP/1.1 Sep 24 20:50:16.872829 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:50:16.872829 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:50:16.872829 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:50:16.872829 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:50:16.872829 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:50:16.872829 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:50:16.872829 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:50:16.872829 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:50:16.872829 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL22DyOhxOCB4ylP9IAh7YpZWhwcUe-z2Isw6nOalPwyiQ7JVWRRtzy9e29FjrhgxwmFN1qjsLIZUEXsWcECo6wDuu6fvc3mpooaUK_JmJlJdb9xGIVQpAtUsnJFM0d3umnwi0sIRks91utdCWX05ZSDBzQ6FTpyYhOF9mhLnNf078rI Sep 24 20:50:16.872829 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:50:16.872829 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:50:16.872829 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:50:16.872829 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:50:16.872829 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:50:16.872829 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:50:16.872829 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 38a02cd040484a8c98525fd9cc37d266 Sep 24 20:50:16.872829 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1798361765 Sep 24 20:50:16.872829 ncdv-master-1 devstack@n-api.service[140516]: X-Role: admin,reader,member Sep 24 20:50:16.872829 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: admin,reader,member Sep 24 20:50:16.874949 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/38a02cd040484a8c98525fd9cc37d266"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_38a02cd040484a8c98525fd9cc37d266"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/38a02cd040484a8c98525fd9cc37d266"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/38a02cd040484a8c98525fd9cc37d266"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:50:16.874949 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1798361765 Sep 24 20:50:16.874949 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 38a02cd040484a8c98525fd9cc37d266 Sep 24 20:50:16.874949 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1798361765 Sep 24 20:50:16.874949 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-HypervisorAdminNegativeTestJSON-1798361765-project-admin Sep 24 20:50:16.874949 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:50:16.874949 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:50:16.874949 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 9397b23c06f14ac396c4ecb5e41231dc Sep 24 20:50:16.874949 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1798361765-project-admin Sep 24 20:50:16.874949 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:50:16.874949 ncdv-master-1 devstack@n-api.service[140516]: exception: Hypervisor with ID '48a720ee-5371-4b07-bfa9-793dbeeb1e04' could not be found. Sep 24 20:50:16.874949 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '48a720ee-5371-4b07-bfa9-793dbeeb1e04'} Sep 24 20:50:16.875586 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:50:16.875586 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:16.875586 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 24 20:50:16.875586 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 24 20:50:16.875586 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '48a720ee-5371-4b07-bfa9-793dbeeb1e04' Sep 24 20:50:16.875586 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:16.875586 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:50:16.875586 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:16.875586 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:16.875586 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 24 20:50:16.875586 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 24 20:50:16.875586 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 24 20:50:16.875586 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 24 20:50:16.875586 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 24 20:50:16.875586 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:16.875586 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:50:16.875586 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:16.875586 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:16.875586 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 24 20:50:16.875586 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 24 20:50:16.875586 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 24 20:50:16.875586 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 24 20:50:16.876695 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 24 20:50:16.876695 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:16.876695 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:50:16.876695 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:16.876695 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:16.876695 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:50:16.876695 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:50:16.876695 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:50:16.876695 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:50:16.876695 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:50:16.876695 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:50:16.876695 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:50:16.876695 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:50:16.876695 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Sep 24 20:50:16.876695 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 24 20:50:16.876695 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 24 20:50:16.876695 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 24 20:50:16.876695 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '48a720ee-5371-4b07-bfa9-793dbeeb1e04' could not be found. Sep 24 20:50:16.876695 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:16.876695 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:50:16.876695 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:16.878266 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:16.878266 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:50:16.878266 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:50:16.878266 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:50:16.878266 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:50:16.878266 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '48a720ee-5371-4b07-bfa9-793dbeeb1e04' could not be found. Sep 24 20:50:16.878266 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:16.878266 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7b1137c9-3377-4071-8715-7a3c7e85e573 tempest-HypervisorAdminNegativeTestJSON-1798361765 tempest-HypervisorAdminNegativeTestJSON-1798361765-project-admin] Returning 404 to user: Hypervisor with ID '48a720ee-5371-4b07-bfa9-793dbeeb1e04' could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:50:16.878266 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7b1137c9-3377-4071-8715-7a3c7e85e573 tempest-HypervisorAdminNegativeTestJSON-1798361765 tempest-HypervisorAdminNegativeTestJSON-1798361765-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/48a720ee-5371-4b07-bfa9-793dbeeb1e04/uptime" status: 404 len: 123 microversion: 2.1 time: 0.051298 Sep 24 20:50:16.878266 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 88/148] 10.222.0.52 () {58 vars in 1278 bytes} [Sat Sep 24 20:50:16 2022] GET /compute/v2.1/os-hypervisors/48a720ee-5371-4b07-bfa9-793dbeeb1e04/uptime => generated 123 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:50:16.886455 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d6b1d8af-653e-4c90-8bc4-f6e32f0cc864 tempest-HypervisorAdminNegativeTestJSON-1798361765 tempest-HypervisorAdminNegativeTestJSON-1798361765-project-admin] Calling method '.version_select at 0x7f4b0d101670>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:16.888464 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d6b1d8af-653e-4c90-8bc4-f6e32f0cc864 tempest-HypervisorAdminNegativeTestJSON-1798361765 tempest-HypervisorAdminNegativeTestJSON-1798361765-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:16.888995 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d6b1d8af-653e-4c90-8bc4-f6e32f0cc864 tempest-HypervisorAdminNegativeTestJSON-1798361765 tempest-HypervisorAdminNegativeTestJSON-1798361765-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:16.889841 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d6b1d8af-653e-4c90-8bc4-f6e32f0cc864 tempest-HypervisorAdminNegativeTestJSON-1798361765 tempest-HypervisorAdminNegativeTestJSON-1798361765-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:16.928882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d6b1d8af-653e-4c90-8bc4-f6e32f0cc864 tempest-HypervisorAdminNegativeTestJSON-1798361765 tempest-HypervisorAdminNegativeTestJSON-1798361765-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:16.929320 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d6b1d8af-653e-4c90-8bc4-f6e32f0cc864 tempest-HypervisorAdminNegativeTestJSON-1798361765 tempest-HypervisorAdminNegativeTestJSON-1798361765-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:16.929775 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d6b1d8af-653e-4c90-8bc4-f6e32f0cc864 tempest-HypervisorAdminNegativeTestJSON-1798361765 tempest-HypervisorAdminNegativeTestJSON-1798361765-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:16.954007 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d6b1d8af-653e-4c90-8bc4-f6e32f0cc864 tempest-HypervisorAdminNegativeTestJSON-1798361765 tempest-HypervisorAdminNegativeTestJSON-1798361765-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:16.954530 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d6b1d8af-653e-4c90-8bc4-f6e32f0cc864 tempest-HypervisorAdminNegativeTestJSON-1798361765 tempest-HypervisorAdminNegativeTestJSON-1798361765-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:16.959459 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d6b1d8af-653e-4c90-8bc4-f6e32f0cc864 tempest-HypervisorAdminNegativeTestJSON-1798361765 tempest-HypervisorAdminNegativeTestJSON-1798361765-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:16.977621 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d6b1d8af-653e-4c90-8bc4-f6e32f0cc864 tempest-HypervisorAdminNegativeTestJSON-1798361765 tempest-HypervisorAdminNegativeTestJSON-1798361765-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.094841 Sep 24 20:50:16.978727 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 89/149] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:50:16 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:16.989858 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c49c6c84-a05c-41a9-ac6b-5b7ef69686be tempest-HypervisorAdminNegativeTestJSON-1150505152 tempest-HypervisorAdminNegativeTestJSON-1150505152-project] Calling method '.version_select at 0x7f4b0d183040>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:16.991757 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c49c6c84-a05c-41a9-ac6b-5b7ef69686be tempest-HypervisorAdminNegativeTestJSON-1150505152 tempest-HypervisorAdminNegativeTestJSON-1150505152-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'd8eebdb35d754b39b1b551a25e5195cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82024a37b59b4790b869f387793fd5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:16.999239 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c49c6c84-a05c-41a9-ac6b-5b7ef69686be tempest-HypervisorAdminNegativeTestJSON-1150505152 tempest-HypervisorAdminNegativeTestJSON-1150505152-project] Request method failure captured: Sep 24 20:50:16.999239 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Sep 24 20:50:16.999239 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:50:16.999239 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:50:16.999239 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:50:16.999239 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:50:16.999239 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:50:16.999239 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:50:16.999239 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:50:16.999239 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:50:16.999239 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL22BUaGsCfr1jdijYXHA4o14mdi-lbiWJ7Une9ArnjvdaU5dIZfay75rmgRI5skUzTJF6s0HdhAd_VRHDw7brByZ3WnZKXAndUobnsLWRRJ--oEVJOnudm_n0Yngu4BboK8C2d9EazrdRSJw3vD8bBhLhnOsQkNTkuMG2jKFfDQ9D64 Sep 24 20:50:16.999239 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:50:16.999239 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:50:16.999239 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:50:16.999239 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:50:16.999239 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:50:16.999239 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:50:16.999239 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 82024a37b59b4790b869f387793fd5bc Sep 24 20:50:16.999239 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1150505152 Sep 24 20:50:16.999239 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:50:16.999239 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:50:17.000563 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/82024a37b59b4790b869f387793fd5bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_82024a37b59b4790b869f387793fd5bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/82024a37b59b4790b869f387793fd5bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/82024a37b59b4790b869f387793fd5bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:50:17.000563 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1150505152 Sep 24 20:50:17.000563 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 82024a37b59b4790b869f387793fd5bc Sep 24 20:50:17.000563 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1150505152 Sep 24 20:50:17.000563 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-HypervisorAdminNegativeTestJSON-1150505152-project Sep 24 20:50:17.000563 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:50:17.000563 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:50:17.000563 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: d8eebdb35d754b39b1b551a25e5195cb Sep 24 20:50:17.000563 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1150505152-project Sep 24 20:50:17.000563 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:50:17.000563 ncdv-master-1 devstack@n-api.service[140516]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 24 20:50:17.000563 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '1'} Sep 24 20:50:17.000563 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:50:17.001270 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:17.001270 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:50:17.001270 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:50:17.001270 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:50:17.001270 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:50:17.001270 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:50:17.001270 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:50:17.001270 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:50:17.001270 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:50:17.001270 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 24 20:50:17.001270 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 24 20:50:17.001270 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Sep 24 20:50:17.001270 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Sep 24 20:50:17.001270 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 24 20:50:17.001270 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 24 20:50:17.001270 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 24 20:50:17.001270 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 24 20:50:17.001270 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:50:17.001270 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:50:17.002514 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:50:17.002514 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:50:17.002514 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 24 20:50:17.002514 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 24 20:50:17.002514 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 24 20:50:17.002514 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 24 20:50:17.002514 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 24 20:50:17.002514 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 24 20:50:17.002514 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 24 20:50:17.002514 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:17.002514 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:50:17.002514 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:17.002514 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:17.002514 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:50:17.002514 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:50:17.002514 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 24 20:50:17.002514 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 24 20:50:17.002514 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 24 20:50:17.002514 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:17.003700 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c49c6c84-a05c-41a9-ac6b-5b7ef69686be tempest-HypervisorAdminNegativeTestJSON-1150505152 tempest-HypervisorAdminNegativeTestJSON-1150505152-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:50:17.003700 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c49c6c84-a05c-41a9-ac6b-5b7ef69686be tempest-HypervisorAdminNegativeTestJSON-1150505152 tempest-HypervisorAdminNegativeTestJSON-1150505152-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.015037 Sep 24 20:50:17.003700 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 90/150] 10.222.0.52 () {58 vars in 1152 bytes} [Sat Sep 24 20:50:16 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 24 20:50:17.014834 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ffb6d049-aebb-4d08-b28b-0d2c26441915 tempest-HypervisorAdminNegativeTestJSON-1798361765 tempest-HypervisorAdminNegativeTestJSON-1798361765-project-admin] Calling method '.version_select at 0x7f4b0d0810d0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:17.019122 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-ffb6d049-aebb-4d08-b28b-0d2c26441915 tempest-HypervisorAdminNegativeTestJSON-1798361765 tempest-HypervisorAdminNegativeTestJSON-1798361765-project-admin] HTTP exception thrown: Hypervisor with ID 'ee5f8fa7-3089-4df9-a5cc-021f34e95954' could not be found. Sep 24 20:50:17.020876 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ffb6d049-aebb-4d08-b28b-0d2c26441915 tempest-HypervisorAdminNegativeTestJSON-1798361765 tempest-HypervisorAdminNegativeTestJSON-1798361765-project-admin] Request method failure captured: Sep 24 20:50:17.020876 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/os-hypervisors/ee5f8fa7-3089-4df9-a5cc-021f34e95954 HTTP/1.1 Sep 24 20:50:17.020876 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:50:17.020876 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:50:17.020876 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:50:17.020876 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:50:17.020876 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:50:17.020876 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:50:17.020876 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:50:17.020876 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:50:17.020876 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL22DyOhxOCB4ylP9IAh7YpZWhwcUe-z2Isw6nOalPwyiQ7JVWRRtzy9e29FjrhgxwmFN1qjsLIZUEXsWcECo6wDuu6fvc3mpooaUK_JmJlJdb9xGIVQpAtUsnJFM0d3umnwi0sIRks91utdCWX05ZSDBzQ6FTpyYhOF9mhLnNf078rI Sep 24 20:50:17.020876 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:50:17.020876 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:50:17.020876 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:50:17.020876 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:50:17.020876 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:50:17.020876 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:50:17.020876 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 38a02cd040484a8c98525fd9cc37d266 Sep 24 20:50:17.020876 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1798361765 Sep 24 20:50:17.020876 ncdv-master-1 devstack@n-api.service[140516]: X-Role: admin,reader,member Sep 24 20:50:17.020876 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: admin,reader,member Sep 24 20:50:17.022052 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/38a02cd040484a8c98525fd9cc37d266"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_38a02cd040484a8c98525fd9cc37d266"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/38a02cd040484a8c98525fd9cc37d266"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/38a02cd040484a8c98525fd9cc37d266"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:50:17.022052 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1798361765 Sep 24 20:50:17.022052 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 38a02cd040484a8c98525fd9cc37d266 Sep 24 20:50:17.022052 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1798361765 Sep 24 20:50:17.022052 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-HypervisorAdminNegativeTestJSON-1798361765-project-admin Sep 24 20:50:17.022052 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:50:17.022052 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:50:17.022052 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 9397b23c06f14ac396c4ecb5e41231dc Sep 24 20:50:17.022052 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1798361765-project-admin Sep 24 20:50:17.022052 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:50:17.022052 ncdv-master-1 devstack@n-api.service[140516]: exception: Hypervisor with ID 'ee5f8fa7-3089-4df9-a5cc-021f34e95954' could not be found. Sep 24 20:50:17.022052 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'ee5f8fa7-3089-4df9-a5cc-021f34e95954'} Sep 24 20:50:17.022727 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:50:17.022727 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:17.022727 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 24 20:50:17.022727 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 24 20:50:17.022727 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'ee5f8fa7-3089-4df9-a5cc-021f34e95954' Sep 24 20:50:17.022727 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:17.022727 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:50:17.022727 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:17.022727 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:17.022727 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 24 20:50:17.022727 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 24 20:50:17.022727 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 24 20:50:17.022727 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 24 20:50:17.022727 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 24 20:50:17.022727 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:17.022727 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:50:17.022727 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:17.022727 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:17.022727 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 24 20:50:17.022727 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 24 20:50:17.022727 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 24 20:50:17.022727 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 24 20:50:17.024109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 24 20:50:17.024109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:17.024109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:50:17.024109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:17.024109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:17.024109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:50:17.024109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:50:17.024109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:50:17.024109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:50:17.024109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:50:17.024109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:50:17.024109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:50:17.024109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:50:17.024109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 24 20:50:17.024109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 24 20:50:17.024109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Sep 24 20:50:17.024109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 24 20:50:17.024109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 24 20:50:17.024109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 24 20:50:17.024109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'ee5f8fa7-3089-4df9-a5cc-021f34e95954' could not be found. Sep 24 20:50:17.025766 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:17.025766 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:50:17.025766 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:17.025766 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:17.025766 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:50:17.025766 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:50:17.025766 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:50:17.025766 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:50:17.025766 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'ee5f8fa7-3089-4df9-a5cc-021f34e95954' could not be found. Sep 24 20:50:17.025766 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:17.025766 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ffb6d049-aebb-4d08-b28b-0d2c26441915 tempest-HypervisorAdminNegativeTestJSON-1798361765 tempest-HypervisorAdminNegativeTestJSON-1798361765-project-admin] Returning 404 to user: Hypervisor with ID 'ee5f8fa7-3089-4df9-a5cc-021f34e95954' could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:50:17.025766 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ffb6d049-aebb-4d08-b28b-0d2c26441915 tempest-HypervisorAdminNegativeTestJSON-1798361765 tempest-HypervisorAdminNegativeTestJSON-1798361765-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/ee5f8fa7-3089-4df9-a5cc-021f34e95954" status: 404 len: 123 microversion: 2.1 time: 0.015440 Sep 24 20:50:17.044959 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 91/151] 10.222.0.52 () {58 vars in 1257 bytes} [Sat Sep 24 20:50:17 2022] GET /compute/v2.1/os-hypervisors/ee5f8fa7-3089-4df9-a5cc-021f34e95954 => generated 123 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:50:17.165354 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-30ef0d23-fac7-4c3e-bec3-5c5d59babe73 tempest-QuotaClassesAdminTestJSON-996949242 tempest-QuotaClassesAdminTestJSON-996949242-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.558615 Sep 24 20:50:17.168095 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 61/152] 10.222.0.52 () {60 vars in 1206 bytes} [Sat Sep 24 20:50:16 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:17.181413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-69cf816f-cb1f-4d57-b51c-8ff8903f0d06 tempest-QuotaClassesAdminTestJSON-996949242 tempest-QuotaClassesAdminTestJSON-996949242-project-admin] Calling method '.version_select at 0x7f4b0d183ca0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:17.206745 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-69cf816f-cb1f-4d57-b51c-8ff8903f0d06 tempest-QuotaClassesAdminTestJSON-996949242 tempest-QuotaClassesAdminTestJSON-996949242-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.030344 Sep 24 20:50:17.207694 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 92/153] 10.222.0.52 () {58 vars in 1185 bytes} [Sat Sep 24 20:50:17 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:17.222483 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8c72c860-be46-49b0-ab1f-fdfc48f07955 tempest-QuotaClassesAdminTestJSON-996949242 tempest-QuotaClassesAdminTestJSON-996949242-project-admin] Action: 'update', calling method: .version_select at 0x7f4b0d3c9d30>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:17.349681 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=15,nova_api:UPDATE=19 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:50:17.426000 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8c72c860-be46-49b0-ab1f-fdfc48f07955 tempest-QuotaClassesAdminTestJSON-996949242 tempest-QuotaClassesAdminTestJSON-996949242-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.209636 Sep 24 20:50:17.434704 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 62/154] 10.222.0.52 () {60 vars in 1206 bytes} [Sat Sep 24 20:50:17 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:17.465583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6bdebc52-ac55-478b-92ee-40d19c81061d tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:17.466509 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6bdebc52-ac55-478b-92ee-40d19c81061d tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] [instance: 650cae0b-7b94-4c33-a526-5cc80548c0db] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:17.483958 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6bdebc52-ac55-478b-92ee-40d19c81061d tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:17.484738 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6bdebc52-ac55-478b-92ee-40d19c81061d tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:17.485689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6bdebc52-ac55-478b-92ee-40d19c81061d tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:17.488101 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6bdebc52-ac55-478b-92ee-40d19c81061d tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:17.489754 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6bdebc52-ac55-478b-92ee-40d19c81061d tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:17.490400 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6bdebc52-ac55-478b-92ee-40d19c81061d tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:17.627179 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1e46232a-d0e1-4bcb-bf5e-f612904eab89 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:17.630251 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1e46232a-d0e1-4bcb-bf5e-f612904eab89 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:17.640989 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e46232a-d0e1-4bcb-bf5e-f612904eab89 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:17.643110 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e46232a-d0e1-4bcb-bf5e-f612904eab89 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:17.643526 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e46232a-d0e1-4bcb-bf5e-f612904eab89 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:17.644587 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e46232a-d0e1-4bcb-bf5e-f612904eab89 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:17.645211 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e46232a-d0e1-4bcb-bf5e-f612904eab89 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:17.645211 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e46232a-d0e1-4bcb-bf5e-f612904eab89 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:17.918314 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1e46232a-d0e1-4bcb-bf5e-f612904eab89 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:17.930104 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1e46232a-d0e1-4bcb-bf5e-f612904eab89 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1235 microversion: 2.1 time: 0.320279 Sep 24 20:50:17.933457 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 63/155] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:17 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1235 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:17.951067 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b500976c-cfea-4298-809a-d11f36d5be08 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:17.952654 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b500976c-cfea-4298-809a-d11f36d5be08 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:17.967809 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b500976c-cfea-4298-809a-d11f36d5be08 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:17.969825 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b500976c-cfea-4298-809a-d11f36d5be08 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:17.970525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b500976c-cfea-4298-809a-d11f36d5be08 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:17.973193 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b500976c-cfea-4298-809a-d11f36d5be08 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:17.973883 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6bdebc52-ac55-478b-92ee-40d19c81061d tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01bfb1e8464616aceb3b73c958eb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e62e74103b45cc81dfe7900c0baf5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:17.974704 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b500976c-cfea-4298-809a-d11f36d5be08 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:17.976128 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b500976c-cfea-4298-809a-d11f36d5be08 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:17.985137 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6bdebc52-ac55-478b-92ee-40d19c81061d tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] 10.222.0.52 "GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db" status: 200 len: 1336 microversion: 2.1 time: 0.523767 Sep 24 20:50:17.989545 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 93/156] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:17 2022] GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db => generated 1336 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:18.005575 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7ac2cfb7-cfdc-4267-a28d-c37e1b04e350 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:18.006610 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7ac2cfb7-cfdc-4267-a28d-c37e1b04e350 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 9b0e9940-f6ac-46d5-8898-1e4ba56119b3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:18.018049 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ac2cfb7-cfdc-4267-a28d-c37e1b04e350 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:18.022726 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ac2cfb7-cfdc-4267-a28d-c37e1b04e350 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:18.023418 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ac2cfb7-cfdc-4267-a28d-c37e1b04e350 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:18.024325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ac2cfb7-cfdc-4267-a28d-c37e1b04e350 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:18.025562 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ac2cfb7-cfdc-4267-a28d-c37e1b04e350 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:18.026914 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ac2cfb7-cfdc-4267-a28d-c37e1b04e350 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:18.315817 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7ac2cfb7-cfdc-4267-a28d-c37e1b04e350 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278977b201c48dda2d73823fbfe4833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a31be22cc451b92af447ed8d81242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:18.329444 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7ac2cfb7-cfdc-4267-a28d-c37e1b04e350 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3" status: 200 len: 1286 microversion: 2.1 time: 0.338587 Sep 24 20:50:18.334652 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 94/157] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:17 2022] GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3 => generated 1286 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:18.511008 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b500976c-cfea-4298-809a-d11f36d5be08 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8a91794144d73a8942f5c3bac8cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3800968cd944059a397e9c6b35f976d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:18.532391 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b500976c-cfea-4298-809a-d11f36d5be08 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1" status: 200 len: 1320 microversion: 2.1 time: 0.597515 Sep 24 20:50:18.550521 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 64/158] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:17 2022] GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 => generated 1320 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:18.961684 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7bd9509c-dc0a-4e96-b278-dc59652a0554 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:18.964354 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7bd9509c-dc0a-4e96-b278-dc59652a0554 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:18.977889 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7bd9509c-dc0a-4e96-b278-dc59652a0554 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:18.983916 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7bd9509c-dc0a-4e96-b278-dc59652a0554 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:18.984815 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7bd9509c-dc0a-4e96-b278-dc59652a0554 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:18.985926 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7bd9509c-dc0a-4e96-b278-dc59652a0554 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:18.987344 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7bd9509c-dc0a-4e96-b278-dc59652a0554 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:18.988144 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7bd9509c-dc0a-4e96-b278-dc59652a0554 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:19.009965 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dbe77c41-392e-4b52-a7ed-85d3dd31abba tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:19.011053 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dbe77c41-392e-4b52-a7ed-85d3dd31abba tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] [instance: 650cae0b-7b94-4c33-a526-5cc80548c0db] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:19.023030 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dbe77c41-392e-4b52-a7ed-85d3dd31abba tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:19.023678 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dbe77c41-392e-4b52-a7ed-85d3dd31abba tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:19.024222 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dbe77c41-392e-4b52-a7ed-85d3dd31abba tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:19.025310 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dbe77c41-392e-4b52-a7ed-85d3dd31abba tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:19.025997 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dbe77c41-392e-4b52-a7ed-85d3dd31abba tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:19.027288 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dbe77c41-392e-4b52-a7ed-85d3dd31abba tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:19.170489 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7bd9509c-dc0a-4e96-b278-dc59652a0554 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:19.185382 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7bd9509c-dc0a-4e96-b278-dc59652a0554 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1283 microversion: 2.1 time: 0.227317 Sep 24 20:50:19.186140 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 95/159] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:18 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1283 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:19.357213 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-91bc39f0-cacc-4850-b6b9-11a478fd2ee1 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:19.358013 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-91bc39f0-cacc-4850-b6b9-11a478fd2ee1 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 9b0e9940-f6ac-46d5-8898-1e4ba56119b3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:19.379171 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-91bc39f0-cacc-4850-b6b9-11a478fd2ee1 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:19.380031 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-91bc39f0-cacc-4850-b6b9-11a478fd2ee1 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:19.380694 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-91bc39f0-cacc-4850-b6b9-11a478fd2ee1 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:19.381618 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-91bc39f0-cacc-4850-b6b9-11a478fd2ee1 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:19.383076 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-91bc39f0-cacc-4850-b6b9-11a478fd2ee1 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:19.384596 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-91bc39f0-cacc-4850-b6b9-11a478fd2ee1 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:19.741368 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-91bc39f0-cacc-4850-b6b9-11a478fd2ee1 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278977b201c48dda2d73823fbfe4833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a31be22cc451b92af447ed8d81242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:19.751719 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-91bc39f0-cacc-4850-b6b9-11a478fd2ee1 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3" status: 200 len: 1334 microversion: 2.1 time: 0.398787 Sep 24 20:50:19.752899 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 96/160] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:19 2022] GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3 => generated 1334 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:50:19.758212 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-224c6f8d-4902-4a45-8785-ebcba57edc93 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:19.759086 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-224c6f8d-4902-4a45-8785-ebcba57edc93 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:19.768204 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-224c6f8d-4902-4a45-8785-ebcba57edc93 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:19.769441 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-224c6f8d-4902-4a45-8785-ebcba57edc93 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:19.770132 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-224c6f8d-4902-4a45-8785-ebcba57edc93 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:19.771044 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-224c6f8d-4902-4a45-8785-ebcba57edc93 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:19.771807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-224c6f8d-4902-4a45-8785-ebcba57edc93 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:19.772391 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-224c6f8d-4902-4a45-8785-ebcba57edc93 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:19.837647 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dbe77c41-392e-4b52-a7ed-85d3dd31abba tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01bfb1e8464616aceb3b73c958eb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e62e74103b45cc81dfe7900c0baf5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:19.850909 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dbe77c41-392e-4b52-a7ed-85d3dd31abba tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] 10.222.0.52 "GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db" status: 200 len: 1336 microversion: 2.1 time: 0.846206 Sep 24 20:50:19.852158 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 65/161] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:19 2022] GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db => generated 1336 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:20.209879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b75fdb81-8032-42b4-a7bb-61ce468b790e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:20.211398 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b75fdb81-8032-42b4-a7bb-61ce468b790e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:20.230710 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b75fdb81-8032-42b4-a7bb-61ce468b790e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:20.237225 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b75fdb81-8032-42b4-a7bb-61ce468b790e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:20.242739 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b75fdb81-8032-42b4-a7bb-61ce468b790e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:20.244886 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b75fdb81-8032-42b4-a7bb-61ce468b790e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:20.251558 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b75fdb81-8032-42b4-a7bb-61ce468b790e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:20.252165 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b75fdb81-8032-42b4-a7bb-61ce468b790e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:20.588349 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b75fdb81-8032-42b4-a7bb-61ce468b790e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:20.606796 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b75fdb81-8032-42b4-a7bb-61ce468b790e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1289 microversion: 2.1 time: 0.401523 Sep 24 20:50:20.624099 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-224c6f8d-4902-4a45-8785-ebcba57edc93 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8a91794144d73a8942f5c3bac8cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3800968cd944059a397e9c6b35f976d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:20.624755 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 66/162] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:20 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1289 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:20.627775 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-224c6f8d-4902-4a45-8785-ebcba57edc93 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1" status: 200 len: 1320 microversion: 2.1 time: 0.873497 Sep 24 20:50:20.628564 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 97/163] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:19 2022] GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 => generated 1320 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:20.779249 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-98771fcc-f42c-4ce8-829f-6666d713741c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:20.779872 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-98771fcc-f42c-4ce8-829f-6666d713741c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 9b0e9940-f6ac-46d5-8898-1e4ba56119b3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:20.789670 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98771fcc-f42c-4ce8-829f-6666d713741c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:20.790580 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98771fcc-f42c-4ce8-829f-6666d713741c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:20.791205 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98771fcc-f42c-4ce8-829f-6666d713741c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:20.792113 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98771fcc-f42c-4ce8-829f-6666d713741c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:20.792773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98771fcc-f42c-4ce8-829f-6666d713741c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:20.793705 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98771fcc-f42c-4ce8-829f-6666d713741c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:20.891689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b5d8e6cb-eb41-4ff5-9acb-3a13778ef412 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:20.892339 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b5d8e6cb-eb41-4ff5-9acb-3a13778ef412 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] [instance: 650cae0b-7b94-4c33-a526-5cc80548c0db] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:20.901926 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5d8e6cb-eb41-4ff5-9acb-3a13778ef412 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:20.902810 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5d8e6cb-eb41-4ff5-9acb-3a13778ef412 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:20.903494 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5d8e6cb-eb41-4ff5-9acb-3a13778ef412 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:20.906314 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5d8e6cb-eb41-4ff5-9acb-3a13778ef412 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:20.907170 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5d8e6cb-eb41-4ff5-9acb-3a13778ef412 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:20.907885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5d8e6cb-eb41-4ff5-9acb-3a13778ef412 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:20.984466 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-98771fcc-f42c-4ce8-829f-6666d713741c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278977b201c48dda2d73823fbfe4833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a31be22cc451b92af447ed8d81242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:20.997017 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-98771fcc-f42c-4ce8-829f-6666d713741c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3" status: 200 len: 1340 microversion: 2.1 time: 0.224598 Sep 24 20:50:21.023171 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 67/164] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:20 2022] GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3 => generated 1340 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:50:21.483953 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b5d8e6cb-eb41-4ff5-9acb-3a13778ef412 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01bfb1e8464616aceb3b73c958eb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e62e74103b45cc81dfe7900c0baf5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:21.495495 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b5d8e6cb-eb41-4ff5-9acb-3a13778ef412 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] 10.222.0.52 "GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db" status: 200 len: 1336 microversion: 2.1 time: 0.623815 Sep 24 20:50:21.496741 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 98/165] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:20 2022] GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db => generated 1336 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:50:21.646488 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dbd3ac17-8c06-40ad-bf97-94a7e6f7c172 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:21.647425 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dbd3ac17-8c06-40ad-bf97-94a7e6f7c172 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:21.655241 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dbd3ac17-8c06-40ad-bf97-94a7e6f7c172 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:21.655449 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2fee2c9a-1f79-469b-aebc-a7ead6cdf999 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:21.656157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2fee2c9a-1f79-469b-aebc-a7ead6cdf999 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:21.656768 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dbd3ac17-8c06-40ad-bf97-94a7e6f7c172 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:21.657414 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dbd3ac17-8c06-40ad-bf97-94a7e6f7c172 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:21.658344 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dbd3ac17-8c06-40ad-bf97-94a7e6f7c172 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:21.659058 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dbd3ac17-8c06-40ad-bf97-94a7e6f7c172 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:21.659708 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dbd3ac17-8c06-40ad-bf97-94a7e6f7c172 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:21.672451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2fee2c9a-1f79-469b-aebc-a7ead6cdf999 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:21.672970 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2fee2c9a-1f79-469b-aebc-a7ead6cdf999 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:21.673421 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2fee2c9a-1f79-469b-aebc-a7ead6cdf999 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:21.678436 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2fee2c9a-1f79-469b-aebc-a7ead6cdf999 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:21.678977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2fee2c9a-1f79-469b-aebc-a7ead6cdf999 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:21.679396 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2fee2c9a-1f79-469b-aebc-a7ead6cdf999 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:22.028085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dbd3ac17-8c06-40ad-bf97-94a7e6f7c172 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:22.038877 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dbd3ac17-8c06-40ad-bf97-94a7e6f7c172 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1289 microversion: 2.1 time: 0.398374 Sep 24 20:50:22.039463 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 68/166] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:21 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1289 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:22.051216 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9cbdda01-2159-4c36-b605-72a5ea224eee tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:22.051841 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9cbdda01-2159-4c36-b605-72a5ea224eee tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 9b0e9940-f6ac-46d5-8898-1e4ba56119b3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:22.075673 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9cbdda01-2159-4c36-b605-72a5ea224eee tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:22.076229 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9cbdda01-2159-4c36-b605-72a5ea224eee tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:22.076865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9cbdda01-2159-4c36-b605-72a5ea224eee tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:22.077818 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9cbdda01-2159-4c36-b605-72a5ea224eee tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:22.078285 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9cbdda01-2159-4c36-b605-72a5ea224eee tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:22.078740 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9cbdda01-2159-4c36-b605-72a5ea224eee tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:22.275890 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9cbdda01-2159-4c36-b605-72a5ea224eee tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278977b201c48dda2d73823fbfe4833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a31be22cc451b92af447ed8d81242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:22.286431 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9cbdda01-2159-4c36-b605-72a5ea224eee tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3" status: 200 len: 1340 microversion: 2.1 time: 0.245914 Sep 24 20:50:22.287282 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 69/167] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:22 2022] GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3 => generated 1340 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:22.432217 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2fee2c9a-1f79-469b-aebc-a7ead6cdf999 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8a91794144d73a8942f5c3bac8cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3800968cd944059a397e9c6b35f976d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:22.471798 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2fee2c9a-1f79-469b-aebc-a7ead6cdf999 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1" status: 200 len: 1320 microversion: 2.1 time: 0.818864 Sep 24 20:50:22.487381 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 99/168] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:21 2022] GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 => generated 1320 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:22.522104 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-eb809f25-744e-42c3-9c60-774fbeb85e72 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:22.523010 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-eb809f25-744e-42c3-9c60-774fbeb85e72 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] [instance: 650cae0b-7b94-4c33-a526-5cc80548c0db] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:22.533277 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb809f25-744e-42c3-9c60-774fbeb85e72 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:22.562723 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb809f25-744e-42c3-9c60-774fbeb85e72 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:22.563374 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb809f25-744e-42c3-9c60-774fbeb85e72 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:22.570481 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb809f25-744e-42c3-9c60-774fbeb85e72 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:22.576627 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb809f25-744e-42c3-9c60-774fbeb85e72 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:22.579249 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb809f25-744e-42c3-9c60-774fbeb85e72 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:23.020920 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-eb809f25-744e-42c3-9c60-774fbeb85e72 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01bfb1e8464616aceb3b73c958eb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e62e74103b45cc81dfe7900c0baf5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:23.035829 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-eb809f25-744e-42c3-9c60-774fbeb85e72 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] 10.222.0.52 "GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db" status: 200 len: 1336 microversion: 2.1 time: 0.518044 Sep 24 20:50:23.052302 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 70/169] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:22 2022] GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db => generated 1336 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:23.067804 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7d1c5dd8-2c7e-4ea2-91c6-74249f86065b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:23.068766 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7d1c5dd8-2c7e-4ea2-91c6-74249f86065b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:23.078451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-4b1a0eac-31bf-46bf-87d5-a790a829ab82 req-169791ab-e2a7-4bc9-9cb8-60e12cd28002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "650cae0b-7b94-4c33-a526-5cc80548c0db", "name": "network-vif-plugged", "status": "completed", "tag": "5f721dd0-8223-41cc-ad71-4ac5294e10ed"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:23.096387 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d1c5dd8-2c7e-4ea2-91c6-74249f86065b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:23.098588 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d1c5dd8-2c7e-4ea2-91c6-74249f86065b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:23.099983 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d1c5dd8-2c7e-4ea2-91c6-74249f86065b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:23.101266 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d1c5dd8-2c7e-4ea2-91c6-74249f86065b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:23.101473 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-4b1a0eac-31bf-46bf-87d5-a790a829ab82 req-169791ab-e2a7-4bc9-9cb8-60e12cd28002 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:23.102075 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-4b1a0eac-31bf-46bf-87d5-a790a829ab82 req-169791ab-e2a7-4bc9-9cb8-60e12cd28002 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:23.102662 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d1c5dd8-2c7e-4ea2-91c6-74249f86065b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:23.103202 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-4b1a0eac-31bf-46bf-87d5-a790a829ab82 req-169791ab-e2a7-4bc9-9cb8-60e12cd28002 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:23.106139 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d1c5dd8-2c7e-4ea2-91c6-74249f86065b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:23.128048 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-4b1a0eac-31bf-46bf-87d5-a790a829ab82 req-169791ab-e2a7-4bc9-9cb8-60e12cd28002 service nova] Creating event network-vif-plugged:5f721dd0-8223-41cc-ad71-4ac5294e10ed for instance 650cae0b-7b94-4c33-a526-5cc80548c0db on nch1-master-1 Sep 24 20:50:23.140247 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-4b1a0eac-31bf-46bf-87d5-a790a829ab82 req-169791ab-e2a7-4bc9-9cb8-60e12cd28002 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177614 Sep 24 20:50:23.145525 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 100/170] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:50:23.401419 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c6c6b5c3-ae71-4d19-bf0f-cb8c03ffd931 tempest-QuotasAdminTestV257-361241291 tempest-QuotasAdminTestV257-361241291-project-admin] Action: 'update', calling method: .version_select at 0x7f4b0d146f70>, body: {"quota_set": {"ram": "5120"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:23.511410 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6c6b5c3-ae71-4d19-bf0f-cb8c03ffd931 tempest-QuotasAdminTestV257-361241291 tempest-QuotasAdminTestV257-361241291-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:23.512588 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6c6b5c3-ae71-4d19-bf0f-cb8c03ffd931 tempest-QuotasAdminTestV257-361241291 tempest-QuotasAdminTestV257-361241291-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:23.514314 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6c6b5c3-ae71-4d19-bf0f-cb8c03ffd931 tempest-QuotasAdminTestV257-361241291 tempest-QuotasAdminTestV257-361241291-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:23.515680 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6c6b5c3-ae71-4d19-bf0f-cb8c03ffd931 tempest-QuotasAdminTestV257-361241291 tempest-QuotasAdminTestV257-361241291-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:23.516627 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6c6b5c3-ae71-4d19-bf0f-cb8c03ffd931 tempest-QuotasAdminTestV257-361241291 tempest-QuotasAdminTestV257-361241291-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:23.517400 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6c6b5c3-ae71-4d19-bf0f-cb8c03ffd931 tempest-QuotasAdminTestV257-361241291 tempest-QuotasAdminTestV257-361241291-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:23.655862 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7d1c5dd8-2c7e-4ea2-91c6-74249f86065b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:23.667122 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7d1c5dd8-2c7e-4ea2-91c6-74249f86065b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1331 microversion: 2.1 time: 0.603540 Sep 24 20:50:23.667825 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 71/171] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:23 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1331 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:50:23.678741 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f707de5b-06e5-424d-a7da-84547158313e tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:23.678741 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f707de5b-06e5-424d-a7da-84547158313e tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 9b0e9940-f6ac-46d5-8898-1e4ba56119b3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:23.678951 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c6c6b5c3-ae71-4d19-bf0f-cb8c03ffd931 tempest-QuotasAdminTestV257-361241291 tempest-QuotasAdminTestV257-361241291-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/bea627807de3458c9376652ac768daa8" status: 200 len: 148 microversion: 2.57 time: 0.462015 Sep 24 20:50:23.678951 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 101/172] 10.222.0.52 () {62 vars in 1303 bytes} [Sat Sep 24 20:50:23 2022] PUT /compute/v2.1/os-quota-sets/bea627807de3458c9376652ac768daa8 => generated 148 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:50:23.680136 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-25102cd7-45a9-489d-aeff-dd566ca4a856 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:23.680863 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-25102cd7-45a9-489d-aeff-dd566ca4a856 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:23.694201 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-25102cd7-45a9-489d-aeff-dd566ca4a856 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:23.696315 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f707de5b-06e5-424d-a7da-84547158313e tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:23.697284 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f707de5b-06e5-424d-a7da-84547158313e tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:23.698165 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f707de5b-06e5-424d-a7da-84547158313e tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:23.702585 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-25102cd7-45a9-489d-aeff-dd566ca4a856 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:23.703143 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-25102cd7-45a9-489d-aeff-dd566ca4a856 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:23.704037 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-25102cd7-45a9-489d-aeff-dd566ca4a856 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:23.704488 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f707de5b-06e5-424d-a7da-84547158313e tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:23.704872 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-25102cd7-45a9-489d-aeff-dd566ca4a856 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:23.705446 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-25102cd7-45a9-489d-aeff-dd566ca4a856 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:23.707149 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f707de5b-06e5-424d-a7da-84547158313e tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:23.708805 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f707de5b-06e5-424d-a7da-84547158313e tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:24.607035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f707de5b-06e5-424d-a7da-84547158313e tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278977b201c48dda2d73823fbfe4833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a31be22cc451b92af447ed8d81242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:24.621721 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f707de5b-06e5-424d-a7da-84547158313e tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3" status: 200 len: 1408 microversion: 2.1 time: 0.952700 Sep 24 20:50:24.629696 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 72/173] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:23 2022] GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3 => generated 1408 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:24.650608 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1ad22d57-e748-40fb-9cda-ba35c2af3cd3 tempest-QuotasAdminTestV257-361241291 tempest-QuotasAdminTestV257-361241291-project-admin] Calling method '.version_select at 0x7f4b0d4858b0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:24.653529 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-25102cd7-45a9-489d-aeff-dd566ca4a856 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8a91794144d73a8942f5c3bac8cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3800968cd944059a397e9c6b35f976d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:24.665912 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-25102cd7-45a9-489d-aeff-dd566ca4a856 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1" status: 200 len: 1320 microversion: 2.1 time: 0.989024 Sep 24 20:50:24.680354 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 102/174] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:23 2022] GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 => generated 1320 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:24.684827 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7ad74585-fb44-4029-bc8b-80008ecc8595 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:24.692716 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7ad74585-fb44-4029-bc8b-80008ecc8595 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] [instance: 650cae0b-7b94-4c33-a526-5cc80548c0db] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:24.707797 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ad74585-fb44-4029-bc8b-80008ecc8595 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:24.708289 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ad74585-fb44-4029-bc8b-80008ecc8595 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:24.708937 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ad74585-fb44-4029-bc8b-80008ecc8595 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:24.715581 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ad74585-fb44-4029-bc8b-80008ecc8595 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:24.716298 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ad74585-fb44-4029-bc8b-80008ecc8595 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:24.717746 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ad74585-fb44-4029-bc8b-80008ecc8595 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:24.782694 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1ad22d57-e748-40fb-9cda-ba35c2af3cd3 tempest-QuotasAdminTestV257-361241291 tempest-QuotasAdminTestV257-361241291-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:24.783421 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1ad22d57-e748-40fb-9cda-ba35c2af3cd3 tempest-QuotasAdminTestV257-361241291 tempest-QuotasAdminTestV257-361241291-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:24.784017 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1ad22d57-e748-40fb-9cda-ba35c2af3cd3 tempest-QuotasAdminTestV257-361241291 tempest-QuotasAdminTestV257-361241291-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:24.791532 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1ad22d57-e748-40fb-9cda-ba35c2af3cd3 tempest-QuotasAdminTestV257-361241291 tempest-QuotasAdminTestV257-361241291-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:24.792265 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1ad22d57-e748-40fb-9cda-ba35c2af3cd3 tempest-QuotasAdminTestV257-361241291 tempest-QuotasAdminTestV257-361241291-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:24.792865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1ad22d57-e748-40fb-9cda-ba35c2af3cd3 tempest-QuotasAdminTestV257-361241291 tempest-QuotasAdminTestV257-361241291-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:24.839534 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1ad22d57-e748-40fb-9cda-ba35c2af3cd3 tempest-QuotasAdminTestV257-361241291 tempest-QuotasAdminTestV257-361241291-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/bea627807de3458c9376652ac768daa8/detail" status: 200 len: 463 microversion: 2.57 time: 0.193024 Sep 24 20:50:24.843094 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 73/175] 10.222.0.52 () {60 vars in 1304 bytes} [Sat Sep 24 20:50:24 2022] GET /compute/v2.1/os-quota-sets/bea627807de3458c9376652ac768daa8/detail => generated 463 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:50:24.867306 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7a30efe3-2008-42a8-861b-037f80234fdf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:24.868202 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7a30efe3-2008-42a8-861b-037f80234fdf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:24.884874 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7a30efe3-2008-42a8-861b-037f80234fdf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:24.885654 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7a30efe3-2008-42a8-861b-037f80234fdf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:24.887803 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7a30efe3-2008-42a8-861b-037f80234fdf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:24.889115 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7a30efe3-2008-42a8-861b-037f80234fdf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:24.890624 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7a30efe3-2008-42a8-861b-037f80234fdf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:24.892993 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7a30efe3-2008-42a8-861b-037f80234fdf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:25.543925 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7ad74585-fb44-4029-bc8b-80008ecc8595 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01bfb1e8464616aceb3b73c958eb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e62e74103b45cc81dfe7900c0baf5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:25.554110 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7ad74585-fb44-4029-bc8b-80008ecc8595 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] 10.222.0.52 "GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db" status: 200 len: 1336 microversion: 2.1 time: 0.872918 Sep 24 20:50:25.567781 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 103/176] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:24 2022] GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db => generated 1336 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:25.572906 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-93f86e2b-ba05-4b63-843a-a7ae30404796 tempest-QuotasAdminTestV257-361241291 tempest-QuotasAdminTestV257-361241291-project-admin] Action: 'update', calling method: .version_select at 0x7f4b0cf95700>, body: {"quota_set": {"ram": "2048"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:25.714600 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93f86e2b-ba05-4b63-843a-a7ae30404796 tempest-QuotasAdminTestV257-361241291 tempest-QuotasAdminTestV257-361241291-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:25.716359 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93f86e2b-ba05-4b63-843a-a7ae30404796 tempest-QuotasAdminTestV257-361241291 tempest-QuotasAdminTestV257-361241291-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:25.718856 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93f86e2b-ba05-4b63-843a-a7ae30404796 tempest-QuotasAdminTestV257-361241291 tempest-QuotasAdminTestV257-361241291-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:25.721691 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93f86e2b-ba05-4b63-843a-a7ae30404796 tempest-QuotasAdminTestV257-361241291 tempest-QuotasAdminTestV257-361241291-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:25.722275 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93f86e2b-ba05-4b63-843a-a7ae30404796 tempest-QuotasAdminTestV257-361241291 tempest-QuotasAdminTestV257-361241291-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:25.724028 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93f86e2b-ba05-4b63-843a-a7ae30404796 tempest-QuotasAdminTestV257-361241291 tempest-QuotasAdminTestV257-361241291-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:25.843217 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7a30efe3-2008-42a8-861b-037f80234fdf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:25.853742 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93f86e2b-ba05-4b63-843a-a7ae30404796 tempest-QuotasAdminTestV257-361241291 tempest-QuotasAdminTestV257-361241291-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:25.854518 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93f86e2b-ba05-4b63-843a-a7ae30404796 tempest-QuotasAdminTestV257-361241291 tempest-QuotasAdminTestV257-361241291-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:25.859869 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7a30efe3-2008-42a8-861b-037f80234fdf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1331 microversion: 2.1 time: 1.004561 Sep 24 20:50:25.860054 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93f86e2b-ba05-4b63-843a-a7ae30404796 tempest-QuotasAdminTestV257-361241291 tempest-QuotasAdminTestV257-361241291-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:25.861309 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93f86e2b-ba05-4b63-843a-a7ae30404796 tempest-QuotasAdminTestV257-361241291 tempest-QuotasAdminTestV257-361241291-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:25.862210 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 74/177] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:24 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1331 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:25.862373 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93f86e2b-ba05-4b63-843a-a7ae30404796 tempest-QuotasAdminTestV257-361241291 tempest-QuotasAdminTestV257-361241291-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:25.863110 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93f86e2b-ba05-4b63-843a-a7ae30404796 tempest-QuotasAdminTestV257-361241291 tempest-QuotasAdminTestV257-361241291-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:25.888754 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-ca0a6461-47ce-45a7-b642-3f78b3589209 req-3c28c452-96da-4fa9-83a6-2be9486008bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c7ac6b8-6436-4f54-abad-8d782b4eb5e1", "name": "network-vif-plugged", "status": "completed", "tag": "62020081-009a-494e-a571-75ec298caf16"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:25.909351 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-ca0a6461-47ce-45a7-b642-3f78b3589209 req-3c28c452-96da-4fa9-83a6-2be9486008bc service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:25.911321 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-ca0a6461-47ce-45a7-b642-3f78b3589209 req-3c28c452-96da-4fa9-83a6-2be9486008bc service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:25.911930 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-ca0a6461-47ce-45a7-b642-3f78b3589209 req-3c28c452-96da-4fa9-83a6-2be9486008bc service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:25.934076 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:50:25.953529 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-ca0a6461-47ce-45a7-b642-3f78b3589209 req-3c28c452-96da-4fa9-83a6-2be9486008bc service nova] Creating event network-vif-plugged:62020081-009a-494e-a571-75ec298caf16 for instance 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 on nch2-master-1 Sep 24 20:50:25.954562 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-ca0a6461-47ce-45a7-b642-3f78b3589209 req-3c28c452-96da-4fa9-83a6-2be9486008bc service nova] Acquiring lock "compute-rpcapi-router" {{(pid=140517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 24 20:50:25.955248 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-ca0a6461-47ce-45a7-b642-3f78b3589209 req-3c28c452-96da-4fa9-83a6-2be9486008bc service nova] Acquired lock "compute-rpcapi-router" {{(pid=140517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 24 20:50:25.956598 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed7b996f-dc70-4e0f-a52b-8ee3a6955bfc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:25.957405 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed7b996f-dc70-4e0f-a52b-8ee3a6955bfc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:25.959619 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed7b996f-dc70-4e0f-a52b-8ee3a6955bfc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:25.960647 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed7b996f-dc70-4e0f-a52b-8ee3a6955bfc None None] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:25.961696 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed7b996f-dc70-4e0f-a52b-8ee3a6955bfc None None] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:25.962752 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed7b996f-dc70-4e0f-a52b-8ee3a6955bfc None None] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:25.977497 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.compute.rpcapi [None req-ed7b996f-dc70-4e0f-a52b-8ee3a6955bfc None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 24 20:50:25.979018 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed7b996f-dc70-4e0f-a52b-8ee3a6955bfc None None] Releasing lock "compute-rpcapi-router" {{(pid=140517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 24 20:50:26.017425 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ed7b996f-dc70-4e0f-a52b-8ee3a6955bfc None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140204 Sep 24 20:50:26.018289 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 75/178] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:26.029176 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-30280368-ff26-40a5-b415-aed0e93847c6 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:26.031390 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-30280368-ff26-40a5-b415-aed0e93847c6 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 9b0e9940-f6ac-46d5-8898-1e4ba56119b3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:26.040991 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30280368-ff26-40a5-b415-aed0e93847c6 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:26.042755 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-93f86e2b-ba05-4b63-843a-a7ae30404796 tempest-QuotasAdminTestV257-361241291 tempest-QuotasAdminTestV257-361241291-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/bea627807de3458c9376652ac768daa8?user_id=9929bcabada74355bb90f3b31590c07b" status: 200 len: 148 microversion: 2.57 time: 0.473515 Sep 24 20:50:26.047531 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30280368-ff26-40a5-b415-aed0e93847c6 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:26.048279 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30280368-ff26-40a5-b415-aed0e93847c6 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:26.049349 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30280368-ff26-40a5-b415-aed0e93847c6 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:26.049973 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30280368-ff26-40a5-b415-aed0e93847c6 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:26.050603 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30280368-ff26-40a5-b415-aed0e93847c6 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:26.052460 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 104/179] 10.222.0.52 () {62 vars in 1384 bytes} [Sat Sep 24 20:50:25 2022] PUT /compute/v2.1/os-quota-sets/bea627807de3458c9376652ac768daa8?user_id=9929bcabada74355bb90f3b31590c07b => generated 148 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:50:26.073846 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:50:26.083974 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2ee428c4-9e58-4375-b1c5-6ed97affc579 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:26.084616 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2ee428c4-9e58-4375-b1c5-6ed97affc579 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:26.107029 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2ee428c4-9e58-4375-b1c5-6ed97affc579 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:26.108191 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2ee428c4-9e58-4375-b1c5-6ed97affc579 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:26.108683 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2ee428c4-9e58-4375-b1c5-6ed97affc579 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:26.135111 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2ee428c4-9e58-4375-b1c5-6ed97affc579 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:26.137358 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2ee428c4-9e58-4375-b1c5-6ed97affc579 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:26.141480 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2ee428c4-9e58-4375-b1c5-6ed97affc579 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:26.893476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2ee428c4-9e58-4375-b1c5-6ed97affc579 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8a91794144d73a8942f5c3bac8cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3800968cd944059a397e9c6b35f976d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:26.907622 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2ee428c4-9e58-4375-b1c5-6ed97affc579 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1" status: 200 len: 1320 microversion: 2.1 time: 0.853950 Sep 24 20:50:26.908479 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 105/180] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:26 2022] GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 => generated 1320 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:26.922780 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0dfc88c5-df46-4757-83c4-0c35f55925e1 tempest-QuotasAdminTestV257-361241291 tempest-QuotasAdminTestV257-361241291-project-admin] Calling method '.version_select at 0x7f4b0cf4c8b0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:26.949070 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-30280368-ff26-40a5-b415-aed0e93847c6 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278977b201c48dda2d73823fbfe4833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a31be22cc451b92af447ed8d81242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:26.962208 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-30280368-ff26-40a5-b415-aed0e93847c6 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3" status: 200 len: 1408 microversion: 2.1 time: 0.939747 Sep 24 20:50:26.963136 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 76/181] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:26 2022] GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3 => generated 1408 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:26.968148 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-81d3ea6a-f793-4f28-853d-191ebe85ea7f tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:26.972908 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-81d3ea6a-f793-4f28-853d-191ebe85ea7f tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] [instance: 650cae0b-7b94-4c33-a526-5cc80548c0db] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:26.989181 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-81d3ea6a-f793-4f28-853d-191ebe85ea7f tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:26.990087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-81d3ea6a-f793-4f28-853d-191ebe85ea7f tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:26.990853 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-81d3ea6a-f793-4f28-853d-191ebe85ea7f tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:26.991845 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-81d3ea6a-f793-4f28-853d-191ebe85ea7f tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:26.992774 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-81d3ea6a-f793-4f28-853d-191ebe85ea7f tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:26.993694 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-81d3ea6a-f793-4f28-853d-191ebe85ea7f tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:27.066925 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0dfc88c5-df46-4757-83c4-0c35f55925e1 tempest-QuotasAdminTestV257-361241291 tempest-QuotasAdminTestV257-361241291-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/bea627807de3458c9376652ac768daa8?user_id=9929bcabada74355bb90f3b31590c07b" status: 200 len: 190 microversion: 2.57 time: 0.156738 Sep 24 20:50:27.075505 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 106/182] 10.222.0.52 () {60 vars in 1364 bytes} [Sat Sep 24 20:50:26 2022] GET /compute/v2.1/os-quota-sets/bea627807de3458c9376652ac768daa8?user_id=9929bcabada74355bb90f3b31590c07b => generated 190 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:50:27.093261 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-11ccc8c3-3772-40c3-a053-a87d88f12f11 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:27.094126 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-11ccc8c3-3772-40c3-a053-a87d88f12f11 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:27.102727 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-11ccc8c3-3772-40c3-a053-a87d88f12f11 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:27.103231 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-11ccc8c3-3772-40c3-a053-a87d88f12f11 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:27.103880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-11ccc8c3-3772-40c3-a053-a87d88f12f11 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:27.104596 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-11ccc8c3-3772-40c3-a053-a87d88f12f11 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:27.105051 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-11ccc8c3-3772-40c3-a053-a87d88f12f11 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:27.105661 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-11ccc8c3-3772-40c3-a053-a87d88f12f11 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:27.112576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:50:27.947590 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-11ccc8c3-3772-40c3-a053-a87d88f12f11 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:27.958304 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-11ccc8c3-3772-40c3-a053-a87d88f12f11 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1331 microversion: 2.1 time: 0.879915 Sep 24 20:50:27.958859 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 107/183] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:27 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1331 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:27.974344 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-bcfb00e7-e9c3-4c64-aa72-32cd50beeab1 req-c8363f5d-cd5e-4fb1-92ac-d131b36a5c49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b0e9940-f6ac-46d5-8898-1e4ba56119b3", "tag": "bd5ba8f6-52ce-4952-b823-1baad516098d"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:27.990896 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-bcfb00e7-e9c3-4c64-aa72-32cd50beeab1 req-c8363f5d-cd5e-4fb1-92ac-d131b36a5c49 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:27.994343 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-bcfb00e7-e9c3-4c64-aa72-32cd50beeab1 req-c8363f5d-cd5e-4fb1-92ac-d131b36a5c49 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:27.995090 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-bcfb00e7-e9c3-4c64-aa72-32cd50beeab1 req-c8363f5d-cd5e-4fb1-92ac-d131b36a5c49 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:28.034479 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-bcfb00e7-e9c3-4c64-aa72-32cd50beeab1 req-c8363f5d-cd5e-4fb1-92ac-d131b36a5c49 service nova] Creating event network-changed:bd5ba8f6-52ce-4952-b823-1baad516098d for instance 9b0e9940-f6ac-46d5-8898-1e4ba56119b3 on nch1-master-1 Sep 24 20:50:28.064805 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-bcfb00e7-e9c3-4c64-aa72-32cd50beeab1 req-c8363f5d-cd5e-4fb1-92ac-d131b36a5c49 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100224 Sep 24 20:50:28.070739 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 108/184] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:28.088779 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f02c59a7-664e-4277-ac0a-92e6b7ba54eb tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:28.089495 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f02c59a7-664e-4277-ac0a-92e6b7ba54eb tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:28.119628 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f02c59a7-664e-4277-ac0a-92e6b7ba54eb tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:28.120128 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f02c59a7-664e-4277-ac0a-92e6b7ba54eb tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:28.120561 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f02c59a7-664e-4277-ac0a-92e6b7ba54eb tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:28.121275 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f02c59a7-664e-4277-ac0a-92e6b7ba54eb tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:28.121726 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f02c59a7-664e-4277-ac0a-92e6b7ba54eb tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:28.122153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f02c59a7-664e-4277-ac0a-92e6b7ba54eb tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:28.187714 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-81d3ea6a-f793-4f28-853d-191ebe85ea7f tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01bfb1e8464616aceb3b73c958eb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e62e74103b45cc81dfe7900c0baf5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:28.196154 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-81d3ea6a-f793-4f28-853d-191ebe85ea7f tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] 10.222.0.52 "GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db" status: 200 len: 1486 microversion: 2.1 time: 1.231797 Sep 24 20:50:28.212675 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 77/185] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:26 2022] GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db => generated 1486 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:28.228589 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3ecb3155-20b0-4e5f-9ca9-461d65f7e4a6 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:28.229692 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3ecb3155-20b0-4e5f-9ca9-461d65f7e4a6 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 9b0e9940-f6ac-46d5-8898-1e4ba56119b3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:28.256501 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ecb3155-20b0-4e5f-9ca9-461d65f7e4a6 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:28.258242 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ecb3155-20b0-4e5f-9ca9-461d65f7e4a6 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:28.267218 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ecb3155-20b0-4e5f-9ca9-461d65f7e4a6 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:28.268342 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ecb3155-20b0-4e5f-9ca9-461d65f7e4a6 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:28.271692 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ecb3155-20b0-4e5f-9ca9-461d65f7e4a6 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:28.272588 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ecb3155-20b0-4e5f-9ca9-461d65f7e4a6 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:28.713062 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3ecb3155-20b0-4e5f-9ca9-461d65f7e4a6 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278977b201c48dda2d73823fbfe4833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a31be22cc451b92af447ed8d81242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:28.723358 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3ecb3155-20b0-4e5f-9ca9-461d65f7e4a6 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3" status: 200 len: 1408 microversion: 2.1 time: 0.509265 Sep 24 20:50:28.728817 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 78/186] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:28 2022] GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3 => generated 1408 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:28.734453 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e11b45f0-a14c-4ed0-89ff-13d3f83c73f1 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:28.737289 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e11b45f0-a14c-4ed0-89ff-13d3f83c73f1 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] [instance: 650cae0b-7b94-4c33-a526-5cc80548c0db] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:28.755116 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e11b45f0-a14c-4ed0-89ff-13d3f83c73f1 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:28.756002 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e11b45f0-a14c-4ed0-89ff-13d3f83c73f1 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:28.756859 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e11b45f0-a14c-4ed0-89ff-13d3f83c73f1 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:28.757930 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e11b45f0-a14c-4ed0-89ff-13d3f83c73f1 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:28.758745 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e11b45f0-a14c-4ed0-89ff-13d3f83c73f1 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:28.759387 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e11b45f0-a14c-4ed0-89ff-13d3f83c73f1 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:29.029652 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f02c59a7-664e-4277-ac0a-92e6b7ba54eb tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8a91794144d73a8942f5c3bac8cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3800968cd944059a397e9c6b35f976d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:29.042771 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f02c59a7-664e-4277-ac0a-92e6b7ba54eb tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1" status: 200 len: 1320 microversion: 2.1 time: 0.968263 Sep 24 20:50:29.044070 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 109/187] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:28 2022] GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 => generated 1320 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:29.057061 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3cd0fc39-7cb4-42df-8034-492d0d7fb5fc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:29.057848 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3cd0fc39-7cb4-42df-8034-492d0d7fb5fc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:29.071787 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3cd0fc39-7cb4-42df-8034-492d0d7fb5fc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:29.083350 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3cd0fc39-7cb4-42df-8034-492d0d7fb5fc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:29.083807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3cd0fc39-7cb4-42df-8034-492d0d7fb5fc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:29.084570 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3cd0fc39-7cb4-42df-8034-492d0d7fb5fc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:29.085033 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3cd0fc39-7cb4-42df-8034-492d0d7fb5fc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:29.085463 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3cd0fc39-7cb4-42df-8034-492d0d7fb5fc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:29.817756 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3cd0fc39-7cb4-42df-8034-492d0d7fb5fc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:29.830623 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3cd0fc39-7cb4-42df-8034-492d0d7fb5fc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1331 microversion: 2.1 time: 0.784962 Sep 24 20:50:29.831413 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 110/188] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:29 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1331 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:29.843574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f79e1e01-b39f-4373-a696-645eed71801e tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:29.845366 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f79e1e01-b39f-4373-a696-645eed71801e tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 9b0e9940-f6ac-46d5-8898-1e4ba56119b3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:29.863063 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f79e1e01-b39f-4373-a696-645eed71801e tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:29.866333 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f79e1e01-b39f-4373-a696-645eed71801e tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:29.867150 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f79e1e01-b39f-4373-a696-645eed71801e tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:29.877308 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f79e1e01-b39f-4373-a696-645eed71801e tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:29.878086 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f79e1e01-b39f-4373-a696-645eed71801e tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:29.881197 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f79e1e01-b39f-4373-a696-645eed71801e tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:30.194331 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e11b45f0-a14c-4ed0-89ff-13d3f83c73f1 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db" status: 200 len: 1637 microversion: 2.1 time: 1.463372 Sep 24 20:50:30.195812 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 79/189] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:28 2022] GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db => generated 1637 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:30.203540 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d3f6e137-773b-4838-8fd8-4a1f71ca9f44 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:30.206958 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d3f6e137-773b-4838-8fd8-4a1f71ca9f44 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:30.218266 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3f6e137-773b-4838-8fd8-4a1f71ca9f44 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:30.219063 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3f6e137-773b-4838-8fd8-4a1f71ca9f44 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:30.220075 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3f6e137-773b-4838-8fd8-4a1f71ca9f44 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:30.221140 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3f6e137-773b-4838-8fd8-4a1f71ca9f44 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:30.221783 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3f6e137-773b-4838-8fd8-4a1f71ca9f44 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:30.224346 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3f6e137-773b-4838-8fd8-4a1f71ca9f44 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:30.516598 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f79e1e01-b39f-4373-a696-645eed71801e tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278977b201c48dda2d73823fbfe4833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a31be22cc451b92af447ed8d81242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:30.532013 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f79e1e01-b39f-4373-a696-645eed71801e tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3" status: 200 len: 1408 microversion: 2.1 time: 0.696357 Sep 24 20:50:30.544409 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 111/190] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:29 2022] GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3 => generated 1408 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:30.563130 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e43197c7-c8b2-43e5-af0a-9de48a042f48 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:30.566151 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e43197c7-c8b2-43e5-af0a-9de48a042f48 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] [instance: 650cae0b-7b94-4c33-a526-5cc80548c0db] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:30.580183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e43197c7-c8b2-43e5-af0a-9de48a042f48 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:30.580689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e43197c7-c8b2-43e5-af0a-9de48a042f48 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:30.581134 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e43197c7-c8b2-43e5-af0a-9de48a042f48 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:30.581861 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e43197c7-c8b2-43e5-af0a-9de48a042f48 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:30.582585 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e43197c7-c8b2-43e5-af0a-9de48a042f48 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:30.588619 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e43197c7-c8b2-43e5-af0a-9de48a042f48 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:30.636372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e43197c7-c8b2-43e5-af0a-9de48a042f48 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] [instance: 650cae0b-7b94-4c33-a526-5cc80548c0db] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:50:30.800318 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e43197c7-c8b2-43e5-af0a-9de48a042f48 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] 10.222.0.52 "DELETE /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db" status: 204 len: 0 microversion: 2.1 time: 0.252392 Sep 24 20:50:30.804684 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 112/191] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:50:30 2022] DELETE /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:50:30.813881 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-c64e48eb-b875-4514-94bd-1c9505987297 req-3647da8a-f45b-4fa6-8ee9-9d853d931536 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f389d01c-08ec-42e6-81a1-85aedcdfe42e", "tag": "d104313c-4d9a-4ffb-8015-0f9ee3bfbcb1"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:30.824697 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c64e48eb-b875-4514-94bd-1c9505987297 req-3647da8a-f45b-4fa6-8ee9-9d853d931536 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:30.825457 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c64e48eb-b875-4514-94bd-1c9505987297 req-3647da8a-f45b-4fa6-8ee9-9d853d931536 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:30.826086 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c64e48eb-b875-4514-94bd-1c9505987297 req-3647da8a-f45b-4fa6-8ee9-9d853d931536 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:30.838976 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-c64e48eb-b875-4514-94bd-1c9505987297 req-3647da8a-f45b-4fa6-8ee9-9d853d931536 service nova] Creating event network-changed:d104313c-4d9a-4ffb-8015-0f9ee3bfbcb1 for instance f389d01c-08ec-42e6-81a1-85aedcdfe42e on nch1-master-1 Sep 24 20:50:30.845184 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-c64e48eb-b875-4514-94bd-1c9505987297 req-3647da8a-f45b-4fa6-8ee9-9d853d931536 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038661 Sep 24 20:50:30.845780 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 113/192] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:30.851335 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a27fbfc5-38f7-4edb-8699-4060a5460b5b tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:30.852236 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a27fbfc5-38f7-4edb-8699-4060a5460b5b tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] [instance: 650cae0b-7b94-4c33-a526-5cc80548c0db] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:30.859425 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a27fbfc5-38f7-4edb-8699-4060a5460b5b tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:30.860145 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a27fbfc5-38f7-4edb-8699-4060a5460b5b tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:30.860735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a27fbfc5-38f7-4edb-8699-4060a5460b5b tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:30.861607 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a27fbfc5-38f7-4edb-8699-4060a5460b5b tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:30.862228 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a27fbfc5-38f7-4edb-8699-4060a5460b5b tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:30.862824 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a27fbfc5-38f7-4edb-8699-4060a5460b5b tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:30.970888 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d3f6e137-773b-4838-8fd8-4a1f71ca9f44 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8a91794144d73a8942f5c3bac8cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3800968cd944059a397e9c6b35f976d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:30.984353 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d3f6e137-773b-4838-8fd8-4a1f71ca9f44 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1" status: 200 len: 1470 microversion: 2.1 time: 0.786400 Sep 24 20:50:30.984751 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 80/193] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:30 2022] GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 => generated 1470 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:30.990076 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-877246c1-d964-4b61-a45a-052163222a64 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:30.990843 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-877246c1-d964-4b61-a45a-052163222a64 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:30.997775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-877246c1-d964-4b61-a45a-052163222a64 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:30.998309 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-877246c1-d964-4b61-a45a-052163222a64 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:30.998960 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-877246c1-d964-4b61-a45a-052163222a64 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:30.999706 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-877246c1-d964-4b61-a45a-052163222a64 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:31.000168 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-877246c1-d964-4b61-a45a-052163222a64 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:31.000623 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-877246c1-d964-4b61-a45a-052163222a64 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:31.293064 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a27fbfc5-38f7-4edb-8699-4060a5460b5b tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01bfb1e8464616aceb3b73c958eb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e62e74103b45cc81dfe7900c0baf5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:31.309193 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a27fbfc5-38f7-4edb-8699-4060a5460b5b tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] 10.222.0.52 "GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db" status: 200 len: 1492 microversion: 2.1 time: 0.457378 Sep 24 20:50:31.324163 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 114/194] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:30 2022] GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db => generated 1492 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:31.421184 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-877246c1-d964-4b61-a45a-052163222a64 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:31.436243 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-877246c1-d964-4b61-a45a-052163222a64 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1331 microversion: 2.1 time: 0.448680 Sep 24 20:50:31.438538 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 81/195] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:30 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1331 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:31.555619 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-759678ba-1521-4699-a93a-8eeb49e34791 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:31.556921 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-759678ba-1521-4699-a93a-8eeb49e34791 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 9b0e9940-f6ac-46d5-8898-1e4ba56119b3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:31.570586 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-759678ba-1521-4699-a93a-8eeb49e34791 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:31.571508 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-759678ba-1521-4699-a93a-8eeb49e34791 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:31.574880 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-759678ba-1521-4699-a93a-8eeb49e34791 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:31.577216 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-759678ba-1521-4699-a93a-8eeb49e34791 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:31.580002 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-759678ba-1521-4699-a93a-8eeb49e34791 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:31.580579 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-759678ba-1521-4699-a93a-8eeb49e34791 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:31.862220 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-759678ba-1521-4699-a93a-8eeb49e34791 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278977b201c48dda2d73823fbfe4833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a31be22cc451b92af447ed8d81242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:31.874350 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-759678ba-1521-4699-a93a-8eeb49e34791 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3" status: 200 len: 1408 microversion: 2.1 time: 0.324027 Sep 24 20:50:31.875980 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 82/196] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:31 2022] GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3 => generated 1408 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:31.889841 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d88a29b1-3903-430b-8b8d-5a1702cf4fbe tempest-DeleteServersAdminTestJSON-1230208415 tempest-DeleteServersAdminTestJSON-1230208415-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:31.890423 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d88a29b1-3903-430b-8b8d-5a1702cf4fbe tempest-DeleteServersAdminTestJSON-1230208415 tempest-DeleteServersAdminTestJSON-1230208415-project-admin] [instance: 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:31.909093 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d88a29b1-3903-430b-8b8d-5a1702cf4fbe tempest-DeleteServersAdminTestJSON-1230208415 tempest-DeleteServersAdminTestJSON-1230208415-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:31.909464 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d88a29b1-3903-430b-8b8d-5a1702cf4fbe tempest-DeleteServersAdminTestJSON-1230208415 tempest-DeleteServersAdminTestJSON-1230208415-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:31.910179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d88a29b1-3903-430b-8b8d-5a1702cf4fbe tempest-DeleteServersAdminTestJSON-1230208415 tempest-DeleteServersAdminTestJSON-1230208415-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:31.910782 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d88a29b1-3903-430b-8b8d-5a1702cf4fbe tempest-DeleteServersAdminTestJSON-1230208415 tempest-DeleteServersAdminTestJSON-1230208415-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:31.911505 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d88a29b1-3903-430b-8b8d-5a1702cf4fbe tempest-DeleteServersAdminTestJSON-1230208415 tempest-DeleteServersAdminTestJSON-1230208415-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:31.912171 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d88a29b1-3903-430b-8b8d-5a1702cf4fbe tempest-DeleteServersAdminTestJSON-1230208415 tempest-DeleteServersAdminTestJSON-1230208415-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:32.066892 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d88a29b1-3903-430b-8b8d-5a1702cf4fbe tempest-DeleteServersAdminTestJSON-1230208415 tempest-DeleteServersAdminTestJSON-1230208415-project-admin] [instance: 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:50:32.272835 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d88a29b1-3903-430b-8b8d-5a1702cf4fbe tempest-DeleteServersAdminTestJSON-1230208415 tempest-DeleteServersAdminTestJSON-1230208415-project-admin] 10.222.0.52 "DELETE /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1" status: 204 len: 0 microversion: 2.1 time: 0.947099 Sep 24 20:50:32.286316 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 115/197] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:50:31 2022] DELETE /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 => generated 0 bytes in 956 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:50:32.290718 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-229f73fd-a500-4d2d-9960-b42c592d5ca7 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:32.296213 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-229f73fd-a500-4d2d-9960-b42c592d5ca7 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:32.310587 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-229f73fd-a500-4d2d-9960-b42c592d5ca7 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:32.311167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-229f73fd-a500-4d2d-9960-b42c592d5ca7 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:32.311809 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-229f73fd-a500-4d2d-9960-b42c592d5ca7 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:32.312714 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-229f73fd-a500-4d2d-9960-b42c592d5ca7 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:32.313337 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-229f73fd-a500-4d2d-9960-b42c592d5ca7 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:32.313817 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-229f73fd-a500-4d2d-9960-b42c592d5ca7 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:32.344121 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ad56bc7f-ec09-425e-944b-cee7a605afec tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:32.348426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ad56bc7f-ec09-425e-944b-cee7a605afec tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] [instance: 650cae0b-7b94-4c33-a526-5cc80548c0db] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:32.383631 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad56bc7f-ec09-425e-944b-cee7a605afec tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:32.384275 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad56bc7f-ec09-425e-944b-cee7a605afec tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:32.384816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad56bc7f-ec09-425e-944b-cee7a605afec tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:32.385628 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad56bc7f-ec09-425e-944b-cee7a605afec tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:32.386156 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad56bc7f-ec09-425e-944b-cee7a605afec tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:32.389009 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad56bc7f-ec09-425e-944b-cee7a605afec tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:32.787523 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ad56bc7f-ec09-425e-944b-cee7a605afec tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01bfb1e8464616aceb3b73c958eb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e62e74103b45cc81dfe7900c0baf5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:32.800416 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ad56bc7f-ec09-425e-944b-cee7a605afec tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] 10.222.0.52 "GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db" status: 200 len: 1492 microversion: 2.1 time: 0.464577 Sep 24 20:50:32.802548 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 116/198] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:32 2022] GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db => generated 1492 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:50:32.808191 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-229f73fd-a500-4d2d-9960-b42c592d5ca7 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8a91794144d73a8942f5c3bac8cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3800968cd944059a397e9c6b35f976d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:32.809677 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a235d665-aa4f-4b69-8d12-7d42d987a2de tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:32.811086 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a235d665-aa4f-4b69-8d12-7d42d987a2de tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:32.824525 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-229f73fd-a500-4d2d-9960-b42c592d5ca7 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1" status: 200 len: 1476 microversion: 2.1 time: 0.537996 Sep 24 20:50:32.838569 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a235d665-aa4f-4b69-8d12-7d42d987a2de tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:32.838569 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a235d665-aa4f-4b69-8d12-7d42d987a2de tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:32.838569 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a235d665-aa4f-4b69-8d12-7d42d987a2de tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:32.838569 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a235d665-aa4f-4b69-8d12-7d42d987a2de tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:32.838994 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a235d665-aa4f-4b69-8d12-7d42d987a2de tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:32.839082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a235d665-aa4f-4b69-8d12-7d42d987a2de tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:32.840578 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 83/199] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:32 2022] GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 => generated 1476 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:32.904402 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3350d5b6-eaaa-4872-94cd-c3636f89badc tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:32.905366 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3350d5b6-eaaa-4872-94cd-c3636f89badc tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 9b0e9940-f6ac-46d5-8898-1e4ba56119b3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:32.915732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3350d5b6-eaaa-4872-94cd-c3636f89badc tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:32.921930 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3350d5b6-eaaa-4872-94cd-c3636f89badc tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:32.922894 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3350d5b6-eaaa-4872-94cd-c3636f89badc tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:32.923819 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3350d5b6-eaaa-4872-94cd-c3636f89badc tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:32.925210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3350d5b6-eaaa-4872-94cd-c3636f89badc tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:32.931242 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3350d5b6-eaaa-4872-94cd-c3636f89badc tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:33.239065 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3350d5b6-eaaa-4872-94cd-c3636f89badc tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278977b201c48dda2d73823fbfe4833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a31be22cc451b92af447ed8d81242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:33.242164 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a235d665-aa4f-4b69-8d12-7d42d987a2de tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:33.251229 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3350d5b6-eaaa-4872-94cd-c3636f89badc tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3" status: 200 len: 1408 microversion: 2.1 time: 0.353309 Sep 24 20:50:33.252212 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a235d665-aa4f-4b69-8d12-7d42d987a2de tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1331 microversion: 2.1 time: 0.445704 Sep 24 20:50:33.252586 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 84/200] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:32 2022] GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3 => generated 1408 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:33.266591 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 117/201] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:32 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1331 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:33.825845 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-174adf15-1dac-48f2-8228-a907066ce8d2 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:33.827323 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-174adf15-1dac-48f2-8228-a907066ce8d2 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] [instance: 650cae0b-7b94-4c33-a526-5cc80548c0db] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:33.837545 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-174adf15-1dac-48f2-8228-a907066ce8d2 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:33.839833 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-174adf15-1dac-48f2-8228-a907066ce8d2 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:33.840447 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-174adf15-1dac-48f2-8228-a907066ce8d2 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:33.843835 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-174adf15-1dac-48f2-8228-a907066ce8d2 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:33.844754 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-174adf15-1dac-48f2-8228-a907066ce8d2 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:33.845298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-174adf15-1dac-48f2-8228-a907066ce8d2 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:33.851940 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ec526555-3ea8-4163-b5a4-5bfba95f1196 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:33.852762 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ec526555-3ea8-4163-b5a4-5bfba95f1196 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:33.868339 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ec526555-3ea8-4163-b5a4-5bfba95f1196 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:33.870420 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ec526555-3ea8-4163-b5a4-5bfba95f1196 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:33.871077 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ec526555-3ea8-4163-b5a4-5bfba95f1196 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:33.873917 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ec526555-3ea8-4163-b5a4-5bfba95f1196 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:33.875212 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ec526555-3ea8-4163-b5a4-5bfba95f1196 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:33.878412 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ec526555-3ea8-4163-b5a4-5bfba95f1196 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:34.396945 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-174adf15-1dac-48f2-8228-a907066ce8d2 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01bfb1e8464616aceb3b73c958eb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e62e74103b45cc81dfe7900c0baf5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:34.407325 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-174adf15-1dac-48f2-8228-a907066ce8d2 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] 10.222.0.52 "GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db" status: 200 len: 1492 microversion: 2.1 time: 0.585659 Sep 24 20:50:34.409375 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 85/202] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:33 2022] GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db => generated 1492 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:34.531132 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ec526555-3ea8-4163-b5a4-5bfba95f1196 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8a91794144d73a8942f5c3bac8cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3800968cd944059a397e9c6b35f976d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:34.542872 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ec526555-3ea8-4163-b5a4-5bfba95f1196 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1" status: 200 len: 1476 microversion: 2.1 time: 0.692668 Sep 24 20:50:34.546336 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 118/203] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:33 2022] GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 => generated 1476 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:50:34.558199 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-14136d3e-ba24-4848-b484-83a5b7417153 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:34.561551 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-14136d3e-ba24-4848-b484-83a5b7417153 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:34.577737 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-14136d3e-ba24-4848-b484-83a5b7417153 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:34.581908 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-14136d3e-ba24-4848-b484-83a5b7417153 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:34.582675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-14136d3e-ba24-4848-b484-83a5b7417153 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:34.584239 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-14136d3e-ba24-4848-b484-83a5b7417153 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:34.584880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-14136d3e-ba24-4848-b484-83a5b7417153 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:34.585460 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-14136d3e-ba24-4848-b484-83a5b7417153 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:34.728236 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-58f02e77-6d54-4fb0-a649-91ccdc6e394b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1363983661", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": "none"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:34.781925 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=50,nova_cell0:UPDATE=12 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:50:34.831423 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-58f02e77-6d54-4fb0-a649-91ccdc6e394b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:50:34.832495 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-58f02e77-6d54-4fb0-a649-91ccdc6e394b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:50:34.833132 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-58f02e77-6d54-4fb0-a649-91ccdc6e394b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:50:34.833744 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-58f02e77-6d54-4fb0-a649-91ccdc6e394b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:50:34.835451 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-58f02e77-6d54-4fb0-a649-91ccdc6e394b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:50:34.857906 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58f02e77-6d54-4fb0-a649-91ccdc6e394b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:34.858689 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58f02e77-6d54-4fb0-a649-91ccdc6e394b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:34.859453 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58f02e77-6d54-4fb0-a649-91ccdc6e394b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:34.860567 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58f02e77-6d54-4fb0-a649-91ccdc6e394b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:34.861580 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58f02e77-6d54-4fb0-a649-91ccdc6e394b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:34.864103 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-14136d3e-ba24-4848-b484-83a5b7417153 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:34.867117 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58f02e77-6d54-4fb0-a649-91ccdc6e394b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:34.876907 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-14136d3e-ba24-4848-b484-83a5b7417153 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1331 microversion: 2.1 time: 0.329036 Sep 24 20:50:34.877698 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 119/204] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:34 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1331 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:34.893601 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c49624ca-b8ae-43dd-a190-a87c09a2b540 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:34.894437 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c49624ca-b8ae-43dd-a190-a87c09a2b540 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 9b0e9940-f6ac-46d5-8898-1e4ba56119b3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:34.908870 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c49624ca-b8ae-43dd-a190-a87c09a2b540 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:34.912758 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c49624ca-b8ae-43dd-a190-a87c09a2b540 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:34.913748 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c49624ca-b8ae-43dd-a190-a87c09a2b540 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:34.914679 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c49624ca-b8ae-43dd-a190-a87c09a2b540 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:34.915260 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c49624ca-b8ae-43dd-a190-a87c09a2b540 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:34.915800 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c49624ca-b8ae-43dd-a190-a87c09a2b540 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:34.928618 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-58f02e77-6d54-4fb0-a649-91ccdc6e394b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Getting quotas for project 899574bf215744b29695dc6128d4c8dd. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:50:34.943749 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-58f02e77-6d54-4fb0-a649-91ccdc6e394b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Getting quotas for user 8df2631dab974889a95bed3f863c0219 and project 899574bf215744b29695dc6128d4c8dd. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:50:34.961013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-58f02e77-6d54-4fb0-a649-91ccdc6e394b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:50:34.963461 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-58f02e77-6d54-4fb0-a649-91ccdc6e394b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:50:35.033364 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-58f02e77-6d54-4fb0-a649-91ccdc6e394b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.622633 Sep 24 20:50:35.034905 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 86/205] 10.222.0.52 () {62 vars in 1188 bytes} [Sat Sep 24 20:50:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 24 20:50:35.051178 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-097a6421-0db5-4717-b872-fdc7901abbea tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:35.054922 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-097a6421-0db5-4717-b872-fdc7901abbea tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:35.302347 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-097a6421-0db5-4717-b872-fdc7901abbea tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:35.313866 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-097a6421-0db5-4717-b872-fdc7901abbea tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:35.315386 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-097a6421-0db5-4717-b872-fdc7901abbea tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:35.340633 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-097a6421-0db5-4717-b872-fdc7901abbea tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1454 microversion: 2.91 time: 0.298624 Sep 24 20:50:35.348002 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 87/206] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:50:35 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1454 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:50:35.437797 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2e354764-365c-46da-bc27-5fb59fa7b0fe tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:35.438465 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2e354764-365c-46da-bc27-5fb59fa7b0fe tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] [instance: 650cae0b-7b94-4c33-a526-5cc80548c0db] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:35.446983 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2e354764-365c-46da-bc27-5fb59fa7b0fe tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:35.447491 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2e354764-365c-46da-bc27-5fb59fa7b0fe tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:35.448020 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2e354764-365c-46da-bc27-5fb59fa7b0fe tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:35.449683 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2e354764-365c-46da-bc27-5fb59fa7b0fe tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:35.451521 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2e354764-365c-46da-bc27-5fb59fa7b0fe tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:35.453286 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2e354764-365c-46da-bc27-5fb59fa7b0fe tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:35.892082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=11 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:50:36.457755 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c49624ca-b8ae-43dd-a190-a87c09a2b540 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278977b201c48dda2d73823fbfe4833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a31be22cc451b92af447ed8d81242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:36.471198 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c49624ca-b8ae-43dd-a190-a87c09a2b540 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3" status: 200 len: 1408 microversion: 2.1 time: 1.589477 Sep 24 20:50:36.474798 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 120/207] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:34 2022] GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3 => generated 1408 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:36.484054 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f87e178c-fe51-49c1-8249-e7d1ec9c8623 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:36.486895 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f87e178c-fe51-49c1-8249-e7d1ec9c8623 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:36.505373 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f87e178c-fe51-49c1-8249-e7d1ec9c8623 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:36.506068 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f87e178c-fe51-49c1-8249-e7d1ec9c8623 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:36.506687 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f87e178c-fe51-49c1-8249-e7d1ec9c8623 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:36.507934 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f87e178c-fe51-49c1-8249-e7d1ec9c8623 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:36.510727 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f87e178c-fe51-49c1-8249-e7d1ec9c8623 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:36.511350 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f87e178c-fe51-49c1-8249-e7d1ec9c8623 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:36.610483 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f87e178c-fe51-49c1-8249-e7d1ec9c8623 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:36.610483 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f87e178c-fe51-49c1-8249-e7d1ec9c8623 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:36.611506 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f87e178c-fe51-49c1-8249-e7d1ec9c8623 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:36.614218 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-f87e178c-fe51-49c1-8249-e7d1ec9c8623 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lazy-loading 'fault' on Instance uuid 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:50:36.636280 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:50:36.925337 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f87e178c-fe51-49c1-8249-e7d1ec9c8623 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8a91794144d73a8942f5c3bac8cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3800968cd944059a397e9c6b35f976d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:36.940867 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f87e178c-fe51-49c1-8249-e7d1ec9c8623 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1" status: 200 len: 1310 microversion: 2.1 time: 0.464803 Sep 24 20:50:36.944548 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 121/208] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:36 2022] GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 => generated 1310 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:36.946055 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2e354764-365c-46da-bc27-5fb59fa7b0fe tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01bfb1e8464616aceb3b73c958eb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e62e74103b45cc81dfe7900c0baf5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:36.956767 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2e354764-365c-46da-bc27-5fb59fa7b0fe tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] 10.222.0.52 "GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db" status: 200 len: 1492 microversion: 2.1 time: 1.528534 Sep 24 20:50:36.972948 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-a1d3b6d5-030c-4747-aac9-c7f33ccd54a7 req-299e4fc5-4fe2-4452-88e7-927a9b5b8a9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c7ac6b8-6436-4f54-abad-8d782b4eb5e1", "name": "network-vif-deleted", "tag": "62020081-009a-494e-a571-75ec298caf16"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:36.978896 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 88/209] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:35 2022] GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db => generated 1492 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:36.993656 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0d93c1b6-ddd0-4f94-af48-25871bd9fc1c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:36.994343 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0d93c1b6-ddd0-4f94-af48-25871bd9fc1c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:37.008198 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d93c1b6-ddd0-4f94-af48-25871bd9fc1c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:37.008701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d93c1b6-ddd0-4f94-af48-25871bd9fc1c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:37.009230 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d93c1b6-ddd0-4f94-af48-25871bd9fc1c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:37.010023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d93c1b6-ddd0-4f94-af48-25871bd9fc1c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:37.010490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d93c1b6-ddd0-4f94-af48-25871bd9fc1c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:37.010776 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a1d3b6d5-030c-4747-aac9-c7f33ccd54a7 req-299e4fc5-4fe2-4452-88e7-927a9b5b8a9c service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:37.011615 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a1d3b6d5-030c-4747-aac9-c7f33ccd54a7 req-299e4fc5-4fe2-4452-88e7-927a9b5b8a9c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:37.012082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d93c1b6-ddd0-4f94-af48-25871bd9fc1c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:37.015045 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a1d3b6d5-030c-4747-aac9-c7f33ccd54a7 req-299e4fc5-4fe2-4452-88e7-927a9b5b8a9c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:37.030212 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-a1d3b6d5-030c-4747-aac9-c7f33ccd54a7 req-299e4fc5-4fe2-4452-88e7-927a9b5b8a9c service nova] Creating event network-vif-deleted:62020081-009a-494e-a571-75ec298caf16 for instance 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 on nch2-master-1 Sep 24 20:50:37.047300 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-a1d3b6d5-030c-4747-aac9-c7f33ccd54a7 req-299e4fc5-4fe2-4452-88e7-927a9b5b8a9c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099066 Sep 24 20:50:37.048372 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 122/210] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:37.056964 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ab169c24-683f-4673-9b01-ff1c9062708e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:37.057812 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ab169c24-683f-4673-9b01-ff1c9062708e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:37.066207 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=34 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:50:37.068835 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab169c24-683f-4673-9b01-ff1c9062708e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:37.069355 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab169c24-683f-4673-9b01-ff1c9062708e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:37.070696 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab169c24-683f-4673-9b01-ff1c9062708e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:37.071422 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab169c24-683f-4673-9b01-ff1c9062708e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:37.072168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab169c24-683f-4673-9b01-ff1c9062708e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:37.073073 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab169c24-683f-4673-9b01-ff1c9062708e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:37.456935 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ab169c24-683f-4673-9b01-ff1c9062708e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:37.475511 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ab169c24-683f-4673-9b01-ff1c9062708e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:37.476953 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ab169c24-683f-4673-9b01-ff1c9062708e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:37.496805 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ab169c24-683f-4673-9b01-ff1c9062708e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1506 microversion: 2.91 time: 0.446418 Sep 24 20:50:37.508649 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 123/211] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:50:37 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1506 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:50:37.526363 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c016bb25-8c91-4eb5-855e-9a95eca20cf5 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:37.527039 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c016bb25-8c91-4eb5-855e-9a95eca20cf5 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 9b0e9940-f6ac-46d5-8898-1e4ba56119b3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:37.549902 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c016bb25-8c91-4eb5-855e-9a95eca20cf5 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:37.551772 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c016bb25-8c91-4eb5-855e-9a95eca20cf5 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:37.552635 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c016bb25-8c91-4eb5-855e-9a95eca20cf5 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:37.555046 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c016bb25-8c91-4eb5-855e-9a95eca20cf5 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:37.556084 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c016bb25-8c91-4eb5-855e-9a95eca20cf5 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:37.557903 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c016bb25-8c91-4eb5-855e-9a95eca20cf5 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:37.780227 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0d93c1b6-ddd0-4f94-af48-25871bd9fc1c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:37.796222 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0d93c1b6-ddd0-4f94-af48-25871bd9fc1c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1331 microversion: 2.1 time: 0.815914 Sep 24 20:50:37.811097 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 89/212] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:36 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1331 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:37.972104 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-af62e340-7da3-4238-a6c2-fba09abbb092 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:37.973466 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-af62e340-7da3-4238-a6c2-fba09abbb092 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:37.988963 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af62e340-7da3-4238-a6c2-fba09abbb092 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:37.989969 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af62e340-7da3-4238-a6c2-fba09abbb092 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:37.991870 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af62e340-7da3-4238-a6c2-fba09abbb092 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:37.993449 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af62e340-7da3-4238-a6c2-fba09abbb092 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:37.993964 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af62e340-7da3-4238-a6c2-fba09abbb092 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:37.994404 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af62e340-7da3-4238-a6c2-fba09abbb092 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:38.017601 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-af62e340-7da3-4238-a6c2-fba09abbb092 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] HTTP exception thrown: Instance 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 could not be found. Sep 24 20:50:38.024741 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-af62e340-7da3-4238-a6c2-fba09abbb092 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Request method failure captured: Sep 24 20:50:38.024741 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 HTTP/1.1 Sep 24 20:50:38.024741 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:50:38.024741 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:50:38.024741 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:50:38.024741 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:50:38.024741 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:50:38.024741 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:50:38.024741 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:50:38.024741 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:50:38.024741 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL21tXct_e6jYlpfCLicbbyTXnoW3D_SgXTsoW20R0hO-giY2cCcXhB4j8Nab-pCROuS1EhSgImQhmloh-H8_adEV6tabmxZf_wCnDt5SOp7qMTeNy_SEXOA-DiocBN4-gwUDtJPEwbTPoE1jDUI_OjMOLSqgk3sAcU03gPMcMHJCzhk Sep 24 20:50:38.024741 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:50:38.024741 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:50:38.024741 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:50:38.024741 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:50:38.024741 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:50:38.024741 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:50:38.024741 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: c3800968cd944059a397e9c6b35f976d Sep 24 20:50:38.024741 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-DeleteServersAdminTestJSON-351697204 Sep 24 20:50:38.024741 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:50:38.024741 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:50:38.026210 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c3800968cd944059a397e9c6b35f976d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c3800968cd944059a397e9c6b35f976d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c3800968cd944059a397e9c6b35f976d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c3800968cd944059a397e9c6b35f976d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:50:38.026210 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-DeleteServersAdminTestJSON-351697204 Sep 24 20:50:38.026210 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: c3800968cd944059a397e9c6b35f976d Sep 24 20:50:38.026210 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-351697204 Sep 24 20:50:38.026210 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-DeleteServersAdminTestJSON-351697204-project Sep 24 20:50:38.026210 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:50:38.026210 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:50:38.026210 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 50d8a91794144d73a8942f5c3bac8cc8 Sep 24 20:50:38.026210 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-DeleteServersAdminTestJSON-351697204-project Sep 24 20:50:38.026210 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:50:38.026210 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 could not be found. Sep 24 20:50:38.026210 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '9c7ac6b8-6436-4f54-abad-8d782b4eb5e1'} Sep 24 20:50:38.026995 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:50:38.026995 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:38.026995 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:50:38.026995 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:50:38.026995 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:50:38.026995 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:50:38.026995 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:50:38.026995 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:50:38.026995 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:50:38.026995 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:50:38.026995 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 could not be found. Sep 24 20:50:38.026995 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:38.026995 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:50:38.026995 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:38.026995 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:38.026995 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:50:38.026995 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:50:38.026995 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:50:38.026995 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:50:38.026995 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:50:38.028890 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:50:38.028890 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:50:38.028890 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:50:38.028890 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:50:38.028890 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:50:38.028890 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:50:38.028890 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:50:38.028890 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 could not be found. Sep 24 20:50:38.028890 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:38.028890 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:50:38.028890 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:38.028890 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:38.028890 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:50:38.028890 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:50:38.028890 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:50:38.028890 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:50:38.028890 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 could not be found. Sep 24 20:50:38.028890 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:38.032945 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-af62e340-7da3-4238-a6c2-fba09abbb092 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Returning 404 to user: Instance 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:50:38.034110 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-af62e340-7da3-4238-a6c2-fba09abbb092 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1" status: 404 len: 111 microversion: 2.1 time: 0.068571 Sep 24 20:50:38.047222 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 90/213] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:37 2022] GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 20:50:38.066337 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ccc4d1fb-e13a-43eb-a523-4f070d07f51f tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:38.067233 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ccc4d1fb-e13a-43eb-a523-4f070d07f51f tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] [instance: 650cae0b-7b94-4c33-a526-5cc80548c0db] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:38.087040 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ccc4d1fb-e13a-43eb-a523-4f070d07f51f tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:38.088045 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ccc4d1fb-e13a-43eb-a523-4f070d07f51f tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:38.088817 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ccc4d1fb-e13a-43eb-a523-4f070d07f51f tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:38.089879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ccc4d1fb-e13a-43eb-a523-4f070d07f51f tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:38.090635 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ccc4d1fb-e13a-43eb-a523-4f070d07f51f tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:38.091868 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ccc4d1fb-e13a-43eb-a523-4f070d07f51f tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:38.190374 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ccc4d1fb-e13a-43eb-a523-4f070d07f51f tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:38.195657 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ccc4d1fb-e13a-43eb-a523-4f070d07f51f tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:38.201552 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ccc4d1fb-e13a-43eb-a523-4f070d07f51f tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:38.203554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-ccc4d1fb-e13a-43eb-a523-4f070d07f51f tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lazy-loading 'fault' on Instance uuid 650cae0b-7b94-4c33-a526-5cc80548c0db {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:50:38.380250 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ccc4d1fb-e13a-43eb-a523-4f070d07f51f tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01bfb1e8464616aceb3b73c958eb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e62e74103b45cc81dfe7900c0baf5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:38.395804 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ccc4d1fb-e13a-43eb-a523-4f070d07f51f tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] 10.222.0.52 "GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db" status: 200 len: 1326 microversion: 2.1 time: 0.345281 Sep 24 20:50:38.398602 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 91/214] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:38 2022] GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db => generated 1326 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:38.412671 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-73679919-ff78-4edc-abce-80b9efaefad9 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-37082122", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:38.512094 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-73679919-ff78-4edc-abce-80b9efaefad9 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] validate_networks() for None {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:50:38.924106 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c016bb25-8c91-4eb5-855e-9a95eca20cf5 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278977b201c48dda2d73823fbfe4833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a31be22cc451b92af447ed8d81242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:38.938333 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c016bb25-8c91-4eb5-855e-9a95eca20cf5 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3" status: 200 len: 1408 microversion: 2.1 time: 1.428404 Sep 24 20:50:38.940695 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 124/215] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:37 2022] GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3 => generated 1408 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:38.949257 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c8e96507-2806-4f74-8940-034d536da142 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:38.950072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c8e96507-2806-4f74-8940-034d536da142 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:38.958105 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8e96507-2806-4f74-8940-034d536da142 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:38.958823 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8e96507-2806-4f74-8940-034d536da142 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:38.959424 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8e96507-2806-4f74-8940-034d536da142 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:38.961547 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8e96507-2806-4f74-8940-034d536da142 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:38.962233 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8e96507-2806-4f74-8940-034d536da142 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:38.962865 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8e96507-2806-4f74-8940-034d536da142 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:39.206869 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c8e96507-2806-4f74-8940-034d536da142 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:39.231345 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c8e96507-2806-4f74-8940-034d536da142 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:39.235332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c8e96507-2806-4f74-8940-034d536da142 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:39.251713 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c8e96507-2806-4f74-8940-034d536da142 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1512 microversion: 2.91 time: 0.309470 Sep 24 20:50:39.254891 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 125/216] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:50:38 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1512 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:50:39.260776 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f115a173-1ae3-4a41-aeb5-a86c0ae60948 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:39.261343 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f115a173-1ae3-4a41-aeb5-a86c0ae60948 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:39.274837 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f115a173-1ae3-4a41-aeb5-a86c0ae60948 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:39.278853 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f115a173-1ae3-4a41-aeb5-a86c0ae60948 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:39.279690 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f115a173-1ae3-4a41-aeb5-a86c0ae60948 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:39.281491 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f115a173-1ae3-4a41-aeb5-a86c0ae60948 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:39.282271 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f115a173-1ae3-4a41-aeb5-a86c0ae60948 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:39.283195 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f115a173-1ae3-4a41-aeb5-a86c0ae60948 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:39.599590 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-73679919-ff78-4edc-abce-80b9efaefad9 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:50:39.600352 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-73679919-ff78-4edc-abce-80b9efaefad9 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:50:39.601311 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-73679919-ff78-4edc-abce-80b9efaefad9 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:50:39.602038 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-73679919-ff78-4edc-abce-80b9efaefad9 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:50:39.602369 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-73679919-ff78-4edc-abce-80b9efaefad9 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:50:39.657733 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-73679919-ff78-4edc-abce-80b9efaefad9 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:39.658646 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-73679919-ff78-4edc-abce-80b9efaefad9 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:39.659333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-73679919-ff78-4edc-abce-80b9efaefad9 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:39.660258 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-73679919-ff78-4edc-abce-80b9efaefad9 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:39.664752 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-73679919-ff78-4edc-abce-80b9efaefad9 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:39.665780 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-73679919-ff78-4edc-abce-80b9efaefad9 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:39.679024 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=9 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:50:39.717919 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-73679919-ff78-4edc-abce-80b9efaefad9 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Getting quotas for project c3800968cd944059a397e9c6b35f976d. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:50:39.732616 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:UPDATE=5,nova_api:SELECT=92,nova_api:INSERT=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:50:39.734434 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-73679919-ff78-4edc-abce-80b9efaefad9 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Getting quotas for user 50d8a91794144d73a8942f5c3bac8cc8 and project c3800968cd944059a397e9c6b35f976d. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:50:39.751564 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-73679919-ff78-4edc-abce-80b9efaefad9 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:50:39.753913 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-73679919-ff78-4edc-abce-80b9efaefad9 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 59b0e336-5d09-43b8-b126-6b8e0a33f813] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:50:39.790019 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f115a173-1ae3-4a41-aeb5-a86c0ae60948 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:39.803670 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f115a173-1ae3-4a41-aeb5-a86c0ae60948 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1331 microversion: 2.1 time: 0.547396 Sep 24 20:50:39.804621 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 126/217] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:39 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1331 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:39.821707 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-453dbcc9-eedc-4933-8aef-c0c3f0f551d4 req-897ab3b7-d1f7-4f87-a3d3-b1e137bf6b3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "650cae0b-7b94-4c33-a526-5cc80548c0db", "name": "network-vif-deleted", "tag": "5f721dd0-8223-41cc-ad71-4ac5294e10ed"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:39.867252 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-453dbcc9-eedc-4933-8aef-c0c3f0f551d4 req-897ab3b7-d1f7-4f87-a3d3-b1e137bf6b3f service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:39.867994 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-453dbcc9-eedc-4933-8aef-c0c3f0f551d4 req-897ab3b7-d1f7-4f87-a3d3-b1e137bf6b3f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:39.869106 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-453dbcc9-eedc-4933-8aef-c0c3f0f551d4 req-897ab3b7-d1f7-4f87-a3d3-b1e137bf6b3f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:39.871319 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-73679919-ff78-4edc-abce-80b9efaefad9 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.471039 Sep 24 20:50:39.890345 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 92/218] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:50:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:50:39.897920 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-453dbcc9-eedc-4933-8aef-c0c3f0f551d4 req-897ab3b7-d1f7-4f87-a3d3-b1e137bf6b3f service nova] Creating event network-vif-deleted:5f721dd0-8223-41cc-ad71-4ac5294e10ed for instance 650cae0b-7b94-4c33-a526-5cc80548c0db on nch1-master-1 Sep 24 20:50:39.899756 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-96a9ccae-4825-4b44-85ba-6724db49648a tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:39.900778 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-96a9ccae-4825-4b44-85ba-6724db49648a tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] [instance: 650cae0b-7b94-4c33-a526-5cc80548c0db] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:39.910630 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-453dbcc9-eedc-4933-8aef-c0c3f0f551d4 req-897ab3b7-d1f7-4f87-a3d3-b1e137bf6b3f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104412 Sep 24 20:50:39.911551 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96a9ccae-4825-4b44-85ba-6724db49648a tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:39.913628 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96a9ccae-4825-4b44-85ba-6724db49648a tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:39.914076 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 127/219] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:39.914446 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96a9ccae-4825-4b44-85ba-6724db49648a tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:39.915630 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96a9ccae-4825-4b44-85ba-6724db49648a tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:39.916393 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96a9ccae-4825-4b44-85ba-6724db49648a tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:39.916977 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96a9ccae-4825-4b44-85ba-6724db49648a tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:39.921658 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-65a55cd0-e418-42f5-8f5b-fcd0ed4d3a40 req-26d253f7-4649-43c2-bb47-15f7978c4202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b0e9940-f6ac-46d5-8898-1e4ba56119b3", "name": "network-vif-plugged", "status": "completed", "tag": "bd5ba8f6-52ce-4952-b823-1baad516098d"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:39.945605 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-65a55cd0-e418-42f5-8f5b-fcd0ed4d3a40 req-26d253f7-4649-43c2-bb47-15f7978c4202 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:39.946964 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-65a55cd0-e418-42f5-8f5b-fcd0ed4d3a40 req-26d253f7-4649-43c2-bb47-15f7978c4202 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:39.947615 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-65a55cd0-e418-42f5-8f5b-fcd0ed4d3a40 req-26d253f7-4649-43c2-bb47-15f7978c4202 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:39.957488 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-96a9ccae-4825-4b44-85ba-6724db49648a tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] HTTP exception thrown: Instance 650cae0b-7b94-4c33-a526-5cc80548c0db could not be found. Sep 24 20:50:39.966783 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-96a9ccae-4825-4b44-85ba-6724db49648a tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Request method failure captured: Sep 24 20:50:39.966783 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db HTTP/1.1 Sep 24 20:50:39.966783 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:50:39.966783 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:50:39.966783 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:50:39.966783 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:50:39.966783 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:50:39.966783 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:50:39.966783 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:50:39.966783 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:50:39.966783 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL21hAokN1y2TX9ppXu7HBhRzEoJwzw5r3-z_TLzxnCl1pw5UEFWrAlF7tGaE7KP_yEI3JfTVO5i65_89EmyJQECO5JBG3xBfYxvmtYqi-Q6S15tziN9we3qusC2l-jk1zuzFFvziUheTkwqPl2BIQu3EABRjPM64nBT6vJu3WorZh44 Sep 24 20:50:39.966783 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:50:39.966783 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:50:39.966783 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:50:39.966783 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:50:39.966783 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:50:39.966783 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:50:39.966783 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: a9e62e74103b45cc81dfe7900c0baf5a Sep 24 20:50:39.966783 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-AggregatesAdminTestJSON-1167595380 Sep 24 20:50:39.966783 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:50:39.966783 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:50:39.968265 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a9e62e74103b45cc81dfe7900c0baf5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a9e62e74103b45cc81dfe7900c0baf5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a9e62e74103b45cc81dfe7900c0baf5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a9e62e74103b45cc81dfe7900c0baf5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:50:39.968265 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-AggregatesAdminTestJSON-1167595380 Sep 24 20:50:39.968265 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: a9e62e74103b45cc81dfe7900c0baf5a Sep 24 20:50:39.968265 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1167595380 Sep 24 20:50:39.968265 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-AggregatesAdminTestJSON-1167595380-project Sep 24 20:50:39.968265 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:50:39.968265 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:50:39.968265 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 2c01bfb1e8464616aceb3b73c958eb3f Sep 24 20:50:39.968265 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-AggregatesAdminTestJSON-1167595380-project Sep 24 20:50:39.968265 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:50:39.968265 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 650cae0b-7b94-4c33-a526-5cc80548c0db could not be found. Sep 24 20:50:39.968265 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '650cae0b-7b94-4c33-a526-5cc80548c0db'} Sep 24 20:50:39.968984 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:50:39.968984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:39.968984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:50:39.968984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:50:39.968984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:50:39.968984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:50:39.968984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:50:39.968984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:50:39.968984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:50:39.968984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:50:39.968984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 650cae0b-7b94-4c33-a526-5cc80548c0db could not be found. Sep 24 20:50:39.968984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:39.968984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:50:39.968984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:39.968984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:39.968984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:50:39.968984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:50:39.968984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:50:39.968984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:50:39.968984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:50:39.970073 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:50:39.970073 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:50:39.970073 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:50:39.970073 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:50:39.970073 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:50:39.970073 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:50:39.970073 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:50:39.970073 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 650cae0b-7b94-4c33-a526-5cc80548c0db could not be found. Sep 24 20:50:39.970073 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:39.970073 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:50:39.970073 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:39.970073 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:39.970073 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:50:39.970073 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:50:39.970073 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:50:39.970073 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:50:39.970073 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 650cae0b-7b94-4c33-a526-5cc80548c0db could not be found. Sep 24 20:50:39.970073 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:39.971123 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-96a9ccae-4825-4b44-85ba-6724db49648a tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Returning 404 to user: Instance 650cae0b-7b94-4c33-a526-5cc80548c0db could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:50:39.971945 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-96a9ccae-4825-4b44-85ba-6724db49648a tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] 10.222.0.52 "GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db" status: 404 len: 111 microversion: 2.1 time: 0.075309 Sep 24 20:50:39.973735 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-65a55cd0-e418-42f5-8f5b-fcd0ed4d3a40 req-26d253f7-4649-43c2-bb47-15f7978c4202 service nova] Creating event network-vif-plugged:bd5ba8f6-52ce-4952-b823-1baad516098d for instance 9b0e9940-f6ac-46d5-8898-1e4ba56119b3 on nch1-master-1 Sep 24 20:50:39.979631 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 93/220] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:39 2022] GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:50:39.987016 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-555c9bda-922e-432c-b30f-5292a5044d0b tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:39.988013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-555c9bda-922e-432c-b30f-5292a5044d0b tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 59b0e336-5d09-43b8-b126-6b8e0a33f813] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:39.991052 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-65a55cd0-e418-42f5-8f5b-fcd0ed4d3a40 req-26d253f7-4649-43c2-bb47-15f7978c4202 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075265 Sep 24 20:50:40.004575 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 128/221] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:40.014480 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f8082fc0-fde0-4e72-b25e-050804a5145e tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:40.015496 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f8082fc0-fde0-4e72-b25e-050804a5145e tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 9b0e9940-f6ac-46d5-8898-1e4ba56119b3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:40.026434 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8082fc0-fde0-4e72-b25e-050804a5145e tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:40.027051 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8082fc0-fde0-4e72-b25e-050804a5145e tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:40.027489 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8082fc0-fde0-4e72-b25e-050804a5145e tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:40.028264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8082fc0-fde0-4e72-b25e-050804a5145e tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:40.037973 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8082fc0-fde0-4e72-b25e-050804a5145e tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:40.038415 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8082fc0-fde0-4e72-b25e-050804a5145e tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:40.165930 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-555c9bda-922e-432c-b30f-5292a5044d0b tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8a91794144d73a8942f5c3bac8cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3800968cd944059a397e9c6b35f976d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:40.176371 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-555c9bda-922e-432c-b30f-5292a5044d0b tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813" status: 200 len: 1218 microversion: 2.1 time: 0.195024 Sep 24 20:50:40.176898 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 94/222] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:39 2022] GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813 => generated 1218 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:40.198527 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f91b121a-2752-481c-842e-a217da3c008b tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:40.218034 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f91b121a-2752-481c-842e-a217da3c008b tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:40.219125 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f91b121a-2752-481c-842e-a217da3c008b tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:40.219125 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f91b121a-2752-481c-842e-a217da3c008b tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:40.509818 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f91b121a-2752-481c-842e-a217da3c008b tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 294 microversion: 2.1 time: 0.304101 Sep 24 20:50:40.524478 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 95/223] 10.222.0.52 () {60 vars in 1191 bytes} [Sat Sep 24 20:50:40 2022] POST /compute/v2.1/os-aggregates/5/action => generated 294 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:40.543567 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4999cc61-e831-44a0-bb8a-f83ad3d4f9d2 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:40.545287 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4999cc61-e831-44a0-bb8a-f83ad3d4f9d2 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:40.553909 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4999cc61-e831-44a0-bb8a-f83ad3d4f9d2 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:40.555476 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4999cc61-e831-44a0-bb8a-f83ad3d4f9d2 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:40.556187 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4999cc61-e831-44a0-bb8a-f83ad3d4f9d2 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:40.557116 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4999cc61-e831-44a0-bb8a-f83ad3d4f9d2 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:40.557954 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4999cc61-e831-44a0-bb8a-f83ad3d4f9d2 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:40.558628 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4999cc61-e831-44a0-bb8a-f83ad3d4f9d2 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:40.807118 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4999cc61-e831-44a0-bb8a-f83ad3d4f9d2 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:40.828634 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4999cc61-e831-44a0-bb8a-f83ad3d4f9d2 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:40.833857 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4999cc61-e831-44a0-bb8a-f83ad3d4f9d2 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:40.834017 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f8082fc0-fde0-4e72-b25e-050804a5145e tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278977b201c48dda2d73823fbfe4833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a31be22cc451b92af447ed8d81242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:40.842907 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f8082fc0-fde0-4e72-b25e-050804a5145e tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3" status: 200 len: 1408 microversion: 2.1 time: 0.836801 Sep 24 20:50:40.846812 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 129/224] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:40 2022] GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3 => generated 1408 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:40.847315 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4999cc61-e831-44a0-bb8a-f83ad3d4f9d2 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1533 microversion: 2.91 time: 0.321388 Sep 24 20:50:40.851092 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 96/225] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:50:40 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1533 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:50:40.859482 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b9167e65-c8b3-47a9-911f-987f206da14c tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:40.860957 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b559102c-49c1-4b5f-bdcc-89bdf313e289 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:40.861882 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b559102c-49c1-4b5f-bdcc-89bdf313e289 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:40.878435 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b559102c-49c1-4b5f-bdcc-89bdf313e289 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:40.879453 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b559102c-49c1-4b5f-bdcc-89bdf313e289 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:40.880196 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b559102c-49c1-4b5f-bdcc-89bdf313e289 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:40.881088 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b559102c-49c1-4b5f-bdcc-89bdf313e289 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:40.882938 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b559102c-49c1-4b5f-bdcc-89bdf313e289 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:40.883881 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b559102c-49c1-4b5f-bdcc-89bdf313e289 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:40.908862 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b9167e65-c8b3-47a9-911f-987f206da14c tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.060886 Sep 24 20:50:40.910296 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 130/226] 10.222.0.52 () {58 vars in 1152 bytes} [Sat Sep 24 20:50:40 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 24 20:50:40.944934 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:50:41.020687 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-aee367a2-921f-49ce-a125-2f9bd5599242 tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:41.021430 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-aee367a2-921f-49ce-a125-2f9bd5599242 tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:41.034373 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aee367a2-921f-49ce-a125-2f9bd5599242 tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:41.035374 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aee367a2-921f-49ce-a125-2f9bd5599242 tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:41.035783 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aee367a2-921f-49ce-a125-2f9bd5599242 tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:41.037397 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aee367a2-921f-49ce-a125-2f9bd5599242 tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:41.038152 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aee367a2-921f-49ce-a125-2f9bd5599242 tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:41.038935 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aee367a2-921f-49ce-a125-2f9bd5599242 tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:41.278757 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-aee367a2-921f-49ce-a125-2f9bd5599242 tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Lazy-loading 'services' on Instance uuid fafd445e-572c-4300-9433-f0d9a628df5e {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:50:41.415225 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-aee367a2-921f-49ce-a125-2f9bd5599242 tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1938 microversion: 2.91 time: 0.503358 Sep 24 20:50:41.427516 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 131/227] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:50:40 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1938 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:50:41.433258 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b559102c-49c1-4b5f-bdcc-89bdf313e289 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:41.447427 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b559102c-49c1-4b5f-bdcc-89bdf313e289 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1312 microversion: 2.1 time: 0.595001 Sep 24 20:50:41.448240 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 97/228] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:40 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1312 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:41.463656 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8a453c29-a50e-4ca7-b5a2-d435e915b30a tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1444420794"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:41.463656 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.aggregate [None req-8a453c29-a50e-4ca7-b5a2-d435e915b30a tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Generated uuid fc4464ed-4b6c-4a88-9bbe-6a9f767fcde3 for aggregate {{(pid=140516) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 24 20:50:41.480974 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-425f1d4a-556f-49c9-a917-6688b2b2289f tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:41.482416 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-425f1d4a-556f-49c9-a917-6688b2b2289f tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 59b0e336-5d09-43b8-b126-6b8e0a33f813] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:41.492784 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-425f1d4a-556f-49c9-a917-6688b2b2289f tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:41.495419 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-425f1d4a-556f-49c9-a917-6688b2b2289f tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:41.499822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-425f1d4a-556f-49c9-a917-6688b2b2289f tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:41.500859 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-425f1d4a-556f-49c9-a917-6688b2b2289f tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:41.501522 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-425f1d4a-556f-49c9-a917-6688b2b2289f tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:41.501776 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8a453c29-a50e-4ca7-b5a2-d435e915b30a tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.071757 Sep 24 20:50:41.502329 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-425f1d4a-556f-49c9-a917-6688b2b2289f tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:41.502453 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 132/229] 10.222.0.52 () {60 vars in 1164 bytes} [Sat Sep 24 20:50:41 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:41.513056 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ff1aa02e-a245-4499-84fd-0c7cd8171962 tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:41.513696 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ff1aa02e-a245-4499-84fd-0c7cd8171962 tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:41.523249 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff1aa02e-a245-4499-84fd-0c7cd8171962 tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:41.523758 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff1aa02e-a245-4499-84fd-0c7cd8171962 tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:41.524467 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff1aa02e-a245-4499-84fd-0c7cd8171962 tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:41.525267 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff1aa02e-a245-4499-84fd-0c7cd8171962 tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:41.525786 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff1aa02e-a245-4499-84fd-0c7cd8171962 tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:41.526270 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff1aa02e-a245-4499-84fd-0c7cd8171962 tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:41.687702 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-425f1d4a-556f-49c9-a917-6688b2b2289f tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8a91794144d73a8942f5c3bac8cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3800968cd944059a397e9c6b35f976d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:41.697052 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-425f1d4a-556f-49c9-a917-6688b2b2289f tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813" status: 200 len: 1270 microversion: 2.1 time: 0.231684 Sep 24 20:50:41.713143 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-ff1aa02e-a245-4499-84fd-0c7cd8171962 tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Lazy-loading 'services' on Instance uuid fafd445e-572c-4300-9433-f0d9a628df5e {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:50:41.714550 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 98/230] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:41 2022] GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813 => generated 1270 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:41.727255 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9a8060f1-69ec-4ce5-97ee-592a65856619 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:41.748418 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ff1aa02e-a245-4499-84fd-0c7cd8171962 tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1938 microversion: 2.91 time: 0.244696 Sep 24 20:50:41.753219 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 133/231] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:50:41 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1938 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:50:41.754224 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a8060f1-69ec-4ce5-97ee-592a65856619 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:41.754763 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a8060f1-69ec-4ce5-97ee-592a65856619 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:41.757602 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a8060f1-69ec-4ce5-97ee-592a65856619 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:41.790879 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1feebcae-5f05-44c9-9fb0-3a774c553929 tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:41.796487 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1feebcae-5f05-44c9-9fb0-3a774c553929 tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:41.797908 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1feebcae-5f05-44c9-9fb0-3a774c553929 tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:41.798764 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1feebcae-5f05-44c9-9fb0-3a774c553929 tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:41.799946 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1feebcae-5f05-44c9-9fb0-3a774c553929 tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:41.800642 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1feebcae-5f05-44c9-9fb0-3a774c553929 tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:41.801555 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1feebcae-5f05-44c9-9fb0-3a774c553929 tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:41.822760 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=2,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:50:41.844236 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1feebcae-5f05-44c9-9fb0-3a774c553929 tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.059646 Sep 24 20:50:41.845658 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 134/232] 10.222.0.52 () {60 vars in 1217 bytes} [Sat Sep 24 20:50:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:50:41.864575 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7cab560a-e128-4bd7-88c8-e2689c2cc9c8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:41.865534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7cab560a-e128-4bd7-88c8-e2689c2cc9c8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:41.879108 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7cab560a-e128-4bd7-88c8-e2689c2cc9c8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:41.879858 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7cab560a-e128-4bd7-88c8-e2689c2cc9c8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:41.880486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7cab560a-e128-4bd7-88c8-e2689c2cc9c8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:41.881434 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7cab560a-e128-4bd7-88c8-e2689c2cc9c8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:41.882054 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7cab560a-e128-4bd7-88c8-e2689c2cc9c8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:41.882903 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7cab560a-e128-4bd7-88c8-e2689c2cc9c8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:41.961293 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-7cab560a-e128-4bd7-88c8-e2689c2cc9c8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lazy-loading 'flavor' on Instance uuid fafd445e-572c-4300-9433-f0d9a628df5e {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:50:42.024540 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9a8060f1-69ec-4ce5-97ee-592a65856619 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.308630 Sep 24 20:50:42.025246 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 99/233] 10.222.0.52 () {60 vars in 1191 bytes} [Sat Sep 24 20:50:41 2022] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:42.037189 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-53fbf0cc-377c-4e7e-9bd5-73575c799aab tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:42.038043 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-53fbf0cc-377c-4e7e-9bd5-73575c799aab tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 9b0e9940-f6ac-46d5-8898-1e4ba56119b3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:42.060718 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53fbf0cc-377c-4e7e-9bd5-73575c799aab tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:42.061615 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53fbf0cc-377c-4e7e-9bd5-73575c799aab tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:42.064349 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53fbf0cc-377c-4e7e-9bd5-73575c799aab tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:42.065355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53fbf0cc-377c-4e7e-9bd5-73575c799aab tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:42.066070 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53fbf0cc-377c-4e7e-9bd5-73575c799aab tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:42.067000 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53fbf0cc-377c-4e7e-9bd5-73575c799aab tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:42.400538 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-53fbf0cc-377c-4e7e-9bd5-73575c799aab tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278977b201c48dda2d73823fbfe4833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a31be22cc451b92af447ed8d81242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:42.417562 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-53fbf0cc-377c-4e7e-9bd5-73575c799aab tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3" status: 200 len: 1389 microversion: 2.1 time: 0.387669 Sep 24 20:50:42.420417 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 100/234] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:42 2022] GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3 => generated 1389 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:42.445991 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-45a1c46e-d1e9-4d7f-afc8-a007cb2888a4 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:42.463234 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7cab560a-e128-4bd7-88c8-e2689c2cc9c8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "POST /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e/action" status: 202 len: 0 microversion: 2.91 time: 0.608308 Sep 24 20:50:42.463937 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 135/235] 10.222.0.52 () {62 vars in 1319 bytes} [Sat Sep 24 20:50:41 2022] POST /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e/action => generated 0 bytes in 611 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 24 20:50:42.469265 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-45a1c46e-d1e9-4d7f-afc8-a007cb2888a4 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 242 microversion: 2.1 time: 0.045563 Sep 24 20:50:42.470075 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 101/236] 10.222.0.52 () {58 vars in 1149 bytes} [Sat Sep 24 20:50:42 2022] GET /compute/v2.1/os-aggregates/9 => generated 242 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:42.483128 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5035c400-6fdd-45b6-a74b-5df5c4ccb8eb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:42.483890 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5035c400-6fdd-45b6-a74b-5df5c4ccb8eb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:42.492557 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5035c400-6fdd-45b6-a74b-5df5c4ccb8eb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:42.493429 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5035c400-6fdd-45b6-a74b-5df5c4ccb8eb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:42.494147 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5035c400-6fdd-45b6-a74b-5df5c4ccb8eb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:42.495289 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5035c400-6fdd-45b6-a74b-5df5c4ccb8eb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:42.496170 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5035c400-6fdd-45b6-a74b-5df5c4ccb8eb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:42.497451 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5035c400-6fdd-45b6-a74b-5df5c4ccb8eb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:42.507526 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-55a622fe-34fd-4346-9c3a-5ab3f7efa75f req-ac9bdef1-b25c-4d5d-b978-854795f5bbaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f389d01c-08ec-42e6-81a1-85aedcdfe42e", "name": "network-vif-plugged", "status": "completed", "tag": "d104313c-4d9a-4ffb-8015-0f9ee3bfbcb1"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:42.532896 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-55a622fe-34fd-4346-9c3a-5ab3f7efa75f req-ac9bdef1-b25c-4d5d-b978-854795f5bbaa service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:42.535880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-55a622fe-34fd-4346-9c3a-5ab3f7efa75f req-ac9bdef1-b25c-4d5d-b978-854795f5bbaa service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:42.536543 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-55a622fe-34fd-4346-9c3a-5ab3f7efa75f req-ac9bdef1-b25c-4d5d-b978-854795f5bbaa service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:42.558248 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-55a622fe-34fd-4346-9c3a-5ab3f7efa75f req-ac9bdef1-b25c-4d5d-b978-854795f5bbaa service nova] Creating event network-vif-plugged:d104313c-4d9a-4ffb-8015-0f9ee3bfbcb1 for instance f389d01c-08ec-42e6-81a1-85aedcdfe42e on nch1-master-1 Sep 24 20:50:42.566614 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-55a622fe-34fd-4346-9c3a-5ab3f7efa75f req-ac9bdef1-b25c-4d5d-b978-854795f5bbaa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087449 Sep 24 20:50:42.567521 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 136/237] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:42.573404 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2e63574a-26ba-4b6e-bdd5-c5e84274d12a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:42.574348 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2e63574a-26ba-4b6e-bdd5-c5e84274d12a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:42.581203 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e63574a-26ba-4b6e-bdd5-c5e84274d12a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:42.581781 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e63574a-26ba-4b6e-bdd5-c5e84274d12a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:42.582291 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e63574a-26ba-4b6e-bdd5-c5e84274d12a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:42.583093 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e63574a-26ba-4b6e-bdd5-c5e84274d12a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:42.583625 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e63574a-26ba-4b6e-bdd5-c5e84274d12a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:42.584441 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e63574a-26ba-4b6e-bdd5-c5e84274d12a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:42.619791 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5035c400-6fdd-45b6-a74b-5df5c4ccb8eb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:42.643860 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5035c400-6fdd-45b6-a74b-5df5c4ccb8eb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:42.649510 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5035c400-6fdd-45b6-a74b-5df5c4ccb8eb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:42.658807 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5035c400-6fdd-45b6-a74b-5df5c4ccb8eb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.187222 Sep 24 20:50:42.659958 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 102/238] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:50:42 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:50:42.665043 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fa8361ca-22f3-4980-9f40-94dd96179f52 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:42.679515 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa8361ca-22f3-4980-9f40-94dd96179f52 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:42.680223 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa8361ca-22f3-4980-9f40-94dd96179f52 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:42.680828 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa8361ca-22f3-4980-9f40-94dd96179f52 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:42.817903 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fa8361ca-22f3-4980-9f40-94dd96179f52 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.156183 Sep 24 20:50:42.818945 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 103/239] 10.222.0.52 () {60 vars in 1191 bytes} [Sat Sep 24 20:50:42 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:42.825777 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e6d47b7b-a1d9-494c-b1ad-e74aacfeaa93 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:42.827013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e6d47b7b-a1d9-494c-b1ad-e74aacfeaa93 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 59b0e336-5d09-43b8-b126-6b8e0a33f813] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:42.834486 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6d47b7b-a1d9-494c-b1ad-e74aacfeaa93 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:42.835582 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6d47b7b-a1d9-494c-b1ad-e74aacfeaa93 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:42.836121 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6d47b7b-a1d9-494c-b1ad-e74aacfeaa93 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:42.836898 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6d47b7b-a1d9-494c-b1ad-e74aacfeaa93 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:42.837385 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6d47b7b-a1d9-494c-b1ad-e74aacfeaa93 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:42.837810 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6d47b7b-a1d9-494c-b1ad-e74aacfeaa93 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:43.003332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e6d47b7b-a1d9-494c-b1ad-e74aacfeaa93 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8a91794144d73a8942f5c3bac8cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3800968cd944059a397e9c6b35f976d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:43.014384 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e6d47b7b-a1d9-494c-b1ad-e74aacfeaa93 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813" status: 200 len: 1276 microversion: 2.1 time: 0.194030 Sep 24 20:50:43.015034 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 104/240] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:42 2022] GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813 => generated 1276 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:43.051089 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c11ae95c-1287-42c9-94d1-ad67a61fac55 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:43.094637 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c11ae95c-1287-42c9-94d1-ad67a61fac55 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.058057 Sep 24 20:50:43.099973 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 105/241] 10.222.0.52 () {58 vars in 1152 bytes} [Sat Sep 24 20:50:43 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 24 20:50:43.114280 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8d6c6450-b5a5-4d29-8d74-acd8ca1dc9bf tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1490486339"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:43.123208 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2e63574a-26ba-4b6e-bdd5-c5e84274d12a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:43.124378 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.aggregate [None req-8d6c6450-b5a5-4d29-8d74-acd8ca1dc9bf tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Generated uuid 5cd423f5-3cc6-4fcc-95c7-8e88f201128f for aggregate {{(pid=140517) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 24 20:50:43.137955 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2e63574a-26ba-4b6e-bdd5-c5e84274d12a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1312 microversion: 2.1 time: 0.566622 Sep 24 20:50:43.141980 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 137/242] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:42 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1312 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:43.187398 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8d6c6450-b5a5-4d29-8d74-acd8ca1dc9bf tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.076968 Sep 24 20:50:43.189279 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 106/243] 10.222.0.52 () {60 vars in 1164 bytes} [Sat Sep 24 20:50:43 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:50:43.202689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b3120ef6-b6cf-44e7-9f1b-7fc80de04f3b tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:43.219872 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b3120ef6-b6cf-44e7-9f1b-7fc80de04f3b tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:43.220530 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b3120ef6-b6cf-44e7-9f1b-7fc80de04f3b tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:43.221502 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b3120ef6-b6cf-44e7-9f1b-7fc80de04f3b tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:43.395094 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b3120ef6-b6cf-44e7-9f1b-7fc80de04f3b tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 243 microversion: 2.1 time: 0.196965 Sep 24 20:50:43.397272 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 138/244] 10.222.0.52 () {60 vars in 1194 bytes} [Sat Sep 24 20:50:43 2022] POST /compute/v2.1/os-aggregates/10/action => generated 243 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:43.414889 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-064168ea-5a31-4c7a-902a-a1b0a8ffb7ae tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:43.439718 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-064168ea-5a31-4c7a-902a-a1b0a8ffb7ae tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.032380 Sep 24 20:50:43.442057 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 107/245] 10.222.0.52 () {58 vars in 1143 bytes} [Sat Sep 24 20:50:43 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:43.455174 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-37908613-1219-4a9b-946c-8041874f339e tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:43.460916 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-953ca610-fa7d-4185-8e37-4aaae33e3ae4 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:43.461653 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-953ca610-fa7d-4185-8e37-4aaae33e3ae4 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 9b0e9940-f6ac-46d5-8898-1e4ba56119b3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:43.473294 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-953ca610-fa7d-4185-8e37-4aaae33e3ae4 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:43.473966 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-953ca610-fa7d-4185-8e37-4aaae33e3ae4 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:43.474526 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-953ca610-fa7d-4185-8e37-4aaae33e3ae4 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:43.476183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-953ca610-fa7d-4185-8e37-4aaae33e3ae4 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:43.477496 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-953ca610-fa7d-4185-8e37-4aaae33e3ae4 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:43.478016 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-953ca610-fa7d-4185-8e37-4aaae33e3ae4 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:43.478695 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-37908613-1219-4a9b-946c-8041874f339e tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:43.480707 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-37908613-1219-4a9b-946c-8041874f339e tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:43.483319 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-37908613-1219-4a9b-946c-8041874f339e tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:43.633010 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-37908613-1219-4a9b-946c-8041874f339e tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.184585 Sep 24 20:50:43.634268 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 108/246] 10.222.0.52 () {60 vars in 1194 bytes} [Sat Sep 24 20:50:43 2022] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:50:43.645318 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7e4a79e5-263f-4006-976b-6cdde4097fdd tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:43.674932 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7e4a79e5-263f-4006-976b-6cdde4097fdd tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.033082 Sep 24 20:50:43.676238 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 109/247] 10.222.0.52 () {58 vars in 1155 bytes} [Sat Sep 24 20:50:43 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 24 20:50:43.686930 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ae019d8a-3c2f-463f-9f72-fe55836c2239 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-851427165"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:43.691046 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.aggregate [None req-ae019d8a-3c2f-463f-9f72-fe55836c2239 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Generated uuid a7ce29e4-b3e7-4c4a-b98e-1661bcae27f6 for aggregate {{(pid=140517) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 24 20:50:43.720526 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ae019d8a-3c2f-463f-9f72-fe55836c2239 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.037957 Sep 24 20:50:43.721378 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 110/248] 10.222.0.52 () {60 vars in 1164 bytes} [Sat Sep 24 20:50:43 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:50:43.740794 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c14e6436-79be-42f7-88a3-eac084456853 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:43.742253 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c14e6436-79be-42f7-88a3-eac084456853 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:43.754410 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c14e6436-79be-42f7-88a3-eac084456853 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:43.755115 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c14e6436-79be-42f7-88a3-eac084456853 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:43.757478 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c14e6436-79be-42f7-88a3-eac084456853 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:43.758402 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c14e6436-79be-42f7-88a3-eac084456853 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:43.759093 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c14e6436-79be-42f7-88a3-eac084456853 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:43.759674 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c14e6436-79be-42f7-88a3-eac084456853 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:43.765384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-953ca610-fa7d-4185-8e37-4aaae33e3ae4 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278977b201c48dda2d73823fbfe4833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a31be22cc451b92af447ed8d81242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:43.784624 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-953ca610-fa7d-4185-8e37-4aaae33e3ae4 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3" status: 200 len: 1588 microversion: 2.1 time: 0.329284 Sep 24 20:50:43.785322 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 139/249] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:43 2022] GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3 => generated 1588 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:43.812650 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b1c53056-98ea-4587-8097-d8790ddb86a4 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:43.825982 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1c53056-98ea-4587-8097-d8790ddb86a4 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:43.826527 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1c53056-98ea-4587-8097-d8790ddb86a4 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:43.827065 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1c53056-98ea-4587-8097-d8790ddb86a4 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:43.950659 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c14e6436-79be-42f7-88a3-eac084456853 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:43.963662 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c14e6436-79be-42f7-88a3-eac084456853 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:43.969254 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c14e6436-79be-42f7-88a3-eac084456853 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:43.997835 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c14e6436-79be-42f7-88a3-eac084456853 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.263152 Sep 24 20:50:43.998709 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 111/250] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:50:43 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:50:44.005533 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b1c53056-98ea-4587-8097-d8790ddb86a4 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 242 microversion: 2.1 time: 0.197298 Sep 24 20:50:44.006905 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 140/251] 10.222.0.52 () {60 vars in 1194 bytes} [Sat Sep 24 20:50:43 2022] POST /compute/v2.1/os-aggregates/11/action => generated 242 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:44.008763 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-20688c70-39d2-4e9f-ad9e-f58a92f4f1d7 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:44.011914 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-20688c70-39d2-4e9f-ad9e-f58a92f4f1d7 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 9b0e9940-f6ac-46d5-8898-1e4ba56119b3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:44.020376 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6ec8f066-a500-4422-876f-d29b549469ea tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:44.034064 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-20688c70-39d2-4e9f-ad9e-f58a92f4f1d7 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:44.034443 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-20688c70-39d2-4e9f-ad9e-f58a92f4f1d7 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:44.035008 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-20688c70-39d2-4e9f-ad9e-f58a92f4f1d7 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:44.035834 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-20688c70-39d2-4e9f-ad9e-f58a92f4f1d7 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:44.036208 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-20688c70-39d2-4e9f-ad9e-f58a92f4f1d7 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:44.036776 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-20688c70-39d2-4e9f-ad9e-f58a92f4f1d7 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:44.037459 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ec8f066-a500-4422-876f-d29b549469ea tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:44.038766 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ec8f066-a500-4422-876f-d29b549469ea tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:44.039477 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ec8f066-a500-4422-876f-d29b549469ea tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:44.060935 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:50:44.250665 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6ec8f066-a500-4422-876f-d29b549469ea tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.235447 Sep 24 20:50:44.251400 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 141/252] 10.222.0.52 () {60 vars in 1194 bytes} [Sat Sep 24 20:50:44 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:50:44.264560 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-442b5905-2c51-4042-b724-9bb74f7e6c58 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:44.265525 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-442b5905-2c51-4042-b724-9bb74f7e6c58 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 59b0e336-5d09-43b8-b126-6b8e0a33f813] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:44.276125 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-442b5905-2c51-4042-b724-9bb74f7e6c58 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:44.277073 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-442b5905-2c51-4042-b724-9bb74f7e6c58 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:44.279752 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-442b5905-2c51-4042-b724-9bb74f7e6c58 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:44.279752 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-442b5905-2c51-4042-b724-9bb74f7e6c58 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:44.280325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-442b5905-2c51-4042-b724-9bb74f7e6c58 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:44.280848 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-442b5905-2c51-4042-b724-9bb74f7e6c58 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:44.341050 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-20688c70-39d2-4e9f-ad9e-f58a92f4f1d7 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.340182 Sep 24 20:50:44.349603 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 112/253] 10.222.0.52 () {58 vars in 1275 bytes} [Sat Sep 24 20:50:43 2022] GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3/os-interface => generated 285 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:44.353173 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bc794d15-578f-4cef-a9c9-55a1f5f63ea9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:44.353807 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bc794d15-578f-4cef-a9c9-55a1f5f63ea9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:44.364115 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bc794d15-578f-4cef-a9c9-55a1f5f63ea9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:44.364567 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bc794d15-578f-4cef-a9c9-55a1f5f63ea9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:44.365018 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bc794d15-578f-4cef-a9c9-55a1f5f63ea9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:44.366378 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bc794d15-578f-4cef-a9c9-55a1f5f63ea9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:44.366378 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bc794d15-578f-4cef-a9c9-55a1f5f63ea9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:44.368378 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bc794d15-578f-4cef-a9c9-55a1f5f63ea9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:44.689305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-442b5905-2c51-4042-b724-9bb74f7e6c58 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8a91794144d73a8942f5c3bac8cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3800968cd944059a397e9c6b35f976d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:44.697540 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-442b5905-2c51-4042-b724-9bb74f7e6c58 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813" status: 200 len: 1318 microversion: 2.1 time: 0.444855 Sep 24 20:50:44.713572 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 142/254] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:44 2022] GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813 => generated 1318 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:44.718532 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-28e51c76-7c9c-43ce-a81a-c08acdb9d938 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:44.757917 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-28e51c76-7c9c-43ce-a81a-c08acdb9d938 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.033371 Sep 24 20:50:44.763175 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 143/255] 10.222.0.52 () {58 vars in 1155 bytes} [Sat Sep 24 20:50:44 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 24 20:50:44.774938 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ae83677b-e838-4abd-a708-3a01f19cf7bf tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1709220711"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:44.778874 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bc794d15-578f-4cef-a9c9-55a1f5f63ea9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:44.779986 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.aggregate [None req-ae83677b-e838-4abd-a708-3a01f19cf7bf tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Generated uuid a776604f-69a4-4ec5-8315-564169601ace for aggregate {{(pid=140516) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 24 20:50:44.789870 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bc794d15-578f-4cef-a9c9-55a1f5f63ea9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1312 microversion: 2.1 time: 0.446436 Sep 24 20:50:44.790476 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 113/256] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:44 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1312 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:44.813665 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-06129637-22c1-4cf9-9eee-70f667f8d154 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-384600010"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:44.818268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.aggregate [None req-06129637-22c1-4cf9-9eee-70f667f8d154 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Generated uuid f86f2719-411b-402a-9af2-799aea5ff1ec for aggregate {{(pid=140517) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 24 20:50:44.820961 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ae83677b-e838-4abd-a708-3a01f19cf7bf tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.054381 Sep 24 20:50:44.822301 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 144/257] 10.222.0.52 () {60 vars in 1164 bytes} [Sat Sep 24 20:50:44 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:44.835079 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-728a63c7-9315-4f88-a38d-6a6e1e869590 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:44.851175 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:DELETE=7 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:50:44.863493 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-06129637-22c1-4cf9-9eee-70f667f8d154 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.061394 Sep 24 20:50:44.870972 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 114/258] 10.222.0.52 () {60 vars in 1164 bytes} [Sat Sep 24 20:50:44 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:44.882211 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-05839ae5-f4bb-48fa-9535-9d882ebd4a82 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:44.889818 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-728a63c7-9315-4f88-a38d-6a6e1e869590 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.060175 Sep 24 20:50:44.891869 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 145/259] 10.222.0.52 () {58 vars in 1155 bytes} [Sat Sep 24 20:50:44 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 24 20:50:44.903867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3363705d-36cc-450e-8f3f-12a6222fee96 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:44.913078 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-3363705d-36cc-450e-8f3f-12a6222fee96 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Sep 24 20:50:44.915376 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3363705d-36cc-450e-8f3f-12a6222fee96 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Request method failure captured: Sep 24 20:50:44.915376 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Sep 24 20:50:44.915376 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:50:44.915376 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:50:44.915376 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:50:44.915376 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:50:44.915376 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:50:44.915376 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:50:44.915376 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:50:44.915376 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:50:44.915376 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL21k1U3-K_Q8V7lJbsDG7q9mfNX1H09Q_hPTN-nrXv01yoUCWxWGP6pHcUH7tyS1PwnMJ7NOcHNY-ytyYoOlMe0lVISt81pX9KLyQHwE7eK0SorGIqitX_S_lK03hDkA8s38aEVjfZ5NZrfrcXxaFB9HnJ3TvAqMAzNfUE5BrVwejRg Sep 24 20:50:44.915376 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:50:44.915376 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:50:44.915376 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:50:44.915376 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:50:44.915376 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:50:44.915376 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:50:44.915376 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 8d1158a2f81d4d5ba36d8b1462cc5df7 Sep 24 20:50:44.915376 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-AggregatesAdminTestJSON-1828080836 Sep 24 20:50:44.915376 ncdv-master-1 devstack@n-api.service[140516]: X-Role: admin,reader,member Sep 24 20:50:44.915376 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: admin,reader,member Sep 24 20:50:44.916653 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d1158a2f81d4d5ba36d8b1462cc5df7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8d1158a2f81d4d5ba36d8b1462cc5df7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8d1158a2f81d4d5ba36d8b1462cc5df7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d1158a2f81d4d5ba36d8b1462cc5df7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:50:44.916653 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-AggregatesAdminTestJSON-1828080836 Sep 24 20:50:44.916653 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 8d1158a2f81d4d5ba36d8b1462cc5df7 Sep 24 20:50:44.916653 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1828080836 Sep 24 20:50:44.916653 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-AggregatesAdminTestJSON-1828080836-project-admin Sep 24 20:50:44.916653 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:50:44.916653 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:50:44.916653 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: c96cbcb3dc994e45a66930828065645a Sep 24 20:50:44.916653 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-AggregatesAdminTestJSON-1828080836-project-admin Sep 24 20:50:44.916653 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:50:44.916653 ncdv-master-1 devstack@n-api.service[140516]: exception: Aggregate 12 could not be found. Sep 24 20:50:44.916653 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '12'} Sep 24 20:50:44.916653 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:50:44.917392 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:44.917392 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 24 20:50:44.917392 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 24 20:50:44.917392 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 24 20:50:44.917392 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 24 20:50:44.917392 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 20:50:44.917392 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 20:50:44.917392 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 24 20:50:44.917392 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 24 20:50:44.917392 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 24 20:50:44.917392 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 24 20:50:44.917392 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 24 20:50:44.917392 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 24 20:50:44.917392 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Sep 24 20:50:44.917392 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:44.917392 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:50:44.917392 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:44.917392 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:44.917392 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:50:44.918544 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:50:44.918544 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:50:44.918544 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:50:44.918544 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:50:44.918544 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:50:44.918544 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 24 20:50:44.918544 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:50:44.918544 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Sep 24 20:50:44.918544 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:44.918544 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:50:44.918544 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:44.918544 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:44.918544 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:50:44.918544 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:50:44.918544 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:50:44.918544 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:50:44.918544 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Sep 24 20:50:44.918544 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:44.920083 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05839ae5-f4bb-48fa-9535-9d882ebd4a82 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:44.920083 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05839ae5-f4bb-48fa-9535-9d882ebd4a82 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:44.920083 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05839ae5-f4bb-48fa-9535-9d882ebd4a82 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:44.923408 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3363705d-36cc-450e-8f3f-12a6222fee96 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:50:44.924613 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3363705d-36cc-450e-8f3f-12a6222fee96 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.028534 Sep 24 20:50:44.925769 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 146/260] 10.222.0.52 () {58 vars in 1152 bytes} [Sat Sep 24 20:50:44 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 20:50:44.937880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0b40d48e-fb4e-418c-b62e-184477782e7b tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:44.957243 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-0b40d48e-fb4e-418c-b62e-184477782e7b tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Sep 24 20:50:44.959780 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0b40d48e-fb4e-418c-b62e-184477782e7b tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Request method failure captured: Sep 24 20:50:44.959780 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Sep 24 20:50:44.959780 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:50:44.959780 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:50:44.959780 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:50:44.959780 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:50:44.959780 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:50:44.959780 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:50:44.959780 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:50:44.959780 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:50:44.959780 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL21k1U3-K_Q8V7lJbsDG7q9mfNX1H09Q_hPTN-nrXv01yoUCWxWGP6pHcUH7tyS1PwnMJ7NOcHNY-ytyYoOlMe0lVISt81pX9KLyQHwE7eK0SorGIqitX_S_lK03hDkA8s38aEVjfZ5NZrfrcXxaFB9HnJ3TvAqMAzNfUE5BrVwejRg Sep 24 20:50:44.959780 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:50:44.959780 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:50:44.959780 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:50:44.959780 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:50:44.959780 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:50:44.959780 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:50:44.959780 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 8d1158a2f81d4d5ba36d8b1462cc5df7 Sep 24 20:50:44.959780 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-AggregatesAdminTestJSON-1828080836 Sep 24 20:50:44.959780 ncdv-master-1 devstack@n-api.service[140516]: X-Role: admin,reader,member Sep 24 20:50:44.959780 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: admin,reader,member Sep 24 20:50:44.961458 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d1158a2f81d4d5ba36d8b1462cc5df7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8d1158a2f81d4d5ba36d8b1462cc5df7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8d1158a2f81d4d5ba36d8b1462cc5df7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d1158a2f81d4d5ba36d8b1462cc5df7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:50:44.961458 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-AggregatesAdminTestJSON-1828080836 Sep 24 20:50:44.961458 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 8d1158a2f81d4d5ba36d8b1462cc5df7 Sep 24 20:50:44.961458 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1828080836 Sep 24 20:50:44.961458 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-AggregatesAdminTestJSON-1828080836-project-admin Sep 24 20:50:44.961458 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:50:44.961458 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:50:44.961458 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: c96cbcb3dc994e45a66930828065645a Sep 24 20:50:44.961458 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-AggregatesAdminTestJSON-1828080836-project-admin Sep 24 20:50:44.961458 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:50:44.961458 ncdv-master-1 devstack@n-api.service[140516]: exception: Aggregate 12 could not be found. Sep 24 20:50:44.961458 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '12'} Sep 24 20:50:44.961458 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:50:44.962809 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:44.962809 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 24 20:50:44.962809 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 24 20:50:44.962809 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 24 20:50:44.962809 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 24 20:50:44.962809 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:50:44.962809 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:50:44.962809 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:50:44.962809 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:50:44.962809 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 24 20:50:44.962809 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 24 20:50:44.962809 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 24 20:50:44.962809 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 24 20:50:44.962809 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 20:50:44.962809 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 20:50:44.962809 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 24 20:50:44.962809 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 24 20:50:44.962809 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 24 20:50:44.962809 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 24 20:50:44.963896 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 24 20:50:44.963896 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 24 20:50:44.963896 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Sep 24 20:50:44.963896 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:44.963896 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:50:44.963896 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:44.963896 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:44.963896 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:50:44.963896 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:50:44.963896 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:50:44.963896 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:50:44.963896 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:50:44.963896 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:50:44.963896 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 24 20:50:44.963896 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:50:44.963896 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Sep 24 20:50:44.963896 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:44.963896 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:50:44.963896 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:44.963896 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:44.963896 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:50:44.964974 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:50:44.964974 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:50:44.964974 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:50:44.964974 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Sep 24 20:50:44.964974 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:44.964974 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0b40d48e-fb4e-418c-b62e-184477782e7b tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:50:44.964974 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0b40d48e-fb4e-418c-b62e-184477782e7b tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.031922 Sep 24 20:50:44.964974 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 147/261] 10.222.0.52 () {58 vars in 1155 bytes} [Sat Sep 24 20:50:44 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 24 20:50:44.988870 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-14f5639f-90be-46f5-88da-86e8e81c915d tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1329108381", "name": "tempest-test_aggregate-1816547203"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:44.999179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.aggregate [None req-14f5639f-90be-46f5-88da-86e8e81c915d tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Generated uuid 3eeca248-0b28-4188-b47c-985881053f16 for aggregate {{(pid=140516) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 24 20:50:45.037587 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-14f5639f-90be-46f5-88da-86e8e81c915d tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.067691 Sep 24 20:50:45.040078 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 148/262] 10.222.0.52 () {60 vars in 1165 bytes} [Sat Sep 24 20:50:44 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:45.061640 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2dc9c4fc-f40e-42df-95d9-d2854bd91c6b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:45.064628 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2dc9c4fc-f40e-42df-95d9-d2854bd91c6b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:45.084832 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2dc9c4fc-f40e-42df-95d9-d2854bd91c6b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:45.085604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2dc9c4fc-f40e-42df-95d9-d2854bd91c6b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:45.087027 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2dc9c4fc-f40e-42df-95d9-d2854bd91c6b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:45.088424 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2dc9c4fc-f40e-42df-95d9-d2854bd91c6b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:45.089711 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2dc9c4fc-f40e-42df-95d9-d2854bd91c6b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:45.092174 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2dc9c4fc-f40e-42df-95d9-d2854bd91c6b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:45.157081 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-05839ae5-f4bb-48fa-9535-9d882ebd4a82 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 242 microversion: 2.1 time: 0.284405 Sep 24 20:50:45.157720 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 115/263] 10.222.0.52 () {60 vars in 1194 bytes} [Sat Sep 24 20:50:44 2022] POST /compute/v2.1/os-aggregates/13/action => generated 242 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:45.162322 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8fc41320-4e08-4088-816b-8a3fa2454668 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:45.206817 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2dc9c4fc-f40e-42df-95d9-d2854bd91c6b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:45.212435 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8fc41320-4e08-4088-816b-8a3fa2454668 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.053593 Sep 24 20:50:45.213040 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 116/264] 10.222.0.52 () {58 vars in 1155 bytes} [Sat Sep 24 20:50:45 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 24 20:50:45.218582 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ee449df3-5dc9-409a-be26-a1be8a6988c0 tempest-AggregatesAdminNegativeTestJSON-1230891279 tempest-AggregatesAdminNegativeTestJSON-1230891279-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:45.220200 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2dc9c4fc-f40e-42df-95d9-d2854bd91c6b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:45.221693 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2dc9c4fc-f40e-42df-95d9-d2854bd91c6b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:45.222044 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ee449df3-5dc9-409a-be26-a1be8a6988c0 tempest-AggregatesAdminNegativeTestJSON-1230891279 tempest-AggregatesAdminNegativeTestJSON-1230891279-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '7af773989be84d47a75f107f9acc8c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea3cc3ecfc941758415b8324faf7644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:45.223731 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ee449df3-5dc9-409a-be26-a1be8a6988c0 tempest-AggregatesAdminNegativeTestJSON-1230891279 tempest-AggregatesAdminNegativeTestJSON-1230891279-project] Request method failure captured: Sep 24 20:50:45.223731 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Sep 24 20:50:45.223731 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:50:45.223731 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:50:45.223731 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:50:45.223731 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 42 Sep 24 20:50:45.223731 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:50:45.223731 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:50:45.223731 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:50:45.223731 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:50:45.223731 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL21f4RaHWOrhnWIuWpqpkYL7mjtuC3JO0zkKes6TNKdr9u-3PrJszigST82y1DkYyYALY5dcIqGyY_wqVkqcf1PlFdiccA0koW5cnrJibJwQ7J25YdRK_gokc5lYfP_EUDwUNskhksknLFgudTSUIRQj8Uexajfgt9ef1kslJZSDYDY Sep 24 20:50:45.223731 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:50:45.223731 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:50:45.223731 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:50:45.223731 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:50:45.223731 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:50:45.223731 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:50:45.223731 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 6ea3cc3ecfc941758415b8324faf7644 Sep 24 20:50:45.223731 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1230891279 Sep 24 20:50:45.223731 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:50:45.223731 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:50:45.225137 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6ea3cc3ecfc941758415b8324faf7644"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6ea3cc3ecfc941758415b8324faf7644"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6ea3cc3ecfc941758415b8324faf7644"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6ea3cc3ecfc941758415b8324faf7644"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:50:45.225137 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1230891279 Sep 24 20:50:45.225137 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 6ea3cc3ecfc941758415b8324faf7644 Sep 24 20:50:45.225137 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1230891279 Sep 24 20:50:45.225137 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-AggregatesAdminNegativeTestJSON-1230891279-project Sep 24 20:50:45.225137 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:50:45.225137 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:50:45.225137 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 7af773989be84d47a75f107f9acc8c69 Sep 24 20:50:45.225137 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1230891279-project Sep 24 20:50:45.225137 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 20:50:45.225137 ncdv-master-1 devstack@n-api.service[140517]: {"remove_host": {"host": "nch1-master-1"}} Sep 24 20:50:45.225137 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:50:45.225137 ncdv-master-1 devstack@n-api.service[140517]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 24 20:50:45.226035 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'nch1-master-1'}}} Sep 24 20:50:45.226035 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:50:45.226035 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:45.226035 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:50:45.226035 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:50:45.226035 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:50:45.226035 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:50:45.226035 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:50:45.226035 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:50:45.226035 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:50:45.226035 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:50:45.226035 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Sep 24 20:50:45.226035 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Sep 24 20:50:45.226035 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 24 20:50:45.226035 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 24 20:50:45.226035 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 24 20:50:45.226035 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 24 20:50:45.226035 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:50:45.226035 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:50:45.227388 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:50:45.227388 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:50:45.227388 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 24 20:50:45.227388 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 24 20:50:45.227388 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 24 20:50:45.227388 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 24 20:50:45.227388 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 24 20:50:45.227388 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 24 20:50:45.227388 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 24 20:50:45.227388 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:45.227388 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:50:45.227388 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:45.227388 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:45.227388 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:50:45.227388 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:50:45.227388 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 24 20:50:45.227388 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 24 20:50:45.227388 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 24 20:50:45.227388 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:45.228700 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ee449df3-5dc9-409a-be26-a1be8a6988c0 tempest-AggregatesAdminNegativeTestJSON-1230891279 tempest-AggregatesAdminNegativeTestJSON-1230891279-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:50:45.228700 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ee449df3-5dc9-409a-be26-a1be8a6988c0 tempest-AggregatesAdminNegativeTestJSON-1230891279 tempest-AggregatesAdminNegativeTestJSON-1230891279-project] 10.222.0.52 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.010890 Sep 24 20:50:45.228700 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 117/265] 10.222.0.52 () {60 vars in 1194 bytes} [Sat Sep 24 20:50:45 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:50:45.251092 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e440abd7-9d79-44f6-a979-8fd22fd2b09b tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:45.251944 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2dc9c4fc-f40e-42df-95d9-d2854bd91c6b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.210033 Sep 24 20:50:45.253049 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 149/266] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:50:45 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:50:45.264392 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-e440abd7-9d79-44f6-a979-8fd22fd2b09b tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Sep 24 20:50:45.270091 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-49611b47-e21c-4511-8b51-a979bed41586 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:45.271291 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e440abd7-9d79-44f6-a979-8fd22fd2b09b tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Request method failure captured: Sep 24 20:50:45.271291 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Sep 24 20:50:45.271291 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:50:45.271291 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:50:45.271291 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:50:45.271291 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:50:45.271291 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:50:45.271291 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:50:45.271291 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:50:45.271291 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:50:45.271291 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL21k1U3-K_Q8V7lJbsDG7q9mfNX1H09Q_hPTN-nrXv01yoUCWxWGP6pHcUH7tyS1PwnMJ7NOcHNY-ytyYoOlMe0lVISt81pX9KLyQHwE7eK0SorGIqitX_S_lK03hDkA8s38aEVjfZ5NZrfrcXxaFB9HnJ3TvAqMAzNfUE5BrVwejRg Sep 24 20:50:45.271291 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:50:45.271291 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:50:45.271291 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:50:45.271291 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:50:45.271291 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:50:45.271291 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:50:45.271291 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 8d1158a2f81d4d5ba36d8b1462cc5df7 Sep 24 20:50:45.271291 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-AggregatesAdminTestJSON-1828080836 Sep 24 20:50:45.271291 ncdv-master-1 devstack@n-api.service[140517]: X-Role: admin,reader,member Sep 24 20:50:45.271291 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: admin,reader,member Sep 24 20:50:45.272471 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d1158a2f81d4d5ba36d8b1462cc5df7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8d1158a2f81d4d5ba36d8b1462cc5df7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8d1158a2f81d4d5ba36d8b1462cc5df7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d1158a2f81d4d5ba36d8b1462cc5df7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:50:45.272471 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-AggregatesAdminTestJSON-1828080836 Sep 24 20:50:45.272471 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 8d1158a2f81d4d5ba36d8b1462cc5df7 Sep 24 20:50:45.272471 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1828080836 Sep 24 20:50:45.272471 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-AggregatesAdminTestJSON-1828080836-project-admin Sep 24 20:50:45.272471 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:50:45.272471 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:50:45.272471 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: c96cbcb3dc994e45a66930828065645a Sep 24 20:50:45.272471 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-AggregatesAdminTestJSON-1828080836-project-admin Sep 24 20:50:45.272471 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:50:45.272471 ncdv-master-1 devstack@n-api.service[140517]: exception: Aggregate 14 could not be found. Sep 24 20:50:45.272471 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '14'} Sep 24 20:50:45.272471 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:50:45.273170 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:45.273170 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 24 20:50:45.273170 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 24 20:50:45.273170 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 24 20:50:45.273170 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 24 20:50:45.273170 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 20:50:45.273170 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 20:50:45.273170 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 24 20:50:45.273170 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 24 20:50:45.273170 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 24 20:50:45.273170 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 24 20:50:45.273170 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 24 20:50:45.273170 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 24 20:50:45.273170 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Sep 24 20:50:45.273170 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:45.273170 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:50:45.273170 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:45.273170 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:45.273170 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:50:45.274459 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:50:45.274459 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:50:45.274459 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:50:45.274459 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:50:45.274459 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:50:45.274459 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 24 20:50:45.274459 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:50:45.274459 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Sep 24 20:50:45.274459 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:45.274459 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:50:45.274459 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:45.274459 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:45.274459 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:50:45.274459 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:50:45.274459 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:50:45.274459 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:50:45.274459 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Sep 24 20:50:45.274459 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:45.278479 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e440abd7-9d79-44f6-a979-8fd22fd2b09b tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:50:45.278479 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e440abd7-9d79-44f6-a979-8fd22fd2b09b tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.046242 Sep 24 20:50:45.278479 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 118/267] 10.222.0.52 () {58 vars in 1152 bytes} [Sat Sep 24 20:50:45 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 20:50:45.289373 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ed7a2c7b-9e94-42d7-8fe7-3fe29e40c9c8 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:45.303511 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-49611b47-e21c-4511-8b51-a979bed41586 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:45.304449 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-49611b47-e21c-4511-8b51-a979bed41586 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:45.305240 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-49611b47-e21c-4511-8b51-a979bed41586 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:45.320191 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-ed7a2c7b-9e94-42d7-8fe7-3fe29e40c9c8 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Sep 24 20:50:45.322641 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ed7a2c7b-9e94-42d7-8fe7-3fe29e40c9c8 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Request method failure captured: Sep 24 20:50:45.322641 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Sep 24 20:50:45.322641 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:50:45.322641 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:50:45.322641 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:50:45.322641 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:50:45.322641 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:50:45.322641 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:50:45.322641 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:50:45.322641 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:50:45.322641 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL21k1U3-K_Q8V7lJbsDG7q9mfNX1H09Q_hPTN-nrXv01yoUCWxWGP6pHcUH7tyS1PwnMJ7NOcHNY-ytyYoOlMe0lVISt81pX9KLyQHwE7eK0SorGIqitX_S_lK03hDkA8s38aEVjfZ5NZrfrcXxaFB9HnJ3TvAqMAzNfUE5BrVwejRg Sep 24 20:50:45.322641 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:50:45.322641 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:50:45.322641 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:50:45.322641 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:50:45.322641 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:50:45.322641 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:50:45.322641 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 8d1158a2f81d4d5ba36d8b1462cc5df7 Sep 24 20:50:45.322641 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-AggregatesAdminTestJSON-1828080836 Sep 24 20:50:45.322641 ncdv-master-1 devstack@n-api.service[140517]: X-Role: admin,reader,member Sep 24 20:50:45.322641 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: admin,reader,member Sep 24 20:50:45.323814 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d1158a2f81d4d5ba36d8b1462cc5df7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8d1158a2f81d4d5ba36d8b1462cc5df7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8d1158a2f81d4d5ba36d8b1462cc5df7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d1158a2f81d4d5ba36d8b1462cc5df7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:50:45.323814 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-AggregatesAdminTestJSON-1828080836 Sep 24 20:50:45.323814 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 8d1158a2f81d4d5ba36d8b1462cc5df7 Sep 24 20:50:45.323814 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1828080836 Sep 24 20:50:45.323814 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-AggregatesAdminTestJSON-1828080836-project-admin Sep 24 20:50:45.323814 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:50:45.323814 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:50:45.323814 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: c96cbcb3dc994e45a66930828065645a Sep 24 20:50:45.323814 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-AggregatesAdminTestJSON-1828080836-project-admin Sep 24 20:50:45.323814 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:50:45.323814 ncdv-master-1 devstack@n-api.service[140517]: exception: Aggregate 14 could not be found. Sep 24 20:50:45.323814 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '14'} Sep 24 20:50:45.323814 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:50:45.324499 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:45.324499 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 24 20:50:45.324499 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 24 20:50:45.324499 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 24 20:50:45.324499 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 24 20:50:45.324499 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:50:45.324499 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:50:45.324499 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:50:45.324499 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:50:45.324499 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 24 20:50:45.324499 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 24 20:50:45.324499 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 24 20:50:45.324499 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 24 20:50:45.324499 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 20:50:45.324499 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 20:50:45.324499 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 24 20:50:45.324499 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 24 20:50:45.324499 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 24 20:50:45.324499 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 24 20:50:45.326441 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 24 20:50:45.326441 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 24 20:50:45.326441 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Sep 24 20:50:45.326441 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:45.326441 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:50:45.326441 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:45.326441 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:45.326441 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:50:45.326441 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:50:45.326441 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:50:45.326441 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:50:45.326441 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:50:45.326441 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:50:45.326441 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 24 20:50:45.326441 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:50:45.326441 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Sep 24 20:50:45.326441 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:45.326441 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:50:45.326441 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:45.326441 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:45.326441 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:50:45.329377 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:50:45.329377 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:50:45.329377 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:50:45.329377 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Sep 24 20:50:45.329377 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:45.329377 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ed7a2c7b-9e94-42d7-8fe7-3fe29e40c9c8 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:50:45.329377 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ed7a2c7b-9e94-42d7-8fe7-3fe29e40c9c8 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.045073 Sep 24 20:50:45.329377 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 119/268] 10.222.0.52 () {58 vars in 1155 bytes} [Sat Sep 24 20:50:45 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 20:50:45.338036 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8ad0ac0b-77d2-4895-83bf-6069e9cc62ef tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-943760566"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:45.348665 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.aggregate [None req-8ad0ac0b-77d2-4895-83bf-6069e9cc62ef tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Generated uuid 304ecf5e-6349-40dc-a3a8-770dc63c0398 for aggregate {{(pid=140517) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 24 20:50:45.390520 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8ad0ac0b-77d2-4895-83bf-6069e9cc62ef tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.056865 Sep 24 20:50:45.391452 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 120/269] 10.222.0.52 () {60 vars in 1164 bytes} [Sat Sep 24 20:50:45 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:45.411224 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cd23cf2f-0bfb-4b6a-9e0a-666658d5f3b7 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:45.421797 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cd23cf2f-0bfb-4b6a-9e0a-666658d5f3b7 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 227 microversion: 2.1 time: 0.020526 Sep 24 20:50:45.422718 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 121/270] 10.222.0.52 () {58 vars in 1152 bytes} [Sat Sep 24 20:50:45 2022] GET /compute/v2.1/os-aggregates/15 => generated 227 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:45.439396 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ed550095-da81-4ff9-a2f0-7ae7137833d2 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:45.468906 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ed550095-da81-4ff9-a2f0-7ae7137833d2 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 265 microversion: 2.1 time: 0.036876 Sep 24 20:50:45.470079 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 122/271] 10.222.0.52 () {60 vars in 1194 bytes} [Sat Sep 24 20:50:45 2022] POST /compute/v2.1/os-aggregates/15/action => generated 265 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:45.488203 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f10db44f-aea3-4de4-b718-1e46fa1ea50e tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:45.499213 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f10db44f-aea3-4de4-b718-1e46fa1ea50e tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 241 microversion: 2.1 time: 0.021917 Sep 24 20:50:45.505721 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 123/272] 10.222.0.52 () {58 vars in 1152 bytes} [Sat Sep 24 20:50:45 2022] GET /compute/v2.1/os-aggregates/15 => generated 241 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:45.522476 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1afd4ac2-be90-42a8-a97e-e1566bd9afdb tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:45.537980 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-49611b47-e21c-4511-8b51-a979bed41586 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 227 microversion: 2.1 time: 0.283523 Sep 24 20:50:45.538801 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 150/273] 10.222.0.52 () {60 vars in 1194 bytes} [Sat Sep 24 20:50:45 2022] POST /compute/v2.1/os-aggregates/13/action => generated 227 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:45.555425 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b7b6aa21-aa5b-4200-aec2-534bc9fb8fd5 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:45.570355 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1afd4ac2-be90-42a8-a97e-e1566bd9afdb tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.058530 Sep 24 20:50:45.570716 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 124/274] 10.222.0.52 () {58 vars in 1155 bytes} [Sat Sep 24 20:50:45 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 24 20:50:45.583994 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1678a35f-5589-4dd8-9a05-d645e29755d6 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-44064420", "availability_zone": "tempest-test_az-157818087"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:45.593918 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b7b6aa21-aa5b-4200-aec2-534bc9fb8fd5 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.047034 Sep 24 20:50:45.594872 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 151/275] 10.222.0.52 () {58 vars in 1155 bytes} [Sat Sep 24 20:50:45 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 24 20:50:45.604002 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-93ef9aef-4ca9-4f74-afc7-9542560a8690 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1525240211"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:45.607663 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.aggregate [None req-93ef9aef-4ca9-4f74-afc7-9542560a8690 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Generated uuid 56d5e1c1-5103-4330-b0f5-eb8530622a57 for aggregate {{(pid=140516) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 24 20:50:45.629021 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.aggregate [None req-1678a35f-5589-4dd8-9a05-d645e29755d6 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Generated uuid e466fcf7-5426-4229-bb4f-0b6697997230 for aggregate {{(pid=140517) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 24 20:50:45.638475 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-93ef9aef-4ca9-4f74-afc7-9542560a8690 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.037212 Sep 24 20:50:45.642958 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 152/276] 10.222.0.52 () {60 vars in 1164 bytes} [Sat Sep 24 20:50:45 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:50:45.656135 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-91de644c-6051-4f7d-a910-1a890fab56e7 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:45.676300 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1678a35f-5589-4dd8-9a05-d645e29755d6 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.096960 Sep 24 20:50:45.677433 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 125/277] 10.222.0.52 () {60 vars in 1165 bytes} [Sat Sep 24 20:50:45 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:45.679466 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-91de644c-6051-4f7d-a910-1a890fab56e7 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:45.679963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-91de644c-6051-4f7d-a910-1a890fab56e7 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:45.680405 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-91de644c-6051-4f7d-a910-1a890fab56e7 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:45.689037 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-91de644c-6051-4f7d-a910-1a890fab56e7 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:45.689395 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c0c96391-20d8-4d98-a6d4-d88e6812d149 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-44064420_new", "availability_zone": "tempest-test_az-157818087_new"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:45.689542 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-91de644c-6051-4f7d-a910-1a890fab56e7 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:45.689978 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-91de644c-6051-4f7d-a910-1a890fab56e7 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:45.705859 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.compute.aggregates [None req-91de644c-6051-4f7d-a910-1a890fab56e7 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Failed to remove host nonexist_host from aggregate 16. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 24 20:50:45.706390 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-91de644c-6051-4f7d-a910-1a890fab56e7 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 16 Sep 24 20:50:45.708675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-91de644c-6051-4f7d-a910-1a890fab56e7 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Request method failure captured: Sep 24 20:50:45.708675 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/os-aggregates/16/action HTTP/1.1 Sep 24 20:50:45.708675 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:50:45.708675 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:50:45.708675 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:50:45.708675 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 42 Sep 24 20:50:45.708675 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:50:45.708675 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:50:45.708675 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:50:45.708675 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:50:45.708675 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL21hJ1CF2mkJt96SF7DXZ-9JiF-EYzXLBX_u18XtsNx4b5ZsbCRUZiIBh8c91Zj8sUeE_NpuXiCn8rHgr7lpUQJ_sg_RfrSOzo6ap18kYx-Cjq5KPhNfIuZAcscKQLqI9EupePrTfOxBsrQGp58MXaN4jwib7gEdIeMceQ-kLhleWb0 Sep 24 20:50:45.708675 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:50:45.708675 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:50:45.708675 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:50:45.708675 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:50:45.708675 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:50:45.708675 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:50:45.708675 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 79afe6f2d12f45e994b77b96c44f8239 Sep 24 20:50:45.708675 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-422514215 Sep 24 20:50:45.708675 ncdv-master-1 devstack@n-api.service[140516]: X-Role: admin,reader,member Sep 24 20:50:45.708675 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: admin,reader,member Sep 24 20:50:45.710156 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/79afe6f2d12f45e994b77b96c44f8239"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_79afe6f2d12f45e994b77b96c44f8239"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/79afe6f2d12f45e994b77b96c44f8239"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/79afe6f2d12f45e994b77b96c44f8239"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:50:45.710156 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-422514215 Sep 24 20:50:45.710156 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 79afe6f2d12f45e994b77b96c44f8239 Sep 24 20:50:45.710156 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-422514215 Sep 24 20:50:45.710156 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin Sep 24 20:50:45.710156 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:50:45.710156 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:50:45.710156 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 64a47c4d366e4af88ff0386e79158e85 Sep 24 20:50:45.710156 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin Sep 24 20:50:45.710156 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 20:50:45.710156 ncdv-master-1 devstack@n-api.service[140516]: {"remove_host": {"host": "nonexist_host"}} Sep 24 20:50:45.710156 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:50:45.710156 ncdv-master-1 devstack@n-api.service[140516]: exception: Cannot remove host nonexist_host in aggregate 16 Sep 24 20:50:45.711089 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '16', 'body': {'remove_host': {'host': 'nonexist_host'}}} Sep 24 20:50:45.711089 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:50:45.711089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:45.711089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 24 20:50:45.711089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 24 20:50:45.711089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 20:50:45.711089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 20:50:45.711089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 24 20:50:45.711089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 24 20:50:45.711089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 24 20:50:45.711089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 24 20:50:45.711089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 24 20:50:45.711089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 24 20:50:45.711089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Sep 24 20:50:45.711089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:45.711089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:50:45.711089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:45.711089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:45.711089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 24 20:50:45.711089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 24 20:50:45.712395 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 24 20:50:45.712395 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 24 20:50:45.712395 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 24 20:50:45.712395 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:45.712395 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:50:45.712395 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:45.712395 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:45.712395 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Sep 24 20:50:45.712395 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Sep 24 20:50:45.712395 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 24 20:50:45.712395 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 24 20:50:45.712395 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:50:45.712395 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:50:45.712395 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:50:45.712395 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:50:45.712395 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 24 20:50:45.712395 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 24 20:50:45.712395 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Sep 24 20:50:45.712395 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Sep 24 20:50:45.712395 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 24 20:50:45.713659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 24 20:50:45.713659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 24 20:50:45.713659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:45.713659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:50:45.713659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:45.713659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:45.713659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:50:45.713659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:50:45.713659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:50:45.713659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:50:45.713659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:50:45.713659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:50:45.713659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:50:45.713659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:50:45.713659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Sep 24 20:50:45.713659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 24 20:50:45.713659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 16 Sep 24 20:50:45.713659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:45.713659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:50:45.713659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:45.713659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:45.715150 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:50:45.715150 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:50:45.715150 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:50:45.715150 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:50:45.715150 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 16 Sep 24 20:50:45.715150 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:50:45.715150 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-91de644c-6051-4f7d-a910-1a890fab56e7 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 16 {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:50:45.715150 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-91de644c-6051-4f7d-a910-1a890fab56e7 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/16/action" status: 404 len: 94 microversion: 2.1 time: 0.062555 Sep 24 20:50:45.715150 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 153/278] 10.222.0.52 () {60 vars in 1194 bytes} [Sat Sep 24 20:50:45 2022] POST /compute/v2.1/os-aggregates/16/action => generated 94 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 20:50:45.723500 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-65523532-abb8-45a1-898a-dd4fea59a5df tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:45.724126 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-65523532-abb8-45a1-898a-dd4fea59a5df tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 59b0e336-5d09-43b8-b126-6b8e0a33f813] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:45.732593 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65523532-abb8-45a1-898a-dd4fea59a5df tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:45.733258 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65523532-abb8-45a1-898a-dd4fea59a5df tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:45.733713 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65523532-abb8-45a1-898a-dd4fea59a5df tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:45.734960 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65523532-abb8-45a1-898a-dd4fea59a5df tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:45.735875 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65523532-abb8-45a1-898a-dd4fea59a5df tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:45.736243 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65523532-abb8-45a1-898a-dd4fea59a5df tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:45.749620 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0c96391-20d8-4d98-a6d4-d88e6812d149 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:45.750382 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0c96391-20d8-4d98-a6d4-d88e6812d149 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:45.751514 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0c96391-20d8-4d98-a6d4-d88e6812d149 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:45.801074 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c0c96391-20d8-4d98-a6d4-d88e6812d149 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 333 microversion: 2.1 time: 0.115536 Sep 24 20:50:45.802309 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 126/279] 10.222.0.52 () {60 vars in 1173 bytes} [Sat Sep 24 20:50:45 2022] PUT /compute/v2.1/os-aggregates/17 => generated 333 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:50:45.820498 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ffbec233-2013-4659-a42b-cb7d53083b42 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:45.848853 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ffbec233-2013-4659-a42b-cb7d53083b42 tempest-AggregatesAdminNegativeTestJSON-422514215 tempest-AggregatesAdminNegativeTestJSON-422514215-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.043461 Sep 24 20:50:45.850215 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 127/280] 10.222.0.52 () {58 vars in 1155 bytes} [Sat Sep 24 20:50:45 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 24 20:50:45.869623 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fa646d57-c3bc-4bf0-a887-a9e5533d82b0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:45.870312 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fa646d57-c3bc-4bf0-a887-a9e5533d82b0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:45.889913 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa646d57-c3bc-4bf0-a887-a9e5533d82b0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:45.894150 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa646d57-c3bc-4bf0-a887-a9e5533d82b0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:45.894978 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa646d57-c3bc-4bf0-a887-a9e5533d82b0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:45.896013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa646d57-c3bc-4bf0-a887-a9e5533d82b0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:45.896637 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa646d57-c3bc-4bf0-a887-a9e5533d82b0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:45.899096 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa646d57-c3bc-4bf0-a887-a9e5533d82b0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:45.925533 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-65523532-abb8-45a1-898a-dd4fea59a5df tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8a91794144d73a8942f5c3bac8cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3800968cd944059a397e9c6b35f976d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:45.934603 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-65523532-abb8-45a1-898a-dd4fea59a5df tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813" status: 200 len: 1318 microversion: 2.1 time: 0.214856 Sep 24 20:50:45.935505 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 154/281] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:45 2022] GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:45.961803 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-17fe2ea9-75a7-48ad-90df-f59e55ab1934 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:45.984431 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-17fe2ea9-75a7-48ad-90df-f59e55ab1934 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates" status: 200 len: 336 microversion: 2.1 time: 0.047101 Sep 24 20:50:45.986614 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 155/282] 10.222.0.52 () {58 vars in 1143 bytes} [Sat Sep 24 20:50:45 2022] GET /compute/v2.1/os-aggregates => generated 336 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:46.005028 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e230ae49-9924-4a02-a8ad-06fcd5d06c75 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:46.056511 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e230ae49-9924-4a02-a8ad-06fcd5d06c75 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.062017 Sep 24 20:50:46.057103 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 156/283] 10.222.0.52 () {58 vars in 1155 bytes} [Sat Sep 24 20:50:45 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 24 20:50:46.145496 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fa646d57-c3bc-4bf0-a887-a9e5533d82b0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:46.155412 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fa646d57-c3bc-4bf0-a887-a9e5533d82b0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1462 microversion: 2.1 time: 0.303121 Sep 24 20:50:46.160254 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 128/284] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:45 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1462 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:46.172246 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7f42917a-d996-4097-9ccd-ac13425929aa tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-578118921"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:46.173887 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6bff4e80-ffab-48f6-8511-a60e5084055e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1818058060", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "89b13b8f-db96-4ded-b022-c0f1faad59f4"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:46.181002 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.aggregate [None req-7f42917a-d996-4097-9ccd-ac13425929aa tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Generated uuid a657c21b-b443-4178-8a35-b4b6b0bcf932 for aggregate {{(pid=140517) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 24 20:50:46.243708 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7f42917a-d996-4097-9ccd-ac13425929aa tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.080089 Sep 24 20:50:46.245803 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 129/285] 10.222.0.52 () {60 vars in 1164 bytes} [Sat Sep 24 20:50:46 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:46.272233 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-6bff4e80-ffab-48f6-8511-a60e5084055e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] validate_networks() for [('89b13b8f-db96-4ded-b022-c0f1faad59f4', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:50:46.660063 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-42cf7f5d-ce62-42dd-bf5a-54130b585786 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:46.661570 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-42cf7f5d-ce62-42dd-bf5a-54130b585786 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:46.670176 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-42cf7f5d-ce62-42dd-bf5a-54130b585786 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:46.671384 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-42cf7f5d-ce62-42dd-bf5a-54130b585786 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:46.671997 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-42cf7f5d-ce62-42dd-bf5a-54130b585786 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:46.673087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-42cf7f5d-ce62-42dd-bf5a-54130b585786 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:46.673715 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-42cf7f5d-ce62-42dd-bf5a-54130b585786 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:46.674401 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-42cf7f5d-ce62-42dd-bf5a-54130b585786 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:47.178455 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-42cf7f5d-ce62-42dd-bf5a-54130b585786 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1613 microversion: 2.1 time: 0.924612 Sep 24 20:50:47.179291 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 130/286] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:46 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1613 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:47.183856 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-89133fbd-7119-4f4f-baab-d6e4031d1037 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:47.202696 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-89133fbd-7119-4f4f-baab-d6e4031d1037 tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.021991 Sep 24 20:50:47.204040 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 131/287] 10.222.0.52 () {58 vars in 1143 bytes} [Sat Sep 24 20:50:47 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:47.209486 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a2c6a618-eb95-4d6a-b7cc-444a5c93e2cf tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:47.210289 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a2c6a618-eb95-4d6a-b7cc-444a5c93e2cf tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:47.218328 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a2c6a618-eb95-4d6a-b7cc-444a5c93e2cf tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:47.219174 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a2c6a618-eb95-4d6a-b7cc-444a5c93e2cf tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:47.219791 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a2c6a618-eb95-4d6a-b7cc-444a5c93e2cf tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:47.220808 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a2c6a618-eb95-4d6a-b7cc-444a5c93e2cf tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:47.221426 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a2c6a618-eb95-4d6a-b7cc-444a5c93e2cf tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:47.222027 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a2c6a618-eb95-4d6a-b7cc-444a5c93e2cf tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:47.323033 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a2c6a618-eb95-4d6a-b7cc-444a5c93e2cf tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:47.333630 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a2c6a618-eb95-4d6a-b7cc-444a5c93e2cf tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:47.339942 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a2c6a618-eb95-4d6a-b7cc-444a5c93e2cf tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:47.351910 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a2c6a618-eb95-4d6a-b7cc-444a5c93e2cf tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.146578 Sep 24 20:50:47.366524 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 132/288] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:50:47 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:50:47.366524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-299abdb5-7f02-42a4-aba2-7c46735efa46 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:47.366524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-299abdb5-7f02-42a4-aba2-7c46735efa46 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 59b0e336-5d09-43b8-b126-6b8e0a33f813] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:47.374767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-6bff4e80-ffab-48f6-8511-a60e5084055e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:50:47.374767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-6bff4e80-ffab-48f6-8511-a60e5084055e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:50:47.374767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-6bff4e80-ffab-48f6-8511-a60e5084055e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:50:47.375455 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-6bff4e80-ffab-48f6-8511-a60e5084055e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:50:47.375455 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-6bff4e80-ffab-48f6-8511-a60e5084055e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:50:47.383334 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-299abdb5-7f02-42a4-aba2-7c46735efa46 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:47.383766 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6,nova_api:DELETE=10 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:50:47.385285 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-299abdb5-7f02-42a4-aba2-7c46735efa46 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:47.386709 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-299abdb5-7f02-42a4-aba2-7c46735efa46 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:47.388296 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-299abdb5-7f02-42a4-aba2-7c46735efa46 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:47.388815 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-299abdb5-7f02-42a4-aba2-7c46735efa46 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:47.389256 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-299abdb5-7f02-42a4-aba2-7c46735efa46 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:47.400512 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6bff4e80-ffab-48f6-8511-a60e5084055e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:47.404671 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6bff4e80-ffab-48f6-8511-a60e5084055e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:47.405185 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6bff4e80-ffab-48f6-8511-a60e5084055e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:47.406023 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6bff4e80-ffab-48f6-8511-a60e5084055e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:47.410877 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6bff4e80-ffab-48f6-8511-a60e5084055e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:47.411481 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6bff4e80-ffab-48f6-8511-a60e5084055e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:47.464476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-6bff4e80-ffab-48f6-8511-a60e5084055e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Getting quotas for project a2b7e30f79bf42e497c53c091ad0a106. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:50:47.472087 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-6bff4e80-ffab-48f6-8511-a60e5084055e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Getting quotas for user 9c03c67e0c4c4de7a186f28ac10d0b92 and project a2b7e30f79bf42e497c53c091ad0a106. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:50:47.487489 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6bff4e80-ffab-48f6-8511-a60e5084055e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:50:47.490246 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6bff4e80-ffab-48f6-8511-a60e5084055e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:50:47.567799 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6bff4e80-ffab-48f6-8511-a60e5084055e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.508423 Sep 24 20:50:47.579226 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 157/289] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:50:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:50:47.590836 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b87bfa0b-cc7c-4f58-83c4-554f8bcbba0a tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:47.591859 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b87bfa0b-cc7c-4f58-83c4-554f8bcbba0a tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:47.604203 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b87bfa0b-cc7c-4f58-83c4-554f8bcbba0a tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:47.605554 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b87bfa0b-cc7c-4f58-83c4-554f8bcbba0a tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:47.607639 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b87bfa0b-cc7c-4f58-83c4-554f8bcbba0a tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:47.609143 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b87bfa0b-cc7c-4f58-83c4-554f8bcbba0a tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:47.611356 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b87bfa0b-cc7c-4f58-83c4-554f8bcbba0a tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:47.613341 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b87bfa0b-cc7c-4f58-83c4-554f8bcbba0a tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:47.715970 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-299abdb5-7f02-42a4-aba2-7c46735efa46 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8a91794144d73a8942f5c3bac8cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3800968cd944059a397e9c6b35f976d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:47.732137 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-299abdb5-7f02-42a4-aba2-7c46735efa46 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813" status: 200 len: 1318 microversion: 2.1 time: 0.378428 Sep 24 20:50:47.734940 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 133/290] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:47 2022] GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813 => generated 1318 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:47.751633 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ab8d384c-f28c-4547-8604-62902b76109c tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:47.786289 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ab8d384c-f28c-4547-8604-62902b76109c tempest-AggregatesAdminTestJSON-1828080836 tempest-AggregatesAdminTestJSON-1828080836-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.049674 Sep 24 20:50:47.786910 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 134/291] 10.222.0.52 () {58 vars in 1155 bytes} [Sat Sep 24 20:50:47 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 24 20:50:47.799970 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-029d91b7-1550-4b6f-b5de-0d0be135224d tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:47.805952 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-029d91b7-1550-4b6f-b5de-0d0be135224d tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:47.904908 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-029d91b7-1550-4b6f-b5de-0d0be135224d tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:47.913959 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-029d91b7-1550-4b6f-b5de-0d0be135224d tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5" status: 200 len: 1211 microversion: 2.1 time: 0.118159 Sep 24 20:50:47.929204 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 135/292] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:47 2022] GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 => generated 1211 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:47.934181 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-10d0774a-fcb5-4a54-a98c-f4fd8c47c350 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:47.934763 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-10d0774a-fcb5-4a54-a98c-f4fd8c47c350 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] [instance: 650cae0b-7b94-4c33-a526-5cc80548c0db] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:47.944892 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-10d0774a-fcb5-4a54-a98c-f4fd8c47c350 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:47.945394 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-10d0774a-fcb5-4a54-a98c-f4fd8c47c350 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:47.946425 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-10d0774a-fcb5-4a54-a98c-f4fd8c47c350 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:47.947245 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-10d0774a-fcb5-4a54-a98c-f4fd8c47c350 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:47.947644 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-10d0774a-fcb5-4a54-a98c-f4fd8c47c350 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:47.948077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-10d0774a-fcb5-4a54-a98c-f4fd8c47c350 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:47.950335 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b87bfa0b-cc7c-4f58-83c4-554f8bcbba0a tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4349ca208839405199602d34e1c7bf33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00041f889f3d430d87831f82a4d3b598', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:47.951227 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b87bfa0b-cc7c-4f58-83c4-554f8bcbba0a tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] flavor_id is None. Assuming migration. {{(pid=140516) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 24 20:50:47.951853 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b87bfa0b-cc7c-4f58-83c4-554f8bcbba0a tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=140516) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 24 20:50:47.985215 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-10d0774a-fcb5-4a54-a98c-f4fd8c47c350 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] HTTP exception thrown: Instance 650cae0b-7b94-4c33-a526-5cc80548c0db could not be found. Sep 24 20:50:47.992865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-10d0774a-fcb5-4a54-a98c-f4fd8c47c350 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Request method failure captured: Sep 24 20:50:47.992865 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db HTTP/1.1 Sep 24 20:50:47.992865 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:50:47.992865 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:50:47.992865 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:50:47.992865 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:50:47.992865 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:50:47.992865 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:50:47.992865 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:50:47.992865 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:50:47.992865 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL21hAokN1y2TX9ppXu7HBhRzEoJwzw5r3-z_TLzxnCl1pw5UEFWrAlF7tGaE7KP_yEI3JfTVO5i65_89EmyJQECO5JBG3xBfYxvmtYqi-Q6S15tziN9we3qusC2l-jk1zuzFFvziUheTkwqPl2BIQu3EABRjPM64nBT6vJu3WorZh44 Sep 24 20:50:47.992865 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:50:47.992865 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:50:47.992865 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:50:47.992865 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:50:47.992865 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:50:47.992865 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:50:47.992865 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: a9e62e74103b45cc81dfe7900c0baf5a Sep 24 20:50:47.992865 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-AggregatesAdminTestJSON-1167595380 Sep 24 20:50:47.992865 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:50:47.992865 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:50:47.994265 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a9e62e74103b45cc81dfe7900c0baf5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a9e62e74103b45cc81dfe7900c0baf5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a9e62e74103b45cc81dfe7900c0baf5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a9e62e74103b45cc81dfe7900c0baf5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:50:47.994265 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-AggregatesAdminTestJSON-1167595380 Sep 24 20:50:47.994265 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: a9e62e74103b45cc81dfe7900c0baf5a Sep 24 20:50:47.994265 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1167595380 Sep 24 20:50:47.994265 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-AggregatesAdminTestJSON-1167595380-project Sep 24 20:50:47.994265 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:50:47.994265 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:50:47.994265 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 2c01bfb1e8464616aceb3b73c958eb3f Sep 24 20:50:47.994265 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-AggregatesAdminTestJSON-1167595380-project Sep 24 20:50:47.994265 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:50:47.994265 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 650cae0b-7b94-4c33-a526-5cc80548c0db could not be found. Sep 24 20:50:47.994265 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '650cae0b-7b94-4c33-a526-5cc80548c0db'} Sep 24 20:50:47.995032 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:50:47.995032 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:47.995032 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:50:47.995032 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:50:47.995032 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:50:47.995032 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:50:47.995032 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:50:47.995032 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:50:47.995032 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:50:47.995032 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:50:47.995032 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 650cae0b-7b94-4c33-a526-5cc80548c0db could not be found. Sep 24 20:50:47.995032 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:47.995032 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:50:47.995032 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:47.995032 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:47.995032 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:50:47.995032 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:50:47.995032 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:50:47.995032 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:50:47.995032 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:50:47.996124 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:50:47.996124 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 20:50:47.996124 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 20:50:47.996124 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 20:50:47.996124 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 20:50:47.996124 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:50:47.996124 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:50:47.996124 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:50:47.996124 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:50:47.996124 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 650cae0b-7b94-4c33-a526-5cc80548c0db could not be found. Sep 24 20:50:47.996124 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:47.996124 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:50:47.996124 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:47.996124 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:47.996124 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:50:47.996124 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:50:47.996124 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:50:47.996124 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:50:47.996124 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 650cae0b-7b94-4c33-a526-5cc80548c0db could not be found. Sep 24 20:50:47.996124 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:47.997439 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-10d0774a-fcb5-4a54-a98c-f4fd8c47c350 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Returning 404 to user: Instance 650cae0b-7b94-4c33-a526-5cc80548c0db could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:50:47.997439 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-10d0774a-fcb5-4a54-a98c-f4fd8c47c350 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] 10.222.0.52 "DELETE /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db" status: 404 len: 111 microversion: 2.1 time: 0.074296 Sep 24 20:50:48.000483 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 136/293] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:50:47 2022] DELETE /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:50:48.005895 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-21341fdf-8cdd-4d21-ade5-26358620a763 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:48.006631 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-21341fdf-8cdd-4d21-ade5-26358620a763 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] [instance: 650cae0b-7b94-4c33-a526-5cc80548c0db] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:48.014374 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-21341fdf-8cdd-4d21-ade5-26358620a763 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:48.015186 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-21341fdf-8cdd-4d21-ade5-26358620a763 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:48.015764 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-21341fdf-8cdd-4d21-ade5-26358620a763 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:48.016838 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-21341fdf-8cdd-4d21-ade5-26358620a763 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:48.017477 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-21341fdf-8cdd-4d21-ade5-26358620a763 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:48.018045 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-21341fdf-8cdd-4d21-ade5-26358620a763 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:48.042314 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-21341fdf-8cdd-4d21-ade5-26358620a763 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] HTTP exception thrown: Instance 650cae0b-7b94-4c33-a526-5cc80548c0db could not be found. Sep 24 20:50:48.050405 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-21341fdf-8cdd-4d21-ade5-26358620a763 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Request method failure captured: Sep 24 20:50:48.050405 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db HTTP/1.1 Sep 24 20:50:48.050405 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:50:48.050405 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:50:48.050405 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:50:48.050405 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:50:48.050405 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:50:48.050405 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:50:48.050405 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:50:48.050405 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:50:48.050405 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL21hAokN1y2TX9ppXu7HBhRzEoJwzw5r3-z_TLzxnCl1pw5UEFWrAlF7tGaE7KP_yEI3JfTVO5i65_89EmyJQECO5JBG3xBfYxvmtYqi-Q6S15tziN9we3qusC2l-jk1zuzFFvziUheTkwqPl2BIQu3EABRjPM64nBT6vJu3WorZh44 Sep 24 20:50:48.050405 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:50:48.050405 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:50:48.050405 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:50:48.050405 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:50:48.050405 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:50:48.050405 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:50:48.050405 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: a9e62e74103b45cc81dfe7900c0baf5a Sep 24 20:50:48.050405 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-AggregatesAdminTestJSON-1167595380 Sep 24 20:50:48.050405 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:50:48.050405 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:50:48.052611 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a9e62e74103b45cc81dfe7900c0baf5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a9e62e74103b45cc81dfe7900c0baf5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a9e62e74103b45cc81dfe7900c0baf5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a9e62e74103b45cc81dfe7900c0baf5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:50:48.052611 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-AggregatesAdminTestJSON-1167595380 Sep 24 20:50:48.052611 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: a9e62e74103b45cc81dfe7900c0baf5a Sep 24 20:50:48.052611 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1167595380 Sep 24 20:50:48.052611 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-AggregatesAdminTestJSON-1167595380-project Sep 24 20:50:48.052611 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:50:48.052611 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:50:48.052611 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 2c01bfb1e8464616aceb3b73c958eb3f Sep 24 20:50:48.052611 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-AggregatesAdminTestJSON-1167595380-project Sep 24 20:50:48.052611 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:50:48.052611 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 650cae0b-7b94-4c33-a526-5cc80548c0db could not be found. Sep 24 20:50:48.052611 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '650cae0b-7b94-4c33-a526-5cc80548c0db'} Sep 24 20:50:48.053560 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:50:48.053560 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:48.053560 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:50:48.053560 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:50:48.053560 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:50:48.053560 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:50:48.053560 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:50:48.053560 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:50:48.053560 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:50:48.053560 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:50:48.053560 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 650cae0b-7b94-4c33-a526-5cc80548c0db could not be found. Sep 24 20:50:48.053560 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:48.053560 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:50:48.053560 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:48.053560 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:48.053560 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:50:48.053560 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:50:48.053560 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:50:48.053560 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:50:48.053560 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:50:48.054748 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:50:48.054748 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:50:48.054748 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:50:48.054748 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:50:48.054748 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:50:48.054748 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:50:48.054748 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:50:48.054748 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 650cae0b-7b94-4c33-a526-5cc80548c0db could not be found. Sep 24 20:50:48.054748 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:48.054748 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:50:48.054748 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:48.054748 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:50:48.054748 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:50:48.054748 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:50:48.054748 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:50:48.054748 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:50:48.054748 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 650cae0b-7b94-4c33-a526-5cc80548c0db could not be found. Sep 24 20:50:48.054748 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:50:48.056929 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-21341fdf-8cdd-4d21-ade5-26358620a763 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] Returning 404 to user: Instance 650cae0b-7b94-4c33-a526-5cc80548c0db could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:50:48.057968 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-21341fdf-8cdd-4d21-ade5-26358620a763 tempest-AggregatesAdminTestJSON-1167595380 tempest-AggregatesAdminTestJSON-1167595380-project] 10.222.0.52 "GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db" status: 404 len: 111 microversion: 2.1 time: 0.056498 Sep 24 20:50:48.062923 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 137/294] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:48 2022] GET /compute/v2.1/servers/650cae0b-7b94-4c33-a526-5cc80548c0db => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:50:48.326020 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-cf8ddc1e-efc4-4115-8a3a-ccdb3b34e7c6 req-1cbf0acc-992d-4092-91ed-3919f3ed5abf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59b0e336-5d09-43b8-b126-6b8e0a33f813", "tag": "1ff5d9c6-f16b-4bec-a6ed-b7254060cab5"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:48.355210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-cf8ddc1e-efc4-4115-8a3a-ccdb3b34e7c6 req-1cbf0acc-992d-4092-91ed-3919f3ed5abf service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:48.356720 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-cf8ddc1e-efc4-4115-8a3a-ccdb3b34e7c6 req-1cbf0acc-992d-4092-91ed-3919f3ed5abf service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:48.358068 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-cf8ddc1e-efc4-4115-8a3a-ccdb3b34e7c6 req-1cbf0acc-992d-4092-91ed-3919f3ed5abf service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:48.428612 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-cf8ddc1e-efc4-4115-8a3a-ccdb3b34e7c6 req-1cbf0acc-992d-4092-91ed-3919f3ed5abf service nova] Creating event network-changed:1ff5d9c6-f16b-4bec-a6ed-b7254060cab5 for instance 59b0e336-5d09-43b8-b126-6b8e0a33f813 on nch2-master-1 Sep 24 20:50:48.442929 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-cf8ddc1e-efc4-4115-8a3a-ccdb3b34e7c6 req-1cbf0acc-992d-4092-91ed-3919f3ed5abf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119856 Sep 24 20:50:48.444122 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 138/295] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:50:48.452277 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5b0b6bd4-f5b3-4cd5-a204-0308d57e9196 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:48.456419 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b87bfa0b-cc7c-4f58-83c4-554f8bcbba0a tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e/action" status: 202 len: 0 microversion: 2.1 time: 0.875424 Sep 24 20:50:48.461186 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 158/296] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:50:47 2022] POST /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e/action => generated 0 bytes in 880 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:50:48.473879 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8816d923-3578-4352-b794-61101c3180f3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:48.475727 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8816d923-3578-4352-b794-61101c3180f3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:48.479648 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5b0b6bd4-f5b3-4cd5-a204-0308d57e9196 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:48.493598 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8816d923-3578-4352-b794-61101c3180f3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:48.494116 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8816d923-3578-4352-b794-61101c3180f3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:48.495763 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8816d923-3578-4352-b794-61101c3180f3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:48.497752 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8816d923-3578-4352-b794-61101c3180f3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:48.498248 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8816d923-3578-4352-b794-61101c3180f3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:48.499886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8816d923-3578-4352-b794-61101c3180f3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:48.509166 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=8,nova_api:UPDATE=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:50:48.536726 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b0b6bd4-f5b3-4cd5-a204-0308d57e9196 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:48.537684 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b0b6bd4-f5b3-4cd5-a204-0308d57e9196 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:48.543103 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b0b6bd4-f5b3-4cd5-a204-0308d57e9196 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:48.547056 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b0b6bd4-f5b3-4cd5-a204-0308d57e9196 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:48.547922 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b0b6bd4-f5b3-4cd5-a204-0308d57e9196 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:48.549609 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b0b6bd4-f5b3-4cd5-a204-0308d57e9196 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:48.924461 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5b0b6bd4-f5b3-4cd5-a204-0308d57e9196 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:48.938122 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5b0b6bd4-f5b3-4cd5-a204-0308d57e9196 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:48.939620 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5b0b6bd4-f5b3-4cd5-a204-0308d57e9196 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:48.970104 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5b0b6bd4-f5b3-4cd5-a204-0308d57e9196 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.522375 Sep 24 20:50:48.971123 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 139/297] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:50:48 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:50:48.978219 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-95f03676-4a39-4f93-ba28-2e31dd0adca3 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:48.978868 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-95f03676-4a39-4f93-ba28-2e31dd0adca3 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 9b0e9940-f6ac-46d5-8898-1e4ba56119b3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:49.005455 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-95f03676-4a39-4f93-ba28-2e31dd0adca3 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:49.006140 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-95f03676-4a39-4f93-ba28-2e31dd0adca3 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:49.006776 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-95f03676-4a39-4f93-ba28-2e31dd0adca3 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:49.008144 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-95f03676-4a39-4f93-ba28-2e31dd0adca3 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:49.008763 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-95f03676-4a39-4f93-ba28-2e31dd0adca3 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:49.009375 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-95f03676-4a39-4f93-ba28-2e31dd0adca3 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:49.029548 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:50:49.245505 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8816d923-3578-4352-b794-61101c3180f3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:49.276147 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8816d923-3578-4352-b794-61101c3180f3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1471 microversion: 2.1 time: 0.813203 Sep 24 20:50:49.281509 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 159/298] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:48 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1471 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:49.300350 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6fc87016-cb13-4ff0-8221-fe1d6e76de2c tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:49.303271 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6fc87016-cb13-4ff0-8221-fe1d6e76de2c tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 59b0e336-5d09-43b8-b126-6b8e0a33f813] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:49.347489 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6fc87016-cb13-4ff0-8221-fe1d6e76de2c tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:49.349481 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6fc87016-cb13-4ff0-8221-fe1d6e76de2c tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:49.351602 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6fc87016-cb13-4ff0-8221-fe1d6e76de2c tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:49.352781 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6fc87016-cb13-4ff0-8221-fe1d6e76de2c tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:49.356351 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6fc87016-cb13-4ff0-8221-fe1d6e76de2c tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:49.356804 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6fc87016-cb13-4ff0-8221-fe1d6e76de2c tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:49.551578 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-95f03676-4a39-4f93-ba28-2e31dd0adca3 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278977b201c48dda2d73823fbfe4833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a31be22cc451b92af447ed8d81242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:49.567671 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-95f03676-4a39-4f93-ba28-2e31dd0adca3 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3" status: 200 len: 1588 microversion: 2.1 time: 0.592570 Sep 24 20:50:49.569405 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 140/299] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:48 2022] GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3 => generated 1588 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:49.591016 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7e309082-7391-4271-b649-974d3f0c6c40 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:49.596271 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7e309082-7391-4271-b649-974d3f0c6c40 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:49.628192 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7e309082-7391-4271-b649-974d3f0c6c40 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:49.630663 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7e309082-7391-4271-b649-974d3f0c6c40 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:49.633014 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7e309082-7391-4271-b649-974d3f0c6c40 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:49.635668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7e309082-7391-4271-b649-974d3f0c6c40 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:49.637872 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7e309082-7391-4271-b649-974d3f0c6c40 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:49.640523 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7e309082-7391-4271-b649-974d3f0c6c40 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:49.770995 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:50:50.264352 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6fc87016-cb13-4ff0-8221-fe1d6e76de2c tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8a91794144d73a8942f5c3bac8cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3800968cd944059a397e9c6b35f976d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:50.274720 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6fc87016-cb13-4ff0-8221-fe1d6e76de2c tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813" status: 200 len: 1318 microversion: 2.1 time: 0.992047 Sep 24 20:50:50.292574 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 160/300] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:49 2022] GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813 => generated 1318 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:50.298663 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ed7c1daf-28f0-4a43-9db1-d9e49af41753 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:50.311327 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ed7c1daf-28f0-4a43-9db1-d9e49af41753 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:50.332310 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed7c1daf-28f0-4a43-9db1-d9e49af41753 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:50.338136 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7e309082-7391-4271-b649-974d3f0c6c40 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:50.342570 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed7c1daf-28f0-4a43-9db1-d9e49af41753 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:50.347865 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7e309082-7391-4271-b649-974d3f0c6c40 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5" status: 200 len: 1263 microversion: 2.1 time: 0.776404 Sep 24 20:50:50.348184 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed7c1daf-28f0-4a43-9db1-d9e49af41753 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:50.349064 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed7c1daf-28f0-4a43-9db1-d9e49af41753 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:50.350324 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed7c1daf-28f0-4a43-9db1-d9e49af41753 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:50.354607 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 141/301] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:49 2022] GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 => generated 1263 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:50.357237 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed7c1daf-28f0-4a43-9db1-d9e49af41753 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:50.368199 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-489ead2f-f5c8-48d4-8037-67c0574bc900 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:50.380359 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-489ead2f-f5c8-48d4-8037-67c0574bc900 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:50.406182 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-489ead2f-f5c8-48d4-8037-67c0574bc900 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:50.413768 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-489ead2f-f5c8-48d4-8037-67c0574bc900 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:50.415781 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-489ead2f-f5c8-48d4-8037-67c0574bc900 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:50.422417 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-489ead2f-f5c8-48d4-8037-67c0574bc900 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:50.430116 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-489ead2f-f5c8-48d4-8037-67c0574bc900 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:50.431866 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-489ead2f-f5c8-48d4-8037-67c0574bc900 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:50.741519 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ed7c1daf-28f0-4a43-9db1-d9e49af41753 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:50.756937 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ed7c1daf-28f0-4a43-9db1-d9e49af41753 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:50.761140 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ed7c1daf-28f0-4a43-9db1-d9e49af41753 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:50.775171 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ed7c1daf-28f0-4a43-9db1-d9e49af41753 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.487912 Sep 24 20:50:50.776492 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 161/302] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:50:50 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:50:50.795943 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-51bbb5e0-9408-405f-9187-6a4b9390dd11 req-22d44061-bd54-4c25-8da4-e49c573f2f2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b0e9940-f6ac-46d5-8898-1e4ba56119b3", "tag": "bd5ba8f6-52ce-4952-b823-1baad516098d"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:50.823242 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-51bbb5e0-9408-405f-9187-6a4b9390dd11 req-22d44061-bd54-4c25-8da4-e49c573f2f2d service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:50.828813 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-51bbb5e0-9408-405f-9187-6a4b9390dd11 req-22d44061-bd54-4c25-8da4-e49c573f2f2d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:50.835549 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-51bbb5e0-9408-405f-9187-6a4b9390dd11 req-22d44061-bd54-4c25-8da4-e49c573f2f2d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:50.870029 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-51bbb5e0-9408-405f-9187-6a4b9390dd11 req-22d44061-bd54-4c25-8da4-e49c573f2f2d service nova] Creating event network-changed:bd5ba8f6-52ce-4952-b823-1baad516098d for instance 9b0e9940-f6ac-46d5-8898-1e4ba56119b3 on nch1-master-1 Sep 24 20:50:50.889289 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-51bbb5e0-9408-405f-9187-6a4b9390dd11 req-22d44061-bd54-4c25-8da4-e49c573f2f2d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108430 Sep 24 20:50:50.892396 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 162/303] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:51.309463 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-28a99da7-2b45-48fb-8d09-31239702f6cf tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:51.310370 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-28a99da7-2b45-48fb-8d09-31239702f6cf tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 59b0e336-5d09-43b8-b126-6b8e0a33f813] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:51.324103 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28a99da7-2b45-48fb-8d09-31239702f6cf tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:51.330324 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-489ead2f-f5c8-48d4-8037-67c0574bc900 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:51.337043 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28a99da7-2b45-48fb-8d09-31239702f6cf tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:51.337531 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28a99da7-2b45-48fb-8d09-31239702f6cf tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:51.338304 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28a99da7-2b45-48fb-8d09-31239702f6cf tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:51.338811 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28a99da7-2b45-48fb-8d09-31239702f6cf tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:51.339257 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28a99da7-2b45-48fb-8d09-31239702f6cf tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:51.347134 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-489ead2f-f5c8-48d4-8037-67c0574bc900 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1471 microversion: 2.1 time: 0.983604 Sep 24 20:50:51.347857 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 142/304] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:50 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1471 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:51.380041 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-286d2d0b-1eb2-4486-ab2e-ad6cfc5a2796 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:51.381104 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-286d2d0b-1eb2-4486-ab2e-ad6cfc5a2796 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:51.393274 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-286d2d0b-1eb2-4486-ab2e-ad6cfc5a2796 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:51.395010 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-286d2d0b-1eb2-4486-ab2e-ad6cfc5a2796 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:51.395737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-286d2d0b-1eb2-4486-ab2e-ad6cfc5a2796 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:51.397295 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-286d2d0b-1eb2-4486-ab2e-ad6cfc5a2796 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:51.400273 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-286d2d0b-1eb2-4486-ab2e-ad6cfc5a2796 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:51.402154 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-286d2d0b-1eb2-4486-ab2e-ad6cfc5a2796 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:51.896976 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-286d2d0b-1eb2-4486-ab2e-ad6cfc5a2796 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:51.922928 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-286d2d0b-1eb2-4486-ab2e-ad6cfc5a2796 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5" status: 200 len: 1269 microversion: 2.1 time: 0.548927 Sep 24 20:50:51.923534 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 143/305] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:51 2022] GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 => generated 1269 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:50:51.943250 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-061ffc8f-76b3-4596-8e8f-0149f9665699 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:51.943882 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-061ffc8f-76b3-4596-8e8f-0149f9665699 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:51.960867 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-061ffc8f-76b3-4596-8e8f-0149f9665699 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:51.961365 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-061ffc8f-76b3-4596-8e8f-0149f9665699 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:51.961811 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-061ffc8f-76b3-4596-8e8f-0149f9665699 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:51.973609 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-061ffc8f-76b3-4596-8e8f-0149f9665699 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:51.984537 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-061ffc8f-76b3-4596-8e8f-0149f9665699 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:51.985075 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-061ffc8f-76b3-4596-8e8f-0149f9665699 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:52.291895 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-061ffc8f-76b3-4596-8e8f-0149f9665699 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:52.312397 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-28a99da7-2b45-48fb-8d09-31239702f6cf tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8a91794144d73a8942f5c3bac8cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3800968cd944059a397e9c6b35f976d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:52.317114 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-061ffc8f-76b3-4596-8e8f-0149f9665699 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:52.319337 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-061ffc8f-76b3-4596-8e8f-0149f9665699 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:52.324886 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-28a99da7-2b45-48fb-8d09-31239702f6cf tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813" status: 200 len: 1318 microversion: 2.1 time: 1.017728 Sep 24 20:50:52.331034 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-061ffc8f-76b3-4596-8e8f-0149f9665699 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.405205 Sep 24 20:50:52.332322 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 163/306] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:51 2022] GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813 => generated 1318 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:50:52.343285 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 144/307] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:50:51 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:50:52.376517 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9e505267-81b5-45a6-9eac-4576c187620a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:52.379460 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9e505267-81b5-45a6-9eac-4576c187620a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:52.396520 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e505267-81b5-45a6-9eac-4576c187620a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:52.397021 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e505267-81b5-45a6-9eac-4576c187620a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:52.397457 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e505267-81b5-45a6-9eac-4576c187620a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:52.402999 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e505267-81b5-45a6-9eac-4576c187620a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:52.404800 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e505267-81b5-45a6-9eac-4576c187620a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:52.408488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e505267-81b5-45a6-9eac-4576c187620a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:52.876744 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9e505267-81b5-45a6-9eac-4576c187620a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:52.891778 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9e505267-81b5-45a6-9eac-4576c187620a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1471 microversion: 2.1 time: 0.521892 Sep 24 20:50:52.894171 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 164/308] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:52 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1471 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:52.954181 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-78a022e4-eca3-4edb-89d3-36f4910b52c3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:52.955327 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-78a022e4-eca3-4edb-89d3-36f4910b52c3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:52.971128 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-78a022e4-eca3-4edb-89d3-36f4910b52c3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:52.971991 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-78a022e4-eca3-4edb-89d3-36f4910b52c3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:52.973408 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-78a022e4-eca3-4edb-89d3-36f4910b52c3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:52.975528 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-78a022e4-eca3-4edb-89d3-36f4910b52c3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:52.977209 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-78a022e4-eca3-4edb-89d3-36f4910b52c3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:52.977759 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-78a022e4-eca3-4edb-89d3-36f4910b52c3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:53.055038 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-72baa43e-f9c9-4073-8551-4d33787620b3 tempest-FlavorsAccessTestJSON-641810292 tempest-FlavorsAccessTestJSON-641810292-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1679820052", "id": 1852779736, "os-flavor-access:is_public": "False"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:53.092147 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-72baa43e-f9c9-4073-8551-4d33787620b3 tempest-FlavorsAccessTestJSON-641810292 tempest-FlavorsAccessTestJSON-641810292-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.277308 Sep 24 20:50:53.092932 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 145/309] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:50:52 2022] POST /compute/v2.1/flavors => generated 431 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:50:53.109698 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8de321fb-a9ef-4886-a9f2-495269ee97b0 tempest-FlavorsAccessTestJSON-641810292 tempest-FlavorsAccessTestJSON-641810292-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "652de1d5c4614bbfaafe5df4628052b9"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:53.213409 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8de321fb-a9ef-4886-a9f2-495269ee97b0 tempest-FlavorsAccessTestJSON-641810292 tempest-FlavorsAccessTestJSON-641810292-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/1852779736/action" status: 200 len: 97 microversion: 2.1 time: 0.108146 Sep 24 20:50:53.214312 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 146/310] 10.222.0.52 () {60 vars in 1200 bytes} [Sat Sep 24 20:50:53 2022] POST /compute/v2.1/flavors/1852779736/action => generated 97 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:50:53.485414 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-78a022e4-eca3-4edb-89d3-36f4910b52c3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:53.500384 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-78a022e4-eca3-4edb-89d3-36f4910b52c3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5" status: 200 len: 1311 microversion: 2.1 time: 0.554413 Sep 24 20:50:53.503907 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 165/311] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:52 2022] GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 => generated 1311 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:50:53.516605 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c2175b76-5661-4fb7-9f0d-2cc3b1b8c5fb tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:53.516605 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c2175b76-5661-4fb7-9f0d-2cc3b1b8c5fb tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 59b0e336-5d09-43b8-b126-6b8e0a33f813] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:53.531117 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2175b76-5661-4fb7-9f0d-2cc3b1b8c5fb tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:53.531979 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2175b76-5661-4fb7-9f0d-2cc3b1b8c5fb tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:53.533335 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2175b76-5661-4fb7-9f0d-2cc3b1b8c5fb tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:53.535716 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2175b76-5661-4fb7-9f0d-2cc3b1b8c5fb tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:53.538351 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2175b76-5661-4fb7-9f0d-2cc3b1b8c5fb tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:53.540177 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2175b76-5661-4fb7-9f0d-2cc3b1b8c5fb tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:53.554919 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b7df96ff-6c71-430f-bc52-04a1464122ad tempest-FlavorsAccessTestJSON-872049668 tempest-FlavorsAccessTestJSON-872049668-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:53.610507 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b7df96ff-6c71-430f-bc52-04a1464122ad tempest-FlavorsAccessTestJSON-872049668 tempest-FlavorsAccessTestJSON-872049668-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 6238 microversion: 2.1 time: 0.387982 Sep 24 20:50:53.611684 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 147/312] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:50:53 2022] GET /compute/v2.1/flavors/detail => generated 6238 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:53.616710 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bf294ce0-78a5-4672-96e7-b2ab984a4bcb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:53.617569 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bf294ce0-78a5-4672-96e7-b2ab984a4bcb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:53.624647 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf294ce0-78a5-4672-96e7-b2ab984a4bcb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:53.625465 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf294ce0-78a5-4672-96e7-b2ab984a4bcb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:53.626147 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf294ce0-78a5-4672-96e7-b2ab984a4bcb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:53.627215 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf294ce0-78a5-4672-96e7-b2ab984a4bcb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:53.627745 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf294ce0-78a5-4672-96e7-b2ab984a4bcb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:53.628248 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf294ce0-78a5-4672-96e7-b2ab984a4bcb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:54.007443 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bf294ce0-78a5-4672-96e7-b2ab984a4bcb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:54.020022 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bf294ce0-78a5-4672-96e7-b2ab984a4bcb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:54.022473 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bf294ce0-78a5-4672-96e7-b2ab984a4bcb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:54.041477 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bf294ce0-78a5-4672-96e7-b2ab984a4bcb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.425196 Sep 24 20:50:54.041477 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 148/313] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:50:53 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:50:54.047423 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-960c63fc-1d6e-4438-8e25-dab4d78fc1c7 tempest-FlavorsAccessTestJSON-641810292 tempest-FlavorsAccessTestJSON-641810292-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "652de1d5c4614bbfaafe5df4628052b9"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:54.141299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c2175b76-5661-4fb7-9f0d-2cc3b1b8c5fb tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8a91794144d73a8942f5c3bac8cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3800968cd944059a397e9c6b35f976d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:54.152120 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c2175b76-5661-4fb7-9f0d-2cc3b1b8c5fb tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813" status: 200 len: 1318 microversion: 2.1 time: 0.644977 Sep 24 20:50:54.154868 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 166/314] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:53 2022] GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813 => generated 1318 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:54.171488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6a87b59a-cd9a-482b-9da8-1242f69790ec tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:54.172345 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6a87b59a-cd9a-482b-9da8-1242f69790ec tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:54.186588 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6a87b59a-cd9a-482b-9da8-1242f69790ec tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:54.187090 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6a87b59a-cd9a-482b-9da8-1242f69790ec tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:54.187705 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6a87b59a-cd9a-482b-9da8-1242f69790ec tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:54.188576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6a87b59a-cd9a-482b-9da8-1242f69790ec tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:54.189189 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6a87b59a-cd9a-482b-9da8-1242f69790ec tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:54.189772 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6a87b59a-cd9a-482b-9da8-1242f69790ec tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:54.561595 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6a87b59a-cd9a-482b-9da8-1242f69790ec tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:54.582663 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6a87b59a-cd9a-482b-9da8-1242f69790ec tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1471 microversion: 2.1 time: 0.425694 Sep 24 20:50:54.617398 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 167/315] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:54 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1471 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:54.631027 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-960c63fc-1d6e-4438-8e25-dab4d78fc1c7 tempest-FlavorsAccessTestJSON-641810292 tempest-FlavorsAccessTestJSON-641810292-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/1852779736/action" status: 200 len: 21 microversion: 2.1 time: 0.589818 Sep 24 20:50:54.632195 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 149/316] 10.222.0.52 () {60 vars in 1200 bytes} [Sat Sep 24 20:50:54 2022] POST /compute/v2.1/flavors/1852779736/action => generated 21 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:50:54.654421 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b74c2194-3a32-44b9-a01e-e350c9f52608 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:54.658989 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b74c2194-3a32-44b9-a01e-e350c9f52608 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:54.670803 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b74c2194-3a32-44b9-a01e-e350c9f52608 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:54.670994 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5f72ddb1-4d85-4a2f-a684-ac8ed7930f3d tempest-FlavorsAccessTestJSON-872049668 tempest-FlavorsAccessTestJSON-872049668-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:54.671967 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b74c2194-3a32-44b9-a01e-e350c9f52608 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:54.672915 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b74c2194-3a32-44b9-a01e-e350c9f52608 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:54.674040 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b74c2194-3a32-44b9-a01e-e350c9f52608 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:54.674885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b74c2194-3a32-44b9-a01e-e350c9f52608 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:54.675552 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b74c2194-3a32-44b9-a01e-e350c9f52608 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:54.744239 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5f72ddb1-4d85-4a2f-a684-ac8ed7930f3d tempest-FlavorsAccessTestJSON-872049668 tempest-FlavorsAccessTestJSON-872049668-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.090593 Sep 24 20:50:54.744853 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 150/317] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:50:54 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:54.766301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-27f2b1f4-a282-4145-b869-2290ecd73a11 tempest-FlavorsAccessTestJSON-641810292 tempest-FlavorsAccessTestJSON-641810292-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:54.789742 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-27f2b1f4-a282-4145-b869-2290ecd73a11 tempest-FlavorsAccessTestJSON-641810292 tempest-FlavorsAccessTestJSON-641810292-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1852779736" status: 202 len: 0 microversion: 2.1 time: 0.028579 Sep 24 20:50:54.794723 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 151/318] 10.222.0.52 () {58 vars in 1161 bytes} [Sat Sep 24 20:50:54 2022] DELETE /compute/v2.1/flavors/1852779736 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 20:50:54.800484 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d395580c-73ae-4d56-b91c-98231b720d32 tempest-FlavorsAccessTestJSON-641810292 tempest-FlavorsAccessTestJSON-641810292-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:54.844663 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d395580c-73ae-4d56-b91c-98231b720d32 tempest-FlavorsAccessTestJSON-641810292 tempest-FlavorsAccessTestJSON-641810292-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.048169 Sep 24 20:50:54.859797 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 152/319] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:50:54 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:54.870954 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2e619e6c-823f-4e9d-9f60-e2b9a39ea99c tempest-FlavorsAccessTestJSON-641810292 tempest-FlavorsAccessTestJSON-641810292-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1294705438", "id": 1051022389, "os-flavor-access:is_public": "False"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:54.897318 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2e619e6c-823f-4e9d-9f60-e2b9a39ea99c tempest-FlavorsAccessTestJSON-641810292 tempest-FlavorsAccessTestJSON-641810292-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.031307 Sep 24 20:50:54.906016 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 153/320] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:50:54 2022] POST /compute/v2.1/flavors => generated 431 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:54.911835 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-17829cb4-7501-48e0-a102-3cd2a3343855 tempest-FlavorsAccessTestJSON-641810292 tempest-FlavorsAccessTestJSON-641810292-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:54.931250 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-17829cb4-7501-48e0-a102-3cd2a3343855 tempest-FlavorsAccessTestJSON-641810292 tempest-FlavorsAccessTestJSON-641810292-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/1051022389/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.023684 Sep 24 20:50:54.934711 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 154/321] 10.222.0.52 () {58 vars in 1209 bytes} [Sat Sep 24 20:50:54 2022] GET /compute/v2.1/flavors/1051022389/os-flavor-access => generated 21 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:50:54.947016 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-20f161ab-3c4a-4c1b-8db4-e1524e57ed12 tempest-FlavorsAccessTestJSON-641810292 tempest-FlavorsAccessTestJSON-641810292-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:54.961682 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b74c2194-3a32-44b9-a01e-e350c9f52608 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:54.972637 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b74c2194-3a32-44b9-a01e-e350c9f52608 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5" status: 200 len: 1311 microversion: 2.1 time: 0.353424 Sep 24 20:50:54.974002 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 168/322] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:54 2022] GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 => generated 1311 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:55.009021 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-20f161ab-3c4a-4c1b-8db4-e1524e57ed12 tempest-FlavorsAccessTestJSON-641810292 tempest-FlavorsAccessTestJSON-641810292-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1051022389" status: 202 len: 0 microversion: 2.1 time: 0.068029 Sep 24 20:50:55.010403 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 155/323] 10.222.0.52 () {58 vars in 1161 bytes} [Sat Sep 24 20:50:54 2022] DELETE /compute/v2.1/flavors/1051022389 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:50:55.021379 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e2e35c77-47ed-4d90-a13a-5bd995e5762e tempest-FlavorsAccessTestJSON-641810292 tempest-FlavorsAccessTestJSON-641810292-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:55.057053 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e2e35c77-47ed-4d90-a13a-5bd995e5762e tempest-FlavorsAccessTestJSON-641810292 tempest-FlavorsAccessTestJSON-641810292-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.041134 Sep 24 20:50:55.058228 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 169/324] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:50:55 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:55.083470 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b31628d6-7b2c-42de-8e16-e253a58b2552 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:55.085539 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b31628d6-7b2c-42de-8e16-e253a58b2552 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:55.104222 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b31628d6-7b2c-42de-8e16-e253a58b2552 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:55.106676 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b31628d6-7b2c-42de-8e16-e253a58b2552 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:55.107791 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b31628d6-7b2c-42de-8e16-e253a58b2552 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:55.109726 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b31628d6-7b2c-42de-8e16-e253a58b2552 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:55.110318 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b31628d6-7b2c-42de-8e16-e253a58b2552 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:55.113290 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b31628d6-7b2c-42de-8e16-e253a58b2552 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:55.179666 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-21b4232b-eef5-41e4-bcc1-9948b7265c09 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:55.180355 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-21b4232b-eef5-41e4-bcc1-9948b7265c09 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 59b0e336-5d09-43b8-b126-6b8e0a33f813] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:55.192367 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-21b4232b-eef5-41e4-bcc1-9948b7265c09 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:55.194083 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-21b4232b-eef5-41e4-bcc1-9948b7265c09 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:55.195145 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-21b4232b-eef5-41e4-bcc1-9948b7265c09 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:55.196408 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-21b4232b-eef5-41e4-bcc1-9948b7265c09 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:55.197548 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-21b4232b-eef5-41e4-bcc1-9948b7265c09 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:55.198672 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-21b4232b-eef5-41e4-bcc1-9948b7265c09 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:55.208787 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:50:55.279275 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b31628d6-7b2c-42de-8e16-e253a58b2552 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:55.300418 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b31628d6-7b2c-42de-8e16-e253a58b2552 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:55.304876 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b31628d6-7b2c-42de-8e16-e253a58b2552 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:55.324840 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b31628d6-7b2c-42de-8e16-e253a58b2552 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.251413 Sep 24 20:50:55.326976 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 156/325] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:50:55 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:50:55.338656 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-b1886e87-d18d-43cb-8e8b-6e704a664811 req-bdcaba54-ebe4-4803-b2f4-d49431505ddf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8164fcd2-b47c-4b73-b5f3-4e71615a3ec5", "tag": "7f54b87f-432c-4333-a0ed-d461564390c4"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:55.353126 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-b1886e87-d18d-43cb-8e8b-6e704a664811 req-bdcaba54-ebe4-4803-b2f4-d49431505ddf service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:55.353844 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-b1886e87-d18d-43cb-8e8b-6e704a664811 req-bdcaba54-ebe4-4803-b2f4-d49431505ddf service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:55.354585 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-b1886e87-d18d-43cb-8e8b-6e704a664811 req-bdcaba54-ebe4-4803-b2f4-d49431505ddf service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:55.373526 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-b1886e87-d18d-43cb-8e8b-6e704a664811 req-bdcaba54-ebe4-4803-b2f4-d49431505ddf service nova] Creating event network-changed:7f54b87f-432c-4333-a0ed-d461564390c4 for instance 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 on nch1-master-1 Sep 24 20:50:55.382639 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-b1886e87-d18d-43cb-8e8b-6e704a664811 req-bdcaba54-ebe4-4803-b2f4-d49431505ddf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053812 Sep 24 20:50:55.383720 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 157/326] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:55.602708 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-21b4232b-eef5-41e4-bcc1-9948b7265c09 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8a91794144d73a8942f5c3bac8cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3800968cd944059a397e9c6b35f976d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:55.611235 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-21b4232b-eef5-41e4-bcc1-9948b7265c09 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813" status: 200 len: 1318 microversion: 2.1 time: 0.435830 Sep 24 20:50:55.611830 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 170/327] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:55 2022] GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813 => generated 1318 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:50:55.626457 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dc4930a7-757c-4245-91f3-ec1b51f28ea5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:55.627544 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dc4930a7-757c-4245-91f3-ec1b51f28ea5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:55.647141 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc4930a7-757c-4245-91f3-ec1b51f28ea5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:55.648338 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc4930a7-757c-4245-91f3-ec1b51f28ea5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:55.649195 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc4930a7-757c-4245-91f3-ec1b51f28ea5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:55.650248 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc4930a7-757c-4245-91f3-ec1b51f28ea5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:55.650906 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc4930a7-757c-4245-91f3-ec1b51f28ea5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:55.651490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc4930a7-757c-4245-91f3-ec1b51f28ea5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:55.876314 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dc4930a7-757c-4245-91f3-ec1b51f28ea5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:55.901398 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dc4930a7-757c-4245-91f3-ec1b51f28ea5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1476 microversion: 2.1 time: 0.279814 Sep 24 20:50:55.915606 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 158/328] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:55 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1476 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:56.008279 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-27d6f169-6ff0-45a4-af3a-f798b44e424a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:56.009244 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-27d6f169-6ff0-45a4-af3a-f798b44e424a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:56.023343 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27d6f169-6ff0-45a4-af3a-f798b44e424a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:56.024316 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27d6f169-6ff0-45a4-af3a-f798b44e424a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:56.024919 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27d6f169-6ff0-45a4-af3a-f798b44e424a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:56.025646 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27d6f169-6ff0-45a4-af3a-f798b44e424a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:56.026222 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27d6f169-6ff0-45a4-af3a-f798b44e424a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:56.026601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27d6f169-6ff0-45a4-af3a-f798b44e424a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:56.067533 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b3280f01-4f09-4083-a032-9c1cafbaf5a6 tempest-FlavorsExtraSpecsTestJSON-1623382506 tempest-FlavorsExtraSpecsTestJSON-1623382506-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-136254254", "ram": 512, "vcpus": 1, "disk": 10, "id": 659985101, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:56.098255 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b3280f01-4f09-4083-a032-9c1cafbaf5a6 tempest-FlavorsExtraSpecsTestJSON-1623382506 tempest-FlavorsExtraSpecsTestJSON-1623382506-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.215718 Sep 24 20:50:56.102972 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 171/329] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:50:55 2022] POST /compute/v2.1/flavors => generated 412 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:50:56.117085 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-18e2eaac-6073-4a5e-b11f-def69d2a4a8a tempest-FlavorsExtraSpecsTestJSON-1623382506 tempest-FlavorsExtraSpecsTestJSON-1623382506-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:56.157138 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-18e2eaac-6073-4a5e-b11f-def69d2a4a8a tempest-FlavorsExtraSpecsTestJSON-1623382506 tempest-FlavorsExtraSpecsTestJSON-1623382506-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/659985101/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.043882 Sep 24 20:50:56.158105 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 172/330] 10.222.0.52 () {60 vars in 1221 bytes} [Sat Sep 24 20:50:56 2022] POST /compute/v2.1/flavors/659985101/os-extra_specs => generated 66 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 24 20:50:56.284345 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-27d6f169-6ff0-45a4-af3a-f798b44e424a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:56.304951 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-15159429-bd4c-4a87-bc98-099a32bb8b63 tempest-FlavorsExtraSpecsTestJSON-396846010 tempest-FlavorsExtraSpecsTestJSON-396846010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:56.326101 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-15159429-bd4c-4a87-bc98-099a32bb8b63 tempest-FlavorsExtraSpecsTestJSON-396846010 tempest-FlavorsExtraSpecsTestJSON-396846010-project] 10.222.0.52 "GET /compute/v2.1/flavors/659985101/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.161597 Sep 24 20:50:56.327343 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 173/331] 10.222.0.52 () {58 vars in 1200 bytes} [Sat Sep 24 20:50:56 2022] GET /compute/v2.1/flavors/659985101/os-extra_specs => generated 66 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:50:56.335219 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-27d6f169-6ff0-45a4-af3a-f798b44e424a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5" status: 200 len: 1311 microversion: 2.1 time: 0.317195 Sep 24 20:50:56.335952 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 159/332] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:55 2022] GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 => generated 1311 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:56.338892 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-20fe14af-c6c4-4a92-8896-c9321f7ca239 tempest-FlavorsExtraSpecsTestJSON-1623382506 tempest-FlavorsExtraSpecsTestJSON-1623382506-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:56.354166 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c1c7e709-92e7-4d8b-94aa-d6dc10dbb2f7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:56.354820 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c1c7e709-92e7-4d8b-94aa-d6dc10dbb2f7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:56.362104 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1c7e709-92e7-4d8b-94aa-d6dc10dbb2f7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:56.362785 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1c7e709-92e7-4d8b-94aa-d6dc10dbb2f7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:56.363259 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1c7e709-92e7-4d8b-94aa-d6dc10dbb2f7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:56.364161 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1c7e709-92e7-4d8b-94aa-d6dc10dbb2f7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:56.365071 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1c7e709-92e7-4d8b-94aa-d6dc10dbb2f7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:56.365479 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1c7e709-92e7-4d8b-94aa-d6dc10dbb2f7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:56.383053 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-20fe14af-c6c4-4a92-8896-c9321f7ca239 tempest-FlavorsExtraSpecsTestJSON-1623382506 tempest-FlavorsExtraSpecsTestJSON-1623382506-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/659985101/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.049283 Sep 24 20:50:56.389769 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 174/333] 10.222.0.52 () {60 vars in 1221 bytes} [Sat Sep 24 20:50:56 2022] POST /compute/v2.1/flavors/659985101/os-extra_specs => generated 66 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:50:56.395566 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b4cc20b9-ccfd-4bdb-9610-f495344b8104 tempest-FlavorsExtraSpecsTestJSON-396846010 tempest-FlavorsExtraSpecsTestJSON-396846010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:56.406036 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b4cc20b9-ccfd-4bdb-9610-f495344b8104 tempest-FlavorsExtraSpecsTestJSON-396846010 tempest-FlavorsExtraSpecsTestJSON-396846010-project] 10.222.0.52 "GET /compute/v2.1/flavors/659985101/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.015054 Sep 24 20:50:56.411592 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 175/334] 10.222.0.52 () {58 vars in 1242 bytes} [Sat Sep 24 20:50:56 2022] GET /compute/v2.1/flavors/659985101/os-extra_specs/hw:numa_nodes => generated 22 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:50:56.422198 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-61c96087-9451-4763-a105-bdec962310ba tempest-FlavorsExtraSpecsTestJSON-1623382506 tempest-FlavorsExtraSpecsTestJSON-1623382506-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:56.462258 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c1c7e709-92e7-4d8b-94aa-d6dc10dbb2f7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:56.474898 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c1c7e709-92e7-4d8b-94aa-d6dc10dbb2f7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:56.476379 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c1c7e709-92e7-4d8b-94aa-d6dc10dbb2f7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:56.479538 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-61c96087-9451-4763-a105-bdec962310ba tempest-FlavorsExtraSpecsTestJSON-1623382506 tempest-FlavorsExtraSpecsTestJSON-1623382506-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/659985101/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.065552 Sep 24 20:50:56.481908 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 176/335] 10.222.0.52 () {60 vars in 1221 bytes} [Sat Sep 24 20:50:56 2022] POST /compute/v2.1/flavors/659985101/os-extra_specs => generated 66 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 24 20:50:56.487987 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c1c7e709-92e7-4d8b-94aa-d6dc10dbb2f7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.137623 Sep 24 20:50:56.488851 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 160/336] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:50:56 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:50:56.491639 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a14e0002-8dac-46d2-9e2a-16bf02280822 tempest-FlavorsExtraSpecsTestJSON-1623382506 tempest-FlavorsExtraSpecsTestJSON-1623382506-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:56.500038 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a14e0002-8dac-46d2-9e2a-16bf02280822 tempest-FlavorsExtraSpecsTestJSON-1623382506 tempest-FlavorsExtraSpecsTestJSON-1623382506-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/659985101/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.013360 Sep 24 20:50:56.500602 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 177/337] 10.222.0.52 () {58 vars in 1200 bytes} [Sat Sep 24 20:50:56 2022] GET /compute/v2.1/flavors/659985101/os-extra_specs => generated 66 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:50:56.510899 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e5c14e3e-dc0d-4f07-ae8a-c3fa4684f3f3 tempest-FlavorsExtraSpecsTestJSON-1623382506 tempest-FlavorsExtraSpecsTestJSON-1623382506-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:56.571179 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e5c14e3e-dc0d-4f07-ae8a-c3fa4684f3f3 tempest-FlavorsExtraSpecsTestJSON-1623382506 tempest-FlavorsExtraSpecsTestJSON-1623382506-project-admin] 10.222.0.52 "PUT /compute/v2.1/flavors/659985101/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.064672 Sep 24 20:50:56.576449 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 161/338] 10.222.0.52 () {60 vars in 1262 bytes} [Sat Sep 24 20:50:56 2022] PUT /compute/v2.1/flavors/659985101/os-extra_specs/hw:numa_nodes => generated 22 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:50:56.583612 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-456ae13b-d4bf-4402-ba08-1b5af2b5b655 tempest-FlavorsExtraSpecsTestJSON-1623382506 tempest-FlavorsExtraSpecsTestJSON-1623382506-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:56.597936 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-456ae13b-d4bf-4402-ba08-1b5af2b5b655 tempest-FlavorsExtraSpecsTestJSON-1623382506 tempest-FlavorsExtraSpecsTestJSON-1623382506-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/659985101/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.019662 Sep 24 20:50:56.604029 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 178/339] 10.222.0.52 () {58 vars in 1200 bytes} [Sat Sep 24 20:50:56 2022] GET /compute/v2.1/flavors/659985101/os-extra_specs => generated 66 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:50:56.609754 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-96840a47-bb87-46d6-9884-f0099daed2ea tempest-FlavorsExtraSpecsTestJSON-1623382506 tempest-FlavorsExtraSpecsTestJSON-1623382506-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:56.626824 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:DELETE=8,nova_api:SAVEPOINT=3,nova_api:RELEASE=3,nova_api:UPDATE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:50:56.640319 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7c69fbd0-78e5-43dc-9610-218e4b11fcd7 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:56.640956 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7c69fbd0-78e5-43dc-9610-218e4b11fcd7 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 59b0e336-5d09-43b8-b126-6b8e0a33f813] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:56.651060 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-96840a47-bb87-46d6-9884-f0099daed2ea tempest-FlavorsExtraSpecsTestJSON-1623382506 tempest-FlavorsExtraSpecsTestJSON-1623382506-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/659985101/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.046020 Sep 24 20:50:56.652426 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 162/340] 10.222.0.52 () {58 vars in 1245 bytes} [Sat Sep 24 20:50:56 2022] DELETE /compute/v2.1/flavors/659985101/os-extra_specs/hw:numa_nodes => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 24 20:50:56.657667 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7c69fbd0-78e5-43dc-9610-218e4b11fcd7 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:56.658375 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7c69fbd0-78e5-43dc-9610-218e4b11fcd7 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:56.659175 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7c69fbd0-78e5-43dc-9610-218e4b11fcd7 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:56.659960 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7c69fbd0-78e5-43dc-9610-218e4b11fcd7 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:56.660719 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7c69fbd0-78e5-43dc-9610-218e4b11fcd7 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:56.661157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7c69fbd0-78e5-43dc-9610-218e4b11fcd7 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:56.666724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f1529bdf-730b-45e4-8904-8efc0b442f7d tempest-FlavorsExtraSpecsTestJSON-1623382506 tempest-FlavorsExtraSpecsTestJSON-1623382506-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:56.706807 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f1529bdf-730b-45e4-8904-8efc0b442f7d tempest-FlavorsExtraSpecsTestJSON-1623382506 tempest-FlavorsExtraSpecsTestJSON-1623382506-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/659985101/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.049395 Sep 24 20:50:56.707385 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 163/341] 10.222.0.52 () {58 vars in 1245 bytes} [Sat Sep 24 20:50:56 2022] DELETE /compute/v2.1/flavors/659985101/os-extra_specs/hw:cpu_policy => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 24 20:50:56.721615 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fc7b993f-b404-456c-a71f-3457f5deaed3 tempest-FlavorsExtraSpecsTestJSON-1623382506 tempest-FlavorsExtraSpecsTestJSON-1623382506-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:56.738611 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fc7b993f-b404-456c-a71f-3457f5deaed3 tempest-FlavorsExtraSpecsTestJSON-1623382506 tempest-FlavorsExtraSpecsTestJSON-1623382506-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/659985101/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.025987 Sep 24 20:50:56.740419 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 164/342] 10.222.0.52 () {58 vars in 1200 bytes} [Sat Sep 24 20:50:56 2022] GET /compute/v2.1/flavors/659985101/os-extra_specs => generated 19 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 24 20:50:56.745355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-37913cc3-132b-4e37-a4c4-8b84510dc798 req-4cca18a5-a424-44ca-bdc0-02aa8542fd5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59b0e336-5d09-43b8-b126-6b8e0a33f813", "name": "network-vif-plugged", "status": "completed", "tag": "1ff5d9c6-f16b-4bec-a6ed-b7254060cab5"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:56.770639 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-37913cc3-132b-4e37-a4c4-8b84510dc798 req-4cca18a5-a424-44ca-bdc0-02aa8542fd5c service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:56.771597 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-37913cc3-132b-4e37-a4c4-8b84510dc798 req-4cca18a5-a424-44ca-bdc0-02aa8542fd5c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:56.772276 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-37913cc3-132b-4e37-a4c4-8b84510dc798 req-4cca18a5-a424-44ca-bdc0-02aa8542fd5c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:56.786878 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-37913cc3-132b-4e37-a4c4-8b84510dc798 req-4cca18a5-a424-44ca-bdc0-02aa8542fd5c service nova] Creating event network-vif-plugged:1ff5d9c6-f16b-4bec-a6ed-b7254060cab5 for instance 59b0e336-5d09-43b8-b126-6b8e0a33f813 on nch2-master-1 Sep 24 20:50:56.796700 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-37913cc3-132b-4e37-a4c4-8b84510dc798 req-4cca18a5-a424-44ca-bdc0-02aa8542fd5c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054879 Sep 24 20:50:56.799431 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 165/343] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:56.808369 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-03c52137-f499-4e45-8299-8938bb39ca54 tempest-FlavorsExtraSpecsTestJSON-1623382506 tempest-FlavorsExtraSpecsTestJSON-1623382506-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:56.830841 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-03c52137-f499-4e45-8299-8938bb39ca54 tempest-FlavorsExtraSpecsTestJSON-1623382506 tempest-FlavorsExtraSpecsTestJSON-1623382506-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/659985101" status: 202 len: 0 microversion: 2.1 time: 0.029097 Sep 24 20:50:56.832168 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 166/344] 10.222.0.52 () {58 vars in 1158 bytes} [Sat Sep 24 20:50:56 2022] DELETE /compute/v2.1/flavors/659985101 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:50:56.841062 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-55d900b5-be41-42e5-979d-266eacc1bd94 tempest-FlavorsExtraSpecsTestJSON-1623382506 tempest-FlavorsExtraSpecsTestJSON-1623382506-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:56.864885 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-55d900b5-be41-42e5-979d-266eacc1bd94 tempest-FlavorsExtraSpecsTestJSON-1623382506 tempest-FlavorsExtraSpecsTestJSON-1623382506-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.028264 Sep 24 20:50:56.865738 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 167/345] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:50:56 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:50:56.884524 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7c69fbd0-78e5-43dc-9610-218e4b11fcd7 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8a91794144d73a8942f5c3bac8cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3800968cd944059a397e9c6b35f976d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:56.894031 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7c69fbd0-78e5-43dc-9610-218e4b11fcd7 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813" status: 200 len: 1318 microversion: 2.1 time: 0.259180 Sep 24 20:50:56.899568 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 179/346] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:56 2022] GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813 => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:50:56.928544 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e9526cd7-c542-475f-913f-caf7d9d7bd14 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:56.929300 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e9526cd7-c542-475f-913f-caf7d9d7bd14 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:56.937035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9526cd7-c542-475f-913f-caf7d9d7bd14 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:56.937551 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9526cd7-c542-475f-913f-caf7d9d7bd14 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:56.937996 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9526cd7-c542-475f-913f-caf7d9d7bd14 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:56.938753 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9526cd7-c542-475f-913f-caf7d9d7bd14 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:56.939221 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9526cd7-c542-475f-913f-caf7d9d7bd14 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:56.940070 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9526cd7-c542-475f-913f-caf7d9d7bd14 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:57.125544 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e9526cd7-c542-475f-913f-caf7d9d7bd14 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:57.134983 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e9526cd7-c542-475f-913f-caf7d9d7bd14 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1476 microversion: 2.1 time: 0.210720 Sep 24 20:50:57.136103 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 168/347] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:56 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1476 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:50:57.366385 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ee94b13a-d2c3-4d44-b35a-a85632ee95c4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:57.367031 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ee94b13a-d2c3-4d44-b35a-a85632ee95c4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:57.374212 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee94b13a-d2c3-4d44-b35a-a85632ee95c4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:57.374730 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee94b13a-d2c3-4d44-b35a-a85632ee95c4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:57.375357 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee94b13a-d2c3-4d44-b35a-a85632ee95c4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:57.376697 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee94b13a-d2c3-4d44-b35a-a85632ee95c4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:57.377169 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee94b13a-d2c3-4d44-b35a-a85632ee95c4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:57.377593 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee94b13a-d2c3-4d44-b35a-a85632ee95c4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:57.436208 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:50:57.481150 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:50:57.520575 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-161b29c6-e2b0-4fec-b0bd-b38cb322c017 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:57.521470 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-161b29c6-e2b0-4fec-b0bd-b38cb322c017 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:57.528941 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-161b29c6-e2b0-4fec-b0bd-b38cb322c017 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:57.529968 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-161b29c6-e2b0-4fec-b0bd-b38cb322c017 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:57.530646 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-161b29c6-e2b0-4fec-b0bd-b38cb322c017 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:57.531572 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-161b29c6-e2b0-4fec-b0bd-b38cb322c017 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:57.532148 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-161b29c6-e2b0-4fec-b0bd-b38cb322c017 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:57.533009 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-161b29c6-e2b0-4fec-b0bd-b38cb322c017 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:57.588796 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ee94b13a-d2c3-4d44-b35a-a85632ee95c4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:57.598130 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ee94b13a-d2c3-4d44-b35a-a85632ee95c4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5" status: 200 len: 1311 microversion: 2.1 time: 0.237563 Sep 24 20:50:57.599370 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 180/348] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:57 2022] GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 => generated 1311 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:57.638782 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-161b29c6-e2b0-4fec-b0bd-b38cb322c017 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:57.650750 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-161b29c6-e2b0-4fec-b0bd-b38cb322c017 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:57.652814 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-161b29c6-e2b0-4fec-b0bd-b38cb322c017 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:57.662570 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-161b29c6-e2b0-4fec-b0bd-b38cb322c017 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.146524 Sep 24 20:50:57.663448 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 169/349] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:50:57 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:50:57.922202 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-837dea57-6e8a-4e5a-9e80-01438bd7cf08 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:57.923662 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-837dea57-6e8a-4e5a-9e80-01438bd7cf08 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 59b0e336-5d09-43b8-b126-6b8e0a33f813] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:57.930647 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-837dea57-6e8a-4e5a-9e80-01438bd7cf08 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:57.931703 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-837dea57-6e8a-4e5a-9e80-01438bd7cf08 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:57.932747 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-837dea57-6e8a-4e5a-9e80-01438bd7cf08 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:57.933894 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-837dea57-6e8a-4e5a-9e80-01438bd7cf08 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:57.934443 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-837dea57-6e8a-4e5a-9e80-01438bd7cf08 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:57.935005 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-837dea57-6e8a-4e5a-9e80-01438bd7cf08 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:58.091848 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-837dea57-6e8a-4e5a-9e80-01438bd7cf08 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8a91794144d73a8942f5c3bac8cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3800968cd944059a397e9c6b35f976d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:58.100544 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-837dea57-6e8a-4e5a-9e80-01438bd7cf08 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813" status: 200 len: 1318 microversion: 2.1 time: 0.183203 Sep 24 20:50:58.114912 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 181/350] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:57 2022] GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813 => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:58.165195 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0f762806-0c94-45e5-966d-9c529fe897eb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:58.167336 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0f762806-0c94-45e5-966d-9c529fe897eb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:58.172786 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=18 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:50:58.187018 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f762806-0c94-45e5-966d-9c529fe897eb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:58.188509 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f762806-0c94-45e5-966d-9c529fe897eb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:58.189527 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f762806-0c94-45e5-966d-9c529fe897eb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:58.190316 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f762806-0c94-45e5-966d-9c529fe897eb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:58.191117 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f762806-0c94-45e5-966d-9c529fe897eb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:58.191544 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f762806-0c94-45e5-966d-9c529fe897eb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:58.503810 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0f762806-0c94-45e5-966d-9c529fe897eb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:58.513290 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0f762806-0c94-45e5-966d-9c529fe897eb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1476 microversion: 2.1 time: 0.356848 Sep 24 20:50:58.513876 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 170/351] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:58 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1476 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:58.623087 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e9e7effa-5c5e-42c7-8549-7b35c7bef069 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:58.623886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e9e7effa-5c5e-42c7-8549-7b35c7bef069 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:58.637589 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e9e7effa-5c5e-42c7-8549-7b35c7bef069 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:58.638613 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e9e7effa-5c5e-42c7-8549-7b35c7bef069 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:58.639275 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e9e7effa-5c5e-42c7-8549-7b35c7bef069 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:58.640370 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e9e7effa-5c5e-42c7-8549-7b35c7bef069 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:58.641053 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e9e7effa-5c5e-42c7-8549-7b35c7bef069 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:58.641696 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e9e7effa-5c5e-42c7-8549-7b35c7bef069 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:58.907950 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e9e7effa-5c5e-42c7-8549-7b35c7bef069 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:58.916546 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e9e7effa-5c5e-42c7-8549-7b35c7bef069 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5" status: 200 len: 1311 microversion: 2.1 time: 0.297976 Sep 24 20:50:58.929067 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 182/352] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:58 2022] GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 => generated 1311 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:58.937836 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ba5156b1-1e54-4906-9a8c-d3c46b135265 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:58.938666 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ba5156b1-1e54-4906-9a8c-d3c46b135265 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:58.945235 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba5156b1-1e54-4906-9a8c-d3c46b135265 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:58.945927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba5156b1-1e54-4906-9a8c-d3c46b135265 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:58.946713 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba5156b1-1e54-4906-9a8c-d3c46b135265 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:58.947588 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba5156b1-1e54-4906-9a8c-d3c46b135265 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:58.948202 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba5156b1-1e54-4906-9a8c-d3c46b135265 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:58.949311 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba5156b1-1e54-4906-9a8c-d3c46b135265 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:59.003230 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ea346d07-c10b-4a63-a4a2-4b6f201e4a1c tempest-NetworksTest-1541431612 tempest-NetworksTest-1541431612-project-admin] Calling method '.version_select at 0x7f4b0d1c4dc0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:59.029766 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ba5156b1-1e54-4906-9a8c-d3c46b135265 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:59.040110 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ba5156b1-1e54-4906-9a8c-d3c46b135265 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:59.041758 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ba5156b1-1e54-4906-9a8c-d3c46b135265 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:59.047938 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6,nova_api:SAVEPOINT=6,nova_api:RELEASE=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:50:59.051356 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ba5156b1-1e54-4906-9a8c-d3c46b135265 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.116832 Sep 24 20:50:59.052578 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 183/353] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:50:58 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:50:59.124428 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-242a0474-51c7-435b-b9c5-d04a1cb3fb14 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:59.125107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-242a0474-51c7-435b-b9c5-d04a1cb3fb14 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 59b0e336-5d09-43b8-b126-6b8e0a33f813] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:59.136985 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-242a0474-51c7-435b-b9c5-d04a1cb3fb14 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:59.137661 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-242a0474-51c7-435b-b9c5-d04a1cb3fb14 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:59.138058 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-242a0474-51c7-435b-b9c5-d04a1cb3fb14 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:59.138922 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-242a0474-51c7-435b-b9c5-d04a1cb3fb14 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:59.139421 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-242a0474-51c7-435b-b9c5-d04a1cb3fb14 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:59.139851 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-242a0474-51c7-435b-b9c5-d04a1cb3fb14 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:59.296476 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ea346d07-c10b-4a63-a4a2-4b6f201e4a1c tempest-NetworksTest-1541431612 tempest-NetworksTest-1541431612-project-admin] 10.222.0.52 "GET /compute/v2.1/os-networks" status: 200 len: 4684 microversion: 2.1 time: 0.631685 Sep 24 20:50:59.297186 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 171/354] 10.222.0.52 () {58 vars in 1137 bytes} [Sat Sep 24 20:50:58 2022] GET /compute/v2.1/os-networks => generated 4684 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:50:59.306271 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f5926572-aac5-4d52-9a0a-44a6525cd068 tempest-NetworksTest-1541431612 tempest-NetworksTest-1541431612-project-admin] Calling method '.version_select at 0x7f4b0d1c4b80>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:59.407616 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-242a0474-51c7-435b-b9c5-d04a1cb3fb14 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8a91794144d73a8942f5c3bac8cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3800968cd944059a397e9c6b35f976d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:59.420278 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-242a0474-51c7-435b-b9c5-d04a1cb3fb14 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813" status: 200 len: 1467 microversion: 2.1 time: 0.300041 Sep 24 20:50:59.421462 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 184/355] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:59 2022] GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813 => generated 1467 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:50:59.441990 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f5926572-aac5-4d52-9a0a-44a6525cd068 tempest-NetworksTest-1541431612 tempest-NetworksTest-1541431612-project-admin] 10.222.0.52 "GET /compute/v2.1/os-networks/c58107ef-9de1-4174-95fe-9673bfb49cab" status: 200 len: 652 microversion: 2.1 time: 0.140139 Sep 24 20:50:59.442744 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 172/356] 10.222.0.52 () {58 vars in 1248 bytes} [Sat Sep 24 20:50:59 2022] GET /compute/v2.1/os-networks/c58107ef-9de1-4174-95fe-9673bfb49cab => generated 652 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:50:59.452025 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-24394a82-fb8c-47f7-a819-df205454cf68 tempest-DeleteServersAdminTestJSON-1230208415 tempest-DeleteServersAdminTestJSON-1230208415-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:50:59.452967 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c5498ed3-6f2d-4ca9-928e-e7ee0bfc6441 tempest-NetworksTest-1541431612 tempest-NetworksTest-1541431612-project-admin] Calling method '.version_select at 0x7f4b0d014d30>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:59.455209 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-24394a82-fb8c-47f7-a819-df205454cf68 tempest-DeleteServersAdminTestJSON-1230208415 tempest-DeleteServersAdminTestJSON-1230208415-project-admin] [instance: 59b0e336-5d09-43b8-b126-6b8e0a33f813] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:59.462739 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-24394a82-fb8c-47f7-a819-df205454cf68 tempest-DeleteServersAdminTestJSON-1230208415 tempest-DeleteServersAdminTestJSON-1230208415-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:59.463392 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-24394a82-fb8c-47f7-a819-df205454cf68 tempest-DeleteServersAdminTestJSON-1230208415 tempest-DeleteServersAdminTestJSON-1230208415-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:59.464016 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-24394a82-fb8c-47f7-a819-df205454cf68 tempest-DeleteServersAdminTestJSON-1230208415 tempest-DeleteServersAdminTestJSON-1230208415-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:59.465302 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-24394a82-fb8c-47f7-a819-df205454cf68 tempest-DeleteServersAdminTestJSON-1230208415 tempest-DeleteServersAdminTestJSON-1230208415-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:59.465985 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-24394a82-fb8c-47f7-a819-df205454cf68 tempest-DeleteServersAdminTestJSON-1230208415 tempest-DeleteServersAdminTestJSON-1230208415-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:59.466683 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-24394a82-fb8c-47f7-a819-df205454cf68 tempest-DeleteServersAdminTestJSON-1230208415 tempest-DeleteServersAdminTestJSON-1230208415-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:59.564861 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-24394a82-fb8c-47f7-a819-df205454cf68 tempest-DeleteServersAdminTestJSON-1230208415 tempest-DeleteServersAdminTestJSON-1230208415-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813/action" status: 202 len: 0 microversion: 2.1 time: 0.124000 Sep 24 20:50:59.565864 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 185/357] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:50:59 2022] POST /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 20:50:59.571800 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9a09d6a1-f2e4-4b73-847a-5d5c6b45ae12 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:59.572745 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9a09d6a1-f2e4-4b73-847a-5d5c6b45ae12 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:59.579504 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9a09d6a1-f2e4-4b73-847a-5d5c6b45ae12 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:59.580003 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9a09d6a1-f2e4-4b73-847a-5d5c6b45ae12 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:59.580450 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9a09d6a1-f2e4-4b73-847a-5d5c6b45ae12 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:59.581344 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9a09d6a1-f2e4-4b73-847a-5d5c6b45ae12 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:59.581899 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9a09d6a1-f2e4-4b73-847a-5d5c6b45ae12 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:59.582340 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9a09d6a1-f2e4-4b73-847a-5d5c6b45ae12 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:59.842012 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c5498ed3-6f2d-4ca9-928e-e7ee0bfc6441 tempest-NetworksTest-1541431612 tempest-NetworksTest-1541431612-project-admin] 10.222.0.52 "GET /compute/v2.1/os-networks" status: 200 len: 4684 microversion: 2.1 time: 0.394026 Sep 24 20:50:59.843089 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 173/358] 10.222.0.52 () {58 vars in 1137 bytes} [Sat Sep 24 20:50:59 2022] GET /compute/v2.1/os-networks => generated 4684 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:50:59.852818 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c7a2f7a6-ed7e-4c0c-91b1-922ea1bf3771 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:59.853339 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c7a2f7a6-ed7e-4c0c-91b1-922ea1bf3771 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 59b0e336-5d09-43b8-b126-6b8e0a33f813] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:59.864123 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c7a2f7a6-ed7e-4c0c-91b1-922ea1bf3771 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:59.865295 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c7a2f7a6-ed7e-4c0c-91b1-922ea1bf3771 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:59.866087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c7a2f7a6-ed7e-4c0c-91b1-922ea1bf3771 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:59.867129 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c7a2f7a6-ed7e-4c0c-91b1-922ea1bf3771 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:59.867892 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c7a2f7a6-ed7e-4c0c-91b1-922ea1bf3771 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:59.873184 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9a09d6a1-f2e4-4b73-847a-5d5c6b45ae12 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:50:59.882069 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9a09d6a1-f2e4-4b73-847a-5d5c6b45ae12 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1476 microversion: 2.1 time: 0.314713 Sep 24 20:50:59.884688 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c7a2f7a6-ed7e-4c0c-91b1-922ea1bf3771 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:59.896304 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 186/359] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:59 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1476 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:50:59.900815 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9a09d6a1-f2e4-4b73-847a-5d5c6b45ae12 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:59.901819 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9a09d6a1-f2e4-4b73-847a-5d5c6b45ae12 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004474 Sep 24 20:50:59.902263 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 187/360] 10.222.0.52 () {56 vars in 886 bytes} [Sat Sep 24 20:50:59 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 24 20:50:59.936023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c7a2f7a6-ed7e-4c0c-91b1-922ea1bf3771 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:59.936522 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c7a2f7a6-ed7e-4c0c-91b1-922ea1bf3771 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:59.937330 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c7a2f7a6-ed7e-4c0c-91b1-922ea1bf3771 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:59.937764 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-c7a2f7a6-ed7e-4c0c-91b1-922ea1bf3771 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lazy-loading 'fault' on Instance uuid 59b0e336-5d09-43b8-b126-6b8e0a33f813 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:50:59.942001 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c988153c-33f8-441c-a28e-2adae630350e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:50:59.942640 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c988153c-33f8-441c-a28e-2adae630350e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:50:59.950019 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c988153c-33f8-441c-a28e-2adae630350e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:59.950846 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c988153c-33f8-441c-a28e-2adae630350e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:59.951432 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c988153c-33f8-441c-a28e-2adae630350e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:50:59.952288 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c988153c-33f8-441c-a28e-2adae630350e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:50:59.952920 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c988153c-33f8-441c-a28e-2adae630350e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:50:59.953490 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c988153c-33f8-441c-a28e-2adae630350e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:00.134210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c7a2f7a6-ed7e-4c0c-91b1-922ea1bf3771 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8a91794144d73a8942f5c3bac8cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3800968cd944059a397e9c6b35f976d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:00.140372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c988153c-33f8-441c-a28e-2adae630350e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:00.147387 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c7a2f7a6-ed7e-4c0c-91b1-922ea1bf3771 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813" status: 200 len: 1450 microversion: 2.1 time: 0.298995 Sep 24 20:51:00.148780 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 174/361] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:59 2022] GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813 => generated 1450 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:00.153483 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c988153c-33f8-441c-a28e-2adae630350e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5" status: 200 len: 1311 microversion: 2.1 time: 0.216094 Sep 24 20:51:00.154253 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 188/362] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:50:59 2022] GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 => generated 1311 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:00.160949 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2af8d5e6-917f-40a0-be0b-fbf633aa1a9c tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:00.162145 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2af8d5e6-917f-40a0-be0b-fbf633aa1a9c tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:00.172696 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2af8d5e6-917f-40a0-be0b-fbf633aa1a9c tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:00.173233 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2af8d5e6-917f-40a0-be0b-fbf633aa1a9c tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:00.173681 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2af8d5e6-917f-40a0-be0b-fbf633aa1a9c tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:00.174428 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2af8d5e6-917f-40a0-be0b-fbf633aa1a9c tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:00.174914 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2af8d5e6-917f-40a0-be0b-fbf633aa1a9c tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:00.175346 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2af8d5e6-917f-40a0-be0b-fbf633aa1a9c tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:00.176173 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ebd4cbc8-2560-41c0-a8db-a2ad82ccaaee tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:00.176966 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ebd4cbc8-2560-41c0-a8db-a2ad82ccaaee tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 59b0e336-5d09-43b8-b126-6b8e0a33f813] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:00.183432 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ebd4cbc8-2560-41c0-a8db-a2ad82ccaaee tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:00.184184 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ebd4cbc8-2560-41c0-a8db-a2ad82ccaaee tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:00.184815 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ebd4cbc8-2560-41c0-a8db-a2ad82ccaaee tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:00.186009 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ebd4cbc8-2560-41c0-a8db-a2ad82ccaaee tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:00.187428 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ebd4cbc8-2560-41c0-a8db-a2ad82ccaaee tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:00.188125 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ebd4cbc8-2560-41c0-a8db-a2ad82ccaaee tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:00.222930 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ebd4cbc8-2560-41c0-a8db-a2ad82ccaaee tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 59b0e336-5d09-43b8-b126-6b8e0a33f813] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:51:00.262471 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2af8d5e6-917f-40a0-be0b-fbf633aa1a9c tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:00.272617 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2af8d5e6-917f-40a0-be0b-fbf633aa1a9c tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:00.274460 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2af8d5e6-917f-40a0-be0b-fbf633aa1a9c tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:00.284985 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2af8d5e6-917f-40a0-be0b-fbf633aa1a9c tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.135176 Sep 24 20:51:00.301848 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 175/363] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:51:00 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:51:00.353859 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ebd4cbc8-2560-41c0-a8db-a2ad82ccaaee tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "DELETE /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813" status: 204 len: 0 microversion: 2.1 time: 0.182373 Sep 24 20:51:00.354456 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 189/364] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:51:00 2022] DELETE /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 24 20:51:00.363251 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bebc7214-1f1b-428e-93b4-b2d14c60a9d5 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:00.363982 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bebc7214-1f1b-428e-93b4-b2d14c60a9d5 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 59b0e336-5d09-43b8-b126-6b8e0a33f813] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:00.371082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bebc7214-1f1b-428e-93b4-b2d14c60a9d5 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:00.371583 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bebc7214-1f1b-428e-93b4-b2d14c60a9d5 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:00.372025 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bebc7214-1f1b-428e-93b4-b2d14c60a9d5 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:00.372737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bebc7214-1f1b-428e-93b4-b2d14c60a9d5 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:00.373192 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bebc7214-1f1b-428e-93b4-b2d14c60a9d5 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:00.373623 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bebc7214-1f1b-428e-93b4-b2d14c60a9d5 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:00.408481 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bebc7214-1f1b-428e-93b4-b2d14c60a9d5 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:00.408974 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bebc7214-1f1b-428e-93b4-b2d14c60a9d5 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:00.409406 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bebc7214-1f1b-428e-93b4-b2d14c60a9d5 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:00.410021 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-bebc7214-1f1b-428e-93b4-b2d14c60a9d5 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lazy-loading 'fault' on Instance uuid 59b0e336-5d09-43b8-b126-6b8e0a33f813 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:51:00.622283 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bebc7214-1f1b-428e-93b4-b2d14c60a9d5 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8a91794144d73a8942f5c3bac8cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3800968cd944059a397e9c6b35f976d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:00.624499 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:51:00.633642 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bebc7214-1f1b-428e-93b4-b2d14c60a9d5 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813" status: 200 len: 1456 microversion: 2.1 time: 0.274420 Sep 24 20:51:00.646925 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 176/365] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:00 2022] GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813 => generated 1456 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:51:00.906739 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-05b1de36-f87a-49ed-9524-829fdc83b556 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:00.907438 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-05b1de36-f87a-49ed-9524-829fdc83b556 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:00.914579 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05b1de36-f87a-49ed-9524-829fdc83b556 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:00.916597 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05b1de36-f87a-49ed-9524-829fdc83b556 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:00.918075 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05b1de36-f87a-49ed-9524-829fdc83b556 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:00.918976 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05b1de36-f87a-49ed-9524-829fdc83b556 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:00.921478 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05b1de36-f87a-49ed-9524-829fdc83b556 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:00.924571 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05b1de36-f87a-49ed-9524-829fdc83b556 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:01.025864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9bf9feca-eb08-49ee-8ba0-f13e7aff2994 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] Calling method '.version_select at 0x7f4b0d101670>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:01.029795 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9bf9feca-eb08-49ee-8ba0-f13e7aff2994 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:01.029998 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9bf9feca-eb08-49ee-8ba0-f13e7aff2994 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:01.030449 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9bf9feca-eb08-49ee-8ba0-f13e7aff2994 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:01.034712 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9bf9feca-eb08-49ee-8ba0-f13e7aff2994 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:01.035396 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9bf9feca-eb08-49ee-8ba0-f13e7aff2994 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:01.036008 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9bf9feca-eb08-49ee-8ba0-f13e7aff2994 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:01.070956 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9bf9feca-eb08-49ee-8ba0-f13e7aff2994 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.222534 Sep 24 20:51:01.072039 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 190/366] 10.222.0.52 () {58 vars in 1128 bytes} [Sat Sep 24 20:51:00 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:01.137680 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-05b1de36-f87a-49ed-9524-829fdc83b556 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:01.147061 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-05b1de36-f87a-49ed-9524-829fdc83b556 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1476 microversion: 2.1 time: 0.244861 Sep 24 20:51:01.162901 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 177/367] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:00 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1476 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:51:01.178973 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-908f173e-2c06-4e0a-9aa5-288a828bfb69 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:01.179988 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-908f173e-2c06-4e0a-9aa5-288a828bfb69 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:01.186916 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-908f173e-2c06-4e0a-9aa5-288a828bfb69 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:01.187598 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-908f173e-2c06-4e0a-9aa5-288a828bfb69 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:01.188182 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-908f173e-2c06-4e0a-9aa5-288a828bfb69 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:01.189326 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-908f173e-2c06-4e0a-9aa5-288a828bfb69 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:01.189879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-908f173e-2c06-4e0a-9aa5-288a828bfb69 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:01.190742 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-908f173e-2c06-4e0a-9aa5-288a828bfb69 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:01.357004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-908f173e-2c06-4e0a-9aa5-288a828bfb69 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:01.366095 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-908f173e-2c06-4e0a-9aa5-288a828bfb69 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5" status: 200 len: 1311 microversion: 2.1 time: 0.191229 Sep 24 20:51:01.366700 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 178/368] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:01 2022] GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 => generated 1311 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:01.376816 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-607ed445-3e7c-494f-9c5b-c95d20c7bcc4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:01.377440 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-607ed445-3e7c-494f-9c5b-c95d20c7bcc4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:01.384371 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-607ed445-3e7c-494f-9c5b-c95d20c7bcc4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:01.384884 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-607ed445-3e7c-494f-9c5b-c95d20c7bcc4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:01.385511 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-607ed445-3e7c-494f-9c5b-c95d20c7bcc4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:01.387137 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-607ed445-3e7c-494f-9c5b-c95d20c7bcc4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:01.388063 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-607ed445-3e7c-494f-9c5b-c95d20c7bcc4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:01.388652 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-607ed445-3e7c-494f-9c5b-c95d20c7bcc4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:01.390857 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ccca61f2-379e-4762-8e3a-cdf1f9960e83 tempest-HostsAdminNegativeTestJSON-876583914 tempest-HostsAdminNegativeTestJSON-876583914-project] Calling method '.version_select at 0x7f4b0d01b790>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:01.394865 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ccca61f2-379e-4762-8e3a-cdf1f9960e83 tempest-HostsAdminNegativeTestJSON-876583914 tempest-HostsAdminNegativeTestJSON-876583914-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'a3590953b1ca4dcfb5da6a319bfb11fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8cfbd9651040b1a4c9844f088a857b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:01.397753 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ccca61f2-379e-4762-8e3a-cdf1f9960e83 tempest-HostsAdminNegativeTestJSON-876583914 tempest-HostsAdminNegativeTestJSON-876583914-project] Request method failure captured: Sep 24 20:51:01.397753 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Sep 24 20:51:01.397753 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:51:01.397753 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:51:01.397753 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:51:01.397753 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:51:01.397753 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:51:01.397753 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:51:01.397753 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:51:01.397753 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:51:01.397753 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL22zal4HhIrJ5nWTXw2-GYBMsXYj_N6ccV5iKIrL10bRYifmICj2taBQdT16hulcSHc--Q9w6i3gSpRYjLk4ec9VK8GWNzs6ilrJ7xeh7j_Gb4VC7HI-E1RUvivK1qLZQk-YuP9rgQkdXb6X9DOJ2JI7_EulFI_7yIAxt__NWB7c-ig Sep 24 20:51:01.397753 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:51:01.397753 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:51:01.397753 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:51:01.397753 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:51:01.397753 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:51:01.397753 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:51:01.397753 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: fc8cfbd9651040b1a4c9844f088a857b Sep 24 20:51:01.397753 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-876583914 Sep 24 20:51:01.397753 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:51:01.397753 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:51:01.399312 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fc8cfbd9651040b1a4c9844f088a857b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fc8cfbd9651040b1a4c9844f088a857b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fc8cfbd9651040b1a4c9844f088a857b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fc8cfbd9651040b1a4c9844f088a857b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:51:01.399312 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-HostsAdminNegativeTestJSON-876583914 Sep 24 20:51:01.399312 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: fc8cfbd9651040b1a4c9844f088a857b Sep 24 20:51:01.399312 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-876583914 Sep 24 20:51:01.399312 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-HostsAdminNegativeTestJSON-876583914-project Sep 24 20:51:01.399312 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:51:01.399312 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:51:01.399312 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: a3590953b1ca4dcfb5da6a319bfb11fe Sep 24 20:51:01.399312 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-HostsAdminNegativeTestJSON-876583914-project Sep 24 20:51:01.399312 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:51:01.399312 ncdv-master-1 devstack@n-api.service[140516]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 24 20:51:01.399312 ncdv-master-1 devstack@n-api.service[140516]: action_args: {} Sep 24 20:51:01.399312 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:51:01.400017 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:01.400017 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:01.400017 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:01.400017 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:51:01.400017 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:51:01.400017 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:51:01.400017 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:51:01.400017 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 24 20:51:01.400017 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:51:01.400017 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:51:01.400017 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:51:01.400017 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Sep 24 20:51:01.400017 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Sep 24 20:51:01.400017 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 24 20:51:01.400017 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 24 20:51:01.400017 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 24 20:51:01.400017 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 24 20:51:01.400017 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:51:01.400017 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:51:01.401114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:51:01.401114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:51:01.401114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 24 20:51:01.401114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 24 20:51:01.401114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 24 20:51:01.401114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 24 20:51:01.401114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 24 20:51:01.401114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 24 20:51:01.401114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 24 20:51:01.401114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.401114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:01.401114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.401114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:01.401114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:01.401114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:01.401114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 24 20:51:01.401114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 24 20:51:01.401114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 24 20:51:01.401114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.404973 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ccca61f2-379e-4762-8e3a-cdf1f9960e83 tempest-HostsAdminNegativeTestJSON-876583914 tempest-HostsAdminNegativeTestJSON-876583914-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:51:01.406809 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ccca61f2-379e-4762-8e3a-cdf1f9960e83 tempest-HostsAdminNegativeTestJSON-876583914 tempest-HostsAdminNegativeTestJSON-876583914-project] 10.222.0.52 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.326772 Sep 24 20:51:01.407575 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 191/369] 10.222.0.52 () {58 vars in 1128 bytes} [Sat Sep 24 20:51:01 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 328 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:51:01.419202 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-90db8223-eaac-4d80-8dd5-c3ab4a39cce9 tempest-HostsAdminNegativeTestJSON-876583914 tempest-HostsAdminNegativeTestJSON-876583914-project] Calling method '.version_select at 0x7f4b0cb0cca0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:01.421501 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-90db8223-eaac-4d80-8dd5-c3ab4a39cce9 tempest-HostsAdminNegativeTestJSON-876583914 tempest-HostsAdminNegativeTestJSON-876583914-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'a3590953b1ca4dcfb5da6a319bfb11fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8cfbd9651040b1a4c9844f088a857b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:01.423958 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-90db8223-eaac-4d80-8dd5-c3ab4a39cce9 tempest-HostsAdminNegativeTestJSON-876583914 tempest-HostsAdminNegativeTestJSON-876583914-project] Request method failure captured: Sep 24 20:51:01.423958 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/reboot HTTP/1.1 Sep 24 20:51:01.423958 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:51:01.423958 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:51:01.423958 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:51:01.423958 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:51:01.423958 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:51:01.423958 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:51:01.423958 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:51:01.423958 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:51:01.423958 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL22zal4HhIrJ5nWTXw2-GYBMsXYj_N6ccV5iKIrL10bRYifmICj2taBQdT16hulcSHc--Q9w6i3gSpRYjLk4ec9VK8GWNzs6ilrJ7xeh7j_Gb4VC7HI-E1RUvivK1qLZQk-YuP9rgQkdXb6X9DOJ2JI7_EulFI_7yIAxt__NWB7c-ig Sep 24 20:51:01.423958 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:51:01.423958 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:51:01.423958 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:51:01.423958 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:51:01.423958 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:51:01.423958 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:51:01.423958 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: fc8cfbd9651040b1a4c9844f088a857b Sep 24 20:51:01.423958 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-876583914 Sep 24 20:51:01.423958 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:51:01.423958 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:51:01.425124 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fc8cfbd9651040b1a4c9844f088a857b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fc8cfbd9651040b1a4c9844f088a857b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fc8cfbd9651040b1a4c9844f088a857b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fc8cfbd9651040b1a4c9844f088a857b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:51:01.425124 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-HostsAdminNegativeTestJSON-876583914 Sep 24 20:51:01.425124 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: fc8cfbd9651040b1a4c9844f088a857b Sep 24 20:51:01.425124 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-876583914 Sep 24 20:51:01.425124 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-HostsAdminNegativeTestJSON-876583914-project Sep 24 20:51:01.425124 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:51:01.425124 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:51:01.425124 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: a3590953b1ca4dcfb5da6a319bfb11fe Sep 24 20:51:01.425124 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-HostsAdminNegativeTestJSON-876583914-project Sep 24 20:51:01.425124 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:51:01.425124 ncdv-master-1 devstack@n-api.service[140516]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 24 20:51:01.425124 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'ncdv-master-1'} Sep 24 20:51:01.425124 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:51:01.425814 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:01.425814 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:01.425814 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:01.425814 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:51:01.425814 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:51:01.425814 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:51:01.425814 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:51:01.425814 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:51:01.425814 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:51:01.425814 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Sep 24 20:51:01.425814 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Sep 24 20:51:01.425814 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 24 20:51:01.425814 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 24 20:51:01.425814 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 24 20:51:01.425814 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 24 20:51:01.425814 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:51:01.425814 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:51:01.425814 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:51:01.425814 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:51:01.426817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 24 20:51:01.426817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 24 20:51:01.426817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 24 20:51:01.426817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 24 20:51:01.426817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 24 20:51:01.426817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 24 20:51:01.426817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 24 20:51:01.426817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.426817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:01.426817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.426817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:01.426817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:01.426817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:01.426817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 24 20:51:01.426817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 24 20:51:01.426817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 24 20:51:01.426817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.427685 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-90db8223-eaac-4d80-8dd5-c3ab4a39cce9 tempest-HostsAdminNegativeTestJSON-876583914 tempest-HostsAdminNegativeTestJSON-876583914-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:51:01.429190 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-90db8223-eaac-4d80-8dd5-c3ab4a39cce9 tempest-HostsAdminNegativeTestJSON-876583914 tempest-HostsAdminNegativeTestJSON-876583914-project] 10.222.0.52 "GET /compute/v2.1/os-hosts/ncdv-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.014504 Sep 24 20:51:01.429970 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 192/370] 10.222.0.52 () {58 vars in 1191 bytes} [Sat Sep 24 20:51:01 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/reboot => generated 111 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:51:01.443393 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-783c0204-b45f-498c-9102-8e91701af727 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] Calling method '.version_select at 0x7f4b0cb0cca0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:01.455901 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-783c0204-b45f-498c-9102-8e91701af727 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 24 20:51:01.457907 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-783c0204-b45f-498c-9102-8e91701af727 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] Request method failure captured: Sep 24 20:51:01.457907 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Sep 24 20:51:01.457907 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:51:01.457907 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:51:01.457907 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:51:01.457907 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:51:01.457907 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:51:01.457907 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:51:01.457907 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:51:01.457907 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:51:01.457907 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL220f664dth_d-EpeliJ12YWm7suSvdAhPXIRhCqnGIAwlam6yzPbV9DEaVIJqtpXTTRm_uzh0FqyjX7-wXV8XNDyOCgL8VybmEwqkZhmqN1ZTVFMWESs0OjiNiV4O9tZHw5PNQKT1ksg9lJ08FXhYluLQAg8ZASd4fwPrqxkAm-aqg Sep 24 20:51:01.457907 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:51:01.457907 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:51:01.457907 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:51:01.457907 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:51:01.457907 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:51:01.457907 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:51:01.457907 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: cd8a527890e94f4e841d702b8e766d17 Sep 24 20:51:01.457907 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-640196156 Sep 24 20:51:01.457907 ncdv-master-1 devstack@n-api.service[140516]: X-Role: admin,reader,member Sep 24 20:51:01.457907 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: admin,reader,member Sep 24 20:51:01.459152 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd8a527890e94f4e841d702b8e766d17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cd8a527890e94f4e841d702b8e766d17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cd8a527890e94f4e841d702b8e766d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd8a527890e94f4e841d702b8e766d17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:51:01.459152 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-HostsAdminNegativeTestJSON-640196156 Sep 24 20:51:01.459152 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: cd8a527890e94f4e841d702b8e766d17 Sep 24 20:51:01.459152 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-640196156 Sep 24 20:51:01.459152 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-HostsAdminNegativeTestJSON-640196156-project-admin Sep 24 20:51:01.459152 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:51:01.459152 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:51:01.459152 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 71b1dc505d65433cb8cab4b8ff8480a1 Sep 24 20:51:01.459152 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-HostsAdminNegativeTestJSON-640196156-project-admin Sep 24 20:51:01.459152 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:51:01.459152 ncdv-master-1 devstack@n-api.service[140516]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 24 20:51:01.459152 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'nonexistent_hostname'} Sep 24 20:51:01.459152 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:51:01.459888 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:01.459888 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 24 20:51:01.459888 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 24 20:51:01.459888 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 24 20:51:01.459888 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 24 20:51:01.459888 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:51:01.459888 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:51:01.459888 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:51:01.459888 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:51:01.459888 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 24 20:51:01.459888 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 24 20:51:01.459888 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 24 20:51:01.459888 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 24 20:51:01.459888 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 20:51:01.459888 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 20:51:01.459888 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 24 20:51:01.459888 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 24 20:51:01.459888 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 24 20:51:01.459888 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 24 20:51:01.460913 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 24 20:51:01.460913 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 24 20:51:01.460913 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 24 20:51:01.460913 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.460913 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:01.460913 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.460913 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:01.460913 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:01.460913 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:01.460913 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:51:01.460913 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:51:01.460913 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:51:01.460913 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:51:01.460913 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:51:01.460913 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:51:01.460913 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Sep 24 20:51:01.460913 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Sep 24 20:51:01.460913 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 24 20:51:01.460913 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:51:01.461944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 24 20:51:01.461944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.461944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:01.461944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.461944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:01.461944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:01.461944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:01.461944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:51:01.461944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:51:01.461944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 24 20:51:01.461944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.461944 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-783c0204-b45f-498c-9102-8e91701af727 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:51:01.461944 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-783c0204-b45f-498c-9102-8e91701af727 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.023533 Sep 24 20:51:01.461944 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 193/371] 10.222.0.52 () {58 vars in 1212 bytes} [Sat Sep 24 20:51:01 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 20:51:01.469302 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e9217cba-dfc4-4bc0-9c3f-9bb33edbd6dd tempest-HostsAdminNegativeTestJSON-876583914 tempest-HostsAdminNegativeTestJSON-876583914-project] Calling method '.version_select at 0x7f4b0cd54310>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:01.471357 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e9217cba-dfc4-4bc0-9c3f-9bb33edbd6dd tempest-HostsAdminNegativeTestJSON-876583914 tempest-HostsAdminNegativeTestJSON-876583914-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'a3590953b1ca4dcfb5da6a319bfb11fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8cfbd9651040b1a4c9844f088a857b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:01.475003 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e9217cba-dfc4-4bc0-9c3f-9bb33edbd6dd tempest-HostsAdminNegativeTestJSON-876583914 tempest-HostsAdminNegativeTestJSON-876583914-project] Request method failure captured: Sep 24 20:51:01.475003 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Sep 24 20:51:01.475003 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:51:01.475003 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:51:01.475003 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:51:01.475003 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:51:01.475003 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:51:01.475003 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:51:01.475003 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:51:01.475003 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:51:01.475003 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL22zal4HhIrJ5nWTXw2-GYBMsXYj_N6ccV5iKIrL10bRYifmICj2taBQdT16hulcSHc--Q9w6i3gSpRYjLk4ec9VK8GWNzs6ilrJ7xeh7j_Gb4VC7HI-E1RUvivK1qLZQk-YuP9rgQkdXb6X9DOJ2JI7_EulFI_7yIAxt__NWB7c-ig Sep 24 20:51:01.475003 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:51:01.475003 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:51:01.475003 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:51:01.475003 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:51:01.475003 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:51:01.475003 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:51:01.475003 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: fc8cfbd9651040b1a4c9844f088a857b Sep 24 20:51:01.475003 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-876583914 Sep 24 20:51:01.475003 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:51:01.475003 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:51:01.476256 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fc8cfbd9651040b1a4c9844f088a857b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fc8cfbd9651040b1a4c9844f088a857b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fc8cfbd9651040b1a4c9844f088a857b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fc8cfbd9651040b1a4c9844f088a857b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:51:01.476256 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-HostsAdminNegativeTestJSON-876583914 Sep 24 20:51:01.476256 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: fc8cfbd9651040b1a4c9844f088a857b Sep 24 20:51:01.476256 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-876583914 Sep 24 20:51:01.476256 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-HostsAdminNegativeTestJSON-876583914-project Sep 24 20:51:01.476256 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:51:01.476256 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:51:01.476256 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: a3590953b1ca4dcfb5da6a319bfb11fe Sep 24 20:51:01.476256 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-HostsAdminNegativeTestJSON-876583914-project Sep 24 20:51:01.476256 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:51:01.476256 ncdv-master-1 devstack@n-api.service[140516]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 24 20:51:01.476256 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'ncdv-master-1'} Sep 24 20:51:01.476256 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:51:01.476947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:01.476947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:01.476947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:01.476947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:51:01.476947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:51:01.476947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:51:01.476947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:51:01.476947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:51:01.476947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:51:01.476947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Sep 24 20:51:01.476947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Sep 24 20:51:01.476947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 24 20:51:01.476947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 24 20:51:01.476947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 24 20:51:01.476947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 24 20:51:01.476947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:51:01.476947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:51:01.476947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:51:01.476947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:51:01.478281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 24 20:51:01.478281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 24 20:51:01.478281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 24 20:51:01.478281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 24 20:51:01.478281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 24 20:51:01.478281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 24 20:51:01.478281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 24 20:51:01.478281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.478281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:01.478281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.478281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:01.478281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:01.478281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:01.478281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 24 20:51:01.478281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 24 20:51:01.478281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 24 20:51:01.478281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.480192 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-607ed445-3e7c-494f-9c5b-c95d20c7bcc4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:01.485631 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e9217cba-dfc4-4bc0-9c3f-9bb33edbd6dd tempest-HostsAdminNegativeTestJSON-876583914 tempest-HostsAdminNegativeTestJSON-876583914-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:51:01.487100 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e9217cba-dfc4-4bc0-9c3f-9bb33edbd6dd tempest-HostsAdminNegativeTestJSON-876583914 tempest-HostsAdminNegativeTestJSON-876583914-project] 10.222.0.52 "GET /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 109 microversion: 2.1 time: 0.021759 Sep 24 20:51:01.487365 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-607ed445-3e7c-494f-9c5b-c95d20c7bcc4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:01.489234 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 194/372] 10.222.0.52 () {58 vars in 1170 bytes} [Sat Sep 24 20:51:01 2022] GET /compute/v2.1/os-hosts/ncdv-master-1 => generated 109 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 24 20:51:01.491336 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-607ed445-3e7c-494f-9c5b-c95d20c7bcc4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:01.501645 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-607ed445-3e7c-494f-9c5b-c95d20c7bcc4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.132940 Sep 24 20:51:01.502799 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 179/373] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:51:01 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:51:01.509067 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2c801c42-a343-45e0-9729-8df661f1ce52 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] Calling method '.version_select at 0x7f4b0cd861f0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:01.520975 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-2c801c42-a343-45e0-9729-8df661f1ce52 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 24 20:51:01.524010 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2c801c42-a343-45e0-9729-8df661f1ce52 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] Request method failure captured: Sep 24 20:51:01.524010 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 24 20:51:01.524010 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:51:01.524010 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:51:01.524010 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:51:01.524010 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:51:01.524010 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:51:01.524010 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:51:01.524010 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:51:01.524010 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:51:01.524010 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL220f664dth_d-EpeliJ12YWm7suSvdAhPXIRhCqnGIAwlam6yzPbV9DEaVIJqtpXTTRm_uzh0FqyjX7-wXV8XNDyOCgL8VybmEwqkZhmqN1ZTVFMWESs0OjiNiV4O9tZHw5PNQKT1ksg9lJ08FXhYluLQAg8ZASd4fwPrqxkAm-aqg Sep 24 20:51:01.524010 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:51:01.524010 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:51:01.524010 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:51:01.524010 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:51:01.524010 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:51:01.524010 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:51:01.524010 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: cd8a527890e94f4e841d702b8e766d17 Sep 24 20:51:01.524010 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-640196156 Sep 24 20:51:01.524010 ncdv-master-1 devstack@n-api.service[140516]: X-Role: admin,reader,member Sep 24 20:51:01.524010 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: admin,reader,member Sep 24 20:51:01.525204 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd8a527890e94f4e841d702b8e766d17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cd8a527890e94f4e841d702b8e766d17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cd8a527890e94f4e841d702b8e766d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd8a527890e94f4e841d702b8e766d17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:51:01.525204 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-HostsAdminNegativeTestJSON-640196156 Sep 24 20:51:01.525204 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: cd8a527890e94f4e841d702b8e766d17 Sep 24 20:51:01.525204 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-640196156 Sep 24 20:51:01.525204 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-HostsAdminNegativeTestJSON-640196156-project-admin Sep 24 20:51:01.525204 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:51:01.525204 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:51:01.525204 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 71b1dc505d65433cb8cab4b8ff8480a1 Sep 24 20:51:01.525204 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-HostsAdminNegativeTestJSON-640196156-project-admin Sep 24 20:51:01.525204 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:51:01.525204 ncdv-master-1 devstack@n-api.service[140516]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 24 20:51:01.525204 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'nonexistent_hostname'} Sep 24 20:51:01.525204 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:51:01.525891 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:01.525891 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Sep 24 20:51:01.525891 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 24 20:51:01.525891 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 20:51:01.525891 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 20:51:01.525891 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 24 20:51:01.525891 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 24 20:51:01.525891 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 24 20:51:01.525891 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 24 20:51:01.525891 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 24 20:51:01.525891 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 24 20:51:01.525891 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 24 20:51:01.525891 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.525891 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:01.525891 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.525891 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:01.525891 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:01.525891 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:01.525891 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:51:01.527569 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:51:01.527569 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:51:01.527569 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:51:01.527569 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:51:01.527569 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:51:01.527569 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Sep 24 20:51:01.527569 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:51:01.527569 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 24 20:51:01.527569 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.527569 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:01.527569 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.527569 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:01.527569 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:01.527569 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:01.527569 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:51:01.527569 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:51:01.527569 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 24 20:51:01.527569 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.529037 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2c801c42-a343-45e0-9729-8df661f1ce52 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:51:01.529037 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2c801c42-a343-45e0-9729-8df661f1ce52 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.029712 Sep 24 20:51:01.529037 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 195/374] 10.222.0.52 () {58 vars in 1191 bytes} [Sat Sep 24 20:51:01 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 24 20:51:01.535863 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-71609011-6bff-454c-9c84-4867bc94cc59 tempest-HostsAdminNegativeTestJSON-876583914 tempest-HostsAdminNegativeTestJSON-876583914-project] Calling method '.version_select at 0x7f4b0d069310>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:01.538278 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-71609011-6bff-454c-9c84-4867bc94cc59 tempest-HostsAdminNegativeTestJSON-876583914 tempest-HostsAdminNegativeTestJSON-876583914-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'a3590953b1ca4dcfb5da6a319bfb11fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8cfbd9651040b1a4c9844f088a857b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:01.540664 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-71609011-6bff-454c-9c84-4867bc94cc59 tempest-HostsAdminNegativeTestJSON-876583914 tempest-HostsAdminNegativeTestJSON-876583914-project] Request method failure captured: Sep 24 20:51:01.540664 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown HTTP/1.1 Sep 24 20:51:01.540664 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:51:01.540664 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:51:01.540664 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:51:01.540664 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:51:01.540664 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:51:01.540664 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:51:01.540664 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:51:01.540664 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:51:01.540664 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL22zal4HhIrJ5nWTXw2-GYBMsXYj_N6ccV5iKIrL10bRYifmICj2taBQdT16hulcSHc--Q9w6i3gSpRYjLk4ec9VK8GWNzs6ilrJ7xeh7j_Gb4VC7HI-E1RUvivK1qLZQk-YuP9rgQkdXb6X9DOJ2JI7_EulFI_7yIAxt__NWB7c-ig Sep 24 20:51:01.540664 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:51:01.540664 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:51:01.540664 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:51:01.540664 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:51:01.540664 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:51:01.540664 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:51:01.540664 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: fc8cfbd9651040b1a4c9844f088a857b Sep 24 20:51:01.540664 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-876583914 Sep 24 20:51:01.540664 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:51:01.540664 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:51:01.541832 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fc8cfbd9651040b1a4c9844f088a857b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fc8cfbd9651040b1a4c9844f088a857b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fc8cfbd9651040b1a4c9844f088a857b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fc8cfbd9651040b1a4c9844f088a857b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:51:01.541832 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-HostsAdminNegativeTestJSON-876583914 Sep 24 20:51:01.541832 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: fc8cfbd9651040b1a4c9844f088a857b Sep 24 20:51:01.541832 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-876583914 Sep 24 20:51:01.541832 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-HostsAdminNegativeTestJSON-876583914-project Sep 24 20:51:01.541832 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:51:01.541832 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:51:01.541832 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: a3590953b1ca4dcfb5da6a319bfb11fe Sep 24 20:51:01.541832 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-HostsAdminNegativeTestJSON-876583914-project Sep 24 20:51:01.541832 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 20:51:01.541832 ncdv-master-1 devstack@n-api.service[140517]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 24 20:51:01.541832 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'ncdv-master-1'} Sep 24 20:51:01.541832 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:51:01.542621 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:01.542621 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:01.542621 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:01.542621 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:51:01.542621 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:51:01.542621 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:51:01.542621 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:51:01.542621 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:51:01.542621 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:51:01.542621 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Sep 24 20:51:01.542621 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Sep 24 20:51:01.542621 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 24 20:51:01.542621 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 24 20:51:01.542621 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 24 20:51:01.542621 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 24 20:51:01.542621 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:51:01.542621 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:51:01.542621 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:51:01.542621 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:51:01.544545 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 24 20:51:01.544545 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 24 20:51:01.544545 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 24 20:51:01.544545 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 24 20:51:01.544545 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 24 20:51:01.544545 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 24 20:51:01.544545 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 24 20:51:01.544545 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.544545 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:01.544545 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.544545 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:01.544545 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:01.544545 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:01.544545 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 24 20:51:01.544545 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 24 20:51:01.544545 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 24 20:51:01.544545 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.546959 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-71609011-6bff-454c-9c84-4867bc94cc59 tempest-HostsAdminNegativeTestJSON-876583914 tempest-HostsAdminNegativeTestJSON-876583914-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:51:01.548175 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-71609011-6bff-454c-9c84-4867bc94cc59 tempest-HostsAdminNegativeTestJSON-876583914 tempest-HostsAdminNegativeTestJSON-876583914-project] 10.222.0.52 "GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.016155 Sep 24 20:51:01.549343 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 180/375] 10.222.0.52 () {58 vars in 1197 bytes} [Sat Sep 24 20:51:01 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown => generated 113 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:51:01.564784 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9487e668-ece3-46fc-9009-e9e09b3cdde4 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] Calling method '.version_select at 0x7f4b0cc19e50>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:01.573498 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-9487e668-ece3-46fc-9009-e9e09b3cdde4 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 24 20:51:01.575249 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9487e668-ece3-46fc-9009-e9e09b3cdde4 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] Request method failure captured: Sep 24 20:51:01.575249 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Sep 24 20:51:01.575249 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:51:01.575249 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:51:01.575249 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:51:01.575249 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:51:01.575249 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:51:01.575249 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:51:01.575249 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:51:01.575249 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:51:01.575249 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL220f664dth_d-EpeliJ12YWm7suSvdAhPXIRhCqnGIAwlam6yzPbV9DEaVIJqtpXTTRm_uzh0FqyjX7-wXV8XNDyOCgL8VybmEwqkZhmqN1ZTVFMWESs0OjiNiV4O9tZHw5PNQKT1ksg9lJ08FXhYluLQAg8ZASd4fwPrqxkAm-aqg Sep 24 20:51:01.575249 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:51:01.575249 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:51:01.575249 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:51:01.575249 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:51:01.575249 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:51:01.575249 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:51:01.575249 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: cd8a527890e94f4e841d702b8e766d17 Sep 24 20:51:01.575249 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-640196156 Sep 24 20:51:01.575249 ncdv-master-1 devstack@n-api.service[140516]: X-Role: admin,reader,member Sep 24 20:51:01.575249 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: admin,reader,member Sep 24 20:51:01.576672 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd8a527890e94f4e841d702b8e766d17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cd8a527890e94f4e841d702b8e766d17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cd8a527890e94f4e841d702b8e766d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd8a527890e94f4e841d702b8e766d17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:51:01.576672 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-HostsAdminNegativeTestJSON-640196156 Sep 24 20:51:01.576672 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: cd8a527890e94f4e841d702b8e766d17 Sep 24 20:51:01.576672 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-640196156 Sep 24 20:51:01.576672 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-HostsAdminNegativeTestJSON-640196156-project-admin Sep 24 20:51:01.576672 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:51:01.576672 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:51:01.576672 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 71b1dc505d65433cb8cab4b8ff8480a1 Sep 24 20:51:01.576672 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-HostsAdminNegativeTestJSON-640196156-project-admin Sep 24 20:51:01.576672 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:51:01.576672 ncdv-master-1 devstack@n-api.service[140516]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 24 20:51:01.576672 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'nonexistent_hostname'} Sep 24 20:51:01.576672 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:51:01.577537 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:01.577537 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 24 20:51:01.577537 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 24 20:51:01.577537 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 24 20:51:01.577537 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 24 20:51:01.577537 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:51:01.577537 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:51:01.577537 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:51:01.577537 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:51:01.577537 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 24 20:51:01.577537 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 24 20:51:01.577537 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 24 20:51:01.577537 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 24 20:51:01.577537 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 20:51:01.577537 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 20:51:01.577537 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 24 20:51:01.577537 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 24 20:51:01.577537 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 24 20:51:01.577537 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 24 20:51:01.582905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 24 20:51:01.582905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 24 20:51:01.582905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 24 20:51:01.582905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.582905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:01.582905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.582905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:01.582905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:01.582905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:01.582905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:51:01.582905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:51:01.582905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:51:01.582905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:51:01.582905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:51:01.582905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:51:01.582905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Sep 24 20:51:01.582905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Sep 24 20:51:01.582905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 24 20:51:01.582905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:51:01.585130 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 24 20:51:01.585130 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.585130 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:01.585130 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.585130 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:01.585130 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:01.585130 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:01.585130 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:51:01.585130 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:51:01.585130 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 24 20:51:01.585130 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.585130 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9487e668-ece3-46fc-9009-e9e09b3cdde4 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:51:01.585130 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9487e668-ece3-46fc-9009-e9e09b3cdde4 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.015797 Sep 24 20:51:01.585130 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 196/376] 10.222.0.52 () {58 vars in 1218 bytes} [Sat Sep 24 20:51:01 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 20:51:01.587888 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5a952ea6-fcf8-4d4a-aece-4bc672efb513 tempest-HostsAdminNegativeTestJSON-876583914 tempest-HostsAdminNegativeTestJSON-876583914-project] Calling method '.version_select at 0x7f4b0d153550>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:01.590884 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5a952ea6-fcf8-4d4a-aece-4bc672efb513 tempest-HostsAdminNegativeTestJSON-876583914 tempest-HostsAdminNegativeTestJSON-876583914-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'a3590953b1ca4dcfb5da6a319bfb11fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8cfbd9651040b1a4c9844f088a857b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:01.592610 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5a952ea6-fcf8-4d4a-aece-4bc672efb513 tempest-HostsAdminNegativeTestJSON-876583914 tempest-HostsAdminNegativeTestJSON-876583914-project] Request method failure captured: Sep 24 20:51:01.592610 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/startup HTTP/1.1 Sep 24 20:51:01.592610 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:51:01.592610 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:51:01.592610 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:51:01.592610 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:51:01.592610 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:51:01.592610 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:51:01.592610 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:51:01.592610 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:51:01.592610 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL22zal4HhIrJ5nWTXw2-GYBMsXYj_N6ccV5iKIrL10bRYifmICj2taBQdT16hulcSHc--Q9w6i3gSpRYjLk4ec9VK8GWNzs6ilrJ7xeh7j_Gb4VC7HI-E1RUvivK1qLZQk-YuP9rgQkdXb6X9DOJ2JI7_EulFI_7yIAxt__NWB7c-ig Sep 24 20:51:01.592610 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:51:01.592610 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:51:01.592610 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:51:01.592610 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:51:01.592610 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:51:01.592610 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:51:01.592610 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: fc8cfbd9651040b1a4c9844f088a857b Sep 24 20:51:01.592610 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-876583914 Sep 24 20:51:01.592610 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:51:01.592610 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:51:01.593867 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fc8cfbd9651040b1a4c9844f088a857b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fc8cfbd9651040b1a4c9844f088a857b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fc8cfbd9651040b1a4c9844f088a857b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fc8cfbd9651040b1a4c9844f088a857b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:51:01.593867 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-HostsAdminNegativeTestJSON-876583914 Sep 24 20:51:01.593867 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: fc8cfbd9651040b1a4c9844f088a857b Sep 24 20:51:01.593867 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-876583914 Sep 24 20:51:01.593867 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-HostsAdminNegativeTestJSON-876583914-project Sep 24 20:51:01.593867 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:51:01.593867 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:51:01.593867 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: a3590953b1ca4dcfb5da6a319bfb11fe Sep 24 20:51:01.593867 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-HostsAdminNegativeTestJSON-876583914-project Sep 24 20:51:01.593867 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 20:51:01.593867 ncdv-master-1 devstack@n-api.service[140517]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 24 20:51:01.593867 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'ncdv-master-1'} Sep 24 20:51:01.593867 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:51:01.594582 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:01.594582 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:01.594582 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:01.594582 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:51:01.594582 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:51:01.594582 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:51:01.594582 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:51:01.594582 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:51:01.594582 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:51:01.594582 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Sep 24 20:51:01.594582 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Sep 24 20:51:01.594582 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 24 20:51:01.594582 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 24 20:51:01.594582 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 24 20:51:01.594582 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 24 20:51:01.594582 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:51:01.594582 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:51:01.594582 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:51:01.594582 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:51:01.595723 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 24 20:51:01.595723 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 24 20:51:01.595723 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 24 20:51:01.595723 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 24 20:51:01.595723 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 24 20:51:01.595723 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 24 20:51:01.595723 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 24 20:51:01.595723 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.595723 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:01.595723 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.595723 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:01.595723 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:01.595723 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:01.595723 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 24 20:51:01.595723 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 24 20:51:01.595723 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 24 20:51:01.595723 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.596669 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5a952ea6-fcf8-4d4a-aece-4bc672efb513 tempest-HostsAdminNegativeTestJSON-876583914 tempest-HostsAdminNegativeTestJSON-876583914-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:51:01.596669 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5a952ea6-fcf8-4d4a-aece-4bc672efb513 tempest-HostsAdminNegativeTestJSON-876583914 tempest-HostsAdminNegativeTestJSON-876583914-project] 10.222.0.52 "GET /compute/v2.1/os-hosts/ncdv-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.010092 Sep 24 20:51:01.596669 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 181/377] 10.222.0.52 () {58 vars in 1194 bytes} [Sat Sep 24 20:51:01 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/startup => generated 110 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:51:01.604240 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b54a1dc3-fd39-4050-8c0e-a5f635a8734b tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] Calling method '.version_select at 0x7f4b0ccd3c10>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:01.615341 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-b54a1dc3-fd39-4050-8c0e-a5f635a8734b tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 24 20:51:01.617115 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b54a1dc3-fd39-4050-8c0e-a5f635a8734b tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] Request method failure captured: Sep 24 20:51:01.617115 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Sep 24 20:51:01.617115 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:51:01.617115 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:51:01.617115 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:51:01.617115 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:51:01.617115 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:51:01.617115 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:51:01.617115 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:51:01.617115 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:51:01.617115 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL220f664dth_d-EpeliJ12YWm7suSvdAhPXIRhCqnGIAwlam6yzPbV9DEaVIJqtpXTTRm_uzh0FqyjX7-wXV8XNDyOCgL8VybmEwqkZhmqN1ZTVFMWESs0OjiNiV4O9tZHw5PNQKT1ksg9lJ08FXhYluLQAg8ZASd4fwPrqxkAm-aqg Sep 24 20:51:01.617115 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:51:01.617115 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:51:01.617115 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:51:01.617115 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:51:01.617115 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:51:01.617115 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:51:01.617115 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: cd8a527890e94f4e841d702b8e766d17 Sep 24 20:51:01.617115 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-640196156 Sep 24 20:51:01.617115 ncdv-master-1 devstack@n-api.service[140516]: X-Role: admin,reader,member Sep 24 20:51:01.617115 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: admin,reader,member Sep 24 20:51:01.618687 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd8a527890e94f4e841d702b8e766d17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cd8a527890e94f4e841d702b8e766d17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cd8a527890e94f4e841d702b8e766d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd8a527890e94f4e841d702b8e766d17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:51:01.618687 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-HostsAdminNegativeTestJSON-640196156 Sep 24 20:51:01.618687 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: cd8a527890e94f4e841d702b8e766d17 Sep 24 20:51:01.618687 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-640196156 Sep 24 20:51:01.618687 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-HostsAdminNegativeTestJSON-640196156-project-admin Sep 24 20:51:01.618687 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:51:01.618687 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:51:01.618687 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 71b1dc505d65433cb8cab4b8ff8480a1 Sep 24 20:51:01.618687 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-HostsAdminNegativeTestJSON-640196156-project-admin Sep 24 20:51:01.618687 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:51:01.618687 ncdv-master-1 devstack@n-api.service[140516]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 24 20:51:01.618687 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'nonexistent_hostname'} Sep 24 20:51:01.618687 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:51:01.619420 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:01.619420 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 24 20:51:01.619420 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 24 20:51:01.619420 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 24 20:51:01.619420 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 24 20:51:01.619420 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:51:01.619420 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:51:01.619420 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:51:01.619420 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:51:01.619420 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 24 20:51:01.619420 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 24 20:51:01.619420 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 24 20:51:01.619420 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 24 20:51:01.619420 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 20:51:01.619420 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 20:51:01.619420 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 24 20:51:01.619420 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 24 20:51:01.619420 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 24 20:51:01.619420 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 24 20:51:01.621709 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 24 20:51:01.621709 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 24 20:51:01.621709 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 24 20:51:01.621709 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.621709 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:01.621709 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.621709 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:01.621709 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:01.621709 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:01.621709 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:51:01.621709 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:51:01.621709 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:51:01.621709 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:51:01.621709 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:51:01.621709 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:51:01.621709 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Sep 24 20:51:01.621709 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Sep 24 20:51:01.621709 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 24 20:51:01.621709 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:51:01.623730 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 24 20:51:01.623730 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.623730 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:01.623730 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.623730 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:01.623730 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:01.623730 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:01.623730 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:51:01.623730 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:51:01.623730 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 24 20:51:01.623730 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.623730 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b54a1dc3-fd39-4050-8c0e-a5f635a8734b tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:51:01.623730 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b54a1dc3-fd39-4050-8c0e-a5f635a8734b tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.018470 Sep 24 20:51:01.623730 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 197/378] 10.222.0.52 () {58 vars in 1215 bytes} [Sat Sep 24 20:51:01 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 24 20:51:01.631735 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3ff0fc03-4a3c-4a16-8fa2-dc819bedd777 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] Action: 'update', calling method: .version_select at 0x7f4b0d1e5a60>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:01.637247 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3ff0fc03-4a3c-4a16-8fa2-dc819bedd777 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] Request method failure captured: Sep 24 20:51:01.637247 ncdv-master-1 devstack@n-api.service[140517]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Sep 24 20:51:01.637247 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:51:01.637247 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:51:01.637247 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:51:01.637247 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 51 Sep 24 20:51:01.637247 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:51:01.637247 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:51:01.637247 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:51:01.637247 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:51:01.637247 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL220f664dth_d-EpeliJ12YWm7suSvdAhPXIRhCqnGIAwlam6yzPbV9DEaVIJqtpXTTRm_uzh0FqyjX7-wXV8XNDyOCgL8VybmEwqkZhmqN1ZTVFMWESs0OjiNiV4O9tZHw5PNQKT1ksg9lJ08FXhYluLQAg8ZASd4fwPrqxkAm-aqg Sep 24 20:51:01.637247 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:51:01.637247 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:51:01.637247 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:51:01.637247 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:51:01.637247 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:51:01.637247 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:51:01.637247 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: cd8a527890e94f4e841d702b8e766d17 Sep 24 20:51:01.637247 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-640196156 Sep 24 20:51:01.637247 ncdv-master-1 devstack@n-api.service[140517]: X-Role: admin,reader,member Sep 24 20:51:01.637247 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: admin,reader,member Sep 24 20:51:01.638626 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd8a527890e94f4e841d702b8e766d17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cd8a527890e94f4e841d702b8e766d17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cd8a527890e94f4e841d702b8e766d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd8a527890e94f4e841d702b8e766d17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:51:01.638626 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-HostsAdminNegativeTestJSON-640196156 Sep 24 20:51:01.638626 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: cd8a527890e94f4e841d702b8e766d17 Sep 24 20:51:01.638626 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-640196156 Sep 24 20:51:01.638626 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-HostsAdminNegativeTestJSON-640196156-project-admin Sep 24 20:51:01.638626 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:51:01.638626 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:51:01.638626 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 71b1dc505d65433cb8cab4b8ff8480a1 Sep 24 20:51:01.638626 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-HostsAdminNegativeTestJSON-640196156-project-admin Sep 24 20:51:01.638626 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 20:51:01.638626 ncdv-master-1 devstack@n-api.service[140517]: {"status": "enable", "maintenance_mode": "invalid"} Sep 24 20:51:01.638626 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 20:51:01.638626 ncdv-master-1 devstack@n-api.service[140517]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 24 20:51:01.639440 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Sep 24 20:51:01.639440 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:51:01.639440 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:01.639440 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 20:51:01.639440 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 20:51:01.639440 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 20:51:01.639440 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise error Sep 24 20:51:01.639440 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 24 20:51:01.639440 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.639440 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Sep 24 20:51:01.639440 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 24 20:51:01.639440 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi 'disable', Sep 24 20:51:01.639440 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi 'Enable', Sep 24 20:51:01.639440 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi 'Disable', Sep 24 20:51:01.639440 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 24 20:51:01.639440 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 24 20:51:01.639440 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 24 20:51:01.639440 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.639440 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi On instance: Sep 24 20:51:01.639440 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi 'invalid' Sep 24 20:51:01.639440 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.639440 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:01.639440 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.639440 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:01.639440 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:01.640760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:01.640760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:51:01.640760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:51:01.640760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:51:01.640760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:51:01.640760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:51:01.640760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:51:01.640760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 20:51:01.640760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 20:51:01.640760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 20:51:01.640760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 20:51:01.640760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 20:51:01.640760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 20:51:01.640760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 24 20:51:01.640760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.640760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:01.640760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.640760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:01.640760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:01.642879 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:01.642879 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 20:51:01.642879 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 20:51:01.642879 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 24 20:51:01.642879 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.644485 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3ff0fc03-4a3c-4a16-8fa2-dc819bedd777 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:51:01.645760 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3ff0fc03-4a3c-4a16-8fa2-dc819bedd777 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 199 microversion: 2.1 time: 0.019618 Sep 24 20:51:01.646811 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 182/379] 10.222.0.52 () {60 vars in 1190 bytes} [Sat Sep 24 20:51:01 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 199 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 20:51:01.657581 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-87171e8a-31d9-47d6-b835-efaf8a3937c9 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] Action: 'update', calling method: .version_select at 0x7f4b0cd54b80>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:01.660252 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-daa8a28f-6fe4-4063-ac0f-3463963bc7cc tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:01.661639 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-daa8a28f-6fe4-4063-ac0f-3463963bc7cc tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 59b0e336-5d09-43b8-b126-6b8e0a33f813] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:01.663006 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-87171e8a-31d9-47d6-b835-efaf8a3937c9 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] Request method failure captured: Sep 24 20:51:01.663006 ncdv-master-1 devstack@n-api.service[140516]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Sep 24 20:51:01.663006 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:51:01.663006 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:51:01.663006 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:51:01.663006 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 51 Sep 24 20:51:01.663006 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:51:01.663006 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:51:01.663006 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:51:01.663006 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:51:01.663006 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL220f664dth_d-EpeliJ12YWm7suSvdAhPXIRhCqnGIAwlam6yzPbV9DEaVIJqtpXTTRm_uzh0FqyjX7-wXV8XNDyOCgL8VybmEwqkZhmqN1ZTVFMWESs0OjiNiV4O9tZHw5PNQKT1ksg9lJ08FXhYluLQAg8ZASd4fwPrqxkAm-aqg Sep 24 20:51:01.663006 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:51:01.663006 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:51:01.663006 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:51:01.663006 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:51:01.663006 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:51:01.663006 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:51:01.663006 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: cd8a527890e94f4e841d702b8e766d17 Sep 24 20:51:01.663006 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-640196156 Sep 24 20:51:01.663006 ncdv-master-1 devstack@n-api.service[140516]: X-Role: admin,reader,member Sep 24 20:51:01.663006 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: admin,reader,member Sep 24 20:51:01.664255 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd8a527890e94f4e841d702b8e766d17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cd8a527890e94f4e841d702b8e766d17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cd8a527890e94f4e841d702b8e766d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd8a527890e94f4e841d702b8e766d17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:51:01.664255 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-HostsAdminNegativeTestJSON-640196156 Sep 24 20:51:01.664255 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: cd8a527890e94f4e841d702b8e766d17 Sep 24 20:51:01.664255 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-640196156 Sep 24 20:51:01.664255 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-HostsAdminNegativeTestJSON-640196156-project-admin Sep 24 20:51:01.664255 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:51:01.664255 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:51:01.664255 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 71b1dc505d65433cb8cab4b8ff8480a1 Sep 24 20:51:01.664255 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-HostsAdminNegativeTestJSON-640196156-project-admin Sep 24 20:51:01.664255 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 20:51:01.664255 ncdv-master-1 devstack@n-api.service[140516]: {"status": "invalid", "maintenance_mode": "enable"} Sep 24 20:51:01.664255 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:51:01.664255 ncdv-master-1 devstack@n-api.service[140516]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 24 20:51:01.664941 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Sep 24 20:51:01.664941 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:51:01.664941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:01.664941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 20:51:01.664941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 20:51:01.664941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 20:51:01.664941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise error Sep 24 20:51:01.664941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 24 20:51:01.664941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.664941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Sep 24 20:51:01.664941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 24 20:51:01.664941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'disable', Sep 24 20:51:01.664941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'Enable', Sep 24 20:51:01.664941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'Disable', Sep 24 20:51:01.664941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 24 20:51:01.664941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 24 20:51:01.664941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 24 20:51:01.664941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.664941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi On instance: Sep 24 20:51:01.664941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'invalid' Sep 24 20:51:01.664941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.664941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:01.664941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.664941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:01.664941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:01.666197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:01.666197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:51:01.666197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:51:01.666197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:51:01.666197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:51:01.666197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:51:01.666197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:51:01.666197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 20:51:01.666197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 20:51:01.666197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 20:51:01.666197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 20:51:01.666197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 20:51:01.666197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 20:51:01.666197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 24 20:51:01.666197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.666197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:01.666197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.666197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:01.666197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:01.669295 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:01.669295 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 20:51:01.669295 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 20:51:01.669295 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 24 20:51:01.669295 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.669295 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-87171e8a-31d9-47d6-b835-efaf8a3937c9 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:51:01.669295 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-87171e8a-31d9-47d6-b835-efaf8a3937c9 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 189 microversion: 2.1 time: 0.012495 Sep 24 20:51:01.669295 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 198/380] 10.222.0.52 () {60 vars in 1190 bytes} [Sat Sep 24 20:51:01 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 189 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 20:51:01.671600 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-daa8a28f-6fe4-4063-ac0f-3463963bc7cc tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:01.672289 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-daa8a28f-6fe4-4063-ac0f-3463963bc7cc tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:01.672864 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-daa8a28f-6fe4-4063-ac0f-3463963bc7cc tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:01.674042 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-daa8a28f-6fe4-4063-ac0f-3463963bc7cc tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:01.674560 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-daa8a28f-6fe4-4063-ac0f-3463963bc7cc tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:01.675499 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-daa8a28f-6fe4-4063-ac0f-3463963bc7cc tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:01.677703 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d46fef9a-d27a-483d-afa5-91dcfa21fe8b tempest-HostsAdminNegativeTestJSON-876583914 tempest-HostsAdminNegativeTestJSON-876583914-project] Action: 'update', calling method: .version_select at 0x7f4b0cb92af0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:01.685494 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d46fef9a-d27a-483d-afa5-91dcfa21fe8b tempest-HostsAdminNegativeTestJSON-876583914 tempest-HostsAdminNegativeTestJSON-876583914-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'a3590953b1ca4dcfb5da6a319bfb11fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8cfbd9651040b1a4c9844f088a857b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:01.687572 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d46fef9a-d27a-483d-afa5-91dcfa21fe8b tempest-HostsAdminNegativeTestJSON-876583914 tempest-HostsAdminNegativeTestJSON-876583914-project] Request method failure captured: Sep 24 20:51:01.687572 ncdv-master-1 devstack@n-api.service[140516]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Sep 24 20:51:01.687572 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:51:01.687572 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:51:01.687572 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:51:01.687572 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 50 Sep 24 20:51:01.687572 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:51:01.687572 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:51:01.687572 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:51:01.687572 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:51:01.687572 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL22zal4HhIrJ5nWTXw2-GYBMsXYj_N6ccV5iKIrL10bRYifmICj2taBQdT16hulcSHc--Q9w6i3gSpRYjLk4ec9VK8GWNzs6ilrJ7xeh7j_Gb4VC7HI-E1RUvivK1qLZQk-YuP9rgQkdXb6X9DOJ2JI7_EulFI_7yIAxt__NWB7c-ig Sep 24 20:51:01.687572 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:51:01.687572 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:51:01.687572 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:51:01.687572 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:51:01.687572 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:51:01.687572 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:51:01.687572 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: fc8cfbd9651040b1a4c9844f088a857b Sep 24 20:51:01.687572 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-876583914 Sep 24 20:51:01.687572 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:51:01.687572 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:51:01.688741 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fc8cfbd9651040b1a4c9844f088a857b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fc8cfbd9651040b1a4c9844f088a857b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fc8cfbd9651040b1a4c9844f088a857b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fc8cfbd9651040b1a4c9844f088a857b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:51:01.688741 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-HostsAdminNegativeTestJSON-876583914 Sep 24 20:51:01.688741 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: fc8cfbd9651040b1a4c9844f088a857b Sep 24 20:51:01.688741 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-876583914 Sep 24 20:51:01.688741 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-HostsAdminNegativeTestJSON-876583914-project Sep 24 20:51:01.688741 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:51:01.688741 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:51:01.688741 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: a3590953b1ca4dcfb5da6a319bfb11fe Sep 24 20:51:01.688741 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-HostsAdminNegativeTestJSON-876583914-project Sep 24 20:51:01.688741 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 20:51:01.688741 ncdv-master-1 devstack@n-api.service[140516]: {"status": "enable", "maintenance_mode": "enable"} Sep 24 20:51:01.688741 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:51:01.688741 ncdv-master-1 devstack@n-api.service[140516]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 24 20:51:01.688741 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 24 20:51:01.689508 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:51:01.689508 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:01.689508 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:01.689508 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:01.689508 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:51:01.689508 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:51:01.689508 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:51:01.689508 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:51:01.689508 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:51:01.689508 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:51:01.689508 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:51:01.689508 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:51:01.689508 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Sep 24 20:51:01.689508 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Sep 24 20:51:01.689508 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 24 20:51:01.689508 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 24 20:51:01.689508 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 24 20:51:01.689508 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 24 20:51:01.689508 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:51:01.689508 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:51:01.690555 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:51:01.690555 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:51:01.690555 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 24 20:51:01.690555 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 24 20:51:01.690555 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 24 20:51:01.690555 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 24 20:51:01.690555 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 24 20:51:01.690555 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 24 20:51:01.690555 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 24 20:51:01.690555 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.690555 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:01.690555 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.690555 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:01.690555 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:01.690555 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:01.690555 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 24 20:51:01.690555 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 24 20:51:01.690555 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 24 20:51:01.690555 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.691572 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d46fef9a-d27a-483d-afa5-91dcfa21fe8b tempest-HostsAdminNegativeTestJSON-876583914 tempest-HostsAdminNegativeTestJSON-876583914-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:51:01.691572 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d46fef9a-d27a-483d-afa5-91dcfa21fe8b tempest-HostsAdminNegativeTestJSON-876583914 tempest-HostsAdminNegativeTestJSON-876583914-project] 10.222.0.52 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 111 microversion: 2.1 time: 0.019172 Sep 24 20:51:01.691572 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 199/381] 10.222.0.52 () {60 vars in 1190 bytes} [Sat Sep 24 20:51:01 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 111 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:51:01.704453 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5931c3a7-6522-462f-9483-16defbdf6712 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] Action: 'update', calling method: .version_select at 0x7f4b0cacba60>, body: {"status": null, "maintenance_mode": null} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:01.708118 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5931c3a7-6522-462f-9483-16defbdf6712 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] Request method failure captured: Sep 24 20:51:01.708118 ncdv-master-1 devstack@n-api.service[140516]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Sep 24 20:51:01.708118 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:51:01.708118 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:51:01.708118 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:51:01.708118 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 42 Sep 24 20:51:01.708118 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:51:01.708118 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:51:01.708118 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:51:01.708118 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:51:01.708118 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL220f664dth_d-EpeliJ12YWm7suSvdAhPXIRhCqnGIAwlam6yzPbV9DEaVIJqtpXTTRm_uzh0FqyjX7-wXV8XNDyOCgL8VybmEwqkZhmqN1ZTVFMWESs0OjiNiV4O9tZHw5PNQKT1ksg9lJ08FXhYluLQAg8ZASd4fwPrqxkAm-aqg Sep 24 20:51:01.708118 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:51:01.708118 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:51:01.708118 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:51:01.708118 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:51:01.708118 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:51:01.708118 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:51:01.708118 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: cd8a527890e94f4e841d702b8e766d17 Sep 24 20:51:01.708118 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-640196156 Sep 24 20:51:01.708118 ncdv-master-1 devstack@n-api.service[140516]: X-Role: admin,reader,member Sep 24 20:51:01.708118 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: admin,reader,member Sep 24 20:51:01.709301 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd8a527890e94f4e841d702b8e766d17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cd8a527890e94f4e841d702b8e766d17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cd8a527890e94f4e841d702b8e766d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd8a527890e94f4e841d702b8e766d17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:51:01.709301 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-HostsAdminNegativeTestJSON-640196156 Sep 24 20:51:01.709301 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: cd8a527890e94f4e841d702b8e766d17 Sep 24 20:51:01.709301 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-640196156 Sep 24 20:51:01.709301 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-HostsAdminNegativeTestJSON-640196156-project-admin Sep 24 20:51:01.709301 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:51:01.709301 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:51:01.709301 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 71b1dc505d65433cb8cab4b8ff8480a1 Sep 24 20:51:01.709301 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-HostsAdminNegativeTestJSON-640196156-project-admin Sep 24 20:51:01.709301 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 20:51:01.709301 ncdv-master-1 devstack@n-api.service[140516]: {"status": null, "maintenance_mode": null} Sep 24 20:51:01.709301 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:51:01.709301 ncdv-master-1 devstack@n-api.service[140516]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 24 20:51:01.709301 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'ncdv-master-1', 'body': {'status': None, 'maintenance_mode': None}} Sep 24 20:51:01.710076 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:51:01.710076 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:01.710076 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 20:51:01.710076 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 20:51:01.710076 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 20:51:01.710076 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise error Sep 24 20:51:01.710076 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Sep 24 20:51:01.710076 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.710076 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Sep 24 20:51:01.710076 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 24 20:51:01.710076 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'disable', Sep 24 20:51:01.710076 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'Enable', Sep 24 20:51:01.710076 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'Disable', Sep 24 20:51:01.710076 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 24 20:51:01.710076 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 24 20:51:01.710076 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 24 20:51:01.710076 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.710076 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi On instance: Sep 24 20:51:01.710076 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi None Sep 24 20:51:01.710076 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.710076 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:01.710076 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.710076 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:01.710076 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:01.710076 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:01.711632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:51:01.711632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:51:01.711632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:51:01.711632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:51:01.711632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:51:01.711632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:51:01.711632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 20:51:01.711632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 20:51:01.711632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 20:51:01.711632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 20:51:01.711632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 20:51:01.711632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 20:51:01.711632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 24 20:51:01.711632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.711632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:01.711632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.711632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:01.711632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:01.711632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:01.712659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 20:51:01.712659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 20:51:01.712659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 24 20:51:01.712659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.712659 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5931c3a7-6522-462f-9483-16defbdf6712 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:51:01.712659 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5931c3a7-6522-462f-9483-16defbdf6712 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 127 microversion: 2.1 time: 0.008779 Sep 24 20:51:01.713762 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 200/382] 10.222.0.52 () {60 vars in 1190 bytes} [Sat Sep 24 20:51:01 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 127 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 20:51:01.722251 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-daa8a28f-6fe4-4063-ac0f-3463963bc7cc tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:01.722571 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-759697c7-fb34-4e85-92e2-bc0a0f322597 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] Action: 'update', calling method: .version_select at 0x7f4b0cd54700>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:01.722768 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-daa8a28f-6fe4-4063-ac0f-3463963bc7cc tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:01.723413 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-daa8a28f-6fe4-4063-ac0f-3463963bc7cc tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:01.724053 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-daa8a28f-6fe4-4063-ac0f-3463963bc7cc tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lazy-loading 'fault' on Instance uuid 59b0e336-5d09-43b8-b126-6b8e0a33f813 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:51:01.738035 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.hosts [None req-759697c7-fb34-4e85-92e2-bc0a0f322597 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] Enabling host nonexistent_hostname. Sep 24 20:51:01.747240 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-759697c7-fb34-4e85-92e2-bc0a0f322597 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 24 20:51:01.749268 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-759697c7-fb34-4e85-92e2-bc0a0f322597 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] Request method failure captured: Sep 24 20:51:01.749268 ncdv-master-1 devstack@n-api.service[140516]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 24 20:51:01.749268 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:51:01.749268 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:51:01.749268 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:51:01.749268 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 50 Sep 24 20:51:01.749268 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:51:01.749268 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:51:01.749268 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:51:01.749268 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:51:01.749268 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL220f664dth_d-EpeliJ12YWm7suSvdAhPXIRhCqnGIAwlam6yzPbV9DEaVIJqtpXTTRm_uzh0FqyjX7-wXV8XNDyOCgL8VybmEwqkZhmqN1ZTVFMWESs0OjiNiV4O9tZHw5PNQKT1ksg9lJ08FXhYluLQAg8ZASd4fwPrqxkAm-aqg Sep 24 20:51:01.749268 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:51:01.749268 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:51:01.749268 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:51:01.749268 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:51:01.749268 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:51:01.749268 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:51:01.749268 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: cd8a527890e94f4e841d702b8e766d17 Sep 24 20:51:01.749268 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-640196156 Sep 24 20:51:01.749268 ncdv-master-1 devstack@n-api.service[140516]: X-Role: admin,reader,member Sep 24 20:51:01.749268 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: admin,reader,member Sep 24 20:51:01.750536 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd8a527890e94f4e841d702b8e766d17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cd8a527890e94f4e841d702b8e766d17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cd8a527890e94f4e841d702b8e766d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd8a527890e94f4e841d702b8e766d17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:51:01.750536 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-HostsAdminNegativeTestJSON-640196156 Sep 24 20:51:01.750536 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: cd8a527890e94f4e841d702b8e766d17 Sep 24 20:51:01.750536 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-640196156 Sep 24 20:51:01.750536 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-HostsAdminNegativeTestJSON-640196156-project-admin Sep 24 20:51:01.750536 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:51:01.750536 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:51:01.750536 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 71b1dc505d65433cb8cab4b8ff8480a1 Sep 24 20:51:01.750536 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-HostsAdminNegativeTestJSON-640196156-project-admin Sep 24 20:51:01.750536 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 20:51:01.750536 ncdv-master-1 devstack@n-api.service[140516]: {"status": "enable", "maintenance_mode": "enable"} Sep 24 20:51:01.750536 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:51:01.750536 ncdv-master-1 devstack@n-api.service[140516]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 24 20:51:01.750536 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 24 20:51:01.751287 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:51:01.751287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:01.751287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Sep 24 20:51:01.751287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Sep 24 20:51:01.751287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 24 20:51:01.751287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 24 20:51:01.751287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:51:01.751287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:51:01.751287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:51:01.751287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:51:01.751287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 24 20:51:01.751287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 24 20:51:01.751287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 24 20:51:01.751287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 24 20:51:01.751287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 20:51:01.751287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 20:51:01.751287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 24 20:51:01.751287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 24 20:51:01.752208 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 24 20:51:01.752208 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 24 20:51:01.752208 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 24 20:51:01.752208 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 24 20:51:01.752208 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 24 20:51:01.752208 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.752208 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:01.752208 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.752208 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:01.752208 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:01.752208 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:01.752208 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:51:01.752208 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:51:01.752208 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:51:01.752208 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:51:01.752208 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:51:01.752208 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:51:01.752208 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:51:01.752208 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:51:01.752208 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Sep 24 20:51:01.753232 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Sep 24 20:51:01.753232 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Sep 24 20:51:01.753232 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:51:01.753232 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 24 20:51:01.753232 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.753232 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:01.753232 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.753232 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:01.753232 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:01.753232 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:01.753232 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:51:01.753232 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:51:01.753232 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 24 20:51:01.753232 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:01.756340 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-759697c7-fb34-4e85-92e2-bc0a0f322597 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:51:01.756995 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-759697c7-fb34-4e85-92e2-bc0a0f322597 tempest-HostsAdminNegativeTestJSON-640196156 tempest-HostsAdminNegativeTestJSON-640196156-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.037758 Sep 24 20:51:01.757899 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 201/383] 10.222.0.52 () {60 vars in 1211 bytes} [Sat Sep 24 20:51:01 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 24 20:51:01.912346 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-daa8a28f-6fe4-4063-ac0f-3463963bc7cc tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8a91794144d73a8942f5c3bac8cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3800968cd944059a397e9c6b35f976d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:01.926274 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-daa8a28f-6fe4-4063-ac0f-3463963bc7cc tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813" status: 200 len: 1456 microversion: 2.1 time: 0.271363 Sep 24 20:51:01.946968 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 183/384] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:01 2022] GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813 => generated 1456 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:51:02.176563 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e7657965-4771-48dc-8694-6c01a46d8730 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:02.177478 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e7657965-4771-48dc-8694-6c01a46d8730 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:02.185502 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e7657965-4771-48dc-8694-6c01a46d8730 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:02.187358 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e7657965-4771-48dc-8694-6c01a46d8730 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:02.187923 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e7657965-4771-48dc-8694-6c01a46d8730 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:02.188879 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e7657965-4771-48dc-8694-6c01a46d8730 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:02.189530 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e7657965-4771-48dc-8694-6c01a46d8730 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:02.190023 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e7657965-4771-48dc-8694-6c01a46d8730 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:02.363489 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e7657965-4771-48dc-8694-6c01a46d8730 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:02.375583 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e7657965-4771-48dc-8694-6c01a46d8730 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1476 microversion: 2.1 time: 0.203930 Sep 24 20:51:02.376426 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 202/385] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:02 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1476 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:02.395725 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9f492962-fb02-4214-a013-f72777d3ab97 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:02.396411 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9f492962-fb02-4214-a013-f72777d3ab97 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:02.408314 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f492962-fb02-4214-a013-f72777d3ab97 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:02.412194 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f492962-fb02-4214-a013-f72777d3ab97 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:02.413178 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f492962-fb02-4214-a013-f72777d3ab97 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:02.414053 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f492962-fb02-4214-a013-f72777d3ab97 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:02.416860 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f492962-fb02-4214-a013-f72777d3ab97 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:02.419000 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f492962-fb02-4214-a013-f72777d3ab97 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:02.531976 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5a88117c-36e8-477b-bce7-9aaf5bc5c881 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:02.533110 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5a88117c-36e8-477b-bce7-9aaf5bc5c881 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:02.549723 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5a88117c-36e8-477b-bce7-9aaf5bc5c881 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:02.551728 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5a88117c-36e8-477b-bce7-9aaf5bc5c881 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:02.553442 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5a88117c-36e8-477b-bce7-9aaf5bc5c881 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:02.556035 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5a88117c-36e8-477b-bce7-9aaf5bc5c881 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:02.557231 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5a88117c-36e8-477b-bce7-9aaf5bc5c881 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:02.558462 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5a88117c-36e8-477b-bce7-9aaf5bc5c881 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:02.678885 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9f492962-fb02-4214-a013-f72777d3ab97 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:02.691104 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9f492962-fb02-4214-a013-f72777d3ab97 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5" status: 200 len: 1311 microversion: 2.1 time: 0.300759 Sep 24 20:51:02.693999 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 184/386] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:02 2022] GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 => generated 1311 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:51:02.700453 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-0d83e3a6-6a55-46a3-a881-41dfb89ec848 req-1d29b31a-e9b8-492b-b9d9-7f26a5b6c201 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59b0e336-5d09-43b8-b126-6b8e0a33f813", "name": "network-vif-deleted", "tag": "1ff5d9c6-f16b-4bec-a6ed-b7254060cab5"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:02.732631 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-0d83e3a6-6a55-46a3-a881-41dfb89ec848 req-1d29b31a-e9b8-492b-b9d9-7f26a5b6c201 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:02.733608 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-0d83e3a6-6a55-46a3-a881-41dfb89ec848 req-1d29b31a-e9b8-492b-b9d9-7f26a5b6c201 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:02.734253 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-0d83e3a6-6a55-46a3-a881-41dfb89ec848 req-1d29b31a-e9b8-492b-b9d9-7f26a5b6c201 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:02.738328 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5a88117c-36e8-477b-bce7-9aaf5bc5c881 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:02.752764 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-0d83e3a6-6a55-46a3-a881-41dfb89ec848 req-1d29b31a-e9b8-492b-b9d9-7f26a5b6c201 service nova] Creating event network-vif-deleted:1ff5d9c6-f16b-4bec-a6ed-b7254060cab5 for instance 59b0e336-5d09-43b8-b126-6b8e0a33f813 on nch2-master-1 Sep 24 20:51:02.758607 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5a88117c-36e8-477b-bce7-9aaf5bc5c881 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:02.759446 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-0d83e3a6-6a55-46a3-a881-41dfb89ec848 req-1d29b31a-e9b8-492b-b9d9-7f26a5b6c201 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063387 Sep 24 20:51:02.760527 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5a88117c-36e8-477b-bce7-9aaf5bc5c881 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:02.766228 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 185/387] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:02.770045 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5a88117c-36e8-477b-bce7-9aaf5bc5c881 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.243420 Sep 24 20:51:02.771016 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 203/388] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:51:02 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:51:02.906723 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-ed93411f-4d35-438f-ac2a-2e26d48ed96a req-e4d01959-6796-4e9e-8d34-698e969fbd1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8164fcd2-b47c-4b73-b5f3-4e71615a3ec5", "name": "network-vif-plugged", "status": "completed", "tag": "7f54b87f-432c-4333-a0ed-d461564390c4"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:02.934763 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-ed93411f-4d35-438f-ac2a-2e26d48ed96a req-e4d01959-6796-4e9e-8d34-698e969fbd1f service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:02.935254 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-ed93411f-4d35-438f-ac2a-2e26d48ed96a req-e4d01959-6796-4e9e-8d34-698e969fbd1f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:02.936607 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-ed93411f-4d35-438f-ac2a-2e26d48ed96a req-e4d01959-6796-4e9e-8d34-698e969fbd1f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:02.959742 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5fe8a7e5-ae44-476e-bd05-72f28f9f6ff2 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:02.960878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5fe8a7e5-ae44-476e-bd05-72f28f9f6ff2 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 59b0e336-5d09-43b8-b126-6b8e0a33f813] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:02.969038 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5fe8a7e5-ae44-476e-bd05-72f28f9f6ff2 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:02.970633 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5fe8a7e5-ae44-476e-bd05-72f28f9f6ff2 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:02.971302 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5fe8a7e5-ae44-476e-bd05-72f28f9f6ff2 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:02.972230 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5fe8a7e5-ae44-476e-bd05-72f28f9f6ff2 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:02.972895 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5fe8a7e5-ae44-476e-bd05-72f28f9f6ff2 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:02.973003 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-ed93411f-4d35-438f-ac2a-2e26d48ed96a req-e4d01959-6796-4e9e-8d34-698e969fbd1f service nova] Creating event network-vif-plugged:7f54b87f-432c-4333-a0ed-d461564390c4 for instance 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 on nch1-master-1 Sep 24 20:51:02.973642 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5fe8a7e5-ae44-476e-bd05-72f28f9f6ff2 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:02.989789 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-ed93411f-4d35-438f-ac2a-2e26d48ed96a req-e4d01959-6796-4e9e-8d34-698e969fbd1f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086615 Sep 24 20:51:02.990871 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 186/389] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:02.997131 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:51:03.021389 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5fe8a7e5-ae44-476e-bd05-72f28f9f6ff2 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:03.021992 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5fe8a7e5-ae44-476e-bd05-72f28f9f6ff2 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:03.023538 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5fe8a7e5-ae44-476e-bd05-72f28f9f6ff2 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:03.023979 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-5fe8a7e5-ae44-476e-bd05-72f28f9f6ff2 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lazy-loading 'fault' on Instance uuid 59b0e336-5d09-43b8-b126-6b8e0a33f813 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:51:03.119181 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5fe8a7e5-ae44-476e-bd05-72f28f9f6ff2 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8a91794144d73a8942f5c3bac8cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3800968cd944059a397e9c6b35f976d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:03.132546 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5fe8a7e5-ae44-476e-bd05-72f28f9f6ff2 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813" status: 200 len: 1308 microversion: 2.1 time: 0.177288 Sep 24 20:51:03.150625 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 204/390] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:02 2022] GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813 => generated 1308 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:03.399454 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f34cb969-af80-4e86-bc2c-eb34de1be2bc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:03.400164 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f34cb969-af80-4e86-bc2c-eb34de1be2bc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:03.408320 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f34cb969-af80-4e86-bc2c-eb34de1be2bc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:03.408739 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f34cb969-af80-4e86-bc2c-eb34de1be2bc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:03.409183 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f34cb969-af80-4e86-bc2c-eb34de1be2bc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:03.409894 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f34cb969-af80-4e86-bc2c-eb34de1be2bc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:03.410364 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f34cb969-af80-4e86-bc2c-eb34de1be2bc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:03.410914 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f34cb969-af80-4e86-bc2c-eb34de1be2bc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:03.615944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f34cb969-af80-4e86-bc2c-eb34de1be2bc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:03.628488 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f34cb969-af80-4e86-bc2c-eb34de1be2bc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1476 microversion: 2.1 time: 0.233549 Sep 24 20:51:03.630902 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 187/391] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:03 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1476 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:03.724076 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d6840b8e-3447-4d41-9d17-58ac837ac589 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:03.724697 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d6840b8e-3447-4d41-9d17-58ac837ac589 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:03.733762 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d6840b8e-3447-4d41-9d17-58ac837ac589 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:03.734715 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d6840b8e-3447-4d41-9d17-58ac837ac589 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:03.735305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d6840b8e-3447-4d41-9d17-58ac837ac589 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:03.736826 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d6840b8e-3447-4d41-9d17-58ac837ac589 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:03.737437 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d6840b8e-3447-4d41-9d17-58ac837ac589 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:03.738731 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d6840b8e-3447-4d41-9d17-58ac837ac589 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:03.801670 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6ad49bc9-d57c-43fc-b99f-4b5d050cd5cf tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:03.803001 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6ad49bc9-d57c-43fc-b99f-4b5d050cd5cf tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:03.813148 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ad49bc9-d57c-43fc-b99f-4b5d050cd5cf tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:03.813663 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ad49bc9-d57c-43fc-b99f-4b5d050cd5cf tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:03.814455 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ad49bc9-d57c-43fc-b99f-4b5d050cd5cf tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:03.815207 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ad49bc9-d57c-43fc-b99f-4b5d050cd5cf tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:03.815991 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ad49bc9-d57c-43fc-b99f-4b5d050cd5cf tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:03.816527 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ad49bc9-d57c-43fc-b99f-4b5d050cd5cf tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:03.923233 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6ad49bc9-d57c-43fc-b99f-4b5d050cd5cf tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:03.935091 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6ad49bc9-d57c-43fc-b99f-4b5d050cd5cf tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:03.936918 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6ad49bc9-d57c-43fc-b99f-4b5d050cd5cf tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:03.942276 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6ad49bc9-d57c-43fc-b99f-4b5d050cd5cf tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.147149 Sep 24 20:51:03.943590 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 188/392] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:51:03 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:51:04.051157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d6840b8e-3447-4d41-9d17-58ac837ac589 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:04.062755 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d6840b8e-3447-4d41-9d17-58ac837ac589 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5" status: 200 len: 1311 microversion: 2.1 time: 0.342413 Sep 24 20:51:04.063670 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 205/393] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:03 2022] GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 => generated 1311 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:04.160364 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5c90e513-cf34-4f9d-a31a-7dfa97ee2f57 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:04.161606 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5c90e513-cf34-4f9d-a31a-7dfa97ee2f57 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 59b0e336-5d09-43b8-b126-6b8e0a33f813] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:04.170156 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c90e513-cf34-4f9d-a31a-7dfa97ee2f57 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:04.170702 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c90e513-cf34-4f9d-a31a-7dfa97ee2f57 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:04.171150 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c90e513-cf34-4f9d-a31a-7dfa97ee2f57 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:04.171856 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c90e513-cf34-4f9d-a31a-7dfa97ee2f57 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:04.172314 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c90e513-cf34-4f9d-a31a-7dfa97ee2f57 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:04.173155 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c90e513-cf34-4f9d-a31a-7dfa97ee2f57 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:04.188851 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-5c90e513-cf34-4f9d-a31a-7dfa97ee2f57 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] HTTP exception thrown: Instance 59b0e336-5d09-43b8-b126-6b8e0a33f813 could not be found. Sep 24 20:51:04.191050 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5c90e513-cf34-4f9d-a31a-7dfa97ee2f57 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Request method failure captured: Sep 24 20:51:04.191050 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813 HTTP/1.1 Sep 24 20:51:04.191050 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:51:04.191050 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:51:04.191050 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:51:04.191050 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:51:04.191050 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:51:04.191050 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:51:04.191050 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:51:04.191050 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:51:04.191050 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL21tXct_e6jYlpfCLicbbyTXnoW3D_SgXTsoW20R0hO-giY2cCcXhB4j8Nab-pCROuS1EhSgImQhmloh-H8_adEV6tabmxZf_wCnDt5SOp7qMTeNy_SEXOA-DiocBN4-gwUDtJPEwbTPoE1jDUI_OjMOLSqgk3sAcU03gPMcMHJCzhk Sep 24 20:51:04.191050 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:51:04.191050 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:51:04.191050 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:51:04.191050 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:51:04.191050 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:51:04.191050 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:51:04.191050 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: c3800968cd944059a397e9c6b35f976d Sep 24 20:51:04.191050 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-DeleteServersAdminTestJSON-351697204 Sep 24 20:51:04.191050 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:51:04.191050 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:51:04.192605 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c3800968cd944059a397e9c6b35f976d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c3800968cd944059a397e9c6b35f976d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c3800968cd944059a397e9c6b35f976d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c3800968cd944059a397e9c6b35f976d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:51:04.192605 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-DeleteServersAdminTestJSON-351697204 Sep 24 20:51:04.192605 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: c3800968cd944059a397e9c6b35f976d Sep 24 20:51:04.192605 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-351697204 Sep 24 20:51:04.192605 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-DeleteServersAdminTestJSON-351697204-project Sep 24 20:51:04.192605 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:51:04.192605 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:51:04.192605 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 50d8a91794144d73a8942f5c3bac8cc8 Sep 24 20:51:04.192605 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-DeleteServersAdminTestJSON-351697204-project Sep 24 20:51:04.192605 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:51:04.192605 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 59b0e336-5d09-43b8-b126-6b8e0a33f813 could not be found. Sep 24 20:51:04.192605 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '59b0e336-5d09-43b8-b126-6b8e0a33f813'} Sep 24 20:51:04.193392 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:51:04.193392 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:04.193392 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:51:04.193392 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:51:04.193392 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:51:04.193392 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:51:04.193392 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:51:04.193392 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:51:04.193392 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:51:04.193392 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:51:04.193392 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59b0e336-5d09-43b8-b126-6b8e0a33f813 could not be found. Sep 24 20:51:04.193392 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:04.193392 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:04.193392 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:04.193392 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:04.193392 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:04.193392 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:04.193392 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:51:04.193392 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:51:04.193392 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:51:04.194788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:51:04.194788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:51:04.194788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:51:04.194788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:51:04.194788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:51:04.194788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:51:04.194788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:51:04.194788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59b0e336-5d09-43b8-b126-6b8e0a33f813 could not be found. Sep 24 20:51:04.194788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:04.194788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:04.194788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:04.194788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:04.194788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:04.194788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:04.194788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:51:04.194788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:51:04.194788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59b0e336-5d09-43b8-b126-6b8e0a33f813 could not be found. Sep 24 20:51:04.194788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:04.196688 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5c90e513-cf34-4f9d-a31a-7dfa97ee2f57 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Returning 404 to user: Instance 59b0e336-5d09-43b8-b126-6b8e0a33f813 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:51:04.197541 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5c90e513-cf34-4f9d-a31a-7dfa97ee2f57 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813" status: 404 len: 111 microversion: 2.1 time: 0.042390 Sep 24 20:51:04.198088 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 189/394] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:04 2022] GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:51:04.210375 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-91927420-951e-42d5-8980-d7e95b1c793e tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:04.211212 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-91927420-951e-42d5-8980-d7e95b1c793e tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 59b0e336-5d09-43b8-b126-6b8e0a33f813] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:04.218570 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-91927420-951e-42d5-8980-d7e95b1c793e tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:04.219203 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-91927420-951e-42d5-8980-d7e95b1c793e tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:04.219749 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-91927420-951e-42d5-8980-d7e95b1c793e tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:04.220554 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-91927420-951e-42d5-8980-d7e95b1c793e tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:04.221179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-91927420-951e-42d5-8980-d7e95b1c793e tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:04.221614 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-91927420-951e-42d5-8980-d7e95b1c793e tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:04.236161 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-91927420-951e-42d5-8980-d7e95b1c793e tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] HTTP exception thrown: Instance 59b0e336-5d09-43b8-b126-6b8e0a33f813 could not be found. Sep 24 20:51:04.238201 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-91927420-951e-42d5-8980-d7e95b1c793e tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Request method failure captured: Sep 24 20:51:04.238201 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813 HTTP/1.1 Sep 24 20:51:04.238201 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:51:04.238201 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:51:04.238201 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:51:04.238201 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:51:04.238201 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:51:04.238201 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:51:04.238201 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:51:04.238201 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:51:04.238201 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL21tXct_e6jYlpfCLicbbyTXnoW3D_SgXTsoW20R0hO-giY2cCcXhB4j8Nab-pCROuS1EhSgImQhmloh-H8_adEV6tabmxZf_wCnDt5SOp7qMTeNy_SEXOA-DiocBN4-gwUDtJPEwbTPoE1jDUI_OjMOLSqgk3sAcU03gPMcMHJCzhk Sep 24 20:51:04.238201 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:51:04.238201 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:51:04.238201 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:51:04.238201 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:51:04.238201 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:51:04.238201 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:51:04.238201 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: c3800968cd944059a397e9c6b35f976d Sep 24 20:51:04.238201 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-DeleteServersAdminTestJSON-351697204 Sep 24 20:51:04.238201 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:51:04.238201 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:51:04.239737 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c3800968cd944059a397e9c6b35f976d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c3800968cd944059a397e9c6b35f976d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c3800968cd944059a397e9c6b35f976d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c3800968cd944059a397e9c6b35f976d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:51:04.239737 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-DeleteServersAdminTestJSON-351697204 Sep 24 20:51:04.239737 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: c3800968cd944059a397e9c6b35f976d Sep 24 20:51:04.239737 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-351697204 Sep 24 20:51:04.239737 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-DeleteServersAdminTestJSON-351697204-project Sep 24 20:51:04.239737 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:51:04.239737 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:51:04.239737 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 50d8a91794144d73a8942f5c3bac8cc8 Sep 24 20:51:04.239737 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-DeleteServersAdminTestJSON-351697204-project Sep 24 20:51:04.239737 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:51:04.239737 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 59b0e336-5d09-43b8-b126-6b8e0a33f813 could not be found. Sep 24 20:51:04.239737 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '59b0e336-5d09-43b8-b126-6b8e0a33f813'} Sep 24 20:51:04.240459 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:51:04.240459 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:04.240459 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:51:04.240459 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:51:04.240459 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:51:04.240459 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:51:04.240459 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:51:04.240459 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:51:04.240459 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:51:04.240459 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:51:04.240459 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59b0e336-5d09-43b8-b126-6b8e0a33f813 could not be found. Sep 24 20:51:04.240459 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:04.240459 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:04.240459 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:04.240459 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:04.240459 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:04.240459 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:04.240459 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:51:04.240459 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:51:04.240459 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:51:04.241738 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:51:04.241738 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 20:51:04.241738 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 20:51:04.241738 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 20:51:04.241738 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 20:51:04.241738 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:51:04.241738 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:51:04.241738 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:51:04.241738 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:51:04.241738 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59b0e336-5d09-43b8-b126-6b8e0a33f813 could not be found. Sep 24 20:51:04.241738 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:04.241738 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:04.241738 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:04.241738 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:04.241738 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:04.241738 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:04.241738 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:51:04.241738 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:51:04.241738 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59b0e336-5d09-43b8-b126-6b8e0a33f813 could not be found. Sep 24 20:51:04.241738 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:04.243630 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-91927420-951e-42d5-8980-d7e95b1c793e tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Returning 404 to user: Instance 59b0e336-5d09-43b8-b126-6b8e0a33f813 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:51:04.243630 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-91927420-951e-42d5-8980-d7e95b1c793e tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "DELETE /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813" status: 404 len: 111 microversion: 2.1 time: 0.033503 Sep 24 20:51:04.243630 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 206/395] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:51:04 2022] DELETE /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:51:04.248564 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5b392ef9-228e-4d28-ba01-d7a5346d9c4c tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:04.249194 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5b392ef9-228e-4d28-ba01-d7a5346d9c4c tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 59b0e336-5d09-43b8-b126-6b8e0a33f813] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:04.264583 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b392ef9-228e-4d28-ba01-d7a5346d9c4c tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:04.265074 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b392ef9-228e-4d28-ba01-d7a5346d9c4c tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:04.265518 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b392ef9-228e-4d28-ba01-d7a5346d9c4c tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:04.266224 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b392ef9-228e-4d28-ba01-d7a5346d9c4c tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:04.266708 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b392ef9-228e-4d28-ba01-d7a5346d9c4c tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:04.267167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b392ef9-228e-4d28-ba01-d7a5346d9c4c tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:04.287238 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-5b392ef9-228e-4d28-ba01-d7a5346d9c4c tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] HTTP exception thrown: Instance 59b0e336-5d09-43b8-b126-6b8e0a33f813 could not be found. Sep 24 20:51:04.288816 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5b392ef9-228e-4d28-ba01-d7a5346d9c4c tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Request method failure captured: Sep 24 20:51:04.288816 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813 HTTP/1.1 Sep 24 20:51:04.288816 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:51:04.288816 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:51:04.288816 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:51:04.288816 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:51:04.288816 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:51:04.288816 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:51:04.288816 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:51:04.288816 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:51:04.288816 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL21tXct_e6jYlpfCLicbbyTXnoW3D_SgXTsoW20R0hO-giY2cCcXhB4j8Nab-pCROuS1EhSgImQhmloh-H8_adEV6tabmxZf_wCnDt5SOp7qMTeNy_SEXOA-DiocBN4-gwUDtJPEwbTPoE1jDUI_OjMOLSqgk3sAcU03gPMcMHJCzhk Sep 24 20:51:04.288816 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:51:04.288816 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:51:04.288816 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:51:04.288816 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:51:04.288816 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:51:04.288816 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:51:04.288816 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: c3800968cd944059a397e9c6b35f976d Sep 24 20:51:04.288816 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-DeleteServersAdminTestJSON-351697204 Sep 24 20:51:04.288816 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:51:04.288816 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:51:04.290219 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c3800968cd944059a397e9c6b35f976d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c3800968cd944059a397e9c6b35f976d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c3800968cd944059a397e9c6b35f976d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c3800968cd944059a397e9c6b35f976d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:51:04.290219 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-DeleteServersAdminTestJSON-351697204 Sep 24 20:51:04.290219 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: c3800968cd944059a397e9c6b35f976d Sep 24 20:51:04.290219 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-351697204 Sep 24 20:51:04.290219 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-DeleteServersAdminTestJSON-351697204-project Sep 24 20:51:04.290219 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:51:04.290219 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:51:04.290219 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 50d8a91794144d73a8942f5c3bac8cc8 Sep 24 20:51:04.290219 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-DeleteServersAdminTestJSON-351697204-project Sep 24 20:51:04.290219 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:51:04.290219 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 59b0e336-5d09-43b8-b126-6b8e0a33f813 could not be found. Sep 24 20:51:04.290219 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '59b0e336-5d09-43b8-b126-6b8e0a33f813'} Sep 24 20:51:04.290992 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:51:04.290992 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:04.290992 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:51:04.290992 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:51:04.290992 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:51:04.290992 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:51:04.290992 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:51:04.290992 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:51:04.290992 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:51:04.290992 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:51:04.290992 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59b0e336-5d09-43b8-b126-6b8e0a33f813 could not be found. Sep 24 20:51:04.290992 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:04.290992 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:04.290992 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:04.290992 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:04.290992 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:04.290992 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:04.290992 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:51:04.290992 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:51:04.290992 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:51:04.292693 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:51:04.292693 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:51:04.292693 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:51:04.292693 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:51:04.292693 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:51:04.292693 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:51:04.292693 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:51:04.292693 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59b0e336-5d09-43b8-b126-6b8e0a33f813 could not be found. Sep 24 20:51:04.292693 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:04.292693 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:04.292693 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:04.292693 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:04.292693 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:04.292693 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:04.292693 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:51:04.292693 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:51:04.292693 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59b0e336-5d09-43b8-b126-6b8e0a33f813 could not be found. Sep 24 20:51:04.292693 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:04.294552 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5b392ef9-228e-4d28-ba01-d7a5346d9c4c tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Returning 404 to user: Instance 59b0e336-5d09-43b8-b126-6b8e0a33f813 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:51:04.294552 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5b392ef9-228e-4d28-ba01-d7a5346d9c4c tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813" status: 404 len: 111 microversion: 2.1 time: 0.045609 Sep 24 20:51:04.294552 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 190/396] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:04 2022] GET /compute/v2.1/servers/59b0e336-5d09-43b8-b126-6b8e0a33f813 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 20:51:04.299594 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c3f7a454-9eec-4016-ab83-53df0de333c6 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:04.300080 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c3f7a454-9eec-4016-ab83-53df0de333c6 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:04.307686 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3f7a454-9eec-4016-ab83-53df0de333c6 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:04.308229 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3f7a454-9eec-4016-ab83-53df0de333c6 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:04.308941 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3f7a454-9eec-4016-ab83-53df0de333c6 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:04.310257 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3f7a454-9eec-4016-ab83-53df0de333c6 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:04.311002 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3f7a454-9eec-4016-ab83-53df0de333c6 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:04.311416 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3f7a454-9eec-4016-ab83-53df0de333c6 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:04.326383 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-c3f7a454-9eec-4016-ab83-53df0de333c6 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] HTTP exception thrown: Instance 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 could not be found. Sep 24 20:51:04.327980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c3f7a454-9eec-4016-ab83-53df0de333c6 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Request method failure captured: Sep 24 20:51:04.327980 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 HTTP/1.1 Sep 24 20:51:04.327980 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:51:04.327980 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:51:04.327980 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:51:04.327980 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:51:04.327980 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:51:04.327980 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:51:04.327980 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:51:04.327980 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:51:04.327980 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL21tXct_e6jYlpfCLicbbyTXnoW3D_SgXTsoW20R0hO-giY2cCcXhB4j8Nab-pCROuS1EhSgImQhmloh-H8_adEV6tabmxZf_wCnDt5SOp7qMTeNy_SEXOA-DiocBN4-gwUDtJPEwbTPoE1jDUI_OjMOLSqgk3sAcU03gPMcMHJCzhk Sep 24 20:51:04.327980 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:51:04.327980 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:51:04.327980 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:51:04.327980 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:51:04.327980 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:51:04.327980 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:51:04.327980 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: c3800968cd944059a397e9c6b35f976d Sep 24 20:51:04.327980 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-DeleteServersAdminTestJSON-351697204 Sep 24 20:51:04.327980 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:51:04.327980 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:51:04.329338 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c3800968cd944059a397e9c6b35f976d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c3800968cd944059a397e9c6b35f976d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c3800968cd944059a397e9c6b35f976d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c3800968cd944059a397e9c6b35f976d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:51:04.329338 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-DeleteServersAdminTestJSON-351697204 Sep 24 20:51:04.329338 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: c3800968cd944059a397e9c6b35f976d Sep 24 20:51:04.329338 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-351697204 Sep 24 20:51:04.329338 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-DeleteServersAdminTestJSON-351697204-project Sep 24 20:51:04.329338 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:51:04.329338 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:51:04.329338 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 50d8a91794144d73a8942f5c3bac8cc8 Sep 24 20:51:04.329338 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-DeleteServersAdminTestJSON-351697204-project Sep 24 20:51:04.329338 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:51:04.329338 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 could not be found. Sep 24 20:51:04.329338 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '9c7ac6b8-6436-4f54-abad-8d782b4eb5e1'} Sep 24 20:51:04.329989 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:51:04.329989 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:04.329989 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:51:04.329989 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:51:04.329989 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:51:04.329989 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:51:04.329989 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:51:04.329989 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:51:04.329989 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:51:04.329989 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:51:04.329989 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 could not be found. Sep 24 20:51:04.329989 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:04.329989 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:04.329989 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:04.329989 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:04.329989 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:04.329989 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:04.329989 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:51:04.329989 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:51:04.329989 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:51:04.331116 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:51:04.331116 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 20:51:04.331116 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 20:51:04.331116 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 20:51:04.331116 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 20:51:04.331116 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:51:04.331116 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:51:04.331116 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:51:04.331116 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:51:04.331116 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 could not be found. Sep 24 20:51:04.331116 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:04.331116 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:04.331116 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:04.331116 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:04.331116 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:04.331116 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:04.331116 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:51:04.331116 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:51:04.331116 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 could not be found. Sep 24 20:51:04.331116 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:04.332394 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c3f7a454-9eec-4016-ab83-53df0de333c6 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Returning 404 to user: Instance 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:51:04.332394 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c3f7a454-9eec-4016-ab83-53df0de333c6 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1" status: 404 len: 111 microversion: 2.1 time: 0.034449 Sep 24 20:51:04.332394 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 207/397] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:51:04 2022] DELETE /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:51:04.337913 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0607f275-18b2-4594-b66f-f84f4ab91c55 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:04.338822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0607f275-18b2-4594-b66f-f84f4ab91c55 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] [instance: 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:04.345718 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0607f275-18b2-4594-b66f-f84f4ab91c55 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:04.346298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0607f275-18b2-4594-b66f-f84f4ab91c55 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:04.346847 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0607f275-18b2-4594-b66f-f84f4ab91c55 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:04.347603 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0607f275-18b2-4594-b66f-f84f4ab91c55 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:04.348144 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0607f275-18b2-4594-b66f-f84f4ab91c55 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:04.348637 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0607f275-18b2-4594-b66f-f84f4ab91c55 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:04.372208 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-0607f275-18b2-4594-b66f-f84f4ab91c55 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] HTTP exception thrown: Instance 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 could not be found. Sep 24 20:51:04.374092 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0607f275-18b2-4594-b66f-f84f4ab91c55 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Request method failure captured: Sep 24 20:51:04.374092 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 HTTP/1.1 Sep 24 20:51:04.374092 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:51:04.374092 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:51:04.374092 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:51:04.374092 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:51:04.374092 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:51:04.374092 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:51:04.374092 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:51:04.374092 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:51:04.374092 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL21tXct_e6jYlpfCLicbbyTXnoW3D_SgXTsoW20R0hO-giY2cCcXhB4j8Nab-pCROuS1EhSgImQhmloh-H8_adEV6tabmxZf_wCnDt5SOp7qMTeNy_SEXOA-DiocBN4-gwUDtJPEwbTPoE1jDUI_OjMOLSqgk3sAcU03gPMcMHJCzhk Sep 24 20:51:04.374092 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:51:04.374092 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:51:04.374092 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:51:04.374092 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:51:04.374092 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:51:04.374092 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:51:04.374092 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: c3800968cd944059a397e9c6b35f976d Sep 24 20:51:04.374092 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-DeleteServersAdminTestJSON-351697204 Sep 24 20:51:04.374092 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:51:04.374092 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:51:04.375515 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c3800968cd944059a397e9c6b35f976d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c3800968cd944059a397e9c6b35f976d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c3800968cd944059a397e9c6b35f976d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c3800968cd944059a397e9c6b35f976d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:51:04.375515 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-DeleteServersAdminTestJSON-351697204 Sep 24 20:51:04.375515 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: c3800968cd944059a397e9c6b35f976d Sep 24 20:51:04.375515 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-351697204 Sep 24 20:51:04.375515 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-DeleteServersAdminTestJSON-351697204-project Sep 24 20:51:04.375515 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:51:04.375515 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:51:04.375515 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 50d8a91794144d73a8942f5c3bac8cc8 Sep 24 20:51:04.375515 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-DeleteServersAdminTestJSON-351697204-project Sep 24 20:51:04.375515 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:51:04.375515 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 could not be found. Sep 24 20:51:04.375515 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '9c7ac6b8-6436-4f54-abad-8d782b4eb5e1'} Sep 24 20:51:04.376419 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:51:04.376419 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:04.376419 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:51:04.376419 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:51:04.376419 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:51:04.376419 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:51:04.376419 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:51:04.376419 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:51:04.376419 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:51:04.376419 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:51:04.376419 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 could not be found. Sep 24 20:51:04.376419 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:04.376419 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:04.376419 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:04.376419 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:04.376419 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:04.376419 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:04.376419 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:51:04.376419 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:51:04.376419 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:51:04.377864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:51:04.377864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:51:04.377864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:51:04.377864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:51:04.377864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:51:04.377864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:51:04.377864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:51:04.377864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 could not be found. Sep 24 20:51:04.377864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:04.377864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:04.377864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:04.377864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:04.377864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:04.377864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:04.377864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:51:04.377864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:51:04.377864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 could not be found. Sep 24 20:51:04.377864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:04.379087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0607f275-18b2-4594-b66f-f84f4ab91c55 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] Returning 404 to user: Instance 9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:51:04.379087 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0607f275-18b2-4594-b66f-f84f4ab91c55 tempest-DeleteServersAdminTestJSON-351697204 tempest-DeleteServersAdminTestJSON-351697204-project] 10.222.0.52 "GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1" status: 404 len: 111 microversion: 2.1 time: 0.043019 Sep 24 20:51:04.379555 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 191/398] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:04 2022] GET /compute/v2.1/servers/9c7ac6b8-6436-4f54-abad-8d782b4eb5e1 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:51:04.658138 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0dc7dc20-45e8-48eb-9181-27c2de74d558 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:04.659131 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0dc7dc20-45e8-48eb-9181-27c2de74d558 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:04.665629 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0dc7dc20-45e8-48eb-9181-27c2de74d558 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:04.666106 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0dc7dc20-45e8-48eb-9181-27c2de74d558 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:04.666794 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0dc7dc20-45e8-48eb-9181-27c2de74d558 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:04.668123 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0dc7dc20-45e8-48eb-9181-27c2de74d558 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:04.668772 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0dc7dc20-45e8-48eb-9181-27c2de74d558 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:04.669229 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0dc7dc20-45e8-48eb-9181-27c2de74d558 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:04.828576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0dc7dc20-45e8-48eb-9181-27c2de74d558 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:04.838950 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0dc7dc20-45e8-48eb-9181-27c2de74d558 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1476 microversion: 2.1 time: 0.185283 Sep 24 20:51:04.851315 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 208/399] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:04 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1476 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:04.973185 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-edfc60b2-5c72-4411-9784-80960a6e4b80 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:04.974310 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-edfc60b2-5c72-4411-9784-80960a6e4b80 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:04.981859 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-edfc60b2-5c72-4411-9784-80960a6e4b80 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:04.982547 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-edfc60b2-5c72-4411-9784-80960a6e4b80 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:04.983173 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-edfc60b2-5c72-4411-9784-80960a6e4b80 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:04.984057 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-edfc60b2-5c72-4411-9784-80960a6e4b80 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:04.984981 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-edfc60b2-5c72-4411-9784-80960a6e4b80 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:04.985564 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-edfc60b2-5c72-4411-9784-80960a6e4b80 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:05.064221 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-edfc60b2-5c72-4411-9784-80960a6e4b80 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:05.075394 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-edfc60b2-5c72-4411-9784-80960a6e4b80 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:05.077637 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-edfc60b2-5c72-4411-9784-80960a6e4b80 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:05.083905 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-edfc60b2-5c72-4411-9784-80960a6e4b80 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.114578 Sep 24 20:51:05.091591 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9d6d6619-4177-45e1-9ffe-848c3c3af40b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:05.092803 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9d6d6619-4177-45e1-9ffe-848c3c3af40b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:05.096446 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 192/400] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:51:04 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:51:05.111731 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d6d6619-4177-45e1-9ffe-848c3c3af40b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:05.112234 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d6d6619-4177-45e1-9ffe-848c3c3af40b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:05.112671 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d6d6619-4177-45e1-9ffe-848c3c3af40b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:05.113377 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d6d6619-4177-45e1-9ffe-848c3c3af40b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:05.113828 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d6d6619-4177-45e1-9ffe-848c3c3af40b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:05.114257 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d6d6619-4177-45e1-9ffe-848c3c3af40b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:05.291921 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9d6d6619-4177-45e1-9ffe-848c3c3af40b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:05.303334 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9d6d6619-4177-45e1-9ffe-848c3c3af40b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5" status: 200 len: 1494 microversion: 2.1 time: 0.217538 Sep 24 20:51:05.304067 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 209/401] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:05 2022] GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 => generated 1494 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:05.336871 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0dbb0e48-cc4c-4986-b04a-73cc6a668bf9 tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] Calling method '.version_select at 0x7f4b0d1c4310>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:05.338710 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0dbb0e48-cc4c-4986-b04a-73cc6a668bf9 tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:05.340162 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0dbb0e48-cc4c-4986-b04a-73cc6a668bf9 tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:05.340323 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0dbb0e48-cc4c-4986-b04a-73cc6a668bf9 tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:05.357117 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0dbb0e48-cc4c-4986-b04a-73cc6a668bf9 tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:05.357613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0dbb0e48-cc4c-4986-b04a-73cc6a668bf9 tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:05.358052 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0dbb0e48-cc4c-4986-b04a-73cc6a668bf9 tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:05.371901 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0dbb0e48-cc4c-4986-b04a-73cc6a668bf9 tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:05.372620 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0dbb0e48-cc4c-4986-b04a-73cc6a668bf9 tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:05.373431 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0dbb0e48-cc4c-4986-b04a-73cc6a668bf9 tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:05.381930 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0dbb0e48-cc4c-4986-b04a-73cc6a668bf9 tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.270458 Sep 24 20:51:05.382566 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 193/402] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:51:05 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:05.393954 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f326fa7b-d5e1-42f7-a3d8-f6382fba921e tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] Calling method '.version_select at 0x7f4b0cfe3f70>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:05.395903 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f326fa7b-d5e1-42f7-a3d8-f6382fba921e tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:05.396393 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f326fa7b-d5e1-42f7-a3d8-f6382fba921e tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:05.396859 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f326fa7b-d5e1-42f7-a3d8-f6382fba921e tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:05.418700 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f326fa7b-d5e1-42f7-a3d8-f6382fba921e tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:05.419197 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f326fa7b-d5e1-42f7-a3d8-f6382fba921e tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:05.419630 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f326fa7b-d5e1-42f7-a3d8-f6382fba921e tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:05.445222 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f326fa7b-d5e1-42f7-a3d8-f6382fba921e tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:05.445716 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f326fa7b-d5e1-42f7-a3d8-f6382fba921e tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:05.446153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f326fa7b-d5e1-42f7-a3d8-f6382fba921e tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:05.452831 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f326fa7b-d5e1-42f7-a3d8-f6382fba921e tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/nch1-master-1/servers" status: 200 len: 354 microversion: 2.1 time: 0.062488 Sep 24 20:51:05.453397 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 194/403] 10.222.0.52 () {58 vars in 1212 bytes} [Sat Sep 24 20:51:05 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/servers => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:05.622365 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3a3fcebc-8aa9-4d99-82d4-a6ec8a82c39e tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:05.623047 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3a3fcebc-8aa9-4d99-82d4-a6ec8a82c39e tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] [instance: 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:05.629465 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3a3fcebc-8aa9-4d99-82d4-a6ec8a82c39e tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:05.630180 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3a3fcebc-8aa9-4d99-82d4-a6ec8a82c39e tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:05.630835 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3a3fcebc-8aa9-4d99-82d4-a6ec8a82c39e tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:05.631551 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3a3fcebc-8aa9-4d99-82d4-a6ec8a82c39e tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:05.632174 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3a3fcebc-8aa9-4d99-82d4-a6ec8a82c39e tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:05.632614 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3a3fcebc-8aa9-4d99-82d4-a6ec8a82c39e tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:05.820173 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3a3fcebc-8aa9-4d99-82d4-a6ec8a82c39e tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5" status: 200 len: 1645 microversion: 2.1 time: 0.492695 Sep 24 20:51:05.821271 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 210/404] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:05 2022] GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 => generated 1645 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:51:05.827407 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7f726aa1-d34a-4321-9c97-c4f8655baa6e tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] Calling method '.version_select at 0x7f4b0d01b9d0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:05.829642 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f726aa1-d34a-4321-9c97-c4f8655baa6e tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:05.831249 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f726aa1-d34a-4321-9c97-c4f8655baa6e tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:05.831930 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f726aa1-d34a-4321-9c97-c4f8655baa6e tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:05.851376 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c5c76550-d194-4f88-a279-9dbc1158fb71 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-409247639", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:05.851912 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f726aa1-d34a-4321-9c97-c4f8655baa6e tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:05.852703 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f726aa1-d34a-4321-9c97-c4f8655baa6e tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:05.853329 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f726aa1-d34a-4321-9c97-c4f8655baa6e tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:05.866563 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f726aa1-d34a-4321-9c97-c4f8655baa6e tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:05.867136 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f726aa1-d34a-4321-9c97-c4f8655baa6e tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:05.867654 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f726aa1-d34a-4321-9c97-c4f8655baa6e tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:05.875387 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7f726aa1-d34a-4321-9c97-c4f8655baa6e tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.052017 Sep 24 20:51:05.875995 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 211/405] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:51:05 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:05.882760 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ebf98f43-730c-4a2b-8528-b8b958b3f418 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:05.883752 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ebf98f43-730c-4a2b-8528-b8b958b3f418 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] [instance: 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:05.891142 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ebf98f43-730c-4a2b-8528-b8b958b3f418 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:05.892015 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ebf98f43-730c-4a2b-8528-b8b958b3f418 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:05.892641 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ebf98f43-730c-4a2b-8528-b8b958b3f418 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:05.893526 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ebf98f43-730c-4a2b-8528-b8b958b3f418 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:05.894161 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ebf98f43-730c-4a2b-8528-b8b958b3f418 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:05.894819 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ebf98f43-730c-4a2b-8528-b8b958b3f418 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:05.939367 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-c5c76550-d194-4f88-a279-9dbc1158fb71 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] validate_networks() for None {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:51:06.172275 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ebf98f43-730c-4a2b-8528-b8b958b3f418 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5" status: 200 len: 1645 microversion: 2.1 time: 0.294861 Sep 24 20:51:06.173082 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 212/406] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:05 2022] GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 => generated 1645 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:06.178452 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b747732f-867e-4a75-a879-50624d199863 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:06.180183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b747732f-867e-4a75-a879-50624d199863 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:06.186927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b747732f-867e-4a75-a879-50624d199863 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:06.187625 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b747732f-867e-4a75-a879-50624d199863 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:06.188302 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b747732f-867e-4a75-a879-50624d199863 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:06.189375 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b747732f-867e-4a75-a879-50624d199863 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:06.190132 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b747732f-867e-4a75-a879-50624d199863 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:06.191987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b747732f-867e-4a75-a879-50624d199863 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:06.315388 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-c5c76550-d194-4f88-a279-9dbc1158fb71 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:51:06.316443 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-c5c76550-d194-4f88-a279-9dbc1158fb71 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:51:06.317175 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-c5c76550-d194-4f88-a279-9dbc1158fb71 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:51:06.317806 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-c5c76550-d194-4f88-a279-9dbc1158fb71 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:51:06.318460 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-c5c76550-d194-4f88-a279-9dbc1158fb71 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:51:06.331431 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c5c76550-d194-4f88-a279-9dbc1158fb71 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:06.332155 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c5c76550-d194-4f88-a279-9dbc1158fb71 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:06.332935 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c5c76550-d194-4f88-a279-9dbc1158fb71 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:06.333881 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c5c76550-d194-4f88-a279-9dbc1158fb71 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:06.335007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c5c76550-d194-4f88-a279-9dbc1158fb71 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:06.335628 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c5c76550-d194-4f88-a279-9dbc1158fb71 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:06.363751 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-c5c76550-d194-4f88-a279-9dbc1158fb71 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Getting quotas for project 5e68660c954f47f9bad1f7bee17f9435. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:51:06.371402 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-c5c76550-d194-4f88-a279-9dbc1158fb71 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Getting quotas for user 9eec3a30bcc641ca8ecee19471007b1d and project 5e68660c954f47f9bad1f7bee17f9435. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:51:06.385780 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b747732f-867e-4a75-a879-50624d199863 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:06.390941 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c5c76550-d194-4f88-a279-9dbc1158fb71 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:51:06.394307 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c5c76550-d194-4f88-a279-9dbc1158fb71 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:51:06.395894 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b747732f-867e-4a75-a879-50624d199863 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1476 microversion: 2.1 time: 0.221612 Sep 24 20:51:06.396459 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 213/407] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:06 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1476 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:06.404087 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e2bc96d7-42b9-4327-ad6b-7a6d5ceab30a tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] Calling method '.version_select at 0x7f4b0cd861f0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:06.407725 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e2bc96d7-42b9-4327-ad6b-7a6d5ceab30a tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:06.407725 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e2bc96d7-42b9-4327-ad6b-7a6d5ceab30a tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:06.407885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e2bc96d7-42b9-4327-ad6b-7a6d5ceab30a tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:06.438550 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e2bc96d7-42b9-4327-ad6b-7a6d5ceab30a tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:06.439210 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e2bc96d7-42b9-4327-ad6b-7a6d5ceab30a tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:06.440120 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e2bc96d7-42b9-4327-ad6b-7a6d5ceab30a tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:06.447341 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e2bc96d7-42b9-4327-ad6b-7a6d5ceab30a tempest-HypervisorAdminUnderV252Test-2041938922 tempest-HypervisorAdminUnderV252Test-2041938922-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/nch1-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.047803 Sep 24 20:51:06.449306 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 214/408] 10.222.0.52 () {58 vars in 1209 bytes} [Sat Sep 24 20:51:06 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/search => generated 104 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:06.455313 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-49ec1ca3-f450-4039-a4be-1a48f8b9f938 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:06.456317 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-49ec1ca3-f450-4039-a4be-1a48f8b9f938 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:06.462381 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-49ec1ca3-f450-4039-a4be-1a48f8b9f938 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:06.462973 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-49ec1ca3-f450-4039-a4be-1a48f8b9f938 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:06.463479 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-49ec1ca3-f450-4039-a4be-1a48f8b9f938 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:06.464892 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-49ec1ca3-f450-4039-a4be-1a48f8b9f938 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:06.465684 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-49ec1ca3-f450-4039-a4be-1a48f8b9f938 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:06.466336 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-49ec1ca3-f450-4039-a4be-1a48f8b9f938 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:06.487448 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c5c76550-d194-4f88-a279-9dbc1158fb71 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.031118 Sep 24 20:51:06.494762 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 195/409] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:51:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:51:06.504887 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3e4dc980-d2ca-4dbc-b377-732a216cae35 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:06.519691 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e4dc980-d2ca-4dbc-b377-732a216cae35 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:06.520654 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e4dc980-d2ca-4dbc-b377-732a216cae35 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:06.521271 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e4dc980-d2ca-4dbc-b377-732a216cae35 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:06.522219 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e4dc980-d2ca-4dbc-b377-732a216cae35 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:06.522914 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e4dc980-d2ca-4dbc-b377-732a216cae35 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:06.523784 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e4dc980-d2ca-4dbc-b377-732a216cae35 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:06.545210 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-49ec1ca3-f450-4039-a4be-1a48f8b9f938 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:06.548190 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=4,nova_api:INSERT=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:51:06.555565 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-49ec1ca3-f450-4039-a4be-1a48f8b9f938 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:06.557342 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-49ec1ca3-f450-4039-a4be-1a48f8b9f938 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:06.564857 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-49ec1ca3-f450-4039-a4be-1a48f8b9f938 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.113484 Sep 24 20:51:06.566349 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 215/410] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:51:06 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:51:06.568718 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3e4dc980-d2ca-4dbc-b377-732a216cae35 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.077211 Sep 24 20:51:06.579502 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 196/411] 10.222.0.52 () {58 vars in 1176 bytes} [Sat Sep 24 20:51:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:06.586320 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-72def127-40f1-4107-af26-1ba9a7697538 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:06.592032 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-72def127-40f1-4107-af26-1ba9a7697538 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] [instance: 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:06.600425 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72def127-40f1-4107-af26-1ba9a7697538 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:06.601492 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72def127-40f1-4107-af26-1ba9a7697538 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:06.602026 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72def127-40f1-4107-af26-1ba9a7697538 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:06.602958 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72def127-40f1-4107-af26-1ba9a7697538 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:06.603517 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72def127-40f1-4107-af26-1ba9a7697538 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:06.604039 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72def127-40f1-4107-af26-1ba9a7697538 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:06.698620 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-72def127-40f1-4107-af26-1ba9a7697538 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lazy-loading 'flavor' on Instance uuid 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:51:06.756207 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-72def127-40f1-4107-af26-1ba9a7697538 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] [instance: 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5] Going to try to live migrate instance to nch2-master-1 {{(pid=140516) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 24 20:51:06.783554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-946e0863-cbf3-4ce5-8106-95dfdb29636a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-995192843", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:06.874142 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-946e0863-cbf3-4ce5-8106-95dfdb29636a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] validate_networks() for None {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:51:07.186935 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-946e0863-cbf3-4ce5-8106-95dfdb29636a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:51:07.187366 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-946e0863-cbf3-4ce5-8106-95dfdb29636a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:51:07.187851 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-946e0863-cbf3-4ce5-8106-95dfdb29636a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:51:07.188263 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-946e0863-cbf3-4ce5-8106-95dfdb29636a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:51:07.188680 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-946e0863-cbf3-4ce5-8106-95dfdb29636a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:51:07.200856 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-946e0863-cbf3-4ce5-8106-95dfdb29636a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:07.201348 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-946e0863-cbf3-4ce5-8106-95dfdb29636a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:07.201787 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-946e0863-cbf3-4ce5-8106-95dfdb29636a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:07.202547 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-946e0863-cbf3-4ce5-8106-95dfdb29636a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:07.202994 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-946e0863-cbf3-4ce5-8106-95dfdb29636a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:07.203438 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-946e0863-cbf3-4ce5-8106-95dfdb29636a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:07.238655 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-946e0863-cbf3-4ce5-8106-95dfdb29636a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Getting quotas for project 5e68660c954f47f9bad1f7bee17f9435. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:51:07.246436 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-946e0863-cbf3-4ce5-8106-95dfdb29636a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Getting quotas for user 9eec3a30bcc641ca8ecee19471007b1d and project 5e68660c954f47f9bad1f7bee17f9435. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:51:07.265431 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-946e0863-cbf3-4ce5-8106-95dfdb29636a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:51:07.268019 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-946e0863-cbf3-4ce5-8106-95dfdb29636a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: 95aa2033-71b1-41a6-b583-2fd183c18242] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:51:07.338297 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-946e0863-cbf3-4ce5-8106-95dfdb29636a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.559893 Sep 24 20:51:07.359693 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 197/412] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:51:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:51:07.371834 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d6b06f06-1048-4003-9b94-b2413bfb93a9 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:07.373135 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d6b06f06-1048-4003-9b94-b2413bfb93a9 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: 95aa2033-71b1-41a6-b583-2fd183c18242] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:07.442335 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d6b06f06-1048-4003-9b94-b2413bfb93a9 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:07.456403 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d6b06f06-1048-4003-9b94-b2413bfb93a9 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242" status: 200 len: 1213 microversion: 2.1 time: 0.093745 Sep 24 20:51:07.456999 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 198/413] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:07 2022] GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242 => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:07.493212 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-77d6b79f-2d06-4bc9-a56d-0d5759c63dd5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:07.496840 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-77d6b79f-2d06-4bc9-a56d-0d5759c63dd5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:07.506868 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77d6b79f-2d06-4bc9-a56d-0d5759c63dd5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:07.507845 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77d6b79f-2d06-4bc9-a56d-0d5759c63dd5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:07.514859 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77d6b79f-2d06-4bc9-a56d-0d5759c63dd5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:07.516957 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77d6b79f-2d06-4bc9-a56d-0d5759c63dd5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:07.517447 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77d6b79f-2d06-4bc9-a56d-0d5759c63dd5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:07.520828 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77d6b79f-2d06-4bc9-a56d-0d5759c63dd5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:07.735938 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-77d6b79f-2d06-4bc9-a56d-0d5759c63dd5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:07.753834 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-77d6b79f-2d06-4bc9-a56d-0d5759c63dd5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1476 microversion: 2.1 time: 0.279601 Sep 24 20:51:07.767349 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 199/414] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:07 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1476 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:07.778544 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9460166f-c663-4f09-baa9-066acc37604f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:07.779239 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9460166f-c663-4f09-baa9-066acc37604f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:07.785619 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9460166f-c663-4f09-baa9-066acc37604f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:07.786380 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9460166f-c663-4f09-baa9-066acc37604f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:07.786852 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9460166f-c663-4f09-baa9-066acc37604f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:07.787559 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9460166f-c663-4f09-baa9-066acc37604f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:07.788016 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9460166f-c663-4f09-baa9-066acc37604f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:07.788435 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9460166f-c663-4f09-baa9-066acc37604f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:07.861135 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9460166f-c663-4f09-baa9-066acc37604f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:07.869566 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9460166f-c663-4f09-baa9-066acc37604f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:07.872776 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9460166f-c663-4f09-baa9-066acc37604f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:07.878051 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9460166f-c663-4f09-baa9-066acc37604f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.109434 Sep 24 20:51:07.878647 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 200/415] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:51:07 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:51:08.487436 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-baf412a5-dcb8-471f-8818-a5410ca26ebb tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:08.488139 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-baf412a5-dcb8-471f-8818-a5410ca26ebb tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: 95aa2033-71b1-41a6-b583-2fd183c18242] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:08.551682 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-baf412a5-dcb8-471f-8818-a5410ca26ebb tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:08.569270 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-baf412a5-dcb8-471f-8818-a5410ca26ebb tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242" status: 200 len: 1213 microversion: 2.1 time: 0.085864 Sep 24 20:51:08.571700 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 201/416] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:08 2022] GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:51:08.783179 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dc1425f7-de1e-4ab8-915b-8a43e208c232 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:08.783913 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dc1425f7-de1e-4ab8-915b-8a43e208c232 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:08.795920 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc1425f7-de1e-4ab8-915b-8a43e208c232 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:08.796499 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc1425f7-de1e-4ab8-915b-8a43e208c232 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:08.796979 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc1425f7-de1e-4ab8-915b-8a43e208c232 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:08.801102 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc1425f7-de1e-4ab8-915b-8a43e208c232 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:08.801102 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc1425f7-de1e-4ab8-915b-8a43e208c232 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:08.801102 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc1425f7-de1e-4ab8-915b-8a43e208c232 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:09.229174 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dc1425f7-de1e-4ab8-915b-8a43e208c232 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:09.241357 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dc1425f7-de1e-4ab8-915b-8a43e208c232 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1476 microversion: 2.1 time: 0.462915 Sep 24 20:51:09.243318 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 202/417] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:08 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1476 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:09.258332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b17c0a32-bd29-4da0-81a4-57d0df7c3112 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:09.261570 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b17c0a32-bd29-4da0-81a4-57d0df7c3112 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:09.285078 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b17c0a32-bd29-4da0-81a4-57d0df7c3112 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:09.285078 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b17c0a32-bd29-4da0-81a4-57d0df7c3112 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:09.285352 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b17c0a32-bd29-4da0-81a4-57d0df7c3112 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:09.286271 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b17c0a32-bd29-4da0-81a4-57d0df7c3112 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:09.287129 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b17c0a32-bd29-4da0-81a4-57d0df7c3112 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:09.297257 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b17c0a32-bd29-4da0-81a4-57d0df7c3112 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:09.325458 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:51:09.577577 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b17c0a32-bd29-4da0-81a4-57d0df7c3112 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:09.600376 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b17c0a32-bd29-4da0-81a4-57d0df7c3112 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:09.603501 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b17c0a32-bd29-4da0-81a4-57d0df7c3112 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:09.633685 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b17c0a32-bd29-4da0-81a4-57d0df7c3112 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1560 microversion: 2.91 time: 0.389016 Sep 24 20:51:09.634676 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 203/418] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:51:09 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1560 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:51:09.642070 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-eb390197-0a8b-4b16-94a4-0edad8b6495f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:09.648029 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-eb390197-0a8b-4b16-94a4-0edad8b6495f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: 95aa2033-71b1-41a6-b583-2fd183c18242] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:09.657408 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb390197-0a8b-4b16-94a4-0edad8b6495f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:09.658194 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb390197-0a8b-4b16-94a4-0edad8b6495f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:09.659254 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb390197-0a8b-4b16-94a4-0edad8b6495f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:09.660491 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb390197-0a8b-4b16-94a4-0edad8b6495f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:09.661274 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb390197-0a8b-4b16-94a4-0edad8b6495f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:09.661912 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb390197-0a8b-4b16-94a4-0edad8b6495f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:09.814869 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-eb390197-0a8b-4b16-94a4-0edad8b6495f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:09.826821 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-eb390197-0a8b-4b16-94a4-0edad8b6495f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242" status: 200 len: 1265 microversion: 2.1 time: 0.190601 Sep 24 20:51:09.829818 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 204/419] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:09 2022] GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:10.561275 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-72def127-40f1-4107-af26-1ba9a7697538 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5/action" status: 202 len: 0 microversion: 2.1 time: 3.983000 Sep 24 20:51:10.563576 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 216/420] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:51:06 2022] POST /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5/action => generated 0 bytes in 3986 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:51:10.569640 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a5d23e72-8649-4731-9519-cc2f5a52659c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:10.571141 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a5d23e72-8649-4731-9519-cc2f5a52659c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:10.581814 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5d23e72-8649-4731-9519-cc2f5a52659c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:10.582901 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5d23e72-8649-4731-9519-cc2f5a52659c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:10.583633 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5d23e72-8649-4731-9519-cc2f5a52659c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:10.584921 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5d23e72-8649-4731-9519-cc2f5a52659c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:10.585669 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5d23e72-8649-4731-9519-cc2f5a52659c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:10.586326 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5d23e72-8649-4731-9519-cc2f5a52659c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:10.779959 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d7d546b9-3cab-4330-8a70-6146eaebbfe7 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1121046657", "id": 1659065766, "os-flavor-access:is_public": "False"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:10.832058 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d7d546b9-3cab-4330-8a70-6146eaebbfe7 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.757384 Sep 24 20:51:10.833012 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 205/421] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:51:10 2022] POST /compute/v2.1/flavors => generated 439 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:51:10.858919 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-58590796-d08e-4acf-94d3-fe4acde4f0c6 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:10.864637 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-58590796-d08e-4acf-94d3-fe4acde4f0c6 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:10.879224 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58590796-d08e-4acf-94d3-fe4acde4f0c6 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:10.879728 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58590796-d08e-4acf-94d3-fe4acde4f0c6 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:10.890390 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58590796-d08e-4acf-94d3-fe4acde4f0c6 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:10.893059 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58590796-d08e-4acf-94d3-fe4acde4f0c6 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:10.894857 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58590796-d08e-4acf-94d3-fe4acde4f0c6 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:10.896094 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58590796-d08e-4acf-94d3-fe4acde4f0c6 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:10.914729 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a5d23e72-8649-4731-9519-cc2f5a52659c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:10.928680 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a5d23e72-8649-4731-9519-cc2f5a52659c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1476 microversion: 2.1 time: 0.358724 Sep 24 20:51:10.930246 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 217/422] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:10 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1476 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:10.954721 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3c9911a3-789b-4f1c-81bb-a6f17ddfb9ff tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:10.956475 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3c9911a3-789b-4f1c-81bb-a6f17ddfb9ff tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:10.966119 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c9911a3-789b-4f1c-81bb-a6f17ddfb9ff tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:10.984305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c9911a3-789b-4f1c-81bb-a6f17ddfb9ff tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:10.985252 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c9911a3-789b-4f1c-81bb-a6f17ddfb9ff tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:10.986406 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c9911a3-789b-4f1c-81bb-a6f17ddfb9ff tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:10.988318 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c9911a3-789b-4f1c-81bb-a6f17ddfb9ff tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:10.991101 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c9911a3-789b-4f1c-81bb-a6f17ddfb9ff tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:11.050880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:51:11.167523 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3c9911a3-789b-4f1c-81bb-a6f17ddfb9ff tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:11.186660 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-58590796-d08e-4acf-94d3-fe4acde4f0c6 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:11.189938 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3c9911a3-789b-4f1c-81bb-a6f17ddfb9ff tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:11.195095 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3c9911a3-789b-4f1c-81bb-a6f17ddfb9ff tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:11.196936 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-58590796-d08e-4acf-94d3-fe4acde4f0c6 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5" status: 200 len: 1504 microversion: 2.1 time: 0.363176 Sep 24 20:51:11.197833 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 206/423] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:10 2022] GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 => generated 1504 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:11.203460 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6f11f5de-a6bc-4ff1-ba33-5144b0dd0194 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "1dcc95e714424741acb548115f7c0acb"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:11.213712 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3c9911a3-789b-4f1c-81bb-a6f17ddfb9ff tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1555 microversion: 2.91 time: 0.280106 Sep 24 20:51:11.219115 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 218/424] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:51:10 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1555 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:51:11.244336 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c4cae75b-1432-44c9-add6-0d5aa982fd4c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:11.245833 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c4cae75b-1432-44c9-add6-0d5aa982fd4c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: 95aa2033-71b1-41a6-b583-2fd183c18242] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:11.252974 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4cae75b-1432-44c9-add6-0d5aa982fd4c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:11.253668 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4cae75b-1432-44c9-add6-0d5aa982fd4c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:11.254270 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4cae75b-1432-44c9-add6-0d5aa982fd4c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:11.255178 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4cae75b-1432-44c9-add6-0d5aa982fd4c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:11.255815 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4cae75b-1432-44c9-add6-0d5aa982fd4c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:11.256398 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4cae75b-1432-44c9-add6-0d5aa982fd4c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:11.333878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c4cae75b-1432-44c9-add6-0d5aa982fd4c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:11.344325 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c4cae75b-1432-44c9-add6-0d5aa982fd4c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242" status: 200 len: 1271 microversion: 2.1 time: 0.108563 Sep 24 20:51:11.345104 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 219/425] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:11 2022] GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242 => generated 1271 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:11.774029 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6f11f5de-a6bc-4ff1-ba33-5144b0dd0194 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/1659065766/action" status: 200 len: 97 microversion: 2.1 time: 0.574379 Sep 24 20:51:11.774595 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 207/426] 10.222.0.52 () {60 vars in 1200 bytes} [Sat Sep 24 20:51:11 2022] POST /compute/v2.1/flavors/1659065766/action => generated 97 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:51:11.786083 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2d9433a3-ec90-4f15-8d7f-b9da8d325f5e tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "1dcc95e714424741acb548115f7c0acb"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:11.957603 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ba3f09c4-99ab-434c-81f6-82308951e92f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:11.958388 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ba3f09c4-99ab-434c-81f6-82308951e92f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:11.974704 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ba3f09c4-99ab-434c-81f6-82308951e92f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:11.976591 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ba3f09c4-99ab-434c-81f6-82308951e92f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:11.980228 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ba3f09c4-99ab-434c-81f6-82308951e92f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:11.981322 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ba3f09c4-99ab-434c-81f6-82308951e92f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:11.983424 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ba3f09c4-99ab-434c-81f6-82308951e92f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:11.985957 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ba3f09c4-99ab-434c-81f6-82308951e92f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:12.278257 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ba3f09c4-99ab-434c-81f6-82308951e92f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:12.290094 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ba3f09c4-99ab-434c-81f6-82308951e92f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1476 microversion: 2.1 time: 0.340054 Sep 24 20:51:12.327437 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 208/427] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:11 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1476 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:12.334789 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-2d9433a3-ec90-4f15-8d7f-b9da8d325f5e tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] HTTP exception thrown: Flavor access already exists for flavor 33 and project 1dcc95e714424741acb548115f7c0acb combination. Sep 24 20:51:12.342359 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3939f994-7023-4471-b654-f00a67890b19 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:12.344498 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2d9433a3-ec90-4f15-8d7f-b9da8d325f5e tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] Request method failure captured: Sep 24 20:51:12.344498 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/flavors/1659065766/action HTTP/1.1 Sep 24 20:51:12.344498 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:51:12.344498 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:51:12.344498 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:51:12.344498 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 67 Sep 24 20:51:12.344498 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:51:12.344498 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:51:12.344498 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:51:12.344498 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:51:12.344498 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL22872MF5QTO0rpTp0GRkXe3bFObfDHCbCpdIOsFIGvCJJk0bFdziNh1NxTwsJvH0WWTdPdT4GCey5tMAPka5RPV8A5YS8qBSGIXEamSXCHxVfmgpqy0W4IXEmnsT705r1-lswcjv0mtPkvqXeIcPgILb8EjC9Dw1sbL_6iPhIP9VlQ Sep 24 20:51:12.344498 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:51:12.344498 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:51:12.344498 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:51:12.344498 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:51:12.344498 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:51:12.344498 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:51:12.344498 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 37b8d37bcac74b7996617c1561e96c19 Sep 24 20:51:12.344498 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1295882863 Sep 24 20:51:12.344498 ncdv-master-1 devstack@n-api.service[140516]: X-Role: admin,reader,member Sep 24 20:51:12.344498 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: admin,reader,member Sep 24 20:51:12.345759 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/37b8d37bcac74b7996617c1561e96c19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_37b8d37bcac74b7996617c1561e96c19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/37b8d37bcac74b7996617c1561e96c19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/37b8d37bcac74b7996617c1561e96c19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:51:12.345759 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1295882863 Sep 24 20:51:12.345759 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 37b8d37bcac74b7996617c1561e96c19 Sep 24 20:51:12.345759 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1295882863 Sep 24 20:51:12.345759 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin Sep 24 20:51:12.345759 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:51:12.345759 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:51:12.345759 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 830860e6e5aa438ca5e59691022fa2fa Sep 24 20:51:12.345759 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin Sep 24 20:51:12.345759 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 20:51:12.345759 ncdv-master-1 devstack@n-api.service[140516]: {"addTenantAccess": {"tenant": "1dcc95e714424741acb548115f7c0acb"}} Sep 24 20:51:12.345759 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:51:12.346476 ncdv-master-1 devstack@n-api.service[140516]: exception: Flavor access already exists for flavor 33 and project 1dcc95e714424741acb548115f7c0acb combination. Sep 24 20:51:12.346476 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '1659065766', 'body': {'addTenantAccess': {'tenant': '1dcc95e714424741acb548115f7c0acb'}}} Sep 24 20:51:12.346476 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:51:12.346476 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:12.346476 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 24 20:51:12.346476 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 24 20:51:12.346476 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 24 20:51:12.346476 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 24 20:51:12.346476 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 24 20:51:12.346476 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 24 20:51:12.346476 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 24 20:51:12.346476 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 24 20:51:12.346476 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 24 20:51:12.346476 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 24 20:51:12.346476 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 24 20:51:12.346476 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result.read() Sep 24 20:51:12.346476 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 24 20:51:12.346476 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 24 20:51:12.347600 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 24 20:51:12.347600 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 24 20:51:12.347600 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 24 20:51:12.347600 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 24 20:51:12.347600 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 24 20:51:12.347600 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 24 20:51:12.347600 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '33-1dcc95e714424741acb548115f7c0acb' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 24 20:51:12.347600 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:12.347600 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 24 20:51:12.347600 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:12.347600 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:12.347600 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Sep 24 20:51:12.347600 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi project.save(context.session) Sep 24 20:51:12.347600 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 24 20:51:12.347600 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi session.flush() Sep 24 20:51:12.347600 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 24 20:51:12.347600 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 24 20:51:12.347600 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 24 20:51:12.347600 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 24 20:51:12.348670 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 24 20:51:12.348670 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 24 20:51:12.348670 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 24 20:51:12.348670 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception Sep 24 20:51:12.348670 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 24 20:51:12.348670 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 24 20:51:12.348670 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 24 20:51:12.348670 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 24 20:51:12.348670 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 24 20:51:12.348670 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 24 20:51:12.348670 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 24 20:51:12.348670 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 24 20:51:12.348670 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 24 20:51:12.348670 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 24 20:51:12.348670 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 24 20:51:12.348670 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 24 20:51:12.348670 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 24 20:51:12.348670 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 24 20:51:12.349617 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 24 20:51:12.349617 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 24 20:51:12.349617 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 24 20:51:12.349617 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 24 20:51:12.349617 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 24 20:51:12.349617 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 24 20:51:12.349617 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 24 20:51:12.349617 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception Sep 24 20:51:12.349617 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 24 20:51:12.349617 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 24 20:51:12.349617 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 24 20:51:12.349617 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 24 20:51:12.349617 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 24 20:51:12.349617 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 24 20:51:12.349617 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 24 20:51:12.349617 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 24 20:51:12.349617 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 24 20:51:12.349617 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 24 20:51:12.351625 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 24 20:51:12.351625 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result.read() Sep 24 20:51:12.351625 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 24 20:51:12.351625 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 24 20:51:12.351625 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 24 20:51:12.351625 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 24 20:51:12.351625 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 24 20:51:12.351625 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 24 20:51:12.351625 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 24 20:51:12.351625 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 24 20:51:12.351625 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '33-1dcc95e714424741acb548115f7c0acb' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 24 20:51:12.351625 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Sep 24 20:51:12.351625 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 24, 20, 51, 12, 329043), 'updated_at': None, 'flavor_id': 33, 'project_id': '1dcc95e714424741acb548115f7c0acb'}] Sep 24 20:51:12.351625 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 24 20:51:12.351625 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:12.351625 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:12.351625 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:12.353845 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:12.353845 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Sep 24 20:51:12.353845 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Sep 24 20:51:12.353845 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 24 20:51:12.353845 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 24 20:51:12.353845 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Sep 24 20:51:12.353845 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Sep 24 20:51:12.353845 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Sep 24 20:51:12.353845 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Sep 24 20:51:12.353845 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Sep 24 20:51:12.353845 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Sep 24 20:51:12.353845 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 24 20:51:12.353845 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 24 20:51:12.353845 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Sep 24 20:51:12.353845 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Sep 24 20:51:12.353845 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 33 and project 1dcc95e714424741acb548115f7c0acb combination. Sep 24 20:51:12.353845 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:12.353845 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:12.353845 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:12.360164 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:12.360164 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:12.360164 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:12.360164 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:51:12.360164 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:51:12.360164 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:51:12.360164 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:51:12.360164 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:51:12.360164 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:51:12.360164 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Sep 24 20:51:12.360164 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Sep 24 20:51:12.360164 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 33 and project 1dcc95e714424741acb548115f7c0acb combination. Sep 24 20:51:12.360164 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:12.360164 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:12.360164 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:12.360164 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:12.360164 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:12.360164 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:12.360164 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:51:12.360164 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:51:12.362720 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 33 and project 1dcc95e714424741acb548115f7c0acb combination. Sep 24 20:51:12.362720 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:12.363023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3939f994-7023-4471-b654-f00a67890b19 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:12.364156 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2d9433a3-ec90-4f15-8d7f-b9da8d325f5e tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] Returning 409 to user: Flavor access already exists for flavor 33 and project 1dcc95e714424741acb548115f7c0acb combination. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:51:12.365264 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2d9433a3-ec90-4f15-8d7f-b9da8d325f5e tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/1659065766/action" status: 409 len: 152 microversion: 2.1 time: 0.583623 Sep 24 20:51:12.368631 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 220/428] 10.222.0.52 () {60 vars in 1200 bytes} [Sat Sep 24 20:51:11 2022] POST /compute/v2.1/flavors/1659065766/action => generated 152 bytes in 588 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 24 20:51:12.379298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3939f994-7023-4471-b654-f00a67890b19 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:12.380184 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3939f994-7023-4471-b654-f00a67890b19 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:12.380881 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3939f994-7023-4471-b654-f00a67890b19 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:12.381465 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ff998e7c-196c-4e95-a345-7d137f545421 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:12.382419 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3939f994-7023-4471-b654-f00a67890b19 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:12.383320 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ff998e7c-196c-4e95-a345-7d137f545421 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:12.386887 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3939f994-7023-4471-b654-f00a67890b19 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:12.388389 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3939f994-7023-4471-b654-f00a67890b19 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:12.400041 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff998e7c-196c-4e95-a345-7d137f545421 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:12.405670 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff998e7c-196c-4e95-a345-7d137f545421 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:12.406847 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff998e7c-196c-4e95-a345-7d137f545421 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:12.408728 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff998e7c-196c-4e95-a345-7d137f545421 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:12.409439 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff998e7c-196c-4e95-a345-7d137f545421 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:12.410109 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff998e7c-196c-4e95-a345-7d137f545421 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:12.449008 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:51:12.598023 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ff998e7c-196c-4e95-a345-7d137f545421 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:12.614700 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ff998e7c-196c-4e95-a345-7d137f545421 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:12.617199 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ff998e7c-196c-4e95-a345-7d137f545421 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:12.626362 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ff998e7c-196c-4e95-a345-7d137f545421 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1555 microversion: 2.91 time: 0.254621 Sep 24 20:51:12.628487 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 221/429] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:51:12 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1555 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:51:12.636174 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3dbacc8b-1f69-4e96-b2de-0a28e320062f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:12.637028 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3dbacc8b-1f69-4e96-b2de-0a28e320062f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: 95aa2033-71b1-41a6-b583-2fd183c18242] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:12.644882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3dbacc8b-1f69-4e96-b2de-0a28e320062f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:12.645730 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3dbacc8b-1f69-4e96-b2de-0a28e320062f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:12.646413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3dbacc8b-1f69-4e96-b2de-0a28e320062f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:12.647386 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3dbacc8b-1f69-4e96-b2de-0a28e320062f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:12.648318 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3dbacc8b-1f69-4e96-b2de-0a28e320062f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:12.649803 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3dbacc8b-1f69-4e96-b2de-0a28e320062f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:12.706332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3939f994-7023-4471-b654-f00a67890b19 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:12.716018 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3939f994-7023-4471-b654-f00a67890b19 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5" status: 200 len: 1504 microversion: 2.1 time: 0.385848 Sep 24 20:51:12.717825 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 209/430] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:12 2022] GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 => generated 1504 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:12.739831 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6886b324-3b84-4733-9729-c964fe1009f5 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "1dcc95e714424741acb548115f7c0acb"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:13.022257 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3dbacc8b-1f69-4e96-b2de-0a28e320062f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:13.044046 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3dbacc8b-1f69-4e96-b2de-0a28e320062f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242" status: 200 len: 1313 microversion: 2.1 time: 0.412938 Sep 24 20:51:13.051571 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 222/431] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:12 2022] GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242 => generated 1313 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:13.122523 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-cbc76f53-0048-4cd3-8f65-f8c26b5f8e23 req-6ad0ff7f-02d5-4742-a2b3-e0491da41674 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdb37c4d-e841-4e13-b809-e3f19ce6365a", "tag": "fdfbcb27-4de9-4bdc-b3e7-a1d7e89b3236"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:13.152398 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-cbc76f53-0048-4cd3-8f65-f8c26b5f8e23 req-6ad0ff7f-02d5-4742-a2b3-e0491da41674 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:13.154111 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-cbc76f53-0048-4cd3-8f65-f8c26b5f8e23 req-6ad0ff7f-02d5-4742-a2b3-e0491da41674 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:13.156316 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-cbc76f53-0048-4cd3-8f65-f8c26b5f8e23 req-6ad0ff7f-02d5-4742-a2b3-e0491da41674 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:13.183866 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-cbc76f53-0048-4cd3-8f65-f8c26b5f8e23 req-6ad0ff7f-02d5-4742-a2b3-e0491da41674 service nova] Creating event network-changed:fdfbcb27-4de9-4bdc-b3e7-a1d7e89b3236 for instance bdb37c4d-e841-4e13-b809-e3f19ce6365a on nch2-master-1 Sep 24 20:51:13.190137 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-cbc76f53-0048-4cd3-8f65-f8c26b5f8e23 req-6ad0ff7f-02d5-4742-a2b3-e0491da41674 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073917 Sep 24 20:51:13.191420 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 223/432] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:51:13.334030 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-383a7949-01d2-4c67-84e3-a51f6a97202f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:13.335176 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-383a7949-01d2-4c67-84e3-a51f6a97202f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:13.353668 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-383a7949-01d2-4c67-84e3-a51f6a97202f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:13.354963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-383a7949-01d2-4c67-84e3-a51f6a97202f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:13.356047 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-383a7949-01d2-4c67-84e3-a51f6a97202f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:13.360150 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-383a7949-01d2-4c67-84e3-a51f6a97202f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:13.360942 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-383a7949-01d2-4c67-84e3-a51f6a97202f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:13.362378 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-383a7949-01d2-4c67-84e3-a51f6a97202f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:13.540452 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6886b324-3b84-4733-9729-c964fe1009f5 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/1659065766/action" status: 200 len: 21 microversion: 2.1 time: 0.820626 Sep 24 20:51:13.543242 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 210/433] 10.222.0.52 () {60 vars in 1200 bytes} [Sat Sep 24 20:51:12 2022] POST /compute/v2.1/flavors/1659065766/action => generated 21 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:51:13.553783 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8a012233-f0e9-41fa-ac48-c76c99c8ca59 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:13.601823 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8a012233-f0e9-41fa-ac48-c76c99c8ca59 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1659065766" status: 202 len: 0 microversion: 2.1 time: 0.051642 Sep 24 20:51:13.602830 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 211/434] 10.222.0.52 () {58 vars in 1161 bytes} [Sat Sep 24 20:51:13 2022] DELETE /compute/v2.1/flavors/1659065766 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 20:51:13.612480 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-20de1095-6530-4337-9045-df3ce68a4f04 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:13.681352 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-20de1095-6530-4337-9045-df3ce68a4f04 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.073109 Sep 24 20:51:13.691506 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 212/435] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:51:13 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:13.701093 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4aa82ae4-ae1c-4e09-afdc-aa3bfb04b15c tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:13.701712 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4aa82ae4-ae1c-4e09-afdc-aa3bfb04b15c tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:13.726848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4aa82ae4-ae1c-4e09-afdc-aa3bfb04b15c tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:13.727615 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4aa82ae4-ae1c-4e09-afdc-aa3bfb04b15c tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:13.728283 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4aa82ae4-ae1c-4e09-afdc-aa3bfb04b15c tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:13.730112 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4aa82ae4-ae1c-4e09-afdc-aa3bfb04b15c tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:13.731953 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4aa82ae4-ae1c-4e09-afdc-aa3bfb04b15c tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:13.732558 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4aa82ae4-ae1c-4e09-afdc-aa3bfb04b15c tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:13.767080 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-383a7949-01d2-4c67-84e3-a51f6a97202f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:13.779289 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-383a7949-01d2-4c67-84e3-a51f6a97202f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1476 microversion: 2.1 time: 0.450266 Sep 24 20:51:13.792822 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 224/436] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:13 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1476 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:13.792822 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fe8d29bf-eba1-4112-9f9b-8caa6cc776f9 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-224393171", "id": 695168233, "os-flavor-access:is_public": "True"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:13.835014 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fe8d29bf-eba1-4112-9f9b-8caa6cc776f9 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.044194 Sep 24 20:51:13.835014 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 225/437] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:51:13 2022] POST /compute/v2.1/flavors => generated 434 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:13.844428 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0d647831-94df-4109-91ca-283c933bb7bb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:13.845445 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0d647831-94df-4109-91ca-283c933bb7bb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:13.859430 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d647831-94df-4109-91ca-283c933bb7bb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:13.864052 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d647831-94df-4109-91ca-283c933bb7bb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:13.864602 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d647831-94df-4109-91ca-283c933bb7bb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:13.865531 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d647831-94df-4109-91ca-283c933bb7bb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:13.866073 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d647831-94df-4109-91ca-283c933bb7bb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:13.866921 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d647831-94df-4109-91ca-283c933bb7bb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:13.901209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4aa82ae4-ae1c-4e09-afdc-aa3bfb04b15c tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:13.913306 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4aa82ae4-ae1c-4e09-afdc-aa3bfb04b15c tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:13.917722 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4aa82ae4-ae1c-4e09-afdc-aa3bfb04b15c tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:13.929299 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4aa82ae4-ae1c-4e09-afdc-aa3bfb04b15c tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1555 microversion: 2.91 time: 0.235689 Sep 24 20:51:13.935047 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 213/438] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:51:13 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1555 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:51:13.959309 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ca005e1c-70b9-47f4-aa4d-908da0ba1f94 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:13.983572 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-ca005e1c-70b9-47f4-aa4d-908da0ba1f94 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] HTTP exception thrown: Access list not available for public flavors. Sep 24 20:51:13.989575 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ca005e1c-70b9-47f4-aa4d-908da0ba1f94 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] Request method failure captured: Sep 24 20:51:13.989575 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/flavors/695168233/os-flavor-access HTTP/1.1 Sep 24 20:51:13.989575 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:51:13.989575 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:51:13.989575 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:51:13.989575 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:51:13.989575 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:51:13.989575 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:51:13.989575 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:51:13.989575 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:51:13.989575 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL22872MF5QTO0rpTp0GRkXe3bFObfDHCbCpdIOsFIGvCJJk0bFdziNh1NxTwsJvH0WWTdPdT4GCey5tMAPka5RPV8A5YS8qBSGIXEamSXCHxVfmgpqy0W4IXEmnsT705r1-lswcjv0mtPkvqXeIcPgILb8EjC9Dw1sbL_6iPhIP9VlQ Sep 24 20:51:13.989575 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:51:13.989575 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:51:13.989575 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:51:13.989575 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:51:13.989575 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:51:13.989575 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:51:13.989575 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 37b8d37bcac74b7996617c1561e96c19 Sep 24 20:51:13.989575 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1295882863 Sep 24 20:51:13.989575 ncdv-master-1 devstack@n-api.service[140517]: X-Role: admin,reader,member Sep 24 20:51:13.989575 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: admin,reader,member Sep 24 20:51:13.991228 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/37b8d37bcac74b7996617c1561e96c19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_37b8d37bcac74b7996617c1561e96c19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/37b8d37bcac74b7996617c1561e96c19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/37b8d37bcac74b7996617c1561e96c19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:51:13.991228 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1295882863 Sep 24 20:51:13.991228 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 37b8d37bcac74b7996617c1561e96c19 Sep 24 20:51:13.991228 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1295882863 Sep 24 20:51:13.991228 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin Sep 24 20:51:13.991228 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:51:13.991228 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:51:13.991228 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 830860e6e5aa438ca5e59691022fa2fa Sep 24 20:51:13.991228 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin Sep 24 20:51:13.991228 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:51:13.991228 ncdv-master-1 devstack@n-api.service[140517]: exception: Access list not available for public flavors. Sep 24 20:51:13.991228 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'flavor_id': '695168233'} Sep 24 20:51:13.992110 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:51:13.992110 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:13.992110 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:13.992110 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:13.992110 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:51:13.992110 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:51:13.992110 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:51:13.992110 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:51:13.992110 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Sep 24 20:51:13.992110 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 24 20:51:13.992110 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Sep 24 20:51:13.992110 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:13.992110 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:13.992110 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:13.992110 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:13.992110 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:13.992110 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:13.992110 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:51:13.992110 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:51:13.992110 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Sep 24 20:51:13.992110 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:14.000055 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ca005e1c-70b9-47f4-aa4d-908da0ba1f94 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:51:14.002331 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ca005e1c-70b9-47f4-aa4d-908da0ba1f94 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/695168233/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.066063 Sep 24 20:51:14.003118 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 214/439] 10.222.0.52 () {58 vars in 1206 bytes} [Sat Sep 24 20:51:13 2022] GET /compute/v2.1/flavors/695168233/os-flavor-access => generated 91 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 20:51:14.023955 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cf285835-0163-4b0c-9b74-1ffc5c1b1860 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:14.083038 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cf285835-0163-4b0c-9b74-1ffc5c1b1860 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/695168233" status: 202 len: 0 microversion: 2.1 time: 0.075463 Sep 24 20:51:14.084752 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 215/440] 10.222.0.52 () {58 vars in 1158 bytes} [Sat Sep 24 20:51:14 2022] DELETE /compute/v2.1/flavors/695168233 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:51:14.093701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9172c00e-9d63-4b0b-9ddc-d943b5b3ac85 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:14.101363 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9172c00e-9d63-4b0b-9ddc-d943b5b3ac85 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: 95aa2033-71b1-41a6-b583-2fd183c18242] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:14.111202 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9172c00e-9d63-4b0b-9ddc-d943b5b3ac85 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:14.112251 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9172c00e-9d63-4b0b-9ddc-d943b5b3ac85 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:14.115877 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9172c00e-9d63-4b0b-9ddc-d943b5b3ac85 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:14.117046 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9172c00e-9d63-4b0b-9ddc-d943b5b3ac85 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:14.117735 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9172c00e-9d63-4b0b-9ddc-d943b5b3ac85 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:14.118380 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9172c00e-9d63-4b0b-9ddc-d943b5b3ac85 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:14.192694 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0d647831-94df-4109-91ca-283c933bb7bb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:14.203219 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0d647831-94df-4109-91ca-283c933bb7bb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5" status: 200 len: 1504 microversion: 2.1 time: 0.373051 Sep 24 20:51:14.203820 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 226/441] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:13 2022] GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 => generated 1504 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:14.227077 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d4646d65-21c9-4f34-8ca7-10aec7db7332 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:14.260053 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:51:14.268304 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d4646d65-21c9-4f34-8ca7-10aec7db7332 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.058669 Sep 24 20:51:14.280161 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 227/442] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:51:14 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:14.442717 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9172c00e-9d63-4b0b-9ddc-d943b5b3ac85 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:14.456021 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9172c00e-9d63-4b0b-9ddc-d943b5b3ac85 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242" status: 200 len: 1313 microversion: 2.1 time: 0.369812 Sep 24 20:51:14.457531 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 216/443] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:14 2022] GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242 => generated 1313 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:14.518929 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-327286fc-f822-4396-9e86-440c4496a32a tempest-HypervisorAdminNegativeUnderV252Test-437463789 tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin] Calling method '.version_select at 0x7f4b0cb92b80>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:14.520710 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-327286fc-f822-4396-9e86-440c4496a32a tempest-HypervisorAdminNegativeUnderV252Test-437463789 tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:14.521190 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-327286fc-f822-4396-9e86-440c4496a32a tempest-HypervisorAdminNegativeUnderV252Test-437463789 tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:14.521816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-327286fc-f822-4396-9e86-440c4496a32a tempest-HypervisorAdminNegativeUnderV252Test-437463789 tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:14.551120 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-324e229d-a9e1-4184-97e0-4a81ca8fbd5b tempest-ServicesAdminTestJSON-759348936 tempest-ServicesAdminTestJSON-759348936-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:14.554943 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-324e229d-a9e1-4184-97e0-4a81ca8fbd5b tempest-ServicesAdminTestJSON-759348936 tempest-ServicesAdminTestJSON-759348936-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:14.555430 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-324e229d-a9e1-4184-97e0-4a81ca8fbd5b tempest-ServicesAdminTestJSON-759348936 tempest-ServicesAdminTestJSON-759348936-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:14.557399 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-324e229d-a9e1-4184-97e0-4a81ca8fbd5b tempest-ServicesAdminTestJSON-759348936 tempest-ServicesAdminTestJSON-759348936-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:14.558108 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-327286fc-f822-4396-9e86-440c4496a32a tempest-HypervisorAdminNegativeUnderV252Test-437463789 tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:14.558862 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-327286fc-f822-4396-9e86-440c4496a32a tempest-HypervisorAdminNegativeUnderV252Test-437463789 tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:14.559312 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-327286fc-f822-4396-9e86-440c4496a32a tempest-HypervisorAdminNegativeUnderV252Test-437463789 tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:14.559907 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-324e229d-a9e1-4184-97e0-4a81ca8fbd5b tempest-ServicesAdminTestJSON-759348936 tempest-ServicesAdminTestJSON-759348936-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:14.560537 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-324e229d-a9e1-4184-97e0-4a81ca8fbd5b tempest-ServicesAdminTestJSON-759348936 tempest-ServicesAdminTestJSON-759348936-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:14.561298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-324e229d-a9e1-4184-97e0-4a81ca8fbd5b tempest-ServicesAdminTestJSON-759348936 tempest-ServicesAdminTestJSON-759348936-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:14.572010 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-327286fc-f822-4396-9e86-440c4496a32a tempest-HypervisorAdminNegativeUnderV252Test-437463789 tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:14.574612 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-327286fc-f822-4396-9e86-440c4496a32a tempest-HypervisorAdminNegativeUnderV252Test-437463789 tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:14.575291 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-327286fc-f822-4396-9e86-440c4496a32a tempest-HypervisorAdminNegativeUnderV252Test-437463789 tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:14.585524 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-327286fc-f822-4396-9e86-440c4496a32a tempest-HypervisorAdminNegativeUnderV252Test-437463789 tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.304156 Sep 24 20:51:14.587214 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 228/444] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:51:14 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:14.593065 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a11b5381-1345-456e-b20d-87b15e509429 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1910004140", "id": 608340442, "os-flavor-access:is_public": "False"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:14.600025 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-324e229d-a9e1-4184-97e0-4a81ca8fbd5b tempest-ServicesAdminTestJSON-759348936 tempest-ServicesAdminTestJSON-759348936-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.140396 Sep 24 20:51:14.600922 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 217/445] 10.222.0.52 () {58 vars in 1137 bytes} [Sat Sep 24 20:51:14 2022] GET /compute/v2.1/os-services => generated 947 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:14.619960 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a11b5381-1345-456e-b20d-87b15e509429 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.031085 Sep 24 20:51:14.622646 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 229/446] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:51:14 2022] POST /compute/v2.1/flavors => generated 436 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:14.645790 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-26ea6685-a20a-4e96-865e-163141046ce5 tempest-ServicesAdminTestJSON-759348936 tempest-ServicesAdminTestJSON-759348936-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:14.652358 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26ea6685-a20a-4e96-865e-163141046ce5 tempest-ServicesAdminTestJSON-759348936 tempest-ServicesAdminTestJSON-759348936-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:14.653658 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26ea6685-a20a-4e96-865e-163141046ce5 tempest-ServicesAdminTestJSON-759348936 tempest-ServicesAdminTestJSON-759348936-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:14.654700 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26ea6685-a20a-4e96-865e-163141046ce5 tempest-ServicesAdminTestJSON-759348936 tempest-ServicesAdminTestJSON-759348936-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:14.655641 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26ea6685-a20a-4e96-865e-163141046ce5 tempest-ServicesAdminTestJSON-759348936 tempest-ServicesAdminTestJSON-759348936-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:14.656874 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26ea6685-a20a-4e96-865e-163141046ce5 tempest-ServicesAdminTestJSON-759348936 tempest-ServicesAdminTestJSON-759348936-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:14.657663 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26ea6685-a20a-4e96-865e-163141046ce5 tempest-ServicesAdminTestJSON-759348936 tempest-ServicesAdminTestJSON-759348936-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:14.690567 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-26ea6685-a20a-4e96-865e-163141046ce5 tempest-ServicesAdminTestJSON-759348936 tempest-ServicesAdminTestJSON-759348936-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?host=ncdv-master-1" status: 200 len: 581 microversion: 2.1 time: 0.065548 Sep 24 20:51:14.691468 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 230/447] 10.222.0.52 () {58 vars in 1174 bytes} [Sat Sep 24 20:51:14 2022] GET /compute/v2.1/os-services?host=ncdv-master-1 => generated 581 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:14.758546 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-009c1489-def2-49af-99e9-5b810d3fde8f tempest-HypervisorAdminNegativeUnderV252Test-1704498361 tempest-HypervisorAdminNegativeUnderV252Test-1704498361-project] Calling method '.version_select at 0x7f4b0cf9ad30>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:14.762594 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-009c1489-def2-49af-99e9-5b810d3fde8f tempest-HypervisorAdminNegativeUnderV252Test-1704498361 tempest-HypervisorAdminNegativeUnderV252Test-1704498361-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'c37bbe07404449939f9695f84a4a1138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab231b35cac14739857a122475926f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:14.775227 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-009c1489-def2-49af-99e9-5b810d3fde8f tempest-HypervisorAdminNegativeUnderV252Test-1704498361 tempest-HypervisorAdminNegativeUnderV252Test-1704498361-project] Request method failure captured: Sep 24 20:51:14.775227 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/os-hypervisors/nch1-master-1/search HTTP/1.1 Sep 24 20:51:14.775227 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:51:14.775227 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:51:14.775227 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:51:14.775227 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:51:14.775227 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:51:14.775227 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:51:14.775227 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:51:14.775227 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:51:14.775227 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL23ASk544WtR8_YdcUOMFKVnESrwaDpJrTd2_UIRPcNb_E4TD0mgTq1aoZHT2KAOEwGmLC8G0epdlGsOOjmAaNIRR-iapy55D2_rpR_-7msLblCIPmBx1ZbZwAPrZ3x49oDOb_gA-7VqtMVun4PlfurM_72dtKIBZuvvr9Sx6F3I7ss Sep 24 20:51:14.775227 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:51:14.775227 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:51:14.775227 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:51:14.775227 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:51:14.775227 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:51:14.775227 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:51:14.775227 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: ab231b35cac14739857a122475926f75 Sep 24 20:51:14.775227 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1704498361 Sep 24 20:51:14.775227 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:51:14.775227 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:51:14.777187 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ab231b35cac14739857a122475926f75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ab231b35cac14739857a122475926f75"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ab231b35cac14739857a122475926f75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ab231b35cac14739857a122475926f75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:51:14.777187 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1704498361 Sep 24 20:51:14.777187 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: ab231b35cac14739857a122475926f75 Sep 24 20:51:14.777187 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1704498361 Sep 24 20:51:14.777187 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1704498361-project Sep 24 20:51:14.777187 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:51:14.777187 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:51:14.777187 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: c37bbe07404449939f9695f84a4a1138 Sep 24 20:51:14.777187 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1704498361-project Sep 24 20:51:14.777187 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 20:51:14.777187 ncdv-master-1 devstack@n-api.service[140517]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 24 20:51:14.777187 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'nch1-master-1'} Sep 24 20:51:14.777936 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:51:14.777936 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:14.777936 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:14.777936 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:14.777936 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:51:14.777936 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:51:14.777936 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:51:14.777936 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:51:14.777936 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:51:14.777936 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:51:14.777936 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Sep 24 20:51:14.777936 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Sep 24 20:51:14.777936 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 24 20:51:14.777936 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 24 20:51:14.777936 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 24 20:51:14.777936 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 24 20:51:14.777936 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:51:14.777936 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:51:14.777936 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:51:14.779091 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:51:14.779091 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 24 20:51:14.779091 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 24 20:51:14.779091 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 24 20:51:14.779091 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 24 20:51:14.779091 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 24 20:51:14.779091 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 24 20:51:14.779091 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 24 20:51:14.779091 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:14.779091 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:14.779091 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:14.779091 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:14.779091 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:14.779091 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:14.779091 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 24 20:51:14.779091 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 24 20:51:14.779091 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 24 20:51:14.779091 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:14.780129 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-009c1489-def2-49af-99e9-5b810d3fde8f tempest-HypervisorAdminNegativeUnderV252Test-1704498361 tempest-HypervisorAdminNegativeUnderV252Test-1704498361-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:51:14.780129 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-009c1489-def2-49af-99e9-5b810d3fde8f tempest-HypervisorAdminNegativeUnderV252Test-1704498361 tempest-HypervisorAdminNegativeUnderV252Test-1704498361-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/nch1-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.177878 Sep 24 20:51:14.785625 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 218/448] 10.222.0.52 () {58 vars in 1209 bytes} [Sat Sep 24 20:51:14 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/search => generated 117 bytes in 184 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:51:14.799013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-02bd28de-cf29-40af-9ba1-49e1cfaca60e tempest-ServicesAdminTestJSON-759348936 tempest-ServicesAdminTestJSON-759348936-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:14.802700 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-02bd28de-cf29-40af-9ba1-49e1cfaca60e tempest-ServicesAdminTestJSON-759348936 tempest-ServicesAdminTestJSON-759348936-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:14.808599 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-02bd28de-cf29-40af-9ba1-49e1cfaca60e tempest-ServicesAdminTestJSON-759348936 tempest-ServicesAdminTestJSON-759348936-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:14.813912 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-02bd28de-cf29-40af-9ba1-49e1cfaca60e tempest-ServicesAdminTestJSON-759348936 tempest-ServicesAdminTestJSON-759348936-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:14.815009 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-02bd28de-cf29-40af-9ba1-49e1cfaca60e tempest-ServicesAdminTestJSON-759348936 tempest-ServicesAdminTestJSON-759348936-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:14.815696 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-02bd28de-cf29-40af-9ba1-49e1cfaca60e tempest-ServicesAdminTestJSON-759348936 tempest-ServicesAdminTestJSON-759348936-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:14.816295 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-02bd28de-cf29-40af-9ba1-49e1cfaca60e tempest-ServicesAdminTestJSON-759348936 tempest-ServicesAdminTestJSON-759348936-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:14.865464 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-02bd28de-cf29-40af-9ba1-49e1cfaca60e tempest-ServicesAdminTestJSON-759348936 tempest-ServicesAdminTestJSON-759348936-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.078449 Sep 24 20:51:14.866820 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 219/449] 10.222.0.52 () {58 vars in 1176 bytes} [Sat Sep 24 20:51:14 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:14.878222 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-735f07d1-637e-4f04-956c-6e427313a877 tempest-HypervisorAdminNegativeUnderV252Test-437463789 tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin] Calling method '.version_select at 0x7f4b0cfb20d0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:14.880243 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-735f07d1-637e-4f04-956c-6e427313a877 tempest-HypervisorAdminNegativeUnderV252Test-437463789 tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:14.880877 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-735f07d1-637e-4f04-956c-6e427313a877 tempest-HypervisorAdminNegativeUnderV252Test-437463789 tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:14.881549 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-735f07d1-637e-4f04-956c-6e427313a877 tempest-HypervisorAdminNegativeUnderV252Test-437463789 tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:14.892265 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-735f07d1-637e-4f04-956c-6e427313a877 tempest-HypervisorAdminNegativeUnderV252Test-437463789 tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 24 20:51:14.892823 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-072a0a6e-ffdb-438d-b7b6-779d0c1189a9 tempest-FlavorsAccessNegativeTestJSON-1802217241 tempest-FlavorsAccessNegativeTestJSON-1802217241-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "1dcc95e714424741acb548115f7c0acb"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:14.893634 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-735f07d1-637e-4f04-956c-6e427313a877 tempest-HypervisorAdminNegativeUnderV252Test-437463789 tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin] Request method failure captured: Sep 24 20:51:14.893634 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Sep 24 20:51:14.893634 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:51:14.893634 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:51:14.893634 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:51:14.893634 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:51:14.893634 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:51:14.893634 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:51:14.893634 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:51:14.893634 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:51:14.893634 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL23BkHaDDIhhu1krK4X9ILIPvny0EkXP8i3x4Mc8sqJQ4lS52A1LYDGgNVCLcfMi8Lfjv3GIlmTlZVDmP9Z6gV_fOJtx3q8yCTT1ApjY8Tl4ZSYVZMw2KP-9gb9BICpPX4W9wfOjCDS8E_TR98qOK2xZ4SHQ61toMwH9uyVww0EVrMQ Sep 24 20:51:14.893634 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:51:14.893634 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:51:14.893634 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:51:14.893634 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:51:14.893634 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:51:14.893634 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:51:14.893634 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 34df17012cfa4196bb99da22825c58c5 Sep 24 20:51:14.893634 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-437463789 Sep 24 20:51:14.893634 ncdv-master-1 devstack@n-api.service[140517]: X-Role: admin,reader,member Sep 24 20:51:14.893634 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: admin,reader,member Sep 24 20:51:14.895193 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34df17012cfa4196bb99da22825c58c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34df17012cfa4196bb99da22825c58c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34df17012cfa4196bb99da22825c58c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34df17012cfa4196bb99da22825c58c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:51:14.895193 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-437463789 Sep 24 20:51:14.895193 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 34df17012cfa4196bb99da22825c58c5 Sep 24 20:51:14.895193 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-437463789 Sep 24 20:51:14.895193 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin Sep 24 20:51:14.895193 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:51:14.895193 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:51:14.895193 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 97a178801189432d831041a94f2d95b5 Sep 24 20:51:14.895193 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin Sep 24 20:51:14.895193 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 20:51:14.895193 ncdv-master-1 devstack@n-api.service[140517]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 24 20:51:14.895193 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'nonexistent_hypervisor_name'} Sep 24 20:51:14.895894 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:51:14.895894 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:14.895894 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:14.895894 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:14.895894 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:51:14.895894 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:51:14.895894 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:51:14.895894 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:51:14.895894 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:51:14.895894 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:51:14.895894 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Sep 24 20:51:14.895894 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 24 20:51:14.895894 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 24 20:51:14.895894 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 24 20:51:14.895894 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 24 20:51:14.895894 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:14.895894 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:14.895894 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:14.895894 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:14.895894 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:14.896968 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:14.896968 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:51:14.896968 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:51:14.896968 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 24 20:51:14.896968 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:14.896968 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-735f07d1-637e-4f04-956c-6e427313a877 tempest-HypervisorAdminNegativeUnderV252Test-437463789 tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:51:14.896968 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-735f07d1-637e-4f04-956c-6e427313a877 tempest-HypervisorAdminNegativeUnderV252Test-437463789 tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.027175 Sep 24 20:51:14.897386 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-072a0a6e-ffdb-438d-b7b6-779d0c1189a9 tempest-FlavorsAccessNegativeTestJSON-1802217241 tempest-FlavorsAccessNegativeTestJSON-1802217241-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '3f421dbad8b14e2186421e1278d3a875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcc95e714424741acb548115f7c0acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:14.898253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-072a0a6e-ffdb-438d-b7b6-779d0c1189a9 tempest-FlavorsAccessNegativeTestJSON-1802217241 tempest-FlavorsAccessNegativeTestJSON-1802217241-project] Request method failure captured: Sep 24 20:51:14.898253 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/flavors/608340442/action HTTP/1.1 Sep 24 20:51:14.898253 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:51:14.898253 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:51:14.898253 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:51:14.898253 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 67 Sep 24 20:51:14.898253 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:51:14.898253 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:51:14.898253 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:51:14.898253 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:51:14.898253 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL227C6NYom3KUHDuRamE6StFavheXBlHg4wRW-uykVHhkiWqxItTIniZ-jyNuPS-BK-twmjX60hYqY2H4-BHLwKFRXGqqEJtJETO-68Ls8uV3zp1ictTA8hLjHcTMMoScanecQZm5hEnHiuhTHsQ9GPHuHr1nzDowIk9In86IpvAHGs Sep 24 20:51:14.898253 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:51:14.898253 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:51:14.898253 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:51:14.898253 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:51:14.898253 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:51:14.898253 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:51:14.898253 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 1dcc95e714424741acb548115f7c0acb Sep 24 20:51:14.898253 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1802217241 Sep 24 20:51:14.898253 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:51:14.898253 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:51:14.901900 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1dcc95e714424741acb548115f7c0acb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1dcc95e714424741acb548115f7c0acb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1dcc95e714424741acb548115f7c0acb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1dcc95e714424741acb548115f7c0acb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:51:14.901900 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1802217241 Sep 24 20:51:14.901900 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 1dcc95e714424741acb548115f7c0acb Sep 24 20:51:14.901900 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1802217241 Sep 24 20:51:14.901900 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-FlavorsAccessNegativeTestJSON-1802217241-project Sep 24 20:51:14.901900 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:51:14.901900 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:51:14.901900 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 3f421dbad8b14e2186421e1278d3a875 Sep 24 20:51:14.901900 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1802217241-project Sep 24 20:51:14.901900 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 20:51:14.901900 ncdv-master-1 devstack@n-api.service[140516]: {"addTenantAccess": {"tenant": "1dcc95e714424741acb548115f7c0acb"}} Sep 24 20:51:14.901900 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:51:14.903853 ncdv-master-1 devstack@n-api.service[140516]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 24 20:51:14.903853 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '608340442', 'body': {'addTenantAccess': {'tenant': '1dcc95e714424741acb548115f7c0acb'}}} Sep 24 20:51:14.903853 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:51:14.903853 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:14.903853 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:14.903853 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:14.903853 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:51:14.903853 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:51:14.903853 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:51:14.903853 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:51:14.903853 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:51:14.903853 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:51:14.903853 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Sep 24 20:51:14.903853 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Sep 24 20:51:14.903853 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 24 20:51:14.903853 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 24 20:51:14.903853 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 24 20:51:14.903853 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 24 20:51:14.903853 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:51:14.906812 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:51:14.906812 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:51:14.906812 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:51:14.906812 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 24 20:51:14.906812 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 24 20:51:14.906812 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 24 20:51:14.906812 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 24 20:51:14.906812 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 24 20:51:14.906812 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 24 20:51:14.906812 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 24 20:51:14.906812 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:14.906812 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:14.906812 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:14.906812 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:14.906812 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:14.906812 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:14.906812 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 24 20:51:14.906812 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 24 20:51:14.906812 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 24 20:51:14.906812 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:14.909483 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-072a0a6e-ffdb-438d-b7b6-779d0c1189a9 tempest-FlavorsAccessNegativeTestJSON-1802217241 tempest-FlavorsAccessNegativeTestJSON-1802217241-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:51:14.909483 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-072a0a6e-ffdb-438d-b7b6-779d0c1189a9 tempest-FlavorsAccessNegativeTestJSON-1802217241 tempest-FlavorsAccessNegativeTestJSON-1802217241-project] 10.222.0.52 "POST /compute/v2.1/flavors/608340442/action" status: 403 len: 130 microversion: 2.1 time: 0.206901 Sep 24 20:51:14.909483 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 231/450] 10.222.0.52 () {60 vars in 1197 bytes} [Sat Sep 24 20:51:14 2022] POST /compute/v2.1/flavors/608340442/action => generated 130 bytes in 208 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:51:14.910172 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 220/451] 10.222.0.52 () {58 vars in 1251 bytes} [Sat Sep 24 20:51:14 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:51:14.911094 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9783734d-8929-455e-bdec-ab4222371800 tempest-ServicesAdminTestJSON-759348936 tempest-ServicesAdminTestJSON-759348936-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:14.913278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-95138144-da17-43d6-86b6-4ec8f7d21591 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:14.913907 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-95138144-da17-43d6-86b6-4ec8f7d21591 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:14.914817 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9783734d-8929-455e-bdec-ab4222371800 tempest-ServicesAdminTestJSON-759348936 tempest-ServicesAdminTestJSON-759348936-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:14.915310 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9783734d-8929-455e-bdec-ab4222371800 tempest-ServicesAdminTestJSON-759348936 tempest-ServicesAdminTestJSON-759348936-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:14.915749 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9783734d-8929-455e-bdec-ab4222371800 tempest-ServicesAdminTestJSON-759348936 tempest-ServicesAdminTestJSON-759348936-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:14.917590 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9783734d-8929-455e-bdec-ab4222371800 tempest-ServicesAdminTestJSON-759348936 tempest-ServicesAdminTestJSON-759348936-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:14.918055 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9783734d-8929-455e-bdec-ab4222371800 tempest-ServicesAdminTestJSON-759348936 tempest-ServicesAdminTestJSON-759348936-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:14.918554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9783734d-8929-455e-bdec-ab4222371800 tempest-ServicesAdminTestJSON-759348936 tempest-ServicesAdminTestJSON-759348936-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:14.930444 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-95138144-da17-43d6-86b6-4ec8f7d21591 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:14.930974 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-95138144-da17-43d6-86b6-4ec8f7d21591 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:14.931419 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-95138144-da17-43d6-86b6-4ec8f7d21591 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:14.935826 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-95138144-da17-43d6-86b6-4ec8f7d21591 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:14.938723 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-95138144-da17-43d6-86b6-4ec8f7d21591 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:14.940075 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-95138144-da17-43d6-86b6-4ec8f7d21591 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:14.944304 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9783734d-8929-455e-bdec-ab4222371800 tempest-ServicesAdminTestJSON-759348936 tempest-ServicesAdminTestJSON-759348936-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.036853 Sep 24 20:51:14.945401 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 221/452] 10.222.0.52 () {58 vars in 1137 bytes} [Sat Sep 24 20:51:14 2022] GET /compute/v2.1/os-services => generated 947 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:14.960862 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d3eaa786-0978-438b-bf29-2da7393db7a3 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:14.974679 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5,nova_api:DELETE=7 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:51:14.986019 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d3eaa786-0978-438b-bf29-2da7393db7a3 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/608340442" status: 202 len: 0 microversion: 2.1 time: 0.039242 Sep 24 20:51:14.987159 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 222/453] 10.222.0.52 () {58 vars in 1158 bytes} [Sat Sep 24 20:51:14 2022] DELETE /compute/v2.1/flavors/608340442 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:51:14.996293 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-065d0554-24d6-474a-a44b-79fc56e3ba89 tempest-HypervisorAdminNegativeUnderV252Test-437463789 tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin] Calling method '.version_select at 0x7f4b0cf9ab80>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:14.998678 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-065d0554-24d6-474a-a44b-79fc56e3ba89 tempest-HypervisorAdminNegativeUnderV252Test-437463789 tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:14.999361 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-065d0554-24d6-474a-a44b-79fc56e3ba89 tempest-HypervisorAdminNegativeUnderV252Test-437463789 tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:14.999997 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-065d0554-24d6-474a-a44b-79fc56e3ba89 tempest-HypervisorAdminNegativeUnderV252Test-437463789 tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:15.020894 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-065d0554-24d6-474a-a44b-79fc56e3ba89 tempest-HypervisorAdminNegativeUnderV252Test-437463789 tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:15.021971 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-065d0554-24d6-474a-a44b-79fc56e3ba89 tempest-HypervisorAdminNegativeUnderV252Test-437463789 tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:15.022677 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-065d0554-24d6-474a-a44b-79fc56e3ba89 tempest-HypervisorAdminNegativeUnderV252Test-437463789 tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:15.035072 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-065d0554-24d6-474a-a44b-79fc56e3ba89 tempest-HypervisorAdminNegativeUnderV252Test-437463789 tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:15.038094 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-065d0554-24d6-474a-a44b-79fc56e3ba89 tempest-HypervisorAdminNegativeUnderV252Test-437463789 tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:15.046865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-065d0554-24d6-474a-a44b-79fc56e3ba89 tempest-HypervisorAdminNegativeUnderV252Test-437463789 tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:15.065808 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-065d0554-24d6-474a-a44b-79fc56e3ba89 tempest-HypervisorAdminNegativeUnderV252Test-437463789 tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.074209 Sep 24 20:51:15.077010 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 223/454] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:51:14 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:15.082133 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-79e192f3-2ba5-467c-b844-45cabf1e388d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:15.082768 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-79e192f3-2ba5-467c-b844-45cabf1e388d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:15.103579 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79e192f3-2ba5-467c-b844-45cabf1e388d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:15.104939 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79e192f3-2ba5-467c-b844-45cabf1e388d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:15.105574 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79e192f3-2ba5-467c-b844-45cabf1e388d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:15.107655 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79e192f3-2ba5-467c-b844-45cabf1e388d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:15.111249 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79e192f3-2ba5-467c-b844-45cabf1e388d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:15.112175 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79e192f3-2ba5-467c-b844-45cabf1e388d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:15.287928 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-79e192f3-2ba5-467c-b844-45cabf1e388d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:15.306044 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-79e192f3-2ba5-467c-b844-45cabf1e388d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:15.311317 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-79e192f3-2ba5-467c-b844-45cabf1e388d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:15.326127 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-79e192f3-2ba5-467c-b844-45cabf1e388d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1555 microversion: 2.91 time: 0.247690 Sep 24 20:51:15.327642 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 224/455] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:51:15 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1555 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:51:15.333403 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c5a0f5c9-83f1-4174-8c8e-f11d3a6f48e5 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:15.357577 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-95138144-da17-43d6-86b6-4ec8f7d21591 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:15.366045 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c5a0f5c9-83f1-4174-8c8e-f11d3a6f48e5 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.036882 Sep 24 20:51:15.366522 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-95138144-da17-43d6-86b6-4ec8f7d21591 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1476 microversion: 2.1 time: 0.465425 Sep 24 20:51:15.371811 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 232/456] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:14 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1476 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:15.375327 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 225/457] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:51:15 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:15.382766 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d7e26a37-7eac-48cf-9581-c03d4e8f6857 tempest-HypervisorAdminNegativeUnderV252Test-1704498361 tempest-HypervisorAdminNegativeUnderV252Test-1704498361-project] Calling method '.version_select at 0x7f4b0ca29e50>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:15.388283 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d7e26a37-7eac-48cf-9581-c03d4e8f6857 tempest-HypervisorAdminNegativeUnderV252Test-1704498361 tempest-HypervisorAdminNegativeUnderV252Test-1704498361-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'c37bbe07404449939f9695f84a4a1138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab231b35cac14739857a122475926f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:15.392626 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3df92c9c-1ad5-4c05-8d62-722de8b31de3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:15.392794 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d7e26a37-7eac-48cf-9581-c03d4e8f6857 tempest-HypervisorAdminNegativeUnderV252Test-1704498361 tempest-HypervisorAdminNegativeUnderV252Test-1704498361-project] Request method failure captured: Sep 24 20:51:15.392794 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Sep 24 20:51:15.392794 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:51:15.392794 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:51:15.392794 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:51:15.392794 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:51:15.392794 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:51:15.392794 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:51:15.392794 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:51:15.392794 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:51:15.392794 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL23ASk544WtR8_YdcUOMFKVnESrwaDpJrTd2_UIRPcNb_E4TD0mgTq1aoZHT2KAOEwGmLC8G0epdlGsOOjmAaNIRR-iapy55D2_rpR_-7msLblCIPmBx1ZbZwAPrZ3x49oDOb_gA-7VqtMVun4PlfurM_72dtKIBZuvvr9Sx6F3I7ss Sep 24 20:51:15.392794 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:51:15.392794 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:51:15.392794 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:51:15.392794 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:51:15.392794 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:51:15.392794 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:51:15.392794 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: ab231b35cac14739857a122475926f75 Sep 24 20:51:15.392794 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1704498361 Sep 24 20:51:15.392794 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:51:15.392794 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:51:15.393982 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ab231b35cac14739857a122475926f75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ab231b35cac14739857a122475926f75"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ab231b35cac14739857a122475926f75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ab231b35cac14739857a122475926f75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:51:15.393982 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1704498361 Sep 24 20:51:15.393982 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: ab231b35cac14739857a122475926f75 Sep 24 20:51:15.393982 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1704498361 Sep 24 20:51:15.393982 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1704498361-project Sep 24 20:51:15.393982 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:51:15.393982 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:51:15.393982 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: c37bbe07404449939f9695f84a4a1138 Sep 24 20:51:15.393982 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1704498361-project Sep 24 20:51:15.393982 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:51:15.393982 ncdv-master-1 devstack@n-api.service[140516]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 24 20:51:15.393982 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '1'} Sep 24 20:51:15.394700 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:51:15.394700 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:15.394700 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:15.394700 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:15.394700 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:51:15.394700 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:51:15.394700 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:51:15.394700 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:51:15.394700 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:51:15.394700 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:51:15.394700 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Sep 24 20:51:15.394700 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Sep 24 20:51:15.394700 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 24 20:51:15.394700 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 24 20:51:15.394700 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 24 20:51:15.394700 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 24 20:51:15.394700 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:51:15.394700 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:51:15.394700 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:51:15.395830 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:51:15.395830 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 24 20:51:15.395830 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 24 20:51:15.395830 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 24 20:51:15.395830 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 24 20:51:15.395830 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 24 20:51:15.395830 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 24 20:51:15.395830 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 24 20:51:15.395830 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:15.395830 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:15.395830 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:15.395830 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:15.395830 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:15.395830 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:15.395830 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 24 20:51:15.395830 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 24 20:51:15.395830 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 24 20:51:15.395830 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:15.396827 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d7e26a37-7eac-48cf-9581-c03d4e8f6857 tempest-HypervisorAdminNegativeUnderV252Test-1704498361 tempest-HypervisorAdminNegativeUnderV252Test-1704498361-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:51:15.396827 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d7e26a37-7eac-48cf-9581-c03d4e8f6857 tempest-HypervisorAdminNegativeUnderV252Test-1704498361 tempest-HypervisorAdminNegativeUnderV252Test-1704498361-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.022322 Sep 24 20:51:15.397294 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 233/458] 10.222.0.52 () {58 vars in 1176 bytes} [Sat Sep 24 20:51:15 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:51:15.403897 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3df92c9c-1ad5-4c05-8d62-722de8b31de3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:15.411446 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-d4ad0ab3-b2ad-4f38-9cec-6eec9ad0f90f req-b68b6de6-43de-432a-82e8-32992a75f82c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8164fcd2-b47c-4b73-b5f3-4e71615a3ec5", "name": "network-vif-unplugged", "status": "completed", "tag": "7f54b87f-432c-4333-a0ed-d461564390c4"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:15.420313 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3df92c9c-1ad5-4c05-8d62-722de8b31de3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:15.421187 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3df92c9c-1ad5-4c05-8d62-722de8b31de3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:15.421858 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3df92c9c-1ad5-4c05-8d62-722de8b31de3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:15.422914 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3df92c9c-1ad5-4c05-8d62-722de8b31de3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:15.423693 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3df92c9c-1ad5-4c05-8d62-722de8b31de3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:15.424873 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3df92c9c-1ad5-4c05-8d62-722de8b31de3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:15.439675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d4ad0ab3-b2ad-4f38-9cec-6eec9ad0f90f req-b68b6de6-43de-432a-82e8-32992a75f82c service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:15.440522 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d4ad0ab3-b2ad-4f38-9cec-6eec9ad0f90f req-b68b6de6-43de-432a-82e8-32992a75f82c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:15.441101 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d4ad0ab3-b2ad-4f38-9cec-6eec9ad0f90f req-b68b6de6-43de-432a-82e8-32992a75f82c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:15.466873 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-d4ad0ab3-b2ad-4f38-9cec-6eec9ad0f90f req-b68b6de6-43de-432a-82e8-32992a75f82c service nova] Creating event network-vif-unplugged:7f54b87f-432c-4333-a0ed-d461564390c4 for instance 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 on nch1-master-1 Sep 24 20:51:15.480949 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-d4ad0ab3-b2ad-4f38-9cec-6eec9ad0f90f req-b68b6de6-43de-432a-82e8-32992a75f82c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080121 Sep 24 20:51:15.481995 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 234/459] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:15.497547 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7e57200f-2070-49a5-ab2e-e42b513c76fe tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-123901055", "id": 73302870, "os-flavor-access:is_public": "False"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:15.539552 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7e57200f-2070-49a5-ab2e-e42b513c76fe tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 432 microversion: 2.1 time: 0.053736 Sep 24 20:51:15.548496 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 235/460] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:51:15 2022] POST /compute/v2.1/flavors => generated 432 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:15.554988 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-32757343-212b-4a30-b7a2-32545ddf94c3 tempest-HypervisorAdminNegativeUnderV252Test-437463789 tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin] Calling method '.version_select at 0x7f4b0ca29550>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:15.557569 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-32757343-212b-4a30-b7a2-32545ddf94c3 tempest-HypervisorAdminNegativeUnderV252Test-437463789 tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:15.559511 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-32757343-212b-4a30-b7a2-32545ddf94c3 tempest-HypervisorAdminNegativeUnderV252Test-437463789 tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:15.559970 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-32757343-212b-4a30-b7a2-32545ddf94c3 tempest-HypervisorAdminNegativeUnderV252Test-437463789 tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:15.570483 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-32757343-212b-4a30-b7a2-32545ddf94c3 tempest-HypervisorAdminNegativeUnderV252Test-437463789 tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin] HTTP exception thrown: No hypervisor matching '6eac4fd8-8fc8-4696-854e-2e56ca736033' could be found. Sep 24 20:51:15.574025 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-32757343-212b-4a30-b7a2-32545ddf94c3 tempest-HypervisorAdminNegativeUnderV252Test-437463789 tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin] Request method failure captured: Sep 24 20:51:15.574025 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/os-hypervisors/6eac4fd8-8fc8-4696-854e-2e56ca736033/servers HTTP/1.1 Sep 24 20:51:15.574025 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:51:15.574025 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:51:15.574025 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:51:15.574025 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:51:15.574025 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:51:15.574025 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:51:15.574025 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:51:15.574025 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:51:15.574025 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL23BkHaDDIhhu1krK4X9ILIPvny0EkXP8i3x4Mc8sqJQ4lS52A1LYDGgNVCLcfMi8Lfjv3GIlmTlZVDmP9Z6gV_fOJtx3q8yCTT1ApjY8Tl4ZSYVZMw2KP-9gb9BICpPX4W9wfOjCDS8E_TR98qOK2xZ4SHQ61toMwH9uyVww0EVrMQ Sep 24 20:51:15.574025 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:51:15.574025 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:51:15.574025 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:51:15.574025 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:51:15.574025 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:51:15.574025 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:51:15.574025 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 34df17012cfa4196bb99da22825c58c5 Sep 24 20:51:15.574025 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-437463789 Sep 24 20:51:15.574025 ncdv-master-1 devstack@n-api.service[140516]: X-Role: admin,reader,member Sep 24 20:51:15.574025 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: admin,reader,member Sep 24 20:51:15.575501 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34df17012cfa4196bb99da22825c58c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34df17012cfa4196bb99da22825c58c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34df17012cfa4196bb99da22825c58c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34df17012cfa4196bb99da22825c58c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:51:15.575501 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-437463789 Sep 24 20:51:15.575501 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 34df17012cfa4196bb99da22825c58c5 Sep 24 20:51:15.575501 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-437463789 Sep 24 20:51:15.575501 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin Sep 24 20:51:15.575501 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:51:15.575501 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:51:15.575501 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 97a178801189432d831041a94f2d95b5 Sep 24 20:51:15.575501 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin Sep 24 20:51:15.575501 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:51:15.575501 ncdv-master-1 devstack@n-api.service[140516]: exception: No hypervisor matching '6eac4fd8-8fc8-4696-854e-2e56ca736033' could be found. Sep 24 20:51:15.575501 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '6eac4fd8-8fc8-4696-854e-2e56ca736033'} Sep 24 20:51:15.576259 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:51:15.576259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:15.576259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:15.576259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:15.576259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:51:15.576259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:51:15.576259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:51:15.576259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:51:15.576259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:51:15.576259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:51:15.576259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Sep 24 20:51:15.576259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 24 20:51:15.576259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 24 20:51:15.576259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 24 20:51:15.576259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '6eac4fd8-8fc8-4696-854e-2e56ca736033' could be found. Sep 24 20:51:15.576259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:15.576259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:15.576259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:15.576259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:15.577287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:15.577287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:15.577287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:51:15.577287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:51:15.577287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '6eac4fd8-8fc8-4696-854e-2e56ca736033' could be found. Sep 24 20:51:15.577287 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:15.581665 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-32757343-212b-4a30-b7a2-32545ddf94c3 tempest-HypervisorAdminNegativeUnderV252Test-437463789 tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin] Returning 404 to user: No hypervisor matching '6eac4fd8-8fc8-4696-854e-2e56ca736033' could be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:51:15.582768 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-32757343-212b-4a30-b7a2-32545ddf94c3 tempest-HypervisorAdminNegativeUnderV252Test-437463789 tempest-HypervisorAdminNegativeUnderV252Test-437463789-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/6eac4fd8-8fc8-4696-854e-2e56ca736033/servers" status: 404 len: 123 microversion: 2.1 time: 0.032492 Sep 24 20:51:15.587344 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 236/461] 10.222.0.52 () {58 vars in 1281 bytes} [Sat Sep 24 20:51:15 2022] GET /compute/v2.1/os-hypervisors/6eac4fd8-8fc8-4696-854e-2e56ca736033/servers => generated 123 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:51:15.607292 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8c4a3ce9-2081-48e3-9a7e-07ced9be4712 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:15.613633 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8c4a3ce9-2081-48e3-9a7e-07ced9be4712 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: 95aa2033-71b1-41a6-b583-2fd183c18242] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:15.633842 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c4a3ce9-2081-48e3-9a7e-07ced9be4712 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:15.637962 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c4a3ce9-2081-48e3-9a7e-07ced9be4712 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:15.638654 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c4a3ce9-2081-48e3-9a7e-07ced9be4712 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:15.639900 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c4a3ce9-2081-48e3-9a7e-07ced9be4712 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:15.642722 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c4a3ce9-2081-48e3-9a7e-07ced9be4712 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:15.643343 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c4a3ce9-2081-48e3-9a7e-07ced9be4712 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:15.728735 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3df92c9c-1ad5-4c05-8d62-722de8b31de3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:15.741526 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3df92c9c-1ad5-4c05-8d62-722de8b31de3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5" status: 200 len: 1504 microversion: 2.1 time: 0.364830 Sep 24 20:51:15.743731 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 226/462] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:15 2022] GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 => generated 1504 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:15.774953 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ae590de4-5d3d-47bf-8265-18b0c26efebf tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "1dcc95e714424741acb548115f7c0acb"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:16.515436 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8c4a3ce9-2081-48e3-9a7e-07ced9be4712 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:16.536037 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8c4a3ce9-2081-48e3-9a7e-07ced9be4712 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242" status: 200 len: 1313 microversion: 2.1 time: 0.943226 Sep 24 20:51:16.537158 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 237/463] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:15 2022] GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242 => generated 1313 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:16.546603 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3903b726-1d8a-447d-8096-930002456b35 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:16.554392 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3903b726-1d8a-447d-8096-930002456b35 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:16.570599 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3903b726-1d8a-447d-8096-930002456b35 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:16.588793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3903b726-1d8a-447d-8096-930002456b35 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:16.589744 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3903b726-1d8a-447d-8096-930002456b35 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:16.591764 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3903b726-1d8a-447d-8096-930002456b35 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:16.595083 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3903b726-1d8a-447d-8096-930002456b35 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:16.596141 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3903b726-1d8a-447d-8096-930002456b35 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:16.677100 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ae590de4-5d3d-47bf-8265-18b0c26efebf tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/73302870/action" status: 200 len: 95 microversion: 2.1 time: 0.914628 Sep 24 20:51:16.694330 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 227/464] 10.222.0.52 () {60 vars in 1194 bytes} [Sat Sep 24 20:51:15 2022] POST /compute/v2.1/flavors/73302870/action => generated 95 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:51:16.696352 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-feef4204-eba9-4a86-9c49-d4f70c5c53df tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:16.697275 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-feef4204-eba9-4a86-9c49-d4f70c5c53df tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:16.727644 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-feef4204-eba9-4a86-9c49-d4f70c5c53df tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:16.728514 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-feef4204-eba9-4a86-9c49-d4f70c5c53df tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:16.729230 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-feef4204-eba9-4a86-9c49-d4f70c5c53df tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:16.732305 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-feef4204-eba9-4a86-9c49-d4f70c5c53df tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:16.735645 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-feef4204-eba9-4a86-9c49-d4f70c5c53df tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:16.736426 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-feef4204-eba9-4a86-9c49-d4f70c5c53df tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:16.752870 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3903b726-1d8a-447d-8096-930002456b35 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:16.764174 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3903b726-1d8a-447d-8096-930002456b35 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:16.765906 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3903b726-1d8a-447d-8096-930002456b35 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:16.775758 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3903b726-1d8a-447d-8096-930002456b35 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1555 microversion: 2.91 time: 0.236410 Sep 24 20:51:16.777133 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 238/465] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:51:16 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1555 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:51:16.795859 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-90ebc46c-e3b7-44cc-be19-9a1900d5fc01 tempest-FlavorsAccessNegativeTestJSON-1802217241 tempest-FlavorsAccessNegativeTestJSON-1802217241-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "1dcc95e714424741acb548115f7c0acb"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:16.799681 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-90ebc46c-e3b7-44cc-be19-9a1900d5fc01 tempest-FlavorsAccessNegativeTestJSON-1802217241 tempest-FlavorsAccessNegativeTestJSON-1802217241-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '3f421dbad8b14e2186421e1278d3a875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcc95e714424741acb548115f7c0acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:16.802662 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-90ebc46c-e3b7-44cc-be19-9a1900d5fc01 tempest-FlavorsAccessNegativeTestJSON-1802217241 tempest-FlavorsAccessNegativeTestJSON-1802217241-project] Request method failure captured: Sep 24 20:51:16.802662 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/flavors/73302870/action HTTP/1.1 Sep 24 20:51:16.802662 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:51:16.802662 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:51:16.802662 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:51:16.802662 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 70 Sep 24 20:51:16.802662 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:51:16.802662 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:51:16.802662 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:51:16.802662 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:51:16.802662 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL227C6NYom3KUHDuRamE6StFavheXBlHg4wRW-uykVHhkiWqxItTIniZ-jyNuPS-BK-twmjX60hYqY2H4-BHLwKFRXGqqEJtJETO-68Ls8uV3zp1ictTA8hLjHcTMMoScanecQZm5hEnHiuhTHsQ9GPHuHr1nzDowIk9In86IpvAHGs Sep 24 20:51:16.802662 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:51:16.802662 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:51:16.802662 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:51:16.802662 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:51:16.802662 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:51:16.802662 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:51:16.802662 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 1dcc95e714424741acb548115f7c0acb Sep 24 20:51:16.802662 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1802217241 Sep 24 20:51:16.802662 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:51:16.802662 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:51:16.804172 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1dcc95e714424741acb548115f7c0acb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1dcc95e714424741acb548115f7c0acb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1dcc95e714424741acb548115f7c0acb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1dcc95e714424741acb548115f7c0acb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:51:16.804172 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1802217241 Sep 24 20:51:16.804172 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 1dcc95e714424741acb548115f7c0acb Sep 24 20:51:16.804172 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1802217241 Sep 24 20:51:16.804172 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-FlavorsAccessNegativeTestJSON-1802217241-project Sep 24 20:51:16.804172 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:51:16.804172 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:51:16.804172 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 3f421dbad8b14e2186421e1278d3a875 Sep 24 20:51:16.804172 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1802217241-project Sep 24 20:51:16.804172 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 20:51:16.804172 ncdv-master-1 devstack@n-api.service[140516]: {"removeTenantAccess": {"tenant": "1dcc95e714424741acb548115f7c0acb"}} Sep 24 20:51:16.804172 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:51:16.805418 ncdv-master-1 devstack@n-api.service[140516]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 24 20:51:16.805418 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '73302870', 'body': {'removeTenantAccess': {'tenant': '1dcc95e714424741acb548115f7c0acb'}}} Sep 24 20:51:16.805418 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:51:16.805418 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:16.805418 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:16.805418 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:16.805418 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:51:16.805418 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:51:16.805418 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:51:16.805418 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:51:16.805418 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:51:16.805418 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:51:16.805418 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Sep 24 20:51:16.805418 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi context.can( Sep 24 20:51:16.805418 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 24 20:51:16.805418 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 24 20:51:16.805418 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 24 20:51:16.805418 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 24 20:51:16.805418 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:51:16.805418 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:51:16.808927 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:51:16.808927 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:51:16.808927 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 24 20:51:16.808927 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 24 20:51:16.808927 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 24 20:51:16.808927 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 24 20:51:16.808927 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 24 20:51:16.808927 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 24 20:51:16.808927 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 24 20:51:16.808927 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:16.808927 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:16.808927 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:16.808927 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:16.808927 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:16.808927 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:16.808927 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 24 20:51:16.808927 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 24 20:51:16.808927 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 24 20:51:16.808927 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:16.812485 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-90ebc46c-e3b7-44cc-be19-9a1900d5fc01 tempest-FlavorsAccessNegativeTestJSON-1802217241 tempest-FlavorsAccessNegativeTestJSON-1802217241-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:51:16.814024 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-90ebc46c-e3b7-44cc-be19-9a1900d5fc01 tempest-FlavorsAccessNegativeTestJSON-1802217241 tempest-FlavorsAccessNegativeTestJSON-1802217241-project] 10.222.0.52 "POST /compute/v2.1/flavors/73302870/action" status: 403 len: 133 microversion: 2.1 time: 0.035466 Sep 24 20:51:16.815484 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 239/466] 10.222.0.52 () {60 vars in 1194 bytes} [Sat Sep 24 20:51:16 2022] POST /compute/v2.1/flavors/73302870/action => generated 133 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:51:16.826489 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0fa11ac8-5cdd-4b63-af5d-003d2f706541 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:16.827589 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0fa11ac8-5cdd-4b63-af5d-003d2f706541 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:16.835772 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0fa11ac8-5cdd-4b63-af5d-003d2f706541 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:16.836612 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0fa11ac8-5cdd-4b63-af5d-003d2f706541 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:16.837300 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0fa11ac8-5cdd-4b63-af5d-003d2f706541 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:16.838641 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0fa11ac8-5cdd-4b63-af5d-003d2f706541 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:16.840329 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0fa11ac8-5cdd-4b63-af5d-003d2f706541 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:16.841016 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0fa11ac8-5cdd-4b63-af5d-003d2f706541 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:17.000320 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-feef4204-eba9-4a86-9c49-d4f70c5c53df tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:17.008844 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-feef4204-eba9-4a86-9c49-d4f70c5c53df tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1476 microversion: 2.1 time: 0.317977 Sep 24 20:51:17.023680 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 228/467] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:16 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1476 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:17.033683 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0abbacfa-6fcb-4532-8238-eddeaa6077f4 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "1dcc95e714424741acb548115f7c0acb"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:17.058476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0fa11ac8-5cdd-4b63-af5d-003d2f706541 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:17.070209 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0fa11ac8-5cdd-4b63-af5d-003d2f706541 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5" status: 200 len: 1504 microversion: 2.1 time: 0.251377 Sep 24 20:51:17.071988 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 240/468] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:16 2022] GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 => generated 1504 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:17.268286 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0abbacfa-6fcb-4532-8238-eddeaa6077f4 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/73302870/action" status: 200 len: 21 microversion: 2.1 time: 0.242781 Sep 24 20:51:17.274317 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 229/469] 10.222.0.52 () {60 vars in 1194 bytes} [Sat Sep 24 20:51:17 2022] POST /compute/v2.1/flavors/73302870/action => generated 21 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:51:17.281653 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9d472d70-da5e-42ec-8fad-360605474ea6 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:17.312691 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9d472d70-da5e-42ec-8fad-360605474ea6 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/73302870" status: 202 len: 0 microversion: 2.1 time: 0.037208 Sep 24 20:51:17.314088 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 241/470] 10.222.0.52 () {58 vars in 1155 bytes} [Sat Sep 24 20:51:17 2022] DELETE /compute/v2.1/flavors/73302870 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 20:51:17.326185 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-509d1a76-25e2-4303-b206-8c14d26e7de2 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:17.361206 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-509d1a76-25e2-4303-b206-8c14d26e7de2 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.042260 Sep 24 20:51:17.383458 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ff23e0cc-297a-4b3c-9f03-07f9984b8b1d tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2096766551", "id": 168342576, "os-flavor-access:is_public": "False"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:17.395132 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 230/471] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:51:17 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:17.442531 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ff23e0cc-297a-4b3c-9f03-07f9984b8b1d tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.058645 Sep 24 20:51:17.456882 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-092e40bd-b158-4800-8f93-d0d4acede1a0 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d64a82484b68429381efcbffd434ee1a"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:17.462105 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 242/472] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:51:17 2022] POST /compute/v2.1/flavors => generated 436 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:17.526601 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-a53eba65-bccc-41fc-baf0-09cfde4dfa77 req-3825ce99-f6b3-444a-ac9d-cb4d06fb647e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95aa2033-71b1-41a6-b583-2fd183c18242", "tag": "ee855b7c-23b6-4bd8-b336-15077259decf"}, {"name": "network-changed", "server_uuid": "8164fcd2-b47c-4b73-b5f3-4e71615a3ec5", "tag": "7f54b87f-432c-4333-a0ed-d461564390c4"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:17.552448 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a53eba65-bccc-41fc-baf0-09cfde4dfa77 req-3825ce99-f6b3-444a-ac9d-cb4d06fb647e service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:17.553161 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a53eba65-bccc-41fc-baf0-09cfde4dfa77 req-3825ce99-f6b3-444a-ac9d-cb4d06fb647e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:17.554596 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a53eba65-bccc-41fc-baf0-09cfde4dfa77 req-3825ce99-f6b3-444a-ac9d-cb4d06fb647e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:17.583484 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-092e40bd-b158-4800-8f93-d0d4acede1a0 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] HTTP exception thrown: Flavor access not found for 37 / d64a82484b68429381efcbffd434ee1a combination. Sep 24 20:51:17.593601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-092e40bd-b158-4800-8f93-d0d4acede1a0 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] Request method failure captured: Sep 24 20:51:17.593601 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/flavors/168342576/action HTTP/1.1 Sep 24 20:51:17.593601 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:51:17.593601 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:51:17.593601 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:51:17.593601 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 70 Sep 24 20:51:17.593601 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:51:17.593601 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:51:17.593601 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:51:17.593601 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:51:17.593601 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL22872MF5QTO0rpTp0GRkXe3bFObfDHCbCpdIOsFIGvCJJk0bFdziNh1NxTwsJvH0WWTdPdT4GCey5tMAPka5RPV8A5YS8qBSGIXEamSXCHxVfmgpqy0W4IXEmnsT705r1-lswcjv0mtPkvqXeIcPgILb8EjC9Dw1sbL_6iPhIP9VlQ Sep 24 20:51:17.593601 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:51:17.593601 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:51:17.593601 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:51:17.593601 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:51:17.593601 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:51:17.593601 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:51:17.593601 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 37b8d37bcac74b7996617c1561e96c19 Sep 24 20:51:17.593601 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1295882863 Sep 24 20:51:17.593601 ncdv-master-1 devstack@n-api.service[140517]: X-Role: admin,reader,member Sep 24 20:51:17.593601 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: admin,reader,member Sep 24 20:51:17.595146 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/37b8d37bcac74b7996617c1561e96c19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_37b8d37bcac74b7996617c1561e96c19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/37b8d37bcac74b7996617c1561e96c19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/37b8d37bcac74b7996617c1561e96c19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:51:17.595146 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1295882863 Sep 24 20:51:17.595146 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 37b8d37bcac74b7996617c1561e96c19 Sep 24 20:51:17.595146 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1295882863 Sep 24 20:51:17.595146 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin Sep 24 20:51:17.595146 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:51:17.595146 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:51:17.595146 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 830860e6e5aa438ca5e59691022fa2fa Sep 24 20:51:17.595146 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin Sep 24 20:51:17.595146 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 20:51:17.595146 ncdv-master-1 devstack@n-api.service[140517]: {"removeTenantAccess": {"tenant": "d64a82484b68429381efcbffd434ee1a"}} Sep 24 20:51:17.595146 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:51:17.595964 ncdv-master-1 devstack@n-api.service[140517]: exception: Flavor access not found for 37 / d64a82484b68429381efcbffd434ee1a combination. Sep 24 20:51:17.595964 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '168342576', 'body': {'removeTenantAccess': {'tenant': 'd64a82484b68429381efcbffd434ee1a'}}} Sep 24 20:51:17.595964 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:51:17.595964 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:17.595964 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Sep 24 20:51:17.595964 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Sep 24 20:51:17.595964 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 24 20:51:17.595964 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 24 20:51:17.595964 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Sep 24 20:51:17.595964 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Sep 24 20:51:17.595964 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Sep 24 20:51:17.595964 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Sep 24 20:51:17.595964 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Sep 24 20:51:17.595964 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Sep 24 20:51:17.595964 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 24 20:51:17.595964 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 24 20:51:17.595964 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Sep 24 20:51:17.595964 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Sep 24 20:51:17.597187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 37 / d64a82484b68429381efcbffd434ee1a combination. Sep 24 20:51:17.597187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:17.597187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:17.597187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:17.597187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:17.597187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:17.597187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:17.597187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:51:17.597187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:51:17.597187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:51:17.597187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:51:17.597187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:51:17.597187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:51:17.597187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Sep 24 20:51:17.597187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:51:17.597187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 37 / d64a82484b68429381efcbffd434ee1a combination. Sep 24 20:51:17.597187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:17.597187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:17.597187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:17.597187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:17.598596 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:17.598596 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:17.598596 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:51:17.598596 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:51:17.598596 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 37 / d64a82484b68429381efcbffd434ee1a combination. Sep 24 20:51:17.598596 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:17.604491 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-092e40bd-b158-4800-8f93-d0d4acede1a0 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] Returning 404 to user: Flavor access not found for 37 / d64a82484b68429381efcbffd434ee1a combination. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:51:17.605226 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-092e40bd-b158-4800-8f93-d0d4acede1a0 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/168342576/action" status: 404 len: 124 microversion: 2.1 time: 0.152040 Sep 24 20:51:17.614300 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-a53eba65-bccc-41fc-baf0-09cfde4dfa77 req-3825ce99-f6b3-444a-ac9d-cb4d06fb647e service nova] Creating event network-changed:ee855b7c-23b6-4bd8-b336-15077259decf for instance 95aa2033-71b1-41a6-b583-2fd183c18242 on nch2-master-1 Sep 24 20:51:17.614852 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-a53eba65-bccc-41fc-baf0-09cfde4dfa77 req-3825ce99-f6b3-444a-ac9d-cb4d06fb647e service nova] Creating event network-changed:7f54b87f-432c-4333-a0ed-d461564390c4 for instance 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 on nch1-master-1 Sep 24 20:51:17.617306 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 231/473] 10.222.0.52 () {60 vars in 1197 bytes} [Sat Sep 24 20:51:17 2022] POST /compute/v2.1/flavors/168342576/action => generated 124 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:51:17.624484 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f623d261-e6a7-4b7c-b296-1742dc917e64 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:17.625408 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f623d261-e6a7-4b7c-b296-1742dc917e64 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: 95aa2033-71b1-41a6-b583-2fd183c18242] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:17.646756 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-a53eba65-bccc-41fc-baf0-09cfde4dfa77 req-3825ce99-f6b3-444a-ac9d-cb4d06fb647e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.123563 Sep 24 20:51:17.649584 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 243/474] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:51:17.654774 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f623d261-e6a7-4b7c-b296-1742dc917e64 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:17.656318 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f623d261-e6a7-4b7c-b296-1742dc917e64 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:17.656770 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f623d261-e6a7-4b7c-b296-1742dc917e64 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:17.658003 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f623d261-e6a7-4b7c-b296-1742dc917e64 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:17.658476 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f623d261-e6a7-4b7c-b296-1742dc917e64 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:17.659168 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f623d261-e6a7-4b7c-b296-1742dc917e64 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:17.661151 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cd54ad86-6555-4ff5-9acd-aa7d6e18e55c tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:17.725246 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cd54ad86-6555-4ff5-9acd-aa7d6e18e55c tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/168342576" status: 202 len: 0 microversion: 2.1 time: 0.073097 Sep 24 20:51:17.726309 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 244/475] 10.222.0.52 () {58 vars in 1158 bytes} [Sat Sep 24 20:51:17 2022] DELETE /compute/v2.1/flavors/168342576 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:51:17.743821 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f62fc6a6-48c4-4e5d-a1d8-c830fd3201d6 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:17.792871 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f62fc6a6-48c4-4e5d-a1d8-c830fd3201d6 tempest-FlavorsAccessNegativeTestJSON-1295882863 tempest-FlavorsAccessNegativeTestJSON-1295882863-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.059289 Sep 24 20:51:17.811648 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 245/476] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:51:17 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:17.818446 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-027e16ae-1dd4-4b23-8760-abfd77d76ca5 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:17.819609 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-027e16ae-1dd4-4b23-8760-abfd77d76ca5 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:17.829149 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-027e16ae-1dd4-4b23-8760-abfd77d76ca5 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:17.829946 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-027e16ae-1dd4-4b23-8760-abfd77d76ca5 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:17.830518 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-027e16ae-1dd4-4b23-8760-abfd77d76ca5 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:17.831980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-027e16ae-1dd4-4b23-8760-abfd77d76ca5 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:17.832570 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-027e16ae-1dd4-4b23-8760-abfd77d76ca5 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:17.833103 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-027e16ae-1dd4-4b23-8760-abfd77d76ca5 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:17.994157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-027e16ae-1dd4-4b23-8760-abfd77d76ca5 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:18.008111 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-027e16ae-1dd4-4b23-8760-abfd77d76ca5 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:18.009637 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-027e16ae-1dd4-4b23-8760-abfd77d76ca5 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:18.025165 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-027e16ae-1dd4-4b23-8760-abfd77d76ca5 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1555 microversion: 2.91 time: 0.210905 Sep 24 20:51:18.029178 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 246/477] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:51:17 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1555 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:51:18.043654 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0f78dd89-1d8a-466f-b4b7-2653cd94950f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:18.046215 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0f78dd89-1d8a-466f-b4b7-2653cd94950f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:18.064476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0f78dd89-1d8a-466f-b4b7-2653cd94950f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:18.065200 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0f78dd89-1d8a-466f-b4b7-2653cd94950f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:18.067987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0f78dd89-1d8a-466f-b4b7-2653cd94950f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:18.069215 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0f78dd89-1d8a-466f-b4b7-2653cd94950f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:18.072161 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0f78dd89-1d8a-466f-b4b7-2653cd94950f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:18.074053 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0f78dd89-1d8a-466f-b4b7-2653cd94950f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:18.249041 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f623d261-e6a7-4b7c-b296-1742dc917e64 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:18.265873 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f623d261-e6a7-4b7c-b296-1742dc917e64 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242" status: 200 len: 1313 microversion: 2.1 time: 0.645449 Sep 24 20:51:18.267112 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 232/478] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:17 2022] GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242 => generated 1313 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:18.278678 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-571aefd5-3320-411d-849e-3bb04b4c350e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:18.281679 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-571aefd5-3320-411d-849e-3bb04b4c350e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:18.325532 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-571aefd5-3320-411d-849e-3bb04b4c350e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:18.326684 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-571aefd5-3320-411d-849e-3bb04b4c350e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:18.327479 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-571aefd5-3320-411d-849e-3bb04b4c350e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:18.328479 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-571aefd5-3320-411d-849e-3bb04b4c350e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:18.329245 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-571aefd5-3320-411d-849e-3bb04b4c350e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:18.329857 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-571aefd5-3320-411d-849e-3bb04b4c350e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:18.441662 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0f78dd89-1d8a-466f-b4b7-2653cd94950f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:18.496750 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0f78dd89-1d8a-466f-b4b7-2653cd94950f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1475 microversion: 2.1 time: 0.463012 Sep 24 20:51:18.500990 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 247/479] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:18 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1475 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:18.568775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=16 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:51:18.748646 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-571aefd5-3320-411d-849e-3bb04b4c350e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:18.762549 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-571aefd5-3320-411d-849e-3bb04b4c350e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5" status: 200 len: 1504 microversion: 2.1 time: 0.488333 Sep 24 20:51:18.763490 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 233/480] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:18 2022] GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 => generated 1504 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:19.065957 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2715f462-6913-4c01-a213-4b8929bffb61 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:19.067389 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2715f462-6913-4c01-a213-4b8929bffb61 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:19.103042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2715f462-6913-4c01-a213-4b8929bffb61 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:19.106247 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2715f462-6913-4c01-a213-4b8929bffb61 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:19.108251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2715f462-6913-4c01-a213-4b8929bffb61 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:19.110545 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2715f462-6913-4c01-a213-4b8929bffb61 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:19.112886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2715f462-6913-4c01-a213-4b8929bffb61 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:19.118078 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2715f462-6913-4c01-a213-4b8929bffb61 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:19.298905 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2543276c-06ba-4358-bd7c-776307d277b4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:19.299528 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2543276c-06ba-4358-bd7c-776307d277b4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: 95aa2033-71b1-41a6-b583-2fd183c18242] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:19.309979 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2543276c-06ba-4358-bd7c-776307d277b4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:19.326673 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2543276c-06ba-4358-bd7c-776307d277b4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:19.327398 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2543276c-06ba-4358-bd7c-776307d277b4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:19.331305 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2543276c-06ba-4358-bd7c-776307d277b4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:19.332010 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2543276c-06ba-4358-bd7c-776307d277b4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:19.332634 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2543276c-06ba-4358-bd7c-776307d277b4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:19.358910 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2715f462-6913-4c01-a213-4b8929bffb61 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:19.374290 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2715f462-6913-4c01-a213-4b8929bffb61 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:19.376019 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2715f462-6913-4c01-a213-4b8929bffb61 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:19.389839 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2715f462-6913-4c01-a213-4b8929bffb61 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1555 microversion: 2.91 time: 0.340229 Sep 24 20:51:19.394375 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 248/481] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:51:19 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1555 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:51:19.535325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-72e5aef3-2499-4757-a7e6-67c48a77f537 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:19.536192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-72e5aef3-2499-4757-a7e6-67c48a77f537 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:19.550723 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72e5aef3-2499-4757-a7e6-67c48a77f537 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:19.551542 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72e5aef3-2499-4757-a7e6-67c48a77f537 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:19.552398 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72e5aef3-2499-4757-a7e6-67c48a77f537 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:19.553886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72e5aef3-2499-4757-a7e6-67c48a77f537 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:19.554385 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72e5aef3-2499-4757-a7e6-67c48a77f537 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:19.554853 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72e5aef3-2499-4757-a7e6-67c48a77f537 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:19.763355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2543276c-06ba-4358-bd7c-776307d277b4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:19.773416 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2543276c-06ba-4358-bd7c-776307d277b4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242" status: 200 len: 1313 microversion: 2.1 time: 0.478338 Sep 24 20:51:19.781187 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 234/482] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:19 2022] GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242 => generated 1313 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:19.788891 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5b4538c2-6361-4ac9-b835-c9c24be77ff4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:19.791121 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5b4538c2-6361-4ac9-b835-c9c24be77ff4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:19.809194 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b4538c2-6361-4ac9-b835-c9c24be77ff4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:19.810070 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b4538c2-6361-4ac9-b835-c9c24be77ff4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:19.810765 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b4538c2-6361-4ac9-b835-c9c24be77ff4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:19.811755 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b4538c2-6361-4ac9-b835-c9c24be77ff4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:19.812296 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b4538c2-6361-4ac9-b835-c9c24be77ff4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:19.812810 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b4538c2-6361-4ac9-b835-c9c24be77ff4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:20.098734 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-72e5aef3-2499-4757-a7e6-67c48a77f537 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:20.112267 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-72e5aef3-2499-4757-a7e6-67c48a77f537 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1475 microversion: 2.1 time: 0.581235 Sep 24 20:51:20.113028 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 249/483] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:19 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1475 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:20.131492 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-6fdb5a12-13a6-4bad-93c9-edc106781502 req-679f5d25-f8b2-4274-a79d-a2e3cf9264e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f389d01c-08ec-42e6-81a1-85aedcdfe42e", "name": "network-vif-unplugged", "status": "completed", "tag": "d104313c-4d9a-4ffb-8015-0f9ee3bfbcb1"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:20.164718 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-6fdb5a12-13a6-4bad-93c9-edc106781502 req-679f5d25-f8b2-4274-a79d-a2e3cf9264e3 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:20.165360 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-6fdb5a12-13a6-4bad-93c9-edc106781502 req-679f5d25-f8b2-4274-a79d-a2e3cf9264e3 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:20.167505 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-6fdb5a12-13a6-4bad-93c9-edc106781502 req-679f5d25-f8b2-4274-a79d-a2e3cf9264e3 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:20.201165 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-6fdb5a12-13a6-4bad-93c9-edc106781502 req-679f5d25-f8b2-4274-a79d-a2e3cf9264e3 service nova] Creating event network-vif-unplugged:d104313c-4d9a-4ffb-8015-0f9ee3bfbcb1 for instance f389d01c-08ec-42e6-81a1-85aedcdfe42e on nch2-master-1 Sep 24 20:51:20.230194 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [req-6fdb5a12-13a6-4bad-93c9-edc106781502 req-679f5d25-f8b2-4274-a79d-a2e3cf9264e3 service nova] Instance f389d01c-08ec-42e6-81a1-85aedcdfe42e is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 20:51:20.254990 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-6fdb5a12-13a6-4bad-93c9-edc106781502 req-679f5d25-f8b2-4274-a79d-a2e3cf9264e3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.139791 Sep 24 20:51:20.256021 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 250/484] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:20.260843 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5b4538c2-6361-4ac9-b835-c9c24be77ff4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:20.280012 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5b4538c2-6361-4ac9-b835-c9c24be77ff4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5" status: 200 len: 1504 microversion: 2.1 time: 0.497270 Sep 24 20:51:20.280493 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 235/485] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:19 2022] GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 => generated 1504 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:20.436298 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-35d20375-3deb-451b-82d0-bcb5b57e64bd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:20.437216 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-35d20375-3deb-451b-82d0-bcb5b57e64bd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:20.462196 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35d20375-3deb-451b-82d0-bcb5b57e64bd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:20.464844 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35d20375-3deb-451b-82d0-bcb5b57e64bd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:20.465670 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35d20375-3deb-451b-82d0-bcb5b57e64bd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:20.469390 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35d20375-3deb-451b-82d0-bcb5b57e64bd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:20.470276 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35d20375-3deb-451b-82d0-bcb5b57e64bd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:20.471859 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35d20375-3deb-451b-82d0-bcb5b57e64bd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:20.581775 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-35d20375-3deb-451b-82d0-bcb5b57e64bd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:20.592557 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-35d20375-3deb-451b-82d0-bcb5b57e64bd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:20.595446 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-35d20375-3deb-451b-82d0-bcb5b57e64bd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:20.603160 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-35d20375-3deb-451b-82d0-bcb5b57e64bd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1555 microversion: 2.91 time: 0.182892 Sep 24 20:51:20.604965 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 251/486] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:51:20 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1555 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:51:20.805550 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4281bd44-2728-430f-8fee-48fad7a42085 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:20.806298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4281bd44-2728-430f-8fee-48fad7a42085 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: 95aa2033-71b1-41a6-b583-2fd183c18242] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:20.816933 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4281bd44-2728-430f-8fee-48fad7a42085 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:20.823056 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4281bd44-2728-430f-8fee-48fad7a42085 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:20.823960 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4281bd44-2728-430f-8fee-48fad7a42085 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:20.825050 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4281bd44-2728-430f-8fee-48fad7a42085 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:20.825824 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4281bd44-2728-430f-8fee-48fad7a42085 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:20.826423 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4281bd44-2728-430f-8fee-48fad7a42085 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:20.899227 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:51:21.020310 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c0565dfc-4cdf-4f35-acfa-eec7464437d1 tempest-FlavorsV2TestJSON-1705321906 tempest-FlavorsV2TestJSON-1705321906-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:21.031472 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c0565dfc-4cdf-4f35-acfa-eec7464437d1 tempest-FlavorsV2TestJSON-1705321906 tempest-FlavorsV2TestJSON-1705321906-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.187712 Sep 24 20:51:21.038979 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 252/487] 10.222.0.52 () {58 vars in 1137 bytes} [Sat Sep 24 20:51:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:21.055636 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cfb0023e-a953-433b-9b41-99f3fd741048 tempest-FlavorsV2TestJSON-1705321906 tempest-FlavorsV2TestJSON-1705321906-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:21.120492 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cfb0023e-a953-433b-9b41-99f3fd741048 tempest-FlavorsV2TestJSON-1705321906 tempest-FlavorsV2TestJSON-1705321906-project] 10.222.0.52 "GET /compute/v2.1/flavors" status: 200 len: 3078 microversion: 2.1 time: 0.072726 Sep 24 20:51:21.122151 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 253/488] 10.222.0.52 () {58 vars in 1125 bytes} [Sat Sep 24 20:51:21 2022] GET /compute/v2.1/flavors => generated 3078 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:51:21.133278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-a4804f1e-b148-4440-b743-91f06fa5915c req-a71a452d-f1b5-4b98-9e98-aca5052bc125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdb37c4d-e841-4e13-b809-e3f19ce6365a", "name": "network-vif-plugged", "status": "completed", "tag": "fdfbcb27-4de9-4bdc-b3e7-a1d7e89b3236"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:21.172305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a4804f1e-b148-4440-b743-91f06fa5915c req-a71a452d-f1b5-4b98-9e98-aca5052bc125 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:21.175339 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a4804f1e-b148-4440-b743-91f06fa5915c req-a71a452d-f1b5-4b98-9e98-aca5052bc125 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:21.177350 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4281bd44-2728-430f-8fee-48fad7a42085 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:21.178177 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a4804f1e-b148-4440-b743-91f06fa5915c req-a71a452d-f1b5-4b98-9e98-aca5052bc125 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:21.190488 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4281bd44-2728-430f-8fee-48fad7a42085 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242" status: 200 len: 1313 microversion: 2.1 time: 0.389911 Sep 24 20:51:21.207043 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-a4804f1e-b148-4440-b743-91f06fa5915c req-a71a452d-f1b5-4b98-9e98-aca5052bc125 service nova] Creating event network-vif-plugged:fdfbcb27-4de9-4bdc-b3e7-a1d7e89b3236 for instance bdb37c4d-e841-4e13-b809-e3f19ce6365a on nch2-master-1 Sep 24 20:51:21.208778 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 236/489] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:20 2022] GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242 => generated 1313 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:21.215340 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a916544d-4d69-460e-b5ea-96c5b6d76e47 tempest-FlavorsV2TestJSON-1705321906 tempest-FlavorsV2TestJSON-1705321906-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:21.227788 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a916544d-4d69-460e-b5ea-96c5b6d76e47 tempest-FlavorsV2TestJSON-1705321906 tempest-FlavorsV2TestJSON-1705321906-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017431 Sep 24 20:51:21.230691 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 237/490] 10.222.0.52 () {58 vars in 1137 bytes} [Sat Sep 24 20:51:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:21.236815 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-38eb86b3-d3f5-4260-87d9-3cf315d61e83 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:21.237649 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-38eb86b3-d3f5-4260-87d9-3cf315d61e83 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:21.242236 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-a4804f1e-b148-4440-b743-91f06fa5915c req-a71a452d-f1b5-4b98-9e98-aca5052bc125 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118354 Sep 24 20:51:21.246211 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 254/491] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:21.251680 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38eb86b3-d3f5-4260-87d9-3cf315d61e83 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:21.252466 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38eb86b3-d3f5-4260-87d9-3cf315d61e83 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:21.252582 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-39f5dfe3-b338-44c3-ac18-94f912912a94 tempest-FlavorsV2TestJSON-1705321906 tempest-FlavorsV2TestJSON-1705321906-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:21.253306 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38eb86b3-d3f5-4260-87d9-3cf315d61e83 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:21.254625 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38eb86b3-d3f5-4260-87d9-3cf315d61e83 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:21.255277 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38eb86b3-d3f5-4260-87d9-3cf315d61e83 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:21.255952 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38eb86b3-d3f5-4260-87d9-3cf315d61e83 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:21.265263 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-39f5dfe3-b338-44c3-ac18-94f912912a94 tempest-FlavorsV2TestJSON-1705321906 tempest-FlavorsV2TestJSON-1705321906-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017688 Sep 24 20:51:21.275258 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 255/492] 10.222.0.52 () {58 vars in 1137 bytes} [Sat Sep 24 20:51:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:21.301947 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2deda755-9763-4cc7-8c72-4902ba0f9970 tempest-FlavorsV2TestJSON-1705321906 tempest-FlavorsV2TestJSON-1705321906-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:21.406398 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2deda755-9763-4cc7-8c72-4902ba0f9970 tempest-FlavorsV2TestJSON-1705321906 tempest-FlavorsV2TestJSON-1705321906-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.124509 Sep 24 20:51:21.407353 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 256/493] 10.222.0.52 () {58 vars in 1165 bytes} [Sat Sep 24 20:51:21 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:21.415976 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b7e218b2-806a-4bdb-989c-f0c8f01baa73 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:21.417943 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b7e218b2-806a-4bdb-989c-f0c8f01baa73 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:21.425715 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7e218b2-806a-4bdb-989c-f0c8f01baa73 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:21.426281 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7e218b2-806a-4bdb-989c-f0c8f01baa73 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:21.426758 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7e218b2-806a-4bdb-989c-f0c8f01baa73 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:21.427772 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7e218b2-806a-4bdb-989c-f0c8f01baa73 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:21.428234 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7e218b2-806a-4bdb-989c-f0c8f01baa73 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:21.428657 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7e218b2-806a-4bdb-989c-f0c8f01baa73 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:21.466852 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:51:21.704583 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-38eb86b3-d3f5-4260-87d9-3cf315d61e83 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:21.722299 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-38eb86b3-d3f5-4260-87d9-3cf315d61e83 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1475 microversion: 2.1 time: 0.490191 Sep 24 20:51:21.722968 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 238/494] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:21 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1475 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:21.749920 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c85ff51a-27a3-4df8-aefd-62896005c517 tempest-FlavorsV2TestJSON-1705321906 tempest-FlavorsV2TestJSON-1705321906-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:21.768569 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c85ff51a-27a3-4df8-aefd-62896005c517 tempest-FlavorsV2TestJSON-1705321906 tempest-FlavorsV2TestJSON-1705321906-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030406 Sep 24 20:51:21.780848 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 239/495] 10.222.0.52 () {58 vars in 1137 bytes} [Sat Sep 24 20:51:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:21.785406 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b7e218b2-806a-4bdb-989c-f0c8f01baa73 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:21.785866 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7c4ab813-44a7-4f96-9da9-e58ccca78ca4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:21.789923 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7c4ab813-44a7-4f96-9da9-e58ccca78ca4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:21.795794 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b7e218b2-806a-4bdb-989c-f0c8f01baa73 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5" status: 200 len: 1504 microversion: 2.1 time: 0.387349 Sep 24 20:51:21.802424 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 257/496] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:21 2022] GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 => generated 1504 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:21.805145 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7c4ab813-44a7-4f96-9da9-e58ccca78ca4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:21.805627 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7c4ab813-44a7-4f96-9da9-e58ccca78ca4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:21.806167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7c4ab813-44a7-4f96-9da9-e58ccca78ca4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:21.806835 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7c4ab813-44a7-4f96-9da9-e58ccca78ca4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:21.807501 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7c4ab813-44a7-4f96-9da9-e58ccca78ca4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:21.808122 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7c4ab813-44a7-4f96-9da9-e58ccca78ca4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:21.818773 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9ac181ce-5dbf-47e7-940c-35b3e1346ca5 tempest-FlavorsV2TestJSON-1705321906 tempest-FlavorsV2TestJSON-1705321906-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:21.871623 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9ac181ce-5dbf-47e7-940c-35b3e1346ca5 tempest-FlavorsV2TestJSON-1705321906 tempest-FlavorsV2TestJSON-1705321906-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.067751 Sep 24 20:51:21.872220 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 258/497] 10.222.0.52 () {58 vars in 1169 bytes} [Sat Sep 24 20:51:21 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:21.895159 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-81196d5a-122a-4c17-9fe2-a1e4b2547c30 tempest-FlavorsV2TestJSON-1705321906 tempest-FlavorsV2TestJSON-1705321906-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:21.931432 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-81196d5a-122a-4c17-9fe2-a1e4b2547c30 tempest-FlavorsV2TestJSON-1705321906 tempest-FlavorsV2TestJSON-1705321906-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.040329 Sep 24 20:51:21.940055 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 259/498] 10.222.0.52 () {58 vars in 1161 bytes} [Sat Sep 24 20:51:21 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:51:21.955920 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-12eb7dd7-752a-4231-9bb0-6e709cbef1a4 tempest-FlavorsV2TestJSON-1705321906 tempest-FlavorsV2TestJSON-1705321906-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:21.970894 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-12eb7dd7-752a-4231-9bb0-6e709cbef1a4 tempest-FlavorsV2TestJSON-1705321906 tempest-FlavorsV2TestJSON-1705321906-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019796 Sep 24 20:51:21.980832 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 260/499] 10.222.0.52 () {58 vars in 1137 bytes} [Sat Sep 24 20:51:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:21.988771 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-333b2f42-fd2c-46c5-a4b0-5c8cdc70f5e1 tempest-FlavorsV2TestJSON-1705321906 tempest-FlavorsV2TestJSON-1705321906-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:22.005489 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7c4ab813-44a7-4f96-9da9-e58ccca78ca4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:22.019526 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7c4ab813-44a7-4f96-9da9-e58ccca78ca4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:22.031632 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7c4ab813-44a7-4f96-9da9-e58ccca78ca4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:22.045001 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7c4ab813-44a7-4f96-9da9-e58ccca78ca4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1555 microversion: 2.91 time: 0.271674 Sep 24 20:51:22.047703 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 240/500] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:51:21 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1555 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:51:22.222198 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2ee80084-8223-4174-9e56-ef82856e5696 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:22.223860 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2ee80084-8223-4174-9e56-ef82856e5696 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: 95aa2033-71b1-41a6-b583-2fd183c18242] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:22.238064 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ee80084-8223-4174-9e56-ef82856e5696 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:22.243612 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ee80084-8223-4174-9e56-ef82856e5696 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:22.247421 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ee80084-8223-4174-9e56-ef82856e5696 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:22.248477 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ee80084-8223-4174-9e56-ef82856e5696 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:22.251688 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ee80084-8223-4174-9e56-ef82856e5696 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:22.252452 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ee80084-8223-4174-9e56-ef82856e5696 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:22.287061 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-333b2f42-fd2c-46c5-a4b0-5c8cdc70f5e1 tempest-FlavorsV2TestJSON-1705321906 tempest-FlavorsV2TestJSON-1705321906-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.304449 Sep 24 20:51:22.287977 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 261/501] 10.222.0.52 () {58 vars in 1167 bytes} [Sat Sep 24 20:51:21 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:22.310006 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2608d085-f3f9-41de-b8aa-d5a1a0595798 tempest-FlavorsV2TestJSON-1705321906 tempest-FlavorsV2TestJSON-1705321906-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:22.328897 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2608d085-f3f9-41de-b8aa-d5a1a0595798 tempest-FlavorsV2TestJSON-1705321906 tempest-FlavorsV2TestJSON-1705321906-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024138 Sep 24 20:51:22.330793 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 262/502] 10.222.0.52 () {58 vars in 1137 bytes} [Sat Sep 24 20:51:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:51:22.344016 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-d9e0aa08-2b5f-49fe-a2ec-197d9552e0fb req-bae5b4a7-dfeb-4e9d-a01f-49e096b821e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f389d01c-08ec-42e6-81a1-85aedcdfe42e", "tag": "d104313c-4d9a-4ffb-8015-0f9ee3bfbcb1"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:22.374476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d9e0aa08-2b5f-49fe-a2ec-197d9552e0fb req-bae5b4a7-dfeb-4e9d-a01f-49e096b821e0 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:22.376394 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d9e0aa08-2b5f-49fe-a2ec-197d9552e0fb req-bae5b4a7-dfeb-4e9d-a01f-49e096b821e0 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:22.377076 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d9e0aa08-2b5f-49fe-a2ec-197d9552e0fb req-bae5b4a7-dfeb-4e9d-a01f-49e096b821e0 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:22.402155 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-d9e0aa08-2b5f-49fe-a2ec-197d9552e0fb req-bae5b4a7-dfeb-4e9d-a01f-49e096b821e0 service nova] Creating event network-changed:d104313c-4d9a-4ffb-8015-0f9ee3bfbcb1 for instance f389d01c-08ec-42e6-81a1-85aedcdfe42e on nch2-master-1 Sep 24 20:51:22.408571 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [req-d9e0aa08-2b5f-49fe-a2ec-197d9552e0fb req-bae5b4a7-dfeb-4e9d-a01f-49e096b821e0 service nova] Instance f389d01c-08ec-42e6-81a1-85aedcdfe42e is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 20:51:22.423737 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-d9e0aa08-2b5f-49fe-a2ec-197d9552e0fb req-bae5b4a7-dfeb-4e9d-a01f-49e096b821e0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091434 Sep 24 20:51:22.425271 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 263/503] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:22.430825 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-937c7596-384b-476a-92d3-6e8492d84472 tempest-FlavorsV2TestJSON-1705321906 tempest-FlavorsV2TestJSON-1705321906-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:22.454207 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-937c7596-384b-476a-92d3-6e8492d84472 tempest-FlavorsV2TestJSON-1705321906 tempest-FlavorsV2TestJSON-1705321906-project] 10.222.0.52 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.027463 Sep 24 20:51:22.455018 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 264/504] 10.222.0.52 () {58 vars in 1144 bytes} [Sat Sep 24 20:51:22 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:22.473246 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-613d1d10-1289-430c-ab3f-1de72b2ecb26 tempest-FlavorsV2TestJSON-1705321906 tempest-FlavorsV2TestJSON-1705321906-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:22.514957 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-613d1d10-1289-430c-ab3f-1de72b2ecb26 tempest-FlavorsV2TestJSON-1705321906 tempest-FlavorsV2TestJSON-1705321906-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.045715 Sep 24 20:51:22.520941 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 265/505] 10.222.0.52 () {58 vars in 1137 bytes} [Sat Sep 24 20:51:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:22.537996 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8511a7c7-9bb1-4603-9db4-a0f00d04a34e tempest-FlavorsV2TestJSON-1705321906 tempest-FlavorsV2TestJSON-1705321906-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:22.579127 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8511a7c7-9bb1-4603-9db4-a0f00d04a34e tempest-FlavorsV2TestJSON-1705321906 tempest-FlavorsV2TestJSON-1705321906-project] 10.222.0.52 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.048768 Sep 24 20:51:22.583576 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 266/506] 10.222.0.52 () {58 vars in 1148 bytes} [Sat Sep 24 20:51:22 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:22.597616 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-eab829d7-dbba-4bd2-9fbc-382e34f37a71 tempest-FlavorsV2TestJSON-1705321906 tempest-FlavorsV2TestJSON-1705321906-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:22.608287 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:DELETE=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:51:22.625160 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-eab829d7-dbba-4bd2-9fbc-382e34f37a71 tempest-FlavorsV2TestJSON-1705321906 tempest-FlavorsV2TestJSON-1705321906-project] 10.222.0.52 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.031598 Sep 24 20:51:22.634458 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 267/507] 10.222.0.52 () {58 vars in 1140 bytes} [Sat Sep 24 20:51:22 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:22.641786 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a16f4bac-4ff8-47bf-8b8a-20100b1baaf1 tempest-FlavorsV2TestJSON-1705321906 tempest-FlavorsV2TestJSON-1705321906-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:22.653536 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a16f4bac-4ff8-47bf-8b8a-20100b1baaf1 tempest-FlavorsV2TestJSON-1705321906 tempest-FlavorsV2TestJSON-1705321906-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018130 Sep 24 20:51:22.658554 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 268/508] 10.222.0.52 () {58 vars in 1137 bytes} [Sat Sep 24 20:51:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:51:22.676890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d1d69163-efc9-4fc3-b514-e17cad8cb2dd tempest-FlavorsV2TestJSON-1705321906 tempest-FlavorsV2TestJSON-1705321906-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:22.768498 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2ee80084-8223-4174-9e56-ef82856e5696 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:22.781296 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2ee80084-8223-4174-9e56-ef82856e5696 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242" status: 200 len: 1313 microversion: 2.1 time: 0.565589 Sep 24 20:51:22.786874 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 241/509] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:22 2022] GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242 => generated 1313 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:22.804035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-737e20dd-7e26-4548-95ac-67756ccfadd7 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:22.804767 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-737e20dd-7e26-4548-95ac-67756ccfadd7 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:22.828951 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-737e20dd-7e26-4548-95ac-67756ccfadd7 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:22.829616 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-737e20dd-7e26-4548-95ac-67756ccfadd7 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:22.836086 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-737e20dd-7e26-4548-95ac-67756ccfadd7 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:22.838142 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-737e20dd-7e26-4548-95ac-67756ccfadd7 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:22.841382 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-737e20dd-7e26-4548-95ac-67756ccfadd7 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:22.844116 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-737e20dd-7e26-4548-95ac-67756ccfadd7 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:22.855230 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d1d69163-efc9-4fc3-b514-e17cad8cb2dd tempest-FlavorsV2TestJSON-1705321906 tempest-FlavorsV2TestJSON-1705321906-project] 10.222.0.52 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.191996 Sep 24 20:51:22.860918 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 269/510] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:51:22 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:22.879178 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5b0133a2-e1da-4d28-b8c3-823e58a7c2bf tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:22.879955 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5b0133a2-e1da-4d28-b8c3-823e58a7c2bf tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:22.904492 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b0133a2-e1da-4d28-b8c3-823e58a7c2bf tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:22.905006 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b0133a2-e1da-4d28-b8c3-823e58a7c2bf tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:22.905457 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b0133a2-e1da-4d28-b8c3-823e58a7c2bf tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:22.906187 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b0133a2-e1da-4d28-b8c3-823e58a7c2bf tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:22.912332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b0133a2-e1da-4d28-b8c3-823e58a7c2bf tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:22.913483 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b0133a2-e1da-4d28-b8c3-823e58a7c2bf tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:23.217901 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-737e20dd-7e26-4548-95ac-67756ccfadd7 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:23.236442 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-737e20dd-7e26-4548-95ac-67756ccfadd7 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1473 microversion: 2.1 time: 0.446654 Sep 24 20:51:23.255778 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 242/511] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:22 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1473 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:23.267467 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4fc2f548-803d-45fc-b79a-f1c6ea862346 tempest-FlavorsV2TestJSON-1705321906 tempest-FlavorsV2TestJSON-1705321906-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:23.332722 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4fc2f548-803d-45fc-b79a-f1c6ea862346 tempest-FlavorsV2TestJSON-1705321906 tempest-FlavorsV2TestJSON-1705321906-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.075949 Sep 24 20:51:23.333827 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 243/512] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:51:23 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:23.340232 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cf141237-d434-4b8c-ab02-a9b6a2482b74 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:23.341068 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cf141237-d434-4b8c-ab02-a9b6a2482b74 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:23.349896 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf141237-d434-4b8c-ab02-a9b6a2482b74 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:23.350581 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf141237-d434-4b8c-ab02-a9b6a2482b74 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:23.351207 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf141237-d434-4b8c-ab02-a9b6a2482b74 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:23.352253 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf141237-d434-4b8c-ab02-a9b6a2482b74 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:23.352878 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf141237-d434-4b8c-ab02-a9b6a2482b74 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:23.353465 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf141237-d434-4b8c-ab02-a9b6a2482b74 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:23.391504 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5b0133a2-e1da-4d28-b8c3-823e58a7c2bf tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:23.412855 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5b0133a2-e1da-4d28-b8c3-823e58a7c2bf tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5" status: 200 len: 1504 microversion: 2.1 time: 0.550754 Sep 24 20:51:23.416565 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 270/513] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:22 2022] GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 => generated 1504 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:23.433260 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-443003a5-e0d3-4b4f-a832-d7310799ab71 tempest-FlavorsV2TestJSON-1705321906 tempest-FlavorsV2TestJSON-1705321906-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:23.455054 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-443003a5-e0d3-4b4f-a832-d7310799ab71 tempest-FlavorsV2TestJSON-1705321906 tempest-FlavorsV2TestJSON-1705321906-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.036265 Sep 24 20:51:23.459744 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 271/514] 10.222.0.52 () {58 vars in 1137 bytes} [Sat Sep 24 20:51:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:23.535682 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cf141237-d434-4b8c-ab02-a9b6a2482b74 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:23.551060 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cf141237-d434-4b8c-ab02-a9b6a2482b74 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:23.553553 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cf141237-d434-4b8c-ab02-a9b6a2482b74 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:23.591344 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cf141237-d434-4b8c-ab02-a9b6a2482b74 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1555 microversion: 2.91 time: 0.249418 Sep 24 20:51:23.604900 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 244/515] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:51:23 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1555 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:51:23.813985 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-50ed6fa5-64b5-4bed-a523-5a3831cc3a5f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:23.816470 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-50ed6fa5-64b5-4bed-a523-5a3831cc3a5f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: 95aa2033-71b1-41a6-b583-2fd183c18242] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:23.836310 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-50ed6fa5-64b5-4bed-a523-5a3831cc3a5f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:23.836798 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-50ed6fa5-64b5-4bed-a523-5a3831cc3a5f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:23.837255 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-50ed6fa5-64b5-4bed-a523-5a3831cc3a5f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:23.838686 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-50ed6fa5-64b5-4bed-a523-5a3831cc3a5f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:23.839059 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-50ed6fa5-64b5-4bed-a523-5a3831cc3a5f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:23.839499 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-50ed6fa5-64b5-4bed-a523-5a3831cc3a5f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:24.089258 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-50ed6fa5-64b5-4bed-a523-5a3831cc3a5f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:24.102137 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-50ed6fa5-64b5-4bed-a523-5a3831cc3a5f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242" status: 200 len: 1313 microversion: 2.1 time: 0.293309 Sep 24 20:51:24.103171 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 272/516] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:23 2022] GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242 => generated 1313 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:24.270452 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7eb88e31-03b5-4db3-867a-cff9aa280da0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:24.271346 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7eb88e31-03b5-4db3-867a-cff9aa280da0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:24.286109 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7eb88e31-03b5-4db3-867a-cff9aa280da0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:24.286845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7eb88e31-03b5-4db3-867a-cff9aa280da0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:24.288276 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7eb88e31-03b5-4db3-867a-cff9aa280da0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:24.289846 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7eb88e31-03b5-4db3-867a-cff9aa280da0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:24.290665 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7eb88e31-03b5-4db3-867a-cff9aa280da0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:24.292139 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7eb88e31-03b5-4db3-867a-cff9aa280da0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:24.361437 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b884b13b-0d84-42c1-a0c9-8cc30af91d3c tempest-InstanceUsageAuditLogTestJSON-1780209098 tempest-InstanceUsageAuditLogTestJSON-1780209098-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:24.400282 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b884b13b-0d84-42c1-a0c9-8cc30af91d3c tempest-InstanceUsageAuditLogTestJSON-1780209098 tempest-InstanceUsageAuditLogTestJSON-1780209098-project-admin] 10.222.0.52 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-24 20:51:23" status: 200 len: 318 microversion: 2.1 time: 0.470360 Sep 24 20:51:24.403760 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 245/517] 10.222.0.52 () {58 vars in 1251 bytes} [Sat Sep 24 20:51:23 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-24%2020%3A51%3A23 => generated 318 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:51:24.423610 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b08a9269-918f-4890-8b0d-ebe45103d8d3 tempest-InstanceUsageAuditLogTestJSON-1780209098 tempest-InstanceUsageAuditLogTestJSON-1780209098-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:24.464409 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b08a9269-918f-4890-8b0d-ebe45103d8d3 tempest-InstanceUsageAuditLogTestJSON-1780209098 tempest-InstanceUsageAuditLogTestJSON-1780209098-project-admin] 10.222.0.52 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.049190 Sep 24 20:51:24.470283 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 246/518] 10.222.0.52 () {58 vars in 1185 bytes} [Sat Sep 24 20:51:24 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:24.486354 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ff1f72d5-e8d0-4527-94c1-2ad5ad77a9b4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:24.487432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ff1f72d5-e8d0-4527-94c1-2ad5ad77a9b4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:24.505558 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff1f72d5-e8d0-4527-94c1-2ad5ad77a9b4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:24.507652 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff1f72d5-e8d0-4527-94c1-2ad5ad77a9b4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:24.508573 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff1f72d5-e8d0-4527-94c1-2ad5ad77a9b4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:24.512073 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff1f72d5-e8d0-4527-94c1-2ad5ad77a9b4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:24.513957 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff1f72d5-e8d0-4527-94c1-2ad5ad77a9b4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:24.514587 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff1f72d5-e8d0-4527-94c1-2ad5ad77a9b4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:24.530056 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7eb88e31-03b5-4db3-867a-cff9aa280da0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:24.544080 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7eb88e31-03b5-4db3-867a-cff9aa280da0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1473 microversion: 2.1 time: 0.279814 Sep 24 20:51:24.547432 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 273/519] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:24 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1473 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:51:24.625624 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f17364d1-34bd-4c59-a151-771fa87ac57d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:24.628785 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f17364d1-34bd-4c59-a151-771fa87ac57d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:24.640239 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f17364d1-34bd-4c59-a151-771fa87ac57d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:24.643742 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f17364d1-34bd-4c59-a151-771fa87ac57d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:24.646895 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f17364d1-34bd-4c59-a151-771fa87ac57d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:24.652925 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f17364d1-34bd-4c59-a151-771fa87ac57d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:24.654041 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f17364d1-34bd-4c59-a151-771fa87ac57d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:24.655283 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f17364d1-34bd-4c59-a151-771fa87ac57d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:24.669243 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:51:24.926728 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=12 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:51:24.966258 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f17364d1-34bd-4c59-a151-771fa87ac57d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:24.977591 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f17364d1-34bd-4c59-a151-771fa87ac57d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:24.984550 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f17364d1-34bd-4c59-a151-771fa87ac57d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:25.011372 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f17364d1-34bd-4c59-a151-771fa87ac57d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1555 microversion: 2.91 time: 0.381984 Sep 24 20:51:25.012793 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 274/520] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:51:24 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1555 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:51:25.059408 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ff1f72d5-e8d0-4527-94c1-2ad5ad77a9b4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:25.085351 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ff1f72d5-e8d0-4527-94c1-2ad5ad77a9b4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5" status: 200 len: 1504 microversion: 2.1 time: 0.613553 Sep 24 20:51:25.098529 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 247/521] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:24 2022] GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 => generated 1504 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:25.128199 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a175e22c-977d-45c9-b487-e27f42677396 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:25.128770 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a175e22c-977d-45c9-b487-e27f42677396 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: 95aa2033-71b1-41a6-b583-2fd183c18242] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:25.148065 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a175e22c-977d-45c9-b487-e27f42677396 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:25.148631 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a175e22c-977d-45c9-b487-e27f42677396 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:25.149017 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a175e22c-977d-45c9-b487-e27f42677396 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:25.159520 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a175e22c-977d-45c9-b487-e27f42677396 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:25.160033 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a175e22c-977d-45c9-b487-e27f42677396 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:25.160592 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a175e22c-977d-45c9-b487-e27f42677396 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:25.270572 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-9fc88064-6017-402d-9fd5-473d8f69efa3 req-89727dd7-df9f-406b-8214-4e0d14524bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95aa2033-71b1-41a6-b583-2fd183c18242", "name": "network-vif-plugged", "status": "completed", "tag": "ee855b7c-23b6-4bd8-b336-15077259decf"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:25.283423 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-9fc88064-6017-402d-9fd5-473d8f69efa3 req-89727dd7-df9f-406b-8214-4e0d14524bf2 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:25.283906 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-9fc88064-6017-402d-9fd5-473d8f69efa3 req-89727dd7-df9f-406b-8214-4e0d14524bf2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:25.284335 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-9fc88064-6017-402d-9fd5-473d8f69efa3 req-89727dd7-df9f-406b-8214-4e0d14524bf2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:25.308599 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-9fc88064-6017-402d-9fd5-473d8f69efa3 req-89727dd7-df9f-406b-8214-4e0d14524bf2 service nova] Creating event network-vif-plugged:ee855b7c-23b6-4bd8-b336-15077259decf for instance 95aa2033-71b1-41a6-b583-2fd183c18242 on nch2-master-1 Sep 24 20:51:25.332101 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-9fc88064-6017-402d-9fd5-473d8f69efa3 req-89727dd7-df9f-406b-8214-4e0d14524bf2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066154 Sep 24 20:51:25.334947 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 248/522] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 24 20:51:25.573620 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2ab723ce-0175-4e40-b2ec-68d618682061 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:25.575334 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2ab723ce-0175-4e40-b2ec-68d618682061 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:25.598307 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ab723ce-0175-4e40-b2ec-68d618682061 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:25.598964 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ab723ce-0175-4e40-b2ec-68d618682061 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:25.602656 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ab723ce-0175-4e40-b2ec-68d618682061 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:25.603820 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ab723ce-0175-4e40-b2ec-68d618682061 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:25.604467 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ab723ce-0175-4e40-b2ec-68d618682061 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:25.604919 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ab723ce-0175-4e40-b2ec-68d618682061 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:26.028871 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a175e22c-977d-45c9-b487-e27f42677396 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:26.043482 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a175e22c-977d-45c9-b487-e27f42677396 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242" status: 200 len: 1313 microversion: 2.1 time: 0.918876 Sep 24 20:51:26.047582 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 275/523] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:25 2022] GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242 => generated 1313 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:26.061898 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-17ae86af-b21d-4fc2-994f-f62c91850268 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:26.067088 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-17ae86af-b21d-4fc2-994f-f62c91850268 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:26.093040 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17ae86af-b21d-4fc2-994f-f62c91850268 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:26.096753 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17ae86af-b21d-4fc2-994f-f62c91850268 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:26.097940 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17ae86af-b21d-4fc2-994f-f62c91850268 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:26.100561 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17ae86af-b21d-4fc2-994f-f62c91850268 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:26.102999 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17ae86af-b21d-4fc2-994f-f62c91850268 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:26.103700 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17ae86af-b21d-4fc2-994f-f62c91850268 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:26.247164 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2ab723ce-0175-4e40-b2ec-68d618682061 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:26.263029 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2ab723ce-0175-4e40-b2ec-68d618682061 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1470 microversion: 2.1 time: 0.692174 Sep 24 20:51:26.288412 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-17ae86af-b21d-4fc2-994f-f62c91850268 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:26.293527 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 249/524] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:25 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1470 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:51:26.303056 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-17ae86af-b21d-4fc2-994f-f62c91850268 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:26.305941 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-17ae86af-b21d-4fc2-994f-f62c91850268 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:26.307221 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-38a79212-f3b5-4a0b-8a03-4fbf271623a7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:26.308951 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-38a79212-f3b5-4a0b-8a03-4fbf271623a7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:26.321846 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-17ae86af-b21d-4fc2-994f-f62c91850268 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1555 microversion: 2.91 time: 0.272955 Sep 24 20:51:26.326132 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38a79212-f3b5-4a0b-8a03-4fbf271623a7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:26.326844 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 276/525] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:51:26 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1555 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:51:26.328861 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38a79212-f3b5-4a0b-8a03-4fbf271623a7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:26.329598 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38a79212-f3b5-4a0b-8a03-4fbf271623a7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:26.330571 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38a79212-f3b5-4a0b-8a03-4fbf271623a7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:26.331235 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38a79212-f3b5-4a0b-8a03-4fbf271623a7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:26.331885 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38a79212-f3b5-4a0b-8a03-4fbf271623a7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:26.341667 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0e275a89-35d5-44da-9941-dfb0b79c8176 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:26.342640 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0e275a89-35d5-44da-9941-dfb0b79c8176 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:26.361926 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e275a89-35d5-44da-9941-dfb0b79c8176 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:26.362833 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e275a89-35d5-44da-9941-dfb0b79c8176 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:26.363509 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e275a89-35d5-44da-9941-dfb0b79c8176 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:26.364523 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e275a89-35d5-44da-9941-dfb0b79c8176 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:26.365269 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e275a89-35d5-44da-9941-dfb0b79c8176 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:26.366207 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e275a89-35d5-44da-9941-dfb0b79c8176 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:26.529483 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0e275a89-35d5-44da-9941-dfb0b79c8176 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "POST /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e/action" status: 204 len: 0 microversion: 2.1 time: 0.201085 Sep 24 20:51:26.534093 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 277/526] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:51:26 2022] POST /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e/action => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:51:26.565875 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-eacea7ba-97a9-45b1-8d59-50cd7aa60bd8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:26.567983 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-eacea7ba-97a9-45b1-8d59-50cd7aa60bd8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:26.586989 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eacea7ba-97a9-45b1-8d59-50cd7aa60bd8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:26.592485 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eacea7ba-97a9-45b1-8d59-50cd7aa60bd8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:26.593755 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eacea7ba-97a9-45b1-8d59-50cd7aa60bd8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:26.597833 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eacea7ba-97a9-45b1-8d59-50cd7aa60bd8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:26.598943 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eacea7ba-97a9-45b1-8d59-50cd7aa60bd8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:26.599725 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eacea7ba-97a9-45b1-8d59-50cd7aa60bd8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:27.548343 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-38a79212-f3b5-4a0b-8a03-4fbf271623a7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:27.562103 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-38a79212-f3b5-4a0b-8a03-4fbf271623a7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5" status: 200 len: 1504 microversion: 2.1 time: 1.264657 Sep 24 20:51:27.579728 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 250/527] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:26 2022] GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 => generated 1504 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:27.596373 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fb80e3d6-1e70-4a82-b6a9-35716638fe38 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:27.599245 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fb80e3d6-1e70-4a82-b6a9-35716638fe38 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: 95aa2033-71b1-41a6-b583-2fd183c18242] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:27.623006 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb80e3d6-1e70-4a82-b6a9-35716638fe38 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:27.623924 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb80e3d6-1e70-4a82-b6a9-35716638fe38 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:27.626409 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb80e3d6-1e70-4a82-b6a9-35716638fe38 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:27.628892 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb80e3d6-1e70-4a82-b6a9-35716638fe38 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:27.629658 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb80e3d6-1e70-4a82-b6a9-35716638fe38 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:27.630880 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb80e3d6-1e70-4a82-b6a9-35716638fe38 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:27.912358 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-eacea7ba-97a9-45b1-8d59-50cd7aa60bd8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:27.931201 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-eacea7ba-97a9-45b1-8d59-50cd7aa60bd8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1470 microversion: 2.1 time: 1.372391 Sep 24 20:51:27.932741 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 278/528] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:26 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1470 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:27.949921 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d22b194f-9053-4371-9177-1cc1bca79e59 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:27.951534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d22b194f-9053-4371-9177-1cc1bca79e59 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:27.967362 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d22b194f-9053-4371-9177-1cc1bca79e59 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:27.968292 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d22b194f-9053-4371-9177-1cc1bca79e59 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:27.974592 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d22b194f-9053-4371-9177-1cc1bca79e59 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:27.976409 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d22b194f-9053-4371-9177-1cc1bca79e59 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:27.979874 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d22b194f-9053-4371-9177-1cc1bca79e59 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:27.981926 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d22b194f-9053-4371-9177-1cc1bca79e59 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:28.152473 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d22b194f-9053-4371-9177-1cc1bca79e59 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:28.163438 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d22b194f-9053-4371-9177-1cc1bca79e59 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:28.167448 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d22b194f-9053-4371-9177-1cc1bca79e59 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:28.175224 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d22b194f-9053-4371-9177-1cc1bca79e59 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1555 microversion: 2.91 time: 0.238895 Sep 24 20:51:28.177431 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 279/529] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:51:27 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1555 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:51:28.251760 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fb80e3d6-1e70-4a82-b6a9-35716638fe38 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:28.283395 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fb80e3d6-1e70-4a82-b6a9-35716638fe38 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242" status: 200 len: 1313 microversion: 2.1 time: 0.697380 Sep 24 20:51:28.284298 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 251/530] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:27 2022] GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242 => generated 1313 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:28.594340 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c1ca1faf-e105-4633-af1c-0109482b44c7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:28.596176 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c1ca1faf-e105-4633-af1c-0109482b44c7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:28.608467 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1ca1faf-e105-4633-af1c-0109482b44c7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:28.612535 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b119f907-7da7-40f5-8df0-6992aa744e0a tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Calling method '.version_select at 0x7f4b0ca2db80>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:28.615643 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b119f907-7da7-40f5-8df0-6992aa744e0a tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:28.616161 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b119f907-7da7-40f5-8df0-6992aa744e0a tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:28.616614 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b119f907-7da7-40f5-8df0-6992aa744e0a tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:28.622773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1ca1faf-e105-4633-af1c-0109482b44c7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:28.624039 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1ca1faf-e105-4633-af1c-0109482b44c7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:28.627357 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1ca1faf-e105-4633-af1c-0109482b44c7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:28.651338 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1ca1faf-e105-4633-af1c-0109482b44c7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:28.652412 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b119f907-7da7-40f5-8df0-6992aa744e0a tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:28.653039 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b119f907-7da7-40f5-8df0-6992aa744e0a tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:28.653615 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b119f907-7da7-40f5-8df0-6992aa744e0a tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:28.654765 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1ca1faf-e105-4633-af1c-0109482b44c7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:28.684301 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b119f907-7da7-40f5-8df0-6992aa744e0a tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:28.684793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b119f907-7da7-40f5-8df0-6992aa744e0a tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:28.687682 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b119f907-7da7-40f5-8df0-6992aa744e0a tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:28.708256 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b119f907-7da7-40f5-8df0-6992aa744e0a tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.529419 Sep 24 20:51:28.708878 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 280/531] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:51:28 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:28.727276 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b04cfc40-977f-4ab8-b5d9-32a835869393 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Calling method '.version_select at 0x7f4b0ca2d5e0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:28.735125 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b04cfc40-977f-4ab8-b5d9-32a835869393 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:28.735655 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b04cfc40-977f-4ab8-b5d9-32a835869393 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:28.736111 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b04cfc40-977f-4ab8-b5d9-32a835869393 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:28.761529 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b04cfc40-977f-4ab8-b5d9-32a835869393 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:28.762032 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b04cfc40-977f-4ab8-b5d9-32a835869393 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:28.762475 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b04cfc40-977f-4ab8-b5d9-32a835869393 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:28.777452 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b04cfc40-977f-4ab8-b5d9-32a835869393 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:28.778317 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b04cfc40-977f-4ab8-b5d9-32a835869393 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:28.779139 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b04cfc40-977f-4ab8-b5d9-32a835869393 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:28.787476 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b04cfc40-977f-4ab8-b5d9-32a835869393 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.068282 Sep 24 20:51:28.789383 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 281/532] 10.222.0.52 () {58 vars in 1167 bytes} [Sat Sep 24 20:51:28 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:28.805600 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b426f857-72b9-4c4e-b660-0b8f33141b3f tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Calling method '.version_select at 0x7f4b0ca29160>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:28.812045 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b426f857-72b9-4c4e-b660-0b8f33141b3f tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:28.813826 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b426f857-72b9-4c4e-b660-0b8f33141b3f tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:28.815021 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b426f857-72b9-4c4e-b660-0b8f33141b3f tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:28.889005 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b426f857-72b9-4c4e-b660-0b8f33141b3f tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:28.889678 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b426f857-72b9-4c4e-b660-0b8f33141b3f tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:28.890272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b426f857-72b9-4c4e-b660-0b8f33141b3f tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:28.914448 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b426f857-72b9-4c4e-b660-0b8f33141b3f tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:28.916219 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b426f857-72b9-4c4e-b660-0b8f33141b3f tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:28.917835 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b426f857-72b9-4c4e-b660-0b8f33141b3f tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:28.925692 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b426f857-72b9-4c4e-b660-0b8f33141b3f tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.123657 Sep 24 20:51:28.926931 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 282/533] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:51:28 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:51:28.944352 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0c08b3f6-c8ea-486d-bcea-ea4198da1759 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Calling method '.version_select at 0x7f4b0ca4e670>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:28.946953 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0c08b3f6-c8ea-486d-bcea-ea4198da1759 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:28.949717 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0c08b3f6-c8ea-486d-bcea-ea4198da1759 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:28.951716 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0c08b3f6-c8ea-486d-bcea-ea4198da1759 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:28.981509 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0c08b3f6-c8ea-486d-bcea-ea4198da1759 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:28.982368 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0c08b3f6-c8ea-486d-bcea-ea4198da1759 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:28.983935 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0c08b3f6-c8ea-486d-bcea-ea4198da1759 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:28.991517 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0c08b3f6-c8ea-486d-bcea-ea4198da1759 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.057755 Sep 24 20:51:28.992752 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 283/534] 10.222.0.52 () {58 vars in 1152 bytes} [Sat Sep 24 20:51:28 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:28.998801 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7c728982-f837-467f-bdc5-bd36fc2aa32b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:28.999682 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7c728982-f837-467f-bdc5-bd36fc2aa32b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:29.008559 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7c728982-f837-467f-bdc5-bd36fc2aa32b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:29.009971 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7c728982-f837-467f-bdc5-bd36fc2aa32b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:29.011149 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7c728982-f837-467f-bdc5-bd36fc2aa32b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:29.012354 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7c728982-f837-467f-bdc5-bd36fc2aa32b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:29.013016 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7c728982-f837-467f-bdc5-bd36fc2aa32b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:29.013665 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7c728982-f837-467f-bdc5-bd36fc2aa32b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:29.204591 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c1ca1faf-e105-4633-af1c-0109482b44c7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:29.229965 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c1ca1faf-e105-4633-af1c-0109482b44c7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5" status: 200 len: 1504 microversion: 2.1 time: 0.639696 Sep 24 20:51:29.233024 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 252/535] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:28 2022] GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 => generated 1504 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:29.260283 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a45ea10f-421f-42a7-9f69-dc749db2eea1 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Calling method '.version_select at 0x7f4b0cf9a040>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:29.262931 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a45ea10f-421f-42a7-9f69-dc749db2eea1 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:29.263953 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a45ea10f-421f-42a7-9f69-dc749db2eea1 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:29.265861 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a45ea10f-421f-42a7-9f69-dc749db2eea1 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:29.290438 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a45ea10f-421f-42a7-9f69-dc749db2eea1 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.055931 Sep 24 20:51:29.302529 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 253/536] 10.222.0.52 () {58 vars in 1179 bytes} [Sat Sep 24 20:51:29 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:29.314001 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5577ddc9-b485-4c02-a2d6-b8d76e52d3ef tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:29.315454 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5577ddc9-b485-4c02-a2d6-b8d76e52d3ef tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:29.324493 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5577ddc9-b485-4c02-a2d6-b8d76e52d3ef tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:29.325417 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5577ddc9-b485-4c02-a2d6-b8d76e52d3ef tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:29.326099 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5577ddc9-b485-4c02-a2d6-b8d76e52d3ef tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:29.327416 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5577ddc9-b485-4c02-a2d6-b8d76e52d3ef tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:29.328717 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5577ddc9-b485-4c02-a2d6-b8d76e52d3ef tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:29.329494 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5577ddc9-b485-4c02-a2d6-b8d76e52d3ef tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:29.582863 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5577ddc9-b485-4c02-a2d6-b8d76e52d3ef tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:29.598141 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5577ddc9-b485-4c02-a2d6-b8d76e52d3ef tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:29.607048 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5577ddc9-b485-4c02-a2d6-b8d76e52d3ef tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:29.623914 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5577ddc9-b485-4c02-a2d6-b8d76e52d3ef tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1555 microversion: 2.91 time: 0.319726 Sep 24 20:51:29.626327 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 254/537] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:51:29 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1555 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:51:29.630656 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-15612a7a-47c5-41c5-83f0-611f20c23493 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Calling method '.version_select at 0x7f4b0cfb2c10>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:29.642282 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15612a7a-47c5-41c5-83f0-611f20c23493 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:29.654453 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15612a7a-47c5-41c5-83f0-611f20c23493 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:29.655119 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15612a7a-47c5-41c5-83f0-611f20c23493 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:29.686845 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15612a7a-47c5-41c5-83f0-611f20c23493 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:29.688280 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15612a7a-47c5-41c5-83f0-611f20c23493 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:29.688875 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15612a7a-47c5-41c5-83f0-611f20c23493 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:29.716272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7c728982-f837-467f-bdc5-bd36fc2aa32b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:29.718527 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15612a7a-47c5-41c5-83f0-611f20c23493 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:29.721309 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15612a7a-47c5-41c5-83f0-611f20c23493 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:29.721950 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15612a7a-47c5-41c5-83f0-611f20c23493 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:29.725865 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7c728982-f837-467f-bdc5-bd36fc2aa32b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1470 microversion: 2.1 time: 0.730980 Sep 24 20:51:29.729205 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 284/538] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:28 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1470 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:29.744408 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-400bdcb1-0222-4459-aef0-13b67c7b6f3e tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:29.745642 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-400bdcb1-0222-4459-aef0-13b67c7b6f3e tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: 95aa2033-71b1-41a6-b583-2fd183c18242] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:29.750440 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-15612a7a-47c5-41c5-83f0-611f20c23493 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.123125 Sep 24 20:51:29.754652 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-400bdcb1-0222-4459-aef0-13b67c7b6f3e tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:29.755574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-400bdcb1-0222-4459-aef0-13b67c7b6f3e tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:29.756380 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-400bdcb1-0222-4459-aef0-13b67c7b6f3e tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:29.757119 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 255/539] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:51:29 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:29.757821 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-400bdcb1-0222-4459-aef0-13b67c7b6f3e tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:29.758772 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-400bdcb1-0222-4459-aef0-13b67c7b6f3e tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:29.760796 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-400bdcb1-0222-4459-aef0-13b67c7b6f3e tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:29.767566 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-bc02eaef-a7fc-446e-a5d8-4630429de23e req-e0c38a51-3269-4b21-a124-94a916ffa8d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f389d01c-08ec-42e6-81a1-85aedcdfe42e", "name": "network-vif-plugged", "status": "completed", "tag": "d104313c-4d9a-4ffb-8015-0f9ee3bfbcb1"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:29.788505 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-bc02eaef-a7fc-446e-a5d8-4630429de23e req-e0c38a51-3269-4b21-a124-94a916ffa8d0 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:29.789093 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-bc02eaef-a7fc-446e-a5d8-4630429de23e req-e0c38a51-3269-4b21-a124-94a916ffa8d0 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:29.789533 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-bc02eaef-a7fc-446e-a5d8-4630429de23e req-e0c38a51-3269-4b21-a124-94a916ffa8d0 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:29.792511 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:51:29.815195 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-bc02eaef-a7fc-446e-a5d8-4630429de23e req-e0c38a51-3269-4b21-a124-94a916ffa8d0 service nova] Creating event network-vif-plugged:d104313c-4d9a-4ffb-8015-0f9ee3bfbcb1 for instance f389d01c-08ec-42e6-81a1-85aedcdfe42e on nch2-master-1 Sep 24 20:51:29.843617 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [req-bc02eaef-a7fc-446e-a5d8-4630429de23e req-e0c38a51-3269-4b21-a124-94a916ffa8d0 service nova] Instance f389d01c-08ec-42e6-81a1-85aedcdfe42e is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 20:51:29.858797 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-bc02eaef-a7fc-446e-a5d8-4630429de23e req-e0c38a51-3269-4b21-a124-94a916ffa8d0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099554 Sep 24 20:51:29.862684 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 256/540] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:29.870179 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-832b3ab8-71eb-47bf-bee1-db4469d9f2a1 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Calling method '.version_select at 0x7f4b0cf9a280>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:29.873365 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-832b3ab8-71eb-47bf-bee1-db4469d9f2a1 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:29.874171 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-832b3ab8-71eb-47bf-bee1-db4469d9f2a1 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:29.882911 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-832b3ab8-71eb-47bf-bee1-db4469d9f2a1 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:29.905163 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-832b3ab8-71eb-47bf-bee1-db4469d9f2a1 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:29.905931 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-832b3ab8-71eb-47bf-bee1-db4469d9f2a1 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:29.907336 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-832b3ab8-71eb-47bf-bee1-db4469d9f2a1 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:29.916358 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-832b3ab8-71eb-47bf-bee1-db4469d9f2a1 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.052197 Sep 24 20:51:29.917995 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 257/541] 10.222.0.52 () {58 vars in 1152 bytes} [Sat Sep 24 20:51:29 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:29.938784 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-12636552-9fe9-47a9-9f02-6a50ade753ec tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Calling method '.version_select at 0x7f4b0d2fe4c0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:29.940615 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12636552-9fe9-47a9-9f02-6a50ade753ec tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:29.941111 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12636552-9fe9-47a9-9f02-6a50ade753ec tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:29.941558 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12636552-9fe9-47a9-9f02-6a50ade753ec tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:29.981072 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12636552-9fe9-47a9-9f02-6a50ade753ec tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:29.981189 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12636552-9fe9-47a9-9f02-6a50ade753ec tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:29.981758 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12636552-9fe9-47a9-9f02-6a50ade753ec tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:29.995714 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-12636552-9fe9-47a9-9f02-6a50ade753ec tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.066511 Sep 24 20:51:30.002845 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 258/542] 10.222.0.52 () {58 vars in 1152 bytes} [Sat Sep 24 20:51:29 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:30.015361 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-514ebd5f-2a3b-4d10-b5dd-5e5619bc1d19 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Calling method '.version_select at 0x7f4b0d17b700>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:30.017426 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-514ebd5f-2a3b-4d10-b5dd-5e5619bc1d19 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:30.018070 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-514ebd5f-2a3b-4d10-b5dd-5e5619bc1d19 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:30.018821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-514ebd5f-2a3b-4d10-b5dd-5e5619bc1d19 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:30.034073 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-514ebd5f-2a3b-4d10-b5dd-5e5619bc1d19 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:30.035749 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-514ebd5f-2a3b-4d10-b5dd-5e5619bc1d19 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:30.036358 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-514ebd5f-2a3b-4d10-b5dd-5e5619bc1d19 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:30.053601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-514ebd5f-2a3b-4d10-b5dd-5e5619bc1d19 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:30.054100 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-514ebd5f-2a3b-4d10-b5dd-5e5619bc1d19 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:30.054559 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-514ebd5f-2a3b-4d10-b5dd-5e5619bc1d19 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:30.165767 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-514ebd5f-2a3b-4d10-b5dd-5e5619bc1d19 tempest-HypervisorAdminTestJSON-1101510951 tempest-HypervisorAdminTestJSON-1101510951-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.148479 Sep 24 20:51:30.174305 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 259/543] 10.222.0.52 () {58 vars in 1173 bytes} [Sat Sep 24 20:51:30 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:30.261714 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-400bdcb1-0222-4459-aef0-13b67c7b6f3e tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:30.271483 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-400bdcb1-0222-4459-aef0-13b67c7b6f3e tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242" status: 200 len: 1463 microversion: 2.1 time: 0.540113 Sep 24 20:51:30.273356 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 285/544] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:29 2022] GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242 => generated 1463 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:30.276211 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6d7beaba-68e9-4e63-b8fb-12515b8b9275 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:30.277186 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6d7beaba-68e9-4e63-b8fb-12515b8b9275 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:30.284961 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=5,nova_api:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:51:30.291532 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6d7beaba-68e9-4e63-b8fb-12515b8b9275 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:30.292391 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6d7beaba-68e9-4e63-b8fb-12515b8b9275 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:30.293005 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6d7beaba-68e9-4e63-b8fb-12515b8b9275 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:30.294085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6d7beaba-68e9-4e63-b8fb-12515b8b9275 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:30.294947 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6d7beaba-68e9-4e63-b8fb-12515b8b9275 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:30.295615 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6d7beaba-68e9-4e63-b8fb-12515b8b9275 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:30.305927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cca92f5f-5d31-44ac-a72d-74ffdc376d75 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:30.307290 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cca92f5f-5d31-44ac-a72d-74ffdc376d75 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:30.320462 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cca92f5f-5d31-44ac-a72d-74ffdc376d75 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:30.321307 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cca92f5f-5d31-44ac-a72d-74ffdc376d75 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:30.323039 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cca92f5f-5d31-44ac-a72d-74ffdc376d75 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:30.325331 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cca92f5f-5d31-44ac-a72d-74ffdc376d75 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:30.326121 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cca92f5f-5d31-44ac-a72d-74ffdc376d75 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:30.328431 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cca92f5f-5d31-44ac-a72d-74ffdc376d75 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:30.370896 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:51:30.771988 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6d7beaba-68e9-4e63-b8fb-12515b8b9275 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:30.786254 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6d7beaba-68e9-4e63-b8fb-12515b8b9275 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5" status: 200 len: 1494 microversion: 2.1 time: 0.528799 Sep 24 20:51:30.788409 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 260/545] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:30 2022] GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 => generated 1494 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:30.803610 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cca92f5f-5d31-44ac-a72d-74ffdc376d75 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:30.812943 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a5b6365d-511c-49dc-a875-9028f33cb54f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:30.814026 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a5b6365d-511c-49dc-a875-9028f33cb54f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:30.820742 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5b6365d-511c-49dc-a875-9028f33cb54f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:30.832728 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5b6365d-511c-49dc-a875-9028f33cb54f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:30.835408 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cca92f5f-5d31-44ac-a72d-74ffdc376d75 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1462 microversion: 2.1 time: 0.533147 Sep 24 20:51:30.836046 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 286/546] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:30 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1462 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:30.836603 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5b6365d-511c-49dc-a875-9028f33cb54f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:30.838268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5b6365d-511c-49dc-a875-9028f33cb54f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:30.840543 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5b6365d-511c-49dc-a875-9028f33cb54f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:30.841016 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5b6365d-511c-49dc-a875-9028f33cb54f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:30.859577 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-734f61f2-a762-4a0f-8194-4a92b691ec44 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:30.862897 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-734f61f2-a762-4a0f-8194-4a92b691ec44 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:30.886287 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-734f61f2-a762-4a0f-8194-4a92b691ec44 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:30.888817 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-734f61f2-a762-4a0f-8194-4a92b691ec44 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:30.889278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-734f61f2-a762-4a0f-8194-4a92b691ec44 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:30.890028 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-734f61f2-a762-4a0f-8194-4a92b691ec44 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:30.890708 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-734f61f2-a762-4a0f-8194-4a92b691ec44 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:30.898077 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-734f61f2-a762-4a0f-8194-4a92b691ec44 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:31.210588 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a5b6365d-511c-49dc-a875-9028f33cb54f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:31.230603 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a5b6365d-511c-49dc-a875-9028f33cb54f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:31.233765 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a5b6365d-511c-49dc-a875-9028f33cb54f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:31.248518 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a5b6365d-511c-49dc-a875-9028f33cb54f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1555 microversion: 2.91 time: 0.440027 Sep 24 20:51:31.269565 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 261/547] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:51:30 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1555 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:51:31.291613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-84d733d3-a51e-4bbd-8767-fec6bd1ff3d3 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Calling method '.version_select at 0x7f4b0cfe39d0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:31.297467 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84d733d3-a51e-4bbd-8767-fec6bd1ff3d3 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:31.309682 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84d733d3-a51e-4bbd-8767-fec6bd1ff3d3 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:31.310614 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84d733d3-a51e-4bbd-8767-fec6bd1ff3d3 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:31.355413 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-84d733d3-a51e-4bbd-8767-fec6bd1ff3d3 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 793 microversion: 2.1 time: 0.074953 Sep 24 20:51:31.356695 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 262/548] 10.222.0.52 () {58 vars in 1143 bytes} [Sat Sep 24 20:51:31 2022] GET /compute/v2.1/os-migrations => generated 793 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:31.385751 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7d62fbe8-606f-425b-aacd-c3fa150181da tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1191779388", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "bdb37c4d-e841-4e13-b809-e3f19ce6365a"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:31.403796 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-734f61f2-a762-4a0f-8194-4a92b691ec44 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:31.426239 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-734f61f2-a762-4a0f-8194-4a92b691ec44 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1470 microversion: 2.1 time: 0.584393 Sep 24 20:51:31.429425 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 287/549] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:30 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1470 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:31.451306 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6de3c3bf-61e1-4cf1-a30f-2182ad131a95 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:31.452215 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6de3c3bf-61e1-4cf1-a30f-2182ad131a95 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] [instance: 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:31.465417 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6de3c3bf-61e1-4cf1-a30f-2182ad131a95 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:31.468666 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6de3c3bf-61e1-4cf1-a30f-2182ad131a95 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:31.469283 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6de3c3bf-61e1-4cf1-a30f-2182ad131a95 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:31.470802 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6de3c3bf-61e1-4cf1-a30f-2182ad131a95 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:31.471504 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6de3c3bf-61e1-4cf1-a30f-2182ad131a95 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:31.472087 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6de3c3bf-61e1-4cf1-a30f-2182ad131a95 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:31.535935 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-7d62fbe8-606f-425b-aacd-c3fa150181da tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] validate_networks() for None {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:51:31.804531 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6de3c3bf-61e1-4cf1-a30f-2182ad131a95 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5" status: 200 len: 1645 microversion: 2.1 time: 0.369125 Sep 24 20:51:31.813033 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 288/550] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:31 2022] GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 => generated 1645 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:32.016810 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-7d62fbe8-606f-425b-aacd-c3fa150181da tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:51:32.017386 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-7d62fbe8-606f-425b-aacd-c3fa150181da tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:51:32.017922 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-7d62fbe8-606f-425b-aacd-c3fa150181da tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:51:32.018533 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-7d62fbe8-606f-425b-aacd-c3fa150181da tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:51:32.019162 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-7d62fbe8-606f-425b-aacd-c3fa150181da tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:51:32.035713 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d62fbe8-606f-425b-aacd-c3fa150181da tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:32.036750 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d62fbe8-606f-425b-aacd-c3fa150181da tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:32.037402 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d62fbe8-606f-425b-aacd-c3fa150181da tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:32.038572 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d62fbe8-606f-425b-aacd-c3fa150181da tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:32.039279 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d62fbe8-606f-425b-aacd-c3fa150181da tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:32.039921 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d62fbe8-606f-425b-aacd-c3fa150181da tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:32.065526 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-7d62fbe8-606f-425b-aacd-c3fa150181da tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Getting quotas for project 5e68660c954f47f9bad1f7bee17f9435. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:51:32.072606 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-7d62fbe8-606f-425b-aacd-c3fa150181da tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Getting quotas for user 9eec3a30bcc641ca8ecee19471007b1d and project 5e68660c954f47f9bad1f7bee17f9435. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:51:32.089035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7d62fbe8-606f-425b-aacd-c3fa150181da tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:51:32.092576 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7d62fbe8-606f-425b-aacd-c3fa150181da tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: a44ee230-ea66-4c1b-90e4-4e5a9a0cd994] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:51:32.160598 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9f5857f3-c992-4d78-ad32-ab77f38f28c7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-148164030", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "89b13b8f-db96-4ded-b022-c0f1faad59f4"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:32.178463 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7d62fbe8-606f-425b-aacd-c3fa150181da tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.814543 Sep 24 20:51:32.179522 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 263/551] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:51:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:51:32.193730 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0b96fa01-947d-42ea-8aae-0f63b33dd09c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:32.195480 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0b96fa01-947d-42ea-8aae-0f63b33dd09c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: a44ee230-ea66-4c1b-90e4-4e5a9a0cd994] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:32.313971 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0b96fa01-947d-42ea-8aae-0f63b33dd09c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:32.322131 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0b96fa01-947d-42ea-8aae-0f63b33dd09c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994" status: 200 len: 1214 microversion: 2.1 time: 0.133511 Sep 24 20:51:32.330287 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-9f5857f3-c992-4d78-ad32-ab77f38f28c7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] validate_networks() for [('89b13b8f-db96-4ded-b022-c0f1faad59f4', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:51:32.343643 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 264/552] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:32 2022] GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 => generated 1214 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:32.366643 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b4ebd822-2ffd-4061-9084-a5b9a583b8fd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:32.367492 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b4ebd822-2ffd-4061-9084-a5b9a583b8fd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:32.393275 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b4ebd822-2ffd-4061-9084-a5b9a583b8fd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:32.399764 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b4ebd822-2ffd-4061-9084-a5b9a583b8fd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:32.402246 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b4ebd822-2ffd-4061-9084-a5b9a583b8fd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:32.404648 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b4ebd822-2ffd-4061-9084-a5b9a583b8fd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:32.405824 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b4ebd822-2ffd-4061-9084-a5b9a583b8fd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:32.412135 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b4ebd822-2ffd-4061-9084-a5b9a583b8fd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:32.855880 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b4ebd822-2ffd-4061-9084-a5b9a583b8fd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:32.870601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b4ebd822-2ffd-4061-9084-a5b9a583b8fd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:32.877282 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b4ebd822-2ffd-4061-9084-a5b9a583b8fd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:32.898177 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b4ebd822-2ffd-4061-9084-a5b9a583b8fd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1555 microversion: 2.91 time: 0.550077 Sep 24 20:51:32.900002 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 265/553] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:51:32 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1555 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:51:32.920936 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7f45864f-b5cf-4e99-b635-e092f8be44fc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:32.921828 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7f45864f-b5cf-4e99-b635-e092f8be44fc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:32.933774 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f45864f-b5cf-4e99-b635-e092f8be44fc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:32.935001 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f45864f-b5cf-4e99-b635-e092f8be44fc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:32.936604 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f45864f-b5cf-4e99-b635-e092f8be44fc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:32.937519 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f45864f-b5cf-4e99-b635-e092f8be44fc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:32.940565 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f45864f-b5cf-4e99-b635-e092f8be44fc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:32.941147 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f45864f-b5cf-4e99-b635-e092f8be44fc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:33.385570 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7f45864f-b5cf-4e99-b635-e092f8be44fc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:33.404814 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7f45864f-b5cf-4e99-b635-e092f8be44fc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1462 microversion: 2.1 time: 0.498442 Sep 24 20:51:33.405474 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 266/554] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:32 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1462 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:33.410093 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6fedb29f-b643-4ff0-9e65-495089629e59 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:33.410728 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6fedb29f-b643-4ff0-9e65-495089629e59 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: a44ee230-ea66-4c1b-90e4-4e5a9a0cd994] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:33.676668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6fedb29f-b643-4ff0-9e65-495089629e59 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:33.687556 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6fedb29f-b643-4ff0-9e65-495089629e59 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994" status: 200 len: 1214 microversion: 2.1 time: 0.280853 Sep 24 20:51:33.688557 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 267/555] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:33 2022] GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 => generated 1214 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:33.714707 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-23f9d1a8-5dbd-4661-a8bb-57d21a4e3297 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:33.715822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-23f9d1a8-5dbd-4661-a8bb-57d21a4e3297 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:33.732159 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23f9d1a8-5dbd-4661-a8bb-57d21a4e3297 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:33.732925 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23f9d1a8-5dbd-4661-a8bb-57d21a4e3297 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:33.734060 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23f9d1a8-5dbd-4661-a8bb-57d21a4e3297 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:33.735057 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23f9d1a8-5dbd-4661-a8bb-57d21a4e3297 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:33.736236 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23f9d1a8-5dbd-4661-a8bb-57d21a4e3297 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:33.736879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23f9d1a8-5dbd-4661-a8bb-57d21a4e3297 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:33.878299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-9f5857f3-c992-4d78-ad32-ab77f38f28c7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:51:33.878299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-9f5857f3-c992-4d78-ad32-ab77f38f28c7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:51:33.878299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-9f5857f3-c992-4d78-ad32-ab77f38f28c7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:51:33.878299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-9f5857f3-c992-4d78-ad32-ab77f38f28c7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:51:33.878997 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-9f5857f3-c992-4d78-ad32-ab77f38f28c7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:51:33.900748 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9f5857f3-c992-4d78-ad32-ab77f38f28c7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:33.912490 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9f5857f3-c992-4d78-ad32-ab77f38f28c7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:33.915399 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9f5857f3-c992-4d78-ad32-ab77f38f28c7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:33.917840 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9f5857f3-c992-4d78-ad32-ab77f38f28c7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:33.922799 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9f5857f3-c992-4d78-ad32-ab77f38f28c7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:33.924067 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9f5857f3-c992-4d78-ad32-ab77f38f28c7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:33.982068 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-9f5857f3-c992-4d78-ad32-ab77f38f28c7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Getting quotas for project a2b7e30f79bf42e497c53c091ad0a106. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:51:34.000354 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-9f5857f3-c992-4d78-ad32-ab77f38f28c7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Getting quotas for user 9c03c67e0c4c4de7a186f28ac10d0b92 and project a2b7e30f79bf42e497c53c091ad0a106. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:51:34.043663 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9f5857f3-c992-4d78-ad32-ab77f38f28c7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:51:34.046289 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9f5857f3-c992-4d78-ad32-ab77f38f28c7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:51:34.048844 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-23f9d1a8-5dbd-4661-a8bb-57d21a4e3297 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1613 microversion: 2.1 time: 0.340967 Sep 24 20:51:34.050779 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 268/556] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:33 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1613 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:34.174194 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9f5857f3-c992-4d78-ad32-ab77f38f28c7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.018007 Sep 24 20:51:34.177514 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 289/557] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:51:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:51:34.190302 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0263d985-7954-4017-bd58-399e802553e9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:34.192744 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0263d985-7954-4017-bd58-399e802553e9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:34.204344 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0263d985-7954-4017-bd58-399e802553e9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:34.205106 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0263d985-7954-4017-bd58-399e802553e9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:34.233815 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0263d985-7954-4017-bd58-399e802553e9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:34.235848 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0263d985-7954-4017-bd58-399e802553e9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:34.238973 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0263d985-7954-4017-bd58-399e802553e9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:34.239429 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0263d985-7954-4017-bd58-399e802553e9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:34.523340 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0263d985-7954-4017-bd58-399e802553e9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:34.532018 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0263d985-7954-4017-bd58-399e802553e9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:34.545358 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0263d985-7954-4017-bd58-399e802553e9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:34.568355 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0263d985-7954-4017-bd58-399e802553e9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1555 microversion: 2.91 time: 0.388003 Sep 24 20:51:34.578574 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 290/558] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:51:34 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1555 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:51:34.583556 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0f29c4fe-b05e-45df-9800-8f9724f9872c tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Calling method '.version_select at 0x7f4b0cacb550>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:34.605264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0f29c4fe-b05e-45df-9800-8f9724f9872c tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:34.605264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0f29c4fe-b05e-45df-9800-8f9724f9872c tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:34.605264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0f29c4fe-b05e-45df-9800-8f9724f9872c tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:34.659721 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0f29c4fe-b05e-45df-9800-8f9724f9872c tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 793 microversion: 2.1 time: 0.069448 Sep 24 20:51:34.671475 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 291/559] 10.222.0.52 () {58 vars in 1143 bytes} [Sat Sep 24 20:51:34 2022] GET /compute/v2.1/os-migrations => generated 793 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:34.676338 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c7657cc5-066e-4fe8-acb7-1e96580a3a42 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:34.676964 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c7657cc5-066e-4fe8-acb7-1e96580a3a42 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:34.751893 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-43e28339-18ca-4c69-acb9-af6ee384e199 tempest-KeyPairsV210TestJSON-1153530846 tempest-KeyPairsV210TestJSON-1153530846-project-admin] Action: 'create', calling method: .version_select at 0x7f4b0cec7700>, body: {"keypair": {"name": "tempest-keypair-732005535", "type": "ssh", "user_id": "f594da00255b413e92574deabe5b2427", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4aP8EX/D+NWy8xpMHoCbo+98TsO5xGnkPN6uf+sexIH7rrvkzvHzoC6G1AzxvvXjQ6Z+14uZ2XWjhUABATiZrP/6icIfhBkYel8By8eD/0pdDuCpqwknnv047wk4monA=="}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:34.784594 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-43e28339-18ca-4c69-acb9-af6ee384e199 tempest-KeyPairsV210TestJSON-1153530846 tempest-KeyPairsV210TestJSON-1153530846-project-admin] Getting quotas for project 4e088fce2b6b49ba90f68bf8ea1529f8. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:51:34.792444 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-43e28339-18ca-4c69-acb9-af6ee384e199 tempest-KeyPairsV210TestJSON-1153530846 tempest-KeyPairsV210TestJSON-1153530846-project-admin] Getting quotas for user b01746ed5b6541b8b764e5b66c919193 and project 4e088fce2b6b49ba90f68bf8ea1529f8. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:51:34.810089 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c7657cc5-066e-4fe8-acb7-1e96580a3a42 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:34.820561 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c7657cc5-066e-4fe8-acb7-1e96580a3a42 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d" status: 200 len: 1210 microversion: 2.1 time: 0.147370 Sep 24 20:51:34.821246 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 292/560] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:34 2022] GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d => generated 1210 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:34.837124 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cd14488d-4993-4a15-88a1-4c2821ac879e tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:34.839805 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cd14488d-4993-4a15-88a1-4c2821ac879e tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: a44ee230-ea66-4c1b-90e4-4e5a9a0cd994] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:34.848340 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-43e28339-18ca-4c69-acb9-af6ee384e199 tempest-KeyPairsV210TestJSON-1153530846 tempest-KeyPairsV210TestJSON-1153530846-project-admin] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.794859 Sep 24 20:51:34.851749 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 269/561] 10.222.0.52 () {62 vars in 1200 bytes} [Sat Sep 24 20:51:34 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 799 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 24 20:51:34.861216 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd14488d-4993-4a15-88a1-4c2821ac879e tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:34.861216 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd14488d-4993-4a15-88a1-4c2821ac879e tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:34.861216 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd14488d-4993-4a15-88a1-4c2821ac879e tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:34.861216 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd14488d-4993-4a15-88a1-4c2821ac879e tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:34.862135 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd14488d-4993-4a15-88a1-4c2821ac879e tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:34.862135 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd14488d-4993-4a15-88a1-4c2821ac879e tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:34.887210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-47893f61-1e37-4c59-b52d-79f708a5a2c5 tempest-KeyPairsV210TestJSON-1153530846 tempest-KeyPairsV210TestJSON-1153530846-project-admin] Action: 'create', calling method: .version_select at 0x7f4b0cec7430>, body: {"keypair": {"name": "tempest-keypair-562768945", "type": "ssh", "user_id": "f594da00255b413e92574deabe5b2427", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUeKuyTC/hE6zjVnMOMQ4/xGr5E1npW35nG8lRWQR/ZP47ub8WYFcD+SAo3Z7YdkKjt5NC3Ve4QGSp1J2Ov15hIWYre9BN+t6kwpP2QufR8OBsKZw/1RgOmQUCHVce1cA=="}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:34.943040 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cd14488d-4993-4a15-88a1-4c2821ac879e tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:34.948270 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-47893f61-1e37-4c59-b52d-79f708a5a2c5 tempest-KeyPairsV210TestJSON-1153530846 tempest-KeyPairsV210TestJSON-1153530846-project-admin] Getting quotas for project 4e088fce2b6b49ba90f68bf8ea1529f8. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:51:34.953553 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cd14488d-4993-4a15-88a1-4c2821ac879e tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994" status: 200 len: 1266 microversion: 2.1 time: 0.128799 Sep 24 20:51:34.956243 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 293/562] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:34 2022] GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 => generated 1266 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:34.966431 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8521238d-a0ed-4c94-ad07-4501e33d7b0f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-949438818", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:34.970848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-47893f61-1e37-4c59-b52d-79f708a5a2c5 tempest-KeyPairsV210TestJSON-1153530846 tempest-KeyPairsV210TestJSON-1153530846-project-admin] Getting quotas for user b01746ed5b6541b8b764e5b66c919193 and project 4e088fce2b6b49ba90f68bf8ea1529f8. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:51:35.016530 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-47893f61-1e37-4c59-b52d-79f708a5a2c5 tempest-KeyPairsV210TestJSON-1153530846 tempest-KeyPairsV210TestJSON-1153530846-project-admin] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.150324 Sep 24 20:51:35.018237 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 270/563] 10.222.0.52 () {62 vars in 1200 bytes} [Sat Sep 24 20:51:34 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 155 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 24 20:51:35.029375 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1b31363a-ae43-46b8-acc2-c16cbc1e0e81 tempest-KeyPairsV210TestJSON-1153530846 tempest-KeyPairsV210TestJSON-1153530846-project-admin] Calling method '.version_select at 0x7f4b0cf9af70>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:35.053699 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-8521238d-a0ed-4c94-ad07-4501e33d7b0f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] validate_networks() for None {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:51:35.063948 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1b31363a-ae43-46b8-acc2-c16cbc1e0e81 tempest-KeyPairsV210TestJSON-1153530846 tempest-KeyPairsV210TestJSON-1153530846-project-admin] 10.222.0.52 "GET /compute/v2.1/os-keypairs/tempest-keypair-732005535?user_id=f594da00255b413e92574deabe5b2427" status: 200 len: 511 microversion: 2.10 time: 0.038298 Sep 24 20:51:35.075923 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 271/564] 10.222.0.52 () {60 vars in 1337 bytes} [Sat Sep 24 20:51:35 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-732005535?user_id=f594da00255b413e92574deabe5b2427 => generated 511 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:51:35.081205 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dab9d2fb-662f-494c-972f-08b2f314d6e9 tempest-KeyPairsV210TestJSON-1153530846 tempest-KeyPairsV210TestJSON-1153530846-project-admin] Action: 'create', calling method: .version_select at 0x7f4b0cf9a4c0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-2128363551", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAQ0O4CDO1w0qiY1SpMf20Tp7WY1ZvHWaICYyPmQqSYWMFHuRTKdEoKXIITHKi7ZbKZ5x9GRNAz0mheDfM2RQZWApLdY4P1MgWIqAOa1V8ekyXXeIM6e8cotKZUSo+3bg=="}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:35.098753 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-dab9d2fb-662f-494c-972f-08b2f314d6e9 tempest-KeyPairsV210TestJSON-1153530846 tempest-KeyPairsV210TestJSON-1153530846-project-admin] Getting quotas for project 4e088fce2b6b49ba90f68bf8ea1529f8. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:51:35.104257 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-dab9d2fb-662f-494c-972f-08b2f314d6e9 tempest-KeyPairsV210TestJSON-1153530846 tempest-KeyPairsV210TestJSON-1153530846-project-admin] Getting quotas for user b01746ed5b6541b8b764e5b66c919193 and project 4e088fce2b6b49ba90f68bf8ea1529f8. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:51:35.181579 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dab9d2fb-662f-494c-972f-08b2f314d6e9 tempest-KeyPairsV210TestJSON-1153530846 tempest-KeyPairsV210TestJSON-1153530846-project-admin] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.103021 Sep 24 20:51:35.189587 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 272/565] 10.222.0.52 () {62 vars in 1200 bytes} [Sat Sep 24 20:51:35 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 113 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 24 20:51:35.202217 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-deec4567-80b1-4cc9-95be-91baed43f58e tempest-KeyPairsV210TestJSON-1153530846 tempest-KeyPairsV210TestJSON-1153530846-project-admin] Calling method '.version_select at 0x7f4b0cf77310>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:35.206201 ncdv-master-1 devstack@n-api.service[140517]: WARNING oslo_db.sqlalchemy.utils [None req-deec4567-80b1-4cc9-95be-91baed43f58e tempest-KeyPairsV210TestJSON-1153530846 tempest-KeyPairsV210TestJSON-1153530846-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Sep 24 20:51:35.231194 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-deec4567-80b1-4cc9-95be-91baed43f58e tempest-KeyPairsV210TestJSON-1153530846 tempest-KeyPairsV210TestJSON-1153530846-project-admin] 10.222.0.52 "GET /compute/v2.1/os-keypairs?user_id=f594da00255b413e92574deabe5b2427" status: 200 len: 724 microversion: 2.10 time: 0.039218 Sep 24 20:51:35.237372 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 273/566] 10.222.0.52 () {60 vars in 1259 bytes} [Sat Sep 24 20:51:35 2022] GET /compute/v2.1/os-keypairs?user_id=f594da00255b413e92574deabe5b2427 => generated 724 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:51:35.242066 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-272fdd3f-7631-4cc0-ab7f-bd8c76d5def4 tempest-KeyPairsV210TestJSON-1153530846 tempest-KeyPairsV210TestJSON-1153530846-project-admin] Calling method '.version_select at 0x7f4b0cf9af70>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:35.291317 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-272fdd3f-7631-4cc0-ab7f-bd8c76d5def4 tempest-KeyPairsV210TestJSON-1153530846 tempest-KeyPairsV210TestJSON-1153530846-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-2128363551" status: 204 len: 0 microversion: 2.10 time: 0.053129 Sep 24 20:51:35.292144 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 274/567] 10.222.0.52 () {60 vars in 1325 bytes} [Sat Sep 24 20:51:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-2128363551 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 24 20:51:35.301745 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-18158dff-6e83-4dfd-aa1f-590c23b41c3e tempest-KeyPairsV210TestJSON-1153530846 tempest-KeyPairsV210TestJSON-1153530846-project-admin] Calling method '.version_select at 0x7f4b0cec7430>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:35.349814 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-18158dff-6e83-4dfd-aa1f-590c23b41c3e tempest-KeyPairsV210TestJSON-1153530846 tempest-KeyPairsV210TestJSON-1153530846-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-562768945?user_id=f594da00255b413e92574deabe5b2427" status: 204 len: 0 microversion: 2.10 time: 0.052640 Sep 24 20:51:35.350763 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 275/568] 10.222.0.52 () {60 vars in 1340 bytes} [Sat Sep 24 20:51:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-562768945?user_id=f594da00255b413e92574deabe5b2427 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 24 20:51:35.359498 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cb6898f8-82c3-435f-a61c-4f9d1b70fbac tempest-KeyPairsV210TestJSON-1153530846 tempest-KeyPairsV210TestJSON-1153530846-project-admin] Calling method '.version_select at 0x7f4b0cfb2c10>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:35.387051 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cb6898f8-82c3-435f-a61c-4f9d1b70fbac tempest-KeyPairsV210TestJSON-1153530846 tempest-KeyPairsV210TestJSON-1153530846-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-732005535?user_id=f594da00255b413e92574deabe5b2427" status: 204 len: 0 microversion: 2.10 time: 0.030213 Sep 24 20:51:35.388018 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 276/569] 10.222.0.52 () {60 vars in 1340 bytes} [Sat Sep 24 20:51:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-732005535?user_id=f594da00255b413e92574deabe5b2427 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 24 20:51:35.485925 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-8521238d-a0ed-4c94-ad07-4501e33d7b0f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:51:35.486654 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-8521238d-a0ed-4c94-ad07-4501e33d7b0f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:51:35.487383 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-8521238d-a0ed-4c94-ad07-4501e33d7b0f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:51:35.488027 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-8521238d-a0ed-4c94-ad07-4501e33d7b0f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:51:35.488642 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-8521238d-a0ed-4c94-ad07-4501e33d7b0f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:51:35.500235 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8521238d-a0ed-4c94-ad07-4501e33d7b0f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:35.501152 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8521238d-a0ed-4c94-ad07-4501e33d7b0f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:35.501894 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8521238d-a0ed-4c94-ad07-4501e33d7b0f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:35.502896 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8521238d-a0ed-4c94-ad07-4501e33d7b0f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:35.503594 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8521238d-a0ed-4c94-ad07-4501e33d7b0f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:35.504235 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8521238d-a0ed-4c94-ad07-4501e33d7b0f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:35.527574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-8521238d-a0ed-4c94-ad07-4501e33d7b0f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Getting quotas for project 349d3aa8627644d59867a744695f2579. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:51:35.535218 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-8521238d-a0ed-4c94-ad07-4501e33d7b0f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Getting quotas for user 93982876b1e24efb8ffa8c009532343a and project 349d3aa8627644d59867a744695f2579. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:51:35.555853 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8521238d-a0ed-4c94-ad07-4501e33d7b0f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:51:35.559205 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8521238d-a0ed-4c94-ad07-4501e33d7b0f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:51:35.604690 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9c290291-24ad-4222-a3a5-d8b4aa26b84e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:35.605388 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9c290291-24ad-4222-a3a5-d8b4aa26b84e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:35.618022 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c290291-24ad-4222-a3a5-d8b4aa26b84e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:35.623230 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c290291-24ad-4222-a3a5-d8b4aa26b84e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:35.623724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c290291-24ad-4222-a3a5-d8b4aa26b84e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:35.629855 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c290291-24ad-4222-a3a5-d8b4aa26b84e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:35.630358 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c290291-24ad-4222-a3a5-d8b4aa26b84e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:35.630846 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c290291-24ad-4222-a3a5-d8b4aa26b84e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:35.646073 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8521238d-a0ed-4c94-ad07-4501e33d7b0f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.688395 Sep 24 20:51:35.652164 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 294/570] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:51:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:51:35.665243 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1e000444-1a1f-4837-96bd-f607b9d0f4db tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:35.667809 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1e000444-1a1f-4837-96bd-f607b9d0f4db tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:35.685581 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:51:35.791054 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1e000444-1a1f-4837-96bd-f607b9d0f4db tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:35.803297 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1e000444-1a1f-4837-96bd-f607b9d0f4db tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1212 microversion: 2.1 time: 0.145890 Sep 24 20:51:35.806710 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 295/571] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:35 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1212 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:35.847866 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f31e45e0-391f-4240-92d4-257a9d1cf1cb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:35.848814 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f31e45e0-391f-4240-92d4-257a9d1cf1cb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:35.860641 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f31e45e0-391f-4240-92d4-257a9d1cf1cb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:35.861362 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f31e45e0-391f-4240-92d4-257a9d1cf1cb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:35.870886 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9c290291-24ad-4222-a3a5-d8b4aa26b84e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:35.876183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f31e45e0-391f-4240-92d4-257a9d1cf1cb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:35.878088 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f31e45e0-391f-4240-92d4-257a9d1cf1cb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:35.879854 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f31e45e0-391f-4240-92d4-257a9d1cf1cb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:35.880538 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f31e45e0-391f-4240-92d4-257a9d1cf1cb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:35.888948 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9c290291-24ad-4222-a3a5-d8b4aa26b84e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:35.898342 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9c290291-24ad-4222-a3a5-d8b4aa26b84e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:35.933357 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9c290291-24ad-4222-a3a5-d8b4aa26b84e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1537 microversion: 2.91 time: 0.336964 Sep 24 20:51:35.933983 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 277/572] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:51:35 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1537 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:51:35.984001 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1b23e833-d7d5-4d38-a115-2530974de391 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:35.985393 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1b23e833-d7d5-4d38-a115-2530974de391 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: a44ee230-ea66-4c1b-90e4-4e5a9a0cd994] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:35.998985 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1b23e833-d7d5-4d38-a115-2530974de391 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:36.004443 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1b23e833-d7d5-4d38-a115-2530974de391 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:36.006361 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1b23e833-d7d5-4d38-a115-2530974de391 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:36.007303 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1b23e833-d7d5-4d38-a115-2530974de391 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:36.012048 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1b23e833-d7d5-4d38-a115-2530974de391 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:36.021375 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1b23e833-d7d5-4d38-a115-2530974de391 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:36.026017 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f31e45e0-391f-4240-92d4-257a9d1cf1cb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:36.048925 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f31e45e0-391f-4240-92d4-257a9d1cf1cb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d" status: 200 len: 1262 microversion: 2.1 time: 0.207764 Sep 24 20:51:36.051961 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 296/573] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:35 2022] GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d => generated 1262 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:36.200651 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1b23e833-d7d5-4d38-a115-2530974de391 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:36.220788 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1b23e833-d7d5-4d38-a115-2530974de391 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994" status: 200 len: 1284 microversion: 2.1 time: 0.239275 Sep 24 20:51:36.221685 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 278/574] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:35 2022] GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 => generated 1284 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:51:36.832909 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d3efe8c0-5f82-4ca6-9592-7d45712fc39b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:36.833545 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d3efe8c0-5f82-4ca6-9592-7d45712fc39b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:36.854638 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d3efe8c0-5f82-4ca6-9592-7d45712fc39b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:36.859485 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d3efe8c0-5f82-4ca6-9592-7d45712fc39b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:36.859976 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d3efe8c0-5f82-4ca6-9592-7d45712fc39b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:36.860744 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d3efe8c0-5f82-4ca6-9592-7d45712fc39b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:36.861222 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d3efe8c0-5f82-4ca6-9592-7d45712fc39b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:36.861662 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d3efe8c0-5f82-4ca6-9592-7d45712fc39b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:36.966803 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2c058dd8-836e-49d3-aa8a-54d32460f9e3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:36.968196 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2c058dd8-836e-49d3-aa8a-54d32460f9e3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:36.984060 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c058dd8-836e-49d3-aa8a-54d32460f9e3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:36.984813 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c058dd8-836e-49d3-aa8a-54d32460f9e3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:36.985612 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c058dd8-836e-49d3-aa8a-54d32460f9e3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:36.987301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c058dd8-836e-49d3-aa8a-54d32460f9e3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:36.988829 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c058dd8-836e-49d3-aa8a-54d32460f9e3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:36.990929 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c058dd8-836e-49d3-aa8a-54d32460f9e3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:37.309378 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2c058dd8-836e-49d3-aa8a-54d32460f9e3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:37.325311 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2c058dd8-836e-49d3-aa8a-54d32460f9e3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:37.327549 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2c058dd8-836e-49d3-aa8a-54d32460f9e3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:37.337698 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2c058dd8-836e-49d3-aa8a-54d32460f9e3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1537 microversion: 2.91 time: 0.374813 Sep 24 20:51:37.359276 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d3efe8c0-5f82-4ca6-9592-7d45712fc39b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:37.360445 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 279/575] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:51:36 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1537 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:51:37.370484 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-57f0e135-1cb9-43bf-b560-2d62b4b0d1fe tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:37.371624 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-57f0e135-1cb9-43bf-b560-2d62b4b0d1fe tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:37.376919 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d3efe8c0-5f82-4ca6-9592-7d45712fc39b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1216 microversion: 2.1 time: 0.546672 Sep 24 20:51:37.377552 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 297/576] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:36 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1216 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:37.393678 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-96ed61e1-96e7-4caa-9d99-1d19f129090f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:37.394226 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-96ed61e1-96e7-4caa-9d99-1d19f129090f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: a44ee230-ea66-4c1b-90e4-4e5a9a0cd994] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:37.396812 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:51:37.400881 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57f0e135-1cb9-43bf-b560-2d62b4b0d1fe tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:37.401922 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57f0e135-1cb9-43bf-b560-2d62b4b0d1fe tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:37.402606 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57f0e135-1cb9-43bf-b560-2d62b4b0d1fe tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:37.404352 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57f0e135-1cb9-43bf-b560-2d62b4b0d1fe tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:37.405239 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57f0e135-1cb9-43bf-b560-2d62b4b0d1fe tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:37.405825 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57f0e135-1cb9-43bf-b560-2d62b4b0d1fe tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:37.410345 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96ed61e1-96e7-4caa-9d99-1d19f129090f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:37.410752 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96ed61e1-96e7-4caa-9d99-1d19f129090f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:37.414764 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96ed61e1-96e7-4caa-9d99-1d19f129090f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:37.416949 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96ed61e1-96e7-4caa-9d99-1d19f129090f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:37.417483 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96ed61e1-96e7-4caa-9d99-1d19f129090f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:37.422178 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96ed61e1-96e7-4caa-9d99-1d19f129090f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:37.496688 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-57f0e135-1cb9-43bf-b560-2d62b4b0d1fe tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:37.510781 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-57f0e135-1cb9-43bf-b560-2d62b4b0d1fe tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d" status: 200 len: 1268 microversion: 2.1 time: 0.146031 Sep 24 20:51:37.522678 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 280/577] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:37 2022] GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d => generated 1268 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:37.595316 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-96ed61e1-96e7-4caa-9d99-1d19f129090f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:37.610595 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-96ed61e1-96e7-4caa-9d99-1d19f129090f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994" status: 200 len: 1272 microversion: 2.1 time: 0.231736 Sep 24 20:51:37.612419 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 298/578] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:37 2022] GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 => generated 1272 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:38.376087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d1c1e230-9c8f-45dc-9073-a8af86263a4d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:38.378104 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d1c1e230-9c8f-45dc-9073-a8af86263a4d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:38.385573 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1c1e230-9c8f-45dc-9073-a8af86263a4d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:38.386264 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1c1e230-9c8f-45dc-9073-a8af86263a4d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:38.386852 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1c1e230-9c8f-45dc-9073-a8af86263a4d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:38.389131 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1c1e230-9c8f-45dc-9073-a8af86263a4d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:38.389731 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1c1e230-9c8f-45dc-9073-a8af86263a4d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:38.390273 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1c1e230-9c8f-45dc-9073-a8af86263a4d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:38.405707 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8d761260-30c6-46ad-9af0-a2c9702267f7 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:38.409997 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8d761260-30c6-46ad-9af0-a2c9702267f7 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:38.423963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d761260-30c6-46ad-9af0-a2c9702267f7 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:38.431733 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d761260-30c6-46ad-9af0-a2c9702267f7 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:38.432624 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d761260-30c6-46ad-9af0-a2c9702267f7 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:38.436067 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d761260-30c6-46ad-9af0-a2c9702267f7 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:38.438999 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d761260-30c6-46ad-9af0-a2c9702267f7 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:38.441107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d761260-30c6-46ad-9af0-a2c9702267f7 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:38.768251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8d761260-30c6-46ad-9af0-a2c9702267f7 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:38.783430 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8d761260-30c6-46ad-9af0-a2c9702267f7 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1270 microversion: 2.1 time: 0.380133 Sep 24 20:51:38.784481 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 299/579] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:38 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1270 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:38.785660 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d1c1e230-9c8f-45dc-9073-a8af86263a4d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:38.795570 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d1c1e230-9c8f-45dc-9073-a8af86263a4d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:38.801688 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d1c1e230-9c8f-45dc-9073-a8af86263a4d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:38.803515 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1c9d6f77-26ad-4115-a810-87a34d498401 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:38.804146 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1c9d6f77-26ad-4115-a810-87a34d498401 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:38.811423 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c9d6f77-26ad-4115-a810-87a34d498401 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:38.811922 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c9d6f77-26ad-4115-a810-87a34d498401 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:38.812664 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d1c1e230-9c8f-45dc-9073-a8af86263a4d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1537 microversion: 2.91 time: 0.445240 Sep 24 20:51:38.820165 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c9d6f77-26ad-4115-a810-87a34d498401 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:38.820425 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 281/580] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:51:38 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1537 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:51:38.821913 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c9d6f77-26ad-4115-a810-87a34d498401 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:38.822742 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c9d6f77-26ad-4115-a810-87a34d498401 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:38.823395 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c9d6f77-26ad-4115-a810-87a34d498401 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:38.826019 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-74f167c7-2e6a-4893-8816-2caf934a2aa5 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:38.826668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-74f167c7-2e6a-4893-8816-2caf934a2aa5 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: a44ee230-ea66-4c1b-90e4-4e5a9a0cd994] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:38.848598 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-74f167c7-2e6a-4893-8816-2caf934a2aa5 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:38.849458 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-74f167c7-2e6a-4893-8816-2caf934a2aa5 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:38.850106 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-74f167c7-2e6a-4893-8816-2caf934a2aa5 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:38.851133 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-74f167c7-2e6a-4893-8816-2caf934a2aa5 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:38.851668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-74f167c7-2e6a-4893-8816-2caf934a2aa5 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:38.852168 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-74f167c7-2e6a-4893-8816-2caf934a2aa5 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:39.124853 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-74f167c7-2e6a-4893-8816-2caf934a2aa5 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:39.144967 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-74f167c7-2e6a-4893-8816-2caf934a2aa5 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994" status: 200 len: 1272 microversion: 2.1 time: 0.322733 Sep 24 20:51:39.146209 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 282/581] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:38 2022] GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 => generated 1272 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:39.337486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1c9d6f77-26ad-4115-a810-87a34d498401 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:39.354298 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1c9d6f77-26ad-4115-a810-87a34d498401 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d" status: 200 len: 1310 microversion: 2.1 time: 0.565467 Sep 24 20:51:39.355211 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 300/582] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:38 2022] GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d => generated 1310 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:39.812813 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-70672dda-4b0a-4cfc-bddd-330323de7723 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:39.814244 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-70672dda-4b0a-4cfc-bddd-330323de7723 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:39.821863 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-70672dda-4b0a-4cfc-bddd-330323de7723 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:39.822701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-70672dda-4b0a-4cfc-bddd-330323de7723 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:39.823407 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-70672dda-4b0a-4cfc-bddd-330323de7723 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:39.824873 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-70672dda-4b0a-4cfc-bddd-330323de7723 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:39.825555 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-70672dda-4b0a-4cfc-bddd-330323de7723 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:39.826186 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-70672dda-4b0a-4cfc-bddd-330323de7723 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:39.845566 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a37f6301-f472-4c22-8833-f4368313e60a tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:39.846303 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a37f6301-f472-4c22-8833-f4368313e60a tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:39.865804 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a37f6301-f472-4c22-8833-f4368313e60a tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:39.868767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a37f6301-f472-4c22-8833-f4368313e60a tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:39.870221 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a37f6301-f472-4c22-8833-f4368313e60a tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:39.873775 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a37f6301-f472-4c22-8833-f4368313e60a tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:39.875524 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a37f6301-f472-4c22-8833-f4368313e60a tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:39.877802 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a37f6301-f472-4c22-8833-f4368313e60a tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:40.035129 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-70672dda-4b0a-4cfc-bddd-330323de7723 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:40.038540 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a37f6301-f472-4c22-8833-f4368313e60a tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:40.063365 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-70672dda-4b0a-4cfc-bddd-330323de7723 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1270 microversion: 2.1 time: 0.253903 Sep 24 20:51:40.064895 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a37f6301-f472-4c22-8833-f4368313e60a tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:40.066119 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 283/583] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:39 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1270 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:40.067889 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a37f6301-f472-4c22-8833-f4368313e60a tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:40.077764 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a37f6301-f472-4c22-8833-f4368313e60a tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1537 microversion: 2.91 time: 0.236424 Sep 24 20:51:40.078724 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 301/584] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:51:39 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1537 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:51:40.184355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8be7fa7a-fc82-44f1-b3e3-f3b536590dc5 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:40.185215 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8be7fa7a-fc82-44f1-b3e3-f3b536590dc5 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: a44ee230-ea66-4c1b-90e4-4e5a9a0cd994] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:40.196884 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-ed3799b9-f18c-4282-a6df-a3278e0598c2 req-e9da167c-6923-4b84-a8b3-96e13d329303 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dc2952a-aad1-40d0-bd55-87c6b3b9618d", "tag": "092b1380-825b-4d02-bb2f-0dda7ef94e2e"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:40.216743 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8be7fa7a-fc82-44f1-b3e3-f3b536590dc5 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:40.218651 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8be7fa7a-fc82-44f1-b3e3-f3b536590dc5 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:40.222106 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-ed3799b9-f18c-4282-a6df-a3278e0598c2 req-e9da167c-6923-4b84-a8b3-96e13d329303 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:40.223110 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8be7fa7a-fc82-44f1-b3e3-f3b536590dc5 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:40.224781 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8be7fa7a-fc82-44f1-b3e3-f3b536590dc5 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:40.225742 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8be7fa7a-fc82-44f1-b3e3-f3b536590dc5 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:40.226945 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8be7fa7a-fc82-44f1-b3e3-f3b536590dc5 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:40.236122 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-ed3799b9-f18c-4282-a6df-a3278e0598c2 req-e9da167c-6923-4b84-a8b3-96e13d329303 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:40.238245 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-ed3799b9-f18c-4282-a6df-a3278e0598c2 req-e9da167c-6923-4b84-a8b3-96e13d329303 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:40.266154 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-ed3799b9-f18c-4282-a6df-a3278e0598c2 req-e9da167c-6923-4b84-a8b3-96e13d329303 service nova] Creating event network-changed:092b1380-825b-4d02-bb2f-0dda7ef94e2e for instance 5dc2952a-aad1-40d0-bd55-87c6b3b9618d on nch1-master-1 Sep 24 20:51:40.283390 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-ed3799b9-f18c-4282-a6df-a3278e0598c2 req-e9da167c-6923-4b84-a8b3-96e13d329303 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092674 Sep 24 20:51:40.284417 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 302/585] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:40.404774 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6327278b-da15-419d-a4c4-9022d3870a05 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:40.407317 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6327278b-da15-419d-a4c4-9022d3870a05 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:40.421168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6327278b-da15-419d-a4c4-9022d3870a05 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:40.421668 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6327278b-da15-419d-a4c4-9022d3870a05 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:40.427088 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6327278b-da15-419d-a4c4-9022d3870a05 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:40.427947 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6327278b-da15-419d-a4c4-9022d3870a05 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:40.428435 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6327278b-da15-419d-a4c4-9022d3870a05 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:40.428875 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6327278b-da15-419d-a4c4-9022d3870a05 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:40.697760 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8be7fa7a-fc82-44f1-b3e3-f3b536590dc5 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:40.706336 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8be7fa7a-fc82-44f1-b3e3-f3b536590dc5 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994" status: 200 len: 1314 microversion: 2.1 time: 0.538616 Sep 24 20:51:40.706946 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 284/586] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:40 2022] GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 => generated 1314 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:40.809443 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6327278b-da15-419d-a4c4-9022d3870a05 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:40.827536 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6327278b-da15-419d-a4c4-9022d3870a05 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d" status: 200 len: 1310 microversion: 2.1 time: 0.451308 Sep 24 20:51:40.838577 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 303/587] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:40 2022] GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d => generated 1310 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:41.090194 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cf6577ec-bc98-4580-b623-e6c28015937d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:41.091063 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cf6577ec-bc98-4580-b623-e6c28015937d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:41.101853 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf6577ec-bc98-4580-b623-e6c28015937d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:41.103429 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf6577ec-bc98-4580-b623-e6c28015937d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:41.105499 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf6577ec-bc98-4580-b623-e6c28015937d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:41.106947 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf6577ec-bc98-4580-b623-e6c28015937d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:41.109358 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf6577ec-bc98-4580-b623-e6c28015937d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:41.110734 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2427efdb-727b-4ef9-918e-0e6135d78d4b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:41.111087 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2427efdb-727b-4ef9-918e-0e6135d78d4b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:41.112014 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf6577ec-bc98-4580-b623-e6c28015937d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:41.119765 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2427efdb-727b-4ef9-918e-0e6135d78d4b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:41.120266 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2427efdb-727b-4ef9-918e-0e6135d78d4b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:41.120705 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2427efdb-727b-4ef9-918e-0e6135d78d4b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:41.121427 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2427efdb-727b-4ef9-918e-0e6135d78d4b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:41.121890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2427efdb-727b-4ef9-918e-0e6135d78d4b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:41.122327 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2427efdb-727b-4ef9-918e-0e6135d78d4b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:41.570991 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2427efdb-727b-4ef9-918e-0e6135d78d4b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:41.581707 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2427efdb-727b-4ef9-918e-0e6135d78d4b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:41.590244 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2427efdb-727b-4ef9-918e-0e6135d78d4b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:41.601911 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2427efdb-727b-4ef9-918e-0e6135d78d4b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1480 microversion: 2.91 time: 0.496379 Sep 24 20:51:41.622924 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 304/588] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:51:41 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1480 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:51:41.637867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-914a2396-a6c5-4d0f-8e0a-eac3e50ba2eb tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "nch2-master-1"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:41.651283 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-914a2396-a6c5-4d0f-8e0a-eac3e50ba2eb tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:41.658114 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-914a2396-a6c5-4d0f-8e0a-eac3e50ba2eb tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:41.662987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-914a2396-a6c5-4d0f-8e0a-eac3e50ba2eb tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:41.663640 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-914a2396-a6c5-4d0f-8e0a-eac3e50ba2eb tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:41.666763 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-914a2396-a6c5-4d0f-8e0a-eac3e50ba2eb tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:41.669715 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-914a2396-a6c5-4d0f-8e0a-eac3e50ba2eb tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:41.670568 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-914a2396-a6c5-4d0f-8e0a-eac3e50ba2eb tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:41.803783 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-914a2396-a6c5-4d0f-8e0a-eac3e50ba2eb tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "nch2-master-1". {{(pid=140516) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 24 20:51:41.900848 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:51:41.962363 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cf6577ec-bc98-4580-b623-e6c28015937d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:41.972401 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cf6577ec-bc98-4580-b623-e6c28015937d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1312 microversion: 2.1 time: 0.886744 Sep 24 20:51:41.977109 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 285/589] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:41 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1312 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:41.982426 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-426a544c-bccd-47d7-92c2-e3dd4be22eb4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:41.986848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-426a544c-bccd-47d7-92c2-e3dd4be22eb4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: a44ee230-ea66-4c1b-90e4-4e5a9a0cd994] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:42.006153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-426a544c-bccd-47d7-92c2-e3dd4be22eb4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:42.006703 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-426a544c-bccd-47d7-92c2-e3dd4be22eb4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:42.007146 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-426a544c-bccd-47d7-92c2-e3dd4be22eb4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:42.008220 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-426a544c-bccd-47d7-92c2-e3dd4be22eb4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:42.009160 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-426a544c-bccd-47d7-92c2-e3dd4be22eb4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:42.011498 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-426a544c-bccd-47d7-92c2-e3dd4be22eb4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:42.015734 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-914a2396-a6c5-4d0f-8e0a-eac3e50ba2eb tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e/action" status: 202 len: 0 microversion: 2.91 time: 0.380068 Sep 24 20:51:42.019338 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 305/590] 10.222.0.52 () {62 vars in 1319 bytes} [Sat Sep 24 20:51:41 2022] POST /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e/action => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 24 20:51:42.028905 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-10786d3b-1f27-4aeb-a4bd-18254e5d62a0 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:42.029881 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-10786d3b-1f27-4aeb-a4bd-18254e5d62a0 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:42.050375 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:51:42.054243 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10786d3b-1f27-4aeb-a4bd-18254e5d62a0 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:42.057140 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10786d3b-1f27-4aeb-a4bd-18254e5d62a0 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:42.058670 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10786d3b-1f27-4aeb-a4bd-18254e5d62a0 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:42.060518 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10786d3b-1f27-4aeb-a4bd-18254e5d62a0 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:42.063597 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10786d3b-1f27-4aeb-a4bd-18254e5d62a0 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:42.064208 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10786d3b-1f27-4aeb-a4bd-18254e5d62a0 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:42.646972 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-426a544c-bccd-47d7-92c2-e3dd4be22eb4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:42.658212 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-426a544c-bccd-47d7-92c2-e3dd4be22eb4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994" status: 200 len: 1314 microversion: 2.1 time: 0.679413 Sep 24 20:51:42.666256 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 286/591] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:41 2022] GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 => generated 1314 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:42.678483 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f3fffe06-c814-49f1-9308-4d5db45b93fa tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:42.679134 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f3fffe06-c814-49f1-9308-4d5db45b93fa tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:42.695734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3fffe06-c814-49f1-9308-4d5db45b93fa tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:42.699781 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3fffe06-c814-49f1-9308-4d5db45b93fa tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:42.700512 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3fffe06-c814-49f1-9308-4d5db45b93fa tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:42.701364 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3fffe06-c814-49f1-9308-4d5db45b93fa tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:42.714346 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3fffe06-c814-49f1-9308-4d5db45b93fa tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:42.715520 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3fffe06-c814-49f1-9308-4d5db45b93fa tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:42.944510 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-10786d3b-1f27-4aeb-a4bd-18254e5d62a0 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:42.970654 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-10786d3b-1f27-4aeb-a4bd-18254e5d62a0 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d" status: 200 len: 1310 microversion: 2.1 time: 0.949386 Sep 24 20:51:42.972671 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 306/592] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:42 2022] GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d => generated 1310 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:43.001513 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f6854421-afd6-4366-8d98-04f9472dcb98 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:43.005872 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f6854421-afd6-4366-8d98-04f9472dcb98 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:43.024625 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6854421-afd6-4366-8d98-04f9472dcb98 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:43.027683 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6854421-afd6-4366-8d98-04f9472dcb98 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:43.029581 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6854421-afd6-4366-8d98-04f9472dcb98 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:43.031301 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6854421-afd6-4366-8d98-04f9472dcb98 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:43.031792 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6854421-afd6-4366-8d98-04f9472dcb98 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:43.032219 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6854421-afd6-4366-8d98-04f9472dcb98 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:43.045456 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f3fffe06-c814-49f1-9308-4d5db45b93fa tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:43.060754 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f3fffe06-c814-49f1-9308-4d5db45b93fa tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:43.066534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f3fffe06-c814-49f1-9308-4d5db45b93fa tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:43.088038 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f3fffe06-c814-49f1-9308-4d5db45b93fa tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1488 microversion: 2.91 time: 0.415987 Sep 24 20:51:43.091038 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 287/593] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:51:42 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1488 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:51:43.421901 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f6854421-afd6-4366-8d98-04f9472dcb98 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:43.434888 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f6854421-afd6-4366-8d98-04f9472dcb98 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1312 microversion: 2.1 time: 0.439016 Sep 24 20:51:43.435935 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 307/594] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:42 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1312 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:51:43.514817 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-be4e6f81-71bb-4176-96a2-e7e143a52052 tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Calling method '.version_select at 0x7f4b0cebb670>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:43.607791 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-1c497a75-ad06-41cf-8a6e-ca26d237cf56 req-f11a0b18-aac8-4c31-a4d0-155800a85a93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a44ee230-ea66-4c1b-90e4-4e5a9a0cd994", "tag": "1d87750d-071a-4b4c-9e13-ddf06bb0283b"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:43.653653 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1c497a75-ad06-41cf-8a6e-ca26d237cf56 req-f11a0b18-aac8-4c31-a4d0-155800a85a93 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:43.654644 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1c497a75-ad06-41cf-8a6e-ca26d237cf56 req-f11a0b18-aac8-4c31-a4d0-155800a85a93 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:43.655305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1c497a75-ad06-41cf-8a6e-ca26d237cf56 req-f11a0b18-aac8-4c31-a4d0-155800a85a93 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:43.657803 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-be4e6f81-71bb-4176-96a2-e7e143a52052 tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/e43a52b503c946659d54675548a49bab" status: 200 len: 371 microversion: 2.1 time: 0.291596 Sep 24 20:51:43.660449 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 288/595] 10.222.0.52 () {58 vars in 1242 bytes} [Sat Sep 24 20:51:43 2022] GET /compute/v2.1/os-quota-sets/e43a52b503c946659d54675548a49bab => generated 371 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:43.676796 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dc47b34f-0a6a-4960-9446-632d8cb60974 tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Action: 'update', calling method: .version_select at 0x7f4b0ceb3040>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:43.701200 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-1c497a75-ad06-41cf-8a6e-ca26d237cf56 req-f11a0b18-aac8-4c31-a4d0-155800a85a93 service nova] Creating event network-changed:1d87750d-071a-4b4c-9e13-ddf06bb0283b for instance a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 on nch2-master-1 Sep 24 20:51:43.708068 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-1c497a75-ad06-41cf-8a6e-ca26d237cf56 req-f11a0b18-aac8-4c31-a4d0-155800a85a93 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106422 Sep 24 20:51:43.709362 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 308/596] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:43.715975 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d0966289-6942-40a3-9ee4-b130fb6e186d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:43.716906 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d0966289-6942-40a3-9ee4-b130fb6e186d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: a44ee230-ea66-4c1b-90e4-4e5a9a0cd994] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:43.735423 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0966289-6942-40a3-9ee4-b130fb6e186d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:43.735986 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0966289-6942-40a3-9ee4-b130fb6e186d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:43.736360 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0966289-6942-40a3-9ee4-b130fb6e186d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:43.737075 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0966289-6942-40a3-9ee4-b130fb6e186d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:43.739097 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0966289-6942-40a3-9ee4-b130fb6e186d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:43.740648 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0966289-6942-40a3-9ee4-b130fb6e186d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:43.846515 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc47b34f-0a6a-4960-9446-632d8cb60974 tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:43.847471 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc47b34f-0a6a-4960-9446-632d8cb60974 tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:43.848655 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc47b34f-0a6a-4960-9446-632d8cb60974 tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:43.850299 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc47b34f-0a6a-4960-9446-632d8cb60974 tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:43.850999 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc47b34f-0a6a-4960-9446-632d8cb60974 tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:43.852064 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc47b34f-0a6a-4960-9446-632d8cb60974 tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:43.987288 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dc47b34f-0a6a-4960-9446-632d8cb60974 tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/e43a52b503c946659d54675548a49bab" status: 200 len: 328 microversion: 2.1 time: 0.317014 Sep 24 20:51:44.009677 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 289/597] 10.222.0.52 () {60 vars in 1262 bytes} [Sat Sep 24 20:51:43 2022] PUT /compute/v2.1/os-quota-sets/e43a52b503c946659d54675548a49bab => generated 328 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:51:44.023893 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6cd1cfb2-9fb5-4c1f-b2df-3e9ab19638a8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:44.024596 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6cd1cfb2-9fb5-4c1f-b2df-3e9ab19638a8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:44.073089 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6cd1cfb2-9fb5-4c1f-b2df-3e9ab19638a8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:44.073949 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6cd1cfb2-9fb5-4c1f-b2df-3e9ab19638a8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:44.074745 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6cd1cfb2-9fb5-4c1f-b2df-3e9ab19638a8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:44.075744 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6cd1cfb2-9fb5-4c1f-b2df-3e9ab19638a8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:44.077393 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6cd1cfb2-9fb5-4c1f-b2df-3e9ab19638a8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:44.086687 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6cd1cfb2-9fb5-4c1f-b2df-3e9ab19638a8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:44.093564 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:51:44.309224 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d0966289-6942-40a3-9ee4-b130fb6e186d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:44.324870 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d0966289-6942-40a3-9ee4-b130fb6e186d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994" status: 200 len: 1314 microversion: 2.1 time: 0.613394 Sep 24 20:51:44.327495 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 309/598] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:43 2022] GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 => generated 1314 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:44.343309 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-baf395f5-93b2-449d-a8a8-2efe4d11733f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:44.344254 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-baf395f5-93b2-449d-a8a8-2efe4d11733f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:44.353249 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-baf395f5-93b2-449d-a8a8-2efe4d11733f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:44.354055 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-baf395f5-93b2-449d-a8a8-2efe4d11733f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:44.354900 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-baf395f5-93b2-449d-a8a8-2efe4d11733f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:44.356856 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-baf395f5-93b2-449d-a8a8-2efe4d11733f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:44.357638 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-baf395f5-93b2-449d-a8a8-2efe4d11733f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:44.358309 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-baf395f5-93b2-449d-a8a8-2efe4d11733f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:44.543075 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-baf395f5-93b2-449d-a8a8-2efe4d11733f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:44.552852 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6cd1cfb2-9fb5-4c1f-b2df-3e9ab19638a8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:44.556169 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-baf395f5-93b2-449d-a8a8-2efe4d11733f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:44.557959 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-baf395f5-93b2-449d-a8a8-2efe4d11733f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:44.568426 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6cd1cfb2-9fb5-4c1f-b2df-3e9ab19638a8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d" status: 200 len: 1310 microversion: 2.1 time: 0.557417 Sep 24 20:51:44.569020 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 290/599] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:44 2022] GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d => generated 1310 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:44.570323 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-baf395f5-93b2-449d-a8a8-2efe4d11733f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1488 microversion: 2.91 time: 0.241057 Sep 24 20:51:44.576759 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 310/600] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:51:44 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1488 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:51:44.582003 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3921f52a-fad5-4104-919d-c8508ccaa5ad tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:44.582822 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3921f52a-fad5-4104-919d-c8508ccaa5ad tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:44.608454 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3921f52a-fad5-4104-919d-c8508ccaa5ad tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:44.608963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3921f52a-fad5-4104-919d-c8508ccaa5ad tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:44.609406 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3921f52a-fad5-4104-919d-c8508ccaa5ad tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:44.610130 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3921f52a-fad5-4104-919d-c8508ccaa5ad tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:44.610622 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3921f52a-fad5-4104-919d-c8508ccaa5ad tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:44.611053 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3921f52a-fad5-4104-919d-c8508ccaa5ad tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:44.733905 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-844a8d6d-98b8-464a-bd82-00f3364992f3 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-216197650", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:44.808944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-844a8d6d-98b8-464a-bd82-00f3364992f3 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] validate_networks() for None {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:51:45.466107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3921f52a-fad5-4104-919d-c8508ccaa5ad tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:45.483311 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3921f52a-fad5-4104-919d-c8508ccaa5ad tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1312 microversion: 2.1 time: 0.904799 Sep 24 20:51:45.485591 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 311/601] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:44 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1312 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:45.516469 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=4 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:51:45.580281 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-67eb5a40-ad89-4ee1-a03d-994f87026166 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-297733758", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "024c2e10-583d-4d69-82c6-3844b4ef926e"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:45.679873 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-67eb5a40-ad89-4ee1-a03d-994f87026166 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] validate_networks() for [('024c2e10-583d-4d69-82c6-3844b4ef926e', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:51:45.717804 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-844a8d6d-98b8-464a-bd82-00f3364992f3 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:51:45.718473 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-844a8d6d-98b8-464a-bd82-00f3364992f3 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:51:45.719145 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-844a8d6d-98b8-464a-bd82-00f3364992f3 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:51:45.719715 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-844a8d6d-98b8-464a-bd82-00f3364992f3 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:51:45.720295 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-844a8d6d-98b8-464a-bd82-00f3364992f3 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:51:45.740778 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-844a8d6d-98b8-464a-bd82-00f3364992f3 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:45.741947 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-844a8d6d-98b8-464a-bd82-00f3364992f3 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:45.742572 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-844a8d6d-98b8-464a-bd82-00f3364992f3 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:45.744320 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-844a8d6d-98b8-464a-bd82-00f3364992f3 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:45.745065 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-844a8d6d-98b8-464a-bd82-00f3364992f3 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:45.745649 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-844a8d6d-98b8-464a-bd82-00f3364992f3 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:45.781393 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-844a8d6d-98b8-464a-bd82-00f3364992f3 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Getting quotas for project e43a52b503c946659d54675548a49bab. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:51:45.786898 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-844a8d6d-98b8-464a-bd82-00f3364992f3 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Getting quotas for user 8c3a535cc471436689e916bd1cbc3159 and project e43a52b503c946659d54675548a49bab. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:51:45.798009 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=16 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:51:45.800906 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.utils [None req-844a8d6d-98b8-464a-bd82-00f3364992f3 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] cores quota exceeded for e43a52b503c946659d54675548a49bab, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=140517) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 24 20:51:45.801939 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-844a8d6d-98b8-464a-bd82-00f3364992f3 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 24 20:51:45.806032 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-844a8d6d-98b8-464a-bd82-00f3364992f3 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Request method failure captured: Sep 24 20:51:45.806032 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 24 20:51:45.806032 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:51:45.806032 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:51:45.806032 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:51:45.806032 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 144 Sep 24 20:51:45.806032 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:51:45.806032 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:51:45.806032 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:51:45.806032 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:51:45.806032 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL23ePUhVZzryQImcxmczlbHgoUaIhkGK5uzP6lNoNEYcxciXTl-Rby5jikBcLqinVyZJs8nEknhrFh2RkQCQuaXrAXCrKPCv6tRqu97gVRcMYG0X83PdEvsQGOSMTNYXrFVHteZoiS4yWqnJyaOx7mBcr7dCuJ7oVnn1qTsMnNKBJ2g Sep 24 20:51:45.806032 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:51:45.806032 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:51:45.806032 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:51:45.806032 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:51:45.806032 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:51:45.806032 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:51:45.806032 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: e43a52b503c946659d54675548a49bab Sep 24 20:51:45.806032 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-QuotasAdminNegativeTest-723968951 Sep 24 20:51:45.806032 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:51:45.806032 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:51:45.807685 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e43a52b503c946659d54675548a49bab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e43a52b503c946659d54675548a49bab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e43a52b503c946659d54675548a49bab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e43a52b503c946659d54675548a49bab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:51:45.807685 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-QuotasAdminNegativeTest-723968951 Sep 24 20:51:45.807685 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: e43a52b503c946659d54675548a49bab Sep 24 20:51:45.807685 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-723968951 Sep 24 20:51:45.807685 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-QuotasAdminNegativeTest-723968951-project Sep 24 20:51:45.807685 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:51:45.807685 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:51:45.807685 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 8c3a535cc471436689e916bd1cbc3159 Sep 24 20:51:45.807685 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-QuotasAdminNegativeTest-723968951-project Sep 24 20:51:45.807685 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 20:51:45.807685 ncdv-master-1 devstack@n-api.service[140517]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-216197650", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452"}} Sep 24 20:51:45.807685 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:51:45.808410 ncdv-master-1 devstack@n-api.service[140517]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 24 20:51:45.808410 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-216197650', 'imageRef': '4c30e8e9-8fb2-4377-83f1-98322cb17799', 'flavorRef': '452'}}} Sep 24 20:51:45.808410 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:51:45.808410 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:45.808410 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 24 20:51:45.808410 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 24 20:51:45.808410 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 20:51:45.808410 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 20:51:45.808410 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 24 20:51:45.808410 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc Sep 24 20:51:45.808410 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 24 20:51:45.808410 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 24 20:51:45.808410 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 20:51:45.808410 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 20:51:45.808410 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 24 20:51:45.808410 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 24 20:51:45.808410 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 24 20:51:45.808410 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 24 20:51:45.809450 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 24 20:51:45.809450 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 24 20:51:45.809450 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 24 20:51:45.809450 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:45.809450 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:45.809450 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:45.809450 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:45.809450 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 24 20:51:45.809450 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 24 20:51:45.809450 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 24 20:51:45.809450 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 24 20:51:45.809450 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 24 20:51:45.809450 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 24 20:51:45.809450 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 24 20:51:45.809450 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 24 20:51:45.809450 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 24 20:51:45.809450 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 24 20:51:45.809450 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 24 20:51:45.809450 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:45.809450 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:45.809450 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:45.810867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:45.810867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:45.810867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:45.810867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:51:45.810867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:51:45.810867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:51:45.810867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:51:45.810867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:51:45.810867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:51:45.810867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:51:45.810867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:51:45.810867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:51:45.810867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:51:45.810867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 24 20:51:45.810867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 24 20:51:45.810867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 24 20:51:45.810867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 24 20:51:45.810867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:45.810867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:45.810867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:45.810867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:45.812057 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:45.812057 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:45.812057 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:51:45.812057 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:51:45.812057 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 24 20:51:45.812057 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:45.814186 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-844a8d6d-98b8-464a-bd82-00f3364992f3 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:51:45.815367 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-844a8d6d-98b8-464a-bd82-00f3364992f3 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.245244 Sep 24 20:51:45.816172 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 291/602] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:51:44 2022] POST /compute/v2.1/servers => generated 111 bytes in 1246 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:51:45.821343 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9c662eb9-18ee-4916-85b7-31ac8e0c2b42 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:45.822750 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9c662eb9-18ee-4916-85b7-31ac8e0c2b42 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: a44ee230-ea66-4c1b-90e4-4e5a9a0cd994] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:45.831172 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c662eb9-18ee-4916-85b7-31ac8e0c2b42 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:45.832022 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c662eb9-18ee-4916-85b7-31ac8e0c2b42 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:45.832667 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c662eb9-18ee-4916-85b7-31ac8e0c2b42 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:45.833763 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c662eb9-18ee-4916-85b7-31ac8e0c2b42 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:45.834431 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c662eb9-18ee-4916-85b7-31ac8e0c2b42 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:45.835173 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c662eb9-18ee-4916-85b7-31ac8e0c2b42 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:46.195583 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9c662eb9-18ee-4916-85b7-31ac8e0c2b42 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:46.208941 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9c662eb9-18ee-4916-85b7-31ac8e0c2b42 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994" status: 200 len: 1314 microversion: 2.1 time: 0.387373 Sep 24 20:51:46.209727 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 292/603] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:45 2022] GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:46.222890 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a0dbf1ed-388c-4cd5-aaf3-0e7a75428473 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:46.224865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a0dbf1ed-388c-4cd5-aaf3-0e7a75428473 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:46.246144 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a0dbf1ed-388c-4cd5-aaf3-0e7a75428473 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:46.247780 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a0dbf1ed-388c-4cd5-aaf3-0e7a75428473 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:46.252443 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a0dbf1ed-388c-4cd5-aaf3-0e7a75428473 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:46.253245 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a0dbf1ed-388c-4cd5-aaf3-0e7a75428473 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:46.253733 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a0dbf1ed-388c-4cd5-aaf3-0e7a75428473 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:46.254185 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a0dbf1ed-388c-4cd5-aaf3-0e7a75428473 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:46.485608 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-67eb5a40-ad89-4ee1-a03d-994f87026166 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:51:46.487570 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-67eb5a40-ad89-4ee1-a03d-994f87026166 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:51:46.488052 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-67eb5a40-ad89-4ee1-a03d-994f87026166 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:51:46.488675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-67eb5a40-ad89-4ee1-a03d-994f87026166 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:51:46.489188 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-67eb5a40-ad89-4ee1-a03d-994f87026166 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:51:46.504593 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67eb5a40-ad89-4ee1-a03d-994f87026166 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:46.507553 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67eb5a40-ad89-4ee1-a03d-994f87026166 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:46.508315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67eb5a40-ad89-4ee1-a03d-994f87026166 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:46.512253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67eb5a40-ad89-4ee1-a03d-994f87026166 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:46.512974 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67eb5a40-ad89-4ee1-a03d-994f87026166 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:46.513655 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67eb5a40-ad89-4ee1-a03d-994f87026166 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:46.550513 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a0dbf1ed-388c-4cd5-aaf3-0e7a75428473 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:46.556520 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-67eb5a40-ad89-4ee1-a03d-994f87026166 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Getting quotas for project e175cb4032ec4e6aa900141abbaa04c4. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:51:46.563063 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-67eb5a40-ad89-4ee1-a03d-994f87026166 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Getting quotas for user 6db52cb259fa426d860f9c9a48a149f3 and project e175cb4032ec4e6aa900141abbaa04c4. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:51:46.570657 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a0dbf1ed-388c-4cd5-aaf3-0e7a75428473 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d" status: 200 len: 1310 microversion: 2.1 time: 0.358769 Sep 24 20:51:46.574942 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 293/604] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:46 2022] GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d => generated 1310 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:46.593605 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ecae7f98-d581-4411-9d5c-7eff463cdd8d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:46.596872 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ecae7f98-d581-4411-9d5c-7eff463cdd8d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:46.607787 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-67eb5a40-ad89-4ee1-a03d-994f87026166 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:51:46.610224 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ecae7f98-d581-4411-9d5c-7eff463cdd8d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:46.610925 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ecae7f98-d581-4411-9d5c-7eff463cdd8d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:46.611544 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ecae7f98-d581-4411-9d5c-7eff463cdd8d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:46.612686 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-67eb5a40-ad89-4ee1-a03d-994f87026166 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: b4b8b488-a1f1-42fb-b34a-04005d670e7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:51:46.615034 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ecae7f98-d581-4411-9d5c-7eff463cdd8d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:46.616266 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ecae7f98-d581-4411-9d5c-7eff463cdd8d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:46.617053 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ecae7f98-d581-4411-9d5c-7eff463cdd8d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:46.734449 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-67eb5a40-ad89-4ee1-a03d-994f87026166 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.247457 Sep 24 20:51:46.735146 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 312/605] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:51:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:51:46.757790 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-37be026a-75a5-405a-9769-a50d72b039d6 req-369d5960-b469-4a8a-a2a1-7f88f31214b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bde8ccc3-582c-4d8e-8bcd-3c5711560a26", "tag": "c4b07864-228d-47d5-9e64-61cd582aa91a"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:46.760327 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ecae7f98-d581-4411-9d5c-7eff463cdd8d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:46.772022 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ecae7f98-d581-4411-9d5c-7eff463cdd8d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:46.773751 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ecae7f98-d581-4411-9d5c-7eff463cdd8d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:46.787831 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-37be026a-75a5-405a-9769-a50d72b039d6 req-369d5960-b469-4a8a-a2a1-7f88f31214b8 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:46.788315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-37be026a-75a5-405a-9769-a50d72b039d6 req-369d5960-b469-4a8a-a2a1-7f88f31214b8 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:46.788748 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-37be026a-75a5-405a-9769-a50d72b039d6 req-369d5960-b469-4a8a-a2a1-7f88f31214b8 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:46.804059 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-37be026a-75a5-405a-9769-a50d72b039d6 req-369d5960-b469-4a8a-a2a1-7f88f31214b8 service nova] Creating event network-changed:c4b07864-228d-47d5-9e64-61cd582aa91a for instance bde8ccc3-582c-4d8e-8bcd-3c5711560a26 on nch1-master-1 Sep 24 20:51:46.811471 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-37be026a-75a5-405a-9769-a50d72b039d6 req-369d5960-b469-4a8a-a2a1-7f88f31214b8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074460 Sep 24 20:51:46.812378 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 313/606] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:46.813314 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ecae7f98-d581-4411-9d5c-7eff463cdd8d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1546 microversion: 2.91 time: 0.235320 Sep 24 20:51:46.816105 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 294/607] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:51:46 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1546 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:51:46.818328 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-10d211ad-c342-4ea5-b215-26d8c8a38e7e tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Action: 'update', calling method: .version_select at 0x7f4b0c996a60>, body: {"quota_set": {"cores": 20}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:46.841489 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1ea91c10-1b9d-42b3-96f7-344bb6d0af36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:46.843435 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1ea91c10-1b9d-42b3-96f7-344bb6d0af36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:46.855904 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1ea91c10-1b9d-42b3-96f7-344bb6d0af36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:46.856882 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1ea91c10-1b9d-42b3-96f7-344bb6d0af36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:46.857630 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1ea91c10-1b9d-42b3-96f7-344bb6d0af36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:46.858620 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1ea91c10-1b9d-42b3-96f7-344bb6d0af36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:46.859301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1ea91c10-1b9d-42b3-96f7-344bb6d0af36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:46.859943 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1ea91c10-1b9d-42b3-96f7-344bb6d0af36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:46.924576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10d211ad-c342-4ea5-b215-26d8c8a38e7e tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:46.927368 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10d211ad-c342-4ea5-b215-26d8c8a38e7e tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:46.928148 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10d211ad-c342-4ea5-b215-26d8c8a38e7e tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:46.931476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10d211ad-c342-4ea5-b215-26d8c8a38e7e tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:46.932651 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10d211ad-c342-4ea5-b215-26d8c8a38e7e tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:46.935198 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10d211ad-c342-4ea5-b215-26d8c8a38e7e tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:47.079312 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-10d211ad-c342-4ea5-b215-26d8c8a38e7e tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/e43a52b503c946659d54675548a49bab" status: 200 len: 329 microversion: 2.1 time: 0.265193 Sep 24 20:51:47.083164 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 314/608] 10.222.0.52 () {60 vars in 1262 bytes} [Sat Sep 24 20:51:46 2022] PUT /compute/v2.1/os-quota-sets/e43a52b503c946659d54675548a49bab => generated 329 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:47.095570 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9bed29aa-451d-4fe8-89e5-0ba3a49398ce tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:47.096269 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9bed29aa-451d-4fe8-89e5-0ba3a49398ce tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: b4b8b488-a1f1-42fb-b34a-04005d670e7b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:47.128147 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1ea91c10-1b9d-42b3-96f7-344bb6d0af36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:47.137004 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1ea91c10-1b9d-42b3-96f7-344bb6d0af36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1312 microversion: 2.1 time: 0.318517 Sep 24 20:51:47.138484 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 295/609] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:46 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1312 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:47.142769 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0f21ac80-afdf-49bc-bb63-4a4aa71b590f tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Calling method '.version_select at 0x7f4b0cf770d0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:47.192709 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9bed29aa-451d-4fe8-89e5-0ba3a49398ce tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:47.202349 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9bed29aa-451d-4fe8-89e5-0ba3a49398ce tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b" status: 200 len: 1224 microversion: 2.1 time: 0.118074 Sep 24 20:51:47.202969 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 315/610] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:47 2022] GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b => generated 1224 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:47.237957 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d4b20a0a-d78c-4d52-91a5-de0f5e81d3b1 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:47.245282 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d4b20a0a-d78c-4d52-91a5-de0f5e81d3b1 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: a44ee230-ea66-4c1b-90e4-4e5a9a0cd994] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:47.260104 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d4b20a0a-d78c-4d52-91a5-de0f5e81d3b1 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:47.260574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d4b20a0a-d78c-4d52-91a5-de0f5e81d3b1 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:47.261050 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d4b20a0a-d78c-4d52-91a5-de0f5e81d3b1 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:47.264329 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d4b20a0a-d78c-4d52-91a5-de0f5e81d3b1 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:47.264825 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d4b20a0a-d78c-4d52-91a5-de0f5e81d3b1 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:47.268081 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0f21ac80-afdf-49bc-bb63-4a4aa71b590f tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/e43a52b503c946659d54675548a49bab" status: 200 len: 371 microversion: 2.1 time: 0.121573 Sep 24 20:51:47.270051 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 296/611] 10.222.0.52 () {58 vars in 1242 bytes} [Sat Sep 24 20:51:47 2022] GET /compute/v2.1/os-quota-sets/e43a52b503c946659d54675548a49bab => generated 371 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:47.270171 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d4b20a0a-d78c-4d52-91a5-de0f5e81d3b1 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:47.285646 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-868eec58-fc96-41f4-8910-b4c26af789f2 tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Action: 'update', calling method: .version_select at 0x7f4b0ce28820>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:47.469206 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-868eec58-fc96-41f4-8910-b4c26af789f2 tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:47.483199 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-868eec58-fc96-41f4-8910-b4c26af789f2 tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:47.483970 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-868eec58-fc96-41f4-8910-b4c26af789f2 tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:47.485255 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-868eec58-fc96-41f4-8910-b4c26af789f2 tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:47.485715 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-868eec58-fc96-41f4-8910-b4c26af789f2 tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:47.486154 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-868eec58-fc96-41f4-8910-b4c26af789f2 tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:47.596477 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d4b20a0a-d78c-4d52-91a5-de0f5e81d3b1 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:47.609021 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d4b20a0a-d78c-4d52-91a5-de0f5e81d3b1 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994" status: 200 len: 1314 microversion: 2.1 time: 0.374902 Sep 24 20:51:47.609631 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 316/612] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:47 2022] GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:47.659542 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2b98bc43-b709-4d6e-88f4-f62bb9282f50 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:47.660186 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2b98bc43-b709-4d6e-88f4-f62bb9282f50 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:47.677114 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-868eec58-fc96-41f4-8910-b4c26af789f2 tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/e43a52b503c946659d54675548a49bab" status: 200 len: 328 microversion: 2.1 time: 0.398425 Sep 24 20:51:47.678383 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 297/613] 10.222.0.52 () {60 vars in 1262 bytes} [Sat Sep 24 20:51:47 2022] PUT /compute/v2.1/os-quota-sets/e43a52b503c946659d54675548a49bab => generated 328 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:51:47.690946 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2b98bc43-b709-4d6e-88f4-f62bb9282f50 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:47.693142 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2b98bc43-b709-4d6e-88f4-f62bb9282f50 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:47.695286 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2b98bc43-b709-4d6e-88f4-f62bb9282f50 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:47.697374 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2b98bc43-b709-4d6e-88f4-f62bb9282f50 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:47.700427 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2b98bc43-b709-4d6e-88f4-f62bb9282f50 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:47.702642 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2b98bc43-b709-4d6e-88f4-f62bb9282f50 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:47.794182 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0bae6f09-c44f-479c-9fa6-0184738978d7 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1768820664", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:47.898596 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-0bae6f09-c44f-479c-9fa6-0184738978d7 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] validate_networks() for None {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:51:48.218406 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2b98bc43-b709-4d6e-88f4-f62bb9282f50 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:48.244465 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2b98bc43-b709-4d6e-88f4-f62bb9282f50 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d" status: 200 len: 1310 microversion: 2.1 time: 0.633704 Sep 24 20:51:48.247299 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 317/614] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:47 2022] GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d => generated 1310 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:48.266390 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0f8c7522-79cb-4032-a582-c828466277ce tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:48.267608 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0f8c7522-79cb-4032-a582-c828466277ce tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:48.280012 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0f8c7522-79cb-4032-a582-c828466277ce tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:48.284985 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0f8c7522-79cb-4032-a582-c828466277ce tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:48.285518 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0f8c7522-79cb-4032-a582-c828466277ce tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:48.286364 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0f8c7522-79cb-4032-a582-c828466277ce tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:48.286926 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0f8c7522-79cb-4032-a582-c828466277ce tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:48.297353 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0f8c7522-79cb-4032-a582-c828466277ce tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:48.515243 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-0bae6f09-c44f-479c-9fa6-0184738978d7 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:51:48.516365 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-0bae6f09-c44f-479c-9fa6-0184738978d7 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:51:48.517698 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-0bae6f09-c44f-479c-9fa6-0184738978d7 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:51:48.519005 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-0bae6f09-c44f-479c-9fa6-0184738978d7 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:51:48.519623 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-0bae6f09-c44f-479c-9fa6-0184738978d7 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:51:48.539402 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0bae6f09-c44f-479c-9fa6-0184738978d7 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:48.542073 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0bae6f09-c44f-479c-9fa6-0184738978d7 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:48.545951 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0bae6f09-c44f-479c-9fa6-0184738978d7 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:48.547274 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0bae6f09-c44f-479c-9fa6-0184738978d7 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:48.548052 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0bae6f09-c44f-479c-9fa6-0184738978d7 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:48.548661 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0bae6f09-c44f-479c-9fa6-0184738978d7 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:48.608551 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0f8c7522-79cb-4032-a582-c828466277ce tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:48.622028 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=59 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:51:48.628455 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-0bae6f09-c44f-479c-9fa6-0184738978d7 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Getting quotas for project e43a52b503c946659d54675548a49bab. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:51:48.642435 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0f8c7522-79cb-4032-a582-c828466277ce tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:48.652077 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0f8c7522-79cb-4032-a582-c828466277ce tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:48.663437 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-0bae6f09-c44f-479c-9fa6-0184738978d7 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Getting quotas for user 8c3a535cc471436689e916bd1cbc3159 and project e43a52b503c946659d54675548a49bab. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:51:48.668617 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0f8c7522-79cb-4032-a582-c828466277ce tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1546 microversion: 2.91 time: 0.419438 Sep 24 20:51:48.670198 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 318/615] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:51:48 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1546 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:51:48.684933 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-24e0e552-5eb2-4ba5-9ee9-72a20f604de5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:48.688676 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-24e0e552-5eb2-4ba5-9ee9-72a20f604de5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:48.704506 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.utils [None req-0bae6f09-c44f-479c-9fa6-0184738978d7 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] instances quota exceeded for e43a52b503c946659d54675548a49bab, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=140517) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 24 20:51:48.707497 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-0bae6f09-c44f-479c-9fa6-0184738978d7 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 24 20:51:48.709688 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-24e0e552-5eb2-4ba5-9ee9-72a20f604de5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:48.710070 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-24e0e552-5eb2-4ba5-9ee9-72a20f604de5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:48.714609 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0bae6f09-c44f-479c-9fa6-0184738978d7 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Request method failure captured: Sep 24 20:51:48.714609 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 24 20:51:48.714609 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:51:48.714609 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:51:48.714609 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:51:48.714609 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 145 Sep 24 20:51:48.714609 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:51:48.714609 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:51:48.714609 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:51:48.714609 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:51:48.714609 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL23ePUhVZzryQImcxmczlbHgoUaIhkGK5uzP6lNoNEYcxciXTl-Rby5jikBcLqinVyZJs8nEknhrFh2RkQCQuaXrAXCrKPCv6tRqu97gVRcMYG0X83PdEvsQGOSMTNYXrFVHteZoiS4yWqnJyaOx7mBcr7dCuJ7oVnn1qTsMnNKBJ2g Sep 24 20:51:48.714609 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:51:48.714609 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:51:48.714609 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:51:48.714609 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:51:48.714609 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:51:48.714609 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:51:48.714609 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: e43a52b503c946659d54675548a49bab Sep 24 20:51:48.714609 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-QuotasAdminNegativeTest-723968951 Sep 24 20:51:48.714609 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:51:48.714609 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:51:48.716124 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e43a52b503c946659d54675548a49bab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e43a52b503c946659d54675548a49bab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e43a52b503c946659d54675548a49bab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e43a52b503c946659d54675548a49bab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:51:48.716124 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-QuotasAdminNegativeTest-723968951 Sep 24 20:51:48.716124 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: e43a52b503c946659d54675548a49bab Sep 24 20:51:48.716124 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-723968951 Sep 24 20:51:48.716124 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-QuotasAdminNegativeTest-723968951-project Sep 24 20:51:48.716124 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:51:48.716124 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:51:48.716124 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 8c3a535cc471436689e916bd1cbc3159 Sep 24 20:51:48.716124 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-QuotasAdminNegativeTest-723968951-project Sep 24 20:51:48.716124 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 20:51:48.716124 ncdv-master-1 devstack@n-api.service[140517]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1768820664", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452"}} Sep 24 20:51:48.716124 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:51:48.717263 ncdv-master-1 devstack@n-api.service[140517]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 24 20:51:48.717263 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1768820664', 'imageRef': '4c30e8e9-8fb2-4377-83f1-98322cb17799', 'flavorRef': '452'}}} Sep 24 20:51:48.717263 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:51:48.717263 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:48.717263 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 24 20:51:48.717263 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 24 20:51:48.717263 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 20:51:48.717263 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 20:51:48.717263 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 24 20:51:48.717263 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc Sep 24 20:51:48.717263 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 24 20:51:48.717263 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 24 20:51:48.717263 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 20:51:48.717263 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 20:51:48.717263 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 24 20:51:48.717263 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 24 20:51:48.717263 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 24 20:51:48.717263 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 24 20:51:48.718573 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 24 20:51:48.718573 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 24 20:51:48.718573 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Sep 24 20:51:48.718573 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:48.718573 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:48.718573 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:48.718573 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:48.718573 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 24 20:51:48.718573 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 24 20:51:48.718573 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 24 20:51:48.718573 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 24 20:51:48.718573 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 24 20:51:48.718573 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 24 20:51:48.718573 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 24 20:51:48.718573 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 24 20:51:48.718573 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 24 20:51:48.718573 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 24 20:51:48.718573 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 24 20:51:48.718573 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:48.718573 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:48.718573 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:48.720003 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:48.720003 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:48.720003 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:48.720003 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:51:48.720003 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:51:48.720003 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:51:48.720003 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:51:48.720003 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:51:48.720003 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:51:48.720003 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:51:48.720003 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:51:48.720003 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:51:48.720003 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:51:48.720003 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 24 20:51:48.720003 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 24 20:51:48.720003 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 24 20:51:48.720003 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 24 20:51:48.720003 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:48.720003 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:48.720003 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:48.720003 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:48.721845 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:48.721845 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:48.721845 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:51:48.721845 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:51:48.721845 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 24 20:51:48.721845 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:48.723457 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-24e0e552-5eb2-4ba5-9ee9-72a20f604de5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:48.724735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-24e0e552-5eb2-4ba5-9ee9-72a20f604de5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:48.726649 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0bae6f09-c44f-479c-9fa6-0184738978d7 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:51:48.728143 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-24e0e552-5eb2-4ba5-9ee9-72a20f604de5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:48.730086 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-24e0e552-5eb2-4ba5-9ee9-72a20f604de5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:48.733210 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0bae6f09-c44f-479c-9fa6-0184738978d7 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.947407 Sep 24 20:51:48.735228 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 298/616] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:51:47 2022] POST /compute/v2.1/servers => generated 119 bytes in 954 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 24 20:51:48.748520 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9f3b9dfa-20f2-492e-b448-5849716e4a5c tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:48.749214 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9f3b9dfa-20f2-492e-b448-5849716e4a5c tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: b4b8b488-a1f1-42fb-b34a-04005d670e7b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:48.763615 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f3b9dfa-20f2-492e-b448-5849716e4a5c tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:48.767013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f3b9dfa-20f2-492e-b448-5849716e4a5c tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:48.767502 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f3b9dfa-20f2-492e-b448-5849716e4a5c tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:48.768344 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f3b9dfa-20f2-492e-b448-5849716e4a5c tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:48.768739 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f3b9dfa-20f2-492e-b448-5849716e4a5c tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:48.770144 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f3b9dfa-20f2-492e-b448-5849716e4a5c tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:48.958950 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9f3b9dfa-20f2-492e-b448-5849716e4a5c tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:48.970991 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9f3b9dfa-20f2-492e-b448-5849716e4a5c tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b" status: 200 len: 1276 microversion: 2.1 time: 0.234434 Sep 24 20:51:48.971588 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 299/617] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:48 2022] GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b => generated 1276 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:48.990589 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f553eab7-83db-4e59-9038-77f81c537ca0 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:48.993352 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f553eab7-83db-4e59-9038-77f81c537ca0 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: a44ee230-ea66-4c1b-90e4-4e5a9a0cd994] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:49.017493 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f553eab7-83db-4e59-9038-77f81c537ca0 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:49.017995 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f553eab7-83db-4e59-9038-77f81c537ca0 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:49.018511 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f553eab7-83db-4e59-9038-77f81c537ca0 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:49.023593 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f553eab7-83db-4e59-9038-77f81c537ca0 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:49.024701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f553eab7-83db-4e59-9038-77f81c537ca0 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:49.025158 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f553eab7-83db-4e59-9038-77f81c537ca0 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:49.194982 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-24e0e552-5eb2-4ba5-9ee9-72a20f604de5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:49.208967 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-24e0e552-5eb2-4ba5-9ee9-72a20f604de5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1312 microversion: 2.1 time: 0.535931 Sep 24 20:51:49.222528 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 319/618] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:48 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1312 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:49.229212 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8e472b0d-faf2-4305-ac87-e85ce76d7b1f tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Action: 'update', calling method: .version_select at 0x7f4b0ca2d0d0>, body: {"quota_set": {"instances": 10}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:49.359290 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f553eab7-83db-4e59-9038-77f81c537ca0 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:49.368867 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f553eab7-83db-4e59-9038-77f81c537ca0 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994" status: 200 len: 1314 microversion: 2.1 time: 0.395787 Sep 24 20:51:49.383083 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 300/619] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:48 2022] GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:49.383083 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-79ed2340-5bad-4dfb-86ea-9f3cafe464eb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:49.383083 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-79ed2340-5bad-4dfb-86ea-9f3cafe464eb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:49.398940 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8e472b0d-faf2-4305-ac87-e85ce76d7b1f tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:49.401965 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8e472b0d-faf2-4305-ac87-e85ce76d7b1f tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:49.402430 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8e472b0d-faf2-4305-ac87-e85ce76d7b1f tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:49.407295 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79ed2340-5bad-4dfb-86ea-9f3cafe464eb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:49.409640 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79ed2340-5bad-4dfb-86ea-9f3cafe464eb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:49.410068 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8e472b0d-faf2-4305-ac87-e85ce76d7b1f tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:49.410187 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79ed2340-5bad-4dfb-86ea-9f3cafe464eb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:49.414617 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8e472b0d-faf2-4305-ac87-e85ce76d7b1f tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:49.415279 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8e472b0d-faf2-4305-ac87-e85ce76d7b1f tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:49.415695 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79ed2340-5bad-4dfb-86ea-9f3cafe464eb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:49.416230 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79ed2340-5bad-4dfb-86ea-9f3cafe464eb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:49.416688 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79ed2340-5bad-4dfb-86ea-9f3cafe464eb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:49.519788 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:51:49.611382 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8e472b0d-faf2-4305-ac87-e85ce76d7b1f tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/e43a52b503c946659d54675548a49bab" status: 200 len: 329 microversion: 2.1 time: 0.394405 Sep 24 20:51:49.614911 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 320/620] 10.222.0.52 () {60 vars in 1262 bytes} [Sat Sep 24 20:51:49 2022] PUT /compute/v2.1/os-quota-sets/e43a52b503c946659d54675548a49bab => generated 329 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:49.663442 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-38b90508-e176-4f73-a5f7-beda63e7efd3 tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Calling method '.version_select at 0x7f4b0ca2d1f0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:49.782073 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-79ed2340-5bad-4dfb-86ea-9f3cafe464eb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:49.794484 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-79ed2340-5bad-4dfb-86ea-9f3cafe464eb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d" status: 200 len: 1310 microversion: 2.1 time: 0.418925 Sep 24 20:51:49.810580 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 301/621] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:49 2022] GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d => generated 1310 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:49.820387 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5d6765df-520e-473f-bbe0-c84e316157ca tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:49.821554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5d6765df-520e-473f-bbe0-c84e316157ca tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:49.844435 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d6765df-520e-473f-bbe0-c84e316157ca tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:49.848461 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-38b90508-e176-4f73-a5f7-beda63e7efd3 tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/e43a52b503c946659d54675548a49bab" status: 200 len: 371 microversion: 2.1 time: 0.223356 Sep 24 20:51:49.849323 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d6765df-520e-473f-bbe0-c84e316157ca tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:49.850749 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d6765df-520e-473f-bbe0-c84e316157ca tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:49.859475 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d6765df-520e-473f-bbe0-c84e316157ca tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:49.860007 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 321/622] 10.222.0.52 () {58 vars in 1242 bytes} [Sat Sep 24 20:51:49 2022] GET /compute/v2.1/os-quota-sets/e43a52b503c946659d54675548a49bab => generated 371 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:49.862988 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d6765df-520e-473f-bbe0-c84e316157ca tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:49.863675 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d6765df-520e-473f-bbe0-c84e316157ca tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:49.878444 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f2ad8872-7743-4a29-a933-3ee31dc81b8c tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Action: 'update', calling method: .version_select at 0x7f4b0ce2dd30>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:50.011274 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f2ad8872-7743-4a29-a933-3ee31dc81b8c tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:50.011986 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f2ad8872-7743-4a29-a933-3ee31dc81b8c tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:50.012590 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f2ad8872-7743-4a29-a933-3ee31dc81b8c tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:50.013683 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f2ad8872-7743-4a29-a933-3ee31dc81b8c tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:50.014446 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f2ad8872-7743-4a29-a933-3ee31dc81b8c tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:50.015219 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f2ad8872-7743-4a29-a933-3ee31dc81b8c tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:50.067971 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5d6765df-520e-473f-bbe0-c84e316157ca tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:50.093409 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5d6765df-520e-473f-bbe0-c84e316157ca tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:50.097029 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5d6765df-520e-473f-bbe0-c84e316157ca tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:50.108216 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:51:50.121565 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5d6765df-520e-473f-bbe0-c84e316157ca tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1546 microversion: 2.91 time: 0.308563 Sep 24 20:51:50.122455 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 302/623] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:51:49 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1546 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:51:50.132347 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0476d8e7-755f-4eea-8191-0d7ce415b626 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:50.136937 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0476d8e7-755f-4eea-8191-0d7ce415b626 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: b4b8b488-a1f1-42fb-b34a-04005d670e7b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:50.144238 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f2ad8872-7743-4a29-a933-3ee31dc81b8c tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/e43a52b503c946659d54675548a49bab" status: 200 len: 325 microversion: 2.1 time: 0.276830 Sep 24 20:51:50.153463 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 322/624] 10.222.0.52 () {60 vars in 1262 bytes} [Sat Sep 24 20:51:49 2022] PUT /compute/v2.1/os-quota-sets/e43a52b503c946659d54675548a49bab => generated 325 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:50.157094 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0476d8e7-755f-4eea-8191-0d7ce415b626 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:50.158020 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0476d8e7-755f-4eea-8191-0d7ce415b626 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:50.160701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0476d8e7-755f-4eea-8191-0d7ce415b626 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:50.161673 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0476d8e7-755f-4eea-8191-0d7ce415b626 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:50.162297 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0476d8e7-755f-4eea-8191-0d7ce415b626 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:50.162925 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0476d8e7-755f-4eea-8191-0d7ce415b626 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:50.237268 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6ac647bc-a716-4faa-96a0-91a3b2302968 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:50.238070 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6ac647bc-a716-4faa-96a0-91a3b2302968 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:50.256483 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ac647bc-a716-4faa-96a0-91a3b2302968 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:50.257025 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ac647bc-a716-4faa-96a0-91a3b2302968 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:50.257474 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ac647bc-a716-4faa-96a0-91a3b2302968 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:50.276741 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ac647bc-a716-4faa-96a0-91a3b2302968 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:50.281052 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ac647bc-a716-4faa-96a0-91a3b2302968 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:50.281542 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ac647bc-a716-4faa-96a0-91a3b2302968 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:50.346446 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0476d8e7-755f-4eea-8191-0d7ce415b626 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:50.361883 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0476d8e7-755f-4eea-8191-0d7ce415b626 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b" status: 200 len: 1276 microversion: 2.1 time: 0.237552 Sep 24 20:51:50.368122 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 303/625] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:50 2022] GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b => generated 1276 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:50.380704 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7b7e8da8-8efa-463b-93ee-0c069a3b9b03 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-585736253", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:50.565064 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-7b7e8da8-8efa-463b-93ee-0c069a3b9b03 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] validate_networks() for None {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:51:50.826541 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6ac647bc-a716-4faa-96a0-91a3b2302968 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:50.839510 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6ac647bc-a716-4faa-96a0-91a3b2302968 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1312 microversion: 2.1 time: 0.606989 Sep 24 20:51:50.846983 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 323/626] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:50 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1312 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:51:50.866485 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-162bf538-b64e-4372-841f-8c7885e150df tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:50.871866 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-162bf538-b64e-4372-841f-8c7885e150df tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: a44ee230-ea66-4c1b-90e4-4e5a9a0cd994] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:50.900270 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-162bf538-b64e-4372-841f-8c7885e150df tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:50.903510 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-162bf538-b64e-4372-841f-8c7885e150df tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:50.903978 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-162bf538-b64e-4372-841f-8c7885e150df tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:50.904864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-162bf538-b64e-4372-841f-8c7885e150df tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:50.905451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-162bf538-b64e-4372-841f-8c7885e150df tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:50.905891 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-162bf538-b64e-4372-841f-8c7885e150df tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:51.361795 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-7b7e8da8-8efa-463b-93ee-0c069a3b9b03 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:51:51.363486 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-7b7e8da8-8efa-463b-93ee-0c069a3b9b03 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:51:51.364176 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-7b7e8da8-8efa-463b-93ee-0c069a3b9b03 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:51:51.364752 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-7b7e8da8-8efa-463b-93ee-0c069a3b9b03 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:51:51.365350 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-7b7e8da8-8efa-463b-93ee-0c069a3b9b03 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:51:51.384459 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-162bf538-b64e-4372-841f-8c7885e150df tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:51.392101 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b7e8da8-8efa-463b-93ee-0c069a3b9b03 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:51.393096 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b7e8da8-8efa-463b-93ee-0c069a3b9b03 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:51.396941 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-162bf538-b64e-4372-841f-8c7885e150df tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994" status: 200 len: 1314 microversion: 2.1 time: 0.548620 Sep 24 20:51:51.397750 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b7e8da8-8efa-463b-93ee-0c069a3b9b03 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:51.398564 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 324/627] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:50 2022] GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 => generated 1314 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:51.399723 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b7e8da8-8efa-463b-93ee-0c069a3b9b03 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:51.400123 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b7e8da8-8efa-463b-93ee-0c069a3b9b03 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:51.400573 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b7e8da8-8efa-463b-93ee-0c069a3b9b03 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:51.405231 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1659a7d2-eb18-4b76-a85f-10b15a85c29f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:51.406161 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1659a7d2-eb18-4b76-a85f-10b15a85c29f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:51.413072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1659a7d2-eb18-4b76-a85f-10b15a85c29f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:51.414131 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1659a7d2-eb18-4b76-a85f-10b15a85c29f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:51.414947 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1659a7d2-eb18-4b76-a85f-10b15a85c29f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:51.415918 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1659a7d2-eb18-4b76-a85f-10b15a85c29f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:51.416607 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1659a7d2-eb18-4b76-a85f-10b15a85c29f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:51.417279 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1659a7d2-eb18-4b76-a85f-10b15a85c29f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:51.488872 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-7b7e8da8-8efa-463b-93ee-0c069a3b9b03 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Getting quotas for project e43a52b503c946659d54675548a49bab. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:51:51.503071 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-7b7e8da8-8efa-463b-93ee-0c069a3b9b03 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Getting quotas for user 8c3a535cc471436689e916bd1cbc3159 and project e43a52b503c946659d54675548a49bab. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:51:51.553534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.utils [None req-7b7e8da8-8efa-463b-93ee-0c069a3b9b03 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] ram quota exceeded for e43a52b503c946659d54675548a49bab, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=140517) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 24 20:51:51.555645 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-7b7e8da8-8efa-463b-93ee-0c069a3b9b03 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 24 20:51:51.558566 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7b7e8da8-8efa-463b-93ee-0c069a3b9b03 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Request method failure captured: Sep 24 20:51:51.558566 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 24 20:51:51.558566 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:51:51.558566 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:51:51.558566 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:51:51.558566 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 144 Sep 24 20:51:51.558566 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:51:51.558566 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:51:51.558566 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:51:51.558566 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:51:51.558566 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL23ePUhVZzryQImcxmczlbHgoUaIhkGK5uzP6lNoNEYcxciXTl-Rby5jikBcLqinVyZJs8nEknhrFh2RkQCQuaXrAXCrKPCv6tRqu97gVRcMYG0X83PdEvsQGOSMTNYXrFVHteZoiS4yWqnJyaOx7mBcr7dCuJ7oVnn1qTsMnNKBJ2g Sep 24 20:51:51.558566 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:51:51.558566 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:51:51.558566 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:51:51.558566 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:51:51.558566 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:51:51.558566 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:51:51.558566 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: e43a52b503c946659d54675548a49bab Sep 24 20:51:51.558566 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-QuotasAdminNegativeTest-723968951 Sep 24 20:51:51.558566 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:51:51.558566 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:51:51.560395 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e43a52b503c946659d54675548a49bab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e43a52b503c946659d54675548a49bab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e43a52b503c946659d54675548a49bab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e43a52b503c946659d54675548a49bab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:51:51.560395 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-QuotasAdminNegativeTest-723968951 Sep 24 20:51:51.560395 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: e43a52b503c946659d54675548a49bab Sep 24 20:51:51.560395 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-723968951 Sep 24 20:51:51.560395 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-QuotasAdminNegativeTest-723968951-project Sep 24 20:51:51.560395 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:51:51.560395 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:51:51.560395 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 8c3a535cc471436689e916bd1cbc3159 Sep 24 20:51:51.560395 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-QuotasAdminNegativeTest-723968951-project Sep 24 20:51:51.560395 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 20:51:51.560395 ncdv-master-1 devstack@n-api.service[140517]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-585736253", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452"}} Sep 24 20:51:51.560395 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:51:51.561436 ncdv-master-1 devstack@n-api.service[140517]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 24 20:51:51.561436 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-585736253', 'imageRef': '4c30e8e9-8fb2-4377-83f1-98322cb17799', 'flavorRef': '452'}}} Sep 24 20:51:51.561436 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:51:51.561436 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:51.561436 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 24 20:51:51.561436 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 24 20:51:51.561436 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 20:51:51.561436 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 20:51:51.561436 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 24 20:51:51.561436 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc Sep 24 20:51:51.561436 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 24 20:51:51.561436 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 24 20:51:51.561436 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 20:51:51.561436 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 20:51:51.561436 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 24 20:51:51.561436 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 24 20:51:51.561436 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 24 20:51:51.561436 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 24 20:51:51.562986 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 24 20:51:51.562986 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 24 20:51:51.562986 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 24 20:51:51.562986 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:51.562986 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:51.562986 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:51.562986 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:51.562986 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 24 20:51:51.562986 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 24 20:51:51.562986 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 24 20:51:51.562986 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 24 20:51:51.562986 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 24 20:51:51.562986 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 24 20:51:51.562986 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 24 20:51:51.562986 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 24 20:51:51.562986 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 24 20:51:51.562986 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 24 20:51:51.562986 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 24 20:51:51.562986 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:51.562986 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:51.562986 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:51.564498 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:51.564498 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:51.564498 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:51.564498 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:51:51.564498 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:51:51.564498 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:51:51.564498 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:51:51.564498 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:51:51.564498 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:51:51.564498 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:51:51.564498 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:51:51.564498 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:51:51.564498 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:51:51.564498 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 24 20:51:51.564498 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 24 20:51:51.564498 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 24 20:51:51.564498 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 24 20:51:51.564498 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:51.564498 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:51.564498 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:51.564498 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:51.566018 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:51.566018 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:51.566018 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:51:51.566018 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:51:51.566018 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 24 20:51:51.566018 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:51:51.567853 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7b7e8da8-8efa-463b-93ee-0c069a3b9b03 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:51:51.569128 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7b7e8da8-8efa-463b-93ee-0c069a3b9b03 tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.199870 Sep 24 20:51:51.571144 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 304/628] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:51:50 2022] POST /compute/v2.1/servers => generated 110 bytes in 1202 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:51:51.577558 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4bfe5949-751b-4740-8946-3b3d6c97952e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:51.578696 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4bfe5949-751b-4740-8946-3b3d6c97952e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:51.594034 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4bfe5949-751b-4740-8946-3b3d6c97952e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:51.595114 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4bfe5949-751b-4740-8946-3b3d6c97952e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:51.595924 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4bfe5949-751b-4740-8946-3b3d6c97952e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:51.600350 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4bfe5949-751b-4740-8946-3b3d6c97952e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:51.602085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4bfe5949-751b-4740-8946-3b3d6c97952e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:51.604074 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4bfe5949-751b-4740-8946-3b3d6c97952e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:51.763562 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4bfe5949-751b-4740-8946-3b3d6c97952e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:51.784945 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4bfe5949-751b-4740-8946-3b3d6c97952e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:51.790572 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4bfe5949-751b-4740-8946-3b3d6c97952e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:51.817841 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4bfe5949-751b-4740-8946-3b3d6c97952e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1546 microversion: 2.91 time: 0.245164 Sep 24 20:51:51.823447 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 305/629] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:51:51 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1546 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:51:51.844280 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4dedcc6b-02ec-427c-8ce6-67163e2d761f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:51.844920 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4dedcc6b-02ec-427c-8ce6-67163e2d761f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: b4b8b488-a1f1-42fb-b34a-04005d670e7b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:51.866533 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4dedcc6b-02ec-427c-8ce6-67163e2d761f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:51.872686 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4dedcc6b-02ec-427c-8ce6-67163e2d761f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:51.875501 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4dedcc6b-02ec-427c-8ce6-67163e2d761f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:51.876363 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4dedcc6b-02ec-427c-8ce6-67163e2d761f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:51.876771 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4dedcc6b-02ec-427c-8ce6-67163e2d761f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:51.877178 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4dedcc6b-02ec-427c-8ce6-67163e2d761f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:51.907604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1659a7d2-eb18-4b76-a85f-10b15a85c29f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:51.923015 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1659a7d2-eb18-4b76-a85f-10b15a85c29f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d" status: 200 len: 1310 microversion: 2.1 time: 0.517425 Sep 24 20:51:51.923648 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 325/630] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:51 2022] GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d => generated 1310 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:51.938847 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5d5aff30-a939-486b-bc14-f8c96bbadccb tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Action: 'update', calling method: .version_select at 0x7f4b0d151ca0>, body: {"quota_set": {"ram": 51200}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:52.075512 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4dedcc6b-02ec-427c-8ce6-67163e2d761f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:52.090681 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4dedcc6b-02ec-427c-8ce6-67163e2d761f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b" status: 200 len: 1284 microversion: 2.1 time: 0.265820 Sep 24 20:51:52.092720 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 306/631] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:51 2022] GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b => generated 1284 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:52.098408 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-50e54c7b-3aa3-4474-bb02-534be72d28b6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:52.099409 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-50e54c7b-3aa3-4474-bb02-534be72d28b6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:52.108647 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-50e54c7b-3aa3-4474-bb02-534be72d28b6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:52.109571 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-50e54c7b-3aa3-4474-bb02-534be72d28b6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:52.110308 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-50e54c7b-3aa3-4474-bb02-534be72d28b6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:52.111495 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-50e54c7b-3aa3-4474-bb02-534be72d28b6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:52.112201 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-50e54c7b-3aa3-4474-bb02-534be72d28b6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:52.113127 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-50e54c7b-3aa3-4474-bb02-534be72d28b6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:52.140347 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d5aff30-a939-486b-bc14-f8c96bbadccb tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:52.140879 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d5aff30-a939-486b-bc14-f8c96bbadccb tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:52.141328 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d5aff30-a939-486b-bc14-f8c96bbadccb tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:52.142102 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d5aff30-a939-486b-bc14-f8c96bbadccb tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:52.142587 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d5aff30-a939-486b-bc14-f8c96bbadccb tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:52.143018 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d5aff30-a939-486b-bc14-f8c96bbadccb tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:52.262590 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5d5aff30-a939-486b-bc14-f8c96bbadccb tempest-QuotasAdminNegativeTest-1004569023 tempest-QuotasAdminNegativeTest-1004569023-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/e43a52b503c946659d54675548a49bab" status: 200 len: 329 microversion: 2.1 time: 0.337794 Sep 24 20:51:52.263197 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 326/632] 10.222.0.52 () {60 vars in 1262 bytes} [Sat Sep 24 20:51:51 2022] PUT /compute/v2.1/os-quota-sets/e43a52b503c946659d54675548a49bab => generated 329 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:52.281169 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ef520304-f169-4c9f-bcea-51236824176f tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Action: 'update', calling method: .version_select at 0x7f4b0c996d30>, body: {"quota_set": {"ram": 0}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:52.286053 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ef520304-f169-4c9f-bcea-51236824176f tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '8c3a535cc471436689e916bd1cbc3159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43a52b503c946659d54675548a49bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:52.289113 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ef520304-f169-4c9f-bcea-51236824176f tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Request method failure captured: Sep 24 20:51:52.289113 ncdv-master-1 devstack@n-api.service[140516]: request: PUT /compute/v2.1/os-quota-sets/e43a52b503c946659d54675548a49bab HTTP/1.1 Sep 24 20:51:52.289113 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:51:52.289113 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:51:52.289113 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:51:52.289113 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 25 Sep 24 20:51:52.289113 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:51:52.289113 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:51:52.289113 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:51:52.289113 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:51:52.289113 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL23ePUhVZzryQImcxmczlbHgoUaIhkGK5uzP6lNoNEYcxciXTl-Rby5jikBcLqinVyZJs8nEknhrFh2RkQCQuaXrAXCrKPCv6tRqu97gVRcMYG0X83PdEvsQGOSMTNYXrFVHteZoiS4yWqnJyaOx7mBcr7dCuJ7oVnn1qTsMnNKBJ2g Sep 24 20:51:52.289113 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:51:52.289113 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:51:52.289113 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:51:52.289113 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:51:52.289113 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:51:52.289113 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:51:52.289113 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: e43a52b503c946659d54675548a49bab Sep 24 20:51:52.289113 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-QuotasAdminNegativeTest-723968951 Sep 24 20:51:52.289113 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:51:52.289113 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:51:52.290418 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e43a52b503c946659d54675548a49bab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e43a52b503c946659d54675548a49bab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e43a52b503c946659d54675548a49bab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e43a52b503c946659d54675548a49bab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:51:52.290418 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-QuotasAdminNegativeTest-723968951 Sep 24 20:51:52.290418 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: e43a52b503c946659d54675548a49bab Sep 24 20:51:52.290418 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-723968951 Sep 24 20:51:52.290418 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-QuotasAdminNegativeTest-723968951-project Sep 24 20:51:52.290418 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:51:52.290418 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:51:52.290418 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 8c3a535cc471436689e916bd1cbc3159 Sep 24 20:51:52.290418 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-QuotasAdminNegativeTest-723968951-project Sep 24 20:51:52.290418 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 20:51:52.290418 ncdv-master-1 devstack@n-api.service[140516]: {"quota_set": {"ram": 0}} Sep 24 20:51:52.290418 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:51:52.290418 ncdv-master-1 devstack@n-api.service[140516]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 24 20:51:52.290418 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'e43a52b503c946659d54675548a49bab', 'body': {'quota_set': {'ram': 0}}} Sep 24 20:51:52.291257 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:51:52.291257 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:52.291257 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:52.291257 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:52.291257 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:51:52.291257 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:51:52.291257 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:51:52.291257 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:51:52.291257 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:51:52.291257 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:51:52.291257 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:51:52.291257 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:51:52.291257 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Sep 24 20:51:52.291257 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Sep 24 20:51:52.291257 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 24 20:51:52.291257 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:51:52.291257 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 24 20:51:52.291257 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:51:52.291257 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Sep 24 20:51:52.292366 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Sep 24 20:51:52.292366 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 24 20:51:52.292366 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 24 20:51:52.292366 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 24 20:51:52.292366 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 24 20:51:52.292366 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:51:52.292366 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:51:52.292366 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:51:52.292366 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:51:52.292366 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 24 20:51:52.292366 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 24 20:51:52.292366 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 24 20:51:52.292366 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 24 20:51:52.292366 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 24 20:51:52.292366 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 24 20:51:52.292366 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 24 20:51:52.292366 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:52.292366 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:51:52.292366 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:52.292366 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:51:52.293520 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:51:52.293520 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:51:52.293520 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 24 20:51:52.293520 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 24 20:51:52.293520 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 24 20:51:52.293520 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:51:52.293520 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ef520304-f169-4c9f-bcea-51236824176f tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:51:52.293520 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ef520304-f169-4c9f-bcea-51236824176f tempest-QuotasAdminNegativeTest-723968951 tempest-QuotasAdminNegativeTest-723968951-project] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/e43a52b503c946659d54675548a49bab" status: 403 len: 116 microversion: 2.1 time: 0.014758 Sep 24 20:51:52.297016 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 327/633] 10.222.0.52 () {60 vars in 1262 bytes} [Sat Sep 24 20:51:52 2022] PUT /compute/v2.1/os-quota-sets/e43a52b503c946659d54675548a49bab => generated 116 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:51:52.382534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-50e54c7b-3aa3-4474-bb02-534be72d28b6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:52.395427 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-50e54c7b-3aa3-4474-bb02-534be72d28b6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1312 microversion: 2.1 time: 0.301264 Sep 24 20:51:52.396398 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 307/634] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:52 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1312 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:52.429641 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ecd9916a-500e-4a16-94aa-26a860287469 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:52.430888 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ecd9916a-500e-4a16-94aa-26a860287469 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: a44ee230-ea66-4c1b-90e4-4e5a9a0cd994] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:52.449356 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ecd9916a-500e-4a16-94aa-26a860287469 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:52.451658 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ecd9916a-500e-4a16-94aa-26a860287469 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:52.453155 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ecd9916a-500e-4a16-94aa-26a860287469 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:52.456126 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ecd9916a-500e-4a16-94aa-26a860287469 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:52.459504 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ecd9916a-500e-4a16-94aa-26a860287469 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:52.461158 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ecd9916a-500e-4a16-94aa-26a860287469 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:52.854585 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d631611a-1ce1-4967-82c5-049a2bf28cf1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:52.856466 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d631611a-1ce1-4967-82c5-049a2bf28cf1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:52.874065 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d631611a-1ce1-4967-82c5-049a2bf28cf1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:52.875109 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d631611a-1ce1-4967-82c5-049a2bf28cf1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:52.878569 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d631611a-1ce1-4967-82c5-049a2bf28cf1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:52.882346 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d631611a-1ce1-4967-82c5-049a2bf28cf1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:52.885439 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d631611a-1ce1-4967-82c5-049a2bf28cf1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:52.886324 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d631611a-1ce1-4967-82c5-049a2bf28cf1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:52.887438 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ecd9916a-500e-4a16-94aa-26a860287469 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:52.897940 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ecd9916a-500e-4a16-94aa-26a860287469 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994" status: 200 len: 1314 microversion: 2.1 time: 0.475693 Sep 24 20:51:52.917513 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 328/635] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:52 2022] GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 => generated 1314 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:52.951198 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-623498df-0b40-46b4-b132-2eaeae6afa85 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:52.952114 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-623498df-0b40-46b4-b132-2eaeae6afa85 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:52.983170 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-623498df-0b40-46b4-b132-2eaeae6afa85 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:52.985679 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-623498df-0b40-46b4-b132-2eaeae6afa85 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:52.986233 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-623498df-0b40-46b4-b132-2eaeae6afa85 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:52.987281 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-623498df-0b40-46b4-b132-2eaeae6afa85 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:52.991036 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-623498df-0b40-46b4-b132-2eaeae6afa85 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:52.991945 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-623498df-0b40-46b4-b132-2eaeae6afa85 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:53.059666 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d631611a-1ce1-4967-82c5-049a2bf28cf1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:53.081469 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d631611a-1ce1-4967-82c5-049a2bf28cf1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:53.091210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d631611a-1ce1-4967-82c5-049a2bf28cf1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:53.126576 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d631611a-1ce1-4967-82c5-049a2bf28cf1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1546 microversion: 2.91 time: 0.276897 Sep 24 20:51:53.132698 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 308/636] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:51:52 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1546 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:51:53.148422 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d72a6b72-cd32-4185-8239-e9962be23846 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:53.150115 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d72a6b72-cd32-4185-8239-e9962be23846 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: b4b8b488-a1f1-42fb-b34a-04005d670e7b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:53.160077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d72a6b72-cd32-4185-8239-e9962be23846 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:53.160965 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d72a6b72-cd32-4185-8239-e9962be23846 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:53.162105 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d72a6b72-cd32-4185-8239-e9962be23846 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:53.163118 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d72a6b72-cd32-4185-8239-e9962be23846 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:53.163971 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d72a6b72-cd32-4185-8239-e9962be23846 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:53.165519 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d72a6b72-cd32-4185-8239-e9962be23846 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:53.409418 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d72a6b72-cd32-4185-8239-e9962be23846 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:53.423111 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d72a6b72-cd32-4185-8239-e9962be23846 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b" status: 200 len: 1282 microversion: 2.1 time: 0.287226 Sep 24 20:51:53.424762 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 309/637] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:53 2022] GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b => generated 1282 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:53.433634 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-30284d9c-b659-4a3a-a1ca-c20f059c4a24 req-acb2844f-de58-482b-b9b6-8b03f7290bad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dc2952a-aad1-40d0-bd55-87c6b3b9618d", "name": "network-vif-plugged", "status": "completed", "tag": "092b1380-825b-4d02-bb2f-0dda7ef94e2e"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:53.450421 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-30284d9c-b659-4a3a-a1ca-c20f059c4a24 req-acb2844f-de58-482b-b9b6-8b03f7290bad service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:53.451815 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-30284d9c-b659-4a3a-a1ca-c20f059c4a24 req-acb2844f-de58-482b-b9b6-8b03f7290bad service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:53.453150 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-30284d9c-b659-4a3a-a1ca-c20f059c4a24 req-acb2844f-de58-482b-b9b6-8b03f7290bad service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:53.479259 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-30284d9c-b659-4a3a-a1ca-c20f059c4a24 req-acb2844f-de58-482b-b9b6-8b03f7290bad service nova] Creating event network-vif-plugged:092b1380-825b-4d02-bb2f-0dda7ef94e2e for instance 5dc2952a-aad1-40d0-bd55-87c6b3b9618d on nch1-master-1 Sep 24 20:51:53.497158 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-30284d9c-b659-4a3a-a1ca-c20f059c4a24 req-acb2844f-de58-482b-b9b6-8b03f7290bad service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064216 Sep 24 20:51:53.499023 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 310/638] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:53.510854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-abc2fc46-ceea-4d26-80f4-4a12cdf24d93 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:53.513058 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-abc2fc46-ceea-4d26-80f4-4a12cdf24d93 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:53.553519 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-abc2fc46-ceea-4d26-80f4-4a12cdf24d93 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:53.554020 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-abc2fc46-ceea-4d26-80f4-4a12cdf24d93 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:53.554517 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-abc2fc46-ceea-4d26-80f4-4a12cdf24d93 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:53.558053 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-abc2fc46-ceea-4d26-80f4-4a12cdf24d93 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:53.558609 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-abc2fc46-ceea-4d26-80f4-4a12cdf24d93 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:53.559131 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-abc2fc46-ceea-4d26-80f4-4a12cdf24d93 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:53.573310 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:51:53.634139 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-623498df-0b40-46b4-b132-2eaeae6afa85 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:53.638079 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:51:53.652692 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-623498df-0b40-46b4-b132-2eaeae6afa85 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d" status: 200 len: 1310 microversion: 2.1 time: 0.705242 Sep 24 20:51:53.655117 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 329/639] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:52 2022] GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d => generated 1310 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:53.925181 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-550fea67-02ed-46cd-b386-6323f83692b4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:53.927254 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-550fea67-02ed-46cd-b386-6323f83692b4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: a44ee230-ea66-4c1b-90e4-4e5a9a0cd994] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:53.944584 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-550fea67-02ed-46cd-b386-6323f83692b4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:53.948584 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-550fea67-02ed-46cd-b386-6323f83692b4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:53.949691 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-550fea67-02ed-46cd-b386-6323f83692b4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:53.952290 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-550fea67-02ed-46cd-b386-6323f83692b4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:53.953149 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-550fea67-02ed-46cd-b386-6323f83692b4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:53.954742 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-550fea67-02ed-46cd-b386-6323f83692b4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:54.219819 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-abc2fc46-ceea-4d26-80f4-4a12cdf24d93 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:54.236119 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-abc2fc46-ceea-4d26-80f4-4a12cdf24d93 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1312 microversion: 2.1 time: 0.734798 Sep 24 20:51:54.239000 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 311/640] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:53 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1312 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:54.254695 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-29af9d0b-07dd-42a0-a488-6ac164f4b825 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:54.255425 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-29af9d0b-07dd-42a0-a488-6ac164f4b825 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 9b0e9940-f6ac-46d5-8898-1e4ba56119b3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:54.268143 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-29af9d0b-07dd-42a0-a488-6ac164f4b825 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:54.268995 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-29af9d0b-07dd-42a0-a488-6ac164f4b825 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:54.269690 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-29af9d0b-07dd-42a0-a488-6ac164f4b825 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:54.270758 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-29af9d0b-07dd-42a0-a488-6ac164f4b825 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:54.271383 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-29af9d0b-07dd-42a0-a488-6ac164f4b825 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:54.272422 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-29af9d0b-07dd-42a0-a488-6ac164f4b825 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:54.323323 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-29af9d0b-07dd-42a0-a488-6ac164f4b825 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 9b0e9940-f6ac-46d5-8898-1e4ba56119b3] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:51:54.597682 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-29af9d0b-07dd-42a0-a488-6ac164f4b825 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3" status: 204 len: 0 microversion: 2.1 time: 0.357332 Sep 24 20:51:54.600019 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 312/641] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:51:54 2022] DELETE /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:51:54.614282 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-550fea67-02ed-46cd-b386-6323f83692b4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:54.618613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-683c816c-9bd2-4754-b1ae-dec6d1f28ea8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:54.628639 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-683c816c-9bd2-4754-b1ae-dec6d1f28ea8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:54.648302 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-683c816c-9bd2-4754-b1ae-dec6d1f28ea8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:54.652812 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-683c816c-9bd2-4754-b1ae-dec6d1f28ea8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:54.655193 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-550fea67-02ed-46cd-b386-6323f83692b4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994" status: 200 len: 1314 microversion: 2.1 time: 0.729588 Sep 24 20:51:54.670450 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 330/642] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:53 2022] GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 => generated 1314 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:54.671268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-683c816c-9bd2-4754-b1ae-dec6d1f28ea8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:54.671268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-683c816c-9bd2-4754-b1ae-dec6d1f28ea8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:54.671268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-683c816c-9bd2-4754-b1ae-dec6d1f28ea8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:54.671268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-683c816c-9bd2-4754-b1ae-dec6d1f28ea8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:54.671665 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9101011b-f181-4638-b523-e5b6b2d6e3bb tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:54.671665 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9101011b-f181-4638-b523-e5b6b2d6e3bb tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: b4b8b488-a1f1-42fb-b34a-04005d670e7b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:54.714755 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9101011b-f181-4638-b523-e5b6b2d6e3bb tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:54.716441 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9101011b-f181-4638-b523-e5b6b2d6e3bb tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:54.719988 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9101011b-f181-4638-b523-e5b6b2d6e3bb tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:54.734563 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9101011b-f181-4638-b523-e5b6b2d6e3bb tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:54.735177 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9101011b-f181-4638-b523-e5b6b2d6e3bb tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:54.735640 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9101011b-f181-4638-b523-e5b6b2d6e3bb tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:55.101438 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-683c816c-9bd2-4754-b1ae-dec6d1f28ea8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:55.149200 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-683c816c-9bd2-4754-b1ae-dec6d1f28ea8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:55.161116 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-683c816c-9bd2-4754-b1ae-dec6d1f28ea8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:55.170961 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9101011b-f181-4638-b523-e5b6b2d6e3bb tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:55.182255 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-683c816c-9bd2-4754-b1ae-dec6d1f28ea8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1546 microversion: 2.91 time: 0.581393 Sep 24 20:51:55.194534 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 313/643] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:51:54 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1546 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:51:55.205495 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fca14f5d-5f68-4555-9641-8ddb46de1a7f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:55.205495 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fca14f5d-5f68-4555-9641-8ddb46de1a7f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:55.208185 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9101011b-f181-4638-b523-e5b6b2d6e3bb tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b" status: 200 len: 1282 microversion: 2.1 time: 0.550664 Sep 24 20:51:55.217836 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fca14f5d-5f68-4555-9641-8ddb46de1a7f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:55.220773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fca14f5d-5f68-4555-9641-8ddb46de1a7f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:55.221324 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fca14f5d-5f68-4555-9641-8ddb46de1a7f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:55.223307 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fca14f5d-5f68-4555-9641-8ddb46de1a7f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:55.223826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fca14f5d-5f68-4555-9641-8ddb46de1a7f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:55.224264 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fca14f5d-5f68-4555-9641-8ddb46de1a7f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:55.227401 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 331/644] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:54 2022] GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b => generated 1282 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:55.241320 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4a80776e-669f-4876-9c04-f49dfc9af96c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1020312633", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "1835620820", "adminPass": "***", "networks": [{"uuid": "d9321d34-d679-4ed7-935d-3b84684d66b9"}], "security_groups": [{"name": "tempest-securitygroup--1471433951"}], "key_name": "tempest-keypair-1715256276", "user_data": "}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:55.584293 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-4a80776e-669f-4876-9c04-f49dfc9af96c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] validate_networks() for [('d9321d34-d679-4ed7-935d-3b84684d66b9', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:51:56.418830 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fca14f5d-5f68-4555-9641-8ddb46de1a7f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:56.432878 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fca14f5d-5f68-4555-9641-8ddb46de1a7f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d" status: 200 len: 1310 microversion: 2.1 time: 1.246229 Sep 24 20:51:56.434332 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 314/645] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:55 2022] GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d => generated 1310 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:56.450658 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-af072b17-b114-4a17-8f4b-718baef6ac7b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:56.451541 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-af072b17-b114-4a17-8f4b-718baef6ac7b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:56.458281 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af072b17-b114-4a17-8f4b-718baef6ac7b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:56.463917 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af072b17-b114-4a17-8f4b-718baef6ac7b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:56.464790 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af072b17-b114-4a17-8f4b-718baef6ac7b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:56.465412 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af072b17-b114-4a17-8f4b-718baef6ac7b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:56.466046 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af072b17-b114-4a17-8f4b-718baef6ac7b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:56.471778 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af072b17-b114-4a17-8f4b-718baef6ac7b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:56.874718 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-af072b17-b114-4a17-8f4b-718baef6ac7b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:56.883470 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-af072b17-b114-4a17-8f4b-718baef6ac7b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1312 microversion: 2.1 time: 0.447881 Sep 24 20:51:56.905539 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 315/646] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:56 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1312 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:56.910698 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8712a7e4-e857-4463-8e98-b972696345dc tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:56.915440 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8712a7e4-e857-4463-8e98-b972696345dc tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: a44ee230-ea66-4c1b-90e4-4e5a9a0cd994] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:56.938724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8712a7e4-e857-4463-8e98-b972696345dc tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:56.939746 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8712a7e4-e857-4463-8e98-b972696345dc tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:56.940435 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8712a7e4-e857-4463-8e98-b972696345dc tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:56.941424 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8712a7e4-e857-4463-8e98-b972696345dc tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:56.942229 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8712a7e4-e857-4463-8e98-b972696345dc tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:56.942990 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8712a7e4-e857-4463-8e98-b972696345dc tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:58.036202 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-4a80776e-669f-4876-9c04-f49dfc9af96c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:51:58.038455 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-4a80776e-669f-4876-9c04-f49dfc9af96c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:51:58.040943 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-4a80776e-669f-4876-9c04-f49dfc9af96c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:51:58.041743 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-4a80776e-669f-4876-9c04-f49dfc9af96c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:51:58.043375 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-4a80776e-669f-4876-9c04-f49dfc9af96c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:51:58.059127 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a80776e-669f-4876-9c04-f49dfc9af96c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:58.060055 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a80776e-669f-4876-9c04-f49dfc9af96c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:58.060756 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a80776e-669f-4876-9c04-f49dfc9af96c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:58.062317 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a80776e-669f-4876-9c04-f49dfc9af96c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:58.063045 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a80776e-669f-4876-9c04-f49dfc9af96c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:58.064038 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a80776e-669f-4876-9c04-f49dfc9af96c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:58.100048 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-4a80776e-669f-4876-9c04-f49dfc9af96c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Getting quotas for project 478a31be22cc451b92af447ed8d81242. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:51:58.112118 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-4a80776e-669f-4876-9c04-f49dfc9af96c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Getting quotas for user d278977b201c48dda2d73823fbfe4833 and project 478a31be22cc451b92af447ed8d81242. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:51:58.155002 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4a80776e-669f-4876-9c04-f49dfc9af96c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:51:58.160079 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4a80776e-669f-4876-9c04-f49dfc9af96c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 625f5fd3-d872-4da5-b176-5a70dfd8cfe2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:51:58.200638 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8712a7e4-e857-4463-8e98-b972696345dc tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:58.232105 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8712a7e4-e857-4463-8e98-b972696345dc tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994" status: 200 len: 1314 microversion: 2.1 time: 1.322378 Sep 24 20:51:58.234329 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 316/647] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:56 2022] GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 => generated 1314 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:58.252450 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8f8597fb-2b50-42f9-bd5a-00e0251bea0c tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:58.258817 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8f8597fb-2b50-42f9-bd5a-00e0251bea0c tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:58.290046 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8f8597fb-2b50-42f9-bd5a-00e0251bea0c tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:58.291611 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8f8597fb-2b50-42f9-bd5a-00e0251bea0c tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:58.293563 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8f8597fb-2b50-42f9-bd5a-00e0251bea0c tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:58.295462 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8f8597fb-2b50-42f9-bd5a-00e0251bea0c tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:58.296775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8f8597fb-2b50-42f9-bd5a-00e0251bea0c tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:58.297799 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8f8597fb-2b50-42f9-bd5a-00e0251bea0c tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:58.335870 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4a80776e-669f-4876-9c04-f49dfc9af96c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.106915 Sep 24 20:51:58.346219 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 332/648] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:51:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 3118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:51:58.357826 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-394e7687-dcec-4e01-b155-38073b625e07 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:58.358490 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-394e7687-dcec-4e01-b155-38073b625e07 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: b4b8b488-a1f1-42fb-b34a-04005d670e7b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:58.377386 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-394e7687-dcec-4e01-b155-38073b625e07 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:58.378185 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-394e7687-dcec-4e01-b155-38073b625e07 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:58.379056 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-394e7687-dcec-4e01-b155-38073b625e07 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:58.380291 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-394e7687-dcec-4e01-b155-38073b625e07 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:58.384043 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-394e7687-dcec-4e01-b155-38073b625e07 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:58.384948 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-394e7687-dcec-4e01-b155-38073b625e07 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:58.747811 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8f8597fb-2b50-42f9-bd5a-00e0251bea0c tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:58.760248 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8f8597fb-2b50-42f9-bd5a-00e0251bea0c tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:58.761739 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8f8597fb-2b50-42f9-bd5a-00e0251bea0c tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:58.775966 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8f8597fb-2b50-42f9-bd5a-00e0251bea0c tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1546 microversion: 2.91 time: 0.538767 Sep 24 20:51:58.784316 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 317/649] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:51:58 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1546 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:51:58.790101 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-653e0324-8b2d-482b-bb16-67c7b2f2004f req-45a759db-ea07-4a27-a8ff-33ab2c87342e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bde8ccc3-582c-4d8e-8bcd-3c5711560a26", "name": "network-vif-plugged", "status": "completed", "tag": "c4b07864-228d-47d5-9e64-61cd582aa91a"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:51:58.811513 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-653e0324-8b2d-482b-bb16-67c7b2f2004f req-45a759db-ea07-4a27-a8ff-33ab2c87342e service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:58.815112 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-653e0324-8b2d-482b-bb16-67c7b2f2004f req-45a759db-ea07-4a27-a8ff-33ab2c87342e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:58.815574 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-653e0324-8b2d-482b-bb16-67c7b2f2004f req-45a759db-ea07-4a27-a8ff-33ab2c87342e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:58.870714 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-653e0324-8b2d-482b-bb16-67c7b2f2004f req-45a759db-ea07-4a27-a8ff-33ab2c87342e service nova] Creating event network-vif-plugged:c4b07864-228d-47d5-9e64-61cd582aa91a for instance bde8ccc3-582c-4d8e-8bcd-3c5711560a26 on nch1-master-1 Sep 24 20:51:58.884489 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-653e0324-8b2d-482b-bb16-67c7b2f2004f req-45a759db-ea07-4a27-a8ff-33ab2c87342e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098456 Sep 24 20:51:58.894867 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 318/650] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:51:58.906575 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-30878f38-b6cb-4835-ada7-15f0ea78bd26 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:58.907296 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-30878f38-b6cb-4835-ada7-15f0ea78bd26 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:58.928341 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30878f38-b6cb-4835-ada7-15f0ea78bd26 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:58.928849 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30878f38-b6cb-4835-ada7-15f0ea78bd26 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:58.929332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30878f38-b6cb-4835-ada7-15f0ea78bd26 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:58.930832 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30878f38-b6cb-4835-ada7-15f0ea78bd26 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:58.947363 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30878f38-b6cb-4835-ada7-15f0ea78bd26 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:58.948086 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30878f38-b6cb-4835-ada7-15f0ea78bd26 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:59.202100 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-394e7687-dcec-4e01-b155-38073b625e07 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:59.211934 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-394e7687-dcec-4e01-b155-38073b625e07 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b" status: 200 len: 1324 microversion: 2.1 time: 0.864188 Sep 24 20:51:59.214614 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 333/651] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:58 2022] GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b => generated 1324 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:59.226393 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-49e4735f-addd-471c-8351-46fc1bdcb477 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:59.237502 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-49e4735f-addd-471c-8351-46fc1bdcb477 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:59.278025 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-49e4735f-addd-471c-8351-46fc1bdcb477 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:59.281128 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-49e4735f-addd-471c-8351-46fc1bdcb477 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:59.281861 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-49e4735f-addd-471c-8351-46fc1bdcb477 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:59.285150 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-49e4735f-addd-471c-8351-46fc1bdcb477 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:59.285866 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-49e4735f-addd-471c-8351-46fc1bdcb477 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:59.286450 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-49e4735f-addd-471c-8351-46fc1bdcb477 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:59.713048 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-30878f38-b6cb-4835-ada7-15f0ea78bd26 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:51:59.729578 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-30878f38-b6cb-4835-ada7-15f0ea78bd26 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d" status: 200 len: 1493 microversion: 2.1 time: 0.832836 Sep 24 20:51:59.730889 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 319/652] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:58 2022] GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d => generated 1493 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:51:59.772128 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-08e8eda9-b950-4460-8f25-b96c6ec74b47 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:51:59.774095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-08e8eda9-b950-4460-8f25-b96c6ec74b47 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 625f5fd3-d872-4da5-b176-5a70dfd8cfe2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:51:59.784282 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-08e8eda9-b950-4460-8f25-b96c6ec74b47 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:59.784859 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-08e8eda9-b950-4460-8f25-b96c6ec74b47 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:59.785298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-08e8eda9-b950-4460-8f25-b96c6ec74b47 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:51:59.786080 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-08e8eda9-b950-4460-8f25-b96c6ec74b47 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:51:59.786644 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-08e8eda9-b950-4460-8f25-b96c6ec74b47 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:51:59.787079 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-08e8eda9-b950-4460-8f25-b96c6ec74b47 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:00.007143 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-08e8eda9-b950-4460-8f25-b96c6ec74b47 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278977b201c48dda2d73823fbfe4833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a31be22cc451b92af447ed8d81242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:00.024069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-49e4735f-addd-471c-8351-46fc1bdcb477 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:00.031636 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-08e8eda9-b950-4460-8f25-b96c6ec74b47 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2" status: 200 len: 1269 microversion: 2.1 time: 0.265303 Sep 24 20:52:00.033729 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 320/653] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:59 2022] GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2 => generated 1269 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:00.047709 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-4ec6db02-69d0-4ca3-8979-ae876e816c5c req-8c3827af-1766-4ea7-8a42-63c67b02db3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4b8b488-a1f1-42fb-b34a-04005d670e7b", "tag": "412957fd-2470-4bdf-a174-c5dd3f956904"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:00.061515 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-49e4735f-addd-471c-8351-46fc1bdcb477 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1312 microversion: 2.1 time: 0.843211 Sep 24 20:52:00.062118 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 334/654] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:51:59 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1312 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:00.080570 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-4ec6db02-69d0-4ca3-8979-ae876e816c5c req-8c3827af-1766-4ea7-8a42-63c67b02db3d service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:00.082635 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-4ec6db02-69d0-4ca3-8979-ae876e816c5c req-8c3827af-1766-4ea7-8a42-63c67b02db3d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:00.084655 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-4ec6db02-69d0-4ca3-8979-ae876e816c5c req-8c3827af-1766-4ea7-8a42-63c67b02db3d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:00.093229 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-efbf9344-c609-4a98-b1eb-d5e1c970c16b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:00.096535 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-efbf9344-c609-4a98-b1eb-d5e1c970c16b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: a44ee230-ea66-4c1b-90e4-4e5a9a0cd994] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:00.108083 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-efbf9344-c609-4a98-b1eb-d5e1c970c16b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:00.108863 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-efbf9344-c609-4a98-b1eb-d5e1c970c16b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:00.109308 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-efbf9344-c609-4a98-b1eb-d5e1c970c16b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:00.110098 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-efbf9344-c609-4a98-b1eb-d5e1c970c16b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:00.110594 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-efbf9344-c609-4a98-b1eb-d5e1c970c16b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:00.111030 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-efbf9344-c609-4a98-b1eb-d5e1c970c16b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:00.116113 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-4ec6db02-69d0-4ca3-8979-ae876e816c5c req-8c3827af-1766-4ea7-8a42-63c67b02db3d service nova] Creating event network-changed:412957fd-2470-4bdf-a174-c5dd3f956904 for instance b4b8b488-a1f1-42fb-b34a-04005d670e7b on nch2-master-1 Sep 24 20:52:00.124138 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-4ec6db02-69d0-4ca3-8979-ae876e816c5c req-8c3827af-1766-4ea7-8a42-63c67b02db3d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087503 Sep 24 20:52:00.124967 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 321/655] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:52:00.526484 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2d26c4ab-a78e-4adb-b69a-65c731d93a3b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1548476664", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:00.588359 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-efbf9344-c609-4a98-b1eb-d5e1c970c16b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:00.608319 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-efbf9344-c609-4a98-b1eb-d5e1c970c16b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994" status: 200 len: 1314 microversion: 2.1 time: 0.521545 Sep 24 20:52:00.610884 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 335/656] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:00 2022] GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 => generated 1314 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:00.636583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-af7bdbf9-846c-49ea-8c5f-7c9cc80150c1 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:00.646189 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-af7bdbf9-846c-49ea-8c5f-7c9cc80150c1 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:00.673485 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af7bdbf9-846c-49ea-8c5f-7c9cc80150c1 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:00.681377 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af7bdbf9-846c-49ea-8c5f-7c9cc80150c1 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:00.682069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af7bdbf9-846c-49ea-8c5f-7c9cc80150c1 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:00.686697 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af7bdbf9-846c-49ea-8c5f-7c9cc80150c1 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:00.687384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af7bdbf9-846c-49ea-8c5f-7c9cc80150c1 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:00.690181 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af7bdbf9-846c-49ea-8c5f-7c9cc80150c1 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:00.691520 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-2d26c4ab-a78e-4adb-b69a-65c731d93a3b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] validate_networks() for None {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:52:01.323601 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-af7bdbf9-846c-49ea-8c5f-7c9cc80150c1 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d" status: 200 len: 1644 microversion: 2.1 time: 0.709292 Sep 24 20:52:01.324537 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 336/657] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:00 2022] GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d => generated 1644 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:01.361704 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d1e2dedd-0b2b-43d6-b0f4-5aabc734e419 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:01.365229 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d1e2dedd-0b2b-43d6-b0f4-5aabc734e419 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:01.375891 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d1e2dedd-0b2b-43d6-b0f4-5aabc734e419 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:01.377212 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d1e2dedd-0b2b-43d6-b0f4-5aabc734e419 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:01.378202 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d1e2dedd-0b2b-43d6-b0f4-5aabc734e419 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:01.383085 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d1e2dedd-0b2b-43d6-b0f4-5aabc734e419 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:01.384705 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d1e2dedd-0b2b-43d6-b0f4-5aabc734e419 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:01.386453 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d1e2dedd-0b2b-43d6-b0f4-5aabc734e419 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:01.433059 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=10 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:01.527393 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=9 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:01.754958 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d1e2dedd-0b2b-43d6-b0f4-5aabc734e419 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:01.775492 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d1e2dedd-0b2b-43d6-b0f4-5aabc734e419 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:01.783775 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d1e2dedd-0b2b-43d6-b0f4-5aabc734e419 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:01.801945 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d1e2dedd-0b2b-43d6-b0f4-5aabc734e419 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1546 microversion: 2.91 time: 0.453180 Sep 24 20:52:01.803274 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 337/658] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:01 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1546 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:01.813735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d03e6514-bde0-45a5-a006-eae48528a4e1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:01.815753 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d03e6514-bde0-45a5-a006-eae48528a4e1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: b4b8b488-a1f1-42fb-b34a-04005d670e7b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:01.837521 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d03e6514-bde0-45a5-a006-eae48528a4e1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:01.845593 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d03e6514-bde0-45a5-a006-eae48528a4e1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:01.850776 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d03e6514-bde0-45a5-a006-eae48528a4e1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:01.858552 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d03e6514-bde0-45a5-a006-eae48528a4e1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:01.859439 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d03e6514-bde0-45a5-a006-eae48528a4e1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:01.861057 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d03e6514-bde0-45a5-a006-eae48528a4e1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:02.170978 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-2d26c4ab-a78e-4adb-b69a-65c731d93a3b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:52:02.171665 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-2d26c4ab-a78e-4adb-b69a-65c731d93a3b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:52:02.172321 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-2d26c4ab-a78e-4adb-b69a-65c731d93a3b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:52:02.172895 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-2d26c4ab-a78e-4adb-b69a-65c731d93a3b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:52:02.173311 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-2d26c4ab-a78e-4adb-b69a-65c731d93a3b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:52:02.185871 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d26c4ab-a78e-4adb-b69a-65c731d93a3b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:02.186347 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d26c4ab-a78e-4adb-b69a-65c731d93a3b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:02.186819 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d26c4ab-a78e-4adb-b69a-65c731d93a3b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:02.187549 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d26c4ab-a78e-4adb-b69a-65c731d93a3b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:02.188007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d26c4ab-a78e-4adb-b69a-65c731d93a3b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:02.188431 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d26c4ab-a78e-4adb-b69a-65c731d93a3b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:02.208635 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-2d26c4ab-a78e-4adb-b69a-65c731d93a3b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Getting quotas for project 73bec7c48b07450f95a29a35e113153d. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:52:02.214629 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-2d26c4ab-a78e-4adb-b69a-65c731d93a3b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Getting quotas for user 936372eff4da45e281fc5512632a12b6 and project 73bec7c48b07450f95a29a35e113153d. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:52:02.232463 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2d26c4ab-a78e-4adb-b69a-65c731d93a3b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:52:02.234989 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2d26c4ab-a78e-4adb-b69a-65c731d93a3b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a74d1c4c-d757-4879-a35d-9f817ea6e28b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:52:02.273734 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d03e6514-bde0-45a5-a006-eae48528a4e1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:02.284736 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d03e6514-bde0-45a5-a006-eae48528a4e1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b" status: 200 len: 1324 microversion: 2.1 time: 0.478425 Sep 24 20:52:02.298531 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 338/659] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:01 2022] GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b => generated 1324 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:02.298531 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-1901edc9-205e-4709-840b-33448660f123 req-85aabe16-e03a-46ef-becf-5ce6a52b59e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a44ee230-ea66-4c1b-90e4-4e5a9a0cd994", "name": "network-vif-plugged", "status": "completed", "tag": "1d87750d-071a-4b4c-9e13-ddf06bb0283b"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:02.298869 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2d26c4ab-a78e-4adb-b69a-65c731d93a3b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.171517 Sep 24 20:52:02.307500 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1901edc9-205e-4709-840b-33448660f123 req-85aabe16-e03a-46ef-becf-5ce6a52b59e8 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:02.307500 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1901edc9-205e-4709-840b-33448660f123 req-85aabe16-e03a-46ef-becf-5ce6a52b59e8 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:02.307500 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1901edc9-205e-4709-840b-33448660f123 req-85aabe16-e03a-46ef-becf-5ce6a52b59e8 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:02.308018 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 322/660] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:52:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:52:02.328810 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-55ca489d-6a25-4d40-a39c-91b68933bcb6 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:02.329664 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-55ca489d-6a25-4d40-a39c-91b68933bcb6 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 625f5fd3-d872-4da5-b176-5a70dfd8cfe2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:02.340101 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-55ca489d-6a25-4d40-a39c-91b68933bcb6 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:02.341131 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-55ca489d-6a25-4d40-a39c-91b68933bcb6 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:02.341900 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-55ca489d-6a25-4d40-a39c-91b68933bcb6 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:02.342839 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-55ca489d-6a25-4d40-a39c-91b68933bcb6 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:02.343309 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-55ca489d-6a25-4d40-a39c-91b68933bcb6 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:02.344057 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-55ca489d-6a25-4d40-a39c-91b68933bcb6 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:02.390264 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-1901edc9-205e-4709-840b-33448660f123 req-85aabe16-e03a-46ef-becf-5ce6a52b59e8 service nova] Creating event network-vif-plugged:1d87750d-071a-4b4c-9e13-ddf06bb0283b for instance a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 on nch2-master-1 Sep 24 20:52:02.409152 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-1901edc9-205e-4709-840b-33448660f123 req-85aabe16-e03a-46ef-becf-5ce6a52b59e8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120048 Sep 24 20:52:02.414318 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 339/661] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:52:02.421767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-726935a1-7368-4b6c-a56b-aad71677c11a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:02.435605 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-726935a1-7368-4b6c-a56b-aad71677c11a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:02.443084 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-726935a1-7368-4b6c-a56b-aad71677c11a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:02.443706 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-726935a1-7368-4b6c-a56b-aad71677c11a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:02.444273 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-726935a1-7368-4b6c-a56b-aad71677c11a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:02.447986 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-726935a1-7368-4b6c-a56b-aad71677c11a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:02.448792 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-726935a1-7368-4b6c-a56b-aad71677c11a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:02.449455 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-726935a1-7368-4b6c-a56b-aad71677c11a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:02.570978 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-55ca489d-6a25-4d40-a39c-91b68933bcb6 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278977b201c48dda2d73823fbfe4833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a31be22cc451b92af447ed8d81242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:02.592066 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-55ca489d-6a25-4d40-a39c-91b68933bcb6 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2" status: 200 len: 1323 microversion: 2.1 time: 0.280486 Sep 24 20:52:02.598720 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 323/662] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:02 2022] GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2 => generated 1323 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:02.604324 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8551fb0a-f4f3-4768-9fc2-4cbb8bf610a2 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:02.607479 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8551fb0a-f4f3-4768-9fc2-4cbb8bf610a2 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:02.635471 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8551fb0a-f4f3-4768-9fc2-4cbb8bf610a2 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:02.635886 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8551fb0a-f4f3-4768-9fc2-4cbb8bf610a2 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:02.636331 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8551fb0a-f4f3-4768-9fc2-4cbb8bf610a2 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:02.652943 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8551fb0a-f4f3-4768-9fc2-4cbb8bf610a2 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:02.653574 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8551fb0a-f4f3-4768-9fc2-4cbb8bf610a2 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:02.654033 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8551fb0a-f4f3-4768-9fc2-4cbb8bf610a2 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:03.486229 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-726935a1-7368-4b6c-a56b-aad71677c11a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:03.502336 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-726935a1-7368-4b6c-a56b-aad71677c11a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1461 microversion: 2.1 time: 1.079665 Sep 24 20:52:03.503893 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 340/663] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:02 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1461 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:03.509658 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-74719c90-1166-4570-8902-079ded2fdecf tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:03.513192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-74719c90-1166-4570-8902-079ded2fdecf tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: a44ee230-ea66-4c1b-90e4-4e5a9a0cd994] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:03.530190 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-74719c90-1166-4570-8902-079ded2fdecf tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:03.531034 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-74719c90-1166-4570-8902-079ded2fdecf tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:03.531720 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-74719c90-1166-4570-8902-079ded2fdecf tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:03.532667 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-74719c90-1166-4570-8902-079ded2fdecf tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:03.533361 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-74719c90-1166-4570-8902-079ded2fdecf tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:03.539637 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-74719c90-1166-4570-8902-079ded2fdecf tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:03.613474 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8551fb0a-f4f3-4768-9fc2-4cbb8bf610a2 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d" status: 200 len: 1644 microversion: 2.1 time: 1.013088 Sep 24 20:52:03.615688 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 324/664] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:02 2022] GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d => generated 1644 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:03.646490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-6e676506-f229-48be-8434-0c1a5dc572f8 req-ac735758-5747-4866-8ef5-c77e5d5309f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b0e9940-f6ac-46d5-8898-1e4ba56119b3", "name": "network-vif-deleted", "tag": "bd5ba8f6-52ce-4952-b823-1baad516098d"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:03.662298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6e676506-f229-48be-8434-0c1a5dc572f8 req-ac735758-5747-4866-8ef5-c77e5d5309f5 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:03.677986 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6e676506-f229-48be-8434-0c1a5dc572f8 req-ac735758-5747-4866-8ef5-c77e5d5309f5 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:03.681085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6e676506-f229-48be-8434-0c1a5dc572f8 req-ac735758-5747-4866-8ef5-c77e5d5309f5 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:03.713968 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-6e676506-f229-48be-8434-0c1a5dc572f8 req-ac735758-5747-4866-8ef5-c77e5d5309f5 service nova] Creating event network-vif-deleted:bd5ba8f6-52ce-4952-b823-1baad516098d for instance 9b0e9940-f6ac-46d5-8898-1e4ba56119b3 on nch1-master-1 Sep 24 20:52:03.724303 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-6e676506-f229-48be-8434-0c1a5dc572f8 req-ac735758-5747-4866-8ef5-c77e5d5309f5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096274 Sep 24 20:52:03.725172 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 325/665] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:52:03.737481 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e7556091-4ea3-47db-b1a1-01d97ff4d8e6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:03.747735 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e7556091-4ea3-47db-b1a1-01d97ff4d8e6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a74d1c4c-d757-4879-a35d-9f817ea6e28b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:03.755943 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7556091-4ea3-47db-b1a1-01d97ff4d8e6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:03.767401 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7556091-4ea3-47db-b1a1-01d97ff4d8e6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:03.768218 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7556091-4ea3-47db-b1a1-01d97ff4d8e6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:03.769209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7556091-4ea3-47db-b1a1-01d97ff4d8e6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:03.769894 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7556091-4ea3-47db-b1a1-01d97ff4d8e6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:03.770597 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7556091-4ea3-47db-b1a1-01d97ff4d8e6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:03.993387 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e7556091-4ea3-47db-b1a1-01d97ff4d8e6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:04.001281 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-74719c90-1166-4570-8902-079ded2fdecf tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:04.005760 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e7556091-4ea3-47db-b1a1-01d97ff4d8e6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a74d1c4c-d757-4879-a35d-9f817ea6e28b" status: 200 len: 1213 microversion: 2.1 time: 0.279232 Sep 24 20:52:04.010874 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 326/666] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:03 2022] GET /compute/v2.1/servers/a74d1c4c-d757-4879-a35d-9f817ea6e28b => generated 1213 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:04.011161 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-74719c90-1166-4570-8902-079ded2fdecf tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994" status: 200 len: 1314 microversion: 2.1 time: 0.505993 Sep 24 20:52:04.018914 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-101268ca-93b6-4e57-a374-fee329d7675b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:04.019480 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-101268ca-93b6-4e57-a374-fee329d7675b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:04.035179 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 341/667] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:03 2022] GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 => generated 1314 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:04.041047 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-101268ca-93b6-4e57-a374-fee329d7675b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:04.043088 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-101268ca-93b6-4e57-a374-fee329d7675b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:04.043494 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-931547f6-bcb2-4169-9b39-d03c43203bc8 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:04.044311 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-931547f6-bcb2-4169-9b39-d03c43203bc8 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: b4b8b488-a1f1-42fb-b34a-04005d670e7b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:04.045349 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-101268ca-93b6-4e57-a374-fee329d7675b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:04.046121 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-101268ca-93b6-4e57-a374-fee329d7675b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:04.055084 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-101268ca-93b6-4e57-a374-fee329d7675b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:04.055714 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-101268ca-93b6-4e57-a374-fee329d7675b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:04.067157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-931547f6-bcb2-4169-9b39-d03c43203bc8 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:04.068816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-931547f6-bcb2-4169-9b39-d03c43203bc8 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:04.070638 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-931547f6-bcb2-4169-9b39-d03c43203bc8 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:04.073083 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-931547f6-bcb2-4169-9b39-d03c43203bc8 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:04.073935 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-931547f6-bcb2-4169-9b39-d03c43203bc8 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:04.075891 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-931547f6-bcb2-4169-9b39-d03c43203bc8 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:04.316335 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-101268ca-93b6-4e57-a374-fee329d7675b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:04.332246 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-101268ca-93b6-4e57-a374-fee329d7675b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:04.337735 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-101268ca-93b6-4e57-a374-fee329d7675b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:04.359099 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-101268ca-93b6-4e57-a374-fee329d7675b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1546 microversion: 2.91 time: 0.347009 Sep 24 20:52:04.359801 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 327/668] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:04 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1546 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:04.370355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-84dae14f-a3a5-4f66-a955-43e7d0c8c91a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:04.373831 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-84dae14f-a3a5-4f66-a955-43e7d0c8c91a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:04.391055 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84dae14f-a3a5-4f66-a955-43e7d0c8c91a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:04.392073 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84dae14f-a3a5-4f66-a955-43e7d0c8c91a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:04.392704 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84dae14f-a3a5-4f66-a955-43e7d0c8c91a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:04.397820 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84dae14f-a3a5-4f66-a955-43e7d0c8c91a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:04.399817 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84dae14f-a3a5-4f66-a955-43e7d0c8c91a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:04.400425 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84dae14f-a3a5-4f66-a955-43e7d0c8c91a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:04.808469 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-931547f6-bcb2-4169-9b39-d03c43203bc8 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:04.818099 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-931547f6-bcb2-4169-9b39-d03c43203bc8 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b" status: 200 len: 1324 microversion: 2.1 time: 0.781761 Sep 24 20:52:04.822337 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 342/669] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:04 2022] GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b => generated 1324 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:04.834072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5021208d-f324-4595-996c-6f2e619f7bc0 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:04.835360 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5021208d-f324-4595-996c-6f2e619f7bc0 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 625f5fd3-d872-4da5-b176-5a70dfd8cfe2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:04.852222 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5021208d-f324-4595-996c-6f2e619f7bc0 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:04.853038 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5021208d-f324-4595-996c-6f2e619f7bc0 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:04.854419 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5021208d-f324-4595-996c-6f2e619f7bc0 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:04.858237 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5021208d-f324-4595-996c-6f2e619f7bc0 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:04.858997 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5021208d-f324-4595-996c-6f2e619f7bc0 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:04.861557 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5021208d-f324-4595-996c-6f2e619f7bc0 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:05.070885 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-84dae14f-a3a5-4f66-a955-43e7d0c8c91a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:05.080338 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-84dae14f-a3a5-4f66-a955-43e7d0c8c91a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Old instance type m1.heat2, new instance type m1.heat {{(pid=140517) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 24 20:52:05.086882 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:05.110205 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-84dae14f-a3a5-4f66-a955-43e7d0c8c91a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:52:05.110687 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-84dae14f-a3a5-4f66-a955-43e7d0c8c91a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:52:05.115572 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-84dae14f-a3a5-4f66-a955-43e7d0c8c91a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:52:05.116043 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-84dae14f-a3a5-4f66-a955-43e7d0c8c91a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:52:05.116479 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-84dae14f-a3a5-4f66-a955-43e7d0c8c91a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:52:05.312539 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5021208d-f324-4595-996c-6f2e619f7bc0 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278977b201c48dda2d73823fbfe4833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a31be22cc451b92af447ed8d81242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:05.325456 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5021208d-f324-4595-996c-6f2e619f7bc0 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2" status: 200 len: 1391 microversion: 2.1 time: 0.500024 Sep 24 20:52:05.327073 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 343/670] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:04 2022] GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2 => generated 1391 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:05.339508 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-991cdf2a-9601-431d-a708-706fc71e9e95 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:05.355768 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-991cdf2a-9601-431d-a708-706fc71e9e95 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:05.356262 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-991cdf2a-9601-431d-a708-706fc71e9e95 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:05.356841 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-991cdf2a-9601-431d-a708-706fc71e9e95 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:05.357434 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-991cdf2a-9601-431d-a708-706fc71e9e95 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:05.357892 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-991cdf2a-9601-431d-a708-706fc71e9e95 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:05.358315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-991cdf2a-9601-431d-a708-706fc71e9e95 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:05.393480 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:05.421535 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-84dae14f-a3a5-4f66-a955-43e7d0c8c91a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "POST /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26/action" status: 202 len: 0 microversion: 2.1 time: 1.058297 Sep 24 20:52:05.431944 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 328/671] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:52:04 2022] POST /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26/action => generated 0 bytes in 1070 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:52:05.432148 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-991cdf2a-9601-431d-a708-706fc71e9e95 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.102716 Sep 24 20:52:05.440625 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 344/672] 10.222.0.52 () {58 vars in 1176 bytes} [Sat Sep 24 20:52:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:52:05.449446 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9819830b-1c07-4d64-a067-a9a309060f8c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:05.450075 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9819830b-1c07-4d64-a067-a9a309060f8c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: a44ee230-ea66-4c1b-90e4-4e5a9a0cd994] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:05.450561 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-02452a39-f403-4457-9b92-4bb634c291f4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:05.451335 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-02452a39-f403-4457-9b92-4bb634c291f4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a74d1c4c-d757-4879-a35d-9f817ea6e28b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:05.467175 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9819830b-1c07-4d64-a067-a9a309060f8c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:05.469550 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9819830b-1c07-4d64-a067-a9a309060f8c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:05.471316 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9819830b-1c07-4d64-a067-a9a309060f8c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:05.471786 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-02452a39-f403-4457-9b92-4bb634c291f4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:05.472581 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-02452a39-f403-4457-9b92-4bb634c291f4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:05.473262 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-02452a39-f403-4457-9b92-4bb634c291f4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:05.475701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-02452a39-f403-4457-9b92-4bb634c291f4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:05.477107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9819830b-1c07-4d64-a067-a9a309060f8c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:05.477956 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9819830b-1c07-4d64-a067-a9a309060f8c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:05.478660 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9819830b-1c07-4d64-a067-a9a309060f8c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:05.479029 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-02452a39-f403-4457-9b92-4bb634c291f4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:05.479508 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-02452a39-f403-4457-9b92-4bb634c291f4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:05.765653 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-02452a39-f403-4457-9b92-4bb634c291f4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:05.775871 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-02452a39-f403-4457-9b92-4bb634c291f4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a74d1c4c-d757-4879-a35d-9f817ea6e28b" status: 200 len: 1275 microversion: 2.1 time: 0.340978 Sep 24 20:52:05.798469 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 329/673] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:05 2022] GET /compute/v2.1/servers/a74d1c4c-d757-4879-a35d-9f817ea6e28b => generated 1275 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:05.805660 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cd416244-311e-4885-a9d9-5a3bf3d38731 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:05.806523 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cd416244-311e-4885-a9d9-5a3bf3d38731 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:05.812901 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:05.815084 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd416244-311e-4885-a9d9-5a3bf3d38731 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:05.817850 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd416244-311e-4885-a9d9-5a3bf3d38731 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:05.819043 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd416244-311e-4885-a9d9-5a3bf3d38731 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:05.819995 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd416244-311e-4885-a9d9-5a3bf3d38731 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:05.820622 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd416244-311e-4885-a9d9-5a3bf3d38731 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:05.821272 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd416244-311e-4885-a9d9-5a3bf3d38731 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:05.840003 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9819830b-1c07-4d64-a067-a9a309060f8c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:05.863059 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9819830b-1c07-4d64-a067-a9a309060f8c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994" status: 200 len: 1314 microversion: 2.1 time: 0.421035 Sep 24 20:52:05.888921 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 345/674] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:05 2022] GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:05.896022 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2ccf8382-4e46-4b20-8fdd-c8ca4733b2b4 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:05.896922 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2ccf8382-4e46-4b20-8fdd-c8ca4733b2b4 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:05.905186 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2ccf8382-4e46-4b20-8fdd-c8ca4733b2b4 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:05.905696 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2ccf8382-4e46-4b20-8fdd-c8ca4733b2b4 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:05.906146 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2ccf8382-4e46-4b20-8fdd-c8ca4733b2b4 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:05.906981 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2ccf8382-4e46-4b20-8fdd-c8ca4733b2b4 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:05.907449 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2ccf8382-4e46-4b20-8fdd-c8ca4733b2b4 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:05.907886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2ccf8382-4e46-4b20-8fdd-c8ca4733b2b4 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:06.358921 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cd416244-311e-4885-a9d9-5a3bf3d38731 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:06.373912 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cd416244-311e-4885-a9d9-5a3bf3d38731 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:06.375836 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cd416244-311e-4885-a9d9-5a3bf3d38731 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:06.387233 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cd416244-311e-4885-a9d9-5a3bf3d38731 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1546 microversion: 2.91 time: 0.587380 Sep 24 20:52:06.390391 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 330/675] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:05 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1546 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:06.397494 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1f8f0f36-4a64-48b8-9049-25f5d2871847 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:06.402821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1f8f0f36-4a64-48b8-9049-25f5d2871847 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:06.417871 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1f8f0f36-4a64-48b8-9049-25f5d2871847 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:06.418374 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1f8f0f36-4a64-48b8-9049-25f5d2871847 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:06.425041 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1f8f0f36-4a64-48b8-9049-25f5d2871847 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:06.425952 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1f8f0f36-4a64-48b8-9049-25f5d2871847 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:06.426443 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1f8f0f36-4a64-48b8-9049-25f5d2871847 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:06.426930 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1f8f0f36-4a64-48b8-9049-25f5d2871847 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:06.607063 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1f8f0f36-4a64-48b8-9049-25f5d2871847 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d/action" status: 202 len: 0 microversion: 2.1 time: 0.215120 Sep 24 20:52:06.611479 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 331/676] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:52:06 2022] POST /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:52:06.619368 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-cdd32472-b796-4639-8ca4-8824f3717b71 req-83d90776-cc72-470d-bf91-6c0087779b9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "625f5fd3-d872-4da5-b176-5a70dfd8cfe2", "tag": "f81a67af-6fdb-4ade-b541-421cafdc5230"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:06.645320 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-cdd32472-b796-4639-8ca4-8824f3717b71 req-83d90776-cc72-470d-bf91-6c0087779b9f service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:06.648285 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-cdd32472-b796-4639-8ca4-8824f3717b71 req-83d90776-cc72-470d-bf91-6c0087779b9f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:06.653397 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-cdd32472-b796-4639-8ca4-8824f3717b71 req-83d90776-cc72-470d-bf91-6c0087779b9f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:06.681497 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-cdd32472-b796-4639-8ca4-8824f3717b71 req-83d90776-cc72-470d-bf91-6c0087779b9f service nova] Creating event network-changed:f81a67af-6fdb-4ade-b541-421cafdc5230 for instance 625f5fd3-d872-4da5-b176-5a70dfd8cfe2 on nch1-master-1 Sep 24 20:52:06.701713 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-cdd32472-b796-4639-8ca4-8824f3717b71 req-83d90776-cc72-470d-bf91-6c0087779b9f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084873 Sep 24 20:52:06.706623 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 332/677] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:52:06.722862 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3599f940-d041-4034-8cce-99091c90c9f2 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:06.723748 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3599f940-d041-4034-8cce-99091c90c9f2 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: b4b8b488-a1f1-42fb-b34a-04005d670e7b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:06.739124 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3599f940-d041-4034-8cce-99091c90c9f2 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:06.741024 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3599f940-d041-4034-8cce-99091c90c9f2 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:06.742457 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3599f940-d041-4034-8cce-99091c90c9f2 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:06.747457 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3599f940-d041-4034-8cce-99091c90c9f2 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:06.749218 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3599f940-d041-4034-8cce-99091c90c9f2 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:06.749798 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3599f940-d041-4034-8cce-99091c90c9f2 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:07.168919 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2ccf8382-4e46-4b20-8fdd-c8ca4733b2b4 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:07.180821 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2ccf8382-4e46-4b20-8fdd-c8ca4733b2b4 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1470 microversion: 2.1 time: 1.290358 Sep 24 20:52:07.181482 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 346/678] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:05 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1470 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:07.200513 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a3e0a8dc-b88e-47ba-9c7f-cdb7fd71e121 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:07.201484 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a3e0a8dc-b88e-47ba-9c7f-cdb7fd71e121 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 625f5fd3-d872-4da5-b176-5a70dfd8cfe2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:07.216613 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3e0a8dc-b88e-47ba-9c7f-cdb7fd71e121 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:07.217378 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3e0a8dc-b88e-47ba-9c7f-cdb7fd71e121 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:07.217992 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3e0a8dc-b88e-47ba-9c7f-cdb7fd71e121 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:07.218971 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3e0a8dc-b88e-47ba-9c7f-cdb7fd71e121 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:07.222422 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3e0a8dc-b88e-47ba-9c7f-cdb7fd71e121 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:07.223754 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3e0a8dc-b88e-47ba-9c7f-cdb7fd71e121 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:07.478391 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3599f940-d041-4034-8cce-99091c90c9f2 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:07.497655 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3599f940-d041-4034-8cce-99091c90c9f2 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b" status: 200 len: 1324 microversion: 2.1 time: 0.788938 Sep 24 20:52:07.498732 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 333/679] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:06 2022] GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b => generated 1324 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:07.505039 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-48932a24-7929-453d-8607-bf5a20716437 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:07.505887 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-48932a24-7929-453d-8607-bf5a20716437 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:07.527243 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-48932a24-7929-453d-8607-bf5a20716437 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:07.527923 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-48932a24-7929-453d-8607-bf5a20716437 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:07.528514 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-48932a24-7929-453d-8607-bf5a20716437 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:07.530057 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-48932a24-7929-453d-8607-bf5a20716437 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:07.530936 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-48932a24-7929-453d-8607-bf5a20716437 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:07.531964 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-48932a24-7929-453d-8607-bf5a20716437 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:07.877961 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a3e0a8dc-b88e-47ba-9c7f-cdb7fd71e121 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278977b201c48dda2d73823fbfe4833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a31be22cc451b92af447ed8d81242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:07.889891 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a3e0a8dc-b88e-47ba-9c7f-cdb7fd71e121 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2" status: 200 len: 1391 microversion: 2.1 time: 0.707344 Sep 24 20:52:07.891517 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 347/680] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:07 2022] GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2 => generated 1391 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:07.898193 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-38c02808-b551-435b-b2c9-37311389acea tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:07.900048 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-38c02808-b551-435b-b2c9-37311389acea tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a74d1c4c-d757-4879-a35d-9f817ea6e28b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:07.909453 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-38c02808-b551-435b-b2c9-37311389acea tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:07.910236 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-38c02808-b551-435b-b2c9-37311389acea tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:07.911006 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-38c02808-b551-435b-b2c9-37311389acea tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:07.912331 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-38c02808-b551-435b-b2c9-37311389acea tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:07.913074 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-38c02808-b551-435b-b2c9-37311389acea tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:07.914479 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-38c02808-b551-435b-b2c9-37311389acea tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:07.948464 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:07.979718 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-48932a24-7929-453d-8607-bf5a20716437 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d" status: 200 len: 1649 microversion: 2.1 time: 0.479895 Sep 24 20:52:07.999820 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 334/681] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:07 2022] GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d => generated 1649 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:08.017288 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bbb9d790-d826-4d7d-8529-f18dda902a48 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:08.018106 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bbb9d790-d826-4d7d-8529-f18dda902a48 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: a44ee230-ea66-4c1b-90e4-4e5a9a0cd994] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:08.029864 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bbb9d790-d826-4d7d-8529-f18dda902a48 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:08.030477 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bbb9d790-d826-4d7d-8529-f18dda902a48 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:08.031177 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bbb9d790-d826-4d7d-8529-f18dda902a48 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:08.032120 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bbb9d790-d826-4d7d-8529-f18dda902a48 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:08.033284 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bbb9d790-d826-4d7d-8529-f18dda902a48 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:08.033848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bbb9d790-d826-4d7d-8529-f18dda902a48 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:08.074890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-38c02808-b551-435b-b2c9-37311389acea tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:08.086797 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-38c02808-b551-435b-b2c9-37311389acea tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a74d1c4c-d757-4879-a35d-9f817ea6e28b" status: 200 len: 1275 microversion: 2.1 time: 0.193917 Sep 24 20:52:08.091879 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 348/682] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:07 2022] GET /compute/v2.1/servers/a74d1c4c-d757-4879-a35d-9f817ea6e28b => generated 1275 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:08.108570 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a88f598a-1d48-4bed-b112-9577d808ebed tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:08.109731 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a88f598a-1d48-4bed-b112-9577d808ebed tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:08.118427 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a88f598a-1d48-4bed-b112-9577d808ebed tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:08.119773 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a88f598a-1d48-4bed-b112-9577d808ebed tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:08.126793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a88f598a-1d48-4bed-b112-9577d808ebed tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:08.128028 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a88f598a-1d48-4bed-b112-9577d808ebed tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:08.128688 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a88f598a-1d48-4bed-b112-9577d808ebed tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:08.129288 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a88f598a-1d48-4bed-b112-9577d808ebed tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:08.167105 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=48 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:08.287558 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a88f598a-1d48-4bed-b112-9577d808ebed tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:08.297871 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a88f598a-1d48-4bed-b112-9577d808ebed tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:08.299124 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a88f598a-1d48-4bed-b112-9577d808ebed tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:08.305236 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a88f598a-1d48-4bed-b112-9577d808ebed tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1546 microversion: 2.91 time: 0.211826 Sep 24 20:52:08.305827 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 349/683] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:08 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1546 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:08.328873 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-2208153b-6c09-4767-b22e-3fcacb87123c req-f6599da0-95c1-41b0-8363-72fde5836a89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4b8b488-a1f1-42fb-b34a-04005d670e7b", "name": "network-vif-plugged", "status": "completed", "tag": "412957fd-2470-4bdf-a174-c5dd3f956904"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:08.341669 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-2208153b-6c09-4767-b22e-3fcacb87123c req-f6599da0-95c1-41b0-8363-72fde5836a89 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:08.342154 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-2208153b-6c09-4767-b22e-3fcacb87123c req-f6599da0-95c1-41b0-8363-72fde5836a89 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:08.342615 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-2208153b-6c09-4767-b22e-3fcacb87123c req-f6599da0-95c1-41b0-8363-72fde5836a89 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:08.360165 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-2208153b-6c09-4767-b22e-3fcacb87123c req-f6599da0-95c1-41b0-8363-72fde5836a89 service nova] Creating event network-vif-plugged:412957fd-2470-4bdf-a174-c5dd3f956904 for instance b4b8b488-a1f1-42fb-b34a-04005d670e7b on nch2-master-1 Sep 24 20:52:08.365391 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-2208153b-6c09-4767-b22e-3fcacb87123c req-f6599da0-95c1-41b0-8363-72fde5836a89 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058153 Sep 24 20:52:08.365990 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 350/684] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:52:08.374091 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d5526cfa-5590-4431-bdbb-0dc54251debf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:08.374848 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d5526cfa-5590-4431-bdbb-0dc54251debf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:08.381338 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d5526cfa-5590-4431-bdbb-0dc54251debf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:08.381835 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d5526cfa-5590-4431-bdbb-0dc54251debf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:08.382877 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d5526cfa-5590-4431-bdbb-0dc54251debf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:08.383950 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d5526cfa-5590-4431-bdbb-0dc54251debf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:08.384567 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d5526cfa-5590-4431-bdbb-0dc54251debf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:08.385184 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d5526cfa-5590-4431-bdbb-0dc54251debf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:08.427307 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bbb9d790-d826-4d7d-8529-f18dda902a48 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:08.447660 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bbb9d790-d826-4d7d-8529-f18dda902a48 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994" status: 200 len: 1464 microversion: 2.1 time: 0.438897 Sep 24 20:52:08.448694 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 335/685] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:07 2022] GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 => generated 1464 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:08.720493 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9c344d3a-0a51-4844-a937-cde94825dd73 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:08.726406 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9c344d3a-0a51-4844-a937-cde94825dd73 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Searching by: {'deleted': False, 'project_id': '483f8a432244480698773200e1d49501'} {{(pid=140517) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 20:52:08.734270 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c344d3a-0a51-4844-a937-cde94825dd73 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:08.734809 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c344d3a-0a51-4844-a937-cde94825dd73 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:08.735734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c344d3a-0a51-4844-a937-cde94825dd73 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:08.743260 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c344d3a-0a51-4844-a937-cde94825dd73 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:08.744146 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c344d3a-0a51-4844-a937-cde94825dd73 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:08.744879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c344d3a-0a51-4844-a937-cde94825dd73 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:08.828569 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d5526cfa-5590-4431-bdbb-0dc54251debf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:08.843689 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d5526cfa-5590-4431-bdbb-0dc54251debf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1470 microversion: 2.1 time: 0.476369 Sep 24 20:52:08.844855 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 351/686] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:08 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1470 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:08.858707 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c40bd0e1-7811-482d-a634-bcbacec8a36f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:08.859508 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c40bd0e1-7811-482d-a634-bcbacec8a36f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: b4b8b488-a1f1-42fb-b34a-04005d670e7b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:08.861628 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9c344d3a-0a51-4844-a937-cde94825dd73 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.392588 Sep 24 20:52:08.866232 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c40bd0e1-7811-482d-a634-bcbacec8a36f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:08.867488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c40bd0e1-7811-482d-a634-bcbacec8a36f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:08.868098 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c40bd0e1-7811-482d-a634-bcbacec8a36f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:08.868979 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c40bd0e1-7811-482d-a634-bcbacec8a36f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:08.869593 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c40bd0e1-7811-482d-a634-bcbacec8a36f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:08.870355 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c40bd0e1-7811-482d-a634-bcbacec8a36f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:08.877847 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 336/687] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:52:08 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:52:08.892386 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e1307a86-7758-4c49-8d48-13d12267ad6c tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:08.900455 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e1307a86-7758-4c49-8d48-13d12267ad6c tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Searching by: {'deleted': False} {{(pid=140517) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 20:52:08.906037 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1307a86-7758-4c49-8d48-13d12267ad6c tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:08.907062 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1307a86-7758-4c49-8d48-13d12267ad6c tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:08.907841 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1307a86-7758-4c49-8d48-13d12267ad6c tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:08.908986 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1307a86-7758-4c49-8d48-13d12267ad6c tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:08.909612 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1307a86-7758-4c49-8d48-13d12267ad6c tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:08.910193 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1307a86-7758-4c49-8d48-13d12267ad6c tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:09.047193 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.multi_cell_list [None req-e1307a86-7758-4c49-8d48-13d12267ad6c tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Listed batch of 11 results from cell out of 1000 limit. Returned 11 total so far. {{(pid=140517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 20:52:09.156867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c40bd0e1-7811-482d-a634-bcbacec8a36f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:09.166098 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c40bd0e1-7811-482d-a634-bcbacec8a36f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b" status: 200 len: 1324 microversion: 2.1 time: 0.320004 Sep 24 20:52:09.181852 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1307a86-7758-4c49-8d48-13d12267ad6c tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:09.181852 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1307a86-7758-4c49-8d48-13d12267ad6c tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:09.181852 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1307a86-7758-4c49-8d48-13d12267ad6c tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:09.187225 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 352/688] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:08 2022] GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b => generated 1324 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:09.192601 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e2978082-f431-4c72-9e23-3675c5d9f153 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:09.193243 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e2978082-f431-4c72-9e23-3675c5d9f153 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 625f5fd3-d872-4da5-b176-5a70dfd8cfe2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:09.199756 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e2978082-f431-4c72-9e23-3675c5d9f153 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:09.200257 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e2978082-f431-4c72-9e23-3675c5d9f153 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:09.200697 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e2978082-f431-4c72-9e23-3675c5d9f153 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:09.201418 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e2978082-f431-4c72-9e23-3675c5d9f153 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:09.201879 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e2978082-f431-4c72-9e23-3675c5d9f153 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:09.202315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e2978082-f431-4c72-9e23-3675c5d9f153 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:09.607304 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e2978082-f431-4c72-9e23-3675c5d9f153 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278977b201c48dda2d73823fbfe4833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a31be22cc451b92af447ed8d81242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:09.620270 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e2978082-f431-4c72-9e23-3675c5d9f153 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2" status: 200 len: 1391 microversion: 2.1 time: 0.431653 Sep 24 20:52:09.634523 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 353/689] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:09 2022] GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2 => generated 1391 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:09.649227 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a91186c2-56d2-40e4-932c-d1228e4a7ba9 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:09.650985 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a91186c2-56d2-40e4-932c-d1228e4a7ba9 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:09.661586 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a91186c2-56d2-40e4-932c-d1228e4a7ba9 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:09.662455 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a91186c2-56d2-40e4-932c-d1228e4a7ba9 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:09.663914 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a91186c2-56d2-40e4-932c-d1228e4a7ba9 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:09.664942 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a91186c2-56d2-40e4-932c-d1228e4a7ba9 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:09.665592 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a91186c2-56d2-40e4-932c-d1228e4a7ba9 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:09.666177 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a91186c2-56d2-40e4-932c-d1228e4a7ba9 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:10.424197 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a91186c2-56d2-40e4-932c-d1228e4a7ba9 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d" status: 200 len: 1629 microversion: 2.1 time: 0.799616 Sep 24 20:52:10.425794 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 354/690] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:09 2022] GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d => generated 1629 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:10.449154 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-62c1d2ed-b010-4229-a021-97bcb4600629 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:10.452025 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-62c1d2ed-b010-4229-a021-97bcb4600629 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a74d1c4c-d757-4879-a35d-9f817ea6e28b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:10.467719 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62c1d2ed-b010-4229-a021-97bcb4600629 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:10.469895 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62c1d2ed-b010-4229-a021-97bcb4600629 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:10.471356 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62c1d2ed-b010-4229-a021-97bcb4600629 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:10.474291 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62c1d2ed-b010-4229-a021-97bcb4600629 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:10.477675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62c1d2ed-b010-4229-a021-97bcb4600629 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:10.478192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62c1d2ed-b010-4229-a021-97bcb4600629 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:10.710486 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e1307a86-7758-4c49-8d48-13d12267ad6c tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 17210 microversion: 2.1 time: 1.823717 Sep 24 20:52:10.727836 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 337/691] 10.222.0.52 () {58 vars in 1171 bytes} [Sat Sep 24 20:52:08 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 17210 bytes in 1826 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 20:52:10.727836 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b45e7402-8345-4ac4-bfed-0b7a15d0886d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:10.727836 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b45e7402-8345-4ac4-bfed-0b7a15d0886d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:10.729899 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b45e7402-8345-4ac4-bfed-0b7a15d0886d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:10.730711 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b45e7402-8345-4ac4-bfed-0b7a15d0886d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:10.731450 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b45e7402-8345-4ac4-bfed-0b7a15d0886d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:10.732418 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b45e7402-8345-4ac4-bfed-0b7a15d0886d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:10.733100 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b45e7402-8345-4ac4-bfed-0b7a15d0886d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:10.733750 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b45e7402-8345-4ac4-bfed-0b7a15d0886d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:10.859859 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b45e7402-8345-4ac4-bfed-0b7a15d0886d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:10.869409 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b45e7402-8345-4ac4-bfed-0b7a15d0886d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:10.870993 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b45e7402-8345-4ac4-bfed-0b7a15d0886d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:10.876567 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b45e7402-8345-4ac4-bfed-0b7a15d0886d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1533 microversion: 2.91 time: 0.163393 Sep 24 20:52:10.877702 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 338/692] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:10 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1533 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:10.886102 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5ba5dae9-d32a-4049-b649-f80bf973b4fc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:10.886923 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5ba5dae9-d32a-4049-b649-f80bf973b4fc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:10.900169 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ba5dae9-d32a-4049-b649-f80bf973b4fc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:10.900870 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ba5dae9-d32a-4049-b649-f80bf973b4fc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:10.901128 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-62c1d2ed-b010-4229-a021-97bcb4600629 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:10.901653 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ba5dae9-d32a-4049-b649-f80bf973b4fc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:10.902190 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ba5dae9-d32a-4049-b649-f80bf973b4fc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:10.902850 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ba5dae9-d32a-4049-b649-f80bf973b4fc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:10.903441 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ba5dae9-d32a-4049-b649-f80bf973b4fc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:10.916295 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-62c1d2ed-b010-4229-a021-97bcb4600629 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a74d1c4c-d757-4879-a35d-9f817ea6e28b" status: 200 len: 1317 microversion: 2.1 time: 0.475943 Sep 24 20:52:10.922538 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 355/693] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:10 2022] GET /compute/v2.1/servers/a74d1c4c-d757-4879-a35d-9f817ea6e28b => generated 1317 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:10.928989 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-80ce5226-308e-48cb-833a-be63e65c25d7 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:10.929831 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-80ce5226-308e-48cb-833a-be63e65c25d7 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: b4b8b488-a1f1-42fb-b34a-04005d670e7b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:10.936322 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-80ce5226-308e-48cb-833a-be63e65c25d7 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:10.937031 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-80ce5226-308e-48cb-833a-be63e65c25d7 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:10.937531 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-80ce5226-308e-48cb-833a-be63e65c25d7 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:10.938242 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-80ce5226-308e-48cb-833a-be63e65c25d7 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:10.938730 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-80ce5226-308e-48cb-833a-be63e65c25d7 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:10.939161 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-80ce5226-308e-48cb-833a-be63e65c25d7 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:11.328889 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5ba5dae9-d32a-4049-b649-f80bf973b4fc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:11.339805 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5ba5dae9-d32a-4049-b649-f80bf973b4fc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1475 microversion: 2.1 time: 0.460976 Sep 24 20:52:11.341263 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 339/694] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:10 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1475 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:11.355095 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-80ce5226-308e-48cb-833a-be63e65c25d7 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:11.363263 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-80ce5226-308e-48cb-833a-be63e65c25d7 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b" status: 200 len: 1521 microversion: 2.1 time: 0.439352 Sep 24 20:52:11.364592 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0206e0eb-4f8c-40e9-adbc-d30e4d751821 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:11.368644 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0206e0eb-4f8c-40e9-adbc-d30e4d751821 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:11.377392 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 356/695] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:10 2022] GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b => generated 1521 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:11.379345 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0206e0eb-4f8c-40e9-adbc-d30e4d751821 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:11.380116 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0206e0eb-4f8c-40e9-adbc-d30e4d751821 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:11.380906 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0206e0eb-4f8c-40e9-adbc-d30e4d751821 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:11.381958 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0206e0eb-4f8c-40e9-adbc-d30e4d751821 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:11.383812 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0206e0eb-4f8c-40e9-adbc-d30e4d751821 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:11.385083 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0206e0eb-4f8c-40e9-adbc-d30e4d751821 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:11.477286 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b0669ab2-4f66-4a1f-969d-c591d65fed4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-875949369", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "4720b9f0-7a36-43a8-8f75-d94ac4c68f4c"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:11.487012 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-0206e0eb-4f8c-40e9-adbc-d30e4d751821 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lazy-loading 'flavor' on Instance uuid 5dc2952a-aad1-40d0-bd55-87c6b3b9618d {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:52:11.549502 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0206e0eb-4f8c-40e9-adbc-d30e4d751821 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Going to try to live migrate instance to nch2-master-1 {{(pid=140517) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 24 20:52:11.561135 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-b0669ab2-4f66-4a1f-969d-c591d65fed4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] validate_networks() for [('4720b9f0-7a36-43a8-8f75-d94ac4c68f4c', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:52:12.297653 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-b0669ab2-4f66-4a1f-969d-c591d65fed4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:52:12.298217 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-b0669ab2-4f66-4a1f-969d-c591d65fed4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:52:12.300047 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-b0669ab2-4f66-4a1f-969d-c591d65fed4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:52:12.300492 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-b0669ab2-4f66-4a1f-969d-c591d65fed4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:52:12.301034 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-b0669ab2-4f66-4a1f-969d-c591d65fed4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:52:12.324137 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0669ab2-4f66-4a1f-969d-c591d65fed4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:12.324553 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0669ab2-4f66-4a1f-969d-c591d65fed4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:12.325022 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0669ab2-4f66-4a1f-969d-c591d65fed4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:12.331872 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0669ab2-4f66-4a1f-969d-c591d65fed4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:12.332429 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0669ab2-4f66-4a1f-969d-c591d65fed4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:12.332897 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0669ab2-4f66-4a1f-969d-c591d65fed4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:12.351989 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-b0669ab2-4f66-4a1f-969d-c591d65fed4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Getting quotas for project f3c583f2016e4edd94aeec7dd64f9673. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:52:12.357305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-b0669ab2-4f66-4a1f-969d-c591d65fed4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Getting quotas for user ca78cf6d34e84f2cb5cb254c5d8af1da and project f3c583f2016e4edd94aeec7dd64f9673. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:52:12.370971 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b0669ab2-4f66-4a1f-969d-c591d65fed4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:52:12.373373 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b0669ab2-4f66-4a1f-969d-c591d65fed4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:52:12.422037 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b0669ab2-4f66-4a1f-969d-c591d65fed4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.043679 Sep 24 20:52:12.422730 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 357/696] 10.222.0.52 () {62 vars in 1188 bytes} [Sat Sep 24 20:52:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1045 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 24 20:52:12.427566 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1fada4ea-039c-4a3b-8360-28f8a9fc4f56 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:12.428445 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1fada4ea-039c-4a3b-8360-28f8a9fc4f56 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 625f5fd3-d872-4da5-b176-5a70dfd8cfe2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:12.439041 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1fada4ea-039c-4a3b-8360-28f8a9fc4f56 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:12.439543 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1fada4ea-039c-4a3b-8360-28f8a9fc4f56 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:12.440289 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1fada4ea-039c-4a3b-8360-28f8a9fc4f56 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:12.441022 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1fada4ea-039c-4a3b-8360-28f8a9fc4f56 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:12.441487 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1fada4ea-039c-4a3b-8360-28f8a9fc4f56 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:12.442655 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1fada4ea-039c-4a3b-8360-28f8a9fc4f56 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:12.609637 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1fada4ea-039c-4a3b-8360-28f8a9fc4f56 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278977b201c48dda2d73823fbfe4833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a31be22cc451b92af447ed8d81242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:12.640579 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1fada4ea-039c-4a3b-8360-28f8a9fc4f56 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2" status: 200 len: 1391 microversion: 2.1 time: 0.216562 Sep 24 20:52:12.641174 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 358/697] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:12 2022] GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2 => generated 1391 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:12.650425 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-86c600da-4226-4c8d-8d7e-d7e4a05306dc tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:12.657750 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-86c600da-4226-4c8d-8d7e-d7e4a05306dc tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Searching by: {'deleted': False, 'project_id': '483f8a432244480698773200e1d49501'} {{(pid=140516) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 20:52:12.671979 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86c600da-4226-4c8d-8d7e-d7e4a05306dc tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:12.672467 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86c600da-4226-4c8d-8d7e-d7e4a05306dc tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:12.672905 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86c600da-4226-4c8d-8d7e-d7e4a05306dc tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:12.673630 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86c600da-4226-4c8d-8d7e-d7e4a05306dc tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:12.674083 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86c600da-4226-4c8d-8d7e-d7e4a05306dc tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:12.674515 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86c600da-4226-4c8d-8d7e-d7e4a05306dc tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:12.784749 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-86c600da-4226-4c8d-8d7e-d7e4a05306dc tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/detail?tenant_id=5e68660c954f47f9bad1f7bee17f9435" status: 200 len: 15 microversion: 2.1 time: 0.141700 Sep 24 20:52:12.785332 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 359/698] 10.222.0.52 () {58 vars in 1231 bytes} [Sat Sep 24 20:52:12 2022] GET /compute/v2.1/servers/detail?tenant_id=5e68660c954f47f9bad1f7bee17f9435 => generated 15 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:52:12.790253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-29465553-5d24-4659-a72b-e3b1a222a75d tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:12.791049 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-29465553-5d24-4659-a72b-e3b1a222a75d tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:12.797215 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-29465553-5d24-4659-a72b-e3b1a222a75d tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:12.797920 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-29465553-5d24-4659-a72b-e3b1a222a75d tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:12.798537 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-29465553-5d24-4659-a72b-e3b1a222a75d tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:12.799402 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-29465553-5d24-4659-a72b-e3b1a222a75d tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:12.800103 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-29465553-5d24-4659-a72b-e3b1a222a75d tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:12.800534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-29465553-5d24-4659-a72b-e3b1a222a75d tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:12.884749 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-29465553-5d24-4659-a72b-e3b1a222a75d tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Lazy-loading 'services' on Instance uuid fafd445e-572c-4300-9433-f0d9a628df5e {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:52:12.903779 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-29465553-5d24-4659-a72b-e3b1a222a75d tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1938 microversion: 2.91 time: 0.117309 Sep 24 20:52:12.904373 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 360/699] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:12 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1938 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:12.909764 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ee420c1e-cee6-40ea-8fc3-a9b1f53da192 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:12.910422 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ee420c1e-cee6-40ea-8fc3-a9b1f53da192 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: b4b8b488-a1f1-42fb-b34a-04005d670e7b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:12.920098 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee420c1e-cee6-40ea-8fc3-a9b1f53da192 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:12.920593 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee420c1e-cee6-40ea-8fc3-a9b1f53da192 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:12.921031 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee420c1e-cee6-40ea-8fc3-a9b1f53da192 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:12.921741 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee420c1e-cee6-40ea-8fc3-a9b1f53da192 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:12.922447 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee420c1e-cee6-40ea-8fc3-a9b1f53da192 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:12.922634 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee420c1e-cee6-40ea-8fc3-a9b1f53da192 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:13.067321 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ee420c1e-cee6-40ea-8fc3-a9b1f53da192 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:13.076644 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ee420c1e-cee6-40ea-8fc3-a9b1f53da192 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b" status: 200 len: 1521 microversion: 2.1 time: 0.171019 Sep 24 20:52:13.077349 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 361/700] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:12 2022] GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:13.081887 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-7be07a77-6b1e-4993-9ea4-80cff58de14e req-e867e8bc-b9d2-4e81-aaa5-6d050be6348f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a74d1c4c-d757-4879-a35d-9f817ea6e28b", "tag": "b6ab8620-4ae6-45bc-8b07-7059b14738de"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:13.097563 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-7be07a77-6b1e-4993-9ea4-80cff58de14e req-e867e8bc-b9d2-4e81-aaa5-6d050be6348f service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:13.098030 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-7be07a77-6b1e-4993-9ea4-80cff58de14e req-e867e8bc-b9d2-4e81-aaa5-6d050be6348f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:13.098488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-7be07a77-6b1e-4993-9ea4-80cff58de14e req-e867e8bc-b9d2-4e81-aaa5-6d050be6348f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:13.111974 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-7be07a77-6b1e-4993-9ea4-80cff58de14e req-e867e8bc-b9d2-4e81-aaa5-6d050be6348f service nova] Creating event network-changed:b6ab8620-4ae6-45bc-8b07-7059b14738de for instance a74d1c4c-d757-4879-a35d-9f817ea6e28b on nch1-master-1 Sep 24 20:52:13.117561 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-7be07a77-6b1e-4993-9ea4-80cff58de14e req-e867e8bc-b9d2-4e81-aaa5-6d050be6348f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038640 Sep 24 20:52:13.118154 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 362/701] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:52:13.126527 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-7b2cf61b-ddfd-4dd8-99c7-df30a85fc8cf req-d3ac7db2-3b52-42d5-b163-77fcb86d6dcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "625f5fd3-d872-4da5-b176-5a70dfd8cfe2", "name": "network-vif-plugged", "status": "completed", "tag": "f81a67af-6fdb-4ade-b541-421cafdc5230"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:13.138987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-7b2cf61b-ddfd-4dd8-99c7-df30a85fc8cf req-d3ac7db2-3b52-42d5-b163-77fcb86d6dcc service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:13.139380 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-7b2cf61b-ddfd-4dd8-99c7-df30a85fc8cf req-d3ac7db2-3b52-42d5-b163-77fcb86d6dcc service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:13.139819 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-7b2cf61b-ddfd-4dd8-99c7-df30a85fc8cf req-d3ac7db2-3b52-42d5-b163-77fcb86d6dcc service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:13.152880 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-7b2cf61b-ddfd-4dd8-99c7-df30a85fc8cf req-d3ac7db2-3b52-42d5-b163-77fcb86d6dcc service nova] Creating event network-vif-plugged:f81a67af-6fdb-4ade-b541-421cafdc5230 for instance 625f5fd3-d872-4da5-b176-5a70dfd8cfe2 on nch1-master-1 Sep 24 20:52:13.157950 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-7b2cf61b-ddfd-4dd8-99c7-df30a85fc8cf req-d3ac7db2-3b52-42d5-b163-77fcb86d6dcc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035320 Sep 24 20:52:13.158697 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 363/702] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:52:13.164689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0b9938c7-43c1-4db8-9a1b-bd588b71f228 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:13.165404 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0b9938c7-43c1-4db8-9a1b-bd588b71f228 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a74d1c4c-d757-4879-a35d-9f817ea6e28b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:13.172168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b9938c7-43c1-4db8-9a1b-bd588b71f228 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:13.172621 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b9938c7-43c1-4db8-9a1b-bd588b71f228 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:13.173057 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b9938c7-43c1-4db8-9a1b-bd588b71f228 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:13.173761 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b9938c7-43c1-4db8-9a1b-bd588b71f228 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:13.174214 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b9938c7-43c1-4db8-9a1b-bd588b71f228 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:13.174671 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b9938c7-43c1-4db8-9a1b-bd588b71f228 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:13.321363 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0b9938c7-43c1-4db8-9a1b-bd588b71f228 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:13.329412 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0b9938c7-43c1-4db8-9a1b-bd588b71f228 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a74d1c4c-d757-4879-a35d-9f817ea6e28b" status: 200 len: 1317 microversion: 2.1 time: 0.169483 Sep 24 20:52:13.330139 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 364/703] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:13 2022] GET /compute/v2.1/servers/a74d1c4c-d757-4879-a35d-9f817ea6e28b => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:13.334685 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-41d3000b-0df7-432d-b5ac-c187e61e983f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:13.336332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-41d3000b-0df7-432d-b5ac-c187e61e983f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:13.342742 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41d3000b-0df7-432d-b5ac-c187e61e983f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:13.343233 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41d3000b-0df7-432d-b5ac-c187e61e983f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:13.343852 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41d3000b-0df7-432d-b5ac-c187e61e983f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:13.344560 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41d3000b-0df7-432d-b5ac-c187e61e983f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:13.345016 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41d3000b-0df7-432d-b5ac-c187e61e983f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:13.345441 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41d3000b-0df7-432d-b5ac-c187e61e983f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:13.493723 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-41d3000b-0df7-432d-b5ac-c187e61e983f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:13.502190 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-41d3000b-0df7-432d-b5ac-c187e61e983f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1475 microversion: 2.1 time: 0.171063 Sep 24 20:52:13.502689 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 365/704] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:13 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1475 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:13.507514 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8c63c09f-da3b-4a91-be39-6d9f3bebb618 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:13.508129 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8c63c09f-da3b-4a91-be39-6d9f3bebb618 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:13.514182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c63c09f-da3b-4a91-be39-6d9f3bebb618 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:13.514702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c63c09f-da3b-4a91-be39-6d9f3bebb618 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:13.515311 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c63c09f-da3b-4a91-be39-6d9f3bebb618 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:13.516189 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c63c09f-da3b-4a91-be39-6d9f3bebb618 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:13.516792 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c63c09f-da3b-4a91-be39-6d9f3bebb618 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:13.517366 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c63c09f-da3b-4a91-be39-6d9f3bebb618 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:13.586958 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8c63c09f-da3b-4a91-be39-6d9f3bebb618 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:13.596229 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8c63c09f-da3b-4a91-be39-6d9f3bebb618 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:13.597801 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8c63c09f-da3b-4a91-be39-6d9f3bebb618 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:13.598923 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8c63c09f-da3b-4a91-be39-6d9f3bebb618 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e" status: 200 len: 1313 microversion: 2.25 time: 0.095113 Sep 24 20:52:13.610521 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 366/705] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:13 2022] GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e => generated 1313 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:13.610521 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-290d8e61-591d-4439-8091-3ae7b34c825d tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:13.614173 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-290d8e61-591d-4439-8091-3ae7b34c825d tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Searching by: {'tenant_id': '5e68660c954f47f9bad1f7bee17f9435', 'deleted': False} {{(pid=140516) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 20:52:13.620064 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-290d8e61-591d-4439-8091-3ae7b34c825d tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:13.620555 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-290d8e61-591d-4439-8091-3ae7b34c825d tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:13.620996 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-290d8e61-591d-4439-8091-3ae7b34c825d tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:13.621737 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-290d8e61-591d-4439-8091-3ae7b34c825d tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:13.622219 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-290d8e61-591d-4439-8091-3ae7b34c825d tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:13.622678 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-290d8e61-591d-4439-8091-3ae7b34c825d tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:13.658645 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.multi_cell_list [None req-290d8e61-591d-4439-8091-3ae7b34c825d tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 20:52:13.746560 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:13.785658 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-290d8e61-591d-4439-8091-3ae7b34c825d tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:13.786174 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-290d8e61-591d-4439-8091-3ae7b34c825d tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:13.786660 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-290d8e61-591d-4439-8091-3ae7b34c825d tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:14.102567 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-290d8e61-591d-4439-8091-3ae7b34c825d tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=5e68660c954f47f9bad1f7bee17f9435" status: 200 len: 4825 microversion: 2.1 time: 0.501586 Sep 24 20:52:14.103211 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 367/706] 10.222.0.52 () {58 vars in 1257 bytes} [Sat Sep 24 20:52:13 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=5e68660c954f47f9bad1f7bee17f9435 => generated 4825 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:14.108141 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2c0f8774-6e85-4d7a-b6d9-594c117156aa tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:14.108622 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2c0f8774-6e85-4d7a-b6d9-594c117156aa tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:14.115430 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c0f8774-6e85-4d7a-b6d9-594c117156aa tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:14.115926 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c0f8774-6e85-4d7a-b6d9-594c117156aa tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:14.116538 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c0f8774-6e85-4d7a-b6d9-594c117156aa tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:14.117357 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c0f8774-6e85-4d7a-b6d9-594c117156aa tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:14.117823 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c0f8774-6e85-4d7a-b6d9-594c117156aa tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:14.118259 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c0f8774-6e85-4d7a-b6d9-594c117156aa tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:14.141009 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-2c0f8774-6e85-4d7a-b6d9-594c117156aa tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lazy-loading 'flavor' on Instance uuid fafd445e-572c-4300-9433-f0d9a628df5e {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:52:14.344312 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2c0f8774-6e85-4d7a-b6d9-594c117156aa tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "POST /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e/action" status: 202 len: 0 microversion: 2.91 time: 0.239770 Sep 24 20:52:14.345001 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 368/707] 10.222.0.52 () {62 vars in 1319 bytes} [Sat Sep 24 20:52:14 2022] POST /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:52:14.350544 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7e8c72ce-e6a1-4f9b-8c2d-1a1095d0e368 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-751258903", "metadata": {"": ""}}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:14.354876 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7e8c72ce-e6a1-4f9b-8c2d-1a1095d0e368 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Request method failure captured: Sep 24 20:52:14.354876 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b/action HTTP/1.1 Sep 24 20:52:14.354876 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:52:14.354876 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:52:14.354876 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:52:14.354876 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 106 Sep 24 20:52:14.354876 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:52:14.354876 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:52:14.354876 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:52:14.354876 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:52:14.354876 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL23hSaMAKT8B-JdjtYs2UoED1UAMalIeRO9Th3athHCHzrGhfs9Sy0_hBzkoXpxV7aas8iy4VFycxPqE3-ST396dY35DaR9MZAQlds-eQBPgVm84hG8pTTOjeXtJegh8tOCUNbJFm6JLpFNRAi1C2IykufgxtCoO69ROBtQmrT9YEmI Sep 24 20:52:14.354876 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:52:14.354876 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:52:14.354876 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:52:14.354876 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:52:14.354876 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:52:14.354876 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:52:14.354876 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: e175cb4032ec4e6aa900141abbaa04c4 Sep 24 20:52:14.354876 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:52:14.354876 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:52:14.354876 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:52:14.356367 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:52:14.356367 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:52:14.356367 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: e175cb4032ec4e6aa900141abbaa04c4 Sep 24 20:52:14.356367 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:52:14.356367 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ImagesOneServerNegativeTestJSON-1825846347-project Sep 24 20:52:14.356367 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:52:14.356367 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:52:14.356367 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 6db52cb259fa426d860f9c9a48a149f3 Sep 24 20:52:14.356367 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347-project Sep 24 20:52:14.356367 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 20:52:14.356367 ncdv-master-1 devstack@n-api.service[140516]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-751258903", "metadata": {"": ""}}} Sep 24 20:52:14.356367 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:52:14.357127 ncdv-master-1 devstack@n-api.service[140516]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 24 20:52:14.357127 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'b4b8b488-a1f1-42fb-b34a-04005d670e7b', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-751258903', 'metadata': {'': ''}}}} Sep 24 20:52:14.357127 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:52:14.357127 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:52:14.357127 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 20:52:14.357127 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 20:52:14.357127 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 20:52:14.357127 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise error Sep 24 20:52:14.357127 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 24 20:52:14.357127 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:52:14.357127 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 24 20:52:14.357127 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 24 20:52:14.357127 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 24 20:52:14.357127 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 24 20:52:14.357127 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 24 20:52:14.357127 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:52:14.357127 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 24 20:52:14.357127 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi {'': ''} Sep 24 20:52:14.357127 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:52:14.357127 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:52:14.357127 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:52:14.358541 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:52:14.358541 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:52:14.358541 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:52:14.358541 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:52:14.358541 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:52:14.358541 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:52:14.358541 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:52:14.358541 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:52:14.358541 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:52:14.358541 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 20:52:14.358541 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 20:52:14.358541 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 20:52:14.358541 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 20:52:14.358541 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 20:52:14.358541 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 20:52:14.358541 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 24 20:52:14.358541 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:52:14.358541 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:52:14.358541 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:52:14.358541 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:52:14.359860 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:52:14.359860 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:52:14.359860 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 20:52:14.359860 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 20:52:14.359860 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 24 20:52:14.359860 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:52:14.359860 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7e8c72ce-e6a1-4f9b-8c2d-1a1095d0e368 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:52:14.359860 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7e8c72ce-e6a1-4f9b-8c2d-1a1095d0e368 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "POST /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b/action" status: 400 len: 170 microversion: 2.1 time: 0.009985 Sep 24 20:52:14.359860 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 369/708] 10.222.0.52 () {60 vars in 1279 bytes} [Sat Sep 24 20:52:14 2022] POST /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b/action => generated 170 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 20:52:14.364265 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6053b20e-72c3-45c5-9d76-ee7ea7e8f9dc tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:14.365007 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6053b20e-72c3-45c5-9d76-ee7ea7e8f9dc tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 625f5fd3-d872-4da5-b176-5a70dfd8cfe2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:14.373684 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6053b20e-72c3-45c5-9d76-ee7ea7e8f9dc tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:14.374185 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6053b20e-72c3-45c5-9d76-ee7ea7e8f9dc tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:14.374664 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6053b20e-72c3-45c5-9d76-ee7ea7e8f9dc tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:14.375388 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6053b20e-72c3-45c5-9d76-ee7ea7e8f9dc tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:14.375853 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6053b20e-72c3-45c5-9d76-ee7ea7e8f9dc tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:14.376290 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6053b20e-72c3-45c5-9d76-ee7ea7e8f9dc tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:14.697533 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6053b20e-72c3-45c5-9d76-ee7ea7e8f9dc tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278977b201c48dda2d73823fbfe4833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a31be22cc451b92af447ed8d81242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:14.707534 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6053b20e-72c3-45c5-9d76-ee7ea7e8f9dc tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2" status: 200 len: 1391 microversion: 2.1 time: 0.349814 Sep 24 20:52:14.708393 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 370/709] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:14 2022] GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2 => generated 1391 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:14.713373 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b849bc07-15ce-40c2-a146-4dd60e36114e tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:14.719694 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b849bc07-15ce-40c2-a146-4dd60e36114e tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Searching by: {'tenant_id': '483f8a432244480698773200e1d49501', 'deleted': False} {{(pid=140516) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 20:52:14.733251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b849bc07-15ce-40c2-a146-4dd60e36114e tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:14.733765 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b849bc07-15ce-40c2-a146-4dd60e36114e tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:14.734282 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b849bc07-15ce-40c2-a146-4dd60e36114e tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:14.735132 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b849bc07-15ce-40c2-a146-4dd60e36114e tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:14.735764 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b849bc07-15ce-40c2-a146-4dd60e36114e tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:14.740365 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b849bc07-15ce-40c2-a146-4dd60e36114e tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:14.782973 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b849bc07-15ce-40c2-a146-4dd60e36114e tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=483f8a432244480698773200e1d49501" status: 200 len: 15 microversion: 2.1 time: 0.072900 Sep 24 20:52:14.783663 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 371/710] 10.222.0.52 () {58 vars in 1257 bytes} [Sat Sep 24 20:52:14 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=483f8a432244480698773200e1d49501 => generated 15 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:52:14.793966 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d80d4c8a-b8a2-4a36-9b40-a1aace491fac tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:14.794973 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d80d4c8a-b8a2-4a36-9b40-a1aace491fac tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a74d1c4c-d757-4879-a35d-9f817ea6e28b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:14.801642 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d80d4c8a-b8a2-4a36-9b40-a1aace491fac tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:14.802398 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d80d4c8a-b8a2-4a36-9b40-a1aace491fac tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:14.803091 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d80d4c8a-b8a2-4a36-9b40-a1aace491fac tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:14.803955 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d80d4c8a-b8a2-4a36-9b40-a1aace491fac tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:14.804494 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d80d4c8a-b8a2-4a36-9b40-a1aace491fac tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:14.805019 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d80d4c8a-b8a2-4a36-9b40-a1aace491fac tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:15.015291 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d80d4c8a-b8a2-4a36-9b40-a1aace491fac tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:15.025278 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d80d4c8a-b8a2-4a36-9b40-a1aace491fac tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a74d1c4c-d757-4879-a35d-9f817ea6e28b" status: 200 len: 1317 microversion: 2.1 time: 0.240363 Sep 24 20:52:15.026149 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 372/711] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:14 2022] GET /compute/v2.1/servers/a74d1c4c-d757-4879-a35d-9f817ea6e28b => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:15.031455 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1a735144-848f-45e9-b401-def49744d51a tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:15.032186 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1a735144-848f-45e9-b401-def49744d51a tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:15.038650 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a735144-848f-45e9-b401-def49744d51a tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:15.039382 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a735144-848f-45e9-b401-def49744d51a tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:15.040184 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a735144-848f-45e9-b401-def49744d51a tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:15.041155 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a735144-848f-45e9-b401-def49744d51a tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:15.042318 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a735144-848f-45e9-b401-def49744d51a tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:15.042840 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a735144-848f-45e9-b401-def49744d51a tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:15.152469 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1a735144-848f-45e9-b401-def49744d51a tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:15.163782 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1a735144-848f-45e9-b401-def49744d51a tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:15.165655 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1a735144-848f-45e9-b401-def49744d51a tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:15.172200 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1a735144-848f-45e9-b401-def49744d51a tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.144771 Sep 24 20:52:15.172867 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 373/712] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:15 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:15.177927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f096d925-7d5f-46d0-96b2-2887ab828974 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:15.178891 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f096d925-7d5f-46d0-96b2-2887ab828974 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: b4b8b488-a1f1-42fb-b34a-04005d670e7b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:15.184674 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f096d925-7d5f-46d0-96b2-2887ab828974 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:15.185153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f096d925-7d5f-46d0-96b2-2887ab828974 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:15.185784 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f096d925-7d5f-46d0-96b2-2887ab828974 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:15.186488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f096d925-7d5f-46d0-96b2-2887ab828974 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:15.186988 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f096d925-7d5f-46d0-96b2-2887ab828974 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:15.187570 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f096d925-7d5f-46d0-96b2-2887ab828974 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:15.456389 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f096d925-7d5f-46d0-96b2-2887ab828974 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:15.466271 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f096d925-7d5f-46d0-96b2-2887ab828974 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b" status: 200 len: 1521 microversion: 2.1 time: 0.292104 Sep 24 20:52:15.467509 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 374/713] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:15 2022] GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:15.482960 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e7c6c23f-07e0-4349-8bf9-c68eccf02040 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:15.483901 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e7c6c23f-07e0-4349-8bf9-c68eccf02040 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:15.491654 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e7c6c23f-07e0-4349-8bf9-c68eccf02040 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:15.498025 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e7c6c23f-07e0-4349-8bf9-c68eccf02040 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:15.498640 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e7c6c23f-07e0-4349-8bf9-c68eccf02040 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:15.500141 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e7c6c23f-07e0-4349-8bf9-c68eccf02040 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:15.500938 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e7c6c23f-07e0-4349-8bf9-c68eccf02040 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:15.501598 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e7c6c23f-07e0-4349-8bf9-c68eccf02040 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:15.562110 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0206e0eb-4f8c-40e9-adbc-d30e4d751821 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d/action" status: 202 len: 0 microversion: 2.1 time: 4.204823 Sep 24 20:52:15.563009 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 340/714] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:52:11 2022] POST /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d/action => generated 0 bytes in 4221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:52:15.571232 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-32bd963d-5b4a-4bd6-b422-240dcd220ef0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:15.575184 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-32bd963d-5b4a-4bd6-b422-240dcd220ef0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:15.583409 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-32bd963d-5b4a-4bd6-b422-240dcd220ef0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:15.583896 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-32bd963d-5b4a-4bd6-b422-240dcd220ef0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:15.584334 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-32bd963d-5b4a-4bd6-b422-240dcd220ef0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:15.585203 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-32bd963d-5b4a-4bd6-b422-240dcd220ef0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:15.585969 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-32bd963d-5b4a-4bd6-b422-240dcd220ef0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:15.586418 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-32bd963d-5b4a-4bd6-b422-240dcd220ef0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:15.725211 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e7c6c23f-07e0-4349-8bf9-c68eccf02040 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:15.735631 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e7c6c23f-07e0-4349-8bf9-c68eccf02040 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1475 microversion: 2.1 time: 0.266859 Sep 24 20:52:15.736242 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 375/715] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:15 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1475 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:15.744287 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cdb0ab24-cd78-44ed-ac81-3e959e2c88dd tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:15.750279 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cdb0ab24-cd78-44ed-ac81-3e959e2c88dd tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.012001 Sep 24 20:52:15.752520 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 376/716] 10.222.0.52 () {58 vars in 1189 bytes} [Sat Sep 24 20:52:15 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:52:15.758303 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0c8dea90-9360-49a6-a3d3-73168dc3213d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:15.759445 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0c8dea90-9360-49a6-a3d3-73168dc3213d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: b4b8b488-a1f1-42fb-b34a-04005d670e7b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:15.763814 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-32bd963d-5b4a-4bd6-b422-240dcd220ef0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:15.766378 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:15.776616 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-32bd963d-5b4a-4bd6-b422-240dcd220ef0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:15.777792 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0c8dea90-9360-49a6-a3d3-73168dc3213d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:15.778285 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0c8dea90-9360-49a6-a3d3-73168dc3213d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:15.778750 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0c8dea90-9360-49a6-a3d3-73168dc3213d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:15.779177 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-32bd963d-5b4a-4bd6-b422-240dcd220ef0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:15.779463 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0c8dea90-9360-49a6-a3d3-73168dc3213d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:15.779917 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0c8dea90-9360-49a6-a3d3-73168dc3213d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:15.780340 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0c8dea90-9360-49a6-a3d3-73168dc3213d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:15.781037 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-32bd963d-5b4a-4bd6-b422-240dcd220ef0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e" status: 200 len: 1361 microversion: 2.25 time: 0.216612 Sep 24 20:52:15.781708 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 341/717] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:15 2022] GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e => generated 1361 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:15.786633 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-199ec0f2-5fdd-483a-94d6-af75941f95de tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:15.787523 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-199ec0f2-5fdd-483a-94d6-af75941f95de tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:15.795896 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-199ec0f2-5fdd-483a-94d6-af75941f95de tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:15.796659 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-199ec0f2-5fdd-483a-94d6-af75941f95de tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:15.797340 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-199ec0f2-5fdd-483a-94d6-af75941f95de tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:15.798269 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-199ec0f2-5fdd-483a-94d6-af75941f95de tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:15.799275 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-199ec0f2-5fdd-483a-94d6-af75941f95de tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:15.799921 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-199ec0f2-5fdd-483a-94d6-af75941f95de tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:16.127422 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0c8dea90-9360-49a6-a3d3-73168dc3213d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:16.142765 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0c8dea90-9360-49a6-a3d3-73168dc3213d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b" status: 200 len: 1521 microversion: 2.1 time: 0.388830 Sep 24 20:52:16.144166 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 377/718] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:15 2022] GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b => generated 1521 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:16.150782 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-efeda7ad-f936-47a0-b618-c4551ed95b48 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:16.151694 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-efeda7ad-f936-47a0-b618-c4551ed95b48 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 625f5fd3-d872-4da5-b176-5a70dfd8cfe2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:16.155536 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-199ec0f2-5fdd-483a-94d6-af75941f95de tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:16.166915 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-efeda7ad-f936-47a0-b618-c4551ed95b48 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:16.167412 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-efeda7ad-f936-47a0-b618-c4551ed95b48 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:16.168036 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-efeda7ad-f936-47a0-b618-c4551ed95b48 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:16.168940 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-efeda7ad-f936-47a0-b618-c4551ed95b48 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:16.169512 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-199ec0f2-5fdd-483a-94d6-af75941f95de tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d" status: 200 len: 1503 microversion: 2.1 time: 0.386250 Sep 24 20:52:16.169998 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-efeda7ad-f936-47a0-b618-c4551ed95b48 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:16.170611 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-efeda7ad-f936-47a0-b618-c4551ed95b48 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:16.171871 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 342/719] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:15 2022] GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d => generated 1503 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:16.182450 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9d934bd7-fdbb-4c4b-9dba-b1b02d432196 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:16.187231 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9d934bd7-fdbb-4c4b-9dba-b1b02d432196 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:16.201553 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d934bd7-fdbb-4c4b-9dba-b1b02d432196 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:16.202105 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d934bd7-fdbb-4c4b-9dba-b1b02d432196 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:16.203029 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d934bd7-fdbb-4c4b-9dba-b1b02d432196 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:16.204279 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d934bd7-fdbb-4c4b-9dba-b1b02d432196 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:16.205079 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d934bd7-fdbb-4c4b-9dba-b1b02d432196 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:16.205973 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d934bd7-fdbb-4c4b-9dba-b1b02d432196 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:16.314136 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9d934bd7-fdbb-4c4b-9dba-b1b02d432196 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a/action" status: 202 len: 0 microversion: 2.1 time: 0.140801 Sep 24 20:52:16.320053 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 343/720] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:52:16 2022] POST /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:52:16.327210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8d13b9b8-63e0-43e3-83af-5684ccda7070 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:16.328672 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8d13b9b8-63e0-43e3-83af-5684ccda7070 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a74d1c4c-d757-4879-a35d-9f817ea6e28b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:16.337272 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8d13b9b8-63e0-43e3-83af-5684ccda7070 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:16.338233 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8d13b9b8-63e0-43e3-83af-5684ccda7070 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:16.338856 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8d13b9b8-63e0-43e3-83af-5684ccda7070 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:16.339764 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8d13b9b8-63e0-43e3-83af-5684ccda7070 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:16.340797 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8d13b9b8-63e0-43e3-83af-5684ccda7070 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:16.341442 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8d13b9b8-63e0-43e3-83af-5684ccda7070 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:16.344922 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-efeda7ad-f936-47a0-b618-c4551ed95b48 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278977b201c48dda2d73823fbfe4833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a31be22cc451b92af447ed8d81242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:16.355520 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-efeda7ad-f936-47a0-b618-c4551ed95b48 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2" status: 200 len: 1391 microversion: 2.1 time: 0.209922 Sep 24 20:52:16.356570 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 378/721] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:16 2022] GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2 => generated 1391 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:16.362426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-39b3654b-2302-4ea9-a10f-38971ffa1e79 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-627349969", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:16.368399 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-39b3654b-2302-4ea9-a10f-38971ffa1e79 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Request method failure captured: Sep 24 20:52:16.368399 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b/action HTTP/1.1 Sep 24 20:52:16.368399 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:52:16.368399 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:52:16.368399 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:52:16.368399 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 618 Sep 24 20:52:16.368399 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:52:16.368399 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:52:16.368399 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:52:16.368399 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:52:16.368399 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL23hSaMAKT8B-JdjtYs2UoED1UAMalIeRO9Th3athHCHzrGhfs9Sy0_hBzkoXpxV7aas8iy4VFycxPqE3-ST396dY35DaR9MZAQlds-eQBPgVm84hG8pTTOjeXtJegh8tOCUNbJFm6JLpFNRAi1C2IykufgxtCoO69ROBtQmrT9YEmI Sep 24 20:52:16.368399 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:52:16.368399 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:52:16.368399 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:52:16.368399 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:52:16.368399 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:52:16.368399 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:52:16.368399 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: e175cb4032ec4e6aa900141abbaa04c4 Sep 24 20:52:16.368399 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:52:16.368399 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:52:16.368399 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:52:16.369713 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:52:16.369713 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:52:16.369713 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: e175cb4032ec4e6aa900141abbaa04c4 Sep 24 20:52:16.369713 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:52:16.369713 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ImagesOneServerNegativeTestJSON-1825846347-project Sep 24 20:52:16.369713 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:52:16.369713 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:52:16.369713 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 6db52cb259fa426d860f9c9a48a149f3 Sep 24 20:52:16.369713 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347-project Sep 24 20:52:16.369713 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 20:52:16.370364 ncdv-master-1 devstack@n-api.service[140516]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-627349969", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Sep 24 20:52:16.370364 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:52:16.370364 ncdv-master-1 devstack@n-api.service[140516]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 24 20:52:16.370588 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'b4b8b488-a1f1-42fb-b34a-04005d670e7b', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-627349969', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Sep 24 20:52:16.370588 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:52:16.370588 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:52:16.370588 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 20:52:16.370588 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 20:52:16.370588 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 20:52:16.370588 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise error Sep 24 20:52:16.370588 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 24 20:52:16.370588 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:52:16.370588 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 24 20:52:16.370588 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 24 20:52:16.371213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 24 20:52:16.371213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 24 20:52:16.371213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 24 20:52:16.371213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:52:16.371213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 24 20:52:16.371213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Sep 24 20:52:16.371213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:52:16.371213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:52:16.371213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:52:16.371213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:52:16.371213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:52:16.371213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:52:16.371213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:52:16.371213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:52:16.371213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:52:16.371213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:52:16.371213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:52:16.372149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:52:16.372149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 20:52:16.372149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 20:52:16.372149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 20:52:16.372149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 20:52:16.372149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 20:52:16.372149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 20:52:16.372149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 24 20:52:16.372149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:52:16.372149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:52:16.372149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:52:16.372149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:52:16.372818 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:52:16.372818 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:52:16.372818 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 20:52:16.372818 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 20:52:16.372818 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 24 20:52:16.372818 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:52:16.373179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-39b3654b-2302-4ea9-a10f-38971ffa1e79 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:52:16.373179 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-39b3654b-2302-4ea9-a10f-38971ffa1e79 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "POST /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b/action" status: 400 len: 938 microversion: 2.1 time: 0.012079 Sep 24 20:52:16.373179 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 379/722] 10.222.0.52 () {60 vars in 1279 bytes} [Sat Sep 24 20:52:16 2022] POST /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b/action => generated 938 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 20:52:16.379374 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-635b150b-05a3-46e1-81b3-1673f0a787a5 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:16.380161 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-635b150b-05a3-46e1-81b3-1673f0a787a5 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:16.388416 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-635b150b-05a3-46e1-81b3-1673f0a787a5 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:16.388923 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-635b150b-05a3-46e1-81b3-1673f0a787a5 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:16.389371 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-635b150b-05a3-46e1-81b3-1673f0a787a5 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:16.390256 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-635b150b-05a3-46e1-81b3-1673f0a787a5 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:16.390757 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-635b150b-05a3-46e1-81b3-1673f0a787a5 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:16.391185 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-635b150b-05a3-46e1-81b3-1673f0a787a5 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:16.484306 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-635b150b-05a3-46e1-81b3-1673f0a787a5 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:16.493917 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-635b150b-05a3-46e1-81b3-1673f0a787a5 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:16.495561 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-635b150b-05a3-46e1-81b3-1673f0a787a5 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:16.501039 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-635b150b-05a3-46e1-81b3-1673f0a787a5 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.127235 Sep 24 20:52:16.501696 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 380/723] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:16 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:16.508946 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7f8b663a-c728-4784-b2e3-0fecbdbf33c5 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:16.514146 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7f8b663a-c728-4784-b2e3-0fecbdbf33c5 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:16.516463 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7f8b663a-c728-4784-b2e3-0fecbdbf33c5 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '5e68660c954f47f9bad1f7bee17f9435'} {{(pid=140516) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 20:52:16.529463 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f8b663a-c728-4784-b2e3-0fecbdbf33c5 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:16.529956 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f8b663a-c728-4784-b2e3-0fecbdbf33c5 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:16.530612 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f8b663a-c728-4784-b2e3-0fecbdbf33c5 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:16.531498 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f8b663a-c728-4784-b2e3-0fecbdbf33c5 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:16.532109 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f8b663a-c728-4784-b2e3-0fecbdbf33c5 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:16.532690 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f8b663a-c728-4784-b2e3-0fecbdbf33c5 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:16.556569 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8d13b9b8-63e0-43e3-83af-5684ccda7070 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:16.561610 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=23 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:16.565977 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8d13b9b8-63e0-43e3-83af-5684ccda7070 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a74d1c4c-d757-4879-a35d-9f817ea6e28b" status: 200 len: 1317 microversion: 2.1 time: 0.244649 Sep 24 20:52:16.567014 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 344/724] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:16 2022] GET /compute/v2.1/servers/a74d1c4c-d757-4879-a35d-9f817ea6e28b => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:16.572986 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-682b1acf-d497-4332-a259-0addd5db3c65 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:16.573658 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-682b1acf-d497-4332-a259-0addd5db3c65 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: b4b8b488-a1f1-42fb-b34a-04005d670e7b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:16.580101 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-682b1acf-d497-4332-a259-0addd5db3c65 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:16.580800 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-682b1acf-d497-4332-a259-0addd5db3c65 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:16.581400 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-682b1acf-d497-4332-a259-0addd5db3c65 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:16.582535 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-682b1acf-d497-4332-a259-0addd5db3c65 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:16.583043 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-682b1acf-d497-4332-a259-0addd5db3c65 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:16.583480 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-682b1acf-d497-4332-a259-0addd5db3c65 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:16.623002 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.multi_cell_list [None req-7f8b663a-c728-4784-b2e3-0fecbdbf33c5 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 20:52:16.690238 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7f8b663a-c728-4784-b2e3-0fecbdbf33c5 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.187278 Sep 24 20:52:16.691452 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 381/725] 10.222.0.52 () {58 vars in 1150 bytes} [Sat Sep 24 20:52:16 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:52:16.696650 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-1cb9e23b-1e85-4dd7-9bee-e9c9b23249b3 req-abf7d24e-d277-4cb2-93c3-c9551988c42e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca2ec54c-f6d0-43a4-abf4-c35d1cad952e", "tag": "6259f434-7655-415c-a21b-246b0076fb23"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:16.701738 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:16.708494 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1cb9e23b-1e85-4dd7-9bee-e9c9b23249b3 req-abf7d24e-d277-4cb2-93c3-c9551988c42e service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:16.709069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1cb9e23b-1e85-4dd7-9bee-e9c9b23249b3 req-abf7d24e-d277-4cb2-93c3-c9551988c42e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:16.709788 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1cb9e23b-1e85-4dd7-9bee-e9c9b23249b3 req-abf7d24e-d277-4cb2-93c3-c9551988c42e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:16.722723 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-1cb9e23b-1e85-4dd7-9bee-e9c9b23249b3 req-abf7d24e-d277-4cb2-93c3-c9551988c42e service nova] Creating event network-changed:6259f434-7655-415c-a21b-246b0076fb23 for instance ca2ec54c-f6d0-43a4-abf4-c35d1cad952e on nch2-master-1 Sep 24 20:52:16.728816 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-1cb9e23b-1e85-4dd7-9bee-e9c9b23249b3 req-abf7d24e-d277-4cb2-93c3-c9551988c42e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036033 Sep 24 20:52:16.729515 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 382/726] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:52:16.733613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-682b1acf-d497-4332-a259-0addd5db3c65 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:16.735427 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9eb1d96b-a025-46dc-bf43-0466fbf72791 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:16.737731 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9eb1d96b-a025-46dc-bf43-0466fbf72791 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:16.743989 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-682b1acf-d497-4332-a259-0addd5db3c65 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b" status: 200 len: 1521 microversion: 2.1 time: 0.175138 Sep 24 20:52:16.744131 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9eb1d96b-a025-46dc-bf43-0466fbf72791 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:16.744617 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9eb1d96b-a025-46dc-bf43-0466fbf72791 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:16.745197 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 345/727] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:16 2022] GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:16.751004 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9eb1d96b-a025-46dc-bf43-0466fbf72791 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:16.751873 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9eb1d96b-a025-46dc-bf43-0466fbf72791 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:16.752550 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9eb1d96b-a025-46dc-bf43-0466fbf72791 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:16.753067 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9eb1d96b-a025-46dc-bf43-0466fbf72791 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:16.768624 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d08d53da-d3de-4365-88ea-81111cd6ee56 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:16.769243 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d08d53da-d3de-4365-88ea-81111cd6ee56 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: b4b8b488-a1f1-42fb-b34a-04005d670e7b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:16.777025 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d08d53da-d3de-4365-88ea-81111cd6ee56 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:16.777549 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d08d53da-d3de-4365-88ea-81111cd6ee56 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:16.777999 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d08d53da-d3de-4365-88ea-81111cd6ee56 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:16.778738 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d08d53da-d3de-4365-88ea-81111cd6ee56 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:16.779198 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d08d53da-d3de-4365-88ea-81111cd6ee56 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:16.779629 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d08d53da-d3de-4365-88ea-81111cd6ee56 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:16.838938 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9eb1d96b-a025-46dc-bf43-0466fbf72791 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a/action" status: 202 len: 0 microversion: 2.1 time: 0.107238 Sep 24 20:52:16.840181 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 383/728] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:52:16 2022] POST /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:52:16.844961 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c10d5402-24ee-4f33-8b13-fec2a06fa5e6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:16.846018 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c10d5402-24ee-4f33-8b13-fec2a06fa5e6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:16.854938 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c10d5402-24ee-4f33-8b13-fec2a06fa5e6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:16.856451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c10d5402-24ee-4f33-8b13-fec2a06fa5e6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:16.857159 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c10d5402-24ee-4f33-8b13-fec2a06fa5e6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:16.858684 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c10d5402-24ee-4f33-8b13-fec2a06fa5e6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:16.859440 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c10d5402-24ee-4f33-8b13-fec2a06fa5e6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:16.860141 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c10d5402-24ee-4f33-8b13-fec2a06fa5e6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:16.963339 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d08d53da-d3de-4365-88ea-81111cd6ee56 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:16.972562 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d08d53da-d3de-4365-88ea-81111cd6ee56 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b" status: 200 len: 1521 microversion: 2.1 time: 0.207856 Sep 24 20:52:16.973148 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 346/729] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:16 2022] GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:52:16.978744 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-006517b5-f8e7-49d4-a315-243cdc0c3e89 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:16.979362 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-006517b5-f8e7-49d4-a315-243cdc0c3e89 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:16.985734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-006517b5-f8e7-49d4-a315-243cdc0c3e89 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:16.986579 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-006517b5-f8e7-49d4-a315-243cdc0c3e89 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:16.987211 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-006517b5-f8e7-49d4-a315-243cdc0c3e89 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:16.988778 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-006517b5-f8e7-49d4-a315-243cdc0c3e89 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:16.989408 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-006517b5-f8e7-49d4-a315-243cdc0c3e89 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:16.989995 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-006517b5-f8e7-49d4-a315-243cdc0c3e89 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:17.086344 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c10d5402-24ee-4f33-8b13-fec2a06fa5e6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:17.089136 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:17.103465 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c10d5402-24ee-4f33-8b13-fec2a06fa5e6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1475 microversion: 2.1 time: 0.261632 Sep 24 20:52:17.104740 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 384/730] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:16 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1475 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:17.110512 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0b6ddbce-3448-4412-acf0-0cf9bd78027f tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:17.111500 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0b6ddbce-3448-4412-acf0-0cf9bd78027f tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:17.121029 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b6ddbce-3448-4412-acf0-0cf9bd78027f tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:17.121883 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b6ddbce-3448-4412-acf0-0cf9bd78027f tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:17.122422 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b6ddbce-3448-4412-acf0-0cf9bd78027f tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:17.123257 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b6ddbce-3448-4412-acf0-0cf9bd78027f tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:17.123827 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b6ddbce-3448-4412-acf0-0cf9bd78027f tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:17.124349 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b6ddbce-3448-4412-acf0-0cf9bd78027f tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:17.151623 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-006517b5-f8e7-49d4-a315-243cdc0c3e89 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:17.161041 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-006517b5-f8e7-49d4-a315-243cdc0c3e89 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:17.162567 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-006517b5-f8e7-49d4-a315-243cdc0c3e89 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:17.163784 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-006517b5-f8e7-49d4-a315-243cdc0c3e89 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e" status: 200 len: 1361 microversion: 2.25 time: 0.189484 Sep 24 20:52:17.164344 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 347/731] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:16 2022] GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:17.169600 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-75d5cb34-a725-42b9-8b3f-296da37ae3a9 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:17.175818 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-75d5cb34-a725-42b9-8b3f-296da37ae3a9 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Request method failure captured: Sep 24 20:52:17.175818 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b/action HTTP/1.1 Sep 24 20:52:17.175818 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:52:17.175818 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:52:17.175818 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:52:17.175818 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 285 Sep 24 20:52:17.175818 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:52:17.175818 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:52:17.175818 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:52:17.175818 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:52:17.175818 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL23hSaMAKT8B-JdjtYs2UoED1UAMalIeRO9Th3athHCHzrGhfs9Sy0_hBzkoXpxV7aas8iy4VFycxPqE3-ST396dY35DaR9MZAQlds-eQBPgVm84hG8pTTOjeXtJegh8tOCUNbJFm6JLpFNRAi1C2IykufgxtCoO69ROBtQmrT9YEmI Sep 24 20:52:17.175818 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:52:17.175818 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:52:17.175818 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:52:17.175818 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:52:17.175818 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:52:17.175818 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:52:17.175818 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: e175cb4032ec4e6aa900141abbaa04c4 Sep 24 20:52:17.175818 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:52:17.175818 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:52:17.175818 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:52:17.177178 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:52:17.177178 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:52:17.177178 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: e175cb4032ec4e6aa900141abbaa04c4 Sep 24 20:52:17.177178 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:52:17.177178 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ImagesOneServerNegativeTestJSON-1825846347-project Sep 24 20:52:17.177178 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:52:17.177178 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:52:17.177178 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 6db52cb259fa426d860f9c9a48a149f3 Sep 24 20:52:17.177178 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347-project Sep 24 20:52:17.177178 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 20:52:17.177178 ncdv-master-1 devstack@n-api.service[140517]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 24 20:52:17.177811 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:52:17.177811 ncdv-master-1 devstack@n-api.service[140517]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 24 20:52:17.177811 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'b4b8b488-a1f1-42fb-b34a-04005d670e7b', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 24 20:52:17.177811 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:52:17.177811 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:52:17.177811 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 20:52:17.177811 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 20:52:17.177811 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 20:52:17.177811 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise error Sep 24 20:52:17.177811 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 24 20:52:17.178999 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:52:17.178999 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Sep 24 20:52:17.178999 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 24 20:52:17.178999 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:52:17.178999 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 24 20:52:17.178999 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 24 20:52:17.178999 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:52:17.178999 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:52:17.178999 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:52:17.178999 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:52:17.178999 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:52:17.178999 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:52:17.178999 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:52:17.178999 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:52:17.178999 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:52:17.178999 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:52:17.178999 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:52:17.178999 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:52:17.178999 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 20:52:17.178999 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 20:52:17.180190 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 20:52:17.180190 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 20:52:17.180190 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 20:52:17.180190 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 20:52:17.180190 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 24 20:52:17.180190 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:52:17.180190 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:52:17.180190 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:52:17.180190 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:52:17.180190 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:52:17.180190 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:52:17.180190 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 20:52:17.180190 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 20:52:17.182535 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 24 20:52:17.182535 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:52:17.184570 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-75d5cb34-a725-42b9-8b3f-296da37ae3a9 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:52:17.185466 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-75d5cb34-a725-42b9-8b3f-296da37ae3a9 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "POST /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b/action" status: 400 len: 619 microversion: 2.1 time: 0.020028 Sep 24 20:52:17.186062 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 348/732] 10.222.0.52 () {60 vars in 1279 bytes} [Sat Sep 24 20:52:17 2022] POST /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b/action => generated 619 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 20:52:17.200301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0e0b2682-ebb5-4c01-b8ec-3baa297b500a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:17.203588 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0e0b2682-ebb5-4c01-b8ec-3baa297b500a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:17.212290 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e0b2682-ebb5-4c01-b8ec-3baa297b500a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:17.213026 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e0b2682-ebb5-4c01-b8ec-3baa297b500a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:17.213880 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e0b2682-ebb5-4c01-b8ec-3baa297b500a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:17.214820 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e0b2682-ebb5-4c01-b8ec-3baa297b500a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:17.215532 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e0b2682-ebb5-4c01-b8ec-3baa297b500a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:17.216118 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e0b2682-ebb5-4c01-b8ec-3baa297b500a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:17.332963 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0b6ddbce-3448-4412-acf0-0cf9bd78027f tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1613 microversion: 2.1 time: 0.226225 Sep 24 20:52:17.333913 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 385/733] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:17 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1613 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:17.340644 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f6366ef5-7ddd-40f5-8898-36f0e132aa1f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:17.341262 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f6366ef5-7ddd-40f5-8898-36f0e132aa1f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: b4b8b488-a1f1-42fb-b34a-04005d670e7b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:17.349182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6366ef5-7ddd-40f5-8898-36f0e132aa1f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:17.349670 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6366ef5-7ddd-40f5-8898-36f0e132aa1f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:17.350105 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6366ef5-7ddd-40f5-8898-36f0e132aa1f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:17.351622 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6366ef5-7ddd-40f5-8898-36f0e132aa1f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:17.352157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6366ef5-7ddd-40f5-8898-36f0e132aa1f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:17.352590 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6366ef5-7ddd-40f5-8898-36f0e132aa1f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:17.415903 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0e0b2682-ebb5-4c01-b8ec-3baa297b500a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:17.424662 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0e0b2682-ebb5-4c01-b8ec-3baa297b500a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d" status: 200 len: 1503 microversion: 2.1 time: 0.235410 Sep 24 20:52:17.439231 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 349/734] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:17 2022] GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d => generated 1503 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:52:17.446420 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-52e08fb9-ec1a-4e45-9c51-a6d7c18d5091 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:17.447133 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-52e08fb9-ec1a-4e45-9c51-a6d7c18d5091 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:17.460711 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52e08fb9-ec1a-4e45-9c51-a6d7c18d5091 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:17.461320 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52e08fb9-ec1a-4e45-9c51-a6d7c18d5091 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:17.461773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52e08fb9-ec1a-4e45-9c51-a6d7c18d5091 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:17.462530 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52e08fb9-ec1a-4e45-9c51-a6d7c18d5091 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:17.465136 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52e08fb9-ec1a-4e45-9c51-a6d7c18d5091 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:17.465592 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52e08fb9-ec1a-4e45-9c51-a6d7c18d5091 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:17.555219 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f6366ef5-7ddd-40f5-8898-36f0e132aa1f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:17.563856 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f6366ef5-7ddd-40f5-8898-36f0e132aa1f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b" status: 200 len: 1521 microversion: 2.1 time: 0.228909 Sep 24 20:52:17.578865 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 386/735] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:17 2022] GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:17.588347 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7703beb3-af26-4441-b73a-a5feba7c7f75 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:17.588985 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7703beb3-af26-4441-b73a-a5feba7c7f75 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 625f5fd3-d872-4da5-b176-5a70dfd8cfe2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:17.595092 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7703beb3-af26-4441-b73a-a5feba7c7f75 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:17.595582 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7703beb3-af26-4441-b73a-a5feba7c7f75 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:17.596021 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7703beb3-af26-4441-b73a-a5feba7c7f75 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:17.596722 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7703beb3-af26-4441-b73a-a5feba7c7f75 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:17.597177 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7703beb3-af26-4441-b73a-a5feba7c7f75 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:17.598055 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7703beb3-af26-4441-b73a-a5feba7c7f75 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:17.629291 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-52e08fb9-ec1a-4e45-9c51-a6d7c18d5091 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1613 microversion: 2.1 time: 0.189025 Sep 24 20:52:17.630551 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 350/736] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:17 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1613 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:17.636439 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-261b9694-8bfe-40ce-8cd4-90cf1e5e7742 req-5020590e-ded4-4acd-8ae1-8cae93067445 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a74d1c4c-d757-4879-a35d-9f817ea6e28b", "name": "network-vif-plugged", "status": "completed", "tag": "b6ab8620-4ae6-45bc-8b07-7059b14738de"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:17.647927 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-261b9694-8bfe-40ce-8cd4-90cf1e5e7742 req-5020590e-ded4-4acd-8ae1-8cae93067445 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:17.648599 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-261b9694-8bfe-40ce-8cd4-90cf1e5e7742 req-5020590e-ded4-4acd-8ae1-8cae93067445 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:17.649223 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-261b9694-8bfe-40ce-8cd4-90cf1e5e7742 req-5020590e-ded4-4acd-8ae1-8cae93067445 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:17.661186 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-261b9694-8bfe-40ce-8cd4-90cf1e5e7742 req-5020590e-ded4-4acd-8ae1-8cae93067445 service nova] Creating event network-vif-plugged:b6ab8620-4ae6-45bc-8b07-7059b14738de for instance a74d1c4c-d757-4879-a35d-9f817ea6e28b on nch1-master-1 Sep 24 20:52:17.666743 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-261b9694-8bfe-40ce-8cd4-90cf1e5e7742 req-5020590e-ded4-4acd-8ae1-8cae93067445 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034809 Sep 24 20:52:17.667712 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 351/737] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:52:17.672994 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cd437a35-b6be-4e86-8b96-5f484f5f0fdf tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:17.673705 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cd437a35-b6be-4e86-8b96-5f484f5f0fdf tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:17.681126 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd437a35-b6be-4e86-8b96-5f484f5f0fdf tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:17.681637 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd437a35-b6be-4e86-8b96-5f484f5f0fdf tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:17.682083 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd437a35-b6be-4e86-8b96-5f484f5f0fdf tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:17.682840 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd437a35-b6be-4e86-8b96-5f484f5f0fdf tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:17.683310 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd437a35-b6be-4e86-8b96-5f484f5f0fdf tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:17.683941 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd437a35-b6be-4e86-8b96-5f484f5f0fdf tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:17.799915 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cd437a35-b6be-4e86-8b96-5f484f5f0fdf tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:17.806531 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7703beb3-af26-4441-b73a-a5feba7c7f75 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278977b201c48dda2d73823fbfe4833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a31be22cc451b92af447ed8d81242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:17.808987 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cd437a35-b6be-4e86-8b96-5f484f5f0fdf tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:17.810470 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cd437a35-b6be-4e86-8b96-5f484f5f0fdf tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:17.815245 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7703beb3-af26-4441-b73a-a5feba7c7f75 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2" status: 200 len: 1589 microversion: 2.1 time: 0.235317 Sep 24 20:52:17.815898 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cd437a35-b6be-4e86-8b96-5f484f5f0fdf tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.146896 Sep 24 20:52:17.816031 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 387/738] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:17 2022] GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2 => generated 1589 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:17.816514 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 352/739] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:17 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:17.821518 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c99ba1af-2682-46c2-8e5b-7c2a73fb19da tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:17.821768 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c605d49f-ce02-4ce0-bf84-883c4e7e13b7 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:17.822289 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c99ba1af-2682-46c2-8e5b-7c2a73fb19da tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: b4b8b488-a1f1-42fb-b34a-04005d670e7b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:17.822392 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c605d49f-ce02-4ce0-bf84-883c4e7e13b7 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a74d1c4c-d757-4879-a35d-9f817ea6e28b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:17.829343 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c605d49f-ce02-4ce0-bf84-883c4e7e13b7 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:17.829847 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c605d49f-ce02-4ce0-bf84-883c4e7e13b7 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:17.830290 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c605d49f-ce02-4ce0-bf84-883c4e7e13b7 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:17.831043 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c605d49f-ce02-4ce0-bf84-883c4e7e13b7 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:17.831505 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c605d49f-ce02-4ce0-bf84-883c4e7e13b7 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:17.831938 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c605d49f-ce02-4ce0-bf84-883c4e7e13b7 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:17.838332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c99ba1af-2682-46c2-8e5b-7c2a73fb19da tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:17.839253 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c99ba1af-2682-46c2-8e5b-7c2a73fb19da tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:17.839840 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c99ba1af-2682-46c2-8e5b-7c2a73fb19da tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:17.840632 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c99ba1af-2682-46c2-8e5b-7c2a73fb19da tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:17.841259 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c99ba1af-2682-46c2-8e5b-7c2a73fb19da tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:17.841778 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c99ba1af-2682-46c2-8e5b-7c2a73fb19da tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:18.041281 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c605d49f-ce02-4ce0-bf84-883c4e7e13b7 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:18.044384 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c99ba1af-2682-46c2-8e5b-7c2a73fb19da tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:18.049394 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c605d49f-ce02-4ce0-bf84-883c4e7e13b7 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a74d1c4c-d757-4879-a35d-9f817ea6e28b" status: 200 len: 1317 microversion: 2.1 time: 0.231700 Sep 24 20:52:18.050161 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 388/740] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:17 2022] GET /compute/v2.1/servers/a74d1c4c-d757-4879-a35d-9f817ea6e28b => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:18.052801 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c99ba1af-2682-46c2-8e5b-7c2a73fb19da tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b" status: 200 len: 1521 microversion: 2.1 time: 0.235285 Sep 24 20:52:18.062038 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 353/741] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:17 2022] GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:18.062175 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8b466eb9-8379-475c-a94a-135cbea2015b tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:18.062175 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8b466eb9-8379-475c-a94a-135cbea2015b tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Searching by: {'host': 'nch2-master-1', 'deleted': False} {{(pid=140516) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 20:52:18.065938 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8b466eb9-8379-475c-a94a-135cbea2015b tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:18.066420 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8b466eb9-8379-475c-a94a-135cbea2015b tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:18.066875 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4fd0a2c5-5285-4ee7-870d-c04d0912bc1f tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:18.066998 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8b466eb9-8379-475c-a94a-135cbea2015b tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:18.067495 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4fd0a2c5-5285-4ee7-870d-c04d0912bc1f tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 625f5fd3-d872-4da5-b176-5a70dfd8cfe2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:18.067612 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8b466eb9-8379-475c-a94a-135cbea2015b tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:18.068036 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8b466eb9-8379-475c-a94a-135cbea2015b tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:18.068458 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8b466eb9-8379-475c-a94a-135cbea2015b tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:18.074775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4fd0a2c5-5285-4ee7-870d-c04d0912bc1f tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:18.075270 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4fd0a2c5-5285-4ee7-870d-c04d0912bc1f tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:18.075714 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4fd0a2c5-5285-4ee7-870d-c04d0912bc1f tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:18.076467 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4fd0a2c5-5285-4ee7-870d-c04d0912bc1f tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:18.076933 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4fd0a2c5-5285-4ee7-870d-c04d0912bc1f tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:18.077396 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4fd0a2c5-5285-4ee7-870d-c04d0912bc1f tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:18.161103 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4fd0a2c5-5285-4ee7-870d-c04d0912bc1f tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106248 Sep 24 20:52:18.161743 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 354/742] 10.222.0.52 () {58 vars in 1275 bytes} [Sat Sep 24 20:52:18 2022] GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:52:18.162868 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.multi_cell_list [None req-8b466eb9-8379-475c-a94a-135cbea2015b tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Listed batch of 8 results from cell out of 1000 limit. Returned 8 total so far. {{(pid=140516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 20:52:18.166905 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-828548dd-59ba-44c2-9444-cd9a1e5e71b0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1458870546"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:18.169803 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-828548dd-59ba-44c2-9444-cd9a1e5e71b0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: b4b8b488-a1f1-42fb-b34a-04005d670e7b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:18.176112 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-828548dd-59ba-44c2-9444-cd9a1e5e71b0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:18.176609 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-828548dd-59ba-44c2-9444-cd9a1e5e71b0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:18.177612 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-828548dd-59ba-44c2-9444-cd9a1e5e71b0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:18.177814 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-828548dd-59ba-44c2-9444-cd9a1e5e71b0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:18.178767 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-828548dd-59ba-44c2-9444-cd9a1e5e71b0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:18.179213 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-828548dd-59ba-44c2-9444-cd9a1e5e71b0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:18.227235 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8b466eb9-8379-475c-a94a-135cbea2015b tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] 10.222.0.52 "GET /compute/v2.1/servers?host=nch2-master-1&all_tenants=1" status: 200 len: 2641 microversion: 2.1 time: 0.176172 Sep 24 20:52:18.236316 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 389/743] 10.222.0.52 () {58 vars in 1190 bytes} [Sat Sep 24 20:52:18 2022] GET /compute/v2.1/servers?host=nch2-master-1&all_tenants=1 => generated 2641 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:18.236316 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-90cc16a1-de63-4b8a-abfb-817699044f48 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:18.236316 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-90cc16a1-de63-4b8a-abfb-817699044f48 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:18.242734 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-90cc16a1-de63-4b8a-abfb-817699044f48 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:18.243241 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-90cc16a1-de63-4b8a-abfb-817699044f48 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:18.243686 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-90cc16a1-de63-4b8a-abfb-817699044f48 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:18.244405 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-90cc16a1-de63-4b8a-abfb-817699044f48 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:18.244869 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-90cc16a1-de63-4b8a-abfb-817699044f48 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:18.245301 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-90cc16a1-de63-4b8a-abfb-817699044f48 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:18.394181 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-828548dd-59ba-44c2-9444-cd9a1e5e71b0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "POST /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b/action" status: 202 len: 0 microversion: 2.1 time: 0.231154 Sep 24 20:52:18.395053 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 355/744] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:52:18 2022] POST /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 24 20:52:18.400775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c19a57e3-a4ba-4330-a405-40db52bf22b0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:18.401444 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c19a57e3-a4ba-4330-a405-40db52bf22b0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:18.407706 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c19a57e3-a4ba-4330-a405-40db52bf22b0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:18.408188 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c19a57e3-a4ba-4330-a405-40db52bf22b0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:18.408623 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c19a57e3-a4ba-4330-a405-40db52bf22b0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:18.409321 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c19a57e3-a4ba-4330-a405-40db52bf22b0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:18.409771 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c19a57e3-a4ba-4330-a405-40db52bf22b0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:18.410209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c19a57e3-a4ba-4330-a405-40db52bf22b0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:18.554111 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-90cc16a1-de63-4b8a-abfb-817699044f48 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:18.562536 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-90cc16a1-de63-4b8a-abfb-817699044f48 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1475 microversion: 2.1 time: 0.333287 Sep 24 20:52:18.563141 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 390/745] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:18 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1475 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:18.573552 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c21d6464-adf2-489e-9bf7-09930d049bb8 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:18.579474 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c21d6464-adf2-489e-9bf7-09930d049bb8 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=140516) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 20:52:18.584275 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c21d6464-adf2-489e-9bf7-09930d049bb8 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:18.585280 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c21d6464-adf2-489e-9bf7-09930d049bb8 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:18.585904 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c21d6464-adf2-489e-9bf7-09930d049bb8 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:18.586669 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c21d6464-adf2-489e-9bf7-09930d049bb8 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:18.587135 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c21d6464-adf2-489e-9bf7-09930d049bb8 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:18.587575 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c21d6464-adf2-489e-9bf7-09930d049bb8 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:18.608034 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c21d6464-adf2-489e-9bf7-09930d049bb8 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] 10.222.0.52 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.043756 Sep 24 20:52:18.608947 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 391/746] 10.222.0.52 () {58 vars in 1196 bytes} [Sat Sep 24 20:52:18 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:52:18.620435 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c4a78a08-bcfe-48ed-b116-f8821f051a33 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1612860825"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:18.623107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c4a78a08-bcfe-48ed-b116-f8821f051a33 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: b4b8b488-a1f1-42fb-b34a-04005d670e7b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:18.634593 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4a78a08-bcfe-48ed-b116-f8821f051a33 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:18.634593 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4a78a08-bcfe-48ed-b116-f8821f051a33 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:18.634593 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4a78a08-bcfe-48ed-b116-f8821f051a33 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:18.634593 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4a78a08-bcfe-48ed-b116-f8821f051a33 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:18.635094 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4a78a08-bcfe-48ed-b116-f8821f051a33 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:18.635094 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4a78a08-bcfe-48ed-b116-f8821f051a33 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:18.665358 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-c4a78a08-bcfe-48ed-b116-f8821f051a33 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] HTTP exception thrown: Cannot 'createImage' instance b4b8b488-a1f1-42fb-b34a-04005d670e7b while it is in task_state image_snapshot_pending Sep 24 20:52:18.667053 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c4a78a08-bcfe-48ed-b116-f8821f051a33 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Request method failure captured: Sep 24 20:52:18.667053 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b/action HTTP/1.1 Sep 24 20:52:18.667053 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:52:18.667053 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:52:18.667053 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:52:18.667053 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 85 Sep 24 20:52:18.667053 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:52:18.667053 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:52:18.667053 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:52:18.667053 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:52:18.667053 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL23hSaMAKT8B-JdjtYs2UoED1UAMalIeRO9Th3athHCHzrGhfs9Sy0_hBzkoXpxV7aas8iy4VFycxPqE3-ST396dY35DaR9MZAQlds-eQBPgVm84hG8pTTOjeXtJegh8tOCUNbJFm6JLpFNRAi1C2IykufgxtCoO69ROBtQmrT9YEmI Sep 24 20:52:18.667053 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:52:18.667053 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:52:18.667053 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:52:18.667053 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:52:18.667053 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:52:18.667053 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:52:18.667053 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: e175cb4032ec4e6aa900141abbaa04c4 Sep 24 20:52:18.667053 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:52:18.667053 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:52:18.667053 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:52:18.668595 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:52:18.668595 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:52:18.668595 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: e175cb4032ec4e6aa900141abbaa04c4 Sep 24 20:52:18.668595 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:52:18.668595 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ImagesOneServerNegativeTestJSON-1825846347-project Sep 24 20:52:18.668595 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:52:18.668595 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:52:18.668595 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 6db52cb259fa426d860f9c9a48a149f3 Sep 24 20:52:18.668595 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347-project Sep 24 20:52:18.668595 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 20:52:18.668595 ncdv-master-1 devstack@n-api.service[140516]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1612860825"}} Sep 24 20:52:18.668595 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:52:18.669496 ncdv-master-1 devstack@n-api.service[140516]: exception: Cannot 'createImage' instance b4b8b488-a1f1-42fb-b34a-04005d670e7b while it is in task_state image_snapshot_pending Sep 24 20:52:18.669496 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'b4b8b488-a1f1-42fb-b34a-04005d670e7b', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1612860825'}}} Sep 24 20:52:18.669496 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:52:18.669496 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:52:18.669496 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Sep 24 20:52:18.669496 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Sep 24 20:52:18.669496 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Sep 24 20:52:18.669496 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 24 20:52:18.669496 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b4b8b488-a1f1-42fb-b34a-04005d670e7b in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Sep 24 20:52:18.669496 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:52:18.669496 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:52:18.669496 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:52:18.669496 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:52:18.669496 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:52:18.669496 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:52:18.669496 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:52:18.669496 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:52:18.669496 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:52:18.669496 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:52:18.671343 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:52:18.671343 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:52:18.671343 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:52:18.671343 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:52:18.671343 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Sep 24 20:52:18.671343 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 24 20:52:18.671343 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 24 20:52:18.671343 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 24 20:52:18.671343 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance b4b8b488-a1f1-42fb-b34a-04005d670e7b while it is in task_state image_snapshot_pending Sep 24 20:52:18.671343 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:52:18.671343 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:52:18.671343 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:52:18.671343 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:52:18.671343 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:52:18.671343 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:52:18.671343 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:52:18.671343 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:52:18.671343 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance b4b8b488-a1f1-42fb-b34a-04005d670e7b while it is in task_state image_snapshot_pending Sep 24 20:52:18.671343 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:52:18.673254 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c4a78a08-bcfe-48ed-b116-f8821f051a33 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Returning 409 to user: Cannot 'createImage' instance b4b8b488-a1f1-42fb-b34a-04005d670e7b while it is in task_state image_snapshot_pending {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:52:18.673254 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c4a78a08-bcfe-48ed-b116-f8821f051a33 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "POST /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b/action" status: 409 len: 167 microversion: 2.1 time: 0.058503 Sep 24 20:52:18.673254 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 392/747] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:52:18 2022] POST /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b/action => generated 167 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 24 20:52:18.674317 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d99c4150-4ea7-410b-9949-9abd115acde7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:18.674968 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d99c4150-4ea7-410b-9949-9abd115acde7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:18.681109 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d99c4150-4ea7-410b-9949-9abd115acde7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:18.681598 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d99c4150-4ea7-410b-9949-9abd115acde7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:18.682033 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d99c4150-4ea7-410b-9949-9abd115acde7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:18.682779 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d99c4150-4ea7-410b-9949-9abd115acde7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:18.683219 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d99c4150-4ea7-410b-9949-9abd115acde7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:18.683644 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d99c4150-4ea7-410b-9949-9abd115acde7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:18.713569 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c19a57e3-a4ba-4330-a405-40db52bf22b0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:18.722266 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c19a57e3-a4ba-4330-a405-40db52bf22b0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:18.723850 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c19a57e3-a4ba-4330-a405-40db52bf22b0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:18.725046 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c19a57e3-a4ba-4330-a405-40db52bf22b0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e" status: 200 len: 1361 microversion: 2.25 time: 0.328958 Sep 24 20:52:18.726339 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 356/748] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:18 2022] GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e => generated 1361 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:18.731039 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9ab370f7-ecbc-43d1-bee4-667d52cdf3ce tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:18.733412 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9ab370f7-ecbc-43d1-bee4-667d52cdf3ce tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:18.739879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ab370f7-ecbc-43d1-bee4-667d52cdf3ce tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:18.740479 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ab370f7-ecbc-43d1-bee4-667d52cdf3ce tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:18.741017 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ab370f7-ecbc-43d1-bee4-667d52cdf3ce tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:18.741806 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ab370f7-ecbc-43d1-bee4-667d52cdf3ce tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:18.742344 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ab370f7-ecbc-43d1-bee4-667d52cdf3ce tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:18.742867 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ab370f7-ecbc-43d1-bee4-667d52cdf3ce tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:18.760748 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:18.827782 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9ab370f7-ecbc-43d1-bee4-667d52cdf3ce tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a/action" status: 202 len: 0 microversion: 2.1 time: 0.100214 Sep 24 20:52:18.831685 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 357/749] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:52:18 2022] POST /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:52:18.833750 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6dd17e3c-422b-463e-846d-323955732634 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '.version_select at 0x7f4b0cd8f160>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:18.944872 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=6 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:18.970523 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6dd17e3c-422b-463e-846d-323955732634 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "DELETE /compute/v2.1/images/1bed2b7f-72b2-4601-a6c9-62e647355ee5" status: 204 len: 0 microversion: 2.1 time: 0.140811 Sep 24 20:52:18.971118 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 358/750] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:18 2022] DELETE /compute/v2.1/images/1bed2b7f-72b2-4601-a6c9-62e647355ee5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:52:18.976506 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4360296a-bd2f-4c9d-8ddd-e09ff79015e6 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:18.979231 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4360296a-bd2f-4c9d-8ddd-e09ff79015e6 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:18.985576 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4360296a-bd2f-4c9d-8ddd-e09ff79015e6 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:18.986060 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4360296a-bd2f-4c9d-8ddd-e09ff79015e6 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:18.986526 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4360296a-bd2f-4c9d-8ddd-e09ff79015e6 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:18.987244 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4360296a-bd2f-4c9d-8ddd-e09ff79015e6 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:18.987709 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4360296a-bd2f-4c9d-8ddd-e09ff79015e6 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:18.988132 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4360296a-bd2f-4c9d-8ddd-e09ff79015e6 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:19.073642 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-4360296a-bd2f-4c9d-8ddd-e09ff79015e6 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:52:19.074247 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-4360296a-bd2f-4c9d-8ddd-e09ff79015e6 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:52:19.074928 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-4360296a-bd2f-4c9d-8ddd-e09ff79015e6 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:52:19.075795 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-4360296a-bd2f-4c9d-8ddd-e09ff79015e6 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:52:19.075940 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-4360296a-bd2f-4c9d-8ddd-e09ff79015e6 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:52:19.165717 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=8 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:19.167194 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4360296a-bd2f-4c9d-8ddd-e09ff79015e6 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:19.173664 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4360296a-bd2f-4c9d-8ddd-e09ff79015e6 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:19.174160 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4360296a-bd2f-4c9d-8ddd-e09ff79015e6 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:19.174692 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4360296a-bd2f-4c9d-8ddd-e09ff79015e6 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:19.175358 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4360296a-bd2f-4c9d-8ddd-e09ff79015e6 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:19.175819 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4360296a-bd2f-4c9d-8ddd-e09ff79015e6 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:19.176252 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4360296a-bd2f-4c9d-8ddd-e09ff79015e6 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:19.208941 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d99c4150-4ea7-410b-9949-9abd115acde7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:19.211722 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4360296a-bd2f-4c9d-8ddd-e09ff79015e6 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "POST /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a/action" status: 202 len: 1066 microversion: 2.1 time: 0.239505 Sep 24 20:52:19.226130 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 359/751] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:52:18 2022] POST /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a/action => generated 1066 bytes in 243 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 24 20:52:19.226561 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d99c4150-4ea7-410b-9949-9abd115acde7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d" status: 200 len: 1503 microversion: 2.1 time: 0.547177 Sep 24 20:52:19.226678 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-31bd6bc8-20c3-4d2a-a334-335f30922981 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:19.226678 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-31bd6bc8-20c3-4d2a-a334-335f30922981 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:19.231416 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-31bd6bc8-20c3-4d2a-a334-335f30922981 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:19.231921 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-31bd6bc8-20c3-4d2a-a334-335f30922981 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:19.232419 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-31bd6bc8-20c3-4d2a-a334-335f30922981 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:19.233321 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-31bd6bc8-20c3-4d2a-a334-335f30922981 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:19.233964 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-31bd6bc8-20c3-4d2a-a334-335f30922981 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:19.234406 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-31bd6bc8-20c3-4d2a-a334-335f30922981 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:19.248537 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 393/752] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:18 2022] GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d => generated 1503 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:19.276474 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d79ad8d5-b553-42b9-854b-5db8b1aff135 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:19.277108 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d79ad8d5-b553-42b9-854b-5db8b1aff135 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: b4b8b488-a1f1-42fb-b34a-04005d670e7b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:19.287668 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d79ad8d5-b553-42b9-854b-5db8b1aff135 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:19.288168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d79ad8d5-b553-42b9-854b-5db8b1aff135 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:19.288772 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d79ad8d5-b553-42b9-854b-5db8b1aff135 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:19.289516 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d79ad8d5-b553-42b9-854b-5db8b1aff135 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:19.289986 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d79ad8d5-b553-42b9-854b-5db8b1aff135 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:19.290487 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d79ad8d5-b553-42b9-854b-5db8b1aff135 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:19.346828 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-31bd6bc8-20c3-4d2a-a334-335f30922981 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:19.358607 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-31bd6bc8-20c3-4d2a-a334-335f30922981 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:19.361045 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-31bd6bc8-20c3-4d2a-a334-335f30922981 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:19.367518 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-31bd6bc8-20c3-4d2a-a334-335f30922981 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.151421 Sep 24 20:52:19.368327 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 360/753] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:19 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:19.373719 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-51807b0e-68df-4873-97ad-184ce441a968 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:19.374352 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-51807b0e-68df-4873-97ad-184ce441a968 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a74d1c4c-d757-4879-a35d-9f817ea6e28b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:19.380937 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-51807b0e-68df-4873-97ad-184ce441a968 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:19.382031 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-51807b0e-68df-4873-97ad-184ce441a968 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:19.382555 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-51807b0e-68df-4873-97ad-184ce441a968 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:19.383368 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-51807b0e-68df-4873-97ad-184ce441a968 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:19.383837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-51807b0e-68df-4873-97ad-184ce441a968 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:19.384308 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-51807b0e-68df-4873-97ad-184ce441a968 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:19.687129 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d79ad8d5-b553-42b9-854b-5db8b1aff135 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:19.699458 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d79ad8d5-b553-42b9-854b-5db8b1aff135 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b" status: 200 len: 1533 microversion: 2.1 time: 0.449309 Sep 24 20:52:19.701304 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 394/754] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:19 2022] GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b => generated 1533 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:19.706781 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c9aa6fca-d870-4a6d-a869-9e1183176175 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:19.707598 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c9aa6fca-d870-4a6d-a869-9e1183176175 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:19.716833 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c9aa6fca-d870-4a6d-a869-9e1183176175 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:19.717631 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c9aa6fca-d870-4a6d-a869-9e1183176175 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:19.718387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c9aa6fca-d870-4a6d-a869-9e1183176175 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:19.719346 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c9aa6fca-d870-4a6d-a869-9e1183176175 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:19.719968 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c9aa6fca-d870-4a6d-a869-9e1183176175 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:19.721175 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c9aa6fca-d870-4a6d-a869-9e1183176175 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:19.734918 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-51807b0e-68df-4873-97ad-184ce441a968 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:19.749894 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-51807b0e-68df-4873-97ad-184ce441a968 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a74d1c4c-d757-4879-a35d-9f817ea6e28b" status: 200 len: 1467 microversion: 2.1 time: 0.379538 Sep 24 20:52:19.751155 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 361/755] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:19 2022] GET /compute/v2.1/servers/a74d1c4c-d757-4879-a35d-9f817ea6e28b => generated 1467 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:19.765874 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ecd77dde-aa06-4dc6-a8fc-f3b181c29370 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:19.769962 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ecd77dde-aa06-4dc6-a8fc-f3b181c29370 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:19.789552 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ecd77dde-aa06-4dc6-a8fc-f3b181c29370 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:19.790324 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ecd77dde-aa06-4dc6-a8fc-f3b181c29370 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:19.791085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ecd77dde-aa06-4dc6-a8fc-f3b181c29370 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:19.792345 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ecd77dde-aa06-4dc6-a8fc-f3b181c29370 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:19.794427 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ecd77dde-aa06-4dc6-a8fc-f3b181c29370 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:19.795140 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ecd77dde-aa06-4dc6-a8fc-f3b181c29370 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:20.096643 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c9aa6fca-d870-4a6d-a869-9e1183176175 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:20.108327 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c9aa6fca-d870-4a6d-a869-9e1183176175 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1470 microversion: 2.1 time: 0.405644 Sep 24 20:52:20.108867 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ecd77dde-aa06-4dc6-a8fc-f3b181c29370 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:20.109401 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 395/756] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:19 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1470 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:20.114959 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-3a6cd16b-6477-40c4-8dfb-f6409d24e5f2 req-83f66603-8263-4060-923b-f945420c8d15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dc2952a-aad1-40d0-bd55-87c6b3b9618d", "name": "network-vif-unplugged", "status": "completed", "tag": "092b1380-825b-4d02-bb2f-0dda7ef94e2e"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:20.129934 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-3a6cd16b-6477-40c4-8dfb-f6409d24e5f2 req-83f66603-8263-4060-923b-f945420c8d15 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:20.130421 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-3a6cd16b-6477-40c4-8dfb-f6409d24e5f2 req-83f66603-8263-4060-923b-f945420c8d15 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:20.131121 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ecd77dde-aa06-4dc6-a8fc-f3b181c29370 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1475 microversion: 2.1 time: 0.377989 Sep 24 20:52:20.131248 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-3a6cd16b-6477-40c4-8dfb-f6409d24e5f2 req-83f66603-8263-4060-923b-f945420c8d15 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:20.133406 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 362/757] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:19 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1475 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:20.140496 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-89e2a1dd-77b9-4dd5-80ce-f5e66e634ce3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:20.141870 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-89e2a1dd-77b9-4dd5-80ce-f5e66e634ce3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:20.151864 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-89e2a1dd-77b9-4dd5-80ce-f5e66e634ce3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:20.152553 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-89e2a1dd-77b9-4dd5-80ce-f5e66e634ce3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:20.153320 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-89e2a1dd-77b9-4dd5-80ce-f5e66e634ce3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:20.154187 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-89e2a1dd-77b9-4dd5-80ce-f5e66e634ce3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:20.154821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-89e2a1dd-77b9-4dd5-80ce-f5e66e634ce3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:20.155402 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-89e2a1dd-77b9-4dd5-80ce-f5e66e634ce3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:20.159707 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-3a6cd16b-6477-40c4-8dfb-f6409d24e5f2 req-83f66603-8263-4060-923b-f945420c8d15 service nova] Creating event network-vif-unplugged:092b1380-825b-4d02-bb2f-0dda7ef94e2e for instance 5dc2952a-aad1-40d0-bd55-87c6b3b9618d on nch1-master-1 Sep 24 20:52:20.164952 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-3a6cd16b-6477-40c4-8dfb-f6409d24e5f2 req-83f66603-8263-4060-923b-f945420c8d15 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054172 Sep 24 20:52:20.166142 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 396/758] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:52:20.229062 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0456882c-9a82-4392-a470-c9212811c1f6 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:20.231383 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0456882c-9a82-4392-a470-c9212811c1f6 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] [instance: a74d1c4c-d757-4879-a35d-9f817ea6e28b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:20.238623 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0456882c-9a82-4392-a470-c9212811c1f6 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:20.239929 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0456882c-9a82-4392-a470-c9212811c1f6 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:20.241217 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0456882c-9a82-4392-a470-c9212811c1f6 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:20.242317 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0456882c-9a82-4392-a470-c9212811c1f6 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:20.242972 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0456882c-9a82-4392-a470-c9212811c1f6 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:20.243651 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0456882c-9a82-4392-a470-c9212811c1f6 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:20.461985 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-89e2a1dd-77b9-4dd5-80ce-f5e66e634ce3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:20.475908 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-89e2a1dd-77b9-4dd5-80ce-f5e66e634ce3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:20.478024 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-89e2a1dd-77b9-4dd5-80ce-f5e66e634ce3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:20.480157 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-89e2a1dd-77b9-4dd5-80ce-f5e66e634ce3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e" status: 200 len: 1361 microversion: 2.25 time: 0.344776 Sep 24 20:52:20.481346 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 363/759] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:20 2022] GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e => generated 1361 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:20.488136 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-69455bff-1719-46d2-a203-3cdd46caf4f3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:20.489417 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-69455bff-1719-46d2-a203-3cdd46caf4f3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:20.496432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69455bff-1719-46d2-a203-3cdd46caf4f3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:20.497200 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69455bff-1719-46d2-a203-3cdd46caf4f3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:20.497704 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69455bff-1719-46d2-a203-3cdd46caf4f3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:20.498562 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69455bff-1719-46d2-a203-3cdd46caf4f3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:20.499256 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69455bff-1719-46d2-a203-3cdd46caf4f3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:20.499841 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69455bff-1719-46d2-a203-3cdd46caf4f3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:20.707491 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-69455bff-1719-46d2-a203-3cdd46caf4f3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:20.715535 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-69455bff-1719-46d2-a203-3cdd46caf4f3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d" status: 200 len: 1503 microversion: 2.1 time: 0.232700 Sep 24 20:52:20.716149 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 364/760] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:20 2022] GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d => generated 1503 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:20.716688 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0456882c-9a82-4392-a470-c9212811c1f6 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/a74d1c4c-d757-4879-a35d-9f817ea6e28b" status: 200 len: 1618 microversion: 2.1 time: 0.548327 Sep 24 20:52:20.718810 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 397/761] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:20 2022] GET /compute/v2.1/servers/a74d1c4c-d757-4879-a35d-9f817ea6e28b => generated 1618 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:20.727294 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-add8bf1e-1549-4016-92ce-068f9cd9de9c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:20.728042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-add8bf1e-1549-4016-92ce-068f9cd9de9c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 625f5fd3-d872-4da5-b176-5a70dfd8cfe2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:20.734122 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-add8bf1e-1549-4016-92ce-068f9cd9de9c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:20.734961 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-add8bf1e-1549-4016-92ce-068f9cd9de9c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:20.735617 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-add8bf1e-1549-4016-92ce-068f9cd9de9c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:20.736537 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-add8bf1e-1549-4016-92ce-068f9cd9de9c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:20.737203 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-add8bf1e-1549-4016-92ce-068f9cd9de9c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:20.737861 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-add8bf1e-1549-4016-92ce-068f9cd9de9c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:20.738435 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-00cafb1f-5b7c-4f9d-ab4b-2fc200d69f5b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:20.739102 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-00cafb1f-5b7c-4f9d-ab4b-2fc200d69f5b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:20.745801 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00cafb1f-5b7c-4f9d-ab4b-2fc200d69f5b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:20.746297 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00cafb1f-5b7c-4f9d-ab4b-2fc200d69f5b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:20.746848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00cafb1f-5b7c-4f9d-ab4b-2fc200d69f5b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:20.747563 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00cafb1f-5b7c-4f9d-ab4b-2fc200d69f5b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:20.748031 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00cafb1f-5b7c-4f9d-ab4b-2fc200d69f5b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:20.748475 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00cafb1f-5b7c-4f9d-ab4b-2fc200d69f5b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:20.841085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-00cafb1f-5b7c-4f9d-ab4b-2fc200d69f5b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:20.850129 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-00cafb1f-5b7c-4f9d-ab4b-2fc200d69f5b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:20.852186 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-00cafb1f-5b7c-4f9d-ab4b-2fc200d69f5b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:20.857861 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-00cafb1f-5b7c-4f9d-ab4b-2fc200d69f5b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.126087 Sep 24 20:52:20.858439 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 365/762] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:20 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:20.863791 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-197cc7ee-5515-4f87-8854-9d6ed4ef23f0 req-1062ffe3-816b-4e7b-a40f-73a0dda9b7d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "625f5fd3-d872-4da5-b176-5a70dfd8cfe2", "tag": "f81a67af-6fdb-4ade-b541-421cafdc5230"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:20.874256 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-197cc7ee-5515-4f87-8854-9d6ed4ef23f0 req-1062ffe3-816b-4e7b-a40f-73a0dda9b7d8 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:20.875019 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-197cc7ee-5515-4f87-8854-9d6ed4ef23f0 req-1062ffe3-816b-4e7b-a40f-73a0dda9b7d8 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:20.875613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-197cc7ee-5515-4f87-8854-9d6ed4ef23f0 req-1062ffe3-816b-4e7b-a40f-73a0dda9b7d8 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:20.888735 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-197cc7ee-5515-4f87-8854-9d6ed4ef23f0 req-1062ffe3-816b-4e7b-a40f-73a0dda9b7d8 service nova] Creating event network-changed:f81a67af-6fdb-4ade-b541-421cafdc5230 for instance 625f5fd3-d872-4da5-b176-5a70dfd8cfe2 on nch1-master-1 Sep 24 20:52:20.894076 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-197cc7ee-5515-4f87-8854-9d6ed4ef23f0 req-1062ffe3-816b-4e7b-a40f-73a0dda9b7d8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033581 Sep 24 20:52:20.895074 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 366/763] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:52:20.901226 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-043f1f63-129e-4e50-ad58-4a8837643a18 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:20.901831 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-043f1f63-129e-4e50-ad58-4a8837643a18 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: b4b8b488-a1f1-42fb-b34a-04005d670e7b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:20.908119 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-043f1f63-129e-4e50-ad58-4a8837643a18 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:20.908609 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-043f1f63-129e-4e50-ad58-4a8837643a18 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:20.909056 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-043f1f63-129e-4e50-ad58-4a8837643a18 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:20.909768 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-043f1f63-129e-4e50-ad58-4a8837643a18 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:20.910935 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-043f1f63-129e-4e50-ad58-4a8837643a18 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:20.911367 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-043f1f63-129e-4e50-ad58-4a8837643a18 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:20.922231 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-add8bf1e-1549-4016-92ce-068f9cd9de9c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278977b201c48dda2d73823fbfe4833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a31be22cc451b92af447ed8d81242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:20.932687 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-add8bf1e-1549-4016-92ce-068f9cd9de9c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2" status: 200 len: 1589 microversion: 2.1 time: 0.212003 Sep 24 20:52:20.933508 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 398/764] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:20 2022] GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2 => generated 1589 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:20.940626 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6ad8abd1-175b-4b82-936e-ab66c0c40811 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Action: 'create', calling method: .version_select at 0x7f4b0c731c10>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-859500589", "policies": ["affinity"]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:20.959911 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-6ad8abd1-175b-4b82-936e-ab66c0c40811 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Getting quotas for project 73bec7c48b07450f95a29a35e113153d. Resources: {'server_groups'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:52:20.966087 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-6ad8abd1-175b-4b82-936e-ab66c0c40811 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Getting quotas for user 936372eff4da45e281fc5512632a12b6 and project 73bec7c48b07450f95a29a35e113153d. Resources: {'server_groups'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:52:21.033662 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-6ad8abd1-175b-4b82-936e-ab66c0c40811 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Getting quotas for project 73bec7c48b07450f95a29a35e113153d. Resources: {'server_groups'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:52:21.040222 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-6ad8abd1-175b-4b82-936e-ab66c0c40811 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Getting quotas for user 936372eff4da45e281fc5512632a12b6 and project 73bec7c48b07450f95a29a35e113153d. Resources: {'server_groups'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:52:21.054834 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6ad8abd1-175b-4b82-936e-ab66c0c40811 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.120093 Sep 24 20:52:21.066171 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 399/765] 10.222.0.52 () {60 vars in 1174 bytes} [Sat Sep 24 20:52:20 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:52:21.107344 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-02ef731f-d1bb-4c50-9033-3075c95899dd tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-795369364", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "6c51a00c-efd7-44fd-a092-affeb2c54462"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:21.168139 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-02ef731f-d1bb-4c50-9033-3075c95899dd tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] validate_networks() for None {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:52:21.438020 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-043f1f63-129e-4e50-ad58-4a8837643a18 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:21.447872 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-043f1f63-129e-4e50-ad58-4a8837643a18 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b" status: 200 len: 1539 microversion: 2.1 time: 0.551297 Sep 24 20:52:21.448903 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 367/766] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:20 2022] GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b => generated 1539 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:21.453917 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f6dcc71f-1a73-4430-805a-83c9339353cd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:21.454869 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f6dcc71f-1a73-4430-805a-83c9339353cd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:21.461441 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6dcc71f-1a73-4430-805a-83c9339353cd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:21.462211 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6dcc71f-1a73-4430-805a-83c9339353cd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:21.463124 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6dcc71f-1a73-4430-805a-83c9339353cd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:21.464079 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6dcc71f-1a73-4430-805a-83c9339353cd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:21.464828 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6dcc71f-1a73-4430-805a-83c9339353cd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:21.465488 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6dcc71f-1a73-4430-805a-83c9339353cd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:21.824145 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f6dcc71f-1a73-4430-805a-83c9339353cd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:21.832893 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f6dcc71f-1a73-4430-805a-83c9339353cd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1470 microversion: 2.1 time: 0.382658 Sep 24 20:52:21.833473 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 368/767] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:21 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1470 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:21.840728 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-968fc44d-7686-44f5-bf93-c3b6b9c5b7fb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:21.841559 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-968fc44d-7686-44f5-bf93-c3b6b9c5b7fb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:21.849090 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-968fc44d-7686-44f5-bf93-c3b6b9c5b7fb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:21.849809 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-968fc44d-7686-44f5-bf93-c3b6b9c5b7fb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:21.851213 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-968fc44d-7686-44f5-bf93-c3b6b9c5b7fb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:21.852275 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-968fc44d-7686-44f5-bf93-c3b6b9c5b7fb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:21.853016 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-968fc44d-7686-44f5-bf93-c3b6b9c5b7fb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:21.853827 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-968fc44d-7686-44f5-bf93-c3b6b9c5b7fb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:21.907570 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-02ef731f-d1bb-4c50-9033-3075c95899dd tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:52:21.908067 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-02ef731f-d1bb-4c50-9033-3075c95899dd tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:52:21.908647 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-02ef731f-d1bb-4c50-9033-3075c95899dd tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:52:21.909137 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-02ef731f-d1bb-4c50-9033-3075c95899dd tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:52:21.909762 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-02ef731f-d1bb-4c50-9033-3075c95899dd tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:52:21.945327 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-02ef731f-d1bb-4c50-9033-3075c95899dd tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:21.945834 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-02ef731f-d1bb-4c50-9033-3075c95899dd tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:21.946275 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-02ef731f-d1bb-4c50-9033-3075c95899dd tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:21.947066 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-02ef731f-d1bb-4c50-9033-3075c95899dd tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:21.947525 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-02ef731f-d1bb-4c50-9033-3075c95899dd tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:21.947983 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-02ef731f-d1bb-4c50-9033-3075c95899dd tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:21.966171 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-02ef731f-d1bb-4c50-9033-3075c95899dd tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Getting quotas for project 73bec7c48b07450f95a29a35e113153d. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:52:21.972201 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-02ef731f-d1bb-4c50-9033-3075c95899dd tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Getting quotas for user 936372eff4da45e281fc5512632a12b6 and project 73bec7c48b07450f95a29a35e113153d. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:52:21.992065 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-02ef731f-d1bb-4c50-9033-3075c95899dd tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Going to run 2 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:52:21.994582 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-02ef731f-d1bb-4c50-9033-3075c95899dd tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 1de24cda-52fe-42b6-8639-4bb3c77b5eb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:52:22.031999 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-02ef731f-d1bb-4c50-9033-3075c95899dd tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=140516) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 24 20:52:22.051082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-02ef731f-d1bb-4c50-9033-3075c95899dd tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Getting quotas for project 73bec7c48b07450f95a29a35e113153d. Resources: {'server_group_members'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:52:22.056599 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-02ef731f-d1bb-4c50-9033-3075c95899dd tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Getting quotas for user 936372eff4da45e281fc5512632a12b6 and project 73bec7c48b07450f95a29a35e113153d. Resources: {'server_group_members'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:52:22.086670 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-968fc44d-7686-44f5-bf93-c3b6b9c5b7fb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:22.096002 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-968fc44d-7686-44f5-bf93-c3b6b9c5b7fb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1475 microversion: 2.1 time: 0.261241 Sep 24 20:52:22.097023 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 369/768] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:21 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1475 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:22.110766 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-02ef731f-d1bb-4c50-9033-3075c95899dd tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Getting quotas for project 73bec7c48b07450f95a29a35e113153d. Resources: {'server_group_members'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:52:22.110766 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:22.113260 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-02ef731f-d1bb-4c50-9033-3075c95899dd tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Getting quotas for user 936372eff4da45e281fc5512632a12b6 and project 73bec7c48b07450f95a29a35e113153d. Resources: {'server_group_members'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:52:22.119091 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-067fa0da-5983-4d1d-a938-3e17f7dfb6fa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:22.119718 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-067fa0da-5983-4d1d-a938-3e17f7dfb6fa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:22.125736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-067fa0da-5983-4d1d-a938-3e17f7dfb6fa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:22.126243 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-067fa0da-5983-4d1d-a938-3e17f7dfb6fa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:22.126750 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-067fa0da-5983-4d1d-a938-3e17f7dfb6fa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:22.127477 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-067fa0da-5983-4d1d-a938-3e17f7dfb6fa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:22.128163 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-067fa0da-5983-4d1d-a938-3e17f7dfb6fa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:22.128675 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-067fa0da-5983-4d1d-a938-3e17f7dfb6fa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:22.130270 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-02ef731f-d1bb-4c50-9033-3075c95899dd tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: fc6a752b-8418-4657-8e37-3d9259b45d4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=1de24cda-52fe-42b6-8639-4bb3c77b5eb7,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:52:22.182745 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-02ef731f-d1bb-4c50-9033-3075c95899dd tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Getting quotas for project 73bec7c48b07450f95a29a35e113153d. Resources: {'server_group_members'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:52:22.187962 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-02ef731f-d1bb-4c50-9033-3075c95899dd tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Getting quotas for user 936372eff4da45e281fc5512632a12b6 and project 73bec7c48b07450f95a29a35e113153d. Resources: {'server_group_members'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:52:22.224696 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-02ef731f-d1bb-4c50-9033-3075c95899dd tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Getting quotas for project 73bec7c48b07450f95a29a35e113153d. Resources: {'server_group_members'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:52:22.230214 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-02ef731f-d1bb-4c50-9033-3075c95899dd tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Getting quotas for user 936372eff4da45e281fc5512632a12b6 and project 73bec7c48b07450f95a29a35e113153d. Resources: {'server_group_members'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:52:22.266368 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-067fa0da-5983-4d1d-a938-3e17f7dfb6fa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:22.266696 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-02ef731f-d1bb-4c50-9033-3075c95899dd tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.163170 Sep 24 20:52:22.267786 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 400/769] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:52:21 2022] POST /compute/v2.1/servers => generated 32 bytes in 1165 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 24 20:52:22.274599 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-076aaa33-786b-4096-868f-f442f0957e21 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:22.275225 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-076aaa33-786b-4096-868f-f442f0957e21 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:22.280349 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-067fa0da-5983-4d1d-a938-3e17f7dfb6fa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:22.281785 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-076aaa33-786b-4096-868f-f442f0957e21 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:22.282137 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-067fa0da-5983-4d1d-a938-3e17f7dfb6fa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:22.282278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-076aaa33-786b-4096-868f-f442f0957e21 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:22.282816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-076aaa33-786b-4096-868f-f442f0957e21 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:22.283528 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-076aaa33-786b-4096-868f-f442f0957e21 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:22.283670 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-067fa0da-5983-4d1d-a938-3e17f7dfb6fa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e" status: 200 len: 1361 microversion: 2.25 time: 0.171298 Sep 24 20:52:22.283989 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-076aaa33-786b-4096-868f-f442f0957e21 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:22.284454 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 370/770] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:22 2022] GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:22.286875 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-076aaa33-786b-4096-868f-f442f0957e21 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:22.290468 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9ab01501-79e8-4a65-b5c4-4ff01d56b58e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:22.291650 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9ab01501-79e8-4a65-b5c4-4ff01d56b58e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:22.299573 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ab01501-79e8-4a65-b5c4-4ff01d56b58e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:22.300286 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ab01501-79e8-4a65-b5c4-4ff01d56b58e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:22.300886 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ab01501-79e8-4a65-b5c4-4ff01d56b58e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:22.301984 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ab01501-79e8-4a65-b5c4-4ff01d56b58e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:22.302656 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ab01501-79e8-4a65-b5c4-4ff01d56b58e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:22.303943 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ab01501-79e8-4a65-b5c4-4ff01d56b58e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:22.426725 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9ab01501-79e8-4a65-b5c4-4ff01d56b58e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:22.438045 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9ab01501-79e8-4a65-b5c4-4ff01d56b58e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:22.439901 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9ab01501-79e8-4a65-b5c4-4ff01d56b58e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:22.443276 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:22.447680 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9ab01501-79e8-4a65-b5c4-4ff01d56b58e tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.162326 Sep 24 20:52:22.462891 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 371/771] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:22 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:22.474109 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-661327f7-417f-47be-ba09-45f7161c46f6 req-1614ec88-0dbc-40bb-a882-bcca8f2e1ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dc2952a-aad1-40d0-bd55-87c6b3b9618d", "tag": "092b1380-825b-4d02-bb2f-0dda7ef94e2e"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:22.484371 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-661327f7-417f-47be-ba09-45f7161c46f6 req-1614ec88-0dbc-40bb-a882-bcca8f2e1ea9 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:22.484854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-661327f7-417f-47be-ba09-45f7161c46f6 req-1614ec88-0dbc-40bb-a882-bcca8f2e1ea9 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:22.485289 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-661327f7-417f-47be-ba09-45f7161c46f6 req-1614ec88-0dbc-40bb-a882-bcca8f2e1ea9 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:22.489962 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-076aaa33-786b-4096-868f-f442f0957e21 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:22.498283 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-661327f7-417f-47be-ba09-45f7161c46f6 req-1614ec88-0dbc-40bb-a882-bcca8f2e1ea9 service nova] Creating event network-changed:092b1380-825b-4d02-bb2f-0dda7ef94e2e for instance 5dc2952a-aad1-40d0-bd55-87c6b3b9618d on nch1-master-1 Sep 24 20:52:22.504961 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-661327f7-417f-47be-ba09-45f7161c46f6 req-1614ec88-0dbc-40bb-a882-bcca8f2e1ea9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040410 Sep 24 20:52:22.505871 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 372/772] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:52:22.512220 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ee02cca0-7858-4188-bda1-bac8beeb1917 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:22.517290 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ee02cca0-7858-4188-bda1-bac8beeb1917 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:22.518097 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ee02cca0-7858-4188-bda1-bac8beeb1917 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Searching by: {'deleted': False, 'project_id': '73bec7c48b07450f95a29a35e113153d'} {{(pid=140517) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 20:52:22.534109 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-076aaa33-786b-4096-868f-f442f0957e21 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d" status: 200 len: 1503 microversion: 2.1 time: 0.264697 Sep 24 20:52:22.535337 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 401/773] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:22 2022] GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d => generated 1503 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:22.536627 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ee02cca0-7858-4188-bda1-bac8beeb1917 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:22.537125 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ee02cca0-7858-4188-bda1-bac8beeb1917 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:22.537795 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ee02cca0-7858-4188-bda1-bac8beeb1917 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:22.538959 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ee02cca0-7858-4188-bda1-bac8beeb1917 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:22.539419 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ee02cca0-7858-4188-bda1-bac8beeb1917 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:22.539920 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ee02cca0-7858-4188-bda1-bac8beeb1917 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:22.560301 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-61678037-2ff0-468a-835f-783f522af14d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:22.561555 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-61678037-2ff0-468a-835f-783f522af14d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: b4b8b488-a1f1-42fb-b34a-04005d670e7b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:22.572731 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-61678037-2ff0-468a-835f-783f522af14d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:22.573712 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-61678037-2ff0-468a-835f-783f522af14d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:22.574359 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-61678037-2ff0-468a-835f-783f522af14d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:22.575641 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-61678037-2ff0-468a-835f-783f522af14d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:22.576319 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-61678037-2ff0-468a-835f-783f522af14d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:22.577041 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-61678037-2ff0-468a-835f-783f522af14d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:22.611404 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:22.638811 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.multi_cell_list [None req-ee02cca0-7858-4188-bda1-bac8beeb1917 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=140517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 20:52:22.707908 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ee02cca0-7858-4188-bda1-bac8beeb1917 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.200504 Sep 24 20:52:22.708500 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 373/774] 10.222.0.52 () {58 vars in 1125 bytes} [Sat Sep 24 20:52:22 2022] GET /compute/v2.1/servers => generated 1002 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:22.721515 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0d3c8df4-73c6-48c6-96a4-a26bba695948 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:22.722447 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0d3c8df4-73c6-48c6-96a4-a26bba695948 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: fc6a752b-8418-4657-8e37-3d9259b45d4e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:22.816002 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0d3c8df4-73c6-48c6-96a4-a26bba695948 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:22.825449 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0d3c8df4-73c6-48c6-96a4-a26bba695948 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/fc6a752b-8418-4657-8e37-3d9259b45d4e" status: 200 len: 1218 microversion: 2.1 time: 0.108407 Sep 24 20:52:22.826780 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 374/775] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:22 2022] GET /compute/v2.1/servers/fc6a752b-8418-4657-8e37-3d9259b45d4e => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:52:22.857888 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-007a56d0-30a6-414e-bcfb-e2b005ceac03 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:22.858900 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-007a56d0-30a6-414e-bcfb-e2b005ceac03 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:22.864333 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-61678037-2ff0-468a-835f-783f522af14d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:22.870644 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-007a56d0-30a6-414e-bcfb-e2b005ceac03 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:22.871416 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-007a56d0-30a6-414e-bcfb-e2b005ceac03 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:22.872068 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-007a56d0-30a6-414e-bcfb-e2b005ceac03 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:22.873138 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-007a56d0-30a6-414e-bcfb-e2b005ceac03 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:22.873701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-007a56d0-30a6-414e-bcfb-e2b005ceac03 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:22.874177 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-61678037-2ff0-468a-835f-783f522af14d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b" status: 200 len: 1539 microversion: 2.1 time: 0.324795 Sep 24 20:52:22.874302 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-007a56d0-30a6-414e-bcfb-e2b005ceac03 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:22.886907 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 402/776] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:22 2022] GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b => generated 1539 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:23.097646 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-007a56d0-30a6-414e-bcfb-e2b005ceac03 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:23.106478 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-007a56d0-30a6-414e-bcfb-e2b005ceac03 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1470 microversion: 2.1 time: 0.252831 Sep 24 20:52:23.107194 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 375/777] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:22 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1470 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:23.124660 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-48e1cc8c-23ca-4164-9f71-6b5307ed1c47 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:23.125477 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-48e1cc8c-23ca-4164-9f71-6b5307ed1c47 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:23.134013 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-48e1cc8c-23ca-4164-9f71-6b5307ed1c47 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:23.134859 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-48e1cc8c-23ca-4164-9f71-6b5307ed1c47 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:23.135838 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-48e1cc8c-23ca-4164-9f71-6b5307ed1c47 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:23.136338 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-48e1cc8c-23ca-4164-9f71-6b5307ed1c47 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:23.137683 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-48e1cc8c-23ca-4164-9f71-6b5307ed1c47 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:23.138392 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-48e1cc8c-23ca-4164-9f71-6b5307ed1c47 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:23.311581 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-11c3aacb-470b-4b26-af78-4b7b4e09652a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:23.312269 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-11c3aacb-470b-4b26-af78-4b7b4e09652a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:23.323401 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-11c3aacb-470b-4b26-af78-4b7b4e09652a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:23.324195 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-11c3aacb-470b-4b26-af78-4b7b4e09652a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:23.324647 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-11c3aacb-470b-4b26-af78-4b7b4e09652a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:23.325566 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-11c3aacb-470b-4b26-af78-4b7b4e09652a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:23.326118 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-11c3aacb-470b-4b26-af78-4b7b4e09652a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:23.327058 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-11c3aacb-470b-4b26-af78-4b7b4e09652a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:23.425167 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-48e1cc8c-23ca-4164-9f71-6b5307ed1c47 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:23.434211 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-48e1cc8c-23ca-4164-9f71-6b5307ed1c47 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1475 microversion: 2.1 time: 0.313406 Sep 24 20:52:23.447005 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 403/778] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:23 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1475 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:23.480397 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0c0ff14c-af7a-4d14-87ff-7e446156b7a3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:23.481263 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0c0ff14c-af7a-4d14-87ff-7e446156b7a3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:23.487810 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0c0ff14c-af7a-4d14-87ff-7e446156b7a3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:23.488308 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0c0ff14c-af7a-4d14-87ff-7e446156b7a3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:23.488747 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0c0ff14c-af7a-4d14-87ff-7e446156b7a3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:23.489464 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0c0ff14c-af7a-4d14-87ff-7e446156b7a3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:23.489924 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0c0ff14c-af7a-4d14-87ff-7e446156b7a3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:23.490352 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0c0ff14c-af7a-4d14-87ff-7e446156b7a3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:23.495765 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:23.499655 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-11c3aacb-470b-4b26-af78-4b7b4e09652a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:23.509240 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-11c3aacb-470b-4b26-af78-4b7b4e09652a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:23.511056 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-11c3aacb-470b-4b26-af78-4b7b4e09652a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:23.512068 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-11c3aacb-470b-4b26-af78-4b7b4e09652a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e" status: 200 len: 1361 microversion: 2.25 time: 0.205083 Sep 24 20:52:23.512801 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 376/779] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:23 2022] GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e => generated 1361 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:52:23.561347 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e16e2bde-f487-40bf-a1b5-013eb72bbc34 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:23.561930 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0c0ff14c-af7a-4d14-87ff-7e446156b7a3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:23.562079 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e16e2bde-f487-40bf-a1b5-013eb72bbc34 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:23.568206 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e16e2bde-f487-40bf-a1b5-013eb72bbc34 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:23.569646 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e16e2bde-f487-40bf-a1b5-013eb72bbc34 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:23.570299 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e16e2bde-f487-40bf-a1b5-013eb72bbc34 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:23.571048 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e16e2bde-f487-40bf-a1b5-013eb72bbc34 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:23.571511 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e16e2bde-f487-40bf-a1b5-013eb72bbc34 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:23.571937 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e16e2bde-f487-40bf-a1b5-013eb72bbc34 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:23.572174 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0c0ff14c-af7a-4d14-87ff-7e446156b7a3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:23.573673 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0c0ff14c-af7a-4d14-87ff-7e446156b7a3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:23.579147 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0c0ff14c-af7a-4d14-87ff-7e446156b7a3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.103182 Sep 24 20:52:23.579919 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 404/780] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:23 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:52:23.717961 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e16e2bde-f487-40bf-a1b5-013eb72bbc34 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:23.726371 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e16e2bde-f487-40bf-a1b5-013eb72bbc34 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d" status: 200 len: 1503 microversion: 2.1 time: 0.169134 Sep 24 20:52:23.726967 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 377/781] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:23 2022] GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:23.849300 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1c771abe-03f0-46f9-9bf1-8346ce69d7bb tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:23.849991 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1c771abe-03f0-46f9-9bf1-8346ce69d7bb tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: fc6a752b-8418-4657-8e37-3d9259b45d4e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:23.856297 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c771abe-03f0-46f9-9bf1-8346ce69d7bb tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:23.856791 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c771abe-03f0-46f9-9bf1-8346ce69d7bb tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:23.857230 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c771abe-03f0-46f9-9bf1-8346ce69d7bb tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:23.857937 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c771abe-03f0-46f9-9bf1-8346ce69d7bb tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:23.858398 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c771abe-03f0-46f9-9bf1-8346ce69d7bb tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:23.858860 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c771abe-03f0-46f9-9bf1-8346ce69d7bb tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:23.901137 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-04f448e6-efe0-4b4d-b1ef-9829ba41d9f1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:23.902361 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-04f448e6-efe0-4b4d-b1ef-9829ba41d9f1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: b4b8b488-a1f1-42fb-b34a-04005d670e7b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:23.909253 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-04f448e6-efe0-4b4d-b1ef-9829ba41d9f1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:23.910939 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-04f448e6-efe0-4b4d-b1ef-9829ba41d9f1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:23.911527 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-04f448e6-efe0-4b4d-b1ef-9829ba41d9f1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:23.913030 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-04f448e6-efe0-4b4d-b1ef-9829ba41d9f1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:23.913724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-04f448e6-efe0-4b4d-b1ef-9829ba41d9f1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:23.914239 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-04f448e6-efe0-4b4d-b1ef-9829ba41d9f1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:23.933583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1c771abe-03f0-46f9-9bf1-8346ce69d7bb tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:23.941495 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1c771abe-03f0-46f9-9bf1-8346ce69d7bb tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/fc6a752b-8418-4657-8e37-3d9259b45d4e" status: 200 len: 1214 microversion: 2.1 time: 0.096077 Sep 24 20:52:23.955085 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 405/782] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:23 2022] GET /compute/v2.1/servers/fc6a752b-8418-4657-8e37-3d9259b45d4e => generated 1214 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:24.065266 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-04f448e6-efe0-4b4d-b1ef-9829ba41d9f1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:24.077183 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-04f448e6-efe0-4b4d-b1ef-9829ba41d9f1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b" status: 200 len: 1534 microversion: 2.1 time: 0.179939 Sep 24 20:52:24.078635 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 378/783] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:23 2022] GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b => generated 1534 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:24.130194 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-718aaa71-00a6-4100-b879-8d997c1fcd3d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:24.130989 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-718aaa71-00a6-4100-b879-8d997c1fcd3d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:24.139065 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-718aaa71-00a6-4100-b879-8d997c1fcd3d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:24.139638 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-718aaa71-00a6-4100-b879-8d997c1fcd3d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:24.140110 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-718aaa71-00a6-4100-b879-8d997c1fcd3d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:24.140988 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-718aaa71-00a6-4100-b879-8d997c1fcd3d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:24.141484 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-718aaa71-00a6-4100-b879-8d997c1fcd3d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:24.142059 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-718aaa71-00a6-4100-b879-8d997c1fcd3d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:24.344199 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-718aaa71-00a6-4100-b879-8d997c1fcd3d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:24.353870 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-718aaa71-00a6-4100-b879-8d997c1fcd3d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1470 microversion: 2.1 time: 0.227589 Sep 24 20:52:24.354456 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 406/784] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:24 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1470 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:24.457438 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7e38d222-be54-4ccc-a707-435399f5fb3b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:24.458113 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7e38d222-be54-4ccc-a707-435399f5fb3b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:24.464703 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7e38d222-be54-4ccc-a707-435399f5fb3b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:24.465201 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7e38d222-be54-4ccc-a707-435399f5fb3b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:24.465648 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7e38d222-be54-4ccc-a707-435399f5fb3b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:24.466720 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7e38d222-be54-4ccc-a707-435399f5fb3b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:24.467186 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7e38d222-be54-4ccc-a707-435399f5fb3b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:24.467622 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7e38d222-be54-4ccc-a707-435399f5fb3b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:24.539265 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1b59722d-4e6c-4495-8933-acf369c3f94a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:24.539265 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1b59722d-4e6c-4495-8933-acf369c3f94a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:24.545742 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1b59722d-4e6c-4495-8933-acf369c3f94a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:24.546300 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1b59722d-4e6c-4495-8933-acf369c3f94a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:24.546781 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1b59722d-4e6c-4495-8933-acf369c3f94a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:24.547761 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1b59722d-4e6c-4495-8933-acf369c3f94a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:24.548092 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1b59722d-4e6c-4495-8933-acf369c3f94a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:24.548528 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1b59722d-4e6c-4495-8933-acf369c3f94a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:24.808873 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7e38d222-be54-4ccc-a707-435399f5fb3b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:24.831481 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7e38d222-be54-4ccc-a707-435399f5fb3b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1475 microversion: 2.1 time: 0.377867 Sep 24 20:52:24.836966 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 379/785] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:24 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1475 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:24.851172 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-43fa2049-29cf-4691-bf7e-a345111951bb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:24.852104 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-43fa2049-29cf-4691-bf7e-a345111951bb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:24.871326 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-43fa2049-29cf-4691-bf7e-a345111951bb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:24.874413 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-43fa2049-29cf-4691-bf7e-a345111951bb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:24.877520 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-43fa2049-29cf-4691-bf7e-a345111951bb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:24.878472 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-43fa2049-29cf-4691-bf7e-a345111951bb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:24.880238 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-43fa2049-29cf-4691-bf7e-a345111951bb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:24.881684 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-43fa2049-29cf-4691-bf7e-a345111951bb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:24.946997 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1b59722d-4e6c-4495-8933-acf369c3f94a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:24.961689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1b59722d-4e6c-4495-8933-acf369c3f94a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:24.963215 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1b59722d-4e6c-4495-8933-acf369c3f94a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:24.967385 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1b59722d-4e6c-4495-8933-acf369c3f94a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e" status: 200 len: 1361 microversion: 2.25 time: 0.434244 Sep 24 20:52:24.970574 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 407/786] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:24 2022] GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e => generated 1361 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:52:24.975997 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-674f1351-71e3-4b81-9638-59014270676f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:24.979986 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-674f1351-71e3-4b81-9638-59014270676f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:24.997105 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-674f1351-71e3-4b81-9638-59014270676f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:24.997869 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-674f1351-71e3-4b81-9638-59014270676f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:24.998474 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-674f1351-71e3-4b81-9638-59014270676f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:24.999418 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-674f1351-71e3-4b81-9638-59014270676f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:25.000041 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-674f1351-71e3-4b81-9638-59014270676f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:25.000635 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-674f1351-71e3-4b81-9638-59014270676f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:25.063475 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-43fa2049-29cf-4691-bf7e-a345111951bb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:25.075187 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-43fa2049-29cf-4691-bf7e-a345111951bb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:25.077575 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-43fa2049-29cf-4691-bf7e-a345111951bb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:25.084087 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-43fa2049-29cf-4691-bf7e-a345111951bb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.245802 Sep 24 20:52:25.086444 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 380/787] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:24 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:25.091581 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c22d4f01-a68c-41b9-9ccd-a102a5abc45b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:25.092702 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c22d4f01-a68c-41b9-9ccd-a102a5abc45b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: fc6a752b-8418-4657-8e37-3d9259b45d4e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:25.101049 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c22d4f01-a68c-41b9-9ccd-a102a5abc45b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:25.101768 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c22d4f01-a68c-41b9-9ccd-a102a5abc45b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:25.102578 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c22d4f01-a68c-41b9-9ccd-a102a5abc45b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:25.103727 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c22d4f01-a68c-41b9-9ccd-a102a5abc45b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:25.104335 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c22d4f01-a68c-41b9-9ccd-a102a5abc45b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:25.104917 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c22d4f01-a68c-41b9-9ccd-a102a5abc45b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:25.213007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c22d4f01-a68c-41b9-9ccd-a102a5abc45b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:25.224733 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c22d4f01-a68c-41b9-9ccd-a102a5abc45b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/fc6a752b-8418-4657-8e37-3d9259b45d4e" status: 200 len: 1276 microversion: 2.1 time: 0.136799 Sep 24 20:52:25.250997 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 381/788] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:25 2022] GET /compute/v2.1/servers/fc6a752b-8418-4657-8e37-3d9259b45d4e => generated 1276 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:25.264813 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-73479ac1-0073-4cf9-9d32-080260c4d962 req-23314f9f-20fe-446d-a67f-a4d2b2889903 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca2ec54c-f6d0-43a4-abf4-c35d1cad952e", "name": "network-vif-plugged", "status": "completed", "tag": "6259f434-7655-415c-a21b-246b0076fb23"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:25.280183 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-73479ac1-0073-4cf9-9d32-080260c4d962 req-23314f9f-20fe-446d-a67f-a4d2b2889903 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:25.280667 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-73479ac1-0073-4cf9-9d32-080260c4d962 req-23314f9f-20fe-446d-a67f-a4d2b2889903 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:25.281283 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-73479ac1-0073-4cf9-9d32-080260c4d962 req-23314f9f-20fe-446d-a67f-a4d2b2889903 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:25.298167 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-73479ac1-0073-4cf9-9d32-080260c4d962 req-23314f9f-20fe-446d-a67f-a4d2b2889903 service nova] Creating event network-vif-plugged:6259f434-7655-415c-a21b-246b0076fb23 for instance ca2ec54c-f6d0-43a4-abf4-c35d1cad952e on nch2-master-1 Sep 24 20:52:25.303910 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-73479ac1-0073-4cf9-9d32-080260c4d962 req-23314f9f-20fe-446d-a67f-a4d2b2889903 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049490 Sep 24 20:52:25.305151 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 382/789] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:52:25.310116 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0282c3a0-1bde-44ed-aeeb-4dfb5fefe191 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:25.310958 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0282c3a0-1bde-44ed-aeeb-4dfb5fefe191 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: b4b8b488-a1f1-42fb-b34a-04005d670e7b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:25.318360 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0282c3a0-1bde-44ed-aeeb-4dfb5fefe191 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:25.319132 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0282c3a0-1bde-44ed-aeeb-4dfb5fefe191 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:25.319839 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0282c3a0-1bde-44ed-aeeb-4dfb5fefe191 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:25.320438 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0282c3a0-1bde-44ed-aeeb-4dfb5fefe191 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:25.321094 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0282c3a0-1bde-44ed-aeeb-4dfb5fefe191 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:25.321528 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0282c3a0-1bde-44ed-aeeb-4dfb5fefe191 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:25.365608 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-674f1351-71e3-4b81-9638-59014270676f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:25.373861 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-674f1351-71e3-4b81-9638-59014270676f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d" status: 200 len: 1503 microversion: 2.1 time: 0.401991 Sep 24 20:52:25.375079 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 408/790] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:24 2022] GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d => generated 1503 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:25.379631 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f71a553d-5efa-43ca-8f72-1578f931ee85 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:25.380446 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f71a553d-5efa-43ca-8f72-1578f931ee85 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:25.389154 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f71a553d-5efa-43ca-8f72-1578f931ee85 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:25.389684 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f71a553d-5efa-43ca-8f72-1578f931ee85 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:25.390198 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f71a553d-5efa-43ca-8f72-1578f931ee85 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:25.391131 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f71a553d-5efa-43ca-8f72-1578f931ee85 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:25.391900 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f71a553d-5efa-43ca-8f72-1578f931ee85 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:25.392341 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f71a553d-5efa-43ca-8f72-1578f931ee85 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:25.769816 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0282c3a0-1bde-44ed-aeeb-4dfb5fefe191 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:25.783414 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0282c3a0-1bde-44ed-aeeb-4dfb5fefe191 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b" status: 200 len: 1521 microversion: 2.1 time: 0.476977 Sep 24 20:52:25.785832 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 383/791] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:25 2022] GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b => generated 1521 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:25.819172 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bf65c2e0-0c1c-4479-ba73-784d19645849 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:25.820307 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bf65c2e0-0c1c-4479-ba73-784d19645849 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: b4b8b488-a1f1-42fb-b34a-04005d670e7b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:25.827730 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf65c2e0-0c1c-4479-ba73-784d19645849 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:25.828451 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf65c2e0-0c1c-4479-ba73-784d19645849 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:25.829098 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf65c2e0-0c1c-4479-ba73-784d19645849 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:25.830211 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf65c2e0-0c1c-4479-ba73-784d19645849 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:25.832194 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf65c2e0-0c1c-4479-ba73-784d19645849 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:25.834130 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf65c2e0-0c1c-4479-ba73-784d19645849 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:25.877519 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bf65c2e0-0c1c-4479-ba73-784d19645849 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: b4b8b488-a1f1-42fb-b34a-04005d670e7b] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:52:25.925710 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f71a553d-5efa-43ca-8f72-1578f931ee85 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:25.943274 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f71a553d-5efa-43ca-8f72-1578f931ee85 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1470 microversion: 2.1 time: 0.567110 Sep 24 20:52:25.957307 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 409/792] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:25 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1470 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:25.957307 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c61eaed4-686a-4f12-8d5d-0597b31d1d70 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:25.957307 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c61eaed4-686a-4f12-8d5d-0597b31d1d70 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:25.964306 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c61eaed4-686a-4f12-8d5d-0597b31d1d70 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:25.966181 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c61eaed4-686a-4f12-8d5d-0597b31d1d70 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:25.966770 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c61eaed4-686a-4f12-8d5d-0597b31d1d70 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:25.967571 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c61eaed4-686a-4f12-8d5d-0597b31d1d70 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:25.971110 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c61eaed4-686a-4f12-8d5d-0597b31d1d70 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:25.971728 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c61eaed4-686a-4f12-8d5d-0597b31d1d70 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:26.050273 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bf65c2e0-0c1c-4479-ba73-784d19645849 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b" status: 204 len: 0 microversion: 2.1 time: 0.235302 Sep 24 20:52:26.055204 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 384/793] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:52:25 2022] DELETE /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:52:26.066673 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-87f2b066-3eca-4780-a05f-a430b8e65aeb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:26.069281 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-87f2b066-3eca-4780-a05f-a430b8e65aeb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:26.089202 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-87f2b066-3eca-4780-a05f-a430b8e65aeb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:26.090009 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-87f2b066-3eca-4780-a05f-a430b8e65aeb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:26.092694 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-87f2b066-3eca-4780-a05f-a430b8e65aeb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:26.093664 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-87f2b066-3eca-4780-a05f-a430b8e65aeb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:26.095340 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-87f2b066-3eca-4780-a05f-a430b8e65aeb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:26.097287 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-87f2b066-3eca-4780-a05f-a430b8e65aeb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:26.700393 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c61eaed4-686a-4f12-8d5d-0597b31d1d70 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:26.710734 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c61eaed4-686a-4f12-8d5d-0597b31d1d70 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1475 microversion: 2.1 time: 0.764524 Sep 24 20:52:26.724130 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 410/794] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:25 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1475 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:26.735996 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2871bb5a-5031-4138-aa6b-ff75ea7226e5 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:26.736969 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2871bb5a-5031-4138-aa6b-ff75ea7226e5 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: b4b8b488-a1f1-42fb-b34a-04005d670e7b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:26.746598 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2871bb5a-5031-4138-aa6b-ff75ea7226e5 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:26.747270 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2871bb5a-5031-4138-aa6b-ff75ea7226e5 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:26.747877 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2871bb5a-5031-4138-aa6b-ff75ea7226e5 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:26.748761 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2871bb5a-5031-4138-aa6b-ff75ea7226e5 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:26.749380 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2871bb5a-5031-4138-aa6b-ff75ea7226e5 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:26.750168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2871bb5a-5031-4138-aa6b-ff75ea7226e5 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:26.783714 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-87f2b066-3eca-4780-a05f-a430b8e65aeb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:26.798177 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-87f2b066-3eca-4780-a05f-a430b8e65aeb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:26.799941 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-87f2b066-3eca-4780-a05f-a430b8e65aeb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:26.801493 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-87f2b066-3eca-4780-a05f-a430b8e65aeb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e" status: 200 len: 1361 microversion: 2.25 time: 0.744641 Sep 24 20:52:26.804884 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 385/795] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:26 2022] GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e => generated 1361 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:26.810544 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-09ae8a7e-a4a1-4fe8-9d11-21b384513622 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:26.811739 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-09ae8a7e-a4a1-4fe8-9d11-21b384513622 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:26.819981 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09ae8a7e-a4a1-4fe8-9d11-21b384513622 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:26.820513 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09ae8a7e-a4a1-4fe8-9d11-21b384513622 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:26.820941 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09ae8a7e-a4a1-4fe8-9d11-21b384513622 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:26.821794 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09ae8a7e-a4a1-4fe8-9d11-21b384513622 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:26.822608 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09ae8a7e-a4a1-4fe8-9d11-21b384513622 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:26.823203 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09ae8a7e-a4a1-4fe8-9d11-21b384513622 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:26.934967 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-09ae8a7e-a4a1-4fe8-9d11-21b384513622 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:26.946268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-09ae8a7e-a4a1-4fe8-9d11-21b384513622 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:26.947858 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-09ae8a7e-a4a1-4fe8-9d11-21b384513622 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:26.953296 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-09ae8a7e-a4a1-4fe8-9d11-21b384513622 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.147068 Sep 24 20:52:26.954282 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 386/796] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:26 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:26.958818 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c73aab1b-3caa-4e40-bf2f-e760b3d239f7 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:26.960201 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c73aab1b-3caa-4e40-bf2f-e760b3d239f7 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: fc6a752b-8418-4657-8e37-3d9259b45d4e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:26.967922 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c73aab1b-3caa-4e40-bf2f-e760b3d239f7 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:26.968701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c73aab1b-3caa-4e40-bf2f-e760b3d239f7 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:26.969347 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c73aab1b-3caa-4e40-bf2f-e760b3d239f7 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:26.970339 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c73aab1b-3caa-4e40-bf2f-e760b3d239f7 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:26.971031 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c73aab1b-3caa-4e40-bf2f-e760b3d239f7 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:26.971653 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c73aab1b-3caa-4e40-bf2f-e760b3d239f7 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:27.039039 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2871bb5a-5031-4138-aa6b-ff75ea7226e5 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:27.047291 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2871bb5a-5031-4138-aa6b-ff75ea7226e5 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b" status: 200 len: 1527 microversion: 2.1 time: 0.315740 Sep 24 20:52:27.048296 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 411/797] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:26 2022] GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b => generated 1527 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:27.053712 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b5ff30c2-904c-435b-b0be-b7f3c15946f2 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:27.054639 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b5ff30c2-904c-435b-b0be-b7f3c15946f2 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:27.061821 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5ff30c2-904c-435b-b0be-b7f3c15946f2 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:27.062640 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5ff30c2-904c-435b-b0be-b7f3c15946f2 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:27.063324 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5ff30c2-904c-435b-b0be-b7f3c15946f2 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:27.064153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5ff30c2-904c-435b-b0be-b7f3c15946f2 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:27.064153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5ff30c2-904c-435b-b0be-b7f3c15946f2 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:27.065348 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5ff30c2-904c-435b-b0be-b7f3c15946f2 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:27.299670 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c73aab1b-3caa-4e40-bf2f-e760b3d239f7 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:27.309763 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c73aab1b-3caa-4e40-bf2f-e760b3d239f7 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/fc6a752b-8418-4657-8e37-3d9259b45d4e" status: 200 len: 1318 microversion: 2.1 time: 0.354289 Sep 24 20:52:27.310454 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 387/798] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:26 2022] GET /compute/v2.1/servers/fc6a752b-8418-4657-8e37-3d9259b45d4e => generated 1318 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:27.316506 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-7cafe3a3-60fb-4925-81af-cc74fdf05bb2 req-bc26d63e-355d-4b5b-99aa-6005e58997bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc6a752b-8418-4657-8e37-3d9259b45d4e", "tag": "5f5a0c0a-3945-4355-9600-b930be774f0d"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:27.329781 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-7cafe3a3-60fb-4925-81af-cc74fdf05bb2 req-bc26d63e-355d-4b5b-99aa-6005e58997bf service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:27.330680 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-7cafe3a3-60fb-4925-81af-cc74fdf05bb2 req-bc26d63e-355d-4b5b-99aa-6005e58997bf service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:27.331224 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-7cafe3a3-60fb-4925-81af-cc74fdf05bb2 req-bc26d63e-355d-4b5b-99aa-6005e58997bf service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:27.346239 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-7cafe3a3-60fb-4925-81af-cc74fdf05bb2 req-bc26d63e-355d-4b5b-99aa-6005e58997bf service nova] Creating event network-changed:5f5a0c0a-3945-4355-9600-b930be774f0d for instance fc6a752b-8418-4657-8e37-3d9259b45d4e on nch1-master-1 Sep 24 20:52:27.351462 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-7cafe3a3-60fb-4925-81af-cc74fdf05bb2 req-bc26d63e-355d-4b5b-99aa-6005e58997bf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039367 Sep 24 20:52:27.352393 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 388/799] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:52:27.360628 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a8aa760d-e757-48ff-abda-f1d9e8240f56 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:27.361730 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a8aa760d-e757-48ff-abda-f1d9e8240f56 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:27.374380 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a8aa760d-e757-48ff-abda-f1d9e8240f56 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:27.375403 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a8aa760d-e757-48ff-abda-f1d9e8240f56 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:27.376047 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a8aa760d-e757-48ff-abda-f1d9e8240f56 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:27.377984 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a8aa760d-e757-48ff-abda-f1d9e8240f56 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:27.379388 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a8aa760d-e757-48ff-abda-f1d9e8240f56 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:27.380034 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a8aa760d-e757-48ff-abda-f1d9e8240f56 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:27.385192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b5ff30c2-904c-435b-b0be-b7f3c15946f2 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:27.395438 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b5ff30c2-904c-435b-b0be-b7f3c15946f2 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d" status: 200 len: 1503 microversion: 2.1 time: 0.345895 Sep 24 20:52:27.410522 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 412/800] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:27 2022] GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d => generated 1503 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:27.622397 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a8aa760d-e757-48ff-abda-f1d9e8240f56 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:27.635086 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a8aa760d-e757-48ff-abda-f1d9e8240f56 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1470 microversion: 2.1 time: 0.277884 Sep 24 20:52:27.635086 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 389/801] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:27 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1470 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:27.647428 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-28ddc6fc-af1a-48b3-8966-fe0dff59c28a req-dd999acf-de83-4578-883d-9c7bf71803e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1de24cda-52fe-42b6-8639-4bb3c77b5eb7", "tag": "8c825e40-7e4d-4161-a9bf-cab2864992bd"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:27.659401 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-28ddc6fc-af1a-48b3-8966-fe0dff59c28a req-dd999acf-de83-4578-883d-9c7bf71803e5 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:27.659617 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-28ddc6fc-af1a-48b3-8966-fe0dff59c28a req-dd999acf-de83-4578-883d-9c7bf71803e5 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:27.659942 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-28ddc6fc-af1a-48b3-8966-fe0dff59c28a req-dd999acf-de83-4578-883d-9c7bf71803e5 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:27.672424 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-28ddc6fc-af1a-48b3-8966-fe0dff59c28a req-dd999acf-de83-4578-883d-9c7bf71803e5 service nova] Creating event network-changed:8c825e40-7e4d-4161-a9bf-cab2864992bd for instance 1de24cda-52fe-42b6-8639-4bb3c77b5eb7 on nch1-master-1 Sep 24 20:52:27.678594 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-28ddc6fc-af1a-48b3-8966-fe0dff59c28a req-dd999acf-de83-4578-883d-9c7bf71803e5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034529 Sep 24 20:52:27.679404 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 413/802] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:52:27.737171 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b2d958c1-8811-4e33-a73c-4239f47f7535 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:27.737802 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b2d958c1-8811-4e33-a73c-4239f47f7535 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:27.745297 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2d958c1-8811-4e33-a73c-4239f47f7535 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:27.745793 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2d958c1-8811-4e33-a73c-4239f47f7535 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:27.746229 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2d958c1-8811-4e33-a73c-4239f47f7535 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:27.746970 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2d958c1-8811-4e33-a73c-4239f47f7535 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:27.747431 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2d958c1-8811-4e33-a73c-4239f47f7535 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:27.747886 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2d958c1-8811-4e33-a73c-4239f47f7535 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:27.750678 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:27.839148 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b01cdf11-dff4-42a4-98f9-5ab20129bdc7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:27.840235 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b01cdf11-dff4-42a4-98f9-5ab20129bdc7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:27.847530 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b01cdf11-dff4-42a4-98f9-5ab20129bdc7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:27.848071 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b01cdf11-dff4-42a4-98f9-5ab20129bdc7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:27.848519 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b01cdf11-dff4-42a4-98f9-5ab20129bdc7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:27.849616 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b01cdf11-dff4-42a4-98f9-5ab20129bdc7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:27.850407 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b01cdf11-dff4-42a4-98f9-5ab20129bdc7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:27.851009 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b01cdf11-dff4-42a4-98f9-5ab20129bdc7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:27.899751 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b2d958c1-8811-4e33-a73c-4239f47f7535 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:27.908765 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b2d958c1-8811-4e33-a73c-4239f47f7535 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1475 microversion: 2.1 time: 0.175396 Sep 24 20:52:27.909368 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 390/803] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:27 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1475 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:27.982651 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9270ae8a-229c-48de-8059-025d2d529fd7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:27.983273 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9270ae8a-229c-48de-8059-025d2d529fd7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:27.992284 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9270ae8a-229c-48de-8059-025d2d529fd7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:27.993111 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9270ae8a-229c-48de-8059-025d2d529fd7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:27.993868 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9270ae8a-229c-48de-8059-025d2d529fd7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:27.995085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9270ae8a-229c-48de-8059-025d2d529fd7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:27.995849 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9270ae8a-229c-48de-8059-025d2d529fd7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:27.996575 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9270ae8a-229c-48de-8059-025d2d529fd7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:27.997723 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b01cdf11-dff4-42a4-98f9-5ab20129bdc7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:28.006391 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b01cdf11-dff4-42a4-98f9-5ab20129bdc7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:28.007984 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b01cdf11-dff4-42a4-98f9-5ab20129bdc7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:28.009190 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b01cdf11-dff4-42a4-98f9-5ab20129bdc7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e" status: 200 len: 1361 microversion: 2.25 time: 0.178738 Sep 24 20:52:28.009834 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 414/804] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:27 2022] GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e => generated 1361 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:28.075512 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9270ae8a-229c-48de-8059-025d2d529fd7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:28.077565 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e8fd46c5-88db-48fc-8420-4a5bbb918843 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:28.078191 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e8fd46c5-88db-48fc-8420-4a5bbb918843 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: b4b8b488-a1f1-42fb-b34a-04005d670e7b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:28.084348 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9270ae8a-229c-48de-8059-025d2d529fd7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:28.084528 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e8fd46c5-88db-48fc-8420-4a5bbb918843 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:28.084960 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e8fd46c5-88db-48fc-8420-4a5bbb918843 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:28.085405 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e8fd46c5-88db-48fc-8420-4a5bbb918843 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:28.085991 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9270ae8a-229c-48de-8059-025d2d529fd7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:28.086108 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e8fd46c5-88db-48fc-8420-4a5bbb918843 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:28.086602 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e8fd46c5-88db-48fc-8420-4a5bbb918843 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:28.087036 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e8fd46c5-88db-48fc-8420-4a5bbb918843 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:28.090864 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9270ae8a-229c-48de-8059-025d2d529fd7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.112195 Sep 24 20:52:28.091436 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 391/805] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:27 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:52:28.215570 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e8fd46c5-88db-48fc-8420-4a5bbb918843 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:28.223332 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e8fd46c5-88db-48fc-8420-4a5bbb918843 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b" status: 200 len: 1527 microversion: 2.1 time: 0.149863 Sep 24 20:52:28.223905 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 415/806] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:28 2022] GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b => generated 1527 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:52:28.334519 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4548f977-9658-4e74-9965-a2fd9b333267 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:28.335528 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4548f977-9658-4e74-9965-a2fd9b333267 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: fc6a752b-8418-4657-8e37-3d9259b45d4e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:28.341443 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4548f977-9658-4e74-9965-a2fd9b333267 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:28.342192 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4548f977-9658-4e74-9965-a2fd9b333267 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:28.342658 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4548f977-9658-4e74-9965-a2fd9b333267 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:28.343354 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4548f977-9658-4e74-9965-a2fd9b333267 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:28.343809 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4548f977-9658-4e74-9965-a2fd9b333267 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:28.344235 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4548f977-9658-4e74-9965-a2fd9b333267 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:28.427121 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e6e8ae72-9ff8-4e2c-b444-7a870a298e1c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:28.428551 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e6e8ae72-9ff8-4e2c-b444-7a870a298e1c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:28.435554 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6e8ae72-9ff8-4e2c-b444-7a870a298e1c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:28.436042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6e8ae72-9ff8-4e2c-b444-7a870a298e1c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:28.436479 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6e8ae72-9ff8-4e2c-b444-7a870a298e1c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:28.437182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6e8ae72-9ff8-4e2c-b444-7a870a298e1c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:28.437636 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6e8ae72-9ff8-4e2c-b444-7a870a298e1c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:28.438059 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6e8ae72-9ff8-4e2c-b444-7a870a298e1c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:28.499116 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4548f977-9658-4e74-9965-a2fd9b333267 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:28.507658 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4548f977-9658-4e74-9965-a2fd9b333267 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/fc6a752b-8418-4657-8e37-3d9259b45d4e" status: 200 len: 1318 microversion: 2.1 time: 0.177526 Sep 24 20:52:28.508240 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 392/807] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:28 2022] GET /compute/v2.1/servers/fc6a752b-8418-4657-8e37-3d9259b45d4e => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:28.584974 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e6e8ae72-9ff8-4e2c-b444-7a870a298e1c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:28.592764 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e6e8ae72-9ff8-4e2c-b444-7a870a298e1c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d" status: 200 len: 1503 microversion: 2.1 time: 0.172168 Sep 24 20:52:28.593343 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 416/808] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:28 2022] GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d => generated 1503 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:52:28.660057 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-75e75657-2aac-4977-b381-71e9dedc4dfa tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:28.660676 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-75e75657-2aac-4977-b381-71e9dedc4dfa tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:28.666889 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75e75657-2aac-4977-b381-71e9dedc4dfa tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:28.667379 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75e75657-2aac-4977-b381-71e9dedc4dfa tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:28.667822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75e75657-2aac-4977-b381-71e9dedc4dfa tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:28.668518 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75e75657-2aac-4977-b381-71e9dedc4dfa tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:28.668978 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75e75657-2aac-4977-b381-71e9dedc4dfa tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:28.669458 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75e75657-2aac-4977-b381-71e9dedc4dfa tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:28.799064 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-75e75657-2aac-4977-b381-71e9dedc4dfa tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:28.807868 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-75e75657-2aac-4977-b381-71e9dedc4dfa tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1470 microversion: 2.1 time: 0.151670 Sep 24 20:52:28.808426 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 393/809] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:28 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:28.935904 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1721f310-718b-4f18-8cae-fe703ac711ea tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:28.936438 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1721f310-718b-4f18-8cae-fe703ac711ea tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:28.942457 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1721f310-718b-4f18-8cae-fe703ac711ea tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:28.942973 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1721f310-718b-4f18-8cae-fe703ac711ea tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:28.943444 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1721f310-718b-4f18-8cae-fe703ac711ea tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:28.944145 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1721f310-718b-4f18-8cae-fe703ac711ea tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:28.944607 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1721f310-718b-4f18-8cae-fe703ac711ea tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:28.945038 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1721f310-718b-4f18-8cae-fe703ac711ea tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:29.035528 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-605a73d8-9b08-42e5-b7d0-d88280bf6107 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:29.036273 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-605a73d8-9b08-42e5-b7d0-d88280bf6107 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:29.042326 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-605a73d8-9b08-42e5-b7d0-d88280bf6107 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:29.043038 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-605a73d8-9b08-42e5-b7d0-d88280bf6107 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:29.043473 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-605a73d8-9b08-42e5-b7d0-d88280bf6107 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:29.044173 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-605a73d8-9b08-42e5-b7d0-d88280bf6107 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:29.044626 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-605a73d8-9b08-42e5-b7d0-d88280bf6107 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:29.045049 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-605a73d8-9b08-42e5-b7d0-d88280bf6107 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:29.078308 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1721f310-718b-4f18-8cae-fe703ac711ea tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:29.089147 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1721f310-718b-4f18-8cae-fe703ac711ea tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1475 microversion: 2.1 time: 0.157068 Sep 24 20:52:29.089742 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 417/810] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:28 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1475 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:29.119874 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dce78947-bd21-48ea-923c-c2ff9fbd0d71 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:29.120625 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-dce78947-bd21-48ea-923c-c2ff9fbd0d71 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:29.126689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dce78947-bd21-48ea-923c-c2ff9fbd0d71 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:29.127175 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dce78947-bd21-48ea-923c-c2ff9fbd0d71 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:29.127610 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dce78947-bd21-48ea-923c-c2ff9fbd0d71 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:29.128496 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dce78947-bd21-48ea-923c-c2ff9fbd0d71 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:29.128954 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dce78947-bd21-48ea-923c-c2ff9fbd0d71 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:29.129415 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dce78947-bd21-48ea-923c-c2ff9fbd0d71 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:29.208151 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-dce78947-bd21-48ea-923c-c2ff9fbd0d71 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:29.211853 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-605a73d8-9b08-42e5-b7d0-d88280bf6107 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:29.216855 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-dce78947-bd21-48ea-923c-c2ff9fbd0d71 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:29.218476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-dce78947-bd21-48ea-923c-c2ff9fbd0d71 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:29.221112 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-605a73d8-9b08-42e5-b7d0-d88280bf6107 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:29.222846 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-605a73d8-9b08-42e5-b7d0-d88280bf6107 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:29.224033 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-605a73d8-9b08-42e5-b7d0-d88280bf6107 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e" status: 200 len: 1557 microversion: 2.25 time: 0.192528 Sep 24 20:52:29.224986 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 394/811] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:29 2022] GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e => generated 1557 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:52:29.225125 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-dce78947-bd21-48ea-923c-c2ff9fbd0d71 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.109601 Sep 24 20:52:29.232630 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 418/812] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:29 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:52:29.247724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-787bd0c9-df1f-4ddb-aa59-d7e10da5a24d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:29.248477 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-787bd0c9-df1f-4ddb-aa59-d7e10da5a24d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: b4b8b488-a1f1-42fb-b34a-04005d670e7b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:29.259358 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-787bd0c9-df1f-4ddb-aa59-d7e10da5a24d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:29.259854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-787bd0c9-df1f-4ddb-aa59-d7e10da5a24d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:29.260299 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-787bd0c9-df1f-4ddb-aa59-d7e10da5a24d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:29.261011 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-787bd0c9-df1f-4ddb-aa59-d7e10da5a24d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:29.261670 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-787bd0c9-df1f-4ddb-aa59-d7e10da5a24d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:29.262108 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-787bd0c9-df1f-4ddb-aa59-d7e10da5a24d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:29.305359 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ccc82956-721b-4ace-a342-a452d4f30559 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:29.305986 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ccc82956-721b-4ace-a342-a452d4f30559 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:29.313130 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ccc82956-721b-4ace-a342-a452d4f30559 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:29.313705 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ccc82956-721b-4ace-a342-a452d4f30559 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:29.314264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ccc82956-721b-4ace-a342-a452d4f30559 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:29.315105 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ccc82956-721b-4ace-a342-a452d4f30559 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:29.315788 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ccc82956-721b-4ace-a342-a452d4f30559 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:29.316483 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ccc82956-721b-4ace-a342-a452d4f30559 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:29.449059 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-787bd0c9-df1f-4ddb-aa59-d7e10da5a24d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:29.458372 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-787bd0c9-df1f-4ddb-aa59-d7e10da5a24d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b" status: 200 len: 1527 microversion: 2.1 time: 0.214293 Sep 24 20:52:29.459388 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 395/813] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:29 2022] GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b => generated 1527 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:29.478782 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-ccc82956-721b-4ace-a342-a452d4f30559 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lazy-loading 'services' on Instance uuid ca2ec54c-f6d0-43a4-abf4-c35d1cad952e {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:52:29.492798 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ccc82956-721b-4ace-a342-a452d4f30559 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e" status: 200 len: 2049 microversion: 2.25 time: 0.247369 Sep 24 20:52:29.493355 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 419/814] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:29 2022] GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e => generated 2049 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:29.516601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-65246732-cd7a-40eb-b322-c9ea4c79cdaf tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:29.517224 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-65246732-cd7a-40eb-b322-c9ea4c79cdaf tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:29.525268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65246732-cd7a-40eb-b322-c9ea4c79cdaf tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:29.525268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65246732-cd7a-40eb-b322-c9ea4c79cdaf tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:29.525512 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65246732-cd7a-40eb-b322-c9ea4c79cdaf tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:29.526075 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65246732-cd7a-40eb-b322-c9ea4c79cdaf tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:29.526566 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65246732-cd7a-40eb-b322-c9ea4c79cdaf tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:29.526997 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65246732-cd7a-40eb-b322-c9ea4c79cdaf tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:29.532751 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-861d0a60-2dc8-4599-b6ea-2786bda7c730 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:29.533390 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-861d0a60-2dc8-4599-b6ea-2786bda7c730 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: fc6a752b-8418-4657-8e37-3d9259b45d4e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:29.543323 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-861d0a60-2dc8-4599-b6ea-2786bda7c730 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:29.543823 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-861d0a60-2dc8-4599-b6ea-2786bda7c730 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:29.544263 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-861d0a60-2dc8-4599-b6ea-2786bda7c730 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:29.545002 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-861d0a60-2dc8-4599-b6ea-2786bda7c730 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:29.545456 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-861d0a60-2dc8-4599-b6ea-2786bda7c730 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:29.545879 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-861d0a60-2dc8-4599-b6ea-2786bda7c730 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:29.769427 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-65246732-cd7a-40eb-b322-c9ea4c79cdaf tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lazy-loading 'services' on Instance uuid ca2ec54c-f6d0-43a4-abf4-c35d1cad952e {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:52:29.788901 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-861d0a60-2dc8-4599-b6ea-2786bda7c730 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:29.800710 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-861d0a60-2dc8-4599-b6ea-2786bda7c730 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/fc6a752b-8418-4657-8e37-3d9259b45d4e" status: 200 len: 1318 microversion: 2.1 time: 0.273462 Sep 24 20:52:29.800893 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 420/815] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:29 2022] GET /compute/v2.1/servers/fc6a752b-8418-4657-8e37-3d9259b45d4e => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:29.806306 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fe1177fe-f666-4f36-8caa-e7645d3301fc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:29.806980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fe1177fe-f666-4f36-8caa-e7645d3301fc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:29.813325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fe1177fe-f666-4f36-8caa-e7645d3301fc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:29.814049 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fe1177fe-f666-4f36-8caa-e7645d3301fc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:29.814856 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fe1177fe-f666-4f36-8caa-e7645d3301fc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:29.815230 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fe1177fe-f666-4f36-8caa-e7645d3301fc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:29.815690 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fe1177fe-f666-4f36-8caa-e7645d3301fc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:29.816120 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fe1177fe-f666-4f36-8caa-e7645d3301fc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:29.820743 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:29.823305 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-65246732-cd7a-40eb-b322-c9ea4c79cdaf tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e" status: 200 len: 2049 microversion: 2.25 time: 0.310380 Sep 24 20:52:29.824235 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 396/816] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:29 2022] GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e => generated 2049 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:29.831877 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9b29a142-0a3a-4007-a5f0-b28307962dbd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:29.832700 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9b29a142-0a3a-4007-a5f0-b28307962dbd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:29.840071 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9b29a142-0a3a-4007-a5f0-b28307962dbd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:29.840757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9b29a142-0a3a-4007-a5f0-b28307962dbd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:29.841389 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9b29a142-0a3a-4007-a5f0-b28307962dbd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:29.842662 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9b29a142-0a3a-4007-a5f0-b28307962dbd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:29.843378 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9b29a142-0a3a-4007-a5f0-b28307962dbd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:29.844024 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9b29a142-0a3a-4007-a5f0-b28307962dbd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:30.120513 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fe1177fe-f666-4f36-8caa-e7645d3301fc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:30.135205 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fe1177fe-f666-4f36-8caa-e7645d3301fc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d" status: 200 len: 1503 microversion: 2.1 time: 0.333067 Sep 24 20:52:30.136584 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 421/817] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:29 2022] GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d => generated 1503 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:30.142569 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-47c8a3cd-bf74-4953-89be-892d39853737 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:30.149707 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47c8a3cd-bf74-4953-89be-892d39853737 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:30.150732 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47c8a3cd-bf74-4953-89be-892d39853737 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:30.151378 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47c8a3cd-bf74-4953-89be-892d39853737 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:30.152322 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47c8a3cd-bf74-4953-89be-892d39853737 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:30.153114 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47c8a3cd-bf74-4953-89be-892d39853737 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:30.153512 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9b29a142-0a3a-4007-a5f0-b28307962dbd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:30.154178 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47c8a3cd-bf74-4953-89be-892d39853737 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:30.161701 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9b29a142-0a3a-4007-a5f0-b28307962dbd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1470 microversion: 2.1 time: 0.334964 Sep 24 20:52:30.166939 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 397/818] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:29 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1470 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:30.172371 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-89561ff4-8c1a-4a27-903e-6b2d33c41976 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:30.173208 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-89561ff4-8c1a-4a27-903e-6b2d33c41976 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:30.180573 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-89561ff4-8c1a-4a27-903e-6b2d33c41976 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:30.181076 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-89561ff4-8c1a-4a27-903e-6b2d33c41976 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:30.181687 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-89561ff4-8c1a-4a27-903e-6b2d33c41976 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:30.182407 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-89561ff4-8c1a-4a27-903e-6b2d33c41976 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:30.182895 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-89561ff4-8c1a-4a27-903e-6b2d33c41976 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:30.183321 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-89561ff4-8c1a-4a27-903e-6b2d33c41976 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:30.199018 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-47c8a3cd-bf74-4953-89be-892d39853737 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.061111 Sep 24 20:52:30.199819 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 422/819] 10.222.0.52 () {60 vars in 1217 bytes} [Sat Sep 24 20:52:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:52:30.212608 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5fba6b07-f2ae-48b6-856d-9d6e70db04eb tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:30.218231 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5fba6b07-f2ae-48b6-856d-9d6e70db04eb tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:30.226753 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5fba6b07-f2ae-48b6-856d-9d6e70db04eb tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:30.227512 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5fba6b07-f2ae-48b6-856d-9d6e70db04eb tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:30.228187 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5fba6b07-f2ae-48b6-856d-9d6e70db04eb tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:30.229141 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5fba6b07-f2ae-48b6-856d-9d6e70db04eb tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:30.229816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5fba6b07-f2ae-48b6-856d-9d6e70db04eb tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:30.230731 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5fba6b07-f2ae-48b6-856d-9d6e70db04eb tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:30.267519 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-5fba6b07-f2ae-48b6-856d-9d6e70db04eb tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lazy-loading 'flavor' on Instance uuid ca2ec54c-f6d0-43a4-abf4-c35d1cad952e {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:52:30.284352 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5fba6b07-f2ae-48b6-856d-9d6e70db04eb tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] Going to try to live migrate instance to nch1-master-1 {{(pid=140516) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 24 20:52:30.434306 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-89561ff4-8c1a-4a27-903e-6b2d33c41976 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:30.446162 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-89561ff4-8c1a-4a27-903e-6b2d33c41976 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1475 microversion: 2.1 time: 0.279732 Sep 24 20:52:30.447449 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 398/820] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:30 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1475 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:30.453116 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fc337eb1-0567-44e9-b85d-07dee235c757 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:30.453773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fc337eb1-0567-44e9-b85d-07dee235c757 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:30.460965 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc337eb1-0567-44e9-b85d-07dee235c757 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:30.461689 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc337eb1-0567-44e9-b85d-07dee235c757 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:30.462138 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc337eb1-0567-44e9-b85d-07dee235c757 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:30.463044 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc337eb1-0567-44e9-b85d-07dee235c757 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:30.463668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc337eb1-0567-44e9-b85d-07dee235c757 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:30.464357 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc337eb1-0567-44e9-b85d-07dee235c757 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:30.623047 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fc337eb1-0567-44e9-b85d-07dee235c757 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:30.634129 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fc337eb1-0567-44e9-b85d-07dee235c757 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:30.635686 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fc337eb1-0567-44e9-b85d-07dee235c757 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:30.647991 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fc337eb1-0567-44e9-b85d-07dee235c757 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.197558 Sep 24 20:52:30.662867 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 399/821] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:30 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:30.668347 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9f4c20f8-3033-43ae-9470-8b750feffa71 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:30.669233 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9f4c20f8-3033-43ae-9470-8b750feffa71 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: b4b8b488-a1f1-42fb-b34a-04005d670e7b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:30.683597 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f4c20f8-3033-43ae-9470-8b750feffa71 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:30.684095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f4c20f8-3033-43ae-9470-8b750feffa71 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:30.684530 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f4c20f8-3033-43ae-9470-8b750feffa71 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:30.685234 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f4c20f8-3033-43ae-9470-8b750feffa71 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:30.685689 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f4c20f8-3033-43ae-9470-8b750feffa71 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:30.687175 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f4c20f8-3033-43ae-9470-8b750feffa71 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:30.789541 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9f4c20f8-3033-43ae-9470-8b750feffa71 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:30.804445 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9f4c20f8-3033-43ae-9470-8b750feffa71 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b" status: 200 len: 1485 microversion: 2.1 time: 0.140413 Sep 24 20:52:30.806490 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 400/822] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:30 2022] GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b => generated 1485 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:30.829653 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5fcf22c0-8148-42a1-a987-560b24142786 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:30.830310 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5fcf22c0-8148-42a1-a987-560b24142786 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: fc6a752b-8418-4657-8e37-3d9259b45d4e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:30.840368 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5fcf22c0-8148-42a1-a987-560b24142786 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:30.840871 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5fcf22c0-8148-42a1-a987-560b24142786 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:30.841439 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5fcf22c0-8148-42a1-a987-560b24142786 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:30.842257 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5fcf22c0-8148-42a1-a987-560b24142786 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:30.842945 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5fcf22c0-8148-42a1-a987-560b24142786 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:30.843391 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5fcf22c0-8148-42a1-a987-560b24142786 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:31.074882 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5fcf22c0-8148-42a1-a987-560b24142786 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:31.085312 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5fcf22c0-8148-42a1-a987-560b24142786 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/fc6a752b-8418-4657-8e37-3d9259b45d4e" status: 200 len: 1318 microversion: 2.1 time: 0.264893 Sep 24 20:52:31.086013 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 401/823] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:30 2022] GET /compute/v2.1/servers/fc6a752b-8418-4657-8e37-3d9259b45d4e => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:52:31.090866 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-d646af3f-b268-4a78-8559-7849e077a11b req-7cd3c008-6b80-480a-ac23-562604ed4302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4b8b488-a1f1-42fb-b34a-04005d670e7b", "name": "network-vif-deleted", "tag": "412957fd-2470-4bdf-a174-c5dd3f956904"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:31.102628 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-d646af3f-b268-4a78-8559-7849e077a11b req-7cd3c008-6b80-480a-ac23-562604ed4302 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:31.103356 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-d646af3f-b268-4a78-8559-7849e077a11b req-7cd3c008-6b80-480a-ac23-562604ed4302 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:31.103796 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-d646af3f-b268-4a78-8559-7849e077a11b req-7cd3c008-6b80-480a-ac23-562604ed4302 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:31.116432 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-d646af3f-b268-4a78-8559-7849e077a11b req-7cd3c008-6b80-480a-ac23-562604ed4302 service nova] Creating event network-vif-deleted:412957fd-2470-4bdf-a174-c5dd3f956904 for instance b4b8b488-a1f1-42fb-b34a-04005d670e7b on nch2-master-1 Sep 24 20:52:31.121191 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-d646af3f-b268-4a78-8559-7849e077a11b req-7cd3c008-6b80-480a-ac23-562604ed4302 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033815 Sep 24 20:52:31.125173 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 402/824] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:52:31.164847 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6f91ce11-083d-486a-94ca-cc5460887c91 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:31.165663 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6f91ce11-083d-486a-94ca-cc5460887c91 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:31.171828 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f91ce11-083d-486a-94ca-cc5460887c91 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:31.172316 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f91ce11-083d-486a-94ca-cc5460887c91 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:31.172756 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f91ce11-083d-486a-94ca-cc5460887c91 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:31.173459 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f91ce11-083d-486a-94ca-cc5460887c91 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:31.173916 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f91ce11-083d-486a-94ca-cc5460887c91 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:31.174343 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f91ce11-083d-486a-94ca-cc5460887c91 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:31.347998 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6f91ce11-083d-486a-94ca-cc5460887c91 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:31.364537 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6f91ce11-083d-486a-94ca-cc5460887c91 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d" status: 200 len: 1503 microversion: 2.1 time: 0.203811 Sep 24 20:52:31.368791 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 403/825] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:31 2022] GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d => generated 1503 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:52:31.375369 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e31e1f74-ba54-429e-b4d3-10c32527cd38 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:31.376533 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e31e1f74-ba54-429e-b4d3-10c32527cd38 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:31.383800 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e31e1f74-ba54-429e-b4d3-10c32527cd38 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:31.384385 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e31e1f74-ba54-429e-b4d3-10c32527cd38 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:31.384893 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e31e1f74-ba54-429e-b4d3-10c32527cd38 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:31.385692 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e31e1f74-ba54-429e-b4d3-10c32527cd38 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:31.386249 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e31e1f74-ba54-429e-b4d3-10c32527cd38 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:31.388223 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e31e1f74-ba54-429e-b4d3-10c32527cd38 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:31.534414 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e31e1f74-ba54-429e-b4d3-10c32527cd38 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:31.544795 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e31e1f74-ba54-429e-b4d3-10c32527cd38 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1470 microversion: 2.1 time: 0.174746 Sep 24 20:52:31.545358 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 404/826] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:31 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1470 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:31.549854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c512e7ee-833f-4f6a-8314-907bdbaf8036 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:31.550454 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c512e7ee-833f-4f6a-8314-907bdbaf8036 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:31.556219 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c512e7ee-833f-4f6a-8314-907bdbaf8036 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:31.556700 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c512e7ee-833f-4f6a-8314-907bdbaf8036 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:31.557132 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c512e7ee-833f-4f6a-8314-907bdbaf8036 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:31.557830 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c512e7ee-833f-4f6a-8314-907bdbaf8036 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:31.558285 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c512e7ee-833f-4f6a-8314-907bdbaf8036 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:31.558741 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c512e7ee-833f-4f6a-8314-907bdbaf8036 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:31.687849 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c512e7ee-833f-4f6a-8314-907bdbaf8036 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:31.696348 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c512e7ee-833f-4f6a-8314-907bdbaf8036 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1475 microversion: 2.1 time: 0.149867 Sep 24 20:52:31.696953 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 405/827] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:31 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1475 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:31.701436 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1dbec655-397d-4c00-9822-74601a1b8921 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:31.702047 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1dbec655-397d-4c00-9822-74601a1b8921 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:31.708069 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1dbec655-397d-4c00-9822-74601a1b8921 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:31.708563 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1dbec655-397d-4c00-9822-74601a1b8921 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:31.709694 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1dbec655-397d-4c00-9822-74601a1b8921 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:31.710411 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1dbec655-397d-4c00-9822-74601a1b8921 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:31.710906 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1dbec655-397d-4c00-9822-74601a1b8921 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:31.711344 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1dbec655-397d-4c00-9822-74601a1b8921 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:31.780220 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1dbec655-397d-4c00-9822-74601a1b8921 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:31.788558 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1dbec655-397d-4c00-9822-74601a1b8921 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:31.790010 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1dbec655-397d-4c00-9822-74601a1b8921 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:31.794918 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1dbec655-397d-4c00-9822-74601a1b8921 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.096958 Sep 24 20:52:31.795503 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 406/828] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:31 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:31.831272 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cd53779b-ef6a-43a6-b6d6-642202a02711 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:31.831894 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cd53779b-ef6a-43a6-b6d6-642202a02711 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: b4b8b488-a1f1-42fb-b34a-04005d670e7b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:31.838541 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd53779b-ef6a-43a6-b6d6-642202a02711 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:31.839045 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd53779b-ef6a-43a6-b6d6-642202a02711 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:31.839487 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd53779b-ef6a-43a6-b6d6-642202a02711 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:31.840393 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd53779b-ef6a-43a6-b6d6-642202a02711 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:31.840856 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd53779b-ef6a-43a6-b6d6-642202a02711 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:31.841291 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd53779b-ef6a-43a6-b6d6-642202a02711 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:31.845583 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:31.873264 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd53779b-ef6a-43a6-b6d6-642202a02711 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:31.873759 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd53779b-ef6a-43a6-b6d6-642202a02711 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:31.874199 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd53779b-ef6a-43a6-b6d6-642202a02711 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:31.874690 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-cd53779b-ef6a-43a6-b6d6-642202a02711 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lazy-loading 'fault' on Instance uuid b4b8b488-a1f1-42fb-b34a-04005d670e7b {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:52:31.918670 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cd53779b-ef6a-43a6-b6d6-642202a02711 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:31.926332 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cd53779b-ef6a-43a6-b6d6-642202a02711 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b" status: 200 len: 1314 microversion: 2.1 time: 0.098820 Sep 24 20:52:31.927271 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 407/829] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:31 2022] GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b => generated 1314 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:52:32.108331 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c931a014-44c2-45e7-81fa-4bbce9ab5118 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:32.108949 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c931a014-44c2-45e7-81fa-4bbce9ab5118 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: fc6a752b-8418-4657-8e37-3d9259b45d4e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:32.116344 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c931a014-44c2-45e7-81fa-4bbce9ab5118 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:32.116832 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c931a014-44c2-45e7-81fa-4bbce9ab5118 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:32.117270 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c931a014-44c2-45e7-81fa-4bbce9ab5118 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:32.117968 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c931a014-44c2-45e7-81fa-4bbce9ab5118 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:32.118429 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c931a014-44c2-45e7-81fa-4bbce9ab5118 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:32.118891 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c931a014-44c2-45e7-81fa-4bbce9ab5118 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:32.236947 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=38 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:32.273533 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c931a014-44c2-45e7-81fa-4bbce9ab5118 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:32.281514 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c931a014-44c2-45e7-81fa-4bbce9ab5118 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/fc6a752b-8418-4657-8e37-3d9259b45d4e" status: 200 len: 1318 microversion: 2.1 time: 0.177215 Sep 24 20:52:32.282099 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 408/830] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:32 2022] GET /compute/v2.1/servers/fc6a752b-8418-4657-8e37-3d9259b45d4e => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:52:32.390534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a19586c6-50b9-49fa-9827-af271e93f6e7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:32.391158 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a19586c6-50b9-49fa-9827-af271e93f6e7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:32.397425 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a19586c6-50b9-49fa-9827-af271e93f6e7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:32.397971 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a19586c6-50b9-49fa-9827-af271e93f6e7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:32.398411 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a19586c6-50b9-49fa-9827-af271e93f6e7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:32.399132 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a19586c6-50b9-49fa-9827-af271e93f6e7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:32.399589 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a19586c6-50b9-49fa-9827-af271e93f6e7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:32.400014 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a19586c6-50b9-49fa-9827-af271e93f6e7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:32.531556 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a19586c6-50b9-49fa-9827-af271e93f6e7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:32.540122 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a19586c6-50b9-49fa-9827-af271e93f6e7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d" status: 200 len: 1478 microversion: 2.1 time: 0.153422 Sep 24 20:52:32.540722 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 409/831] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:32 2022] GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d => generated 1478 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:52:32.562777 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-eaf8e167-c06c-4e63-a2f6-ccbadff921d6 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Calling method '.version_select at 0x7f4b0cf3e5e0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:32.566321 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eaf8e167-c06c-4e63-a2f6-ccbadff921d6 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:32.566858 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eaf8e167-c06c-4e63-a2f6-ccbadff921d6 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:32.567300 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eaf8e167-c06c-4e63-a2f6-ccbadff921d6 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:32.569158 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:32.578126 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-eaf8e167-c06c-4e63-a2f6-ccbadff921d6 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 1905 microversion: 2.1 time: 0.019577 Sep 24 20:52:32.578728 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 410/832] 10.222.0.52 () {58 vars in 1143 bytes} [Sat Sep 24 20:52:32 2022] GET /compute/v2.1/os-migrations => generated 1905 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:52:32.583011 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-320c6fb9-3f5c-4c01-b989-68bf2b92ed44 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:32.583782 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-320c6fb9-3f5c-4c01-b989-68bf2b92ed44 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:32.589317 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-320c6fb9-3f5c-4c01-b989-68bf2b92ed44 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:32.589797 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-320c6fb9-3f5c-4c01-b989-68bf2b92ed44 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:32.590236 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-320c6fb9-3f5c-4c01-b989-68bf2b92ed44 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:32.590955 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-320c6fb9-3f5c-4c01-b989-68bf2b92ed44 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:32.591413 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-320c6fb9-3f5c-4c01-b989-68bf2b92ed44 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:32.591841 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-320c6fb9-3f5c-4c01-b989-68bf2b92ed44 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:32.728100 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-320c6fb9-3f5c-4c01-b989-68bf2b92ed44 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:32.736080 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-320c6fb9-3f5c-4c01-b989-68bf2b92ed44 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1470 microversion: 2.1 time: 0.156412 Sep 24 20:52:32.736643 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 411/833] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:32 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:32.741972 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a0db7bfb-ba18-469e-9c8c-bb4b725b039b tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:32.742809 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a0db7bfb-ba18-469e-9c8c-bb4b725b039b tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:32.748162 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:32.750524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a0db7bfb-ba18-469e-9c8c-bb4b725b039b tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:32.751021 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a0db7bfb-ba18-469e-9c8c-bb4b725b039b tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:32.751454 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a0db7bfb-ba18-469e-9c8c-bb4b725b039b tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:32.752152 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a0db7bfb-ba18-469e-9c8c-bb4b725b039b tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:32.752608 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a0db7bfb-ba18-469e-9c8c-bb4b725b039b tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:32.753315 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a0db7bfb-ba18-469e-9c8c-bb4b725b039b tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:32.822042 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:32.881844 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a0db7bfb-ba18-469e-9c8c-bb4b725b039b tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d" status: 200 len: 1629 microversion: 2.1 time: 0.144087 Sep 24 20:52:32.882420 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 412/834] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:32 2022] GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d => generated 1629 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:32.887713 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-52a5b719-2a98-440c-9747-67758b764bda tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:32.888342 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-52a5b719-2a98-440c-9747-67758b764bda tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:32.894054 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52a5b719-2a98-440c-9747-67758b764bda tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:32.894485 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52a5b719-2a98-440c-9747-67758b764bda tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:32.895003 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52a5b719-2a98-440c-9747-67758b764bda tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:32.895706 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52a5b719-2a98-440c-9747-67758b764bda tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:32.896969 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52a5b719-2a98-440c-9747-67758b764bda tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:32.897399 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52a5b719-2a98-440c-9747-67758b764bda tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:33.066930 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-52a5b719-2a98-440c-9747-67758b764bda tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:33.080153 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-52a5b719-2a98-440c-9747-67758b764bda tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1475 microversion: 2.1 time: 0.194991 Sep 24 20:52:33.083146 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 413/835] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:32 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1475 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:33.088789 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-01eef89f-a2de-4242-b53d-fd9bb2a7f8d7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:33.089509 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-01eef89f-a2de-4242-b53d-fd9bb2a7f8d7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:33.101840 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01eef89f-a2de-4242-b53d-fd9bb2a7f8d7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:33.102523 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01eef89f-a2de-4242-b53d-fd9bb2a7f8d7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:33.103103 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01eef89f-a2de-4242-b53d-fd9bb2a7f8d7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:33.104742 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01eef89f-a2de-4242-b53d-fd9bb2a7f8d7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:33.105370 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01eef89f-a2de-4242-b53d-fd9bb2a7f8d7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:33.105812 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01eef89f-a2de-4242-b53d-fd9bb2a7f8d7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:33.186572 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-01eef89f-a2de-4242-b53d-fd9bb2a7f8d7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:33.197414 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-01eef89f-a2de-4242-b53d-fd9bb2a7f8d7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:33.199097 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-01eef89f-a2de-4242-b53d-fd9bb2a7f8d7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:33.205114 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-01eef89f-a2de-4242-b53d-fd9bb2a7f8d7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.119999 Sep 24 20:52:33.206023 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 414/836] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:33 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:33.211489 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4c1e9074-4176-48b8-af99-7a2863d022db tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Action: 'create', calling method: .version_select at 0x7f4b0c8d4700>, body: {"keypair": {"name": "tempest-keypair-1402438983", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9EVpRZPyWQhpR/8ql9V4pvbD+CKvIL1osv0UJOOlLxOeAN9ovsC23tRhF60OFWzwa65eSLCAlP5of0XX06CWQrxC7D/Y+qRsOZ3S5W6FF1nWrZybqYG6PdxJf059Ofpg=="}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:33.228080 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-4c1e9074-4176-48b8-af99-7a2863d022db tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Getting quotas for project a2b7e30f79bf42e497c53c091ad0a106. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:52:33.234066 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-4c1e9074-4176-48b8-af99-7a2863d022db tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Getting quotas for user 9c03c67e0c4c4de7a186f28ac10d0b92 and project a2b7e30f79bf42e497c53c091ad0a106. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:52:33.285012 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4c1e9074-4176-48b8-af99-7a2863d022db tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.077798 Sep 24 20:52:33.285757 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 415/837] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 20:52:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:52:33.295513 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c41bdf5f-58bd-4db1-a503-cda3abdafa09 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:33.304345 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c41bdf5f-58bd-4db1-a503-cda3abdafa09 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: b4b8b488-a1f1-42fb-b34a-04005d670e7b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:33.321545 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c41bdf5f-58bd-4db1-a503-cda3abdafa09 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:33.324916 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c41bdf5f-58bd-4db1-a503-cda3abdafa09 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:33.325671 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c41bdf5f-58bd-4db1-a503-cda3abdafa09 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:33.335336 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c41bdf5f-58bd-4db1-a503-cda3abdafa09 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:33.336044 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c41bdf5f-58bd-4db1-a503-cda3abdafa09 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:33.336643 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c41bdf5f-58bd-4db1-a503-cda3abdafa09 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:33.363149 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-c41bdf5f-58bd-4db1-a503-cda3abdafa09 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] HTTP exception thrown: Instance b4b8b488-a1f1-42fb-b34a-04005d670e7b could not be found. Sep 24 20:52:33.364864 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c41bdf5f-58bd-4db1-a503-cda3abdafa09 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Request method failure captured: Sep 24 20:52:33.364864 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b HTTP/1.1 Sep 24 20:52:33.364864 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:52:33.364864 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:52:33.364864 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:52:33.364864 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:52:33.364864 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:52:33.364864 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:52:33.364864 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:52:33.364864 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:52:33.364864 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL23hSaMAKT8B-JdjtYs2UoED1UAMalIeRO9Th3athHCHzrGhfs9Sy0_hBzkoXpxV7aas8iy4VFycxPqE3-ST396dY35DaR9MZAQlds-eQBPgVm84hG8pTTOjeXtJegh8tOCUNbJFm6JLpFNRAi1C2IykufgxtCoO69ROBtQmrT9YEmI Sep 24 20:52:33.364864 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:52:33.364864 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:52:33.364864 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:52:33.364864 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:52:33.364864 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:52:33.364864 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:52:33.364864 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: e175cb4032ec4e6aa900141abbaa04c4 Sep 24 20:52:33.364864 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:52:33.364864 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:52:33.364864 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:52:33.367069 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:52:33.367069 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:52:33.367069 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: e175cb4032ec4e6aa900141abbaa04c4 Sep 24 20:52:33.367069 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:52:33.367069 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ImagesOneServerNegativeTestJSON-1825846347-project Sep 24 20:52:33.367069 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:52:33.367069 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:52:33.367069 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 6db52cb259fa426d860f9c9a48a149f3 Sep 24 20:52:33.367069 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347-project Sep 24 20:52:33.367069 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:52:33.367069 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance b4b8b488-a1f1-42fb-b34a-04005d670e7b could not be found. Sep 24 20:52:33.367069 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'b4b8b488-a1f1-42fb-b34a-04005d670e7b'} Sep 24 20:52:33.367905 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:52:33.367905 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:52:33.367905 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:52:33.367905 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:52:33.367905 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:52:33.367905 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:52:33.367905 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:52:33.367905 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:52:33.367905 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:52:33.367905 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:52:33.367905 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4b8b488-a1f1-42fb-b34a-04005d670e7b could not be found. Sep 24 20:52:33.367905 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:52:33.367905 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:52:33.367905 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:52:33.367905 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:52:33.367905 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:52:33.367905 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:52:33.367905 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:52:33.367905 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:52:33.367905 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:52:33.369100 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:52:33.369100 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:52:33.369100 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:52:33.369100 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:52:33.369100 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:52:33.369100 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:52:33.369100 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:52:33.369100 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4b8b488-a1f1-42fb-b34a-04005d670e7b could not be found. Sep 24 20:52:33.369100 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:52:33.369100 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:52:33.369100 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:52:33.369100 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:52:33.369100 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:52:33.369100 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:52:33.369100 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:52:33.369100 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:52:33.369100 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4b8b488-a1f1-42fb-b34a-04005d670e7b could not be found. Sep 24 20:52:33.369100 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:52:33.370175 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c41bdf5f-58bd-4db1-a503-cda3abdafa09 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Returning 404 to user: Instance b4b8b488-a1f1-42fb-b34a-04005d670e7b could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:52:33.371133 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c41bdf5f-58bd-4db1-a503-cda3abdafa09 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b" status: 404 len: 111 microversion: 2.1 time: 0.081234 Sep 24 20:52:33.387242 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 416/838] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:33 2022] GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:52:33.398725 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1b182792-d6a6-4e83-bcc6-e814b84ec9f8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:33.399352 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1b182792-d6a6-4e83-bcc6-e814b84ec9f8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: fc6a752b-8418-4657-8e37-3d9259b45d4e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:33.407487 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1b182792-d6a6-4e83-bcc6-e814b84ec9f8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:33.408395 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1b182792-d6a6-4e83-bcc6-e814b84ec9f8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:33.408848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1b182792-d6a6-4e83-bcc6-e814b84ec9f8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:33.410130 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1b182792-d6a6-4e83-bcc6-e814b84ec9f8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:33.410561 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1b182792-d6a6-4e83-bcc6-e814b84ec9f8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:33.411000 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1b182792-d6a6-4e83-bcc6-e814b84ec9f8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:33.668915 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1b182792-d6a6-4e83-bcc6-e814b84ec9f8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:33.676874 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1b182792-d6a6-4e83-bcc6-e814b84ec9f8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/fc6a752b-8418-4657-8e37-3d9259b45d4e" status: 200 len: 1318 microversion: 2.1 time: 0.288520 Sep 24 20:52:33.677991 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 417/839] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:33 2022] GET /compute/v2.1/servers/fc6a752b-8418-4657-8e37-3d9259b45d4e => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:33.682791 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-22a8ac27-ec4d-4105-8fd6-ff09eb4232d9 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Action: 'create', calling method: .version_select at 0x7f4b0c95a5e0>, body: {"keypair": {"name": "tempest-keypair-266780220", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3eUNhfDJa7++/Mk5sMm5J6B9+YltO675H0w63ih6xjQPclYG35BnSlP3SHl5V/feefTC5fbbjQN8RPd/lCHfgBqHNgSkPVMLhaQQJvAgFMMSDkby9qSSBaGJkgiMO4Mw=="}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:33.698972 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-22a8ac27-ec4d-4105-8fd6-ff09eb4232d9 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Getting quotas for project e175cb4032ec4e6aa900141abbaa04c4. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:52:33.704461 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-22a8ac27-ec4d-4105-8fd6-ff09eb4232d9 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Getting quotas for user 6db52cb259fa426d860f9c9a48a149f3 and project e175cb4032ec4e6aa900141abbaa04c4. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:52:33.727617 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-22a8ac27-ec4d-4105-8fd6-ff09eb4232d9 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048371 Sep 24 20:52:33.728255 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 418/840] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 20:52:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:52:33.732680 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-6d32506c-9795-4255-8d97-321609d2f907 req-aa8daf56-7a9f-4667-a391-b5c814e07ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc6a752b-8418-4657-8e37-3d9259b45d4e", "name": "network-vif-plugged", "status": "completed", "tag": "5f5a0c0a-3945-4355-9600-b930be774f0d"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:33.745530 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6d32506c-9795-4255-8d97-321609d2f907 req-aa8daf56-7a9f-4667-a391-b5c814e07ca2 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:33.746043 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6d32506c-9795-4255-8d97-321609d2f907 req-aa8daf56-7a9f-4667-a391-b5c814e07ca2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:33.746486 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6d32506c-9795-4255-8d97-321609d2f907 req-aa8daf56-7a9f-4667-a391-b5c814e07ca2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:33.758824 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-6d32506c-9795-4255-8d97-321609d2f907 req-aa8daf56-7a9f-4667-a391-b5c814e07ca2 service nova] Creating event network-vif-plugged:5f5a0c0a-3945-4355-9600-b930be774f0d for instance fc6a752b-8418-4657-8e37-3d9259b45d4e on nch1-master-1 Sep 24 20:52:33.764006 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-6d32506c-9795-4255-8d97-321609d2f907 req-aa8daf56-7a9f-4667-a391-b5c814e07ca2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034583 Sep 24 20:52:33.764828 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 419/841] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:52:33.770200 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6a81a1c2-0d61-4211-807d-31a9a7e1c701 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:33.771947 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6a81a1c2-0d61-4211-807d-31a9a7e1c701 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:33.779097 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6a81a1c2-0d61-4211-807d-31a9a7e1c701 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:33.779598 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6a81a1c2-0d61-4211-807d-31a9a7e1c701 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:33.780081 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6a81a1c2-0d61-4211-807d-31a9a7e1c701 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:33.780950 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6a81a1c2-0d61-4211-807d-31a9a7e1c701 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:33.781507 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6a81a1c2-0d61-4211-807d-31a9a7e1c701 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:33.782022 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6a81a1c2-0d61-4211-807d-31a9a7e1c701 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:33.970311 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5fba6b07-f2ae-48b6-856d-9d6e70db04eb tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e/action" status: 202 len: 0 microversion: 2.25 time: 3.761623 Sep 24 20:52:33.973987 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 423/842] 10.222.0.52 () {62 vars in 1319 bytes} [Sat Sep 24 20:52:30 2022] POST /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e/action => generated 0 bytes in 3763 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 24 20:52:33.974991 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6a81a1c2-0d61-4211-807d-31a9a7e1c701 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:33.980139 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6e15c7dc-ad67-4f7a-8c86-456e1347c1ff tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:33.980769 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6e15c7dc-ad67-4f7a-8c86-456e1347c1ff tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:33.994114 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6a81a1c2-0d61-4211-807d-31a9a7e1c701 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1470 microversion: 2.1 time: 0.227930 Sep 24 20:52:33.995504 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 420/843] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:33 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1470 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:34.027530 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6e15c7dc-ad67-4f7a-8c86-456e1347c1ff tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:34.032183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6e15c7dc-ad67-4f7a-8c86-456e1347c1ff tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:34.032821 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6e15c7dc-ad67-4f7a-8c86-456e1347c1ff tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:34.034230 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6e15c7dc-ad67-4f7a-8c86-456e1347c1ff tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:34.034985 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6e15c7dc-ad67-4f7a-8c86-456e1347c1ff tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:34.035604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6e15c7dc-ad67-4f7a-8c86-456e1347c1ff tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:34.114348 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-69ee9075-56fa-475e-9c87-523c2decde1b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:34.116797 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-69ee9075-56fa-475e-9c87-523c2decde1b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:34.124256 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69ee9075-56fa-475e-9c87-523c2decde1b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:34.124856 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69ee9075-56fa-475e-9c87-523c2decde1b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:34.127132 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69ee9075-56fa-475e-9c87-523c2decde1b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:34.128395 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69ee9075-56fa-475e-9c87-523c2decde1b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:34.129206 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69ee9075-56fa-475e-9c87-523c2decde1b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:34.129708 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69ee9075-56fa-475e-9c87-523c2decde1b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:34.336789 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6e15c7dc-ad67-4f7a-8c86-456e1347c1ff tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:34.359978 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6e15c7dc-ad67-4f7a-8c86-456e1347c1ff tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:34.361455 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6e15c7dc-ad67-4f7a-8c86-456e1347c1ff tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:34.371356 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6e15c7dc-ad67-4f7a-8c86-456e1347c1ff tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e" status: 200 len: 1567 microversion: 2.25 time: 0.395228 Sep 24 20:52:34.372544 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 424/844] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:33 2022] GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e => generated 1567 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:34.377474 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ceeabfd4-d6cb-43a6-a1d9-baf772b74ff8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:34.378425 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ceeabfd4-d6cb-43a6-a1d9-baf772b74ff8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:34.385543 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ceeabfd4-d6cb-43a6-a1d9-baf772b74ff8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:34.386300 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ceeabfd4-d6cb-43a6-a1d9-baf772b74ff8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:34.386950 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ceeabfd4-d6cb-43a6-a1d9-baf772b74ff8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:34.387838 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ceeabfd4-d6cb-43a6-a1d9-baf772b74ff8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:34.388463 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ceeabfd4-d6cb-43a6-a1d9-baf772b74ff8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:34.388911 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ceeabfd4-d6cb-43a6-a1d9-baf772b74ff8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:34.407367 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-69ee9075-56fa-475e-9c87-523c2decde1b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:34.439849 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-69ee9075-56fa-475e-9c87-523c2decde1b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1474 microversion: 2.1 time: 0.336834 Sep 24 20:52:34.440477 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 421/845] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:34 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1474 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:34.484186 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ceeabfd4-d6cb-43a6-a1d9-baf772b74ff8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:34.500184 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ceeabfd4-d6cb-43a6-a1d9-baf772b74ff8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:34.501677 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ceeabfd4-d6cb-43a6-a1d9-baf772b74ff8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:34.507773 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ceeabfd4-d6cb-43a6-a1d9-baf772b74ff8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.133945 Sep 24 20:52:34.508371 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 425/846] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:34 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:34.700242 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-06c1edea-f8ab-44de-8f4d-0b8c2a06fd39 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:34.700865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-06c1edea-f8ab-44de-8f4d-0b8c2a06fd39 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: fc6a752b-8418-4657-8e37-3d9259b45d4e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:34.706913 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-06c1edea-f8ab-44de-8f4d-0b8c2a06fd39 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:34.707414 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-06c1edea-f8ab-44de-8f4d-0b8c2a06fd39 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:34.707876 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-06c1edea-f8ab-44de-8f4d-0b8c2a06fd39 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:34.708598 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-06c1edea-f8ab-44de-8f4d-0b8c2a06fd39 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:34.709173 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-06c1edea-f8ab-44de-8f4d-0b8c2a06fd39 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:34.709615 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-06c1edea-f8ab-44de-8f4d-0b8c2a06fd39 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:34.842058 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-06c1edea-f8ab-44de-8f4d-0b8c2a06fd39 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:34.850661 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-06c1edea-f8ab-44de-8f4d-0b8c2a06fd39 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/fc6a752b-8418-4657-8e37-3d9259b45d4e" status: 200 len: 1318 microversion: 2.1 time: 0.153918 Sep 24 20:52:34.851242 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 422/847] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:34 2022] GET /compute/v2.1/servers/fc6a752b-8418-4657-8e37-3d9259b45d4e => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:52:35.022919 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f4e068c5-e914-4890-a629-47f5eb397b41 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:35.023798 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f4e068c5-e914-4890-a629-47f5eb397b41 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:35.030616 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4e068c5-e914-4890-a629-47f5eb397b41 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:35.031102 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4e068c5-e914-4890-a629-47f5eb397b41 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:35.031540 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4e068c5-e914-4890-a629-47f5eb397b41 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:35.032235 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4e068c5-e914-4890-a629-47f5eb397b41 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:35.032692 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4e068c5-e914-4890-a629-47f5eb397b41 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:35.033118 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4e068c5-e914-4890-a629-47f5eb397b41 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:35.170716 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f4e068c5-e914-4890-a629-47f5eb397b41 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:35.178894 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f4e068c5-e914-4890-a629-47f5eb397b41 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1470 microversion: 2.1 time: 0.160452 Sep 24 20:52:35.193222 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 426/848] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:35 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1470 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:35.402630 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3ca672f2-8e6d-44f0-8049-022f3df72a37 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:35.403651 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3ca672f2-8e6d-44f0-8049-022f3df72a37 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:35.411600 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ca672f2-8e6d-44f0-8049-022f3df72a37 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:35.412391 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ca672f2-8e6d-44f0-8049-022f3df72a37 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:35.412901 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ca672f2-8e6d-44f0-8049-022f3df72a37 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:35.413857 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ca672f2-8e6d-44f0-8049-022f3df72a37 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:35.414398 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ca672f2-8e6d-44f0-8049-022f3df72a37 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:35.414921 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ca672f2-8e6d-44f0-8049-022f3df72a37 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:35.464498 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-104e0fcd-1998-43e5-bff5-d86a86849ee6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:35.465409 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-104e0fcd-1998-43e5-bff5-d86a86849ee6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:35.472253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-104e0fcd-1998-43e5-bff5-d86a86849ee6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:35.472866 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-104e0fcd-1998-43e5-bff5-d86a86849ee6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:35.474692 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-104e0fcd-1998-43e5-bff5-d86a86849ee6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:35.475201 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-104e0fcd-1998-43e5-bff5-d86a86849ee6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:35.475666 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-104e0fcd-1998-43e5-bff5-d86a86849ee6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:35.476102 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-104e0fcd-1998-43e5-bff5-d86a86849ee6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:35.932047 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3ca672f2-8e6d-44f0-8049-022f3df72a37 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:35.945448 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3ca672f2-8e6d-44f0-8049-022f3df72a37 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:35.947992 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3ca672f2-8e6d-44f0-8049-022f3df72a37 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:35.951079 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3ca672f2-8e6d-44f0-8049-022f3df72a37 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e" status: 200 len: 1567 microversion: 2.25 time: 0.552865 Sep 24 20:52:35.952200 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 423/849] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:35 2022] GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e => generated 1567 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:35.958927 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e4804b98-914b-4ece-84bc-41eda96b86d1 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-34724261", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "89b13b8f-db96-4ded-b022-c0f1faad59f4"}], "security_groups": [{"name": "tempest-securitygroup--787381027"}], "key_name": "tempest-keypair-1402438983", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:35.968157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-104e0fcd-1998-43e5-bff5-d86a86849ee6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:35.978521 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-104e0fcd-1998-43e5-bff5-d86a86849ee6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1474 microversion: 2.1 time: 0.518162 Sep 24 20:52:35.979421 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 427/850] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:35 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1474 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:35.988910 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-da0890d3-d87f-4dc4-83d6-01e186c610b3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:35.989538 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-da0890d3-d87f-4dc4-83d6-01e186c610b3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:35.997103 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-da0890d3-d87f-4dc4-83d6-01e186c610b3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:35.997808 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-da0890d3-d87f-4dc4-83d6-01e186c610b3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:35.998436 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-da0890d3-d87f-4dc4-83d6-01e186c610b3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:35.999347 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-da0890d3-d87f-4dc4-83d6-01e186c610b3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:36.000104 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-da0890d3-d87f-4dc4-83d6-01e186c610b3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:36.001019 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-da0890d3-d87f-4dc4-83d6-01e186c610b3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:36.107714 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-da0890d3-d87f-4dc4-83d6-01e186c610b3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:36.122666 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-da0890d3-d87f-4dc4-83d6-01e186c610b3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:36.124289 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-da0890d3-d87f-4dc4-83d6-01e186c610b3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:36.127339 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:36.132030 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-da0890d3-d87f-4dc4-83d6-01e186c610b3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.151223 Sep 24 20:52:36.132847 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 428/851] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:35 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:36.144530 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-e4804b98-914b-4ece-84bc-41eda96b86d1 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] validate_networks() for [('89b13b8f-db96-4ded-b022-c0f1faad59f4', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:52:36.148526 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d186a9fb-14da-4067-ae25-0044b811a340 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:36.149484 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d186a9fb-14da-4067-ae25-0044b811a340 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: fc6a752b-8418-4657-8e37-3d9259b45d4e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:36.158224 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d186a9fb-14da-4067-ae25-0044b811a340 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:36.158779 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d186a9fb-14da-4067-ae25-0044b811a340 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:36.159214 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d186a9fb-14da-4067-ae25-0044b811a340 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:36.159919 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d186a9fb-14da-4067-ae25-0044b811a340 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:36.160372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d186a9fb-14da-4067-ae25-0044b811a340 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:36.160833 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d186a9fb-14da-4067-ae25-0044b811a340 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:36.458043 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d186a9fb-14da-4067-ae25-0044b811a340 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:36.469865 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d186a9fb-14da-4067-ae25-0044b811a340 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/fc6a752b-8418-4657-8e37-3d9259b45d4e" status: 200 len: 1318 microversion: 2.1 time: 0.335700 Sep 24 20:52:36.486726 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 429/852] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:36 2022] GET /compute/v2.1/servers/fc6a752b-8418-4657-8e37-3d9259b45d4e => generated 1318 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:36.492635 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d51b0140-b1dd-4473-91f1-3368315dcba9 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-771696546", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:36.556644 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-d51b0140-b1dd-4473-91f1-3368315dcba9 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] validate_networks() for [('024c2e10-583d-4d69-82c6-3844b4ef926e', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:52:36.923321 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-e4804b98-914b-4ece-84bc-41eda96b86d1 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:52:36.924252 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-e4804b98-914b-4ece-84bc-41eda96b86d1 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:52:36.924743 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-e4804b98-914b-4ece-84bc-41eda96b86d1 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:52:36.925355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-e4804b98-914b-4ece-84bc-41eda96b86d1 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:52:36.926185 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-e4804b98-914b-4ece-84bc-41eda96b86d1 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:52:36.937624 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e4804b98-914b-4ece-84bc-41eda96b86d1 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:36.939106 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e4804b98-914b-4ece-84bc-41eda96b86d1 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:36.939561 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e4804b98-914b-4ece-84bc-41eda96b86d1 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:36.940325 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e4804b98-914b-4ece-84bc-41eda96b86d1 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:36.940807 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e4804b98-914b-4ece-84bc-41eda96b86d1 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:36.941385 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e4804b98-914b-4ece-84bc-41eda96b86d1 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:36.963534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-e4804b98-914b-4ece-84bc-41eda96b86d1 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Getting quotas for project a2b7e30f79bf42e497c53c091ad0a106. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:52:36.969907 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-e4804b98-914b-4ece-84bc-41eda96b86d1 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Getting quotas for user 9c03c67e0c4c4de7a186f28ac10d0b92 and project a2b7e30f79bf42e497c53c091ad0a106. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:52:36.984411 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e4804b98-914b-4ece-84bc-41eda96b86d1 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:52:36.986983 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e4804b98-914b-4ece-84bc-41eda96b86d1 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:52:37.053029 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e4804b98-914b-4ece-84bc-41eda96b86d1 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.098874 Sep 24 20:52:37.054190 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 424/853] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:52:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 1101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:52:37.060316 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c7fd5c80-ccc3-4a6b-b0db-8a345640e630 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:37.062095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c7fd5c80-ccc3-4a6b-b0db-8a345640e630 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:37.072756 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c7fd5c80-ccc3-4a6b-b0db-8a345640e630 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:37.073540 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c7fd5c80-ccc3-4a6b-b0db-8a345640e630 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:37.074138 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c7fd5c80-ccc3-4a6b-b0db-8a345640e630 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:37.075142 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c7fd5c80-ccc3-4a6b-b0db-8a345640e630 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:37.075708 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c7fd5c80-ccc3-4a6b-b0db-8a345640e630 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:37.088267 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c7fd5c80-ccc3-4a6b-b0db-8a345640e630 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:37.218861 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-d51b0140-b1dd-4473-91f1-3368315dcba9 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:52:37.219650 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-d51b0140-b1dd-4473-91f1-3368315dcba9 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:52:37.220341 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-d51b0140-b1dd-4473-91f1-3368315dcba9 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:52:37.221196 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-d51b0140-b1dd-4473-91f1-3368315dcba9 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:52:37.221798 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-d51b0140-b1dd-4473-91f1-3368315dcba9 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:52:37.234947 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d51b0140-b1dd-4473-91f1-3368315dcba9 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:37.235600 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d51b0140-b1dd-4473-91f1-3368315dcba9 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:37.236112 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d51b0140-b1dd-4473-91f1-3368315dcba9 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:37.237179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d51b0140-b1dd-4473-91f1-3368315dcba9 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:37.237715 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d51b0140-b1dd-4473-91f1-3368315dcba9 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:37.238441 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d51b0140-b1dd-4473-91f1-3368315dcba9 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:37.317590 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-d51b0140-b1dd-4473-91f1-3368315dcba9 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Getting quotas for project e175cb4032ec4e6aa900141abbaa04c4. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:52:37.335987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-d51b0140-b1dd-4473-91f1-3368315dcba9 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Getting quotas for user 6db52cb259fa426d860f9c9a48a149f3 and project e175cb4032ec4e6aa900141abbaa04c4. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:52:37.358812 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c7fd5c80-ccc3-4a6b-b0db-8a345640e630 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:37.367453 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c7fd5c80-ccc3-4a6b-b0db-8a345640e630 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1470 microversion: 2.1 time: 0.311853 Sep 24 20:52:37.369430 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d51b0140-b1dd-4473-91f1-3368315dcba9 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:52:37.371168 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 425/854] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:37 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1470 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:37.373953 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d51b0140-b1dd-4473-91f1-3368315dcba9 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:52:37.386603 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-325b97d5-302d-4e0e-9aba-15da2874b448 req-a3fe7e3e-ff11-4974-9a05-98c53a6e9959 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bde8ccc3-582c-4d8e-8bcd-3c5711560a26", "name": "network-vif-unplugged", "status": "completed", "tag": "c4b07864-228d-47d5-9e64-61cd582aa91a"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:37.405580 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-325b97d5-302d-4e0e-9aba-15da2874b448 req-a3fe7e3e-ff11-4974-9a05-98c53a6e9959 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:37.407372 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-325b97d5-302d-4e0e-9aba-15da2874b448 req-a3fe7e3e-ff11-4974-9a05-98c53a6e9959 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:37.407925 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-325b97d5-302d-4e0e-9aba-15da2874b448 req-a3fe7e3e-ff11-4974-9a05-98c53a6e9959 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:37.440028 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-325b97d5-302d-4e0e-9aba-15da2874b448 req-a3fe7e3e-ff11-4974-9a05-98c53a6e9959 service nova] Creating event network-vif-unplugged:c4b07864-228d-47d5-9e64-61cd582aa91a for instance bde8ccc3-582c-4d8e-8bcd-3c5711560a26 on nch2-master-1 Sep 24 20:52:37.452414 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [req-325b97d5-302d-4e0e-9aba-15da2874b448 req-a3fe7e3e-ff11-4974-9a05-98c53a6e9959 service nova] Instance bde8ccc3-582c-4d8e-8bcd-3c5711560a26 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 20:52:37.466001 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d51b0140-b1dd-4473-91f1-3368315dcba9 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.977912 Sep 24 20:52:37.467014 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 430/855] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:52:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:52:37.473017 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4b078595-7e49-469f-bd07-8dda08bbfeb0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:37.473941 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4b078595-7e49-469f-bd07-8dda08bbfeb0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:37.485788 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-325b97d5-302d-4e0e-9aba-15da2874b448 req-a3fe7e3e-ff11-4974-9a05-98c53a6e9959 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111151 Sep 24 20:52:37.486889 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 426/856] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:52:37.498037 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4b078595-7e49-469f-bd07-8dda08bbfeb0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:37.498878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4b078595-7e49-469f-bd07-8dda08bbfeb0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:37.499629 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1693f823-586f-4ed5-ac3e-555265355853 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:37.500061 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4b078595-7e49-469f-bd07-8dda08bbfeb0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:37.500822 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4b078595-7e49-469f-bd07-8dda08bbfeb0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:37.501297 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4b078595-7e49-469f-bd07-8dda08bbfeb0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:37.501737 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4b078595-7e49-469f-bd07-8dda08bbfeb0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:37.502857 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1693f823-586f-4ed5-ac3e-555265355853 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:37.516179 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1693f823-586f-4ed5-ac3e-555265355853 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:37.516898 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1693f823-586f-4ed5-ac3e-555265355853 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:37.517545 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1693f823-586f-4ed5-ac3e-555265355853 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:37.518466 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1693f823-586f-4ed5-ac3e-555265355853 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:37.519145 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1693f823-586f-4ed5-ac3e-555265355853 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:37.519755 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1693f823-586f-4ed5-ac3e-555265355853 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:37.896814 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4b078595-7e49-469f-bd07-8dda08bbfeb0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:37.902163 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1693f823-586f-4ed5-ac3e-555265355853 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:37.912877 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4b078595-7e49-469f-bd07-8dda08bbfeb0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:37.913948 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1693f823-586f-4ed5-ac3e-555265355853 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1474 microversion: 2.1 time: 0.425652 Sep 24 20:52:37.920761 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 427/857] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:37 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1474 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:37.923312 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4b078595-7e49-469f-bd07-8dda08bbfeb0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:37.924771 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4b078595-7e49-469f-bd07-8dda08bbfeb0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e" status: 200 len: 1567 microversion: 2.25 time: 0.456599 Sep 24 20:52:37.926201 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 431/858] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:37 2022] GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e => generated 1567 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:37.935375 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-88d34f80-5a7b-4527-9ada-457a56d0d17f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:37.936782 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-88d34f80-5a7b-4527-9ada-457a56d0d17f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:37.944698 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-88d34f80-5a7b-4527-9ada-457a56d0d17f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:37.945471 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-88d34f80-5a7b-4527-9ada-457a56d0d17f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:37.946560 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-88d34f80-5a7b-4527-9ada-457a56d0d17f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:37.947502 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-88d34f80-5a7b-4527-9ada-457a56d0d17f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:37.948194 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-88d34f80-5a7b-4527-9ada-457a56d0d17f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:37.948763 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-88d34f80-5a7b-4527-9ada-457a56d0d17f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:37.951067 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c30b7df2-d931-437c-a504-354c72eba230 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:37.953492 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c30b7df2-d931-437c-a504-354c72eba230 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:37.961060 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c30b7df2-d931-437c-a504-354c72eba230 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:37.961775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c30b7df2-d931-437c-a504-354c72eba230 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:37.962445 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c30b7df2-d931-437c-a504-354c72eba230 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:37.963193 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c30b7df2-d931-437c-a504-354c72eba230 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:37.963648 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c30b7df2-d931-437c-a504-354c72eba230 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:37.964239 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c30b7df2-d931-437c-a504-354c72eba230 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:37.981483 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:38.047345 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c30b7df2-d931-437c-a504-354c72eba230 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:38.056680 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c30b7df2-d931-437c-a504-354c72eba230 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1229 microversion: 2.1 time: 0.134518 Sep 24 20:52:38.057277 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 428/859] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:37 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1229 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:38.078396 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f9dc146c-f422-46c1-91fa-714c42571a96 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:38.079474 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f9dc146c-f422-46c1-91fa-714c42571a96 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:38.201816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-88d34f80-5a7b-4527-9ada-457a56d0d17f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:38.210692 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-88d34f80-5a7b-4527-9ada-457a56d0d17f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:38.214432 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-88d34f80-5a7b-4527-9ada-457a56d0d17f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:38.219135 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-88d34f80-5a7b-4527-9ada-457a56d0d17f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.291391 Sep 24 20:52:38.219910 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 432/860] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:37 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:38.225911 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-eb5dfc34-bd46-4a9c-af84-1d99963d63c8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:38.226801 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-eb5dfc34-bd46-4a9c-af84-1d99963d63c8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: fc6a752b-8418-4657-8e37-3d9259b45d4e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:38.233591 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eb5dfc34-bd46-4a9c-af84-1d99963d63c8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:38.234469 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eb5dfc34-bd46-4a9c-af84-1d99963d63c8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:38.235114 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eb5dfc34-bd46-4a9c-af84-1d99963d63c8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:38.236165 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eb5dfc34-bd46-4a9c-af84-1d99963d63c8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:38.236634 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eb5dfc34-bd46-4a9c-af84-1d99963d63c8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:38.237219 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eb5dfc34-bd46-4a9c-af84-1d99963d63c8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:38.242396 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f9dc146c-f422-46c1-91fa-714c42571a96 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:38.250289 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f9dc146c-f422-46c1-91fa-714c42571a96 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 200 len: 1224 microversion: 2.1 time: 0.178270 Sep 24 20:52:38.253843 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 429/861] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:38 2022] GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 1224 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:38.397053 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9ec9a55b-400e-43ee-a115-904df528d10e tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:38.397922 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9ec9a55b-400e-43ee-a115-904df528d10e tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:38.403956 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ec9a55b-400e-43ee-a115-904df528d10e tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:38.404479 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ec9a55b-400e-43ee-a115-904df528d10e tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:38.404928 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ec9a55b-400e-43ee-a115-904df528d10e tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:38.405648 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ec9a55b-400e-43ee-a115-904df528d10e tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:38.406112 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ec9a55b-400e-43ee-a115-904df528d10e tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:38.406559 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ec9a55b-400e-43ee-a115-904df528d10e tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:38.545245 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-eb5dfc34-bd46-4a9c-af84-1d99963d63c8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:38.553905 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-eb5dfc34-bd46-4a9c-af84-1d99963d63c8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/fc6a752b-8418-4657-8e37-3d9259b45d4e" status: 200 len: 1468 microversion: 2.1 time: 0.332624 Sep 24 20:52:38.555177 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 433/862] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:38 2022] GET /compute/v2.1/servers/fc6a752b-8418-4657-8e37-3d9259b45d4e => generated 1468 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:38.577047 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4e8a6076-49fe-435e-8a20-03ac7991e042 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:38.577669 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4e8a6076-49fe-435e-8a20-03ac7991e042 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 1de24cda-52fe-42b6-8639-4bb3c77b5eb7] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:38.585108 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e8a6076-49fe-435e-8a20-03ac7991e042 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:38.585795 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e8a6076-49fe-435e-8a20-03ac7991e042 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:38.586239 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e8a6076-49fe-435e-8a20-03ac7991e042 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:38.586979 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e8a6076-49fe-435e-8a20-03ac7991e042 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:38.587447 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e8a6076-49fe-435e-8a20-03ac7991e042 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:38.587880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e8a6076-49fe-435e-8a20-03ac7991e042 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:38.657811 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9ec9a55b-400e-43ee-a115-904df528d10e tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:38.666314 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9ec9a55b-400e-43ee-a115-904df528d10e tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1470 microversion: 2.1 time: 0.273401 Sep 24 20:52:38.666929 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 430/863] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:38 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1470 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:52:38.774621 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-04b157f2-a4e0-48d4-a9f3-35ec68f8b483 req-cf19f207-8ec8-4983-8892-951b4f0f6908 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca2ec54c-f6d0-43a4-abf4-c35d1cad952e", "name": "network-vif-unplugged", "status": "completed", "tag": "6259f434-7655-415c-a21b-246b0076fb23"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:38.784592 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-04b157f2-a4e0-48d4-a9f3-35ec68f8b483 req-cf19f207-8ec8-4983-8892-951b4f0f6908 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:38.785245 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-04b157f2-a4e0-48d4-a9f3-35ec68f8b483 req-cf19f207-8ec8-4983-8892-951b4f0f6908 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:38.785677 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-04b157f2-a4e0-48d4-a9f3-35ec68f8b483 req-cf19f207-8ec8-4983-8892-951b4f0f6908 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:38.799989 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-04b157f2-a4e0-48d4-a9f3-35ec68f8b483 req-cf19f207-8ec8-4983-8892-951b4f0f6908 service nova] Creating event network-vif-unplugged:6259f434-7655-415c-a21b-246b0076fb23 for instance ca2ec54c-f6d0-43a4-abf4-c35d1cad952e on nch2-master-1 Sep 24 20:52:38.806335 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-04b157f2-a4e0-48d4-a9f3-35ec68f8b483 req-cf19f207-8ec8-4983-8892-951b4f0f6908 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037388 Sep 24 20:52:38.806967 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 431/864] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:52:38.810005 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4e8a6076-49fe-435e-8a20-03ac7991e042 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:38.818437 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4e8a6076-49fe-435e-8a20-03ac7991e042 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/1de24cda-52fe-42b6-8639-4bb3c77b5eb7" status: 200 len: 1318 microversion: 2.1 time: 0.245404 Sep 24 20:52:38.819209 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 434/865] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:38 2022] GET /compute/v2.1/servers/1de24cda-52fe-42b6-8639-4bb3c77b5eb7 => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:52:38.946127 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ec8c066e-4874-4814-80cc-f0bf3813459f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:38.946862 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ec8c066e-4874-4814-80cc-f0bf3813459f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:38.953125 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ec8c066e-4874-4814-80cc-f0bf3813459f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:38.953757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ec8c066e-4874-4814-80cc-f0bf3813459f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:38.954025 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ec8c066e-4874-4814-80cc-f0bf3813459f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:38.954929 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ec8c066e-4874-4814-80cc-f0bf3813459f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:38.955706 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ec8c066e-4874-4814-80cc-f0bf3813459f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:38.956141 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ec8c066e-4874-4814-80cc-f0bf3813459f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:38.956493 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-761de717-1df4-420c-ae46-3cede8b394ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:38.957442 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-761de717-1df4-420c-ae46-3cede8b394ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:38.965212 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-761de717-1df4-420c-ae46-3cede8b394ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:38.965704 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-761de717-1df4-420c-ae46-3cede8b394ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:38.966423 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-761de717-1df4-420c-ae46-3cede8b394ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:38.967337 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-761de717-1df4-420c-ae46-3cede8b394ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:38.967947 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-761de717-1df4-420c-ae46-3cede8b394ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:38.968536 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-761de717-1df4-420c-ae46-3cede8b394ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:39.474843 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-761de717-1df4-420c-ae46-3cede8b394ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:39.484202 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-761de717-1df4-420c-ae46-3cede8b394ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:39.485982 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-761de717-1df4-420c-ae46-3cede8b394ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:39.487152 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-761de717-1df4-420c-ae46-3cede8b394ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e" status: 200 len: 1567 microversion: 2.25 time: 0.535545 Sep 24 20:52:39.488080 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 435/866] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:38 2022] GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e => generated 1567 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:52:39.496043 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ec8c066e-4874-4814-80cc-f0bf3813459f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:39.501553 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-353c5648-c8a0-4830-a33e-f4f04c73a6bc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:39.502834 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-353c5648-c8a0-4830-a33e-f4f04c73a6bc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:39.504472 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ec8c066e-4874-4814-80cc-f0bf3813459f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1472 microversion: 2.1 time: 0.562931 Sep 24 20:52:39.514883 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 432/867] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:38 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1472 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:39.520349 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d0b7788d-bb82-445b-9bc5-4826ac03c391 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:39.522079 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d0b7788d-bb82-445b-9bc5-4826ac03c391 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:39.523860 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-353c5648-c8a0-4830-a33e-f4f04c73a6bc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:39.524373 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-353c5648-c8a0-4830-a33e-f4f04c73a6bc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:39.524815 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-353c5648-c8a0-4830-a33e-f4f04c73a6bc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:39.525541 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-353c5648-c8a0-4830-a33e-f4f04c73a6bc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:39.525999 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-353c5648-c8a0-4830-a33e-f4f04c73a6bc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:39.526426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-353c5648-c8a0-4830-a33e-f4f04c73a6bc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:39.530962 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d0b7788d-bb82-445b-9bc5-4826ac03c391 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:39.531679 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d0b7788d-bb82-445b-9bc5-4826ac03c391 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:39.532121 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d0b7788d-bb82-445b-9bc5-4826ac03c391 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:39.532996 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d0b7788d-bb82-445b-9bc5-4826ac03c391 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:39.533621 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d0b7788d-bb82-445b-9bc5-4826ac03c391 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:39.534059 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d0b7788d-bb82-445b-9bc5-4826ac03c391 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:39.614252 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-353c5648-c8a0-4830-a33e-f4f04c73a6bc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:39.616070 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d0b7788d-bb82-445b-9bc5-4826ac03c391 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:39.622756 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-353c5648-c8a0-4830-a33e-f4f04c73a6bc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1285 microversion: 2.1 time: 0.133457 Sep 24 20:52:39.623445 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 436/868] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:39 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:39.624144 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d0b7788d-bb82-445b-9bc5-4826ac03c391 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:39.625622 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d0b7788d-bb82-445b-9bc5-4826ac03c391 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:39.628181 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-160e9e39-1f2d-495c-984a-ab5a1f5df933 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:39.628793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-160e9e39-1f2d-495c-984a-ab5a1f5df933 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:39.636002 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-160e9e39-1f2d-495c-984a-ab5a1f5df933 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:39.637550 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-160e9e39-1f2d-495c-984a-ab5a1f5df933 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:39.638207 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-160e9e39-1f2d-495c-984a-ab5a1f5df933 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:39.639152 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-160e9e39-1f2d-495c-984a-ab5a1f5df933 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:39.639621 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-160e9e39-1f2d-495c-984a-ab5a1f5df933 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:39.640054 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-160e9e39-1f2d-495c-984a-ab5a1f5df933 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:39.644291 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:39.647723 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d0b7788d-bb82-445b-9bc5-4826ac03c391 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.140740 Sep 24 20:52:39.648498 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 433/869] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:39 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:39.658945 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-cbf85f63-8355-4e7b-aa14-338499f5ef76 req-32a84074-1abf-47d3-8748-30b90697c2b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1de24cda-52fe-42b6-8639-4bb3c77b5eb7", "name": "network-vif-plugged", "status": "completed", "tag": "8c825e40-7e4d-4161-a9bf-cab2864992bd"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:39.670616 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-cbf85f63-8355-4e7b-aa14-338499f5ef76 req-32a84074-1abf-47d3-8748-30b90697c2b9 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:39.671015 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-cbf85f63-8355-4e7b-aa14-338499f5ef76 req-32a84074-1abf-47d3-8748-30b90697c2b9 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:39.671444 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-cbf85f63-8355-4e7b-aa14-338499f5ef76 req-32a84074-1abf-47d3-8748-30b90697c2b9 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:39.683943 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-cbf85f63-8355-4e7b-aa14-338499f5ef76 req-32a84074-1abf-47d3-8748-30b90697c2b9 service nova] Creating event network-vif-plugged:8c825e40-7e4d-4161-a9bf-cab2864992bd for instance 1de24cda-52fe-42b6-8639-4bb3c77b5eb7 on nch1-master-1 Sep 24 20:52:39.690530 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-cbf85f63-8355-4e7b-aa14-338499f5ef76 req-32a84074-1abf-47d3-8748-30b90697c2b9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035844 Sep 24 20:52:39.691372 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 434/870] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:52:39.696981 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-95a2f881-b187-49cc-8ec2-345f775b3358 req-ad510631-2802-4f92-90c3-a584e5dbe0b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bde8ccc3-582c-4d8e-8bcd-3c5711560a26", "tag": "c4b07864-228d-47d5-9e64-61cd582aa91a"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:39.706905 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-95a2f881-b187-49cc-8ec2-345f775b3358 req-ad510631-2802-4f92-90c3-a584e5dbe0b9 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:39.707387 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-95a2f881-b187-49cc-8ec2-345f775b3358 req-ad510631-2802-4f92-90c3-a584e5dbe0b9 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:39.707822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-95a2f881-b187-49cc-8ec2-345f775b3358 req-ad510631-2802-4f92-90c3-a584e5dbe0b9 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:39.711060 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-160e9e39-1f2d-495c-984a-ab5a1f5df933 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:39.721274 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-95a2f881-b187-49cc-8ec2-345f775b3358 req-ad510631-2802-4f92-90c3-a584e5dbe0b9 service nova] Creating event network-changed:c4b07864-228d-47d5-9e64-61cd582aa91a for instance bde8ccc3-582c-4d8e-8bcd-3c5711560a26 on nch2-master-1 Sep 24 20:52:39.728139 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [req-95a2f881-b187-49cc-8ec2-345f775b3358 req-ad510631-2802-4f92-90c3-a584e5dbe0b9 service nova] Instance bde8ccc3-582c-4d8e-8bcd-3c5711560a26 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 20:52:39.730143 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-160e9e39-1f2d-495c-984a-ab5a1f5df933 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 200 len: 1220 microversion: 2.1 time: 0.104948 Sep 24 20:52:39.732195 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 437/871] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:39 2022] GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 1220 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:39.737790 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-abf85e60-93e9-4757-a33d-1e6ae6e1da44 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:39.738601 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-abf85e60-93e9-4757-a33d-1e6ae6e1da44 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:39.746355 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-abf85e60-93e9-4757-a33d-1e6ae6e1da44 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:39.747190 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-abf85e60-93e9-4757-a33d-1e6ae6e1da44 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:39.747816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-abf85e60-93e9-4757-a33d-1e6ae6e1da44 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:39.748816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-abf85e60-93e9-4757-a33d-1e6ae6e1da44 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:39.749438 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-abf85e60-93e9-4757-a33d-1e6ae6e1da44 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:39.750016 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-abf85e60-93e9-4757-a33d-1e6ae6e1da44 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:39.766243 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-95a2f881-b187-49cc-8ec2-345f775b3358 req-ad510631-2802-4f92-90c3-a584e5dbe0b9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073663 Sep 24 20:52:39.767121 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 435/872] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:52:39.842452 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7fd4f35b-3023-4c66-a4f0-4b1b574aad02 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:39.843543 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7fd4f35b-3023-4c66-a4f0-4b1b574aad02 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 1de24cda-52fe-42b6-8639-4bb3c77b5eb7] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:39.851090 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7fd4f35b-3023-4c66-a4f0-4b1b574aad02 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:39.851964 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7fd4f35b-3023-4c66-a4f0-4b1b574aad02 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:39.852618 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7fd4f35b-3023-4c66-a4f0-4b1b574aad02 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:39.853580 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7fd4f35b-3023-4c66-a4f0-4b1b574aad02 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:39.854261 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7fd4f35b-3023-4c66-a4f0-4b1b574aad02 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:39.854823 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7fd4f35b-3023-4c66-a4f0-4b1b574aad02 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:40.037463 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-abf85e60-93e9-4757-a33d-1e6ae6e1da44 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:40.045623 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-abf85e60-93e9-4757-a33d-1e6ae6e1da44 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1470 microversion: 2.1 time: 0.312201 Sep 24 20:52:40.046453 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 438/873] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:39 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1470 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:40.068264 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7fd4f35b-3023-4c66-a4f0-4b1b574aad02 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:40.076622 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7fd4f35b-3023-4c66-a4f0-4b1b574aad02 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/1de24cda-52fe-42b6-8639-4bb3c77b5eb7" status: 200 len: 1318 microversion: 2.1 time: 0.238873 Sep 24 20:52:40.077210 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 436/874] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:39 2022] GET /compute/v2.1/servers/1de24cda-52fe-42b6-8639-4bb3c77b5eb7 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:52:40.515089 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2889b8a8-11e9-4d85-87f9-8bade4db4b9c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:40.515798 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2889b8a8-11e9-4d85-87f9-8bade4db4b9c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:40.522613 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2889b8a8-11e9-4d85-87f9-8bade4db4b9c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:40.523103 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2889b8a8-11e9-4d85-87f9-8bade4db4b9c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:40.523548 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2889b8a8-11e9-4d85-87f9-8bade4db4b9c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:40.524282 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2889b8a8-11e9-4d85-87f9-8bade4db4b9c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:40.524742 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2889b8a8-11e9-4d85-87f9-8bade4db4b9c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:40.525174 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2889b8a8-11e9-4d85-87f9-8bade4db4b9c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:40.530391 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6070ac99-b9f4-47d2-9b1f-4619c4d7b031 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:40.530824 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6070ac99-b9f4-47d2-9b1f-4619c4d7b031 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:40.537495 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6070ac99-b9f4-47d2-9b1f-4619c4d7b031 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:40.537988 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6070ac99-b9f4-47d2-9b1f-4619c4d7b031 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:40.538428 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6070ac99-b9f4-47d2-9b1f-4619c4d7b031 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:40.539183 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6070ac99-b9f4-47d2-9b1f-4619c4d7b031 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:40.539647 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6070ac99-b9f4-47d2-9b1f-4619c4d7b031 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:40.540074 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6070ac99-b9f4-47d2-9b1f-4619c4d7b031 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:40.753318 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2889b8a8-11e9-4d85-87f9-8bade4db4b9c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:40.762524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6070ac99-b9f4-47d2-9b1f-4619c4d7b031 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:40.764457 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2889b8a8-11e9-4d85-87f9-8bade4db4b9c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:40.765955 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2889b8a8-11e9-4d85-87f9-8bade4db4b9c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:40.767369 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2889b8a8-11e9-4d85-87f9-8bade4db4b9c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e" status: 200 len: 1567 microversion: 2.25 time: 0.256267 Sep 24 20:52:40.767936 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 439/875] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:40 2022] GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e => generated 1567 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:40.773104 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f542d8a9-1d49-4b89-bdff-143148cb17c9 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:40.773725 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f542d8a9-1d49-4b89-bdff-143148cb17c9 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:40.780065 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f542d8a9-1d49-4b89-bdff-143148cb17c9 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:40.780559 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f542d8a9-1d49-4b89-bdff-143148cb17c9 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:40.781000 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f542d8a9-1d49-4b89-bdff-143148cb17c9 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:40.781707 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f542d8a9-1d49-4b89-bdff-143148cb17c9 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:40.782167 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f542d8a9-1d49-4b89-bdff-143148cb17c9 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:40.782626 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f542d8a9-1d49-4b89-bdff-143148cb17c9 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:40.790777 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6070ac99-b9f4-47d2-9b1f-4619c4d7b031 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1472 microversion: 2.1 time: 0.265395 Sep 24 20:52:40.791686 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 437/876] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:40 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1472 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:52:40.796372 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-de32b42a-6ebf-4d31-a1c7-3a7b661cbaa1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:40.797062 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-de32b42a-6ebf-4d31-a1c7-3a7b661cbaa1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:40.804100 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de32b42a-6ebf-4d31-a1c7-3a7b661cbaa1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:40.804687 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de32b42a-6ebf-4d31-a1c7-3a7b661cbaa1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:40.805221 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de32b42a-6ebf-4d31-a1c7-3a7b661cbaa1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:40.806136 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de32b42a-6ebf-4d31-a1c7-3a7b661cbaa1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:40.806725 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de32b42a-6ebf-4d31-a1c7-3a7b661cbaa1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:40.807250 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de32b42a-6ebf-4d31-a1c7-3a7b661cbaa1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:40.857500 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f542d8a9-1d49-4b89-bdff-143148cb17c9 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:40.865822 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f542d8a9-1d49-4b89-bdff-143148cb17c9 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1285 microversion: 2.1 time: 0.096650 Sep 24 20:52:40.874695 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 440/877] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:40 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:40.874695 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ef3b0151-186f-49a6-b59d-1faa56e968ad tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:40.874695 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ef3b0151-186f-49a6-b59d-1faa56e968ad tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:40.878740 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef3b0151-186f-49a6-b59d-1faa56e968ad tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:40.879234 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef3b0151-186f-49a6-b59d-1faa56e968ad tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:40.879685 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef3b0151-186f-49a6-b59d-1faa56e968ad tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:40.881012 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef3b0151-186f-49a6-b59d-1faa56e968ad tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:40.881490 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef3b0151-186f-49a6-b59d-1faa56e968ad tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:40.881927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef3b0151-186f-49a6-b59d-1faa56e968ad tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:40.883584 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-de32b42a-6ebf-4d31-a1c7-3a7b661cbaa1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:40.891701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-de32b42a-6ebf-4d31-a1c7-3a7b661cbaa1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:40.893153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-de32b42a-6ebf-4d31-a1c7-3a7b661cbaa1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:40.898880 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-de32b42a-6ebf-4d31-a1c7-3a7b661cbaa1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.106304 Sep 24 20:52:40.899461 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 438/878] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:40 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:40.903760 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-6740feb6-d510-4f6f-bf18-787e8a30ebda req-15b547cd-1740-4434-9834-a1e7e4003071 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca2ec54c-f6d0-43a4-abf4-c35d1cad952e", "tag": "6259f434-7655-415c-a21b-246b0076fb23"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:40.912978 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6740feb6-d510-4f6f-bf18-787e8a30ebda req-15b547cd-1740-4434-9834-a1e7e4003071 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:40.913458 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6740feb6-d510-4f6f-bf18-787e8a30ebda req-15b547cd-1740-4434-9834-a1e7e4003071 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:40.913891 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6740feb6-d510-4f6f-bf18-787e8a30ebda req-15b547cd-1740-4434-9834-a1e7e4003071 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:40.928565 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-6740feb6-d510-4f6f-bf18-787e8a30ebda req-15b547cd-1740-4434-9834-a1e7e4003071 service nova] Creating event network-changed:6259f434-7655-415c-a21b-246b0076fb23 for instance ca2ec54c-f6d0-43a4-abf4-c35d1cad952e on nch2-master-1 Sep 24 20:52:40.933443 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-6740feb6-d510-4f6f-bf18-787e8a30ebda req-15b547cd-1740-4434-9834-a1e7e4003071 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032876 Sep 24 20:52:40.934056 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 439/879] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:52:40.954918 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ef3b0151-186f-49a6-b59d-1faa56e968ad tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:40.963628 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ef3b0151-186f-49a6-b59d-1faa56e968ad tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 200 len: 1220 microversion: 2.1 time: 0.096296 Sep 24 20:52:40.964204 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 441/880] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:40 2022] GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:41.070313 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ae6a55c1-4eee-45aa-a5b0-372a4bcc1d62 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:41.071050 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ae6a55c1-4eee-45aa-a5b0-372a4bcc1d62 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:41.074164 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:41.078914 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ae6a55c1-4eee-45aa-a5b0-372a4bcc1d62 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:41.079275 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ae6a55c1-4eee-45aa-a5b0-372a4bcc1d62 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:41.080003 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ae6a55c1-4eee-45aa-a5b0-372a4bcc1d62 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:41.080726 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ae6a55c1-4eee-45aa-a5b0-372a4bcc1d62 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:41.081186 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ae6a55c1-4eee-45aa-a5b0-372a4bcc1d62 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:41.081619 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ae6a55c1-4eee-45aa-a5b0-372a4bcc1d62 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:41.099634 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a9abed18-00d9-4452-8e1d-17126e74f9c7 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:41.100679 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a9abed18-00d9-4452-8e1d-17126e74f9c7 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 1de24cda-52fe-42b6-8639-4bb3c77b5eb7] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:41.106842 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a9abed18-00d9-4452-8e1d-17126e74f9c7 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:41.107339 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a9abed18-00d9-4452-8e1d-17126e74f9c7 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:41.108003 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a9abed18-00d9-4452-8e1d-17126e74f9c7 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:41.108729 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a9abed18-00d9-4452-8e1d-17126e74f9c7 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:41.109197 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a9abed18-00d9-4452-8e1d-17126e74f9c7 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:41.109634 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a9abed18-00d9-4452-8e1d-17126e74f9c7 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:41.284276 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ae6a55c1-4eee-45aa-a5b0-372a4bcc1d62 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:41.289679 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a9abed18-00d9-4452-8e1d-17126e74f9c7 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:41.294582 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ae6a55c1-4eee-45aa-a5b0-372a4bcc1d62 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1470 microversion: 2.1 time: 0.229035 Sep 24 20:52:41.297886 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a9abed18-00d9-4452-8e1d-17126e74f9c7 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/1de24cda-52fe-42b6-8639-4bb3c77b5eb7" status: 200 len: 1318 microversion: 2.1 time: 0.202241 Sep 24 20:52:41.298468 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 442/881] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:41 2022] GET /compute/v2.1/servers/1de24cda-52fe-42b6-8639-4bb3c77b5eb7 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:52:41.302970 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 440/882] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:41 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1470 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:41.793544 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-829dce3d-1b8a-4444-8c30-355459dda48e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:41.794153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-829dce3d-1b8a-4444-8c30-355459dda48e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:41.800566 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-829dce3d-1b8a-4444-8c30-355459dda48e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:41.801040 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-829dce3d-1b8a-4444-8c30-355459dda48e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:41.801471 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-829dce3d-1b8a-4444-8c30-355459dda48e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:41.803020 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-829dce3d-1b8a-4444-8c30-355459dda48e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:41.803578 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-829dce3d-1b8a-4444-8c30-355459dda48e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:41.804006 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-829dce3d-1b8a-4444-8c30-355459dda48e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:41.815318 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-08bc462a-cd2f-4d0b-8c73-059d54266218 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:41.815937 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-08bc462a-cd2f-4d0b-8c73-059d54266218 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:41.822921 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-08bc462a-cd2f-4d0b-8c73-059d54266218 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:41.823418 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-08bc462a-cd2f-4d0b-8c73-059d54266218 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:41.823865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-08bc462a-cd2f-4d0b-8c73-059d54266218 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:41.824582 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-08bc462a-cd2f-4d0b-8c73-059d54266218 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:41.825044 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-08bc462a-cd2f-4d0b-8c73-059d54266218 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:41.825478 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-08bc462a-cd2f-4d0b-8c73-059d54266218 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:42.008964 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-829dce3d-1b8a-4444-8c30-355459dda48e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:42.013059 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-08bc462a-cd2f-4d0b-8c73-059d54266218 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:42.017479 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-829dce3d-1b8a-4444-8c30-355459dda48e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:42.018963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-829dce3d-1b8a-4444-8c30-355459dda48e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:42.020127 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-829dce3d-1b8a-4444-8c30-355459dda48e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e" status: 200 len: 1567 microversion: 2.25 time: 0.230611 Sep 24 20:52:42.021264 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 443/883] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:41 2022] GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e => generated 1567 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:42.021402 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-08bc462a-cd2f-4d0b-8c73-059d54266218 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1469 microversion: 2.1 time: 0.209480 Sep 24 20:52:42.022112 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 441/884] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:41 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1469 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:52:42.025837 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-67003336-e26c-4d73-a47a-afef5a3eb37b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:42.026449 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-67003336-e26c-4d73-a47a-afef5a3eb37b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:42.026681 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-29879a00-8a5a-4cf6-aaac-3b9b033a279f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:42.027300 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-29879a00-8a5a-4cf6-aaac-3b9b033a279f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:42.033025 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-29879a00-8a5a-4cf6-aaac-3b9b033a279f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:42.033743 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-29879a00-8a5a-4cf6-aaac-3b9b033a279f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:42.034385 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-29879a00-8a5a-4cf6-aaac-3b9b033a279f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:42.034606 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67003336-e26c-4d73-a47a-afef5a3eb37b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:42.035320 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67003336-e26c-4d73-a47a-afef5a3eb37b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:42.035709 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-29879a00-8a5a-4cf6-aaac-3b9b033a279f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:42.035820 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67003336-e26c-4d73-a47a-afef5a3eb37b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:42.037068 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-29879a00-8a5a-4cf6-aaac-3b9b033a279f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:42.037433 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67003336-e26c-4d73-a47a-afef5a3eb37b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:42.037904 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-29879a00-8a5a-4cf6-aaac-3b9b033a279f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:42.038197 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67003336-e26c-4d73-a47a-afef5a3eb37b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:42.038814 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67003336-e26c-4d73-a47a-afef5a3eb37b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:42.120557 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-67003336-e26c-4d73-a47a-afef5a3eb37b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:42.122278 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-29879a00-8a5a-4cf6-aaac-3b9b033a279f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:42.128477 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-67003336-e26c-4d73-a47a-afef5a3eb37b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1285 microversion: 2.1 time: 0.106216 Sep 24 20:52:42.129266 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 444/885] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:42 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:42.131662 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-29879a00-8a5a-4cf6-aaac-3b9b033a279f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:42.133200 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-29879a00-8a5a-4cf6-aaac-3b9b033a279f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:42.133839 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4ca20291-2a9e-4bb5-b784-45ad9d9a6835 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:42.134447 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4ca20291-2a9e-4bb5-b784-45ad9d9a6835 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:42.138726 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-29879a00-8a5a-4cf6-aaac-3b9b033a279f tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.115594 Sep 24 20:52:42.139582 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 442/886] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:42 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:42.140116 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ca20291-2a9e-4bb5-b784-45ad9d9a6835 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:42.140603 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ca20291-2a9e-4bb5-b784-45ad9d9a6835 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:42.141658 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ca20291-2a9e-4bb5-b784-45ad9d9a6835 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:42.142368 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ca20291-2a9e-4bb5-b784-45ad9d9a6835 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:42.143370 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ca20291-2a9e-4bb5-b784-45ad9d9a6835 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:42.143370 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ca20291-2a9e-4bb5-b784-45ad9d9a6835 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:42.164594 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1e514d34-2838-40b1-a7bb-4c9e2221c553 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:42.165160 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1e514d34-2838-40b1-a7bb-4c9e2221c553 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:42.171952 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e514d34-2838-40b1-a7bb-4c9e2221c553 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:42.172532 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e514d34-2838-40b1-a7bb-4c9e2221c553 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:42.173038 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e514d34-2838-40b1-a7bb-4c9e2221c553 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:42.173837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e514d34-2838-40b1-a7bb-4c9e2221c553 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:42.174363 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e514d34-2838-40b1-a7bb-4c9e2221c553 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:42.174884 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e514d34-2838-40b1-a7bb-4c9e2221c553 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:42.214489 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4ca20291-2a9e-4bb5-b784-45ad9d9a6835 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:42.222331 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4ca20291-2a9e-4bb5-b784-45ad9d9a6835 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 200 len: 1220 microversion: 2.1 time: 0.092296 Sep 24 20:52:42.222997 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 445/887] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:42 2022] GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:42.237970 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1e514d34-2838-40b1-a7bb-4c9e2221c553 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "POST /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26/action" status: 204 len: 0 microversion: 2.1 time: 0.096716 Sep 24 20:52:42.238722 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 443/888] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:52:42 2022] POST /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26/action => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:52:42.246992 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-59e4d235-bfa6-4eee-906f-dbe834bcde6f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:42.247613 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-59e4d235-bfa6-4eee-906f-dbe834bcde6f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:42.253536 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-59e4d235-bfa6-4eee-906f-dbe834bcde6f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:42.254057 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-59e4d235-bfa6-4eee-906f-dbe834bcde6f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:42.254461 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-59e4d235-bfa6-4eee-906f-dbe834bcde6f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:42.255935 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-59e4d235-bfa6-4eee-906f-dbe834bcde6f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:42.256534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-59e4d235-bfa6-4eee-906f-dbe834bcde6f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:42.256963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-59e4d235-bfa6-4eee-906f-dbe834bcde6f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:42.320148 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-24cc1117-f2f6-4247-8212-6403d4826c41 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:42.321251 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-24cc1117-f2f6-4247-8212-6403d4826c41 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:42.329517 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24cc1117-f2f6-4247-8212-6403d4826c41 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:42.330126 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24cc1117-f2f6-4247-8212-6403d4826c41 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:42.331296 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24cc1117-f2f6-4247-8212-6403d4826c41 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:42.331504 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24cc1117-f2f6-4247-8212-6403d4826c41 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:42.332293 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24cc1117-f2f6-4247-8212-6403d4826c41 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:42.332477 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24cc1117-f2f6-4247-8212-6403d4826c41 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:42.443955 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-59e4d235-bfa6-4eee-906f-dbe834bcde6f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:42.460367 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-59e4d235-bfa6-4eee-906f-dbe834bcde6f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1469 microversion: 2.1 time: 0.216944 Sep 24 20:52:42.478312 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 446/889] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:42 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1469 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:42.478312 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ff807c0d-4a78-4883-909b-1dd5a83fc76b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:42.478312 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ff807c0d-4a78-4883-909b-1dd5a83fc76b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 1de24cda-52fe-42b6-8639-4bb3c77b5eb7] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:42.483390 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff807c0d-4a78-4883-909b-1dd5a83fc76b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:42.483943 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff807c0d-4a78-4883-909b-1dd5a83fc76b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:42.484383 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff807c0d-4a78-4883-909b-1dd5a83fc76b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:42.485159 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff807c0d-4a78-4883-909b-1dd5a83fc76b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:42.485625 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff807c0d-4a78-4883-909b-1dd5a83fc76b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:42.486050 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff807c0d-4a78-4883-909b-1dd5a83fc76b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:42.501466 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-24cc1117-f2f6-4247-8212-6403d4826c41 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:42.509700 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-24cc1117-f2f6-4247-8212-6403d4826c41 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1470 microversion: 2.1 time: 0.195625 Sep 24 20:52:42.510280 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 444/890] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:42 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1470 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:42.653900 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ff807c0d-4a78-4883-909b-1dd5a83fc76b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:42.662782 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ff807c0d-4a78-4883-909b-1dd5a83fc76b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/1de24cda-52fe-42b6-8639-4bb3c77b5eb7" status: 200 len: 1467 microversion: 2.1 time: 0.191229 Sep 24 20:52:42.671120 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 447/891] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:42 2022] GET /compute/v2.1/servers/1de24cda-52fe-42b6-8639-4bb3c77b5eb7 => generated 1467 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:42.686583 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9318f43b-d2c2-4e00-92ec-4cb771c7b1a6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:42.692516 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9318f43b-d2c2-4e00-92ec-4cb771c7b1a6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:42.694023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9318f43b-d2c2-4e00-92ec-4cb771c7b1a6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Searching by: {'reservation_id': 'r-f19wku6i', 'deleted': False, 'project_id': '73bec7c48b07450f95a29a35e113153d'} {{(pid=140517) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 20:52:42.700089 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9318f43b-d2c2-4e00-92ec-4cb771c7b1a6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:42.700679 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9318f43b-d2c2-4e00-92ec-4cb771c7b1a6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:42.701224 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9318f43b-d2c2-4e00-92ec-4cb771c7b1a6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:42.702094 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9318f43b-d2c2-4e00-92ec-4cb771c7b1a6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:42.702682 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9318f43b-d2c2-4e00-92ec-4cb771c7b1a6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:42.703212 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9318f43b-d2c2-4e00-92ec-4cb771c7b1a6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:42.744436 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-fc5485b1-5883-4047-ba06-1c8162301975 req-587c6ec7-380f-4e6f-9c14-eeb1d989fd1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bde8ccc3-582c-4d8e-8bcd-3c5711560a26", "name": "network-vif-plugged", "status": "completed", "tag": "c4b07864-228d-47d5-9e64-61cd582aa91a"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:42.785896 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-fc5485b1-5883-4047-ba06-1c8162301975 req-587c6ec7-380f-4e6f-9c14-eeb1d989fd1b service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:42.787280 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-fc5485b1-5883-4047-ba06-1c8162301975 req-587c6ec7-380f-4e6f-9c14-eeb1d989fd1b service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:42.788328 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-fc5485b1-5883-4047-ba06-1c8162301975 req-587c6ec7-380f-4e6f-9c14-eeb1d989fd1b service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:42.808004 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-fc5485b1-5883-4047-ba06-1c8162301975 req-587c6ec7-380f-4e6f-9c14-eeb1d989fd1b service nova] Creating event network-vif-plugged:c4b07864-228d-47d5-9e64-61cd582aa91a for instance bde8ccc3-582c-4d8e-8bcd-3c5711560a26 on nch2-master-1 Sep 24 20:52:42.815760 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [req-fc5485b1-5883-4047-ba06-1c8162301975 req-587c6ec7-380f-4e6f-9c14-eeb1d989fd1b service nova] Instance bde8ccc3-582c-4d8e-8bcd-3c5711560a26 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 20:52:42.833494 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-fc5485b1-5883-4047-ba06-1c8162301975 req-587c6ec7-380f-4e6f-9c14-eeb1d989fd1b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102471 Sep 24 20:52:42.834722 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 448/892] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:52:42.859244 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.multi_cell_list [None req-9318f43b-d2c2-4e00-92ec-4cb771c7b1a6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 20:52:42.928480 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9318f43b-d2c2-4e00-92ec-4cb771c7b1a6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:42.935040 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9318f43b-d2c2-4e00-92ec-4cb771c7b1a6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:42.935526 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9318f43b-d2c2-4e00-92ec-4cb771c7b1a6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:42.935968 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9318f43b-d2c2-4e00-92ec-4cb771c7b1a6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:43.048252 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-489b51d5-14d9-43cb-9ed3-be99e3f70968 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:43.049559 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-489b51d5-14d9-43cb-9ed3-be99e3f70968 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:43.056513 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-489b51d5-14d9-43cb-9ed3-be99e3f70968 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:43.057107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-489b51d5-14d9-43cb-9ed3-be99e3f70968 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:43.057617 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-489b51d5-14d9-43cb-9ed3-be99e3f70968 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:43.058424 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-489b51d5-14d9-43cb-9ed3-be99e3f70968 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:43.059247 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-489b51d5-14d9-43cb-9ed3-be99e3f70968 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:43.059754 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-489b51d5-14d9-43cb-9ed3-be99e3f70968 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:43.066407 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9318f43b-d2c2-4e00-92ec-4cb771c7b1a6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/detail?reservation_id=r-f19wku6i" status: 200 len: 2928 microversion: 2.1 time: 0.383707 Sep 24 20:52:43.067828 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 445/893] 10.222.0.52 () {58 vars in 1197 bytes} [Sat Sep 24 20:52:42 2022] GET /compute/v2.1/servers/detail?reservation_id=r-f19wku6i => generated 2928 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:43.092619 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5810ffc5-55b6-4512-9752-d18b9ec64664 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:43.120093 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.compute.server_groups [None req-5810ffc5-55b6-4512-9752-d18b9ec64664 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Querying cell 788aecb6-32dc-4b71-909a-be050455aded(cell1) for 2 instances {{(pid=140517) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 24 20:52:43.121097 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5810ffc5-55b6-4512-9752-d18b9ec64664 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:43.121742 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5810ffc5-55b6-4512-9752-d18b9ec64664 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:43.122374 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5810ffc5-55b6-4512-9752-d18b9ec64664 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:43.148501 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:43.157728 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5810ffc5-55b6-4512-9752-d18b9ec64664 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups/6c51a00c-efd7-44fd-a092-affeb2c54462" status: 200 len: 265 microversion: 2.1 time: 0.068869 Sep 24 20:52:43.158572 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 446/894] 10.222.0.52 () {58 vars in 1263 bytes} [Sat Sep 24 20:52:43 2022] GET /compute/v2.1/os-server-groups/6c51a00c-efd7-44fd-a092-affeb2c54462 => generated 265 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:52:43.163317 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-79695842-9a82-45e2-9dc7-6e22b8be653f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:43.163929 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-79695842-9a82-45e2-9dc7-6e22b8be653f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:43.171110 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79695842-9a82-45e2-9dc7-6e22b8be653f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:43.171971 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79695842-9a82-45e2-9dc7-6e22b8be653f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:43.172114 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79695842-9a82-45e2-9dc7-6e22b8be653f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:43.172740 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79695842-9a82-45e2-9dc7-6e22b8be653f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:43.173196 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79695842-9a82-45e2-9dc7-6e22b8be653f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:43.173809 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79695842-9a82-45e2-9dc7-6e22b8be653f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:43.205462 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-489b51d5-14d9-43cb-9ed3-be99e3f70968 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:43.233248 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-489b51d5-14d9-43cb-9ed3-be99e3f70968 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:43.241163 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-489b51d5-14d9-43cb-9ed3-be99e3f70968 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:43.243688 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-489b51d5-14d9-43cb-9ed3-be99e3f70968 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e" status: 200 len: 1567 microversion: 2.25 time: 0.199760 Sep 24 20:52:43.247117 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 449/895] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:43 2022] GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e => generated 1567 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:52:43.269742 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-79695842-9a82-45e2-9dc7-6e22b8be653f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:43.272583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f2ea95ac-29d4-40a9-82df-12fe4e81d029 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:43.273468 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f2ea95ac-29d4-40a9-82df-12fe4e81d029 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:43.280072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f2ea95ac-29d4-40a9-82df-12fe4e81d029 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:43.280658 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f2ea95ac-29d4-40a9-82df-12fe4e81d029 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:43.281180 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f2ea95ac-29d4-40a9-82df-12fe4e81d029 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:43.281721 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-79695842-9a82-45e2-9dc7-6e22b8be653f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1285 microversion: 2.1 time: 0.121293 Sep 24 20:52:43.282206 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f2ea95ac-29d4-40a9-82df-12fe4e81d029 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:43.282780 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f2ea95ac-29d4-40a9-82df-12fe4e81d029 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:43.283429 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f2ea95ac-29d4-40a9-82df-12fe4e81d029 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:43.285472 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 447/896] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:43 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:43.302555 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e74a0b75-b144-4e74-a1a2-9a2c4cca2e59 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:43.303523 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e74a0b75-b144-4e74-a1a2-9a2c4cca2e59 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] [instance: 1de24cda-52fe-42b6-8639-4bb3c77b5eb7] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:43.314013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e74a0b75-b144-4e74-a1a2-9a2c4cca2e59 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:43.314715 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e74a0b75-b144-4e74-a1a2-9a2c4cca2e59 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:43.315443 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e74a0b75-b144-4e74-a1a2-9a2c4cca2e59 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:43.328977 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e74a0b75-b144-4e74-a1a2-9a2c4cca2e59 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:43.331235 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e74a0b75-b144-4e74-a1a2-9a2c4cca2e59 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:43.331696 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e74a0b75-b144-4e74-a1a2-9a2c4cca2e59 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:43.369866 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f2ea95ac-29d4-40a9-82df-12fe4e81d029 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:43.379770 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f2ea95ac-29d4-40a9-82df-12fe4e81d029 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:43.381545 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f2ea95ac-29d4-40a9-82df-12fe4e81d029 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:43.388564 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f2ea95ac-29d4-40a9-82df-12fe4e81d029 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.139818 Sep 24 20:52:43.389443 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 450/897] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:43 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:43.394311 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-05a92f73-2c49-4eb4-8cbd-a4737c4d24f0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:43.394985 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-05a92f73-2c49-4eb4-8cbd-a4737c4d24f0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:43.414051 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05a92f73-2c49-4eb4-8cbd-a4737c4d24f0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:43.414606 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05a92f73-2c49-4eb4-8cbd-a4737c4d24f0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:43.416879 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05a92f73-2c49-4eb4-8cbd-a4737c4d24f0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:43.419811 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05a92f73-2c49-4eb4-8cbd-a4737c4d24f0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:43.420126 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05a92f73-2c49-4eb4-8cbd-a4737c4d24f0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:43.420488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05a92f73-2c49-4eb4-8cbd-a4737c4d24f0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:43.505942 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-05a92f73-2c49-4eb4-8cbd-a4737c4d24f0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:43.514388 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-05a92f73-2c49-4eb4-8cbd-a4737c4d24f0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 200 len: 1220 microversion: 2.1 time: 0.123819 Sep 24 20:52:43.515007 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 451/898] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:43 2022] GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 1220 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:43.519710 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e11c3fc7-9934-4d59-bda6-725828cc762d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:43.520330 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e11c3fc7-9934-4d59-bda6-725828cc762d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:43.529255 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e11c3fc7-9934-4d59-bda6-725828cc762d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:43.529255 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e11c3fc7-9934-4d59-bda6-725828cc762d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:43.529255 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e11c3fc7-9934-4d59-bda6-725828cc762d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:43.529820 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e11c3fc7-9934-4d59-bda6-725828cc762d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:43.530592 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e11c3fc7-9934-4d59-bda6-725828cc762d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:43.530728 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e11c3fc7-9934-4d59-bda6-725828cc762d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:43.540365 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e74a0b75-b144-4e74-a1a2-9a2c4cca2e59 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1de24cda-52fe-42b6-8639-4bb3c77b5eb7" status: 200 len: 1618 microversion: 2.1 time: 0.252963 Sep 24 20:52:43.554471 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 448/899] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:43 2022] GET /compute/v2.1/servers/1de24cda-52fe-42b6-8639-4bb3c77b5eb7 => generated 1618 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:43.558683 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ff6be67b-46c5-4be6-938d-7f25f5415ba9 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:43.560360 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ff6be67b-46c5-4be6-938d-7f25f5415ba9 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:43.567465 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff6be67b-46c5-4be6-938d-7f25f5415ba9 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:43.568544 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff6be67b-46c5-4be6-938d-7f25f5415ba9 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:43.569059 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff6be67b-46c5-4be6-938d-7f25f5415ba9 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:43.569958 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff6be67b-46c5-4be6-938d-7f25f5415ba9 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:43.570489 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff6be67b-46c5-4be6-938d-7f25f5415ba9 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:43.571010 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff6be67b-46c5-4be6-938d-7f25f5415ba9 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:43.766158 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e11c3fc7-9934-4d59-bda6-725828cc762d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:43.774802 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e11c3fc7-9934-4d59-bda6-725828cc762d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1469 microversion: 2.1 time: 0.258673 Sep 24 20:52:43.775574 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 452/900] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:43 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1469 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:43.781804 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ff6be67b-46c5-4be6-938d-7f25f5415ba9 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:43.791209 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ff6be67b-46c5-4be6-938d-7f25f5415ba9 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1476 microversion: 2.1 time: 0.249016 Sep 24 20:52:43.791806 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 449/901] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:43 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1476 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:43.795678 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-75d42cce-67ce-4724-9f15-dcb3707b4548 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:43.796261 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-75d42cce-67ce-4724-9f15-dcb3707b4548 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] [instance: fc6a752b-8418-4657-8e37-3d9259b45d4e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:43.803728 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-75d42cce-67ce-4724-9f15-dcb3707b4548 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:43.804217 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-75d42cce-67ce-4724-9f15-dcb3707b4548 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:43.804857 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-75d42cce-67ce-4724-9f15-dcb3707b4548 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:43.805573 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-75d42cce-67ce-4724-9f15-dcb3707b4548 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:43.806029 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-75d42cce-67ce-4724-9f15-dcb3707b4548 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:43.806458 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-75d42cce-67ce-4724-9f15-dcb3707b4548 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:43.941027 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-75d42cce-67ce-4724-9f15-dcb3707b4548 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/fc6a752b-8418-4657-8e37-3d9259b45d4e" status: 200 len: 1619 microversion: 2.1 time: 0.153264 Sep 24 20:52:43.941653 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 453/902] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:43 2022] GET /compute/v2.1/servers/fc6a752b-8418-4657-8e37-3d9259b45d4e => generated 1619 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:43.966477 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c28e5798-406d-4172-93ee-e39d6482c073 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Action: 'create', calling method: .version_select at 0x7f4b0c869e50>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1389856247", "policies": ["anti-affinity"]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:43.988014 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-c28e5798-406d-4172-93ee-e39d6482c073 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Getting quotas for project 73bec7c48b07450f95a29a35e113153d. Resources: {'server_groups'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:52:43.993640 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-c28e5798-406d-4172-93ee-e39d6482c073 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Getting quotas for user 936372eff4da45e281fc5512632a12b6 and project 73bec7c48b07450f95a29a35e113153d. Resources: {'server_groups'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:52:44.040888 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-c28e5798-406d-4172-93ee-e39d6482c073 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Getting quotas for project 73bec7c48b07450f95a29a35e113153d. Resources: {'server_groups'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:52:44.045569 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-c28e5798-406d-4172-93ee-e39d6482c073 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Getting quotas for user 936372eff4da45e281fc5512632a12b6 and project 73bec7c48b07450f95a29a35e113153d. Resources: {'server_groups'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:52:44.058434 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c28e5798-406d-4172-93ee-e39d6482c073 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.095855 Sep 24 20:52:44.059079 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 450/903] 10.222.0.52 () {60 vars in 1174 bytes} [Sat Sep 24 20:52:43 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:52:44.112426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-56c0da41-470f-46cc-a999-a589eea86323 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1189423444", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "92c5334a-46a2-4c38-a94e-b62060cbfecf"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:44.168185 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-56c0da41-470f-46cc-a999-a589eea86323 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] validate_networks() for None {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:52:44.271324 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-27d16f3e-fd01-4ccd-840b-dddf27f46ecc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:44.272255 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-27d16f3e-fd01-4ccd-840b-dddf27f46ecc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:44.290285 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27d16f3e-fd01-4ccd-840b-dddf27f46ecc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:44.291046 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27d16f3e-fd01-4ccd-840b-dddf27f46ecc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:44.291528 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27d16f3e-fd01-4ccd-840b-dddf27f46ecc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:44.292664 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27d16f3e-fd01-4ccd-840b-dddf27f46ecc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:44.293462 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27d16f3e-fd01-4ccd-840b-dddf27f46ecc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:44.294198 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27d16f3e-fd01-4ccd-840b-dddf27f46ecc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:44.506845 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-27d16f3e-fd01-4ccd-840b-dddf27f46ecc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:44.515070 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-27d16f3e-fd01-4ccd-840b-dddf27f46ecc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:44.516559 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-27d16f3e-fd01-4ccd-840b-dddf27f46ecc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:44.517711 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-27d16f3e-fd01-4ccd-840b-dddf27f46ecc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e" status: 200 len: 1567 microversion: 2.25 time: 0.250726 Sep 24 20:52:44.518132 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-56c0da41-470f-46cc-a999-a589eea86323 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:52:44.518743 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 451/904] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:44 2022] GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e => generated 1567 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:44.519136 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-56c0da41-470f-46cc-a999-a589eea86323 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:52:44.519631 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-56c0da41-470f-46cc-a999-a589eea86323 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:52:44.520138 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-56c0da41-470f-46cc-a999-a589eea86323 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:52:44.521201 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-56c0da41-470f-46cc-a999-a589eea86323 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:52:44.523766 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a2fbe97a-aa30-4039-884e-07bf11dee24d tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:44.524376 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a2fbe97a-aa30-4039-884e-07bf11dee24d tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:44.531236 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a2fbe97a-aa30-4039-884e-07bf11dee24d tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:44.531841 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a2fbe97a-aa30-4039-884e-07bf11dee24d tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:44.534271 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a2fbe97a-aa30-4039-884e-07bf11dee24d tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:44.535126 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a2fbe97a-aa30-4039-884e-07bf11dee24d tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:44.535796 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a2fbe97a-aa30-4039-884e-07bf11dee24d tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:44.536883 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a2fbe97a-aa30-4039-884e-07bf11dee24d tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:44.537876 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56c0da41-470f-46cc-a999-a589eea86323 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:44.538364 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56c0da41-470f-46cc-a999-a589eea86323 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:44.538902 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56c0da41-470f-46cc-a999-a589eea86323 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:44.539736 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56c0da41-470f-46cc-a999-a589eea86323 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:44.540388 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56c0da41-470f-46cc-a999-a589eea86323 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:44.540821 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56c0da41-470f-46cc-a999-a589eea86323 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:44.547874 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:44.560358 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-56c0da41-470f-46cc-a999-a589eea86323 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Getting quotas for project 73bec7c48b07450f95a29a35e113153d. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:52:44.565657 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-56c0da41-470f-46cc-a999-a589eea86323 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Getting quotas for user 936372eff4da45e281fc5512632a12b6 and project 73bec7c48b07450f95a29a35e113153d. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:52:44.578396 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-56c0da41-470f-46cc-a999-a589eea86323 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Going to run 2 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:52:44.580801 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-56c0da41-470f-46cc-a999-a589eea86323 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 6a57ca61-642f-4749-a3f2-3ae1cfcbc542] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:52:44.603848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a2fbe97a-aa30-4039-884e-07bf11dee24d tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:44.611689 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a2fbe97a-aa30-4039-884e-07bf11dee24d tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1293 microversion: 2.1 time: 0.091693 Sep 24 20:52:44.612258 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 452/905] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:44 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:44.631606 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5afedce3-0783-4b73-ad5e-d24983e22ecd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:44.631841 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-56c0da41-470f-46cc-a999-a589eea86323 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Getting quotas for project 73bec7c48b07450f95a29a35e113153d. Resources: {'server_group_members'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:52:44.632492 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5afedce3-0783-4b73-ad5e-d24983e22ecd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:44.637052 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-56c0da41-470f-46cc-a999-a589eea86323 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Getting quotas for user 936372eff4da45e281fc5512632a12b6 and project 73bec7c48b07450f95a29a35e113153d. Resources: {'server_group_members'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:52:44.640550 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5afedce3-0783-4b73-ad5e-d24983e22ecd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:44.641109 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5afedce3-0783-4b73-ad5e-d24983e22ecd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:44.641615 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5afedce3-0783-4b73-ad5e-d24983e22ecd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:44.642529 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5afedce3-0783-4b73-ad5e-d24983e22ecd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:44.643057 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5afedce3-0783-4b73-ad5e-d24983e22ecd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:44.643482 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5afedce3-0783-4b73-ad5e-d24983e22ecd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:44.654300 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:44.674902 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-56c0da41-470f-46cc-a999-a589eea86323 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Getting quotas for project 73bec7c48b07450f95a29a35e113153d. Resources: {'server_group_members'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:52:44.680767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-56c0da41-470f-46cc-a999-a589eea86323 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Getting quotas for user 936372eff4da45e281fc5512632a12b6 and project 73bec7c48b07450f95a29a35e113153d. Resources: {'server_group_members'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:52:44.695663 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-56c0da41-470f-46cc-a999-a589eea86323 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 1c19c5a4-46f9-4e5e-a717-55bc8e5c3026] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=6a57ca61-642f-4749-a3f2-3ae1cfcbc542,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:52:44.709273 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5afedce3-0783-4b73-ad5e-d24983e22ecd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:44.718855 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5afedce3-0783-4b73-ad5e-d24983e22ecd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:44.720324 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5afedce3-0783-4b73-ad5e-d24983e22ecd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:44.726268 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5afedce3-0783-4b73-ad5e-d24983e22ecd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.098948 Sep 24 20:52:44.745392 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 453/906] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:44 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:44.745392 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1d19518b-317a-49aa-becf-2cce5c7ab7d7 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:44.745392 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1d19518b-317a-49aa-becf-2cce5c7ab7d7 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:44.745392 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1d19518b-317a-49aa-becf-2cce5c7ab7d7 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:44.745868 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1d19518b-317a-49aa-becf-2cce5c7ab7d7 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:44.745868 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1d19518b-317a-49aa-becf-2cce5c7ab7d7 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:44.745868 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1d19518b-317a-49aa-becf-2cce5c7ab7d7 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:44.745868 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1d19518b-317a-49aa-becf-2cce5c7ab7d7 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:44.746248 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1d19518b-317a-49aa-becf-2cce5c7ab7d7 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:44.746341 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-56c0da41-470f-46cc-a999-a589eea86323 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Getting quotas for project 73bec7c48b07450f95a29a35e113153d. Resources: {'server_group_members'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:52:44.750845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-56c0da41-470f-46cc-a999-a589eea86323 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Getting quotas for user 936372eff4da45e281fc5512632a12b6 and project 73bec7c48b07450f95a29a35e113153d. Resources: {'server_group_members'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:52:44.787728 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-56c0da41-470f-46cc-a999-a589eea86323 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Getting quotas for project 73bec7c48b07450f95a29a35e113153d. Resources: {'server_group_members'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:52:44.792847 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-56c0da41-470f-46cc-a999-a589eea86323 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Getting quotas for user 936372eff4da45e281fc5512632a12b6 and project 73bec7c48b07450f95a29a35e113153d. Resources: {'server_group_members'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:52:44.807848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1d19518b-317a-49aa-becf-2cce5c7ab7d7 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:44.815885 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1d19518b-317a-49aa-becf-2cce5c7ab7d7 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 200 len: 1276 microversion: 2.1 time: 0.088031 Sep 24 20:52:44.816464 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 454/907] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:44 2022] GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 1276 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:44.822305 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-864052da-3c75-4afe-b331-b1e058367e78 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:44.823162 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-864052da-3c75-4afe-b331-b1e058367e78 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:44.829288 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-864052da-3c75-4afe-b331-b1e058367e78 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:44.829569 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-56c0da41-470f-46cc-a999-a589eea86323 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.721517 Sep 24 20:52:44.830000 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-864052da-3c75-4afe-b331-b1e058367e78 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:44.834072 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-864052da-3c75-4afe-b331-b1e058367e78 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:44.834342 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 454/908] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:52:44 2022] POST /compute/v2.1/servers => generated 32 bytes in 723 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 24 20:52:44.834443 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-864052da-3c75-4afe-b331-b1e058367e78 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:44.834443 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-864052da-3c75-4afe-b331-b1e058367e78 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:44.834443 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-864052da-3c75-4afe-b331-b1e058367e78 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:44.837519 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-01ff8e00-5c02-4f1f-8e1f-64588bc0b587 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:44.838177 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-01ff8e00-5c02-4f1f-8e1f-64588bc0b587 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:44.844430 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-01ff8e00-5c02-4f1f-8e1f-64588bc0b587 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:44.844924 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-01ff8e00-5c02-4f1f-8e1f-64588bc0b587 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:44.845847 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-01ff8e00-5c02-4f1f-8e1f-64588bc0b587 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:44.846062 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-01ff8e00-5c02-4f1f-8e1f-64588bc0b587 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:44.846554 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-01ff8e00-5c02-4f1f-8e1f-64588bc0b587 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:44.846989 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-01ff8e00-5c02-4f1f-8e1f-64588bc0b587 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:45.031875 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-864052da-3c75-4afe-b331-b1e058367e78 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:45.042822 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-01ff8e00-5c02-4f1f-8e1f-64588bc0b587 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:45.049306 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-864052da-3c75-4afe-b331-b1e058367e78 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1461 microversion: 2.1 time: 0.230514 Sep 24 20:52:45.049951 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 455/909] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:44 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1461 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:45.051448 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-01ff8e00-5c02-4f1f-8e1f-64588bc0b587 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1476 microversion: 2.1 time: 0.219677 Sep 24 20:52:45.062578 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 455/910] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:44 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1476 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:45.067914 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a1d8bbe4-5ea7-4c8f-be44-800d4f9baf10 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:45.072245 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a1d8bbe4-5ea7-4c8f-be44-800d4f9baf10 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:45.072978 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-40bd9f02-55bf-4a31-9b14-cd7121f296aa tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:45.073191 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a1d8bbe4-5ea7-4c8f-be44-800d4f9baf10 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Searching by: {'deleted': False, 'project_id': '73bec7c48b07450f95a29a35e113153d'} {{(pid=140517) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 20:52:45.073746 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-40bd9f02-55bf-4a31-9b14-cd7121f296aa tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:45.080304 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40bd9f02-55bf-4a31-9b14-cd7121f296aa tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:45.080874 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40bd9f02-55bf-4a31-9b14-cd7121f296aa tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:45.081392 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40bd9f02-55bf-4a31-9b14-cd7121f296aa tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:45.082172 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40bd9f02-55bf-4a31-9b14-cd7121f296aa tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:45.083377 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40bd9f02-55bf-4a31-9b14-cd7121f296aa tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:45.084026 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40bd9f02-55bf-4a31-9b14-cd7121f296aa tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:45.090417 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1d8bbe4-5ea7-4c8f-be44-800d4f9baf10 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:45.090969 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1d8bbe4-5ea7-4c8f-be44-800d4f9baf10 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:45.091465 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1d8bbe4-5ea7-4c8f-be44-800d4f9baf10 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:45.092220 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1d8bbe4-5ea7-4c8f-be44-800d4f9baf10 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:45.092676 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1d8bbe4-5ea7-4c8f-be44-800d4f9baf10 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:45.093101 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1d8bbe4-5ea7-4c8f-be44-800d4f9baf10 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:45.122618 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.multi_cell_list [None req-a1d8bbe4-5ea7-4c8f-be44-800d4f9baf10 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=140517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 20:52:45.153033 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a1d8bbe4-5ea7-4c8f-be44-800d4f9baf10 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.101851 Sep 24 20:52:45.153613 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 456/911] 10.222.0.52 () {58 vars in 1125 bytes} [Sat Sep 24 20:52:45 2022] GET /compute/v2.1/servers => generated 1664 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:45.166827 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2506084b-cfdb-4df3-b337-172c5f39ffca tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:45.167542 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2506084b-cfdb-4df3-b337-172c5f39ffca tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 1c19c5a4-46f9-4e5e-a717-55bc8e5c3026] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:45.233728 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2506084b-cfdb-4df3-b337-172c5f39ffca tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:45.254483 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-40bd9f02-55bf-4a31-9b14-cd7121f296aa tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:45.257525 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2506084b-cfdb-4df3-b337-172c5f39ffca tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026" status: 200 len: 1219 microversion: 2.1 time: 0.094162 Sep 24 20:52:45.258896 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 457/912] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:45 2022] GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:52:45.263354 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-40bd9f02-55bf-4a31-9b14-cd7121f296aa tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1461 microversion: 2.1 time: 0.194127 Sep 24 20:52:45.264039 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 456/913] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:45 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1461 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:52:45.290013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-52d10d81-01a0-4926-a41a-373a2c6aedce tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Action: 'create', calling method: .version_select at 0x7f4b0c79f280>, body: {"keypair": {"name": "tempest-keypair-2025347422", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACAyJs+LR0sGD/WykVuvNdIsT5BDmGo9ciHygCvkB62CfTA4beQAhNG9+aRKIyFd0b8eoV6TR72MMeMSV3P09n5YPp7oE2cbsniTYLBWkBeBM91dntYpV5QHHd1ts++eA=="}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:45.307301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-52d10d81-01a0-4926-a41a-373a2c6aedce tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Getting quotas for project 349d3aa8627644d59867a744695f2579. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:52:45.312395 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-52d10d81-01a0-4926-a41a-373a2c6aedce tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Getting quotas for user 93982876b1e24efb8ffa8c009532343a and project 349d3aa8627644d59867a744695f2579. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:52:45.347707 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-52d10d81-01a0-4926-a41a-373a2c6aedce tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.062729 Sep 24 20:52:45.349217 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 458/914] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 20:52:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:52:45.549928 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-18dd0641-d06d-4294-b73c-367de7b98385 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:45.554761 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-18dd0641-d06d-4294-b73c-367de7b98385 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:45.566595 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-18dd0641-d06d-4294-b73c-367de7b98385 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:45.567146 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-18dd0641-d06d-4294-b73c-367de7b98385 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:45.567740 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-18dd0641-d06d-4294-b73c-367de7b98385 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:45.568459 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-18dd0641-d06d-4294-b73c-367de7b98385 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:45.568919 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-18dd0641-d06d-4294-b73c-367de7b98385 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:45.569346 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-18dd0641-d06d-4294-b73c-367de7b98385 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:45.638984 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c4316ffd-c405-43b3-b32d-67e7c5829b9e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:45.640507 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c4316ffd-c405-43b3-b32d-67e7c5829b9e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:45.649333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c4316ffd-c405-43b3-b32d-67e7c5829b9e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:45.649871 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c4316ffd-c405-43b3-b32d-67e7c5829b9e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:45.650315 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c4316ffd-c405-43b3-b32d-67e7c5829b9e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:45.651409 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c4316ffd-c405-43b3-b32d-67e7c5829b9e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:45.652044 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c4316ffd-c405-43b3-b32d-67e7c5829b9e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:45.652615 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c4316ffd-c405-43b3-b32d-67e7c5829b9e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:45.750805 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c4316ffd-c405-43b3-b32d-67e7c5829b9e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:45.760957 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c4316ffd-c405-43b3-b32d-67e7c5829b9e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1293 microversion: 2.1 time: 0.127776 Sep 24 20:52:45.762226 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 459/915] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:45 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1293 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:45.781280 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a3f89e80-586a-4660-868d-8583a4e76ec0 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:45.783464 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a3f89e80-586a-4660-868d-8583a4e76ec0 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:45.799239 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-18dd0641-d06d-4294-b73c-367de7b98385 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:45.800344 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a3f89e80-586a-4660-868d-8583a4e76ec0 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:45.801120 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a3f89e80-586a-4660-868d-8583a4e76ec0 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:45.802560 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a3f89e80-586a-4660-868d-8583a4e76ec0 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:45.814726 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a3f89e80-586a-4660-868d-8583a4e76ec0 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:45.815481 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a3f89e80-586a-4660-868d-8583a4e76ec0 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:45.817966 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-18dd0641-d06d-4294-b73c-367de7b98385 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:45.818281 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a3f89e80-586a-4660-868d-8583a4e76ec0 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:45.824333 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-18dd0641-d06d-4294-b73c-367de7b98385 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:45.827854 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-18dd0641-d06d-4294-b73c-367de7b98385 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e" status: 200 len: 1567 microversion: 2.25 time: 0.286178 Sep 24 20:52:45.829710 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 457/916] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:45 2022] GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e => generated 1567 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:45.860187 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e0600a55-525c-4750-a154-039817e153aa tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:45.861132 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e0600a55-525c-4750-a154-039817e153aa tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:45.868806 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e0600a55-525c-4750-a154-039817e153aa tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:45.869760 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e0600a55-525c-4750-a154-039817e153aa tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:45.870686 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e0600a55-525c-4750-a154-039817e153aa tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:45.871604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e0600a55-525c-4750-a154-039817e153aa tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:45.872568 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e0600a55-525c-4750-a154-039817e153aa tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:45.873015 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e0600a55-525c-4750-a154-039817e153aa tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:45.952393 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a3f89e80-586a-4660-868d-8583a4e76ec0 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:45.968918 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a3f89e80-586a-4660-868d-8583a4e76ec0 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:45.972347 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a3f89e80-586a-4660-868d-8583a4e76ec0 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:45.976709 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e0600a55-525c-4750-a154-039817e153aa tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:45.982905 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a3f89e80-586a-4660-868d-8583a4e76ec0 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.218722 Sep 24 20:52:45.984544 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 460/917] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:45 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:45.986888 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e0600a55-525c-4750-a154-039817e153aa tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 200 len: 1276 microversion: 2.1 time: 0.131501 Sep 24 20:52:45.987469 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 458/918] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:45 2022] GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 1276 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:52:46.077887 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-15b716e0-949f-484b-b96d-2c61bb7220e1 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:46.078643 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-15b716e0-949f-484b-b96d-2c61bb7220e1 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:46.086950 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15b716e0-949f-484b-b96d-2c61bb7220e1 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:46.087610 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15b716e0-949f-484b-b96d-2c61bb7220e1 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:46.088144 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15b716e0-949f-484b-b96d-2c61bb7220e1 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:46.089260 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15b716e0-949f-484b-b96d-2c61bb7220e1 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:46.090148 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15b716e0-949f-484b-b96d-2c61bb7220e1 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:46.091413 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15b716e0-949f-484b-b96d-2c61bb7220e1 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:46.282246 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-567bda69-b491-43c8-afc1-4ddc38049b72 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:46.282906 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-567bda69-b491-43c8-afc1-4ddc38049b72 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 1c19c5a4-46f9-4e5e-a717-55bc8e5c3026] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:46.294385 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-567bda69-b491-43c8-afc1-4ddc38049b72 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:46.295456 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-567bda69-b491-43c8-afc1-4ddc38049b72 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:46.296053 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-567bda69-b491-43c8-afc1-4ddc38049b72 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:46.296793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-567bda69-b491-43c8-afc1-4ddc38049b72 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:46.297256 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-567bda69-b491-43c8-afc1-4ddc38049b72 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:46.297689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-567bda69-b491-43c8-afc1-4ddc38049b72 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:46.366371 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-15b716e0-949f-484b-b96d-2c61bb7220e1 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:46.375670 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-15b716e0-949f-484b-b96d-2c61bb7220e1 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1476 microversion: 2.1 time: 0.303485 Sep 24 20:52:46.376407 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 461/919] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:46 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1476 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:46.404172 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-567bda69-b491-43c8-afc1-4ddc38049b72 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:46.421386 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-567bda69-b491-43c8-afc1-4ddc38049b72 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026" status: 200 len: 1215 microversion: 2.1 time: 0.144111 Sep 24 20:52:46.422205 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 459/920] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:46 2022] GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026 => generated 1215 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:52:46.791427 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-58305d86-b59b-4099-84b3-b3414154458d tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:46.793120 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-58305d86-b59b-4099-84b3-b3414154458d tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:46.807654 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58305d86-b59b-4099-84b3-b3414154458d tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:46.808408 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58305d86-b59b-4099-84b3-b3414154458d tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:46.809198 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58305d86-b59b-4099-84b3-b3414154458d tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:46.810266 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58305d86-b59b-4099-84b3-b3414154458d tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:46.811076 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58305d86-b59b-4099-84b3-b3414154458d tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:46.811744 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58305d86-b59b-4099-84b3-b3414154458d tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:46.861453 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-36e5fbfc-92ab-4308-9c91-935f3dae6368 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:46.862663 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-36e5fbfc-92ab-4308-9c91-935f3dae6368 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:46.875599 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36e5fbfc-92ab-4308-9c91-935f3dae6368 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:46.876838 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36e5fbfc-92ab-4308-9c91-935f3dae6368 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:46.878398 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36e5fbfc-92ab-4308-9c91-935f3dae6368 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:46.879789 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36e5fbfc-92ab-4308-9c91-935f3dae6368 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:46.883672 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36e5fbfc-92ab-4308-9c91-935f3dae6368 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:46.884455 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36e5fbfc-92ab-4308-9c91-935f3dae6368 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:47.000757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-58305d86-b59b-4099-84b3-b3414154458d tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:47.038607 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-58305d86-b59b-4099-84b3-b3414154458d tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1291 microversion: 2.1 time: 0.254086 Sep 24 20:52:47.055196 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 462/921] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:46 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1291 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:47.073288 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-35a637eb-2881-44e1-9350-6c5d546446d6 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:47.074171 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-35a637eb-2881-44e1-9350-6c5d546446d6 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:47.082234 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-35a637eb-2881-44e1-9350-6c5d546446d6 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:47.083616 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-35a637eb-2881-44e1-9350-6c5d546446d6 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:47.084321 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-35a637eb-2881-44e1-9350-6c5d546446d6 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:47.085226 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-35a637eb-2881-44e1-9350-6c5d546446d6 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:47.085914 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-35a637eb-2881-44e1-9350-6c5d546446d6 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:47.086584 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-35a637eb-2881-44e1-9350-6c5d546446d6 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:47.236264 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-35a637eb-2881-44e1-9350-6c5d546446d6 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:47.247631 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-35a637eb-2881-44e1-9350-6c5d546446d6 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 200 len: 1276 microversion: 2.1 time: 0.190873 Sep 24 20:52:47.249405 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 463/922] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:47 2022] GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 1276 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:47.255720 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4bd7c740-1bc8-496c-aae1-cc927e9cc10b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:47.256858 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4bd7c740-1bc8-496c-aae1-cc927e9cc10b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:47.263764 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4bd7c740-1bc8-496c-aae1-cc927e9cc10b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:47.264561 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4bd7c740-1bc8-496c-aae1-cc927e9cc10b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:47.265268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4bd7c740-1bc8-496c-aae1-cc927e9cc10b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:47.269890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-36e5fbfc-92ab-4308-9c91-935f3dae6368 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:47.274433 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4bd7c740-1bc8-496c-aae1-cc927e9cc10b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:47.279167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4bd7c740-1bc8-496c-aae1-cc927e9cc10b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:47.279708 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4bd7c740-1bc8-496c-aae1-cc927e9cc10b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:47.284012 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-36e5fbfc-92ab-4308-9c91-935f3dae6368 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:47.286446 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-36e5fbfc-92ab-4308-9c91-935f3dae6368 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:47.289845 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-36e5fbfc-92ab-4308-9c91-935f3dae6368 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e" status: 200 len: 1567 microversion: 2.25 time: 0.432390 Sep 24 20:52:47.291201 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 460/923] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:46 2022] GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e => generated 1567 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:47.343234 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fa44ca8c-efd2-4938-bbb1-de125d6c9c77 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Calling method '.version_select at 0x7f4b0c5ff5e0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:47.347283 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fa44ca8c-efd2-4938-bbb1-de125d6c9c77 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:47.347958 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fa44ca8c-efd2-4938-bbb1-de125d6c9c77 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:47.348660 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fa44ca8c-efd2-4938-bbb1-de125d6c9c77 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:47.358844 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fa44ca8c-efd2-4938-bbb1-de125d6c9c77 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 1952 microversion: 2.1 time: 0.019835 Sep 24 20:52:47.360079 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 461/924] 10.222.0.52 () {58 vars in 1143 bytes} [Sat Sep 24 20:52:47 2022] GET /compute/v2.1/os-migrations => generated 1952 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:47.383262 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1db75ad1-ea1e-4996-85e0-3f8539e0f3aa tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:47.383432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4bd7c740-1bc8-496c-aae1-cc927e9cc10b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:47.390847 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1db75ad1-ea1e-4996-85e0-3f8539e0f3aa tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011493 Sep 24 20:52:47.391563 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 462/925] 10.222.0.52 () {58 vars in 1137 bytes} [Sat Sep 24 20:52:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:52:47.402394 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4bd7c740-1bc8-496c-aae1-cc927e9cc10b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:47.404075 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3e12c71c-f1ce-46e8-8c55-414212fc8a77 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:47.404528 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4bd7c740-1bc8-496c-aae1-cc927e9cc10b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:47.405078 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3e12c71c-f1ce-46e8-8c55-414212fc8a77 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:47.410033 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4bd7c740-1bc8-496c-aae1-cc927e9cc10b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1560 microversion: 2.91 time: 0.159105 Sep 24 20:52:47.415376 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 464/926] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:47 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:47.416328 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c7864bdd-86c1-4a84-9ed6-dc7c6b1dbd6a tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-295944139", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:47.418902 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3e12c71c-f1ce-46e8-8c55-414212fc8a77 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:47.419683 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3e12c71c-f1ce-46e8-8c55-414212fc8a77 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:47.420826 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3e12c71c-f1ce-46e8-8c55-414212fc8a77 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:47.422394 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3e12c71c-f1ce-46e8-8c55-414212fc8a77 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:47.423613 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3e12c71c-f1ce-46e8-8c55-414212fc8a77 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:47.424476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3e12c71c-f1ce-46e8-8c55-414212fc8a77 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:47.438305 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:47.443010 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c7864bdd-86c1-4a84-9ed6-dc7c6b1dbd6a tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.030361 Sep 24 20:52:47.446354 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 465/927] 10.222.0.52 () {60 vars in 1146 bytes} [Sat Sep 24 20:52:47 2022] POST /compute/v2.1/flavors => generated 498 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:52:47.454533 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9d313a76-4c33-4764-840a-3b806841e10c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:47.455410 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9d313a76-4c33-4764-840a-3b806841e10c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 1c19c5a4-46f9-4e5e-a717-55bc8e5c3026] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:47.465349 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d313a76-4c33-4764-840a-3b806841e10c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:47.466298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d313a76-4c33-4764-840a-3b806841e10c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:47.466536 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d313a76-4c33-4764-840a-3b806841e10c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:47.467262 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d313a76-4c33-4764-840a-3b806841e10c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:47.467790 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d313a76-4c33-4764-840a-3b806841e10c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:47.468907 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d313a76-4c33-4764-840a-3b806841e10c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:47.558751 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9d313a76-4c33-4764-840a-3b806841e10c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:47.568554 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9d313a76-4c33-4764-840a-3b806841e10c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026" status: 200 len: 1215 microversion: 2.1 time: 0.119089 Sep 24 20:52:47.569756 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 466/928] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:47 2022] GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026 => generated 1215 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:47.574732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-63939999-0b23-4882-8b5f-eba1f071f1c8 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:47.582937 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-63939999-0b23-4882-8b5f-eba1f071f1c8 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.011643 Sep 24 20:52:47.583869 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 467/929] 10.222.0.52 () {58 vars in 1182 bytes} [Sat Sep 24 20:52:47 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:52:47.607734 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3e12c71c-f1ce-46e8-8c55-414212fc8a77 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:47.632709 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3e12c71c-f1ce-46e8-8c55-414212fc8a77 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1476 microversion: 2.1 time: 0.235905 Sep 24 20:52:47.633516 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 463/930] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:47 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1476 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:47.725593 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3eaa3937-0c5f-412a-8ec5-224ac5aef86b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1999109809", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "5bff3db1-43db-4c23-bdea-b823b03cf9b3"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:47.866474 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-3eaa3937-0c5f-412a-8ec5-224ac5aef86b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] validate_networks() for None {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:52:48.064186 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fccb402f-44d5-41eb-98fe-967ca634bfe5 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:48.065137 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fccb402f-44d5-41eb-98fe-967ca634bfe5 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:48.077164 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fccb402f-44d5-41eb-98fe-967ca634bfe5 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:48.083758 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fccb402f-44d5-41eb-98fe-967ca634bfe5 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:48.084698 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fccb402f-44d5-41eb-98fe-967ca634bfe5 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:48.088140 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fccb402f-44d5-41eb-98fe-967ca634bfe5 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:48.089753 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fccb402f-44d5-41eb-98fe-967ca634bfe5 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:48.090490 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fccb402f-44d5-41eb-98fe-967ca634bfe5 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:48.368891 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fccb402f-44d5-41eb-98fe-967ca634bfe5 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:48.382377 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fccb402f-44d5-41eb-98fe-967ca634bfe5 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1358 microversion: 2.1 time: 0.322278 Sep 24 20:52:48.399383 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 464/931] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:48 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1358 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:48.401909 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-3eaa3937-0c5f-412a-8ec5-224ac5aef86b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:52:48.402938 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-3eaa3937-0c5f-412a-8ec5-224ac5aef86b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:52:48.403720 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-3eaa3937-0c5f-412a-8ec5-224ac5aef86b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:52:48.404296 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-3eaa3937-0c5f-412a-8ec5-224ac5aef86b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:52:48.404486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-455fc8e6-c005-40d7-a76f-0b1f98c30daf tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:48.405108 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-455fc8e6-c005-40d7-a76f-0b1f98c30daf tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:48.405408 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-3eaa3937-0c5f-412a-8ec5-224ac5aef86b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:52:48.416841 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-455fc8e6-c005-40d7-a76f-0b1f98c30daf tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:48.417361 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-455fc8e6-c005-40d7-a76f-0b1f98c30daf tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:48.417808 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-455fc8e6-c005-40d7-a76f-0b1f98c30daf tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:48.418752 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-455fc8e6-c005-40d7-a76f-0b1f98c30daf tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:48.419222 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-455fc8e6-c005-40d7-a76f-0b1f98c30daf tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:48.419650 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-455fc8e6-c005-40d7-a76f-0b1f98c30daf tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:48.426670 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3eaa3937-0c5f-412a-8ec5-224ac5aef86b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:48.427595 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3eaa3937-0c5f-412a-8ec5-224ac5aef86b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:48.428345 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3eaa3937-0c5f-412a-8ec5-224ac5aef86b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:48.429573 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3eaa3937-0c5f-412a-8ec5-224ac5aef86b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:48.430936 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3eaa3937-0c5f-412a-8ec5-224ac5aef86b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:48.432217 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3eaa3937-0c5f-412a-8ec5-224ac5aef86b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:48.451473 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:48.464655 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-3eaa3937-0c5f-412a-8ec5-224ac5aef86b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Getting quotas for project 349d3aa8627644d59867a744695f2579. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:52:48.475350 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-3eaa3937-0c5f-412a-8ec5-224ac5aef86b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Getting quotas for user 93982876b1e24efb8ffa8c009532343a and project 349d3aa8627644d59867a744695f2579. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:52:48.501509 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3eaa3937-0c5f-412a-8ec5-224ac5aef86b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:52:48.509482 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3eaa3937-0c5f-412a-8ec5-224ac5aef86b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:52:48.558544 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-455fc8e6-c005-40d7-a76f-0b1f98c30daf tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:48.579206 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-455fc8e6-c005-40d7-a76f-0b1f98c30daf tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 200 len: 1282 microversion: 2.1 time: 0.178412 Sep 24 20:52:48.580027 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 465/932] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:48 2022] GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 1282 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:48.586724 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8ebaae84-db06-4491-887e-b572d17515a0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:48.587542 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8ebaae84-db06-4491-887e-b572d17515a0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:48.597647 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8ebaae84-db06-4491-887e-b572d17515a0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:48.598173 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8ebaae84-db06-4491-887e-b572d17515a0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:48.598759 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8ebaae84-db06-4491-887e-b572d17515a0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:48.600085 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8ebaae84-db06-4491-887e-b572d17515a0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:48.601313 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8ebaae84-db06-4491-887e-b572d17515a0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:48.601768 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8ebaae84-db06-4491-887e-b572d17515a0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:48.623484 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3eaa3937-0c5f-412a-8ec5-224ac5aef86b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.904312 Sep 24 20:52:48.624635 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 468/933] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:52:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 24 20:52:48.630744 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a248d783-dcae-4585-ace7-c208a7fe37c1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:48.631607 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a248d783-dcae-4585-ace7-c208a7fe37c1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:48.640262 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a248d783-dcae-4585-ace7-c208a7fe37c1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:48.640997 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a248d783-dcae-4585-ace7-c208a7fe37c1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:48.641546 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a248d783-dcae-4585-ace7-c208a7fe37c1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:48.642443 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a248d783-dcae-4585-ace7-c208a7fe37c1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:48.643030 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a248d783-dcae-4585-ace7-c208a7fe37c1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:48.643563 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a248d783-dcae-4585-ace7-c208a7fe37c1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:48.775768 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a248d783-dcae-4585-ace7-c208a7fe37c1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:48.793142 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a248d783-dcae-4585-ace7-c208a7fe37c1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:48.794071 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a248d783-dcae-4585-ace7-c208a7fe37c1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:48.804026 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a248d783-dcae-4585-ace7-c208a7fe37c1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1560 microversion: 2.91 time: 0.177893 Sep 24 20:52:48.804553 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 469/934] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:48 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:48.835459 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e52caa67-5234-492f-bcbe-f36b89763722 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:48.836446 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e52caa67-5234-492f-bcbe-f36b89763722 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 1c19c5a4-46f9-4e5e-a717-55bc8e5c3026] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:48.843413 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e52caa67-5234-492f-bcbe-f36b89763722 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:48.843896 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e52caa67-5234-492f-bcbe-f36b89763722 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:48.844332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e52caa67-5234-492f-bcbe-f36b89763722 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:48.845044 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e52caa67-5234-492f-bcbe-f36b89763722 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:48.845577 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e52caa67-5234-492f-bcbe-f36b89763722 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:48.846044 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e52caa67-5234-492f-bcbe-f36b89763722 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:48.862250 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8ebaae84-db06-4491-887e-b572d17515a0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:48.872298 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8ebaae84-db06-4491-887e-b572d17515a0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:48.873783 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8ebaae84-db06-4491-887e-b572d17515a0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:48.875157 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8ebaae84-db06-4491-887e-b572d17515a0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e" status: 200 len: 1567 microversion: 2.25 time: 0.293876 Sep 24 20:52:48.876223 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 466/935] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:48 2022] GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e => generated 1567 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:48.890905 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-17b9f7e2-5719-432d-b7da-98715a6d381b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:48.891539 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-17b9f7e2-5719-432d-b7da-98715a6d381b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:48.947316 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e52caa67-5234-492f-bcbe-f36b89763722 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:48.956964 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e52caa67-5234-492f-bcbe-f36b89763722 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026" status: 200 len: 1271 microversion: 2.1 time: 0.127119 Sep 24 20:52:48.959164 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 470/936] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:48 2022] GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026 => generated 1271 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:48.965203 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-27307deb-4616-4032-8a02-6af7af2f9939 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:48.965830 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-27307deb-4616-4032-8a02-6af7af2f9939 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:48.977992 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27307deb-4616-4032-8a02-6af7af2f9939 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:48.978840 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27307deb-4616-4032-8a02-6af7af2f9939 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:48.979265 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27307deb-4616-4032-8a02-6af7af2f9939 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:48.980425 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27307deb-4616-4032-8a02-6af7af2f9939 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:48.980920 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27307deb-4616-4032-8a02-6af7af2f9939 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:48.981360 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27307deb-4616-4032-8a02-6af7af2f9939 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:48.991038 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-17b9f7e2-5719-432d-b7da-98715a6d381b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:49.014702 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-17b9f7e2-5719-432d-b7da-98715a6d381b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1279 microversion: 2.1 time: 0.122164 Sep 24 20:52:49.031344 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 467/937] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:48 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1279 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:49.163153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-27307deb-4616-4032-8a02-6af7af2f9939 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:49.175396 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-27307deb-4616-4032-8a02-6af7af2f9939 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1476 microversion: 2.1 time: 0.214189 Sep 24 20:52:49.186376 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 471/938] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:48 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1476 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:49.414097 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5f9b1720-96a2-4eea-bbb6-a9e605a4bda8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:49.414877 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5f9b1720-96a2-4eea-bbb6-a9e605a4bda8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:49.421752 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f9b1720-96a2-4eea-bbb6-a9e605a4bda8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:49.427435 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f9b1720-96a2-4eea-bbb6-a9e605a4bda8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:49.431472 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f9b1720-96a2-4eea-bbb6-a9e605a4bda8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:49.432410 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f9b1720-96a2-4eea-bbb6-a9e605a4bda8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:49.433041 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f9b1720-96a2-4eea-bbb6-a9e605a4bda8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:49.433629 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f9b1720-96a2-4eea-bbb6-a9e605a4bda8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:49.603944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-95ed9e02-68ee-4b17-a2d4-61761cb5c7b0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:49.604641 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-95ed9e02-68ee-4b17-a2d4-61761cb5c7b0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:49.619258 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-95ed9e02-68ee-4b17-a2d4-61761cb5c7b0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:49.620053 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-95ed9e02-68ee-4b17-a2d4-61761cb5c7b0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:49.621220 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-95ed9e02-68ee-4b17-a2d4-61761cb5c7b0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:49.622108 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-95ed9e02-68ee-4b17-a2d4-61761cb5c7b0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:49.626708 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-95ed9e02-68ee-4b17-a2d4-61761cb5c7b0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:49.627336 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-95ed9e02-68ee-4b17-a2d4-61761cb5c7b0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:49.742957 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5f9b1720-96a2-4eea-bbb6-a9e605a4bda8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:49.753050 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5f9b1720-96a2-4eea-bbb6-a9e605a4bda8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1358 microversion: 2.1 time: 0.342688 Sep 24 20:52:49.757524 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 468/939] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:49 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1358 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:49.762394 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-26a47a2f-b244-40f3-991e-9e093fdd7403 req-d6ccf3d7-548b-41db-8eee-07f11937865d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdb37c4d-e841-4e13-b809-e3f19ce6365a", "name": "network-vif-plugged", "status": "completed", "tag": "fdfbcb27-4de9-4bdc-b3e7-a1d7e89b3236"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:49.778301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-95ed9e02-68ee-4b17-a2d4-61761cb5c7b0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:49.788788 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-95ed9e02-68ee-4b17-a2d4-61761cb5c7b0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 200 len: 1282 microversion: 2.1 time: 0.188515 Sep 24 20:52:49.789673 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 472/940] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:49 2022] GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 1282 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:49.799445 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-26a47a2f-b244-40f3-991e-9e093fdd7403 req-d6ccf3d7-548b-41db-8eee-07f11937865d service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:49.799445 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-26a47a2f-b244-40f3-991e-9e093fdd7403 req-d6ccf3d7-548b-41db-8eee-07f11937865d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:49.799445 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-26a47a2f-b244-40f3-991e-9e093fdd7403 req-d6ccf3d7-548b-41db-8eee-07f11937865d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:49.831148 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-26a47a2f-b244-40f3-991e-9e093fdd7403 req-d6ccf3d7-548b-41db-8eee-07f11937865d service nova] Creating event network-vif-plugged:fdfbcb27-4de9-4bdc-b3e7-a1d7e89b3236 for instance bdb37c4d-e841-4e13-b809-e3f19ce6365a on nch2-master-1 Sep 24 20:52:49.841318 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2d6cf9a4-d687-405d-b384-5374b7bf437d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:49.842205 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2d6cf9a4-d687-405d-b384-5374b7bf437d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:49.846276 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-26a47a2f-b244-40f3-991e-9e093fdd7403 req-d6ccf3d7-548b-41db-8eee-07f11937865d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085385 Sep 24 20:52:49.846947 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 469/941] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:52:49.852026 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d6cf9a4-d687-405d-b384-5374b7bf437d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:49.853807 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d6cf9a4-d687-405d-b384-5374b7bf437d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:49.854797 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d6cf9a4-d687-405d-b384-5374b7bf437d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:49.856319 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d6cf9a4-d687-405d-b384-5374b7bf437d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:49.857544 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d6cf9a4-d687-405d-b384-5374b7bf437d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:49.858561 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d6cf9a4-d687-405d-b384-5374b7bf437d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:49.903865 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4f896208-30ef-49ac-8b37-fe9eb4388087 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:49.905429 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4f896208-30ef-49ac-8b37-fe9eb4388087 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:49.916533 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f896208-30ef-49ac-8b37-fe9eb4388087 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:49.917807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f896208-30ef-49ac-8b37-fe9eb4388087 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:49.918775 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f896208-30ef-49ac-8b37-fe9eb4388087 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:49.919890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f896208-30ef-49ac-8b37-fe9eb4388087 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:49.920794 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f896208-30ef-49ac-8b37-fe9eb4388087 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:49.921347 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f896208-30ef-49ac-8b37-fe9eb4388087 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:49.963392 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2d6cf9a4-d687-405d-b384-5374b7bf437d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:49.976828 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2d6cf9a4-d687-405d-b384-5374b7bf437d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:49.978344 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2d6cf9a4-d687-405d-b384-5374b7bf437d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:49.987204 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2d6cf9a4-d687-405d-b384-5374b7bf437d tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1555 microversion: 2.91 time: 0.151242 Sep 24 20:52:49.998628 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 473/942] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:49 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:50.030414 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d36160e7-051c-4c53-85e0-9e7012156632 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:50.032209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d36160e7-051c-4c53-85e0-9e7012156632 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 1c19c5a4-46f9-4e5e-a717-55bc8e5c3026] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:50.045592 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d36160e7-051c-4c53-85e0-9e7012156632 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:50.046093 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d36160e7-051c-4c53-85e0-9e7012156632 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:50.046559 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d36160e7-051c-4c53-85e0-9e7012156632 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:50.047373 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d36160e7-051c-4c53-85e0-9e7012156632 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:50.047888 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d36160e7-051c-4c53-85e0-9e7012156632 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:50.048325 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d36160e7-051c-4c53-85e0-9e7012156632 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:50.160507 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d36160e7-051c-4c53-85e0-9e7012156632 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:50.169604 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d36160e7-051c-4c53-85e0-9e7012156632 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026" status: 200 len: 1277 microversion: 2.1 time: 0.168970 Sep 24 20:52:50.172128 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 474/943] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:49 2022] GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026 => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:50.193542 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-728ea071-579e-4dbd-b1e6-88f941152e9c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:50.194246 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-728ea071-579e-4dbd-b1e6-88f941152e9c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:50.214782 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-728ea071-579e-4dbd-b1e6-88f941152e9c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:50.215383 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-728ea071-579e-4dbd-b1e6-88f941152e9c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:50.215896 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-728ea071-579e-4dbd-b1e6-88f941152e9c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:50.216693 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-728ea071-579e-4dbd-b1e6-88f941152e9c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:50.217789 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-728ea071-579e-4dbd-b1e6-88f941152e9c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:50.218462 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-728ea071-579e-4dbd-b1e6-88f941152e9c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:50.332210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-728ea071-579e-4dbd-b1e6-88f941152e9c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:50.344731 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-728ea071-579e-4dbd-b1e6-88f941152e9c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1331 microversion: 2.1 time: 0.155863 Sep 24 20:52:50.346141 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 475/944] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:50 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1331 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:50.357926 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4f896208-30ef-49ac-8b37-fe9eb4388087 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:50.358625 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cd7e4897-31a5-402e-90d1-708b7762f246 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:50.359338 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cd7e4897-31a5-402e-90d1-708b7762f246 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:50.369882 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd7e4897-31a5-402e-90d1-708b7762f246 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:50.370469 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd7e4897-31a5-402e-90d1-708b7762f246 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:50.371015 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd7e4897-31a5-402e-90d1-708b7762f246 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:50.371812 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd7e4897-31a5-402e-90d1-708b7762f246 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:50.372348 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd7e4897-31a5-402e-90d1-708b7762f246 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:50.372954 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4f896208-30ef-49ac-8b37-fe9eb4388087 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:50.373899 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd7e4897-31a5-402e-90d1-708b7762f246 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:50.375876 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4f896208-30ef-49ac-8b37-fe9eb4388087 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:50.377359 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4f896208-30ef-49ac-8b37-fe9eb4388087 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e" status: 200 len: 1567 microversion: 2.25 time: 0.479574 Sep 24 20:52:50.378411 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 470/945] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:49 2022] GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e => generated 1567 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:50.779999 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c4e4b718-3896-42cd-8fd3-5b332bc83d94 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:50.780688 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c4e4b718-3896-42cd-8fd3-5b332bc83d94 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:50.793411 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4e4b718-3896-42cd-8fd3-5b332bc83d94 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:50.798134 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4e4b718-3896-42cd-8fd3-5b332bc83d94 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:50.800743 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4e4b718-3896-42cd-8fd3-5b332bc83d94 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:50.802924 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4e4b718-3896-42cd-8fd3-5b332bc83d94 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:50.804332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4e4b718-3896-42cd-8fd3-5b332bc83d94 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:50.805017 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4e4b718-3896-42cd-8fd3-5b332bc83d94 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:51.016654 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cd7e4897-31a5-402e-90d1-708b7762f246 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:51.029245 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cd7e4897-31a5-402e-90d1-708b7762f246 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1476 microversion: 2.1 time: 0.674647 Sep 24 20:52:51.055173 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 476/946] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:50 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1476 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:51.068918 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3b75a6b8-93c7-4895-8aaa-36a6121dc946 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:51.071977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c4e4b718-3896-42cd-8fd3-5b332bc83d94 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:51.073288 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3b75a6b8-93c7-4895-8aaa-36a6121dc946 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:51.081825 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c4e4b718-3896-42cd-8fd3-5b332bc83d94 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1358 microversion: 2.1 time: 0.305639 Sep 24 20:52:51.087017 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 471/947] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:50 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1358 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:52:51.091523 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3b75a6b8-93c7-4895-8aaa-36a6121dc946 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:51.092027 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3b75a6b8-93c7-4895-8aaa-36a6121dc946 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:51.092464 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3b75a6b8-93c7-4895-8aaa-36a6121dc946 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:51.093176 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3b75a6b8-93c7-4895-8aaa-36a6121dc946 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:51.093632 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3b75a6b8-93c7-4895-8aaa-36a6121dc946 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:51.094057 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3b75a6b8-93c7-4895-8aaa-36a6121dc946 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:51.096052 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-96719cd7-3d44-4b52-adca-5df73a5c04fb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:51.097092 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-96719cd7-3d44-4b52-adca-5df73a5c04fb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:51.115941 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96719cd7-3d44-4b52-adca-5df73a5c04fb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:51.116832 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96719cd7-3d44-4b52-adca-5df73a5c04fb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:51.117514 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96719cd7-3d44-4b52-adca-5df73a5c04fb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:51.118717 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96719cd7-3d44-4b52-adca-5df73a5c04fb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:51.127230 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96719cd7-3d44-4b52-adca-5df73a5c04fb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:51.128176 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96719cd7-3d44-4b52-adca-5df73a5c04fb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:51.273305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-96719cd7-3d44-4b52-adca-5df73a5c04fb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:51.291717 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-96719cd7-3d44-4b52-adca-5df73a5c04fb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:51.293870 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-96719cd7-3d44-4b52-adca-5df73a5c04fb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:51.303816 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-96719cd7-3d44-4b52-adca-5df73a5c04fb tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1555 microversion: 2.91 time: 0.214841 Sep 24 20:52:51.322537 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 472/948] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:51 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1555 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:51.335230 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d65a9faf-5fa7-4f88-8e42-0617468fbe4c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:51.335677 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d65a9faf-5fa7-4f88-8e42-0617468fbe4c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 1c19c5a4-46f9-4e5e-a717-55bc8e5c3026] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:51.342830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d65a9faf-5fa7-4f88-8e42-0617468fbe4c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:51.343323 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d65a9faf-5fa7-4f88-8e42-0617468fbe4c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:51.344843 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d65a9faf-5fa7-4f88-8e42-0617468fbe4c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:51.345595 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d65a9faf-5fa7-4f88-8e42-0617468fbe4c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:51.346059 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d65a9faf-5fa7-4f88-8e42-0617468fbe4c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:51.346512 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d65a9faf-5fa7-4f88-8e42-0617468fbe4c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:51.475240 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d65a9faf-5fa7-4f88-8e42-0617468fbe4c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:51.483827 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d65a9faf-5fa7-4f88-8e42-0617468fbe4c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026" status: 200 len: 1277 microversion: 2.1 time: 0.160138 Sep 24 20:52:51.490820 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 473/949] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:51 2022] GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026 => generated 1277 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:51.495639 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-00af7192-88a2-45a1-a8f4-3a543578112c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:51.496268 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-00af7192-88a2-45a1-a8f4-3a543578112c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:51.499978 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3b75a6b8-93c7-4895-8aaa-36a6121dc946 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:51.519422 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3b75a6b8-93c7-4895-8aaa-36a6121dc946 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 200 len: 1324 microversion: 2.1 time: 0.459760 Sep 24 20:52:51.521318 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 477/950] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:51 2022] GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 1324 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:51.526626 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8326bdd3-e166-4ed8-96b3-e8dded1526af tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:51.527260 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8326bdd3-e166-4ed8-96b3-e8dded1526af tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:51.537500 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8326bdd3-e166-4ed8-96b3-e8dded1526af tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:51.537901 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8326bdd3-e166-4ed8-96b3-e8dded1526af tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:51.538490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8326bdd3-e166-4ed8-96b3-e8dded1526af tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:51.539225 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8326bdd3-e166-4ed8-96b3-e8dded1526af tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:51.539691 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8326bdd3-e166-4ed8-96b3-e8dded1526af tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:51.540124 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8326bdd3-e166-4ed8-96b3-e8dded1526af tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:51.541355 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00af7192-88a2-45a1-a8f4-3a543578112c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:51.541878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00af7192-88a2-45a1-a8f4-3a543578112c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:51.542337 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00af7192-88a2-45a1-a8f4-3a543578112c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:51.544046 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00af7192-88a2-45a1-a8f4-3a543578112c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:51.544535 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00af7192-88a2-45a1-a8f4-3a543578112c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:51.544991 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00af7192-88a2-45a1-a8f4-3a543578112c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:51.693759 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-00af7192-88a2-45a1-a8f4-3a543578112c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:51.696680 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:51.714473 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-00af7192-88a2-45a1-a8f4-3a543578112c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1337 microversion: 2.1 time: 0.222536 Sep 24 20:52:51.715628 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 474/951] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:51 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1337 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:51.848820 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8326bdd3-e166-4ed8-96b3-e8dded1526af tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:51.866904 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8326bdd3-e166-4ed8-96b3-e8dded1526af tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:51.868958 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8326bdd3-e166-4ed8-96b3-e8dded1526af tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:51.875994 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8326bdd3-e166-4ed8-96b3-e8dded1526af tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e" status: 200 len: 1567 microversion: 2.25 time: 0.350647 Sep 24 20:52:51.917459 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 478/952] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:51 2022] GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e => generated 1567 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:51.927293 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-3a79f3af-49a6-4373-9510-4a7a879e8e1d req-9625449a-89d1-4010-8124-23d4d9dc3c15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a57ca61-642f-4749-a3f2-3ae1cfcbc542", "tag": "3db6518e-fc81-4574-b1fa-978663ca6d51"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:51.954543 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-3a79f3af-49a6-4373-9510-4a7a879e8e1d req-9625449a-89d1-4010-8124-23d4d9dc3c15 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:51.955592 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-3a79f3af-49a6-4373-9510-4a7a879e8e1d req-9625449a-89d1-4010-8124-23d4d9dc3c15 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:51.956755 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-3a79f3af-49a6-4373-9510-4a7a879e8e1d req-9625449a-89d1-4010-8124-23d4d9dc3c15 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:51.997156 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-3a79f3af-49a6-4373-9510-4a7a879e8e1d req-9625449a-89d1-4010-8124-23d4d9dc3c15 service nova] Creating event network-changed:3db6518e-fc81-4574-b1fa-978663ca6d51 for instance 6a57ca61-642f-4749-a3f2-3ae1cfcbc542 on nch1-master-1 Sep 24 20:52:52.003485 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-3a79f3af-49a6-4373-9510-4a7a879e8e1d req-9625449a-89d1-4010-8124-23d4d9dc3c15 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080409 Sep 24 20:52:52.004737 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 475/953] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:52:52.057654 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9fd9b097-5639-4ad9-aea4-cbef941ff9b3 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:52.058387 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9fd9b097-5639-4ad9-aea4-cbef941ff9b3 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:52.074923 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fd9b097-5639-4ad9-aea4-cbef941ff9b3 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:52.075537 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fd9b097-5639-4ad9-aea4-cbef941ff9b3 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:52.076062 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fd9b097-5639-4ad9-aea4-cbef941ff9b3 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:52.076851 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fd9b097-5639-4ad9-aea4-cbef941ff9b3 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:52.077370 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fd9b097-5639-4ad9-aea4-cbef941ff9b3 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:52.077871 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fd9b097-5639-4ad9-aea4-cbef941ff9b3 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:52.113398 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fefb5ca3-c646-44b5-a325-a641033ac32f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:52.115340 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fefb5ca3-c646-44b5-a325-a641033ac32f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:52.127888 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fefb5ca3-c646-44b5-a325-a641033ac32f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:52.135168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fefb5ca3-c646-44b5-a325-a641033ac32f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:52.135728 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fefb5ca3-c646-44b5-a325-a641033ac32f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:52.136712 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fefb5ca3-c646-44b5-a325-a641033ac32f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:52.137109 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fefb5ca3-c646-44b5-a325-a641033ac32f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:52.137607 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fefb5ca3-c646-44b5-a325-a641033ac32f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:52.372770 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9fd9b097-5639-4ad9-aea4-cbef941ff9b3 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:52.388388 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9fd9b097-5639-4ad9-aea4-cbef941ff9b3 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1462 microversion: 2.1 time: 0.334310 Sep 24 20:52:52.389034 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 479/954] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:52 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1462 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:52.421173 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bdcade43-eab6-4e9b-9508-ec7eb44f19b9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:52.422004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bdcade43-eab6-4e9b-9508-ec7eb44f19b9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:52.434222 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bdcade43-eab6-4e9b-9508-ec7eb44f19b9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:52.434761 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bdcade43-eab6-4e9b-9508-ec7eb44f19b9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:52.437451 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bdcade43-eab6-4e9b-9508-ec7eb44f19b9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:52.438291 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bdcade43-eab6-4e9b-9508-ec7eb44f19b9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:52.438803 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bdcade43-eab6-4e9b-9508-ec7eb44f19b9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:52.439247 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bdcade43-eab6-4e9b-9508-ec7eb44f19b9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:52.439626 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fefb5ca3-c646-44b5-a325-a641033ac32f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:52.455667 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fefb5ca3-c646-44b5-a325-a641033ac32f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1358 microversion: 2.1 time: 0.346819 Sep 24 20:52:52.471946 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 476/955] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:52 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1358 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:52:52.483462 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-005687b7-9d5f-4f2d-b242-d35f3c2c67ab tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:52.484338 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-005687b7-9d5f-4f2d-b242-d35f3c2c67ab tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:52.492767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-005687b7-9d5f-4f2d-b242-d35f3c2c67ab tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:52.493347 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-005687b7-9d5f-4f2d-b242-d35f3c2c67ab tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:52.493874 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-005687b7-9d5f-4f2d-b242-d35f3c2c67ab tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:52.494821 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-005687b7-9d5f-4f2d-b242-d35f3c2c67ab tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:52.495350 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-005687b7-9d5f-4f2d-b242-d35f3c2c67ab tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:52.495870 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-005687b7-9d5f-4f2d-b242-d35f3c2c67ab tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:52.566570 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bdcade43-eab6-4e9b-9508-ec7eb44f19b9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:52.579345 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bdcade43-eab6-4e9b-9508-ec7eb44f19b9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:52.584862 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bdcade43-eab6-4e9b-9508-ec7eb44f19b9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:52.603560 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bdcade43-eab6-4e9b-9508-ec7eb44f19b9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1555 microversion: 2.91 time: 0.198023 Sep 24 20:52:52.604183 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 480/956] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:52 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1555 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:52.610656 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-916555f9-dbd1-44e5-9c8b-8bfa3f94176f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:52.611278 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-916555f9-dbd1-44e5-9c8b-8bfa3f94176f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 1c19c5a4-46f9-4e5e-a717-55bc8e5c3026] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:52.617591 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-916555f9-dbd1-44e5-9c8b-8bfa3f94176f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:52.618234 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-916555f9-dbd1-44e5-9c8b-8bfa3f94176f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:52.618738 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-916555f9-dbd1-44e5-9c8b-8bfa3f94176f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:52.619443 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-916555f9-dbd1-44e5-9c8b-8bfa3f94176f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:52.619913 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-916555f9-dbd1-44e5-9c8b-8bfa3f94176f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:52.620411 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-916555f9-dbd1-44e5-9c8b-8bfa3f94176f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:52.761099 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-916555f9-dbd1-44e5-9c8b-8bfa3f94176f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:52.768808 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-916555f9-dbd1-44e5-9c8b-8bfa3f94176f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026" status: 200 len: 1277 microversion: 2.1 time: 0.163613 Sep 24 20:52:52.788972 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 481/957] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:52 2022] GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026 => generated 1277 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:52.796102 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e1f55818-fbe7-40cb-a905-48310c667ab9 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:52.797370 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e1f55818-fbe7-40cb-a905-48310c667ab9 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:52.806347 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1f55818-fbe7-40cb-a905-48310c667ab9 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:52.806984 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1f55818-fbe7-40cb-a905-48310c667ab9 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:52.807529 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1f55818-fbe7-40cb-a905-48310c667ab9 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:52.808344 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1f55818-fbe7-40cb-a905-48310c667ab9 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:52.808920 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1f55818-fbe7-40cb-a905-48310c667ab9 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:52.809441 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1f55818-fbe7-40cb-a905-48310c667ab9 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:52.828714 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-005687b7-9d5f-4f2d-b242-d35f3c2c67ab tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:52.840019 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-005687b7-9d5f-4f2d-b242-d35f3c2c67ab tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1462 microversion: 2.1 time: 0.366131 Sep 24 20:52:52.843498 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 477/958] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:52 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1462 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:52.858391 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8167880c-0c65-4bbc-bf15-7c41f3b932a9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:52.859045 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8167880c-0c65-4bbc-bf15-7c41f3b932a9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:52.868759 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8167880c-0c65-4bbc-bf15-7c41f3b932a9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:52.869261 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8167880c-0c65-4bbc-bf15-7c41f3b932a9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:52.869704 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8167880c-0c65-4bbc-bf15-7c41f3b932a9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:52.870696 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8167880c-0c65-4bbc-bf15-7c41f3b932a9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:52.871310 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8167880c-0c65-4bbc-bf15-7c41f3b932a9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:52.871889 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8167880c-0c65-4bbc-bf15-7c41f3b932a9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:53.080775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e1f55818-fbe7-40cb-a905-48310c667ab9 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:53.127831 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8167880c-0c65-4bbc-bf15-7c41f3b932a9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:53.133916 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e1f55818-fbe7-40cb-a905-48310c667ab9 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 200 len: 1324 microversion: 2.1 time: 0.343667 Sep 24 20:52:53.134541 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 482/959] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:52 2022] GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 1324 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:53.148939 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3d987e48-3fd3-4b32-bc9f-c82871c1465f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:53.154170 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8167880c-0c65-4bbc-bf15-7c41f3b932a9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1337 microversion: 2.1 time: 0.309276 Sep 24 20:52:53.155410 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 478/960] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:52 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1337 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:53.168435 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4289845b-103a-4d16-93ff-4570adf4683a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:53.170440 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4289845b-103a-4d16-93ff-4570adf4683a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:53.182700 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3d987e48-3fd3-4b32-bc9f-c82871c1465f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:53.199927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4289845b-103a-4d16-93ff-4570adf4683a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:53.204703 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4289845b-103a-4d16-93ff-4570adf4683a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:53.206839 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4289845b-103a-4d16-93ff-4570adf4683a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:53.207509 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d987e48-3fd3-4b32-bc9f-c82871c1465f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:53.209080 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d987e48-3fd3-4b32-bc9f-c82871c1465f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:53.211233 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4289845b-103a-4d16-93ff-4570adf4683a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:53.212009 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d987e48-3fd3-4b32-bc9f-c82871c1465f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:53.214885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4289845b-103a-4d16-93ff-4570adf4683a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:53.215432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d987e48-3fd3-4b32-bc9f-c82871c1465f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:53.216035 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4289845b-103a-4d16-93ff-4570adf4683a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:53.216699 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d987e48-3fd3-4b32-bc9f-c82871c1465f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:53.219256 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d987e48-3fd3-4b32-bc9f-c82871c1465f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:53.425815 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-3d987e48-3fd3-4b32-bc9f-c82871c1465f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:52:53.426364 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-3d987e48-3fd3-4b32-bc9f-c82871c1465f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:52:53.427806 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-3d987e48-3fd3-4b32-bc9f-c82871c1465f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:52:53.428244 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-3d987e48-3fd3-4b32-bc9f-c82871c1465f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:52:53.428671 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-3d987e48-3fd3-4b32-bc9f-c82871c1465f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:52:53.545845 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3d987e48-3fd3-4b32-bc9f-c82871c1465f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:53.557249 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d987e48-3fd3-4b32-bc9f-c82871c1465f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:53.557249 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d987e48-3fd3-4b32-bc9f-c82871c1465f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:53.557249 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d987e48-3fd3-4b32-bc9f-c82871c1465f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:53.558228 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d987e48-3fd3-4b32-bc9f-c82871c1465f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:53.558784 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d987e48-3fd3-4b32-bc9f-c82871c1465f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:53.559219 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d987e48-3fd3-4b32-bc9f-c82871c1465f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:53.564773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:53.595398 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3d987e48-3fd3-4b32-bc9f-c82871c1465f tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "POST /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a/action" status: 202 len: 1066 microversion: 2.1 time: 0.454046 Sep 24 20:52:53.596185 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 483/961] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:52:53 2022] POST /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a/action => generated 1066 bytes in 461 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 24 20:52:53.603153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-40e7e2dd-87c3-4a2f-92dd-5e5e5d895821 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:53.603766 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-40e7e2dd-87c3-4a2f-92dd-5e5e5d895821 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:53.611281 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-40e7e2dd-87c3-4a2f-92dd-5e5e5d895821 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:53.611793 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-40e7e2dd-87c3-4a2f-92dd-5e5e5d895821 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:53.612215 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-40e7e2dd-87c3-4a2f-92dd-5e5e5d895821 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:53.613062 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-40e7e2dd-87c3-4a2f-92dd-5e5e5d895821 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:53.613627 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-40e7e2dd-87c3-4a2f-92dd-5e5e5d895821 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:53.615046 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-40e7e2dd-87c3-4a2f-92dd-5e5e5d895821 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:53.874254 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4289845b-103a-4d16-93ff-4570adf4683a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:53.899469 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4289845b-103a-4d16-93ff-4570adf4683a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:53.902696 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4289845b-103a-4d16-93ff-4570adf4683a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:53.907547 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4289845b-103a-4d16-93ff-4570adf4683a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e" status: 200 len: 1567 microversion: 2.25 time: 0.750765 Sep 24 20:52:53.908469 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 479/962] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:53 2022] GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e => generated 1567 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:53.935921 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b55d6548-f35c-4b1d-9f49-d69a76cb7d9b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:53.938167 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b55d6548-f35c-4b1d-9f49-d69a76cb7d9b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:53.956233 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b55d6548-f35c-4b1d-9f49-d69a76cb7d9b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:53.956731 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b55d6548-f35c-4b1d-9f49-d69a76cb7d9b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:53.957172 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b55d6548-f35c-4b1d-9f49-d69a76cb7d9b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:53.959134 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b55d6548-f35c-4b1d-9f49-d69a76cb7d9b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:53.959722 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b55d6548-f35c-4b1d-9f49-d69a76cb7d9b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:53.960153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b55d6548-f35c-4b1d-9f49-d69a76cb7d9b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:53.961185 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-40e7e2dd-87c3-4a2f-92dd-5e5e5d895821 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:53.972709 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-40e7e2dd-87c3-4a2f-92dd-5e5e5d895821 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1358 microversion: 2.1 time: 0.372004 Sep 24 20:52:53.974070 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 484/963] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:53 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1358 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:53.980582 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f34164e2-d165-4819-b1f7-b163603f5dd9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:53.981196 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f34164e2-d165-4819-b1f7-b163603f5dd9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:53.999114 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f34164e2-d165-4819-b1f7-b163603f5dd9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:53.999618 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f34164e2-d165-4819-b1f7-b163603f5dd9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:54.000065 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f34164e2-d165-4819-b1f7-b163603f5dd9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:54.003683 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f34164e2-d165-4819-b1f7-b163603f5dd9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:54.004288 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f34164e2-d165-4819-b1f7-b163603f5dd9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:54.004767 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f34164e2-d165-4819-b1f7-b163603f5dd9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:54.182119 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f34164e2-d165-4819-b1f7-b163603f5dd9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:54.203253 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f34164e2-d165-4819-b1f7-b163603f5dd9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:54.209396 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f34164e2-d165-4819-b1f7-b163603f5dd9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:54.233923 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f34164e2-d165-4819-b1f7-b163603f5dd9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1555 microversion: 2.91 time: 0.257042 Sep 24 20:52:54.248391 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 485/964] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:53 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1555 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:54.248391 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-149e85e2-99a3-427b-9035-35529e361c9b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:54.248391 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-149e85e2-99a3-427b-9035-35529e361c9b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 1c19c5a4-46f9-4e5e-a717-55bc8e5c3026] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:54.268168 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-149e85e2-99a3-427b-9035-35529e361c9b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:54.268967 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-149e85e2-99a3-427b-9035-35529e361c9b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:54.269592 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-149e85e2-99a3-427b-9035-35529e361c9b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:54.275463 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-149e85e2-99a3-427b-9035-35529e361c9b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:54.276403 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-149e85e2-99a3-427b-9035-35529e361c9b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:54.277027 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-149e85e2-99a3-427b-9035-35529e361c9b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:54.451634 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b55d6548-f35c-4b1d-9f49-d69a76cb7d9b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:54.479942 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b55d6548-f35c-4b1d-9f49-d69a76cb7d9b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1471 microversion: 2.1 time: 0.559176 Sep 24 20:52:54.483870 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 480/965] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:53 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1471 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:54.506646 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-eb106015-2a6a-4ef4-8c5f-95b60a5e7f99 req-acd0c81c-aa15-4c74-b37e-03b14f8dcf61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e72414b7-9fb5-4059-92fe-46b1780543f3", "tag": "3c7dbe37-1536-469e-b3d7-785af8945b6a"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:54.542183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-eb106015-2a6a-4ef4-8c5f-95b60a5e7f99 req-acd0c81c-aa15-4c74-b37e-03b14f8dcf61 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:54.545768 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-eb106015-2a6a-4ef4-8c5f-95b60a5e7f99 req-acd0c81c-aa15-4c74-b37e-03b14f8dcf61 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:54.548017 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-eb106015-2a6a-4ef4-8c5f-95b60a5e7f99 req-acd0c81c-aa15-4c74-b37e-03b14f8dcf61 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:54.565780 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=13 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:54.568052 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-149e85e2-99a3-427b-9035-35529e361c9b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:54.583516 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-149e85e2-99a3-427b-9035-35529e361c9b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026" status: 200 len: 1319 microversion: 2.1 time: 0.345261 Sep 24 20:52:54.584656 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 486/966] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:54 2022] GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026 => generated 1319 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:54.589363 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-aa700fb6-ecae-4aa1-8dcd-a217a9e73ecd tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:54.589984 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-aa700fb6-ecae-4aa1-8dcd-a217a9e73ecd tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:54.597447 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aa700fb6-ecae-4aa1-8dcd-a217a9e73ecd tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:54.598716 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aa700fb6-ecae-4aa1-8dcd-a217a9e73ecd tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:54.599752 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aa700fb6-ecae-4aa1-8dcd-a217a9e73ecd tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:54.600956 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aa700fb6-ecae-4aa1-8dcd-a217a9e73ecd tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:54.601932 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-eb106015-2a6a-4ef4-8c5f-95b60a5e7f99 req-acd0c81c-aa15-4c74-b37e-03b14f8dcf61 service nova] Creating event network-changed:3c7dbe37-1536-469e-b3d7-785af8945b6a for instance e72414b7-9fb5-4059-92fe-46b1780543f3 on nch2-master-1 Sep 24 20:52:54.602065 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aa700fb6-ecae-4aa1-8dcd-a217a9e73ecd tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:54.602448 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aa700fb6-ecae-4aa1-8dcd-a217a9e73ecd tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:54.616597 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-eb106015-2a6a-4ef4-8c5f-95b60a5e7f99 req-acd0c81c-aa15-4c74-b37e-03b14f8dcf61 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130260 Sep 24 20:52:54.618036 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 481/967] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:52:54.631792 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8275bae0-0a42-49bf-8e85-65ebf51e0f3f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:54.632809 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8275bae0-0a42-49bf-8e85-65ebf51e0f3f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:54.648704 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8275bae0-0a42-49bf-8e85-65ebf51e0f3f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:54.649443 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8275bae0-0a42-49bf-8e85-65ebf51e0f3f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:54.650080 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8275bae0-0a42-49bf-8e85-65ebf51e0f3f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:54.650999 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8275bae0-0a42-49bf-8e85-65ebf51e0f3f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:54.651621 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8275bae0-0a42-49bf-8e85-65ebf51e0f3f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:54.652212 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8275bae0-0a42-49bf-8e85-65ebf51e0f3f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:54.907033 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-aa700fb6-ecae-4aa1-8dcd-a217a9e73ecd tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:54.919815 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-aa700fb6-ecae-4aa1-8dcd-a217a9e73ecd tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 200 len: 1324 microversion: 2.1 time: 0.333925 Sep 24 20:52:54.934527 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 487/968] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:54 2022] GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 1324 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:54.943049 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8275bae0-0a42-49bf-8e85-65ebf51e0f3f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:54.950533 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d8cb927c-0745-4c43-be56-ba06fae985db tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:54.950533 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d8cb927c-0745-4c43-be56-ba06fae985db tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:54.959611 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8275bae0-0a42-49bf-8e85-65ebf51e0f3f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1379 microversion: 2.1 time: 0.340089 Sep 24 20:52:54.971752 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d8cb927c-0745-4c43-be56-ba06fae985db tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:54.971752 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d8cb927c-0745-4c43-be56-ba06fae985db tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:54.971752 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d8cb927c-0745-4c43-be56-ba06fae985db tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:54.971752 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d8cb927c-0745-4c43-be56-ba06fae985db tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:54.972305 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d8cb927c-0745-4c43-be56-ba06fae985db tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:54.972402 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 482/969] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:54 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1379 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:54.972484 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d8cb927c-0745-4c43-be56-ba06fae985db tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:55.002084 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c3ed181b-930a-457d-ad9a-88bf56edf58f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:55.002720 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c3ed181b-930a-457d-ad9a-88bf56edf58f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:55.012494 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3ed181b-930a-457d-ad9a-88bf56edf58f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:55.012990 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3ed181b-930a-457d-ad9a-88bf56edf58f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:55.013431 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3ed181b-930a-457d-ad9a-88bf56edf58f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:55.014148 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3ed181b-930a-457d-ad9a-88bf56edf58f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:55.034179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3ed181b-930a-457d-ad9a-88bf56edf58f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:55.034736 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3ed181b-930a-457d-ad9a-88bf56edf58f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:55.237516 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d8cb927c-0745-4c43-be56-ba06fae985db tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:55.250727 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d8cb927c-0745-4c43-be56-ba06fae985db tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:55.253674 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d8cb927c-0745-4c43-be56-ba06fae985db tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:55.256086 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d8cb927c-0745-4c43-be56-ba06fae985db tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e" status: 200 len: 1567 microversion: 2.25 time: 0.320505 Sep 24 20:52:55.256716 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 488/970] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:54 2022] GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e => generated 1567 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:52:55.269485 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b557a0bb-7b37-45f1-adec-d30818b150e0 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:55.271197 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b557a0bb-7b37-45f1-adec-d30818b150e0 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:55.305256 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b557a0bb-7b37-45f1-adec-d30818b150e0 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:55.306026 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b557a0bb-7b37-45f1-adec-d30818b150e0 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:55.306547 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b557a0bb-7b37-45f1-adec-d30818b150e0 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:55.307398 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b557a0bb-7b37-45f1-adec-d30818b150e0 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:55.307869 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b557a0bb-7b37-45f1-adec-d30818b150e0 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:55.308300 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b557a0bb-7b37-45f1-adec-d30818b150e0 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:55.326766 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c3ed181b-930a-457d-ad9a-88bf56edf58f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:55.339373 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c3ed181b-930a-457d-ad9a-88bf56edf58f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1358 microversion: 2.1 time: 0.341090 Sep 24 20:52:55.341109 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 483/971] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:54 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1358 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:52:55.432290 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b557a0bb-7b37-45f1-adec-d30818b150e0 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:55.443134 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b557a0bb-7b37-45f1-adec-d30818b150e0 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:55.444620 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b557a0bb-7b37-45f1-adec-d30818b150e0 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:55.451326 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b557a0bb-7b37-45f1-adec-d30818b150e0 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1555 microversion: 2.91 time: 0.185569 Sep 24 20:52:55.452048 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 489/972] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:55 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1555 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:52:55.511190 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-477d7b10-ca81-495e-ae62-d2e2f2a3f92a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:55.512388 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-477d7b10-ca81-495e-ae62-d2e2f2a3f92a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:55.517922 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:55.519682 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-477d7b10-ca81-495e-ae62-d2e2f2a3f92a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:55.520327 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-477d7b10-ca81-495e-ae62-d2e2f2a3f92a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:55.521272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-477d7b10-ca81-495e-ae62-d2e2f2a3f92a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:55.521983 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-477d7b10-ca81-495e-ae62-d2e2f2a3f92a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:55.522604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-477d7b10-ca81-495e-ae62-d2e2f2a3f92a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:55.523166 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-477d7b10-ca81-495e-ae62-d2e2f2a3f92a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:55.616309 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-afcf6b86-289b-447d-9321-cb7c65d541d6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:55.631441 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-afcf6b86-289b-447d-9321-cb7c65d541d6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 1c19c5a4-46f9-4e5e-a717-55bc8e5c3026] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:55.639757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-afcf6b86-289b-447d-9321-cb7c65d541d6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:55.640409 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-afcf6b86-289b-447d-9321-cb7c65d541d6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:55.641907 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-afcf6b86-289b-447d-9321-cb7c65d541d6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:55.643011 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-afcf6b86-289b-447d-9321-cb7c65d541d6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:55.643646 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-afcf6b86-289b-447d-9321-cb7c65d541d6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:55.644235 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-afcf6b86-289b-447d-9321-cb7c65d541d6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:55.780880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-477d7b10-ca81-495e-ae62-d2e2f2a3f92a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:55.791174 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-477d7b10-ca81-495e-ae62-d2e2f2a3f92a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1471 microversion: 2.1 time: 0.284060 Sep 24 20:52:55.810589 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 484/973] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:55 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1471 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:55.867045 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-afcf6b86-289b-447d-9321-cb7c65d541d6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:55.875000 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-afcf6b86-289b-447d-9321-cb7c65d541d6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026" status: 200 len: 1319 microversion: 2.1 time: 0.266206 Sep 24 20:52:55.875473 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 490/974] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:55 2022] GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026 => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:55.947835 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-aa342ec5-5c62-40c6-8bb9-72c055d7840d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:55.948451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-aa342ec5-5c62-40c6-8bb9-72c055d7840d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:55.954885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa342ec5-5c62-40c6-8bb9-72c055d7840d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:55.955782 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa342ec5-5c62-40c6-8bb9-72c055d7840d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:55.956453 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa342ec5-5c62-40c6-8bb9-72c055d7840d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:55.957626 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa342ec5-5c62-40c6-8bb9-72c055d7840d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:55.958724 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa342ec5-5c62-40c6-8bb9-72c055d7840d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:55.959897 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa342ec5-5c62-40c6-8bb9-72c055d7840d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:55.986911 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-027c4eaf-619a-4eb2-8b2d-fd495bb06516 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:55.987746 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-027c4eaf-619a-4eb2-8b2d-fd495bb06516 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:55.995733 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-027c4eaf-619a-4eb2-8b2d-fd495bb06516 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:55.996145 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-027c4eaf-619a-4eb2-8b2d-fd495bb06516 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:55.996591 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-027c4eaf-619a-4eb2-8b2d-fd495bb06516 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:55.997290 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-027c4eaf-619a-4eb2-8b2d-fd495bb06516 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:55.997743 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-027c4eaf-619a-4eb2-8b2d-fd495bb06516 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:55.998309 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-027c4eaf-619a-4eb2-8b2d-fd495bb06516 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:56.200968 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-aa342ec5-5c62-40c6-8bb9-72c055d7840d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:56.210347 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-aa342ec5-5c62-40c6-8bb9-72c055d7840d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 200 len: 1324 microversion: 2.1 time: 0.266315 Sep 24 20:52:56.217468 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 485/975] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:55 2022] GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 1324 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:56.241244 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-027c4eaf-619a-4eb2-8b2d-fd495bb06516 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:56.251337 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-027c4eaf-619a-4eb2-8b2d-fd495bb06516 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1379 microversion: 2.1 time: 0.268338 Sep 24 20:52:56.253318 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 491/976] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:55 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1379 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:52:56.285438 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8c914187-902d-48e5-aa86-dde7e08fa978 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:56.286596 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8c914187-902d-48e5-aa86-dde7e08fa978 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:56.293015 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c914187-902d-48e5-aa86-dde7e08fa978 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:56.293522 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c914187-902d-48e5-aa86-dde7e08fa978 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:56.293963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c914187-902d-48e5-aa86-dde7e08fa978 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:56.294909 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c914187-902d-48e5-aa86-dde7e08fa978 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:56.295965 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c914187-902d-48e5-aa86-dde7e08fa978 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:56.296416 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c914187-902d-48e5-aa86-dde7e08fa978 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:56.361592 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-629c952d-aa70-42bb-8183-7ab3698ce5f6 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:56.362980 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-629c952d-aa70-42bb-8183-7ab3698ce5f6 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:56.373358 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-629c952d-aa70-42bb-8183-7ab3698ce5f6 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:56.374221 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-629c952d-aa70-42bb-8183-7ab3698ce5f6 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:56.374860 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-629c952d-aa70-42bb-8183-7ab3698ce5f6 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:56.375755 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-629c952d-aa70-42bb-8183-7ab3698ce5f6 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:56.376361 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-629c952d-aa70-42bb-8183-7ab3698ce5f6 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:56.376946 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-629c952d-aa70-42bb-8183-7ab3698ce5f6 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:56.534671 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8c914187-902d-48e5-aa86-dde7e08fa978 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:56.545525 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8c914187-902d-48e5-aa86-dde7e08fa978 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:56.548082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8c914187-902d-48e5-aa86-dde7e08fa978 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:56.549714 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8c914187-902d-48e5-aa86-dde7e08fa978 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e" status: 200 len: 1567 microversion: 2.25 time: 0.268268 Sep 24 20:52:56.550885 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 486/977] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:56 2022] GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e => generated 1567 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:56.556761 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-58054707-9e46-48a8-ad67-1cab205883ef tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:56.558030 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-58054707-9e46-48a8-ad67-1cab205883ef tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:56.565433 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-58054707-9e46-48a8-ad67-1cab205883ef tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:56.566257 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-58054707-9e46-48a8-ad67-1cab205883ef tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:56.568331 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-58054707-9e46-48a8-ad67-1cab205883ef tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:56.569645 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-58054707-9e46-48a8-ad67-1cab205883ef tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:56.570619 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-58054707-9e46-48a8-ad67-1cab205883ef tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:56.571402 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-58054707-9e46-48a8-ad67-1cab205883ef tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:56.611004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-629c952d-aa70-42bb-8183-7ab3698ce5f6 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:56.622608 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-629c952d-aa70-42bb-8183-7ab3698ce5f6 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1358 microversion: 2.1 time: 0.264972 Sep 24 20:52:56.625495 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 492/978] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:56 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1358 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:52:56.703926 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-58054707-9e46-48a8-ad67-1cab205883ef tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:56.714267 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-58054707-9e46-48a8-ad67-1cab205883ef tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:56.716112 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-58054707-9e46-48a8-ad67-1cab205883ef tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:56.722149 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-58054707-9e46-48a8-ad67-1cab205883ef tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1555 microversion: 2.91 time: 0.169871 Sep 24 20:52:56.724038 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 487/979] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:56 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:56.821797 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0e922028-5189-4f75-a6e7-4785cf31582a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:56.822386 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-0e4bf10e-9298-464f-a0bf-4ccd38f6f65c req-aee499c8-e2a9-42d0-9b8e-6c0527aca800 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "500f472e-d914-4eef-b315-7178f06ef6d8", "tag": "4d1d41e0-6d1a-4c5c-b228-5e9a7c7076e4"}, {"name": "network-changed", "server_uuid": "1c19c5a4-46f9-4e5e-a717-55bc8e5c3026", "tag": "35a118ee-28c5-40cd-9e35-d9ab0080224a"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:56.823234 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0e922028-5189-4f75-a6e7-4785cf31582a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:56.863053 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e922028-5189-4f75-a6e7-4785cf31582a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:56.865062 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e922028-5189-4f75-a6e7-4785cf31582a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:56.865718 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e922028-5189-4f75-a6e7-4785cf31582a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:56.867982 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e922028-5189-4f75-a6e7-4785cf31582a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:56.868888 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e922028-5189-4f75-a6e7-4785cf31582a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:56.871351 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e922028-5189-4f75-a6e7-4785cf31582a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:56.880737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-0e4bf10e-9298-464f-a0bf-4ccd38f6f65c req-aee499c8-e2a9-42d0-9b8e-6c0527aca800 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:56.881516 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-0e4bf10e-9298-464f-a0bf-4ccd38f6f65c req-aee499c8-e2a9-42d0-9b8e-6c0527aca800 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:56.882940 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-0e4bf10e-9298-464f-a0bf-4ccd38f6f65c req-aee499c8-e2a9-42d0-9b8e-6c0527aca800 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:56.914618 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-0e4bf10e-9298-464f-a0bf-4ccd38f6f65c req-aee499c8-e2a9-42d0-9b8e-6c0527aca800 service nova] Creating event network-changed:4d1d41e0-6d1a-4c5c-b228-5e9a7c7076e4 for instance 500f472e-d914-4eef-b315-7178f06ef6d8 on nch2-master-1 Sep 24 20:52:56.915956 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-0e4bf10e-9298-464f-a0bf-4ccd38f6f65c req-aee499c8-e2a9-42d0-9b8e-6c0527aca800 service nova] Creating event network-changed:35a118ee-28c5-40cd-9e35-d9ab0080224a for instance 1c19c5a4-46f9-4e5e-a717-55bc8e5c3026 on nch2-master-1 Sep 24 20:52:56.932376 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-0e4bf10e-9298-464f-a0bf-4ccd38f6f65c req-aee499c8-e2a9-42d0-9b8e-6c0527aca800 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.120582 Sep 24 20:52:56.932993 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 493/980] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:52:56.948793 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7c89de2f-efdb-45ec-a96c-49bcd57413fa tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:56.949507 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7c89de2f-efdb-45ec-a96c-49bcd57413fa tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 1c19c5a4-46f9-4e5e-a717-55bc8e5c3026] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:56.962434 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7c89de2f-efdb-45ec-a96c-49bcd57413fa tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:56.962981 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7c89de2f-efdb-45ec-a96c-49bcd57413fa tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:56.963426 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7c89de2f-efdb-45ec-a96c-49bcd57413fa tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:56.964147 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7c89de2f-efdb-45ec-a96c-49bcd57413fa tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:56.964611 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7c89de2f-efdb-45ec-a96c-49bcd57413fa tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:56.965046 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7c89de2f-efdb-45ec-a96c-49bcd57413fa tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:57.665691 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0e922028-5189-4f75-a6e7-4785cf31582a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:57.688019 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0e922028-5189-4f75-a6e7-4785cf31582a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1471 microversion: 2.1 time: 0.873292 Sep 24 20:52:57.711386 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 488/981] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:56 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1471 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:52:57.713533 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7c89de2f-efdb-45ec-a96c-49bcd57413fa tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:57.720456 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b1e55778-e5eb-496f-ba9b-a148d9b8a848 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:57.721106 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b1e55778-e5eb-496f-ba9b-a148d9b8a848 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:57.730235 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7c89de2f-efdb-45ec-a96c-49bcd57413fa tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026" status: 200 len: 1319 microversion: 2.1 time: 0.786390 Sep 24 20:52:57.757894 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 494/982] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:56 2022] GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026 => generated 1319 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:57.810115 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5d646470-e693-4608-9c62-bb1cfc5176f8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:57.813727 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1e55778-e5eb-496f-ba9b-a148d9b8a848 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:57.818208 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1e55778-e5eb-496f-ba9b-a148d9b8a848 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:57.818700 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1e55778-e5eb-496f-ba9b-a148d9b8a848 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:57.819483 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1e55778-e5eb-496f-ba9b-a148d9b8a848 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:57.819950 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1e55778-e5eb-496f-ba9b-a148d9b8a848 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:57.820389 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1e55778-e5eb-496f-ba9b-a148d9b8a848 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:57.821303 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5d646470-e693-4608-9c62-bb1cfc5176f8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:57.840666 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d646470-e693-4608-9c62-bb1cfc5176f8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:57.843072 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d646470-e693-4608-9c62-bb1cfc5176f8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:57.845629 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d646470-e693-4608-9c62-bb1cfc5176f8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:57.851889 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d646470-e693-4608-9c62-bb1cfc5176f8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:57.854554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d646470-e693-4608-9c62-bb1cfc5176f8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:57.855173 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d646470-e693-4608-9c62-bb1cfc5176f8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:58.262394 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b1e55778-e5eb-496f-ba9b-a148d9b8a848 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:58.271412 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b1e55778-e5eb-496f-ba9b-a148d9b8a848 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 200 len: 1324 microversion: 2.1 time: 0.558631 Sep 24 20:52:58.279056 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 489/983] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:57 2022] GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 1324 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:58.284717 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2cd12595-6f19-47a8-bd83-469d938bf3f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:58.287272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2cd12595-6f19-47a8-bd83-469d938bf3f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:58.302880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2cd12595-6f19-47a8-bd83-469d938bf3f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:58.303643 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2cd12595-6f19-47a8-bd83-469d938bf3f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:58.304262 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2cd12595-6f19-47a8-bd83-469d938bf3f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:58.305148 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2cd12595-6f19-47a8-bd83-469d938bf3f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:58.305762 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2cd12595-6f19-47a8-bd83-469d938bf3f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:58.306347 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2cd12595-6f19-47a8-bd83-469d938bf3f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:58.331151 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5d646470-e693-4608-9c62-bb1cfc5176f8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:58.347133 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5d646470-e693-4608-9c62-bb1cfc5176f8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1379 microversion: 2.1 time: 0.547442 Sep 24 20:52:58.354165 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 495/984] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:57 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1379 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:58.359232 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-12e4f370-71d5-4627-9ec8-e6d025fc430a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:58.360099 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-12e4f370-71d5-4627-9ec8-e6d025fc430a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:58.367182 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12e4f370-71d5-4627-9ec8-e6d025fc430a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:58.368006 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12e4f370-71d5-4627-9ec8-e6d025fc430a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:58.368672 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12e4f370-71d5-4627-9ec8-e6d025fc430a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:58.369828 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12e4f370-71d5-4627-9ec8-e6d025fc430a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:58.370547 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12e4f370-71d5-4627-9ec8-e6d025fc430a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:58.371668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12e4f370-71d5-4627-9ec8-e6d025fc430a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:58.451793 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=8 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:58.485922 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=38 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:58.735246 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2cd12595-6f19-47a8-bd83-469d938bf3f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:58.754389 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2cd12595-6f19-47a8-bd83-469d938bf3f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:58.757130 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2cd12595-6f19-47a8-bd83-469d938bf3f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:58.759041 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2cd12595-6f19-47a8-bd83-469d938bf3f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e" status: 200 len: 1567 microversion: 2.25 time: 0.485340 Sep 24 20:52:58.760080 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 490/985] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:58 2022] GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e => generated 1567 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:58.766406 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-45d3f163-41ac-4b72-ac9a-46ba6120daf7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:58.771348 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-45d3f163-41ac-4b72-ac9a-46ba6120daf7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:58.785997 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45d3f163-41ac-4b72-ac9a-46ba6120daf7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:58.788824 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45d3f163-41ac-4b72-ac9a-46ba6120daf7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:58.789563 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45d3f163-41ac-4b72-ac9a-46ba6120daf7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:58.790545 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45d3f163-41ac-4b72-ac9a-46ba6120daf7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:58.791183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45d3f163-41ac-4b72-ac9a-46ba6120daf7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:58.793465 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45d3f163-41ac-4b72-ac9a-46ba6120daf7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:58.839395 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-12e4f370-71d5-4627-9ec8-e6d025fc430a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:58.851057 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-12e4f370-71d5-4627-9ec8-e6d025fc430a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1358 microversion: 2.1 time: 0.495437 Sep 24 20:52:58.854051 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 496/986] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:58 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1358 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:58.871333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7542174f-8312-497b-bb37-e37299655ebd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:58.874124 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7542174f-8312-497b-bb37-e37299655ebd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:58.884603 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7542174f-8312-497b-bb37-e37299655ebd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:58.885506 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7542174f-8312-497b-bb37-e37299655ebd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:58.886316 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7542174f-8312-497b-bb37-e37299655ebd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:58.887324 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7542174f-8312-497b-bb37-e37299655ebd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:58.888342 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7542174f-8312-497b-bb37-e37299655ebd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:58.889129 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7542174f-8312-497b-bb37-e37299655ebd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:58.935037 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-45d3f163-41ac-4b72-ac9a-46ba6120daf7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:58.945835 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-45d3f163-41ac-4b72-ac9a-46ba6120daf7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:58.947784 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-45d3f163-41ac-4b72-ac9a-46ba6120daf7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:58.954589 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-45d3f163-41ac-4b72-ac9a-46ba6120daf7 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1555 microversion: 2.91 time: 0.193178 Sep 24 20:52:58.955918 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 491/987] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:58 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1555 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:52:58.975890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-49d32ae7-98ab-4830-831b-a394e206c815 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:58.976804 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-49d32ae7-98ab-4830-831b-a394e206c815 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 1c19c5a4-46f9-4e5e-a717-55bc8e5c3026] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:58.983609 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-49d32ae7-98ab-4830-831b-a394e206c815 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:58.984332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-49d32ae7-98ab-4830-831b-a394e206c815 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:58.985014 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-49d32ae7-98ab-4830-831b-a394e206c815 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:58.985952 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-49d32ae7-98ab-4830-831b-a394e206c815 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:58.986661 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-49d32ae7-98ab-4830-831b-a394e206c815 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:58.987297 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-49d32ae7-98ab-4830-831b-a394e206c815 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:59.007164 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=30 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:59.378171 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-49d32ae7-98ab-4830-831b-a394e206c815 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:59.381481 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7542174f-8312-497b-bb37-e37299655ebd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:59.384002 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:59.395034 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-49d32ae7-98ab-4830-831b-a394e206c815 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026" status: 200 len: 1319 microversion: 2.1 time: 0.436577 Sep 24 20:52:59.396360 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7542174f-8312-497b-bb37-e37299655ebd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1471 microversion: 2.1 time: 0.537229 Sep 24 20:52:59.397130 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 492/988] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:58 2022] GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026 => generated 1319 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:59.397957 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 497/989] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:58 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1471 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:59.402788 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-36726af5-1e4d-4f0a-8e07-c3d350c08015 req-abed4088-aa29-46f9-92ed-44c0962ff0ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "684811fb-a8ce-497a-a8f2-c66d6e4512bd", "tag": "f1619055-c388-4c6a-ae4a-12376117a1fd"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:52:59.403102 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b84a0cbe-9066-4d94-a55c-77ed20cf62a3 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:59.403823 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b84a0cbe-9066-4d94-a55c-77ed20cf62a3 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:59.411738 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b84a0cbe-9066-4d94-a55c-77ed20cf62a3 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:59.412532 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b84a0cbe-9066-4d94-a55c-77ed20cf62a3 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:59.413440 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b84a0cbe-9066-4d94-a55c-77ed20cf62a3 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:59.414736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b84a0cbe-9066-4d94-a55c-77ed20cf62a3 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:59.416044 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b84a0cbe-9066-4d94-a55c-77ed20cf62a3 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:59.416888 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b84a0cbe-9066-4d94-a55c-77ed20cf62a3 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:59.418216 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-36726af5-1e4d-4f0a-8e07-c3d350c08015 req-abed4088-aa29-46f9-92ed-44c0962ff0ca service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:59.418945 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-36726af5-1e4d-4f0a-8e07-c3d350c08015 req-abed4088-aa29-46f9-92ed-44c0962ff0ca service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:59.419715 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-36726af5-1e4d-4f0a-8e07-c3d350c08015 req-abed4088-aa29-46f9-92ed-44c0962ff0ca service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:59.442144 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-36726af5-1e4d-4f0a-8e07-c3d350c08015 req-abed4088-aa29-46f9-92ed-44c0962ff0ca service nova] Creating event network-changed:f1619055-c388-4c6a-ae4a-12376117a1fd for instance 684811fb-a8ce-497a-a8f2-c66d6e4512bd on nch1-master-1 Sep 24 20:52:59.452442 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-36726af5-1e4d-4f0a-8e07-c3d350c08015 req-abed4088-aa29-46f9-92ed-44c0962ff0ca service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053828 Sep 24 20:52:59.453760 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 493/990] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:52:59.461182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5e2a8daa-dfcf-4f3c-8065-fcf86820fc8f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:59.462173 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5e2a8daa-dfcf-4f3c-8065-fcf86820fc8f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:59.471629 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e2a8daa-dfcf-4f3c-8065-fcf86820fc8f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:59.472167 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e2a8daa-dfcf-4f3c-8065-fcf86820fc8f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:59.473161 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e2a8daa-dfcf-4f3c-8065-fcf86820fc8f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:59.473915 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e2a8daa-dfcf-4f3c-8065-fcf86820fc8f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:59.475027 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e2a8daa-dfcf-4f3c-8065-fcf86820fc8f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:59.475694 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e2a8daa-dfcf-4f3c-8065-fcf86820fc8f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:59.843908 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5e2a8daa-dfcf-4f3c-8065-fcf86820fc8f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:59.853687 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5e2a8daa-dfcf-4f3c-8065-fcf86820fc8f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1379 microversion: 2.1 time: 0.398410 Sep 24 20:52:59.854587 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 494/991] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:59 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1379 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:59.859852 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1f82d213-a62b-430c-a94a-49cfb442fef7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:59.860789 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1f82d213-a62b-430c-a94a-49cfb442fef7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:59.868495 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f82d213-a62b-430c-a94a-49cfb442fef7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:59.869311 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f82d213-a62b-430c-a94a-49cfb442fef7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:59.869931 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f82d213-a62b-430c-a94a-49cfb442fef7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:59.870901 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f82d213-a62b-430c-a94a-49cfb442fef7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:59.871586 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f82d213-a62b-430c-a94a-49cfb442fef7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:59.872187 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f82d213-a62b-430c-a94a-49cfb442fef7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:59.945881 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b84a0cbe-9066-4d94-a55c-77ed20cf62a3 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:52:59.959726 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b84a0cbe-9066-4d94-a55c-77ed20cf62a3 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 200 len: 1324 microversion: 2.1 time: 0.560509 Sep 24 20:52:59.960833 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 498/992] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:59 2022] GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 1324 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:52:59.968593 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bba62e60-def7-4bdf-aff5-49491e76417e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:52:59.969564 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bba62e60-def7-4bdf-aff5-49491e76417e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:52:59.987696 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bba62e60-def7-4bdf-aff5-49491e76417e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:59.989407 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bba62e60-def7-4bdf-aff5-49491e76417e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:59.990075 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bba62e60-def7-4bdf-aff5-49491e76417e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:52:59.991490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bba62e60-def7-4bdf-aff5-49491e76417e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:52:59.991657 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bba62e60-def7-4bdf-aff5-49491e76417e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:52:59.992382 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bba62e60-def7-4bdf-aff5-49491e76417e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:00.280106 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1f82d213-a62b-430c-a94a-49cfb442fef7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:00.290181 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1f82d213-a62b-430c-a94a-49cfb442fef7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:00.304479 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1f82d213-a62b-430c-a94a-49cfb442fef7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:00.306031 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1f82d213-a62b-430c-a94a-49cfb442fef7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e" status: 200 len: 1557 microversion: 2.25 time: 0.450314 Sep 24 20:53:00.306811 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 495/993] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:52:59 2022] GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e => generated 1557 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:00.311455 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9167efff-485e-43f4-b272-05c098c802c4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:00.312251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9167efff-485e-43f4-b272-05c098c802c4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:00.330388 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9167efff-485e-43f4-b272-05c098c802c4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:00.330922 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9167efff-485e-43f4-b272-05c098c802c4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:00.331392 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9167efff-485e-43f4-b272-05c098c802c4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:00.332404 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9167efff-485e-43f4-b272-05c098c802c4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:00.333236 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9167efff-485e-43f4-b272-05c098c802c4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:00.338037 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9167efff-485e-43f4-b272-05c098c802c4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:00.388089 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bba62e60-def7-4bdf-aff5-49491e76417e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:00.399604 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bba62e60-def7-4bdf-aff5-49491e76417e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1358 microversion: 2.1 time: 0.436992 Sep 24 20:53:00.400791 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 499/994] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:52:59 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1358 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:00.406770 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bbb09281-721f-4060-a9b6-f81da8d95e2a tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Calling method '.version_select at 0x7f4b0c6efdc0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:00.411081 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bbb09281-721f-4060-a9b6-f81da8d95e2a tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:00.411660 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bbb09281-721f-4060-a9b6-f81da8d95e2a tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:00.412190 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bbb09281-721f-4060-a9b6-f81da8d95e2a tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:00.426595 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bbb09281-721f-4060-a9b6-f81da8d95e2a tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 2365 microversion: 2.25 time: 0.023592 Sep 24 20:53:00.427650 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 500/995] 10.222.0.52 () {60 vars in 1184 bytes} [Sat Sep 24 20:53:00 2022] GET /compute/v2.1/os-migrations => generated 2365 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:00.432584 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-0de4f620-7ece-432e-ab53-db481ec68959 req-2397a7fd-eb17-4397-83a3-59054ed5e619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e72414b7-9fb5-4059-92fe-46b1780543f3", "name": "network-vif-plugged", "status": "completed", "tag": "3c7dbe37-1536-469e-b3d7-785af8945b6a"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:00.448284 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9167efff-485e-43f4-b272-05c098c802c4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:00.462372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9167efff-485e-43f4-b272-05c098c802c4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:00.465067 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-0de4f620-7ece-432e-ab53-db481ec68959 req-2397a7fd-eb17-4397-83a3-59054ed5e619 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:00.465794 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-0de4f620-7ece-432e-ab53-db481ec68959 req-2397a7fd-eb17-4397-83a3-59054ed5e619 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:00.466454 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-0de4f620-7ece-432e-ab53-db481ec68959 req-2397a7fd-eb17-4397-83a3-59054ed5e619 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:00.468340 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9167efff-485e-43f4-b272-05c098c802c4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:00.478490 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9167efff-485e-43f4-b272-05c098c802c4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1555 microversion: 2.91 time: 0.170478 Sep 24 20:53:00.486769 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-0de4f620-7ece-432e-ab53-db481ec68959 req-2397a7fd-eb17-4397-83a3-59054ed5e619 service nova] Creating event network-vif-plugged:3c7dbe37-1536-469e-b3d7-785af8945b6a for instance e72414b7-9fb5-4059-92fe-46b1780543f3 on nch2-master-1 Sep 24 20:53:00.491141 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 496/996] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:00 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1555 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:00.499642 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-0de4f620-7ece-432e-ab53-db481ec68959 req-2397a7fd-eb17-4397-83a3-59054ed5e619 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070442 Sep 24 20:53:00.500903 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 501/997] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:53:00.507422 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4dd32b94-f961-4a78-a678-e7666f4de270 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:00.508401 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-11ae3792-33ce-42ee-b15d-1c5957806d1a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:00.509073 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4dd32b94-f961-4a78-a678-e7666f4de270 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:00.509213 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-11ae3792-33ce-42ee-b15d-1c5957806d1a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 1c19c5a4-46f9-4e5e-a717-55bc8e5c3026] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:00.515649 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:00.515902 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-11ae3792-33ce-42ee-b15d-1c5957806d1a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:00.516466 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-11ae3792-33ce-42ee-b15d-1c5957806d1a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:00.517149 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-11ae3792-33ce-42ee-b15d-1c5957806d1a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:00.518137 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-11ae3792-33ce-42ee-b15d-1c5957806d1a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:00.518629 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4dd32b94-f961-4a78-a678-e7666f4de270 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:00.519106 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-11ae3792-33ce-42ee-b15d-1c5957806d1a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:00.519222 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4dd32b94-f961-4a78-a678-e7666f4de270 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:00.520127 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4dd32b94-f961-4a78-a678-e7666f4de270 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:00.520917 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-11ae3792-33ce-42ee-b15d-1c5957806d1a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:00.521076 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4dd32b94-f961-4a78-a678-e7666f4de270 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:00.521549 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4dd32b94-f961-4a78-a678-e7666f4de270 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:00.521981 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4dd32b94-f961-4a78-a678-e7666f4de270 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:00.529167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:00.800064 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-11ae3792-33ce-42ee-b15d-1c5957806d1a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:00.809567 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-11ae3792-33ce-42ee-b15d-1c5957806d1a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026" status: 200 len: 1319 microversion: 2.1 time: 0.317201 Sep 24 20:53:00.810535 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 497/998] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:00 2022] GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026 => generated 1319 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:00.813835 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4dd32b94-f961-4a78-a678-e7666f4de270 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:00.816180 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-56219e82-def7-4391-bc3c-bb6355495ac6 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:00.817649 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-56219e82-def7-4391-bc3c-bb6355495ac6 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:00.822701 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4dd32b94-f961-4a78-a678-e7666f4de270 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1471 microversion: 2.1 time: 0.320470 Sep 24 20:53:00.824871 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56219e82-def7-4391-bc3c-bb6355495ac6 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:00.825589 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56219e82-def7-4391-bc3c-bb6355495ac6 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:00.826227 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56219e82-def7-4391-bc3c-bb6355495ac6 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:00.827161 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56219e82-def7-4391-bc3c-bb6355495ac6 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:00.827783 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56219e82-def7-4391-bc3c-bb6355495ac6 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:00.828379 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56219e82-def7-4391-bc3c-bb6355495ac6 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:00.835096 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 502/999] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:00 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1471 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:00.920269 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-59381271-7ffa-4b8e-95d7-ce5cfe5a614f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:00.920907 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-59381271-7ffa-4b8e-95d7-ce5cfe5a614f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:00.930241 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-59381271-7ffa-4b8e-95d7-ce5cfe5a614f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:00.930777 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-59381271-7ffa-4b8e-95d7-ce5cfe5a614f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:00.931222 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-59381271-7ffa-4b8e-95d7-ce5cfe5a614f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:00.931944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-59381271-7ffa-4b8e-95d7-ce5cfe5a614f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:00.932660 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-59381271-7ffa-4b8e-95d7-ce5cfe5a614f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:00.933120 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-59381271-7ffa-4b8e-95d7-ce5cfe5a614f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:01.029249 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-56219e82-def7-4391-bc3c-bb6355495ac6 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lazy-loading 'services' on Instance uuid ca2ec54c-f6d0-43a4-abf4-c35d1cad952e {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:53:01.045333 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-56219e82-def7-4391-bc3c-bb6355495ac6 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e" status: 200 len: 2049 microversion: 2.25 time: 0.233375 Sep 24 20:53:01.050302 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 498/1000] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:00 2022] GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e => generated 2049 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:01.050707 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-735b172f-e009-47ff-a7db-7705ff360072 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:01.051220 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-735b172f-e009-47ff-a7db-7705ff360072 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:01.057712 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-735b172f-e009-47ff-a7db-7705ff360072 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:01.059355 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-735b172f-e009-47ff-a7db-7705ff360072 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:01.059821 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-735b172f-e009-47ff-a7db-7705ff360072 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:01.060554 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-735b172f-e009-47ff-a7db-7705ff360072 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:01.061025 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-735b172f-e009-47ff-a7db-7705ff360072 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:01.061465 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-735b172f-e009-47ff-a7db-7705ff360072 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:01.138230 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-59381271-7ffa-4b8e-95d7-ce5cfe5a614f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:01.156259 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-59381271-7ffa-4b8e-95d7-ce5cfe5a614f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1379 microversion: 2.1 time: 0.241649 Sep 24 20:53:01.156859 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 503/1001] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:00 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1379 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:01.169343 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-aac7bd46-de67-4a8b-890c-74481bcb3302 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2116350694", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "4720b9f0-7a36-43a8-8f75-d94ac4c68f4c"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:01.237110 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-aac7bd46-de67-4a8b-890c-74481bcb3302 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] validate_networks() for [('4720b9f0-7a36-43a8-8f75-d94ac4c68f4c', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:53:01.282531 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-735b172f-e009-47ff-a7db-7705ff360072 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:01.296185 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-735b172f-e009-47ff-a7db-7705ff360072 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 200 len: 1324 microversion: 2.1 time: 0.249154 Sep 24 20:53:01.296784 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 499/1002] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:01 2022] GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 1324 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:01.423956 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c2adaffe-a6a6-42fc-bcc6-b6cd092b106f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:01.424927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c2adaffe-a6a6-42fc-bcc6-b6cd092b106f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:01.432696 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2adaffe-a6a6-42fc-bcc6-b6cd092b106f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:01.433771 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2adaffe-a6a6-42fc-bcc6-b6cd092b106f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:01.434464 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2adaffe-a6a6-42fc-bcc6-b6cd092b106f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:01.435617 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2adaffe-a6a6-42fc-bcc6-b6cd092b106f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:01.436616 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2adaffe-a6a6-42fc-bcc6-b6cd092b106f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:01.437272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2adaffe-a6a6-42fc-bcc6-b6cd092b106f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:01.722381 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c2adaffe-a6a6-42fc-bcc6-b6cd092b106f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:01.739193 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c2adaffe-a6a6-42fc-bcc6-b6cd092b106f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1358 microversion: 2.1 time: 0.316457 Sep 24 20:53:01.740520 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 500/1003] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:01 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1358 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:01.749757 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-885c8704-3158-423d-8722-f5e6cae5ad12 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:01.753335 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-885c8704-3158-423d-8722-f5e6cae5ad12 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:01.760860 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-885c8704-3158-423d-8722-f5e6cae5ad12 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:01.761592 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-885c8704-3158-423d-8722-f5e6cae5ad12 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:01.762210 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-885c8704-3158-423d-8722-f5e6cae5ad12 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:01.764181 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-885c8704-3158-423d-8722-f5e6cae5ad12 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:01.764844 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-885c8704-3158-423d-8722-f5e6cae5ad12 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:01.765625 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-885c8704-3158-423d-8722-f5e6cae5ad12 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:01.882473 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-885c8704-3158-423d-8722-f5e6cae5ad12 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:01.902216 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-aac7bd46-de67-4a8b-890c-74481bcb3302 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:53:01.902980 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-aac7bd46-de67-4a8b-890c-74481bcb3302 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:53:01.903547 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-885c8704-3158-423d-8722-f5e6cae5ad12 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:01.903687 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-aac7bd46-de67-4a8b-890c-74481bcb3302 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:53:01.904154 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-aac7bd46-de67-4a8b-890c-74481bcb3302 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:53:01.904671 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-aac7bd46-de67-4a8b-890c-74481bcb3302 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:53:01.905047 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-885c8704-3158-423d-8722-f5e6cae5ad12 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:01.921650 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aac7bd46-de67-4a8b-890c-74481bcb3302 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:01.922902 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aac7bd46-de67-4a8b-890c-74481bcb3302 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:01.923644 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aac7bd46-de67-4a8b-890c-74481bcb3302 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:01.924993 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aac7bd46-de67-4a8b-890c-74481bcb3302 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:01.926293 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aac7bd46-de67-4a8b-890c-74481bcb3302 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:01.927018 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aac7bd46-de67-4a8b-890c-74481bcb3302 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:01.934456 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-885c8704-3158-423d-8722-f5e6cae5ad12 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1555 microversion: 2.91 time: 0.192643 Sep 24 20:53:01.948136 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-aac7bd46-de67-4a8b-890c-74481bcb3302 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Getting quotas for project f3c583f2016e4edd94aeec7dd64f9673. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:53:01.951665 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 501/1004] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:01 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1555 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:01.953916 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-aac7bd46-de67-4a8b-890c-74481bcb3302 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Getting quotas for user ca78cf6d34e84f2cb5cb254c5d8af1da and project f3c583f2016e4edd94aeec7dd64f9673. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:53:01.963004 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-17709dc3-f15c-47e3-90ca-2f07ed26b4a9 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:01.963654 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-17709dc3-f15c-47e3-90ca-2f07ed26b4a9 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 1c19c5a4-46f9-4e5e-a717-55bc8e5c3026] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:01.970539 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-aac7bd46-de67-4a8b-890c-74481bcb3302 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:53:01.974170 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-aac7bd46-de67-4a8b-890c-74481bcb3302 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:53:01.979619 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17709dc3-f15c-47e3-90ca-2f07ed26b4a9 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:01.980122 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17709dc3-f15c-47e3-90ca-2f07ed26b4a9 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:01.980567 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17709dc3-f15c-47e3-90ca-2f07ed26b4a9 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:01.986924 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17709dc3-f15c-47e3-90ca-2f07ed26b4a9 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:01.987464 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17709dc3-f15c-47e3-90ca-2f07ed26b4a9 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:01.987923 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17709dc3-f15c-47e3-90ca-2f07ed26b4a9 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:02.041363 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-aac7bd46-de67-4a8b-890c-74481bcb3302 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.883379 Sep 24 20:53:02.052590 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 504/1005] 10.222.0.52 () {62 vars in 1188 bytes} [Sat Sep 24 20:53:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 24 20:53:02.066822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-07a06d47-e52b-4b49-b39a-75b484499a70 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:02.070213 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-07a06d47-e52b-4b49-b39a-75b484499a70 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:02.078023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-07a06d47-e52b-4b49-b39a-75b484499a70 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:02.078628 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-07a06d47-e52b-4b49-b39a-75b484499a70 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:02.079075 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-07a06d47-e52b-4b49-b39a-75b484499a70 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:02.081236 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-07a06d47-e52b-4b49-b39a-75b484499a70 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:02.082439 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-07a06d47-e52b-4b49-b39a-75b484499a70 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:02.083378 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-07a06d47-e52b-4b49-b39a-75b484499a70 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:02.292012 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-17709dc3-f15c-47e3-90ca-2f07ed26b4a9 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:02.301684 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-17709dc3-f15c-47e3-90ca-2f07ed26b4a9 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026" status: 200 len: 1319 microversion: 2.1 time: 0.348518 Sep 24 20:53:02.315646 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 502/1006] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:01 2022] GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026 => generated 1319 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:02.324943 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-df237830-3631-44af-a987-cb77836b80fc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:02.326031 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-df237830-3631-44af-a987-cb77836b80fc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:02.359855 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-07a06d47-e52b-4b49-b39a-75b484499a70 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:02.368616 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-07a06d47-e52b-4b49-b39a-75b484499a70 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1471 microversion: 2.1 time: 0.314701 Sep 24 20:53:02.369395 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 505/1007] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:02 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1471 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:02.405765 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9a0656ac-1115-4e43-9beb-f4cd0b9895b8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:02.409835 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9a0656ac-1115-4e43-9beb-f4cd0b9895b8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:02.421534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a0656ac-1115-4e43-9beb-f4cd0b9895b8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:02.422053 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a0656ac-1115-4e43-9beb-f4cd0b9895b8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:02.426771 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a0656ac-1115-4e43-9beb-f4cd0b9895b8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:02.427920 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a0656ac-1115-4e43-9beb-f4cd0b9895b8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:02.432714 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a0656ac-1115-4e43-9beb-f4cd0b9895b8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:02.433544 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a0656ac-1115-4e43-9beb-f4cd0b9895b8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:02.465208 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-df237830-3631-44af-a987-cb77836b80fc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:02.482996 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-df237830-3631-44af-a987-cb77836b80fc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:02.485154 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-df237830-3631-44af-a987-cb77836b80fc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:02.488558 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-df237830-3631-44af-a987-cb77836b80fc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1262 microversion: 2.25 time: 0.171365 Sep 24 20:53:02.491367 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 503/1008] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:02 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1262 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:02.503658 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9a73f3ce-6618-4b22-aef5-048bd4e21fd4 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:02.508138 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9a73f3ce-6618-4b22-aef5-048bd4e21fd4 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:02.523763 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9a73f3ce-6618-4b22-aef5-048bd4e21fd4 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:02.524503 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9a73f3ce-6618-4b22-aef5-048bd4e21fd4 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:02.525806 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9a73f3ce-6618-4b22-aef5-048bd4e21fd4 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:02.526809 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9a73f3ce-6618-4b22-aef5-048bd4e21fd4 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:02.541834 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9a73f3ce-6618-4b22-aef5-048bd4e21fd4 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:02.542377 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9a73f3ce-6618-4b22-aef5-048bd4e21fd4 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:02.789257 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9a0656ac-1115-4e43-9beb-f4cd0b9895b8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:02.800690 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9a0656ac-1115-4e43-9beb-f4cd0b9895b8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1379 microversion: 2.1 time: 0.410560 Sep 24 20:53:02.801768 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 506/1009] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:02 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1379 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:02.806936 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-7b2a0beb-d62a-454c-80b7-ecddac077547 req-cce825b3-d96e-48d7-ad81-6ec5156ee75e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a57ca61-642f-4749-a3f2-3ae1cfcbc542", "name": "network-vif-plugged", "status": "completed", "tag": "3db6518e-fc81-4574-b1fa-978663ca6d51"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:02.823798 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-7b2a0beb-d62a-454c-80b7-ecddac077547 req-cce825b3-d96e-48d7-ad81-6ec5156ee75e service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:02.824563 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-7b2a0beb-d62a-454c-80b7-ecddac077547 req-cce825b3-d96e-48d7-ad81-6ec5156ee75e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:02.825170 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-7b2a0beb-d62a-454c-80b7-ecddac077547 req-cce825b3-d96e-48d7-ad81-6ec5156ee75e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:02.839679 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-7b2a0beb-d62a-454c-80b7-ecddac077547 req-cce825b3-d96e-48d7-ad81-6ec5156ee75e service nova] Creating event network-vif-plugged:3db6518e-fc81-4574-b1fa-978663ca6d51 for instance 6a57ca61-642f-4749-a3f2-3ae1cfcbc542 on nch1-master-1 Sep 24 20:53:02.844923 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-7b2a0beb-d62a-454c-80b7-ecddac077547 req-cce825b3-d96e-48d7-ad81-6ec5156ee75e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041556 Sep 24 20:53:02.846734 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 507/1010] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:53:02.848481 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9a73f3ce-6618-4b22-aef5-048bd4e21fd4 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:02.853400 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b38a6b37-0436-4895-9366-ca9cd3bac187 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:02.854395 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b38a6b37-0436-4895-9366-ca9cd3bac187 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:02.859834 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9a73f3ce-6618-4b22-aef5-048bd4e21fd4 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 200 len: 1324 microversion: 2.1 time: 0.362274 Sep 24 20:53:02.861070 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b38a6b37-0436-4895-9366-ca9cd3bac187 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:02.861654 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b38a6b37-0436-4895-9366-ca9cd3bac187 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:02.862162 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 504/1011] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:02 2022] GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 1324 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:02.862283 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b38a6b37-0436-4895-9366-ca9cd3bac187 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:02.863711 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b38a6b37-0436-4895-9366-ca9cd3bac187 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:02.864074 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b38a6b37-0436-4895-9366-ca9cd3bac187 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:02.864755 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b38a6b37-0436-4895-9366-ca9cd3bac187 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:02.970545 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d9e7145c-6199-48fd-b23f-0211b5b09661 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:02.971572 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d9e7145c-6199-48fd-b23f-0211b5b09661 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:02.979404 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d9e7145c-6199-48fd-b23f-0211b5b09661 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:02.980184 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d9e7145c-6199-48fd-b23f-0211b5b09661 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:02.980844 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d9e7145c-6199-48fd-b23f-0211b5b09661 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:02.981632 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d9e7145c-6199-48fd-b23f-0211b5b09661 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:02.982547 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d9e7145c-6199-48fd-b23f-0211b5b09661 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:02.983345 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d9e7145c-6199-48fd-b23f-0211b5b09661 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:03.017866 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b38a6b37-0436-4895-9366-ca9cd3bac187 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:03.027148 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b38a6b37-0436-4895-9366-ca9cd3bac187 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1358 microversion: 2.1 time: 0.178888 Sep 24 20:53:03.039026 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 508/1012] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:02 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:03.073824 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d9e7145c-6199-48fd-b23f-0211b5b09661 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:03.084179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d9e7145c-6199-48fd-b23f-0211b5b09661 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:03.085742 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d9e7145c-6199-48fd-b23f-0211b5b09661 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:03.091427 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d9e7145c-6199-48fd-b23f-0211b5b09661 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1555 microversion: 2.91 time: 0.126037 Sep 24 20:53:03.092366 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 505/1013] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:02 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1555 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:53:03.333872 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c26c8903-04c8-4b89-b3d4-368d3b2fce90 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:03.336521 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c26c8903-04c8-4b89-b3d4-368d3b2fce90 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 1c19c5a4-46f9-4e5e-a717-55bc8e5c3026] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:03.354229 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c26c8903-04c8-4b89-b3d4-368d3b2fce90 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:03.357493 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c26c8903-04c8-4b89-b3d4-368d3b2fce90 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:03.358291 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c26c8903-04c8-4b89-b3d4-368d3b2fce90 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:03.360340 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c26c8903-04c8-4b89-b3d4-368d3b2fce90 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:03.362448 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c26c8903-04c8-4b89-b3d4-368d3b2fce90 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:03.363852 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c26c8903-04c8-4b89-b3d4-368d3b2fce90 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:03.397443 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f6648d17-02dc-46f5-b56c-b4353d3f50d9 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:03.398245 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f6648d17-02dc-46f5-b56c-b4353d3f50d9 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:03.410556 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6648d17-02dc-46f5-b56c-b4353d3f50d9 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:03.414608 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6648d17-02dc-46f5-b56c-b4353d3f50d9 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:03.417019 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6648d17-02dc-46f5-b56c-b4353d3f50d9 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:03.421049 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6648d17-02dc-46f5-b56c-b4353d3f50d9 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:03.421656 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6648d17-02dc-46f5-b56c-b4353d3f50d9 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:03.422801 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6648d17-02dc-46f5-b56c-b4353d3f50d9 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:04.203471 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f6648d17-02dc-46f5-b56c-b4353d3f50d9 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:04.209917 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c26c8903-04c8-4b89-b3d4-368d3b2fce90 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:04.220182 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f6648d17-02dc-46f5-b56c-b4353d3f50d9 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1471 microversion: 2.1 time: 0.827484 Sep 24 20:53:04.220579 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c26c8903-04c8-4b89-b3d4-368d3b2fce90 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026" status: 200 len: 1319 microversion: 2.1 time: 0.896769 Sep 24 20:53:04.230525 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 506/1014] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:03 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1471 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:04.230525 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-31c76e0f-6410-4268-a2fd-e306c0f1ebda tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:04.230525 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-31c76e0f-6410-4268-a2fd-e306c0f1ebda tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:04.238746 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 509/1015] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:03 2022] GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026 => generated 1319 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:04.242560 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-85bb0732-1143-49da-a34e-59badea06f53 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:04.243177 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-85bb0732-1143-49da-a34e-59badea06f53 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:04.249740 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85bb0732-1143-49da-a34e-59badea06f53 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:04.250485 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85bb0732-1143-49da-a34e-59badea06f53 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:04.250636 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-31c76e0f-6410-4268-a2fd-e306c0f1ebda tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:04.250971 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85bb0732-1143-49da-a34e-59badea06f53 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:04.251092 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-31c76e0f-6410-4268-a2fd-e306c0f1ebda tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:04.251475 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-31c76e0f-6410-4268-a2fd-e306c0f1ebda tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:04.251682 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85bb0732-1143-49da-a34e-59badea06f53 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:04.252143 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85bb0732-1143-49da-a34e-59badea06f53 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:04.252262 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-31c76e0f-6410-4268-a2fd-e306c0f1ebda tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:04.252639 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-31c76e0f-6410-4268-a2fd-e306c0f1ebda tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:04.252871 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85bb0732-1143-49da-a34e-59badea06f53 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:04.253060 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-31c76e0f-6410-4268-a2fd-e306c0f1ebda tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:04.422706 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-31c76e0f-6410-4268-a2fd-e306c0f1ebda tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:04.442026 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-31c76e0f-6410-4268-a2fd-e306c0f1ebda tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:04.448435 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-31c76e0f-6410-4268-a2fd-e306c0f1ebda tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:04.450469 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-31c76e0f-6410-4268-a2fd-e306c0f1ebda tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1314 microversion: 2.25 time: 0.224424 Sep 24 20:53:04.463023 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 507/1016] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:04 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:04.475272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-07502508-48fb-4683-9884-b1ae584405bf tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:04.476148 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-07502508-48fb-4683-9884-b1ae584405bf tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:04.486251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07502508-48fb-4683-9884-b1ae584405bf tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:04.487079 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07502508-48fb-4683-9884-b1ae584405bf tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:04.489498 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07502508-48fb-4683-9884-b1ae584405bf tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:04.491276 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07502508-48fb-4683-9884-b1ae584405bf tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:04.492279 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07502508-48fb-4683-9884-b1ae584405bf tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:04.492906 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07502508-48fb-4683-9884-b1ae584405bf tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:04.585361 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-85bb0732-1143-49da-a34e-59badea06f53 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:04.594541 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-85bb0732-1143-49da-a34e-59badea06f53 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1379 microversion: 2.1 time: 0.360797 Sep 24 20:53:04.612688 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 510/1017] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:04 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1379 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:04.648972 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2a0798d7-5c41-4821-847d-18fe2efef29b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:04.649608 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2a0798d7-5c41-4821-847d-18fe2efef29b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:04.664466 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a0798d7-5c41-4821-847d-18fe2efef29b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:04.679591 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a0798d7-5c41-4821-847d-18fe2efef29b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:04.683272 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a0798d7-5c41-4821-847d-18fe2efef29b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:04.686001 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a0798d7-5c41-4821-847d-18fe2efef29b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:04.688611 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a0798d7-5c41-4821-847d-18fe2efef29b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:04.689131 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a0798d7-5c41-4821-847d-18fe2efef29b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:04.965547 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-07502508-48fb-4683-9884-b1ae584405bf tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:04.974730 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-07502508-48fb-4683-9884-b1ae584405bf tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 200 len: 1324 microversion: 2.1 time: 0.504169 Sep 24 20:53:04.978645 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 508/1018] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:04 2022] GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 1324 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:04.989680 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-aa44d52b-16ba-4bab-b23f-e34cc5978cd8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:04.992311 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-aa44d52b-16ba-4bab-b23f-e34cc5978cd8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:05.009840 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa44d52b-16ba-4bab-b23f-e34cc5978cd8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:05.010716 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa44d52b-16ba-4bab-b23f-e34cc5978cd8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:05.011324 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa44d52b-16ba-4bab-b23f-e34cc5978cd8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:05.012232 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa44d52b-16ba-4bab-b23f-e34cc5978cd8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:05.012850 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa44d52b-16ba-4bab-b23f-e34cc5978cd8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:05.020429 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa44d52b-16ba-4bab-b23f-e34cc5978cd8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:05.165670 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-aa44d52b-16ba-4bab-b23f-e34cc5978cd8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:05.185507 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-aa44d52b-16ba-4bab-b23f-e34cc5978cd8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:05.190615 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-aa44d52b-16ba-4bab-b23f-e34cc5978cd8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:05.197221 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-aa44d52b-16ba-4bab-b23f-e34cc5978cd8 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1555 microversion: 2.91 time: 0.217349 Sep 24 20:53:05.198394 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 509/1019] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:04 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1555 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:05.245930 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e185645c-012a-43ff-b275-b67c88577504 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:05.246919 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e185645c-012a-43ff-b275-b67c88577504 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 1c19c5a4-46f9-4e5e-a717-55bc8e5c3026] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:05.266578 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e185645c-012a-43ff-b275-b67c88577504 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:05.267077 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e185645c-012a-43ff-b275-b67c88577504 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:05.267512 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e185645c-012a-43ff-b275-b67c88577504 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:05.268405 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e185645c-012a-43ff-b275-b67c88577504 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:05.269597 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e185645c-012a-43ff-b275-b67c88577504 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:05.270039 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e185645c-012a-43ff-b275-b67c88577504 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:05.355082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2a0798d7-5c41-4821-847d-18fe2efef29b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:05.365633 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2a0798d7-5c41-4821-847d-18fe2efef29b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1541 microversion: 2.1 time: 0.747845 Sep 24 20:53:05.366604 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 511/1020] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:04 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1541 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:05.387197 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9fd40092-f46b-473e-9f14-e91711df07e0 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:05.388244 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9fd40092-f46b-473e-9f14-e91711df07e0 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:05.406038 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fd40092-f46b-473e-9f14-e91711df07e0 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:05.407103 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fd40092-f46b-473e-9f14-e91711df07e0 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:05.407559 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fd40092-f46b-473e-9f14-e91711df07e0 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:05.408277 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fd40092-f46b-473e-9f14-e91711df07e0 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:05.409128 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fd40092-f46b-473e-9f14-e91711df07e0 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:05.409542 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fd40092-f46b-473e-9f14-e91711df07e0 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:05.467127 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e185645c-012a-43ff-b275-b67c88577504 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:05.475041 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:05.488487 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e185645c-012a-43ff-b275-b67c88577504 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026" status: 200 len: 1319 microversion: 2.1 time: 0.246494 Sep 24 20:53:05.502520 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 510/1021] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:05 2022] GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026 => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:05.502520 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-728cd5d3-f299-4a5c-bea9-47df90cfd714 req-a1c7b686-e345-4db7-80c0-5456e6f18451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c19c5a4-46f9-4e5e-a717-55bc8e5c3026", "name": "network-vif-plugged", "status": "completed", "tag": "35a118ee-28c5-40cd-9e35-d9ab0080224a"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:05.517751 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-728cd5d3-f299-4a5c-bea9-47df90cfd714 req-a1c7b686-e345-4db7-80c0-5456e6f18451 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:05.517751 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-728cd5d3-f299-4a5c-bea9-47df90cfd714 req-a1c7b686-e345-4db7-80c0-5456e6f18451 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:05.517751 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-728cd5d3-f299-4a5c-bea9-47df90cfd714 req-a1c7b686-e345-4db7-80c0-5456e6f18451 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:05.528416 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-728cd5d3-f299-4a5c-bea9-47df90cfd714 req-a1c7b686-e345-4db7-80c0-5456e6f18451 service nova] Creating event network-vif-plugged:35a118ee-28c5-40cd-9e35-d9ab0080224a for instance 1c19c5a4-46f9-4e5e-a717-55bc8e5c3026 on nch2-master-1 Sep 24 20:53:05.533883 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-728cd5d3-f299-4a5c-bea9-47df90cfd714 req-a1c7b686-e345-4db7-80c0-5456e6f18451 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040792 Sep 24 20:53:05.535691 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 511/1022] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:53:05.541574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c2bb910f-9bf9-4632-8a95-c366cfd183dd tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:05.543017 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c2bb910f-9bf9-4632-8a95-c366cfd183dd tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:05.549525 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2bb910f-9bf9-4632-8a95-c366cfd183dd tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:05.550100 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2bb910f-9bf9-4632-8a95-c366cfd183dd tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:05.551355 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2bb910f-9bf9-4632-8a95-c366cfd183dd tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:05.552153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2bb910f-9bf9-4632-8a95-c366cfd183dd tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:05.552699 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2bb910f-9bf9-4632-8a95-c366cfd183dd tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:05.553238 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2bb910f-9bf9-4632-8a95-c366cfd183dd tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:05.737212 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c2bb910f-9bf9-4632-8a95-c366cfd183dd tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.200042 Sep 24 20:53:05.738380 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 512/1023] 10.222.0.52 () {58 vars in 1275 bytes} [Sat Sep 24 20:53:05 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3/os-interface => generated 284 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:53:05.743715 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-892efca7-838a-47e5-ae14-255dd79c2bac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:05.744338 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-892efca7-838a-47e5-ae14-255dd79c2bac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:05.750807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-892efca7-838a-47e5-ae14-255dd79c2bac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:05.751300 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-892efca7-838a-47e5-ae14-255dd79c2bac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:05.751735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-892efca7-838a-47e5-ae14-255dd79c2bac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:05.752439 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-892efca7-838a-47e5-ae14-255dd79c2bac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:05.753012 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-892efca7-838a-47e5-ae14-255dd79c2bac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:05.753303 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-892efca7-838a-47e5-ae14-255dd79c2bac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:05.798366 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9fd40092-f46b-473e-9f14-e91711df07e0 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:05.809733 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9fd40092-f46b-473e-9f14-e91711df07e0 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1471 microversion: 2.1 time: 0.436779 Sep 24 20:53:05.810663 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 512/1024] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:05 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1471 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:05.817445 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8a4ae151-eaf2-4e2b-bc9e-ef6c9702abdc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:05.818369 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8a4ae151-eaf2-4e2b-bc9e-ef6c9702abdc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:05.827458 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8a4ae151-eaf2-4e2b-bc9e-ef6c9702abdc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:05.828168 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8a4ae151-eaf2-4e2b-bc9e-ef6c9702abdc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:05.828762 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8a4ae151-eaf2-4e2b-bc9e-ef6c9702abdc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:05.829714 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8a4ae151-eaf2-4e2b-bc9e-ef6c9702abdc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:05.830327 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8a4ae151-eaf2-4e2b-bc9e-ef6c9702abdc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:05.830949 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8a4ae151-eaf2-4e2b-bc9e-ef6c9702abdc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:05.885018 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-892efca7-838a-47e5-ae14-255dd79c2bac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:05.896253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-892efca7-838a-47e5-ae14-255dd79c2bac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:05.897705 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-892efca7-838a-47e5-ae14-255dd79c2bac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:05.898898 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-892efca7-838a-47e5-ae14-255dd79c2bac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1320 microversion: 2.25 time: 0.158870 Sep 24 20:53:05.899811 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 513/1025] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:05 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1320 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:06.006098 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2c276d39-f645-4f43-b2bf-c643ef3a22cb tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:06.007206 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2c276d39-f645-4f43-b2bf-c643ef3a22cb tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:06.015988 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c276d39-f645-4f43-b2bf-c643ef3a22cb tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:06.016476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c276d39-f645-4f43-b2bf-c643ef3a22cb tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:06.017244 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c276d39-f645-4f43-b2bf-c643ef3a22cb tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:06.023992 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c276d39-f645-4f43-b2bf-c643ef3a22cb tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:06.024584 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c276d39-f645-4f43-b2bf-c643ef3a22cb tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:06.025443 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c276d39-f645-4f43-b2bf-c643ef3a22cb tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:06.153610 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8a4ae151-eaf2-4e2b-bc9e-ef6c9702abdc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:06.171287 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8a4ae151-eaf2-4e2b-bc9e-ef6c9702abdc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1379 microversion: 2.1 time: 0.358162 Sep 24 20:53:06.172604 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 513/1026] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:05 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1379 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:06.227657 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4ea1a653-6a7b-4ad7-8d73-c834da96332b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:06.228876 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4ea1a653-6a7b-4ad7-8d73-c834da96332b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:06.240597 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ea1a653-6a7b-4ad7-8d73-c834da96332b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:06.241217 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ea1a653-6a7b-4ad7-8d73-c834da96332b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:06.242313 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ea1a653-6a7b-4ad7-8d73-c834da96332b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:06.243181 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ea1a653-6a7b-4ad7-8d73-c834da96332b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:06.243784 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ea1a653-6a7b-4ad7-8d73-c834da96332b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:06.244355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ea1a653-6a7b-4ad7-8d73-c834da96332b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:06.367428 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4ea1a653-6a7b-4ad7-8d73-c834da96332b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:06.373172 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2c276d39-f645-4f43-b2bf-c643ef3a22cb tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:06.385793 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2c276d39-f645-4f43-b2bf-c643ef3a22cb tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 200 len: 1324 microversion: 2.1 time: 0.385815 Sep 24 20:53:06.388595 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 514/1027] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:05 2022] GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 1324 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:06.404608 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4ea1a653-6a7b-4ad7-8d73-c834da96332b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:06.407013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4ea1a653-6a7b-4ad7-8d73-c834da96332b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:06.414442 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4ea1a653-6a7b-4ad7-8d73-c834da96332b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1537 microversion: 2.91 time: 0.192904 Sep 24 20:53:06.421630 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 514/1028] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:06 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1537 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:53:06.515639 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-35446078-717f-4809-8f9a-7e2eae363c37 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:06.516435 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-35446078-717f-4809-8f9a-7e2eae363c37 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 1c19c5a4-46f9-4e5e-a717-55bc8e5c3026] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:06.523576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35446078-717f-4809-8f9a-7e2eae363c37 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:06.524072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35446078-717f-4809-8f9a-7e2eae363c37 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:06.524701 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35446078-717f-4809-8f9a-7e2eae363c37 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:06.525585 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35446078-717f-4809-8f9a-7e2eae363c37 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:06.526052 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35446078-717f-4809-8f9a-7e2eae363c37 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:06.526690 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35446078-717f-4809-8f9a-7e2eae363c37 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:06.759904 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-35446078-717f-4809-8f9a-7e2eae363c37 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:06.768168 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-35446078-717f-4809-8f9a-7e2eae363c37 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026" status: 200 len: 1319 microversion: 2.1 time: 0.256337 Sep 24 20:53:06.768754 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 515/1029] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:06 2022] GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026 => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:06.837177 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9fdaf60c-5744-42f5-8d5e-0e6ea4231c15 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:06.838599 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9fdaf60c-5744-42f5-8d5e-0e6ea4231c15 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:06.848936 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fdaf60c-5744-42f5-8d5e-0e6ea4231c15 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:06.850868 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fdaf60c-5744-42f5-8d5e-0e6ea4231c15 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:06.851753 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fdaf60c-5744-42f5-8d5e-0e6ea4231c15 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:06.855266 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fdaf60c-5744-42f5-8d5e-0e6ea4231c15 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:06.855960 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fdaf60c-5744-42f5-8d5e-0e6ea4231c15 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:06.856586 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fdaf60c-5744-42f5-8d5e-0e6ea4231c15 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:06.931228 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0e498bc9-fb13-4f4e-8a11-baf67b2e870d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:06.933164 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0e498bc9-fb13-4f4e-8a11-baf67b2e870d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:06.939820 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e498bc9-fb13-4f4e-8a11-baf67b2e870d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:06.940698 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e498bc9-fb13-4f4e-8a11-baf67b2e870d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:06.941930 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e498bc9-fb13-4f4e-8a11-baf67b2e870d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:06.942843 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e498bc9-fb13-4f4e-8a11-baf67b2e870d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:06.947940 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e498bc9-fb13-4f4e-8a11-baf67b2e870d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:06.948636 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e498bc9-fb13-4f4e-8a11-baf67b2e870d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:07.209106 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9fdaf60c-5744-42f5-8d5e-0e6ea4231c15 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:07.220676 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9fdaf60c-5744-42f5-8d5e-0e6ea4231c15 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1471 microversion: 2.1 time: 0.387316 Sep 24 20:53:07.222801 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 515/1030] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:06 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1471 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:07.229642 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7998bbd2-12e5-4215-8d57-8da0babd8dfe tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:07.230542 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7998bbd2-12e5-4215-8d57-8da0babd8dfe tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:07.239755 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7998bbd2-12e5-4215-8d57-8da0babd8dfe tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:07.240628 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7998bbd2-12e5-4215-8d57-8da0babd8dfe tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:07.241321 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7998bbd2-12e5-4215-8d57-8da0babd8dfe tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:07.243833 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7998bbd2-12e5-4215-8d57-8da0babd8dfe tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:07.244718 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7998bbd2-12e5-4215-8d57-8da0babd8dfe tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:07.245877 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7998bbd2-12e5-4215-8d57-8da0babd8dfe tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:07.251721 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0e498bc9-fb13-4f4e-8a11-baf67b2e870d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:07.270542 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0e498bc9-fb13-4f4e-8a11-baf67b2e870d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:07.272935 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0e498bc9-fb13-4f4e-8a11-baf67b2e870d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:07.277314 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0e498bc9-fb13-4f4e-8a11-baf67b2e870d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1362 microversion: 2.25 time: 0.354707 Sep 24 20:53:07.281457 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 516/1031] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:06 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1362 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:07.414619 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-47de984e-8c44-4b6c-abad-3f45e72c41a7 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:07.415871 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-47de984e-8c44-4b6c-abad-3f45e72c41a7 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:07.431280 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47de984e-8c44-4b6c-abad-3f45e72c41a7 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:07.431791 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47de984e-8c44-4b6c-abad-3f45e72c41a7 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:07.432695 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47de984e-8c44-4b6c-abad-3f45e72c41a7 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:07.433846 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47de984e-8c44-4b6c-abad-3f45e72c41a7 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:07.434315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47de984e-8c44-4b6c-abad-3f45e72c41a7 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:07.434803 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47de984e-8c44-4b6c-abad-3f45e72c41a7 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:07.609004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7998bbd2-12e5-4215-8d57-8da0babd8dfe tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:07.618372 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7998bbd2-12e5-4215-8d57-8da0babd8dfe tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1379 microversion: 2.1 time: 0.393852 Sep 24 20:53:07.634364 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 516/1032] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:07 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1379 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:07.634364 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-35658f95-21bf-439f-b2d6-b41205545199 req-b61e8d02-8559-478e-ad17-2d3b375cb361 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e72414b7-9fb5-4059-92fe-46b1780543f3", "tag": "3c7dbe37-1536-469e-b3d7-785af8945b6a"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:07.634364 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-35658f95-21bf-439f-b2d6-b41205545199 req-b61e8d02-8559-478e-ad17-2d3b375cb361 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:07.634838 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-35658f95-21bf-439f-b2d6-b41205545199 req-b61e8d02-8559-478e-ad17-2d3b375cb361 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:07.635524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-35658f95-21bf-439f-b2d6-b41205545199 req-b61e8d02-8559-478e-ad17-2d3b375cb361 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:07.650750 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-35658f95-21bf-439f-b2d6-b41205545199 req-b61e8d02-8559-478e-ad17-2d3b375cb361 service nova] Creating event network-changed:3c7dbe37-1536-469e-b3d7-785af8945b6a for instance e72414b7-9fb5-4059-92fe-46b1780543f3 on nch2-master-1 Sep 24 20:53:07.656189 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-35658f95-21bf-439f-b2d6-b41205545199 req-b61e8d02-8559-478e-ad17-2d3b375cb361 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036021 Sep 24 20:53:07.657201 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 517/1033] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:53:07.663112 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c5fa64ed-becf-4de2-9b3c-49d8f1bf69b6 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:07.663820 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c5fa64ed-becf-4de2-9b3c-49d8f1bf69b6 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:07.671565 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c5fa64ed-becf-4de2-9b3c-49d8f1bf69b6 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:07.672060 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c5fa64ed-becf-4de2-9b3c-49d8f1bf69b6 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:07.672501 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c5fa64ed-becf-4de2-9b3c-49d8f1bf69b6 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:07.673232 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c5fa64ed-becf-4de2-9b3c-49d8f1bf69b6 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:07.674361 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c5fa64ed-becf-4de2-9b3c-49d8f1bf69b6 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:07.674828 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c5fa64ed-becf-4de2-9b3c-49d8f1bf69b6 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:07.704718 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-47de984e-8c44-4b6c-abad-3f45e72c41a7 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:07.725768 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-47de984e-8c44-4b6c-abad-3f45e72c41a7 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 200 len: 1324 microversion: 2.1 time: 0.316209 Sep 24 20:53:07.726388 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 517/1034] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:07 2022] GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 1324 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:07.731312 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-7562d046-a6a9-4e65-8f69-fc8cc6ee7c20 req-785c1707-e846-4245-bb9d-c185cd3ad348 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "684811fb-a8ce-497a-a8f2-c66d6e4512bd", "name": "network-vif-plugged", "status": "completed", "tag": "f1619055-c388-4c6a-ae4a-12376117a1fd"}, {"server_uuid": "500f472e-d914-4eef-b315-7178f06ef6d8", "name": "network-vif-plugged", "status": "completed", "tag": "4d1d41e0-6d1a-4c5c-b228-5e9a7c7076e4"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:07.743486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-7562d046-a6a9-4e65-8f69-fc8cc6ee7c20 req-785c1707-e846-4245-bb9d-c185cd3ad348 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:07.744376 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-7562d046-a6a9-4e65-8f69-fc8cc6ee7c20 req-785c1707-e846-4245-bb9d-c185cd3ad348 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:07.744982 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-7562d046-a6a9-4e65-8f69-fc8cc6ee7c20 req-785c1707-e846-4245-bb9d-c185cd3ad348 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:07.760122 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-7562d046-a6a9-4e65-8f69-fc8cc6ee7c20 req-785c1707-e846-4245-bb9d-c185cd3ad348 service nova] Creating event network-vif-plugged:f1619055-c388-4c6a-ae4a-12376117a1fd for instance 684811fb-a8ce-497a-a8f2-c66d6e4512bd on nch1-master-1 Sep 24 20:53:07.760806 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-7562d046-a6a9-4e65-8f69-fc8cc6ee7c20 req-785c1707-e846-4245-bb9d-c185cd3ad348 service nova] Creating event network-vif-plugged:4d1d41e0-6d1a-4c5c-b228-5e9a7c7076e4 for instance 500f472e-d914-4eef-b315-7178f06ef6d8 on nch2-master-1 Sep 24 20:53:07.764450 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c5fa64ed-becf-4de2-9b3c-49d8f1bf69b6 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:07.777003 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c5fa64ed-becf-4de2-9b3c-49d8f1bf69b6 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:07.778854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c5fa64ed-becf-4de2-9b3c-49d8f1bf69b6 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:07.785448 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c5fa64ed-becf-4de2-9b3c-49d8f1bf69b6 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1537 microversion: 2.91 time: 0.126380 Sep 24 20:53:07.788404 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-7562d046-a6a9-4e65-8f69-fc8cc6ee7c20 req-785c1707-e846-4245-bb9d-c185cd3ad348 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.060543 Sep 24 20:53:07.791148 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 518/1035] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:53:07.798895 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d2cfdb39-812a-46c3-9be6-dabc1c020026 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:07.799629 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d2cfdb39-812a-46c3-9be6-dabc1c020026 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 1c19c5a4-46f9-4e5e-a717-55bc8e5c3026] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:07.810484 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d2cfdb39-812a-46c3-9be6-dabc1c020026 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:07.811249 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d2cfdb39-812a-46c3-9be6-dabc1c020026 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:07.812469 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d2cfdb39-812a-46c3-9be6-dabc1c020026 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:07.814400 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d2cfdb39-812a-46c3-9be6-dabc1c020026 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:07.815040 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d2cfdb39-812a-46c3-9be6-dabc1c020026 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:07.815647 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d2cfdb39-812a-46c3-9be6-dabc1c020026 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:07.818840 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 518/1036] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:07 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1537 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:08.082840 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d2cfdb39-812a-46c3-9be6-dabc1c020026 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:08.091603 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d2cfdb39-812a-46c3-9be6-dabc1c020026 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026" status: 200 len: 1319 microversion: 2.1 time: 0.299165 Sep 24 20:53:08.108537 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 519/1037] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:07 2022] GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026 => generated 1319 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:08.127967 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-3744a358-8b68-4eb6-addf-9cfe6d3b9a9f req-e8079637-97a9-45ad-90a6-da073b690646 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03612730-8fd5-4006-aa0a-0c90feb1ea64", "tag": "f19f1969-880f-461a-a794-33b5a54fa613"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:08.138164 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-3744a358-8b68-4eb6-addf-9cfe6d3b9a9f req-e8079637-97a9-45ad-90a6-da073b690646 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:08.138805 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-3744a358-8b68-4eb6-addf-9cfe6d3b9a9f req-e8079637-97a9-45ad-90a6-da073b690646 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:08.139426 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-3744a358-8b68-4eb6-addf-9cfe6d3b9a9f req-e8079637-97a9-45ad-90a6-da073b690646 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:08.150691 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-3744a358-8b68-4eb6-addf-9cfe6d3b9a9f req-e8079637-97a9-45ad-90a6-da073b690646 service nova] Creating event network-changed:f19f1969-880f-461a-a794-33b5a54fa613 for instance 03612730-8fd5-4006-aa0a-0c90feb1ea64 on nch1-master-1 Sep 24 20:53:08.155718 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-3744a358-8b68-4eb6-addf-9cfe6d3b9a9f req-e8079637-97a9-45ad-90a6-da073b690646 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031468 Sep 24 20:53:08.156477 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 519/1038] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:53:08.246415 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d3e546d7-75ae-488b-a55a-06a4e7678205 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:08.247069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d3e546d7-75ae-488b-a55a-06a4e7678205 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:08.254222 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d3e546d7-75ae-488b-a55a-06a4e7678205 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:08.254750 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d3e546d7-75ae-488b-a55a-06a4e7678205 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:08.255192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d3e546d7-75ae-488b-a55a-06a4e7678205 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:08.255915 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d3e546d7-75ae-488b-a55a-06a4e7678205 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:08.256378 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d3e546d7-75ae-488b-a55a-06a4e7678205 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:08.256806 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d3e546d7-75ae-488b-a55a-06a4e7678205 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:08.310408 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b0fffb79-503f-4a09-854c-bc0f4e3e34e1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:08.311253 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b0fffb79-503f-4a09-854c-bc0f4e3e34e1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:08.318947 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b0fffb79-503f-4a09-854c-bc0f4e3e34e1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:08.320000 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b0fffb79-503f-4a09-854c-bc0f4e3e34e1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:08.320888 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b0fffb79-503f-4a09-854c-bc0f4e3e34e1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:08.321755 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b0fffb79-503f-4a09-854c-bc0f4e3e34e1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:08.322215 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b0fffb79-503f-4a09-854c-bc0f4e3e34e1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:08.322822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b0fffb79-503f-4a09-854c-bc0f4e3e34e1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:08.461181 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d3e546d7-75ae-488b-a55a-06a4e7678205 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:08.469500 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d3e546d7-75ae-488b-a55a-06a4e7678205 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1471 microversion: 2.1 time: 0.226896 Sep 24 20:53:08.478533 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 520/1039] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:08 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1471 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:08.627775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b0fffb79-503f-4a09-854c-bc0f4e3e34e1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:08.641012 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b2fc49f6-5ae0-48ab-bf58-e6a2e7978a45 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:08.641708 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b2fc49f6-5ae0-48ab-bf58-e6a2e7978a45 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:08.643629 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b0fffb79-503f-4a09-854c-bc0f4e3e34e1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:08.646319 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b0fffb79-503f-4a09-854c-bc0f4e3e34e1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:08.647513 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b0fffb79-503f-4a09-854c-bc0f4e3e34e1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1362 microversion: 2.25 time: 0.341382 Sep 24 20:53:08.648071 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 520/1040] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:08 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1362 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:53:08.651674 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b2fc49f6-5ae0-48ab-bf58-e6a2e7978a45 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:08.652170 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b2fc49f6-5ae0-48ab-bf58-e6a2e7978a45 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:08.652613 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b2fc49f6-5ae0-48ab-bf58-e6a2e7978a45 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:08.653321 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b2fc49f6-5ae0-48ab-bf58-e6a2e7978a45 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:08.653772 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b2fc49f6-5ae0-48ab-bf58-e6a2e7978a45 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:08.662391 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b2fc49f6-5ae0-48ab-bf58-e6a2e7978a45 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:08.749612 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fcc2529a-9d26-463c-a298-9a3d75c26f57 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:08.750298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fcc2529a-9d26-463c-a298-9a3d75c26f57 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:08.758014 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fcc2529a-9d26-463c-a298-9a3d75c26f57 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:08.758527 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fcc2529a-9d26-463c-a298-9a3d75c26f57 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:08.758983 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fcc2529a-9d26-463c-a298-9a3d75c26f57 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:08.759699 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fcc2529a-9d26-463c-a298-9a3d75c26f57 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:08.760167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fcc2529a-9d26-463c-a298-9a3d75c26f57 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:08.760599 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fcc2529a-9d26-463c-a298-9a3d75c26f57 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:08.779954 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:08.811315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b2fc49f6-5ae0-48ab-bf58-e6a2e7978a45 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:08.820197 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b2fc49f6-5ae0-48ab-bf58-e6a2e7978a45 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1379 microversion: 2.1 time: 0.182924 Sep 24 20:53:08.820781 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 521/1041] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:08 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1379 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:08.825536 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9794ac7d-8ee8-48dc-bd50-0549c0214e83 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:08.826152 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9794ac7d-8ee8-48dc-bd50-0549c0214e83 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:08.832633 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9794ac7d-8ee8-48dc-bd50-0549c0214e83 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:08.833184 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9794ac7d-8ee8-48dc-bd50-0549c0214e83 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:08.833576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9794ac7d-8ee8-48dc-bd50-0549c0214e83 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:08.834353 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9794ac7d-8ee8-48dc-bd50-0549c0214e83 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:08.834797 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9794ac7d-8ee8-48dc-bd50-0549c0214e83 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:08.835498 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9794ac7d-8ee8-48dc-bd50-0549c0214e83 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:08.901816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9794ac7d-8ee8-48dc-bd50-0549c0214e83 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:08.910873 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9794ac7d-8ee8-48dc-bd50-0549c0214e83 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:08.912392 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9794ac7d-8ee8-48dc-bd50-0549c0214e83 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:08.917322 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9794ac7d-8ee8-48dc-bd50-0549c0214e83 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1537 microversion: 2.91 time: 0.095577 Sep 24 20:53:08.917905 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 522/1042] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:08 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1537 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:08.923833 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fcc2529a-9d26-463c-a298-9a3d75c26f57 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:08.932322 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fcc2529a-9d26-463c-a298-9a3d75c26f57 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 200 len: 1324 microversion: 2.1 time: 0.186844 Sep 24 20:53:08.932887 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 521/1043] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:08 2022] GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 1324 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:09.115394 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a16e3fe9-4ba5-48e6-b00a-a6b890834c79 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:09.115924 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a16e3fe9-4ba5-48e6-b00a-a6b890834c79 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 1c19c5a4-46f9-4e5e-a717-55bc8e5c3026] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:09.122549 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a16e3fe9-4ba5-48e6-b00a-a6b890834c79 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:09.123040 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a16e3fe9-4ba5-48e6-b00a-a6b890834c79 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:09.123477 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a16e3fe9-4ba5-48e6-b00a-a6b890834c79 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:09.124171 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a16e3fe9-4ba5-48e6-b00a-a6b890834c79 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:09.124625 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a16e3fe9-4ba5-48e6-b00a-a6b890834c79 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:09.125050 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a16e3fe9-4ba5-48e6-b00a-a6b890834c79 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:09.496349 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5301797c-10b2-4a08-ac66-0c4b7b6b6d57 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:09.496974 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5301797c-10b2-4a08-ac66-0c4b7b6b6d57 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:09.504116 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5301797c-10b2-4a08-ac66-0c4b7b6b6d57 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:09.504623 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5301797c-10b2-4a08-ac66-0c4b7b6b6d57 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:09.505207 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5301797c-10b2-4a08-ac66-0c4b7b6b6d57 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:09.505937 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5301797c-10b2-4a08-ac66-0c4b7b6b6d57 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:09.506403 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5301797c-10b2-4a08-ac66-0c4b7b6b6d57 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:09.506893 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5301797c-10b2-4a08-ac66-0c4b7b6b6d57 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:09.678582 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a16e3fe9-4ba5-48e6-b00a-a6b890834c79 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:09.689025 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a16e3fe9-4ba5-48e6-b00a-a6b890834c79 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026" status: 200 len: 1319 microversion: 2.1 time: 0.577726 Sep 24 20:53:09.690118 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 523/1044] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:09 2022] GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026 => generated 1319 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:09.712188 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-07c74330-4f9d-4462-8fb8-fc5ca2f1471e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:09.712814 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-07c74330-4f9d-4462-8fb8-fc5ca2f1471e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:09.723745 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07c74330-4f9d-4462-8fb8-fc5ca2f1471e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:09.724528 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07c74330-4f9d-4462-8fb8-fc5ca2f1471e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:09.725885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07c74330-4f9d-4462-8fb8-fc5ca2f1471e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:09.726900 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07c74330-4f9d-4462-8fb8-fc5ca2f1471e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:09.727601 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07c74330-4f9d-4462-8fb8-fc5ca2f1471e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:09.728957 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07c74330-4f9d-4462-8fb8-fc5ca2f1471e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:09.748649 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5301797c-10b2-4a08-ac66-0c4b7b6b6d57 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:09.758080 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5301797c-10b2-4a08-ac66-0c4b7b6b6d57 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1471 microversion: 2.1 time: 0.265576 Sep 24 20:53:09.759534 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 522/1045] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:09 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1471 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:09.843947 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bd20368a-4b8f-432b-87bd-b022409c7b62 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:09.844567 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bd20368a-4b8f-432b-87bd-b022409c7b62 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:09.851035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bd20368a-4b8f-432b-87bd-b022409c7b62 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:09.851903 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bd20368a-4b8f-432b-87bd-b022409c7b62 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:09.853775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bd20368a-4b8f-432b-87bd-b022409c7b62 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:09.854557 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bd20368a-4b8f-432b-87bd-b022409c7b62 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:09.855031 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bd20368a-4b8f-432b-87bd-b022409c7b62 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:09.855469 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bd20368a-4b8f-432b-87bd-b022409c7b62 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:10.017509 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-07c74330-4f9d-4462-8fb8-fc5ca2f1471e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:10.026390 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-07c74330-4f9d-4462-8fb8-fc5ca2f1471e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:10.027880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-07c74330-4f9d-4462-8fb8-fc5ca2f1471e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:10.028977 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-07c74330-4f9d-4462-8fb8-fc5ca2f1471e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1362 microversion: 2.25 time: 0.320743 Sep 24 20:53:10.029534 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 524/1046] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:09 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1362 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:10.034236 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-afc34d63-41b9-411b-a384-787c0cb47dd1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:10.034876 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-afc34d63-41b9-411b-a384-787c0cb47dd1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:10.042287 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-afc34d63-41b9-411b-a384-787c0cb47dd1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:10.042807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-afc34d63-41b9-411b-a384-787c0cb47dd1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:10.043243 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-afc34d63-41b9-411b-a384-787c0cb47dd1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:10.043951 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-afc34d63-41b9-411b-a384-787c0cb47dd1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:10.044394 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-afc34d63-41b9-411b-a384-787c0cb47dd1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:10.044816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-afc34d63-41b9-411b-a384-787c0cb47dd1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:10.096500 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bd20368a-4b8f-432b-87bd-b022409c7b62 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:10.105487 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bd20368a-4b8f-432b-87bd-b022409c7b62 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1527 microversion: 2.1 time: 0.265430 Sep 24 20:53:10.106068 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 523/1047] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:09 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1527 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:10.122348 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8432696f-4eca-4e32-ace1-d2ad6513a815 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:10.123024 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8432696f-4eca-4e32-ace1-d2ad6513a815 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:10.129835 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8432696f-4eca-4e32-ace1-d2ad6513a815 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:10.130334 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8432696f-4eca-4e32-ace1-d2ad6513a815 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:10.130817 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8432696f-4eca-4e32-ace1-d2ad6513a815 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:10.131450 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-afc34d63-41b9-411b-a384-787c0cb47dd1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:10.131589 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8432696f-4eca-4e32-ace1-d2ad6513a815 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:10.131979 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8432696f-4eca-4e32-ace1-d2ad6513a815 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:10.132411 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8432696f-4eca-4e32-ace1-d2ad6513a815 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:10.140344 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-afc34d63-41b9-411b-a384-787c0cb47dd1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:10.142587 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-afc34d63-41b9-411b-a384-787c0cb47dd1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:10.146644 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:10.150298 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-afc34d63-41b9-411b-a384-787c0cb47dd1 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1540 microversion: 2.91 time: 0.119233 Sep 24 20:53:10.150957 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 525/1048] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:10 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1540 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:10.155850 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2e8441ce-230b-42c8-9f5e-36a2037202aa tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:10.156572 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2e8441ce-230b-42c8-9f5e-36a2037202aa tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:10.163348 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e8441ce-230b-42c8-9f5e-36a2037202aa tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:10.163938 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e8441ce-230b-42c8-9f5e-36a2037202aa tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:10.164604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e8441ce-230b-42c8-9f5e-36a2037202aa tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:10.165627 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e8441ce-230b-42c8-9f5e-36a2037202aa tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:10.166154 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e8441ce-230b-42c8-9f5e-36a2037202aa tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:10.166706 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e8441ce-230b-42c8-9f5e-36a2037202aa tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:10.405412 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8432696f-4eca-4e32-ace1-d2ad6513a815 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:10.414240 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8432696f-4eca-4e32-ace1-d2ad6513a815 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 200 len: 1324 microversion: 2.1 time: 0.306976 Sep 24 20:53:10.414907 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 524/1049] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:10 2022] GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 1324 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:10.419453 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7286187a-f1ff-49bc-9756-4ba84bffdc9b tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "nch1-master-1"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:10.421931 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7286187a-f1ff-49bc-9756-4ba84bffdc9b tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:10.435837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7286187a-f1ff-49bc-9756-4ba84bffdc9b tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:10.436343 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7286187a-f1ff-49bc-9756-4ba84bffdc9b tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:10.436791 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7286187a-f1ff-49bc-9756-4ba84bffdc9b tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:10.437519 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7286187a-f1ff-49bc-9756-4ba84bffdc9b tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:10.438565 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7286187a-f1ff-49bc-9756-4ba84bffdc9b tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:10.438565 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7286187a-f1ff-49bc-9756-4ba84bffdc9b tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:10.451790 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2e8441ce-230b-42c8-9f5e-36a2037202aa tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:10.464986 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2e8441ce-230b-42c8-9f5e-36a2037202aa tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1527 microversion: 2.1 time: 0.312409 Sep 24 20:53:10.485316 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 526/1050] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:10 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1527 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:10.491569 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fad67fed-7089-45f4-96a1-044b6a5f8466 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:10.528124 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7286187a-f1ff-49bc-9756-4ba84bffdc9b tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "nch1-master-1". {{(pid=140517) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 24 20:53:10.528691 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fad67fed-7089-45f4-96a1-044b6a5f8466 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/5bff3db1-43db-4c23-bdea-b823b03cf9b3" status: 202 len: 0 microversion: 2.1 time: 0.040461 Sep 24 20:53:10.528982 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 527/1051] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:53:10 2022] DELETE /compute/v2.1/flavors/5bff3db1-43db-4c23-bdea-b823b03cf9b3 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:53:10.542505 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-eea20a2f-4c87-4afa-bbeb-9403d2f60f5f tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:10.567918 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-eea20a2f-4c87-4afa-bbeb-9403d2f60f5f tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.031620 Sep 24 20:53:10.568901 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 528/1052] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:53:10 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:10.592540 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8cf0db6f-9df3-468d-878c-6c377196da10 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:10.595682 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8cf0db6f-9df3-468d-878c-6c377196da10 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:10.602947 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8cf0db6f-9df3-468d-878c-6c377196da10 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:10.603586 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8cf0db6f-9df3-468d-878c-6c377196da10 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:10.604130 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8cf0db6f-9df3-468d-878c-6c377196da10 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:10.604946 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8cf0db6f-9df3-468d-878c-6c377196da10 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:10.605527 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8cf0db6f-9df3-468d-878c-6c377196da10 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:10.606054 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8cf0db6f-9df3-468d-878c-6c377196da10 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:10.608245 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7286187a-f1ff-49bc-9756-4ba84bffdc9b tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e/action" status: 202 len: 0 microversion: 2.91 time: 0.192355 Sep 24 20:53:10.609155 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 525/1053] 10.222.0.52 () {62 vars in 1319 bytes} [Sat Sep 24 20:53:10 2022] POST /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:53:10.617449 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8171f7d3-83ed-4563-bf7f-9ae6130859e3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:10.618071 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8171f7d3-83ed-4563-bf7f-9ae6130859e3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:10.624448 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8171f7d3-83ed-4563-bf7f-9ae6130859e3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:10.624952 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8171f7d3-83ed-4563-bf7f-9ae6130859e3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:10.625396 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8171f7d3-83ed-4563-bf7f-9ae6130859e3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:10.626110 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8171f7d3-83ed-4563-bf7f-9ae6130859e3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:10.626808 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8171f7d3-83ed-4563-bf7f-9ae6130859e3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:10.627292 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8171f7d3-83ed-4563-bf7f-9ae6130859e3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:10.704696 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8171f7d3-83ed-4563-bf7f-9ae6130859e3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:10.715389 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8171f7d3-83ed-4563-bf7f-9ae6130859e3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:10.716924 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8171f7d3-83ed-4563-bf7f-9ae6130859e3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:10.718333 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8cf0db6f-9df3-468d-878c-6c377196da10 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:10.729025 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8cf0db6f-9df3-468d-878c-6c377196da10 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Old instance type tempest-test_resize_flavor_-295944139, new instance type m1.heat {{(pid=140516) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 24 20:53:10.738148 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-8cf0db6f-9df3-468d-878c-6c377196da10 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:53:10.738620 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-8cf0db6f-9df3-468d-878c-6c377196da10 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:53:10.739159 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-8cf0db6f-9df3-468d-878c-6c377196da10 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:53:10.739567 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-8cf0db6f-9df3-468d-878c-6c377196da10 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:53:10.740006 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-8cf0db6f-9df3-468d-878c-6c377196da10 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:53:10.740294 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8171f7d3-83ed-4563-bf7f-9ae6130859e3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1548 microversion: 2.91 time: 0.126953 Sep 24 20:53:10.745127 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 526/1054] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:10 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1548 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:53:10.753859 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6a672005-8e8d-4297-bc5b-469acc0b531b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:10.754696 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6a672005-8e8d-4297-bc5b-469acc0b531b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 1c19c5a4-46f9-4e5e-a717-55bc8e5c3026] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:10.764879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6a672005-8e8d-4297-bc5b-469acc0b531b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:10.765630 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6a672005-8e8d-4297-bc5b-469acc0b531b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:10.766259 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6a672005-8e8d-4297-bc5b-469acc0b531b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:10.767248 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6a672005-8e8d-4297-bc5b-469acc0b531b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:10.767956 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6a672005-8e8d-4297-bc5b-469acc0b531b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:10.769314 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6a672005-8e8d-4297-bc5b-469acc0b531b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:10.849390 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:10.867597 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8cf0db6f-9df3-468d-878c-6c377196da10 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "POST /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd/action" status: 202 len: 0 microversion: 2.1 time: 0.279866 Sep 24 20:53:10.868246 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 529/1055] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:53:10 2022] POST /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:53:10.874346 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-876ca74c-9141-4aab-87bb-5db1b4eb566c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:10.874993 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-876ca74c-9141-4aab-87bb-5db1b4eb566c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:10.881210 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-876ca74c-9141-4aab-87bb-5db1b4eb566c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:10.881705 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-876ca74c-9141-4aab-87bb-5db1b4eb566c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:10.882177 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-876ca74c-9141-4aab-87bb-5db1b4eb566c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:10.882912 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-876ca74c-9141-4aab-87bb-5db1b4eb566c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:10.883384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-876ca74c-9141-4aab-87bb-5db1b4eb566c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:10.883801 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-876ca74c-9141-4aab-87bb-5db1b4eb566c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:11.015822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6a672005-8e8d-4297-bc5b-469acc0b531b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:11.025195 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6a672005-8e8d-4297-bc5b-469acc0b531b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026" status: 200 len: 1468 microversion: 2.1 time: 0.278799 Sep 24 20:53:11.025853 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 527/1056] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:10 2022] GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026 => generated 1468 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:11.031408 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cd70dc41-3b43-410e-85d2-a9467a5c86a9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:11.032275 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cd70dc41-3b43-410e-85d2-a9467a5c86a9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:11.038724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd70dc41-3b43-410e-85d2-a9467a5c86a9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:11.039457 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd70dc41-3b43-410e-85d2-a9467a5c86a9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:11.040098 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd70dc41-3b43-410e-85d2-a9467a5c86a9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:11.041037 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd70dc41-3b43-410e-85d2-a9467a5c86a9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:11.041697 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd70dc41-3b43-410e-85d2-a9467a5c86a9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:11.042324 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd70dc41-3b43-410e-85d2-a9467a5c86a9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:11.178014 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-876ca74c-9141-4aab-87bb-5db1b4eb566c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:11.186901 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-876ca74c-9141-4aab-87bb-5db1b4eb566c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1471 microversion: 2.1 time: 0.317166 Sep 24 20:53:11.195657 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 530/1057] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:10 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1471 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:11.200882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7cfda9b8-2753-474d-9d93-e7429373e9de tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:11.201512 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7cfda9b8-2753-474d-9d93-e7429373e9de tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 6a57ca61-642f-4749-a3f2-3ae1cfcbc542] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:11.215516 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7cfda9b8-2753-474d-9d93-e7429373e9de tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:11.216018 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7cfda9b8-2753-474d-9d93-e7429373e9de tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:11.216459 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7cfda9b8-2753-474d-9d93-e7429373e9de tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:11.217190 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7cfda9b8-2753-474d-9d93-e7429373e9de tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:11.217645 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7cfda9b8-2753-474d-9d93-e7429373e9de tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:11.218079 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7cfda9b8-2753-474d-9d93-e7429373e9de tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:11.272219 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cd70dc41-3b43-410e-85d2-a9467a5c86a9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:11.280702 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cd70dc41-3b43-410e-85d2-a9467a5c86a9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1536 microversion: 2.1 time: 0.253569 Sep 24 20:53:11.281763 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 528/1058] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:11 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1536 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:11.287275 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ed8ec32a-b89a-42e3-9820-5eb384bc17eb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:11.287890 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ed8ec32a-b89a-42e3-9820-5eb384bc17eb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:11.294678 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed8ec32a-b89a-42e3-9820-5eb384bc17eb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:11.295373 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed8ec32a-b89a-42e3-9820-5eb384bc17eb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:11.296050 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed8ec32a-b89a-42e3-9820-5eb384bc17eb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:11.296923 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed8ec32a-b89a-42e3-9820-5eb384bc17eb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:11.297535 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed8ec32a-b89a-42e3-9820-5eb384bc17eb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:11.298130 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed8ec32a-b89a-42e3-9820-5eb384bc17eb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:11.474017 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7cfda9b8-2753-474d-9d93-e7429373e9de tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:11.484502 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7cfda9b8-2753-474d-9d93-e7429373e9de tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/6a57ca61-642f-4749-a3f2-3ae1cfcbc542" status: 200 len: 1469 microversion: 2.1 time: 0.287514 Sep 24 20:53:11.490665 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 531/1059] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:11 2022] GET /compute/v2.1/servers/6a57ca61-642f-4749-a3f2-3ae1cfcbc542 => generated 1469 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:11.495248 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-78f8e7ca-749c-42d2-bf15-04601172a216 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:11.496040 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-78f8e7ca-749c-42d2-bf15-04601172a216 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:11.504398 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ed8ec32a-b89a-42e3-9820-5eb384bc17eb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:11.504784 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-78f8e7ca-749c-42d2-bf15-04601172a216 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:11.505288 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-78f8e7ca-749c-42d2-bf15-04601172a216 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:11.505726 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-78f8e7ca-749c-42d2-bf15-04601172a216 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:11.506434 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-78f8e7ca-749c-42d2-bf15-04601172a216 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:11.507057 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-78f8e7ca-749c-42d2-bf15-04601172a216 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:11.507465 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-78f8e7ca-749c-42d2-bf15-04601172a216 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:11.513719 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ed8ec32a-b89a-42e3-9820-5eb384bc17eb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:11.515210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ed8ec32a-b89a-42e3-9820-5eb384bc17eb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:11.516336 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ed8ec32a-b89a-42e3-9820-5eb384bc17eb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1362 microversion: 2.25 time: 0.233499 Sep 24 20:53:11.516931 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 529/1060] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:11 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:11.537354 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-aad3d0a3-d07a-46d9-bd3f-f3c9bd9398a8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:11.545277 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-aad3d0a3-d07a-46d9-bd3f-f3c9bd9398a8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:11.546166 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-aad3d0a3-d07a-46d9-bd3f-f3c9bd9398a8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Searching by: {'reservation_id': 'r-jlsjoy2p', 'deleted': False, 'project_id': '73bec7c48b07450f95a29a35e113153d'} {{(pid=140517) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 20:53:11.552140 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aad3d0a3-d07a-46d9-bd3f-f3c9bd9398a8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:11.552626 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aad3d0a3-d07a-46d9-bd3f-f3c9bd9398a8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:11.553547 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aad3d0a3-d07a-46d9-bd3f-f3c9bd9398a8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:11.554621 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aad3d0a3-d07a-46d9-bd3f-f3c9bd9398a8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:11.555094 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aad3d0a3-d07a-46d9-bd3f-f3c9bd9398a8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:11.555528 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aad3d0a3-d07a-46d9-bd3f-f3c9bd9398a8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:11.648966 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-78f8e7ca-749c-42d2-bf15-04601172a216 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:11.660372 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-78f8e7ca-749c-42d2-bf15-04601172a216 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 200 len: 1520 microversion: 2.1 time: 0.173715 Sep 24 20:53:11.661411 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 532/1061] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:11 2022] GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:11.671185 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.multi_cell_list [None req-aad3d0a3-d07a-46d9-bd3f-f3c9bd9398a8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 20:53:11.693744 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4041dc12-02d2-4e61-b85f-7d58f0929aec tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:11.694361 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4041dc12-02d2-4e61-b85f-7d58f0929aec tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:11.700983 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4041dc12-02d2-4e61-b85f-7d58f0929aec tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:11.701836 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4041dc12-02d2-4e61-b85f-7d58f0929aec tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:11.702675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4041dc12-02d2-4e61-b85f-7d58f0929aec tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:11.704488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4041dc12-02d2-4e61-b85f-7d58f0929aec tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:11.705352 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4041dc12-02d2-4e61-b85f-7d58f0929aec tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:11.706970 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4041dc12-02d2-4e61-b85f-7d58f0929aec tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:11.749490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-aad3d0a3-d07a-46d9-bd3f-f3c9bd9398a8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:11.757039 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aad3d0a3-d07a-46d9-bd3f-f3c9bd9398a8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:11.757540 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aad3d0a3-d07a-46d9-bd3f-f3c9bd9398a8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:11.757987 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aad3d0a3-d07a-46d9-bd3f-f3c9bd9398a8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:11.940338 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-aad3d0a3-d07a-46d9-bd3f-f3c9bd9398a8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/detail?reservation_id=r-jlsjoy2p" status: 200 len: 2930 microversion: 2.1 time: 0.408301 Sep 24 20:53:11.943640 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 530/1062] 10.222.0.52 () {58 vars in 1197 bytes} [Sat Sep 24 20:53:11 2022] GET /compute/v2.1/servers/detail?reservation_id=r-jlsjoy2p => generated 2930 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:11.944572 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4041dc12-02d2-4e61-b85f-7d58f0929aec tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:11.950123 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a106c595-4e3c-4b4c-b6f9-87f0e3caf901 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:11.950894 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a106c595-4e3c-4b4c-b6f9-87f0e3caf901 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:11.953258 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4041dc12-02d2-4e61-b85f-7d58f0929aec tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 200 len: 1520 microversion: 2.1 time: 0.263868 Sep 24 20:53:11.966555 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 533/1063] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:11 2022] GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 1520 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:11.967218 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a106c595-4e3c-4b4c-b6f9-87f0e3caf901 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:11.968035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a106c595-4e3c-4b4c-b6f9-87f0e3caf901 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:11.968785 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a106c595-4e3c-4b4c-b6f9-87f0e3caf901 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:11.969836 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a106c595-4e3c-4b4c-b6f9-87f0e3caf901 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:11.970461 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a106c595-4e3c-4b4c-b6f9-87f0e3caf901 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:11.971249 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a106c595-4e3c-4b4c-b6f9-87f0e3caf901 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:11.974374 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-25d2fdad-56a4-4982-96e1-ba87c333c759 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:11.990211 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.compute.server_groups [None req-25d2fdad-56a4-4982-96e1-ba87c333c759 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Querying cell 788aecb6-32dc-4b71-909a-be050455aded(cell1) for 2 instances {{(pid=140516) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 24 20:53:11.991114 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-25d2fdad-56a4-4982-96e1-ba87c333c759 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:11.991698 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-25d2fdad-56a4-4982-96e1-ba87c333c759 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:11.992234 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-25d2fdad-56a4-4982-96e1-ba87c333c759 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:12.025982 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-25d2fdad-56a4-4982-96e1-ba87c333c759 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups/92c5334a-46a2-4c38-a94e-b62060cbfecf" status: 200 len: 271 microversion: 2.1 time: 0.058973 Sep 24 20:53:12.026599 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 534/1064] 10.222.0.52 () {58 vars in 1263 bytes} [Sat Sep 24 20:53:11 2022] GET /compute/v2.1/os-server-groups/92c5334a-46a2-4c38-a94e-b62060cbfecf => generated 271 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:53:12.032175 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f9a708d8-94fe-4da9-bc93-8e7ea092287b tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-803693690"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:12.034878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f9a708d8-94fe-4da9-bc93-8e7ea092287b tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:12.038919 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a106c595-4e3c-4b4c-b6f9-87f0e3caf901 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:12.040910 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9a708d8-94fe-4da9-bc93-8e7ea092287b tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:12.041411 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9a708d8-94fe-4da9-bc93-8e7ea092287b tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:12.041854 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9a708d8-94fe-4da9-bc93-8e7ea092287b tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:12.042600 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9a708d8-94fe-4da9-bc93-8e7ea092287b tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:12.043065 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9a708d8-94fe-4da9-bc93-8e7ea092287b tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:12.043495 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9a708d8-94fe-4da9-bc93-8e7ea092287b tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:12.047680 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a106c595-4e3c-4b4c-b6f9-87f0e3caf901 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:12.049157 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a106c595-4e3c-4b4c-b6f9-87f0e3caf901 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:12.054802 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a106c595-4e3c-4b4c-b6f9-87f0e3caf901 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1488 microversion: 2.91 time: 0.109457 Sep 24 20:53:12.055377 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 531/1065] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:11 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1488 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:12.059940 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3b660549-84dc-417a-8ec5-779ba8adb2c5 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:12.060693 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3b660549-84dc-417a-8ec5-779ba8adb2c5 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] [instance: 1c19c5a4-46f9-4e5e-a717-55bc8e5c3026] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:12.067230 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3b660549-84dc-417a-8ec5-779ba8adb2c5 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:12.067731 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3b660549-84dc-417a-8ec5-779ba8adb2c5 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:12.068175 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3b660549-84dc-417a-8ec5-779ba8adb2c5 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:12.068896 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3b660549-84dc-417a-8ec5-779ba8adb2c5 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:12.069363 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3b660549-84dc-417a-8ec5-779ba8adb2c5 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:12.069870 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3b660549-84dc-417a-8ec5-779ba8adb2c5 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:12.196288 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3b660549-84dc-417a-8ec5-779ba8adb2c5 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026" status: 200 len: 1619 microversion: 2.1 time: 0.139865 Sep 24 20:53:12.196866 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 532/1066] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:12 2022] GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026 => generated 1619 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:12.215662 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3625e26c-36cf-4917-9d5b-a944379f35ba tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:12.216281 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3625e26c-36cf-4917-9d5b-a944379f35ba tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:12.222927 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3625e26c-36cf-4917-9d5b-a944379f35ba tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:12.223432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3625e26c-36cf-4917-9d5b-a944379f35ba tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:12.223874 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3625e26c-36cf-4917-9d5b-a944379f35ba tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:12.224584 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3625e26c-36cf-4917-9d5b-a944379f35ba tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:12.225049 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3625e26c-36cf-4917-9d5b-a944379f35ba tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:12.225479 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3625e26c-36cf-4917-9d5b-a944379f35ba tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:12.247970 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f9a708d8-94fe-4da9-bc93-8e7ea092287b tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "POST /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8/action" status: 202 len: 0 microversion: 2.1 time: 0.219440 Sep 24 20:53:12.248730 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 535/1067] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:53:12 2022] POST /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 24 20:53:12.253871 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9cc4f3d5-9321-46a7-90d0-dc649e67090b tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:12.254667 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9cc4f3d5-9321-46a7-90d0-dc649e67090b tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] [instance: 6a57ca61-642f-4749-a3f2-3ae1cfcbc542] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:12.261830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9cc4f3d5-9321-46a7-90d0-dc649e67090b tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:12.262445 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9cc4f3d5-9321-46a7-90d0-dc649e67090b tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:12.262924 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9cc4f3d5-9321-46a7-90d0-dc649e67090b tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:12.263671 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9cc4f3d5-9321-46a7-90d0-dc649e67090b tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:12.264131 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9cc4f3d5-9321-46a7-90d0-dc649e67090b tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:12.264583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9cc4f3d5-9321-46a7-90d0-dc649e67090b tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:12.434800 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3625e26c-36cf-4917-9d5b-a944379f35ba tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:12.444018 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3625e26c-36cf-4917-9d5b-a944379f35ba tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1471 microversion: 2.1 time: 0.232157 Sep 24 20:53:12.444605 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 533/1068] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:12 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1471 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:12.447115 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9cc4f3d5-9321-46a7-90d0-dc649e67090b tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/6a57ca61-642f-4749-a3f2-3ae1cfcbc542" status: 200 len: 1620 microversion: 2.1 time: 0.197117 Sep 24 20:53:12.448207 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 536/1069] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:12 2022] GET /compute/v2.1/servers/6a57ca61-642f-4749-a3f2-3ae1cfcbc542 => generated 1620 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:12.449185 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a9e2b225-dac8-451c-945c-dd19c528a01a tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '.version_select at 0x7f4b0c6e9670>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:12.454338 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-db57bd19-3dac-40af-917d-b9e37754ed95 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:12.455727 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-db57bd19-3dac-40af-917d-b9e37754ed95 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:12.462236 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-db57bd19-3dac-40af-917d-b9e37754ed95 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:12.462782 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-db57bd19-3dac-40af-917d-b9e37754ed95 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:12.468519 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-db57bd19-3dac-40af-917d-b9e37754ed95 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:12.468519 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-db57bd19-3dac-40af-917d-b9e37754ed95 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:12.468519 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-db57bd19-3dac-40af-917d-b9e37754ed95 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:12.468519 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-db57bd19-3dac-40af-917d-b9e37754ed95 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:12.502332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:12.591835 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a9e2b225-dac8-451c-945c-dd19c528a01a tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "DELETE /compute/v2.1/images/3f427b1d-f285-4ad9-9c06-2ab2ff38c2c6" status: 204 len: 0 microversion: 2.1 time: 0.146024 Sep 24 20:53:12.592657 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 534/1070] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:12 2022] DELETE /compute/v2.1/images/3f427b1d-f285-4ad9-9c06-2ab2ff38c2c6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:53:12.599703 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0e06a414-d553-4540-bea0-86cb7247187e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-792667439", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "a74d1c4c-d757-4879-a35d-9f817ea6e28b"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:12.634469 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-db57bd19-3dac-40af-917d-b9e37754ed95 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:12.642802 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-db57bd19-3dac-40af-917d-b9e37754ed95 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1536 microversion: 2.1 time: 0.193326 Sep 24 20:53:12.643386 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 537/1071] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:12 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1536 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:12.655423 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-471a0df6-771d-4b31-b758-30a0f810485f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:12.656046 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-471a0df6-771d-4b31-b758-30a0f810485f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:12.661736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-0e06a414-d553-4540-bea0-86cb7247187e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] validate_networks() for None {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:53:12.663196 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-471a0df6-771d-4b31-b758-30a0f810485f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:12.663691 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-471a0df6-771d-4b31-b758-30a0f810485f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:12.664160 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-471a0df6-771d-4b31-b758-30a0f810485f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:12.664866 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-471a0df6-771d-4b31-b758-30a0f810485f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:12.665328 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-471a0df6-771d-4b31-b758-30a0f810485f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:12.665759 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-471a0df6-771d-4b31-b758-30a0f810485f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:12.887312 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-471a0df6-771d-4b31-b758-30a0f810485f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:12.897039 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-471a0df6-771d-4b31-b758-30a0f810485f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:12.898482 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-471a0df6-771d-4b31-b758-30a0f810485f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:12.899633 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-471a0df6-771d-4b31-b758-30a0f810485f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1362 microversion: 2.25 time: 0.252012 Sep 24 20:53:12.900199 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 538/1072] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:12 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1362 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:12.904943 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7b896d8f-7631-4aab-beb8-4dcfba959267 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '.version_select at 0x7f4b0c431310>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:12.926748 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-7b896d8f-7631-4aab-beb8-4dcfba959267 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] HTTP exception thrown: Image not found. Sep 24 20:53:12.939105 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7b896d8f-7631-4aab-beb8-4dcfba959267 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Request method failure captured: Sep 24 20:53:12.939105 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/images/3f427b1d-f285-4ad9-9c06-2ab2ff38c2c6 HTTP/1.1 Sep 24 20:53:12.939105 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:53:12.939105 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:53:12.939105 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:53:12.939105 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:53:12.939105 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:53:12.939105 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:53:12.939105 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:53:12.939105 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:53:12.939105 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL23hSaMAKT8B-JdjtYs2UoED1UAMalIeRO9Th3athHCHzrGhfs9Sy0_hBzkoXpxV7aas8iy4VFycxPqE3-ST396dY35DaR9MZAQlds-eQBPgVm84hG8pTTOjeXtJegh8tOCUNbJFm6JLpFNRAi1C2IykufgxtCoO69ROBtQmrT9YEmI Sep 24 20:53:12.939105 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:53:12.939105 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:53:12.939105 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:53:12.939105 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:53:12.939105 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:53:12.939105 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:53:12.939105 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: e175cb4032ec4e6aa900141abbaa04c4 Sep 24 20:53:12.939105 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:53:12.939105 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:53:12.939105 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:53:12.941501 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:53:12.941501 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:53:12.941501 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: e175cb4032ec4e6aa900141abbaa04c4 Sep 24 20:53:12.941501 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:53:12.941501 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ImagesOneServerNegativeTestJSON-1825846347-project Sep 24 20:53:12.941501 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:53:12.941501 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:53:12.941501 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 6db52cb259fa426d860f9c9a48a149f3 Sep 24 20:53:12.941501 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347-project Sep 24 20:53:12.941501 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:53:12.941501 ncdv-master-1 devstack@n-api.service[140516]: exception: Image not found. Sep 24 20:53:12.941501 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '3f427b1d-f285-4ad9-9c06-2ab2ff38c2c6'} Sep 24 20:53:12.941501 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:53:12.942361 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:12.942361 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 24 20:53:12.942361 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 24 20:53:12.942361 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 24 20:53:12.942361 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 24 20:53:12.942361 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 24 20:53:12.942361 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 24 20:53:12.942361 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 24 20:53:12.942361 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 24 20:53:12.942361 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 24 20:53:12.942361 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 24 20:53:12.942361 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 24 20:53:12.942361 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 24 20:53:12.942361 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 24 20:53:12.942361 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 24 20:53:12.942361 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 24 20:53:12.942361 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 24 20:53:12.942361 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3f427b1d-f285-4ad9-9c06-2ab2ff38c2c6 Sep 24 20:53:12.943445 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:12.943445 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:53:12.943445 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:12.943445 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:12.943445 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 24 20:53:12.943445 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 24 20:53:12.943445 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 24 20:53:12.943445 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 24 20:53:12.943445 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 24 20:53:12.943445 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 24 20:53:12.943445 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 24 20:53:12.943445 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 24 20:53:12.943445 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 24 20:53:12.943445 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 24 20:53:12.943445 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 24 20:53:12.943445 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 24 20:53:12.943445 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 24 20:53:12.943445 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 24 20:53:12.943445 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 24 20:53:12.943445 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 24 20:53:12.944846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 24 20:53:12.944846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 24 20:53:12.944846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 24 20:53:12.944846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 24 20:53:12.944846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 24 20:53:12.944846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 24 20:53:12.944846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 24 20:53:12.944846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 24 20:53:12.944846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3f427b1d-f285-4ad9-9c06-2ab2ff38c2c6 could not be found. Sep 24 20:53:12.944846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:12.944846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:53:12.944846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:12.944846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:12.944846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:53:12.944846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:53:12.944846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:53:12.944846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:53:12.944846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:53:12.944846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:53:12.946605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:53:12.946605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:53:12.946605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 24 20:53:12.946605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 24 20:53:12.946605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 24 20:53:12.946605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:12.946605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:53:12.946605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:12.946605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:12.946605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:53:12.946605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:53:12.946605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:53:12.946605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:53:12.946605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 24 20:53:12.946605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:12.946605 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7b896d8f-7631-4aab-beb8-4dcfba959267 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Returning 404 to user: Image not found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:53:12.947743 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7b896d8f-7631-4aab-beb8-4dcfba959267 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/images/3f427b1d-f285-4ad9-9c06-2ab2ff38c2c6" status: 404 len: 62 microversion: 2.1 time: 0.039453 Sep 24 20:53:12.947743 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 539/1073] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:53:12 2022] GET /compute/v2.1/images/3f427b1d-f285-4ad9-9c06-2ab2ff38c2c6 => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 20:53:12.949763 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-76815bf3-7a28-48d0-8b0a-2b7546f94135 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:12.950381 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-76815bf3-7a28-48d0-8b0a-2b7546f94135 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:12.950513 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-0e06a414-d553-4540-bea0-86cb7247187e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:53:12.950864 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-0e06a414-d553-4540-bea0-86cb7247187e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:53:12.951363 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-0e06a414-d553-4540-bea0-86cb7247187e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:53:12.951783 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-0e06a414-d553-4540-bea0-86cb7247187e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:53:12.952210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-0e06a414-d553-4540-bea0-86cb7247187e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:53:12.962315 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e06a414-d553-4540-bea0-86cb7247187e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:12.962857 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e06a414-d553-4540-bea0-86cb7247187e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:12.963303 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e06a414-d553-4540-bea0-86cb7247187e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:12.964062 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e06a414-d553-4540-bea0-86cb7247187e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:12.964533 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e06a414-d553-4540-bea0-86cb7247187e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:12.964971 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e06a414-d553-4540-bea0-86cb7247187e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:12.986323 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-0e06a414-d553-4540-bea0-86cb7247187e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Getting quotas for project 73bec7c48b07450f95a29a35e113153d. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:53:12.989730 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:12.994152 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-0e06a414-d553-4540-bea0-86cb7247187e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Getting quotas for user 936372eff4da45e281fc5512632a12b6 and project 73bec7c48b07450f95a29a35e113153d. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:53:13.011549 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0e06a414-d553-4540-bea0-86cb7247187e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:53:13.013957 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0e06a414-d553-4540-bea0-86cb7247187e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 7505ad12-d1c7-4dad-b0b8-e797560e5274] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:53:13.063527 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0e06a414-d553-4540-bea0-86cb7247187e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.469785 Sep 24 20:53:13.064366 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 535/1074] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:53:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 471 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:53:13.075889 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6fb3d4c1-fc8c-4054-aed4-410de48cb237 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:13.076529 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6fb3d4c1-fc8c-4054-aed4-410de48cb237 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 7505ad12-d1c7-4dad-b0b8-e797560e5274] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:13.136822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6fb3d4c1-fc8c-4054-aed4-410de48cb237 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:13.145497 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6fb3d4c1-fc8c-4054-aed4-410de48cb237 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274" status: 200 len: 1216 microversion: 2.1 time: 0.073219 Sep 24 20:53:13.146246 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 536/1075] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:13 2022] GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274 => generated 1216 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:13.151835 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fc25eb17-9493-483b-b961-1b906bdecae6 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:13.153242 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fc25eb17-9493-483b-b961-1b906bdecae6 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:13.160309 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76815bf3-7a28-48d0-8b0a-2b7546f94135 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:13.160941 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76815bf3-7a28-48d0-8b0a-2b7546f94135 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:13.161236 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76815bf3-7a28-48d0-8b0a-2b7546f94135 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:13.161361 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc25eb17-9493-483b-b961-1b906bdecae6 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:13.161867 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc25eb17-9493-483b-b961-1b906bdecae6 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:13.161985 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76815bf3-7a28-48d0-8b0a-2b7546f94135 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:13.162386 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc25eb17-9493-483b-b961-1b906bdecae6 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:13.162478 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76815bf3-7a28-48d0-8b0a-2b7546f94135 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:13.162845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76815bf3-7a28-48d0-8b0a-2b7546f94135 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:13.163281 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc25eb17-9493-483b-b961-1b906bdecae6 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:13.163778 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc25eb17-9493-483b-b961-1b906bdecae6 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:13.164249 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc25eb17-9493-483b-b961-1b906bdecae6 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:13.260179 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fc25eb17-9493-483b-b961-1b906bdecae6 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:13.268673 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fc25eb17-9493-483b-b961-1b906bdecae6 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:13.270989 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fc25eb17-9493-483b-b961-1b906bdecae6 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:13.276380 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fc25eb17-9493-483b-b961-1b906bdecae6 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1488 microversion: 2.91 time: 0.128741 Sep 24 20:53:13.276933 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 537/1076] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:13 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1488 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:13.331940 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-76815bf3-7a28-48d0-8b0a-2b7546f94135 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:13.340413 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-76815bf3-7a28-48d0-8b0a-2b7546f94135 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 200 len: 1532 microversion: 2.1 time: 0.394146 Sep 24 20:53:13.340993 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 540/1077] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:12 2022] GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 1532 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:13.468680 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-baa4f8ee-d28b-4f82-9916-c096f05ce70c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:13.469391 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-baa4f8ee-d28b-4f82-9916-c096f05ce70c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:13.475999 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-baa4f8ee-d28b-4f82-9916-c096f05ce70c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:13.476696 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-baa4f8ee-d28b-4f82-9916-c096f05ce70c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:13.477376 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-baa4f8ee-d28b-4f82-9916-c096f05ce70c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:13.478219 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-baa4f8ee-d28b-4f82-9916-c096f05ce70c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:13.478770 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-baa4f8ee-d28b-4f82-9916-c096f05ce70c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:13.479304 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-baa4f8ee-d28b-4f82-9916-c096f05ce70c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:13.625796 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-baa4f8ee-d28b-4f82-9916-c096f05ce70c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:13.630676 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:13.639106 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-baa4f8ee-d28b-4f82-9916-c096f05ce70c tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1471 microversion: 2.1 time: 0.174766 Sep 24 20:53:13.640007 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 538/1078] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:13 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1471 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:13.668171 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-17460be0-f08f-4647-8345-36f70160fbd9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:13.669158 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-17460be0-f08f-4647-8345-36f70160fbd9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:13.677032 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17460be0-f08f-4647-8345-36f70160fbd9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:13.677614 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17460be0-f08f-4647-8345-36f70160fbd9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:13.678123 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17460be0-f08f-4647-8345-36f70160fbd9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:13.678948 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17460be0-f08f-4647-8345-36f70160fbd9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:13.679636 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17460be0-f08f-4647-8345-36f70160fbd9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:13.680388 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17460be0-f08f-4647-8345-36f70160fbd9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:13.820431 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-17460be0-f08f-4647-8345-36f70160fbd9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:13.828385 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-17460be0-f08f-4647-8345-36f70160fbd9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1536 microversion: 2.1 time: 0.165142 Sep 24 20:53:13.828966 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 541/1079] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:13 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1536 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:13.925484 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-21e821a2-bdf8-400a-8f1c-ee19cbc21628 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:13.926387 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-21e821a2-bdf8-400a-8f1c-ee19cbc21628 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:13.934910 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-21e821a2-bdf8-400a-8f1c-ee19cbc21628 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:13.935624 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-21e821a2-bdf8-400a-8f1c-ee19cbc21628 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:13.936255 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-21e821a2-bdf8-400a-8f1c-ee19cbc21628 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:13.936976 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-21e821a2-bdf8-400a-8f1c-ee19cbc21628 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:13.937440 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-21e821a2-bdf8-400a-8f1c-ee19cbc21628 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:13.938159 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-21e821a2-bdf8-400a-8f1c-ee19cbc21628 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:14.087236 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-21e821a2-bdf8-400a-8f1c-ee19cbc21628 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:14.096789 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-21e821a2-bdf8-400a-8f1c-ee19cbc21628 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:14.098917 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-21e821a2-bdf8-400a-8f1c-ee19cbc21628 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:14.102206 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-21e821a2-bdf8-400a-8f1c-ee19cbc21628 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1362 microversion: 2.25 time: 0.179013 Sep 24 20:53:14.105985 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 539/1080] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:13 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:53:14.168295 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-13debb60-0736-4b02-87f1-093b856e5fbc tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:14.169020 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-13debb60-0736-4b02-87f1-093b856e5fbc tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 7505ad12-d1c7-4dad-b0b8-e797560e5274] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:14.178228 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-13debb60-0736-4b02-87f1-093b856e5fbc tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:14.179042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-13debb60-0736-4b02-87f1-093b856e5fbc tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:14.179483 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-13debb60-0736-4b02-87f1-093b856e5fbc tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:14.180353 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-13debb60-0736-4b02-87f1-093b856e5fbc tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:14.180987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-13debb60-0736-4b02-87f1-093b856e5fbc tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:14.181412 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-13debb60-0736-4b02-87f1-093b856e5fbc tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:14.247756 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-13debb60-0736-4b02-87f1-093b856e5fbc tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:14.256802 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-13debb60-0736-4b02-87f1-093b856e5fbc tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274" status: 200 len: 1268 microversion: 2.1 time: 0.092642 Sep 24 20:53:14.257377 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 542/1081] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:14 2022] GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274 => generated 1268 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:14.305490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e92427a7-9a3d-4dc4-8d72-8ed469e6b5cd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:14.306140 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e92427a7-9a3d-4dc4-8d72-8ed469e6b5cd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:14.312334 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e92427a7-9a3d-4dc4-8d72-8ed469e6b5cd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:14.312829 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e92427a7-9a3d-4dc4-8d72-8ed469e6b5cd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:14.313272 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e92427a7-9a3d-4dc4-8d72-8ed469e6b5cd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:14.313978 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e92427a7-9a3d-4dc4-8d72-8ed469e6b5cd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:14.314442 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e92427a7-9a3d-4dc4-8d72-8ed469e6b5cd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:14.314905 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e92427a7-9a3d-4dc4-8d72-8ed469e6b5cd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:14.364062 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-84585d8f-2d33-44e3-8291-afaa0c6ce84b tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:14.364793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-84585d8f-2d33-44e3-8291-afaa0c6ce84b tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:14.371080 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-84585d8f-2d33-44e3-8291-afaa0c6ce84b tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:14.371571 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-84585d8f-2d33-44e3-8291-afaa0c6ce84b tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:14.372013 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-84585d8f-2d33-44e3-8291-afaa0c6ce84b tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:14.372776 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-84585d8f-2d33-44e3-8291-afaa0c6ce84b tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:14.373244 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-84585d8f-2d33-44e3-8291-afaa0c6ce84b tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:14.373675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-84585d8f-2d33-44e3-8291-afaa0c6ce84b tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:14.380728 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e92427a7-9a3d-4dc4-8d72-8ed469e6b5cd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:14.389238 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e92427a7-9a3d-4dc4-8d72-8ed469e6b5cd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:14.390736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e92427a7-9a3d-4dc4-8d72-8ed469e6b5cd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:14.396683 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e92427a7-9a3d-4dc4-8d72-8ed469e6b5cd tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1490 microversion: 2.91 time: 0.095061 Sep 24 20:53:14.397270 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 540/1082] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:14 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1490 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:14.509967 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-84585d8f-2d33-44e3-8291-afaa0c6ce84b tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:14.517993 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-84585d8f-2d33-44e3-8291-afaa0c6ce84b tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 200 len: 1538 microversion: 2.1 time: 0.158497 Sep 24 20:53:14.519035 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 543/1083] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:14 2022] GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 1538 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:14.663892 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-aedd3591-e80e-431d-aac0-dadffd7c638a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:14.664486 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-aedd3591-e80e-431d-aac0-dadffd7c638a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:14.671833 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aedd3591-e80e-431d-aac0-dadffd7c638a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:14.672587 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aedd3591-e80e-431d-aac0-dadffd7c638a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:14.673279 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aedd3591-e80e-431d-aac0-dadffd7c638a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:14.674030 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aedd3591-e80e-431d-aac0-dadffd7c638a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:14.674610 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aedd3591-e80e-431d-aac0-dadffd7c638a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:14.675371 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aedd3591-e80e-431d-aac0-dadffd7c638a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:14.854204 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-229d8896-a098-4dfa-acbe-b81725de0f4f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:14.855253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-229d8896-a098-4dfa-acbe-b81725de0f4f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:14.866154 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-229d8896-a098-4dfa-acbe-b81725de0f4f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:14.870087 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-229d8896-a098-4dfa-acbe-b81725de0f4f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:14.871853 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-229d8896-a098-4dfa-acbe-b81725de0f4f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:14.873032 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-229d8896-a098-4dfa-acbe-b81725de0f4f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:14.874608 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-229d8896-a098-4dfa-acbe-b81725de0f4f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:14.876362 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-229d8896-a098-4dfa-acbe-b81725de0f4f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:14.902560 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-aedd3591-e80e-431d-aac0-dadffd7c638a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:14.922001 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-aedd3591-e80e-431d-aac0-dadffd7c638a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1471 microversion: 2.1 time: 0.260931 Sep 24 20:53:14.924312 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 541/1084] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:14 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1471 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:15.118733 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-229d8896-a098-4dfa-acbe-b81725de0f4f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:15.126930 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-229d8896-a098-4dfa-acbe-b81725de0f4f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1536 microversion: 2.1 time: 0.277220 Sep 24 20:53:15.127594 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 544/1085] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:14 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1536 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:15.127789 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-eb0d77a7-1b5e-482a-9807-86bef4fce536 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:15.128735 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-eb0d77a7-1b5e-482a-9807-86bef4fce536 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:15.135354 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb0d77a7-1b5e-482a-9807-86bef4fce536 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:15.135853 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb0d77a7-1b5e-482a-9807-86bef4fce536 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:15.136298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb0d77a7-1b5e-482a-9807-86bef4fce536 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:15.137013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb0d77a7-1b5e-482a-9807-86bef4fce536 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:15.137476 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb0d77a7-1b5e-482a-9807-86bef4fce536 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:15.137912 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb0d77a7-1b5e-482a-9807-86bef4fce536 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:15.273454 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-eb0d77a7-1b5e-482a-9807-86bef4fce536 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:15.280299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7538b605-0827-48ec-9d5e-5620ba644f7a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:15.281157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7538b605-0827-48ec-9d5e-5620ba644f7a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 7505ad12-d1c7-4dad-b0b8-e797560e5274] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:15.283246 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-eb0d77a7-1b5e-482a-9807-86bef4fce536 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:15.285801 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-eb0d77a7-1b5e-482a-9807-86bef4fce536 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:15.287777 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-eb0d77a7-1b5e-482a-9807-86bef4fce536 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1362 microversion: 2.25 time: 0.163978 Sep 24 20:53:15.303529 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 542/1086] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:15 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:53:15.324333 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7538b605-0827-48ec-9d5e-5620ba644f7a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:15.324843 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7538b605-0827-48ec-9d5e-5620ba644f7a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:15.325288 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7538b605-0827-48ec-9d5e-5620ba644f7a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:15.326018 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7538b605-0827-48ec-9d5e-5620ba644f7a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:15.326486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7538b605-0827-48ec-9d5e-5620ba644f7a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:15.326968 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7538b605-0827-48ec-9d5e-5620ba644f7a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:15.426707 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b19f9d66-1245-418d-80d8-9b2687a22761 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:15.427346 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b19f9d66-1245-418d-80d8-9b2687a22761 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:15.438312 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b19f9d66-1245-418d-80d8-9b2687a22761 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:15.439521 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b19f9d66-1245-418d-80d8-9b2687a22761 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:15.441061 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b19f9d66-1245-418d-80d8-9b2687a22761 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:15.442354 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b19f9d66-1245-418d-80d8-9b2687a22761 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:15.442878 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b19f9d66-1245-418d-80d8-9b2687a22761 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:15.443717 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b19f9d66-1245-418d-80d8-9b2687a22761 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:15.457267 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7538b605-0827-48ec-9d5e-5620ba644f7a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:15.469366 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7538b605-0827-48ec-9d5e-5620ba644f7a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274" status: 200 len: 1274 microversion: 2.1 time: 0.192982 Sep 24 20:53:15.469881 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 545/1087] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:15 2022] GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274 => generated 1274 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:15.541427 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-662340a1-9e85-43b4-bc20-69e5a6d29f9e tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:15.542306 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-662340a1-9e85-43b4-bc20-69e5a6d29f9e tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:15.548891 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-662340a1-9e85-43b4-bc20-69e5a6d29f9e tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:15.549777 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-662340a1-9e85-43b4-bc20-69e5a6d29f9e tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:15.550483 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-662340a1-9e85-43b4-bc20-69e5a6d29f9e tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:15.551474 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-662340a1-9e85-43b4-bc20-69e5a6d29f9e tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:15.552565 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-662340a1-9e85-43b4-bc20-69e5a6d29f9e tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:15.553505 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-662340a1-9e85-43b4-bc20-69e5a6d29f9e tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:15.559253 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b19f9d66-1245-418d-80d8-9b2687a22761 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:15.571942 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b19f9d66-1245-418d-80d8-9b2687a22761 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:15.574518 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b19f9d66-1245-418d-80d8-9b2687a22761 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:15.587871 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:15.590913 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b19f9d66-1245-418d-80d8-9b2687a22761 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1546 microversion: 2.91 time: 0.169542 Sep 24 20:53:15.594289 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 543/1088] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:15 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1546 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:53:15.803421 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-662340a1-9e85-43b4-bc20-69e5a6d29f9e tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:15.811966 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-662340a1-9e85-43b4-bc20-69e5a6d29f9e tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 200 len: 1538 microversion: 2.1 time: 0.274480 Sep 24 20:53:15.814538 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 546/1089] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:15 2022] GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 1538 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:15.945946 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-79fc48d0-3781-478d-98d5-d6c541c9bf70 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:15.946673 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-79fc48d0-3781-478d-98d5-d6c541c9bf70 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:15.954125 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79fc48d0-3781-478d-98d5-d6c541c9bf70 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:15.954664 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79fc48d0-3781-478d-98d5-d6c541c9bf70 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:15.955308 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79fc48d0-3781-478d-98d5-d6c541c9bf70 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:15.956081 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79fc48d0-3781-478d-98d5-d6c541c9bf70 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:15.956550 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79fc48d0-3781-478d-98d5-d6c541c9bf70 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:15.956988 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79fc48d0-3781-478d-98d5-d6c541c9bf70 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:16.113365 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-79fc48d0-3781-478d-98d5-d6c541c9bf70 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:16.125827 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-79fc48d0-3781-478d-98d5-d6c541c9bf70 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1471 microversion: 2.1 time: 0.183827 Sep 24 20:53:16.126425 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 544/1090] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:15 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1471 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:16.150259 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-88320c05-a811-4947-a01a-bbd71fe32393 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:16.150970 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-88320c05-a811-4947-a01a-bbd71fe32393 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:16.164339 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-88320c05-a811-4947-a01a-bbd71fe32393 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:16.165285 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-88320c05-a811-4947-a01a-bbd71fe32393 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:16.165912 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-88320c05-a811-4947-a01a-bbd71fe32393 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:16.169028 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-88320c05-a811-4947-a01a-bbd71fe32393 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:16.170804 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-88320c05-a811-4947-a01a-bbd71fe32393 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:16.171433 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-88320c05-a811-4947-a01a-bbd71fe32393 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:16.326933 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c9fdffc6-ecd3-4ccc-9d46-db2a2a8afc49 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:16.328080 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c9fdffc6-ecd3-4ccc-9d46-db2a2a8afc49 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:16.339796 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c9fdffc6-ecd3-4ccc-9d46-db2a2a8afc49 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:16.340582 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c9fdffc6-ecd3-4ccc-9d46-db2a2a8afc49 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:16.341237 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c9fdffc6-ecd3-4ccc-9d46-db2a2a8afc49 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:16.342606 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c9fdffc6-ecd3-4ccc-9d46-db2a2a8afc49 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:16.343283 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c9fdffc6-ecd3-4ccc-9d46-db2a2a8afc49 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:16.344554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c9fdffc6-ecd3-4ccc-9d46-db2a2a8afc49 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:16.405157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-88320c05-a811-4947-a01a-bbd71fe32393 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:16.417954 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-88320c05-a811-4947-a01a-bbd71fe32393 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1541 microversion: 2.1 time: 0.271300 Sep 24 20:53:16.422543 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 547/1091] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:16 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1541 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:16.495993 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-75fe2729-be9f-4287-8d3a-562469b3cd78 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:16.497619 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-75fe2729-be9f-4287-8d3a-562469b3cd78 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 7505ad12-d1c7-4dad-b0b8-e797560e5274] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:16.510339 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-75fe2729-be9f-4287-8d3a-562469b3cd78 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:16.514927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-75fe2729-be9f-4287-8d3a-562469b3cd78 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:16.515688 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-75fe2729-be9f-4287-8d3a-562469b3cd78 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:16.520472 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-75fe2729-be9f-4287-8d3a-562469b3cd78 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:16.521340 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-75fe2729-be9f-4287-8d3a-562469b3cd78 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:16.522134 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-75fe2729-be9f-4287-8d3a-562469b3cd78 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:16.732160 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c9fdffc6-ecd3-4ccc-9d46-db2a2a8afc49 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:16.743585 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c9fdffc6-ecd3-4ccc-9d46-db2a2a8afc49 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:16.745141 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c9fdffc6-ecd3-4ccc-9d46-db2a2a8afc49 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:16.746639 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c9fdffc6-ecd3-4ccc-9d46-db2a2a8afc49 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1362 microversion: 2.25 time: 0.435092 Sep 24 20:53:16.751899 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 545/1092] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:16 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1362 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:16.758465 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-599c50a3-2aea-4ff7-b7f0-d64fd1664fac tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:16.760260 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-599c50a3-2aea-4ff7-b7f0-d64fd1664fac tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:16.776037 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-599c50a3-2aea-4ff7-b7f0-d64fd1664fac tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:16.776599 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-599c50a3-2aea-4ff7-b7f0-d64fd1664fac tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:16.776953 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-599c50a3-2aea-4ff7-b7f0-d64fd1664fac tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:16.777685 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-599c50a3-2aea-4ff7-b7f0-d64fd1664fac tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:16.778154 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-599c50a3-2aea-4ff7-b7f0-d64fd1664fac tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:16.780242 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-599c50a3-2aea-4ff7-b7f0-d64fd1664fac tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:16.837333 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-75fe2729-be9f-4287-8d3a-562469b3cd78 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:16.854018 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-75fe2729-be9f-4287-8d3a-562469b3cd78 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274" status: 200 len: 1316 microversion: 2.1 time: 0.360917 Sep 24 20:53:16.856398 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 548/1093] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:16 2022] GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274 => generated 1316 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:16.870053 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bd6db3ae-39b8-4a51-8c05-9be5f3f9ad50 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:16.871573 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-bd6db3ae-39b8-4a51-8c05-9be5f3f9ad50 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:16.885178 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-599c50a3-2aea-4ff7-b7f0-d64fd1664fac tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:16.886697 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bd6db3ae-39b8-4a51-8c05-9be5f3f9ad50 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:16.889648 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bd6db3ae-39b8-4a51-8c05-9be5f3f9ad50 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:16.890261 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bd6db3ae-39b8-4a51-8c05-9be5f3f9ad50 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:16.892060 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bd6db3ae-39b8-4a51-8c05-9be5f3f9ad50 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:16.894098 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bd6db3ae-39b8-4a51-8c05-9be5f3f9ad50 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:16.896046 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bd6db3ae-39b8-4a51-8c05-9be5f3f9ad50 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:16.896768 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-599c50a3-2aea-4ff7-b7f0-d64fd1664fac tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:16.898538 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-599c50a3-2aea-4ff7-b7f0-d64fd1664fac tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:16.913750 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-599c50a3-2aea-4ff7-b7f0-d64fd1664fac tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1546 microversion: 2.91 time: 0.160655 Sep 24 20:53:16.915066 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 546/1094] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:16 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1546 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:17.133346 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-bd6db3ae-39b8-4a51-8c05-9be5f3f9ad50 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:17.142413 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bd6db3ae-39b8-4a51-8c05-9be5f3f9ad50 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 200 len: 1520 microversion: 2.1 time: 0.284244 Sep 24 20:53:17.168036 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cefbd1ff-5175-4736-8413-e8c598b46773 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:17.169230 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cefbd1ff-5175-4736-8413-e8c598b46773 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:17.177371 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cefbd1ff-5175-4736-8413-e8c598b46773 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:17.177904 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 549/1095] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:16 2022] GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 1520 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:17.182999 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7db44365-941e-4118-8bf2-560770510e2d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:17.188494 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cefbd1ff-5175-4736-8413-e8c598b46773 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:17.189149 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cefbd1ff-5175-4736-8413-e8c598b46773 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:17.191465 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7db44365-941e-4118-8bf2-560770510e2d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:17.192474 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cefbd1ff-5175-4736-8413-e8c598b46773 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:17.194988 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cefbd1ff-5175-4736-8413-e8c598b46773 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:17.195631 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cefbd1ff-5175-4736-8413-e8c598b46773 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:17.205174 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7db44365-941e-4118-8bf2-560770510e2d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:17.211186 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7db44365-941e-4118-8bf2-560770510e2d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:17.211931 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7db44365-941e-4118-8bf2-560770510e2d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:17.212942 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7db44365-941e-4118-8bf2-560770510e2d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:17.213605 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7db44365-941e-4118-8bf2-560770510e2d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:17.214205 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7db44365-941e-4118-8bf2-560770510e2d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:17.266134 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7db44365-941e-4118-8bf2-560770510e2d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:53:17.460101 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7db44365-941e-4118-8bf2-560770510e2d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "DELETE /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 204 len: 0 microversion: 2.1 time: 0.276584 Sep 24 20:53:17.466684 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 550/1096] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:53:17 2022] DELETE /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:53:17.489948 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-39a6b918-80ce-401a-bc80-ff1744ad2453 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:17.493142 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-39a6b918-80ce-401a-bc80-ff1744ad2453 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:17.515459 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-39a6b918-80ce-401a-bc80-ff1744ad2453 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:17.517178 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-39a6b918-80ce-401a-bc80-ff1744ad2453 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:17.518712 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-39a6b918-80ce-401a-bc80-ff1744ad2453 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:17.521198 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-39a6b918-80ce-401a-bc80-ff1744ad2453 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:17.522701 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-39a6b918-80ce-401a-bc80-ff1744ad2453 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:17.526563 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-39a6b918-80ce-401a-bc80-ff1744ad2453 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:17.554461 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cefbd1ff-5175-4736-8413-e8c598b46773 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:17.565706 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cefbd1ff-5175-4736-8413-e8c598b46773 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1471 microversion: 2.1 time: 0.400838 Sep 24 20:53:17.570266 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 547/1097] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:17 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1471 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:17.579647 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-499c3af6-18cf-457d-8624-2e99a56ee767 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:17.580615 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-499c3af6-18cf-457d-8624-2e99a56ee767 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:17.597521 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-499c3af6-18cf-457d-8624-2e99a56ee767 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:17.598711 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-499c3af6-18cf-457d-8624-2e99a56ee767 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:17.599949 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-499c3af6-18cf-457d-8624-2e99a56ee767 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:17.600955 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-499c3af6-18cf-457d-8624-2e99a56ee767 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:17.603522 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-499c3af6-18cf-457d-8624-2e99a56ee767 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:17.604247 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-499c3af6-18cf-457d-8624-2e99a56ee767 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:17.831097 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-39a6b918-80ce-401a-bc80-ff1744ad2453 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:17.840409 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-39a6b918-80ce-401a-bc80-ff1744ad2453 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1541 microversion: 2.1 time: 0.370782 Sep 24 20:53:17.844055 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 551/1098] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:17 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1541 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:17.855684 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-2c93f538-520a-4d27-8900-9654ecb215f5 req-5f6502db-98fc-4f5a-9674-42154a94bd43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7505ad12-d1c7-4dad-b0b8-e797560e5274", "tag": "a03de1a2-dcb4-4c5f-9261-079c2c97a272"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:17.878125 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-2c93f538-520a-4d27-8900-9654ecb215f5 req-5f6502db-98fc-4f5a-9674-42154a94bd43 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:17.878822 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-2c93f538-520a-4d27-8900-9654ecb215f5 req-5f6502db-98fc-4f5a-9674-42154a94bd43 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:17.880144 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-2c93f538-520a-4d27-8900-9654ecb215f5 req-5f6502db-98fc-4f5a-9674-42154a94bd43 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:17.889470 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-499c3af6-18cf-457d-8624-2e99a56ee767 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:17.892235 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-2c93f538-520a-4d27-8900-9654ecb215f5 req-5f6502db-98fc-4f5a-9674-42154a94bd43 service nova] Creating event network-changed:a03de1a2-dcb4-4c5f-9261-079c2c97a272 for instance 7505ad12-d1c7-4dad-b0b8-e797560e5274 on nch2-master-1 Sep 24 20:53:17.899531 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-2c93f538-520a-4d27-8900-9654ecb215f5 req-5f6502db-98fc-4f5a-9674-42154a94bd43 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052796 Sep 24 20:53:17.900203 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 552/1099] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:53:17.900640 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-499c3af6-18cf-457d-8624-2e99a56ee767 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 200 len: 1526 microversion: 2.1 time: 0.328802 Sep 24 20:53:17.901212 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 548/1100] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:17 2022] GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 1526 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:17.920223 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0b0161ee-214c-4c0c-8f8c-f62e0a8725e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:17.920223 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0b0161ee-214c-4c0c-8f8c-f62e0a8725e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:17.924131 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f96f17d1-8bbd-458a-a37b-f09d4f5eb802 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:17.925508 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f96f17d1-8bbd-458a-a37b-f09d4f5eb802 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 7505ad12-d1c7-4dad-b0b8-e797560e5274] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:17.932794 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f96f17d1-8bbd-458a-a37b-f09d4f5eb802 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:17.933538 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f96f17d1-8bbd-458a-a37b-f09d4f5eb802 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:17.934143 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f96f17d1-8bbd-458a-a37b-f09d4f5eb802 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:17.934811 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b0161ee-214c-4c0c-8f8c-f62e0a8725e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:17.935306 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f96f17d1-8bbd-458a-a37b-f09d4f5eb802 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:17.935430 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b0161ee-214c-4c0c-8f8c-f62e0a8725e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:17.936131 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f96f17d1-8bbd-458a-a37b-f09d4f5eb802 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:17.936773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f96f17d1-8bbd-458a-a37b-f09d4f5eb802 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:17.939486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b0161ee-214c-4c0c-8f8c-f62e0a8725e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:17.939486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b0161ee-214c-4c0c-8f8c-f62e0a8725e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:17.942003 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b0161ee-214c-4c0c-8f8c-f62e0a8725e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:17.942586 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b0161ee-214c-4c0c-8f8c-f62e0a8725e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:18.227455 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0b0161ee-214c-4c0c-8f8c-f62e0a8725e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:18.229328 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f96f17d1-8bbd-458a-a37b-f09d4f5eb802 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:18.240811 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0b0161ee-214c-4c0c-8f8c-f62e0a8725e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:18.241062 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f96f17d1-8bbd-458a-a37b-f09d4f5eb802 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274" status: 200 len: 1316 microversion: 2.1 time: 0.324402 Sep 24 20:53:18.242127 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 549/1101] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:17 2022] GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274 => generated 1316 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:18.246539 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0b0161ee-214c-4c0c-8f8c-f62e0a8725e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:18.247158 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-df9c3099-7369-477d-88ff-975ffd388f20 req-9cbfb53f-2288-4f41-937f-379010181bf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03612730-8fd5-4006-aa0a-0c90feb1ea64", "name": "network-vif-plugged", "status": "completed", "tag": "f19f1969-880f-461a-a794-33b5a54fa613"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:18.248616 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0b0161ee-214c-4c0c-8f8c-f62e0a8725e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1362 microversion: 2.25 time: 0.346388 Sep 24 20:53:18.251778 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 553/1102] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:17 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1362 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:18.259742 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-df9c3099-7369-477d-88ff-975ffd388f20 req-9cbfb53f-2288-4f41-937f-379010181bf7 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:18.260475 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-df9c3099-7369-477d-88ff-975ffd388f20 req-9cbfb53f-2288-4f41-937f-379010181bf7 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:18.261067 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-df9c3099-7369-477d-88ff-975ffd388f20 req-9cbfb53f-2288-4f41-937f-379010181bf7 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:18.263141 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3d5070dd-99ce-457a-a3c8-7cda3fc79c5b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:18.265075 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3d5070dd-99ce-457a-a3c8-7cda3fc79c5b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:18.275228 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-df9c3099-7369-477d-88ff-975ffd388f20 req-9cbfb53f-2288-4f41-937f-379010181bf7 service nova] Creating event network-vif-plugged:f19f1969-880f-461a-a794-33b5a54fa613 for instance 03612730-8fd5-4006-aa0a-0c90feb1ea64 on nch1-master-1 Sep 24 20:53:18.280434 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d5070dd-99ce-457a-a3c8-7cda3fc79c5b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:18.281012 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d5070dd-99ce-457a-a3c8-7cda3fc79c5b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:18.281440 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-df9c3099-7369-477d-88ff-975ffd388f20 req-9cbfb53f-2288-4f41-937f-379010181bf7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037101 Sep 24 20:53:18.281564 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d5070dd-99ce-457a-a3c8-7cda3fc79c5b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:18.282404 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 550/1103] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:53:18.282788 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d5070dd-99ce-457a-a3c8-7cda3fc79c5b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:18.283267 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d5070dd-99ce-457a-a3c8-7cda3fc79c5b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:18.283707 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d5070dd-99ce-457a-a3c8-7cda3fc79c5b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:18.424706 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3d5070dd-99ce-457a-a3c8-7cda3fc79c5b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:18.441408 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3d5070dd-99ce-457a-a3c8-7cda3fc79c5b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:18.443659 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3d5070dd-99ce-457a-a3c8-7cda3fc79c5b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:18.451405 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3d5070dd-99ce-457a-a3c8-7cda3fc79c5b tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1546 microversion: 2.91 time: 0.198226 Sep 24 20:53:18.455018 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 554/1104] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:18 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1546 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:18.594949 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d33978c4-7833-4f7c-bc31-272d3b93670d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:18.595738 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d33978c4-7833-4f7c-bc31-272d3b93670d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:18.612893 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d33978c4-7833-4f7c-bc31-272d3b93670d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:18.614193 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d33978c4-7833-4f7c-bc31-272d3b93670d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:18.615294 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d33978c4-7833-4f7c-bc31-272d3b93670d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:18.617995 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d33978c4-7833-4f7c-bc31-272d3b93670d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:18.618890 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d33978c4-7833-4f7c-bc31-272d3b93670d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:18.619598 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d33978c4-7833-4f7c-bc31-272d3b93670d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:18.868446 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-366ee694-f802-4dcc-a3b7-038703c5f82c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:18.870124 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-366ee694-f802-4dcc-a3b7-038703c5f82c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:18.878476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-366ee694-f802-4dcc-a3b7-038703c5f82c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:18.879072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-366ee694-f802-4dcc-a3b7-038703c5f82c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:18.879682 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-366ee694-f802-4dcc-a3b7-038703c5f82c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:18.880609 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-366ee694-f802-4dcc-a3b7-038703c5f82c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:18.881067 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-366ee694-f802-4dcc-a3b7-038703c5f82c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:18.881576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-366ee694-f802-4dcc-a3b7-038703c5f82c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:19.092360 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d33978c4-7833-4f7c-bc31-272d3b93670d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:19.100232 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d33978c4-7833-4f7c-bc31-272d3b93670d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1471 microversion: 2.1 time: 0.509760 Sep 24 20:53:19.101210 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 551/1105] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:18 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1471 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:19.103840 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-366ee694-f802-4dcc-a3b7-038703c5f82c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:19.105649 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2d46f4c1-7111-4bd1-8355-f2ccbbd0edc5 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:19.108217 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2d46f4c1-7111-4bd1-8355-f2ccbbd0edc5 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:19.118986 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-366ee694-f802-4dcc-a3b7-038703c5f82c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1541 microversion: 2.1 time: 0.254965 Sep 24 20:53:19.120176 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d46f4c1-7111-4bd1-8355-f2ccbbd0edc5 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:19.130521 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d46f4c1-7111-4bd1-8355-f2ccbbd0edc5 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:19.130521 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d46f4c1-7111-4bd1-8355-f2ccbbd0edc5 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:19.130521 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d46f4c1-7111-4bd1-8355-f2ccbbd0edc5 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:19.130521 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d46f4c1-7111-4bd1-8355-f2ccbbd0edc5 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:19.130968 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d46f4c1-7111-4bd1-8355-f2ccbbd0edc5 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:19.145839 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 555/1106] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:18 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1541 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:19.265014 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c15be314-c36e-4f6d-a823-9b45478b2ff3 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:19.265549 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c15be314-c36e-4f6d-a823-9b45478b2ff3 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 7505ad12-d1c7-4dad-b0b8-e797560e5274] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:19.273210 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c15be314-c36e-4f6d-a823-9b45478b2ff3 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:19.273706 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c15be314-c36e-4f6d-a823-9b45478b2ff3 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:19.273706 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c15be314-c36e-4f6d-a823-9b45478b2ff3 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:19.273706 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c15be314-c36e-4f6d-a823-9b45478b2ff3 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:19.273706 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c15be314-c36e-4f6d-a823-9b45478b2ff3 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:19.280248 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c15be314-c36e-4f6d-a823-9b45478b2ff3 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:19.285481 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2d46f4c1-7111-4bd1-8355-f2ccbbd0edc5 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:19.295383 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2d46f4c1-7111-4bd1-8355-f2ccbbd0edc5 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 200 len: 1526 microversion: 2.1 time: 0.193196 Sep 24 20:53:19.297644 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 552/1107] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:19 2022] GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 1526 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:19.305253 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bbf7bd35-5af2-4248-a5b4-ef5ea9e605ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:19.306302 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bbf7bd35-5af2-4248-a5b4-ef5ea9e605ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:19.315309 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bbf7bd35-5af2-4248-a5b4-ef5ea9e605ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:19.316125 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bbf7bd35-5af2-4248-a5b4-ef5ea9e605ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:19.316749 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bbf7bd35-5af2-4248-a5b4-ef5ea9e605ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:19.317940 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bbf7bd35-5af2-4248-a5b4-ef5ea9e605ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:19.319180 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bbf7bd35-5af2-4248-a5b4-ef5ea9e605ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:19.320031 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bbf7bd35-5af2-4248-a5b4-ef5ea9e605ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:19.564092 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bbf7bd35-5af2-4248-a5b4-ef5ea9e605ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:19.566519 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c15be314-c36e-4f6d-a823-9b45478b2ff3 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:19.574200 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c15be314-c36e-4f6d-a823-9b45478b2ff3 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274" status: 200 len: 1316 microversion: 2.1 time: 0.313200 Sep 24 20:53:19.574592 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bbf7bd35-5af2-4248-a5b4-ef5ea9e605ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:19.574802 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 556/1108] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:19 2022] GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274 => generated 1316 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:19.576306 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bbf7bd35-5af2-4248-a5b4-ef5ea9e605ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:19.577545 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bbf7bd35-5af2-4248-a5b4-ef5ea9e605ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1362 microversion: 2.25 time: 0.278125 Sep 24 20:53:19.578194 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 553/1109] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:19 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1362 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:19.583561 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1dacb4da-0a0e-4b65-b339-e2be2f093a95 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:19.584188 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1dacb4da-0a0e-4b65-b339-e2be2f093a95 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:19.590295 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1dacb4da-0a0e-4b65-b339-e2be2f093a95 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:19.590843 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1dacb4da-0a0e-4b65-b339-e2be2f093a95 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:19.591287 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1dacb4da-0a0e-4b65-b339-e2be2f093a95 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:19.591994 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1dacb4da-0a0e-4b65-b339-e2be2f093a95 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:19.592455 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1dacb4da-0a0e-4b65-b339-e2be2f093a95 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:19.592882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1dacb4da-0a0e-4b65-b339-e2be2f093a95 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:19.662095 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1dacb4da-0a0e-4b65-b339-e2be2f093a95 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:19.670880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1dacb4da-0a0e-4b65-b339-e2be2f093a95 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:19.672467 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1dacb4da-0a0e-4b65-b339-e2be2f093a95 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:19.678964 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1dacb4da-0a0e-4b65-b339-e2be2f093a95 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1546 microversion: 2.91 time: 0.099254 Sep 24 20:53:19.691481 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 557/1110] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:19 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1546 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:20.124238 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b563c099-b9d4-4ed0-80b9-eee9ddf0aa79 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:20.124854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b563c099-b9d4-4ed0-80b9-eee9ddf0aa79 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:20.131612 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b563c099-b9d4-4ed0-80b9-eee9ddf0aa79 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:20.132106 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b563c099-b9d4-4ed0-80b9-eee9ddf0aa79 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:20.132545 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b563c099-b9d4-4ed0-80b9-eee9ddf0aa79 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:20.133254 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b563c099-b9d4-4ed0-80b9-eee9ddf0aa79 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:20.133735 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b563c099-b9d4-4ed0-80b9-eee9ddf0aa79 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:20.134147 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b563c099-b9d4-4ed0-80b9-eee9ddf0aa79 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:20.153840 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-776c024a-3fdb-4653-8f74-238c59dabf9f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:20.154543 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-776c024a-3fdb-4653-8f74-238c59dabf9f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:20.162753 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-776c024a-3fdb-4653-8f74-238c59dabf9f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:20.163648 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-776c024a-3fdb-4653-8f74-238c59dabf9f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:20.164299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-776c024a-3fdb-4653-8f74-238c59dabf9f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:20.165256 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-776c024a-3fdb-4653-8f74-238c59dabf9f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:20.166054 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-776c024a-3fdb-4653-8f74-238c59dabf9f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:20.167744 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-776c024a-3fdb-4653-8f74-238c59dabf9f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:20.360489 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b563c099-b9d4-4ed0-80b9-eee9ddf0aa79 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:20.371295 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b563c099-b9d4-4ed0-80b9-eee9ddf0aa79 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1471 microversion: 2.1 time: 0.250839 Sep 24 20:53:20.371890 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 554/1111] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:20 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1471 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:20.376743 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-7979c1aa-f9ae-45cb-9fa7-c21bd690af54 req-a763ca0d-3812-4664-94a0-3d1f4d8d6328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "500f472e-d914-4eef-b315-7178f06ef6d8", "name": "network-vif-plugged", "status": "completed", "tag": "4d1d41e0-6d1a-4c5c-b228-5e9a7c7076e4"}, {"server_uuid": "500f472e-d914-4eef-b315-7178f06ef6d8", "name": "network-vif-unplugged", "status": "completed", "tag": "4d1d41e0-6d1a-4c5c-b228-5e9a7c7076e4"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:20.386886 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-7979c1aa-f9ae-45cb-9fa7-c21bd690af54 req-a763ca0d-3812-4664-94a0-3d1f4d8d6328 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:20.387372 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-7979c1aa-f9ae-45cb-9fa7-c21bd690af54 req-a763ca0d-3812-4664-94a0-3d1f4d8d6328 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:20.387812 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-7979c1aa-f9ae-45cb-9fa7-c21bd690af54 req-a763ca0d-3812-4664-94a0-3d1f4d8d6328 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:20.392148 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-776c024a-3fdb-4653-8f74-238c59dabf9f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:20.400621 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-7979c1aa-f9ae-45cb-9fa7-c21bd690af54 req-a763ca0d-3812-4664-94a0-3d1f4d8d6328 service nova] Creating event network-vif-plugged:4d1d41e0-6d1a-4c5c-b228-5e9a7c7076e4 for instance 500f472e-d914-4eef-b315-7178f06ef6d8 on nch2-master-1 Sep 24 20:53:20.400972 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-776c024a-3fdb-4653-8f74-238c59dabf9f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1541 microversion: 2.1 time: 0.251416 Sep 24 20:53:20.401145 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-7979c1aa-f9ae-45cb-9fa7-c21bd690af54 req-a763ca0d-3812-4664-94a0-3d1f4d8d6328 service nova] Creating event network-vif-unplugged:4d1d41e0-6d1a-4c5c-b228-5e9a7c7076e4 for instance 500f472e-d914-4eef-b315-7178f06ef6d8 on nch2-master-1 Sep 24 20:53:20.401559 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 558/1112] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:20 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1541 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:20.406402 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-7979c1aa-f9ae-45cb-9fa7-c21bd690af54 req-a763ca0d-3812-4664-94a0-3d1f4d8d6328 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.033148 Sep 24 20:53:20.407031 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 555/1113] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:53:20.419027 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4c4184b8-53e7-445e-b2e6-13a02d0b8582 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:20.420198 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4c4184b8-53e7-445e-b2e6-13a02d0b8582 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:20.428608 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4c4184b8-53e7-445e-b2e6-13a02d0b8582 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:20.429170 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4c4184b8-53e7-445e-b2e6-13a02d0b8582 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:20.430166 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4c4184b8-53e7-445e-b2e6-13a02d0b8582 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:20.431084 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4c4184b8-53e7-445e-b2e6-13a02d0b8582 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:20.431717 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4c4184b8-53e7-445e-b2e6-13a02d0b8582 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:20.432150 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4c4184b8-53e7-445e-b2e6-13a02d0b8582 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:20.575980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4c4184b8-53e7-445e-b2e6-13a02d0b8582 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:20.586197 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4c4184b8-53e7-445e-b2e6-13a02d0b8582 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 200 len: 1526 microversion: 2.1 time: 0.170965 Sep 24 20:53:20.598194 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 559/1114] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:20 2022] GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 1526 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:20.601084 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-eae2235b-4cee-4334-8100-6d7e5997b748 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:20.601799 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-eae2235b-4cee-4334-8100-6d7e5997b748 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 7505ad12-d1c7-4dad-b0b8-e797560e5274] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:20.603180 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-54981bae-7650-42fc-8d31-62d0091de4ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:20.604140 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-54981bae-7650-42fc-8d31-62d0091de4ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:20.608696 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eae2235b-4cee-4334-8100-6d7e5997b748 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:20.609168 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eae2235b-4cee-4334-8100-6d7e5997b748 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:20.609607 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eae2235b-4cee-4334-8100-6d7e5997b748 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:20.610274 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-54981bae-7650-42fc-8d31-62d0091de4ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:20.610385 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eae2235b-4cee-4334-8100-6d7e5997b748 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:20.610774 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eae2235b-4cee-4334-8100-6d7e5997b748 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:20.610894 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-54981bae-7650-42fc-8d31-62d0091de4ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:20.611204 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eae2235b-4cee-4334-8100-6d7e5997b748 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:20.611318 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-54981bae-7650-42fc-8d31-62d0091de4ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:20.612629 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-54981bae-7650-42fc-8d31-62d0091de4ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:20.613124 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-54981bae-7650-42fc-8d31-62d0091de4ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:20.613594 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-54981bae-7650-42fc-8d31-62d0091de4ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:20.833054 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-54981bae-7650-42fc-8d31-62d0091de4ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:20.841413 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-eae2235b-4cee-4334-8100-6d7e5997b748 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:20.841648 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-54981bae-7650-42fc-8d31-62d0091de4ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:20.843153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-54981bae-7650-42fc-8d31-62d0091de4ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:20.844293 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-54981bae-7650-42fc-8d31-62d0091de4ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1362 microversion: 2.25 time: 0.245028 Sep 24 20:53:20.847351 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:20.853930 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-eae2235b-4cee-4334-8100-6d7e5997b748 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274" status: 200 len: 1316 microversion: 2.1 time: 0.258164 Sep 24 20:53:20.855290 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 556/1115] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:20 2022] GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274 => generated 1316 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:20.864148 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-03577c20-55e3-4698-9c2c-a3822c738880 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:20.864148 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-03577c20-55e3-4698-9c2c-a3822c738880 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:20.864439 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 560/1116] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:20 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1362 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:20.869874 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-03577c20-55e3-4698-9c2c-a3822c738880 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:20.870475 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-03577c20-55e3-4698-9c2c-a3822c738880 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:20.871034 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-03577c20-55e3-4698-9c2c-a3822c738880 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:20.871828 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-03577c20-55e3-4698-9c2c-a3822c738880 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:20.872304 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-03577c20-55e3-4698-9c2c-a3822c738880 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:20.872826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-03577c20-55e3-4698-9c2c-a3822c738880 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:20.946827 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-03577c20-55e3-4698-9c2c-a3822c738880 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:20.955051 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-03577c20-55e3-4698-9c2c-a3822c738880 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:20.957064 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-03577c20-55e3-4698-9c2c-a3822c738880 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:20.961818 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-03577c20-55e3-4698-9c2c-a3822c738880 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1546 microversion: 2.91 time: 0.105376 Sep 24 20:53:20.962390 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 557/1117] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:20 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1546 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:21.394197 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f2d801a3-8b1a-47be-a051-fe5cf39543a6 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:21.395176 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f2d801a3-8b1a-47be-a051-fe5cf39543a6 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:21.401648 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f2d801a3-8b1a-47be-a051-fe5cf39543a6 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:21.402133 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f2d801a3-8b1a-47be-a051-fe5cf39543a6 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:21.402601 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f2d801a3-8b1a-47be-a051-fe5cf39543a6 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:21.403301 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f2d801a3-8b1a-47be-a051-fe5cf39543a6 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:21.403760 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f2d801a3-8b1a-47be-a051-fe5cf39543a6 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:21.404187 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f2d801a3-8b1a-47be-a051-fe5cf39543a6 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:21.429712 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a5d1d325-621c-4eb7-88dd-dc2e23da53bf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:21.430518 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a5d1d325-621c-4eb7-88dd-dc2e23da53bf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:21.438121 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5d1d325-621c-4eb7-88dd-dc2e23da53bf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:21.438974 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5d1d325-621c-4eb7-88dd-dc2e23da53bf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:21.440540 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5d1d325-621c-4eb7-88dd-dc2e23da53bf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:21.441690 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5d1d325-621c-4eb7-88dd-dc2e23da53bf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:21.442360 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5d1d325-621c-4eb7-88dd-dc2e23da53bf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:21.452361 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5d1d325-621c-4eb7-88dd-dc2e23da53bf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:21.653604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f2d801a3-8b1a-47be-a051-fe5cf39543a6 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:21.661220 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f2d801a3-8b1a-47be-a051-fe5cf39543a6 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1471 microversion: 2.1 time: 0.270624 Sep 24 20:53:21.661551 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a5d1d325-621c-4eb7-88dd-dc2e23da53bf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:21.662075 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 561/1118] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:21 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1471 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:21.666971 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-488628f3-1aec-473a-bd27-2a362c473dbe tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:21.667688 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-488628f3-1aec-473a-bd27-2a362c473dbe tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:21.670014 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a5d1d325-621c-4eb7-88dd-dc2e23da53bf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1541 microversion: 2.1 time: 0.245705 Sep 24 20:53:21.676353 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-488628f3-1aec-473a-bd27-2a362c473dbe tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:21.677868 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-488628f3-1aec-473a-bd27-2a362c473dbe tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:21.679092 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-488628f3-1aec-473a-bd27-2a362c473dbe tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:21.680521 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-488628f3-1aec-473a-bd27-2a362c473dbe tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:21.681534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-488628f3-1aec-473a-bd27-2a362c473dbe tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:21.682110 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-488628f3-1aec-473a-bd27-2a362c473dbe tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:21.683098 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 558/1119] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:21 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1541 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:21.685384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:21.829028 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-488628f3-1aec-473a-bd27-2a362c473dbe tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:21.837850 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-488628f3-1aec-473a-bd27-2a362c473dbe tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 200 len: 1526 microversion: 2.1 time: 0.174835 Sep 24 20:53:21.838665 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 562/1120] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:21 2022] GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 1526 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:21.875617 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2572cc97-7586-42a7-a9fb-1bd3009316fd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:21.876270 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2572cc97-7586-42a7-a9fb-1bd3009316fd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:21.881101 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ff3dcf12-ae4d-4893-a72c-0d242893dc10 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:21.882668 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ff3dcf12-ae4d-4893-a72c-0d242893dc10 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 7505ad12-d1c7-4dad-b0b8-e797560e5274] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:21.882895 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2572cc97-7586-42a7-a9fb-1bd3009316fd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:21.883432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2572cc97-7586-42a7-a9fb-1bd3009316fd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:21.883877 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2572cc97-7586-42a7-a9fb-1bd3009316fd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:21.884616 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2572cc97-7586-42a7-a9fb-1bd3009316fd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:21.885096 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2572cc97-7586-42a7-a9fb-1bd3009316fd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:21.885534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2572cc97-7586-42a7-a9fb-1bd3009316fd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:21.891210 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff3dcf12-ae4d-4893-a72c-0d242893dc10 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:21.891210 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff3dcf12-ae4d-4893-a72c-0d242893dc10 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:21.891210 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff3dcf12-ae4d-4893-a72c-0d242893dc10 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:21.891636 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff3dcf12-ae4d-4893-a72c-0d242893dc10 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:21.894447 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff3dcf12-ae4d-4893-a72c-0d242893dc10 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:21.895291 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff3dcf12-ae4d-4893-a72c-0d242893dc10 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:22.130168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ff3dcf12-ae4d-4893-a72c-0d242893dc10 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:22.141823 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ff3dcf12-ae4d-4893-a72c-0d242893dc10 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274" status: 200 len: 1316 microversion: 2.1 time: 0.266855 Sep 24 20:53:22.142877 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 563/1121] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:21 2022] GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274 => generated 1316 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:22.152445 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2572cc97-7586-42a7-a9fb-1bd3009316fd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:22.159311 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-05ded0ff-38ca-4e86-b330-3e29502f59d9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:22.161292 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-05ded0ff-38ca-4e86-b330-3e29502f59d9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:22.169011 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05ded0ff-38ca-4e86-b330-3e29502f59d9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:22.169934 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2572cc97-7586-42a7-a9fb-1bd3009316fd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:22.170345 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05ded0ff-38ca-4e86-b330-3e29502f59d9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:22.171280 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05ded0ff-38ca-4e86-b330-3e29502f59d9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:22.172446 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05ded0ff-38ca-4e86-b330-3e29502f59d9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:22.172566 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2572cc97-7586-42a7-a9fb-1bd3009316fd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:22.173412 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05ded0ff-38ca-4e86-b330-3e29502f59d9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:22.175163 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05ded0ff-38ca-4e86-b330-3e29502f59d9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:22.181583 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2572cc97-7586-42a7-a9fb-1bd3009316fd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1362 microversion: 2.25 time: 0.306078 Sep 24 20:53:22.191219 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 559/1122] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:21 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1362 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:22.255622 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-05ded0ff-38ca-4e86-b330-3e29502f59d9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:22.266370 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-05ded0ff-38ca-4e86-b330-3e29502f59d9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:22.268718 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-05ded0ff-38ca-4e86-b330-3e29502f59d9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:22.274441 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-05ded0ff-38ca-4e86-b330-3e29502f59d9 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1546 microversion: 2.91 time: 0.127552 Sep 24 20:53:22.275986 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 564/1123] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:22 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1546 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:22.684994 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-aa53b75a-606c-4a13-9f22-dc513fae7876 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:22.685603 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-aa53b75a-606c-4a13-9f22-dc513fae7876 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:22.694669 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a906add8-9438-4d6c-b680-8a4cb8c1085e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:22.695258 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aa53b75a-606c-4a13-9f22-dc513fae7876 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:22.695523 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aa53b75a-606c-4a13-9f22-dc513fae7876 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:22.695673 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a906add8-9438-4d6c-b680-8a4cb8c1085e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:22.695968 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aa53b75a-606c-4a13-9f22-dc513fae7876 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:22.696681 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aa53b75a-606c-4a13-9f22-dc513fae7876 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:22.697213 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aa53b75a-606c-4a13-9f22-dc513fae7876 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:22.697570 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aa53b75a-606c-4a13-9f22-dc513fae7876 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:22.729718 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:22.733153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a906add8-9438-4d6c-b680-8a4cb8c1085e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:22.734557 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a906add8-9438-4d6c-b680-8a4cb8c1085e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:22.735364 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a906add8-9438-4d6c-b680-8a4cb8c1085e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:22.736139 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a906add8-9438-4d6c-b680-8a4cb8c1085e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:22.736660 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a906add8-9438-4d6c-b680-8a4cb8c1085e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:22.742087 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a906add8-9438-4d6c-b680-8a4cb8c1085e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:22.975334 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=6 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:23.026829 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-aa53b75a-606c-4a13-9f22-dc513fae7876 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:23.040176 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-aa53b75a-606c-4a13-9f22-dc513fae7876 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1477 microversion: 2.1 time: 0.358795 Sep 24 20:53:23.042548 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 560/1124] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:22 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1477 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:23.046705 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-dbde0db0-1025-4c81-9a6c-50e0c712176a req-6b04e470-4900-482c-b9c4-e551f819e817 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "500f472e-d914-4eef-b315-7178f06ef6d8", "name": "network-vif-deleted", "tag": "4d1d41e0-6d1a-4c5c-b228-5e9a7c7076e4"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:23.048069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a906add8-9438-4d6c-b680-8a4cb8c1085e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:23.058760 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a906add8-9438-4d6c-b680-8a4cb8c1085e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1541 microversion: 2.1 time: 0.369267 Sep 24 20:53:23.060031 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 565/1125] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:22 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1541 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:23.060156 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-dbde0db0-1025-4c81-9a6c-50e0c712176a req-6b04e470-4900-482c-b9c4-e551f819e817 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:23.064773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-dbde0db0-1025-4c81-9a6c-50e0c712176a req-6b04e470-4900-482c-b9c4-e551f819e817 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:23.064773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-dbde0db0-1025-4c81-9a6c-50e0c712176a req-6b04e470-4900-482c-b9c4-e551f819e817 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:23.065005 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cb13b655-7a10-4edf-bfb8-436adeee87e2 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:23.065102 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cb13b655-7a10-4edf-bfb8-436adeee87e2 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:23.071124 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb13b655-7a10-4edf-bfb8-436adeee87e2 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:23.071620 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb13b655-7a10-4edf-bfb8-436adeee87e2 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:23.072063 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb13b655-7a10-4edf-bfb8-436adeee87e2 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:23.072775 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb13b655-7a10-4edf-bfb8-436adeee87e2 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:23.073358 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb13b655-7a10-4edf-bfb8-436adeee87e2 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:23.073794 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb13b655-7a10-4edf-bfb8-436adeee87e2 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:23.074320 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-dbde0db0-1025-4c81-9a6c-50e0c712176a req-6b04e470-4900-482c-b9c4-e551f819e817 service nova] Creating event network-vif-deleted:4d1d41e0-6d1a-4c5c-b228-5e9a7c7076e4 for instance 500f472e-d914-4eef-b315-7178f06ef6d8 on nch2-master-1 Sep 24 20:53:23.080126 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-dbde0db0-1025-4c81-9a6c-50e0c712176a req-6b04e470-4900-482c-b9c4-e551f819e817 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037440 Sep 24 20:53:23.081487 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 561/1126] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:53:23.148317 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cb13b655-7a10-4edf-bfb8-436adeee87e2 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:23.156405 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cb13b655-7a10-4edf-bfb8-436adeee87e2 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 200 len: 1484 microversion: 2.1 time: 0.095683 Sep 24 20:53:23.156999 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 566/1127] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:23 2022] GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 1484 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:23.166613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ebca15f7-92f2-4f97-93c3-8e7aa6821602 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:23.167437 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ebca15f7-92f2-4f97-93c3-8e7aa6821602 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 7505ad12-d1c7-4dad-b0b8-e797560e5274] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:23.173818 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=16 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:23.176503 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ebca15f7-92f2-4f97-93c3-8e7aa6821602 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:23.177607 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ebca15f7-92f2-4f97-93c3-8e7aa6821602 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:23.177607 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ebca15f7-92f2-4f97-93c3-8e7aa6821602 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:23.184035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ebca15f7-92f2-4f97-93c3-8e7aa6821602 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:23.184869 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ebca15f7-92f2-4f97-93c3-8e7aa6821602 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:23.186152 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ebca15f7-92f2-4f97-93c3-8e7aa6821602 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:23.218168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2db0244c-11c4-446a-a18b-021da5dd386f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:23.218816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2db0244c-11c4-446a-a18b-021da5dd386f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:23.225662 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2db0244c-11c4-446a-a18b-021da5dd386f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:23.226165 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2db0244c-11c4-446a-a18b-021da5dd386f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:23.226637 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2db0244c-11c4-446a-a18b-021da5dd386f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:23.227351 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2db0244c-11c4-446a-a18b-021da5dd386f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:23.227808 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2db0244c-11c4-446a-a18b-021da5dd386f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:23.228247 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2db0244c-11c4-446a-a18b-021da5dd386f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:23.433910 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ebca15f7-92f2-4f97-93c3-8e7aa6821602 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:23.442430 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ebca15f7-92f2-4f97-93c3-8e7aa6821602 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274" status: 200 len: 1316 microversion: 2.1 time: 0.281468 Sep 24 20:53:23.443049 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 562/1128] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:23 2022] GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274 => generated 1316 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:23.447666 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-de24042b-0ee7-4d3e-bed2-a61f002642c4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:23.448289 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-de24042b-0ee7-4d3e-bed2-a61f002642c4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:23.450432 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2db0244c-11c4-446a-a18b-021da5dd386f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:23.470633 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de24042b-0ee7-4d3e-bed2-a61f002642c4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:23.471806 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de24042b-0ee7-4d3e-bed2-a61f002642c4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:23.472137 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de24042b-0ee7-4d3e-bed2-a61f002642c4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:23.473104 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de24042b-0ee7-4d3e-bed2-a61f002642c4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:23.473749 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de24042b-0ee7-4d3e-bed2-a61f002642c4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:23.474006 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de24042b-0ee7-4d3e-bed2-a61f002642c4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:23.475743 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2db0244c-11c4-446a-a18b-021da5dd386f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:23.478124 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2db0244c-11c4-446a-a18b-021da5dd386f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:23.479638 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2db0244c-11c4-446a-a18b-021da5dd386f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1362 microversion: 2.25 time: 0.265532 Sep 24 20:53:23.480217 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 567/1129] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:23 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1362 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:53:23.552475 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-de24042b-0ee7-4d3e-bed2-a61f002642c4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:23.561490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-de24042b-0ee7-4d3e-bed2-a61f002642c4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:23.563005 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-de24042b-0ee7-4d3e-bed2-a61f002642c4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:23.568703 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-de24042b-0ee7-4d3e-bed2-a61f002642c4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1546 microversion: 2.91 time: 0.124622 Sep 24 20:53:23.569429 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 563/1130] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:23 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1546 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:24.065415 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d54c003f-3eca-4e4d-98db-0f180399e0e4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:24.066241 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d54c003f-3eca-4e4d-98db-0f180399e0e4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:24.088950 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d54c003f-3eca-4e4d-98db-0f180399e0e4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:24.089516 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d54c003f-3eca-4e4d-98db-0f180399e0e4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:24.089970 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d54c003f-3eca-4e4d-98db-0f180399e0e4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:24.090732 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d54c003f-3eca-4e4d-98db-0f180399e0e4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:24.091199 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d54c003f-3eca-4e4d-98db-0f180399e0e4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:24.091458 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e3384f2d-9f35-462b-accc-976d119907db tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:24.092010 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d54c003f-3eca-4e4d-98db-0f180399e0e4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:24.092158 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e3384f2d-9f35-462b-accc-976d119907db tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:24.099882 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3384f2d-9f35-462b-accc-976d119907db tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:24.100386 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3384f2d-9f35-462b-accc-976d119907db tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:24.100833 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3384f2d-9f35-462b-accc-976d119907db tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:24.101736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3384f2d-9f35-462b-accc-976d119907db tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:24.102208 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3384f2d-9f35-462b-accc-976d119907db tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:24.102824 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3384f2d-9f35-462b-accc-976d119907db tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:24.389245 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e3384f2d-9f35-462b-accc-976d119907db tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:24.397876 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e3384f2d-9f35-462b-accc-976d119907db tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1541 microversion: 2.1 time: 0.310124 Sep 24 20:53:24.414318 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 564/1131] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:24 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1541 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:24.417813 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d54c003f-3eca-4e4d-98db-0f180399e0e4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:24.419621 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f09e804e-913a-4080-9749-9abc3a13bbe0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:24.420447 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f09e804e-913a-4080-9749-9abc3a13bbe0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:24.428423 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f09e804e-913a-4080-9749-9abc3a13bbe0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:24.428634 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d54c003f-3eca-4e4d-98db-0f180399e0e4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1477 microversion: 2.1 time: 0.367063 Sep 24 20:53:24.429058 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 568/1132] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:24 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1477 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:24.429476 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f09e804e-913a-4080-9749-9abc3a13bbe0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:24.429925 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f09e804e-913a-4080-9749-9abc3a13bbe0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:24.430678 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f09e804e-913a-4080-9749-9abc3a13bbe0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:24.431289 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f09e804e-913a-4080-9749-9abc3a13bbe0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:24.431876 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f09e804e-913a-4080-9749-9abc3a13bbe0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:24.465394 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f09e804e-913a-4080-9749-9abc3a13bbe0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:24.465586 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4e173722-c8a1-4c60-985e-90bdce0cc285 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:24.465805 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f09e804e-913a-4080-9749-9abc3a13bbe0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:24.466247 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f09e804e-913a-4080-9749-9abc3a13bbe0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:24.466467 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4e173722-c8a1-4c60-985e-90bdce0cc285 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 7505ad12-d1c7-4dad-b0b8-e797560e5274] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:24.466818 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-f09e804e-913a-4080-9749-9abc3a13bbe0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lazy-loading 'fault' on Instance uuid 500f472e-d914-4eef-b315-7178f06ef6d8 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:53:24.475813 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e173722-c8a1-4c60-985e-90bdce0cc285 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:24.476675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e173722-c8a1-4c60-985e-90bdce0cc285 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:24.477578 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e173722-c8a1-4c60-985e-90bdce0cc285 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:24.478544 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e173722-c8a1-4c60-985e-90bdce0cc285 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:24.479372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e173722-c8a1-4c60-985e-90bdce0cc285 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:24.479866 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e173722-c8a1-4c60-985e-90bdce0cc285 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:24.513952 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f09e804e-913a-4080-9749-9abc3a13bbe0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:24.534523 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f09e804e-913a-4080-9749-9abc3a13bbe0 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 200 len: 1314 microversion: 2.1 time: 0.118290 Sep 24 20:53:24.552522 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 565/1133] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:24 2022] GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 1314 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:24.563868 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-57ec3ab2-48b3-4e97-856a-a4f5ec82edcf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:24.566171 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-57ec3ab2-48b3-4e97-856a-a4f5ec82edcf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:24.573185 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57ec3ab2-48b3-4e97-856a-a4f5ec82edcf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:24.574817 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57ec3ab2-48b3-4e97-856a-a4f5ec82edcf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:24.575512 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57ec3ab2-48b3-4e97-856a-a4f5ec82edcf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:24.576656 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57ec3ab2-48b3-4e97-856a-a4f5ec82edcf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:24.577232 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57ec3ab2-48b3-4e97-856a-a4f5ec82edcf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:24.578586 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57ec3ab2-48b3-4e97-856a-a4f5ec82edcf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:24.668437 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4e173722-c8a1-4c60-985e-90bdce0cc285 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:24.677373 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4e173722-c8a1-4c60-985e-90bdce0cc285 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274" status: 200 len: 1316 microversion: 2.1 time: 0.215861 Sep 24 20:53:24.686227 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 569/1134] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:24 2022] GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274 => generated 1316 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:24.699503 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-25e59ebc-6f3a-4795-8b5b-91a0c3824b79 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:24.700563 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-25e59ebc-6f3a-4795-8b5b-91a0c3824b79 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:24.707203 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-25e59ebc-6f3a-4795-8b5b-91a0c3824b79 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:24.707964 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-25e59ebc-6f3a-4795-8b5b-91a0c3824b79 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:24.708585 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-25e59ebc-6f3a-4795-8b5b-91a0c3824b79 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:24.709597 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-25e59ebc-6f3a-4795-8b5b-91a0c3824b79 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:24.710396 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-25e59ebc-6f3a-4795-8b5b-91a0c3824b79 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:24.711013 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-25e59ebc-6f3a-4795-8b5b-91a0c3824b79 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:24.774607 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-57ec3ab2-48b3-4e97-856a-a4f5ec82edcf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:24.782775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-57ec3ab2-48b3-4e97-856a-a4f5ec82edcf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:24.784613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-57ec3ab2-48b3-4e97-856a-a4f5ec82edcf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:24.785726 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-57ec3ab2-48b3-4e97-856a-a4f5ec82edcf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1362 microversion: 2.25 time: 0.231713 Sep 24 20:53:24.786307 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 566/1135] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:24 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:24.790637 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-25e59ebc-6f3a-4795-8b5b-91a0c3824b79 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:24.800091 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-25e59ebc-6f3a-4795-8b5b-91a0c3824b79 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:24.801685 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-25e59ebc-6f3a-4795-8b5b-91a0c3824b79 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:24.807332 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-25e59ebc-6f3a-4795-8b5b-91a0c3824b79 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1546 microversion: 2.91 time: 0.119837 Sep 24 20:53:24.808187 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 570/1136] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:24 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1546 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:25.406864 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-fe1610e6-4fbb-436c-b083-9d5602edb0dc req-79b382a7-e866-48a4-ad91-254ef04627a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdb37c4d-e841-4e13-b809-e3f19ce6365a", "name": "network-vif-unplugged", "status": "completed", "tag": "fdfbcb27-4de9-4bdc-b3e7-a1d7e89b3236"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:25.421375 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a8a09cbb-10ed-46cf-a246-16709750af60 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:25.421989 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a8a09cbb-10ed-46cf-a246-16709750af60 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:25.429909 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a8a09cbb-10ed-46cf-a246-16709750af60 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:25.430293 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-fe1610e6-4fbb-436c-b083-9d5602edb0dc req-79b382a7-e866-48a4-ad91-254ef04627a6 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:25.430740 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a8a09cbb-10ed-46cf-a246-16709750af60 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:25.431013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-fe1610e6-4fbb-436c-b083-9d5602edb0dc req-79b382a7-e866-48a4-ad91-254ef04627a6 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:25.431238 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a8a09cbb-10ed-46cf-a246-16709750af60 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:25.431441 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-fe1610e6-4fbb-436c-b083-9d5602edb0dc req-79b382a7-e866-48a4-ad91-254ef04627a6 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:25.432103 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a8a09cbb-10ed-46cf-a246-16709750af60 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:25.432564 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a8a09cbb-10ed-46cf-a246-16709750af60 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:25.432999 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a8a09cbb-10ed-46cf-a246-16709750af60 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:25.444434 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-fe1610e6-4fbb-436c-b083-9d5602edb0dc req-79b382a7-e866-48a4-ad91-254ef04627a6 service nova] Creating event network-vif-unplugged:fdfbcb27-4de9-4bdc-b3e7-a1d7e89b3236 for instance bdb37c4d-e841-4e13-b809-e3f19ce6365a on nch2-master-1 Sep 24 20:53:25.451513 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-fe1610e6-4fbb-436c-b083-9d5602edb0dc req-79b382a7-e866-48a4-ad91-254ef04627a6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048782 Sep 24 20:53:25.452366 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 567/1137] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:53:25.458357 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b5cd150b-0fcc-403e-8a4f-2039d473f1c7 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:25.459100 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b5cd150b-0fcc-403e-8a4f-2039d473f1c7 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:25.465379 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b5cd150b-0fcc-403e-8a4f-2039d473f1c7 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:25.465871 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b5cd150b-0fcc-403e-8a4f-2039d473f1c7 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:25.466316 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b5cd150b-0fcc-403e-8a4f-2039d473f1c7 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:25.467044 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b5cd150b-0fcc-403e-8a4f-2039d473f1c7 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:25.467690 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b5cd150b-0fcc-403e-8a4f-2039d473f1c7 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:25.468126 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b5cd150b-0fcc-403e-8a4f-2039d473f1c7 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:25.649429 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a8a09cbb-10ed-46cf-a246-16709750af60 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:25.653386 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b5cd150b-0fcc-403e-8a4f-2039d473f1c7 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:25.657419 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a8a09cbb-10ed-46cf-a246-16709750af60 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1541 microversion: 2.1 time: 0.239926 Sep 24 20:53:25.657994 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 571/1138] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:25 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1541 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:25.662660 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4af6639e-27a0-478b-8aa7-de7d7906f0eb tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:25.663278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4af6639e-27a0-478b-8aa7-de7d7906f0eb tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:25.666610 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b5cd150b-0fcc-403e-8a4f-2039d473f1c7 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1477 microversion: 2.1 time: 0.212890 Sep 24 20:53:25.667198 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 568/1139] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:25 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1477 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:25.670390 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4af6639e-27a0-478b-8aa7-de7d7906f0eb tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:25.670913 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4af6639e-27a0-478b-8aa7-de7d7906f0eb tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:25.671347 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4af6639e-27a0-478b-8aa7-de7d7906f0eb tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:25.672051 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4af6639e-27a0-478b-8aa7-de7d7906f0eb tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:25.672509 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4af6639e-27a0-478b-8aa7-de7d7906f0eb tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:25.672936 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4af6639e-27a0-478b-8aa7-de7d7906f0eb tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:25.705256 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a1da674c-5c3f-4ed1-a21f-1145adc737f3 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:25.705612 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4af6639e-27a0-478b-8aa7-de7d7906f0eb tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:25.706152 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4af6639e-27a0-478b-8aa7-de7d7906f0eb tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:25.706454 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a1da674c-5c3f-4ed1-a21f-1145adc737f3 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 7505ad12-d1c7-4dad-b0b8-e797560e5274] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:25.706697 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4af6639e-27a0-478b-8aa7-de7d7906f0eb tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:25.707148 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-4af6639e-27a0-478b-8aa7-de7d7906f0eb tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lazy-loading 'fault' on Instance uuid 500f472e-d914-4eef-b315-7178f06ef6d8 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:53:25.713264 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1da674c-5c3f-4ed1-a21f-1145adc737f3 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:25.713755 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1da674c-5c3f-4ed1-a21f-1145adc737f3 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:25.714187 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1da674c-5c3f-4ed1-a21f-1145adc737f3 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:25.714907 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1da674c-5c3f-4ed1-a21f-1145adc737f3 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:25.715472 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1da674c-5c3f-4ed1-a21f-1145adc737f3 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:25.715909 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1da674c-5c3f-4ed1-a21f-1145adc737f3 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:25.749272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4af6639e-27a0-478b-8aa7-de7d7906f0eb tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:25.758649 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4af6639e-27a0-478b-8aa7-de7d7906f0eb tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 200 len: 1314 microversion: 2.1 time: 0.099501 Sep 24 20:53:25.759457 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 572/1140] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:25 2022] GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 1314 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:25.810704 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-250ae66c-e6b3-4c17-b53a-9161be12a6fe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:25.811333 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-250ae66c-e6b3-4c17-b53a-9161be12a6fe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:25.818026 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-250ae66c-e6b3-4c17-b53a-9161be12a6fe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:25.818538 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-250ae66c-e6b3-4c17-b53a-9161be12a6fe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:25.818981 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-250ae66c-e6b3-4c17-b53a-9161be12a6fe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:25.819686 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-250ae66c-e6b3-4c17-b53a-9161be12a6fe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:25.820152 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-250ae66c-e6b3-4c17-b53a-9161be12a6fe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:25.820582 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-250ae66c-e6b3-4c17-b53a-9161be12a6fe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:25.854526 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a1da674c-5c3f-4ed1-a21f-1145adc737f3 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:25.862835 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a1da674c-5c3f-4ed1-a21f-1145adc737f3 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274" status: 200 len: 1316 microversion: 2.1 time: 0.161336 Sep 24 20:53:25.863531 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 569/1141] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:25 2022] GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274 => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:25.868201 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-88f5bd57-6912-47ab-8463-55cd79162468 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:25.868814 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-88f5bd57-6912-47ab-8463-55cd79162468 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:25.875217 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-88f5bd57-6912-47ab-8463-55cd79162468 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:25.875709 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-88f5bd57-6912-47ab-8463-55cd79162468 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:25.876276 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-88f5bd57-6912-47ab-8463-55cd79162468 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:25.877600 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-88f5bd57-6912-47ab-8463-55cd79162468 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:25.878388 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-88f5bd57-6912-47ab-8463-55cd79162468 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:25.878939 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-88f5bd57-6912-47ab-8463-55cd79162468 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:25.962246 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-88f5bd57-6912-47ab-8463-55cd79162468 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:25.970476 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-88f5bd57-6912-47ab-8463-55cd79162468 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:25.972773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-88f5bd57-6912-47ab-8463-55cd79162468 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:25.977725 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-88f5bd57-6912-47ab-8463-55cd79162468 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1546 microversion: 2.91 time: 0.113215 Sep 24 20:53:25.978398 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 570/1142] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:25 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1546 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:25.983940 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-250ae66c-e6b3-4c17-b53a-9161be12a6fe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:25.992890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-250ae66c-e6b3-4c17-b53a-9161be12a6fe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:25.994332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-250ae66c-e6b3-4c17-b53a-9161be12a6fe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:25.995527 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-250ae66c-e6b3-4c17-b53a-9161be12a6fe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1362 microversion: 2.25 time: 0.188668 Sep 24 20:53:25.996083 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 573/1143] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:25 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:53:26.681708 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-afca6a4a-d16d-4a29-80cc-a9ca22715971 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:26.682332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-afca6a4a-d16d-4a29-80cc-a9ca22715971 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:26.689532 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-afca6a4a-d16d-4a29-80cc-a9ca22715971 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:26.690043 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-afca6a4a-d16d-4a29-80cc-a9ca22715971 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:26.690650 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-afca6a4a-d16d-4a29-80cc-a9ca22715971 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:26.691198 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1ccb6216-246d-4a9f-a9a7-254601ef6c44 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:26.691643 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-afca6a4a-d16d-4a29-80cc-a9ca22715971 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:26.691820 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1ccb6216-246d-4a9f-a9a7-254601ef6c44 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:26.691932 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-afca6a4a-d16d-4a29-80cc-a9ca22715971 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:26.692278 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-afca6a4a-d16d-4a29-80cc-a9ca22715971 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:26.698282 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1ccb6216-246d-4a9f-a9a7-254601ef6c44 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:26.698797 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1ccb6216-246d-4a9f-a9a7-254601ef6c44 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:26.699242 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1ccb6216-246d-4a9f-a9a7-254601ef6c44 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:26.699947 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1ccb6216-246d-4a9f-a9a7-254601ef6c44 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:26.700409 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1ccb6216-246d-4a9f-a9a7-254601ef6c44 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:26.700842 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1ccb6216-246d-4a9f-a9a7-254601ef6c44 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:26.888171 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-afca6a4a-d16d-4a29-80cc-a9ca22715971 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:26.891614 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1ccb6216-246d-4a9f-a9a7-254601ef6c44 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:26.897075 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-afca6a4a-d16d-4a29-80cc-a9ca22715971 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1541 microversion: 2.1 time: 0.219294 Sep 24 20:53:26.897671 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 571/1144] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:26 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1541 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:26.900375 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1ccb6216-246d-4a9f-a9a7-254601ef6c44 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1477 microversion: 2.1 time: 0.212972 Sep 24 20:53:26.901165 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 574/1145] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:26 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1477 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:26.902444 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b25b6277-f588-49d3-8acd-00d6772a0f97 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:26.903092 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b25b6277-f588-49d3-8acd-00d6772a0f97 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:26.906186 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:26.910663 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b25b6277-f588-49d3-8acd-00d6772a0f97 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:26.911168 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b25b6277-f588-49d3-8acd-00d6772a0f97 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:26.911615 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b25b6277-f588-49d3-8acd-00d6772a0f97 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:26.912332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b25b6277-f588-49d3-8acd-00d6772a0f97 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:26.912807 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b25b6277-f588-49d3-8acd-00d6772a0f97 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:26.913234 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b25b6277-f588-49d3-8acd-00d6772a0f97 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:26.922850 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e122240c-419f-4894-80dd-108faa2b736f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:26.923478 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e122240c-419f-4894-80dd-108faa2b736f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 7505ad12-d1c7-4dad-b0b8-e797560e5274] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:26.928077 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-b25b6277-f588-49d3-8acd-00d6772a0f97 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] HTTP exception thrown: Instance 500f472e-d914-4eef-b315-7178f06ef6d8 could not be found. Sep 24 20:53:26.929427 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e122240c-419f-4894-80dd-108faa2b736f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:26.929736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b25b6277-f588-49d3-8acd-00d6772a0f97 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Request method failure captured: Sep 24 20:53:26.929736 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 HTTP/1.1 Sep 24 20:53:26.929736 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:53:26.929736 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:53:26.929736 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:53:26.929736 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:53:26.929736 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:53:26.929736 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:53:26.929736 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:53:26.929736 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:53:26.929736 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL23hSaMAKT8B-JdjtYs2UoED1UAMalIeRO9Th3athHCHzrGhfs9Sy0_hBzkoXpxV7aas8iy4VFycxPqE3-ST396dY35DaR9MZAQlds-eQBPgVm84hG8pTTOjeXtJegh8tOCUNbJFm6JLpFNRAi1C2IykufgxtCoO69ROBtQmrT9YEmI Sep 24 20:53:26.929736 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:53:26.929736 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:53:26.929736 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:53:26.929736 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:53:26.929736 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:53:26.929736 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:53:26.929736 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: e175cb4032ec4e6aa900141abbaa04c4 Sep 24 20:53:26.929736 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:53:26.929736 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:53:26.929736 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:53:26.931438 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:53:26.931438 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:53:26.931438 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: e175cb4032ec4e6aa900141abbaa04c4 Sep 24 20:53:26.931438 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:53:26.931438 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ImagesOneServerNegativeTestJSON-1825846347-project Sep 24 20:53:26.931438 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:53:26.931438 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:53:26.931438 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 6db52cb259fa426d860f9c9a48a149f3 Sep 24 20:53:26.931438 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347-project Sep 24 20:53:26.931438 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:53:26.931438 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 500f472e-d914-4eef-b315-7178f06ef6d8 could not be found. Sep 24 20:53:26.931438 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '500f472e-d914-4eef-b315-7178f06ef6d8'} Sep 24 20:53:26.932286 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:53:26.932286 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:26.932286 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:53:26.932286 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:53:26.932286 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:53:26.932286 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:53:26.932286 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:53:26.932286 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:53:26.932286 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:53:26.932286 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:53:26.932286 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 500f472e-d914-4eef-b315-7178f06ef6d8 could not be found. Sep 24 20:53:26.932286 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:53:26.932286 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:53:26.932286 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:53:26.932286 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:26.932286 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:53:26.932286 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:53:26.932286 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:53:26.932286 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:53:26.932286 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:53:26.933788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:53:26.933788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:53:26.933788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:53:26.933788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:53:26.933788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:53:26.933788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:53:26.933788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:53:26.933788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 500f472e-d914-4eef-b315-7178f06ef6d8 could not be found. Sep 24 20:53:26.933788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:53:26.933788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:53:26.933788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:53:26.933788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:26.933788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:53:26.933788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:53:26.933788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:53:26.933788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:53:26.933788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 500f472e-d914-4eef-b315-7178f06ef6d8 could not be found. Sep 24 20:53:26.933788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:53:26.935177 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e122240c-419f-4894-80dd-108faa2b736f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:26.935270 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b25b6277-f588-49d3-8acd-00d6772a0f97 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Returning 404 to user: Instance 500f472e-d914-4eef-b315-7178f06ef6d8 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:53:26.935370 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e122240c-419f-4894-80dd-108faa2b736f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:26.935370 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e122240c-419f-4894-80dd-108faa2b736f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:26.935538 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b25b6277-f588-49d3-8acd-00d6772a0f97 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 404 len: 111 microversion: 2.1 time: 0.032578 Sep 24 20:53:26.935631 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e122240c-419f-4894-80dd-108faa2b736f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:26.935720 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 572/1146] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:26 2022] GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:53:26.935799 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e122240c-419f-4894-80dd-108faa2b736f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:27.006469 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3a5758ee-9db2-421f-8afe-e1d64d5e5a15 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:27.007210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3a5758ee-9db2-421f-8afe-e1d64d5e5a15 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:27.013662 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a5758ee-9db2-421f-8afe-e1d64d5e5a15 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:27.014169 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a5758ee-9db2-421f-8afe-e1d64d5e5a15 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:27.014646 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a5758ee-9db2-421f-8afe-e1d64d5e5a15 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:27.015732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a5758ee-9db2-421f-8afe-e1d64d5e5a15 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:27.016214 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a5758ee-9db2-421f-8afe-e1d64d5e5a15 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:27.016654 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a5758ee-9db2-421f-8afe-e1d64d5e5a15 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:27.092833 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3a5758ee-9db2-421f-8afe-e1d64d5e5a15 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:27.101262 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e122240c-419f-4894-80dd-108faa2b736f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:27.101686 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3a5758ee-9db2-421f-8afe-e1d64d5e5a15 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:27.103179 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3a5758ee-9db2-421f-8afe-e1d64d5e5a15 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:27.108107 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3a5758ee-9db2-421f-8afe-e1d64d5e5a15 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1546 microversion: 2.91 time: 0.106467 Sep 24 20:53:27.108671 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 573/1147] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:27 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1546 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:27.109101 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e122240c-419f-4894-80dd-108faa2b736f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274" status: 200 len: 1316 microversion: 2.1 time: 0.190088 Sep 24 20:53:27.109935 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 575/1148] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:26 2022] GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274 => generated 1316 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:27.113675 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c0da4fce-5742-4ad2-92fc-21c8f458d953 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:27.114405 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c0da4fce-5742-4ad2-92fc-21c8f458d953 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:27.115455 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a2f86de2-98b8-41d0-bc68-c8140420e9e5 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1541781850", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:27.120611 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0da4fce-5742-4ad2-92fc-21c8f458d953 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:27.121211 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0da4fce-5742-4ad2-92fc-21c8f458d953 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:27.121757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0da4fce-5742-4ad2-92fc-21c8f458d953 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:27.122585 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0da4fce-5742-4ad2-92fc-21c8f458d953 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:27.123155 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0da4fce-5742-4ad2-92fc-21c8f458d953 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:27.123688 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0da4fce-5742-4ad2-92fc-21c8f458d953 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:27.172180 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-a2f86de2-98b8-41d0-bc68-c8140420e9e5 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] validate_networks() for [('024c2e10-583d-4d69-82c6-3844b4ef926e', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:53:27.348254 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c0da4fce-5742-4ad2-92fc-21c8f458d953 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:27.360678 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c0da4fce-5742-4ad2-92fc-21c8f458d953 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:27.362394 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c0da4fce-5742-4ad2-92fc-21c8f458d953 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:27.363563 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c0da4fce-5742-4ad2-92fc-21c8f458d953 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1362 microversion: 2.25 time: 0.253966 Sep 24 20:53:27.364195 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 574/1149] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:27 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1362 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:27.481991 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-712fc346-3f9a-4609-872a-8de1c2b707d1 req-bf10bc5d-1d71-4181-91ef-791303b59a50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdb37c4d-e841-4e13-b809-e3f19ce6365a", "name": "network-vif-plugged", "status": "completed", "tag": "fdfbcb27-4de9-4bdc-b3e7-a1d7e89b3236"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:27.492592 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-712fc346-3f9a-4609-872a-8de1c2b707d1 req-bf10bc5d-1d71-4181-91ef-791303b59a50 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:27.493217 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-712fc346-3f9a-4609-872a-8de1c2b707d1 req-bf10bc5d-1d71-4181-91ef-791303b59a50 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:27.493764 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-712fc346-3f9a-4609-872a-8de1c2b707d1 req-bf10bc5d-1d71-4181-91ef-791303b59a50 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:27.497969 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:27.507985 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-712fc346-3f9a-4609-872a-8de1c2b707d1 req-bf10bc5d-1d71-4181-91ef-791303b59a50 service nova] Creating event network-vif-plugged:fdfbcb27-4de9-4bdc-b3e7-a1d7e89b3236 for instance bdb37c4d-e841-4e13-b809-e3f19ce6365a on nch2-master-1 Sep 24 20:53:27.513169 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-712fc346-3f9a-4609-872a-8de1c2b707d1 req-bf10bc5d-1d71-4181-91ef-791303b59a50 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035276 Sep 24 20:53:27.513863 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 575/1150] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:53:27.609907 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-a2f86de2-98b8-41d0-bc68-c8140420e9e5 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:53:27.610386 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-a2f86de2-98b8-41d0-bc68-c8140420e9e5 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:53:27.610894 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-a2f86de2-98b8-41d0-bc68-c8140420e9e5 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:53:27.611818 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-a2f86de2-98b8-41d0-bc68-c8140420e9e5 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:53:27.612656 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-a2f86de2-98b8-41d0-bc68-c8140420e9e5 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:53:27.621663 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2f86de2-98b8-41d0-bc68-c8140420e9e5 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:27.622178 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2f86de2-98b8-41d0-bc68-c8140420e9e5 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:27.622653 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2f86de2-98b8-41d0-bc68-c8140420e9e5 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:27.623385 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2f86de2-98b8-41d0-bc68-c8140420e9e5 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:27.623842 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2f86de2-98b8-41d0-bc68-c8140420e9e5 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:27.624297 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2f86de2-98b8-41d0-bc68-c8140420e9e5 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:27.644426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-a2f86de2-98b8-41d0-bc68-c8140420e9e5 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Getting quotas for project e175cb4032ec4e6aa900141abbaa04c4. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:53:27.649656 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-a2f86de2-98b8-41d0-bc68-c8140420e9e5 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Getting quotas for user 6db52cb259fa426d860f9c9a48a149f3 and project e175cb4032ec4e6aa900141abbaa04c4. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:53:27.663145 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a2f86de2-98b8-41d0-bc68-c8140420e9e5 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:53:27.666096 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a2f86de2-98b8-41d0-bc68-c8140420e9e5 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 3a097c2a-9087-4024-839a-c6b89c95303d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:53:27.716356 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a2f86de2-98b8-41d0-bc68-c8140420e9e5 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.604986 Sep 24 20:53:27.717328 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 576/1151] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:53:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:53:27.729875 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fc4985d4-2a4b-45b7-9017-a22b90ee43ed tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:27.730619 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fc4985d4-2a4b-45b7-9017-a22b90ee43ed tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 3a097c2a-9087-4024-839a-c6b89c95303d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:27.811793 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fc4985d4-2a4b-45b7-9017-a22b90ee43ed tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:27.819905 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fc4985d4-2a4b-45b7-9017-a22b90ee43ed tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d" status: 200 len: 1225 microversion: 2.1 time: 0.095058 Sep 24 20:53:27.820495 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 576/1152] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:27 2022] GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:27.922527 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-527cbe05-930c-46e2-bdc0-0287031f1f73 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:27.923479 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-527cbe05-930c-46e2-bdc0-0287031f1f73 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:27.925091 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2bcf18b9-ae66-4895-84f2-c0d58617e1fc tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:27.925703 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2bcf18b9-ae66-4895-84f2-c0d58617e1fc tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:27.932189 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-527cbe05-930c-46e2-bdc0-0287031f1f73 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:27.932784 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2bcf18b9-ae66-4895-84f2-c0d58617e1fc tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:27.932961 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-527cbe05-930c-46e2-bdc0-0287031f1f73 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:27.933508 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-527cbe05-930c-46e2-bdc0-0287031f1f73 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:27.933710 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2bcf18b9-ae66-4895-84f2-c0d58617e1fc tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:27.934151 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2bcf18b9-ae66-4895-84f2-c0d58617e1fc tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:27.934487 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-527cbe05-930c-46e2-bdc0-0287031f1f73 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:27.934892 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2bcf18b9-ae66-4895-84f2-c0d58617e1fc tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:27.935362 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2bcf18b9-ae66-4895-84f2-c0d58617e1fc tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:27.935560 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-527cbe05-930c-46e2-bdc0-0287031f1f73 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:27.935858 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2bcf18b9-ae66-4895-84f2-c0d58617e1fc tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:27.936096 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-527cbe05-930c-46e2-bdc0-0287031f1f73 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:28.178451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-527cbe05-930c-46e2-bdc0-0287031f1f73 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:28.187635 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-527cbe05-930c-46e2-bdc0-0287031f1f73 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1541 microversion: 2.1 time: 0.269051 Sep 24 20:53:28.188223 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 577/1153] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:27 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1541 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:28.191778 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2bcf18b9-ae66-4895-84f2-c0d58617e1fc tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:28.194324 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3e05b5e3-2ae5-4601-a6c3-95eddd2332ce tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:28.195024 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3e05b5e3-2ae5-4601-a6c3-95eddd2332ce tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 7505ad12-d1c7-4dad-b0b8-e797560e5274] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:28.200607 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2bcf18b9-ae66-4895-84f2-c0d58617e1fc tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1477 microversion: 2.1 time: 0.280429 Sep 24 20:53:28.201267 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 577/1154] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:27 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1477 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:28.206583 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-eed2cde4-8a37-416f-a43f-86653e7ef561 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:28.207184 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3e05b5e3-2ae5-4601-a6c3-95eddd2332ce tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:28.207706 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3e05b5e3-2ae5-4601-a6c3-95eddd2332ce tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:28.208129 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3e05b5e3-2ae5-4601-a6c3-95eddd2332ce tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:28.208268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-eed2cde4-8a37-416f-a43f-86653e7ef561 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:28.208839 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3e05b5e3-2ae5-4601-a6c3-95eddd2332ce tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:28.209298 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3e05b5e3-2ae5-4601-a6c3-95eddd2332ce tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:28.209724 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3e05b5e3-2ae5-4601-a6c3-95eddd2332ce tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:28.216250 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eed2cde4-8a37-416f-a43f-86653e7ef561 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:28.217004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eed2cde4-8a37-416f-a43f-86653e7ef561 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:28.217629 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eed2cde4-8a37-416f-a43f-86653e7ef561 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:28.218598 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eed2cde4-8a37-416f-a43f-86653e7ef561 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:28.219214 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eed2cde4-8a37-416f-a43f-86653e7ef561 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:28.219800 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eed2cde4-8a37-416f-a43f-86653e7ef561 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:28.334014 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-eed2cde4-8a37-416f-a43f-86653e7ef561 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:28.345027 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-eed2cde4-8a37-416f-a43f-86653e7ef561 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:28.347400 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-eed2cde4-8a37-416f-a43f-86653e7ef561 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:28.352747 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-eed2cde4-8a37-416f-a43f-86653e7ef561 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1546 microversion: 2.91 time: 0.150338 Sep 24 20:53:28.353771 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 578/1155] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:28 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1546 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:28.389413 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d2dd89b4-a23f-479a-8b32-dd52c972b0d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:28.390023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d2dd89b4-a23f-479a-8b32-dd52c972b0d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:28.401302 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d2dd89b4-a23f-479a-8b32-dd52c972b0d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:28.401806 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d2dd89b4-a23f-479a-8b32-dd52c972b0d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:28.402249 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d2dd89b4-a23f-479a-8b32-dd52c972b0d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:28.402995 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d2dd89b4-a23f-479a-8b32-dd52c972b0d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:28.403410 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3e05b5e3-2ae5-4601-a6c3-95eddd2332ce tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:28.403549 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d2dd89b4-a23f-479a-8b32-dd52c972b0d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:28.403866 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d2dd89b4-a23f-479a-8b32-dd52c972b0d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:28.413270 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3e05b5e3-2ae5-4601-a6c3-95eddd2332ce tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274" status: 200 len: 1316 microversion: 2.1 time: 0.223371 Sep 24 20:53:28.413781 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 578/1156] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:28 2022] GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274 => generated 1316 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:28.552793 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d2dd89b4-a23f-479a-8b32-dd52c972b0d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:28.561424 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d2dd89b4-a23f-479a-8b32-dd52c972b0d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:28.563002 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d2dd89b4-a23f-479a-8b32-dd52c972b0d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:28.564132 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d2dd89b4-a23f-479a-8b32-dd52c972b0d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1362 microversion: 2.25 time: 0.178931 Sep 24 20:53:28.569150 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 579/1157] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:28 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:53:28.844860 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-53a1d11b-c1ce-4adc-991a-7d841126c21a tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:28.845491 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-53a1d11b-c1ce-4adc-991a-7d841126c21a tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 3a097c2a-9087-4024-839a-c6b89c95303d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:28.853870 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-53a1d11b-c1ce-4adc-991a-7d841126c21a tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:28.854369 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-53a1d11b-c1ce-4adc-991a-7d841126c21a tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:28.854866 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-53a1d11b-c1ce-4adc-991a-7d841126c21a tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:28.855579 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-53a1d11b-c1ce-4adc-991a-7d841126c21a tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:28.856039 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-53a1d11b-c1ce-4adc-991a-7d841126c21a tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:28.856464 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-53a1d11b-c1ce-4adc-991a-7d841126c21a tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:28.859195 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:28.931058 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-53a1d11b-c1ce-4adc-991a-7d841126c21a tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:28.944762 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-53a1d11b-c1ce-4adc-991a-7d841126c21a tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d" status: 200 len: 1221 microversion: 2.1 time: 0.103620 Sep 24 20:53:28.945532 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 579/1158] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:28 2022] GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d => generated 1221 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:29.211155 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e6103ee7-8fa6-4bbe-bc7f-792acd878a75 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:29.212036 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e6103ee7-8fa6-4bbe-bc7f-792acd878a75 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:29.219084 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6103ee7-8fa6-4bbe-bc7f-792acd878a75 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:29.219576 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6103ee7-8fa6-4bbe-bc7f-792acd878a75 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:29.220024 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6103ee7-8fa6-4bbe-bc7f-792acd878a75 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:29.220739 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6103ee7-8fa6-4bbe-bc7f-792acd878a75 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:29.221389 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6103ee7-8fa6-4bbe-bc7f-792acd878a75 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:29.221763 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6103ee7-8fa6-4bbe-bc7f-792acd878a75 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:29.231478 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5cfe6f95-0420-4468-88db-852ff88d845b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:29.232104 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5cfe6f95-0420-4468-88db-852ff88d845b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:29.243032 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5cfe6f95-0420-4468-88db-852ff88d845b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:29.243533 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5cfe6f95-0420-4468-88db-852ff88d845b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:29.250785 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5cfe6f95-0420-4468-88db-852ff88d845b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:29.251698 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5cfe6f95-0420-4468-88db-852ff88d845b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:29.253075 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5cfe6f95-0420-4468-88db-852ff88d845b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:29.253773 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5cfe6f95-0420-4468-88db-852ff88d845b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:29.457757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e6103ee7-8fa6-4bbe-bc7f-792acd878a75 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:29.464767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5cfe6f95-0420-4468-88db-852ff88d845b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:29.466339 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e6103ee7-8fa6-4bbe-bc7f-792acd878a75 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1541 microversion: 2.1 time: 0.258983 Sep 24 20:53:29.467035 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 580/1159] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:29 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1541 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:29.472558 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a292048c-6286-4a99-bbee-811c8c0b31e4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:29.473314 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a292048c-6286-4a99-bbee-811c8c0b31e4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:29.485149 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5cfe6f95-0420-4468-88db-852ff88d845b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1477 microversion: 2.1 time: 0.257505 Sep 24 20:53:29.485849 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 580/1160] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:29 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1477 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:29.490197 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a292048c-6286-4a99-bbee-811c8c0b31e4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:29.490957 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a292048c-6286-4a99-bbee-811c8c0b31e4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:29.491083 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cbcbf5ef-1972-40b6-9690-dec295636a97 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:29.491702 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a292048c-6286-4a99-bbee-811c8c0b31e4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:29.491843 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cbcbf5ef-1972-40b6-9690-dec295636a97 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 7505ad12-d1c7-4dad-b0b8-e797560e5274] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:29.492729 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a292048c-6286-4a99-bbee-811c8c0b31e4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:29.493478 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a292048c-6286-4a99-bbee-811c8c0b31e4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:29.494197 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a292048c-6286-4a99-bbee-811c8c0b31e4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:29.498240 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cbcbf5ef-1972-40b6-9690-dec295636a97 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:29.499094 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cbcbf5ef-1972-40b6-9690-dec295636a97 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:29.500077 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cbcbf5ef-1972-40b6-9690-dec295636a97 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:29.500864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cbcbf5ef-1972-40b6-9690-dec295636a97 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:29.501422 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cbcbf5ef-1972-40b6-9690-dec295636a97 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:29.502449 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cbcbf5ef-1972-40b6-9690-dec295636a97 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:29.602938 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a292048c-6286-4a99-bbee-811c8c0b31e4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:29.613649 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a292048c-6286-4a99-bbee-811c8c0b31e4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:29.615571 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a292048c-6286-4a99-bbee-811c8c0b31e4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:29.621497 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a292048c-6286-4a99-bbee-811c8c0b31e4 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1546 microversion: 2.91 time: 0.153105 Sep 24 20:53:29.622174 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 581/1161] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:29 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1546 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:29.627962 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-47f532ed-1383-431a-afc0-7b92cd683076 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:29.634908 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-47f532ed-1383-431a-afc0-7b92cd683076 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:29.648895 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-47f532ed-1383-431a-afc0-7b92cd683076 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:29.649494 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-47f532ed-1383-431a-afc0-7b92cd683076 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:29.650013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-47f532ed-1383-431a-afc0-7b92cd683076 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:29.650879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-47f532ed-1383-431a-afc0-7b92cd683076 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:29.651415 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-47f532ed-1383-431a-afc0-7b92cd683076 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:29.651923 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-47f532ed-1383-431a-afc0-7b92cd683076 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:29.679975 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cbcbf5ef-1972-40b6-9690-dec295636a97 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:29.691292 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cbcbf5ef-1972-40b6-9690-dec295636a97 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274" status: 200 len: 1316 microversion: 2.1 time: 0.204249 Sep 24 20:53:29.691884 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 581/1162] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:29 2022] GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274 => generated 1316 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:29.790759 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-47f532ed-1383-431a-afc0-7b92cd683076 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:29.801120 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-47f532ed-1383-431a-afc0-7b92cd683076 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:29.804301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-47f532ed-1383-431a-afc0-7b92cd683076 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:29.806635 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-47f532ed-1383-431a-afc0-7b92cd683076 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1362 microversion: 2.25 time: 0.182855 Sep 24 20:53:29.812610 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 582/1163] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:29 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:29.975646 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7e534014-3e05-4a3a-8865-90062b4b5e30 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:29.976190 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7e534014-3e05-4a3a-8865-90062b4b5e30 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 3a097c2a-9087-4024-839a-c6b89c95303d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:29.982780 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7e534014-3e05-4a3a-8865-90062b4b5e30 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:29.983273 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7e534014-3e05-4a3a-8865-90062b4b5e30 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:29.983745 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7e534014-3e05-4a3a-8865-90062b4b5e30 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:29.984489 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7e534014-3e05-4a3a-8865-90062b4b5e30 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:29.984951 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7e534014-3e05-4a3a-8865-90062b4b5e30 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:29.985387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7e534014-3e05-4a3a-8865-90062b4b5e30 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:30.047309 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7e534014-3e05-4a3a-8865-90062b4b5e30 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:30.056102 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7e534014-3e05-4a3a-8865-90062b4b5e30 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d" status: 200 len: 1277 microversion: 2.1 time: 0.084432 Sep 24 20:53:30.056679 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 582/1164] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:29 2022] GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d => generated 1277 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:30.491397 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-06bf8a62-b329-4c84-8d29-385fc9fa0e21 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:30.492452 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-06bf8a62-b329-4c84-8d29-385fc9fa0e21 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:30.505987 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-06bf8a62-b329-4c84-8d29-385fc9fa0e21 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:30.507040 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-06bf8a62-b329-4c84-8d29-385fc9fa0e21 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:30.507743 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-06bf8a62-b329-4c84-8d29-385fc9fa0e21 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:30.508810 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-06bf8a62-b329-4c84-8d29-385fc9fa0e21 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:30.509889 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-06bf8a62-b329-4c84-8d29-385fc9fa0e21 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:30.510668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-06bf8a62-b329-4c84-8d29-385fc9fa0e21 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:30.514810 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3f6acfe4-da2e-4b89-b4bf-d94ec6e2d7d1 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:30.516346 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3f6acfe4-da2e-4b89-b4bf-d94ec6e2d7d1 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:30.524453 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3f6acfe4-da2e-4b89-b4bf-d94ec6e2d7d1 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:30.525052 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3f6acfe4-da2e-4b89-b4bf-d94ec6e2d7d1 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:30.526179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3f6acfe4-da2e-4b89-b4bf-d94ec6e2d7d1 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:30.527031 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3f6acfe4-da2e-4b89-b4bf-d94ec6e2d7d1 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:30.527830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3f6acfe4-da2e-4b89-b4bf-d94ec6e2d7d1 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:30.528000 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3f6acfe4-da2e-4b89-b4bf-d94ec6e2d7d1 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:30.746750 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-06bf8a62-b329-4c84-8d29-385fc9fa0e21 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:30.755182 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-06bf8a62-b329-4c84-8d29-385fc9fa0e21 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1541 microversion: 2.1 time: 0.268435 Sep 24 20:53:30.766636 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 583/1165] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:30 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1541 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:30.766636 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-df208fe5-4e41-4e97-a00b-ec6777c0fe00 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:30.766636 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-df208fe5-4e41-4e97-a00b-ec6777c0fe00 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:30.767327 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df208fe5-4e41-4e97-a00b-ec6777c0fe00 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:30.768364 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df208fe5-4e41-4e97-a00b-ec6777c0fe00 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:30.768823 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df208fe5-4e41-4e97-a00b-ec6777c0fe00 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:30.769534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df208fe5-4e41-4e97-a00b-ec6777c0fe00 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:30.770257 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df208fe5-4e41-4e97-a00b-ec6777c0fe00 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:30.770722 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df208fe5-4e41-4e97-a00b-ec6777c0fe00 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:30.776411 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3f6acfe4-da2e-4b89-b4bf-d94ec6e2d7d1 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:30.784657 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3f6acfe4-da2e-4b89-b4bf-d94ec6e2d7d1 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1462 microversion: 2.1 time: 0.278558 Sep 24 20:53:30.785570 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 583/1166] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:30 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1462 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:30.790531 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6bfb107a-90a1-41a6-bf4d-f7e10b4e7405 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:30.791144 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6bfb107a-90a1-41a6-bf4d-f7e10b4e7405 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 7505ad12-d1c7-4dad-b0b8-e797560e5274] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:30.797632 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6bfb107a-90a1-41a6-bf4d-f7e10b4e7405 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:30.797952 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6bfb107a-90a1-41a6-bf4d-f7e10b4e7405 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:30.798399 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6bfb107a-90a1-41a6-bf4d-f7e10b4e7405 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:30.799932 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6bfb107a-90a1-41a6-bf4d-f7e10b4e7405 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:30.800603 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6bfb107a-90a1-41a6-bf4d-f7e10b4e7405 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:30.801039 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6bfb107a-90a1-41a6-bf4d-f7e10b4e7405 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:30.856715 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-df208fe5-4e41-4e97-a00b-ec6777c0fe00 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:30.869140 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-df208fe5-4e41-4e97-a00b-ec6777c0fe00 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:30.870871 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-df208fe5-4e41-4e97-a00b-ec6777c0fe00 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:30.876209 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-df208fe5-4e41-4e97-a00b-ec6777c0fe00 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1546 microversion: 2.91 time: 0.119105 Sep 24 20:53:30.876919 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 584/1167] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:30 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1546 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:30.895943 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-24574fef-ea08-4fed-bd3f-2d0bd817bff9 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:30.898331 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-24574fef-ea08-4fed-bd3f-2d0bd817bff9 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:30.904302 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24574fef-ea08-4fed-bd3f-2d0bd817bff9 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:30.905332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24574fef-ea08-4fed-bd3f-2d0bd817bff9 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:30.905332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24574fef-ea08-4fed-bd3f-2d0bd817bff9 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:30.905919 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24574fef-ea08-4fed-bd3f-2d0bd817bff9 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:30.906379 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24574fef-ea08-4fed-bd3f-2d0bd817bff9 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:30.906839 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24574fef-ea08-4fed-bd3f-2d0bd817bff9 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:30.971640 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6bfb107a-90a1-41a6-bf4d-f7e10b4e7405 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:30.982639 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6bfb107a-90a1-41a6-bf4d-f7e10b4e7405 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274" status: 200 len: 1316 microversion: 2.1 time: 0.195624 Sep 24 20:53:30.984031 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 584/1168] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:30 2022] GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274 => generated 1316 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:30.998153 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-24574fef-ea08-4fed-bd3f-2d0bd817bff9 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a/action" status: 202 len: 0 microversion: 2.1 time: 0.095905 Sep 24 20:53:30.998153 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 585/1169] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:53:30 2022] POST /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:53:30.998153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-13e57522-7386-47bb-affb-4399b6b4d545 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:30.998153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-13e57522-7386-47bb-affb-4399b6b4d545 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:30.998153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-13e57522-7386-47bb-affb-4399b6b4d545 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:30.998681 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-13e57522-7386-47bb-affb-4399b6b4d545 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:30.998681 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-13e57522-7386-47bb-affb-4399b6b4d545 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:30.998681 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-13e57522-7386-47bb-affb-4399b6b4d545 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:30.998681 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-13e57522-7386-47bb-affb-4399b6b4d545 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:30.998977 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-13e57522-7386-47bb-affb-4399b6b4d545 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:31.007082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a67ff0dc-cab8-44ee-a864-02fd5728fc0a tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:31.007945 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a67ff0dc-cab8-44ee-a864-02fd5728fc0a tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:31.014147 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a67ff0dc-cab8-44ee-a864-02fd5728fc0a tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:31.014892 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a67ff0dc-cab8-44ee-a864-02fd5728fc0a tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:31.015332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a67ff0dc-cab8-44ee-a864-02fd5728fc0a tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:31.016042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a67ff0dc-cab8-44ee-a864-02fd5728fc0a tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:31.016496 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a67ff0dc-cab8-44ee-a864-02fd5728fc0a tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:31.016980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a67ff0dc-cab8-44ee-a864-02fd5728fc0a tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:31.053524 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a67ff0dc-cab8-44ee-a864-02fd5728fc0a tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:31.054119 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a67ff0dc-cab8-44ee-a864-02fd5728fc0a tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:31.054590 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a67ff0dc-cab8-44ee-a864-02fd5728fc0a tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:31.055050 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-a67ff0dc-cab8-44ee-a864-02fd5728fc0a tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lazy-loading 'fault' on Instance uuid bdb37c4d-e841-4e13-b809-e3f19ce6365a {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:53:31.199829 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-13e57522-7386-47bb-affb-4399b6b4d545 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:31.213992 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-13e57522-7386-47bb-affb-4399b6b4d545 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:31.216025 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-13e57522-7386-47bb-affb-4399b6b4d545 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:31.218204 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-13e57522-7386-47bb-affb-4399b6b4d545 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1362 microversion: 2.25 time: 0.232163 Sep 24 20:53:31.219466 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 586/1170] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:30 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:31.225588 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0bc768f4-7079-43b1-a251-6fe30a750c24 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:31.226300 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0bc768f4-7079-43b1-a251-6fe30a750c24 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 3a097c2a-9087-4024-839a-c6b89c95303d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:31.233333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0bc768f4-7079-43b1-a251-6fe30a750c24 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:31.234078 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0bc768f4-7079-43b1-a251-6fe30a750c24 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:31.234623 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0bc768f4-7079-43b1-a251-6fe30a750c24 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:31.235471 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0bc768f4-7079-43b1-a251-6fe30a750c24 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:31.236000 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0bc768f4-7079-43b1-a251-6fe30a750c24 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:31.236574 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0bc768f4-7079-43b1-a251-6fe30a750c24 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:31.248872 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a67ff0dc-cab8-44ee-a864-02fd5728fc0a tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1596 microversion: 2.1 time: 0.248267 Sep 24 20:53:31.250060 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 585/1171] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:30 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1596 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:31.273303 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0dabcf0f-59a9-4a1d-b58d-bb81945dc9c7 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:31.276164 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0dabcf0f-59a9-4a1d-b58d-bb81945dc9c7 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:31.284327 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0dabcf0f-59a9-4a1d-b58d-bb81945dc9c7 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:31.285270 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0dabcf0f-59a9-4a1d-b58d-bb81945dc9c7 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:31.285937 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0dabcf0f-59a9-4a1d-b58d-bb81945dc9c7 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:31.286950 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0dabcf0f-59a9-4a1d-b58d-bb81945dc9c7 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:31.287626 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0dabcf0f-59a9-4a1d-b58d-bb81945dc9c7 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:31.288260 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0dabcf0f-59a9-4a1d-b58d-bb81945dc9c7 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:31.402009 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0dabcf0f-59a9-4a1d-b58d-bb81945dc9c7 tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a/action" status: 202 len: 0 microversion: 2.1 time: 0.132813 Sep 24 20:53:31.403471 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 586/1172] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:53:31 2022] POST /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 20:53:31.412682 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f9a8bc5c-0f67-4a1d-87f1-77bca6e24dec tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:31.413896 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f9a8bc5c-0f67-4a1d-87f1-77bca6e24dec tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:31.415952 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0bc768f4-7079-43b1-a251-6fe30a750c24 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:31.421885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9a8bc5c-0f67-4a1d-87f1-77bca6e24dec tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:31.422486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9a8bc5c-0f67-4a1d-87f1-77bca6e24dec tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:31.423456 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9a8bc5c-0f67-4a1d-87f1-77bca6e24dec tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:31.425471 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9a8bc5c-0f67-4a1d-87f1-77bca6e24dec tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:31.426672 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9a8bc5c-0f67-4a1d-87f1-77bca6e24dec tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:31.427306 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9a8bc5c-0f67-4a1d-87f1-77bca6e24dec tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:31.427943 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0bc768f4-7079-43b1-a251-6fe30a750c24 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d" status: 200 len: 1325 microversion: 2.1 time: 0.206654 Sep 24 20:53:31.428885 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 587/1173] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:31 2022] GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d => generated 1325 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:31.564237 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f9a8bc5c-0f67-4a1d-87f1-77bca6e24dec tempest-ServersAdminTestJSON-1004936758 tempest-ServersAdminTestJSON-1004936758-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1613 microversion: 2.1 time: 0.156819 Sep 24 20:53:31.564863 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 587/1174] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:31 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1613 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:31.587171 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-13109229-e593-4507-bdb3-06f232b26a35 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:31.587693 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-13109229-e593-4507-bdb3-06f232b26a35 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: a44ee230-ea66-4c1b-90e4-4e5a9a0cd994] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:31.594879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-13109229-e593-4507-bdb3-06f232b26a35 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:31.595369 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-13109229-e593-4507-bdb3-06f232b26a35 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:31.595893 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-13109229-e593-4507-bdb3-06f232b26a35 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:31.596639 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-13109229-e593-4507-bdb3-06f232b26a35 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:31.597270 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-13109229-e593-4507-bdb3-06f232b26a35 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:31.597710 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-13109229-e593-4507-bdb3-06f232b26a35 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:31.624815 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-13109229-e593-4507-bdb3-06f232b26a35 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: a44ee230-ea66-4c1b-90e4-4e5a9a0cd994] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:53:31.710071 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-13109229-e593-4507-bdb3-06f232b26a35 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994" status: 204 len: 0 microversion: 2.1 time: 0.126520 Sep 24 20:53:31.713700 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 588/1175] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:53:31 2022] DELETE /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:53:31.719234 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4057ff5a-c1e9-455d-aeaf-522a601f5c05 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:31.719864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4057ff5a-c1e9-455d-aeaf-522a601f5c05 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: a44ee230-ea66-4c1b-90e4-4e5a9a0cd994] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:31.733368 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4057ff5a-c1e9-455d-aeaf-522a601f5c05 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:31.734170 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4057ff5a-c1e9-455d-aeaf-522a601f5c05 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:31.735773 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4057ff5a-c1e9-455d-aeaf-522a601f5c05 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:31.736615 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4057ff5a-c1e9-455d-aeaf-522a601f5c05 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:31.737834 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4057ff5a-c1e9-455d-aeaf-522a601f5c05 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:31.738577 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4057ff5a-c1e9-455d-aeaf-522a601f5c05 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:31.784077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-03eaf3e0-efc6-4080-8aaa-6b931c27f477 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:31.785144 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-03eaf3e0-efc6-4080-8aaa-6b931c27f477 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:31.792284 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-03eaf3e0-efc6-4080-8aaa-6b931c27f477 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:31.792882 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-03eaf3e0-efc6-4080-8aaa-6b931c27f477 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:31.793403 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-03eaf3e0-efc6-4080-8aaa-6b931c27f477 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:31.794205 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-03eaf3e0-efc6-4080-8aaa-6b931c27f477 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:31.794774 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-03eaf3e0-efc6-4080-8aaa-6b931c27f477 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:31.795392 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-03eaf3e0-efc6-4080-8aaa-6b931c27f477 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:31.970337 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4057ff5a-c1e9-455d-aeaf-522a601f5c05 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:31.994390 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4057ff5a-c1e9-455d-aeaf-522a601f5c05 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994" status: 200 len: 1470 microversion: 2.1 time: 0.279088 Sep 24 20:53:31.996956 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 588/1176] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:31 2022] GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 => generated 1470 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:31.998851 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-03eaf3e0-efc6-4080-8aaa-6b931c27f477 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:32.001838 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-cbd2e44f-b0b7-4415-a222-57dda5c054e6 req-08e591fc-67b9-4f43-ba77-360e8c459ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7505ad12-d1c7-4dad-b0b8-e797560e5274", "name": "network-vif-plugged", "status": "completed", "tag": "a03de1a2-dcb4-4c5f-9261-079c2c97a272"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:32.008587 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-03eaf3e0-efc6-4080-8aaa-6b931c27f477 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1541 microversion: 2.1 time: 0.229047 Sep 24 20:53:32.010084 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 589/1177] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:31 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1541 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:32.016822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7b1f6dba-98f2-43d3-af46-40ef3dbf26aa tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:32.017734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7b1f6dba-98f2-43d3-af46-40ef3dbf26aa tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:32.025568 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b1f6dba-98f2-43d3-af46-40ef3dbf26aa tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:32.026339 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b1f6dba-98f2-43d3-af46-40ef3dbf26aa tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:32.027235 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b1f6dba-98f2-43d3-af46-40ef3dbf26aa tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:32.027815 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b1f6dba-98f2-43d3-af46-40ef3dbf26aa tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:32.028449 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b1f6dba-98f2-43d3-af46-40ef3dbf26aa tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:32.029506 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b1f6dba-98f2-43d3-af46-40ef3dbf26aa tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:32.030768 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-cbd2e44f-b0b7-4415-a222-57dda5c054e6 req-08e591fc-67b9-4f43-ba77-360e8c459ce7 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:32.031480 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-cbd2e44f-b0b7-4415-a222-57dda5c054e6 req-08e591fc-67b9-4f43-ba77-360e8c459ce7 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:32.034582 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-cbd2e44f-b0b7-4415-a222-57dda5c054e6 req-08e591fc-67b9-4f43-ba77-360e8c459ce7 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:32.050428 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-cbd2e44f-b0b7-4415-a222-57dda5c054e6 req-08e591fc-67b9-4f43-ba77-360e8c459ce7 service nova] Creating event network-vif-plugged:a03de1a2-dcb4-4c5f-9261-079c2c97a272 for instance 7505ad12-d1c7-4dad-b0b8-e797560e5274 on nch2-master-1 Sep 24 20:53:32.055794 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-cbd2e44f-b0b7-4415-a222-57dda5c054e6 req-08e591fc-67b9-4f43-ba77-360e8c459ce7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057628 Sep 24 20:53:32.056245 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:32.056789 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 589/1178] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:53:32.062238 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c74c13b9-d537-47b2-80b0-7d7c8c4e485d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:32.063203 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c74c13b9-d537-47b2-80b0-7d7c8c4e485d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 7505ad12-d1c7-4dad-b0b8-e797560e5274] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:32.070114 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c74c13b9-d537-47b2-80b0-7d7c8c4e485d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:32.070933 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c74c13b9-d537-47b2-80b0-7d7c8c4e485d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:32.071522 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c74c13b9-d537-47b2-80b0-7d7c8c4e485d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:32.072374 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c74c13b9-d537-47b2-80b0-7d7c8c4e485d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:32.073013 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c74c13b9-d537-47b2-80b0-7d7c8c4e485d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:32.073675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c74c13b9-d537-47b2-80b0-7d7c8c4e485d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:32.116375 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7b1f6dba-98f2-43d3-af46-40ef3dbf26aa tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:32.125952 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7b1f6dba-98f2-43d3-af46-40ef3dbf26aa tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:32.127950 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7b1f6dba-98f2-43d3-af46-40ef3dbf26aa tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:32.136015 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7b1f6dba-98f2-43d3-af46-40ef3dbf26aa tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1546 microversion: 2.91 time: 0.124136 Sep 24 20:53:32.144542 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 590/1179] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:32 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1546 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:32.215758 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c74c13b9-d537-47b2-80b0-7d7c8c4e485d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:32.224271 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c74c13b9-d537-47b2-80b0-7d7c8c4e485d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274" status: 200 len: 1316 microversion: 2.1 time: 0.166126 Sep 24 20:53:32.224852 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 590/1180] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:32 2022] GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274 => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:32.243990 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d6ed1c93-a21a-4242-a6a2-3ea7f2c30f8f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:32.244616 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d6ed1c93-a21a-4242-a6a2-3ea7f2c30f8f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:32.250589 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6ed1c93-a21a-4242-a6a2-3ea7f2c30f8f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:32.251081 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6ed1c93-a21a-4242-a6a2-3ea7f2c30f8f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:32.251522 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6ed1c93-a21a-4242-a6a2-3ea7f2c30f8f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:32.252443 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6ed1c93-a21a-4242-a6a2-3ea7f2c30f8f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:32.252914 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6ed1c93-a21a-4242-a6a2-3ea7f2c30f8f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:32.253344 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6ed1c93-a21a-4242-a6a2-3ea7f2c30f8f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:32.293766 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-19e32eee-1631-4145-8c52-fd8206ec79bd req-64ccf8c6-c61b-4f6c-b664-afe87332af5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a097c2a-9087-4024-839a-c6b89c95303d", "tag": "28f41adb-fd88-48bb-bbc8-d02f980738c3"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:32.303827 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-19e32eee-1631-4145-8c52-fd8206ec79bd req-64ccf8c6-c61b-4f6c-b664-afe87332af5b service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:32.304328 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-19e32eee-1631-4145-8c52-fd8206ec79bd req-64ccf8c6-c61b-4f6c-b664-afe87332af5b service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:32.304756 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-19e32eee-1631-4145-8c52-fd8206ec79bd req-64ccf8c6-c61b-4f6c-b664-afe87332af5b service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:32.317187 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-19e32eee-1631-4145-8c52-fd8206ec79bd req-64ccf8c6-c61b-4f6c-b664-afe87332af5b service nova] Creating event network-changed:28f41adb-fd88-48bb-bbc8-d02f980738c3 for instance 3a097c2a-9087-4024-839a-c6b89c95303d on nch2-master-1 Sep 24 20:53:32.322597 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-19e32eee-1631-4145-8c52-fd8206ec79bd req-64ccf8c6-c61b-4f6c-b664-afe87332af5b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031950 Sep 24 20:53:32.323160 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 591/1181] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:53:32.390964 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d6ed1c93-a21a-4242-a6a2-3ea7f2c30f8f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:32.400289 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d6ed1c93-a21a-4242-a6a2-3ea7f2c30f8f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:32.401795 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d6ed1c93-a21a-4242-a6a2-3ea7f2c30f8f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:32.403032 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d6ed1c93-a21a-4242-a6a2-3ea7f2c30f8f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1362 microversion: 2.25 time: 0.162962 Sep 24 20:53:32.403602 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 591/1182] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:32 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:32.451989 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-93ac15b8-373f-4565-877f-1eea82ef2110 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:32.452699 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-93ac15b8-373f-4565-877f-1eea82ef2110 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 3a097c2a-9087-4024-839a-c6b89c95303d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:32.459613 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93ac15b8-373f-4565-877f-1eea82ef2110 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:32.460100 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93ac15b8-373f-4565-877f-1eea82ef2110 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:32.460564 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93ac15b8-373f-4565-877f-1eea82ef2110 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:32.461266 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93ac15b8-373f-4565-877f-1eea82ef2110 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:32.461727 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93ac15b8-373f-4565-877f-1eea82ef2110 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:32.462157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93ac15b8-373f-4565-877f-1eea82ef2110 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:32.595606 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-93ac15b8-373f-4565-877f-1eea82ef2110 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:32.603834 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-93ac15b8-373f-4565-877f-1eea82ef2110 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d" status: 200 len: 1325 microversion: 2.1 time: 0.156125 Sep 24 20:53:32.604414 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 592/1183] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:32 2022] GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d => generated 1325 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:33.022214 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9a2031d2-4deb-4a5d-bc5e-8d8200f2e066 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:33.022886 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9a2031d2-4deb-4a5d-bc5e-8d8200f2e066 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: a44ee230-ea66-4c1b-90e4-4e5a9a0cd994] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:33.029942 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a2031d2-4deb-4a5d-bc5e-8d8200f2e066 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:33.030448 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a2031d2-4deb-4a5d-bc5e-8d8200f2e066 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:33.030906 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a2031d2-4deb-4a5d-bc5e-8d8200f2e066 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:33.031624 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a2031d2-4deb-4a5d-bc5e-8d8200f2e066 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:33.032083 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a2031d2-4deb-4a5d-bc5e-8d8200f2e066 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:33.032533 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a2031d2-4deb-4a5d-bc5e-8d8200f2e066 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:33.037077 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-95f8730e-e252-41a4-b121-d304621c2356 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:33.037813 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-95f8730e-e252-41a4-b121-d304621c2356 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:33.045070 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-95f8730e-e252-41a4-b121-d304621c2356 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:33.045794 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-95f8730e-e252-41a4-b121-d304621c2356 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:33.046417 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-95f8730e-e252-41a4-b121-d304621c2356 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:33.047438 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-95f8730e-e252-41a4-b121-d304621c2356 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:33.048012 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-95f8730e-e252-41a4-b121-d304621c2356 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:33.048593 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-95f8730e-e252-41a4-b121-d304621c2356 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:33.269048 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9a2031d2-4deb-4a5d-bc5e-8d8200f2e066 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:33.277811 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9a2031d2-4deb-4a5d-bc5e-8d8200f2e066 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994" status: 200 len: 1470 microversion: 2.1 time: 0.259695 Sep 24 20:53:33.278330 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 592/1184] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:33 2022] GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 => generated 1470 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:33.283002 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-95f8730e-e252-41a4-b121-d304621c2356 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:33.283798 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2c25d0f7-c92e-4883-a842-8a9a458c02f3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:33.291778 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2c25d0f7-c92e-4883-a842-8a9a458c02f3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:33.293229 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-95f8730e-e252-41a4-b121-d304621c2356 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1541 microversion: 2.1 time: 0.260226 Sep 24 20:53:33.294061 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 593/1185] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:33 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1541 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:33.299095 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-96951452-f68a-4a1d-9c7a-c821c8047c98 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:33.300515 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-96951452-f68a-4a1d-9c7a-c821c8047c98 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 7505ad12-d1c7-4dad-b0b8-e797560e5274] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:33.307034 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96951452-f68a-4a1d-9c7a-c821c8047c98 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:33.307614 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96951452-f68a-4a1d-9c7a-c821c8047c98 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:33.308133 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96951452-f68a-4a1d-9c7a-c821c8047c98 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:33.308912 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96951452-f68a-4a1d-9c7a-c821c8047c98 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:33.309445 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96951452-f68a-4a1d-9c7a-c821c8047c98 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:33.309945 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96951452-f68a-4a1d-9c7a-c821c8047c98 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:33.311594 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c25d0f7-c92e-4883-a842-8a9a458c02f3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:33.312101 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c25d0f7-c92e-4883-a842-8a9a458c02f3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:33.312560 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c25d0f7-c92e-4883-a842-8a9a458c02f3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:33.313440 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c25d0f7-c92e-4883-a842-8a9a458c02f3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:33.314060 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c25d0f7-c92e-4883-a842-8a9a458c02f3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:33.315937 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c25d0f7-c92e-4883-a842-8a9a458c02f3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:33.405460 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2c25d0f7-c92e-4883-a842-8a9a458c02f3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:33.414435 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2c25d0f7-c92e-4883-a842-8a9a458c02f3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:33.415975 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2c25d0f7-c92e-4883-a842-8a9a458c02f3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:33.421025 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2c25d0f7-c92e-4883-a842-8a9a458c02f3 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1546 microversion: 2.91 time: 0.141677 Sep 24 20:53:33.421618 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 593/1186] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:33 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1546 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:33.435738 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f43ab597-a8ad-414b-ae41-5587918fddd5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:33.436351 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f43ab597-a8ad-414b-ae41-5587918fddd5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:33.443276 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f43ab597-a8ad-414b-ae41-5587918fddd5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:33.443768 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f43ab597-a8ad-414b-ae41-5587918fddd5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:33.444215 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f43ab597-a8ad-414b-ae41-5587918fddd5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:33.444948 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f43ab597-a8ad-414b-ae41-5587918fddd5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:33.445407 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f43ab597-a8ad-414b-ae41-5587918fddd5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:33.445841 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f43ab597-a8ad-414b-ae41-5587918fddd5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:33.479540 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-96951452-f68a-4a1d-9c7a-c821c8047c98 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:33.488306 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-96951452-f68a-4a1d-9c7a-c821c8047c98 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274" status: 200 len: 1316 microversion: 2.1 time: 0.192970 Sep 24 20:53:33.488890 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 594/1187] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:33 2022] GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274 => generated 1316 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:33.577548 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f43ab597-a8ad-414b-ae41-5587918fddd5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:33.587792 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f43ab597-a8ad-414b-ae41-5587918fddd5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:33.589314 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f43ab597-a8ad-414b-ae41-5587918fddd5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:33.590576 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f43ab597-a8ad-414b-ae41-5587918fddd5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1559 microversion: 2.25 time: 0.158750 Sep 24 20:53:33.591158 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 594/1188] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:33 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:53:33.615175 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-129409fa-e42f-410e-8d51-0903c9ad09ec tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:33.615806 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-129409fa-e42f-410e-8d51-0903c9ad09ec tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:33.621706 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-129409fa-e42f-410e-8d51-0903c9ad09ec tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:33.622418 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-129409fa-e42f-410e-8d51-0903c9ad09ec tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:33.622699 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-129409fa-e42f-410e-8d51-0903c9ad09ec tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:33.623414 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-129409fa-e42f-410e-8d51-0903c9ad09ec tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:33.623886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-129409fa-e42f-410e-8d51-0903c9ad09ec tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:33.624324 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-129409fa-e42f-410e-8d51-0903c9ad09ec tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:33.629102 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:33.635726 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fbf613ce-b554-4cf9-9916-412ba86291c1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:33.636359 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fbf613ce-b554-4cf9-9916-412ba86291c1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 3a097c2a-9087-4024-839a-c6b89c95303d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:33.643866 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fbf613ce-b554-4cf9-9916-412ba86291c1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:33.644377 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fbf613ce-b554-4cf9-9916-412ba86291c1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:33.645206 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fbf613ce-b554-4cf9-9916-412ba86291c1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:33.646396 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fbf613ce-b554-4cf9-9916-412ba86291c1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:33.646396 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fbf613ce-b554-4cf9-9916-412ba86291c1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:33.646916 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fbf613ce-b554-4cf9-9916-412ba86291c1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:33.839833 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-129409fa-e42f-410e-8d51-0903c9ad09ec tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lazy-loading 'services' on Instance uuid 03612730-8fd5-4006-aa0a-0c90feb1ea64 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:53:33.840707 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fbf613ce-b554-4cf9-9916-412ba86291c1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:33.850377 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fbf613ce-b554-4cf9-9916-412ba86291c1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d" status: 200 len: 1325 microversion: 2.1 time: 0.225511 Sep 24 20:53:33.851439 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 595/1189] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:33 2022] GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d => generated 1325 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:33.854386 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-129409fa-e42f-410e-8d51-0903c9ad09ec tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 2052 microversion: 2.25 time: 0.243387 Sep 24 20:53:33.855000 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 595/1190] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:33 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 2052 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:33.879906 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2013306a-ebc5-43ac-8e74-3dba91a89e6c tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:33.880525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2013306a-ebc5-43ac-8e74-3dba91a89e6c tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:33.886650 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2013306a-ebc5-43ac-8e74-3dba91a89e6c tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:33.887134 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2013306a-ebc5-43ac-8e74-3dba91a89e6c tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:33.887572 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2013306a-ebc5-43ac-8e74-3dba91a89e6c tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:33.888263 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2013306a-ebc5-43ac-8e74-3dba91a89e6c tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:33.888719 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2013306a-ebc5-43ac-8e74-3dba91a89e6c tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:33.889146 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2013306a-ebc5-43ac-8e74-3dba91a89e6c tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:34.018665 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-2013306a-ebc5-43ac-8e74-3dba91a89e6c tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lazy-loading 'services' on Instance uuid 03612730-8fd5-4006-aa0a-0c90feb1ea64 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:53:34.033301 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2013306a-ebc5-43ac-8e74-3dba91a89e6c tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 2052 microversion: 2.25 time: 0.157726 Sep 24 20:53:34.034268 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 596/1191] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:33 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 2052 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:53:34.057883 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2aa0827c-af0e-4d58-aa63-0adc9aa2c91b tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:34.061646 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2aa0827c-af0e-4d58-aa63-0adc9aa2c91b tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:34.062143 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2aa0827c-af0e-4d58-aa63-0adc9aa2c91b tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:34.062613 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2aa0827c-af0e-4d58-aa63-0adc9aa2c91b tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:34.063392 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2aa0827c-af0e-4d58-aa63-0adc9aa2c91b tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:34.063856 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2aa0827c-af0e-4d58-aa63-0adc9aa2c91b tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:34.064286 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2aa0827c-af0e-4d58-aa63-0adc9aa2c91b tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:34.091940 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2aa0827c-af0e-4d58-aa63-0adc9aa2c91b tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.037941 Sep 24 20:53:34.092562 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 596/1192] 10.222.0.52 () {60 vars in 1217 bytes} [Sat Sep 24 20:53:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:53:34.105563 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e814635c-0c64-4dd4-8dea-6f8c9baa4287 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:34.106112 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e814635c-0c64-4dd4-8dea-6f8c9baa4287 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:34.113114 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e814635c-0c64-4dd4-8dea-6f8c9baa4287 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:34.113727 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e814635c-0c64-4dd4-8dea-6f8c9baa4287 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:34.114164 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e814635c-0c64-4dd4-8dea-6f8c9baa4287 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:34.114897 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e814635c-0c64-4dd4-8dea-6f8c9baa4287 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:34.115351 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e814635c-0c64-4dd4-8dea-6f8c9baa4287 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:34.115774 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e814635c-0c64-4dd4-8dea-6f8c9baa4287 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:34.190265 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e814635c-0c64-4dd4-8dea-6f8c9baa4287 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64/action" status: 202 len: 0 microversion: 2.25 time: 0.088334 Sep 24 20:53:34.191187 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 597/1193] 10.222.0.52 () {62 vars in 1319 bytes} [Sat Sep 24 20:53:34 2022] POST /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:53:34.199232 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3cdb6965-1842-4a9b-9f41-26cfcb815e56 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:34.199855 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3cdb6965-1842-4a9b-9f41-26cfcb815e56 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:34.206452 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3cdb6965-1842-4a9b-9f41-26cfcb815e56 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:34.207000 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3cdb6965-1842-4a9b-9f41-26cfcb815e56 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:34.207435 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3cdb6965-1842-4a9b-9f41-26cfcb815e56 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:34.208142 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3cdb6965-1842-4a9b-9f41-26cfcb815e56 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:34.208605 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3cdb6965-1842-4a9b-9f41-26cfcb815e56 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:34.209060 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3cdb6965-1842-4a9b-9f41-26cfcb815e56 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:34.302431 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b76e768e-94e0-41c5-b373-6d052a68f0ac tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:34.303502 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b76e768e-94e0-41c5-b373-6d052a68f0ac tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: a44ee230-ea66-4c1b-90e4-4e5a9a0cd994] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:34.310971 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b76e768e-94e0-41c5-b373-6d052a68f0ac tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:34.312408 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b76e768e-94e0-41c5-b373-6d052a68f0ac tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:34.312408 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b76e768e-94e0-41c5-b373-6d052a68f0ac tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:34.312651 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b76e768e-94e0-41c5-b373-6d052a68f0ac tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:34.313119 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b76e768e-94e0-41c5-b373-6d052a68f0ac tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:34.313590 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b76e768e-94e0-41c5-b373-6d052a68f0ac tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:34.364642 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-3cdb6965-1842-4a9b-9f41-26cfcb815e56 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lazy-loading 'services' on Instance uuid 03612730-8fd5-4006-aa0a-0c90feb1ea64 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:53:34.385974 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3cdb6965-1842-4a9b-9f41-26cfcb815e56 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 2057 microversion: 2.25 time: 0.190508 Sep 24 20:53:34.399488 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 597/1194] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:34 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 2057 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:34.415004 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3c20ca39-4644-4ed2-98d7-8aedac266c1f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:34.415836 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3c20ca39-4644-4ed2-98d7-8aedac266c1f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:34.422350 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c20ca39-4644-4ed2-98d7-8aedac266c1f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:34.423094 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c20ca39-4644-4ed2-98d7-8aedac266c1f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:34.423711 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c20ca39-4644-4ed2-98d7-8aedac266c1f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:34.425845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c20ca39-4644-4ed2-98d7-8aedac266c1f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:34.426484 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c20ca39-4644-4ed2-98d7-8aedac266c1f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:34.427171 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c20ca39-4644-4ed2-98d7-8aedac266c1f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:34.484618 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b76e768e-94e0-41c5-b373-6d052a68f0ac tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:34.493926 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b76e768e-94e0-41c5-b373-6d052a68f0ac tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994" status: 200 len: 1470 microversion: 2.1 time: 0.196478 Sep 24 20:53:34.503281 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 598/1195] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:34 2022] GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 => generated 1470 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:34.503281 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-071c7230-8d90-41a7-9a80-0933be2e4e80 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:34.503281 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-071c7230-8d90-41a7-9a80-0933be2e4e80 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:34.508076 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-071c7230-8d90-41a7-9a80-0933be2e4e80 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:34.508755 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-071c7230-8d90-41a7-9a80-0933be2e4e80 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:34.509393 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-071c7230-8d90-41a7-9a80-0933be2e4e80 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:34.510695 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-071c7230-8d90-41a7-9a80-0933be2e4e80 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:34.511422 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-071c7230-8d90-41a7-9a80-0933be2e4e80 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:34.512391 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-071c7230-8d90-41a7-9a80-0933be2e4e80 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:34.600218 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-071c7230-8d90-41a7-9a80-0933be2e4e80 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:34.605521 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3c20ca39-4644-4ed2-98d7-8aedac266c1f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:34.615936 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-071c7230-8d90-41a7-9a80-0933be2e4e80 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:34.618471 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-071c7230-8d90-41a7-9a80-0933be2e4e80 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:34.620064 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3c20ca39-4644-4ed2-98d7-8aedac266c1f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1541 microversion: 2.1 time: 0.218961 Sep 24 20:53:34.621026 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 598/1196] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:34 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1541 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:34.641650 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8f7fbb14-8c96-4bb3-b8bd-7179d620e08b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:34.644163 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8f7fbb14-8c96-4bb3-b8bd-7179d620e08b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 7505ad12-d1c7-4dad-b0b8-e797560e5274] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:34.647883 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-071c7230-8d90-41a7-9a80-0933be2e4e80 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1546 microversion: 2.91 time: 0.150947 Sep 24 20:53:34.650546 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 599/1197] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:34 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1546 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:34.651417 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8f7fbb14-8c96-4bb3-b8bd-7179d620e08b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:34.651914 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8f7fbb14-8c96-4bb3-b8bd-7179d620e08b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:34.652409 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8f7fbb14-8c96-4bb3-b8bd-7179d620e08b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:34.653814 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8f7fbb14-8c96-4bb3-b8bd-7179d620e08b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:34.654283 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8f7fbb14-8c96-4bb3-b8bd-7179d620e08b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:34.654931 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8f7fbb14-8c96-4bb3-b8bd-7179d620e08b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:34.744408 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-b8d63a66-b7a8-4de9-bea5-e2f1c5739954 req-4551218c-224e-44a3-a626-081c289c09e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a44ee230-ea66-4c1b-90e4-4e5a9a0cd994", "name": "network-vif-deleted", "tag": "1d87750d-071a-4b4c-9e13-ddf06bb0283b"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:34.767213 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-b8d63a66-b7a8-4de9-bea5-e2f1c5739954 req-4551218c-224e-44a3-a626-081c289c09e5 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:34.772268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-b8d63a66-b7a8-4de9-bea5-e2f1c5739954 req-4551218c-224e-44a3-a626-081c289c09e5 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:34.772775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-b8d63a66-b7a8-4de9-bea5-e2f1c5739954 req-4551218c-224e-44a3-a626-081c289c09e5 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:34.789350 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-b8d63a66-b7a8-4de9-bea5-e2f1c5739954 req-4551218c-224e-44a3-a626-081c289c09e5 service nova] Creating event network-vif-deleted:1d87750d-071a-4b4c-9e13-ddf06bb0283b for instance a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 on nch2-master-1 Sep 24 20:53:34.795253 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-b8d63a66-b7a8-4de9-bea5-e2f1c5739954 req-4551218c-224e-44a3-a626-081c289c09e5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054585 Sep 24 20:53:34.796817 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 600/1198] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:53:34.845446 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8f7fbb14-8c96-4bb3-b8bd-7179d620e08b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:34.857011 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8f7fbb14-8c96-4bb3-b8bd-7179d620e08b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274" status: 200 len: 1316 microversion: 2.1 time: 0.234913 Sep 24 20:53:34.857862 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 599/1199] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:34 2022] GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274 => generated 1316 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:34.878955 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c490e56d-7b5d-4776-b8e0-251f639d473f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:34.879688 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c490e56d-7b5d-4776-b8e0-251f639d473f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 3a097c2a-9087-4024-839a-c6b89c95303d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:34.889289 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c490e56d-7b5d-4776-b8e0-251f639d473f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:34.890014 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c490e56d-7b5d-4776-b8e0-251f639d473f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:34.890237 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c490e56d-7b5d-4776-b8e0-251f639d473f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:34.893257 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c490e56d-7b5d-4776-b8e0-251f639d473f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:34.893833 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c490e56d-7b5d-4776-b8e0-251f639d473f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:34.894397 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c490e56d-7b5d-4776-b8e0-251f639d473f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:35.059164 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c490e56d-7b5d-4776-b8e0-251f639d473f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:35.073865 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c490e56d-7b5d-4776-b8e0-251f639d473f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d" status: 200 len: 1325 microversion: 2.1 time: 0.201719 Sep 24 20:53:35.074512 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 601/1200] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:34 2022] GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d => generated 1325 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:35.416133 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ccd82247-b9b2-4b91-89a4-48bcf6a894e0 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:35.416762 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ccd82247-b9b2-4b91-89a4-48bcf6a894e0 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:35.423880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ccd82247-b9b2-4b91-89a4-48bcf6a894e0 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:35.424958 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ccd82247-b9b2-4b91-89a4-48bcf6a894e0 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:35.425506 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ccd82247-b9b2-4b91-89a4-48bcf6a894e0 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:35.426213 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ccd82247-b9b2-4b91-89a4-48bcf6a894e0 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:35.426706 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ccd82247-b9b2-4b91-89a4-48bcf6a894e0 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:35.427135 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ccd82247-b9b2-4b91-89a4-48bcf6a894e0 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:35.521459 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7e13d0e3-62ba-42ba-a4d6-592f1fbf727a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:35.522345 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7e13d0e3-62ba-42ba-a4d6-592f1fbf727a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: a44ee230-ea66-4c1b-90e4-4e5a9a0cd994] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:35.528458 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7e13d0e3-62ba-42ba-a4d6-592f1fbf727a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:35.528952 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7e13d0e3-62ba-42ba-a4d6-592f1fbf727a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:35.529481 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7e13d0e3-62ba-42ba-a4d6-592f1fbf727a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:35.530687 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7e13d0e3-62ba-42ba-a4d6-592f1fbf727a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:35.531180 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7e13d0e3-62ba-42ba-a4d6-592f1fbf727a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:35.531668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7e13d0e3-62ba-42ba-a4d6-592f1fbf727a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:35.560571 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-ccd82247-b9b2-4b91-89a4-48bcf6a894e0 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lazy-loading 'services' on Instance uuid 03612730-8fd5-4006-aa0a-0c90feb1ea64 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:53:35.572567 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7e13d0e3-62ba-42ba-a4d6-592f1fbf727a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:35.573174 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7e13d0e3-62ba-42ba-a4d6-592f1fbf727a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:35.573604 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7e13d0e3-62ba-42ba-a4d6-592f1fbf727a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:35.574057 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-7e13d0e3-62ba-42ba-a4d6-592f1fbf727a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lazy-loading 'fault' on Instance uuid a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:53:35.574272 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ccd82247-b9b2-4b91-89a4-48bcf6a894e0 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 2037 microversion: 2.25 time: 0.162075 Sep 24 20:53:35.575129 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 600/1201] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:35 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 2037 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:35.599882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-81353ba0-929c-4ade-9a78-957535868bfb tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:35.602416 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-81353ba0-929c-4ade-9a78-957535868bfb tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:35.608468 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81353ba0-929c-4ade-9a78-957535868bfb tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:35.609003 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81353ba0-929c-4ade-9a78-957535868bfb tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:35.609399 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81353ba0-929c-4ade-9a78-957535868bfb tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:35.610096 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81353ba0-929c-4ade-9a78-957535868bfb tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:35.610580 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81353ba0-929c-4ade-9a78-957535868bfb tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:35.611009 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81353ba0-929c-4ade-9a78-957535868bfb tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:35.614848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7e13d0e3-62ba-42ba-a4d6-592f1fbf727a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:35.622642 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7e13d0e3-62ba-42ba-a4d6-592f1fbf727a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994" status: 200 len: 1304 microversion: 2.1 time: 0.105829 Sep 24 20:53:35.623331 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 602/1202] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:35 2022] GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:35.637389 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-81353ba0-929c-4ade-9a78-957535868bfb tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lazy-loading 'flavor' on Instance uuid 03612730-8fd5-4006-aa0a-0c90feb1ea64 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:53:35.646954 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-22243b29-d51b-4cbc-99f8-34ee9a9ff41f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:35.647570 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-22243b29-d51b-4cbc-99f8-34ee9a9ff41f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:35.650804 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-81353ba0-929c-4ade-9a78-957535868bfb tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Going to try to live migrate instance to nch2-master-1 {{(pid=140516) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 24 20:53:35.653420 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22243b29-d51b-4cbc-99f8-34ee9a9ff41f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:35.654108 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22243b29-d51b-4cbc-99f8-34ee9a9ff41f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:35.654586 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22243b29-d51b-4cbc-99f8-34ee9a9ff41f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:35.655295 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22243b29-d51b-4cbc-99f8-34ee9a9ff41f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:35.655761 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22243b29-d51b-4cbc-99f8-34ee9a9ff41f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:35.656194 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22243b29-d51b-4cbc-99f8-34ee9a9ff41f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:36.063240 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-22243b29-d51b-4cbc-99f8-34ee9a9ff41f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:36.073112 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-22243b29-d51b-4cbc-99f8-34ee9a9ff41f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1541 microversion: 2.1 time: 0.430233 Sep 24 20:53:36.074349 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 603/1203] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:35 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1541 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:36.079844 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e261a33b-aece-4075-9fa7-32db02742eef tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:36.081508 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e261a33b-aece-4075-9fa7-32db02742eef tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:36.087657 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e261a33b-aece-4075-9fa7-32db02742eef tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:36.097637 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e261a33b-aece-4075-9fa7-32db02742eef tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:36.098106 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e261a33b-aece-4075-9fa7-32db02742eef tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:36.098961 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e261a33b-aece-4075-9fa7-32db02742eef tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:36.109884 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e261a33b-aece-4075-9fa7-32db02742eef tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:36.110591 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e261a33b-aece-4075-9fa7-32db02742eef tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:36.185685 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e261a33b-aece-4075-9fa7-32db02742eef tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:36.195270 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e261a33b-aece-4075-9fa7-32db02742eef tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:36.196732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e261a33b-aece-4075-9fa7-32db02742eef tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:36.201839 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e261a33b-aece-4075-9fa7-32db02742eef tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1533 microversion: 2.91 time: 0.126251 Sep 24 20:53:36.202407 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 604/1204] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:36 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1533 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:36.207025 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1b7ce95e-b4b6-4d00-933f-abe4852447b9 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:36.207640 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1b7ce95e-b4b6-4d00-933f-abe4852447b9 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 7505ad12-d1c7-4dad-b0b8-e797560e5274] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:36.213775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1b7ce95e-b4b6-4d00-933f-abe4852447b9 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:36.214258 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1b7ce95e-b4b6-4d00-933f-abe4852447b9 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:36.214761 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1b7ce95e-b4b6-4d00-933f-abe4852447b9 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:36.215467 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1b7ce95e-b4b6-4d00-933f-abe4852447b9 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:36.215934 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1b7ce95e-b4b6-4d00-933f-abe4852447b9 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:36.216364 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1b7ce95e-b4b6-4d00-933f-abe4852447b9 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:36.349872 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1b7ce95e-b4b6-4d00-933f-abe4852447b9 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:36.357784 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1b7ce95e-b4b6-4d00-933f-abe4852447b9 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274" status: 200 len: 1466 microversion: 2.1 time: 0.154232 Sep 24 20:53:36.358359 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 605/1205] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:36 2022] GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274 => generated 1466 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:36.363160 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6d045f84-ecb2-4a3b-9858-01cad8d6e330 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:36.363808 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6d045f84-ecb2-4a3b-9858-01cad8d6e330 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 3a097c2a-9087-4024-839a-c6b89c95303d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:36.371069 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6d045f84-ecb2-4a3b-9858-01cad8d6e330 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:36.371566 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6d045f84-ecb2-4a3b-9858-01cad8d6e330 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:36.372016 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6d045f84-ecb2-4a3b-9858-01cad8d6e330 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:36.372730 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6d045f84-ecb2-4a3b-9858-01cad8d6e330 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:36.373203 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6d045f84-ecb2-4a3b-9858-01cad8d6e330 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:36.373638 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6d045f84-ecb2-4a3b-9858-01cad8d6e330 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:36.376531 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:36.508910 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6d045f84-ecb2-4a3b-9858-01cad8d6e330 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:36.516748 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6d045f84-ecb2-4a3b-9858-01cad8d6e330 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d" status: 200 len: 1325 microversion: 2.1 time: 0.157416 Sep 24 20:53:36.517344 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 606/1206] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:36 2022] GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d => generated 1325 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:36.522539 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-78272d0c-d6c0-43ed-b55a-c3ad78366513 tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:36.523153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-78272d0c-d6c0-43ed-b55a-c3ad78366513 tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:36.528713 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78272d0c-d6c0-43ed-b55a-c3ad78366513 tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:36.529200 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78272d0c-d6c0-43ed-b55a-c3ad78366513 tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:36.529644 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78272d0c-d6c0-43ed-b55a-c3ad78366513 tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:36.530339 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78272d0c-d6c0-43ed-b55a-c3ad78366513 tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:36.530829 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78272d0c-d6c0-43ed-b55a-c3ad78366513 tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:36.531261 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78272d0c-d6c0-43ed-b55a-c3ad78366513 tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:36.644405 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-78272d0c-d6c0-43ed-b55a-c3ad78366513 tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] Lazy-loading 'services' on Instance uuid fafd445e-572c-4300-9433-f0d9a628df5e {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:53:36.662055 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-78272d0c-d6c0-43ed-b55a-c3ad78366513 tempest-UnshelveToHostMultiNodesTest-1271281294 tempest-UnshelveToHostMultiNodesTest-1271281294-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1938 microversion: 2.91 time: 0.143084 Sep 24 20:53:36.662744 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 607/1207] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:36 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1938 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:36.667089 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-066e48da-4331-4370-9761-2a00524bbf03 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:36.667696 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-066e48da-4331-4370-9761-2a00524bbf03 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] [instance: 7505ad12-d1c7-4dad-b0b8-e797560e5274] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:36.670181 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:36.674765 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-066e48da-4331-4370-9761-2a00524bbf03 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:36.675254 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-066e48da-4331-4370-9761-2a00524bbf03 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:36.675689 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-066e48da-4331-4370-9761-2a00524bbf03 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:36.676411 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-066e48da-4331-4370-9761-2a00524bbf03 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:36.676865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-066e48da-4331-4370-9761-2a00524bbf03 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:36.677294 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-066e48da-4331-4370-9761-2a00524bbf03 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:36.802555 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-066e48da-4331-4370-9761-2a00524bbf03 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274" status: 200 len: 1617 microversion: 2.1 time: 0.138618 Sep 24 20:53:36.803143 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 608/1208] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:36 2022] GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274 => generated 1617 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:36.807756 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2d196f82-1e6a-4c18-9f61-ab1ce4a02f8b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:36.808369 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2d196f82-1e6a-4c18-9f61-ab1ce4a02f8b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: a44ee230-ea66-4c1b-90e4-4e5a9a0cd994] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:36.813902 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d196f82-1e6a-4c18-9f61-ab1ce4a02f8b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:36.814392 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d196f82-1e6a-4c18-9f61-ab1ce4a02f8b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:36.815434 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d196f82-1e6a-4c18-9f61-ab1ce4a02f8b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:36.816327 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d196f82-1e6a-4c18-9f61-ab1ce4a02f8b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:36.816794 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d196f82-1e6a-4c18-9f61-ab1ce4a02f8b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:36.817230 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d196f82-1e6a-4c18-9f61-ab1ce4a02f8b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:36.849325 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d196f82-1e6a-4c18-9f61-ab1ce4a02f8b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:36.849968 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d196f82-1e6a-4c18-9f61-ab1ce4a02f8b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:36.850459 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d196f82-1e6a-4c18-9f61-ab1ce4a02f8b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:36.851087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-2d196f82-1e6a-4c18-9f61-ab1ce4a02f8b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lazy-loading 'fault' on Instance uuid a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:53:36.894055 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2d196f82-1e6a-4c18-9f61-ab1ce4a02f8b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:36.902068 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2d196f82-1e6a-4c18-9f61-ab1ce4a02f8b tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994" status: 200 len: 1304 microversion: 2.1 time: 0.097968 Sep 24 20:53:36.902681 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 609/1209] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:36 2022] GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:36.907111 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-138d6658-4557-4275-9b82-5427c789e925 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:36.907608 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-138d6658-4557-4275-9b82-5427c789e925 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:36.913192 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-138d6658-4557-4275-9b82-5427c789e925 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:36.913684 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-138d6658-4557-4275-9b82-5427c789e925 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:36.914137 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-138d6658-4557-4275-9b82-5427c789e925 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:36.914880 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-138d6658-4557-4275-9b82-5427c789e925 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:36.915345 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-138d6658-4557-4275-9b82-5427c789e925 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:36.915781 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-138d6658-4557-4275-9b82-5427c789e925 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:36.944541 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-138d6658-4557-4275-9b82-5427c789e925 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:53:37.019568 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-138d6658-4557-4275-9b82-5427c789e925 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 204 len: 0 microversion: 2.91 time: 0.115577 Sep 24 20:53:37.020683 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 610/1210] 10.222.0.52 () {60 vars in 1280 bytes} [Sat Sep 24 20:53:36 2022] DELETE /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 24 20:53:37.028992 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-68359517-ebc9-4ab5-8711-16714db43e76 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-314028097", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["a74d1c4c-d757-4879-a35d-9f817ea6e28b"]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:37.086421 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-68359517-ebc9-4ab5-8711-16714db43e76 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] validate_networks() for None {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:53:37.391821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-68359517-ebc9-4ab5-8711-16714db43e76 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:53:37.392254 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-68359517-ebc9-4ab5-8711-16714db43e76 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:53:37.392774 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-68359517-ebc9-4ab5-8711-16714db43e76 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:53:37.393193 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-68359517-ebc9-4ab5-8711-16714db43e76 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:53:37.393616 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-68359517-ebc9-4ab5-8711-16714db43e76 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:53:37.402838 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68359517-ebc9-4ab5-8711-16714db43e76 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:37.403328 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68359517-ebc9-4ab5-8711-16714db43e76 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:37.403774 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68359517-ebc9-4ab5-8711-16714db43e76 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:37.404537 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68359517-ebc9-4ab5-8711-16714db43e76 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:37.405005 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68359517-ebc9-4ab5-8711-16714db43e76 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:37.405440 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68359517-ebc9-4ab5-8711-16714db43e76 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:37.422444 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-68359517-ebc9-4ab5-8711-16714db43e76 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Getting quotas for project 73bec7c48b07450f95a29a35e113153d. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:53:37.428101 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-68359517-ebc9-4ab5-8711-16714db43e76 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Getting quotas for user 936372eff4da45e281fc5512632a12b6 and project 73bec7c48b07450f95a29a35e113153d. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:53:37.440968 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-68359517-ebc9-4ab5-8711-16714db43e76 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:53:37.443427 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-68359517-ebc9-4ab5-8711-16714db43e76 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:53:37.490141 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-68359517-ebc9-4ab5-8711-16714db43e76 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.466083 Sep 24 20:53:37.490832 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 611/1211] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:53:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:53:37.495842 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-133f49e0-b1c3-499a-8eba-edd1b0a18847 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:37.496392 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-133f49e0-b1c3-499a-8eba-edd1b0a18847 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:37.503896 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-133f49e0-b1c3-499a-8eba-edd1b0a18847 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:37.504390 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-133f49e0-b1c3-499a-8eba-edd1b0a18847 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:37.504838 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-133f49e0-b1c3-499a-8eba-edd1b0a18847 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:37.505601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-133f49e0-b1c3-499a-8eba-edd1b0a18847 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:37.506055 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-133f49e0-b1c3-499a-8eba-edd1b0a18847 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:37.506487 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-133f49e0-b1c3-499a-8eba-edd1b0a18847 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:37.571773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-133f49e0-b1c3-499a-8eba-edd1b0a18847 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:37.579982 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-133f49e0-b1c3-499a-8eba-edd1b0a18847 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:37.581462 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-133f49e0-b1c3-499a-8eba-edd1b0a18847 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:37.586571 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-133f49e0-b1c3-499a-8eba-edd1b0a18847 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.094691 Sep 24 20:53:37.587146 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 612/1212] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:37 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:37.591559 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-901b7299-9d4e-4410-9dd2-714c98de7bee tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:37.592177 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-901b7299-9d4e-4410-9dd2-714c98de7bee tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:37.598018 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-901b7299-9d4e-4410-9dd2-714c98de7bee tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:37.598531 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-901b7299-9d4e-4410-9dd2-714c98de7bee tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:37.598989 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-901b7299-9d4e-4410-9dd2-714c98de7bee tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:37.599697 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-901b7299-9d4e-4410-9dd2-714c98de7bee tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:37.600169 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-901b7299-9d4e-4410-9dd2-714c98de7bee tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:37.600604 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-901b7299-9d4e-4410-9dd2-714c98de7bee tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:37.657126 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:37.755568 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-901b7299-9d4e-4410-9dd2-714c98de7bee tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:37.764218 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-901b7299-9d4e-4410-9dd2-714c98de7bee tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1541 microversion: 2.1 time: 0.175847 Sep 24 20:53:37.764937 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 613/1213] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:37 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1541 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:37.770235 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b58c0148-3891-4d8a-b4c8-660a1ec3a1af tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:37.771023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b58c0148-3891-4d8a-b4c8-660a1ec3a1af tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:37.843531 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b58c0148-3891-4d8a-b4c8-660a1ec3a1af tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:37.850985 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b58c0148-3891-4d8a-b4c8-660a1ec3a1af tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d" status: 200 len: 1216 microversion: 2.1 time: 0.085027 Sep 24 20:53:37.851563 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 614/1214] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:37 2022] GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d => generated 1216 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:37.856174 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3e23b65f-c898-42ee-863b-3d566ed40611 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:37.856819 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3e23b65f-c898-42ee-863b-3d566ed40611 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 3a097c2a-9087-4024-839a-c6b89c95303d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:37.867116 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e23b65f-c898-42ee-863b-3d566ed40611 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:37.867614 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e23b65f-c898-42ee-863b-3d566ed40611 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:37.868119 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e23b65f-c898-42ee-863b-3d566ed40611 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:37.868772 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e23b65f-c898-42ee-863b-3d566ed40611 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:37.869270 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e23b65f-c898-42ee-863b-3d566ed40611 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:37.869653 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e23b65f-c898-42ee-863b-3d566ed40611 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:38.007383 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3e23b65f-c898-42ee-863b-3d566ed40611 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:38.015148 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3e23b65f-c898-42ee-863b-3d566ed40611 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d" status: 200 len: 1325 microversion: 2.1 time: 0.162642 Sep 24 20:53:38.015723 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 615/1215] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:37 2022] GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d => generated 1325 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:38.020946 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6fb4a232-4974-4228-8a8e-52ec6f7bfac8 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:38.021554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6fb4a232-4974-4228-8a8e-52ec6f7bfac8 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: a44ee230-ea66-4c1b-90e4-4e5a9a0cd994] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:38.027550 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6fb4a232-4974-4228-8a8e-52ec6f7bfac8 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:38.028195 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6fb4a232-4974-4228-8a8e-52ec6f7bfac8 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:38.028967 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6fb4a232-4974-4228-8a8e-52ec6f7bfac8 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:38.030197 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6fb4a232-4974-4228-8a8e-52ec6f7bfac8 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:38.031095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6fb4a232-4974-4228-8a8e-52ec6f7bfac8 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:38.031904 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6fb4a232-4974-4228-8a8e-52ec6f7bfac8 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:38.069023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6fb4a232-4974-4228-8a8e-52ec6f7bfac8 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:38.069512 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6fb4a232-4974-4228-8a8e-52ec6f7bfac8 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:38.069976 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6fb4a232-4974-4228-8a8e-52ec6f7bfac8 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:38.070427 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-6fb4a232-4974-4228-8a8e-52ec6f7bfac8 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lazy-loading 'fault' on Instance uuid a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:53:38.110288 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6fb4a232-4974-4228-8a8e-52ec6f7bfac8 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:38.118670 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6fb4a232-4974-4228-8a8e-52ec6f7bfac8 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994" status: 200 len: 1304 microversion: 2.1 time: 0.101985 Sep 24 20:53:38.119234 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 616/1216] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:38 2022] GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:38.613958 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f96028e9-ed26-4245-9ef4-20d6525dd592 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:38.614621 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f96028e9-ed26-4245-9ef4-20d6525dd592 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:38.620807 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f96028e9-ed26-4245-9ef4-20d6525dd592 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:38.621304 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f96028e9-ed26-4245-9ef4-20d6525dd592 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:38.621750 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f96028e9-ed26-4245-9ef4-20d6525dd592 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:38.622473 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f96028e9-ed26-4245-9ef4-20d6525dd592 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:38.622964 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f96028e9-ed26-4245-9ef4-20d6525dd592 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:38.623406 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f96028e9-ed26-4245-9ef4-20d6525dd592 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:38.713759 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f96028e9-ed26-4245-9ef4-20d6525dd592 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:38.723687 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f96028e9-ed26-4245-9ef4-20d6525dd592 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:38.725330 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f96028e9-ed26-4245-9ef4-20d6525dd592 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df2631dab974889a95bed3f863c0219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899574bf215744b29695dc6128d4c8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:38.730917 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f96028e9-ed26-4245-9ef4-20d6525dd592 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 200 len: 1539 microversion: 2.91 time: 0.121349 Sep 24 20:53:38.738877 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 617/1217] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:38 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 1539 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:53:38.789992 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dc512e71-d3bf-44ac-8d0e-6d32f632d80b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:38.791290 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dc512e71-d3bf-44ac-8d0e-6d32f632d80b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:38.797377 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc512e71-d3bf-44ac-8d0e-6d32f632d80b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:38.797865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc512e71-d3bf-44ac-8d0e-6d32f632d80b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:38.798299 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc512e71-d3bf-44ac-8d0e-6d32f632d80b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:38.799667 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc512e71-d3bf-44ac-8d0e-6d32f632d80b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:38.800132 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc512e71-d3bf-44ac-8d0e-6d32f632d80b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:38.800565 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc512e71-d3bf-44ac-8d0e-6d32f632d80b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:38.984934 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dc512e71-d3bf-44ac-8d0e-6d32f632d80b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:38.994331 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dc512e71-d3bf-44ac-8d0e-6d32f632d80b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1541 microversion: 2.1 time: 0.208165 Sep 24 20:53:38.995158 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 618/1218] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:38 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1541 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:39.006270 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1839c7f0-585c-421a-bece-16c8dde9830c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:39.007008 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1839c7f0-585c-421a-bece-16c8dde9830c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:39.015571 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1839c7f0-585c-421a-bece-16c8dde9830c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:39.016075 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1839c7f0-585c-421a-bece-16c8dde9830c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:39.016516 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1839c7f0-585c-421a-bece-16c8dde9830c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:39.017236 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1839c7f0-585c-421a-bece-16c8dde9830c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:39.018262 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1839c7f0-585c-421a-bece-16c8dde9830c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:39.019205 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1839c7f0-585c-421a-bece-16c8dde9830c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:39.097590 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1839c7f0-585c-421a-bece-16c8dde9830c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:39.106831 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1839c7f0-585c-421a-bece-16c8dde9830c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d" status: 200 len: 1212 microversion: 2.1 time: 0.105785 Sep 24 20:53:39.114552 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 619/1219] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:38 2022] GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d => generated 1212 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:39.114552 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4819e2c3-be3d-4498-af39-9c4ed31baabf tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:39.114552 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4819e2c3-be3d-4498-af39-9c4ed31baabf tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 3a097c2a-9087-4024-839a-c6b89c95303d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:39.119994 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4819e2c3-be3d-4498-af39-9c4ed31baabf tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:39.120610 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4819e2c3-be3d-4498-af39-9c4ed31baabf tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:39.121112 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4819e2c3-be3d-4498-af39-9c4ed31baabf tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:39.121886 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4819e2c3-be3d-4498-af39-9c4ed31baabf tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:39.122401 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4819e2c3-be3d-4498-af39-9c4ed31baabf tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:39.123322 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4819e2c3-be3d-4498-af39-9c4ed31baabf tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:39.168336 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-81353ba0-929c-4ade-9a78-957535868bfb tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64/action" status: 202 len: 0 microversion: 2.25 time: 3.573004 Sep 24 20:53:39.169793 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 601/1220] 10.222.0.52 () {62 vars in 1319 bytes} [Sat Sep 24 20:53:35 2022] POST /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64/action => generated 0 bytes in 3575 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 24 20:53:39.176299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cef67934-a68f-4af0-9e59-82c6ae464d85 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:39.177220 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cef67934-a68f-4af0-9e59-82c6ae464d85 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: a44ee230-ea66-4c1b-90e4-4e5a9a0cd994] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:39.187302 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cef67934-a68f-4af0-9e59-82c6ae464d85 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:39.188244 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cef67934-a68f-4af0-9e59-82c6ae464d85 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:39.188958 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cef67934-a68f-4af0-9e59-82c6ae464d85 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:39.191979 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cef67934-a68f-4af0-9e59-82c6ae464d85 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:39.192867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cef67934-a68f-4af0-9e59-82c6ae464d85 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:39.193758 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cef67934-a68f-4af0-9e59-82c6ae464d85 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:39.212495 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-cef67934-a68f-4af0-9e59-82c6ae464d85 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] HTTP exception thrown: Instance a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 could not be found. Sep 24 20:53:39.214712 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cef67934-a68f-4af0-9e59-82c6ae464d85 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Request method failure captured: Sep 24 20:53:39.214712 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 HTTP/1.1 Sep 24 20:53:39.214712 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:53:39.214712 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:53:39.214712 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:53:39.214712 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:53:39.214712 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:53:39.214712 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:53:39.214712 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:53:39.214712 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:53:39.214712 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL22349FckTD92VIwVmq_7U3_xHrtSalVhtGML1KoGIVoVE94cuLvDEWEYrWE9AD5dP6r_cMifUfMZmyzidYy76wL-h5OBqP5hcT-U3m-xAdwkbFv-YQOyPV1rw9xNmw_Bz_qeXJLB4GbguLfjKYiHpSMzsZck8ktZer4jjeXGzr4tkY Sep 24 20:53:39.214712 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:53:39.214712 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:53:39.214712 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:53:39.214712 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:53:39.214712 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:53:39.214712 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:53:39.214712 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 5e68660c954f47f9bad1f7bee17f9435 Sep 24 20:53:39.214712 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersAdminTestJSON-1944287898 Sep 24 20:53:39.214712 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:53:39.214712 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:53:39.216416 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5e68660c954f47f9bad1f7bee17f9435"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5e68660c954f47f9bad1f7bee17f9435"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5e68660c954f47f9bad1f7bee17f9435"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5e68660c954f47f9bad1f7bee17f9435"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:53:39.216416 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersAdminTestJSON-1944287898 Sep 24 20:53:39.216416 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 5e68660c954f47f9bad1f7bee17f9435 Sep 24 20:53:39.216416 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersAdminTestJSON-1944287898 Sep 24 20:53:39.216416 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersAdminTestJSON-1944287898-project Sep 24 20:53:39.216416 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:53:39.216416 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:53:39.216416 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 9eec3a30bcc641ca8ecee19471007b1d Sep 24 20:53:39.216416 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersAdminTestJSON-1944287898-project Sep 24 20:53:39.216416 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:53:39.216416 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 could not be found. Sep 24 20:53:39.216416 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'a44ee230-ea66-4c1b-90e4-4e5a9a0cd994'} Sep 24 20:53:39.217310 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:53:39.217310 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:39.217310 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:53:39.217310 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:53:39.217310 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:53:39.217310 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:53:39.217310 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:53:39.217310 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:53:39.217310 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:53:39.217310 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:53:39.217310 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 could not be found. Sep 24 20:53:39.217310 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:39.217310 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:53:39.217310 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:39.217310 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:39.217310 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:53:39.217310 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:53:39.217310 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:53:39.217310 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:53:39.217310 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:53:39.218888 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:53:39.218888 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:53:39.218888 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:53:39.218888 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:53:39.218888 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:53:39.218888 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:53:39.218888 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:53:39.218888 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 could not be found. Sep 24 20:53:39.218888 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:39.218888 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:53:39.218888 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:39.218888 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:39.218888 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:53:39.218888 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:53:39.218888 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:53:39.218888 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:53:39.218888 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 could not be found. Sep 24 20:53:39.218888 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:39.220091 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cef67934-a68f-4af0-9e59-82c6ae464d85 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Returning 404 to user: Instance a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:53:39.220091 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cef67934-a68f-4af0-9e59-82c6ae464d85 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994" status: 404 len: 111 microversion: 2.1 time: 0.047440 Sep 24 20:53:39.223850 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 602/1221] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:39 2022] GET /compute/v2.1/servers/a44ee230-ea66-4c1b-90e4-4e5a9a0cd994 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:53:39.232412 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c888560a-c611-495c-a4a7-ab95912b9d79 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:39.233301 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c888560a-c611-495c-a4a7-ab95912b9d79 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:39.240573 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:39.242793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c888560a-c611-495c-a4a7-ab95912b9d79 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:39.243635 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c888560a-c611-495c-a4a7-ab95912b9d79 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:39.244271 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c888560a-c611-495c-a4a7-ab95912b9d79 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:39.245207 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c888560a-c611-495c-a4a7-ab95912b9d79 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:39.245856 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c888560a-c611-495c-a4a7-ab95912b9d79 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:39.246475 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c888560a-c611-495c-a4a7-ab95912b9d79 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:39.340190 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4819e2c3-be3d-4498-af39-9c4ed31baabf tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:39.349386 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4819e2c3-be3d-4498-af39-9c4ed31baabf tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d" status: 200 len: 1325 microversion: 2.1 time: 0.240574 Sep 24 20:53:39.350190 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 620/1222] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:39 2022] GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d => generated 1325 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:39.355113 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a81edc35-3cd6-4ae4-bd04-d7c6807704ef tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:39.355639 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a81edc35-3cd6-4ae4-bd04-d7c6807704ef tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: 95aa2033-71b1-41a6-b583-2fd183c18242] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:39.362406 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a81edc35-3cd6-4ae4-bd04-d7c6807704ef tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:39.362965 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a81edc35-3cd6-4ae4-bd04-d7c6807704ef tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:39.363409 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a81edc35-3cd6-4ae4-bd04-d7c6807704ef tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:39.364126 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a81edc35-3cd6-4ae4-bd04-d7c6807704ef tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:39.364611 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a81edc35-3cd6-4ae4-bd04-d7c6807704ef tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:39.365104 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a81edc35-3cd6-4ae4-bd04-d7c6807704ef tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:39.400846 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a81edc35-3cd6-4ae4-bd04-d7c6807704ef tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: 95aa2033-71b1-41a6-b583-2fd183c18242] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:53:39.404904 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:39.411120 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c888560a-c611-495c-a4a7-ab95912b9d79 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:39.434561 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c888560a-c611-495c-a4a7-ab95912b9d79 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:39.438530 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c888560a-c611-495c-a4a7-ab95912b9d79 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:39.441962 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c888560a-c611-495c-a4a7-ab95912b9d79 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1569 microversion: 2.25 time: 0.216903 Sep 24 20:53:39.447894 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 603/1223] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:39 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1569 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:39.513842 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a81edc35-3cd6-4ae4-bd04-d7c6807704ef tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "DELETE /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242" status: 204 len: 0 microversion: 2.1 time: 0.162334 Sep 24 20:53:39.514513 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 621/1224] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:53:39 2022] DELETE /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:53:39.523597 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5491616f-fdf2-4b33-95d6-dd7c41e2f1ad tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:39.524486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5491616f-fdf2-4b33-95d6-dd7c41e2f1ad tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: 95aa2033-71b1-41a6-b583-2fd183c18242] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:39.532979 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5491616f-fdf2-4b33-95d6-dd7c41e2f1ad tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:39.534285 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5491616f-fdf2-4b33-95d6-dd7c41e2f1ad tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:39.534980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5491616f-fdf2-4b33-95d6-dd7c41e2f1ad tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:39.535872 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5491616f-fdf2-4b33-95d6-dd7c41e2f1ad tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:39.536334 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5491616f-fdf2-4b33-95d6-dd7c41e2f1ad tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:39.536931 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5491616f-fdf2-4b33-95d6-dd7c41e2f1ad tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:39.673033 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5491616f-fdf2-4b33-95d6-dd7c41e2f1ad tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:39.681482 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5491616f-fdf2-4b33-95d6-dd7c41e2f1ad tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242" status: 200 len: 1469 microversion: 2.1 time: 0.162313 Sep 24 20:53:39.682046 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 604/1225] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:39 2022] GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242 => generated 1469 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:39.759559 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-858b7f2e-135c-490b-884a-7fca0d29fb15 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:39.760242 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-858b7f2e-135c-490b-884a-7fca0d29fb15 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] [instance: fafd445e-572c-4300-9433-f0d9a628df5e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:39.766349 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-858b7f2e-135c-490b-884a-7fca0d29fb15 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:39.766862 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-858b7f2e-135c-490b-884a-7fca0d29fb15 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:39.767301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-858b7f2e-135c-490b-884a-7fca0d29fb15 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:39.768711 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-858b7f2e-135c-490b-884a-7fca0d29fb15 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:39.769174 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-858b7f2e-135c-490b-884a-7fca0d29fb15 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:39.769618 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-858b7f2e-135c-490b-884a-7fca0d29fb15 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:39.784694 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-858b7f2e-135c-490b-884a-7fca0d29fb15 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] HTTP exception thrown: Instance fafd445e-572c-4300-9433-f0d9a628df5e could not be found. Sep 24 20:53:39.786347 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-858b7f2e-135c-490b-884a-7fca0d29fb15 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Request method failure captured: Sep 24 20:53:39.786347 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e HTTP/1.1 Sep 24 20:53:39.786347 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:53:39.786347 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:53:39.786347 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:53:39.786347 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:53:39.786347 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:53:39.786347 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:53:39.786347 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:53:39.786347 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:53:39.786347 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL22YrklXBNxC0Tqb8dCbFyZqHIYqYKYLxu8Bw9XWxGmngm5VhzodlGqBHrW-cRAhi92fIORz_BcMvoV797A5bdCyQ5iFXEB9gvksm4E6umII7BBC6bdbhpJXN35OKUwFTlokBxs4aQn_WSWdpxcSIy865okHmHn2xvLTxJbXPpvuRTc Sep 24 20:53:39.786347 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:53:39.786347 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:53:39.786347 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:53:39.786347 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:53:39.786347 ncdv-master-1 devstack@n-api.service[140517]: X-Openstack-Nova-Api-Version: 2.91 Sep 24 20:53:39.786347 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:53:39.786347 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:53:39.786347 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 899574bf215744b29695dc6128d4c8dd Sep 24 20:53:39.786347 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-175512859 Sep 24 20:53:39.786347 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:53:39.786347 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:53:39.787998 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/899574bf215744b29695dc6128d4c8dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_899574bf215744b29695dc6128d4c8dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/899574bf215744b29695dc6128d4c8dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/899574bf215744b29695dc6128d4c8dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:53:39.787998 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-175512859 Sep 24 20:53:39.787998 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 899574bf215744b29695dc6128d4c8dd Sep 24 20:53:39.787998 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-175512859 Sep 24 20:53:39.787998 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-UnshelveToHostMultiNodesTest-175512859-project Sep 24 20:53:39.787998 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:53:39.787998 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:53:39.787998 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 8df2631dab974889a95bed3f863c0219 Sep 24 20:53:39.787998 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-175512859-project Sep 24 20:53:39.787998 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:53:39.787998 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance fafd445e-572c-4300-9433-f0d9a628df5e could not be found. Sep 24 20:53:39.787998 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'fafd445e-572c-4300-9433-f0d9a628df5e'} Sep 24 20:53:39.788833 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:53:39.788833 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:39.788833 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:53:39.788833 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:53:39.788833 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:53:39.788833 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:53:39.788833 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:53:39.788833 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:53:39.788833 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:53:39.788833 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:53:39.788833 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fafd445e-572c-4300-9433-f0d9a628df5e could not be found. Sep 24 20:53:39.788833 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:53:39.788833 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:53:39.788833 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:53:39.788833 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:39.788833 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:53:39.788833 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:53:39.788833 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:53:39.788833 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:53:39.788833 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:53:39.790135 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:53:39.790135 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:53:39.790135 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:53:39.790135 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:53:39.790135 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:53:39.790135 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:53:39.790135 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:53:39.790135 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fafd445e-572c-4300-9433-f0d9a628df5e could not be found. Sep 24 20:53:39.790135 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:53:39.790135 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:53:39.790135 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:53:39.790135 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:39.790135 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:53:39.790135 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:53:39.790135 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:53:39.790135 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:53:39.790135 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fafd445e-572c-4300-9433-f0d9a628df5e could not be found. Sep 24 20:53:39.790135 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:53:39.791441 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-858b7f2e-135c-490b-884a-7fca0d29fb15 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] Returning 404 to user: Instance fafd445e-572c-4300-9433-f0d9a628df5e could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:53:39.791441 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-858b7f2e-135c-490b-884a-7fca0d29fb15 tempest-UnshelveToHostMultiNodesTest-175512859 tempest-UnshelveToHostMultiNodesTest-175512859-project] 10.222.0.52 "GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e" status: 404 len: 111 microversion: 2.91 time: 0.032662 Sep 24 20:53:39.791441 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 622/1226] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:39 2022] GET /compute/v2.1/servers/fafd445e-572c-4300-9433-f0d9a628df5e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 24 20:53:40.019092 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-77193866-88b5-4a6a-a743-8db30225acf9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:40.019859 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-77193866-88b5-4a6a-a743-8db30225acf9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:40.026463 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-77193866-88b5-4a6a-a743-8db30225acf9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:40.026994 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-77193866-88b5-4a6a-a743-8db30225acf9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:40.027439 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-77193866-88b5-4a6a-a743-8db30225acf9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:40.028157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-77193866-88b5-4a6a-a743-8db30225acf9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:40.028623 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-77193866-88b5-4a6a-a743-8db30225acf9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:40.029054 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-77193866-88b5-4a6a-a743-8db30225acf9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:40.131480 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c0a1c7f2-0d8f-4083-afe5-2ae313f53bcc tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:40.132167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c0a1c7f2-0d8f-4083-afe5-2ae313f53bcc tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:40.149141 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0a1c7f2-0d8f-4083-afe5-2ae313f53bcc tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:40.150016 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0a1c7f2-0d8f-4083-afe5-2ae313f53bcc tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:40.150560 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0a1c7f2-0d8f-4083-afe5-2ae313f53bcc tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:40.151519 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0a1c7f2-0d8f-4083-afe5-2ae313f53bcc tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:40.152058 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0a1c7f2-0d8f-4083-afe5-2ae313f53bcc tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:40.152565 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0a1c7f2-0d8f-4083-afe5-2ae313f53bcc tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:40.215092 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-77193866-88b5-4a6a-a743-8db30225acf9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:40.223384 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-77193866-88b5-4a6a-a743-8db30225acf9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1541 microversion: 2.1 time: 0.209598 Sep 24 20:53:40.224063 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 605/1227] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:40 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1541 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:40.238903 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c0a1c7f2-0d8f-4083-afe5-2ae313f53bcc tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:40.247131 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c0a1c7f2-0d8f-4083-afe5-2ae313f53bcc tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d" status: 200 len: 1212 microversion: 2.1 time: 0.120309 Sep 24 20:53:40.247704 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 623/1228] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:40 2022] GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d => generated 1212 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:40.375530 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4f0a43ba-fc76-4ad8-8439-b37b00b1843f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:40.376692 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4f0a43ba-fc76-4ad8-8439-b37b00b1843f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 3a097c2a-9087-4024-839a-c6b89c95303d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:40.383458 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f0a43ba-fc76-4ad8-8439-b37b00b1843f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:40.384192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f0a43ba-fc76-4ad8-8439-b37b00b1843f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:40.384643 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f0a43ba-fc76-4ad8-8439-b37b00b1843f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:40.385364 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f0a43ba-fc76-4ad8-8439-b37b00b1843f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:40.385833 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f0a43ba-fc76-4ad8-8439-b37b00b1843f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:40.386369 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f0a43ba-fc76-4ad8-8439-b37b00b1843f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:40.474392 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fccbd34e-77ec-41c5-9ae1-b960e40974ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:40.475253 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fccbd34e-77ec-41c5-9ae1-b960e40974ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:40.482479 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fccbd34e-77ec-41c5-9ae1-b960e40974ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:40.483137 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fccbd34e-77ec-41c5-9ae1-b960e40974ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:40.483795 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fccbd34e-77ec-41c5-9ae1-b960e40974ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:40.484591 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fccbd34e-77ec-41c5-9ae1-b960e40974ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:40.485130 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fccbd34e-77ec-41c5-9ae1-b960e40974ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:40.485641 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fccbd34e-77ec-41c5-9ae1-b960e40974ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:40.548451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4f0a43ba-fc76-4ad8-8439-b37b00b1843f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:40.557856 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4f0a43ba-fc76-4ad8-8439-b37b00b1843f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d" status: 200 len: 1325 microversion: 2.1 time: 0.186198 Sep 24 20:53:40.558460 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 606/1229] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:40 2022] GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d => generated 1325 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:40.661144 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fccbd34e-77ec-41c5-9ae1-b960e40974ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:40.672582 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fccbd34e-77ec-41c5-9ae1-b960e40974ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:40.675721 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fccbd34e-77ec-41c5-9ae1-b960e40974ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:40.678166 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fccbd34e-77ec-41c5-9ae1-b960e40974ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1569 microversion: 2.25 time: 0.207959 Sep 24 20:53:40.679277 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 624/1230] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:40 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1569 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:40.705511 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f1516935-9830-4b6a-8f1a-47e8c8f2dbfa tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:40.706246 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f1516935-9830-4b6a-8f1a-47e8c8f2dbfa tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: 95aa2033-71b1-41a6-b583-2fd183c18242] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:40.712280 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1516935-9830-4b6a-8f1a-47e8c8f2dbfa tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:40.712779 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1516935-9830-4b6a-8f1a-47e8c8f2dbfa tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:40.713224 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1516935-9830-4b6a-8f1a-47e8c8f2dbfa tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:40.713933 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1516935-9830-4b6a-8f1a-47e8c8f2dbfa tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:40.714603 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1516935-9830-4b6a-8f1a-47e8c8f2dbfa tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:40.715038 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1516935-9830-4b6a-8f1a-47e8c8f2dbfa tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:40.851406 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f1516935-9830-4b6a-8f1a-47e8c8f2dbfa tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:40.859911 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f1516935-9830-4b6a-8f1a-47e8c8f2dbfa tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242" status: 200 len: 1469 microversion: 2.1 time: 0.158386 Sep 24 20:53:40.860524 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 607/1231] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:40 2022] GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242 => generated 1469 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:41.248398 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c223aeb4-d1b0-4736-bdcf-9f9390d3b1d3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:41.249031 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c223aeb4-d1b0-4736-bdcf-9f9390d3b1d3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:41.256656 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c223aeb4-d1b0-4736-bdcf-9f9390d3b1d3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:41.257153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c223aeb4-d1b0-4736-bdcf-9f9390d3b1d3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:41.257712 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c223aeb4-d1b0-4736-bdcf-9f9390d3b1d3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:41.258524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c223aeb4-d1b0-4736-bdcf-9f9390d3b1d3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:41.259029 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c223aeb4-d1b0-4736-bdcf-9f9390d3b1d3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:41.259471 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c223aeb4-d1b0-4736-bdcf-9f9390d3b1d3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:41.271415 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f4e1fb48-e4c3-4108-8cba-e04d7704d5e4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:41.272662 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f4e1fb48-e4c3-4108-8cba-e04d7704d5e4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:41.279096 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4e1fb48-e4c3-4108-8cba-e04d7704d5e4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:41.279589 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4e1fb48-e4c3-4108-8cba-e04d7704d5e4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:41.280292 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4e1fb48-e4c3-4108-8cba-e04d7704d5e4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:41.281081 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4e1fb48-e4c3-4108-8cba-e04d7704d5e4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:41.281621 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4e1fb48-e4c3-4108-8cba-e04d7704d5e4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:41.282266 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4e1fb48-e4c3-4108-8cba-e04d7704d5e4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:41.367433 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f4e1fb48-e4c3-4108-8cba-e04d7704d5e4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:41.375464 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f4e1fb48-e4c3-4108-8cba-e04d7704d5e4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d" status: 200 len: 1268 microversion: 2.1 time: 0.108788 Sep 24 20:53:41.376056 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 608/1232] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:41 2022] GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d => generated 1268 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:41.432925 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c223aeb4-d1b0-4736-bdcf-9f9390d3b1d3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:41.444482 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c223aeb4-d1b0-4736-bdcf-9f9390d3b1d3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1541 microversion: 2.1 time: 0.200772 Sep 24 20:53:41.455740 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 625/1233] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:41 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1541 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:41.581369 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9e3f0976-1645-4598-b706-2ec899e24234 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:41.582192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9e3f0976-1645-4598-b706-2ec899e24234 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 3a097c2a-9087-4024-839a-c6b89c95303d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:41.589776 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e3f0976-1645-4598-b706-2ec899e24234 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:41.590270 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e3f0976-1645-4598-b706-2ec899e24234 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:41.590741 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e3f0976-1645-4598-b706-2ec899e24234 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:41.591450 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e3f0976-1645-4598-b706-2ec899e24234 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:41.591904 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e3f0976-1645-4598-b706-2ec899e24234 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:41.592341 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e3f0976-1645-4598-b706-2ec899e24234 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:41.703728 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-111bc411-d125-4ade-860c-c2582e899f22 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:41.709387 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-111bc411-d125-4ade-860c-c2582e899f22 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:41.729120 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-111bc411-d125-4ade-860c-c2582e899f22 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:41.730110 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-111bc411-d125-4ade-860c-c2582e899f22 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:41.731309 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-111bc411-d125-4ade-860c-c2582e899f22 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:41.733093 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-111bc411-d125-4ade-860c-c2582e899f22 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:41.733557 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-111bc411-d125-4ade-860c-c2582e899f22 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:41.735357 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-111bc411-d125-4ade-860c-c2582e899f22 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:41.799697 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9e3f0976-1645-4598-b706-2ec899e24234 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:41.812331 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9e3f0976-1645-4598-b706-2ec899e24234 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d" status: 200 len: 1325 microversion: 2.1 time: 0.234853 Sep 24 20:53:41.827975 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 609/1234] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:41 2022] GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d => generated 1325 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:41.884531 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8178b4f8-e0c8-4140-8cf2-58205fad0293 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:41.885548 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8178b4f8-e0c8-4140-8cf2-58205fad0293 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: 95aa2033-71b1-41a6-b583-2fd183c18242] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:41.892741 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8178b4f8-e0c8-4140-8cf2-58205fad0293 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:41.893741 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8178b4f8-e0c8-4140-8cf2-58205fad0293 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:41.894192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8178b4f8-e0c8-4140-8cf2-58205fad0293 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:41.894944 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8178b4f8-e0c8-4140-8cf2-58205fad0293 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:41.895660 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8178b4f8-e0c8-4140-8cf2-58205fad0293 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:41.896096 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8178b4f8-e0c8-4140-8cf2-58205fad0293 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:41.901834 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:41.915610 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-111bc411-d125-4ade-860c-c2582e899f22 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:41.925340 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-111bc411-d125-4ade-860c-c2582e899f22 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:41.926714 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-111bc411-d125-4ade-860c-c2582e899f22 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:41.928072 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-111bc411-d125-4ade-860c-c2582e899f22 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1569 microversion: 2.25 time: 0.228821 Sep 24 20:53:41.929151 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 626/1235] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:41 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1569 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:53:42.107062 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8178b4f8-e0c8-4140-8cf2-58205fad0293 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:42.120151 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8178b4f8-e0c8-4140-8cf2-58205fad0293 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242" status: 200 len: 1469 microversion: 2.1 time: 0.240122 Sep 24 20:53:42.121658 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 610/1236] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:41 2022] GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242 => generated 1469 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:42.149112 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-b76b8f0c-7c73-4504-bf9c-da31914e4f10 req-58d7e958-69fc-4397-adef-81077c6a3689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a097c2a-9087-4024-839a-c6b89c95303d", "name": "network-vif-plugged", "status": "completed", "tag": "28f41adb-fd88-48bb-bbc8-d02f980738c3"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:42.168621 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-b76b8f0c-7c73-4504-bf9c-da31914e4f10 req-58d7e958-69fc-4397-adef-81077c6a3689 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:42.169420 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-b76b8f0c-7c73-4504-bf9c-da31914e4f10 req-58d7e958-69fc-4397-adef-81077c6a3689 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:42.169890 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-b76b8f0c-7c73-4504-bf9c-da31914e4f10 req-58d7e958-69fc-4397-adef-81077c6a3689 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:42.184566 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-b76b8f0c-7c73-4504-bf9c-da31914e4f10 req-58d7e958-69fc-4397-adef-81077c6a3689 service nova] Creating event network-vif-plugged:28f41adb-fd88-48bb-bbc8-d02f980738c3 for instance 3a097c2a-9087-4024-839a-c6b89c95303d on nch2-master-1 Sep 24 20:53:42.191493 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-b76b8f0c-7c73-4504-bf9c-da31914e4f10 req-58d7e958-69fc-4397-adef-81077c6a3689 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046288 Sep 24 20:53:42.192847 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 627/1237] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:53:42.377684 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-c1cdac14-7936-4e58-89f2-192380c84ff8 req-e74abdf4-bafc-445d-b659-b43b490bacc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95aa2033-71b1-41a6-b583-2fd183c18242", "name": "network-vif-deleted", "tag": "ee855b7c-23b6-4bd8-b336-15077259decf"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:42.390030 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-c1cdac14-7936-4e58-89f2-192380c84ff8 req-e74abdf4-bafc-445d-b659-b43b490bacc8 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:42.390517 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-c1cdac14-7936-4e58-89f2-192380c84ff8 req-e74abdf4-bafc-445d-b659-b43b490bacc8 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:42.390976 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-c1cdac14-7936-4e58-89f2-192380c84ff8 req-e74abdf4-bafc-445d-b659-b43b490bacc8 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:42.403987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-67fb2b33-5632-4b61-9450-059ec4bdafa0 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-2006114409", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:42.418285 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-c1cdac14-7936-4e58-89f2-192380c84ff8 req-e74abdf4-bafc-445d-b659-b43b490bacc8 service nova] Creating event network-vif-deleted:ee855b7c-23b6-4bd8-b336-15077259decf for instance 95aa2033-71b1-41a6-b583-2fd183c18242 on nch2-master-1 Sep 24 20:53:42.423478 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-c1cdac14-7936-4e58-89f2-192380c84ff8 req-e74abdf4-bafc-445d-b659-b43b490bacc8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051600 Sep 24 20:53:42.425835 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 628/1238] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:53:42.433850 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-427c4418-83ce-4b5d-ad51-15c2223ca6b1 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:42.435216 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-427c4418-83ce-4b5d-ad51-15c2223ca6b1 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:42.443091 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-427c4418-83ce-4b5d-ad51-15c2223ca6b1 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:42.443590 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-427c4418-83ce-4b5d-ad51-15c2223ca6b1 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:42.444036 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-427c4418-83ce-4b5d-ad51-15c2223ca6b1 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:42.444755 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-427c4418-83ce-4b5d-ad51-15c2223ca6b1 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:42.445222 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-427c4418-83ce-4b5d-ad51-15c2223ca6b1 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:42.445659 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-427c4418-83ce-4b5d-ad51-15c2223ca6b1 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:42.472759 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-67fb2b33-5632-4b61-9450-059ec4bdafa0 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] validate_networks() for None {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:53:42.538662 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-427c4418-83ce-4b5d-ad51-15c2223ca6b1 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:42.546209 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-427c4418-83ce-4b5d-ad51-15c2223ca6b1 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d" status: 200 len: 1268 microversion: 2.1 time: 0.116601 Sep 24 20:53:42.546833 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 629/1239] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:42 2022] GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d => generated 1268 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:42.556233 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-52bda679-b103-49de-bb7e-ee0d4eac73b9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:42.557015 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-52bda679-b103-49de-bb7e-ee0d4eac73b9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:42.563298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52bda679-b103-49de-bb7e-ee0d4eac73b9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:42.563785 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52bda679-b103-49de-bb7e-ee0d4eac73b9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:42.564224 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52bda679-b103-49de-bb7e-ee0d4eac73b9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:42.565595 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52bda679-b103-49de-bb7e-ee0d4eac73b9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:42.566060 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52bda679-b103-49de-bb7e-ee0d4eac73b9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:42.566530 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52bda679-b103-49de-bb7e-ee0d4eac73b9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:42.794534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-67fb2b33-5632-4b61-9450-059ec4bdafa0 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:53:42.795507 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-67fb2b33-5632-4b61-9450-059ec4bdafa0 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:53:42.796165 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-67fb2b33-5632-4b61-9450-059ec4bdafa0 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:53:42.796591 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-67fb2b33-5632-4b61-9450-059ec4bdafa0 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:53:42.797010 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-67fb2b33-5632-4b61-9450-059ec4bdafa0 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:53:42.802167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-52bda679-b103-49de-bb7e-ee0d4eac73b9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:42.826911 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-52bda679-b103-49de-bb7e-ee0d4eac73b9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1541 microversion: 2.1 time: 0.274264 Sep 24 20:53:42.832833 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67fb2b33-5632-4b61-9450-059ec4bdafa0 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:42.833589 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67fb2b33-5632-4b61-9450-059ec4bdafa0 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:42.834178 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67fb2b33-5632-4b61-9450-059ec4bdafa0 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:42.835107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67fb2b33-5632-4b61-9450-059ec4bdafa0 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:42.835807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67fb2b33-5632-4b61-9450-059ec4bdafa0 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:42.836935 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67fb2b33-5632-4b61-9450-059ec4bdafa0 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:42.840005 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 630/1240] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:42 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1541 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:42.850944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-59c9edd2-1fa6-49c7-b127-f5bf357e3bba tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:42.851901 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-59c9edd2-1fa6-49c7-b127-f5bf357e3bba tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 3a097c2a-9087-4024-839a-c6b89c95303d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:42.858673 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-59c9edd2-1fa6-49c7-b127-f5bf357e3bba tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:42.859445 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-59c9edd2-1fa6-49c7-b127-f5bf357e3bba tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:42.860282 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-59c9edd2-1fa6-49c7-b127-f5bf357e3bba tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:42.861119 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-59c9edd2-1fa6-49c7-b127-f5bf357e3bba tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:42.862283 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-59c9edd2-1fa6-49c7-b127-f5bf357e3bba tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:42.862989 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-59c9edd2-1fa6-49c7-b127-f5bf357e3bba tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:42.869948 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-67fb2b33-5632-4b61-9450-059ec4bdafa0 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Getting quotas for project 66a0417c2ae142c48e41a41a495ea988. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:53:42.876721 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-67fb2b33-5632-4b61-9450-059ec4bdafa0 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Getting quotas for user 2d241b5c9b654fa7bf97f3652186ea6f and project 66a0417c2ae142c48e41a41a495ea988. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:53:42.894945 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-67fb2b33-5632-4b61-9450-059ec4bdafa0 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:53:42.899316 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-67fb2b33-5632-4b61-9450-059ec4bdafa0 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] [instance: 048b3539-80cb-4d73-9280-b62713ddb588] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:53:42.971471 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-67fb2b33-5632-4b61-9450-059ec4bdafa0 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.707939 Sep 24 20:53:42.973084 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 611/1241] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:53:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:53:42.985435 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a356d9ad-8dca-43a8-8fa1-523976ebadfd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:42.988240 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a356d9ad-8dca-43a8-8fa1-523976ebadfd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:42.998221 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a356d9ad-8dca-43a8-8fa1-523976ebadfd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:42.999073 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a356d9ad-8dca-43a8-8fa1-523976ebadfd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:42.999718 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a356d9ad-8dca-43a8-8fa1-523976ebadfd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:43.000700 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a356d9ad-8dca-43a8-8fa1-523976ebadfd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:43.002259 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a356d9ad-8dca-43a8-8fa1-523976ebadfd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:43.002973 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a356d9ad-8dca-43a8-8fa1-523976ebadfd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:43.179596 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-59c9edd2-1fa6-49c7-b127-f5bf357e3bba tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:43.187544 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-59c9edd2-1fa6-49c7-b127-f5bf357e3bba tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d" status: 200 len: 1325 microversion: 2.1 time: 0.346308 Sep 24 20:53:43.188136 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 631/1242] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:42 2022] GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d => generated 1325 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:43.199228 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6e91e54b-1a34-4b5f-b5ea-43c3409845ff tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:43.199228 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6e91e54b-1a34-4b5f-b5ea-43c3409845ff tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] [instance: 048b3539-80cb-4d73-9280-b62713ddb588] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:43.268755 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6e91e54b-1a34-4b5f-b5ea-43c3409845ff tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d241b5c9b654fa7bf97f3652186ea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a0417c2ae142c48e41a41a495ea988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:43.272760 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a356d9ad-8dca-43a8-8fa1-523976ebadfd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:43.283808 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a356d9ad-8dca-43a8-8fa1-523976ebadfd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:43.287429 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a356d9ad-8dca-43a8-8fa1-523976ebadfd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:43.289283 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6e91e54b-1a34-4b5f-b5ea-43c3409845ff tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588" status: 200 len: 1217 microversion: 2.1 time: 0.099771 Sep 24 20:53:43.290475 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 632/1243] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:43 2022] GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588 => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:43.290712 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a356d9ad-8dca-43a8-8fa1-523976ebadfd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1569 microversion: 2.25 time: 0.314408 Sep 24 20:53:43.291559 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 612/1244] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:42 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1569 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:43.299402 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-96a3b8a3-30fe-4e8c-83c3-ef2840ce028d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:43.300189 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-96a3b8a3-30fe-4e8c-83c3-ef2840ce028d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: 95aa2033-71b1-41a6-b583-2fd183c18242] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:43.322051 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96a3b8a3-30fe-4e8c-83c3-ef2840ce028d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:43.322593 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96a3b8a3-30fe-4e8c-83c3-ef2840ce028d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:43.323175 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96a3b8a3-30fe-4e8c-83c3-ef2840ce028d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:43.323882 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96a3b8a3-30fe-4e8c-83c3-ef2840ce028d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:43.324640 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96a3b8a3-30fe-4e8c-83c3-ef2840ce028d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:43.325395 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96a3b8a3-30fe-4e8c-83c3-ef2840ce028d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:43.375699 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96a3b8a3-30fe-4e8c-83c3-ef2840ce028d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:43.376293 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96a3b8a3-30fe-4e8c-83c3-ef2840ce028d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:43.377121 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96a3b8a3-30fe-4e8c-83c3-ef2840ce028d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:43.379074 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-96a3b8a3-30fe-4e8c-83c3-ef2840ce028d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lazy-loading 'fault' on Instance uuid 95aa2033-71b1-41a6-b583-2fd183c18242 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:53:43.432182 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-96a3b8a3-30fe-4e8c-83c3-ef2840ce028d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:43.441932 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-96a3b8a3-30fe-4e8c-83c3-ef2840ce028d tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242" status: 200 len: 1303 microversion: 2.1 time: 0.148648 Sep 24 20:53:43.442617 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 633/1245] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:43 2022] GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242 => generated 1303 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:43.570894 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4ea67f4f-1488-4d23-8cb7-a3aafc493920 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:43.572166 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4ea67f4f-1488-4d23-8cb7-a3aafc493920 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:43.578880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ea67f4f-1488-4d23-8cb7-a3aafc493920 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:43.579435 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ea67f4f-1488-4d23-8cb7-a3aafc493920 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:43.579990 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ea67f4f-1488-4d23-8cb7-a3aafc493920 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:43.580953 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ea67f4f-1488-4d23-8cb7-a3aafc493920 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:43.581468 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ea67f4f-1488-4d23-8cb7-a3aafc493920 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:43.581908 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ea67f4f-1488-4d23-8cb7-a3aafc493920 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:43.651211 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4ea67f4f-1488-4d23-8cb7-a3aafc493920 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:43.659709 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4ea67f4f-1488-4d23-8cb7-a3aafc493920 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d" status: 200 len: 1274 microversion: 2.1 time: 0.093024 Sep 24 20:53:43.660302 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 613/1246] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:43 2022] GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d => generated 1274 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:43.854780 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8843549e-e432-437a-916b-de58fbcdda08 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:43.855420 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8843549e-e432-437a-916b-de58fbcdda08 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:43.863962 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8843549e-e432-437a-916b-de58fbcdda08 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:43.865430 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8843549e-e432-437a-916b-de58fbcdda08 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:43.866165 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8843549e-e432-437a-916b-de58fbcdda08 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:43.867014 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8843549e-e432-437a-916b-de58fbcdda08 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:43.867439 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8843549e-e432-437a-916b-de58fbcdda08 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:43.867877 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8843549e-e432-437a-916b-de58fbcdda08 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:44.014375 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8843549e-e432-437a-916b-de58fbcdda08 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:44.023151 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8843549e-e432-437a-916b-de58fbcdda08 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1541 microversion: 2.1 time: 0.173505 Sep 24 20:53:44.023918 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 634/1247] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:43 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1541 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:44.214632 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-69be4fa7-d782-468f-be09-6e3e31db0d78 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:44.215307 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-69be4fa7-d782-468f-be09-6e3e31db0d78 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 3a097c2a-9087-4024-839a-c6b89c95303d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:44.221698 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-69be4fa7-d782-468f-be09-6e3e31db0d78 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:44.222201 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-69be4fa7-d782-468f-be09-6e3e31db0d78 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:44.222681 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-69be4fa7-d782-468f-be09-6e3e31db0d78 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:44.223406 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-69be4fa7-d782-468f-be09-6e3e31db0d78 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:44.223872 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-69be4fa7-d782-468f-be09-6e3e31db0d78 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:44.224307 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-69be4fa7-d782-468f-be09-6e3e31db0d78 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:44.320405 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3a6a55f2-a43b-4fd7-be1d-e2ba3f61c670 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:44.321284 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3a6a55f2-a43b-4fd7-be1d-e2ba3f61c670 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:44.328039 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a6a55f2-a43b-4fd7-be1d-e2ba3f61c670 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:44.328534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a6a55f2-a43b-4fd7-be1d-e2ba3f61c670 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:44.329585 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a6a55f2-a43b-4fd7-be1d-e2ba3f61c670 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:44.331044 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a6a55f2-a43b-4fd7-be1d-e2ba3f61c670 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:44.331830 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a6a55f2-a43b-4fd7-be1d-e2ba3f61c670 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:44.332497 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a6a55f2-a43b-4fd7-be1d-e2ba3f61c670 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:44.427230 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-69be4fa7-d782-468f-be09-6e3e31db0d78 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:44.438553 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-69be4fa7-d782-468f-be09-6e3e31db0d78 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d" status: 200 len: 1325 microversion: 2.1 time: 0.227858 Sep 24 20:53:44.439134 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 614/1248] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:44 2022] GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d => generated 1325 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:44.444525 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9f3b110e-6bd5-4cdc-aa5b-cd09919960ac tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:44.445390 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9f3b110e-6bd5-4cdc-aa5b-cd09919960ac tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] [instance: 048b3539-80cb-4d73-9280-b62713ddb588] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:44.451395 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9f3b110e-6bd5-4cdc-aa5b-cd09919960ac tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:44.452134 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9f3b110e-6bd5-4cdc-aa5b-cd09919960ac tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:44.452770 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9f3b110e-6bd5-4cdc-aa5b-cd09919960ac tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:44.453706 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9f3b110e-6bd5-4cdc-aa5b-cd09919960ac tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:44.454541 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9f3b110e-6bd5-4cdc-aa5b-cd09919960ac tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:44.455223 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9f3b110e-6bd5-4cdc-aa5b-cd09919960ac tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:44.535250 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9f3b110e-6bd5-4cdc-aa5b-cd09919960ac tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d241b5c9b654fa7bf97f3652186ea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a0417c2ae142c48e41a41a495ea988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:44.539257 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3a6a55f2-a43b-4fd7-be1d-e2ba3f61c670 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:44.543907 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9f3b110e-6bd5-4cdc-aa5b-cd09919960ac tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588" status: 200 len: 1269 microversion: 2.1 time: 0.103026 Sep 24 20:53:44.544823 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 615/1249] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:44 2022] GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588 => generated 1269 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:44.549849 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-61b09965-fb02-4ea6-8478-619834929967 req-06579034-2813-4bed-9bb9-4c074c9676a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03612730-8fd5-4006-aa0a-0c90feb1ea64", "name": "network-vif-unplugged", "status": "completed", "tag": "f19f1969-880f-461a-a794-33b5a54fa613"}, {"name": "network-changed", "server_uuid": "03612730-8fd5-4006-aa0a-0c90feb1ea64", "tag": "f19f1969-880f-461a-a794-33b5a54fa613"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:44.559040 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3a6a55f2-a43b-4fd7-be1d-e2ba3f61c670 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:44.560523 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-61b09965-fb02-4ea6-8478-619834929967 req-06579034-2813-4bed-9bb9-4c074c9676a5 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:44.560661 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3a6a55f2-a43b-4fd7-be1d-e2ba3f61c670 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:44.561382 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-61b09965-fb02-4ea6-8478-619834929967 req-06579034-2813-4bed-9bb9-4c074c9676a5 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:44.561924 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-61b09965-fb02-4ea6-8478-619834929967 req-06579034-2813-4bed-9bb9-4c074c9676a5 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:44.562326 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3a6a55f2-a43b-4fd7-be1d-e2ba3f61c670 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1569 microversion: 2.25 time: 0.246004 Sep 24 20:53:44.562961 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 635/1250] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:44 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1569 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:53:44.576475 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-61b09965-fb02-4ea6-8478-619834929967 req-06579034-2813-4bed-9bb9-4c074c9676a5 service nova] Creating event network-vif-unplugged:f19f1969-880f-461a-a794-33b5a54fa613 for instance 03612730-8fd5-4006-aa0a-0c90feb1ea64 on nch1-master-1 Sep 24 20:53:44.582108 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-61b09965-fb02-4ea6-8478-619834929967 req-06579034-2813-4bed-9bb9-4c074c9676a5 service nova] Creating event network-changed:f19f1969-880f-461a-a794-33b5a54fa613 for instance 03612730-8fd5-4006-aa0a-0c90feb1ea64 on nch1-master-1 Sep 24 20:53:44.583868 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-61b09965-fb02-4ea6-8478-619834929967 req-06579034-2813-4bed-9bb9-4c074c9676a5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.037505 Sep 24 20:53:44.584562 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 616/1251] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:53:44.585365 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-213b7bd1-d1db-444e-97fc-e1158e5352af tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:44.586985 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-213b7bd1-d1db-444e-97fc-e1158e5352af tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: 95aa2033-71b1-41a6-b583-2fd183c18242] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:44.593549 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-213b7bd1-d1db-444e-97fc-e1158e5352af tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:44.594035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-213b7bd1-d1db-444e-97fc-e1158e5352af tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:44.594478 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-213b7bd1-d1db-444e-97fc-e1158e5352af tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:44.595225 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-213b7bd1-d1db-444e-97fc-e1158e5352af tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:44.595658 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-213b7bd1-d1db-444e-97fc-e1158e5352af tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:44.597021 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-213b7bd1-d1db-444e-97fc-e1158e5352af tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:44.630048 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-213b7bd1-d1db-444e-97fc-e1158e5352af tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:44.630685 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-213b7bd1-d1db-444e-97fc-e1158e5352af tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:44.631127 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-213b7bd1-d1db-444e-97fc-e1158e5352af tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:44.631575 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-213b7bd1-d1db-444e-97fc-e1158e5352af tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lazy-loading 'fault' on Instance uuid 95aa2033-71b1-41a6-b583-2fd183c18242 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:53:44.675250 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-213b7bd1-d1db-444e-97fc-e1158e5352af tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:44.683309 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-213b7bd1-d1db-444e-97fc-e1158e5352af tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242" status: 200 len: 1303 microversion: 2.1 time: 0.106846 Sep 24 20:53:44.683827 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-30d089db-ee07-4d6e-942a-3088d4cb0e89 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:44.684239 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 636/1252] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:44 2022] GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242 => generated 1303 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:44.684716 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-30d089db-ee07-4d6e-942a-3088d4cb0e89 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:44.692840 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-30d089db-ee07-4d6e-942a-3088d4cb0e89 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:44.693636 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-30d089db-ee07-4d6e-942a-3088d4cb0e89 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:44.694239 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-30d089db-ee07-4d6e-942a-3088d4cb0e89 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:44.694964 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-30d089db-ee07-4d6e-942a-3088d4cb0e89 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:44.695576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-30d089db-ee07-4d6e-942a-3088d4cb0e89 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:44.696185 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-30d089db-ee07-4d6e-942a-3088d4cb0e89 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:44.960280 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-30d089db-ee07-4d6e-942a-3088d4cb0e89 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:44.973413 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-30d089db-ee07-4d6e-942a-3088d4cb0e89 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d" status: 200 len: 1316 microversion: 2.1 time: 0.294345 Sep 24 20:53:44.974174 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 617/1253] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:44 2022] GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d => generated 1316 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:45.046995 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dbcde973-d943-414c-b80f-3db4662f3143 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:45.047625 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dbcde973-d943-414c-b80f-3db4662f3143 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:45.052091 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:45.056258 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dbcde973-d943-414c-b80f-3db4662f3143 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:45.056767 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dbcde973-d943-414c-b80f-3db4662f3143 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:45.057217 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dbcde973-d943-414c-b80f-3db4662f3143 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:45.057940 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dbcde973-d943-414c-b80f-3db4662f3143 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:45.058407 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dbcde973-d943-414c-b80f-3db4662f3143 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:45.059085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dbcde973-d943-414c-b80f-3db4662f3143 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:45.222738 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dbcde973-d943-414c-b80f-3db4662f3143 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:45.234616 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dbcde973-d943-414c-b80f-3db4662f3143 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1541 microversion: 2.1 time: 0.191399 Sep 24 20:53:45.235684 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 637/1254] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:45 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1541 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:45.462287 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3a2be6e9-2f2d-46a5-a28a-575599e77db8 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:45.463191 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3a2be6e9-2f2d-46a5-a28a-575599e77db8 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 3a097c2a-9087-4024-839a-c6b89c95303d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:45.469639 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3a2be6e9-2f2d-46a5-a28a-575599e77db8 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:45.470134 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3a2be6e9-2f2d-46a5-a28a-575599e77db8 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:45.471371 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3a2be6e9-2f2d-46a5-a28a-575599e77db8 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:45.472237 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3a2be6e9-2f2d-46a5-a28a-575599e77db8 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:45.472902 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3a2be6e9-2f2d-46a5-a28a-575599e77db8 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:45.473542 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3a2be6e9-2f2d-46a5-a28a-575599e77db8 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:45.570902 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5f6423b2-25cc-4835-8dc6-01cf775baa3b tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:45.572325 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5f6423b2-25cc-4835-8dc6-01cf775baa3b tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] [instance: 048b3539-80cb-4d73-9280-b62713ddb588] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:45.579300 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f6423b2-25cc-4835-8dc6-01cf775baa3b tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:45.580031 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f6423b2-25cc-4835-8dc6-01cf775baa3b tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:45.581228 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f6423b2-25cc-4835-8dc6-01cf775baa3b tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:45.583070 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f6423b2-25cc-4835-8dc6-01cf775baa3b tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:45.583726 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f6423b2-25cc-4835-8dc6-01cf775baa3b tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:45.584307 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f6423b2-25cc-4835-8dc6-01cf775baa3b tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:45.669953 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5f6423b2-25cc-4835-8dc6-01cf775baa3b tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d241b5c9b654fa7bf97f3652186ea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a0417c2ae142c48e41a41a495ea988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:45.682067 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5f6423b2-25cc-4835-8dc6-01cf775baa3b tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588" status: 200 len: 1269 microversion: 2.1 time: 0.116918 Sep 24 20:53:45.682948 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 638/1255] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:45 2022] GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588 => generated 1269 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:45.686732 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3a2be6e9-2f2d-46a5-a28a-575599e77db8 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:45.691659 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9c92ce7a-b317-4431-a7b1-3cf70ed2c80a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:45.692588 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9c92ce7a-b317-4431-a7b1-3cf70ed2c80a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:45.700741 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c92ce7a-b317-4431-a7b1-3cf70ed2c80a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:45.701361 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c92ce7a-b317-4431-a7b1-3cf70ed2c80a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:45.701910 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c92ce7a-b317-4431-a7b1-3cf70ed2c80a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:45.703022 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c92ce7a-b317-4431-a7b1-3cf70ed2c80a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:45.703595 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c92ce7a-b317-4431-a7b1-3cf70ed2c80a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:45.704269 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c92ce7a-b317-4431-a7b1-3cf70ed2c80a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:45.705902 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3a2be6e9-2f2d-46a5-a28a-575599e77db8 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d" status: 200 len: 1522 microversion: 2.1 time: 0.246934 Sep 24 20:53:45.707669 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 618/1256] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:45 2022] GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:45.708206 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:45.714730 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-83f181bc-2c2a-45dd-bcfd-77725cfba8e3 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:45.715619 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-83f181bc-2c2a-45dd-bcfd-77725cfba8e3 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: 95aa2033-71b1-41a6-b583-2fd183c18242] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:45.722644 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-83f181bc-2c2a-45dd-bcfd-77725cfba8e3 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:45.723378 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-83f181bc-2c2a-45dd-bcfd-77725cfba8e3 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:45.723979 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-83f181bc-2c2a-45dd-bcfd-77725cfba8e3 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:45.724855 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-83f181bc-2c2a-45dd-bcfd-77725cfba8e3 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:45.725999 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-83f181bc-2c2a-45dd-bcfd-77725cfba8e3 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:45.726655 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-83f181bc-2c2a-45dd-bcfd-77725cfba8e3 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:45.751836 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-83f181bc-2c2a-45dd-bcfd-77725cfba8e3 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] HTTP exception thrown: Instance 95aa2033-71b1-41a6-b583-2fd183c18242 could not be found. Sep 24 20:53:45.754089 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-83f181bc-2c2a-45dd-bcfd-77725cfba8e3 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Request method failure captured: Sep 24 20:53:45.754089 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242 HTTP/1.1 Sep 24 20:53:45.754089 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:53:45.754089 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:53:45.754089 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:53:45.754089 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:53:45.754089 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:53:45.754089 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:53:45.754089 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:53:45.754089 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:53:45.754089 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL22349FckTD92VIwVmq_7U3_xHrtSalVhtGML1KoGIVoVE94cuLvDEWEYrWE9AD5dP6r_cMifUfMZmyzidYy76wL-h5OBqP5hcT-U3m-xAdwkbFv-YQOyPV1rw9xNmw_Bz_qeXJLB4GbguLfjKYiHpSMzsZck8ktZer4jjeXGzr4tkY Sep 24 20:53:45.754089 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:53:45.754089 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:53:45.754089 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:53:45.754089 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:53:45.754089 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:53:45.754089 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:53:45.754089 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 5e68660c954f47f9bad1f7bee17f9435 Sep 24 20:53:45.754089 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersAdminTestJSON-1944287898 Sep 24 20:53:45.754089 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:53:45.754089 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:53:45.755427 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5e68660c954f47f9bad1f7bee17f9435"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5e68660c954f47f9bad1f7bee17f9435"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5e68660c954f47f9bad1f7bee17f9435"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5e68660c954f47f9bad1f7bee17f9435"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:53:45.755427 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersAdminTestJSON-1944287898 Sep 24 20:53:45.755427 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 5e68660c954f47f9bad1f7bee17f9435 Sep 24 20:53:45.755427 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersAdminTestJSON-1944287898 Sep 24 20:53:45.755427 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersAdminTestJSON-1944287898-project Sep 24 20:53:45.755427 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:53:45.755427 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:53:45.755427 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 9eec3a30bcc641ca8ecee19471007b1d Sep 24 20:53:45.755427 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersAdminTestJSON-1944287898-project Sep 24 20:53:45.755427 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:53:45.755427 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 95aa2033-71b1-41a6-b583-2fd183c18242 could not be found. Sep 24 20:53:45.755427 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '95aa2033-71b1-41a6-b583-2fd183c18242'} Sep 24 20:53:45.756160 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:53:45.756160 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:45.756160 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:53:45.756160 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:53:45.756160 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:53:45.756160 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:53:45.756160 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:53:45.756160 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:53:45.756160 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:53:45.756160 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:53:45.756160 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95aa2033-71b1-41a6-b583-2fd183c18242 could not be found. Sep 24 20:53:45.756160 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:45.756160 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:53:45.756160 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:45.756160 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:45.756160 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:53:45.756160 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:53:45.756160 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:53:45.756160 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:53:45.756160 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:53:45.757327 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:53:45.757327 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:53:45.757327 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:53:45.757327 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:53:45.757327 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:53:45.757327 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:53:45.757327 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:53:45.757327 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95aa2033-71b1-41a6-b583-2fd183c18242 could not be found. Sep 24 20:53:45.757327 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:45.757327 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:53:45.757327 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:45.757327 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:45.757327 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:53:45.757327 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:53:45.757327 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:53:45.757327 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:53:45.757327 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95aa2033-71b1-41a6-b583-2fd183c18242 could not be found. Sep 24 20:53:45.757327 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:45.758398 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-83f181bc-2c2a-45dd-bcfd-77725cfba8e3 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Returning 404 to user: Instance 95aa2033-71b1-41a6-b583-2fd183c18242 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:53:45.758398 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-83f181bc-2c2a-45dd-bcfd-77725cfba8e3 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242" status: 404 len: 111 microversion: 2.1 time: 0.046634 Sep 24 20:53:45.758398 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 619/1257] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:45 2022] GET /compute/v2.1/servers/95aa2033-71b1-41a6-b583-2fd183c18242 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:53:45.760894 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b317fcb6-7155-4d49-ae14-4ddfa45e998f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:45.762043 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b317fcb6-7155-4d49-ae14-4ddfa45e998f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 3a097c2a-9087-4024-839a-c6b89c95303d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:45.768927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b317fcb6-7155-4d49-ae14-4ddfa45e998f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:45.769437 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b317fcb6-7155-4d49-ae14-4ddfa45e998f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:45.770029 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b317fcb6-7155-4d49-ae14-4ddfa45e998f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:45.771046 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b317fcb6-7155-4d49-ae14-4ddfa45e998f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:45.771509 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b317fcb6-7155-4d49-ae14-4ddfa45e998f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:45.771943 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b317fcb6-7155-4d49-ae14-4ddfa45e998f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:45.800082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b317fcb6-7155-4d49-ae14-4ddfa45e998f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 3a097c2a-9087-4024-839a-c6b89c95303d] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:53:45.883184 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9c92ce7a-b317-4431-a7b1-3cf70ed2c80a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:45.889331 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b317fcb6-7155-4d49-ae14-4ddfa45e998f tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d" status: 204 len: 0 microversion: 2.1 time: 0.131918 Sep 24 20:53:45.890152 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 620/1258] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:53:45 2022] DELETE /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:53:45.899480 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-81bb28c9-cad8-44b2-8a64-a0034ff06509 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:45.900850 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-81bb28c9-cad8-44b2-8a64-a0034ff06509 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:45.905749 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9c92ce7a-b317-4431-a7b1-3cf70ed2c80a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:45.908584 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9c92ce7a-b317-4431-a7b1-3cf70ed2c80a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:45.908904 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81bb28c9-cad8-44b2-8a64-a0034ff06509 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:45.909565 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81bb28c9-cad8-44b2-8a64-a0034ff06509 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:45.910024 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81bb28c9-cad8-44b2-8a64-a0034ff06509 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:45.910871 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81bb28c9-cad8-44b2-8a64-a0034ff06509 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:45.911874 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81bb28c9-cad8-44b2-8a64-a0034ff06509 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:45.912471 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81bb28c9-cad8-44b2-8a64-a0034ff06509 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:45.916364 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9c92ce7a-b317-4431-a7b1-3cf70ed2c80a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1569 microversion: 2.25 time: 0.230906 Sep 24 20:53:45.933645 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 639/1259] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:45 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1569 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:45.946816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-81bb28c9-cad8-44b2-8a64-a0034ff06509 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:53:45.949694 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-57867d34-77af-4390-b82e-2c5d0363c974 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:45.950327 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-57867d34-77af-4390-b82e-2c5d0363c974 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 3a097c2a-9087-4024-839a-c6b89c95303d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:45.957277 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57867d34-77af-4390-b82e-2c5d0363c974 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:45.958056 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57867d34-77af-4390-b82e-2c5d0363c974 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:45.958999 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57867d34-77af-4390-b82e-2c5d0363c974 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:45.960156 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57867d34-77af-4390-b82e-2c5d0363c974 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:45.960964 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57867d34-77af-4390-b82e-2c5d0363c974 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:45.961701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57867d34-77af-4390-b82e-2c5d0363c974 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:46.053382 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-81bb28c9-cad8-44b2-8a64-a0034ff06509 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 204 len: 0 microversion: 2.1 time: 0.161146 Sep 24 20:53:46.054033 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 621/1260] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:53:45 2022] DELETE /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:53:46.074051 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e9690e74-677f-45a9-ae43-d5860c975592 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:46.077237 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e9690e74-677f-45a9-ae43-d5860c975592 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:46.094395 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e9690e74-677f-45a9-ae43-d5860c975592 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:46.095278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e9690e74-677f-45a9-ae43-d5860c975592 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:46.096044 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e9690e74-677f-45a9-ae43-d5860c975592 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:46.097491 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e9690e74-677f-45a9-ae43-d5860c975592 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:46.103240 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e9690e74-677f-45a9-ae43-d5860c975592 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:46.103799 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e9690e74-677f-45a9-ae43-d5860c975592 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:46.324557 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-57867d34-77af-4390-b82e-2c5d0363c974 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:46.334455 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-57867d34-77af-4390-b82e-2c5d0363c974 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d" status: 200 len: 1528 microversion: 2.1 time: 0.394787 Sep 24 20:53:46.335118 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 640/1261] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:45 2022] GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d => generated 1528 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:46.351062 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b2d3f62a-b35b-48ac-a10a-a43af0be1722 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:46.351691 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b2d3f62a-b35b-48ac-a10a-a43af0be1722 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:46.357487 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e9690e74-677f-45a9-ae43-d5860c975592 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:46.358519 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2d3f62a-b35b-48ac-a10a-a43af0be1722 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:46.359264 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2d3f62a-b35b-48ac-a10a-a43af0be1722 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:46.359948 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2d3f62a-b35b-48ac-a10a-a43af0be1722 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:46.360904 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2d3f62a-b35b-48ac-a10a-a43af0be1722 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:46.361473 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2d3f62a-b35b-48ac-a10a-a43af0be1722 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:46.362895 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2d3f62a-b35b-48ac-a10a-a43af0be1722 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:46.367926 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e9690e74-677f-45a9-ae43-d5860c975592 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d" status: 200 len: 1316 microversion: 2.1 time: 0.311180 Sep 24 20:53:46.380559 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 622/1262] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:46 2022] GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d => generated 1316 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:46.385925 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-81eb19ce-dc9b-4166-90cc-5979420f6fe8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:46.386618 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-81eb19ce-dc9b-4166-90cc-5979420f6fe8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:46.393865 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81eb19ce-dc9b-4166-90cc-5979420f6fe8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:46.394366 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81eb19ce-dc9b-4166-90cc-5979420f6fe8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:46.395668 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81eb19ce-dc9b-4166-90cc-5979420f6fe8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:46.396004 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81eb19ce-dc9b-4166-90cc-5979420f6fe8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:46.396605 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81eb19ce-dc9b-4166-90cc-5979420f6fe8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:46.397075 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81eb19ce-dc9b-4166-90cc-5979420f6fe8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:46.576392 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b2d3f62a-b35b-48ac-a10a-a43af0be1722 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:46.580430 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-81eb19ce-dc9b-4166-90cc-5979420f6fe8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:46.585513 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b2d3f62a-b35b-48ac-a10a-a43af0be1722 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1468 microversion: 2.1 time: 0.249114 Sep 24 20:53:46.586447 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 641/1263] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:46 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1468 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:46.592214 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-81eb19ce-dc9b-4166-90cc-5979420f6fe8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1540 microversion: 2.1 time: 0.210685 Sep 24 20:53:46.592933 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 623/1264] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:46 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1540 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:46.608961 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-dffa1df2-34db-4d8b-b0d6-26ecdfb59ed9 req-96c24a44-47ab-4877-a176-3f6da7b836c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d", "tag": "6f3a76e4-02e8-411b-ac48-84a50c0d2403"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:46.620648 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-dffa1df2-34db-4d8b-b0d6-26ecdfb59ed9 req-96c24a44-47ab-4877-a176-3f6da7b836c1 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:46.621148 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-dffa1df2-34db-4d8b-b0d6-26ecdfb59ed9 req-96c24a44-47ab-4877-a176-3f6da7b836c1 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:46.621583 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-dffa1df2-34db-4d8b-b0d6-26ecdfb59ed9 req-96c24a44-47ab-4877-a176-3f6da7b836c1 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:46.636458 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-dffa1df2-34db-4d8b-b0d6-26ecdfb59ed9 req-96c24a44-47ab-4877-a176-3f6da7b836c1 service nova] Creating event network-changed:6f3a76e4-02e8-411b-ac48-84a50c0d2403 for instance cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d on nch2-master-1 Sep 24 20:53:46.641673 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-dffa1df2-34db-4d8b-b0d6-26ecdfb59ed9 req-96c24a44-47ab-4877-a176-3f6da7b836c1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036334 Sep 24 20:53:46.643176 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 642/1265] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:53:46.709408 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-62b541a4-3473-4cce-a974-15d62e533c47 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:46.710598 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-62b541a4-3473-4cce-a974-15d62e533c47 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] [instance: 048b3539-80cb-4d73-9280-b62713ddb588] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:46.719620 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62b541a4-3473-4cce-a974-15d62e533c47 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:46.720368 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62b541a4-3473-4cce-a974-15d62e533c47 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:46.721490 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62b541a4-3473-4cce-a974-15d62e533c47 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:46.722459 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62b541a4-3473-4cce-a974-15d62e533c47 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:46.723424 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62b541a4-3473-4cce-a974-15d62e533c47 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:46.723923 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62b541a4-3473-4cce-a974-15d62e533c47 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:46.813897 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-62b541a4-3473-4cce-a974-15d62e533c47 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d241b5c9b654fa7bf97f3652186ea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a0417c2ae142c48e41a41a495ea988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:46.825118 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-62b541a4-3473-4cce-a974-15d62e533c47 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588" status: 200 len: 1277 microversion: 2.1 time: 0.121102 Sep 24 20:53:46.826728 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 624/1266] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:46 2022] GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588 => generated 1277 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:46.947702 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6d4a0e61-bd82-4f99-8e58-c7944a603377 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:46.948729 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6d4a0e61-bd82-4f99-8e58-c7944a603377 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:46.957122 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6d4a0e61-bd82-4f99-8e58-c7944a603377 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:46.957616 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6d4a0e61-bd82-4f99-8e58-c7944a603377 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:46.958253 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6d4a0e61-bd82-4f99-8e58-c7944a603377 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:46.959011 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6d4a0e61-bd82-4f99-8e58-c7944a603377 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:46.959476 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6d4a0e61-bd82-4f99-8e58-c7944a603377 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:46.959911 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6d4a0e61-bd82-4f99-8e58-c7944a603377 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:47.363671 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bd5893cd-e56e-45cf-9457-c5ec8213c300 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:47.364343 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-bd5893cd-e56e-45cf-9457-c5ec8213c300 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 3a097c2a-9087-4024-839a-c6b89c95303d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:47.376440 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bd5893cd-e56e-45cf-9457-c5ec8213c300 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:47.378115 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bd5893cd-e56e-45cf-9457-c5ec8213c300 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:47.378264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bd5893cd-e56e-45cf-9457-c5ec8213c300 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:47.379169 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bd5893cd-e56e-45cf-9457-c5ec8213c300 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:47.379753 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bd5893cd-e56e-45cf-9457-c5ec8213c300 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:47.380260 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bd5893cd-e56e-45cf-9457-c5ec8213c300 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:47.400819 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:47.413267 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:47.529719 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6d4a0e61-bd82-4f99-8e58-c7944a603377 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:47.540700 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6d4a0e61-bd82-4f99-8e58-c7944a603377 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:47.542299 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6d4a0e61-bd82-4f99-8e58-c7944a603377 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:47.543737 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6d4a0e61-bd82-4f99-8e58-c7944a603377 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1569 microversion: 2.25 time: 0.600389 Sep 24 20:53:47.551801 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 643/1267] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:46 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1569 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:47.557406 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b6640d7e-79c1-452e-85dc-a588eeecf809 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:47.558339 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b6640d7e-79c1-452e-85dc-a588eeecf809 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:47.566002 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b6640d7e-79c1-452e-85dc-a588eeecf809 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:47.566630 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b6640d7e-79c1-452e-85dc-a588eeecf809 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:47.567748 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b6640d7e-79c1-452e-85dc-a588eeecf809 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:47.568084 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b6640d7e-79c1-452e-85dc-a588eeecf809 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:47.568610 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b6640d7e-79c1-452e-85dc-a588eeecf809 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:47.569117 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b6640d7e-79c1-452e-85dc-a588eeecf809 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:47.692055 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-bd5893cd-e56e-45cf-9457-c5ec8213c300 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:47.707250 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bd5893cd-e56e-45cf-9457-c5ec8213c300 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d" status: 200 len: 1528 microversion: 2.1 time: 0.349062 Sep 24 20:53:47.719232 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 625/1268] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:47 2022] GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d => generated 1528 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:47.725615 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-01a954c4-46a6-44b3-9463-3d7dc0b18804 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:47.726367 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-01a954c4-46a6-44b3-9463-3d7dc0b18804 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:47.740908 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-01a954c4-46a6-44b3-9463-3d7dc0b18804 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:47.741564 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-01a954c4-46a6-44b3-9463-3d7dc0b18804 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:47.742112 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-01a954c4-46a6-44b3-9463-3d7dc0b18804 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:47.743003 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-01a954c4-46a6-44b3-9463-3d7dc0b18804 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:47.745714 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-01a954c4-46a6-44b3-9463-3d7dc0b18804 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:47.746276 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-01a954c4-46a6-44b3-9463-3d7dc0b18804 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:47.857069 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b6640d7e-79c1-452e-85dc-a588eeecf809 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:47.869819 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b6640d7e-79c1-452e-85dc-a588eeecf809 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d" status: 200 len: 1316 microversion: 2.1 time: 0.316649 Sep 24 20:53:47.874850 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 644/1269] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:47 2022] GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d => generated 1316 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:47.882433 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-31a594e1-af26-4ca7-8e28-d021211e2301 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:47.884568 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-31a594e1-af26-4ca7-8e28-d021211e2301 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:47.894298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-31a594e1-af26-4ca7-8e28-d021211e2301 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:47.894937 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-31a594e1-af26-4ca7-8e28-d021211e2301 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:47.895282 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-31a594e1-af26-4ca7-8e28-d021211e2301 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:47.896273 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-31a594e1-af26-4ca7-8e28-d021211e2301 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:47.896736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-31a594e1-af26-4ca7-8e28-d021211e2301 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:47.897172 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-31a594e1-af26-4ca7-8e28-d021211e2301 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:47.995660 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-01a954c4-46a6-44b3-9463-3d7dc0b18804 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:48.010410 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-01a954c4-46a6-44b3-9463-3d7dc0b18804 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1468 microversion: 2.1 time: 0.289200 Sep 24 20:53:48.011415 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 626/1270] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:47 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1468 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:48.032674 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d50b65f0-9d33-4b75-98c1-4081e113c453 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:48.033890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d50b65f0-9d33-4b75-98c1-4081e113c453 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] [instance: 048b3539-80cb-4d73-9280-b62713ddb588] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:48.040281 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d50b65f0-9d33-4b75-98c1-4081e113c453 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:48.041236 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d50b65f0-9d33-4b75-98c1-4081e113c453 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:48.041901 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d50b65f0-9d33-4b75-98c1-4081e113c453 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:48.042965 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d50b65f0-9d33-4b75-98c1-4081e113c453 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:48.043533 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d50b65f0-9d33-4b75-98c1-4081e113c453 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:48.044165 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d50b65f0-9d33-4b75-98c1-4081e113c453 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:48.160236 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-31a594e1-af26-4ca7-8e28-d021211e2301 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:48.168873 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-31a594e1-af26-4ca7-8e28-d021211e2301 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1540 microversion: 2.1 time: 0.292620 Sep 24 20:53:48.171844 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 645/1271] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:47 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1540 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:48.234228 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d50b65f0-9d33-4b75-98c1-4081e113c453 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d241b5c9b654fa7bf97f3652186ea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a0417c2ae142c48e41a41a495ea988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:48.252213 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d50b65f0-9d33-4b75-98c1-4081e113c453 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588" status: 200 len: 1317 microversion: 2.1 time: 0.228067 Sep 24 20:53:48.253065 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 627/1272] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:48 2022] GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588 => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:48.576711 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a1f3509b-f14d-496d-af13-48230279ab9c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:48.577622 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a1f3509b-f14d-496d-af13-48230279ab9c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:48.584272 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1f3509b-f14d-496d-af13-48230279ab9c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:48.584782 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1f3509b-f14d-496d-af13-48230279ab9c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:48.585212 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1f3509b-f14d-496d-af13-48230279ab9c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:48.585959 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1f3509b-f14d-496d-af13-48230279ab9c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:48.586454 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1f3509b-f14d-496d-af13-48230279ab9c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:48.586908 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1f3509b-f14d-496d-af13-48230279ab9c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:48.656939 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-412330f0-3ec0-42a0-83f1-a1733676c825 req-c083693e-bf42-4cc3-a866-3026bca419ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "048b3539-80cb-4d73-9280-b62713ddb588", "tag": "018d9d05-4694-4f6a-8a92-2c61652eab6e"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:48.666833 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-412330f0-3ec0-42a0-83f1-a1733676c825 req-c083693e-bf42-4cc3-a866-3026bca419ab service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:48.667314 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-412330f0-3ec0-42a0-83f1-a1733676c825 req-c083693e-bf42-4cc3-a866-3026bca419ab service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:48.667753 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-412330f0-3ec0-42a0-83f1-a1733676c825 req-c083693e-bf42-4cc3-a866-3026bca419ab service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:48.681287 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-412330f0-3ec0-42a0-83f1-a1733676c825 req-c083693e-bf42-4cc3-a866-3026bca419ab service nova] Creating event network-changed:018d9d05-4694-4f6a-8a92-2c61652eab6e for instance 048b3539-80cb-4d73-9280-b62713ddb588 on nch1-master-1 Sep 24 20:53:48.686553 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-412330f0-3ec0-42a0-83f1-a1733676c825 req-c083693e-bf42-4cc3-a866-3026bca419ab service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033222 Sep 24 20:53:48.687355 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 628/1273] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:53:48.722433 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a1f3509b-f14d-496d-af13-48230279ab9c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:48.730633 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a1f3509b-f14d-496d-af13-48230279ab9c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:48.732091 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a1f3509b-f14d-496d-af13-48230279ab9c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:48.733247 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a1f3509b-f14d-496d-af13-48230279ab9c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1569 microversion: 2.25 time: 0.160611 Sep 24 20:53:48.733805 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 646/1274] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:48 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:48.745784 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-13692c22-de2d-482a-926a-64d0e545a9fa tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:48.746507 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-13692c22-de2d-482a-926a-64d0e545a9fa tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 3a097c2a-9087-4024-839a-c6b89c95303d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:48.753399 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-13692c22-de2d-482a-926a-64d0e545a9fa tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:48.753924 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-13692c22-de2d-482a-926a-64d0e545a9fa tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:48.754375 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-13692c22-de2d-482a-926a-64d0e545a9fa tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:48.755097 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-13692c22-de2d-482a-926a-64d0e545a9fa tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:48.755561 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-13692c22-de2d-482a-926a-64d0e545a9fa tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:48.755994 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-13692c22-de2d-482a-926a-64d0e545a9fa tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:48.891555 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-13692c22-de2d-482a-926a-64d0e545a9fa tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:48.899389 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f2359874-804f-413d-a10b-169e1dba5754 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:48.900042 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f2359874-804f-413d-a10b-169e1dba5754 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:48.901027 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-13692c22-de2d-482a-926a-64d0e545a9fa tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d" status: 200 len: 1528 microversion: 2.1 time: 0.159543 Sep 24 20:53:48.901618 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 629/1275] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:48 2022] GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d => generated 1528 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:48.906166 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f2359874-804f-413d-a10b-169e1dba5754 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:48.906702 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f2359874-804f-413d-a10b-169e1dba5754 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:48.907146 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f2359874-804f-413d-a10b-169e1dba5754 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:48.907856 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f2359874-804f-413d-a10b-169e1dba5754 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:48.908315 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f2359874-804f-413d-a10b-169e1dba5754 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:48.909301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f2359874-804f-413d-a10b-169e1dba5754 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:49.036220 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f2359874-804f-413d-a10b-169e1dba5754 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:49.039810 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cd93f797-a517-4838-9242-1e8759ad32ff tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:49.040518 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cd93f797-a517-4838-9242-1e8759ad32ff tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:49.044280 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f2359874-804f-413d-a10b-169e1dba5754 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d" status: 200 len: 1316 microversion: 2.1 time: 0.148966 Sep 24 20:53:49.044862 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 647/1276] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:48 2022] GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d => generated 1316 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:49.046895 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd93f797-a517-4838-9242-1e8759ad32ff tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:49.047455 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd93f797-a517-4838-9242-1e8759ad32ff tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:49.047997 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd93f797-a517-4838-9242-1e8759ad32ff tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:49.048811 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd93f797-a517-4838-9242-1e8759ad32ff tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:49.049384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd93f797-a517-4838-9242-1e8759ad32ff tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:49.050415 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd93f797-a517-4838-9242-1e8759ad32ff tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:49.179576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cd93f797-a517-4838-9242-1e8759ad32ff tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:49.187507 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cd93f797-a517-4838-9242-1e8759ad32ff tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1468 microversion: 2.1 time: 0.152026 Sep 24 20:53:49.188085 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 630/1277] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:49 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1468 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:49.196179 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bd91c851-c13d-418e-885c-a6d2b2376410 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:49.196858 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bd91c851-c13d-418e-885c-a6d2b2376410 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:49.203392 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bd91c851-c13d-418e-885c-a6d2b2376410 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:49.203884 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bd91c851-c13d-418e-885c-a6d2b2376410 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:49.204333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bd91c851-c13d-418e-885c-a6d2b2376410 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:49.205046 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bd91c851-c13d-418e-885c-a6d2b2376410 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:49.206146 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bd91c851-c13d-418e-885c-a6d2b2376410 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:49.206611 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bd91c851-c13d-418e-885c-a6d2b2376410 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:49.276971 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1dcf06fc-5727-42de-bc9a-2b21a9006e1b tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:49.277888 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1dcf06fc-5727-42de-bc9a-2b21a9006e1b tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] [instance: 048b3539-80cb-4d73-9280-b62713ddb588] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:49.284067 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1dcf06fc-5727-42de-bc9a-2b21a9006e1b tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:49.284560 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1dcf06fc-5727-42de-bc9a-2b21a9006e1b tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:49.285003 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1dcf06fc-5727-42de-bc9a-2b21a9006e1b tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:49.285735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1dcf06fc-5727-42de-bc9a-2b21a9006e1b tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:49.286239 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1dcf06fc-5727-42de-bc9a-2b21a9006e1b tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:49.286703 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1dcf06fc-5727-42de-bc9a-2b21a9006e1b tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:49.370943 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bd91c851-c13d-418e-885c-a6d2b2376410 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:49.379678 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bd91c851-c13d-418e-885c-a6d2b2376410 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1472 microversion: 2.1 time: 0.187649 Sep 24 20:53:49.380574 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 648/1278] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:49 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1472 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:49.385540 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-68d9ded2-5b58-4f00-8858-6c447e26dae2 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:49.386049 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-68d9ded2-5b58-4f00-8858-6c447e26dae2 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 625f5fd3-d872-4da5-b176-5a70dfd8cfe2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:49.392195 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68d9ded2-5b58-4f00-8858-6c447e26dae2 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:49.392687 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68d9ded2-5b58-4f00-8858-6c447e26dae2 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:49.393133 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68d9ded2-5b58-4f00-8858-6c447e26dae2 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:49.393859 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68d9ded2-5b58-4f00-8858-6c447e26dae2 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:49.394310 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68d9ded2-5b58-4f00-8858-6c447e26dae2 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:49.394770 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68d9ded2-5b58-4f00-8858-6c447e26dae2 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:49.422978 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-68d9ded2-5b58-4f00-8858-6c447e26dae2 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 625f5fd3-d872-4da5-b176-5a70dfd8cfe2] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:53:49.436325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1dcf06fc-5727-42de-bc9a-2b21a9006e1b tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d241b5c9b654fa7bf97f3652186ea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a0417c2ae142c48e41a41a495ea988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:49.445060 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1dcf06fc-5727-42de-bc9a-2b21a9006e1b tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588" status: 200 len: 1317 microversion: 2.1 time: 0.172009 Sep 24 20:53:49.445849 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 631/1279] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:49 2022] GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:49.499455 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-68d9ded2-5b58-4f00-8858-6c447e26dae2 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "DELETE /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2" status: 204 len: 0 microversion: 2.1 time: 0.117459 Sep 24 20:53:49.500037 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 649/1280] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:53:49 2022] DELETE /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:53:49.509133 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c4ee3777-f7a5-4216-97a6-f838a61557c1 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:49.509752 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c4ee3777-f7a5-4216-97a6-f838a61557c1 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 625f5fd3-d872-4da5-b176-5a70dfd8cfe2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:49.517689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4ee3777-f7a5-4216-97a6-f838a61557c1 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:49.518418 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4ee3777-f7a5-4216-97a6-f838a61557c1 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:49.519073 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4ee3777-f7a5-4216-97a6-f838a61557c1 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:49.520043 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4ee3777-f7a5-4216-97a6-f838a61557c1 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:49.520842 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4ee3777-f7a5-4216-97a6-f838a61557c1 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:49.521269 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4ee3777-f7a5-4216-97a6-f838a61557c1 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:49.654653 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c4ee3777-f7a5-4216-97a6-f838a61557c1 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278977b201c48dda2d73823fbfe4833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a31be22cc451b92af447ed8d81242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:49.662886 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c4ee3777-f7a5-4216-97a6-f838a61557c1 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2" status: 200 len: 1714 microversion: 2.1 time: 0.157653 Sep 24 20:53:49.663580 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 632/1281] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:49 2022] GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2 => generated 1714 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:49.759438 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c526a970-1e72-4d8d-996a-40392a907dcb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:49.760097 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c526a970-1e72-4d8d-996a-40392a907dcb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:49.766417 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c526a970-1e72-4d8d-996a-40392a907dcb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:49.766937 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c526a970-1e72-4d8d-996a-40392a907dcb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:49.767371 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c526a970-1e72-4d8d-996a-40392a907dcb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:49.768271 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c526a970-1e72-4d8d-996a-40392a907dcb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:49.768859 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c526a970-1e72-4d8d-996a-40392a907dcb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:49.769286 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c526a970-1e72-4d8d-996a-40392a907dcb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:49.901305 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c526a970-1e72-4d8d-996a-40392a907dcb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:49.910542 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c526a970-1e72-4d8d-996a-40392a907dcb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:49.912005 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c526a970-1e72-4d8d-996a-40392a907dcb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:49.913174 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c526a970-1e72-4d8d-996a-40392a907dcb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1569 microversion: 2.25 time: 0.158468 Sep 24 20:53:49.913744 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 650/1282] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:49 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:53:49.925923 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cffb5c7b-ad95-447a-89dd-ec1f7e902ebc tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:49.926703 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cffb5c7b-ad95-447a-89dd-ec1f7e902ebc tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 3a097c2a-9087-4024-839a-c6b89c95303d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:49.933261 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cffb5c7b-ad95-447a-89dd-ec1f7e902ebc tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:49.933755 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cffb5c7b-ad95-447a-89dd-ec1f7e902ebc tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:49.934191 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cffb5c7b-ad95-447a-89dd-ec1f7e902ebc tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:49.934920 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cffb5c7b-ad95-447a-89dd-ec1f7e902ebc tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:49.935383 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cffb5c7b-ad95-447a-89dd-ec1f7e902ebc tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:49.935813 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cffb5c7b-ad95-447a-89dd-ec1f7e902ebc tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:50.067777 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-01606279-92ea-4b61-a52e-f5e8a376c993 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:50.068559 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-01606279-92ea-4b61-a52e-f5e8a376c993 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:50.071103 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cffb5c7b-ad95-447a-89dd-ec1f7e902ebc tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:50.074722 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01606279-92ea-4b61-a52e-f5e8a376c993 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:50.075215 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01606279-92ea-4b61-a52e-f5e8a376c993 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:50.075659 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01606279-92ea-4b61-a52e-f5e8a376c993 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:50.076401 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01606279-92ea-4b61-a52e-f5e8a376c993 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:50.076865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01606279-92ea-4b61-a52e-f5e8a376c993 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:50.077299 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01606279-92ea-4b61-a52e-f5e8a376c993 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:50.079179 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cffb5c7b-ad95-447a-89dd-ec1f7e902ebc tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d" status: 200 len: 1528 microversion: 2.1 time: 0.158195 Sep 24 20:53:50.079761 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 633/1283] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:49 2022] GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d => generated 1528 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:50.208867 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-01606279-92ea-4b61-a52e-f5e8a376c993 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:50.211894 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2e1800e8-32b9-4992-a056-6600e5758abd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:50.212520 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2e1800e8-32b9-4992-a056-6600e5758abd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:50.217006 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-01606279-92ea-4b61-a52e-f5e8a376c993 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d" status: 200 len: 1316 microversion: 2.1 time: 0.153313 Sep 24 20:53:50.217700 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 651/1284] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:50 2022] GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:50.218448 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e1800e8-32b9-4992-a056-6600e5758abd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:50.218969 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e1800e8-32b9-4992-a056-6600e5758abd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:50.219409 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e1800e8-32b9-4992-a056-6600e5758abd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:50.220106 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e1800e8-32b9-4992-a056-6600e5758abd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:50.220562 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e1800e8-32b9-4992-a056-6600e5758abd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:50.221023 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e1800e8-32b9-4992-a056-6600e5758abd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:50.352327 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2e1800e8-32b9-4992-a056-6600e5758abd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:50.360266 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2e1800e8-32b9-4992-a056-6600e5758abd tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1468 microversion: 2.1 time: 0.152250 Sep 24 20:53:50.360849 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 634/1285] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:50 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1468 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:50.402879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7c29f587-6b5f-46c1-a4b4-3e9eb60ba89f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:50.403647 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7c29f587-6b5f-46c1-a4b4-3e9eb60ba89f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:50.409847 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7c29f587-6b5f-46c1-a4b4-3e9eb60ba89f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:50.410452 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7c29f587-6b5f-46c1-a4b4-3e9eb60ba89f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:50.410993 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7c29f587-6b5f-46c1-a4b4-3e9eb60ba89f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:50.411879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7c29f587-6b5f-46c1-a4b4-3e9eb60ba89f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:50.412415 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7c29f587-6b5f-46c1-a4b4-3e9eb60ba89f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:50.412941 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7c29f587-6b5f-46c1-a4b4-3e9eb60ba89f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:50.468034 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b16dd6ab-ccc8-4182-8d19-186592a1042f tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:50.468672 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b16dd6ab-ccc8-4182-8d19-186592a1042f tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] [instance: 048b3539-80cb-4d73-9280-b62713ddb588] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:50.475547 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b16dd6ab-ccc8-4182-8d19-186592a1042f tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:50.476049 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b16dd6ab-ccc8-4182-8d19-186592a1042f tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:50.477153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b16dd6ab-ccc8-4182-8d19-186592a1042f tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:50.478875 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b16dd6ab-ccc8-4182-8d19-186592a1042f tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:50.479350 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b16dd6ab-ccc8-4182-8d19-186592a1042f tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:50.479790 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b16dd6ab-ccc8-4182-8d19-186592a1042f tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:50.593033 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7c29f587-6b5f-46c1-a4b4-3e9eb60ba89f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:50.609236 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7c29f587-6b5f-46c1-a4b4-3e9eb60ba89f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1472 microversion: 2.1 time: 0.210180 Sep 24 20:53:50.610217 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 652/1286] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:50 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1472 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:50.659003 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b16dd6ab-ccc8-4182-8d19-186592a1042f tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d241b5c9b654fa7bf97f3652186ea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a0417c2ae142c48e41a41a495ea988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:50.666889 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b16dd6ab-ccc8-4182-8d19-186592a1042f tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588" status: 200 len: 1317 microversion: 2.1 time: 0.202924 Sep 24 20:53:50.667754 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 635/1287] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:50 2022] GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588 => generated 1317 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:50.686922 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-077ef6af-8abb-4f40-884f-c52de05b3b9b tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:50.687571 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-077ef6af-8abb-4f40-884f-c52de05b3b9b tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 625f5fd3-d872-4da5-b176-5a70dfd8cfe2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:50.694040 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-077ef6af-8abb-4f40-884f-c52de05b3b9b tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:50.694559 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-077ef6af-8abb-4f40-884f-c52de05b3b9b tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:50.695009 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-077ef6af-8abb-4f40-884f-c52de05b3b9b tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:50.695704 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-077ef6af-8abb-4f40-884f-c52de05b3b9b tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:50.696171 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-077ef6af-8abb-4f40-884f-c52de05b3b9b tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:50.696602 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-077ef6af-8abb-4f40-884f-c52de05b3b9b tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:50.838683 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-077ef6af-8abb-4f40-884f-c52de05b3b9b tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278977b201c48dda2d73823fbfe4833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a31be22cc451b92af447ed8d81242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:50.848990 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-077ef6af-8abb-4f40-884f-c52de05b3b9b tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2" status: 200 len: 1714 microversion: 2.1 time: 0.165847 Sep 24 20:53:50.849746 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 653/1288] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:50 2022] GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2 => generated 1714 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:50.915598 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-2f4b1f22-cbca-4bad-ac36-190908eed072 req-3bccaa1f-194b-46b1-9ecf-e2f861c35a30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "684811fb-a8ce-497a-a8f2-c66d6e4512bd", "name": "network-vif-unplugged", "status": "completed", "tag": "f1619055-c388-4c6a-ae4a-12376117a1fd"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:50.926167 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-2f4b1f22-cbca-4bad-ac36-190908eed072 req-3bccaa1f-194b-46b1-9ecf-e2f861c35a30 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:50.926954 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-2f4b1f22-cbca-4bad-ac36-190908eed072 req-3bccaa1f-194b-46b1-9ecf-e2f861c35a30 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:50.927560 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-2f4b1f22-cbca-4bad-ac36-190908eed072 req-3bccaa1f-194b-46b1-9ecf-e2f861c35a30 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:50.940306 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-2f4b1f22-cbca-4bad-ac36-190908eed072 req-3bccaa1f-194b-46b1-9ecf-e2f861c35a30 service nova] Creating event network-vif-unplugged:f1619055-c388-4c6a-ae4a-12376117a1fd for instance 684811fb-a8ce-497a-a8f2-c66d6e4512bd on nch1-master-1 Sep 24 20:53:50.943729 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7613ab93-4e5d-435d-891b-24ddc215f959 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:50.945424 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7613ab93-4e5d-435d-891b-24ddc215f959 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:50.946363 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [req-2f4b1f22-cbca-4bad-ac36-190908eed072 req-3bccaa1f-194b-46b1-9ecf-e2f861c35a30 service nova] Instance 684811fb-a8ce-497a-a8f2-c66d6e4512bd is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=140516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 20:53:50.953298 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-2f4b1f22-cbca-4bad-ac36-190908eed072 req-3bccaa1f-194b-46b1-9ecf-e2f861c35a30 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041394 Sep 24 20:53:50.954292 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 636/1289] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:53:50.958103 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7613ab93-4e5d-435d-891b-24ddc215f959 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:50.959747 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7613ab93-4e5d-435d-891b-24ddc215f959 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:50.960396 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7613ab93-4e5d-435d-891b-24ddc215f959 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:50.961407 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7613ab93-4e5d-435d-891b-24ddc215f959 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:50.962216 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7613ab93-4e5d-435d-891b-24ddc215f959 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:50.962946 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7613ab93-4e5d-435d-891b-24ddc215f959 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:51.103822 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7b043255-6e52-4c5c-b710-484fa909b755 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:51.104471 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7b043255-6e52-4c5c-b710-484fa909b755 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 3a097c2a-9087-4024-839a-c6b89c95303d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:51.111504 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b043255-6e52-4c5c-b710-484fa909b755 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:51.112718 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b043255-6e52-4c5c-b710-484fa909b755 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:51.113285 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b043255-6e52-4c5c-b710-484fa909b755 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:51.114198 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b043255-6e52-4c5c-b710-484fa909b755 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:51.114723 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b043255-6e52-4c5c-b710-484fa909b755 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:51.115160 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b043255-6e52-4c5c-b710-484fa909b755 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:51.118121 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7613ab93-4e5d-435d-891b-24ddc215f959 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:51.121341 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:51.130306 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7613ab93-4e5d-435d-891b-24ddc215f959 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:51.132525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7613ab93-4e5d-435d-891b-24ddc215f959 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:51.134000 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7613ab93-4e5d-435d-891b-24ddc215f959 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1569 microversion: 2.25 time: 0.198524 Sep 24 20:53:51.147284 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 654/1290] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:50 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1569 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:51.242391 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8be579d7-7f68-4bed-a798-08812933fe9f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:51.243267 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8be579d7-7f68-4bed-a798-08812933fe9f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:51.251552 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8be579d7-7f68-4bed-a798-08812933fe9f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:51.252198 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8be579d7-7f68-4bed-a798-08812933fe9f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:51.253215 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8be579d7-7f68-4bed-a798-08812933fe9f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:51.253994 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8be579d7-7f68-4bed-a798-08812933fe9f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:51.254467 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8be579d7-7f68-4bed-a798-08812933fe9f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:51.254943 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8be579d7-7f68-4bed-a798-08812933fe9f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:51.262487 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7b043255-6e52-4c5c-b710-484fa909b755 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:51.273875 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7b043255-6e52-4c5c-b710-484fa909b755 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d" status: 200 len: 1528 microversion: 2.1 time: 0.174121 Sep 24 20:53:51.276178 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 637/1291] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:51 2022] GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d => generated 1528 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:51.385121 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-aaf576c3-758f-4a11-b76e-41590ab90d05 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:51.385673 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-aaf576c3-758f-4a11-b76e-41590ab90d05 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:51.391899 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aaf576c3-758f-4a11-b76e-41590ab90d05 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:51.392403 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aaf576c3-758f-4a11-b76e-41590ab90d05 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:51.393264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aaf576c3-758f-4a11-b76e-41590ab90d05 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:51.394057 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aaf576c3-758f-4a11-b76e-41590ab90d05 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:51.394546 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aaf576c3-758f-4a11-b76e-41590ab90d05 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:51.394989 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aaf576c3-758f-4a11-b76e-41590ab90d05 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:51.398647 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8be579d7-7f68-4bed-a798-08812933fe9f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:51.409005 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8be579d7-7f68-4bed-a798-08812933fe9f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d" status: 200 len: 1316 microversion: 2.1 time: 0.171598 Sep 24 20:53:51.414581 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 655/1292] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:51 2022] GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d => generated 1316 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:51.532406 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-aaf576c3-758f-4a11-b76e-41590ab90d05 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:51.540426 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-aaf576c3-758f-4a11-b76e-41590ab90d05 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1468 microversion: 2.1 time: 0.159529 Sep 24 20:53:51.541174 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 638/1293] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:51 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1468 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:51.633416 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f823e296-18c1-43b1-93f7-2194007d7b84 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:51.634603 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f823e296-18c1-43b1-93f7-2194007d7b84 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:51.644601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f823e296-18c1-43b1-93f7-2194007d7b84 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:51.653006 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f823e296-18c1-43b1-93f7-2194007d7b84 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:51.653586 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f823e296-18c1-43b1-93f7-2194007d7b84 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:51.654400 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f823e296-18c1-43b1-93f7-2194007d7b84 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:51.654906 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f823e296-18c1-43b1-93f7-2194007d7b84 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:51.655344 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f823e296-18c1-43b1-93f7-2194007d7b84 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:51.706964 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a0c7db70-68a8-4a60-a240-bd64a4e13eb6 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:51.707862 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a0c7db70-68a8-4a60-a240-bd64a4e13eb6 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] [instance: 048b3539-80cb-4d73-9280-b62713ddb588] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:51.728518 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a0c7db70-68a8-4a60-a240-bd64a4e13eb6 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:51.729653 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a0c7db70-68a8-4a60-a240-bd64a4e13eb6 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:51.730439 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a0c7db70-68a8-4a60-a240-bd64a4e13eb6 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:51.731525 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a0c7db70-68a8-4a60-a240-bd64a4e13eb6 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:51.732383 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a0c7db70-68a8-4a60-a240-bd64a4e13eb6 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:51.733540 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a0c7db70-68a8-4a60-a240-bd64a4e13eb6 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:51.887979 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f823e296-18c1-43b1-93f7-2194007d7b84 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:51.906022 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f823e296-18c1-43b1-93f7-2194007d7b84 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1472 microversion: 2.1 time: 0.274659 Sep 24 20:53:51.907305 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 656/1294] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:51 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1472 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:51.913026 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-80a6186e-eb29-45ae-8c51-3102a1360610 req-1304ddae-1bb6-4fa7-8ff3-56a9d4f82a28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a097c2a-9087-4024-839a-c6b89c95303d", "name": "network-vif-deleted", "tag": "28f41adb-fd88-48bb-bbc8-d02f980738c3"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:51.923960 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-80a6186e-eb29-45ae-8c51-3102a1360610 req-1304ddae-1bb6-4fa7-8ff3-56a9d4f82a28 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:51.924486 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-80a6186e-eb29-45ae-8c51-3102a1360610 req-1304ddae-1bb6-4fa7-8ff3-56a9d4f82a28 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:51.924936 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-80a6186e-eb29-45ae-8c51-3102a1360610 req-1304ddae-1bb6-4fa7-8ff3-56a9d4f82a28 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:51.937389 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-80a6186e-eb29-45ae-8c51-3102a1360610 req-1304ddae-1bb6-4fa7-8ff3-56a9d4f82a28 service nova] Creating event network-vif-deleted:28f41adb-fd88-48bb-bbc8-d02f980738c3 for instance 3a097c2a-9087-4024-839a-c6b89c95303d on nch2-master-1 Sep 24 20:53:51.944768 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-80a6186e-eb29-45ae-8c51-3102a1360610 req-1304ddae-1bb6-4fa7-8ff3-56a9d4f82a28 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036137 Sep 24 20:53:51.945415 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 657/1295] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:53:51.952368 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0fe256bb-a556-4a4a-b0a4-d3aeecbdbdcf tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:51.953701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0fe256bb-a556-4a4a-b0a4-d3aeecbdbdcf tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 625f5fd3-d872-4da5-b176-5a70dfd8cfe2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:51.961342 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0fe256bb-a556-4a4a-b0a4-d3aeecbdbdcf tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:51.962170 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0fe256bb-a556-4a4a-b0a4-d3aeecbdbdcf tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:51.962954 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0fe256bb-a556-4a4a-b0a4-d3aeecbdbdcf tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:51.964071 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0fe256bb-a556-4a4a-b0a4-d3aeecbdbdcf tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:51.964740 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0fe256bb-a556-4a4a-b0a4-d3aeecbdbdcf tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:51.965400 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0fe256bb-a556-4a4a-b0a4-d3aeecbdbdcf tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:51.997618 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a0c7db70-68a8-4a60-a240-bd64a4e13eb6 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d241b5c9b654fa7bf97f3652186ea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a0417c2ae142c48e41a41a495ea988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:52.007272 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a0c7db70-68a8-4a60-a240-bd64a4e13eb6 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588" status: 200 len: 1317 microversion: 2.1 time: 0.321759 Sep 24 20:53:52.008026 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 639/1296] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:51 2022] GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588 => generated 1317 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:52.140432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0fe256bb-a556-4a4a-b0a4-d3aeecbdbdcf tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278977b201c48dda2d73823fbfe4833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a31be22cc451b92af447ed8d81242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:52.149270 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0fe256bb-a556-4a4a-b0a4-d3aeecbdbdcf tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2" status: 200 len: 1714 microversion: 2.1 time: 0.201675 Sep 24 20:53:52.149838 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 658/1297] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:51 2022] GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2 => generated 1714 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:52.161847 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7428ff3b-2a50-46d6-953e-d2035a7a0ba2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:52.162479 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7428ff3b-2a50-46d6-953e-d2035a7a0ba2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:52.164551 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:52.169839 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7428ff3b-2a50-46d6-953e-d2035a7a0ba2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:52.170329 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7428ff3b-2a50-46d6-953e-d2035a7a0ba2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:52.170803 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7428ff3b-2a50-46d6-953e-d2035a7a0ba2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:52.171519 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7428ff3b-2a50-46d6-953e-d2035a7a0ba2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:52.171985 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7428ff3b-2a50-46d6-953e-d2035a7a0ba2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:52.172421 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7428ff3b-2a50-46d6-953e-d2035a7a0ba2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:52.301846 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7627b3e2-940c-45fc-a8b0-cdbd48e03e24 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:52.302481 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7627b3e2-940c-45fc-a8b0-cdbd48e03e24 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 3a097c2a-9087-4024-839a-c6b89c95303d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:52.307634 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7428ff3b-2a50-46d6-953e-d2035a7a0ba2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:52.309101 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7627b3e2-940c-45fc-a8b0-cdbd48e03e24 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:52.309588 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7627b3e2-940c-45fc-a8b0-cdbd48e03e24 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:52.310023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7627b3e2-940c-45fc-a8b0-cdbd48e03e24 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:52.310752 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7627b3e2-940c-45fc-a8b0-cdbd48e03e24 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:52.311211 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7627b3e2-940c-45fc-a8b0-cdbd48e03e24 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:52.311636 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7627b3e2-940c-45fc-a8b0-cdbd48e03e24 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:52.316835 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7428ff3b-2a50-46d6-953e-d2035a7a0ba2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:52.318352 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7428ff3b-2a50-46d6-953e-d2035a7a0ba2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:52.319592 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7428ff3b-2a50-46d6-953e-d2035a7a0ba2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1569 microversion: 2.25 time: 0.162388 Sep 24 20:53:52.320166 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 640/1298] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:52 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:52.346160 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7627b3e2-940c-45fc-a8b0-cdbd48e03e24 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:52.346970 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7627b3e2-940c-45fc-a8b0-cdbd48e03e24 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:52.347410 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7627b3e2-940c-45fc-a8b0-cdbd48e03e24 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:52.347861 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-7627b3e2-940c-45fc-a8b0-cdbd48e03e24 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lazy-loading 'fault' on Instance uuid 3a097c2a-9087-4024-839a-c6b89c95303d {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:53:52.392013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7627b3e2-940c-45fc-a8b0-cdbd48e03e24 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:52.400238 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7627b3e2-940c-45fc-a8b0-cdbd48e03e24 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d" status: 200 len: 1315 microversion: 2.1 time: 0.103161 Sep 24 20:53:52.400812 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 659/1299] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:52 2022] GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d => generated 1315 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:52.434003 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7bf0e47d-6463-46e8-b7e9-79e26eb7824a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:52.434671 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7bf0e47d-6463-46e8-b7e9-79e26eb7824a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:52.440789 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7bf0e47d-6463-46e8-b7e9-79e26eb7824a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:52.441272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7bf0e47d-6463-46e8-b7e9-79e26eb7824a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:52.441708 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7bf0e47d-6463-46e8-b7e9-79e26eb7824a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:52.442400 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7bf0e47d-6463-46e8-b7e9-79e26eb7824a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:52.443400 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7bf0e47d-6463-46e8-b7e9-79e26eb7824a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:52.443825 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7bf0e47d-6463-46e8-b7e9-79e26eb7824a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:52.563678 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-020c6741-8046-4ef9-a15a-4173370dd84a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:52.564307 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-020c6741-8046-4ef9-a15a-4173370dd84a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:52.570921 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-020c6741-8046-4ef9-a15a-4173370dd84a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:52.571420 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-020c6741-8046-4ef9-a15a-4173370dd84a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:52.571864 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-020c6741-8046-4ef9-a15a-4173370dd84a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:52.572578 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-020c6741-8046-4ef9-a15a-4173370dd84a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:52.573039 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-020c6741-8046-4ef9-a15a-4173370dd84a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:52.573147 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7bf0e47d-6463-46e8-b7e9-79e26eb7824a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:52.573478 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-020c6741-8046-4ef9-a15a-4173370dd84a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:52.581045 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7bf0e47d-6463-46e8-b7e9-79e26eb7824a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d" status: 200 len: 1316 microversion: 2.1 time: 0.151071 Sep 24 20:53:52.581623 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 641/1300] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:52 2022] GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:52.636673 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-020c6741-8046-4ef9-a15a-4173370dd84a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:52.644951 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-020c6741-8046-4ef9-a15a-4173370dd84a tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1298 microversion: 2.1 time: 0.085144 Sep 24 20:53:52.645475 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 660/1301] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:52 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1298 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:52.930156 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ab2c3b75-e6a2-4aec-9c32-124bc3f393bb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:52.930867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ab2c3b75-e6a2-4aec-9c32-124bc3f393bb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:52.932920 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:52.933688 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:52.939634 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab2c3b75-e6a2-4aec-9c32-124bc3f393bb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:52.940914 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab2c3b75-e6a2-4aec-9c32-124bc3f393bb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:52.941371 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab2c3b75-e6a2-4aec-9c32-124bc3f393bb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:52.942111 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab2c3b75-e6a2-4aec-9c32-124bc3f393bb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:52.942609 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab2c3b75-e6a2-4aec-9c32-124bc3f393bb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:52.943048 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab2c3b75-e6a2-4aec-9c32-124bc3f393bb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:53.031268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-78845d15-c58f-4859-97b8-444c899f952e tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:53.031980 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-78845d15-c58f-4859-97b8-444c899f952e tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] [instance: 048b3539-80cb-4d73-9280-b62713ddb588] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:53.039119 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78845d15-c58f-4859-97b8-444c899f952e tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:53.039618 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78845d15-c58f-4859-97b8-444c899f952e tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:53.040066 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78845d15-c58f-4859-97b8-444c899f952e tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:53.040784 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78845d15-c58f-4859-97b8-444c899f952e tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:53.041250 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78845d15-c58f-4859-97b8-444c899f952e tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:53.041683 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78845d15-c58f-4859-97b8-444c899f952e tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:53.097048 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ab2c3b75-e6a2-4aec-9c32-124bc3f393bb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:53.107531 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ab2c3b75-e6a2-4aec-9c32-124bc3f393bb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1472 microversion: 2.1 time: 0.181454 Sep 24 20:53:53.108103 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 642/1302] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:52 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1472 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:53.174220 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c2505a55-5055-42e4-bc89-3c3a7039f79c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:53.175004 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c2505a55-5055-42e4-bc89-3c3a7039f79c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 625f5fd3-d872-4da5-b176-5a70dfd8cfe2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:53.181311 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2505a55-5055-42e4-bc89-3c3a7039f79c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:53.181824 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2505a55-5055-42e4-bc89-3c3a7039f79c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:53.182345 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2505a55-5055-42e4-bc89-3c3a7039f79c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:53.183136 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-78845d15-c58f-4859-97b8-444c899f952e tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d241b5c9b654fa7bf97f3652186ea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a0417c2ae142c48e41a41a495ea988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:53.183262 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2505a55-5055-42e4-bc89-3c3a7039f79c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:53.183747 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2505a55-5055-42e4-bc89-3c3a7039f79c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:53.184266 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2505a55-5055-42e4-bc89-3c3a7039f79c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:53.188687 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:53.191653 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-78845d15-c58f-4859-97b8-444c899f952e tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588" status: 200 len: 1317 microversion: 2.1 time: 0.164673 Sep 24 20:53:53.192337 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 661/1303] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:53 2022] GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:53.325219 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c2505a55-5055-42e4-bc89-3c3a7039f79c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278977b201c48dda2d73823fbfe4833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a31be22cc451b92af447ed8d81242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:53.334264 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c2505a55-5055-42e4-bc89-3c3a7039f79c tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2" status: 200 len: 1714 microversion: 2.1 time: 0.164853 Sep 24 20:53:53.334869 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 643/1304] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:53 2022] GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2 => generated 1714 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:53.345225 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9693a5b5-77d2-4d7a-b805-74b1e05bd257 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:53.346683 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9693a5b5-77d2-4d7a-b805-74b1e05bd257 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:53.350153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=12 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:53.357090 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9693a5b5-77d2-4d7a-b805-74b1e05bd257 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:53.357752 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9693a5b5-77d2-4d7a-b805-74b1e05bd257 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:53.358195 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9693a5b5-77d2-4d7a-b805-74b1e05bd257 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:53.358941 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9693a5b5-77d2-4d7a-b805-74b1e05bd257 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:53.359398 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9693a5b5-77d2-4d7a-b805-74b1e05bd257 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:53.359827 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9693a5b5-77d2-4d7a-b805-74b1e05bd257 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:53.428467 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f9e42a4a-3216-4672-9f46-8426e0cf57c8 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:53.430098 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f9e42a4a-3216-4672-9f46-8426e0cf57c8 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 3a097c2a-9087-4024-839a-c6b89c95303d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:53.436805 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9e42a4a-3216-4672-9f46-8426e0cf57c8 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:53.437226 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9e42a4a-3216-4672-9f46-8426e0cf57c8 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:53.437665 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9e42a4a-3216-4672-9f46-8426e0cf57c8 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:53.438385 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9e42a4a-3216-4672-9f46-8426e0cf57c8 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:53.438876 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9e42a4a-3216-4672-9f46-8426e0cf57c8 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:53.439307 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9e42a4a-3216-4672-9f46-8426e0cf57c8 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:53.478794 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9e42a4a-3216-4672-9f46-8426e0cf57c8 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:53.479290 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9e42a4a-3216-4672-9f46-8426e0cf57c8 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:53.479736 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9e42a4a-3216-4672-9f46-8426e0cf57c8 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:53.480206 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-f9e42a4a-3216-4672-9f46-8426e0cf57c8 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lazy-loading 'fault' on Instance uuid 3a097c2a-9087-4024-839a-c6b89c95303d {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:53:53.546486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f9e42a4a-3216-4672-9f46-8426e0cf57c8 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6db52cb259fa426d860f9c9a48a149f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e175cb4032ec4e6aa900141abbaa04c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:53.567933 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f9e42a4a-3216-4672-9f46-8426e0cf57c8 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d" status: 200 len: 1315 microversion: 2.1 time: 0.147216 Sep 24 20:53:53.582358 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 644/1305] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:53 2022] GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:53.591463 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9693a5b5-77d2-4d7a-b805-74b1e05bd257 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:53.603224 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9693a5b5-77d2-4d7a-b805-74b1e05bd257 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:53.604738 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9693a5b5-77d2-4d7a-b805-74b1e05bd257 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:53.605920 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9693a5b5-77d2-4d7a-b805-74b1e05bd257 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1569 microversion: 2.25 time: 0.264816 Sep 24 20:53:53.606486 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 662/1306] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:53 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1569 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:53.611120 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3e3048c3-adb8-4155-aca8-75a9c2156bc3 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:53.612549 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3e3048c3-adb8-4155-aca8-75a9c2156bc3 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:53.619521 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3e3048c3-adb8-4155-aca8-75a9c2156bc3 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:53.620495 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3e3048c3-adb8-4155-aca8-75a9c2156bc3 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:53.621204 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3e3048c3-adb8-4155-aca8-75a9c2156bc3 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:53.641895 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3e3048c3-adb8-4155-aca8-75a9c2156bc3 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:53.646795 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3e3048c3-adb8-4155-aca8-75a9c2156bc3 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:53.648468 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3e3048c3-adb8-4155-aca8-75a9c2156bc3 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:53.674792 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-adf8229d-ba7a-4910-9e43-be6570e252c4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:53.676177 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-adf8229d-ba7a-4910-9e43-be6570e252c4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:53.684303 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-adf8229d-ba7a-4910-9e43-be6570e252c4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:53.684823 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-adf8229d-ba7a-4910-9e43-be6570e252c4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:53.685277 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-adf8229d-ba7a-4910-9e43-be6570e252c4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:53.686022 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-adf8229d-ba7a-4910-9e43-be6570e252c4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:53.691209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-adf8229d-ba7a-4910-9e43-be6570e252c4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:53.693989 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-adf8229d-ba7a-4910-9e43-be6570e252c4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:53.742470 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-adf8229d-ba7a-4910-9e43-be6570e252c4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:53.743653 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-adf8229d-ba7a-4910-9e43-be6570e252c4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:53.744356 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-adf8229d-ba7a-4910-9e43-be6570e252c4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:53.744827 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-adf8229d-ba7a-4910-9e43-be6570e252c4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lazy-loading 'fault' on Instance uuid bdb37c4d-e841-4e13-b809-e3f19ce6365a {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:53:53.835154 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-adf8229d-ba7a-4910-9e43-be6570e252c4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:53.843502 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-adf8229d-ba7a-4910-9e43-be6570e252c4 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1303 microversion: 2.1 time: 0.177347 Sep 24 20:53:53.844082 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 663/1307] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:53 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1303 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:53.916916 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3e3048c3-adb8-4155-aca8-75a9c2156bc3 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:53.925591 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3e3048c3-adb8-4155-aca8-75a9c2156bc3 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d" status: 200 len: 1316 microversion: 2.1 time: 0.325788 Sep 24 20:53:53.926329 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 645/1308] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:53 2022] GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d => generated 1316 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:53.969339 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-46f2ca0a-455f-4d4f-a5f8-0fa1f506adf0 req-78e06345-6860-40a3-a78d-9068fe1caf96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdb37c4d-e841-4e13-b809-e3f19ce6365a", "name": "network-vif-deleted", "tag": "fdfbcb27-4de9-4bdc-b3e7-a1d7e89b3236"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:53.979974 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-46f2ca0a-455f-4d4f-a5f8-0fa1f506adf0 req-78e06345-6860-40a3-a78d-9068fe1caf96 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:53.980553 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-46f2ca0a-455f-4d4f-a5f8-0fa1f506adf0 req-78e06345-6860-40a3-a78d-9068fe1caf96 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:53.981063 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-46f2ca0a-455f-4d4f-a5f8-0fa1f506adf0 req-78e06345-6860-40a3-a78d-9068fe1caf96 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:53.994215 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-46f2ca0a-455f-4d4f-a5f8-0fa1f506adf0 req-78e06345-6860-40a3-a78d-9068fe1caf96 service nova] Creating event network-vif-deleted:fdfbcb27-4de9-4bdc-b3e7-a1d7e89b3236 for instance bdb37c4d-e841-4e13-b809-e3f19ce6365a on nch2-master-1 Sep 24 20:53:53.999295 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-46f2ca0a-455f-4d4f-a5f8-0fa1f506adf0 req-78e06345-6860-40a3-a78d-9068fe1caf96 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033900 Sep 24 20:53:54.000144 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 664/1309] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:53:54.131580 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a0345b01-4a95-492c-b249-3842093780ea tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:54.132338 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a0345b01-4a95-492c-b249-3842093780ea tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:54.140263 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a0345b01-4a95-492c-b249-3842093780ea tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:54.140765 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a0345b01-4a95-492c-b249-3842093780ea tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:54.141290 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a0345b01-4a95-492c-b249-3842093780ea tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:54.142202 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a0345b01-4a95-492c-b249-3842093780ea tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:54.142939 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a0345b01-4a95-492c-b249-3842093780ea tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:54.143590 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a0345b01-4a95-492c-b249-3842093780ea tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:54.217527 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4e5fc9f6-8035-4512-be3d-de95198ef9fa tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:54.218315 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4e5fc9f6-8035-4512-be3d-de95198ef9fa tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] [instance: 048b3539-80cb-4d73-9280-b62713ddb588] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:54.228900 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e5fc9f6-8035-4512-be3d-de95198ef9fa tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:54.229678 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e5fc9f6-8035-4512-be3d-de95198ef9fa tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:54.230851 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e5fc9f6-8035-4512-be3d-de95198ef9fa tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:54.231885 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e5fc9f6-8035-4512-be3d-de95198ef9fa tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:54.232611 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e5fc9f6-8035-4512-be3d-de95198ef9fa tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:54.233162 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e5fc9f6-8035-4512-be3d-de95198ef9fa tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:54.431561 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a0345b01-4a95-492c-b249-3842093780ea tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:54.444049 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a0345b01-4a95-492c-b249-3842093780ea tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1469 microversion: 2.1 time: 0.316283 Sep 24 20:53:54.445445 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 646/1310] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:54 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1469 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:54.450706 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-79c45aea-1ace-404d-a4cf-3764f5c0aed4 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:54.452307 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-79c45aea-1ace-404d-a4cf-3764f5c0aed4 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:54.460844 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-79c45aea-1ace-404d-a4cf-3764f5c0aed4 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:54.461592 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-79c45aea-1ace-404d-a4cf-3764f5c0aed4 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:54.463408 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-79c45aea-1ace-404d-a4cf-3764f5c0aed4 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:54.464305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-79c45aea-1ace-404d-a4cf-3764f5c0aed4 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:54.465235 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-79c45aea-1ace-404d-a4cf-3764f5c0aed4 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:54.465235 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-79c45aea-1ace-404d-a4cf-3764f5c0aed4 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:54.568690 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4e5fc9f6-8035-4512-be3d-de95198ef9fa tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d241b5c9b654fa7bf97f3652186ea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a0417c2ae142c48e41a41a495ea988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:54.579979 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4e5fc9f6-8035-4512-be3d-de95198ef9fa tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588" status: 200 len: 1317 microversion: 2.1 time: 0.368115 Sep 24 20:53:54.594845 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 665/1311] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:54 2022] GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588 => generated 1317 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:54.600363 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-db2ec3c8-ff8e-4312-a21f-bb44e16444cf tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:54.611443 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-db2ec3c8-ff8e-4312-a21f-bb44e16444cf tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 625f5fd3-d872-4da5-b176-5a70dfd8cfe2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:54.622676 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db2ec3c8-ff8e-4312-a21f-bb44e16444cf tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:54.623181 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db2ec3c8-ff8e-4312-a21f-bb44e16444cf tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:54.623621 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db2ec3c8-ff8e-4312-a21f-bb44e16444cf tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:54.624449 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db2ec3c8-ff8e-4312-a21f-bb44e16444cf tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:54.624912 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db2ec3c8-ff8e-4312-a21f-bb44e16444cf tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:54.625591 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db2ec3c8-ff8e-4312-a21f-bb44e16444cf tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:54.735886 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-79c45aea-1ace-404d-a4cf-3764f5c0aed4 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1810 microversion: 2.1 time: 0.288790 Sep 24 20:53:54.736748 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 647/1312] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:54 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1810 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:54.741638 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-aab91fdf-200f-489c-a150-f1210481c59b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:54.743296 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-aab91fdf-200f-489c-a150-f1210481c59b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:54.753283 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aab91fdf-200f-489c-a150-f1210481c59b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:54.753940 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aab91fdf-200f-489c-a150-f1210481c59b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:54.755430 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aab91fdf-200f-489c-a150-f1210481c59b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:54.755430 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aab91fdf-200f-489c-a150-f1210481c59b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:54.756069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aab91fdf-200f-489c-a150-f1210481c59b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:54.758258 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aab91fdf-200f-489c-a150-f1210481c59b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:54.801845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aab91fdf-200f-489c-a150-f1210481c59b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:54.802334 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aab91fdf-200f-489c-a150-f1210481c59b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:54.803110 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aab91fdf-200f-489c-a150-f1210481c59b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:54.803797 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aab91fdf-200f-489c-a150-f1210481c59b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:54.804364 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aab91fdf-200f-489c-a150-f1210481c59b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:54.804795 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aab91fdf-200f-489c-a150-f1210481c59b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:54.809972 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-db2ec3c8-ff8e-4312-a21f-bb44e16444cf tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278977b201c48dda2d73823fbfe4833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a31be22cc451b92af447ed8d81242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:54.819345 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-db2ec3c8-ff8e-4312-a21f-bb44e16444cf tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2" status: 200 len: 1714 microversion: 2.1 time: 0.229635 Sep 24 20:53:54.822723 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 666/1313] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:54 2022] GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2 => generated 1714 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:54.824865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6c4a393d-09cb-46d4-bb06-503e92c74136 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:54.825971 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6c4a393d-09cb-46d4-bb06-503e92c74136 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 3a097c2a-9087-4024-839a-c6b89c95303d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:54.832801 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c4a393d-09cb-46d4-bb06-503e92c74136 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:54.833302 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c4a393d-09cb-46d4-bb06-503e92c74136 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:54.833746 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c4a393d-09cb-46d4-bb06-503e92c74136 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:54.834468 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c4a393d-09cb-46d4-bb06-503e92c74136 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:54.834963 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c4a393d-09cb-46d4-bb06-503e92c74136 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:54.835660 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c4a393d-09cb-46d4-bb06-503e92c74136 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:54.843345 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-aab91fdf-200f-489c-a150-f1210481c59b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Getting quotas for project 349d3aa8627644d59867a744695f2579. Resources: {'ram', 'cores'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:53:54.850450 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-6c4a393d-09cb-46d4-bb06-503e92c74136 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] HTTP exception thrown: Instance 3a097c2a-9087-4024-839a-c6b89c95303d could not be found. Sep 24 20:53:54.850696 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-aab91fdf-200f-489c-a150-f1210481c59b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Getting quotas for user 93982876b1e24efb8ffa8c009532343a and project 349d3aa8627644d59867a744695f2579. Resources: {'ram', 'cores'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:53:54.852151 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6c4a393d-09cb-46d4-bb06-503e92c74136 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Request method failure captured: Sep 24 20:53:54.852151 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d HTTP/1.1 Sep 24 20:53:54.852151 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:53:54.852151 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:53:54.852151 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:53:54.852151 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:53:54.852151 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:53:54.852151 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:53:54.852151 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:53:54.852151 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:53:54.852151 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL23hSaMAKT8B-JdjtYs2UoED1UAMalIeRO9Th3athHCHzrGhfs9Sy0_hBzkoXpxV7aas8iy4VFycxPqE3-ST396dY35DaR9MZAQlds-eQBPgVm84hG8pTTOjeXtJegh8tOCUNbJFm6JLpFNRAi1C2IykufgxtCoO69ROBtQmrT9YEmI Sep 24 20:53:54.852151 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:53:54.852151 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:53:54.852151 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:53:54.852151 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:53:54.852151 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:53:54.852151 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:53:54.852151 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: e175cb4032ec4e6aa900141abbaa04c4 Sep 24 20:53:54.852151 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:53:54.852151 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:53:54.852151 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:53:54.853653 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:53:54.853653 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:53:54.853653 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: e175cb4032ec4e6aa900141abbaa04c4 Sep 24 20:53:54.853653 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:53:54.853653 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ImagesOneServerNegativeTestJSON-1825846347-project Sep 24 20:53:54.853653 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:53:54.853653 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:53:54.853653 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 6db52cb259fa426d860f9c9a48a149f3 Sep 24 20:53:54.853653 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347-project Sep 24 20:53:54.853653 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:53:54.853653 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 3a097c2a-9087-4024-839a-c6b89c95303d could not be found. Sep 24 20:53:54.853653 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '3a097c2a-9087-4024-839a-c6b89c95303d'} Sep 24 20:53:54.854665 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:53:54.854665 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:54.854665 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:53:54.854665 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:53:54.854665 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:53:54.854665 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:53:54.854665 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:53:54.854665 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:53:54.854665 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:53:54.854665 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:53:54.854665 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a097c2a-9087-4024-839a-c6b89c95303d could not be found. Sep 24 20:53:54.854665 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:53:54.854665 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:53:54.854665 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:53:54.854665 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:54.854665 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:53:54.854665 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:53:54.854665 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:53:54.854665 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:53:54.854665 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:53:54.856349 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:53:54.856349 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:53:54.856349 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:53:54.856349 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:53:54.856349 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:53:54.856349 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:53:54.856349 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:53:54.856349 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a097c2a-9087-4024-839a-c6b89c95303d could not be found. Sep 24 20:53:54.856349 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:53:54.856349 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:53:54.856349 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:53:54.856349 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:54.856349 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:53:54.856349 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:53:54.856349 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:53:54.856349 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:53:54.856349 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a097c2a-9087-4024-839a-c6b89c95303d could not be found. Sep 24 20:53:54.856349 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:53:54.857701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6c4a393d-09cb-46d4-bb06-503e92c74136 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Returning 404 to user: Instance 3a097c2a-9087-4024-839a-c6b89c95303d could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:53:54.857701 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6c4a393d-09cb-46d4-bb06-503e92c74136 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d" status: 404 len: 111 microversion: 2.1 time: 0.033111 Sep 24 20:53:54.857701 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 667/1314] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:54 2022] GET /compute/v2.1/servers/3a097c2a-9087-4024-839a-c6b89c95303d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:53:54.859463 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5e876826-c5cb-449f-a29a-09c61fa05fe0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:54.859824 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5e876826-c5cb-449f-a29a-09c61fa05fe0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:54.866032 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5e876826-c5cb-449f-a29a-09c61fa05fe0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:54.866698 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5e876826-c5cb-449f-a29a-09c61fa05fe0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:54.867142 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5e876826-c5cb-449f-a29a-09c61fa05fe0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:54.867856 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5e876826-c5cb-449f-a29a-09c61fa05fe0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:54.868317 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5e876826-c5cb-449f-a29a-09c61fa05fe0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:54.868744 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5e876826-c5cb-449f-a29a-09c61fa05fe0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:54.980792 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-aab91fdf-200f-489c-a150-f1210481c59b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "POST /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd/action" status: 202 len: 0 microversion: 2.1 time: 0.242894 Sep 24 20:53:54.981612 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 648/1315] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:53:54 2022] POST /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:53:54.987889 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-22c04aae-20f1-4fc8-818a-766d3e5f4a0f tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:54.992719 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22c04aae-20f1-4fc8-818a-766d3e5f4a0f tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:54.993216 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22c04aae-20f1-4fc8-818a-766d3e5f4a0f tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:54.993660 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22c04aae-20f1-4fc8-818a-766d3e5f4a0f tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:54.994412 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22c04aae-20f1-4fc8-818a-766d3e5f4a0f tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:54.994924 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22c04aae-20f1-4fc8-818a-766d3e5f4a0f tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:54.995400 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22c04aae-20f1-4fc8-818a-766d3e5f4a0f tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:55.029894 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-22c04aae-20f1-4fc8-818a-766d3e5f4a0f tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.046919 Sep 24 20:53:55.038060 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 649/1316] 10.222.0.52 () {58 vars in 1176 bytes} [Sat Sep 24 20:53:54 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:53:55.038413 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5e876826-c5cb-449f-a29a-09c61fa05fe0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:55.038557 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-08ed3db7-4d66-4ed7-a8e2-1530d0d8e495 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '.version_select at 0x7f4b0cf6e670>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:55.045223 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5e876826-c5cb-449f-a29a-09c61fa05fe0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:55.047033 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5e876826-c5cb-449f-a29a-09c61fa05fe0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:55.048228 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5e876826-c5cb-449f-a29a-09c61fa05fe0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1569 microversion: 2.25 time: 0.192733 Sep 24 20:53:55.049124 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 668/1317] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:54 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1569 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:55.073726 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-22a5a7c3-ccd8-4eec-ba53-9d94f46736df tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:55.074074 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-22a5a7c3-ccd8-4eec-ba53-9d94f46736df tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:55.085374 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22a5a7c3-ccd8-4eec-ba53-9d94f46736df tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:55.085906 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22a5a7c3-ccd8-4eec-ba53-9d94f46736df tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:55.086343 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22a5a7c3-ccd8-4eec-ba53-9d94f46736df tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:55.087209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22a5a7c3-ccd8-4eec-ba53-9d94f46736df tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:55.087686 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22a5a7c3-ccd8-4eec-ba53-9d94f46736df tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:55.088137 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22a5a7c3-ccd8-4eec-ba53-9d94f46736df tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:55.125207 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22a5a7c3-ccd8-4eec-ba53-9d94f46736df tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:55.125944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22a5a7c3-ccd8-4eec-ba53-9d94f46736df tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:55.126680 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22a5a7c3-ccd8-4eec-ba53-9d94f46736df tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:55.127778 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-22a5a7c3-ccd8-4eec-ba53-9d94f46736df tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lazy-loading 'fault' on Instance uuid bdb37c4d-e841-4e13-b809-e3f19ce6365a {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:53:55.131685 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-08ed3db7-4d66-4ed7-a8e2-1530d0d8e495 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] HTTP exception thrown: Image not found. Sep 24 20:53:55.139702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-08ed3db7-4d66-4ed7-a8e2-1530d0d8e495 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Request method failure captured: Sep 24 20:53:55.139702 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/images/3f427b1d-f285-4ad9-9c06-2ab2ff38c2c6 HTTP/1.1 Sep 24 20:53:55.139702 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:53:55.139702 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:53:55.139702 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:53:55.139702 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:53:55.139702 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:53:55.139702 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:53:55.139702 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:53:55.139702 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:53:55.139702 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL23hSaMAKT8B-JdjtYs2UoED1UAMalIeRO9Th3athHCHzrGhfs9Sy0_hBzkoXpxV7aas8iy4VFycxPqE3-ST396dY35DaR9MZAQlds-eQBPgVm84hG8pTTOjeXtJegh8tOCUNbJFm6JLpFNRAi1C2IykufgxtCoO69ROBtQmrT9YEmI Sep 24 20:53:55.139702 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:53:55.139702 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:53:55.139702 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:53:55.139702 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:53:55.139702 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:53:55.139702 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:53:55.139702 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: e175cb4032ec4e6aa900141abbaa04c4 Sep 24 20:53:55.139702 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:53:55.139702 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:53:55.139702 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:53:55.141113 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:53:55.141113 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:53:55.141113 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: e175cb4032ec4e6aa900141abbaa04c4 Sep 24 20:53:55.141113 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:53:55.141113 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ImagesOneServerNegativeTestJSON-1825846347-project Sep 24 20:53:55.141113 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:53:55.141113 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:53:55.141113 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 6db52cb259fa426d860f9c9a48a149f3 Sep 24 20:53:55.141113 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347-project Sep 24 20:53:55.141113 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:53:55.141113 ncdv-master-1 devstack@n-api.service[140516]: exception: Image not found. Sep 24 20:53:55.141113 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '3f427b1d-f285-4ad9-9c06-2ab2ff38c2c6'} Sep 24 20:53:55.141113 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:53:55.141904 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:55.141904 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 24 20:53:55.141904 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 24 20:53:55.141904 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 24 20:53:55.141904 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 24 20:53:55.141904 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 24 20:53:55.141904 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 24 20:53:55.141904 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 24 20:53:55.141904 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 24 20:53:55.141904 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 24 20:53:55.141904 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 24 20:53:55.141904 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 24 20:53:55.141904 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 24 20:53:55.141904 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 24 20:53:55.141904 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 24 20:53:55.141904 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3f427b1d-f285-4ad9-9c06-2ab2ff38c2c6 to delete Sep 24 20:53:55.141904 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:55.141904 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:53:55.141904 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:55.143791 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:55.143791 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 24 20:53:55.143791 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 24 20:53:55.143791 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 24 20:53:55.143791 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 24 20:53:55.143791 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 24 20:53:55.143791 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 24 20:53:55.143791 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3f427b1d-f285-4ad9-9c06-2ab2ff38c2c6 could not be found. Sep 24 20:53:55.143791 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:55.143791 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:53:55.143791 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:55.143791 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:55.143791 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:53:55.143791 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:53:55.143791 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:53:55.143791 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:53:55.143791 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:53:55.143791 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:53:55.143791 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:53:55.143791 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:53:55.144990 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 24 20:53:55.144990 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 24 20:53:55.144990 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 24 20:53:55.144990 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:55.144990 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:53:55.144990 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:55.144990 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:55.144990 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:53:55.144990 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:53:55.144990 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:53:55.144990 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:53:55.144990 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 24 20:53:55.144990 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:55.144990 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-08ed3db7-4d66-4ed7-a8e2-1530d0d8e495 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Returning 404 to user: Image not found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:53:55.144990 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-08ed3db7-4d66-4ed7-a8e2-1530d0d8e495 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "DELETE /compute/v2.1/images/3f427b1d-f285-4ad9-9c06-2ab2ff38c2c6" status: 404 len: 62 microversion: 2.1 time: 0.110504 Sep 24 20:53:55.146164 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 650/1318] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:55 2022] DELETE /compute/v2.1/images/3f427b1d-f285-4ad9-9c06-2ab2ff38c2c6 => generated 62 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 20:53:55.150725 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b784dc15-62f0-4223-9311-b8fc73419a17 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:55.151466 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b784dc15-62f0-4223-9311-b8fc73419a17 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:55.164062 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b784dc15-62f0-4223-9311-b8fc73419a17 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:55.165273 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b784dc15-62f0-4223-9311-b8fc73419a17 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:55.166018 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b784dc15-62f0-4223-9311-b8fc73419a17 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:55.167582 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b784dc15-62f0-4223-9311-b8fc73419a17 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:55.168639 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b784dc15-62f0-4223-9311-b8fc73419a17 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:55.169305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b784dc15-62f0-4223-9311-b8fc73419a17 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:55.200690 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-22a5a7c3-ccd8-4eec-ba53-9d94f46736df tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eec3a30bcc641ca8ecee19471007b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68660c954f47f9bad1f7bee17f9435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:55.225800 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-22a5a7c3-ccd8-4eec-ba53-9d94f46736df tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 200 len: 1303 microversion: 2.1 time: 0.175464 Sep 24 20:53:55.229877 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 669/1319] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:55 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 1303 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:55.239082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ee6c92f1-dd58-47e7-ab45-a51fcc7723c6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:55.239637 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ee6c92f1-dd58-47e7-ab45-a51fcc7723c6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:55.251875 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ee6c92f1-dd58-47e7-ab45-a51fcc7723c6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:55.252780 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ee6c92f1-dd58-47e7-ab45-a51fcc7723c6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:55.253927 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ee6c92f1-dd58-47e7-ab45-a51fcc7723c6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:55.255826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ee6c92f1-dd58-47e7-ab45-a51fcc7723c6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:55.263115 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ee6c92f1-dd58-47e7-ab45-a51fcc7723c6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:55.277487 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ee6c92f1-dd58-47e7-ab45-a51fcc7723c6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:55.468632 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b784dc15-62f0-4223-9311-b8fc73419a17 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:55.480669 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b784dc15-62f0-4223-9311-b8fc73419a17 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d" status: 200 len: 1316 microversion: 2.1 time: 0.334400 Sep 24 20:53:55.481464 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 651/1320] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:55 2022] GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d => generated 1316 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:55.503467 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0bc114c4-5bda-4ea3-b57a-31a079ca2e04 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:55.503807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0bc114c4-5bda-4ea3-b57a-31a079ca2e04 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:55.510118 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0bc114c4-5bda-4ea3-b57a-31a079ca2e04 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:55.510649 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0bc114c4-5bda-4ea3-b57a-31a079ca2e04 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:55.511098 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0bc114c4-5bda-4ea3-b57a-31a079ca2e04 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:55.511816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0bc114c4-5bda-4ea3-b57a-31a079ca2e04 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:55.512282 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0bc114c4-5bda-4ea3-b57a-31a079ca2e04 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:55.512717 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0bc114c4-5bda-4ea3-b57a-31a079ca2e04 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:55.555033 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-0bc114c4-5bda-4ea3-b57a-31a079ca2e04 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] HTTP exception thrown: Instance 500f472e-d914-4eef-b315-7178f06ef6d8 could not be found. Sep 24 20:53:55.560156 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0bc114c4-5bda-4ea3-b57a-31a079ca2e04 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Request method failure captured: Sep 24 20:53:55.560156 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 HTTP/1.1 Sep 24 20:53:55.560156 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:53:55.560156 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:53:55.560156 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:53:55.560156 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:53:55.560156 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:53:55.560156 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:53:55.560156 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:53:55.560156 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:53:55.560156 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL23hSaMAKT8B-JdjtYs2UoED1UAMalIeRO9Th3athHCHzrGhfs9Sy0_hBzkoXpxV7aas8iy4VFycxPqE3-ST396dY35DaR9MZAQlds-eQBPgVm84hG8pTTOjeXtJegh8tOCUNbJFm6JLpFNRAi1C2IykufgxtCoO69ROBtQmrT9YEmI Sep 24 20:53:55.560156 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:53:55.560156 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:53:55.560156 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:53:55.560156 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:53:55.560156 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:53:55.560156 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:53:55.560156 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: e175cb4032ec4e6aa900141abbaa04c4 Sep 24 20:53:55.560156 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:53:55.560156 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:53:55.560156 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:53:55.561489 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:53:55.561489 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:53:55.561489 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: e175cb4032ec4e6aa900141abbaa04c4 Sep 24 20:53:55.561489 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:53:55.561489 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ImagesOneServerNegativeTestJSON-1825846347-project Sep 24 20:53:55.561489 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:53:55.561489 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:53:55.561489 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 6db52cb259fa426d860f9c9a48a149f3 Sep 24 20:53:55.561489 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347-project Sep 24 20:53:55.561489 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:53:55.561489 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 500f472e-d914-4eef-b315-7178f06ef6d8 could not be found. Sep 24 20:53:55.561489 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '500f472e-d914-4eef-b315-7178f06ef6d8'} Sep 24 20:53:55.562224 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:53:55.562224 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:55.562224 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:53:55.562224 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:53:55.562224 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:53:55.562224 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:53:55.562224 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:53:55.562224 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:53:55.562224 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:53:55.562224 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:53:55.562224 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 500f472e-d914-4eef-b315-7178f06ef6d8 could not be found. Sep 24 20:53:55.562224 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:55.562224 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:53:55.562224 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:55.562224 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:55.562224 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:53:55.562224 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:53:55.562224 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:53:55.562224 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:53:55.562224 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:53:55.564010 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:53:55.564010 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 20:53:55.564010 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 20:53:55.564010 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 20:53:55.564010 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 20:53:55.564010 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:53:55.564010 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:53:55.564010 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:53:55.564010 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:53:55.564010 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 500f472e-d914-4eef-b315-7178f06ef6d8 could not be found. Sep 24 20:53:55.564010 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:55.564010 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:53:55.564010 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:55.564010 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:55.564010 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:53:55.564010 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:53:55.564010 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:53:55.564010 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:53:55.564010 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 500f472e-d914-4eef-b315-7178f06ef6d8 could not be found. Sep 24 20:53:55.564010 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:55.565813 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0bc114c4-5bda-4ea3-b57a-31a079ca2e04 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Returning 404 to user: Instance 500f472e-d914-4eef-b315-7178f06ef6d8 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:53:55.565813 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0bc114c4-5bda-4ea3-b57a-31a079ca2e04 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "DELETE /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 404 len: 111 microversion: 2.1 time: 0.065703 Sep 24 20:53:55.565813 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 652/1321] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:53:55 2022] DELETE /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:53:55.570226 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-3b4d768b-ed36-49a2-ae3e-00180b9c28f0 req-93600a62-c2b2-4b93-80cd-44b57fb4203b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "684811fb-a8ce-497a-a8f2-c66d6e4512bd", "name": "network-vif-plugged", "status": "completed", "tag": "f1619055-c388-4c6a-ae4a-12376117a1fd"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:55.575630 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ee6c92f1-dd58-47e7-ab45-a51fcc7723c6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:55.582219 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-3b4d768b-ed36-49a2-ae3e-00180b9c28f0 req-93600a62-c2b2-4b93-80cd-44b57fb4203b service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:55.582745 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-3b4d768b-ed36-49a2-ae3e-00180b9c28f0 req-93600a62-c2b2-4b93-80cd-44b57fb4203b service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:55.583188 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-3b4d768b-ed36-49a2-ae3e-00180b9c28f0 req-93600a62-c2b2-4b93-80cd-44b57fb4203b service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:55.598349 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-3b4d768b-ed36-49a2-ae3e-00180b9c28f0 req-93600a62-c2b2-4b93-80cd-44b57fb4203b service nova] Creating event network-vif-plugged:f1619055-c388-4c6a-ae4a-12376117a1fd for instance 684811fb-a8ce-497a-a8f2-c66d6e4512bd on nch1-master-1 Sep 24 20:53:55.603295 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ee6c92f1-dd58-47e7-ab45-a51fcc7723c6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1468 microversion: 2.1 time: 0.371169 Sep 24 20:53:55.607452 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 670/1322] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:55 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1468 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:55.609148 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [req-3b4d768b-ed36-49a2-ae3e-00180b9c28f0 req-93600a62-c2b2-4b93-80cd-44b57fb4203b service nova] Instance 684811fb-a8ce-497a-a8f2-c66d6e4512bd is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=140516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 20:53:55.623167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3cbfdd70-5591-4ea4-899a-6319a07a4cc1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:55.624076 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3cbfdd70-5591-4ea4-899a-6319a07a4cc1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: 500f472e-d914-4eef-b315-7178f06ef6d8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:55.632332 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-3b4d768b-ed36-49a2-ae3e-00180b9c28f0 req-93600a62-c2b2-4b93-80cd-44b57fb4203b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064098 Sep 24 20:53:55.632332 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 653/1323] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:53:55.638401 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3cbfdd70-5591-4ea4-899a-6319a07a4cc1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:55.647057 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3cbfdd70-5591-4ea4-899a-6319a07a4cc1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:55.649531 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3cbfdd70-5591-4ea4-899a-6319a07a4cc1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:55.653192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-70f8e3cd-df69-4682-8314-4f9eab8203ae tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:55.653684 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3cbfdd70-5591-4ea4-899a-6319a07a4cc1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:55.654334 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3cbfdd70-5591-4ea4-899a-6319a07a4cc1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:55.654865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3cbfdd70-5591-4ea4-899a-6319a07a4cc1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:55.655868 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-70f8e3cd-df69-4682-8314-4f9eab8203ae tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] [instance: 048b3539-80cb-4d73-9280-b62713ddb588] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:55.663975 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-70f8e3cd-df69-4682-8314-4f9eab8203ae tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:55.664479 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-70f8e3cd-df69-4682-8314-4f9eab8203ae tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:55.664928 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-70f8e3cd-df69-4682-8314-4f9eab8203ae tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:55.665665 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-70f8e3cd-df69-4682-8314-4f9eab8203ae tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:55.666110 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-70f8e3cd-df69-4682-8314-4f9eab8203ae tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:55.666569 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-70f8e3cd-df69-4682-8314-4f9eab8203ae tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:55.683372 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-3cbfdd70-5591-4ea4-899a-6319a07a4cc1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] HTTP exception thrown: Instance 500f472e-d914-4eef-b315-7178f06ef6d8 could not be found. Sep 24 20:53:55.690989 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3cbfdd70-5591-4ea4-899a-6319a07a4cc1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Request method failure captured: Sep 24 20:53:55.690989 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 HTTP/1.1 Sep 24 20:53:55.690989 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:53:55.690989 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:53:55.690989 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:53:55.690989 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:53:55.690989 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:53:55.690989 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:53:55.690989 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:53:55.690989 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:53:55.690989 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL23hSaMAKT8B-JdjtYs2UoED1UAMalIeRO9Th3athHCHzrGhfs9Sy0_hBzkoXpxV7aas8iy4VFycxPqE3-ST396dY35DaR9MZAQlds-eQBPgVm84hG8pTTOjeXtJegh8tOCUNbJFm6JLpFNRAi1C2IykufgxtCoO69ROBtQmrT9YEmI Sep 24 20:53:55.690989 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:53:55.690989 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:53:55.690989 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:53:55.690989 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:53:55.690989 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:53:55.690989 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:53:55.690989 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: e175cb4032ec4e6aa900141abbaa04c4 Sep 24 20:53:55.690989 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:53:55.690989 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:53:55.690989 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:53:55.692698 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:53:55.692698 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:53:55.692698 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: e175cb4032ec4e6aa900141abbaa04c4 Sep 24 20:53:55.692698 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:53:55.692698 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ImagesOneServerNegativeTestJSON-1825846347-project Sep 24 20:53:55.692698 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:53:55.692698 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:53:55.692698 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 6db52cb259fa426d860f9c9a48a149f3 Sep 24 20:53:55.692698 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347-project Sep 24 20:53:55.692698 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:53:55.692698 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 500f472e-d914-4eef-b315-7178f06ef6d8 could not be found. Sep 24 20:53:55.692698 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '500f472e-d914-4eef-b315-7178f06ef6d8'} Sep 24 20:53:55.693506 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:53:55.693506 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:55.693506 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:53:55.693506 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:53:55.693506 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:53:55.693506 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:53:55.693506 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:53:55.693506 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:53:55.693506 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:53:55.693506 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:53:55.693506 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 500f472e-d914-4eef-b315-7178f06ef6d8 could not be found. Sep 24 20:53:55.693506 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:53:55.693506 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:53:55.693506 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:53:55.693506 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:55.693506 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:53:55.693506 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:53:55.693506 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:53:55.693506 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:53:55.693506 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:53:55.694846 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:53:55.694846 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:53:55.694846 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:53:55.694846 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:53:55.694846 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:53:55.694846 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:53:55.694846 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:53:55.694846 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 500f472e-d914-4eef-b315-7178f06ef6d8 could not be found. Sep 24 20:53:55.694846 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:53:55.694846 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:53:55.694846 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:53:55.694846 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:55.694846 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:53:55.694846 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:53:55.694846 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:53:55.694846 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:53:55.694846 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 500f472e-d914-4eef-b315-7178f06ef6d8 could not be found. Sep 24 20:53:55.694846 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:53:55.695948 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3cbfdd70-5591-4ea4-899a-6319a07a4cc1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Returning 404 to user: Instance 500f472e-d914-4eef-b315-7178f06ef6d8 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:53:55.695948 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3cbfdd70-5591-4ea4-899a-6319a07a4cc1 tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8" status: 404 len: 111 microversion: 2.1 time: 0.082528 Sep 24 20:53:55.695948 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 671/1324] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:55 2022] GET /compute/v2.1/servers/500f472e-d914-4eef-b315-7178f06ef6d8 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:53:55.702361 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-27a93f0d-dc05-437e-9b33-2c768491bc0a tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '.version_select at 0x7f4b0c7153a0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:55.757976 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-27a93f0d-dc05-437e-9b33-2c768491bc0a tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-266780220" status: 202 len: 0 microversion: 2.1 time: 0.059155 Sep 24 20:53:55.773727 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 672/1325] 10.222.0.52 () {58 vars in 1218 bytes} [Sat Sep 24 20:53:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-266780220 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:53:55.845184 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-92c00178-8da3-43c4-a4f4-79522b096ce7 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:55.845820 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-92c00178-8da3-43c4-a4f4-79522b096ce7 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 625f5fd3-d872-4da5-b176-5a70dfd8cfe2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:55.860071 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-92c00178-8da3-43c4-a4f4-79522b096ce7 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:55.861023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-92c00178-8da3-43c4-a4f4-79522b096ce7 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:55.865956 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-92c00178-8da3-43c4-a4f4-79522b096ce7 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:55.868937 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-92c00178-8da3-43c4-a4f4-79522b096ce7 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:55.869451 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-92c00178-8da3-43c4-a4f4-79522b096ce7 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:55.871886 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-92c00178-8da3-43c4-a4f4-79522b096ce7 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:56.022050 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-92c00178-8da3-43c4-a4f4-79522b096ce7 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278977b201c48dda2d73823fbfe4833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a31be22cc451b92af447ed8d81242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:56.030908 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-70f8e3cd-df69-4682-8314-4f9eab8203ae tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d241b5c9b654fa7bf97f3652186ea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a0417c2ae142c48e41a41a495ea988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:56.035788 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-92c00178-8da3-43c4-a4f4-79522b096ce7 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2" status: 200 len: 1646 microversion: 2.1 time: 0.194428 Sep 24 20:53:56.038223 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 673/1326] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:55 2022] GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2 => generated 1646 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:56.056061 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-3ba8a612-9082-4800-a799-faa168db445e req-e148f617-3f81-4b97-9b5d-db80ffd42392 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "625f5fd3-d872-4da5-b176-5a70dfd8cfe2", "name": "network-vif-deleted", "tag": "f81a67af-6fdb-4ade-b541-421cafdc5230"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:56.062993 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-70f8e3cd-df69-4682-8314-4f9eab8203ae tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588" status: 200 len: 1317 microversion: 2.1 time: 0.429296 Sep 24 20:53:56.066895 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 654/1327] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:55 2022] GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588 => generated 1317 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:56.077364 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-3ba8a612-9082-4800-a799-faa168db445e req-e148f617-3f81-4b97-9b5d-db80ffd42392 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:56.077848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-3ba8a612-9082-4800-a799-faa168db445e req-e148f617-3f81-4b97-9b5d-db80ffd42392 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:56.078324 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-3ba8a612-9082-4800-a799-faa168db445e req-e148f617-3f81-4b97-9b5d-db80ffd42392 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:56.084337 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-86e11964-c51c-4805-bb5b-cef6e516b72b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:56.088530 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-86e11964-c51c-4805-bb5b-cef6e516b72b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:56.088749 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:56.103999 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86e11964-c51c-4805-bb5b-cef6e516b72b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:56.104516 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86e11964-c51c-4805-bb5b-cef6e516b72b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:56.104969 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86e11964-c51c-4805-bb5b-cef6e516b72b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:56.105698 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86e11964-c51c-4805-bb5b-cef6e516b72b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:56.112960 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86e11964-c51c-4805-bb5b-cef6e516b72b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:56.113665 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86e11964-c51c-4805-bb5b-cef6e516b72b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:56.117999 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-3ba8a612-9082-4800-a799-faa168db445e req-e148f617-3f81-4b97-9b5d-db80ffd42392 service nova] Creating event network-vif-deleted:f81a67af-6fdb-4ade-b541-421cafdc5230 for instance 625f5fd3-d872-4da5-b176-5a70dfd8cfe2 on nch1-master-1 Sep 24 20:53:56.144759 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-3ba8a612-9082-4800-a799-faa168db445e req-e148f617-3f81-4b97-9b5d-db80ffd42392 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094662 Sep 24 20:53:56.146228 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 674/1328] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:53:56.254989 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fc2278c1-9cf3-4b40-818c-6ec885f49072 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:56.255706 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fc2278c1-9cf3-4b40-818c-6ec885f49072 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] [instance: bdb37c4d-e841-4e13-b809-e3f19ce6365a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:56.274667 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc2278c1-9cf3-4b40-818c-6ec885f49072 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:56.275172 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc2278c1-9cf3-4b40-818c-6ec885f49072 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:56.275619 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc2278c1-9cf3-4b40-818c-6ec885f49072 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:56.276345 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc2278c1-9cf3-4b40-818c-6ec885f49072 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:56.276811 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc2278c1-9cf3-4b40-818c-6ec885f49072 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:56.277242 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc2278c1-9cf3-4b40-818c-6ec885f49072 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:56.310819 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-fc2278c1-9cf3-4b40-818c-6ec885f49072 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] HTTP exception thrown: Instance bdb37c4d-e841-4e13-b809-e3f19ce6365a could not be found. Sep 24 20:53:56.317867 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fc2278c1-9cf3-4b40-818c-6ec885f49072 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Request method failure captured: Sep 24 20:53:56.317867 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a HTTP/1.1 Sep 24 20:53:56.317867 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:53:56.317867 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:53:56.317867 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:53:56.317867 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:53:56.317867 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:53:56.317867 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:53:56.317867 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:53:56.317867 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:53:56.317867 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL22349FckTD92VIwVmq_7U3_xHrtSalVhtGML1KoGIVoVE94cuLvDEWEYrWE9AD5dP6r_cMifUfMZmyzidYy76wL-h5OBqP5hcT-U3m-xAdwkbFv-YQOyPV1rw9xNmw_Bz_qeXJLB4GbguLfjKYiHpSMzsZck8ktZer4jjeXGzr4tkY Sep 24 20:53:56.317867 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:53:56.317867 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:53:56.317867 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:53:56.317867 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:53:56.317867 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:53:56.317867 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:53:56.317867 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 5e68660c954f47f9bad1f7bee17f9435 Sep 24 20:53:56.317867 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersAdminTestJSON-1944287898 Sep 24 20:53:56.317867 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:53:56.317867 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:53:56.319335 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5e68660c954f47f9bad1f7bee17f9435"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5e68660c954f47f9bad1f7bee17f9435"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5e68660c954f47f9bad1f7bee17f9435"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5e68660c954f47f9bad1f7bee17f9435"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:53:56.319335 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersAdminTestJSON-1944287898 Sep 24 20:53:56.319335 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 5e68660c954f47f9bad1f7bee17f9435 Sep 24 20:53:56.319335 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersAdminTestJSON-1944287898 Sep 24 20:53:56.319335 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersAdminTestJSON-1944287898-project Sep 24 20:53:56.319335 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:53:56.319335 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:53:56.319335 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 9eec3a30bcc641ca8ecee19471007b1d Sep 24 20:53:56.319335 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersAdminTestJSON-1944287898-project Sep 24 20:53:56.319335 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:53:56.319335 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance bdb37c4d-e841-4e13-b809-e3f19ce6365a could not be found. Sep 24 20:53:56.319335 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'bdb37c4d-e841-4e13-b809-e3f19ce6365a'} Sep 24 20:53:56.320138 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:53:56.320138 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:56.320138 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:53:56.320138 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:53:56.320138 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:53:56.320138 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:53:56.320138 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:53:56.320138 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:53:56.320138 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:53:56.320138 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:53:56.320138 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdb37c4d-e841-4e13-b809-e3f19ce6365a could not be found. Sep 24 20:53:56.320138 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:53:56.320138 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:53:56.320138 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:53:56.320138 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:56.320138 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:53:56.320138 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:53:56.320138 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:53:56.320138 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:53:56.320138 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:53:56.322035 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:53:56.322035 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:53:56.322035 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:53:56.322035 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:53:56.322035 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:53:56.322035 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:53:56.322035 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:53:56.322035 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdb37c4d-e841-4e13-b809-e3f19ce6365a could not be found. Sep 24 20:53:56.322035 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:53:56.322035 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:53:56.322035 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:53:56.322035 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:56.322035 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:53:56.322035 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:53:56.322035 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:53:56.322035 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:53:56.322035 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdb37c4d-e841-4e13-b809-e3f19ce6365a could not be found. Sep 24 20:53:56.322035 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:53:56.324188 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fc2278c1-9cf3-4b40-818c-6ec885f49072 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] Returning 404 to user: Instance bdb37c4d-e841-4e13-b809-e3f19ce6365a could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:53:56.324188 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fc2278c1-9cf3-4b40-818c-6ec885f49072 tempest-ServersAdminTestJSON-1944287898 tempest-ServersAdminTestJSON-1944287898-project] 10.222.0.52 "GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a" status: 404 len: 111 microversion: 2.1 time: 0.070011 Sep 24 20:53:56.329207 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 675/1329] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:56 2022] GET /compute/v2.1/servers/bdb37c4d-e841-4e13-b809-e3f19ce6365a => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:53:56.449957 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-86e11964-c51c-4805-bb5b-cef6e516b72b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:56.460687 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-86e11964-c51c-4805-bb5b-cef6e516b72b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:56.462475 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-86e11964-c51c-4805-bb5b-cef6e516b72b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:56.464556 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-86e11964-c51c-4805-bb5b-cef6e516b72b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1544 microversion: 2.25 time: 0.386273 Sep 24 20:53:56.478288 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 655/1330] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:56 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1544 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:56.493950 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a72adab6-55de-4508-889d-4a2e23035182 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Calling method '.version_select at 0x7f4b0c869670>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:56.498254 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a72adab6-55de-4508-889d-4a2e23035182 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:56.498862 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a72adab6-55de-4508-889d-4a2e23035182 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:56.499368 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a72adab6-55de-4508-889d-4a2e23035182 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:56.509603 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-af776ecf-a2bd-403a-82e0-d34cb849c836 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:56.510434 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-af776ecf-a2bd-403a-82e0-d34cb849c836 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:56.523256 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af776ecf-a2bd-403a-82e0-d34cb849c836 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:56.527331 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af776ecf-a2bd-403a-82e0-d34cb849c836 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:56.528035 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af776ecf-a2bd-403a-82e0-d34cb849c836 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:56.528881 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af776ecf-a2bd-403a-82e0-d34cb849c836 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:56.529451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af776ecf-a2bd-403a-82e0-d34cb849c836 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:56.529984 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af776ecf-a2bd-403a-82e0-d34cb849c836 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:56.539913 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a72adab6-55de-4508-889d-4a2e23035182 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 3206 microversion: 2.25 time: 0.049954 Sep 24 20:53:56.556841 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 676/1331] 10.222.0.52 () {60 vars in 1184 bytes} [Sat Sep 24 20:53:56 2022] GET /compute/v2.1/os-migrations => generated 3206 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:56.567854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ad3a2e90-188c-4764-a266-182900f9f945 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:56.568823 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ad3a2e90-188c-4764-a266-182900f9f945 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:56.579228 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ad3a2e90-188c-4764-a266-182900f9f945 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:56.580080 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ad3a2e90-188c-4764-a266-182900f9f945 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:56.580859 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ad3a2e90-188c-4764-a266-182900f9f945 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:56.584884 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ad3a2e90-188c-4764-a266-182900f9f945 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:56.585906 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ad3a2e90-188c-4764-a266-182900f9f945 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:56.588152 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ad3a2e90-188c-4764-a266-182900f9f945 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:56.885595 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-af776ecf-a2bd-403a-82e0-d34cb849c836 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:56.889461 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-ad3a2e90-188c-4764-a266-182900f9f945 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lazy-loading 'services' on Instance uuid 03612730-8fd5-4006-aa0a-0c90feb1ea64 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:53:56.897204 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-af776ecf-a2bd-403a-82e0-d34cb849c836 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d" status: 200 len: 1316 microversion: 2.1 time: 0.393052 Sep 24 20:53:56.898079 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 656/1332] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:56 2022] GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d => generated 1316 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:56.915352 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-926fc5d2-6aeb-423f-ac68-2f795e0cb647 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:56.916309 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-926fc5d2-6aeb-423f-ac68-2f795e0cb647 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:56.923574 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ad3a2e90-188c-4764-a266-182900f9f945 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 2037 microversion: 2.25 time: 0.364742 Sep 24 20:53:56.924222 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-926fc5d2-6aeb-423f-ac68-2f795e0cb647 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:56.938258 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 677/1333] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:53:56 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 2037 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:53:56.940140 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-926fc5d2-6aeb-423f-ac68-2f795e0cb647 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:56.941877 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-926fc5d2-6aeb-423f-ac68-2f795e0cb647 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:56.952473 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-926fc5d2-6aeb-423f-ac68-2f795e0cb647 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:56.952473 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-926fc5d2-6aeb-423f-ac68-2f795e0cb647 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:56.952473 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-926fc5d2-6aeb-423f-ac68-2f795e0cb647 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:56.962826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1531286b-1845-49ff-ab96-28d5cfe462b8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Action: 'create', calling method: .version_select at 0x7f4b0c7351f0>, body: {"keypair": {"name": "tempest-keypair-687707201", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8GlVUP4LJPOtaQnJ9wDFTza4DdB74D8wkmm0fTDM+u+h7PSL5mGWcbgRqD+3uISLW9v0vdXeE15nG07GRlVqpVgNKVMSoOEMCPwExnv+iDgu6XC2jBX2NBKX4W1CeqPw=="}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:57.001354 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-1531286b-1845-49ff-ab96-28d5cfe462b8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Getting quotas for project f3c583f2016e4edd94aeec7dd64f9673. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:53:57.015090 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-1531286b-1845-49ff-ab96-28d5cfe462b8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Getting quotas for user ca78cf6d34e84f2cb5cb254c5d8af1da and project f3c583f2016e4edd94aeec7dd64f9673. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:53:57.024176 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:57.073035 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1531286b-1845-49ff-ab96-28d5cfe462b8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.114370 Sep 24 20:53:57.073763 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 678/1334] 10.222.0.52 () {62 vars in 1200 bytes} [Sat Sep 24 20:53:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 117 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 24 20:53:57.079644 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c3c96c16-9f1b-4484-a6f1-1d6ec18cc9fb tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:57.080267 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c3c96c16-9f1b-4484-a6f1-1d6ec18cc9fb tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 625f5fd3-d872-4da5-b176-5a70dfd8cfe2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:57.104395 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c3c96c16-9f1b-4484-a6f1-1d6ec18cc9fb tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:57.106797 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c3c96c16-9f1b-4484-a6f1-1d6ec18cc9fb tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:57.106797 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c3c96c16-9f1b-4484-a6f1-1d6ec18cc9fb tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:57.106797 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c3c96c16-9f1b-4484-a6f1-1d6ec18cc9fb tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:57.112907 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c3c96c16-9f1b-4484-a6f1-1d6ec18cc9fb tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:57.113451 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c3c96c16-9f1b-4484-a6f1-1d6ec18cc9fb tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:57.257419 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c3c96c16-9f1b-4484-a6f1-1d6ec18cc9fb tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278977b201c48dda2d73823fbfe4833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a31be22cc451b92af447ed8d81242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:57.267516 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c3c96c16-9f1b-4484-a6f1-1d6ec18cc9fb tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2" status: 200 len: 1646 microversion: 2.1 time: 0.192507 Sep 24 20:53:57.271255 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-926fc5d2-6aeb-423f-ac68-2f795e0cb647 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:57.280469 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-926fc5d2-6aeb-423f-ac68-2f795e0cb647 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1468 microversion: 2.1 time: 0.380919 Sep 24 20:53:57.281774 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 657/1336] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:56 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1468 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:57.286214 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 679/1336] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:57 2022] GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2 => generated 1646 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:57.288155 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ceb9ad30-734e-4e44-8a2a-78018885a535 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:57.289505 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ceb9ad30-734e-4e44-8a2a-78018885a535 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] [instance: 048b3539-80cb-4d73-9280-b62713ddb588] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:57.298482 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ceb9ad30-734e-4e44-8a2a-78018885a535 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:57.299820 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ceb9ad30-734e-4e44-8a2a-78018885a535 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:57.300826 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ceb9ad30-734e-4e44-8a2a-78018885a535 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:57.302080 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e5ee1811-dffd-4705-9171-0f7ac04b6eae tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c6e1dda-a103-4e0d-b86a-6da231607ef6", "device": "/dev/xvdb"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:57.303777 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ceb9ad30-734e-4e44-8a2a-78018885a535 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:57.304533 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ceb9ad30-734e-4e44-8a2a-78018885a535 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:57.305179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ceb9ad30-734e-4e44-8a2a-78018885a535 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:57.312079 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e5ee1811-dffd-4705-9171-0f7ac04b6eae tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:57.323163 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5ee1811-dffd-4705-9171-0f7ac04b6eae tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:57.326005 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5ee1811-dffd-4705-9171-0f7ac04b6eae tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:57.326673 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5ee1811-dffd-4705-9171-0f7ac04b6eae tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:57.327587 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5ee1811-dffd-4705-9171-0f7ac04b6eae tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:57.328279 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5ee1811-dffd-4705-9171-0f7ac04b6eae tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:57.329712 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5ee1811-dffd-4705-9171-0f7ac04b6eae tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:57.562734 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ceb9ad30-734e-4e44-8a2a-78018885a535 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d241b5c9b654fa7bf97f3652186ea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a0417c2ae142c48e41a41a495ea988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:57.574568 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ceb9ad30-734e-4e44-8a2a-78018885a535 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588" status: 200 len: 1317 microversion: 2.1 time: 0.291390 Sep 24 20:53:57.576274 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 658/1337] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:57 2022] GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588 => generated 1317 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:57.586206 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d5cf70d5-036b-49d9-b3d7-4ebc28df9f7d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '.version_select at 0x7f4b0c5ff4c0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:57.667641 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-d5cf70d5-036b-49d9-b3d7-4ebc28df9f7d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] HTTP exception thrown: Image not found. Sep 24 20:53:57.670598 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d5cf70d5-036b-49d9-b3d7-4ebc28df9f7d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Request method failure captured: Sep 24 20:53:57.670598 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/images/1bed2b7f-72b2-4601-a6c9-62e647355ee5 HTTP/1.1 Sep 24 20:53:57.670598 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:53:57.670598 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:53:57.670598 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:53:57.670598 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:53:57.670598 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:53:57.670598 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:53:57.670598 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:53:57.670598 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:53:57.670598 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL23hSaMAKT8B-JdjtYs2UoED1UAMalIeRO9Th3athHCHzrGhfs9Sy0_hBzkoXpxV7aas8iy4VFycxPqE3-ST396dY35DaR9MZAQlds-eQBPgVm84hG8pTTOjeXtJegh8tOCUNbJFm6JLpFNRAi1C2IykufgxtCoO69ROBtQmrT9YEmI Sep 24 20:53:57.670598 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:53:57.670598 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:53:57.670598 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:53:57.670598 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:53:57.670598 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:53:57.670598 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:53:57.670598 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: e175cb4032ec4e6aa900141abbaa04c4 Sep 24 20:53:57.670598 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:53:57.670598 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:53:57.670598 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:53:57.672250 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:53:57.672250 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:53:57.672250 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: e175cb4032ec4e6aa900141abbaa04c4 Sep 24 20:53:57.672250 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:53:57.672250 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ImagesOneServerNegativeTestJSON-1825846347-project Sep 24 20:53:57.672250 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:53:57.672250 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:53:57.672250 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 6db52cb259fa426d860f9c9a48a149f3 Sep 24 20:53:57.672250 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347-project Sep 24 20:53:57.672250 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:53:57.672250 ncdv-master-1 devstack@n-api.service[140516]: exception: Image not found. Sep 24 20:53:57.672250 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '1bed2b7f-72b2-4601-a6c9-62e647355ee5'} Sep 24 20:53:57.672250 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:53:57.673415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:57.673415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 24 20:53:57.673415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 24 20:53:57.673415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 24 20:53:57.673415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 24 20:53:57.673415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 24 20:53:57.673415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 24 20:53:57.673415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 24 20:53:57.673415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 24 20:53:57.673415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 24 20:53:57.673415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 24 20:53:57.673415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 24 20:53:57.673415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 24 20:53:57.673415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 24 20:53:57.673415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 24 20:53:57.673415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1bed2b7f-72b2-4601-a6c9-62e647355ee5 to delete Sep 24 20:53:57.673415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:57.673415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:53:57.673415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:57.676605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:57.676605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 24 20:53:57.676605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 24 20:53:57.676605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 24 20:53:57.676605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 24 20:53:57.676605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 24 20:53:57.676605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 24 20:53:57.676605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1bed2b7f-72b2-4601-a6c9-62e647355ee5 could not be found. Sep 24 20:53:57.676605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:57.676605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:53:57.676605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:57.676605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:57.676605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:53:57.676605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:53:57.676605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:53:57.676605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:53:57.676605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:53:57.676605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:53:57.676605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:53:57.676605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:53:57.678466 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 24 20:53:57.678466 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 24 20:53:57.678466 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 24 20:53:57.678466 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:57.678466 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:53:57.678466 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:57.678466 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:57.678466 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:53:57.678466 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:53:57.678466 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:53:57.678466 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:53:57.678466 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 24 20:53:57.678466 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:57.678466 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d5cf70d5-036b-49d9-b3d7-4ebc28df9f7d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Returning 404 to user: Image not found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:53:57.678466 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d5cf70d5-036b-49d9-b3d7-4ebc28df9f7d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "DELETE /compute/v2.1/images/1bed2b7f-72b2-4601-a6c9-62e647355ee5" status: 404 len: 62 microversion: 2.1 time: 0.095781 Sep 24 20:53:57.680337 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 659/1338] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:57 2022] DELETE /compute/v2.1/images/1bed2b7f-72b2-4601-a6c9-62e647355ee5 => generated 62 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 20:53:57.693325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8009c8d7-6e11-4ce9-a74c-42848859048d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:57.694262 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8009c8d7-6e11-4ce9-a74c-42848859048d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: b4b8b488-a1f1-42fb-b34a-04005d670e7b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:57.708654 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8009c8d7-6e11-4ce9-a74c-42848859048d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:57.709489 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8009c8d7-6e11-4ce9-a74c-42848859048d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:57.710265 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8009c8d7-6e11-4ce9-a74c-42848859048d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:57.711990 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8009c8d7-6e11-4ce9-a74c-42848859048d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:57.718568 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8009c8d7-6e11-4ce9-a74c-42848859048d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:57.719412 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8009c8d7-6e11-4ce9-a74c-42848859048d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:57.726391 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:57.745013 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-8009c8d7-6e11-4ce9-a74c-42848859048d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] HTTP exception thrown: Instance b4b8b488-a1f1-42fb-b34a-04005d670e7b could not be found. Sep 24 20:53:57.747372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8009c8d7-6e11-4ce9-a74c-42848859048d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Request method failure captured: Sep 24 20:53:57.747372 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b HTTP/1.1 Sep 24 20:53:57.747372 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:53:57.747372 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:53:57.747372 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:53:57.747372 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:53:57.747372 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:53:57.747372 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:53:57.747372 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:53:57.747372 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:53:57.747372 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL23hSaMAKT8B-JdjtYs2UoED1UAMalIeRO9Th3athHCHzrGhfs9Sy0_hBzkoXpxV7aas8iy4VFycxPqE3-ST396dY35DaR9MZAQlds-eQBPgVm84hG8pTTOjeXtJegh8tOCUNbJFm6JLpFNRAi1C2IykufgxtCoO69ROBtQmrT9YEmI Sep 24 20:53:57.747372 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:53:57.747372 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:53:57.747372 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:53:57.747372 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:53:57.747372 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:53:57.747372 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:53:57.747372 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: e175cb4032ec4e6aa900141abbaa04c4 Sep 24 20:53:57.747372 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:53:57.747372 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:53:57.747372 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:53:57.748833 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:53:57.748833 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:53:57.748833 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: e175cb4032ec4e6aa900141abbaa04c4 Sep 24 20:53:57.748833 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:53:57.748833 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ImagesOneServerNegativeTestJSON-1825846347-project Sep 24 20:53:57.748833 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:53:57.748833 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:53:57.748833 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 6db52cb259fa426d860f9c9a48a149f3 Sep 24 20:53:57.748833 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347-project Sep 24 20:53:57.748833 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:53:57.748833 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance b4b8b488-a1f1-42fb-b34a-04005d670e7b could not be found. Sep 24 20:53:57.748833 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'b4b8b488-a1f1-42fb-b34a-04005d670e7b'} Sep 24 20:53:57.749710 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:53:57.749710 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:57.749710 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:53:57.749710 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:53:57.749710 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:53:57.749710 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:53:57.749710 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:53:57.749710 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:53:57.749710 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:53:57.749710 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:53:57.749710 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4b8b488-a1f1-42fb-b34a-04005d670e7b could not be found. Sep 24 20:53:57.749710 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:57.749710 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:53:57.749710 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:57.749710 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:57.749710 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:53:57.749710 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:53:57.749710 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:53:57.749710 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:53:57.749710 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:53:57.751163 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:53:57.751163 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 20:53:57.751163 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 20:53:57.751163 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 20:53:57.751163 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 20:53:57.751163 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:53:57.751163 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:53:57.751163 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:53:57.751163 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:53:57.751163 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4b8b488-a1f1-42fb-b34a-04005d670e7b could not be found. Sep 24 20:53:57.751163 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:57.751163 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:53:57.751163 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:57.751163 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:57.751163 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:53:57.751163 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:53:57.751163 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:53:57.751163 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:53:57.751163 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4b8b488-a1f1-42fb-b34a-04005d670e7b could not be found. Sep 24 20:53:57.751163 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:57.756651 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8009c8d7-6e11-4ce9-a74c-42848859048d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Returning 404 to user: Instance b4b8b488-a1f1-42fb-b34a-04005d670e7b could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:53:57.757748 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8009c8d7-6e11-4ce9-a74c-42848859048d tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b" status: 404 len: 111 microversion: 2.1 time: 0.074989 Sep 24 20:53:57.759629 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 660/1339] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:53:57 2022] DELETE /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:53:57.769841 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1895580b-ef4d-4d61-82f1-72f542e3ce5c tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:57.771292 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1895580b-ef4d-4d61-82f1-72f542e3ce5c tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] [instance: b4b8b488-a1f1-42fb-b34a-04005d670e7b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:57.781821 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1895580b-ef4d-4d61-82f1-72f542e3ce5c tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:57.782657 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1895580b-ef4d-4d61-82f1-72f542e3ce5c tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:57.783290 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1895580b-ef4d-4d61-82f1-72f542e3ce5c tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:57.785073 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1895580b-ef4d-4d61-82f1-72f542e3ce5c tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:57.786018 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1895580b-ef4d-4d61-82f1-72f542e3ce5c tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:57.787417 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1895580b-ef4d-4d61-82f1-72f542e3ce5c tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:57.809987 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-1895580b-ef4d-4d61-82f1-72f542e3ce5c tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] HTTP exception thrown: Instance b4b8b488-a1f1-42fb-b34a-04005d670e7b could not be found. Sep 24 20:53:57.811730 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1895580b-ef4d-4d61-82f1-72f542e3ce5c tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Request method failure captured: Sep 24 20:53:57.811730 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b HTTP/1.1 Sep 24 20:53:57.811730 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:53:57.811730 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:53:57.811730 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:53:57.811730 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:53:57.811730 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:53:57.811730 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:53:57.811730 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:53:57.811730 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:53:57.811730 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL23hSaMAKT8B-JdjtYs2UoED1UAMalIeRO9Th3athHCHzrGhfs9Sy0_hBzkoXpxV7aas8iy4VFycxPqE3-ST396dY35DaR9MZAQlds-eQBPgVm84hG8pTTOjeXtJegh8tOCUNbJFm6JLpFNRAi1C2IykufgxtCoO69ROBtQmrT9YEmI Sep 24 20:53:57.811730 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:53:57.811730 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:53:57.811730 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:53:57.811730 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:53:57.811730 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:53:57.811730 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:53:57.811730 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: e175cb4032ec4e6aa900141abbaa04c4 Sep 24 20:53:57.811730 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:53:57.811730 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:53:57.811730 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:53:57.813321 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e175cb4032ec4e6aa900141abbaa04c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:53:57.813321 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:53:57.813321 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: e175cb4032ec4e6aa900141abbaa04c4 Sep 24 20:53:57.813321 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347 Sep 24 20:53:57.813321 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ImagesOneServerNegativeTestJSON-1825846347-project Sep 24 20:53:57.813321 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:53:57.813321 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:53:57.813321 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 6db52cb259fa426d860f9c9a48a149f3 Sep 24 20:53:57.813321 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1825846347-project Sep 24 20:53:57.813321 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:53:57.813321 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance b4b8b488-a1f1-42fb-b34a-04005d670e7b could not be found. Sep 24 20:53:57.813321 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'b4b8b488-a1f1-42fb-b34a-04005d670e7b'} Sep 24 20:53:57.814164 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:53:57.814164 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:57.814164 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:53:57.814164 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:53:57.814164 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:53:57.814164 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:53:57.814164 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:53:57.814164 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:53:57.814164 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:53:57.814164 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:53:57.814164 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4b8b488-a1f1-42fb-b34a-04005d670e7b could not be found. Sep 24 20:53:57.814164 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:57.814164 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:53:57.814164 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:57.814164 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:57.814164 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:53:57.814164 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:53:57.814164 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:53:57.814164 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:53:57.814164 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:53:57.815406 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:53:57.815406 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:53:57.815406 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:53:57.815406 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:53:57.815406 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:53:57.815406 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:53:57.815406 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:53:57.815406 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4b8b488-a1f1-42fb-b34a-04005d670e7b could not be found. Sep 24 20:53:57.815406 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:57.815406 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:53:57.815406 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:57.815406 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:57.815406 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:53:57.815406 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:53:57.815406 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:53:57.815406 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:53:57.815406 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4b8b488-a1f1-42fb-b34a-04005d670e7b could not be found. Sep 24 20:53:57.815406 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:57.816481 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1895580b-ef4d-4d61-82f1-72f542e3ce5c tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] Returning 404 to user: Instance b4b8b488-a1f1-42fb-b34a-04005d670e7b could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:53:57.816481 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1895580b-ef4d-4d61-82f1-72f542e3ce5c tempest-ImagesOneServerNegativeTestJSON-1825846347 tempest-ImagesOneServerNegativeTestJSON-1825846347-project] 10.222.0.52 "GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b" status: 404 len: 111 microversion: 2.1 time: 0.049717 Sep 24 20:53:57.816481 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 661/1340] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:57 2022] GET /compute/v2.1/servers/b4b8b488-a1f1-42fb-b34a-04005d670e7b => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:53:57.922758 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e8c822cb-6737-475d-803e-7bb7342de6db tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:57.923429 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e8c822cb-6737-475d-803e-7bb7342de6db tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:57.944593 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e8c822cb-6737-475d-803e-7bb7342de6db tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:57.945107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e8c822cb-6737-475d-803e-7bb7342de6db tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:57.945674 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e8c822cb-6737-475d-803e-7bb7342de6db tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:57.952717 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e8c822cb-6737-475d-803e-7bb7342de6db tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:57.953299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e8c822cb-6737-475d-803e-7bb7342de6db tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:57.953756 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e8c822cb-6737-475d-803e-7bb7342de6db tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:58.010036 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e5ee1811-dffd-4705-9171-0f7ac04b6eae tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "POST /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.717512 Sep 24 20:53:58.010957 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 680/1341] 10.222.0.52 () {60 vars in 1323 bytes} [Sat Sep 24 20:53:57 2022] POST /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3/os-volume_attachments => generated 194 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:53:58.311374 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a40d8664-4ad8-4fb3-8056-017c7f6418e4 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:58.314789 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a40d8664-4ad8-4fb3-8056-017c7f6418e4 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 625f5fd3-d872-4da5-b176-5a70dfd8cfe2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:58.325697 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a40d8664-4ad8-4fb3-8056-017c7f6418e4 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:58.327907 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a40d8664-4ad8-4fb3-8056-017c7f6418e4 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:58.328991 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a40d8664-4ad8-4fb3-8056-017c7f6418e4 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:58.330301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a40d8664-4ad8-4fb3-8056-017c7f6418e4 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:58.332849 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a40d8664-4ad8-4fb3-8056-017c7f6418e4 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:58.334478 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a40d8664-4ad8-4fb3-8056-017c7f6418e4 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:58.383142 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a40d8664-4ad8-4fb3-8056-017c7f6418e4 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:58.384306 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a40d8664-4ad8-4fb3-8056-017c7f6418e4 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:58.384978 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a40d8664-4ad8-4fb3-8056-017c7f6418e4 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:58.390903 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-a40d8664-4ad8-4fb3-8056-017c7f6418e4 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lazy-loading 'fault' on Instance uuid 625f5fd3-d872-4da5-b176-5a70dfd8cfe2 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:53:58.530952 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a40d8664-4ad8-4fb3-8056-017c7f6418e4 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd278977b201c48dda2d73823fbfe4833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a31be22cc451b92af447ed8d81242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:58.552566 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a40d8664-4ad8-4fb3-8056-017c7f6418e4 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2" status: 200 len: 1355 microversion: 2.1 time: 0.249700 Sep 24 20:53:58.554010 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 681/1342] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:58 2022] GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2 => generated 1355 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:53:58.560941 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dc8a377b-5c86-40c1-a89b-e3c2290e1e35 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:58.561887 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dc8a377b-5c86-40c1-a89b-e3c2290e1e35 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:58.570001 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc8a377b-5c86-40c1-a89b-e3c2290e1e35 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:58.570844 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc8a377b-5c86-40c1-a89b-e3c2290e1e35 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:58.571542 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc8a377b-5c86-40c1-a89b-e3c2290e1e35 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:58.573555 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc8a377b-5c86-40c1-a89b-e3c2290e1e35 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:58.574968 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc8a377b-5c86-40c1-a89b-e3c2290e1e35 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:58.575790 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc8a377b-5c86-40c1-a89b-e3c2290e1e35 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:58.816690 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e8c822cb-6737-475d-803e-7bb7342de6db tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:58.827790 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e8c822cb-6737-475d-803e-7bb7342de6db tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d" status: 200 len: 1316 microversion: 2.1 time: 0.908984 Sep 24 20:53:58.828957 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 662/1343] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:57 2022] GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d => generated 1316 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:58.836263 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-84107a06-d661-4377-a0f4-0ebcf23c6708 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:58.837150 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-84107a06-d661-4377-a0f4-0ebcf23c6708 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] [instance: 048b3539-80cb-4d73-9280-b62713ddb588] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:58.846905 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-84107a06-d661-4377-a0f4-0ebcf23c6708 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:58.847839 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-84107a06-d661-4377-a0f4-0ebcf23c6708 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:58.848478 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-84107a06-d661-4377-a0f4-0ebcf23c6708 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:58.849432 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-84107a06-d661-4377-a0f4-0ebcf23c6708 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:58.850077 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-84107a06-d661-4377-a0f4-0ebcf23c6708 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:58.850905 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-84107a06-d661-4377-a0f4-0ebcf23c6708 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:59.479643 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dc8a377b-5c86-40c1-a89b-e3c2290e1e35 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:59.491198 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dc8a377b-5c86-40c1-a89b-e3c2290e1e35 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1468 microversion: 2.1 time: 0.935109 Sep 24 20:53:59.503001 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 682/1344] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:58 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1468 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:59.508169 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-f91bf40f-a89c-4f95-b479-3861c732a06c req-d9a1fcc7-380b-4571-93e5-908a52108280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d", "name": "network-vif-plugged", "status": "completed", "tag": "6f3a76e4-02e8-411b-ac48-84a50c0d2403"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:53:59.530323 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-f91bf40f-a89c-4f95-b479-3861c732a06c req-d9a1fcc7-380b-4571-93e5-908a52108280 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:59.530834 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-f91bf40f-a89c-4f95-b479-3861c732a06c req-d9a1fcc7-380b-4571-93e5-908a52108280 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:59.532791 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-f91bf40f-a89c-4f95-b479-3861c732a06c req-d9a1fcc7-380b-4571-93e5-908a52108280 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:59.559268 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-f91bf40f-a89c-4f95-b479-3861c732a06c req-d9a1fcc7-380b-4571-93e5-908a52108280 service nova] Creating event network-vif-plugged:6f3a76e4-02e8-411b-ac48-84a50c0d2403 for instance cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d on nch2-master-1 Sep 24 20:53:59.572690 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-f91bf40f-a89c-4f95-b479-3861c732a06c req-d9a1fcc7-380b-4571-93e5-908a52108280 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068094 Sep 24 20:53:59.579123 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 683/1345] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:53:59.589736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3853e086-faf2-4be2-82a0-74d33f87e394 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:59.594755 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3853e086-faf2-4be2-82a0-74d33f87e394 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 625f5fd3-d872-4da5-b176-5a70dfd8cfe2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:59.604209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3853e086-faf2-4be2-82a0-74d33f87e394 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:59.604638 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3853e086-faf2-4be2-82a0-74d33f87e394 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:59.605083 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3853e086-faf2-4be2-82a0-74d33f87e394 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:59.607387 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3853e086-faf2-4be2-82a0-74d33f87e394 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:59.608329 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3853e086-faf2-4be2-82a0-74d33f87e394 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:59.609681 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3853e086-faf2-4be2-82a0-74d33f87e394 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:59.652731 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-3853e086-faf2-4be2-82a0-74d33f87e394 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] HTTP exception thrown: Instance 625f5fd3-d872-4da5-b176-5a70dfd8cfe2 could not be found. Sep 24 20:53:59.655885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-84107a06-d661-4377-a0f4-0ebcf23c6708 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d241b5c9b654fa7bf97f3652186ea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a0417c2ae142c48e41a41a495ea988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:53:59.675908 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3853e086-faf2-4be2-82a0-74d33f87e394 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Request method failure captured: Sep 24 20:53:59.675908 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2 HTTP/1.1 Sep 24 20:53:59.675908 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:53:59.675908 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:53:59.675908 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:53:59.675908 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:53:59.675908 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:53:59.675908 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:53:59.675908 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:53:59.675908 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:53:59.675908 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL21pAbLhFQJ05UONnnN4wNI0WrL-gY9r7xq5p3GoLlNRpVDYgBj9Hwhk_a2fLemPvH8jFXafRiu0Asi6_GdyZjeQBfBjCcHUjs8PstE14Wud-QKBNCtmgDY4x9txHGYFntGCvyIf4e2aEBQXKvLpvbyeA7uNJ9FHoiE2aA2fCo_XAe0 Sep 24 20:53:59.675908 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:53:59.675908 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:53:59.675908 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:53:59.675908 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:53:59.675908 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:53:59.675908 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:53:59.675908 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 478a31be22cc451b92af447ed8d81242 Sep 24 20:53:59.675908 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-299372410 Sep 24 20:53:59.675908 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:53:59.675908 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:53:59.677406 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/478a31be22cc451b92af447ed8d81242"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_478a31be22cc451b92af447ed8d81242"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/478a31be22cc451b92af447ed8d81242"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/478a31be22cc451b92af447ed8d81242"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:53:59.677406 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-299372410 Sep 24 20:53:59.677406 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 478a31be22cc451b92af447ed8d81242 Sep 24 20:53:59.677406 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-299372410 Sep 24 20:53:59.677406 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersWithSpecificFlavorTestJSON-299372410-project Sep 24 20:53:59.677406 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:53:59.677406 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:53:59.677406 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: d278977b201c48dda2d73823fbfe4833 Sep 24 20:53:59.677406 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-299372410-project Sep 24 20:53:59.677406 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:53:59.677406 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 625f5fd3-d872-4da5-b176-5a70dfd8cfe2 could not be found. Sep 24 20:53:59.677406 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '625f5fd3-d872-4da5-b176-5a70dfd8cfe2'} Sep 24 20:53:59.678203 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:53:59.678203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:59.678203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:53:59.678203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:53:59.678203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:53:59.678203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:53:59.678203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:53:59.678203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:53:59.678203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:53:59.678203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:53:59.678203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 625f5fd3-d872-4da5-b176-5a70dfd8cfe2 could not be found. Sep 24 20:53:59.678203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:53:59.678203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:53:59.678203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:53:59.678203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:59.678203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:53:59.678203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:53:59.678203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:53:59.678203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:53:59.678203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:53:59.679442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:53:59.679442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:53:59.679442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:53:59.679442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:53:59.679442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:53:59.679442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:53:59.679442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:53:59.679442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 625f5fd3-d872-4da5-b176-5a70dfd8cfe2 could not be found. Sep 24 20:53:59.679442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:53:59.679442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:53:59.679442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:53:59.679442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:59.679442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:53:59.679442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:53:59.679442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:53:59.679442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:53:59.679442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 625f5fd3-d872-4da5-b176-5a70dfd8cfe2 could not be found. Sep 24 20:53:59.679442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:53:59.685122 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3853e086-faf2-4be2-82a0-74d33f87e394 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Returning 404 to user: Instance 625f5fd3-d872-4da5-b176-5a70dfd8cfe2 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:53:59.685122 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3853e086-faf2-4be2-82a0-74d33f87e394 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2" status: 404 len: 111 microversion: 2.1 time: 0.095750 Sep 24 20:53:59.685469 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-84107a06-d661-4377-a0f4-0ebcf23c6708 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588" status: 200 len: 1317 microversion: 2.1 time: 0.848115 Sep 24 20:53:59.685469 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 663/1346] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:58 2022] GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588 => generated 1317 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:53:59.696639 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 684/1347] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:59 2022] GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:53:59.705836 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-674e5843-c7ab-4775-bf74-c0b549f0d255 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:59.707051 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-674e5843-c7ab-4775-bf74-c0b549f0d255 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 9b0e9940-f6ac-46d5-8898-1e4ba56119b3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:59.714323 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-674e5843-c7ab-4775-bf74-c0b549f0d255 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:59.715071 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-674e5843-c7ab-4775-bf74-c0b549f0d255 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:59.715711 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-674e5843-c7ab-4775-bf74-c0b549f0d255 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:59.716600 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-674e5843-c7ab-4775-bf74-c0b549f0d255 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:59.717242 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-674e5843-c7ab-4775-bf74-c0b549f0d255 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:59.717841 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-674e5843-c7ab-4775-bf74-c0b549f0d255 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:59.737501 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-674e5843-c7ab-4775-bf74-c0b549f0d255 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] HTTP exception thrown: Instance 9b0e9940-f6ac-46d5-8898-1e4ba56119b3 could not be found. Sep 24 20:53:59.739387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-674e5843-c7ab-4775-bf74-c0b549f0d255 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Request method failure captured: Sep 24 20:53:59.739387 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3 HTTP/1.1 Sep 24 20:53:59.739387 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:53:59.739387 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:53:59.739387 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:53:59.739387 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:53:59.739387 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:53:59.739387 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:53:59.739387 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:53:59.739387 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:53:59.739387 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL21pAbLhFQJ05UONnnN4wNI0WrL-gY9r7xq5p3GoLlNRpVDYgBj9Hwhk_a2fLemPvH8jFXafRiu0Asi6_GdyZjeQBfBjCcHUjs8PstE14Wud-QKBNCtmgDY4x9txHGYFntGCvyIf4e2aEBQXKvLpvbyeA7uNJ9FHoiE2aA2fCo_XAe0 Sep 24 20:53:59.739387 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:53:59.739387 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:53:59.739387 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:53:59.739387 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:53:59.739387 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:53:59.739387 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:53:59.739387 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 478a31be22cc451b92af447ed8d81242 Sep 24 20:53:59.739387 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-299372410 Sep 24 20:53:59.739387 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:53:59.739387 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:53:59.740924 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/478a31be22cc451b92af447ed8d81242"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_478a31be22cc451b92af447ed8d81242"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/478a31be22cc451b92af447ed8d81242"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/478a31be22cc451b92af447ed8d81242"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:53:59.740924 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-299372410 Sep 24 20:53:59.740924 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 478a31be22cc451b92af447ed8d81242 Sep 24 20:53:59.740924 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-299372410 Sep 24 20:53:59.740924 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersWithSpecificFlavorTestJSON-299372410-project Sep 24 20:53:59.740924 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:53:59.740924 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:53:59.740924 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: d278977b201c48dda2d73823fbfe4833 Sep 24 20:53:59.740924 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-299372410-project Sep 24 20:53:59.740924 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:53:59.740924 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 9b0e9940-f6ac-46d5-8898-1e4ba56119b3 could not be found. Sep 24 20:53:59.740924 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '9b0e9940-f6ac-46d5-8898-1e4ba56119b3'} Sep 24 20:53:59.741800 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:53:59.741800 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:59.741800 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:53:59.741800 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:53:59.741800 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:53:59.741800 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:53:59.741800 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:53:59.741800 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:53:59.741800 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:53:59.741800 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:53:59.741800 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b0e9940-f6ac-46d5-8898-1e4ba56119b3 could not be found. Sep 24 20:53:59.741800 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:59.741800 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:53:59.741800 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:59.741800 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:59.741800 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:53:59.741800 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:53:59.741800 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:53:59.741800 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:53:59.741800 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:53:59.743515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:53:59.743515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 20:53:59.743515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 20:53:59.743515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 20:53:59.743515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 20:53:59.743515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:53:59.743515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:53:59.743515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:53:59.743515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:53:59.743515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b0e9940-f6ac-46d5-8898-1e4ba56119b3 could not be found. Sep 24 20:53:59.743515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:59.743515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:53:59.743515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:59.743515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:59.743515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:53:59.743515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:53:59.743515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:53:59.743515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:53:59.743515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b0e9940-f6ac-46d5-8898-1e4ba56119b3 could not be found. Sep 24 20:53:59.743515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:53:59.746794 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-674e5843-c7ab-4775-bf74-c0b549f0d255 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Returning 404 to user: Instance 9b0e9940-f6ac-46d5-8898-1e4ba56119b3 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:53:59.747863 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-674e5843-c7ab-4775-bf74-c0b549f0d255 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3" status: 404 len: 111 microversion: 2.1 time: 0.046781 Sep 24 20:53:59.748643 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 664/1348] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:53:59 2022] DELETE /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:53:59.757550 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6011ae0c-3cfc-45ce-b676-5ea773a24477 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:59.758553 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6011ae0c-3cfc-45ce-b676-5ea773a24477 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 9b0e9940-f6ac-46d5-8898-1e4ba56119b3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:59.767344 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6011ae0c-3cfc-45ce-b676-5ea773a24477 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:59.768747 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6011ae0c-3cfc-45ce-b676-5ea773a24477 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:59.769398 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6011ae0c-3cfc-45ce-b676-5ea773a24477 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:59.770320 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6011ae0c-3cfc-45ce-b676-5ea773a24477 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:59.771005 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6011ae0c-3cfc-45ce-b676-5ea773a24477 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:59.772170 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6011ae0c-3cfc-45ce-b676-5ea773a24477 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:59.787861 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-6011ae0c-3cfc-45ce-b676-5ea773a24477 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] HTTP exception thrown: Instance 9b0e9940-f6ac-46d5-8898-1e4ba56119b3 could not be found. Sep 24 20:53:59.790218 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6011ae0c-3cfc-45ce-b676-5ea773a24477 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Request method failure captured: Sep 24 20:53:59.790218 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3 HTTP/1.1 Sep 24 20:53:59.790218 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:53:59.790218 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:53:59.790218 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:53:59.790218 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:53:59.790218 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:53:59.790218 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:53:59.790218 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:53:59.790218 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:53:59.790218 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL21pAbLhFQJ05UONnnN4wNI0WrL-gY9r7xq5p3GoLlNRpVDYgBj9Hwhk_a2fLemPvH8jFXafRiu0Asi6_GdyZjeQBfBjCcHUjs8PstE14Wud-QKBNCtmgDY4x9txHGYFntGCvyIf4e2aEBQXKvLpvbyeA7uNJ9FHoiE2aA2fCo_XAe0 Sep 24 20:53:59.790218 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:53:59.790218 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:53:59.790218 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:53:59.790218 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:53:59.790218 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:53:59.790218 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:53:59.790218 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 478a31be22cc451b92af447ed8d81242 Sep 24 20:53:59.790218 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-299372410 Sep 24 20:53:59.790218 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:53:59.790218 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:53:59.791602 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/478a31be22cc451b92af447ed8d81242"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_478a31be22cc451b92af447ed8d81242"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/478a31be22cc451b92af447ed8d81242"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/478a31be22cc451b92af447ed8d81242"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:53:59.791602 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-299372410 Sep 24 20:53:59.791602 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 478a31be22cc451b92af447ed8d81242 Sep 24 20:53:59.791602 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-299372410 Sep 24 20:53:59.791602 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersWithSpecificFlavorTestJSON-299372410-project Sep 24 20:53:59.791602 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:53:59.791602 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:53:59.791602 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: d278977b201c48dda2d73823fbfe4833 Sep 24 20:53:59.791602 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-299372410-project Sep 24 20:53:59.791602 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:53:59.791602 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 9b0e9940-f6ac-46d5-8898-1e4ba56119b3 could not be found. Sep 24 20:53:59.791602 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '9b0e9940-f6ac-46d5-8898-1e4ba56119b3'} Sep 24 20:53:59.792488 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:53:59.792488 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:59.792488 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:53:59.792488 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:53:59.792488 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:53:59.792488 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:53:59.792488 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:53:59.792488 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:53:59.792488 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:53:59.792488 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:53:59.792488 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b0e9940-f6ac-46d5-8898-1e4ba56119b3 could not be found. Sep 24 20:53:59.792488 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:53:59.792488 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:53:59.792488 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:53:59.792488 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:59.792488 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:53:59.792488 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:53:59.792488 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:53:59.792488 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:53:59.792488 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:53:59.793675 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:53:59.793675 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:53:59.793675 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:53:59.793675 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:53:59.793675 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:53:59.793675 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:53:59.793675 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:53:59.793675 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b0e9940-f6ac-46d5-8898-1e4ba56119b3 could not be found. Sep 24 20:53:59.793675 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:53:59.793675 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:53:59.793675 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:53:59.793675 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:53:59.793675 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:53:59.793675 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:53:59.793675 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:53:59.793675 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:53:59.793675 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b0e9940-f6ac-46d5-8898-1e4ba56119b3 could not be found. Sep 24 20:53:59.793675 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:53:59.795602 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6011ae0c-3cfc-45ce-b676-5ea773a24477 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Returning 404 to user: Instance 9b0e9940-f6ac-46d5-8898-1e4ba56119b3 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:53:59.796984 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6011ae0c-3cfc-45ce-b676-5ea773a24477 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3" status: 404 len: 111 microversion: 2.1 time: 0.043391 Sep 24 20:53:59.798140 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 685/1349] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:59 2022] GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:53:59.806324 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-22a71a3f-aeac-4ce6-900c-183e9059a4d3 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '.version_select at 0x7f4b0c413280>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:59.839604 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-22a71a3f-aeac-4ce6-900c-183e9059a4d3 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1715256276" status: 202 len: 0 microversion: 2.1 time: 0.037129 Sep 24 20:53:59.843905 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 665/1350] 10.222.0.52 () {58 vars in 1221 bytes} [Sat Sep 24 20:53:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1715256276 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:53:59.854707 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-12bdeac5-1d4f-4d48-b40a-e7de90aba480 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:53:59.856079 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-12bdeac5-1d4f-4d48-b40a-e7de90aba480 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:53:59.865204 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12bdeac5-1d4f-4d48-b40a-e7de90aba480 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:59.865917 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12bdeac5-1d4f-4d48-b40a-e7de90aba480 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:59.866722 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12bdeac5-1d4f-4d48-b40a-e7de90aba480 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:53:59.867801 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12bdeac5-1d4f-4d48-b40a-e7de90aba480 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:53:59.868554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12bdeac5-1d4f-4d48-b40a-e7de90aba480 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:53:59.869238 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12bdeac5-1d4f-4d48-b40a-e7de90aba480 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:00.358804 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-12bdeac5-1d4f-4d48-b40a-e7de90aba480 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:00.368157 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-12bdeac5-1d4f-4d48-b40a-e7de90aba480 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d" status: 200 len: 1316 microversion: 2.1 time: 0.517653 Sep 24 20:54:00.374474 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 686/1351] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:53:59 2022] GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d => generated 1316 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:00.525001 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-62da5ebd-a0e9-40fc-9894-6be44eed52a3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:00.527005 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-62da5ebd-a0e9-40fc-9894-6be44eed52a3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:00.539428 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62da5ebd-a0e9-40fc-9894-6be44eed52a3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:00.541193 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62da5ebd-a0e9-40fc-9894-6be44eed52a3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:00.542722 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62da5ebd-a0e9-40fc-9894-6be44eed52a3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:00.544758 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62da5ebd-a0e9-40fc-9894-6be44eed52a3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:00.545963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62da5ebd-a0e9-40fc-9894-6be44eed52a3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:00.546986 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62da5ebd-a0e9-40fc-9894-6be44eed52a3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:00.703821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f80366e7-fb4b-4133-88dc-135c782b9c73 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:00.706672 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f80366e7-fb4b-4133-88dc-135c782b9c73 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] [instance: 048b3539-80cb-4d73-9280-b62713ddb588] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:00.719601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f80366e7-fb4b-4133-88dc-135c782b9c73 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:00.720625 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f80366e7-fb4b-4133-88dc-135c782b9c73 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:00.726677 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f80366e7-fb4b-4133-88dc-135c782b9c73 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:00.727669 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f80366e7-fb4b-4133-88dc-135c782b9c73 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:00.728262 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f80366e7-fb4b-4133-88dc-135c782b9c73 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:00.728806 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f80366e7-fb4b-4133-88dc-135c782b9c73 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:01.081629 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-62da5ebd-a0e9-40fc-9894-6be44eed52a3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:01.099497 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-62da5ebd-a0e9-40fc-9894-6be44eed52a3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1468 microversion: 2.1 time: 0.586034 Sep 24 20:54:01.102006 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 666/1352] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:00 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1468 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:01.107059 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-10eded81-78e3-497e-a020-cebda04c8cae tempest-ServersWithSpecificFlavorTestJSON-592449782 tempest-ServersWithSpecificFlavorTestJSON-592449782-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:01.130461 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-10eded81-78e3-497e-a020-cebda04c8cae tempest-ServersWithSpecificFlavorTestJSON-592449782 tempest-ServersWithSpecificFlavorTestJSON-592449782-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/285405344" status: 202 len: 0 microversion: 2.1 time: 0.027062 Sep 24 20:54:01.131103 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 667/1353] 10.222.0.52 () {58 vars in 1158 bytes} [Sat Sep 24 20:54:01 2022] DELETE /compute/v2.1/flavors/285405344 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:54:01.155854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f80366e7-fb4b-4133-88dc-135c782b9c73 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d241b5c9b654fa7bf97f3652186ea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a0417c2ae142c48e41a41a495ea988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:01.165455 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f80366e7-fb4b-4133-88dc-135c782b9c73 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588" status: 200 len: 1317 microversion: 2.1 time: 0.465919 Sep 24 20:54:01.179347 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 687/1354] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:00 2022] GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588 => generated 1317 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:54:01.179347 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9e4e122d-6b89-41f5-a4ef-43ec036aba9f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-31728293", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "4720b9f0-7a36-43a8-8f75-d94ac4c68f4c"}], "security_groups": [{"name": "tempest-securitygroup--1816061534"}], "key_name": "tempest-keypair-687707201", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:01.339167 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a1048d6b-2ea0-4d31-a163-6692477105de tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-859478809", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:01.369670 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-9e4e122d-6b89-41f5-a4ef-43ec036aba9f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] validate_networks() for [('4720b9f0-7a36-43a8-8f75-d94ac4c68f4c', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:54:01.438043 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-a1048d6b-2ea0-4d31-a163-6692477105de tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] validate_networks() for None {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:54:02.124464 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-a1048d6b-2ea0-4d31-a163-6692477105de tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:54:02.125090 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-a1048d6b-2ea0-4d31-a163-6692477105de tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:54:02.125378 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-a1048d6b-2ea0-4d31-a163-6692477105de tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:54:02.125797 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-a1048d6b-2ea0-4d31-a163-6692477105de tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:54:02.126223 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-a1048d6b-2ea0-4d31-a163-6692477105de tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:54:02.147135 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a1048d6b-2ea0-4d31-a163-6692477105de tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:02.147726 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a1048d6b-2ea0-4d31-a163-6692477105de tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:02.148185 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a1048d6b-2ea0-4d31-a163-6692477105de tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:02.148932 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a1048d6b-2ea0-4d31-a163-6692477105de tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:02.149400 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a1048d6b-2ea0-4d31-a163-6692477105de tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:02.150085 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a1048d6b-2ea0-4d31-a163-6692477105de tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:02.183708 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-a1048d6b-2ea0-4d31-a163-6692477105de tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Getting quotas for project 4b55ef17d925408093f5407fa8015787. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:54:02.189739 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-a1048d6b-2ea0-4d31-a163-6692477105de tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Getting quotas for user 2844f27200534323910d80cd869a6601 and project 4b55ef17d925408093f5407fa8015787. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:54:02.210607 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a1048d6b-2ea0-4d31-a163-6692477105de tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:54:02.213533 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a1048d6b-2ea0-4d31-a163-6692477105de tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 39c753b7-d223-4e33-9086-d64877d26ecc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:54:02.272458 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a1048d6b-2ea0-4d31-a163-6692477105de tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.140074 Sep 24 20:54:02.273155 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 668/1355] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:54:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1141 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:54:02.287252 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fa222fd8-b467-4e98-b07b-7206cbb8d5b2 tempest-ServersWithSpecificFlavorTestJSON-592449782 tempest-ServersWithSpecificFlavorTestJSON-592449782-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:02.325751 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fa222fd8-b467-4e98-b07b-7206cbb8d5b2 tempest-ServersWithSpecificFlavorTestJSON-592449782 tempest-ServersWithSpecificFlavorTestJSON-592449782-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.043452 Sep 24 20:54:02.326596 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 669/1356] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:54:02 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:02.333890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b0cd5822-2f44-46c7-b390-e96bffa27dd4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:02.334913 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b0cd5822-2f44-46c7-b390-e96bffa27dd4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:02.344680 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0cd5822-2f44-46c7-b390-e96bffa27dd4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:02.345445 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0cd5822-2f44-46c7-b390-e96bffa27dd4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:02.346152 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0cd5822-2f44-46c7-b390-e96bffa27dd4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:02.347801 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0cd5822-2f44-46c7-b390-e96bffa27dd4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:02.348422 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0cd5822-2f44-46c7-b390-e96bffa27dd4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:02.349021 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0cd5822-2f44-46c7-b390-e96bffa27dd4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:02.387701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-9e4e122d-6b89-41f5-a4ef-43ec036aba9f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:54:02.388295 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-9e4e122d-6b89-41f5-a4ef-43ec036aba9f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:54:02.388595 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-9e4e122d-6b89-41f5-a4ef-43ec036aba9f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:54:02.389009 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-9e4e122d-6b89-41f5-a4ef-43ec036aba9f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:54:02.389427 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-9e4e122d-6b89-41f5-a4ef-43ec036aba9f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:54:02.413668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9e4e122d-6b89-41f5-a4ef-43ec036aba9f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:02.414167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9e4e122d-6b89-41f5-a4ef-43ec036aba9f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:02.414640 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9e4e122d-6b89-41f5-a4ef-43ec036aba9f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:02.415376 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9e4e122d-6b89-41f5-a4ef-43ec036aba9f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:02.415878 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9e4e122d-6b89-41f5-a4ef-43ec036aba9f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:02.417224 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9e4e122d-6b89-41f5-a4ef-43ec036aba9f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:02.442777 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-9e4e122d-6b89-41f5-a4ef-43ec036aba9f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Getting quotas for project f3c583f2016e4edd94aeec7dd64f9673. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:54:02.450307 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-9e4e122d-6b89-41f5-a4ef-43ec036aba9f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Getting quotas for user ca78cf6d34e84f2cb5cb254c5d8af1da and project f3c583f2016e4edd94aeec7dd64f9673. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:54:02.468315 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9e4e122d-6b89-41f5-a4ef-43ec036aba9f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:54:02.471165 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9e4e122d-6b89-41f5-a4ef-43ec036aba9f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:54:02.536358 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9e4e122d-6b89-41f5-a4ef-43ec036aba9f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.368691 Sep 24 20:54:02.537610 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 688/1357] 10.222.0.52 () {62 vars in 1188 bytes} [Sat Sep 24 20:54:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 1371 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 24 20:54:02.542740 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-9889cb3b-873d-499d-892b-601221af5291 req-8fa94f75-a309-445f-a5f5-e06f70756fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "048b3539-80cb-4d73-9280-b62713ddb588", "name": "network-vif-plugged", "status": "completed", "tag": "018d9d05-4694-4f6a-8a92-2c61652eab6e"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:02.557837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-9889cb3b-873d-499d-892b-601221af5291 req-8fa94f75-a309-445f-a5f5-e06f70756fd3 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:02.558736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-9889cb3b-873d-499d-892b-601221af5291 req-8fa94f75-a309-445f-a5f5-e06f70756fd3 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:02.559607 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-9889cb3b-873d-499d-892b-601221af5291 req-8fa94f75-a309-445f-a5f5-e06f70756fd3 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:02.588901 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b0cd5822-2f44-46c7-b390-e96bffa27dd4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:02.592647 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-9889cb3b-873d-499d-892b-601221af5291 req-8fa94f75-a309-445f-a5f5-e06f70756fd3 service nova] Creating event network-vif-plugged:018d9d05-4694-4f6a-8a92-2c61652eab6e for instance 048b3539-80cb-4d73-9280-b62713ddb588 on nch1-master-1 Sep 24 20:54:02.599072 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b0cd5822-2f44-46c7-b390-e96bffa27dd4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d" status: 200 len: 1466 microversion: 2.1 time: 0.270992 Sep 24 20:54:02.600490 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-9889cb3b-873d-499d-892b-601221af5291 req-8fa94f75-a309-445f-a5f5-e06f70756fd3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061088 Sep 24 20:54:02.604184 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 670/1358] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:02 2022] GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d => generated 1466 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:02.606610 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 689/1359] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:54:02.620803 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e27dc9a8-e458-46c3-8b71-1e119cbca14c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:02.621535 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e27dc9a8-e458-46c3-8b71-1e119cbca14c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:02.626871 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3dcfa4d8-597f-4065-b0f6-e18c8ace91f2 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:02.628211 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3dcfa4d8-597f-4065-b0f6-e18c8ace91f2 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] [instance: 048b3539-80cb-4d73-9280-b62713ddb588] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:02.651271 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e27dc9a8-e458-46c3-8b71-1e119cbca14c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:02.652081 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e27dc9a8-e458-46c3-8b71-1e119cbca14c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:02.652728 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e27dc9a8-e458-46c3-8b71-1e119cbca14c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:02.653816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e27dc9a8-e458-46c3-8b71-1e119cbca14c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:02.654470 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e27dc9a8-e458-46c3-8b71-1e119cbca14c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:02.655278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e27dc9a8-e458-46c3-8b71-1e119cbca14c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:02.662702 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3dcfa4d8-597f-4065-b0f6-e18c8ace91f2 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:02.663476 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3dcfa4d8-597f-4065-b0f6-e18c8ace91f2 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:02.665146 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3dcfa4d8-597f-4065-b0f6-e18c8ace91f2 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:02.666048 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3dcfa4d8-597f-4065-b0f6-e18c8ace91f2 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:02.669648 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3dcfa4d8-597f-4065-b0f6-e18c8ace91f2 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:02.670410 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3dcfa4d8-597f-4065-b0f6-e18c8ace91f2 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:03.025787 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e27dc9a8-e458-46c3-8b71-1e119cbca14c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:03.037194 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e27dc9a8-e458-46c3-8b71-1e119cbca14c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1534 microversion: 2.1 time: 0.431781 Sep 24 20:54:03.038450 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 671/1360] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:02 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1534 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:03.048013 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4f2dc518-a635-48c3-a136-07193d43f2bc tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:03.053697 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3dcfa4d8-597f-4065-b0f6-e18c8ace91f2 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d241b5c9b654fa7bf97f3652186ea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a0417c2ae142c48e41a41a495ea988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:03.063107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4f2dc518-a635-48c3-a136-07193d43f2bc tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 39c753b7-d223-4e33-9086-d64877d26ecc] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:03.066122 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3dcfa4d8-597f-4065-b0f6-e18c8ace91f2 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588" status: 200 len: 1317 microversion: 2.1 time: 0.454075 Sep 24 20:54:03.068370 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=4,nova_api:INSERT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:54:03.073850 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f2dc518-a635-48c3-a136-07193d43f2bc tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:03.074632 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f2dc518-a635-48c3-a136-07193d43f2bc tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:03.075255 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f2dc518-a635-48c3-a136-07193d43f2bc tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:03.076141 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f2dc518-a635-48c3-a136-07193d43f2bc tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:03.076784 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f2dc518-a635-48c3-a136-07193d43f2bc tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:03.077374 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f2dc518-a635-48c3-a136-07193d43f2bc tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:03.087759 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 690/1361] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:02 2022] GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588 => generated 1317 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:03.093273 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8e19b325-2c60-4232-92d4-bcddb81b3e12 tempest-ServersWithSpecificFlavorTestJSON-592449782 tempest-ServersWithSpecificFlavorTestJSON-592449782-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:03.116637 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8e19b325-2c60-4232-92d4-bcddb81b3e12 tempest-ServersWithSpecificFlavorTestJSON-592449782 tempest-ServersWithSpecificFlavorTestJSON-592449782-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1835620820" status: 202 len: 0 microversion: 2.1 time: 0.027638 Sep 24 20:54:03.120618 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 691/1362] 10.222.0.52 () {58 vars in 1161 bytes} [Sat Sep 24 20:54:03 2022] DELETE /compute/v2.1/flavors/1835620820 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:54:03.123166 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-792b8c6c-5459-46bf-8363-6c78e18bba91 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:03.123883 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-792b8c6c-5459-46bf-8363-6c78e18bba91 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:03.198130 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-792b8c6c-5459-46bf-8363-6c78e18bba91 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:03.207842 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-792b8c6c-5459-46bf-8363-6c78e18bba91 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:03.211397 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-792b8c6c-5459-46bf-8363-6c78e18bba91 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:03.212836 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-792b8c6c-5459-46bf-8363-6c78e18bba91 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1283 microversion: 2.25 time: 0.094271 Sep 24 20:54:03.214905 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 692/1363] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:54:03 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1283 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:54:03.222256 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-93225756-db44-4fd3-b79b-28991ddf87fb tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:03.224389 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-93225756-db44-4fd3-b79b-28991ddf87fb tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] [instance: cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:03.236923 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93225756-db44-4fd3-b79b-28991ddf87fb tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:03.237450 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93225756-db44-4fd3-b79b-28991ddf87fb tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:03.237901 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93225756-db44-4fd3-b79b-28991ddf87fb tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:03.238148 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4f2dc518-a635-48c3-a136-07193d43f2bc tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:03.238958 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93225756-db44-4fd3-b79b-28991ddf87fb tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:03.239336 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93225756-db44-4fd3-b79b-28991ddf87fb tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:03.240092 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93225756-db44-4fd3-b79b-28991ddf87fb tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:03.250525 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4f2dc518-a635-48c3-a136-07193d43f2bc tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc" status: 200 len: 1225 microversion: 2.1 time: 0.208527 Sep 24 20:54:03.251819 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 672/1364] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:03 2022] GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc => generated 1225 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:03.257875 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-048bd126-0dae-4d94-8f98-2b48796e9c9e tempest-ServersWithSpecificFlavorTestJSON-592449782 tempest-ServersWithSpecificFlavorTestJSON-592449782-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:03.284508 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-048bd126-0dae-4d94-8f98-2b48796e9c9e tempest-ServersWithSpecificFlavorTestJSON-592449782 tempest-ServersWithSpecificFlavorTestJSON-592449782-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030600 Sep 24 20:54:03.286201 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 673/1365] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:54:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:03.328339 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-de2bf61a-9649-45d6-966a-9e2c3f912dfe tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:03.329198 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-de2bf61a-9649-45d6-966a-9e2c3f912dfe tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 625f5fd3-d872-4da5-b176-5a70dfd8cfe2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:03.339054 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-de2bf61a-9649-45d6-966a-9e2c3f912dfe tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:03.339728 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-de2bf61a-9649-45d6-966a-9e2c3f912dfe tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:03.340367 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-de2bf61a-9649-45d6-966a-9e2c3f912dfe tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:03.341247 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-de2bf61a-9649-45d6-966a-9e2c3f912dfe tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:03.346049 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-de2bf61a-9649-45d6-966a-9e2c3f912dfe tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:03.347267 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-de2bf61a-9649-45d6-966a-9e2c3f912dfe tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:03.365223 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-de2bf61a-9649-45d6-966a-9e2c3f912dfe tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] HTTP exception thrown: Instance 625f5fd3-d872-4da5-b176-5a70dfd8cfe2 could not be found. Sep 24 20:54:03.367165 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-de2bf61a-9649-45d6-966a-9e2c3f912dfe tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Request method failure captured: Sep 24 20:54:03.367165 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2 HTTP/1.1 Sep 24 20:54:03.367165 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:54:03.367165 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:54:03.367165 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:54:03.367165 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:54:03.367165 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:54:03.367165 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:54:03.367165 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:54:03.367165 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:54:03.367165 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL21pAbLhFQJ05UONnnN4wNI0WrL-gY9r7xq5p3GoLlNRpVDYgBj9Hwhk_a2fLemPvH8jFXafRiu0Asi6_GdyZjeQBfBjCcHUjs8PstE14Wud-QKBNCtmgDY4x9txHGYFntGCvyIf4e2aEBQXKvLpvbyeA7uNJ9FHoiE2aA2fCo_XAe0 Sep 24 20:54:03.367165 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:54:03.367165 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:54:03.367165 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:54:03.367165 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:54:03.367165 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:54:03.367165 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:54:03.367165 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 478a31be22cc451b92af447ed8d81242 Sep 24 20:54:03.367165 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-299372410 Sep 24 20:54:03.367165 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:54:03.367165 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:54:03.368722 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/478a31be22cc451b92af447ed8d81242"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_478a31be22cc451b92af447ed8d81242"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/478a31be22cc451b92af447ed8d81242"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/478a31be22cc451b92af447ed8d81242"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:54:03.368722 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-299372410 Sep 24 20:54:03.368722 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 478a31be22cc451b92af447ed8d81242 Sep 24 20:54:03.368722 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-299372410 Sep 24 20:54:03.368722 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersWithSpecificFlavorTestJSON-299372410-project Sep 24 20:54:03.368722 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:54:03.368722 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:54:03.368722 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: d278977b201c48dda2d73823fbfe4833 Sep 24 20:54:03.368722 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-299372410-project Sep 24 20:54:03.368722 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:54:03.368722 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 625f5fd3-d872-4da5-b176-5a70dfd8cfe2 could not be found. Sep 24 20:54:03.368722 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '625f5fd3-d872-4da5-b176-5a70dfd8cfe2'} Sep 24 20:54:03.369599 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:54:03.369599 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:03.369599 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:54:03.369599 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:54:03.369599 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:54:03.369599 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:54:03.369599 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:54:03.369599 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:54:03.369599 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:54:03.369599 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:54:03.369599 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 625f5fd3-d872-4da5-b176-5a70dfd8cfe2 could not be found. Sep 24 20:54:03.369599 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:03.369599 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:54:03.369599 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:03.369599 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:03.369599 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:54:03.369599 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:54:03.369599 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:54:03.369599 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:54:03.369599 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:54:03.371018 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:54:03.371018 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 20:54:03.371018 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 20:54:03.371018 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 20:54:03.371018 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 20:54:03.371018 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:54:03.371018 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:54:03.371018 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:54:03.371018 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:54:03.371018 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 625f5fd3-d872-4da5-b176-5a70dfd8cfe2 could not be found. Sep 24 20:54:03.371018 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:03.371018 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:54:03.371018 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:03.371018 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:03.371018 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:54:03.371018 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:54:03.371018 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:54:03.371018 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:54:03.371018 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 625f5fd3-d872-4da5-b176-5a70dfd8cfe2 could not be found. Sep 24 20:54:03.371018 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:03.373953 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-de2bf61a-9649-45d6-966a-9e2c3f912dfe tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Returning 404 to user: Instance 625f5fd3-d872-4da5-b176-5a70dfd8cfe2 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:54:03.375050 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-de2bf61a-9649-45d6-966a-9e2c3f912dfe tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "DELETE /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2" status: 404 len: 111 microversion: 2.1 time: 0.053842 Sep 24 20:54:03.376270 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 674/1366] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:54:03 2022] DELETE /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 20:54:03.384815 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b59ee7b8-7713-4bf8-b073-667be4106ebb tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:03.385885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b59ee7b8-7713-4bf8-b073-667be4106ebb tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 625f5fd3-d872-4da5-b176-5a70dfd8cfe2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:03.394348 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b59ee7b8-7713-4bf8-b073-667be4106ebb tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:03.395176 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b59ee7b8-7713-4bf8-b073-667be4106ebb tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:03.395795 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b59ee7b8-7713-4bf8-b073-667be4106ebb tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:03.397150 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b59ee7b8-7713-4bf8-b073-667be4106ebb tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:03.397617 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b59ee7b8-7713-4bf8-b073-667be4106ebb tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:03.398214 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b59ee7b8-7713-4bf8-b073-667be4106ebb tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:03.418576 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-b59ee7b8-7713-4bf8-b073-667be4106ebb tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] HTTP exception thrown: Instance 625f5fd3-d872-4da5-b176-5a70dfd8cfe2 could not be found. Sep 24 20:54:03.420352 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b59ee7b8-7713-4bf8-b073-667be4106ebb tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Request method failure captured: Sep 24 20:54:03.420352 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2 HTTP/1.1 Sep 24 20:54:03.420352 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:54:03.420352 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:54:03.420352 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:54:03.420352 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:54:03.420352 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:54:03.420352 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:54:03.420352 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:54:03.420352 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:54:03.420352 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL21pAbLhFQJ05UONnnN4wNI0WrL-gY9r7xq5p3GoLlNRpVDYgBj9Hwhk_a2fLemPvH8jFXafRiu0Asi6_GdyZjeQBfBjCcHUjs8PstE14Wud-QKBNCtmgDY4x9txHGYFntGCvyIf4e2aEBQXKvLpvbyeA7uNJ9FHoiE2aA2fCo_XAe0 Sep 24 20:54:03.420352 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:54:03.420352 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:54:03.420352 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:54:03.420352 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:54:03.420352 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:54:03.420352 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:54:03.420352 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 478a31be22cc451b92af447ed8d81242 Sep 24 20:54:03.420352 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-299372410 Sep 24 20:54:03.420352 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:54:03.420352 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:54:03.421896 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/478a31be22cc451b92af447ed8d81242"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_478a31be22cc451b92af447ed8d81242"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/478a31be22cc451b92af447ed8d81242"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/478a31be22cc451b92af447ed8d81242"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:54:03.421896 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-299372410 Sep 24 20:54:03.421896 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 478a31be22cc451b92af447ed8d81242 Sep 24 20:54:03.421896 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-299372410 Sep 24 20:54:03.421896 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersWithSpecificFlavorTestJSON-299372410-project Sep 24 20:54:03.421896 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:54:03.421896 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:54:03.421896 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: d278977b201c48dda2d73823fbfe4833 Sep 24 20:54:03.421896 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-299372410-project Sep 24 20:54:03.421896 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:54:03.421896 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 625f5fd3-d872-4da5-b176-5a70dfd8cfe2 could not be found. Sep 24 20:54:03.421896 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '625f5fd3-d872-4da5-b176-5a70dfd8cfe2'} Sep 24 20:54:03.423001 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:54:03.423001 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:03.423001 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:54:03.423001 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:54:03.423001 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:54:03.423001 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:54:03.423001 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:54:03.423001 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:54:03.423001 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:54:03.423001 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:54:03.423001 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 625f5fd3-d872-4da5-b176-5a70dfd8cfe2 could not be found. Sep 24 20:54:03.423001 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:03.423001 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:54:03.423001 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:03.423001 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:03.423001 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:54:03.423001 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:54:03.423001 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:54:03.423001 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:54:03.423001 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:54:03.424559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:54:03.424559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:54:03.424559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:54:03.424559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:54:03.424559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:54:03.424559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:54:03.424559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:54:03.424559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 625f5fd3-d872-4da5-b176-5a70dfd8cfe2 could not be found. Sep 24 20:54:03.424559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:03.424559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:54:03.424559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:03.424559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:03.424559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:54:03.424559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:54:03.424559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:54:03.424559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:54:03.424559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 625f5fd3-d872-4da5-b176-5a70dfd8cfe2 could not be found. Sep 24 20:54:03.424559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:03.428136 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b59ee7b8-7713-4bf8-b073-667be4106ebb tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Returning 404 to user: Instance 625f5fd3-d872-4da5-b176-5a70dfd8cfe2 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:54:03.428136 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b59ee7b8-7713-4bf8-b073-667be4106ebb tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2" status: 404 len: 111 microversion: 2.1 time: 0.046225 Sep 24 20:54:03.431442 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 675/1367] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:03 2022] GET /compute/v2.1/servers/625f5fd3-d872-4da5-b176-5a70dfd8cfe2 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:54:03.439316 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-923eccd5-9388-461d-8f47-e787b2406d32 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:03.440745 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-923eccd5-9388-461d-8f47-e787b2406d32 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 9b0e9940-f6ac-46d5-8898-1e4ba56119b3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:03.446803 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-93225756-db44-4fd3-b79b-28991ddf87fb tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d" status: 200 len: 1617 microversion: 2.1 time: 0.230134 Sep 24 20:54:03.448233 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 693/1368] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:03 2022] GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d => generated 1617 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:03.457347 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-923eccd5-9388-461d-8f47-e787b2406d32 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:03.458021 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-923eccd5-9388-461d-8f47-e787b2406d32 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:03.458588 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-923eccd5-9388-461d-8f47-e787b2406d32 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:03.459457 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-923eccd5-9388-461d-8f47-e787b2406d32 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:03.459989 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-923eccd5-9388-461d-8f47-e787b2406d32 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:03.460655 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-923eccd5-9388-461d-8f47-e787b2406d32 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:03.496435 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-923eccd5-9388-461d-8f47-e787b2406d32 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] HTTP exception thrown: Instance 9b0e9940-f6ac-46d5-8898-1e4ba56119b3 could not be found. Sep 24 20:54:03.499744 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-923eccd5-9388-461d-8f47-e787b2406d32 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Request method failure captured: Sep 24 20:54:03.499744 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3 HTTP/1.1 Sep 24 20:54:03.499744 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:54:03.499744 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:54:03.499744 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:54:03.499744 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:54:03.499744 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:54:03.499744 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:54:03.499744 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:54:03.499744 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:54:03.499744 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL21pAbLhFQJ05UONnnN4wNI0WrL-gY9r7xq5p3GoLlNRpVDYgBj9Hwhk_a2fLemPvH8jFXafRiu0Asi6_GdyZjeQBfBjCcHUjs8PstE14Wud-QKBNCtmgDY4x9txHGYFntGCvyIf4e2aEBQXKvLpvbyeA7uNJ9FHoiE2aA2fCo_XAe0 Sep 24 20:54:03.499744 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:54:03.499744 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:54:03.499744 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:54:03.499744 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:54:03.499744 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:54:03.499744 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:54:03.499744 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 478a31be22cc451b92af447ed8d81242 Sep 24 20:54:03.499744 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-299372410 Sep 24 20:54:03.499744 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:54:03.499744 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:54:03.501299 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/478a31be22cc451b92af447ed8d81242"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_478a31be22cc451b92af447ed8d81242"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/478a31be22cc451b92af447ed8d81242"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/478a31be22cc451b92af447ed8d81242"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:54:03.501299 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-299372410 Sep 24 20:54:03.501299 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 478a31be22cc451b92af447ed8d81242 Sep 24 20:54:03.501299 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-299372410 Sep 24 20:54:03.501299 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersWithSpecificFlavorTestJSON-299372410-project Sep 24 20:54:03.501299 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:54:03.501299 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:54:03.501299 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: d278977b201c48dda2d73823fbfe4833 Sep 24 20:54:03.501299 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-299372410-project Sep 24 20:54:03.501299 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:54:03.501299 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 9b0e9940-f6ac-46d5-8898-1e4ba56119b3 could not be found. Sep 24 20:54:03.501299 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '9b0e9940-f6ac-46d5-8898-1e4ba56119b3'} Sep 24 20:54:03.502176 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:54:03.502176 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:03.502176 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:54:03.502176 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:54:03.502176 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:54:03.502176 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:54:03.502176 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:54:03.502176 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:54:03.502176 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:54:03.502176 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:54:03.502176 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b0e9940-f6ac-46d5-8898-1e4ba56119b3 could not be found. Sep 24 20:54:03.502176 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:03.502176 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:54:03.502176 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:03.502176 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:03.502176 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:54:03.502176 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:54:03.502176 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:54:03.502176 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:54:03.502176 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:54:03.503945 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:54:03.503945 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 20:54:03.503945 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 20:54:03.503945 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 20:54:03.503945 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 20:54:03.503945 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:54:03.503945 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:54:03.503945 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:54:03.503945 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:54:03.503945 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b0e9940-f6ac-46d5-8898-1e4ba56119b3 could not be found. Sep 24 20:54:03.503945 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:03.503945 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:54:03.503945 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:03.503945 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:03.503945 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:54:03.503945 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:54:03.503945 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:54:03.503945 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:54:03.503945 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b0e9940-f6ac-46d5-8898-1e4ba56119b3 could not be found. Sep 24 20:54:03.503945 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:03.507156 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-923eccd5-9388-461d-8f47-e787b2406d32 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Returning 404 to user: Instance 9b0e9940-f6ac-46d5-8898-1e4ba56119b3 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:54:03.508386 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-923eccd5-9388-461d-8f47-e787b2406d32 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3" status: 404 len: 111 microversion: 2.1 time: 0.075771 Sep 24 20:54:03.509117 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 676/1369] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:54:03 2022] DELETE /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:54:03.517872 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c4c2b28e-500e-4116-8029-3ecd09c0d8c2 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:03.519401 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c4c2b28e-500e-4116-8029-3ecd09c0d8c2 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] [instance: 9b0e9940-f6ac-46d5-8898-1e4ba56119b3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:03.527226 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c4c2b28e-500e-4116-8029-3ecd09c0d8c2 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:03.528294 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c4c2b28e-500e-4116-8029-3ecd09c0d8c2 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:03.528960 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c4c2b28e-500e-4116-8029-3ecd09c0d8c2 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:03.529904 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c4c2b28e-500e-4116-8029-3ecd09c0d8c2 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:03.530678 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c4c2b28e-500e-4116-8029-3ecd09c0d8c2 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:03.531331 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c4c2b28e-500e-4116-8029-3ecd09c0d8c2 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:03.550984 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-c4c2b28e-500e-4116-8029-3ecd09c0d8c2 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] HTTP exception thrown: Instance 9b0e9940-f6ac-46d5-8898-1e4ba56119b3 could not be found. Sep 24 20:54:03.553247 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c4c2b28e-500e-4116-8029-3ecd09c0d8c2 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Request method failure captured: Sep 24 20:54:03.553247 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3 HTTP/1.1 Sep 24 20:54:03.553247 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:54:03.553247 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:54:03.553247 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:54:03.553247 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:54:03.553247 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:54:03.553247 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:54:03.553247 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:54:03.553247 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:54:03.553247 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL21pAbLhFQJ05UONnnN4wNI0WrL-gY9r7xq5p3GoLlNRpVDYgBj9Hwhk_a2fLemPvH8jFXafRiu0Asi6_GdyZjeQBfBjCcHUjs8PstE14Wud-QKBNCtmgDY4x9txHGYFntGCvyIf4e2aEBQXKvLpvbyeA7uNJ9FHoiE2aA2fCo_XAe0 Sep 24 20:54:03.553247 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:54:03.553247 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:54:03.553247 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:54:03.553247 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:54:03.553247 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:54:03.553247 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:54:03.553247 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 478a31be22cc451b92af447ed8d81242 Sep 24 20:54:03.553247 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-299372410 Sep 24 20:54:03.553247 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:54:03.553247 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:54:03.554910 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/478a31be22cc451b92af447ed8d81242"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_478a31be22cc451b92af447ed8d81242"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/478a31be22cc451b92af447ed8d81242"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/478a31be22cc451b92af447ed8d81242"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:54:03.554910 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-299372410 Sep 24 20:54:03.554910 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 478a31be22cc451b92af447ed8d81242 Sep 24 20:54:03.554910 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-299372410 Sep 24 20:54:03.554910 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersWithSpecificFlavorTestJSON-299372410-project Sep 24 20:54:03.554910 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:54:03.554910 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:54:03.554910 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: d278977b201c48dda2d73823fbfe4833 Sep 24 20:54:03.554910 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-299372410-project Sep 24 20:54:03.554910 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:54:03.554910 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 9b0e9940-f6ac-46d5-8898-1e4ba56119b3 could not be found. Sep 24 20:54:03.554910 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '9b0e9940-f6ac-46d5-8898-1e4ba56119b3'} Sep 24 20:54:03.555797 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:54:03.555797 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:03.555797 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:54:03.555797 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:54:03.555797 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:54:03.555797 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:54:03.555797 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:54:03.555797 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:54:03.555797 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:54:03.555797 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:54:03.555797 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b0e9940-f6ac-46d5-8898-1e4ba56119b3 could not be found. Sep 24 20:54:03.555797 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:54:03.555797 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:54:03.555797 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:54:03.555797 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:03.555797 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:54:03.555797 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:54:03.555797 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:54:03.555797 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:54:03.555797 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:54:03.557337 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:54:03.557337 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:54:03.557337 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:54:03.557337 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:54:03.557337 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:54:03.557337 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:54:03.557337 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:54:03.557337 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b0e9940-f6ac-46d5-8898-1e4ba56119b3 could not be found. Sep 24 20:54:03.557337 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:54:03.557337 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:54:03.557337 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:54:03.557337 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:03.557337 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:54:03.557337 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:54:03.557337 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:54:03.557337 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:54:03.557337 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b0e9940-f6ac-46d5-8898-1e4ba56119b3 could not be found. Sep 24 20:54:03.557337 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:54:03.560086 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c4c2b28e-500e-4116-8029-3ecd09c0d8c2 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] Returning 404 to user: Instance 9b0e9940-f6ac-46d5-8898-1e4ba56119b3 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:54:03.561457 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c4c2b28e-500e-4116-8029-3ecd09c0d8c2 tempest-ServersWithSpecificFlavorTestJSON-299372410 tempest-ServersWithSpecificFlavorTestJSON-299372410-project] 10.222.0.52 "GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3" status: 404 len: 111 microversion: 2.1 time: 0.047952 Sep 24 20:54:03.562608 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 694/1370] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:03 2022] GET /compute/v2.1/servers/9b0e9940-f6ac-46d5-8898-1e4ba56119b3 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 20:54:03.642697 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fa6907ca-a551-4511-b6e3-f466d8658251 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-319798512", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "a74d1c4c-d757-4879-a35d-9f817ea6e28b"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:03.704090 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-fa6907ca-a551-4511-b6e3-f466d8658251 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] validate_networks() for None {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:54:04.062568 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-81514dbb-4ad8-4d28-84a8-efbf6fe68dbb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:04.063397 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-81514dbb-4ad8-4d28-84a8-efbf6fe68dbb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:04.078774 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-81514dbb-4ad8-4d28-84a8-efbf6fe68dbb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:04.079614 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-81514dbb-4ad8-4d28-84a8-efbf6fe68dbb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:04.081255 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-81514dbb-4ad8-4d28-84a8-efbf6fe68dbb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:04.083366 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-81514dbb-4ad8-4d28-84a8-efbf6fe68dbb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:04.085594 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-81514dbb-4ad8-4d28-84a8-efbf6fe68dbb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:04.086077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-81514dbb-4ad8-4d28-84a8-efbf6fe68dbb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:04.111388 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-fa6907ca-a551-4511-b6e3-f466d8658251 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:54:04.112461 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-fa6907ca-a551-4511-b6e3-f466d8658251 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:54:04.114987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-fa6907ca-a551-4511-b6e3-f466d8658251 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:54:04.115777 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-fa6907ca-a551-4511-b6e3-f466d8658251 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:54:04.116348 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-fa6907ca-a551-4511-b6e3-f466d8658251 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:54:04.128252 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fa6907ca-a551-4511-b6e3-f466d8658251 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:04.129304 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fa6907ca-a551-4511-b6e3-f466d8658251 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:04.130367 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fa6907ca-a551-4511-b6e3-f466d8658251 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:04.131378 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fa6907ca-a551-4511-b6e3-f466d8658251 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:04.154116 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fa6907ca-a551-4511-b6e3-f466d8658251 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:04.155091 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fa6907ca-a551-4511-b6e3-f466d8658251 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:04.192200 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-fa6907ca-a551-4511-b6e3-f466d8658251 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Getting quotas for project 73bec7c48b07450f95a29a35e113153d. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:54:04.198258 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-fa6907ca-a551-4511-b6e3-f466d8658251 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Getting quotas for user 936372eff4da45e281fc5512632a12b6 and project 73bec7c48b07450f95a29a35e113153d. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:54:04.214002 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fa6907ca-a551-4511-b6e3-f466d8658251 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:54:04.216920 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fa6907ca-a551-4511-b6e3-f466d8658251 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a89ef546-702c-4ecd-babc-7d523421339b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:54:04.300649 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fa6907ca-a551-4511-b6e3-f466d8658251 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.662158 Sep 24 20:54:04.302363 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 677/1371] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:54:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:54:04.311788 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cab85caa-6572-4427-83f9-704250a664a5 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:04.312861 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cab85caa-6572-4427-83f9-704250a664a5 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] [instance: 048b3539-80cb-4d73-9280-b62713ddb588] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:04.321565 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cab85caa-6572-4427-83f9-704250a664a5 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:04.322377 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cab85caa-6572-4427-83f9-704250a664a5 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:04.323121 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cab85caa-6572-4427-83f9-704250a664a5 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:04.325046 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cab85caa-6572-4427-83f9-704250a664a5 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:04.325915 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cab85caa-6572-4427-83f9-704250a664a5 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:04.326888 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cab85caa-6572-4427-83f9-704250a664a5 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:04.901518 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-81514dbb-4ad8-4d28-84a8-efbf6fe68dbb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:04.911295 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-81514dbb-4ad8-4d28-84a8-efbf6fe68dbb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1534 microversion: 2.1 time: 0.852810 Sep 24 20:54:04.912220 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 695/1372] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:04 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1534 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:54:04.917288 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ca2f422d-ce2a-4ef9-acca-63ace54511a2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:04.917908 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ca2f422d-ce2a-4ef9-acca-63ace54511a2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:04.924028 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ca2f422d-ce2a-4ef9-acca-63ace54511a2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:04.925484 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ca2f422d-ce2a-4ef9-acca-63ace54511a2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:04.926100 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ca2f422d-ce2a-4ef9-acca-63ace54511a2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:04.927033 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ca2f422d-ce2a-4ef9-acca-63ace54511a2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:04.927765 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ca2f422d-ce2a-4ef9-acca-63ace54511a2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:04.928346 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ca2f422d-ce2a-4ef9-acca-63ace54511a2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:05.060017 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cab85caa-6572-4427-83f9-704250a664a5 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d241b5c9b654fa7bf97f3652186ea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a0417c2ae142c48e41a41a495ea988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:05.070028 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cab85caa-6572-4427-83f9-704250a664a5 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588" status: 200 len: 1317 microversion: 2.1 time: 0.766169 Sep 24 20:54:05.090846 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 678/1373] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:04 2022] GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588 => generated 1317 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:05.091095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ca2f422d-ce2a-4ef9-acca-63ace54511a2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:05.091403 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c87ffa1e-eda3-4622-8f48-2f188064bbc0 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:05.091403 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c87ffa1e-eda3-4622-8f48-2f188064bbc0 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 39c753b7-d223-4e33-9086-d64877d26ecc] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:05.091566 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ca2f422d-ce2a-4ef9-acca-63ace54511a2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:05.099343 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ca2f422d-ce2a-4ef9-acca-63ace54511a2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:05.100607 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ca2f422d-ce2a-4ef9-acca-63ace54511a2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1279 microversion: 2.25 time: 0.187208 Sep 24 20:54:05.101875 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 696/1374] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:54:04 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1279 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:54:05.116154 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e5b70f24-4b5a-4567-b4f8-ae2e2047eb3d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:05.116775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e5b70f24-4b5a-4567-b4f8-ae2e2047eb3d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a89ef546-702c-4ecd-babc-7d523421339b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:05.117418 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c87ffa1e-eda3-4622-8f48-2f188064bbc0 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:05.118035 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c87ffa1e-eda3-4622-8f48-2f188064bbc0 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:05.118615 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c87ffa1e-eda3-4622-8f48-2f188064bbc0 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:05.119459 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c87ffa1e-eda3-4622-8f48-2f188064bbc0 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:05.120027 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c87ffa1e-eda3-4622-8f48-2f188064bbc0 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:05.121668 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c87ffa1e-eda3-4622-8f48-2f188064bbc0 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:05.136539 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5b70f24-4b5a-4567-b4f8-ae2e2047eb3d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:05.137045 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5b70f24-4b5a-4567-b4f8-ae2e2047eb3d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:05.137494 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5b70f24-4b5a-4567-b4f8-ae2e2047eb3d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:05.138231 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5b70f24-4b5a-4567-b4f8-ae2e2047eb3d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:05.138731 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5b70f24-4b5a-4567-b4f8-ae2e2047eb3d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:05.139165 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5b70f24-4b5a-4567-b4f8-ae2e2047eb3d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:05.280501 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c87ffa1e-eda3-4622-8f48-2f188064bbc0 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:05.299786 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e5b70f24-4b5a-4567-b4f8-ae2e2047eb3d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:05.302386 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c87ffa1e-eda3-4622-8f48-2f188064bbc0 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc" status: 200 len: 1273 microversion: 2.1 time: 0.222560 Sep 24 20:54:05.305631 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:54:05.309808 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e5b70f24-4b5a-4567-b4f8-ae2e2047eb3d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b" status: 200 len: 1220 microversion: 2.1 time: 0.198387 Sep 24 20:54:05.313299 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 697/1375] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:05 2022] GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b => generated 1220 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:05.318556 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e12a4093-f816-442b-b0c2-eb2a695f7d8b tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:05.322428 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 679/1376] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:05 2022] GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc => generated 1273 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:05.323520 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e12a4093-f816-442b-b0c2-eb2a695f7d8b tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:05.333186 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e12a4093-f816-442b-b0c2-eb2a695f7d8b tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:05.334025 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e12a4093-f816-442b-b0c2-eb2a695f7d8b tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:05.334613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e12a4093-f816-442b-b0c2-eb2a695f7d8b tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:05.335476 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e12a4093-f816-442b-b0c2-eb2a695f7d8b tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:05.336041 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e12a4093-f816-442b-b0c2-eb2a695f7d8b tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:05.336622 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e12a4093-f816-442b-b0c2-eb2a695f7d8b tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:05.560125 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-8a82b233-574e-488c-a381-c28e2222b9b3 req-8258c0fb-31ad-4bde-9f19-664c5fc7a689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "684811fb-a8ce-497a-a8f2-c66d6e4512bd", "name": "network-vif-unplugged", "status": "completed", "tag": "f1619055-c388-4c6a-ae4a-12376117a1fd"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:05.570593 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-8a82b233-574e-488c-a381-c28e2222b9b3 req-8258c0fb-31ad-4bde-9f19-664c5fc7a689 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:05.571084 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-8a82b233-574e-488c-a381-c28e2222b9b3 req-8258c0fb-31ad-4bde-9f19-664c5fc7a689 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:05.571514 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-8a82b233-574e-488c-a381-c28e2222b9b3 req-8258c0fb-31ad-4bde-9f19-664c5fc7a689 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:05.584702 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-8a82b233-574e-488c-a381-c28e2222b9b3 req-8258c0fb-31ad-4bde-9f19-664c5fc7a689 service nova] Creating event network-vif-unplugged:f1619055-c388-4c6a-ae4a-12376117a1fd for instance 684811fb-a8ce-497a-a8f2-c66d6e4512bd on nch1-master-1 Sep 24 20:54:05.591583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [req-8a82b233-574e-488c-a381-c28e2222b9b3 req-8258c0fb-31ad-4bde-9f19-664c5fc7a689 service nova] Instance 684811fb-a8ce-497a-a8f2-c66d6e4512bd is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=140516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 20:54:05.600052 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-8a82b233-574e-488c-a381-c28e2222b9b3 req-8258c0fb-31ad-4bde-9f19-664c5fc7a689 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043329 Sep 24 20:54:05.601585 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 680/1377] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:54:05.636950 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e12a4093-f816-442b-b0c2-eb2a695f7d8b tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1856 microversion: 2.1 time: 0.322284 Sep 24 20:54:05.638874 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 698/1378] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:05 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1856 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:05.661903 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-caf4656a-0c26-41f3-bb1b-7c74149f30b7 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:05.664765 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-caf4656a-0c26-41f3-bb1b-7c74149f30b7 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:05.671534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-caf4656a-0c26-41f3-bb1b-7c74149f30b7 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:05.672027 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-caf4656a-0c26-41f3-bb1b-7c74149f30b7 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:05.672472 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-caf4656a-0c26-41f3-bb1b-7c74149f30b7 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:05.673188 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-caf4656a-0c26-41f3-bb1b-7c74149f30b7 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:05.673657 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-caf4656a-0c26-41f3-bb1b-7c74149f30b7 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:05.674091 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-caf4656a-0c26-41f3-bb1b-7c74149f30b7 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:05.700063 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-caf4656a-0c26-41f3-bb1b-7c74149f30b7 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lazy-loading 'flavor' on Instance uuid e72414b7-9fb5-4059-92fe-46b1780543f3 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:54:05.712631 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-caf4656a-0c26-41f3-bb1b-7c74149f30b7 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Going to try to live migrate instance to nch1-master-1 {{(pid=140516) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 24 20:54:05.937122 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3d7ae438-7a87-422c-b899-4bbfa8e45359 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:05.938470 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3d7ae438-7a87-422c-b899-4bbfa8e45359 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:05.945752 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d7ae438-7a87-422c-b899-4bbfa8e45359 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:05.946337 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d7ae438-7a87-422c-b899-4bbfa8e45359 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:05.946885 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d7ae438-7a87-422c-b899-4bbfa8e45359 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:05.947738 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d7ae438-7a87-422c-b899-4bbfa8e45359 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:05.948487 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d7ae438-7a87-422c-b899-4bbfa8e45359 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:05.949209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d7ae438-7a87-422c-b899-4bbfa8e45359 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:06.489046 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3d7ae438-7a87-422c-b899-4bbfa8e45359 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:06.502036 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3d7ae438-7a87-422c-b899-4bbfa8e45359 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1534 microversion: 2.1 time: 0.568632 Sep 24 20:54:06.519875 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 699/1379] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:05 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1534 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:54:06.526082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ec502480-8ab7-4994-9dc3-aaaf0bb51cd8 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:06.527044 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ec502480-8ab7-4994-9dc3-aaaf0bb51cd8 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] [instance: 048b3539-80cb-4d73-9280-b62713ddb588] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:06.534174 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ec502480-8ab7-4994-9dc3-aaaf0bb51cd8 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:06.536843 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ec502480-8ab7-4994-9dc3-aaaf0bb51cd8 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:06.537334 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ec502480-8ab7-4994-9dc3-aaaf0bb51cd8 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:06.538075 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ec502480-8ab7-4994-9dc3-aaaf0bb51cd8 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:06.538818 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ec502480-8ab7-4994-9dc3-aaaf0bb51cd8 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:06.539415 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ec502480-8ab7-4994-9dc3-aaaf0bb51cd8 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:06.784434 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ec502480-8ab7-4994-9dc3-aaaf0bb51cd8 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d241b5c9b654fa7bf97f3652186ea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a0417c2ae142c48e41a41a495ea988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:06.800363 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ec502480-8ab7-4994-9dc3-aaaf0bb51cd8 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588" status: 200 len: 1467 microversion: 2.1 time: 0.278568 Sep 24 20:54:06.802045 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 700/1380] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:06 2022] GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588 => generated 1467 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:06.836784 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2b2d86f2-29ab-49d3-a60a-8e3d4ed41157 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:06.837411 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2b2d86f2-29ab-49d3-a60a-8e3d4ed41157 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:06.844816 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2b2d86f2-29ab-49d3-a60a-8e3d4ed41157 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:06.845310 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2b2d86f2-29ab-49d3-a60a-8e3d4ed41157 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:06.845750 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2b2d86f2-29ab-49d3-a60a-8e3d4ed41157 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:06.847164 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2b2d86f2-29ab-49d3-a60a-8e3d4ed41157 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:06.847789 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2b2d86f2-29ab-49d3-a60a-8e3d4ed41157 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:06.848237 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2b2d86f2-29ab-49d3-a60a-8e3d4ed41157 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:06.933916 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2b2d86f2-29ab-49d3-a60a-8e3d4ed41157 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:06.944779 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2b2d86f2-29ab-49d3-a60a-8e3d4ed41157 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:06.947265 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2b2d86f2-29ab-49d3-a60a-8e3d4ed41157 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:06.948633 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2b2d86f2-29ab-49d3-a60a-8e3d4ed41157 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1279 microversion: 2.25 time: 0.145585 Sep 24 20:54:06.949319 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 701/1381] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:54:06 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1279 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:54:06.954020 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a56eaa01-784d-4289-a7d4-cb6bd75cee81 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:06.954753 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a56eaa01-784d-4289-a7d4-cb6bd75cee81 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 39c753b7-d223-4e33-9086-d64877d26ecc] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:06.961174 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a56eaa01-784d-4289-a7d4-cb6bd75cee81 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:06.961837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a56eaa01-784d-4289-a7d4-cb6bd75cee81 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:06.962276 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a56eaa01-784d-4289-a7d4-cb6bd75cee81 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:06.962992 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a56eaa01-784d-4289-a7d4-cb6bd75cee81 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:06.963453 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a56eaa01-784d-4289-a7d4-cb6bd75cee81 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:06.963878 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a56eaa01-784d-4289-a7d4-cb6bd75cee81 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:07.052920 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a56eaa01-784d-4289-a7d4-cb6bd75cee81 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:07.061025 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a56eaa01-784d-4289-a7d4-cb6bd75cee81 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc" status: 200 len: 1273 microversion: 2.1 time: 0.110394 Sep 24 20:54:07.061638 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 702/1382] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:06 2022] GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc => generated 1273 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:07.066267 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e384529d-ee28-4108-a751-58b6e1d25286 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:07.066948 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e384529d-ee28-4108-a751-58b6e1d25286 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a89ef546-702c-4ecd-babc-7d523421339b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:07.075078 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e384529d-ee28-4108-a751-58b6e1d25286 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:07.075545 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e384529d-ee28-4108-a751-58b6e1d25286 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:07.075993 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e384529d-ee28-4108-a751-58b6e1d25286 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:07.076708 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e384529d-ee28-4108-a751-58b6e1d25286 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:07.077175 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e384529d-ee28-4108-a751-58b6e1d25286 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:07.077611 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e384529d-ee28-4108-a751-58b6e1d25286 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:07.156613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e384529d-ee28-4108-a751-58b6e1d25286 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:07.172207 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e384529d-ee28-4108-a751-58b6e1d25286 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b" status: 200 len: 1220 microversion: 2.1 time: 0.108810 Sep 24 20:54:07.173375 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 703/1383] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:07 2022] GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b => generated 1220 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:07.180234 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-194e38b8-c8cb-4066-afdd-d4347199bcf9 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-892407671", "metadata": {"image_type": "test"}}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:07.186748 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-194e38b8-c8cb-4066-afdd-d4347199bcf9 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] [instance: 048b3539-80cb-4d73-9280-b62713ddb588] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:07.194446 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-194e38b8-c8cb-4066-afdd-d4347199bcf9 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:07.195056 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-194e38b8-c8cb-4066-afdd-d4347199bcf9 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:07.195597 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-194e38b8-c8cb-4066-afdd-d4347199bcf9 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:07.196369 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-194e38b8-c8cb-4066-afdd-d4347199bcf9 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:07.196894 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-194e38b8-c8cb-4066-afdd-d4347199bcf9 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:07.197445 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-194e38b8-c8cb-4066-afdd-d4347199bcf9 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:07.243842 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-194e38b8-c8cb-4066-afdd-d4347199bcf9 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Getting quotas for project 66a0417c2ae142c48e41a41a495ea988. Resources: dict_keys(['metadata_items']) {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:54:07.250543 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-194e38b8-c8cb-4066-afdd-d4347199bcf9 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Getting quotas for user 2d241b5c9b654fa7bf97f3652186ea6f and project 66a0417c2ae142c48e41a41a495ea988. Resources: dict_keys(['metadata_items']) {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:54:07.481557 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-194e38b8-c8cb-4066-afdd-d4347199bcf9 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "POST /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588/action" status: 202 len: 0 microversion: 2.1 time: 0.304417 Sep 24 20:54:07.490085 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 704/1384] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:54:07 2022] POST /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 24 20:54:07.505038 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8ef732c2-9a24-43b9-8a9e-c8972a0d5d24 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b0c957940>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:07.568305 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8ef732c2-9a24-43b9-8a9e-c8972a0d5d24 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913" status: 200 len: 1421 microversion: 2.1 time: 0.076232 Sep 24 20:54:07.568894 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 705/1385] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:54:07 2022] GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913 => generated 1421 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:07.583738 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-69296704-154a-4a01-a4ad-e7f344497a63 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:07.584472 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-69296704-154a-4a01-a4ad-e7f344497a63 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:07.591919 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69296704-154a-4a01-a4ad-e7f344497a63 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:07.592406 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69296704-154a-4a01-a4ad-e7f344497a63 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:07.593053 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69296704-154a-4a01-a4ad-e7f344497a63 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:07.593982 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69296704-154a-4a01-a4ad-e7f344497a63 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:07.594659 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69296704-154a-4a01-a4ad-e7f344497a63 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:07.595088 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69296704-154a-4a01-a4ad-e7f344497a63 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:07.762261 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-69296704-154a-4a01-a4ad-e7f344497a63 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:07.772939 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-69296704-154a-4a01-a4ad-e7f344497a63 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1534 microversion: 2.1 time: 0.194081 Sep 24 20:54:07.774460 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 706/1386] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:07 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1534 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:07.974208 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b14d17e5-440f-4991-aea2-f11ba67185a7 tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Action: 'create', calling method: .version_select at 0x7f4b0c957310>, body: {"keypair": {"name": "tempest-keypair-105666352", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDl8fOJcGtOcgIKQZln/CURExY1/02cFn3HwiDUC3r4O6SfdfHTtnxSABr27VUUwPxiKl+kkG6eEqArkCkFn2fSXpmAoC6SIG9soJJ/QdwlykDHmOyBamKUrKTqQTZ+7Q=="}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:07.990117 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-b14d17e5-440f-4991-aea2-f11ba67185a7 tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Getting quotas for project 176a40378e334575814671210471a92c. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:54:07.996166 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-b14d17e5-440f-4991-aea2-f11ba67185a7 tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Getting quotas for user 50812c49f681493bbe428d7376572b3d and project 176a40378e334575814671210471a92c. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:54:08.005995 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:54:08.022714 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b14d17e5-440f-4991-aea2-f11ba67185a7 tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.205541 Sep 24 20:54:08.023311 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 707/1387] 10.222.0.52 () {62 vars in 1199 bytes} [Sat Sep 24 20:54:07 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 207 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Sep 24 20:54:08.028104 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a4e9fbf3-eac6-466f-a830-7d570309e582 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:08.028717 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a4e9fbf3-eac6-466f-a830-7d570309e582 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:08.035777 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4e9fbf3-eac6-466f-a830-7d570309e582 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:08.036208 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4e9fbf3-eac6-466f-a830-7d570309e582 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:08.036649 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4e9fbf3-eac6-466f-a830-7d570309e582 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:08.037418 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4e9fbf3-eac6-466f-a830-7d570309e582 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:08.037881 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4e9fbf3-eac6-466f-a830-7d570309e582 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:08.038309 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4e9fbf3-eac6-466f-a830-7d570309e582 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:08.102402 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a4e9fbf3-eac6-466f-a830-7d570309e582 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:08.110610 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a4e9fbf3-eac6-466f-a830-7d570309e582 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:08.112672 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a4e9fbf3-eac6-466f-a830-7d570309e582 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:08.113868 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a4e9fbf3-eac6-466f-a830-7d570309e582 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1279 microversion: 2.25 time: 0.089427 Sep 24 20:54:08.114429 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 708/1388] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:54:08 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1279 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:54:08.119056 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-46893716-25ab-4521-80c3-daddac8176c1 tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Calling method '.version_select at 0x7f4b1109e8b0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:08.128103 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-46893716-25ab-4521-80c3-daddac8176c1 tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs/tempest-keypair-105666352" status: 200 len: 511 microversion: 2.2 time: 0.012022 Sep 24 20:54:08.128823 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 709/1389] 10.222.0.52 () {60 vars in 1255 bytes} [Sat Sep 24 20:54:08 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-105666352 => generated 511 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:54:08.133709 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a6f0112d-7ca6-490b-9cc7-010077c1d694 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:08.134324 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a6f0112d-7ca6-490b-9cc7-010077c1d694 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 39c753b7-d223-4e33-9086-d64877d26ecc] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:08.140176 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a6f0112d-7ca6-490b-9cc7-010077c1d694 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:08.140656 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a6f0112d-7ca6-490b-9cc7-010077c1d694 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:08.141089 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a6f0112d-7ca6-490b-9cc7-010077c1d694 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:08.141783 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a6f0112d-7ca6-490b-9cc7-010077c1d694 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:08.142237 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a6f0112d-7ca6-490b-9cc7-010077c1d694 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:08.142691 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a6f0112d-7ca6-490b-9cc7-010077c1d694 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:08.210981 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a6f0112d-7ca6-490b-9cc7-010077c1d694 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:08.218610 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a6f0112d-7ca6-490b-9cc7-010077c1d694 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc" status: 200 len: 1273 microversion: 2.1 time: 0.088560 Sep 24 20:54:08.219173 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 710/1390] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:08 2022] GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc => generated 1273 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:08.224362 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-08424d92-7196-4e26-ad06-a1d32d8a5cfb tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Calling method '.version_select at 0x7f4b11018310>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:08.244251 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-08424d92-7196-4e26-ad06-a1d32d8a5cfb tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-105666352" status: 204 len: 0 microversion: 2.2 time: 0.023677 Sep 24 20:54:08.245121 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 711/1391] 10.222.0.52 () {60 vars in 1258 bytes} [Sat Sep 24 20:54:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-105666352 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:54:08.257076 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3526cfe9-a2d6-4faa-8641-6d552ba855bf tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:08.257915 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3526cfe9-a2d6-4faa-8641-6d552ba855bf tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a89ef546-702c-4ecd-babc-7d523421339b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:08.264875 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3526cfe9-a2d6-4faa-8641-6d552ba855bf tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:08.266065 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3526cfe9-a2d6-4faa-8641-6d552ba855bf tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:08.266065 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3526cfe9-a2d6-4faa-8641-6d552ba855bf tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:08.266513 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3526cfe9-a2d6-4faa-8641-6d552ba855bf tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:08.266991 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3526cfe9-a2d6-4faa-8641-6d552ba855bf tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:08.267417 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3526cfe9-a2d6-4faa-8641-6d552ba855bf tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:08.348181 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3526cfe9-a2d6-4faa-8641-6d552ba855bf tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:08.356806 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3526cfe9-a2d6-4faa-8641-6d552ba855bf tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b" status: 200 len: 1220 microversion: 2.1 time: 0.110482 Sep 24 20:54:08.357411 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 712/1392] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:08 2022] GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b => generated 1220 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:08.372419 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6fc18d2d-1039-469a-b73f-01f4d78542cd tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Action: 'create', calling method: .version_select at 0x7f4b1109e1f0>, body: {"keypair": {"name": "tempest-keypair-405725505", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZphcmqRCDrDdsoj39kWZyUkCrpzVcepYTLL8MdUThYk1AShBOieiZCBA33wideuWapV791NdN2rdjOdCxibNMPNZMUljUy+9Z+UzZ5LonVobueVdUt9nmoxp0ZhLHO3A=="}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:08.407294 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-6fc18d2d-1039-469a-b73f-01f4d78542cd tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Getting quotas for project 176a40378e334575814671210471a92c. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:54:08.417510 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-6fc18d2d-1039-469a-b73f-01f4d78542cd tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Getting quotas for user 50812c49f681493bbe428d7376572b3d and project 176a40378e334575814671210471a92c. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:54:08.447579 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6fc18d2d-1039-469a-b73f-01f4d78542cd tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.087821 Sep 24 20:54:08.449743 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 713/1393] 10.222.0.52 () {62 vars in 1199 bytes} [Sat Sep 24 20:54:08 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 92 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 24 20:54:08.459588 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6f6a281d-de74-4d50-899e-297fe85f9a6a tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Calling method '.version_select at 0x7f4b110181f0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:08.478910 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6f6a281d-de74-4d50-899e-297fe85f9a6a tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-405725505" status: 204 len: 0 microversion: 2.2 time: 0.023653 Sep 24 20:54:08.479746 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 714/1394] 10.222.0.52 () {60 vars in 1258 bytes} [Sat Sep 24 20:54:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-405725505 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 24 20:54:08.490467 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4954034d-1c52-4283-bd81-b39e289665cb tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Action: 'create', calling method: .version_select at 0x7f4b110245e0>, body: {"keypair": {"name": "tempest-keypair-385200851", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:08.507279 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-4954034d-1c52-4283-bd81-b39e289665cb tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Getting quotas for project 176a40378e334575814671210471a92c. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:54:08.512187 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-4954034d-1c52-4283-bd81-b39e289665cb tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Getting quotas for user 50812c49f681493bbe428d7376572b3d and project 176a40378e334575814671210471a92c. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:54:08.536083 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4954034d-1c52-4283-bd81-b39e289665cb tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.049557 Sep 24 20:54:08.536920 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 715/1395] 10.222.0.52 () {62 vars in 1199 bytes} [Sat Sep 24 20:54:08 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Sep 24 20:54:08.547968 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-707e2f6e-446a-422a-827d-5fc4910d9958 tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Calling method '.version_select at 0x7f4b110249d0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:08.568567 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-707e2f6e-446a-422a-827d-5fc4910d9958 tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-385200851" status: 204 len: 0 microversion: 2.2 time: 0.024472 Sep 24 20:54:08.569414 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 716/1396] 10.222.0.52 () {60 vars in 1258 bytes} [Sat Sep 24 20:54:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-385200851 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 24 20:54:08.581800 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-de555bc3-57d6-41a7-ac62-fc3a66462744 tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Action: 'create', calling method: .version_select at 0x7f4b11018310>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1602301050", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBObj4d2iUOHkFg8Wylx0oCrgASLtqwgzCtDd3u+zR0JXABZvDWkIqjsyWBjEZHfk5eIXqQekAyerKuqG4HhpIc8LiqEIB5seDyeoq7202k/SkI17ls+Ql5UFp6U9oRTm7A=="}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:08.598018 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-de555bc3-57d6-41a7-ac62-fc3a66462744 tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Getting quotas for project 176a40378e334575814671210471a92c. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:54:08.604070 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-de555bc3-57d6-41a7-ac62-fc3a66462744 tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Getting quotas for user 50812c49f681493bbe428d7376572b3d and project 176a40378e334575814671210471a92c. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:54:08.638940 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-de555bc3-57d6-41a7-ac62-fc3a66462744 tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.061829 Sep 24 20:54:08.641294 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 717/1397] 10.222.0.52 () {62 vars in 1199 bytes} [Sat Sep 24 20:54:08 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 65 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 24 20:54:08.647855 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-801a6bed-fbd9-4410-b46e-6cf4c4452b43 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b0ceb3940>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:08.736499 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-801a6bed-fbd9-4410-b46e-6cf4c4452b43 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913" status: 200 len: 1421 microversion: 2.1 time: 0.093901 Sep 24 20:54:08.745605 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 718/1398] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:54:08 2022] GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913 => generated 1421 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:08.791172 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bddbf4f0-9aa2-4b52-98a1-16854b78e26d tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Action: 'create', calling method: .version_select at 0x7f4b11018280>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1300898397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACnGvKO2APtVh9HK5KqXO0cl2IMeidMitnn5NAThzmslzuywtYIbou6o3wZ3sJjASAUPADl3xO8A42faRYE124jyuGvA6GQXHfYvOXKzU03D1nbdsTiyjRokpda9cOPRA=="}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:08.856627 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-bddbf4f0-9aa2-4b52-98a1-16854b78e26d tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Getting quotas for project 176a40378e334575814671210471a92c. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:54:08.863990 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-bddbf4f0-9aa2-4b52-98a1-16854b78e26d tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Getting quotas for user 50812c49f681493bbe428d7376572b3d and project 176a40378e334575814671210471a92c. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:54:08.901502 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bddbf4f0-9aa2-4b52-98a1-16854b78e26d tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.161448 Sep 24 20:54:08.902577 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 719/1399] 10.222.0.52 () {62 vars in 1199 bytes} [Sat Sep 24 20:54:08 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 163 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 24 20:54:08.911424 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7d3098f1-00de-4ef6-a6d5-ae971422bfbd tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:08.911424 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7d3098f1-00de-4ef6-a6d5-ae971422bfbd tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:08.917752 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d3098f1-00de-4ef6-a6d5-ae971422bfbd tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:08.918457 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d3098f1-00de-4ef6-a6d5-ae971422bfbd tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:08.919239 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d3098f1-00de-4ef6-a6d5-ae971422bfbd tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:08.920212 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d3098f1-00de-4ef6-a6d5-ae971422bfbd tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:08.920832 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d3098f1-00de-4ef6-a6d5-ae971422bfbd tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:08.921360 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d3098f1-00de-4ef6-a6d5-ae971422bfbd tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:09.171612 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7d3098f1-00de-4ef6-a6d5-ae971422bfbd tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:09.187577 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7d3098f1-00de-4ef6-a6d5-ae971422bfbd tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1534 microversion: 2.1 time: 0.283633 Sep 24 20:54:09.188631 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 720/1400] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:08 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1534 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:09.197119 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0e203fd7-f1f2-4100-8f87-2ccaf53c7a1c tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Action: 'create', calling method: .version_select at 0x7f4b11018940>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1488166655", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFnXYCjJnKn3P3Os092IyGYTXTVcWRe38rVkC7erpcs6pO9zhgS+RI0tuECaHH5wplK+NuI1ez7YUM96luf/zhEV7NWoKO5Knl3VsoHfU2nPBgbYK8Tnp2eSbro+hfcGsA=="}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:09.220799 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-0e203fd7-f1f2-4100-8f87-2ccaf53c7a1c tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Getting quotas for project 176a40378e334575814671210471a92c. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:54:09.228120 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-0e203fd7-f1f2-4100-8f87-2ccaf53c7a1c tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Getting quotas for user 50812c49f681493bbe428d7376572b3d and project 176a40378e334575814671210471a92c. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:54:09.268534 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0e203fd7-f1f2-4100-8f87-2ccaf53c7a1c tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.076598 Sep 24 20:54:09.269436 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 721/1401] 10.222.0.52 () {62 vars in 1199 bytes} [Sat Sep 24 20:54:09 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 80 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 24 20:54:09.276462 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b883c459-8995-4b9c-9728-0f9dc58c067a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:09.277379 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b883c459-8995-4b9c-9728-0f9dc58c067a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:09.284522 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b883c459-8995-4b9c-9728-0f9dc58c067a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:09.285290 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b883c459-8995-4b9c-9728-0f9dc58c067a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:09.285637 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b883c459-8995-4b9c-9728-0f9dc58c067a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:09.286644 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b883c459-8995-4b9c-9728-0f9dc58c067a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:09.287840 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b883c459-8995-4b9c-9728-0f9dc58c067a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:09.288315 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b883c459-8995-4b9c-9728-0f9dc58c067a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:09.365371 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b883c459-8995-4b9c-9728-0f9dc58c067a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:09.374548 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b883c459-8995-4b9c-9728-0f9dc58c067a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:09.376118 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b883c459-8995-4b9c-9728-0f9dc58c067a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:09.377491 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b883c459-8995-4b9c-9728-0f9dc58c067a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1335 microversion: 2.25 time: 0.105848 Sep 24 20:54:09.379001 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 722/1402] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:54:09 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1335 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:54:09.391265 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0124a809-3709-43d7-be00-a35d5105ab9a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:09.391923 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0124a809-3709-43d7-be00-a35d5105ab9a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 39c753b7-d223-4e33-9086-d64877d26ecc] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:09.402980 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0124a809-3709-43d7-be00-a35d5105ab9a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:09.403492 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0124a809-3709-43d7-be00-a35d5105ab9a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:09.403936 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0124a809-3709-43d7-be00-a35d5105ab9a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:09.404653 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0124a809-3709-43d7-be00-a35d5105ab9a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:09.405816 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0124a809-3709-43d7-be00-a35d5105ab9a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:09.406359 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0124a809-3709-43d7-be00-a35d5105ab9a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:09.499652 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0124a809-3709-43d7-be00-a35d5105ab9a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:09.509647 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0124a809-3709-43d7-be00-a35d5105ab9a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc" status: 200 len: 1279 microversion: 2.1 time: 0.129597 Sep 24 20:54:09.525867 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 723/1403] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:09 2022] GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc => generated 1279 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:09.532530 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b93f4702-aa96-40e3-85c0-c8c9329fdeff tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Calling method '.version_select at 0x7f4b11024b80>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:09.537296 ncdv-master-1 devstack@n-api.service[140517]: WARNING oslo_db.sqlalchemy.utils [None req-b93f4702-aa96-40e3-85c0-c8c9329fdeff tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 24 20:54:09.543006 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b93f4702-aa96-40e3-85c0-c8c9329fdeff tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs" status: 200 len: 1142 microversion: 2.2 time: 0.015802 Sep 24 20:54:09.543916 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 724/1404] 10.222.0.52 () {60 vars in 1177 bytes} [Sat Sep 24 20:54:09 2022] GET /compute/v2.1/os-keypairs => generated 1142 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:09.548601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fd8dc062-0036-461b-81d7-481fa8e06445 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:09.549251 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fd8dc062-0036-461b-81d7-481fa8e06445 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a89ef546-702c-4ecd-babc-7d523421339b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:09.555663 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd8dc062-0036-461b-81d7-481fa8e06445 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:09.556386 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd8dc062-0036-461b-81d7-481fa8e06445 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:09.556946 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd8dc062-0036-461b-81d7-481fa8e06445 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:09.557719 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd8dc062-0036-461b-81d7-481fa8e06445 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:09.558255 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd8dc062-0036-461b-81d7-481fa8e06445 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:09.558786 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd8dc062-0036-461b-81d7-481fa8e06445 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:09.590352 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:54:09.662461 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fd8dc062-0036-461b-81d7-481fa8e06445 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:09.672470 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fd8dc062-0036-461b-81d7-481fa8e06445 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b" status: 200 len: 1212 microversion: 2.1 time: 0.127416 Sep 24 20:54:09.675020 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 725/1405] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:09 2022] GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b => generated 1212 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:09.680088 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b07d4c6d-3388-4c86-8fa4-24622fa9bf00 tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Calling method '.version_select at 0x7f4b11018c10>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:09.705249 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b07d4c6d-3388-4c86-8fa4-24622fa9bf00 tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1488166655" status: 204 len: 0 microversion: 2.2 time: 0.028790 Sep 24 20:54:09.715245 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 726/1406] 10.222.0.52 () {60 vars in 1321 bytes} [Sat Sep 24 20:54:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1488166655 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:54:09.727101 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1e63bdb8-a511-47ff-8994-ce57d172cffe tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Calling method '.version_select at 0x7f4b1107d0d0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:09.743333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:DELETE=4 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:54:09.748859 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1e63bdb8-a511-47ff-8994-ce57d172cffe tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1300898397" status: 204 len: 0 microversion: 2.2 time: 0.029981 Sep 24 20:54:09.749873 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 727/1407] 10.222.0.52 () {60 vars in 1321 bytes} [Sat Sep 24 20:54:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1300898397 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 24 20:54:09.754591 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-acd59728-94bf-47f4-abb1-dbacb75bafc0 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b11081670>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:09.808680 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-acd59728-94bf-47f4-abb1-dbacb75bafc0 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913" status: 200 len: 1421 microversion: 2.1 time: 0.057850 Sep 24 20:54:09.810557 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 728/1408] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:54:09 2022] GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913 => generated 1421 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:09.816266 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b49b5f36-d7be-44ed-b78c-b34796c2dd1f tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Calling method '.version_select at 0x7f4b11024670>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:09.835399 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b49b5f36-d7be-44ed-b78c-b34796c2dd1f tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1602301050" status: 204 len: 0 microversion: 2.2 time: 0.025059 Sep 24 20:54:09.836124 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 729/1409] 10.222.0.52 () {60 vars in 1321 bytes} [Sat Sep 24 20:54:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1602301050 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:54:09.850565 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-91a47d91-b3fa-4d77-b4cc-6c4081e5cdcc tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Action: 'create', calling method: .version_select at 0x7f4b110c71f0>, body: {"keypair": {"name": "tempest-keypair-1754526951", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxIHN0npQ5K6OxeGIyLAibIkYtbIQ2zqcmy0rlBxn7q7WTWD3W7+m8c+SdskddJSI8+gTevKKskKIQBqNzVH8rLMacH0lkMeOaSaC9cawgDsUvA93RKp5yHyDdj61hgsQ=="}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:09.868662 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-91a47d91-b3fa-4d77-b4cc-6c4081e5cdcc tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Getting quotas for project 176a40378e334575814671210471a92c. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:54:09.873974 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-91a47d91-b3fa-4d77-b4cc-6c4081e5cdcc tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Getting quotas for user 50812c49f681493bbe428d7376572b3d and project 176a40378e334575814671210471a92c. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:54:09.902085 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-91a47d91-b3fa-4d77-b4cc-6c4081e5cdcc tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.056902 Sep 24 20:54:09.902730 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 730/1410] 10.222.0.52 () {62 vars in 1199 bytes} [Sat Sep 24 20:54:09 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 58 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 24 20:54:09.913788 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d5ecfe59-7aa6-48ee-bafd-f8eea92ccf3d tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Calling method '.version_select at 0x7f4b110aae50>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:09.922337 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d5ecfe59-7aa6-48ee-bafd-f8eea92ccf3d tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs/tempest-keypair-1754526951" status: 200 len: 513 microversion: 2.2 time: 0.012308 Sep 24 20:54:09.923126 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 731/1411] 10.222.0.52 () {60 vars in 1258 bytes} [Sat Sep 24 20:54:09 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1754526951 => generated 513 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:54:09.934638 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0dbcc8c6-16e3-44fd-b7bf-17392bf7bf71 tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Calling method '.version_select at 0x7f4b110c75e0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:09.938393 ncdv-master-1 devstack@n-api.service[140517]: WARNING oslo_db.sqlalchemy.utils [None req-0dbcc8c6-16e3-44fd-b7bf-17392bf7bf71 tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 24 20:54:09.944238 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0dbcc8c6-16e3-44fd-b7bf-17392bf7bf71 tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.013284 Sep 24 20:54:09.944952 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 732/1412] 10.222.0.52 () {60 vars in 1177 bytes} [Sat Sep 24 20:54:09 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:54:09.954745 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fcefdcc0-b4f4-430b-abf7-4149afb42f31 tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Calling method '.version_select at 0x7f4b1109e670>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:09.975200 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fcefdcc0-b4f4-430b-abf7-4149afb42f31 tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1754526951" status: 204 len: 0 microversion: 2.2 time: 0.023871 Sep 24 20:54:09.976005 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 733/1413] 10.222.0.52 () {60 vars in 1261 bytes} [Sat Sep 24 20:54:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1754526951 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 24 20:54:09.985041 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-357b1d48-4fd2-4f45-b5bf-480dc8b53f7b tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Action: 'create', calling method: .version_select at 0x7f4b110815e0>, body: {"keypair": {"name": "tempest-keypair-1089355385", "type": "x509"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:10.001713 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-357b1d48-4fd2-4f45-b5bf-480dc8b53f7b tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Getting quotas for project 176a40378e334575814671210471a92c. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:54:10.006649 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-357b1d48-4fd2-4f45-b5bf-480dc8b53f7b tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Getting quotas for user 50812c49f681493bbe428d7376572b3d and project 176a40378e334575814671210471a92c. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:54:10.023105 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.processutils [None req-357b1d48-4fd2-4f45-b5bf-480dc8b53f7b tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp7nqx1wwc/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp7nqx1wwc/temp.key -subj /CN=50812c49f681493bbe428d7376572b3d -extensions v3_req_client {{(pid=140517) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 24 20:54:10.216424 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.processutils [None req-357b1d48-4fd2-4f45-b5bf-480dc8b53f7b tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp7nqx1wwc/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp7nqx1wwc/temp.key -subj /CN=50812c49f681493bbe428d7376572b3d -extensions v3_req_client" returned: 0 in 0.193s {{(pid=140517) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 24 20:54:10.217991 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.processutils [None req-357b1d48-4fd2-4f45-b5bf-480dc8b53f7b tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp7nqx1wwc/temp.key -password pass: {{(pid=140517) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 24 20:54:10.243010 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.processutils [None req-357b1d48-4fd2-4f45-b5bf-480dc8b53f7b tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp7nqx1wwc/temp.key -password pass:" returned: 0 in 0.024s {{(pid=140517) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 24 20:54:10.326756 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-357b1d48-4fd2-4f45-b5bf-480dc8b53f7b tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Getting quotas for project 176a40378e334575814671210471a92c. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:54:10.334743 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-357b1d48-4fd2-4f45-b5bf-480dc8b53f7b tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Getting quotas for user 50812c49f681493bbe428d7376572b3d and project 176a40378e334575814671210471a92c. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:54:10.359925 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-357b1d48-4fd2-4f45-b5bf-480dc8b53f7b tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.378543 Sep 24 20:54:10.360936 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 734/1414] 10.222.0.52 () {62 vars in 1198 bytes} [Sat Sep 24 20:54:09 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 380 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:54:10.367249 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f2b0ec4d-4d1d-4d6e-b87a-1c27f7016c19 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:10.367979 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f2b0ec4d-4d1d-4d6e-b87a-1c27f7016c19 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:10.375101 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f2b0ec4d-4d1d-4d6e-b87a-1c27f7016c19 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:10.375633 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f2b0ec4d-4d1d-4d6e-b87a-1c27f7016c19 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:10.376087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f2b0ec4d-4d1d-4d6e-b87a-1c27f7016c19 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:10.376898 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f2b0ec4d-4d1d-4d6e-b87a-1c27f7016c19 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:10.377404 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f2b0ec4d-4d1d-4d6e-b87a-1c27f7016c19 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:10.378365 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f2b0ec4d-4d1d-4d6e-b87a-1c27f7016c19 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:10.618775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f2b0ec4d-4d1d-4d6e-b87a-1c27f7016c19 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:10.645576 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f2b0ec4d-4d1d-4d6e-b87a-1c27f7016c19 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1527 microversion: 2.1 time: 0.283460 Sep 24 20:54:10.650859 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 735/1415] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:10 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1527 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:10.655733 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5dee694e-4ab8-4518-9645-14576057a479 tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Calling method '.version_select at 0x7f4b11081160>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:10.694047 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5dee694e-4ab8-4518-9645-14576057a479 tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs/tempest-keypair-1089355385" status: 200 len: 1534 microversion: 2.2 time: 0.041859 Sep 24 20:54:10.696513 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 736/1416] 10.222.0.52 () {60 vars in 1258 bytes} [Sat Sep 24 20:54:10 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1089355385 => generated 1534 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:10.710832 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-232f171b-f3f2-4a5e-9c45-0a630810523f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:10.711532 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-232f171b-f3f2-4a5e-9c45-0a630810523f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:10.718089 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-232f171b-f3f2-4a5e-9c45-0a630810523f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:10.718949 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-232f171b-f3f2-4a5e-9c45-0a630810523f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:10.719550 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-232f171b-f3f2-4a5e-9c45-0a630810523f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:10.722056 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-232f171b-f3f2-4a5e-9c45-0a630810523f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:10.723017 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-232f171b-f3f2-4a5e-9c45-0a630810523f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:10.723584 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-232f171b-f3f2-4a5e-9c45-0a630810523f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:10.843033 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-232f171b-f3f2-4a5e-9c45-0a630810523f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:10.855178 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-232f171b-f3f2-4a5e-9c45-0a630810523f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:10.856809 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-232f171b-f3f2-4a5e-9c45-0a630810523f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:10.858028 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-232f171b-f3f2-4a5e-9c45-0a630810523f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1341 microversion: 2.25 time: 0.158472 Sep 24 20:54:10.858972 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 737/1417] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:54:10 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1341 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:54:10.863603 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-92bb7c14-adb4-482e-81cb-7d10640ffff2 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:10.864232 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-92bb7c14-adb4-482e-81cb-7d10640ffff2 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 39c753b7-d223-4e33-9086-d64877d26ecc] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:10.884383 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-92bb7c14-adb4-482e-81cb-7d10640ffff2 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:10.884950 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-92bb7c14-adb4-482e-81cb-7d10640ffff2 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:10.885450 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-92bb7c14-adb4-482e-81cb-7d10640ffff2 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:10.886603 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-92bb7c14-adb4-482e-81cb-7d10640ffff2 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:10.887141 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-92bb7c14-adb4-482e-81cb-7d10640ffff2 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:10.887583 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-92bb7c14-adb4-482e-81cb-7d10640ffff2 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:10.996848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-92bb7c14-adb4-482e-81cb-7d10640ffff2 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:11.012747 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-92bb7c14-adb4-482e-81cb-7d10640ffff2 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc" status: 200 len: 1279 microversion: 2.1 time: 0.152444 Sep 24 20:54:11.013971 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 738/1418] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:10 2022] GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc => generated 1279 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:11.024900 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-924a4a2c-daa5-4c6f-b10f-8e183f1c6152 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:11.025804 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-924a4a2c-daa5-4c6f-b10f-8e183f1c6152 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:11.043747 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-caf4656a-0c26-41f3-bb1b-7c74149f30b7 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3/action" status: 202 len: 0 microversion: 2.1 time: 5.386481 Sep 24 20:54:11.044466 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-924a4a2c-daa5-4c6f-b10f-8e183f1c6152 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:11.046904 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-924a4a2c-daa5-4c6f-b10f-8e183f1c6152 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:11.047396 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-924a4a2c-daa5-4c6f-b10f-8e183f1c6152 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:11.048375 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-924a4a2c-daa5-4c6f-b10f-8e183f1c6152 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:11.048860 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-924a4a2c-daa5-4c6f-b10f-8e183f1c6152 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:11.050097 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-924a4a2c-daa5-4c6f-b10f-8e183f1c6152 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:11.051368 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 681/1419] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:54:05 2022] POST /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3/action => generated 0 bytes in 5390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:54:11.068650 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7605cd3c-0574-44b7-9fa4-3a238c519171 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:11.074602 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7605cd3c-0574-44b7-9fa4-3a238c519171 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a89ef546-702c-4ecd-babc-7d523421339b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:11.091543 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7605cd3c-0574-44b7-9fa4-3a238c519171 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:11.092404 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7605cd3c-0574-44b7-9fa4-3a238c519171 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:11.093099 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7605cd3c-0574-44b7-9fa4-3a238c519171 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:11.099560 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7605cd3c-0574-44b7-9fa4-3a238c519171 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:11.100447 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7605cd3c-0574-44b7-9fa4-3a238c519171 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:11.101087 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7605cd3c-0574-44b7-9fa4-3a238c519171 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:11.213785 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7605cd3c-0574-44b7-9fa4-3a238c519171 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:11.222395 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7605cd3c-0574-44b7-9fa4-3a238c519171 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b" status: 200 len: 1268 microversion: 2.1 time: 0.167699 Sep 24 20:54:11.223175 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 682/1420] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:11 2022] GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b => generated 1268 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:11.230244 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2eefbfae-822c-46f1-ad73-e1e02d5eb7d7 tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Calling method '.version_select at 0x7f4b0c6673a0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:11.235172 ncdv-master-1 devstack@n-api.service[140516]: WARNING oslo_db.sqlalchemy.utils [None req-2eefbfae-822c-46f1-ad73-e1e02d5eb7d7 tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 24 20:54:11.244142 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2eefbfae-822c-46f1-ad73-e1e02d5eb7d7 tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.019791 Sep 24 20:54:11.244915 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 683/1421] 10.222.0.52 () {60 vars in 1177 bytes} [Sat Sep 24 20:54:11 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:11.249356 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-896fff70-eda9-4639-bc7d-bc561070673c tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b0c569d30>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:11.298371 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-896fff70-eda9-4639-bc7d-bc561070673c tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913" status: 200 len: 1421 microversion: 2.1 time: 0.052599 Sep 24 20:54:11.299197 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 684/1422] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:54:11 2022] GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913 => generated 1421 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:11.310844 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e41eb7d6-1516-4da5-ad01-d299e5b8b7fe tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:11.311606 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e41eb7d6-1516-4da5-ad01-d299e5b8b7fe tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:11.319618 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e41eb7d6-1516-4da5-ad01-d299e5b8b7fe tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:11.320108 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e41eb7d6-1516-4da5-ad01-d299e5b8b7fe tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:11.320550 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e41eb7d6-1516-4da5-ad01-d299e5b8b7fe tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:11.321257 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e41eb7d6-1516-4da5-ad01-d299e5b8b7fe tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:11.321715 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e41eb7d6-1516-4da5-ad01-d299e5b8b7fe tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:11.322142 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e41eb7d6-1516-4da5-ad01-d299e5b8b7fe tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:11.352585 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-924a4a2c-daa5-4c6f-b10f-8e183f1c6152 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:11.368127 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-924a4a2c-daa5-4c6f-b10f-8e183f1c6152 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1527 microversion: 2.1 time: 0.349850 Sep 24 20:54:11.369241 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 739/1423] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:11 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1527 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:11.376121 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7d44863d-317b-469e-bb8e-eb10a5868351 tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] Calling method '.version_select at 0x7f4b11081040>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:11.395520 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7d44863d-317b-469e-bb8e-eb10a5868351 tempest-KeyPairsV22TestJSON-2052187739 tempest-KeyPairsV22TestJSON-2052187739-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1089355385" status: 204 len: 0 microversion: 2.2 time: 0.024996 Sep 24 20:54:11.401046 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 740/1424] 10.222.0.52 () {60 vars in 1261 bytes} [Sat Sep 24 20:54:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1089355385 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:54:11.407377 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-eb2a9ace-3f92-44d5-9bb8-e7b47233af1f tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:11.413993 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-eb2a9ace-3f92-44d5-9bb8-e7b47233af1f tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] HTTP exception thrown: Flavor 5bff3db1-43db-4c23-bdea-b823b03cf9b3 could not be found. Sep 24 20:54:11.415841 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-eb2a9ace-3f92-44d5-9bb8-e7b47233af1f tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Request method failure captured: Sep 24 20:54:11.415841 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/flavors/5bff3db1-43db-4c23-bdea-b823b03cf9b3 HTTP/1.1 Sep 24 20:54:11.415841 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:54:11.415841 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:54:11.415841 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:54:11.415841 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:54:11.415841 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:54:11.415841 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:54:11.415841 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:54:11.415841 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:54:11.415841 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL22EOs4RBXzL5DkvYJeyiAY-4a1iqM1YGpLmcCNxC8P9CsvzmAynMe2mPS3LX4J8zH2QmYdXfKD2BQZ1NGR8t8VwBRdWIqUiINIBaG9hQ_32-z6EsaxPexDBOPFLOLd5OLOKjgiSTxC5JAZ6I_X46zZls3DKYY1ThP_W9tRiLKh3SD8 Sep 24 20:54:11.415841 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:54:11.415841 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:54:11.415841 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:54:11.415841 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:54:11.415841 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:54:11.415841 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:54:11.415841 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 00041f889f3d430d87831f82a4d3b598 Sep 24 20:54:11.415841 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-MigrationsAdminTest-82239000 Sep 24 20:54:11.415841 ncdv-master-1 devstack@n-api.service[140517]: X-Role: admin,reader,member Sep 24 20:54:11.415841 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: admin,reader,member Sep 24 20:54:11.417447 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/00041f889f3d430d87831f82a4d3b598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_00041f889f3d430d87831f82a4d3b598"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/00041f889f3d430d87831f82a4d3b598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/00041f889f3d430d87831f82a4d3b598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:54:11.417447 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-MigrationsAdminTest-82239000 Sep 24 20:54:11.417447 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 00041f889f3d430d87831f82a4d3b598 Sep 24 20:54:11.417447 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-MigrationsAdminTest-82239000 Sep 24 20:54:11.417447 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-MigrationsAdminTest-82239000-project-admin Sep 24 20:54:11.417447 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:54:11.417447 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:54:11.417447 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 4349ca208839405199602d34e1c7bf33 Sep 24 20:54:11.417447 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-MigrationsAdminTest-82239000-project-admin Sep 24 20:54:11.417447 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:54:11.417447 ncdv-master-1 devstack@n-api.service[140517]: exception: Flavor 5bff3db1-43db-4c23-bdea-b823b03cf9b3 could not be found. Sep 24 20:54:11.417447 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '5bff3db1-43db-4c23-bdea-b823b03cf9b3'} Sep 24 20:54:11.419729 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:54:11.419729 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:11.419729 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Sep 24 20:54:11.419729 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi flavor.destroy() Sep 24 20:54:11.419729 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 24 20:54:11.419729 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 24 20:54:11.419729 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Sep 24 20:54:11.419729 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Sep 24 20:54:11.419729 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Sep 24 20:54:11.419729 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Sep 24 20:54:11.419729 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 24 20:54:11.419729 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 24 20:54:11.419729 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Sep 24 20:54:11.419729 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Sep 24 20:54:11.419729 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 5bff3db1-43db-4c23-bdea-b823b03cf9b3 could not be found. Sep 24 20:54:11.419729 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:54:11.419729 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:54:11.419729 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:54:11.419729 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:11.419729 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:54:11.421005 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:54:11.421005 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:54:11.421005 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:54:11.421005 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:54:11.421005 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:54:11.421005 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Sep 24 20:54:11.421005 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:54:11.421005 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 5bff3db1-43db-4c23-bdea-b823b03cf9b3 could not be found. Sep 24 20:54:11.421005 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:54:11.421005 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:54:11.421005 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:54:11.421005 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:11.421005 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:54:11.421005 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:54:11.421005 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:54:11.421005 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:54:11.421005 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 5bff3db1-43db-4c23-bdea-b823b03cf9b3 could not be found. Sep 24 20:54:11.421005 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:54:11.422386 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-eb2a9ace-3f92-44d5-9bb8-e7b47233af1f tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Returning 404 to user: Flavor 5bff3db1-43db-4c23-bdea-b823b03cf9b3 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:54:11.422386 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-eb2a9ace-3f92-44d5-9bb8-e7b47233af1f tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/5bff3db1-43db-4c23-bdea-b823b03cf9b3" status: 404 len: 109 microversion: 2.1 time: 0.015251 Sep 24 20:54:11.422386 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 741/1425] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:54:11 2022] DELETE /compute/v2.1/flavors/5bff3db1-43db-4c23-bdea-b823b03cf9b3 => generated 109 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:54:11.615624 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f2f084e4-6a41-4649-9940-1844775b6848 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-154450772", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:11.646048 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e41eb7d6-1516-4da5-ad01-d299e5b8b7fe tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:11.664369 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e41eb7d6-1516-4da5-ad01-d299e5b8b7fe tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1715 microversion: 2.1 time: 0.362876 Sep 24 20:54:11.665212 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 685/1426] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:11 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1715 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:11.731171 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-f2f084e4-6a41-4649-9940-1844775b6848 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] validate_networks() for None {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:54:11.884554 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-490f63e2-4d66-4af3-8122-8c19947dc817 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:11.885094 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-490f63e2-4d66-4af3-8122-8c19947dc817 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:11.897264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-490f63e2-4d66-4af3-8122-8c19947dc817 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:11.897764 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-490f63e2-4d66-4af3-8122-8c19947dc817 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:11.910756 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-490f63e2-4d66-4af3-8122-8c19947dc817 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:11.920863 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-490f63e2-4d66-4af3-8122-8c19947dc817 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:11.923994 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-490f63e2-4d66-4af3-8122-8c19947dc817 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:11.929787 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-490f63e2-4d66-4af3-8122-8c19947dc817 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:11.964679 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:54:12.427540 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:54:12.661362 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-490f63e2-4d66-4af3-8122-8c19947dc817 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:12.673757 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-490f63e2-4d66-4af3-8122-8c19947dc817 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:12.676867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-490f63e2-4d66-4af3-8122-8c19947dc817 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:12.678616 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-490f63e2-4d66-4af3-8122-8c19947dc817 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1409 microversion: 2.25 time: 0.799284 Sep 24 20:54:12.681089 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 686/1427] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:54:11 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1409 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:54:12.698182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-586d5cf2-00d4-49c1-8ad1-0a576aceed8e tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:12.698863 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-586d5cf2-00d4-49c1-8ad1-0a576aceed8e tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 39c753b7-d223-4e33-9086-d64877d26ecc] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:12.709440 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-586d5cf2-00d4-49c1-8ad1-0a576aceed8e tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:12.709938 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-586d5cf2-00d4-49c1-8ad1-0a576aceed8e tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:12.710377 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-586d5cf2-00d4-49c1-8ad1-0a576aceed8e tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:12.711240 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-586d5cf2-00d4-49c1-8ad1-0a576aceed8e tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:12.719023 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-586d5cf2-00d4-49c1-8ad1-0a576aceed8e tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:12.719809 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-586d5cf2-00d4-49c1-8ad1-0a576aceed8e tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:13.505792 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-f2f084e4-6a41-4649-9940-1844775b6848 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:54:13.506242 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-f2f084e4-6a41-4649-9940-1844775b6848 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:54:13.506781 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-f2f084e4-6a41-4649-9940-1844775b6848 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:54:13.507229 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-f2f084e4-6a41-4649-9940-1844775b6848 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:54:13.507664 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-f2f084e4-6a41-4649-9940-1844775b6848 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:54:13.518762 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f2f084e4-6a41-4649-9940-1844775b6848 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:13.519268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f2f084e4-6a41-4649-9940-1844775b6848 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:13.519730 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f2f084e4-6a41-4649-9940-1844775b6848 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:13.527986 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f2f084e4-6a41-4649-9940-1844775b6848 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:13.528561 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f2f084e4-6a41-4649-9940-1844775b6848 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:13.529022 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f2f084e4-6a41-4649-9940-1844775b6848 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:13.579539 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-f2f084e4-6a41-4649-9940-1844775b6848 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Getting quotas for project 349d3aa8627644d59867a744695f2579. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:54:13.588058 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-f2f084e4-6a41-4649-9940-1844775b6848 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Getting quotas for user 93982876b1e24efb8ffa8c009532343a and project 349d3aa8627644d59867a744695f2579. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:54:13.624442 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f2f084e4-6a41-4649-9940-1844775b6848 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:54:13.635340 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f2f084e4-6a41-4649-9940-1844775b6848 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:54:13.745984 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f2f084e4-6a41-4649-9940-1844775b6848 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.134616 Sep 24 20:54:13.753910 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 742/1428] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:54:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2143 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 24 20:54:13.759858 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-38e8fd34-db7f-4dfd-87ab-b596f833575a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:13.760660 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-38e8fd34-db7f-4dfd-87ab-b596f833575a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a89ef546-702c-4ecd-babc-7d523421339b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:13.768081 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38e8fd34-db7f-4dfd-87ab-b596f833575a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:13.769756 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38e8fd34-db7f-4dfd-87ab-b596f833575a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:13.770391 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38e8fd34-db7f-4dfd-87ab-b596f833575a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:13.771302 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38e8fd34-db7f-4dfd-87ab-b596f833575a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:13.772181 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38e8fd34-db7f-4dfd-87ab-b596f833575a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:13.772778 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38e8fd34-db7f-4dfd-87ab-b596f833575a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:13.797705 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-586d5cf2-00d4-49c1-8ad1-0a576aceed8e tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:13.811009 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-586d5cf2-00d4-49c1-8ad1-0a576aceed8e tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc" status: 200 len: 1321 microversion: 2.1 time: 1.126976 Sep 24 20:54:13.811897 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 687/1429] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:12 2022] GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc => generated 1321 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:13.820042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-ca199cdc-a9f8-4c18-8c83-43c159d752d5 req-d053c57e-c463-4f0e-8e20-965fb58d4dee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "684811fb-a8ce-497a-a8f2-c66d6e4512bd", "name": "network-vif-plugged", "status": "completed", "tag": "f1619055-c388-4c6a-ae4a-12376117a1fd"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:13.842809 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-ca199cdc-a9f8-4c18-8c83-43c159d752d5 req-d053c57e-c463-4f0e-8e20-965fb58d4dee service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:13.848039 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-ca199cdc-a9f8-4c18-8c83-43c159d752d5 req-d053c57e-c463-4f0e-8e20-965fb58d4dee service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:13.849476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-ca199cdc-a9f8-4c18-8c83-43c159d752d5 req-d053c57e-c463-4f0e-8e20-965fb58d4dee service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:13.863107 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-ca199cdc-a9f8-4c18-8c83-43c159d752d5 req-d053c57e-c463-4f0e-8e20-965fb58d4dee service nova] Creating event network-vif-plugged:f1619055-c388-4c6a-ae4a-12376117a1fd for instance 684811fb-a8ce-497a-a8f2-c66d6e4512bd on nch1-master-1 Sep 24 20:54:13.868795 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-ca199cdc-a9f8-4c18-8c83-43c159d752d5 req-d053c57e-c463-4f0e-8e20-965fb58d4dee service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052627 Sep 24 20:54:13.870130 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 688/1430] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:54:13.891715 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fcef5633-94fa-4db6-8c5c-2ee825070c9f tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b0c954af0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:13.964150 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fcef5633-94fa-4db6-8c5c-2ee825070c9f tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913" status: 200 len: 1421 microversion: 2.1 time: 0.092857 Sep 24 20:54:13.965084 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 689/1431] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:54:13 2022] GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913 => generated 1421 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:13.977706 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-291bb045-be72-481c-9651-616b867d91a5 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:13.979457 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-291bb045-be72-481c-9651-616b867d91a5 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:13.995946 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-291bb045-be72-481c-9651-616b867d91a5 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:13.996760 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-291bb045-be72-481c-9651-616b867d91a5 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:13.997487 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-291bb045-be72-481c-9651-616b867d91a5 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:13.998582 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-291bb045-be72-481c-9651-616b867d91a5 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:13.999259 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-291bb045-be72-481c-9651-616b867d91a5 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:14.000418 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-291bb045-be72-481c-9651-616b867d91a5 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:14.062008 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-38e8fd34-db7f-4dfd-87ab-b596f833575a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:14.085873 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-38e8fd34-db7f-4dfd-87ab-b596f833575a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b" status: 200 len: 1274 microversion: 2.1 time: 0.321020 Sep 24 20:54:14.086543 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 743/1432] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:13 2022] GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b => generated 1274 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:14.105733 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-bab60c7c-7ab7-4fc0-ac8f-fb995f1572d7 req-5b9a13eb-ca3c-4fea-8843-7bd90a5857da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39c753b7-d223-4e33-9086-d64877d26ecc", "tag": "7aefbbe0-4d35-4c50-9cd0-90292cc0b874"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:14.121258 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-bab60c7c-7ab7-4fc0-ac8f-fb995f1572d7 req-5b9a13eb-ca3c-4fea-8843-7bd90a5857da service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:14.123138 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-bab60c7c-7ab7-4fc0-ac8f-fb995f1572d7 req-5b9a13eb-ca3c-4fea-8843-7bd90a5857da service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:14.124375 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-bab60c7c-7ab7-4fc0-ac8f-fb995f1572d7 req-5b9a13eb-ca3c-4fea-8843-7bd90a5857da service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:14.148784 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-bab60c7c-7ab7-4fc0-ac8f-fb995f1572d7 req-5b9a13eb-ca3c-4fea-8843-7bd90a5857da service nova] Creating event network-changed:7aefbbe0-4d35-4c50-9cd0-90292cc0b874 for instance 39c753b7-d223-4e33-9086-d64877d26ecc on nch1-master-1 Sep 24 20:54:14.156353 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-bab60c7c-7ab7-4fc0-ac8f-fb995f1572d7 req-5b9a13eb-ca3c-4fea-8843-7bd90a5857da service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067884 Sep 24 20:54:14.166204 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 744/1433] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:54:14.176939 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=9 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:54:14.195894 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-98bb5def-fe16-458f-b045-5094e28d68a3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:14.197647 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-98bb5def-fe16-458f-b045-5094e28d68a3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:14.209057 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=12 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:54:14.211913 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98bb5def-fe16-458f-b045-5094e28d68a3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:14.213583 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98bb5def-fe16-458f-b045-5094e28d68a3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:14.214222 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98bb5def-fe16-458f-b045-5094e28d68a3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:14.215200 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98bb5def-fe16-458f-b045-5094e28d68a3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:14.215821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98bb5def-fe16-458f-b045-5094e28d68a3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:14.216427 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98bb5def-fe16-458f-b045-5094e28d68a3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:14.906546 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-291bb045-be72-481c-9651-616b867d91a5 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:14.919240 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-291bb045-be72-481c-9651-616b867d91a5 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1715 microversion: 2.1 time: 0.952127 Sep 24 20:54:14.936702 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 690/1434] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:13 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1715 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:14.945119 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-41774be8-d0a0-48e5-b56c-52b8a18c6891 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:14.947787 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-41774be8-d0a0-48e5-b56c-52b8a18c6891 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:14.956386 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41774be8-d0a0-48e5-b56c-52b8a18c6891 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:14.958219 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41774be8-d0a0-48e5-b56c-52b8a18c6891 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:14.959252 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41774be8-d0a0-48e5-b56c-52b8a18c6891 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:14.960271 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41774be8-d0a0-48e5-b56c-52b8a18c6891 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:14.961895 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41774be8-d0a0-48e5-b56c-52b8a18c6891 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:14.962560 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41774be8-d0a0-48e5-b56c-52b8a18c6891 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:15.000539 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-98bb5def-fe16-458f-b045-5094e28d68a3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:15.012680 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-98bb5def-fe16-458f-b045-5094e28d68a3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:15.016796 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-98bb5def-fe16-458f-b045-5094e28d68a3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:15.021697 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-98bb5def-fe16-458f-b045-5094e28d68a3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1409 microversion: 2.25 time: 0.853576 Sep 24 20:54:15.042915 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 745/1435] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:54:14 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1409 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:54:15.051372 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-92772713-bcd2-4aa0-91aa-84a3e7cc251a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:15.052351 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-92772713-bcd2-4aa0-91aa-84a3e7cc251a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 39c753b7-d223-4e33-9086-d64877d26ecc] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:15.061092 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-92772713-bcd2-4aa0-91aa-84a3e7cc251a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:15.061854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-92772713-bcd2-4aa0-91aa-84a3e7cc251a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:15.063142 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-92772713-bcd2-4aa0-91aa-84a3e7cc251a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:15.064466 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-92772713-bcd2-4aa0-91aa-84a3e7cc251a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:15.065186 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-92772713-bcd2-4aa0-91aa-84a3e7cc251a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:15.065812 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-92772713-bcd2-4aa0-91aa-84a3e7cc251a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:15.108999 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-41774be8-d0a0-48e5-b56c-52b8a18c6891 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:15.123143 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-41774be8-d0a0-48e5-b56c-52b8a18c6891 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1264 microversion: 2.1 time: 0.184974 Sep 24 20:54:15.123734 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 691/1436] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:14 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1264 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:15.134786 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ed999a3a-678c-432d-82a2-21db2f91a14b tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b0ce2dd30>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:15.213139 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ed999a3a-678c-432d-82a2-21db2f91a14b tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913" status: 200 len: 1421 microversion: 2.1 time: 0.087792 Sep 24 20:54:15.214410 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 692/1437] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:54:15 2022] GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913 => generated 1421 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:15.234259 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-96c7e35d-3e75-415b-a065-2fba7dcf233f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:15.235374 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-96c7e35d-3e75-415b-a065-2fba7dcf233f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a89ef546-702c-4ecd-babc-7d523421339b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:15.246994 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96c7e35d-3e75-415b-a065-2fba7dcf233f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:15.247530 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96c7e35d-3e75-415b-a065-2fba7dcf233f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:15.247979 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96c7e35d-3e75-415b-a065-2fba7dcf233f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:15.248711 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96c7e35d-3e75-415b-a065-2fba7dcf233f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:15.249172 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96c7e35d-3e75-415b-a065-2fba7dcf233f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:15.249779 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96c7e35d-3e75-415b-a065-2fba7dcf233f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:15.507380 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-96c7e35d-3e75-415b-a065-2fba7dcf233f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:15.515760 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-96c7e35d-3e75-415b-a065-2fba7dcf233f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b" status: 200 len: 1274 microversion: 2.1 time: 0.297135 Sep 24 20:54:15.516669 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 693/1438] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:15 2022] GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b => generated 1274 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:15.696945 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-92772713-bcd2-4aa0-91aa-84a3e7cc251a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:15.711663 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-92772713-bcd2-4aa0-91aa-84a3e7cc251a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc" status: 200 len: 1321 microversion: 2.1 time: 0.666655 Sep 24 20:54:15.712896 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 746/1439] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:15 2022] GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc => generated 1321 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:15.947567 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-26177ad0-d750-4236-bace-2e416074783b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:15.948163 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-26177ad0-d750-4236-bace-2e416074783b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:15.955204 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26177ad0-d750-4236-bace-2e416074783b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:15.964389 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26177ad0-d750-4236-bace-2e416074783b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:15.971495 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26177ad0-d750-4236-bace-2e416074783b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:15.973569 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26177ad0-d750-4236-bace-2e416074783b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:15.974370 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26177ad0-d750-4236-bace-2e416074783b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:15.975061 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26177ad0-d750-4236-bace-2e416074783b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:16.050219 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8dfc6cc3-6e83-4992-b64c-5b0ede3b9d29 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:16.050881 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8dfc6cc3-6e83-4992-b64c-5b0ede3b9d29 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:16.064527 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8dfc6cc3-6e83-4992-b64c-5b0ede3b9d29 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:16.065590 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8dfc6cc3-6e83-4992-b64c-5b0ede3b9d29 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:16.066042 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8dfc6cc3-6e83-4992-b64c-5b0ede3b9d29 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:16.066913 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8dfc6cc3-6e83-4992-b64c-5b0ede3b9d29 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:16.070937 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8dfc6cc3-6e83-4992-b64c-5b0ede3b9d29 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:16.071467 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8dfc6cc3-6e83-4992-b64c-5b0ede3b9d29 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:16.653020 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-26177ad0-d750-4236-bace-2e416074783b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:16.668080 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-26177ad0-d750-4236-bace-2e416074783b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1715 microversion: 2.1 time: 0.724571 Sep 24 20:54:16.682888 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 694/1440] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:15 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1715 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:16.691932 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8dfc6cc3-6e83-4992-b64c-5b0ede3b9d29 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:16.693051 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7ccf4cc5-f79e-495d-acdc-c43e8752dde2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:16.693960 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7ccf4cc5-f79e-495d-acdc-c43e8752dde2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:16.709478 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ccf4cc5-f79e-495d-acdc-c43e8752dde2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:16.711336 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ccf4cc5-f79e-495d-acdc-c43e8752dde2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:16.715113 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ccf4cc5-f79e-495d-acdc-c43e8752dde2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:16.716113 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ccf4cc5-f79e-495d-acdc-c43e8752dde2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:16.716241 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8dfc6cc3-6e83-4992-b64c-5b0ede3b9d29 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:16.716874 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ccf4cc5-f79e-495d-acdc-c43e8752dde2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:16.717489 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ccf4cc5-f79e-495d-acdc-c43e8752dde2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:16.718008 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8dfc6cc3-6e83-4992-b64c-5b0ede3b9d29 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:16.720913 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8dfc6cc3-6e83-4992-b64c-5b0ede3b9d29 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1409 microversion: 2.25 time: 0.674685 Sep 24 20:54:16.739917 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 747/1441] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:54:16 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1409 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:54:16.793923 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-692df373-04a0-4738-99d6-040ac60a853e tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b1103fd30>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:16.856360 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7ccf4cc5-f79e-495d-acdc-c43e8752dde2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:16.867592 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7ccf4cc5-f79e-495d-acdc-c43e8752dde2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1270 microversion: 2.1 time: 0.183451 Sep 24 20:54:16.870177 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 695/1442] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:16 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1270 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:16.886881 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-78bbc770-2fc7-4750-896e-0fbbf84b8b2e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:16.887452 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-692df373-04a0-4738-99d6-040ac60a853e tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913" status: 200 len: 1421 microversion: 2.1 time: 0.145956 Sep 24 20:54:16.888036 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-78bbc770-2fc7-4750-896e-0fbbf84b8b2e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a89ef546-702c-4ecd-babc-7d523421339b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:16.890721 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 748/1443] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:54:16 2022] GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913 => generated 1421 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:16.901126 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-78bbc770-2fc7-4750-896e-0fbbf84b8b2e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:16.901636 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-78bbc770-2fc7-4750-896e-0fbbf84b8b2e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:16.902081 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-78bbc770-2fc7-4750-896e-0fbbf84b8b2e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:16.902939 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f766801a-97cb-4ddc-a8b6-b7deac836376 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:16.903091 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-78bbc770-2fc7-4750-896e-0fbbf84b8b2e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:16.903722 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-78bbc770-2fc7-4750-896e-0fbbf84b8b2e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:16.904476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-78bbc770-2fc7-4750-896e-0fbbf84b8b2e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:16.904992 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f766801a-97cb-4ddc-a8b6-b7deac836376 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 39c753b7-d223-4e33-9086-d64877d26ecc] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:16.922635 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f766801a-97cb-4ddc-a8b6-b7deac836376 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:16.923360 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f766801a-97cb-4ddc-a8b6-b7deac836376 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:16.923981 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f766801a-97cb-4ddc-a8b6-b7deac836376 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:16.929545 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f766801a-97cb-4ddc-a8b6-b7deac836376 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:16.930250 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f766801a-97cb-4ddc-a8b6-b7deac836376 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:16.930899 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f766801a-97cb-4ddc-a8b6-b7deac836376 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:17.171090 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-78bbc770-2fc7-4750-896e-0fbbf84b8b2e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:17.176724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f766801a-97cb-4ddc-a8b6-b7deac836376 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:17.188652 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-78bbc770-2fc7-4750-896e-0fbbf84b8b2e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b" status: 200 len: 1316 microversion: 2.1 time: 0.316530 Sep 24 20:54:17.189722 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 696/1444] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:16 2022] GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b => generated 1316 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:17.203852 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f766801a-97cb-4ddc-a8b6-b7deac836376 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc" status: 200 len: 1321 microversion: 2.1 time: 0.309864 Sep 24 20:54:17.205141 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 749/1445] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:16 2022] GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc => generated 1321 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:17.205814 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-49ec10e3-60eb-48c2-81ed-20a7c5ff3684 req-55e00b8a-40eb-4782-975c-5e8cc43ce717 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54ec06be-cb4b-4b5f-9ed8-904a328cc118", "tag": "f450a593-c9dc-4f8e-8acb-60edeb836cea"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:17.218018 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-49ec10e3-60eb-48c2-81ed-20a7c5ff3684 req-55e00b8a-40eb-4782-975c-5e8cc43ce717 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:17.221189 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-49ec10e3-60eb-48c2-81ed-20a7c5ff3684 req-55e00b8a-40eb-4782-975c-5e8cc43ce717 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:17.221956 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-49ec10e3-60eb-48c2-81ed-20a7c5ff3684 req-55e00b8a-40eb-4782-975c-5e8cc43ce717 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:17.222720 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-9b0fccb9-4bde-454e-9df5-5a21e087a23e req-73e52d24-e720-48b5-b9d5-073f987da915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "048b3539-80cb-4d73-9280-b62713ddb588", "name": "network-vif-plugged", "status": "completed", "tag": "018d9d05-4694-4f6a-8a92-2c61652eab6e"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:17.235038 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-9b0fccb9-4bde-454e-9df5-5a21e087a23e req-73e52d24-e720-48b5-b9d5-073f987da915 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:17.235446 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-49ec10e3-60eb-48c2-81ed-20a7c5ff3684 req-55e00b8a-40eb-4782-975c-5e8cc43ce717 service nova] Creating event network-changed:f450a593-c9dc-4f8e-8acb-60edeb836cea for instance 54ec06be-cb4b-4b5f-9ed8-904a328cc118 on nch1-master-1 Sep 24 20:54:17.236022 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-9b0fccb9-4bde-454e-9df5-5a21e087a23e req-73e52d24-e720-48b5-b9d5-073f987da915 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:17.236681 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-9b0fccb9-4bde-454e-9df5-5a21e087a23e req-73e52d24-e720-48b5-b9d5-073f987da915 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:17.243178 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-49ec10e3-60eb-48c2-81ed-20a7c5ff3684 req-55e00b8a-40eb-4782-975c-5e8cc43ce717 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050070 Sep 24 20:54:17.243862 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 697/1446] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:54:17.254048 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-9b0fccb9-4bde-454e-9df5-5a21e087a23e req-73e52d24-e720-48b5-b9d5-073f987da915 service nova] Creating event network-vif-plugged:018d9d05-4694-4f6a-8a92-2c61652eab6e for instance 048b3539-80cb-4d73-9280-b62713ddb588 on nch1-master-1 Sep 24 20:54:17.260622 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-9b0fccb9-4bde-454e-9df5-5a21e087a23e req-73e52d24-e720-48b5-b9d5-073f987da915 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047290 Sep 24 20:54:17.261490 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 750/1447] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:54:17.703994 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-720c4b09-8fc3-49d7-9eaf-ac3d6645bd54 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:17.705237 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-720c4b09-8fc3-49d7-9eaf-ac3d6645bd54 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:17.716118 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-720c4b09-8fc3-49d7-9eaf-ac3d6645bd54 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:17.717148 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-720c4b09-8fc3-49d7-9eaf-ac3d6645bd54 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:17.718347 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-720c4b09-8fc3-49d7-9eaf-ac3d6645bd54 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:17.720858 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-720c4b09-8fc3-49d7-9eaf-ac3d6645bd54 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:17.723235 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-720c4b09-8fc3-49d7-9eaf-ac3d6645bd54 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:17.723905 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-720c4b09-8fc3-49d7-9eaf-ac3d6645bd54 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:17.764948 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-23f1ac64-7e67-419b-a66d-4ebf64a37206 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:17.765844 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-23f1ac64-7e67-419b-a66d-4ebf64a37206 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:17.783302 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23f1ac64-7e67-419b-a66d-4ebf64a37206 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:17.785353 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23f1ac64-7e67-419b-a66d-4ebf64a37206 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:17.785921 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23f1ac64-7e67-419b-a66d-4ebf64a37206 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:17.787906 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23f1ac64-7e67-419b-a66d-4ebf64a37206 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:17.791245 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23f1ac64-7e67-419b-a66d-4ebf64a37206 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:17.791808 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23f1ac64-7e67-419b-a66d-4ebf64a37206 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:18.575887 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-720c4b09-8fc3-49d7-9eaf-ac3d6645bd54 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:18.581079 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-23f1ac64-7e67-419b-a66d-4ebf64a37206 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:18.594563 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-23f1ac64-7e67-419b-a66d-4ebf64a37206 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:18.596262 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-23f1ac64-7e67-419b-a66d-4ebf64a37206 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:18.599931 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-720c4b09-8fc3-49d7-9eaf-ac3d6645bd54 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1715 microversion: 2.1 time: 0.902416 Sep 24 20:54:18.602684 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 698/1448] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:17 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1715 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:18.614826 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-23f1ac64-7e67-419b-a66d-4ebf64a37206 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1409 microversion: 2.25 time: 0.854435 Sep 24 20:54:18.620756 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e7504339-e5e5-497d-9410-8847954cad36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:18.631331 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 751/1449] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:54:17 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1409 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:54:18.631331 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-77212e79-43c1-46ca-ad05-6d2d32f4d0be tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b110c7280>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:18.662167 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e7504339-e5e5-497d-9410-8847954cad36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:18.692865 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e7504339-e5e5-497d-9410-8847954cad36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:18.693425 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e7504339-e5e5-497d-9410-8847954cad36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:18.693932 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e7504339-e5e5-497d-9410-8847954cad36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:18.695427 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e7504339-e5e5-497d-9410-8847954cad36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:18.697322 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e7504339-e5e5-497d-9410-8847954cad36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:18.698420 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e7504339-e5e5-497d-9410-8847954cad36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:18.698991 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-77212e79-43c1-46ca-ad05-6d2d32f4d0be tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913" status: 200 len: 1421 microversion: 2.1 time: 0.077104 Sep 24 20:54:18.708091 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 752/1450] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:54:18 2022] GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913 => generated 1421 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:18.715795 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-204dd093-fab8-4256-965f-40cfe8e363cd tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:18.716426 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-204dd093-fab8-4256-965f-40cfe8e363cd tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a89ef546-702c-4ecd-babc-7d523421339b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:18.734136 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-204dd093-fab8-4256-965f-40cfe8e363cd tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:18.734952 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-204dd093-fab8-4256-965f-40cfe8e363cd tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:18.735599 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-204dd093-fab8-4256-965f-40cfe8e363cd tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:18.736521 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-204dd093-fab8-4256-965f-40cfe8e363cd tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:18.738976 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-204dd093-fab8-4256-965f-40cfe8e363cd tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:18.739638 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-204dd093-fab8-4256-965f-40cfe8e363cd tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:19.182216 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-204dd093-fab8-4256-965f-40cfe8e363cd tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:19.197829 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-204dd093-fab8-4256-965f-40cfe8e363cd tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b" status: 200 len: 1316 microversion: 2.1 time: 0.482842 Sep 24 20:54:19.199391 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 753/1451] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:18 2022] GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b => generated 1316 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:19.210488 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-22dadf45-495d-4f65-ab08-9f49ae96b902 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:19.212361 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-22dadf45-495d-4f65-ab08-9f49ae96b902 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 39c753b7-d223-4e33-9086-d64877d26ecc] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:19.226268 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e7504339-e5e5-497d-9410-8847954cad36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:19.236695 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22dadf45-495d-4f65-ab08-9f49ae96b902 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:19.238213 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22dadf45-495d-4f65-ab08-9f49ae96b902 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:19.239836 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22dadf45-495d-4f65-ab08-9f49ae96b902 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:19.240372 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e7504339-e5e5-497d-9410-8847954cad36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1312 microversion: 2.1 time: 0.635164 Sep 24 20:54:19.241349 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22dadf45-495d-4f65-ab08-9f49ae96b902 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:19.243854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22dadf45-495d-4f65-ab08-9f49ae96b902 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:19.245354 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22dadf45-495d-4f65-ab08-9f49ae96b902 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:19.253243 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 699/1452] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:18 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1312 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:19.626519 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8a9b43f9-4edd-4c9f-88a5-56787f06f71c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:19.627401 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8a9b43f9-4edd-4c9f-88a5-56787f06f71c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:19.652983 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8a9b43f9-4edd-4c9f-88a5-56787f06f71c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:19.653488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8a9b43f9-4edd-4c9f-88a5-56787f06f71c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:19.653925 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8a9b43f9-4edd-4c9f-88a5-56787f06f71c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:19.659749 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8a9b43f9-4edd-4c9f-88a5-56787f06f71c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:19.660472 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8a9b43f9-4edd-4c9f-88a5-56787f06f71c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:19.661086 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8a9b43f9-4edd-4c9f-88a5-56787f06f71c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:19.760439 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-22dadf45-495d-4f65-ab08-9f49ae96b902 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:19.777289 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-22dadf45-495d-4f65-ab08-9f49ae96b902 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc" status: 200 len: 1321 microversion: 2.1 time: 0.575198 Sep 24 20:54:19.780594 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 754/1453] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:19 2022] GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc => generated 1321 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:19.797315 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8d907d8c-ab4b-43c5-a473-d5a4199eb6df tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:19.801833 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8d907d8c-ab4b-43c5-a473-d5a4199eb6df tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:19.813853 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:DELETE=4,nova_api:SELECT=91,nova_api:INSERT=5 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:54:19.829028 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8d907d8c-ab4b-43c5-a473-d5a4199eb6df tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:19.832036 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8d907d8c-ab4b-43c5-a473-d5a4199eb6df tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:19.832529 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8d907d8c-ab4b-43c5-a473-d5a4199eb6df tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:19.833296 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8d907d8c-ab4b-43c5-a473-d5a4199eb6df tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:19.833746 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8d907d8c-ab4b-43c5-a473-d5a4199eb6df tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:19.836392 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8d907d8c-ab4b-43c5-a473-d5a4199eb6df tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:20.566886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8a9b43f9-4edd-4c9f-88a5-56787f06f71c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:20.576521 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8a9b43f9-4edd-4c9f-88a5-56787f06f71c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1715 microversion: 2.1 time: 0.955147 Sep 24 20:54:20.579508 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 700/1454] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:19 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1715 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:54:20.588986 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-31e9a5ff-91ea-4231-b627-56f06d5bef01 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b0c9138b0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:20.678049 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-31e9a5ff-91ea-4231-b627-56f06d5bef01 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913" status: 200 len: 1421 microversion: 2.1 time: 0.097117 Sep 24 20:54:20.688091 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 701/1455] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:54:20 2022] GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913 => generated 1421 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:20.693892 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fddcdf5f-5b13-4669-b2e0-c700f4803cdb tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:20.694785 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fddcdf5f-5b13-4669-b2e0-c700f4803cdb tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a89ef546-702c-4ecd-babc-7d523421339b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:20.704745 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fddcdf5f-5b13-4669-b2e0-c700f4803cdb tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:20.705620 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fddcdf5f-5b13-4669-b2e0-c700f4803cdb tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:20.706318 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fddcdf5f-5b13-4669-b2e0-c700f4803cdb tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:20.708057 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fddcdf5f-5b13-4669-b2e0-c700f4803cdb tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:20.709584 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fddcdf5f-5b13-4669-b2e0-c700f4803cdb tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:20.710270 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fddcdf5f-5b13-4669-b2e0-c700f4803cdb tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:20.934379 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8d907d8c-ab4b-43c5-a473-d5a4199eb6df tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:20.951859 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8d907d8c-ab4b-43c5-a473-d5a4199eb6df tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:20.956898 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8d907d8c-ab4b-43c5-a473-d5a4199eb6df tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:20.959748 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8d907d8c-ab4b-43c5-a473-d5a4199eb6df tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1409 microversion: 2.25 time: 1.176009 Sep 24 20:54:20.985549 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 755/1456] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:54:19 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1409 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:54:20.998968 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-eeccba66-d1f7-4698-9ca2-01f995f6bad9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:21.008216 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-eeccba66-d1f7-4698-9ca2-01f995f6bad9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:21.018247 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eeccba66-d1f7-4698-9ca2-01f995f6bad9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:21.019919 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eeccba66-d1f7-4698-9ca2-01f995f6bad9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:21.021723 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eeccba66-d1f7-4698-9ca2-01f995f6bad9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:21.035681 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eeccba66-d1f7-4698-9ca2-01f995f6bad9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:21.039881 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eeccba66-d1f7-4698-9ca2-01f995f6bad9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:21.041263 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eeccba66-d1f7-4698-9ca2-01f995f6bad9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:21.683816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fddcdf5f-5b13-4669-b2e0-c700f4803cdb tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:21.697914 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fddcdf5f-5b13-4669-b2e0-c700f4803cdb tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b" status: 200 len: 1316 microversion: 2.1 time: 1.008138 Sep 24 20:54:21.700417 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 702/1457] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:20 2022] GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b => generated 1316 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:21.719394 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3d99b21c-53cb-46ec-a5bd-bfb861265eff tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:21.722608 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3d99b21c-53cb-46ec-a5bd-bfb861265eff tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 39c753b7-d223-4e33-9086-d64877d26ecc] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:21.742889 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d99b21c-53cb-46ec-a5bd-bfb861265eff tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:21.743754 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d99b21c-53cb-46ec-a5bd-bfb861265eff tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:21.745862 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d99b21c-53cb-46ec-a5bd-bfb861265eff tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:21.747080 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d99b21c-53cb-46ec-a5bd-bfb861265eff tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:21.748035 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d99b21c-53cb-46ec-a5bd-bfb861265eff tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:21.749265 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d99b21c-53cb-46ec-a5bd-bfb861265eff tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:21.828633 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-eeccba66-d1f7-4698-9ca2-01f995f6bad9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:21.837984 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-eeccba66-d1f7-4698-9ca2-01f995f6bad9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1312 microversion: 2.1 time: 0.847160 Sep 24 20:54:21.838613 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 756/1458] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:20 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1312 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:21.843948 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-e6fc44ce-788e-44c6-bc8e-9de40b18138f req-f22cb018-1987-4c6d-9757-ca02990a9c72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9425eeec-a7b4-4926-a2f3-80dd47eb9e0c", "tag": "7138905c-dbe0-4d9c-83c3-21fb5d346268"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:21.854330 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e6fc44ce-788e-44c6-bc8e-9de40b18138f req-f22cb018-1987-4c6d-9757-ca02990a9c72 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:21.856225 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e6fc44ce-788e-44c6-bc8e-9de40b18138f req-f22cb018-1987-4c6d-9757-ca02990a9c72 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:21.856225 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e6fc44ce-788e-44c6-bc8e-9de40b18138f req-f22cb018-1987-4c6d-9757-ca02990a9c72 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:21.870524 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-e6fc44ce-788e-44c6-bc8e-9de40b18138f req-f22cb018-1987-4c6d-9757-ca02990a9c72 service nova] Creating event network-changed:7138905c-dbe0-4d9c-83c3-21fb5d346268 for instance 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c on nch2-master-1 Sep 24 20:54:21.875810 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-e6fc44ce-788e-44c6-bc8e-9de40b18138f req-f22cb018-1987-4c6d-9757-ca02990a9c72 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034953 Sep 24 20:54:21.876629 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 757/1459] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:54:21.884055 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7a5af0f0-cc6d-43f8-8e56-29f0021fd02c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:21.884774 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7a5af0f0-cc6d-43f8-8e56-29f0021fd02c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:21.896161 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7a5af0f0-cc6d-43f8-8e56-29f0021fd02c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:21.896808 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7a5af0f0-cc6d-43f8-8e56-29f0021fd02c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:21.897841 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7a5af0f0-cc6d-43f8-8e56-29f0021fd02c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:21.898764 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7a5af0f0-cc6d-43f8-8e56-29f0021fd02c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:21.899405 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7a5af0f0-cc6d-43f8-8e56-29f0021fd02c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:21.900099 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7a5af0f0-cc6d-43f8-8e56-29f0021fd02c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:22.111935 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3d99b21c-53cb-46ec-a5bd-bfb861265eff tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:22.124505 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3d99b21c-53cb-46ec-a5bd-bfb861265eff tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc" status: 200 len: 1321 microversion: 2.1 time: 0.422354 Sep 24 20:54:22.142668 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 703/1460] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:21 2022] GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc => generated 1321 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:22.149401 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-fed6597e-e744-46bd-9eac-2e2531b043e0 req-bd413226-0f79-4b80-9542-c471ea1303de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a89ef546-702c-4ecd-babc-7d523421339b", "tag": "fa4b4cb0-8e47-43ef-bbc3-afdd2366b28f"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:22.162478 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-fed6597e-e744-46bd-9eac-2e2531b043e0 req-bd413226-0f79-4b80-9542-c471ea1303de service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:22.163664 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-fed6597e-e744-46bd-9eac-2e2531b043e0 req-bd413226-0f79-4b80-9542-c471ea1303de service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:22.164349 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-fed6597e-e744-46bd-9eac-2e2531b043e0 req-bd413226-0f79-4b80-9542-c471ea1303de service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:22.177617 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-fed6597e-e744-46bd-9eac-2e2531b043e0 req-bd413226-0f79-4b80-9542-c471ea1303de service nova] Creating event network-changed:fa4b4cb0-8e47-43ef-bbc3-afdd2366b28f for instance a89ef546-702c-4ecd-babc-7d523421339b on nch1-master-1 Sep 24 20:54:22.182864 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-fed6597e-e744-46bd-9eac-2e2531b043e0 req-bd413226-0f79-4b80-9542-c471ea1303de service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038172 Sep 24 20:54:22.183576 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 704/1461] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:54:22.188643 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-919836a2-8380-4269-9163-5a7cdeb988ee tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b0c913820>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:22.218674 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7a5af0f0-cc6d-43f8-8e56-29f0021fd02c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:22.224698 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:54:22.237548 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7a5af0f0-cc6d-43f8-8e56-29f0021fd02c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1715 microversion: 2.1 time: 0.358536 Sep 24 20:54:22.250698 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-919836a2-8380-4269-9163-5a7cdeb988ee tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913" status: 200 len: 1421 microversion: 2.1 time: 0.060186 Sep 24 20:54:22.250698 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 705/1462] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:54:22 2022] GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913 => generated 1421 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:22.250698 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e2ef00d0-8975-433e-9174-9fb6a3bed404 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:22.251005 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e2ef00d0-8975-433e-9174-9fb6a3bed404 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:22.253263 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 758/1463] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:21 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1715 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:22.258180 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e2ef00d0-8975-433e-9174-9fb6a3bed404 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:22.258723 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e2ef00d0-8975-433e-9174-9fb6a3bed404 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:22.259169 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e2ef00d0-8975-433e-9174-9fb6a3bed404 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:22.259891 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e2ef00d0-8975-433e-9174-9fb6a3bed404 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:22.260357 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e2ef00d0-8975-433e-9174-9fb6a3bed404 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:22.260794 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e2ef00d0-8975-433e-9174-9fb6a3bed404 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:22.507544 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e2ef00d0-8975-433e-9174-9fb6a3bed404 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:22.522631 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e2ef00d0-8975-433e-9174-9fb6a3bed404 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:22.524466 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e2ef00d0-8975-433e-9174-9fb6a3bed404 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:22.525815 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e2ef00d0-8975-433e-9174-9fb6a3bed404 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1409 microversion: 2.25 time: 0.279138 Sep 24 20:54:22.533224 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 706/1464] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:54:22 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1409 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:54:22.726239 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-04ddc3ae-af04-4063-bf98-3238be8393ad tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:22.726900 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-04ddc3ae-af04-4063-bf98-3238be8393ad tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a89ef546-702c-4ecd-babc-7d523421339b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:22.735224 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-04ddc3ae-af04-4063-bf98-3238be8393ad tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:22.736151 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-04ddc3ae-af04-4063-bf98-3238be8393ad tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:22.738050 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-04ddc3ae-af04-4063-bf98-3238be8393ad tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:22.739677 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-04ddc3ae-af04-4063-bf98-3238be8393ad tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:22.740322 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-04ddc3ae-af04-4063-bf98-3238be8393ad tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:22.740894 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-04ddc3ae-af04-4063-bf98-3238be8393ad tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:22.864465 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5c955aa7-c5f1-4669-bef2-2d2c18657307 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:22.868948 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5c955aa7-c5f1-4669-bef2-2d2c18657307 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:22.876769 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c955aa7-c5f1-4669-bef2-2d2c18657307 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:22.881734 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c955aa7-c5f1-4669-bef2-2d2c18657307 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:22.884178 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c955aa7-c5f1-4669-bef2-2d2c18657307 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:22.884941 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c955aa7-c5f1-4669-bef2-2d2c18657307 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:22.885423 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c955aa7-c5f1-4669-bef2-2d2c18657307 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:22.885867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c955aa7-c5f1-4669-bef2-2d2c18657307 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:23.321241 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-04ddc3ae-af04-4063-bf98-3238be8393ad tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:23.337460 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-04ddc3ae-af04-4063-bf98-3238be8393ad tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b" status: 200 len: 1316 microversion: 2.1 time: 0.613040 Sep 24 20:54:23.338235 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 759/1465] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:22 2022] GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b => generated 1316 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:23.356451 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e2d4e61e-5db9-4b2b-90fc-15739ddcae2b tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:23.359318 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e2d4e61e-5db9-4b2b-90fc-15739ddcae2b tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 39c753b7-d223-4e33-9086-d64877d26ecc] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:23.380844 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e2d4e61e-5db9-4b2b-90fc-15739ddcae2b tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:23.381362 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e2d4e61e-5db9-4b2b-90fc-15739ddcae2b tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:23.381813 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e2d4e61e-5db9-4b2b-90fc-15739ddcae2b tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:23.382563 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e2d4e61e-5db9-4b2b-90fc-15739ddcae2b tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:23.383025 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e2d4e61e-5db9-4b2b-90fc-15739ddcae2b tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:23.386429 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e2d4e61e-5db9-4b2b-90fc-15739ddcae2b tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:23.522766 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5c955aa7-c5f1-4669-bef2-2d2c18657307 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:23.537961 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:54:23.540754 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5c955aa7-c5f1-4669-bef2-2d2c18657307 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1312 microversion: 2.1 time: 0.679719 Sep 24 20:54:23.544047 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 707/1466] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:22 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1312 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:54:23.578708 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5ceb9d68-41ef-4582-a003-c472615923a2 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b0c9f35e0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:23.606717 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=54 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:54:23.682453 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5ceb9d68-41ef-4582-a003-c472615923a2 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913" status: 200 len: 1421 microversion: 2.1 time: 0.132622 Sep 24 20:54:23.695116 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 708/1467] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:54:23 2022] GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913 => generated 1421 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:23.717588 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-916f0b44-dee1-48bd-abcf-14fb7cd0b566 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:23.718234 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-916f0b44-dee1-48bd-abcf-14fb7cd0b566 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:23.759710 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-916f0b44-dee1-48bd-abcf-14fb7cd0b566 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:23.761490 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-916f0b44-dee1-48bd-abcf-14fb7cd0b566 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:23.763077 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-916f0b44-dee1-48bd-abcf-14fb7cd0b566 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:23.766119 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-916f0b44-dee1-48bd-abcf-14fb7cd0b566 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:23.767754 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-916f0b44-dee1-48bd-abcf-14fb7cd0b566 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:23.769208 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-916f0b44-dee1-48bd-abcf-14fb7cd0b566 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:24.122945 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e2d4e61e-5db9-4b2b-90fc-15739ddcae2b tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:24.157650 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e2d4e61e-5db9-4b2b-90fc-15739ddcae2b tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc" status: 200 len: 1321 microversion: 2.1 time: 0.806576 Sep 24 20:54:24.158338 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 760/1468] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:23 2022] GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc => generated 1321 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:24.171432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f6e47f79-ded6-47e0-b651-342f865f3f82 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:24.172696 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f6e47f79-ded6-47e0-b651-342f865f3f82 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:24.186744 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6e47f79-ded6-47e0-b651-342f865f3f82 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:24.187964 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6e47f79-ded6-47e0-b651-342f865f3f82 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:24.188900 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6e47f79-ded6-47e0-b651-342f865f3f82 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:24.189798 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6e47f79-ded6-47e0-b651-342f865f3f82 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:24.192500 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6e47f79-ded6-47e0-b651-342f865f3f82 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:24.193699 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6e47f79-ded6-47e0-b651-342f865f3f82 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:24.285957 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-916f0b44-dee1-48bd-abcf-14fb7cd0b566 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:24.316035 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-916f0b44-dee1-48bd-abcf-14fb7cd0b566 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1715 microversion: 2.1 time: 0.616672 Sep 24 20:54:24.318978 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 709/1469] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:23 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1715 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:24.364912 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8cb1c8c1-bb07-4bee-a63d-9cfb18824aaa tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:24.365937 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8cb1c8c1-bb07-4bee-a63d-9cfb18824aaa tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a89ef546-702c-4ecd-babc-7d523421339b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:24.373050 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8cb1c8c1-bb07-4bee-a63d-9cfb18824aaa tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:24.373998 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8cb1c8c1-bb07-4bee-a63d-9cfb18824aaa tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:24.374573 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8cb1c8c1-bb07-4bee-a63d-9cfb18824aaa tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:24.375821 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8cb1c8c1-bb07-4bee-a63d-9cfb18824aaa tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:24.376509 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8cb1c8c1-bb07-4bee-a63d-9cfb18824aaa tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:24.378226 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8cb1c8c1-bb07-4bee-a63d-9cfb18824aaa tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:24.384675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:54:24.822415 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f6e47f79-ded6-47e0-b651-342f865f3f82 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:24.840661 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f6e47f79-ded6-47e0-b651-342f865f3f82 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:24.842332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f6e47f79-ded6-47e0-b651-342f865f3f82 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:24.844010 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f6e47f79-ded6-47e0-b651-342f865f3f82 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1409 microversion: 2.25 time: 0.681976 Sep 24 20:54:24.855221 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 761/1470] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:54:24 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1409 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:54:24.937665 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8cb1c8c1-bb07-4bee-a63d-9cfb18824aaa tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:24.952541 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8cb1c8c1-bb07-4bee-a63d-9cfb18824aaa tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b" status: 200 len: 1316 microversion: 2.1 time: 0.592144 Sep 24 20:54:24.970773 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 710/1471] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:24 2022] GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b => generated 1316 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:54:24.976833 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f58a5353-65fb-48c0-a5da-289376c5ab36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:24.977472 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f58a5353-65fb-48c0-a5da-289376c5ab36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:25.001882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f58a5353-65fb-48c0-a5da-289376c5ab36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:25.003767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f58a5353-65fb-48c0-a5da-289376c5ab36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:25.006260 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f58a5353-65fb-48c0-a5da-289376c5ab36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:25.008255 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f58a5353-65fb-48c0-a5da-289376c5ab36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:25.009673 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f58a5353-65fb-48c0-a5da-289376c5ab36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:25.010545 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f58a5353-65fb-48c0-a5da-289376c5ab36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:25.286993 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3d4632c6-eb61-4550-9bfe-5f378e282015 tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390 tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-752956719", "ram": 512, "vcpus": 1, "disk": 10, "id": 1294328666, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:25.318468 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3d4632c6-eb61-4550-9bfe-5f378e282015 tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390 tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.454656 Sep 24 20:54:25.320985 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 762/1472] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:54:24 2022] POST /compute/v2.1/flavors => generated 415 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:54:25.340877 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ecad0950-0c79-437c-9c44-450e2eda3235 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b110aadc0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:25.402959 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ecad0950-0c79-437c-9c44-450e2eda3235 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913" status: 200 len: 1421 microversion: 2.1 time: 0.069335 Sep 24 20:54:25.404095 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 763/1473] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:54:25 2022] GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913 => generated 1421 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:25.410662 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-557349d3-d871-4a20-9b19-bc2abf9511de tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:25.411790 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-557349d3-d871-4a20-9b19-bc2abf9511de tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 39c753b7-d223-4e33-9086-d64877d26ecc] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:25.418411 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-557349d3-d871-4a20-9b19-bc2abf9511de tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:25.419371 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-557349d3-d871-4a20-9b19-bc2abf9511de tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:25.420082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-557349d3-d871-4a20-9b19-bc2abf9511de tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:25.421469 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-557349d3-d871-4a20-9b19-bc2abf9511de tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:25.423127 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-557349d3-d871-4a20-9b19-bc2abf9511de tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:25.423909 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-557349d3-d871-4a20-9b19-bc2abf9511de tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:26.113129 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f58a5353-65fb-48c0-a5da-289376c5ab36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:26.184300 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f58a5353-65fb-48c0-a5da-289376c5ab36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1312 microversion: 2.1 time: 1.212920 Sep 24 20:54:26.194523 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 711/1474] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:24 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1312 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:26.211392 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-557349d3-d871-4a20-9b19-bc2abf9511de tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:26.219547 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-557349d3-d871-4a20-9b19-bc2abf9511de tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc" status: 200 len: 1321 microversion: 2.1 time: 0.814117 Sep 24 20:54:26.226039 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 764/1475] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:25 2022] GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc => generated 1321 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:26.242463 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-eae4f9e5-c56a-4a37-8d5d-105b4a0cd079 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:26.243121 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-eae4f9e5-c56a-4a37-8d5d-105b4a0cd079 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:26.256605 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eae4f9e5-c56a-4a37-8d5d-105b4a0cd079 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:26.258329 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eae4f9e5-c56a-4a37-8d5d-105b4a0cd079 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:26.259030 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eae4f9e5-c56a-4a37-8d5d-105b4a0cd079 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:26.259774 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eae4f9e5-c56a-4a37-8d5d-105b4a0cd079 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:26.262485 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eae4f9e5-c56a-4a37-8d5d-105b4a0cd079 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:26.265640 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eae4f9e5-c56a-4a37-8d5d-105b4a0cd079 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:26.398158 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7e2100ef-80fe-4c27-b629-490c5590ac54 tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363 tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:26.419654 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-7e2100ef-80fe-4c27-b629-490c5590ac54 tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363 tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363-project] HTTP exception thrown: Flavor 1294328666 has no extra specs with key hw:cpu_thread_policy. Sep 24 20:54:26.428203 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7e2100ef-80fe-4c27-b629-490c5590ac54 tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363 tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363-project] Request method failure captured: Sep 24 20:54:26.428203 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/flavors/1294328666/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 24 20:54:26.428203 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:54:26.428203 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:54:26.428203 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:54:26.428203 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:54:26.428203 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:54:26.428203 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:54:26.428203 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:54:26.428203 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:54:26.428203 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL25_wlfDVkenF80XeKRIZKTg5N32zaeJmkDz2vI1T044MRdmAPIWKLdvp3AgnABc4aFM_Ml7jS6C3zK0y10Q0upvC5TN5Ds7b1pWoFQe8lFfVeUwejIUzmJiqhoDPCNZoU9_obkhFeL4M950u9s05o8No2HHGxOdYw-FmQk0eAf1zno Sep 24 20:54:26.428203 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:54:26.428203 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:54:26.428203 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:54:26.428203 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:54:26.428203 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:54:26.428203 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:54:26.428203 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: e470661b12a6454c8641b87827b073a6 Sep 24 20:54:26.428203 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363 Sep 24 20:54:26.428203 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:54:26.428203 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:54:26.429619 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e470661b12a6454c8641b87827b073a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e470661b12a6454c8641b87827b073a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e470661b12a6454c8641b87827b073a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e470661b12a6454c8641b87827b073a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:54:26.429619 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363 Sep 24 20:54:26.429619 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: e470661b12a6454c8641b87827b073a6 Sep 24 20:54:26.429619 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363 Sep 24 20:54:26.429619 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363-project Sep 24 20:54:26.429619 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:54:26.429619 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:54:26.429619 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 821fe105082c42b096e348a48966471e Sep 24 20:54:26.429619 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363-project Sep 24 20:54:26.429619 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:54:26.429619 ncdv-master-1 devstack@n-api.service[140516]: exception: Flavor 1294328666 has no extra specs with key hw:cpu_thread_policy. Sep 24 20:54:26.430441 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'flavor_id': '1294328666', 'id': 'hw:cpu_thread_policy'} Sep 24 20:54:26.430441 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:54:26.430441 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:26.430441 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Sep 24 20:54:26.430441 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Sep 24 20:54:26.430441 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 24 20:54:26.430441 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:26.430441 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:54:26.430441 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:26.430441 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:26.430441 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:54:26.430441 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:54:26.430441 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:54:26.430441 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:54:26.430441 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:54:26.430441 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:54:26.430441 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Sep 24 20:54:26.430441 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 24 20:54:26.430441 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1294328666 has no extra specs with key hw:cpu_thread_policy. Sep 24 20:54:26.430441 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:26.430441 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:54:26.430441 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:26.431882 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:26.431882 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:54:26.431882 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:54:26.431882 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:54:26.431882 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:54:26.431882 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1294328666 has no extra specs with key hw:cpu_thread_policy. Sep 24 20:54:26.431882 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:26.431882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7e2100ef-80fe-4c27-b629-490c5590ac54 tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363 tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363-project] Returning 404 to user: Flavor 1294328666 has no extra specs with key hw:cpu_thread_policy. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:54:26.431882 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7e2100ef-80fe-4c27-b629-490c5590ac54 tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363 tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363-project] 10.222.0.52 "GET /compute/v2.1/flavors/1294328666/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.243449 Sep 24 20:54:26.431882 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 712/1476] 10.222.0.52 () {58 vars in 1266 bytes} [Sat Sep 24 20:54:26 2022] GET /compute/v2.1/flavors/1294328666/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 245 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:54:26.450070 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-d2a56e71-6c7b-42eb-a469-9e887a01c27c req-d8716b7c-d1a4-4f53-9751-8aafcfa0cf9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39c753b7-d223-4e33-9086-d64877d26ecc", "name": "network-vif-plugged", "status": "completed", "tag": "7aefbbe0-4d35-4c50-9cd0-90292cc0b874"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:26.464456 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d2a56e71-6c7b-42eb-a469-9e887a01c27c req-d8716b7c-d1a4-4f53-9751-8aafcfa0cf9b service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:26.465171 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d2a56e71-6c7b-42eb-a469-9e887a01c27c req-d8716b7c-d1a4-4f53-9751-8aafcfa0cf9b service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:26.466372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d2a56e71-6c7b-42eb-a469-9e887a01c27c req-d8716b7c-d1a4-4f53-9751-8aafcfa0cf9b service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:26.484381 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-d2a56e71-6c7b-42eb-a469-9e887a01c27c req-d8716b7c-d1a4-4f53-9751-8aafcfa0cf9b service nova] Creating event network-vif-plugged:7aefbbe0-4d35-4c50-9cd0-90292cc0b874 for instance 39c753b7-d223-4e33-9086-d64877d26ecc on nch1-master-1 Sep 24 20:54:26.496039 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-d2a56e71-6c7b-42eb-a469-9e887a01c27c req-d8716b7c-d1a4-4f53-9751-8aafcfa0cf9b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054099 Sep 24 20:54:26.497247 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 713/1477] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:54:26.504979 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e3cb8f43-52f8-43c7-a2b9-231e6e0423e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:26.506961 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e3cb8f43-52f8-43c7-a2b9-231e6e0423e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:26.515585 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e3cb8f43-52f8-43c7-a2b9-231e6e0423e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:26.516323 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e3cb8f43-52f8-43c7-a2b9-231e6e0423e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:26.516771 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e3cb8f43-52f8-43c7-a2b9-231e6e0423e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:26.517505 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e3cb8f43-52f8-43c7-a2b9-231e6e0423e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:26.517969 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e3cb8f43-52f8-43c7-a2b9-231e6e0423e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:26.518441 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e3cb8f43-52f8-43c7-a2b9-231e6e0423e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:26.548552 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-eae4f9e5-c56a-4a37-8d5d-105b4a0cd079 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:26.559310 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-eae4f9e5-c56a-4a37-8d5d-105b4a0cd079 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1715 microversion: 2.1 time: 0.332314 Sep 24 20:54:26.561040 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 765/1478] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:26 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1715 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:26.567996 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-aba3e82f-fdbe-4252-97e2-4fc197053e81 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:26.568912 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-aba3e82f-fdbe-4252-97e2-4fc197053e81 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a89ef546-702c-4ecd-babc-7d523421339b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:26.590788 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aba3e82f-fdbe-4252-97e2-4fc197053e81 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:26.591599 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aba3e82f-fdbe-4252-97e2-4fc197053e81 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:26.594171 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aba3e82f-fdbe-4252-97e2-4fc197053e81 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:26.595172 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aba3e82f-fdbe-4252-97e2-4fc197053e81 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:26.598556 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aba3e82f-fdbe-4252-97e2-4fc197053e81 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:26.599239 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aba3e82f-fdbe-4252-97e2-4fc197053e81 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:26.819375 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e3cb8f43-52f8-43c7-a2b9-231e6e0423e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:26.828798 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e3cb8f43-52f8-43c7-a2b9-231e6e0423e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:26.831704 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e3cb8f43-52f8-43c7-a2b9-231e6e0423e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:26.833441 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e3cb8f43-52f8-43c7-a2b9-231e6e0423e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1409 microversion: 2.25 time: 0.334854 Sep 24 20:54:26.847324 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 714/1479] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:54:26 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1409 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:54:26.881065 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-aba3e82f-fdbe-4252-97e2-4fc197053e81 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:26.889247 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-aba3e82f-fdbe-4252-97e2-4fc197053e81 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b" status: 200 len: 1316 microversion: 2.1 time: 0.326979 Sep 24 20:54:26.889826 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 766/1480] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:26 2022] GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b => generated 1316 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:26.920182 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b3acbf90-94b7-43cb-90d8-ee8014ae7314 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b1102f790>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:26.988385 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c3059794-2a94-4a42-9f5e-3112c0232b20 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Action: 'create', calling method: .version_select at 0x7f4b0c83f820>, body: {"keypair": {"name": "tempest-keypair-313481477", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMtqJ4sK1N3wmrZlFYUGrtQLP++sKCgMaRHaE9gRvnaEwGXYok78Qm1PWJngPVJyNgWsEbl5KRUA+E8mdBgS/gIMEhV9EgL6TRevvqGtFejQb0bWlvDW/yYqcJcg9xfZCg=="}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:27.015995 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b3acbf90-94b7-43cb-90d8-ee8014ae7314 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913" status: 200 len: 1421 microversion: 2.1 time: 0.114622 Sep 24 20:54:27.024760 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 767/1481] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:54:26 2022] GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913 => generated 1421 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:27.035152 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c33be520-6238-4828-a6c6-84016a04e66b tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363 tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:27.036145 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-c3059794-2a94-4a42-9f5e-3112c0232b20 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Getting quotas for project 8dc5dc16f54e4d2991a2b456216459a4. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:54:27.048514 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c33be520-6238-4828-a6c6-84016a04e66b tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363 tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '821fe105082c42b096e348a48966471e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e470661b12a6454c8641b87827b073a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:27.054426 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c33be520-6238-4828-a6c6-84016a04e66b tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363 tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363-project] Request method failure captured: Sep 24 20:54:27.054426 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/flavors/1294328666/os-extra_specs HTTP/1.1 Sep 24 20:54:27.054426 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:54:27.054426 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:54:27.054426 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:54:27.054426 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 66 Sep 24 20:54:27.054426 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:54:27.054426 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:54:27.054426 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:54:27.054426 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:54:27.054426 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL25_wlfDVkenF80XeKRIZKTg5N32zaeJmkDz2vI1T044MRdmAPIWKLdvp3AgnABc4aFM_Ml7jS6C3zK0y10Q0upvC5TN5Ds7b1pWoFQe8lFfVeUwejIUzmJiqhoDPCNZoU9_obkhFeL4M950u9s05o8No2HHGxOdYw-FmQk0eAf1zno Sep 24 20:54:27.054426 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:54:27.054426 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:54:27.054426 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:54:27.054426 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:54:27.054426 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:54:27.054426 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:54:27.054426 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: e470661b12a6454c8641b87827b073a6 Sep 24 20:54:27.054426 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363 Sep 24 20:54:27.054426 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:54:27.054426 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:54:27.056605 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e470661b12a6454c8641b87827b073a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e470661b12a6454c8641b87827b073a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e470661b12a6454c8641b87827b073a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e470661b12a6454c8641b87827b073a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:54:27.056605 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363 Sep 24 20:54:27.056605 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: e470661b12a6454c8641b87827b073a6 Sep 24 20:54:27.056605 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363 Sep 24 20:54:27.056605 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363-project Sep 24 20:54:27.056605 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:54:27.056605 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:54:27.056605 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 821fe105082c42b096e348a48966471e Sep 24 20:54:27.056605 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363-project Sep 24 20:54:27.056605 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 20:54:27.056605 ncdv-master-1 devstack@n-api.service[140517]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Sep 24 20:54:27.056605 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:54:27.057520 ncdv-master-1 devstack@n-api.service[140517]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 24 20:54:27.057520 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'flavor_id': '1294328666', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Sep 24 20:54:27.057520 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:54:27.057520 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:27.057520 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:54:27.057520 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:54:27.057520 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:54:27.057520 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:54:27.057520 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:54:27.057520 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:54:27.057520 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:54:27.057520 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:54:27.057520 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Sep 24 20:54:27.057520 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Sep 24 20:54:27.057520 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 24 20:54:27.057520 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 24 20:54:27.057520 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 24 20:54:27.057520 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 24 20:54:27.057520 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:54:27.058794 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:54:27.058794 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:54:27.058794 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:54:27.058794 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 24 20:54:27.058794 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 24 20:54:27.058794 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 24 20:54:27.058794 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 24 20:54:27.058794 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 24 20:54:27.058794 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 24 20:54:27.058794 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 24 20:54:27.058794 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:54:27.058794 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:54:27.058794 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:54:27.058794 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:27.058794 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:54:27.058794 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:54:27.058794 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 24 20:54:27.058794 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 24 20:54:27.058794 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 24 20:54:27.058794 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:54:27.060052 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-c3059794-2a94-4a42-9f5e-3112c0232b20 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Getting quotas for user dab2b6bf40594154a6340d5afd02da0c and project 8dc5dc16f54e4d2991a2b456216459a4. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:54:27.062546 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c33be520-6238-4828-a6c6-84016a04e66b tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363 tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:54:27.063507 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c33be520-6238-4828-a6c6-84016a04e66b tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363 tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363-project] 10.222.0.52 "POST /compute/v2.1/flavors/1294328666/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.037812 Sep 24 20:54:27.069469 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 768/1482] 10.222.0.52 () {60 vars in 1224 bytes} [Sat Sep 24 20:54:27 2022] POST /compute/v2.1/flavors/1294328666/os-extra_specs => generated 124 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:54:27.076863 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e6791262-d3e3-4f0a-b608-32ffa50f427f tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390 tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:27.089790 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:54:27.098029 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c3059794-2a94-4a42-9f5e-3112c0232b20 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.249187 Sep 24 20:54:27.099062 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 715/1483] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 20:54:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:54:27.119454 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e6791262-d3e3-4f0a-b608-32ffa50f427f tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390 tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/1294328666/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.048028 Sep 24 20:54:27.120880 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 769/1484] 10.222.0.52 () {60 vars in 1224 bytes} [Sat Sep 24 20:54:27 2022] POST /compute/v2.1/flavors/1294328666/os-extra_specs => generated 66 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:54:27.130539 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-01d2674e-5c13-43be-bdf6-2f0431223769 tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363 tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:27.133167 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-01d2674e-5c13-43be-bdf6-2f0431223769 tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363 tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '821fe105082c42b096e348a48966471e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e470661b12a6454c8641b87827b073a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:27.135165 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-01d2674e-5c13-43be-bdf6-2f0431223769 tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363 tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363-project] Request method failure captured: Sep 24 20:54:27.135165 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/flavors/1294328666/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 24 20:54:27.135165 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:54:27.135165 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:54:27.135165 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:54:27.135165 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:54:27.135165 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:54:27.135165 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:54:27.135165 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:54:27.135165 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:54:27.135165 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL25_wlfDVkenF80XeKRIZKTg5N32zaeJmkDz2vI1T044MRdmAPIWKLdvp3AgnABc4aFM_Ml7jS6C3zK0y10Q0upvC5TN5Ds7b1pWoFQe8lFfVeUwejIUzmJiqhoDPCNZoU9_obkhFeL4M950u9s05o8No2HHGxOdYw-FmQk0eAf1zno Sep 24 20:54:27.135165 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:54:27.135165 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:54:27.135165 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:54:27.135165 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:54:27.135165 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:54:27.135165 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:54:27.135165 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: e470661b12a6454c8641b87827b073a6 Sep 24 20:54:27.135165 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363 Sep 24 20:54:27.135165 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:54:27.135165 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:54:27.136509 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e470661b12a6454c8641b87827b073a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e470661b12a6454c8641b87827b073a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e470661b12a6454c8641b87827b073a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e470661b12a6454c8641b87827b073a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:54:27.136509 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363 Sep 24 20:54:27.136509 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: e470661b12a6454c8641b87827b073a6 Sep 24 20:54:27.136509 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363 Sep 24 20:54:27.136509 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363-project Sep 24 20:54:27.136509 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:54:27.136509 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:54:27.136509 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 821fe105082c42b096e348a48966471e Sep 24 20:54:27.136509 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363-project Sep 24 20:54:27.136509 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:54:27.136509 ncdv-master-1 devstack@n-api.service[140516]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 24 20:54:27.137190 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'flavor_id': '1294328666', 'id': 'hw:numa_nodes'} Sep 24 20:54:27.137190 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:54:27.137190 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:27.137190 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:54:27.137190 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:54:27.137190 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:54:27.137190 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:54:27.137190 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:54:27.137190 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:54:27.137190 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Sep 24 20:54:27.137190 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Sep 24 20:54:27.137190 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 24 20:54:27.137190 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 24 20:54:27.137190 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 24 20:54:27.137190 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 24 20:54:27.137190 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:54:27.137190 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:54:27.137190 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:54:27.137190 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:54:27.137190 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 24 20:54:27.138527 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 24 20:54:27.138527 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 24 20:54:27.138527 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 24 20:54:27.138527 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 24 20:54:27.138527 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 24 20:54:27.138527 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 24 20:54:27.138527 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:27.138527 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:54:27.138527 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:27.138527 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:27.138527 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:54:27.138527 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:54:27.138527 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 24 20:54:27.138527 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 24 20:54:27.138527 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 24 20:54:27.138527 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:27.144221 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-01d2674e-5c13-43be-bdf6-2f0431223769 tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363 tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:54:27.145503 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-01d2674e-5c13-43be-bdf6-2f0431223769 tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363 tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363-project] 10.222.0.52 "DELETE /compute/v2.1/flavors/1294328666/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.018946 Sep 24 20:54:27.146579 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 716/1485] 10.222.0.52 () {58 vars in 1248 bytes} [Sat Sep 24 20:54:27 2022] DELETE /compute/v2.1/flavors/1294328666/os-extra_specs/hw:numa_nodes => generated 124 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:54:27.157174 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8b082e44-8be3-4fa3-8b5f-6b59b39e860b tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390 tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:27.188744 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8b082e44-8be3-4fa3-8b5f-6b59b39e860b tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390 tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/1294328666/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.036363 Sep 24 20:54:27.190791 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 770/1486] 10.222.0.52 () {60 vars in 1224 bytes} [Sat Sep 24 20:54:27 2022] POST /compute/v2.1/flavors/1294328666/os-extra_specs => generated 66 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:54:27.202290 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0099e649-6b37-479c-93c9-dca3f3e43dac tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363 tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:27.208928 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0099e649-6b37-479c-93c9-dca3f3e43dac tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363 tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '821fe105082c42b096e348a48966471e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e470661b12a6454c8641b87827b073a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:27.211113 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0099e649-6b37-479c-93c9-dca3f3e43dac tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363 tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363-project] Request method failure captured: Sep 24 20:54:27.211113 ncdv-master-1 devstack@n-api.service[140516]: request: PUT /compute/v2.1/flavors/1294328666/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 24 20:54:27.211113 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:54:27.211113 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:54:27.211113 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:54:27.211113 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 22 Sep 24 20:54:27.211113 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:54:27.211113 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:54:27.211113 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:54:27.211113 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:54:27.211113 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL25_wlfDVkenF80XeKRIZKTg5N32zaeJmkDz2vI1T044MRdmAPIWKLdvp3AgnABc4aFM_Ml7jS6C3zK0y10Q0upvC5TN5Ds7b1pWoFQe8lFfVeUwejIUzmJiqhoDPCNZoU9_obkhFeL4M950u9s05o8No2HHGxOdYw-FmQk0eAf1zno Sep 24 20:54:27.211113 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:54:27.211113 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:54:27.211113 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:54:27.211113 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:54:27.211113 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:54:27.211113 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:54:27.211113 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: e470661b12a6454c8641b87827b073a6 Sep 24 20:54:27.211113 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363 Sep 24 20:54:27.211113 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:54:27.211113 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:54:27.212790 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e470661b12a6454c8641b87827b073a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e470661b12a6454c8641b87827b073a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e470661b12a6454c8641b87827b073a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e470661b12a6454c8641b87827b073a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:54:27.212790 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363 Sep 24 20:54:27.212790 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: e470661b12a6454c8641b87827b073a6 Sep 24 20:54:27.212790 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363 Sep 24 20:54:27.212790 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363-project Sep 24 20:54:27.212790 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:54:27.212790 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:54:27.212790 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 821fe105082c42b096e348a48966471e Sep 24 20:54:27.212790 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363-project Sep 24 20:54:27.212790 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 20:54:27.212790 ncdv-master-1 devstack@n-api.service[140516]: {"hw:numa_nodes": "1"} Sep 24 20:54:27.212790 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:54:27.212790 ncdv-master-1 devstack@n-api.service[140516]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 24 20:54:27.213650 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'flavor_id': '1294328666', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Sep 24 20:54:27.213650 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:54:27.213650 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:27.213650 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:54:27.213650 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:54:27.213650 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:54:27.213650 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:54:27.213650 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:54:27.213650 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:54:27.213650 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:54:27.213650 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:54:27.213650 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Sep 24 20:54:27.213650 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Sep 24 20:54:27.213650 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 24 20:54:27.213650 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 24 20:54:27.213650 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 24 20:54:27.213650 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 24 20:54:27.213650 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:54:27.213650 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:54:27.214882 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:54:27.214882 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:54:27.214882 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 24 20:54:27.214882 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 24 20:54:27.214882 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 24 20:54:27.214882 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 24 20:54:27.214882 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 24 20:54:27.214882 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 24 20:54:27.214882 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 24 20:54:27.214882 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:27.214882 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:54:27.214882 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:27.214882 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:27.214882 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:54:27.214882 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:54:27.214882 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 24 20:54:27.214882 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 24 20:54:27.214882 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 24 20:54:27.214882 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:27.223093 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4b52c302-507c-4bfb-be8d-6cf825743b4f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:27.224604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0099e649-6b37-479c-93c9-dca3f3e43dac tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363 tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:54:27.225742 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0099e649-6b37-479c-93c9-dca3f3e43dac tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363 tempest-FlavorsExtraSpecsNegativeTestJSON-1721533363-project] 10.222.0.52 "PUT /compute/v2.1/flavors/1294328666/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.029067 Sep 24 20:54:27.227420 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 717/1487] 10.222.0.52 () {60 vars in 1265 bytes} [Sat Sep 24 20:54:27 2022] PUT /compute/v2.1/flavors/1294328666/os-extra_specs/hw:numa_nodes => generated 124 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:54:27.230371 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4b52c302-507c-4bfb-be8d-6cf825743b4f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:27.241266 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3057b1d6-31cf-4850-a291-9d4672c88c7e tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390 tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:27.248325 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4b52c302-507c-4bfb-be8d-6cf825743b4f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:27.250252 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4b52c302-507c-4bfb-be8d-6cf825743b4f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:27.251282 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4b52c302-507c-4bfb-be8d-6cf825743b4f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:27.256170 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4b52c302-507c-4bfb-be8d-6cf825743b4f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:27.257097 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4b52c302-507c-4bfb-be8d-6cf825743b4f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:27.258790 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4b52c302-507c-4bfb-be8d-6cf825743b4f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:27.261955 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-3057b1d6-31cf-4850-a291-9d4672c88c7e tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390 tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390-project-admin] HTTP exception thrown: Flavor 1294328666 has no extra specs with key hw:cpu_thread_policy. Sep 24 20:54:27.265977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3057b1d6-31cf-4850-a291-9d4672c88c7e tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390 tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390-project-admin] Request method failure captured: Sep 24 20:54:27.265977 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/flavors/1294328666/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 24 20:54:27.265977 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:54:27.265977 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:54:27.265977 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:54:27.265977 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:54:27.265977 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:54:27.265977 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:54:27.265977 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:54:27.265977 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:54:27.265977 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL26A85ZC8IF-mllWahimzVbv7J_mxu77T5WIE73jXjH1AXW7COCPI3ClOmb1DkQ9R_NIgyYlDJ0__A5fDw9iVQC1YVwV9yyueUVNehRGJ5pqHoxgsg2ZBmmpKQH3BdwUNGCH4INkLfx7ClFR1KxhxJ6lP_ikXq8uaULm9v4vDH3ITSA Sep 24 20:54:27.265977 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:54:27.265977 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:54:27.265977 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:54:27.265977 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:54:27.265977 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:54:27.265977 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:54:27.265977 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: c6badc448b704fe29a75c0c0e40de963 Sep 24 20:54:27.265977 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390 Sep 24 20:54:27.265977 ncdv-master-1 devstack@n-api.service[140516]: X-Role: admin,reader,member Sep 24 20:54:27.265977 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: admin,reader,member Sep 24 20:54:27.267513 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c6badc448b704fe29a75c0c0e40de963"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c6badc448b704fe29a75c0c0e40de963"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c6badc448b704fe29a75c0c0e40de963"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c6badc448b704fe29a75c0c0e40de963"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:54:27.267513 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390 Sep 24 20:54:27.267513 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: c6badc448b704fe29a75c0c0e40de963 Sep 24 20:54:27.267513 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390 Sep 24 20:54:27.267513 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390-project-admin Sep 24 20:54:27.267513 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:54:27.267513 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:54:27.267513 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 42eef758668a4696aaa1d2505f77cb87 Sep 24 20:54:27.267513 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390-project-admin Sep 24 20:54:27.267513 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:54:27.267513 ncdv-master-1 devstack@n-api.service[140516]: exception: Flavor 1294328666 has no extra specs with key hw:cpu_thread_policy. Sep 24 20:54:27.269498 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'flavor_id': '1294328666', 'id': 'hw:cpu_thread_policy'} Sep 24 20:54:27.269498 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:54:27.269498 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:27.269498 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Sep 24 20:54:27.269498 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Sep 24 20:54:27.269498 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 24 20:54:27.269498 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:27.269498 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:54:27.269498 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:27.269498 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:27.269498 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:54:27.269498 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:54:27.269498 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:54:27.269498 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:54:27.269498 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:54:27.269498 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:54:27.269498 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Sep 24 20:54:27.269498 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 24 20:54:27.269498 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1294328666 has no extra specs with key hw:cpu_thread_policy. Sep 24 20:54:27.269498 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:27.269498 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:54:27.269498 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:27.272175 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:27.272175 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:54:27.272175 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:54:27.272175 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:54:27.272175 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:54:27.272175 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1294328666 has no extra specs with key hw:cpu_thread_policy. Sep 24 20:54:27.272175 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:27.272175 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3057b1d6-31cf-4850-a291-9d4672c88c7e tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390 tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390-project-admin] Returning 404 to user: Flavor 1294328666 has no extra specs with key hw:cpu_thread_policy. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:54:27.275819 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3057b1d6-31cf-4850-a291-9d4672c88c7e tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390 tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1294328666/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.041264 Sep 24 20:54:27.275819 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 718/1488] 10.222.0.52 () {58 vars in 1269 bytes} [Sat Sep 24 20:54:27 2022] DELETE /compute/v2.1/flavors/1294328666/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:54:27.283281 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5b7bb351-95ba-49f1-82c7-abe6b3e90e68 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:27.284830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5b7bb351-95ba-49f1-82c7-abe6b3e90e68 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 39c753b7-d223-4e33-9086-d64877d26ecc] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:27.294123 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b7bb351-95ba-49f1-82c7-abe6b3e90e68 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:27.295548 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b7bb351-95ba-49f1-82c7-abe6b3e90e68 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:27.296346 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b7bb351-95ba-49f1-82c7-abe6b3e90e68 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:27.297305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b7bb351-95ba-49f1-82c7-abe6b3e90e68 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:27.297923 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b7bb351-95ba-49f1-82c7-abe6b3e90e68 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:27.298595 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b7bb351-95ba-49f1-82c7-abe6b3e90e68 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:27.748446 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5b7bb351-95ba-49f1-82c7-abe6b3e90e68 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:27.779139 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5b7bb351-95ba-49f1-82c7-abe6b3e90e68 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc" status: 200 len: 1321 microversion: 2.1 time: 0.502311 Sep 24 20:54:27.779733 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 719/1489] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:27 2022] GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc => generated 1321 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:27.792879 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c52a5404-62a4-4040-8d1e-5fb15e85096e tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390 tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:27.796262 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-c52a5404-62a4-4040-8d1e-5fb15e85096e tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390 tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390-project-admin] HTTP exception thrown: Request body and URI mismatch Sep 24 20:54:27.807508 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c52a5404-62a4-4040-8d1e-5fb15e85096e tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390 tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390-project-admin] Request method failure captured: Sep 24 20:54:27.807508 ncdv-master-1 devstack@n-api.service[140516]: request: PUT /compute/v2.1/flavors/1294328666/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 24 20:54:27.807508 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:54:27.807508 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:54:27.807508 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:54:27.807508 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 27 Sep 24 20:54:27.807508 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:54:27.807508 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:54:27.807508 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:54:27.807508 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:54:27.807508 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL26A85ZC8IF-mllWahimzVbv7J_mxu77T5WIE73jXjH1AXW7COCPI3ClOmb1DkQ9R_NIgyYlDJ0__A5fDw9iVQC1YVwV9yyueUVNehRGJ5pqHoxgsg2ZBmmpKQH3BdwUNGCH4INkLfx7ClFR1KxhxJ6lP_ikXq8uaULm9v4vDH3ITSA Sep 24 20:54:27.807508 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:54:27.807508 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:54:27.807508 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:54:27.807508 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:54:27.807508 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:54:27.807508 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:54:27.807508 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: c6badc448b704fe29a75c0c0e40de963 Sep 24 20:54:27.807508 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390 Sep 24 20:54:27.807508 ncdv-master-1 devstack@n-api.service[140516]: X-Role: admin,reader,member Sep 24 20:54:27.807508 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: admin,reader,member Sep 24 20:54:27.809329 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c6badc448b704fe29a75c0c0e40de963"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c6badc448b704fe29a75c0c0e40de963"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c6badc448b704fe29a75c0c0e40de963"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c6badc448b704fe29a75c0c0e40de963"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:54:27.809329 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390 Sep 24 20:54:27.809329 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: c6badc448b704fe29a75c0c0e40de963 Sep 24 20:54:27.809329 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390 Sep 24 20:54:27.809329 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390-project-admin Sep 24 20:54:27.809329 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:54:27.809329 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:54:27.809329 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 42eef758668a4696aaa1d2505f77cb87 Sep 24 20:54:27.809329 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390-project-admin Sep 24 20:54:27.809329 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 20:54:27.809329 ncdv-master-1 devstack@n-api.service[140516]: {"hw:cpu_policy": "shared"} Sep 24 20:54:27.809329 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:54:27.809329 ncdv-master-1 devstack@n-api.service[140516]: exception: Request body and URI mismatch Sep 24 20:54:27.810319 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'flavor_id': '1294328666', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Sep 24 20:54:27.810319 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:54:27.810319 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:27.810319 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:54:27.810319 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:54:27.810319 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:54:27.810319 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:54:27.810319 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:54:27.810319 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:54:27.810319 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:54:27.810319 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:54:27.810319 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Sep 24 20:54:27.810319 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Sep 24 20:54:27.810319 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Sep 24 20:54:27.810319 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:27.810319 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:54:27.810319 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:27.810319 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:27.810319 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:54:27.810319 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:54:27.811836 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:54:27.811836 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:54:27.811836 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Sep 24 20:54:27.811836 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:27.816093 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c52a5404-62a4-4040-8d1e-5fb15e85096e tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390 tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:54:27.817400 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c52a5404-62a4-4040-8d1e-5fb15e85096e tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390 tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390-project-admin] 10.222.0.52 "PUT /compute/v2.1/flavors/1294328666/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.036729 Sep 24 20:54:27.820359 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 720/1490] 10.222.0.52 () {60 vars in 1265 bytes} [Sat Sep 24 20:54:27 2022] PUT /compute/v2.1/flavors/1294328666/os-extra_specs/hw:numa_nodes => generated 73 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 24 20:54:27.826714 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4b52c302-507c-4bfb-be8d-6cf825743b4f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:27.861917 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4b52c302-507c-4bfb-be8d-6cf825743b4f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1312 microversion: 2.1 time: 0.643328 Sep 24 20:54:27.864534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b1ff0b72-fcc4-449c-8ba9-bea6a5cc22cf tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:27.865488 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 771/1491] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:27 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1312 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:27.867493 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b1ff0b72-fcc4-449c-8ba9-bea6a5cc22cf tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:27.875613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b26fa9ff-a118-4184-b568-0d7412551fbb tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390 tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:27.896742 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1ff0b72-fcc4-449c-8ba9-bea6a5cc22cf tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:27.898176 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1ff0b72-fcc4-449c-8ba9-bea6a5cc22cf tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:27.899922 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b26fa9ff-a118-4184-b568-0d7412551fbb tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390 tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390-project-admin] Request method failure captured: Sep 24 20:54:27.899922 ncdv-master-1 devstack@n-api.service[140517]: request: PUT /compute/v2.1/flavors/1294328666/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 24 20:54:27.899922 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:54:27.899922 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:54:27.899922 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:54:27.899922 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 49 Sep 24 20:54:27.899922 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:54:27.899922 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:54:27.899922 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:54:27.899922 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:54:27.899922 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL26A85ZC8IF-mllWahimzVbv7J_mxu77T5WIE73jXjH1AXW7COCPI3ClOmb1DkQ9R_NIgyYlDJ0__A5fDw9iVQC1YVwV9yyueUVNehRGJ5pqHoxgsg2ZBmmpKQH3BdwUNGCH4INkLfx7ClFR1KxhxJ6lP_ikXq8uaULm9v4vDH3ITSA Sep 24 20:54:27.899922 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:54:27.899922 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:54:27.899922 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:54:27.899922 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:54:27.899922 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:54:27.899922 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:54:27.899922 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: c6badc448b704fe29a75c0c0e40de963 Sep 24 20:54:27.899922 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390 Sep 24 20:54:27.899922 ncdv-master-1 devstack@n-api.service[140517]: X-Role: admin,reader,member Sep 24 20:54:27.899922 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: admin,reader,member Sep 24 20:54:27.901636 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c6badc448b704fe29a75c0c0e40de963"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c6badc448b704fe29a75c0c0e40de963"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c6badc448b704fe29a75c0c0e40de963"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c6badc448b704fe29a75c0c0e40de963"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:54:27.901636 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390 Sep 24 20:54:27.901636 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: c6badc448b704fe29a75c0c0e40de963 Sep 24 20:54:27.901636 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390 Sep 24 20:54:27.901636 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390-project-admin Sep 24 20:54:27.901636 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:54:27.901636 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:54:27.901636 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 42eef758668a4696aaa1d2505f77cb87 Sep 24 20:54:27.901636 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390-project-admin Sep 24 20:54:27.901636 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 20:54:27.901636 ncdv-master-1 devstack@n-api.service[140517]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Sep 24 20:54:27.901636 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:54:27.902793 ncdv-master-1 devstack@n-api.service[140517]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 24 20:54:27.902793 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'flavor_id': '1294328666', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Sep 24 20:54:27.902793 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:54:27.902793 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:27.902793 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 20:54:27.902793 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 20:54:27.902793 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 20:54:27.902793 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise error Sep 24 20:54:27.902793 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 24 20:54:27.902793 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:54:27.902793 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Sep 24 20:54:27.902793 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 24 20:54:27.902793 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Sep 24 20:54:27.902793 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Sep 24 20:54:27.902793 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 24 20:54:27.902793 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi 'type': ['string', Sep 24 20:54:27.902793 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi 'number']}}, Sep 24 20:54:27.902793 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 24 20:54:27.902793 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:54:27.902793 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi On instance: Sep 24 20:54:27.902793 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Sep 24 20:54:27.902793 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:54:27.904727 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:54:27.904727 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:54:27.904727 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:27.904727 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:54:27.904727 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:54:27.904727 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:54:27.904727 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:54:27.904727 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:54:27.904727 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:54:27.904727 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 20:54:27.904727 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 20:54:27.904727 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 20:54:27.904727 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 20:54:27.904727 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 20:54:27.904727 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 20:54:27.904727 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 24 20:54:27.904727 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:54:27.904727 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:54:27.904727 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:54:27.904727 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:27.906421 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:54:27.906421 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:54:27.906421 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 20:54:27.906421 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 20:54:27.906421 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 24 20:54:27.906421 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:54:27.907015 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1ff0b72-fcc4-449c-8ba9-bea6a5cc22cf tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:27.909486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1ff0b72-fcc4-449c-8ba9-bea6a5cc22cf tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:27.909998 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1ff0b72-fcc4-449c-8ba9-bea6a5cc22cf tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:27.910444 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1ff0b72-fcc4-449c-8ba9-bea6a5cc22cf tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:27.912304 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b26fa9ff-a118-4184-b568-0d7412551fbb tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390 tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:54:27.912622 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b26fa9ff-a118-4184-b568-0d7412551fbb tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390 tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390-project-admin] 10.222.0.52 "PUT /compute/v2.1/flavors/1294328666/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.045006 Sep 24 20:54:27.913362 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 772/1492] 10.222.0.52 () {60 vars in 1265 bytes} [Sat Sep 24 20:54:27 2022] PUT /compute/v2.1/flavors/1294328666/os-extra_specs/hw:numa_nodes => generated 117 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 20:54:27.932129 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-969af152-987e-487b-89d8-b88ad2d434fb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:27.936344 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-969af152-987e-487b-89d8-b88ad2d434fb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:27.958534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-969af152-987e-487b-89d8-b88ad2d434fb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:27.959393 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-969af152-987e-487b-89d8-b88ad2d434fb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:27.959883 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-969af152-987e-487b-89d8-b88ad2d434fb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:27.960636 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-969af152-987e-487b-89d8-b88ad2d434fb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:27.961105 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-969af152-987e-487b-89d8-b88ad2d434fb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:27.961540 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-969af152-987e-487b-89d8-b88ad2d434fb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:28.502620 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-969af152-987e-487b-89d8-b88ad2d434fb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:28.528649 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-969af152-987e-487b-89d8-b88ad2d434fb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:28.531590 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-969af152-987e-487b-89d8-b88ad2d434fb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:28.537588 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-969af152-987e-487b-89d8-b88ad2d434fb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1409 microversion: 2.25 time: 0.621997 Sep 24 20:54:28.574310 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 773/1493] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:54:27 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1409 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:54:28.583976 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-076a3fc0-aa1c-43d5-b796-14d96a601f8b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:28.584860 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-076a3fc0-aa1c-43d5-b796-14d96a601f8b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a89ef546-702c-4ecd-babc-7d523421339b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:28.598561 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b1ff0b72-fcc4-449c-8ba9-bea6a5cc22cf tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:28.613966 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b1ff0b72-fcc4-449c-8ba9-bea6a5cc22cf tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1715 microversion: 2.1 time: 0.792312 Sep 24 20:54:28.614280 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-076a3fc0-aa1c-43d5-b796-14d96a601f8b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:28.615094 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-076a3fc0-aa1c-43d5-b796-14d96a601f8b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:28.616019 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 721/1494] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:27 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1715 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:28.619779 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-076a3fc0-aa1c-43d5-b796-14d96a601f8b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:28.621470 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-076a3fc0-aa1c-43d5-b796-14d96a601f8b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:28.623142 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-076a3fc0-aa1c-43d5-b796-14d96a601f8b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:28.626436 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-076a3fc0-aa1c-43d5-b796-14d96a601f8b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:28.641283 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-70a048fa-1721-4dd4-a3ef-af23121287b2 tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390 tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:28.687034 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-70a048fa-1721-4dd4-a3ef-af23121287b2 tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390 tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1294328666" status: 202 len: 0 microversion: 2.1 time: 0.069080 Sep 24 20:54:28.688173 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 722/1495] 10.222.0.52 () {58 vars in 1161 bytes} [Sat Sep 24 20:54:28 2022] DELETE /compute/v2.1/flavors/1294328666 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:54:28.702642 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b3b109ef-d554-4576-8b37-3aee55ea016c tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b0c954940>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:28.812601 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b3b109ef-d554-4576-8b37-3aee55ea016c tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913" status: 200 len: 1421 microversion: 2.1 time: 0.123249 Sep 24 20:54:28.813195 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 723/1496] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:54:28 2022] GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913 => generated 1421 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:28.831672 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-f02c5741-4e56-428f-bcea-64360aafe351 req-555da241-77db-4ac7-96c2-fa90ea9d8aa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9425eeec-a7b4-4926-a2f3-80dd47eb9e0c", "name": "network-vif-plugged", "status": "completed", "tag": "7138905c-dbe0-4d9c-83c3-21fb5d346268"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:28.864333 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-f02c5741-4e56-428f-bcea-64360aafe351 req-555da241-77db-4ac7-96c2-fa90ea9d8aa2 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:28.864830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-f02c5741-4e56-428f-bcea-64360aafe351 req-555da241-77db-4ac7-96c2-fa90ea9d8aa2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:28.865270 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-f02c5741-4e56-428f-bcea-64360aafe351 req-555da241-77db-4ac7-96c2-fa90ea9d8aa2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:28.899912 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-f02c5741-4e56-428f-bcea-64360aafe351 req-555da241-77db-4ac7-96c2-fa90ea9d8aa2 service nova] Creating event network-vif-plugged:7138905c-dbe0-4d9c-83c3-21fb5d346268 for instance 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c on nch2-master-1 Sep 24 20:54:28.906343 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-f02c5741-4e56-428f-bcea-64360aafe351 req-555da241-77db-4ac7-96c2-fa90ea9d8aa2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091740 Sep 24 20:54:28.909669 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 724/1497] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:54:28.928203 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c2a22a7b-f393-4e20-82ab-f3f1eaa6b580 tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390 tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:28.979399 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c2a22a7b-f393-4e20-82ab-f3f1eaa6b580 tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390 tempest-FlavorsExtraSpecsNegativeTestJSON-1880009390-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.067503 Sep 24 20:54:28.979606 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 725/1498] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:54:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:28.995341 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-20e233b9-398e-4d24-b87f-279cf9c283e0 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:28.996832 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-20e233b9-398e-4d24-b87f-279cf9c283e0 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 39c753b7-d223-4e33-9086-d64877d26ecc] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:29.009389 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-076a3fc0-aa1c-43d5-b796-14d96a601f8b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:29.014811 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-20e233b9-398e-4d24-b87f-279cf9c283e0 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:29.017249 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-20e233b9-398e-4d24-b87f-279cf9c283e0 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:29.017749 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-20e233b9-398e-4d24-b87f-279cf9c283e0 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:29.017904 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-076a3fc0-aa1c-43d5-b796-14d96a601f8b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b" status: 200 len: 1316 microversion: 2.1 time: 0.442368 Sep 24 20:54:29.020344 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 774/1499] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:28 2022] GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b => generated 1316 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:29.021616 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-20e233b9-398e-4d24-b87f-279cf9c283e0 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:29.022149 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-20e233b9-398e-4d24-b87f-279cf9c283e0 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:29.022901 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-20e233b9-398e-4d24-b87f-279cf9c283e0 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:29.027042 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-76862a16-533b-4abb-89ad-5ee6a5fa49c8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:29.027659 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-76862a16-533b-4abb-89ad-5ee6a5fa49c8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:29.056704 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76862a16-533b-4abb-89ad-5ee6a5fa49c8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:29.057953 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76862a16-533b-4abb-89ad-5ee6a5fa49c8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:29.058584 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76862a16-533b-4abb-89ad-5ee6a5fa49c8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:29.064074 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76862a16-533b-4abb-89ad-5ee6a5fa49c8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:29.064840 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76862a16-533b-4abb-89ad-5ee6a5fa49c8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:29.066225 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76862a16-533b-4abb-89ad-5ee6a5fa49c8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:29.719182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-20e233b9-398e-4d24-b87f-279cf9c283e0 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:29.745911 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-20e233b9-398e-4d24-b87f-279cf9c283e0 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc" status: 200 len: 1321 microversion: 2.1 time: 0.762888 Sep 24 20:54:29.755513 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-76862a16-533b-4abb-89ad-5ee6a5fa49c8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:29.761382 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 726/1500] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:28 2022] GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc => generated 1321 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:29.778011 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-67f10d4d-fa61-4d69-b653-cb1a6dcfb32a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:29.779619 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-76862a16-533b-4abb-89ad-5ee6a5fa49c8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1312 microversion: 2.1 time: 0.755676 Sep 24 20:54:29.784791 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-67f10d4d-fa61-4d69-b653-cb1a6dcfb32a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:29.787803 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 775/1501] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:29 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1312 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:29.808855 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-44e671c6-c3ad-45ac-b939-d55d484c3c4c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:29.823750 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-44e671c6-c3ad-45ac-b939-d55d484c3c4c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:29.828677 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67f10d4d-fa61-4d69-b653-cb1a6dcfb32a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:29.832873 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67f10d4d-fa61-4d69-b653-cb1a6dcfb32a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:29.836686 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67f10d4d-fa61-4d69-b653-cb1a6dcfb32a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:29.837824 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67f10d4d-fa61-4d69-b653-cb1a6dcfb32a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:29.841188 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67f10d4d-fa61-4d69-b653-cb1a6dcfb32a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:29.843225 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67f10d4d-fa61-4d69-b653-cb1a6dcfb32a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:29.858561 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-44e671c6-c3ad-45ac-b939-d55d484c3c4c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:29.861690 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-44e671c6-c3ad-45ac-b939-d55d484c3c4c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:29.864304 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-44e671c6-c3ad-45ac-b939-d55d484c3c4c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:29.865354 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-44e671c6-c3ad-45ac-b939-d55d484c3c4c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:29.868558 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-44e671c6-c3ad-45ac-b939-d55d484c3c4c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:29.870633 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-44e671c6-c3ad-45ac-b939-d55d484c3c4c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:30.237978 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-44e671c6-c3ad-45ac-b939-d55d484c3c4c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:30.248758 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-44e671c6-c3ad-45ac-b939-d55d484c3c4c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1715 microversion: 2.1 time: 0.453803 Sep 24 20:54:30.249355 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 776/1502] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:29 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1715 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:30.266701 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-67f10d4d-fa61-4d69-b653-cb1a6dcfb32a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:30.286915 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-67f10d4d-fa61-4d69-b653-cb1a6dcfb32a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:30.289000 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-88216383-cd48-4b0b-b549-62d664dcbea3 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b11024c10>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:30.289876 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-67f10d4d-fa61-4d69-b653-cb1a6dcfb32a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:30.291808 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-67f10d4d-fa61-4d69-b653-cb1a6dcfb32a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1409 microversion: 2.25 time: 0.528240 Sep 24 20:54:30.292870 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 727/1503] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:54:29 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1409 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:54:30.316129 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d4d03fe9-5d3d-4b92-be13-08fa23b4eeba tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:30.319689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d4d03fe9-5d3d-4b92-be13-08fa23b4eeba tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a89ef546-702c-4ecd-babc-7d523421339b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:30.329748 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d4d03fe9-5d3d-4b92-be13-08fa23b4eeba tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:30.330247 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d4d03fe9-5d3d-4b92-be13-08fa23b4eeba tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:30.331059 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d4d03fe9-5d3d-4b92-be13-08fa23b4eeba tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:30.331973 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d4d03fe9-5d3d-4b92-be13-08fa23b4eeba tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:30.332703 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d4d03fe9-5d3d-4b92-be13-08fa23b4eeba tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:30.333296 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d4d03fe9-5d3d-4b92-be13-08fa23b4eeba tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:30.382822 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-88216383-cd48-4b0b-b549-62d664dcbea3 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913" status: 200 len: 1421 microversion: 2.1 time: 0.120632 Sep 24 20:54:30.392797 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 777/1504] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:54:30 2022] GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913 => generated 1421 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:30.404296 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-228962ad-f9a0-4e89-9ba6-47a15a2aec9b tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "199a1630-6cfa-47df-a2c1-b525ef0ef3ee"}], "security_groups": [{"name": "tempest-securitygroup--1933432854"}], "key_name": "tempest-keypair-313481477", "user_data": "}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:30.650770 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-228962ad-f9a0-4e89-9ba6-47a15a2aec9b tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] validate_networks() for [('199a1630-6cfa-47df-a2c1-b525ef0ef3ee', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:54:30.665923 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d4d03fe9-5d3d-4b92-be13-08fa23b4eeba tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:30.679742 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d4d03fe9-5d3d-4b92-be13-08fa23b4eeba tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b" status: 200 len: 1316 microversion: 2.1 time: 0.385033 Sep 24 20:54:30.683541 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 728/1505] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:30 2022] GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b => generated 1316 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:30.774360 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d672f4ca-8492-48b0-a4be-6d51f2988230 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:30.775035 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d672f4ca-8492-48b0-a4be-6d51f2988230 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 39c753b7-d223-4e33-9086-d64877d26ecc] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:30.783424 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d672f4ca-8492-48b0-a4be-6d51f2988230 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:30.784638 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d672f4ca-8492-48b0-a4be-6d51f2988230 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:30.785147 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d672f4ca-8492-48b0-a4be-6d51f2988230 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:30.785927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d672f4ca-8492-48b0-a4be-6d51f2988230 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:30.786329 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d672f4ca-8492-48b0-a4be-6d51f2988230 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:30.789281 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d672f4ca-8492-48b0-a4be-6d51f2988230 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:31.175389 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d672f4ca-8492-48b0-a4be-6d51f2988230 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:31.184553 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d672f4ca-8492-48b0-a4be-6d51f2988230 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc" status: 200 len: 1321 microversion: 2.1 time: 0.414209 Sep 24 20:54:31.194983 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 729/1506] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:30 2022] GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc => generated 1321 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:31.208973 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f0ec79e6-ed11-4f91-9fa1-5b4feb945eb0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:31.209861 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f0ec79e6-ed11-4f91-9fa1-5b4feb945eb0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:31.226367 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f0ec79e6-ed11-4f91-9fa1-5b4feb945eb0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:31.234875 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f0ec79e6-ed11-4f91-9fa1-5b4feb945eb0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:31.235427 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f0ec79e6-ed11-4f91-9fa1-5b4feb945eb0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:31.236212 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f0ec79e6-ed11-4f91-9fa1-5b4feb945eb0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:31.236906 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f0ec79e6-ed11-4f91-9fa1-5b4feb945eb0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:31.238032 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f0ec79e6-ed11-4f91-9fa1-5b4feb945eb0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:31.634529 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-228962ad-f9a0-4e89-9ba6-47a15a2aec9b tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:54:31.635111 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-228962ad-f9a0-4e89-9ba6-47a15a2aec9b tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:54:31.635466 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-228962ad-f9a0-4e89-9ba6-47a15a2aec9b tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:54:31.635885 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-228962ad-f9a0-4e89-9ba6-47a15a2aec9b tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:54:31.636315 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-228962ad-f9a0-4e89-9ba6-47a15a2aec9b tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:54:31.653006 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-228962ad-f9a0-4e89-9ba6-47a15a2aec9b tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:31.653535 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-228962ad-f9a0-4e89-9ba6-47a15a2aec9b tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:31.653949 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-228962ad-f9a0-4e89-9ba6-47a15a2aec9b tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:31.654729 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-228962ad-f9a0-4e89-9ba6-47a15a2aec9b tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:31.655194 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-228962ad-f9a0-4e89-9ba6-47a15a2aec9b tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:31.655629 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-228962ad-f9a0-4e89-9ba6-47a15a2aec9b tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:31.689764 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f0ec79e6-ed11-4f91-9fa1-5b4feb945eb0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:31.703949 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-228962ad-f9a0-4e89-9ba6-47a15a2aec9b tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Getting quotas for project 8dc5dc16f54e4d2991a2b456216459a4. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:54:31.709126 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f0ec79e6-ed11-4f91-9fa1-5b4feb945eb0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1312 microversion: 2.1 time: 0.509522 Sep 24 20:54:31.710453 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-228962ad-f9a0-4e89-9ba6-47a15a2aec9b tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Getting quotas for user dab2b6bf40594154a6340d5afd02da0c and project 8dc5dc16f54e4d2991a2b456216459a4. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:54:31.711990 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 730/1507] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:31 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1312 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:31.724659 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-228962ad-f9a0-4e89-9ba6-47a15a2aec9b tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:54:31.727332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-228962ad-f9a0-4e89-9ba6-47a15a2aec9b tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] [instance: 5fc32d38-e9c2-4a92-a346-622b7b7206fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:54:31.733598 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-f5bf6215-858f-47c6-9bc6-5ea9b00c3246 req-70530d19-dfac-4ef3-aa1f-3d2cf73a2ced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54ec06be-cb4b-4b5f-9ed8-904a328cc118", "name": "network-vif-plugged", "status": "completed", "tag": "f450a593-c9dc-4f8e-8acb-60edeb836cea"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:31.762558 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-f5bf6215-858f-47c6-9bc6-5ea9b00c3246 req-70530d19-dfac-4ef3-aa1f-3d2cf73a2ced service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:31.765905 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-f5bf6215-858f-47c6-9bc6-5ea9b00c3246 req-70530d19-dfac-4ef3-aa1f-3d2cf73a2ced service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:31.766413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-f5bf6215-858f-47c6-9bc6-5ea9b00c3246 req-70530d19-dfac-4ef3-aa1f-3d2cf73a2ced service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:31.797348 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-f5bf6215-858f-47c6-9bc6-5ea9b00c3246 req-70530d19-dfac-4ef3-aa1f-3d2cf73a2ced service nova] Creating event network-vif-plugged:f450a593-c9dc-4f8e-8acb-60edeb836cea for instance 54ec06be-cb4b-4b5f-9ed8-904a328cc118 on nch1-master-1 Sep 24 20:54:31.808475 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-228962ad-f9a0-4e89-9ba6-47a15a2aec9b tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.413156 Sep 24 20:54:31.808825 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-f5bf6215-858f-47c6-9bc6-5ea9b00c3246 req-70530d19-dfac-4ef3-aa1f-3d2cf73a2ced service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091296 Sep 24 20:54:31.809428 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 731/1508] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:54:31.815889 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 778/1509] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:54:30 2022] POST /compute/v2.1/servers => generated 409 bytes in 1422 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:54:31.820767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1e79444a-341b-49fe-a822-ac8e58d5c916 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:31.821312 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-62a598ed-14d8-42f1-a9bf-62cbd5ebe8ec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:31.822585 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-62a598ed-14d8-42f1-a9bf-62cbd5ebe8ec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:31.825487 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1e79444a-341b-49fe-a822-ac8e58d5c916 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:31.829189 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62a598ed-14d8-42f1-a9bf-62cbd5ebe8ec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:31.829703 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62a598ed-14d8-42f1-a9bf-62cbd5ebe8ec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:31.830149 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62a598ed-14d8-42f1-a9bf-62cbd5ebe8ec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:31.831061 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62a598ed-14d8-42f1-a9bf-62cbd5ebe8ec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:31.831577 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62a598ed-14d8-42f1-a9bf-62cbd5ebe8ec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:31.831993 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62a598ed-14d8-42f1-a9bf-62cbd5ebe8ec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:31.851317 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e79444a-341b-49fe-a822-ac8e58d5c916 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:31.852088 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e79444a-341b-49fe-a822-ac8e58d5c916 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:31.852746 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e79444a-341b-49fe-a822-ac8e58d5c916 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:31.853692 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e79444a-341b-49fe-a822-ac8e58d5c916 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:31.854346 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e79444a-341b-49fe-a822-ac8e58d5c916 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:31.855018 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e79444a-341b-49fe-a822-ac8e58d5c916 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:32.298178 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-62a598ed-14d8-42f1-a9bf-62cbd5ebe8ec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:32.319490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-62a598ed-14d8-42f1-a9bf-62cbd5ebe8ec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:32.323546 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-62a598ed-14d8-42f1-a9bf-62cbd5ebe8ec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:32.330416 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-62a598ed-14d8-42f1-a9bf-62cbd5ebe8ec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1409 microversion: 2.25 time: 0.512332 Sep 24 20:54:32.331968 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 779/1510] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:54:31 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1409 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:54:32.350794 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-275c9b1b-26ee-41c2-b309-27dcc39080c0 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b11024310>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:32.372906 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1e79444a-341b-49fe-a822-ac8e58d5c916 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:32.404557 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1e79444a-341b-49fe-a822-ac8e58d5c916 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1715 microversion: 2.1 time: 0.589241 Sep 24 20:54:32.408865 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 732/1511] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:31 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1715 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:32.416070 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d70dd9d3-7c7b-45c7-8914-8b233fd13f72 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:32.417629 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d70dd9d3-7c7b-45c7-8914-8b233fd13f72 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a89ef546-702c-4ecd-babc-7d523421339b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:32.437099 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d70dd9d3-7c7b-45c7-8914-8b233fd13f72 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:32.438541 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d70dd9d3-7c7b-45c7-8914-8b233fd13f72 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:32.440323 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d70dd9d3-7c7b-45c7-8914-8b233fd13f72 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:32.441697 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d70dd9d3-7c7b-45c7-8914-8b233fd13f72 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:32.445735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d70dd9d3-7c7b-45c7-8914-8b233fd13f72 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:32.446521 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-275c9b1b-26ee-41c2-b309-27dcc39080c0 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913" status: 200 len: 1421 microversion: 2.1 time: 0.110489 Sep 24 20:54:32.446980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d70dd9d3-7c7b-45c7-8914-8b233fd13f72 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:32.447146 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 780/1512] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:54:32 2022] GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913 => generated 1421 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:32.459736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-55ba90b4-b032-49a2-afb0-b781f65695a6 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:32.460346 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-55ba90b4-b032-49a2-afb0-b781f65695a6 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] [instance: 5fc32d38-e9c2-4a92-a346-622b7b7206fd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:32.631887 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-55ba90b4-b032-49a2-afb0-b781f65695a6 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab2b6bf40594154a6340d5afd02da0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc5dc16f54e4d2991a2b456216459a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:32.644080 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-55ba90b4-b032-49a2-afb0-b781f65695a6 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc32d38-e9c2-4a92-a346-622b7b7206fd" status: 200 len: 1225 microversion: 2.1 time: 0.192517 Sep 24 20:54:32.646173 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 781/1513] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:32 2022] GET /compute/v2.1/servers/5fc32d38-e9c2-4a92-a346-622b7b7206fd => generated 1225 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:32.676051 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-66a65368-fb98-4434-8713-d7d24fc6922a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:32.676681 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-66a65368-fb98-4434-8713-d7d24fc6922a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 39c753b7-d223-4e33-9086-d64877d26ecc] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:32.714617 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66a65368-fb98-4434-8713-d7d24fc6922a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:32.720463 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66a65368-fb98-4434-8713-d7d24fc6922a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:32.721170 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66a65368-fb98-4434-8713-d7d24fc6922a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:32.724636 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66a65368-fb98-4434-8713-d7d24fc6922a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:32.725315 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66a65368-fb98-4434-8713-d7d24fc6922a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:32.726088 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66a65368-fb98-4434-8713-d7d24fc6922a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:33.144638 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d70dd9d3-7c7b-45c7-8914-8b233fd13f72 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:33.156356 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d70dd9d3-7c7b-45c7-8914-8b233fd13f72 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b" status: 200 len: 1316 microversion: 2.1 time: 0.744991 Sep 24 20:54:33.175957 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 733/1514] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:32 2022] GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b => generated 1316 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:33.198675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-f18444d5-eb6c-44db-869c-c88c31d34579 req-79fd57a6-5444-4b76-809f-24e08bdca9cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e72414b7-9fb5-4059-92fe-46b1780543f3", "name": "network-vif-unplugged", "status": "completed", "tag": "3c7dbe37-1536-469e-b3d7-785af8945b6a"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:33.259330 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-f18444d5-eb6c-44db-869c-c88c31d34579 req-79fd57a6-5444-4b76-809f-24e08bdca9cd service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:33.259823 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-f18444d5-eb6c-44db-869c-c88c31d34579 req-79fd57a6-5444-4b76-809f-24e08bdca9cd service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:33.260266 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-f18444d5-eb6c-44db-869c-c88c31d34579 req-79fd57a6-5444-4b76-809f-24e08bdca9cd service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:33.306182 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-f18444d5-eb6c-44db-869c-c88c31d34579 req-79fd57a6-5444-4b76-809f-24e08bdca9cd service nova] Creating event network-vif-unplugged:3c7dbe37-1536-469e-b3d7-785af8945b6a for instance e72414b7-9fb5-4059-92fe-46b1780543f3 on nch2-master-1 Sep 24 20:54:33.316710 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-f18444d5-eb6c-44db-869c-c88c31d34579 req-79fd57a6-5444-4b76-809f-24e08bdca9cd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.137119 Sep 24 20:54:33.320121 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 734/1515] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:54:33.333869 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b4aaee30-1cbf-4981-bedc-8654c0349a52 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:33.334656 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b4aaee30-1cbf-4981-bedc-8654c0349a52 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:33.341862 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b4aaee30-1cbf-4981-bedc-8654c0349a52 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:33.342680 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-66a65368-fb98-4434-8713-d7d24fc6922a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:33.342857 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b4aaee30-1cbf-4981-bedc-8654c0349a52 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:33.343297 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b4aaee30-1cbf-4981-bedc-8654c0349a52 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:33.344029 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b4aaee30-1cbf-4981-bedc-8654c0349a52 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:33.344636 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b4aaee30-1cbf-4981-bedc-8654c0349a52 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:33.345077 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b4aaee30-1cbf-4981-bedc-8654c0349a52 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:33.356569 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-66a65368-fb98-4434-8713-d7d24fc6922a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc" status: 200 len: 1321 microversion: 2.1 time: 0.683246 Sep 24 20:54:33.363011 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 782/1516] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:32 2022] GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc => generated 1321 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:33.379499 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e8170458-e8c4-4b54-b883-fac8507c96ea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:33.381246 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e8170458-e8c4-4b54-b883-fac8507c96ea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:33.395826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e8170458-e8c4-4b54-b883-fac8507c96ea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:33.396583 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e8170458-e8c4-4b54-b883-fac8507c96ea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:33.397203 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e8170458-e8c4-4b54-b883-fac8507c96ea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:33.398870 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e8170458-e8c4-4b54-b883-fac8507c96ea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:33.407727 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e8170458-e8c4-4b54-b883-fac8507c96ea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:33.412290 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e8170458-e8c4-4b54-b883-fac8507c96ea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:33.765295 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b4aaee30-1cbf-4981-bedc-8654c0349a52 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:33.779161 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b4aaee30-1cbf-4981-bedc-8654c0349a52 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1461 microversion: 2.1 time: 0.457347 Sep 24 20:54:33.780736 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 735/1517] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:33 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1461 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:33.808282 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-413bf33f-ce7b-4de7-84ef-44cad12035da tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:33.808932 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-413bf33f-ce7b-4de7-84ef-44cad12035da tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:33.834261 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-413bf33f-ce7b-4de7-84ef-44cad12035da tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:33.835046 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-413bf33f-ce7b-4de7-84ef-44cad12035da tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:33.835673 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-413bf33f-ce7b-4de7-84ef-44cad12035da tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:33.838634 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-413bf33f-ce7b-4de7-84ef-44cad12035da tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:33.839392 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-413bf33f-ce7b-4de7-84ef-44cad12035da tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:33.840084 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-413bf33f-ce7b-4de7-84ef-44cad12035da tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:33.937216 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e8170458-e8c4-4b54-b883-fac8507c96ea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:33.949122 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e8170458-e8c4-4b54-b883-fac8507c96ea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:33.951292 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e8170458-e8c4-4b54-b883-fac8507c96ea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:33.952948 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e8170458-e8c4-4b54-b883-fac8507c96ea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1409 microversion: 2.25 time: 0.588518 Sep 24 20:54:33.954103 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 783/1518] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:54:33 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1409 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:54:33.959567 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ee5fe51e-28e9-4326-ab94-a528ea52416d tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b1104c430>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:34.020451 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ee5fe51e-28e9-4326-ab94-a528ea52416d tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913" status: 200 len: 1421 microversion: 2.1 time: 0.064587 Sep 24 20:54:34.021939 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 784/1519] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:54:33 2022] GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913 => generated 1421 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:34.029241 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-148e4d69-41f9-4490-b6e1-3fe3b9350d5e tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:34.030178 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-148e4d69-41f9-4490-b6e1-3fe3b9350d5e tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] [instance: 5fc32d38-e9c2-4a92-a346-622b7b7206fd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:34.038543 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-148e4d69-41f9-4490-b6e1-3fe3b9350d5e tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:34.039424 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-148e4d69-41f9-4490-b6e1-3fe3b9350d5e tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:34.040453 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-148e4d69-41f9-4490-b6e1-3fe3b9350d5e tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:34.042098 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-148e4d69-41f9-4490-b6e1-3fe3b9350d5e tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:34.043405 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-148e4d69-41f9-4490-b6e1-3fe3b9350d5e tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:34.044087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-148e4d69-41f9-4490-b6e1-3fe3b9350d5e tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:34.248565 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-148e4d69-41f9-4490-b6e1-3fe3b9350d5e tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab2b6bf40594154a6340d5afd02da0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc5dc16f54e4d2991a2b456216459a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:34.258142 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-148e4d69-41f9-4490-b6e1-3fe3b9350d5e tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc32d38-e9c2-4a92-a346-622b7b7206fd" status: 200 len: 1277 microversion: 2.1 time: 0.233399 Sep 24 20:54:34.280843 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 785/1520] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:34 2022] GET /compute/v2.1/servers/5fc32d38-e9c2-4a92-a346-622b7b7206fd => generated 1277 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:34.288919 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5db39cb9-a2fb-498d-ba41-99924894e736 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:34.291226 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5db39cb9-a2fb-498d-ba41-99924894e736 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:34.298940 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5db39cb9-a2fb-498d-ba41-99924894e736 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:34.302324 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5db39cb9-a2fb-498d-ba41-99924894e736 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:34.303735 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5db39cb9-a2fb-498d-ba41-99924894e736 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:34.305305 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5db39cb9-a2fb-498d-ba41-99924894e736 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:34.306473 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5db39cb9-a2fb-498d-ba41-99924894e736 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:34.307355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5db39cb9-a2fb-498d-ba41-99924894e736 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:34.340645 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-413bf33f-ce7b-4de7-84ef-44cad12035da tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:34.372201 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-413bf33f-ce7b-4de7-84ef-44cad12035da tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1715 microversion: 2.1 time: 0.584473 Sep 24 20:54:34.373010 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 736/1521] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:33 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1715 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:34.394531 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b4b6e7c1-ae0e-4322-8596-81701d4130f4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:34.395361 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b4b6e7c1-ae0e-4322-8596-81701d4130f4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a89ef546-702c-4ecd-babc-7d523421339b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:34.418576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b4b6e7c1-ae0e-4322-8596-81701d4130f4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:34.419091 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b4b6e7c1-ae0e-4322-8596-81701d4130f4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:34.419540 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b4b6e7c1-ae0e-4322-8596-81701d4130f4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:34.420276 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b4b6e7c1-ae0e-4322-8596-81701d4130f4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:34.420748 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b4b6e7c1-ae0e-4322-8596-81701d4130f4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:34.421187 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b4b6e7c1-ae0e-4322-8596-81701d4130f4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:34.582683 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5db39cb9-a2fb-498d-ba41-99924894e736 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1612 microversion: 2.1 time: 0.290907 Sep 24 20:54:34.583481 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 786/1522] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:34 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1612 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:34.603230 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8837926f-e226-419d-9ba7-29342f3855f9 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:34.603860 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8837926f-e226-419d-9ba7-29342f3855f9 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 39c753b7-d223-4e33-9086-d64877d26ecc] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:34.623367 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8837926f-e226-419d-9ba7-29342f3855f9 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:34.623871 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8837926f-e226-419d-9ba7-29342f3855f9 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:34.624319 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8837926f-e226-419d-9ba7-29342f3855f9 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:34.625038 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8837926f-e226-419d-9ba7-29342f3855f9 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:34.625515 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8837926f-e226-419d-9ba7-29342f3855f9 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:34.626067 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8837926f-e226-419d-9ba7-29342f3855f9 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:34.649711 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:54:34.859289 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b4b6e7c1-ae0e-4322-8596-81701d4130f4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:34.884107 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b4b6e7c1-ae0e-4322-8596-81701d4130f4 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b" status: 200 len: 1316 microversion: 2.1 time: 0.508102 Sep 24 20:54:34.887387 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 737/1523] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:34 2022] GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b => generated 1316 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:34.895715 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a362efe9-1e53-4729-8f03-a5b13267d263 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:34.899585 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a362efe9-1e53-4729-8f03-a5b13267d263 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:34.921470 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a362efe9-1e53-4729-8f03-a5b13267d263 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:34.923680 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a362efe9-1e53-4729-8f03-a5b13267d263 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:34.924556 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a362efe9-1e53-4729-8f03-a5b13267d263 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:34.926066 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a362efe9-1e53-4729-8f03-a5b13267d263 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:34.926795 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a362efe9-1e53-4729-8f03-a5b13267d263 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:34.929660 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a362efe9-1e53-4729-8f03-a5b13267d263 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:34.949964 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8837926f-e226-419d-9ba7-29342f3855f9 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:34.963044 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8837926f-e226-419d-9ba7-29342f3855f9 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc" status: 200 len: 1470 microversion: 2.1 time: 0.378423 Sep 24 20:54:34.963954 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 787/1524] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:34 2022] GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc => generated 1470 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:34.984842 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:54:35.011858 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a362efe9-1e53-4729-8f03-a5b13267d263 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4349ca208839405199602d34e1c7bf33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00041f889f3d430d87831f82a4d3b598', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:35.012819 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a362efe9-1e53-4729-8f03-a5b13267d263 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] flavor_id is None. Assuming migration. {{(pid=140516) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 24 20:54:35.013500 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a362efe9-1e53-4729-8f03-a5b13267d263 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=140516) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 24 20:54:35.150091 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fe0910bb-ae9a-4056-9318-da8c596e5898 tempest-FlavorsV255TestJSON-1693519675 tempest-FlavorsV255TestJSON-1693519675-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-551641838", "id": 1003397772, "os-flavor-access:is_public": "True"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:35.171613 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fe0910bb-ae9a-4056-9318-da8c596e5898 tempest-FlavorsV255TestJSON-1693519675 tempest-FlavorsV255TestJSON-1693519675-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.206352 Sep 24 20:54:35.172799 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 788/1525] 10.222.0.52 () {62 vars in 1188 bytes} [Sat Sep 24 20:54:34 2022] POST /compute/v2.1/flavors => generated 448 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:54:35.179915 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4d17b0fb-8749-4919-a614-b752a66a1a62 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:35.180959 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4d17b0fb-8749-4919-a614-b752a66a1a62 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:35.187422 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4d17b0fb-8749-4919-a614-b752a66a1a62 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:35.188216 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4d17b0fb-8749-4919-a614-b752a66a1a62 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:35.188950 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4d17b0fb-8749-4919-a614-b752a66a1a62 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:35.189952 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4d17b0fb-8749-4919-a614-b752a66a1a62 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:35.191063 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4d17b0fb-8749-4919-a614-b752a66a1a62 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:35.191700 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4d17b0fb-8749-4919-a614-b752a66a1a62 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:35.260763 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a362efe9-1e53-4729-8f03-a5b13267d263 tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c/action" status: 202 len: 0 microversion: 2.1 time: 0.371570 Sep 24 20:54:35.264652 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 738/1526] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:54:34 2022] POST /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c/action => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:54:35.521841 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dec015f0-1b0e-4b50-802c-556f9a7d521c tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:35.522576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-dec015f0-1b0e-4b50-802c-556f9a7d521c tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] [instance: 5b64767b-17e8-41e8-af3f-3367b554bd5b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:35.529051 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-dec015f0-1b0e-4b50-802c-556f9a7d521c tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] HTTP exception thrown: Instance 5b64767b-17e8-41e8-af3f-3367b554bd5b could not be found. Sep 24 20:54:35.532319 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dec015f0-1b0e-4b50-802c-556f9a7d521c tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Request method failure captured: Sep 24 20:54:35.532319 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/servers/5b64767b-17e8-41e8-af3f-3367b554bd5b/action HTTP/1.1 Sep 24 20:54:35.532319 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:54:35.532319 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:54:35.532319 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:54:35.532319 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 15 Sep 24 20:54:35.532319 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:54:35.532319 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:54:35.532319 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:54:35.532319 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:54:35.532319 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL25oIqd747e9fbagI6ED8nyM3TOWLHa-g1g46goDq85Uditncnv0xsnxxC-SPejnI_djyhzIxmBSxR9VqfpGTibI_9QLNATzVURtv1UlKOp0qlT0BUtBv3nRt5zRz1lIlMgOD-eEdP5st646P9J7eL3v4obHWj9qf3LCKq_dKGHlSP0 Sep 24 20:54:35.532319 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:54:35.532319 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:54:35.532319 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:54:35.532319 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:54:35.532319 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:54:35.532319 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:54:35.532319 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 2464ee933b394763a0135453d1072a2d Sep 24 20:54:35.532319 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1125222510 Sep 24 20:54:35.532319 ncdv-master-1 devstack@n-api.service[140516]: X-Role: admin,reader,member Sep 24 20:54:35.532319 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: admin,reader,member Sep 24 20:54:35.534994 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2464ee933b394763a0135453d1072a2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2464ee933b394763a0135453d1072a2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2464ee933b394763a0135453d1072a2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2464ee933b394763a0135453d1072a2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:54:35.534994 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1125222510 Sep 24 20:54:35.534994 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 2464ee933b394763a0135453d1072a2d Sep 24 20:54:35.534994 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1125222510 Sep 24 20:54:35.534994 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersAdminNegativeTestJSON-1125222510-project-admin Sep 24 20:54:35.534994 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:54:35.534994 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:54:35.534994 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 0f596f58695644da8f20168715392c49 Sep 24 20:54:35.534994 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1125222510-project-admin Sep 24 20:54:35.534994 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 20:54:35.534994 ncdv-master-1 devstack@n-api.service[140516]: {"migrate": {}} Sep 24 20:54:35.534994 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:54:35.534994 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 5b64767b-17e8-41e8-af3f-3367b554bd5b could not be found. Sep 24 20:54:35.536045 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '5b64767b-17e8-41e8-af3f-3367b554bd5b', 'body': {'migrate': {}}} Sep 24 20:54:35.536045 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:54:35.536045 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:35.536045 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:54:35.536045 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:54:35.536045 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:54:35.536045 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:54:35.536045 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 24 20:54:35.536045 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 24 20:54:35.536045 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b64767b-17e8-41e8-af3f-3367b554bd5b could not be found. Sep 24 20:54:35.536045 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:35.536045 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:54:35.536045 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:35.536045 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:35.536045 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:54:35.536045 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:54:35.536045 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:54:35.536045 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:54:35.536045 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:54:35.536045 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:54:35.537693 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:54:35.537693 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:54:35.537693 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Sep 24 20:54:35.537693 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Sep 24 20:54:35.537693 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:54:35.537693 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:54:35.537693 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b64767b-17e8-41e8-af3f-3367b554bd5b could not be found. Sep 24 20:54:35.537693 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:35.537693 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:54:35.537693 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:35.537693 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:35.537693 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:54:35.537693 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:54:35.537693 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:54:35.537693 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:54:35.537693 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b64767b-17e8-41e8-af3f-3367b554bd5b could not be found. Sep 24 20:54:35.537693 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:35.538915 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dec015f0-1b0e-4b50-802c-556f9a7d521c tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Returning 404 to user: Instance 5b64767b-17e8-41e8-af3f-3367b554bd5b could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:54:35.538915 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-dec015f0-1b0e-4b50-802c-556f9a7d521c tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/5b64767b-17e8-41e8-af3f-3367b554bd5b/action" status: 404 len: 111 microversion: 2.1 time: 0.271778 Sep 24 20:54:35.539773 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 739/1527] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:54:35 2022] POST /compute/v2.1/servers/5b64767b-17e8-41e8-af3f-3367b554bd5b/action => generated 111 bytes in 277 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:54:35.544727 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9969c864-a48e-41ce-bd18-5218f9ddd525 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b0cacba60>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:35.673176 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9969c864-a48e-41ce-bd18-5218f9ddd525 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913" status: 200 len: 1421 microversion: 2.1 time: 0.132125 Sep 24 20:54:35.673938 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 740/1528] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:54:35 2022] GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913 => generated 1421 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:35.913671 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4d17b0fb-8749-4919-a614-b752a66a1a62 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:35.932765 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bd61d3f9-a403-4dbc-ad6a-68516b24c3d3 tempest-FlavorsV255TestJSON-1584029735 tempest-FlavorsV255TestJSON-1584029735-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:35.938793 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4d17b0fb-8749-4919-a614-b752a66a1a62 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:35.947495 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bd61d3f9-a403-4dbc-ad6a-68516b24c3d3 tempest-FlavorsV255TestJSON-1584029735 tempest-FlavorsV255TestJSON-1584029735-project] 10.222.0.52 "GET /compute/v2.1/flavors/1003397772" status: 200 len: 448 microversion: 2.55 time: 0.269385 Sep 24 20:54:35.950755 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 741/1529] 10.222.0.52 () {60 vars in 1199 bytes} [Sat Sep 24 20:54:35 2022] GET /compute/v2.1/flavors/1003397772 => generated 448 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:54:35.952537 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4d17b0fb-8749-4919-a614-b752a66a1a62 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:35.957971 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4d17b0fb-8749-4919-a614-b752a66a1a62 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1409 microversion: 2.25 time: 0.783145 Sep 24 20:54:35.959044 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 789/1530] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:54:35 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1409 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:54:35.972227 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8e260a2f-e3da-4565-ac92-d7a628ab7d55 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:35.974293 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8e260a2f-e3da-4565-ac92-d7a628ab7d55 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:35.977907 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f6218447-9ecb-4198-ab0f-84f2eb92518d tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:35.978996 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f6218447-9ecb-4198-ab0f-84f2eb92518d tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] [instance: 5fc32d38-e9c2-4a92-a346-622b7b7206fd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:35.995567 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6218447-9ecb-4198-ab0f-84f2eb92518d tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:35.997373 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6218447-9ecb-4198-ab0f-84f2eb92518d tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:35.998340 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6218447-9ecb-4198-ab0f-84f2eb92518d tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:36.001733 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8e260a2f-e3da-4565-ac92-d7a628ab7d55 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:36.003874 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6218447-9ecb-4198-ab0f-84f2eb92518d tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:36.004587 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6218447-9ecb-4198-ab0f-84f2eb92518d tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:36.004775 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8e260a2f-e3da-4565-ac92-d7a628ab7d55 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:36.005244 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8e260a2f-e3da-4565-ac92-d7a628ab7d55 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:36.005540 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6218447-9ecb-4198-ab0f-84f2eb92518d tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:36.006000 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8e260a2f-e3da-4565-ac92-d7a628ab7d55 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:36.006454 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8e260a2f-e3da-4565-ac92-d7a628ab7d55 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:36.006920 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8e260a2f-e3da-4565-ac92-d7a628ab7d55 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:36.495850 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f6218447-9ecb-4198-ab0f-84f2eb92518d tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab2b6bf40594154a6340d5afd02da0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc5dc16f54e4d2991a2b456216459a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:36.505020 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f6218447-9ecb-4198-ab0f-84f2eb92518d tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc32d38-e9c2-4a92-a346-622b7b7206fd" status: 200 len: 1351 microversion: 2.1 time: 0.540892 Sep 24 20:54:36.509535 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 790/1531] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:35 2022] GET /compute/v2.1/servers/5fc32d38-e9c2-4a92-a346-622b7b7206fd => generated 1351 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:36.541618 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-6e8843e9-ce19-4319-b6ee-8e8d2fe8dff8 req-bad4db4e-31e9-44a7-a1ae-3287a25da26c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e72414b7-9fb5-4059-92fe-46b1780543f3", "tag": "3c7dbe37-1536-469e-b3d7-785af8945b6a"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:36.562687 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6e8843e9-ce19-4319-b6ee-8e8d2fe8dff8 req-bad4db4e-31e9-44a7-a1ae-3287a25da26c service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:36.563183 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6e8843e9-ce19-4319-b6ee-8e8d2fe8dff8 req-bad4db4e-31e9-44a7-a1ae-3287a25da26c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:36.563630 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6e8843e9-ce19-4319-b6ee-8e8d2fe8dff8 req-bad4db4e-31e9-44a7-a1ae-3287a25da26c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:36.582992 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-6e8843e9-ce19-4319-b6ee-8e8d2fe8dff8 req-bad4db4e-31e9-44a7-a1ae-3287a25da26c service nova] Creating event network-changed:3c7dbe37-1536-469e-b3d7-785af8945b6a for instance e72414b7-9fb5-4059-92fe-46b1780543f3 on nch2-master-1 Sep 24 20:54:36.584196 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8e260a2f-e3da-4565-ac92-d7a628ab7d55 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:36.589695 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-6e8843e9-ce19-4319-b6ee-8e8d2fe8dff8 req-bad4db4e-31e9-44a7-a1ae-3287a25da26c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060050 Sep 24 20:54:36.591003 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 791/1532] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:54:36.597273 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8e260a2f-e3da-4565-ac92-d7a628ab7d55 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1470 microversion: 2.1 time: 0.643457 Sep 24 20:54:36.598850 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 742/1533] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:35 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1470 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:36.599411 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bb858bff-376e-4b40-a084-5b73f8939ea8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:36.600614 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bb858bff-376e-4b40-a084-5b73f8939ea8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:36.602940 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:54:36.605486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c262d5cc-7ebd-48d0-9025-8ed982531828 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1962603186", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:36.609694 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb858bff-376e-4b40-a084-5b73f8939ea8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:36.610780 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb858bff-376e-4b40-a084-5b73f8939ea8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:36.611458 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb858bff-376e-4b40-a084-5b73f8939ea8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:36.613071 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb858bff-376e-4b40-a084-5b73f8939ea8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:36.613778 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb858bff-376e-4b40-a084-5b73f8939ea8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:36.614378 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb858bff-376e-4b40-a084-5b73f8939ea8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:36.715420 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-c262d5cc-7ebd-48d0-9025-8ed982531828 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] validate_networks() for None {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:54:37.054772 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bb858bff-376e-4b40-a084-5b73f8939ea8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:37.067884 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bb858bff-376e-4b40-a084-5b73f8939ea8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1715 microversion: 2.1 time: 0.475141 Sep 24 20:54:37.069538 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 792/1534] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:36 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1715 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:37.078052 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ae450aae-333c-44d6-8efa-08b88925c531 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:37.078795 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ae450aae-333c-44d6-8efa-08b88925c531 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a89ef546-702c-4ecd-babc-7d523421339b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:37.078963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=4 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:54:37.100177 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ae450aae-333c-44d6-8efa-08b88925c531 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:37.103016 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ae450aae-333c-44d6-8efa-08b88925c531 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:37.103631 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ae450aae-333c-44d6-8efa-08b88925c531 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:37.104526 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ae450aae-333c-44d6-8efa-08b88925c531 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:37.105669 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ae450aae-333c-44d6-8efa-08b88925c531 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:37.106278 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ae450aae-333c-44d6-8efa-08b88925c531 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:37.251613 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-c262d5cc-7ebd-48d0-9025-8ed982531828 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:54:37.252043 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-c262d5cc-7ebd-48d0-9025-8ed982531828 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:54:37.252528 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-c262d5cc-7ebd-48d0-9025-8ed982531828 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:54:37.253368 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-c262d5cc-7ebd-48d0-9025-8ed982531828 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:54:37.254719 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-c262d5cc-7ebd-48d0-9025-8ed982531828 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:54:37.288238 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c262d5cc-7ebd-48d0-9025-8ed982531828 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:37.288794 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c262d5cc-7ebd-48d0-9025-8ed982531828 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:37.289254 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c262d5cc-7ebd-48d0-9025-8ed982531828 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:37.290059 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c262d5cc-7ebd-48d0-9025-8ed982531828 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:37.290717 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c262d5cc-7ebd-48d0-9025-8ed982531828 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:37.291161 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c262d5cc-7ebd-48d0-9025-8ed982531828 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:37.326165 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-c262d5cc-7ebd-48d0-9025-8ed982531828 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Getting quotas for project 4b55ef17d925408093f5407fa8015787. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:54:37.335888 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-c262d5cc-7ebd-48d0-9025-8ed982531828 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Getting quotas for user 2844f27200534323910d80cd869a6601 and project 4b55ef17d925408093f5407fa8015787. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:54:37.338022 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ae450aae-333c-44d6-8efa-08b88925c531 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:37.354175 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c262d5cc-7ebd-48d0-9025-8ed982531828 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:54:37.357042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c262d5cc-7ebd-48d0-9025-8ed982531828 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 074c501c-cdef-4f19-81e5-8fc2608e9dd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:54:37.375031 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ae450aae-333c-44d6-8efa-08b88925c531 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b" status: 200 len: 1316 microversion: 2.1 time: 0.297711 Sep 24 20:54:37.394976 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 793/1535] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:37 2022] GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b => generated 1316 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:37.406654 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-109d8a4f-8bba-45d5-9d08-2e1576b813e6 tempest-FlavorsV255TestJSON-1693519675 tempest-FlavorsV255TestJSON-1693519675-project-admin] Action: 'update', calling method: .version_select at 0x7f4b0e4fd940>, body: {"flavor": {"description": "new"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:37.513206 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c262d5cc-7ebd-48d0-9025-8ed982531828 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.908679 Sep 24 20:54:37.523121 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 743/1536] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:54:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:54:37.535849 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-f0df033a-7ec6-4662-8518-a1934f1c0149 req-8d86bd68-7cbd-4793-b657-905a244316eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a89ef546-702c-4ecd-babc-7d523421339b", "name": "network-vif-plugged", "status": "completed", "tag": "fa4b4cb0-8e47-43ef-bbc3-afdd2366b28f"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:37.556667 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-109d8a4f-8bba-45d5-9d08-2e1576b813e6 tempest-FlavorsV255TestJSON-1693519675 tempest-FlavorsV255TestJSON-1693519675-project-admin] 10.222.0.52 "PUT /compute/v2.1/flavors/1003397772" status: 200 len: 449 microversion: 2.55 time: 0.160479 Sep 24 20:54:37.557282 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 794/1537] 10.222.0.52 () {62 vars in 1219 bytes} [Sat Sep 24 20:54:37 2022] PUT /compute/v2.1/flavors/1003397772 => generated 449 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:54:37.564291 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-f0df033a-7ec6-4662-8518-a1934f1c0149 req-8d86bd68-7cbd-4793-b657-905a244316eb service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:37.566966 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-f0df033a-7ec6-4662-8518-a1934f1c0149 req-8d86bd68-7cbd-4793-b657-905a244316eb service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:37.567331 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-87c0b50f-5752-4350-b42d-47903cf226fc tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b1104c280>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:37.567806 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-f0df033a-7ec6-4662-8518-a1934f1c0149 req-8d86bd68-7cbd-4793-b657-905a244316eb service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:37.585806 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-f0df033a-7ec6-4662-8518-a1934f1c0149 req-8d86bd68-7cbd-4793-b657-905a244316eb service nova] Creating event network-vif-plugged:fa4b4cb0-8e47-43ef-bbc3-afdd2366b28f for instance a89ef546-702c-4ecd-babc-7d523421339b on nch1-master-1 Sep 24 20:54:37.605700 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-f0df033a-7ec6-4662-8518-a1934f1c0149 req-8d86bd68-7cbd-4793-b657-905a244316eb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079986 Sep 24 20:54:37.610680 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 744/1538] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:54:37.617998 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b10d81d4-2b73-4c17-bd78-fdc240abfa34 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:37.618910 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b10d81d4-2b73-4c17-bd78-fdc240abfa34 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:37.637025 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b10d81d4-2b73-4c17-bd78-fdc240abfa34 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:37.638366 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b10d81d4-2b73-4c17-bd78-fdc240abfa34 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:37.639248 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b10d81d4-2b73-4c17-bd78-fdc240abfa34 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:37.640242 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b10d81d4-2b73-4c17-bd78-fdc240abfa34 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:37.641178 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b10d81d4-2b73-4c17-bd78-fdc240abfa34 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:37.641784 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b10d81d4-2b73-4c17-bd78-fdc240abfa34 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:37.703798 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-87c0b50f-5752-4350-b42d-47903cf226fc tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913" status: 200 len: 1421 microversion: 2.1 time: 0.142840 Sep 24 20:54:37.704385 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 795/1539] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:54:37 2022] GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913 => generated 1421 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:37.710382 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f74f7621-2247-48c3-9da4-8e1ebcb3eec9 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:37.714812 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f74f7621-2247-48c3-9da4-8e1ebcb3eec9 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 074c501c-cdef-4f19-81e5-8fc2608e9dd1] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:38.123163 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f74f7621-2247-48c3-9da4-8e1ebcb3eec9 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:38.132959 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b10d81d4-2b73-4c17-bd78-fdc240abfa34 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:38.134547 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f74f7621-2247-48c3-9da4-8e1ebcb3eec9 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1" status: 200 len: 1222 microversion: 2.1 time: 0.428898 Sep 24 20:54:38.146629 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 796/1540] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:37 2022] GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1 => generated 1222 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:38.149757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-72079970-424f-4436-8ac4-a188c4ff4347 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:38.149757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-72079970-424f-4436-8ac4-a188c4ff4347 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] [instance: 5fc32d38-e9c2-4a92-a346-622b7b7206fd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:38.160981 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-72079970-424f-4436-8ac4-a188c4ff4347 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:38.161486 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-72079970-424f-4436-8ac4-a188c4ff4347 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:38.161930 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-72079970-424f-4436-8ac4-a188c4ff4347 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:38.162971 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-72079970-424f-4436-8ac4-a188c4ff4347 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:38.163434 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-72079970-424f-4436-8ac4-a188c4ff4347 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:38.164066 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-72079970-424f-4436-8ac4-a188c4ff4347 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:38.186518 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b10d81d4-2b73-4c17-bd78-fdc240abfa34 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:38.194464 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b10d81d4-2b73-4c17-bd78-fdc240abfa34 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:38.215897 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b10d81d4-2b73-4c17-bd78-fdc240abfa34 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1605 microversion: 2.25 time: 0.583718 Sep 24 20:54:38.217071 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 745/1541] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:54:37 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1605 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:54:38.222561 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1f3f5b57-a557-4d06-b7fd-ef3bb9aa5993 tempest-FlavorsV255TestJSON-1584029735 tempest-FlavorsV255TestJSON-1584029735-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:38.364973 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1f3f5b57-a557-4d06-b7fd-ef3bb9aa5993 tempest-FlavorsV255TestJSON-1584029735 tempest-FlavorsV255TestJSON-1584029735-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5724 microversion: 2.55 time: 0.137872 Sep 24 20:54:38.364973 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 746/1542] 10.222.0.52 () {60 vars in 1187 bytes} [Sat Sep 24 20:54:38 2022] GET /compute/v2.1/flavors/detail => generated 5724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:54:38.396817 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a833124f-3f64-422a-a9c5-74867d6e8f1d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:38.407148 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a833124f-3f64-422a-a9c5-74867d6e8f1d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:38.435512 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a833124f-3f64-422a-a9c5-74867d6e8f1d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:38.441234 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a833124f-3f64-422a-a9c5-74867d6e8f1d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:38.441962 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a833124f-3f64-422a-a9c5-74867d6e8f1d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:38.461158 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a833124f-3f64-422a-a9c5-74867d6e8f1d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:38.464008 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a833124f-3f64-422a-a9c5-74867d6e8f1d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:38.468496 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a833124f-3f64-422a-a9c5-74867d6e8f1d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:38.618679 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-72079970-424f-4436-8ac4-a188c4ff4347 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab2b6bf40594154a6340d5afd02da0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc5dc16f54e4d2991a2b456216459a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:38.634081 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-72079970-424f-4436-8ac4-a188c4ff4347 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc32d38-e9c2-4a92-a346-622b7b7206fd" status: 200 len: 1351 microversion: 2.1 time: 0.496678 Sep 24 20:54:38.635565 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 797/1543] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:38 2022] GET /compute/v2.1/servers/5fc32d38-e9c2-4a92-a346-622b7b7206fd => generated 1351 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:38.640961 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a71956f3-5887-4f8f-bef0-1428d07f7133 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:38.642089 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a71956f3-5887-4f8f-bef0-1428d07f7133 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:38.668094 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a71956f3-5887-4f8f-bef0-1428d07f7133 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:38.669037 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a71956f3-5887-4f8f-bef0-1428d07f7133 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:38.670852 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a71956f3-5887-4f8f-bef0-1428d07f7133 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:38.673706 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a71956f3-5887-4f8f-bef0-1428d07f7133 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:38.674387 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a71956f3-5887-4f8f-bef0-1428d07f7133 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:38.678148 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a71956f3-5887-4f8f-bef0-1428d07f7133 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:38.705451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a833124f-3f64-422a-a9c5-74867d6e8f1d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:38.714855 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a833124f-3f64-422a-a9c5-74867d6e8f1d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1470 microversion: 2.1 time: 0.349081 Sep 24 20:54:38.727490 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 747/1544] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:38 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1470 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:38.732763 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f1a3fb42-d32b-40c7-b0c7-8fb912d2e079 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:38.733269 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f1a3fb42-d32b-40c7-b0c7-8fb912d2e079 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:38.752282 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1a3fb42-d32b-40c7-b0c7-8fb912d2e079 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:38.753301 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1a3fb42-d32b-40c7-b0c7-8fb912d2e079 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:38.753756 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1a3fb42-d32b-40c7-b0c7-8fb912d2e079 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:38.754472 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1a3fb42-d32b-40c7-b0c7-8fb912d2e079 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:38.755549 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1a3fb42-d32b-40c7-b0c7-8fb912d2e079 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:38.755992 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1a3fb42-d32b-40c7-b0c7-8fb912d2e079 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:38.904329 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f1a3fb42-d32b-40c7-b0c7-8fb912d2e079 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.175524 Sep 24 20:54:38.905440 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 748/1545] 10.222.0.52 () {60 vars in 1316 bytes} [Sat Sep 24 20:54:38 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-interface => generated 284 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:54:38.910417 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-32a3ad73-55bc-4d3e-ab50-f6aab3fab564 tempest-FlavorsV255TestJSON-1584029735 tempest-FlavorsV255TestJSON-1584029735-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:38.965713 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-32a3ad73-55bc-4d3e-ab50-f6aab3fab564 tempest-FlavorsV255TestJSON-1584029735 tempest-FlavorsV255TestJSON-1584029735-project] 10.222.0.52 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.55 time: 0.058898 Sep 24 20:54:38.967033 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 749/1546] 10.222.0.52 () {60 vars in 1166 bytes} [Sat Sep 24 20:54:38 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:54:38.975060 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1aaf552c-e843-40c2-bb18-cd60aa6f1910 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:38.975684 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1aaf552c-e843-40c2-bb18-cd60aa6f1910 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a89ef546-702c-4ecd-babc-7d523421339b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:38.984791 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1aaf552c-e843-40c2-bb18-cd60aa6f1910 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:38.985341 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1aaf552c-e843-40c2-bb18-cd60aa6f1910 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:38.986063 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1aaf552c-e843-40c2-bb18-cd60aa6f1910 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:38.986896 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1aaf552c-e843-40c2-bb18-cd60aa6f1910 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:38.988572 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1aaf552c-e843-40c2-bb18-cd60aa6f1910 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:38.989010 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1aaf552c-e843-40c2-bb18-cd60aa6f1910 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:39.004153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a71956f3-5887-4f8f-bef0-1428d07f7133 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:39.020649 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a71956f3-5887-4f8f-bef0-1428d07f7133 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1715 microversion: 2.1 time: 0.382968 Sep 24 20:54:39.034870 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 798/1547] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:38 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1715 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:39.043410 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-7f8593ff-91a7-455a-af6d-6f65fc390757 req-b1c6b01e-3bca-4b9f-8097-bfb2262d4133 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fc32d38-e9c2-4a92-a346-622b7b7206fd", "tag": "ae80193f-701b-44ae-b340-65e79cdd45ec"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:39.054653 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-7f8593ff-91a7-455a-af6d-6f65fc390757 req-b1c6b01e-3bca-4b9f-8097-bfb2262d4133 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:39.055514 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-7f8593ff-91a7-455a-af6d-6f65fc390757 req-b1c6b01e-3bca-4b9f-8097-bfb2262d4133 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:39.056181 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-7f8593ff-91a7-455a-af6d-6f65fc390757 req-b1c6b01e-3bca-4b9f-8097-bfb2262d4133 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:39.070837 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-7f8593ff-91a7-455a-af6d-6f65fc390757 req-b1c6b01e-3bca-4b9f-8097-bfb2262d4133 service nova] Creating event network-changed:ae80193f-701b-44ae-b340-65e79cdd45ec for instance 5fc32d38-e9c2-4a92-a346-622b7b7206fd on nch2-master-1 Sep 24 20:54:39.077286 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-7f8593ff-91a7-455a-af6d-6f65fc390757 req-b1c6b01e-3bca-4b9f-8097-bfb2262d4133 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040717 Sep 24 20:54:39.078587 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 799/1548] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:54:39.085160 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-76509c38-32b2-4827-be48-fe749b8808f1 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b1104caf0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:39.162425 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-76509c38-32b2-4827-be48-fe749b8808f1 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913" status: 200 len: 1421 microversion: 2.1 time: 0.082192 Sep 24 20:54:39.163990 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 800/1549] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:54:39 2022] GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913 => generated 1421 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:39.171186 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1059bcf7-36e5-4ba2-93aa-06a1beb1075d tempest-FlavorsV255TestJSON-1693519675 tempest-FlavorsV255TestJSON-1693519675-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:39.204449 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1059bcf7-36e5-4ba2-93aa-06a1beb1075d tempest-FlavorsV255TestJSON-1693519675 tempest-FlavorsV255TestJSON-1693519675-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1003397772" status: 202 len: 0 microversion: 2.55 time: 0.038907 Sep 24 20:54:39.206957 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 801/1550] 10.222.0.52 () {60 vars in 1202 bytes} [Sat Sep 24 20:54:39 2022] DELETE /compute/v2.1/flavors/1003397772 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:54:39.220913 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5ab5abcc-ea7d-4535-9b20-672116c61600 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:39.222558 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5ab5abcc-ea7d-4535-9b20-672116c61600 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 074c501c-cdef-4f19-81e5-8fc2608e9dd1] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:39.230837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ab5abcc-ea7d-4535-9b20-672116c61600 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:39.232897 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ab5abcc-ea7d-4535-9b20-672116c61600 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:39.233584 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ab5abcc-ea7d-4535-9b20-672116c61600 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:39.234710 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ab5abcc-ea7d-4535-9b20-672116c61600 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:39.235402 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ab5abcc-ea7d-4535-9b20-672116c61600 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:39.236138 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ab5abcc-ea7d-4535-9b20-672116c61600 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:39.275781 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1aaf552c-e843-40c2-bb18-cd60aa6f1910 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:39.293507 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1aaf552c-e843-40c2-bb18-cd60aa6f1910 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b" status: 200 len: 1316 microversion: 2.1 time: 0.323137 Sep 24 20:54:39.294469 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 750/1551] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:38 2022] GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b => generated 1316 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:39.299932 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b95a50ae-74fc-4a44-9209-2998b13f57cf tempest-FlavorsV255TestJSON-1693519675 tempest-FlavorsV255TestJSON-1693519675-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:39.325500 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b95a50ae-74fc-4a44-9209-2998b13f57cf tempest-FlavorsV255TestJSON-1693519675 tempest-FlavorsV255TestJSON-1693519675-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.029677 Sep 24 20:54:39.334885 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 751/1552] 10.222.0.52 () {60 vars in 1187 bytes} [Sat Sep 24 20:54:39 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:54:39.359087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5ab5abcc-ea7d-4535-9b20-672116c61600 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:39.368352 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5ab5abcc-ea7d-4535-9b20-672116c61600 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1" status: 200 len: 1218 microversion: 2.1 time: 0.159387 Sep 24 20:54:39.368953 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 802/1553] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:39 2022] GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1 => generated 1218 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:39.661943 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-84af7dda-e553-429a-8d33-c3bcf1eb8fe6 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:39.662772 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-84af7dda-e553-429a-8d33-c3bcf1eb8fe6 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] [instance: 5fc32d38-e9c2-4a92-a346-622b7b7206fd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:39.671624 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-84af7dda-e553-429a-8d33-c3bcf1eb8fe6 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:39.673557 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-84af7dda-e553-429a-8d33-c3bcf1eb8fe6 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:39.677622 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-84af7dda-e553-429a-8d33-c3bcf1eb8fe6 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:39.682394 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-84af7dda-e553-429a-8d33-c3bcf1eb8fe6 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:39.684426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-84af7dda-e553-429a-8d33-c3bcf1eb8fe6 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:39.686078 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-84af7dda-e553-429a-8d33-c3bcf1eb8fe6 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:39.766785 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c0d6bc89-48d8-4090-a80f-53ab0d0e9a75 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:39.768821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c0d6bc89-48d8-4090-a80f-53ab0d0e9a75 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:39.798016 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0d6bc89-48d8-4090-a80f-53ab0d0e9a75 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:39.799526 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0d6bc89-48d8-4090-a80f-53ab0d0e9a75 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:39.801021 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0d6bc89-48d8-4090-a80f-53ab0d0e9a75 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:39.801831 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0d6bc89-48d8-4090-a80f-53ab0d0e9a75 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:39.802481 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0d6bc89-48d8-4090-a80f-53ab0d0e9a75 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:39.805510 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0d6bc89-48d8-4090-a80f-53ab0d0e9a75 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:39.974854 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-84af7dda-e553-429a-8d33-c3bcf1eb8fe6 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab2b6bf40594154a6340d5afd02da0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc5dc16f54e4d2991a2b456216459a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:39.984747 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-84af7dda-e553-429a-8d33-c3bcf1eb8fe6 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc32d38-e9c2-4a92-a346-622b7b7206fd" status: 200 len: 1351 microversion: 2.1 time: 0.328584 Sep 24 20:54:40.001362 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 752/1554] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:39 2022] GET /compute/v2.1/servers/5fc32d38-e9c2-4a92-a346-622b7b7206fd => generated 1351 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:40.039217 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c0d6bc89-48d8-4090-a80f-53ab0d0e9a75 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:40.051439 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b5546f58-8deb-419d-a9bd-576a4c822a26 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:40.052076 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b5546f58-8deb-419d-a9bd-576a4c822a26 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:40.053181 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c0d6bc89-48d8-4090-a80f-53ab0d0e9a75 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1470 microversion: 2.1 time: 0.294288 Sep 24 20:54:40.054485 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 803/1555] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:39 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1470 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:40.062229 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5546f58-8deb-419d-a9bd-576a4c822a26 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:40.063256 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5546f58-8deb-419d-a9bd-576a4c822a26 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:40.063519 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5546f58-8deb-419d-a9bd-576a4c822a26 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:40.064426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5546f58-8deb-419d-a9bd-576a4c822a26 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:40.064928 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5546f58-8deb-419d-a9bd-576a4c822a26 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:40.065972 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5546f58-8deb-419d-a9bd-576a4c822a26 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:40.181584 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-92e286d1-adbe-43e1-aa7e-8b87daef39d9 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b1100a5e0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:40.256852 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b5546f58-8deb-419d-a9bd-576a4c822a26 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:40.270151 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b5546f58-8deb-419d-a9bd-576a4c822a26 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1715 microversion: 2.1 time: 0.223617 Sep 24 20:54:40.280397 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 753/1556] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:40 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1715 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:40.289903 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-92e286d1-adbe-43e1-aa7e-8b87daef39d9 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913" status: 200 len: 1421 microversion: 2.1 time: 0.113367 Sep 24 20:54:40.291406 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 804/1557] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:54:40 2022] GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913 => generated 1421 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:54:40.322359 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-07a8280c-feb5-4bd9-9b28-b4f27a73f70e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:40.323353 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-07a8280c-feb5-4bd9-9b28-b4f27a73f70e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a89ef546-702c-4ecd-babc-7d523421339b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:40.334445 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07a8280c-feb5-4bd9-9b28-b4f27a73f70e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:40.334972 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07a8280c-feb5-4bd9-9b28-b4f27a73f70e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:40.335414 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07a8280c-feb5-4bd9-9b28-b4f27a73f70e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:40.336124 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07a8280c-feb5-4bd9-9b28-b4f27a73f70e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:40.336585 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07a8280c-feb5-4bd9-9b28-b4f27a73f70e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:40.337014 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07a8280c-feb5-4bd9-9b28-b4f27a73f70e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:40.397008 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a3016c0d-d214-42f8-a0f3-70a42229de6f tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:40.397632 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a3016c0d-d214-42f8-a0f3-70a42229de6f tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 074c501c-cdef-4f19-81e5-8fc2608e9dd1] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:40.414949 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a3016c0d-d214-42f8-a0f3-70a42229de6f tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:40.419145 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a3016c0d-d214-42f8-a0f3-70a42229de6f tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:40.419609 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a3016c0d-d214-42f8-a0f3-70a42229de6f tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:40.420417 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a3016c0d-d214-42f8-a0f3-70a42229de6f tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:40.421445 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a3016c0d-d214-42f8-a0f3-70a42229de6f tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:40.421888 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a3016c0d-d214-42f8-a0f3-70a42229de6f tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:40.536226 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a3016c0d-d214-42f8-a0f3-70a42229de6f tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:40.556275 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a3016c0d-d214-42f8-a0f3-70a42229de6f tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1" status: 200 len: 1274 microversion: 2.1 time: 0.164764 Sep 24 20:54:40.560009 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 805/1558] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:40 2022] GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1 => generated 1274 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:54:40.584517 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-07a8280c-feb5-4bd9-9b28-b4f27a73f70e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:40.594106 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-07a8280c-feb5-4bd9-9b28-b4f27a73f70e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b" status: 200 len: 1316 microversion: 2.1 time: 0.276674 Sep 24 20:54:40.614614 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 754/1559] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:40 2022] GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b => generated 1316 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:41.011635 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-62aab8e8-704c-4454-8fc6-a6029637ba6b tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:41.012716 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-62aab8e8-704c-4454-8fc6-a6029637ba6b tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] [instance: 5fc32d38-e9c2-4a92-a346-622b7b7206fd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:41.032369 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62aab8e8-704c-4454-8fc6-a6029637ba6b tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:41.033128 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62aab8e8-704c-4454-8fc6-a6029637ba6b tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:41.033758 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62aab8e8-704c-4454-8fc6-a6029637ba6b tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:41.035093 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62aab8e8-704c-4454-8fc6-a6029637ba6b tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:41.035550 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62aab8e8-704c-4454-8fc6-a6029637ba6b tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:41.035986 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62aab8e8-704c-4454-8fc6-a6029637ba6b tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:41.083312 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-649ae3b4-5e5c-4226-9c26-f3fe9526871d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:41.088170 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-649ae3b4-5e5c-4226-9c26-f3fe9526871d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:41.110281 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-649ae3b4-5e5c-4226-9c26-f3fe9526871d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:41.112451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-649ae3b4-5e5c-4226-9c26-f3fe9526871d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:41.123506 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-649ae3b4-5e5c-4226-9c26-f3fe9526871d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:41.126945 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-649ae3b4-5e5c-4226-9c26-f3fe9526871d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:41.129796 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-649ae3b4-5e5c-4226-9c26-f3fe9526871d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:41.131913 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-649ae3b4-5e5c-4226-9c26-f3fe9526871d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:41.555823 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-62aab8e8-704c-4454-8fc6-a6029637ba6b tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab2b6bf40594154a6340d5afd02da0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc5dc16f54e4d2991a2b456216459a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:41.569051 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-62aab8e8-704c-4454-8fc6-a6029637ba6b tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc32d38-e9c2-4a92-a346-622b7b7206fd" status: 200 len: 1351 microversion: 2.1 time: 0.563683 Sep 24 20:54:41.575426 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 806/1560] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:41 2022] GET /compute/v2.1/servers/5fc32d38-e9c2-4a92-a346-622b7b7206fd => generated 1351 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:41.586481 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-ffc9a6b7-67e4-4edd-a380-a0b08593bd0e req-be479e1c-d920-4140-9b99-870d168bbb8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54ec06be-cb4b-4b5f-9ed8-904a328cc118", "tag": "f450a593-c9dc-4f8e-8acb-60edeb836cea"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:41.610485 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-649ae3b4-5e5c-4226-9c26-f3fe9526871d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:41.616516 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-ffc9a6b7-67e4-4edd-a380-a0b08593bd0e req-be479e1c-d920-4140-9b99-870d168bbb8c service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:41.617217 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-ffc9a6b7-67e4-4edd-a380-a0b08593bd0e req-be479e1c-d920-4140-9b99-870d168bbb8c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:41.617650 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-ffc9a6b7-67e4-4edd-a380-a0b08593bd0e req-be479e1c-d920-4140-9b99-870d168bbb8c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:41.628750 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-649ae3b4-5e5c-4226-9c26-f3fe9526871d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1470 microversion: 2.1 time: 0.552412 Sep 24 20:54:41.647787 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 755/1561] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:41 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1470 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:41.654762 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-859ac45d-7230-47a3-962f-d2128ec78ab0 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:41.655648 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-859ac45d-7230-47a3-962f-d2128ec78ab0 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:41.664630 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-859ac45d-7230-47a3-962f-d2128ec78ab0 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:41.665958 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-859ac45d-7230-47a3-962f-d2128ec78ab0 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:41.666771 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-859ac45d-7230-47a3-962f-d2128ec78ab0 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:41.667686 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-859ac45d-7230-47a3-962f-d2128ec78ab0 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:41.668310 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-859ac45d-7230-47a3-962f-d2128ec78ab0 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:41.669161 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-ffc9a6b7-67e4-4edd-a380-a0b08593bd0e req-be479e1c-d920-4140-9b99-870d168bbb8c service nova] Creating event network-changed:f450a593-c9dc-4f8e-8acb-60edeb836cea for instance 54ec06be-cb4b-4b5f-9ed8-904a328cc118 on nch1-master-1 Sep 24 20:54:41.669635 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-859ac45d-7230-47a3-962f-d2128ec78ab0 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:41.696159 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-ffc9a6b7-67e4-4edd-a380-a0b08593bd0e req-be479e1c-d920-4140-9b99-870d168bbb8c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115666 Sep 24 20:54:41.701798 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 807/1562] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:54:41.713185 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-56e0101a-b1c1-42f3-9e13-f6fed7a787bd tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b11024670>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:41.740539 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:54:41.794187 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-56e0101a-b1c1-42f3-9e13-f6fed7a787bd tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913" status: 200 len: 1421 microversion: 2.1 time: 0.090800 Sep 24 20:54:41.794806 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 808/1563] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:54:41 2022] GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913 => generated 1421 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:41.808634 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-97a2e420-8c0d-4ed0-90e5-a2e7e7cfe03e tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:41.812964 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-97a2e420-8c0d-4ed0-90e5-a2e7e7cfe03e tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 074c501c-cdef-4f19-81e5-8fc2608e9dd1] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:41.837416 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97a2e420-8c0d-4ed0-90e5-a2e7e7cfe03e tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:41.838438 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97a2e420-8c0d-4ed0-90e5-a2e7e7cfe03e tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:41.839309 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97a2e420-8c0d-4ed0-90e5-a2e7e7cfe03e tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:41.840593 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97a2e420-8c0d-4ed0-90e5-a2e7e7cfe03e tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:41.841335 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97a2e420-8c0d-4ed0-90e5-a2e7e7cfe03e tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:41.842820 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97a2e420-8c0d-4ed0-90e5-a2e7e7cfe03e tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:42.006975 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-97a2e420-8c0d-4ed0-90e5-a2e7e7cfe03e tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:42.021321 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-97a2e420-8c0d-4ed0-90e5-a2e7e7cfe03e tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1" status: 200 len: 1282 microversion: 2.1 time: 0.222548 Sep 24 20:54:42.025121 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 809/1564] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:41 2022] GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1 => generated 1282 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:42.036209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b5e8236d-749f-4515-adcf-c6bd117034ee tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:42.036838 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b5e8236d-749f-4515-adcf-c6bd117034ee tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a89ef546-702c-4ecd-babc-7d523421339b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:42.059042 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b5e8236d-749f-4515-adcf-c6bd117034ee tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:42.059547 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b5e8236d-749f-4515-adcf-c6bd117034ee tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:42.059990 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b5e8236d-749f-4515-adcf-c6bd117034ee tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:42.060703 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b5e8236d-749f-4515-adcf-c6bd117034ee tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:42.061161 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b5e8236d-749f-4515-adcf-c6bd117034ee tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:42.061592 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b5e8236d-749f-4515-adcf-c6bd117034ee tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:42.354806 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-859ac45d-7230-47a3-962f-d2128ec78ab0 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:42.365351 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-859ac45d-7230-47a3-962f-d2128ec78ab0 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1715 microversion: 2.1 time: 0.715946 Sep 24 20:54:42.375927 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 756/1565] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:41 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1715 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:42.504620 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b5e8236d-749f-4515-adcf-c6bd117034ee tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:42.517992 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b5e8236d-749f-4515-adcf-c6bd117034ee tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b" status: 200 len: 1466 microversion: 2.1 time: 0.491757 Sep 24 20:54:42.520609 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 810/1566] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:42 2022] GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b => generated 1466 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:42.546327 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e07dd287-506e-4405-b9ca-d854f9c9c421 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:42.547116 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e07dd287-506e-4405-b9ca-d854f9c9c421 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] [instance: a89ef546-702c-4ecd-babc-7d523421339b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:42.559448 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e07dd287-506e-4405-b9ca-d854f9c9c421 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:42.562401 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e07dd287-506e-4405-b9ca-d854f9c9c421 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:42.563331 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e07dd287-506e-4405-b9ca-d854f9c9c421 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:42.567327 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e07dd287-506e-4405-b9ca-d854f9c9c421 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:42.570216 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e07dd287-506e-4405-b9ca-d854f9c9c421 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:42.570936 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e07dd287-506e-4405-b9ca-d854f9c9c421 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:42.598903 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dd055a2c-709d-4267-b946-5880d5a11f0b tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:42.599530 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dd055a2c-709d-4267-b946-5880d5a11f0b tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] [instance: 5fc32d38-e9c2-4a92-a346-622b7b7206fd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:42.617206 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dd055a2c-709d-4267-b946-5880d5a11f0b tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:42.617716 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dd055a2c-709d-4267-b946-5880d5a11f0b tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:42.627314 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dd055a2c-709d-4267-b946-5880d5a11f0b tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:42.650006 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dd055a2c-709d-4267-b946-5880d5a11f0b tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:42.650624 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dd055a2c-709d-4267-b946-5880d5a11f0b tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:42.651078 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dd055a2c-709d-4267-b946-5880d5a11f0b tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:43.015011 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dd055a2c-709d-4267-b946-5880d5a11f0b tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab2b6bf40594154a6340d5afd02da0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc5dc16f54e4d2991a2b456216459a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:43.031978 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dd055a2c-709d-4267-b946-5880d5a11f0b tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc32d38-e9c2-4a92-a346-622b7b7206fd" status: 200 len: 1351 microversion: 2.1 time: 0.438137 Sep 24 20:54:43.032828 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 811/1567] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:42 2022] GET /compute/v2.1/servers/5fc32d38-e9c2-4a92-a346-622b7b7206fd => generated 1351 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:54:43.051716 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5a8b7eb0-c9be-40b2-941b-ec7d33eafdee tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:43.059619 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5a8b7eb0-c9be-40b2-941b-ec7d33eafdee tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:43.083089 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5a8b7eb0-c9be-40b2-941b-ec7d33eafdee tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:43.083902 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5a8b7eb0-c9be-40b2-941b-ec7d33eafdee tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:43.087028 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5a8b7eb0-c9be-40b2-941b-ec7d33eafdee tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:43.088386 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5a8b7eb0-c9be-40b2-941b-ec7d33eafdee tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:43.094945 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5a8b7eb0-c9be-40b2-941b-ec7d33eafdee tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:43.099284 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5a8b7eb0-c9be-40b2-941b-ec7d33eafdee tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:43.625379 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e07dd287-506e-4405-b9ca-d854f9c9c421 tempest-ServersOnMultiNodesTest-344820995 tempest-ServersOnMultiNodesTest-344820995-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b" status: 200 len: 1617 microversion: 2.1 time: 1.081264 Sep 24 20:54:43.642127 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 757/1568] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:42 2022] GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b => generated 1617 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:43.649204 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-601ec08d-3ace-462b-9083-c817a5786457 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b0cd54430>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:43.748315 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-601ec08d-3ace-462b-9083-c817a5786457 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913" status: 200 len: 1421 microversion: 2.1 time: 0.103358 Sep 24 20:54:43.751384 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 758/1569] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:54:43 2022] GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913 => generated 1421 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:43.765436 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1f300826-cf19-4a92-a923-c676f4122906 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:43.766384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1f300826-cf19-4a92-a923-c676f4122906 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 074c501c-cdef-4f19-81e5-8fc2608e9dd1] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:43.787023 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f300826-cf19-4a92-a923-c676f4122906 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:43.787915 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f300826-cf19-4a92-a923-c676f4122906 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:43.790451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f300826-cf19-4a92-a923-c676f4122906 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:43.793236 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f300826-cf19-4a92-a923-c676f4122906 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:43.793871 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f300826-cf19-4a92-a923-c676f4122906 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:43.794648 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f300826-cf19-4a92-a923-c676f4122906 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:43.823366 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5a8b7eb0-c9be-40b2-941b-ec7d33eafdee tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:43.832641 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5a8b7eb0-c9be-40b2-941b-ec7d33eafdee tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1470 microversion: 2.1 time: 0.798640 Sep 24 20:54:43.836167 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 812/1570] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:43 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1470 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:43.852007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-aa9e05d6-ecca-4ac3-8a09-eef623441681 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:43.852638 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-aa9e05d6-ecca-4ac3-8a09-eef623441681 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:43.858930 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aa9e05d6-ecca-4ac3-8a09-eef623441681 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:43.859630 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aa9e05d6-ecca-4ac3-8a09-eef623441681 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:43.860323 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aa9e05d6-ecca-4ac3-8a09-eef623441681 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:43.861200 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aa9e05d6-ecca-4ac3-8a09-eef623441681 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:43.861918 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aa9e05d6-ecca-4ac3-8a09-eef623441681 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:43.863213 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aa9e05d6-ecca-4ac3-8a09-eef623441681 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:43.985311 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1f300826-cf19-4a92-a923-c676f4122906 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:43.994136 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1f300826-cf19-4a92-a923-c676f4122906 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1" status: 200 len: 1280 microversion: 2.1 time: 0.241463 Sep 24 20:54:43.999628 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 759/1571] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:43 2022] GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1 => generated 1280 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:44.008200 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-85ba2290-b8cf-42be-9960-805f666c9209 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:44.009845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-85ba2290-b8cf-42be-9960-805f666c9209 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a89ef546-702c-4ecd-babc-7d523421339b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:44.026382 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=93,nova_api:DELETE=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:54:44.028457 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-85ba2290-b8cf-42be-9960-805f666c9209 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:44.029298 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-85ba2290-b8cf-42be-9960-805f666c9209 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:44.029961 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-85ba2290-b8cf-42be-9960-805f666c9209 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:44.030951 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-85ba2290-b8cf-42be-9960-805f666c9209 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:44.031671 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-85ba2290-b8cf-42be-9960-805f666c9209 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:44.032331 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-85ba2290-b8cf-42be-9960-805f666c9209 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:44.109343 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-85ba2290-b8cf-42be-9960-805f666c9209 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a89ef546-702c-4ecd-babc-7d523421339b] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:54:44.198997 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:54:44.278846 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-aa9e05d6-ecca-4ac3-8a09-eef623441681 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:44.281639 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:54:44.289956 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-85ba2290-b8cf-42be-9960-805f666c9209 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b" status: 204 len: 0 microversion: 2.1 time: 0.288637 Sep 24 20:54:44.290832 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 760/1572] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:54:43 2022] DELETE /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:54:44.293044 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-aa9e05d6-ecca-4ac3-8a09-eef623441681 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1715 microversion: 2.1 time: 0.453650 Sep 24 20:54:44.306530 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-12300806-af8a-4aec-92de-dc896fc273aa tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:44.306530 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-12300806-af8a-4aec-92de-dc896fc273aa tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] [instance: 5fc32d38-e9c2-4a92-a346-622b7b7206fd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:44.307527 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 813/1573] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:43 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1715 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:44.317827 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e51f59c3-ba35-4d48-8f6e-a75f138e27c8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:44.320329 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-12300806-af8a-4aec-92de-dc896fc273aa tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:44.321001 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e51f59c3-ba35-4d48-8f6e-a75f138e27c8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a89ef546-702c-4ecd-babc-7d523421339b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:44.323301 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-12300806-af8a-4aec-92de-dc896fc273aa tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:44.325543 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-12300806-af8a-4aec-92de-dc896fc273aa tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:44.331110 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-12300806-af8a-4aec-92de-dc896fc273aa tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:44.331110 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-12300806-af8a-4aec-92de-dc896fc273aa tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:44.334148 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e51f59c3-ba35-4d48-8f6e-a75f138e27c8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:44.334808 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-12300806-af8a-4aec-92de-dc896fc273aa tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:44.340256 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e51f59c3-ba35-4d48-8f6e-a75f138e27c8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:44.340989 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e51f59c3-ba35-4d48-8f6e-a75f138e27c8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:44.342021 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e51f59c3-ba35-4d48-8f6e-a75f138e27c8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:44.342674 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e51f59c3-ba35-4d48-8f6e-a75f138e27c8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:44.344157 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e51f59c3-ba35-4d48-8f6e-a75f138e27c8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:44.663198 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-12300806-af8a-4aec-92de-dc896fc273aa tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab2b6bf40594154a6340d5afd02da0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc5dc16f54e4d2991a2b456216459a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:44.689387 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-12300806-af8a-4aec-92de-dc896fc273aa tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc32d38-e9c2-4a92-a346-622b7b7206fd" status: 200 len: 1351 microversion: 2.1 time: 0.397206 Sep 24 20:54:44.694092 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 761/1574] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:44 2022] GET /compute/v2.1/servers/5fc32d38-e9c2-4a92-a346-622b7b7206fd => generated 1351 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:44.766339 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bae44995-1f34-401c-9cf9-f2ec6bcc09c6 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b0c97bd30>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:44.813395 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e51f59c3-ba35-4d48-8f6e-a75f138e27c8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:44.826477 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e51f59c3-ba35-4d48-8f6e-a75f138e27c8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b" status: 200 len: 1472 microversion: 2.1 time: 0.517232 Sep 24 20:54:44.850919 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 814/1575] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:44 2022] GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b => generated 1472 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:44.872096 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bae44995-1f34-401c-9cf9-f2ec6bcc09c6 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913" status: 200 len: 1421 microversion: 2.1 time: 0.110709 Sep 24 20:54:44.882616 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 762/1576] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:54:44 2022] GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913 => generated 1421 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:54:44.882983 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a360f7c8-5e20-4e52-82cc-f37579a08a9f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:44.882983 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a360f7c8-5e20-4e52-82cc-f37579a08a9f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:44.884065 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a360f7c8-5e20-4e52-82cc-f37579a08a9f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:44.884660 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a360f7c8-5e20-4e52-82cc-f37579a08a9f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:44.885243 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a360f7c8-5e20-4e52-82cc-f37579a08a9f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:44.886088 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a360f7c8-5e20-4e52-82cc-f37579a08a9f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:44.886699 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a360f7c8-5e20-4e52-82cc-f37579a08a9f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:44.887462 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a360f7c8-5e20-4e52-82cc-f37579a08a9f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:45.032514 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-829fc68a-c3d5-45d1-aa56-767ef445c9b5 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:45.033303 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-829fc68a-c3d5-45d1-aa56-767ef445c9b5 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 074c501c-cdef-4f19-81e5-8fc2608e9dd1] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:45.044995 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-829fc68a-c3d5-45d1-aa56-767ef445c9b5 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:45.045498 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-829fc68a-c3d5-45d1-aa56-767ef445c9b5 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:45.045498 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-829fc68a-c3d5-45d1-aa56-767ef445c9b5 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:45.046222 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-829fc68a-c3d5-45d1-aa56-767ef445c9b5 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:45.048685 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-829fc68a-c3d5-45d1-aa56-767ef445c9b5 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:45.049205 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-829fc68a-c3d5-45d1-aa56-767ef445c9b5 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:45.079088 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a360f7c8-5e20-4e52-82cc-f37579a08a9f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:45.089509 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a360f7c8-5e20-4e52-82cc-f37579a08a9f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1475 microversion: 2.1 time: 0.234545 Sep 24 20:54:45.090671 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 815/1577] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:44 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1475 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:45.107723 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-9a3e51a7-877f-4043-8d16-88ba2692377c req-9be1c240-b991-4e68-84cb-ba9884f60148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fc32d38-e9c2-4a92-a346-622b7b7206fd", "name": "network-vif-plugged", "status": "completed", "tag": "ae80193f-701b-44ae-b340-65e79cdd45ec"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:45.127638 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-9a3e51a7-877f-4043-8d16-88ba2692377c req-9be1c240-b991-4e68-84cb-ba9884f60148 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:45.130058 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-9a3e51a7-877f-4043-8d16-88ba2692377c req-9be1c240-b991-4e68-84cb-ba9884f60148 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:45.130601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-9a3e51a7-877f-4043-8d16-88ba2692377c req-9be1c240-b991-4e68-84cb-ba9884f60148 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:45.145480 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-9a3e51a7-877f-4043-8d16-88ba2692377c req-9be1c240-b991-4e68-84cb-ba9884f60148 service nova] Creating event network-vif-plugged:ae80193f-701b-44ae-b340-65e79cdd45ec for instance 5fc32d38-e9c2-4a92-a346-622b7b7206fd on nch2-master-1 Sep 24 20:54:45.152081 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-9a3e51a7-877f-4043-8d16-88ba2692377c req-9be1c240-b991-4e68-84cb-ba9884f60148 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059569 Sep 24 20:54:45.153635 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 816/1578] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:54:45.234716 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-829fc68a-c3d5-45d1-aa56-767ef445c9b5 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:45.243688 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-829fc68a-c3d5-45d1-aa56-767ef445c9b5 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1" status: 200 len: 1322 microversion: 2.1 time: 0.216421 Sep 24 20:54:45.244268 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 763/1579] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:45 2022] GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:45.322239 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9e4d2778-3883-477c-8b19-8a41f13616bd tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:45.323366 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9e4d2778-3883-477c-8b19-8a41f13616bd tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:45.331449 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9e4d2778-3883-477c-8b19-8a41f13616bd tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:45.332029 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9e4d2778-3883-477c-8b19-8a41f13616bd tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:45.332550 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9e4d2778-3883-477c-8b19-8a41f13616bd tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:45.333611 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9e4d2778-3883-477c-8b19-8a41f13616bd tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:45.334160 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9e4d2778-3883-477c-8b19-8a41f13616bd tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:45.334934 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9e4d2778-3883-477c-8b19-8a41f13616bd tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:45.483482 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9e4d2778-3883-477c-8b19-8a41f13616bd tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:45.492134 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9e4d2778-3883-477c-8b19-8a41f13616bd tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1715 microversion: 2.1 time: 0.174332 Sep 24 20:54:45.492717 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 817/1580] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:45 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1715 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:45.547466 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9d142708-62ab-4824-99d1-4cc72fb16cfb tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Calling method '.version_select at 0x7f4b0ca2d940>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:45.551286 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d142708-62ab-4824-99d1-4cc72fb16cfb tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:45.551783 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d142708-62ab-4824-99d1-4cc72fb16cfb tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:45.552239 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d142708-62ab-4824-99d1-4cc72fb16cfb tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:45.552971 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d142708-62ab-4824-99d1-4cc72fb16cfb tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:45.553428 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d142708-62ab-4824-99d1-4cc72fb16cfb tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:45.553857 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d142708-62ab-4824-99d1-4cc72fb16cfb tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:45.577864 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9d142708-62ab-4824-99d1-4cc72fb16cfb tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.156117 Sep 24 20:54:45.578428 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 764/1581] 10.222.0.52 () {58 vars in 1128 bytes} [Sat Sep 24 20:54:45 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:54:45.590694 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7c2e6e90-788e-480e-97a9-76b3c5e894c4 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Calling method '.version_select at 0x7f4b10fa0790>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:45.594347 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7c2e6e90-788e-480e-97a9-76b3c5e894c4 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:45.594900 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7c2e6e90-788e-480e-97a9-76b3c5e894c4 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:45.595347 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7c2e6e90-788e-480e-97a9-76b3c5e894c4 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:45.596086 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7c2e6e90-788e-480e-97a9-76b3c5e894c4 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:45.596704 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7c2e6e90-788e-480e-97a9-76b3c5e894c4 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:45.597235 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7c2e6e90-788e-480e-97a9-76b3c5e894c4 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:45.624485 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7c2e6e90-788e-480e-97a9-76b3c5e894c4 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 379 microversion: 2.1 time: 0.037558 Sep 24 20:54:45.625068 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 818/1582] 10.222.0.52 () {58 vars in 1139 bytes} [Sat Sep 24 20:54:45 2022] GET /compute/v2.1/os-hosts?zone= => generated 379 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:54:45.636988 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cf3d334e-6a41-4dc9-af1a-c21e2a6663f1 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Calling method '.version_select at 0x7f4b0cacb8b0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:45.640567 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cf3d334e-6a41-4dc9-af1a-c21e2a6663f1 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:45.641118 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cf3d334e-6a41-4dc9-af1a-c21e2a6663f1 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:45.641564 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cf3d334e-6a41-4dc9-af1a-c21e2a6663f1 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:45.642314 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cf3d334e-6a41-4dc9-af1a-c21e2a6663f1 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:45.642807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cf3d334e-6a41-4dc9-af1a-c21e2a6663f1 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:45.643246 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cf3d334e-6a41-4dc9-af1a-c21e2a6663f1 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:45.666822 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cf3d334e-6a41-4dc9-af1a-c21e2a6663f1 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.033597 Sep 24 20:54:45.667394 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 765/1583] 10.222.0.52 () {58 vars in 1145 bytes} [Sat Sep 24 20:54:45 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:54:45.679882 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dc8d7279-8e08-49ba-92fd-5dbb9a672cb3 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Calling method '.version_select at 0x7f4b1104c430>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:45.683187 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc8d7279-8e08-49ba-92fd-5dbb9a672cb3 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:45.683678 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc8d7279-8e08-49ba-92fd-5dbb9a672cb3 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:45.684124 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc8d7279-8e08-49ba-92fd-5dbb9a672cb3 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:45.684862 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc8d7279-8e08-49ba-92fd-5dbb9a672cb3 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:45.685323 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc8d7279-8e08-49ba-92fd-5dbb9a672cb3 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:45.685752 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc8d7279-8e08-49ba-92fd-5dbb9a672cb3 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:45.711162 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dc8d7279-8e08-49ba-92fd-5dbb9a672cb3 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.035101 Sep 24 20:54:45.711793 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 819/1584] 10.222.0.52 () {58 vars in 1128 bytes} [Sat Sep 24 20:54:45 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:54:45.721298 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e321766e-b928-48fa-a0fc-92aa625bf425 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:45.721940 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e321766e-b928-48fa-a0fc-92aa625bf425 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] [instance: 5fc32d38-e9c2-4a92-a346-622b7b7206fd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:45.722940 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-480e15dd-4db4-4033-962f-265f7fc8f0bd tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Calling method '.version_select at 0x7f4b10ffaca0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:45.728589 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e321766e-b928-48fa-a0fc-92aa625bf425 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:45.729094 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e321766e-b928-48fa-a0fc-92aa625bf425 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:45.729214 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-480e15dd-4db4-4033-962f-265f7fc8f0bd tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:45.729547 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e321766e-b928-48fa-a0fc-92aa625bf425 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:45.729661 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-480e15dd-4db4-4033-962f-265f7fc8f0bd tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:45.730201 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-480e15dd-4db4-4033-962f-265f7fc8f0bd tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:45.730429 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e321766e-b928-48fa-a0fc-92aa625bf425 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:45.731001 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-480e15dd-4db4-4033-962f-265f7fc8f0bd tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:45.731122 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e321766e-b928-48fa-a0fc-92aa625bf425 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:45.731443 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e321766e-b928-48fa-a0fc-92aa625bf425 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:45.731561 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-480e15dd-4db4-4033-962f-265f7fc8f0bd tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:45.731884 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-480e15dd-4db4-4033-962f-265f7fc8f0bd tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:45.770677 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-480e15dd-4db4-4033-962f-265f7fc8f0bd tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.051415 Sep 24 20:54:45.771306 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 820/1585] 10.222.0.52 () {58 vars in 1155 bytes} [Sat Sep 24 20:54:45 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:54:45.782813 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-05a19ca8-e691-4969-bf1e-748424922711 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Calling method '.version_select at 0x7f4b11024820>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:45.787331 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05a19ca8-e691-4969-bf1e-748424922711 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:45.787822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05a19ca8-e691-4969-bf1e-748424922711 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:45.788455 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05a19ca8-e691-4969-bf1e-748424922711 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:45.789370 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05a19ca8-e691-4969-bf1e-748424922711 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:45.789833 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05a19ca8-e691-4969-bf1e-748424922711 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:45.790281 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05a19ca8-e691-4969-bf1e-748424922711 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:45.815935 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-05a19ca8-e691-4969-bf1e-748424922711 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.036618 Sep 24 20:54:45.817076 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 821/1586] 10.222.0.52 () {58 vars in 1128 bytes} [Sat Sep 24 20:54:45 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:54:45.827220 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7a14de30-ce09-4def-8330-0e45128be455 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Calling method '.version_select at 0x7f4b110aadc0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:45.835543 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7a14de30-ce09-4def-8330-0e45128be455 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:45.836033 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7a14de30-ce09-4def-8330-0e45128be455 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:45.836474 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7a14de30-ce09-4def-8330-0e45128be455 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:45.850813 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7a14de30-ce09-4def-8330-0e45128be455 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:45.851306 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7a14de30-ce09-4def-8330-0e45128be455 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:45.851748 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7a14de30-ce09-4def-8330-0e45128be455 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:45.878050 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e321766e-b928-48fa-a0fc-92aa625bf425 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab2b6bf40594154a6340d5afd02da0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc5dc16f54e4d2991a2b456216459a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:45.890112 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e321766e-b928-48fa-a0fc-92aa625bf425 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc32d38-e9c2-4a92-a346-622b7b7206fd" status: 200 len: 1351 microversion: 2.1 time: 0.173081 Sep 24 20:54:45.890854 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 766/1587] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:45 2022] GET /compute/v2.1/servers/5fc32d38-e9c2-4a92-a346-622b7b7206fd => generated 1351 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:54:45.895032 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7a14de30-ce09-4def-8330-0e45128be455 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts/nch1-master-1" status: 200 len: 997 microversion: 2.1 time: 0.071026 Sep 24 20:54:45.896923 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0500c7d1-48a6-45b4-9679-1bb079cb30ae tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:45.897830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0500c7d1-48a6-45b4-9679-1bb079cb30ae tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a89ef546-702c-4ecd-babc-7d523421339b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:45.901611 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 822/1588] 10.222.0.52 () {58 vars in 1170 bytes} [Sat Sep 24 20:54:45 2022] GET /compute/v2.1/os-hosts/nch1-master-1 => generated 997 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:54:45.905976 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0500c7d1-48a6-45b4-9679-1bb079cb30ae tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:45.906936 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0500c7d1-48a6-45b4-9679-1bb079cb30ae tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:45.907139 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-31118518-aee4-4155-a64b-e32eb5542d7c tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b1100a040>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:45.907808 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0500c7d1-48a6-45b4-9679-1bb079cb30ae tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:45.908592 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0500c7d1-48a6-45b4-9679-1bb079cb30ae tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:45.909815 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0500c7d1-48a6-45b4-9679-1bb079cb30ae tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:45.910407 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0500c7d1-48a6-45b4-9679-1bb079cb30ae tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:45.963168 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-31118518-aee4-4155-a64b-e32eb5542d7c tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913" status: 200 len: 1430 microversion: 2.1 time: 0.060329 Sep 24 20:54:45.963714 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 823/1589] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:54:45 2022] GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913 => generated 1430 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:45.977955 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cc0fed3c-d676-4bf9-9e42-508763fb70a4 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Calling method '.version_select at 0x7f4b10fe8e50>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:45.985204 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cc0fed3c-d676-4bf9-9e42-508763fb70a4 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:45.985825 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cc0fed3c-d676-4bf9-9e42-508763fb70a4 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:45.986276 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cc0fed3c-d676-4bf9-9e42-508763fb70a4 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:46.000120 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cc0fed3c-d676-4bf9-9e42-508763fb70a4 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:46.000601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cc0fed3c-d676-4bf9-9e42-508763fb70a4 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:46.001046 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cc0fed3c-d676-4bf9-9e42-508763fb70a4 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:46.040590 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cc0fed3c-d676-4bf9-9e42-508763fb70a4 tempest-HostsAdminTestJSON-102265651 tempest-HostsAdminTestJSON-102265651-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts/nch2-master-1" status: 200 len: 997 microversion: 2.1 time: 0.066296 Sep 24 20:54:46.041557 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 824/1590] 10.222.0.52 () {58 vars in 1170 bytes} [Sat Sep 24 20:54:45 2022] GET /compute/v2.1/os-hosts/nch2-master-1 => generated 997 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:54:46.047735 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-822a5cdb-0d83-40f4-9a9c-5ca62f1f6d94 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b1100a5e0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:46.080347 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0500c7d1-48a6-45b4-9679-1bb079cb30ae tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:46.088794 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0500c7d1-48a6-45b4-9679-1bb079cb30ae tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b" status: 200 len: 1472 microversion: 2.1 time: 0.196576 Sep 24 20:54:46.089766 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 767/1591] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:45 2022] GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b => generated 1472 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:46.120347 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-822a5cdb-0d83-40f4-9a9c-5ca62f1f6d94 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913" status: 200 len: 1430 microversion: 2.1 time: 0.076672 Sep 24 20:54:46.130532 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 825/1592] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:54:46 2022] GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913 => generated 1430 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:46.132387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b6db0d71-e13a-4722-938c-8cb38807be7c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:46.133020 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b6db0d71-e13a-4722-938c-8cb38807be7c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:46.142682 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3606edeb-2c5b-4487-8a87-4707cb747468 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:46.144445 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3606edeb-2c5b-4487-8a87-4707cb747468 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] [instance: 048b3539-80cb-4d73-9280-b62713ddb588] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:46.144715 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6db0d71-e13a-4722-938c-8cb38807be7c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:46.145238 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6db0d71-e13a-4722-938c-8cb38807be7c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:46.145737 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6db0d71-e13a-4722-938c-8cb38807be7c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:46.146372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6db0d71-e13a-4722-938c-8cb38807be7c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:46.146862 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6db0d71-e13a-4722-938c-8cb38807be7c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:46.147294 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6db0d71-e13a-4722-938c-8cb38807be7c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:46.155680 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3606edeb-2c5b-4487-8a87-4707cb747468 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:46.156306 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3606edeb-2c5b-4487-8a87-4707cb747468 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:46.156859 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3606edeb-2c5b-4487-8a87-4707cb747468 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:46.157690 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3606edeb-2c5b-4487-8a87-4707cb747468 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:46.158260 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3606edeb-2c5b-4487-8a87-4707cb747468 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:46.158826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3606edeb-2c5b-4487-8a87-4707cb747468 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:46.424215 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3606edeb-2c5b-4487-8a87-4707cb747468 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d241b5c9b654fa7bf97f3652186ea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a0417c2ae142c48e41a41a495ea988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:46.427384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b6db0d71-e13a-4722-938c-8cb38807be7c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:46.435334 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3606edeb-2c5b-4487-8a87-4707cb747468 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588" status: 200 len: 1480 microversion: 2.1 time: 0.297673 Sep 24 20:54:46.435492 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b6db0d71-e13a-4722-938c-8cb38807be7c tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1475 microversion: 2.1 time: 0.324839 Sep 24 20:54:46.436212 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 826/1593] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:46 2022] GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588 => generated 1480 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:54:46.442130 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ea4c52a8-e3d5-4644-80fa-2304fd13de81 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:46.443083 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ea4c52a8-e3d5-4644-80fa-2304fd13de81 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 074c501c-cdef-4f19-81e5-8fc2608e9dd1] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:46.449823 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ea4c52a8-e3d5-4644-80fa-2304fd13de81 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:46.450522 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ea4c52a8-e3d5-4644-80fa-2304fd13de81 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:46.451159 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ea4c52a8-e3d5-4644-80fa-2304fd13de81 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:46.452044 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ea4c52a8-e3d5-4644-80fa-2304fd13de81 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:46.452723 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ea4c52a8-e3d5-4644-80fa-2304fd13de81 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:46.453364 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ea4c52a8-e3d5-4644-80fa-2304fd13de81 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:46.456751 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 768/1594] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:46 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1475 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:46.518163 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-503db724-fec1-44a3-b476-3758cde431bd tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:46.520500 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-503db724-fec1-44a3-b476-3758cde431bd tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:46.535386 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-503db724-fec1-44a3-b476-3758cde431bd tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:46.535932 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-503db724-fec1-44a3-b476-3758cde431bd tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:46.536382 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-503db724-fec1-44a3-b476-3758cde431bd tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:46.537115 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-503db724-fec1-44a3-b476-3758cde431bd tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:46.542248 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-503db724-fec1-44a3-b476-3758cde431bd tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:46.542781 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-503db724-fec1-44a3-b476-3758cde431bd tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:46.734079 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ea4c52a8-e3d5-4644-80fa-2304fd13de81 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:46.744322 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ea4c52a8-e3d5-4644-80fa-2304fd13de81 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1" status: 200 len: 1322 microversion: 2.1 time: 0.306685 Sep 24 20:54:46.752202 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 827/1595] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:46 2022] GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1 => generated 1322 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:46.757493 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-6e13611d-180b-461a-b0dd-5be6c37016d0 req-19e12419-cdf8-475f-819f-21e707009924 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "074c501c-cdef-4f19-81e5-8fc2608e9dd1", "tag": "d2003e83-fec4-44ef-a623-62218b581c9b"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:46.768860 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6e13611d-180b-461a-b0dd-5be6c37016d0 req-19e12419-cdf8-475f-819f-21e707009924 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:46.770334 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6e13611d-180b-461a-b0dd-5be6c37016d0 req-19e12419-cdf8-475f-819f-21e707009924 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:46.771069 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6e13611d-180b-461a-b0dd-5be6c37016d0 req-19e12419-cdf8-475f-819f-21e707009924 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:46.785181 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-6e13611d-180b-461a-b0dd-5be6c37016d0 req-19e12419-cdf8-475f-819f-21e707009924 service nova] Creating event network-changed:d2003e83-fec4-44ef-a623-62218b581c9b for instance 074c501c-cdef-4f19-81e5-8fc2608e9dd1 on nch1-master-1 Sep 24 20:54:46.791929 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-6e13611d-180b-461a-b0dd-5be6c37016d0 req-19e12419-cdf8-475f-819f-21e707009924 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038058 Sep 24 20:54:46.792787 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 828/1596] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:54:46.917052 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f0f9097b-a9d2-4d92-9de1-b8fde1486cb4 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:46.917851 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f0f9097b-a9d2-4d92-9de1-b8fde1486cb4 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] [instance: 5fc32d38-e9c2-4a92-a346-622b7b7206fd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:46.922221 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-503db724-fec1-44a3-b476-3758cde431bd tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:46.943788 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-503db724-fec1-44a3-b476-3758cde431bd tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1715 microversion: 2.1 time: 0.428050 Sep 24 20:54:46.944732 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 769/1597] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:46 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1715 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:54:46.945010 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f0f9097b-a9d2-4d92-9de1-b8fde1486cb4 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:46.945736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f0f9097b-a9d2-4d92-9de1-b8fde1486cb4 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:46.946332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f0f9097b-a9d2-4d92-9de1-b8fde1486cb4 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:46.947820 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f0f9097b-a9d2-4d92-9de1-b8fde1486cb4 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:46.948437 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f0f9097b-a9d2-4d92-9de1-b8fde1486cb4 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:46.949043 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f0f9097b-a9d2-4d92-9de1-b8fde1486cb4 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:47.113868 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9b0783b1-bbd1-4525-88d9-52c2030475d8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:47.114824 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9b0783b1-bbd1-4525-88d9-52c2030475d8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a89ef546-702c-4ecd-babc-7d523421339b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:47.121966 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9b0783b1-bbd1-4525-88d9-52c2030475d8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:47.122476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9b0783b1-bbd1-4525-88d9-52c2030475d8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:47.122942 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9b0783b1-bbd1-4525-88d9-52c2030475d8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:47.123976 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9b0783b1-bbd1-4525-88d9-52c2030475d8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:47.124640 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9b0783b1-bbd1-4525-88d9-52c2030475d8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:47.125443 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9b0783b1-bbd1-4525-88d9-52c2030475d8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:47.298733 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f0f9097b-a9d2-4d92-9de1-b8fde1486cb4 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab2b6bf40594154a6340d5afd02da0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc5dc16f54e4d2991a2b456216459a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:47.319586 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f0f9097b-a9d2-4d92-9de1-b8fde1486cb4 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc32d38-e9c2-4a92-a346-622b7b7206fd" status: 200 len: 1542 microversion: 2.1 time: 0.404985 Sep 24 20:54:47.320520 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 829/1598] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:46 2022] GET /compute/v2.1/servers/5fc32d38-e9c2-4a92-a346-622b7b7206fd => generated 1542 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:54:47.350236 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7acefcf1-cde3-4556-adb7-10631bc7015d tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:47.351261 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7acefcf1-cde3-4556-adb7-10631bc7015d tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] [instance: 5fc32d38-e9c2-4a92-a346-622b7b7206fd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:47.354155 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:54:47.358523 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7acefcf1-cde3-4556-adb7-10631bc7015d tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:47.359296 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7acefcf1-cde3-4556-adb7-10631bc7015d tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:47.359907 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7acefcf1-cde3-4556-adb7-10631bc7015d tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:47.360805 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7acefcf1-cde3-4556-adb7-10631bc7015d tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:47.361270 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7acefcf1-cde3-4556-adb7-10631bc7015d tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:47.361685 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7acefcf1-cde3-4556-adb7-10631bc7015d tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:47.399153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9b0783b1-bbd1-4525-88d9-52c2030475d8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:47.410804 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9b0783b1-bbd1-4525-88d9-52c2030475d8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b" status: 200 len: 1472 microversion: 2.1 time: 0.301715 Sep 24 20:54:47.412066 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 770/1599] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:47 2022] GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b => generated 1472 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:47.459984 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-700eff90-de6d-4174-9a41-7a0437f68053 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:47.460681 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-700eff90-de6d-4174-9a41-7a0437f68053 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:47.468217 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-700eff90-de6d-4174-9a41-7a0437f68053 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:47.469068 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-700eff90-de6d-4174-9a41-7a0437f68053 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:47.470070 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-700eff90-de6d-4174-9a41-7a0437f68053 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:47.471081 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-700eff90-de6d-4174-9a41-7a0437f68053 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:47.472811 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-700eff90-de6d-4174-9a41-7a0437f68053 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:47.473752 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-700eff90-de6d-4174-9a41-7a0437f68053 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:47.527991 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7acefcf1-cde3-4556-adb7-10631bc7015d tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc32d38-e9c2-4a92-a346-622b7b7206fd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.184248 Sep 24 20:54:47.541155 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 830/1600] 10.222.0.52 () {58 vars in 1275 bytes} [Sat Sep 24 20:54:47 2022] GET /compute/v2.1/servers/5fc32d38-e9c2-4a92-a346-622b7b7206fd/os-interface => generated 285 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:54:47.546589 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2b1e46ae-6653-4105-b568-25527e48a0ce tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:47.547566 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2b1e46ae-6653-4105-b568-25527e48a0ce tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] [instance: 048b3539-80cb-4d73-9280-b62713ddb588] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:47.555518 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2b1e46ae-6653-4105-b568-25527e48a0ce tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:47.556197 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2b1e46ae-6653-4105-b568-25527e48a0ce tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:47.556798 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2b1e46ae-6653-4105-b568-25527e48a0ce tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:47.557867 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2b1e46ae-6653-4105-b568-25527e48a0ce tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:47.558560 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2b1e46ae-6653-4105-b568-25527e48a0ce tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:47.559154 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2b1e46ae-6653-4105-b568-25527e48a0ce tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:48.130098 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=10 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:54:48.341439 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-700eff90-de6d-4174-9a41-7a0437f68053 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:48.371354 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-700eff90-de6d-4174-9a41-7a0437f68053 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1475 microversion: 2.1 time: 0.915507 Sep 24 20:54:48.372003 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 771/1601] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:47 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1475 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:54:48.376827 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-51b04d38-d062-4680-84cb-9d5d033c3019 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:48.377451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-51b04d38-d062-4680-84cb-9d5d033c3019 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 074c501c-cdef-4f19-81e5-8fc2608e9dd1] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:48.389301 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51b04d38-d062-4680-84cb-9d5d033c3019 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:48.389447 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51b04d38-d062-4680-84cb-9d5d033c3019 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:48.389897 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51b04d38-d062-4680-84cb-9d5d033c3019 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:48.390662 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51b04d38-d062-4680-84cb-9d5d033c3019 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:48.391326 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51b04d38-d062-4680-84cb-9d5d033c3019 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:48.392624 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51b04d38-d062-4680-84cb-9d5d033c3019 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:48.413506 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2b1e46ae-6653-4105-b568-25527e48a0ce tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d241b5c9b654fa7bf97f3652186ea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a0417c2ae142c48e41a41a495ea988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:48.431769 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2b1e46ae-6653-4105-b568-25527e48a0ce tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588" status: 200 len: 1467 microversion: 2.1 time: 0.888486 Sep 24 20:54:48.433014 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 831/1602] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:47 2022] GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588 => generated 1467 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:48.438856 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-33b3d967-bd5d-4099-8349-974535add823 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:48.440983 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-33b3d967-bd5d-4099-8349-974535add823 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:48.457291 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33b3d967-bd5d-4099-8349-974535add823 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:48.457883 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33b3d967-bd5d-4099-8349-974535add823 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:48.458332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33b3d967-bd5d-4099-8349-974535add823 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:48.459163 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33b3d967-bd5d-4099-8349-974535add823 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:48.459631 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33b3d967-bd5d-4099-8349-974535add823 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:48.460063 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33b3d967-bd5d-4099-8349-974535add823 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:48.758414 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-51b04d38-d062-4680-84cb-9d5d033c3019 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:48.767498 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-51b04d38-d062-4680-84cb-9d5d033c3019 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1" status: 200 len: 1322 microversion: 2.1 time: 0.394464 Sep 24 20:54:48.768087 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 772/1603] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:48 2022] GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1 => generated 1322 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:48.778747 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-336d4402-49dc-4ef4-9678-c85b1d98edcb req-3d01a457-533f-4cff-a1c5-a058be7f0a8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a89ef546-702c-4ecd-babc-7d523421339b", "name": "network-vif-deleted", "tag": "fa4b4cb0-8e47-43ef-bbc3-afdd2366b28f"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:48.792153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-336d4402-49dc-4ef4-9678-c85b1d98edcb req-3d01a457-533f-4cff-a1c5-a058be7f0a8e service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:48.792734 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-336d4402-49dc-4ef4-9678-c85b1d98edcb req-3d01a457-533f-4cff-a1c5-a058be7f0a8e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:48.793354 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-336d4402-49dc-4ef4-9678-c85b1d98edcb req-3d01a457-533f-4cff-a1c5-a058be7f0a8e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:48.807482 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-336d4402-49dc-4ef4-9678-c85b1d98edcb req-3d01a457-533f-4cff-a1c5-a058be7f0a8e service nova] Creating event network-vif-deleted:fa4b4cb0-8e47-43ef-bbc3-afdd2366b28f for instance a89ef546-702c-4ecd-babc-7d523421339b on nch1-master-1 Sep 24 20:54:48.814221 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-336d4402-49dc-4ef4-9678-c85b1d98edcb req-3d01a457-533f-4cff-a1c5-a058be7f0a8e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044193 Sep 24 20:54:48.815296 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 773/1604] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:54:48.822040 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1e88704a-fea9-4c92-8f14-fb31dc7065e6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:48.822971 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1e88704a-fea9-4c92-8f14-fb31dc7065e6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a89ef546-702c-4ecd-babc-7d523421339b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:48.829690 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e88704a-fea9-4c92-8f14-fb31dc7065e6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:48.830349 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e88704a-fea9-4c92-8f14-fb31dc7065e6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:48.831662 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e88704a-fea9-4c92-8f14-fb31dc7065e6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:48.833058 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e88704a-fea9-4c92-8f14-fb31dc7065e6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:48.833537 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e88704a-fea9-4c92-8f14-fb31dc7065e6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:48.833976 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e88704a-fea9-4c92-8f14-fb31dc7065e6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:48.965905 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1e88704a-fea9-4c92-8f14-fb31dc7065e6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:48.975361 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1e88704a-fea9-4c92-8f14-fb31dc7065e6 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b" status: 200 len: 1430 microversion: 2.1 time: 0.158723 Sep 24 20:54:48.975946 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-33b3d967-bd5d-4099-8349-974535add823 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:48.976447 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 774/1605] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:48 2022] GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b => generated 1430 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:48.982687 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ca8ae282-b59c-4375-bcf6-78a2604fc168 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b0ca2d940>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:48.987155 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-33b3d967-bd5d-4099-8349-974535add823 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1715 microversion: 2.1 time: 0.552202 Sep 24 20:54:49.002523 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 832/1606] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:48 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1715 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:49.040464 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ca8ae282-b59c-4375-bcf6-78a2604fc168 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/4c30e8e9-8fb2-4377-83f1-98322cb17799" status: 200 len: 784 microversion: 2.1 time: 0.062422 Sep 24 20:54:49.041061 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 775/1607] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:54:48 2022] GET /compute/v2.1/images/4c30e8e9-8fb2-4377-83f1-98322cb17799 => generated 784 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:54:49.055636 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0b1d41da-0ff9-4c3f-992e-077c0812ee53 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:49.065875 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0b1d41da-0ff9-4c3f-992e-077c0812ee53 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014181 Sep 24 20:54:49.066552 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 833/1608] 10.222.0.52 () {58 vars in 1137 bytes} [Sat Sep 24 20:54:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:54:49.078337 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-89be985d-a388-4854-91a8-9f01367eb1a0 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b0c5fc790>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:49.396355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-24799801-6a46-40d3-9826-301d0cc373e8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:49.397497 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-24799801-6a46-40d3-9826-301d0cc373e8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:49.414913 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24799801-6a46-40d3-9826-301d0cc373e8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:49.415503 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24799801-6a46-40d3-9826-301d0cc373e8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:49.416558 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24799801-6a46-40d3-9826-301d0cc373e8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:49.418199 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24799801-6a46-40d3-9826-301d0cc373e8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:49.419139 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24799801-6a46-40d3-9826-301d0cc373e8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:49.420210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24799801-6a46-40d3-9826-301d0cc373e8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:49.637596 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-24799801-6a46-40d3-9826-301d0cc373e8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:49.650262 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-24799801-6a46-40d3-9826-301d0cc373e8 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1475 microversion: 2.1 time: 0.259985 Sep 24 20:54:49.654590 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 834/1609] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:49 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1475 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:54:49.793833 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-96ab5d36-e8b2-4cf8-b34a-c47ea903b8ed tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:49.794477 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-96ab5d36-e8b2-4cf8-b34a-c47ea903b8ed tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 074c501c-cdef-4f19-81e5-8fc2608e9dd1] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:49.803831 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96ab5d36-e8b2-4cf8-b34a-c47ea903b8ed tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:49.804332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96ab5d36-e8b2-4cf8-b34a-c47ea903b8ed tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:49.804779 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96ab5d36-e8b2-4cf8-b34a-c47ea903b8ed tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:49.805619 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96ab5d36-e8b2-4cf8-b34a-c47ea903b8ed tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:49.806270 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96ab5d36-e8b2-4cf8-b34a-c47ea903b8ed tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:49.806853 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96ab5d36-e8b2-4cf8-b34a-c47ea903b8ed tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:49.884654 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-89be985d-a388-4854-91a8-9f01367eb1a0 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "DELETE /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913" status: 204 len: 0 microversion: 2.1 time: 0.810035 Sep 24 20:54:49.886017 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 776/1610] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:49 2022] DELETE /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913 => generated 0 bytes in 812 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:54:49.894528 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2721ede8-71e0-493b-8344-993d41728f61 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b0c996310>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:49.927720 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-2721ede8-71e0-493b-8344-993d41728f61 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] HTTP exception thrown: Image not found. Sep 24 20:54:49.930069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2721ede8-71e0-493b-8344-993d41728f61 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Request method failure captured: Sep 24 20:54:49.930069 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913 HTTP/1.1 Sep 24 20:54:49.930069 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:54:49.930069 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:54:49.930069 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:54:49.930069 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:54:49.930069 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:54:49.930069 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:54:49.930069 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:54:49.930069 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:54:49.930069 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL25WtLhSiM52-bmwuugMhvCCGYBv161RiI4FkcqGmF75ZrfzBqlJGiCMzEV3ZQpftw0ly-bWgUlZ16VlaTkDn6TpyD_MjzqCtuer4cakD5bdfJRE3ArSCeRjMJNIY4U95NQpvtZ9NRFDKo4AUARrREwm88q9QCIMYiHrr6QlNgoTYkg Sep 24 20:54:49.930069 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:54:49.930069 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:54:49.930069 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:54:49.930069 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:54:49.930069 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:54:49.930069 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:54:49.930069 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 66a0417c2ae142c48e41a41a495ea988 Sep 24 20:54:49.930069 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ImagesOneServerTestJSON-188397882 Sep 24 20:54:49.930069 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:54:49.930069 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:54:49.931552 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/66a0417c2ae142c48e41a41a495ea988"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_66a0417c2ae142c48e41a41a495ea988"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/66a0417c2ae142c48e41a41a495ea988"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/66a0417c2ae142c48e41a41a495ea988"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:54:49.931552 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ImagesOneServerTestJSON-188397882 Sep 24 20:54:49.931552 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 66a0417c2ae142c48e41a41a495ea988 Sep 24 20:54:49.931552 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-188397882 Sep 24 20:54:49.931552 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ImagesOneServerTestJSON-188397882-project Sep 24 20:54:49.931552 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:54:49.931552 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:54:49.931552 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 2d241b5c9b654fa7bf97f3652186ea6f Sep 24 20:54:49.931552 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ImagesOneServerTestJSON-188397882-project Sep 24 20:54:49.931552 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:54:49.931552 ncdv-master-1 devstack@n-api.service[140516]: exception: Image not found. Sep 24 20:54:49.931552 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '6da95260-14d8-49e7-924c-2a06865d3913'} Sep 24 20:54:49.931552 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:54:49.932441 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:49.932441 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 24 20:54:49.932441 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 24 20:54:49.932441 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 24 20:54:49.932441 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 24 20:54:49.932441 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 24 20:54:49.932441 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 24 20:54:49.932441 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 24 20:54:49.932441 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 24 20:54:49.932441 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 24 20:54:49.932441 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 24 20:54:49.932441 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 24 20:54:49.932441 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 24 20:54:49.932441 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 24 20:54:49.932441 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 24 20:54:49.932441 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 24 20:54:49.932441 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 24 20:54:49.932441 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6da95260-14d8-49e7-924c-2a06865d3913 Sep 24 20:54:49.933601 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:49.933601 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:54:49.933601 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:49.933601 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:49.933601 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 24 20:54:49.933601 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 24 20:54:49.933601 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 24 20:54:49.933601 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 24 20:54:49.933601 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 24 20:54:49.933601 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 24 20:54:49.933601 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 24 20:54:49.933601 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 24 20:54:49.933601 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 24 20:54:49.933601 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 24 20:54:49.933601 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 24 20:54:49.933601 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 24 20:54:49.933601 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 24 20:54:49.933601 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 24 20:54:49.933601 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 24 20:54:49.933601 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 24 20:54:49.935182 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 24 20:54:49.935182 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 24 20:54:49.935182 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 24 20:54:49.935182 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 24 20:54:49.935182 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 24 20:54:49.935182 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 24 20:54:49.935182 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 24 20:54:49.935182 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 24 20:54:49.935182 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6da95260-14d8-49e7-924c-2a06865d3913 could not be found. Sep 24 20:54:49.935182 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:49.935182 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:54:49.935182 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:49.935182 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:49.935182 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:54:49.935182 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:54:49.935182 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:54:49.935182 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:54:49.935182 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:54:49.935182 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:54:49.936450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:54:49.936450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:54:49.936450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 24 20:54:49.936450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 24 20:54:49.936450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 24 20:54:49.936450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:49.936450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:54:49.936450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:49.936450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:49.936450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:54:49.936450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:54:49.936450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:54:49.936450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:54:49.936450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 24 20:54:49.936450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:49.936450 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2721ede8-71e0-493b-8344-993d41728f61 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Returning 404 to user: Image not found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:54:49.936450 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2721ede8-71e0-493b-8344-993d41728f61 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913" status: 404 len: 62 microversion: 2.1 time: 0.041607 Sep 24 20:54:49.938064 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 777/1611] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:54:49 2022] GET /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913 => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 24 20:54:49.951575 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b8ee62d2-6447-4a78-b817-c4e0cf2732a3 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1554875245"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:49.955341 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b8ee62d2-6447-4a78-b817-c4e0cf2732a3 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] [instance: 048b3539-80cb-4d73-9280-b62713ddb588] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:49.963657 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b8ee62d2-6447-4a78-b817-c4e0cf2732a3 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:49.964466 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b8ee62d2-6447-4a78-b817-c4e0cf2732a3 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:49.965147 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b8ee62d2-6447-4a78-b817-c4e0cf2732a3 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:49.966187 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b8ee62d2-6447-4a78-b817-c4e0cf2732a3 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:49.967056 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b8ee62d2-6447-4a78-b817-c4e0cf2732a3 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:49.967924 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b8ee62d2-6447-4a78-b817-c4e0cf2732a3 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:49.998668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-96ab5d36-e8b2-4cf8-b34a-c47ea903b8ed tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:50.008231 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-96ab5d36-e8b2-4cf8-b34a-c47ea903b8ed tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1" status: 200 len: 1322 microversion: 2.1 time: 0.219934 Sep 24 20:54:50.009459 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 835/1612] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:49 2022] GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:54:50.014482 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0e9a523a-f9d2-4fc3-b788-1025aec797d8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:50.015586 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0e9a523a-f9d2-4fc3-b788-1025aec797d8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a89ef546-702c-4ecd-babc-7d523421339b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:50.024582 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:54:50.026306 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e9a523a-f9d2-4fc3-b788-1025aec797d8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:50.027745 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e9a523a-f9d2-4fc3-b788-1025aec797d8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:50.028609 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e9a523a-f9d2-4fc3-b788-1025aec797d8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:50.030052 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e9a523a-f9d2-4fc3-b788-1025aec797d8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:50.032030 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e9a523a-f9d2-4fc3-b788-1025aec797d8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:50.033342 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e9a523a-f9d2-4fc3-b788-1025aec797d8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:50.107617 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0e9a523a-f9d2-4fc3-b788-1025aec797d8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:50.118790 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0e9a523a-f9d2-4fc3-b788-1025aec797d8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b" status: 200 len: 1430 microversion: 2.1 time: 0.108011 Sep 24 20:54:50.120147 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 836/1613] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:50 2022] GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b => generated 1430 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:50.137837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d428318a-910e-4e08-a047-8530808a23a8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:50.138616 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d428318a-910e-4e08-a047-8530808a23a8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:50.145867 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d428318a-910e-4e08-a047-8530808a23a8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:50.146362 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d428318a-910e-4e08-a047-8530808a23a8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:50.146832 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d428318a-910e-4e08-a047-8530808a23a8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:50.147549 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d428318a-910e-4e08-a047-8530808a23a8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:50.148192 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d428318a-910e-4e08-a047-8530808a23a8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:50.149054 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d428318a-910e-4e08-a047-8530808a23a8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:50.220993 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b8ee62d2-6447-4a78-b817-c4e0cf2732a3 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "POST /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588/action" status: 202 len: 0 microversion: 2.1 time: 0.274670 Sep 24 20:54:50.223093 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 778/1614] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:54:49 2022] POST /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 24 20:54:50.299365 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d428318a-910e-4e08-a047-8530808a23a8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:50.309150 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:54:50.312623 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d428318a-910e-4e08-a047-8530808a23a8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1715 microversion: 2.1 time: 0.190826 Sep 24 20:54:50.313215 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 837/1615] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:50 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1715 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:50.331632 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2e7754f9-1e84-47c4-b7b6-9126a6a8f3d6 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b10f5a0d0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:50.374928 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8d94fdcd-64e3-4f88-ae7a-f173db9fbf85 tempest-HypervisorAdminV228Test-1693033956 tempest-HypervisorAdminV228Test-1693033956-project-admin] Calling method '.version_select at 0x7f4b0caff1f0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:50.376697 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d94fdcd-64e3-4f88-ae7a-f173db9fbf85 tempest-HypervisorAdminV228Test-1693033956 tempest-HypervisorAdminV228Test-1693033956-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:50.377179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d94fdcd-64e3-4f88-ae7a-f173db9fbf85 tempest-HypervisorAdminV228Test-1693033956 tempest-HypervisorAdminV228Test-1693033956-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:50.377639 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d94fdcd-64e3-4f88-ae7a-f173db9fbf85 tempest-HypervisorAdminV228Test-1693033956 tempest-HypervisorAdminV228Test-1693033956-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:50.383762 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2e7754f9-1e84-47c4-b7b6-9126a6a8f3d6 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/4efda41f-1d87-450f-8456-2a80880b8c9a" status: 200 len: 1427 microversion: 2.1 time: 0.069222 Sep 24 20:54:50.392370 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 838/1616] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:54:50 2022] GET /compute/v2.1/images/4efda41f-1d87-450f-8456-2a80880b8c9a => generated 1427 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:50.395223 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d94fdcd-64e3-4f88-ae7a-f173db9fbf85 tempest-HypervisorAdminV228Test-1693033956 tempest-HypervisorAdminV228Test-1693033956-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:50.395712 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d94fdcd-64e3-4f88-ae7a-f173db9fbf85 tempest-HypervisorAdminV228Test-1693033956 tempest-HypervisorAdminV228Test-1693033956-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:50.396576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d94fdcd-64e3-4f88-ae7a-f173db9fbf85 tempest-HypervisorAdminV228Test-1693033956 tempest-HypervisorAdminV228Test-1693033956-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:50.407482 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d94fdcd-64e3-4f88-ae7a-f173db9fbf85 tempest-HypervisorAdminV228Test-1693033956 tempest-HypervisorAdminV228Test-1693033956-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:50.407959 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d94fdcd-64e3-4f88-ae7a-f173db9fbf85 tempest-HypervisorAdminV228Test-1693033956 tempest-HypervisorAdminV228Test-1693033956-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:50.408396 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d94fdcd-64e3-4f88-ae7a-f173db9fbf85 tempest-HypervisorAdminV228Test-1693033956 tempest-HypervisorAdminV228Test-1693033956-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:50.416257 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8d94fdcd-64e3-4f88-ae7a-f173db9fbf85 tempest-HypervisorAdminV228Test-1693033956 tempest-HypervisorAdminV228Test-1693033956-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.191478 Sep 24 20:54:50.417194 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 779/1617] 10.222.0.52 () {60 vars in 1187 bytes} [Sat Sep 24 20:54:50 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:54:50.429712 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0ba82086-b723-43cc-8a9d-8f719f9b6cb5 tempest-HypervisorAdminV228Test-1693033956 tempest-HypervisorAdminV228Test-1693033956-project-admin] Calling method '.version_select at 0x7f4b10fcb160>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:50.431911 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0ba82086-b723-43cc-8a9d-8f719f9b6cb5 tempest-HypervisorAdminV228Test-1693033956 tempest-HypervisorAdminV228Test-1693033956-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:50.432476 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0ba82086-b723-43cc-8a9d-8f719f9b6cb5 tempest-HypervisorAdminV228Test-1693033956 tempest-HypervisorAdminV228Test-1693033956-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:50.432991 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0ba82086-b723-43cc-8a9d-8f719f9b6cb5 tempest-HypervisorAdminV228Test-1693033956 tempest-HypervisorAdminV228Test-1693033956-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:50.448248 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0ba82086-b723-43cc-8a9d-8f719f9b6cb5 tempest-HypervisorAdminV228Test-1693033956 tempest-HypervisorAdminV228Test-1693033956-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:50.448906 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0ba82086-b723-43cc-8a9d-8f719f9b6cb5 tempest-HypervisorAdminV228Test-1693033956 tempest-HypervisorAdminV228Test-1693033956-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:50.449415 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0ba82086-b723-43cc-8a9d-8f719f9b6cb5 tempest-HypervisorAdminV228Test-1693033956 tempest-HypervisorAdminV228Test-1693033956-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:50.456538 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0ba82086-b723-43cc-8a9d-8f719f9b6cb5 tempest-HypervisorAdminV228Test-1693033956 tempest-HypervisorAdminV228Test-1693033956-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 721 microversion: 2.28 time: 0.031615 Sep 24 20:54:50.457165 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 839/1618] 10.222.0.52 () {60 vars in 1193 bytes} [Sat Sep 24 20:54:50 2022] GET /compute/v2.1/os-hypervisors/1 => generated 721 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:54:50.588653 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-1a9a8932-331c-4341-9349-a120f7a197ba req-951853d4-969a-478d-8eab-f92829abc8f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "048b3539-80cb-4d73-9280-b62713ddb588", "name": "network-vif-unplugged", "status": "completed", "tag": "018d9d05-4694-4f6a-8a92-2c61652eab6e"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:50.603259 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1a9a8932-331c-4341-9349-a120f7a197ba req-951853d4-969a-478d-8eab-f92829abc8f2 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:50.604004 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1a9a8932-331c-4341-9349-a120f7a197ba req-951853d4-969a-478d-8eab-f92829abc8f2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:50.604521 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1a9a8932-331c-4341-9349-a120f7a197ba req-951853d4-969a-478d-8eab-f92829abc8f2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:50.620863 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-1a9a8932-331c-4341-9349-a120f7a197ba req-951853d4-969a-478d-8eab-f92829abc8f2 service nova] Creating event network-vif-unplugged:018d9d05-4694-4f6a-8a92-2c61652eab6e for instance 048b3539-80cb-4d73-9280-b62713ddb588 on nch1-master-1 Sep 24 20:54:50.625996 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-1a9a8932-331c-4341-9349-a120f7a197ba req-951853d4-969a-478d-8eab-f92829abc8f2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041604 Sep 24 20:54:50.626954 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 780/1619] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:54:50.678025 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-68bab727-fbc0-461f-91fc-e44d02cfe261 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:50.678682 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-68bab727-fbc0-461f-91fc-e44d02cfe261 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:50.684914 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68bab727-fbc0-461f-91fc-e44d02cfe261 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:50.687695 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68bab727-fbc0-461f-91fc-e44d02cfe261 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:50.691887 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68bab727-fbc0-461f-91fc-e44d02cfe261 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:50.692863 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68bab727-fbc0-461f-91fc-e44d02cfe261 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:50.693350 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68bab727-fbc0-461f-91fc-e44d02cfe261 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:50.693797 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68bab727-fbc0-461f-91fc-e44d02cfe261 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:50.845111 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-5cc0197f-c19d-449f-9bcd-5301d28e860d req-d20fb84c-6c37-4672-aaec-751b7c5f144f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fc32d38-e9c2-4a92-a346-622b7b7206fd", "tag": "ae80193f-701b-44ae-b340-65e79cdd45ec"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:50.869325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-5cc0197f-c19d-449f-9bcd-5301d28e860d req-d20fb84c-6c37-4672-aaec-751b7c5f144f service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:50.871421 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-5cc0197f-c19d-449f-9bcd-5301d28e860d req-d20fb84c-6c37-4672-aaec-751b7c5f144f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:50.873392 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-5cc0197f-c19d-449f-9bcd-5301d28e860d req-d20fb84c-6c37-4672-aaec-751b7c5f144f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:50.903932 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-5cc0197f-c19d-449f-9bcd-5301d28e860d req-d20fb84c-6c37-4672-aaec-751b7c5f144f service nova] Creating event network-changed:ae80193f-701b-44ae-b340-65e79cdd45ec for instance 5fc32d38-e9c2-4a92-a346-622b7b7206fd on nch2-master-1 Sep 24 20:54:50.914475 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-5cc0197f-c19d-449f-9bcd-5301d28e860d req-d20fb84c-6c37-4672-aaec-751b7c5f144f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076359 Sep 24 20:54:50.916384 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 781/1620] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:54:50.947305 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-68bab727-fbc0-461f-91fc-e44d02cfe261 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:50.956816 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-68bab727-fbc0-461f-91fc-e44d02cfe261 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1475 microversion: 2.1 time: 0.282815 Sep 24 20:54:50.957502 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 840/1621] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:50 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1475 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:51.033450 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-be50fe3e-0804-4d97-beb6-1d96da070a7b tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:51.035069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-be50fe3e-0804-4d97-beb6-1d96da070a7b tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 074c501c-cdef-4f19-81e5-8fc2608e9dd1] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:51.043694 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-be50fe3e-0804-4d97-beb6-1d96da070a7b tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:51.047012 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-be50fe3e-0804-4d97-beb6-1d96da070a7b tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:51.047844 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-be50fe3e-0804-4d97-beb6-1d96da070a7b tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:51.048804 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-be50fe3e-0804-4d97-beb6-1d96da070a7b tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:51.050148 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-be50fe3e-0804-4d97-beb6-1d96da070a7b tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:51.051033 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-be50fe3e-0804-4d97-beb6-1d96da070a7b tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:51.142792 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-674953a7-c80f-4176-9a97-b1033179b2ea tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:51.143721 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-674953a7-c80f-4176-9a97-b1033179b2ea tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a89ef546-702c-4ecd-babc-7d523421339b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:51.163650 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-674953a7-c80f-4176-9a97-b1033179b2ea tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:51.164506 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-674953a7-c80f-4176-9a97-b1033179b2ea tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:51.165338 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-674953a7-c80f-4176-9a97-b1033179b2ea tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:51.170293 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-674953a7-c80f-4176-9a97-b1033179b2ea tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:51.171052 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-674953a7-c80f-4176-9a97-b1033179b2ea tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:51.171724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-674953a7-c80f-4176-9a97-b1033179b2ea tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:51.222956 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-674953a7-c80f-4176-9a97-b1033179b2ea tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:51.223955 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-674953a7-c80f-4176-9a97-b1033179b2ea tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:51.224890 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-674953a7-c80f-4176-9a97-b1033179b2ea tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:51.225945 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-674953a7-c80f-4176-9a97-b1033179b2ea tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lazy-loading 'fault' on Instance uuid a89ef546-702c-4ecd-babc-7d523421339b {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:54:51.311828 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-674953a7-c80f-4176-9a97-b1033179b2ea tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:51.325754 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-674953a7-c80f-4176-9a97-b1033179b2ea tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b" status: 200 len: 1306 microversion: 2.1 time: 0.185442 Sep 24 20:54:51.327353 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 841/1622] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:51 2022] GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b => generated 1306 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:51.336967 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-be50fe3e-0804-4d97-beb6-1d96da070a7b tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:51.345787 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d77d726b-5a89-451c-b17c-cd98843f2324 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:51.348128 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d77d726b-5a89-451c-b17c-cd98843f2324 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:51.350956 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-be50fe3e-0804-4d97-beb6-1d96da070a7b tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1" status: 200 len: 1322 microversion: 2.1 time: 0.321908 Sep 24 20:54:51.351832 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 782/1623] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:51 2022] GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1 => generated 1322 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:51.357629 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d77d726b-5a89-451c-b17c-cd98843f2324 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:51.358619 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d77d726b-5a89-451c-b17c-cd98843f2324 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:51.359357 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d77d726b-5a89-451c-b17c-cd98843f2324 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:51.360291 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d77d726b-5a89-451c-b17c-cd98843f2324 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:51.360917 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d77d726b-5a89-451c-b17c-cd98843f2324 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:51.361494 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d77d726b-5a89-451c-b17c-cd98843f2324 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:51.403228 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b29e0a2f-7d27-423c-95a1-c7ef65d0f1d8 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b0ca29c10>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:51.696285 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b29e0a2f-7d27-423c-95a1-c7ef65d0f1d8 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/4efda41f-1d87-450f-8456-2a80880b8c9a" status: 200 len: 1427 microversion: 2.1 time: 0.299757 Sep 24 20:54:51.696856 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 783/1624] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:54:51 2022] GET /compute/v2.1/images/4efda41f-1d87-450f-8456-2a80880b8c9a => generated 1427 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:51.741944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d77d726b-5a89-451c-b17c-cd98843f2324 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:51.750545 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d77d726b-5a89-451c-b17c-cd98843f2324 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1715 microversion: 2.1 time: 0.416637 Sep 24 20:54:51.751134 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 842/1625] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:51 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1715 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:51.983921 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-db008423-7e3d-48a4-8671-b2e8ef8fd482 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:51.984608 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-db008423-7e3d-48a4-8671-b2e8ef8fd482 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:51.991526 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-db008423-7e3d-48a4-8671-b2e8ef8fd482 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:51.992036 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-db008423-7e3d-48a4-8671-b2e8ef8fd482 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:51.992527 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-db008423-7e3d-48a4-8671-b2e8ef8fd482 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:51.993230 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-db008423-7e3d-48a4-8671-b2e8ef8fd482 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:51.993693 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-db008423-7e3d-48a4-8671-b2e8ef8fd482 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:51.994152 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-db008423-7e3d-48a4-8671-b2e8ef8fd482 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:51.998474 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:54:52.159494 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-db008423-7e3d-48a4-8671-b2e8ef8fd482 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:52.169393 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-db008423-7e3d-48a4-8671-b2e8ef8fd482 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1475 microversion: 2.1 time: 0.189564 Sep 24 20:54:52.187389 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 784/1626] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:51 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1475 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:52.351570 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8c6753c5-0e4b-4ab6-a318-8af182b10634 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:52.363282 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8c6753c5-0e4b-4ab6-a318-8af182b10634 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a89ef546-702c-4ecd-babc-7d523421339b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:52.371918 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8c6753c5-0e4b-4ab6-a318-8af182b10634 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:52.372642 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8c6753c5-0e4b-4ab6-a318-8af182b10634 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:52.373672 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8c6753c5-0e4b-4ab6-a318-8af182b10634 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:52.374603 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8c6753c5-0e4b-4ab6-a318-8af182b10634 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:52.378164 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8c6753c5-0e4b-4ab6-a318-8af182b10634 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:52.378965 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8c6753c5-0e4b-4ab6-a318-8af182b10634 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:52.382518 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6f9c4044-a712-4f1b-8fdf-6be710bb1ae0 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:52.384091 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6f9c4044-a712-4f1b-8fdf-6be710bb1ae0 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 074c501c-cdef-4f19-81e5-8fc2608e9dd1] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:52.391769 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f9c4044-a712-4f1b-8fdf-6be710bb1ae0 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:52.393227 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f9c4044-a712-4f1b-8fdf-6be710bb1ae0 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:52.400088 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f9c4044-a712-4f1b-8fdf-6be710bb1ae0 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:52.401258 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f9c4044-a712-4f1b-8fdf-6be710bb1ae0 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:52.402115 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f9c4044-a712-4f1b-8fdf-6be710bb1ae0 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:52.402935 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f9c4044-a712-4f1b-8fdf-6be710bb1ae0 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:52.413382 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-8c6753c5-0e4b-4ab6-a318-8af182b10634 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] HTTP exception thrown: Instance a89ef546-702c-4ecd-babc-7d523421339b could not be found. Sep 24 20:54:52.417080 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8c6753c5-0e4b-4ab6-a318-8af182b10634 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Request method failure captured: Sep 24 20:54:52.417080 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b HTTP/1.1 Sep 24 20:54:52.417080 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:54:52.417080 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:54:52.417080 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:54:52.417080 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:54:52.417080 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:54:52.417080 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:54:52.417080 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:54:52.417080 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:54:52.417080 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL23ty18wZ369rBpsqLlzALGIa2Gim7BSAzth626XfTPt1jl2TGGDfuIK0NF1uBFJTGNmpODfOJmslXLXls2-SCCSRhWzdKVR2lBkl_nLf9Mq1Le-1pWzwdVHhu2NC69cXC874Lb-O01_urLv2faksB3B4Xzjyj58JzXn5kGazzFVV5g Sep 24 20:54:52.417080 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:54:52.417080 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:54:52.417080 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:54:52.417080 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:54:52.417080 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:54:52.417080 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:54:52.417080 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 73bec7c48b07450f95a29a35e113153d Sep 24 20:54:52.417080 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersOnMultiNodesTest-512776478 Sep 24 20:54:52.417080 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:54:52.417080 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:54:52.418441 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/73bec7c48b07450f95a29a35e113153d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_73bec7c48b07450f95a29a35e113153d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/73bec7c48b07450f95a29a35e113153d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/73bec7c48b07450f95a29a35e113153d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:54:52.418441 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersOnMultiNodesTest-512776478 Sep 24 20:54:52.418441 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 73bec7c48b07450f95a29a35e113153d Sep 24 20:54:52.418441 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-512776478 Sep 24 20:54:52.418441 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersOnMultiNodesTest-512776478-project Sep 24 20:54:52.418441 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:54:52.418441 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:54:52.418441 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 936372eff4da45e281fc5512632a12b6 Sep 24 20:54:52.418441 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersOnMultiNodesTest-512776478-project Sep 24 20:54:52.418441 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:54:52.418441 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance a89ef546-702c-4ecd-babc-7d523421339b could not be found. Sep 24 20:54:52.418441 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'a89ef546-702c-4ecd-babc-7d523421339b'} Sep 24 20:54:52.419256 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:54:52.419256 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:52.419256 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:54:52.419256 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:54:52.419256 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:54:52.419256 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:54:52.419256 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:54:52.419256 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:54:52.419256 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:54:52.419256 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:54:52.419256 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a89ef546-702c-4ecd-babc-7d523421339b could not be found. Sep 24 20:54:52.419256 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:54:52.419256 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:54:52.419256 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:54:52.419256 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:52.419256 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:54:52.419256 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:54:52.419256 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:54:52.419256 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:54:52.419256 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:54:52.421998 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:54:52.421998 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:54:52.421998 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:54:52.421998 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:54:52.421998 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:54:52.421998 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:54:52.421998 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:54:52.421998 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a89ef546-702c-4ecd-babc-7d523421339b could not be found. Sep 24 20:54:52.421998 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:54:52.421998 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:54:52.421998 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:54:52.421998 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:52.421998 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:54:52.421998 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:54:52.421998 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:54:52.421998 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:54:52.421998 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a89ef546-702c-4ecd-babc-7d523421339b could not be found. Sep 24 20:54:52.421998 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:54:52.425178 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8c6753c5-0e4b-4ab6-a318-8af182b10634 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Returning 404 to user: Instance a89ef546-702c-4ecd-babc-7d523421339b could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:54:52.425178 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8c6753c5-0e4b-4ab6-a318-8af182b10634 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b" status: 404 len: 111 microversion: 2.1 time: 0.070997 Sep 24 20:54:52.425178 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 843/1627] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:52 2022] GET /compute/v2.1/servers/a89ef546-702c-4ecd-babc-7d523421339b => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:54:52.434527 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f9a65cb8-3dab-42a5-b4a7-d8966cbf8b41 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:52.437147 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f9a65cb8-3dab-42a5-b4a7-d8966cbf8b41 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:52.450732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f9a65cb8-3dab-42a5-b4a7-d8966cbf8b41 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:52.454884 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f9a65cb8-3dab-42a5-b4a7-d8966cbf8b41 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:52.456506 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f9a65cb8-3dab-42a5-b4a7-d8966cbf8b41 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:52.457700 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f9a65cb8-3dab-42a5-b4a7-d8966cbf8b41 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:52.458624 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f9a65cb8-3dab-42a5-b4a7-d8966cbf8b41 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:52.459074 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f9a65cb8-3dab-42a5-b4a7-d8966cbf8b41 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:52.490038 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f9a65cb8-3dab-42a5-b4a7-d8966cbf8b41 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:54:52.589786 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f9a65cb8-3dab-42a5-b4a7-d8966cbf8b41 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d" status: 204 len: 0 microversion: 2.1 time: 0.165418 Sep 24 20:54:52.590939 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 844/1628] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:54:52 2022] DELETE /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:54:52.602788 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-893e0a24-24ca-4bbf-8822-2de65dc7b913 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:52.604372 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-893e0a24-24ca-4bbf-8822-2de65dc7b913 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:52.614102 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-893e0a24-24ca-4bbf-8822-2de65dc7b913 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:52.614660 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-893e0a24-24ca-4bbf-8822-2de65dc7b913 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:52.615110 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-893e0a24-24ca-4bbf-8822-2de65dc7b913 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:52.616027 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-893e0a24-24ca-4bbf-8822-2de65dc7b913 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:52.619463 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-893e0a24-24ca-4bbf-8822-2de65dc7b913 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:52.619463 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-893e0a24-24ca-4bbf-8822-2de65dc7b913 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:52.630621 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6f9c4044-a712-4f1b-8fdf-6be710bb1ae0 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:52.646456 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6f9c4044-a712-4f1b-8fdf-6be710bb1ae0 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1" status: 200 len: 1322 microversion: 2.1 time: 0.270012 Sep 24 20:54:52.647401 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 785/1629] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:52 2022] GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:54:52.713539 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9e590a49-03e6-4145-93c3-3c25c6983570 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b0c4e01f0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:52.764099 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9e590a49-03e6-4145-93c3-3c25c6983570 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/4efda41f-1d87-450f-8456-2a80880b8c9a" status: 200 len: 1427 microversion: 2.1 time: 0.055544 Sep 24 20:54:52.764990 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 786/1630] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:54:52 2022] GET /compute/v2.1/images/4efda41f-1d87-450f-8456-2a80880b8c9a => generated 1427 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:54:52.780542 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8dd98936-2ba8-4ede-9c3c-7e1b41ec71f7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:52.781791 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8dd98936-2ba8-4ede-9c3c-7e1b41ec71f7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:52.790951 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8dd98936-2ba8-4ede-9c3c-7e1b41ec71f7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:52.791574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8dd98936-2ba8-4ede-9c3c-7e1b41ec71f7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:52.791986 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8dd98936-2ba8-4ede-9c3c-7e1b41ec71f7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:52.793508 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8dd98936-2ba8-4ede-9c3c-7e1b41ec71f7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:52.794067 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-893e0a24-24ca-4bbf-8822-2de65dc7b913 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:52.794827 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8dd98936-2ba8-4ede-9c3c-7e1b41ec71f7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:52.795294 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8dd98936-2ba8-4ede-9c3c-7e1b41ec71f7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:52.815874 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-893e0a24-24ca-4bbf-8822-2de65dc7b913 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d" status: 200 len: 1472 microversion: 2.1 time: 0.220046 Sep 24 20:54:52.816508 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 845/1631] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:52 2022] GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d => generated 1472 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:52.953245 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8dd98936-2ba8-4ede-9c3c-7e1b41ec71f7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:52.962923 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8dd98936-2ba8-4ede-9c3c-7e1b41ec71f7 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1715 microversion: 2.1 time: 0.187512 Sep 24 20:54:52.963790 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 787/1632] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:52 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1715 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:53.193349 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-01766f54-4df2-4aeb-af6f-58f46147e915 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:53.194009 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-01766f54-4df2-4aeb-af6f-58f46147e915 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:53.200249 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01766f54-4df2-4aeb-af6f-58f46147e915 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:53.200747 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01766f54-4df2-4aeb-af6f-58f46147e915 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:53.201470 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01766f54-4df2-4aeb-af6f-58f46147e915 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:53.202312 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01766f54-4df2-4aeb-af6f-58f46147e915 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:53.203327 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01766f54-4df2-4aeb-af6f-58f46147e915 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:53.204227 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01766f54-4df2-4aeb-af6f-58f46147e915 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:53.349853 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-01766f54-4df2-4aeb-af6f-58f46147e915 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:53.358833 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-01766f54-4df2-4aeb-af6f-58f46147e915 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1475 microversion: 2.1 time: 0.169507 Sep 24 20:54:53.359482 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 846/1633] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:53 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1475 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:53.669241 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-72826ebe-c575-46fd-87c3-8c00c6c13980 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:53.669953 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-72826ebe-c575-46fd-87c3-8c00c6c13980 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 074c501c-cdef-4f19-81e5-8fc2608e9dd1] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:53.677250 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72826ebe-c575-46fd-87c3-8c00c6c13980 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:53.677730 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72826ebe-c575-46fd-87c3-8c00c6c13980 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:53.678170 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72826ebe-c575-46fd-87c3-8c00c6c13980 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:53.679086 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72826ebe-c575-46fd-87c3-8c00c6c13980 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:53.679571 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72826ebe-c575-46fd-87c3-8c00c6c13980 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:53.680121 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72826ebe-c575-46fd-87c3-8c00c6c13980 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:53.780162 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fdcef1fc-ade3-47f5-9ac5-b31bac5352a2 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b10f6bf70>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:53.835279 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fdcef1fc-ade3-47f5-9ac5-b31bac5352a2 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/4efda41f-1d87-450f-8456-2a80880b8c9a" status: 200 len: 1427 microversion: 2.1 time: 0.058806 Sep 24 20:54:53.843432 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 847/1634] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:54:53 2022] GET /compute/v2.1/images/4efda41f-1d87-450f-8456-2a80880b8c9a => generated 1427 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:54:53.848415 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-72826ebe-c575-46fd-87c3-8c00c6c13980 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:53.848992 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0ebf7c13-ee69-4fe8-97fe-4df4b1b73d13 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:53.849614 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0ebf7c13-ee69-4fe8-97fe-4df4b1b73d13 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:53.856274 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-72826ebe-c575-46fd-87c3-8c00c6c13980 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1" status: 200 len: 1322 microversion: 2.1 time: 0.190824 Sep 24 20:54:53.856854 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 788/1635] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:53 2022] GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:53.856981 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0ebf7c13-ee69-4fe8-97fe-4df4b1b73d13 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:53.870332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0ebf7c13-ee69-4fe8-97fe-4df4b1b73d13 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:53.871116 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0ebf7c13-ee69-4fe8-97fe-4df4b1b73d13 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:53.871915 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0ebf7c13-ee69-4fe8-97fe-4df4b1b73d13 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:53.872417 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0ebf7c13-ee69-4fe8-97fe-4df4b1b73d13 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:53.872880 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0ebf7c13-ee69-4fe8-97fe-4df4b1b73d13 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:53.987179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1444e711-ad2d-4b5b-9103-7b9090e20348 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:53.988126 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1444e711-ad2d-4b5b-9103-7b9090e20348 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:53.994455 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1444e711-ad2d-4b5b-9103-7b9090e20348 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:53.995269 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1444e711-ad2d-4b5b-9103-7b9090e20348 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:53.995876 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1444e711-ad2d-4b5b-9103-7b9090e20348 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:53.996878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1444e711-ad2d-4b5b-9103-7b9090e20348 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:53.997500 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1444e711-ad2d-4b5b-9103-7b9090e20348 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:53.998134 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1444e711-ad2d-4b5b-9103-7b9090e20348 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:54.010291 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0ebf7c13-ee69-4fe8-97fe-4df4b1b73d13 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:54.019503 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0ebf7c13-ee69-4fe8-97fe-4df4b1b73d13 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d" status: 200 len: 1472 microversion: 2.1 time: 0.174013 Sep 24 20:54:54.030714 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 848/1636] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:53 2022] GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d => generated 1472 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:54.153586 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1444e711-ad2d-4b5b-9103-7b9090e20348 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:54.162523 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1444e711-ad2d-4b5b-9103-7b9090e20348 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1705 microversion: 2.1 time: 0.179400 Sep 24 20:54:54.163105 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 789/1637] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:53 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1705 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:54:54.185133 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c108c9b5-821d-4f63-a771-d22d0970a38c tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Calling method '.version_select at 0x7f4b0ceb3940>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:54.188688 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c108c9b5-821d-4f63-a771-d22d0970a38c tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:54.189173 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c108c9b5-821d-4f63-a771-d22d0970a38c tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:54.189610 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c108c9b5-821d-4f63-a771-d22d0970a38c tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:54.202406 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c108c9b5-821d-4f63-a771-d22d0970a38c tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 3505 microversion: 2.1 time: 0.020917 Sep 24 20:54:54.203030 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 849/1638] 10.222.0.52 () {58 vars in 1143 bytes} [Sat Sep 24 20:54:54 2022] GET /compute/v2.1/os-migrations => generated 3505 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:54.218678 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a642d16a-e3b7-4559-8871-0c577c0c23db tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:54.219308 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a642d16a-e3b7-4559-8871-0c577c0c23db tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:54.226663 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a642d16a-e3b7-4559-8871-0c577c0c23db tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:54.226663 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a642d16a-e3b7-4559-8871-0c577c0c23db tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:54.226970 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a642d16a-e3b7-4559-8871-0c577c0c23db tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:54.227683 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a642d16a-e3b7-4559-8871-0c577c0c23db tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:54.228146 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a642d16a-e3b7-4559-8871-0c577c0c23db tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:54.228581 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a642d16a-e3b7-4559-8871-0c577c0c23db tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:54.353343 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-816c925d-4055-4e3c-91c5-7a49c9e99c04 tempest-QuotasAdminTestV236-774709866 tempest-QuotasAdminTestV236-774709866-project-admin] Action: 'update', calling method: .version_select at 0x7f4b1100faf0>, body: {"quota_set": {"ram": "5120"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:54.364708 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a642d16a-e3b7-4559-8871-0c577c0c23db tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1856 microversion: 2.1 time: 0.149698 Sep 24 20:54:54.365299 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 790/1639] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:54 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1856 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:54.383145 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0fc47d4d-6997-4288-9217-46264717dfd9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:54.383811 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0fc47d4d-6997-4288-9217-46264717dfd9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:54.390299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0fc47d4d-6997-4288-9217-46264717dfd9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:54.390847 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0fc47d4d-6997-4288-9217-46264717dfd9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:54.391291 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0fc47d4d-6997-4288-9217-46264717dfd9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:54.392009 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0fc47d4d-6997-4288-9217-46264717dfd9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:54.392481 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0fc47d4d-6997-4288-9217-46264717dfd9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:54.392917 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0fc47d4d-6997-4288-9217-46264717dfd9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:54.427683 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-816c925d-4055-4e3c-91c5-7a49c9e99c04 tempest-QuotasAdminTestV236-774709866 tempest-QuotasAdminTestV236-774709866-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:54.428173 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-816c925d-4055-4e3c-91c5-7a49c9e99c04 tempest-QuotasAdminTestV236-774709866 tempest-QuotasAdminTestV236-774709866-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:54.428620 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-816c925d-4055-4e3c-91c5-7a49c9e99c04 tempest-QuotasAdminTestV236-774709866 tempest-QuotasAdminTestV236-774709866-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:54.429369 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-816c925d-4055-4e3c-91c5-7a49c9e99c04 tempest-QuotasAdminTestV236-774709866 tempest-QuotasAdminTestV236-774709866-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:54.429948 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-816c925d-4055-4e3c-91c5-7a49c9e99c04 tempest-QuotasAdminTestV236-774709866 tempest-QuotasAdminTestV236-774709866-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:54.430385 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-816c925d-4055-4e3c-91c5-7a49c9e99c04 tempest-QuotasAdminTestV236-774709866 tempest-QuotasAdminTestV236-774709866-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:54.483390 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-816c925d-4055-4e3c-91c5-7a49c9e99c04 tempest-QuotasAdminTestV236-774709866 tempest-QuotasAdminTestV236-774709866-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/c2cc93bc366345b2853c71bcbd47dcf6" status: 200 len: 240 microversion: 2.36 time: 0.255415 Sep 24 20:54:54.484009 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 850/1640] 10.222.0.52 () {62 vars in 1303 bytes} [Sat Sep 24 20:54:54 2022] PUT /compute/v2.1/os-quota-sets/c2cc93bc366345b2853c71bcbd47dcf6 => generated 240 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:54:54.489357 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1786aa5d-2d23-45d3-8bcb-0915d22b94da tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:54.490164 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1786aa5d-2d23-45d3-8bcb-0915d22b94da tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:54.496641 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1786aa5d-2d23-45d3-8bcb-0915d22b94da tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:54.497065 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1786aa5d-2d23-45d3-8bcb-0915d22b94da tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:54.497510 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1786aa5d-2d23-45d3-8bcb-0915d22b94da tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:54.498227 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1786aa5d-2d23-45d3-8bcb-0915d22b94da tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:54.498726 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1786aa5d-2d23-45d3-8bcb-0915d22b94da tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:54.499160 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1786aa5d-2d23-45d3-8bcb-0915d22b94da tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:54.551567 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0fc47d4d-6997-4288-9217-46264717dfd9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:54.560177 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0fc47d4d-6997-4288-9217-46264717dfd9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1475 microversion: 2.1 time: 0.180778 Sep 24 20:54:54.560899 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 791/1641] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:54 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1475 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:54:54.568988 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7b429b04-dcaf-4741-847f-a3b6cc08c54c tempest-QuotasAdminTestV236-774709866 tempest-QuotasAdminTestV236-774709866-project-admin] Calling method '.version_select at 0x7f4b0c83f040>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:54.643409 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1786aa5d-2d23-45d3-8bcb-0915d22b94da tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1856 microversion: 2.1 time: 0.158060 Sep 24 20:54:54.644135 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 851/1642] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:54 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1856 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:54.647682 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b429b04-dcaf-4741-847f-a3b6cc08c54c tempest-QuotasAdminTestV236-774709866 tempest-QuotasAdminTestV236-774709866-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:54.648174 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b429b04-dcaf-4741-847f-a3b6cc08c54c tempest-QuotasAdminTestV236-774709866 tempest-QuotasAdminTestV236-774709866-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:54.648895 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b429b04-dcaf-4741-847f-a3b6cc08c54c tempest-QuotasAdminTestV236-774709866 tempest-QuotasAdminTestV236-774709866-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:54.649633 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b429b04-dcaf-4741-847f-a3b6cc08c54c tempest-QuotasAdminTestV236-774709866 tempest-QuotasAdminTestV236-774709866-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:54.650267 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b429b04-dcaf-4741-847f-a3b6cc08c54c tempest-QuotasAdminTestV236-774709866 tempest-QuotasAdminTestV236-774709866-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:54.650737 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b429b04-dcaf-4741-847f-a3b6cc08c54c tempest-QuotasAdminTestV236-774709866 tempest-QuotasAdminTestV236-774709866-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:54.671465 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7b429b04-dcaf-4741-847f-a3b6cc08c54c tempest-QuotasAdminTestV236-774709866 tempest-QuotasAdminTestV236-774709866-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/c2cc93bc366345b2853c71bcbd47dcf6/detail" status: 200 len: 672 microversion: 2.36 time: 0.109158 Sep 24 20:54:54.682527 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 792/1643] 10.222.0.52 () {60 vars in 1304 bytes} [Sat Sep 24 20:54:54 2022] GET /compute/v2.1/os-quota-sets/c2cc93bc366345b2853c71bcbd47dcf6/detail => generated 672 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:54:54.739090 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4edc67bb-6fe7-4999-a2a9-347200c26dae tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:54.739609 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4edc67bb-6fe7-4999-a2a9-347200c26dae tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:54.746779 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4edc67bb-6fe7-4999-a2a9-347200c26dae tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:54.746779 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4edc67bb-6fe7-4999-a2a9-347200c26dae tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:54.746779 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4edc67bb-6fe7-4999-a2a9-347200c26dae tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:54.747251 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4edc67bb-6fe7-4999-a2a9-347200c26dae tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:54.747724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4edc67bb-6fe7-4999-a2a9-347200c26dae tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:54.748162 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4edc67bb-6fe7-4999-a2a9-347200c26dae tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:54.837741 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-364d7a1f-cee2-4188-b440-f29d5d618ec8 tempest-QuotasAdminTestV236-774709866 tempest-QuotasAdminTestV236-774709866-project-admin] Action: 'update', calling method: .version_select at 0x7f4b0cde3dc0>, body: {"quota_set": {"ram": "2048"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:54.896948 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-4edc67bb-6fe7-4999-a2a9-347200c26dae tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lazy-loading 'services' on Instance uuid e72414b7-9fb5-4059-92fe-46b1780543f3 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:54:54.911210 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-364d7a1f-cee2-4188-b440-f29d5d618ec8 tempest-QuotasAdminTestV236-774709866 tempest-QuotasAdminTestV236-774709866-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:54.911840 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-364d7a1f-cee2-4188-b440-f29d5d618ec8 tempest-QuotasAdminTestV236-774709866 tempest-QuotasAdminTestV236-774709866-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:54.912510 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-364d7a1f-cee2-4188-b440-f29d5d618ec8 tempest-QuotasAdminTestV236-774709866 tempest-QuotasAdminTestV236-774709866-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:54.913476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-364d7a1f-cee2-4188-b440-f29d5d618ec8 tempest-QuotasAdminTestV236-774709866 tempest-QuotasAdminTestV236-774709866-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:54.914009 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-364d7a1f-cee2-4188-b440-f29d5d618ec8 tempest-QuotasAdminTestV236-774709866 tempest-QuotasAdminTestV236-774709866-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:54.914531 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-364d7a1f-cee2-4188-b440-f29d5d618ec8 tempest-QuotasAdminTestV236-774709866 tempest-QuotasAdminTestV236-774709866-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:54.951713 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-364d7a1f-cee2-4188-b440-f29d5d618ec8 tempest-QuotasAdminTestV236-774709866 tempest-QuotasAdminTestV236-774709866-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:54.952357 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-364d7a1f-cee2-4188-b440-f29d5d618ec8 tempest-QuotasAdminTestV236-774709866 tempest-QuotasAdminTestV236-774709866-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:54.952891 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-364d7a1f-cee2-4188-b440-f29d5d618ec8 tempest-QuotasAdminTestV236-774709866 tempest-QuotasAdminTestV236-774709866-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:54.953771 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-364d7a1f-cee2-4188-b440-f29d5d618ec8 tempest-QuotasAdminTestV236-774709866 tempest-QuotasAdminTestV236-774709866-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:54.954307 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-364d7a1f-cee2-4188-b440-f29d5d618ec8 tempest-QuotasAdminTestV236-774709866 tempest-QuotasAdminTestV236-774709866-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:54.954840 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-364d7a1f-cee2-4188-b440-f29d5d618ec8 tempest-QuotasAdminTestV236-774709866 tempest-QuotasAdminTestV236-774709866-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:55.019323 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-364d7a1f-cee2-4188-b440-f29d5d618ec8 tempest-QuotasAdminTestV236-774709866 tempest-QuotasAdminTestV236-774709866-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/c2cc93bc366345b2853c71bcbd47dcf6?user_id=3d83fecb4f8b467b8fe86558fc6ec2ba" status: 200 len: 240 microversion: 2.36 time: 0.185286 Sep 24 20:54:55.020301 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 793/1644] 10.222.0.52 () {62 vars in 1384 bytes} [Sat Sep 24 20:54:54 2022] PUT /compute/v2.1/os-quota-sets/c2cc93bc366345b2853c71bcbd47dcf6?user_id=3d83fecb4f8b467b8fe86558fc6ec2ba => generated 240 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:54:55.043082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3e4cdc22-3c77-456d-a2d7-e96f9ad67939 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b0ca29430>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:55.074729 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4edc67bb-6fe7-4999-a2a9-347200c26dae tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3/os-volume_attachments/3c6e1dda-a103-4e0d-b86a-6da231607ef6" status: 202 len: 0 microversion: 2.1 time: 0.338469 Sep 24 20:54:55.077240 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 852/1645] 10.222.0.52 () {58 vars in 1416 bytes} [Sat Sep 24 20:54:54 2022] DELETE /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3/os-volume_attachments/3c6e1dda-a103-4e0d-b86a-6da231607ef6 => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:54:55.086261 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ff945052-3a2c-4fe3-98f2-266525fef797 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:55.089577 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ff945052-3a2c-4fe3-98f2-266525fef797 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 074c501c-cdef-4f19-81e5-8fc2608e9dd1] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:55.107675 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff945052-3a2c-4fe3-98f2-266525fef797 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:55.108177 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff945052-3a2c-4fe3-98f2-266525fef797 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:55.109140 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3e4cdc22-3c77-456d-a2d7-e96f9ad67939 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/4efda41f-1d87-450f-8456-2a80880b8c9a" status: 200 len: 1427 microversion: 2.1 time: 0.087663 Sep 24 20:54:55.109729 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 794/1646] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:54:55 2022] GET /compute/v2.1/images/4efda41f-1d87-450f-8456-2a80880b8c9a => generated 1427 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:55.115188 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e3e3d54b-8bc9-4a8b-9766-335b3697fc61 tempest-QuotasAdminTestV236-774709866 tempest-QuotasAdminTestV236-774709866-project-admin] Calling method '.version_select at 0x7f4b0c4e0790>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:55.118128 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff945052-3a2c-4fe3-98f2-266525fef797 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:55.118946 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff945052-3a2c-4fe3-98f2-266525fef797 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:55.119439 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff945052-3a2c-4fe3-98f2-266525fef797 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:55.119881 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff945052-3a2c-4fe3-98f2-266525fef797 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:55.284947 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e3e3d54b-8bc9-4a8b-9766-335b3697fc61 tempest-QuotasAdminTestV236-774709866 tempest-QuotasAdminTestV236-774709866-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/c2cc93bc366345b2853c71bcbd47dcf6?user_id=3d83fecb4f8b467b8fe86558fc6ec2ba" status: 200 len: 282 microversion: 2.36 time: 0.169778 Sep 24 20:54:55.285642 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 795/1647] 10.222.0.52 () {60 vars in 1364 bytes} [Sat Sep 24 20:54:55 2022] GET /compute/v2.1/os-quota-sets/c2cc93bc366345b2853c71bcbd47dcf6?user_id=3d83fecb4f8b467b8fe86558fc6ec2ba => generated 282 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:54:55.294157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-57695c57-8158-4e8c-9f84-1d12e6ee5c1d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:55.298816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-57695c57-8158-4e8c-9f84-1d12e6ee5c1d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:55.314190 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-57695c57-8158-4e8c-9f84-1d12e6ee5c1d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:55.314734 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-57695c57-8158-4e8c-9f84-1d12e6ee5c1d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:55.317366 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-57695c57-8158-4e8c-9f84-1d12e6ee5c1d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:55.318162 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-57695c57-8158-4e8c-9f84-1d12e6ee5c1d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:55.320506 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-57695c57-8158-4e8c-9f84-1d12e6ee5c1d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:55.322471 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-57695c57-8158-4e8c-9f84-1d12e6ee5c1d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:55.332321 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ff945052-3a2c-4fe3-98f2-266525fef797 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:55.343727 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ff945052-3a2c-4fe3-98f2-266525fef797 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1" status: 200 len: 1322 microversion: 2.1 time: 0.264938 Sep 24 20:54:55.346366 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 853/1648] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:55 2022] GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1 => generated 1322 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:55.369457 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bd69f1d9-cb72-47bc-ad3a-45ff723b2ce2 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:55.373180 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bd69f1d9-cb72-47bc-ad3a-45ff723b2ce2 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:55.381576 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bd69f1d9-cb72-47bc-ad3a-45ff723b2ce2 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:55.382378 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bd69f1d9-cb72-47bc-ad3a-45ff723b2ce2 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:55.383058 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bd69f1d9-cb72-47bc-ad3a-45ff723b2ce2 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:55.384167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bd69f1d9-cb72-47bc-ad3a-45ff723b2ce2 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:55.384732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bd69f1d9-cb72-47bc-ad3a-45ff723b2ce2 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:55.385267 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bd69f1d9-cb72-47bc-ad3a-45ff723b2ce2 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:55.424007 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bd69f1d9-cb72-47bc-ad3a-45ff723b2ce2 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058453 Sep 24 20:54:55.431523 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 854/1649] 10.222.0.52 () {58 vars in 1302 bytes} [Sat Sep 24 20:54:55 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:54:55.439333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-577e8d04-0f3e-444d-b442-8153ed536b6b req-53adc7b9-3b09-4533-ac60-7a21ed43eda3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "074c501c-cdef-4f19-81e5-8fc2608e9dd1", "name": "network-vif-plugged", "status": "completed", "tag": "d2003e83-fec4-44ef-a623-62218b581c9b"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:55.465515 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-577e8d04-0f3e-444d-b442-8153ed536b6b req-53adc7b9-3b09-4533-ac60-7a21ed43eda3 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:55.466337 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-577e8d04-0f3e-444d-b442-8153ed536b6b req-53adc7b9-3b09-4533-ac60-7a21ed43eda3 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:55.467017 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-577e8d04-0f3e-444d-b442-8153ed536b6b req-53adc7b9-3b09-4533-ac60-7a21ed43eda3 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:55.482705 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-577e8d04-0f3e-444d-b442-8153ed536b6b req-53adc7b9-3b09-4533-ac60-7a21ed43eda3 service nova] Creating event network-vif-plugged:d2003e83-fec4-44ef-a623-62218b581c9b for instance 074c501c-cdef-4f19-81e5-8fc2608e9dd1 on nch1-master-1 Sep 24 20:54:55.488872 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-577e8d04-0f3e-444d-b442-8153ed536b6b req-53adc7b9-3b09-4533-ac60-7a21ed43eda3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055004 Sep 24 20:54:55.489714 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 855/1650] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:54:55.517683 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-57695c57-8158-4e8c-9f84-1d12e6ee5c1d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:55.528713 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-57695c57-8158-4e8c-9f84-1d12e6ee5c1d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d" status: 200 len: 1472 microversion: 2.1 time: 0.242020 Sep 24 20:54:55.529794 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 796/1651] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:55 2022] GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d => generated 1472 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:55.586452 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-087ddef6-fa6b-4b77-81a4-cc3d0f495033 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:55.587470 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-087ddef6-fa6b-4b77-81a4-cc3d0f495033 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:55.594754 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-087ddef6-fa6b-4b77-81a4-cc3d0f495033 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:55.597139 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-087ddef6-fa6b-4b77-81a4-cc3d0f495033 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:55.597698 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-087ddef6-fa6b-4b77-81a4-cc3d0f495033 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:55.598442 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-087ddef6-fa6b-4b77-81a4-cc3d0f495033 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:55.600053 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-087ddef6-fa6b-4b77-81a4-cc3d0f495033 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:55.600830 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-087ddef6-fa6b-4b77-81a4-cc3d0f495033 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:55.783559 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-087ddef6-fa6b-4b77-81a4-cc3d0f495033 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:55.795479 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:54:55.802638 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-087ddef6-fa6b-4b77-81a4-cc3d0f495033 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1475 microversion: 2.1 time: 0.220876 Sep 24 20:54:55.815539 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 856/1652] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:55 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1475 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:55.883876 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-b2e88124-9861-4a93-9909-a5532fedcdd6 req-5fbba7d8-c44e-46dc-9fbf-46e6f8c38030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d", "name": "network-vif-deleted", "tag": "6f3a76e4-02e8-411b-ac48-84a50c0d2403"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:55.891859 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:54:55.900617 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-b2e88124-9861-4a93-9909-a5532fedcdd6 req-5fbba7d8-c44e-46dc-9fbf-46e6f8c38030 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:55.901176 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-b2e88124-9861-4a93-9909-a5532fedcdd6 req-5fbba7d8-c44e-46dc-9fbf-46e6f8c38030 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:55.901624 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-b2e88124-9861-4a93-9909-a5532fedcdd6 req-5fbba7d8-c44e-46dc-9fbf-46e6f8c38030 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:55.916263 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-b2e88124-9861-4a93-9909-a5532fedcdd6 req-5fbba7d8-c44e-46dc-9fbf-46e6f8c38030 service nova] Creating event network-vif-deleted:6f3a76e4-02e8-411b-ac48-84a50c0d2403 for instance cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d on nch2-master-1 Sep 24 20:54:55.921819 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-b2e88124-9861-4a93-9909-a5532fedcdd6 req-5fbba7d8-c44e-46dc-9fbf-46e6f8c38030 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044180 Sep 24 20:54:55.922763 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 797/1653] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:54:56.139647 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-09e620df-f772-4e19-9231-b05c5be714db tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b10f6bdc0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:56.229742 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-09e620df-f772-4e19-9231-b05c5be714db tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/4efda41f-1d87-450f-8456-2a80880b8c9a" status: 200 len: 1427 microversion: 2.1 time: 0.108157 Sep 24 20:54:56.239026 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 857/1654] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:54:56 2022] GET /compute/v2.1/images/4efda41f-1d87-450f-8456-2a80880b8c9a => generated 1427 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:56.375437 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-af552c5f-b208-4c65-9db6-c17ce2422b68 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:56.376078 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-af552c5f-b208-4c65-9db6-c17ce2422b68 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 074c501c-cdef-4f19-81e5-8fc2608e9dd1] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:56.395577 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af552c5f-b208-4c65-9db6-c17ce2422b68 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:56.399884 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af552c5f-b208-4c65-9db6-c17ce2422b68 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:56.400543 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af552c5f-b208-4c65-9db6-c17ce2422b68 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:56.401326 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af552c5f-b208-4c65-9db6-c17ce2422b68 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:56.401800 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af552c5f-b208-4c65-9db6-c17ce2422b68 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:56.402240 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af552c5f-b208-4c65-9db6-c17ce2422b68 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:56.439405 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7a364643-2339-4826-a311-0cc8d3a58d91 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:56.442717 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7a364643-2339-4826-a311-0cc8d3a58d91 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:56.452139 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7a364643-2339-4826-a311-0cc8d3a58d91 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:56.453502 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7a364643-2339-4826-a311-0cc8d3a58d91 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:56.454527 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7a364643-2339-4826-a311-0cc8d3a58d91 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:56.455897 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7a364643-2339-4826-a311-0cc8d3a58d91 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:56.456723 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7a364643-2339-4826-a311-0cc8d3a58d91 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:56.468195 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7a364643-2339-4826-a311-0cc8d3a58d91 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:56.506368 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7a364643-2339-4826-a311-0cc8d3a58d91 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072066 Sep 24 20:54:56.506982 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 858/1655] 10.222.0.52 () {58 vars in 1302 bytes} [Sat Sep 24 20:54:56 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:54:56.552985 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6b5ab573-235b-4066-a10d-c5c878d03f7f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:56.553631 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6b5ab573-235b-4066-a10d-c5c878d03f7f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:56.563208 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b5ab573-235b-4066-a10d-c5c878d03f7f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:56.564267 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b5ab573-235b-4066-a10d-c5c878d03f7f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:56.564460 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b5ab573-235b-4066-a10d-c5c878d03f7f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:56.565442 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b5ab573-235b-4066-a10d-c5c878d03f7f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:56.566098 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b5ab573-235b-4066-a10d-c5c878d03f7f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:56.566708 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b5ab573-235b-4066-a10d-c5c878d03f7f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:56.610407 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b5ab573-235b-4066-a10d-c5c878d03f7f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:56.611281 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b5ab573-235b-4066-a10d-c5c878d03f7f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:56.611879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b5ab573-235b-4066-a10d-c5c878d03f7f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:56.613204 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-6b5ab573-235b-4066-a10d-c5c878d03f7f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lazy-loading 'fault' on Instance uuid cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:54:56.666828 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-af552c5f-b208-4c65-9db6-c17ce2422b68 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:56.676004 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-af552c5f-b208-4c65-9db6-c17ce2422b68 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1" status: 200 len: 1322 microversion: 2.1 time: 0.308083 Sep 24 20:54:56.676588 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 798/1656] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:56 2022] GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1 => generated 1322 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:56.688884 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6b5ab573-235b-4066-a10d-c5c878d03f7f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:56.704752 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6b5ab573-235b-4066-a10d-c5c878d03f7f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d" status: 200 len: 1306 microversion: 2.1 time: 0.155938 Sep 24 20:54:56.705691 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 859/1657] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:56 2022] GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d => generated 1306 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:54:56.826486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-780b9bd9-5442-4e55-830a-b0b068991ae2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:56.827149 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-780b9bd9-5442-4e55-830a-b0b068991ae2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:56.836002 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-780b9bd9-5442-4e55-830a-b0b068991ae2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:56.836540 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-780b9bd9-5442-4e55-830a-b0b068991ae2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:56.836942 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-780b9bd9-5442-4e55-830a-b0b068991ae2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:56.837732 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-780b9bd9-5442-4e55-830a-b0b068991ae2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:56.838191 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-780b9bd9-5442-4e55-830a-b0b068991ae2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:56.838656 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-780b9bd9-5442-4e55-830a-b0b068991ae2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:56.992840 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-780b9bd9-5442-4e55-830a-b0b068991ae2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:57.001751 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-780b9bd9-5442-4e55-830a-b0b068991ae2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1475 microversion: 2.1 time: 0.179130 Sep 24 20:54:57.002333 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 799/1658] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:56 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1475 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:57.245451 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-872a039a-f3f5-4500-ad27-6e02e4758805 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b10f5a3a0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:57.292523 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-872a039a-f3f5-4500-ad27-6e02e4758805 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/4efda41f-1d87-450f-8456-2a80880b8c9a" status: 200 len: 1427 microversion: 2.1 time: 0.051114 Sep 24 20:54:57.293102 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 860/1659] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:54:57 2022] GET /compute/v2.1/images/4efda41f-1d87-450f-8456-2a80880b8c9a => generated 1427 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:57.518227 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a8dd9243-69b1-45c9-b99f-2a01ad008567 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:57.520595 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a8dd9243-69b1-45c9-b99f-2a01ad008567 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:57.527103 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a8dd9243-69b1-45c9-b99f-2a01ad008567 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:57.527594 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a8dd9243-69b1-45c9-b99f-2a01ad008567 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:57.528042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a8dd9243-69b1-45c9-b99f-2a01ad008567 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:57.528752 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a8dd9243-69b1-45c9-b99f-2a01ad008567 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:57.529217 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a8dd9243-69b1-45c9-b99f-2a01ad008567 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:57.529651 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a8dd9243-69b1-45c9-b99f-2a01ad008567 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:57.562909 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a8dd9243-69b1-45c9-b99f-2a01ad008567 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048605 Sep 24 20:54:57.563671 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 800/1660] 10.222.0.52 () {58 vars in 1302 bytes} [Sat Sep 24 20:54:57 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 24 20:54:57.699759 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5beafc0b-c5d2-4cb3-8eed-1fa3e542a76f tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:57.700661 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5beafc0b-c5d2-4cb3-8eed-1fa3e542a76f tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 074c501c-cdef-4f19-81e5-8fc2608e9dd1] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:57.708451 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5beafc0b-c5d2-4cb3-8eed-1fa3e542a76f tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:57.709186 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5beafc0b-c5d2-4cb3-8eed-1fa3e542a76f tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:57.709996 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5beafc0b-c5d2-4cb3-8eed-1fa3e542a76f tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:57.711020 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5beafc0b-c5d2-4cb3-8eed-1fa3e542a76f tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:57.711648 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5beafc0b-c5d2-4cb3-8eed-1fa3e542a76f tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:57.712198 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5beafc0b-c5d2-4cb3-8eed-1fa3e542a76f tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:57.729788 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c9b94e8a-6445-46eb-b1e3-ab34fd5ead4e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:57.730416 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c9b94e8a-6445-46eb-b1e3-ab34fd5ead4e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:57.738620 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c9b94e8a-6445-46eb-b1e3-ab34fd5ead4e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:57.739332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c9b94e8a-6445-46eb-b1e3-ab34fd5ead4e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:57.740084 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c9b94e8a-6445-46eb-b1e3-ab34fd5ead4e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:57.741072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c9b94e8a-6445-46eb-b1e3-ab34fd5ead4e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:57.742152 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c9b94e8a-6445-46eb-b1e3-ab34fd5ead4e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:57.742827 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c9b94e8a-6445-46eb-b1e3-ab34fd5ead4e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:57.761157 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-c9b94e8a-6445-46eb-b1e3-ab34fd5ead4e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] HTTP exception thrown: Instance cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d could not be found. Sep 24 20:54:57.763395 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c9b94e8a-6445-46eb-b1e3-ab34fd5ead4e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Request method failure captured: Sep 24 20:54:57.763395 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d HTTP/1.1 Sep 24 20:54:57.763395 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:54:57.763395 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:54:57.763395 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:54:57.763395 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:54:57.763395 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:54:57.763395 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:54:57.763395 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:54:57.763395 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:54:57.763395 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL23ty18wZ369rBpsqLlzALGIa2Gim7BSAzth626XfTPt1jl2TGGDfuIK0NF1uBFJTGNmpODfOJmslXLXls2-SCCSRhWzdKVR2lBkl_nLf9Mq1Le-1pWzwdVHhu2NC69cXC874Lb-O01_urLv2faksB3B4Xzjyj58JzXn5kGazzFVV5g Sep 24 20:54:57.763395 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:54:57.763395 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:54:57.763395 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:54:57.763395 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:54:57.763395 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:54:57.763395 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:54:57.763395 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 73bec7c48b07450f95a29a35e113153d Sep 24 20:54:57.763395 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersOnMultiNodesTest-512776478 Sep 24 20:54:57.763395 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:54:57.763395 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:54:57.765070 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/73bec7c48b07450f95a29a35e113153d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_73bec7c48b07450f95a29a35e113153d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/73bec7c48b07450f95a29a35e113153d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/73bec7c48b07450f95a29a35e113153d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:54:57.765070 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersOnMultiNodesTest-512776478 Sep 24 20:54:57.765070 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 73bec7c48b07450f95a29a35e113153d Sep 24 20:54:57.765070 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-512776478 Sep 24 20:54:57.765070 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersOnMultiNodesTest-512776478-project Sep 24 20:54:57.765070 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:54:57.765070 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:54:57.765070 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 936372eff4da45e281fc5512632a12b6 Sep 24 20:54:57.765070 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersOnMultiNodesTest-512776478-project Sep 24 20:54:57.765070 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:54:57.765070 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d could not be found. Sep 24 20:54:57.765070 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d'} Sep 24 20:54:57.766013 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:54:57.766013 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:57.766013 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:54:57.766013 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:54:57.766013 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:54:57.766013 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:54:57.766013 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:54:57.766013 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:54:57.766013 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:54:57.766013 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:54:57.766013 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d could not be found. Sep 24 20:54:57.766013 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:57.766013 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:54:57.766013 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:57.766013 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:57.766013 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:54:57.766013 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:54:57.766013 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:54:57.766013 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:54:57.766013 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:54:57.767563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:54:57.767563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:54:57.767563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:54:57.767563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:54:57.767563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:54:57.767563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:54:57.767563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:54:57.767563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d could not be found. Sep 24 20:54:57.767563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:57.767563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:54:57.767563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:57.767563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:54:57.767563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:54:57.767563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:54:57.767563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:54:57.767563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:54:57.767563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d could not be found. Sep 24 20:54:57.767563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:54:57.769056 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c9b94e8a-6445-46eb-b1e3-ab34fd5ead4e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Returning 404 to user: Instance cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:54:57.769056 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c9b94e8a-6445-46eb-b1e3-ab34fd5ead4e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d" status: 404 len: 111 microversion: 2.1 time: 0.040716 Sep 24 20:54:57.769056 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 801/1661] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:57 2022] GET /compute/v2.1/servers/cd6bf9bf-ac2c-4d7b-b16b-4dd061fb2e5d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 20:54:57.774732 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7ccad21f-e060-4562-ba63-0c9e5a28dd40 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:57.775236 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7ccad21f-e060-4562-ba63-0c9e5a28dd40 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 7505ad12-d1c7-4dad-b0b8-e797560e5274] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:57.781433 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ccad21f-e060-4562-ba63-0c9e5a28dd40 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:57.781934 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ccad21f-e060-4562-ba63-0c9e5a28dd40 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:57.782713 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ccad21f-e060-4562-ba63-0c9e5a28dd40 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:57.783446 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ccad21f-e060-4562-ba63-0c9e5a28dd40 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:57.783814 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ccad21f-e060-4562-ba63-0c9e5a28dd40 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:57.784504 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ccad21f-e060-4562-ba63-0c9e5a28dd40 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:57.817894 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7ccad21f-e060-4562-ba63-0c9e5a28dd40 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 7505ad12-d1c7-4dad-b0b8-e797560e5274] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:54:57.898228 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5beafc0b-c5d2-4cb3-8eed-1fa3e542a76f tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:57.911470 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5beafc0b-c5d2-4cb3-8eed-1fa3e542a76f tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1" status: 200 len: 1322 microversion: 2.1 time: 0.215944 Sep 24 20:54:57.915116 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 861/1662] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:57 2022] GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:57.933646 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7ccad21f-e060-4562-ba63-0c9e5a28dd40 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274" status: 204 len: 0 microversion: 2.1 time: 0.157254 Sep 24 20:54:57.933646 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 802/1663] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:54:57 2022] DELETE /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 24 20:54:57.938390 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d860d3ec-c1af-4588-833b-5d5a07554a56 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:57.939372 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d860d3ec-c1af-4588-833b-5d5a07554a56 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 7505ad12-d1c7-4dad-b0b8-e797560e5274] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:57.948101 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d860d3ec-c1af-4588-833b-5d5a07554a56 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:57.949075 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d860d3ec-c1af-4588-833b-5d5a07554a56 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:57.949829 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d860d3ec-c1af-4588-833b-5d5a07554a56 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:57.951188 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d860d3ec-c1af-4588-833b-5d5a07554a56 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:57.951915 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d860d3ec-c1af-4588-833b-5d5a07554a56 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:57.952888 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d860d3ec-c1af-4588-833b-5d5a07554a56 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:58.026453 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-aee3d0f6-ca57-44b1-ba03-f5d6fc5904ba tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:58.027279 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-aee3d0f6-ca57-44b1-ba03-f5d6fc5904ba tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:58.036775 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aee3d0f6-ca57-44b1-ba03-f5d6fc5904ba tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:58.037300 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aee3d0f6-ca57-44b1-ba03-f5d6fc5904ba tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:58.038537 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aee3d0f6-ca57-44b1-ba03-f5d6fc5904ba tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:58.039636 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aee3d0f6-ca57-44b1-ba03-f5d6fc5904ba tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:58.040216 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aee3d0f6-ca57-44b1-ba03-f5d6fc5904ba tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:58.040652 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aee3d0f6-ca57-44b1-ba03-f5d6fc5904ba tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:58.160195 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d860d3ec-c1af-4588-833b-5d5a07554a56 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:58.168433 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d860d3ec-c1af-4588-833b-5d5a07554a56 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274" status: 200 len: 1472 microversion: 2.1 time: 0.234558 Sep 24 20:54:58.169017 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 862/1664] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:57 2022] GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274 => generated 1472 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:58.232384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-aee3d0f6-ca57-44b1-ba03-f5d6fc5904ba tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:58.249474 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-aee3d0f6-ca57-44b1-ba03-f5d6fc5904ba tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1475 microversion: 2.1 time: 0.227667 Sep 24 20:54:58.250061 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 803/1665] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:58 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1475 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:54:58.310889 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-213e126c-0f87-4523-a9d8-b1fd26227d68 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b1100af70>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:58.367521 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-213e126c-0f87-4523-a9d8-b1fd26227d68 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/4efda41f-1d87-450f-8456-2a80880b8c9a" status: 200 len: 1427 microversion: 2.1 time: 0.062203 Sep 24 20:54:58.368363 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 863/1666] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:54:58 2022] GET /compute/v2.1/images/4efda41f-1d87-450f-8456-2a80880b8c9a => generated 1427 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:58.942314 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-76152def-2d8b-40d2-9712-94017fe158b4 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:58.942888 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-76152def-2d8b-40d2-9712-94017fe158b4 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 074c501c-cdef-4f19-81e5-8fc2608e9dd1] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:58.950892 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76152def-2d8b-40d2-9712-94017fe158b4 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:58.951662 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76152def-2d8b-40d2-9712-94017fe158b4 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:58.952267 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76152def-2d8b-40d2-9712-94017fe158b4 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:58.953160 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76152def-2d8b-40d2-9712-94017fe158b4 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:58.953779 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76152def-2d8b-40d2-9712-94017fe158b4 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:58.954371 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76152def-2d8b-40d2-9712-94017fe158b4 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:58.977702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:54:59.139274 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-76152def-2d8b-40d2-9712-94017fe158b4 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:59.148549 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-76152def-2d8b-40d2-9712-94017fe158b4 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1" status: 200 len: 1472 microversion: 2.1 time: 0.211298 Sep 24 20:54:59.163853 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 804/1667] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:58 2022] GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1 => generated 1472 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:54:59.172851 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-14d97985-3e1d-49b2-9d76-48aac26b019d tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:59.173403 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-14d97985-3e1d-49b2-9d76-48aac26b019d tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] [instance: 074c501c-cdef-4f19-81e5-8fc2608e9dd1] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:59.180480 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-14d97985-3e1d-49b2-9d76-48aac26b019d tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:59.183454 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-14d97985-3e1d-49b2-9d76-48aac26b019d tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:59.186620 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-14d97985-3e1d-49b2-9d76-48aac26b019d tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:59.186999 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-14d97985-3e1d-49b2-9d76-48aac26b019d tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:59.187465 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-14d97985-3e1d-49b2-9d76-48aac26b019d tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:59.187899 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-14d97985-3e1d-49b2-9d76-48aac26b019d tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:59.214744 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-14d97985-3e1d-49b2-9d76-48aac26b019d tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Lazy-loading 'flavor' on Instance uuid 074c501c-cdef-4f19-81e5-8fc2608e9dd1 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:54:59.218663 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-43a32652-d93f-4e23-859e-bf3b2f402857 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-396197801", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:54:59.283279 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-43a32652-d93f-4e23-859e-bf3b2f402857 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] validate_networks() for None {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:54:59.296796 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-14d97985-3e1d-49b2-9d76-48aac26b019d tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1/action" status: 202 len: 0 microversion: 2.1 time: 0.127732 Sep 24 20:54:59.297446 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 805/1668] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:54:59 2022] POST /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 20:54:59.305023 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-72ee5854-ca50-4531-b407-36f445c61f4f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:59.306092 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-72ee5854-ca50-4531-b407-36f445c61f4f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 7505ad12-d1c7-4dad-b0b8-e797560e5274] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:59.314458 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72ee5854-ca50-4531-b407-36f445c61f4f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:59.314988 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72ee5854-ca50-4531-b407-36f445c61f4f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:59.316059 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72ee5854-ca50-4531-b407-36f445c61f4f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:59.316797 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72ee5854-ca50-4531-b407-36f445c61f4f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:59.317542 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72ee5854-ca50-4531-b407-36f445c61f4f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:59.317976 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72ee5854-ca50-4531-b407-36f445c61f4f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:59.561428 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-72ee5854-ca50-4531-b407-36f445c61f4f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:59.571011 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-72ee5854-ca50-4531-b407-36f445c61f4f tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274" status: 200 len: 1472 microversion: 2.1 time: 0.271954 Sep 24 20:54:59.571945 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 806/1669] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:59 2022] GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274 => generated 1472 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:54:59.576782 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b4a476bc-daa8-470f-afd5-d35785e3719e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:54:59.577472 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b4a476bc-daa8-470f-afd5-d35785e3719e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:54:59.583934 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b4a476bc-daa8-470f-afd5-d35785e3719e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:59.584723 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b4a476bc-daa8-470f-afd5-d35785e3719e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:59.585635 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b4a476bc-daa8-470f-afd5-d35785e3719e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:59.591882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b4a476bc-daa8-470f-afd5-d35785e3719e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:59.593115 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b4a476bc-daa8-470f-afd5-d35785e3719e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:59.593840 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b4a476bc-daa8-470f-afd5-d35785e3719e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:59.896634 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-43a32652-d93f-4e23-859e-bf3b2f402857 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:54:59.907570 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-43a32652-d93f-4e23-859e-bf3b2f402857 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:54:59.909916 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-43a32652-d93f-4e23-859e-bf3b2f402857 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:54:59.910382 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-43a32652-d93f-4e23-859e-bf3b2f402857 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:54:59.918083 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-43a32652-d93f-4e23-859e-bf3b2f402857 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:54:59.938438 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-43a32652-d93f-4e23-859e-bf3b2f402857 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:59.939077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-43a32652-d93f-4e23-859e-bf3b2f402857 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:59.939754 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-43a32652-d93f-4e23-859e-bf3b2f402857 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:59.941093 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-43a32652-d93f-4e23-859e-bf3b2f402857 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:54:59.941567 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-43a32652-d93f-4e23-859e-bf3b2f402857 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:54:59.941996 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-43a32652-d93f-4e23-859e-bf3b2f402857 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:54:59.967810 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-43a32652-d93f-4e23-859e-bf3b2f402857 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Getting quotas for project dccf2c674b1748c6b6e0b33e05e02940. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:54:59.974985 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-43a32652-d93f-4e23-859e-bf3b2f402857 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Getting quotas for user 8a0244a0ef19409a8a6e7c6526685919 and project dccf2c674b1748c6b6e0b33e05e02940. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:54:59.994530 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-43a32652-d93f-4e23-859e-bf3b2f402857 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:54:59.995961 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b4a476bc-daa8-470f-afd5-d35785e3719e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:54:59.997343 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-43a32652-d93f-4e23-859e-bf3b2f402857 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] [instance: 01455b1b-b319-4297-bd83-5471b441eb12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:55:00.007031 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b4a476bc-daa8-470f-afd5-d35785e3719e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1475 microversion: 2.1 time: 0.433980 Sep 24 20:55:00.008337 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 807/1670] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:54:59 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1475 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:00.013668 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8d2a4240-fec3-47d9-8cdb-25fe31de0d03 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:00.014573 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8d2a4240-fec3-47d9-8cdb-25fe31de0d03 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] [instance: 074c501c-cdef-4f19-81e5-8fc2608e9dd1] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:00.022782 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d2a4240-fec3-47d9-8cdb-25fe31de0d03 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:00.023651 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d2a4240-fec3-47d9-8cdb-25fe31de0d03 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:00.024742 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d2a4240-fec3-47d9-8cdb-25fe31de0d03 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:00.025910 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d2a4240-fec3-47d9-8cdb-25fe31de0d03 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:00.027327 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d2a4240-fec3-47d9-8cdb-25fe31de0d03 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:00.028324 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d2a4240-fec3-47d9-8cdb-25fe31de0d03 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:00.055780 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-43a32652-d93f-4e23-859e-bf3b2f402857 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.981055 Sep 24 20:55:00.056858 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 864/1671] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:54:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:55:00.061526 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d522d62f-cdb1-4b44-b57d-4b310a1f3f48 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b10f6bd30>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:00.145389 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d522d62f-cdb1-4b44-b57d-4b310a1f3f48 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/4efda41f-1d87-450f-8456-2a80880b8c9a" status: 200 len: 1427 microversion: 2.1 time: 0.087191 Sep 24 20:55:00.146199 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 865/1672] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:55:00 2022] GET /compute/v2.1/images/4efda41f-1d87-450f-8456-2a80880b8c9a => generated 1427 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:00.156979 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fd9f1041-541d-4139-95f7-fdfb8a1e4c18 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:00.160300 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fd9f1041-541d-4139-95f7-fdfb8a1e4c18 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] [instance: 01455b1b-b319-4297-bd83-5471b441eb12] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:00.243962 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fd9f1041-541d-4139-95f7-fdfb8a1e4c18 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0244a0ef19409a8a6e7c6526685919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccf2c674b1748c6b6e0b33e05e02940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:00.254694 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fd9f1041-541d-4139-95f7-fdfb8a1e4c18 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] 10.222.0.52 "GET /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12" status: 200 len: 1222 microversion: 2.1 time: 0.106816 Sep 24 20:55:00.257570 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 866/1673] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:00 2022] GET /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12 => generated 1222 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:00.396003 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-61c87d45-ed56-405d-b230-0353aa901cd5 req-a60e9d2a-fc67-4c63-895e-085de2928373 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7505ad12-d1c7-4dad-b0b8-e797560e5274", "name": "network-vif-deleted", "tag": "a03de1a2-dcb4-4c5f-9261-079c2c97a272"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:55:00.431065 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8d2a4240-fec3-47d9-8cdb-25fe31de0d03 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1" status: 200 len: 1631 microversion: 2.1 time: 0.417482 Sep 24 20:55:00.432346 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 808/1674] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:00 2022] GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1 => generated 1631 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:00.432970 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-61c87d45-ed56-405d-b230-0353aa901cd5 req-a60e9d2a-fc67-4c63-895e-085de2928373 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:00.433679 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-61c87d45-ed56-405d-b230-0353aa901cd5 req-a60e9d2a-fc67-4c63-895e-085de2928373 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:00.434374 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-61c87d45-ed56-405d-b230-0353aa901cd5 req-a60e9d2a-fc67-4c63-895e-085de2928373 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:00.452227 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-61c87d45-ed56-405d-b230-0353aa901cd5 req-a60e9d2a-fc67-4c63-895e-085de2928373 service nova] Creating event network-vif-deleted:a03de1a2-dcb4-4c5f-9261-079c2c97a272 for instance 7505ad12-d1c7-4dad-b0b8-e797560e5274 on nch2-master-1 Sep 24 20:55:00.472863 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-61c87d45-ed56-405d-b230-0353aa901cd5 req-a60e9d2a-fc67-4c63-895e-085de2928373 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085021 Sep 24 20:55:00.477324 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 867/1675] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:55:00.595462 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c542b60c-1c56-41a4-a37f-b4e1d38693bb tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:00.607571 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c542b60c-1c56-41a4-a37f-b4e1d38693bb tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 7505ad12-d1c7-4dad-b0b8-e797560e5274] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:00.623177 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c542b60c-1c56-41a4-a37f-b4e1d38693bb tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:00.623680 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c542b60c-1c56-41a4-a37f-b4e1d38693bb tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:00.624121 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c542b60c-1c56-41a4-a37f-b4e1d38693bb tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:00.626525 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c542b60c-1c56-41a4-a37f-b4e1d38693bb tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:00.627174 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c542b60c-1c56-41a4-a37f-b4e1d38693bb tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:00.645751 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c542b60c-1c56-41a4-a37f-b4e1d38693bb tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:00.715116 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c542b60c-1c56-41a4-a37f-b4e1d38693bb tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:00.715862 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c542b60c-1c56-41a4-a37f-b4e1d38693bb tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:00.717046 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c542b60c-1c56-41a4-a37f-b4e1d38693bb tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:00.729380 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-c542b60c-1c56-41a4-a37f-b4e1d38693bb tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lazy-loading 'fault' on Instance uuid 7505ad12-d1c7-4dad-b0b8-e797560e5274 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:55:00.834101 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c542b60c-1c56-41a4-a37f-b4e1d38693bb tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:00.846045 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c542b60c-1c56-41a4-a37f-b4e1d38693bb tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274" status: 200 len: 1306 microversion: 2.1 time: 0.254721 Sep 24 20:55:00.848952 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 809/1676] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:00 2022] GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274 => generated 1306 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:01.037724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9d6de3c8-06c1-4fbb-8d8e-add51b83a67e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:01.040039 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9d6de3c8-06c1-4fbb-8d8e-add51b83a67e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:01.057495 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d6de3c8-06c1-4fbb-8d8e-add51b83a67e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:01.058598 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d6de3c8-06c1-4fbb-8d8e-add51b83a67e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:01.059209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d6de3c8-06c1-4fbb-8d8e-add51b83a67e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:01.062663 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d6de3c8-06c1-4fbb-8d8e-add51b83a67e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:01.064016 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d6de3c8-06c1-4fbb-8d8e-add51b83a67e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:01.064740 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d6de3c8-06c1-4fbb-8d8e-add51b83a67e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:01.162655 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ad3484eb-998b-4eff-b396-0e28810868a0 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b0cd544c0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:01.278574 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9d6de3c8-06c1-4fbb-8d8e-add51b83a67e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:01.288273 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ad3484eb-998b-4eff-b396-0e28810868a0 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/4efda41f-1d87-450f-8456-2a80880b8c9a" status: 200 len: 1427 microversion: 2.1 time: 0.115535 Sep 24 20:55:01.288939 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 810/1677] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:55:01 2022] GET /compute/v2.1/images/4efda41f-1d87-450f-8456-2a80880b8c9a => generated 1427 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:55:01.295365 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9d6de3c8-06c1-4fbb-8d8e-add51b83a67e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1475 microversion: 2.1 time: 0.262699 Sep 24 20:55:01.296523 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 868/1678] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:01 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1475 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:01.301737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9da9f6c9-7ee1-4274-8401-46e650234479 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:01.302363 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9da9f6c9-7ee1-4274-8401-46e650234479 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] [instance: 01455b1b-b319-4297-bd83-5471b441eb12] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:01.303247 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-c54687af-02bf-42f5-9229-bed0728cb747 req-8bf0ca1e-140b-43aa-9721-a6850931a207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "048b3539-80cb-4d73-9280-b62713ddb588", "name": "network-vif-plugged", "status": "completed", "tag": "018d9d05-4694-4f6a-8a92-2c61652eab6e"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:55:01.319958 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c54687af-02bf-42f5-9229-bed0728cb747 req-8bf0ca1e-140b-43aa-9721-a6850931a207 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:01.320757 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c54687af-02bf-42f5-9229-bed0728cb747 req-8bf0ca1e-140b-43aa-9721-a6850931a207 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:01.321220 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c54687af-02bf-42f5-9229-bed0728cb747 req-8bf0ca1e-140b-43aa-9721-a6850931a207 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:01.329472 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9da9f6c9-7ee1-4274-8401-46e650234479 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:01.330066 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9da9f6c9-7ee1-4274-8401-46e650234479 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:01.330551 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9da9f6c9-7ee1-4274-8401-46e650234479 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:01.333511 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9da9f6c9-7ee1-4274-8401-46e650234479 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:01.334758 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9da9f6c9-7ee1-4274-8401-46e650234479 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:01.337121 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9da9f6c9-7ee1-4274-8401-46e650234479 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:01.338572 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-c54687af-02bf-42f5-9229-bed0728cb747 req-8bf0ca1e-140b-43aa-9721-a6850931a207 service nova] Creating event network-vif-plugged:018d9d05-4694-4f6a-8a92-2c61652eab6e for instance 048b3539-80cb-4d73-9280-b62713ddb588 on nch1-master-1 Sep 24 20:55:01.346338 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-c54687af-02bf-42f5-9229-bed0728cb747 req-8bf0ca1e-140b-43aa-9721-a6850931a207 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055818 Sep 24 20:55:01.348465 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 811/1679] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:55:01.438084 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9da9f6c9-7ee1-4274-8401-46e650234479 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0244a0ef19409a8a6e7c6526685919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccf2c674b1748c6b6e0b33e05e02940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:01.449134 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9da9f6c9-7ee1-4274-8401-46e650234479 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] 10.222.0.52 "GET /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12" status: 200 len: 1226 microversion: 2.1 time: 0.150918 Sep 24 20:55:01.451735 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 869/1680] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:01 2022] GET /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12 => generated 1226 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:01.467467 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-85ca52fb-0ecb-48de-9b90-c6436df0fa73 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:01.469838 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-85ca52fb-0ecb-48de-9b90-c6436df0fa73 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] [instance: 074c501c-cdef-4f19-81e5-8fc2608e9dd1] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:01.484153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-85ca52fb-0ecb-48de-9b90-c6436df0fa73 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:01.484959 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-85ca52fb-0ecb-48de-9b90-c6436df0fa73 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:01.486134 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-85ca52fb-0ecb-48de-9b90-c6436df0fa73 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:01.488785 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-85ca52fb-0ecb-48de-9b90-c6436df0fa73 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:01.489627 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-85ca52fb-0ecb-48de-9b90-c6436df0fa73 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:01.490273 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-85ca52fb-0ecb-48de-9b90-c6436df0fa73 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:01.717342 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-85ca52fb-0ecb-48de-9b90-c6436df0fa73 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1" status: 200 len: 1614 microversion: 2.1 time: 0.256392 Sep 24 20:55:01.718373 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 812/1681] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:01 2022] GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1 => generated 1614 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:01.742902 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a862dead-b94b-4b88-9120-472a92daa221 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:55:01.743743 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a862dead-b94b-4b88-9120-472a92daa221 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] [instance: 074c501c-cdef-4f19-81e5-8fc2608e9dd1] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:01.754354 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a862dead-b94b-4b88-9120-472a92daa221 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:01.755299 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a862dead-b94b-4b88-9120-472a92daa221 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:01.755958 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a862dead-b94b-4b88-9120-472a92daa221 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:01.757163 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a862dead-b94b-4b88-9120-472a92daa221 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:01.758061 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a862dead-b94b-4b88-9120-472a92daa221 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:01.758659 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a862dead-b94b-4b88-9120-472a92daa221 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:01.874557 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-a862dead-b94b-4b88-9120-472a92daa221 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] HTTP exception thrown: Cannot 'migrate' instance 074c501c-cdef-4f19-81e5-8fc2608e9dd1 while it is in vm_state suspended Sep 24 20:55:01.877018 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8532b7ae-4305-4c34-af7f-7a99704cef2c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:01.877285 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a862dead-b94b-4b88-9120-472a92daa221 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Request method failure captured: Sep 24 20:55:01.877285 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1/action HTTP/1.1 Sep 24 20:55:01.877285 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:55:01.877285 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:55:01.877285 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:55:01.877285 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 15 Sep 24 20:55:01.877285 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:55:01.877285 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:55:01.877285 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:55:01.877285 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:55:01.877285 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL25oIqd747e9fbagI6ED8nyM3TOWLHa-g1g46goDq85Uditncnv0xsnxxC-SPejnI_djyhzIxmBSxR9VqfpGTibI_9QLNATzVURtv1UlKOp0qlT0BUtBv3nRt5zRz1lIlMgOD-eEdP5st646P9J7eL3v4obHWj9qf3LCKq_dKGHlSP0 Sep 24 20:55:01.877285 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:55:01.877285 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:55:01.877285 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:55:01.877285 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:55:01.877285 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:55:01.877285 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:55:01.877285 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 2464ee933b394763a0135453d1072a2d Sep 24 20:55:01.877285 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1125222510 Sep 24 20:55:01.877285 ncdv-master-1 devstack@n-api.service[140517]: X-Role: admin,reader,member Sep 24 20:55:01.877285 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: admin,reader,member Sep 24 20:55:01.879175 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2464ee933b394763a0135453d1072a2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2464ee933b394763a0135453d1072a2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2464ee933b394763a0135453d1072a2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2464ee933b394763a0135453d1072a2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:55:01.879175 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1125222510 Sep 24 20:55:01.879175 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 2464ee933b394763a0135453d1072a2d Sep 24 20:55:01.879175 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1125222510 Sep 24 20:55:01.879175 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersAdminNegativeTestJSON-1125222510-project-admin Sep 24 20:55:01.879175 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:55:01.879175 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:55:01.879175 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 0f596f58695644da8f20168715392c49 Sep 24 20:55:01.879175 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1125222510-project-admin Sep 24 20:55:01.879175 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 20:55:01.879175 ncdv-master-1 devstack@n-api.service[140517]: {"migrate": {}} Sep 24 20:55:01.879175 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:55:01.879175 ncdv-master-1 devstack@n-api.service[140517]: exception: Cannot 'migrate' instance 074c501c-cdef-4f19-81e5-8fc2608e9dd1 while it is in vm_state suspended Sep 24 20:55:01.880039 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '074c501c-cdef-4f19-81e5-8fc2608e9dd1', 'body': {'migrate': {}}} Sep 24 20:55:01.880039 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:55:01.880039 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:01.880039 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Sep 24 20:55:01.880039 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Sep 24 20:55:01.880039 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 24 20:55:01.880039 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 20:55:01.880039 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 24 20:55:01.880039 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 24 20:55:01.880039 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 24 20:55:01.880039 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 24 20:55:01.880039 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 24 20:55:01.880039 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 20:55:01.880039 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 24 20:55:01.880039 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 24 20:55:01.880039 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 074c501c-cdef-4f19-81e5-8fc2608e9dd1 in vm_state suspended. Cannot resize while the instance is in this state. Sep 24 20:55:01.880039 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:01.880039 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:01.880039 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:01.880039 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:01.881343 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:01.881343 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:01.881343 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:55:01.881343 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:55:01.881343 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:55:01.881343 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:55:01.881343 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:55:01.881343 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:55:01.881343 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Sep 24 20:55:01.881343 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 24 20:55:01.881343 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 24 20:55:01.881343 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 24 20:55:01.881343 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 074c501c-cdef-4f19-81e5-8fc2608e9dd1 while it is in vm_state suspended Sep 24 20:55:01.881343 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:01.881343 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:01.881343 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:01.881343 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:01.881343 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:01.881343 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:01.882563 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:55:01.882563 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:55:01.882563 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 074c501c-cdef-4f19-81e5-8fc2608e9dd1 while it is in vm_state suspended Sep 24 20:55:01.882563 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:01.882836 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8532b7ae-4305-4c34-af7f-7a99704cef2c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 7505ad12-d1c7-4dad-b0b8-e797560e5274] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:01.884262 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a862dead-b94b-4b88-9120-472a92daa221 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Returning 409 to user: Cannot 'migrate' instance 074c501c-cdef-4f19-81e5-8fc2608e9dd1 while it is in vm_state suspended {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:55:01.885348 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a862dead-b94b-4b88-9120-472a92daa221 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1/action" status: 409 len: 148 microversion: 2.1 time: 0.146255 Sep 24 20:55:01.886532 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 870/1682] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:55:01 2022] POST /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1/action => generated 148 bytes in 148 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 24 20:55:01.887494 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8532b7ae-4305-4c34-af7f-7a99704cef2c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:01.888065 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8532b7ae-4305-4c34-af7f-7a99704cef2c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:01.888974 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8532b7ae-4305-4c34-af7f-7a99704cef2c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:01.889806 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8532b7ae-4305-4c34-af7f-7a99704cef2c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:01.889926 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8532b7ae-4305-4c34-af7f-7a99704cef2c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:01.893689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8532b7ae-4305-4c34-af7f-7a99704cef2c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:01.907502 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-8532b7ae-4305-4c34-af7f-7a99704cef2c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] HTTP exception thrown: Instance 7505ad12-d1c7-4dad-b0b8-e797560e5274 could not be found. Sep 24 20:55:01.908309 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e0a6a8c3-957d-424b-9526-a0b965608417 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:55:01.913342 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e0a6a8c3-957d-424b-9526-a0b965608417 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Request method failure captured: Sep 24 20:55:01.913342 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc/action HTTP/1.1 Sep 24 20:55:01.913342 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:55:01.913342 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:55:01.913342 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:55:01.913342 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 39 Sep 24 20:55:01.913342 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:55:01.913342 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:55:01.913342 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:55:01.913342 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:55:01.913342 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL25oIqd747e9fbagI6ED8nyM3TOWLHa-g1g46goDq85Uditncnv0xsnxxC-SPejnI_djyhzIxmBSxR9VqfpGTibI_9QLNATzVURtv1UlKOp0qlT0BUtBv3nRt5zRz1lIlMgOD-eEdP5st646P9J7eL3v4obHWj9qf3LCKq_dKGHlSP0 Sep 24 20:55:01.913342 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:55:01.913342 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:55:01.913342 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:55:01.913342 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:55:01.913342 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:55:01.913342 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:55:01.913342 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 2464ee933b394763a0135453d1072a2d Sep 24 20:55:01.913342 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1125222510 Sep 24 20:55:01.913342 ncdv-master-1 devstack@n-api.service[140517]: X-Role: admin,reader,member Sep 24 20:55:01.913342 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: admin,reader,member Sep 24 20:55:01.915040 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2464ee933b394763a0135453d1072a2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2464ee933b394763a0135453d1072a2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2464ee933b394763a0135453d1072a2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2464ee933b394763a0135453d1072a2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:55:01.915040 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1125222510 Sep 24 20:55:01.915040 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 2464ee933b394763a0135453d1072a2d Sep 24 20:55:01.915040 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1125222510 Sep 24 20:55:01.915040 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersAdminNegativeTestJSON-1125222510-project-admin Sep 24 20:55:01.915040 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:55:01.915040 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:55:01.915040 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 0f596f58695644da8f20168715392c49 Sep 24 20:55:01.915040 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1125222510-project-admin Sep 24 20:55:01.915040 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 20:55:01.915040 ncdv-master-1 devstack@n-api.service[140517]: {"os-resetState": {"state": "invalid"}} Sep 24 20:55:01.915040 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:55:01.915829 ncdv-master-1 devstack@n-api.service[140517]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 24 20:55:01.915829 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '39c753b7-d223-4e33-9086-d64877d26ecc', 'body': {'os-resetState': {'state': 'invalid'}}} Sep 24 20:55:01.915829 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:55:01.915829 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:01.915829 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 20:55:01.915829 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 20:55:01.915829 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 20:55:01.915829 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise error Sep 24 20:55:01.915829 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Sep 24 20:55:01.915829 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:01.915829 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Sep 24 20:55:01.915829 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 24 20:55:01.915829 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:01.915829 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 24 20:55:01.915829 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi 'invalid' Sep 24 20:55:01.915829 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:01.915829 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:01.915829 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:01.915829 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:01.915829 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:01.915829 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:01.915829 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:55:01.917205 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:55:01.917205 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:55:01.917205 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:55:01.917205 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 20:55:01.917205 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 20:55:01.917205 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 20:55:01.917205 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 20:55:01.917205 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 20:55:01.917205 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 20:55:01.917205 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 24 20:55:01.917205 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:01.917205 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:01.917205 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:01.917205 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:01.917205 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:01.917205 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:01.917205 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 20:55:01.917205 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 20:55:01.917205 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 24 20:55:01.918464 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:01.918464 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e0a6a8c3-957d-424b-9526-a0b965608417 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:55:01.918464 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e0a6a8c3-957d-424b-9526-a0b965608417 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc/action" status: 400 len: 144 microversion: 2.1 time: 0.019773 Sep 24 20:55:01.920214 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8532b7ae-4305-4c34-af7f-7a99704cef2c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Request method failure captured: Sep 24 20:55:01.920214 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274 HTTP/1.1 Sep 24 20:55:01.920214 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:55:01.920214 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:55:01.920214 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:55:01.920214 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:55:01.920214 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:55:01.920214 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:55:01.920214 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:55:01.920214 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:55:01.920214 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL23ty18wZ369rBpsqLlzALGIa2Gim7BSAzth626XfTPt1jl2TGGDfuIK0NF1uBFJTGNmpODfOJmslXLXls2-SCCSRhWzdKVR2lBkl_nLf9Mq1Le-1pWzwdVHhu2NC69cXC874Lb-O01_urLv2faksB3B4Xzjyj58JzXn5kGazzFVV5g Sep 24 20:55:01.920214 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:55:01.920214 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:55:01.920214 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:55:01.920214 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:55:01.920214 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:55:01.920214 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:55:01.920214 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 73bec7c48b07450f95a29a35e113153d Sep 24 20:55:01.920214 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersOnMultiNodesTest-512776478 Sep 24 20:55:01.920214 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:55:01.920214 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:55:01.924377 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/73bec7c48b07450f95a29a35e113153d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_73bec7c48b07450f95a29a35e113153d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/73bec7c48b07450f95a29a35e113153d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/73bec7c48b07450f95a29a35e113153d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:55:01.924377 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersOnMultiNodesTest-512776478 Sep 24 20:55:01.924377 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 73bec7c48b07450f95a29a35e113153d Sep 24 20:55:01.924377 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-512776478 Sep 24 20:55:01.924377 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersOnMultiNodesTest-512776478-project Sep 24 20:55:01.924377 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:55:01.924377 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:55:01.924377 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 936372eff4da45e281fc5512632a12b6 Sep 24 20:55:01.924377 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersOnMultiNodesTest-512776478-project Sep 24 20:55:01.924377 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:55:01.924377 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 7505ad12-d1c7-4dad-b0b8-e797560e5274 could not be found. Sep 24 20:55:01.924377 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '7505ad12-d1c7-4dad-b0b8-e797560e5274'} Sep 24 20:55:01.926013 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:55:01.926013 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:01.926013 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:55:01.926013 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:55:01.926013 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:55:01.926013 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:55:01.926013 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:55:01.926013 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:55:01.926013 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:55:01.926013 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:55:01.926013 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7505ad12-d1c7-4dad-b0b8-e797560e5274 could not be found. Sep 24 20:55:01.926013 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:01.926013 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:01.926013 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:01.926013 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:01.926013 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:01.926013 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:01.926013 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:55:01.926013 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:55:01.926013 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:55:01.928218 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:55:01.928218 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:55:01.928218 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:55:01.928218 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:55:01.928218 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:55:01.928218 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:55:01.928218 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:55:01.928218 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7505ad12-d1c7-4dad-b0b8-e797560e5274 could not be found. Sep 24 20:55:01.928218 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:01.928218 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:01.928218 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:01.928218 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:01.928218 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:01.928218 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:01.928218 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:55:01.928218 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:55:01.928218 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7505ad12-d1c7-4dad-b0b8-e797560e5274 could not be found. Sep 24 20:55:01.928218 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:01.930290 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 871/1683] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:55:01 2022] POST /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc/action => generated 144 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 20:55:01.930603 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8532b7ae-4305-4c34-af7f-7a99704cef2c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Returning 404 to user: Instance 7505ad12-d1c7-4dad-b0b8-e797560e5274 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:55:01.930603 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8532b7ae-4305-4c34-af7f-7a99704cef2c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274" status: 404 len: 111 microversion: 2.1 time: 0.045243 Sep 24 20:55:01.930603 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 813/1684] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:01 2022] GET /compute/v2.1/servers/7505ad12-d1c7-4dad-b0b8-e797560e5274 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 20:55:01.951194 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a26744d7-741b-4f18-b232-ccc3f7ada904 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:55:01.953223 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-98775936-e1ff-4591-a6e1-4b649e3ca7b9 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:01.956943 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a26744d7-741b-4f18-b232-ccc3f7ada904 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Request method failure captured: Sep 24 20:55:01.956943 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc/action HTTP/1.1 Sep 24 20:55:01.956943 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:55:01.956943 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:55:01.956943 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:55:01.956943 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 31 Sep 24 20:55:01.956943 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:55:01.956943 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:55:01.956943 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:55:01.956943 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:55:01.956943 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL25oIqd747e9fbagI6ED8nyM3TOWLHa-g1g46goDq85Uditncnv0xsnxxC-SPejnI_djyhzIxmBSxR9VqfpGTibI_9QLNATzVURtv1UlKOp0qlT0BUtBv3nRt5zRz1lIlMgOD-eEdP5st646P9J7eL3v4obHWj9qf3LCKq_dKGHlSP0 Sep 24 20:55:01.956943 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:55:01.956943 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:55:01.956943 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:55:01.956943 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:55:01.956943 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:55:01.956943 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:55:01.956943 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 2464ee933b394763a0135453d1072a2d Sep 24 20:55:01.956943 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1125222510 Sep 24 20:55:01.956943 ncdv-master-1 devstack@n-api.service[140516]: X-Role: admin,reader,member Sep 24 20:55:01.956943 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: admin,reader,member Sep 24 20:55:01.958678 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2464ee933b394763a0135453d1072a2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2464ee933b394763a0135453d1072a2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2464ee933b394763a0135453d1072a2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2464ee933b394763a0135453d1072a2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:55:01.958678 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1125222510 Sep 24 20:55:01.958678 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 2464ee933b394763a0135453d1072a2d Sep 24 20:55:01.958678 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1125222510 Sep 24 20:55:01.958678 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersAdminNegativeTestJSON-1125222510-project-admin Sep 24 20:55:01.958678 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:55:01.958678 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:55:01.958678 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 0f596f58695644da8f20168715392c49 Sep 24 20:55:01.958678 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1125222510-project-admin Sep 24 20:55:01.958678 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 20:55:01.958678 ncdv-master-1 devstack@n-api.service[140516]: {"os-resetState": {"state": 1}} Sep 24 20:55:01.958678 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:55:01.958678 ncdv-master-1 devstack@n-api.service[140516]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 24 20:55:01.959665 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '39c753b7-d223-4e33-9086-d64877d26ecc', 'body': {'os-resetState': {'state': 1}}} Sep 24 20:55:01.959665 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:55:01.959665 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:01.959665 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 20:55:01.959665 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 20:55:01.959665 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 20:55:01.959665 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise error Sep 24 20:55:01.959665 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Sep 24 20:55:01.959665 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:01.959665 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Sep 24 20:55:01.959665 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 24 20:55:01.959665 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:01.959665 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 24 20:55:01.959665 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 1 Sep 24 20:55:01.959665 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:01.959665 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:01.959665 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:01.959665 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:01.959665 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:01.959665 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:01.959665 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:55:01.959665 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:55:01.962026 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:55:01.962026 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:55:01.962026 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 20:55:01.962026 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 20:55:01.962026 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 20:55:01.962026 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 20:55:01.962026 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 20:55:01.962026 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 20:55:01.962026 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 24 20:55:01.962026 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:01.962026 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:01.962026 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:01.962026 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:01.962026 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:01.962026 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:01.962026 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 20:55:01.962026 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 20:55:01.962026 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 24 20:55:01.962026 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:01.964720 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-98775936-e1ff-4591-a6e1-4b649e3ca7b9 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 6a57ca61-642f-4749-a3f2-3ae1cfcbc542] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:01.966320 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a26744d7-741b-4f18-b232-ccc3f7ada904 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:55:01.967759 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a26744d7-741b-4f18-b232-ccc3f7ada904 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc/action" status: 400 len: 120 microversion: 2.1 time: 0.023169 Sep 24 20:55:01.969295 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 814/1685] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:55:01 2022] POST /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc/action => generated 120 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 20:55:01.978432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98775936-e1ff-4591-a6e1-4b649e3ca7b9 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:01.979265 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98775936-e1ff-4591-a6e1-4b649e3ca7b9 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:01.979995 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98775936-e1ff-4591-a6e1-4b649e3ca7b9 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:01.980753 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98775936-e1ff-4591-a6e1-4b649e3ca7b9 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:01.981473 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98775936-e1ff-4591-a6e1-4b649e3ca7b9 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:01.982132 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98775936-e1ff-4591-a6e1-4b649e3ca7b9 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:01.982664 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-15cb9721-eb43-4f83-9486-b44f77d3dea7 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:55:01.993814 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-15cb9721-eb43-4f83-9486-b44f77d3dea7 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Failed to fetch instance by id 999 {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 24 20:55:01.994353 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-15cb9721-eb43-4f83-9486-b44f77d3dea7 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] HTTP exception thrown: Instance 999 could not be found. Sep 24 20:55:01.997115 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-15cb9721-eb43-4f83-9486-b44f77d3dea7 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Request method failure captured: Sep 24 20:55:01.997115 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Sep 24 20:55:01.997115 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:55:01.997115 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:55:01.997115 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:55:01.997115 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 37 Sep 24 20:55:01.997115 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:55:01.997115 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:55:01.997115 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:55:01.997115 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:55:01.997115 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL25oIqd747e9fbagI6ED8nyM3TOWLHa-g1g46goDq85Uditncnv0xsnxxC-SPejnI_djyhzIxmBSxR9VqfpGTibI_9QLNATzVURtv1UlKOp0qlT0BUtBv3nRt5zRz1lIlMgOD-eEdP5st646P9J7eL3v4obHWj9qf3LCKq_dKGHlSP0 Sep 24 20:55:01.997115 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:55:01.997115 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:55:01.997115 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:55:01.997115 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:55:01.997115 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:55:01.997115 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:55:01.997115 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 2464ee933b394763a0135453d1072a2d Sep 24 20:55:01.997115 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1125222510 Sep 24 20:55:01.997115 ncdv-master-1 devstack@n-api.service[140516]: X-Role: admin,reader,member Sep 24 20:55:01.997115 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: admin,reader,member Sep 24 20:55:01.998484 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2464ee933b394763a0135453d1072a2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2464ee933b394763a0135453d1072a2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2464ee933b394763a0135453d1072a2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2464ee933b394763a0135453d1072a2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:55:01.998484 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1125222510 Sep 24 20:55:01.998484 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 2464ee933b394763a0135453d1072a2d Sep 24 20:55:01.998484 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1125222510 Sep 24 20:55:01.998484 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersAdminNegativeTestJSON-1125222510-project-admin Sep 24 20:55:01.998484 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:55:01.998484 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:55:01.998484 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 0f596f58695644da8f20168715392c49 Sep 24 20:55:01.998484 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1125222510-project-admin Sep 24 20:55:01.998484 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 20:55:01.998484 ncdv-master-1 devstack@n-api.service[140516]: {"os-resetState": {"state": "error"}} Sep 24 20:55:01.998484 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:55:01.998484 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 999 could not be found. Sep 24 20:55:01.999447 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Sep 24 20:55:01.999447 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:55:01.999447 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:01.999447 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:55:01.999447 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:55:01.999447 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 24 20:55:01.999447 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 24 20:55:01.999447 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 24 20:55:01.999447 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:01.999447 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:01.999447 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:01.999447 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:01.999447 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:01.999447 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:01.999447 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:55:01.999447 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:55:01.999447 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:55:01.999447 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:55:01.999447 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:55:01.999447 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:55:01.999447 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Sep 24 20:55:02.000775 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 24 20:55:02.000775 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:55:02.000775 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:55:02.000775 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 24 20:55:02.000775 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:02.000775 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:02.000775 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:02.000775 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:02.000775 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:02.000775 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:02.000775 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:55:02.000775 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:55:02.000775 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 24 20:55:02.000775 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:02.000775 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-15cb9721-eb43-4f83-9486-b44f77d3dea7 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:55:02.000775 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-15cb9721-eb43-4f83-9486-b44f77d3dea7 tempest-ServersAdminNegativeTestJSON-1125222510 tempest-ServersAdminNegativeTestJSON-1125222510-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.020442 Sep 24 20:55:02.001782 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 815/1686] 10.222.0.52 () {60 vars in 1179 bytes} [Sat Sep 24 20:55:01 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 20:55:02.017945 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2dca8996-16d0-48c2-9508-8bf420400690 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:02.019341 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2dca8996-16d0-48c2-9508-8bf420400690 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 074c501c-cdef-4f19-81e5-8fc2608e9dd1] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:02.027438 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2dca8996-16d0-48c2-9508-8bf420400690 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:02.028225 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2dca8996-16d0-48c2-9508-8bf420400690 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:02.028999 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2dca8996-16d0-48c2-9508-8bf420400690 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:02.029952 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2dca8996-16d0-48c2-9508-8bf420400690 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:02.030710 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2dca8996-16d0-48c2-9508-8bf420400690 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:02.031372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2dca8996-16d0-48c2-9508-8bf420400690 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:02.037865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-98775936-e1ff-4591-a6e1-4b649e3ca7b9 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 6a57ca61-642f-4749-a3f2-3ae1cfcbc542] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:55:02.070979 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2dca8996-16d0-48c2-9508-8bf420400690 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 074c501c-cdef-4f19-81e5-8fc2608e9dd1] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:55:02.167887 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:55:02.173439 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-98775936-e1ff-4591-a6e1-4b649e3ca7b9 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6a57ca61-642f-4749-a3f2-3ae1cfcbc542" status: 204 len: 0 microversion: 2.1 time: 0.230388 Sep 24 20:55:02.179182 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 872/1687] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:55:01 2022] DELETE /compute/v2.1/servers/6a57ca61-642f-4749-a3f2-3ae1cfcbc542 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:55:02.185505 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-52264b82-53d2-4664-b9cf-4ea31b5d4dd8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:02.186407 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-52264b82-53d2-4664-b9cf-4ea31b5d4dd8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 1c19c5a4-46f9-4e5e-a717-55bc8e5c3026] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:02.198719 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52264b82-53d2-4664-b9cf-4ea31b5d4dd8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:02.200044 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52264b82-53d2-4664-b9cf-4ea31b5d4dd8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:02.200813 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52264b82-53d2-4664-b9cf-4ea31b5d4dd8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:02.201818 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52264b82-53d2-4664-b9cf-4ea31b5d4dd8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:02.202555 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52264b82-53d2-4664-b9cf-4ea31b5d4dd8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:02.203211 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52264b82-53d2-4664-b9cf-4ea31b5d4dd8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:02.238631 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-52264b82-53d2-4664-b9cf-4ea31b5d4dd8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 1c19c5a4-46f9-4e5e-a717-55bc8e5c3026] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:55:02.254332 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2dca8996-16d0-48c2-9508-8bf420400690 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "DELETE /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1" status: 204 len: 0 microversion: 2.1 time: 0.247143 Sep 24 20:55:02.255369 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 816/1688] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:55:02 2022] DELETE /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:55:02.272898 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3c013b29-cb82-4fbf-b830-c0323bacaba4 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:02.275096 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3c013b29-cb82-4fbf-b830-c0323bacaba4 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 074c501c-cdef-4f19-81e5-8fc2608e9dd1] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:02.287725 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c013b29-cb82-4fbf-b830-c0323bacaba4 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:02.288305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c013b29-cb82-4fbf-b830-c0323bacaba4 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:02.288751 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c013b29-cb82-4fbf-b830-c0323bacaba4 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:02.289461 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c013b29-cb82-4fbf-b830-c0323bacaba4 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:02.290162 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c013b29-cb82-4fbf-b830-c0323bacaba4 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:02.291065 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c013b29-cb82-4fbf-b830-c0323bacaba4 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:02.350891 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-52264b82-53d2-4664-b9cf-4ea31b5d4dd8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026" status: 204 len: 0 microversion: 2.1 time: 0.169599 Sep 24 20:55:02.356049 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 873/1689] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:55:02 2022] DELETE /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:55:02.376677 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9a516220-8747-4ecb-8d1d-0e3b05fa6fc2 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b0c0e6670>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:02.506072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3c013b29-cb82-4fbf-b830-c0323bacaba4 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:02.516799 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3c013b29-cb82-4fbf-b830-c0323bacaba4 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1" status: 200 len: 1469 microversion: 2.1 time: 0.251787 Sep 24 20:55:02.517925 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 817/1690] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:02 2022] GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1 => generated 1469 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:02.523552 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5c4a1e4d-0c4f-4e65-bdb8-712100160fa5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:02.524428 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5c4a1e4d-0c4f-4e65-bdb8-712100160fa5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:02.535802 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c4a1e4d-0c4f-4e65-bdb8-712100160fa5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:02.536551 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c4a1e4d-0c4f-4e65-bdb8-712100160fa5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:02.537241 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c4a1e4d-0c4f-4e65-bdb8-712100160fa5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:02.538131 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c4a1e4d-0c4f-4e65-bdb8-712100160fa5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:02.538778 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c4a1e4d-0c4f-4e65-bdb8-712100160fa5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:02.539365 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c4a1e4d-0c4f-4e65-bdb8-712100160fa5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:02.764787 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5c4a1e4d-0c4f-4e65-bdb8-712100160fa5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:02.779605 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5c4a1e4d-0c4f-4e65-bdb8-712100160fa5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1475 microversion: 2.1 time: 0.257977 Sep 24 20:55:02.780366 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 818/1691] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:02 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1475 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:02.793162 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5f50f4ea-01a3-4b3e-8940-8e1ec5922f29 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:02.794210 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5f50f4ea-01a3-4b3e-8940-8e1ec5922f29 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 6a57ca61-642f-4749-a3f2-3ae1cfcbc542] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:02.814053 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f50f4ea-01a3-4b3e-8940-8e1ec5922f29 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:02.815673 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f50f4ea-01a3-4b3e-8940-8e1ec5922f29 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:02.816992 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f50f4ea-01a3-4b3e-8940-8e1ec5922f29 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:02.818045 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f50f4ea-01a3-4b3e-8940-8e1ec5922f29 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:02.818479 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f50f4ea-01a3-4b3e-8940-8e1ec5922f29 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:02.818978 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f50f4ea-01a3-4b3e-8940-8e1ec5922f29 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:02.983580 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5f50f4ea-01a3-4b3e-8940-8e1ec5922f29 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:03.006092 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5f50f4ea-01a3-4b3e-8940-8e1ec5922f29 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/6a57ca61-642f-4749-a3f2-3ae1cfcbc542" status: 200 len: 1475 microversion: 2.1 time: 0.221012 Sep 24 20:55:03.019060 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 819/1692] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:02 2022] GET /compute/v2.1/servers/6a57ca61-642f-4749-a3f2-3ae1cfcbc542 => generated 1475 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:03.029713 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-11a8297f-a21f-4ceb-b1c5-a4b981d089ad tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:03.031898 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-11a8297f-a21f-4ceb-b1c5-a4b981d089ad tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] [instance: 01455b1b-b319-4297-bd83-5471b441eb12] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:03.042595 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-11a8297f-a21f-4ceb-b1c5-a4b981d089ad tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:03.043089 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-11a8297f-a21f-4ceb-b1c5-a4b981d089ad tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:03.043625 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-11a8297f-a21f-4ceb-b1c5-a4b981d089ad tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:03.044726 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-11a8297f-a21f-4ceb-b1c5-a4b981d089ad tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:03.045183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-11a8297f-a21f-4ceb-b1c5-a4b981d089ad tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:03.045905 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-11a8297f-a21f-4ceb-b1c5-a4b981d089ad tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:03.131731 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-11a8297f-a21f-4ceb-b1c5-a4b981d089ad tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0244a0ef19409a8a6e7c6526685919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccf2c674b1748c6b6e0b33e05e02940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:03.145176 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-11a8297f-a21f-4ceb-b1c5-a4b981d089ad tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] 10.222.0.52 "GET /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12" status: 200 len: 1282 microversion: 2.1 time: 0.128664 Sep 24 20:55:03.146746 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 820/1693] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:03 2022] GET /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12 => generated 1282 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:03.541703 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9c875e8c-92d0-446c-b961-8606486a3086 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:03.543615 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9c875e8c-92d0-446c-b961-8606486a3086 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 074c501c-cdef-4f19-81e5-8fc2608e9dd1] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:03.553865 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c875e8c-92d0-446c-b961-8606486a3086 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:03.554778 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c875e8c-92d0-446c-b961-8606486a3086 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:03.555471 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c875e8c-92d0-446c-b961-8606486a3086 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:03.556435 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c875e8c-92d0-446c-b961-8606486a3086 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:03.557148 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c875e8c-92d0-446c-b961-8606486a3086 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:03.557832 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c875e8c-92d0-446c-b961-8606486a3086 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:03.715508 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9c875e8c-92d0-446c-b961-8606486a3086 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:03.718340 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:55:03.726016 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9c875e8c-92d0-446c-b961-8606486a3086 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1" status: 200 len: 1469 microversion: 2.1 time: 0.188796 Sep 24 20:55:03.743090 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 821/1694] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:03 2022] GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1 => generated 1469 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:03.809444 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d645b9d3-0730-49a0-abf8-394e409e40e3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:03.810811 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d645b9d3-0730-49a0-abf8-394e409e40e3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:03.838362 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d645b9d3-0730-49a0-abf8-394e409e40e3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:03.839261 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d645b9d3-0730-49a0-abf8-394e409e40e3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:03.849893 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d645b9d3-0730-49a0-abf8-394e409e40e3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:03.849893 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d645b9d3-0730-49a0-abf8-394e409e40e3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:03.849893 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d645b9d3-0730-49a0-abf8-394e409e40e3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:03.849893 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d645b9d3-0730-49a0-abf8-394e409e40e3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:04.052175 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d645b9d3-0730-49a0-abf8-394e409e40e3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:04.069420 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d645b9d3-0730-49a0-abf8-394e409e40e3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1475 microversion: 2.1 time: 0.265578 Sep 24 20:55:04.078603 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 822/1695] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:03 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1475 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:55:04.078603 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-928eb276-4b83-45f1-b699-6933c0dc5872 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:04.078603 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-928eb276-4b83-45f1-b699-6933c0dc5872 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 6a57ca61-642f-4749-a3f2-3ae1cfcbc542] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:04.085535 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-928eb276-4b83-45f1-b699-6933c0dc5872 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:04.086383 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-928eb276-4b83-45f1-b699-6933c0dc5872 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:04.087020 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-928eb276-4b83-45f1-b699-6933c0dc5872 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:04.087911 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-928eb276-4b83-45f1-b699-6933c0dc5872 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:04.088781 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-928eb276-4b83-45f1-b699-6933c0dc5872 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:04.089235 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-928eb276-4b83-45f1-b699-6933c0dc5872 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:04.304997 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-928eb276-4b83-45f1-b699-6933c0dc5872 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:04.320731 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-928eb276-4b83-45f1-b699-6933c0dc5872 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/6a57ca61-642f-4749-a3f2-3ae1cfcbc542" status: 200 len: 1475 microversion: 2.1 time: 0.248766 Sep 24 20:55:04.334528 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 823/1696] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:04 2022] GET /compute/v2.1/servers/6a57ca61-642f-4749-a3f2-3ae1cfcbc542 => generated 1475 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:04.341586 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6571b5b6-b12d-463c-8e96-7493b8070c28 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:04.342224 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6571b5b6-b12d-463c-8e96-7493b8070c28 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] [instance: 01455b1b-b319-4297-bd83-5471b441eb12] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:04.349521 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6571b5b6-b12d-463c-8e96-7493b8070c28 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:04.350029 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6571b5b6-b12d-463c-8e96-7493b8070c28 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:04.350476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6571b5b6-b12d-463c-8e96-7493b8070c28 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:04.351281 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6571b5b6-b12d-463c-8e96-7493b8070c28 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:04.351683 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6571b5b6-b12d-463c-8e96-7493b8070c28 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:04.366368 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6571b5b6-b12d-463c-8e96-7493b8070c28 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:04.466437 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6571b5b6-b12d-463c-8e96-7493b8070c28 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0244a0ef19409a8a6e7c6526685919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccf2c674b1748c6b6e0b33e05e02940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:04.475794 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6571b5b6-b12d-463c-8e96-7493b8070c28 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] 10.222.0.52 "GET /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12" status: 200 len: 1292 microversion: 2.1 time: 0.153229 Sep 24 20:55:04.477467 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 824/1697] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:04 2022] GET /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12 => generated 1292 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:04.753604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a3e46cf6-2baa-4748-bb27-714ef3dd7503 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:04.755940 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a3e46cf6-2baa-4748-bb27-714ef3dd7503 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 074c501c-cdef-4f19-81e5-8fc2608e9dd1] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:04.774419 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3e46cf6-2baa-4748-bb27-714ef3dd7503 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:04.776119 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3e46cf6-2baa-4748-bb27-714ef3dd7503 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:04.779107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3e46cf6-2baa-4748-bb27-714ef3dd7503 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:04.783700 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3e46cf6-2baa-4748-bb27-714ef3dd7503 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:04.785631 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3e46cf6-2baa-4748-bb27-714ef3dd7503 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:04.786087 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3e46cf6-2baa-4748-bb27-714ef3dd7503 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:04.970526 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=13 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:55:05.087522 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a3e46cf6-2baa-4748-bb27-714ef3dd7503 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:05.095936 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a3e46cf6-2baa-4748-bb27-714ef3dd7503 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1" status: 200 len: 1469 microversion: 2.1 time: 0.349931 Sep 24 20:55:05.099390 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 825/1698] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:04 2022] GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1 => generated 1469 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:05.106900 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-de5b9d51-8128-4863-9024-a18d07d1a6cf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:05.107146 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-de5b9d51-8128-4863-9024-a18d07d1a6cf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:05.125607 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-de5b9d51-8128-4863-9024-a18d07d1a6cf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:05.126119 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-de5b9d51-8128-4863-9024-a18d07d1a6cf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:05.126604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-de5b9d51-8128-4863-9024-a18d07d1a6cf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:05.127347 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-de5b9d51-8128-4863-9024-a18d07d1a6cf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:05.129478 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-de5b9d51-8128-4863-9024-a18d07d1a6cf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:05.130678 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-de5b9d51-8128-4863-9024-a18d07d1a6cf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:05.266904 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=18 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:55:05.313552 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-de5b9d51-8128-4863-9024-a18d07d1a6cf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:05.326136 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-de5b9d51-8128-4863-9024-a18d07d1a6cf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1475 microversion: 2.1 time: 0.225499 Sep 24 20:55:05.327595 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 826/1699] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:05 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1475 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:05.347106 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1718006e-ed8a-403d-aabc-4c0c580bc321 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:05.347806 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1718006e-ed8a-403d-aabc-4c0c580bc321 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 6a57ca61-642f-4749-a3f2-3ae1cfcbc542] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:05.356114 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1718006e-ed8a-403d-aabc-4c0c580bc321 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:05.356787 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1718006e-ed8a-403d-aabc-4c0c580bc321 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:05.357375 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1718006e-ed8a-403d-aabc-4c0c580bc321 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:05.365225 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1718006e-ed8a-403d-aabc-4c0c580bc321 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:05.365225 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1718006e-ed8a-403d-aabc-4c0c580bc321 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:05.365225 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1718006e-ed8a-403d-aabc-4c0c580bc321 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:05.574950 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1718006e-ed8a-403d-aabc-4c0c580bc321 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:05.587859 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1718006e-ed8a-403d-aabc-4c0c580bc321 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/6a57ca61-642f-4749-a3f2-3ae1cfcbc542" status: 200 len: 1475 microversion: 2.1 time: 0.245336 Sep 24 20:55:05.589200 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 827/1700] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:05 2022] GET /compute/v2.1/servers/6a57ca61-642f-4749-a3f2-3ae1cfcbc542 => generated 1475 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:05.595851 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1c98c286-8f1e-4447-88cd-4c4fa90c5591 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:05.597035 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1c98c286-8f1e-4447-88cd-4c4fa90c5591 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] [instance: 01455b1b-b319-4297-bd83-5471b441eb12] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:05.621324 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c98c286-8f1e-4447-88cd-4c4fa90c5591 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:05.622244 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c98c286-8f1e-4447-88cd-4c4fa90c5591 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:05.623359 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c98c286-8f1e-4447-88cd-4c4fa90c5591 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:05.624254 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c98c286-8f1e-4447-88cd-4c4fa90c5591 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:05.626261 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c98c286-8f1e-4447-88cd-4c4fa90c5591 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:05.626995 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c98c286-8f1e-4447-88cd-4c4fa90c5591 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:05.742740 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1c98c286-8f1e-4447-88cd-4c4fa90c5591 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0244a0ef19409a8a6e7c6526685919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccf2c674b1748c6b6e0b33e05e02940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:05.761437 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1c98c286-8f1e-4447-88cd-4c4fa90c5591 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] 10.222.0.52 "GET /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12" status: 200 len: 1280 microversion: 2.1 time: 0.167300 Sep 24 20:55:05.762118 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 828/1701] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:05 2022] GET /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12 => generated 1280 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:06.131670 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-60408b42-032f-4b9f-8f86-85dd182f91e9 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:06.155466 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-60408b42-032f-4b9f-8f86-85dd182f91e9 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 074c501c-cdef-4f19-81e5-8fc2608e9dd1] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:06.212889 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-60408b42-032f-4b9f-8f86-85dd182f91e9 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:06.212889 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-60408b42-032f-4b9f-8f86-85dd182f91e9 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:06.212889 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-60408b42-032f-4b9f-8f86-85dd182f91e9 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:06.223050 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-60408b42-032f-4b9f-8f86-85dd182f91e9 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:06.223050 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-60408b42-032f-4b9f-8f86-85dd182f91e9 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:06.223479 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-60408b42-032f-4b9f-8f86-85dd182f91e9 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:06.613674 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-60408b42-032f-4b9f-8f86-85dd182f91e9 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:06.625743 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-60408b42-032f-4b9f-8f86-85dd182f91e9 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1" status: 200 len: 1469 microversion: 2.1 time: 0.501529 Sep 24 20:55:06.628385 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 829/1702] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:06 2022] GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1 => generated 1469 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:06.638845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-be0d541e-1959-42fc-94cf-f4165b2c3327 req-48467652-4af2-48f2-a387-5dc349d579ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c19c5a4-46f9-4e5e-a717-55bc8e5c3026", "name": "network-vif-deleted", "tag": "35a118ee-28c5-40cd-9e35-d9ab0080224a"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:55:06.670200 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-be0d541e-1959-42fc-94cf-f4165b2c3327 req-48467652-4af2-48f2-a387-5dc349d579ae service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:06.677285 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-be0d541e-1959-42fc-94cf-f4165b2c3327 req-48467652-4af2-48f2-a387-5dc349d579ae service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:06.678034 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-be0d541e-1959-42fc-94cf-f4165b2c3327 req-48467652-4af2-48f2-a387-5dc349d579ae service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:06.708763 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-be0d541e-1959-42fc-94cf-f4165b2c3327 req-48467652-4af2-48f2-a387-5dc349d579ae service nova] Creating event network-vif-deleted:35a118ee-28c5-40cd-9e35-d9ab0080224a for instance 1c19c5a4-46f9-4e5e-a717-55bc8e5c3026 on nch2-master-1 Sep 24 20:55:06.715193 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-be0d541e-1959-42fc-94cf-f4165b2c3327 req-48467652-4af2-48f2-a387-5dc349d579ae service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085065 Sep 24 20:55:06.716144 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 830/1703] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:55:06.723715 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-157f2bf5-f5e7-4f81-9519-3fe63b381641 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:06.724803 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-157f2bf5-f5e7-4f81-9519-3fe63b381641 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:06.731968 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-157f2bf5-f5e7-4f81-9519-3fe63b381641 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:06.732904 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-157f2bf5-f5e7-4f81-9519-3fe63b381641 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:06.733577 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-157f2bf5-f5e7-4f81-9519-3fe63b381641 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:06.734633 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-157f2bf5-f5e7-4f81-9519-3fe63b381641 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:06.735330 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-157f2bf5-f5e7-4f81-9519-3fe63b381641 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:06.736077 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-157f2bf5-f5e7-4f81-9519-3fe63b381641 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:07.245479 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-157f2bf5-f5e7-4f81-9519-3fe63b381641 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:07.259467 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-157f2bf5-f5e7-4f81-9519-3fe63b381641 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1475 microversion: 2.1 time: 0.541825 Sep 24 20:55:07.260077 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 831/1704] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:06 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1475 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:07.285988 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-618569b0-6697-4a1a-bec5-924ec39f75fc tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:07.286664 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-618569b0-6697-4a1a-bec5-924ec39f75fc tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 6a57ca61-642f-4749-a3f2-3ae1cfcbc542] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:07.296595 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-618569b0-6697-4a1a-bec5-924ec39f75fc tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:07.297240 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-618569b0-6697-4a1a-bec5-924ec39f75fc tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:07.297689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-618569b0-6697-4a1a-bec5-924ec39f75fc tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:07.298422 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-618569b0-6697-4a1a-bec5-924ec39f75fc tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:07.298937 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-618569b0-6697-4a1a-bec5-924ec39f75fc tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:07.299375 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-618569b0-6697-4a1a-bec5-924ec39f75fc tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:07.455102 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-618569b0-6697-4a1a-bec5-924ec39f75fc tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:07.467573 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-618569b0-6697-4a1a-bec5-924ec39f75fc tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/6a57ca61-642f-4749-a3f2-3ae1cfcbc542" status: 200 len: 1433 microversion: 2.1 time: 0.204174 Sep 24 20:55:07.472002 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 832/1705] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:07 2022] GET /compute/v2.1/servers/6a57ca61-642f-4749-a3f2-3ae1cfcbc542 => generated 1433 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:07.488205 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ef2dc057-f287-483a-8af4-8882fc7011ed tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:07.490688 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ef2dc057-f287-483a-8af4-8882fc7011ed tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] [instance: 01455b1b-b319-4297-bd83-5471b441eb12] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:07.512981 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef2dc057-f287-483a-8af4-8882fc7011ed tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:07.514944 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef2dc057-f287-483a-8af4-8882fc7011ed tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:07.519248 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef2dc057-f287-483a-8af4-8882fc7011ed tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:07.520650 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef2dc057-f287-483a-8af4-8882fc7011ed tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:07.521157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef2dc057-f287-483a-8af4-8882fc7011ed tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:07.521605 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef2dc057-f287-483a-8af4-8882fc7011ed tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:07.927244 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ef2dc057-f287-483a-8af4-8882fc7011ed tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0244a0ef19409a8a6e7c6526685919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccf2c674b1748c6b6e0b33e05e02940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:07.940059 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ef2dc057-f287-483a-8af4-8882fc7011ed tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] 10.222.0.52 "GET /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12" status: 200 len: 1322 microversion: 2.1 time: 0.464445 Sep 24 20:55:07.962829 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 833/1706] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:07 2022] GET /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12 => generated 1322 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:08.085699 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-a22c951d-a476-4f5d-8121-d933610ddb75 req-d2ff2adf-7d91-44bd-8485-b9e6a9789e8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "074c501c-cdef-4f19-81e5-8fc2608e9dd1", "name": "network-vif-deleted", "tag": "d2003e83-fec4-44ef-a623-62218b581c9b"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:55:08.099664 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a22c951d-a476-4f5d-8121-d933610ddb75 req-d2ff2adf-7d91-44bd-8485-b9e6a9789e8e service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:08.100443 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a22c951d-a476-4f5d-8121-d933610ddb75 req-d2ff2adf-7d91-44bd-8485-b9e6a9789e8e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:08.101061 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a22c951d-a476-4f5d-8121-d933610ddb75 req-d2ff2adf-7d91-44bd-8485-b9e6a9789e8e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:08.117009 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-a22c951d-a476-4f5d-8121-d933610ddb75 req-d2ff2adf-7d91-44bd-8485-b9e6a9789e8e service nova] Creating event network-vif-deleted:d2003e83-fec4-44ef-a623-62218b581c9b for instance 074c501c-cdef-4f19-81e5-8fc2608e9dd1 on nch1-master-1 Sep 24 20:55:08.123259 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-a22c951d-a476-4f5d-8121-d933610ddb75 req-d2ff2adf-7d91-44bd-8485-b9e6a9789e8e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157683 Sep 24 20:55:08.124899 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 834/1707] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:55:08.134094 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-467b916f-f530-4d10-8182-8bd56335d4ed tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:08.135233 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-467b916f-f530-4d10-8182-8bd56335d4ed tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 074c501c-cdef-4f19-81e5-8fc2608e9dd1] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:08.143609 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-467b916f-f530-4d10-8182-8bd56335d4ed tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:08.144907 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-467b916f-f530-4d10-8182-8bd56335d4ed tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:08.145874 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-467b916f-f530-4d10-8182-8bd56335d4ed tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:08.147651 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-467b916f-f530-4d10-8182-8bd56335d4ed tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:08.148539 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-467b916f-f530-4d10-8182-8bd56335d4ed tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:08.150204 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-467b916f-f530-4d10-8182-8bd56335d4ed tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:08.192784 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-467b916f-f530-4d10-8182-8bd56335d4ed tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:08.193679 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-467b916f-f530-4d10-8182-8bd56335d4ed tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:08.194296 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-467b916f-f530-4d10-8182-8bd56335d4ed tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:08.194952 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-467b916f-f530-4d10-8182-8bd56335d4ed tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lazy-loading 'fault' on Instance uuid 074c501c-cdef-4f19-81e5-8fc2608e9dd1 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:55:08.254376 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-467b916f-f530-4d10-8182-8bd56335d4ed tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:08.274262 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-467b916f-f530-4d10-8182-8bd56335d4ed tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1" status: 200 len: 1312 microversion: 2.1 time: 0.146529 Sep 24 20:55:08.275446 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 835/1708] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:08 2022] GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1 => generated 1312 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:08.305501 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8c1398a6-6de4-443f-ae12-44d5a7a1904b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:08.306445 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8c1398a6-6de4-443f-ae12-44d5a7a1904b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:08.332010 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c1398a6-6de4-443f-ae12-44d5a7a1904b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:08.332926 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c1398a6-6de4-443f-ae12-44d5a7a1904b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:08.333378 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c1398a6-6de4-443f-ae12-44d5a7a1904b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:08.334280 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c1398a6-6de4-443f-ae12-44d5a7a1904b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:08.334929 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c1398a6-6de4-443f-ae12-44d5a7a1904b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:08.335549 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c1398a6-6de4-443f-ae12-44d5a7a1904b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:08.749268 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8c1398a6-6de4-443f-ae12-44d5a7a1904b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:08.759483 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8c1398a6-6de4-443f-ae12-44d5a7a1904b tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1474 microversion: 2.1 time: 0.464965 Sep 24 20:55:08.763170 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 836/1709] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:08 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1474 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:08.779041 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4164338f-83b8-4587-8858-6c44550cf30b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:08.782233 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4164338f-83b8-4587-8858-6c44550cf30b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 6a57ca61-642f-4749-a3f2-3ae1cfcbc542] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:08.799097 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4164338f-83b8-4587-8858-6c44550cf30b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:08.801105 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4164338f-83b8-4587-8858-6c44550cf30b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:08.802595 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4164338f-83b8-4587-8858-6c44550cf30b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:08.804204 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4164338f-83b8-4587-8858-6c44550cf30b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:08.805392 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4164338f-83b8-4587-8858-6c44550cf30b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:08.805989 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4164338f-83b8-4587-8858-6c44550cf30b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:08.873527 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4164338f-83b8-4587-8858-6c44550cf30b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:08.874032 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4164338f-83b8-4587-8858-6c44550cf30b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:08.874659 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4164338f-83b8-4587-8858-6c44550cf30b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:08.875394 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-4164338f-83b8-4587-8858-6c44550cf30b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lazy-loading 'fault' on Instance uuid 6a57ca61-642f-4749-a3f2-3ae1cfcbc542 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:55:08.934096 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4164338f-83b8-4587-8858-6c44550cf30b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:08.956977 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4164338f-83b8-4587-8858-6c44550cf30b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/6a57ca61-642f-4749-a3f2-3ae1cfcbc542" status: 200 len: 1309 microversion: 2.1 time: 0.189854 Sep 24 20:55:08.973806 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 837/1710] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:08 2022] GET /compute/v2.1/servers/6a57ca61-642f-4749-a3f2-3ae1cfcbc542 => generated 1309 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:08.985466 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-d4c3fd6c-db1c-4050-81dd-dc0c894cc325 req-49371a08-e222-4601-9aab-0520157ff8df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a57ca61-642f-4749-a3f2-3ae1cfcbc542", "name": "network-vif-deleted", "tag": "3db6518e-fc81-4574-b1fa-978663ca6d51"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:55:08.999562 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d4c3fd6c-db1c-4050-81dd-dc0c894cc325 req-49371a08-e222-4601-9aab-0520157ff8df service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:09.000844 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d4c3fd6c-db1c-4050-81dd-dc0c894cc325 req-49371a08-e222-4601-9aab-0520157ff8df service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:09.001828 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d4c3fd6c-db1c-4050-81dd-dc0c894cc325 req-49371a08-e222-4601-9aab-0520157ff8df service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:09.025784 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-d4c3fd6c-db1c-4050-81dd-dc0c894cc325 req-49371a08-e222-4601-9aab-0520157ff8df service nova] Creating event network-vif-deleted:3db6518e-fc81-4574-b1fa-978663ca6d51 for instance 6a57ca61-642f-4749-a3f2-3ae1cfcbc542 on nch1-master-1 Sep 24 20:55:09.032511 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-d4c3fd6c-db1c-4050-81dd-dc0c894cc325 req-49371a08-e222-4601-9aab-0520157ff8df service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053678 Sep 24 20:55:09.033370 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 838/1711] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:55:09.040560 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e69ebe1a-f744-4414-a018-40f91e993ebb tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:09.041848 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e69ebe1a-f744-4414-a018-40f91e993ebb tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] [instance: 01455b1b-b319-4297-bd83-5471b441eb12] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:09.069084 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e69ebe1a-f744-4414-a018-40f91e993ebb tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:09.071710 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e69ebe1a-f744-4414-a018-40f91e993ebb tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:09.072455 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e69ebe1a-f744-4414-a018-40f91e993ebb tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:09.074303 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e69ebe1a-f744-4414-a018-40f91e993ebb tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:09.075747 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e69ebe1a-f744-4414-a018-40f91e993ebb tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:09.077442 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e69ebe1a-f744-4414-a018-40f91e993ebb tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:09.383963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e69ebe1a-f744-4414-a018-40f91e993ebb tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0244a0ef19409a8a6e7c6526685919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccf2c674b1748c6b6e0b33e05e02940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:09.387959 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:55:09.404295 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e69ebe1a-f744-4414-a018-40f91e993ebb tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] 10.222.0.52 "GET /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12" status: 200 len: 1322 microversion: 2.1 time: 0.368855 Sep 24 20:55:09.405499 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 839/1712] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:09 2022] GET /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12 => generated 1322 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:09.423763 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f59ea63e-2e6a-4cd3-a517-e0fef1070a9a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:09.428837 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f59ea63e-2e6a-4cd3-a517-e0fef1070a9a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 074c501c-cdef-4f19-81e5-8fc2608e9dd1] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:09.439462 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f59ea63e-2e6a-4cd3-a517-e0fef1070a9a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:09.441207 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f59ea63e-2e6a-4cd3-a517-e0fef1070a9a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:09.442155 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f59ea63e-2e6a-4cd3-a517-e0fef1070a9a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:09.443188 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f59ea63e-2e6a-4cd3-a517-e0fef1070a9a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:09.443865 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f59ea63e-2e6a-4cd3-a517-e0fef1070a9a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:09.460372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f59ea63e-2e6a-4cd3-a517-e0fef1070a9a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:09.501082 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-f59ea63e-2e6a-4cd3-a517-e0fef1070a9a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] HTTP exception thrown: Instance 074c501c-cdef-4f19-81e5-8fc2608e9dd1 could not be found. Sep 24 20:55:09.504528 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f59ea63e-2e6a-4cd3-a517-e0fef1070a9a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Request method failure captured: Sep 24 20:55:09.504528 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1 HTTP/1.1 Sep 24 20:55:09.504528 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:55:09.504528 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:55:09.504528 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:55:09.504528 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:55:09.504528 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:55:09.504528 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:55:09.504528 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:55:09.504528 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:55:09.504528 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL25nfnP4bFGTWGzrr_QRsUXd9wMxdWYj0qEbd874ngXuszXlz0Wd_B7C7CSMGsLjDXHJ13W5tcKy0icXJHkWEqSKU2jW0SUqUtKxIm2jlgCAIO_9cD49gF89cpeSznRLjC516EQc6d2cWE_iQUNyVTXEMVU4xgcj8SO3ipMtnW3AXK8 Sep 24 20:55:09.504528 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:55:09.504528 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:55:09.504528 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:55:09.504528 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:55:09.504528 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:55:09.504528 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:55:09.504528 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 4b55ef17d925408093f5407fa8015787 Sep 24 20:55:09.504528 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-521115943 Sep 24 20:55:09.504528 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:55:09.504528 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:55:09.506559 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4b55ef17d925408093f5407fa8015787"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4b55ef17d925408093f5407fa8015787"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4b55ef17d925408093f5407fa8015787"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4b55ef17d925408093f5407fa8015787"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:55:09.506559 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersAdminNegativeTestJSON-521115943 Sep 24 20:55:09.506559 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 4b55ef17d925408093f5407fa8015787 Sep 24 20:55:09.506559 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-521115943 Sep 24 20:55:09.506559 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersAdminNegativeTestJSON-521115943-project Sep 24 20:55:09.506559 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:55:09.506559 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:55:09.506559 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 2844f27200534323910d80cd869a6601 Sep 24 20:55:09.506559 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersAdminNegativeTestJSON-521115943-project Sep 24 20:55:09.506559 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:55:09.506559 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 074c501c-cdef-4f19-81e5-8fc2608e9dd1 could not be found. Sep 24 20:55:09.506559 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '074c501c-cdef-4f19-81e5-8fc2608e9dd1'} Sep 24 20:55:09.507725 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:55:09.507725 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:09.507725 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:55:09.507725 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:55:09.507725 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:55:09.507725 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:55:09.507725 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:55:09.507725 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:55:09.507725 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:55:09.507725 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:55:09.507725 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 074c501c-cdef-4f19-81e5-8fc2608e9dd1 could not be found. Sep 24 20:55:09.507725 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:09.507725 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:09.507725 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:09.507725 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:09.507725 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:09.507725 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:09.507725 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:55:09.507725 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:55:09.507725 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:55:09.509545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:55:09.509545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:55:09.509545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:55:09.509545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:55:09.509545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:55:09.509545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:55:09.509545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:55:09.509545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 074c501c-cdef-4f19-81e5-8fc2608e9dd1 could not be found. Sep 24 20:55:09.509545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:09.509545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:09.509545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:09.509545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:09.509545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:09.509545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:09.509545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:55:09.509545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:55:09.509545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 074c501c-cdef-4f19-81e5-8fc2608e9dd1 could not be found. Sep 24 20:55:09.509545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:09.513539 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f59ea63e-2e6a-4cd3-a517-e0fef1070a9a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Returning 404 to user: Instance 074c501c-cdef-4f19-81e5-8fc2608e9dd1 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:55:09.519216 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f59ea63e-2e6a-4cd3-a517-e0fef1070a9a tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1" status: 404 len: 111 microversion: 2.1 time: 0.111950 Sep 24 20:55:09.522728 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 840/1713] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:09 2022] GET /compute/v2.1/servers/074c501c-cdef-4f19-81e5-8fc2608e9dd1 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:55:09.530670 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b5974def-2bc2-44b2-a615-dd52c0001197 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:09.534897 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b5974def-2bc2-44b2-a615-dd52c0001197 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 39c753b7-d223-4e33-9086-d64877d26ecc] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:09.546371 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:55:09.549693 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5974def-2bc2-44b2-a615-dd52c0001197 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:09.550610 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5974def-2bc2-44b2-a615-dd52c0001197 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:09.551489 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5974def-2bc2-44b2-a615-dd52c0001197 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:09.552606 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5974def-2bc2-44b2-a615-dd52c0001197 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:09.553282 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5974def-2bc2-44b2-a615-dd52c0001197 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:09.553929 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5974def-2bc2-44b2-a615-dd52c0001197 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:09.614452 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b5974def-2bc2-44b2-a615-dd52c0001197 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 39c753b7-d223-4e33-9086-d64877d26ecc] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:55:09.862581 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b5974def-2bc2-44b2-a615-dd52c0001197 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "DELETE /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc" status: 204 len: 0 microversion: 2.1 time: 0.334170 Sep 24 20:55:09.864553 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 841/1714] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:55:09 2022] DELETE /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:55:09.877024 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bb892c81-fe93-47f8-b74d-60fadeb97baf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:09.877776 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-bb892c81-fe93-47f8-b74d-60fadeb97baf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:09.904276 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb892c81-fe93-47f8-b74d-60fadeb97baf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:09.904771 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb892c81-fe93-47f8-b74d-60fadeb97baf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:09.905215 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb892c81-fe93-47f8-b74d-60fadeb97baf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:09.909122 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb892c81-fe93-47f8-b74d-60fadeb97baf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:09.910640 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb892c81-fe93-47f8-b74d-60fadeb97baf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:09.913856 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb892c81-fe93-47f8-b74d-60fadeb97baf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:09.953544 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=12 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:55:10.248603 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=16 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:55:10.368761 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-bb892c81-fe93-47f8-b74d-60fadeb97baf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:10.383887 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bb892c81-fe93-47f8-b74d-60fadeb97baf tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1474 microversion: 2.1 time: 0.513532 Sep 24 20:55:10.385192 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 842/1715] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:09 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1474 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:10.397288 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-837b111e-0112-46d9-838d-12d524f03071 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:10.406008 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-837b111e-0112-46d9-838d-12d524f03071 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 39c753b7-d223-4e33-9086-d64877d26ecc] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:10.434949 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-837b111e-0112-46d9-838d-12d524f03071 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:10.435840 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-837b111e-0112-46d9-838d-12d524f03071 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:10.436377 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-837b111e-0112-46d9-838d-12d524f03071 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:10.437198 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-837b111e-0112-46d9-838d-12d524f03071 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:10.437748 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-837b111e-0112-46d9-838d-12d524f03071 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:10.438252 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-837b111e-0112-46d9-838d-12d524f03071 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:10.668849 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-837b111e-0112-46d9-838d-12d524f03071 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:10.689460 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-837b111e-0112-46d9-838d-12d524f03071 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc" status: 200 len: 1476 microversion: 2.1 time: 0.302445 Sep 24 20:55:10.692145 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 843/1716] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:10 2022] GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc => generated 1476 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:10.712131 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1a772408-ebda-4797-b4df-fd3858bc1105 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:10.712874 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1a772408-ebda-4797-b4df-fd3858bc1105 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 6a57ca61-642f-4749-a3f2-3ae1cfcbc542] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:10.730530 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a772408-ebda-4797-b4df-fd3858bc1105 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:10.732355 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a772408-ebda-4797-b4df-fd3858bc1105 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:10.734326 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a772408-ebda-4797-b4df-fd3858bc1105 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:10.736296 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a772408-ebda-4797-b4df-fd3858bc1105 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:10.738128 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a772408-ebda-4797-b4df-fd3858bc1105 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:10.739509 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a772408-ebda-4797-b4df-fd3858bc1105 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:10.774381 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-1a772408-ebda-4797-b4df-fd3858bc1105 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] HTTP exception thrown: Instance 6a57ca61-642f-4749-a3f2-3ae1cfcbc542 could not be found. Sep 24 20:55:10.777476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1a772408-ebda-4797-b4df-fd3858bc1105 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Request method failure captured: Sep 24 20:55:10.777476 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/6a57ca61-642f-4749-a3f2-3ae1cfcbc542 HTTP/1.1 Sep 24 20:55:10.777476 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:55:10.777476 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:55:10.777476 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:55:10.777476 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:55:10.777476 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:55:10.777476 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:55:10.777476 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:55:10.777476 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:55:10.777476 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL23ty18wZ369rBpsqLlzALGIa2Gim7BSAzth626XfTPt1jl2TGGDfuIK0NF1uBFJTGNmpODfOJmslXLXls2-SCCSRhWzdKVR2lBkl_nLf9Mq1Le-1pWzwdVHhu2NC69cXC874Lb-O01_urLv2faksB3B4Xzjyj58JzXn5kGazzFVV5g Sep 24 20:55:10.777476 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:55:10.777476 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:55:10.777476 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:55:10.777476 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:55:10.777476 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:55:10.777476 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:55:10.777476 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 73bec7c48b07450f95a29a35e113153d Sep 24 20:55:10.777476 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersOnMultiNodesTest-512776478 Sep 24 20:55:10.777476 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:55:10.777476 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:55:10.779176 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/73bec7c48b07450f95a29a35e113153d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_73bec7c48b07450f95a29a35e113153d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/73bec7c48b07450f95a29a35e113153d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/73bec7c48b07450f95a29a35e113153d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:55:10.779176 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersOnMultiNodesTest-512776478 Sep 24 20:55:10.779176 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 73bec7c48b07450f95a29a35e113153d Sep 24 20:55:10.779176 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-512776478 Sep 24 20:55:10.779176 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersOnMultiNodesTest-512776478-project Sep 24 20:55:10.779176 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:55:10.779176 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:55:10.779176 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 936372eff4da45e281fc5512632a12b6 Sep 24 20:55:10.779176 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersOnMultiNodesTest-512776478-project Sep 24 20:55:10.779176 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:55:10.779176 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 6a57ca61-642f-4749-a3f2-3ae1cfcbc542 could not be found. Sep 24 20:55:10.779176 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '6a57ca61-642f-4749-a3f2-3ae1cfcbc542'} Sep 24 20:55:10.780143 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:55:10.780143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:10.780143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:55:10.780143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:55:10.780143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:55:10.780143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:55:10.780143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:55:10.780143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:55:10.780143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:55:10.780143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:55:10.780143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a57ca61-642f-4749-a3f2-3ae1cfcbc542 could not be found. Sep 24 20:55:10.780143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:10.780143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:10.780143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:10.780143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:10.780143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:10.780143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:10.780143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:55:10.780143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:55:10.780143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:55:10.781607 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:55:10.781607 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:55:10.781607 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:55:10.781607 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:55:10.781607 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:55:10.781607 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:55:10.781607 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:55:10.781607 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a57ca61-642f-4749-a3f2-3ae1cfcbc542 could not be found. Sep 24 20:55:10.781607 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:10.781607 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:10.781607 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:10.781607 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:10.781607 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:10.781607 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:10.781607 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:55:10.781607 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:55:10.781607 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a57ca61-642f-4749-a3f2-3ae1cfcbc542 could not be found. Sep 24 20:55:10.781607 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:10.785128 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1a772408-ebda-4797-b4df-fd3858bc1105 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Returning 404 to user: Instance 6a57ca61-642f-4749-a3f2-3ae1cfcbc542 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:55:10.786368 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1a772408-ebda-4797-b4df-fd3858bc1105 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/6a57ca61-642f-4749-a3f2-3ae1cfcbc542" status: 404 len: 111 microversion: 2.1 time: 0.082610 Sep 24 20:55:10.787737 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 844/1717] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:10 2022] GET /compute/v2.1/servers/6a57ca61-642f-4749-a3f2-3ae1cfcbc542 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:55:10.794426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0119de37-3f18-4a5f-b2f9-1e7196f4faa3 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:10.795311 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0119de37-3f18-4a5f-b2f9-1e7196f4faa3 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] [instance: 01455b1b-b319-4297-bd83-5471b441eb12] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:10.803433 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0119de37-3f18-4a5f-b2f9-1e7196f4faa3 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:10.804772 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0119de37-3f18-4a5f-b2f9-1e7196f4faa3 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:10.805401 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0119de37-3f18-4a5f-b2f9-1e7196f4faa3 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:10.806484 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0119de37-3f18-4a5f-b2f9-1e7196f4faa3 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:10.807617 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0119de37-3f18-4a5f-b2f9-1e7196f4faa3 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:10.810332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0119de37-3f18-4a5f-b2f9-1e7196f4faa3 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:11.067720 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0119de37-3f18-4a5f-b2f9-1e7196f4faa3 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0244a0ef19409a8a6e7c6526685919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccf2c674b1748c6b6e0b33e05e02940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:11.080762 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0119de37-3f18-4a5f-b2f9-1e7196f4faa3 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] 10.222.0.52 "GET /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12" status: 200 len: 1322 microversion: 2.1 time: 0.291669 Sep 24 20:55:11.089773 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 845/1718] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:10 2022] GET /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12 => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:11.100106 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c546b2be-4611-43f9-8268-c02e3b03249a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:11.103403 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c546b2be-4611-43f9-8268-c02e3b03249a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 1c19c5a4-46f9-4e5e-a717-55bc8e5c3026] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:11.123635 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c546b2be-4611-43f9-8268-c02e3b03249a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:11.124430 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c546b2be-4611-43f9-8268-c02e3b03249a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:11.125217 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c546b2be-4611-43f9-8268-c02e3b03249a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:11.126117 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c546b2be-4611-43f9-8268-c02e3b03249a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:11.126759 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c546b2be-4611-43f9-8268-c02e3b03249a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:11.127340 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c546b2be-4611-43f9-8268-c02e3b03249a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:11.169077 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-c546b2be-4611-43f9-8268-c02e3b03249a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] HTTP exception thrown: Instance 1c19c5a4-46f9-4e5e-a717-55bc8e5c3026 could not be found. Sep 24 20:55:11.177088 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c546b2be-4611-43f9-8268-c02e3b03249a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Request method failure captured: Sep 24 20:55:11.177088 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026 HTTP/1.1 Sep 24 20:55:11.177088 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:55:11.177088 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:55:11.177088 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:55:11.177088 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:55:11.177088 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:55:11.177088 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:55:11.177088 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:55:11.177088 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:55:11.177088 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL23ty18wZ369rBpsqLlzALGIa2Gim7BSAzth626XfTPt1jl2TGGDfuIK0NF1uBFJTGNmpODfOJmslXLXls2-SCCSRhWzdKVR2lBkl_nLf9Mq1Le-1pWzwdVHhu2NC69cXC874Lb-O01_urLv2faksB3B4Xzjyj58JzXn5kGazzFVV5g Sep 24 20:55:11.177088 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:55:11.177088 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:55:11.177088 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:55:11.177088 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:55:11.177088 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:55:11.177088 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:55:11.177088 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 73bec7c48b07450f95a29a35e113153d Sep 24 20:55:11.177088 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersOnMultiNodesTest-512776478 Sep 24 20:55:11.177088 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:55:11.177088 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:55:11.178857 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/73bec7c48b07450f95a29a35e113153d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_73bec7c48b07450f95a29a35e113153d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/73bec7c48b07450f95a29a35e113153d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/73bec7c48b07450f95a29a35e113153d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:55:11.178857 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersOnMultiNodesTest-512776478 Sep 24 20:55:11.178857 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 73bec7c48b07450f95a29a35e113153d Sep 24 20:55:11.178857 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-512776478 Sep 24 20:55:11.178857 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersOnMultiNodesTest-512776478-project Sep 24 20:55:11.178857 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:55:11.178857 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:55:11.178857 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 936372eff4da45e281fc5512632a12b6 Sep 24 20:55:11.178857 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersOnMultiNodesTest-512776478-project Sep 24 20:55:11.178857 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:55:11.178857 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 1c19c5a4-46f9-4e5e-a717-55bc8e5c3026 could not be found. Sep 24 20:55:11.178857 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '1c19c5a4-46f9-4e5e-a717-55bc8e5c3026'} Sep 24 20:55:11.179782 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:55:11.179782 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:11.179782 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:55:11.179782 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:55:11.179782 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:55:11.179782 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:55:11.179782 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:55:11.179782 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:55:11.179782 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:55:11.179782 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:55:11.179782 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c19c5a4-46f9-4e5e-a717-55bc8e5c3026 could not be found. Sep 24 20:55:11.179782 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:11.179782 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:11.179782 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:11.179782 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:11.179782 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:11.179782 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:11.179782 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:55:11.179782 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:55:11.179782 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:55:11.181285 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:55:11.181285 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:55:11.181285 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:55:11.181285 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:55:11.181285 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:55:11.181285 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:55:11.181285 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:55:11.181285 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c19c5a4-46f9-4e5e-a717-55bc8e5c3026 could not be found. Sep 24 20:55:11.181285 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:11.181285 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:11.181285 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:11.181285 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:11.181285 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:11.181285 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:11.181285 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:55:11.181285 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:55:11.181285 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c19c5a4-46f9-4e5e-a717-55bc8e5c3026 could not be found. Sep 24 20:55:11.181285 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:11.182736 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c546b2be-4611-43f9-8268-c02e3b03249a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Returning 404 to user: Instance 1c19c5a4-46f9-4e5e-a717-55bc8e5c3026 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:55:11.183149 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c546b2be-4611-43f9-8268-c02e3b03249a tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026" status: 404 len: 111 microversion: 2.1 time: 0.090214 Sep 24 20:55:11.183936 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 846/1719] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:11 2022] GET /compute/v2.1/servers/1c19c5a4-46f9-4e5e-a717-55bc8e5c3026 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:55:11.199495 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-66f9f3a6-2388-412f-b20e-e531516d1cc4 req-6c7c7a6e-ad5c-4337-80cd-dbe67b7a9861 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9425eeec-a7b4-4926-a2f3-80dd47eb9e0c", "name": "network-vif-unplugged", "status": "completed", "tag": "7138905c-dbe0-4d9c-83c3-21fb5d346268"}, {"name": "network-changed", "server_uuid": "01455b1b-b319-4297-bd83-5471b441eb12", "tag": "e1dd21a3-c3ac-4806-9e3e-2da6c3fd40b6"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:55:11.217856 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-66f9f3a6-2388-412f-b20e-e531516d1cc4 req-6c7c7a6e-ad5c-4337-80cd-dbe67b7a9861 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:11.218622 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-66f9f3a6-2388-412f-b20e-e531516d1cc4 req-6c7c7a6e-ad5c-4337-80cd-dbe67b7a9861 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:11.219309 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-66f9f3a6-2388-412f-b20e-e531516d1cc4 req-6c7c7a6e-ad5c-4337-80cd-dbe67b7a9861 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:11.242947 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-66f9f3a6-2388-412f-b20e-e531516d1cc4 req-6c7c7a6e-ad5c-4337-80cd-dbe67b7a9861 service nova] Creating event network-vif-unplugged:7138905c-dbe0-4d9c-83c3-21fb5d346268 for instance 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c on nch1-master-1 Sep 24 20:55:11.249886 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-66f9f3a6-2388-412f-b20e-e531516d1cc4 req-6c7c7a6e-ad5c-4337-80cd-dbe67b7a9861 service nova] Creating event network-changed:e1dd21a3-c3ac-4806-9e3e-2da6c3fd40b6 for instance 01455b1b-b319-4297-bd83-5471b441eb12 on nch2-master-1 Sep 24 20:55:11.270709 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [req-66f9f3a6-2388-412f-b20e-e531516d1cc4 req-6c7c7a6e-ad5c-4337-80cd-dbe67b7a9861 service nova] Instance 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 20:55:11.290167 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-66f9f3a6-2388-412f-b20e-e531516d1cc4 req-6c7c7a6e-ad5c-4337-80cd-dbe67b7a9861 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.104455 Sep 24 20:55:11.292335 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 847/1720] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:55:11.302593 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3daf78f5-651d-410d-b9b6-24862ad2f393 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:11.359521 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3daf78f5-651d-410d-b9b6-24862ad2f393 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/92c5334a-46a2-4c38-a94e-b62060cbfecf" status: 204 len: 0 microversion: 2.1 time: 0.065400 Sep 24 20:55:11.360117 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 848/1721] 10.222.0.52 () {58 vars in 1266 bytes} [Sat Sep 24 20:55:11 2022] DELETE /compute/v2.1/os-server-groups/92c5334a-46a2-4c38-a94e-b62060cbfecf => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:55:11.369713 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-844c83fc-2116-41be-acce-996bbda2c8b5 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:11.370337 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-844c83fc-2116-41be-acce-996bbda2c8b5 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 1de24cda-52fe-42b6-8639-4bb3c77b5eb7] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:11.391124 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-844c83fc-2116-41be-acce-996bbda2c8b5 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:11.391713 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-844c83fc-2116-41be-acce-996bbda2c8b5 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:11.392236 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-844c83fc-2116-41be-acce-996bbda2c8b5 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:11.392890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-844c83fc-2116-41be-acce-996bbda2c8b5 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:11.393931 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-844c83fc-2116-41be-acce-996bbda2c8b5 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:11.396680 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-844c83fc-2116-41be-acce-996bbda2c8b5 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:11.466538 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-844c83fc-2116-41be-acce-996bbda2c8b5 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 1de24cda-52fe-42b6-8639-4bb3c77b5eb7] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:55:11.665622 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-844c83fc-2116-41be-acce-996bbda2c8b5 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1de24cda-52fe-42b6-8639-4bb3c77b5eb7" status: 204 len: 0 microversion: 2.1 time: 0.300406 Sep 24 20:55:11.669785 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 849/1722] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:55:11 2022] DELETE /compute/v2.1/servers/1de24cda-52fe-42b6-8639-4bb3c77b5eb7 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:55:11.676051 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6967481d-bcde-4bed-8103-ccccf31be0b6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:11.676782 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6967481d-bcde-4bed-8103-ccccf31be0b6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:11.697062 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6967481d-bcde-4bed-8103-ccccf31be0b6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:11.697569 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6967481d-bcde-4bed-8103-ccccf31be0b6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:11.698024 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6967481d-bcde-4bed-8103-ccccf31be0b6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:11.698781 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6967481d-bcde-4bed-8103-ccccf31be0b6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:11.699250 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6967481d-bcde-4bed-8103-ccccf31be0b6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:11.699688 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6967481d-bcde-4bed-8103-ccccf31be0b6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:11.895769 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6967481d-bcde-4bed-8103-ccccf31be0b6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:11.906537 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6967481d-bcde-4bed-8103-ccccf31be0b6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1474 microversion: 2.1 time: 0.233966 Sep 24 20:55:11.906914 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 850/1723] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:11 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1474 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:11.911559 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b1490a30-e663-48ad-a272-c3a0259f5b29 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:11.912067 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b1490a30-e663-48ad-a272-c3a0259f5b29 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: fc6a752b-8418-4657-8e37-3d9259b45d4e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:11.918758 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1490a30-e663-48ad-a272-c3a0259f5b29 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:11.919258 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1490a30-e663-48ad-a272-c3a0259f5b29 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:11.919704 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1490a30-e663-48ad-a272-c3a0259f5b29 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:11.920494 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1490a30-e663-48ad-a272-c3a0259f5b29 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:11.920886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1490a30-e663-48ad-a272-c3a0259f5b29 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:11.921327 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1490a30-e663-48ad-a272-c3a0259f5b29 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:11.956538 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b1490a30-e663-48ad-a272-c3a0259f5b29 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: fc6a752b-8418-4657-8e37-3d9259b45d4e] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:55:12.074083 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b1490a30-e663-48ad-a272-c3a0259f5b29 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fc6a752b-8418-4657-8e37-3d9259b45d4e" status: 204 len: 0 microversion: 2.1 time: 0.166071 Sep 24 20:55:12.075007 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 851/1724] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:55:11 2022] DELETE /compute/v2.1/servers/fc6a752b-8418-4657-8e37-3d9259b45d4e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:55:12.084884 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ba6b986c-cfdb-49d8-9760-3f4904a11af8 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:12.085830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ba6b986c-cfdb-49d8-9760-3f4904a11af8 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 39c753b7-d223-4e33-9086-d64877d26ecc] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:12.093129 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba6b986c-cfdb-49d8-9760-3f4904a11af8 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:12.093816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba6b986c-cfdb-49d8-9760-3f4904a11af8 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:12.094465 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba6b986c-cfdb-49d8-9760-3f4904a11af8 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:12.095328 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba6b986c-cfdb-49d8-9760-3f4904a11af8 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:12.095877 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba6b986c-cfdb-49d8-9760-3f4904a11af8 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:12.096370 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba6b986c-cfdb-49d8-9760-3f4904a11af8 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:12.298691 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ba6b986c-cfdb-49d8-9760-3f4904a11af8 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:12.308737 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ba6b986c-cfdb-49d8-9760-3f4904a11af8 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc" status: 200 len: 1476 microversion: 2.1 time: 0.229276 Sep 24 20:55:12.310047 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 852/1725] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:12 2022] GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc => generated 1476 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:12.318629 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:55:12.333376 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4c8809f7-7700-4e37-8328-e989ce056703 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:12.334000 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4c8809f7-7700-4e37-8328-e989ce056703 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 1de24cda-52fe-42b6-8639-4bb3c77b5eb7] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:12.347188 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:55:12.347924 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4c8809f7-7700-4e37-8328-e989ce056703 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:12.348583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4c8809f7-7700-4e37-8328-e989ce056703 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:12.349183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4c8809f7-7700-4e37-8328-e989ce056703 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:12.350216 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4c8809f7-7700-4e37-8328-e989ce056703 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:12.350996 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4c8809f7-7700-4e37-8328-e989ce056703 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:12.351594 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4c8809f7-7700-4e37-8328-e989ce056703 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:12.524606 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4c8809f7-7700-4e37-8328-e989ce056703 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:12.540676 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4c8809f7-7700-4e37-8328-e989ce056703 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/1de24cda-52fe-42b6-8639-4bb3c77b5eb7" status: 200 len: 1473 microversion: 2.1 time: 0.215363 Sep 24 20:55:12.554534 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 853/1726] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:12 2022] GET /compute/v2.1/servers/1de24cda-52fe-42b6-8639-4bb3c77b5eb7 => generated 1473 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:12.560322 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c3404d18-0a64-42d2-880f-3f6b0dc37e1f tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:12.560954 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c3404d18-0a64-42d2-880f-3f6b0dc37e1f tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] [instance: 01455b1b-b319-4297-bd83-5471b441eb12] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:12.569395 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3404d18-0a64-42d2-880f-3f6b0dc37e1f tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:12.569897 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3404d18-0a64-42d2-880f-3f6b0dc37e1f tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:12.570624 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3404d18-0a64-42d2-880f-3f6b0dc37e1f tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:12.571411 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3404d18-0a64-42d2-880f-3f6b0dc37e1f tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:12.571879 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3404d18-0a64-42d2-880f-3f6b0dc37e1f tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:12.572392 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3404d18-0a64-42d2-880f-3f6b0dc37e1f tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:12.909549 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c3404d18-0a64-42d2-880f-3f6b0dc37e1f tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0244a0ef19409a8a6e7c6526685919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccf2c674b1748c6b6e0b33e05e02940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:12.919558 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:55:12.923995 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c3404d18-0a64-42d2-880f-3f6b0dc37e1f tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] 10.222.0.52 "GET /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12" status: 200 len: 1322 microversion: 2.1 time: 0.376383 Sep 24 20:55:12.923995 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 854/1727] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:12 2022] GET /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12 => generated 1322 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:12.947864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-82f0f362-1fd7-4f08-8512-2623080d2db4 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:12.947864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-82f0f362-1fd7-4f08-8512-2623080d2db4 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:12.952715 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-82f0f362-1fd7-4f08-8512-2623080d2db4 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:12.953223 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-82f0f362-1fd7-4f08-8512-2623080d2db4 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:12.959632 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-82f0f362-1fd7-4f08-8512-2623080d2db4 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:12.959632 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-82f0f362-1fd7-4f08-8512-2623080d2db4 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:12.959632 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-82f0f362-1fd7-4f08-8512-2623080d2db4 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:12.959632 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-82f0f362-1fd7-4f08-8512-2623080d2db4 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:13.255119 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-82f0f362-1fd7-4f08-8512-2623080d2db4 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:13.263189 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-82f0f362-1fd7-4f08-8512-2623080d2db4 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1474 microversion: 2.1 time: 0.324984 Sep 24 20:55:13.282091 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 855/1728] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:12 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1474 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:55:13.308780 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-e88e1577-7c3a-4a1d-ae4b-e83151c39948 req-304e0fac-fb8d-44f4-afbf-708e47665c4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9425eeec-a7b4-4926-a2f3-80dd47eb9e0c", "tag": "7138905c-dbe0-4d9c-83c3-21fb5d346268"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:55:13.325804 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-e88e1577-7c3a-4a1d-ae4b-e83151c39948 req-304e0fac-fb8d-44f4-afbf-708e47665c4c service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:13.325804 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-e88e1577-7c3a-4a1d-ae4b-e83151c39948 req-304e0fac-fb8d-44f4-afbf-708e47665c4c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:13.325804 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-e88e1577-7c3a-4a1d-ae4b-e83151c39948 req-304e0fac-fb8d-44f4-afbf-708e47665c4c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:13.358038 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-e88e1577-7c3a-4a1d-ae4b-e83151c39948 req-304e0fac-fb8d-44f4-afbf-708e47665c4c service nova] Creating event network-changed:7138905c-dbe0-4d9c-83c3-21fb5d346268 for instance 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c on nch1-master-1 Sep 24 20:55:13.377972 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [req-e88e1577-7c3a-4a1d-ae4b-e83151c39948 req-304e0fac-fb8d-44f4-afbf-708e47665c4c service nova] Instance 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 20:55:13.402696 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-e88e1577-7c3a-4a1d-ae4b-e83151c39948 req-304e0fac-fb8d-44f4-afbf-708e47665c4c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094152 Sep 24 20:55:13.404456 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 856/1729] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:55:13.415857 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a64f6560-3cc2-4377-921b-948ad71934f3 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:13.417233 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a64f6560-3cc2-4377-921b-948ad71934f3 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 39c753b7-d223-4e33-9086-d64877d26ecc] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:13.427326 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a64f6560-3cc2-4377-921b-948ad71934f3 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:13.428179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a64f6560-3cc2-4377-921b-948ad71934f3 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:13.428879 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a64f6560-3cc2-4377-921b-948ad71934f3 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:13.430015 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a64f6560-3cc2-4377-921b-948ad71934f3 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:13.430747 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a64f6560-3cc2-4377-921b-948ad71934f3 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:13.431519 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a64f6560-3cc2-4377-921b-948ad71934f3 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:13.678137 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a64f6560-3cc2-4377-921b-948ad71934f3 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:13.695977 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a64f6560-3cc2-4377-921b-948ad71934f3 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc" status: 200 len: 1476 microversion: 2.1 time: 0.289659 Sep 24 20:55:13.699948 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 857/1730] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:13 2022] GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc => generated 1476 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:13.716076 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4cecf57a-68ab-4e5a-a577-5927dc6857b8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:13.719052 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4cecf57a-68ab-4e5a-a577-5927dc6857b8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 1de24cda-52fe-42b6-8639-4bb3c77b5eb7] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:13.744090 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4cecf57a-68ab-4e5a-a577-5927dc6857b8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:13.746838 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4cecf57a-68ab-4e5a-a577-5927dc6857b8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:13.750819 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4cecf57a-68ab-4e5a-a577-5927dc6857b8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:13.751743 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4cecf57a-68ab-4e5a-a577-5927dc6857b8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:13.753007 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4cecf57a-68ab-4e5a-a577-5927dc6857b8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:13.753228 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4cecf57a-68ab-4e5a-a577-5927dc6857b8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:14.147250 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4cecf57a-68ab-4e5a-a577-5927dc6857b8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:14.168169 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4cecf57a-68ab-4e5a-a577-5927dc6857b8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/1de24cda-52fe-42b6-8639-4bb3c77b5eb7" status: 200 len: 1473 microversion: 2.1 time: 0.462607 Sep 24 20:55:14.168954 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 858/1731] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:13 2022] GET /compute/v2.1/servers/1de24cda-52fe-42b6-8639-4bb3c77b5eb7 => generated 1473 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:14.197838 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-ca8e2bbc-180f-42d6-9324-6db7387c5d59 req-c2e8177a-667f-4e8b-9140-23bd021cbaa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39c753b7-d223-4e33-9086-d64877d26ecc", "name": "network-vif-deleted", "tag": "7aefbbe0-4d35-4c50-9cd0-90292cc0b874"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:55:14.223046 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-ca8e2bbc-180f-42d6-9324-6db7387c5d59 req-c2e8177a-667f-4e8b-9140-23bd021cbaa2 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:14.227520 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-ca8e2bbc-180f-42d6-9324-6db7387c5d59 req-c2e8177a-667f-4e8b-9140-23bd021cbaa2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:14.228068 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-ca8e2bbc-180f-42d6-9324-6db7387c5d59 req-c2e8177a-667f-4e8b-9140-23bd021cbaa2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:14.266829 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-ca8e2bbc-180f-42d6-9324-6db7387c5d59 req-c2e8177a-667f-4e8b-9140-23bd021cbaa2 service nova] Creating event network-vif-deleted:7aefbbe0-4d35-4c50-9cd0-90292cc0b874 for instance 39c753b7-d223-4e33-9086-d64877d26ecc on nch1-master-1 Sep 24 20:55:14.282840 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-ca8e2bbc-180f-42d6-9324-6db7387c5d59 req-c2e8177a-667f-4e8b-9140-23bd021cbaa2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091894 Sep 24 20:55:14.284674 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 859/1732] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:55:14.298583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c616a437-13c4-4f02-8882-bf375283e187 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:14.302778 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c616a437-13c4-4f02-8882-bf375283e187 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] [instance: 01455b1b-b319-4297-bd83-5471b441eb12] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:14.318995 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c616a437-13c4-4f02-8882-bf375283e187 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:14.322775 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c616a437-13c4-4f02-8882-bf375283e187 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:14.326946 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c616a437-13c4-4f02-8882-bf375283e187 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:14.327760 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c616a437-13c4-4f02-8882-bf375283e187 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:14.328238 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c616a437-13c4-4f02-8882-bf375283e187 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:14.328670 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c616a437-13c4-4f02-8882-bf375283e187 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:14.851529 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c616a437-13c4-4f02-8882-bf375283e187 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0244a0ef19409a8a6e7c6526685919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccf2c674b1748c6b6e0b33e05e02940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:14.874057 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c616a437-13c4-4f02-8882-bf375283e187 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] 10.222.0.52 "GET /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12" status: 200 len: 1322 microversion: 2.1 time: 0.586328 Sep 24 20:55:14.879186 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 860/1733] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:14 2022] GET /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12 => generated 1322 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:15.059658 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8871aada-5288-4c03-811b-5a39bcddeb70 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:15.060310 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8871aada-5288-4c03-811b-5a39bcddeb70 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:15.069632 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8871aada-5288-4c03-811b-5a39bcddeb70 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:15.071424 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8871aada-5288-4c03-811b-5a39bcddeb70 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:15.076278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8871aada-5288-4c03-811b-5a39bcddeb70 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:15.077925 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8871aada-5288-4c03-811b-5a39bcddeb70 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:15.078595 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8871aada-5288-4c03-811b-5a39bcddeb70 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:15.079194 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8871aada-5288-4c03-811b-5a39bcddeb70 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:15.505905 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8871aada-5288-4c03-811b-5a39bcddeb70 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:15.612681 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8871aada-5288-4c03-811b-5a39bcddeb70 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1474 microversion: 2.1 time: 0.731791 Sep 24 20:55:15.619854 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 861/1734] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:14 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1474 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:15.662153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-729b0284-cf42-4d34-b841-78b874cfe8ac tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:15.671443 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-729b0284-cf42-4d34-b841-78b874cfe8ac tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 39c753b7-d223-4e33-9086-d64877d26ecc] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:15.698045 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-729b0284-cf42-4d34-b841-78b874cfe8ac tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:15.698577 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-729b0284-cf42-4d34-b841-78b874cfe8ac tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:15.706397 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-729b0284-cf42-4d34-b841-78b874cfe8ac tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:15.709780 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-729b0284-cf42-4d34-b841-78b874cfe8ac tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:15.710301 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-729b0284-cf42-4d34-b841-78b874cfe8ac tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:15.712174 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-729b0284-cf42-4d34-b841-78b874cfe8ac tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:15.789249 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-729b0284-cf42-4d34-b841-78b874cfe8ac tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:15.790251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-729b0284-cf42-4d34-b841-78b874cfe8ac tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:15.791302 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-729b0284-cf42-4d34-b841-78b874cfe8ac tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:15.853247 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-729b0284-cf42-4d34-b841-78b874cfe8ac tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lazy-loading 'fault' on Instance uuid 39c753b7-d223-4e33-9086-d64877d26ecc {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:55:15.868454 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-729b0284-cf42-4d34-b841-78b874cfe8ac tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:15.883697 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-729b0284-cf42-4d34-b841-78b874cfe8ac tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc" status: 200 len: 1311 microversion: 2.1 time: 0.243682 Sep 24 20:55:15.887881 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 862/1735] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:15 2022] GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc => generated 1311 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:15.892786 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-95ffc2f3-d541-40ff-b38f-4f682c52f5de tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:15.902144 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-95ffc2f3-d541-40ff-b38f-4f682c52f5de tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 1de24cda-52fe-42b6-8639-4bb3c77b5eb7] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:15.910826 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-95ffc2f3-d541-40ff-b38f-4f682c52f5de tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:15.912687 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-95ffc2f3-d541-40ff-b38f-4f682c52f5de tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:15.913395 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-95ffc2f3-d541-40ff-b38f-4f682c52f5de tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:15.914065 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-95ffc2f3-d541-40ff-b38f-4f682c52f5de tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:15.914678 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-95ffc2f3-d541-40ff-b38f-4f682c52f5de tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:15.915362 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-95ffc2f3-d541-40ff-b38f-4f682c52f5de tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:16.220522 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-95ffc2f3-d541-40ff-b38f-4f682c52f5de tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:16.242886 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-95ffc2f3-d541-40ff-b38f-4f682c52f5de tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/1de24cda-52fe-42b6-8639-4bb3c77b5eb7" status: 200 len: 1431 microversion: 2.1 time: 0.348141 Sep 24 20:55:16.247832 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 863/1736] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:15 2022] GET /compute/v2.1/servers/1de24cda-52fe-42b6-8639-4bb3c77b5eb7 => generated 1431 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:16.274916 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5d9a773c-6aa5-44d9-bf2f-71077ca89257 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:16.276115 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5d9a773c-6aa5-44d9-bf2f-71077ca89257 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] [instance: 01455b1b-b319-4297-bd83-5471b441eb12] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:16.295239 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d9a773c-6aa5-44d9-bf2f-71077ca89257 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:16.296009 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d9a773c-6aa5-44d9-bf2f-71077ca89257 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:16.296697 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d9a773c-6aa5-44d9-bf2f-71077ca89257 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:16.298275 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d9a773c-6aa5-44d9-bf2f-71077ca89257 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:16.299007 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d9a773c-6aa5-44d9-bf2f-71077ca89257 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:16.309971 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d9a773c-6aa5-44d9-bf2f-71077ca89257 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:16.556587 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5d9a773c-6aa5-44d9-bf2f-71077ca89257 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0244a0ef19409a8a6e7c6526685919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccf2c674b1748c6b6e0b33e05e02940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:16.570287 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5d9a773c-6aa5-44d9-bf2f-71077ca89257 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] 10.222.0.52 "GET /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12" status: 200 len: 1322 microversion: 2.1 time: 0.320864 Sep 24 20:55:16.571542 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 864/1737] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:16 2022] GET /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12 => generated 1322 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:16.577794 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-bfb610ee-cc1a-47df-a936-e5b9262d1169 req-ce8d0f5f-530f-498e-a70d-642f4a1eece1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01455b1b-b319-4297-bd83-5471b441eb12", "name": "network-vif-plugged", "status": "completed", "tag": "e1dd21a3-c3ac-4806-9e3e-2da6c3fd40b6"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:55:16.588370 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-bfb610ee-cc1a-47df-a936-e5b9262d1169 req-ce8d0f5f-530f-498e-a70d-642f4a1eece1 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:16.589141 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-bfb610ee-cc1a-47df-a936-e5b9262d1169 req-ce8d0f5f-530f-498e-a70d-642f4a1eece1 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:16.589586 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-bfb610ee-cc1a-47df-a936-e5b9262d1169 req-ce8d0f5f-530f-498e-a70d-642f4a1eece1 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:16.608016 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-bfb610ee-cc1a-47df-a936-e5b9262d1169 req-ce8d0f5f-530f-498e-a70d-642f4a1eece1 service nova] Creating event network-vif-plugged:e1dd21a3-c3ac-4806-9e3e-2da6c3fd40b6 for instance 01455b1b-b319-4297-bd83-5471b441eb12 on nch2-master-1 Sep 24 20:55:16.618309 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-bfb610ee-cc1a-47df-a936-e5b9262d1169 req-ce8d0f5f-530f-498e-a70d-642f4a1eece1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044007 Sep 24 20:55:16.619308 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 865/1738] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:55:16.630164 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-4c39f211-52d4-406c-8d58-75b15fc13599 req-26c341c4-83e4-4a4b-93ee-3a8b93d4c57c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1de24cda-52fe-42b6-8639-4bb3c77b5eb7", "name": "network-vif-deleted", "tag": "8c825e40-7e4d-4161-a9bf-cab2864992bd"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:55:16.657275 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-4c39f211-52d4-406c-8d58-75b15fc13599 req-26c341c4-83e4-4a4b-93ee-3a8b93d4c57c service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:16.657761 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-4c39f211-52d4-406c-8d58-75b15fc13599 req-26c341c4-83e4-4a4b-93ee-3a8b93d4c57c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:16.659895 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-4c39f211-52d4-406c-8d58-75b15fc13599 req-26c341c4-83e4-4a4b-93ee-3a8b93d4c57c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:16.679967 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-4c39f211-52d4-406c-8d58-75b15fc13599 req-26c341c4-83e4-4a4b-93ee-3a8b93d4c57c service nova] Creating event network-vif-deleted:8c825e40-7e4d-4161-a9bf-cab2864992bd for instance 1de24cda-52fe-42b6-8639-4bb3c77b5eb7 on nch1-master-1 Sep 24 20:55:16.687526 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-4c39f211-52d4-406c-8d58-75b15fc13599 req-26c341c4-83e4-4a4b-93ee-3a8b93d4c57c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066577 Sep 24 20:55:16.688703 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 866/1739] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:55:16.695798 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7582b2d3-e0f3-4f1f-bd75-6974a18db623 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:16.696814 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7582b2d3-e0f3-4f1f-bd75-6974a18db623 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:16.704933 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7582b2d3-e0f3-4f1f-bd75-6974a18db623 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:16.705523 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7582b2d3-e0f3-4f1f-bd75-6974a18db623 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:16.706834 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7582b2d3-e0f3-4f1f-bd75-6974a18db623 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:16.707870 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7582b2d3-e0f3-4f1f-bd75-6974a18db623 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:16.708437 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7582b2d3-e0f3-4f1f-bd75-6974a18db623 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:16.708956 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7582b2d3-e0f3-4f1f-bd75-6974a18db623 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:16.836072 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9a516220-8747-4ecb-8d1d-0e3b05fa6fc2 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/4efda41f-1d87-450f-8456-2a80880b8c9a" status: 200 len: 1427 microversion: 2.1 time: 14.478595 Sep 24 20:55:16.842836 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 874/1740] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:55:02 2022] GET /compute/v2.1/images/4efda41f-1d87-450f-8456-2a80880b8c9a => generated 1427 bytes in 14486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:16.914943 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0773987d-e98e-4c08-b974-de957d48df51 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:16.915690 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0773987d-e98e-4c08-b974-de957d48df51 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 39c753b7-d223-4e33-9086-d64877d26ecc] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:16.928833 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0773987d-e98e-4c08-b974-de957d48df51 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:16.929697 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0773987d-e98e-4c08-b974-de957d48df51 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:16.931167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0773987d-e98e-4c08-b974-de957d48df51 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:16.931665 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0773987d-e98e-4c08-b974-de957d48df51 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:16.933516 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0773987d-e98e-4c08-b974-de957d48df51 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:16.937361 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0773987d-e98e-4c08-b974-de957d48df51 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:16.950772 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7582b2d3-e0f3-4f1f-bd75-6974a18db623 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:16.962615 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7582b2d3-e0f3-4f1f-bd75-6974a18db623 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1472 microversion: 2.1 time: 0.271912 Sep 24 20:55:16.966541 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 867/1741] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:16 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1472 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:16.995378 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0773987d-e98e-4c08-b974-de957d48df51 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:16.995874 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0773987d-e98e-4c08-b974-de957d48df51 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:16.996327 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0773987d-e98e-4c08-b974-de957d48df51 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:16.996788 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-0773987d-e98e-4c08-b974-de957d48df51 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lazy-loading 'fault' on Instance uuid 39c753b7-d223-4e33-9086-d64877d26ecc {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:55:17.098298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0773987d-e98e-4c08-b974-de957d48df51 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:17.125966 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0773987d-e98e-4c08-b974-de957d48df51 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc" status: 200 len: 1311 microversion: 2.1 time: 0.215695 Sep 24 20:55:17.129156 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 875/1742] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:16 2022] GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc => generated 1311 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:17.271667 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d1d749b3-c1f3-474b-ba29-32c11921bebf tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:17.276182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d1d749b3-c1f3-474b-ba29-32c11921bebf tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 1de24cda-52fe-42b6-8639-4bb3c77b5eb7] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:17.292929 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d1d749b3-c1f3-474b-ba29-32c11921bebf tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:17.293999 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d1d749b3-c1f3-474b-ba29-32c11921bebf tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:17.296924 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d1d749b3-c1f3-474b-ba29-32c11921bebf tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:17.298133 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d1d749b3-c1f3-474b-ba29-32c11921bebf tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:17.298862 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d1d749b3-c1f3-474b-ba29-32c11921bebf tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:17.299526 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d1d749b3-c1f3-474b-ba29-32c11921bebf tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:17.380301 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d1d749b3-c1f3-474b-ba29-32c11921bebf tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:17.393266 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d1d749b3-c1f3-474b-ba29-32c11921bebf tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/1de24cda-52fe-42b6-8639-4bb3c77b5eb7" status: 200 len: 1431 microversion: 2.1 time: 0.127519 Sep 24 20:55:17.394454 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 868/1743] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:17 2022] GET /compute/v2.1/servers/1de24cda-52fe-42b6-8639-4bb3c77b5eb7 => generated 1431 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:17.593095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e00114c7-2f0a-47d0-9ffa-3aea0fd042ae tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:17.593954 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e00114c7-2f0a-47d0-9ffa-3aea0fd042ae tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] [instance: 01455b1b-b319-4297-bd83-5471b441eb12] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:17.601597 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e00114c7-2f0a-47d0-9ffa-3aea0fd042ae tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:17.602454 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e00114c7-2f0a-47d0-9ffa-3aea0fd042ae tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:17.603178 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e00114c7-2f0a-47d0-9ffa-3aea0fd042ae tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:17.604145 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e00114c7-2f0a-47d0-9ffa-3aea0fd042ae tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:17.604828 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e00114c7-2f0a-47d0-9ffa-3aea0fd042ae tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:17.605485 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e00114c7-2f0a-47d0-9ffa-3aea0fd042ae tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:17.809497 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e00114c7-2f0a-47d0-9ffa-3aea0fd042ae tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0244a0ef19409a8a6e7c6526685919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccf2c674b1748c6b6e0b33e05e02940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:17.819472 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e00114c7-2f0a-47d0-9ffa-3aea0fd042ae tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] 10.222.0.52 "GET /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12" status: 200 len: 1322 microversion: 2.1 time: 0.230165 Sep 24 20:55:17.835751 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 876/1744] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:17 2022] GET /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12 => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:17.856373 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dadd290e-af97-4482-8b44-a2a031f6a9aa tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b0c3c2700>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:17.919664 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-dadd290e-af97-4482-8b44-a2a031f6a9aa tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/4efda41f-1d87-450f-8456-2a80880b8c9a" status: 200 len: 1427 microversion: 2.1 time: 0.071799 Sep 24 20:55:17.920782 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 869/1745] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:55:17 2022] GET /compute/v2.1/images/4efda41f-1d87-450f-8456-2a80880b8c9a => generated 1427 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:55:17.987749 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ed81cc3b-07ab-4c77-b79b-a0edd94532f6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:17.990384 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ed81cc3b-07ab-4c77-b79b-a0edd94532f6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:17.997141 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed81cc3b-07ab-4c77-b79b-a0edd94532f6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:17.997911 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed81cc3b-07ab-4c77-b79b-a0edd94532f6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:17.998632 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed81cc3b-07ab-4c77-b79b-a0edd94532f6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:17.999720 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed81cc3b-07ab-4c77-b79b-a0edd94532f6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:18.000443 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed81cc3b-07ab-4c77-b79b-a0edd94532f6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:18.001447 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed81cc3b-07ab-4c77-b79b-a0edd94532f6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:18.168400 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-daec0731-3a2e-441f-b40d-f2e99d6fe653 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:18.175152 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-daec0731-3a2e-441f-b40d-f2e99d6fe653 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 39c753b7-d223-4e33-9086-d64877d26ecc] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:18.197822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ed81cc3b-07ab-4c77-b79b-a0edd94532f6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:18.208121 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ed81cc3b-07ab-4c77-b79b-a0edd94532f6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1472 microversion: 2.1 time: 0.225491 Sep 24 20:55:18.209479 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 877/1746] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:17 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1472 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:18.233989 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-daec0731-3a2e-441f-b40d-f2e99d6fe653 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:18.234831 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-daec0731-3a2e-441f-b40d-f2e99d6fe653 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:18.235381 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-daec0731-3a2e-441f-b40d-f2e99d6fe653 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:18.236206 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-daec0731-3a2e-441f-b40d-f2e99d6fe653 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:18.237779 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-daec0731-3a2e-441f-b40d-f2e99d6fe653 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:18.238780 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-daec0731-3a2e-441f-b40d-f2e99d6fe653 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:18.293257 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-daec0731-3a2e-441f-b40d-f2e99d6fe653 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:18.294828 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-daec0731-3a2e-441f-b40d-f2e99d6fe653 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:18.295868 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-daec0731-3a2e-441f-b40d-f2e99d6fe653 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:18.297305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-daec0731-3a2e-441f-b40d-f2e99d6fe653 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lazy-loading 'fault' on Instance uuid 39c753b7-d223-4e33-9086-d64877d26ecc {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:55:18.373671 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-daec0731-3a2e-441f-b40d-f2e99d6fe653 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2844f27200534323910d80cd869a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b55ef17d925408093f5407fa8015787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:18.384009 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-daec0731-3a2e-441f-b40d-f2e99d6fe653 tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc" status: 200 len: 1311 microversion: 2.1 time: 0.227953 Sep 24 20:55:18.395313 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 870/1747] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:18 2022] GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc => generated 1311 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:18.418069 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-df25af92-c72f-4d33-817a-351fe742b382 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:18.419127 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-df25af92-c72f-4d33-817a-351fe742b382 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 1de24cda-52fe-42b6-8639-4bb3c77b5eb7] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:18.427641 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df25af92-c72f-4d33-817a-351fe742b382 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:18.428433 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df25af92-c72f-4d33-817a-351fe742b382 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:18.431961 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df25af92-c72f-4d33-817a-351fe742b382 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:18.434102 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df25af92-c72f-4d33-817a-351fe742b382 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:18.434841 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df25af92-c72f-4d33-817a-351fe742b382 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:18.435725 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df25af92-c72f-4d33-817a-351fe742b382 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:18.520613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-df25af92-c72f-4d33-817a-351fe742b382 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:18.532120 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-df25af92-c72f-4d33-817a-351fe742b382 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/1de24cda-52fe-42b6-8639-4bb3c77b5eb7" status: 200 len: 1431 microversion: 2.1 time: 0.118724 Sep 24 20:55:18.532721 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 878/1748] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:18 2022] GET /compute/v2.1/servers/1de24cda-52fe-42b6-8639-4bb3c77b5eb7 => generated 1431 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:18.708823 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-bef4cec5-f8d6-434c-8b3c-413148d5a2e5 req-7d5031af-63e1-43a0-8434-3213baf87d71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc6a752b-8418-4657-8e37-3d9259b45d4e", "name": "network-vif-deleted", "tag": "5f5a0c0a-3945-4355-9600-b930be774f0d"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:55:18.719730 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-bef4cec5-f8d6-434c-8b3c-413148d5a2e5 req-7d5031af-63e1-43a0-8434-3213baf87d71 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:18.724385 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-bef4cec5-f8d6-434c-8b3c-413148d5a2e5 req-7d5031af-63e1-43a0-8434-3213baf87d71 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:18.724868 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-bef4cec5-f8d6-434c-8b3c-413148d5a2e5 req-7d5031af-63e1-43a0-8434-3213baf87d71 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:18.737127 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-bef4cec5-f8d6-434c-8b3c-413148d5a2e5 req-7d5031af-63e1-43a0-8434-3213baf87d71 service nova] Creating event network-vif-deleted:5f5a0c0a-3945-4355-9600-b930be774f0d for instance fc6a752b-8418-4657-8e37-3d9259b45d4e on nch1-master-1 Sep 24 20:55:18.742329 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-bef4cec5-f8d6-434c-8b3c-413148d5a2e5 req-7d5031af-63e1-43a0-8434-3213baf87d71 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037759 Sep 24 20:55:18.742991 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 871/1749] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:55:18.845203 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b9a79454-4faa-418d-af84-fe01f2599a83 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:18.845856 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b9a79454-4faa-418d-af84-fe01f2599a83 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] [instance: 01455b1b-b319-4297-bd83-5471b441eb12] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:18.853576 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b9a79454-4faa-418d-af84-fe01f2599a83 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:18.854192 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b9a79454-4faa-418d-af84-fe01f2599a83 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:18.854663 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b9a79454-4faa-418d-af84-fe01f2599a83 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:18.855421 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b9a79454-4faa-418d-af84-fe01f2599a83 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:18.855886 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b9a79454-4faa-418d-af84-fe01f2599a83 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:18.856313 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b9a79454-4faa-418d-af84-fe01f2599a83 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:18.936840 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-84eeb502-27da-46ac-82dc-b28956c23148 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b0ca2d0d0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:18.989464 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-84eeb502-27da-46ac-82dc-b28956c23148 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/4efda41f-1d87-450f-8456-2a80880b8c9a" status: 200 len: 1436 microversion: 2.1 time: 0.057008 Sep 24 20:55:18.990248 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 872/1750] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:55:18 2022] GET /compute/v2.1/images/4efda41f-1d87-450f-8456-2a80880b8c9a => generated 1436 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:55:19.004227 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-206cd1d9-da3c-4d21-b313-114867ad3f45 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b11155d30>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:19.010320 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b9a79454-4faa-418d-af84-fe01f2599a83 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0244a0ef19409a8a6e7c6526685919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccf2c674b1748c6b6e0b33e05e02940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:19.019758 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b9a79454-4faa-418d-af84-fe01f2599a83 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] 10.222.0.52 "GET /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12" status: 200 len: 1471 microversion: 2.1 time: 0.178437 Sep 24 20:55:19.020344 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 879/1751] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:18 2022] GET /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12 => generated 1471 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:19.044607 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7fd4f54b-7293-4881-96fc-c35c3767cf15 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:19.045128 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7fd4f54b-7293-4881-96fc-c35c3767cf15 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] [instance: 01455b1b-b319-4297-bd83-5471b441eb12] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:19.052013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7fd4f54b-7293-4881-96fc-c35c3767cf15 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:19.052510 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7fd4f54b-7293-4881-96fc-c35c3767cf15 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:19.052955 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7fd4f54b-7293-4881-96fc-c35c3767cf15 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:19.053953 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7fd4f54b-7293-4881-96fc-c35c3767cf15 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:19.054519 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7fd4f54b-7293-4881-96fc-c35c3767cf15 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:19.054959 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7fd4f54b-7293-4881-96fc-c35c3767cf15 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:19.062045 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-206cd1d9-da3c-4d21-b313-114867ad3f45 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/images/4efda41f-1d87-450f-8456-2a80880b8c9a" status: 200 len: 1436 microversion: 2.1 time: 0.060901 Sep 24 20:55:19.071099 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 873/1752] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:55:18 2022] GET /compute/v2.1/images/4efda41f-1d87-450f-8456-2a80880b8c9a => generated 1436 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:19.078424 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-591037f6-a159-4638-b7ba-542b665a6e53 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:19.079933 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-591037f6-a159-4638-b7ba-542b665a6e53 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] [instance: 048b3539-80cb-4d73-9280-b62713ddb588] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:19.084414 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7fd4f54b-7293-4881-96fc-c35c3767cf15 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '8a0244a0ef19409a8a6e7c6526685919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccf2c674b1748c6b6e0b33e05e02940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:19.086459 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7fd4f54b-7293-4881-96fc-c35c3767cf15 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Request method failure captured: Sep 24 20:55:19.086459 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12/diagnostics HTTP/1.1 Sep 24 20:55:19.086459 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:55:19.086459 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:55:19.086459 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:55:19.086459 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:55:19.086459 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:55:19.086459 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:55:19.086459 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:55:19.086459 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:55:19.086459 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL26il7nt4byx_Dv_dZW6HksXqqwT_P4LQKn-BXu4jYPBXonSJr7TlG3siHvOXBminVuFihgZdkzj2k3EQuQVLOf3K7Mu2qwN5mLueB_5qPPpuX7sUNEHPKHe4OCEqX8kyUyW1brgGaDM4y5-QPS_3j7vSno-VetzvUg76xSEIzjdhOs Sep 24 20:55:19.086459 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:55:19.086459 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:55:19.086459 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:55:19.086459 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:55:19.086459 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:55:19.086459 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:55:19.086459 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: dccf2c674b1748c6b6e0b33e05e02940 Sep 24 20:55:19.086459 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1272686998 Sep 24 20:55:19.086459 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:55:19.086459 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:55:19.088200 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dccf2c674b1748c6b6e0b33e05e02940"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dccf2c674b1748c6b6e0b33e05e02940"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dccf2c674b1748c6b6e0b33e05e02940"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dccf2c674b1748c6b6e0b33e05e02940"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:55:19.088200 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1272686998 Sep 24 20:55:19.088200 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: dccf2c674b1748c6b6e0b33e05e02940 Sep 24 20:55:19.088200 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1272686998 Sep 24 20:55:19.088200 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServerDiagnosticsNegativeTest-1272686998-project Sep 24 20:55:19.088200 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:55:19.088200 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:55:19.088200 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 8a0244a0ef19409a8a6e7c6526685919 Sep 24 20:55:19.088200 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1272686998-project Sep 24 20:55:19.088200 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:55:19.088200 ncdv-master-1 devstack@n-api.service[140517]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 24 20:55:19.089135 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'server_id': '01455b1b-b319-4297-bd83-5471b441eb12'} Sep 24 20:55:19.089135 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:55:19.089135 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:19.089135 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:19.089135 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:19.089135 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:55:19.089135 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:55:19.089135 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:55:19.089135 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:55:19.089135 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Sep 24 20:55:19.089135 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Sep 24 20:55:19.089135 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 24 20:55:19.089135 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 24 20:55:19.089135 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 24 20:55:19.089135 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 24 20:55:19.089135 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:55:19.089135 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:55:19.089135 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:55:19.089135 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:55:19.089135 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 24 20:55:19.090519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 24 20:55:19.090519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 24 20:55:19.090519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 24 20:55:19.090519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 24 20:55:19.090519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 24 20:55:19.090519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 24 20:55:19.090519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:19.090519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:19.090519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:19.090519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:19.090519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:19.090519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:19.090519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 24 20:55:19.090519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 24 20:55:19.090519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 24 20:55:19.090519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:19.090519 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7fd4f54b-7293-4881-96fc-c35c3767cf15 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:55:19.091781 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7fd4f54b-7293-4881-96fc-c35c3767cf15 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] 10.222.0.52 "GET /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.048154 Sep 24 20:55:19.091781 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 880/1753] 10.222.0.52 () {58 vars in 1272 bytes} [Sat Sep 24 20:55:19 2022] GET /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12/diagnostics => generated 117 bytes in 49 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 24 20:55:19.099643 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1bc2af41-35c0-45b7-8ece-7c84034f9d3a tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:19.100150 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1bc2af41-35c0-45b7-8ece-7c84034f9d3a tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] [instance: 01455b1b-b319-4297-bd83-5471b441eb12] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:19.100283 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-591037f6-a159-4638-b7ba-542b665a6e53 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:19.100874 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-591037f6-a159-4638-b7ba-542b665a6e53 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:19.101329 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-591037f6-a159-4638-b7ba-542b665a6e53 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:19.102057 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-591037f6-a159-4638-b7ba-542b665a6e53 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:19.102743 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-591037f6-a159-4638-b7ba-542b665a6e53 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:19.103393 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-591037f6-a159-4638-b7ba-542b665a6e53 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:19.106208 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1bc2af41-35c0-45b7-8ece-7c84034f9d3a tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:19.106751 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1bc2af41-35c0-45b7-8ece-7c84034f9d3a tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:19.107193 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1bc2af41-35c0-45b7-8ece-7c84034f9d3a tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:19.107897 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1bc2af41-35c0-45b7-8ece-7c84034f9d3a tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:19.108352 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1bc2af41-35c0-45b7-8ece-7c84034f9d3a tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:19.108787 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1bc2af41-35c0-45b7-8ece-7c84034f9d3a tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:19.135341 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1bc2af41-35c0-45b7-8ece-7c84034f9d3a tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] [instance: 01455b1b-b319-4297-bd83-5471b441eb12] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:55:19.222474 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1bc2af41-35c0-45b7-8ece-7c84034f9d3a tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] 10.222.0.52 "DELETE /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12" status: 204 len: 0 microversion: 2.1 time: 0.126789 Sep 24 20:55:19.223417 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 881/1754] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:55:19 2022] DELETE /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 24 20:55:19.232281 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-25536a0f-6896-4bc7-8cec-c98a0dc21ebd tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:19.233515 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-25536a0f-6896-4bc7-8cec-c98a0dc21ebd tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] [instance: 01455b1b-b319-4297-bd83-5471b441eb12] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:19.239077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-25536a0f-6896-4bc7-8cec-c98a0dc21ebd tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:19.239575 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-25536a0f-6896-4bc7-8cec-c98a0dc21ebd tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:19.240015 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-25536a0f-6896-4bc7-8cec-c98a0dc21ebd tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:19.240725 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-25536a0f-6896-4bc7-8cec-c98a0dc21ebd tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:19.241183 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-25536a0f-6896-4bc7-8cec-c98a0dc21ebd tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:19.241697 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-25536a0f-6896-4bc7-8cec-c98a0dc21ebd tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:19.250290 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-591037f6-a159-4638-b7ba-542b665a6e53 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d241b5c9b654fa7bf97f3652186ea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a0417c2ae142c48e41a41a495ea988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:19.259089 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-591037f6-a159-4638-b7ba-542b665a6e53 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588" status: 200 len: 1480 microversion: 2.1 time: 0.185823 Sep 24 20:55:19.259753 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 874/1755] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:19 2022] GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588 => generated 1480 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:19.264715 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-649f796c-47b9-49fc-8c9f-e989fc53384e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:19.265524 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-649f796c-47b9-49fc-8c9f-e989fc53384e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:19.272778 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-649f796c-47b9-49fc-8c9f-e989fc53384e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:19.273501 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-649f796c-47b9-49fc-8c9f-e989fc53384e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:19.274112 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-649f796c-47b9-49fc-8c9f-e989fc53384e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:19.275403 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-649f796c-47b9-49fc-8c9f-e989fc53384e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:19.275870 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-649f796c-47b9-49fc-8c9f-e989fc53384e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:19.276303 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-649f796c-47b9-49fc-8c9f-e989fc53384e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:19.500879 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-649f796c-47b9-49fc-8c9f-e989fc53384e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:19.510902 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-25536a0f-6896-4bc7-8cec-c98a0dc21ebd tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0244a0ef19409a8a6e7c6526685919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccf2c674b1748c6b6e0b33e05e02940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:19.521829 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-649f796c-47b9-49fc-8c9f-e989fc53384e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1472 microversion: 2.1 time: 0.260901 Sep 24 20:55:19.522453 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 875/1756] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:19 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1472 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:19.525486 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-25536a0f-6896-4bc7-8cec-c98a0dc21ebd tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] 10.222.0.52 "GET /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12" status: 200 len: 1477 microversion: 2.1 time: 0.297448 Sep 24 20:55:19.526268 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 882/1757] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:19 2022] GET /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12 => generated 1477 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:19.546060 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-13ab1d9c-434e-495a-a76f-091f0d77f82b tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:19.546720 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-13ab1d9c-434e-495a-a76f-091f0d77f82b tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] [instance: 39c753b7-d223-4e33-9086-d64877d26ecc] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:19.553489 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-13ab1d9c-434e-495a-a76f-091f0d77f82b tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:19.553993 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-13ab1d9c-434e-495a-a76f-091f0d77f82b tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:19.554642 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-13ab1d9c-434e-495a-a76f-091f0d77f82b tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:19.555347 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-13ab1d9c-434e-495a-a76f-091f0d77f82b tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:19.555800 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-13ab1d9c-434e-495a-a76f-091f0d77f82b tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:19.556225 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-13ab1d9c-434e-495a-a76f-091f0d77f82b tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:19.558478 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3940f44f-3d13-4b90-9787-de263d8bf373 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:19.559125 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3940f44f-3d13-4b90-9787-de263d8bf373 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 1de24cda-52fe-42b6-8639-4bb3c77b5eb7] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:19.565395 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3940f44f-3d13-4b90-9787-de263d8bf373 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:19.566185 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3940f44f-3d13-4b90-9787-de263d8bf373 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:19.566853 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3940f44f-3d13-4b90-9787-de263d8bf373 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:19.567731 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3940f44f-3d13-4b90-9787-de263d8bf373 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:19.568355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3940f44f-3d13-4b90-9787-de263d8bf373 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:19.568972 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3940f44f-3d13-4b90-9787-de263d8bf373 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:19.579582 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-13ab1d9c-434e-495a-a76f-091f0d77f82b tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] HTTP exception thrown: Instance 39c753b7-d223-4e33-9086-d64877d26ecc could not be found. Sep 24 20:55:19.583009 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-13ab1d9c-434e-495a-a76f-091f0d77f82b tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Request method failure captured: Sep 24 20:55:19.583009 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc HTTP/1.1 Sep 24 20:55:19.583009 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:55:19.583009 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:55:19.583009 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:55:19.583009 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:55:19.583009 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:55:19.583009 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:55:19.583009 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:55:19.583009 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:55:19.583009 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL25nfnP4bFGTWGzrr_QRsUXd9wMxdWYj0qEbd874ngXuszXlz0Wd_B7C7CSMGsLjDXHJ13W5tcKy0icXJHkWEqSKU2jW0SUqUtKxIm2jlgCAIO_9cD49gF89cpeSznRLjC516EQc6d2cWE_iQUNyVTXEMVU4xgcj8SO3ipMtnW3AXK8 Sep 24 20:55:19.583009 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:55:19.583009 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:55:19.583009 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:55:19.583009 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:55:19.583009 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:55:19.583009 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:55:19.583009 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 4b55ef17d925408093f5407fa8015787 Sep 24 20:55:19.583009 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-521115943 Sep 24 20:55:19.583009 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:55:19.583009 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:55:19.584694 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4b55ef17d925408093f5407fa8015787"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4b55ef17d925408093f5407fa8015787"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4b55ef17d925408093f5407fa8015787"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4b55ef17d925408093f5407fa8015787"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:55:19.584694 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersAdminNegativeTestJSON-521115943 Sep 24 20:55:19.584694 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 4b55ef17d925408093f5407fa8015787 Sep 24 20:55:19.584694 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-521115943 Sep 24 20:55:19.584694 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersAdminNegativeTestJSON-521115943-project Sep 24 20:55:19.584694 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:55:19.584694 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:55:19.584694 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 2844f27200534323910d80cd869a6601 Sep 24 20:55:19.584694 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersAdminNegativeTestJSON-521115943-project Sep 24 20:55:19.584694 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:55:19.584694 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 39c753b7-d223-4e33-9086-d64877d26ecc could not be found. Sep 24 20:55:19.584694 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '39c753b7-d223-4e33-9086-d64877d26ecc'} Sep 24 20:55:19.585634 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:55:19.585634 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:19.585634 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:55:19.585634 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:55:19.585634 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:55:19.585634 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:55:19.585634 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:55:19.585634 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:55:19.585634 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:55:19.585634 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:55:19.585634 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39c753b7-d223-4e33-9086-d64877d26ecc could not be found. Sep 24 20:55:19.585634 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:19.585634 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:19.585634 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:19.585634 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:19.585634 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:19.585634 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:19.585634 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:55:19.585634 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:55:19.585634 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:55:19.588378 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:55:19.588378 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:55:19.588378 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:55:19.588378 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:55:19.588378 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:55:19.588378 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:55:19.588378 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:55:19.588378 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39c753b7-d223-4e33-9086-d64877d26ecc could not be found. Sep 24 20:55:19.588378 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:19.588378 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:19.588378 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:19.588378 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:19.588378 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:19.588378 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:19.588378 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:55:19.588378 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:55:19.588378 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39c753b7-d223-4e33-9086-d64877d26ecc could not be found. Sep 24 20:55:19.588378 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:19.589563 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-13ab1d9c-434e-495a-a76f-091f0d77f82b tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] Returning 404 to user: Instance 39c753b7-d223-4e33-9086-d64877d26ecc could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:55:19.589563 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-13ab1d9c-434e-495a-a76f-091f0d77f82b tempest-ServersAdminNegativeTestJSON-521115943 tempest-ServersAdminNegativeTestJSON-521115943-project] 10.222.0.52 "GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc" status: 404 len: 111 microversion: 2.1 time: 0.048993 Sep 24 20:55:19.589563 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 876/1758] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:19 2022] GET /compute/v2.1/servers/39c753b7-d223-4e33-9086-d64877d26ecc => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:55:19.646739 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3940f44f-3d13-4b90-9787-de263d8bf373 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:19.655031 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3940f44f-3d13-4b90-9787-de263d8bf373 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/1de24cda-52fe-42b6-8639-4bb3c77b5eb7" status: 200 len: 1303 microversion: 2.1 time: 0.101915 Sep 24 20:55:19.655696 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 883/1759] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:19 2022] GET /compute/v2.1/servers/1de24cda-52fe-42b6-8639-4bb3c77b5eb7 => generated 1303 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:55:20.282783 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f9695c25-ae0d-4381-aad6-cb0e69bb0294 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:20.283457 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f9695c25-ae0d-4381-aad6-cb0e69bb0294 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] [instance: 048b3539-80cb-4d73-9280-b62713ddb588] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:20.301114 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9695c25-ae0d-4381-aad6-cb0e69bb0294 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:20.301613 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9695c25-ae0d-4381-aad6-cb0e69bb0294 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:20.302069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9695c25-ae0d-4381-aad6-cb0e69bb0294 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:20.306270 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9695c25-ae0d-4381-aad6-cb0e69bb0294 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:20.306979 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9695c25-ae0d-4381-aad6-cb0e69bb0294 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:20.307423 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9695c25-ae0d-4381-aad6-cb0e69bb0294 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:20.325125 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:55:20.507114 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f9695c25-ae0d-4381-aad6-cb0e69bb0294 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d241b5c9b654fa7bf97f3652186ea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a0417c2ae142c48e41a41a495ea988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:20.521225 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f9695c25-ae0d-4381-aad6-cb0e69bb0294 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588" status: 200 len: 1467 microversion: 2.1 time: 0.242289 Sep 24 20:55:20.522330 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 877/1760] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:20 2022] GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588 => generated 1467 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:20.569777 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-07791f04-412c-42d9-907b-1cbc3e95f6d2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:20.571093 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-07791f04-412c-42d9-907b-1cbc3e95f6d2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:20.572510 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-db6091f4-72a4-47ee-ba21-5ff95fdc35dc tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:20.573581 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-db6091f4-72a4-47ee-ba21-5ff95fdc35dc tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] [instance: 01455b1b-b319-4297-bd83-5471b441eb12] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:20.599388 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-db6091f4-72a4-47ee-ba21-5ff95fdc35dc tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:20.600864 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-07791f04-412c-42d9-907b-1cbc3e95f6d2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:20.601776 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-07791f04-412c-42d9-907b-1cbc3e95f6d2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:20.602234 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-db6091f4-72a4-47ee-ba21-5ff95fdc35dc tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:20.602748 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-db6091f4-72a4-47ee-ba21-5ff95fdc35dc tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:20.603689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-db6091f4-72a4-47ee-ba21-5ff95fdc35dc tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:20.605589 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-db6091f4-72a4-47ee-ba21-5ff95fdc35dc tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:20.607378 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-db6091f4-72a4-47ee-ba21-5ff95fdc35dc tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:20.610986 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-07791f04-412c-42d9-907b-1cbc3e95f6d2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:20.619652 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-07791f04-412c-42d9-907b-1cbc3e95f6d2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:20.620924 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-07791f04-412c-42d9-907b-1cbc3e95f6d2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:20.621962 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-07791f04-412c-42d9-907b-1cbc3e95f6d2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:20.908459 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-db6091f4-72a4-47ee-ba21-5ff95fdc35dc tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0244a0ef19409a8a6e7c6526685919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccf2c674b1748c6b6e0b33e05e02940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:20.921206 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-db6091f4-72a4-47ee-ba21-5ff95fdc35dc tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] 10.222.0.52 "GET /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12" status: 200 len: 1477 microversion: 2.1 time: 0.367414 Sep 24 20:55:20.921800 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 878/1761] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:20 2022] GET /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12 => generated 1477 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:20.933236 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-47c30049-8b34-4419-99ea-e7d1db3a9cff tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b0c9e3670>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:20.935092 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-07791f04-412c-42d9-907b-1cbc3e95f6d2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:20.947492 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-07791f04-412c-42d9-907b-1cbc3e95f6d2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1469 microversion: 2.1 time: 0.403078 Sep 24 20:55:20.948426 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 884/1762] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:20 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1469 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:20.953512 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-19b9a142-40ee-40f9-a89f-404dcef8d305 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:20.954316 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-19b9a142-40ee-40f9-a89f-404dcef8d305 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 1de24cda-52fe-42b6-8639-4bb3c77b5eb7] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:20.960824 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-19b9a142-40ee-40f9-a89f-404dcef8d305 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:20.961583 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-19b9a142-40ee-40f9-a89f-404dcef8d305 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:20.962172 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-19b9a142-40ee-40f9-a89f-404dcef8d305 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:20.963091 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-19b9a142-40ee-40f9-a89f-404dcef8d305 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:20.963769 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-19b9a142-40ee-40f9-a89f-404dcef8d305 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:20.964373 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-19b9a142-40ee-40f9-a89f-404dcef8d305 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:21.012548 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-19b9a142-40ee-40f9-a89f-404dcef8d305 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:21.013282 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-19b9a142-40ee-40f9-a89f-404dcef8d305 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:21.013911 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-19b9a142-40ee-40f9-a89f-404dcef8d305 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:21.014619 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-19b9a142-40ee-40f9-a89f-404dcef8d305 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lazy-loading 'fault' on Instance uuid 1de24cda-52fe-42b6-8639-4bb3c77b5eb7 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:55:21.107801 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-19b9a142-40ee-40f9-a89f-404dcef8d305 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:21.123072 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-19b9a142-40ee-40f9-a89f-404dcef8d305 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/1de24cda-52fe-42b6-8639-4bb3c77b5eb7" status: 200 len: 1308 microversion: 2.1 time: 0.171570 Sep 24 20:55:21.125083 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 885/1763] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:20 2022] GET /compute/v2.1/servers/1de24cda-52fe-42b6-8639-4bb3c77b5eb7 => generated 1308 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:21.137675 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c9881332-9020-4cd7-a6a2-86b77cd46dc6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:55:21.138592 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c9881332-9020-4cd7-a6a2-86b77cd46dc6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:21.153490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c9881332-9020-4cd7-a6a2-86b77cd46dc6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:21.159693 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c9881332-9020-4cd7-a6a2-86b77cd46dc6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:21.161469 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c9881332-9020-4cd7-a6a2-86b77cd46dc6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:21.162644 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c9881332-9020-4cd7-a6a2-86b77cd46dc6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:21.163976 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c9881332-9020-4cd7-a6a2-86b77cd46dc6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:21.164537 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c9881332-9020-4cd7-a6a2-86b77cd46dc6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:21.425313 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c9881332-9020-4cd7-a6a2-86b77cd46dc6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "POST /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c/action" status: 202 len: 0 microversion: 2.1 time: 0.295897 Sep 24 20:55:21.426408 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 886/1764] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:55:21 2022] POST /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:55:21.450684 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b7115eea-76aa-4a73-8f98-dbe425c70f27 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:21.451805 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b7115eea-76aa-4a73-8f98-dbe425c70f27 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:21.465710 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b7115eea-76aa-4a73-8f98-dbe425c70f27 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:21.466702 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b7115eea-76aa-4a73-8f98-dbe425c70f27 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:21.470805 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b7115eea-76aa-4a73-8f98-dbe425c70f27 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:21.473420 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b7115eea-76aa-4a73-8f98-dbe425c70f27 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:21.475543 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b7115eea-76aa-4a73-8f98-dbe425c70f27 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:21.476227 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b7115eea-76aa-4a73-8f98-dbe425c70f27 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:21.800771 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b7115eea-76aa-4a73-8f98-dbe425c70f27 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:21.822150 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:55:21.828290 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b7115eea-76aa-4a73-8f98-dbe425c70f27 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1468 microversion: 2.1 time: 0.388576 Sep 24 20:55:21.829289 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 887/1765] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:21 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1468 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:21.952525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-784395d6-c0c2-4ba7-99ba-07dcf5cf662e tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:21.953700 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-784395d6-c0c2-4ba7-99ba-07dcf5cf662e tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] [instance: 01455b1b-b319-4297-bd83-5471b441eb12] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:21.965151 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-784395d6-c0c2-4ba7-99ba-07dcf5cf662e tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:21.968232 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-784395d6-c0c2-4ba7-99ba-07dcf5cf662e tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:21.970941 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-784395d6-c0c2-4ba7-99ba-07dcf5cf662e tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:21.972646 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-784395d6-c0c2-4ba7-99ba-07dcf5cf662e tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:21.973137 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-784395d6-c0c2-4ba7-99ba-07dcf5cf662e tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:21.973579 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-784395d6-c0c2-4ba7-99ba-07dcf5cf662e tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:22.041036 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-47c30049-8b34-4419-99ea-e7d1db3a9cff tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "DELETE /compute/v2.1/images/4efda41f-1d87-450f-8456-2a80880b8c9a" status: 204 len: 0 microversion: 2.1 time: 1.112222 Sep 24 20:55:22.044622 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 879/1766] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:20 2022] DELETE /compute/v2.1/images/4efda41f-1d87-450f-8456-2a80880b8c9a => generated 0 bytes in 1122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:55:22.063036 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5b5b9a8d-4a40-4322-a47a-702c7f80561b tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '.version_select at 0x7f4b111be5e0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:22.097055 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-5b5b9a8d-4a40-4322-a47a-702c7f80561b tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] HTTP exception thrown: Image not found. Sep 24 20:55:22.100145 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5b5b9a8d-4a40-4322-a47a-702c7f80561b tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Request method failure captured: Sep 24 20:55:22.100145 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913 HTTP/1.1 Sep 24 20:55:22.100145 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:55:22.100145 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:55:22.100145 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:55:22.100145 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:55:22.100145 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:55:22.100145 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:55:22.100145 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:55:22.100145 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:55:22.100145 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL25WtLhSiM52-bmwuugMhvCCGYBv161RiI4FkcqGmF75ZrfzBqlJGiCMzEV3ZQpftw0ly-bWgUlZ16VlaTkDn6TpyD_MjzqCtuer4cakD5bdfJRE3ArSCeRjMJNIY4U95NQpvtZ9NRFDKo4AUARrREwm88q9QCIMYiHrr6QlNgoTYkg Sep 24 20:55:22.100145 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:55:22.100145 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:55:22.100145 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:55:22.100145 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:55:22.100145 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:55:22.100145 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:55:22.100145 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 66a0417c2ae142c48e41a41a495ea988 Sep 24 20:55:22.100145 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ImagesOneServerTestJSON-188397882 Sep 24 20:55:22.100145 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:55:22.100145 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:55:22.101522 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/66a0417c2ae142c48e41a41a495ea988"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_66a0417c2ae142c48e41a41a495ea988"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/66a0417c2ae142c48e41a41a495ea988"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/66a0417c2ae142c48e41a41a495ea988"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:55:22.101522 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ImagesOneServerTestJSON-188397882 Sep 24 20:55:22.101522 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 66a0417c2ae142c48e41a41a495ea988 Sep 24 20:55:22.101522 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-188397882 Sep 24 20:55:22.101522 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ImagesOneServerTestJSON-188397882-project Sep 24 20:55:22.101522 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:55:22.101522 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:55:22.101522 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 2d241b5c9b654fa7bf97f3652186ea6f Sep 24 20:55:22.101522 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ImagesOneServerTestJSON-188397882-project Sep 24 20:55:22.101522 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:55:22.101522 ncdv-master-1 devstack@n-api.service[140516]: exception: Image not found. Sep 24 20:55:22.101522 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '6da95260-14d8-49e7-924c-2a06865d3913'} Sep 24 20:55:22.101522 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:55:22.102364 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:22.102364 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 24 20:55:22.102364 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 24 20:55:22.102364 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 24 20:55:22.102364 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 24 20:55:22.102364 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 24 20:55:22.102364 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 24 20:55:22.102364 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 24 20:55:22.102364 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 24 20:55:22.102364 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 24 20:55:22.102364 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 24 20:55:22.102364 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 24 20:55:22.102364 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 24 20:55:22.102364 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 24 20:55:22.102364 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 24 20:55:22.102364 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6da95260-14d8-49e7-924c-2a06865d3913 to delete Sep 24 20:55:22.102364 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:22.102364 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:22.102364 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:22.103634 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:22.103634 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 24 20:55:22.103634 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 24 20:55:22.103634 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 24 20:55:22.103634 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 24 20:55:22.103634 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 24 20:55:22.103634 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 24 20:55:22.103634 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6da95260-14d8-49e7-924c-2a06865d3913 could not be found. Sep 24 20:55:22.103634 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:22.103634 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:22.103634 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:22.103634 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:22.103634 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:22.103634 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:22.103634 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:55:22.103634 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:55:22.103634 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:55:22.103634 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:55:22.103634 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:55:22.103634 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:55:22.104846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 24 20:55:22.104846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 24 20:55:22.104846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 24 20:55:22.104846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:22.104846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:22.104846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:22.104846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:22.104846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:22.104846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:22.104846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:55:22.104846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:55:22.104846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 24 20:55:22.104846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:22.116405 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5b5b9a8d-4a40-4322-a47a-702c7f80561b tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Returning 404 to user: Image not found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:55:22.117500 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5b5b9a8d-4a40-4322-a47a-702c7f80561b tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "DELETE /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913" status: 404 len: 62 microversion: 2.1 time: 0.068996 Sep 24 20:55:22.125643 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 880/1767] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:22 2022] DELETE /compute/v2.1/images/6da95260-14d8-49e7-924c-2a06865d3913 => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 20:55:22.140299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5c180377-a0b3-41cd-8c51-3efd10ad4c9d tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:22.146074 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5c180377-a0b3-41cd-8c51-3efd10ad4c9d tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] [instance: 048b3539-80cb-4d73-9280-b62713ddb588] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:22.168631 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c180377-a0b3-41cd-8c51-3efd10ad4c9d tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:22.172004 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c180377-a0b3-41cd-8c51-3efd10ad4c9d tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:22.173555 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c180377-a0b3-41cd-8c51-3efd10ad4c9d tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:22.177272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c180377-a0b3-41cd-8c51-3efd10ad4c9d tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:22.179279 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c180377-a0b3-41cd-8c51-3efd10ad4c9d tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:22.180460 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c180377-a0b3-41cd-8c51-3efd10ad4c9d tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:22.181979 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-784395d6-c0c2-4ba7-99ba-07dcf5cf662e tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0244a0ef19409a8a6e7c6526685919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccf2c674b1748c6b6e0b33e05e02940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:22.197177 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-784395d6-c0c2-4ba7-99ba-07dcf5cf662e tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] 10.222.0.52 "GET /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12" status: 200 len: 1435 microversion: 2.1 time: 0.248877 Sep 24 20:55:22.197827 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 888/1768] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:21 2022] GET /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12 => generated 1435 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:55:22.217325 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-53ff90a4-dafb-47a3-811a-2fb2ea23737d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:22.217325 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-53ff90a4-dafb-47a3-811a-2fb2ea23737d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: 1de24cda-52fe-42b6-8639-4bb3c77b5eb7] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:22.242542 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53ff90a4-dafb-47a3-811a-2fb2ea23737d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:22.243159 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53ff90a4-dafb-47a3-811a-2fb2ea23737d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:22.243623 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53ff90a4-dafb-47a3-811a-2fb2ea23737d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:22.244691 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53ff90a4-dafb-47a3-811a-2fb2ea23737d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:22.245315 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53ff90a4-dafb-47a3-811a-2fb2ea23737d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:22.245767 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53ff90a4-dafb-47a3-811a-2fb2ea23737d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:22.264772 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-53ff90a4-dafb-47a3-811a-2fb2ea23737d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] HTTP exception thrown: Instance 1de24cda-52fe-42b6-8639-4bb3c77b5eb7 could not be found. Sep 24 20:55:22.267458 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-53ff90a4-dafb-47a3-811a-2fb2ea23737d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Request method failure captured: Sep 24 20:55:22.267458 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/1de24cda-52fe-42b6-8639-4bb3c77b5eb7 HTTP/1.1 Sep 24 20:55:22.267458 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:55:22.267458 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:55:22.267458 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:55:22.267458 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:55:22.267458 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:55:22.267458 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:55:22.267458 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:55:22.267458 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:55:22.267458 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL23ty18wZ369rBpsqLlzALGIa2Gim7BSAzth626XfTPt1jl2TGGDfuIK0NF1uBFJTGNmpODfOJmslXLXls2-SCCSRhWzdKVR2lBkl_nLf9Mq1Le-1pWzwdVHhu2NC69cXC874Lb-O01_urLv2faksB3B4Xzjyj58JzXn5kGazzFVV5g Sep 24 20:55:22.267458 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:55:22.267458 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:55:22.267458 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:55:22.267458 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:55:22.267458 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:55:22.267458 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:55:22.267458 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 73bec7c48b07450f95a29a35e113153d Sep 24 20:55:22.267458 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersOnMultiNodesTest-512776478 Sep 24 20:55:22.267458 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:55:22.267458 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:55:22.269626 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/73bec7c48b07450f95a29a35e113153d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_73bec7c48b07450f95a29a35e113153d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/73bec7c48b07450f95a29a35e113153d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/73bec7c48b07450f95a29a35e113153d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:55:22.269626 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersOnMultiNodesTest-512776478 Sep 24 20:55:22.269626 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 73bec7c48b07450f95a29a35e113153d Sep 24 20:55:22.269626 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-512776478 Sep 24 20:55:22.269626 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersOnMultiNodesTest-512776478-project Sep 24 20:55:22.269626 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:55:22.269626 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:55:22.269626 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 936372eff4da45e281fc5512632a12b6 Sep 24 20:55:22.269626 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersOnMultiNodesTest-512776478-project Sep 24 20:55:22.269626 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:55:22.269626 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 1de24cda-52fe-42b6-8639-4bb3c77b5eb7 could not be found. Sep 24 20:55:22.269626 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '1de24cda-52fe-42b6-8639-4bb3c77b5eb7'} Sep 24 20:55:22.270475 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:55:22.270475 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:22.270475 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:55:22.270475 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:55:22.270475 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:55:22.270475 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:55:22.270475 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:55:22.270475 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:55:22.270475 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:55:22.270475 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:55:22.270475 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1de24cda-52fe-42b6-8639-4bb3c77b5eb7 could not be found. Sep 24 20:55:22.270475 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:22.270475 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:22.270475 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:22.270475 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:22.270475 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:22.270475 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:22.270475 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:55:22.270475 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:55:22.270475 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:55:22.272193 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:55:22.272193 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:55:22.272193 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:55:22.272193 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:55:22.272193 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:55:22.272193 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:55:22.272193 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:55:22.272193 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1de24cda-52fe-42b6-8639-4bb3c77b5eb7 could not be found. Sep 24 20:55:22.272193 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:22.272193 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:22.272193 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:22.272193 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:22.272193 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:22.272193 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:22.272193 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:55:22.272193 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:55:22.272193 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1de24cda-52fe-42b6-8639-4bb3c77b5eb7 could not be found. Sep 24 20:55:22.272193 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:22.273761 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-53ff90a4-dafb-47a3-811a-2fb2ea23737d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Returning 404 to user: Instance 1de24cda-52fe-42b6-8639-4bb3c77b5eb7 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:55:22.273761 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-53ff90a4-dafb-47a3-811a-2fb2ea23737d tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/1de24cda-52fe-42b6-8639-4bb3c77b5eb7" status: 404 len: 111 microversion: 2.1 time: 0.070789 Sep 24 20:55:22.273970 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5c180377-a0b3-41cd-8c51-3efd10ad4c9d tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] [instance: 048b3539-80cb-4d73-9280-b62713ddb588] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:55:22.274077 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 889/1769] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:22 2022] GET /compute/v2.1/servers/1de24cda-52fe-42b6-8639-4bb3c77b5eb7 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:55:22.387947 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:55:22.410102 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5c180377-a0b3-41cd-8c51-3efd10ad4c9d tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "DELETE /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588" status: 204 len: 0 microversion: 2.1 time: 0.282658 Sep 24 20:55:22.411456 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 881/1770] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:55:22 2022] DELETE /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:55:22.419045 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-856b1dfb-e14c-4d2e-86da-9473a6a4aade tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:22.420260 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-856b1dfb-e14c-4d2e-86da-9473a6a4aade tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: fc6a752b-8418-4657-8e37-3d9259b45d4e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:22.429157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-856b1dfb-e14c-4d2e-86da-9473a6a4aade tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:22.430380 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-856b1dfb-e14c-4d2e-86da-9473a6a4aade tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:22.431386 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-856b1dfb-e14c-4d2e-86da-9473a6a4aade tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:22.432915 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-856b1dfb-e14c-4d2e-86da-9473a6a4aade tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:22.433686 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-856b1dfb-e14c-4d2e-86da-9473a6a4aade tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:22.434421 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-856b1dfb-e14c-4d2e-86da-9473a6a4aade tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:22.454200 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-856b1dfb-e14c-4d2e-86da-9473a6a4aade tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] HTTP exception thrown: Instance fc6a752b-8418-4657-8e37-3d9259b45d4e could not be found. Sep 24 20:55:22.456838 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-856b1dfb-e14c-4d2e-86da-9473a6a4aade tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Request method failure captured: Sep 24 20:55:22.456838 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/fc6a752b-8418-4657-8e37-3d9259b45d4e HTTP/1.1 Sep 24 20:55:22.456838 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:55:22.456838 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:55:22.456838 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:55:22.456838 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:55:22.456838 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:55:22.456838 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:55:22.456838 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:55:22.456838 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:55:22.456838 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL23ty18wZ369rBpsqLlzALGIa2Gim7BSAzth626XfTPt1jl2TGGDfuIK0NF1uBFJTGNmpODfOJmslXLXls2-SCCSRhWzdKVR2lBkl_nLf9Mq1Le-1pWzwdVHhu2NC69cXC874Lb-O01_urLv2faksB3B4Xzjyj58JzXn5kGazzFVV5g Sep 24 20:55:22.456838 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:55:22.456838 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:55:22.456838 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:55:22.456838 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:55:22.456838 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:55:22.456838 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:55:22.456838 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 73bec7c48b07450f95a29a35e113153d Sep 24 20:55:22.456838 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersOnMultiNodesTest-512776478 Sep 24 20:55:22.456838 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:55:22.456838 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:55:22.458213 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/73bec7c48b07450f95a29a35e113153d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_73bec7c48b07450f95a29a35e113153d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/73bec7c48b07450f95a29a35e113153d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/73bec7c48b07450f95a29a35e113153d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:55:22.458213 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersOnMultiNodesTest-512776478 Sep 24 20:55:22.458213 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 73bec7c48b07450f95a29a35e113153d Sep 24 20:55:22.458213 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-512776478 Sep 24 20:55:22.458213 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersOnMultiNodesTest-512776478-project Sep 24 20:55:22.458213 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:55:22.458213 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:55:22.458213 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 936372eff4da45e281fc5512632a12b6 Sep 24 20:55:22.458213 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersOnMultiNodesTest-512776478-project Sep 24 20:55:22.458213 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:55:22.458213 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance fc6a752b-8418-4657-8e37-3d9259b45d4e could not be found. Sep 24 20:55:22.458213 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'fc6a752b-8418-4657-8e37-3d9259b45d4e'} Sep 24 20:55:22.459012 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:55:22.459012 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:22.459012 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:55:22.459012 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:55:22.459012 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:55:22.459012 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:55:22.459012 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:55:22.459012 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:55:22.459012 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:55:22.459012 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:55:22.459012 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc6a752b-8418-4657-8e37-3d9259b45d4e could not be found. Sep 24 20:55:22.459012 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:22.459012 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:22.459012 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:22.459012 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:22.459012 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:22.459012 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:22.459012 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:55:22.459012 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:55:22.459012 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:55:22.460269 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:55:22.460269 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:55:22.460269 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:55:22.460269 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:55:22.460269 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:55:22.460269 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:55:22.460269 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:55:22.460269 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc6a752b-8418-4657-8e37-3d9259b45d4e could not be found. Sep 24 20:55:22.460269 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:22.460269 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:22.460269 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:22.460269 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:22.460269 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:22.460269 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:22.460269 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:55:22.460269 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:55:22.460269 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc6a752b-8418-4657-8e37-3d9259b45d4e could not be found. Sep 24 20:55:22.460269 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:22.463363 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-856b1dfb-e14c-4d2e-86da-9473a6a4aade tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Returning 404 to user: Instance fc6a752b-8418-4657-8e37-3d9259b45d4e could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:55:22.464602 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-856b1dfb-e14c-4d2e-86da-9473a6a4aade tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/fc6a752b-8418-4657-8e37-3d9259b45d4e" status: 404 len: 111 microversion: 2.1 time: 0.051741 Sep 24 20:55:22.467023 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 882/1771] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:22 2022] GET /compute/v2.1/servers/fc6a752b-8418-4657-8e37-3d9259b45d4e => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:55:22.486395 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7a1de2ea-db6f-4772-a907-15502c6e0e72 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:22.489352 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7a1de2ea-db6f-4772-a907-15502c6e0e72 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] [instance: 048b3539-80cb-4d73-9280-b62713ddb588] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:22.498391 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a1de2ea-db6f-4772-a907-15502c6e0e72 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:22.499766 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a1de2ea-db6f-4772-a907-15502c6e0e72 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:22.500484 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a1de2ea-db6f-4772-a907-15502c6e0e72 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:22.501614 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a1de2ea-db6f-4772-a907-15502c6e0e72 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:22.502308 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a1de2ea-db6f-4772-a907-15502c6e0e72 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:22.504548 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a1de2ea-db6f-4772-a907-15502c6e0e72 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:22.715378 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-70f5009b-5207-4742-9016-61db2a2dc562 req-764868f5-1439-47ef-9db1-f8c6a100307d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01455b1b-b319-4297-bd83-5471b441eb12", "name": "network-vif-deleted", "tag": "e1dd21a3-c3ac-4806-9e3e-2da6c3fd40b6"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:55:22.752534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-70f5009b-5207-4742-9016-61db2a2dc562 req-764868f5-1439-47ef-9db1-f8c6a100307d service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:22.754358 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-70f5009b-5207-4742-9016-61db2a2dc562 req-764868f5-1439-47ef-9db1-f8c6a100307d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:22.761242 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7a1de2ea-db6f-4772-a907-15502c6e0e72 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d241b5c9b654fa7bf97f3652186ea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a0417c2ae142c48e41a41a495ea988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:22.778653 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7a1de2ea-db6f-4772-a907-15502c6e0e72 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588" status: 200 len: 1473 microversion: 2.1 time: 0.310022 Sep 24 20:55:22.781273 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-70f5009b-5207-4742-9016-61db2a2dc562 req-764868f5-1439-47ef-9db1-f8c6a100307d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:22.793622 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 883/1772] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:22 2022] GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588 => generated 1473 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:22.798670 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d1c60df8-577e-4625-b079-03218494abe8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:22.808225 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-70f5009b-5207-4742-9016-61db2a2dc562 req-764868f5-1439-47ef-9db1-f8c6a100307d service nova] Creating event network-vif-deleted:e1dd21a3-c3ac-4806-9e3e-2da6c3fd40b6 for instance 01455b1b-b319-4297-bd83-5471b441eb12 on nch2-master-1 Sep 24 20:55:22.824563 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-70f5009b-5207-4742-9016-61db2a2dc562 req-764868f5-1439-47ef-9db1-f8c6a100307d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.552780 Sep 24 20:55:22.825154 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 890/1773] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:55:22.857425 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9eafdbdb-1693-47d0-81d2-7a1485aa9a09 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:22.858832 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9eafdbdb-1693-47d0-81d2-7a1485aa9a09 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:22.864074 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d1c60df8-577e-4625-b079-03218494abe8 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/6c51a00c-efd7-44fd-a092-affeb2c54462" status: 204 len: 0 microversion: 2.1 time: 0.069311 Sep 24 20:55:22.867186 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 884/1774] 10.222.0.52 () {58 vars in 1266 bytes} [Sat Sep 24 20:55:22 2022] DELETE /compute/v2.1/os-server-groups/6c51a00c-efd7-44fd-a092-affeb2c54462 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:55:22.867735 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9eafdbdb-1693-47d0-81d2-7a1485aa9a09 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:22.868957 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9eafdbdb-1693-47d0-81d2-7a1485aa9a09 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:22.869647 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9eafdbdb-1693-47d0-81d2-7a1485aa9a09 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:22.870712 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9eafdbdb-1693-47d0-81d2-7a1485aa9a09 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:22.871714 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9eafdbdb-1693-47d0-81d2-7a1485aa9a09 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:22.872375 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9eafdbdb-1693-47d0-81d2-7a1485aa9a09 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:22.886217 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-caa15bd3-9de6-4f11-b6ba-cb029fb69902 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:22.886822 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-caa15bd3-9de6-4f11-b6ba-cb029fb69902 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a74d1c4c-d757-4879-a35d-9f817ea6e28b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:22.903557 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-caa15bd3-9de6-4f11-b6ba-cb029fb69902 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:22.904060 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-caa15bd3-9de6-4f11-b6ba-cb029fb69902 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:22.904530 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-caa15bd3-9de6-4f11-b6ba-cb029fb69902 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:22.905341 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-caa15bd3-9de6-4f11-b6ba-cb029fb69902 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:22.905811 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-caa15bd3-9de6-4f11-b6ba-cb029fb69902 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:22.907213 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-caa15bd3-9de6-4f11-b6ba-cb029fb69902 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:22.942132 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-caa15bd3-9de6-4f11-b6ba-cb029fb69902 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a74d1c4c-d757-4879-a35d-9f817ea6e28b] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:55:23.052029 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-caa15bd3-9de6-4f11-b6ba-cb029fb69902 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a74d1c4c-d757-4879-a35d-9f817ea6e28b" status: 204 len: 0 microversion: 2.1 time: 0.180870 Sep 24 20:55:23.052756 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 885/1775] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:55:22 2022] DELETE /compute/v2.1/servers/a74d1c4c-d757-4879-a35d-9f817ea6e28b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:55:23.068431 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a7aff62a-5765-487e-851a-2059eee2a75e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:23.069164 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a7aff62a-5765-487e-851a-2059eee2a75e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a74d1c4c-d757-4879-a35d-9f817ea6e28b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:23.070031 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9eafdbdb-1693-47d0-81d2-7a1485aa9a09 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:23.076270 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a7aff62a-5765-487e-851a-2059eee2a75e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:23.077224 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a7aff62a-5765-487e-851a-2059eee2a75e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:23.077811 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a7aff62a-5765-487e-851a-2059eee2a75e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:23.078576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a7aff62a-5765-487e-851a-2059eee2a75e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:23.079049 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a7aff62a-5765-487e-851a-2059eee2a75e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:23.079481 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a7aff62a-5765-487e-851a-2059eee2a75e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:23.080205 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9eafdbdb-1693-47d0-81d2-7a1485aa9a09 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1468 microversion: 2.1 time: 0.228711 Sep 24 20:55:23.092626 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 891/1776] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:22 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1468 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:55:23.231323 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ff7c5ea5-1240-492c-8c54-62b6bdd07309 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:23.233013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ff7c5ea5-1240-492c-8c54-62b6bdd07309 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] [instance: 01455b1b-b319-4297-bd83-5471b441eb12] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:23.242724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff7c5ea5-1240-492c-8c54-62b6bdd07309 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:23.245006 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff7c5ea5-1240-492c-8c54-62b6bdd07309 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:23.246811 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff7c5ea5-1240-492c-8c54-62b6bdd07309 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:23.250827 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff7c5ea5-1240-492c-8c54-62b6bdd07309 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:23.251340 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff7c5ea5-1240-492c-8c54-62b6bdd07309 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:23.251784 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff7c5ea5-1240-492c-8c54-62b6bdd07309 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:23.259234 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a7aff62a-5765-487e-851a-2059eee2a75e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:23.269677 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a7aff62a-5765-487e-851a-2059eee2a75e tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a74d1c4c-d757-4879-a35d-9f817ea6e28b" status: 200 len: 1473 microversion: 2.1 time: 0.212457 Sep 24 20:55:23.271191 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 886/1777] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:23 2022] GET /compute/v2.1/servers/a74d1c4c-d757-4879-a35d-9f817ea6e28b => generated 1473 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:23.514932 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-ff7c5ea5-1240-492c-8c54-62b6bdd07309 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] HTTP exception thrown: Instance 01455b1b-b319-4297-bd83-5471b441eb12 could not be found. Sep 24 20:55:23.516942 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ff7c5ea5-1240-492c-8c54-62b6bdd07309 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Request method failure captured: Sep 24 20:55:23.516942 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12 HTTP/1.1 Sep 24 20:55:23.516942 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:55:23.516942 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:55:23.516942 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:55:23.516942 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:55:23.516942 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:55:23.516942 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:55:23.516942 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:55:23.516942 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:55:23.516942 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL26il7nt4byx_Dv_dZW6HksXqqwT_P4LQKn-BXu4jYPBXonSJr7TlG3siHvOXBminVuFihgZdkzj2k3EQuQVLOf3K7Mu2qwN5mLueB_5qPPpuX7sUNEHPKHe4OCEqX8kyUyW1brgGaDM4y5-QPS_3j7vSno-VetzvUg76xSEIzjdhOs Sep 24 20:55:23.516942 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:55:23.516942 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:55:23.516942 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:55:23.516942 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:55:23.516942 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:55:23.516942 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:55:23.516942 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: dccf2c674b1748c6b6e0b33e05e02940 Sep 24 20:55:23.516942 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1272686998 Sep 24 20:55:23.516942 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:55:23.516942 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:55:23.518628 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dccf2c674b1748c6b6e0b33e05e02940"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dccf2c674b1748c6b6e0b33e05e02940"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dccf2c674b1748c6b6e0b33e05e02940"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dccf2c674b1748c6b6e0b33e05e02940"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:55:23.518628 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1272686998 Sep 24 20:55:23.518628 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: dccf2c674b1748c6b6e0b33e05e02940 Sep 24 20:55:23.518628 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1272686998 Sep 24 20:55:23.518628 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServerDiagnosticsNegativeTest-1272686998-project Sep 24 20:55:23.518628 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:55:23.518628 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:55:23.518628 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 8a0244a0ef19409a8a6e7c6526685919 Sep 24 20:55:23.518628 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1272686998-project Sep 24 20:55:23.518628 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:55:23.518628 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 01455b1b-b319-4297-bd83-5471b441eb12 could not be found. Sep 24 20:55:23.518628 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '01455b1b-b319-4297-bd83-5471b441eb12'} Sep 24 20:55:23.519577 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:55:23.519577 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:23.519577 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:55:23.519577 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:55:23.519577 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:55:23.519577 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:55:23.519577 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:55:23.519577 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:55:23.519577 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:55:23.519577 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:55:23.519577 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01455b1b-b319-4297-bd83-5471b441eb12 could not be found. Sep 24 20:55:23.519577 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:23.519577 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:23.519577 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:23.519577 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:23.519577 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:23.519577 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:23.519577 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:55:23.519577 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:55:23.519577 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:55:23.521117 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:55:23.521117 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:55:23.521117 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:55:23.521117 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:55:23.521117 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:55:23.521117 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:55:23.521117 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:55:23.521117 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01455b1b-b319-4297-bd83-5471b441eb12 could not be found. Sep 24 20:55:23.521117 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:23.521117 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:23.521117 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:23.521117 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:23.521117 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:23.521117 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:23.521117 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:55:23.521117 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:55:23.521117 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01455b1b-b319-4297-bd83-5471b441eb12 could not be found. Sep 24 20:55:23.521117 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:23.523102 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ff7c5ea5-1240-492c-8c54-62b6bdd07309 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] Returning 404 to user: Instance 01455b1b-b319-4297-bd83-5471b441eb12 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:55:23.523102 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ff7c5ea5-1240-492c-8c54-62b6bdd07309 tempest-ServerDiagnosticsNegativeTest-1272686998 tempest-ServerDiagnosticsNegativeTest-1272686998-project] 10.222.0.52 "GET /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12" status: 404 len: 111 microversion: 2.1 time: 0.292954 Sep 24 20:55:23.523102 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 892/1778] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:23 2022] GET /compute/v2.1/servers/01455b1b-b319-4297-bd83-5471b441eb12 => generated 111 bytes in 294 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:55:23.817494 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-52f5c26c-bb81-475c-a95b-2d0f2eb7b24e tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:23.818830 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-52f5c26c-bb81-475c-a95b-2d0f2eb7b24e tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] [instance: 048b3539-80cb-4d73-9280-b62713ddb588] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:23.837228 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52f5c26c-bb81-475c-a95b-2d0f2eb7b24e tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:23.837977 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52f5c26c-bb81-475c-a95b-2d0f2eb7b24e tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:23.838599 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52f5c26c-bb81-475c-a95b-2d0f2eb7b24e tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:23.839510 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52f5c26c-bb81-475c-a95b-2d0f2eb7b24e tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:23.839970 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52f5c26c-bb81-475c-a95b-2d0f2eb7b24e tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:23.840401 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52f5c26c-bb81-475c-a95b-2d0f2eb7b24e tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:24.119960 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f569e512-583b-4197-b484-94f7de011a84 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:24.126559 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f569e512-583b-4197-b484-94f7de011a84 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:24.127076 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f569e512-583b-4197-b484-94f7de011a84 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:24.127524 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f569e512-583b-4197-b484-94f7de011a84 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:24.128419 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-52f5c26c-bb81-475c-a95b-2d0f2eb7b24e tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d241b5c9b654fa7bf97f3652186ea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a0417c2ae142c48e41a41a495ea988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:24.129469 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f569e512-583b-4197-b484-94f7de011a84 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:24.129954 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f569e512-583b-4197-b484-94f7de011a84 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:24.130584 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f569e512-583b-4197-b484-94f7de011a84 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:24.137227 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-52f5c26c-bb81-475c-a95b-2d0f2eb7b24e tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588" status: 200 len: 1473 microversion: 2.1 time: 0.323847 Sep 24 20:55:24.143129 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 893/1779] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:23 2022] GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588 => generated 1473 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:55:24.154033 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-44b382cb-e6ea-4675-86db-3572d3cba875 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:24.154894 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-44b382cb-e6ea-4675-86db-3572d3cba875 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:24.173903 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-44b382cb-e6ea-4675-86db-3572d3cba875 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:24.175378 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-44b382cb-e6ea-4675-86db-3572d3cba875 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:24.176024 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-44b382cb-e6ea-4675-86db-3572d3cba875 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:24.176950 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-44b382cb-e6ea-4675-86db-3572d3cba875 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:24.177577 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-44b382cb-e6ea-4675-86db-3572d3cba875 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:24.178180 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-44b382cb-e6ea-4675-86db-3572d3cba875 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:24.184523 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f569e512-583b-4197-b484-94f7de011a84 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.413837 Sep 24 20:55:24.185672 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 887/1780] 10.222.0.52 () {58 vars in 1137 bytes} [Sat Sep 24 20:55:23 2022] GET /compute/v2.1/os-services => generated 947 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:55:24.292848 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-2d3fa6ae-497e-4975-917f-e00615974562 req-b0c4bda8-532d-447b-838d-ca9cf326cd64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9425eeec-a7b4-4926-a2f3-80dd47eb9e0c", "name": "network-vif-plugged", "status": "completed", "tag": "7138905c-dbe0-4d9c-83c3-21fb5d346268"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:55:24.320129 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-2d3fa6ae-497e-4975-917f-e00615974562 req-b0c4bda8-532d-447b-838d-ca9cf326cd64 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:24.321466 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-2d3fa6ae-497e-4975-917f-e00615974562 req-b0c4bda8-532d-447b-838d-ca9cf326cd64 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:24.323581 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-2d3fa6ae-497e-4975-917f-e00615974562 req-b0c4bda8-532d-447b-838d-ca9cf326cd64 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:24.341095 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-2d3fa6ae-497e-4975-917f-e00615974562 req-b0c4bda8-532d-447b-838d-ca9cf326cd64 service nova] Creating event network-vif-plugged:7138905c-dbe0-4d9c-83c3-21fb5d346268 for instance 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c on nch1-master-1 Sep 24 20:55:24.350026 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [req-2d3fa6ae-497e-4975-917f-e00615974562 req-b0c4bda8-532d-447b-838d-ca9cf326cd64 service nova] Instance 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 20:55:24.368634 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-2d3fa6ae-497e-4975-917f-e00615974562 req-b0c4bda8-532d-447b-838d-ca9cf326cd64 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180939 Sep 24 20:55:24.369578 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 888/1781] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:55:24.378327 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9c1a9b3f-b8d4-48db-9b2a-8a92ef2bdaa7 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:24.383141 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c1a9b3f-b8d4-48db-9b2a-8a92ef2bdaa7 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:24.383688 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c1a9b3f-b8d4-48db-9b2a-8a92ef2bdaa7 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:24.384136 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c1a9b3f-b8d4-48db-9b2a-8a92ef2bdaa7 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:24.384990 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c1a9b3f-b8d4-48db-9b2a-8a92ef2bdaa7 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:24.385462 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c1a9b3f-b8d4-48db-9b2a-8a92ef2bdaa7 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:24.385901 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c1a9b3f-b8d4-48db-9b2a-8a92ef2bdaa7 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:24.389316 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-44b382cb-e6ea-4675-86db-3572d3cba875 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:24.402133 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-44b382cb-e6ea-4675-86db-3572d3cba875 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1468 microversion: 2.1 time: 0.257013 Sep 24 20:55:24.406785 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 894/1782] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:24 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1468 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:24.413855 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-75385c0a-0dbd-4f40-bd23-cf0ff0e34eb0 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:24.415211 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9c1a9b3f-b8d4-48db-9b2a-8a92ef2bdaa7 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.043604 Sep 24 20:55:24.415830 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 889/1783] 10.222.0.52 () {58 vars in 1170 bytes} [Sat Sep 24 20:55:24 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 947 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:55:24.424026 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-75385c0a-0dbd-4f40-bd23-cf0ff0e34eb0 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a74d1c4c-d757-4879-a35d-9f817ea6e28b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:24.430027 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4969f594-b69f-401e-80a0-4da8437ace49 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:24.434929 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4969f594-b69f-401e-80a0-4da8437ace49 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:24.435681 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4969f594-b69f-401e-80a0-4da8437ace49 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:24.436253 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75385c0a-0dbd-4f40-bd23-cf0ff0e34eb0 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:24.436517 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4969f594-b69f-401e-80a0-4da8437ace49 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:24.437509 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4969f594-b69f-401e-80a0-4da8437ace49 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:24.438138 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4969f594-b69f-401e-80a0-4da8437ace49 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:24.438780 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4969f594-b69f-401e-80a0-4da8437ace49 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:24.439356 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75385c0a-0dbd-4f40-bd23-cf0ff0e34eb0 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:24.439824 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75385c0a-0dbd-4f40-bd23-cf0ff0e34eb0 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:24.441122 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75385c0a-0dbd-4f40-bd23-cf0ff0e34eb0 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:24.441599 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75385c0a-0dbd-4f40-bd23-cf0ff0e34eb0 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:24.442247 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75385c0a-0dbd-4f40-bd23-cf0ff0e34eb0 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:24.468147 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4969f594-b69f-401e-80a0-4da8437ace49 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.041648 Sep 24 20:55:24.477215 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 890/1784] 10.222.0.52 () {58 vars in 1137 bytes} [Sat Sep 24 20:55:24 2022] GET /compute/v2.1/os-services => generated 947 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:55:24.484055 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8ae0a9a4-b32b-4f61-aac3-efbae3aada4b tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:24.492896 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8ae0a9a4-b32b-4f61-aac3-efbae3aada4b tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:24.493387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8ae0a9a4-b32b-4f61-aac3-efbae3aada4b tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:24.493836 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8ae0a9a4-b32b-4f61-aac3-efbae3aada4b tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:24.494611 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8ae0a9a4-b32b-4f61-aac3-efbae3aada4b tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:24.495076 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8ae0a9a4-b32b-4f61-aac3-efbae3aada4b tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:24.495509 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8ae0a9a4-b32b-4f61-aac3-efbae3aada4b tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:24.521495 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8ae0a9a4-b32b-4f61-aac3-efbae3aada4b tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.042783 Sep 24 20:55:24.522443 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 891/1785] 10.222.0.52 () {58 vars in 1196 bytes} [Sat Sep 24 20:55:24 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 24 20:55:24.541205 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-76ed9b0f-fdaa-4d87-96db-837b5802adc6 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:24.544906 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76ed9b0f-fdaa-4d87-96db-837b5802adc6 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:24.545406 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76ed9b0f-fdaa-4d87-96db-837b5802adc6 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:24.545862 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76ed9b0f-fdaa-4d87-96db-837b5802adc6 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:24.551511 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76ed9b0f-fdaa-4d87-96db-837b5802adc6 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:24.552077 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76ed9b0f-fdaa-4d87-96db-837b5802adc6 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:24.552535 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76ed9b0f-fdaa-4d87-96db-837b5802adc6 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:24.603933 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-76ed9b0f-fdaa-4d87-96db-837b5802adc6 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.071554 Sep 24 20:55:24.605047 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 892/1786] 10.222.0.52 () {58 vars in 1137 bytes} [Sat Sep 24 20:55:24 2022] GET /compute/v2.1/os-services => generated 947 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:55:24.618138 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7e4e21ee-7a89-4333-adda-72e584873793 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:24.625693 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7e4e21ee-7a89-4333-adda-72e584873793 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:24.626569 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7e4e21ee-7a89-4333-adda-72e584873793 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:24.627902 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7e4e21ee-7a89-4333-adda-72e584873793 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:24.628969 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7e4e21ee-7a89-4333-adda-72e584873793 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:24.629683 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7e4e21ee-7a89-4333-adda-72e584873793 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:24.630348 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7e4e21ee-7a89-4333-adda-72e584873793 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:24.660336 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7e4e21ee-7a89-4333-adda-72e584873793 tempest-ServicesAdminNegativeTestJSON-1331453754 tempest-ServicesAdminNegativeTestJSON-1331453754-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.046782 Sep 24 20:55:24.661556 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 893/1787] 10.222.0.52 () {58 vars in 1198 bytes} [Sat Sep 24 20:55:24 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:55:24.661692 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-75385c0a-0dbd-4f40-bd23-cf0ff0e34eb0 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:24.671187 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-75385c0a-0dbd-4f40-bd23-cf0ff0e34eb0 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a74d1c4c-d757-4879-a35d-9f817ea6e28b" status: 200 len: 1473 microversion: 2.1 time: 0.263480 Sep 24 20:55:24.671757 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 895/1788] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:24 2022] GET /compute/v2.1/servers/a74d1c4c-d757-4879-a35d-9f817ea6e28b => generated 1473 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:24.871219 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2bbdabf2-0df1-42cf-a557-b3ec475d26ed tempest-ServicesAdminNegativeTestJSON-814522559 tempest-ServicesAdminNegativeTestJSON-814522559-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:24.875407 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2bbdabf2-0df1-42cf-a557-b3ec475d26ed tempest-ServicesAdminNegativeTestJSON-814522559 tempest-ServicesAdminNegativeTestJSON-814522559-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '9f84e590b82949999943ec418f5ce4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a215e5d0f694eb28b015a77a65fed65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:24.878384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2bbdabf2-0df1-42cf-a557-b3ec475d26ed tempest-ServicesAdminNegativeTestJSON-814522559 tempest-ServicesAdminNegativeTestJSON-814522559-project] Request method failure captured: Sep 24 20:55:24.878384 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 24 20:55:24.878384 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:55:24.878384 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:55:24.878384 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:55:24.878384 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:55:24.878384 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:55:24.878384 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:55:24.878384 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:55:24.878384 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:55:24.878384 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL266BRo3Z6rBcB7L4wN5x5Q5wVD2pxk_bG1Ikgx5jSdKzcAKWuOQlORcBGZFzQMnWh4VbFo4-R_anPV7BzAjGs9HUkQlXapkWKBW1fLaFnf3PvhlMfsZcXShB7yqAxyAUq-AZnsUqFSfiRYtD6PQgc4A0ivyu1LtINnjGWXSSocTRhk Sep 24 20:55:24.878384 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:55:24.878384 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:55:24.878384 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:55:24.878384 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:55:24.878384 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:55:24.878384 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:55:24.878384 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 3a215e5d0f694eb28b015a77a65fed65 Sep 24 20:55:24.878384 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-814522559 Sep 24 20:55:24.878384 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:55:24.878384 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:55:24.879866 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3a215e5d0f694eb28b015a77a65fed65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3a215e5d0f694eb28b015a77a65fed65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3a215e5d0f694eb28b015a77a65fed65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3a215e5d0f694eb28b015a77a65fed65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:55:24.879866 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-814522559 Sep 24 20:55:24.879866 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 3a215e5d0f694eb28b015a77a65fed65 Sep 24 20:55:24.879866 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-814522559 Sep 24 20:55:24.879866 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServicesAdminNegativeTestJSON-814522559-project Sep 24 20:55:24.879866 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:55:24.879866 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:55:24.879866 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 9f84e590b82949999943ec418f5ce4f5 Sep 24 20:55:24.879866 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-814522559-project Sep 24 20:55:24.879866 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:55:24.879866 ncdv-master-1 devstack@n-api.service[140516]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 24 20:55:24.879866 ncdv-master-1 devstack@n-api.service[140516]: action_args: {} Sep 24 20:55:24.880678 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:55:24.880678 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:24.880678 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:24.880678 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:24.880678 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:55:24.880678 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:55:24.880678 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 24 20:55:24.880678 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:55:24.880678 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 24 20:55:24.880678 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:55:24.880678 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:55:24.880678 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:55:24.880678 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 24 20:55:24.880678 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 24 20:55:24.880678 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 24 20:55:24.880678 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 24 20:55:24.880678 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 24 20:55:24.880678 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 24 20:55:24.880678 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:55:24.882600 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:55:24.882600 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:55:24.882600 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:55:24.882600 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 24 20:55:24.882600 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 24 20:55:24.882600 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 24 20:55:24.882600 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 24 20:55:24.882600 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 24 20:55:24.882600 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 24 20:55:24.882600 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 24 20:55:24.882600 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:24.882600 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:24.882600 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:24.882600 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:24.882600 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:24.882600 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:24.882600 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 24 20:55:24.882600 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 24 20:55:24.882600 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 24 20:55:24.882600 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:24.885762 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2bbdabf2-0df1-42cf-a557-b3ec475d26ed tempest-ServicesAdminNegativeTestJSON-814522559 tempest-ServicesAdminNegativeTestJSON-814522559-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:55:24.886965 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2bbdabf2-0df1-42cf-a557-b3ec475d26ed tempest-ServicesAdminNegativeTestJSON-814522559 tempest-ServicesAdminNegativeTestJSON-814522559-project] 10.222.0.52 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.216780 Sep 24 20:55:24.887841 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 894/1789] 10.222.0.52 () {58 vars in 1137 bytes} [Sat Sep 24 20:55:24 2022] GET /compute/v2.1/os-services => generated 112 bytes in 218 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:55:25.173079 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-78f909bb-2f66-4848-8c5b-e8e2faa9ed4e tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:25.173702 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-78f909bb-2f66-4848-8c5b-e8e2faa9ed4e tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] [instance: 048b3539-80cb-4d73-9280-b62713ddb588] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:25.191453 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78f909bb-2f66-4848-8c5b-e8e2faa9ed4e tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:25.192328 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78f909bb-2f66-4848-8c5b-e8e2faa9ed4e tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:25.194989 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78f909bb-2f66-4848-8c5b-e8e2faa9ed4e tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:25.197664 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78f909bb-2f66-4848-8c5b-e8e2faa9ed4e tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:25.198428 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78f909bb-2f66-4848-8c5b-e8e2faa9ed4e tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:25.199207 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78f909bb-2f66-4848-8c5b-e8e2faa9ed4e tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:25.433692 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4622b43e-1f9a-4382-881d-c6208c73b820 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:25.435508 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4622b43e-1f9a-4382-881d-c6208c73b820 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:25.458988 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4622b43e-1f9a-4382-881d-c6208c73b820 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:25.462272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4622b43e-1f9a-4382-881d-c6208c73b820 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:25.463991 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4622b43e-1f9a-4382-881d-c6208c73b820 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:25.465341 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4622b43e-1f9a-4382-881d-c6208c73b820 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:25.466550 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4622b43e-1f9a-4382-881d-c6208c73b820 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:25.467645 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-78f909bb-2f66-4848-8c5b-e8e2faa9ed4e tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d241b5c9b654fa7bf97f3652186ea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a0417c2ae142c48e41a41a495ea988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:25.467983 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4622b43e-1f9a-4382-881d-c6208c73b820 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:25.477980 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-78f909bb-2f66-4848-8c5b-e8e2faa9ed4e tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588" status: 200 len: 1473 microversion: 2.1 time: 0.308659 Sep 24 20:55:25.478788 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 896/1790] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:25 2022] GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588 => generated 1473 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:25.695301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b8548139-e324-4ac7-910e-7b327926ff6b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:25.697155 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b8548139-e324-4ac7-910e-7b327926ff6b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a74d1c4c-d757-4879-a35d-9f817ea6e28b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:25.704184 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b8548139-e324-4ac7-910e-7b327926ff6b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:25.704944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b8548139-e324-4ac7-910e-7b327926ff6b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:25.705648 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b8548139-e324-4ac7-910e-7b327926ff6b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:25.707882 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b8548139-e324-4ac7-910e-7b327926ff6b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:25.708698 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b8548139-e324-4ac7-910e-7b327926ff6b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:25.709366 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b8548139-e324-4ac7-910e-7b327926ff6b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:26.171280 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4622b43e-1f9a-4382-881d-c6208c73b820 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:26.182014 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4622b43e-1f9a-4382-881d-c6208c73b820 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1468 microversion: 2.1 time: 0.754748 Sep 24 20:55:26.195117 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 895/1791] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:25 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1468 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:26.483638 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b8548139-e324-4ac7-910e-7b327926ff6b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:26.495045 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b8548139-e324-4ac7-910e-7b327926ff6b tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a74d1c4c-d757-4879-a35d-9f817ea6e28b" status: 200 len: 1473 microversion: 2.1 time: 0.802529 Sep 24 20:55:26.495045 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 897/1792] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:25 2022] GET /compute/v2.1/servers/a74d1c4c-d757-4879-a35d-9f817ea6e28b => generated 1473 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:55:26.508702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-72138bf4-b667-4680-91aa-e1f7aa43783c tempest-ImagesMetadataNegativeTestJSON-1050062638 tempest-ImagesMetadataNegativeTestJSON-1050062638-project] Calling method '.version_select at 0x7f4b0c3c2670>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:26.511159 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-e623db41-7202-4f88-a85e-ad71fec5b81c req-d14983f6-72ca-4370-bfc7-fa3601bbed31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "048b3539-80cb-4d73-9280-b62713ddb588", "name": "network-vif-unplugged", "status": "completed", "tag": "018d9d05-4694-4f6a-8a92-2c61652eab6e"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:55:26.539140 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-72138bf4-b667-4680-91aa-e1f7aa43783c tempest-ImagesMetadataNegativeTestJSON-1050062638 tempest-ImagesMetadataNegativeTestJSON-1050062638-project] HTTP exception thrown: Image not found. Sep 24 20:55:26.541907 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-72138bf4-b667-4680-91aa-e1f7aa43783c tempest-ImagesMetadataNegativeTestJSON-1050062638 tempest-ImagesMetadataNegativeTestJSON-1050062638-project] Request method failure captured: Sep 24 20:55:26.541907 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/images/71d9fc25-6ee4-4275-9603-6164ae109eee/metadata/os_distro HTTP/1.1 Sep 24 20:55:26.541907 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:55:26.541907 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:55:26.541907 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:55:26.541907 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:55:26.541907 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:55:26.541907 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:55:26.541907 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:55:26.541907 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:55:26.541907 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL26-czyrnaJ4uEitaHs9i41UymwU-Xn5kEbRgN5STqmlwaRqP94SAUDRcQp0SvICKoyYZmvsWhG_HuF9aaASVSB8-ddS_84qAp0AiNqh6LAnlkKX2TNz1y1KN5mCP8pOdjkwtZY6RZRZceOt_iJYIhgmm_yc_BHJC86GcYZBdlnlA84 Sep 24 20:55:26.541907 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:55:26.541907 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:55:26.541907 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:55:26.541907 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:55:26.541907 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:55:26.541907 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:55:26.541907 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 2b59c07031e64582ac08d14f9aa85a68 Sep 24 20:55:26.541907 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1050062638 Sep 24 20:55:26.541907 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:55:26.541907 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:55:26.543735 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b59c07031e64582ac08d14f9aa85a68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2b59c07031e64582ac08d14f9aa85a68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2b59c07031e64582ac08d14f9aa85a68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b59c07031e64582ac08d14f9aa85a68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:55:26.543735 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1050062638 Sep 24 20:55:26.543735 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 2b59c07031e64582ac08d14f9aa85a68 Sep 24 20:55:26.543735 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1050062638 Sep 24 20:55:26.543735 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ImagesMetadataNegativeTestJSON-1050062638-project Sep 24 20:55:26.543735 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:55:26.543735 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:55:26.543735 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 36cada5c067342218850b5d13a17627c Sep 24 20:55:26.543735 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1050062638-project Sep 24 20:55:26.543735 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:55:26.543735 ncdv-master-1 devstack@n-api.service[140516]: exception: Image not found. Sep 24 20:55:26.543735 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'image_id': '71d9fc25-6ee4-4275-9603-6164ae109eee', 'id': 'os_distro'} Sep 24 20:55:26.543735 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:55:26.544763 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:26.544763 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 24 20:55:26.544763 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 24 20:55:26.544763 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 24 20:55:26.544763 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 24 20:55:26.544763 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 24 20:55:26.544763 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 24 20:55:26.544763 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 24 20:55:26.544763 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 24 20:55:26.544763 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 24 20:55:26.544763 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 24 20:55:26.544763 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 24 20:55:26.544763 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 24 20:55:26.544763 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 24 20:55:26.544763 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 24 20:55:26.544763 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 24 20:55:26.544763 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 24 20:55:26.544763 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 71d9fc25-6ee4-4275-9603-6164ae109eee Sep 24 20:55:26.546145 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:26.546145 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:26.546145 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:26.546145 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:26.546145 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 24 20:55:26.546145 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 24 20:55:26.546145 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 24 20:55:26.546145 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 24 20:55:26.546145 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 24 20:55:26.546145 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 24 20:55:26.546145 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 24 20:55:26.546145 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 24 20:55:26.546145 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 24 20:55:26.546145 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 24 20:55:26.546145 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 24 20:55:26.546145 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 24 20:55:26.546145 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 24 20:55:26.546145 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 24 20:55:26.546145 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 24 20:55:26.546145 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 24 20:55:26.547757 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 24 20:55:26.547757 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 24 20:55:26.547757 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 24 20:55:26.547757 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 24 20:55:26.547757 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 24 20:55:26.547757 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 24 20:55:26.547757 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 24 20:55:26.547757 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 24 20:55:26.547757 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 71d9fc25-6ee4-4275-9603-6164ae109eee could not be found. Sep 24 20:55:26.547757 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:26.547757 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:26.547757 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:26.547757 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:26.547757 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:26.547757 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:26.547757 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:55:26.547757 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:55:26.547757 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:55:26.547757 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:55:26.549201 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:55:26.549201 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:55:26.549201 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Sep 24 20:55:26.549201 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 24 20:55:26.549201 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 24 20:55:26.549201 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 24 20:55:26.549201 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 24 20:55:26.549201 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:26.549201 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:26.549201 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:26.549201 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:26.549201 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:26.549201 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:26.549201 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:55:26.549201 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:55:26.549201 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 24 20:55:26.549201 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:26.549201 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-72138bf4-b667-4680-91aa-e1f7aa43783c tempest-ImagesMetadataNegativeTestJSON-1050062638 tempest-ImagesMetadataNegativeTestJSON-1050062638-project] Returning 404 to user: Image not found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:55:26.552264 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-72138bf4-b667-4680-91aa-e1f7aa43783c tempest-ImagesMetadataNegativeTestJSON-1050062638 tempest-ImagesMetadataNegativeTestJSON-1050062638-project] 10.222.0.52 "DELETE /compute/v2.1/images/71d9fc25-6ee4-4275-9603-6164ae109eee/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.243233 Sep 24 20:55:26.553299 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 896/1793] 10.222.0.52 () {58 vars in 1293 bytes} [Sat Sep 24 20:55:26 2022] DELETE /compute/v2.1/images/71d9fc25-6ee4-4275-9603-6164ae109eee/metadata/os_distro => generated 62 bytes in 252 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 20:55:26.556733 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e623db41-7202-4f88-a85e-ad71fec5b81c req-d14983f6-72ca-4370-bfc7-fa3601bbed31 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:26.557523 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e623db41-7202-4f88-a85e-ad71fec5b81c req-d14983f6-72ca-4370-bfc7-fa3601bbed31 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:26.557875 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ac915bf2-d372-4ab9-b0f7-4ad1ce383056 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:26.558612 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e623db41-7202-4f88-a85e-ad71fec5b81c req-d14983f6-72ca-4370-bfc7-fa3601bbed31 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:26.559043 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ac915bf2-d372-4ab9-b0f7-4ad1ce383056 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] [instance: 048b3539-80cb-4d73-9280-b62713ddb588] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:26.570364 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac915bf2-d372-4ab9-b0f7-4ad1ce383056 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:26.571028 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac915bf2-d372-4ab9-b0f7-4ad1ce383056 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:26.571505 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac915bf2-d372-4ab9-b0f7-4ad1ce383056 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:26.572478 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac915bf2-d372-4ab9-b0f7-4ad1ce383056 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:26.583366 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac915bf2-d372-4ab9-b0f7-4ad1ce383056 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:26.586890 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-e623db41-7202-4f88-a85e-ad71fec5b81c req-d14983f6-72ca-4370-bfc7-fa3601bbed31 service nova] Creating event network-vif-unplugged:018d9d05-4694-4f6a-8a92-2c61652eab6e for instance 048b3539-80cb-4d73-9280-b62713ddb588 on nch1-master-1 Sep 24 20:55:26.587217 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac915bf2-d372-4ab9-b0f7-4ad1ce383056 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:26.603495 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-e623db41-7202-4f88-a85e-ad71fec5b81c req-d14983f6-72ca-4370-bfc7-fa3601bbed31 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106287 Sep 24 20:55:26.604573 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 898/1794] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:55:26.618355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6c613c47-1713-46ed-894b-56d6d8b30c09 tempest-ImagesMetadataNegativeTestJSON-1050062638 tempest-ImagesMetadataNegativeTestJSON-1050062638-project] Calling method '.version_select at 0x7f4b0c114a60>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:26.661358 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-6c613c47-1713-46ed-894b-56d6d8b30c09 tempest-ImagesMetadataNegativeTestJSON-1050062638 tempest-ImagesMetadataNegativeTestJSON-1050062638-project] HTTP exception thrown: Image not found. Sep 24 20:55:26.794953 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6c613c47-1713-46ed-894b-56d6d8b30c09 tempest-ImagesMetadataNegativeTestJSON-1050062638 tempest-ImagesMetadataNegativeTestJSON-1050062638-project] Request method failure captured: Sep 24 20:55:26.794953 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/images/45b1fcf4-7b0d-4295-9f82-b7a355bc214e/metadata/os_version HTTP/1.1 Sep 24 20:55:26.794953 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:55:26.794953 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:55:26.794953 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:55:26.794953 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:55:26.794953 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:55:26.794953 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:55:26.794953 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:55:26.794953 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:55:26.794953 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL26-czyrnaJ4uEitaHs9i41UymwU-Xn5kEbRgN5STqmlwaRqP94SAUDRcQp0SvICKoyYZmvsWhG_HuF9aaASVSB8-ddS_84qAp0AiNqh6LAnlkKX2TNz1y1KN5mCP8pOdjkwtZY6RZRZceOt_iJYIhgmm_yc_BHJC86GcYZBdlnlA84 Sep 24 20:55:26.794953 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:55:26.794953 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:55:26.794953 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:55:26.794953 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:55:26.794953 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:55:26.794953 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:55:26.794953 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 2b59c07031e64582ac08d14f9aa85a68 Sep 24 20:55:26.794953 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1050062638 Sep 24 20:55:26.794953 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:55:26.794953 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:55:26.796528 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b59c07031e64582ac08d14f9aa85a68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2b59c07031e64582ac08d14f9aa85a68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2b59c07031e64582ac08d14f9aa85a68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b59c07031e64582ac08d14f9aa85a68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:55:26.796528 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1050062638 Sep 24 20:55:26.796528 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 2b59c07031e64582ac08d14f9aa85a68 Sep 24 20:55:26.796528 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1050062638 Sep 24 20:55:26.796528 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ImagesMetadataNegativeTestJSON-1050062638-project Sep 24 20:55:26.796528 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:55:26.796528 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:55:26.796528 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 36cada5c067342218850b5d13a17627c Sep 24 20:55:26.796528 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1050062638-project Sep 24 20:55:26.796528 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 20:55:26.796528 ncdv-master-1 devstack@n-api.service[140517]: exception: Image not found. Sep 24 20:55:26.796528 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'image_id': '45b1fcf4-7b0d-4295-9f82-b7a355bc214e', 'id': 'os_version'} Sep 24 20:55:26.796528 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:55:26.802000 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:26.802000 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 24 20:55:26.802000 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 24 20:55:26.802000 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 24 20:55:26.802000 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 24 20:55:26.802000 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 24 20:55:26.802000 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 24 20:55:26.802000 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 24 20:55:26.802000 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 24 20:55:26.802000 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 24 20:55:26.802000 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 24 20:55:26.802000 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 24 20:55:26.802000 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 24 20:55:26.802000 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 24 20:55:26.802000 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 24 20:55:26.802000 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 24 20:55:26.802000 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 24 20:55:26.802000 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 45b1fcf4-7b0d-4295-9f82-b7a355bc214e Sep 24 20:55:26.803218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:26.803218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:26.803218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:26.803218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:26.803218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 24 20:55:26.803218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 24 20:55:26.803218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 24 20:55:26.803218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 24 20:55:26.803218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 24 20:55:26.803218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 24 20:55:26.803218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 24 20:55:26.803218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 24 20:55:26.803218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 24 20:55:26.803218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 24 20:55:26.803218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 24 20:55:26.803218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 24 20:55:26.803218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 24 20:55:26.803218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 24 20:55:26.803218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 24 20:55:26.803218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 24 20:55:26.804561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 24 20:55:26.804561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 24 20:55:26.804561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 24 20:55:26.804561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 24 20:55:26.804561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 24 20:55:26.804561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 24 20:55:26.804561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 24 20:55:26.804561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 24 20:55:26.804561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 45b1fcf4-7b0d-4295-9f82-b7a355bc214e could not be found. Sep 24 20:55:26.804561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:26.804561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:26.804561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:26.804561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:26.804561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:26.804561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:26.804561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:55:26.804561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:55:26.804561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:55:26.804561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:55:26.807994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:55:26.807994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:55:26.807994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Sep 24 20:55:26.807994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 24 20:55:26.807994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 24 20:55:26.807994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 24 20:55:26.807994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 24 20:55:26.807994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:26.807994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:26.807994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:26.807994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:26.807994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:26.807994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:26.807994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:55:26.807994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:55:26.807994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 24 20:55:26.807994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:26.807994 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6c613c47-1713-46ed-894b-56d6d8b30c09 tempest-ImagesMetadataNegativeTestJSON-1050062638 tempest-ImagesMetadataNegativeTestJSON-1050062638-project] Returning 404 to user: Image not found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:55:26.810392 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6c613c47-1713-46ed-894b-56d6d8b30c09 tempest-ImagesMetadataNegativeTestJSON-1050062638 tempest-ImagesMetadataNegativeTestJSON-1050062638-project] 10.222.0.52 "GET /compute/v2.1/images/45b1fcf4-7b0d-4295-9f82-b7a355bc214e/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.191037 Sep 24 20:55:26.810392 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 899/1795] 10.222.0.52 () {58 vars in 1293 bytes} [Sat Sep 24 20:55:26 2022] GET /compute/v2.1/images/45b1fcf4-7b0d-4295-9f82-b7a355bc214e/metadata/os_version => generated 62 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 20:55:26.810392 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f3168fb0-42c4-4379-87b4-67cd953738cc tempest-ImagesMetadataNegativeTestJSON-1050062638 tempest-ImagesMetadataNegativeTestJSON-1050062638-project] Calling method '.version_select at 0x7f4b0c0f1b80>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:26.840530 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-f3168fb0-42c4-4379-87b4-67cd953738cc tempest-ImagesMetadataNegativeTestJSON-1050062638 tempest-ImagesMetadataNegativeTestJSON-1050062638-project] HTTP exception thrown: Image not found. Sep 24 20:55:26.842620 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f3168fb0-42c4-4379-87b4-67cd953738cc tempest-ImagesMetadataNegativeTestJSON-1050062638 tempest-ImagesMetadataNegativeTestJSON-1050062638-project] Request method failure captured: Sep 24 20:55:26.842620 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/images/a34793ce-0635-4dfd-bee2-c023de3f9a21/metadata HTTP/1.1 Sep 24 20:55:26.842620 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:55:26.842620 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:55:26.842620 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:55:26.842620 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:55:26.842620 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:55:26.842620 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:55:26.842620 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:55:26.842620 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:55:26.842620 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL26-czyrnaJ4uEitaHs9i41UymwU-Xn5kEbRgN5STqmlwaRqP94SAUDRcQp0SvICKoyYZmvsWhG_HuF9aaASVSB8-ddS_84qAp0AiNqh6LAnlkKX2TNz1y1KN5mCP8pOdjkwtZY6RZRZceOt_iJYIhgmm_yc_BHJC86GcYZBdlnlA84 Sep 24 20:55:26.842620 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:55:26.842620 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:55:26.842620 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:55:26.842620 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:55:26.842620 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:55:26.842620 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:55:26.842620 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 2b59c07031e64582ac08d14f9aa85a68 Sep 24 20:55:26.842620 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1050062638 Sep 24 20:55:26.842620 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:55:26.842620 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:55:26.845066 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b59c07031e64582ac08d14f9aa85a68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2b59c07031e64582ac08d14f9aa85a68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2b59c07031e64582ac08d14f9aa85a68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b59c07031e64582ac08d14f9aa85a68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:55:26.845066 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1050062638 Sep 24 20:55:26.845066 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 2b59c07031e64582ac08d14f9aa85a68 Sep 24 20:55:26.845066 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1050062638 Sep 24 20:55:26.845066 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ImagesMetadataNegativeTestJSON-1050062638-project Sep 24 20:55:26.845066 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:55:26.845066 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:55:26.845066 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 36cada5c067342218850b5d13a17627c Sep 24 20:55:26.845066 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1050062638-project Sep 24 20:55:26.845066 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 20:55:26.845066 ncdv-master-1 devstack@n-api.service[140517]: exception: Image not found. Sep 24 20:55:26.845066 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'image_id': 'a34793ce-0635-4dfd-bee2-c023de3f9a21'} Sep 24 20:55:26.845066 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:55:26.846040 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:26.846040 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 24 20:55:26.846040 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 24 20:55:26.846040 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 24 20:55:26.846040 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 24 20:55:26.846040 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 24 20:55:26.846040 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 24 20:55:26.846040 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 24 20:55:26.846040 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 24 20:55:26.846040 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 24 20:55:26.846040 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 24 20:55:26.846040 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 24 20:55:26.846040 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 24 20:55:26.846040 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 24 20:55:26.846040 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 24 20:55:26.846040 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 24 20:55:26.846040 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 24 20:55:26.846040 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a34793ce-0635-4dfd-bee2-c023de3f9a21 Sep 24 20:55:26.847273 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:26.847273 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:26.847273 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:26.847273 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:26.847273 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 24 20:55:26.847273 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 24 20:55:26.847273 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 24 20:55:26.847273 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 24 20:55:26.847273 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 24 20:55:26.847273 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 24 20:55:26.847273 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 24 20:55:26.847273 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 24 20:55:26.847273 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 24 20:55:26.847273 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 24 20:55:26.847273 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 24 20:55:26.847273 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 24 20:55:26.847273 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 24 20:55:26.847273 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 24 20:55:26.847273 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 24 20:55:26.847273 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 24 20:55:26.848499 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 24 20:55:26.848499 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 24 20:55:26.848499 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 24 20:55:26.848499 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 24 20:55:26.848499 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 24 20:55:26.848499 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 24 20:55:26.848499 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 24 20:55:26.848499 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 24 20:55:26.848499 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a34793ce-0635-4dfd-bee2-c023de3f9a21 could not be found. Sep 24 20:55:26.848499 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:26.848499 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:26.848499 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:26.848499 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:26.848499 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:26.848499 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:26.848499 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:55:26.848499 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:55:26.848499 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:55:26.848499 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:55:26.849783 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:55:26.849783 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:55:26.849783 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Sep 24 20:55:26.849783 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 24 20:55:26.849783 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 24 20:55:26.849783 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 24 20:55:26.849783 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 24 20:55:26.849783 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:26.849783 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:26.849783 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:26.849783 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:26.849783 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:26.849783 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:26.849783 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:55:26.849783 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:55:26.849783 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 24 20:55:26.849783 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:26.853688 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f3168fb0-42c4-4379-87b4-67cd953738cc tempest-ImagesMetadataNegativeTestJSON-1050062638 tempest-ImagesMetadataNegativeTestJSON-1050062638-project] Returning 404 to user: Image not found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:55:26.854630 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f3168fb0-42c4-4379-87b4-67cd953738cc tempest-ImagesMetadataNegativeTestJSON-1050062638 tempest-ImagesMetadataNegativeTestJSON-1050062638-project] 10.222.0.52 "GET /compute/v2.1/images/a34793ce-0635-4dfd-bee2-c023de3f9a21/metadata" status: 404 len: 62 microversion: 2.1 time: 0.050893 Sep 24 20:55:26.856217 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 900/1796] 10.222.0.52 () {58 vars in 1260 bytes} [Sat Sep 24 20:55:26 2022] GET /compute/v2.1/images/a34793ce-0635-4dfd-bee2-c023de3f9a21/metadata => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 24 20:55:26.867060 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cf27616d-1d30-450b-a300-064fcc0f2a54 tempest-ImagesMetadataNegativeTestJSON-1050062638 tempest-ImagesMetadataNegativeTestJSON-1050062638-project] Action: 'update_all', calling method: .version_select at 0x7f4b0c114040>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:55:26.914190 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-cf27616d-1d30-450b-a300-064fcc0f2a54 tempest-ImagesMetadataNegativeTestJSON-1050062638 tempest-ImagesMetadataNegativeTestJSON-1050062638-project] HTTP exception thrown: Image not found. Sep 24 20:55:26.917865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cf27616d-1d30-450b-a300-064fcc0f2a54 tempest-ImagesMetadataNegativeTestJSON-1050062638 tempest-ImagesMetadataNegativeTestJSON-1050062638-project] Request method failure captured: Sep 24 20:55:26.917865 ncdv-master-1 devstack@n-api.service[140517]: request: PUT /compute/v2.1/images/c65e0dc7-4391-41f4-ab15-2429a1ffcbe9/metadata HTTP/1.1 Sep 24 20:55:26.917865 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:55:26.917865 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:55:26.917865 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:55:26.917865 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 57 Sep 24 20:55:26.917865 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:55:26.917865 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:55:26.917865 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:55:26.917865 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:55:26.917865 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL26-czyrnaJ4uEitaHs9i41UymwU-Xn5kEbRgN5STqmlwaRqP94SAUDRcQp0SvICKoyYZmvsWhG_HuF9aaASVSB8-ddS_84qAp0AiNqh6LAnlkKX2TNz1y1KN5mCP8pOdjkwtZY6RZRZceOt_iJYIhgmm_yc_BHJC86GcYZBdlnlA84 Sep 24 20:55:26.917865 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:55:26.917865 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:55:26.917865 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:55:26.917865 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:55:26.917865 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:55:26.917865 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:55:26.917865 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 2b59c07031e64582ac08d14f9aa85a68 Sep 24 20:55:26.917865 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1050062638 Sep 24 20:55:26.917865 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:55:26.917865 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:55:26.919339 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b59c07031e64582ac08d14f9aa85a68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2b59c07031e64582ac08d14f9aa85a68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2b59c07031e64582ac08d14f9aa85a68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b59c07031e64582ac08d14f9aa85a68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:55:26.919339 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1050062638 Sep 24 20:55:26.919339 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 2b59c07031e64582ac08d14f9aa85a68 Sep 24 20:55:26.919339 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1050062638 Sep 24 20:55:26.919339 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ImagesMetadataNegativeTestJSON-1050062638-project Sep 24 20:55:26.919339 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:55:26.919339 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:55:26.919339 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 36cada5c067342218850b5d13a17627c Sep 24 20:55:26.919339 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1050062638-project Sep 24 20:55:26.919339 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 20:55:26.919339 ncdv-master-1 devstack@n-api.service[140517]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 24 20:55:26.919339 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 20:55:26.919339 ncdv-master-1 devstack@n-api.service[140517]: exception: Image not found. Sep 24 20:55:26.920202 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'image_id': 'c65e0dc7-4391-41f4-ab15-2429a1ffcbe9', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 24 20:55:26.920202 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:55:26.920202 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:26.920202 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 24 20:55:26.920202 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 24 20:55:26.920202 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 24 20:55:26.920202 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 24 20:55:26.920202 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 24 20:55:26.920202 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 24 20:55:26.920202 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 24 20:55:26.920202 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 24 20:55:26.920202 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 24 20:55:26.920202 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 24 20:55:26.920202 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 24 20:55:26.920202 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 24 20:55:26.920202 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 24 20:55:26.920202 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 24 20:55:26.920202 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 24 20:55:26.921342 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 24 20:55:26.921342 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c65e0dc7-4391-41f4-ab15-2429a1ffcbe9 Sep 24 20:55:26.921342 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:26.921342 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:26.921342 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:26.921342 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:26.921342 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 24 20:55:26.921342 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 24 20:55:26.921342 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 24 20:55:26.921342 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 24 20:55:26.921342 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 24 20:55:26.921342 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 24 20:55:26.921342 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 24 20:55:26.921342 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 24 20:55:26.921342 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 24 20:55:26.921342 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 24 20:55:26.921342 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 24 20:55:26.921342 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 24 20:55:26.921342 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 24 20:55:26.921342 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 24 20:55:26.923347 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 24 20:55:26.923347 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 24 20:55:26.923347 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 24 20:55:26.923347 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 24 20:55:26.923347 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 24 20:55:26.923347 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 24 20:55:26.923347 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 24 20:55:26.923347 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 24 20:55:26.923347 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 24 20:55:26.923347 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 24 20:55:26.923347 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c65e0dc7-4391-41f4-ab15-2429a1ffcbe9 could not be found. Sep 24 20:55:26.923347 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:26.923347 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:26.923347 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:26.923347 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:26.923347 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:26.923347 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:26.923347 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:55:26.923347 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:55:26.927752 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:55:26.927752 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:55:26.927752 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:55:26.927752 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:55:26.927752 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:55:26.927752 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:55:26.927752 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Sep 24 20:55:26.927752 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 24 20:55:26.927752 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 24 20:55:26.927752 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 24 20:55:26.927752 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 24 20:55:26.927752 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:26.927752 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:26.927752 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:26.927752 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:26.927752 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:26.927752 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:26.927752 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:55:26.927752 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:55:26.927752 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 24 20:55:26.927752 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:26.929374 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cf27616d-1d30-450b-a300-064fcc0f2a54 tempest-ImagesMetadataNegativeTestJSON-1050062638 tempest-ImagesMetadataNegativeTestJSON-1050062638-project] Returning 404 to user: Image not found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:55:26.929374 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cf27616d-1d30-450b-a300-064fcc0f2a54 tempest-ImagesMetadataNegativeTestJSON-1050062638 tempest-ImagesMetadataNegativeTestJSON-1050062638-project] 10.222.0.52 "PUT /compute/v2.1/images/c65e0dc7-4391-41f4-ab15-2429a1ffcbe9/metadata" status: 404 len: 62 microversion: 2.1 time: 0.057898 Sep 24 20:55:26.929374 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 901/1797] 10.222.0.52 () {60 vars in 1280 bytes} [Sat Sep 24 20:55:26 2022] PUT /compute/v2.1/images/c65e0dc7-4391-41f4-ab15-2429a1ffcbe9/metadata => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 20:55:26.934844 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0f6bba0f-ebe3-4fbb-b835-03195ab7ed0a tempest-ImagesMetadataNegativeTestJSON-1050062638 tempest-ImagesMetadataNegativeTestJSON-1050062638-project] Action: 'update', calling method: .version_select at 0x7f4b10fcb670>, body: {"meta": {"os_distro": "alt"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:55:26.944572 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ac915bf2-d372-4ab9-b0f7-4ad1ce383056 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d241b5c9b654fa7bf97f3652186ea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a0417c2ae142c48e41a41a495ea988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:26.954089 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ac915bf2-d372-4ab9-b0f7-4ad1ce383056 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588" status: 200 len: 1473 microversion: 2.1 time: 0.400272 Sep 24 20:55:26.959285 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 897/1798] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:26 2022] GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588 => generated 1473 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:26.981216 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-0f6bba0f-ebe3-4fbb-b835-03195ab7ed0a tempest-ImagesMetadataNegativeTestJSON-1050062638 tempest-ImagesMetadataNegativeTestJSON-1050062638-project] HTTP exception thrown: Image not found. Sep 24 20:55:26.983964 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0f6bba0f-ebe3-4fbb-b835-03195ab7ed0a tempest-ImagesMetadataNegativeTestJSON-1050062638 tempest-ImagesMetadataNegativeTestJSON-1050062638-project] Request method failure captured: Sep 24 20:55:26.983964 ncdv-master-1 devstack@n-api.service[140517]: request: PUT /compute/v2.1/images/194cb70d-dbbd-4e11-92f8-d04dfc9c4705/metadata/os_distro HTTP/1.1 Sep 24 20:55:26.983964 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:55:26.983964 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:55:26.983964 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:55:26.983964 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 30 Sep 24 20:55:26.983964 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:55:26.983964 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:55:26.983964 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:55:26.983964 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:55:26.983964 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL26-czyrnaJ4uEitaHs9i41UymwU-Xn5kEbRgN5STqmlwaRqP94SAUDRcQp0SvICKoyYZmvsWhG_HuF9aaASVSB8-ddS_84qAp0AiNqh6LAnlkKX2TNz1y1KN5mCP8pOdjkwtZY6RZRZceOt_iJYIhgmm_yc_BHJC86GcYZBdlnlA84 Sep 24 20:55:26.983964 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:55:26.983964 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:55:26.983964 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:55:26.983964 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:55:26.983964 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:55:26.983964 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:55:26.983964 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 2b59c07031e64582ac08d14f9aa85a68 Sep 24 20:55:26.983964 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1050062638 Sep 24 20:55:26.983964 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:55:26.983964 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:55:26.985379 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b59c07031e64582ac08d14f9aa85a68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2b59c07031e64582ac08d14f9aa85a68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2b59c07031e64582ac08d14f9aa85a68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b59c07031e64582ac08d14f9aa85a68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:55:26.985379 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1050062638 Sep 24 20:55:26.985379 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 2b59c07031e64582ac08d14f9aa85a68 Sep 24 20:55:26.985379 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1050062638 Sep 24 20:55:26.985379 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ImagesMetadataNegativeTestJSON-1050062638-project Sep 24 20:55:26.985379 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:55:26.985379 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:55:26.985379 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 36cada5c067342218850b5d13a17627c Sep 24 20:55:26.985379 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1050062638-project Sep 24 20:55:26.985379 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 20:55:26.985379 ncdv-master-1 devstack@n-api.service[140517]: {"meta": {"os_distro": "alt"}} Sep 24 20:55:26.985379 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 20:55:26.985379 ncdv-master-1 devstack@n-api.service[140517]: exception: Image not found. Sep 24 20:55:26.985379 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'image_id': '194cb70d-dbbd-4e11-92f8-d04dfc9c4705', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Sep 24 20:55:26.986856 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:55:26.986856 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:26.986856 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 24 20:55:26.986856 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 24 20:55:26.986856 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 24 20:55:26.986856 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 24 20:55:26.986856 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 24 20:55:26.986856 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 24 20:55:26.986856 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 24 20:55:26.986856 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 24 20:55:26.986856 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 24 20:55:26.986856 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 24 20:55:26.986856 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 24 20:55:26.986856 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 24 20:55:26.986856 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 24 20:55:26.986856 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 24 20:55:26.986856 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 24 20:55:26.986856 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 24 20:55:26.988603 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 194cb70d-dbbd-4e11-92f8-d04dfc9c4705 Sep 24 20:55:26.988603 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:26.988603 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:26.988603 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:26.988603 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:26.988603 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 24 20:55:26.988603 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 24 20:55:26.988603 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 24 20:55:26.988603 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 24 20:55:26.988603 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 24 20:55:26.988603 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 24 20:55:26.988603 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 24 20:55:26.988603 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 24 20:55:26.988603 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 24 20:55:26.988603 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 24 20:55:26.988603 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 24 20:55:26.988603 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 24 20:55:26.988603 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 24 20:55:26.988603 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 24 20:55:26.989766 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 24 20:55:26.989766 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 24 20:55:26.989766 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 24 20:55:26.989766 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 24 20:55:26.989766 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 24 20:55:26.989766 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 24 20:55:26.989766 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 24 20:55:26.989766 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 24 20:55:26.989766 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 24 20:55:26.989766 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 24 20:55:26.989766 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 194cb70d-dbbd-4e11-92f8-d04dfc9c4705 could not be found. Sep 24 20:55:26.989766 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:26.989766 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:26.989766 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:26.989766 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:26.989766 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:26.989766 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:26.989766 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:55:26.989766 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:55:26.990972 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:55:26.990972 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:55:26.990972 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:55:26.990972 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:55:26.990972 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:55:26.990972 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:55:26.990972 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Sep 24 20:55:26.990972 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 24 20:55:26.990972 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 24 20:55:26.990972 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 24 20:55:26.990972 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 24 20:55:26.990972 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:26.990972 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:26.990972 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:26.990972 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:26.990972 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:26.990972 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:26.990972 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:55:26.990972 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:55:26.990972 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 24 20:55:26.990972 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:26.993731 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0f6bba0f-ebe3-4fbb-b835-03195ab7ed0a tempest-ImagesMetadataNegativeTestJSON-1050062638 tempest-ImagesMetadataNegativeTestJSON-1050062638-project] Returning 404 to user: Image not found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:55:26.994823 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0f6bba0f-ebe3-4fbb-b835-03195ab7ed0a tempest-ImagesMetadataNegativeTestJSON-1050062638 tempest-ImagesMetadataNegativeTestJSON-1050062638-project] 10.222.0.52 "PUT /compute/v2.1/images/194cb70d-dbbd-4e11-92f8-d04dfc9c4705/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.066206 Sep 24 20:55:27.000439 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 902/1799] 10.222.0.52 () {60 vars in 1310 bytes} [Sat Sep 24 20:55:26 2022] PUT /compute/v2.1/images/194cb70d-dbbd-4e11-92f8-d04dfc9c4705/metadata/os_distro => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 20:55:27.006032 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f18a6950-b071-428c-a3e0-663c15afd204 tempest-ImagesMetadataNegativeTestJSON-1050062638 tempest-ImagesMetadataNegativeTestJSON-1050062638-project] Action: 'create', calling method: .version_select at 0x7f4b111cc5e0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:55:27.039015 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-f18a6950-b071-428c-a3e0-663c15afd204 tempest-ImagesMetadataNegativeTestJSON-1050062638 tempest-ImagesMetadataNegativeTestJSON-1050062638-project] HTTP exception thrown: Image not found. Sep 24 20:55:27.043249 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f18a6950-b071-428c-a3e0-663c15afd204 tempest-ImagesMetadataNegativeTestJSON-1050062638 tempest-ImagesMetadataNegativeTestJSON-1050062638-project] Request method failure captured: Sep 24 20:55:27.043249 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/images/17a62c1c-49ab-437a-80f9-173426729248/metadata HTTP/1.1 Sep 24 20:55:27.043249 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:55:27.043249 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:55:27.043249 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:55:27.043249 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 57 Sep 24 20:55:27.043249 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:55:27.043249 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:55:27.043249 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:55:27.043249 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:55:27.043249 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL26-czyrnaJ4uEitaHs9i41UymwU-Xn5kEbRgN5STqmlwaRqP94SAUDRcQp0SvICKoyYZmvsWhG_HuF9aaASVSB8-ddS_84qAp0AiNqh6LAnlkKX2TNz1y1KN5mCP8pOdjkwtZY6RZRZceOt_iJYIhgmm_yc_BHJC86GcYZBdlnlA84 Sep 24 20:55:27.043249 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:55:27.043249 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:55:27.043249 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:55:27.043249 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:55:27.043249 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:55:27.043249 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:55:27.043249 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 2b59c07031e64582ac08d14f9aa85a68 Sep 24 20:55:27.043249 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1050062638 Sep 24 20:55:27.043249 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:55:27.043249 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:55:27.044946 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b59c07031e64582ac08d14f9aa85a68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2b59c07031e64582ac08d14f9aa85a68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2b59c07031e64582ac08d14f9aa85a68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b59c07031e64582ac08d14f9aa85a68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:55:27.044946 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1050062638 Sep 24 20:55:27.044946 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 2b59c07031e64582ac08d14f9aa85a68 Sep 24 20:55:27.044946 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1050062638 Sep 24 20:55:27.044946 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ImagesMetadataNegativeTestJSON-1050062638-project Sep 24 20:55:27.044946 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:55:27.044946 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:55:27.044946 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 36cada5c067342218850b5d13a17627c Sep 24 20:55:27.044946 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1050062638-project Sep 24 20:55:27.044946 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 20:55:27.044946 ncdv-master-1 devstack@n-api.service[140516]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 24 20:55:27.044946 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:55:27.044946 ncdv-master-1 devstack@n-api.service[140516]: exception: Image not found. Sep 24 20:55:27.044946 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'image_id': '17a62c1c-49ab-437a-80f9-173426729248', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 24 20:55:27.045981 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:55:27.045981 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:27.045981 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 24 20:55:27.045981 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 24 20:55:27.045981 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 24 20:55:27.045981 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 24 20:55:27.045981 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 24 20:55:27.045981 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 24 20:55:27.045981 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 24 20:55:27.045981 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 24 20:55:27.045981 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 24 20:55:27.045981 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 24 20:55:27.045981 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 24 20:55:27.045981 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 24 20:55:27.045981 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 24 20:55:27.045981 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 24 20:55:27.045981 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 24 20:55:27.045981 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 24 20:55:27.049474 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 17a62c1c-49ab-437a-80f9-173426729248 Sep 24 20:55:27.049474 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:27.049474 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:27.049474 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:27.049474 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:27.049474 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 24 20:55:27.049474 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 24 20:55:27.049474 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 24 20:55:27.049474 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 24 20:55:27.049474 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 24 20:55:27.049474 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 24 20:55:27.049474 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 24 20:55:27.049474 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 24 20:55:27.049474 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 24 20:55:27.049474 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 24 20:55:27.049474 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 24 20:55:27.049474 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 24 20:55:27.049474 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 24 20:55:27.049474 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 24 20:55:27.052651 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 24 20:55:27.052651 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 24 20:55:27.052651 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 24 20:55:27.052651 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 24 20:55:27.052651 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 24 20:55:27.052651 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 24 20:55:27.052651 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 24 20:55:27.052651 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 24 20:55:27.052651 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 24 20:55:27.052651 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 24 20:55:27.052651 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 17a62c1c-49ab-437a-80f9-173426729248 could not be found. Sep 24 20:55:27.052651 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:27.052651 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:27.052651 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:27.052651 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:27.052651 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:27.052651 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:27.052651 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:55:27.052651 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:55:27.058880 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:55:27.058880 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:55:27.058880 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:55:27.058880 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:55:27.058880 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:55:27.058880 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:55:27.058880 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Sep 24 20:55:27.058880 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 24 20:55:27.058880 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 24 20:55:27.058880 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 24 20:55:27.058880 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 24 20:55:27.058880 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:27.058880 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:27.058880 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:27.058880 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:27.058880 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:27.058880 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:27.058880 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:55:27.058880 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:55:27.058880 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 24 20:55:27.058880 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:27.064500 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f18a6950-b071-428c-a3e0-663c15afd204 tempest-ImagesMetadataNegativeTestJSON-1050062638 tempest-ImagesMetadataNegativeTestJSON-1050062638-project] Returning 404 to user: Image not found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:55:27.066846 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f18a6950-b071-428c-a3e0-663c15afd204 tempest-ImagesMetadataNegativeTestJSON-1050062638 tempest-ImagesMetadataNegativeTestJSON-1050062638-project] 10.222.0.52 "POST /compute/v2.1/images/17a62c1c-49ab-437a-80f9-173426729248/metadata" status: 404 len: 62 microversion: 2.1 time: 0.064242 Sep 24 20:55:27.067460 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 898/1800] 10.222.0.52 () {60 vars in 1281 bytes} [Sat Sep 24 20:55:27 2022] POST /compute/v2.1/images/17a62c1c-49ab-437a-80f9-173426729248/metadata => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 24 20:55:27.121137 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-14cdff34-5b71-4d92-b9a7-99df169f5d29 req-97e0431a-ef23-4c36-a37c-5dafa3238ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "048b3539-80cb-4d73-9280-b62713ddb588", "name": "network-vif-deleted", "tag": "018d9d05-4694-4f6a-8a92-2c61652eab6e"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:55:27.134178 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-14cdff34-5b71-4d92-b9a7-99df169f5d29 req-97e0431a-ef23-4c36-a37c-5dafa3238ce1 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:27.134717 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-14cdff34-5b71-4d92-b9a7-99df169f5d29 req-97e0431a-ef23-4c36-a37c-5dafa3238ce1 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:27.135155 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-14cdff34-5b71-4d92-b9a7-99df169f5d29 req-97e0431a-ef23-4c36-a37c-5dafa3238ce1 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:27.157078 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-14cdff34-5b71-4d92-b9a7-99df169f5d29 req-97e0431a-ef23-4c36-a37c-5dafa3238ce1 service nova] Creating event network-vif-deleted:018d9d05-4694-4f6a-8a92-2c61652eab6e for instance 048b3539-80cb-4d73-9280-b62713ddb588 on nch1-master-1 Sep 24 20:55:27.163011 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-14cdff34-5b71-4d92-b9a7-99df169f5d29 req-97e0431a-ef23-4c36-a37c-5dafa3238ce1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045425 Sep 24 20:55:27.164415 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 903/1801] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:55:27.208036 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ec68634e-a6ba-4be7-8c0f-4bd935d85754 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:27.208671 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ec68634e-a6ba-4be7-8c0f-4bd935d85754 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:27.217483 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ec68634e-a6ba-4be7-8c0f-4bd935d85754 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:27.218054 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ec68634e-a6ba-4be7-8c0f-4bd935d85754 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:27.218526 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ec68634e-a6ba-4be7-8c0f-4bd935d85754 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:27.219361 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ec68634e-a6ba-4be7-8c0f-4bd935d85754 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:27.219918 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ec68634e-a6ba-4be7-8c0f-4bd935d85754 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:27.220201 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ec68634e-a6ba-4be7-8c0f-4bd935d85754 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:27.438543 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-64a1ebc2-322e-48b2-8599-3e7020d9d5ad tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:27.440887 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-64a1ebc2-322e-48b2-8599-3e7020d9d5ad tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] [instance: 5fc32d38-e9c2-4a92-a346-622b7b7206fd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:27.462640 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-64a1ebc2-322e-48b2-8599-3e7020d9d5ad tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:27.464082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-64a1ebc2-322e-48b2-8599-3e7020d9d5ad tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:27.467745 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-64a1ebc2-322e-48b2-8599-3e7020d9d5ad tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:27.468488 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-64a1ebc2-322e-48b2-8599-3e7020d9d5ad tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:27.468957 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-64a1ebc2-322e-48b2-8599-3e7020d9d5ad tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:27.469388 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-64a1ebc2-322e-48b2-8599-3e7020d9d5ad tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:27.517888 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-64a1ebc2-322e-48b2-8599-3e7020d9d5ad tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] [instance: 5fc32d38-e9c2-4a92-a346-622b7b7206fd] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:55:27.684793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ec68634e-a6ba-4be7-8c0f-4bd935d85754 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:27.697331 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ec68634e-a6ba-4be7-8c0f-4bd935d85754 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1468 microversion: 2.1 time: 0.492968 Sep 24 20:55:27.702185 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-64a1ebc2-322e-48b2-8599-3e7020d9d5ad tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5fc32d38-e9c2-4a92-a346-622b7b7206fd" status: 204 len: 0 microversion: 2.1 time: 0.268353 Sep 24 20:55:27.704429 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 904/1802] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:55:27 2022] DELETE /compute/v2.1/servers/5fc32d38-e9c2-4a92-a346-622b7b7206fd => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 24 20:55:27.712147 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3218d4e4-32b4-4d57-8f4f-39d22c151a62 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:27.713592 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3218d4e4-32b4-4d57-8f4f-39d22c151a62 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a74d1c4c-d757-4879-a35d-9f817ea6e28b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:27.725208 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3218d4e4-32b4-4d57-8f4f-39d22c151a62 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:27.725966 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3218d4e4-32b4-4d57-8f4f-39d22c151a62 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:27.726885 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3218d4e4-32b4-4d57-8f4f-39d22c151a62 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:27.728140 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3218d4e4-32b4-4d57-8f4f-39d22c151a62 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:27.728865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3218d4e4-32b4-4d57-8f4f-39d22c151a62 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:27.729528 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3218d4e4-32b4-4d57-8f4f-39d22c151a62 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:27.729646 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 899/1803] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:27 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1468 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:27.749845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-aba064d0-1f1e-44ca-973c-2beb59b770a5 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:27.750615 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-aba064d0-1f1e-44ca-973c-2beb59b770a5 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] [instance: 5fc32d38-e9c2-4a92-a346-622b7b7206fd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:27.771442 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aba064d0-1f1e-44ca-973c-2beb59b770a5 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:27.772525 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aba064d0-1f1e-44ca-973c-2beb59b770a5 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:27.773130 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aba064d0-1f1e-44ca-973c-2beb59b770a5 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:27.777085 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aba064d0-1f1e-44ca-973c-2beb59b770a5 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:27.778484 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aba064d0-1f1e-44ca-973c-2beb59b770a5 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:27.779161 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aba064d0-1f1e-44ca-973c-2beb59b770a5 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:28.104233 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3218d4e4-32b4-4d57-8f4f-39d22c151a62 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:28.116957 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3218d4e4-32b4-4d57-8f4f-39d22c151a62 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a74d1c4c-d757-4879-a35d-9f817ea6e28b" status: 200 len: 1473 microversion: 2.1 time: 0.410896 Sep 24 20:55:28.131194 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 905/1804] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:27 2022] GET /compute/v2.1/servers/a74d1c4c-d757-4879-a35d-9f817ea6e28b => generated 1473 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:28.143063 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-73d974f2-5dc6-400f-9969-24883358dbb7 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:28.146246 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-73d974f2-5dc6-400f-9969-24883358dbb7 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] [instance: 048b3539-80cb-4d73-9280-b62713ddb588] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:28.163652 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-73d974f2-5dc6-400f-9969-24883358dbb7 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:28.164508 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-73d974f2-5dc6-400f-9969-24883358dbb7 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:28.165520 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-73d974f2-5dc6-400f-9969-24883358dbb7 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:28.167137 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-73d974f2-5dc6-400f-9969-24883358dbb7 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:28.168453 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-73d974f2-5dc6-400f-9969-24883358dbb7 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:28.169551 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-73d974f2-5dc6-400f-9969-24883358dbb7 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:28.213432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-73d974f2-5dc6-400f-9969-24883358dbb7 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:28.214625 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-73d974f2-5dc6-400f-9969-24883358dbb7 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:28.215237 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-73d974f2-5dc6-400f-9969-24883358dbb7 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:28.215968 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-73d974f2-5dc6-400f-9969-24883358dbb7 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lazy-loading 'fault' on Instance uuid 048b3539-80cb-4d73-9280-b62713ddb588 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:55:28.294775 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-aba064d0-1f1e-44ca-973c-2beb59b770a5 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab2b6bf40594154a6340d5afd02da0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc5dc16f54e4d2991a2b456216459a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:28.323269 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-aba064d0-1f1e-44ca-973c-2beb59b770a5 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc32d38-e9c2-4a92-a346-622b7b7206fd" status: 200 len: 1667 microversion: 2.1 time: 0.592501 Sep 24 20:55:28.325861 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 900/1805] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:27 2022] GET /compute/v2.1/servers/5fc32d38-e9c2-4a92-a346-622b7b7206fd => generated 1667 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:28.339594 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-73d974f2-5dc6-400f-9969-24883358dbb7 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d241b5c9b654fa7bf97f3652186ea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a0417c2ae142c48e41a41a495ea988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:28.350664 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-73d974f2-5dc6-400f-9969-24883358dbb7 tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588" status: 200 len: 1307 microversion: 2.1 time: 0.218107 Sep 24 20:55:28.370531 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 906/1806] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:28 2022] GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588 => generated 1307 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:28.723504 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9a89859c-35cf-4b01-b4ec-b9eee8ce2c5e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:28.724124 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9a89859c-35cf-4b01-b4ec-b9eee8ce2c5e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:28.732629 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9a89859c-35cf-4b01-b4ec-b9eee8ce2c5e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:28.733391 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9a89859c-35cf-4b01-b4ec-b9eee8ce2c5e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:28.734010 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9a89859c-35cf-4b01-b4ec-b9eee8ce2c5e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:28.734768 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9a89859c-35cf-4b01-b4ec-b9eee8ce2c5e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:28.735385 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9a89859c-35cf-4b01-b4ec-b9eee8ce2c5e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:28.735656 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9a89859c-35cf-4b01-b4ec-b9eee8ce2c5e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:29.007495 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9a89859c-35cf-4b01-b4ec-b9eee8ce2c5e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:29.023752 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:55:29.030221 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9a89859c-35cf-4b01-b4ec-b9eee8ce2c5e tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1468 microversion: 2.1 time: 0.310459 Sep 24 20:55:29.049206 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 901/1807] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:28 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1468 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:29.145673 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-970f39f8-8bdc-4149-9380-9cd00257359c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:29.146561 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-970f39f8-8bdc-4149-9380-9cd00257359c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a74d1c4c-d757-4879-a35d-9f817ea6e28b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:29.174348 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-970f39f8-8bdc-4149-9380-9cd00257359c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:29.175289 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-970f39f8-8bdc-4149-9380-9cd00257359c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:29.175877 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-970f39f8-8bdc-4149-9380-9cd00257359c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:29.176939 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-970f39f8-8bdc-4149-9380-9cd00257359c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:29.179584 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-970f39f8-8bdc-4149-9380-9cd00257359c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:29.180110 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-970f39f8-8bdc-4149-9380-9cd00257359c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:29.184367 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-01deb141-6168-464d-b423-58003023dc67 req-2629dadf-0a26-4cae-9984-4f60af6c0d40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a74d1c4c-d757-4879-a35d-9f817ea6e28b", "name": "network-vif-deleted", "tag": "b6ab8620-4ae6-45bc-8b07-7059b14738de"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:55:29.209905 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-01deb141-6168-464d-b423-58003023dc67 req-2629dadf-0a26-4cae-9984-4f60af6c0d40 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:29.211467 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-01deb141-6168-464d-b423-58003023dc67 req-2629dadf-0a26-4cae-9984-4f60af6c0d40 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:29.212094 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-01deb141-6168-464d-b423-58003023dc67 req-2629dadf-0a26-4cae-9984-4f60af6c0d40 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:29.252278 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-01deb141-6168-464d-b423-58003023dc67 req-2629dadf-0a26-4cae-9984-4f60af6c0d40 service nova] Creating event network-vif-deleted:b6ab8620-4ae6-45bc-8b07-7059b14738de for instance a74d1c4c-d757-4879-a35d-9f817ea6e28b on nch1-master-1 Sep 24 20:55:29.268873 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-01deb141-6168-464d-b423-58003023dc67 req-2629dadf-0a26-4cae-9984-4f60af6c0d40 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089933 Sep 24 20:55:29.277158 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 902/1808] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:55:29.287980 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-970f39f8-8bdc-4149-9380-9cd00257359c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:29.295429 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-970f39f8-8bdc-4149-9380-9cd00257359c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:29.296716 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-970f39f8-8bdc-4149-9380-9cd00257359c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:29.297680 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-970f39f8-8bdc-4149-9380-9cd00257359c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lazy-loading 'fault' on Instance uuid a74d1c4c-d757-4879-a35d-9f817ea6e28b {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:55:29.355033 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f6764d30-550b-45e3-960b-14265265aa56 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:29.356330 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f6764d30-550b-45e3-960b-14265265aa56 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] [instance: 5fc32d38-e9c2-4a92-a346-622b7b7206fd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:29.377319 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6764d30-550b-45e3-960b-14265265aa56 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:29.378459 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6764d30-550b-45e3-960b-14265265aa56 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:29.387414 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6764d30-550b-45e3-960b-14265265aa56 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:29.388574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6764d30-550b-45e3-960b-14265265aa56 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:29.389864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6764d30-550b-45e3-960b-14265265aa56 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:29.390679 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6764d30-550b-45e3-960b-14265265aa56 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:29.525220 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-970f39f8-8bdc-4149-9380-9cd00257359c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936372eff4da45e281fc5512632a12b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bec7c48b07450f95a29a35e113153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:29.537489 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-970f39f8-8bdc-4149-9380-9cd00257359c tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a74d1c4c-d757-4879-a35d-9f817ea6e28b" status: 200 len: 1307 microversion: 2.1 time: 0.397501 Sep 24 20:55:29.538389 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 907/1809] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:29 2022] GET /compute/v2.1/servers/a74d1c4c-d757-4879-a35d-9f817ea6e28b => generated 1307 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:29.543276 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-05e0474b-5094-45e8-a954-679305652f8d tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:29.544110 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-05e0474b-5094-45e8-a954-679305652f8d tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] [instance: 048b3539-80cb-4d73-9280-b62713ddb588] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:29.553405 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05e0474b-5094-45e8-a954-679305652f8d tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:29.553865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05e0474b-5094-45e8-a954-679305652f8d tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:29.554398 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05e0474b-5094-45e8-a954-679305652f8d tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:29.555910 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05e0474b-5094-45e8-a954-679305652f8d tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:29.556680 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05e0474b-5094-45e8-a954-679305652f8d tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:29.557289 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05e0474b-5094-45e8-a954-679305652f8d tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:29.589215 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-05e0474b-5094-45e8-a954-679305652f8d tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] HTTP exception thrown: Instance 048b3539-80cb-4d73-9280-b62713ddb588 could not be found. Sep 24 20:55:29.590922 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-05e0474b-5094-45e8-a954-679305652f8d tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Request method failure captured: Sep 24 20:55:29.590922 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588 HTTP/1.1 Sep 24 20:55:29.590922 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:55:29.590922 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:55:29.590922 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:55:29.590922 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:55:29.590922 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:55:29.590922 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:55:29.590922 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:55:29.590922 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:55:29.590922 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL25WtLhSiM52-bmwuugMhvCCGYBv161RiI4FkcqGmF75ZrfzBqlJGiCMzEV3ZQpftw0ly-bWgUlZ16VlaTkDn6TpyD_MjzqCtuer4cakD5bdfJRE3ArSCeRjMJNIY4U95NQpvtZ9NRFDKo4AUARrREwm88q9QCIMYiHrr6QlNgoTYkg Sep 24 20:55:29.590922 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:55:29.590922 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:55:29.590922 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:55:29.590922 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:55:29.590922 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:55:29.590922 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:55:29.590922 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 66a0417c2ae142c48e41a41a495ea988 Sep 24 20:55:29.590922 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ImagesOneServerTestJSON-188397882 Sep 24 20:55:29.590922 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:55:29.590922 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:55:29.592655 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/66a0417c2ae142c48e41a41a495ea988"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_66a0417c2ae142c48e41a41a495ea988"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/66a0417c2ae142c48e41a41a495ea988"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/66a0417c2ae142c48e41a41a495ea988"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:55:29.592655 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ImagesOneServerTestJSON-188397882 Sep 24 20:55:29.592655 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 66a0417c2ae142c48e41a41a495ea988 Sep 24 20:55:29.592655 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-188397882 Sep 24 20:55:29.592655 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ImagesOneServerTestJSON-188397882-project Sep 24 20:55:29.592655 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:55:29.592655 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:55:29.592655 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 2d241b5c9b654fa7bf97f3652186ea6f Sep 24 20:55:29.592655 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ImagesOneServerTestJSON-188397882-project Sep 24 20:55:29.592655 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:55:29.592655 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 048b3539-80cb-4d73-9280-b62713ddb588 could not be found. Sep 24 20:55:29.592655 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '048b3539-80cb-4d73-9280-b62713ddb588'} Sep 24 20:55:29.593595 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:55:29.593595 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:29.593595 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:55:29.593595 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:55:29.593595 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:55:29.593595 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:55:29.593595 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:55:29.593595 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:55:29.593595 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:55:29.593595 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:55:29.593595 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 048b3539-80cb-4d73-9280-b62713ddb588 could not be found. Sep 24 20:55:29.593595 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:29.593595 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:29.593595 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:29.593595 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:29.593595 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:29.593595 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:29.593595 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:55:29.593595 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:55:29.593595 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:55:29.595190 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:55:29.595190 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:55:29.595190 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:55:29.595190 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:55:29.595190 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:55:29.595190 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:55:29.595190 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:55:29.595190 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 048b3539-80cb-4d73-9280-b62713ddb588 could not be found. Sep 24 20:55:29.595190 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:29.595190 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:29.595190 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:29.595190 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:29.595190 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:29.595190 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:29.595190 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:55:29.595190 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:55:29.595190 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 048b3539-80cb-4d73-9280-b62713ddb588 could not be found. Sep 24 20:55:29.595190 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:29.596996 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-05e0474b-5094-45e8-a954-679305652f8d tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] Returning 404 to user: Instance 048b3539-80cb-4d73-9280-b62713ddb588 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:55:29.596996 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-05e0474b-5094-45e8-a954-679305652f8d tempest-ImagesOneServerTestJSON-188397882 tempest-ImagesOneServerTestJSON-188397882-project] 10.222.0.52 "GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588" status: 404 len: 111 microversion: 2.1 time: 0.052929 Sep 24 20:55:29.596996 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 908/1810] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:29 2022] GET /compute/v2.1/servers/048b3539-80cb-4d73-9280-b62713ddb588 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:55:29.867530 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-78c50ba8-db2f-4cdc-a34a-777623c7d76d tempest-FlavorsV2NegativeTest-1430969636 tempest-FlavorsV2NegativeTest-1430969636-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:29.908977 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-78c50ba8-db2f-4cdc-a34a-777623c7d76d tempest-FlavorsV2NegativeTest-1430969636 tempest-FlavorsV2NegativeTest-1430969636-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.311524 Sep 24 20:55:29.911650 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 909/1811] 10.222.0.52 () {58 vars in 1137 bytes} [Sat Sep 24 20:55:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:55:29.949047 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f6764d30-550b-45e3-960b-14265265aa56 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab2b6bf40594154a6340d5afd02da0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc5dc16f54e4d2991a2b456216459a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:29.982010 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f6764d30-550b-45e3-960b-14265265aa56 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc32d38-e9c2-4a92-a346-622b7b7206fd" status: 200 len: 1667 microversion: 2.1 time: 0.627726 Sep 24 20:55:29.982301 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 903/1812] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:29 2022] GET /compute/v2.1/servers/5fc32d38-e9c2-4a92-a346-622b7b7206fd => generated 1667 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:30.061517 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4006caae-500e-449c-abc7-8f65ca4e3362 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:30.062563 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4006caae-500e-449c-abc7-8f65ca4e3362 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:30.076596 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4006caae-500e-449c-abc7-8f65ca4e3362 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:30.086714 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4006caae-500e-449c-abc7-8f65ca4e3362 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:30.087437 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4006caae-500e-449c-abc7-8f65ca4e3362 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:30.088297 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4006caae-500e-449c-abc7-8f65ca4e3362 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:30.088969 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4006caae-500e-449c-abc7-8f65ca4e3362 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:30.089580 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4006caae-500e-449c-abc7-8f65ca4e3362 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:30.493054 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4006caae-500e-449c-abc7-8f65ca4e3362 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:30.509868 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4006caae-500e-449c-abc7-8f65ca4e3362 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1468 microversion: 2.1 time: 0.448510 Sep 24 20:55:30.529082 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 910/1813] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:30 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1468 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:30.567643 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-34d9b259-f0d4-419a-8ca8-c363cbda1f73 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:30.568639 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-34d9b259-f0d4-419a-8ca8-c363cbda1f73 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] [instance: a74d1c4c-d757-4879-a35d-9f817ea6e28b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:30.583325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34d9b259-f0d4-419a-8ca8-c363cbda1f73 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:30.583831 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34d9b259-f0d4-419a-8ca8-c363cbda1f73 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:30.585925 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34d9b259-f0d4-419a-8ca8-c363cbda1f73 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:30.586903 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34d9b259-f0d4-419a-8ca8-c363cbda1f73 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:30.587381 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34d9b259-f0d4-419a-8ca8-c363cbda1f73 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:30.588900 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34d9b259-f0d4-419a-8ca8-c363cbda1f73 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:30.621104 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-34d9b259-f0d4-419a-8ca8-c363cbda1f73 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] HTTP exception thrown: Instance a74d1c4c-d757-4879-a35d-9f817ea6e28b could not be found. Sep 24 20:55:30.628772 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-34d9b259-f0d4-419a-8ca8-c363cbda1f73 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Request method failure captured: Sep 24 20:55:30.628772 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/a74d1c4c-d757-4879-a35d-9f817ea6e28b HTTP/1.1 Sep 24 20:55:30.628772 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:55:30.628772 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:55:30.628772 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:55:30.628772 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:55:30.628772 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:55:30.628772 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:55:30.628772 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:55:30.628772 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:55:30.628772 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL23ty18wZ369rBpsqLlzALGIa2Gim7BSAzth626XfTPt1jl2TGGDfuIK0NF1uBFJTGNmpODfOJmslXLXls2-SCCSRhWzdKVR2lBkl_nLf9Mq1Le-1pWzwdVHhu2NC69cXC874Lb-O01_urLv2faksB3B4Xzjyj58JzXn5kGazzFVV5g Sep 24 20:55:30.628772 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:55:30.628772 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:55:30.628772 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:55:30.628772 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:55:30.628772 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:55:30.628772 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:55:30.628772 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 73bec7c48b07450f95a29a35e113153d Sep 24 20:55:30.628772 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersOnMultiNodesTest-512776478 Sep 24 20:55:30.628772 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:55:30.628772 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:55:30.636007 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/73bec7c48b07450f95a29a35e113153d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_73bec7c48b07450f95a29a35e113153d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/73bec7c48b07450f95a29a35e113153d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/73bec7c48b07450f95a29a35e113153d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:55:30.636007 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersOnMultiNodesTest-512776478 Sep 24 20:55:30.636007 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 73bec7c48b07450f95a29a35e113153d Sep 24 20:55:30.636007 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-512776478 Sep 24 20:55:30.636007 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersOnMultiNodesTest-512776478-project Sep 24 20:55:30.636007 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:55:30.636007 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:55:30.636007 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 936372eff4da45e281fc5512632a12b6 Sep 24 20:55:30.636007 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersOnMultiNodesTest-512776478-project Sep 24 20:55:30.636007 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:55:30.636007 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance a74d1c4c-d757-4879-a35d-9f817ea6e28b could not be found. Sep 24 20:55:30.636007 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'a74d1c4c-d757-4879-a35d-9f817ea6e28b'} Sep 24 20:55:30.636970 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:55:30.636970 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:30.636970 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:55:30.636970 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:55:30.636970 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:55:30.636970 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:55:30.636970 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:55:30.636970 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:55:30.636970 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:55:30.636970 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:55:30.636970 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a74d1c4c-d757-4879-a35d-9f817ea6e28b could not be found. Sep 24 20:55:30.636970 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:30.636970 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:30.636970 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:30.636970 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:30.636970 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:30.636970 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:30.636970 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:55:30.636970 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:55:30.636970 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:55:30.638417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:55:30.638417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:55:30.638417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:55:30.638417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:55:30.638417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:55:30.638417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:55:30.638417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:55:30.638417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a74d1c4c-d757-4879-a35d-9f817ea6e28b could not be found. Sep 24 20:55:30.638417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:30.638417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:30.638417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:30.638417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:30.638417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:30.638417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:30.638417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:55:30.638417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:55:30.638417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a74d1c4c-d757-4879-a35d-9f817ea6e28b could not be found. Sep 24 20:55:30.638417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:30.639818 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-34d9b259-f0d4-419a-8ca8-c363cbda1f73 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] Returning 404 to user: Instance a74d1c4c-d757-4879-a35d-9f817ea6e28b could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:55:30.639818 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-34d9b259-f0d4-419a-8ca8-c363cbda1f73 tempest-ServersOnMultiNodesTest-512776478 tempest-ServersOnMultiNodesTest-512776478-project] 10.222.0.52 "GET /compute/v2.1/servers/a74d1c4c-d757-4879-a35d-9f817ea6e28b" status: 404 len: 111 microversion: 2.1 time: 0.070992 Sep 24 20:55:30.639818 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 904/1814] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:30 2022] GET /compute/v2.1/servers/a74d1c4c-d757-4879-a35d-9f817ea6e28b => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 20:55:31.007512 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dfb7d243-e2e9-4469-912e-fda49372daa8 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:31.008174 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dfb7d243-e2e9-4469-912e-fda49372daa8 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] [instance: 5fc32d38-e9c2-4a92-a346-622b7b7206fd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:31.043565 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-42b86ec7-0b96-49fe-b951-15e578e9d9ca req-b304945a-5fbd-4aeb-b4ce-1fc742f805ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9425eeec-a7b4-4926-a2f3-80dd47eb9e0c", "name": "network-vif-unplugged", "status": "completed", "tag": "7138905c-dbe0-4d9c-83c3-21fb5d346268"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:55:31.059446 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dfb7d243-e2e9-4469-912e-fda49372daa8 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:31.063558 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dfb7d243-e2e9-4469-912e-fda49372daa8 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:31.068299 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dfb7d243-e2e9-4469-912e-fda49372daa8 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:31.076850 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dfb7d243-e2e9-4469-912e-fda49372daa8 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:31.081680 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-42b86ec7-0b96-49fe-b951-15e578e9d9ca req-b304945a-5fbd-4aeb-b4ce-1fc742f805ec service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:31.083111 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-42b86ec7-0b96-49fe-b951-15e578e9d9ca req-b304945a-5fbd-4aeb-b4ce-1fc742f805ec service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:31.084385 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-42b86ec7-0b96-49fe-b951-15e578e9d9ca req-b304945a-5fbd-4aeb-b4ce-1fc742f805ec service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:31.084650 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dfb7d243-e2e9-4469-912e-fda49372daa8 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:31.085890 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dfb7d243-e2e9-4469-912e-fda49372daa8 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:31.121143 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-42b86ec7-0b96-49fe-b951-15e578e9d9ca req-b304945a-5fbd-4aeb-b4ce-1fc742f805ec service nova] Creating event network-vif-unplugged:7138905c-dbe0-4d9c-83c3-21fb5d346268 for instance 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c on nch2-master-1 Sep 24 20:55:31.138923 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [req-42b86ec7-0b96-49fe-b951-15e578e9d9ca req-b304945a-5fbd-4aeb-b4ce-1fc742f805ec service nova] Instance 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 20:55:31.172142 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:55:31.176901 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-42b86ec7-0b96-49fe-b951-15e578e9d9ca req-b304945a-5fbd-4aeb-b4ce-1fc742f805ec service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.135747 Sep 24 20:55:31.178291 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 905/1815] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:55:31.330159 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dfb7d243-e2e9-4469-912e-fda49372daa8 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab2b6bf40594154a6340d5afd02da0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc5dc16f54e4d2991a2b456216459a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:31.350486 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dfb7d243-e2e9-4469-912e-fda49372daa8 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc32d38-e9c2-4a92-a346-622b7b7206fd" status: 200 len: 1599 microversion: 2.1 time: 0.348129 Sep 24 20:55:31.352079 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 911/1816] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:30 2022] GET /compute/v2.1/servers/5fc32d38-e9c2-4a92-a346-622b7b7206fd => generated 1599 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:31.537312 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5191853e-19c8-4581-96ab-12180ec5b8e3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:31.538346 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5191853e-19c8-4581-96ab-12180ec5b8e3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:31.555493 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5191853e-19c8-4581-96ab-12180ec5b8e3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:31.556390 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5191853e-19c8-4581-96ab-12180ec5b8e3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:31.556975 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5191853e-19c8-4581-96ab-12180ec5b8e3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:31.558007 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5191853e-19c8-4581-96ab-12180ec5b8e3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:31.558714 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5191853e-19c8-4581-96ab-12180ec5b8e3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:31.562846 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5191853e-19c8-4581-96ab-12180ec5b8e3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:32.057007 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5191853e-19c8-4581-96ab-12180ec5b8e3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:32.073527 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5191853e-19c8-4581-96ab-12180ec5b8e3 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1468 microversion: 2.1 time: 0.541537 Sep 24 20:55:32.074885 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 906/1817] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:31 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1468 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:32.381204 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8f23d024-0b3e-4333-8a6d-5cac94017c81 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:32.381823 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8f23d024-0b3e-4333-8a6d-5cac94017c81 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] [instance: 5fc32d38-e9c2-4a92-a346-622b7b7206fd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:32.420618 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8f23d024-0b3e-4333-8a6d-5cac94017c81 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:32.423127 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8f23d024-0b3e-4333-8a6d-5cac94017c81 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:32.424276 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8f23d024-0b3e-4333-8a6d-5cac94017c81 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:32.427222 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8f23d024-0b3e-4333-8a6d-5cac94017c81 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:32.428068 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8f23d024-0b3e-4333-8a6d-5cac94017c81 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:32.429311 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8f23d024-0b3e-4333-8a6d-5cac94017c81 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:32.607246 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8f23d024-0b3e-4333-8a6d-5cac94017c81 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab2b6bf40594154a6340d5afd02da0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc5dc16f54e4d2991a2b456216459a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:32.622318 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8f23d024-0b3e-4333-8a6d-5cac94017c81 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc32d38-e9c2-4a92-a346-622b7b7206fd" status: 200 len: 1599 microversion: 2.1 time: 0.246883 Sep 24 20:55:32.636319 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 912/1818] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:32 2022] GET /compute/v2.1/servers/5fc32d38-e9c2-4a92-a346-622b7b7206fd => generated 1599 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:55:32.978677 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c8250cdc-a13a-4cfc-8466-d7b48fe4b1ad tempest-FlavorsV2NegativeTest-1430969636 tempest-FlavorsV2NegativeTest-1430969636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1162268717", "imageRef": "e4eb6493-2682-4b19-93e6-031836481941", "flavorRef": "452"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:55:33.104098 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-36b23b79-1633-48f3-a52f-febd74383014 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:33.104775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-36b23b79-1633-48f3-a52f-febd74383014 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:33.110149 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-c8250cdc-a13a-4cfc-8466-d7b48fe4b1ad tempest-FlavorsV2NegativeTest-1430969636 tempest-FlavorsV2NegativeTest-1430969636-project] validate_networks() for None {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:55:33.117872 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-36b23b79-1633-48f3-a52f-febd74383014 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:33.118385 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-36b23b79-1633-48f3-a52f-febd74383014 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:33.123927 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-36b23b79-1633-48f3-a52f-febd74383014 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:33.124758 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-36b23b79-1633-48f3-a52f-febd74383014 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:33.125259 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-36b23b79-1633-48f3-a52f-febd74383014 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:33.125723 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-36b23b79-1633-48f3-a52f-febd74383014 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:33.783561 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-c8250cdc-a13a-4cfc-8466-d7b48fe4b1ad tempest-FlavorsV2NegativeTest-1430969636 tempest-FlavorsV2NegativeTest-1430969636-project] HTTP exception thrown: Flavor's memory is too small for requested image. Sep 24 20:55:33.786967 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c8250cdc-a13a-4cfc-8466-d7b48fe4b1ad tempest-FlavorsV2NegativeTest-1430969636 tempest-FlavorsV2NegativeTest-1430969636-project] Request method failure captured: Sep 24 20:55:33.786967 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 24 20:55:33.786967 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:55:33.786967 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:55:33.786967 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:55:33.786967 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 143 Sep 24 20:55:33.786967 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:55:33.786967 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:55:33.786967 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:55:33.786967 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:55:33.786967 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL27BRdxDwOiYSkfyMY9yO65OEcJXy183WNkCB4uGz9EJUkKmi_zFRjkETisAT20jj90K3NX7EBLUO9ALnPaE4yNSkeTGF_Qfoq9F8ETqA26Y1f1r3_mKIlEyuT7ThwBj3dQ6N3t4xPp2sllHM4LFq2ROwLbjVdcrJhItaXJ6yplTOIY Sep 24 20:55:33.786967 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:55:33.786967 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:55:33.786967 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:55:33.786967 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:55:33.786967 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:55:33.786967 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:55:33.786967 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: ce9e67a8883f4d37a7da86febec31fa3 Sep 24 20:55:33.786967 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-FlavorsV2NegativeTest-1430969636 Sep 24 20:55:33.786967 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:55:33.786967 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:55:33.789229 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ce9e67a8883f4d37a7da86febec31fa3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ce9e67a8883f4d37a7da86febec31fa3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ce9e67a8883f4d37a7da86febec31fa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ce9e67a8883f4d37a7da86febec31fa3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:55:33.789229 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-FlavorsV2NegativeTest-1430969636 Sep 24 20:55:33.789229 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: ce9e67a8883f4d37a7da86febec31fa3 Sep 24 20:55:33.789229 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1430969636 Sep 24 20:55:33.789229 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-FlavorsV2NegativeTest-1430969636-project Sep 24 20:55:33.789229 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:55:33.789229 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:55:33.789229 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 6fab725854974a6c86e089f32e446954 Sep 24 20:55:33.789229 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-FlavorsV2NegativeTest-1430969636-project Sep 24 20:55:33.789229 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 20:55:33.789229 ncdv-master-1 devstack@n-api.service[140516]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1162268717", "imageRef": "e4eb6493-2682-4b19-93e6-031836481941", "flavorRef": "452"}} Sep 24 20:55:33.789229 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:55:33.790360 ncdv-master-1 devstack@n-api.service[140516]: exception: Flavor's memory is too small for requested image. Sep 24 20:55:33.790360 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1162268717', 'imageRef': 'e4eb6493-2682-4b19-93e6-031836481941', 'flavorRef': '452'}}} Sep 24 20:55:33.790360 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:55:33.790360 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:33.790360 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 24 20:55:33.790360 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 24 20:55:33.790360 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 24 20:55:33.790360 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 24 20:55:33.790360 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 24 20:55:33.790360 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 24 20:55:33.790360 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Sep 24 20:55:33.790360 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Sep 24 20:55:33.790360 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Sep 24 20:55:33.790360 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Sep 24 20:55:33.790360 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Sep 24 20:55:33.790360 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Sep 24 20:55:33.790360 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Sep 24 20:55:33.790360 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:33.790360 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:33.790360 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:33.793650 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:33.793650 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:33.793650 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:33.793650 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:55:33.793650 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:55:33.793650 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:55:33.793650 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:55:33.793650 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:55:33.793650 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:55:33.793650 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:55:33.793650 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:55:33.793650 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:55:33.793650 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:55:33.793650 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 24 20:55:33.793650 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Sep 24 20:55:33.793650 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 24 20:55:33.793650 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Sep 24 20:55:33.793650 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:33.793650 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:33.793650 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:33.793650 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:33.796202 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:33.796202 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:33.796202 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:55:33.796202 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:55:33.796202 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Sep 24 20:55:33.796202 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:33.797947 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-36b23b79-1633-48f3-a52f-febd74383014 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:33.799587 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c8250cdc-a13a-4cfc-8466-d7b48fe4b1ad tempest-FlavorsV2NegativeTest-1430969636 tempest-FlavorsV2NegativeTest-1430969636-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:55:33.799587 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c8250cdc-a13a-4cfc-8466-d7b48fe4b1ad tempest-FlavorsV2NegativeTest-1430969636 tempest-FlavorsV2NegativeTest-1430969636-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.825253 Sep 24 20:55:33.812947 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 907/1819] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:55:32 2022] POST /compute/v2.1/servers => generated 93 bytes in 833 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 24 20:55:33.816211 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-8ed77a1d-6f74-4dd7-9eed-24e70d8aa468 req-d711f3a2-b19b-4bf9-92a0-1c7422645c68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fc32d38-e9c2-4a92-a346-622b7b7206fd", "name": "network-vif-deleted", "tag": "ae80193f-701b-44ae-b340-65e79cdd45ec"}, {"name": "network-changed", "server_uuid": "9425eeec-a7b4-4926-a2f3-80dd47eb9e0c", "tag": "7138905c-dbe0-4d9c-83c3-21fb5d346268"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:55:33.838878 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-36b23b79-1633-48f3-a52f-febd74383014 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1468 microversion: 2.1 time: 0.735327 Sep 24 20:55:33.843091 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 913/1820] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:33 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1468 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:33.864175 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c99d2f89-7f72-44b4-a0f7-30f715c2a2f5 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:33.868147 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c99d2f89-7f72-44b4-a0f7-30f715c2a2f5 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] [instance: 5fc32d38-e9c2-4a92-a346-622b7b7206fd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:33.889055 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-8ed77a1d-6f74-4dd7-9eed-24e70d8aa468 req-d711f3a2-b19b-4bf9-92a0-1c7422645c68 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:33.889713 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-8ed77a1d-6f74-4dd7-9eed-24e70d8aa468 req-d711f3a2-b19b-4bf9-92a0-1c7422645c68 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:33.890289 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-8ed77a1d-6f74-4dd7-9eed-24e70d8aa468 req-d711f3a2-b19b-4bf9-92a0-1c7422645c68 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:33.895708 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c99d2f89-7f72-44b4-a0f7-30f715c2a2f5 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:33.900899 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c99d2f89-7f72-44b4-a0f7-30f715c2a2f5 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:33.904805 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c99d2f89-7f72-44b4-a0f7-30f715c2a2f5 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:33.906937 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c99d2f89-7f72-44b4-a0f7-30f715c2a2f5 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:33.907944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c99d2f89-7f72-44b4-a0f7-30f715c2a2f5 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:33.909957 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c99d2f89-7f72-44b4-a0f7-30f715c2a2f5 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:33.929489 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-8ed77a1d-6f74-4dd7-9eed-24e70d8aa468 req-d711f3a2-b19b-4bf9-92a0-1c7422645c68 service nova] Creating event network-vif-deleted:ae80193f-701b-44ae-b340-65e79cdd45ec for instance 5fc32d38-e9c2-4a92-a346-622b7b7206fd on nch2-master-1 Sep 24 20:55:33.930362 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-8ed77a1d-6f74-4dd7-9eed-24e70d8aa468 req-d711f3a2-b19b-4bf9-92a0-1c7422645c68 service nova] Creating event network-changed:7138905c-dbe0-4d9c-83c3-21fb5d346268 for instance 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c on nch2-master-1 Sep 24 20:55:33.942239 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [req-8ed77a1d-6f74-4dd7-9eed-24e70d8aa468 req-d711f3a2-b19b-4bf9-92a0-1c7422645c68 service nova] Instance 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 20:55:33.981581 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-8ed77a1d-6f74-4dd7-9eed-24e70d8aa468 req-d711f3a2-b19b-4bf9-92a0-1c7422645c68 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.172636 Sep 24 20:55:33.983254 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 908/1821] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:55:34.017983 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c99d2f89-7f72-44b4-a0f7-30f715c2a2f5 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:34.019961 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c99d2f89-7f72-44b4-a0f7-30f715c2a2f5 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:34.023694 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c99d2f89-7f72-44b4-a0f7-30f715c2a2f5 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:34.024665 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-c99d2f89-7f72-44b4-a0f7-30f715c2a2f5 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lazy-loading 'fault' on Instance uuid 5fc32d38-e9c2-4a92-a346-622b7b7206fd {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:55:34.385606 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c99d2f89-7f72-44b4-a0f7-30f715c2a2f5 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab2b6bf40594154a6340d5afd02da0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc5dc16f54e4d2991a2b456216459a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:34.411123 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c99d2f89-7f72-44b4-a0f7-30f715c2a2f5 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc32d38-e9c2-4a92-a346-622b7b7206fd" status: 200 len: 1315 microversion: 2.1 time: 0.563220 Sep 24 20:55:34.415471 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 914/1822] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:33 2022] GET /compute/v2.1/servers/5fc32d38-e9c2-4a92-a346-622b7b7206fd => generated 1315 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:34.866888 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=12 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:55:34.872983 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-31b9fbaa-76b1-45c7-9256-c534d26a5bed tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:34.873722 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-31b9fbaa-76b1-45c7-9256-c534d26a5bed tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:34.898948 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-31b9fbaa-76b1-45c7-9256-c534d26a5bed tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:34.900810 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-31b9fbaa-76b1-45c7-9256-c534d26a5bed tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:34.907970 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-31b9fbaa-76b1-45c7-9256-c534d26a5bed tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:34.909646 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-31b9fbaa-76b1-45c7-9256-c534d26a5bed tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:34.910471 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-31b9fbaa-76b1-45c7-9256-c534d26a5bed tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:34.911310 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-31b9fbaa-76b1-45c7-9256-c534d26a5bed tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:35.349320 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-31b9fbaa-76b1-45c7-9256-c534d26a5bed tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:35.363632 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-31b9fbaa-76b1-45c7-9256-c534d26a5bed tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1468 microversion: 2.1 time: 0.497979 Sep 24 20:55:35.365617 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 909/1823] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:34 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1468 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:35.447742 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bb1efd7b-44a5-4068-b064-6e8fba82f1e4 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:35.450354 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bb1efd7b-44a5-4068-b064-6e8fba82f1e4 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] [instance: 5fc32d38-e9c2-4a92-a346-622b7b7206fd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:35.464872 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:55:35.467185 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb1efd7b-44a5-4068-b064-6e8fba82f1e4 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:35.468217 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb1efd7b-44a5-4068-b064-6e8fba82f1e4 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:35.468885 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb1efd7b-44a5-4068-b064-6e8fba82f1e4 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:35.470739 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb1efd7b-44a5-4068-b064-6e8fba82f1e4 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:35.471368 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb1efd7b-44a5-4068-b064-6e8fba82f1e4 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:35.473004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb1efd7b-44a5-4068-b064-6e8fba82f1e4 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:35.494968 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-bb1efd7b-44a5-4068-b064-6e8fba82f1e4 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] HTTP exception thrown: Instance 5fc32d38-e9c2-4a92-a346-622b7b7206fd could not be found. Sep 24 20:55:35.496849 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bb1efd7b-44a5-4068-b064-6e8fba82f1e4 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Request method failure captured: Sep 24 20:55:35.496849 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/5fc32d38-e9c2-4a92-a346-622b7b7206fd HTTP/1.1 Sep 24 20:55:35.496849 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:55:35.496849 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:55:35.496849 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:55:35.496849 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:55:35.496849 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:55:35.496849 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:55:35.496849 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:55:35.496849 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:55:35.496849 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL26CWUEeC9JX99PJw232crZXUGT8Jq42IMgQT7qz4qX3pqwemyKyCnysrcXTFXGqDQLBLfMi5hS-DY2lZ_QakNP4PQsvPzUIJdfBtzD4PXz428uC6gne-nztXAPGNqDEBUn5aMCz7UXaj3r77Wht2NcBmfauuZBnBeU--Yagy-0mpnQ Sep 24 20:55:35.496849 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:55:35.496849 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:55:35.496849 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:55:35.496849 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:55:35.496849 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:55:35.496849 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:55:35.496849 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 8dc5dc16f54e4d2991a2b456216459a4 Sep 24 20:55:35.496849 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersTestFqdnHostnames-715150543 Sep 24 20:55:35.496849 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:55:35.496849 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:55:35.498534 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8dc5dc16f54e4d2991a2b456216459a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8dc5dc16f54e4d2991a2b456216459a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8dc5dc16f54e4d2991a2b456216459a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8dc5dc16f54e4d2991a2b456216459a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:55:35.498534 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersTestFqdnHostnames-715150543 Sep 24 20:55:35.498534 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 8dc5dc16f54e4d2991a2b456216459a4 Sep 24 20:55:35.498534 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-715150543 Sep 24 20:55:35.498534 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersTestFqdnHostnames-715150543-project Sep 24 20:55:35.498534 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:55:35.498534 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:55:35.498534 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: dab2b6bf40594154a6340d5afd02da0c Sep 24 20:55:35.498534 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersTestFqdnHostnames-715150543-project Sep 24 20:55:35.498534 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:55:35.498534 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 5fc32d38-e9c2-4a92-a346-622b7b7206fd could not be found. Sep 24 20:55:35.498534 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '5fc32d38-e9c2-4a92-a346-622b7b7206fd'} Sep 24 20:55:35.499511 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:55:35.499511 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:35.499511 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:55:35.499511 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:55:35.499511 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:55:35.499511 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:55:35.499511 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:55:35.499511 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:55:35.499511 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:55:35.499511 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:55:35.499511 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fc32d38-e9c2-4a92-a346-622b7b7206fd could not be found. Sep 24 20:55:35.499511 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:35.499511 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:35.499511 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:35.499511 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:35.499511 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:35.499511 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:35.499511 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:55:35.499511 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:55:35.499511 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:55:35.501051 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:55:35.501051 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:55:35.501051 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:55:35.501051 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:55:35.501051 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:55:35.501051 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:55:35.501051 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:55:35.501051 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fc32d38-e9c2-4a92-a346-622b7b7206fd could not be found. Sep 24 20:55:35.501051 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:35.501051 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:35.501051 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:35.501051 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:35.501051 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:35.501051 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:35.501051 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:55:35.501051 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:55:35.501051 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fc32d38-e9c2-4a92-a346-622b7b7206fd could not be found. Sep 24 20:55:35.501051 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:35.502378 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bb1efd7b-44a5-4068-b064-6e8fba82f1e4 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Returning 404 to user: Instance 5fc32d38-e9c2-4a92-a346-622b7b7206fd could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:55:35.502378 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bb1efd7b-44a5-4068-b064-6e8fba82f1e4 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] 10.222.0.52 "GET /compute/v2.1/servers/5fc32d38-e9c2-4a92-a346-622b7b7206fd" status: 404 len: 111 microversion: 2.1 time: 0.058187 Sep 24 20:55:35.509001 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5cadb53e-0c87-4364-9b78-33d70f201698 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] Calling method '.version_select at 0x7f4b111ccf70>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:35.513538 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 915/1824] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:35 2022] GET /compute/v2.1/servers/5fc32d38-e9c2-4a92-a346-622b7b7206fd => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:55:35.536619 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5cadb53e-0c87-4364-9b78-33d70f201698 tempest-ServersTestFqdnHostnames-715150543 tempest-ServersTestFqdnHostnames-715150543-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-313481477" status: 202 len: 0 microversion: 2.1 time: 0.030538 Sep 24 20:55:35.541493 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 910/1825] 10.222.0.52 () {58 vars in 1218 bytes} [Sat Sep 24 20:55:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-313481477 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:55:36.390012 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d805d6a7-c08f-4acb-8e72-a5dde13b31eb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:36.391094 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d805d6a7-c08f-4acb-8e72-a5dde13b31eb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:36.406652 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d805d6a7-c08f-4acb-8e72-a5dde13b31eb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:36.408648 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d805d6a7-c08f-4acb-8e72-a5dde13b31eb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:36.410104 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d805d6a7-c08f-4acb-8e72-a5dde13b31eb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:36.413668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d805d6a7-c08f-4acb-8e72-a5dde13b31eb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:36.414397 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d805d6a7-c08f-4acb-8e72-a5dde13b31eb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:36.415088 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d805d6a7-c08f-4acb-8e72-a5dde13b31eb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:36.773363 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d805d6a7-c08f-4acb-8e72-a5dde13b31eb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:36.783323 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d805d6a7-c08f-4acb-8e72-a5dde13b31eb tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1468 microversion: 2.1 time: 0.398291 Sep 24 20:55:36.785865 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 916/1826] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:36 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1468 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:37.813513 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4ad0c6e5-2db7-4808-8098-12da992864fd tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:37.815179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4ad0c6e5-2db7-4808-8098-12da992864fd tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:37.837082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ad0c6e5-2db7-4808-8098-12da992864fd tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:37.838077 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ad0c6e5-2db7-4808-8098-12da992864fd tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:37.839127 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ad0c6e5-2db7-4808-8098-12da992864fd tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:37.842369 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ad0c6e5-2db7-4808-8098-12da992864fd tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:37.843310 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ad0c6e5-2db7-4808-8098-12da992864fd tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:37.844069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ad0c6e5-2db7-4808-8098-12da992864fd tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:38.136526 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4ad0c6e5-2db7-4808-8098-12da992864fd tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:38.148743 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4ad0c6e5-2db7-4808-8098-12da992864fd tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1461 microversion: 2.1 time: 0.341022 Sep 24 20:55:38.149353 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 911/1827] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:37 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1461 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:38.178046 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-41c2d59d-2bce-4fdf-ab2c-f62d689a55da tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:38.180537 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-41c2d59d-2bce-4fdf-ab2c-f62d689a55da tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:38.200367 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-41c2d59d-2bce-4fdf-ab2c-f62d689a55da tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:38.200862 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-41c2d59d-2bce-4fdf-ab2c-f62d689a55da tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:38.210612 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-41c2d59d-2bce-4fdf-ab2c-f62d689a55da tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:38.211495 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-41c2d59d-2bce-4fdf-ab2c-f62d689a55da tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:38.211979 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-41c2d59d-2bce-4fdf-ab2c-f62d689a55da tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:38.212426 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-41c2d59d-2bce-4fdf-ab2c-f62d689a55da tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:38.668875 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-41c2d59d-2bce-4fdf-ab2c-f62d689a55da tempest-MigrationsAdminTest-82239000 tempest-MigrationsAdminTest-82239000-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1612 microversion: 2.1 time: 0.495852 Sep 24 20:55:38.671998 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 917/1828] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:38 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1612 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:38.707402 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d4491a3e-e7a1-4e7a-8d6e-cc5cea31ef36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:38.707911 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d4491a3e-e7a1-4e7a-8d6e-cc5cea31ef36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:38.718350 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d4491a3e-e7a1-4e7a-8d6e-cc5cea31ef36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:38.720007 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d4491a3e-e7a1-4e7a-8d6e-cc5cea31ef36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:38.720634 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d4491a3e-e7a1-4e7a-8d6e-cc5cea31ef36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:38.724398 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d4491a3e-e7a1-4e7a-8d6e-cc5cea31ef36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:38.725087 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d4491a3e-e7a1-4e7a-8d6e-cc5cea31ef36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:38.725702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d4491a3e-e7a1-4e7a-8d6e-cc5cea31ef36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:38.726552 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e93b9309-72e2-4094-9d9b-5eb2a0333f12 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-367234739", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "89b13b8f-db96-4ded-b022-c0f1faad59f4"}], "block_device_mapping_v2": [{"uuid": "b1d57646-064a-4739-a13c-b954f6f5cb19", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:55:38.801094 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d4491a3e-e7a1-4e7a-8d6e-cc5cea31ef36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:55:38.928134 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-e93b9309-72e2-4094-9d9b-5eb2a0333f12 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] validate_networks() for [('89b13b8f-db96-4ded-b022-c0f1faad59f4', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:55:39.056468 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d4491a3e-e7a1-4e7a-8d6e-cc5cea31ef36 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 204 len: 0 microversion: 2.1 time: 0.357788 Sep 24 20:55:39.057319 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 912/1829] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:55:38 2022] DELETE /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:55:39.335665 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3282d6f4-cfdb-431b-80ba-775e1ac586bc tempest-TenantUsagesNegativeTestJSON-2036482378 tempest-TenantUsagesNegativeTestJSON-2036482378-project-admin] 10.222.0.52 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-23T20%3A55%3A38.966166&end=2022-09-25T20%3A55%3A38.966166" status: 404 len: 112 microversion: - time: 0.276992 Sep 24 20:55:39.337085 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 913/1830] 10.222.0.52 () {58 vars in 1316 bytes} [Sat Sep 24 20:55:39 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-23T20%3A55%3A38.966166&end=2022-09-25T20%3A55%3A38.966166 => generated 112 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 24 20:55:39.346163 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a93dcff1-1e72-4816-9d25-6d2e10e701d2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:39.347992 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a93dcff1-1e72-4816-9d25-6d2e10e701d2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:39.356832 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a93dcff1-1e72-4816-9d25-6d2e10e701d2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:39.357802 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a93dcff1-1e72-4816-9d25-6d2e10e701d2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:39.359355 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a93dcff1-1e72-4816-9d25-6d2e10e701d2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:39.360711 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a93dcff1-1e72-4816-9d25-6d2e10e701d2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:39.361493 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a93dcff1-1e72-4816-9d25-6d2e10e701d2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:39.362848 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a93dcff1-1e72-4816-9d25-6d2e10e701d2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:40.237262 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a93dcff1-1e72-4816-9d25-6d2e10e701d2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:40.247652 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a93dcff1-1e72-4816-9d25-6d2e10e701d2 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1467 microversion: 2.1 time: 0.909224 Sep 24 20:55:40.248449 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 914/1831] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:39 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1467 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:40.253832 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3b8ebf77-67ae-4231-a280-dafc79975a57 tempest-TenantUsagesNegativeTestJSON-2036482378 tempest-TenantUsagesNegativeTestJSON-2036482378-project-admin] Calling method '.version_select at 0x7f4b1116f160>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:40.260541 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-3b8ebf77-67ae-4231-a280-dafc79975a57 tempest-TenantUsagesNegativeTestJSON-2036482378 tempest-TenantUsagesNegativeTestJSON-2036482378-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Sep 24 20:55:40.270890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3b8ebf77-67ae-4231-a280-dafc79975a57 tempest-TenantUsagesNegativeTestJSON-2036482378 tempest-TenantUsagesNegativeTestJSON-2036482378-project-admin] Request method failure captured: Sep 24 20:55:40.270890 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/os-simple-tenant-usage/d982e19aac5c41c0846e2e7b71c6d75a?start=2022-09-25T20%3A55%3A38.966166&end=2022-09-23T20%3A55%3A38.966166 HTTP/1.1 Sep 24 20:55:40.270890 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:55:40.270890 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:55:40.270890 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:55:40.270890 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:55:40.270890 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:55:40.270890 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:55:40.270890 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:55:40.270890 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:55:40.270890 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL27KR65LzEsgfF_7SO7pO0Lc8ut0eGLHMFJDw45Uf0F0KUACo3j-ryrnO7jnd_JkSMLnPzcTn-B44oIJFEl5jkadKiR-uapMVbNmdpsu2TU3FDrYaozBDNg_9239hzQq2pTixYChFv00wTaKt78id_X56Tnh3E7GpK6hSyHQ6r8UXFE Sep 24 20:55:40.270890 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:55:40.270890 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:55:40.270890 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:55:40.270890 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:55:40.270890 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:55:40.270890 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:55:40.270890 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 91c0d956ef0248bebbdb8e679d65b2b9 Sep 24 20:55:40.270890 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-2036482378 Sep 24 20:55:40.270890 ncdv-master-1 devstack@n-api.service[140516]: X-Role: admin,reader,member Sep 24 20:55:40.270890 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: admin,reader,member Sep 24 20:55:40.272639 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91c0d956ef0248bebbdb8e679d65b2b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_91c0d956ef0248bebbdb8e679d65b2b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/91c0d956ef0248bebbdb8e679d65b2b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91c0d956ef0248bebbdb8e679d65b2b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:55:40.272639 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-2036482378 Sep 24 20:55:40.272639 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 91c0d956ef0248bebbdb8e679d65b2b9 Sep 24 20:55:40.272639 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-2036482378 Sep 24 20:55:40.272639 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-TenantUsagesNegativeTestJSON-2036482378-project-admin Sep 24 20:55:40.272639 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:55:40.272639 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:55:40.272639 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 9e0531aad05d44c19884d3f12972e8c1 Sep 24 20:55:40.272639 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-2036482378-project-admin Sep 24 20:55:40.272639 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:55:40.272639 ncdv-master-1 devstack@n-api.service[140516]: exception: Invalid start time. The start time cannot occur after the end time. Sep 24 20:55:40.272639 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'd982e19aac5c41c0846e2e7b71c6d75a'} Sep 24 20:55:40.273990 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:55:40.273990 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:40.273990 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:40.273990 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:40.273990 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:55:40.273990 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:55:40.273990 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:55:40.273990 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:55:40.273990 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 24 20:55:40.273990 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:55:40.273990 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:55:40.273990 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:55:40.273990 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Sep 24 20:55:40.273990 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 24 20:55:40.273990 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Sep 24 20:55:40.273990 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Sep 24 20:55:40.273990 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Sep 24 20:55:40.273990 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 24 20:55:40.273990 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Sep 24 20:55:40.275758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:40.275758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:40.275758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:40.275758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:40.275758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:40.275758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:40.275758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:55:40.275758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:55:40.275758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Sep 24 20:55:40.275758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:40.277606 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3b8ebf77-67ae-4231-a280-dafc79975a57 tempest-TenantUsagesNegativeTestJSON-2036482378 tempest-TenantUsagesNegativeTestJSON-2036482378-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:55:40.278725 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3b8ebf77-67ae-4231-a280-dafc79975a57 tempest-TenantUsagesNegativeTestJSON-2036482378 tempest-TenantUsagesNegativeTestJSON-2036482378-project-admin] 10.222.0.52 "GET /compute/v2.1/os-simple-tenant-usage/d982e19aac5c41c0846e2e7b71c6d75a?start=2022-09-25T20%3A55%3A38.966166&end=2022-09-23T20%3A55%3A38.966166" status: 400 len: 111 microversion: 2.1 time: 0.029107 Sep 24 20:55:40.279759 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 915/1832] 10.222.0.52 () {58 vars in 1412 bytes} [Sat Sep 24 20:55:40 2022] GET /compute/v2.1/os-simple-tenant-usage/d982e19aac5c41c0846e2e7b71c6d75a?start=2022-09-25T20%3A55%3A38.966166&end=2022-09-23T20%3A55%3A38.966166 => generated 111 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 20:55:40.557171 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-e93b9309-72e2-4094-9d9b-5eb2a0333f12 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:55:40.558266 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-e93b9309-72e2-4094-9d9b-5eb2a0333f12 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:55:40.559153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-e93b9309-72e2-4094-9d9b-5eb2a0333f12 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:55:40.559807 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-e93b9309-72e2-4094-9d9b-5eb2a0333f12 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:55:40.560448 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-e93b9309-72e2-4094-9d9b-5eb2a0333f12 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:55:40.562455 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-10c4f240-e6cc-4af8-a549-e4d74304fdb7 tempest-TenantUsagesNegativeTestJSON-1512450258 tempest-TenantUsagesNegativeTestJSON-1512450258-project] Calling method '.version_select at 0x7f4b111cc820>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:40.567305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-10c4f240-e6cc-4af8-a549-e4d74304fdb7 tempest-TenantUsagesNegativeTestJSON-1512450258 tempest-TenantUsagesNegativeTestJSON-1512450258-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'b4f97d7719ae4acfb3e4c20a59cdc7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd982e19aac5c41c0846e2e7b71c6d75a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:40.571173 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-10c4f240-e6cc-4af8-a549-e4d74304fdb7 tempest-TenantUsagesNegativeTestJSON-1512450258 tempest-TenantUsagesNegativeTestJSON-1512450258-project] Request method failure captured: Sep 24 20:55:40.571173 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-23T20%3A55%3A38.966166&end=2022-09-25T20%3A55%3A38.966166&detailed=1 HTTP/1.1 Sep 24 20:55:40.571173 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:55:40.571173 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:55:40.571173 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:55:40.571173 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:55:40.571173 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:55:40.571173 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:55:40.571173 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:55:40.571173 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:55:40.571173 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL27JNklOJRcuFWuh7S-rwKxjzd63dQUk53BzI4XWQxtouLhqorov29EV_bmi877x6ER63xumjcfUIMKUHooN7z_1LCmHGgKUA9sVuxlt6CkkW9iG-F7Xr21NvYS-j1ThmM5XPJgPVgQ0jqaoIHzFcyvmRm9JpVE9EO7zwag6r3vKyhs Sep 24 20:55:40.571173 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:55:40.571173 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:55:40.571173 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:55:40.571173 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:55:40.571173 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:55:40.571173 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:55:40.571173 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: d982e19aac5c41c0846e2e7b71c6d75a Sep 24 20:55:40.571173 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1512450258 Sep 24 20:55:40.571173 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:55:40.571173 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:55:40.572637 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d982e19aac5c41c0846e2e7b71c6d75a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d982e19aac5c41c0846e2e7b71c6d75a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d982e19aac5c41c0846e2e7b71c6d75a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d982e19aac5c41c0846e2e7b71c6d75a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:55:40.572637 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1512450258 Sep 24 20:55:40.572637 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: d982e19aac5c41c0846e2e7b71c6d75a Sep 24 20:55:40.572637 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1512450258 Sep 24 20:55:40.572637 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-TenantUsagesNegativeTestJSON-1512450258-project Sep 24 20:55:40.572637 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:55:40.572637 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:55:40.572637 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: b4f97d7719ae4acfb3e4c20a59cdc7ab Sep 24 20:55:40.572637 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1512450258-project Sep 24 20:55:40.572637 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:55:40.572637 ncdv-master-1 devstack@n-api.service[140516]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 24 20:55:40.572637 ncdv-master-1 devstack@n-api.service[140516]: action_args: {} Sep 24 20:55:40.572637 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:55:40.573697 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:40.573697 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:40.573697 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:40.573697 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:55:40.573697 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:55:40.573697 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:55:40.573697 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:55:40.573697 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 24 20:55:40.573697 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:55:40.573697 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:55:40.573697 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:55:40.573697 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Sep 24 20:55:40.573697 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 24 20:55:40.573697 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Sep 24 20:55:40.573697 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Sep 24 20:55:40.573697 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 24 20:55:40.573697 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 24 20:55:40.573697 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 24 20:55:40.573697 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 24 20:55:40.574992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:55:40.574992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:55:40.574992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:55:40.574992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:55:40.574992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 24 20:55:40.574992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 24 20:55:40.574992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 24 20:55:40.574992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 24 20:55:40.574992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 24 20:55:40.574992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 24 20:55:40.574992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 24 20:55:40.574992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:40.574992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:40.574992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:40.574992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:40.574992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:40.574992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:40.574992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 24 20:55:40.574992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 24 20:55:40.577267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 24 20:55:40.577267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:40.579226 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-10c4f240-e6cc-4af8-a549-e4d74304fdb7 tempest-TenantUsagesNegativeTestJSON-1512450258 tempest-TenantUsagesNegativeTestJSON-1512450258-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:55:40.580993 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-10c4f240-e6cc-4af8-a549-e4d74304fdb7 tempest-TenantUsagesNegativeTestJSON-1512450258 tempest-TenantUsagesNegativeTestJSON-1512450258-project] 10.222.0.52 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-23T20%3A55%3A38.966166&end=2022-09-25T20%3A55%3A38.966166&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.295187 Sep 24 20:55:40.583218 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e93b9309-72e2-4094-9d9b-5eb2a0333f12 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:40.584544 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e93b9309-72e2-4094-9d9b-5eb2a0333f12 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:40.585636 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e93b9309-72e2-4094-9d9b-5eb2a0333f12 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:40.586143 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 916/1833] 10.222.0.52 () {58 vars in 1335 bytes} [Sat Sep 24 20:55:40 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-23T20%3A55%3A38.966166&end=2022-09-25T20%3A55%3A38.966166&detailed=1 => generated 123 bytes in 298 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:55:40.588527 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e93b9309-72e2-4094-9d9b-5eb2a0333f12 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:40.589480 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e93b9309-72e2-4094-9d9b-5eb2a0333f12 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:40.593205 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e93b9309-72e2-4094-9d9b-5eb2a0333f12 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:40.617316 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-e93b9309-72e2-4094-9d9b-5eb2a0333f12 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Getting quotas for project a2b7e30f79bf42e497c53c091ad0a106. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:55:40.624222 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-e93b9309-72e2-4094-9d9b-5eb2a0333f12 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Getting quotas for user 9c03c67e0c4c4de7a186f28ac10d0b92 and project a2b7e30f79bf42e497c53c091ad0a106. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:55:40.733396 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e93b9309-72e2-4094-9d9b-5eb2a0333f12 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:55:40.736050 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e93b9309-72e2-4094-9d9b-5eb2a0333f12 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b1d57646-064a-4739-a13c-b954f6f5cb19',volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:55:41.051828 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e93b9309-72e2-4094-9d9b-5eb2a0333f12 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.330656 Sep 24 20:55:41.053160 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 918/1834] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:55:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2333 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 24 20:55:41.066130 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0c9339d3-e37e-4839-ac26-0d85df1fe44b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:41.066884 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0c9339d3-e37e-4839-ac26-0d85df1fe44b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:41.273977 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e3809695-4801-4452-8509-18537120105f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:41.275037 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e3809695-4801-4452-8509-18537120105f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:41.288545 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0c9339d3-e37e-4839-ac26-0d85df1fe44b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:41.296786 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3809695-4801-4452-8509-18537120105f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:41.299692 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0c9339d3-e37e-4839-ac26-0d85df1fe44b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1052 microversion: 2.1 time: 0.235290 Sep 24 20:55:41.300193 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3809695-4801-4452-8509-18537120105f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:41.300812 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3809695-4801-4452-8509-18537120105f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:41.302523 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 917/1835] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:41 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1052 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:41.324840 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3809695-4801-4452-8509-18537120105f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:41.333095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3809695-4801-4452-8509-18537120105f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:41.333624 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3809695-4801-4452-8509-18537120105f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:42.326276 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a22d48cd-29aa-4b82-bc62-7cead0e9f948 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:42.326945 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a22d48cd-29aa-4b82-bc62-7cead0e9f948 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:42.329575 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=4 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:55:42.360027 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a22d48cd-29aa-4b82-bc62-7cead0e9f948 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:42.360706 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a22d48cd-29aa-4b82-bc62-7cead0e9f948 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:42.361486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a22d48cd-29aa-4b82-bc62-7cead0e9f948 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:42.362277 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a22d48cd-29aa-4b82-bc62-7cead0e9f948 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:42.363028 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a22d48cd-29aa-4b82-bc62-7cead0e9f948 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:42.364543 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a22d48cd-29aa-4b82-bc62-7cead0e9f948 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:42.460398 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e3809695-4801-4452-8509-18537120105f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:42.483270 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e3809695-4801-4452-8509-18537120105f tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1467 microversion: 2.1 time: 1.215508 Sep 24 20:55:42.491052 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 919/1836] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:41 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1467 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:42.527822 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a22d48cd-29aa-4b82-bc62-7cead0e9f948 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:42.539374 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a22d48cd-29aa-4b82-bc62-7cead0e9f948 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1150 microversion: 2.1 time: 0.217894 Sep 24 20:55:42.540594 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 918/1837] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:42 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1150 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:55:42.899090 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-6710f759-383f-47d5-928f-53f4849e7206 req-b1c8c54e-7ca0-4b03-a43a-2edf73778f4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9425eeec-a7b4-4926-a2f3-80dd47eb9e0c", "name": "network-vif-deleted", "tag": "7138905c-dbe0-4d9c-83c3-21fb5d346268"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:55:42.947141 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6710f759-383f-47d5-928f-53f4849e7206 req-b1c8c54e-7ca0-4b03-a43a-2edf73778f4d service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:42.947748 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6710f759-383f-47d5-928f-53f4849e7206 req-b1c8c54e-7ca0-4b03-a43a-2edf73778f4d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:42.948932 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6710f759-383f-47d5-928f-53f4849e7206 req-b1c8c54e-7ca0-4b03-a43a-2edf73778f4d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:42.992150 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-6710f759-383f-47d5-928f-53f4849e7206 req-b1c8c54e-7ca0-4b03-a43a-2edf73778f4d service nova] Creating event network-vif-deleted:7138905c-dbe0-4d9c-83c3-21fb5d346268 for instance 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c on nch2-master-1 Sep 24 20:55:43.004957 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-6710f759-383f-47d5-928f-53f4849e7206 req-b1c8c54e-7ca0-4b03-a43a-2edf73778f4d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111242 Sep 24 20:55:43.006405 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 920/1838] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:55:43.513615 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-138d0cc3-d338-461f-8529-e0d314434b6a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:43.514413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-138d0cc3-d338-461f-8529-e0d314434b6a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:43.521845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-138d0cc3-d338-461f-8529-e0d314434b6a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:43.522329 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-138d0cc3-d338-461f-8529-e0d314434b6a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:43.532945 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-138d0cc3-d338-461f-8529-e0d314434b6a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:43.535403 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-138d0cc3-d338-461f-8529-e0d314434b6a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:43.537629 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-138d0cc3-d338-461f-8529-e0d314434b6a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:43.538290 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-138d0cc3-d338-461f-8529-e0d314434b6a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:43.564097 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-05a39128-644f-4203-80dc-d6420a36c960 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:43.564854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-05a39128-644f-4203-80dc-d6420a36c960 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:43.576117 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05a39128-644f-4203-80dc-d6420a36c960 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:43.585827 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05a39128-644f-4203-80dc-d6420a36c960 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:43.587038 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05a39128-644f-4203-80dc-d6420a36c960 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:43.589980 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05a39128-644f-4203-80dc-d6420a36c960 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:43.591297 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05a39128-644f-4203-80dc-d6420a36c960 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:43.591924 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05a39128-644f-4203-80dc-d6420a36c960 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:43.624243 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-138d0cc3-d338-461f-8529-e0d314434b6a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:43.625325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-138d0cc3-d338-461f-8529-e0d314434b6a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:43.632280 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-138d0cc3-d338-461f-8529-e0d314434b6a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:43.632908 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-138d0cc3-d338-461f-8529-e0d314434b6a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lazy-loading 'fault' on Instance uuid 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:55:43.920495 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-138d0cc3-d338-461f-8529-e0d314434b6a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:43.934021 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-05a39128-644f-4203-80dc-d6420a36c960 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:43.935889 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-138d0cc3-d338-461f-8529-e0d314434b6a tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 200 len: 1302 microversion: 2.1 time: 0.422237 Sep 24 20:55:43.943286 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 919/1839] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:43 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 1302 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:43.947367 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-05a39128-644f-4203-80dc-d6420a36c960 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1168 microversion: 2.1 time: 0.387795 Sep 24 20:55:43.964424 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 921/1840] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:43 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1168 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:44.966025 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-de4177bb-7f37-4fb5-904c-b953a8c252e6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:44.967205 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-de4177bb-7f37-4fb5-904c-b953a8c252e6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:44.977185 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-de4177bb-7f37-4fb5-904c-b953a8c252e6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:44.984826 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-de4177bb-7f37-4fb5-904c-b953a8c252e6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:44.986294 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-de4177bb-7f37-4fb5-904c-b953a8c252e6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:44.988451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-de4177bb-7f37-4fb5-904c-b953a8c252e6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:44.989332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-de4177bb-7f37-4fb5-904c-b953a8c252e6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:44.991772 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-de4177bb-7f37-4fb5-904c-b953a8c252e6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:44.993337 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a87074c6-0a89-4036-ab25-5bb5791607ea tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:44.994098 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a87074c6-0a89-4036-ab25-5bb5791607ea tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:45.009274 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a87074c6-0a89-4036-ab25-5bb5791607ea tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:45.010561 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a87074c6-0a89-4036-ab25-5bb5791607ea tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:45.011319 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a87074c6-0a89-4036-ab25-5bb5791607ea tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:45.013819 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a87074c6-0a89-4036-ab25-5bb5791607ea tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:45.015752 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a87074c6-0a89-4036-ab25-5bb5791607ea tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:45.018772 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a87074c6-0a89-4036-ab25-5bb5791607ea tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:45.035443 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-de4177bb-7f37-4fb5-904c-b953a8c252e6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] HTTP exception thrown: Instance 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c could not be found. Sep 24 20:55:45.045118 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-de4177bb-7f37-4fb5-904c-b953a8c252e6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Request method failure captured: Sep 24 20:55:45.045118 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c HTTP/1.1 Sep 24 20:55:45.045118 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:55:45.045118 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:55:45.045118 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:55:45.045118 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:55:45.045118 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:55:45.045118 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:55:45.045118 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:55:45.045118 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:55:45.045118 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL22AH--cPMnXJJd4QEnLriiYfB-w2A-yE5jCCcHhGxiq35NRxCuRY3j9uVE-aco-xiGNm5JbBY89pNNBwEc_CSyxIUrHMKp_PTqtE3xF_aDC7uBbmtCAbwdBtpCdOHudl2IaI-pxz1mpiD8H1-ZYDP3b2uTg8cCogwfCwUryxb4V3gs Sep 24 20:55:45.045118 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:55:45.045118 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:55:45.045118 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:55:45.045118 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:55:45.045118 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:55:45.045118 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:55:45.045118 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 349d3aa8627644d59867a744695f2579 Sep 24 20:55:45.045118 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-MigrationsAdminTest-1468292266 Sep 24 20:55:45.045118 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:55:45.045118 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:55:45.047036 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/349d3aa8627644d59867a744695f2579"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_349d3aa8627644d59867a744695f2579"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/349d3aa8627644d59867a744695f2579"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/349d3aa8627644d59867a744695f2579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:55:45.047036 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-MigrationsAdminTest-1468292266 Sep 24 20:55:45.047036 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 349d3aa8627644d59867a744695f2579 Sep 24 20:55:45.047036 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-MigrationsAdminTest-1468292266 Sep 24 20:55:45.047036 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-MigrationsAdminTest-1468292266-project Sep 24 20:55:45.047036 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:55:45.047036 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:55:45.047036 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 93982876b1e24efb8ffa8c009532343a Sep 24 20:55:45.047036 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-MigrationsAdminTest-1468292266-project Sep 24 20:55:45.047036 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:55:45.047036 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c could not be found. Sep 24 20:55:45.047036 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '9425eeec-a7b4-4926-a2f3-80dd47eb9e0c'} Sep 24 20:55:45.047850 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:55:45.047850 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:45.047850 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:55:45.047850 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:55:45.047850 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:55:45.047850 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:55:45.047850 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:55:45.047850 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:55:45.047850 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:55:45.047850 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:55:45.047850 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c could not be found. Sep 24 20:55:45.047850 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:45.047850 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:45.047850 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:45.047850 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:45.047850 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:45.047850 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:45.047850 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:55:45.047850 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:55:45.047850 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:55:45.049155 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:55:45.049155 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:55:45.049155 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:55:45.049155 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:55:45.049155 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:55:45.049155 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:55:45.049155 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:55:45.049155 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c could not be found. Sep 24 20:55:45.049155 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:45.049155 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:45.049155 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:45.049155 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:45.049155 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:45.049155 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:45.049155 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:55:45.049155 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:55:45.049155 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c could not be found. Sep 24 20:55:45.049155 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:45.053484 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-de4177bb-7f37-4fb5-904c-b953a8c252e6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Returning 404 to user: Instance 9425eeec-a7b4-4926-a2f3-80dd47eb9e0c could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:55:45.059716 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-de4177bb-7f37-4fb5-904c-b953a8c252e6 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c" status: 404 len: 111 microversion: 2.1 time: 0.098361 Sep 24 20:55:45.066628 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 920/1841] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:44 2022] GET /compute/v2.1/servers/9425eeec-a7b4-4926-a2f3-80dd47eb9e0c => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:55:45.076364 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9c69c993-4182-44c5-8574-3f9180f096e0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:45.081378 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9c69c993-4182-44c5-8574-3f9180f096e0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:45.093070 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c69c993-4182-44c5-8574-3f9180f096e0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:45.093909 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c69c993-4182-44c5-8574-3f9180f096e0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:45.099894 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c69c993-4182-44c5-8574-3f9180f096e0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:45.100924 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c69c993-4182-44c5-8574-3f9180f096e0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:45.101719 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c69c993-4182-44c5-8574-3f9180f096e0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:45.102344 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c69c993-4182-44c5-8574-3f9180f096e0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:45.169114 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9c69c993-4182-44c5-8574-3f9180f096e0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:55:45.344914 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9c69c993-4182-44c5-8574-3f9180f096e0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "DELETE /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 204 len: 0 microversion: 2.1 time: 0.272545 Sep 24 20:55:45.345788 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 921/1842] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:55:45 2022] DELETE /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:55:45.356759 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4a2c7b54-210d-4dea-9b75-6c4d82d98644 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:45.359598 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4a2c7b54-210d-4dea-9b75-6c4d82d98644 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:45.373793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a2c7b54-210d-4dea-9b75-6c4d82d98644 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:45.389144 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a2c7b54-210d-4dea-9b75-6c4d82d98644 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:45.397638 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a2c7b54-210d-4dea-9b75-6c4d82d98644 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:45.398818 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a2c7b54-210d-4dea-9b75-6c4d82d98644 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:45.399455 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a2c7b54-210d-4dea-9b75-6c4d82d98644 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:45.400924 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a2c7b54-210d-4dea-9b75-6c4d82d98644 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:45.579821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a87074c6-0a89-4036-ab25-5bb5791607ea tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:45.598945 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a87074c6-0a89-4036-ab25-5bb5791607ea tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1168 microversion: 2.1 time: 0.610126 Sep 24 20:55:45.600158 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 922/1843] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:44 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1168 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:55:46.652065 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4a2c7b54-210d-4dea-9b75-6c4d82d98644 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:46.669157 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4a2c7b54-210d-4dea-9b75-6c4d82d98644 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1533 microversion: 2.1 time: 1.315734 Sep 24 20:55:46.670420 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 922/1844] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:45 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1533 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:55:47.147479 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c1fa1400-b63c-4ab8-bbad-974b99ffdc8e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:47.149598 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c1fa1400-b63c-4ab8-bbad-974b99ffdc8e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:47.157771 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1fa1400-b63c-4ab8-bbad-974b99ffdc8e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:47.158622 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1fa1400-b63c-4ab8-bbad-974b99ffdc8e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:47.159521 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1fa1400-b63c-4ab8-bbad-974b99ffdc8e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:47.160473 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1fa1400-b63c-4ab8-bbad-974b99ffdc8e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:47.161178 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1fa1400-b63c-4ab8-bbad-974b99ffdc8e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:47.161858 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1fa1400-b63c-4ab8-bbad-974b99ffdc8e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:47.694134 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5a6f5323-b4fd-456d-899c-d63fbb10edda tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:47.700599 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5a6f5323-b4fd-456d-899c-d63fbb10edda tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:47.718972 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5a6f5323-b4fd-456d-899c-d63fbb10edda tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:47.720898 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5a6f5323-b4fd-456d-899c-d63fbb10edda tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:47.721373 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5a6f5323-b4fd-456d-899c-d63fbb10edda tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:47.735664 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5a6f5323-b4fd-456d-899c-d63fbb10edda tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:47.736193 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5a6f5323-b4fd-456d-899c-d63fbb10edda tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:47.736648 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5a6f5323-b4fd-456d-899c-d63fbb10edda tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:47.772702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:55:48.301256 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c1fa1400-b63c-4ab8-bbad-974b99ffdc8e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:48.310017 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c1fa1400-b63c-4ab8-bbad-974b99ffdc8e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1198 microversion: 2.1 time: 1.689540 Sep 24 20:55:48.311321 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 923/1845] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:46 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1198 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:48.644962 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5a6f5323-b4fd-456d-899c-d63fbb10edda tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:48.654703 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5a6f5323-b4fd-456d-899c-d63fbb10edda tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1533 microversion: 2.1 time: 0.965061 Sep 24 20:55:48.660847 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 923/1846] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:47 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1533 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:55:49.337997 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f276fd54-d847-42a5-9149-5a7457c408ec tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:49.338660 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f276fd54-d847-42a5-9149-5a7457c408ec tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:49.356948 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f276fd54-d847-42a5-9149-5a7457c408ec tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:49.360817 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f276fd54-d847-42a5-9149-5a7457c408ec tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:49.364706 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f276fd54-d847-42a5-9149-5a7457c408ec tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:49.368977 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f276fd54-d847-42a5-9149-5a7457c408ec tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:49.368977 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f276fd54-d847-42a5-9149-5a7457c408ec tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:49.368977 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f276fd54-d847-42a5-9149-5a7457c408ec tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:49.684579 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-97a9f001-ad35-480b-be96-3f0bde4ea96d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:49.685093 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-97a9f001-ad35-480b-be96-3f0bde4ea96d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:49.703756 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-97a9f001-ad35-480b-be96-3f0bde4ea96d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:49.704759 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-97a9f001-ad35-480b-be96-3f0bde4ea96d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:49.706999 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-97a9f001-ad35-480b-be96-3f0bde4ea96d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:49.708015 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-97a9f001-ad35-480b-be96-3f0bde4ea96d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:49.709641 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-97a9f001-ad35-480b-be96-3f0bde4ea96d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:49.712909 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-97a9f001-ad35-480b-be96-3f0bde4ea96d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:50.008944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f276fd54-d847-42a5-9149-5a7457c408ec tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:50.019124 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f276fd54-d847-42a5-9149-5a7457c408ec tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1198 microversion: 2.1 time: 0.684978 Sep 24 20:55:50.022007 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 924/1847] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:49 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1198 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:50.083286 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-97a9f001-ad35-480b-be96-3f0bde4ea96d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:50.103476 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-97a9f001-ad35-480b-be96-3f0bde4ea96d tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1491 microversion: 2.1 time: 0.430008 Sep 24 20:55:50.104447 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 924/1848] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:49 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1491 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:55:50.633953 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:55:50.647155 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=6 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:55:50.888821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-21eb4b0c-af3b-4dd9-ac79-19715273f962 tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] Action: 'create', calling method: .version_select at 0x7f4b1104c820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1790264666", "description": "tempest-description-337941306"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:55:51.047127 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-338b1b5f-54e1-4870-b2bd-b1b18d650ca8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:51.048497 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-338b1b5f-54e1-4870-b2bd-b1b18d650ca8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:51.065118 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-338b1b5f-54e1-4870-b2bd-b1b18d650ca8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:51.067593 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-338b1b5f-54e1-4870-b2bd-b1b18d650ca8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:51.069596 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-338b1b5f-54e1-4870-b2bd-b1b18d650ca8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:51.071954 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-338b1b5f-54e1-4870-b2bd-b1b18d650ca8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:51.075974 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-338b1b5f-54e1-4870-b2bd-b1b18d650ca8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:51.076670 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-338b1b5f-54e1-4870-b2bd-b1b18d650ca8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:51.296517 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:55:52.346070 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-338b1b5f-54e1-4870-b2bd-b1b18d650ca8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:52.367558 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-338b1b5f-54e1-4870-b2bd-b1b18d650ca8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1198 microversion: 2.1 time: 1.328259 Sep 24 20:55:52.370778 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 925/1849] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:51 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1198 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:55:52.383461 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-87b17378-69f5-4fd7-9667-d1d1f58e2b02 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:52.384528 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-87b17378-69f5-4fd7-9667-d1d1f58e2b02 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:52.417574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-87b17378-69f5-4fd7-9667-d1d1f58e2b02 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:52.418146 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-87b17378-69f5-4fd7-9667-d1d1f58e2b02 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:52.418840 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-87b17378-69f5-4fd7-9667-d1d1f58e2b02 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:52.419589 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-87b17378-69f5-4fd7-9667-d1d1f58e2b02 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:52.420143 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-87b17378-69f5-4fd7-9667-d1d1f58e2b02 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:52.420965 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-87b17378-69f5-4fd7-9667-d1d1f58e2b02 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:52.499986 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-87b17378-69f5-4fd7-9667-d1d1f58e2b02 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:52.500505 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-87b17378-69f5-4fd7-9667-d1d1f58e2b02 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:52.502101 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-87b17378-69f5-4fd7-9667-d1d1f58e2b02 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:52.502738 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-87b17378-69f5-4fd7-9667-d1d1f58e2b02 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lazy-loading 'fault' on Instance uuid 684811fb-a8ce-497a-a8f2-c66d6e4512bd {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:55:52.700921 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-87b17378-69f5-4fd7-9667-d1d1f58e2b02 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:52.717696 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-87b17378-69f5-4fd7-9667-d1d1f58e2b02 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 200 len: 1369 microversion: 2.1 time: 0.344518 Sep 24 20:55:52.727560 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 926/1850] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:52 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 1369 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:52.736205 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-6da7d491-284a-45e3-aafa-23d26739fdeb req-8ee8c6a6-33ad-4307-8f63-df8bf22e91c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "684811fb-a8ce-497a-a8f2-c66d6e4512bd", "name": "network-vif-deleted", "tag": "f1619055-c388-4c6a-ae4a-12376117a1fd"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:55:52.800789 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-6da7d491-284a-45e3-aafa-23d26739fdeb req-8ee8c6a6-33ad-4307-8f63-df8bf22e91c6 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:52.805468 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-6da7d491-284a-45e3-aafa-23d26739fdeb req-8ee8c6a6-33ad-4307-8f63-df8bf22e91c6 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:52.811988 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-6da7d491-284a-45e3-aafa-23d26739fdeb req-8ee8c6a6-33ad-4307-8f63-df8bf22e91c6 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:52.842404 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-21eb4b0c-af3b-4dd9-ac79-19715273f962 tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 2.216525 Sep 24 20:55:52.843257 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 925/1851] 10.222.0.52 () {60 vars in 1180 bytes} [Sat Sep 24 20:55:50 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 2219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:55:52.863068 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-43575e41-dbc2-4eae-8f53-17475c0da68c tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] Action: 'create', calling method: .version_select at 0x7f4b1100a790>, body: {"security_group_rule": {"parent_group_id": "7ab16b2a-051a-448f-b9d3-d48192bcb23f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:55:52.893053 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-6da7d491-284a-45e3-aafa-23d26739fdeb req-8ee8c6a6-33ad-4307-8f63-df8bf22e91c6 service nova] Creating event network-vif-deleted:f1619055-c388-4c6a-ae4a-12376117a1fd for instance 684811fb-a8ce-497a-a8f2-c66d6e4512bd on nch1-master-1 Sep 24 20:55:52.902993 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-6da7d491-284a-45e3-aafa-23d26739fdeb req-8ee8c6a6-33ad-4307-8f63-df8bf22e91c6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171451 Sep 24 20:55:52.904118 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 927/1852] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:55:53.395219 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-84d58ee6-4c41-4d4c-8a0b-0d735485537f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:53.396928 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-84d58ee6-4c41-4d4c-8a0b-0d735485537f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:53.416870 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-84d58ee6-4c41-4d4c-8a0b-0d735485537f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:53.420833 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-84d58ee6-4c41-4d4c-8a0b-0d735485537f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:53.421624 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-84d58ee6-4c41-4d4c-8a0b-0d735485537f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:53.426611 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-84d58ee6-4c41-4d4c-8a0b-0d735485537f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:53.428760 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-84d58ee6-4c41-4d4c-8a0b-0d735485537f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:53.429630 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-84d58ee6-4c41-4d4c-8a0b-0d735485537f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:53.559209 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-43575e41-dbc2-4eae-8f53-17475c0da68c tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.702325 Sep 24 20:55:53.569598 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 926/1853] 10.222.0.52 () {60 vars in 1195 bytes} [Sat Sep 24 20:55:52 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:55:53.575592 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c1c184a3-6cb2-48ba-a0ea-7a99c5e496f0 tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] Action: 'create', calling method: .version_select at 0x7f4b10f5a9d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1846061656", "description": "tempest-description-1010744634"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:55:53.994818 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-84d58ee6-4c41-4d4c-8a0b-0d735485537f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:54.005807 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-84d58ee6-4c41-4d4c-8a0b-0d735485537f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1198 microversion: 2.1 time: 0.616749 Sep 24 20:55:54.011739 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 928/1854] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:53 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1198 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:55:54.016645 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-291bd95b-38b4-4b1c-a44e-599d8dfdc6a9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:54.017274 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-291bd95b-38b4-4b1c-a44e-599d8dfdc6a9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: 684811fb-a8ce-497a-a8f2-c66d6e4512bd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:54.043107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-291bd95b-38b4-4b1c-a44e-599d8dfdc6a9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:54.043667 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-291bd95b-38b4-4b1c-a44e-599d8dfdc6a9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:54.044116 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-291bd95b-38b4-4b1c-a44e-599d8dfdc6a9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:54.044846 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-291bd95b-38b4-4b1c-a44e-599d8dfdc6a9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:54.045313 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-291bd95b-38b4-4b1c-a44e-599d8dfdc6a9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:54.045743 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-291bd95b-38b4-4b1c-a44e-599d8dfdc6a9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:54.079293 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-291bd95b-38b4-4b1c-a44e-599d8dfdc6a9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] HTTP exception thrown: Instance 684811fb-a8ce-497a-a8f2-c66d6e4512bd could not be found. Sep 24 20:55:54.081443 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-291bd95b-38b4-4b1c-a44e-599d8dfdc6a9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Request method failure captured: Sep 24 20:55:54.081443 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd HTTP/1.1 Sep 24 20:55:54.081443 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:55:54.081443 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:55:54.081443 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:55:54.081443 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:55:54.081443 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:55:54.081443 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:55:54.081443 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:55:54.081443 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:55:54.081443 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL22AH--cPMnXJJd4QEnLriiYfB-w2A-yE5jCCcHhGxiq35NRxCuRY3j9uVE-aco-xiGNm5JbBY89pNNBwEc_CSyxIUrHMKp_PTqtE3xF_aDC7uBbmtCAbwdBtpCdOHudl2IaI-pxz1mpiD8H1-ZYDP3b2uTg8cCogwfCwUryxb4V3gs Sep 24 20:55:54.081443 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:55:54.081443 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:55:54.081443 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:55:54.081443 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:55:54.081443 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:55:54.081443 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:55:54.081443 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 349d3aa8627644d59867a744695f2579 Sep 24 20:55:54.081443 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-MigrationsAdminTest-1468292266 Sep 24 20:55:54.081443 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:55:54.081443 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:55:54.083400 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/349d3aa8627644d59867a744695f2579"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_349d3aa8627644d59867a744695f2579"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/349d3aa8627644d59867a744695f2579"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/349d3aa8627644d59867a744695f2579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:55:54.083400 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-MigrationsAdminTest-1468292266 Sep 24 20:55:54.083400 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 349d3aa8627644d59867a744695f2579 Sep 24 20:55:54.083400 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-MigrationsAdminTest-1468292266 Sep 24 20:55:54.083400 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-MigrationsAdminTest-1468292266-project Sep 24 20:55:54.083400 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:55:54.083400 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:55:54.083400 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 93982876b1e24efb8ffa8c009532343a Sep 24 20:55:54.083400 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-MigrationsAdminTest-1468292266-project Sep 24 20:55:54.083400 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:55:54.083400 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 684811fb-a8ce-497a-a8f2-c66d6e4512bd could not be found. Sep 24 20:55:54.083400 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '684811fb-a8ce-497a-a8f2-c66d6e4512bd'} Sep 24 20:55:54.084355 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:55:54.084355 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:54.084355 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:55:54.084355 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:55:54.084355 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:55:54.084355 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:55:54.084355 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:55:54.084355 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:55:54.084355 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:55:54.084355 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:55:54.084355 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 684811fb-a8ce-497a-a8f2-c66d6e4512bd could not be found. Sep 24 20:55:54.084355 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:54.084355 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:54.084355 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:54.084355 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:54.084355 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:54.084355 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:54.084355 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:55:54.084355 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:55:54.084355 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:55:54.085944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:55:54.085944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:55:54.085944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:55:54.085944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:55:54.085944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:55:54.085944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:55:54.085944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:55:54.085944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 684811fb-a8ce-497a-a8f2-c66d6e4512bd could not be found. Sep 24 20:55:54.085944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:54.085944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:54.085944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:54.085944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:54.085944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:54.085944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:54.085944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:55:54.085944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:55:54.085944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 684811fb-a8ce-497a-a8f2-c66d6e4512bd could not be found. Sep 24 20:55:54.085944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:55:54.087439 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-291bd95b-38b4-4b1c-a44e-599d8dfdc6a9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Returning 404 to user: Instance 684811fb-a8ce-497a-a8f2-c66d6e4512bd could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:55:54.098027 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c1c184a3-6cb2-48ba-a0ea-7a99c5e496f0 tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.526664 Sep 24 20:55:54.100536 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-291bd95b-38b4-4b1c-a44e-599d8dfdc6a9 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd" status: 404 len: 111 microversion: 2.1 time: 0.082676 Sep 24 20:55:54.100733 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 927/1855] 10.222.0.52 () {60 vars in 1180 bytes} [Sat Sep 24 20:55:53 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:55:54.102017 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 929/1856] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:54 2022] GET /compute/v2.1/servers/684811fb-a8ce-497a-a8f2-c66d6e4512bd => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:55:54.115351 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c51eb80d-1340-47e9-9bf6-71efc3051d48 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '.version_select at 0x7f4b111cc9d0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:54.154383 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c51eb80d-1340-47e9-9bf6-71efc3051d48 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2025347422" status: 202 len: 0 microversion: 2.1 time: 0.047560 Sep 24 20:55:54.156021 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 930/1857] 10.222.0.52 () {58 vars in 1221 bytes} [Sat Sep 24 20:55:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2025347422 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:55:54.179543 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-440bb57b-22cb-48d5-8fc0-6df6732f5d97 tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] Action: 'create', calling method: .version_select at 0x7f4b0c97b430>, body: {"security_group_rule": {"parent_group_id": "788c6182-6690-4442-ac23-d7a372ce5a2e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:55:54.208488 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-acb5ef11-cc01-43ec-a230-b35e5de7190d tempest-SecurityGroupsNegativeTestJSON-1017699641 tempest-SecurityGroupsNegativeTestJSON-1017699641-project] Calling method '.version_select at 0x7f4b1104cd30>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:54.294895 ncdv-master-1 devstack@n-api.service[140517]: DEBUG neutronclient.v2_0.client [None req-acb5ef11-cc01-43ec-a230-b35e5de7190d tempest-SecurityGroupsNegativeTestJSON-1017699641 tempest-SecurityGroupsNegativeTestJSON-1017699641-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a7f4231c-74a5-43ae-9d5b-c90698c6d548 does not exist", "detail": ""}} {{(pid=140517) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 24 20:55:54.295575 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.security_group_api [None req-acb5ef11-cc01-43ec-a230-b35e5de7190d tempest-SecurityGroupsNegativeTestJSON-1017699641 tempest-SecurityGroupsNegativeTestJSON-1017699641-project] Neutron security group a7f4231c-74a5-43ae-9d5b-c90698c6d548 not found {{(pid=140517) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 24 20:55:54.296115 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-acb5ef11-cc01-43ec-a230-b35e5de7190d tempest-SecurityGroupsNegativeTestJSON-1017699641 tempest-SecurityGroupsNegativeTestJSON-1017699641-project] HTTP exception thrown: Security group a7f4231c-74a5-43ae-9d5b-c90698c6d548 does not exist Sep 24 20:55:54.296115 ncdv-master-1 devstack@n-api.service[140517]: Neutron server returns request_ids: ['req-1d7b5848-3f00-43fe-8238-ec4c33e8394a'] Sep 24 20:55:54.322113 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-acb5ef11-cc01-43ec-a230-b35e5de7190d tempest-SecurityGroupsNegativeTestJSON-1017699641 tempest-SecurityGroupsNegativeTestJSON-1017699641-project] Request method failure captured: Sep 24 20:55:54.322113 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/os-security-groups/a7f4231c-74a5-43ae-9d5b-c90698c6d548 HTTP/1.1 Sep 24 20:55:54.322113 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:55:54.322113 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:55:54.322113 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:55:54.322113 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:55:54.322113 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:55:54.322113 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:55:54.322113 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:55:54.322113 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:55:54.322113 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL27Zxe0701BBt0mZM6QsjWhwCrWAxtlUtK52EaGgjxSMLnOfvoDuOCOrQAwCNi0QvsydLBfAxkSD0Dv4Wxi94c73uwSpO4XjyNbHNTsrVy-h1bTVucewCYaOWu99b_ykiAJFWGif29StDOCSU5syT8hxk4_q2VI5yuugIDTVtojwmpY Sep 24 20:55:54.322113 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:55:54.322113 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:55:54.322113 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:55:54.322113 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:55:54.322113 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:55:54.322113 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:55:54.322113 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: a1d9e5ac0e5f4e8598a63c55c639ffaf Sep 24 20:55:54.322113 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1017699641 Sep 24 20:55:54.322113 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:55:54.322113 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:55:54.323894 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a1d9e5ac0e5f4e8598a63c55c639ffaf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a1d9e5ac0e5f4e8598a63c55c639ffaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a1d9e5ac0e5f4e8598a63c55c639ffaf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a1d9e5ac0e5f4e8598a63c55c639ffaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:55:54.323894 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1017699641 Sep 24 20:55:54.323894 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: a1d9e5ac0e5f4e8598a63c55c639ffaf Sep 24 20:55:54.323894 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1017699641 Sep 24 20:55:54.323894 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-SecurityGroupsNegativeTestJSON-1017699641-project Sep 24 20:55:54.323894 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:55:54.323894 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:55:54.323894 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 6453a6150dcc44bb94c257c6c7666d48 Sep 24 20:55:54.323894 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1017699641-project Sep 24 20:55:54.323894 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 20:55:54.323894 ncdv-master-1 devstack@n-api.service[140517]: exception: Security group a7f4231c-74a5-43ae-9d5b-c90698c6d548 does not exist Sep 24 20:55:54.323894 ncdv-master-1 devstack@n-api.service[140517]: Neutron server returns request_ids: ['req-1d7b5848-3f00-43fe-8238-ec4c33e8394a'] Sep 24 20:55:54.323894 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'a7f4231c-74a5-43ae-9d5b-c90698c6d548'} Sep 24 20:55:54.324994 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:55:54.324994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:54.324994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 24 20:55:54.324994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 24 20:55:54.324994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:55:54.324994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:55:54.324994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 24 20:55:54.324994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 24 20:55:54.324994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:55:54.324994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:55:54.324994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 24 20:55:54.324994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 24 20:55:54.324994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:55:54.324994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:55:54.324994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 24 20:55:54.324994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 24 20:55:54.324994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:55:54.324994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:55:54.324994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 24 20:55:54.326997 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 24 20:55:54.326997 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:55:54.326997 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:55:54.326997 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 24 20:55:54.326997 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 24 20:55:54.326997 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 24 20:55:54.326997 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 24 20:55:54.326997 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a7f4231c-74a5-43ae-9d5b-c90698c6d548 does not exist Sep 24 20:55:54.326997 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d7b5848-3f00-43fe-8238-ec4c33e8394a'] Sep 24 20:55:54.326997 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:54.326997 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:54.326997 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:54.326997 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:54.326997 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 24 20:55:54.326997 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 24 20:55:54.326997 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 24 20:55:54.326997 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 24 20:55:54.326997 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a7f4231c-74a5-43ae-9d5b-c90698c6d548 does not exist Sep 24 20:55:54.328542 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d7b5848-3f00-43fe-8238-ec4c33e8394a'] Sep 24 20:55:54.328542 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:54.328542 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:54.328542 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:54.328542 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:54.328542 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:54.328542 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:54.328542 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:55:54.328542 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:55:54.328542 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:55:54.328542 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:55:54.328542 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:55:54.328542 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:55:54.328542 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 24 20:55:54.328542 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 24 20:55:54.328542 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a7f4231c-74a5-43ae-9d5b-c90698c6d548 does not exist Sep 24 20:55:54.328542 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d7b5848-3f00-43fe-8238-ec4c33e8394a'] Sep 24 20:55:54.328542 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:54.328542 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:54.328542 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:54.328542 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:54.330333 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:54.330333 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:54.330333 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:55:54.330333 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:55:54.330333 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a7f4231c-74a5-43ae-9d5b-c90698c6d548 does not exist Sep 24 20:55:54.330333 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d7b5848-3f00-43fe-8238-ec4c33e8394a'] Sep 24 20:55:54.330333 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:54.335994 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-acb5ef11-cc01-43ec-a230-b35e5de7190d tempest-SecurityGroupsNegativeTestJSON-1017699641 tempest-SecurityGroupsNegativeTestJSON-1017699641-project] Returning 404 to user: Security group a7f4231c-74a5-43ae-9d5b-c90698c6d548 does not exist Sep 24 20:55:54.335994 ncdv-master-1 devstack@n-api.service[140517]: Neutron server returns request_ids: ['req-1d7b5848-3f00-43fe-8238-ec4c33e8394a'] {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:55:54.338424 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-acb5ef11-cc01-43ec-a230-b35e5de7190d tempest-SecurityGroupsNegativeTestJSON-1017699641 tempest-SecurityGroupsNegativeTestJSON-1017699641-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/a7f4231c-74a5-43ae-9d5b-c90698c6d548" status: 404 len: 194 microversion: 2.1 time: 0.231557 Sep 24 20:55:54.339572 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 928/1858] 10.222.0.52 () {58 vars in 1272 bytes} [Sat Sep 24 20:55:54 2022] DELETE /compute/v2.1/os-security-groups/a7f4231c-74a5-43ae-9d5b-c90698c6d548 => generated 194 bytes in 238 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:55:54.353958 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2f9e6c63-f6ad-47ea-9f32-78cac164a259 tempest-SecurityGroupsNegativeTestJSON-1017699641 tempest-SecurityGroupsNegativeTestJSON-1017699641-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.007156 Sep 24 20:55:54.356645 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 929/1859] 10.222.0.52 () {58 vars in 1164 bytes} [Sat Sep 24 20:55:54 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 24 20:55:54.373690 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d16ab61d-f40e-4f4f-a17f-8dc8d9b22962 tempest-SecurityGroupsNegativeTestJSON-1017699641 tempest-SecurityGroupsNegativeTestJSON-1017699641-project] Calling method '.version_select at 0x7f4b0c79f280>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:54.914000 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d16ab61d-f40e-4f4f-a17f-8dc8d9b22962 tempest-SecurityGroupsNegativeTestJSON-1017699641 tempest-SecurityGroupsNegativeTestJSON-1017699641-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.553316 Sep 24 20:55:54.915254 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 930/1860] 10.222.0.52 () {58 vars in 1158 bytes} [Sat Sep 24 20:55:54 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:55:54.935232 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1d286390-df2b-46dc-891f-ad2cfc478dd0 tempest-SecurityGroupsNegativeTestJSON-1017699641 tempest-SecurityGroupsNegativeTestJSON-1017699641-project] Calling method '.version_select at 0x7f4b110aad30>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:55.165810 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-440bb57b-22cb-48d5-8fc0-6df6732f5d97 tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.008474 Sep 24 20:55:55.166872 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 931/1861] 10.222.0.52 () {60 vars in 1195 bytes} [Sat Sep 24 20:55:54 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:55:55.171572 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-feac4d08-9e5c-43e9-b9fe-0659605f862d req-324f0ba6-b50d-4a9d-af73-2d8b27637aae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eeb37e4-c327-4c29-a1a9-ae517e3e55ea", "tag": "abcad753-fa76-461f-a30f-d6161dbdea13"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:55:55.194406 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-feac4d08-9e5c-43e9-b9fe-0659605f862d req-324f0ba6-b50d-4a9d-af73-2d8b27637aae service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:55.196806 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-feac4d08-9e5c-43e9-b9fe-0659605f862d req-324f0ba6-b50d-4a9d-af73-2d8b27637aae service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:55.198050 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-feac4d08-9e5c-43e9-b9fe-0659605f862d req-324f0ba6-b50d-4a9d-af73-2d8b27637aae service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:55.219605 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-feac4d08-9e5c-43e9-b9fe-0659605f862d req-324f0ba6-b50d-4a9d-af73-2d8b27637aae service nova] Creating event network-changed:abcad753-fa76-461f-a30f-d6161dbdea13 for instance 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea on nch1-master-1 Sep 24 20:55:55.236396 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-feac4d08-9e5c-43e9-b9fe-0659605f862d req-324f0ba6-b50d-4a9d-af73-2d8b27637aae service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068095 Sep 24 20:55:55.237011 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 932/1862] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:55:55.243308 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-15d8cf75-d214-4e18-be2b-70f995d7dcf8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:55.249137 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-15d8cf75-d214-4e18-be2b-70f995d7dcf8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:55.266293 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-15d8cf75-d214-4e18-be2b-70f995d7dcf8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:55.266822 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-15d8cf75-d214-4e18-be2b-70f995d7dcf8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:55.267256 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-15d8cf75-d214-4e18-be2b-70f995d7dcf8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:55.268425 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-15d8cf75-d214-4e18-be2b-70f995d7dcf8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:55.269633 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-15d8cf75-d214-4e18-be2b-70f995d7dcf8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:55.270244 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-15d8cf75-d214-4e18-be2b-70f995d7dcf8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:55.983396 ncdv-master-1 devstack@n-api.service[140517]: DEBUG neutronclient.v2_0.client [None req-1d286390-df2b-46dc-891f-ad2cfc478dd0 tempest-SecurityGroupsNegativeTestJSON-1017699641 tempest-SecurityGroupsNegativeTestJSON-1017699641-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=140517) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 24 20:55:55.984105 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-1d286390-df2b-46dc-891f-ad2cfc478dd0 tempest-SecurityGroupsNegativeTestJSON-1017699641 tempest-SecurityGroupsNegativeTestJSON-1017699641-project] HTTP exception thrown: Insufficient rights for removing default security group. Sep 24 20:55:55.984105 ncdv-master-1 devstack@n-api.service[140517]: Neutron server returns request_ids: ['req-4ea90460-5a0b-4e4a-91ba-b8ee85418281'] Sep 24 20:55:55.985974 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1d286390-df2b-46dc-891f-ad2cfc478dd0 tempest-SecurityGroupsNegativeTestJSON-1017699641 tempest-SecurityGroupsNegativeTestJSON-1017699641-project] Request method failure captured: Sep 24 20:55:55.985974 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/os-security-groups/146ca5f4-a798-45c0-a88e-4e1899d9b294 HTTP/1.1 Sep 24 20:55:55.985974 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:55:55.985974 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:55:55.985974 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:55:55.985974 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:55:55.985974 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:55:55.985974 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:55:55.985974 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:55:55.985974 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:55:55.985974 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL27Zxe0701BBt0mZM6QsjWhwCrWAxtlUtK52EaGgjxSMLnOfvoDuOCOrQAwCNi0QvsydLBfAxkSD0Dv4Wxi94c73uwSpO4XjyNbHNTsrVy-h1bTVucewCYaOWu99b_ykiAJFWGif29StDOCSU5syT8hxk4_q2VI5yuugIDTVtojwmpY Sep 24 20:55:55.985974 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:55:55.985974 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:55:55.985974 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:55:55.985974 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:55:55.985974 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:55:55.985974 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:55:55.985974 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: a1d9e5ac0e5f4e8598a63c55c639ffaf Sep 24 20:55:55.985974 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1017699641 Sep 24 20:55:55.985974 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:55:55.985974 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:55:55.988215 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a1d9e5ac0e5f4e8598a63c55c639ffaf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a1d9e5ac0e5f4e8598a63c55c639ffaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a1d9e5ac0e5f4e8598a63c55c639ffaf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a1d9e5ac0e5f4e8598a63c55c639ffaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:55:55.988215 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1017699641 Sep 24 20:55:55.988215 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: a1d9e5ac0e5f4e8598a63c55c639ffaf Sep 24 20:55:55.988215 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1017699641 Sep 24 20:55:55.988215 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-SecurityGroupsNegativeTestJSON-1017699641-project Sep 24 20:55:55.988215 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:55:55.988215 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:55:55.988215 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 6453a6150dcc44bb94c257c6c7666d48 Sep 24 20:55:55.988215 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1017699641-project Sep 24 20:55:55.988215 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 20:55:55.988215 ncdv-master-1 devstack@n-api.service[140517]: exception: Insufficient rights for removing default security group. Sep 24 20:55:55.988215 ncdv-master-1 devstack@n-api.service[140517]: Neutron server returns request_ids: ['req-4ea90460-5a0b-4e4a-91ba-b8ee85418281'] Sep 24 20:55:55.988215 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '146ca5f4-a798-45c0-a88e-4e1899d9b294'} Sep 24 20:55:55.989114 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:55:55.989114 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:55.989114 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 24 20:55:55.989114 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 24 20:55:55.989114 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:55:55.989114 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:55:55.989114 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 24 20:55:55.989114 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 24 20:55:55.989114 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:55:55.989114 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:55:55.989114 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 24 20:55:55.989114 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 24 20:55:55.989114 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:55:55.989114 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:55:55.989114 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 24 20:55:55.989114 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 24 20:55:55.989114 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:55:55.989114 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:55:55.989114 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 24 20:55:55.990399 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 24 20:55:55.990399 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:55:55.990399 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:55:55.990399 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 24 20:55:55.990399 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 24 20:55:55.990399 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 24 20:55:55.990399 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 24 20:55:55.990399 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Sep 24 20:55:55.990399 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ea90460-5a0b-4e4a-91ba-b8ee85418281'] Sep 24 20:55:55.990399 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:55.990399 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:55.990399 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:55.990399 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:55.990399 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 24 20:55:55.990399 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 24 20:55:55.990399 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 24 20:55:55.990399 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 24 20:55:55.990399 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Sep 24 20:55:55.990399 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ea90460-5a0b-4e4a-91ba-b8ee85418281'] Sep 24 20:55:55.991685 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:55.991685 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:55.991685 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:55.991685 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:55.991685 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:55.991685 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:55.991685 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:55:55.991685 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:55:55.991685 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:55:55.991685 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:55:55.991685 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:55:55.991685 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:55:55.991685 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 24 20:55:55.991685 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 24 20:55:55.991685 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Sep 24 20:55:55.991685 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ea90460-5a0b-4e4a-91ba-b8ee85418281'] Sep 24 20:55:55.991685 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:55.991685 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:55.991685 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:55.991685 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:55.991685 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:55.993209 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:55.993209 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:55:55.993209 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:55:55.993209 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Sep 24 20:55:55.993209 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ea90460-5a0b-4e4a-91ba-b8ee85418281'] Sep 24 20:55:55.993209 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:55.993209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1d286390-df2b-46dc-891f-ad2cfc478dd0 tempest-SecurityGroupsNegativeTestJSON-1017699641 tempest-SecurityGroupsNegativeTestJSON-1017699641-project] Returning 400 to user: Insufficient rights for removing default security group. Sep 24 20:55:55.993209 ncdv-master-1 devstack@n-api.service[140517]: Neutron server returns request_ids: ['req-4ea90460-5a0b-4e4a-91ba-b8ee85418281'] {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:55:55.993209 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1d286390-df2b-46dc-891f-ad2cfc478dd0 tempest-SecurityGroupsNegativeTestJSON-1017699641 tempest-SecurityGroupsNegativeTestJSON-1017699641-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/146ca5f4-a798-45c0-a88e-4e1899d9b294" status: 400 len: 182 microversion: 2.1 time: 1.062407 Sep 24 20:55:56.003454 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 931/1863] 10.222.0.52 () {58 vars in 1272 bytes} [Sat Sep 24 20:55:54 2022] DELETE /compute/v2.1/os-security-groups/146ca5f4-a798-45c0-a88e-4e1899d9b294 => generated 182 bytes in 1078 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 20:55:56.013173 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bf081af6-02ca-4e4f-b29e-c8ad683d9e69 tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] Action: 'create', calling method: .version_select at 0x7f4b110188b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-650934176", "description": "tempest-description-352709008"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:55:56.069351 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-15d8cf75-d214-4e18-be2b-70f995d7dcf8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:56.091193 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-15d8cf75-d214-4e18-be2b-70f995d7dcf8 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1198 microversion: 2.1 time: 0.850508 Sep 24 20:55:56.093200 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 933/1864] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:55 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1198 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:56.618675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ad5af7f5-31e2-4ac7-855d-4be8856a92f4 tempest-FloatingIPsTestJSON-1952344289 tempest-FloatingIPsTestJSON-1952344289-project] Action: 'create', calling method: .version_select at 0x7f4b111a49d0>, body: {"pool": null} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:55:56.638403 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bf081af6-02ca-4e4f-b29e-c8ad683d9e69 tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.633399 Sep 24 20:55:56.639564 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 932/1865] 10.222.0.52 () {60 vars in 1180 bytes} [Sat Sep 24 20:55:56 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:55:56.646605 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b6d2aecc-c8cb-4dd0-947f-e946422afa43 tempest-SecurityGroupsNegativeTestJSON-1017699641 tempest-SecurityGroupsNegativeTestJSON-1017699641-project] Calling method '.version_select at 0x7f4b10fa0820>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:56.795715 ncdv-master-1 devstack@n-api.service[140517]: DEBUG neutronclient.v2_0.client [None req-b6d2aecc-c8cb-4dd0-947f-e946422afa43 tempest-SecurityGroupsNegativeTestJSON-1017699641 tempest-SecurityGroupsNegativeTestJSON-1017699641-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 62988037-1b5b-4a38-b3be-d84ad29ffa61 does not exist", "detail": ""}} {{(pid=140517) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 24 20:55:56.796786 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.security_group_api [None req-b6d2aecc-c8cb-4dd0-947f-e946422afa43 tempest-SecurityGroupsNegativeTestJSON-1017699641 tempest-SecurityGroupsNegativeTestJSON-1017699641-project] Neutron security group 62988037-1b5b-4a38-b3be-d84ad29ffa61 not found {{(pid=140517) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 24 20:55:56.798284 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-b6d2aecc-c8cb-4dd0-947f-e946422afa43 tempest-SecurityGroupsNegativeTestJSON-1017699641 tempest-SecurityGroupsNegativeTestJSON-1017699641-project] HTTP exception thrown: Security group 62988037-1b5b-4a38-b3be-d84ad29ffa61 does not exist Sep 24 20:55:56.798284 ncdv-master-1 devstack@n-api.service[140517]: Neutron server returns request_ids: ['req-ed90df09-fc8a-42bf-925f-5c287ac1401b'] Sep 24 20:55:56.802988 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b6d2aecc-c8cb-4dd0-947f-e946422afa43 tempest-SecurityGroupsNegativeTestJSON-1017699641 tempest-SecurityGroupsNegativeTestJSON-1017699641-project] Request method failure captured: Sep 24 20:55:56.802988 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/os-security-groups/62988037-1b5b-4a38-b3be-d84ad29ffa61 HTTP/1.1 Sep 24 20:55:56.802988 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:55:56.802988 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:55:56.802988 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:55:56.802988 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:55:56.802988 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:55:56.802988 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:55:56.802988 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:55:56.802988 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:55:56.802988 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL27Zxe0701BBt0mZM6QsjWhwCrWAxtlUtK52EaGgjxSMLnOfvoDuOCOrQAwCNi0QvsydLBfAxkSD0Dv4Wxi94c73uwSpO4XjyNbHNTsrVy-h1bTVucewCYaOWu99b_ykiAJFWGif29StDOCSU5syT8hxk4_q2VI5yuugIDTVtojwmpY Sep 24 20:55:56.802988 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:55:56.802988 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:55:56.802988 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:55:56.802988 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:55:56.802988 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:55:56.802988 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:55:56.802988 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: a1d9e5ac0e5f4e8598a63c55c639ffaf Sep 24 20:55:56.802988 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1017699641 Sep 24 20:55:56.802988 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:55:56.802988 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:55:56.804612 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a1d9e5ac0e5f4e8598a63c55c639ffaf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a1d9e5ac0e5f4e8598a63c55c639ffaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a1d9e5ac0e5f4e8598a63c55c639ffaf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a1d9e5ac0e5f4e8598a63c55c639ffaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:55:56.804612 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1017699641 Sep 24 20:55:56.804612 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: a1d9e5ac0e5f4e8598a63c55c639ffaf Sep 24 20:55:56.804612 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1017699641 Sep 24 20:55:56.804612 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-SecurityGroupsNegativeTestJSON-1017699641-project Sep 24 20:55:56.804612 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:55:56.804612 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:55:56.804612 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 6453a6150dcc44bb94c257c6c7666d48 Sep 24 20:55:56.804612 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1017699641-project Sep 24 20:55:56.804612 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 20:55:56.804612 ncdv-master-1 devstack@n-api.service[140517]: exception: Security group 62988037-1b5b-4a38-b3be-d84ad29ffa61 does not exist Sep 24 20:55:56.804612 ncdv-master-1 devstack@n-api.service[140517]: Neutron server returns request_ids: ['req-ed90df09-fc8a-42bf-925f-5c287ac1401b'] Sep 24 20:55:56.804612 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '62988037-1b5b-4a38-b3be-d84ad29ffa61'} Sep 24 20:55:56.805600 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:55:56.805600 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:56.805600 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 24 20:55:56.805600 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 24 20:55:56.805600 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:55:56.805600 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:55:56.805600 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 24 20:55:56.805600 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 24 20:55:56.805600 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:55:56.805600 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:55:56.805600 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 24 20:55:56.805600 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 24 20:55:56.805600 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:55:56.805600 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:55:56.805600 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 24 20:55:56.805600 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 24 20:55:56.805600 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:55:56.805600 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:55:56.805600 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 24 20:55:56.807463 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 24 20:55:56.807463 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:55:56.807463 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:55:56.807463 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 24 20:55:56.807463 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 24 20:55:56.807463 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 24 20:55:56.807463 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 24 20:55:56.807463 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 62988037-1b5b-4a38-b3be-d84ad29ffa61 does not exist Sep 24 20:55:56.807463 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed90df09-fc8a-42bf-925f-5c287ac1401b'] Sep 24 20:55:56.807463 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:56.807463 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:56.807463 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:56.807463 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:56.807463 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 24 20:55:56.807463 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 24 20:55:56.807463 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 24 20:55:56.807463 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 24 20:55:56.807463 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 62988037-1b5b-4a38-b3be-d84ad29ffa61 does not exist Sep 24 20:55:56.808880 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed90df09-fc8a-42bf-925f-5c287ac1401b'] Sep 24 20:55:56.808880 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:56.808880 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:56.808880 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:56.808880 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:56.808880 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:56.808880 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:56.808880 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:55:56.808880 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:55:56.808880 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:55:56.808880 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:55:56.808880 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:55:56.808880 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:55:56.808880 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 24 20:55:56.808880 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 24 20:55:56.808880 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 62988037-1b5b-4a38-b3be-d84ad29ffa61 does not exist Sep 24 20:55:56.808880 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed90df09-fc8a-42bf-925f-5c287ac1401b'] Sep 24 20:55:56.808880 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:56.808880 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:56.808880 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:56.808880 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:56.810640 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:56.810640 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:56.810640 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:55:56.810640 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:55:56.810640 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 62988037-1b5b-4a38-b3be-d84ad29ffa61 does not exist Sep 24 20:55:56.810640 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed90df09-fc8a-42bf-925f-5c287ac1401b'] Sep 24 20:55:56.810640 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:56.812630 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b6d2aecc-c8cb-4dd0-947f-e946422afa43 tempest-SecurityGroupsNegativeTestJSON-1017699641 tempest-SecurityGroupsNegativeTestJSON-1017699641-project] Returning 404 to user: Security group 62988037-1b5b-4a38-b3be-d84ad29ffa61 does not exist Sep 24 20:55:56.812630 ncdv-master-1 devstack@n-api.service[140517]: Neutron server returns request_ids: ['req-ed90df09-fc8a-42bf-925f-5c287ac1401b'] {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:55:56.813900 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b6d2aecc-c8cb-4dd0-947f-e946422afa43 tempest-SecurityGroupsNegativeTestJSON-1017699641 tempest-SecurityGroupsNegativeTestJSON-1017699641-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/62988037-1b5b-4a38-b3be-d84ad29ffa61" status: 404 len: 194 microversion: 2.1 time: 0.173157 Sep 24 20:55:56.822683 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 933/1866] 10.222.0.52 () {58 vars in 1269 bytes} [Sat Sep 24 20:55:56 2022] GET /compute/v2.1/os-security-groups/62988037-1b5b-4a38-b3be-d84ad29ffa61 => generated 194 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:55:56.835520 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8bf85ef9-369b-4545-abc8-a0f72bce21e5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:56.836233 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8bf85ef9-369b-4545-abc8-a0f72bce21e5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:56.845870 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8bf85ef9-369b-4545-abc8-a0f72bce21e5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:56.847121 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8bf85ef9-369b-4545-abc8-a0f72bce21e5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:56.848050 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8bf85ef9-369b-4545-abc8-a0f72bce21e5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:56.849080 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8bf85ef9-369b-4545-abc8-a0f72bce21e5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:56.849715 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8bf85ef9-369b-4545-abc8-a0f72bce21e5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:56.850889 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8bf85ef9-369b-4545-abc8-a0f72bce21e5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:56.888550 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8bf85ef9-369b-4545-abc8-a0f72bce21e5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:55:57.041762 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8bf85ef9-369b-4545-abc8-a0f72bce21e5 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 204 len: 0 microversion: 2.1 time: 0.217234 Sep 24 20:55:57.042672 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 934/1867] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:55:56 2022] DELETE /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:55:57.061322 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8d9a90b0-a3d0-4d38-bc3e-6144d0ba7b25 tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] Action: 'create', calling method: .version_select at 0x7f4b110c7ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1241712554", "description": "tempest-description-1988462661"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:55:58.351295 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8d9a90b0-a3d0-4d38-bc3e-6144d0ba7b25 tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.307100 Sep 24 20:55:58.352015 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 935/1868] 10.222.0.52 () {60 vars in 1180 bytes} [Sat Sep 24 20:55:57 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:55:58.358170 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-923a097a-df56-4a5a-ba71-ea07e4745615 tempest-SecurityGroupsNegativeTestJSON-1017699641 tempest-SecurityGroupsNegativeTestJSON-1017699641-project] Action: 'update', calling method: .version_select at 0x7f4b110be310>, body: {"security_group": {"name": "tempest-sg-1498442878", "description": "tempest-description-1077681706"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:55:58.639099 ncdv-master-1 devstack@n-api.service[140517]: DEBUG neutronclient.v2_0.client [None req-923a097a-df56-4a5a-ba71-ea07e4745615 tempest-SecurityGroupsNegativeTestJSON-1017699641 tempest-SecurityGroupsNegativeTestJSON-1017699641-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5bf2a27d-d8d0-45bb-9eb4-226bcb95bf9d does not exist", "detail": ""}} {{(pid=140517) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 24 20:55:58.640092 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.security_group_api [None req-923a097a-df56-4a5a-ba71-ea07e4745615 tempest-SecurityGroupsNegativeTestJSON-1017699641 tempest-SecurityGroupsNegativeTestJSON-1017699641-project] Neutron security group 5bf2a27d-d8d0-45bb-9eb4-226bcb95bf9d not found {{(pid=140517) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 24 20:55:58.641117 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-923a097a-df56-4a5a-ba71-ea07e4745615 tempest-SecurityGroupsNegativeTestJSON-1017699641 tempest-SecurityGroupsNegativeTestJSON-1017699641-project] HTTP exception thrown: Security group 5bf2a27d-d8d0-45bb-9eb4-226bcb95bf9d does not exist Sep 24 20:55:58.641117 ncdv-master-1 devstack@n-api.service[140517]: Neutron server returns request_ids: ['req-057425ae-071e-4e9a-98b5-f6731cb2a762'] Sep 24 20:55:58.645230 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-923a097a-df56-4a5a-ba71-ea07e4745615 tempest-SecurityGroupsNegativeTestJSON-1017699641 tempest-SecurityGroupsNegativeTestJSON-1017699641-project] Request method failure captured: Sep 24 20:55:58.645230 ncdv-master-1 devstack@n-api.service[140517]: request: PUT /compute/v2.1/os-security-groups/5bf2a27d-d8d0-45bb-9eb4-226bcb95bf9d HTTP/1.1 Sep 24 20:55:58.645230 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:55:58.645230 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:55:58.645230 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:55:58.645230 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 102 Sep 24 20:55:58.645230 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:55:58.645230 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:55:58.645230 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:55:58.645230 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:55:58.645230 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL27Zxe0701BBt0mZM6QsjWhwCrWAxtlUtK52EaGgjxSMLnOfvoDuOCOrQAwCNi0QvsydLBfAxkSD0Dv4Wxi94c73uwSpO4XjyNbHNTsrVy-h1bTVucewCYaOWu99b_ykiAJFWGif29StDOCSU5syT8hxk4_q2VI5yuugIDTVtojwmpY Sep 24 20:55:58.645230 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:55:58.645230 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:55:58.645230 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:55:58.645230 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:55:58.645230 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:55:58.645230 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:55:58.645230 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: a1d9e5ac0e5f4e8598a63c55c639ffaf Sep 24 20:55:58.645230 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1017699641 Sep 24 20:55:58.645230 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:55:58.645230 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:55:58.648444 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a1d9e5ac0e5f4e8598a63c55c639ffaf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a1d9e5ac0e5f4e8598a63c55c639ffaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a1d9e5ac0e5f4e8598a63c55c639ffaf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a1d9e5ac0e5f4e8598a63c55c639ffaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:55:58.648444 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1017699641 Sep 24 20:55:58.648444 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: a1d9e5ac0e5f4e8598a63c55c639ffaf Sep 24 20:55:58.648444 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1017699641 Sep 24 20:55:58.648444 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-SecurityGroupsNegativeTestJSON-1017699641-project Sep 24 20:55:58.648444 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:55:58.648444 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:55:58.648444 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 6453a6150dcc44bb94c257c6c7666d48 Sep 24 20:55:58.648444 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1017699641-project Sep 24 20:55:58.648444 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 20:55:58.648444 ncdv-master-1 devstack@n-api.service[140517]: {"security_group": {"name": "tempest-sg-1498442878", "description": "tempest-description-1077681706"}} Sep 24 20:55:58.648444 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 20:55:58.648444 ncdv-master-1 devstack@n-api.service[140517]: exception: Security group 5bf2a27d-d8d0-45bb-9eb4-226bcb95bf9d does not exist Sep 24 20:55:58.649714 ncdv-master-1 devstack@n-api.service[140517]: Neutron server returns request_ids: ['req-057425ae-071e-4e9a-98b5-f6731cb2a762'] Sep 24 20:55:58.649714 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '5bf2a27d-d8d0-45bb-9eb4-226bcb95bf9d', 'body': {'security_group': {'name': 'tempest-sg-1498442878', 'description': 'tempest-description-1077681706'}}} Sep 24 20:55:58.649714 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:55:58.649714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:58.649714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 24 20:55:58.649714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 24 20:55:58.649714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:55:58.649714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:55:58.649714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 24 20:55:58.649714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 24 20:55:58.649714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:55:58.649714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:55:58.649714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 24 20:55:58.649714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 24 20:55:58.649714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:55:58.649714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:55:58.649714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 24 20:55:58.649714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 24 20:55:58.651271 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:55:58.651271 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:55:58.651271 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 24 20:55:58.651271 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 24 20:55:58.651271 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:55:58.651271 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:55:58.651271 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 24 20:55:58.651271 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 24 20:55:58.651271 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 24 20:55:58.651271 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 24 20:55:58.651271 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5bf2a27d-d8d0-45bb-9eb4-226bcb95bf9d does not exist Sep 24 20:55:58.651271 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-057425ae-071e-4e9a-98b5-f6731cb2a762'] Sep 24 20:55:58.651271 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:58.651271 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:58.651271 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:58.651271 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:58.651271 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Sep 24 20:55:58.651271 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 24 20:55:58.651271 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 24 20:55:58.652642 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 24 20:55:58.652642 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5bf2a27d-d8d0-45bb-9eb4-226bcb95bf9d does not exist Sep 24 20:55:58.652642 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-057425ae-071e-4e9a-98b5-f6731cb2a762'] Sep 24 20:55:58.652642 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:58.652642 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:58.652642 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:58.652642 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:58.652642 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:58.652642 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:58.652642 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:55:58.652642 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:55:58.652642 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:55:58.652642 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:55:58.652642 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:55:58.652642 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:55:58.652642 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Sep 24 20:55:58.652642 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 24 20:55:58.652642 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5bf2a27d-d8d0-45bb-9eb4-226bcb95bf9d does not exist Sep 24 20:55:58.652642 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-057425ae-071e-4e9a-98b5-f6731cb2a762'] Sep 24 20:55:58.652642 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:58.653978 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:55:58.653978 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:58.653978 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:55:58.653978 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:55:58.653978 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:55:58.653978 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:55:58.653978 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:55:58.653978 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5bf2a27d-d8d0-45bb-9eb4-226bcb95bf9d does not exist Sep 24 20:55:58.653978 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-057425ae-071e-4e9a-98b5-f6731cb2a762'] Sep 24 20:55:58.653978 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:55:58.659817 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-923a097a-df56-4a5a-ba71-ea07e4745615 tempest-SecurityGroupsNegativeTestJSON-1017699641 tempest-SecurityGroupsNegativeTestJSON-1017699641-project] Returning 404 to user: Security group 5bf2a27d-d8d0-45bb-9eb4-226bcb95bf9d does not exist Sep 24 20:55:58.659817 ncdv-master-1 devstack@n-api.service[140517]: Neutron server returns request_ids: ['req-057425ae-071e-4e9a-98b5-f6731cb2a762'] {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:55:58.661226 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-923a097a-df56-4a5a-ba71-ea07e4745615 tempest-SecurityGroupsNegativeTestJSON-1017699641 tempest-SecurityGroupsNegativeTestJSON-1017699641-project] 10.222.0.52 "PUT /compute/v2.1/os-security-groups/5bf2a27d-d8d0-45bb-9eb4-226bcb95bf9d" status: 404 len: 194 microversion: 2.1 time: 0.308129 Sep 24 20:55:58.662029 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 936/1869] 10.222.0.52 () {60 vars in 1290 bytes} [Sat Sep 24 20:55:58 2022] PUT /compute/v2.1/os-security-groups/5bf2a27d-d8d0-45bb-9eb4-226bcb95bf9d => generated 194 bytes in 309 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:55:58.685910 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-770d9111-d00a-47d5-9ba6-2880f90ac969 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:58.692960 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-770d9111-d00a-47d5-9ba6-2880f90ac969 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:58.714783 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-770d9111-d00a-47d5-9ba6-2880f90ac969 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:58.716734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-770d9111-d00a-47d5-9ba6-2880f90ac969 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:58.722247 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-770d9111-d00a-47d5-9ba6-2880f90ac969 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:58.724039 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-770d9111-d00a-47d5-9ba6-2880f90ac969 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:58.724768 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-770d9111-d00a-47d5-9ba6-2880f90ac969 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:58.725469 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-770d9111-d00a-47d5-9ba6-2880f90ac969 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:59.531098 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-770d9111-d00a-47d5-9ba6-2880f90ac969 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:55:59.549161 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-770d9111-d00a-47d5-9ba6-2880f90ac969 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1467 microversion: 2.1 time: 0.874985 Sep 24 20:55:59.555537 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 937/1870] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:58 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1467 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:55:59.575834 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1fddeb15-c4c7-444f-a6fb-b86c0662ae14 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:55:59.576471 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1fddeb15-c4c7-444f-a6fb-b86c0662ae14 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:55:59.585309 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1fddeb15-c4c7-444f-a6fb-b86c0662ae14 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:59.592401 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1fddeb15-c4c7-444f-a6fb-b86c0662ae14 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:59.592862 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1fddeb15-c4c7-444f-a6fb-b86c0662ae14 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:55:59.593975 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1fddeb15-c4c7-444f-a6fb-b86c0662ae14 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:55:59.594684 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1fddeb15-c4c7-444f-a6fb-b86c0662ae14 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:55:59.595447 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1fddeb15-c4c7-444f-a6fb-b86c0662ae14 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:00.227334 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1fddeb15-c4c7-444f-a6fb-b86c0662ae14 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:00.229780 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:56:00.242980 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1fddeb15-c4c7-444f-a6fb-b86c0662ae14 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1198 microversion: 2.1 time: 0.685874 Sep 24 20:56:00.261068 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 938/1871] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:55:59 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1198 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:00.269411 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-aae78308-f4b9-4930-95cb-bb9f94f758d4 tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] Action: 'create', calling method: .version_select at 0x7f4b1110fa60>, body: {"security_group_rule": {"parent_group_id": "695d5663-50d7-4711-a86a-091e977d0491", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "f6b7526a-6d54-4251-9ad3-48e0943b46e8"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:01.799020 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-aae78308-f4b9-4930-95cb-bb9f94f758d4 tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.550757 Sep 24 20:56:01.802446 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 939/1872] 10.222.0.52 () {60 vars in 1195 bytes} [Sat Sep 24 20:56:00 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:56:01.810313 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4cb8f97e-4d2b-4cf0-91f0-33133f38cebc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:01.818388 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4cb8f97e-4d2b-4cf0-91f0-33133f38cebc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:01.827697 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cb8f97e-4d2b-4cf0-91f0-33133f38cebc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:01.828496 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cb8f97e-4d2b-4cf0-91f0-33133f38cebc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:01.829127 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cb8f97e-4d2b-4cf0-91f0-33133f38cebc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:01.831661 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cb8f97e-4d2b-4cf0-91f0-33133f38cebc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:01.833019 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cb8f97e-4d2b-4cf0-91f0-33133f38cebc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:01.834258 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cb8f97e-4d2b-4cf0-91f0-33133f38cebc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:02.036037 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4cb8f97e-4d2b-4cf0-91f0-33133f38cebc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:02.051469 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4cb8f97e-4d2b-4cf0-91f0-33133f38cebc tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 200 len: 1425 microversion: 2.1 time: 0.247573 Sep 24 20:56:02.052072 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 940/1873] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:01 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 1425 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:02.070838 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3379fe8a-55b2-4472-a67d-ee02e9cd7b9b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:02.071482 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3379fe8a-55b2-4472-a67d-ee02e9cd7b9b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:02.078206 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3379fe8a-55b2-4472-a67d-ee02e9cd7b9b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:02.078837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3379fe8a-55b2-4472-a67d-ee02e9cd7b9b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:02.079331 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3379fe8a-55b2-4472-a67d-ee02e9cd7b9b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:02.082047 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3379fe8a-55b2-4472-a67d-ee02e9cd7b9b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:02.082671 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3379fe8a-55b2-4472-a67d-ee02e9cd7b9b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:02.083328 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3379fe8a-55b2-4472-a67d-ee02e9cd7b9b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:02.402597 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ad5af7f5-31e2-4ac7-855d-4be8856a92f4 tempest-FloatingIPsTestJSON-1952344289 tempest-FloatingIPsTestJSON-1952344289-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.303683 Sep 24 20:56:02.403364 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 934/1874] 10.222.0.52 () {60 vars in 1170 bytes} [Sat Sep 24 20:55:56 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:56:02.418275 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-58d6fb1b-7e72-4568-93e8-6f4b7710492e tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] Action: 'create', calling method: .version_select at 0x7f4b1116f5e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1429232846", "description": "tempest-description-1679079806"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:02.617247 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3379fe8a-55b2-4472-a67d-ee02e9cd7b9b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:02.631798 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3379fe8a-55b2-4472-a67d-ee02e9cd7b9b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1198 microversion: 2.1 time: 0.578637 Sep 24 20:56:02.632392 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 941/1875] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:02 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1198 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:02.637243 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-ca22bbe6-a0fc-4799-a543-27c107bd5361 req-f56a1502-f9ed-4b6d-8c70-ebab6fadcb4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bde8ccc3-582c-4d8e-8bcd-3c5711560a26", "name": "network-vif-deleted", "tag": "c4b07864-228d-47d5-9e64-61cd582aa91a"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:02.664834 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-ca22bbe6-a0fc-4799-a543-27c107bd5361 req-f56a1502-f9ed-4b6d-8c70-ebab6fadcb4d service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:02.665612 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-ca22bbe6-a0fc-4799-a543-27c107bd5361 req-f56a1502-f9ed-4b6d-8c70-ebab6fadcb4d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:02.666226 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-ca22bbe6-a0fc-4799-a543-27c107bd5361 req-f56a1502-f9ed-4b6d-8c70-ebab6fadcb4d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:02.685959 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-ca22bbe6-a0fc-4799-a543-27c107bd5361 req-f56a1502-f9ed-4b6d-8c70-ebab6fadcb4d service nova] Creating event network-vif-deleted:c4b07864-228d-47d5-9e64-61cd582aa91a for instance bde8ccc3-582c-4d8e-8bcd-3c5711560a26 on nch2-master-1 Sep 24 20:56:02.699250 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-ca22bbe6-a0fc-4799-a543-27c107bd5361 req-f56a1502-f9ed-4b6d-8c70-ebab6fadcb4d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065335 Sep 24 20:56:02.699875 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 942/1876] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:56:02.722072 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c7da86a1-8125-4050-b3a2-c1663cc00d6d tempest-FloatingIPsTestJSON-1952344289 tempest-FloatingIPsTestJSON-1952344289-project] Calling method '.version_select at 0x7f4b110beb80>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:03.153660 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-58d6fb1b-7e72-4568-93e8-6f4b7710492e tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.748268 Sep 24 20:56:03.163843 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 935/1877] 10.222.0.52 () {60 vars in 1180 bytes} [Sat Sep 24 20:56:02 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:56:03.176390 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7ec0cd35-e169-4b35-8820-5b8ea3bdd2e0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:03.177874 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7ec0cd35-e169-4b35-8820-5b8ea3bdd2e0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: bde8ccc3-582c-4d8e-8bcd-3c5711560a26] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:03.195931 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ec0cd35-e169-4b35-8820-5b8ea3bdd2e0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:03.196834 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ec0cd35-e169-4b35-8820-5b8ea3bdd2e0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:03.197518 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ec0cd35-e169-4b35-8820-5b8ea3bdd2e0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:03.199023 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ec0cd35-e169-4b35-8820-5b8ea3bdd2e0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:03.199716 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ec0cd35-e169-4b35-8820-5b8ea3bdd2e0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:03.200366 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ec0cd35-e169-4b35-8820-5b8ea3bdd2e0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:03.219117 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-7ec0cd35-e169-4b35-8820-5b8ea3bdd2e0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] HTTP exception thrown: Instance bde8ccc3-582c-4d8e-8bcd-3c5711560a26 could not be found. Sep 24 20:56:03.221999 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7ec0cd35-e169-4b35-8820-5b8ea3bdd2e0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Request method failure captured: Sep 24 20:56:03.221999 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 HTTP/1.1 Sep 24 20:56:03.221999 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:56:03.221999 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:56:03.221999 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:56:03.221999 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:56:03.221999 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:56:03.221999 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:56:03.221999 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:56:03.221999 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:56:03.221999 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL22AH--cPMnXJJd4QEnLriiYfB-w2A-yE5jCCcHhGxiq35NRxCuRY3j9uVE-aco-xiGNm5JbBY89pNNBwEc_CSyxIUrHMKp_PTqtE3xF_aDC7uBbmtCAbwdBtpCdOHudl2IaI-pxz1mpiD8H1-ZYDP3b2uTg8cCogwfCwUryxb4V3gs Sep 24 20:56:03.221999 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:56:03.221999 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:56:03.221999 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:56:03.221999 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:56:03.221999 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:56:03.221999 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:56:03.221999 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 349d3aa8627644d59867a744695f2579 Sep 24 20:56:03.221999 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-MigrationsAdminTest-1468292266 Sep 24 20:56:03.221999 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:56:03.221999 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:56:03.223718 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/349d3aa8627644d59867a744695f2579"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_349d3aa8627644d59867a744695f2579"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/349d3aa8627644d59867a744695f2579"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/349d3aa8627644d59867a744695f2579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:56:03.223718 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-MigrationsAdminTest-1468292266 Sep 24 20:56:03.223718 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 349d3aa8627644d59867a744695f2579 Sep 24 20:56:03.223718 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-MigrationsAdminTest-1468292266 Sep 24 20:56:03.223718 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-MigrationsAdminTest-1468292266-project Sep 24 20:56:03.223718 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:56:03.223718 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:56:03.223718 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 93982876b1e24efb8ffa8c009532343a Sep 24 20:56:03.223718 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-MigrationsAdminTest-1468292266-project Sep 24 20:56:03.223718 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:56:03.223718 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance bde8ccc3-582c-4d8e-8bcd-3c5711560a26 could not be found. Sep 24 20:56:03.223718 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'bde8ccc3-582c-4d8e-8bcd-3c5711560a26'} Sep 24 20:56:03.224954 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:56:03.224954 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:03.224954 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:56:03.224954 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:56:03.224954 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:56:03.224954 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:56:03.224954 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:56:03.224954 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:56:03.224954 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:56:03.224954 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:56:03.224954 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bde8ccc3-582c-4d8e-8bcd-3c5711560a26 could not be found. Sep 24 20:56:03.224954 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:03.224954 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:03.224954 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:03.224954 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:03.224954 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:03.224954 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:03.224954 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:56:03.224954 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:56:03.224954 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:56:03.227334 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:56:03.227334 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:56:03.227334 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:56:03.227334 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:56:03.227334 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:56:03.227334 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:56:03.227334 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:56:03.227334 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bde8ccc3-582c-4d8e-8bcd-3c5711560a26 could not be found. Sep 24 20:56:03.227334 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:03.227334 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:03.227334 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:03.227334 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:03.227334 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:03.227334 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:03.227334 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:56:03.227334 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:56:03.227334 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bde8ccc3-582c-4d8e-8bcd-3c5711560a26 could not be found. Sep 24 20:56:03.227334 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:03.231489 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7ec0cd35-e169-4b35-8820-5b8ea3bdd2e0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Returning 404 to user: Instance bde8ccc3-582c-4d8e-8bcd-3c5711560a26 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:56:03.233036 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7ec0cd35-e169-4b35-8820-5b8ea3bdd2e0 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26" status: 404 len: 111 microversion: 2.1 time: 0.067651 Sep 24 20:56:03.234275 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 936/1878] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:03 2022] GET /compute/v2.1/servers/bde8ccc3-582c-4d8e-8bcd-3c5711560a26 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:56:03.242248 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-12170239-e2a8-4150-b8ac-663212af07ce tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] Action: 'create', calling method: .version_select at 0x7f4b1116fca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-604822047", "description": "tempest-description-130990814"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:03.297042 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c7da86a1-8125-4050-b3a2-c1663cc00d6d tempest-FloatingIPsTestJSON-1952344289 tempest-FloatingIPsTestJSON-1952344289-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips/0c893aca-22c2-4416-a851-2a71158b2340" status: 200 len: 142 microversion: 2.1 time: 0.595270 Sep 24 20:56:03.299557 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 943/1879] 10.222.0.52 () {58 vars in 1260 bytes} [Sat Sep 24 20:56:02 2022] GET /compute/v2.1/os-floating-ips/0c893aca-22c2-4416-a851-2a71158b2340 => generated 142 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:56:03.313224 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e15fde1f-3473-41c7-a346-2734da0c12af tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:03.319397 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e15fde1f-3473-41c7-a346-2734da0c12af tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:03.342596 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e15fde1f-3473-41c7-a346-2734da0c12af tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:03.343467 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e15fde1f-3473-41c7-a346-2734da0c12af tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:03.344227 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e15fde1f-3473-41c7-a346-2734da0c12af tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:03.345294 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e15fde1f-3473-41c7-a346-2734da0c12af tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:03.346009 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e15fde1f-3473-41c7-a346-2734da0c12af tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:03.347586 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e15fde1f-3473-41c7-a346-2734da0c12af tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:03.426667 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e15fde1f-3473-41c7-a346-2734da0c12af tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:56:03.601257 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-12170239-e2a8-4150-b8ac-663212af07ce tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.365449 Sep 24 20:56:03.602069 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 937/1880] 10.222.0.52 () {60 vars in 1180 bytes} [Sat Sep 24 20:56:03 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:56:03.615703 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d9f87230-c074-4488-adbd-1739145671c8 tempest-FloatingIPsTestJSON-1952344289 tempest-FloatingIPsTestJSON-1952344289-project] Calling method '.version_select at 0x7f4b111cc820>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:03.657186 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e15fde1f-3473-41c7-a346-2734da0c12af tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 204 len: 0 microversion: 2.1 time: 0.355283 Sep 24 20:56:03.658557 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 944/1881] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:56:03 2022] DELETE /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:56:03.679612 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8aa3eafc-2b31-4181-99b3-875a0f49979c tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] Action: 'create', calling method: .version_select at 0x7f4b110be310>, body: {"security_group_rule": {"parent_group_id": "cebf0f11-c071-4aa7-8efe-e1f2ec60c406", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "6e135d8c-43b4-42d1-9570-63e8a877be4b"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:04.654305 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d9f87230-c074-4488-adbd-1739145671c8 tempest-FloatingIPsTestJSON-1952344289 tempest-FloatingIPsTestJSON-1952344289-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 1.050585 Sep 24 20:56:04.656821 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 938/1882] 10.222.0.52 () {58 vars in 1149 bytes} [Sat Sep 24 20:56:03 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:56:04.666041 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-949cd4a0-ba07-4aee-a1f4-499a287730ff tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:04.670022 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-949cd4a0-ba07-4aee-a1f4-499a287730ff tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:04.685641 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-949cd4a0-ba07-4aee-a1f4-499a287730ff tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:04.686167 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-949cd4a0-ba07-4aee-a1f4-499a287730ff tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:04.687501 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-949cd4a0-ba07-4aee-a1f4-499a287730ff tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:04.688277 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-949cd4a0-ba07-4aee-a1f4-499a287730ff tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:04.688754 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-949cd4a0-ba07-4aee-a1f4-499a287730ff tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:04.689199 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-949cd4a0-ba07-4aee-a1f4-499a287730ff tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:05.112989 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8aa3eafc-2b31-4181-99b3-875a0f49979c tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.451695 Sep 24 20:56:05.113604 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 945/1883] 10.222.0.52 () {60 vars in 1195 bytes} [Sat Sep 24 20:56:03 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:56:05.124799 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8bc47ace-2ff2-4a30-aaa8-f3dd081cc0b7 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:05.125867 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8bc47ace-2ff2-4a30-aaa8-f3dd081cc0b7 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:05.147636 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-949cd4a0-ba07-4aee-a1f4-499a287730ff tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:05.148305 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8bc47ace-2ff2-4a30-aaa8-f3dd081cc0b7 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:05.148709 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8bc47ace-2ff2-4a30-aaa8-f3dd081cc0b7 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:05.149168 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8bc47ace-2ff2-4a30-aaa8-f3dd081cc0b7 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:05.149915 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8bc47ace-2ff2-4a30-aaa8-f3dd081cc0b7 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:05.150387 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8bc47ace-2ff2-4a30-aaa8-f3dd081cc0b7 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:05.150860 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8bc47ace-2ff2-4a30-aaa8-f3dd081cc0b7 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:05.156256 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-949cd4a0-ba07-4aee-a1f4-499a287730ff tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1198 microversion: 2.1 time: 0.498334 Sep 24 20:56:05.160738 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 939/1884] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:04 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1198 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:05.406882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2a451aa1-e6f4-4107-9224-97dcb5076df3 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1003414728", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "c529e650-5f5f-4183-be3c-902fe3314684"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:05.465405 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8bc47ace-2ff2-4a30-aaa8-f3dd081cc0b7 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93982876b1e24efb8ffa8c009532343a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349d3aa8627644d59867a744695f2579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:05.481969 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8bc47ace-2ff2-4a30-aaa8-f3dd081cc0b7 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 200 len: 1468 microversion: 2.1 time: 0.366923 Sep 24 20:56:05.484488 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 946/1885] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:05 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 1468 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:05.500590 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-327f1c50-adf0-491c-b573-c6bfbf7ebdfa req-f004f8a7-6af8-4b6f-93c4-fa7f64675e8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eeb37e4-c327-4c29-a1a9-ae517e3e55ea", "name": "network-vif-plugged", "status": "completed", "tag": "abcad753-fa76-461f-a30f-d6161dbdea13"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:05.512367 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:56:05.515525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-327f1c50-adf0-491c-b573-c6bfbf7ebdfa req-f004f8a7-6af8-4b6f-93c4-fa7f64675e8d service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:05.516223 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-327f1c50-adf0-491c-b573-c6bfbf7ebdfa req-f004f8a7-6af8-4b6f-93c4-fa7f64675e8d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:05.517458 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-327f1c50-adf0-491c-b573-c6bfbf7ebdfa req-f004f8a7-6af8-4b6f-93c4-fa7f64675e8d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:05.543757 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-327f1c50-adf0-491c-b573-c6bfbf7ebdfa req-f004f8a7-6af8-4b6f-93c4-fa7f64675e8d service nova] Creating event network-vif-plugged:abcad753-fa76-461f-a30f-d6161dbdea13 for instance 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea on nch1-master-1 Sep 24 20:56:05.545484 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-2a451aa1-e6f4-4107-9224-97dcb5076df3 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] validate_networks() for [('c529e650-5f5f-4183-be3c-902fe3314684', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:56:05.556111 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-327f1c50-adf0-491c-b573-c6bfbf7ebdfa req-f004f8a7-6af8-4b6f-93c4-fa7f64675e8d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068728 Sep 24 20:56:05.557561 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 947/1886] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:56:05.562944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c788c630-1d08-4236-a2c0-52b5371e38a5 tempest-FloatingIPsTestJSON-1952344289 tempest-FloatingIPsTestJSON-1952344289-project] Calling method '.version_select at 0x7f4b110c7dc0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:07.111230 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-2a451aa1-e6f4-4107-9224-97dcb5076df3 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:56:07.112811 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-2a451aa1-e6f4-4107-9224-97dcb5076df3 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:56:07.113877 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-2a451aa1-e6f4-4107-9224-97dcb5076df3 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:56:07.114482 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-2a451aa1-e6f4-4107-9224-97dcb5076df3 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:56:07.115113 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-2a451aa1-e6f4-4107-9224-97dcb5076df3 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:56:07.144803 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2a451aa1-e6f4-4107-9224-97dcb5076df3 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:07.147040 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2a451aa1-e6f4-4107-9224-97dcb5076df3 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:07.154866 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2a451aa1-e6f4-4107-9224-97dcb5076df3 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:07.160749 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2a451aa1-e6f4-4107-9224-97dcb5076df3 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:07.162808 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2a451aa1-e6f4-4107-9224-97dcb5076df3 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:07.165199 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2a451aa1-e6f4-4107-9224-97dcb5076df3 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:07.224404 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-2a451aa1-e6f4-4107-9224-97dcb5076df3 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Getting quotas for project 8afe75ffdb814e0ba23546cf3866ceac. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:56:07.230997 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-2a451aa1-e6f4-4107-9224-97dcb5076df3 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Getting quotas for user 302ac6f497cf4d3c8c638f5b4b49f723 and project 8afe75ffdb814e0ba23546cf3866ceac. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:56:07.262375 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2a451aa1-e6f4-4107-9224-97dcb5076df3 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:56:07.264745 ncdv-master-1 devstack@n-api.service[140516]: WARNING nova.utils [None req-2a451aa1-e6f4-4107-9224-97dcb5076df3 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1003414728 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-100341472 Sep 24 20:56:07.265782 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2a451aa1-e6f4-4107-9224-97dcb5076df3 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] [instance: 834ff250-11c3-4391-aae5-7f3e6fa33166] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:56:07.368399 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2a451aa1-e6f4-4107-9224-97dcb5076df3 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.206449 Sep 24 20:56:07.369734 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 940/1887] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:56:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2208 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:56:07.374912 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f47bc0e8-8390-46bf-8e48-4689c7f17778 tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] Calling method '.version_select at 0x7f4b1112c8b0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:08.145631 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f47bc0e8-8390-46bf-8e48-4689c7f17778 tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/6e135d8c-43b4-42d1-9570-63e8a877be4b" status: 202 len: 0 microversion: 2.1 time: 0.774444 Sep 24 20:56:08.147449 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 941/1888] 10.222.0.52 () {58 vars in 1272 bytes} [Sat Sep 24 20:56:07 2022] DELETE /compute/v2.1/os-security-groups/6e135d8c-43b4-42d1-9570-63e8a877be4b => generated 0 bytes in 777 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:56:08.152752 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3acc95ee-76dc-4144-8957-395dfc7f784c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:08.153637 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3acc95ee-76dc-4144-8957-395dfc7f784c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:08.179394 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3acc95ee-76dc-4144-8957-395dfc7f784c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:08.180082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3acc95ee-76dc-4144-8957-395dfc7f784c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:08.180710 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3acc95ee-76dc-4144-8957-395dfc7f784c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:08.181607 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3acc95ee-76dc-4144-8957-395dfc7f784c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:08.182289 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3acc95ee-76dc-4144-8957-395dfc7f784c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:08.182983 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3acc95ee-76dc-4144-8957-395dfc7f784c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:08.607316 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c788c630-1d08-4236-a2c0-52b5371e38a5 tempest-FloatingIPsTestJSON-1952344289 tempest-FloatingIPsTestJSON-1952344289-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/0c893aca-22c2-4416-a851-2a71158b2340" status: 202 len: 0 microversion: 2.1 time: 3.047909 Sep 24 20:56:08.609269 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 948/1889] 10.222.0.52 () {58 vars in 1263 bytes} [Sat Sep 24 20:56:05 2022] DELETE /compute/v2.1/os-floating-ips/0c893aca-22c2-4416-a851-2a71158b2340 => generated 0 bytes in 3051 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:56:08.620724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4ab49135-441d-40a4-afca-e61b7e6e8412 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:08.621479 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4ab49135-441d-40a4-afca-e61b7e6e8412 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] [instance: f389d01c-08ec-42e6-81a1-85aedcdfe42e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:08.638326 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ab49135-441d-40a4-afca-e61b7e6e8412 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:08.638885 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ab49135-441d-40a4-afca-e61b7e6e8412 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:08.639519 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ab49135-441d-40a4-afca-e61b7e6e8412 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:08.640326 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ab49135-441d-40a4-afca-e61b7e6e8412 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:08.640796 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ab49135-441d-40a4-afca-e61b7e6e8412 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:08.641231 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ab49135-441d-40a4-afca-e61b7e6e8412 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:08.676538 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-4ab49135-441d-40a4-afca-e61b7e6e8412 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] HTTP exception thrown: Instance f389d01c-08ec-42e6-81a1-85aedcdfe42e could not be found. Sep 24 20:56:08.695764 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4ab49135-441d-40a4-afca-e61b7e6e8412 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Request method failure captured: Sep 24 20:56:08.695764 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e HTTP/1.1 Sep 24 20:56:08.695764 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:56:08.695764 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:56:08.695764 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:56:08.695764 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:56:08.695764 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:56:08.695764 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:56:08.695764 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:56:08.695764 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:56:08.695764 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL22AH--cPMnXJJd4QEnLriiYfB-w2A-yE5jCCcHhGxiq35NRxCuRY3j9uVE-aco-xiGNm5JbBY89pNNBwEc_CSyxIUrHMKp_PTqtE3xF_aDC7uBbmtCAbwdBtpCdOHudl2IaI-pxz1mpiD8H1-ZYDP3b2uTg8cCogwfCwUryxb4V3gs Sep 24 20:56:08.695764 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:56:08.695764 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:56:08.695764 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:56:08.695764 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:56:08.695764 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:56:08.695764 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:56:08.695764 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 349d3aa8627644d59867a744695f2579 Sep 24 20:56:08.695764 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-MigrationsAdminTest-1468292266 Sep 24 20:56:08.695764 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:56:08.695764 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:56:08.697364 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/349d3aa8627644d59867a744695f2579"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_349d3aa8627644d59867a744695f2579"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/349d3aa8627644d59867a744695f2579"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/349d3aa8627644d59867a744695f2579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:56:08.697364 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-MigrationsAdminTest-1468292266 Sep 24 20:56:08.697364 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 349d3aa8627644d59867a744695f2579 Sep 24 20:56:08.697364 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-MigrationsAdminTest-1468292266 Sep 24 20:56:08.697364 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-MigrationsAdminTest-1468292266-project Sep 24 20:56:08.697364 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:56:08.697364 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:56:08.697364 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 93982876b1e24efb8ffa8c009532343a Sep 24 20:56:08.697364 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-MigrationsAdminTest-1468292266-project Sep 24 20:56:08.697364 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:56:08.697364 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance f389d01c-08ec-42e6-81a1-85aedcdfe42e could not be found. Sep 24 20:56:08.697364 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'f389d01c-08ec-42e6-81a1-85aedcdfe42e'} Sep 24 20:56:08.698200 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:56:08.698200 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:08.698200 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:56:08.698200 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:56:08.698200 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:56:08.698200 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:56:08.698200 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:56:08.698200 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:56:08.698200 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:56:08.698200 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:56:08.698200 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f389d01c-08ec-42e6-81a1-85aedcdfe42e could not be found. Sep 24 20:56:08.698200 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:08.698200 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:08.698200 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:08.698200 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:08.698200 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:08.698200 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:08.698200 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:56:08.698200 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:56:08.698200 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:56:08.699867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:56:08.699867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:56:08.699867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:56:08.699867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:56:08.699867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:56:08.699867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:56:08.699867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:56:08.699867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f389d01c-08ec-42e6-81a1-85aedcdfe42e could not be found. Sep 24 20:56:08.699867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:08.699867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:08.699867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:08.699867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:08.699867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:08.699867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:08.699867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:56:08.699867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:56:08.699867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f389d01c-08ec-42e6-81a1-85aedcdfe42e could not be found. Sep 24 20:56:08.699867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:08.703460 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4ab49135-441d-40a4-afca-e61b7e6e8412 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] Returning 404 to user: Instance f389d01c-08ec-42e6-81a1-85aedcdfe42e could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:56:08.707024 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4ab49135-441d-40a4-afca-e61b7e6e8412 tempest-MigrationsAdminTest-1468292266 tempest-MigrationsAdminTest-1468292266-project] 10.222.0.52 "GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e" status: 404 len: 111 microversion: 2.1 time: 0.089684 Sep 24 20:56:08.713082 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 949/1890] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:08 2022] GET /compute/v2.1/servers/f389d01c-08ec-42e6-81a1-85aedcdfe42e => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:56:08.721020 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3acc95ee-76dc-4144-8957-395dfc7f784c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:08.733644 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-5a0ce3ca-aaa1-4555-81c7-8faca0bfaf92 req-b504f5d0-8e1f-43e1-a9e2-378ed8d2ae93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f389d01c-08ec-42e6-81a1-85aedcdfe42e", "name": "network-vif-deleted", "tag": "d104313c-4d9a-4ffb-8015-0f9ee3bfbcb1"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:08.736167 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3acc95ee-76dc-4144-8957-395dfc7f784c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1382 microversion: 2.1 time: 0.587358 Sep 24 20:56:08.756644 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-5a0ce3ca-aaa1-4555-81c7-8faca0bfaf92 req-b504f5d0-8e1f-43e1-a9e2-378ed8d2ae93 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:08.757310 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-5a0ce3ca-aaa1-4555-81c7-8faca0bfaf92 req-b504f5d0-8e1f-43e1-a9e2-378ed8d2ae93 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:08.757862 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-5a0ce3ca-aaa1-4555-81c7-8faca0bfaf92 req-b504f5d0-8e1f-43e1-a9e2-378ed8d2ae93 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:08.763182 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 942/1891] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:08 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1382 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:08.775046 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-94d5e80f-7ca1-40ae-ab8f-da24b1afa347 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:08.781459 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-5a0ce3ca-aaa1-4555-81c7-8faca0bfaf92 req-b504f5d0-8e1f-43e1-a9e2-378ed8d2ae93 service nova] Creating event network-vif-deleted:d104313c-4d9a-4ffb-8015-0f9ee3bfbcb1 for instance f389d01c-08ec-42e6-81a1-85aedcdfe42e on nch2-master-1 Sep 24 20:56:08.786102 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-94d5e80f-7ca1-40ae-ab8f-da24b1afa347 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] [instance: 834ff250-11c3-4391-aae5-7f3e6fa33166] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:08.789043 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-5a0ce3ca-aaa1-4555-81c7-8faca0bfaf92 req-b504f5d0-8e1f-43e1-a9e2-378ed8d2ae93 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074151 Sep 24 20:56:08.797079 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 950/1892] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:56:08.809717 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-94d5e80f-7ca1-40ae-ab8f-da24b1afa347 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:08.809950 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0681bf61-c494-40d9-9ea3-d26bf72e48fb tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] Calling method '.version_select at 0x7f4b11018160>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:08.814018 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-94d5e80f-7ca1-40ae-ab8f-da24b1afa347 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:08.822653 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-94d5e80f-7ca1-40ae-ab8f-da24b1afa347 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:08.824533 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-94d5e80f-7ca1-40ae-ab8f-da24b1afa347 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:08.825036 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-94d5e80f-7ca1-40ae-ab8f-da24b1afa347 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:08.825488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-94d5e80f-7ca1-40ae-ab8f-da24b1afa347 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:09.105747 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-94d5e80f-7ca1-40ae-ab8f-da24b1afa347 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302ac6f497cf4d3c8c638f5b4b49f723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afe75ffdb814e0ba23546cf3866ceac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:09.121281 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-94d5e80f-7ca1-40ae-ab8f-da24b1afa347 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] 10.222.0.52 "GET /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166" status: 200 len: 1284 microversion: 2.1 time: 0.356587 Sep 24 20:56:09.129718 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 943/1893] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:08 2022] GET /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166 => generated 1284 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:09.135470 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fa8107aa-e2b4-43df-8682-ec410ed2b89c tempest-FloatingIPsTestJSON-1952344289 tempest-FloatingIPsTestJSON-1952344289-project] Action: 'create', calling method: .version_select at 0x7f4b0c996c10>, body: {"pool": null} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:09.150015 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0681bf61-c494-40d9-9ea3-d26bf72e48fb tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/cebf0f11-c071-4aa7-8efe-e1f2ec60c406" status: 200 len: 248 microversion: 2.1 time: 0.351269 Sep 24 20:56:09.151016 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 951/1894] 10.222.0.52 () {58 vars in 1269 bytes} [Sat Sep 24 20:56:08 2022] GET /compute/v2.1/os-security-groups/cebf0f11-c071-4aa7-8efe-e1f2ec60c406 => generated 248 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:56:09.577442 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-522754c3-a563-4c04-8405-e02f69580099 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:09.578195 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-522754c3-a563-4c04-8405-e02f69580099 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:09.592660 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-522754c3-a563-4c04-8405-e02f69580099 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:09.593174 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-522754c3-a563-4c04-8405-e02f69580099 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:09.593627 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-522754c3-a563-4c04-8405-e02f69580099 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:09.594365 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-522754c3-a563-4c04-8405-e02f69580099 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:09.594865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-522754c3-a563-4c04-8405-e02f69580099 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:09.595306 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-522754c3-a563-4c04-8405-e02f69580099 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:10.219363 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-522754c3-a563-4c04-8405-e02f69580099 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1533 microversion: 2.1 time: 1.066594 Sep 24 20:56:10.222139 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 952/1895] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:09 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1533 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:10.233543 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2a2d9bf1-91fd-4bdd-879e-4fab006eedea tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] Action: 'create', calling method: .version_select at 0x7f4b11018f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1707077295", "description": "tempest-description-428515259"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:11.016542 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2a2d9bf1-91fd-4bdd-879e-4fab006eedea tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.792544 Sep 24 20:56:11.017436 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 953/1896] 10.222.0.52 () {60 vars in 1180 bytes} [Sat Sep 24 20:56:10 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:56:11.027057 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-26934ce0-c4e4-431c-a44a-5e9cef5cdf2f tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:11.028633 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-26934ce0-c4e4-431c-a44a-5e9cef5cdf2f tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:11.036603 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26934ce0-c4e4-431c-a44a-5e9cef5cdf2f tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:11.037519 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26934ce0-c4e4-431c-a44a-5e9cef5cdf2f tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:11.038095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26934ce0-c4e4-431c-a44a-5e9cef5cdf2f tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:11.039139 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26934ce0-c4e4-431c-a44a-5e9cef5cdf2f tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:11.039839 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26934ce0-c4e4-431c-a44a-5e9cef5cdf2f tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:11.040478 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26934ce0-c4e4-431c-a44a-5e9cef5cdf2f tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:11.439201 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-26934ce0-c4e4-431c-a44a-5e9cef5cdf2f tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lazy-loading 'services' on Instance uuid 54ec06be-cb4b-4b5f-9ed8-904a328cc118 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:56:11.491724 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-26934ce0-c4e4-431c-a44a-5e9cef5cdf2f tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 2341 microversion: 2.25 time: 0.473093 Sep 24 20:56:11.502797 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 954/1897] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:56:11 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 2341 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:56:11.507798 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1a092f9b-48fb-4112-9a64-5f4a4b80e39c tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:11.508421 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1a092f9b-48fb-4112-9a64-5f4a4b80e39c tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] [instance: 834ff250-11c3-4391-aae5-7f3e6fa33166] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:11.540887 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a092f9b-48fb-4112-9a64-5f4a4b80e39c tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:11.541471 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a092f9b-48fb-4112-9a64-5f4a4b80e39c tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:11.541931 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a092f9b-48fb-4112-9a64-5f4a4b80e39c tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:11.542789 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a092f9b-48fb-4112-9a64-5f4a4b80e39c tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:11.543192 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a092f9b-48fb-4112-9a64-5f4a4b80e39c tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:11.549371 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a092f9b-48fb-4112-9a64-5f4a4b80e39c tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:12.631457 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1a092f9b-48fb-4112-9a64-5f4a4b80e39c tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302ac6f497cf4d3c8c638f5b4b49f723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afe75ffdb814e0ba23546cf3866ceac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:12.644768 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1a092f9b-48fb-4112-9a64-5f4a4b80e39c tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] 10.222.0.52 "GET /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166" status: 200 len: 1332 microversion: 2.1 time: 1.139472 Sep 24 20:56:12.659530 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 955/1898] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:11 2022] GET /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166 => generated 1332 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:12.659530 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c43039da-1591-4400-96b9-98e3528441c2 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:12.659530 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c43039da-1591-4400-96b9-98e3528441c2 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:12.672077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c43039da-1591-4400-96b9-98e3528441c2 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:12.674428 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c43039da-1591-4400-96b9-98e3528441c2 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:12.679987 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c43039da-1591-4400-96b9-98e3528441c2 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:12.680971 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c43039da-1591-4400-96b9-98e3528441c2 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:12.683347 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c43039da-1591-4400-96b9-98e3528441c2 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:12.683989 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c43039da-1591-4400-96b9-98e3528441c2 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:13.284911 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c43039da-1591-4400-96b9-98e3528441c2 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1533 microversion: 2.1 time: 0.633429 Sep 24 20:56:13.285914 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 956/1899] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:12 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1533 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:13.292953 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1e609f37-53a4-4d62-ade8-afe96db8e751 tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] Action: 'create', calling method: .version_select at 0x7f4b1102ff70>, body: {"security_group_rule": {"parent_group_id": "e386e3a1-bc96-41e5-bb15-7bcced6593d3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:14.127273 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fa8107aa-e2b4-43df-8682-ec410ed2b89c tempest-FloatingIPsTestJSON-1952344289 tempest-FloatingIPsTestJSON-1952344289-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.996170 Sep 24 20:56:14.129793 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 944/1900] 10.222.0.52 () {60 vars in 1170 bytes} [Sat Sep 24 20:56:09 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4999 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:56:14.135057 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-71f0df8b-55ea-460a-a980-592e027f1186 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:14.148637 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71f0df8b-55ea-460a-a980-592e027f1186 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:14.151323 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71f0df8b-55ea-460a-a980-592e027f1186 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:14.153641 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71f0df8b-55ea-460a-a980-592e027f1186 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:14.155486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71f0df8b-55ea-460a-a980-592e027f1186 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:14.159631 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71f0df8b-55ea-460a-a980-592e027f1186 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:14.161620 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71f0df8b-55ea-460a-a980-592e027f1186 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:14.206123 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:56:14.244106 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-71f0df8b-55ea-460a-a980-592e027f1186 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.112641 Sep 24 20:56:14.251959 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 945/1901] 10.222.0.52 () {60 vars in 1217 bytes} [Sat Sep 24 20:56:14 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:56:14.251959 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-dd5940a8-df77-4e77-a193-e086ef1ff66d req-d07b2189-0da6-4317-b246-8f9993a0fba7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "834ff250-11c3-4391-aae5-7f3e6fa33166", "tag": "9d899e46-f44e-4bfc-b166-96ac7ad71d19"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:14.281507 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-dd5940a8-df77-4e77-a193-e086ef1ff66d req-d07b2189-0da6-4317-b246-8f9993a0fba7 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:14.283997 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-dd5940a8-df77-4e77-a193-e086ef1ff66d req-d07b2189-0da6-4317-b246-8f9993a0fba7 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:14.285629 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-dd5940a8-df77-4e77-a193-e086ef1ff66d req-d07b2189-0da6-4317-b246-8f9993a0fba7 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:14.313030 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-dd5940a8-df77-4e77-a193-e086ef1ff66d req-d07b2189-0da6-4317-b246-8f9993a0fba7 service nova] Creating event network-changed:9d899e46-f44e-4bfc-b166-96ac7ad71d19 for instance 834ff250-11c3-4391-aae5-7f3e6fa33166 on nch2-master-1 Sep 24 20:56:14.325278 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-dd5940a8-df77-4e77-a193-e086ef1ff66d req-d07b2189-0da6-4317-b246-8f9993a0fba7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079326 Sep 24 20:56:14.326599 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 946/1902] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:56:14.340642 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-53f0dcb7-7e80-4efd-936d-5f3d672da1d2 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:14.355780 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-53f0dcb7-7e80-4efd-936d-5f3d672da1d2 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:14.356849 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-53f0dcb7-7e80-4efd-936d-5f3d672da1d2 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:14.358289 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-53f0dcb7-7e80-4efd-936d-5f3d672da1d2 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:14.360349 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-53f0dcb7-7e80-4efd-936d-5f3d672da1d2 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:14.362969 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-53f0dcb7-7e80-4efd-936d-5f3d672da1d2 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:14.364898 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-53f0dcb7-7e80-4efd-936d-5f3d672da1d2 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:14.429565 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1e609f37-53a4-4d62-ade8-afe96db8e751 tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.141910 Sep 24 20:56:14.430862 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 957/1903] 10.222.0.52 () {60 vars in 1195 bytes} [Sat Sep 24 20:56:13 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:56:14.436345 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-519f5252-8f35-4532-8e3c-df45d5131a80 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:14.437593 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-519f5252-8f35-4532-8e3c-df45d5131a80 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] [instance: 834ff250-11c3-4391-aae5-7f3e6fa33166] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:14.447256 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-53f0dcb7-7e80-4efd-936d-5f3d672da1d2 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.119186 Sep 24 20:56:14.448659 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 947/1904] 10.222.0.52 () {58 vars in 1176 bytes} [Sat Sep 24 20:56:14 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:56:14.463249 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-519f5252-8f35-4532-8e3c-df45d5131a80 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:14.463971 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-519f5252-8f35-4532-8e3c-df45d5131a80 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:14.464585 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-519f5252-8f35-4532-8e3c-df45d5131a80 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:14.466185 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-519f5252-8f35-4532-8e3c-df45d5131a80 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:14.466868 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-519f5252-8f35-4532-8e3c-df45d5131a80 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:14.467510 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-519f5252-8f35-4532-8e3c-df45d5131a80 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:14.681565 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-519f5252-8f35-4532-8e3c-df45d5131a80 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302ac6f497cf4d3c8c638f5b4b49f723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afe75ffdb814e0ba23546cf3866ceac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:14.698473 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-519f5252-8f35-4532-8e3c-df45d5131a80 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] 10.222.0.52 "GET /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166" status: 200 len: 1332 microversion: 2.1 time: 0.264985 Sep 24 20:56:14.718047 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 958/1905] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:14 2022] GET /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166 => generated 1332 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:14.727740 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-865c2eb3-590e-4b76-8d99-010f5998b33c tempest-FloatingIPsTestJSON-1952344289 tempest-FloatingIPsTestJSON-1952344289-project] Calling method '.version_select at 0x7f4b1102f160>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:14.868310 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0c41e208-e703-4a70-9a43-59db6415dbf1 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Action: 'create', calling method: .version_select at 0x7f4b11140f70>, body: {"keypair": {"name": "tempest-keypair-1348728112", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICU5ji8Sv628PvH4+/sn63v6SGPf3lzA0jCAiFQ1huQmh5778Z9Z/QsvyWmh4bs4jBJasCt8CePYZmiWZLGVmQPxzNxDvykgwMs+L3mVLPmLxd2iNvsF5FCrzIczWzQRg=="}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:14.898706 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-0c41e208-e703-4a70-9a43-59db6415dbf1 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Getting quotas for project 71f6b606beca4eb5b62c89a945be15c7. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:56:14.905657 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-0c41e208-e703-4a70-9a43-59db6415dbf1 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Getting quotas for user 3aa253ded2304ac3917a1788b6a1500b and project 71f6b606beca4eb5b62c89a945be15c7. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:56:14.976941 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0c41e208-e703-4a70-9a43-59db6415dbf1 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.525783 Sep 24 20:56:14.978200 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 948/1906] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 20:56:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:56:14.991008 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bba1b9cd-7ea3-4dfc-af36-b8e1fbc4bdb4 tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] Action: 'create', calling method: .version_select at 0x7f4b1116fe50>, body: {"security_group_rule": {"parent_group_id": "e386e3a1-bc96-41e5-bb15-7bcced6593d3", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:15.608828 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bba1b9cd-7ea3-4dfc-af36-b8e1fbc4bdb4 tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.628925 Sep 24 20:56:15.614568 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 949/1907] 10.222.0.52 () {60 vars in 1195 bytes} [Sat Sep 24 20:56:14 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:56:15.616211 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-050e2bb8-c461-4738-8320-adc45ddb0f5d tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:15.626020 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-050e2bb8-c461-4738-8320-adc45ddb0f5d tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:15.660788 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-050e2bb8-c461-4738-8320-adc45ddb0f5d tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:15.661560 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-050e2bb8-c461-4738-8320-adc45ddb0f5d tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:15.662693 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-050e2bb8-c461-4738-8320-adc45ddb0f5d tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:15.663625 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-050e2bb8-c461-4738-8320-adc45ddb0f5d tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:15.664265 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-050e2bb8-c461-4738-8320-adc45ddb0f5d tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:15.664927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-050e2bb8-c461-4738-8320-adc45ddb0f5d tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:15.721573 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-050e2bb8-c461-4738-8320-adc45ddb0f5d tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lazy-loading 'flavor' on Instance uuid 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:56:15.740716 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-050e2bb8-c461-4738-8320-adc45ddb0f5d tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Going to try to live migrate instance to nch2-master-1 {{(pid=140516) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 24 20:56:16.292415 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-865c2eb3-590e-4b76-8d99-010f5998b33c tempest-FloatingIPsTestJSON-1952344289 tempest-FloatingIPsTestJSON-1952344289-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/35504ce5-d824-4773-869e-90081dab792f" status: 202 len: 0 microversion: 2.1 time: 1.572517 Sep 24 20:56:16.293081 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 959/1908] 10.222.0.52 () {58 vars in 1263 bytes} [Sat Sep 24 20:56:14 2022] DELETE /compute/v2.1/os-floating-ips/35504ce5-d824-4773-869e-90081dab792f => generated 0 bytes in 1574 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:56:16.495282 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7dd951ab-e90c-4e57-ba25-58418075e473 tempest-QuotaClassesAdmin257Test-378221869 tempest-QuotaClassesAdmin257Test-378221869-project-admin] Calling method '.version_select at 0x7f4b0c735280>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:16.525815 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7dd951ab-e90c-4e57-ba25-58418075e473 tempest-QuotaClassesAdmin257Test-378221869 tempest-QuotaClassesAdmin257Test-378221869-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.231562 Sep 24 20:56:16.527017 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 960/1909] 10.222.0.52 () {60 vars in 1226 bytes} [Sat Sep 24 20:56:16 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:56:16.537514 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8473c3b6-090f-4dd6-8b82-2db4e2cd7281 tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] Calling method '.version_select at 0x7f4b0c0519d0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:16.665249 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8473c3b6-090f-4dd6-8b82-2db4e2cd7281 tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/e386e3a1-bc96-41e5-bb15-7bcced6593d3" status: 200 len: 664 microversion: 2.1 time: 0.136882 Sep 24 20:56:16.666034 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 961/1910] 10.222.0.52 () {58 vars in 1269 bytes} [Sat Sep 24 20:56:16 2022] GET /compute/v2.1/os-security-groups/e386e3a1-bc96-41e5-bb15-7bcced6593d3 => generated 664 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:56:16.671177 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-87bacff5-6b58-4269-9ece-19746ec52ffc tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:16.672123 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-87bacff5-6b58-4269-9ece-19746ec52ffc tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] [instance: 834ff250-11c3-4391-aae5-7f3e6fa33166] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:16.691566 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-87bacff5-6b58-4269-9ece-19746ec52ffc tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:16.692595 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-87bacff5-6b58-4269-9ece-19746ec52ffc tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:16.693401 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-87bacff5-6b58-4269-9ece-19746ec52ffc tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:16.694380 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-87bacff5-6b58-4269-9ece-19746ec52ffc tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:16.695075 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-87bacff5-6b58-4269-9ece-19746ec52ffc tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:16.696110 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-87bacff5-6b58-4269-9ece-19746ec52ffc tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:16.952524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-87bacff5-6b58-4269-9ece-19746ec52ffc tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302ac6f497cf4d3c8c638f5b4b49f723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afe75ffdb814e0ba23546cf3866ceac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:16.962810 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-87bacff5-6b58-4269-9ece-19746ec52ffc tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] 10.222.0.52 "GET /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166" status: 200 len: 1332 microversion: 2.1 time: 0.295320 Sep 24 20:56:16.963810 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 962/1911] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:16 2022] GET /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166 => generated 1332 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:16.970214 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dee57e90-006a-4ff6-95f4-a3bf18349f4e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f910cbdd-fbe4-4cac-bdb7-3b663c4f26d2", "device": "/dev/xvdb"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:16.973879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dee57e90-006a-4ff6-95f4-a3bf18349f4e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:16.981910 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dee57e90-006a-4ff6-95f4-a3bf18349f4e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:16.982741 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dee57e90-006a-4ff6-95f4-a3bf18349f4e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:16.983432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dee57e90-006a-4ff6-95f4-a3bf18349f4e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:16.984398 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dee57e90-006a-4ff6-95f4-a3bf18349f4e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:16.985082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dee57e90-006a-4ff6-95f4-a3bf18349f4e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:16.985734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dee57e90-006a-4ff6-95f4-a3bf18349f4e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:17.499600 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dee57e90-006a-4ff6-95f4-a3bf18349f4e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "POST /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.533071 Sep 24 20:56:17.506580 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 963/1912] 10.222.0.52 () {62 vars in 1364 bytes} [Sat Sep 24 20:56:16 2022] POST /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 194 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:56:17.507223 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-257c38b2-5dd1-44a8-bac7-99971ee11c8c tempest-FloatingIPsTestJSON-1952344289 tempest-FloatingIPsTestJSON-1952344289-project] Calling method '.version_select at 0x7f4b111048b0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:17.570391 ncdv-master-1 devstack@n-api.service[140517]: DEBUG neutronclient.v2_0.client [None req-257c38b2-5dd1-44a8-bac7-99971ee11c8c tempest-FloatingIPsTestJSON-1952344289 tempest-FloatingIPsTestJSON-1952344289-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 35504ce5-d824-4773-869e-90081dab792f could not be found", "detail": ""}} {{(pid=140517) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 24 20:56:17.571134 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-257c38b2-5dd1-44a8-bac7-99971ee11c8c tempest-FloatingIPsTestJSON-1952344289 tempest-FloatingIPsTestJSON-1952344289-project] HTTP exception thrown: Floating IP not found for ID 35504ce5-d824-4773-869e-90081dab792f Sep 24 20:56:17.580049 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-257c38b2-5dd1-44a8-bac7-99971ee11c8c tempest-FloatingIPsTestJSON-1952344289 tempest-FloatingIPsTestJSON-1952344289-project] Request method failure captured: Sep 24 20:56:17.580049 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/os-floating-ips/35504ce5-d824-4773-869e-90081dab792f HTTP/1.1 Sep 24 20:56:17.580049 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:56:17.580049 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:56:17.580049 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:56:17.580049 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:56:17.580049 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:56:17.580049 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:56:17.580049 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:56:17.580049 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:56:17.580049 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL27bbaybxICkBtJONN1AJvcotSJoeT8d_pNCUjiHYnh7Dre-XsbJPoMEUaeVmIDYSyfW4Uii3e1AjvBaJOVh4i9wsDuPtVvrvg64UcyMHQVtiVEyL9RtxL1PkGynuCfpzwQSXX_XgKZosJgEJv-xlPdf-yOkrtsXQYkTZ_xlXxgufN0 Sep 24 20:56:17.580049 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:56:17.580049 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:56:17.580049 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:56:17.580049 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:56:17.580049 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:56:17.580049 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:56:17.580049 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 9b6e724ba5a849a2ac33fba2b3868ccc Sep 24 20:56:17.580049 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-FloatingIPsTestJSON-1952344289 Sep 24 20:56:17.580049 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:56:17.580049 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:56:17.582040 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9b6e724ba5a849a2ac33fba2b3868ccc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9b6e724ba5a849a2ac33fba2b3868ccc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9b6e724ba5a849a2ac33fba2b3868ccc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9b6e724ba5a849a2ac33fba2b3868ccc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:56:17.582040 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-FloatingIPsTestJSON-1952344289 Sep 24 20:56:17.582040 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 9b6e724ba5a849a2ac33fba2b3868ccc Sep 24 20:56:17.582040 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1952344289 Sep 24 20:56:17.582040 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-FloatingIPsTestJSON-1952344289-project Sep 24 20:56:17.582040 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:56:17.582040 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:56:17.582040 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 6c381100cbcb4f128438e334e9beca6b Sep 24 20:56:17.582040 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-FloatingIPsTestJSON-1952344289-project Sep 24 20:56:17.582040 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 20:56:17.582040 ncdv-master-1 devstack@n-api.service[140517]: exception: Floating IP not found for ID 35504ce5-d824-4773-869e-90081dab792f Sep 24 20:56:17.582040 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '35504ce5-d824-4773-869e-90081dab792f'} Sep 24 20:56:17.582040 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:56:17.583567 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:17.583567 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 24 20:56:17.583567 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 24 20:56:17.583567 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:56:17.583567 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:56:17.583567 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 24 20:56:17.583567 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 24 20:56:17.583567 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:56:17.583567 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:56:17.583567 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 24 20:56:17.583567 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 24 20:56:17.583567 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:56:17.583567 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:56:17.583567 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 24 20:56:17.583567 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 24 20:56:17.583567 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:56:17.583567 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:56:17.583567 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 24 20:56:17.583567 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 24 20:56:17.585918 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:56:17.585918 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:56:17.585918 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 24 20:56:17.585918 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 24 20:56:17.585918 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 24 20:56:17.585918 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 24 20:56:17.585918 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 35504ce5-d824-4773-869e-90081dab792f could not be found Sep 24 20:56:17.585918 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-40921d6e-9604-40f4-8be9-3b5a27e86fb7'] Sep 24 20:56:17.585918 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:17.585918 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:17.585918 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:17.585918 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:17.585918 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 24 20:56:17.585918 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 24 20:56:17.585918 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 24 20:56:17.585918 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 24 20:56:17.585918 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 35504ce5-d824-4773-869e-90081dab792f. Sep 24 20:56:17.585918 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:17.585918 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:17.585918 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:17.589225 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:17.589225 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:17.589225 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:17.589225 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:56:17.589225 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:56:17.589225 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:56:17.589225 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:56:17.589225 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:56:17.589225 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:56:17.589225 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 24 20:56:17.589225 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 24 20:56:17.589225 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 35504ce5-d824-4773-869e-90081dab792f Sep 24 20:56:17.589225 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:17.589225 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:17.589225 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:17.589225 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:17.589225 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:17.589225 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:17.589225 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:56:17.589225 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:56:17.593052 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 35504ce5-d824-4773-869e-90081dab792f Sep 24 20:56:17.593052 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:17.593052 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-257c38b2-5dd1-44a8-bac7-99971ee11c8c tempest-FloatingIPsTestJSON-1952344289 tempest-FloatingIPsTestJSON-1952344289-project] Returning 404 to user: Floating IP not found for ID 35504ce5-d824-4773-869e-90081dab792f {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:56:17.593052 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-257c38b2-5dd1-44a8-bac7-99971ee11c8c tempest-FloatingIPsTestJSON-1952344289 tempest-FloatingIPsTestJSON-1952344289-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips/35504ce5-d824-4773-869e-90081dab792f" status: 404 len: 111 microversion: 2.1 time: 0.080446 Sep 24 20:56:17.593052 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 964/1913] 10.222.0.52 () {58 vars in 1260 bytes} [Sat Sep 24 20:56:17 2022] GET /compute/v2.1/os-floating-ips/35504ce5-d824-4773-869e-90081dab792f => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:56:17.593052 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1b9336ed-c521-407d-8eb5-34d580f3f684 tempest-QuotaClassesAdmin257Test-378221869 tempest-QuotaClassesAdmin257Test-378221869-project-admin] Action: 'update', calling method: .version_select at 0x7f4b0cf3e9d0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:17.788716 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1b9336ed-c521-407d-8eb5-34d580f3f684 tempest-QuotaClassesAdmin257Test-378221869 tempest-QuotaClassesAdmin257Test-378221869-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.200537 Sep 24 20:56:17.789742 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 965/1914] 10.222.0.52 () {62 vars in 1247 bytes} [Sat Sep 24 20:56:17 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:56:17.798082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-887fb839-43ff-4739-b26c-0f934ec21644 tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] Calling method '.version_select at 0x7f4b110aa5e0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:18.178590 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-887fb839-43ff-4739-b26c-0f934ec21644 tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-group-rules/6acb6c22-0c6c-4c1b-b72f-3d633e461c36" status: 202 len: 0 microversion: 2.1 time: 0.386759 Sep 24 20:56:18.179365 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 966/1915] 10.222.0.52 () {58 vars in 1287 bytes} [Sat Sep 24 20:56:17 2022] DELETE /compute/v2.1/os-security-group-rules/6acb6c22-0c6c-4c1b-b72f-3d633e461c36 => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:56:18.184779 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-904cb26a-c9cc-406b-950c-65ac34fafba1 tempest-FloatingIPsTestJSON-1952344289 tempest-FloatingIPsTestJSON-1952344289-project] Calling method '.version_select at 0x7f4b1109eb80>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:18.314313 ncdv-master-1 devstack@n-api.service[140517]: DEBUG neutronclient.v2_0.client [None req-904cb26a-c9cc-406b-950c-65ac34fafba1 tempest-FloatingIPsTestJSON-1952344289 tempest-FloatingIPsTestJSON-1952344289-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 35504ce5-d824-4773-869e-90081dab792f could not be found", "detail": ""}} {{(pid=140517) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 24 20:56:18.316081 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-904cb26a-c9cc-406b-950c-65ac34fafba1 tempest-FloatingIPsTestJSON-1952344289 tempest-FloatingIPsTestJSON-1952344289-project] HTTP exception thrown: Floating IP not found for ID 35504ce5-d824-4773-869e-90081dab792f Sep 24 20:56:18.326874 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-904cb26a-c9cc-406b-950c-65ac34fafba1 tempest-FloatingIPsTestJSON-1952344289 tempest-FloatingIPsTestJSON-1952344289-project] Request method failure captured: Sep 24 20:56:18.326874 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/os-floating-ips/35504ce5-d824-4773-869e-90081dab792f HTTP/1.1 Sep 24 20:56:18.326874 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:56:18.326874 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:56:18.326874 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:56:18.326874 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:56:18.326874 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:56:18.326874 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:56:18.326874 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:56:18.326874 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:56:18.326874 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL27bbaybxICkBtJONN1AJvcotSJoeT8d_pNCUjiHYnh7Dre-XsbJPoMEUaeVmIDYSyfW4Uii3e1AjvBaJOVh4i9wsDuPtVvrvg64UcyMHQVtiVEyL9RtxL1PkGynuCfpzwQSXX_XgKZosJgEJv-xlPdf-yOkrtsXQYkTZ_xlXxgufN0 Sep 24 20:56:18.326874 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:56:18.326874 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:56:18.326874 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:56:18.326874 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:56:18.326874 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:56:18.326874 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:56:18.326874 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 9b6e724ba5a849a2ac33fba2b3868ccc Sep 24 20:56:18.326874 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-FloatingIPsTestJSON-1952344289 Sep 24 20:56:18.326874 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:56:18.326874 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:56:18.328649 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9b6e724ba5a849a2ac33fba2b3868ccc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9b6e724ba5a849a2ac33fba2b3868ccc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9b6e724ba5a849a2ac33fba2b3868ccc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9b6e724ba5a849a2ac33fba2b3868ccc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:56:18.328649 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-FloatingIPsTestJSON-1952344289 Sep 24 20:56:18.328649 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 9b6e724ba5a849a2ac33fba2b3868ccc Sep 24 20:56:18.328649 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1952344289 Sep 24 20:56:18.328649 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-FloatingIPsTestJSON-1952344289-project Sep 24 20:56:18.328649 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:56:18.328649 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:56:18.328649 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 6c381100cbcb4f128438e334e9beca6b Sep 24 20:56:18.328649 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-FloatingIPsTestJSON-1952344289-project Sep 24 20:56:18.328649 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 20:56:18.328649 ncdv-master-1 devstack@n-api.service[140517]: exception: Floating IP not found for ID 35504ce5-d824-4773-869e-90081dab792f Sep 24 20:56:18.328649 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '35504ce5-d824-4773-869e-90081dab792f'} Sep 24 20:56:18.328649 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:56:18.329582 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:18.329582 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 24 20:56:18.329582 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 24 20:56:18.329582 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:56:18.329582 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:56:18.329582 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 24 20:56:18.329582 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 24 20:56:18.329582 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:56:18.329582 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:56:18.329582 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 24 20:56:18.329582 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 24 20:56:18.329582 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:56:18.329582 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:56:18.329582 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 24 20:56:18.329582 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 24 20:56:18.329582 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:56:18.329582 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:56:18.329582 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 24 20:56:18.329582 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 24 20:56:18.332567 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:56:18.332567 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:56:18.332567 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 24 20:56:18.332567 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 24 20:56:18.332567 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 24 20:56:18.332567 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 24 20:56:18.332567 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 35504ce5-d824-4773-869e-90081dab792f could not be found Sep 24 20:56:18.332567 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-30ac8807-209f-407f-a2a7-464558dfe14b'] Sep 24 20:56:18.332567 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:18.332567 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:18.332567 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:18.332567 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:18.332567 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 24 20:56:18.332567 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 24 20:56:18.332567 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 24 20:56:18.332567 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 24 20:56:18.332567 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 35504ce5-d824-4773-869e-90081dab792f. Sep 24 20:56:18.332567 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:18.332567 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:18.332567 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:18.334105 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:18.334105 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:18.334105 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:18.334105 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:56:18.334105 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:56:18.334105 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:56:18.334105 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:56:18.334105 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:56:18.334105 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:56:18.334105 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 24 20:56:18.334105 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 24 20:56:18.334105 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 35504ce5-d824-4773-869e-90081dab792f Sep 24 20:56:18.334105 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:18.334105 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:18.334105 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:18.334105 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:18.334105 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:18.334105 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:18.334105 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:56:18.334105 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:56:18.335460 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 35504ce5-d824-4773-869e-90081dab792f Sep 24 20:56:18.335460 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:18.341728 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-904cb26a-c9cc-406b-950c-65ac34fafba1 tempest-FloatingIPsTestJSON-1952344289 tempest-FloatingIPsTestJSON-1952344289-project] Returning 404 to user: Floating IP not found for ID 35504ce5-d824-4773-869e-90081dab792f {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:56:18.354263 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-904cb26a-c9cc-406b-950c-65ac34fafba1 tempest-FloatingIPsTestJSON-1952344289 tempest-FloatingIPsTestJSON-1952344289-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/35504ce5-d824-4773-869e-90081dab792f" status: 404 len: 111 microversion: 2.1 time: 0.162467 Sep 24 20:56:18.362805 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 967/1916] 10.222.0.52 () {58 vars in 1263 bytes} [Sat Sep 24 20:56:18 2022] DELETE /compute/v2.1/os-floating-ips/35504ce5-d824-4773-869e-90081dab792f => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:56:18.389850 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5c22282e-25ab-4cac-b44b-8c2432fba3b1 tempest-QuotaClassesAdmin257Test-378221869 tempest-QuotaClassesAdmin257Test-378221869-project-admin] Calling method '.version_select at 0x7f4b110c7430>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:18.459603 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5c22282e-25ab-4cac-b44b-8c2432fba3b1 tempest-QuotaClassesAdmin257Test-378221869 tempest-QuotaClassesAdmin257Test-378221869-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.075560 Sep 24 20:56:18.460292 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 968/1917] 10.222.0.52 () {60 vars in 1226 bytes} [Sat Sep 24 20:56:18 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:56:18.476853 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b63fee6e-469f-4c2e-989c-17370b0cb213 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:18.477840 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b63fee6e-469f-4c2e-989c-17370b0cb213 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] [instance: 834ff250-11c3-4391-aae5-7f3e6fa33166] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:18.506692 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b63fee6e-469f-4c2e-989c-17370b0cb213 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:18.507350 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b63fee6e-469f-4c2e-989c-17370b0cb213 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:18.507680 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b63fee6e-469f-4c2e-989c-17370b0cb213 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:18.512494 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b63fee6e-469f-4c2e-989c-17370b0cb213 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:18.516263 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b63fee6e-469f-4c2e-989c-17370b0cb213 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:18.517228 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b63fee6e-469f-4c2e-989c-17370b0cb213 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:18.737533 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-050e2bb8-c461-4738-8320-adc45ddb0f5d tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea/action" status: 202 len: 0 microversion: 2.1 time: 3.126040 Sep 24 20:56:18.739941 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 950/1918] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:56:15 2022] POST /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea/action => generated 0 bytes in 3129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:56:18.766717 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6414b05b-44cd-4bdc-9303-27e1ca5cea6a tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] Calling method '.version_select at 0x7f4b111cc310>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:19.207185 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6414b05b-44cd-4bdc-9303-27e1ca5cea6a tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/e386e3a1-bc96-41e5-bb15-7bcced6593d3" status: 202 len: 0 microversion: 2.1 time: 0.465491 Sep 24 20:56:19.207715 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 951/1919] 10.222.0.52 () {58 vars in 1272 bytes} [Sat Sep 24 20:56:18 2022] DELETE /compute/v2.1/os-security-groups/e386e3a1-bc96-41e5-bb15-7bcced6593d3 => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:56:19.215768 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8f67934d-389e-4e36-b6c0-5539969b666b tempest-QuotaClassesAdmin257Test-378221869 tempest-QuotaClassesAdmin257Test-378221869-project-admin] Action: 'update', calling method: .version_select at 0x7f4b111cc670>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:19.271154 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b63fee6e-469f-4c2e-989c-17370b0cb213 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302ac6f497cf4d3c8c638f5b4b49f723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afe75ffdb814e0ba23546cf3866ceac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:19.273751 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:56:19.288020 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b63fee6e-469f-4c2e-989c-17370b0cb213 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] 10.222.0.52 "GET /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166" status: 200 len: 1332 microversion: 2.1 time: 0.823952 Sep 24 20:56:19.303880 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 969/1920] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:18 2022] GET /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166 => generated 1332 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:19.303880 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9c171810-4f36-450b-b546-fa3610588c63 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:19.303880 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9c171810-4f36-450b-b546-fa3610588c63 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:19.318535 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c171810-4f36-450b-b546-fa3610588c63 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:19.319074 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c171810-4f36-450b-b546-fa3610588c63 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:19.319530 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c171810-4f36-450b-b546-fa3610588c63 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:19.320277 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c171810-4f36-450b-b546-fa3610588c63 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:19.320748 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c171810-4f36-450b-b546-fa3610588c63 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:19.321213 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c171810-4f36-450b-b546-fa3610588c63 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:19.337034 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8f67934d-389e-4e36-b6c0-5539969b666b tempest-QuotaClassesAdmin257Test-378221869 tempest-QuotaClassesAdmin257Test-378221869-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.125127 Sep 24 20:56:19.337807 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 952/1921] 10.222.0.52 () {62 vars in 1247 bytes} [Sat Sep 24 20:56:19 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:56:19.344068 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e4e0d557-7457-4115-a672-077d2ac11666 tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] Calling method '.version_select at 0x7f4b1117b3a0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:19.380223 ncdv-master-1 devstack@n-api.service[140516]: DEBUG neutronclient.v2_0.client [None req-e4e0d557-7457-4115-a672-077d2ac11666 tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6e135d8c-43b4-42d1-9570-63e8a877be4b does not exist", "detail": ""}} {{(pid=140516) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 24 20:56:19.381093 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.security_group_api [None req-e4e0d557-7457-4115-a672-077d2ac11666 tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] Neutron security group 6e135d8c-43b4-42d1-9570-63e8a877be4b not found {{(pid=140516) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 24 20:56:19.381844 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-e4e0d557-7457-4115-a672-077d2ac11666 tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] HTTP exception thrown: Security group 6e135d8c-43b4-42d1-9570-63e8a877be4b does not exist Sep 24 20:56:19.381844 ncdv-master-1 devstack@n-api.service[140516]: Neutron server returns request_ids: ['req-5ff963e8-3a63-4f0d-91af-2d990a84e7e4'] Sep 24 20:56:19.389623 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e4e0d557-7457-4115-a672-077d2ac11666 tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] Request method failure captured: Sep 24 20:56:19.389623 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/os-security-groups/6e135d8c-43b4-42d1-9570-63e8a877be4b HTTP/1.1 Sep 24 20:56:19.389623 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:56:19.389623 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:56:19.389623 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:56:19.389623 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:56:19.389623 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:56:19.389623 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:56:19.389623 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:56:19.389623 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:56:19.389623 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL27WXUfJdao3yxKCmJNN1jHBNVIyKhQcXpDMvAuua4zzJclxg1BIOAY8MgA34ZhPvj5dmxDfsEjSBaSG6H8gfgkzzJmlf6_6aG3BECX8tbbm4x_TuqiT1M5zMR07nxMwaKK1plXRJZzTQD-SOEhaE4yXN0CaWb-I2UFX--qtMrL8Vu8 Sep 24 20:56:19.389623 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:56:19.389623 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:56:19.389623 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:56:19.389623 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:56:19.389623 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:56:19.389623 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:56:19.389623 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: bb818297b8a64e7ababc5eff3f4a1784 Sep 24 20:56:19.389623 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-399536094 Sep 24 20:56:19.389623 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:56:19.389623 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:56:19.391339 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bb818297b8a64e7ababc5eff3f4a1784"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bb818297b8a64e7ababc5eff3f4a1784"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bb818297b8a64e7ababc5eff3f4a1784"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bb818297b8a64e7ababc5eff3f4a1784"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:56:19.391339 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-SecurityGroupRulesTestJSON-399536094 Sep 24 20:56:19.391339 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: bb818297b8a64e7ababc5eff3f4a1784 Sep 24 20:56:19.391339 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-399536094 Sep 24 20:56:19.391339 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-SecurityGroupRulesTestJSON-399536094-project Sep 24 20:56:19.391339 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:56:19.391339 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:56:19.391339 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: e6b8fe778b5447e4be355f476052ba5c Sep 24 20:56:19.391339 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-SecurityGroupRulesTestJSON-399536094-project Sep 24 20:56:19.391339 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:56:19.391339 ncdv-master-1 devstack@n-api.service[140516]: exception: Security group 6e135d8c-43b4-42d1-9570-63e8a877be4b does not exist Sep 24 20:56:19.391339 ncdv-master-1 devstack@n-api.service[140516]: Neutron server returns request_ids: ['req-5ff963e8-3a63-4f0d-91af-2d990a84e7e4'] Sep 24 20:56:19.391339 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '6e135d8c-43b4-42d1-9570-63e8a877be4b'} Sep 24 20:56:19.392284 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:56:19.392284 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:19.392284 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 24 20:56:19.392284 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 24 20:56:19.392284 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:56:19.392284 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:56:19.392284 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 24 20:56:19.392284 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 24 20:56:19.392284 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:56:19.392284 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:56:19.392284 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 24 20:56:19.392284 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 24 20:56:19.392284 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:56:19.392284 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:56:19.392284 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 24 20:56:19.392284 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 24 20:56:19.392284 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:56:19.392284 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:56:19.392284 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 24 20:56:19.394613 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 24 20:56:19.394613 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:56:19.394613 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:56:19.394613 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 24 20:56:19.394613 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 24 20:56:19.394613 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 24 20:56:19.394613 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 24 20:56:19.394613 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6e135d8c-43b4-42d1-9570-63e8a877be4b does not exist Sep 24 20:56:19.394613 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ff963e8-3a63-4f0d-91af-2d990a84e7e4'] Sep 24 20:56:19.394613 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:19.394613 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:19.394613 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:19.394613 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:19.394613 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 24 20:56:19.394613 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 24 20:56:19.394613 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 24 20:56:19.394613 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 24 20:56:19.394613 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6e135d8c-43b4-42d1-9570-63e8a877be4b does not exist Sep 24 20:56:19.396103 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ff963e8-3a63-4f0d-91af-2d990a84e7e4'] Sep 24 20:56:19.396103 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:19.396103 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:19.396103 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:19.396103 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:19.396103 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:19.396103 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:19.396103 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:56:19.396103 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:56:19.396103 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:56:19.396103 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:56:19.396103 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:56:19.396103 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:56:19.396103 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 24 20:56:19.396103 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 24 20:56:19.396103 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6e135d8c-43b4-42d1-9570-63e8a877be4b does not exist Sep 24 20:56:19.396103 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ff963e8-3a63-4f0d-91af-2d990a84e7e4'] Sep 24 20:56:19.396103 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:19.396103 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:19.396103 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:19.396103 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:19.399037 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:19.399037 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:19.399037 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:56:19.399037 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:56:19.399037 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6e135d8c-43b4-42d1-9570-63e8a877be4b does not exist Sep 24 20:56:19.399037 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ff963e8-3a63-4f0d-91af-2d990a84e7e4'] Sep 24 20:56:19.399037 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:19.401969 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e4e0d557-7457-4115-a672-077d2ac11666 tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] Returning 404 to user: Security group 6e135d8c-43b4-42d1-9570-63e8a877be4b does not exist Sep 24 20:56:19.401969 ncdv-master-1 devstack@n-api.service[140516]: Neutron server returns request_ids: ['req-5ff963e8-3a63-4f0d-91af-2d990a84e7e4'] {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:56:19.403463 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e4e0d557-7457-4115-a672-077d2ac11666 tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/6e135d8c-43b4-42d1-9570-63e8a877be4b" status: 404 len: 194 microversion: 2.1 time: 0.064261 Sep 24 20:56:19.407070 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 953/1922] 10.222.0.52 () {58 vars in 1272 bytes} [Sat Sep 24 20:56:19 2022] DELETE /compute/v2.1/os-security-groups/6e135d8c-43b4-42d1-9570-63e8a877be4b => generated 194 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:56:19.419801 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-aa0a3574-9ff6-4afe-86bf-e4d57a6086d4 tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] Calling method '.version_select at 0x7f4b1106a550>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:19.927760 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9c171810-4f36-450b-b546-fa3610588c63 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:19.943293 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9c171810-4f36-450b-b546-fa3610588c63 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1392 microversion: 2.1 time: 0.650447 Sep 24 20:56:19.949835 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 970/1923] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:19 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1392 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:20.071051 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-b55a20f2-8da9-485f-9d79-c0ef420abd1d req-4d8c186b-199e-44f1-99da-fc8c16d93094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "834ff250-11c3-4391-aae5-7f3e6fa33166", "name": "network-vif-plugged", "status": "completed", "tag": "9d899e46-f44e-4bfc-b166-96ac7ad71d19"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:20.091020 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-b55a20f2-8da9-485f-9d79-c0ef420abd1d req-4d8c186b-199e-44f1-99da-fc8c16d93094 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:20.092028 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-b55a20f2-8da9-485f-9d79-c0ef420abd1d req-4d8c186b-199e-44f1-99da-fc8c16d93094 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:20.093046 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-b55a20f2-8da9-485f-9d79-c0ef420abd1d req-4d8c186b-199e-44f1-99da-fc8c16d93094 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:20.117486 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-b55a20f2-8da9-485f-9d79-c0ef420abd1d req-4d8c186b-199e-44f1-99da-fc8c16d93094 service nova] Creating event network-vif-plugged:9d899e46-f44e-4bfc-b166-96ac7ad71d19 for instance 834ff250-11c3-4391-aae5-7f3e6fa33166 on nch2-master-1 Sep 24 20:56:20.126262 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-b55a20f2-8da9-485f-9d79-c0ef420abd1d req-4d8c186b-199e-44f1-99da-fc8c16d93094 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063915 Sep 24 20:56:20.129264 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 971/1924] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:56:20.324203 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-aa0a3574-9ff6-4afe-86bf-e4d57a6086d4 tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/cebf0f11-c071-4aa7-8efe-e1f2ec60c406" status: 202 len: 0 microversion: 2.1 time: 0.912107 Sep 24 20:56:20.325524 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 954/1925] 10.222.0.52 () {58 vars in 1272 bytes} [Sat Sep 24 20:56:19 2022] DELETE /compute/v2.1/os-security-groups/cebf0f11-c071-4aa7-8efe-e1f2ec60c406 => generated 0 bytes in 914 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:56:20.331714 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-63bd5f3c-7da1-4199-af40-3ec8f0fe363d tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:20.333005 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-63bd5f3c-7da1-4199-af40-3ec8f0fe363d tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] [instance: 834ff250-11c3-4391-aae5-7f3e6fa33166] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:20.336603 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-19136430-9cad-4f68-9fc7-a92b4bfcfe5a tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] Calling method '.version_select at 0x7f4b0c3c2b80>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:20.343066 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-63bd5f3c-7da1-4199-af40-3ec8f0fe363d tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:20.344379 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-63bd5f3c-7da1-4199-af40-3ec8f0fe363d tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:20.345711 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-63bd5f3c-7da1-4199-af40-3ec8f0fe363d tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:20.347473 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-63bd5f3c-7da1-4199-af40-3ec8f0fe363d tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:20.348117 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-63bd5f3c-7da1-4199-af40-3ec8f0fe363d tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:20.350235 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-63bd5f3c-7da1-4199-af40-3ec8f0fe363d tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:21.029436 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-63bd5f3c-7da1-4199-af40-3ec8f0fe363d tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302ac6f497cf4d3c8c638f5b4b49f723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afe75ffdb814e0ba23546cf3866ceac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:21.039918 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-63bd5f3c-7da1-4199-af40-3ec8f0fe363d tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] 10.222.0.52 "GET /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166" status: 200 len: 1332 microversion: 2.1 time: 0.720561 Sep 24 20:56:21.042636 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 972/1926] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:20 2022] GET /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166 => generated 1332 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:21.059286 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-09a39ed6-2915-40fb-8314-598934533933 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:21.061337 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-09a39ed6-2915-40fb-8314-598934533933 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:21.070899 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09a39ed6-2915-40fb-8314-598934533933 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:21.071528 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09a39ed6-2915-40fb-8314-598934533933 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:21.072095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09a39ed6-2915-40fb-8314-598934533933 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:21.073245 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09a39ed6-2915-40fb-8314-598934533933 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:21.074267 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09a39ed6-2915-40fb-8314-598934533933 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:21.074986 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09a39ed6-2915-40fb-8314-598934533933 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:21.429348 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-09a39ed6-2915-40fb-8314-598934533933 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:21.439511 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-09a39ed6-2915-40fb-8314-598934533933 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1392 microversion: 2.1 time: 0.395599 Sep 24 20:56:21.454958 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 973/1927] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:21 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1392 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:21.482620 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-19136430-9cad-4f68-9fc7-a92b4bfcfe5a tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/f6b7526a-6d54-4251-9ad3-48e0943b46e8" status: 202 len: 0 microversion: 2.1 time: 1.152626 Sep 24 20:56:21.483602 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 955/1928] 10.222.0.52 () {58 vars in 1272 bytes} [Sat Sep 24 20:56:20 2022] DELETE /compute/v2.1/os-security-groups/f6b7526a-6d54-4251-9ad3-48e0943b46e8 => generated 0 bytes in 1154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:56:21.493300 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-788a7dd6-286d-44d3-b753-5cb8337b957e tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] Calling method '.version_select at 0x7f4b1104caf0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:21.734356 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0b2bbf8f-4fd5-4886-9e0c-193ab8251132 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-739039002", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "8a20889c-d5ef-4d59-989e-690000a3f961"}], "security_groups": [{"name": "tempest-securitygroup--1710054176"}], "key_name": "tempest-keypair-1348728112", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:22.121542 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-0b2bbf8f-4fd5-4886-9e0c-193ab8251132 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] validate_networks() for [('8a20889c-d5ef-4d59-989e-690000a3f961', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:56:22.330342 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-788a7dd6-286d-44d3-b753-5cb8337b957e tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/695d5663-50d7-4711-a86a-091e977d0491" status: 202 len: 0 microversion: 2.1 time: 0.841430 Sep 24 20:56:22.331958 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 974/1929] 10.222.0.52 () {58 vars in 1272 bytes} [Sat Sep 24 20:56:21 2022] DELETE /compute/v2.1/os-security-groups/695d5663-50d7-4711-a86a-091e977d0491 => generated 0 bytes in 845 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:56:22.338920 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6c868b60-db22-42f6-a9c2-470e6c38a1dc tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:22.339602 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6c868b60-db22-42f6-a9c2-470e6c38a1dc tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] [instance: 834ff250-11c3-4391-aae5-7f3e6fa33166] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:22.352836 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c868b60-db22-42f6-a9c2-470e6c38a1dc tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:22.353348 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c868b60-db22-42f6-a9c2-470e6c38a1dc tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:22.358027 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c868b60-db22-42f6-a9c2-470e6c38a1dc tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:22.358843 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c868b60-db22-42f6-a9c2-470e6c38a1dc tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:22.359400 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c868b60-db22-42f6-a9c2-470e6c38a1dc tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:22.359870 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c868b60-db22-42f6-a9c2-470e6c38a1dc tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:22.784828 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6c868b60-db22-42f6-a9c2-470e6c38a1dc tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302ac6f497cf4d3c8c638f5b4b49f723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afe75ffdb814e0ba23546cf3866ceac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:22.797182 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6c868b60-db22-42f6-a9c2-470e6c38a1dc tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] 10.222.0.52 "GET /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166" status: 200 len: 1537 microversion: 2.1 time: 0.464125 Sep 24 20:56:22.797790 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 975/1930] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:22 2022] GET /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166 => generated 1537 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:22.806182 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dda2185a-156d-4a81-8e55-9a540755634f tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:22.816222 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dda2185a-156d-4a81-8e55-9a540755634f tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:22.822848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dda2185a-156d-4a81-8e55-9a540755634f tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:22.823353 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dda2185a-156d-4a81-8e55-9a540755634f tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:22.823807 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dda2185a-156d-4a81-8e55-9a540755634f tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:22.824543 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dda2185a-156d-4a81-8e55-9a540755634f tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:22.825021 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dda2185a-156d-4a81-8e55-9a540755634f tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:22.835703 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dda2185a-156d-4a81-8e55-9a540755634f tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:23.265600 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-0b2bbf8f-4fd5-4886-9e0c-193ab8251132 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Getting quotas for project 71f6b606beca4eb5b62c89a945be15c7. Resources: dict_keys(['metadata_items']) {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:56:23.273168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-0b2bbf8f-4fd5-4886-9e0c-193ab8251132 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Getting quotas for user 3aa253ded2304ac3917a1788b6a1500b and project 71f6b606beca4eb5b62c89a945be15c7. Resources: dict_keys(['metadata_items']) {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:56:23.285340 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-dda2185a-156d-4a81-8e55-9a540755634f tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lazy-loading 'services' on Instance uuid 54ec06be-cb4b-4b5f-9ed8-904a328cc118 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:56:23.292882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-0b2bbf8f-4fd5-4886-9e0c-193ab8251132 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:56:23.294907 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-0b2bbf8f-4fd5-4886-9e0c-193ab8251132 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:56:23.295762 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-0b2bbf8f-4fd5-4886-9e0c-193ab8251132 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:56:23.296623 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-0b2bbf8f-4fd5-4886-9e0c-193ab8251132 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:56:23.297285 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-0b2bbf8f-4fd5-4886-9e0c-193ab8251132 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:56:23.310094 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b2bbf8f-4fd5-4886-9e0c-193ab8251132 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:23.311123 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b2bbf8f-4fd5-4886-9e0c-193ab8251132 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:23.312967 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b2bbf8f-4fd5-4886-9e0c-193ab8251132 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:23.313944 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b2bbf8f-4fd5-4886-9e0c-193ab8251132 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:23.315386 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b2bbf8f-4fd5-4886-9e0c-193ab8251132 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:23.316407 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b2bbf8f-4fd5-4886-9e0c-193ab8251132 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:23.336343 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:56:23.353309 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-0b2bbf8f-4fd5-4886-9e0c-193ab8251132 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Getting quotas for project 71f6b606beca4eb5b62c89a945be15c7. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:56:23.355204 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dda2185a-156d-4a81-8e55-9a540755634f tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 2419 microversion: 2.25 time: 0.552814 Sep 24 20:56:23.359352 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 976/1931] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:56:22 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 2419 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:56:23.374876 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1e13c5b9-2e24-4291-9578-3e6ed32b59e6 tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] Calling method '.version_select at 0x7f4b0c051c10>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:23.381022 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-0b2bbf8f-4fd5-4886-9e0c-193ab8251132 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Getting quotas for user 3aa253ded2304ac3917a1788b6a1500b and project 71f6b606beca4eb5b62c89a945be15c7. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:56:23.418679 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0b2bbf8f-4fd5-4886-9e0c-193ab8251132 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:56:23.424810 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0b2bbf8f-4fd5-4886-9e0c-193ab8251132 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] [instance: 05c0e0fa-1c24-4072-9663-5c0752c685e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:56:23.547294 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0b2bbf8f-4fd5-4886-9e0c-193ab8251132 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.817164 Sep 24 20:56:23.550745 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 956/1932] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:56:21 2022] POST /compute/v2.1/servers => generated 407 bytes in 1821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:56:23.567751 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-87755e71-d369-4f96-9276-66a7d4ce8259 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:23.568663 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-87755e71-d369-4f96-9276-66a7d4ce8259 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:23.578260 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-87755e71-d369-4f96-9276-66a7d4ce8259 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:23.579005 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-87755e71-d369-4f96-9276-66a7d4ce8259 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:23.580266 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-87755e71-d369-4f96-9276-66a7d4ce8259 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:23.588506 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-87755e71-d369-4f96-9276-66a7d4ce8259 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:23.589291 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-87755e71-d369-4f96-9276-66a7d4ce8259 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:23.589901 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-87755e71-d369-4f96-9276-66a7d4ce8259 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:23.939856 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1e13c5b9-2e24-4291-9578-3e6ed32b59e6 tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/788c6182-6690-4442-ac23-d7a372ce5a2e" status: 202 len: 0 microversion: 2.1 time: 0.578902 Sep 24 20:56:23.943234 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 977/1933] 10.222.0.52 () {58 vars in 1272 bytes} [Sat Sep 24 20:56:23 2022] DELETE /compute/v2.1/os-security-groups/788c6182-6690-4442-ac23-d7a372ce5a2e => generated 0 bytes in 583 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:56:23.949075 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e656b4ac-1938-4111-9257-7b5ada56b987 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Action: 'create', calling method: .version_select at 0x7f4b110c7d30>, body: {"pool": "c58107ef-9de1-4174-95fe-9673bfb49cab"} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:24.709344 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-87755e71-d369-4f96-9276-66a7d4ce8259 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:24.720352 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-87755e71-d369-4f96-9276-66a7d4ce8259 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1392 microversion: 2.1 time: 1.167897 Sep 24 20:56:24.720995 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 957/1934] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:23 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1392 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:24.743543 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dd28b781-a226-4f88-8606-c599d63bd824 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:24.752384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-dd28b781-a226-4f88-8606-c599d63bd824 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:24.782771 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd28b781-a226-4f88-8606-c599d63bd824 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:24.783780 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd28b781-a226-4f88-8606-c599d63bd824 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:24.786708 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd28b781-a226-4f88-8606-c599d63bd824 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:24.791524 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd28b781-a226-4f88-8606-c599d63bd824 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:24.793326 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd28b781-a226-4f88-8606-c599d63bd824 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:24.794045 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd28b781-a226-4f88-8606-c599d63bd824 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:24.852659 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-dd28b781-a226-4f88-8606-c599d63bd824 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lazy-loading 'flavor' on Instance uuid 54ec06be-cb4b-4b5f-9ed8-904a328cc118 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:56:24.875337 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-dd28b781-a226-4f88-8606-c599d63bd824 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Going to try to live migrate instance to nch2-master-1 {{(pid=140516) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 24 20:56:27.743263 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e656b4ac-1938-4111-9257-7b5ada56b987 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.798769 Sep 24 20:56:27.745018 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 978/1935] 10.222.0.52 () {60 vars in 1170 bytes} [Sat Sep 24 20:56:23 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3801 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:56:27.750301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a77c4711-eeac-4ead-8f5d-e2dad4b1b5fb tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:27.751910 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a77c4711-eeac-4ead-8f5d-e2dad4b1b5fb tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] [instance: 05c0e0fa-1c24-4072-9663-5c0752c685e0] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:27.765775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a77c4711-eeac-4ead-8f5d-e2dad4b1b5fb tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:27.766918 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a77c4711-eeac-4ead-8f5d-e2dad4b1b5fb tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:27.767380 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a77c4711-eeac-4ead-8f5d-e2dad4b1b5fb tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:27.768722 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a77c4711-eeac-4ead-8f5d-e2dad4b1b5fb tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:27.769397 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a77c4711-eeac-4ead-8f5d-e2dad4b1b5fb tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:27.770739 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a77c4711-eeac-4ead-8f5d-e2dad4b1b5fb tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:28.141895 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a77c4711-eeac-4ead-8f5d-e2dad4b1b5fb tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa253ded2304ac3917a1788b6a1500b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f6b606beca4eb5b62c89a945be15c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:28.153997 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a77c4711-eeac-4ead-8f5d-e2dad4b1b5fb tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] 10.222.0.52 "GET /compute/v2.1/servers/05c0e0fa-1c24-4072-9663-5c0752c685e0" status: 200 len: 1395 microversion: 2.1 time: 0.407632 Sep 24 20:56:28.155913 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 979/1936] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:27 2022] GET /compute/v2.1/servers/05c0e0fa-1c24-4072-9663-5c0752c685e0 => generated 1395 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:28.167467 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2257f557-3d4e-4131-bb76-5d8f747b5e27 tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] Calling method '.version_select at 0x7f4b0ca86700>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:28.259767 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-dd28b781-a226-4f88-8606-c599d63bd824 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/action" status: 202 len: 0 microversion: 2.25 time: 3.529239 Sep 24 20:56:28.261468 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 958/1937] 10.222.0.52 () {62 vars in 1319 bytes} [Sat Sep 24 20:56:24 2022] POST /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/action => generated 0 bytes in 3540 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:56:28.282821 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-16df8729-bcab-44db-a2ce-24b4e64d1879 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:28.283723 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-16df8729-bcab-44db-a2ce-24b4e64d1879 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:28.304723 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-16df8729-bcab-44db-a2ce-24b4e64d1879 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:28.305226 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-16df8729-bcab-44db-a2ce-24b4e64d1879 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:28.305921 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-16df8729-bcab-44db-a2ce-24b4e64d1879 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:28.307307 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-16df8729-bcab-44db-a2ce-24b4e64d1879 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:28.308027 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-16df8729-bcab-44db-a2ce-24b4e64d1879 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:28.308626 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-16df8729-bcab-44db-a2ce-24b4e64d1879 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:28.433955 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=12,nova_cell0:UPDATE=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:56:28.692353 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-16df8729-bcab-44db-a2ce-24b4e64d1879 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:28.702415 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-16df8729-bcab-44db-a2ce-24b4e64d1879 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1392 microversion: 2.1 time: 0.439847 Sep 24 20:56:28.703163 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 959/1938] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:28 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1392 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:28.902987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e66b8f61-f04e-4f2a-a674-86a2de94966a tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Action: 'update', calling method: .version_select at 0x7f4b1106a040>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:28.907426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e66b8f61-f04e-4f2a-a674-86a2de94966a tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:28.908015 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e66b8f61-f04e-4f2a-a674-86a2de94966a tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:28.909462 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e66b8f61-f04e-4f2a-a674-86a2de94966a tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:28.921971 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2257f557-3d4e-4131-bb76-5d8f747b5e27 tempest-SecurityGroupRulesTestJSON-399536094 tempest-SecurityGroupRulesTestJSON-399536094-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/7ab16b2a-051a-448f-b9d3-d48192bcb23f" status: 202 len: 0 microversion: 2.1 time: 0.764695 Sep 24 20:56:28.922977 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 980/1939] 10.222.0.52 () {58 vars in 1272 bytes} [Sat Sep 24 20:56:28 2022] DELETE /compute/v2.1/os-security-groups/7ab16b2a-051a-448f-b9d3-d48192bcb23f => generated 0 bytes in 766 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:56:28.927383 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e66b8f61-f04e-4f2a-a674-86a2de94966a tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:28.928136 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e66b8f61-f04e-4f2a-a674-86a2de94966a tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:28.928777 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e66b8f61-f04e-4f2a-a674-86a2de94966a tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:28.929549 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-80f9e901-1ceb-4af1-9ac4-bf5f808b1ef6 req-5ab1099a-8665-4e08-9b22-34b371081e58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eeb37e4-c327-4c29-a1a9-ae517e3e55ea", "name": "network-vif-unplugged", "status": "completed", "tag": "abcad753-fa76-461f-a30f-d6161dbdea13"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:28.940112 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-e66b8f61-f04e-4f2a-a674-86a2de94966a tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] HTTP exception thrown: Service 67a23d76-9179-4946-a502-0b2f8444fa36 could not be found. Sep 24 20:56:28.942815 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e66b8f61-f04e-4f2a-a674-86a2de94966a tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Request method failure captured: Sep 24 20:56:28.942815 ncdv-master-1 devstack@n-api.service[140516]: request: PUT /compute/v2.1/os-services/67a23d76-9179-4946-a502-0b2f8444fa36 HTTP/1.1 Sep 24 20:56:28.942815 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:56:28.942815 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:56:28.942815 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:56:28.942815 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 56 Sep 24 20:56:28.942815 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:56:28.942815 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:56:28.942815 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:56:28.942815 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:56:28.942815 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL2761LWO6QcoL_8RWyCBaLtYwsOzVo6wHGg-K50a2qkuYsr5Jl52jZy5_an9o1I48oQXww_rL-Svt0wO6pXkFB78N2eo47nQb01Ozsnsz1jfzNg9byhRGTr6rNB4ZDcBIUMqSqFoSUb4tHTw3_HHIZuLn8s6BxRGfczzt4FPudqzBqs Sep 24 20:56:28.942815 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:56:28.942815 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:56:28.942815 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:56:28.942815 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:56:28.942815 ncdv-master-1 devstack@n-api.service[140516]: X-Openstack-Nova-Api-Version: 2.53 Sep 24 20:56:28.942815 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:56:28.942815 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:56:28.942815 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 550e98c5707b43b09841a0d85d9412c3 Sep 24 20:56:28.942815 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-10439278 Sep 24 20:56:28.942815 ncdv-master-1 devstack@n-api.service[140516]: X-Role: admin,reader,member Sep 24 20:56:28.942815 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: admin,reader,member Sep 24 20:56:28.944475 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/550e98c5707b43b09841a0d85d9412c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_550e98c5707b43b09841a0d85d9412c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/550e98c5707b43b09841a0d85d9412c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/550e98c5707b43b09841a0d85d9412c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:56:28.944475 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-10439278 Sep 24 20:56:28.944475 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 550e98c5707b43b09841a0d85d9412c3 Sep 24 20:56:28.944475 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-10439278 Sep 24 20:56:28.944475 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin Sep 24 20:56:28.944475 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:56:28.944475 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:56:28.944475 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 95006050314a43eeb9a2d08da2384cb1 Sep 24 20:56:28.944475 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin Sep 24 20:56:28.944475 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 20:56:28.944475 ncdv-master-1 devstack@n-api.service[140516]: {"status": "disabled", "disabled_reason": "maintenance"} Sep 24 20:56:28.944475 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:56:28.944475 ncdv-master-1 devstack@n-api.service[140516]: exception: Service 67a23d76-9179-4946-a502-0b2f8444fa36 could not be found. Sep 24 20:56:28.945401 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '67a23d76-9179-4946-a502-0b2f8444fa36', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Sep 24 20:56:28.945401 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:56:28.945401 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:28.945401 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 24 20:56:28.945401 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 24 20:56:28.945401 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 24 20:56:28.945401 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 24 20:56:28.945401 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 24 20:56:28.945401 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:28.945401 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:28.945401 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:28.945401 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:28.945401 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 24 20:56:28.945401 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 24 20:56:28.945401 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 24 20:56:28.945401 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:56:28.945401 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 67a23d76-9179-4946-a502-0b2f8444fa36 could not be found. Sep 24 20:56:28.945401 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:28.945401 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:28.945401 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:28.945401 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:28.946876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:28.946876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:28.946876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:56:28.946876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:56:28.946876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:56:28.946876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:56:28.946876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:56:28.946876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:56:28.946876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:56:28.946876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:56:28.946876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 24 20:56:28.946876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:56:28.946876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 67a23d76-9179-4946-a502-0b2f8444fa36 could not be found. Sep 24 20:56:28.946876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:28.946876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:28.946876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:28.946876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:28.946876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:28.946876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:28.946876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:56:28.948385 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:56:28.948385 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 67a23d76-9179-4946-a502-0b2f8444fa36 could not be found. Sep 24 20:56:28.948385 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:28.950923 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e66b8f61-f04e-4f2a-a674-86a2de94966a tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Returning 404 to user: Service 67a23d76-9179-4946-a502-0b2f8444fa36 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:56:28.952765 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e66b8f61-f04e-4f2a-a674-86a2de94966a tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-services/67a23d76-9179-4946-a502-0b2f8444fa36" status: 404 len: 110 microversion: 2.53 time: 0.248158 Sep 24 20:56:28.959051 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 960/1940] 10.222.0.52 () {62 vars in 1309 bytes} [Sat Sep 24 20:56:28 2022] PUT /compute/v2.1/os-services/67a23d76-9179-4946-a502-0b2f8444fa36 => generated 110 bytes in 255 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 20:56:28.963768 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-80f9e901-1ceb-4af1-9ac4-bf5f808b1ef6 req-5ab1099a-8665-4e08-9b22-34b371081e58 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:28.969826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-80f9e901-1ceb-4af1-9ac4-bf5f808b1ef6 req-5ab1099a-8665-4e08-9b22-34b371081e58 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:28.970393 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-80f9e901-1ceb-4af1-9ac4-bf5f808b1ef6 req-5ab1099a-8665-4e08-9b22-34b371081e58 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:28.995549 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-80f9e901-1ceb-4af1-9ac4-bf5f808b1ef6 req-5ab1099a-8665-4e08-9b22-34b371081e58 service nova] Creating event network-vif-unplugged:abcad753-fa76-461f-a30f-d6161dbdea13 for instance 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea on nch1-master-1 Sep 24 20:56:29.005061 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-80f9e901-1ceb-4af1-9ac4-bf5f808b1ef6 req-5ab1099a-8665-4e08-9b22-34b371081e58 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079914 Sep 24 20:56:29.020423 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 981/1941] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:56:29.035857 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c75ad12b-9994-452a-a313-ec4bcce976b2 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Action: 'action', calling method: .version_select at 0x7f4b0e2945e0>, body: {"addFloatingIp": {"address": "172.35.7.202"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:29.039724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c75ad12b-9994-452a-a313-ec4bcce976b2 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] [instance: 834ff250-11c3-4391-aae5-7f3e6fa33166] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:29.061963 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c75ad12b-9994-452a-a313-ec4bcce976b2 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:29.062796 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c75ad12b-9994-452a-a313-ec4bcce976b2 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:29.066174 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c75ad12b-9994-452a-a313-ec4bcce976b2 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:29.067288 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c75ad12b-9994-452a-a313-ec4bcce976b2 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:29.067996 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c75ad12b-9994-452a-a313-ec4bcce976b2 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:29.071898 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c75ad12b-9994-452a-a313-ec4bcce976b2 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:29.072088 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b6493671-27d9-46b3-9b1e-9122bb70ab88 tempest-ServersTestBootFromVolume-1605240856 tempest-ServersTestBootFromVolume-1605240856-project] Action: 'create', calling method: .version_select at 0x7f4b1106a310>, body: {"keypair": {"name": "tempest-keypair-806207515", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUCJzLRcmaY1QX4duwyHTSZYZCkh5S2U8Dr8vptGfzAJo1dfCeflTa8RAoVhLYwqqKQQAWJ1ezcXBcO3Ly3E8oBTqOeIsqrzhDzLllMzEKGvHwh5eb/KGD8T8qYqgKhSg=="}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:29.096436 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-b6493671-27d9-46b3-9b1e-9122bb70ab88 tempest-ServersTestBootFromVolume-1605240856 tempest-ServersTestBootFromVolume-1605240856-project] Getting quotas for project cfa59dfe189849238f3693696fd1089e. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:56:29.107474 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-b6493671-27d9-46b3-9b1e-9122bb70ab88 tempest-ServersTestBootFromVolume-1605240856 tempest-ServersTestBootFromVolume-1605240856-project] Getting quotas for user 76b517a69e1f4dd0895104befebc128d and project cfa59dfe189849238f3693696fd1089e. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:56:29.149118 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b6493671-27d9-46b3-9b1e-9122bb70ab88 tempest-ServersTestBootFromVolume-1605240856 tempest-ServersTestBootFromVolume-1605240856-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.186925 Sep 24 20:56:29.150336 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 961/1942] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 20:56:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:56:29.157904 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ed378f36-89cf-4ce1-b328-7b4e2b3359fb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:29.158564 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ed378f36-89cf-4ce1-b328-7b4e2b3359fb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:29.170280 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed378f36-89cf-4ce1-b328-7b4e2b3359fb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:29.171475 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed378f36-89cf-4ce1-b328-7b4e2b3359fb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:29.172126 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed378f36-89cf-4ce1-b328-7b4e2b3359fb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:29.173360 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed378f36-89cf-4ce1-b328-7b4e2b3359fb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:29.175401 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed378f36-89cf-4ce1-b328-7b4e2b3359fb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:29.176693 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed378f36-89cf-4ce1-b328-7b4e2b3359fb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:29.248113 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c75ad12b-9994-452a-a313-ec4bcce976b2 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquiring lock "refresh_cache-834ff250-11c3-4391-aae5-7f3e6fa33166" {{(pid=140517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 24 20:56:29.251087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c75ad12b-9994-452a-a313-ec4bcce976b2 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquired lock "refresh_cache-834ff250-11c3-4391-aae5-7f3e6fa33166" {{(pid=140517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 24 20:56:29.672716 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ed378f36-89cf-4ce1-b328-7b4e2b3359fb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:29.702749 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ed378f36-89cf-4ce1-b328-7b4e2b3359fb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:29.711881 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ed378f36-89cf-4ce1-b328-7b4e2b3359fb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:29.720886 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ed378f36-89cf-4ce1-b328-7b4e2b3359fb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1812 microversion: 2.25 time: 0.568977 Sep 24 20:56:29.723181 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 962/1943] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:56:29 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1812 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:56:29.733266 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6a5567d2-c6f4-424c-9063-54ec459bd788 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Action: 'update', calling method: .version_select at 0x7f4b1106a790>, body: {"status": "disabled"} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:29.740366 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6a5567d2-c6f4-424c-9063-54ec459bd788 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:29.741190 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6a5567d2-c6f4-424c-9063-54ec459bd788 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:29.742359 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6a5567d2-c6f4-424c-9063-54ec459bd788 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:29.757130 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6a5567d2-c6f4-424c-9063-54ec459bd788 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:29.759165 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6a5567d2-c6f4-424c-9063-54ec459bd788 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:29.759934 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6a5567d2-c6f4-424c-9063-54ec459bd788 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:29.776119 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-6a5567d2-c6f4-424c-9063-54ec459bd788 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] HTTP exception thrown: Service 67a23d76-9179-4946-a502-0b2f8444fa36 could not be found. Sep 24 20:56:29.781941 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6a5567d2-c6f4-424c-9063-54ec459bd788 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Request method failure captured: Sep 24 20:56:29.781941 ncdv-master-1 devstack@n-api.service[140516]: request: PUT /compute/v2.1/os-services/67a23d76-9179-4946-a502-0b2f8444fa36 HTTP/1.1 Sep 24 20:56:29.781941 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:56:29.781941 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:56:29.781941 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:56:29.781941 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 22 Sep 24 20:56:29.781941 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:56:29.781941 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:56:29.781941 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:56:29.781941 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:56:29.781941 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL2761LWO6QcoL_8RWyCBaLtYwsOzVo6wHGg-K50a2qkuYsr5Jl52jZy5_an9o1I48oQXww_rL-Svt0wO6pXkFB78N2eo47nQb01Ozsnsz1jfzNg9byhRGTr6rNB4ZDcBIUMqSqFoSUb4tHTw3_HHIZuLn8s6BxRGfczzt4FPudqzBqs Sep 24 20:56:29.781941 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:56:29.781941 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:56:29.781941 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:56:29.781941 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:56:29.781941 ncdv-master-1 devstack@n-api.service[140516]: X-Openstack-Nova-Api-Version: 2.53 Sep 24 20:56:29.781941 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:56:29.781941 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:56:29.781941 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 550e98c5707b43b09841a0d85d9412c3 Sep 24 20:56:29.781941 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-10439278 Sep 24 20:56:29.781941 ncdv-master-1 devstack@n-api.service[140516]: X-Role: admin,reader,member Sep 24 20:56:29.781941 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: admin,reader,member Sep 24 20:56:29.784326 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/550e98c5707b43b09841a0d85d9412c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_550e98c5707b43b09841a0d85d9412c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/550e98c5707b43b09841a0d85d9412c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/550e98c5707b43b09841a0d85d9412c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:56:29.784326 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-10439278 Sep 24 20:56:29.784326 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 550e98c5707b43b09841a0d85d9412c3 Sep 24 20:56:29.784326 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-10439278 Sep 24 20:56:29.784326 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin Sep 24 20:56:29.784326 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:56:29.784326 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:56:29.784326 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 95006050314a43eeb9a2d08da2384cb1 Sep 24 20:56:29.784326 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin Sep 24 20:56:29.784326 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 20:56:29.784326 ncdv-master-1 devstack@n-api.service[140516]: {"status": "disabled"} Sep 24 20:56:29.784326 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:56:29.784326 ncdv-master-1 devstack@n-api.service[140516]: exception: Service 67a23d76-9179-4946-a502-0b2f8444fa36 could not be found. Sep 24 20:56:29.784326 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '67a23d76-9179-4946-a502-0b2f8444fa36', 'body': {'status': 'disabled'}} Sep 24 20:56:29.785641 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:56:29.785641 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:29.785641 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 24 20:56:29.785641 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 24 20:56:29.785641 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 24 20:56:29.785641 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 24 20:56:29.785641 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 24 20:56:29.785641 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:29.785641 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:29.785641 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:29.785641 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:29.785641 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 24 20:56:29.785641 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 24 20:56:29.785641 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 24 20:56:29.785641 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:56:29.785641 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 67a23d76-9179-4946-a502-0b2f8444fa36 could not be found. Sep 24 20:56:29.785641 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:29.785641 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:29.785641 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:29.785641 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:29.785641 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:29.789388 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:29.789388 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:56:29.789388 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:56:29.789388 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:56:29.789388 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:56:29.789388 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:56:29.789388 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:56:29.789388 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:56:29.789388 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:56:29.789388 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 24 20:56:29.789388 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:56:29.789388 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 67a23d76-9179-4946-a502-0b2f8444fa36 could not be found. Sep 24 20:56:29.789388 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:29.789388 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:29.789388 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:29.789388 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:29.789388 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:29.789388 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:29.789388 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:56:29.789388 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:56:29.793477 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 67a23d76-9179-4946-a502-0b2f8444fa36 could not be found. Sep 24 20:56:29.793477 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:29.793477 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6a5567d2-c6f4-424c-9063-54ec459bd788 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Returning 404 to user: Service 67a23d76-9179-4946-a502-0b2f8444fa36 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:56:29.795139 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6a5567d2-c6f4-424c-9063-54ec459bd788 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-services/67a23d76-9179-4946-a502-0b2f8444fa36" status: 404 len: 110 microversion: 2.53 time: 0.068686 Sep 24 20:56:29.803235 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 963/1944] 10.222.0.52 () {62 vars in 1309 bytes} [Sat Sep 24 20:56:29 2022] PUT /compute/v2.1/os-services/67a23d76-9179-4946-a502-0b2f8444fa36 => generated 110 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 20:56:29.814806 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4d0bdef5-7c74-4f52-8c6f-cc667bc6a9fe tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:29.816903 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4d0bdef5-7c74-4f52-8c6f-cc667bc6a9fe tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] [instance: 05c0e0fa-1c24-4072-9663-5c0752c685e0] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:29.838237 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4d0bdef5-7c74-4f52-8c6f-cc667bc6a9fe tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:29.840995 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4d0bdef5-7c74-4f52-8c6f-cc667bc6a9fe tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:29.841627 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4d0bdef5-7c74-4f52-8c6f-cc667bc6a9fe tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:29.845398 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4d0bdef5-7c74-4f52-8c6f-cc667bc6a9fe tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:29.847261 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4d0bdef5-7c74-4f52-8c6f-cc667bc6a9fe tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:29.848091 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4d0bdef5-7c74-4f52-8c6f-cc667bc6a9fe tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:30.467724 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4d0bdef5-7c74-4f52-8c6f-cc667bc6a9fe tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa253ded2304ac3917a1788b6a1500b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f6b606beca4eb5b62c89a945be15c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:30.478830 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4d0bdef5-7c74-4f52-8c6f-cc667bc6a9fe tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] 10.222.0.52 "GET /compute/v2.1/servers/05c0e0fa-1c24-4072-9663-5c0752c685e0" status: 200 len: 1395 microversion: 2.1 time: 0.679194 Sep 24 20:56:30.479674 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 964/1945] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:29 2022] GET /compute/v2.1/servers/05c0e0fa-1c24-4072-9663-5c0752c685e0 => generated 1395 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:30.487338 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-516129eb-cc38-45a7-bf65-e11d758366dd tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:30.488325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-516129eb-cc38-45a7-bf65-e11d758366dd tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:30.500529 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-516129eb-cc38-45a7-bf65-e11d758366dd tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:30.507283 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-516129eb-cc38-45a7-bf65-e11d758366dd tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:30.508098 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-516129eb-cc38-45a7-bf65-e11d758366dd tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:30.509142 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-516129eb-cc38-45a7-bf65-e11d758366dd tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:30.509872 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-516129eb-cc38-45a7-bf65-e11d758366dd tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:30.510651 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-516129eb-cc38-45a7-bf65-e11d758366dd tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:31.414278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-516129eb-cc38-45a7-bf65-e11d758366dd tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:31.433585 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-516129eb-cc38-45a7-bf65-e11d758366dd tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1392 microversion: 2.1 time: 0.952333 Sep 24 20:56:31.434799 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 965/1946] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:30 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1392 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:31.440329 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-38c708b4-1625-4f6a-ab3d-b9f3122bfc32 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Action: 'update', calling method: .version_select at 0x7f4b1106eaf0>, body: {"status": "enabled"} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:31.444511 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-38c708b4-1625-4f6a-ab3d-b9f3122bfc32 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:31.445253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-38c708b4-1625-4f6a-ab3d-b9f3122bfc32 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:31.445725 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-38c708b4-1625-4f6a-ab3d-b9f3122bfc32 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:31.454385 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-38c708b4-1625-4f6a-ab3d-b9f3122bfc32 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:31.454930 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-38c708b4-1625-4f6a-ab3d-b9f3122bfc32 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:31.455735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-38c708b4-1625-4f6a-ab3d-b9f3122bfc32 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:31.467079 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-38c708b4-1625-4f6a-ab3d-b9f3122bfc32 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] HTTP exception thrown: Service 67a23d76-9179-4946-a502-0b2f8444fa36 could not be found. Sep 24 20:56:31.476526 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-38c708b4-1625-4f6a-ab3d-b9f3122bfc32 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Request method failure captured: Sep 24 20:56:31.476526 ncdv-master-1 devstack@n-api.service[140516]: request: PUT /compute/v2.1/os-services/67a23d76-9179-4946-a502-0b2f8444fa36 HTTP/1.1 Sep 24 20:56:31.476526 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:56:31.476526 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:56:31.476526 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:56:31.476526 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 21 Sep 24 20:56:31.476526 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:56:31.476526 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:56:31.476526 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:56:31.476526 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:56:31.476526 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL2761LWO6QcoL_8RWyCBaLtYwsOzVo6wHGg-K50a2qkuYsr5Jl52jZy5_an9o1I48oQXww_rL-Svt0wO6pXkFB78N2eo47nQb01Ozsnsz1jfzNg9byhRGTr6rNB4ZDcBIUMqSqFoSUb4tHTw3_HHIZuLn8s6BxRGfczzt4FPudqzBqs Sep 24 20:56:31.476526 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:56:31.476526 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:56:31.476526 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:56:31.476526 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:56:31.476526 ncdv-master-1 devstack@n-api.service[140516]: X-Openstack-Nova-Api-Version: 2.53 Sep 24 20:56:31.476526 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:56:31.476526 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:56:31.476526 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 550e98c5707b43b09841a0d85d9412c3 Sep 24 20:56:31.476526 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-10439278 Sep 24 20:56:31.476526 ncdv-master-1 devstack@n-api.service[140516]: X-Role: admin,reader,member Sep 24 20:56:31.476526 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: admin,reader,member Sep 24 20:56:31.478354 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/550e98c5707b43b09841a0d85d9412c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_550e98c5707b43b09841a0d85d9412c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/550e98c5707b43b09841a0d85d9412c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/550e98c5707b43b09841a0d85d9412c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:56:31.478354 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-10439278 Sep 24 20:56:31.478354 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 550e98c5707b43b09841a0d85d9412c3 Sep 24 20:56:31.478354 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-10439278 Sep 24 20:56:31.478354 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin Sep 24 20:56:31.478354 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:56:31.478354 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:56:31.478354 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 95006050314a43eeb9a2d08da2384cb1 Sep 24 20:56:31.478354 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin Sep 24 20:56:31.478354 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 20:56:31.478354 ncdv-master-1 devstack@n-api.service[140516]: {"status": "enabled"} Sep 24 20:56:31.478354 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:56:31.478354 ncdv-master-1 devstack@n-api.service[140516]: exception: Service 67a23d76-9179-4946-a502-0b2f8444fa36 could not be found. Sep 24 20:56:31.478354 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '67a23d76-9179-4946-a502-0b2f8444fa36', 'body': {'status': 'enabled'}} Sep 24 20:56:31.479516 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:56:31.479516 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:31.479516 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 24 20:56:31.479516 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 24 20:56:31.479516 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 24 20:56:31.479516 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 24 20:56:31.479516 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 24 20:56:31.479516 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:31.479516 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:31.479516 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:31.479516 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:31.479516 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 24 20:56:31.479516 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 24 20:56:31.479516 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 24 20:56:31.479516 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:56:31.479516 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 67a23d76-9179-4946-a502-0b2f8444fa36 could not be found. Sep 24 20:56:31.479516 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:31.479516 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:31.479516 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:31.479516 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:31.479516 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:31.481108 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:31.481108 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:56:31.481108 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:56:31.481108 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:56:31.481108 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:56:31.481108 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:56:31.481108 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:56:31.481108 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:56:31.481108 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:56:31.481108 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 24 20:56:31.481108 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:56:31.481108 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 67a23d76-9179-4946-a502-0b2f8444fa36 could not be found. Sep 24 20:56:31.481108 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:31.481108 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:31.481108 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:31.481108 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:31.481108 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:31.481108 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:31.481108 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:56:31.481108 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:56:31.482669 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 67a23d76-9179-4946-a502-0b2f8444fa36 could not be found. Sep 24 20:56:31.482669 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:31.490168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-38c708b4-1625-4f6a-ab3d-b9f3122bfc32 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Returning 404 to user: Service 67a23d76-9179-4946-a502-0b2f8444fa36 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:56:31.491306 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-38c708b4-1625-4f6a-ab3d-b9f3122bfc32 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-services/67a23d76-9179-4946-a502-0b2f8444fa36" status: 404 len: 110 microversion: 2.53 time: 0.055027 Sep 24 20:56:31.493326 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 966/1947] 10.222.0.52 () {62 vars in 1309 bytes} [Sat Sep 24 20:56:31 2022] PUT /compute/v2.1/os-services/67a23d76-9179-4946-a502-0b2f8444fa36 => generated 110 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 20:56:31.499542 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-7ec5b7ff-f36d-49f5-9670-53a7b167df78 req-7d703cc0-ce24-41a3-973d-c0eed85ff7e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05c0e0fa-1c24-4072-9663-5c0752c685e0", "tag": "81d220f2-0310-473b-a74f-b729c26b0e34"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:31.520257 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-7ec5b7ff-f36d-49f5-9670-53a7b167df78 req-7d703cc0-ce24-41a3-973d-c0eed85ff7e1 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:31.521057 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-7ec5b7ff-f36d-49f5-9670-53a7b167df78 req-7d703cc0-ce24-41a3-973d-c0eed85ff7e1 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:31.522036 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-7ec5b7ff-f36d-49f5-9670-53a7b167df78 req-7d703cc0-ce24-41a3-973d-c0eed85ff7e1 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:31.568135 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-7ec5b7ff-f36d-49f5-9670-53a7b167df78 req-7d703cc0-ce24-41a3-973d-c0eed85ff7e1 service nova] Creating event network-changed:81d220f2-0310-473b-a74f-b729c26b0e34 for instance 05c0e0fa-1c24-4072-9663-5c0752c685e0 on nch1-master-1 Sep 24 20:56:31.578228 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-7ec5b7ff-f36d-49f5-9670-53a7b167df78 req-7d703cc0-ce24-41a3-973d-c0eed85ff7e1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083319 Sep 24 20:56:31.579923 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 967/1948] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:56:31.592421 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c17005d0-c149-4fbf-8edb-786dbc545f2c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:31.593490 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c17005d0-c149-4fbf-8edb-786dbc545f2c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:31.611431 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c17005d0-c149-4fbf-8edb-786dbc545f2c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:31.612437 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c17005d0-c149-4fbf-8edb-786dbc545f2c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:31.617711 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c17005d0-c149-4fbf-8edb-786dbc545f2c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:31.618871 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c17005d0-c149-4fbf-8edb-786dbc545f2c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:31.619541 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c17005d0-c149-4fbf-8edb-786dbc545f2c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:31.620186 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c17005d0-c149-4fbf-8edb-786dbc545f2c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:32.709294 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c17005d0-c149-4fbf-8edb-786dbc545f2c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:32.727834 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c17005d0-c149-4fbf-8edb-786dbc545f2c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:32.729679 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c17005d0-c149-4fbf-8edb-786dbc545f2c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:32.731196 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c17005d0-c149-4fbf-8edb-786dbc545f2c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1812 microversion: 2.25 time: 1.149542 Sep 24 20:56:32.732424 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 968/1949] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:56:31 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1812 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:56:32.741959 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-36536a86-aae5-497b-abe2-dd0777727859 req-442e2740-90c8-4f8b-af90-a8ea225a2b1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eeb37e4-c327-4c29-a1a9-ae517e3e55ea", "tag": "abcad753-fa76-461f-a30f-d6161dbdea13"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:32.772121 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-36536a86-aae5-497b-abe2-dd0777727859 req-442e2740-90c8-4f8b-af90-a8ea225a2b1f service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:32.773119 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-36536a86-aae5-497b-abe2-dd0777727859 req-442e2740-90c8-4f8b-af90-a8ea225a2b1f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:32.773743 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-36536a86-aae5-497b-abe2-dd0777727859 req-442e2740-90c8-4f8b-af90-a8ea225a2b1f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:32.806528 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-36536a86-aae5-497b-abe2-dd0777727859 req-442e2740-90c8-4f8b-af90-a8ea225a2b1f service nova] Creating event network-changed:abcad753-fa76-461f-a30f-d6161dbdea13 for instance 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea on nch1-master-1 Sep 24 20:56:32.832143 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-36536a86-aae5-497b-abe2-dd0777727859 req-442e2740-90c8-4f8b-af90-a8ea225a2b1f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093353 Sep 24 20:56:32.833002 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 969/1950] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:56:32.842256 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-730d2b51-5451-4f9d-bf2a-67e28336384a tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:32.852311 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-730d2b51-5451-4f9d-bf2a-67e28336384a tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] [instance: 05c0e0fa-1c24-4072-9663-5c0752c685e0] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:32.855907 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5,nova_api:UPDATE=7 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:56:32.866399 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-730d2b51-5451-4f9d-bf2a-67e28336384a tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:32.868611 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-730d2b51-5451-4f9d-bf2a-67e28336384a tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:32.869380 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-730d2b51-5451-4f9d-bf2a-67e28336384a tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:32.870750 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-730d2b51-5451-4f9d-bf2a-67e28336384a tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:32.872180 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-730d2b51-5451-4f9d-bf2a-67e28336384a tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:32.872917 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-730d2b51-5451-4f9d-bf2a-67e28336384a tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:33.774261 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-730d2b51-5451-4f9d-bf2a-67e28336384a tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa253ded2304ac3917a1788b6a1500b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f6b606beca4eb5b62c89a945be15c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:33.819328 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-730d2b51-5451-4f9d-bf2a-67e28336384a tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] 10.222.0.52 "GET /compute/v2.1/servers/05c0e0fa-1c24-4072-9663-5c0752c685e0" status: 200 len: 1395 microversion: 2.1 time: 0.983365 Sep 24 20:56:33.845292 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-c75ad12b-9994-452a-a313-ec4bcce976b2 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] [instance: 834ff250-11c3-4391-aae5-7f3e6fa33166] Building network info cache for instance {{(pid=140517) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 24 20:56:33.860123 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 970/1951] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:32 2022] GET /compute/v2.1/servers/05c0e0fa-1c24-4072-9663-5c0752c685e0 => generated 1395 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:33.884678 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a31ac50a-1e90-460b-8208-d3065934d0d8 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:33.910891 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a31ac50a-1e90-460b-8208-d3065934d0d8 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:33.913043 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a31ac50a-1e90-460b-8208-d3065934d0d8 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:33.913750 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a31ac50a-1e90-460b-8208-d3065934d0d8 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:33.921893 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a31ac50a-1e90-460b-8208-d3065934d0d8 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:33.924268 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a31ac50a-1e90-460b-8208-d3065934d0d8 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:33.927388 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a31ac50a-1e90-460b-8208-d3065934d0d8 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:33.984723 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a31ac50a-1e90-460b-8208-d3065934d0d8 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.122104 Sep 24 20:56:33.986257 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 971/1952] 10.222.0.52 () {60 vars in 1178 bytes} [Sat Sep 24 20:56:33 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:56:34.000869 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-05fbb79e-2208-41ae-8cb2-d851c1f9eb24 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:34.001787 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-05fbb79e-2208-41ae-8cb2-d851c1f9eb24 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:34.009364 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05fbb79e-2208-41ae-8cb2-d851c1f9eb24 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:34.010176 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05fbb79e-2208-41ae-8cb2-d851c1f9eb24 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:34.010869 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05fbb79e-2208-41ae-8cb2-d851c1f9eb24 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:34.011859 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05fbb79e-2208-41ae-8cb2-d851c1f9eb24 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:34.012904 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05fbb79e-2208-41ae-8cb2-d851c1f9eb24 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:34.013618 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05fbb79e-2208-41ae-8cb2-d851c1f9eb24 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:34.448690 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-05fbb79e-2208-41ae-8cb2-d851c1f9eb24 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:34.469701 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-05fbb79e-2208-41ae-8cb2-d851c1f9eb24 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1392 microversion: 2.1 time: 0.481524 Sep 24 20:56:34.472813 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 972/1953] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:33 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1392 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:34.481647 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bb153ea4-3d86-43a8-9b9f-662333faf795 tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] Calling method '.version_select at 0x7f4b111a4670>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:34.584463 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bb153ea4-3d86-43a8-9b9f-662333faf795 tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] 10.222.0.52 "GET /compute/v2.1/images/0631c3f0-c8d8-4660-8f2e-5e74044bebe8" status: 200 len: 637 microversion: 2.1 time: 0.109920 Sep 24 20:56:34.585124 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 973/1954] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:56:34 2022] GET /compute/v2.1/images/0631c3f0-c8d8-4660-8f2e-5e74044bebe8 => generated 637 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:56:34.603196 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0c42fa30-32ab-4a7d-a679-192f94eaa947 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:34.605711 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0c42fa30-32ab-4a7d-a679-192f94eaa947 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:34.624977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0c42fa30-32ab-4a7d-a679-192f94eaa947 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:34.626216 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0c42fa30-32ab-4a7d-a679-192f94eaa947 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:34.627013 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0c42fa30-32ab-4a7d-a679-192f94eaa947 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:34.654808 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0c42fa30-32ab-4a7d-a679-192f94eaa947 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:34.655983 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0c42fa30-32ab-4a7d-a679-192f94eaa947 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:34.656904 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0c42fa30-32ab-4a7d-a679-192f94eaa947 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:35.074608 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0c42fa30-32ab-4a7d-a679-192f94eaa947 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:35.099916 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0c42fa30-32ab-4a7d-a679-192f94eaa947 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:35.104917 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0c42fa30-32ab-4a7d-a679-192f94eaa947 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:35.107232 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0c42fa30-32ab-4a7d-a679-192f94eaa947 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1812 microversion: 2.25 time: 0.516312 Sep 24 20:56:35.108094 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 974/1955] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:56:34 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1812 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:56:35.115350 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-c6a29bd5-04eb-47f3-9eaa-dc1471131d05 req-8f90d64f-88d6-4d6d-9458-e52abcd9d556 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "834ff250-11c3-4391-aae5-7f3e6fa33166", "tag": "9d899e46-f44e-4bfc-b166-96ac7ad71d19"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:35.146463 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c6a29bd5-04eb-47f3-9eaa-dc1471131d05 req-8f90d64f-88d6-4d6d-9458-e52abcd9d556 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:35.147837 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c6a29bd5-04eb-47f3-9eaa-dc1471131d05 req-8f90d64f-88d6-4d6d-9458-e52abcd9d556 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:35.148466 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c6a29bd5-04eb-47f3-9eaa-dc1471131d05 req-8f90d64f-88d6-4d6d-9458-e52abcd9d556 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:35.210649 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-c6a29bd5-04eb-47f3-9eaa-dc1471131d05 req-8f90d64f-88d6-4d6d-9458-e52abcd9d556 service nova] Creating event network-changed:9d899e46-f44e-4bfc-b166-96ac7ad71d19 for instance 834ff250-11c3-4391-aae5-7f3e6fa33166 on nch2-master-1 Sep 24 20:56:35.224222 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-c6a29bd5-04eb-47f3-9eaa-dc1471131d05 req-8f90d64f-88d6-4d6d-9458-e52abcd9d556 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107040 Sep 24 20:56:35.225236 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 975/1956] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:56:35.239447 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-46fd37fe-8723-4bb6-8926-bc359654c532 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:35.245915 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-46fd37fe-8723-4bb6-8926-bc359654c532 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:35.246476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-46fd37fe-8723-4bb6-8926-bc359654c532 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:35.250979 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-46fd37fe-8723-4bb6-8926-bc359654c532 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:35.251760 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-46fd37fe-8723-4bb6-8926-bc359654c532 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:35.252243 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-46fd37fe-8723-4bb6-8926-bc359654c532 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:35.252963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-46fd37fe-8723-4bb6-8926-bc359654c532 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:35.263844 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=17 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:56:35.306515 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-46fd37fe-8723-4bb6-8926-bc359654c532 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.077874 Sep 24 20:56:35.307687 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 976/1957] 10.222.0.52 () {60 vars in 1211 bytes} [Sat Sep 24 20:56:35 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:56:35.314857 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e0fa9e93-3675-4c5e-920d-bf76a5ab241b tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] Action: 'update_all', calling method: .version_select at 0x7f4b111a4670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:35.395105 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=27 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:56:35.396658 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-e0fa9e93-3675-4c5e-920d-bf76a5ab241b tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] Getting quotas for project 7c8ce066fefe47a69e2bf6d625c01eb7. Resources: dict_keys(['metadata_items']) {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:56:35.407402 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-e0fa9e93-3675-4c5e-920d-bf76a5ab241b tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] Getting quotas for user 5c77dbc1dbd748668e76f2bebc0220d1 and project 7c8ce066fefe47a69e2bf6d625c01eb7. Resources: dict_keys(['metadata_items']) {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:56:35.455302 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-c75ad12b-9994-452a-a313-ec4bcce976b2 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] [instance: 834ff250-11c3-4391-aae5-7f3e6fa33166] Updating instance_info_cache with network_info: [{"id": "9d899e46-f44e-4bfc-b166-96ac7ad71d19", "address": "fa:16:3e:74:3f:92", "network": {"id": "c529e650-5f5f-4183-be3c-902fe3314684", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1231048229-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.7.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8afe75ffdb814e0ba23546cf3866ceac", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9d899e46-f4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140517) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 24 20:56:35.482564 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c75ad12b-9994-452a-a313-ec4bcce976b2 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Releasing lock "refresh_cache-834ff250-11c3-4391-aae5-7f3e6fa33166" {{(pid=140517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 24 20:56:35.483900 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c75ad12b-9994-452a-a313-ec4bcce976b2 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] 10.222.0.52 "POST /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166/action" status: 202 len: 0 microversion: 2.1 time: 6.461684 Sep 24 20:56:35.485331 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 982/1958] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:56:29 2022] POST /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166/action => generated 0 bytes in 6464 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 24 20:56:35.495752 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3692fc8d-07fb-4287-af57-29db7206f3ba tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:35.497308 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3692fc8d-07fb-4287-af57-29db7206f3ba tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] [instance: 05c0e0fa-1c24-4072-9663-5c0752c685e0] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:35.518179 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3692fc8d-07fb-4287-af57-29db7206f3ba tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:35.519433 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3692fc8d-07fb-4287-af57-29db7206f3ba tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:35.520729 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3692fc8d-07fb-4287-af57-29db7206f3ba tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:35.521723 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3692fc8d-07fb-4287-af57-29db7206f3ba tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:35.523675 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3692fc8d-07fb-4287-af57-29db7206f3ba tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:35.524374 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3692fc8d-07fb-4287-af57-29db7206f3ba tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:35.953023 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e0fa9e93-3675-4c5e-920d-bf76a5ab241b tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] 10.222.0.52 "PUT /compute/v2.1/images/0631c3f0-c8d8-4660-8f2e-5e74044bebe8/metadata" status: 200 len: 61 microversion: 2.1 time: 0.643985 Sep 24 20:56:35.953776 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 977/1959] 10.222.0.52 () {60 vars in 1280 bytes} [Sat Sep 24 20:56:35 2022] PUT /compute/v2.1/images/0631c3f0-c8d8-4660-8f2e-5e74044bebe8/metadata => generated 61 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:56:35.959156 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2f0ac7d3-7ee8-4a9e-a0d9-630661f1e138 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:35.970627 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f0ac7d3-7ee8-4a9e-a0d9-630661f1e138 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:35.971279 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f0ac7d3-7ee8-4a9e-a0d9-630661f1e138 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:35.974523 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f0ac7d3-7ee8-4a9e-a0d9-630661f1e138 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:35.976993 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f0ac7d3-7ee8-4a9e-a0d9-630661f1e138 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:35.977866 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f0ac7d3-7ee8-4a9e-a0d9-630661f1e138 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:35.978580 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f0ac7d3-7ee8-4a9e-a0d9-630661f1e138 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:36.069556 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2f0ac7d3-7ee8-4a9e-a0d9-630661f1e138 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.112846 Sep 24 20:56:36.070584 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 978/1960] 10.222.0.52 () {60 vars in 1178 bytes} [Sat Sep 24 20:56:35 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:56:36.090397 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-75c6c44e-8199-4796-b2d8-2e4cf20a3573 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Action: 'create', calling method: .version_select at 0x7f4b1106a550>, body: {"pool": "c58107ef-9de1-4174-95fe-9673bfb49cab"} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:36.222322 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3692fc8d-07fb-4287-af57-29db7206f3ba tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa253ded2304ac3917a1788b6a1500b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f6b606beca4eb5b62c89a945be15c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:36.257535 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3692fc8d-07fb-4287-af57-29db7206f3ba tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] 10.222.0.52 "GET /compute/v2.1/servers/05c0e0fa-1c24-4072-9663-5c0752c685e0" status: 200 len: 1395 microversion: 2.1 time: 0.770361 Sep 24 20:56:36.283124 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 983/1961] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:35 2022] GET /compute/v2.1/servers/05c0e0fa-1c24-4072-9663-5c0752c685e0 => generated 1395 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:36.301620 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-de85105a-cd3f-4da8-ba0c-853560ea8a9f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:36.303271 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-de85105a-cd3f-4da8-ba0c-853560ea8a9f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:36.322007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=7,nova_api:INSERT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:56:36.327023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de85105a-cd3f-4da8-ba0c-853560ea8a9f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:36.330111 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de85105a-cd3f-4da8-ba0c-853560ea8a9f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:36.335329 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de85105a-cd3f-4da8-ba0c-853560ea8a9f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:36.336111 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de85105a-cd3f-4da8-ba0c-853560ea8a9f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:36.337600 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de85105a-cd3f-4da8-ba0c-853560ea8a9f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:36.345466 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de85105a-cd3f-4da8-ba0c-853560ea8a9f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:36.733743 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-de85105a-cd3f-4da8-ba0c-853560ea8a9f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:36.755634 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-de85105a-cd3f-4da8-ba0c-853560ea8a9f tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1392 microversion: 2.1 time: 0.461115 Sep 24 20:56:36.756306 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 984/1962] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:36 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1392 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:36.785187 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9f5c4600-0bf3-4c4f-bd3f-7273547c8e93 tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] Calling method '.version_select at 0x7f4b110be700>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:37.264121 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9f5c4600-0bf3-4c4f-bd3f-7273547c8e93 tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] 10.222.0.52 "DELETE /compute/v2.1/images/0631c3f0-c8d8-4660-8f2e-5e74044bebe8/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.479872 Sep 24 20:56:37.265996 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 985/1963] 10.222.0.52 () {58 vars in 1296 bytes} [Sat Sep 24 20:56:36 2022] DELETE /compute/v2.1/images/0631c3f0-c8d8-4660-8f2e-5e74044bebe8/metadata/os_version => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:56:37.284031 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-885164c4-446e-45e6-9229-bf655cb1679a tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:37.294781 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-885164c4-446e-45e6-9229-bf655cb1679a tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:37.296129 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-885164c4-446e-45e6-9229-bf655cb1679a tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:37.296910 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-885164c4-446e-45e6-9229-bf655cb1679a tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:37.297983 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-885164c4-446e-45e6-9229-bf655cb1679a tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:37.298702 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-885164c4-446e-45e6-9229-bf655cb1679a tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:37.300762 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-885164c4-446e-45e6-9229-bf655cb1679a tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:37.371136 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-885164c4-446e-45e6-9229-bf655cb1679a tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.100739 Sep 24 20:56:37.376388 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 986/1964] 10.222.0.52 () {60 vars in 1237 bytes} [Sat Sep 24 20:56:37 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:37.389216 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6c4ac012-282d-48b0-a906-aef7c9eb8d66 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:37.392250 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6c4ac012-282d-48b0-a906-aef7c9eb8d66 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:37.405820 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c4ac012-282d-48b0-a906-aef7c9eb8d66 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:37.409842 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c4ac012-282d-48b0-a906-aef7c9eb8d66 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:37.411202 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c4ac012-282d-48b0-a906-aef7c9eb8d66 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:37.413482 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c4ac012-282d-48b0-a906-aef7c9eb8d66 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:37.414636 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c4ac012-282d-48b0-a906-aef7c9eb8d66 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:37.417033 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c4ac012-282d-48b0-a906-aef7c9eb8d66 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:37.978949 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6c4ac012-282d-48b0-a906-aef7c9eb8d66 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:37.988568 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6c4ac012-282d-48b0-a906-aef7c9eb8d66 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:37.990158 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6c4ac012-282d-48b0-a906-aef7c9eb8d66 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:38.004295 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6c4ac012-282d-48b0-a906-aef7c9eb8d66 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1812 microversion: 2.25 time: 0.624580 Sep 24 20:56:38.004965 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 987/1965] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:56:37 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1812 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:56:38.010045 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c88ed92b-9abc-408f-a2ec-1bb86eb98b0e tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] Calling method '.version_select at 0x7f4b11018820>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:38.107207 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c88ed92b-9abc-408f-a2ec-1bb86eb98b0e tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] 10.222.0.52 "GET /compute/v2.1/images/0631c3f0-c8d8-4660-8f2e-5e74044bebe8/metadata" status: 200 len: 37 microversion: 2.1 time: 0.093143 Sep 24 20:56:38.108263 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 988/1966] 10.222.0.52 () {58 vars in 1260 bytes} [Sat Sep 24 20:56:38 2022] GET /compute/v2.1/images/0631c3f0-c8d8-4660-8f2e-5e74044bebe8/metadata => generated 37 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:56:38.132014 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6c54ce0f-9e0f-4494-8e28-9959db79b16e tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:38.132014 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6c54ce0f-9e0f-4494-8e28-9959db79b16e tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] [instance: 05c0e0fa-1c24-4072-9663-5c0752c685e0] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:38.147659 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c54ce0f-9e0f-4494-8e28-9959db79b16e tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:38.148165 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c54ce0f-9e0f-4494-8e28-9959db79b16e tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:38.148725 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c54ce0f-9e0f-4494-8e28-9959db79b16e tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:38.149455 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c54ce0f-9e0f-4494-8e28-9959db79b16e tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:38.149925 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c54ce0f-9e0f-4494-8e28-9959db79b16e tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:38.150386 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c54ce0f-9e0f-4494-8e28-9959db79b16e tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:38.493455 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6c54ce0f-9e0f-4494-8e28-9959db79b16e tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa253ded2304ac3917a1788b6a1500b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f6b606beca4eb5b62c89a945be15c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:38.532478 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6c54ce0f-9e0f-4494-8e28-9959db79b16e tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] 10.222.0.52 "GET /compute/v2.1/servers/05c0e0fa-1c24-4072-9663-5c0752c685e0" status: 200 len: 1395 microversion: 2.1 time: 0.421997 Sep 24 20:56:38.536544 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 989/1967] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:38 2022] GET /compute/v2.1/servers/05c0e0fa-1c24-4072-9663-5c0752c685e0 => generated 1395 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:38.554547 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bca95efd-e7fd-451c-83ff-8bcdd744934f tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:38.566289 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bca95efd-e7fd-451c-83ff-8bcdd744934f tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:38.568508 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bca95efd-e7fd-451c-83ff-8bcdd744934f tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:38.569114 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bca95efd-e7fd-451c-83ff-8bcdd744934f tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:38.571334 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bca95efd-e7fd-451c-83ff-8bcdd744934f tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:38.573467 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bca95efd-e7fd-451c-83ff-8bcdd744934f tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:38.574096 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bca95efd-e7fd-451c-83ff-8bcdd744934f tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:38.641951 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bca95efd-e7fd-451c-83ff-8bcdd744934f tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.104002 Sep 24 20:56:38.643678 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 990/1968] 10.222.0.52 () {60 vars in 1178 bytes} [Sat Sep 24 20:56:38 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:56:38.656956 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-77fcb5be-104c-495b-a376-6f7dbd642d43 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:38.659210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-77fcb5be-104c-495b-a376-6f7dbd642d43 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:38.693311 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77fcb5be-104c-495b-a376-6f7dbd642d43 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:38.695186 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77fcb5be-104c-495b-a376-6f7dbd642d43 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:38.696774 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77fcb5be-104c-495b-a376-6f7dbd642d43 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:38.697614 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77fcb5be-104c-495b-a376-6f7dbd642d43 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:38.699234 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77fcb5be-104c-495b-a376-6f7dbd642d43 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:38.700490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77fcb5be-104c-495b-a376-6f7dbd642d43 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:39.026901 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-77fcb5be-104c-495b-a376-6f7dbd642d43 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:39.044573 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-77fcb5be-104c-495b-a376-6f7dbd642d43 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1392 microversion: 2.1 time: 0.396768 Sep 24 20:56:39.046250 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 991/1969] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:38 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1392 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:39.074585 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c473f2fb-91cd-4ab9-af6a-faddc38d3822 tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] Action: 'update_all', calling method: .version_select at 0x7f4b1110fdc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:39.149478 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-c473f2fb-91cd-4ab9-af6a-faddc38d3822 tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] Getting quotas for project 7c8ce066fefe47a69e2bf6d625c01eb7. Resources: dict_keys(['metadata_items']) {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:56:39.154810 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-75c6c44e-8199-4796-b2d8-2e4cf20a3573 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.082398 Sep 24 20:56:39.156178 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 979/1970] 10.222.0.52 () {60 vars in 1170 bytes} [Sat Sep 24 20:56:36 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3085 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:56:39.156376 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-c473f2fb-91cd-4ab9-af6a-faddc38d3822 tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] Getting quotas for user 5c77dbc1dbd748668e76f2bebc0220d1 and project 7c8ce066fefe47a69e2bf6d625c01eb7. Resources: dict_keys(['metadata_items']) {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:56:39.161853 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-afd829ec-c2d1-4d9b-94e6-78ccf1d00715 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:39.166484 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-afd829ec-c2d1-4d9b-94e6-78ccf1d00715 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:39.167118 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-afd829ec-c2d1-4d9b-94e6-78ccf1d00715 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:39.167661 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-afd829ec-c2d1-4d9b-94e6-78ccf1d00715 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:39.168654 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-afd829ec-c2d1-4d9b-94e6-78ccf1d00715 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:39.169339 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-afd829ec-c2d1-4d9b-94e6-78ccf1d00715 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:39.170033 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-afd829ec-c2d1-4d9b-94e6-78ccf1d00715 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:39.208647 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-afd829ec-c2d1-4d9b-94e6-78ccf1d00715 tempest-ServicesAdminNegativeV253TestJSON-10439278 tempest-ServicesAdminNegativeV253TestJSON-10439278-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.53 time: 0.051040 Sep 24 20:56:39.209284 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 980/1971] 10.222.0.52 () {60 vars in 1239 bytes} [Sat Sep 24 20:56:39 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:39.216151 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9cd1e7c9-8399-458a-b8eb-50f9000f5ed4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:39.217760 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9cd1e7c9-8399-458a-b8eb-50f9000f5ed4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:39.226222 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9cd1e7c9-8399-458a-b8eb-50f9000f5ed4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:39.230197 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9cd1e7c9-8399-458a-b8eb-50f9000f5ed4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:39.230761 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9cd1e7c9-8399-458a-b8eb-50f9000f5ed4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:39.233840 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9cd1e7c9-8399-458a-b8eb-50f9000f5ed4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:39.234553 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9cd1e7c9-8399-458a-b8eb-50f9000f5ed4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:39.235192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9cd1e7c9-8399-458a-b8eb-50f9000f5ed4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:39.454563 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9cd1e7c9-8399-458a-b8eb-50f9000f5ed4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:39.475784 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9cd1e7c9-8399-458a-b8eb-50f9000f5ed4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:39.477370 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9cd1e7c9-8399-458a-b8eb-50f9000f5ed4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:39.478708 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9cd1e7c9-8399-458a-b8eb-50f9000f5ed4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1812 microversion: 2.25 time: 0.268392 Sep 24 20:56:39.479800 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 981/1972] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:56:39 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1812 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:56:39.498412 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4eb12401-315b-49cd-ba1d-b5bbd1a0748d tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Action: 'action', calling method: .version_select at 0x7f4b0e2eeca0>, body: {"addFloatingIp": {"address": "172.35.7.204"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:39.502683 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4eb12401-315b-49cd-ba1d-b5bbd1a0748d tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] [instance: 834ff250-11c3-4391-aae5-7f3e6fa33166] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:39.512271 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4eb12401-315b-49cd-ba1d-b5bbd1a0748d tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:39.514477 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4eb12401-315b-49cd-ba1d-b5bbd1a0748d tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:39.516313 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4eb12401-315b-49cd-ba1d-b5bbd1a0748d tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:39.517893 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4eb12401-315b-49cd-ba1d-b5bbd1a0748d tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:39.517893 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4eb12401-315b-49cd-ba1d-b5bbd1a0748d tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:39.518667 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4eb12401-315b-49cd-ba1d-b5bbd1a0748d tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:39.522849 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c473f2fb-91cd-4ab9-af6a-faddc38d3822 tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] 10.222.0.52 "PUT /compute/v2.1/images/0631c3f0-c8d8-4660-8f2e-5e74044bebe8/metadata" status: 200 len: 61 microversion: 2.1 time: 0.474714 Sep 24 20:56:39.524543 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:56:39.529589 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 992/1973] 10.222.0.52 () {60 vars in 1280 bytes} [Sat Sep 24 20:56:39 2022] PUT /compute/v2.1/images/0631c3f0-c8d8-4660-8f2e-5e74044bebe8/metadata => generated 61 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:56:39.618749 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4eb12401-315b-49cd-ba1d-b5bbd1a0748d tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquiring lock "refresh_cache-834ff250-11c3-4391-aae5-7f3e6fa33166" {{(pid=140516) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 24 20:56:39.619408 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4eb12401-315b-49cd-ba1d-b5bbd1a0748d tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquired lock "refresh_cache-834ff250-11c3-4391-aae5-7f3e6fa33166" {{(pid=140516) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 24 20:56:39.868260 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6ba4e00c-5273-48b1-81f5-5fef39ebc67a tempest-ServicesAdminNegativeV253TestJSON-1261217225 tempest-ServicesAdminNegativeV253TestJSON-1261217225-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:39.872351 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6ba4e00c-5273-48b1-81f5-5fef39ebc67a tempest-ServicesAdminNegativeV253TestJSON-1261217225 tempest-ServicesAdminNegativeV253TestJSON-1261217225-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '304d9738234046a19b17b4b87f8ffa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d88a97354b45e7a010e925822ea890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:39.874611 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6ba4e00c-5273-48b1-81f5-5fef39ebc67a tempest-ServicesAdminNegativeV253TestJSON-1261217225 tempest-ServicesAdminNegativeV253TestJSON-1261217225-project] Request method failure captured: Sep 24 20:56:39.874611 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 24 20:56:39.874611 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:56:39.874611 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:56:39.874611 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:56:39.874611 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:56:39.874611 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:56:39.874611 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:56:39.874611 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:56:39.874611 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:56:39.874611 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL2748DWPg4mQHl-1LVfUQ0-kkSqW-Ww1-lPlDbaDdbG7Ah33wfToSV7X7V1UgpC0OpMGJnDd6cSx2B19-kqoi7TTcbk5FmV0mvuodJA2eVn-6SG6-7RDS4rvVgviw0QEIHFmg53TYK3GYWjWmBv32q_AOTBZLclWt1BFg64f1LI4dEE Sep 24 20:56:39.874611 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:56:39.874611 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:56:39.874611 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:56:39.874611 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:56:39.874611 ncdv-master-1 devstack@n-api.service[140517]: X-Openstack-Nova-Api-Version: 2.53 Sep 24 20:56:39.874611 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:56:39.874611 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:56:39.874611 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: a6d88a97354b45e7a010e925822ea890 Sep 24 20:56:39.874611 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1261217225 Sep 24 20:56:39.874611 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:56:39.874611 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:56:39.876617 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a6d88a97354b45e7a010e925822ea890"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a6d88a97354b45e7a010e925822ea890"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a6d88a97354b45e7a010e925822ea890"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a6d88a97354b45e7a010e925822ea890"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:56:39.876617 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1261217225 Sep 24 20:56:39.876617 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: a6d88a97354b45e7a010e925822ea890 Sep 24 20:56:39.876617 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1261217225 Sep 24 20:56:39.876617 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1261217225-project Sep 24 20:56:39.876617 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:56:39.876617 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:56:39.876617 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 304d9738234046a19b17b4b87f8ffa00 Sep 24 20:56:39.876617 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1261217225-project Sep 24 20:56:39.876617 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:56:39.876617 ncdv-master-1 devstack@n-api.service[140517]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 24 20:56:39.876617 ncdv-master-1 devstack@n-api.service[140517]: action_args: {} Sep 24 20:56:39.878474 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:56:39.878474 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:39.878474 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:39.878474 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:39.878474 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:56:39.878474 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:56:39.878474 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 24 20:56:39.878474 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:56:39.878474 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 24 20:56:39.878474 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:56:39.878474 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:56:39.878474 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:56:39.878474 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 24 20:56:39.878474 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 24 20:56:39.878474 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 24 20:56:39.878474 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 24 20:56:39.878474 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 24 20:56:39.878474 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 24 20:56:39.878474 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:56:39.880285 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:56:39.880285 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:56:39.880285 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:56:39.880285 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 24 20:56:39.880285 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 24 20:56:39.880285 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 24 20:56:39.880285 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 24 20:56:39.880285 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 24 20:56:39.880285 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 24 20:56:39.880285 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 24 20:56:39.880285 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:39.880285 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:39.880285 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:39.880285 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:39.880285 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:39.880285 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:39.880285 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 24 20:56:39.880285 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 24 20:56:39.880285 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 24 20:56:39.880285 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:39.881991 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6ba4e00c-5273-48b1-81f5-5fef39ebc67a tempest-ServicesAdminNegativeV253TestJSON-1261217225 tempest-ServicesAdminNegativeV253TestJSON-1261217225-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:56:39.881991 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6ba4e00c-5273-48b1-81f5-5fef39ebc67a tempest-ServicesAdminNegativeV253TestJSON-1261217225 tempest-ServicesAdminNegativeV253TestJSON-1261217225-project] 10.222.0.52 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.345411 Sep 24 20:56:39.881991 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 993/1974] 10.222.0.52 () {60 vars in 1178 bytes} [Sat Sep 24 20:56:39 2022] GET /compute/v2.1/os-services => generated 112 bytes in 346 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Sep 24 20:56:39.886276 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d9f14b90-ce17-412c-b0d2-b12823be1fa8 tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] Calling method '.version_select at 0x7f4b0cfe3700>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:39.957509 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d9f14b90-ce17-412c-b0d2-b12823be1fa8 tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] 10.222.0.52 "GET /compute/v2.1/images/0631c3f0-c8d8-4660-8f2e-5e74044bebe8/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.079890 Sep 24 20:56:39.958689 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 994/1975] 10.222.0.52 () {58 vars in 1290 bytes} [Sat Sep 24 20:56:39 2022] GET /compute/v2.1/images/0631c3f0-c8d8-4660-8f2e-5e74044bebe8/metadata/os_distro => generated 33 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:56:39.963829 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-57b15e4d-83ac-43c7-a627-80d5bedf40ef tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:39.964632 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-57b15e4d-83ac-43c7-a627-80d5bedf40ef tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] [instance: 05c0e0fa-1c24-4072-9663-5c0752c685e0] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:39.972181 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57b15e4d-83ac-43c7-a627-80d5bedf40ef tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:39.972662 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57b15e4d-83ac-43c7-a627-80d5bedf40ef tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:39.973212 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57b15e4d-83ac-43c7-a627-80d5bedf40ef tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:39.974172 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57b15e4d-83ac-43c7-a627-80d5bedf40ef tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:39.974803 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57b15e4d-83ac-43c7-a627-80d5bedf40ef tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:39.975319 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57b15e4d-83ac-43c7-a627-80d5bedf40ef tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:40.281451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG neutronclient.v2_0.client [None req-4eb12401-315b-49cd-ba1d-b5bbd1a0748d tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.7.204 (d58cc77f-10ac-42f1-b16f-00c88be37a63) with port 9d899e46-f44e-4bfc-b166-96ac7ad71d19 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network c58107ef-9de1-4174-95fe-9673bfb49cab.", "detail": ""}} {{(pid=140516) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 24 20:56:40.283502 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4eb12401-315b-49cd-ba1d-b5bbd1a0748d tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Releasing lock "refresh_cache-834ff250-11c3-4391-aae5-7f3e6fa33166" {{(pid=140516) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 24 20:56:40.284983 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-4eb12401-315b-49cd-ba1d-b5bbd1a0748d tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] HTTP exception thrown: Cannot associate floating IP 172.35.7.204 (d58cc77f-10ac-42f1-b16f-00c88be37a63) with port 9d899e46-f44e-4bfc-b166-96ac7ad71d19 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network c58107ef-9de1-4174-95fe-9673bfb49cab. Sep 24 20:56:40.284983 ncdv-master-1 devstack@n-api.service[140516]: Neutron server returns request_ids: ['req-f4b83239-fb63-47d6-ab55-e8f6c8a9a7a3'] Sep 24 20:56:40.291380 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4eb12401-315b-49cd-ba1d-b5bbd1a0748d tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Request method failure captured: Sep 24 20:56:40.291380 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166/action HTTP/1.1 Sep 24 20:56:40.291380 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:56:40.291380 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:56:40.291380 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:56:40.291380 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 46 Sep 24 20:56:40.291380 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:56:40.291380 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:56:40.291380 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:56:40.291380 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:56:40.291380 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL27jOJkgxsOBw7lFZf-oGbOkVF-ZY4rL1xU369nq3wlqvBIm2lyvH6guUjEoNJZVvf9Jo_kvriGIXncTthwp30F7BiGraxMTkU0K4OMsYZVw-bPUX_noga7iTXvzd_onCx4a03_ghhw6BbwmvAFuWIqab3Yiqlq_4MHiIZ4w-N9JT3Y Sep 24 20:56:40.291380 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:56:40.291380 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:56:40.291380 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:56:40.291380 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:56:40.291380 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:56:40.291380 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:56:40.291380 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 8afe75ffdb814e0ba23546cf3866ceac Sep 24 20:56:40.291380 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 Sep 24 20:56:40.291380 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:56:40.291380 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:56:40.292997 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8afe75ffdb814e0ba23546cf3866ceac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8afe75ffdb814e0ba23546cf3866ceac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8afe75ffdb814e0ba23546cf3866ceac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8afe75ffdb814e0ba23546cf3866ceac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:56:40.292997 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 Sep 24 20:56:40.292997 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 8afe75ffdb814e0ba23546cf3866ceac Sep 24 20:56:40.292997 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 Sep 24 20:56:40.292997 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project Sep 24 20:56:40.292997 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:56:40.292997 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:56:40.292997 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 302ac6f497cf4d3c8c638f5b4b49f723 Sep 24 20:56:40.292997 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project Sep 24 20:56:40.292997 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 20:56:40.292997 ncdv-master-1 devstack@n-api.service[140516]: {"addFloatingIp": {"address": "172.35.7.204"}} Sep 24 20:56:40.292997 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:56:40.293874 ncdv-master-1 devstack@n-api.service[140516]: exception: Cannot associate floating IP 172.35.7.204 (d58cc77f-10ac-42f1-b16f-00c88be37a63) with port 9d899e46-f44e-4bfc-b166-96ac7ad71d19 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network c58107ef-9de1-4174-95fe-9673bfb49cab. Sep 24 20:56:40.293874 ncdv-master-1 devstack@n-api.service[140516]: Neutron server returns request_ids: ['req-f4b83239-fb63-47d6-ab55-e8f6c8a9a7a3'] Sep 24 20:56:40.293874 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '834ff250-11c3-4391-aae5-7f3e6fa33166', 'body': {'addFloatingIp': {'address': '172.35.7.204'}}} Sep 24 20:56:40.293874 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:56:40.293874 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:40.293874 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Sep 24 20:56:40.293874 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Sep 24 20:56:40.293874 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:56:40.293874 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:56:40.293874 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Sep 24 20:56:40.293874 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Sep 24 20:56:40.293874 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:56:40.293874 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:56:40.293874 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Sep 24 20:56:40.293874 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Sep 24 20:56:40.293874 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:56:40.293874 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:56:40.295161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Sep 24 20:56:40.295161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Sep 24 20:56:40.295161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:56:40.295161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:56:40.295161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 24 20:56:40.295161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 24 20:56:40.295161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:56:40.295161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:56:40.295161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 24 20:56:40.295161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 24 20:56:40.295161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 20:56:40.295161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 20:56:40.295161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 24 20:56:40.295161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 24 20:56:40.295161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 24 20:56:40.295161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 24 20:56:40.296339 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.35.7.204 (d58cc77f-10ac-42f1-b16f-00c88be37a63) with port 9d899e46-f44e-4bfc-b166-96ac7ad71d19 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network c58107ef-9de1-4174-95fe-9673bfb49cab. Sep 24 20:56:40.296339 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4b83239-fb63-47d6-ab55-e8f6c8a9a7a3'] Sep 24 20:56:40.296339 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:40.296339 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:40.296339 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:40.296339 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:40.296339 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 24 20:56:40.296339 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 24 20:56:40.296339 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 24 20:56:40.296339 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 24 20:56:40.296339 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Sep 24 20:56:40.296339 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Sep 24 20:56:40.296339 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.35.7.204 (d58cc77f-10ac-42f1-b16f-00c88be37a63) with port 9d899e46-f44e-4bfc-b166-96ac7ad71d19 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network c58107ef-9de1-4174-95fe-9673bfb49cab. Sep 24 20:56:40.296339 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4b83239-fb63-47d6-ab55-e8f6c8a9a7a3'] Sep 24 20:56:40.296339 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:40.296339 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:40.299392 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:40.299392 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:40.299392 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:40.299392 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:40.299392 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:56:40.299392 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:56:40.299392 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:56:40.299392 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:56:40.299392 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:56:40.299392 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:56:40.299392 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:56:40.299392 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:56:40.299392 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Sep 24 20:56:40.299392 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Sep 24 20:56:40.299392 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.35.7.204 (d58cc77f-10ac-42f1-b16f-00c88be37a63) with port 9d899e46-f44e-4bfc-b166-96ac7ad71d19 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network c58107ef-9de1-4174-95fe-9673bfb49cab. Sep 24 20:56:40.299392 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4b83239-fb63-47d6-ab55-e8f6c8a9a7a3'] Sep 24 20:56:40.299392 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:40.299392 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:40.304811 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:40.304811 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:40.304811 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:40.304811 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:40.304811 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:56:40.304811 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:56:40.304811 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.35.7.204 (d58cc77f-10ac-42f1-b16f-00c88be37a63) with port 9d899e46-f44e-4bfc-b166-96ac7ad71d19 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network c58107ef-9de1-4174-95fe-9673bfb49cab. Sep 24 20:56:40.304811 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4b83239-fb63-47d6-ab55-e8f6c8a9a7a3'] Sep 24 20:56:40.304811 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:40.304811 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4eb12401-315b-49cd-ba1d-b5bbd1a0748d tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Returning 400 to user: Cannot associate floating IP 172.35.7.204 (d58cc77f-10ac-42f1-b16f-00c88be37a63) with port 9d899e46-f44e-4bfc-b166-96ac7ad71d19 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network c58107ef-9de1-4174-95fe-9673bfb49cab. Sep 24 20:56:40.304811 ncdv-master-1 devstack@n-api.service[140516]: Neutron server returns request_ids: ['req-f4b83239-fb63-47d6-ab55-e8f6c8a9a7a3'] {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:56:40.307141 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4eb12401-315b-49cd-ba1d-b5bbd1a0748d tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] 10.222.0.52 "POST /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166/action" status: 400 len: 382 microversion: 2.1 time: 0.812849 Sep 24 20:56:40.307141 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 982/1976] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:56:39 2022] POST /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166/action => generated 382 bytes in 814 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 20:56:40.319733 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b9845453-869d-4b00-aae0-c77e14408636 tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] Action: 'update_all', calling method: .version_select at 0x7f4b1106a4c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:40.372332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-57b15e4d-83ac-43c7-a627-80d5bedf40ef tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa253ded2304ac3917a1788b6a1500b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f6b606beca4eb5b62c89a945be15c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:40.387025 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-57b15e4d-83ac-43c7-a627-80d5bedf40ef tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] 10.222.0.52 "GET /compute/v2.1/servers/05c0e0fa-1c24-4072-9663-5c0752c685e0" status: 200 len: 1395 microversion: 2.1 time: 0.426540 Sep 24 20:56:40.391954 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 995/1977] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:39 2022] GET /compute/v2.1/servers/05c0e0fa-1c24-4072-9663-5c0752c685e0 => generated 1395 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:40.400944 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-b9845453-869d-4b00-aae0-c77e14408636 tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] Getting quotas for project 7c8ce066fefe47a69e2bf6d625c01eb7. Resources: dict_keys(['metadata_items']) {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:56:40.406081 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-38301133-f8ea-495a-8d99-0c84716d8be9 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:40.406860 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-38301133-f8ea-495a-8d99-0c84716d8be9 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:40.414424 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-b9845453-869d-4b00-aae0-c77e14408636 tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] Getting quotas for user 5c77dbc1dbd748668e76f2bebc0220d1 and project 7c8ce066fefe47a69e2bf6d625c01eb7. Resources: dict_keys(['metadata_items']) {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:56:40.427097 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38301133-f8ea-495a-8d99-0c84716d8be9 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:40.431843 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38301133-f8ea-495a-8d99-0c84716d8be9 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:40.432406 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38301133-f8ea-495a-8d99-0c84716d8be9 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:40.433198 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38301133-f8ea-495a-8d99-0c84716d8be9 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:40.433726 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38301133-f8ea-495a-8d99-0c84716d8be9 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:40.434107 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38301133-f8ea-495a-8d99-0c84716d8be9 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:40.730105 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b9845453-869d-4b00-aae0-c77e14408636 tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] 10.222.0.52 "PUT /compute/v2.1/images/0631c3f0-c8d8-4660-8f2e-5e74044bebe8/metadata" status: 200 len: 61 microversion: 2.1 time: 0.434245 Sep 24 20:56:40.730993 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 983/1978] 10.222.0.52 () {60 vars in 1280 bytes} [Sat Sep 24 20:56:40 2022] PUT /compute/v2.1/images/0631c3f0-c8d8-4660-8f2e-5e74044bebe8/metadata => generated 61 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:56:40.745466 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5dcba247-69ef-4d09-b3ca-69aaf887e954 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Calling method '.version_select at 0x7f4b11116670>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:40.860705 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-38301133-f8ea-495a-8d99-0c84716d8be9 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:40.864717 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:56:40.870863 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-38301133-f8ea-495a-8d99-0c84716d8be9 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1382 microversion: 2.1 time: 0.477396 Sep 24 20:56:40.871711 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 996/1979] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:40 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1382 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:40.877920 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bf553391-cb1b-450b-97f2-b958b9b843af tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:40.878880 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bf553391-cb1b-450b-97f2-b958b9b843af tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:40.886307 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf553391-cb1b-450b-97f2-b958b9b843af tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:40.887267 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf553391-cb1b-450b-97f2-b958b9b843af tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:40.887958 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf553391-cb1b-450b-97f2-b958b9b843af tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:40.889121 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf553391-cb1b-450b-97f2-b958b9b843af tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:40.890047 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf553391-cb1b-450b-97f2-b958b9b843af tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:40.890795 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf553391-cb1b-450b-97f2-b958b9b843af tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:41.215807 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bf553391-cb1b-450b-97f2-b958b9b843af tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:41.229953 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bf553391-cb1b-450b-97f2-b958b9b843af tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:41.239969 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bf553391-cb1b-450b-97f2-b958b9b843af tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:41.241285 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bf553391-cb1b-450b-97f2-b958b9b843af tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1812 microversion: 2.25 time: 0.368306 Sep 24 20:56:41.242099 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 997/1980] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:56:40 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1812 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:56:41.249723 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-41e00968-79dc-484f-a358-73de08e3afce tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] Calling method '.version_select at 0x7f4b1109ef70>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:41.298842 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-41e00968-79dc-484f-a358-73de08e3afce tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] 10.222.0.52 "GET /compute/v2.1/images/0631c3f0-c8d8-4660-8f2e-5e74044bebe8/metadata" status: 200 len: 61 microversion: 2.1 time: 0.053944 Sep 24 20:56:41.313033 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 998/1981] 10.222.0.52 () {58 vars in 1260 bytes} [Sat Sep 24 20:56:41 2022] GET /compute/v2.1/images/0631c3f0-c8d8-4660-8f2e-5e74044bebe8/metadata => generated 61 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:56:41.322053 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-e5912e11-844d-4e92-a1bd-1d63222a1b10 req-714d46ba-ac92-4490-90a4-5fb5663e37cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c0e0fa-1c24-4072-9663-5c0752c685e0", "name": "network-vif-plugged", "status": "completed", "tag": "81d220f2-0310-473b-a74f-b729c26b0e34"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:41.337217 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e5912e11-844d-4e92-a1bd-1d63222a1b10 req-714d46ba-ac92-4490-90a4-5fb5663e37cf service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:41.338410 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e5912e11-844d-4e92-a1bd-1d63222a1b10 req-714d46ba-ac92-4490-90a4-5fb5663e37cf service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:41.339321 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e5912e11-844d-4e92-a1bd-1d63222a1b10 req-714d46ba-ac92-4490-90a4-5fb5663e37cf service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:41.363607 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-e5912e11-844d-4e92-a1bd-1d63222a1b10 req-714d46ba-ac92-4490-90a4-5fb5663e37cf service nova] Creating event network-vif-plugged:81d220f2-0310-473b-a74f-b729c26b0e34 for instance 05c0e0fa-1c24-4072-9663-5c0752c685e0 on nch1-master-1 Sep 24 20:56:41.374369 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-e5912e11-844d-4e92-a1bd-1d63222a1b10 req-714d46ba-ac92-4490-90a4-5fb5663e37cf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058780 Sep 24 20:56:41.376404 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 999/1982] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:56:41.411302 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d307ee81-091c-4848-b1ab-03777b2c73c1 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Calling method '.version_select at 0x7f4b1110fe50>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:41.420712 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d307ee81-091c-4848-b1ab-03777b2c73c1 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:41.421295 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d307ee81-091c-4848-b1ab-03777b2c73c1 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:41.422110 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d307ee81-091c-4848-b1ab-03777b2c73c1 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:41.455127 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d307ee81-091c-4848-b1ab-03777b2c73c1 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 2706 microversion: 2.1 time: 0.072912 Sep 24 20:56:41.468952 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1000/1983] 10.222.0.52 () {58 vars in 1143 bytes} [Sat Sep 24 20:56:41 2022] GET /compute/v2.1/os-migrations => generated 2706 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:41.469431 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-77283a2d-1e4d-481f-a760-1989981cd762 tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] Action: 'update_all', calling method: .version_select at 0x7f4b0cd9f940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:41.579878 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-77283a2d-1e4d-481f-a760-1989981cd762 tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] Getting quotas for project 7c8ce066fefe47a69e2bf6d625c01eb7. Resources: dict_keys(['metadata_items']) {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:56:41.588815 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-77283a2d-1e4d-481f-a760-1989981cd762 tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] Getting quotas for user 5c77dbc1dbd748668e76f2bebc0220d1 and project 7c8ce066fefe47a69e2bf6d625c01eb7. Resources: dict_keys(['metadata_items']) {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:56:41.932941 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-77283a2d-1e4d-481f-a760-1989981cd762 tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] 10.222.0.52 "PUT /compute/v2.1/images/0631c3f0-c8d8-4660-8f2e-5e74044bebe8/metadata" status: 200 len: 61 microversion: 2.1 time: 0.471138 Sep 24 20:56:41.935577 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1001/1984] 10.222.0.52 () {60 vars in 1280 bytes} [Sat Sep 24 20:56:41 2022] PUT /compute/v2.1/images/0631c3f0-c8d8-4660-8f2e-5e74044bebe8/metadata => generated 61 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:56:41.958254 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c64a45a1-e682-483e-87b5-ecba0dacde9b tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:41.963450 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c64a45a1-e682-483e-87b5-ecba0dacde9b tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] [instance: 05c0e0fa-1c24-4072-9663-5c0752c685e0] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:41.983536 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c64a45a1-e682-483e-87b5-ecba0dacde9b tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:41.984038 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c64a45a1-e682-483e-87b5-ecba0dacde9b tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:41.992518 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c64a45a1-e682-483e-87b5-ecba0dacde9b tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:41.995026 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c64a45a1-e682-483e-87b5-ecba0dacde9b tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:41.995955 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c64a45a1-e682-483e-87b5-ecba0dacde9b tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:41.997024 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c64a45a1-e682-483e-87b5-ecba0dacde9b tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:42.371620 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c64a45a1-e682-483e-87b5-ecba0dacde9b tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa253ded2304ac3917a1788b6a1500b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f6b606beca4eb5b62c89a945be15c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:42.390934 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c64a45a1-e682-483e-87b5-ecba0dacde9b tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] 10.222.0.52 "GET /compute/v2.1/servers/05c0e0fa-1c24-4072-9663-5c0752c685e0" status: 200 len: 1395 microversion: 2.1 time: 0.453409 Sep 24 20:56:42.394521 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1002/1985] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:41 2022] GET /compute/v2.1/servers/05c0e0fa-1c24-4072-9663-5c0752c685e0 => generated 1395 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:42.423685 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d08a7be1-5fc9-4760-beef-224bfb848d12 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:42.425909 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d08a7be1-5fc9-4760-beef-224bfb848d12 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:42.444273 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d08a7be1-5fc9-4760-beef-224bfb848d12 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:42.446189 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d08a7be1-5fc9-4760-beef-224bfb848d12 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:42.447183 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d08a7be1-5fc9-4760-beef-224bfb848d12 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:42.449826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d08a7be1-5fc9-4760-beef-224bfb848d12 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:42.451266 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d08a7be1-5fc9-4760-beef-224bfb848d12 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:42.452783 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d08a7be1-5fc9-4760-beef-224bfb848d12 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:42.749264 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5dcba247-69ef-4d09-b3ca-69aaf887e954 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/d58cc77f-10ac-42f1-b16f-00c88be37a63" status: 202 len: 0 microversion: 2.1 time: 2.016896 Sep 24 20:56:42.750533 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 984/1986] 10.222.0.52 () {58 vars in 1263 bytes} [Sat Sep 24 20:56:40 2022] DELETE /compute/v2.1/os-floating-ips/d58cc77f-10ac-42f1-b16f-00c88be37a63 => generated 0 bytes in 2019 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:56:42.758669 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-422253e8-4b95-4047-8d6b-9d4f78e89663 tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] Action: 'update_all', calling method: .version_select at 0x7f4b11174280>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:42.806885 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d08a7be1-5fc9-4760-beef-224bfb848d12 tempest-LiveMigrationTest-730417024 tempest-LiveMigrationTest-730417024-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1533 microversion: 2.1 time: 0.406420 Sep 24 20:56:42.808313 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1003/1987] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:42 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1533 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:42.834176 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f8dabebd-daec-4c33-bd8a-ed8a3479972b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:42.835927 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f8dabebd-daec-4c33-bd8a-ed8a3479972b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:42.843779 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8dabebd-daec-4c33-bd8a-ed8a3479972b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:42.845082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8dabebd-daec-4c33-bd8a-ed8a3479972b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:42.845776 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8dabebd-daec-4c33-bd8a-ed8a3479972b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:42.847103 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8dabebd-daec-4c33-bd8a-ed8a3479972b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:42.848325 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8dabebd-daec-4c33-bd8a-ed8a3479972b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:42.848782 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8dabebd-daec-4c33-bd8a-ed8a3479972b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:42.850401 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-422253e8-4b95-4047-8d6b-9d4f78e89663 tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] Getting quotas for project 7c8ce066fefe47a69e2bf6d625c01eb7. Resources: dict_keys(['metadata_items']) {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:56:42.858490 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-422253e8-4b95-4047-8d6b-9d4f78e89663 tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] Getting quotas for user 5c77dbc1dbd748668e76f2bebc0220d1 and project 7c8ce066fefe47a69e2bf6d625c01eb7. Resources: dict_keys(['metadata_items']) {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:56:43.089439 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f8dabebd-daec-4c33-bd8a-ed8a3479972b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:43.102252 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f8dabebd-daec-4c33-bd8a-ed8a3479972b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:43.106299 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f8dabebd-daec-4c33-bd8a-ed8a3479972b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:43.108669 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f8dabebd-daec-4c33-bd8a-ed8a3479972b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1812 microversion: 2.25 time: 0.289794 Sep 24 20:56:43.109733 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1004/1988] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:56:42 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1812 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:56:43.119027 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-33fc01bb-d7f7-4cd4-919b-05a1d3188609 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Action: 'action', calling method: .version_select at 0x7f4b0e294670>, body: {"removeFloatingIp": {"address": "172.35.7.202"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:43.375301 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-422253e8-4b95-4047-8d6b-9d4f78e89663 tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] 10.222.0.52 "PUT /compute/v2.1/images/0631c3f0-c8d8-4660-8f2e-5e74044bebe8/metadata" status: 200 len: 64 microversion: 2.1 time: 0.623403 Sep 24 20:56:43.379174 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 985/1989] 10.222.0.52 () {60 vars in 1280 bytes} [Sat Sep 24 20:56:42 2022] PUT /compute/v2.1/images/0631c3f0-c8d8-4660-8f2e-5e74044bebe8/metadata => generated 64 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:56:43.388487 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-34b6d407-41e8-44b4-8d7f-3b7be2cbfcce tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:43.390329 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-34b6d407-41e8-44b4-8d7f-3b7be2cbfcce tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:43.399398 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34b6d407-41e8-44b4-8d7f-3b7be2cbfcce tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:43.400186 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34b6d407-41e8-44b4-8d7f-3b7be2cbfcce tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:43.401677 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34b6d407-41e8-44b4-8d7f-3b7be2cbfcce tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:43.404088 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34b6d407-41e8-44b4-8d7f-3b7be2cbfcce tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:43.404756 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34b6d407-41e8-44b4-8d7f-3b7be2cbfcce tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:43.405365 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34b6d407-41e8-44b4-8d7f-3b7be2cbfcce tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:43.419319 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-33fc01bb-d7f7-4cd4-919b-05a1d3188609 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] [instance: 834ff250-11c3-4391-aae5-7f3e6fa33166] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:43.431167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33fc01bb-d7f7-4cd4-919b-05a1d3188609 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:43.432115 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33fc01bb-d7f7-4cd4-919b-05a1d3188609 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:43.433031 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33fc01bb-d7f7-4cd4-919b-05a1d3188609 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:43.434367 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33fc01bb-d7f7-4cd4-919b-05a1d3188609 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:43.435066 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33fc01bb-d7f7-4cd4-919b-05a1d3188609 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:43.435917 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33fc01bb-d7f7-4cd4-919b-05a1d3188609 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:43.448682 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-34b6d407-41e8-44b4-8d7f-3b7be2cbfcce tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:56:43.595496 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-34b6d407-41e8-44b4-8d7f-3b7be2cbfcce tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 204 len: 0 microversion: 2.1 time: 0.214781 Sep 24 20:56:43.597787 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 986/1990] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:56:43 2022] DELETE /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:56:43.606717 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3e3679f3-d879-4933-b5fc-68b15174aa71 tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] Calling method '.version_select at 0x7f4b111cc1f0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:43.673160 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3e3679f3-d879-4933-b5fc-68b15174aa71 tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] 10.222.0.52 "GET /compute/v2.1/images/0631c3f0-c8d8-4660-8f2e-5e74044bebe8/metadata" status: 200 len: 64 microversion: 2.1 time: 0.073831 Sep 24 20:56:43.674075 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 987/1991] 10.222.0.52 () {58 vars in 1260 bytes} [Sat Sep 24 20:56:43 2022] GET /compute/v2.1/images/0631c3f0-c8d8-4660-8f2e-5e74044bebe8/metadata => generated 64 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:56:43.686225 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4b0ba16f-ad55-4994-94e0-fdf8a1090ab7 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:43.687479 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4b0ba16f-ad55-4994-94e0-fdf8a1090ab7 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] [instance: 05c0e0fa-1c24-4072-9663-5c0752c685e0] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:43.714739 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4b0ba16f-ad55-4994-94e0-fdf8a1090ab7 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:43.715656 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4b0ba16f-ad55-4994-94e0-fdf8a1090ab7 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:43.718072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4b0ba16f-ad55-4994-94e0-fdf8a1090ab7 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:43.719400 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4b0ba16f-ad55-4994-94e0-fdf8a1090ab7 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:43.722688 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4b0ba16f-ad55-4994-94e0-fdf8a1090ab7 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:43.723360 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4b0ba16f-ad55-4994-94e0-fdf8a1090ab7 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:43.804497 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33fc01bb-d7f7-4cd4-919b-05a1d3188609 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquiring lock "refresh_cache-834ff250-11c3-4391-aae5-7f3e6fa33166" {{(pid=140517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 24 20:56:43.805002 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33fc01bb-d7f7-4cd4-919b-05a1d3188609 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquired lock "refresh_cache-834ff250-11c3-4391-aae5-7f3e6fa33166" {{(pid=140517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 24 20:56:44.158719 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4b0ba16f-ad55-4994-94e0-fdf8a1090ab7 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa253ded2304ac3917a1788b6a1500b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f6b606beca4eb5b62c89a945be15c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:44.168627 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4b0ba16f-ad55-4994-94e0-fdf8a1090ab7 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] 10.222.0.52 "GET /compute/v2.1/servers/05c0e0fa-1c24-4072-9663-5c0752c685e0" status: 200 len: 1574 microversion: 2.1 time: 0.492263 Sep 24 20:56:44.179524 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 988/1992] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:43 2022] GET /compute/v2.1/servers/05c0e0fa-1c24-4072-9663-5c0752c685e0 => generated 1574 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:44.191789 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cad1f414-39fb-4f44-a506-0ade4ec59bcc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:44.192810 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cad1f414-39fb-4f44-a506-0ade4ec59bcc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:44.200839 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cad1f414-39fb-4f44-a506-0ade4ec59bcc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:44.201935 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cad1f414-39fb-4f44-a506-0ade4ec59bcc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:44.202714 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cad1f414-39fb-4f44-a506-0ade4ec59bcc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:44.203687 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cad1f414-39fb-4f44-a506-0ade4ec59bcc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:44.204614 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cad1f414-39fb-4f44-a506-0ade4ec59bcc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:44.205189 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cad1f414-39fb-4f44-a506-0ade4ec59bcc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:44.698830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cad1f414-39fb-4f44-a506-0ade4ec59bcc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:44.709358 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cad1f414-39fb-4f44-a506-0ade4ec59bcc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1388 microversion: 2.1 time: 0.527668 Sep 24 20:56:44.714822 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 989/1993] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:44 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1388 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:44.720633 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-94091f19-22c1-403e-8888-0e6f074ec8bd tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] Action: 'update_all', calling method: .version_select at 0x7f4b1106a310>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:44.820872 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-94091f19-22c1-403e-8888-0e6f074ec8bd tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] Getting quotas for project 7c8ce066fefe47a69e2bf6d625c01eb7. Resources: dict_keys(['metadata_items']) {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:56:44.843138 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-94091f19-22c1-403e-8888-0e6f074ec8bd tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] Getting quotas for user 5c77dbc1dbd748668e76f2bebc0220d1 and project 7c8ce066fefe47a69e2bf6d625c01eb7. Resources: dict_keys(['metadata_items']) {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:56:45.241449 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-33fc01bb-d7f7-4cd4-919b-05a1d3188609 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] [instance: 834ff250-11c3-4391-aae5-7f3e6fa33166] Building network info cache for instance {{(pid=140517) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 24 20:56:45.316625 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-94091f19-22c1-403e-8888-0e6f074ec8bd tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] 10.222.0.52 "PUT /compute/v2.1/images/0631c3f0-c8d8-4660-8f2e-5e74044bebe8/metadata" status: 200 len: 61 microversion: 2.1 time: 0.596911 Sep 24 20:56:45.318548 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 990/1994] 10.222.0.52 () {60 vars in 1280 bytes} [Sat Sep 24 20:56:44 2022] PUT /compute/v2.1/images/0631c3f0-c8d8-4660-8f2e-5e74044bebe8/metadata => generated 61 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:56:45.328232 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ef89f5f2-6ba0-4365-af7b-0a800f3836d6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:45.329689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ef89f5f2-6ba0-4365-af7b-0a800f3836d6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:45.339058 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef89f5f2-6ba0-4365-af7b-0a800f3836d6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:45.340022 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef89f5f2-6ba0-4365-af7b-0a800f3836d6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:45.342252 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef89f5f2-6ba0-4365-af7b-0a800f3836d6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:45.343575 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef89f5f2-6ba0-4365-af7b-0a800f3836d6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:45.344332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef89f5f2-6ba0-4365-af7b-0a800f3836d6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:45.345094 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef89f5f2-6ba0-4365-af7b-0a800f3836d6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:45.685810 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ef89f5f2-6ba0-4365-af7b-0a800f3836d6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:45.702267 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ef89f5f2-6ba0-4365-af7b-0a800f3836d6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:45.703992 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ef89f5f2-6ba0-4365-af7b-0a800f3836d6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:45.712531 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ef89f5f2-6ba0-4365-af7b-0a800f3836d6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1812 microversion: 2.25 time: 0.391873 Sep 24 20:56:45.713527 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 991/1995] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:56:45 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1812 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:56:45.718841 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-46bfb6e9-8cb7-47c5-89e4-69699eb6e2ee tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:45.722084 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-46bfb6e9-8cb7-47c5-89e4-69699eb6e2ee tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] [instance: 05c0e0fa-1c24-4072-9663-5c0752c685e0] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:45.736679 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-46bfb6e9-8cb7-47c5-89e4-69699eb6e2ee tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:45.737684 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-46bfb6e9-8cb7-47c5-89e4-69699eb6e2ee tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:45.738334 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-46bfb6e9-8cb7-47c5-89e4-69699eb6e2ee tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:45.740667 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-46bfb6e9-8cb7-47c5-89e4-69699eb6e2ee tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:45.741368 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-46bfb6e9-8cb7-47c5-89e4-69699eb6e2ee tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:45.743241 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-46bfb6e9-8cb7-47c5-89e4-69699eb6e2ee tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:45.884048 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-46bfb6e9-8cb7-47c5-89e4-69699eb6e2ee tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] 10.222.0.52 "GET /compute/v2.1/servers/05c0e0fa-1c24-4072-9663-5c0752c685e0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.168480 Sep 24 20:56:45.884274 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 992/1996] 10.222.0.52 () {58 vars in 1275 bytes} [Sat Sep 24 20:56:45 2022] GET /compute/v2.1/servers/05c0e0fa-1c24-4072-9663-5c0752c685e0/os-interface => generated 284 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:56:45.895333 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-de0bebcf-b636-480a-ac2e-a8f968ed8588 req-6555daa8-35a3-423c-8373-c32652d796bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "834ff250-11c3-4391-aae5-7f3e6fa33166", "tag": "9d899e46-f44e-4bfc-b166-96ac7ad71d19"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:45.911134 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-de0bebcf-b636-480a-ac2e-a8f968ed8588 req-6555daa8-35a3-423c-8373-c32652d796bc service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:45.911680 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-de0bebcf-b636-480a-ac2e-a8f968ed8588 req-6555daa8-35a3-423c-8373-c32652d796bc service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:45.912119 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-de0bebcf-b636-480a-ac2e-a8f968ed8588 req-6555daa8-35a3-423c-8373-c32652d796bc service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:45.934195 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-de0bebcf-b636-480a-ac2e-a8f968ed8588 req-6555daa8-35a3-423c-8373-c32652d796bc service nova] Creating event network-changed:9d899e46-f44e-4bfc-b166-96ac7ad71d19 for instance 834ff250-11c3-4391-aae5-7f3e6fa33166 on nch2-master-1 Sep 24 20:56:45.953508 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-de0bebcf-b636-480a-ac2e-a8f968ed8588 req-6555daa8-35a3-423c-8373-c32652d796bc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064738 Sep 24 20:56:45.955197 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 993/1997] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:56:45.971643 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9830a7fd-dcee-44a2-8bad-0126c89b8a51 tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] Action: 'update', calling method: .version_select at 0x7f4b1117b3a0>, body: {"meta": {"os_version": "alt"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:46.088475 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-9830a7fd-dcee-44a2-8bad-0126c89b8a51 tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] Getting quotas for project 7c8ce066fefe47a69e2bf6d625c01eb7. Resources: dict_keys(['metadata_items']) {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:56:46.097269 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-9830a7fd-dcee-44a2-8bad-0126c89b8a51 tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] Getting quotas for user 5c77dbc1dbd748668e76f2bebc0220d1 and project 7c8ce066fefe47a69e2bf6d625c01eb7. Resources: dict_keys(['metadata_items']) {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:56:46.679298 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9830a7fd-dcee-44a2-8bad-0126c89b8a51 tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] 10.222.0.52 "PUT /compute/v2.1/images/0631c3f0-c8d8-4660-8f2e-5e74044bebe8/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.722530 Sep 24 20:56:46.681193 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 994/1998] 10.222.0.52 () {60 vars in 1313 bytes} [Sat Sep 24 20:56:45 2022] PUT /compute/v2.1/images/0631c3f0-c8d8-4660-8f2e-5e74044bebe8/metadata/os_version => generated 31 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:56:46.689237 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2412efff-05f8-466a-864b-d183aeaadffb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:46.693082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2412efff-05f8-466a-864b-d183aeaadffb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:46.707018 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2412efff-05f8-466a-864b-d183aeaadffb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:46.707778 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2412efff-05f8-466a-864b-d183aeaadffb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:46.708422 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2412efff-05f8-466a-864b-d183aeaadffb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:46.709369 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2412efff-05f8-466a-864b-d183aeaadffb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:46.710027 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2412efff-05f8-466a-864b-d183aeaadffb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:46.711495 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2412efff-05f8-466a-864b-d183aeaadffb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:47.111703 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2412efff-05f8-466a-864b-d183aeaadffb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:47.134311 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2412efff-05f8-466a-864b-d183aeaadffb tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1388 microversion: 2.1 time: 0.450870 Sep 24 20:56:47.136792 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 995/1999] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:46 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1388 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:47.252007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-33fc01bb-d7f7-4cd4-919b-05a1d3188609 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] [instance: 834ff250-11c3-4391-aae5-7f3e6fa33166] Updating instance_info_cache with network_info: [{"id": "9d899e46-f44e-4bfc-b166-96ac7ad71d19", "address": "fa:16:3e:74:3f:92", "network": {"id": "c529e650-5f5f-4183-be3c-902fe3314684", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1231048229-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8afe75ffdb814e0ba23546cf3866ceac", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9d899e46-f4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140517) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 24 20:56:47.276776 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33fc01bb-d7f7-4cd4-919b-05a1d3188609 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Releasing lock "refresh_cache-834ff250-11c3-4391-aae5-7f3e6fa33166" {{(pid=140517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 24 20:56:47.280862 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-33fc01bb-d7f7-4cd4-919b-05a1d3188609 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] 10.222.0.52 "POST /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166/action" status: 202 len: 0 microversion: 2.1 time: 4.169642 Sep 24 20:56:47.282935 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1005/2000] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:56:43 2022] POST /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166/action => generated 0 bytes in 4172 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 24 20:56:47.290792 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-58da1ba4-f185-43e5-a38d-79bf8d892a59 tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] Calling method '.version_select at 0x7f4b0c9ad820>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:47.359013 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-58da1ba4-f185-43e5-a38d-79bf8d892a59 tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] 10.222.0.52 "GET /compute/v2.1/images/0631c3f0-c8d8-4660-8f2e-5e74044bebe8/metadata" status: 200 len: 58 microversion: 2.1 time: 0.074677 Sep 24 20:56:47.366229 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1006/2001] 10.222.0.52 () {58 vars in 1260 bytes} [Sat Sep 24 20:56:47 2022] GET /compute/v2.1/images/0631c3f0-c8d8-4660-8f2e-5e74044bebe8/metadata => generated 58 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:56:47.372321 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ff018cde-032a-4253-af4b-fbd83ea24e41 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:47.372948 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ff018cde-032a-4253-af4b-fbd83ea24e41 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:47.394085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff018cde-032a-4253-af4b-fbd83ea24e41 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:47.395108 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff018cde-032a-4253-af4b-fbd83ea24e41 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:47.395561 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff018cde-032a-4253-af4b-fbd83ea24e41 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:47.396624 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff018cde-032a-4253-af4b-fbd83ea24e41 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:47.398032 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff018cde-032a-4253-af4b-fbd83ea24e41 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:47.398466 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff018cde-032a-4253-af4b-fbd83ea24e41 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:47.448272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0919ca2d-84eb-4a32-82f0-32727dd731ad tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-173125039", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:47.548141 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-0919ca2d-84eb-4a32-82f0-32727dd731ad tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] validate_networks() for None {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:56:47.957795 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ff018cde-032a-4253-af4b-fbd83ea24e41 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:47.967242 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ff018cde-032a-4253-af4b-fbd83ea24e41 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:47.968907 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ff018cde-032a-4253-af4b-fbd83ea24e41 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:47.975053 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ff018cde-032a-4253-af4b-fbd83ea24e41 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1812 microversion: 2.25 time: 0.607347 Sep 24 20:56:47.997251 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1007/2002] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:56:47 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1812 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:56:48.002477 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-95679228-45ef-4578-a8cf-a47f811a9b16 req-b0b3d9eb-7856-4b8a-9e94-ad0b1750cfc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eeb37e4-c327-4c29-a1a9-ae517e3e55ea", "name": "network-vif-deleted", "tag": "abcad753-fa76-461f-a30f-d6161dbdea13"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:48.012283 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-0919ca2d-84eb-4a32-82f0-32727dd731ad tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:56:48.013327 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-0919ca2d-84eb-4a32-82f0-32727dd731ad tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:56:48.014100 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-0919ca2d-84eb-4a32-82f0-32727dd731ad tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:56:48.014752 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-0919ca2d-84eb-4a32-82f0-32727dd731ad tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:56:48.015362 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-0919ca2d-84eb-4a32-82f0-32727dd731ad tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:56:48.017891 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-95679228-45ef-4578-a8cf-a47f811a9b16 req-b0b3d9eb-7856-4b8a-9e94-ad0b1750cfc1 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:48.019470 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-95679228-45ef-4578-a8cf-a47f811a9b16 req-b0b3d9eb-7856-4b8a-9e94-ad0b1750cfc1 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:48.020394 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-95679228-45ef-4578-a8cf-a47f811a9b16 req-b0b3d9eb-7856-4b8a-9e94-ad0b1750cfc1 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:48.032142 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0919ca2d-84eb-4a32-82f0-32727dd731ad tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:48.035660 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0919ca2d-84eb-4a32-82f0-32727dd731ad tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:48.036185 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0919ca2d-84eb-4a32-82f0-32727dd731ad tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:48.037357 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0919ca2d-84eb-4a32-82f0-32727dd731ad tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:48.042849 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0919ca2d-84eb-4a32-82f0-32727dd731ad tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:48.043604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0919ca2d-84eb-4a32-82f0-32727dd731ad tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:48.053312 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-95679228-45ef-4578-a8cf-a47f811a9b16 req-b0b3d9eb-7856-4b8a-9e94-ad0b1750cfc1 service nova] Creating event network-vif-deleted:abcad753-fa76-461f-a30f-d6161dbdea13 for instance 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea on nch2-master-1 Sep 24 20:56:48.060435 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-95679228-45ef-4578-a8cf-a47f811a9b16 req-b0b3d9eb-7856-4b8a-9e94-ad0b1750cfc1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061522 Sep 24 20:56:48.061471 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1008/2003] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:56:48.068708 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b0be2773-91ac-4822-a991-ce5c0397af3b tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Calling method '.version_select at 0x7f4b1100fe50>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:48.087446 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-0919ca2d-84eb-4a32-82f0-32727dd731ad tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Getting quotas for project 749824e2c16946a58801200784fa0480. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:56:48.093123 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-0919ca2d-84eb-4a32-82f0-32727dd731ad tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Getting quotas for user 9dd09a0889c44ce18f0c361c7c661465 and project 749824e2c16946a58801200784fa0480. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:56:48.110554 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0919ca2d-84eb-4a32-82f0-32727dd731ad tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:56:48.114750 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0919ca2d-84eb-4a32-82f0-32727dd731ad tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] [instance: dd9d2c1a-53a4-4426-b01f-c286b39e7309] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:56:48.129872 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:56:48.175742 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0919ca2d-84eb-4a32-82f0-32727dd731ad tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.037313 Sep 24 20:56:48.176482 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 996/2004] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:56:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:56:48.181541 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-84edc7fc-cfce-427e-a09c-2986303f34e9 tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] Action: 'update_all', calling method: .version_select at 0x7f4b1106a9d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:48.249959 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-84edc7fc-cfce-427e-a09c-2986303f34e9 tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] Getting quotas for project 7c8ce066fefe47a69e2bf6d625c01eb7. Resources: dict_keys(['metadata_items']) {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:56:48.265879 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-84edc7fc-cfce-427e-a09c-2986303f34e9 tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] Getting quotas for user 5c77dbc1dbd748668e76f2bebc0220d1 and project 7c8ce066fefe47a69e2bf6d625c01eb7. Resources: dict_keys(['metadata_items']) {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:56:48.604618 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=4 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:56:48.788868 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-84edc7fc-cfce-427e-a09c-2986303f34e9 tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] 10.222.0.52 "PUT /compute/v2.1/images/0631c3f0-c8d8-4660-8f2e-5e74044bebe8/metadata" status: 200 len: 61 microversion: 2.1 time: 0.611285 Sep 24 20:56:48.790808 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 997/2005] 10.222.0.52 () {60 vars in 1280 bytes} [Sat Sep 24 20:56:48 2022] PUT /compute/v2.1/images/0631c3f0-c8d8-4660-8f2e-5e74044bebe8/metadata => generated 61 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:56:48.802363 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-af266f89-3f36-4e68-b56e-c753a2b68714 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:48.804158 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-af266f89-3f36-4e68-b56e-c753a2b68714 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:48.811067 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af266f89-3f36-4e68-b56e-c753a2b68714 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:48.812476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af266f89-3f36-4e68-b56e-c753a2b68714 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:48.813077 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af266f89-3f36-4e68-b56e-c753a2b68714 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:48.813801 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af266f89-3f36-4e68-b56e-c753a2b68714 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:48.814621 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af266f89-3f36-4e68-b56e-c753a2b68714 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:48.814929 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af266f89-3f36-4e68-b56e-c753a2b68714 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:48.942043 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-af266f89-3f36-4e68-b56e-c753a2b68714 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:48.953950 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-af266f89-3f36-4e68-b56e-c753a2b68714 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1183 microversion: 2.1 time: 0.160532 Sep 24 20:56:48.958942 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 998/2006] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:48 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:48.967398 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e9cf5f97-f43e-42ac-875d-241c0e2bd070 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:48.970737 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e9cf5f97-f43e-42ac-875d-241c0e2bd070 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] [instance: dd9d2c1a-53a4-4426-b01f-c286b39e7309] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:49.184585 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e9cf5f97-f43e-42ac-875d-241c0e2bd070 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd09a0889c44ce18f0c361c7c661465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749824e2c16946a58801200784fa0480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:49.199665 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e9cf5f97-f43e-42ac-875d-241c0e2bd070 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9d2c1a-53a4-4426-b01f-c286b39e7309" status: 200 len: 1213 microversion: 2.1 time: 0.238343 Sep 24 20:56:49.206818 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 999/2007] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:48 2022] GET /compute/v2.1/servers/dd9d2c1a-53a4-4426-b01f-c286b39e7309 => generated 1213 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:49.214377 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-123d576c-2421-4578-8b8d-d0feceb0aaaa tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] Action: 'create', calling method: .version_select at 0x7f4b11116700>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:49.284617 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-123d576c-2421-4578-8b8d-d0feceb0aaaa tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] Getting quotas for project 7c8ce066fefe47a69e2bf6d625c01eb7. Resources: dict_keys(['metadata_items']) {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:56:49.290970 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-123d576c-2421-4578-8b8d-d0feceb0aaaa tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] Getting quotas for user 5c77dbc1dbd748668e76f2bebc0220d1 and project 7c8ce066fefe47a69e2bf6d625c01eb7. Resources: dict_keys(['metadata_items']) {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:56:49.804380 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-123d576c-2421-4578-8b8d-d0feceb0aaaa tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] 10.222.0.52 "POST /compute/v2.1/images/0631c3f0-c8d8-4660-8f2e-5e74044bebe8/metadata" status: 200 len: 85 microversion: 2.1 time: 0.596450 Sep 24 20:56:49.805024 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1000/2008] 10.222.0.52 () {60 vars in 1281 bytes} [Sat Sep 24 20:56:49 2022] POST /compute/v2.1/images/0631c3f0-c8d8-4660-8f2e-5e74044bebe8/metadata => generated 85 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:56:49.816429 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b057d62d-8a7e-48c7-ace6-af800794c42e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:49.817068 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b057d62d-8a7e-48c7-ace6-af800794c42e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:49.823644 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b057d62d-8a7e-48c7-ace6-af800794c42e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:49.824125 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b057d62d-8a7e-48c7-ace6-af800794c42e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:49.824823 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b057d62d-8a7e-48c7-ace6-af800794c42e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:49.825815 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b057d62d-8a7e-48c7-ace6-af800794c42e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:49.826521 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b057d62d-8a7e-48c7-ace6-af800794c42e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:49.827176 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b057d62d-8a7e-48c7-ace6-af800794c42e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:50.166914 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b0be2773-91ac-4822-a991-ce5c0397af3b tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/db0db61b-89cb-4665-b810-814017f34f5d" status: 202 len: 0 microversion: 2.1 time: 2.103127 Sep 24 20:56:50.167518 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1009/2009] 10.222.0.52 () {58 vars in 1263 bytes} [Sat Sep 24 20:56:48 2022] DELETE /compute/v2.1/os-floating-ips/db0db61b-89cb-4665-b810-814017f34f5d => generated 0 bytes in 2105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:56:50.175185 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-af08b850-aa8e-4844-900c-b859ba33e16f tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:50.175957 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-af08b850-aa8e-4844-900c-b859ba33e16f tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] [instance: 05c0e0fa-1c24-4072-9663-5c0752c685e0] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:50.185142 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b057d62d-8a7e-48c7-ace6-af800794c42e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:50.195687 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af08b850-aa8e-4844-900c-b859ba33e16f tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:50.196208 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af08b850-aa8e-4844-900c-b859ba33e16f tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:50.196663 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af08b850-aa8e-4844-900c-b859ba33e16f tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:50.200110 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af08b850-aa8e-4844-900c-b859ba33e16f tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:50.200663 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af08b850-aa8e-4844-900c-b859ba33e16f tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:50.201052 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b057d62d-8a7e-48c7-ace6-af800794c42e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:50.201231 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af08b850-aa8e-4844-900c-b859ba33e16f tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:50.202844 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b057d62d-8a7e-48c7-ace6-af800794c42e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:50.204431 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b057d62d-8a7e-48c7-ace6-af800794c42e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1812 microversion: 2.25 time: 0.394005 Sep 24 20:56:50.214528 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1001/2010] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:56:49 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1812 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:56:50.214528 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-d5dc50da-2c78-4345-b5e0-e058a1496374 req-312edb23-bb3c-4dde-8dc1-3ec143d6c677 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05c0e0fa-1c24-4072-9663-5c0752c685e0", "tag": "81d220f2-0310-473b-a74f-b729c26b0e34"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:50.242718 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d5dc50da-2c78-4345-b5e0-e058a1496374 req-312edb23-bb3c-4dde-8dc1-3ec143d6c677 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:50.243211 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d5dc50da-2c78-4345-b5e0-e058a1496374 req-312edb23-bb3c-4dde-8dc1-3ec143d6c677 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:50.243655 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d5dc50da-2c78-4345-b5e0-e058a1496374 req-312edb23-bb3c-4dde-8dc1-3ec143d6c677 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:50.289486 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-d5dc50da-2c78-4345-b5e0-e058a1496374 req-312edb23-bb3c-4dde-8dc1-3ec143d6c677 service nova] Creating event network-changed:81d220f2-0310-473b-a74f-b729c26b0e34 for instance 05c0e0fa-1c24-4072-9663-5c0752c685e0 on nch1-master-1 Sep 24 20:56:50.304431 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-d5dc50da-2c78-4345-b5e0-e058a1496374 req-312edb23-bb3c-4dde-8dc1-3ec143d6c677 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094995 Sep 24 20:56:50.306540 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1002/2011] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:56:50.314485 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-83d09bf8-9d06-4c8e-829b-8b38c5907818 tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] Calling method '.version_select at 0x7f4b11140ee0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:50.390379 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-83d09bf8-9d06-4c8e-829b-8b38c5907818 tempest-ImagesMetadataTestJSON-1750154046 tempest-ImagesMetadataTestJSON-1750154046-project] 10.222.0.52 "GET /compute/v2.1/images/0631c3f0-c8d8-4660-8f2e-5e74044bebe8/metadata" status: 200 len: 85 microversion: 2.1 time: 0.080991 Sep 24 20:56:50.391017 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1003/2012] 10.222.0.52 () {58 vars in 1260 bytes} [Sat Sep 24 20:56:50 2022] GET /compute/v2.1/images/0631c3f0-c8d8-4660-8f2e-5e74044bebe8/metadata => generated 85 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 20:56:50.401900 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-be3eba63-7875-44c8-adda-6fb70480766b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:50.409619 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-be3eba63-7875-44c8-adda-6fb70480766b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:50.420666 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-be3eba63-7875-44c8-adda-6fb70480766b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:50.427104 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-be3eba63-7875-44c8-adda-6fb70480766b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:50.427841 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-be3eba63-7875-44c8-adda-6fb70480766b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:50.428832 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-be3eba63-7875-44c8-adda-6fb70480766b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:50.429806 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-be3eba63-7875-44c8-adda-6fb70480766b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:50.430433 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-be3eba63-7875-44c8-adda-6fb70480766b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:50.476429 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-af08b850-aa8e-4844-900c-b859ba33e16f tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa253ded2304ac3917a1788b6a1500b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f6b606beca4eb5b62c89a945be15c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:50.490541 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-af08b850-aa8e-4844-900c-b859ba33e16f tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] 10.222.0.52 "GET /compute/v2.1/servers/05c0e0fa-1c24-4072-9663-5c0752c685e0" status: 200 len: 1574 microversion: 2.1 time: 0.321791 Sep 24 20:56:50.491588 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1010/2013] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:50 2022] GET /compute/v2.1/servers/05c0e0fa-1c24-4072-9663-5c0752c685e0 => generated 1574 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:50.497957 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-64e9fe1e-e637-446d-8f41-277a1f02a3a4 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:50.503927 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-64e9fe1e-e637-446d-8f41-277a1f02a3a4 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Request method failure captured: Sep 24 20:56:50.503927 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166/action HTTP/1.1 Sep 24 20:56:50.503927 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:56:50.503927 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:56:50.503927 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:56:50.503927 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 34 Sep 24 20:56:50.503927 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:56:50.503927 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:56:50.503927 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:56:50.503927 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:56:50.503927 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL27jOJkgxsOBw7lFZf-oGbOkVF-ZY4rL1xU369nq3wlqvBIm2lyvH6guUjEoNJZVvf9Jo_kvriGIXncTthwp30F7BiGraxMTkU0K4OMsYZVw-bPUX_noga7iTXvzd_onCx4a03_ghhw6BbwmvAFuWIqab3Yiqlq_4MHiIZ4w-N9JT3Y Sep 24 20:56:50.503927 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:56:50.503927 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:56:50.503927 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:56:50.503927 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:56:50.503927 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:56:50.503927 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:56:50.503927 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 8afe75ffdb814e0ba23546cf3866ceac Sep 24 20:56:50.503927 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 Sep 24 20:56:50.503927 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:56:50.503927 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:56:50.505598 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8afe75ffdb814e0ba23546cf3866ceac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8afe75ffdb814e0ba23546cf3866ceac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8afe75ffdb814e0ba23546cf3866ceac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8afe75ffdb814e0ba23546cf3866ceac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:56:50.505598 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 Sep 24 20:56:50.505598 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 8afe75ffdb814e0ba23546cf3866ceac Sep 24 20:56:50.505598 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 Sep 24 20:56:50.505598 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project Sep 24 20:56:50.505598 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:56:50.505598 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:56:50.505598 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 302ac6f497cf4d3c8c638f5b4b49f723 Sep 24 20:56:50.505598 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project Sep 24 20:56:50.505598 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 20:56:50.505598 ncdv-master-1 devstack@n-api.service[140517]: {"addFloatingIp": {"address": ""}} Sep 24 20:56:50.505598 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 20:56:50.505598 ncdv-master-1 devstack@n-api.service[140517]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 24 20:56:50.507090 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '834ff250-11c3-4391-aae5-7f3e6fa33166', 'body': {'addFloatingIp': {'address': ''}}} Sep 24 20:56:50.507090 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:56:50.507090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:50.507090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 20:56:50.507090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 20:56:50.507090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 20:56:50.507090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise error Sep 24 20:56:50.507090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Sep 24 20:56:50.507090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:50.507090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Sep 24 20:56:50.507090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Sep 24 20:56:50.507090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:50.507090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Sep 24 20:56:50.507090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi '' Sep 24 20:56:50.507090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:50.507090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:50.507090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:50.507090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:50.507090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:50.507090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:50.507090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:56:50.507090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:56:50.509765 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:56:50.509765 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:56:50.509765 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:56:50.509765 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:56:50.509765 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 20:56:50.509765 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 20:56:50.509765 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 20:56:50.509765 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 20:56:50.509765 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 20:56:50.509765 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 20:56:50.509765 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 24 20:56:50.509765 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:50.509765 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:50.509765 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:50.509765 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:50.509765 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:50.509765 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:50.509765 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 20:56:50.509765 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 20:56:50.512751 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 24 20:56:50.512751 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:50.519939 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-64e9fe1e-e637-446d-8f41-277a1f02a3a4 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:56:50.521367 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-64e9fe1e-e637-446d-8f41-277a1f02a3a4 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] 10.222.0.52 "POST /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166/action" status: 400 len: 142 microversion: 2.1 time: 0.028064 Sep 24 20:56:50.522606 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1011/2014] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:56:50 2022] POST /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166/action => generated 142 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 20:56:50.533342 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2027ecc7-d25c-428e-96ae-be102af4ffdc tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:50.539153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2027ecc7-d25c-428e-96ae-be102af4ffdc tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] [instance: dd9d2c1a-53a4-4426-b01f-c286b39e7309] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:50.557284 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2027ecc7-d25c-428e-96ae-be102af4ffdc tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:50.558229 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2027ecc7-d25c-428e-96ae-be102af4ffdc tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:50.559906 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2027ecc7-d25c-428e-96ae-be102af4ffdc tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:50.563425 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2027ecc7-d25c-428e-96ae-be102af4ffdc tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:50.584884 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2027ecc7-d25c-428e-96ae-be102af4ffdc tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:50.585846 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2027ecc7-d25c-428e-96ae-be102af4ffdc tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:50.665497 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-be3eba63-7875-44c8-adda-6fb70480766b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:50.679612 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-be3eba63-7875-44c8-adda-6fb70480766b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1183 microversion: 2.1 time: 0.287135 Sep 24 20:56:50.696389 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1004/2015] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:50 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1183 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:50.712710 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8178625c-5ecb-452e-89f4-2f056418882c tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:50.724296 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8178625c-5ecb-452e-89f4-2f056418882c tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] [instance: 834ff250-11c3-4391-aae5-7f3e6fa33166] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:50.726055 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2027ecc7-d25c-428e-96ae-be102af4ffdc tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd09a0889c44ce18f0c361c7c661465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749824e2c16946a58801200784fa0480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:50.737628 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2027ecc7-d25c-428e-96ae-be102af4ffdc tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9d2c1a-53a4-4426-b01f-c286b39e7309" status: 200 len: 1283 microversion: 2.1 time: 0.212753 Sep 24 20:56:50.738960 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1012/2016] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:50 2022] GET /compute/v2.1/servers/dd9d2c1a-53a4-4426-b01f-c286b39e7309 => generated 1283 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:50.744177 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8178625c-5ecb-452e-89f4-2f056418882c tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:50.744676 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8178625c-5ecb-452e-89f4-2f056418882c tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:50.745310 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8178625c-5ecb-452e-89f4-2f056418882c tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:50.746682 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8178625c-5ecb-452e-89f4-2f056418882c tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:50.748396 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8178625c-5ecb-452e-89f4-2f056418882c tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:50.749833 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8178625c-5ecb-452e-89f4-2f056418882c tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:50.807000 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8178625c-5ecb-452e-89f4-2f056418882c tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquiring lock "refresh_cache-834ff250-11c3-4391-aae5-7f3e6fa33166" {{(pid=140516) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 24 20:56:50.807633 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8178625c-5ecb-452e-89f4-2f056418882c tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquired lock "refresh_cache-834ff250-11c3-4391-aae5-7f3e6fa33166" {{(pid=140516) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 24 20:56:50.941435 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8178625c-5ecb-452e-89f4-2f056418882c tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Releasing lock "refresh_cache-834ff250-11c3-4391-aae5-7f3e6fa33166" {{(pid=140516) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 24 20:56:50.942128 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-8178625c-5ecb-452e-89f4-2f056418882c tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] HTTP exception thrown: floating IP not found Sep 24 20:56:50.943922 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8178625c-5ecb-452e-89f4-2f056418882c tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Request method failure captured: Sep 24 20:56:50.943922 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166/action HTTP/1.1 Sep 24 20:56:50.943922 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:56:50.943922 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:56:50.943922 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:56:50.943922 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 41 Sep 24 20:56:50.943922 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:56:50.943922 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:56:50.943922 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:56:50.943922 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:56:50.943922 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL27jOJkgxsOBw7lFZf-oGbOkVF-ZY4rL1xU369nq3wlqvBIm2lyvH6guUjEoNJZVvf9Jo_kvriGIXncTthwp30F7BiGraxMTkU0K4OMsYZVw-bPUX_noga7iTXvzd_onCx4a03_ghhw6BbwmvAFuWIqab3Yiqlq_4MHiIZ4w-N9JT3Y Sep 24 20:56:50.943922 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:56:50.943922 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:56:50.943922 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:56:50.943922 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:56:50.943922 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:56:50.943922 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:56:50.943922 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 8afe75ffdb814e0ba23546cf3866ceac Sep 24 20:56:50.943922 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 Sep 24 20:56:50.943922 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:56:50.943922 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:56:50.945687 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8afe75ffdb814e0ba23546cf3866ceac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8afe75ffdb814e0ba23546cf3866ceac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8afe75ffdb814e0ba23546cf3866ceac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8afe75ffdb814e0ba23546cf3866ceac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:56:50.945687 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 Sep 24 20:56:50.945687 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 8afe75ffdb814e0ba23546cf3866ceac Sep 24 20:56:50.945687 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 Sep 24 20:56:50.945687 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project Sep 24 20:56:50.945687 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:56:50.945687 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:56:50.945687 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 302ac6f497cf4d3c8c638f5b4b49f723 Sep 24 20:56:50.945687 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project Sep 24 20:56:50.945687 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 20:56:50.945687 ncdv-master-1 devstack@n-api.service[140516]: {"addFloatingIp": {"address": "0.0.0.0"}} Sep 24 20:56:50.945687 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:56:50.945687 ncdv-master-1 devstack@n-api.service[140516]: exception: floating IP not found Sep 24 20:56:50.946702 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '834ff250-11c3-4391-aae5-7f3e6fa33166', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Sep 24 20:56:50.946702 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:56:50.946702 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:50.946702 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 24 20:56:50.946702 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 24 20:56:50.946702 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 24 20:56:50.946702 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 24 20:56:50.946702 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Sep 24 20:56:50.946702 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Sep 24 20:56:50.946702 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 24 20:56:50.946702 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 24 20:56:50.946702 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 24 20:56:50.946702 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:50.946702 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:50.946702 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:50.946702 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:50.946702 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:50.946702 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:50.946702 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:56:50.948045 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:56:50.948045 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:56:50.948045 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:56:50.948045 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:56:50.948045 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:56:50.948045 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:56:50.948045 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:56:50.948045 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Sep 24 20:56:50.948045 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 24 20:56:50.948045 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Sep 24 20:56:50.948045 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:50.948045 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:50.948045 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:50.948045 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:50.948045 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:50.948045 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:50.948045 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:56:50.948045 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:56:50.948045 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Sep 24 20:56:50.948045 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:50.949464 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8178625c-5ecb-452e-89f4-2f056418882c tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Returning 404 to user: floating IP not found {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:56:50.949464 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8178625c-5ecb-452e-89f4-2f056418882c tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] 10.222.0.52 "POST /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166/action" status: 404 len: 67 microversion: 2.1 time: 0.243072 Sep 24 20:56:50.949464 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1005/2017] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:56:50 2022] POST /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166/action => generated 67 bytes in 249 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 20:56:50.957142 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b3a40089-b3e3-4cbf-9d95-c4682a6d38ee tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:51.032418 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-b3a40089-b3e3-4cbf-9d95-c4682a6d38ee tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Sep 24 20:56:51.036508 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b3a40089-b3e3-4cbf-9d95-c4682a6d38ee tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Request method failure captured: Sep 24 20:56:51.036508 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166/action HTTP/1.1 Sep 24 20:56:51.036508 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:56:51.036508 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:56:51.036508 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:56:51.036508 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 44 Sep 24 20:56:51.036508 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:56:51.036508 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:56:51.036508 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:56:51.036508 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:56:51.036508 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL27jOJkgxsOBw7lFZf-oGbOkVF-ZY4rL1xU369nq3wlqvBIm2lyvH6guUjEoNJZVvf9Jo_kvriGIXncTthwp30F7BiGraxMTkU0K4OMsYZVw-bPUX_noga7iTXvzd_onCx4a03_ghhw6BbwmvAFuWIqab3Yiqlq_4MHiIZ4w-N9JT3Y Sep 24 20:56:51.036508 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:56:51.036508 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:56:51.036508 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:56:51.036508 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:56:51.036508 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:56:51.036508 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:56:51.036508 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 8afe75ffdb814e0ba23546cf3866ceac Sep 24 20:56:51.036508 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 Sep 24 20:56:51.036508 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:56:51.036508 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:56:51.038221 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8afe75ffdb814e0ba23546cf3866ceac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8afe75ffdb814e0ba23546cf3866ceac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8afe75ffdb814e0ba23546cf3866ceac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8afe75ffdb814e0ba23546cf3866ceac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:56:51.038221 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 Sep 24 20:56:51.038221 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 8afe75ffdb814e0ba23546cf3866ceac Sep 24 20:56:51.038221 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 Sep 24 20:56:51.038221 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project Sep 24 20:56:51.038221 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:56:51.038221 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:56:51.038221 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 302ac6f497cf4d3c8c638f5b4b49f723 Sep 24 20:56:51.038221 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project Sep 24 20:56:51.038221 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 20:56:51.038221 ncdv-master-1 devstack@n-api.service[140517]: {"removeFloatingIp": {"address": "0.0.0.0"}} Sep 24 20:56:51.038221 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 20:56:51.038221 ncdv-master-1 devstack@n-api.service[140517]: exception: Floating IP not found for address 0.0.0.0. Sep 24 20:56:51.039196 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '834ff250-11c3-4391-aae5-7f3e6fa33166', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Sep 24 20:56:51.039196 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:56:51.039196 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:51.039196 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Sep 24 20:56:51.039196 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Sep 24 20:56:51.039196 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Sep 24 20:56:51.039196 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Sep 24 20:56:51.039196 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 24 20:56:51.039196 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 24 20:56:51.039196 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 24 20:56:51.039196 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:51.039196 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:51.039196 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:51.039196 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:51.039196 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:51.039196 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:51.039196 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:56:51.039196 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:56:51.039196 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:56:51.042227 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:56:51.042227 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:56:51.042227 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:56:51.042227 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:56:51.042227 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:56:51.042227 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Sep 24 20:56:51.042227 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Sep 24 20:56:51.042227 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Sep 24 20:56:51.042227 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Sep 24 20:56:51.042227 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Sep 24 20:56:51.042227 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:51.042227 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:51.042227 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:51.042227 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:51.042227 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:51.042227 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:51.042227 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:56:51.042227 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:56:51.042227 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Sep 24 20:56:51.042227 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:51.045048 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b3a40089-b3e3-4cbf-9d95-c4682a6d38ee tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:56:51.045048 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b3a40089-b3e3-4cbf-9d95-c4682a6d38ee tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] 10.222.0.52 "POST /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166/action" status: 404 len: 88 microversion: 2.1 time: 0.086164 Sep 24 20:56:51.045048 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1013/2018] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:56:50 2022] POST /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166/action => generated 88 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 20:56:51.050811 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8983630c-5300-4cec-83b5-d3102c16bc00 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:51.056189 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8983630c-5300-4cec-83b5-d3102c16bc00 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] [instance: 834ff250-11c3-4391-aae5-7f3e6fa33166] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:51.064159 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8983630c-5300-4cec-83b5-d3102c16bc00 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:51.064652 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8983630c-5300-4cec-83b5-d3102c16bc00 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:51.065313 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8983630c-5300-4cec-83b5-d3102c16bc00 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:51.066285 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8983630c-5300-4cec-83b5-d3102c16bc00 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:51.066776 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8983630c-5300-4cec-83b5-d3102c16bc00 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:51.067221 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8983630c-5300-4cec-83b5-d3102c16bc00 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:51.113349 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8983630c-5300-4cec-83b5-d3102c16bc00 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] [instance: 834ff250-11c3-4391-aae5-7f3e6fa33166] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:56:51.234897 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-99a54226-ece9-4901-87dd-455c18a72796 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:51.236089 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-99a54226-ece9-4901-87dd-455c18a72796 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:51.254060 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8983630c-5300-4cec-83b5-d3102c16bc00 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] 10.222.0.52 "DELETE /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166" status: 204 len: 0 microversion: 2.1 time: 0.206258 Sep 24 20:56:51.254665 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-99a54226-ece9-4901-87dd-455c18a72796 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:51.255623 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-99a54226-ece9-4901-87dd-455c18a72796 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:51.256252 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1006/2019] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:56:51 2022] DELETE /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:56:51.257249 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-99a54226-ece9-4901-87dd-455c18a72796 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:51.258601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-99a54226-ece9-4901-87dd-455c18a72796 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:51.260766 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-99a54226-ece9-4901-87dd-455c18a72796 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:51.262274 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-99a54226-ece9-4901-87dd-455c18a72796 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:51.278345 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-67f85fc0-0845-4ab5-a641-bcf1e0c994bd tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:51.280057 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-67f85fc0-0845-4ab5-a641-bcf1e0c994bd tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] [instance: 834ff250-11c3-4391-aae5-7f3e6fa33166] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:51.293467 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67f85fc0-0845-4ab5-a641-bcf1e0c994bd tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:51.294992 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67f85fc0-0845-4ab5-a641-bcf1e0c994bd tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:51.295956 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67f85fc0-0845-4ab5-a641-bcf1e0c994bd tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:51.297094 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67f85fc0-0845-4ab5-a641-bcf1e0c994bd tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:51.297784 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67f85fc0-0845-4ab5-a641-bcf1e0c994bd tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:51.298516 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67f85fc0-0845-4ab5-a641-bcf1e0c994bd tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:51.600551 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=8 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:56:51.617842 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-99a54226-ece9-4901-87dd-455c18a72796 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:51.634622 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-99a54226-ece9-4901-87dd-455c18a72796 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:51.642534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-99a54226-ece9-4901-87dd-455c18a72796 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:51.649227 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-99a54226-ece9-4901-87dd-455c18a72796 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1812 microversion: 2.25 time: 0.418578 Sep 24 20:56:51.650595 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1014/2020] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:56:51 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1812 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:56:51.662915 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-67f85fc0-0845-4ab5-a641-bcf1e0c994bd tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302ac6f497cf4d3c8c638f5b4b49f723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afe75ffdb814e0ba23546cf3866ceac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:51.679976 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-67f85fc0-0845-4ab5-a641-bcf1e0c994bd tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] 10.222.0.52 "GET /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166" status: 200 len: 1543 microversion: 2.1 time: 0.419098 Sep 24 20:56:51.682535 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1007/2021] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:51 2022] GET /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166 => generated 1543 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:51.715770 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2d3b925a-be4a-419a-96b9-345fa4ce9c74 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:51.716410 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2d3b925a-be4a-419a-96b9-345fa4ce9c74 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:51.725310 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d3b925a-be4a-419a-96b9-345fa4ce9c74 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:51.725822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d3b925a-be4a-419a-96b9-345fa4ce9c74 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:51.726274 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d3b925a-be4a-419a-96b9-345fa4ce9c74 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:51.727190 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d3b925a-be4a-419a-96b9-345fa4ce9c74 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:51.727797 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d3b925a-be4a-419a-96b9-345fa4ce9c74 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:51.727999 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d3b925a-be4a-419a-96b9-345fa4ce9c74 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:51.763021 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7968a4c5-99aa-4aba-92df-73ec1b3eca17 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:51.765365 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7968a4c5-99aa-4aba-92df-73ec1b3eca17 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] [instance: dd9d2c1a-53a4-4426-b01f-c286b39e7309] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:51.786708 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7968a4c5-99aa-4aba-92df-73ec1b3eca17 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:51.791372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7968a4c5-99aa-4aba-92df-73ec1b3eca17 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:51.795511 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7968a4c5-99aa-4aba-92df-73ec1b3eca17 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:51.795954 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7968a4c5-99aa-4aba-92df-73ec1b3eca17 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:51.798899 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7968a4c5-99aa-4aba-92df-73ec1b3eca17 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:51.800148 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7968a4c5-99aa-4aba-92df-73ec1b3eca17 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:51.840615 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:56:51.972205 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2d3b925a-be4a-419a-96b9-345fa4ce9c74 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:51.989600 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7968a4c5-99aa-4aba-92df-73ec1b3eca17 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd09a0889c44ce18f0c361c7c661465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749824e2c16946a58801200784fa0480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:51.994368 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2d3b925a-be4a-419a-96b9-345fa4ce9c74 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1183 microversion: 2.1 time: 0.286528 Sep 24 20:56:51.995635 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1015/2022] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:51 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1183 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:52.016134 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7968a4c5-99aa-4aba-92df-73ec1b3eca17 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9d2c1a-53a4-4426-b01f-c286b39e7309" status: 200 len: 1271 microversion: 2.1 time: 0.257907 Sep 24 20:56:52.017109 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1008/2023] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:51 2022] GET /compute/v2.1/servers/dd9d2c1a-53a4-4426-b01f-c286b39e7309 => generated 1271 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:56:52.679194 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bee5ce09-9005-4e61-8f0a-607ad9b4d545 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:52.680469 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bee5ce09-9005-4e61-8f0a-607ad9b4d545 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:52.690400 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bee5ce09-9005-4e61-8f0a-607ad9b4d545 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:52.691441 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bee5ce09-9005-4e61-8f0a-607ad9b4d545 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:52.692248 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bee5ce09-9005-4e61-8f0a-607ad9b4d545 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:52.693499 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bee5ce09-9005-4e61-8f0a-607ad9b4d545 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:52.694246 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bee5ce09-9005-4e61-8f0a-607ad9b4d545 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:52.695099 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bee5ce09-9005-4e61-8f0a-607ad9b4d545 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:52.706719 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-17038089-73f4-4a77-be1c-ab9870f4e055 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:52.709002 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-17038089-73f4-4a77-be1c-ab9870f4e055 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] [instance: 834ff250-11c3-4391-aae5-7f3e6fa33166] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:52.726440 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17038089-73f4-4a77-be1c-ab9870f4e055 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:52.730093 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17038089-73f4-4a77-be1c-ab9870f4e055 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:52.731053 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17038089-73f4-4a77-be1c-ab9870f4e055 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:52.732242 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17038089-73f4-4a77-be1c-ab9870f4e055 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:52.736176 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17038089-73f4-4a77-be1c-ab9870f4e055 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:52.736632 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17038089-73f4-4a77-be1c-ab9870f4e055 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:53.126908 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bee5ce09-9005-4e61-8f0a-607ad9b4d545 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:53.138522 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bee5ce09-9005-4e61-8f0a-607ad9b4d545 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:53.141225 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bee5ce09-9005-4e61-8f0a-607ad9b4d545 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:53.143539 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bee5ce09-9005-4e61-8f0a-607ad9b4d545 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1812 microversion: 2.25 time: 0.470364 Sep 24 20:56:53.155071 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1016/2024] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:56:52 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1812 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:56:53.171075 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1b1cb544-0a41-492a-9bda-3ccbd2119b0c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:53.172015 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1b1cb544-0a41-492a-9bda-3ccbd2119b0c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:53.180723 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1b1cb544-0a41-492a-9bda-3ccbd2119b0c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:53.181455 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1b1cb544-0a41-492a-9bda-3ccbd2119b0c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:53.182757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1b1cb544-0a41-492a-9bda-3ccbd2119b0c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:53.183726 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1b1cb544-0a41-492a-9bda-3ccbd2119b0c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:53.184363 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1b1cb544-0a41-492a-9bda-3ccbd2119b0c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:53.185013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1b1cb544-0a41-492a-9bda-3ccbd2119b0c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:53.197775 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-17038089-73f4-4a77-be1c-ab9870f4e055 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302ac6f497cf4d3c8c638f5b4b49f723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afe75ffdb814e0ba23546cf3866ceac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:53.216063 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-17038089-73f4-4a77-be1c-ab9870f4e055 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] 10.222.0.52 "GET /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166" status: 200 len: 1543 microversion: 2.1 time: 0.515050 Sep 24 20:56:53.217033 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1009/2025] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:52 2022] GET /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166 => generated 1543 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:56:53.222810 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-69e9084c-7c17-434a-96ec-b7794cb30bf3 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:53.227431 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-69e9084c-7c17-434a-96ec-b7794cb30bf3 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] [instance: dd9d2c1a-53a4-4426-b01f-c286b39e7309] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:53.242256 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-69e9084c-7c17-434a-96ec-b7794cb30bf3 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:53.256282 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-69e9084c-7c17-434a-96ec-b7794cb30bf3 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:53.259347 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-69e9084c-7c17-434a-96ec-b7794cb30bf3 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:53.259886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-69e9084c-7c17-434a-96ec-b7794cb30bf3 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:53.260451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-69e9084c-7c17-434a-96ec-b7794cb30bf3 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:53.260864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-69e9084c-7c17-434a-96ec-b7794cb30bf3 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:53.336590 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1b1cb544-0a41-492a-9bda-3ccbd2119b0c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:53.349386 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1b1cb544-0a41-492a-9bda-3ccbd2119b0c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1183 microversion: 2.1 time: 0.190068 Sep 24 20:56:53.368540 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1017/2026] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:53 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:53.670417 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-69e9084c-7c17-434a-96ec-b7794cb30bf3 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd09a0889c44ce18f0c361c7c661465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749824e2c16946a58801200784fa0480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:53.685495 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-69e9084c-7c17-434a-96ec-b7794cb30bf3 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9d2c1a-53a4-4426-b01f-c286b39e7309" status: 200 len: 1313 microversion: 2.1 time: 0.467130 Sep 24 20:56:53.686654 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1010/2027] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:53 2022] GET /compute/v2.1/servers/dd9d2c1a-53a4-4426-b01f-c286b39e7309 => generated 1313 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:53.834379 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-6ccdabff-43b6-46e8-b8d3-49dee3a6dc8d req-0571197b-fbd5-48c8-8b19-3df3be7bdb51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "834ff250-11c3-4391-aae5-7f3e6fa33166", "name": "network-vif-deleted", "tag": "9d899e46-f44e-4bfc-b166-96ac7ad71d19"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:53.867839 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6ccdabff-43b6-46e8-b8d3-49dee3a6dc8d req-0571197b-fbd5-48c8-8b19-3df3be7bdb51 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:53.871097 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6ccdabff-43b6-46e8-b8d3-49dee3a6dc8d req-0571197b-fbd5-48c8-8b19-3df3be7bdb51 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:53.872690 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6ccdabff-43b6-46e8-b8d3-49dee3a6dc8d req-0571197b-fbd5-48c8-8b19-3df3be7bdb51 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:53.902112 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-6ccdabff-43b6-46e8-b8d3-49dee3a6dc8d req-0571197b-fbd5-48c8-8b19-3df3be7bdb51 service nova] Creating event network-vif-deleted:9d899e46-f44e-4bfc-b166-96ac7ad71d19 for instance 834ff250-11c3-4391-aae5-7f3e6fa33166 on nch2-master-1 Sep 24 20:56:53.921392 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-6ccdabff-43b6-46e8-b8d3-49dee3a6dc8d req-0571197b-fbd5-48c8-8b19-3df3be7bdb51 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092247 Sep 24 20:56:53.922133 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1018/2028] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:56:54.175581 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8bb69580-f612-4f6b-9de1-a3bc52407c7a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:54.179265 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8bb69580-f612-4f6b-9de1-a3bc52407c7a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:54.199198 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8bb69580-f612-4f6b-9de1-a3bc52407c7a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:54.199612 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8bb69580-f612-4f6b-9de1-a3bc52407c7a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:54.202340 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8bb69580-f612-4f6b-9de1-a3bc52407c7a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:54.217823 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8bb69580-f612-4f6b-9de1-a3bc52407c7a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:54.218756 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8bb69580-f612-4f6b-9de1-a3bc52407c7a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:54.219375 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8bb69580-f612-4f6b-9de1-a3bc52407c7a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:54.245086 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8161b51e-dca1-43e2-9104-f6e0fda65d55 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:54.246068 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8161b51e-dca1-43e2-9104-f6e0fda65d55 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] [instance: 834ff250-11c3-4391-aae5-7f3e6fa33166] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:54.283879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8161b51e-dca1-43e2-9104-f6e0fda65d55 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:54.284704 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8161b51e-dca1-43e2-9104-f6e0fda65d55 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:54.286716 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8161b51e-dca1-43e2-9104-f6e0fda65d55 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:54.287769 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8161b51e-dca1-43e2-9104-f6e0fda65d55 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:54.289893 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8161b51e-dca1-43e2-9104-f6e0fda65d55 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:54.295339 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8161b51e-dca1-43e2-9104-f6e0fda65d55 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:54.454341 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8161b51e-dca1-43e2-9104-f6e0fda65d55 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:54.455089 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8161b51e-dca1-43e2-9104-f6e0fda65d55 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:54.456235 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8161b51e-dca1-43e2-9104-f6e0fda65d55 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:54.460455 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-8161b51e-dca1-43e2-9104-f6e0fda65d55 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lazy-loading 'fault' on Instance uuid 834ff250-11c3-4391-aae5-7f3e6fa33166 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:56:54.701245 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8bb69580-f612-4f6b-9de1-a3bc52407c7a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:54.703653 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8161b51e-dca1-43e2-9104-f6e0fda65d55 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302ac6f497cf4d3c8c638f5b4b49f723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afe75ffdb814e0ba23546cf3866ceac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:54.715966 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8bb69580-f612-4f6b-9de1-a3bc52407c7a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:54.717478 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8bb69580-f612-4f6b-9de1-a3bc52407c7a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:54.718745 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8bb69580-f612-4f6b-9de1-a3bc52407c7a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1812 microversion: 2.25 time: 0.547071 Sep 24 20:56:54.719331 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1011/2029] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:56:54 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1812 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:56:54.725879 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2c6930df-2c66-40bd-a49d-e335297cfb27 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:54.726593 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2c6930df-2c66-40bd-a49d-e335297cfb27 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:54.733166 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8161b51e-dca1-43e2-9104-f6e0fda65d55 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] 10.222.0.52 "GET /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166" status: 200 len: 1322 microversion: 2.1 time: 0.478909 Sep 24 20:56:54.736443 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c6930df-2c66-40bd-a49d-e335297cfb27 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:54.737655 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c6930df-2c66-40bd-a49d-e335297cfb27 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:54.738246 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c6930df-2c66-40bd-a49d-e335297cfb27 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:54.738914 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c6930df-2c66-40bd-a49d-e335297cfb27 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:54.739588 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c6930df-2c66-40bd-a49d-e335297cfb27 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:54.740317 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c6930df-2c66-40bd-a49d-e335297cfb27 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:54.742871 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1019/2030] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:54 2022] GET /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166 => generated 1322 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:56:54.764267 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4a149441-948c-4940-894d-681c7485f38c tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:54.765616 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4a149441-948c-4940-894d-681c7485f38c tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] [instance: dd9d2c1a-53a4-4426-b01f-c286b39e7309] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:54.773318 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4a149441-948c-4940-894d-681c7485f38c tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:54.774426 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4a149441-948c-4940-894d-681c7485f38c tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:54.775487 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4a149441-948c-4940-894d-681c7485f38c tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:54.776785 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4a149441-948c-4940-894d-681c7485f38c tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:54.777480 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4a149441-948c-4940-894d-681c7485f38c tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:54.778553 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4a149441-948c-4940-894d-681c7485f38c tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:54.932526 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2c6930df-2c66-40bd-a49d-e335297cfb27 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:54.951907 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2c6930df-2c66-40bd-a49d-e335297cfb27 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1183 microversion: 2.1 time: 0.231404 Sep 24 20:56:54.953466 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1012/2031] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:54 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1183 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:55.122952 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4a149441-948c-4940-894d-681c7485f38c tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd09a0889c44ce18f0c361c7c661465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749824e2c16946a58801200784fa0480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:55.132131 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4a149441-948c-4940-894d-681c7485f38c tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9d2c1a-53a4-4426-b01f-c286b39e7309" status: 200 len: 1313 microversion: 2.1 time: 0.387757 Sep 24 20:56:55.179731 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1020/2032] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:54 2022] GET /compute/v2.1/servers/dd9d2c1a-53a4-4426-b01f-c286b39e7309 => generated 1313 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:55.305369 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5d6884bb-64ec-4e0d-9800-ccfce725919a tempest-ListImageFiltersNegativeTestJSON-243372341 tempest-ListImageFiltersNegativeTestJSON-243372341-project] Calling method '.version_select at 0x7f4b1117bca0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:55.347036 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-5d6884bb-64ec-4e0d-9800-ccfce725919a tempest-ListImageFiltersNegativeTestJSON-243372341 tempest-ListImageFiltersNegativeTestJSON-243372341-project] HTTP exception thrown: Image not found. Sep 24 20:56:55.349371 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5d6884bb-64ec-4e0d-9800-ccfce725919a tempest-ListImageFiltersNegativeTestJSON-243372341 tempest-ListImageFiltersNegativeTestJSON-243372341-project] Request method failure captured: Sep 24 20:56:55.349371 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/images/30a583cf-a515-40ea-ba44-a3b5bfa55a99 HTTP/1.1 Sep 24 20:56:55.349371 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:56:55.349371 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:56:55.349371 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:56:55.349371 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:56:55.349371 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:56:55.349371 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:56:55.349371 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:56:55.349371 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:56:55.349371 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL28Whk1PxdeqNziF3UrS6QEaslO7NdghmHHveISchD1ZCiVxZvfMG080uJ993q74-muG_2v24Q3bcyExC1OC63udbiAJzdE83PlFljSs8EmAMGpOMxo8fcvP-sMWA8ghBbMGDIq7Bi-Nhz5-Do68vwpjJJChp0uBaZH6viVwZMmtuno Sep 24 20:56:55.349371 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:56:55.349371 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:56:55.349371 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:56:55.349371 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:56:55.349371 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:56:55.349371 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:56:55.349371 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 13b6517666a849e2811e98f9b0cd764a Sep 24 20:56:55.349371 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-243372341 Sep 24 20:56:55.349371 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:56:55.349371 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:56:55.351151 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/13b6517666a849e2811e98f9b0cd764a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_13b6517666a849e2811e98f9b0cd764a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/13b6517666a849e2811e98f9b0cd764a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/13b6517666a849e2811e98f9b0cd764a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:56:55.351151 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-243372341 Sep 24 20:56:55.351151 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 13b6517666a849e2811e98f9b0cd764a Sep 24 20:56:55.351151 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-243372341 Sep 24 20:56:55.351151 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ListImageFiltersNegativeTestJSON-243372341-project Sep 24 20:56:55.351151 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:56:55.351151 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:56:55.351151 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: cbd3b7d6a7744bfd9a9b2d3f804a9f0b Sep 24 20:56:55.351151 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-243372341-project Sep 24 20:56:55.351151 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:56:55.351151 ncdv-master-1 devstack@n-api.service[140516]: exception: Image not found. Sep 24 20:56:55.351151 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '30a583cf-a515-40ea-ba44-a3b5bfa55a99'} Sep 24 20:56:55.351151 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:56:55.352198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:55.352198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 24 20:56:55.352198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 24 20:56:55.352198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 24 20:56:55.352198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 24 20:56:55.352198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 24 20:56:55.352198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 24 20:56:55.352198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 24 20:56:55.352198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 24 20:56:55.352198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 24 20:56:55.352198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 24 20:56:55.352198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 24 20:56:55.352198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 24 20:56:55.352198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 24 20:56:55.352198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 24 20:56:55.352198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 24 20:56:55.352198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 24 20:56:55.352198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 30a583cf-a515-40ea-ba44-a3b5bfa55a99 Sep 24 20:56:55.353742 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:55.353742 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:55.353742 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:55.353742 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:55.353742 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 24 20:56:55.353742 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 24 20:56:55.353742 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 24 20:56:55.353742 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 24 20:56:55.353742 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 24 20:56:55.353742 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 24 20:56:55.353742 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 24 20:56:55.353742 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 24 20:56:55.353742 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 24 20:56:55.353742 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 24 20:56:55.353742 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 24 20:56:55.353742 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 24 20:56:55.353742 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 24 20:56:55.353742 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 24 20:56:55.353742 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 24 20:56:55.353742 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 24 20:56:55.355951 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 24 20:56:55.355951 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 24 20:56:55.355951 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 24 20:56:55.355951 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 24 20:56:55.355951 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 24 20:56:55.355951 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 24 20:56:55.355951 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 24 20:56:55.355951 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 24 20:56:55.355951 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 30a583cf-a515-40ea-ba44-a3b5bfa55a99 could not be found. Sep 24 20:56:55.355951 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:55.355951 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:55.355951 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:55.355951 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:55.355951 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:55.355951 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:55.355951 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:56:55.355951 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:56:55.355951 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:56:55.355951 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:56:55.357394 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:56:55.357394 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:56:55.357394 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 24 20:56:55.357394 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 24 20:56:55.357394 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 24 20:56:55.357394 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:55.357394 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:55.357394 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:55.357394 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:55.357394 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:55.357394 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:55.357394 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:56:55.357394 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:56:55.357394 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 24 20:56:55.357394 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:55.357394 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5d6884bb-64ec-4e0d-9800-ccfce725919a tempest-ListImageFiltersNegativeTestJSON-243372341 tempest-ListImageFiltersNegativeTestJSON-243372341-project] Returning 404 to user: Image not found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:56:55.359783 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5d6884bb-64ec-4e0d-9800-ccfce725919a tempest-ListImageFiltersNegativeTestJSON-243372341 tempest-ListImageFiltersNegativeTestJSON-243372341-project] 10.222.0.52 "GET /compute/v2.1/images/30a583cf-a515-40ea-ba44-a3b5bfa55a99" status: 404 len: 62 microversion: 2.1 time: 0.395958 Sep 24 20:56:55.359783 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1013/2033] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:56:54 2022] GET /compute/v2.1/images/30a583cf-a515-40ea-ba44-a3b5bfa55a99 => generated 62 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 20:56:55.753299 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4dd828f1-95e1-41d7-9292-fd60d853c3da tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:55.754111 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4dd828f1-95e1-41d7-9292-fd60d853c3da tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:55.772913 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ff13f3c2-5276-4bd7-9107-c0bfd923986e tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:55.773782 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ff13f3c2-5276-4bd7-9107-c0bfd923986e tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] [instance: 834ff250-11c3-4391-aae5-7f3e6fa33166] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:55.774032 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4dd828f1-95e1-41d7-9292-fd60d853c3da tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:55.774597 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4dd828f1-95e1-41d7-9292-fd60d853c3da tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:55.775059 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4dd828f1-95e1-41d7-9292-fd60d853c3da tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:55.776689 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4dd828f1-95e1-41d7-9292-fd60d853c3da tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:55.778475 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4dd828f1-95e1-41d7-9292-fd60d853c3da tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:55.779447 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4dd828f1-95e1-41d7-9292-fd60d853c3da tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:55.793016 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff13f3c2-5276-4bd7-9107-c0bfd923986e tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:55.793637 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff13f3c2-5276-4bd7-9107-c0bfd923986e tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:55.796524 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff13f3c2-5276-4bd7-9107-c0bfd923986e tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:55.797378 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff13f3c2-5276-4bd7-9107-c0bfd923986e tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:55.798051 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff13f3c2-5276-4bd7-9107-c0bfd923986e tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:55.798599 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff13f3c2-5276-4bd7-9107-c0bfd923986e tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:55.829948 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-ff13f3c2-5276-4bd7-9107-c0bfd923986e tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] HTTP exception thrown: Instance 834ff250-11c3-4391-aae5-7f3e6fa33166 could not be found. Sep 24 20:56:55.837735 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:56:55.838457 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ff13f3c2-5276-4bd7-9107-c0bfd923986e tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Request method failure captured: Sep 24 20:56:55.838457 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166 HTTP/1.1 Sep 24 20:56:55.838457 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:56:55.838457 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:56:55.838457 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:56:55.838457 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:56:55.838457 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:56:55.838457 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:56:55.838457 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:56:55.838457 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:56:55.838457 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL27jOJkgxsOBw7lFZf-oGbOkVF-ZY4rL1xU369nq3wlqvBIm2lyvH6guUjEoNJZVvf9Jo_kvriGIXncTthwp30F7BiGraxMTkU0K4OMsYZVw-bPUX_noga7iTXvzd_onCx4a03_ghhw6BbwmvAFuWIqab3Yiqlq_4MHiIZ4w-N9JT3Y Sep 24 20:56:55.838457 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:56:55.838457 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:56:55.838457 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:56:55.838457 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:56:55.838457 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:56:55.838457 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:56:55.838457 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 8afe75ffdb814e0ba23546cf3866ceac Sep 24 20:56:55.838457 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 Sep 24 20:56:55.838457 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:56:55.838457 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:56:55.841000 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8afe75ffdb814e0ba23546cf3866ceac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8afe75ffdb814e0ba23546cf3866ceac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8afe75ffdb814e0ba23546cf3866ceac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8afe75ffdb814e0ba23546cf3866ceac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:56:55.841000 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 Sep 24 20:56:55.841000 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 8afe75ffdb814e0ba23546cf3866ceac Sep 24 20:56:55.841000 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 Sep 24 20:56:55.841000 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project Sep 24 20:56:55.841000 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:56:55.841000 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:56:55.841000 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 302ac6f497cf4d3c8c638f5b4b49f723 Sep 24 20:56:55.841000 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project Sep 24 20:56:55.841000 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:56:55.841000 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 834ff250-11c3-4391-aae5-7f3e6fa33166 could not be found. Sep 24 20:56:55.842199 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '834ff250-11c3-4391-aae5-7f3e6fa33166'} Sep 24 20:56:55.842199 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:56:55.842199 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:55.842199 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:56:55.842199 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:56:55.842199 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:56:55.842199 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:56:55.842199 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:56:55.842199 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:56:55.842199 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:56:55.842199 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:56:55.842199 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 834ff250-11c3-4391-aae5-7f3e6fa33166 could not be found. Sep 24 20:56:55.842199 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:55.842199 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:55.842199 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:55.842199 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:55.842199 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:55.842199 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:55.842199 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:56:55.842199 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:56:55.844810 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:56:55.844810 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:56:55.844810 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:56:55.844810 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:56:55.844810 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:56:55.844810 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:56:55.844810 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:56:55.844810 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:56:55.844810 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 834ff250-11c3-4391-aae5-7f3e6fa33166 could not be found. Sep 24 20:56:55.844810 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:55.844810 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:55.844810 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:55.844810 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:55.844810 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:55.844810 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:55.844810 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:56:55.844810 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:56:55.844810 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 834ff250-11c3-4391-aae5-7f3e6fa33166 could not be found. Sep 24 20:56:55.844810 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:55.847692 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ff13f3c2-5276-4bd7-9107-c0bfd923986e tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] Returning 404 to user: Instance 834ff250-11c3-4391-aae5-7f3e6fa33166 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:56:55.847692 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ff13f3c2-5276-4bd7-9107-c0bfd923986e tempest-FloatingIPsAssociationNegativeTestJSON-1574545311 tempest-FloatingIPsAssociationNegativeTestJSON-1574545311-project] 10.222.0.52 "GET /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166" status: 404 len: 111 microversion: 2.1 time: 0.077533 Sep 24 20:56:55.848453 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1014/2034] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:55 2022] GET /compute/v2.1/servers/834ff250-11c3-4391-aae5-7f3e6fa33166 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 20:56:55.979549 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bf9dfa7b-c49f-4968-8996-0281847e0e60 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:55.980175 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-bf9dfa7b-c49f-4968-8996-0281847e0e60 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:56.001501 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bf9dfa7b-c49f-4968-8996-0281847e0e60 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:56.002131 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bf9dfa7b-c49f-4968-8996-0281847e0e60 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:56.005692 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bf9dfa7b-c49f-4968-8996-0281847e0e60 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:56.006479 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bf9dfa7b-c49f-4968-8996-0281847e0e60 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:56.006984 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bf9dfa7b-c49f-4968-8996-0281847e0e60 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:56.007427 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bf9dfa7b-c49f-4968-8996-0281847e0e60 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:56.242014 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-bf9dfa7b-c49f-4968-8996-0281847e0e60 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:56.264827 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bf9dfa7b-c49f-4968-8996-0281847e0e60 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1183 microversion: 2.1 time: 0.289109 Sep 24 20:56:56.266120 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1015/2035] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:55 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1183 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:56.282738 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4dd828f1-95e1-41d7-9292-fd60d853c3da tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:56.283337 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-f8d0975f-7a33-4904-b73e-894bb325455e req-deb7dbac-f9a9-49e8-ac47-95387af0718a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd9d2c1a-53a4-4426-b01f-c286b39e7309", "tag": "1312138d-ee19-4b9c-baeb-9be04e956496"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:56.294308 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4dd828f1-95e1-41d7-9292-fd60d853c3da tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:56.296802 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4dd828f1-95e1-41d7-9292-fd60d853c3da tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:56.298472 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4dd828f1-95e1-41d7-9292-fd60d853c3da tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1812 microversion: 2.25 time: 0.550776 Sep 24 20:56:56.303007 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1021/2036] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:56:55 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1812 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:56:56.310288 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c6a4ae42-c581-4f7a-b4ca-cd1c7167a389 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:56.320890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-f8d0975f-7a33-4904-b73e-894bb325455e req-deb7dbac-f9a9-49e8-ac47-95387af0718a service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:56.322320 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c6a4ae42-c581-4f7a-b4ca-cd1c7167a389 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] [instance: dd9d2c1a-53a4-4426-b01f-c286b39e7309] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:56.323135 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-f8d0975f-7a33-4904-b73e-894bb325455e req-deb7dbac-f9a9-49e8-ac47-95387af0718a service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:56.324768 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-f8d0975f-7a33-4904-b73e-894bb325455e req-deb7dbac-f9a9-49e8-ac47-95387af0718a service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:56.355232 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c6a4ae42-c581-4f7a-b4ca-cd1c7167a389 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:56.360241 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c6a4ae42-c581-4f7a-b4ca-cd1c7167a389 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:56.362347 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c6a4ae42-c581-4f7a-b4ca-cd1c7167a389 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:56.364886 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c6a4ae42-c581-4f7a-b4ca-cd1c7167a389 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:56.365266 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-f8d0975f-7a33-4904-b73e-894bb325455e req-deb7dbac-f9a9-49e8-ac47-95387af0718a service nova] Creating event network-changed:1312138d-ee19-4b9c-baeb-9be04e956496 for instance dd9d2c1a-53a4-4426-b01f-c286b39e7309 on nch2-master-1 Sep 24 20:56:56.365669 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c6a4ae42-c581-4f7a-b4ca-cd1c7167a389 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:56.366851 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c6a4ae42-c581-4f7a-b4ca-cd1c7167a389 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:56.378084 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-f8d0975f-7a33-4904-b73e-894bb325455e req-deb7dbac-f9a9-49e8-ac47-95387af0718a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109754 Sep 24 20:56:56.381933 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1016/2037] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:56:56.763196 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c6a4ae42-c581-4f7a-b4ca-cd1c7167a389 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd09a0889c44ce18f0c361c7c661465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749824e2c16946a58801200784fa0480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:56.772789 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c6a4ae42-c581-4f7a-b4ca-cd1c7167a389 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9d2c1a-53a4-4426-b01f-c286b39e7309" status: 200 len: 1313 microversion: 2.1 time: 0.468027 Sep 24 20:56:56.773387 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1022/2038] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:56 2022] GET /compute/v2.1/servers/dd9d2c1a-53a4-4426-b01f-c286b39e7309 => generated 1313 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:57.293020 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-74fc1b9a-b839-4461-9ac3-35280e40c984 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:57.294706 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-74fc1b9a-b839-4461-9ac3-35280e40c984 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:57.321810 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-74fc1b9a-b839-4461-9ac3-35280e40c984 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:57.322952 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-74fc1b9a-b839-4461-9ac3-35280e40c984 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:57.323766 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-74fc1b9a-b839-4461-9ac3-35280e40c984 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:57.325374 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-74fc1b9a-b839-4461-9ac3-35280e40c984 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:57.326807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-74fc1b9a-b839-4461-9ac3-35280e40c984 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:57.327641 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-74fc1b9a-b839-4461-9ac3-35280e40c984 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:57.332914 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b2944660-7220-4133-bd07-e84ef42a3456 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:57.334128 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b2944660-7220-4133-bd07-e84ef42a3456 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:57.341714 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2944660-7220-4133-bd07-e84ef42a3456 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:57.342648 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2944660-7220-4133-bd07-e84ef42a3456 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:57.343541 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2944660-7220-4133-bd07-e84ef42a3456 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:57.344529 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2944660-7220-4133-bd07-e84ef42a3456 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:57.345227 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2944660-7220-4133-bd07-e84ef42a3456 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:57.345949 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2944660-7220-4133-bd07-e84ef42a3456 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:57.482464 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-74fc1b9a-b839-4461-9ac3-35280e40c984 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:57.493168 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-74fc1b9a-b839-4461-9ac3-35280e40c984 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1183 microversion: 2.1 time: 0.205971 Sep 24 20:56:57.496194 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1017/2039] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:57 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:57.592773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b2944660-7220-4133-bd07-e84ef42a3456 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:57.605460 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b2944660-7220-4133-bd07-e84ef42a3456 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:57.608032 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b2944660-7220-4133-bd07-e84ef42a3456 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:57.610275 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b2944660-7220-4133-bd07-e84ef42a3456 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1812 microversion: 2.25 time: 0.281975 Sep 24 20:56:57.623812 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1023/2040] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:56:57 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1812 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:56:57.797577 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-873f62c0-027a-4f49-bc96-98e92f1f1ef5 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:57.798298 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-873f62c0-027a-4f49-bc96-98e92f1f1ef5 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] [instance: dd9d2c1a-53a4-4426-b01f-c286b39e7309] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:57.816164 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-873f62c0-027a-4f49-bc96-98e92f1f1ef5 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:57.817040 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-873f62c0-027a-4f49-bc96-98e92f1f1ef5 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:57.817648 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-873f62c0-027a-4f49-bc96-98e92f1f1ef5 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:57.818563 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-873f62c0-027a-4f49-bc96-98e92f1f1ef5 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:57.820034 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-873f62c0-027a-4f49-bc96-98e92f1f1ef5 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:57.822095 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-873f62c0-027a-4f49-bc96-98e92f1f1ef5 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:58.066726 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=7 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:56:58.313315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-873f62c0-027a-4f49-bc96-98e92f1f1ef5 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd09a0889c44ce18f0c361c7c661465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749824e2c16946a58801200784fa0480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:58.325335 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-873f62c0-027a-4f49-bc96-98e92f1f1ef5 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9d2c1a-53a4-4426-b01f-c286b39e7309" status: 200 len: 1313 microversion: 2.1 time: 0.531569 Sep 24 20:56:58.329388 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1018/2041] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:57 2022] GET /compute/v2.1/servers/dd9d2c1a-53a4-4426-b01f-c286b39e7309 => generated 1313 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:56:58.507510 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-58180c74-2a17-49c8-8850-eefdf5051785 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] Action: 'create', calling method: .version_select at 0x7f4b0cae3280>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNt1CY1lPQEqOOHiEOyQ+rMnva5LShuQj1+dNXMERWAVWSls1sHyJ9LEESFpffcVeDhqBNi/6nMw/lH3zRXNFLGLgHugKayojN8HhF8VuLFqW856u6DPRaJQcOAZ+PjoKg=="}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:58.512423 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-58180c74-2a17-49c8-8850-eefdf5051785 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] Request method failure captured: Sep 24 20:56:58.512423 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 24 20:56:58.512423 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:56:58.512423 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:56:58.512423 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:56:58.512423 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 257 Sep 24 20:56:58.512423 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:56:58.512423 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:56:58.512423 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:56:58.512423 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:56:58.512423 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL28aTLEJjzch1z1SupGmgkD53xBoFeKWG1awQ6Cmj6awixQFDtxVtemZ2TcBsRXwygMdYbCg6w-GHBNe8OjHOHmbYrpSokKEF3T414USc4lbDllteDiBAZDnlr4IdqpIs7Ecgo4-P2dK73ibccMlzmLu-GogQOJrKl1Q6AZ19YEgcTo Sep 24 20:56:58.512423 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:56:58.512423 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:56:58.512423 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:56:58.512423 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:56:58.512423 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:56:58.512423 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:56:58.512423 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 3fb03e599c594df3a7480ab9074ee4a9 Sep 24 20:56:58.512423 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1200192494 Sep 24 20:56:58.512423 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:56:58.512423 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:56:58.514213 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3fb03e599c594df3a7480ab9074ee4a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3fb03e599c594df3a7480ab9074ee4a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3fb03e599c594df3a7480ab9074ee4a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3fb03e599c594df3a7480ab9074ee4a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:56:58.514213 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1200192494 Sep 24 20:56:58.514213 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 3fb03e599c594df3a7480ab9074ee4a9 Sep 24 20:56:58.514213 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1200192494 Sep 24 20:56:58.514213 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-KeyPairsNegativeTestJSON-1200192494-project Sep 24 20:56:58.514213 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:56:58.514213 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:56:58.514213 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 83ec68388d7d4ace91cc2d6cd7f7d741 Sep 24 20:56:58.514213 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1200192494-project Sep 24 20:56:58.514213 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 20:56:58.514213 ncdv-master-1 devstack@n-api.service[140517]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNt1CY1lPQEqOOHiEOyQ+rMnva5LShuQj1+dNXMERWAVWSls1sHyJ9LEESFpffcVeDhqBNi/6nMw/lH3zRXNFLGLgHugKayojN8HhF8VuLFqW856u6DPRaJQcOAZ+PjoKg=="}} Sep 24 20:56:58.515133 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 20:56:58.515133 ncdv-master-1 devstack@n-api.service[140517]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 24 20:56:58.515133 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNt1CY1lPQEqOOHiEOyQ+rMnva5LShuQj1+dNXMERWAVWSls1sHyJ9LEESFpffcVeDhqBNi/6nMw/lH3zRXNFLGLgHugKayojN8HhF8VuLFqW856u6DPRaJQcOAZ+PjoKg=='}}} Sep 24 20:56:58.515133 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:56:58.515133 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:58.515133 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 24 20:56:58.515133 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 24 20:56:58.515133 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Sep 24 20:56:58.515133 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Sep 24 20:56:58.515133 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Sep 24 20:56:58.515133 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Sep 24 20:56:58.515133 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 24 20:56:58.515133 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:58.515133 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 24 20:56:58.515133 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:58.515133 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:58.515133 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 20:56:58.516528 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 20:56:58.516528 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 20:56:58.516528 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise error Sep 24 20:56:58.516528 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Sep 24 20:56:58.516528 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:58.516528 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Sep 24 20:56:58.516528 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Sep 24 20:56:58.516528 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Sep 24 20:56:58.516528 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi 'minLength': 1, Sep 24 20:56:58.516528 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 24 20:56:58.516528 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:58.516528 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Sep 24 20:56:58.516528 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Sep 24 20:56:58.516528 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:58.516528 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:58.516528 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:58.516528 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:58.516528 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:58.516528 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:58.516528 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:56:58.516528 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:56:58.516528 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:56:58.516528 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:56:58.519279 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:56:58.519279 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:56:58.519279 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:56:58.519279 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:56:58.519279 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 20:56:58.519279 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 20:56:58.519279 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 20:56:58.519279 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 20:56:58.519279 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 20:56:58.519279 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 20:56:58.519279 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 24 20:56:58.519279 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:58.519279 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:58.519279 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:58.519279 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:58.519279 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:58.519279 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:58.519279 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 20:56:58.519279 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 20:56:58.520797 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 24 20:56:58.520797 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:58.522043 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-58180c74-2a17-49c8-8850-eefdf5051785 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:56:58.523115 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-58180c74-2a17-49c8-8850-eefdf5051785 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.210876 Sep 24 20:56:58.528177 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3bcb6163-f655-4172-94dd-61ba3cc9093b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:58.528632 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3bcb6163-f655-4172-94dd-61ba3cc9093b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:58.529073 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1024/2042] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 20:56:58 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 217 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 24 20:56:58.535683 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fd5410cc-ce72-412d-9449-dfde0b1e27e0 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] Action: 'create', calling method: .version_select at 0x7f4b0ca795e0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1754003652", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:58.538889 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3bcb6163-f655-4172-94dd-61ba3cc9093b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:58.539295 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3bcb6163-f655-4172-94dd-61ba3cc9093b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:58.539743 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3bcb6163-f655-4172-94dd-61ba3cc9093b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:58.540471 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3bcb6163-f655-4172-94dd-61ba3cc9093b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:58.548384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3bcb6163-f655-4172-94dd-61ba3cc9093b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:58.549460 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3bcb6163-f655-4172-94dd-61ba3cc9093b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:58.557841 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-fd5410cc-ce72-412d-9449-dfde0b1e27e0 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] Getting quotas for project 3fb03e599c594df3a7480ab9074ee4a9. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:56:58.564100 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-fd5410cc-ce72-412d-9449-dfde0b1e27e0 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] Getting quotas for user 83ec68388d7d4ace91cc2d6cd7f7d741 and project 3fb03e599c594df3a7480ab9074ee4a9. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:56:58.583449 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-fd5410cc-ce72-412d-9449-dfde0b1e27e0 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 24 20:56:58.600822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fd5410cc-ce72-412d-9449-dfde0b1e27e0 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] Request method failure captured: Sep 24 20:56:58.600822 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 24 20:56:58.600822 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:56:58.600822 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:56:58.600822 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:56:58.600822 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 2167 Sep 24 20:56:58.600822 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:56:58.600822 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:56:58.600822 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:56:58.600822 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:56:58.600822 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL28aTLEJjzch1z1SupGmgkD53xBoFeKWG1awQ6Cmj6awixQFDtxVtemZ2TcBsRXwygMdYbCg6w-GHBNe8OjHOHmbYrpSokKEF3T414USc4lbDllteDiBAZDnlr4IdqpIs7Ecgo4-P2dK73ibccMlzmLu-GogQOJrKl1Q6AZ19YEgcTo Sep 24 20:56:58.600822 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:56:58.600822 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:56:58.600822 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:56:58.600822 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:56:58.600822 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:56:58.600822 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:56:58.600822 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 3fb03e599c594df3a7480ab9074ee4a9 Sep 24 20:56:58.600822 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1200192494 Sep 24 20:56:58.600822 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:56:58.600822 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:56:58.600822 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3fb03e599c594df3a7480ab9074ee4a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3fb03e599c594df3a7480ab9074ee4a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3fb03e599c594df3a7480ab9074ee4a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3fb03e599c594df3a7480ab9074ee4a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:56:58.600822 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1200192494 Sep 24 20:56:58.600822 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 3fb03e599c594df3a7480ab9074ee4a9 Sep 24 20:56:58.600822 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1200192494 Sep 24 20:56:58.600822 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-KeyPairsNegativeTestJSON-1200192494-project Sep 24 20:56:58.600822 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:56:58.600822 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:56:58.600822 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 83ec68388d7d4ace91cc2d6cd7f7d741 Sep 24 20:56:58.600822 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1200192494-project Sep 24 20:56:58.600822 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 20:56:58.600822 ncdv-master-1 devstack@n-api.service[140517]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1754003652", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Sep 24 20:56:58.600822 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 20:56:58.600822 ncdv-master-1 devstack@n-api.service[140517]: exception: Keypair data is invalid: failed to generate fingerprint Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1754003652', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:56:58.603883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:56:58.608750 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:56:58.608750 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:56:58.608750 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:56:58.608750 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:56:58.608750 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 24 20:56:58.608750 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 24 20:56:58.608750 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 24 20:56:58.608750 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 24 20:56:58.608750 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 24 20:56:58.608750 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:58.608750 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:58.608750 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:58.608750 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:58.608750 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:58.608750 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:58.608750 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:56:58.608750 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:56:58.608750 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 24 20:56:58.608750 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:56:58.614127 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fd5410cc-ce72-412d-9449-dfde0b1e27e0 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:56:58.616535 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fd5410cc-ce72-412d-9449-dfde0b1e27e0 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.085475 Sep 24 20:56:58.625731 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1025/2043] 10.222.0.52 () {60 vars in 1160 bytes} [Sat Sep 24 20:56:58 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 24 20:56:58.635086 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9e23dda0-78af-4487-8916-6c842361a96b tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] Action: 'create', calling method: .version_select at 0x7f4b0ca79160>, body: {"keypair": {"name": "tempest-keypair-690656341", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvOJ4j6Kih0pgrfFvRo+gATpjrTvJlNfDcSGjqN9rGORweG77JTbpyPITxIlRW9jJmTsZgNgeHhR6ga3JAL40ilkCxNOSFB5HDkCU0RFLtQpOap/n+Vq7eaY5t0ixp4CQ=="}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:58.656877 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-9e23dda0-78af-4487-8916-6c842361a96b tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] Getting quotas for project 3fb03e599c594df3a7480ab9074ee4a9. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:56:58.663418 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-9e23dda0-78af-4487-8916-6c842361a96b tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] Getting quotas for user 83ec68388d7d4ace91cc2d6cd7f7d741 and project 3fb03e599c594df3a7480ab9074ee4a9. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:56:58.693733 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9e23dda0-78af-4487-8916-6c842361a96b tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.066429 Sep 24 20:56:58.704035 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1026/2044] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 20:56:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:56:58.706724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-517dc17f-1d04-4799-b3ec-75bfebef5766 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:58.708051 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-517dc17f-1d04-4799-b3ec-75bfebef5766 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:58.720743 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:56:58.722993 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-517dc17f-1d04-4799-b3ec-75bfebef5766 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:58.723999 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-517dc17f-1d04-4799-b3ec-75bfebef5766 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:58.724631 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-517dc17f-1d04-4799-b3ec-75bfebef5766 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:58.725501 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-517dc17f-1d04-4799-b3ec-75bfebef5766 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:58.726166 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-517dc17f-1d04-4799-b3ec-75bfebef5766 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:58.726712 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-517dc17f-1d04-4799-b3ec-75bfebef5766 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:58.753233 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3bcb6163-f655-4172-94dd-61ba3cc9093b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:58.768583 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3bcb6163-f655-4172-94dd-61ba3cc9093b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1183 microversion: 2.1 time: 0.245186 Sep 24 20:56:58.769195 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1019/2045] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:58 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1183 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:56:58.775871 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e8e6ada4-c98a-4392-9a82-f1588ba2aa19 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] Action: 'create', calling method: .version_select at 0x7f4b1117baf0>, body: {"keypair": {"name": "tempest-keypair-690656341", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpF6+7Q/fql8pyYzjW3msrRA24lBI/4xlcHwCQr9d+U+1Yna9Uhjy9e/il9UjYPUsgZEGIdkRPAToB4tW0YcnVMpnh1OucwWeNohbvfFYAqFYpsoXPaaqxl8HilNKqcDA=="}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:58.798061 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-e8e6ada4-c98a-4392-9a82-f1588ba2aa19 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] Getting quotas for project 3fb03e599c594df3a7480ab9074ee4a9. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:56:58.805281 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-e8e6ada4-c98a-4392-9a82-f1588ba2aa19 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] Getting quotas for user 83ec68388d7d4ace91cc2d6cd7f7d741 and project 3fb03e599c594df3a7480ab9074ee4a9. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:56:58.837120 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-e8e6ada4-c98a-4392-9a82-f1588ba2aa19 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] HTTP exception thrown: Key pair 'tempest-keypair-690656341' already exists. Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e8e6ada4-c98a-4392-9a82-f1588ba2aa19 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] Request method failure captured: Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 272 Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL28aTLEJjzch1z1SupGmgkD53xBoFeKWG1awQ6Cmj6awixQFDtxVtemZ2TcBsRXwygMdYbCg6w-GHBNe8OjHOHmbYrpSokKEF3T414USc4lbDllteDiBAZDnlr4IdqpIs7Ecgo4-P2dK73ibccMlzmLu-GogQOJrKl1Q6AZ19YEgcTo Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 3fb03e599c594df3a7480ab9074ee4a9 Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1200192494 Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3fb03e599c594df3a7480ab9074ee4a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3fb03e599c594df3a7480ab9074ee4a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3fb03e599c594df3a7480ab9074ee4a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3fb03e599c594df3a7480ab9074ee4a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1200192494 Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 3fb03e599c594df3a7480ab9074ee4a9 Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1200192494 Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-KeyPairsNegativeTestJSON-1200192494-project Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 83ec68388d7d4ace91cc2d6cd7f7d741 Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1200192494-project Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: {"keypair": {"name": "tempest-keypair-690656341", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpF6+7Q/fql8pyYzjW3msrRA24lBI/4xlcHwCQr9d+U+1Yna9Uhjy9e/il9UjYPUsgZEGIdkRPAToB4tW0YcnVMpnh1OucwWeNohbvfFYAqFYpsoXPaaqxl8HilNKqcDA=="}} Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: exception: Key pair 'tempest-keypair-690656341' already exists. Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-690656341', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpF6+7Q/fql8pyYzjW3msrRA24lBI/4xlcHwCQr9d+U+1Yna9Uhjy9e/il9UjYPUsgZEGIdkRPAToB4tW0YcnVMpnh1OucwWeNohbvfFYAqFYpsoXPaaqxl8HilNKqcDA=='}}} Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result.read() Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '83ec68388d7d4ace91cc2d6cd7f7d741-tempest-keypair-690656341' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 24 20:56:58.843713 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi kp.save(context.session) Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi session.flush() Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result.read() Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 24 20:56:58.853062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '83ec68388d7d4ace91cc2d6cd7f7d741-tempest-keypair-690656341' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 24, 20, 56, 58, 826638), 'updated_at': None, 'name': 'tempest-keypair-690656341', 'user_id': '83ec68388d7d4ace91cc2d6cd7f7d741', 'fingerprint': 'd0:48:01:22:75:05:3a:82:68:a6:d1:4b:9f:a1:58:c6', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpF6+7Q/fql8pyYzjW3msrRA24lBI/4xlcHwCQr9d+U+1Yna9Uhjy9e/il9UjYPUsgZEGIdkRPAToB4tW0YcnVMpnh1OucwWeNohbvfFYAqFYpsoXPaaqxl8HilNKqcDA==', 'type': 'ssh'}] Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi keypair.create() Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._create() Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-690656341' already exists. Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Sep 24 20:56:58.857755 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-690656341' already exists. Sep 24 20:56:58.866557 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:58.866557 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:58.866557 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:58.866557 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:58.866557 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:58.866557 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:58.866557 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:56:58.866557 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:56:58.866557 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-690656341' already exists. Sep 24 20:56:58.866557 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:58.866557 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e8e6ada4-c98a-4392-9a82-f1588ba2aa19 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] Returning 409 to user: Key pair 'tempest-keypair-690656341' already exists. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:56:58.866557 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e8e6ada4-c98a-4392-9a82-f1588ba2aa19 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.074653 Sep 24 20:56:58.866557 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1020/2046] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 20:56:58 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 77 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 24 20:56:58.868465 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7e5e735f-82ff-4e36-b343-e9579ae9fc59 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] Calling method '.version_select at 0x7f4b11116430>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:58.891241 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7e5e735f-82ff-4e36-b343-e9579ae9fc59 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-690656341" status: 202 len: 0 microversion: 2.1 time: 0.035524 Sep 24 20:56:58.892016 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1021/2047] 10.222.0.52 () {58 vars in 1218 bytes} [Sat Sep 24 20:56:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-690656341 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:56:58.907665 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ca9220f0-ceb4-4cc1-8953-38cd82f3cb51 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] Action: 'create', calling method: .version_select at 0x7f4b1106aa60>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1GLxRMnBQYC6iqbXPsAeDz4mlfOiE3Brrb/8rwqkTiVTmvVuwxdYeTXcYO3fcJOoH6iDwr0+zbVyJaz+qGJhg4sIcXEQ49PqzzbcaX8HCbL8MIGYa6C8vwbbNM8g5yEw=="}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ca9220f0-ceb4-4cc1-8953-38cd82f3cb51 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] Request method failure captured: Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 247 Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL28aTLEJjzch1z1SupGmgkD53xBoFeKWG1awQ6Cmj6awixQFDtxVtemZ2TcBsRXwygMdYbCg6w-GHBNe8OjHOHmbYrpSokKEF3T414USc4lbDllteDiBAZDnlr4IdqpIs7Ecgo4-P2dK73ibccMlzmLu-GogQOJrKl1Q6AZ19YEgcTo Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 3fb03e599c594df3a7480ab9074ee4a9 Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1200192494 Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3fb03e599c594df3a7480ab9074ee4a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3fb03e599c594df3a7480ab9074ee4a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3fb03e599c594df3a7480ab9074ee4a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3fb03e599c594df3a7480ab9074ee4a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1200192494 Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 3fb03e599c594df3a7480ab9074ee4a9 Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1200192494 Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-KeyPairsNegativeTestJSON-1200192494-project Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 83ec68388d7d4ace91cc2d6cd7f7d741 Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1200192494-project Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1GLxRMnBQYC6iqbXPsAeDz4mlfOiE3Brrb/8rwqkTiVTmvVuwxdYeTXcYO3fcJOoH6iDwr0+zbVyJaz+qGJhg4sIcXEQ49PqzzbcaX8HCbL8MIGYa6C8vwbbNM8g5yEw=="}} Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1GLxRMnBQYC6iqbXPsAeDz4mlfOiE3Brrb/8rwqkTiVTmvVuwxdYeTXcYO3fcJOoH6iDwr0+zbVyJaz+qGJhg4sIcXEQ49PqzzbcaX8HCbL8MIGYa6C8vwbbNM8g5yEw=='}}} Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise error Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi '' Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 20:56:58.912089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 20:56:58.917302 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 20:56:58.917302 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 20:56:58.917302 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 20:56:58.917302 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 20:56:58.917302 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 24 20:56:58.917302 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:58.917302 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:58.917302 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:58.917302 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:58.917302 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:58.917302 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:58.917302 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 20:56:58.917302 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 20:56:58.917302 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 24 20:56:58.917302 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:58.917302 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ca9220f0-ceb4-4cc1-8953-38cd82f3cb51 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:56:58.917302 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ca9220f0-ceb4-4cc1-8953-38cd82f3cb51 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.012844 Sep 24 20:56:58.919413 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1022/2048] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 20:56:58 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 20:56:58.924512 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5e213990-37df-45fa-ae06-572f63ab2945 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] Action: 'create', calling method: .version_select at 0x7f4b111cc670>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-88296175", "public_key": " "}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:58.946249 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-5e213990-37df-45fa-ae06-572f63ab2945 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] Getting quotas for project 3fb03e599c594df3a7480ab9074ee4a9. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:56:58.952456 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-5e213990-37df-45fa-ae06-572f63ab2945 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] Getting quotas for user 83ec68388d7d4ace91cc2d6cd7f7d741 and project 3fb03e599c594df3a7480ab9074ee4a9. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:56:58.974442 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-5e213990-37df-45fa-ae06-572f63ab2945 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5e213990-37df-45fa-ae06-572f63ab2945 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] Request method failure captured: Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 93 Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL28aTLEJjzch1z1SupGmgkD53xBoFeKWG1awQ6Cmj6awixQFDtxVtemZ2TcBsRXwygMdYbCg6w-GHBNe8OjHOHmbYrpSokKEF3T414USc4lbDllteDiBAZDnlr4IdqpIs7Ecgo4-P2dK73ibccMlzmLu-GogQOJrKl1Q6AZ19YEgcTo Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 3fb03e599c594df3a7480ab9074ee4a9 Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1200192494 Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3fb03e599c594df3a7480ab9074ee4a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3fb03e599c594df3a7480ab9074ee4a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3fb03e599c594df3a7480ab9074ee4a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3fb03e599c594df3a7480ab9074ee4a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1200192494 Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 3fb03e599c594df3a7480ab9074ee4a9 Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1200192494 Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-KeyPairsNegativeTestJSON-1200192494-project Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 83ec68388d7d4ace91cc2d6cd7f7d741 Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1200192494-project Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-88296175", "public_key": " "}} Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: exception: Keypair data is invalid: failed to generate fingerprint Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-88296175', 'public_key': ' '}}} Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:58.976994 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:58.981787 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:58.981787 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:58.981787 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:58.981787 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:56:58.981787 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:56:58.981787 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:56:58.981787 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:56:58.981787 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:56:58.981787 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:56:58.981787 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:56:58.981787 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:56:58.981787 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:56:58.981787 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:56:58.981787 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 24 20:56:58.981787 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 24 20:56:58.981787 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 24 20:56:58.981787 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 24 20:56:58.981787 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 24 20:56:58.981787 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:58.981787 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:58.981787 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:58.981787 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:58.981787 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:58.981787 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:58.981787 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:56:58.981787 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:56:58.981787 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 24 20:56:58.981787 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:58.992308 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5e213990-37df-45fa-ae06-572f63ab2945 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:56:58.993381 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5e213990-37df-45fa-ae06-572f63ab2945 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.073482 Sep 24 20:56:59.000609 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1023/2049] 10.222.0.52 () {60 vars in 1158 bytes} [Sat Sep 24 20:56:58 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 75 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 24 20:56:59.007586 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e857a6f1-577d-4392-9a40-aee803447add tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] Action: 'create', calling method: .version_select at 0x7f4b11075160>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMttHefcM5esTx/14dBlNmwd3bOQgPLE6XtigCdT1TEk8NPAL82NA35WcEkGuftHYwhuXu8QWetKVpQQ9P1Ln6seGUn2dGVI/i8Nl36dLG/np/Ybk8D/xvmOnA/8XqZDVg=="}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e857a6f1-577d-4392-9a40-aee803447add tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] Request method failure captured: Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 507 Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL28aTLEJjzch1z1SupGmgkD53xBoFeKWG1awQ6Cmj6awixQFDtxVtemZ2TcBsRXwygMdYbCg6w-GHBNe8OjHOHmbYrpSokKEF3T414USc4lbDllteDiBAZDnlr4IdqpIs7Ecgo4-P2dK73ibccMlzmLu-GogQOJrKl1Q6AZ19YEgcTo Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 3fb03e599c594df3a7480ab9074ee4a9 Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1200192494 Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3fb03e599c594df3a7480ab9074ee4a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3fb03e599c594df3a7480ab9074ee4a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3fb03e599c594df3a7480ab9074ee4a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3fb03e599c594df3a7480ab9074ee4a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1200192494 Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 3fb03e599c594df3a7480ab9074ee4a9 Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1200192494 Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-KeyPairsNegativeTestJSON-1200192494-project Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 83ec68388d7d4ace91cc2d6cd7f7d741 Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1200192494-project Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMttHefcM5esTx/14dBlNmwd3bOQgPLE6XtigCdT1TEk8NPAL82NA35WcEkGuftHYwhuXu8QWetKVpQQ9P1Ln6seGUn2dGVI/i8Nl36dLG/np/Ybk8D/xvmOnA/8XqZDVg=="}} Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMttHefcM5esTx/14dBlNmwd3bOQgPLE6XtigCdT1TEk8NPAL82NA35WcEkGuftHYwhuXu8QWetKVpQQ9P1Ln6seGUn2dGVI/i8Nl36dLG/np/Ybk8D/xvmOnA/8XqZDVg=='}}} Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise error Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 24 20:56:59.013536 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Sep 24 20:56:59.022114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:59.022114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:59.022114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:59.022114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:59.022114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:59.022114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:59.022114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:56:59.022114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:56:59.022114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:56:59.022114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:56:59.022114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:56:59.022114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:56:59.022114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:56:59.022114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:56:59.022114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 20:56:59.022114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 20:56:59.022114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 20:56:59.022114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 20:56:59.022114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 20:56:59.022114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 20:56:59.022114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 24 20:56:59.022114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:59.022114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:59.022114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:59.022114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:59.022114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:59.022114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:59.022114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 20:56:59.022114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 20:56:59.022114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 24 20:56:59.022114 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:59.022114 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e857a6f1-577d-4392-9a40-aee803447add tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:56:59.022114 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e857a6f1-577d-4392-9a40-aee803447add tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.013152 Sep 24 20:56:59.022114 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1024/2050] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 20:56:59 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 24 20:56:59.033183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3217207c-c41a-414d-b35f-6e69db6f4dd5 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] Action: 'create', calling method: .version_select at 0x7f4b1117b160>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1991543995", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:56:59.061587 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-3217207c-c41a-414d-b35f-6e69db6f4dd5 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] Getting quotas for project 3fb03e599c594df3a7480ab9074ee4a9. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:56:59.068119 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-3217207c-c41a-414d-b35f-6e69db6f4dd5 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] Getting quotas for user 83ec68388d7d4ace91cc2d6cd7f7d741 and project 3fb03e599c594df3a7480ab9074ee4a9. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:56:59.082691 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:56:59.112506 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-3217207c-c41a-414d-b35f-6e69db6f4dd5 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3217207c-c41a-414d-b35f-6e69db6f4dd5 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] Request method failure captured: Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 118 Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL28aTLEJjzch1z1SupGmgkD53xBoFeKWG1awQ6Cmj6awixQFDtxVtemZ2TcBsRXwygMdYbCg6w-GHBNe8OjHOHmbYrpSokKEF3T414USc4lbDllteDiBAZDnlr4IdqpIs7Ecgo4-P2dK73ibccMlzmLu-GogQOJrKl1Q6AZ19YEgcTo Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 3fb03e599c594df3a7480ab9074ee4a9 Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1200192494 Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3fb03e599c594df3a7480ab9074ee4a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3fb03e599c594df3a7480ab9074ee4a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3fb03e599c594df3a7480ab9074ee4a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3fb03e599c594df3a7480ab9074ee4a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1200192494 Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 3fb03e599c594df3a7480ab9074ee4a9 Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1200192494 Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-KeyPairsNegativeTestJSON-1200192494-project Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 83ec68388d7d4ace91cc2d6cd7f7d741 Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1200192494-project Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1991543995", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: exception: Keypair data is invalid: failed to generate fingerprint Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1991543995', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 24 20:56:59.115109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 24 20:56:59.120415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 24 20:56:59.120415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 24 20:56:59.120415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 24 20:56:59.120415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:59.120415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:59.120415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:59.120415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:59.120415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:59.120415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:59.120415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:56:59.120415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:56:59.120415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:56:59.120415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:56:59.120415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:56:59.120415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:56:59.120415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:56:59.120415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:56:59.120415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:56:59.120415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:56:59.120415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 24 20:56:59.120415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 24 20:56:59.120415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 24 20:56:59.120415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 24 20:56:59.120415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 24 20:56:59.120415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:59.120415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:59.120415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:59.120415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:59.120415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:59.120415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:59.120415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:56:59.120415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:56:59.120415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 24 20:56:59.120415 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:59.120415 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3217207c-c41a-414d-b35f-6e69db6f4dd5 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:56:59.125652 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3217207c-c41a-414d-b35f-6e69db6f4dd5 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.099948 Sep 24 20:56:59.133660 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1025/2051] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 20:56:59 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 24 20:56:59.148152 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-29b81949-138d-4743-bee3-acaf3b80d0c2 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] Calling method '.version_select at 0x7f4b1106e820>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:59.165105 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-29b81949-138d-4743-bee3-acaf3b80d0c2 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1164240874 not found for user 83ec68388d7d4ace91cc2d6cd7f7d741 Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-29b81949-138d-4743-bee3-acaf3b80d0c2 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] Request method failure captured: Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1164240874 HTTP/1.1 Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL28aTLEJjzch1z1SupGmgkD53xBoFeKWG1awQ6Cmj6awixQFDtxVtemZ2TcBsRXwygMdYbCg6w-GHBNe8OjHOHmbYrpSokKEF3T414USc4lbDllteDiBAZDnlr4IdqpIs7Ecgo4-P2dK73ibccMlzmLu-GogQOJrKl1Q6AZ19YEgcTo Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 3fb03e599c594df3a7480ab9074ee4a9 Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1200192494 Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3fb03e599c594df3a7480ab9074ee4a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3fb03e599c594df3a7480ab9074ee4a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3fb03e599c594df3a7480ab9074ee4a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3fb03e599c594df3a7480ab9074ee4a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1200192494 Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 3fb03e599c594df3a7480ab9074ee4a9 Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1200192494 Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-KeyPairsNegativeTestJSON-1200192494-project Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 83ec68388d7d4ace91cc2d6cd7f7d741 Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1200192494-project Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: exception: Keypair tempest-keypair-non-existent-1164240874 not found for user 83ec68388d7d4ace91cc2d6cd7f7d741 Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'tempest-keypair-non-existent-1164240874'} Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise self.value Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1164240874 not found for user 83ec68388d7d4ace91cc2d6cd7f7d741 Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:59.167229 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:59.173079 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:59.173079 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:59.173079 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:59.173079 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:59.173079 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:56:59.173079 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:56:59.173079 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 20:56:59.173079 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 20:56:59.173079 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 24 20:56:59.173079 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:56:59.173079 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:56:59.173079 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:56:59.173079 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Sep 24 20:56:59.173079 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._delete(req, id) Sep 24 20:56:59.173079 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Sep 24 20:56:59.173079 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Sep 24 20:56:59.173079 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1164240874 not found for user 83ec68388d7d4ace91cc2d6cd7f7d741 Sep 24 20:56:59.173079 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:59.173079 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:56:59.173079 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:59.173079 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:56:59.173079 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:56:59.173079 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:56:59.173079 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:56:59.173079 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:56:59.173079 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1164240874 not found for user 83ec68388d7d4ace91cc2d6cd7f7d741 Sep 24 20:56:59.173079 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:56:59.173079 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-29b81949-138d-4743-bee3-acaf3b80d0c2 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1164240874 not found for user 83ec68388d7d4ace91cc2d6cd7f7d741 {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:56:59.176950 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-29b81949-138d-4743-bee3-acaf3b80d0c2 tempest-KeyPairsNegativeTestJSON-1200192494 tempest-KeyPairsNegativeTestJSON-1200192494-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1164240874" status: 404 len: 145 microversion: 2.1 time: 0.033809 Sep 24 20:56:59.183525 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1026/2052] 10.222.0.52 () {58 vars in 1260 bytes} [Sat Sep 24 20:56:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1164240874 => generated 145 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:56:59.358638 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c66b06a4-78b3-4b73-8ee2-be506f4440c8 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:59.359718 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c66b06a4-78b3-4b73-8ee2-be506f4440c8 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] [instance: dd9d2c1a-53a4-4426-b01f-c286b39e7309] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:59.387261 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c66b06a4-78b3-4b73-8ee2-be506f4440c8 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:59.396918 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c66b06a4-78b3-4b73-8ee2-be506f4440c8 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:59.397391 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c66b06a4-78b3-4b73-8ee2-be506f4440c8 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:59.398246 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c66b06a4-78b3-4b73-8ee2-be506f4440c8 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:59.401123 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c66b06a4-78b3-4b73-8ee2-be506f4440c8 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:59.401591 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c66b06a4-78b3-4b73-8ee2-be506f4440c8 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:59.750840 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-517dc17f-1d04-4799-b3ec-75bfebef5766 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:59.767387 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-517dc17f-1d04-4799-b3ec-75bfebef5766 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:59.770126 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-517dc17f-1d04-4799-b3ec-75bfebef5766 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:59.776223 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-517dc17f-1d04-4799-b3ec-75bfebef5766 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1812 microversion: 2.25 time: 1.076306 Sep 24 20:56:59.777431 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1027/2053] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:56:58 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1812 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:56:59.796762 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f4267e9f-4495-42ca-adaa-43e827d16eb6 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:56:59.797691 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f4267e9f-4495-42ca-adaa-43e827d16eb6 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:56:59.810777 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f4267e9f-4495-42ca-adaa-43e827d16eb6 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:59.811565 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f4267e9f-4495-42ca-adaa-43e827d16eb6 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:59.818341 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f4267e9f-4495-42ca-adaa-43e827d16eb6 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:59.819704 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f4267e9f-4495-42ca-adaa-43e827d16eb6 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:56:59.821995 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f4267e9f-4495-42ca-adaa-43e827d16eb6 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:56:59.822727 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f4267e9f-4495-42ca-adaa-43e827d16eb6 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:56:59.974662 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f4267e9f-4495-42ca-adaa-43e827d16eb6 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:56:59.985318 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f4267e9f-4495-42ca-adaa-43e827d16eb6 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1183 microversion: 2.1 time: 0.193235 Sep 24 20:56:59.998778 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1028/2054] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:59 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:57:00.061096 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c66b06a4-78b3-4b73-8ee2-be506f4440c8 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd09a0889c44ce18f0c361c7c661465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749824e2c16946a58801200784fa0480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:00.077109 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c66b06a4-78b3-4b73-8ee2-be506f4440c8 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9d2c1a-53a4-4426-b01f-c286b39e7309" status: 200 len: 1313 microversion: 2.1 time: 0.720067 Sep 24 20:57:00.092223 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1027/2055] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:56:59 2022] GET /compute/v2.1/servers/dd9d2c1a-53a4-4426-b01f-c286b39e7309 => generated 1313 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:57:00.808901 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-13be8fe9-3f3d-4858-a905-d6c710b33f9e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:00.809536 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-13be8fe9-3f3d-4858-a905-d6c710b33f9e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:00.819420 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-13be8fe9-3f3d-4858-a905-d6c710b33f9e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:00.820214 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-13be8fe9-3f3d-4858-a905-d6c710b33f9e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:00.820882 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-13be8fe9-3f3d-4858-a905-d6c710b33f9e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:00.821825 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-13be8fe9-3f3d-4858-a905-d6c710b33f9e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:00.822562 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-13be8fe9-3f3d-4858-a905-d6c710b33f9e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:00.824094 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-13be8fe9-3f3d-4858-a905-d6c710b33f9e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:01.015194 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-66442e86-7087-43f4-ba66-e8d8adaf5e26 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:01.016412 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-66442e86-7087-43f4-ba66-e8d8adaf5e26 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:01.024717 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66442e86-7087-43f4-ba66-e8d8adaf5e26 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:01.025205 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66442e86-7087-43f4-ba66-e8d8adaf5e26 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:01.025643 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66442e86-7087-43f4-ba66-e8d8adaf5e26 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:01.026350 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66442e86-7087-43f4-ba66-e8d8adaf5e26 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:01.026832 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66442e86-7087-43f4-ba66-e8d8adaf5e26 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:01.027284 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66442e86-7087-43f4-ba66-e8d8adaf5e26 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:01.058608 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-13be8fe9-3f3d-4858-a905-d6c710b33f9e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:01.068444 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-13be8fe9-3f3d-4858-a905-d6c710b33f9e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:01.070575 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-13be8fe9-3f3d-4858-a905-d6c710b33f9e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:01.072021 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-13be8fe9-3f3d-4858-a905-d6c710b33f9e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1812 microversion: 2.25 time: 0.267210 Sep 24 20:57:01.087569 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1029/2056] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:00 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1812 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:57:01.101462 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-66442e86-7087-43f4-ba66-e8d8adaf5e26 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:01.103812 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-db61e144-0296-4357-a672-f98df6670cfa tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:01.105851 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-db61e144-0296-4357-a672-f98df6670cfa tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] [instance: dd9d2c1a-53a4-4426-b01f-c286b39e7309] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:01.109772 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-66442e86-7087-43f4-ba66-e8d8adaf5e26 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1183 microversion: 2.1 time: 0.099633 Sep 24 20:57:01.110471 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1028/2057] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:01 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:57:01.114246 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db61e144-0296-4357-a672-f98df6670cfa tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:01.114846 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db61e144-0296-4357-a672-f98df6670cfa tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:01.115543 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db61e144-0296-4357-a672-f98df6670cfa tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:01.116603 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db61e144-0296-4357-a672-f98df6670cfa tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:01.117018 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db61e144-0296-4357-a672-f98df6670cfa tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:01.117734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db61e144-0296-4357-a672-f98df6670cfa tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:01.301871 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-db61e144-0296-4357-a672-f98df6670cfa tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd09a0889c44ce18f0c361c7c661465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749824e2c16946a58801200784fa0480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:01.310755 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-db61e144-0296-4357-a672-f98df6670cfa tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9d2c1a-53a4-4426-b01f-c286b39e7309" status: 200 len: 1313 microversion: 2.1 time: 0.211005 Sep 24 20:57:01.311318 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1030/2058] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:01 2022] GET /compute/v2.1/servers/dd9d2c1a-53a4-4426-b01f-c286b39e7309 => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:57:01.858311 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-9c38db42-c4f0-43c7-956a-a2227ed623fb req-9edd1008-2ea2-4060-8e80-a14056aab8a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd9d2c1a-53a4-4426-b01f-c286b39e7309", "name": "network-vif-plugged", "status": "completed", "tag": "1312138d-ee19-4b9c-baeb-9be04e956496"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:57:01.901549 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-9c38db42-c4f0-43c7-956a-a2227ed623fb req-9edd1008-2ea2-4060-8e80-a14056aab8a5 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:01.903260 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-9c38db42-c4f0-43c7-956a-a2227ed623fb req-9edd1008-2ea2-4060-8e80-a14056aab8a5 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:01.903699 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-9c38db42-c4f0-43c7-956a-a2227ed623fb req-9edd1008-2ea2-4060-8e80-a14056aab8a5 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:01.933617 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-9c38db42-c4f0-43c7-956a-a2227ed623fb req-9edd1008-2ea2-4060-8e80-a14056aab8a5 service nova] Creating event network-vif-plugged:1312138d-ee19-4b9c-baeb-9be04e956496 for instance dd9d2c1a-53a4-4426-b01f-c286b39e7309 on nch2-master-1 Sep 24 20:57:01.959167 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-9c38db42-c4f0-43c7-956a-a2227ed623fb req-9edd1008-2ea2-4060-8e80-a14056aab8a5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105606 Sep 24 20:57:01.959860 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1029/2059] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:57:02.103560 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-061960f5-1290-482c-b763-e82256fbd74f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:02.104210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-061960f5-1290-482c-b763-e82256fbd74f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:02.114063 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-061960f5-1290-482c-b763-e82256fbd74f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:02.114578 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-061960f5-1290-482c-b763-e82256fbd74f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:02.117410 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-061960f5-1290-482c-b763-e82256fbd74f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:02.118142 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-061960f5-1290-482c-b763-e82256fbd74f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:02.120987 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-061960f5-1290-482c-b763-e82256fbd74f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:02.122847 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-061960f5-1290-482c-b763-e82256fbd74f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:02.139020 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a853cb7b-e30e-446f-9fad-b9fd39e23700 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:02.139669 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a853cb7b-e30e-446f-9fad-b9fd39e23700 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:02.158794 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a853cb7b-e30e-446f-9fad-b9fd39e23700 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:02.159773 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a853cb7b-e30e-446f-9fad-b9fd39e23700 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:02.160614 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a853cb7b-e30e-446f-9fad-b9fd39e23700 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:02.165437 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a853cb7b-e30e-446f-9fad-b9fd39e23700 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:02.166281 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a853cb7b-e30e-446f-9fad-b9fd39e23700 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:02.169387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a853cb7b-e30e-446f-9fad-b9fd39e23700 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:02.365094 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a853cb7b-e30e-446f-9fad-b9fd39e23700 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:02.387034 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a853cb7b-e30e-446f-9fad-b9fd39e23700 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1183 microversion: 2.1 time: 0.253566 Sep 24 20:57:02.387712 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1030/2060] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:02 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1183 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:02.392679 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-96d0a408-bb74-4899-b786-1158a8de83c5 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:02.393541 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-96d0a408-bb74-4899-b786-1158a8de83c5 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] [instance: dd9d2c1a-53a4-4426-b01f-c286b39e7309] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:02.410018 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96d0a408-bb74-4899-b786-1158a8de83c5 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:02.413426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96d0a408-bb74-4899-b786-1158a8de83c5 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:02.414124 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96d0a408-bb74-4899-b786-1158a8de83c5 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:02.415103 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96d0a408-bb74-4899-b786-1158a8de83c5 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:02.416867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96d0a408-bb74-4899-b786-1158a8de83c5 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:02.417498 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96d0a408-bb74-4899-b786-1158a8de83c5 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:02.563216 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-061960f5-1290-482c-b763-e82256fbd74f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:02.575113 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-061960f5-1290-482c-b763-e82256fbd74f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:02.577025 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-061960f5-1290-482c-b763-e82256fbd74f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:02.578869 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-061960f5-1290-482c-b763-e82256fbd74f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1812 microversion: 2.25 time: 0.481920 Sep 24 20:57:02.580075 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1031/2061] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:02 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1812 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:57:02.668325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-96d0a408-bb74-4899-b786-1158a8de83c5 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd09a0889c44ce18f0c361c7c661465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749824e2c16946a58801200784fa0480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:02.678719 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-96d0a408-bb74-4899-b786-1158a8de83c5 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9d2c1a-53a4-4426-b01f-c286b39e7309" status: 200 len: 1313 microversion: 2.1 time: 0.289558 Sep 24 20:57:02.680434 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1031/2062] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:02 2022] GET /compute/v2.1/servers/dd9d2c1a-53a4-4426-b01f-c286b39e7309 => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:03.416345 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-677cc824-d566-44ae-987c-a95f8c6d64c9 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:03.417868 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-677cc824-d566-44ae-987c-a95f8c6d64c9 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:03.430107 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-677cc824-d566-44ae-987c-a95f8c6d64c9 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:03.431142 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-677cc824-d566-44ae-987c-a95f8c6d64c9 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:03.432255 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-677cc824-d566-44ae-987c-a95f8c6d64c9 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:03.434941 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-677cc824-d566-44ae-987c-a95f8c6d64c9 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:03.435786 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-677cc824-d566-44ae-987c-a95f8c6d64c9 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:03.436460 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-677cc824-d566-44ae-987c-a95f8c6d64c9 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:03.556871 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-677cc824-d566-44ae-987c-a95f8c6d64c9 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:03.566851 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-677cc824-d566-44ae-987c-a95f8c6d64c9 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1183 microversion: 2.1 time: 0.157852 Sep 24 20:57:03.583764 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1032/2063] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:03 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:03.605681 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7e5821a6-9d3b-4bc7-9545-ba1323716aed tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:03.607090 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7e5821a6-9d3b-4bc7-9545-ba1323716aed tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:03.616024 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7e5821a6-9d3b-4bc7-9545-ba1323716aed tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:03.619527 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7e5821a6-9d3b-4bc7-9545-ba1323716aed tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:03.620844 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7e5821a6-9d3b-4bc7-9545-ba1323716aed tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:03.622594 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7e5821a6-9d3b-4bc7-9545-ba1323716aed tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:03.624717 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7e5821a6-9d3b-4bc7-9545-ba1323716aed tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:03.625637 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7e5821a6-9d3b-4bc7-9545-ba1323716aed tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:03.702943 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-16bc66c7-46bb-46ff-a8c7-9abe0c8f41e7 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:03.703563 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-16bc66c7-46bb-46ff-a8c7-9abe0c8f41e7 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] [instance: dd9d2c1a-53a4-4426-b01f-c286b39e7309] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:03.713548 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-16bc66c7-46bb-46ff-a8c7-9abe0c8f41e7 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:03.717648 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-16bc66c7-46bb-46ff-a8c7-9abe0c8f41e7 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:03.719098 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-16bc66c7-46bb-46ff-a8c7-9abe0c8f41e7 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:03.722359 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-16bc66c7-46bb-46ff-a8c7-9abe0c8f41e7 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:03.723236 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-16bc66c7-46bb-46ff-a8c7-9abe0c8f41e7 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:03.725035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-16bc66c7-46bb-46ff-a8c7-9abe0c8f41e7 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:04.037490 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7e5821a6-9d3b-4bc7-9545-ba1323716aed tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:04.048288 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7e5821a6-9d3b-4bc7-9545-ba1323716aed tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:04.050059 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7e5821a6-9d3b-4bc7-9545-ba1323716aed tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:04.051968 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7e5821a6-9d3b-4bc7-9545-ba1323716aed tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1812 microversion: 2.25 time: 0.450615 Sep 24 20:57:04.052982 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1032/2064] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:03 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1812 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:57:04.120022 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-16bc66c7-46bb-46ff-a8c7-9abe0c8f41e7 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd09a0889c44ce18f0c361c7c661465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749824e2c16946a58801200784fa0480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:04.131926 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-16bc66c7-46bb-46ff-a8c7-9abe0c8f41e7 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9d2c1a-53a4-4426-b01f-c286b39e7309" status: 200 len: 1463 microversion: 2.1 time: 0.432961 Sep 24 20:57:04.134759 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1033/2065] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:03 2022] GET /compute/v2.1/servers/dd9d2c1a-53a4-4426-b01f-c286b39e7309 => generated 1463 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:04.363537 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-13905153-6492-4f99-ae73-2ae679aad342 tempest-TenantUsagesTestJSON-281600230 tempest-TenantUsagesTestJSON-281600230-project-admin] Calling method '.version_select at 0x7f4b0c97b4c0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:04.373668 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-13905153-6492-4f99-ae73-2ae679aad342 tempest-TenantUsagesTestJSON-281600230 tempest-TenantUsagesTestJSON-281600230-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:04.374415 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-13905153-6492-4f99-ae73-2ae679aad342 tempest-TenantUsagesTestJSON-281600230 tempest-TenantUsagesTestJSON-281600230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:04.374890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-13905153-6492-4f99-ae73-2ae679aad342 tempest-TenantUsagesTestJSON-281600230 tempest-TenantUsagesTestJSON-281600230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:04.392217 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-13905153-6492-4f99-ae73-2ae679aad342 tempest-TenantUsagesTestJSON-281600230 tempest-TenantUsagesTestJSON-281600230-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:04.392706 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-13905153-6492-4f99-ae73-2ae679aad342 tempest-TenantUsagesTestJSON-281600230 tempest-TenantUsagesTestJSON-281600230-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:04.393195 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-13905153-6492-4f99-ae73-2ae679aad342 tempest-TenantUsagesTestJSON-281600230 tempest-TenantUsagesTestJSON-281600230-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:04.412568 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-13905153-6492-4f99-ae73-2ae679aad342 tempest-TenantUsagesTestJSON-281600230 tempest-TenantUsagesTestJSON-281600230-project-admin] 10.222.0.52 "GET /compute/v2.1/os-simple-tenant-usage/749824e2c16946a58801200784fa0480?start=2022-09-23T20%3A57%3A04.148844&end=2022-09-25T20%3A57%3A04.148844" status: 200 len: 694 microversion: 2.1 time: 0.259372 Sep 24 20:57:04.413456 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1033/2066] 10.222.0.52 () {58 vars in 1412 bytes} [Sat Sep 24 20:57:04 2022] GET /compute/v2.1/os-simple-tenant-usage/749824e2c16946a58801200784fa0480?start=2022-09-23T20%3A57%3A04.148844&end=2022-09-25T20%3A57%3A04.148844 => generated 694 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:57:04.429682 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3009136c-e1e3-4952-9faf-82788e7334c3 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Calling method '.version_select at 0x7f4b0d17b4c0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:04.443469 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3009136c-e1e3-4952-9faf-82788e7334c3 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:04.444242 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3009136c-e1e3-4952-9faf-82788e7334c3 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:04.444858 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3009136c-e1e3-4952-9faf-82788e7334c3 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:04.468298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3009136c-e1e3-4952-9faf-82788e7334c3 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:04.468797 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3009136c-e1e3-4952-9faf-82788e7334c3 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:04.469242 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3009136c-e1e3-4952-9faf-82788e7334c3 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:04.489379 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3009136c-e1e3-4952-9faf-82788e7334c3 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] 10.222.0.52 "GET /compute/v2.1/os-simple-tenant-usage/749824e2c16946a58801200784fa0480?start=2022-09-23T20%3A57%3A04.148844&end=2022-09-25T20%3A57%3A04.148844" status: 200 len: 694 microversion: 2.1 time: 0.063710 Sep 24 20:57:04.489989 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1034/2067] 10.222.0.52 () {58 vars in 1412 bytes} [Sat Sep 24 20:57:04 2022] GET /compute/v2.1/os-simple-tenant-usage/749824e2c16946a58801200784fa0480?start=2022-09-23T20%3A57%3A04.148844&end=2022-09-25T20%3A57%3A04.148844 => generated 694 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:57:04.505467 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9b184089-3054-44db-b5e2-c0b43c63c4c1 tempest-TenantUsagesTestJSON-281600230 tempest-TenantUsagesTestJSON-281600230-project-admin] Calling method '.version_select at 0x7f4b11174c10>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:04.514932 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9b184089-3054-44db-b5e2-c0b43c63c4c1 tempest-TenantUsagesTestJSON-281600230 tempest-TenantUsagesTestJSON-281600230-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:04.515426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9b184089-3054-44db-b5e2-c0b43c63c4c1 tempest-TenantUsagesTestJSON-281600230 tempest-TenantUsagesTestJSON-281600230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:04.515867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9b184089-3054-44db-b5e2-c0b43c63c4c1 tempest-TenantUsagesTestJSON-281600230 tempest-TenantUsagesTestJSON-281600230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:04.534156 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9b184089-3054-44db-b5e2-c0b43c63c4c1 tempest-TenantUsagesTestJSON-281600230 tempest-TenantUsagesTestJSON-281600230-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:04.534963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9b184089-3054-44db-b5e2-c0b43c63c4c1 tempest-TenantUsagesTestJSON-281600230 tempest-TenantUsagesTestJSON-281600230-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:04.535575 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9b184089-3054-44db-b5e2-c0b43c63c4c1 tempest-TenantUsagesTestJSON-281600230 tempest-TenantUsagesTestJSON-281600230-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:04.592064 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1b0b85fa-d90b-47e9-88ac-dd76a3c5d898 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:04.593947 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1b0b85fa-d90b-47e9-88ac-dd76a3c5d898 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:04.605150 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1b0b85fa-d90b-47e9-88ac-dd76a3c5d898 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:04.605953 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1b0b85fa-d90b-47e9-88ac-dd76a3c5d898 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:04.606607 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1b0b85fa-d90b-47e9-88ac-dd76a3c5d898 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:04.607693 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1b0b85fa-d90b-47e9-88ac-dd76a3c5d898 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:04.608467 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1b0b85fa-d90b-47e9-88ac-dd76a3c5d898 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:04.609720 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1b0b85fa-d90b-47e9-88ac-dd76a3c5d898 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:04.624284 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9b184089-3054-44db-b5e2-c0b43c63c4c1 tempest-TenantUsagesTestJSON-281600230 tempest-TenantUsagesTestJSON-281600230-project-admin] 10.222.0.52 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-23T20%3A57%3A04.148844&end=2022-09-25T20%3A57%3A04.148844&detailed=1" status: 200 len: 20319 microversion: 2.1 time: 0.122446 Sep 24 20:57:04.625390 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1034/2068] 10.222.0.52 () {58 vars in 1335 bytes} [Sat Sep 24 20:57:04 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-23T20%3A57%3A04.148844&end=2022-09-25T20%3A57%3A04.148844&detailed=1 => generated 20319 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:57:04.663924 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fdf79a51-5a88-4479-bc5f-8904116a8687 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:04.664582 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fdf79a51-5a88-4479-bc5f-8904116a8687 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] [instance: dd9d2c1a-53a4-4426-b01f-c286b39e7309] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:04.677301 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fdf79a51-5a88-4479-bc5f-8904116a8687 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:04.680005 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fdf79a51-5a88-4479-bc5f-8904116a8687 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:04.680514 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fdf79a51-5a88-4479-bc5f-8904116a8687 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:04.681850 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fdf79a51-5a88-4479-bc5f-8904116a8687 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:04.686776 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fdf79a51-5a88-4479-bc5f-8904116a8687 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:04.687572 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fdf79a51-5a88-4479-bc5f-8904116a8687 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:04.727255 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fdf79a51-5a88-4479-bc5f-8904116a8687 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] [instance: dd9d2c1a-53a4-4426-b01f-c286b39e7309] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:57:04.773540 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1b0b85fa-d90b-47e9-88ac-dd76a3c5d898 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:04.782646 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1b0b85fa-d90b-47e9-88ac-dd76a3c5d898 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1183 microversion: 2.1 time: 0.196631 Sep 24 20:57:04.784453 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1035/2069] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:04 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:57:04.795892 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:57:04.883250 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fdf79a51-5a88-4479-bc5f-8904116a8687 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] 10.222.0.52 "DELETE /compute/v2.1/servers/dd9d2c1a-53a4-4426-b01f-c286b39e7309" status: 204 len: 0 microversion: 2.1 time: 0.220079 Sep 24 20:57:04.884351 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1035/2070] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:57:04 2022] DELETE /compute/v2.1/servers/dd9d2c1a-53a4-4426-b01f-c286b39e7309 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:57:04.894667 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e619fc23-d22c-4bb7-bf55-d7bf8c72d818 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:04.895293 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e619fc23-d22c-4bb7-bf55-d7bf8c72d818 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] [instance: dd9d2c1a-53a4-4426-b01f-c286b39e7309] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:04.905457 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e619fc23-d22c-4bb7-bf55-d7bf8c72d818 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:04.907807 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e619fc23-d22c-4bb7-bf55-d7bf8c72d818 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:04.908270 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e619fc23-d22c-4bb7-bf55-d7bf8c72d818 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:04.909928 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e619fc23-d22c-4bb7-bf55-d7bf8c72d818 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:04.910584 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e619fc23-d22c-4bb7-bf55-d7bf8c72d818 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:04.911032 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e619fc23-d22c-4bb7-bf55-d7bf8c72d818 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:05.079031 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6ca9119d-25fd-49da-a34e-73a4bc269a70 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:05.079740 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6ca9119d-25fd-49da-a34e-73a4bc269a70 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:05.100734 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ca9119d-25fd-49da-a34e-73a4bc269a70 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:05.107902 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ca9119d-25fd-49da-a34e-73a4bc269a70 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:05.115218 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ca9119d-25fd-49da-a34e-73a4bc269a70 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:05.115995 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ca9119d-25fd-49da-a34e-73a4bc269a70 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:05.116475 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ca9119d-25fd-49da-a34e-73a4bc269a70 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:05.116905 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ca9119d-25fd-49da-a34e-73a4bc269a70 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:05.143976 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e619fc23-d22c-4bb7-bf55-d7bf8c72d818 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd09a0889c44ce18f0c361c7c661465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749824e2c16946a58801200784fa0480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:05.157670 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e619fc23-d22c-4bb7-bf55-d7bf8c72d818 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9d2c1a-53a4-4426-b01f-c286b39e7309" status: 200 len: 1469 microversion: 2.1 time: 0.268650 Sep 24 20:57:05.176615 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1036/2071] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:04 2022] GET /compute/v2.1/servers/dd9d2c1a-53a4-4426-b01f-c286b39e7309 => generated 1469 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:05.395600 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6ca9119d-25fd-49da-a34e-73a4bc269a70 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:05.411991 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6ca9119d-25fd-49da-a34e-73a4bc269a70 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:05.416372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6ca9119d-25fd-49da-a34e-73a4bc269a70 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:05.420031 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6ca9119d-25fd-49da-a34e-73a4bc269a70 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1812 microversion: 2.25 time: 0.344471 Sep 24 20:57:05.420905 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1036/2072] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:05 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1812 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:57:05.725139 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c1df23df-2cb4-4b5f-a999-de0479858088 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b1104c430>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:05.802001 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c1df23df-2cb4-4b5f-a999-de0479858088 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/173a5f87-44b9-4bad-9ff6-e10630c83424" status: 200 len: 662 microversion: 2.1 time: 0.081749 Sep 24 20:57:05.802629 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1037/2073] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:57:05 2022] GET /compute/v2.1/images/173a5f87-44b9-4bad-9ff6-e10630c83424 => generated 662 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:57:05.818899 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0d6c448e-e327-4c5d-bc2f-733e4d2cb789 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:05.819480 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c7a1a9e3-12dc-4bea-a696-14442239742b tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b0d17bc10>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:05.820481 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0d6c448e-e327-4c5d-bc2f-733e4d2cb789 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:05.856898 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d6c448e-e327-4c5d-bc2f-733e4d2cb789 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:05.857533 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d6c448e-e327-4c5d-bc2f-733e4d2cb789 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:05.858062 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d6c448e-e327-4c5d-bc2f-733e4d2cb789 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:05.858851 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d6c448e-e327-4c5d-bc2f-733e4d2cb789 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:05.859317 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d6c448e-e327-4c5d-bc2f-733e4d2cb789 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:05.859739 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d6c448e-e327-4c5d-bc2f-733e4d2cb789 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:05.891094 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c7a1a9e3-12dc-4bea-a696-14442239742b tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/173a5f87-44b9-4bad-9ff6-e10630c83424" status: 200 len: 662 microversion: 2.1 time: 0.075528 Sep 24 20:57:05.898665 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1038/2074] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:57:05 2022] GET /compute/v2.1/images/173a5f87-44b9-4bad-9ff6-e10630c83424 => generated 662 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:57:06.018735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0d6c448e-e327-4c5d-bc2f-733e4d2cb789 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:06.038301 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0d6c448e-e327-4c5d-bc2f-733e4d2cb789 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1183 microversion: 2.1 time: 0.223569 Sep 24 20:57:06.042409 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1037/2075] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:05 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:06.185576 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-98f83153-a82c-4a03-8b0a-26ee407bd14d tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:06.186196 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-98f83153-a82c-4a03-8b0a-26ee407bd14d tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] [instance: dd9d2c1a-53a4-4426-b01f-c286b39e7309] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:06.199226 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98f83153-a82c-4a03-8b0a-26ee407bd14d tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:06.199715 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98f83153-a82c-4a03-8b0a-26ee407bd14d tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:06.206866 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98f83153-a82c-4a03-8b0a-26ee407bd14d tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:06.208793 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98f83153-a82c-4a03-8b0a-26ee407bd14d tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:06.210309 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98f83153-a82c-4a03-8b0a-26ee407bd14d tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:06.219691 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98f83153-a82c-4a03-8b0a-26ee407bd14d tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:06.451257 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fcd5d90c-2582-4de4-a987-12f0c0b8017d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:06.452177 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fcd5d90c-2582-4de4-a987-12f0c0b8017d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:06.465070 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fcd5d90c-2582-4de4-a987-12f0c0b8017d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:06.465750 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fcd5d90c-2582-4de4-a987-12f0c0b8017d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:06.466069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fcd5d90c-2582-4de4-a987-12f0c0b8017d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:06.472321 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fcd5d90c-2582-4de4-a987-12f0c0b8017d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:06.473011 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fcd5d90c-2582-4de4-a987-12f0c0b8017d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:06.473633 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fcd5d90c-2582-4de4-a987-12f0c0b8017d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:06.505831 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-98f83153-a82c-4a03-8b0a-26ee407bd14d tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd09a0889c44ce18f0c361c7c661465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749824e2c16946a58801200784fa0480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:06.524254 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-98f83153-a82c-4a03-8b0a-26ee407bd14d tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9d2c1a-53a4-4426-b01f-c286b39e7309" status: 200 len: 1469 microversion: 2.1 time: 0.335649 Sep 24 20:57:06.525258 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1039/2076] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:06 2022] GET /compute/v2.1/servers/dd9d2c1a-53a4-4426-b01f-c286b39e7309 => generated 1469 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:06.717366 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fcd5d90c-2582-4de4-a987-12f0c0b8017d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:06.739556 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fcd5d90c-2582-4de4-a987-12f0c0b8017d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:06.741131 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fcd5d90c-2582-4de4-a987-12f0c0b8017d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:06.742378 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fcd5d90c-2582-4de4-a987-12f0c0b8017d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1812 microversion: 2.25 time: 0.295316 Sep 24 20:57:06.742978 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1038/2077] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:06 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1812 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:57:07.065282 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2892d380-2609-4e5a-a5ca-6d8a34b888e0 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:07.066118 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2892d380-2609-4e5a-a5ca-6d8a34b888e0 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:07.082596 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2892d380-2609-4e5a-a5ca-6d8a34b888e0 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:07.083392 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2892d380-2609-4e5a-a5ca-6d8a34b888e0 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:07.084024 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2892d380-2609-4e5a-a5ca-6d8a34b888e0 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:07.084958 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2892d380-2609-4e5a-a5ca-6d8a34b888e0 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:07.085592 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2892d380-2609-4e5a-a5ca-6d8a34b888e0 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:07.086195 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2892d380-2609-4e5a-a5ca-6d8a34b888e0 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:07.190212 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2892d380-2609-4e5a-a5ca-6d8a34b888e0 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:07.198618 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2892d380-2609-4e5a-a5ca-6d8a34b888e0 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1183 microversion: 2.1 time: 0.137200 Sep 24 20:57:07.199530 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1040/2078] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:07 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:07.461506 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-eb5a3a04-bbe3-4b53-891d-fcf43d9c7faa tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b10fba310>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:07.526617 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-eb5a3a04-bbe3-4b53-891d-fcf43d9c7faa tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/6c222011-a7e6-4ffa-843f-508ef2b07e9c" status: 200 len: 662 microversion: 2.1 time: 0.066614 Sep 24 20:57:07.527259 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1039/2079] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:57:07 2022] GET /compute/v2.1/images/6c222011-a7e6-4ffa-843f-508ef2b07e9c => generated 662 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:57:07.548163 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-580626f4-9244-4574-a824-8fbb28f32295 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b1109edc0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:07.577211 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-042c9cb1-c840-422f-949d-9f89c6440696 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:07.599969 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-042c9cb1-c840-422f-949d-9f89c6440696 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] [instance: dd9d2c1a-53a4-4426-b01f-c286b39e7309] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:07.615365 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-042c9cb1-c840-422f-949d-9f89c6440696 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:07.645051 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-042c9cb1-c840-422f-949d-9f89c6440696 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:07.645305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-042c9cb1-c840-422f-949d-9f89c6440696 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:07.646099 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-042c9cb1-c840-422f-949d-9f89c6440696 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:07.646613 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-042c9cb1-c840-422f-949d-9f89c6440696 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:07.647054 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-042c9cb1-c840-422f-949d-9f89c6440696 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:07.663153 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-580626f4-9244-4574-a824-8fbb28f32295 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/6c222011-a7e6-4ffa-843f-508ef2b07e9c" status: 200 len: 662 microversion: 2.1 time: 0.123512 Sep 24 20:57:07.673865 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1041/2080] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:57:07 2022] GET /compute/v2.1/images/6c222011-a7e6-4ffa-843f-508ef2b07e9c => generated 662 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:57:07.773270 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5f70cf1a-dc43-4ac7-8ee9-2c6f18c3c63d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:07.774005 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5f70cf1a-dc43-4ac7-8ee9-2c6f18c3c63d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:07.786270 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-042c9cb1-c840-422f-949d-9f89c6440696 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd09a0889c44ce18f0c361c7c661465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749824e2c16946a58801200784fa0480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:07.813753 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f70cf1a-dc43-4ac7-8ee9-2c6f18c3c63d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:07.817119 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f70cf1a-dc43-4ac7-8ee9-2c6f18c3c63d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:07.826101 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f70cf1a-dc43-4ac7-8ee9-2c6f18c3c63d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:07.844436 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-042c9cb1-c840-422f-949d-9f89c6440696 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9d2c1a-53a4-4426-b01f-c286b39e7309" status: 200 len: 1427 microversion: 2.1 time: 0.275787 Sep 24 20:57:07.845655 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f70cf1a-dc43-4ac7-8ee9-2c6f18c3c63d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:07.850613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f70cf1a-dc43-4ac7-8ee9-2c6f18c3c63d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:07.852037 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f70cf1a-dc43-4ac7-8ee9-2c6f18c3c63d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:07.853584 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1040/2081] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:07 2022] GET /compute/v2.1/servers/dd9d2c1a-53a4-4426-b01f-c286b39e7309 => generated 1427 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:07.868233 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-c1bcbe2d-c965-4854-b368-67d954345c08 req-43a89c28-22a0-42d2-8ce9-66b309caae71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd9d2c1a-53a4-4426-b01f-c286b39e7309", "name": "network-vif-deleted", "tag": "1312138d-ee19-4b9c-baeb-9be04e956496"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:57:07.908264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c1bcbe2d-c965-4854-b368-67d954345c08 req-43a89c28-22a0-42d2-8ce9-66b309caae71 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:07.912305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c1bcbe2d-c965-4854-b368-67d954345c08 req-43a89c28-22a0-42d2-8ce9-66b309caae71 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:07.912935 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c1bcbe2d-c965-4854-b368-67d954345c08 req-43a89c28-22a0-42d2-8ce9-66b309caae71 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:07.962693 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-c1bcbe2d-c965-4854-b368-67d954345c08 req-43a89c28-22a0-42d2-8ce9-66b309caae71 service nova] Creating event network-vif-deleted:1312138d-ee19-4b9c-baeb-9be04e956496 for instance dd9d2c1a-53a4-4426-b01f-c286b39e7309 on nch2-master-1 Sep 24 20:57:07.977703 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-c1bcbe2d-c965-4854-b368-67d954345c08 req-43a89c28-22a0-42d2-8ce9-66b309caae71 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119354 Sep 24 20:57:07.980626 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1041/2082] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:57:08.226660 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c264503a-38d1-4207-9cbd-8ec38b3d5bcc tempest-ServersTestBootFromVolume-1605240856 tempest-ServersTestBootFromVolume-1605240856-project] Calling method '.version_select at 0x7f4b11174c10>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:08.270644 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c264503a-38d1-4207-9cbd-8ec38b3d5bcc tempest-ServersTestBootFromVolume-1605240856 tempest-ServersTestBootFromVolume-1605240856-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-806207515" status: 202 len: 0 microversion: 2.1 time: 0.058151 Sep 24 20:57:08.278731 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1042/2083] 10.222.0.52 () {58 vars in 1218 bytes} [Sat Sep 24 20:57:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-806207515 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:57:08.297402 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fc39eb02-9911-47ea-abc8-47f9660bd976 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:08.298363 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fc39eb02-9911-47ea-abc8-47f9660bd976 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:08.303581 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5f70cf1a-dc43-4ac7-8ee9-2c6f18c3c63d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:08.318284 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5f70cf1a-dc43-4ac7-8ee9-2c6f18c3c63d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:08.318475 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fc39eb02-9911-47ea-abc8-47f9660bd976 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:08.318971 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fc39eb02-9911-47ea-abc8-47f9660bd976 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:08.319618 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fc39eb02-9911-47ea-abc8-47f9660bd976 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:08.321394 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5f70cf1a-dc43-4ac7-8ee9-2c6f18c3c63d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:08.321658 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fc39eb02-9911-47ea-abc8-47f9660bd976 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:08.322300 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fc39eb02-9911-47ea-abc8-47f9660bd976 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:08.323310 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fc39eb02-9911-47ea-abc8-47f9660bd976 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:08.328424 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5f70cf1a-dc43-4ac7-8ee9-2c6f18c3c63d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1812 microversion: 2.25 time: 0.561492 Sep 24 20:57:08.332035 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1042/2084] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:07 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1812 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:57:08.544989 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fc39eb02-9911-47ea-abc8-47f9660bd976 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:08.554374 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fc39eb02-9911-47ea-abc8-47f9660bd976 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1183 microversion: 2.1 time: 0.272915 Sep 24 20:57:08.560362 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1043/2085] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:08 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1183 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:08.876609 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3685b236-e4a0-4b88-8aae-9efe08bfcbbf tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:08.877748 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3685b236-e4a0-4b88-8aae-9efe08bfcbbf tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] [instance: dd9d2c1a-53a4-4426-b01f-c286b39e7309] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:08.889326 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=8 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:57:08.891872 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3685b236-e4a0-4b88-8aae-9efe08bfcbbf tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:08.892783 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3685b236-e4a0-4b88-8aae-9efe08bfcbbf tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:08.893917 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3685b236-e4a0-4b88-8aae-9efe08bfcbbf tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:08.895023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3685b236-e4a0-4b88-8aae-9efe08bfcbbf tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:08.895724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3685b236-e4a0-4b88-8aae-9efe08bfcbbf tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:08.896402 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3685b236-e4a0-4b88-8aae-9efe08bfcbbf tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:08.964588 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3685b236-e4a0-4b88-8aae-9efe08bfcbbf tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:08.966256 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3685b236-e4a0-4b88-8aae-9efe08bfcbbf tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:08.967643 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3685b236-e4a0-4b88-8aae-9efe08bfcbbf tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:08.968667 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-3685b236-e4a0-4b88-8aae-9efe08bfcbbf tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lazy-loading 'fault' on Instance uuid dd9d2c1a-53a4-4426-b01f-c286b39e7309 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:57:09.090661 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3685b236-e4a0-4b88-8aae-9efe08bfcbbf tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd09a0889c44ce18f0c361c7c661465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749824e2c16946a58801200784fa0480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:09.102473 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3685b236-e4a0-4b88-8aae-9efe08bfcbbf tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9d2c1a-53a4-4426-b01f-c286b39e7309" status: 200 len: 1303 microversion: 2.1 time: 0.231233 Sep 24 20:57:09.108268 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1043/2086] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:08 2022] GET /compute/v2.1/servers/dd9d2c1a-53a4-4426-b01f-c286b39e7309 => generated 1303 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:09.209158 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=47 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:57:09.359276 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8a3f4b36-9ba3-4146-8253-961a09c0e0c5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:09.360429 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8a3f4b36-9ba3-4146-8253-961a09c0e0c5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:09.368179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3a0ee83b-9dae-4725-9f37-e38070b45044 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-724150107", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "c3fe033e-a853-47c0-8dd9-92a3555eaf6b"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:57:09.369601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8a3f4b36-9ba3-4146-8253-961a09c0e0c5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:09.370633 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8a3f4b36-9ba3-4146-8253-961a09c0e0c5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:09.370877 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8a3f4b36-9ba3-4146-8253-961a09c0e0c5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:09.371971 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8a3f4b36-9ba3-4146-8253-961a09c0e0c5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:09.372605 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8a3f4b36-9ba3-4146-8253-961a09c0e0c5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:09.373222 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8a3f4b36-9ba3-4146-8253-961a09c0e0c5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:09.402085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:57:09.537046 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-3a0ee83b-9dae-4725-9f37-e38070b45044 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] validate_networks() for [('c3fe033e-a853-47c0-8dd9-92a3555eaf6b', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:57:09.561543 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8a3f4b36-9ba3-4146-8253-961a09c0e0c5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:09.576812 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8a3f4b36-9ba3-4146-8253-961a09c0e0c5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:09.578297 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8a3f4b36-9ba3-4146-8253-961a09c0e0c5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:09.584124 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8a3f4b36-9ba3-4146-8253-961a09c0e0c5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1812 microversion: 2.25 time: 0.228740 Sep 24 20:57:09.584946 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1044/2087] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:09 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1812 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:57:09.597913 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c08824f8-a86c-4012-9b6c-1b9ca9a04ecc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:09.600562 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c08824f8-a86c-4012-9b6c-1b9ca9a04ecc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:09.616730 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c08824f8-a86c-4012-9b6c-1b9ca9a04ecc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:09.617233 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c08824f8-a86c-4012-9b6c-1b9ca9a04ecc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:09.617682 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c08824f8-a86c-4012-9b6c-1b9ca9a04ecc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:09.618960 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c08824f8-a86c-4012-9b6c-1b9ca9a04ecc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:09.618960 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c08824f8-a86c-4012-9b6c-1b9ca9a04ecc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:09.619318 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c08824f8-a86c-4012-9b6c-1b9ca9a04ecc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:09.827751 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c08824f8-a86c-4012-9b6c-1b9ca9a04ecc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:09.839975 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c08824f8-a86c-4012-9b6c-1b9ca9a04ecc tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 200 len: 1183 microversion: 2.1 time: 0.252535 Sep 24 20:57:09.840897 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1045/2088] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:09 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 1183 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:09.860074 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f73f17de-fc6e-492e-8d03-637af086c96e tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b0c910430>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:09.962302 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f73f17de-fc6e-492e-8d03-637af086c96e tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/4b6570b7-782e-4bac-a623-bbaa00593a58" status: 200 len: 661 microversion: 2.1 time: 0.116110 Sep 24 20:57:09.963554 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1046/2089] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:57:09 2022] GET /compute/v2.1/images/4b6570b7-782e-4bac-a623-bbaa00593a58 => generated 661 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:57:09.979189 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1e6e39fa-5806-4cff-aaba-8f4c445d7daf tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b0cb29f70>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:10.054290 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1e6e39fa-5806-4cff-aaba-8f4c445d7daf tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/4b6570b7-782e-4bac-a623-bbaa00593a58" status: 200 len: 661 microversion: 2.1 time: 0.080479 Sep 24 20:57:10.055602 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1047/2090] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:57:09 2022] GET /compute/v2.1/images/4b6570b7-782e-4bac-a623-bbaa00593a58 => generated 661 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:57:10.141205 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f3ea5962-3c29-4d75-b606-77b1e672af31 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:10.143930 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f3ea5962-3c29-4d75-b606-77b1e672af31 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] [instance: dd9d2c1a-53a4-4426-b01f-c286b39e7309] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:10.166018 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3ea5962-3c29-4d75-b606-77b1e672af31 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:10.166769 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3ea5962-3c29-4d75-b606-77b1e672af31 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:10.167848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3ea5962-3c29-4d75-b606-77b1e672af31 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:10.169509 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3ea5962-3c29-4d75-b606-77b1e672af31 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:10.170407 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3ea5962-3c29-4d75-b606-77b1e672af31 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:10.172522 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3ea5962-3c29-4d75-b606-77b1e672af31 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:10.196744 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-f3ea5962-3c29-4d75-b606-77b1e672af31 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] HTTP exception thrown: Instance dd9d2c1a-53a4-4426-b01f-c286b39e7309 could not be found. Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f3ea5962-3c29-4d75-b606-77b1e672af31 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Request method failure captured: Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/dd9d2c1a-53a4-4426-b01f-c286b39e7309 HTTP/1.1 Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL28N43Wdqz9JfI7vW7058nu-55ZKiRgfidm7qE0anhJJUv4hnPN7I6N028YkvJ0Xt8_lNwR0GwV17X14nXQCoZsM_WODft3UvCdUehFXARAYk4H3-5SZGgSKtQ3Yr6wIR2qJCKBBZ6Tqe0Lebsrx1ErE83uE-JnjKNVU0CPsP4sBf-4 Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 749824e2c16946a58801200784fa0480 Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-TenantUsagesTestJSON-1927785565 Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/749824e2c16946a58801200784fa0480"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_749824e2c16946a58801200784fa0480"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/749824e2c16946a58801200784fa0480"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/749824e2c16946a58801200784fa0480"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-TenantUsagesTestJSON-1927785565 Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 749824e2c16946a58801200784fa0480 Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1927785565 Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-TenantUsagesTestJSON-1927785565-project Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 9dd09a0889c44ce18f0c361c7c661465 Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-TenantUsagesTestJSON-1927785565-project Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance dd9d2c1a-53a4-4426-b01f-c286b39e7309 could not be found. Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'dd9d2c1a-53a4-4426-b01f-c286b39e7309'} Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd9d2c1a-53a4-4426-b01f-c286b39e7309 could not be found. Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd9d2c1a-53a4-4426-b01f-c286b39e7309 could not be found. Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:57:10.199501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:57:10.206523 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:57:10.206523 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:57:10.206523 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:57:10.206523 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:57:10.206523 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:57:10.206523 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd9d2c1a-53a4-4426-b01f-c286b39e7309 could not be found. Sep 24 20:57:10.206523 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:57:10.211725 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f3ea5962-3c29-4d75-b606-77b1e672af31 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] Returning 404 to user: Instance dd9d2c1a-53a4-4426-b01f-c286b39e7309 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:57:10.213095 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f3ea5962-3c29-4d75-b606-77b1e672af31 tempest-TenantUsagesTestJSON-1927785565 tempest-TenantUsagesTestJSON-1927785565-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9d2c1a-53a4-4426-b01f-c286b39e7309" status: 404 len: 111 microversion: 2.1 time: 0.081722 Sep 24 20:57:10.214219 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1048/2091] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:10 2022] GET /compute/v2.1/servers/dd9d2c1a-53a4-4426-b01f-c286b39e7309 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:57:10.227689 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f03f3e94-0fc4-4c95-a158-b85bbd085f8f tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-876091438", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:57:10.336687 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-f03f3e94-0fc4-4c95-a158-b85bbd085f8f tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] validate_networks() for None {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:57:11.205371 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-3a0ee83b-9dae-4725-9f37-e38070b45044 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:57:11.206646 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-3a0ee83b-9dae-4725-9f37-e38070b45044 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:57:11.207467 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-3a0ee83b-9dae-4725-9f37-e38070b45044 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:57:11.208650 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-3a0ee83b-9dae-4725-9f37-e38070b45044 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:57:11.209280 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-3a0ee83b-9dae-4725-9f37-e38070b45044 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:57:11.239750 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3a0ee83b-9dae-4725-9f37-e38070b45044 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:11.242386 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3a0ee83b-9dae-4725-9f37-e38070b45044 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:11.243043 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3a0ee83b-9dae-4725-9f37-e38070b45044 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:11.247687 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3a0ee83b-9dae-4725-9f37-e38070b45044 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:11.248302 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3a0ee83b-9dae-4725-9f37-e38070b45044 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:11.248864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3a0ee83b-9dae-4725-9f37-e38070b45044 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:11.268315 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-f03f3e94-0fc4-4c95-a158-b85bbd085f8f tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:57:11.269014 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-f03f3e94-0fc4-4c95-a158-b85bbd085f8f tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:57:11.269609 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-f03f3e94-0fc4-4c95-a158-b85bbd085f8f tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:57:11.270365 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-f03f3e94-0fc4-4c95-a158-b85bbd085f8f tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:57:11.270816 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-f03f3e94-0fc4-4c95-a158-b85bbd085f8f tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:57:11.282405 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f03f3e94-0fc4-4c95-a158-b85bbd085f8f tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:11.283121 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f03f3e94-0fc4-4c95-a158-b85bbd085f8f tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:11.284062 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f03f3e94-0fc4-4c95-a158-b85bbd085f8f tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:11.285321 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f03f3e94-0fc4-4c95-a158-b85bbd085f8f tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:11.285966 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f03f3e94-0fc4-4c95-a158-b85bbd085f8f tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:11.286600 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f03f3e94-0fc4-4c95-a158-b85bbd085f8f tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:11.300021 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-3a0ee83b-9dae-4725-9f37-e38070b45044 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Getting quotas for project 7588851b153c4c0dbc7e63cfa1778497. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:57:11.312830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-3a0ee83b-9dae-4725-9f37-e38070b45044 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Getting quotas for user 2f062663eef74d63aea291eaa5f213a4 and project 7588851b153c4c0dbc7e63cfa1778497. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:57:11.320121 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-f03f3e94-0fc4-4c95-a158-b85bbd085f8f tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Getting quotas for project 265d7d88bb6f45708203ea74df8f3214. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:57:11.327117 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-f03f3e94-0fc4-4c95-a158-b85bbd085f8f tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Getting quotas for user 00585dbe7f814eeebda43417ca1d0ffa and project 265d7d88bb6f45708203ea74df8f3214. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:57:11.329865 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3a0ee83b-9dae-4725-9f37-e38070b45044 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:57:11.332576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3a0ee83b-9dae-4725-9f37-e38070b45044 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] [instance: 1c99e77a-8bb1-4e77-ab94-c560f7d88a28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:57:11.344143 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f03f3e94-0fc4-4c95-a158-b85bbd085f8f tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:57:11.347364 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f03f3e94-0fc4-4c95-a158-b85bbd085f8f tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:57:11.420589 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3a0ee83b-9dae-4725-9f37-e38070b45044 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.222475 Sep 24 20:57:11.425847 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1044/2092] 10.222.0.52 () {62 vars in 1188 bytes} [Sat Sep 24 20:57:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2228 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 24 20:57:11.428576 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f03f3e94-0fc4-4c95-a158-b85bbd085f8f tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.212075 Sep 24 20:57:11.430779 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1049/2093] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:57:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:57:11.444522 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-df159042-33d5-42ec-886b-9b9bff68ca7a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:11.474726 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-df159042-33d5-42ec-886b-9b9bff68ca7a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:11.524433 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df159042-33d5-42ec-886b-9b9bff68ca7a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:11.524927 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df159042-33d5-42ec-886b-9b9bff68ca7a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:11.529652 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df159042-33d5-42ec-886b-9b9bff68ca7a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:11.532010 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df159042-33d5-42ec-886b-9b9bff68ca7a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:11.539799 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df159042-33d5-42ec-886b-9b9bff68ca7a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:11.540543 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df159042-33d5-42ec-886b-9b9bff68ca7a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:11.575516 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-df159042-33d5-42ec-886b-9b9bff68ca7a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] HTTP exception thrown: Instance 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea could not be found. Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-df159042-33d5-42ec-886b-9b9bff68ca7a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Request method failure captured: Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea HTTP/1.1 Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL22W-8wZmyHhPjnmqLAwGZ3mX4nIMGVBzhRCcf9yRpemeS-L-pQ-_V_nLRjxEZ-SLdpjyfDdbYT96U23uVeSrC_JfW-OZR0uiU2rIQ8b6jXauuTn3n6xaPicq5KAr5G3eZ5iymZw3vDvTM33hRL8Wt9H_E_Hy02-3xbdiMvDSMvifHM Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: a2b7e30f79bf42e497c53c091ad0a106 Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-LiveMigrationTest-471200620 Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a2b7e30f79bf42e497c53c091ad0a106"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a2b7e30f79bf42e497c53c091ad0a106"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a2b7e30f79bf42e497c53c091ad0a106"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a2b7e30f79bf42e497c53c091ad0a106"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-LiveMigrationTest-471200620 Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: a2b7e30f79bf42e497c53c091ad0a106 Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-LiveMigrationTest-471200620 Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-LiveMigrationTest-471200620-project Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 9c03c67e0c4c4de7a186f28ac10d0b92 Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-LiveMigrationTest-471200620-project Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea could not be found. Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '5eeb37e4-c327-4c29-a1a9-ae517e3e55ea'} Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea could not be found. Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea could not be found. Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:57:11.577550 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:57:11.583872 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:57:11.583872 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:57:11.583872 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:57:11.583872 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:57:11.583872 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:57:11.583872 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea could not be found. Sep 24 20:57:11.583872 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:57:11.587533 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-df159042-33d5-42ec-886b-9b9bff68ca7a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Returning 404 to user: Instance 5eeb37e4-c327-4c29-a1a9-ae517e3e55ea could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:57:11.591065 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-df159042-33d5-42ec-886b-9b9bff68ca7a tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea" status: 404 len: 111 microversion: 2.1 time: 0.158037 Sep 24 20:57:11.591824 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1050/2094] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:11 2022] GET /compute/v2.1/servers/5eeb37e4-c327-4c29-a1a9-ae517e3e55ea => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:57:11.616817 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e2677da4-71e7-4f2a-8973-ac332bc825f0 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:11.618901 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e2677da4-71e7-4f2a-8973-ac332bc825f0 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] [instance: 1c99e77a-8bb1-4e77-ab94-c560f7d88a28] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:11.771095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e2677da4-71e7-4f2a-8973-ac332bc825f0 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:11.791019 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e2677da4-71e7-4f2a-8973-ac332bc825f0 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:11.794273 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e2677da4-71e7-4f2a-8973-ac332bc825f0 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:11.801066 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e2677da4-71e7-4f2a-8973-ac332bc825f0 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] 10.222.0.52 "GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28" status: 200 len: 1258 microversion: 2.21 time: 0.202042 Sep 24 20:57:11.803409 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1051/2095] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:11 2022] GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28 => generated 1258 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:57:11.812484 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-184a51fa-bede-47f3-8726-d888eb3926b0 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-2085912966", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:57:11.945266 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-84de2898-6511-4e85-b3a5-d5c0b4a7131a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:11.945853 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-84de2898-6511-4e85-b3a5-d5c0b4a7131a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:11.953195 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-184a51fa-bede-47f3-8726-d888eb3926b0 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] validate_networks() for None {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:57:11.960496 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-84de2898-6511-4e85-b3a5-d5c0b4a7131a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:11.961014 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-84de2898-6511-4e85-b3a5-d5c0b4a7131a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:11.968377 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-84de2898-6511-4e85-b3a5-d5c0b4a7131a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:11.969254 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-84de2898-6511-4e85-b3a5-d5c0b4a7131a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:11.970227 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-84de2898-6511-4e85-b3a5-d5c0b4a7131a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:11.970717 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-84de2898-6511-4e85-b3a5-d5c0b4a7131a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:12.586984 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-184a51fa-bede-47f3-8726-d888eb3926b0 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:57:12.587778 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-184a51fa-bede-47f3-8726-d888eb3926b0 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:57:12.588362 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-184a51fa-bede-47f3-8726-d888eb3926b0 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:57:12.589035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-184a51fa-bede-47f3-8726-d888eb3926b0 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:57:12.589805 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-184a51fa-bede-47f3-8726-d888eb3926b0 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:57:12.607173 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-84de2898-6511-4e85-b3a5-d5c0b4a7131a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:12.623655 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-84de2898-6511-4e85-b3a5-d5c0b4a7131a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:12.631086 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-184a51fa-bede-47f3-8726-d888eb3926b0 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:12.635899 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-84de2898-6511-4e85-b3a5-d5c0b4a7131a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:12.639778 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-184a51fa-bede-47f3-8726-d888eb3926b0 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:12.641210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-184a51fa-bede-47f3-8726-d888eb3926b0 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:12.644506 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-84de2898-6511-4e85-b3a5-d5c0b4a7131a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1812 microversion: 2.25 time: 1.217526 Sep 24 20:57:12.645623 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-184a51fa-bede-47f3-8726-d888eb3926b0 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:12.648926 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-184a51fa-bede-47f3-8726-d888eb3926b0 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:12.649732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-184a51fa-bede-47f3-8726-d888eb3926b0 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:12.653872 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1045/2096] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:11 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1812 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:57:12.724696 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-184a51fa-bede-47f3-8726-d888eb3926b0 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Getting quotas for project 265d7d88bb6f45708203ea74df8f3214. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:57:12.743426 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-184a51fa-bede-47f3-8726-d888eb3926b0 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Getting quotas for user 00585dbe7f814eeebda43417ca1d0ffa and project 265d7d88bb6f45708203ea74df8f3214. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:57:12.782274 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-184a51fa-bede-47f3-8726-d888eb3926b0 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:57:12.788394 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-184a51fa-bede-47f3-8726-d888eb3926b0 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 8f800d64-00f6-4135-8090-c95d84acd232] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:57:12.831300 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-324cffb0-d8f3-4a27-8167-9de0eb76290d tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:12.831944 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-324cffb0-d8f3-4a27-8167-9de0eb76290d tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] [instance: 1c99e77a-8bb1-4e77-ab94-c560f7d88a28] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:12.957764 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-184a51fa-bede-47f3-8726-d888eb3926b0 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.151814 Sep 24 20:57:12.962275 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1052/2097] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:57:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:57:12.977857 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f9376d9c-e67d-4255-81ba-9bfb65445da2 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:12.980796 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f9376d9c-e67d-4255-81ba-9bfb65445da2 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:13.001075 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f9376d9c-e67d-4255-81ba-9bfb65445da2 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:13.002425 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f9376d9c-e67d-4255-81ba-9bfb65445da2 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:13.003151 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f9376d9c-e67d-4255-81ba-9bfb65445da2 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:13.004230 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f9376d9c-e67d-4255-81ba-9bfb65445da2 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:13.004943 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f9376d9c-e67d-4255-81ba-9bfb65445da2 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:13.018328 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f9376d9c-e67d-4255-81ba-9bfb65445da2 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:13.063444 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-324cffb0-d8f3-4a27-8167-9de0eb76290d tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:13.076361 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-324cffb0-d8f3-4a27-8167-9de0eb76290d tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:13.092693 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f9376d9c-e67d-4255-81ba-9bfb65445da2 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:57:13.105061 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-324cffb0-d8f3-4a27-8167-9de0eb76290d tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:13.110027 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-324cffb0-d8f3-4a27-8167-9de0eb76290d tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] 10.222.0.52 "GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28" status: 200 len: 1258 microversion: 2.21 time: 0.283399 Sep 24 20:57:13.116114 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1046/2098] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:12 2022] GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28 => generated 1258 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:57:13.147386 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a08dcf0d-0db0-4a75-a701-e044003dbbd7 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:13.151509 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a08dcf0d-0db0-4a75-a701-e044003dbbd7 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 8f800d64-00f6-4135-8090-c95d84acd232] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:13.276527 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f9376d9c-e67d-4255-81ba-9bfb65445da2 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 204 len: 0 microversion: 2.1 time: 0.309280 Sep 24 20:57:13.278015 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1053/2099] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:57:12 2022] DELETE /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:57:13.293342 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-584e13af-4ac0-4cb6-b7c1-35d24d1cb294 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:13.296073 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-584e13af-4ac0-4cb6-b7c1-35d24d1cb294 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:13.312247 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-584e13af-4ac0-4cb6-b7c1-35d24d1cb294 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:13.313322 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-584e13af-4ac0-4cb6-b7c1-35d24d1cb294 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:13.315649 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-584e13af-4ac0-4cb6-b7c1-35d24d1cb294 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:13.317023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-584e13af-4ac0-4cb6-b7c1-35d24d1cb294 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:13.320782 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-584e13af-4ac0-4cb6-b7c1-35d24d1cb294 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:13.321638 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-584e13af-4ac0-4cb6-b7c1-35d24d1cb294 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:13.369346 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a08dcf0d-0db0-4a75-a701-e044003dbbd7 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00585dbe7f814eeebda43417ca1d0ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265d7d88bb6f45708203ea74df8f3214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:13.385658 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a08dcf0d-0db0-4a75-a701-e044003dbbd7 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232" status: 200 len: 1218 microversion: 2.1 time: 0.268381 Sep 24 20:57:13.399463 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1047/2100] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:13 2022] GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232 => generated 1218 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:13.421587 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-541d5641-3a2f-4a88-8b65-58f27d5a2ea4 req-13f8dbca-17b2-4e34-a6f2-464141b91c38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54ec06be-cb4b-4b5f-9ed8-904a328cc118", "name": "network-vif-unplugged", "status": "completed", "tag": "f450a593-c9dc-4f8e-8acb-60edeb836cea"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:57:13.458166 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-541d5641-3a2f-4a88-8b65-58f27d5a2ea4 req-13f8dbca-17b2-4e34-a6f2-464141b91c38 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:13.458693 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-541d5641-3a2f-4a88-8b65-58f27d5a2ea4 req-13f8dbca-17b2-4e34-a6f2-464141b91c38 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:13.459132 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-541d5641-3a2f-4a88-8b65-58f27d5a2ea4 req-13f8dbca-17b2-4e34-a6f2-464141b91c38 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:13.500144 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-541d5641-3a2f-4a88-8b65-58f27d5a2ea4 req-13f8dbca-17b2-4e34-a6f2-464141b91c38 service nova] Creating event network-vif-unplugged:f450a593-c9dc-4f8e-8acb-60edeb836cea for instance 54ec06be-cb4b-4b5f-9ed8-904a328cc118 on nch1-master-1 Sep 24 20:57:13.512776 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-541d5641-3a2f-4a88-8b65-58f27d5a2ea4 req-13f8dbca-17b2-4e34-a6f2-464141b91c38 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110001 Sep 24 20:57:13.522490 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1048/2101] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:57:13.683152 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-33ef7145-0c37-4c91-bf3f-ce48299729bb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:13.683877 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-33ef7145-0c37-4c91-bf3f-ce48299729bb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:13.702007 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-33ef7145-0c37-4c91-bf3f-ce48299729bb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:13.702566 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-33ef7145-0c37-4c91-bf3f-ce48299729bb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:13.707892 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-33ef7145-0c37-4c91-bf3f-ce48299729bb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:13.708864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-33ef7145-0c37-4c91-bf3f-ce48299729bb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:13.709730 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-33ef7145-0c37-4c91-bf3f-ce48299729bb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:13.710196 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-33ef7145-0c37-4c91-bf3f-ce48299729bb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:13.813164 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-584e13af-4ac0-4cb6-b7c1-35d24d1cb294 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:13.831833 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-584e13af-4ac0-4cb6-b7c1-35d24d1cb294 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1665 microversion: 2.1 time: 0.548989 Sep 24 20:57:13.847168 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1054/2102] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:13 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1665 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:14.143783 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6ed0cb10-4156-4080-9177-da5a259f90c2 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:14.144732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6ed0cb10-4156-4080-9177-da5a259f90c2 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] [instance: 1c99e77a-8bb1-4e77-ab94-c560f7d88a28] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:14.156632 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ed0cb10-4156-4080-9177-da5a259f90c2 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:14.157154 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ed0cb10-4156-4080-9177-da5a259f90c2 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:14.157605 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ed0cb10-4156-4080-9177-da5a259f90c2 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:14.158368 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ed0cb10-4156-4080-9177-da5a259f90c2 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:14.158881 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ed0cb10-4156-4080-9177-da5a259f90c2 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:14.159325 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ed0cb10-4156-4080-9177-da5a259f90c2 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:14.370488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-33ef7145-0c37-4c91-bf3f-ce48299729bb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:14.394992 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-33ef7145-0c37-4c91-bf3f-ce48299729bb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:14.402998 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-33ef7145-0c37-4c91-bf3f-ce48299729bb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:14.415195 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-33ef7145-0c37-4c91-bf3f-ce48299729bb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1812 microversion: 2.25 time: 0.734340 Sep 24 20:57:14.419728 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1049/2103] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:13 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1812 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:57:14.433364 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b81d955a-5444-44fb-b0eb-dc40dc769b7e tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:14.443937 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b81d955a-5444-44fb-b0eb-dc40dc769b7e tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 8f800d64-00f6-4135-8090-c95d84acd232] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:14.461637 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6ed0cb10-4156-4080-9177-da5a259f90c2 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:14.464419 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b81d955a-5444-44fb-b0eb-dc40dc769b7e tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:14.466606 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b81d955a-5444-44fb-b0eb-dc40dc769b7e tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:14.468417 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b81d955a-5444-44fb-b0eb-dc40dc769b7e tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:14.473465 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b81d955a-5444-44fb-b0eb-dc40dc769b7e tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:14.475086 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6ed0cb10-4156-4080-9177-da5a259f90c2 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:14.475416 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b81d955a-5444-44fb-b0eb-dc40dc769b7e tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:14.477384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b81d955a-5444-44fb-b0eb-dc40dc769b7e tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:14.479487 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6ed0cb10-4156-4080-9177-da5a259f90c2 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:14.485481 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6ed0cb10-4156-4080-9177-da5a259f90c2 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] 10.222.0.52 "GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28" status: 200 len: 1254 microversion: 2.21 time: 0.345912 Sep 24 20:57:14.488032 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1055/2104] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:14 2022] GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28 => generated 1254 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:57:14.602959 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b81d955a-5444-44fb-b0eb-dc40dc769b7e tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00585dbe7f814eeebda43417ca1d0ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265d7d88bb6f45708203ea74df8f3214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:14.613654 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b81d955a-5444-44fb-b0eb-dc40dc769b7e tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232" status: 200 len: 1222 microversion: 2.1 time: 0.183549 Sep 24 20:57:14.614915 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1050/2105] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:14 2022] GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232 => generated 1222 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:14.872023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d35c27d4-352c-4bdc-92cf-783296d55d47 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:14.874255 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d35c27d4-352c-4bdc-92cf-783296d55d47 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:14.883512 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d35c27d4-352c-4bdc-92cf-783296d55d47 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:14.884461 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d35c27d4-352c-4bdc-92cf-783296d55d47 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:14.886126 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d35c27d4-352c-4bdc-92cf-783296d55d47 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:14.887100 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d35c27d4-352c-4bdc-92cf-783296d55d47 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:14.888257 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d35c27d4-352c-4bdc-92cf-783296d55d47 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:14.888993 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d35c27d4-352c-4bdc-92cf-783296d55d47 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:15.177518 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d35c27d4-352c-4bdc-92cf-783296d55d47 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:15.188376 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d35c27d4-352c-4bdc-92cf-783296d55d47 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1665 microversion: 2.1 time: 0.321890 Sep 24 20:57:15.190669 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1056/2106] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:14 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1665 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:15.451180 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7ea942f2-5166-4c5b-9c54-bc875ff88c91 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:15.451932 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7ea942f2-5166-4c5b-9c54-bc875ff88c91 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:15.464761 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ea942f2-5166-4c5b-9c54-bc875ff88c91 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:15.465575 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ea942f2-5166-4c5b-9c54-bc875ff88c91 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:15.468475 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ea942f2-5166-4c5b-9c54-bc875ff88c91 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:15.471582 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ea942f2-5166-4c5b-9c54-bc875ff88c91 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:15.472345 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ea942f2-5166-4c5b-9c54-bc875ff88c91 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:15.474386 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ea942f2-5166-4c5b-9c54-bc875ff88c91 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:15.528040 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-01fc28f8-5e9d-4a04-ac8b-cbe00be4ffa6 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:15.530031 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-01fc28f8-5e9d-4a04-ac8b-cbe00be4ffa6 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] [instance: 1c99e77a-8bb1-4e77-ab94-c560f7d88a28] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:15.555693 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01fc28f8-5e9d-4a04-ac8b-cbe00be4ffa6 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:15.556853 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01fc28f8-5e9d-4a04-ac8b-cbe00be4ffa6 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:15.557472 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01fc28f8-5e9d-4a04-ac8b-cbe00be4ffa6 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:15.558393 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01fc28f8-5e9d-4a04-ac8b-cbe00be4ffa6 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:15.559363 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01fc28f8-5e9d-4a04-ac8b-cbe00be4ffa6 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:15.561174 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01fc28f8-5e9d-4a04-ac8b-cbe00be4ffa6 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:15.836063 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-01fc28f8-5e9d-4a04-ac8b-cbe00be4ffa6 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:15.858487 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-01fc28f8-5e9d-4a04-ac8b-cbe00be4ffa6 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:15.873375 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-01fc28f8-5e9d-4a04-ac8b-cbe00be4ffa6 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:15.884807 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-01fc28f8-5e9d-4a04-ac8b-cbe00be4ffa6 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] 10.222.0.52 "GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28" status: 200 len: 1318 microversion: 2.21 time: 0.358490 Sep 24 20:57:15.888615 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1057/2107] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:15 2022] GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28 => generated 1318 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:57:15.902932 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9eab9856-0b5b-498b-9517-243957196c83 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:15.904127 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9eab9856-0b5b-498b-9517-243957196c83 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 8f800d64-00f6-4135-8090-c95d84acd232] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:15.913281 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9eab9856-0b5b-498b-9517-243957196c83 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:15.914018 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9eab9856-0b5b-498b-9517-243957196c83 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:15.914704 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9eab9856-0b5b-498b-9517-243957196c83 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:15.915651 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9eab9856-0b5b-498b-9517-243957196c83 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:15.916315 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9eab9856-0b5b-498b-9517-243957196c83 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:15.916949 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9eab9856-0b5b-498b-9517-243957196c83 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:16.142424 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9eab9856-0b5b-498b-9517-243957196c83 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00585dbe7f814eeebda43417ca1d0ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265d7d88bb6f45708203ea74df8f3214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:16.156743 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9eab9856-0b5b-498b-9517-243957196c83 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232" status: 200 len: 1270 microversion: 2.1 time: 0.265884 Sep 24 20:57:16.159405 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1058/2108] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:15 2022] GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232 => generated 1270 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:16.168144 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7ea942f2-5166-4c5b-9c54-bc875ff88c91 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:16.178460 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7ea942f2-5166-4c5b-9c54-bc875ff88c91 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:16.183749 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7ea942f2-5166-4c5b-9c54-bc875ff88c91 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:16.184983 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7ea942f2-5166-4c5b-9c54-bc875ff88c91 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1812 microversion: 2.25 time: 0.740818 Sep 24 20:57:16.185543 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1051/2109] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:15 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1812 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:57:16.215551 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e2652d13-361a-4969-81c6-0bed99b04d4b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:16.216104 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e2652d13-361a-4969-81c6-0bed99b04d4b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:16.226136 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e2652d13-361a-4969-81c6-0bed99b04d4b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:16.226685 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e2652d13-361a-4969-81c6-0bed99b04d4b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:16.227147 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e2652d13-361a-4969-81c6-0bed99b04d4b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:16.227856 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e2652d13-361a-4969-81c6-0bed99b04d4b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:16.228318 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e2652d13-361a-4969-81c6-0bed99b04d4b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:16.228753 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e2652d13-361a-4969-81c6-0bed99b04d4b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:16.569967 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-4a2e12b6-9eaa-427c-ad3b-fb5c3a967cd4 req-cfc6f381-f72e-4d40-aa6e-9a8b57d81665 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54ec06be-cb4b-4b5f-9ed8-904a328cc118", "tag": "f450a593-c9dc-4f8e-8acb-60edeb836cea"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:57:16.593619 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-4a2e12b6-9eaa-427c-ad3b-fb5c3a967cd4 req-cfc6f381-f72e-4d40-aa6e-9a8b57d81665 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:16.594409 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-4a2e12b6-9eaa-427c-ad3b-fb5c3a967cd4 req-cfc6f381-f72e-4d40-aa6e-9a8b57d81665 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:16.596672 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-4a2e12b6-9eaa-427c-ad3b-fb5c3a967cd4 req-cfc6f381-f72e-4d40-aa6e-9a8b57d81665 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:16.633573 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-4a2e12b6-9eaa-427c-ad3b-fb5c3a967cd4 req-cfc6f381-f72e-4d40-aa6e-9a8b57d81665 service nova] Creating event network-changed:f450a593-c9dc-4f8e-8acb-60edeb836cea for instance 54ec06be-cb4b-4b5f-9ed8-904a328cc118 on nch1-master-1 Sep 24 20:57:16.645591 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-4a2e12b6-9eaa-427c-ad3b-fb5c3a967cd4 req-cfc6f381-f72e-4d40-aa6e-9a8b57d81665 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082943 Sep 24 20:57:16.650189 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1052/2110] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:57:16.923755 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-34a30eef-bc2c-4669-83f7-84d4ba6425bc tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:16.926826 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-34a30eef-bc2c-4669-83f7-84d4ba6425bc tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] [instance: 1c99e77a-8bb1-4e77-ab94-c560f7d88a28] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:16.936591 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34a30eef-bc2c-4669-83f7-84d4ba6425bc tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:16.937563 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34a30eef-bc2c-4669-83f7-84d4ba6425bc tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:16.939722 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34a30eef-bc2c-4669-83f7-84d4ba6425bc tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:16.942451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34a30eef-bc2c-4669-83f7-84d4ba6425bc tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:16.943257 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34a30eef-bc2c-4669-83f7-84d4ba6425bc tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:16.944005 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34a30eef-bc2c-4669-83f7-84d4ba6425bc tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:17.148610 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-34a30eef-bc2c-4669-83f7-84d4ba6425bc tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:17.165074 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-34a30eef-bc2c-4669-83f7-84d4ba6425bc tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:17.166878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-34a30eef-bc2c-4669-83f7-84d4ba6425bc tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:17.168340 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-34a30eef-bc2c-4669-83f7-84d4ba6425bc tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] 10.222.0.52 "GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28" status: 200 len: 1316 microversion: 2.21 time: 0.252959 Sep 24 20:57:17.169383 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1053/2111] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:16 2022] GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28 => generated 1316 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:57:17.178255 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e2652d13-361a-4969-81c6-0bed99b04d4b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:17.193904 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-516121ed-30de-407e-baa6-ee2fabaccd52 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:17.194567 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-516121ed-30de-407e-baa6-ee2fabaccd52 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 8f800d64-00f6-4135-8090-c95d84acd232] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:17.217554 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e2652d13-361a-4969-81c6-0bed99b04d4b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1665 microversion: 2.1 time: 0.995152 Sep 24 20:57:17.218637 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1059/2112] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:16 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1665 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:17.219743 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-516121ed-30de-407e-baa6-ee2fabaccd52 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:17.220197 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-516121ed-30de-407e-baa6-ee2fabaccd52 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:17.220996 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-516121ed-30de-407e-baa6-ee2fabaccd52 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:17.222227 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-516121ed-30de-407e-baa6-ee2fabaccd52 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:17.222938 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-516121ed-30de-407e-baa6-ee2fabaccd52 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:17.223568 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-516121ed-30de-407e-baa6-ee2fabaccd52 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:17.229836 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d923cc61-03f2-4f90-9d4c-05c00107535d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:17.238119 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d923cc61-03f2-4f90-9d4c-05c00107535d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:17.254195 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d923cc61-03f2-4f90-9d4c-05c00107535d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:17.259366 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d923cc61-03f2-4f90-9d4c-05c00107535d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:17.264401 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d923cc61-03f2-4f90-9d4c-05c00107535d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:17.268313 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d923cc61-03f2-4f90-9d4c-05c00107535d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:17.270243 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d923cc61-03f2-4f90-9d4c-05c00107535d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:17.271154 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d923cc61-03f2-4f90-9d4c-05c00107535d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:17.428993 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-516121ed-30de-407e-baa6-ee2fabaccd52 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00585dbe7f814eeebda43417ca1d0ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265d7d88bb6f45708203ea74df8f3214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:17.438527 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-516121ed-30de-407e-baa6-ee2fabaccd52 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232" status: 200 len: 1276 microversion: 2.1 time: 0.249709 Sep 24 20:57:17.451783 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1054/2113] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:17 2022] GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232 => generated 1276 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:17.750134 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d923cc61-03f2-4f90-9d4c-05c00107535d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:17.773391 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d923cc61-03f2-4f90-9d4c-05c00107535d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:17.776294 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d923cc61-03f2-4f90-9d4c-05c00107535d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:17.778140 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d923cc61-03f2-4f90-9d4c-05c00107535d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1812 microversion: 2.25 time: 0.558123 Sep 24 20:57:17.779589 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1060/2114] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:17 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1812 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:57:18.208952 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-22eb67ab-ea34-4b68-8bc7-4fdbfd90b0c7 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:18.210259 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-22eb67ab-ea34-4b68-8bc7-4fdbfd90b0c7 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] [instance: 1c99e77a-8bb1-4e77-ab94-c560f7d88a28] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:18.217077 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22eb67ab-ea34-4b68-8bc7-4fdbfd90b0c7 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:18.217807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22eb67ab-ea34-4b68-8bc7-4fdbfd90b0c7 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:18.218415 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22eb67ab-ea34-4b68-8bc7-4fdbfd90b0c7 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:18.219172 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22eb67ab-ea34-4b68-8bc7-4fdbfd90b0c7 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:18.219628 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22eb67ab-ea34-4b68-8bc7-4fdbfd90b0c7 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:18.220055 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22eb67ab-ea34-4b68-8bc7-4fdbfd90b0c7 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:18.250392 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dfabcfef-fa91-4bab-994c-4a45c438d496 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:18.252689 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dfabcfef-fa91-4bab-994c-4a45c438d496 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:18.264569 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dfabcfef-fa91-4bab-994c-4a45c438d496 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:18.265132 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dfabcfef-fa91-4bab-994c-4a45c438d496 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:18.265825 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dfabcfef-fa91-4bab-994c-4a45c438d496 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:18.266841 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dfabcfef-fa91-4bab-994c-4a45c438d496 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:18.267497 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dfabcfef-fa91-4bab-994c-4a45c438d496 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:18.268475 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dfabcfef-fa91-4bab-994c-4a45c438d496 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:18.342006 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-22eb67ab-ea34-4b68-8bc7-4fdbfd90b0c7 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:18.356335 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-22eb67ab-ea34-4b68-8bc7-4fdbfd90b0c7 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:18.358952 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-22eb67ab-ea34-4b68-8bc7-4fdbfd90b0c7 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:18.360514 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-22eb67ab-ea34-4b68-8bc7-4fdbfd90b0c7 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] 10.222.0.52 "GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28" status: 200 len: 1316 microversion: 2.21 time: 0.156144 Sep 24 20:57:18.379502 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1055/2115] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:18 2022] GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28 => generated 1316 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:57:18.417203 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dfabcfef-fa91-4bab-994c-4a45c438d496 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:18.428041 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dfabcfef-fa91-4bab-994c-4a45c438d496 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1598 microversion: 2.1 time: 0.187966 Sep 24 20:57:18.430244 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1061/2116] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:18 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1598 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:18.471544 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-aa5b5b99-899c-4393-963f-9edaf177951a tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:18.472484 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-aa5b5b99-899c-4393-963f-9edaf177951a tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 8f800d64-00f6-4135-8090-c95d84acd232] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:18.484322 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa5b5b99-899c-4393-963f-9edaf177951a tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:18.485121 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa5b5b99-899c-4393-963f-9edaf177951a tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:18.486067 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa5b5b99-899c-4393-963f-9edaf177951a tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:18.487777 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa5b5b99-899c-4393-963f-9edaf177951a tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:18.489247 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa5b5b99-899c-4393-963f-9edaf177951a tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:18.489807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa5b5b99-899c-4393-963f-9edaf177951a tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:18.677193 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-aa5b5b99-899c-4393-963f-9edaf177951a tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00585dbe7f814eeebda43417ca1d0ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265d7d88bb6f45708203ea74df8f3214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:18.687076 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-aa5b5b99-899c-4393-963f-9edaf177951a tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232" status: 200 len: 1276 microversion: 2.1 time: 0.225462 Sep 24 20:57:18.689227 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1056/2117] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:18 2022] GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232 => generated 1276 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:18.806933 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-01111dde-f50d-4ae3-bfcb-dc2e19cc0d15 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:18.807564 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-01111dde-f50d-4ae3-bfcb-dc2e19cc0d15 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:18.824385 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01111dde-f50d-4ae3-bfcb-dc2e19cc0d15 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:18.824900 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01111dde-f50d-4ae3-bfcb-dc2e19cc0d15 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:18.825366 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01111dde-f50d-4ae3-bfcb-dc2e19cc0d15 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:18.826126 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01111dde-f50d-4ae3-bfcb-dc2e19cc0d15 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:18.826691 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01111dde-f50d-4ae3-bfcb-dc2e19cc0d15 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:18.827063 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01111dde-f50d-4ae3-bfcb-dc2e19cc0d15 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:19.399908 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f0df49ec-6aa5-457a-9e00-2d231ab3a80d tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:19.400778 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f0df49ec-6aa5-457a-9e00-2d231ab3a80d tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] [instance: 1c99e77a-8bb1-4e77-ab94-c560f7d88a28] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:19.412550 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f0df49ec-6aa5-457a-9e00-2d231ab3a80d tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:19.414174 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f0df49ec-6aa5-457a-9e00-2d231ab3a80d tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:19.414648 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f0df49ec-6aa5-457a-9e00-2d231ab3a80d tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:19.415669 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f0df49ec-6aa5-457a-9e00-2d231ab3a80d tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:19.416312 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f0df49ec-6aa5-457a-9e00-2d231ab3a80d tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:19.416942 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f0df49ec-6aa5-457a-9e00-2d231ab3a80d tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:19.760190 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-01111dde-f50d-4ae3-bfcb-dc2e19cc0d15 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:19.779619 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-01111dde-f50d-4ae3-bfcb-dc2e19cc0d15 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:19.781732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-01111dde-f50d-4ae3-bfcb-dc2e19cc0d15 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:19.783728 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-01111dde-f50d-4ae3-bfcb-dc2e19cc0d15 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1812 microversion: 2.25 time: 0.981025 Sep 24 20:57:19.786016 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1062/2118] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:18 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1812 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:57:19.804070 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8b75f882-b0e9-437f-9e25-b6464d14b1d2 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:19.805519 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8b75f882-b0e9-437f-9e25-b6464d14b1d2 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:19.815522 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:57:19.827713 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8b75f882-b0e9-437f-9e25-b6464d14b1d2 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:19.828602 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8b75f882-b0e9-437f-9e25-b6464d14b1d2 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:19.829283 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8b75f882-b0e9-437f-9e25-b6464d14b1d2 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:19.832040 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8b75f882-b0e9-437f-9e25-b6464d14b1d2 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:19.832797 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8b75f882-b0e9-437f-9e25-b6464d14b1d2 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:19.833487 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8b75f882-b0e9-437f-9e25-b6464d14b1d2 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:20.013642 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f0df49ec-6aa5-457a-9e00-2d231ab3a80d tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:20.029203 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f0df49ec-6aa5-457a-9e00-2d231ab3a80d tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:20.032232 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f0df49ec-6aa5-457a-9e00-2d231ab3a80d tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:20.034754 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f0df49ec-6aa5-457a-9e00-2d231ab3a80d tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] 10.222.0.52 "GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28" status: 200 len: 1358 microversion: 2.21 time: 0.639390 Sep 24 20:57:20.036261 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1057/2119] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:19 2022] GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28 => generated 1358 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:57:20.042412 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c7ace09f-60c2-4d3a-90cb-323ccec748ab tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:20.043167 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c7ace09f-60c2-4d3a-90cb-323ccec748ab tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 8f800d64-00f6-4135-8090-c95d84acd232] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:20.050743 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c7ace09f-60c2-4d3a-90cb-323ccec748ab tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:20.051326 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c7ace09f-60c2-4d3a-90cb-323ccec748ab tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:20.051994 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c7ace09f-60c2-4d3a-90cb-323ccec748ab tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:20.052818 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c7ace09f-60c2-4d3a-90cb-323ccec748ab tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:20.053359 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c7ace09f-60c2-4d3a-90cb-323ccec748ab tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:20.053864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c7ace09f-60c2-4d3a-90cb-323ccec748ab tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:20.060478 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:57:20.071316 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8b75f882-b0e9-437f-9e25-b6464d14b1d2 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:20.100813 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8b75f882-b0e9-437f-9e25-b6464d14b1d2 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1598 microversion: 2.1 time: 0.310224 Sep 24 20:57:20.104109 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1063/2120] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:19 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1598 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:20.242164 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c7ace09f-60c2-4d3a-90cb-323ccec748ab tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00585dbe7f814eeebda43417ca1d0ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265d7d88bb6f45708203ea74df8f3214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:20.254551 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c7ace09f-60c2-4d3a-90cb-323ccec748ab tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232" status: 200 len: 1276 microversion: 2.1 time: 0.216733 Sep 24 20:57:20.257287 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1058/2121] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:20 2022] GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232 => generated 1276 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:20.585056 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-d17c90b2-1e09-4c94-987a-2b15577aff85 req-55cdfc83-ab43-46a7-8ee6-ffe575827897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e72414b7-9fb5-4059-92fe-46b1780543f3", "name": "network-vif-deleted", "tag": "3c7dbe37-1536-469e-b3d7-785af8945b6a"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:57:20.605240 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-d17c90b2-1e09-4c94-987a-2b15577aff85 req-55cdfc83-ab43-46a7-8ee6-ffe575827897 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:20.606127 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-d17c90b2-1e09-4c94-987a-2b15577aff85 req-55cdfc83-ab43-46a7-8ee6-ffe575827897 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:20.613535 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-d17c90b2-1e09-4c94-987a-2b15577aff85 req-55cdfc83-ab43-46a7-8ee6-ffe575827897 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:20.629149 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-d17c90b2-1e09-4c94-987a-2b15577aff85 req-55cdfc83-ab43-46a7-8ee6-ffe575827897 service nova] Creating event network-vif-deleted:3c7dbe37-1536-469e-b3d7-785af8945b6a for instance e72414b7-9fb5-4059-92fe-46b1780543f3 on nch1-master-1 Sep 24 20:57:20.640468 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-d17c90b2-1e09-4c94-987a-2b15577aff85 req-55cdfc83-ab43-46a7-8ee6-ffe575827897 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064536 Sep 24 20:57:20.641382 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1064/2122] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:57:20.812228 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ca95d647-ed43-4220-95ef-9b7b92dc135c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:20.813560 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ca95d647-ed43-4220-95ef-9b7b92dc135c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:20.823480 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ca95d647-ed43-4220-95ef-9b7b92dc135c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:20.826890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ca95d647-ed43-4220-95ef-9b7b92dc135c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:20.827573 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ca95d647-ed43-4220-95ef-9b7b92dc135c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:20.829411 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ca95d647-ed43-4220-95ef-9b7b92dc135c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:20.831678 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ca95d647-ed43-4220-95ef-9b7b92dc135c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:20.832338 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ca95d647-ed43-4220-95ef-9b7b92dc135c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:21.062788 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2ecdf18d-4f24-4e2a-b2c0-64474ee1d10f tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:21.064004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2ecdf18d-4f24-4e2a-b2c0-64474ee1d10f tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] [instance: 1c99e77a-8bb1-4e77-ab94-c560f7d88a28] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:21.079094 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ecdf18d-4f24-4e2a-b2c0-64474ee1d10f tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:21.079765 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ecdf18d-4f24-4e2a-b2c0-64474ee1d10f tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:21.081792 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ecdf18d-4f24-4e2a-b2c0-64474ee1d10f tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:21.082736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ecdf18d-4f24-4e2a-b2c0-64474ee1d10f tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:21.083335 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ecdf18d-4f24-4e2a-b2c0-64474ee1d10f tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:21.084219 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ecdf18d-4f24-4e2a-b2c0-64474ee1d10f tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:21.106356 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:57:21.186400 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ca95d647-ed43-4220-95ef-9b7b92dc135c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:21.211351 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ca95d647-ed43-4220-95ef-9b7b92dc135c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:21.214201 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ca95d647-ed43-4220-95ef-9b7b92dc135c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:21.217255 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ca95d647-ed43-4220-95ef-9b7b92dc135c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1812 microversion: 2.25 time: 0.409316 Sep 24 20:57:21.218403 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1059/2123] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:20 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1812 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:57:21.229131 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e11d21d3-3fe1-42e4-80ef-7018f78ff38b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:21.231122 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e11d21d3-3fe1-42e4-80ef-7018f78ff38b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:21.260510 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e11d21d3-3fe1-42e4-80ef-7018f78ff38b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:21.261519 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e11d21d3-3fe1-42e4-80ef-7018f78ff38b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:21.262360 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e11d21d3-3fe1-42e4-80ef-7018f78ff38b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:21.264570 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e11d21d3-3fe1-42e4-80ef-7018f78ff38b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:21.265223 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e11d21d3-3fe1-42e4-80ef-7018f78ff38b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:21.271080 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e11d21d3-3fe1-42e4-80ef-7018f78ff38b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:21.289732 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:57:21.365332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e11d21d3-3fe1-42e4-80ef-7018f78ff38b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:21.366016 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e11d21d3-3fe1-42e4-80ef-7018f78ff38b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:21.366636 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e11d21d3-3fe1-42e4-80ef-7018f78ff38b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:21.367199 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-e11d21d3-3fe1-42e4-80ef-7018f78ff38b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lazy-loading 'fault' on Instance uuid e72414b7-9fb5-4059-92fe-46b1780543f3 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:57:21.552934 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e11d21d3-3fe1-42e4-80ef-7018f78ff38b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:21.570334 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e11d21d3-3fe1-42e4-80ef-7018f78ff38b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 200 len: 1323 microversion: 2.1 time: 0.347429 Sep 24 20:57:21.576392 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1060/2124] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:21 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 1323 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:21.598213 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-72bbb7f9-50da-43d2-82e0-a992f34955ef tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:21.601209 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-72bbb7f9-50da-43d2-82e0-a992f34955ef tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 8f800d64-00f6-4135-8090-c95d84acd232] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:21.609535 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2ecdf18d-4f24-4e2a-b2c0-64474ee1d10f tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:21.654147 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72bbb7f9-50da-43d2-82e0-a992f34955ef tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:21.654449 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2ecdf18d-4f24-4e2a-b2c0-64474ee1d10f tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:21.656364 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2ecdf18d-4f24-4e2a-b2c0-64474ee1d10f tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:21.665269 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72bbb7f9-50da-43d2-82e0-a992f34955ef tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:21.666766 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72bbb7f9-50da-43d2-82e0-a992f34955ef tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:21.667764 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72bbb7f9-50da-43d2-82e0-a992f34955ef tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:21.668227 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72bbb7f9-50da-43d2-82e0-a992f34955ef tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:21.668730 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72bbb7f9-50da-43d2-82e0-a992f34955ef tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:21.672443 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2ecdf18d-4f24-4e2a-b2c0-64474ee1d10f tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] 10.222.0.52 "GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28" status: 200 len: 1358 microversion: 2.21 time: 0.608680 Sep 24 20:57:21.673090 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1065/2125] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:21 2022] GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28 => generated 1358 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:57:22.247972 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-df0d61d4-2daf-4db6-94e6-b148ea1318ad tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:22.249370 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-df0d61d4-2daf-4db6-94e6-b148ea1318ad tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:22.261952 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df0d61d4-2daf-4db6-94e6-b148ea1318ad tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:22.262665 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df0d61d4-2daf-4db6-94e6-b148ea1318ad tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:22.263374 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df0d61d4-2daf-4db6-94e6-b148ea1318ad tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:22.264286 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df0d61d4-2daf-4db6-94e6-b148ea1318ad tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:22.264920 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df0d61d4-2daf-4db6-94e6-b148ea1318ad tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:22.265727 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df0d61d4-2daf-4db6-94e6-b148ea1318ad tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:22.693482 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=6 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:57:22.721889 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-72bbb7f9-50da-43d2-82e0-a992f34955ef tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00585dbe7f814eeebda43417ca1d0ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265d7d88bb6f45708203ea74df8f3214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:22.738777 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-72bbb7f9-50da-43d2-82e0-a992f34955ef tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232" status: 200 len: 1318 microversion: 2.1 time: 1.158226 Sep 24 20:57:22.751674 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1061/2126] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:21 2022] GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232 => generated 1318 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:22.768313 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=14 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:57:22.773296 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ff29c33f-4afd-4cef-8358-4f8550eab8ba tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:22.776575 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ff29c33f-4afd-4cef-8358-4f8550eab8ba tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: e72414b7-9fb5-4059-92fe-46b1780543f3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:22.781839 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:57:22.799907 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff29c33f-4afd-4cef-8358-4f8550eab8ba tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:22.801205 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff29c33f-4afd-4cef-8358-4f8550eab8ba tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:22.801850 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff29c33f-4afd-4cef-8358-4f8550eab8ba tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:22.802810 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff29c33f-4afd-4cef-8358-4f8550eab8ba tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:22.805971 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff29c33f-4afd-4cef-8358-4f8550eab8ba tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:22.806647 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff29c33f-4afd-4cef-8358-4f8550eab8ba tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:22.838043 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-ff29c33f-4afd-4cef-8358-4f8550eab8ba tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] HTTP exception thrown: Instance e72414b7-9fb5-4059-92fe-46b1780543f3 could not be found. Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ff29c33f-4afd-4cef-8358-4f8550eab8ba tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Request method failure captured: Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 HTTP/1.1 Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL22W-8wZmyHhPjnmqLAwGZ3mX4nIMGVBzhRCcf9yRpemeS-L-pQ-_V_nLRjxEZ-SLdpjyfDdbYT96U23uVeSrC_JfW-OZR0uiU2rIQ8b6jXauuTn3n6xaPicq5KAr5G3eZ5iymZw3vDvTM33hRL8Wt9H_E_Hy02-3xbdiMvDSMvifHM Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: a2b7e30f79bf42e497c53c091ad0a106 Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-LiveMigrationTest-471200620 Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a2b7e30f79bf42e497c53c091ad0a106"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a2b7e30f79bf42e497c53c091ad0a106"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a2b7e30f79bf42e497c53c091ad0a106"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a2b7e30f79bf42e497c53c091ad0a106"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-LiveMigrationTest-471200620 Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: a2b7e30f79bf42e497c53c091ad0a106 Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-LiveMigrationTest-471200620 Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-LiveMigrationTest-471200620-project Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 9c03c67e0c4c4de7a186f28ac10d0b92 Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-LiveMigrationTest-471200620-project Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance e72414b7-9fb5-4059-92fe-46b1780543f3 could not be found. Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'e72414b7-9fb5-4059-92fe-46b1780543f3'} Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e72414b7-9fb5-4059-92fe-46b1780543f3 could not be found. Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e72414b7-9fb5-4059-92fe-46b1780543f3 could not be found. Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:57:22.840619 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:57:22.847581 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:57:22.847581 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:57:22.847581 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:57:22.847581 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:57:22.847581 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:57:22.847581 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e72414b7-9fb5-4059-92fe-46b1780543f3 could not be found. Sep 24 20:57:22.847581 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:57:22.849815 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ff29c33f-4afd-4cef-8358-4f8550eab8ba tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Returning 404 to user: Instance e72414b7-9fb5-4059-92fe-46b1780543f3 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:57:22.851182 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ff29c33f-4afd-4cef-8358-4f8550eab8ba tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3" status: 404 len: 111 microversion: 2.1 time: 0.097219 Sep 24 20:57:22.851970 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1062/2127] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:22 2022] GET /compute/v2.1/servers/e72414b7-9fb5-4059-92fe-46b1780543f3 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:57:22.860975 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d17bd674-533d-4eef-affe-7ed3f8fdd84b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:22.862828 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d17bd674-533d-4eef-affe-7ed3f8fdd84b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] [instance: 1c99e77a-8bb1-4e77-ab94-c560f7d88a28] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:22.869936 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d17bd674-533d-4eef-affe-7ed3f8fdd84b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:22.870724 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d17bd674-533d-4eef-affe-7ed3f8fdd84b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:22.871477 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d17bd674-533d-4eef-affe-7ed3f8fdd84b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:22.872398 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d17bd674-533d-4eef-affe-7ed3f8fdd84b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:22.876614 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d17bd674-533d-4eef-affe-7ed3f8fdd84b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:22.877551 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d17bd674-533d-4eef-affe-7ed3f8fdd84b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:23.224897 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-df0d61d4-2daf-4db6-94e6-b148ea1318ad tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:23.234403 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-df0d61d4-2daf-4db6-94e6-b148ea1318ad tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:23.236185 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-df0d61d4-2daf-4db6-94e6-b148ea1318ad tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:23.238144 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-df0d61d4-2daf-4db6-94e6-b148ea1318ad tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1812 microversion: 2.25 time: 0.994488 Sep 24 20:57:23.239089 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1066/2128] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:22 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1812 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:57:23.243919 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ef35dd94-3da6-4e64-87cc-abee8b1e6322 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '.version_select at 0x7f4b0c8f68b0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:23.271834 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ef35dd94-3da6-4e64-87cc-abee8b1e6322 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1402438983" status: 202 len: 0 microversion: 2.1 time: 0.031312 Sep 24 20:57:23.273509 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1067/2129] 10.222.0.52 () {58 vars in 1221 bytes} [Sat Sep 24 20:57:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1402438983 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:57:23.385354 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=10 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:57:23.597457 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d17bd674-533d-4eef-affe-7ed3f8fdd84b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:23.610032 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d17bd674-533d-4eef-affe-7ed3f8fdd84b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:23.612413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d17bd674-533d-4eef-affe-7ed3f8fdd84b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:23.613795 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d17bd674-533d-4eef-affe-7ed3f8fdd84b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] 10.222.0.52 "GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28" status: 200 len: 1358 microversion: 2.21 time: 0.760620 Sep 24 20:57:23.614842 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1063/2130] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:22 2022] GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28 => generated 1358 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:57:23.766024 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b3cf944f-7b66-47cb-a97f-89e907b2a77d tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:23.766957 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b3cf944f-7b66-47cb-a97f-89e907b2a77d tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 8f800d64-00f6-4135-8090-c95d84acd232] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:23.791902 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b3cf944f-7b66-47cb-a97f-89e907b2a77d tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:23.793792 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b3cf944f-7b66-47cb-a97f-89e907b2a77d tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:23.794523 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b3cf944f-7b66-47cb-a97f-89e907b2a77d tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:23.797087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b3cf944f-7b66-47cb-a97f-89e907b2a77d tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:23.801201 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b3cf944f-7b66-47cb-a97f-89e907b2a77d tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:23.803416 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b3cf944f-7b66-47cb-a97f-89e907b2a77d tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:24.130383 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-e0511344-7d6b-457c-9607-6580e06192fa req-ab9e4827-b05b-49a6-8de3-152ee6447e9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c99e77a-8bb1-4e77-ab94-c560f7d88a28", "tag": "d0886f87-0f0e-407a-9d0e-f311d469b7f2"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:57:24.157347 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-e0511344-7d6b-457c-9607-6580e06192fa req-ab9e4827-b05b-49a6-8de3-152ee6447e9b service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:24.158760 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-e0511344-7d6b-457c-9607-6580e06192fa req-ab9e4827-b05b-49a6-8de3-152ee6447e9b service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:24.160077 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-e0511344-7d6b-457c-9607-6580e06192fa req-ab9e4827-b05b-49a6-8de3-152ee6447e9b service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:24.200685 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-e0511344-7d6b-457c-9607-6580e06192fa req-ab9e4827-b05b-49a6-8de3-152ee6447e9b service nova] Creating event network-changed:d0886f87-0f0e-407a-9d0e-f311d469b7f2 for instance 1c99e77a-8bb1-4e77-ab94-c560f7d88a28 on nch2-master-1 Sep 24 20:57:24.209927 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-e0511344-7d6b-457c-9607-6580e06192fa req-ab9e4827-b05b-49a6-8de3-152ee6447e9b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099384 Sep 24 20:57:24.211372 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1064/2131] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:57:24.277220 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-881762df-f6a9-4e26-b0d2-3c3efe9848af tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:24.280726 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-881762df-f6a9-4e26-b0d2-3c3efe9848af tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:24.300305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-881762df-f6a9-4e26-b0d2-3c3efe9848af tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:24.300800 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-881762df-f6a9-4e26-b0d2-3c3efe9848af tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:24.301244 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-881762df-f6a9-4e26-b0d2-3c3efe9848af tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:24.301977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-881762df-f6a9-4e26-b0d2-3c3efe9848af tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:24.302430 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-881762df-f6a9-4e26-b0d2-3c3efe9848af tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:24.302890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-881762df-f6a9-4e26-b0d2-3c3efe9848af tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:24.489973 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b3cf944f-7b66-47cb-a97f-89e907b2a77d tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00585dbe7f814eeebda43417ca1d0ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265d7d88bb6f45708203ea74df8f3214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:24.511794 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b3cf944f-7b66-47cb-a97f-89e907b2a77d tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232" status: 200 len: 1318 microversion: 2.1 time: 0.750392 Sep 24 20:57:24.523953 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1068/2132] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:23 2022] GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232 => generated 1318 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:24.645772 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4be0c4e0-d0a9-466d-bb31-7f270a56c7c1 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:24.646726 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4be0c4e0-d0a9-466d-bb31-7f270a56c7c1 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] [instance: 1c99e77a-8bb1-4e77-ab94-c560f7d88a28] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:24.653954 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4be0c4e0-d0a9-466d-bb31-7f270a56c7c1 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:24.654653 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4be0c4e0-d0a9-466d-bb31-7f270a56c7c1 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:24.655386 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4be0c4e0-d0a9-466d-bb31-7f270a56c7c1 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:24.656126 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4be0c4e0-d0a9-466d-bb31-7f270a56c7c1 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:24.656600 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4be0c4e0-d0a9-466d-bb31-7f270a56c7c1 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:24.657038 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4be0c4e0-d0a9-466d-bb31-7f270a56c7c1 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:24.914146 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-881762df-f6a9-4e26-b0d2-3c3efe9848af tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:24.926708 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-881762df-f6a9-4e26-b0d2-3c3efe9848af tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:24.928888 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-881762df-f6a9-4e26-b0d2-3c3efe9848af tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:24.931752 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-881762df-f6a9-4e26-b0d2-3c3efe9848af tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1812 microversion: 2.25 time: 0.668407 Sep 24 20:57:24.951009 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1065/2133] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:24 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1812 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:57:25.248702 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4be0c4e0-d0a9-466d-bb31-7f270a56c7c1 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:25.262018 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4be0c4e0-d0a9-466d-bb31-7f270a56c7c1 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:25.266097 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4be0c4e0-d0a9-466d-bb31-7f270a56c7c1 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:25.269536 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4be0c4e0-d0a9-466d-bb31-7f270a56c7c1 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] 10.222.0.52 "GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28" status: 200 len: 1358 microversion: 2.21 time: 0.630237 Sep 24 20:57:25.274155 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1069/2134] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:24 2022] GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28 => generated 1358 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:57:25.539448 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ee0ed9f5-9d52-4fb0-83be-d75b7682a0b2 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:25.540118 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ee0ed9f5-9d52-4fb0-83be-d75b7682a0b2 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 8f800d64-00f6-4135-8090-c95d84acd232] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:25.559481 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee0ed9f5-9d52-4fb0-83be-d75b7682a0b2 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:25.561057 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee0ed9f5-9d52-4fb0-83be-d75b7682a0b2 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:25.561633 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee0ed9f5-9d52-4fb0-83be-d75b7682a0b2 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:25.563580 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee0ed9f5-9d52-4fb0-83be-d75b7682a0b2 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:25.568816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee0ed9f5-9d52-4fb0-83be-d75b7682a0b2 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:25.569550 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee0ed9f5-9d52-4fb0-83be-d75b7682a0b2 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:25.965822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0b93e716-2503-48b4-a0d8-ebe300183f4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:25.966645 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0b93e716-2503-48b4-a0d8-ebe300183f4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:25.980749 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0b93e716-2503-48b4-a0d8-ebe300183f4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:25.983588 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0b93e716-2503-48b4-a0d8-ebe300183f4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:25.984591 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0b93e716-2503-48b4-a0d8-ebe300183f4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:25.988824 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0b93e716-2503-48b4-a0d8-ebe300183f4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:25.989508 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0b93e716-2503-48b4-a0d8-ebe300183f4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:25.990051 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0b93e716-2503-48b4-a0d8-ebe300183f4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:26.065541 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ee0ed9f5-9d52-4fb0-83be-d75b7682a0b2 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00585dbe7f814eeebda43417ca1d0ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265d7d88bb6f45708203ea74df8f3214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:26.078399 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ee0ed9f5-9d52-4fb0-83be-d75b7682a0b2 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232" status: 200 len: 1318 microversion: 2.1 time: 0.544394 Sep 24 20:57:26.082757 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1066/2135] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:25 2022] GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232 => generated 1318 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:26.271452 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-373a464c-0336-4d05-8993-28efccd7fc96 req-e3dcb6e7-321e-49b8-97e2-99a28d168a16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51", "tag": "00c8986f-e263-4bab-8396-0009b8e0c3e8"}, {"name": "network-changed", "server_uuid": "8f800d64-00f6-4135-8090-c95d84acd232", "tag": "04879ee8-ed63-4eba-999f-e92bf51322a7"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:57:26.291011 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-373a464c-0336-4d05-8993-28efccd7fc96 req-e3dcb6e7-321e-49b8-97e2-99a28d168a16 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:26.292541 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-373a464c-0336-4d05-8993-28efccd7fc96 req-e3dcb6e7-321e-49b8-97e2-99a28d168a16 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:26.295157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-373a464c-0336-4d05-8993-28efccd7fc96 req-e3dcb6e7-321e-49b8-97e2-99a28d168a16 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:26.325903 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-373a464c-0336-4d05-8993-28efccd7fc96 req-e3dcb6e7-321e-49b8-97e2-99a28d168a16 service nova] Creating event network-changed:00c8986f-e263-4bab-8396-0009b8e0c3e8 for instance 4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51 on nch2-master-1 Sep 24 20:57:26.328535 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-373a464c-0336-4d05-8993-28efccd7fc96 req-e3dcb6e7-321e-49b8-97e2-99a28d168a16 service nova] Creating event network-changed:04879ee8-ed63-4eba-999f-e92bf51322a7 for instance 8f800d64-00f6-4135-8090-c95d84acd232 on nch2-master-1 Sep 24 20:57:26.346670 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-373a464c-0336-4d05-8993-28efccd7fc96 req-e3dcb6e7-321e-49b8-97e2-99a28d168a16 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.077698 Sep 24 20:57:26.347548 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1067/2136] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:57:26.364022 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-874a2185-3e3b-42ba-9edc-e4cd71c70cc5 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:26.367865 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-874a2185-3e3b-42ba-9edc-e4cd71c70cc5 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] [instance: 1c99e77a-8bb1-4e77-ab94-c560f7d88a28] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:26.392482 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-874a2185-3e3b-42ba-9edc-e4cd71c70cc5 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:26.396796 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-874a2185-3e3b-42ba-9edc-e4cd71c70cc5 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:26.397318 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-874a2185-3e3b-42ba-9edc-e4cd71c70cc5 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:26.398487 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-874a2185-3e3b-42ba-9edc-e4cd71c70cc5 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:26.399099 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-874a2185-3e3b-42ba-9edc-e4cd71c70cc5 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:26.400075 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-874a2185-3e3b-42ba-9edc-e4cd71c70cc5 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:26.753953 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0b93e716-2503-48b4-a0d8-ebe300183f4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:26.783777 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0b93e716-2503-48b4-a0d8-ebe300183f4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:26.789172 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0b93e716-2503-48b4-a0d8-ebe300183f4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:26.793900 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0b93e716-2503-48b4-a0d8-ebe300183f4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1812 microversion: 2.25 time: 0.836548 Sep 24 20:57:26.796743 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1070/2137] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:25 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1812 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:57:26.818650 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-80c5b3e0-3ed6-4a19-acc5-c0a7fbe6317e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:26.819194 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-80c5b3e0-3ed6-4a19-acc5-c0a7fbe6317e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:26.828329 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-80c5b3e0-3ed6-4a19-acc5-c0a7fbe6317e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:26.829158 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-80c5b3e0-3ed6-4a19-acc5-c0a7fbe6317e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:26.829795 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-80c5b3e0-3ed6-4a19-acc5-c0a7fbe6317e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:26.831370 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-80c5b3e0-3ed6-4a19-acc5-c0a7fbe6317e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:26.832017 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-80c5b3e0-3ed6-4a19-acc5-c0a7fbe6317e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:26.832761 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-80c5b3e0-3ed6-4a19-acc5-c0a7fbe6317e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:26.861361 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-80c5b3e0-3ed6-4a19-acc5-c0a7fbe6317e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:57:26.907648 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-874a2185-3e3b-42ba-9edc-e4cd71c70cc5 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:26.929762 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-874a2185-3e3b-42ba-9edc-e4cd71c70cc5 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:26.940046 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-874a2185-3e3b-42ba-9edc-e4cd71c70cc5 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:26.947503 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-874a2185-3e3b-42ba-9edc-e4cd71c70cc5 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] 10.222.0.52 "GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28" status: 200 len: 1358 microversion: 2.21 time: 0.598406 Sep 24 20:57:26.948265 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1068/2138] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:26 2022] GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28 => generated 1358 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:57:27.010056 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-80c5b3e0-3ed6-4a19-acc5-c0a7fbe6317e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d" status: 204 len: 0 microversion: 2.1 time: 0.207907 Sep 24 20:57:27.015720 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1071/2139] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:57:26 2022] DELETE /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:57:27.024357 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-52a9bd8a-7d3f-4d45-a271-0efad41fd8d4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:27.025879 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-52a9bd8a-7d3f-4d45-a271-0efad41fd8d4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:27.038950 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-52a9bd8a-7d3f-4d45-a271-0efad41fd8d4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:27.039483 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-52a9bd8a-7d3f-4d45-a271-0efad41fd8d4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:27.039942 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-52a9bd8a-7d3f-4d45-a271-0efad41fd8d4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:27.040693 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-52a9bd8a-7d3f-4d45-a271-0efad41fd8d4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:27.041161 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-52a9bd8a-7d3f-4d45-a271-0efad41fd8d4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:27.041599 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-52a9bd8a-7d3f-4d45-a271-0efad41fd8d4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:27.109992 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ab44011d-4aaf-4636-9302-8468063f3227 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:27.110823 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ab44011d-4aaf-4636-9302-8468063f3227 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 8f800d64-00f6-4135-8090-c95d84acd232] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:27.119443 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ab44011d-4aaf-4636-9302-8468063f3227 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:27.120340 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ab44011d-4aaf-4636-9302-8468063f3227 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:27.120815 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ab44011d-4aaf-4636-9302-8468063f3227 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:27.121607 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ab44011d-4aaf-4636-9302-8468063f3227 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:27.122793 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ab44011d-4aaf-4636-9302-8468063f3227 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:27.123298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ab44011d-4aaf-4636-9302-8468063f3227 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:27.436072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-52a9bd8a-7d3f-4d45-a271-0efad41fd8d4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:27.446084 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-52a9bd8a-7d3f-4d45-a271-0efad41fd8d4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d" status: 200 len: 1484 microversion: 2.1 time: 0.430644 Sep 24 20:57:27.459442 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ab44011d-4aaf-4636-9302-8468063f3227 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00585dbe7f814eeebda43417ca1d0ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265d7d88bb6f45708203ea74df8f3214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:27.471919 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ab44011d-4aaf-4636-9302-8468063f3227 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232" status: 200 len: 1318 microversion: 2.1 time: 0.366225 Sep 24 20:57:27.487379 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1072/2140] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:27 2022] GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232 => generated 1318 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:27.490155 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1069/2141] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:27 2022] GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d => generated 1484 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:27.836615 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-afa0ab6d-61c9-4392-b9ad-faa1f0d9e7c2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:27.837249 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-afa0ab6d-61c9-4392-b9ad-faa1f0d9e7c2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:27.858223 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-afa0ab6d-61c9-4392-b9ad-faa1f0d9e7c2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:27.858765 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-afa0ab6d-61c9-4392-b9ad-faa1f0d9e7c2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:27.859212 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-afa0ab6d-61c9-4392-b9ad-faa1f0d9e7c2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:27.859959 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-afa0ab6d-61c9-4392-b9ad-faa1f0d9e7c2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:27.860421 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-afa0ab6d-61c9-4392-b9ad-faa1f0d9e7c2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:27.860849 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-afa0ab6d-61c9-4392-b9ad-faa1f0d9e7c2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:27.975899 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d24dcd59-7f76-40e0-aa83-f9b18b18eb2b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:27.976653 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d24dcd59-7f76-40e0-aa83-f9b18b18eb2b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] [instance: 1c99e77a-8bb1-4e77-ab94-c560f7d88a28] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:27.985561 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d24dcd59-7f76-40e0-aa83-f9b18b18eb2b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:27.986410 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d24dcd59-7f76-40e0-aa83-f9b18b18eb2b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:27.987590 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d24dcd59-7f76-40e0-aa83-f9b18b18eb2b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:27.988566 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d24dcd59-7f76-40e0-aa83-f9b18b18eb2b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:27.989233 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d24dcd59-7f76-40e0-aa83-f9b18b18eb2b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:27.989867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d24dcd59-7f76-40e0-aa83-f9b18b18eb2b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:28.584907 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d24dcd59-7f76-40e0-aa83-f9b18b18eb2b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:28.600440 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d24dcd59-7f76-40e0-aa83-f9b18b18eb2b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:28.604360 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d24dcd59-7f76-40e0-aa83-f9b18b18eb2b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:28.607807 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d24dcd59-7f76-40e0-aa83-f9b18b18eb2b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] 10.222.0.52 "GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28" status: 200 len: 1358 microversion: 2.21 time: 0.634705 Sep 24 20:57:28.608921 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1070/2142] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:27 2022] GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28 => generated 1358 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:57:28.616670 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-afa0ab6d-61c9-4392-b9ad-faa1f0d9e7c2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:28.626708 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-92e4f56e-f1b1-4376-9e57-c22d423b945b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:28.628228 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-92e4f56e-f1b1-4376-9e57-c22d423b945b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:28.633967 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-afa0ab6d-61c9-4392-b9ad-faa1f0d9e7c2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:28.639391 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-afa0ab6d-61c9-4392-b9ad-faa1f0d9e7c2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:28.640093 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-92e4f56e-f1b1-4376-9e57-c22d423b945b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:28.640691 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-afa0ab6d-61c9-4392-b9ad-faa1f0d9e7c2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1812 microversion: 2.25 time: 0.816079 Sep 24 20:57:28.641098 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-92e4f56e-f1b1-4376-9e57-c22d423b945b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:28.642405 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1073/2143] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:27 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1812 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:57:28.643226 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-92e4f56e-f1b1-4376-9e57-c22d423b945b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:28.646786 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-92e4f56e-f1b1-4376-9e57-c22d423b945b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:28.647371 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-92e4f56e-f1b1-4376-9e57-c22d423b945b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:28.648048 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-92e4f56e-f1b1-4376-9e57-c22d423b945b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:28.655417 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-acc37908-c068-4928-aad9-16b20fc0749f tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:28.659966 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-acc37908-c068-4928-aad9-16b20fc0749f tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 8f800d64-00f6-4135-8090-c95d84acd232] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:28.683993 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-acc37908-c068-4928-aad9-16b20fc0749f tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:28.690060 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-acc37908-c068-4928-aad9-16b20fc0749f tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:28.690718 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-acc37908-c068-4928-aad9-16b20fc0749f tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:28.691525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-acc37908-c068-4928-aad9-16b20fc0749f tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:28.692015 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-acc37908-c068-4928-aad9-16b20fc0749f tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:28.692460 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-acc37908-c068-4928-aad9-16b20fc0749f tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:29.094333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-acc37908-c068-4928-aad9-16b20fc0749f tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00585dbe7f814eeebda43417ca1d0ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265d7d88bb6f45708203ea74df8f3214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:29.103848 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-acc37908-c068-4928-aad9-16b20fc0749f tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232" status: 200 len: 1318 microversion: 2.1 time: 0.457066 Sep 24 20:57:29.104428 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1074/2144] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:28 2022] GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232 => generated 1318 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:29.129609 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-92e4f56e-f1b1-4376-9e57-c22d423b945b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:29.140199 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-92e4f56e-f1b1-4376-9e57-c22d423b945b tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d" status: 200 len: 1484 microversion: 2.1 time: 0.527676 Sep 24 20:57:29.141105 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1071/2145] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:28 2022] GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d => generated 1484 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:29.636479 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f1ad98f9-bdd3-4c95-833a-f10228575f54 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:29.638273 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f1ad98f9-bdd3-4c95-833a-f10228575f54 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] [instance: 1c99e77a-8bb1-4e77-ab94-c560f7d88a28] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:29.649222 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f1ad98f9-bdd3-4c95-833a-f10228575f54 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:29.650125 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f1ad98f9-bdd3-4c95-833a-f10228575f54 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:29.650710 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f1ad98f9-bdd3-4c95-833a-f10228575f54 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:29.651554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f1ad98f9-bdd3-4c95-833a-f10228575f54 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:29.652093 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f1ad98f9-bdd3-4c95-833a-f10228575f54 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:29.652594 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f1ad98f9-bdd3-4c95-833a-f10228575f54 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:29.742994 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d7fa7f11-91f1-4e0d-bf45-9b13db941f86 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:29.743924 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d7fa7f11-91f1-4e0d-bf45-9b13db941f86 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:29.750552 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7fa7f11-91f1-4e0d-bf45-9b13db941f86 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:29.751270 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7fa7f11-91f1-4e0d-bf45-9b13db941f86 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:29.752874 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7fa7f11-91f1-4e0d-bf45-9b13db941f86 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:29.753859 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7fa7f11-91f1-4e0d-bf45-9b13db941f86 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:29.754491 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7fa7f11-91f1-4e0d-bf45-9b13db941f86 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:29.755148 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7fa7f11-91f1-4e0d-bf45-9b13db941f86 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:30.015032 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f1ad98f9-bdd3-4c95-833a-f10228575f54 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:30.042257 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f1ad98f9-bdd3-4c95-833a-f10228575f54 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:30.043646 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f1ad98f9-bdd3-4c95-833a-f10228575f54 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:30.044776 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f1ad98f9-bdd3-4c95-833a-f10228575f54 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] 10.222.0.52 "GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28" status: 200 len: 1358 microversion: 2.21 time: 0.412908 Sep 24 20:57:30.045343 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1075/2146] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:29 2022] GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28 => generated 1358 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:57:30.083389 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d7fa7f11-91f1-4e0d-bf45-9b13db941f86 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:30.099337 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d7fa7f11-91f1-4e0d-bf45-9b13db941f86 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:30.102020 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d7fa7f11-91f1-4e0d-bf45-9b13db941f86 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:30.103586 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d7fa7f11-91f1-4e0d-bf45-9b13db941f86 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1812 microversion: 2.25 time: 0.366461 Sep 24 20:57:30.117633 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1072/2147] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:29 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1812 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:57:30.128893 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-74f31473-66fa-4536-a8e5-0713c6b760bf tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:30.130109 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-74f31473-66fa-4536-a8e5-0713c6b760bf tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 8f800d64-00f6-4135-8090-c95d84acd232] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:30.137236 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-74f31473-66fa-4536-a8e5-0713c6b760bf tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:30.138011 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-74f31473-66fa-4536-a8e5-0713c6b760bf tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:30.138768 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-74f31473-66fa-4536-a8e5-0713c6b760bf tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:30.139728 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-74f31473-66fa-4536-a8e5-0713c6b760bf tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:30.140389 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-74f31473-66fa-4536-a8e5-0713c6b760bf tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:30.141015 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-74f31473-66fa-4536-a8e5-0713c6b760bf tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:30.179297 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-eaabc520-99e0-4f30-a2ac-9efb740f3f4e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:30.183779 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-eaabc520-99e0-4f30-a2ac-9efb740f3f4e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:30.203393 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eaabc520-99e0-4f30-a2ac-9efb740f3f4e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:30.205217 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eaabc520-99e0-4f30-a2ac-9efb740f3f4e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:30.207409 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eaabc520-99e0-4f30-a2ac-9efb740f3f4e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:30.211138 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eaabc520-99e0-4f30-a2ac-9efb740f3f4e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:30.211820 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eaabc520-99e0-4f30-a2ac-9efb740f3f4e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:30.216098 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eaabc520-99e0-4f30-a2ac-9efb740f3f4e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:30.448611 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-eaabc520-99e0-4f30-a2ac-9efb740f3f4e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:30.492171 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-eaabc520-99e0-4f30-a2ac-9efb740f3f4e tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d" status: 200 len: 1442 microversion: 2.1 time: 0.328385 Sep 24 20:57:30.494466 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1073/2148] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:30 2022] GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d => generated 1442 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:30.512708 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-88409d95-51c7-4c0e-b737-c88c5793e2a3 req-e1f8ebf9-3ed2-4ae7-bcc1-4511bb8c1a35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dc2952a-aad1-40d0-bd55-87c6b3b9618d", "name": "network-vif-deleted", "tag": "092b1380-825b-4d02-bb2f-0dda7ef94e2e"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:57:30.538210 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-88409d95-51c7-4c0e-b737-c88c5793e2a3 req-e1f8ebf9-3ed2-4ae7-bcc1-4511bb8c1a35 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:30.538731 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-88409d95-51c7-4c0e-b737-c88c5793e2a3 req-e1f8ebf9-3ed2-4ae7-bcc1-4511bb8c1a35 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:30.543231 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-88409d95-51c7-4c0e-b737-c88c5793e2a3 req-e1f8ebf9-3ed2-4ae7-bcc1-4511bb8c1a35 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:30.574764 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-88409d95-51c7-4c0e-b737-c88c5793e2a3 req-e1f8ebf9-3ed2-4ae7-bcc1-4511bb8c1a35 service nova] Creating event network-vif-deleted:092b1380-825b-4d02-bb2f-0dda7ef94e2e for instance 5dc2952a-aad1-40d0-bd55-87c6b3b9618d on nch2-master-1 Sep 24 20:57:30.584266 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-88409d95-51c7-4c0e-b737-c88c5793e2a3 req-e1f8ebf9-3ed2-4ae7-bcc1-4511bb8c1a35 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083644 Sep 24 20:57:30.586096 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1074/2149] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:57:30.682715 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-74f31473-66fa-4536-a8e5-0713c6b760bf tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00585dbe7f814eeebda43417ca1d0ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265d7d88bb6f45708203ea74df8f3214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:30.692576 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-74f31473-66fa-4536-a8e5-0713c6b760bf tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232" status: 200 len: 1318 microversion: 2.1 time: 0.568478 Sep 24 20:57:30.693586 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1076/2150] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:30 2022] GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232 => generated 1318 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:31.072341 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2967d22c-58c3-4ab0-b295-718477bac6dd tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:31.073056 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2967d22c-58c3-4ab0-b295-718477bac6dd tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] [instance: 1c99e77a-8bb1-4e77-ab94-c560f7d88a28] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:31.087143 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2967d22c-58c3-4ab0-b295-718477bac6dd tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:31.089799 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2967d22c-58c3-4ab0-b295-718477bac6dd tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:31.090279 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2967d22c-58c3-4ab0-b295-718477bac6dd tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:31.091045 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2967d22c-58c3-4ab0-b295-718477bac6dd tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:31.091519 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2967d22c-58c3-4ab0-b295-718477bac6dd tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:31.094304 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2967d22c-58c3-4ab0-b295-718477bac6dd tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:31.132483 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-911cea77-d026-46ee-b873-d0002ef6b51c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:31.133164 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-911cea77-d026-46ee-b873-d0002ef6b51c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:31.149680 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-911cea77-d026-46ee-b873-d0002ef6b51c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:31.151156 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-911cea77-d026-46ee-b873-d0002ef6b51c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:31.153099 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-911cea77-d026-46ee-b873-d0002ef6b51c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:31.156819 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-911cea77-d026-46ee-b873-d0002ef6b51c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:31.157784 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-911cea77-d026-46ee-b873-d0002ef6b51c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:31.163132 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-911cea77-d026-46ee-b873-d0002ef6b51c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:31.567517 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-911cea77-d026-46ee-b873-d0002ef6b51c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:31.569875 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2967d22c-58c3-4ab0-b295-718477bac6dd tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:31.585272 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-911cea77-d026-46ee-b873-d0002ef6b51c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:31.588864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2967d22c-58c3-4ab0-b295-718477bac6dd tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:31.589888 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-911cea77-d026-46ee-b873-d0002ef6b51c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:31.590623 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2967d22c-58c3-4ab0-b295-718477bac6dd tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:31.591798 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2967d22c-58c3-4ab0-b295-718477bac6dd tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] 10.222.0.52 "GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28" status: 200 len: 1358 microversion: 2.21 time: 0.524329 Sep 24 20:57:31.610420 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1075/2151] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:31 2022] GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28 => generated 1358 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:57:31.610670 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-911cea77-d026-46ee-b873-d0002ef6b51c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1812 microversion: 2.25 time: 0.466334 Sep 24 20:57:31.610670 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1077/2152] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:31 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1812 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:57:31.610848 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-00c9a780-4ec1-4430-b9f7-3026d4dffd00 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:31.610848 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-00c9a780-4ec1-4430-b9f7-3026d4dffd00 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:31.623632 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00c9a780-4ec1-4430-b9f7-3026d4dffd00 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:31.624155 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00c9a780-4ec1-4430-b9f7-3026d4dffd00 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:31.624628 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00c9a780-4ec1-4430-b9f7-3026d4dffd00 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:31.625470 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00c9a780-4ec1-4430-b9f7-3026d4dffd00 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:31.625938 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00c9a780-4ec1-4430-b9f7-3026d4dffd00 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:31.626850 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00c9a780-4ec1-4430-b9f7-3026d4dffd00 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:31.718045 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c1c75522-d526-4b65-bce7-49ea457cd261 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:31.718806 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c1c75522-d526-4b65-bce7-49ea457cd261 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 8f800d64-00f6-4135-8090-c95d84acd232] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:31.728885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00c9a780-4ec1-4430-b9f7-3026d4dffd00 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:31.729978 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00c9a780-4ec1-4430-b9f7-3026d4dffd00 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:31.730439 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00c9a780-4ec1-4430-b9f7-3026d4dffd00 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:31.730765 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1c75522-d526-4b65-bce7-49ea457cd261 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:31.730916 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-00c9a780-4ec1-4430-b9f7-3026d4dffd00 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lazy-loading 'fault' on Instance uuid 5dc2952a-aad1-40d0-bd55-87c6b3b9618d {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:57:31.731938 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1c75522-d526-4b65-bce7-49ea457cd261 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:31.734027 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1c75522-d526-4b65-bce7-49ea457cd261 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:31.735244 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1c75522-d526-4b65-bce7-49ea457cd261 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:31.737901 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1c75522-d526-4b65-bce7-49ea457cd261 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:31.738525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1c75522-d526-4b65-bce7-49ea457cd261 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:31.818411 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-00c9a780-4ec1-4430-b9f7-3026d4dffd00 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:31.821178 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:57:31.836698 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-00c9a780-4ec1-4430-b9f7-3026d4dffd00 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d" status: 200 len: 1300 microversion: 2.1 time: 0.235840 Sep 24 20:57:31.837657 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1076/2153] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:31 2022] GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d => generated 1300 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:32.369888 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c1c75522-d526-4b65-bce7-49ea457cd261 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00585dbe7f814eeebda43417ca1d0ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265d7d88bb6f45708203ea74df8f3214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:32.386998 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c1c75522-d526-4b65-bce7-49ea457cd261 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232" status: 200 len: 1318 microversion: 2.1 time: 0.674806 Sep 24 20:57:32.388123 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1078/2154] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:31 2022] GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232 => generated 1318 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:57:32.626687 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-42b48692-ddfb-49de-9e11-9e7e34f8e1a7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:32.631241 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-031b3034-8435-4b3a-b4bd-7c126db898e2 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:32.632139 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-031b3034-8435-4b3a-b4bd-7c126db898e2 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] [instance: 1c99e77a-8bb1-4e77-ab94-c560f7d88a28] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:32.632725 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-42b48692-ddfb-49de-9e11-9e7e34f8e1a7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:32.654821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-031b3034-8435-4b3a-b4bd-7c126db898e2 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:32.655988 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-42b48692-ddfb-49de-9e11-9e7e34f8e1a7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:32.656716 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-031b3034-8435-4b3a-b4bd-7c126db898e2 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:32.658067 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-031b3034-8435-4b3a-b4bd-7c126db898e2 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:32.659527 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-42b48692-ddfb-49de-9e11-9e7e34f8e1a7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:32.663030 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-42b48692-ddfb-49de-9e11-9e7e34f8e1a7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:32.665254 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-42b48692-ddfb-49de-9e11-9e7e34f8e1a7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:32.666430 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-031b3034-8435-4b3a-b4bd-7c126db898e2 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:32.667028 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-42b48692-ddfb-49de-9e11-9e7e34f8e1a7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:32.667565 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-031b3034-8435-4b3a-b4bd-7c126db898e2 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:32.668258 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-031b3034-8435-4b3a-b4bd-7c126db898e2 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:32.670663 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-42b48692-ddfb-49de-9e11-9e7e34f8e1a7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:33.272976 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-031b3034-8435-4b3a-b4bd-7c126db898e2 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:33.292610 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-031b3034-8435-4b3a-b4bd-7c126db898e2 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:33.296844 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-031b3034-8435-4b3a-b4bd-7c126db898e2 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:33.304487 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-031b3034-8435-4b3a-b4bd-7c126db898e2 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] 10.222.0.52 "GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28" status: 200 len: 1358 microversion: 2.21 time: 0.681998 Sep 24 20:57:33.309240 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1079/2155] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:32 2022] GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28 => generated 1358 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:57:33.358036 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d41084a6-df42-4cbf-b319-37297e878ad4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:33.359352 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d41084a6-df42-4cbf-b319-37297e878ad4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 5dc2952a-aad1-40d0-bd55-87c6b3b9618d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:33.366754 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d41084a6-df42-4cbf-b319-37297e878ad4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:33.368144 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d41084a6-df42-4cbf-b319-37297e878ad4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:33.369195 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d41084a6-df42-4cbf-b319-37297e878ad4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:33.373375 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d41084a6-df42-4cbf-b319-37297e878ad4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:33.378891 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d41084a6-df42-4cbf-b319-37297e878ad4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:33.379970 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d41084a6-df42-4cbf-b319-37297e878ad4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:33.420034 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-d41084a6-df42-4cbf-b319-37297e878ad4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] HTTP exception thrown: Instance 5dc2952a-aad1-40d0-bd55-87c6b3b9618d could not be found. Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d41084a6-df42-4cbf-b319-37297e878ad4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Request method failure captured: Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d HTTP/1.1 Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL22W-8wZmyHhPjnmqLAwGZ3mX4nIMGVBzhRCcf9yRpemeS-L-pQ-_V_nLRjxEZ-SLdpjyfDdbYT96U23uVeSrC_JfW-OZR0uiU2rIQ8b6jXauuTn3n6xaPicq5KAr5G3eZ5iymZw3vDvTM33hRL8Wt9H_E_Hy02-3xbdiMvDSMvifHM Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: a2b7e30f79bf42e497c53c091ad0a106 Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-LiveMigrationTest-471200620 Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a2b7e30f79bf42e497c53c091ad0a106"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a2b7e30f79bf42e497c53c091ad0a106"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a2b7e30f79bf42e497c53c091ad0a106"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a2b7e30f79bf42e497c53c091ad0a106"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-LiveMigrationTest-471200620 Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: a2b7e30f79bf42e497c53c091ad0a106 Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-LiveMigrationTest-471200620 Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-LiveMigrationTest-471200620-project Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 9c03c67e0c4c4de7a186f28ac10d0b92 Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-LiveMigrationTest-471200620-project Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 5dc2952a-aad1-40d0-bd55-87c6b3b9618d could not be found. Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '5dc2952a-aad1-40d0-bd55-87c6b3b9618d'} Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dc2952a-aad1-40d0-bd55-87c6b3b9618d could not be found. Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dc2952a-aad1-40d0-bd55-87c6b3b9618d could not be found. Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:57:33.422299 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:57:33.428743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:57:33.428743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:57:33.428743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:57:33.428743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:57:33.428743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:57:33.428743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dc2952a-aad1-40d0-bd55-87c6b3b9618d could not be found. Sep 24 20:57:33.428743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:57:33.431270 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d41084a6-df42-4cbf-b319-37297e878ad4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Returning 404 to user: Instance 5dc2952a-aad1-40d0-bd55-87c6b3b9618d could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:57:33.434075 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d41084a6-df42-4cbf-b319-37297e878ad4 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d" status: 404 len: 111 microversion: 2.1 time: 0.123545 Sep 24 20:57:33.436581 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1080/2156] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:33 2022] GET /compute/v2.1/servers/5dc2952a-aad1-40d0-bd55-87c6b3b9618d => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:57:33.447701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ed3fdce2-2f31-42e1-a2fb-dc76582e2255 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:33.453646 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ed3fdce2-2f31-42e1-a2fb-dc76582e2255 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 8f800d64-00f6-4135-8090-c95d84acd232] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:33.474788 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed3fdce2-2f31-42e1-a2fb-dc76582e2255 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:33.479523 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed3fdce2-2f31-42e1-a2fb-dc76582e2255 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:33.480376 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed3fdce2-2f31-42e1-a2fb-dc76582e2255 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:33.483709 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed3fdce2-2f31-42e1-a2fb-dc76582e2255 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:33.484383 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed3fdce2-2f31-42e1-a2fb-dc76582e2255 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:33.485032 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed3fdce2-2f31-42e1-a2fb-dc76582e2255 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:33.974413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-42b48692-ddfb-49de-9e11-9e7e34f8e1a7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:33.985154 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-42b48692-ddfb-49de-9e11-9e7e34f8e1a7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:33.989164 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-42b48692-ddfb-49de-9e11-9e7e34f8e1a7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:33.990904 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-42b48692-ddfb-49de-9e11-9e7e34f8e1a7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1812 microversion: 2.25 time: 1.370593 Sep 24 20:57:34.013124 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1077/2157] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:32 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1812 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:57:34.035077 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f7c4d899-2694-4bd9-a085-ce499e64d689 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:34.036346 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f7c4d899-2694-4bd9-a085-ce499e64d689 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:34.051395 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f7c4d899-2694-4bd9-a085-ce499e64d689 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:34.052195 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f7c4d899-2694-4bd9-a085-ce499e64d689 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:34.052811 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f7c4d899-2694-4bd9-a085-ce499e64d689 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:34.053706 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f7c4d899-2694-4bd9-a085-ce499e64d689 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:34.054328 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f7c4d899-2694-4bd9-a085-ce499e64d689 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:34.054971 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f7c4d899-2694-4bd9-a085-ce499e64d689 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:34.098201 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f7c4d899-2694-4bd9-a085-ce499e64d689 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:57:34.229689 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ed3fdce2-2f31-42e1-a2fb-dc76582e2255 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00585dbe7f814eeebda43417ca1d0ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265d7d88bb6f45708203ea74df8f3214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:34.248044 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ed3fdce2-2f31-42e1-a2fb-dc76582e2255 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232" status: 200 len: 1318 microversion: 2.1 time: 0.805302 Sep 24 20:57:34.250819 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1081/2158] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:33 2022] GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232 => generated 1318 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:34.264624 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f7c4d899-2694-4bd9-a085-ce499e64d689 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5" status: 204 len: 0 microversion: 2.1 time: 0.248327 Sep 24 20:57:34.266083 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1078/2159] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:57:34 2022] DELETE /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:57:34.276393 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-112fbf75-4a3d-444d-9944-6a3406db3105 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:34.277677 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-112fbf75-4a3d-444d-9944-6a3406db3105 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:34.287149 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-112fbf75-4a3d-444d-9944-6a3406db3105 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:34.288063 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-112fbf75-4a3d-444d-9944-6a3406db3105 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:34.288682 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-112fbf75-4a3d-444d-9944-6a3406db3105 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:34.289575 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-112fbf75-4a3d-444d-9944-6a3406db3105 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:34.290204 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-112fbf75-4a3d-444d-9944-6a3406db3105 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:34.290882 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-112fbf75-4a3d-444d-9944-6a3406db3105 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:34.319486 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:57:34.346460 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-21cf2cbf-cdf5-4a5f-bf16-a4a5de315ca3 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:34.347638 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-21cf2cbf-cdf5-4a5f-bf16-a4a5de315ca3 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] [instance: 1c99e77a-8bb1-4e77-ab94-c560f7d88a28] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:34.361407 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-21cf2cbf-cdf5-4a5f-bf16-a4a5de315ca3 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:34.362239 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-21cf2cbf-cdf5-4a5f-bf16-a4a5de315ca3 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:34.363024 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-21cf2cbf-cdf5-4a5f-bf16-a4a5de315ca3 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:34.363983 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-21cf2cbf-cdf5-4a5f-bf16-a4a5de315ca3 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:34.364758 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-21cf2cbf-cdf5-4a5f-bf16-a4a5de315ca3 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:34.365348 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-21cf2cbf-cdf5-4a5f-bf16-a4a5de315ca3 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:34.833023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-112fbf75-4a3d-444d-9944-6a3406db3105 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:34.855238 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-112fbf75-4a3d-444d-9944-6a3406db3105 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5" status: 200 len: 1500 microversion: 2.1 time: 0.584065 Sep 24 20:57:34.856905 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1082/2160] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:34 2022] GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 => generated 1500 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:34.884722 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-21cf2cbf-cdf5-4a5f-bf16-a4a5de315ca3 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:34.901714 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-21cf2cbf-cdf5-4a5f-bf16-a4a5de315ca3 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:34.903568 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-21cf2cbf-cdf5-4a5f-bf16-a4a5de315ca3 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:34.906405 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-21cf2cbf-cdf5-4a5f-bf16-a4a5de315ca3 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] 10.222.0.52 "GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28" status: 200 len: 1358 microversion: 2.21 time: 0.567299 Sep 24 20:57:34.926487 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1079/2161] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:34 2022] GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28 => generated 1358 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:57:35.042747 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a9d956cc-a44b-4d8a-b360-cb122dba15c3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:35.045286 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a9d956cc-a44b-4d8a-b360-cb122dba15c3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:35.088746 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9d956cc-a44b-4d8a-b360-cb122dba15c3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:35.091487 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9d956cc-a44b-4d8a-b360-cb122dba15c3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:35.093988 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9d956cc-a44b-4d8a-b360-cb122dba15c3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:35.095093 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9d956cc-a44b-4d8a-b360-cb122dba15c3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:35.099807 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9d956cc-a44b-4d8a-b360-cb122dba15c3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:35.105112 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9d956cc-a44b-4d8a-b360-cb122dba15c3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:35.274253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-93477a05-f4aa-4637-b222-860752cd991e tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:35.275658 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-93477a05-f4aa-4637-b222-860752cd991e tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 8f800d64-00f6-4135-8090-c95d84acd232] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:35.293139 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93477a05-f4aa-4637-b222-860752cd991e tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:35.294660 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93477a05-f4aa-4637-b222-860752cd991e tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:35.295367 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93477a05-f4aa-4637-b222-860752cd991e tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:35.296575 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93477a05-f4aa-4637-b222-860752cd991e tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:35.297287 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93477a05-f4aa-4637-b222-860752cd991e tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:35.297977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93477a05-f4aa-4637-b222-860752cd991e tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:35.923618 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a9d956cc-a44b-4d8a-b360-cb122dba15c3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:35.943024 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a9d956cc-a44b-4d8a-b360-cb122dba15c3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:35.945089 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a9d956cc-a44b-4d8a-b360-cb122dba15c3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:35.950206 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a9d956cc-a44b-4d8a-b360-cb122dba15c3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1802 microversion: 2.25 time: 0.921562 Sep 24 20:57:35.993814 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1083/2162] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:35 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1802 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:57:35.999082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-b9d85dad-f73e-4cb1-8fc9-5906f9e8f54e req-33bf701c-4337-4faf-b87c-b6d519e6aff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c99e77a-8bb1-4e77-ab94-c560f7d88a28", "name": "network-vif-plugged", "status": "completed", "tag": "d0886f87-0f0e-407a-9d0e-f311d469b7f2"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:57:36.015505 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-b9d85dad-f73e-4cb1-8fc9-5906f9e8f54e req-33bf701c-4337-4faf-b87c-b6d519e6aff8 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:36.016946 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-b9d85dad-f73e-4cb1-8fc9-5906f9e8f54e req-33bf701c-4337-4faf-b87c-b6d519e6aff8 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:36.018998 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-b9d85dad-f73e-4cb1-8fc9-5906f9e8f54e req-33bf701c-4337-4faf-b87c-b6d519e6aff8 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:36.088820 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-b9d85dad-f73e-4cb1-8fc9-5906f9e8f54e req-33bf701c-4337-4faf-b87c-b6d519e6aff8 service nova] Creating event network-vif-plugged:d0886f87-0f0e-407a-9d0e-f311d469b7f2 for instance 1c99e77a-8bb1-4e77-ab94-c560f7d88a28 on nch2-master-1 Sep 24 20:57:36.103928 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-b9d85dad-f73e-4cb1-8fc9-5906f9e8f54e req-33bf701c-4337-4faf-b87c-b6d519e6aff8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108388 Sep 24 20:57:36.107187 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1084/2163] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:57:36.122784 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-34ac234a-5ae2-4803-b121-af0ea7cc69d3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:36.125236 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-34ac234a-5ae2-4803-b121-af0ea7cc69d3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:36.162043 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-34ac234a-5ae2-4803-b121-af0ea7cc69d3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:36.163103 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-34ac234a-5ae2-4803-b121-af0ea7cc69d3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:36.164104 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-34ac234a-5ae2-4803-b121-af0ea7cc69d3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:36.167015 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-34ac234a-5ae2-4803-b121-af0ea7cc69d3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:36.169086 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-34ac234a-5ae2-4803-b121-af0ea7cc69d3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:36.172518 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-34ac234a-5ae2-4803-b121-af0ea7cc69d3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:36.208197 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-93477a05-f4aa-4637-b222-860752cd991e tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00585dbe7f814eeebda43417ca1d0ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265d7d88bb6f45708203ea74df8f3214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:36.224523 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-93477a05-f4aa-4637-b222-860752cd991e tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232" status: 200 len: 1318 microversion: 2.1 time: 0.954768 Sep 24 20:57:36.230126 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1080/2164] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:35 2022] GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232 => generated 1318 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:36.269783 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ddab5b29-e605-4064-ba45-60cf74d325c9 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:36.271357 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ddab5b29-e605-4064-ba45-60cf74d325c9 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] [instance: 1c99e77a-8bb1-4e77-ab94-c560f7d88a28] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:36.302745 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ddab5b29-e605-4064-ba45-60cf74d325c9 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:36.303568 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ddab5b29-e605-4064-ba45-60cf74d325c9 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:36.304026 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ddab5b29-e605-4064-ba45-60cf74d325c9 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:36.307357 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ddab5b29-e605-4064-ba45-60cf74d325c9 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:36.308133 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ddab5b29-e605-4064-ba45-60cf74d325c9 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:36.310958 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ddab5b29-e605-4064-ba45-60cf74d325c9 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:36.742732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-34ac234a-5ae2-4803-b121-af0ea7cc69d3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:36.757312 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-34ac234a-5ae2-4803-b121-af0ea7cc69d3 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5" status: 200 len: 1500 microversion: 2.1 time: 0.646920 Sep 24 20:57:36.767394 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1085/2165] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:36 2022] GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 => generated 1500 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:36.774135 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ba4b3563-372b-47a0-8011-36a1f662acce tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Calling method '.version_select at 0x7f4b0c7673a0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:36.787982 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ba4b3563-372b-47a0-8011-36a1f662acce tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:36.794311 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ba4b3563-372b-47a0-8011-36a1f662acce tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:36.795167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ba4b3563-372b-47a0-8011-36a1f662acce tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:36.819023 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ba4b3563-372b-47a0-8011-36a1f662acce tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 1697 microversion: 2.25 time: 0.049959 Sep 24 20:57:36.820400 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1086/2166] 10.222.0.52 () {60 vars in 1184 bytes} [Sat Sep 24 20:57:36 2022] GET /compute/v2.1/os-migrations => generated 1697 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:57:36.839976 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-adbe35b4-394e-4869-b979-fa833c539ab4 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:36.841049 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-adbe35b4-394e-4869-b979-fa833c539ab4 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:36.856543 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-adbe35b4-394e-4869-b979-fa833c539ab4 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:36.857593 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-adbe35b4-394e-4869-b979-fa833c539ab4 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:36.858333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-adbe35b4-394e-4869-b979-fa833c539ab4 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:36.859509 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-adbe35b4-394e-4869-b979-fa833c539ab4 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:36.860223 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-adbe35b4-394e-4869-b979-fa833c539ab4 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:36.860972 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-adbe35b4-394e-4869-b979-fa833c539ab4 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:37.423206 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ddab5b29-e605-4064-ba45-60cf74d325c9 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:37.436683 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ddab5b29-e605-4064-ba45-60cf74d325c9 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:37.439364 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ddab5b29-e605-4064-ba45-60cf74d325c9 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:37.462378 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ddab5b29-e605-4064-ba45-60cf74d325c9 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] 10.222.0.52 "GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28" status: 200 len: 1358 microversion: 2.21 time: 1.211379 Sep 24 20:57:37.463502 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1081/2167] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:36 2022] GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28 => generated 1358 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:57:37.487703 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fa8be398-81d5-4039-951d-60213cb2235d tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:37.488896 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fa8be398-81d5-4039-951d-60213cb2235d tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 8f800d64-00f6-4135-8090-c95d84acd232] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:37.497080 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fa8be398-81d5-4039-951d-60213cb2235d tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:37.506233 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fa8be398-81d5-4039-951d-60213cb2235d tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:37.511261 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fa8be398-81d5-4039-951d-60213cb2235d tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:37.513632 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fa8be398-81d5-4039-951d-60213cb2235d tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:37.514253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fa8be398-81d5-4039-951d-60213cb2235d tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:37.514830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fa8be398-81d5-4039-951d-60213cb2235d tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:37.840463 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-adbe35b4-394e-4869-b979-fa833c539ab4 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lazy-loading 'services' on Instance uuid 54ec06be-cb4b-4b5f-9ed8-904a328cc118 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:57:37.881983 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-adbe35b4-394e-4869-b979-fa833c539ab4 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 2419 microversion: 2.25 time: 1.042490 Sep 24 20:57:37.882926 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1087/2168] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:36 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 2419 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:57:37.919695 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-783faf62-b8fd-45c2-be24-a9d367034839 req-6fa9f3c6-0dc7-41bf-8383-c3743b2bc118 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8164fcd2-b47c-4b73-b5f3-4e71615a3ec5", "name": "network-vif-deleted", "tag": "7f54b87f-432c-4333-a0ed-d461564390c4"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:57:37.942553 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-783faf62-b8fd-45c2-be24-a9d367034839 req-6fa9f3c6-0dc7-41bf-8383-c3743b2bc118 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:37.943051 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-783faf62-b8fd-45c2-be24-a9d367034839 req-6fa9f3c6-0dc7-41bf-8383-c3743b2bc118 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:37.943483 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-783faf62-b8fd-45c2-be24-a9d367034839 req-6fa9f3c6-0dc7-41bf-8383-c3743b2bc118 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:37.957248 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-783faf62-b8fd-45c2-be24-a9d367034839 req-6fa9f3c6-0dc7-41bf-8383-c3743b2bc118 service nova] Creating event network-vif-deleted:7f54b87f-432c-4333-a0ed-d461564390c4 for instance 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 on nch2-master-1 Sep 24 20:57:37.962742 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-783faf62-b8fd-45c2-be24-a9d367034839 req-6fa9f3c6-0dc7-41bf-8383-c3743b2bc118 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067032 Sep 24 20:57:37.963705 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1088/2169] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:57:37.969617 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-76500757-5dd4-430d-8836-9c240adef36c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:37.971358 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-76500757-5dd4-430d-8836-9c240adef36c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:37.977691 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fa8be398-81d5-4039-951d-60213cb2235d tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00585dbe7f814eeebda43417ca1d0ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265d7d88bb6f45708203ea74df8f3214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:37.978933 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76500757-5dd4-430d-8836-9c240adef36c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:37.979627 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76500757-5dd4-430d-8836-9c240adef36c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:37.980247 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76500757-5dd4-430d-8836-9c240adef36c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:37.981309 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76500757-5dd4-430d-8836-9c240adef36c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:37.981940 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76500757-5dd4-430d-8836-9c240adef36c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:37.982568 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76500757-5dd4-430d-8836-9c240adef36c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:37.988027 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fa8be398-81d5-4039-951d-60213cb2235d tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232" status: 200 len: 1318 microversion: 2.1 time: 0.522840 Sep 24 20:57:38.016219 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1082/2170] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:37 2022] GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232 => generated 1318 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:38.024935 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-006fe433-353e-4834-b723-4b83f7e80f80 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:38.025615 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76500757-5dd4-430d-8836-9c240adef36c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:38.027395 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76500757-5dd4-430d-8836-9c240adef36c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:38.029544 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76500757-5dd4-430d-8836-9c240adef36c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:38.030282 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-76500757-5dd4-430d-8836-9c240adef36c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lazy-loading 'fault' on Instance uuid 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:57:38.042922 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-006fe433-353e-4834-b723-4b83f7e80f80 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:38.065538 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-006fe433-353e-4834-b723-4b83f7e80f80 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:38.074836 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-006fe433-353e-4834-b723-4b83f7e80f80 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:38.075646 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-006fe433-353e-4834-b723-4b83f7e80f80 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:38.094071 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-006fe433-353e-4834-b723-4b83f7e80f80 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:38.094797 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-006fe433-353e-4834-b723-4b83f7e80f80 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:38.095275 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-006fe433-353e-4834-b723-4b83f7e80f80 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:38.169408 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-76500757-5dd4-430d-8836-9c240adef36c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c03c67e0c4c4de7a186f28ac10d0b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b7e30f79bf42e497c53c091ad0a106', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:38.186241 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-76500757-5dd4-430d-8836-9c240adef36c tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5" status: 200 len: 1301 microversion: 2.1 time: 0.220782 Sep 24 20:57:38.186883 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1089/2171] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:37 2022] GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 => generated 1301 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:38.217425 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-0b6c01fe-e268-478f-878e-916d3cf0b3ab req-6897a8dc-0859-4798-8c90-948aa2544c65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51", "name": "network-vif-plugged", "status": "completed", "tag": "00c8986f-e263-4bab-8396-0009b8e0c3e8"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:57:38.236812 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-0b6c01fe-e268-478f-878e-916d3cf0b3ab req-6897a8dc-0859-4798-8c90-948aa2544c65 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:38.237604 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-0b6c01fe-e268-478f-878e-916d3cf0b3ab req-6897a8dc-0859-4798-8c90-948aa2544c65 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:38.238085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-0b6c01fe-e268-478f-878e-916d3cf0b3ab req-6897a8dc-0859-4798-8c90-948aa2544c65 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:38.272941 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-0b6c01fe-e268-478f-878e-916d3cf0b3ab req-6897a8dc-0859-4798-8c90-948aa2544c65 service nova] Creating event network-vif-plugged:00c8986f-e263-4bab-8396-0009b8e0c3e8 for instance 4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51 on nch2-master-1 Sep 24 20:57:38.287728 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-0b6c01fe-e268-478f-878e-916d3cf0b3ab req-6897a8dc-0859-4798-8c90-948aa2544c65 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071675 Sep 24 20:57:38.288625 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1090/2172] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:57:38.489916 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ca3b3d1e-e891-42d6-8422-87d2a22971d6 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:38.491082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ca3b3d1e-e891-42d6-8422-87d2a22971d6 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] [instance: 1c99e77a-8bb1-4e77-ab94-c560f7d88a28] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:38.501139 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ca3b3d1e-e891-42d6-8422-87d2a22971d6 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:38.506820 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ca3b3d1e-e891-42d6-8422-87d2a22971d6 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:38.507516 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ca3b3d1e-e891-42d6-8422-87d2a22971d6 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:38.508455 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ca3b3d1e-e891-42d6-8422-87d2a22971d6 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:38.509093 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ca3b3d1e-e891-42d6-8422-87d2a22971d6 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:38.509698 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ca3b3d1e-e891-42d6-8422-87d2a22971d6 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:38.604446 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-006fe433-353e-4834-b723-4b83f7e80f80 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] Lazy-loading 'services' on Instance uuid 54ec06be-cb4b-4b5f-9ed8-904a328cc118 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:57:38.677378 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-006fe433-353e-4834-b723-4b83f7e80f80 tempest-LiveAutoBlockMigrationV225Test-1380422539 tempest-LiveAutoBlockMigrationV225Test-1380422539-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 2419 microversion: 2.25 time: 0.658515 Sep 24 20:57:38.678699 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1083/2173] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:38 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 2419 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:57:38.916338 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9b76b119-ebed-4b7a-80e2-3bf5c7cd691e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:38.916957 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9b76b119-ebed-4b7a-80e2-3bf5c7cd691e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:38.937261 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9b76b119-ebed-4b7a-80e2-3bf5c7cd691e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:38.944228 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9b76b119-ebed-4b7a-80e2-3bf5c7cd691e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:38.948938 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9b76b119-ebed-4b7a-80e2-3bf5c7cd691e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:38.960708 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ca3b3d1e-e891-42d6-8422-87d2a22971d6 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:38.962985 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9b76b119-ebed-4b7a-80e2-3bf5c7cd691e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:38.963566 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9b76b119-ebed-4b7a-80e2-3bf5c7cd691e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:38.964029 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9b76b119-ebed-4b7a-80e2-3bf5c7cd691e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:38.974039 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ca3b3d1e-e891-42d6-8422-87d2a22971d6 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:38.978548 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ca3b3d1e-e891-42d6-8422-87d2a22971d6 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:38.984985 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ca3b3d1e-e891-42d6-8422-87d2a22971d6 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] 10.222.0.52 "GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28" status: 200 len: 1358 microversion: 2.21 time: 0.497715 Sep 24 20:57:38.985895 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1091/2174] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:38 2022] GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28 => generated 1358 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:57:39.028272 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-58ccac84-819a-4206-87e2-a18ae4f2c81a tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:39.029239 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-58ccac84-819a-4206-87e2-a18ae4f2c81a tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 8f800d64-00f6-4135-8090-c95d84acd232] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:39.039262 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58ccac84-819a-4206-87e2-a18ae4f2c81a tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:39.040526 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58ccac84-819a-4206-87e2-a18ae4f2c81a tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:39.040918 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58ccac84-819a-4206-87e2-a18ae4f2c81a tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:39.041655 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58ccac84-819a-4206-87e2-a18ae4f2c81a tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:39.042118 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58ccac84-819a-4206-87e2-a18ae4f2c81a tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:39.050674 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58ccac84-819a-4206-87e2-a18ae4f2c81a tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:39.587945 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-58ccac84-819a-4206-87e2-a18ae4f2c81a tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00585dbe7f814eeebda43417ca1d0ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265d7d88bb6f45708203ea74df8f3214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:39.607575 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-58ccac84-819a-4206-87e2-a18ae4f2c81a tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232" status: 200 len: 1318 microversion: 2.1 time: 0.577558 Sep 24 20:57:39.610970 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1092/2175] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:39 2022] GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232 => generated 1318 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:39.619806 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c58649cb-aeaf-4d22-b248-a5a8f0dc2858 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:39.620897 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c58649cb-aeaf-4d22-b248-a5a8f0dc2858 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] [instance: 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:39.641793 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c58649cb-aeaf-4d22-b248-a5a8f0dc2858 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:39.644422 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c58649cb-aeaf-4d22-b248-a5a8f0dc2858 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:39.647346 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c58649cb-aeaf-4d22-b248-a5a8f0dc2858 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:39.649279 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c58649cb-aeaf-4d22-b248-a5a8f0dc2858 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:39.651995 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c58649cb-aeaf-4d22-b248-a5a8f0dc2858 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:39.652795 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c58649cb-aeaf-4d22-b248-a5a8f0dc2858 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:39.707435 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-c58649cb-aeaf-4d22-b248-a5a8f0dc2858 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] HTTP exception thrown: Instance 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 could not be found. Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c58649cb-aeaf-4d22-b248-a5a8f0dc2858 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Request method failure captured: Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 HTTP/1.1 Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL22W-8wZmyHhPjnmqLAwGZ3mX4nIMGVBzhRCcf9yRpemeS-L-pQ-_V_nLRjxEZ-SLdpjyfDdbYT96U23uVeSrC_JfW-OZR0uiU2rIQ8b6jXauuTn3n6xaPicq5KAr5G3eZ5iymZw3vDvTM33hRL8Wt9H_E_Hy02-3xbdiMvDSMvifHM Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: a2b7e30f79bf42e497c53c091ad0a106 Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-LiveMigrationTest-471200620 Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a2b7e30f79bf42e497c53c091ad0a106"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a2b7e30f79bf42e497c53c091ad0a106"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a2b7e30f79bf42e497c53c091ad0a106"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a2b7e30f79bf42e497c53c091ad0a106"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-LiveMigrationTest-471200620 Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: a2b7e30f79bf42e497c53c091ad0a106 Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-LiveMigrationTest-471200620 Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-LiveMigrationTest-471200620-project Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 9c03c67e0c4c4de7a186f28ac10d0b92 Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-LiveMigrationTest-471200620-project Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 could not be found. Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '8164fcd2-b47c-4b73-b5f3-4e71615a3ec5'} Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 could not be found. Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 could not be found. Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:57:39.713977 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:57:39.722043 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:57:39.722043 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:57:39.722043 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:57:39.722043 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:57:39.722043 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:57:39.722043 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 could not be found. Sep 24 20:57:39.722043 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:57:39.725100 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c58649cb-aeaf-4d22-b248-a5a8f0dc2858 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] Returning 404 to user: Instance 8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:57:39.726277 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c58649cb-aeaf-4d22-b248-a5a8f0dc2858 tempest-LiveMigrationTest-471200620 tempest-LiveMigrationTest-471200620-project] 10.222.0.52 "GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5" status: 404 len: 111 microversion: 2.1 time: 0.113994 Sep 24 20:57:39.730915 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1093/2176] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:39 2022] GET /compute/v2.1/servers/8164fcd2-b47c-4b73-b5f3-4e71615a3ec5 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:57:39.804925 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-9b76b119-ebed-4b7a-80e2-3bf5c7cd691e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lazy-loading 'services' on Instance uuid 54ec06be-cb4b-4b5f-9ed8-904a328cc118 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:57:40.015954 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b35f2e8c-0027-48da-b3e9-e4f3b888f6e2 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:40.017187 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b35f2e8c-0027-48da-b3e9-e4f3b888f6e2 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] [instance: 1c99e77a-8bb1-4e77-ab94-c560f7d88a28] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:40.034661 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b35f2e8c-0027-48da-b3e9-e4f3b888f6e2 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:40.035898 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b35f2e8c-0027-48da-b3e9-e4f3b888f6e2 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:40.036629 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b35f2e8c-0027-48da-b3e9-e4f3b888f6e2 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:40.038701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b35f2e8c-0027-48da-b3e9-e4f3b888f6e2 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:40.039196 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b35f2e8c-0027-48da-b3e9-e4f3b888f6e2 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:40.039777 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b35f2e8c-0027-48da-b3e9-e4f3b888f6e2 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:40.082602 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9b76b119-ebed-4b7a-80e2-3bf5c7cd691e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "DELETE /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments/f910cbdd-fbe4-4cac-bdb7-3b663c4f26d2" status: 202 len: 0 microversion: 2.25 time: 1.174639 Sep 24 20:57:40.084755 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1084/2177] 10.222.0.52 () {60 vars in 1457 bytes} [Sat Sep 24 20:57:38 2022] DELETE /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments/f910cbdd-fbe4-4cac-bdb7-3b663c4f26d2 => generated 0 bytes in 1178 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:57:40.124631 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-52826298-06b3-4a0e-b93d-2d338c0bc112 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:40.138033 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-52826298-06b3-4a0e-b93d-2d338c0bc112 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:40.162239 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-52826298-06b3-4a0e-b93d-2d338c0bc112 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:40.164530 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-52826298-06b3-4a0e-b93d-2d338c0bc112 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:40.165042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-52826298-06b3-4a0e-b93d-2d338c0bc112 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:40.167095 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-52826298-06b3-4a0e-b93d-2d338c0bc112 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:40.168604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-52826298-06b3-4a0e-b93d-2d338c0bc112 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:40.169071 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-52826298-06b3-4a0e-b93d-2d338c0bc112 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:40.292223 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-52826298-06b3-4a0e-b93d-2d338c0bc112 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.192045 Sep 24 20:57:40.293149 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1085/2178] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:57:40 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:57:40.534317 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-81285dc4-6e03-4882-8329-31285354ab7b req-439a62bd-2778-439f-8fa4-64f621e0a2b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f800d64-00f6-4135-8090-c95d84acd232", "name": "network-vif-plugged", "status": "completed", "tag": "04879ee8-ed63-4eba-999f-e92bf51322a7"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:57:40.557101 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-81285dc4-6e03-4882-8329-31285354ab7b req-439a62bd-2778-439f-8fa4-64f621e0a2b0 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:40.557597 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-81285dc4-6e03-4882-8329-31285354ab7b req-439a62bd-2778-439f-8fa4-64f621e0a2b0 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:40.558035 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-81285dc4-6e03-4882-8329-31285354ab7b req-439a62bd-2778-439f-8fa4-64f621e0a2b0 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:40.585343 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-81285dc4-6e03-4882-8329-31285354ab7b req-439a62bd-2778-439f-8fa4-64f621e0a2b0 service nova] Creating event network-vif-plugged:04879ee8-ed63-4eba-999f-e92bf51322a7 for instance 8f800d64-00f6-4135-8090-c95d84acd232 on nch2-master-1 Sep 24 20:57:40.590847 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-81285dc4-6e03-4882-8329-31285354ab7b req-439a62bd-2778-439f-8fa4-64f621e0a2b0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060468 Sep 24 20:57:40.592140 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1086/2179] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:57:40.644408 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-845abfdf-a43b-49d1-ac0d-952079d641f0 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:40.647555 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-845abfdf-a43b-49d1-ac0d-952079d641f0 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 8f800d64-00f6-4135-8090-c95d84acd232] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:40.667916 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-845abfdf-a43b-49d1-ac0d-952079d641f0 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:40.670386 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-845abfdf-a43b-49d1-ac0d-952079d641f0 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:40.672362 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-845abfdf-a43b-49d1-ac0d-952079d641f0 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:40.675195 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-845abfdf-a43b-49d1-ac0d-952079d641f0 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:40.679610 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-845abfdf-a43b-49d1-ac0d-952079d641f0 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:40.680734 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-845abfdf-a43b-49d1-ac0d-952079d641f0 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:41.172220 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b35f2e8c-0027-48da-b3e9-e4f3b888f6e2 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:41.187517 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b35f2e8c-0027-48da-b3e9-e4f3b888f6e2 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:41.189002 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b35f2e8c-0027-48da-b3e9-e4f3b888f6e2 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:41.190963 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b35f2e8c-0027-48da-b3e9-e4f3b888f6e2 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] 10.222.0.52 "GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28" status: 200 len: 1551 microversion: 2.21 time: 1.179363 Sep 24 20:57:41.227802 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1094/2180] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:40 2022] GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28 => generated 1551 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:57:41.234108 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c961e99d-9f09-43a4-8a7c-1ef531d5dadd tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:41.234360 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c961e99d-9f09-43a4-8a7c-1ef531d5dadd tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] [instance: 1c99e77a-8bb1-4e77-ab94-c560f7d88a28] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:41.257814 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c961e99d-9f09-43a4-8a7c-1ef531d5dadd tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:41.259138 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c961e99d-9f09-43a4-8a7c-1ef531d5dadd tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:41.260259 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c961e99d-9f09-43a4-8a7c-1ef531d5dadd tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:41.261376 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c961e99d-9f09-43a4-8a7c-1ef531d5dadd tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:41.264312 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c961e99d-9f09-43a4-8a7c-1ef531d5dadd tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:41.265017 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c961e99d-9f09-43a4-8a7c-1ef531d5dadd tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:41.322300 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c961e99d-9f09-43a4-8a7c-1ef531d5dadd tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] [instance: 1c99e77a-8bb1-4e77-ab94-c560f7d88a28] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:57:41.488104 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c961e99d-9f09-43a4-8a7c-1ef531d5dadd tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28" status: 204 len: 0 microversion: 2.21 time: 0.254877 Sep 24 20:57:41.490304 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1095/2181] 10.222.0.52 () {60 vars in 1280 bytes} [Sat Sep 24 20:57:41 2022] DELETE /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 24 20:57:41.510477 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-180d8cf2-4dab-41fb-b1fb-193878ec6787 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:41.521175 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-180d8cf2-4dab-41fb-b1fb-193878ec6787 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:41.530332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-180d8cf2-4dab-41fb-b1fb-193878ec6787 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:41.531053 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-180d8cf2-4dab-41fb-b1fb-193878ec6787 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:41.531920 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-180d8cf2-4dab-41fb-b1fb-193878ec6787 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:41.532826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-180d8cf2-4dab-41fb-b1fb-193878ec6787 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:41.534874 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-180d8cf2-4dab-41fb-b1fb-193878ec6787 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:41.535495 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-180d8cf2-4dab-41fb-b1fb-193878ec6787 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:41.604852 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-180d8cf2-4dab-41fb-b1fb-193878ec6787 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.113009 Sep 24 20:57:41.606310 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1096/2182] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:57:41 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:57:41.613287 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-eb1e407b-a1bd-47b1-bf25-41ec405a1b43 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:41.624080 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-eb1e407b-a1bd-47b1-bf25-41ec405a1b43 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] [instance: 1c99e77a-8bb1-4e77-ab94-c560f7d88a28] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:41.635858 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb1e407b-a1bd-47b1-bf25-41ec405a1b43 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:41.638860 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb1e407b-a1bd-47b1-bf25-41ec405a1b43 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:41.639536 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb1e407b-a1bd-47b1-bf25-41ec405a1b43 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:41.640545 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb1e407b-a1bd-47b1-bf25-41ec405a1b43 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:41.641206 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb1e407b-a1bd-47b1-bf25-41ec405a1b43 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:41.642067 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb1e407b-a1bd-47b1-bf25-41ec405a1b43 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:41.697357 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-845abfdf-a43b-49d1-ac0d-952079d641f0 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00585dbe7f814eeebda43417ca1d0ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265d7d88bb6f45708203ea74df8f3214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:41.705708 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-845abfdf-a43b-49d1-ac0d-952079d641f0 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232" status: 200 len: 1318 microversion: 2.1 time: 1.072014 Sep 24 20:57:41.710757 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1087/2183] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:40 2022] GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232 => generated 1318 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:42.078725 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-eb1e407b-a1bd-47b1-bf25-41ec405a1b43 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:42.100695 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-eb1e407b-a1bd-47b1-bf25-41ec405a1b43 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:42.102803 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-eb1e407b-a1bd-47b1-bf25-41ec405a1b43 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:42.106042 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-eb1e407b-a1bd-47b1-bf25-41ec405a1b43 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] 10.222.0.52 "GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28" status: 200 len: 1557 microversion: 2.21 time: 0.497497 Sep 24 20:57:42.109385 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1097/2184] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:41 2022] GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28 => generated 1557 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:57:42.619580 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-63e251bb-cb4a-4ce9-8c0c-94e00ee00b80 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:42.621953 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-63e251bb-cb4a-4ce9-8c0c-94e00ee00b80 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:42.642313 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-63e251bb-cb4a-4ce9-8c0c-94e00ee00b80 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:42.643813 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-63e251bb-cb4a-4ce9-8c0c-94e00ee00b80 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:42.644634 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-63e251bb-cb4a-4ce9-8c0c-94e00ee00b80 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:42.645583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-63e251bb-cb4a-4ce9-8c0c-94e00ee00b80 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:42.646561 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-63e251bb-cb4a-4ce9-8c0c-94e00ee00b80 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:42.647178 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-63e251bb-cb4a-4ce9-8c0c-94e00ee00b80 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:42.732613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-331a1ab1-bd93-4e25-8f31-a104d2633858 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:42.733837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-331a1ab1-bd93-4e25-8f31-a104d2633858 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 8f800d64-00f6-4135-8090-c95d84acd232] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:42.748448 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-331a1ab1-bd93-4e25-8f31-a104d2633858 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:42.750090 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-63e251bb-cb4a-4ce9-8c0c-94e00ee00b80 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.136000 Sep 24 20:57:42.753654 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1088/2185] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:57:42 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:57:42.754266 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-331a1ab1-bd93-4e25-8f31-a104d2633858 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:42.755025 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-331a1ab1-bd93-4e25-8f31-a104d2633858 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:42.758925 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-331a1ab1-bd93-4e25-8f31-a104d2633858 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:42.761231 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-331a1ab1-bd93-4e25-8f31-a104d2633858 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:42.761885 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-331a1ab1-bd93-4e25-8f31-a104d2633858 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:43.138979 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-48c2ecc0-40fd-4182-88a4-d7e0cd60f7d6 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:43.139719 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-48c2ecc0-40fd-4182-88a4-d7e0cd60f7d6 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] [instance: 1c99e77a-8bb1-4e77-ab94-c560f7d88a28] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:43.146826 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-48c2ecc0-40fd-4182-88a4-d7e0cd60f7d6 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:43.159189 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-48c2ecc0-40fd-4182-88a4-d7e0cd60f7d6 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:43.159660 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-48c2ecc0-40fd-4182-88a4-d7e0cd60f7d6 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:43.160438 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-48c2ecc0-40fd-4182-88a4-d7e0cd60f7d6 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:43.160925 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-48c2ecc0-40fd-4182-88a4-d7e0cd60f7d6 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:43.161354 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-48c2ecc0-40fd-4182-88a4-d7e0cd60f7d6 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:43.369312 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-331a1ab1-bd93-4e25-8f31-a104d2633858 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00585dbe7f814eeebda43417ca1d0ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265d7d88bb6f45708203ea74df8f3214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:43.389808 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-331a1ab1-bd93-4e25-8f31-a104d2633858 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232" status: 200 len: 1318 microversion: 2.1 time: 0.659763 Sep 24 20:57:43.411841 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1098/2186] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:42 2022] GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232 => generated 1318 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:57:43.765733 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4beda486-2415-4dbe-b393-f680c189aafd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:43.770488 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4beda486-2415-4dbe-b393-f680c189aafd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:43.795579 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4beda486-2415-4dbe-b393-f680c189aafd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:43.799320 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4beda486-2415-4dbe-b393-f680c189aafd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:43.800001 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4beda486-2415-4dbe-b393-f680c189aafd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:43.802946 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4beda486-2415-4dbe-b393-f680c189aafd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:43.803663 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4beda486-2415-4dbe-b393-f680c189aafd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:43.807144 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4beda486-2415-4dbe-b393-f680c189aafd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:43.885252 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:57:43.906345 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4beda486-2415-4dbe-b393-f680c189aafd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.144776 Sep 24 20:57:43.907276 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1099/2187] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:57:43 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 20:57:43.945335 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-48c2ecc0-40fd-4182-88a4-d7e0cd60f7d6 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:43.979157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-48c2ecc0-40fd-4182-88a4-d7e0cd60f7d6 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:43.981449 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-48c2ecc0-40fd-4182-88a4-d7e0cd60f7d6 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:43.990935 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-48c2ecc0-40fd-4182-88a4-d7e0cd60f7d6 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] 10.222.0.52 "GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28" status: 200 len: 1557 microversion: 2.21 time: 0.849535 Sep 24 20:57:44.008185 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1089/2188] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:43 2022] GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28 => generated 1557 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:57:44.422520 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bf2b1c90-09da-4e8c-826b-dd7f601259bb tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:44.423470 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bf2b1c90-09da-4e8c-826b-dd7f601259bb tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 8f800d64-00f6-4135-8090-c95d84acd232] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:44.449408 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf2b1c90-09da-4e8c-826b-dd7f601259bb tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:44.449924 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf2b1c90-09da-4e8c-826b-dd7f601259bb tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:44.450369 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf2b1c90-09da-4e8c-826b-dd7f601259bb tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:44.454466 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf2b1c90-09da-4e8c-826b-dd7f601259bb tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:44.466681 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf2b1c90-09da-4e8c-826b-dd7f601259bb tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:44.467570 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf2b1c90-09da-4e8c-826b-dd7f601259bb tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:44.920127 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2e4ebc66-89e3-49a0-9f5c-038d4289a00c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:44.922476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2e4ebc66-89e3-49a0-9f5c-038d4289a00c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:44.944723 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e4ebc66-89e3-49a0-9f5c-038d4289a00c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:44.945280 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e4ebc66-89e3-49a0-9f5c-038d4289a00c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:44.945730 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e4ebc66-89e3-49a0-9f5c-038d4289a00c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:44.946480 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e4ebc66-89e3-49a0-9f5c-038d4289a00c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:44.948902 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e4ebc66-89e3-49a0-9f5c-038d4289a00c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:44.949343 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e4ebc66-89e3-49a0-9f5c-038d4289a00c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:45.021424 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2e4ebc66-89e3-49a0-9f5c-038d4289a00c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.105326 Sep 24 20:57:45.026322 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1090/2189] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:57:44 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:57:45.031751 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5ec8e673-4f1f-43b3-8f0b-71bbf3494887 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:45.040152 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5ec8e673-4f1f-43b3-8f0b-71bbf3494887 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] [instance: 1c99e77a-8bb1-4e77-ab94-c560f7d88a28] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:45.064387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ec8e673-4f1f-43b3-8f0b-71bbf3494887 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:45.066096 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ec8e673-4f1f-43b3-8f0b-71bbf3494887 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:45.066826 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ec8e673-4f1f-43b3-8f0b-71bbf3494887 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:45.067960 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ec8e673-4f1f-43b3-8f0b-71bbf3494887 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:45.068882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ec8e673-4f1f-43b3-8f0b-71bbf3494887 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:45.069529 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ec8e673-4f1f-43b3-8f0b-71bbf3494887 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:45.156678 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:57:45.724833 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bf2b1c90-09da-4e8c-826b-dd7f601259bb tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00585dbe7f814eeebda43417ca1d0ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265d7d88bb6f45708203ea74df8f3214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:45.740005 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bf2b1c90-09da-4e8c-826b-dd7f601259bb tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232" status: 200 len: 1468 microversion: 2.1 time: 1.324162 Sep 24 20:57:45.742557 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1100/2190] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:44 2022] GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232 => generated 1468 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:45.768285 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-422b8394-2a66-442c-8684-c21d7389e3cd tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:45.769067 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-422b8394-2a66-442c-8684-c21d7389e3cd tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:45.784655 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-422b8394-2a66-442c-8684-c21d7389e3cd tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:45.785194 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-422b8394-2a66-442c-8684-c21d7389e3cd tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:45.785664 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-422b8394-2a66-442c-8684-c21d7389e3cd tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:45.786420 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-422b8394-2a66-442c-8684-c21d7389e3cd tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:45.790565 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-422b8394-2a66-442c-8684-c21d7389e3cd tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:45.793004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-422b8394-2a66-442c-8684-c21d7389e3cd tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:45.944082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5ec8e673-4f1f-43b3-8f0b-71bbf3494887 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:45.960804 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5ec8e673-4f1f-43b3-8f0b-71bbf3494887 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:45.962286 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5ec8e673-4f1f-43b3-8f0b-71bbf3494887 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:45.963527 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5ec8e673-4f1f-43b3-8f0b-71bbf3494887 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] 10.222.0.52 "GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28" status: 200 len: 1557 microversion: 2.21 time: 0.935936 Sep 24 20:57:45.976028 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1091/2191] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:45 2022] GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28 => generated 1557 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:57:46.035763 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dd4c658f-f3ec-48d0-9a70-d7add02b3906 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:46.038869 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-dd4c658f-f3ec-48d0-9a70-d7add02b3906 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:46.060550 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd4c658f-f3ec-48d0-9a70-d7add02b3906 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:46.061083 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd4c658f-f3ec-48d0-9a70-d7add02b3906 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:46.061490 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd4c658f-f3ec-48d0-9a70-d7add02b3906 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:46.062212 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd4c658f-f3ec-48d0-9a70-d7add02b3906 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:46.062709 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd4c658f-f3ec-48d0-9a70-d7add02b3906 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:46.063144 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd4c658f-f3ec-48d0-9a70-d7add02b3906 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:46.140037 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-dd4c658f-f3ec-48d0-9a70-d7add02b3906 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.108941 Sep 24 20:57:46.143389 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1092/2192] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:57:46 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 20:57:46.160153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-2a9c5510-36a0-4fd8-b859-7c6397fe798b req-25b45937-9675-4017-b51d-c6961d933290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c99e77a-8bb1-4e77-ab94-c560f7d88a28", "name": "network-vif-deleted", "tag": "d0886f87-0f0e-407a-9d0e-f311d469b7f2"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:57:46.197179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-2a9c5510-36a0-4fd8-b859-7c6397fe798b req-25b45937-9675-4017-b51d-c6961d933290 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:46.197686 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-2a9c5510-36a0-4fd8-b859-7c6397fe798b req-25b45937-9675-4017-b51d-c6961d933290 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:46.198131 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-2a9c5510-36a0-4fd8-b859-7c6397fe798b req-25b45937-9675-4017-b51d-c6961d933290 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:46.219172 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-2a9c5510-36a0-4fd8-b859-7c6397fe798b req-25b45937-9675-4017-b51d-c6961d933290 service nova] Creating event network-vif-deleted:d0886f87-0f0e-407a-9d0e-f311d469b7f2 for instance 1c99e77a-8bb1-4e77-ab94-c560f7d88a28 on nch2-master-1 Sep 24 20:57:46.229241 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-2a9c5510-36a0-4fd8-b859-7c6397fe798b req-25b45937-9675-4017-b51d-c6961d933290 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083032 Sep 24 20:57:46.230686 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1093/2193] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:57:46.787861 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-422b8394-2a66-442c-8684-c21d7389e3cd tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00585dbe7f814eeebda43417ca1d0ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265d7d88bb6f45708203ea74df8f3214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:46.798166 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-422b8394-2a66-442c-8684-c21d7389e3cd tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/servers/4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51" status: 200 len: 1466 microversion: 2.1 time: 1.034305 Sep 24 20:57:46.819323 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1101/2194] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:45 2022] GET /compute/v2.1/servers/4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51 => generated 1466 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:46.841709 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a9bde7da-b9e1-412f-947c-6fe75cd580f5 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1332809382"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:57:46.844767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a9bde7da-b9e1-412f-947c-6fe75cd580f5 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:46.852882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a9bde7da-b9e1-412f-947c-6fe75cd580f5 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:46.853762 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a9bde7da-b9e1-412f-947c-6fe75cd580f5 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:46.854421 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a9bde7da-b9e1-412f-947c-6fe75cd580f5 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:46.855568 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a9bde7da-b9e1-412f-947c-6fe75cd580f5 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:46.856684 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a9bde7da-b9e1-412f-947c-6fe75cd580f5 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:46.857292 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a9bde7da-b9e1-412f-947c-6fe75cd580f5 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:47.009615 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9fd64479-c91b-44bb-8fb7-574c93f01d4b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:47.010965 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9fd64479-c91b-44bb-8fb7-574c93f01d4b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] [instance: 1c99e77a-8bb1-4e77-ab94-c560f7d88a28] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:47.025029 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fd64479-c91b-44bb-8fb7-574c93f01d4b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:47.026447 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fd64479-c91b-44bb-8fb7-574c93f01d4b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:47.028102 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fd64479-c91b-44bb-8fb7-574c93f01d4b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:47.030739 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fd64479-c91b-44bb-8fb7-574c93f01d4b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:47.031515 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fd64479-c91b-44bb-8fb7-574c93f01d4b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:47.033643 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fd64479-c91b-44bb-8fb7-574c93f01d4b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:47.149837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fd64479-c91b-44bb-8fb7-574c93f01d4b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:47.152265 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fd64479-c91b-44bb-8fb7-574c93f01d4b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:47.152726 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fd64479-c91b-44bb-8fb7-574c93f01d4b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:47.153391 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-9fd64479-c91b-44bb-8fb7-574c93f01d4b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lazy-loading 'fault' on Instance uuid 1c99e77a-8bb1-4e77-ab94-c560f7d88a28 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:57:47.164726 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a9bde7da-b9e1-412f-947c-6fe75cd580f5 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "POST /compute/v2.1/servers/4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51/action" status: 202 len: 0 microversion: 2.1 time: 0.326289 Sep 24 20:57:47.166892 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1094/2195] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:57:46 2022] POST /compute/v2.1/servers/4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 24 20:57:47.173173 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-aec4549d-53c5-4ddd-9287-adb4109f7d93 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:47.178390 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-aec4549d-53c5-4ddd-9287-adb4109f7d93 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:47.188109 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aec4549d-53c5-4ddd-9287-adb4109f7d93 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:47.188739 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aec4549d-53c5-4ddd-9287-adb4109f7d93 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:47.189433 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aec4549d-53c5-4ddd-9287-adb4109f7d93 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:47.190648 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aec4549d-53c5-4ddd-9287-adb4109f7d93 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:47.191351 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aec4549d-53c5-4ddd-9287-adb4109f7d93 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:47.192439 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aec4549d-53c5-4ddd-9287-adb4109f7d93 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:47.247014 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-aec4549d-53c5-4ddd-9287-adb4109f7d93 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.078252 Sep 24 20:57:47.248128 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1095/2196] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:57:47 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:57:47.287759 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6415560a-3f87-433e-ab76-c36bcb794bc1 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b11075a60>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:47.304076 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9fd64479-c91b-44bb-8fb7-574c93f01d4b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:47.321154 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9fd64479-c91b-44bb-8fb7-574c93f01d4b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:47.325469 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9fd64479-c91b-44bb-8fb7-574c93f01d4b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f062663eef74d63aea291eaa5f213a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7588851b153c4c0dbc7e63cfa1778497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:47.326823 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9fd64479-c91b-44bb-8fb7-574c93f01d4b tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] 10.222.0.52 "GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28" status: 200 len: 1348 microversion: 2.21 time: 0.329113 Sep 24 20:57:47.342521 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1102/2197] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:46 2022] GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28 => generated 1348 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:57:47.367171 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6415560a-3f87-433e-ab76-c36bcb794bc1 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613" status: 200 len: 1451 microversion: 2.1 time: 0.117016 Sep 24 20:57:47.368273 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1096/2198] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:57:47 2022] GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613 => generated 1451 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:48.261458 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cc9e8d57-8bb9-45d9-a290-eefcf702363c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:48.264421 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cc9e8d57-8bb9-45d9-a290-eefcf702363c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:48.286605 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cc9e8d57-8bb9-45d9-a290-eefcf702363c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:48.288636 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cc9e8d57-8bb9-45d9-a290-eefcf702363c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:48.292596 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cc9e8d57-8bb9-45d9-a290-eefcf702363c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:48.297645 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cc9e8d57-8bb9-45d9-a290-eefcf702363c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:48.298622 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cc9e8d57-8bb9-45d9-a290-eefcf702363c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:48.301353 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cc9e8d57-8bb9-45d9-a290-eefcf702363c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:48.374273 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-245f9dcb-bbb8-417b-8881-b9287a4deb50 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:48.381648 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-245f9dcb-bbb8-417b-8881-b9287a4deb50 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] [instance: 1c99e77a-8bb1-4e77-ab94-c560f7d88a28] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:48.398980 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cc9e8d57-8bb9-45d9-a290-eefcf702363c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.142008 Sep 24 20:57:48.407672 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1103/2199] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:57:48 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:57:48.410045 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-245f9dcb-bbb8-417b-8881-b9287a4deb50 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:48.410584 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-245f9dcb-bbb8-417b-8881-b9287a4deb50 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:48.414830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-245f9dcb-bbb8-417b-8881-b9287a4deb50 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:48.415666 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-245f9dcb-bbb8-417b-8881-b9287a4deb50 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:48.417452 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a565d47a-a1cf-48e0-9bc6-40183678a021 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b0c895af0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:48.418237 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-245f9dcb-bbb8-417b-8881-b9287a4deb50 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:48.418740 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-245f9dcb-bbb8-417b-8881-b9287a4deb50 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:48.469447 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-245f9dcb-bbb8-417b-8881-b9287a4deb50 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] HTTP exception thrown: Instance 1c99e77a-8bb1-4e77-ab94-c560f7d88a28 could not be found. Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-245f9dcb-bbb8-417b-8881-b9287a4deb50 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Request method failure captured: Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28 HTTP/1.1 Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL28kQRRGE6Taeo-IOq7zYbluCNNhM4X9oW4oxw_u9GXAoUBWTdll6JexfzCtpGxAMa8pAMd6CPj9qF_OANbCDfIXv_Qm_d2Zt-rb2AvTG80_o0FAFvH_w2_iPgiR-zFZUpqIfetprA-gGAEQI3b6FlMl_ZhECCJBiPx6EVbFIPSVrm0 Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: X-Openstack-Nova-Api-Version: 2.21 Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 7588851b153c4c0dbc7e63cfa1778497 Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1345030741 Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7588851b153c4c0dbc7e63cfa1778497"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7588851b153c4c0dbc7e63cfa1778497"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7588851b153c4c0dbc7e63cfa1778497"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7588851b153c4c0dbc7e63cfa1778497"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-InstanceActionsV221TestJSON-1345030741 Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 7588851b153c4c0dbc7e63cfa1778497 Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1345030741 Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-InstanceActionsV221TestJSON-1345030741-project Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 2f062663eef74d63aea291eaa5f213a4 Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-InstanceActionsV221TestJSON-1345030741-project Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 1c99e77a-8bb1-4e77-ab94-c560f7d88a28 could not be found. Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '1c99e77a-8bb1-4e77-ab94-c560f7d88a28'} Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c99e77a-8bb1-4e77-ab94-c560f7d88a28 could not be found. Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c99e77a-8bb1-4e77-ab94-c560f7d88a28 could not be found. Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:57:48.471267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:57:48.479089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:57:48.479089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:57:48.479089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:57:48.479089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:57:48.479089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:57:48.479089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:57:48.479089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c99e77a-8bb1-4e77-ab94-c560f7d88a28 could not be found. Sep 24 20:57:48.479089 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:57:48.479089 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-245f9dcb-bbb8-417b-8881-b9287a4deb50 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Returning 404 to user: Instance 1c99e77a-8bb1-4e77-ab94-c560f7d88a28 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:57:48.479089 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-245f9dcb-bbb8-417b-8881-b9287a4deb50 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] 10.222.0.52 "GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28" status: 404 len: 111 microversion: 2.21 time: 0.103329 Sep 24 20:57:48.479089 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1097/2200] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:48 2022] GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 20:57:48.486936 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3daa51d1-0603-489c-abfa-427b86ee7e6f tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Calling method '.version_select at 0x7f4b11075790>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:48.487798 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3daa51d1-0603-489c-abfa-427b86ee7e6f tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] [instance: 1c99e77a-8bb1-4e77-ab94-c560f7d88a28] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:48.494657 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3daa51d1-0603-489c-abfa-427b86ee7e6f tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:48.494816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3daa51d1-0603-489c-abfa-427b86ee7e6f tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:48.495720 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3daa51d1-0603-489c-abfa-427b86ee7e6f tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:48.496830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3daa51d1-0603-489c-abfa-427b86ee7e6f tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:48.497718 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3daa51d1-0603-489c-abfa-427b86ee7e6f tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:48.498331 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3daa51d1-0603-489c-abfa-427b86ee7e6f tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:48.508527 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a565d47a-a1cf-48e0-9bc6-40183678a021 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613" status: 200 len: 1451 microversion: 2.1 time: 0.097999 Sep 24 20:57:48.509632 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1104/2201] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:57:48 2022] GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613 => generated 1451 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:48.617597 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3daa51d1-0603-489c-abfa-427b86ee7e6f tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] 10.222.0.52 "GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.134719 Sep 24 20:57:48.628262 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1098/2202] 10.222.0.52 () {60 vars in 1337 bytes} [Sat Sep 24 20:57:48 2022] GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28/os-instance-actions => generated 611 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:57:48.636907 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c988be04-d1cc-4ba5-85ba-81971fc370e0 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:48.637678 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c988be04-d1cc-4ba5-85ba-81971fc370e0 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] [instance: 1c99e77a-8bb1-4e77-ab94-c560f7d88a28] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:48.648545 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c988be04-d1cc-4ba5-85ba-81971fc370e0 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:48.649362 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c988be04-d1cc-4ba5-85ba-81971fc370e0 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:48.649985 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c988be04-d1cc-4ba5-85ba-81971fc370e0 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:48.651432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c988be04-d1cc-4ba5-85ba-81971fc370e0 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:48.652087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c988be04-d1cc-4ba5-85ba-81971fc370e0 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:48.653476 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c988be04-d1cc-4ba5-85ba-81971fc370e0 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:48.678072 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-c988be04-d1cc-4ba5-85ba-81971fc370e0 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] HTTP exception thrown: Instance 1c99e77a-8bb1-4e77-ab94-c560f7d88a28 could not be found. Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c988be04-d1cc-4ba5-85ba-81971fc370e0 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Request method failure captured: Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28 HTTP/1.1 Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL28kQRRGE6Taeo-IOq7zYbluCNNhM4X9oW4oxw_u9GXAoUBWTdll6JexfzCtpGxAMa8pAMd6CPj9qF_OANbCDfIXv_Qm_d2Zt-rb2AvTG80_o0FAFvH_w2_iPgiR-zFZUpqIfetprA-gGAEQI3b6FlMl_ZhECCJBiPx6EVbFIPSVrm0 Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: X-Openstack-Nova-Api-Version: 2.21 Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 7588851b153c4c0dbc7e63cfa1778497 Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1345030741 Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7588851b153c4c0dbc7e63cfa1778497"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7588851b153c4c0dbc7e63cfa1778497"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7588851b153c4c0dbc7e63cfa1778497"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7588851b153c4c0dbc7e63cfa1778497"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-InstanceActionsV221TestJSON-1345030741 Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 7588851b153c4c0dbc7e63cfa1778497 Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1345030741 Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-InstanceActionsV221TestJSON-1345030741-project Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 2f062663eef74d63aea291eaa5f213a4 Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-InstanceActionsV221TestJSON-1345030741-project Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 1c99e77a-8bb1-4e77-ab94-c560f7d88a28 could not be found. Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '1c99e77a-8bb1-4e77-ab94-c560f7d88a28'} Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c99e77a-8bb1-4e77-ab94-c560f7d88a28 could not be found. Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:57:48.680188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:57:48.685602 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c99e77a-8bb1-4e77-ab94-c560f7d88a28 could not be found. Sep 24 20:57:48.685602 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:57:48.685602 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:57:48.685602 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:57:48.685602 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:57:48.685602 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:57:48.685602 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:57:48.685602 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:57:48.685602 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:57:48.685602 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c99e77a-8bb1-4e77-ab94-c560f7d88a28 could not be found. Sep 24 20:57:48.685602 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:57:48.687597 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c988be04-d1cc-4ba5-85ba-81971fc370e0 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Returning 404 to user: Instance 1c99e77a-8bb1-4e77-ab94-c560f7d88a28 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:57:48.688758 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c988be04-d1cc-4ba5-85ba-81971fc370e0 tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28" status: 404 len: 111 microversion: 2.21 time: 0.057030 Sep 24 20:57:48.690862 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1105/2203] 10.222.0.52 () {60 vars in 1280 bytes} [Sat Sep 24 20:57:48 2022] DELETE /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 20:57:48.699583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c5040a72-5f0f-47e2-ba1e-3d9923a31d3e tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:48.700522 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c5040a72-5f0f-47e2-ba1e-3d9923a31d3e tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] [instance: 1c99e77a-8bb1-4e77-ab94-c560f7d88a28] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:48.713241 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5040a72-5f0f-47e2-ba1e-3d9923a31d3e tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:48.714925 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5040a72-5f0f-47e2-ba1e-3d9923a31d3e tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:48.718151 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5040a72-5f0f-47e2-ba1e-3d9923a31d3e tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:48.719941 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5040a72-5f0f-47e2-ba1e-3d9923a31d3e tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:48.720678 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5040a72-5f0f-47e2-ba1e-3d9923a31d3e tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:48.722822 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5040a72-5f0f-47e2-ba1e-3d9923a31d3e tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:48.764594 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-c5040a72-5f0f-47e2-ba1e-3d9923a31d3e tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] HTTP exception thrown: Instance 1c99e77a-8bb1-4e77-ab94-c560f7d88a28 could not be found. Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c5040a72-5f0f-47e2-ba1e-3d9923a31d3e tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Request method failure captured: Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28 HTTP/1.1 Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL28kQRRGE6Taeo-IOq7zYbluCNNhM4X9oW4oxw_u9GXAoUBWTdll6JexfzCtpGxAMa8pAMd6CPj9qF_OANbCDfIXv_Qm_d2Zt-rb2AvTG80_o0FAFvH_w2_iPgiR-zFZUpqIfetprA-gGAEQI3b6FlMl_ZhECCJBiPx6EVbFIPSVrm0 Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: X-Openstack-Nova-Api-Version: 2.21 Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 7588851b153c4c0dbc7e63cfa1778497 Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1345030741 Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7588851b153c4c0dbc7e63cfa1778497"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7588851b153c4c0dbc7e63cfa1778497"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7588851b153c4c0dbc7e63cfa1778497"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7588851b153c4c0dbc7e63cfa1778497"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-InstanceActionsV221TestJSON-1345030741 Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 7588851b153c4c0dbc7e63cfa1778497 Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1345030741 Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-InstanceActionsV221TestJSON-1345030741-project Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 2f062663eef74d63aea291eaa5f213a4 Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-InstanceActionsV221TestJSON-1345030741-project Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 1c99e77a-8bb1-4e77-ab94-c560f7d88a28 could not be found. Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '1c99e77a-8bb1-4e77-ab94-c560f7d88a28'} Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c99e77a-8bb1-4e77-ab94-c560f7d88a28 could not be found. Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c99e77a-8bb1-4e77-ab94-c560f7d88a28 could not be found. Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:57:48.770905 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:57:48.778023 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:57:48.778023 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:57:48.778023 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:57:48.778023 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:57:48.778023 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:57:48.778023 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:57:48.778023 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c99e77a-8bb1-4e77-ab94-c560f7d88a28 could not be found. Sep 24 20:57:48.778023 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:57:48.778023 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c5040a72-5f0f-47e2-ba1e-3d9923a31d3e tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] Returning 404 to user: Instance 1c99e77a-8bb1-4e77-ab94-c560f7d88a28 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:57:48.778023 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c5040a72-5f0f-47e2-ba1e-3d9923a31d3e tempest-InstanceActionsV221TestJSON-1345030741 tempest-InstanceActionsV221TestJSON-1345030741-project] 10.222.0.52 "GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28" status: 404 len: 111 microversion: 2.21 time: 0.077617 Sep 24 20:57:48.785333 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1099/2204] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:57:48 2022] GET /compute/v2.1/servers/1c99e77a-8bb1-4e77-ab94-c560f7d88a28 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 20:57:48.920559 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-51ec433c-2041-4463-9864-7f5699d205d1 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-352889011", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "37f4af6d-5768-41af-a6d3-e85eda631381"}, {"uuid": "c6bd6a0c-8ba6-4d78-a141-df5e19c71801"}, {"uuid": "37f4af6d-5768-41af-a6d3-e85eda631381"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:57:49.021221 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-51ec433c-2041-4463-9864-7f5699d205d1 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] validate_networks() for [('37f4af6d-5768-41af-a6d3-e85eda631381', None, None, None, None, None), ('c6bd6a0c-8ba6-4d78-a141-df5e19c71801', None, None, None, None, None), ('37f4af6d-5768-41af-a6d3-e85eda631381', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:57:49.103781 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-59ce330f-cf65-46c2-9184-6e337258a642 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Action: 'create', calling method: .version_select at 0x7f4b0c8a4700>, body: {"keypair": {"name": "tempest-keypair-212877395", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKh5SBixh8o4aN7FFPykD7xfcI3re3j+QrB/OfwN1hqrfZy1wk6L4vZ3q6ad8vGGRZ5zcq8hH391OJCcMRutFJ5KvzKzdAT6uyjwBDAKVOCrINz3KcSAoj9gnXTljyKyw=="}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:57:49.115051 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:57:49.129864 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-59ce330f-cf65-46c2-9184-6e337258a642 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Getting quotas for project c4004a1dbc2441f8a5c4ace42af3e2df. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:57:49.143594 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-59ce330f-cf65-46c2-9184-6e337258a642 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Getting quotas for user 31761ade4b4a4df580fd5de55426eb0b and project c4004a1dbc2441f8a5c4ace42af3e2df. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:57:49.185520 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-59ce330f-cf65-46c2-9184-6e337258a642 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.427305 Sep 24 20:57:49.186955 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1106/2205] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 20:57:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:57:49.426769 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e3b2179b-190e-4ecc-b86b-1224d02cdcb7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:49.429547 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e3b2179b-190e-4ecc-b86b-1224d02cdcb7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:49.441558 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3b2179b-190e-4ecc-b86b-1224d02cdcb7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:49.447785 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3b2179b-190e-4ecc-b86b-1224d02cdcb7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:49.448357 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3b2179b-190e-4ecc-b86b-1224d02cdcb7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:49.449232 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3b2179b-190e-4ecc-b86b-1224d02cdcb7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:49.451230 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3b2179b-190e-4ecc-b86b-1224d02cdcb7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:49.451763 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3b2179b-190e-4ecc-b86b-1224d02cdcb7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:49.526463 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e3b2179b-190e-4ecc-b86b-1224d02cdcb7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.109158 Sep 24 20:57:49.529320 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1107/2206] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:57:49 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:57:49.540661 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1126fb31-dce6-480e-a662-00923d868760 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b0d1eadc0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:49.611284 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1126fb31-dce6-480e-a662-00923d868760 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613" status: 200 len: 1451 microversion: 2.1 time: 0.079281 Sep 24 20:57:49.620427 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1108/2207] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:57:49 2022] GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613 => generated 1451 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:50.543243 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c09b7f8b-2f1b-4b0f-996e-f67b6333681a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:50.546318 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c09b7f8b-2f1b-4b0f-996e-f67b6333681a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:50.563342 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c09b7f8b-2f1b-4b0f-996e-f67b6333681a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:50.564320 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c09b7f8b-2f1b-4b0f-996e-f67b6333681a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:50.565192 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c09b7f8b-2f1b-4b0f-996e-f67b6333681a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:50.567876 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c09b7f8b-2f1b-4b0f-996e-f67b6333681a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:50.568684 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c09b7f8b-2f1b-4b0f-996e-f67b6333681a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:50.570316 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c09b7f8b-2f1b-4b0f-996e-f67b6333681a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:50.644642 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c09b7f8b-2f1b-4b0f-996e-f67b6333681a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.106940 Sep 24 20:57:50.647235 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1109/2208] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:57:50 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:57:50.662756 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ee46f3f9-2661-41ff-b6af-4150b481f2c1 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b0c767a60>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:50.724040 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ee46f3f9-2661-41ff-b6af-4150b481f2c1 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613" status: 200 len: 1451 microversion: 2.1 time: 0.074176 Sep 24 20:57:50.724738 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1110/2209] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:57:50 2022] GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613 => generated 1451 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:51.497804 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-51ec433c-2041-4463-9864-7f5699d205d1 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:57:51.499268 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-51ec433c-2041-4463-9864-7f5699d205d1 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:57:51.501101 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-51ec433c-2041-4463-9864-7f5699d205d1 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:57:51.502368 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-51ec433c-2041-4463-9864-7f5699d205d1 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:57:51.503170 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-51ec433c-2041-4463-9864-7f5699d205d1 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:57:51.514162 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51ec433c-2041-4463-9864-7f5699d205d1 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:51.514997 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51ec433c-2041-4463-9864-7f5699d205d1 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:51.515673 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51ec433c-2041-4463-9864-7f5699d205d1 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:51.518006 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51ec433c-2041-4463-9864-7f5699d205d1 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:51.525066 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51ec433c-2041-4463-9864-7f5699d205d1 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:51.548459 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51ec433c-2041-4463-9864-7f5699d205d1 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:51.578848 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-51ec433c-2041-4463-9864-7f5699d205d1 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Getting quotas for project ec085cc2148f4cda9483fbe7257eeb14. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:57:51.588296 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-51ec433c-2041-4463-9864-7f5699d205d1 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Getting quotas for user 6a38dd114ec04ba5826a68a9e796ab8d and project ec085cc2148f4cda9483fbe7257eeb14. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:57:51.609681 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-51ec433c-2041-4463-9864-7f5699d205d1 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:57:51.613317 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-51ec433c-2041-4463-9864-7f5699d205d1 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:57:51.665281 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0c80acd6-e0bd-4ddd-a971-cc87aebeca2a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:51.668591 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0c80acd6-e0bd-4ddd-a971-cc87aebeca2a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:51.703994 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c80acd6-e0bd-4ddd-a971-cc87aebeca2a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:51.719742 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c80acd6-e0bd-4ddd-a971-cc87aebeca2a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:51.720250 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c80acd6-e0bd-4ddd-a971-cc87aebeca2a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:51.727709 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c80acd6-e0bd-4ddd-a971-cc87aebeca2a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:51.728118 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c80acd6-e0bd-4ddd-a971-cc87aebeca2a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:51.728572 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c80acd6-e0bd-4ddd-a971-cc87aebeca2a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:51.750681 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-51ec433c-2041-4463-9864-7f5699d205d1 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.824449 Sep 24 20:57:51.762162 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1100/2210] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:57:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 24 20:57:51.769279 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c05a3d7c-1991-47f0-8dd4-24ac312562ce tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b10fbab80>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:51.874393 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c05a3d7c-1991-47f0-8dd4-24ac312562ce tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613" status: 200 len: 1451 microversion: 2.1 time: 0.110614 Sep 24 20:57:51.876275 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1101/2211] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:57:51 2022] GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613 => generated 1451 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:51.900500 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bec93c8e-7ef4-4f88-9b3e-4df3b674c899 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:51.903015 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-bec93c8e-7ef4-4f88-9b3e-4df3b674c899 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:51.916167 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0c80acd6-e0bd-4ddd-a971-cc87aebeca2a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.260329 Sep 24 20:57:51.917118 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1111/2212] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:57:51 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:57:51.943242 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:57:52.036352 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-bec93c8e-7ef4-4f88-9b3e-4df3b674c899 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:52.046169 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bec93c8e-7ef4-4f88-9b3e-4df3b674c899 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 200 len: 1212 microversion: 2.1 time: 0.168295 Sep 24 20:57:52.050633 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1102/2213] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:51 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 1212 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:52.385813 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fc969a99-4594-4a82-a76d-66a4a0f0a902 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:52.396286 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fc969a99-4594-4a82-a76d-66a4a0f0a902 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3aa253ded2304ac3917a1788b6a1500b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f6b606beca4eb5b62c89a945be15c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:52.396912 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fc969a99-4594-4a82-a76d-66a4a0f0a902 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Searching by: {'deleted': False, 'project_id': '71f6b606beca4eb5b62c89a945be15c7'} {{(pid=140517) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 20:57:52.411983 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc969a99-4594-4a82-a76d-66a4a0f0a902 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:52.412527 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc969a99-4594-4a82-a76d-66a4a0f0a902 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:52.419399 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc969a99-4594-4a82-a76d-66a4a0f0a902 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:52.420349 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc969a99-4594-4a82-a76d-66a4a0f0a902 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:52.420847 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc969a99-4594-4a82-a76d-66a4a0f0a902 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:52.421852 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc969a99-4594-4a82-a76d-66a4a0f0a902 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:52.536992 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.multi_cell_list [None req-fc969a99-4594-4a82-a76d-66a4a0f0a902 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 20:57:52.628970 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fc969a99-4594-4a82-a76d-66a4a0f0a902 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.248035 Sep 24 20:57:52.638033 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1112/2214] 10.222.0.52 () {58 vars in 1125 bytes} [Sat Sep 24 20:57:52 2022] GET /compute/v2.1/servers => generated 333 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:57:52.646765 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-706e2fe3-2f4b-49a6-b13a-df4848c73a87 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:52.652134 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-706e2fe3-2f4b-49a6-b13a-df4848c73a87 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3aa253ded2304ac3917a1788b6a1500b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f6b606beca4eb5b62c89a945be15c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:52.652918 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-706e2fe3-2f4b-49a6-b13a-df4848c73a87 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Searching by: {'deleted': False, 'project_id': '71f6b606beca4eb5b62c89a945be15c7'} {{(pid=140516) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 20:57:52.685168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-706e2fe3-2f4b-49a6-b13a-df4848c73a87 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:52.686812 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-706e2fe3-2f4b-49a6-b13a-df4848c73a87 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:52.688171 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-706e2fe3-2f4b-49a6-b13a-df4848c73a87 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:52.695315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-706e2fe3-2f4b-49a6-b13a-df4848c73a87 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:52.696793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-706e2fe3-2f4b-49a6-b13a-df4848c73a87 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:52.699413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-706e2fe3-2f4b-49a6-b13a-df4848c73a87 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:52.772651 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.multi_cell_list [None req-706e2fe3-2f4b-49a6-b13a-df4848c73a87 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 20:57:52.823527 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-706e2fe3-2f4b-49a6-b13a-df4848c73a87 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa253ded2304ac3917a1788b6a1500b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f6b606beca4eb5b62c89a945be15c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:52.833727 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-706e2fe3-2f4b-49a6-b13a-df4848c73a87 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:52.834671 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-706e2fe3-2f4b-49a6-b13a-df4848c73a87 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:52.835464 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-706e2fe3-2f4b-49a6-b13a-df4848c73a87 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:52.890902 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b72f7744-86da-4d06-8e17-960bd2f7db93 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b0c8f6550>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:53.033882 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b72f7744-86da-4d06-8e17-960bd2f7db93 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613" status: 200 len: 1451 microversion: 2.1 time: 0.146749 Sep 24 20:57:53.034605 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1113/2215] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:57:52 2022] GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:57:53.048368 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-24e64d5d-40bd-460b-aea1-ef849b1fc7b7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:53.065601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-24e64d5d-40bd-460b-aea1-ef849b1fc7b7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:53.081898 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24e64d5d-40bd-460b-aea1-ef849b1fc7b7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:53.093663 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24e64d5d-40bd-460b-aea1-ef849b1fc7b7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:53.094481 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24e64d5d-40bd-460b-aea1-ef849b1fc7b7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:53.096156 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24e64d5d-40bd-460b-aea1-ef849b1fc7b7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:53.099411 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24e64d5d-40bd-460b-aea1-ef849b1fc7b7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:53.100173 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24e64d5d-40bd-460b-aea1-ef849b1fc7b7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:53.172987 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-24e64d5d-40bd-460b-aea1-ef849b1fc7b7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.128707 Sep 24 20:57:53.178782 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1114/2216] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:57:53 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:57:53.196786 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-12ab7f3d-6836-45a2-a9b5-b06663856117 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:53.200061 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-12ab7f3d-6836-45a2-a9b5-b06663856117 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:53.211636 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12ab7f3d-6836-45a2-a9b5-b06663856117 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:53.212423 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12ab7f3d-6836-45a2-a9b5-b06663856117 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:53.213047 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12ab7f3d-6836-45a2-a9b5-b06663856117 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:53.213947 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12ab7f3d-6836-45a2-a9b5-b06663856117 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:53.214688 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12ab7f3d-6836-45a2-a9b5-b06663856117 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:53.215315 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12ab7f3d-6836-45a2-a9b5-b06663856117 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:53.488818 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-12ab7f3d-6836-45a2-a9b5-b06663856117 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:53.497373 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-12ab7f3d-6836-45a2-a9b5-b06663856117 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 200 len: 1216 microversion: 2.1 time: 0.317343 Sep 24 20:57:53.502328 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1115/2217] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:53 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 1216 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:53.700314 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-706e2fe3-2f4b-49a6-b13a-df4848c73a87 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] 10.222.0.52 "GET /compute/v2.1/servers/detail" status: 200 len: 1695 microversion: 2.1 time: 1.061044 Sep 24 20:57:53.701243 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1103/2218] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 20:57:52 2022] GET /compute/v2.1/servers/detail => generated 1695 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:53.728178 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f3b07c99-264a-4b4c-b0c6-3ee1e6e0043e tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:53.737272 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f3b07c99-264a-4b4c-b0c6-3ee1e6e0043e tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012965 Sep 24 20:57:53.759167 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1116/2219] 10.222.0.52 () {58 vars in 1137 bytes} [Sat Sep 24 20:57:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:57:54.050398 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7f4ec71b-78c6-4cb8-ac37-8d620c87d945 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b11140700>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:54.133212 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6a2109b0-85e5-4f9a-8c99-532be3affc6e tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:54.133766 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6a2109b0-85e5-4f9a-8c99-532be3affc6e tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] [instance: 05c0e0fa-1c24-4072-9663-5c0752c685e0] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:54.137881 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7f4ec71b-78c6-4cb8-ac37-8d620c87d945 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613" status: 200 len: 1451 microversion: 2.1 time: 0.092510 Sep 24 20:57:54.138487 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1104/2220] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:57:54 2022] GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613 => generated 1451 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:54.165719 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6a2109b0-85e5-4f9a-8c99-532be3affc6e tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:54.169341 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6a2109b0-85e5-4f9a-8c99-532be3affc6e tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:54.170138 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6a2109b0-85e5-4f9a-8c99-532be3affc6e tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:54.171101 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6a2109b0-85e5-4f9a-8c99-532be3affc6e tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:54.172822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6a2109b0-85e5-4f9a-8c99-532be3affc6e tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:54.173513 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6a2109b0-85e5-4f9a-8c99-532be3affc6e tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:54.201046 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bf14e30d-1899-4ec1-93db-fa7f2b08cda4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:54.208787 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-bf14e30d-1899-4ec1-93db-fa7f2b08cda4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:54.237195 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bf14e30d-1899-4ec1-93db-fa7f2b08cda4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:54.238044 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bf14e30d-1899-4ec1-93db-fa7f2b08cda4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:54.239066 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bf14e30d-1899-4ec1-93db-fa7f2b08cda4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:54.246980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bf14e30d-1899-4ec1-93db-fa7f2b08cda4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:54.249356 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bf14e30d-1899-4ec1-93db-fa7f2b08cda4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:54.251128 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bf14e30d-1899-4ec1-93db-fa7f2b08cda4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:54.297181 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6a2109b0-85e5-4f9a-8c99-532be3affc6e tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] [instance: 05c0e0fa-1c24-4072-9663-5c0752c685e0] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:57:54.344697 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bf14e30d-1899-4ec1-93db-fa7f2b08cda4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.158195 Sep 24 20:57:54.367058 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1105/2221] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:57:54 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:57:54.488308 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6a2109b0-85e5-4f9a-8c99-532be3affc6e tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] 10.222.0.52 "DELETE /compute/v2.1/servers/05c0e0fa-1c24-4072-9663-5c0752c685e0" status: 204 len: 0 microversion: 2.1 time: 0.364729 Sep 24 20:57:54.494168 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1117/2222] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:57:54 2022] DELETE /compute/v2.1/servers/05c0e0fa-1c24-4072-9663-5c0752c685e0 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:57:54.502441 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-71042137-4ce6-47b5-8a8a-9af5d66147da tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:54.503514 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-71042137-4ce6-47b5-8a8a-9af5d66147da tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] [instance: 05c0e0fa-1c24-4072-9663-5c0752c685e0] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:54.521589 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71042137-4ce6-47b5-8a8a-9af5d66147da tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:54.522522 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71042137-4ce6-47b5-8a8a-9af5d66147da tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:54.523200 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71042137-4ce6-47b5-8a8a-9af5d66147da tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:54.529501 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-85f35f65-3bee-485d-b1ea-94644c980dd3 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:54.530588 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-85f35f65-3bee-485d-b1ea-94644c980dd3 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:54.533962 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71042137-4ce6-47b5-8a8a-9af5d66147da tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:54.537830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71042137-4ce6-47b5-8a8a-9af5d66147da tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:54.538738 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71042137-4ce6-47b5-8a8a-9af5d66147da tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:54.544029 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85f35f65-3bee-485d-b1ea-94644c980dd3 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:54.544861 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85f35f65-3bee-485d-b1ea-94644c980dd3 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:54.545549 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85f35f65-3bee-485d-b1ea-94644c980dd3 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:54.549230 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85f35f65-3bee-485d-b1ea-94644c980dd3 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:54.550010 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85f35f65-3bee-485d-b1ea-94644c980dd3 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:54.553264 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85f35f65-3bee-485d-b1ea-94644c980dd3 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:55.184502 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-85f35f65-3bee-485d-b1ea-94644c980dd3 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:55.199225 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-85f35f65-3bee-485d-b1ea-94644c980dd3 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 200 len: 1272 microversion: 2.1 time: 0.674137 Sep 24 20:57:55.205480 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1118/2223] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:54 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 1272 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:55.215115 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ff9d2f51-9030-4b09-9ec1-26cef0fc506f tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b110810d0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:55.309412 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ff9d2f51-9030-4b09-9ec1-26cef0fc506f tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613" status: 200 len: 1451 microversion: 2.1 time: 0.102435 Sep 24 20:57:55.320150 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1119/2224] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:57:55 2022] GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613 => generated 1451 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:55.358926 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5b9a9736-10da-4fc5-a034-6fdfe6099212 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:55.365560 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5b9a9736-10da-4fc5-a034-6fdfe6099212 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:55.381061 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b9a9736-10da-4fc5-a034-6fdfe6099212 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:55.382160 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b9a9736-10da-4fc5-a034-6fdfe6099212 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:55.383234 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b9a9736-10da-4fc5-a034-6fdfe6099212 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:55.384503 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b9a9736-10da-4fc5-a034-6fdfe6099212 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:55.394958 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b9a9736-10da-4fc5-a034-6fdfe6099212 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:55.396117 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b9a9736-10da-4fc5-a034-6fdfe6099212 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:55.434329 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5b9a9736-10da-4fc5-a034-6fdfe6099212 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.079285 Sep 24 20:57:55.442163 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1120/2225] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:57:55 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:57:55.580200 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-71042137-4ce6-47b5-8a8a-9af5d66147da tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa253ded2304ac3917a1788b6a1500b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f6b606beca4eb5b62c89a945be15c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:55.595446 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-71042137-4ce6-47b5-8a8a-9af5d66147da tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] 10.222.0.52 "GET /compute/v2.1/servers/05c0e0fa-1c24-4072-9663-5c0752c685e0" status: 200 len: 1698 microversion: 2.1 time: 1.096817 Sep 24 20:57:55.596848 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1106/2226] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:54 2022] GET /compute/v2.1/servers/05c0e0fa-1c24-4072-9663-5c0752c685e0 => generated 1698 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:56.233604 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f34a69f7-7ec1-4cf9-9556-79c3c83c66b2 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:56.234523 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f34a69f7-7ec1-4cf9-9556-79c3c83c66b2 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:56.259327 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f34a69f7-7ec1-4cf9-9556-79c3c83c66b2 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:56.260089 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f34a69f7-7ec1-4cf9-9556-79c3c83c66b2 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:56.260658 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f34a69f7-7ec1-4cf9-9556-79c3c83c66b2 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:56.261514 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f34a69f7-7ec1-4cf9-9556-79c3c83c66b2 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:56.264986 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f34a69f7-7ec1-4cf9-9556-79c3c83c66b2 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:56.265926 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f34a69f7-7ec1-4cf9-9556-79c3c83c66b2 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:56.327686 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c9982f77-43bb-4d0a-adc7-8410ebb86f62 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b1112c8b0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:56.450149 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c9982f77-43bb-4d0a-adc7-8410ebb86f62 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613" status: 200 len: 1451 microversion: 2.1 time: 0.128445 Sep 24 20:57:56.450813 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1107/2227] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:57:56 2022] GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613 => generated 1451 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:57:56.475524 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f92800d0-1883-4251-bd60-cd3f3dc90724 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:56.477830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f92800d0-1883-4251-bd60-cd3f3dc90724 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:56.511601 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f92800d0-1883-4251-bd60-cd3f3dc90724 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:56.512561 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f92800d0-1883-4251-bd60-cd3f3dc90724 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:56.517340 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f92800d0-1883-4251-bd60-cd3f3dc90724 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:56.519509 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f92800d0-1883-4251-bd60-cd3f3dc90724 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:56.521069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f92800d0-1883-4251-bd60-cd3f3dc90724 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:56.523980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f92800d0-1883-4251-bd60-cd3f3dc90724 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:56.580600 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f34a69f7-7ec1-4cf9-9556-79c3c83c66b2 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:56.586239 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:57:56.605491 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f92800d0-1883-4251-bd60-cd3f3dc90724 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.145862 Sep 24 20:57:56.610576 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f34a69f7-7ec1-4cf9-9556-79c3c83c66b2 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 200 len: 1270 microversion: 2.1 time: 0.381875 Sep 24 20:57:56.610792 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1108/2228] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:57:56 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:57:56.614002 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1121/2229] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:56 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 1270 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:56.636343 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dd1f8f36-c132-4b24-b26d-e2b97b0fd616 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:56.647113 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-dd1f8f36-c132-4b24-b26d-e2b97b0fd616 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] [instance: 05c0e0fa-1c24-4072-9663-5c0752c685e0] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:56.676314 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd1f8f36-c132-4b24-b26d-e2b97b0fd616 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:56.676826 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd1f8f36-c132-4b24-b26d-e2b97b0fd616 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:56.685405 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd1f8f36-c132-4b24-b26d-e2b97b0fd616 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:56.686628 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd1f8f36-c132-4b24-b26d-e2b97b0fd616 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:56.692860 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd1f8f36-c132-4b24-b26d-e2b97b0fd616 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:56.697003 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd1f8f36-c132-4b24-b26d-e2b97b0fd616 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:57.018473 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-dd1f8f36-c132-4b24-b26d-e2b97b0fd616 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa253ded2304ac3917a1788b6a1500b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f6b606beca4eb5b62c89a945be15c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:57.031493 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-dd1f8f36-c132-4b24-b26d-e2b97b0fd616 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] 10.222.0.52 "GET /compute/v2.1/servers/05c0e0fa-1c24-4072-9663-5c0752c685e0" status: 200 len: 1698 microversion: 2.1 time: 0.405077 Sep 24 20:57:57.036124 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1109/2230] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:56 2022] GET /compute/v2.1/servers/05c0e0fa-1c24-4072-9663-5c0752c685e0 => generated 1698 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:57.467137 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5e592393-364f-4b52-b48b-2d4e69581b20 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b0c8b48b0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:57.575868 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5e592393-364f-4b52-b48b-2d4e69581b20 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613" status: 200 len: 1451 microversion: 2.1 time: 0.114456 Sep 24 20:57:57.577093 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1122/2231] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:57:57 2022] GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613 => generated 1451 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:57.624085 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d82d788e-bb8b-4af8-81fc-80e574856fab tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:57.626733 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d82d788e-bb8b-4af8-81fc-80e574856fab tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:57.651515 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5f085d55-87d5-4cc8-b1b8-36a4f5bf20e0 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:57.652575 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5f085d55-87d5-4cc8-b1b8-36a4f5bf20e0 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:57.672363 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f085d55-87d5-4cc8-b1b8-36a4f5bf20e0 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:57.681929 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f085d55-87d5-4cc8-b1b8-36a4f5bf20e0 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:57.685286 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f085d55-87d5-4cc8-b1b8-36a4f5bf20e0 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:57.685666 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d82d788e-bb8b-4af8-81fc-80e574856fab tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:57.686180 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d82d788e-bb8b-4af8-81fc-80e574856fab tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:57.691324 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f085d55-87d5-4cc8-b1b8-36a4f5bf20e0 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:57.694809 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f085d55-87d5-4cc8-b1b8-36a4f5bf20e0 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:57.694972 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d82d788e-bb8b-4af8-81fc-80e574856fab tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:57.695874 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d82d788e-bb8b-4af8-81fc-80e574856fab tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:57.696566 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d82d788e-bb8b-4af8-81fc-80e574856fab tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:57.697391 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d82d788e-bb8b-4af8-81fc-80e574856fab tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:57.698287 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f085d55-87d5-4cc8-b1b8-36a4f5bf20e0 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:57.826826 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d82d788e-bb8b-4af8-81fc-80e574856fab tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.209373 Sep 24 20:57:57.828096 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1110/2232] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:57:57 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:57:58.058212 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0a371fa2-6ab4-4727-82e3-592780e5b72d tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:58.058708 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0a371fa2-6ab4-4727-82e3-592780e5b72d tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] [instance: 05c0e0fa-1c24-4072-9663-5c0752c685e0] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:58.072995 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0a371fa2-6ab4-4727-82e3-592780e5b72d tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:58.077387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0a371fa2-6ab4-4727-82e3-592780e5b72d tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:58.081566 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0a371fa2-6ab4-4727-82e3-592780e5b72d tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:58.082589 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0a371fa2-6ab4-4727-82e3-592780e5b72d tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:58.085875 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0a371fa2-6ab4-4727-82e3-592780e5b72d tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:58.089181 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0a371fa2-6ab4-4727-82e3-592780e5b72d tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:58.128296 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5f085d55-87d5-4cc8-b1b8-36a4f5bf20e0 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:58.142863 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5f085d55-87d5-4cc8-b1b8-36a4f5bf20e0 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 200 len: 1270 microversion: 2.1 time: 0.500580 Sep 24 20:57:58.154867 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1123/2233] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:57 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 1270 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:58.593240 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a9509596-ac6a-4fb8-a414-56aa80fb523a tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b0c895700>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:58.683052 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a9509596-ac6a-4fb8-a414-56aa80fb523a tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613" status: 200 len: 1451 microversion: 2.1 time: 0.094542 Sep 24 20:57:58.685059 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1124/2234] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:57:58 2022] GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613 => generated 1451 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:57:58.731119 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0a371fa2-6ab4-4727-82e3-592780e5b72d tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa253ded2304ac3917a1788b6a1500b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f6b606beca4eb5b62c89a945be15c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:57:58.746840 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0a371fa2-6ab4-4727-82e3-592780e5b72d tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] 10.222.0.52 "GET /compute/v2.1/servers/05c0e0fa-1c24-4072-9663-5c0752c685e0" status: 200 len: 1698 microversion: 2.1 time: 0.691096 Sep 24 20:57:58.760087 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1111/2235] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:57:58 2022] GET /compute/v2.1/servers/05c0e0fa-1c24-4072-9663-5c0752c685e0 => generated 1698 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:57:58.840760 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c1ce0571-aa2b-4500-8038-775fa26add0f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:57:58.843454 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c1ce0571-aa2b-4500-8038-775fa26add0f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:57:58.856432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1ce0571-aa2b-4500-8038-775fa26add0f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:58.859983 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1ce0571-aa2b-4500-8038-775fa26add0f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:58.862526 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1ce0571-aa2b-4500-8038-775fa26add0f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:58.863438 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1ce0571-aa2b-4500-8038-775fa26add0f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:57:58.865537 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1ce0571-aa2b-4500-8038-775fa26add0f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:57:58.866081 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1ce0571-aa2b-4500-8038-775fa26add0f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:57:59.008430 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c1ce0571-aa2b-4500-8038-775fa26add0f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.171911 Sep 24 20:57:59.014247 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1125/2236] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:57:58 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:57:59.117147 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d8447103-b019-44d2-96bf-615b4058cd39 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-494158121", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "cf0eb8e6-8c78-4ee2-84ea-f873689ed3ba"}], "security_groups": [{"name": "tempest-securitygroup--640424147"}], "key_name": "tempest-keypair-212877395", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:57:59.123829 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-47e0d50a-9959-435f-b67d-525a3610798c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-313461700", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "4d177ad8-2ce8-4cf6-95f9-d9dcf8f31aa4"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:57:59.177386 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=4 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:57:59.271439 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-47e0d50a-9959-435f-b67d-525a3610798c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] validate_networks() for [('4d177ad8-2ce8-4cf6-95f9-d9dcf8f31aa4', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:58:00.469872 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-d8447103-b019-44d2-96bf-615b4058cd39 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] validate_networks() for [('cf0eb8e6-8c78-4ee2-84ea-f873689ed3ba', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:58:02.101141 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-d8447103-b019-44d2-96bf-615b4058cd39 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:58:02.102304 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-d8447103-b019-44d2-96bf-615b4058cd39 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:58:02.103062 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-d8447103-b019-44d2-96bf-615b4058cd39 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:58:02.103663 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-d8447103-b019-44d2-96bf-615b4058cd39 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:58:02.104269 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-d8447103-b019-44d2-96bf-615b4058cd39 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:58:02.133704 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d8447103-b019-44d2-96bf-615b4058cd39 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:02.138264 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d8447103-b019-44d2-96bf-615b4058cd39 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:02.141398 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d8447103-b019-44d2-96bf-615b4058cd39 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:02.142531 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d8447103-b019-44d2-96bf-615b4058cd39 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:02.143391 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d8447103-b019-44d2-96bf-615b4058cd39 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:02.145085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d8447103-b019-44d2-96bf-615b4058cd39 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:02.194661 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-d8447103-b019-44d2-96bf-615b4058cd39 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Getting quotas for project c4004a1dbc2441f8a5c4ace42af3e2df. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:58:02.212009 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-d8447103-b019-44d2-96bf-615b4058cd39 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Getting quotas for user 31761ade4b4a4df580fd5de55426eb0b and project c4004a1dbc2441f8a5c4ace42af3e2df. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:58:02.256538 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d8447103-b019-44d2-96bf-615b4058cd39 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:58:02.263594 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d8447103-b019-44d2-96bf-615b4058cd39 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: e781d448-5d66-4040-bf4c-37452b0f7b1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:58:02.283483 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-47e0d50a-9959-435f-b67d-525a3610798c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:58:02.284769 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-47e0d50a-9959-435f-b67d-525a3610798c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:58:02.285729 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-47e0d50a-9959-435f-b67d-525a3610798c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:58:02.286336 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-47e0d50a-9959-435f-b67d-525a3610798c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:58:02.286963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-47e0d50a-9959-435f-b67d-525a3610798c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:58:02.328052 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47e0d50a-9959-435f-b67d-525a3610798c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:02.329489 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47e0d50a-9959-435f-b67d-525a3610798c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:02.334203 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47e0d50a-9959-435f-b67d-525a3610798c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:02.335320 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47e0d50a-9959-435f-b67d-525a3610798c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:02.337513 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47e0d50a-9959-435f-b67d-525a3610798c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:02.341423 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47e0d50a-9959-435f-b67d-525a3610798c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:02.421827 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-47e0d50a-9959-435f-b67d-525a3610798c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Getting quotas for project 8c875b2746384d5a9d02548faab6fd5d. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:58:02.440360 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-47e0d50a-9959-435f-b67d-525a3610798c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Getting quotas for user c84e7493d0ed47aca659dc925e8ca39c and project 8c875b2746384d5a9d02548faab6fd5d. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:58:02.478465 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d8447103-b019-44d2-96bf-615b4058cd39 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.361176 Sep 24 20:58:02.489065 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1126/2237] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:57:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 3378 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:58:02.498250 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-47e0d50a-9959-435f-b67d-525a3610798c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:58:02.516220 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-47e0d50a-9959-435f-b67d-525a3610798c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:58:02.527662 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d65f5a27-b3ea-4bdc-989e-4d0edd38ae02 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:02.534250 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d65f5a27-b3ea-4bdc-989e-4d0edd38ae02 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:02.565341 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d65f5a27-b3ea-4bdc-989e-4d0edd38ae02 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:02.565944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d65f5a27-b3ea-4bdc-989e-4d0edd38ae02 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:02.566639 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d65f5a27-b3ea-4bdc-989e-4d0edd38ae02 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:02.567534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d65f5a27-b3ea-4bdc-989e-4d0edd38ae02 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:02.568007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d65f5a27-b3ea-4bdc-989e-4d0edd38ae02 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:02.568449 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d65f5a27-b3ea-4bdc-989e-4d0edd38ae02 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:02.689586 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-47e0d50a-9959-435f-b67d-525a3610798c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.708046 Sep 24 20:58:02.691183 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1112/2238] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:57:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 3712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 24 20:58:02.701310 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-291e85e7-4535-45e0-8114-c289b5e7a9a5 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b10faf550>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:02.795868 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-291e85e7-4535-45e0-8114-c289b5e7a9a5 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613" status: 200 len: 1451 microversion: 2.1 time: 0.103207 Sep 24 20:58:02.804987 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1113/2239] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:02 2022] GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613 => generated 1451 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:02.821900 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f411f231-a70d-497e-954f-a29cefca5c06 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:02.829337 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f411f231-a70d-497e-954f-a29cefca5c06 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] [instance: 05c0e0fa-1c24-4072-9663-5c0752c685e0] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:02.853512 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f411f231-a70d-497e-954f-a29cefca5c06 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:02.854206 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f411f231-a70d-497e-954f-a29cefca5c06 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:02.854830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f411f231-a70d-497e-954f-a29cefca5c06 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:02.855792 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f411f231-a70d-497e-954f-a29cefca5c06 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:02.856420 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f411f231-a70d-497e-954f-a29cefca5c06 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:02.856994 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f411f231-a70d-497e-954f-a29cefca5c06 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:02.889402 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-f411f231-a70d-497e-954f-a29cefca5c06 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] HTTP exception thrown: Instance 05c0e0fa-1c24-4072-9663-5c0752c685e0 could not be found. Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f411f231-a70d-497e-954f-a29cefca5c06 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Request method failure captured: Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/05c0e0fa-1c24-4072-9663-5c0752c685e0 HTTP/1.1 Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL27tjTcAlLu1ypzJJPffAia2UxdmSwzUbKj718LOoNmj-fTltGX-AlS_5qENHe4mPSigwYcYvFwfuVgQW5aVgkZI_Ga-C_XxNT7UbaV3kd0DHJN2_TQHELN0i3Myjt7h3yeg4xQ0EvCwlC8bMOK4Q8sER3_npkPxBe0p507RReZmOAI Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 71f6b606beca4eb5b62c89a945be15c7 Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersTestJSON-2008482070 Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/71f6b606beca4eb5b62c89a945be15c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_71f6b606beca4eb5b62c89a945be15c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/71f6b606beca4eb5b62c89a945be15c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/71f6b606beca4eb5b62c89a945be15c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersTestJSON-2008482070 Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 71f6b606beca4eb5b62c89a945be15c7 Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersTestJSON-2008482070 Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersTestJSON-2008482070-project Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 3aa253ded2304ac3917a1788b6a1500b Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersTestJSON-2008482070-project Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 05c0e0fa-1c24-4072-9663-5c0752c685e0 could not be found. Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '05c0e0fa-1c24-4072-9663-5c0752c685e0'} Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05c0e0fa-1c24-4072-9663-5c0752c685e0 could not be found. Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05c0e0fa-1c24-4072-9663-5c0752c685e0 could not be found. Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:58:02.908667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:58:02.911836 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:58:02.911836 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:58:02.911836 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:58:02.911836 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:58:02.911836 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:58:02.911836 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05c0e0fa-1c24-4072-9663-5c0752c685e0 could not be found. Sep 24 20:58:02.911836 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:58:02.916822 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f411f231-a70d-497e-954f-a29cefca5c06 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Returning 404 to user: Instance 05c0e0fa-1c24-4072-9663-5c0752c685e0 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:58:02.919871 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f411f231-a70d-497e-954f-a29cefca5c06 tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] 10.222.0.52 "GET /compute/v2.1/servers/05c0e0fa-1c24-4072-9663-5c0752c685e0" status: 404 len: 111 microversion: 2.1 time: 0.111899 Sep 24 20:58:02.926982 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1114/2240] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:02 2022] GET /compute/v2.1/servers/05c0e0fa-1c24-4072-9663-5c0752c685e0 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:58:02.980742 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-00029cfd-b986-4ead-8690-459548cef2cf req-a7e3400c-3035-4115-8b82-fa753f218b35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51", "name": "network-vif-plugged", "status": "completed", "tag": "00c8986f-e263-4bab-8396-0009b8e0c3e8"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:58:03.031706 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-00029cfd-b986-4ead-8690-459548cef2cf req-a7e3400c-3035-4115-8b82-fa753f218b35 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:03.039327 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-00029cfd-b986-4ead-8690-459548cef2cf req-a7e3400c-3035-4115-8b82-fa753f218b35 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:03.042576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-00029cfd-b986-4ead-8690-459548cef2cf req-a7e3400c-3035-4115-8b82-fa753f218b35 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:03.085781 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-00029cfd-b986-4ead-8690-459548cef2cf req-a7e3400c-3035-4115-8b82-fa753f218b35 service nova] Creating event network-vif-plugged:00c8986f-e263-4bab-8396-0009b8e0c3e8 for instance 4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51 on nch2-master-1 Sep 24 20:58:03.100427 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-00029cfd-b986-4ead-8690-459548cef2cf req-a7e3400c-3035-4115-8b82-fa753f218b35 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146854 Sep 24 20:58:03.102535 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1115/2241] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:58:03.122718 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2c4cdb58-4b40-4f45-aa33-d6c9ffcd6753 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:03.137676 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2c4cdb58-4b40-4f45-aa33-d6c9ffcd6753 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:03.185945 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d65f5a27-b3ea-4bdc-989e-4d0edd38ae02 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:03.191045 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c4cdb58-4b40-4f45-aa33-d6c9ffcd6753 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:03.193151 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c4cdb58-4b40-4f45-aa33-d6c9ffcd6753 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:03.194451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c4cdb58-4b40-4f45-aa33-d6c9ffcd6753 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:03.194882 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d65f5a27-b3ea-4bdc-989e-4d0edd38ae02 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 200 len: 1333 microversion: 2.1 time: 0.704487 Sep 24 20:58:03.199325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c4cdb58-4b40-4f45-aa33-d6c9ffcd6753 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:03.204748 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c4cdb58-4b40-4f45-aa33-d6c9ffcd6753 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:03.205914 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c4cdb58-4b40-4f45-aa33-d6c9ffcd6753 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:03.209935 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1127/2242] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:02 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 1333 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:03.224274 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-86725a1b-6a02-4dd0-a1d9-8171afccda65 req-765f1e79-c80d-4559-87e2-83ac7e63eaeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c0e0fa-1c24-4072-9663-5c0752c685e0", "name": "network-vif-deleted", "tag": "81d220f2-0310-473b-a74f-b729c26b0e34"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:58:03.297579 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-86725a1b-6a02-4dd0-a1d9-8171afccda65 req-765f1e79-c80d-4559-87e2-83ac7e63eaeb service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:03.298348 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-86725a1b-6a02-4dd0-a1d9-8171afccda65 req-765f1e79-c80d-4559-87e2-83ac7e63eaeb service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:03.300312 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-86725a1b-6a02-4dd0-a1d9-8171afccda65 req-765f1e79-c80d-4559-87e2-83ac7e63eaeb service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:03.351857 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-86725a1b-6a02-4dd0-a1d9-8171afccda65 req-765f1e79-c80d-4559-87e2-83ac7e63eaeb service nova] Creating event network-vif-deleted:81d220f2-0310-473b-a74f-b729c26b0e34 for instance 05c0e0fa-1c24-4072-9663-5c0752c685e0 on nch1-master-1 Sep 24 20:58:03.406020 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-86725a1b-6a02-4dd0-a1d9-8171afccda65 req-765f1e79-c80d-4559-87e2-83ac7e63eaeb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194265 Sep 24 20:58:03.411633 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1128/2243] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:58:03.435962 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-17de3c93-f1e6-4223-bfe4-4b1fc57b9a7a tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:03.439874 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-17de3c93-f1e6-4223-bfe4-4b1fc57b9a7a tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: e781d448-5d66-4040-bf4c-37452b0f7b1c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:03.447187 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:58:03.468785 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2c4cdb58-4b40-4f45-aa33-d6c9ffcd6753 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.364535 Sep 24 20:58:03.471947 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1116/2244] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:03 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:58:03.483356 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a2b142e7-c92d-45c0-8f6c-ab728db20b4b tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:03.485631 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a2b142e7-c92d-45c0-8f6c-ab728db20b4b tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:03.692251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a2b142e7-c92d-45c0-8f6c-ab728db20b4b tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:03.708816 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a2b142e7-c92d-45c0-8f6c-ab728db20b4b tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1217 microversion: 2.1 time: 0.234379 Sep 24 20:58:03.729823 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1117/2245] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:03 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1217 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:03.763995 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9db8ba4f-12a9-452f-b8e2-6c29cfa17f7f tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] Calling method '.version_select at 0x7f4b10f9b430>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:03.823316 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-17de3c93-f1e6-4223-bfe4-4b1fc57b9a7a tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:03.837532 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-17de3c93-f1e6-4223-bfe4-4b1fc57b9a7a tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c" status: 200 len: 1240 microversion: 2.1 time: 0.421838 Sep 24 20:58:03.841808 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1129/2246] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:03 2022] GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c => generated 1240 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:03.848683 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9db8ba4f-12a9-452f-b8e2-6c29cfa17f7f tempest-ServersTestJSON-2008482070 tempest-ServersTestJSON-2008482070-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1348728112" status: 202 len: 0 microversion: 2.1 time: 0.117283 Sep 24 20:58:03.866013 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1118/2247] 10.222.0.52 () {58 vars in 1221 bytes} [Sat Sep 24 20:58:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1348728112 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:58:03.870781 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e861fc29-dfc0-40d8-beca-be03b3764419 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b0c8d4a60>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:03.998912 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e861fc29-dfc0-40d8-beca-be03b3764419 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613" status: 200 len: 1451 microversion: 2.1 time: 0.155524 Sep 24 20:58:04.000861 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1130/2248] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:03 2022] GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:04.223244 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0219208d-4ed5-4690-96d7-d815c79d5cac tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:04.223244 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0219208d-4ed5-4690-96d7-d815c79d5cac tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:04.241923 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0219208d-4ed5-4690-96d7-d815c79d5cac tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:04.242350 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0219208d-4ed5-4690-96d7-d815c79d5cac tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:04.243285 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0219208d-4ed5-4690-96d7-d815c79d5cac tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:04.244273 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0219208d-4ed5-4690-96d7-d815c79d5cac tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:04.244987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0219208d-4ed5-4690-96d7-d815c79d5cac tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:04.245788 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0219208d-4ed5-4690-96d7-d815c79d5cac tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:04.485307 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e661b79e-1b40-4db3-89df-cd3a52382bf2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:04.487793 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e661b79e-1b40-4db3-89df-cd3a52382bf2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:04.509725 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e661b79e-1b40-4db3-89df-cd3a52382bf2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:04.510241 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e661b79e-1b40-4db3-89df-cd3a52382bf2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:04.529946 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e661b79e-1b40-4db3-89df-cd3a52382bf2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:04.531049 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e661b79e-1b40-4db3-89df-cd3a52382bf2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:04.531546 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e661b79e-1b40-4db3-89df-cd3a52382bf2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:04.531993 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e661b79e-1b40-4db3-89df-cd3a52382bf2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:04.683227 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e661b79e-1b40-4db3-89df-cd3a52382bf2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.203982 Sep 24 20:58:04.683846 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1131/2249] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:04 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:58:04.739681 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4de0a160-96c7-4b99-9ac5-353c8dcbbc4f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:04.740310 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4de0a160-96c7-4b99-9ac5-353c8dcbbc4f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:04.753546 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4de0a160-96c7-4b99-9ac5-353c8dcbbc4f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:04.754052 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4de0a160-96c7-4b99-9ac5-353c8dcbbc4f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:04.754519 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4de0a160-96c7-4b99-9ac5-353c8dcbbc4f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:04.755250 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4de0a160-96c7-4b99-9ac5-353c8dcbbc4f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:04.755711 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4de0a160-96c7-4b99-9ac5-353c8dcbbc4f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:04.756147 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4de0a160-96c7-4b99-9ac5-353c8dcbbc4f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:05.102482 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4de0a160-96c7-4b99-9ac5-353c8dcbbc4f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:05.118856 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4de0a160-96c7-4b99-9ac5-353c8dcbbc4f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1213 microversion: 2.1 time: 0.383423 Sep 24 20:58:05.148694 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1132/2250] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:04 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1213 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:05.184988 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-57e4d8be-89da-4d27-8c34-a2ae6d2f1d90 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:05.186453 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-57e4d8be-89da-4d27-8c34-a2ae6d2f1d90 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: e781d448-5d66-4040-bf4c-37452b0f7b1c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:05.192511 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0219208d-4ed5-4690-96d7-d815c79d5cac tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:05.212226 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57e4d8be-89da-4d27-8c34-a2ae6d2f1d90 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:05.214450 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0219208d-4ed5-4690-96d7-d815c79d5cac tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 200 len: 1333 microversion: 2.1 time: 0.989167 Sep 24 20:58:05.215485 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1119/2251] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:04 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 1333 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:05.217497 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57e4d8be-89da-4d27-8c34-a2ae6d2f1d90 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:05.221358 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57e4d8be-89da-4d27-8c34-a2ae6d2f1d90 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:05.225871 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57e4d8be-89da-4d27-8c34-a2ae6d2f1d90 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:05.230854 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2bfb0658-2123-4dba-bff8-d155c4d68ef7 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b10fba5e0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:05.234200 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57e4d8be-89da-4d27-8c34-a2ae6d2f1d90 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:05.237988 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57e4d8be-89da-4d27-8c34-a2ae6d2f1d90 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:05.350531 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2bfb0658-2123-4dba-bff8-d155c4d68ef7 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613" status: 200 len: 1451 microversion: 2.1 time: 0.132587 Sep 24 20:58:05.359624 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1120/2252] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:05 2022] GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613 => generated 1451 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:05.699635 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c2c8051e-2990-471f-a7a6-e8dafad002c4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:05.703254 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c2c8051e-2990-471f-a7a6-e8dafad002c4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:05.724768 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2c8051e-2990-471f-a7a6-e8dafad002c4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:05.728505 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2c8051e-2990-471f-a7a6-e8dafad002c4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:05.729647 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2c8051e-2990-471f-a7a6-e8dafad002c4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:05.731332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2c8051e-2990-471f-a7a6-e8dafad002c4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:05.735309 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2c8051e-2990-471f-a7a6-e8dafad002c4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:05.736974 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2c8051e-2990-471f-a7a6-e8dafad002c4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:05.813465 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c2c8051e-2990-471f-a7a6-e8dafad002c4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.120797 Sep 24 20:58:05.826618 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1121/2253] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:05 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:58:05.852517 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-57e4d8be-89da-4d27-8c34-a2ae6d2f1d90 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:05.861784 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-57e4d8be-89da-4d27-8c34-a2ae6d2f1d90 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c" status: 200 len: 1292 microversion: 2.1 time: 0.694782 Sep 24 20:58:05.878367 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1133/2254] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:05 2022] GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c => generated 1292 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:06.149775 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5844fc92-4dd3-4c52-a1fd-3e774cf209ea tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:06.150645 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5844fc92-4dd3-4c52-a1fd-3e774cf209ea tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:06.166472 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5844fc92-4dd3-4c52-a1fd-3e774cf209ea tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:06.167034 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5844fc92-4dd3-4c52-a1fd-3e774cf209ea tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:06.167764 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5844fc92-4dd3-4c52-a1fd-3e774cf209ea tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:06.170687 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5844fc92-4dd3-4c52-a1fd-3e774cf209ea tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:06.172952 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5844fc92-4dd3-4c52-a1fd-3e774cf209ea tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:06.175774 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5844fc92-4dd3-4c52-a1fd-3e774cf209ea tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:06.243800 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a28199bd-46f6-4937-95b2-82ab87d4e2cc tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:06.244444 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a28199bd-46f6-4937-95b2-82ab87d4e2cc tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:06.261537 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a28199bd-46f6-4937-95b2-82ab87d4e2cc tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:06.262045 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a28199bd-46f6-4937-95b2-82ab87d4e2cc tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:06.262486 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a28199bd-46f6-4937-95b2-82ab87d4e2cc tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:06.273942 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a28199bd-46f6-4937-95b2-82ab87d4e2cc tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:06.278662 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a28199bd-46f6-4937-95b2-82ab87d4e2cc tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:06.280875 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a28199bd-46f6-4937-95b2-82ab87d4e2cc tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:06.497105 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5844fc92-4dd3-4c52-a1fd-3e774cf209ea tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:06.506960 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5844fc92-4dd3-4c52-a1fd-3e774cf209ea tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1269 microversion: 2.1 time: 0.361477 Sep 24 20:58:06.517012 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1122/2255] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:06 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1269 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:06.535056 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-de0be6ad-ef34-4071-89f5-c883b72556fc tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b1106e1f0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:06.619735 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-de0be6ad-ef34-4071-89f5-c883b72556fc tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613" status: 200 len: 1451 microversion: 2.1 time: 0.100905 Sep 24 20:58:06.629512 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1123/2256] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:06 2022] GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613 => generated 1451 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:06.833173 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-be0783bb-c309-4f5f-96b2-65c8729143c3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:06.836061 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-be0783bb-c309-4f5f-96b2-65c8729143c3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:06.857030 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-be0783bb-c309-4f5f-96b2-65c8729143c3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:06.857927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-be0783bb-c309-4f5f-96b2-65c8729143c3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:06.858717 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-be0783bb-c309-4f5f-96b2-65c8729143c3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:06.859712 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-be0783bb-c309-4f5f-96b2-65c8729143c3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:06.860428 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-be0783bb-c309-4f5f-96b2-65c8729143c3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:06.863862 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-be0783bb-c309-4f5f-96b2-65c8729143c3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:06.970254 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-be0783bb-c309-4f5f-96b2-65c8729143c3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.142505 Sep 24 20:58:06.971468 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1124/2257] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:06 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:58:06.979684 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f1ac585f-7004-4ae7-814f-94285965b2fd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:06.987354 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f1ac585f-7004-4ae7-814f-94285965b2fd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: e781d448-5d66-4040-bf4c-37452b0f7b1c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:07.007258 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1ac585f-7004-4ae7-814f-94285965b2fd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:07.013557 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1ac585f-7004-4ae7-814f-94285965b2fd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:07.014321 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1ac585f-7004-4ae7-814f-94285965b2fd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:07.015330 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1ac585f-7004-4ae7-814f-94285965b2fd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:07.016033 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1ac585f-7004-4ae7-814f-94285965b2fd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:07.016695 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1ac585f-7004-4ae7-814f-94285965b2fd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:07.364846 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f1ac585f-7004-4ae7-814f-94285965b2fd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:07.379599 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f1ac585f-7004-4ae7-814f-94285965b2fd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c" status: 200 len: 1298 microversion: 2.1 time: 0.406807 Sep 24 20:58:07.380197 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1125/2258] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:06 2022] GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c => generated 1298 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:07.397857 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a28199bd-46f6-4937-95b2-82ab87d4e2cc tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:07.408958 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a28199bd-46f6-4937-95b2-82ab87d4e2cc tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 200 len: 1333 microversion: 2.1 time: 1.168763 Sep 24 20:58:07.428858 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1134/2259] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:06 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 1333 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:07.545310 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ac9dc00c-b719-41ab-8935-32d0a41cd786 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:07.545938 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ac9dc00c-b719-41ab-8935-32d0a41cd786 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:07.556128 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac9dc00c-b719-41ab-8935-32d0a41cd786 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:07.559354 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac9dc00c-b719-41ab-8935-32d0a41cd786 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:07.559968 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac9dc00c-b719-41ab-8935-32d0a41cd786 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:07.560898 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac9dc00c-b719-41ab-8935-32d0a41cd786 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:07.561511 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac9dc00c-b719-41ab-8935-32d0a41cd786 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:07.563583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac9dc00c-b719-41ab-8935-32d0a41cd786 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:07.644890 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1f833692-a0ed-452d-bd8b-a465529beab7 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b0c126040>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:07.724833 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1f833692-a0ed-452d-bd8b-a465529beab7 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613" status: 200 len: 1451 microversion: 2.1 time: 0.085003 Sep 24 20:58:07.725866 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1135/2260] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:07 2022] GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613 => generated 1451 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:07.763691 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ac9dc00c-b719-41ab-8935-32d0a41cd786 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:07.777684 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ac9dc00c-b719-41ab-8935-32d0a41cd786 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1275 microversion: 2.1 time: 0.236201 Sep 24 20:58:07.778864 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1126/2261] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:07 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1275 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:07.985239 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0d30d0b9-729b-4745-915c-d973bcb3d9f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:07.997386 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0d30d0b9-729b-4745-915c-d973bcb3d9f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:08.020480 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d30d0b9-729b-4745-915c-d973bcb3d9f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:08.024982 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d30d0b9-729b-4745-915c-d973bcb3d9f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:08.026427 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d30d0b9-729b-4745-915c-d973bcb3d9f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:08.030866 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d30d0b9-729b-4745-915c-d973bcb3d9f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:08.035425 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d30d0b9-729b-4745-915c-d973bcb3d9f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:08.040694 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d30d0b9-729b-4745-915c-d973bcb3d9f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:08.150577 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0d30d0b9-729b-4745-915c-d973bcb3d9f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.170785 Sep 24 20:58:08.153084 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1136/2262] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:07 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:58:08.403923 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0682dc81-8110-47a7-8e5d-198e022fdfa7 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:08.404888 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0682dc81-8110-47a7-8e5d-198e022fdfa7 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: e781d448-5d66-4040-bf4c-37452b0f7b1c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:08.437900 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c9e4c9e4-9757-48d5-92f1-bb2063750537 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:08.438838 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c9e4c9e4-9757-48d5-92f1-bb2063750537 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:08.448398 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0682dc81-8110-47a7-8e5d-198e022fdfa7 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:08.449294 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0682dc81-8110-47a7-8e5d-198e022fdfa7 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:08.451070 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0682dc81-8110-47a7-8e5d-198e022fdfa7 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:08.453653 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0682dc81-8110-47a7-8e5d-198e022fdfa7 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:08.454193 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0682dc81-8110-47a7-8e5d-198e022fdfa7 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:08.457589 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0682dc81-8110-47a7-8e5d-198e022fdfa7 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:08.468010 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c9e4c9e4-9757-48d5-92f1-bb2063750537 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:08.468652 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c9e4c9e4-9757-48d5-92f1-bb2063750537 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:08.469155 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c9e4c9e4-9757-48d5-92f1-bb2063750537 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:08.470077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c9e4c9e4-9757-48d5-92f1-bb2063750537 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:08.470786 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c9e4c9e4-9757-48d5-92f1-bb2063750537 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:08.471232 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c9e4c9e4-9757-48d5-92f1-bb2063750537 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:08.647441 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0682dc81-8110-47a7-8e5d-198e022fdfa7 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:08.666164 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0682dc81-8110-47a7-8e5d-198e022fdfa7 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c" status: 200 len: 1298 microversion: 2.1 time: 0.266015 Sep 24 20:58:08.668887 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1127/2263] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:08 2022] GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c => generated 1298 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:08.742580 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-77577dcb-c918-4d3b-ac26-2940b073bb52 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b1106ac10>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:08.896645 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-77577dcb-c918-4d3b-ac26-2940b073bb52 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613" status: 200 len: 1451 microversion: 2.1 time: 0.159600 Sep 24 20:58:08.897588 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1128/2264] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:08 2022] GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613 => generated 1451 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:08.902787 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-18702e37-3465-431b-891d-1fb79ef27983 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:08.904225 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-18702e37-3465-431b-891d-1fb79ef27983 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:08.911920 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-18702e37-3465-431b-891d-1fb79ef27983 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:08.912842 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-18702e37-3465-431b-891d-1fb79ef27983 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:08.913991 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-18702e37-3465-431b-891d-1fb79ef27983 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:08.914894 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-18702e37-3465-431b-891d-1fb79ef27983 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:08.916305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-18702e37-3465-431b-891d-1fb79ef27983 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:08.916898 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-18702e37-3465-431b-891d-1fb79ef27983 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:09.034445 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-18702e37-3465-431b-891d-1fb79ef27983 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:09.047371 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c9e4c9e4-9757-48d5-92f1-bb2063750537 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:09.049133 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-18702e37-3465-431b-891d-1fb79ef27983 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1275 microversion: 2.1 time: 0.149991 Sep 24 20:58:09.060908 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c9e4c9e4-9757-48d5-92f1-bb2063750537 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 200 len: 1354 microversion: 2.1 time: 0.628767 Sep 24 20:58:09.063327 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1129/2265] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:08 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1275 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:09.069158 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1137/2266] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:08 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 1354 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:58:09.166793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9c697960-4836-4209-b0b6-1d2e27635e2e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:09.169608 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9c697960-4836-4209-b0b6-1d2e27635e2e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:09.188488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c697960-4836-4209-b0b6-1d2e27635e2e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:09.189941 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c697960-4836-4209-b0b6-1d2e27635e2e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:09.192325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c697960-4836-4209-b0b6-1d2e27635e2e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:09.194985 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c697960-4836-4209-b0b6-1d2e27635e2e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:09.197794 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c697960-4836-4209-b0b6-1d2e27635e2e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:09.198933 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c697960-4836-4209-b0b6-1d2e27635e2e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:09.267760 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9c697960-4836-4209-b0b6-1d2e27635e2e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.106406 Sep 24 20:58:09.268611 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1130/2267] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:09 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:58:09.691515 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-464b043c-9634-454a-893d-3d046291dd44 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:09.692815 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-464b043c-9634-454a-893d-3d046291dd44 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: e781d448-5d66-4040-bf4c-37452b0f7b1c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:09.702666 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-464b043c-9634-454a-893d-3d046291dd44 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:09.707332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-464b043c-9634-454a-893d-3d046291dd44 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:09.723291 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-464b043c-9634-454a-893d-3d046291dd44 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:09.727578 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-464b043c-9634-454a-893d-3d046291dd44 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:09.733098 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-464b043c-9634-454a-893d-3d046291dd44 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:09.734810 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-464b043c-9634-454a-893d-3d046291dd44 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:09.914363 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-da4940e3-64f8-4ba2-95cc-c6d439d350c0 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b1112c4c0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:09.988785 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-da4940e3-64f8-4ba2-95cc-c6d439d350c0 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613" status: 200 len: 1451 microversion: 2.1 time: 0.078326 Sep 24 20:58:09.989748 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1131/2268] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:09 2022] GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613 => generated 1451 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:10.075022 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bda26429-8440-40b2-bad1-bbbe526a7976 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:10.075656 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-bda26429-8440-40b2-bad1-bbbe526a7976 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:10.083663 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bda26429-8440-40b2-bad1-bbbe526a7976 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:10.084448 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bda26429-8440-40b2-bad1-bbbe526a7976 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:10.085043 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bda26429-8440-40b2-bad1-bbbe526a7976 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:10.085949 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bda26429-8440-40b2-bad1-bbbe526a7976 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:10.086631 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bda26429-8440-40b2-bad1-bbbe526a7976 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:10.087317 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bda26429-8440-40b2-bad1-bbbe526a7976 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:10.481705 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-464b043c-9634-454a-893d-3d046291dd44 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:10.491154 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-464b043c-9634-454a-893d-3d046291dd44 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c" status: 200 len: 1298 microversion: 2.1 time: 0.804646 Sep 24 20:58:10.495111 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1138/2269] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:09 2022] GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c => generated 1298 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:10.509071 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-924dcabe-233d-43be-8860-4155b424f3fc tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:10.510160 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-924dcabe-233d-43be-8860-4155b424f3fc tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:10.523698 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-924dcabe-233d-43be-8860-4155b424f3fc tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:10.526373 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-924dcabe-233d-43be-8860-4155b424f3fc tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:10.527093 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-924dcabe-233d-43be-8860-4155b424f3fc tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:10.528391 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-924dcabe-233d-43be-8860-4155b424f3fc tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:10.529104 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-924dcabe-233d-43be-8860-4155b424f3fc tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:10.530013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-924dcabe-233d-43be-8860-4155b424f3fc tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:10.783534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-bda26429-8440-40b2-bad1-bbbe526a7976 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:10.796185 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bda26429-8440-40b2-bad1-bbbe526a7976 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1317 microversion: 2.1 time: 0.726029 Sep 24 20:58:10.803046 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1132/2270] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:10 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1317 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:10.812503 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2efd7f7c-5d47-40a2-b0e0-f2883394bcde tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:10.824191 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2efd7f7c-5d47-40a2-b0e0-f2883394bcde tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:10.843035 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2efd7f7c-5d47-40a2-b0e0-f2883394bcde tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:10.845228 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2efd7f7c-5d47-40a2-b0e0-f2883394bcde tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:10.846816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2efd7f7c-5d47-40a2-b0e0-f2883394bcde tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:10.849681 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2efd7f7c-5d47-40a2-b0e0-f2883394bcde tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:10.851696 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2efd7f7c-5d47-40a2-b0e0-f2883394bcde tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:10.852234 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2efd7f7c-5d47-40a2-b0e0-f2883394bcde tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:10.940218 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2efd7f7c-5d47-40a2-b0e0-f2883394bcde tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.135209 Sep 24 20:58:10.949691 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1133/2271] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:10 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:58:11.005027 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b4ed50e0-c8eb-46a5-bcf7-048c7b184972 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b1117bf70>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:11.063718 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b4ed50e0-c8eb-46a5-bcf7-048c7b184972 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613" status: 200 len: 1451 microversion: 2.1 time: 0.063267 Sep 24 20:58:11.064861 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1134/2272] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:10 2022] GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613 => generated 1451 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:58:11.217596 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-924dcabe-233d-43be-8860-4155b424f3fc tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:11.228574 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-924dcabe-233d-43be-8860-4155b424f3fc tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 200 len: 1354 microversion: 2.1 time: 0.732068 Sep 24 20:58:11.242765 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1139/2273] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:10 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 1354 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:11.522835 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-15930de2-5aff-4cf2-9582-49d521ccfa6b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:11.523369 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-15930de2-5aff-4cf2-9582-49d521ccfa6b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: e781d448-5d66-4040-bf4c-37452b0f7b1c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:11.541545 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-15930de2-5aff-4cf2-9582-49d521ccfa6b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:11.542059 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-15930de2-5aff-4cf2-9582-49d521ccfa6b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:11.542539 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-15930de2-5aff-4cf2-9582-49d521ccfa6b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:11.543258 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-15930de2-5aff-4cf2-9582-49d521ccfa6b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:11.543733 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-15930de2-5aff-4cf2-9582-49d521ccfa6b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:11.544169 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-15930de2-5aff-4cf2-9582-49d521ccfa6b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:11.828105 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a9a68d8d-fe29-4bfc-99c4-6df6d614e9cb tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:11.829019 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a9a68d8d-fe29-4bfc-99c4-6df6d614e9cb tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:11.841406 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9a68d8d-fe29-4bfc-99c4-6df6d614e9cb tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:11.843066 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9a68d8d-fe29-4bfc-99c4-6df6d614e9cb tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:11.844790 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9a68d8d-fe29-4bfc-99c4-6df6d614e9cb tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:11.847252 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9a68d8d-fe29-4bfc-99c4-6df6d614e9cb tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:11.852205 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9a68d8d-fe29-4bfc-99c4-6df6d614e9cb tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:11.854531 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9a68d8d-fe29-4bfc-99c4-6df6d614e9cb tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:11.915018 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-15930de2-5aff-4cf2-9582-49d521ccfa6b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:11.927504 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-15930de2-5aff-4cf2-9582-49d521ccfa6b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c" status: 200 len: 1365 microversion: 2.1 time: 0.408580 Sep 24 20:58:11.928026 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1135/2274] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:11 2022] GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c => generated 1365 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:11.960808 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-59dae65b-f106-4e46-8c59-0ac0f0f227ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:11.963207 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-59dae65b-f106-4e46-8c59-0ac0f0f227ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:12.012371 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-59dae65b-f106-4e46-8c59-0ac0f0f227ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:12.022068 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-59dae65b-f106-4e46-8c59-0ac0f0f227ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:12.023081 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-59dae65b-f106-4e46-8c59-0ac0f0f227ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:12.024263 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-59dae65b-f106-4e46-8c59-0ac0f0f227ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:12.024421 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-59dae65b-f106-4e46-8c59-0ac0f0f227ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:12.024860 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-59dae65b-f106-4e46-8c59-0ac0f0f227ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:12.164379 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-59dae65b-f106-4e46-8c59-0ac0f0f227ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.208103 Sep 24 20:58:12.165005 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1136/2275] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:11 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:58:12.166800 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=4 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:58:12.175103 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f41c8760-ad88-4700-8704-bc2313768b7b tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b1116f550>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:12.259924 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f41c8760-ad88-4700-8704-bc2313768b7b tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613" status: 200 len: 1451 microversion: 2.1 time: 0.082734 Sep 24 20:58:12.262311 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1137/2276] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:12 2022] GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613 => generated 1451 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:12.271547 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-842a23ed-7df6-4a6b-8b82-a5ff6b7b496d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:12.274800 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-842a23ed-7df6-4a6b-8b82-a5ff6b7b496d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:12.282177 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a9a68d8d-fe29-4bfc-99c4-6df6d614e9cb tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:12.297987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-842a23ed-7df6-4a6b-8b82-a5ff6b7b496d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:12.299249 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a9a68d8d-fe29-4bfc-99c4-6df6d614e9cb tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1317 microversion: 2.1 time: 0.471286 Sep 24 20:58:12.299592 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-842a23ed-7df6-4a6b-8b82-a5ff6b7b496d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:12.300453 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-842a23ed-7df6-4a6b-8b82-a5ff6b7b496d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:12.301450 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-842a23ed-7df6-4a6b-8b82-a5ff6b7b496d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:12.301648 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1140/2277] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:11 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1317 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:12.301935 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-842a23ed-7df6-4a6b-8b82-a5ff6b7b496d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:12.302379 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-842a23ed-7df6-4a6b-8b82-a5ff6b7b496d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:12.379806 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:58:12.729792 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-842a23ed-7df6-4a6b-8b82-a5ff6b7b496d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:12.741376 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-842a23ed-7df6-4a6b-8b82-a5ff6b7b496d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 200 len: 1354 microversion: 2.1 time: 0.475361 Sep 24 20:58:12.758204 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1138/2278] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:12 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 1354 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:12.862252 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-5f956dca-d66a-4eed-be70-2fb542a83716 req-238a2c24-ff77-4ee9-9ff0-40d8afafba93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c394113-a640-4199-80e0-1316dd1b2828", "tag": "5fbaf336-e072-4bcb-a547-ba1e9efcffcf"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:58:12.927721 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-5f956dca-d66a-4eed-be70-2fb542a83716 req-238a2c24-ff77-4ee9-9ff0-40d8afafba93 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:12.963883 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c82c22b5-a65d-4a58-8f7c-d8518fb5d568 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:12.965107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c82c22b5-a65d-4a58-8f7c-d8518fb5d568 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: e781d448-5d66-4040-bf4c-37452b0f7b1c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:12.965466 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-5f956dca-d66a-4eed-be70-2fb542a83716 req-238a2c24-ff77-4ee9-9ff0-40d8afafba93 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.038s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:12.966139 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-5f956dca-d66a-4eed-be70-2fb542a83716 req-238a2c24-ff77-4ee9-9ff0-40d8afafba93 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:12.982900 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c82c22b5-a65d-4a58-8f7c-d8518fb5d568 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:12.984492 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c82c22b5-a65d-4a58-8f7c-d8518fb5d568 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:12.985133 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c82c22b5-a65d-4a58-8f7c-d8518fb5d568 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:12.986811 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c82c22b5-a65d-4a58-8f7c-d8518fb5d568 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:12.990532 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c82c22b5-a65d-4a58-8f7c-d8518fb5d568 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:12.991173 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c82c22b5-a65d-4a58-8f7c-d8518fb5d568 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:13.066438 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-5f956dca-d66a-4eed-be70-2fb542a83716 req-238a2c24-ff77-4ee9-9ff0-40d8afafba93 service nova] Creating event network-changed:5fbaf336-e072-4bcb-a547-ba1e9efcffcf for instance 1c394113-a640-4199-80e0-1316dd1b2828 on nch1-master-1 Sep 24 20:58:13.102983 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-5f956dca-d66a-4eed-be70-2fb542a83716 req-238a2c24-ff77-4ee9-9ff0-40d8afafba93 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.246173 Sep 24 20:58:13.109549 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1141/2279] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:58:13.179490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2bd34730-f652-4582-80d9-7871cc40d53b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:13.182954 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2bd34730-f652-4582-80d9-7871cc40d53b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:13.206618 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2bd34730-f652-4582-80d9-7871cc40d53b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:13.208262 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2bd34730-f652-4582-80d9-7871cc40d53b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:13.210710 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2bd34730-f652-4582-80d9-7871cc40d53b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:13.211628 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2bd34730-f652-4582-80d9-7871cc40d53b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:13.212241 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2bd34730-f652-4582-80d9-7871cc40d53b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:13.215898 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2bd34730-f652-4582-80d9-7871cc40d53b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:13.300734 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2bd34730-f652-4582-80d9-7871cc40d53b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.127091 Sep 24 20:58:13.311152 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1142/2280] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:13 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:58:13.317959 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-75e397f3-387c-488a-9233-f549eddca8cb tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b0c715430>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:13.396328 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-75e397f3-387c-488a-9233-f549eddca8cb tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613" status: 200 len: 1451 microversion: 2.1 time: 0.087707 Sep 24 20:58:13.400341 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1143/2281] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:13 2022] GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613 => generated 1451 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:13.407495 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5c0d3db1-52a3-42bc-9947-4f14d1ce307d tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:13.408752 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5c0d3db1-52a3-42bc-9947-4f14d1ce307d tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:13.430865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c0d3db1-52a3-42bc-9947-4f14d1ce307d tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:13.431357 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c0d3db1-52a3-42bc-9947-4f14d1ce307d tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:13.431863 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c0d3db1-52a3-42bc-9947-4f14d1ce307d tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:13.435081 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c0d3db1-52a3-42bc-9947-4f14d1ce307d tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:13.437773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c0d3db1-52a3-42bc-9947-4f14d1ce307d tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:13.438406 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c0d3db1-52a3-42bc-9947-4f14d1ce307d tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:13.697000 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=18 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:58:13.827538 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=8 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:58:13.962751 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c82c22b5-a65d-4a58-8f7c-d8518fb5d568 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:13.973189 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c82c22b5-a65d-4a58-8f7c-d8518fb5d568 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c" status: 200 len: 1365 microversion: 2.1 time: 1.021311 Sep 24 20:58:13.974451 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1139/2282] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:12 2022] GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c => generated 1365 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:13.986789 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5c0d3db1-52a3-42bc-9947-4f14d1ce307d tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:13.999492 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d4a32315-ff71-4194-ad2f-355c1adb631c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:14.004675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d4a32315-ff71-4194-ad2f-355c1adb631c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:14.012358 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5c0d3db1-52a3-42bc-9947-4f14d1ce307d tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1317 microversion: 2.1 time: 0.610860 Sep 24 20:58:14.013202 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1144/2283] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:13 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1317 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:14.022192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d4a32315-ff71-4194-ad2f-355c1adb631c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:14.026709 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d4a32315-ff71-4194-ad2f-355c1adb631c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:14.028486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d4a32315-ff71-4194-ad2f-355c1adb631c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:14.031509 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d4a32315-ff71-4194-ad2f-355c1adb631c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:14.043194 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d4a32315-ff71-4194-ad2f-355c1adb631c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:14.043861 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d4a32315-ff71-4194-ad2f-355c1adb631c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:14.320843 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-05894cfd-96ca-48e4-929a-d83e373cfa1b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:14.323373 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-05894cfd-96ca-48e4-929a-d83e373cfa1b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:14.338657 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05894cfd-96ca-48e4-929a-d83e373cfa1b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:14.342652 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05894cfd-96ca-48e4-929a-d83e373cfa1b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:14.343390 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05894cfd-96ca-48e4-929a-d83e373cfa1b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:14.344546 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05894cfd-96ca-48e4-929a-d83e373cfa1b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:14.345192 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05894cfd-96ca-48e4-929a-d83e373cfa1b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:14.346779 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05894cfd-96ca-48e4-929a-d83e373cfa1b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:14.425266 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d4a32315-ff71-4194-ad2f-355c1adb631c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:14.440807 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-05894cfd-96ca-48e4-929a-d83e373cfa1b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.124588 Sep 24 20:58:14.450215 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1145/2284] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:14 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:58:14.450341 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d4a32315-ff71-4194-ad2f-355c1adb631c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 200 len: 1354 microversion: 2.1 time: 0.452193 Sep 24 20:58:14.453594 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1140/2285] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:13 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 1354 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:14.473353 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6db91610-accf-449a-bff2-368ceba90559 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b0c95a9d0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:14.579447 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6db91610-accf-449a-bff2-368ceba90559 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613" status: 200 len: 1451 microversion: 2.1 time: 0.127956 Sep 24 20:58:14.582958 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1146/2286] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:14 2022] GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613 => generated 1451 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:15.004344 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-be8b494d-1084-4986-96dc-0e9fd456c15a tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:15.006601 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-be8b494d-1084-4986-96dc-0e9fd456c15a tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: e781d448-5d66-4040-bf4c-37452b0f7b1c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:15.021932 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-be8b494d-1084-4986-96dc-0e9fd456c15a tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:15.033636 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-be8b494d-1084-4986-96dc-0e9fd456c15a tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:15.035121 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-be8b494d-1084-4986-96dc-0e9fd456c15a tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:15.037789 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-be8b494d-1084-4986-96dc-0e9fd456c15a tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:15.039302 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-be8b494d-1084-4986-96dc-0e9fd456c15a tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:15.040392 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-be8b494d-1084-4986-96dc-0e9fd456c15a tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:15.041736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f99e3d96-c9a2-4608-ba4f-23f9597d0075 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:15.043266 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f99e3d96-c9a2-4608-ba4f-23f9597d0075 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:15.058011 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f99e3d96-c9a2-4608-ba4f-23f9597d0075 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:15.058954 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f99e3d96-c9a2-4608-ba4f-23f9597d0075 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:15.059502 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f99e3d96-c9a2-4608-ba4f-23f9597d0075 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:15.060311 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f99e3d96-c9a2-4608-ba4f-23f9597d0075 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:15.060856 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f99e3d96-c9a2-4608-ba4f-23f9597d0075 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:15.061369 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f99e3d96-c9a2-4608-ba4f-23f9597d0075 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:15.103974 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:58:15.130639 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:58:15.694730 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f99e3d96-c9a2-4608-ba4f-23f9597d0075 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:15.695865 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-be8b494d-1084-4986-96dc-0e9fd456c15a tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:15.703820 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f99e3d96-c9a2-4608-ba4f-23f9597d0075 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1317 microversion: 2.1 time: 0.666126 Sep 24 20:58:15.723343 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1147/2287] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:15 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1317 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:15.735348 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-be8b494d-1084-4986-96dc-0e9fd456c15a tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c" status: 200 len: 1365 microversion: 2.1 time: 0.737892 Sep 24 20:58:15.736537 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1141/2288] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:14 2022] GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c => generated 1365 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:15.737866 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ef08ec2b-7777-4ecd-afc1-33ec7c32d090 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:15.740247 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ef08ec2b-7777-4ecd-afc1-33ec7c32d090 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:15.746837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef08ec2b-7777-4ecd-afc1-33ec7c32d090 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:15.747335 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef08ec2b-7777-4ecd-afc1-33ec7c32d090 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:15.747779 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef08ec2b-7777-4ecd-afc1-33ec7c32d090 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:15.748500 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef08ec2b-7777-4ecd-afc1-33ec7c32d090 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:15.748962 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef08ec2b-7777-4ecd-afc1-33ec7c32d090 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:15.749390 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef08ec2b-7777-4ecd-afc1-33ec7c32d090 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:15.773697 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f2b395d9-07ba-4f88-8010-a9748a740522 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:15.774309 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f2b395d9-07ba-4f88-8010-a9748a740522 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:15.787198 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f2b395d9-07ba-4f88-8010-a9748a740522 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:15.793117 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f2b395d9-07ba-4f88-8010-a9748a740522 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:15.794104 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f2b395d9-07ba-4f88-8010-a9748a740522 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:15.795061 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f2b395d9-07ba-4f88-8010-a9748a740522 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:15.795708 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f2b395d9-07ba-4f88-8010-a9748a740522 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:15.796290 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f2b395d9-07ba-4f88-8010-a9748a740522 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:15.817134 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ef08ec2b-7777-4ecd-afc1-33ec7c32d090 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.092444 Sep 24 20:58:15.823744 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1148/2289] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:15 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:58:15.829582 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-4133a39e-8347-4457-b3b1-6a1695072c7f req-adcc698c-9d84-4c36-99f1-e5b30e221faf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7021278a-14b3-48a6-a442-5278d7d00fd5", "tag": "cea7414d-85d7-4b4b-9261-8e06b9e885f7"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:58:15.846806 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:58:15.849728 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-4133a39e-8347-4457-b3b1-6a1695072c7f req-adcc698c-9d84-4c36-99f1-e5b30e221faf service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:15.850489 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-4133a39e-8347-4457-b3b1-6a1695072c7f req-adcc698c-9d84-4c36-99f1-e5b30e221faf service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:15.851158 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-4133a39e-8347-4457-b3b1-6a1695072c7f req-adcc698c-9d84-4c36-99f1-e5b30e221faf service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:15.870288 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-4133a39e-8347-4457-b3b1-6a1695072c7f req-adcc698c-9d84-4c36-99f1-e5b30e221faf service nova] Creating event network-changed:cea7414d-85d7-4b4b-9261-8e06b9e885f7 for instance 7021278a-14b3-48a6-a442-5278d7d00fd5 on nch2-master-1 Sep 24 20:58:15.878536 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-4133a39e-8347-4457-b3b1-6a1695072c7f req-adcc698c-9d84-4c36-99f1-e5b30e221faf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051503 Sep 24 20:58:15.881561 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1149/2290] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:58:15.890041 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8d55a085-4b47-4201-a19f-04b9e8ddb4c2 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b0c8d4ca0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:15.984994 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8d55a085-4b47-4201-a19f-04b9e8ddb4c2 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613" status: 200 len: 1451 microversion: 2.1 time: 0.101162 Sep 24 20:58:15.985780 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1150/2291] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:15 2022] GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613 => generated 1451 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:16.674434 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f2b395d9-07ba-4f88-8010-a9748a740522 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:16.702171 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f2b395d9-07ba-4f88-8010-a9748a740522 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 200 len: 1354 microversion: 2.1 time: 0.952817 Sep 24 20:58:16.705294 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1142/2292] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:15 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 1354 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:16.727757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5f4efd86-f86a-411b-a05b-3d60ad00de9a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:16.728489 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5f4efd86-f86a-411b-a05b-3d60ad00de9a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:16.749155 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f4efd86-f86a-411b-a05b-3d60ad00de9a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:16.749837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f4efd86-f86a-411b-a05b-3d60ad00de9a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:16.751611 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f4efd86-f86a-411b-a05b-3d60ad00de9a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:16.754436 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f4efd86-f86a-411b-a05b-3d60ad00de9a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:16.758018 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f4efd86-f86a-411b-a05b-3d60ad00de9a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:16.758554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f4efd86-f86a-411b-a05b-3d60ad00de9a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:16.770408 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a59159aa-5c23-43ae-abdf-23ad0a9cf705 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:16.771388 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a59159aa-5c23-43ae-abdf-23ad0a9cf705 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: e781d448-5d66-4040-bf4c-37452b0f7b1c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:16.778144 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a59159aa-5c23-43ae-abdf-23ad0a9cf705 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:16.778945 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a59159aa-5c23-43ae-abdf-23ad0a9cf705 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:16.781353 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a59159aa-5c23-43ae-abdf-23ad0a9cf705 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:16.782311 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a59159aa-5c23-43ae-abdf-23ad0a9cf705 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:16.785107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a59159aa-5c23-43ae-abdf-23ad0a9cf705 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:16.785947 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a59159aa-5c23-43ae-abdf-23ad0a9cf705 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:17.334297 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a59159aa-5c23-43ae-abdf-23ad0a9cf705 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:17.342367 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a59159aa-5c23-43ae-abdf-23ad0a9cf705 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c" status: 200 len: 1365 microversion: 2.1 time: 0.576533 Sep 24 20:58:17.343000 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1143/2293] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:16 2022] GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c => generated 1365 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:58:17.371497 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c938f6cf-57d1-4fb7-80eb-6f08d123cb62 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:17.373824 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c938f6cf-57d1-4fb7-80eb-6f08d123cb62 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:17.424087 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c938f6cf-57d1-4fb7-80eb-6f08d123cb62 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:17.424588 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c938f6cf-57d1-4fb7-80eb-6f08d123cb62 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:17.425033 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c938f6cf-57d1-4fb7-80eb-6f08d123cb62 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:17.428972 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c938f6cf-57d1-4fb7-80eb-6f08d123cb62 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:17.429528 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c938f6cf-57d1-4fb7-80eb-6f08d123cb62 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:17.429970 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c938f6cf-57d1-4fb7-80eb-6f08d123cb62 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:17.519884 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c938f6cf-57d1-4fb7-80eb-6f08d123cb62 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.175786 Sep 24 20:58:17.530620 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1144/2294] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:17 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:58:17.536279 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-24367f19-71c5-4afd-b93e-008727221d71 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b10ff78b0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:17.627620 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-24367f19-71c5-4afd-b93e-008727221d71 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613" status: 200 len: 1451 microversion: 2.1 time: 0.094371 Sep 24 20:58:17.639154 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1145/2295] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:17 2022] GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613 => generated 1451 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:17.671628 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5f4efd86-f86a-411b-a05b-3d60ad00de9a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:17.686600 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5f4efd86-f86a-411b-a05b-3d60ad00de9a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1317 microversion: 2.1 time: 0.962425 Sep 24 20:58:17.687220 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1151/2296] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:16 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1317 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:17.732963 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-66eac669-50b4-45cc-a88f-f4db60d945bb tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:17.734427 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-66eac669-50b4-45cc-a88f-f4db60d945bb tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:17.758599 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66eac669-50b4-45cc-a88f-f4db60d945bb tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:17.759135 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66eac669-50b4-45cc-a88f-f4db60d945bb tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:17.760678 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66eac669-50b4-45cc-a88f-f4db60d945bb tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:17.765631 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66eac669-50b4-45cc-a88f-f4db60d945bb tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:17.766977 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66eac669-50b4-45cc-a88f-f4db60d945bb tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:17.772843 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66eac669-50b4-45cc-a88f-f4db60d945bb tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:18.161598 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c3bdf787-1ba6-4a11-8970-cabfd22d52c9 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-674599932", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:58:18.273526 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-66eac669-50b4-45cc-a88f-f4db60d945bb tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:18.287370 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-66eac669-50b4-45cc-a88f-f4db60d945bb tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 200 len: 1354 microversion: 2.1 time: 0.558413 Sep 24 20:58:18.287986 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1152/2297] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:17 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 1354 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:18.308389 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-c3bdf787-1ba6-4a11-8970-cabfd22d52c9 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] validate_networks() for None {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:58:18.312949 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-977612bd-5a40-4327-9c9f-9a8ef13c2970 req-226f0052-d041-43da-8d5c-019f737fd926 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e781d448-5d66-4040-bf4c-37452b0f7b1c", "tag": "ac7cf96e-fcba-4f98-ab54-6ea3518610bf"}, {"name": "network-changed", "server_uuid": "1c394113-a640-4199-80e0-1316dd1b2828", "tag": "a95c393d-6869-46f3-abf0-a9a01e228621"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:58:18.340946 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-977612bd-5a40-4327-9c9f-9a8ef13c2970 req-226f0052-d041-43da-8d5c-019f737fd926 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:18.344773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-977612bd-5a40-4327-9c9f-9a8ef13c2970 req-226f0052-d041-43da-8d5c-019f737fd926 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:18.345975 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-977612bd-5a40-4327-9c9f-9a8ef13c2970 req-226f0052-d041-43da-8d5c-019f737fd926 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:18.381915 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-977612bd-5a40-4327-9c9f-9a8ef13c2970 req-226f0052-d041-43da-8d5c-019f737fd926 service nova] Creating event network-changed:ac7cf96e-fcba-4f98-ab54-6ea3518610bf for instance e781d448-5d66-4040-bf4c-37452b0f7b1c on nch2-master-1 Sep 24 20:58:18.382524 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-977612bd-5a40-4327-9c9f-9a8ef13c2970 req-226f0052-d041-43da-8d5c-019f737fd926 service nova] Creating event network-changed:a95c393d-6869-46f3-abf0-a9a01e228621 for instance 1c394113-a640-4199-80e0-1316dd1b2828 on nch1-master-1 Sep 24 20:58:18.401718 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-977612bd-5a40-4327-9c9f-9a8ef13c2970 req-226f0052-d041-43da-8d5c-019f737fd926 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.110373 Sep 24 20:58:18.406691 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1153/2298] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:58:18.417476 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-996a656b-9716-4444-921d-eead3bd7e91d tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:18.418206 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-996a656b-9716-4444-921d-eead3bd7e91d tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: e781d448-5d66-4040-bf4c-37452b0f7b1c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:18.437764 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-996a656b-9716-4444-921d-eead3bd7e91d tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:18.438266 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-996a656b-9716-4444-921d-eead3bd7e91d tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:18.439296 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-996a656b-9716-4444-921d-eead3bd7e91d tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:18.440083 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-996a656b-9716-4444-921d-eead3bd7e91d tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:18.440551 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-996a656b-9716-4444-921d-eead3bd7e91d tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:18.454301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-996a656b-9716-4444-921d-eead3bd7e91d tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:19.327133 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-996a656b-9716-4444-921d-eead3bd7e91d tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:19.342725 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-996a656b-9716-4444-921d-eead3bd7e91d tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c" status: 200 len: 1365 microversion: 2.1 time: 0.934544 Sep 24 20:58:19.343595 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1154/2299] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:18 2022] GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c => generated 1365 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:19.350650 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3e1e665d-8d19-4322-a592-8dea8b3d4e16 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:19.356989 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3e1e665d-8d19-4322-a592-8dea8b3d4e16 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:19.370162 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e1e665d-8d19-4322-a592-8dea8b3d4e16 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:19.370748 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e1e665d-8d19-4322-a592-8dea8b3d4e16 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:19.371158 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e1e665d-8d19-4322-a592-8dea8b3d4e16 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:19.371892 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e1e665d-8d19-4322-a592-8dea8b3d4e16 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:19.372358 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e1e665d-8d19-4322-a592-8dea8b3d4e16 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:19.372814 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e1e665d-8d19-4322-a592-8dea8b3d4e16 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:19.440317 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3e1e665d-8d19-4322-a592-8dea8b3d4e16 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.095443 Sep 24 20:58:19.448047 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1155/2300] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:19 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:58:19.453186 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f3211a9f-e6cb-4261-8924-711fefa0a4e9 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b0c895160>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:19.538610 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f3211a9f-e6cb-4261-8924-711fefa0a4e9 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613" status: 200 len: 1451 microversion: 2.1 time: 0.089093 Sep 24 20:58:19.539209 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1156/2301] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:19 2022] GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613 => generated 1451 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:19.551534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4e74e1c2-1ee8-49b9-a1c1-3d6fb28d396e tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:19.552084 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4e74e1c2-1ee8-49b9-a1c1-3d6fb28d396e tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:19.581016 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e74e1c2-1ee8-49b9-a1c1-3d6fb28d396e tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:19.581525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e74e1c2-1ee8-49b9-a1c1-3d6fb28d396e tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:19.581978 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e74e1c2-1ee8-49b9-a1c1-3d6fb28d396e tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:19.582803 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e74e1c2-1ee8-49b9-a1c1-3d6fb28d396e tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:19.583249 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e74e1c2-1ee8-49b9-a1c1-3d6fb28d396e tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:19.583684 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e74e1c2-1ee8-49b9-a1c1-3d6fb28d396e tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:19.949659 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-c3bdf787-1ba6-4a11-8970-cabfd22d52c9 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:58:19.950651 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-c3bdf787-1ba6-4a11-8970-cabfd22d52c9 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:58:19.951294 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-c3bdf787-1ba6-4a11-8970-cabfd22d52c9 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:58:19.951849 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-c3bdf787-1ba6-4a11-8970-cabfd22d52c9 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:58:19.952560 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-c3bdf787-1ba6-4a11-8970-cabfd22d52c9 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:58:19.993405 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3bdf787-1ba6-4a11-8970-cabfd22d52c9 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:19.994150 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3bdf787-1ba6-4a11-8970-cabfd22d52c9 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:19.994773 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3bdf787-1ba6-4a11-8970-cabfd22d52c9 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:19.995697 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3bdf787-1ba6-4a11-8970-cabfd22d52c9 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:19.996308 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3bdf787-1ba6-4a11-8970-cabfd22d52c9 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:19.996891 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3bdf787-1ba6-4a11-8970-cabfd22d52c9 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:20.011160 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4e74e1c2-1ee8-49b9-a1c1-3d6fb28d396e tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:20.027511 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4e74e1c2-1ee8-49b9-a1c1-3d6fb28d396e tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1317 microversion: 2.1 time: 0.478528 Sep 24 20:58:20.031065 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1157/2302] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:19 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1317 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:20.040600 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-c3bdf787-1ba6-4a11-8970-cabfd22d52c9 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Getting quotas for project ffbf416811f64df0b56656a0cf7778ce. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:58:20.041894 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b2729b12-5f64-4a25-8b3c-0799e75bac22 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:20.042786 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b2729b12-5f64-4a25-8b3c-0799e75bac22 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:20.052503 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-c3bdf787-1ba6-4a11-8970-cabfd22d52c9 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Getting quotas for user 1a343dddda044b8fa4eb797a4b64556a and project ffbf416811f64df0b56656a0cf7778ce. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:58:20.070395 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2729b12-5f64-4a25-8b3c-0799e75bac22 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:20.071243 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2729b12-5f64-4a25-8b3c-0799e75bac22 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:20.072008 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2729b12-5f64-4a25-8b3c-0799e75bac22 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:20.072948 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2729b12-5f64-4a25-8b3c-0799e75bac22 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:20.073628 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2729b12-5f64-4a25-8b3c-0799e75bac22 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:20.075874 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2729b12-5f64-4a25-8b3c-0799e75bac22 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:20.086460 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c3bdf787-1ba6-4a11-8970-cabfd22d52c9 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:58:20.089064 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c3bdf787-1ba6-4a11-8970-cabfd22d52c9 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 72bfdb29-fd39-41a3-8314-624925dcd0b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:58:20.151308 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:58:20.200514 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c3bdf787-1ba6-4a11-8970-cabfd22d52c9 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.534736 Sep 24 20:58:20.207368 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1146/2303] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:58:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:58:20.216320 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f216251c-7076-4a00-aa1a-43aa447bc4c3 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:20.221093 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f216251c-7076-4a00-aa1a-43aa447bc4c3 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 72bfdb29-fd39-41a3-8314-624925dcd0b3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:20.425223 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f216251c-7076-4a00-aa1a-43aa447bc4c3 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343dddda044b8fa4eb797a4b64556a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbf416811f64df0b56656a0cf7778ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:20.436900 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f216251c-7076-4a00-aa1a-43aa447bc4c3 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3" status: 200 len: 1218 microversion: 2.1 time: 0.224641 Sep 24 20:58:20.439403 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1147/2304] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:20 2022] GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3 => generated 1218 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:58:20.447218 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9650350e-e48b-4304-9324-0f317eca4b60 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:20.448157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9650350e-e48b-4304-9324-0f317eca4b60 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: e781d448-5d66-4040-bf4c-37452b0f7b1c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:20.476728 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9650350e-e48b-4304-9324-0f317eca4b60 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:20.477867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9650350e-e48b-4304-9324-0f317eca4b60 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:20.478530 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9650350e-e48b-4304-9324-0f317eca4b60 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:20.480552 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9650350e-e48b-4304-9324-0f317eca4b60 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:20.482107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9650350e-e48b-4304-9324-0f317eca4b60 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:20.483686 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9650350e-e48b-4304-9324-0f317eca4b60 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:20.575287 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b2729b12-5f64-4a25-8b3c-0799e75bac22 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:20.586399 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b2729b12-5f64-4a25-8b3c-0799e75bac22 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 200 len: 1354 microversion: 2.1 time: 0.552246 Sep 24 20:58:20.589216 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1158/2305] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:20 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 1354 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:20.616436 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-42224c5b-710b-484c-a030-262c0ae7350f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:20.618791 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-42224c5b-710b-484c-a030-262c0ae7350f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:20.649978 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-42224c5b-710b-484c-a030-262c0ae7350f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:20.662101 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-42224c5b-710b-484c-a030-262c0ae7350f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:20.662827 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-42224c5b-710b-484c-a030-262c0ae7350f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:20.663759 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-42224c5b-710b-484c-a030-262c0ae7350f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:20.664367 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-42224c5b-710b-484c-a030-262c0ae7350f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:20.664945 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-42224c5b-710b-484c-a030-262c0ae7350f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:20.733857 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-42224c5b-710b-484c-a030-262c0ae7350f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.127142 Sep 24 20:58:20.734749 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1159/2306] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:20 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:58:20.750327 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5937bf52-95b7-4f07-b4c7-4bb3a240cefa tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b0ca79790>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:20.836969 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5937bf52-95b7-4f07-b4c7-4bb3a240cefa tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613" status: 200 len: 1451 microversion: 2.1 time: 0.097163 Sep 24 20:58:20.837582 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1160/2307] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:20 2022] GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613 => generated 1451 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:20.850008 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-9a07e078-3564-45e1-a8b8-d27584975674 req-28313fb3-4c34-4065-abd0-2be530b04671 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c394113-a640-4199-80e0-1316dd1b2828", "tag": "356ffb26-b574-4bd3-8e28-72fc211fb860"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:58:20.879737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-9a07e078-3564-45e1-a8b8-d27584975674 req-28313fb3-4c34-4065-abd0-2be530b04671 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:20.880224 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-9a07e078-3564-45e1-a8b8-d27584975674 req-28313fb3-4c34-4065-abd0-2be530b04671 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:20.880656 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-9a07e078-3564-45e1-a8b8-d27584975674 req-28313fb3-4c34-4065-abd0-2be530b04671 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:20.914183 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-9a07e078-3564-45e1-a8b8-d27584975674 req-28313fb3-4c34-4065-abd0-2be530b04671 service nova] Creating event network-changed:356ffb26-b574-4bd3-8e28-72fc211fb860 for instance 1c394113-a640-4199-80e0-1316dd1b2828 on nch1-master-1 Sep 24 20:58:20.929586 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-9a07e078-3564-45e1-a8b8-d27584975674 req-28313fb3-4c34-4065-abd0-2be530b04671 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087220 Sep 24 20:58:20.931000 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1161/2308] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:58:20.941469 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9650350e-e48b-4304-9324-0f317eca4b60 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:20.956711 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9650350e-e48b-4304-9324-0f317eca4b60 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c" status: 200 len: 1365 microversion: 2.1 time: 0.514161 Sep 24 20:58:20.958959 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1148/2309] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:20 2022] GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c => generated 1365 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:21.059146 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-62993771-696d-4e39-ab07-72cc9e655615 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:21.060885 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-62993771-696d-4e39-ab07-72cc9e655615 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:21.081097 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62993771-696d-4e39-ab07-72cc9e655615 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:21.081916 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62993771-696d-4e39-ab07-72cc9e655615 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:21.083085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62993771-696d-4e39-ab07-72cc9e655615 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:21.085733 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62993771-696d-4e39-ab07-72cc9e655615 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:21.086549 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62993771-696d-4e39-ab07-72cc9e655615 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:21.087296 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62993771-696d-4e39-ab07-72cc9e655615 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:21.474260 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-482ad1ac-a5b3-478f-b214-a83a9272645e tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:21.474918 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-482ad1ac-a5b3-478f-b214-a83a9272645e tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 72bfdb29-fd39-41a3-8314-624925dcd0b3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:21.485131 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-482ad1ac-a5b3-478f-b214-a83a9272645e tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:21.492141 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-482ad1ac-a5b3-478f-b214-a83a9272645e tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:21.492665 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-482ad1ac-a5b3-478f-b214-a83a9272645e tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:21.493429 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-482ad1ac-a5b3-478f-b214-a83a9272645e tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:21.493906 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-482ad1ac-a5b3-478f-b214-a83a9272645e tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:21.494337 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-482ad1ac-a5b3-478f-b214-a83a9272645e tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:21.735262 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-482ad1ac-a5b3-478f-b214-a83a9272645e tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343dddda044b8fa4eb797a4b64556a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbf416811f64df0b56656a0cf7778ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:21.746295 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-482ad1ac-a5b3-478f-b214-a83a9272645e tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3" status: 200 len: 1214 microversion: 2.1 time: 0.277023 Sep 24 20:58:21.754872 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1149/2310] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:21 2022] GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3 => generated 1214 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:58:21.772332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b2b226a4-f1c7-4c9a-8f0d-04f46cb4f9dd tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:21.773230 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b2b226a4-f1c7-4c9a-8f0d-04f46cb4f9dd tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:21.779550 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b2b226a4-f1c7-4c9a-8f0d-04f46cb4f9dd tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:21.786702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b2b226a4-f1c7-4c9a-8f0d-04f46cb4f9dd tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:21.787159 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b2b226a4-f1c7-4c9a-8f0d-04f46cb4f9dd tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:21.788529 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b2b226a4-f1c7-4c9a-8f0d-04f46cb4f9dd tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:21.789184 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b2b226a4-f1c7-4c9a-8f0d-04f46cb4f9dd tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:21.789624 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b2b226a4-f1c7-4c9a-8f0d-04f46cb4f9dd tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:21.940819 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-62993771-696d-4e39-ab07-72cc9e655615 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:21.953455 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-62993771-696d-4e39-ab07-72cc9e655615 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1317 microversion: 2.1 time: 0.899294 Sep 24 20:58:21.954273 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1162/2311] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:21 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1317 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:21.978815 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5bf65f7a-f4e2-48bf-9a1d-98a872264027 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:21.984925 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5bf65f7a-f4e2-48bf-9a1d-98a872264027 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:21.992672 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5bf65f7a-f4e2-48bf-9a1d-98a872264027 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:21.995393 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5bf65f7a-f4e2-48bf-9a1d-98a872264027 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:21.996008 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5bf65f7a-f4e2-48bf-9a1d-98a872264027 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:21.996910 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5bf65f7a-f4e2-48bf-9a1d-98a872264027 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:21.997525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5bf65f7a-f4e2-48bf-9a1d-98a872264027 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:21.998145 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5bf65f7a-f4e2-48bf-9a1d-98a872264027 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:22.129676 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5bf65f7a-f4e2-48bf-9a1d-98a872264027 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.155385 Sep 24 20:58:22.134481 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1163/2312] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:21 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:58:22.145600 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9df9b130-b921-4417-bb3a-dec35c8f5350 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b0c895160>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:22.227803 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9df9b130-b921-4417-bb3a-dec35c8f5350 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613" status: 200 len: 1460 microversion: 2.1 time: 0.095841 Sep 24 20:58:22.228819 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1164/2313] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:22 2022] GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613 => generated 1460 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:22.240621 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-52ccb2f6-6f17-45f7-84e9-b6756402ce7b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:22.243709 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-52ccb2f6-6f17-45f7-84e9-b6756402ce7b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: e781d448-5d66-4040-bf4c-37452b0f7b1c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:22.262613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52ccb2f6-6f17-45f7-84e9-b6756402ce7b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:22.264993 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52ccb2f6-6f17-45f7-84e9-b6756402ce7b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:22.265598 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52ccb2f6-6f17-45f7-84e9-b6756402ce7b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:22.266525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52ccb2f6-6f17-45f7-84e9-b6756402ce7b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:22.268033 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52ccb2f6-6f17-45f7-84e9-b6756402ce7b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:22.271077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52ccb2f6-6f17-45f7-84e9-b6756402ce7b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:22.499738 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b2b226a4-f1c7-4c9a-8f0d-04f46cb4f9dd tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:22.518332 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b2b226a4-f1c7-4c9a-8f0d-04f46cb4f9dd tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 200 len: 1354 microversion: 2.1 time: 0.762023 Sep 24 20:58:22.520095 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1150/2314] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:21 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 1354 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:22.527651 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1ae48e50-d25e-4f08-b68d-df2a5e884f0f tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b10f9b430>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:22.615271 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1ae48e50-d25e-4f08-b68d-df2a5e884f0f tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613" status: 200 len: 1460 microversion: 2.1 time: 0.093313 Sep 24 20:58:22.616398 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1151/2315] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:22 2022] GET /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613 => generated 1460 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:22.633486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-635e8481-1d79-4bf1-82f0-eacfe50d8a82 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:22.634795 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-635e8481-1d79-4bf1-82f0-eacfe50d8a82 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:22.644183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-635e8481-1d79-4bf1-82f0-eacfe50d8a82 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:22.646297 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-635e8481-1d79-4bf1-82f0-eacfe50d8a82 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:22.647115 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-635e8481-1d79-4bf1-82f0-eacfe50d8a82 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:22.648220 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-635e8481-1d79-4bf1-82f0-eacfe50d8a82 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:22.648904 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-635e8481-1d79-4bf1-82f0-eacfe50d8a82 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:22.651601 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-635e8481-1d79-4bf1-82f0-eacfe50d8a82 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:22.697368 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-52ccb2f6-6f17-45f7-84e9-b6756402ce7b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:22.709054 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-52ccb2f6-6f17-45f7-84e9-b6756402ce7b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c" status: 200 len: 1365 microversion: 2.1 time: 0.478963 Sep 24 20:58:22.710558 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1165/2316] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:22 2022] GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c => generated 1365 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:22.792126 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9ce24099-7b56-408a-8e98-b1c70106f274 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:22.793622 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9ce24099-7b56-408a-8e98-b1c70106f274 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 72bfdb29-fd39-41a3-8314-624925dcd0b3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:22.832192 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ce24099-7b56-408a-8e98-b1c70106f274 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:22.833273 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ce24099-7b56-408a-8e98-b1c70106f274 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:22.834694 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ce24099-7b56-408a-8e98-b1c70106f274 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:22.839763 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ce24099-7b56-408a-8e98-b1c70106f274 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:22.840921 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ce24099-7b56-408a-8e98-b1c70106f274 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:22.841563 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ce24099-7b56-408a-8e98-b1c70106f274 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:23.006522 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9ce24099-7b56-408a-8e98-b1c70106f274 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343dddda044b8fa4eb797a4b64556a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbf416811f64df0b56656a0cf7778ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:23.021374 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9ce24099-7b56-408a-8e98-b1c70106f274 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3" status: 200 len: 1276 microversion: 2.1 time: 0.241721 Sep 24 20:58:23.040328 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1166/2317] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:22 2022] GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3 => generated 1276 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:58:23.046144 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-53c47f95-bd47-4669-a0da-53685815c622 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:23.046830 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-53c47f95-bd47-4669-a0da-53685815c622 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:23.070262 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53c47f95-bd47-4669-a0da-53685815c622 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:23.070809 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53c47f95-bd47-4669-a0da-53685815c622 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:23.074534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53c47f95-bd47-4669-a0da-53685815c622 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:23.075992 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53c47f95-bd47-4669-a0da-53685815c622 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:23.076882 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53c47f95-bd47-4669-a0da-53685815c622 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:23.077773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53c47f95-bd47-4669-a0da-53685815c622 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:23.236649 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-635e8481-1d79-4bf1-82f0-eacfe50d8a82 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00585dbe7f814eeebda43417ca1d0ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265d7d88bb6f45708203ea74df8f3214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:23.260286 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-635e8481-1d79-4bf1-82f0-eacfe50d8a82 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/servers/4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51" status: 200 len: 1466 microversion: 2.1 time: 0.632885 Sep 24 20:58:23.261415 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1152/2318] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:22 2022] GET /compute/v2.1/servers/4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51 => generated 1466 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:23.273068 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-99951fc0-7b45-4417-a9fe-27fb6972a1d5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:23.281980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-99951fc0-7b45-4417-a9fe-27fb6972a1d5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:23.290570 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-99951fc0-7b45-4417-a9fe-27fb6972a1d5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:23.307065 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-99951fc0-7b45-4417-a9fe-27fb6972a1d5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:23.307772 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-99951fc0-7b45-4417-a9fe-27fb6972a1d5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:23.308695 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-99951fc0-7b45-4417-a9fe-27fb6972a1d5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:23.310396 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-99951fc0-7b45-4417-a9fe-27fb6972a1d5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:23.311017 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-99951fc0-7b45-4417-a9fe-27fb6972a1d5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:23.397846 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-99951fc0-7b45-4417-a9fe-27fb6972a1d5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.135017 Sep 24 20:58:23.398836 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1153/2319] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:23 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:58:23.421882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-06109667-e345-4123-a427-08de745bc49c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-112171406"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:58:23.426577 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-06109667-e345-4123-a427-08de745bc49c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 8f800d64-00f6-4135-8090-c95d84acd232] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:23.437082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06109667-e345-4123-a427-08de745bc49c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:23.445059 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06109667-e345-4123-a427-08de745bc49c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:23.446321 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06109667-e345-4123-a427-08de745bc49c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:23.447397 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06109667-e345-4123-a427-08de745bc49c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:23.448133 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06109667-e345-4123-a427-08de745bc49c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:23.463569 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06109667-e345-4123-a427-08de745bc49c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:23.465254 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-53c47f95-bd47-4669-a0da-53685815c622 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:23.479239 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-53c47f95-bd47-4669-a0da-53685815c622 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1317 microversion: 2.1 time: 0.437403 Sep 24 20:58:23.483054 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1167/2320] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:23 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1317 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:23.560973 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-67f65d0e-2913-45f2-b950-7293e5b110c4 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:23.561965 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-67f65d0e-2913-45f2-b950-7293e5b110c4 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:23.572219 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-67f65d0e-2913-45f2-b950-7293e5b110c4 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:23.572953 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-67f65d0e-2913-45f2-b950-7293e5b110c4 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:23.573586 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-67f65d0e-2913-45f2-b950-7293e5b110c4 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:23.574461 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-67f65d0e-2913-45f2-b950-7293e5b110c4 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:23.575764 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-67f65d0e-2913-45f2-b950-7293e5b110c4 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:23.576353 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-67f65d0e-2913-45f2-b950-7293e5b110c4 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:24.036929 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-06109667-e345-4123-a427-08de745bc49c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "POST /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232/action" status: 202 len: 0 microversion: 2.1 time: 0.636009 Sep 24 20:58:24.038772 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1154/2321] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:58:23 2022] POST /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232/action => generated 0 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 24 20:58:24.045447 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-79205306-bee3-49e5-bcf4-c86f4bded5e8 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:24.046584 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-79205306-bee3-49e5-bcf4-c86f4bded5e8 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: e781d448-5d66-4040-bf4c-37452b0f7b1c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:24.058981 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-79205306-bee3-49e5-bcf4-c86f4bded5e8 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:24.059755 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-79205306-bee3-49e5-bcf4-c86f4bded5e8 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:24.062939 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-79205306-bee3-49e5-bcf4-c86f4bded5e8 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:24.064632 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-79205306-bee3-49e5-bcf4-c86f4bded5e8 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:24.065708 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-79205306-bee3-49e5-bcf4-c86f4bded5e8 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:24.067376 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-79205306-bee3-49e5-bcf4-c86f4bded5e8 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:24.455285 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-67f65d0e-2913-45f2-b950-7293e5b110c4 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:24.469553 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-67f65d0e-2913-45f2-b950-7293e5b110c4 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 200 len: 1354 microversion: 2.1 time: 0.918155 Sep 24 20:58:24.479702 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1168/2322] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:23 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 1354 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:24.493003 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fbbc85af-213f-4d98-b839-c0872c4083eb tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:24.494227 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fbbc85af-213f-4d98-b839-c0872c4083eb tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 72bfdb29-fd39-41a3-8314-624925dcd0b3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:24.510402 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fbbc85af-213f-4d98-b839-c0872c4083eb tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:24.511765 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fbbc85af-213f-4d98-b839-c0872c4083eb tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:24.522015 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fbbc85af-213f-4d98-b839-c0872c4083eb tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:24.526980 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fbbc85af-213f-4d98-b839-c0872c4083eb tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:24.527604 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fbbc85af-213f-4d98-b839-c0872c4083eb tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:24.530800 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fbbc85af-213f-4d98-b839-c0872c4083eb tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:25.012554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fbbc85af-213f-4d98-b839-c0872c4083eb tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343dddda044b8fa4eb797a4b64556a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbf416811f64df0b56656a0cf7778ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:25.022222 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fbbc85af-213f-4d98-b839-c0872c4083eb tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3" status: 200 len: 1276 microversion: 2.1 time: 0.538846 Sep 24 20:58:25.029356 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1169/2323] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:24 2022] GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3 => generated 1276 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:25.042290 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e499bbcf-e359-4d26-960f-72cf952a31c0 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b0ca79790>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:25.109402 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e499bbcf-e359-4d26-960f-72cf952a31c0 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625" status: 200 len: 1450 microversion: 2.1 time: 0.078609 Sep 24 20:58:25.109632 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-79205306-bee3-49e5-bcf4-c86f4bded5e8 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:25.123157 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-79205306-bee3-49e5-bcf4-c86f4bded5e8 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c" status: 200 len: 1365 microversion: 2.1 time: 1.082832 Sep 24 20:58:25.123741 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1155/2324] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:24 2022] GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c => generated 1365 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:25.127830 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1170/2325] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:25 2022] GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625 => generated 1450 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:25.133397 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-67bd7782-dabc-40ad-b205-27aca99f18e3 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:25.136917 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-67bd7782-dabc-40ad-b205-27aca99f18e3 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:25.143341 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-60bc6063-abd0-4d0f-80a6-bac21c2c899a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:25.145936 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-60bc6063-abd0-4d0f-80a6-bac21c2c899a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:25.155739 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-67bd7782-dabc-40ad-b205-27aca99f18e3 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:25.156522 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-67bd7782-dabc-40ad-b205-27aca99f18e3 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:25.157116 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-67bd7782-dabc-40ad-b205-27aca99f18e3 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:25.158815 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-67bd7782-dabc-40ad-b205-27aca99f18e3 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:25.159544 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-67bd7782-dabc-40ad-b205-27aca99f18e3 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:25.160275 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-67bd7782-dabc-40ad-b205-27aca99f18e3 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:25.162090 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-60bc6063-abd0-4d0f-80a6-bac21c2c899a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:25.162634 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-60bc6063-abd0-4d0f-80a6-bac21c2c899a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:25.163083 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-60bc6063-abd0-4d0f-80a6-bac21c2c899a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:25.163987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-60bc6063-abd0-4d0f-80a6-bac21c2c899a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:25.164463 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-60bc6063-abd0-4d0f-80a6-bac21c2c899a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:25.164901 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-60bc6063-abd0-4d0f-80a6-bac21c2c899a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:25.166450 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:58:25.223978 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-60bc6063-abd0-4d0f-80a6-bac21c2c899a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.098952 Sep 24 20:58:25.225534 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1156/2326] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:25 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:58:25.232252 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-f5995a81-5241-468f-85ad-49c66dc91984 req-afbff6a4-2899-4788-9f0f-211afc4ce9d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51", "name": "network-vif-unplugged", "status": "completed", "tag": "00c8986f-e263-4bab-8396-0009b8e0c3e8"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:58:25.243976 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-f5995a81-5241-468f-85ad-49c66dc91984 req-afbff6a4-2899-4788-9f0f-211afc4ce9d2 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:25.244715 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-f5995a81-5241-468f-85ad-49c66dc91984 req-afbff6a4-2899-4788-9f0f-211afc4ce9d2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:25.245914 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-f5995a81-5241-468f-85ad-49c66dc91984 req-afbff6a4-2899-4788-9f0f-211afc4ce9d2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:25.290753 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-f5995a81-5241-468f-85ad-49c66dc91984 req-afbff6a4-2899-4788-9f0f-211afc4ce9d2 service nova] Creating event network-vif-unplugged:00c8986f-e263-4bab-8396-0009b8e0c3e8 for instance 4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51 on nch2-master-1 Sep 24 20:58:25.305007 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-f5995a81-5241-468f-85ad-49c66dc91984 req-afbff6a4-2899-4788-9f0f-211afc4ce9d2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076984 Sep 24 20:58:25.306025 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1157/2327] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:58:25.497714 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f98cc3b8-cf95-452f-ad6a-727d899972b5 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:25.498641 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f98cc3b8-cf95-452f-ad6a-727d899972b5 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:25.512066 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f98cc3b8-cf95-452f-ad6a-727d899972b5 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:25.512692 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f98cc3b8-cf95-452f-ad6a-727d899972b5 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:25.513863 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f98cc3b8-cf95-452f-ad6a-727d899972b5 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:25.514798 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f98cc3b8-cf95-452f-ad6a-727d899972b5 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:25.515353 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f98cc3b8-cf95-452f-ad6a-727d899972b5 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:25.516115 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f98cc3b8-cf95-452f-ad6a-727d899972b5 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:25.648211 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-67bd7782-dabc-40ad-b205-27aca99f18e3 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:25.661735 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-67bd7782-dabc-40ad-b205-27aca99f18e3 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1317 microversion: 2.1 time: 0.532615 Sep 24 20:58:25.670594 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1171/2328] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:25 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1317 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:25.893710 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f98cc3b8-cf95-452f-ad6a-727d899972b5 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:25.903868 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f98cc3b8-cf95-452f-ad6a-727d899972b5 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 200 len: 1354 microversion: 2.1 time: 0.412990 Sep 24 20:58:25.919621 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1158/2329] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:25 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 1354 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:26.056100 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c123273f-0784-4a4e-bc58-a37829976f2f tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:26.056743 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c123273f-0784-4a4e-bc58-a37829976f2f tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 72bfdb29-fd39-41a3-8314-624925dcd0b3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:26.066482 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c123273f-0784-4a4e-bc58-a37829976f2f tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:26.067353 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c123273f-0784-4a4e-bc58-a37829976f2f tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:26.067945 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c123273f-0784-4a4e-bc58-a37829976f2f tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:26.068919 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c123273f-0784-4a4e-bc58-a37829976f2f tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:26.069660 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c123273f-0784-4a4e-bc58-a37829976f2f tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:26.070394 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c123273f-0784-4a4e-bc58-a37829976f2f tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:26.125354 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d6f24633-cc73-4479-b9a5-bbf6d15ce447 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b10ff7940>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:26.259397 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d6f24633-cc73-4479-b9a5-bbf6d15ce447 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625" status: 200 len: 1450 microversion: 2.1 time: 0.137812 Sep 24 20:58:26.270303 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1159/2330] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:26 2022] GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625 => generated 1450 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:58:26.275947 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2d8612b2-d325-4915-b35d-a1458aa0db8f tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:26.276921 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2d8612b2-d325-4915-b35d-a1458aa0db8f tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: e781d448-5d66-4040-bf4c-37452b0f7b1c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:26.291367 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2d8612b2-d325-4915-b35d-a1458aa0db8f tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:26.291977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2d8612b2-d325-4915-b35d-a1458aa0db8f tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:26.292505 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2d8612b2-d325-4915-b35d-a1458aa0db8f tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:26.293307 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2d8612b2-d325-4915-b35d-a1458aa0db8f tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:26.294000 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2d8612b2-d325-4915-b35d-a1458aa0db8f tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:26.294538 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2d8612b2-d325-4915-b35d-a1458aa0db8f tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:26.377681 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c123273f-0784-4a4e-bc58-a37829976f2f tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343dddda044b8fa4eb797a4b64556a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbf416811f64df0b56656a0cf7778ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:26.390660 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c123273f-0784-4a4e-bc58-a37829976f2f tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3" status: 200 len: 1318 microversion: 2.1 time: 0.338226 Sep 24 20:58:26.393472 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1172/2331] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:26 2022] GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3 => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:26.403769 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-75f32c65-0fd5-4578-9009-a79e8de04228 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:26.409164 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-75f32c65-0fd5-4578-9009-a79e8de04228 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:26.415612 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75f32c65-0fd5-4578-9009-a79e8de04228 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:26.416133 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75f32c65-0fd5-4578-9009-a79e8de04228 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:26.416591 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75f32c65-0fd5-4578-9009-a79e8de04228 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:26.417324 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75f32c65-0fd5-4578-9009-a79e8de04228 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:26.417791 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75f32c65-0fd5-4578-9009-a79e8de04228 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:26.418252 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75f32c65-0fd5-4578-9009-a79e8de04228 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:26.476669 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-75f32c65-0fd5-4578-9009-a79e8de04228 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.081771 Sep 24 20:58:26.477289 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1173/2332] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:26 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:58:26.607432 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2d8612b2-d325-4915-b35d-a1458aa0db8f tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:26.620967 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2d8612b2-d325-4915-b35d-a1458aa0db8f tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c" status: 200 len: 1365 microversion: 2.1 time: 0.348219 Sep 24 20:58:26.622365 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1160/2333] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:26 2022] GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c => generated 1365 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:26.696484 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-29cf9e74-8565-480c-9d8b-8c7ee5860477 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:26.697473 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-29cf9e74-8565-480c-9d8b-8c7ee5860477 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:26.705131 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-29cf9e74-8565-480c-9d8b-8c7ee5860477 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:26.706152 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-29cf9e74-8565-480c-9d8b-8c7ee5860477 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:26.706889 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-29cf9e74-8565-480c-9d8b-8c7ee5860477 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:26.707970 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-29cf9e74-8565-480c-9d8b-8c7ee5860477 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:26.709125 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-29cf9e74-8565-480c-9d8b-8c7ee5860477 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:26.709982 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-29cf9e74-8565-480c-9d8b-8c7ee5860477 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:26.716165 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-00cf94d7-a312-41c8-9dd3-8ae2bfef6f7c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Action: 'create', calling method: .version_select at 0x7f4b110243a0>, body: {"keypair": {"name": "tempest-keypair-93033218", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnryKCXcizhKMyGYGiRby0ps5ayy326S5Bukljl3Dp+o3GyN2j6/DmgrQlsQ4/hapFCRoDFC3hMkJxMAsFoMgJrGaZyGWCWiRdf+k8b6GNy+T//VjTdkyx6qlRTYNLwFg=="}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:58:26.762074 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-00cf94d7-a312-41c8-9dd3-8ae2bfef6f7c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Getting quotas for project c1e5d6f3d41e4aa49e630f8c7ac87ded. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:58:26.779273 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-00cf94d7-a312-41c8-9dd3-8ae2bfef6f7c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Getting quotas for user 6493da825aa24f43bdf8f0835a16e3bb and project c1e5d6f3d41e4aa49e630f8c7ac87ded. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:58:26.847275 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-00cf94d7-a312-41c8-9dd3-8ae2bfef6f7c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.310169 Sep 24 20:58:26.854076 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1174/2334] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 20:58:26 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:58:26.930003 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b6b9ac61-8814-449a-a85a-a357744d09c9 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:26.930655 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b6b9ac61-8814-449a-a85a-a357744d09c9 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:26.942594 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b6b9ac61-8814-449a-a85a-a357744d09c9 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:26.943129 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b6b9ac61-8814-449a-a85a-a357744d09c9 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:26.943732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b6b9ac61-8814-449a-a85a-a357744d09c9 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:26.947110 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b6b9ac61-8814-449a-a85a-a357744d09c9 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:26.947951 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b6b9ac61-8814-449a-a85a-a357744d09c9 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:26.949179 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b6b9ac61-8814-449a-a85a-a357744d09c9 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:27.325854 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-29cf9e74-8565-480c-9d8b-8c7ee5860477 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:27.335977 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-29cf9e74-8565-480c-9d8b-8c7ee5860477 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1317 microversion: 2.1 time: 0.643326 Sep 24 20:58:27.357219 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1161/2335] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:26 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1317 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:27.359429 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b6b9ac61-8814-449a-a85a-a357744d09c9 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:27.363881 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3c685b1f-1387-4f2a-a3ec-713d7dde2579 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b10ff70d0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:27.373282 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b6b9ac61-8814-449a-a85a-a357744d09c9 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 200 len: 1354 microversion: 2.1 time: 0.447417 Sep 24 20:58:27.373848 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1175/2336] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:26 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 1354 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:58:27.419257 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f7fb4584-a3ca-4e74-a2db-4213ca1c139b tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:27.421127 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f7fb4584-a3ca-4e74-a2db-4213ca1c139b tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 72bfdb29-fd39-41a3-8314-624925dcd0b3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:27.422186 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3c685b1f-1387-4f2a-a3ec-713d7dde2579 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625" status: 200 len: 1450 microversion: 2.1 time: 0.063502 Sep 24 20:58:27.424135 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1162/2337] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:27 2022] GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625 => generated 1450 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:27.435782 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7fb4584-a3ca-4e74-a2db-4213ca1c139b tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:27.435782 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7fb4584-a3ca-4e74-a2db-4213ca1c139b tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:27.436100 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7fb4584-a3ca-4e74-a2db-4213ca1c139b tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:27.442408 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7fb4584-a3ca-4e74-a2db-4213ca1c139b tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:27.443194 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7fb4584-a3ca-4e74-a2db-4213ca1c139b tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:27.445291 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7fb4584-a3ca-4e74-a2db-4213ca1c139b tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:27.490320 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d6b18baa-9ace-4316-99d3-f746a1521979 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:27.493153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d6b18baa-9ace-4316-99d3-f746a1521979 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:27.508095 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d6b18baa-9ace-4316-99d3-f746a1521979 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:27.508840 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d6b18baa-9ace-4316-99d3-f746a1521979 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:27.509525 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d6b18baa-9ace-4316-99d3-f746a1521979 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:27.511459 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d6b18baa-9ace-4316-99d3-f746a1521979 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:27.513627 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d6b18baa-9ace-4316-99d3-f746a1521979 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:27.514350 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d6b18baa-9ace-4316-99d3-f746a1521979 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:27.526319 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:58:27.610101 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d6b18baa-9ace-4316-99d3-f746a1521979 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.124802 Sep 24 20:58:27.611758 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1163/2338] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:27 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:58:27.653074 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7cfca25c-09e4-4820-8797-c0fd1c55403f tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:27.655404 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7cfca25c-09e4-4820-8797-c0fd1c55403f tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: e781d448-5d66-4040-bf4c-37452b0f7b1c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:27.664683 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7cfca25c-09e4-4820-8797-c0fd1c55403f tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:27.665475 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7cfca25c-09e4-4820-8797-c0fd1c55403f tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:27.666107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7cfca25c-09e4-4820-8797-c0fd1c55403f tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:27.667183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7cfca25c-09e4-4820-8797-c0fd1c55403f tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:27.668563 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7cfca25c-09e4-4820-8797-c0fd1c55403f tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:27.669262 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7cfca25c-09e4-4820-8797-c0fd1c55403f tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:27.832533 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f7fb4584-a3ca-4e74-a2db-4213ca1c139b tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343dddda044b8fa4eb797a4b64556a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbf416811f64df0b56656a0cf7778ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:27.845189 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f7fb4584-a3ca-4e74-a2db-4213ca1c139b tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3" status: 200 len: 1318 microversion: 2.1 time: 0.430167 Sep 24 20:58:27.865927 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1176/2339] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:27 2022] GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3 => generated 1318 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:27.872954 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-61cb9d4f-1bc7-49c4-9294-1eb911f808d7 req-a89d1ba8-f9f4-48c9-95af-90a1c96a5564 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7021278a-14b3-48a6-a442-5278d7d00fd5", "name": "network-vif-plugged", "status": "completed", "tag": "cea7414d-85d7-4b4b-9261-8e06b9e885f7"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:58:27.893573 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-61cb9d4f-1bc7-49c4-9294-1eb911f808d7 req-a89d1ba8-f9f4-48c9-95af-90a1c96a5564 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:27.894354 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-61cb9d4f-1bc7-49c4-9294-1eb911f808d7 req-a89d1ba8-f9f4-48c9-95af-90a1c96a5564 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:27.895046 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-61cb9d4f-1bc7-49c4-9294-1eb911f808d7 req-a89d1ba8-f9f4-48c9-95af-90a1c96a5564 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:27.915157 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-61cb9d4f-1bc7-49c4-9294-1eb911f808d7 req-a89d1ba8-f9f4-48c9-95af-90a1c96a5564 service nova] Creating event network-vif-plugged:cea7414d-85d7-4b4b-9261-8e06b9e885f7 for instance 7021278a-14b3-48a6-a442-5278d7d00fd5 on nch2-master-1 Sep 24 20:58:27.922836 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-61cb9d4f-1bc7-49c4-9294-1eb911f808d7 req-a89d1ba8-f9f4-48c9-95af-90a1c96a5564 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054375 Sep 24 20:58:27.925432 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1177/2340] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:58:28.073577 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7cfca25c-09e4-4820-8797-c0fd1c55403f tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:28.085803 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7cfca25c-09e4-4820-8797-c0fd1c55403f tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c" status: 200 len: 1365 microversion: 2.1 time: 0.440207 Sep 24 20:58:28.090643 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1164/2341] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:27 2022] GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c => generated 1365 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:28.368364 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b2ae5b81-c561-4748-ae31-d6371f0046f1 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:28.369162 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b2ae5b81-c561-4748-ae31-d6371f0046f1 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:28.387416 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2ae5b81-c561-4748-ae31-d6371f0046f1 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:28.387869 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2ae5b81-c561-4748-ae31-d6371f0046f1 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:28.390539 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2ae5b81-c561-4748-ae31-d6371f0046f1 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:28.394824 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2ae5b81-c561-4748-ae31-d6371f0046f1 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:28.396057 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2ae5b81-c561-4748-ae31-d6371f0046f1 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:28.398260 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2ae5b81-c561-4748-ae31-d6371f0046f1 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:28.401062 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1e7ad4c7-1103-459f-b014-960bfa423fbc tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:28.401725 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1e7ad4c7-1103-459f-b014-960bfa423fbc tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:28.417802 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e7ad4c7-1103-459f-b014-960bfa423fbc tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:28.418947 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e7ad4c7-1103-459f-b014-960bfa423fbc tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:28.419462 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e7ad4c7-1103-459f-b014-960bfa423fbc tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:28.420197 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e7ad4c7-1103-459f-b014-960bfa423fbc tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:28.420667 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e7ad4c7-1103-459f-b014-960bfa423fbc tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:28.421101 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e7ad4c7-1103-459f-b014-960bfa423fbc tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:29.026066 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1e7ad4c7-1103-459f-b014-960bfa423fbc tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:29.038466 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1e7ad4c7-1103-459f-b014-960bfa423fbc tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 200 len: 1354 microversion: 2.1 time: 0.641537 Sep 24 20:58:29.039366 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1165/2342] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:28 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 1354 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:29.059017 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c7285fb5-0c47-4f05-a42f-9751e8f1e8d6 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b111558b0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:29.067830 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b2ae5b81-c561-4748-ae31-d6371f0046f1 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:29.084953 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b2ae5b81-c561-4748-ae31-d6371f0046f1 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1317 microversion: 2.1 time: 0.720969 Sep 24 20:58:29.085898 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1178/2343] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:28 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1317 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:29.091951 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f5dd36d6-a868-455f-8300-ecbff50296f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:29.094350 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f5dd36d6-a868-455f-8300-ecbff50296f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:29.104218 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5dd36d6-a868-455f-8300-ecbff50296f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:29.104998 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5dd36d6-a868-455f-8300-ecbff50296f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:29.105763 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5dd36d6-a868-455f-8300-ecbff50296f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:29.108832 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5dd36d6-a868-455f-8300-ecbff50296f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:29.109903 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5dd36d6-a868-455f-8300-ecbff50296f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:29.111219 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5dd36d6-a868-455f-8300-ecbff50296f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:29.177514 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c7285fb5-0c47-4f05-a42f-9751e8f1e8d6 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625" status: 200 len: 1450 microversion: 2.1 time: 0.136855 Sep 24 20:58:29.177713 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f5dd36d6-a868-455f-8300-ecbff50296f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.089647 Sep 24 20:58:29.179495 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1166/2344] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:29 2022] GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625 => generated 1450 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:29.182927 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1179/2345] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:29 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:58:29.200040 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-141ff848-ad61-40e9-8381-510f093fd6cd tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:29.200733 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-141ff848-ad61-40e9-8381-510f093fd6cd tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 72bfdb29-fd39-41a3-8314-624925dcd0b3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:29.207618 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4a5ae7a0-7a94-44bd-af08-6cf8d8bf56b8 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:29.208774 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4a5ae7a0-7a94-44bd-af08-6cf8d8bf56b8 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: e781d448-5d66-4040-bf4c-37452b0f7b1c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:29.222158 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-141ff848-ad61-40e9-8381-510f093fd6cd tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:29.222890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-141ff848-ad61-40e9-8381-510f093fd6cd tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:29.223657 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-141ff848-ad61-40e9-8381-510f093fd6cd tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:29.224806 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-141ff848-ad61-40e9-8381-510f093fd6cd tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:29.225419 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-141ff848-ad61-40e9-8381-510f093fd6cd tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:29.226770 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4a5ae7a0-7a94-44bd-af08-6cf8d8bf56b8 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:29.227050 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-141ff848-ad61-40e9-8381-510f093fd6cd tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:29.229285 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4a5ae7a0-7a94-44bd-af08-6cf8d8bf56b8 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:29.230962 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4a5ae7a0-7a94-44bd-af08-6cf8d8bf56b8 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:29.234453 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4a5ae7a0-7a94-44bd-af08-6cf8d8bf56b8 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:29.235105 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4a5ae7a0-7a94-44bd-af08-6cf8d8bf56b8 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:29.236976 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4a5ae7a0-7a94-44bd-af08-6cf8d8bf56b8 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:29.935954 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4a5ae7a0-7a94-44bd-af08-6cf8d8bf56b8 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:29.953942 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4a5ae7a0-7a94-44bd-af08-6cf8d8bf56b8 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c" status: 200 len: 1365 microversion: 2.1 time: 0.769011 Sep 24 20:58:29.959676 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1180/2346] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:29 2022] GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c => generated 1365 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:29.970189 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-141ff848-ad61-40e9-8381-510f093fd6cd tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343dddda044b8fa4eb797a4b64556a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbf416811f64df0b56656a0cf7778ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:29.982738 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-ac6ca3c7-3169-4c6a-b5eb-d166ce040630 req-7c27cc09-a3e0-4ba1-8ba3-f9365c9d9ff9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72bfdb29-fd39-41a3-8314-624925dcd0b3", "tag": "220a9783-4cc5-43f0-9857-3df4d11f076f"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:58:29.985210 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-141ff848-ad61-40e9-8381-510f093fd6cd tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3" status: 200 len: 1318 microversion: 2.1 time: 0.797020 Sep 24 20:58:29.989173 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1167/2347] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:29 2022] GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3 => generated 1318 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:30.013309 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-d5b8b98f-75cb-4212-b5a2-70919dfd8b2e req-cb2727f5-388f-4c2f-9338-a9ad8fcb7109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e781d448-5d66-4040-bf4c-37452b0f7b1c", "name": "network-vif-plugged", "status": "completed", "tag": "ac7cf96e-fcba-4f98-ab54-6ea3518610bf"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:58:30.018933 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-ac6ca3c7-3169-4c6a-b5eb-d166ce040630 req-7c27cc09-a3e0-4ba1-8ba3-f9365c9d9ff9 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:30.019727 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-ac6ca3c7-3169-4c6a-b5eb-d166ce040630 req-7c27cc09-a3e0-4ba1-8ba3-f9365c9d9ff9 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:30.020278 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-ac6ca3c7-3169-4c6a-b5eb-d166ce040630 req-7c27cc09-a3e0-4ba1-8ba3-f9365c9d9ff9 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:30.032042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:58:30.034582 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-ac6ca3c7-3169-4c6a-b5eb-d166ce040630 req-7c27cc09-a3e0-4ba1-8ba3-f9365c9d9ff9 service nova] Creating event network-changed:220a9783-4cc5-43f0-9857-3df4d11f076f for instance 72bfdb29-fd39-41a3-8314-624925dcd0b3 on nch1-master-1 Sep 24 20:58:30.041415 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-ac6ca3c7-3169-4c6a-b5eb-d166ce040630 req-7c27cc09-a3e0-4ba1-8ba3-f9365c9d9ff9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080148 Sep 24 20:58:30.042859 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1181/2348] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:58:30.057725 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d5b8b98f-75cb-4212-b5a2-70919dfd8b2e req-cb2727f5-388f-4c2f-9338-a9ad8fcb7109 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:30.058215 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d5b8b98f-75cb-4212-b5a2-70919dfd8b2e req-cb2727f5-388f-4c2f-9338-a9ad8fcb7109 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:30.062201 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d5b8b98f-75cb-4212-b5a2-70919dfd8b2e req-cb2727f5-388f-4c2f-9338-a9ad8fcb7109 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:30.062810 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1a85ca96-3e8a-463a-bab7-438b95233423 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:30.063733 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1a85ca96-3e8a-463a-bab7-438b95233423 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:30.073298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a85ca96-3e8a-463a-bab7-438b95233423 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:30.073929 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a85ca96-3e8a-463a-bab7-438b95233423 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:30.077950 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a85ca96-3e8a-463a-bab7-438b95233423 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:30.081823 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a85ca96-3e8a-463a-bab7-438b95233423 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:30.082485 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a85ca96-3e8a-463a-bab7-438b95233423 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:30.083127 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a85ca96-3e8a-463a-bab7-438b95233423 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:30.129895 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-d5b8b98f-75cb-4212-b5a2-70919dfd8b2e req-cb2727f5-388f-4c2f-9338-a9ad8fcb7109 service nova] Creating event network-vif-plugged:ac7cf96e-fcba-4f98-ab54-6ea3518610bf for instance e781d448-5d66-4040-bf4c-37452b0f7b1c on nch2-master-1 Sep 24 20:58:30.145209 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-d5b8b98f-75cb-4212-b5a2-70919dfd8b2e req-cb2727f5-388f-4c2f-9338-a9ad8fcb7109 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138009 Sep 24 20:58:30.150206 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1168/2349] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:58:30.165532 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-997b0db3-6f83-47d2-aad5-92a632885547 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:30.172616 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-997b0db3-6f83-47d2-aad5-92a632885547 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:30.187554 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-997b0db3-6f83-47d2-aad5-92a632885547 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:30.188135 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-997b0db3-6f83-47d2-aad5-92a632885547 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:30.189275 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-997b0db3-6f83-47d2-aad5-92a632885547 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:30.201950 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-997b0db3-6f83-47d2-aad5-92a632885547 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:30.205263 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-997b0db3-6f83-47d2-aad5-92a632885547 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:30.219049 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-997b0db3-6f83-47d2-aad5-92a632885547 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:30.430868 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=8 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:58:30.543224 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1a85ca96-3e8a-463a-bab7-438b95233423 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:30.552776 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1a85ca96-3e8a-463a-bab7-438b95233423 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 200 len: 1354 microversion: 2.1 time: 0.495203 Sep 24 20:58:30.558760 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1182/2350] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:30 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 1354 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:58:30.575234 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-73c71b30-e1e2-4e2f-8c59-692775eb53a5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:30.577884 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-73c71b30-e1e2-4e2f-8c59-692775eb53a5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:30.591380 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-73c71b30-e1e2-4e2f-8c59-692775eb53a5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:30.595243 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-73c71b30-e1e2-4e2f-8c59-692775eb53a5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:30.596129 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-73c71b30-e1e2-4e2f-8c59-692775eb53a5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:30.597151 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-73c71b30-e1e2-4e2f-8c59-692775eb53a5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:30.597832 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-73c71b30-e1e2-4e2f-8c59-692775eb53a5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:30.601330 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-73c71b30-e1e2-4e2f-8c59-692775eb53a5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:30.706241 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-73c71b30-e1e2-4e2f-8c59-692775eb53a5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.144924 Sep 24 20:58:30.714736 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-997b0db3-6f83-47d2-aad5-92a632885547 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:30.723471 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1183/2351] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:30 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:58:30.731712 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-997b0db3-6f83-47d2-aad5-92a632885547 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1506 microversion: 2.1 time: 0.579513 Sep 24 20:58:30.737077 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1169/2352] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:30 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1506 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:30.748068 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-61d2fcba-270a-43f8-a3f0-73ef440be7f0 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b0c715430>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:30.764885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e3fe24cf-c2a9-4fc0-ae5f-2ba24ee552a7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:30.765700 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e3fe24cf-c2a9-4fc0-ae5f-2ba24ee552a7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:30.788061 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e3fe24cf-c2a9-4fc0-ae5f-2ba24ee552a7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:30.789147 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e3fe24cf-c2a9-4fc0-ae5f-2ba24ee552a7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:30.789962 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e3fe24cf-c2a9-4fc0-ae5f-2ba24ee552a7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:30.791940 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e3fe24cf-c2a9-4fc0-ae5f-2ba24ee552a7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:30.792875 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e3fe24cf-c2a9-4fc0-ae5f-2ba24ee552a7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:30.793552 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e3fe24cf-c2a9-4fc0-ae5f-2ba24ee552a7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:30.864297 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-61d2fcba-270a-43f8-a3f0-73ef440be7f0 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625" status: 200 len: 1450 microversion: 2.1 time: 0.137303 Sep 24 20:58:30.875668 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1184/2353] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:30 2022] GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625 => generated 1450 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:30.981345 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fc646e5d-78fa-447a-b59a-056bdcfcfdaa tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:30.981988 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fc646e5d-78fa-447a-b59a-056bdcfcfdaa tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: e781d448-5d66-4040-bf4c-37452b0f7b1c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:30.990244 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc646e5d-78fa-447a-b59a-056bdcfcfdaa tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:30.993240 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc646e5d-78fa-447a-b59a-056bdcfcfdaa tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:30.993883 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc646e5d-78fa-447a-b59a-056bdcfcfdaa tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:30.995704 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc646e5d-78fa-447a-b59a-056bdcfcfdaa tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:30.996724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc646e5d-78fa-447a-b59a-056bdcfcfdaa tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:30.997318 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc646e5d-78fa-447a-b59a-056bdcfcfdaa tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:31.366689 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fc646e5d-78fa-447a-b59a-056bdcfcfdaa tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:31.369776 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e3fe24cf-c2a9-4fc0-ae5f-2ba24ee552a7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:31.383134 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fc646e5d-78fa-447a-b59a-056bdcfcfdaa tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c" status: 200 len: 1365 microversion: 2.1 time: 0.403979 Sep 24 20:58:31.383664 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e3fe24cf-c2a9-4fc0-ae5f-2ba24ee552a7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1506 microversion: 2.1 time: 0.622288 Sep 24 20:58:31.398530 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1185/2354] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:30 2022] GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c => generated 1365 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:58:31.398530 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4c9b3686-906c-4f1c-a222-363ed39321a1 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:31.399332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4c9b3686-906c-4f1c-a222-363ed39321a1 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 72bfdb29-fd39-41a3-8314-624925dcd0b3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:31.400253 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1170/2355] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:30 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1506 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:31.415325 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4c9b3686-906c-4f1c-a222-363ed39321a1 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:31.416801 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4c9b3686-906c-4f1c-a222-363ed39321a1 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:31.417898 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4c9b3686-906c-4f1c-a222-363ed39321a1 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:31.419722 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4c9b3686-906c-4f1c-a222-363ed39321a1 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:31.422162 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4c9b3686-906c-4f1c-a222-363ed39321a1 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:31.422795 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4c9b3686-906c-4f1c-a222-363ed39321a1 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:31.447437 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-06d8f21a-8d2e-49e8-a240-81ad3ade2e62 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "OS-DCF:diskConfig": "AUTO"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:58:31.457625 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-06d8f21a-8d2e-49e8-a240-81ad3ade2e62 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:31.473226 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06d8f21a-8d2e-49e8-a240-81ad3ade2e62 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:31.478664 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06d8f21a-8d2e-49e8-a240-81ad3ade2e62 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:31.479342 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06d8f21a-8d2e-49e8-a240-81ad3ade2e62 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:31.480217 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06d8f21a-8d2e-49e8-a240-81ad3ade2e62 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:31.480918 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06d8f21a-8d2e-49e8-a240-81ad3ade2e62 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:31.481599 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06d8f21a-8d2e-49e8-a240-81ad3ade2e62 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:31.685036 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-06d8f21a-8d2e-49e8-a240-81ad3ade2e62 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:58:31.687656 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-06d8f21a-8d2e-49e8-a240-81ad3ade2e62 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:58:31.693138 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-06d8f21a-8d2e-49e8-a240-81ad3ade2e62 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:58:31.693853 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-06d8f21a-8d2e-49e8-a240-81ad3ade2e62 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:58:31.694529 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-06d8f21a-8d2e-49e8-a240-81ad3ade2e62 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:58:31.765235 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4c9b3686-906c-4f1c-a222-363ed39321a1 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343dddda044b8fa4eb797a4b64556a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbf416811f64df0b56656a0cf7778ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:31.793695 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4c9b3686-906c-4f1c-a222-363ed39321a1 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3" status: 200 len: 1318 microversion: 2.1 time: 0.403307 Sep 24 20:58:31.795981 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1186/2356] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:31 2022] GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3 => generated 1318 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:31.817157 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-27a5b320-e679-4927-a4eb-fd3f1a88a37b tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:31.822217 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-27a5b320-e679-4927-a4eb-fd3f1a88a37b tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:31.833478 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27a5b320-e679-4927-a4eb-fd3f1a88a37b tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:31.833984 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27a5b320-e679-4927-a4eb-fd3f1a88a37b tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:31.834528 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27a5b320-e679-4927-a4eb-fd3f1a88a37b tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:31.835255 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27a5b320-e679-4927-a4eb-fd3f1a88a37b tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:31.835721 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27a5b320-e679-4927-a4eb-fd3f1a88a37b tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:31.836187 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27a5b320-e679-4927-a4eb-fd3f1a88a37b tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:31.842195 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-06d8f21a-8d2e-49e8-a240-81ad3ade2e62 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:31.858885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06d8f21a-8d2e-49e8-a240-81ad3ade2e62 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:31.860516 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06d8f21a-8d2e-49e8-a240-81ad3ade2e62 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:31.861956 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06d8f21a-8d2e-49e8-a240-81ad3ade2e62 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:31.866639 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06d8f21a-8d2e-49e8-a240-81ad3ade2e62 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:31.867417 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06d8f21a-8d2e-49e8-a240-81ad3ade2e62 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:31.868076 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06d8f21a-8d2e-49e8-a240-81ad3ade2e62 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:31.931326 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-06d8f21a-8d2e-49e8-a240-81ad3ade2e62 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "POST /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5/action" status: 202 len: 1108 microversion: 2.1 time: 0.511210 Sep 24 20:58:31.932531 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1171/2357] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:58:31 2022] POST /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5/action => generated 1108 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Sep 24 20:58:31.942726 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-32824f80-c2b1-4fce-bbd6-1998b78155cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:31.952627 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-32824f80-c2b1-4fce-bbd6-1998b78155cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:31.966924 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-32824f80-c2b1-4fce-bbd6-1998b78155cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:31.967792 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-32824f80-c2b1-4fce-bbd6-1998b78155cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:31.968483 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-32824f80-c2b1-4fce-bbd6-1998b78155cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:31.969425 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-32824f80-c2b1-4fce-bbd6-1998b78155cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:31.970844 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-32824f80-c2b1-4fce-bbd6-1998b78155cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:31.973774 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-32824f80-c2b1-4fce-bbd6-1998b78155cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:32.049316 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-32824f80-c2b1-4fce-bbd6-1998b78155cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.114411 Sep 24 20:58:32.050470 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1172/2358] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:31 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:58:32.056885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c97cad11-560b-4b95-848e-daca9b6dd764 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b111ce940>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:32.187501 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c97cad11-560b-4b95-848e-daca9b6dd764 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625" status: 200 len: 1450 microversion: 2.1 time: 0.135627 Sep 24 20:58:32.200853 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1173/2359] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:32 2022] GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625 => generated 1450 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:32.215421 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-de7600be-0b62-4412-94ac-b9b20f65f3ac tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:32.217387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-de7600be-0b62-4412-94ac-b9b20f65f3ac tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:32.225312 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-27a5b320-e679-4927-a4eb-fd3f1a88a37b tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:32.230966 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-de7600be-0b62-4412-94ac-b9b20f65f3ac tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:32.231558 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-de7600be-0b62-4412-94ac-b9b20f65f3ac tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:32.232080 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-de7600be-0b62-4412-94ac-b9b20f65f3ac tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:32.232988 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-de7600be-0b62-4412-94ac-b9b20f65f3ac tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:32.233610 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-de7600be-0b62-4412-94ac-b9b20f65f3ac tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:32.234198 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-de7600be-0b62-4412-94ac-b9b20f65f3ac tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:32.240028 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-27a5b320-e679-4927-a4eb-fd3f1a88a37b tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 200 len: 1354 microversion: 2.1 time: 0.442222 Sep 24 20:58:32.241363 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1187/2360] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:31 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 1354 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:32.258186 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4319d80e-7120-4210-a106-aa1e421f12d7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1251658962", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "75e36a3c-3095-402d-baea-50bb8c960b77"}], "security_groups": [{"name": "tempest-securitygroup--2132483020"}], "key_name": "tempest-keypair-93033218", "user_data": "}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:58:32.571518 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-de7600be-0b62-4412-94ac-b9b20f65f3ac tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:32.585194 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-de7600be-0b62-4412-94ac-b9b20f65f3ac tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1513 microversion: 2.1 time: 0.383131 Sep 24 20:58:32.592469 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1174/2361] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:32 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1513 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:32.617658 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-576f96f8-25a5-426a-bc1e-ee464f8e7a24 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:32.618620 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-576f96f8-25a5-426a-bc1e-ee464f8e7a24 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: e781d448-5d66-4040-bf4c-37452b0f7b1c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:32.625238 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-576f96f8-25a5-426a-bc1e-ee464f8e7a24 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:32.628542 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-576f96f8-25a5-426a-bc1e-ee464f8e7a24 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:32.629176 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-576f96f8-25a5-426a-bc1e-ee464f8e7a24 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:32.630090 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-576f96f8-25a5-426a-bc1e-ee464f8e7a24 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:32.630767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-576f96f8-25a5-426a-bc1e-ee464f8e7a24 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:32.631600 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-576f96f8-25a5-426a-bc1e-ee464f8e7a24 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:32.667956 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-4319d80e-7120-4210-a106-aa1e421f12d7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] validate_networks() for [('75e36a3c-3095-402d-baea-50bb8c960b77', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:58:33.050458 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-576f96f8-25a5-426a-bc1e-ee464f8e7a24 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:33.064643 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-576f96f8-25a5-426a-bc1e-ee464f8e7a24 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c" status: 200 len: 1554 microversion: 2.1 time: 0.450505 Sep 24 20:58:33.066270 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1175/2362] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:32 2022] GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c => generated 1554 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:33.086163 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-43ccacd9-418d-404e-90c2-c0517782abb3 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:33.096229 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-43ccacd9-418d-404e-90c2-c0517782abb3 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 72bfdb29-fd39-41a3-8314-624925dcd0b3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:33.111588 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-43ccacd9-418d-404e-90c2-c0517782abb3 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:33.115249 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-43ccacd9-418d-404e-90c2-c0517782abb3 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:33.115937 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-43ccacd9-418d-404e-90c2-c0517782abb3 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:33.126855 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-43ccacd9-418d-404e-90c2-c0517782abb3 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:33.127729 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-43ccacd9-418d-404e-90c2-c0517782abb3 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:33.134813 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-43ccacd9-418d-404e-90c2-c0517782abb3 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:33.433942 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-4319d80e-7120-4210-a106-aa1e421f12d7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:58:33.434855 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-4319d80e-7120-4210-a106-aa1e421f12d7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:58:33.435549 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-4319d80e-7120-4210-a106-aa1e421f12d7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:58:33.436917 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-4319d80e-7120-4210-a106-aa1e421f12d7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:58:33.437592 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-4319d80e-7120-4210-a106-aa1e421f12d7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:58:33.456254 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4319d80e-7120-4210-a106-aa1e421f12d7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:33.456749 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4319d80e-7120-4210-a106-aa1e421f12d7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:33.458487 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4319d80e-7120-4210-a106-aa1e421f12d7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:33.460361 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4319d80e-7120-4210-a106-aa1e421f12d7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:33.463019 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4319d80e-7120-4210-a106-aa1e421f12d7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:33.463680 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4319d80e-7120-4210-a106-aa1e421f12d7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:33.525374 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-4319d80e-7120-4210-a106-aa1e421f12d7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Getting quotas for project c1e5d6f3d41e4aa49e630f8c7ac87ded. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:58:33.544193 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-4319d80e-7120-4210-a106-aa1e421f12d7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Getting quotas for user 6493da825aa24f43bdf8f0835a16e3bb and project c1e5d6f3d41e4aa49e630f8c7ac87ded. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:58:33.567209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4319d80e-7120-4210-a106-aa1e421f12d7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:58:33.573108 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4319d80e-7120-4210-a106-aa1e421f12d7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:58:33.623804 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-43ccacd9-418d-404e-90c2-c0517782abb3 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343dddda044b8fa4eb797a4b64556a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbf416811f64df0b56656a0cf7778ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:33.633710 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-43ccacd9-418d-404e-90c2-c0517782abb3 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3" status: 200 len: 1318 microversion: 2.1 time: 0.566172 Sep 24 20:58:33.652792 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1176/2363] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:33 2022] GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3 => generated 1318 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:33.664600 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b9f96b67-8447-44a4-b2a5-ef5b127c44e4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:33.668895 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b9f96b67-8447-44a4-b2a5-ef5b127c44e4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:33.687598 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b9f96b67-8447-44a4-b2a5-ef5b127c44e4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:33.691640 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b9f96b67-8447-44a4-b2a5-ef5b127c44e4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:33.692354 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b9f96b67-8447-44a4-b2a5-ef5b127c44e4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:33.695938 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b9f96b67-8447-44a4-b2a5-ef5b127c44e4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:33.696191 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4319d80e-7120-4210-a106-aa1e421f12d7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.453450 Sep 24 20:58:33.699126 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b9f96b67-8447-44a4-b2a5-ef5b127c44e4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:33.699857 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b9f96b67-8447-44a4-b2a5-ef5b127c44e4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:33.704945 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1188/2364] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:58:32 2022] POST /compute/v2.1/servers => generated 409 bytes in 1463 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:58:33.717370 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-37829a9a-d6dd-4664-9127-fa27ef8cb0b8 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:33.718147 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-37829a9a-d6dd-4664-9127-fa27ef8cb0b8 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: e781d448-5d66-4040-bf4c-37452b0f7b1c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:33.733742 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-37829a9a-d6dd-4664-9127-fa27ef8cb0b8 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:33.734265 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-37829a9a-d6dd-4664-9127-fa27ef8cb0b8 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:33.735182 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-37829a9a-d6dd-4664-9127-fa27ef8cb0b8 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:33.740777 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-37829a9a-d6dd-4664-9127-fa27ef8cb0b8 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:33.741290 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-37829a9a-d6dd-4664-9127-fa27ef8cb0b8 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:33.741740 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-37829a9a-d6dd-4664-9127-fa27ef8cb0b8 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:33.815102 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b9f96b67-8447-44a4-b2a5-ef5b127c44e4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.158293 Sep 24 20:58:33.816565 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1177/2365] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:33 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:58:33.834713 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dabffba5-e552-4d4d-ade4-e1bb8e4c4c33 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b0c3b1940>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:33.911561 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-dabffba5-e552-4d4d-ade4-e1bb8e4c4c33 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625" status: 200 len: 1450 microversion: 2.1 time: 0.089680 Sep 24 20:58:33.915014 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1178/2366] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:33 2022] GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625 => generated 1450 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:33.920610 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5f5aa14c-f664-4149-822b-d11324d764ec tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:33.924302 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5f5aa14c-f664-4149-822b-d11324d764ec tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:33.945380 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f5aa14c-f664-4149-822b-d11324d764ec tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:33.946212 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f5aa14c-f664-4149-822b-d11324d764ec tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:33.946885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f5aa14c-f664-4149-822b-d11324d764ec tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:33.947816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f5aa14c-f664-4149-822b-d11324d764ec tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:33.948483 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f5aa14c-f664-4149-822b-d11324d764ec tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:33.949118 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f5aa14c-f664-4149-822b-d11324d764ec tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:34.568217 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-37829a9a-d6dd-4664-9127-fa27ef8cb0b8 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.861821 Sep 24 20:58:34.576358 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1189/2367] 10.222.0.52 () {58 vars in 1275 bytes} [Sat Sep 24 20:58:33 2022] GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c/os-interface => generated 284 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:58:34.576358 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6b683dbc-afdd-4fe3-896f-1a62f59af9bb tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:34.576358 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6b683dbc-afdd-4fe3-896f-1a62f59af9bb tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:34.592841 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b683dbc-afdd-4fe3-896f-1a62f59af9bb tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:34.593385 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b683dbc-afdd-4fe3-896f-1a62f59af9bb tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:34.593826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b683dbc-afdd-4fe3-896f-1a62f59af9bb tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:34.595514 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b683dbc-afdd-4fe3-896f-1a62f59af9bb tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:34.595734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b683dbc-afdd-4fe3-896f-1a62f59af9bb tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:34.596379 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b683dbc-afdd-4fe3-896f-1a62f59af9bb tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:34.931476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5f5aa14c-f664-4149-822b-d11324d764ec tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:34.941368 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5f5aa14c-f664-4149-822b-d11324d764ec tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 200 len: 1354 microversion: 2.1 time: 1.024439 Sep 24 20:58:34.972401 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1179/2368] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:33 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 1354 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:34.987280 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-acb97ca3-916c-4efa-953b-5e4eca854fea tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:34.994270 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-acb97ca3-916c-4efa-953b-5e4eca854fea tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:35.009757 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-acb97ca3-916c-4efa-953b-5e4eca854fea tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:35.010604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-acb97ca3-916c-4efa-953b-5e4eca854fea tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:35.013876 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-acb97ca3-916c-4efa-953b-5e4eca854fea tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:35.015206 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-acb97ca3-916c-4efa-953b-5e4eca854fea tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:35.017193 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-acb97ca3-916c-4efa-953b-5e4eca854fea tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:35.018265 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-acb97ca3-916c-4efa-953b-5e4eca854fea tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:35.254150 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-acb97ca3-916c-4efa-953b-5e4eca854fea tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:35.266539 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-acb97ca3-916c-4efa-953b-5e4eca854fea tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1233 microversion: 2.1 time: 0.292711 Sep 24 20:58:35.274573 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1180/2369] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:34 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1233 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:35.295070 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4caaec62-2692-4f57-888e-8d9bd0806608 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:35.307059 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4caaec62-2692-4f57-888e-8d9bd0806608 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 72bfdb29-fd39-41a3-8314-624925dcd0b3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:35.329837 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4caaec62-2692-4f57-888e-8d9bd0806608 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:35.330718 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4caaec62-2692-4f57-888e-8d9bd0806608 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:35.331329 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4caaec62-2692-4f57-888e-8d9bd0806608 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:35.332549 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4caaec62-2692-4f57-888e-8d9bd0806608 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:35.333169 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4caaec62-2692-4f57-888e-8d9bd0806608 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:35.334923 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4caaec62-2692-4f57-888e-8d9bd0806608 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:35.366074 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:58:35.600749 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6b683dbc-afdd-4fe3-896f-1a62f59af9bb tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:35.615870 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6b683dbc-afdd-4fe3-896f-1a62f59af9bb tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1513 microversion: 2.1 time: 1.045451 Sep 24 20:58:35.616482 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1190/2370] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:34 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1513 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:35.637498 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1c1833df-9729-4f1e-bb37-b1c6af00162e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:35.651491 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1c1833df-9729-4f1e-bb37-b1c6af00162e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:35.671353 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1c1833df-9729-4f1e-bb37-b1c6af00162e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:35.672545 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1c1833df-9729-4f1e-bb37-b1c6af00162e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:35.673494 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1c1833df-9729-4f1e-bb37-b1c6af00162e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:35.674440 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1c1833df-9729-4f1e-bb37-b1c6af00162e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:35.675079 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1c1833df-9729-4f1e-bb37-b1c6af00162e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:35.675668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1c1833df-9729-4f1e-bb37-b1c6af00162e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:35.775454 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1c1833df-9729-4f1e-bb37-b1c6af00162e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.143265 Sep 24 20:58:35.783246 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1191/2371] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:35 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:58:35.791448 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9481d3e2-9540-47ab-bb4b-4cbdbf833fb8 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b07efd700>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:35.895068 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9481d3e2-9540-47ab-bb4b-4cbdbf833fb8 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625" status: 200 len: 1450 microversion: 2.1 time: 0.113717 Sep 24 20:58:35.895290 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1192/2372] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:35 2022] GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625 => generated 1450 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:35.914113 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-3e8543ac-cfc3-4438-856a-d9722b8ec6bf req-85c5ae54-1b39-4518-b225-e6dc21000285 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f800d64-00f6-4135-8090-c95d84acd232", "name": "network-vif-plugged", "status": "completed", "tag": "04879ee8-ed63-4eba-999f-e92bf51322a7"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:58:35.939280 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:58:35.940987 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-3e8543ac-cfc3-4438-856a-d9722b8ec6bf req-85c5ae54-1b39-4518-b225-e6dc21000285 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:35.941486 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-3e8543ac-cfc3-4438-856a-d9722b8ec6bf req-85c5ae54-1b39-4518-b225-e6dc21000285 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:35.941923 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-3e8543ac-cfc3-4438-856a-d9722b8ec6bf req-85c5ae54-1b39-4518-b225-e6dc21000285 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:35.944381 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4caaec62-2692-4f57-888e-8d9bd0806608 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343dddda044b8fa4eb797a4b64556a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbf416811f64df0b56656a0cf7778ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:35.962691 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:58:35.963520 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4caaec62-2692-4f57-888e-8d9bd0806608 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3" status: 200 len: 1318 microversion: 2.1 time: 0.685764 Sep 24 20:58:35.965323 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1181/2373] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:35 2022] GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3 => generated 1318 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:35.967459 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-3e8543ac-cfc3-4438-856a-d9722b8ec6bf req-85c5ae54-1b39-4518-b225-e6dc21000285 service nova] Creating event network-vif-plugged:04879ee8-ed63-4eba-999f-e92bf51322a7 for instance 8f800d64-00f6-4135-8090-c95d84acd232 on nch2-master-1 Sep 24 20:58:35.982028 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-3e8543ac-cfc3-4438-856a-d9722b8ec6bf req-85c5ae54-1b39-4518-b225-e6dc21000285 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078934 Sep 24 20:58:35.982771 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1193/2374] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:58:35.984814 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9be93356-029d-4cd3-a8b7-e0c16267feda tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:35.985628 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9be93356-029d-4cd3-a8b7-e0c16267feda tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:35.996448 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9be93356-029d-4cd3-a8b7-e0c16267feda tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:35.996967 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9be93356-029d-4cd3-a8b7-e0c16267feda tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:35.997433 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9be93356-029d-4cd3-a8b7-e0c16267feda tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:35.999078 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9be93356-029d-4cd3-a8b7-e0c16267feda tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:35.999570 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9be93356-029d-4cd3-a8b7-e0c16267feda tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:36.000580 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9be93356-029d-4cd3-a8b7-e0c16267feda tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:36.226240 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9be93356-029d-4cd3-a8b7-e0c16267feda tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:36.239969 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9be93356-029d-4cd3-a8b7-e0c16267feda tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 200 len: 1354 microversion: 2.1 time: 0.263811 Sep 24 20:58:36.256344 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1182/2375] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:35 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 1354 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:36.302545 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d3c8c961-b25a-4ad4-8f8d-7a7d4816fc2a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:36.303268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d3c8c961-b25a-4ad4-8f8d-7a7d4816fc2a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:36.310928 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3c8c961-b25a-4ad4-8f8d-7a7d4816fc2a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:36.311654 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3c8c961-b25a-4ad4-8f8d-7a7d4816fc2a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:36.312256 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3c8c961-b25a-4ad4-8f8d-7a7d4816fc2a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:36.313138 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3c8c961-b25a-4ad4-8f8d-7a7d4816fc2a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:36.313960 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3c8c961-b25a-4ad4-8f8d-7a7d4816fc2a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:36.314593 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3c8c961-b25a-4ad4-8f8d-7a7d4816fc2a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:36.391170 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d3c8c961-b25a-4ad4-8f8d-7a7d4816fc2a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:36.400673 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d3c8c961-b25a-4ad4-8f8d-7a7d4816fc2a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1295 microversion: 2.1 time: 0.102966 Sep 24 20:58:36.403269 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1194/2376] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:36 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1295 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:36.644229 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0ef10947-ea2c-424a-994d-8eeb30bff618 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:36.645225 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0ef10947-ea2c-424a-994d-8eeb30bff618 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:36.652413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0ef10947-ea2c-424a-994d-8eeb30bff618 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:36.653187 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0ef10947-ea2c-424a-994d-8eeb30bff618 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:36.653804 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0ef10947-ea2c-424a-994d-8eeb30bff618 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:36.654739 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0ef10947-ea2c-424a-994d-8eeb30bff618 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:36.655632 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0ef10947-ea2c-424a-994d-8eeb30bff618 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:36.656220 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0ef10947-ea2c-424a-994d-8eeb30bff618 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:36.791722 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d43699da-71cb-40c3-8c29-5c75a977a933 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:36.794390 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d43699da-71cb-40c3-8c29-5c75a977a933 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:36.811703 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d43699da-71cb-40c3-8c29-5c75a977a933 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:36.812213 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d43699da-71cb-40c3-8c29-5c75a977a933 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:36.812659 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d43699da-71cb-40c3-8c29-5c75a977a933 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:36.813386 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d43699da-71cb-40c3-8c29-5c75a977a933 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:36.813882 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d43699da-71cb-40c3-8c29-5c75a977a933 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:36.816952 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d43699da-71cb-40c3-8c29-5c75a977a933 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:36.889796 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0ef10947-ea2c-424a-994d-8eeb30bff618 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:36.905389 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d43699da-71cb-40c3-8c29-5c75a977a933 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.117862 Sep 24 20:58:36.905655 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0ef10947-ea2c-424a-994d-8eeb30bff618 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1513 microversion: 2.1 time: 0.265234 Sep 24 20:58:36.906813 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1195/2378] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:36 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 20:58:36.906958 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1183/2378] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:36 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1513 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:36.912520 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dfbabdda-a924-48b2-825f-c8837e60c1ad tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b10f7cc10>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:36.994890 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cd600ea6-301e-44d8-9a60-dd129f7515a6 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:36.995973 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cd600ea6-301e-44d8-9a60-dd129f7515a6 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 72bfdb29-fd39-41a3-8314-624925dcd0b3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:37.002109 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-dfbabdda-a924-48b2-825f-c8837e60c1ad tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625" status: 200 len: 1450 microversion: 2.1 time: 0.093843 Sep 24 20:58:37.003738 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1184/2379] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:36 2022] GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625 => generated 1450 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:37.014315 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd600ea6-301e-44d8-9a60-dd129f7515a6 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:37.022386 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd600ea6-301e-44d8-9a60-dd129f7515a6 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:37.023236 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd600ea6-301e-44d8-9a60-dd129f7515a6 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:37.026633 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd600ea6-301e-44d8-9a60-dd129f7515a6 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:37.029005 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd600ea6-301e-44d8-9a60-dd129f7515a6 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:37.029675 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd600ea6-301e-44d8-9a60-dd129f7515a6 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:37.267883 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-725ae5f0-b085-471b-b455-ae99c137a403 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:37.267883 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-725ae5f0-b085-471b-b455-ae99c137a403 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:37.287516 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-725ae5f0-b085-471b-b455-ae99c137a403 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:37.288024 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-725ae5f0-b085-471b-b455-ae99c137a403 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:37.289440 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-725ae5f0-b085-471b-b455-ae99c137a403 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:37.290340 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-725ae5f0-b085-471b-b455-ae99c137a403 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:37.292682 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-725ae5f0-b085-471b-b455-ae99c137a403 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:37.293141 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-725ae5f0-b085-471b-b455-ae99c137a403 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:37.303602 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cd600ea6-301e-44d8-9a60-dd129f7515a6 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343dddda044b8fa4eb797a4b64556a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbf416811f64df0b56656a0cf7778ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:37.314336 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cd600ea6-301e-44d8-9a60-dd129f7515a6 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3" status: 200 len: 1318 microversion: 2.1 time: 0.324797 Sep 24 20:58:37.315695 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1196/2380] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:36 2022] GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3 => generated 1318 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:37.430270 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-36e79f0d-7dc1-46c1-94d5-c74cfdac3104 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:37.430938 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-36e79f0d-7dc1-46c1-94d5-c74cfdac3104 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:37.445825 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-36e79f0d-7dc1-46c1-94d5-c74cfdac3104 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:37.450872 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-36e79f0d-7dc1-46c1-94d5-c74cfdac3104 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:37.451648 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-36e79f0d-7dc1-46c1-94d5-c74cfdac3104 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:37.452585 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-36e79f0d-7dc1-46c1-94d5-c74cfdac3104 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:37.458867 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-36e79f0d-7dc1-46c1-94d5-c74cfdac3104 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:37.459581 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-36e79f0d-7dc1-46c1-94d5-c74cfdac3104 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:37.633870 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-36e79f0d-7dc1-46c1-94d5-c74cfdac3104 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:37.648692 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-36e79f0d-7dc1-46c1-94d5-c74cfdac3104 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1295 microversion: 2.1 time: 0.224132 Sep 24 20:58:37.659843 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1197/2381] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:37 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1295 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:58:37.666126 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-725ae5f0-b085-471b-b455-ae99c137a403 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:37.684166 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-725ae5f0-b085-471b-b455-ae99c137a403 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 200 len: 1354 microversion: 2.1 time: 0.421710 Sep 24 20:58:37.694531 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1185/2382] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:37 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 1354 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:58:37.920780 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f028f50d-eba4-4c1c-bdc0-81e3012209b9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:37.924341 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f028f50d-eba4-4c1c-bdc0-81e3012209b9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:37.932734 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-94358ac2-58b2-4b6d-8687-1c59e71ea1ef tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:37.933374 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-94358ac2-58b2-4b6d-8687-1c59e71ea1ef tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:37.946030 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-94358ac2-58b2-4b6d-8687-1c59e71ea1ef tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:37.946596 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-94358ac2-58b2-4b6d-8687-1c59e71ea1ef tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:37.947060 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-94358ac2-58b2-4b6d-8687-1c59e71ea1ef tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:37.950357 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-94358ac2-58b2-4b6d-8687-1c59e71ea1ef tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:37.952264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-94358ac2-58b2-4b6d-8687-1c59e71ea1ef tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:37.952745 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-94358ac2-58b2-4b6d-8687-1c59e71ea1ef tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:37.973395 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f028f50d-eba4-4c1c-bdc0-81e3012209b9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:37.979535 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f028f50d-eba4-4c1c-bdc0-81e3012209b9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:37.980520 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f028f50d-eba4-4c1c-bdc0-81e3012209b9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:37.982755 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f028f50d-eba4-4c1c-bdc0-81e3012209b9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:37.985936 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f028f50d-eba4-4c1c-bdc0-81e3012209b9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:37.989998 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f028f50d-eba4-4c1c-bdc0-81e3012209b9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:38.036999 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f028f50d-eba4-4c1c-bdc0-81e3012209b9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.123442 Sep 24 20:58:38.041549 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1198/2383] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:37 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:58:38.050115 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-01571b86-a448-4273-8b18-a09dda90e5de tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b0c7b1820>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:38.173558 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-01571b86-a448-4273-8b18-a09dda90e5de tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625" status: 200 len: 1450 microversion: 2.1 time: 0.127630 Sep 24 20:58:38.188072 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1199/2384] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:38 2022] GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625 => generated 1450 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:38.337409 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-87f4ac57-c9df-4cd0-8f47-a1f9feac3f60 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:38.338297 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-87f4ac57-c9df-4cd0-8f47-a1f9feac3f60 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 72bfdb29-fd39-41a3-8314-624925dcd0b3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:38.346277 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-94358ac2-58b2-4b6d-8687-1c59e71ea1ef tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:38.348581 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-87f4ac57-c9df-4cd0-8f47-a1f9feac3f60 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:38.349085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-87f4ac57-c9df-4cd0-8f47-a1f9feac3f60 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:38.349536 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-87f4ac57-c9df-4cd0-8f47-a1f9feac3f60 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:38.350266 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-87f4ac57-c9df-4cd0-8f47-a1f9feac3f60 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:38.350768 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-87f4ac57-c9df-4cd0-8f47-a1f9feac3f60 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:38.351213 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-87f4ac57-c9df-4cd0-8f47-a1f9feac3f60 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:38.356471 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-94358ac2-58b2-4b6d-8687-1c59e71ea1ef tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1513 microversion: 2.1 time: 0.427681 Sep 24 20:58:38.357637 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1186/2385] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:37 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1513 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:58:38.676749 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-aa834425-6d18-4a9d-aa17-91e5398d8a9f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:38.677610 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-aa834425-6d18-4a9d-aa17-91e5398d8a9f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:38.698241 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa834425-6d18-4a9d-aa17-91e5398d8a9f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:38.699455 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa834425-6d18-4a9d-aa17-91e5398d8a9f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:38.700059 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa834425-6d18-4a9d-aa17-91e5398d8a9f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:38.700977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa834425-6d18-4a9d-aa17-91e5398d8a9f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:38.707928 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa834425-6d18-4a9d-aa17-91e5398d8a9f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:38.709264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa834425-6d18-4a9d-aa17-91e5398d8a9f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:38.733215 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-87f4ac57-c9df-4cd0-8f47-a1f9feac3f60 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343dddda044b8fa4eb797a4b64556a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbf416811f64df0b56656a0cf7778ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:38.749775 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-87f4ac57-c9df-4cd0-8f47-a1f9feac3f60 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3" status: 200 len: 1318 microversion: 2.1 time: 0.416162 Sep 24 20:58:38.751558 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1200/2386] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:38 2022] GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3 => generated 1318 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:38.756901 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c98220ea-59b4-4587-8245-5db709e3c4af tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:38.763573 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c98220ea-59b4-4587-8245-5db709e3c4af tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:38.785821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c98220ea-59b4-4587-8245-5db709e3c4af tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:38.786662 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c98220ea-59b4-4587-8245-5db709e3c4af tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:38.788895 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c98220ea-59b4-4587-8245-5db709e3c4af tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:38.791826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c98220ea-59b4-4587-8245-5db709e3c4af tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:38.795024 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c98220ea-59b4-4587-8245-5db709e3c4af tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:38.796068 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c98220ea-59b4-4587-8245-5db709e3c4af tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:39.225483 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-aa834425-6d18-4a9d-aa17-91e5398d8a9f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:39.245071 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-aa834425-6d18-4a9d-aa17-91e5398d8a9f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1363 microversion: 2.1 time: 0.572881 Sep 24 20:58:39.273036 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1187/2387] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:38 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1363 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:39.308539 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-d99c9a3b-0f2c-4c52-b0c3-b7952684a102 req-52fd0be8-415d-4052-abc1-e9d365e4f9b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c394113-a640-4199-80e0-1316dd1b2828", "name": "network-vif-plugged", "status": "completed", "tag": "356ffb26-b574-4bd3-8e28-72fc211fb860"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:58:39.332764 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d99c9a3b-0f2c-4c52-b0c3-b7952684a102 req-52fd0be8-415d-4052-abc1-e9d365e4f9b0 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:39.335086 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d99c9a3b-0f2c-4c52-b0c3-b7952684a102 req-52fd0be8-415d-4052-abc1-e9d365e4f9b0 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:39.335705 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d99c9a3b-0f2c-4c52-b0c3-b7952684a102 req-52fd0be8-415d-4052-abc1-e9d365e4f9b0 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:39.374882 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-d99c9a3b-0f2c-4c52-b0c3-b7952684a102 req-52fd0be8-415d-4052-abc1-e9d365e4f9b0 service nova] Creating event network-vif-plugged:356ffb26-b574-4bd3-8e28-72fc211fb860 for instance 1c394113-a640-4199-80e0-1316dd1b2828 on nch1-master-1 Sep 24 20:58:39.390448 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c98220ea-59b4-4587-8245-5db709e3c4af tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:39.400664 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c98220ea-59b4-4587-8245-5db709e3c4af tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 200 len: 1354 microversion: 2.1 time: 0.647709 Sep 24 20:58:39.411828 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-d99c9a3b-0f2c-4c52-b0c3-b7952684a102 req-52fd0be8-415d-4052-abc1-e9d365e4f9b0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131093 Sep 24 20:58:39.416468 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1188/2388] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:58:39.423909 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1201/2389] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:38 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 1354 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:39.438224 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c749f03f-393d-4207-a6f6-1fab6c1005e8 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b07ea1c10>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:39.439951 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-99083c3f-3e71-471d-96e3-c762636e659c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:39.472102 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-99083c3f-3e71-471d-96e3-c762636e659c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:39.480624 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-99083c3f-3e71-471d-96e3-c762636e659c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:39.481367 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-99083c3f-3e71-471d-96e3-c762636e659c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:39.485273 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-99083c3f-3e71-471d-96e3-c762636e659c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:39.486658 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-99083c3f-3e71-471d-96e3-c762636e659c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:39.489147 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-99083c3f-3e71-471d-96e3-c762636e659c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:39.489767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-99083c3f-3e71-471d-96e3-c762636e659c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:39.526212 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c749f03f-393d-4207-a6f6-1fab6c1005e8 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625" status: 200 len: 1450 microversion: 2.1 time: 0.101074 Sep 24 20:58:39.527519 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1202/2390] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:39 2022] GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625 => generated 1450 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:39.535659 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-99083c3f-3e71-471d-96e3-c762636e659c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.118021 Sep 24 20:58:39.536794 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1189/2391] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:39 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:58:39.541975 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e69d0fea-fdfd-4702-9b7e-07cafee5dd81 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:39.543072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e69d0fea-fdfd-4702-9b7e-07cafee5dd81 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:39.552033 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e69d0fea-fdfd-4702-9b7e-07cafee5dd81 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:39.553961 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e69d0fea-fdfd-4702-9b7e-07cafee5dd81 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:39.554665 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e69d0fea-fdfd-4702-9b7e-07cafee5dd81 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:39.556021 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e69d0fea-fdfd-4702-9b7e-07cafee5dd81 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:39.556646 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e69d0fea-fdfd-4702-9b7e-07cafee5dd81 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:39.557365 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e69d0fea-fdfd-4702-9b7e-07cafee5dd81 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:39.648454 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-435e2b71-cfa4-4a14-abf6-997fc640377f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1720053146", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "1d2fee0c-2b4a-497a-b4e0-a76edfbd4190"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:58:39.761566 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e69d0fea-fdfd-4702-9b7e-07cafee5dd81 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:39.774551 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e69d0fea-fdfd-4702-9b7e-07cafee5dd81 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1513 microversion: 2.1 time: 0.236406 Sep 24 20:58:39.775635 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1190/2392] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:39 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1513 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:39.781626 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-d222107e-2cc6-4559-bec4-08f223f01470 req-ad523048-c159-4bd5-b40c-3c89b4d47fef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e781d448-5d66-4040-bf4c-37452b0f7b1c", "tag": "ac7cf96e-fcba-4f98-ab54-6ea3518610bf"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:58:39.799258 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d222107e-2cc6-4559-bec4-08f223f01470 req-ad523048-c159-4bd5-b40c-3c89b4d47fef service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:39.799759 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d222107e-2cc6-4559-bec4-08f223f01470 req-ad523048-c159-4bd5-b40c-3c89b4d47fef service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:39.800317 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d222107e-2cc6-4559-bec4-08f223f01470 req-ad523048-c159-4bd5-b40c-3c89b4d47fef service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:39.818958 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-d222107e-2cc6-4559-bec4-08f223f01470 req-ad523048-c159-4bd5-b40c-3c89b4d47fef service nova] Creating event network-changed:ac7cf96e-fcba-4f98-ab54-6ea3518610bf for instance e781d448-5d66-4040-bf4c-37452b0f7b1c on nch2-master-1 Sep 24 20:58:39.825374 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-d222107e-2cc6-4559-bec4-08f223f01470 req-ad523048-c159-4bd5-b40c-3c89b4d47fef service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048223 Sep 24 20:58:39.826322 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1191/2393] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:58:39.834146 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a47605e8-3f1e-443a-ac2d-04877f95cfe1 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:39.834579 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-435e2b71-cfa4-4a14-abf6-997fc640377f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] validate_networks() for [('1d2fee0c-2b4a-497a-b4e0-a76edfbd4190', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:58:39.835847 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a47605e8-3f1e-443a-ac2d-04877f95cfe1 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 72bfdb29-fd39-41a3-8314-624925dcd0b3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:39.876488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a47605e8-3f1e-443a-ac2d-04877f95cfe1 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:39.877228 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a47605e8-3f1e-443a-ac2d-04877f95cfe1 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:39.877696 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a47605e8-3f1e-443a-ac2d-04877f95cfe1 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:39.878471 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a47605e8-3f1e-443a-ac2d-04877f95cfe1 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:39.878966 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a47605e8-3f1e-443a-ac2d-04877f95cfe1 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:39.879408 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a47605e8-3f1e-443a-ac2d-04877f95cfe1 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:40.463041 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a47605e8-3f1e-443a-ac2d-04877f95cfe1 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343dddda044b8fa4eb797a4b64556a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbf416811f64df0b56656a0cf7778ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:40.475812 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a47605e8-3f1e-443a-ac2d-04877f95cfe1 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3" status: 200 len: 1318 microversion: 2.1 time: 0.647516 Sep 24 20:58:40.479468 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1192/2394] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:39 2022] GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3 => generated 1318 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:40.490241 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4301f177-4ac1-4c95-971b-5a082407ae5c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:40.493789 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4301f177-4ac1-4c95-971b-5a082407ae5c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:40.514142 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4301f177-4ac1-4c95-971b-5a082407ae5c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:40.515087 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4301f177-4ac1-4c95-971b-5a082407ae5c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:40.515867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4301f177-4ac1-4c95-971b-5a082407ae5c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:40.516555 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4301f177-4ac1-4c95-971b-5a082407ae5c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:40.517399 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4301f177-4ac1-4c95-971b-5a082407ae5c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:40.518042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4301f177-4ac1-4c95-971b-5a082407ae5c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:40.926277 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4301f177-4ac1-4c95-971b-5a082407ae5c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:40.943999 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4301f177-4ac1-4c95-971b-5a082407ae5c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1363 microversion: 2.1 time: 0.463266 Sep 24 20:58:40.944866 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1193/2395] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:40 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1363 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:40.964300 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-22c8772f-7fe5-4a3b-8b6a-4c44c30b6920 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:40.965687 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-22c8772f-7fe5-4a3b-8b6a-4c44c30b6920 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:40.975663 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-435e2b71-cfa4-4a14-abf6-997fc640377f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:58:40.976182 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-435e2b71-cfa4-4a14-abf6-997fc640377f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:58:40.976672 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-435e2b71-cfa4-4a14-abf6-997fc640377f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:58:40.977209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-435e2b71-cfa4-4a14-abf6-997fc640377f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:58:40.977659 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-435e2b71-cfa4-4a14-abf6-997fc640377f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:58:40.992390 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22c8772f-7fe5-4a3b-8b6a-4c44c30b6920 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:40.992897 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22c8772f-7fe5-4a3b-8b6a-4c44c30b6920 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:40.993833 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22c8772f-7fe5-4a3b-8b6a-4c44c30b6920 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:40.994632 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22c8772f-7fe5-4a3b-8b6a-4c44c30b6920 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:40.995123 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22c8772f-7fe5-4a3b-8b6a-4c44c30b6920 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:40.995569 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22c8772f-7fe5-4a3b-8b6a-4c44c30b6920 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:40.998323 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-435e2b71-cfa4-4a14-abf6-997fc640377f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:40.999358 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-435e2b71-cfa4-4a14-abf6-997fc640377f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:40.999954 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-435e2b71-cfa4-4a14-abf6-997fc640377f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:41.005465 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-435e2b71-cfa4-4a14-abf6-997fc640377f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:41.006379 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-435e2b71-cfa4-4a14-abf6-997fc640377f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:41.007825 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-435e2b71-cfa4-4a14-abf6-997fc640377f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:41.038261 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-435e2b71-cfa4-4a14-abf6-997fc640377f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Getting quotas for project 8340f7f8fa9848dc822903c738f78f2a. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:58:41.044698 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-435e2b71-cfa4-4a14-abf6-997fc640377f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Getting quotas for user ee21da3ff38a43798bce50c9aba4ae33 and project 8340f7f8fa9848dc822903c738f78f2a. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:58:41.068323 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-435e2b71-cfa4-4a14-abf6-997fc640377f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:58:41.071312 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-435e2b71-cfa4-4a14-abf6-997fc640377f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 0fa728d6-93b7-4c6f-b358-55f15038a503] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:58:41.149437 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-435e2b71-cfa4-4a14-abf6-997fc640377f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.620811 Sep 24 20:58:41.156720 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1203/2396] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:58:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:58:41.165313 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-345f922d-99fc-430f-a98a-10e1dbba705c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b0c8b4040>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:41.213746 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-22c8772f-7fe5-4a3b-8b6a-4c44c30b6920 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:41.228296 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-22c8772f-7fe5-4a3b-8b6a-4c44c30b6920 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 200 len: 1354 microversion: 2.1 time: 0.279714 Sep 24 20:58:41.231004 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1194/2397] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:40 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 1354 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:41.247278 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-345f922d-99fc-430f-a98a-10e1dbba705c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625" status: 200 len: 1450 microversion: 2.1 time: 0.088812 Sep 24 20:58:41.254173 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1204/2398] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:41 2022] GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625 => generated 1450 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:41.256022 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-742e0c7a-24d1-48d6-9c85-744050293460 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:41.260432 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-742e0c7a-24d1-48d6-9c85-744050293460 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:41.264536 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-147d4b5b-c338-4d06-a727-e19265699b80 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:41.269597 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-147d4b5b-c338-4d06-a727-e19265699b80 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:41.271466 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-742e0c7a-24d1-48d6-9c85-744050293460 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:41.272420 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-742e0c7a-24d1-48d6-9c85-744050293460 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:41.273344 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-742e0c7a-24d1-48d6-9c85-744050293460 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:41.274273 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-742e0c7a-24d1-48d6-9c85-744050293460 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:41.274933 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-742e0c7a-24d1-48d6-9c85-744050293460 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:41.275571 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-742e0c7a-24d1-48d6-9c85-744050293460 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:41.284732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-147d4b5b-c338-4d06-a727-e19265699b80 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:41.284732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-147d4b5b-c338-4d06-a727-e19265699b80 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:41.284732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-147d4b5b-c338-4d06-a727-e19265699b80 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:41.284732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-147d4b5b-c338-4d06-a727-e19265699b80 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:41.284732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-147d4b5b-c338-4d06-a727-e19265699b80 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:41.284732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-147d4b5b-c338-4d06-a727-e19265699b80 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:41.337759 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-742e0c7a-24d1-48d6-9c85-744050293460 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.091527 Sep 24 20:58:41.338527 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1195/2399] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:41 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:58:41.345166 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f9cd00f0-c644-41e6-b51b-da584e56d619 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:41.346194 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f9cd00f0-c644-41e6-b51b-da584e56d619 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 0fa728d6-93b7-4c6f-b358-55f15038a503] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:41.612223 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f9cd00f0-c644-41e6-b51b-da584e56d619 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:41.623474 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f9cd00f0-c644-41e6-b51b-da584e56d619 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503" status: 200 len: 1215 microversion: 2.1 time: 0.283742 Sep 24 20:58:41.642236 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1196/2400] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:41 2022] GET /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503 => generated 1215 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:41.659606 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-0b24a080-1345-41c7-9cf6-fda4b15edc01 req-8256f41d-f622-4d68-86a1-790b40af2c5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c394113-a640-4199-80e0-1316dd1b2828", "name": "network-vif-plugged", "status": "completed", "tag": "5fbaf336-e072-4bcb-a547-ba1e9efcffcf"}, {"server_uuid": "1c394113-a640-4199-80e0-1316dd1b2828", "name": "network-vif-plugged", "status": "completed", "tag": "a95c393d-6869-46f3-abf0-a9a01e228621"}, {"server_uuid": "72bfdb29-fd39-41a3-8314-624925dcd0b3", "name": "network-vif-plugged", "status": "completed", "tag": "220a9783-4cc5-43f0-9857-3df4d11f076f"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:58:41.691883 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-0b24a080-1345-41c7-9cf6-fda4b15edc01 req-8256f41d-f622-4d68-86a1-790b40af2c5f service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:41.692378 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-0b24a080-1345-41c7-9cf6-fda4b15edc01 req-8256f41d-f622-4d68-86a1-790b40af2c5f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:41.693171 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-0b24a080-1345-41c7-9cf6-fda4b15edc01 req-8256f41d-f622-4d68-86a1-790b40af2c5f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:41.716909 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-0b24a080-1345-41c7-9cf6-fda4b15edc01 req-8256f41d-f622-4d68-86a1-790b40af2c5f service nova] Creating event network-vif-plugged:5fbaf336-e072-4bcb-a547-ba1e9efcffcf for instance 1c394113-a640-4199-80e0-1316dd1b2828 on nch1-master-1 Sep 24 20:58:41.717470 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-0b24a080-1345-41c7-9cf6-fda4b15edc01 req-8256f41d-f622-4d68-86a1-790b40af2c5f service nova] Creating event network-vif-plugged:a95c393d-6869-46f3-abf0-a9a01e228621 for instance 1c394113-a640-4199-80e0-1316dd1b2828 on nch1-master-1 Sep 24 20:58:41.717919 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-0b24a080-1345-41c7-9cf6-fda4b15edc01 req-8256f41d-f622-4d68-86a1-790b40af2c5f service nova] Creating event network-vif-plugged:220a9783-4cc5-43f0-9857-3df4d11f076f for instance 72bfdb29-fd39-41a3-8314-624925dcd0b3 on nch1-master-1 Sep 24 20:58:41.737694 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-0b24a080-1345-41c7-9cf6-fda4b15edc01 req-8256f41d-f622-4d68-86a1-790b40af2c5f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.093015 Sep 24 20:58:41.743877 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1197/2401] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:58:41.752866 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a790231c-0bf1-43e1-83fb-c1b15dd2d99d tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:41.753755 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a790231c-0bf1-43e1-83fb-c1b15dd2d99d tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 72bfdb29-fd39-41a3-8314-624925dcd0b3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:41.768103 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=97 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:58:41.769909 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a790231c-0bf1-43e1-83fb-c1b15dd2d99d tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:41.770415 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a790231c-0bf1-43e1-83fb-c1b15dd2d99d tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:41.777414 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-147d4b5b-c338-4d06-a727-e19265699b80 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:41.778898 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a790231c-0bf1-43e1-83fb-c1b15dd2d99d tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:41.779694 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a790231c-0bf1-43e1-83fb-c1b15dd2d99d tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:41.780548 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a790231c-0bf1-43e1-83fb-c1b15dd2d99d tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:41.780857 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a790231c-0bf1-43e1-83fb-c1b15dd2d99d tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:41.800603 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-147d4b5b-c338-4d06-a727-e19265699b80 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1513 microversion: 2.1 time: 0.540669 Sep 24 20:58:41.802982 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1205/2402] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:41 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1513 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:41.903830 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-aff05819-d8d8-406b-aa4e-dc69681e01db req-a0912a50-f3b8-41e4-90c3-003ad59b38b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d546302-deb3-47c6-b9fd-3155ced00883", "tag": "56949465-71b8-45bb-b1d2-4b934bfc9714"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:58:41.925089 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-aff05819-d8d8-406b-aa4e-dc69681e01db req-a0912a50-f3b8-41e4-90c3-003ad59b38b6 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:41.926816 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-aff05819-d8d8-406b-aa4e-dc69681e01db req-a0912a50-f3b8-41e4-90c3-003ad59b38b6 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:41.928729 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-aff05819-d8d8-406b-aa4e-dc69681e01db req-a0912a50-f3b8-41e4-90c3-003ad59b38b6 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:41.954952 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-aff05819-d8d8-406b-aa4e-dc69681e01db req-a0912a50-f3b8-41e4-90c3-003ad59b38b6 service nova] Creating event network-changed:56949465-71b8-45bb-b1d2-4b934bfc9714 for instance 0d546302-deb3-47c6-b9fd-3155ced00883 on nch1-master-1 Sep 24 20:58:41.962935 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-aff05819-d8d8-406b-aa4e-dc69681e01db req-a0912a50-f3b8-41e4-90c3-003ad59b38b6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067810 Sep 24 20:58:41.964193 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1206/2403] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:58:41.970538 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-928f212e-6690-4001-b20e-c4be5075de01 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:41.971821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-928f212e-6690-4001-b20e-c4be5075de01 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:41.979815 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-928f212e-6690-4001-b20e-c4be5075de01 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:41.981542 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-928f212e-6690-4001-b20e-c4be5075de01 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:41.983547 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-928f212e-6690-4001-b20e-c4be5075de01 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:41.985501 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-928f212e-6690-4001-b20e-c4be5075de01 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:41.986876 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-928f212e-6690-4001-b20e-c4be5075de01 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:41.987772 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-928f212e-6690-4001-b20e-c4be5075de01 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:42.328965 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a790231c-0bf1-43e1-83fb-c1b15dd2d99d tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343dddda044b8fa4eb797a4b64556a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbf416811f64df0b56656a0cf7778ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:42.343410 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a790231c-0bf1-43e1-83fb-c1b15dd2d99d tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3" status: 200 len: 1318 microversion: 2.1 time: 0.598254 Sep 24 20:58:42.363555 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1198/2404] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:41 2022] GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3 => generated 1318 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:42.401540 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2e5179c1-3009-4866-b524-61049f3bac77 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:42.412141 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2e5179c1-3009-4866-b524-61049f3bac77 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:42.444563 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e5179c1-3009-4866-b524-61049f3bac77 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:42.445320 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e5179c1-3009-4866-b524-61049f3bac77 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:42.445917 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e5179c1-3009-4866-b524-61049f3bac77 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:42.446883 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e5179c1-3009-4866-b524-61049f3bac77 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:42.448635 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e5179c1-3009-4866-b524-61049f3bac77 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:42.449878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e5179c1-3009-4866-b524-61049f3bac77 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:42.506300 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-928f212e-6690-4001-b20e-c4be5075de01 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:42.535294 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-928f212e-6690-4001-b20e-c4be5075de01 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1363 microversion: 2.1 time: 0.569653 Sep 24 20:58:42.543907 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1207/2405] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:41 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1363 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:42.549485 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6c960dc7-e697-4ec2-9422-87b0469c6b4b tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b11081dc0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:42.625621 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6c960dc7-e697-4ec2-9422-87b0469c6b4b tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625" status: 200 len: 1450 microversion: 2.1 time: 0.080363 Sep 24 20:58:42.639047 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1208/2406] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:42 2022] GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625 => generated 1450 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:42.650580 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9f7dadcf-8c37-4946-9951-602855594f11 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:42.653004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9f7dadcf-8c37-4946-9951-602855594f11 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:42.661301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f7dadcf-8c37-4946-9951-602855594f11 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:42.662259 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f7dadcf-8c37-4946-9951-602855594f11 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:42.663132 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f7dadcf-8c37-4946-9951-602855594f11 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:42.664135 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f7dadcf-8c37-4946-9951-602855594f11 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:42.664747 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f7dadcf-8c37-4946-9951-602855594f11 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:42.665335 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f7dadcf-8c37-4946-9951-602855594f11 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:42.702979 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9f7dadcf-8c37-4946-9951-602855594f11 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.062037 Sep 24 20:58:42.704400 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1209/2407] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:42 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:58:42.709906 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-72e60074-ae74-4a3b-a40d-32e59d33dfb8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:42.710849 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-72e60074-ae74-4a3b-a40d-32e59d33dfb8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 0fa728d6-93b7-4c6f-b358-55f15038a503] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:42.717770 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-72e60074-ae74-4a3b-a40d-32e59d33dfb8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:42.718754 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-72e60074-ae74-4a3b-a40d-32e59d33dfb8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:42.719365 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-72e60074-ae74-4a3b-a40d-32e59d33dfb8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:42.720935 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-72e60074-ae74-4a3b-a40d-32e59d33dfb8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:42.721566 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-72e60074-ae74-4a3b-a40d-32e59d33dfb8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:42.722151 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-72e60074-ae74-4a3b-a40d-32e59d33dfb8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:42.843888 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2e5179c1-3009-4866-b524-61049f3bac77 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:42.854090 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2e5179c1-3009-4866-b524-61049f3bac77 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 200 len: 1354 microversion: 2.1 time: 0.477209 Sep 24 20:58:42.861706 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-72e60074-ae74-4a3b-a40d-32e59d33dfb8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:42.868814 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1199/2408] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:42 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 1354 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:42.870832 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-72e60074-ae74-4a3b-a40d-32e59d33dfb8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503" status: 200 len: 1267 microversion: 2.1 time: 0.165183 Sep 24 20:58:42.873937 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1210/2409] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:42 2022] GET /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:42.876447 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-75bec1a2-fffd-462e-b901-b2b69e0c7043 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:42.877221 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-75bec1a2-fffd-462e-b901-b2b69e0c7043 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:42.897076 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-75bec1a2-fffd-462e-b901-b2b69e0c7043 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:42.897724 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-75bec1a2-fffd-462e-b901-b2b69e0c7043 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:42.898280 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-75bec1a2-fffd-462e-b901-b2b69e0c7043 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:42.899133 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-75bec1a2-fffd-462e-b901-b2b69e0c7043 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:42.900042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-75bec1a2-fffd-462e-b901-b2b69e0c7043 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:42.900898 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-75bec1a2-fffd-462e-b901-b2b69e0c7043 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:43.090882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-75bec1a2-fffd-462e-b901-b2b69e0c7043 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:43.100694 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-75bec1a2-fffd-462e-b901-b2b69e0c7043 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1513 microversion: 2.1 time: 0.230543 Sep 24 20:58:43.103801 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1200/2410] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:42 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1513 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:43.392218 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e6c3fee0-6668-41da-a7fa-035117263313 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:43.392888 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e6c3fee0-6668-41da-a7fa-035117263313 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 72bfdb29-fd39-41a3-8314-624925dcd0b3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:43.412159 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6c3fee0-6668-41da-a7fa-035117263313 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:43.412653 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6c3fee0-6668-41da-a7fa-035117263313 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:43.413314 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6c3fee0-6668-41da-a7fa-035117263313 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:43.414206 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6c3fee0-6668-41da-a7fa-035117263313 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:43.414736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6c3fee0-6668-41da-a7fa-035117263313 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:43.415491 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6c3fee0-6668-41da-a7fa-035117263313 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:43.569553 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bc4d77aa-2ba1-46b0-8e17-69179034c8d2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:43.570423 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-bc4d77aa-2ba1-46b0-8e17-69179034c8d2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:43.587373 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bc4d77aa-2ba1-46b0-8e17-69179034c8d2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:43.587889 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bc4d77aa-2ba1-46b0-8e17-69179034c8d2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:43.588339 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bc4d77aa-2ba1-46b0-8e17-69179034c8d2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:43.589069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bc4d77aa-2ba1-46b0-8e17-69179034c8d2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:43.589533 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bc4d77aa-2ba1-46b0-8e17-69179034c8d2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:43.589968 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bc4d77aa-2ba1-46b0-8e17-69179034c8d2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:43.603548 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e6c3fee0-6668-41da-a7fa-035117263313 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343dddda044b8fa4eb797a4b64556a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbf416811f64df0b56656a0cf7778ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:43.615324 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e6c3fee0-6668-41da-a7fa-035117263313 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3" status: 200 len: 1318 microversion: 2.1 time: 0.228575 Sep 24 20:58:43.634562 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1211/2411] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:43 2022] GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:43.647303 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-77cdf749-66f0-4ba4-b746-29e004707499 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b07ed6dc0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:43.727451 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-77cdf749-66f0-4ba4-b746-29e004707499 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625" status: 200 len: 1450 microversion: 2.1 time: 0.087568 Sep 24 20:58:43.730282 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1212/2412] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:43 2022] GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625 => generated 1450 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:43.740308 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-defc1db6-2b57-4702-844b-21b73f1996e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:43.744114 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-defc1db6-2b57-4702-844b-21b73f1996e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:43.762115 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-defc1db6-2b57-4702-844b-21b73f1996e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:43.763131 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-defc1db6-2b57-4702-844b-21b73f1996e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:43.763807 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-defc1db6-2b57-4702-844b-21b73f1996e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:43.766300 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-defc1db6-2b57-4702-844b-21b73f1996e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:43.767044 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-defc1db6-2b57-4702-844b-21b73f1996e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:43.769166 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-defc1db6-2b57-4702-844b-21b73f1996e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:43.821533 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-defc1db6-2b57-4702-844b-21b73f1996e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.088655 Sep 24 20:58:43.834732 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1213/2413] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:43 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:58:43.878884 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5c58fcd7-57af-4ea7-b693-d52e7f7dc56a tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:43.879865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5c58fcd7-57af-4ea7-b693-d52e7f7dc56a tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:43.888965 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c58fcd7-57af-4ea7-b693-d52e7f7dc56a tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:43.890131 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c58fcd7-57af-4ea7-b693-d52e7f7dc56a tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:43.890955 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c58fcd7-57af-4ea7-b693-d52e7f7dc56a tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:43.891959 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c58fcd7-57af-4ea7-b693-d52e7f7dc56a tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:43.892833 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c58fcd7-57af-4ea7-b693-d52e7f7dc56a tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:43.894028 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c58fcd7-57af-4ea7-b693-d52e7f7dc56a tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:43.901612 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-bc4d77aa-2ba1-46b0-8e17-69179034c8d2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:43.911086 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bc4d77aa-2ba1-46b0-8e17-69179034c8d2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1363 microversion: 2.1 time: 0.345352 Sep 24 20:58:43.917355 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1201/2414] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:43 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1363 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:43.943052 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-aeaf0d32-c15a-42c2-aca0-a023f720063d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:43.950156 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-aeaf0d32-c15a-42c2-aca0-a023f720063d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 0fa728d6-93b7-4c6f-b358-55f15038a503] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:43.959665 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aeaf0d32-c15a-42c2-aca0-a023f720063d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:43.962345 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aeaf0d32-c15a-42c2-aca0-a023f720063d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:43.962981 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aeaf0d32-c15a-42c2-aca0-a023f720063d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:43.963913 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aeaf0d32-c15a-42c2-aca0-a023f720063d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:43.965553 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aeaf0d32-c15a-42c2-aca0-a023f720063d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:43.971063 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aeaf0d32-c15a-42c2-aca0-a023f720063d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:43.975262 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:58:44.211428 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-aeaf0d32-c15a-42c2-aca0-a023f720063d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:44.240050 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-aeaf0d32-c15a-42c2-aca0-a023f720063d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503" status: 200 len: 1275 microversion: 2.1 time: 0.291354 Sep 24 20:58:44.240981 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1202/2415] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:43 2022] GET /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503 => generated 1275 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:44.260272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9ccc4fb9-86fc-4e5f-b0ab-cc386c8577b4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:44.260898 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9ccc4fb9-86fc-4e5f-b0ab-cc386c8577b4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:44.287866 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5c58fcd7-57af-4ea7-b693-d52e7f7dc56a tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:44.294145 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9ccc4fb9-86fc-4e5f-b0ab-cc386c8577b4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:44.298680 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5c58fcd7-57af-4ea7-b693-d52e7f7dc56a tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 200 len: 1354 microversion: 2.1 time: 0.423210 Sep 24 20:58:44.299846 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1214/2416] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:43 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 1354 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:44.303149 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9ccc4fb9-86fc-4e5f-b0ab-cc386c8577b4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:44.303354 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9ccc4fb9-86fc-4e5f-b0ab-cc386c8577b4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:44.304293 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9ccc4fb9-86fc-4e5f-b0ab-cc386c8577b4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:44.304778 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9ccc4fb9-86fc-4e5f-b0ab-cc386c8577b4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:44.305214 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9ccc4fb9-86fc-4e5f-b0ab-cc386c8577b4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:44.519849 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9ccc4fb9-86fc-4e5f-b0ab-cc386c8577b4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:44.532786 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9ccc4fb9-86fc-4e5f-b0ab-cc386c8577b4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1513 microversion: 2.1 time: 0.276396 Sep 24 20:58:44.536343 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1203/2417] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:44 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1513 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:44.639726 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1c93a7bc-4037-4c8b-a592-aaa5d2b63499 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:44.640457 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1c93a7bc-4037-4c8b-a592-aaa5d2b63499 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 72bfdb29-fd39-41a3-8314-624925dcd0b3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:44.652248 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1c93a7bc-4037-4c8b-a592-aaa5d2b63499 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:44.653941 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1c93a7bc-4037-4c8b-a592-aaa5d2b63499 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:44.658365 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1c93a7bc-4037-4c8b-a592-aaa5d2b63499 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:44.659497 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1c93a7bc-4037-4c8b-a592-aaa5d2b63499 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:44.660204 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1c93a7bc-4037-4c8b-a592-aaa5d2b63499 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:44.660888 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1c93a7bc-4037-4c8b-a592-aaa5d2b63499 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:44.747819 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-15f0c6b3-a456-4e1b-a2ec-de6b97bfa6a3 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b11155670>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:44.825057 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-15f0c6b3-a456-4e1b-a2ec-de6b97bfa6a3 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625" status: 200 len: 1450 microversion: 2.1 time: 0.083536 Sep 24 20:58:44.827077 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1204/2418] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:44 2022] GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625 => generated 1450 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:58:44.840809 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-aac54d04-a93c-4698-a905-bde3703e87fc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:44.856270 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-aac54d04-a93c-4698-a905-bde3703e87fc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:44.886690 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aac54d04-a93c-4698-a905-bde3703e87fc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:44.887635 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aac54d04-a93c-4698-a905-bde3703e87fc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:44.888174 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aac54d04-a93c-4698-a905-bde3703e87fc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:44.889027 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aac54d04-a93c-4698-a905-bde3703e87fc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:44.890045 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aac54d04-a93c-4698-a905-bde3703e87fc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:44.890758 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aac54d04-a93c-4698-a905-bde3703e87fc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:45.000682 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1c93a7bc-4037-4c8b-a592-aaa5d2b63499 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343dddda044b8fa4eb797a4b64556a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbf416811f64df0b56656a0cf7778ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:45.009363 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-aac54d04-a93c-4698-a905-bde3703e87fc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.172629 Sep 24 20:58:45.015141 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1205/2419] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:44 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:58:45.020941 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c6f71434-d5ee-4254-9b4d-f0f325308fd1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:45.023483 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c6f71434-d5ee-4254-9b4d-f0f325308fd1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:45.027475 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1c93a7bc-4037-4c8b-a592-aaa5d2b63499 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3" status: 200 len: 1318 microversion: 2.1 time: 0.391774 Sep 24 20:58:45.035976 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6f71434-d5ee-4254-9b4d-f0f325308fd1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:45.036735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6f71434-d5ee-4254-9b4d-f0f325308fd1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:45.037340 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6f71434-d5ee-4254-9b4d-f0f325308fd1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:45.038220 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6f71434-d5ee-4254-9b4d-f0f325308fd1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:45.039165 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6f71434-d5ee-4254-9b4d-f0f325308fd1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:45.039812 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6f71434-d5ee-4254-9b4d-f0f325308fd1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:45.042367 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1215/2420] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:44 2022] GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3 => generated 1318 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:58:45.231026 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c6f71434-d5ee-4254-9b4d-f0f325308fd1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:45.239866 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c6f71434-d5ee-4254-9b4d-f0f325308fd1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1363 microversion: 2.1 time: 0.223449 Sep 24 20:58:45.252504 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1206/2421] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:45 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:45.276175 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-501aecf2-665a-4124-9852-1083251bf9d7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:45.276910 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-501aecf2-665a-4124-9852-1083251bf9d7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 0fa728d6-93b7-4c6f-b358-55f15038a503] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:45.293756 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-501aecf2-665a-4124-9852-1083251bf9d7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:45.301139 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-501aecf2-665a-4124-9852-1083251bf9d7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:45.301702 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-501aecf2-665a-4124-9852-1083251bf9d7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:45.314949 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-501aecf2-665a-4124-9852-1083251bf9d7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:45.322804 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-883006f0-bd54-48d3-a0a3-30bd2704235a tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:45.323460 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-883006f0-bd54-48d3-a0a3-30bd2704235a tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:45.331194 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-501aecf2-665a-4124-9852-1083251bf9d7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:45.332615 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-501aecf2-665a-4124-9852-1083251bf9d7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:45.343176 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-883006f0-bd54-48d3-a0a3-30bd2704235a tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:45.343684 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-883006f0-bd54-48d3-a0a3-30bd2704235a tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:45.344129 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-883006f0-bd54-48d3-a0a3-30bd2704235a tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:45.345535 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-883006f0-bd54-48d3-a0a3-30bd2704235a tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:45.345999 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-883006f0-bd54-48d3-a0a3-30bd2704235a tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:45.346429 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-883006f0-bd54-48d3-a0a3-30bd2704235a tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:45.893132 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-883006f0-bd54-48d3-a0a3-30bd2704235a tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:45.911009 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-883006f0-bd54-48d3-a0a3-30bd2704235a tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 200 len: 1354 microversion: 2.1 time: 0.592112 Sep 24 20:58:45.913115 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1207/2422] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:45 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 1354 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:58:45.931804 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7389c1f9-b7da-469c-b756-086816058a61 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:45.932687 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7389c1f9-b7da-469c-b756-086816058a61 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:45.945136 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7389c1f9-b7da-469c-b756-086816058a61 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:45.945966 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7389c1f9-b7da-469c-b756-086816058a61 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:45.948274 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7389c1f9-b7da-469c-b756-086816058a61 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:45.949313 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7389c1f9-b7da-469c-b756-086816058a61 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:45.949932 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7389c1f9-b7da-469c-b756-086816058a61 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:45.950528 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7389c1f9-b7da-469c-b756-086816058a61 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:45.962379 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-501aecf2-665a-4124-9852-1083251bf9d7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:45.965764 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:58:45.976092 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-501aecf2-665a-4124-9852-1083251bf9d7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503" status: 200 len: 1315 microversion: 2.1 time: 0.705689 Sep 24 20:58:45.977228 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1216/2423] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:45 2022] GET /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503 => generated 1315 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:45.982870 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7b0b31cb-e045-4519-a627-d15dc2895183 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b0c8d4280>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:46.057494 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7b0b31cb-e045-4519-a627-d15dc2895183 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625" status: 200 len: 1450 microversion: 2.1 time: 0.078713 Sep 24 20:58:46.058077 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1217/2424] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:45 2022] GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625 => generated 1450 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:46.066604 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a56479b6-8d4b-410e-b45e-e29148554a7e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:46.072350 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a56479b6-8d4b-410e-b45e-e29148554a7e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:46.102326 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a56479b6-8d4b-410e-b45e-e29148554a7e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:46.103745 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a56479b6-8d4b-410e-b45e-e29148554a7e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:46.105163 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a56479b6-8d4b-410e-b45e-e29148554a7e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:46.106336 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a56479b6-8d4b-410e-b45e-e29148554a7e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:46.117450 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a56479b6-8d4b-410e-b45e-e29148554a7e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:46.118409 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a56479b6-8d4b-410e-b45e-e29148554a7e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:46.226767 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a56479b6-8d4b-410e-b45e-e29148554a7e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.167217 Sep 24 20:58:46.228716 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1218/2425] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:46 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:58:46.240640 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-917f6c12-81fb-4bc9-8caf-7732c139818f tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:46.245088 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-917f6c12-81fb-4bc9-8caf-7732c139818f tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 72bfdb29-fd39-41a3-8314-624925dcd0b3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:46.264860 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-917f6c12-81fb-4bc9-8caf-7732c139818f tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:46.265516 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-917f6c12-81fb-4bc9-8caf-7732c139818f tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:46.267084 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-917f6c12-81fb-4bc9-8caf-7732c139818f tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:46.269196 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-917f6c12-81fb-4bc9-8caf-7732c139818f tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:46.272373 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-917f6c12-81fb-4bc9-8caf-7732c139818f tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:46.273144 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-917f6c12-81fb-4bc9-8caf-7732c139818f tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:46.554957 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7389c1f9-b7da-469c-b756-086816058a61 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:46.564455 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7389c1f9-b7da-469c-b756-086816058a61 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1513 microversion: 2.1 time: 0.648944 Sep 24 20:58:46.565588 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1208/2426] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:45 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1513 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:46.570377 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-95f8e067-f6e9-41ce-9a7d-ddef3648ac4a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:46.571251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-95f8e067-f6e9-41ce-9a7d-ddef3648ac4a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:46.579645 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-95f8e067-f6e9-41ce-9a7d-ddef3648ac4a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:46.580407 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-95f8e067-f6e9-41ce-9a7d-ddef3648ac4a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:46.580995 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-95f8e067-f6e9-41ce-9a7d-ddef3648ac4a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:46.581883 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-95f8e067-f6e9-41ce-9a7d-ddef3648ac4a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:46.582475 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-95f8e067-f6e9-41ce-9a7d-ddef3648ac4a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:46.583067 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-95f8e067-f6e9-41ce-9a7d-ddef3648ac4a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:46.586778 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-917f6c12-81fb-4bc9-8caf-7732c139818f tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343dddda044b8fa4eb797a4b64556a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbf416811f64df0b56656a0cf7778ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:46.597243 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-917f6c12-81fb-4bc9-8caf-7732c139818f tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3" status: 200 len: 1318 microversion: 2.1 time: 0.367262 Sep 24 20:58:46.614571 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1219/2427] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:46 2022] GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3 => generated 1318 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:46.614571 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-144a2b61-1e9f-46f9-a882-289eaa62f044 req-3ee23b17-1299-4185-8be1-24be8fb47dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fa728d6-93b7-4c6f-b358-55f15038a503", "tag": "66bcd8ff-8861-4663-b4ee-9d739fe215ea"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:58:46.624161 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-144a2b61-1e9f-46f9-a882-289eaa62f044 req-3ee23b17-1299-4185-8be1-24be8fb47dc8 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:46.624161 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-144a2b61-1e9f-46f9-a882-289eaa62f044 req-3ee23b17-1299-4185-8be1-24be8fb47dc8 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:46.624161 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-144a2b61-1e9f-46f9-a882-289eaa62f044 req-3ee23b17-1299-4185-8be1-24be8fb47dc8 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:46.649557 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-144a2b61-1e9f-46f9-a882-289eaa62f044 req-3ee23b17-1299-4185-8be1-24be8fb47dc8 service nova] Creating event network-changed:66bcd8ff-8861-4663-b4ee-9d739fe215ea for instance 0fa728d6-93b7-4c6f-b358-55f15038a503 on nch2-master-1 Sep 24 20:58:46.658839 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-144a2b61-1e9f-46f9-a882-289eaa62f044 req-3ee23b17-1299-4185-8be1-24be8fb47dc8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054265 Sep 24 20:58:46.659963 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1220/2428] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:58:46.940912 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-64301790-b678-42c7-9d29-0a2e1a1125ad tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:46.942385 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-64301790-b678-42c7-9d29-0a2e1a1125ad tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:46.953604 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-64301790-b678-42c7-9d29-0a2e1a1125ad tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:46.955376 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-64301790-b678-42c7-9d29-0a2e1a1125ad tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:46.956863 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-64301790-b678-42c7-9d29-0a2e1a1125ad tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:46.958524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-64301790-b678-42c7-9d29-0a2e1a1125ad tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:46.960994 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-64301790-b678-42c7-9d29-0a2e1a1125ad tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:46.962029 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-64301790-b678-42c7-9d29-0a2e1a1125ad tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:47.089549 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-95f8e067-f6e9-41ce-9a7d-ddef3648ac4a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:47.104085 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-95f8e067-f6e9-41ce-9a7d-ddef3648ac4a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1363 microversion: 2.1 time: 0.536820 Sep 24 20:58:47.122585 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1209/2429] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:46 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1363 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:47.128489 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b235373c-70f3-4d3e-bb10-baaf921ccc63 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:47.129104 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b235373c-70f3-4d3e-bb10-baaf921ccc63 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 0fa728d6-93b7-4c6f-b358-55f15038a503] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:47.135578 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b235373c-70f3-4d3e-bb10-baaf921ccc63 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:47.136317 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b235373c-70f3-4d3e-bb10-baaf921ccc63 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:47.137045 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b235373c-70f3-4d3e-bb10-baaf921ccc63 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:47.137934 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b235373c-70f3-4d3e-bb10-baaf921ccc63 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:47.138638 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b235373c-70f3-4d3e-bb10-baaf921ccc63 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:47.139245 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b235373c-70f3-4d3e-bb10-baaf921ccc63 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:47.324161 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-64301790-b678-42c7-9d29-0a2e1a1125ad tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:47.338172 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-64301790-b678-42c7-9d29-0a2e1a1125ad tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 200 len: 1802 microversion: 2.1 time: 0.403115 Sep 24 20:58:47.346757 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1221/2430] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:46 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 1802 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:58:47.348201 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e677ea0d-dc15-49a5-85b9-d8e483594bb8 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b07ed6820>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:47.401385 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b235373c-70f3-4d3e-bb10-baaf921ccc63 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:47.412157 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b235373c-70f3-4d3e-bb10-baaf921ccc63 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503" status: 200 len: 1315 microversion: 2.1 time: 0.287159 Sep 24 20:58:47.413245 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1210/2431] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:47 2022] GET /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503 => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:47.415052 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e677ea0d-dc15-49a5-85b9-d8e483594bb8 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625" status: 200 len: 1450 microversion: 2.1 time: 0.072585 Sep 24 20:58:47.423326 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1222/2432] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:47 2022] GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625 => generated 1450 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:47.427111 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e531bd91-ce98-4e51-b7b5-7ecd586213f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:47.428032 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-54c7f6e9-ef08-4a25-acda-48b1cc234c99 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:47.428541 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-54c7f6e9-ef08-4a25-acda-48b1cc234c99 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:47.430705 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e531bd91-ce98-4e51-b7b5-7ecd586213f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:47.434952 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54c7f6e9-ef08-4a25-acda-48b1cc234c99 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:47.435445 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54c7f6e9-ef08-4a25-acda-48b1cc234c99 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:47.435883 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54c7f6e9-ef08-4a25-acda-48b1cc234c99 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:47.436597 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54c7f6e9-ef08-4a25-acda-48b1cc234c99 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:47.438081 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e531bd91-ce98-4e51-b7b5-7ecd586213f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:47.438883 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54c7f6e9-ef08-4a25-acda-48b1cc234c99 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:47.439545 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e531bd91-ce98-4e51-b7b5-7ecd586213f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:47.439807 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54c7f6e9-ef08-4a25-acda-48b1cc234c99 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:47.440412 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e531bd91-ce98-4e51-b7b5-7ecd586213f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:47.441272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e531bd91-ce98-4e51-b7b5-7ecd586213f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:47.441876 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e531bd91-ce98-4e51-b7b5-7ecd586213f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:47.442730 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e531bd91-ce98-4e51-b7b5-7ecd586213f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:47.469128 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-54c7f6e9-ef08-4a25-acda-48b1cc234c99 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828/ips" status: 200 len: 216 microversion: 2.1 time: 0.044492 Sep 24 20:58:47.476970 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1223/2433] 10.222.0.52 () {58 vars in 1248 bytes} [Sat Sep 24 20:58:47 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828/ips => generated 216 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:58:47.482209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d31edec1-42de-4118-900b-81e33f90c221 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:47.482744 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d31edec1-42de-4118-900b-81e33f90c221 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:47.488006 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e531bd91-ce98-4e51-b7b5-7ecd586213f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.067306 Sep 24 20:58:47.488617 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1211/2434] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:47 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:58:47.491445 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d31edec1-42de-4118-900b-81e33f90c221 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:47.492353 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d31edec1-42de-4118-900b-81e33f90c221 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:47.493474 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d31edec1-42de-4118-900b-81e33f90c221 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:47.494487 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d31edec1-42de-4118-900b-81e33f90c221 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:47.494971 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d31edec1-42de-4118-900b-81e33f90c221 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:47.495569 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d31edec1-42de-4118-900b-81e33f90c221 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:47.528644 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d31edec1-42de-4118-900b-81e33f90c221 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:58:47.591548 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0b8aeb52-3894-4347-b908-53e1496e355c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:47.592166 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0b8aeb52-3894-4347-b908-53e1496e355c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:47.601597 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b8aeb52-3894-4347-b908-53e1496e355c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:47.602337 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b8aeb52-3894-4347-b908-53e1496e355c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:47.603050 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b8aeb52-3894-4347-b908-53e1496e355c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:47.608285 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b8aeb52-3894-4347-b908-53e1496e355c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:47.608750 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b8aeb52-3894-4347-b908-53e1496e355c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:47.609185 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b8aeb52-3894-4347-b908-53e1496e355c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:47.657952 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d31edec1-42de-4118-900b-81e33f90c221 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 204 len: 0 microversion: 2.1 time: 0.175777 Sep 24 20:58:47.659424 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1224/2435] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:58:47 2022] DELETE /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:58:47.667881 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6b23875e-a411-44f5-a44d-24347a13d16f tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:47.668734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6b23875e-a411-44f5-a44d-24347a13d16f tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 72bfdb29-fd39-41a3-8314-624925dcd0b3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:47.676585 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b23875e-a411-44f5-a44d-24347a13d16f tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:47.677231 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b23875e-a411-44f5-a44d-24347a13d16f tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:47.677866 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b23875e-a411-44f5-a44d-24347a13d16f tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:47.678735 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b23875e-a411-44f5-a44d-24347a13d16f tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:47.679315 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b23875e-a411-44f5-a44d-24347a13d16f tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:47.679966 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b23875e-a411-44f5-a44d-24347a13d16f tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:47.848264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0b8aeb52-3894-4347-b908-53e1496e355c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:47.861589 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0b8aeb52-3894-4347-b908-53e1496e355c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1513 microversion: 2.1 time: 0.273767 Sep 24 20:58:47.866239 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1212/2436] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:47 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1513 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:58:47.874905 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c9a66afe-68eb-4d19-b04c-0b6274c08b2c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:47.878886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c9a66afe-68eb-4d19-b04c-0b6274c08b2c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:47.890611 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c9a66afe-68eb-4d19-b04c-0b6274c08b2c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:47.892689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c9a66afe-68eb-4d19-b04c-0b6274c08b2c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:47.895369 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c9a66afe-68eb-4d19-b04c-0b6274c08b2c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:47.897096 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c9a66afe-68eb-4d19-b04c-0b6274c08b2c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:47.897760 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c9a66afe-68eb-4d19-b04c-0b6274c08b2c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:47.898600 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c9a66afe-68eb-4d19-b04c-0b6274c08b2c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:47.923010 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6b23875e-a411-44f5-a44d-24347a13d16f tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343dddda044b8fa4eb797a4b64556a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbf416811f64df0b56656a0cf7778ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:47.931430 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6b23875e-a411-44f5-a44d-24347a13d16f tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3" status: 200 len: 1468 microversion: 2.1 time: 0.267683 Sep 24 20:58:47.935805 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1225/2437] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:47 2022] GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3 => generated 1468 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:48.113888 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c9a66afe-68eb-4d19-b04c-0b6274c08b2c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:48.122873 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c9a66afe-68eb-4d19-b04c-0b6274c08b2c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 200 len: 1808 microversion: 2.1 time: 0.254439 Sep 24 20:58:48.130564 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1213/2438] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:47 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 1808 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:48.131239 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7fe49689-8119-4a22-9d4a-0f6b3aa8ce3b tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-319540249", "block_migration": true, "disk_over_commit": false}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:58:48.132254 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-3072e5a5-ac78-44f6-b0f3-252e9840c2b6 req-10d50c7a-378a-457a-994e-42c38bbe2a3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d546302-deb3-47c6-b9fd-3155ced00883", "name": "network-vif-plugged", "status": "completed", "tag": "56949465-71b8-45bb-b1d2-4b934bfc9714"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:58:48.133756 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7fe49689-8119-4a22-9d4a-0f6b3aa8ce3b tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] [instance: 72bfdb29-fd39-41a3-8314-624925dcd0b3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:48.142889 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-3072e5a5-ac78-44f6-b0f3-252e9840c2b6 req-10d50c7a-378a-457a-994e-42c38bbe2a3e service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:48.143471 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-3072e5a5-ac78-44f6-b0f3-252e9840c2b6 req-10d50c7a-378a-457a-994e-42c38bbe2a3e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:48.143972 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-3072e5a5-ac78-44f6-b0f3-252e9840c2b6 req-10d50c7a-378a-457a-994e-42c38bbe2a3e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:48.144069 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7fe49689-8119-4a22-9d4a-0f6b3aa8ce3b tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:48.144495 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7fe49689-8119-4a22-9d4a-0f6b3aa8ce3b tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:48.144935 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7fe49689-8119-4a22-9d4a-0f6b3aa8ce3b tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:48.145645 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7fe49689-8119-4a22-9d4a-0f6b3aa8ce3b tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:48.146099 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7fe49689-8119-4a22-9d4a-0f6b3aa8ce3b tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:48.156548 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7fe49689-8119-4a22-9d4a-0f6b3aa8ce3b tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:48.156723 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-3072e5a5-ac78-44f6-b0f3-252e9840c2b6 req-10d50c7a-378a-457a-994e-42c38bbe2a3e service nova] Creating event network-vif-plugged:56949465-71b8-45bb-b1d2-4b934bfc9714 for instance 0d546302-deb3-47c6-b9fd-3155ced00883 on nch1-master-1 Sep 24 20:58:48.162127 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-3072e5a5-ac78-44f6-b0f3-252e9840c2b6 req-10d50c7a-378a-457a-994e-42c38bbe2a3e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033776 Sep 24 20:58:48.163291 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1214/2439] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:58:48.169330 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3fe86ba6-e659-4af4-8287-e5c8e9b0df1c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:48.170042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3fe86ba6-e659-4af4-8287-e5c8e9b0df1c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:48.176985 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3fe86ba6-e659-4af4-8287-e5c8e9b0df1c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:48.177480 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3fe86ba6-e659-4af4-8287-e5c8e9b0df1c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:48.177927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3fe86ba6-e659-4af4-8287-e5c8e9b0df1c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:48.178674 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3fe86ba6-e659-4af4-8287-e5c8e9b0df1c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:48.179139 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3fe86ba6-e659-4af4-8287-e5c8e9b0df1c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:48.179569 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3fe86ba6-e659-4af4-8287-e5c8e9b0df1c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:48.186340 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-7fe49689-8119-4a22-9d4a-0f6b3aa8ce3b tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Lazy-loading 'flavor' on Instance uuid 72bfdb29-fd39-41a3-8314-624925dcd0b3 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:58:48.214196 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7fe49689-8119-4a22-9d4a-0f6b3aa8ce3b tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] [instance: 72bfdb29-fd39-41a3-8314-624925dcd0b3] Going to try to live migrate instance to tempest-host-319540249 {{(pid=140517) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 24 20:58:48.226482 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-7fe49689-8119-4a22-9d4a-0f6b3aa8ce3b tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] HTTP exception thrown: Compute host tempest-host-319540249 could not be found. Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7fe49689-8119-4a22-9d4a-0f6b3aa8ce3b tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Request method failure captured: Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3/action HTTP/1.1 Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 106 Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL29piLlF2vu8MknmtP_c8M-92ApNNfBZTmM9J0IlekXc8X-lRB9_duTsfZSLSfYiGPz4-kYgL9BEhcsMKd3cGWEcpuRQloBR69VKPVp34lGE7qYKqDmF5kunqHGwMgNgcirRiQovJyrUoXp0HMu_kS-dZxsRO4gnu-FiZdK05jBrIv0 Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: f3cec66ec0674490b3eaa3f40338f61e Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-LiveMigrationNegativeTest-1943781320 Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: X-Role: admin,reader,member Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: admin,reader,member Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3cec66ec0674490b3eaa3f40338f61e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f3cec66ec0674490b3eaa3f40338f61e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f3cec66ec0674490b3eaa3f40338f61e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3cec66ec0674490b3eaa3f40338f61e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-LiveMigrationNegativeTest-1943781320 Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: f3cec66ec0674490b3eaa3f40338f61e Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1943781320 Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-LiveMigrationNegativeTest-1943781320-project-admin Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: b5dab333d06f4c4c997e9b771a72e269 Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-LiveMigrationNegativeTest-1943781320-project-admin Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: {"os-migrateLive": {"host": "tempest-host-319540249", "block_migration": true, "disk_over_commit": false}} Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: exception: Compute host tempest-host-319540249 could not be found. Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '72bfdb29-fd39-41a3-8314-624925dcd0b3', 'body': {'os-migrateLive': {'host': 'tempest-host-319540249', 'block_migration': True, 'disk_over_commit': False}}} Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Sep 24 20:58:48.237827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-319540249 could not be found. Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-319540249 could not be found. Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-319540249 could not be found. Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7fe49689-8119-4a22-9d4a-0f6b3aa8ce3b tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Returning 400 to user: Compute host tempest-host-319540249 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7fe49689-8119-4a22-9d4a-0f6b3aa8ce3b tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3/action" status: 400 len: 99 microversion: 2.1 time: 0.281990 Sep 24 20:58:48.241211 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1226/2440] 10.222.0.52 () {60 vars in 1279 bytes} [Sat Sep 24 20:58:47 2022] POST /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3/action => generated 99 bytes in 283 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 24 20:58:48.252902 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4e3f5a5c-7270-48e4-abe8-dfcb01c9241a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:48.252902 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4e3f5a5c-7270-48e4-abe8-dfcb01c9241a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 72bfdb29-fd39-41a3-8314-624925dcd0b3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:48.259610 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e3f5a5c-7270-48e4-abe8-dfcb01c9241a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:48.260179 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e3f5a5c-7270-48e4-abe8-dfcb01c9241a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:48.260689 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e3f5a5c-7270-48e4-abe8-dfcb01c9241a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:48.261470 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e3f5a5c-7270-48e4-abe8-dfcb01c9241a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:48.263775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e3f5a5c-7270-48e4-abe8-dfcb01c9241a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:48.263775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e3f5a5c-7270-48e4-abe8-dfcb01c9241a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:48.396776 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3fe86ba6-e659-4af4-8287-e5c8e9b0df1c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:48.411697 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3fe86ba6-e659-4af4-8287-e5c8e9b0df1c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1363 microversion: 2.1 time: 0.247007 Sep 24 20:58:48.413027 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1215/2441] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:48 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:48.430534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1e1b0750-404c-4188-8f52-8f90c36755d6 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b111ce700>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:48.469187 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4e3f5a5c-7270-48e4-abe8-dfcb01c9241a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343dddda044b8fa4eb797a4b64556a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbf416811f64df0b56656a0cf7778ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:48.477909 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4e3f5a5c-7270-48e4-abe8-dfcb01c9241a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3" status: 200 len: 1468 microversion: 2.1 time: 0.230428 Sep 24 20:58:48.478510 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1227/2442] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:48 2022] GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3 => generated 1468 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:48.490654 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bb739d08-3554-4d49-a3b3-498bd932c027 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:48.490654 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bb739d08-3554-4d49-a3b3-498bd932c027 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 0fa728d6-93b7-4c6f-b358-55f15038a503] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:48.491792 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb739d08-3554-4d49-a3b3-498bd932c027 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:48.492298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb739d08-3554-4d49-a3b3-498bd932c027 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:48.492883 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb739d08-3554-4d49-a3b3-498bd932c027 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:48.495171 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1e1b0750-404c-4188-8f52-8f90c36755d6 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625" status: 200 len: 1450 microversion: 2.1 time: 0.068098 Sep 24 20:58:48.495352 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb739d08-3554-4d49-a3b3-498bd932c027 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:48.495815 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb739d08-3554-4d49-a3b3-498bd932c027 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:48.496354 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb739d08-3554-4d49-a3b3-498bd932c027 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:48.496996 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1216/2443] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:48 2022] GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625 => generated 1450 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:58:48.503575 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-26cd6cd8-2bd6-498a-8d5d-b12515b5e2e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:48.506001 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-26cd6cd8-2bd6-498a-8d5d-b12515b5e2e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:48.515834 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26cd6cd8-2bd6-498a-8d5d-b12515b5e2e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:48.519626 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26cd6cd8-2bd6-498a-8d5d-b12515b5e2e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:48.535215 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26cd6cd8-2bd6-498a-8d5d-b12515b5e2e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:48.536433 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26cd6cd8-2bd6-498a-8d5d-b12515b5e2e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:48.539807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26cd6cd8-2bd6-498a-8d5d-b12515b5e2e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:48.541031 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26cd6cd8-2bd6-498a-8d5d-b12515b5e2e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:48.603025 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-26cd6cd8-2bd6-498a-8d5d-b12515b5e2e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.103681 Sep 24 20:58:48.605299 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1217/2444] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:48 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:58:48.736186 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bb739d08-3554-4d49-a3b3-498bd932c027 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:48.740574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8c0ba0a8-1cd0-4823-8b9c-661b2c88d6a9 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-661332259", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:58:48.744121 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bb739d08-3554-4d49-a3b3-498bd932c027 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503" status: 200 len: 1315 microversion: 2.1 time: 0.264599 Sep 24 20:58:48.744892 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1228/2445] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:48 2022] GET /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503 => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:48.813319 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-8c0ba0a8-1cd0-4823-8b9c-661b2c88d6a9 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] validate_networks() for None {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:58:48.889935 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3334bd15-cc71-4f98-920f-ced63966ef90 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:48.890834 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3334bd15-cc71-4f98-920f-ced63966ef90 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:48.900970 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3334bd15-cc71-4f98-920f-ced63966ef90 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:48.903007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3334bd15-cc71-4f98-920f-ced63966ef90 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:48.903540 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3334bd15-cc71-4f98-920f-ced63966ef90 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:48.906035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3334bd15-cc71-4f98-920f-ced63966ef90 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:48.908958 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3334bd15-cc71-4f98-920f-ced63966ef90 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:48.910215 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3334bd15-cc71-4f98-920f-ced63966ef90 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:49.228336 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-8c0ba0a8-1cd0-4823-8b9c-661b2c88d6a9 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:58:49.228336 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-8c0ba0a8-1cd0-4823-8b9c-661b2c88d6a9 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:58:49.228336 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-8c0ba0a8-1cd0-4823-8b9c-661b2c88d6a9 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:58:49.228336 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-8c0ba0a8-1cd0-4823-8b9c-661b2c88d6a9 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:58:49.228336 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-8c0ba0a8-1cd0-4823-8b9c-661b2c88d6a9 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:58:49.243284 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c0ba0a8-1cd0-4823-8b9c-661b2c88d6a9 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:49.243511 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c0ba0a8-1cd0-4823-8b9c-661b2c88d6a9 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:49.243947 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c0ba0a8-1cd0-4823-8b9c-661b2c88d6a9 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:49.244771 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c0ba0a8-1cd0-4823-8b9c-661b2c88d6a9 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:49.245277 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c0ba0a8-1cd0-4823-8b9c-661b2c88d6a9 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:49.250710 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c0ba0a8-1cd0-4823-8b9c-661b2c88d6a9 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:49.257199 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3334bd15-cc71-4f98-920f-ced63966ef90 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:49.273173 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-8c0ba0a8-1cd0-4823-8b9c-661b2c88d6a9 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Getting quotas for project ffbf416811f64df0b56656a0cf7778ce. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:58:49.275031 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3334bd15-cc71-4f98-920f-ced63966ef90 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1513 microversion: 2.1 time: 0.388902 Sep 24 20:58:49.275804 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1229/2446] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:48 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1513 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:49.279399 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-8c0ba0a8-1cd0-4823-8b9c-661b2c88d6a9 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Getting quotas for user 1a343dddda044b8fa4eb797a4b64556a and project ffbf416811f64df0b56656a0cf7778ce. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:58:49.284598 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3beaae0a-b865-4e9d-940f-84686272fadf tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:49.289925 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3beaae0a-b865-4e9d-940f-84686272fadf tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:49.301195 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3beaae0a-b865-4e9d-940f-84686272fadf tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:49.301846 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3beaae0a-b865-4e9d-940f-84686272fadf tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:49.302382 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3beaae0a-b865-4e9d-940f-84686272fadf tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:49.303271 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3beaae0a-b865-4e9d-940f-84686272fadf tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:49.303892 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3beaae0a-b865-4e9d-940f-84686272fadf tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:49.304388 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3beaae0a-b865-4e9d-940f-84686272fadf tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:49.306631 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8c0ba0a8-1cd0-4823-8b9c-661b2c88d6a9 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:58:49.309827 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8c0ba0a8-1cd0-4823-8b9c-661b2c88d6a9 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 5ae40e24-5532-41d3-8913-16ca4adaf7a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:58:49.384808 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8c0ba0a8-1cd0-4823-8b9c-661b2c88d6a9 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.649998 Sep 24 20:58:49.392627 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1218/2447] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:58:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:58:49.399682 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-16ca9c27-9929-4aa1-b797-0399450d9da8 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:49.400326 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-16ca9c27-9929-4aa1-b797-0399450d9da8 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 5ae40e24-5532-41d3-8913-16ca4adaf7a3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:49.504721 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-16ca9c27-9929-4aa1-b797-0399450d9da8 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343dddda044b8fa4eb797a4b64556a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbf416811f64df0b56656a0cf7778ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:49.523415 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-16ca9c27-9929-4aa1-b797-0399450d9da8 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3" status: 200 len: 1218 microversion: 2.1 time: 0.129255 Sep 24 20:58:49.538676 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1219/2448] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:49 2022] GET /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3 => generated 1218 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:49.547753 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e4cd76f2-a487-4a2d-b9ad-33e26499b9b1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:49.548406 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e4cd76f2-a487-4a2d-b9ad-33e26499b9b1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:49.571357 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e4cd76f2-a487-4a2d-b9ad-33e26499b9b1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:49.571860 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e4cd76f2-a487-4a2d-b9ad-33e26499b9b1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:49.572305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e4cd76f2-a487-4a2d-b9ad-33e26499b9b1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:49.573181 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e4cd76f2-a487-4a2d-b9ad-33e26499b9b1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:49.576790 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e4cd76f2-a487-4a2d-b9ad-33e26499b9b1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:49.577276 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e4cd76f2-a487-4a2d-b9ad-33e26499b9b1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:49.735806 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3beaae0a-b865-4e9d-940f-84686272fadf tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:49.745172 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3beaae0a-b865-4e9d-940f-84686272fadf tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 200 len: 1808 microversion: 2.1 time: 0.467521 Sep 24 20:58:49.767030 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1230/2449] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:49 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 1808 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:49.773197 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-38811478-c737-451d-861c-875c1e7138c1 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b07dd1c10>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:49.836408 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-38811478-c737-451d-861c-875c1e7138c1 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625" status: 200 len: 1450 microversion: 2.1 time: 0.067534 Sep 24 20:58:49.847207 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1231/2450] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:49 2022] GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625 => generated 1450 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:49.852681 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-76e91cbe-5131-4b5f-bded-8854c88b4a3c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:49.855097 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-76e91cbe-5131-4b5f-bded-8854c88b4a3c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:49.866366 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76e91cbe-5131-4b5f-bded-8854c88b4a3c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:49.866366 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76e91cbe-5131-4b5f-bded-8854c88b4a3c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:49.866366 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76e91cbe-5131-4b5f-bded-8854c88b4a3c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:49.866366 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76e91cbe-5131-4b5f-bded-8854c88b4a3c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:49.866366 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76e91cbe-5131-4b5f-bded-8854c88b4a3c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:49.866366 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76e91cbe-5131-4b5f-bded-8854c88b4a3c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:49.908455 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-76e91cbe-5131-4b5f-bded-8854c88b4a3c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.058705 Sep 24 20:58:49.909979 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1232/2451] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:49 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:58:49.915059 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-17642a46-e226-4f62-a529-abc1d69b3a25 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:49.916004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-17642a46-e226-4f62-a529-abc1d69b3a25 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 0fa728d6-93b7-4c6f-b358-55f15038a503] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:49.925189 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-17642a46-e226-4f62-a529-abc1d69b3a25 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:49.926042 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-17642a46-e226-4f62-a529-abc1d69b3a25 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:49.926762 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-17642a46-e226-4f62-a529-abc1d69b3a25 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:49.927798 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-17642a46-e226-4f62-a529-abc1d69b3a25 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:49.928823 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-17642a46-e226-4f62-a529-abc1d69b3a25 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:49.929571 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-17642a46-e226-4f62-a529-abc1d69b3a25 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:50.314687 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e4cd76f2-a487-4a2d-b9ad-33e26499b9b1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:50.324297 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e4cd76f2-a487-4a2d-b9ad-33e26499b9b1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1363 microversion: 2.1 time: 0.784321 Sep 24 20:58:50.326590 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1220/2452] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:49 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1363 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:50.332059 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-22bae667-26a6-4c79-8c0c-0a4811d4c6d4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:50.332966 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-22bae667-26a6-4c79-8c0c-0a4811d4c6d4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:50.347613 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22bae667-26a6-4c79-8c0c-0a4811d4c6d4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:50.348114 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22bae667-26a6-4c79-8c0c-0a4811d4c6d4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:50.348559 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22bae667-26a6-4c79-8c0c-0a4811d4c6d4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:50.349282 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22bae667-26a6-4c79-8c0c-0a4811d4c6d4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:50.349773 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22bae667-26a6-4c79-8c0c-0a4811d4c6d4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:50.350395 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22bae667-26a6-4c79-8c0c-0a4811d4c6d4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:50.546534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-17642a46-e226-4f62-a529-abc1d69b3a25 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:50.558337 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-17642a46-e226-4f62-a529-abc1d69b3a25 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503" status: 200 len: 1315 microversion: 2.1 time: 0.646839 Sep 24 20:58:50.559184 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1233/2453] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:49 2022] GET /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503 => generated 1315 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:50.565060 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-983e00c1-455d-4984-abba-6c2e010bd461 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:50.566069 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-983e00c1-455d-4984-abba-6c2e010bd461 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 5ae40e24-5532-41d3-8913-16ca4adaf7a3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:50.574274 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-983e00c1-455d-4984-abba-6c2e010bd461 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:50.575729 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-983e00c1-455d-4984-abba-6c2e010bd461 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:50.576571 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-983e00c1-455d-4984-abba-6c2e010bd461 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:50.577776 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-983e00c1-455d-4984-abba-6c2e010bd461 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:50.578251 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-983e00c1-455d-4984-abba-6c2e010bd461 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:50.578729 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-983e00c1-455d-4984-abba-6c2e010bd461 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:50.728044 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-983e00c1-455d-4984-abba-6c2e010bd461 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343dddda044b8fa4eb797a4b64556a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbf416811f64df0b56656a0cf7778ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:50.743109 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-983e00c1-455d-4984-abba-6c2e010bd461 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3" status: 200 len: 1270 microversion: 2.1 time: 0.182712 Sep 24 20:58:50.758891 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1234/2454] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:50 2022] GET /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3 => generated 1270 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:50.777393 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-22bae667-26a6-4c79-8c0c-0a4811d4c6d4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:50.789064 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d4549b83-6729-4415-8e8f-8c1383a778b7 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:50.790717 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d4549b83-6729-4415-8e8f-8c1383a778b7 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:50.800832 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-22bae667-26a6-4c79-8c0c-0a4811d4c6d4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1513 microversion: 2.1 time: 0.472967 Sep 24 20:58:50.801451 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1221/2455] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:50 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1513 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:50.819637 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d4549b83-6729-4415-8e8f-8c1383a778b7 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:50.820401 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d4549b83-6729-4415-8e8f-8c1383a778b7 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:50.821018 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d4549b83-6729-4415-8e8f-8c1383a778b7 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:50.821900 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d4549b83-6729-4415-8e8f-8c1383a778b7 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:50.822545 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d4549b83-6729-4415-8e8f-8c1383a778b7 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:50.823601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d4549b83-6729-4415-8e8f-8c1383a778b7 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:50.850653 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:58:50.853966 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-903155e4-f78e-46a0-95d7-6b68c6169b31 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b11155040>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:50.911421 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-903155e4-f78e-46a0-95d7-6b68c6169b31 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625" status: 200 len: 1450 microversion: 2.1 time: 0.062159 Sep 24 20:58:50.912629 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1222/2456] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:50 2022] GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625 => generated 1450 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:50.921616 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-72b05818-268d-48f9-9c9e-c8ebe93d087a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:50.924710 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-72b05818-268d-48f9-9c9e-c8ebe93d087a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:50.931432 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72b05818-268d-48f9-9c9e-c8ebe93d087a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:50.932176 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72b05818-268d-48f9-9c9e-c8ebe93d087a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:50.932814 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72b05818-268d-48f9-9c9e-c8ebe93d087a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:50.933705 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72b05818-268d-48f9-9c9e-c8ebe93d087a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:50.934345 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72b05818-268d-48f9-9c9e-c8ebe93d087a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:50.935834 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72b05818-268d-48f9-9c9e-c8ebe93d087a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:50.980040 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-72b05818-268d-48f9-9c9e-c8ebe93d087a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.062528 Sep 24 20:58:50.981465 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1223/2457] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:50 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 20:58:51.025856 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=4 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:58:51.062423 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=16 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:58:51.139582 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d4549b83-6729-4415-8e8f-8c1383a778b7 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:51.153006 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d4549b83-6729-4415-8e8f-8c1383a778b7 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 200 len: 1808 microversion: 2.1 time: 0.380474 Sep 24 20:58:51.154609 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1235/2458] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:50 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 1808 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:51.263363 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-7eb6d8b7-9689-49bf-8fbf-4bc662a9ac01 req-4486c3bd-b2cc-483a-acce-3e282081aaf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c394113-a640-4199-80e0-1316dd1b2828", "name": "network-vif-deleted", "tag": "a95c393d-6869-46f3-abf0-a9a01e228621"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:58:51.290292 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-7eb6d8b7-9689-49bf-8fbf-4bc662a9ac01 req-4486c3bd-b2cc-483a-acce-3e282081aaf2 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:51.291119 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-7eb6d8b7-9689-49bf-8fbf-4bc662a9ac01 req-4486c3bd-b2cc-483a-acce-3e282081aaf2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:51.291708 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-7eb6d8b7-9689-49bf-8fbf-4bc662a9ac01 req-4486c3bd-b2cc-483a-acce-3e282081aaf2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:51.296956 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:58:51.323984 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-7eb6d8b7-9689-49bf-8fbf-4bc662a9ac01 req-4486c3bd-b2cc-483a-acce-3e282081aaf2 service nova] Creating event network-vif-deleted:a95c393d-6869-46f3-abf0-a9a01e228621 for instance 1c394113-a640-4199-80e0-1316dd1b2828 on nch1-master-1 Sep 24 20:58:51.339971 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-7eb6d8b7-9689-49bf-8fbf-4bc662a9ac01 req-4486c3bd-b2cc-483a-acce-3e282081aaf2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081608 Sep 24 20:58:51.340593 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1224/2459] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:58:51.354118 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-75e4d160-6768-472b-8831-0d29f15bee45 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:51.357126 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-75e4d160-6768-472b-8831-0d29f15bee45 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:51.372808 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75e4d160-6768-472b-8831-0d29f15bee45 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:51.373766 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75e4d160-6768-472b-8831-0d29f15bee45 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:51.374389 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75e4d160-6768-472b-8831-0d29f15bee45 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:51.375513 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75e4d160-6768-472b-8831-0d29f15bee45 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:51.377214 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75e4d160-6768-472b-8831-0d29f15bee45 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:51.380289 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75e4d160-6768-472b-8831-0d29f15bee45 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:51.583085 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-77baba0a-2436-4684-9471-0a5d3bc63ea5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:51.583842 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-77baba0a-2436-4684-9471-0a5d3bc63ea5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 0fa728d6-93b7-4c6f-b358-55f15038a503] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:51.602476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-77baba0a-2436-4684-9471-0a5d3bc63ea5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:51.603005 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-77baba0a-2436-4684-9471-0a5d3bc63ea5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:51.603713 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-77baba0a-2436-4684-9471-0a5d3bc63ea5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:51.604731 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-77baba0a-2436-4684-9471-0a5d3bc63ea5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:51.605495 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-77baba0a-2436-4684-9471-0a5d3bc63ea5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:51.606143 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-77baba0a-2436-4684-9471-0a5d3bc63ea5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:51.650482 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-75e4d160-6768-472b-8831-0d29f15bee45 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:51.662692 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-75e4d160-6768-472b-8831-0d29f15bee45 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1550 microversion: 2.1 time: 0.317281 Sep 24 20:58:51.663379 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1236/2460] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:51 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1550 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:51.686119 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9f67f2c9-9a3b-406c-aead-19f5921034d8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:51.686828 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9f67f2c9-9a3b-406c-aead-19f5921034d8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:51.694635 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f67f2c9-9a3b-406c-aead-19f5921034d8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:51.695357 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f67f2c9-9a3b-406c-aead-19f5921034d8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:51.695791 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f67f2c9-9a3b-406c-aead-19f5921034d8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:51.697893 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f67f2c9-9a3b-406c-aead-19f5921034d8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:51.698651 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f67f2c9-9a3b-406c-aead-19f5921034d8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:51.699252 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f67f2c9-9a3b-406c-aead-19f5921034d8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:51.842994 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9f67f2c9-9a3b-406c-aead-19f5921034d8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.160637 Sep 24 20:58:51.843560 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1237/2461] 10.222.0.52 () {58 vars in 1275 bytes} [Sat Sep 24 20:58:51 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/os-interface => generated 284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:58:51.848283 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b6a1431c-871d-4610-a17f-8392b68465c1 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:51.848908 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b6a1431c-871d-4610-a17f-8392b68465c1 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 5ae40e24-5532-41d3-8913-16ca4adaf7a3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:51.863269 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b6a1431c-871d-4610-a17f-8392b68465c1 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:51.864100 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b6a1431c-871d-4610-a17f-8392b68465c1 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:51.865402 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b6a1431c-871d-4610-a17f-8392b68465c1 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:51.867367 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b6a1431c-871d-4610-a17f-8392b68465c1 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:51.868161 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b6a1431c-871d-4610-a17f-8392b68465c1 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:51.868799 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b6a1431c-871d-4610-a17f-8392b68465c1 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:51.983882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-77baba0a-2436-4684-9471-0a5d3bc63ea5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:51.993387 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-77baba0a-2436-4684-9471-0a5d3bc63ea5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503" status: 200 len: 1315 microversion: 2.1 time: 0.414977 Sep 24 20:58:52.007579 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1225/2462] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:51 2022] GET /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503 => generated 1315 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:58:52.017227 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-79fe510a-95e7-4f8b-82c8-4bd46de69837 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:52.018082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-79fe510a-95e7-4f8b-82c8-4bd46de69837 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:52.025913 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-79fe510a-95e7-4f8b-82c8-4bd46de69837 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:52.026655 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-79fe510a-95e7-4f8b-82c8-4bd46de69837 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:52.027282 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-79fe510a-95e7-4f8b-82c8-4bd46de69837 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:52.032438 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-79fe510a-95e7-4f8b-82c8-4bd46de69837 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:52.033032 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-79fe510a-95e7-4f8b-82c8-4bd46de69837 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:52.033573 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-79fe510a-95e7-4f8b-82c8-4bd46de69837 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:52.427919 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b6a1431c-871d-4610-a17f-8392b68465c1 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343dddda044b8fa4eb797a4b64556a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbf416811f64df0b56656a0cf7778ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:52.441705 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b6a1431c-871d-4610-a17f-8392b68465c1 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3" status: 200 len: 1318 microversion: 2.1 time: 0.596987 Sep 24 20:58:52.452274 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1238/2463] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:51 2022] GET /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3 => generated 1318 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:52.454465 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5b8abfec-ed07-4c64-b791-b563fdc17d19 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b07ddd820>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:52.588525 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-79fe510a-95e7-4f8b-82c8-4bd46de69837 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:52.594356 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5b8abfec-ed07-4c64-b791-b563fdc17d19 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625" status: 200 len: 1459 microversion: 2.1 time: 0.148955 Sep 24 20:58:52.600873 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1239/2464] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:52 2022] GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625 => generated 1459 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:52.613456 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-79fe510a-95e7-4f8b-82c8-4bd46de69837 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1513 microversion: 2.1 time: 0.604088 Sep 24 20:58:52.615952 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1226/2465] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:52 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1513 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:52.617637 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-35ff3aac-4557-43eb-9f92-ad935d892eff req-539331bc-be20-4a4e-967d-568caa131100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c394113-a640-4199-80e0-1316dd1b2828", "name": "network-vif-unplugged", "status": "completed", "tag": "356ffb26-b574-4bd3-8e28-72fc211fb860"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:58:52.628499 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e5eaa55c-701b-4840-99c6-8da414d790dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:52.647819 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e5eaa55c-701b-4840-99c6-8da414d790dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:52.664689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e5eaa55c-701b-4840-99c6-8da414d790dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:52.665116 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e5eaa55c-701b-4840-99c6-8da414d790dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:52.665335 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-35ff3aac-4557-43eb-9f92-ad935d892eff req-539331bc-be20-4a4e-967d-568caa131100 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:52.665669 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e5eaa55c-701b-4840-99c6-8da414d790dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:52.666590 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e5eaa55c-701b-4840-99c6-8da414d790dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:52.666802 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-35ff3aac-4557-43eb-9f92-ad935d892eff req-539331bc-be20-4a4e-967d-568caa131100 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:52.667248 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-35ff3aac-4557-43eb-9f92-ad935d892eff req-539331bc-be20-4a4e-967d-568caa131100 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:52.667615 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e5eaa55c-701b-4840-99c6-8da414d790dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:52.668196 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e5eaa55c-701b-4840-99c6-8da414d790dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:52.687541 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-35ff3aac-4557-43eb-9f92-ad935d892eff req-539331bc-be20-4a4e-967d-568caa131100 service nova] Creating event network-vif-unplugged:356ffb26-b574-4bd3-8e28-72fc211fb860 for instance 1c394113-a640-4199-80e0-1316dd1b2828 on nch1-master-1 Sep 24 20:58:52.695249 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-35ff3aac-4557-43eb-9f92-ad935d892eff req-539331bc-be20-4a4e-967d-568caa131100 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090714 Sep 24 20:58:52.696092 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1240/2466] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:58:52.706060 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a942c060-cc8c-4ba4-b2c6-fdedb998e66d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:52.707700 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a942c060-cc8c-4ba4-b2c6-fdedb998e66d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:52.715935 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a942c060-cc8c-4ba4-b2c6-fdedb998e66d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:52.716669 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a942c060-cc8c-4ba4-b2c6-fdedb998e66d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:52.717257 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a942c060-cc8c-4ba4-b2c6-fdedb998e66d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:52.718126 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a942c060-cc8c-4ba4-b2c6-fdedb998e66d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:52.718982 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a942c060-cc8c-4ba4-b2c6-fdedb998e66d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:52.719935 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a942c060-cc8c-4ba4-b2c6-fdedb998e66d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:52.749529 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e5eaa55c-701b-4840-99c6-8da414d790dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.132241 Sep 24 20:58:52.755383 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1227/2467] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:52 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:58:52.760639 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4483cdc9-1686-4d10-b11a-aceabc821ad4 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b10ff70d0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:52.812507 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4483cdc9-1686-4d10-b11a-aceabc821ad4 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625" status: 200 len: 1459 microversion: 2.1 time: 0.055865 Sep 24 20:58:52.813398 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1228/2468] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:52 2022] GET /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625 => generated 1459 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:52.828345 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3cb8ae07-cdb8-471c-91b4-495dd3beda2c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:52.829369 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3cb8ae07-cdb8-471c-91b4-495dd3beda2c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 8f800d64-00f6-4135-8090-c95d84acd232] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:52.836778 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3cb8ae07-cdb8-471c-91b4-495dd3beda2c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:52.837983 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3cb8ae07-cdb8-471c-91b4-495dd3beda2c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:52.838556 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3cb8ae07-cdb8-471c-91b4-495dd3beda2c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:52.839367 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3cb8ae07-cdb8-471c-91b4-495dd3beda2c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:52.839895 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3cb8ae07-cdb8-471c-91b4-495dd3beda2c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:52.840419 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3cb8ae07-cdb8-471c-91b4-495dd3beda2c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:53.239042 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a942c060-cc8c-4ba4-b2c6-fdedb998e66d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:53.259056 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a942c060-cc8c-4ba4-b2c6-fdedb998e66d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 200 len: 1609 microversion: 2.1 time: 0.560636 Sep 24 20:58:53.279514 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3cb8ae07-cdb8-471c-91b4-495dd3beda2c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00585dbe7f814eeebda43417ca1d0ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265d7d88bb6f45708203ea74df8f3214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:53.280791 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1241/2469] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:52 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 1609 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:53.287805 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3cb8ae07-cdb8-471c-91b4-495dd3beda2c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232" status: 200 len: 1468 microversion: 2.1 time: 0.463933 Sep 24 20:58:53.290744 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1229/2470] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:52 2022] GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232 => generated 1468 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:53.291656 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-75d6e2a2-98b8-48f6-9ded-b7abb26760bb tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:53.292536 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-75d6e2a2-98b8-48f6-9ded-b7abb26760bb tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 0fa728d6-93b7-4c6f-b358-55f15038a503] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:53.298697 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:58:53.300935 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75d6e2a2-98b8-48f6-9ded-b7abb26760bb tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:53.302264 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75d6e2a2-98b8-48f6-9ded-b7abb26760bb tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:53.303528 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75d6e2a2-98b8-48f6-9ded-b7abb26760bb tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:53.304461 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75d6e2a2-98b8-48f6-9ded-b7abb26760bb tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:53.305138 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75d6e2a2-98b8-48f6-9ded-b7abb26760bb tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:53.305778 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75d6e2a2-98b8-48f6-9ded-b7abb26760bb tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:53.312624 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7a33e8f8-55a4-45a1-985d-976768ceccc6 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-927375649"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:58:53.316610 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7a33e8f8-55a4-45a1-985d-976768ceccc6 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:53.342016 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a33e8f8-55a4-45a1-985d-976768ceccc6 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:53.343278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a33e8f8-55a4-45a1-985d-976768ceccc6 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:53.343942 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a33e8f8-55a4-45a1-985d-976768ceccc6 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:53.345139 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a33e8f8-55a4-45a1-985d-976768ceccc6 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:53.345818 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a33e8f8-55a4-45a1-985d-976768ceccc6 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:53.352854 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a33e8f8-55a4-45a1-985d-976768ceccc6 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:53.656659 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7a33e8f8-55a4-45a1-985d-976768ceccc6 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "POST /compute/v2.1/servers/4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51/action" status: 202 len: 0 microversion: 2.1 time: 0.348428 Sep 24 20:58:53.658193 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1230/2471] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:58:53 2022] POST /compute/v2.1/servers/4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Sep 24 20:58:53.664912 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-d78d3f2f-67da-42dc-9baa-0ef2017e8e2e req-a7af7d4e-9b59-4aa5-9200-439677226394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c394113-a640-4199-80e0-1316dd1b2828", "name": "network-vif-deleted", "tag": "356ffb26-b574-4bd3-8e28-72fc211fb860"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:58:53.679454 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d78d3f2f-67da-42dc-9baa-0ef2017e8e2e req-a7af7d4e-9b59-4aa5-9200-439677226394 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:53.681365 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d78d3f2f-67da-42dc-9baa-0ef2017e8e2e req-a7af7d4e-9b59-4aa5-9200-439677226394 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:53.684488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d78d3f2f-67da-42dc-9baa-0ef2017e8e2e req-a7af7d4e-9b59-4aa5-9200-439677226394 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:53.707602 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-d78d3f2f-67da-42dc-9baa-0ef2017e8e2e req-a7af7d4e-9b59-4aa5-9200-439677226394 service nova] Creating event network-vif-deleted:356ffb26-b574-4bd3-8e28-72fc211fb860 for instance 1c394113-a640-4199-80e0-1316dd1b2828 on nch1-master-1 Sep 24 20:58:53.715831 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-d78d3f2f-67da-42dc-9baa-0ef2017e8e2e req-a7af7d4e-9b59-4aa5-9200-439677226394 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055984 Sep 24 20:58:53.716993 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1231/2472] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:58:53.728580 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-92d4b886-804e-4ab3-97b7-59926a71cb6a req-97ab87b9-127a-4d58-9e39-8e2ac1fa2f2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ae40e24-5532-41d3-8913-16ca4adaf7a3", "tag": "71677535-9a25-4279-a1b1-e5a91447a32a"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:58:53.749132 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-92d4b886-804e-4ab3-97b7-59926a71cb6a req-97ab87b9-127a-4d58-9e39-8e2ac1fa2f2a service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:53.749960 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-92d4b886-804e-4ab3-97b7-59926a71cb6a req-97ab87b9-127a-4d58-9e39-8e2ac1fa2f2a service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:53.750825 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-92d4b886-804e-4ab3-97b7-59926a71cb6a req-97ab87b9-127a-4d58-9e39-8e2ac1fa2f2a service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:53.763256 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-75d6e2a2-98b8-48f6-9ded-b7abb26760bb tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:53.769239 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-92d4b886-804e-4ab3-97b7-59926a71cb6a req-97ab87b9-127a-4d58-9e39-8e2ac1fa2f2a service nova] Creating event network-changed:71677535-9a25-4279-a1b1-e5a91447a32a for instance 5ae40e24-5532-41d3-8913-16ca4adaf7a3 on nch1-master-1 Sep 24 20:58:53.776028 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-92d4b886-804e-4ab3-97b7-59926a71cb6a req-97ab87b9-127a-4d58-9e39-8e2ac1fa2f2a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056363 Sep 24 20:58:53.776823 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1232/2473] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:58:53.782596 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-75d6e2a2-98b8-48f6-9ded-b7abb26760bb tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503" status: 200 len: 1315 microversion: 2.1 time: 0.498215 Sep 24 20:58:53.783224 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1242/2474] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:53 2022] GET /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503 => generated 1315 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:53.784925 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e353104e-d957-4a90-b65b-f5ea6d9d113e tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:53.785791 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e353104e-d957-4a90-b65b-f5ea6d9d113e tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 5ae40e24-5532-41d3-8913-16ca4adaf7a3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:53.788720 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-183f24b3-839e-412b-9d51-3daf59df4d57 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:53.789393 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-183f24b3-839e-412b-9d51-3daf59df4d57 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:53.794776 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e353104e-d957-4a90-b65b-f5ea6d9d113e tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:53.795605 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e353104e-d957-4a90-b65b-f5ea6d9d113e tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:53.796354 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e353104e-d957-4a90-b65b-f5ea6d9d113e tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:53.797308 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e353104e-d957-4a90-b65b-f5ea6d9d113e tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:53.798768 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e353104e-d957-4a90-b65b-f5ea6d9d113e tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:53.800274 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e353104e-d957-4a90-b65b-f5ea6d9d113e tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:53.806766 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-183f24b3-839e-412b-9d51-3daf59df4d57 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:53.807507 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-183f24b3-839e-412b-9d51-3daf59df4d57 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:53.807960 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-183f24b3-839e-412b-9d51-3daf59df4d57 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:53.808849 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-183f24b3-839e-412b-9d51-3daf59df4d57 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:53.809458 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-183f24b3-839e-412b-9d51-3daf59df4d57 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:53.810044 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-183f24b3-839e-412b-9d51-3daf59df4d57 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:54.202071 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-183f24b3-839e-412b-9d51-3daf59df4d57 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:54.210030 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e353104e-d957-4a90-b65b-f5ea6d9d113e tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343dddda044b8fa4eb797a4b64556a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbf416811f64df0b56656a0cf7778ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:54.211378 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-183f24b3-839e-412b-9d51-3daf59df4d57 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1513 microversion: 2.1 time: 0.426438 Sep 24 20:58:54.212400 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1243/2475] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:53 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1513 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:54.221428 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e353104e-d957-4a90-b65b-f5ea6d9d113e tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3" status: 200 len: 1318 microversion: 2.1 time: 0.443218 Sep 24 20:58:54.221822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ac49f2db-9230-4293-8d13-dc43dabb0261 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b07e49280>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:54.222371 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1233/2476] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:53 2022] GET /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3 => generated 1318 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:54.227185 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1599a069-22be-44e8-879b-72dc9f1d37ef tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:54.229792 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1599a069-22be-44e8-879b-72dc9f1d37ef tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:54.237708 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1599a069-22be-44e8-879b-72dc9f1d37ef tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:54.238920 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1599a069-22be-44e8-879b-72dc9f1d37ef tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:54.239061 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1599a069-22be-44e8-879b-72dc9f1d37ef tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:54.239696 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1599a069-22be-44e8-879b-72dc9f1d37ef tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:54.240161 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1599a069-22be-44e8-879b-72dc9f1d37ef tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:54.240725 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1599a069-22be-44e8-879b-72dc9f1d37ef tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:54.271736 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1599a069-22be-44e8-879b-72dc9f1d37ef tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.048181 Sep 24 20:58:54.272320 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1234/2477] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:54 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:58:54.286290 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e2ca84ab-8b47-4698-a477-1b8059dfa4e9 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:54.287086 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e2ca84ab-8b47-4698-a477-1b8059dfa4e9 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:54.289002 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ac49f2db-9230-4293-8d13-dc43dabb0261 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3" status: 200 len: 1450 microversion: 2.1 time: 0.075333 Sep 24 20:58:54.289598 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1244/2478] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:54 2022] GET /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3 => generated 1450 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:54.293399 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e2ca84ab-8b47-4698-a477-1b8059dfa4e9 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:54.293888 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e2ca84ab-8b47-4698-a477-1b8059dfa4e9 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:54.294331 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e2ca84ab-8b47-4698-a477-1b8059dfa4e9 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:54.295067 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e2ca84ab-8b47-4698-a477-1b8059dfa4e9 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:54.295524 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e2ca84ab-8b47-4698-a477-1b8059dfa4e9 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:54.295954 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e2ca84ab-8b47-4698-a477-1b8059dfa4e9 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:54.362529 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e2ca84ab-8b47-4698-a477-1b8059dfa4e9 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:54.370383 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e2ca84ab-8b47-4698-a477-1b8059dfa4e9 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 200 len: 1452 microversion: 2.1 time: 0.088399 Sep 24 20:58:54.371693 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1235/2479] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:54 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 1452 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:54.736711 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-438e45d2-5625-4cf9-b401-2c3e56afc83d req-18281b1e-0821-4a80-8687-8f0c60dfc4a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c394113-a640-4199-80e0-1316dd1b2828", "name": "network-vif-unplugged", "status": "completed", "tag": "5fbaf336-e072-4bcb-a547-ba1e9efcffcf"}, {"server_uuid": "0fa728d6-93b7-4c6f-b358-55f15038a503", "name": "network-vif-plugged", "status": "completed", "tag": "66bcd8ff-8861-4663-b4ee-9d739fe215ea"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:58:54.748120 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-438e45d2-5625-4cf9-b401-2c3e56afc83d req-18281b1e-0821-4a80-8687-8f0c60dfc4a0 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:54.748605 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-438e45d2-5625-4cf9-b401-2c3e56afc83d req-18281b1e-0821-4a80-8687-8f0c60dfc4a0 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:54.749041 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-438e45d2-5625-4cf9-b401-2c3e56afc83d req-18281b1e-0821-4a80-8687-8f0c60dfc4a0 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:54.761220 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-438e45d2-5625-4cf9-b401-2c3e56afc83d req-18281b1e-0821-4a80-8687-8f0c60dfc4a0 service nova] Creating event network-vif-unplugged:5fbaf336-e072-4bcb-a547-ba1e9efcffcf for instance 1c394113-a640-4199-80e0-1316dd1b2828 on nch1-master-1 Sep 24 20:58:54.761739 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-438e45d2-5625-4cf9-b401-2c3e56afc83d req-18281b1e-0821-4a80-8687-8f0c60dfc4a0 service nova] Creating event network-vif-plugged:66bcd8ff-8861-4663-b4ee-9d739fe215ea for instance 0fa728d6-93b7-4c6f-b358-55f15038a503 on nch2-master-1 Sep 24 20:58:54.771479 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-438e45d2-5625-4cf9-b401-2c3e56afc83d req-18281b1e-0821-4a80-8687-8f0c60dfc4a0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.039062 Sep 24 20:58:54.772015 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1245/2480] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:58:54.808396 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-62750a67-2ec9-464d-9fe7-777f61a6be0e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:54.809170 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-62750a67-2ec9-464d-9fe7-777f61a6be0e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 0fa728d6-93b7-4c6f-b358-55f15038a503] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:54.815787 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62750a67-2ec9-464d-9fe7-777f61a6be0e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:54.816285 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62750a67-2ec9-464d-9fe7-777f61a6be0e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:54.816733 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62750a67-2ec9-464d-9fe7-777f61a6be0e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:54.817447 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62750a67-2ec9-464d-9fe7-777f61a6be0e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:54.817911 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62750a67-2ec9-464d-9fe7-777f61a6be0e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:54.818369 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62750a67-2ec9-464d-9fe7-777f61a6be0e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:54.960508 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-62750a67-2ec9-464d-9fe7-777f61a6be0e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:54.968609 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-62750a67-2ec9-464d-9fe7-777f61a6be0e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503" status: 200 len: 1315 microversion: 2.1 time: 0.164396 Sep 24 20:58:54.978267 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1236/2481] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:54 2022] GET /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:55.240675 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c62cd467-d0d0-4a13-83e5-97b2a2717851 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:55.246425 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5d65744b-5006-483d-aafa-3cd8a0ea9e4b tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:55.247081 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5d65744b-5006-483d-aafa-3cd8a0ea9e4b tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 5ae40e24-5532-41d3-8913-16ca4adaf7a3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:55.250524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c62cd467-d0d0-4a13-83e5-97b2a2717851 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:55.256702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d65744b-5006-483d-aafa-3cd8a0ea9e4b tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:55.257198 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d65744b-5006-483d-aafa-3cd8a0ea9e4b tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:55.257643 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d65744b-5006-483d-aafa-3cd8a0ea9e4b tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:55.258356 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d65744b-5006-483d-aafa-3cd8a0ea9e4b tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:55.258844 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d65744b-5006-483d-aafa-3cd8a0ea9e4b tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:55.259277 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d65744b-5006-483d-aafa-3cd8a0ea9e4b tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:55.266076 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c62cd467-d0d0-4a13-83e5-97b2a2717851 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:55.266687 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c62cd467-d0d0-4a13-83e5-97b2a2717851 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:55.267139 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c62cd467-d0d0-4a13-83e5-97b2a2717851 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:55.267850 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c62cd467-d0d0-4a13-83e5-97b2a2717851 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:55.268313 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c62cd467-d0d0-4a13-83e5-97b2a2717851 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:55.268743 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c62cd467-d0d0-4a13-83e5-97b2a2717851 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:55.796253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5d65744b-5006-483d-aafa-3cd8a0ea9e4b tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343dddda044b8fa4eb797a4b64556a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbf416811f64df0b56656a0cf7778ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:55.803554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c62cd467-d0d0-4a13-83e5-97b2a2717851 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:55.804480 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5d65744b-5006-483d-aafa-3cd8a0ea9e4b tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3" status: 200 len: 1318 microversion: 2.1 time: 0.561838 Sep 24 20:58:55.805067 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1237/2482] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:55 2022] GET /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3 => generated 1318 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:55.809825 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a5a4f0e4-52cb-4161-9da3-72ff9357ec3b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:55.811840 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c62cd467-d0d0-4a13-83e5-97b2a2717851 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1513 microversion: 2.1 time: 0.576656 Sep 24 20:58:55.812145 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a5a4f0e4-52cb-4161-9da3-72ff9357ec3b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:55.812995 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1246/2483] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:55 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1513 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:55.818688 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0fad0d7d-88ae-4015-ad1f-80b052f07133 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b07ea18b0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:55.820755 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5a4f0e4-52cb-4161-9da3-72ff9357ec3b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:55.821256 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5a4f0e4-52cb-4161-9da3-72ff9357ec3b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:55.821698 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5a4f0e4-52cb-4161-9da3-72ff9357ec3b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:55.822410 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5a4f0e4-52cb-4161-9da3-72ff9357ec3b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:55.822901 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5a4f0e4-52cb-4161-9da3-72ff9357ec3b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:55.823325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5a4f0e4-52cb-4161-9da3-72ff9357ec3b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:55.856321 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a5a4f0e4-52cb-4161-9da3-72ff9357ec3b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.050207 Sep 24 20:58:55.856889 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1238/2484] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:55 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:58:55.863363 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4c033dd9-65bd-4207-adc7-0c675fee9ea4 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:55.863984 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4c033dd9-65bd-4207-adc7-0c675fee9ea4 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:55.865822 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0fad0d7d-88ae-4015-ad1f-80b052f07133 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3" status: 200 len: 1450 microversion: 2.1 time: 0.051215 Sep 24 20:58:55.874041 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1247/2485] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:55 2022] GET /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3 => generated 1450 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:55.874182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4c033dd9-65bd-4207-adc7-0c675fee9ea4 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:55.874182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4c033dd9-65bd-4207-adc7-0c675fee9ea4 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:55.874345 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-ba08cbb8-8d0e-4d43-8c10-b27536c70b7e req-fc2d2c28-7fdc-4183-8e3a-2f563e56e7a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c394113-a640-4199-80e0-1316dd1b2828", "name": "network-vif-deleted", "tag": "5fbaf336-e072-4bcb-a547-ba1e9efcffcf"}, {"name": "network-changed", "server_uuid": "0d546302-deb3-47c6-b9fd-3155ced00883", "tag": "56949465-71b8-45bb-b1d2-4b934bfc9714"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:58:55.874441 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4c033dd9-65bd-4207-adc7-0c675fee9ea4 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:55.874441 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4c033dd9-65bd-4207-adc7-0c675fee9ea4 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:55.874441 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4c033dd9-65bd-4207-adc7-0c675fee9ea4 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:55.874441 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4c033dd9-65bd-4207-adc7-0c675fee9ea4 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:55.883941 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-ba08cbb8-8d0e-4d43-8c10-b27536c70b7e req-fc2d2c28-7fdc-4183-8e3a-2f563e56e7a7 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:55.884423 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-ba08cbb8-8d0e-4d43-8c10-b27536c70b7e req-fc2d2c28-7fdc-4183-8e3a-2f563e56e7a7 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:55.884859 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-ba08cbb8-8d0e-4d43-8c10-b27536c70b7e req-fc2d2c28-7fdc-4183-8e3a-2f563e56e7a7 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:55.897884 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-ba08cbb8-8d0e-4d43-8c10-b27536c70b7e req-fc2d2c28-7fdc-4183-8e3a-2f563e56e7a7 service nova] Creating event network-vif-deleted:5fbaf336-e072-4bcb-a547-ba1e9efcffcf for instance 1c394113-a640-4199-80e0-1316dd1b2828 on nch1-master-1 Sep 24 20:58:55.898405 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-ba08cbb8-8d0e-4d43-8c10-b27536c70b7e req-fc2d2c28-7fdc-4183-8e3a-2f563e56e7a7 service nova] Creating event network-changed:56949465-71b8-45bb-b1d2-4b934bfc9714 for instance 0d546302-deb3-47c6-b9fd-3155ced00883 on nch1-master-1 Sep 24 20:58:55.904843 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-ba08cbb8-8d0e-4d43-8c10-b27536c70b7e req-fc2d2c28-7fdc-4183-8e3a-2f563e56e7a7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.037012 Sep 24 20:58:55.905711 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1248/2486] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:58:55.940479 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4c033dd9-65bd-4207-adc7-0c675fee9ea4 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:55.948241 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4c033dd9-65bd-4207-adc7-0c675fee9ea4 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 200 len: 1452 microversion: 2.1 time: 0.090263 Sep 24 20:58:55.948815 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1239/2487] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:55 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 1452 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:55.992632 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bfa7f557-11c8-4095-a5d9-8e08957dfa7a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:55.993376 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bfa7f557-11c8-4095-a5d9-8e08957dfa7a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 0fa728d6-93b7-4c6f-b358-55f15038a503] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:55.999691 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bfa7f557-11c8-4095-a5d9-8e08957dfa7a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:56.000179 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bfa7f557-11c8-4095-a5d9-8e08957dfa7a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:56.001232 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bfa7f557-11c8-4095-a5d9-8e08957dfa7a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:56.002037 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bfa7f557-11c8-4095-a5d9-8e08957dfa7a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:56.002524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bfa7f557-11c8-4095-a5d9-8e08957dfa7a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:56.002957 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bfa7f557-11c8-4095-a5d9-8e08957dfa7a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:56.204662 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bfa7f557-11c8-4095-a5d9-8e08957dfa7a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:56.216228 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bfa7f557-11c8-4095-a5d9-8e08957dfa7a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503" status: 200 len: 1315 microversion: 2.1 time: 0.227624 Sep 24 20:58:56.230554 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1249/2488] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:55 2022] GET /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:56.790681 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-b7ccf029-13ac-4738-8da6-e5675e1faa93 req-3a666977-9d3b-4439-91a5-9ebda9550d48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f800d64-00f6-4135-8090-c95d84acd232", "name": "network-vif-unplugged", "status": "completed", "tag": "04879ee8-ed63-4eba-999f-e92bf51322a7"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:58:56.802102 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-b7ccf029-13ac-4738-8da6-e5675e1faa93 req-3a666977-9d3b-4439-91a5-9ebda9550d48 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:56.802911 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-b7ccf029-13ac-4738-8da6-e5675e1faa93 req-3a666977-9d3b-4439-91a5-9ebda9550d48 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:56.803445 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-b7ccf029-13ac-4738-8da6-e5675e1faa93 req-3a666977-9d3b-4439-91a5-9ebda9550d48 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:56.816427 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-b7ccf029-13ac-4738-8da6-e5675e1faa93 req-3a666977-9d3b-4439-91a5-9ebda9550d48 service nova] Creating event network-vif-unplugged:04879ee8-ed63-4eba-999f-e92bf51322a7 for instance 8f800d64-00f6-4135-8090-c95d84acd232 on nch2-master-1 Sep 24 20:58:56.822396 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-b7ccf029-13ac-4738-8da6-e5675e1faa93 req-3a666977-9d3b-4439-91a5-9ebda9550d48 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035033 Sep 24 20:58:56.823731 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1240/2489] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:58:56.833632 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-520df32d-52b1-4aba-bd51-17d7ffb0a756 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:56.833632 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-520df32d-52b1-4aba-bd51-17d7ffb0a756 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 5ae40e24-5532-41d3-8913-16ca4adaf7a3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:56.840683 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6b61aeed-89ad-48df-8d6c-dd937ca5ca2c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:56.841403 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6b61aeed-89ad-48df-8d6c-dd937ca5ca2c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:56.846540 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-520df32d-52b1-4aba-bd51-17d7ffb0a756 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:56.847063 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-520df32d-52b1-4aba-bd51-17d7ffb0a756 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:56.847677 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-520df32d-52b1-4aba-bd51-17d7ffb0a756 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:56.848590 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-520df32d-52b1-4aba-bd51-17d7ffb0a756 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:56.849058 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-520df32d-52b1-4aba-bd51-17d7ffb0a756 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:56.849912 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-520df32d-52b1-4aba-bd51-17d7ffb0a756 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:56.858819 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b61aeed-89ad-48df-8d6c-dd937ca5ca2c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:56.859344 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b61aeed-89ad-48df-8d6c-dd937ca5ca2c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:56.859797 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b61aeed-89ad-48df-8d6c-dd937ca5ca2c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:56.861069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b61aeed-89ad-48df-8d6c-dd937ca5ca2c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:56.861743 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b61aeed-89ad-48df-8d6c-dd937ca5ca2c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:56.862187 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b61aeed-89ad-48df-8d6c-dd937ca5ca2c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:57.061925 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-520df32d-52b1-4aba-bd51-17d7ffb0a756 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343dddda044b8fa4eb797a4b64556a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbf416811f64df0b56656a0cf7778ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:57.070484 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6b61aeed-89ad-48df-8d6c-dd937ca5ca2c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:57.070879 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-520df32d-52b1-4aba-bd51-17d7ffb0a756 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3" status: 200 len: 1318 microversion: 2.1 time: 0.245363 Sep 24 20:58:57.071463 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1250/2490] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:56 2022] GET /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3 => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:57.076484 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4dce3383-9fd0-4fc7-bb40-ce34fc4efeda tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:57.078410 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6b61aeed-89ad-48df-8d6c-dd937ca5ca2c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1513 microversion: 2.1 time: 0.241949 Sep 24 20:58:57.078889 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4dce3383-9fd0-4fc7-bb40-ce34fc4efeda tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:57.079050 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1241/2491] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:56 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1513 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:57.085173 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6d38ae2d-311e-4edc-bfa3-f12c4d5e77f7 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b0c3b1700>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:57.099281 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4dce3383-9fd0-4fc7-bb40-ce34fc4efeda tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:57.100033 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4dce3383-9fd0-4fc7-bb40-ce34fc4efeda tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:57.100478 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4dce3383-9fd0-4fc7-bb40-ce34fc4efeda tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:57.101187 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4dce3383-9fd0-4fc7-bb40-ce34fc4efeda tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:57.101837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4dce3383-9fd0-4fc7-bb40-ce34fc4efeda tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:57.102464 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4dce3383-9fd0-4fc7-bb40-ce34fc4efeda tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:57.135846 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6d38ae2d-311e-4edc-bfa3-f12c4d5e77f7 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3" status: 200 len: 1450 microversion: 2.1 time: 0.055764 Sep 24 20:58:57.136733 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1242/2492] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:57 2022] GET /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3 => generated 1450 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:57.137215 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4dce3383-9fd0-4fc7-bb40-ce34fc4efeda tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.064492 Sep 24 20:58:57.138000 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1251/2493] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:57 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:58:57.143925 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e68ea848-cff2-4e8e-964c-5f482f77bf01 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:57.144552 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e68ea848-cff2-4e8e-964c-5f482f77bf01 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:57.150696 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e68ea848-cff2-4e8e-964c-5f482f77bf01 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:57.151188 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e68ea848-cff2-4e8e-964c-5f482f77bf01 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:57.151631 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e68ea848-cff2-4e8e-964c-5f482f77bf01 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:57.152342 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e68ea848-cff2-4e8e-964c-5f482f77bf01 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:57.152804 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e68ea848-cff2-4e8e-964c-5f482f77bf01 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:57.153238 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e68ea848-cff2-4e8e-964c-5f482f77bf01 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:57.167628 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-e68ea848-cff2-4e8e-964c-5f482f77bf01 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] HTTP exception thrown: Instance 1c394113-a640-4199-80e0-1316dd1b2828 could not be found. Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e68ea848-cff2-4e8e-964c-5f482f77bf01 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Request method failure captured: Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 HTTP/1.1 Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL29H3Y19P2AmVBhvRjNFRCBpolNuadDBOlKSR1Efyzo3E2lbdIYzJx52Dj0lF1bXU_fThOJRme9w_OFrp-J5PiK1Z0egs_IZEWNOQo5vEfMSx65zof8vr97oZ3wNj8FE3wdmHhCSstpezlY19Uo3EC4P6Ah5BMmSZQrPiNhmXPDnAVk Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: ec085cc2148f4cda9483fbe7257eeb14 Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersTestMultiNic-1036123437 Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ec085cc2148f4cda9483fbe7257eeb14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ec085cc2148f4cda9483fbe7257eeb14"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ec085cc2148f4cda9483fbe7257eeb14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ec085cc2148f4cda9483fbe7257eeb14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersTestMultiNic-1036123437 Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: ec085cc2148f4cda9483fbe7257eeb14 Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersTestMultiNic-1036123437 Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersTestMultiNic-1036123437-project Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 6a38dd114ec04ba5826a68a9e796ab8d Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersTestMultiNic-1036123437-project Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 1c394113-a640-4199-80e0-1316dd1b2828 could not be found. Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '1c394113-a640-4199-80e0-1316dd1b2828'} Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c394113-a640-4199-80e0-1316dd1b2828 could not be found. Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c394113-a640-4199-80e0-1316dd1b2828 could not be found. Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:58:57.169299 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:58:57.173311 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:58:57.173311 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:58:57.173311 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:58:57.173311 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:58:57.173311 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:58:57.173311 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c394113-a640-4199-80e0-1316dd1b2828 could not be found. Sep 24 20:58:57.173311 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:58:57.173311 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e68ea848-cff2-4e8e-964c-5f482f77bf01 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Returning 404 to user: Instance 1c394113-a640-4199-80e0-1316dd1b2828 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:58:57.173311 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e68ea848-cff2-4e8e-964c-5f482f77bf01 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 404 len: 111 microversion: 2.1 time: 0.032712 Sep 24 20:58:57.173311 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1243/2494] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:57 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:58:57.240405 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b5788427-763a-4b7c-8fac-1e13b8daec1f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:57.241040 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b5788427-763a-4b7c-8fac-1e13b8daec1f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 0fa728d6-93b7-4c6f-b358-55f15038a503] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:57.247495 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b5788427-763a-4b7c-8fac-1e13b8daec1f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:57.248001 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b5788427-763a-4b7c-8fac-1e13b8daec1f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:57.248450 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b5788427-763a-4b7c-8fac-1e13b8daec1f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:57.249165 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b5788427-763a-4b7c-8fac-1e13b8daec1f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:57.249636 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b5788427-763a-4b7c-8fac-1e13b8daec1f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:57.250102 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b5788427-763a-4b7c-8fac-1e13b8daec1f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:57.392443 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b5788427-763a-4b7c-8fac-1e13b8daec1f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:57.400422 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b5788427-763a-4b7c-8fac-1e13b8daec1f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503" status: 200 len: 1501 microversion: 2.1 time: 0.163954 Sep 24 20:58:57.401019 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1252/2495] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:57 2022] GET /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503 => generated 1501 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:57.425409 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4779dec6-aef3-41bf-b47b-c6afd9fbd88d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:57.426035 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4779dec6-aef3-41bf-b47b-c6afd9fbd88d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 0fa728d6-93b7-4c6f-b358-55f15038a503] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:57.432309 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4779dec6-aef3-41bf-b47b-c6afd9fbd88d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:57.432878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4779dec6-aef3-41bf-b47b-c6afd9fbd88d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:57.433437 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4779dec6-aef3-41bf-b47b-c6afd9fbd88d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:57.434148 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4779dec6-aef3-41bf-b47b-c6afd9fbd88d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:57.434709 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4779dec6-aef3-41bf-b47b-c6afd9fbd88d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:57.435143 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4779dec6-aef3-41bf-b47b-c6afd9fbd88d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:57.472858 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4779dec6-aef3-41bf-b47b-c6afd9fbd88d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 0fa728d6-93b7-4c6f-b358-55f15038a503] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:58:57.476037 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:58:57.551612 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:58:57.577877 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4779dec6-aef3-41bf-b47b-c6afd9fbd88d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503" status: 204 len: 0 microversion: 2.1 time: 0.156964 Sep 24 20:58:57.579383 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1244/2496] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:58:57 2022] DELETE /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:58:57.587367 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5d3dfb63-122f-400b-9639-9709c31674e8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:57.587994 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5d3dfb63-122f-400b-9639-9709c31674e8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 0fa728d6-93b7-4c6f-b358-55f15038a503] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:57.600006 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d3dfb63-122f-400b-9639-9709c31674e8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:57.600685 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d3dfb63-122f-400b-9639-9709c31674e8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:57.601280 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d3dfb63-122f-400b-9639-9709c31674e8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:57.602005 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d3dfb63-122f-400b-9639-9709c31674e8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:57.602469 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d3dfb63-122f-400b-9639-9709c31674e8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:57.602932 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d3dfb63-122f-400b-9639-9709c31674e8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:57.781114 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5d3dfb63-122f-400b-9639-9709c31674e8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:57.789765 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5d3dfb63-122f-400b-9639-9709c31674e8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503" status: 200 len: 1507 microversion: 2.1 time: 0.206241 Sep 24 20:58:57.791375 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1253/2497] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:57 2022] GET /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503 => generated 1507 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:58:58.098207 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6196dec9-21a0-4d15-9e59-f561a91e1901 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:58.099620 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6196dec9-21a0-4d15-9e59-f561a91e1901 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 5ae40e24-5532-41d3-8913-16ca4adaf7a3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:58.101732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6db19db4-e3d1-4f71-8661-b464cb3d98cf tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:58.102583 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6db19db4-e3d1-4f71-8661-b464cb3d98cf tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:58.110205 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6196dec9-21a0-4d15-9e59-f561a91e1901 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:58.110969 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6196dec9-21a0-4d15-9e59-f561a91e1901 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:58.111244 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6db19db4-e3d1-4f71-8661-b464cb3d98cf tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:58.111899 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6196dec9-21a0-4d15-9e59-f561a91e1901 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:58.112129 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6db19db4-e3d1-4f71-8661-b464cb3d98cf tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:58.112677 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6db19db4-e3d1-4f71-8661-b464cb3d98cf tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:58.113265 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6196dec9-21a0-4d15-9e59-f561a91e1901 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:58.113612 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6db19db4-e3d1-4f71-8661-b464cb3d98cf tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:58.114456 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6196dec9-21a0-4d15-9e59-f561a91e1901 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:58.114651 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6db19db4-e3d1-4f71-8661-b464cb3d98cf tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:58.115271 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6db19db4-e3d1-4f71-8661-b464cb3d98cf tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:58.115744 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6196dec9-21a0-4d15-9e59-f561a91e1901 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:58.467092 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6db19db4-e3d1-4f71-8661-b464cb3d98cf tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:58.473183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6196dec9-21a0-4d15-9e59-f561a91e1901 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343dddda044b8fa4eb797a4b64556a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbf416811f64df0b56656a0cf7778ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:58.476511 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6db19db4-e3d1-4f71-8661-b464cb3d98cf tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1513 microversion: 2.1 time: 0.378943 Sep 24 20:58:58.477102 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1254/2498] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:58 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1513 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:58:58.481981 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-864b0dc3-c9b7-4a41-9e40-6949bd405627 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:58.484479 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-864b0dc3-c9b7-4a41-9e40-6949bd405627 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:58.491236 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-864b0dc3-c9b7-4a41-9e40-6949bd405627 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:58.491728 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-864b0dc3-c9b7-4a41-9e40-6949bd405627 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:58.492173 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-864b0dc3-c9b7-4a41-9e40-6949bd405627 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:58.492883 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-864b0dc3-c9b7-4a41-9e40-6949bd405627 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:58.493461 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-864b0dc3-c9b7-4a41-9e40-6949bd405627 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:58.493895 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-864b0dc3-c9b7-4a41-9e40-6949bd405627 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:58.495303 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6196dec9-21a0-4d15-9e59-f561a91e1901 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3" status: 200 len: 1318 microversion: 2.1 time: 0.403068 Sep 24 20:58:58.496100 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1245/2499] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:58 2022] GET /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3 => generated 1318 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:58.501519 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-613ae57d-860e-4af1-8a0d-564c4352a62e tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b0c4e0280>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:58.535576 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-864b0dc3-c9b7-4a41-9e40-6949bd405627 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.057130 Sep 24 20:58:58.540493 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1255/2500] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:58 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:58:58.549226 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-613ae57d-860e-4af1-8a0d-564c4352a62e tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3" status: 200 len: 1450 microversion: 2.1 time: 0.052201 Sep 24 20:58:58.549968 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1246/2501] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:58 2022] GET /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3 => generated 1450 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:58.813861 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-92f99d56-b7ad-4583-a5af-39aabcca5fc1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:58.814923 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-92f99d56-b7ad-4583-a5af-39aabcca5fc1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 0fa728d6-93b7-4c6f-b358-55f15038a503] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:58.821553 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-92f99d56-b7ad-4583-a5af-39aabcca5fc1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:58.822050 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-92f99d56-b7ad-4583-a5af-39aabcca5fc1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:58.822758 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-92f99d56-b7ad-4583-a5af-39aabcca5fc1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:58.823683 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-92f99d56-b7ad-4583-a5af-39aabcca5fc1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:58.824351 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-92f99d56-b7ad-4583-a5af-39aabcca5fc1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:58.824985 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-92f99d56-b7ad-4583-a5af-39aabcca5fc1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:58.978538 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-92f99d56-b7ad-4583-a5af-39aabcca5fc1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:58.991292 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-92f99d56-b7ad-4583-a5af-39aabcca5fc1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503" status: 200 len: 1507 microversion: 2.1 time: 0.181741 Sep 24 20:58:58.992608 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1256/2502] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:58 2022] GET /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503 => generated 1507 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:59.266170 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:58:59.271545 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-a1bb25a8-e1f4-4d07-9eb8-77403103d33e req-4f11c1c1-3dd0-4a99-b3f6-126f57fad648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51", "name": "network-vif-plugged", "status": "completed", "tag": "00c8986f-e263-4bab-8396-0009b8e0c3e8"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:58:59.284959 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a1bb25a8-e1f4-4d07-9eb8-77403103d33e req-4f11c1c1-3dd0-4a99-b3f6-126f57fad648 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:59.287272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a1bb25a8-e1f4-4d07-9eb8-77403103d33e req-4f11c1c1-3dd0-4a99-b3f6-126f57fad648 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:59.288118 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a1bb25a8-e1f4-4d07-9eb8-77403103d33e req-4f11c1c1-3dd0-4a99-b3f6-126f57fad648 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:59.305427 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-a1bb25a8-e1f4-4d07-9eb8-77403103d33e req-4f11c1c1-3dd0-4a99-b3f6-126f57fad648 service nova] Creating event network-vif-plugged:00c8986f-e263-4bab-8396-0009b8e0c3e8 for instance 4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51 on nch2-master-1 Sep 24 20:58:59.314081 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-a1bb25a8-e1f4-4d07-9eb8-77403103d33e req-4f11c1c1-3dd0-4a99-b3f6-126f57fad648 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047657 Sep 24 20:58:59.316347 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1247/2503] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:58:59.501162 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cbcfc0d7-d9b5-4000-84f8-be002b3930cc tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:59.502488 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cbcfc0d7-d9b5-4000-84f8-be002b3930cc tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:59.509272 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cbcfc0d7-d9b5-4000-84f8-be002b3930cc tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:59.509764 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cbcfc0d7-d9b5-4000-84f8-be002b3930cc tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:59.510201 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cbcfc0d7-d9b5-4000-84f8-be002b3930cc tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:59.510942 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cbcfc0d7-d9b5-4000-84f8-be002b3930cc tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:59.511395 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cbcfc0d7-d9b5-4000-84f8-be002b3930cc tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:59.511819 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cbcfc0d7-d9b5-4000-84f8-be002b3930cc tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:59.519837 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7fd0b685-8db9-4509-bbc8-aa9350b27c77 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:59.520774 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7fd0b685-8db9-4509-bbc8-aa9350b27c77 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 5ae40e24-5532-41d3-8913-16ca4adaf7a3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:59.524181 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=10 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:58:59.529200 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7fd0b685-8db9-4509-bbc8-aa9350b27c77 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:59.529960 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7fd0b685-8db9-4509-bbc8-aa9350b27c77 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:59.531061 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7fd0b685-8db9-4509-bbc8-aa9350b27c77 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:59.532511 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7fd0b685-8db9-4509-bbc8-aa9350b27c77 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:59.533590 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7fd0b685-8db9-4509-bbc8-aa9350b27c77 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:59.534229 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7fd0b685-8db9-4509-bbc8-aa9350b27c77 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:59.539669 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:58:59.737080 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cbcfc0d7-d9b5-4000-84f8-be002b3930cc tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:59.752935 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cbcfc0d7-d9b5-4000-84f8-be002b3930cc tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1513 microversion: 2.1 time: 0.255386 Sep 24 20:58:59.758656 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1257/2504] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:59 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1513 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:59.763054 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7fd0b685-8db9-4509-bbc8-aa9350b27c77 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343dddda044b8fa4eb797a4b64556a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbf416811f64df0b56656a0cf7778ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:58:59.771114 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6c720ce0-32c3-44c5-8788-205ba0560952 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:59.775516 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7fd0b685-8db9-4509-bbc8-aa9350b27c77 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3" status: 200 len: 1318 microversion: 2.1 time: 0.260319 Sep 24 20:58:59.776426 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1248/2505] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:58:59 2022] GET /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:58:59.780791 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6c720ce0-32c3-44c5-8788-205ba0560952 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:58:59.781165 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f8f4853c-5791-45cf-bbb2-2ff3da09ff14 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b111a43a0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:58:59.797471 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c720ce0-32c3-44c5-8788-205ba0560952 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:59.798593 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c720ce0-32c3-44c5-8788-205ba0560952 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:59.801802 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c720ce0-32c3-44c5-8788-205ba0560952 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:59.808033 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c720ce0-32c3-44c5-8788-205ba0560952 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:58:59.808547 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c720ce0-32c3-44c5-8788-205ba0560952 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:58:59.809003 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c720ce0-32c3-44c5-8788-205ba0560952 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:58:59.848696 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f8f4853c-5791-45cf-bbb2-2ff3da09ff14 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3" status: 200 len: 1450 microversion: 2.1 time: 0.071135 Sep 24 20:58:59.849297 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1249/2506] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:58:59 2022] GET /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3 => generated 1450 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:58:59.868898 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6c720ce0-32c3-44c5-8788-205ba0560952 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.108660 Sep 24 20:58:59.869616 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1258/2507] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:58:59 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:59:00.031373 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1e0d2364-5aeb-4530-b473-a313f9cd98af tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:00.033752 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1e0d2364-5aeb-4530-b473-a313f9cd98af tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 0fa728d6-93b7-4c6f-b358-55f15038a503] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:00.044076 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e0d2364-5aeb-4530-b473-a313f9cd98af tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:00.046795 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e0d2364-5aeb-4530-b473-a313f9cd98af tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:00.048993 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e0d2364-5aeb-4530-b473-a313f9cd98af tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:00.050087 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e0d2364-5aeb-4530-b473-a313f9cd98af tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:00.051332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e0d2364-5aeb-4530-b473-a313f9cd98af tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:00.052701 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e0d2364-5aeb-4530-b473-a313f9cd98af tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:00.272297 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1e0d2364-5aeb-4530-b473-a313f9cd98af tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:00.288212 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1e0d2364-5aeb-4530-b473-a313f9cd98af tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503" status: 200 len: 1507 microversion: 2.1 time: 0.272613 Sep 24 20:59:00.288864 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1250/2508] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:00 2022] GET /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503 => generated 1507 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:00.623290 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-4eff2203-6ff3-4523-aeb9-fb9ba8a6d2c9 req-bd67c0d9-f263-4bd5-9a6e-46240a6a00a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fa728d6-93b7-4c6f-b358-55f15038a503", "name": "network-vif-deleted", "tag": "66bcd8ff-8861-4663-b4ee-9d739fe215ea"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:00.660520 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-4eff2203-6ff3-4523-aeb9-fb9ba8a6d2c9 req-bd67c0d9-f263-4bd5-9a6e-46240a6a00a5 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:00.664126 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-4eff2203-6ff3-4523-aeb9-fb9ba8a6d2c9 req-bd67c0d9-f263-4bd5-9a6e-46240a6a00a5 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:00.664836 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-4eff2203-6ff3-4523-aeb9-fb9ba8a6d2c9 req-bd67c0d9-f263-4bd5-9a6e-46240a6a00a5 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:00.694219 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-4eff2203-6ff3-4523-aeb9-fb9ba8a6d2c9 req-bd67c0d9-f263-4bd5-9a6e-46240a6a00a5 service nova] Creating event network-vif-deleted:66bcd8ff-8861-4663-b4ee-9d739fe215ea for instance 0fa728d6-93b7-4c6f-b358-55f15038a503 on nch2-master-1 Sep 24 20:59:00.723017 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-4eff2203-6ff3-4523-aeb9-fb9ba8a6d2c9 req-bd67c0d9-f263-4bd5-9a6e-46240a6a00a5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103017 Sep 24 20:59:00.728924 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1259/2509] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:59:00.787280 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-142cd501-fcaa-48a7-a7b2-b74af570e5db tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:00.792790 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-142cd501-fcaa-48a7-a7b2-b74af570e5db tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:00.804826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c12944d9-5e9d-464b-845d-4c888a3ef8a7 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:00.806020 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c12944d9-5e9d-464b-845d-4c888a3ef8a7 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 5ae40e24-5532-41d3-8913-16ca4adaf7a3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:00.816815 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-142cd501-fcaa-48a7-a7b2-b74af570e5db tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:00.818399 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-142cd501-fcaa-48a7-a7b2-b74af570e5db tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:00.820488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-142cd501-fcaa-48a7-a7b2-b74af570e5db tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:00.822818 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-142cd501-fcaa-48a7-a7b2-b74af570e5db tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:00.826174 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c12944d9-5e9d-464b-845d-4c888a3ef8a7 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:00.826779 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-142cd501-fcaa-48a7-a7b2-b74af570e5db tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:00.830726 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-142cd501-fcaa-48a7-a7b2-b74af570e5db tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:00.833367 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c12944d9-5e9d-464b-845d-4c888a3ef8a7 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:00.836980 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c12944d9-5e9d-464b-845d-4c888a3ef8a7 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:00.839308 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c12944d9-5e9d-464b-845d-4c888a3ef8a7 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:00.841624 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c12944d9-5e9d-464b-845d-4c888a3ef8a7 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:00.847242 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c12944d9-5e9d-464b-845d-4c888a3ef8a7 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:01.282438 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c12944d9-5e9d-464b-845d-4c888a3ef8a7 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343dddda044b8fa4eb797a4b64556a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbf416811f64df0b56656a0cf7778ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:01.292353 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-142cd501-fcaa-48a7-a7b2-b74af570e5db tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:01.304613 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c12944d9-5e9d-464b-845d-4c888a3ef8a7 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3" status: 200 len: 1318 microversion: 2.1 time: 0.499830 Sep 24 20:59:01.305457 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-142cd501-fcaa-48a7-a7b2-b74af570e5db tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1513 microversion: 2.1 time: 0.528416 Sep 24 20:59:01.307368 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1260/2510] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:00 2022] GET /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3 => generated 1318 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:59:01.307793 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1251/2511] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:00 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1513 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:01.328235 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bec30dcd-3510-4ee3-8d74-54f6ca3f4603 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:01.332104 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-bec30dcd-3510-4ee3-8d74-54f6ca3f4603 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:01.343050 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bec30dcd-3510-4ee3-8d74-54f6ca3f4603 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:01.343887 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bec30dcd-3510-4ee3-8d74-54f6ca3f4603 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:01.344316 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8d6eb23b-687f-4690-8fc7-c058d660e6ad tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b11024a60>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:01.345125 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bec30dcd-3510-4ee3-8d74-54f6ca3f4603 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:01.346166 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bec30dcd-3510-4ee3-8d74-54f6ca3f4603 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:01.346946 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bec30dcd-3510-4ee3-8d74-54f6ca3f4603 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:01.347584 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bec30dcd-3510-4ee3-8d74-54f6ca3f4603 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:01.420728 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bec30dcd-3510-4ee3-8d74-54f6ca3f4603 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.111681 Sep 24 20:59:01.421383 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1252/2512] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:01 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:59:01.427285 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c7c869c7-e304-4315-8fde-5e1dd06eb8e8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:01.433916 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c7c869c7-e304-4315-8fde-5e1dd06eb8e8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 0fa728d6-93b7-4c6f-b358-55f15038a503] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:01.439001 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8d6eb23b-687f-4690-8fc7-c058d660e6ad tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3" status: 200 len: 1450 microversion: 2.1 time: 0.106443 Sep 24 20:59:01.450755 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c7c869c7-e304-4315-8fde-5e1dd06eb8e8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:01.451674 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c7c869c7-e304-4315-8fde-5e1dd06eb8e8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:01.452268 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c7c869c7-e304-4315-8fde-5e1dd06eb8e8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:01.453211 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c7c869c7-e304-4315-8fde-5e1dd06eb8e8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:01.453859 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c7c869c7-e304-4315-8fde-5e1dd06eb8e8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:01.454845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c7c869c7-e304-4315-8fde-5e1dd06eb8e8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:01.461951 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1261/2513] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:59:01 2022] GET /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:01.475525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-ddaea60f-fb01-4f35-b764-058d1cdbd005 req-842a1164-d31c-423a-be4b-d5063724cd9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ae40e24-5532-41d3-8913-16ca4adaf7a3", "name": "network-vif-plugged", "status": "completed", "tag": "71677535-9a25-4279-a1b1-e5a91447a32a"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:01.496995 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c7c869c7-e304-4315-8fde-5e1dd06eb8e8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:01.497732 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c7c869c7-e304-4315-8fde-5e1dd06eb8e8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:01.498319 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c7c869c7-e304-4315-8fde-5e1dd06eb8e8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:01.499477 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-c7c869c7-e304-4315-8fde-5e1dd06eb8e8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lazy-loading 'fault' on Instance uuid 0fa728d6-93b7-4c6f-b358-55f15038a503 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:59:01.504373 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-ddaea60f-fb01-4f35-b764-058d1cdbd005 req-842a1164-d31c-423a-be4b-d5063724cd9b service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:01.506534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-ddaea60f-fb01-4f35-b764-058d1cdbd005 req-842a1164-d31c-423a-be4b-d5063724cd9b service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:01.508340 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-ddaea60f-fb01-4f35-b764-058d1cdbd005 req-842a1164-d31c-423a-be4b-d5063724cd9b service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:01.527067 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-ddaea60f-fb01-4f35-b764-058d1cdbd005 req-842a1164-d31c-423a-be4b-d5063724cd9b service nova] Creating event network-vif-plugged:71677535-9a25-4279-a1b1-e5a91447a32a for instance 5ae40e24-5532-41d3-8913-16ca4adaf7a3 on nch1-master-1 Sep 24 20:59:01.544388 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-ddaea60f-fb01-4f35-b764-058d1cdbd005 req-842a1164-d31c-423a-be4b-d5063724cd9b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079842 Sep 24 20:59:01.545590 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1262/2514] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:59:01.657252 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c7c869c7-e304-4315-8fde-5e1dd06eb8e8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:01.671025 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c7c869c7-e304-4315-8fde-5e1dd06eb8e8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503" status: 200 len: 1305 microversion: 2.1 time: 0.248315 Sep 24 20:59:01.691083 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1253/2515] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:01 2022] GET /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503 => generated 1305 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:02.101199 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a0d9d667-edcc-416f-9208-7563f820c2ae tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-593633400", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "14ac1af2-2474-4b1e-88b7-4d7e9d267f41"}, {"uuid": "c707698a-8df0-492e-b503-c571813c9de2"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:02.201958 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-a0d9d667-edcc-416f-9208-7563f820c2ae tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] validate_networks() for [('14ac1af2-2474-4b1e-88b7-4d7e9d267f41', None, None, None, None, None), ('c707698a-8df0-492e-b503-c571813c9de2', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:59:02.331598 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e33a75a3-f215-44bd-9e87-88e678209f70 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:02.332619 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e33a75a3-f215-44bd-9e87-88e678209f70 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 5ae40e24-5532-41d3-8913-16ca4adaf7a3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:02.344285 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e33a75a3-f215-44bd-9e87-88e678209f70 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:02.347050 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e33a75a3-f215-44bd-9e87-88e678209f70 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:02.348209 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e33a75a3-f215-44bd-9e87-88e678209f70 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:02.351345 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e33a75a3-f215-44bd-9e87-88e678209f70 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:02.352206 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e33a75a3-f215-44bd-9e87-88e678209f70 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:02.352937 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e33a75a3-f215-44bd-9e87-88e678209f70 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:02.723145 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e33a75a3-f215-44bd-9e87-88e678209f70 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343dddda044b8fa4eb797a4b64556a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbf416811f64df0b56656a0cf7778ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:02.734471 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e33a75a3-f215-44bd-9e87-88e678209f70 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3" status: 200 len: 1318 microversion: 2.1 time: 0.408812 Sep 24 20:59:02.736931 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1254/2516] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:02 2022] GET /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3 => generated 1318 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:59:02.747153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cf4ad3cd-03ac-47cf-b45f-7dfe17100fc3 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:02.748172 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cf4ad3cd-03ac-47cf-b45f-7dfe17100fc3 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:02.757830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cf4ad3cd-03ac-47cf-b45f-7dfe17100fc3 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:02.758973 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cf4ad3cd-03ac-47cf-b45f-7dfe17100fc3 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:02.759640 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cf4ad3cd-03ac-47cf-b45f-7dfe17100fc3 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:02.760593 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cf4ad3cd-03ac-47cf-b45f-7dfe17100fc3 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:02.761271 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cf4ad3cd-03ac-47cf-b45f-7dfe17100fc3 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:02.761938 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cf4ad3cd-03ac-47cf-b45f-7dfe17100fc3 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:03.172891 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cf4ad3cd-03ac-47cf-b45f-7dfe17100fc3 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:03.183963 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cf4ad3cd-03ac-47cf-b45f-7dfe17100fc3 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1513 microversion: 2.1 time: 0.445640 Sep 24 20:59:03.187958 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1255/2517] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:02 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1513 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:03.214597 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a1aefc9b-d6f9-42c0-a389-74edefaee9d8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:03.217305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a1aefc9b-d6f9-42c0-a389-74edefaee9d8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:03.238722 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a1aefc9b-d6f9-42c0-a389-74edefaee9d8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:03.254861 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a1aefc9b-d6f9-42c0-a389-74edefaee9d8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:03.255981 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a1aefc9b-d6f9-42c0-a389-74edefaee9d8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:03.256980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a1aefc9b-d6f9-42c0-a389-74edefaee9d8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:03.257694 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a1aefc9b-d6f9-42c0-a389-74edefaee9d8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:03.258397 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a1aefc9b-d6f9-42c0-a389-74edefaee9d8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:03.336296 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a1aefc9b-d6f9-42c0-a389-74edefaee9d8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.144531 Sep 24 20:59:03.343030 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1256/2518] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:03 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:59:03.365393 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4030632b-d210-423d-b5a6-db9c5344b865 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b1116f9d0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:03.467710 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4030632b-d210-423d-b5a6-db9c5344b865 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3" status: 200 len: 1450 microversion: 2.1 time: 0.117074 Sep 24 20:59:03.468981 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1257/2519] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:59:03 2022] GET /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3 => generated 1450 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:03.483531 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d7692fe1-6398-4a4d-9163-383563972e0a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:03.484735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d7692fe1-6398-4a4d-9163-383563972e0a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 0fa728d6-93b7-4c6f-b358-55f15038a503] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:03.493313 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7692fe1-6398-4a4d-9163-383563972e0a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:03.497042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7692fe1-6398-4a4d-9163-383563972e0a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:03.497826 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7692fe1-6398-4a4d-9163-383563972e0a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:03.498853 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7692fe1-6398-4a4d-9163-383563972e0a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:03.499573 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7692fe1-6398-4a4d-9163-383563972e0a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:03.502696 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7692fe1-6398-4a4d-9163-383563972e0a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:03.519929 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-a0d9d667-edcc-416f-9208-7563f820c2ae tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:59:03.520943 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-a0d9d667-edcc-416f-9208-7563f820c2ae tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:59:03.521907 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-a0d9d667-edcc-416f-9208-7563f820c2ae tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:59:03.523218 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-a0d9d667-edcc-416f-9208-7563f820c2ae tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:59:03.523855 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-a0d9d667-edcc-416f-9208-7563f820c2ae tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:59:03.541282 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-d7692fe1-6398-4a4d-9163-383563972e0a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] HTTP exception thrown: Instance 0fa728d6-93b7-4c6f-b358-55f15038a503 could not be found. Sep 24 20:59:03.544336 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a0d9d667-edcc-416f-9208-7563f820c2ae tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:03.545061 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a0d9d667-edcc-416f-9208-7563f820c2ae tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:03.546085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a0d9d667-edcc-416f-9208-7563f820c2ae tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:03.549398 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a0d9d667-edcc-416f-9208-7563f820c2ae tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:03.550263 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a0d9d667-edcc-416f-9208-7563f820c2ae tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:03.550955 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a0d9d667-edcc-416f-9208-7563f820c2ae tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d7692fe1-6398-4a4d-9163-383563972e0a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Request method failure captured: Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503 HTTP/1.1 Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL29-X0U31bWS-OdLHgyvrqJ9cKeXdCQcU5XDw5ndql8wo4-9uoBN2em1wysBqNzzzY5Bp3FNsC7GdcmIawuHD1dS6A2amzvS90hoLHvMsCDbASCEoRJt0wxOm48tnGq2wGlMnRgEB8mO_grzOCcTdRgOgaHbZsmHcINVEnjYdvyWtzs Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 8340f7f8fa9848dc822903c738f78f2a Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-DeleteServersTestJSON-1814924671 Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-DeleteServersTestJSON-1814924671 Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 8340f7f8fa9848dc822903c738f78f2a Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-DeleteServersTestJSON-1814924671 Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-DeleteServersTestJSON-1814924671-project Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: ee21da3ff38a43798bce50c9aba4ae33 Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-DeleteServersTestJSON-1814924671-project Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 0fa728d6-93b7-4c6f-b358-55f15038a503 could not be found. Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '0fa728d6-93b7-4c6f-b358-55f15038a503'} Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fa728d6-93b7-4c6f-b358-55f15038a503 could not be found. Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fa728d6-93b7-4c6f-b358-55f15038a503 could not be found. Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:59:03.551148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:59:03.557103 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:03.557103 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:59:03.557103 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:59:03.557103 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:59:03.557103 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:59:03.557103 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fa728d6-93b7-4c6f-b358-55f15038a503 could not be found. Sep 24 20:59:03.557103 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:59:03.558986 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d7692fe1-6398-4a4d-9163-383563972e0a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Returning 404 to user: Instance 0fa728d6-93b7-4c6f-b358-55f15038a503 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:59:03.564431 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d7692fe1-6398-4a4d-9163-383563972e0a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503" status: 404 len: 111 microversion: 2.1 time: 0.091734 Sep 24 20:59:03.565651 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1258/2520] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:03 2022] GET /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:59:03.596012 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-a0d9d667-edcc-416f-9208-7563f820c2ae tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Getting quotas for project ec085cc2148f4cda9483fbe7257eeb14. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:59:03.602564 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-a0d9d667-edcc-416f-9208-7563f820c2ae tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Getting quotas for user 6a38dd114ec04ba5826a68a9e796ab8d and project ec085cc2148f4cda9483fbe7257eeb14. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:59:03.621087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a0d9d667-edcc-416f-9208-7563f820c2ae tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:59:03.624234 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a0d9d667-edcc-416f-9208-7563f820c2ae tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 5a17fd57-ce1b-4b51-8219-cae5add11ef2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:59:03.683802 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b257ceae-345e-4546-af5f-eef696c6754b tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2071204718", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "1d2fee0c-2b4a-497a-b4e0-a76edfbd4190"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:03.759639 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a0d9d667-edcc-416f-9208-7563f820c2ae tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.663167 Sep 24 20:59:03.772420 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1263/2521] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:59:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:59:03.785422 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1f35f9e6-7877-4115-8e88-211245a78a9d tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:03.786330 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1f35f9e6-7877-4115-8e88-211245a78a9d tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 5ae40e24-5532-41d3-8913-16ca4adaf7a3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:03.796397 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1f35f9e6-7877-4115-8e88-211245a78a9d tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:03.800913 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1f35f9e6-7877-4115-8e88-211245a78a9d tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:03.803605 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1f35f9e6-7877-4115-8e88-211245a78a9d tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:03.810135 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1f35f9e6-7877-4115-8e88-211245a78a9d tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:03.811147 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1f35f9e6-7877-4115-8e88-211245a78a9d tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:03.811913 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1f35f9e6-7877-4115-8e88-211245a78a9d tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:03.820722 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-b257ceae-345e-4546-af5f-eef696c6754b tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] validate_networks() for [('1d2fee0c-2b4a-497a-b4e0-a76edfbd4190', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:59:04.389379 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1f35f9e6-7877-4115-8e88-211245a78a9d tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343dddda044b8fa4eb797a4b64556a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbf416811f64df0b56656a0cf7778ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:04.410542 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1f35f9e6-7877-4115-8e88-211245a78a9d tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3" status: 200 len: 1467 microversion: 2.1 time: 0.635011 Sep 24 20:59:04.413928 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1264/2522] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:03 2022] GET /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3 => generated 1467 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:04.430141 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6eef6cf5-3e4f-4a3f-88ef-fc97a241f698 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:04.431215 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6eef6cf5-3e4f-4a3f-88ef-fc97a241f698 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 5a17fd57-ce1b-4b51-8219-cae5add11ef2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:04.701027 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-b257ceae-345e-4546-af5f-eef696c6754b tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:59:04.701639 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-b257ceae-345e-4546-af5f-eef696c6754b tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:59:04.702080 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-b257ceae-345e-4546-af5f-eef696c6754b tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:59:04.702671 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-b257ceae-345e-4546-af5f-eef696c6754b tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:59:04.702962 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-b257ceae-345e-4546-af5f-eef696c6754b tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:59:04.720071 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b257ceae-345e-4546-af5f-eef696c6754b tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:04.720791 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b257ceae-345e-4546-af5f-eef696c6754b tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:04.721337 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b257ceae-345e-4546-af5f-eef696c6754b tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:04.733557 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b257ceae-345e-4546-af5f-eef696c6754b tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:04.734071 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b257ceae-345e-4546-af5f-eef696c6754b tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:04.734547 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b257ceae-345e-4546-af5f-eef696c6754b tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:04.750981 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6eef6cf5-3e4f-4a3f-88ef-fc97a241f698 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:04.760207 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6eef6cf5-3e4f-4a3f-88ef-fc97a241f698 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2" status: 200 len: 1212 microversion: 2.1 time: 0.344220 Sep 24 20:59:04.760811 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1265/2523] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:04 2022] GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2 => generated 1212 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:04.771235 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1a74a0b1-cc48-4e41-9d2b-9c8f9600e67a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:04.771235 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1a74a0b1-cc48-4e41-9d2b-9c8f9600e67a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:04.791315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-b257ceae-345e-4546-af5f-eef696c6754b tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Getting quotas for project 8340f7f8fa9848dc822903c738f78f2a. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:59:04.799357 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a74a0b1-cc48-4e41-9d2b-9c8f9600e67a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:04.803039 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a74a0b1-cc48-4e41-9d2b-9c8f9600e67a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:04.803557 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a74a0b1-cc48-4e41-9d2b-9c8f9600e67a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:04.804321 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a74a0b1-cc48-4e41-9d2b-9c8f9600e67a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:04.804798 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a74a0b1-cc48-4e41-9d2b-9c8f9600e67a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:04.807100 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-b257ceae-345e-4546-af5f-eef696c6754b tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Getting quotas for user ee21da3ff38a43798bce50c9aba4ae33 and project 8340f7f8fa9848dc822903c738f78f2a. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:59:04.809045 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a74a0b1-cc48-4e41-9d2b-9c8f9600e67a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:04.841299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b257ceae-345e-4546-af5f-eef696c6754b tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:59:04.849497 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b257ceae-345e-4546-af5f-eef696c6754b tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9f8f487c-5fb4-4c63-8146-a71154f73046] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:59:04.958926 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b257ceae-345e-4546-af5f-eef696c6754b tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.279023 Sep 24 20:59:04.960133 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1259/2524] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:59:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1281 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 24 20:59:04.968338 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-62862a7b-df18-49ea-adf9-dccfbbabd212 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:04.972435 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-62862a7b-df18-49ea-adf9-dccfbbabd212 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:04.980508 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62862a7b-df18-49ea-adf9-dccfbbabd212 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:04.983208 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62862a7b-df18-49ea-adf9-dccfbbabd212 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:04.983645 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62862a7b-df18-49ea-adf9-dccfbbabd212 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:04.984388 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62862a7b-df18-49ea-adf9-dccfbbabd212 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:04.985542 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62862a7b-df18-49ea-adf9-dccfbbabd212 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:04.986119 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62862a7b-df18-49ea-adf9-dccfbbabd212 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:05.039634 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-62862a7b-df18-49ea-adf9-dccfbbabd212 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.076702 Sep 24 20:59:05.040348 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1260/2525] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:04 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:59:05.045494 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6b07d7f6-5587-4423-8689-69f0675af838 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:05.046326 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6b07d7f6-5587-4423-8689-69f0675af838 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] [instance: 5ae40e24-5532-41d3-8913-16ca4adaf7a3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:05.055123 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b07d7f6-5587-4423-8689-69f0675af838 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:05.055968 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b07d7f6-5587-4423-8689-69f0675af838 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:05.056646 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b07d7f6-5587-4423-8689-69f0675af838 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:05.057574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b07d7f6-5587-4423-8689-69f0675af838 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:05.059800 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b07d7f6-5587-4423-8689-69f0675af838 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:05.060442 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b07d7f6-5587-4423-8689-69f0675af838 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:05.092980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-6b07d7f6-5587-4423-8689-69f0675af838 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Lazy-loading 'flavor' on Instance uuid 5ae40e24-5532-41d3-8913-16ca4adaf7a3 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:59:05.103418 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1a74a0b1-cc48-4e41-9d2b-9c8f9600e67a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:05.116948 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1a74a0b1-cc48-4e41-9d2b-9c8f9600e67a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1519 microversion: 2.1 time: 0.350049 Sep 24 20:59:05.117701 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1266/2526] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:04 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1519 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:05.137137 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-98d2d4de-2e0d-4dd3-982a-e644ec18eca5 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b07ddd310>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:05.222122 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-98d2d4de-2e0d-4dd3-982a-e644ec18eca5 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3" status: 200 len: 1450 microversion: 2.1 time: 0.088242 Sep 24 20:59:05.227582 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1267/2527] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:59:05 2022] GET /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3 => generated 1450 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:05.239540 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-69743361-286b-46e9-ab10-9455dd937b76 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:05.240623 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-69743361-286b-46e9-ab10-9455dd937b76 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9f8f487c-5fb4-4c63-8146-a71154f73046] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:05.244304 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6b07d7f6-5587-4423-8689-69f0675af838 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3/action" status: 202 len: 0 microversion: 2.1 time: 0.202289 Sep 24 20:59:05.249341 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1261/2528] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:59:05 2022] POST /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:59:05.258402 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-464e9051-60f6-4c9a-807e-ec81e76e351a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:05.259148 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-464e9051-60f6-4c9a-807e-ec81e76e351a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 5ae40e24-5532-41d3-8913-16ca4adaf7a3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:05.276296 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-464e9051-60f6-4c9a-807e-ec81e76e351a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:05.276800 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-464e9051-60f6-4c9a-807e-ec81e76e351a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:05.277239 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-464e9051-60f6-4c9a-807e-ec81e76e351a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:05.277957 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-464e9051-60f6-4c9a-807e-ec81e76e351a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:05.278415 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-464e9051-60f6-4c9a-807e-ec81e76e351a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:05.278877 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-464e9051-60f6-4c9a-807e-ec81e76e351a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:05.322123 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-69743361-286b-46e9-ab10-9455dd937b76 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:05.331376 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-69743361-286b-46e9-ab10-9455dd937b76 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046" status: 200 len: 1215 microversion: 2.1 time: 0.101796 Sep 24 20:59:05.332636 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1268/2529] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:05 2022] GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046 => generated 1215 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:05.502477 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-464e9051-60f6-4c9a-807e-ec81e76e351a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343dddda044b8fa4eb797a4b64556a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbf416811f64df0b56656a0cf7778ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:05.505450 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:59:05.517853 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-464e9051-60f6-4c9a-807e-ec81e76e351a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3" status: 200 len: 1475 microversion: 2.1 time: 0.263845 Sep 24 20:59:05.518688 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1262/2530] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:05 2022] GET /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3 => generated 1475 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:05.791677 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cec04b7d-f90c-43ce-8cb2-348737ef627b tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:05.792204 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cec04b7d-f90c-43ce-8cb2-348737ef627b tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 5a17fd57-ce1b-4b51-8219-cae5add11ef2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:05.810365 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cec04b7d-f90c-43ce-8cb2-348737ef627b tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:05.811137 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cec04b7d-f90c-43ce-8cb2-348737ef627b tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:05.811755 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cec04b7d-f90c-43ce-8cb2-348737ef627b tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:05.813046 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cec04b7d-f90c-43ce-8cb2-348737ef627b tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:05.813870 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cec04b7d-f90c-43ce-8cb2-348737ef627b tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:05.814527 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cec04b7d-f90c-43ce-8cb2-348737ef627b tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:05.889291 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cec04b7d-f90c-43ce-8cb2-348737ef627b tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:05.906753 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cec04b7d-f90c-43ce-8cb2-348737ef627b tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2" status: 200 len: 1216 microversion: 2.1 time: 0.118818 Sep 24 20:59:05.908323 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1269/2531] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:05 2022] GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2 => generated 1216 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:06.060348 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-da70fd48-89f3-4567-bb68-c41fea6201aa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:06.065161 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-da70fd48-89f3-4567-bb68-c41fea6201aa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:06.077975 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-da70fd48-89f3-4567-bb68-c41fea6201aa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:06.078921 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-da70fd48-89f3-4567-bb68-c41fea6201aa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:06.079985 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-da70fd48-89f3-4567-bb68-c41fea6201aa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:06.081562 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-da70fd48-89f3-4567-bb68-c41fea6201aa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:06.082776 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-da70fd48-89f3-4567-bb68-c41fea6201aa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:06.083550 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-da70fd48-89f3-4567-bb68-c41fea6201aa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:06.130390 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-da70fd48-89f3-4567-bb68-c41fea6201aa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.078109 Sep 24 20:59:06.135957 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1263/2532] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:06 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 20:59:06.159419 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2ebe5a0e-d9ab-4bc7-a926-d8a3728cf883 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:06.163497 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2ebe5a0e-d9ab-4bc7-a926-d8a3728cf883 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:06.190289 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ebe5a0e-d9ab-4bc7-a926-d8a3728cf883 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:06.192701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ebe5a0e-d9ab-4bc7-a926-d8a3728cf883 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:06.194800 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ebe5a0e-d9ab-4bc7-a926-d8a3728cf883 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:06.196946 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ebe5a0e-d9ab-4bc7-a926-d8a3728cf883 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:06.197624 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ebe5a0e-d9ab-4bc7-a926-d8a3728cf883 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:06.198375 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ebe5a0e-d9ab-4bc7-a926-d8a3728cf883 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:06.248903 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-80b38082-97cf-4a8a-8f84-169612596967 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b0cd545e0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:06.339492 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-80b38082-97cf-4a8a-8f84-169612596967 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3" status: 200 len: 1450 microversion: 2.1 time: 0.101134 Sep 24 20:59:06.341379 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1264/2533] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:59:06 2022] GET /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3 => generated 1450 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:06.369264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-66c404d4-8238-4e66-88b0-146660a49fc6 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:06.369912 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-66c404d4-8238-4e66-88b0-146660a49fc6 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9f8f487c-5fb4-4c63-8146-a71154f73046] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:06.377252 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66c404d4-8238-4e66-88b0-146660a49fc6 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:06.377821 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66c404d4-8238-4e66-88b0-146660a49fc6 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:06.378274 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66c404d4-8238-4e66-88b0-146660a49fc6 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:06.379123 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66c404d4-8238-4e66-88b0-146660a49fc6 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:06.379595 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66c404d4-8238-4e66-88b0-146660a49fc6 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:06.380036 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66c404d4-8238-4e66-88b0-146660a49fc6 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:06.407375 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2ebe5a0e-d9ab-4bc7-a926-d8a3728cf883 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:06.416955 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2ebe5a0e-d9ab-4bc7-a926-d8a3728cf883 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1519 microversion: 2.1 time: 0.271792 Sep 24 20:59:06.428560 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1270/2534] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:06 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1519 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:06.458374 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-66c404d4-8238-4e66-88b0-146660a49fc6 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:06.468355 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-66c404d4-8238-4e66-88b0-146660a49fc6 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046" status: 200 len: 1211 microversion: 2.1 time: 0.106041 Sep 24 20:59:06.484802 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1265/2535] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:06 2022] GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046 => generated 1211 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:06.543439 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e7cba689-6f6c-4914-94e0-479abfc778dc tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:06.544086 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e7cba689-6f6c-4914-94e0-479abfc778dc tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 5ae40e24-5532-41d3-8913-16ca4adaf7a3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:06.550659 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7cba689-6f6c-4914-94e0-479abfc778dc tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:06.551170 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7cba689-6f6c-4914-94e0-479abfc778dc tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:06.551620 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7cba689-6f6c-4914-94e0-479abfc778dc tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:06.552353 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7cba689-6f6c-4914-94e0-479abfc778dc tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:06.552822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7cba689-6f6c-4914-94e0-479abfc778dc tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:06.553265 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7cba689-6f6c-4914-94e0-479abfc778dc tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:06.730962 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e7cba689-6f6c-4914-94e0-479abfc778dc tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343dddda044b8fa4eb797a4b64556a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbf416811f64df0b56656a0cf7778ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:06.739226 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e7cba689-6f6c-4914-94e0-479abfc778dc tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3" status: 200 len: 1458 microversion: 2.1 time: 0.199577 Sep 24 20:59:06.740007 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1271/2536] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:06 2022] GET /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3 => generated 1458 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:06.764560 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-08104674-8d07-4eaf-a12c-ea531d1c5969 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:06.765196 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-08104674-8d07-4eaf-a12c-ea531d1c5969 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] [instance: 5ae40e24-5532-41d3-8913-16ca4adaf7a3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:06.772687 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-08104674-8d07-4eaf-a12c-ea531d1c5969 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:06.773184 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-08104674-8d07-4eaf-a12c-ea531d1c5969 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:06.773634 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-08104674-8d07-4eaf-a12c-ea531d1c5969 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:06.774354 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-08104674-8d07-4eaf-a12c-ea531d1c5969 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:06.774855 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-08104674-8d07-4eaf-a12c-ea531d1c5969 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:06.775295 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-08104674-8d07-4eaf-a12c-ea531d1c5969 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:06.944283 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ebb98202-bfda-4f72-9336-f9a1275774d2 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:06.947170 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ebb98202-bfda-4f72-9336-f9a1275774d2 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 5a17fd57-ce1b-4b51-8219-cae5add11ef2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:06.964023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ebb98202-bfda-4f72-9336-f9a1275774d2 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:06.967352 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ebb98202-bfda-4f72-9336-f9a1275774d2 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:06.968283 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ebb98202-bfda-4f72-9336-f9a1275774d2 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:06.972038 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ebb98202-bfda-4f72-9336-f9a1275774d2 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:06.975592 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ebb98202-bfda-4f72-9336-f9a1275774d2 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:06.976611 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ebb98202-bfda-4f72-9336-f9a1275774d2 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:07.114732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ebb98202-bfda-4f72-9336-f9a1275774d2 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:07.148435 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-08104674-8d07-4eaf-a12c-ea531d1c5969 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3" status: 200 len: 1609 microversion: 2.1 time: 0.388572 Sep 24 20:59:07.151571 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ebb98202-bfda-4f72-9336-f9a1275774d2 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2" status: 200 len: 1272 microversion: 2.1 time: 0.220342 Sep 24 20:59:07.159822 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1266/2537] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:06 2022] GET /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3 => generated 1609 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:07.173818 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1272/2538] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:06 2022] GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2 => generated 1272 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:07.174998 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e16865e0-b7fb-4605-a4d0-6cf855359f2a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:07.178477 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d2f77eeb-3402-4626-ae94-d69a5c518639 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:07.182697 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e16865e0-b7fb-4605-a4d0-6cf855359f2a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:07.185605 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d2f77eeb-3402-4626-ae94-d69a5c518639 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:07.186109 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d2f77eeb-3402-4626-ae94-d69a5c518639 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:07.194793 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d2f77eeb-3402-4626-ae94-d69a5c518639 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:07.195795 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d2f77eeb-3402-4626-ae94-d69a5c518639 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:07.197432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d2f77eeb-3402-4626-ae94-d69a5c518639 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:07.199802 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d2f77eeb-3402-4626-ae94-d69a5c518639 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:07.210279 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e16865e0-b7fb-4605-a4d0-6cf855359f2a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:07.211037 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e16865e0-b7fb-4605-a4d0-6cf855359f2a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:07.211813 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e16865e0-b7fb-4605-a4d0-6cf855359f2a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:07.213074 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e16865e0-b7fb-4605-a4d0-6cf855359f2a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:07.213724 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e16865e0-b7fb-4605-a4d0-6cf855359f2a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:07.214329 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e16865e0-b7fb-4605-a4d0-6cf855359f2a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:07.259946 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d2f77eeb-3402-4626-ae94-d69a5c518639 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.084724 Sep 24 20:59:07.262117 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1273/2539] 10.222.0.52 () {58 vars in 1176 bytes} [Sat Sep 24 20:59:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:59:07.279783 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ec8fff01-e2e3-4e08-b9ed-98aac963e3f7 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:07.285167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ec8fff01-e2e3-4e08-b9ed-98aac963e3f7 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] [instance: 5ae40e24-5532-41d3-8913-16ca4adaf7a3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:07.290737 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e16865e0-b7fb-4605-a4d0-6cf855359f2a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.128187 Sep 24 20:59:07.293985 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ec8fff01-e2e3-4e08-b9ed-98aac963e3f7 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:07.295240 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ec8fff01-e2e3-4e08-b9ed-98aac963e3f7 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:07.296058 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1267/2540] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:07 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:59:07.296862 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ec8fff01-e2e3-4e08-b9ed-98aac963e3f7 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:07.298163 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ec8fff01-e2e3-4e08-b9ed-98aac963e3f7 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:07.298897 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ec8fff01-e2e3-4e08-b9ed-98aac963e3f7 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:07.299557 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ec8fff01-e2e3-4e08-b9ed-98aac963e3f7 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:07.336408 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-ec8fff01-e2e3-4e08-b9ed-98aac963e3f7 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Lazy-loading 'flavor' on Instance uuid 5ae40e24-5532-41d3-8913-16ca4adaf7a3 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:59:07.358262 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6b1f9dc9-080f-4638-b3de-145df6a8e43d tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b0c3b1dc0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:07.364920 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-ec8fff01-e2e3-4e08-b9ed-98aac963e3f7 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 5ae40e24-5532-41d3-8913-16ca4adaf7a3 while it is in vm_state suspended Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ec8fff01-e2e3-4e08-b9ed-98aac963e3f7 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Request method failure captured: Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3/action HTTP/1.1 Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 97 Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL29piLlF2vu8MknmtP_c8M-92ApNNfBZTmM9J0IlekXc8X-lRB9_duTsfZSLSfYiGPz4-kYgL9BEhcsMKd3cGWEcpuRQloBR69VKPVp34lGE7qYKqDmF5kunqHGwMgNgcirRiQovJyrUoXp0HMu_kS-dZxsRO4gnu-FiZdK05jBrIv0 Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: f3cec66ec0674490b3eaa3f40338f61e Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-LiveMigrationNegativeTest-1943781320 Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: X-Role: admin,reader,member Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: admin,reader,member Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3cec66ec0674490b3eaa3f40338f61e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f3cec66ec0674490b3eaa3f40338f61e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f3cec66ec0674490b3eaa3f40338f61e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3cec66ec0674490b3eaa3f40338f61e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-LiveMigrationNegativeTest-1943781320 Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: f3cec66ec0674490b3eaa3f40338f61e Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1943781320 Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-LiveMigrationNegativeTest-1943781320-project-admin Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: b5dab333d06f4c4c997e9b771a72e269 Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-LiveMigrationNegativeTest-1943781320-project-admin Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: exception: Cannot 'os-migrateLive' instance 5ae40e24-5532-41d3-8913-16ca4adaf7a3 while it is in vm_state suspended Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '5ae40e24-5532-41d3-8913-16ca4adaf7a3', 'body': {'os-migrateLive': {'host': 'nch2-master-1', 'block_migration': True, 'disk_over_commit': False}}} Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5ae40e24-5532-41d3-8913-16ca4adaf7a3 in vm_state suspended. Cannot live_migrate while the instance is in this state. Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:07.368086 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:59:07.371628 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:59:07.371628 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:59:07.371628 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:59:07.371628 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:59:07.371628 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:59:07.371628 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:59:07.371628 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:59:07.371628 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:59:07.371628 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:59:07.371628 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:59:07.371628 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:59:07.371628 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 24 20:59:07.371628 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Sep 24 20:59:07.371628 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 24 20:59:07.371628 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 24 20:59:07.371628 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 24 20:59:07.371628 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 5ae40e24-5532-41d3-8913-16ca4adaf7a3 while it is in vm_state suspended Sep 24 20:59:07.371628 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:07.371628 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:59:07.371628 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:07.371628 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:07.371628 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:59:07.371628 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:59:07.371628 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:59:07.371628 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:59:07.371628 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 5ae40e24-5532-41d3-8913-16ca4adaf7a3 while it is in vm_state suspended Sep 24 20:59:07.371628 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:07.376557 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ec8fff01-e2e3-4e08-b9ed-98aac963e3f7 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 5ae40e24-5532-41d3-8913-16ca4adaf7a3 while it is in vm_state suspended {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:59:07.377681 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ec8fff01-e2e3-4e08-b9ed-98aac963e3f7 tempest-LiveMigrationNegativeTest-1943781320 tempest-LiveMigrationNegativeTest-1943781320-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3/action" status: 409 len: 155 microversion: 2.1 time: 0.106239 Sep 24 20:59:07.378587 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1274/2541] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:59:07 2022] POST /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3/action => generated 155 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 24 20:59:07.391546 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-edcf7f54-7d5d-4a12-8574-6f5d067def09 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:07.392460 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-edcf7f54-7d5d-4a12-8574-6f5d067def09 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 5ae40e24-5532-41d3-8913-16ca4adaf7a3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:07.399453 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-edcf7f54-7d5d-4a12-8574-6f5d067def09 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:07.399723 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-edcf7f54-7d5d-4a12-8574-6f5d067def09 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:07.400321 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-edcf7f54-7d5d-4a12-8574-6f5d067def09 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:07.401057 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-edcf7f54-7d5d-4a12-8574-6f5d067def09 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:07.401517 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-edcf7f54-7d5d-4a12-8574-6f5d067def09 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:07.401972 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-edcf7f54-7d5d-4a12-8574-6f5d067def09 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:07.452572 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6b1f9dc9-080f-4638-b3de-145df6a8e43d tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3" status: 200 len: 1450 microversion: 2.1 time: 0.100014 Sep 24 20:59:07.463446 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1268/2542] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:59:07 2022] GET /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3 => generated 1450 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:07.470760 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d13d5026-4d5d-43cb-8d3b-9a610de313d7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:07.471506 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d13d5026-4d5d-43cb-8d3b-9a610de313d7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:07.486944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-edcf7f54-7d5d-4a12-8574-6f5d067def09 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 5ae40e24-5532-41d3-8913-16ca4adaf7a3] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:59:07.489589 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d13d5026-4d5d-43cb-8d3b-9a610de313d7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:07.490551 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d13d5026-4d5d-43cb-8d3b-9a610de313d7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:07.491052 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d13d5026-4d5d-43cb-8d3b-9a610de313d7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:07.491824 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d13d5026-4d5d-43cb-8d3b-9a610de313d7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:07.492973 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d13d5026-4d5d-43cb-8d3b-9a610de313d7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:07.493670 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d13d5026-4d5d-43cb-8d3b-9a610de313d7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:07.664033 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-edcf7f54-7d5d-4a12-8574-6f5d067def09 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3" status: 204 len: 0 microversion: 2.1 time: 0.275360 Sep 24 20:59:07.666738 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1275/2543] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:59:07 2022] DELETE /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:59:07.681937 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-23a9100f-08ee-49c7-9120-5961769be54a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:07.686133 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-23a9100f-08ee-49c7-9120-5961769be54a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9f8f487c-5fb4-4c63-8146-a71154f73046] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:07.706648 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23a9100f-08ee-49c7-9120-5961769be54a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:07.707168 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23a9100f-08ee-49c7-9120-5961769be54a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:07.707628 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23a9100f-08ee-49c7-9120-5961769be54a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:07.708378 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23a9100f-08ee-49c7-9120-5961769be54a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:07.708852 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23a9100f-08ee-49c7-9120-5961769be54a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:07.709290 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23a9100f-08ee-49c7-9120-5961769be54a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:07.725983 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d13d5026-4d5d-43cb-8d3b-9a610de313d7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:07.734406 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d13d5026-4d5d-43cb-8d3b-9a610de313d7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1519 microversion: 2.1 time: 0.269785 Sep 24 20:59:07.736802 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1269/2544] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:07 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1519 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:07.755812 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-497d2aab-558e-46e7-98f8-8575a57feefa tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:07.756825 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-497d2aab-558e-46e7-98f8-8575a57feefa tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 5ae40e24-5532-41d3-8913-16ca4adaf7a3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:07.769535 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-497d2aab-558e-46e7-98f8-8575a57feefa tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:07.771510 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-497d2aab-558e-46e7-98f8-8575a57feefa tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:07.772180 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-497d2aab-558e-46e7-98f8-8575a57feefa tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:07.775739 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-497d2aab-558e-46e7-98f8-8575a57feefa tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:07.776433 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-497d2aab-558e-46e7-98f8-8575a57feefa tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:07.777084 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-497d2aab-558e-46e7-98f8-8575a57feefa tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:07.797025 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-23a9100f-08ee-49c7-9120-5961769be54a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:07.808663 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-23a9100f-08ee-49c7-9120-5961769be54a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046" status: 200 len: 1267 microversion: 2.1 time: 0.140492 Sep 24 20:59:07.810131 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1276/2545] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:07 2022] GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046 => generated 1267 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:07.974786 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-497d2aab-558e-46e7-98f8-8575a57feefa tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343dddda044b8fa4eb797a4b64556a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbf416811f64df0b56656a0cf7778ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:07.983777 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-497d2aab-558e-46e7-98f8-8575a57feefa tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3" status: 200 len: 1464 microversion: 2.1 time: 0.244870 Sep 24 20:59:07.988618 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1270/2546] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:07 2022] GET /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3 => generated 1464 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:08.178116 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ac693d05-286d-4b24-bc0e-c6732b0c7af1 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:08.179197 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ac693d05-286d-4b24-bc0e-c6732b0c7af1 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 5a17fd57-ce1b-4b51-8219-cae5add11ef2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:08.191202 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ac693d05-286d-4b24-bc0e-c6732b0c7af1 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:08.192107 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ac693d05-286d-4b24-bc0e-c6732b0c7af1 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:08.192737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ac693d05-286d-4b24-bc0e-c6732b0c7af1 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:08.193900 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ac693d05-286d-4b24-bc0e-c6732b0c7af1 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:08.194558 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ac693d05-286d-4b24-bc0e-c6732b0c7af1 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:08.195151 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ac693d05-286d-4b24-bc0e-c6732b0c7af1 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:08.304808 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8aa564c7-665a-4d26-ab37-9624efaca74f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:08.308052 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8aa564c7-665a-4d26-ab37-9624efaca74f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:08.323066 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8aa564c7-665a-4d26-ab37-9624efaca74f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:08.323846 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8aa564c7-665a-4d26-ab37-9624efaca74f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:08.324488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8aa564c7-665a-4d26-ab37-9624efaca74f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:08.327028 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8aa564c7-665a-4d26-ab37-9624efaca74f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:08.327729 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8aa564c7-665a-4d26-ab37-9624efaca74f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:08.328945 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8aa564c7-665a-4d26-ab37-9624efaca74f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:08.419849 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8aa564c7-665a-4d26-ab37-9624efaca74f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.119451 Sep 24 20:59:08.420454 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1271/2547] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:08 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 20:59:08.469847 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-81fd79d7-f4c3-43c1-af64-2aa154aad813 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b1117b280>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:08.475534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ac693d05-286d-4b24-bc0e-c6732b0c7af1 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:08.496095 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ac693d05-286d-4b24-bc0e-c6732b0c7af1 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2" status: 200 len: 1312 microversion: 2.1 time: 0.322264 Sep 24 20:59:08.505721 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1277/2548] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:08 2022] GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2 => generated 1312 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:08.530555 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-81fd79d7-f4c3-43c1-af64-2aa154aad813 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3" status: 200 len: 1450 microversion: 2.1 time: 0.065596 Sep 24 20:59:08.532232 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1272/2549] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:59:08 2022] GET /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3 => generated 1450 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:59:08.763231 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-68f848a1-1c76-4c44-98a2-9f4c176141d4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:08.763770 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-68f848a1-1c76-4c44-98a2-9f4c176141d4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:08.771196 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68f848a1-1c76-4c44-98a2-9f4c176141d4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:08.772265 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68f848a1-1c76-4c44-98a2-9f4c176141d4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:08.772265 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68f848a1-1c76-4c44-98a2-9f4c176141d4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:08.772823 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68f848a1-1c76-4c44-98a2-9f4c176141d4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:08.773289 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68f848a1-1c76-4c44-98a2-9f4c176141d4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:08.774165 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68f848a1-1c76-4c44-98a2-9f4c176141d4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:08.837199 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3b56db23-7b72-4da5-9da8-954d7a922e18 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:08.838269 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3b56db23-7b72-4da5-9da8-954d7a922e18 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9f8f487c-5fb4-4c63-8146-a71154f73046] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:08.847371 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3b56db23-7b72-4da5-9da8-954d7a922e18 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:08.849679 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3b56db23-7b72-4da5-9da8-954d7a922e18 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:08.851406 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3b56db23-7b72-4da5-9da8-954d7a922e18 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:08.853084 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3b56db23-7b72-4da5-9da8-954d7a922e18 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:08.856679 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3b56db23-7b72-4da5-9da8-954d7a922e18 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:08.857406 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3b56db23-7b72-4da5-9da8-954d7a922e18 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:08.952769 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-68f848a1-1c76-4c44-98a2-9f4c176141d4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:08.962284 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-68f848a1-1c76-4c44-98a2-9f4c176141d4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1519 microversion: 2.1 time: 0.203218 Sep 24 20:59:08.967369 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1278/2550] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:08 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1519 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:08.998222 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3b56db23-7b72-4da5-9da8-954d7a922e18 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:09.009838 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ed562e77-e309-4178-9920-85c57fc2a76a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:09.010571 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ed562e77-e309-4178-9920-85c57fc2a76a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 5ae40e24-5532-41d3-8913-16ca4adaf7a3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:09.019001 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3b56db23-7b72-4da5-9da8-954d7a922e18 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046" status: 200 len: 1273 microversion: 2.1 time: 0.185033 Sep 24 20:59:09.019146 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed562e77-e309-4178-9920-85c57fc2a76a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:09.019636 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed562e77-e309-4178-9920-85c57fc2a76a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:09.020889 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed562e77-e309-4178-9920-85c57fc2a76a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:09.021048 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed562e77-e309-4178-9920-85c57fc2a76a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:09.021404 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed562e77-e309-4178-9920-85c57fc2a76a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:09.030540 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed562e77-e309-4178-9920-85c57fc2a76a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:09.030540 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:59:09.042277 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1273/2551] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:08 2022] GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046 => generated 1273 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:59:09.231541 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ed562e77-e309-4178-9920-85c57fc2a76a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343dddda044b8fa4eb797a4b64556a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbf416811f64df0b56656a0cf7778ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:09.244077 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ed562e77-e309-4178-9920-85c57fc2a76a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3" status: 200 len: 1464 microversion: 2.1 time: 0.239114 Sep 24 20:59:09.249802 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1279/2552] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:09 2022] GET /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3 => generated 1464 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:59:09.428964 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-beeed0f9-7f6d-45b8-8ff9-d87bde5608f4 req-da9f83ef-e6ee-4ab5-bb66-323ec30efdc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7021278a-14b3-48a6-a442-5278d7d00fd5", "name": "network-vif-unplugged", "status": "completed", "tag": "cea7414d-85d7-4b4b-9261-8e06b9e885f7"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:09.433154 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bed171f7-58a3-49a6-bccd-4e9319fb7e52 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:09.435449 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bed171f7-58a3-49a6-bccd-4e9319fb7e52 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:09.463072 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bed171f7-58a3-49a6-bccd-4e9319fb7e52 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:09.463589 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bed171f7-58a3-49a6-bccd-4e9319fb7e52 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:09.464042 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bed171f7-58a3-49a6-bccd-4e9319fb7e52 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:09.464780 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bed171f7-58a3-49a6-bccd-4e9319fb7e52 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:09.466115 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bed171f7-58a3-49a6-bccd-4e9319fb7e52 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:09.466238 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-beeed0f9-7f6d-45b8-8ff9-d87bde5608f4 req-da9f83ef-e6ee-4ab5-bb66-323ec30efdc7 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:09.466432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bed171f7-58a3-49a6-bccd-4e9319fb7e52 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:09.466534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-beeed0f9-7f6d-45b8-8ff9-d87bde5608f4 req-da9f83ef-e6ee-4ab5-bb66-323ec30efdc7 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:09.473905 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-beeed0f9-7f6d-45b8-8ff9-d87bde5608f4 req-da9f83ef-e6ee-4ab5-bb66-323ec30efdc7 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:09.495671 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-beeed0f9-7f6d-45b8-8ff9-d87bde5608f4 req-da9f83ef-e6ee-4ab5-bb66-323ec30efdc7 service nova] Creating event network-vif-unplugged:cea7414d-85d7-4b4b-9261-8e06b9e885f7 for instance 7021278a-14b3-48a6-a442-5278d7d00fd5 on nch2-master-1 Sep 24 20:59:09.504144 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-beeed0f9-7f6d-45b8-8ff9-d87bde5608f4 req-da9f83ef-e6ee-4ab5-bb66-323ec30efdc7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091268 Sep 24 20:59:09.504770 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1274/2553] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:59:09.536216 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bde0063f-15cd-45d7-8078-453938414267 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:09.536216 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-bde0063f-15cd-45d7-8078-453938414267 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 5a17fd57-ce1b-4b51-8219-cae5add11ef2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:09.550213 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bde0063f-15cd-45d7-8078-453938414267 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:09.550757 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bde0063f-15cd-45d7-8078-453938414267 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:09.551145 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bed171f7-58a3-49a6-bccd-4e9319fb7e52 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.120549 Sep 24 20:59:09.551273 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bde0063f-15cd-45d7-8078-453938414267 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:09.551910 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bde0063f-15cd-45d7-8078-453938414267 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:09.558053 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bde0063f-15cd-45d7-8078-453938414267 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:09.558053 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bde0063f-15cd-45d7-8078-453938414267 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:09.558779 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1280/2554] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:09 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 20:59:09.565868 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0b149592-034d-426e-af68-6bca5017d66f tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b0c126c10>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:09.666087 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0b149592-034d-426e-af68-6bca5017d66f tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3" status: 200 len: 1450 microversion: 2.1 time: 0.105603 Sep 24 20:59:09.675734 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1281/2555] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:59:09 2022] GET /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3 => generated 1450 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:09.987688 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6ba6304f-f374-484c-83a5-57453198a217 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:09.988334 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6ba6304f-f374-484c-83a5-57453198a217 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:10.005184 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ba6304f-f374-484c-83a5-57453198a217 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:10.005743 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ba6304f-f374-484c-83a5-57453198a217 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:10.006208 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ba6304f-f374-484c-83a5-57453198a217 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:10.006977 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ba6304f-f374-484c-83a5-57453198a217 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:10.007451 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ba6304f-f374-484c-83a5-57453198a217 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:10.007893 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ba6304f-f374-484c-83a5-57453198a217 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:10.092921 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-bde0063f-15cd-45d7-8078-453938414267 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:10.124330 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bde0063f-15cd-45d7-8078-453938414267 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2" status: 200 len: 1333 microversion: 2.1 time: 0.578851 Sep 24 20:59:10.150660 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1275/2556] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:09 2022] GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2 => generated 1333 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:59:10.150660 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e97e5997-8ac2-4b2a-b7fb-317ddd803e45 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:10.150660 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e97e5997-8ac2-4b2a-b7fb-317ddd803e45 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9f8f487c-5fb4-4c63-8146-a71154f73046] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:10.150660 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e97e5997-8ac2-4b2a-b7fb-317ddd803e45 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:10.150660 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e97e5997-8ac2-4b2a-b7fb-317ddd803e45 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:10.150660 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e97e5997-8ac2-4b2a-b7fb-317ddd803e45 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:10.152771 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e97e5997-8ac2-4b2a-b7fb-317ddd803e45 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:10.153327 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e97e5997-8ac2-4b2a-b7fb-317ddd803e45 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:10.153783 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e97e5997-8ac2-4b2a-b7fb-317ddd803e45 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:10.412621 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6ba6304f-f374-484c-83a5-57453198a217 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:10.424162 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6ba6304f-f374-484c-83a5-57453198a217 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1519 microversion: 2.1 time: 0.441305 Sep 24 20:59:10.424584 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1282/2557] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:09 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1519 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:10.432438 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3df202d8-545d-49c6-9c4d-79b8d8633bb2 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:10.434679 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3df202d8-545d-49c6-9c4d-79b8d8633bb2 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 5ae40e24-5532-41d3-8913-16ca4adaf7a3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:10.460515 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3df202d8-545d-49c6-9c4d-79b8d8633bb2 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:10.461359 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3df202d8-545d-49c6-9c4d-79b8d8633bb2 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:10.461961 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3df202d8-545d-49c6-9c4d-79b8d8633bb2 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:10.462891 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3df202d8-545d-49c6-9c4d-79b8d8633bb2 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:10.463499 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3df202d8-545d-49c6-9c4d-79b8d8633bb2 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:10.464074 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3df202d8-545d-49c6-9c4d-79b8d8633bb2 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:10.510288 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e97e5997-8ac2-4b2a-b7fb-317ddd803e45 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:10.523179 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e97e5997-8ac2-4b2a-b7fb-317ddd803e45 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046" status: 200 len: 1315 microversion: 2.1 time: 0.396419 Sep 24 20:59:10.524156 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1276/2558] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:10 2022] GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046 => generated 1315 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:10.566665 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-689d20c8-f5f4-431c-b72b-edbca599b839 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:10.570380 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-689d20c8-f5f4-431c-b72b-edbca599b839 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:10.577552 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-689d20c8-f5f4-431c-b72b-edbca599b839 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:10.577991 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-689d20c8-f5f4-431c-b72b-edbca599b839 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:10.578600 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-689d20c8-f5f4-431c-b72b-edbca599b839 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:10.579400 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-689d20c8-f5f4-431c-b72b-edbca599b839 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:10.579934 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-689d20c8-f5f4-431c-b72b-edbca599b839 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:10.580470 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-689d20c8-f5f4-431c-b72b-edbca599b839 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:10.651429 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-689d20c8-f5f4-431c-b72b-edbca599b839 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.089944 Sep 24 20:59:10.652226 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1277/2559] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:10 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 20:59:10.683534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c765914f-5807-43aa-91b9-4ee0ce7b30a1 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b0c3b1dc0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:10.714798 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3df202d8-545d-49c6-9c4d-79b8d8633bb2 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343dddda044b8fa4eb797a4b64556a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbf416811f64df0b56656a0cf7778ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:10.724952 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3df202d8-545d-49c6-9c4d-79b8d8633bb2 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3" status: 200 len: 1464 microversion: 2.1 time: 0.298014 Sep 24 20:59:10.729017 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1283/2560] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:10 2022] GET /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3 => generated 1464 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:10.742246 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c765914f-5807-43aa-91b9-4ee0ce7b30a1 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3" status: 200 len: 1450 microversion: 2.1 time: 0.062546 Sep 24 20:59:10.744057 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1278/2561] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:59:10 2022] GET /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3 => generated 1450 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:59:11.160636 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-00ac3f02-a671-4d7f-9ca6-4ccd18b60e3d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:11.161402 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-00ac3f02-a671-4d7f-9ca6-4ccd18b60e3d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 5a17fd57-ce1b-4b51-8219-cae5add11ef2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:11.164008 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:59:11.176026 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00ac3f02-a671-4d7f-9ca6-4ccd18b60e3d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:11.181583 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00ac3f02-a671-4d7f-9ca6-4ccd18b60e3d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:11.182143 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00ac3f02-a671-4d7f-9ca6-4ccd18b60e3d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:11.183010 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00ac3f02-a671-4d7f-9ca6-4ccd18b60e3d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:11.183569 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00ac3f02-a671-4d7f-9ca6-4ccd18b60e3d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:11.185696 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00ac3f02-a671-4d7f-9ca6-4ccd18b60e3d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:11.451289 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ba6b3b39-fc51-4f67-b3ec-89304fbacc64 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:11.452163 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ba6b3b39-fc51-4f67-b3ec-89304fbacc64 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:11.462272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba6b3b39-fc51-4f67-b3ec-89304fbacc64 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:11.466638 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-00ac3f02-a671-4d7f-9ca6-4ccd18b60e3d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:11.470366 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba6b3b39-fc51-4f67-b3ec-89304fbacc64 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:11.479134 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba6b3b39-fc51-4f67-b3ec-89304fbacc64 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:11.480772 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba6b3b39-fc51-4f67-b3ec-89304fbacc64 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:11.481377 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba6b3b39-fc51-4f67-b3ec-89304fbacc64 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:11.481819 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba6b3b39-fc51-4f67-b3ec-89304fbacc64 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:11.491220 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-00ac3f02-a671-4d7f-9ca6-4ccd18b60e3d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2" status: 200 len: 1333 microversion: 2.1 time: 0.334151 Sep 24 20:59:11.494984 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1284/2562] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:11 2022] GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2 => generated 1333 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:11.520072 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-c238b060-3134-483f-a7e6-e1785b4196c4 req-31babcdf-828f-4230-8652-99ff94c2e009 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ae40e24-5532-41d3-8913-16ca4adaf7a3", "name": "network-vif-deleted", "tag": "71677535-9a25-4279-a1b1-e5a91447a32a"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:11.537260 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-c238b060-3134-483f-a7e6-e1785b4196c4 req-31babcdf-828f-4230-8652-99ff94c2e009 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:11.542534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-c238b060-3134-483f-a7e6-e1785b4196c4 req-31babcdf-828f-4230-8652-99ff94c2e009 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:11.543183 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-c238b060-3134-483f-a7e6-e1785b4196c4 req-31babcdf-828f-4230-8652-99ff94c2e009 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:11.564314 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-c238b060-3134-483f-a7e6-e1785b4196c4 req-31babcdf-828f-4230-8652-99ff94c2e009 service nova] Creating event network-vif-deleted:71677535-9a25-4279-a1b1-e5a91447a32a for instance 5ae40e24-5532-41d3-8913-16ca4adaf7a3 on nch1-master-1 Sep 24 20:59:11.571335 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-c238b060-3134-483f-a7e6-e1785b4196c4 req-31babcdf-828f-4230-8652-99ff94c2e009 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055962 Sep 24 20:59:11.573138 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1285/2563] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:59:11.580510 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3e29289b-3239-4612-a62c-9dd7b7218862 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:11.581622 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3e29289b-3239-4612-a62c-9dd7b7218862 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9f8f487c-5fb4-4c63-8146-a71154f73046] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:11.596694 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e29289b-3239-4612-a62c-9dd7b7218862 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:11.598149 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e29289b-3239-4612-a62c-9dd7b7218862 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:11.600237 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e29289b-3239-4612-a62c-9dd7b7218862 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:11.605025 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e29289b-3239-4612-a62c-9dd7b7218862 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:11.605680 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e29289b-3239-4612-a62c-9dd7b7218862 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:11.608627 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e29289b-3239-4612-a62c-9dd7b7218862 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:11.840681 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ba6b3b39-fc51-4f67-b3ec-89304fbacc64 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:11.849691 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ba6b3b39-fc51-4f67-b3ec-89304fbacc64 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1519 microversion: 2.1 time: 0.404456 Sep 24 20:59:11.854283 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1279/2564] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:11 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1519 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:59:11.897199 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bd69a454-defa-4b32-8147-d8ffc4e9c22e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:11.908514 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-bd69a454-defa-4b32-8147-d8ffc4e9c22e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:11.923861 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bd69a454-defa-4b32-8147-d8ffc4e9c22e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:11.931386 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bd69a454-defa-4b32-8147-d8ffc4e9c22e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:11.933877 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bd69a454-defa-4b32-8147-d8ffc4e9c22e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:11.934812 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bd69a454-defa-4b32-8147-d8ffc4e9c22e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:11.935826 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bd69a454-defa-4b32-8147-d8ffc4e9c22e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:11.937355 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bd69a454-defa-4b32-8147-d8ffc4e9c22e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:11.986334 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3e29289b-3239-4612-a62c-9dd7b7218862 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:11.999587 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3e29289b-3239-4612-a62c-9dd7b7218862 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046" status: 200 len: 1315 microversion: 2.1 time: 0.424038 Sep 24 20:59:12.001894 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1286/2565] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:11 2022] GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046 => generated 1315 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:12.009005 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-382febea-a2fe-4cf1-a1ef-7b143c08b45e tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:12.010034 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-382febea-a2fe-4cf1-a1ef-7b143c08b45e tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 5ae40e24-5532-41d3-8913-16ca4adaf7a3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:12.019958 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-382febea-a2fe-4cf1-a1ef-7b143c08b45e tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:12.021003 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-382febea-a2fe-4cf1-a1ef-7b143c08b45e tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:12.021733 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-382febea-a2fe-4cf1-a1ef-7b143c08b45e tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:12.023303 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-382febea-a2fe-4cf1-a1ef-7b143c08b45e tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:12.024007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-382febea-a2fe-4cf1-a1ef-7b143c08b45e tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:12.030290 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bd69a454-defa-4b32-8147-d8ffc4e9c22e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.161882 Sep 24 20:59:12.031179 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1280/2566] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:11 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:59:12.033979 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-382febea-a2fe-4cf1-a1ef-7b143c08b45e tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:12.043069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e97b1f58-f738-429d-b5e1-c4ac9ed664df tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b1117b700>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:12.081242 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-382febea-a2fe-4cf1-a1ef-7b143c08b45e tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:12.082108 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-382febea-a2fe-4cf1-a1ef-7b143c08b45e tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:12.082734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-382febea-a2fe-4cf1-a1ef-7b143c08b45e tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:12.083353 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-382febea-a2fe-4cf1-a1ef-7b143c08b45e tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lazy-loading 'fault' on Instance uuid 5ae40e24-5532-41d3-8913-16ca4adaf7a3 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:59:12.133282 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e97b1f58-f738-429d-b5e1-c4ac9ed664df tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3" status: 200 len: 1450 microversion: 2.1 time: 0.095790 Sep 24 20:59:12.133866 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1281/2567] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:59:12 2022] GET /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3 => generated 1450 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:12.136768 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-382febea-a2fe-4cf1-a1ef-7b143c08b45e tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343dddda044b8fa4eb797a4b64556a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbf416811f64df0b56656a0cf7778ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:12.146924 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-f3dd6100-153d-49bc-9dae-64fd4a8ff3d1 req-07876f2b-82e9-4f79-af64-e9eb92779832 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7021278a-14b3-48a6-a442-5278d7d00fd5", "name": "network-vif-plugged", "status": "completed", "tag": "cea7414d-85d7-4b4b-9261-8e06b9e885f7"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:12.167853 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-f3dd6100-153d-49bc-9dae-64fd4a8ff3d1 req-07876f2b-82e9-4f79-af64-e9eb92779832 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:12.168281 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-382febea-a2fe-4cf1-a1ef-7b143c08b45e tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3" status: 200 len: 1308 microversion: 2.1 time: 0.165011 Sep 24 20:59:12.170172 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1287/2568] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:12 2022] GET /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3 => generated 1308 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:12.170960 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-f3dd6100-153d-49bc-9dae-64fd4a8ff3d1 req-07876f2b-82e9-4f79-af64-e9eb92779832 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:12.174451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-f3dd6100-153d-49bc-9dae-64fd4a8ff3d1 req-07876f2b-82e9-4f79-af64-e9eb92779832 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:12.207458 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-f3dd6100-153d-49bc-9dae-64fd4a8ff3d1 req-07876f2b-82e9-4f79-af64-e9eb92779832 service nova] Creating event network-vif-plugged:cea7414d-85d7-4b4b-9261-8e06b9e885f7 for instance 7021278a-14b3-48a6-a442-5278d7d00fd5 on nch2-master-1 Sep 24 20:59:12.216297 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-f3dd6100-153d-49bc-9dae-64fd4a8ff3d1 req-07876f2b-82e9-4f79-af64-e9eb92779832 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081121 Sep 24 20:59:12.224282 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1282/2569] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:59:12.519253 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9b2db465-ba95-443f-b1f4-fa6a09aa5312 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:12.520662 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9b2db465-ba95-443f-b1f4-fa6a09aa5312 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 5a17fd57-ce1b-4b51-8219-cae5add11ef2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:12.531066 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9b2db465-ba95-443f-b1f4-fa6a09aa5312 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:12.531968 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9b2db465-ba95-443f-b1f4-fa6a09aa5312 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:12.532636 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9b2db465-ba95-443f-b1f4-fa6a09aa5312 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:12.533404 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9b2db465-ba95-443f-b1f4-fa6a09aa5312 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:12.534066 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9b2db465-ba95-443f-b1f4-fa6a09aa5312 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:12.534726 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9b2db465-ba95-443f-b1f4-fa6a09aa5312 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:12.725857 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9b2db465-ba95-443f-b1f4-fa6a09aa5312 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:12.736373 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9b2db465-ba95-443f-b1f4-fa6a09aa5312 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2" status: 200 len: 1333 microversion: 2.1 time: 0.221532 Sep 24 20:59:12.737177 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1288/2570] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:12 2022] GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2 => generated 1333 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:12.883434 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2643fd92-2d3b-4b41-9dee-5ff5d543ecc3 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:12.884251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2643fd92-2d3b-4b41-9dee-5ff5d543ecc3 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:12.902642 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2643fd92-2d3b-4b41-9dee-5ff5d543ecc3 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:12.903275 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2643fd92-2d3b-4b41-9dee-5ff5d543ecc3 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:12.906022 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2643fd92-2d3b-4b41-9dee-5ff5d543ecc3 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:12.907158 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2643fd92-2d3b-4b41-9dee-5ff5d543ecc3 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:12.910254 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2643fd92-2d3b-4b41-9dee-5ff5d543ecc3 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:12.910935 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2643fd92-2d3b-4b41-9dee-5ff5d543ecc3 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:13.028202 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7368fd1b-9e5a-4224-a80c-08846e3338f8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:13.029242 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7368fd1b-9e5a-4224-a80c-08846e3338f8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9f8f487c-5fb4-4c63-8146-a71154f73046] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:13.039765 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7368fd1b-9e5a-4224-a80c-08846e3338f8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:13.043194 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7368fd1b-9e5a-4224-a80c-08846e3338f8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:13.047061 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7368fd1b-9e5a-4224-a80c-08846e3338f8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:13.048381 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7368fd1b-9e5a-4224-a80c-08846e3338f8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:13.048859 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7368fd1b-9e5a-4224-a80c-08846e3338f8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:13.049307 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7368fd1b-9e5a-4224-a80c-08846e3338f8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:13.108514 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2643fd92-2d3b-4b41-9dee-5ff5d543ecc3 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:13.118840 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2643fd92-2d3b-4b41-9dee-5ff5d543ecc3 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1519 microversion: 2.1 time: 0.240393 Sep 24 20:59:13.138431 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1283/2571] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:12 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1519 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:13.145109 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-81626030-86ac-48d0-b88b-1212ee14ed9d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:13.147742 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-81626030-86ac-48d0-b88b-1212ee14ed9d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:13.158026 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81626030-86ac-48d0-b88b-1212ee14ed9d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:13.159311 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81626030-86ac-48d0-b88b-1212ee14ed9d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:13.160493 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81626030-86ac-48d0-b88b-1212ee14ed9d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:13.161465 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81626030-86ac-48d0-b88b-1212ee14ed9d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:13.162599 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81626030-86ac-48d0-b88b-1212ee14ed9d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:13.163182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81626030-86ac-48d0-b88b-1212ee14ed9d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:13.217547 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-81626030-86ac-48d0-b88b-1212ee14ed9d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.077545 Sep 24 20:59:13.220044 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1284/2572] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:13 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:59:13.225114 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-98e85088-a8d3-4fea-a4ca-7968ae25f643 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b0cb0cb80>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:13.247333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7368fd1b-9e5a-4224-a80c-08846e3338f8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:13.275768 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7368fd1b-9e5a-4224-a80c-08846e3338f8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046" status: 200 len: 1315 microversion: 2.1 time: 0.247860 Sep 24 20:59:13.289358 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1289/2573] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:13 2022] GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:13.298318 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-76e5b015-ceb2-48ef-8439-74564f435804 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:13.300367 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-76e5b015-ceb2-48ef-8439-74564f435804 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 5ae40e24-5532-41d3-8913-16ca4adaf7a3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:13.310318 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-98e85088-a8d3-4fea-a4ca-7968ae25f643 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3" status: 200 len: 1450 microversion: 2.1 time: 0.088895 Sep 24 20:59:13.310965 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1285/2574] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:59:13 2022] GET /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3 => generated 1450 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:13.318459 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76e5b015-ceb2-48ef-8439-74564f435804 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:13.318459 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76e5b015-ceb2-48ef-8439-74564f435804 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:13.318459 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76e5b015-ceb2-48ef-8439-74564f435804 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:13.318459 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76e5b015-ceb2-48ef-8439-74564f435804 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:13.319338 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76e5b015-ceb2-48ef-8439-74564f435804 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:13.319878 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76e5b015-ceb2-48ef-8439-74564f435804 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:13.359842 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-76e5b015-ceb2-48ef-8439-74564f435804 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] HTTP exception thrown: Instance 5ae40e24-5532-41d3-8913-16ca4adaf7a3 could not be found. Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-76e5b015-ceb2-48ef-8439-74564f435804 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Request method failure captured: Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3 HTTP/1.1 Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL29oVeq1tSokQtiulSH-jZ1loxxpChILZU-Pa06b6-kCb6dFkOOJBNdJ_QcaKscjUES5R_tS1-OieV5kH0KkPOlTTA9X0pCwK9h7UEm1S-26agS6j9cctGC_s1VYRa78TLofA_VVZthTEqxyXcEWUeNZtNimDb5OE0iEVryQoS5lhjQ Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: ffbf416811f64df0b56656a0cf7778ce Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-LiveMigrationNegativeTest-981125536 Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ffbf416811f64df0b56656a0cf7778ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ffbf416811f64df0b56656a0cf7778ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ffbf416811f64df0b56656a0cf7778ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ffbf416811f64df0b56656a0cf7778ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-LiveMigrationNegativeTest-981125536 Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: ffbf416811f64df0b56656a0cf7778ce Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-981125536 Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-LiveMigrationNegativeTest-981125536-project Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 1a343dddda044b8fa4eb797a4b64556a Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-LiveMigrationNegativeTest-981125536-project Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 5ae40e24-5532-41d3-8913-16ca4adaf7a3 could not be found. Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '5ae40e24-5532-41d3-8913-16ca4adaf7a3'} Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ae40e24-5532-41d3-8913-16ca4adaf7a3 could not be found. Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ae40e24-5532-41d3-8913-16ca4adaf7a3 could not be found. Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:59:13.361562 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:13.365754 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:13.365754 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:59:13.365754 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:59:13.365754 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:59:13.365754 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:59:13.365754 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ae40e24-5532-41d3-8913-16ca4adaf7a3 could not be found. Sep 24 20:59:13.365754 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:13.365754 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-76e5b015-ceb2-48ef-8439-74564f435804 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Returning 404 to user: Instance 5ae40e24-5532-41d3-8913-16ca4adaf7a3 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:59:13.365754 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-76e5b015-ceb2-48ef-8439-74564f435804 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3" status: 404 len: 111 microversion: 2.1 time: 0.085354 Sep 24 20:59:13.370791 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1290/2575] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:13 2022] GET /compute/v2.1/servers/5ae40e24-5532-41d3-8913-16ca4adaf7a3 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:59:13.376744 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-26712b3b-3bb5-4b30-97ba-edced69ebc84 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:13.377261 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-26712b3b-3bb5-4b30-97ba-edced69ebc84 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 72bfdb29-fd39-41a3-8314-624925dcd0b3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:13.388550 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26712b3b-3bb5-4b30-97ba-edced69ebc84 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:13.390728 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26712b3b-3bb5-4b30-97ba-edced69ebc84 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:13.393505 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26712b3b-3bb5-4b30-97ba-edced69ebc84 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:13.394739 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26712b3b-3bb5-4b30-97ba-edced69ebc84 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:13.395425 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26712b3b-3bb5-4b30-97ba-edced69ebc84 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:13.396572 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26712b3b-3bb5-4b30-97ba-edced69ebc84 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:13.452242 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-26712b3b-3bb5-4b30-97ba-edced69ebc84 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 72bfdb29-fd39-41a3-8314-624925dcd0b3] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:59:13.468041 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:59:13.598781 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-26712b3b-3bb5-4b30-97ba-edced69ebc84 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "DELETE /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3" status: 204 len: 0 microversion: 2.1 time: 0.228004 Sep 24 20:59:13.599678 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1286/2576] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:59:13 2022] DELETE /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 24 20:59:13.608637 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-573f3285-d5aa-4309-ae90-6cd39724c915 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:13.609265 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-573f3285-d5aa-4309-ae90-6cd39724c915 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 72bfdb29-fd39-41a3-8314-624925dcd0b3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:13.609529 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-155a0049-75ac-41f7-951a-27aec466536f req-1b91feb7-5eb5-4f01-bf81-6deba384fea3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f8f487c-5fb4-4c63-8146-a71154f73046", "tag": "0028c831-6285-486f-978f-e4a36e4183a5"}, {"name": "network-changed", "server_uuid": "5a17fd57-ce1b-4b51-8219-cae5add11ef2", "tag": "957e661f-4b67-484a-a751-9619aed2316e"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:13.623978 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-155a0049-75ac-41f7-951a-27aec466536f req-1b91feb7-5eb5-4f01-bf81-6deba384fea3 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:13.624654 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-155a0049-75ac-41f7-951a-27aec466536f req-1b91feb7-5eb5-4f01-bf81-6deba384fea3 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:13.624957 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-155a0049-75ac-41f7-951a-27aec466536f req-1b91feb7-5eb5-4f01-bf81-6deba384fea3 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:13.644156 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-573f3285-d5aa-4309-ae90-6cd39724c915 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:13.644673 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-573f3285-d5aa-4309-ae90-6cd39724c915 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:13.645128 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-573f3285-d5aa-4309-ae90-6cd39724c915 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:13.646278 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-573f3285-d5aa-4309-ae90-6cd39724c915 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:13.647169 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-573f3285-d5aa-4309-ae90-6cd39724c915 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:13.648123 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-573f3285-d5aa-4309-ae90-6cd39724c915 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:13.670718 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-155a0049-75ac-41f7-951a-27aec466536f req-1b91feb7-5eb5-4f01-bf81-6deba384fea3 service nova] Creating event network-changed:0028c831-6285-486f-978f-e4a36e4183a5 for instance 9f8f487c-5fb4-4c63-8146-a71154f73046 on nch2-master-1 Sep 24 20:59:13.671408 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-155a0049-75ac-41f7-951a-27aec466536f req-1b91feb7-5eb5-4f01-bf81-6deba384fea3 service nova] Creating event network-changed:957e661f-4b67-484a-a751-9619aed2316e for instance 5a17fd57-ce1b-4b51-8219-cae5add11ef2 on nch2-master-1 Sep 24 20:59:13.680123 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-155a0049-75ac-41f7-951a-27aec466536f req-1b91feb7-5eb5-4f01-bf81-6deba384fea3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.075404 Sep 24 20:59:13.681618 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1287/2577] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:59:13.783887 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3edf2c11-e577-43f1-8ac0-23e6e4487ecf tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:13.785168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3edf2c11-e577-43f1-8ac0-23e6e4487ecf tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 5a17fd57-ce1b-4b51-8219-cae5add11ef2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:13.809221 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3edf2c11-e577-43f1-8ac0-23e6e4487ecf tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:13.809732 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3edf2c11-e577-43f1-8ac0-23e6e4487ecf tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:13.810177 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3edf2c11-e577-43f1-8ac0-23e6e4487ecf tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:13.811113 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3edf2c11-e577-43f1-8ac0-23e6e4487ecf tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:13.811669 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3edf2c11-e577-43f1-8ac0-23e6e4487ecf tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:13.812034 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3edf2c11-e577-43f1-8ac0-23e6e4487ecf tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:13.999142 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-573f3285-d5aa-4309-ae90-6cd39724c915 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343dddda044b8fa4eb797a4b64556a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbf416811f64df0b56656a0cf7778ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:14.030307 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-573f3285-d5aa-4309-ae90-6cd39724c915 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3" status: 200 len: 1474 microversion: 2.1 time: 0.425827 Sep 24 20:59:14.053402 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1291/2578] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:13 2022] GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3 => generated 1474 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:14.111520 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3edf2c11-e577-43f1-8ac0-23e6e4487ecf tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:14.120779 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3edf2c11-e577-43f1-8ac0-23e6e4487ecf tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2" status: 200 len: 1333 microversion: 2.1 time: 0.359980 Sep 24 20:59:14.121356 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1288/2579] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:13 2022] GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2 => generated 1333 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:59:14.160595 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bf1ff5ed-279c-41bc-968d-8b82d1935a76 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:14.161465 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bf1ff5ed-279c-41bc-968d-8b82d1935a76 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:14.178486 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf1ff5ed-279c-41bc-968d-8b82d1935a76 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:14.179895 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf1ff5ed-279c-41bc-968d-8b82d1935a76 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:14.181944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf1ff5ed-279c-41bc-968d-8b82d1935a76 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:14.186578 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf1ff5ed-279c-41bc-968d-8b82d1935a76 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:14.187282 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf1ff5ed-279c-41bc-968d-8b82d1935a76 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:14.187985 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf1ff5ed-279c-41bc-968d-8b82d1935a76 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:14.232498 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d211f088-f274-4054-90e2-68c648d261e9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:14.235996 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d211f088-f274-4054-90e2-68c648d261e9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:14.249246 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d211f088-f274-4054-90e2-68c648d261e9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:14.256496 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d211f088-f274-4054-90e2-68c648d261e9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:14.259740 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d211f088-f274-4054-90e2-68c648d261e9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:14.260836 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d211f088-f274-4054-90e2-68c648d261e9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:14.271093 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d211f088-f274-4054-90e2-68c648d261e9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:14.271595 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d211f088-f274-4054-90e2-68c648d261e9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:14.358049 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d211f088-f274-4054-90e2-68c648d261e9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.128173 Sep 24 20:59:14.358864 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1289/2580] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:14 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 20:59:14.366257 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-02743833-6616-4c74-956d-3af43186e57c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:14.368249 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-02743833-6616-4c74-956d-3af43186e57c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9f8f487c-5fb4-4c63-8146-a71154f73046] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:14.376940 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:59:14.379213 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-02743833-6616-4c74-956d-3af43186e57c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:14.380134 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-02743833-6616-4c74-956d-3af43186e57c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:14.380724 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-02743833-6616-4c74-956d-3af43186e57c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:14.382123 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-02743833-6616-4c74-956d-3af43186e57c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:14.383787 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-02743833-6616-4c74-956d-3af43186e57c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:14.384383 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-02743833-6616-4c74-956d-3af43186e57c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:14.439082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bf1ff5ed-279c-41bc-968d-8b82d1935a76 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:14.450553 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bf1ff5ed-279c-41bc-968d-8b82d1935a76 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1519 microversion: 2.1 time: 0.309530 Sep 24 20:59:14.464737 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1292/2581] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:14 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1519 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:14.464737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-032948c8-370d-4270-bbc1-45f1c89c138b tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b07d82dc0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:14.549645 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-032948c8-370d-4270-bbc1-45f1c89c138b tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3" status: 200 len: 1450 microversion: 2.1 time: 0.088364 Sep 24 20:59:14.550627 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1293/2582] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:59:14 2022] GET /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3 => generated 1450 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:14.644272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-02743833-6616-4c74-956d-3af43186e57c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:14.658352 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-02743833-6616-4c74-956d-3af43186e57c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046" status: 200 len: 1315 microversion: 2.1 time: 0.295741 Sep 24 20:59:14.658975 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1290/2583] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:14 2022] GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046 => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:15.060114 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-98682a59-947a-4e00-918c-a3d4e25c8e6c tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:15.062317 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-98682a59-947a-4e00-918c-a3d4e25c8e6c tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 72bfdb29-fd39-41a3-8314-624925dcd0b3] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:15.074068 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98682a59-947a-4e00-918c-a3d4e25c8e6c tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:15.074606 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98682a59-947a-4e00-918c-a3d4e25c8e6c tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:15.075062 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98682a59-947a-4e00-918c-a3d4e25c8e6c tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:15.075779 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98682a59-947a-4e00-918c-a3d4e25c8e6c tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:15.076241 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98682a59-947a-4e00-918c-a3d4e25c8e6c tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:15.076903 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98682a59-947a-4e00-918c-a3d4e25c8e6c tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:15.144340 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a670650b-2c23-4697-b89e-e00c99206d41 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:15.144966 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a670650b-2c23-4697-b89e-e00c99206d41 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 5a17fd57-ce1b-4b51-8219-cae5add11ef2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:15.147129 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:59:15.148453 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:59:15.159960 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a670650b-2c23-4697-b89e-e00c99206d41 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:15.160745 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a670650b-2c23-4697-b89e-e00c99206d41 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:15.161525 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a670650b-2c23-4697-b89e-e00c99206d41 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:15.162458 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a670650b-2c23-4697-b89e-e00c99206d41 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:15.163816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a670650b-2c23-4697-b89e-e00c99206d41 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:15.164461 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a670650b-2c23-4697-b89e-e00c99206d41 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:15.267773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-98682a59-947a-4e00-918c-a3d4e25c8e6c tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343dddda044b8fa4eb797a4b64556a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbf416811f64df0b56656a0cf7778ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:15.278317 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-98682a59-947a-4e00-918c-a3d4e25c8e6c tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3" status: 200 len: 1474 microversion: 2.1 time: 0.223711 Sep 24 20:59:15.284439 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1294/2584] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:15 2022] GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3 => generated 1474 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:15.378417 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a670650b-2c23-4697-b89e-e00c99206d41 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:15.385514 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-38d3e6f0-c759-48e7-a7aa-a9d31f6eb4fa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:15.388048 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-38d3e6f0-c759-48e7-a7aa-a9d31f6eb4fa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:15.393130 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a670650b-2c23-4697-b89e-e00c99206d41 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2" status: 200 len: 1333 microversion: 2.1 time: 0.253163 Sep 24 20:59:15.398384 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=10 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:59:15.399179 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1291/2585] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:15 2022] GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2 => generated 1333 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:15.403316 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38d3e6f0-c759-48e7-a7aa-a9d31f6eb4fa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:15.404542 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38d3e6f0-c759-48e7-a7aa-a9d31f6eb4fa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:15.405216 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38d3e6f0-c759-48e7-a7aa-a9d31f6eb4fa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:15.407001 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38d3e6f0-c759-48e7-a7aa-a9d31f6eb4fa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:15.407686 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38d3e6f0-c759-48e7-a7aa-a9d31f6eb4fa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:15.408369 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38d3e6f0-c759-48e7-a7aa-a9d31f6eb4fa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:15.448492 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-38d3e6f0-c759-48e7-a7aa-a9d31f6eb4fa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.079022 Sep 24 20:59:15.454296 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1295/2586] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:15 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:59:15.481659 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2c23019b-64db-4dea-93f6-43fe3b1177f9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:15.482328 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2c23019b-64db-4dea-93f6-43fe3b1177f9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:15.496520 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c23019b-64db-4dea-93f6-43fe3b1177f9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:15.497052 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c23019b-64db-4dea-93f6-43fe3b1177f9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:15.497495 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c23019b-64db-4dea-93f6-43fe3b1177f9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:15.498206 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c23019b-64db-4dea-93f6-43fe3b1177f9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:15.498691 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c23019b-64db-4dea-93f6-43fe3b1177f9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:15.499323 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c23019b-64db-4dea-93f6-43fe3b1177f9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:15.567325 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3ab109d0-baf6-43f4-b583-2c8609573510 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b07e5e4c0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:15.644637 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3ab109d0-baf6-43f4-b583-2c8609573510 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3" status: 200 len: 1450 microversion: 2.1 time: 0.082475 Sep 24 20:59:15.645501 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1296/2587] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:59:15 2022] GET /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3 => generated 1450 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:15.684860 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f35ac008-95ca-4e2e-a7d2-b5a336cdd680 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:15.685482 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f35ac008-95ca-4e2e-a7d2-b5a336cdd680 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9f8f487c-5fb4-4c63-8146-a71154f73046] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:15.696277 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f35ac008-95ca-4e2e-a7d2-b5a336cdd680 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:15.708123 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f35ac008-95ca-4e2e-a7d2-b5a336cdd680 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:15.708648 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f35ac008-95ca-4e2e-a7d2-b5a336cdd680 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:15.709434 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f35ac008-95ca-4e2e-a7d2-b5a336cdd680 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:15.709903 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f35ac008-95ca-4e2e-a7d2-b5a336cdd680 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:15.710340 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f35ac008-95ca-4e2e-a7d2-b5a336cdd680 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:15.796216 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2c23019b-64db-4dea-93f6-43fe3b1177f9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:15.808593 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2c23019b-64db-4dea-93f6-43fe3b1177f9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1504 microversion: 2.1 time: 0.329835 Sep 24 20:59:15.811938 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1292/2588] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:15 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1504 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:15.823890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-61bd0717-5117-4063-939a-9b2c518f86aa req-61b25dee-3e0c-445d-8ebc-5b08708c9963 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a17fd57-ce1b-4b51-8219-cae5add11ef2", "tag": "dfa66666-312a-49e4-b3f6-f9525bebbd5f"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:15.851077 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-61bd0717-5117-4063-939a-9b2c518f86aa req-61b25dee-3e0c-445d-8ebc-5b08708c9963 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:15.851579 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-61bd0717-5117-4063-939a-9b2c518f86aa req-61b25dee-3e0c-445d-8ebc-5b08708c9963 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:15.853045 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-61bd0717-5117-4063-939a-9b2c518f86aa req-61b25dee-3e0c-445d-8ebc-5b08708c9963 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:15.899744 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-61bd0717-5117-4063-939a-9b2c518f86aa req-61b25dee-3e0c-445d-8ebc-5b08708c9963 service nova] Creating event network-changed:dfa66666-312a-49e4-b3f6-f9525bebbd5f for instance 5a17fd57-ce1b-4b51-8219-cae5add11ef2 on nch2-master-1 Sep 24 20:59:15.905198 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-61bd0717-5117-4063-939a-9b2c518f86aa req-61b25dee-3e0c-445d-8ebc-5b08708c9963 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092352 Sep 24 20:59:15.909336 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1293/2589] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:59:15.921806 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-36d15813-dd95-4bdb-be93-632084673287 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:15.922595 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-36d15813-dd95-4bdb-be93-632084673287 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:15.936122 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36d15813-dd95-4bdb-be93-632084673287 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:15.936621 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36d15813-dd95-4bdb-be93-632084673287 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:15.937067 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36d15813-dd95-4bdb-be93-632084673287 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:15.946067 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36d15813-dd95-4bdb-be93-632084673287 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:15.946611 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36d15813-dd95-4bdb-be93-632084673287 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:15.947069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36d15813-dd95-4bdb-be93-632084673287 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:15.998345 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f35ac008-95ca-4e2e-a7d2-b5a336cdd680 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:16.012611 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f35ac008-95ca-4e2e-a7d2-b5a336cdd680 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046" status: 200 len: 1315 microversion: 2.1 time: 0.329429 Sep 24 20:59:16.013599 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1297/2590] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:15 2022] GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046 => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:16.025148 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f6689775-0662-4aa5-aa56-80db9a47d027 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-197704612", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "cf0eb8e6-8c78-4ee2-84ea-f873689ed3ba"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:16.119642 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-f6689775-0662-4aa5-aa56-80db9a47d027 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] validate_networks() for [('cf0eb8e6-8c78-4ee2-84ea-f873689ed3ba', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:59:16.341784 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-36d15813-dd95-4bdb-be93-632084673287 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:16.355862 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-36d15813-dd95-4bdb-be93-632084673287 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 200 len: 1504 microversion: 2.1 time: 0.444495 Sep 24 20:59:16.356682 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1294/2591] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:15 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 1504 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:16.368136 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-51a8ca2a-f8b1-41be-addb-c95deeb5b57a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:16.374644 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-51a8ca2a-f8b1-41be-addb-c95deeb5b57a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 72bfdb29-fd39-41a3-8314-624925dcd0b3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:16.401055 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51a8ca2a-f8b1-41be-addb-c95deeb5b57a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:16.401660 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51a8ca2a-f8b1-41be-addb-c95deeb5b57a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:16.402109 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51a8ca2a-f8b1-41be-addb-c95deeb5b57a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:16.403120 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51a8ca2a-f8b1-41be-addb-c95deeb5b57a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:16.403326 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51a8ca2a-f8b1-41be-addb-c95deeb5b57a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:16.403753 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51a8ca2a-f8b1-41be-addb-c95deeb5b57a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:16.482869 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51a8ca2a-f8b1-41be-addb-c95deeb5b57a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:16.483645 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51a8ca2a-f8b1-41be-addb-c95deeb5b57a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:16.484088 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51a8ca2a-f8b1-41be-addb-c95deeb5b57a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:16.484792 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-51a8ca2a-f8b1-41be-addb-c95deeb5b57a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lazy-loading 'fault' on Instance uuid 72bfdb29-fd39-41a3-8314-624925dcd0b3 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:59:16.549719 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-51a8ca2a-f8b1-41be-addb-c95deeb5b57a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a343dddda044b8fa4eb797a4b64556a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbf416811f64df0b56656a0cf7778ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:16.558835 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-51a8ca2a-f8b1-41be-addb-c95deeb5b57a tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3" status: 200 len: 1308 microversion: 2.1 time: 0.197124 Sep 24 20:59:16.566658 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1295/2592] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:16 2022] GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3 => generated 1308 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:16.571963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-30513b70-634a-41ae-876b-56db479b7307 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:16.572624 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-30513b70-634a-41ae-876b-56db479b7307 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:16.586857 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-30513b70-634a-41ae-876b-56db479b7307 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:16.589221 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-30513b70-634a-41ae-876b-56db479b7307 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:16.589690 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-30513b70-634a-41ae-876b-56db479b7307 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:16.591177 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-30513b70-634a-41ae-876b-56db479b7307 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:16.591657 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-30513b70-634a-41ae-876b-56db479b7307 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:16.592612 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-30513b70-634a-41ae-876b-56db479b7307 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:16.622683 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-30513b70-634a-41ae-876b-56db479b7307 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:59:16.713596 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-30513b70-634a-41ae-876b-56db479b7307 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 204 len: 0 microversion: 2.1 time: 0.145159 Sep 24 20:59:16.730083 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1296/2593] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:59:16 2022] DELETE /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:59:16.730083 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3c3ba33e-9769-4a9b-b9df-ffb49b6d0a56 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:16.730083 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3c3ba33e-9769-4a9b-b9df-ffb49b6d0a56 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 5a17fd57-ce1b-4b51-8219-cae5add11ef2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:16.741076 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c3ba33e-9769-4a9b-b9df-ffb49b6d0a56 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:16.742379 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c3ba33e-9769-4a9b-b9df-ffb49b6d0a56 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:16.742379 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c3ba33e-9769-4a9b-b9df-ffb49b6d0a56 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:16.743558 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c3ba33e-9769-4a9b-b9df-ffb49b6d0a56 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:16.744143 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c3ba33e-9769-4a9b-b9df-ffb49b6d0a56 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:16.744706 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c3ba33e-9769-4a9b-b9df-ffb49b6d0a56 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:16.795466 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-f6689775-0662-4aa5-aa56-80db9a47d027 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:59:16.796536 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-f6689775-0662-4aa5-aa56-80db9a47d027 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:59:16.797861 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-f6689775-0662-4aa5-aa56-80db9a47d027 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:59:16.798460 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-f6689775-0662-4aa5-aa56-80db9a47d027 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:59:16.798943 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-f6689775-0662-4aa5-aa56-80db9a47d027 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:59:16.820113 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6689775-0662-4aa5-aa56-80db9a47d027 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:16.821008 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6689775-0662-4aa5-aa56-80db9a47d027 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:16.821682 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6689775-0662-4aa5-aa56-80db9a47d027 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:16.822697 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6689775-0662-4aa5-aa56-80db9a47d027 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:16.823375 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6689775-0662-4aa5-aa56-80db9a47d027 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:16.824022 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6689775-0662-4aa5-aa56-80db9a47d027 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:16.851595 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-f6689775-0662-4aa5-aa56-80db9a47d027 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Getting quotas for project c4004a1dbc2441f8a5c4ace42af3e2df. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:59:16.858305 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-f6689775-0662-4aa5-aa56-80db9a47d027 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Getting quotas for user 31761ade4b4a4df580fd5de55426eb0b and project c4004a1dbc2441f8a5c4ace42af3e2df. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:59:16.874272 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f6689775-0662-4aa5-aa56-80db9a47d027 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:59:16.877600 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f6689775-0662-4aa5-aa56-80db9a47d027 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: 61376b92-427e-4de0-9a8f-89828ce607fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:59:16.941028 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f6689775-0662-4aa5-aa56-80db9a47d027 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.926023 Sep 24 20:59:16.942181 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1298/2594] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:59:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:59:16.947513 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-46d076b3-1b68-4d0a-b0bb-3b6e8aba510e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:16.950332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-46d076b3-1b68-4d0a-b0bb-3b6e8aba510e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:16.958227 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46d076b3-1b68-4d0a-b0bb-3b6e8aba510e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:16.958866 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46d076b3-1b68-4d0a-b0bb-3b6e8aba510e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:16.959356 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46d076b3-1b68-4d0a-b0bb-3b6e8aba510e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:16.960357 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46d076b3-1b68-4d0a-b0bb-3b6e8aba510e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:16.960629 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46d076b3-1b68-4d0a-b0bb-3b6e8aba510e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:16.961080 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46d076b3-1b68-4d0a-b0bb-3b6e8aba510e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:16.998258 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-46d076b3-1b68-4d0a-b0bb-3b6e8aba510e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.054950 Sep 24 20:59:16.999134 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1299/2595] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:16 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:59:17.007763 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-befebf29-d60d-4f61-b796-8591b8f64789 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b07ed6670>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:17.068755 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-befebf29-d60d-4f61-b796-8591b8f64789 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3" status: 200 len: 1459 microversion: 2.1 time: 0.065091 Sep 24 20:59:17.069714 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1300/2596] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:59:16 2022] GET /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3 => generated 1459 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:17.075150 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-01f88478-95f4-481c-a74b-1e696510d7a8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-145872874", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "4d177ad8-2ce8-4cf6-95f9-d9dcf8f31aa4"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:17.135692 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-01f88478-95f4-481c-a74b-1e696510d7a8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] validate_networks() for [('4d177ad8-2ce8-4cf6-95f9-d9dcf8f31aa4', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:59:17.316775 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3c3ba33e-9769-4a9b-b9df-ffb49b6d0a56 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:17.327796 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3c3ba33e-9769-4a9b-b9df-ffb49b6d0a56 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2" status: 200 len: 1333 microversion: 2.1 time: 0.606410 Sep 24 20:59:17.329261 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1297/2597] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:16 2022] GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2 => generated 1333 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:17.334384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d7be1028-9168-4649-af26-5e9e5429fe7e tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:17.335279 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d7be1028-9168-4649-af26-5e9e5429fe7e tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: 61376b92-427e-4de0-9a8f-89828ce607fd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:17.403572 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d7be1028-9168-4649-af26-5e9e5429fe7e tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:17.412445 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d7be1028-9168-4649-af26-5e9e5429fe7e tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/61376b92-427e-4de0-9a8f-89828ce607fd" status: 200 len: 1217 microversion: 2.1 time: 0.081922 Sep 24 20:59:17.413055 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1298/2598] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:17 2022] GET /compute/v2.1/servers/61376b92-427e-4de0-9a8f-89828ce607fd => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:17.428658 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ac844fc5-8dbd-4bb0-a273-c50cd0d78442 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:17.429307 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ac844fc5-8dbd-4bb0-a273-c50cd0d78442 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9f8f487c-5fb4-4c63-8146-a71154f73046] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:17.438469 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac844fc5-8dbd-4bb0-a273-c50cd0d78442 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:17.439125 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac844fc5-8dbd-4bb0-a273-c50cd0d78442 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:17.439699 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac844fc5-8dbd-4bb0-a273-c50cd0d78442 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:17.440450 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac844fc5-8dbd-4bb0-a273-c50cd0d78442 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:17.440915 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac844fc5-8dbd-4bb0-a273-c50cd0d78442 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:17.441357 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac844fc5-8dbd-4bb0-a273-c50cd0d78442 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:17.651446 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ac844fc5-8dbd-4bb0-a273-c50cd0d78442 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:17.663065 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ac844fc5-8dbd-4bb0-a273-c50cd0d78442 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046" status: 200 len: 1315 microversion: 2.1 time: 0.248691 Sep 24 20:59:17.664568 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1299/2599] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:17 2022] GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:17.670713 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cf7d3994-0f83-40a0-93f0-41c14c64e5cc tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b0cacb0d0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:17.727235 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cf7d3994-0f83-40a0-93f0-41c14c64e5cc tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3" status: 200 len: 1459 microversion: 2.1 time: 0.061536 Sep 24 20:59:17.728521 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1300/2600] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:59:17 2022] GET /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3 => generated 1459 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:17.734301 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c5b8d5da-1406-4ad3-b6d5-e4a0ce6c6390 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:17.736295 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c5b8d5da-1406-4ad3-b6d5-e4a0ce6c6390 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] [instance: 72bfdb29-fd39-41a3-8314-624925dcd0b3] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:17.743553 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5b8d5da-1406-4ad3-b6d5-e4a0ce6c6390 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:17.744146 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5b8d5da-1406-4ad3-b6d5-e4a0ce6c6390 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:17.744664 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5b8d5da-1406-4ad3-b6d5-e4a0ce6c6390 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:17.745498 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5b8d5da-1406-4ad3-b6d5-e4a0ce6c6390 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:17.746038 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5b8d5da-1406-4ad3-b6d5-e4a0ce6c6390 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:17.746580 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5b8d5da-1406-4ad3-b6d5-e4a0ce6c6390 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:17.763965 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-c5b8d5da-1406-4ad3-b6d5-e4a0ce6c6390 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] HTTP exception thrown: Instance 72bfdb29-fd39-41a3-8314-624925dcd0b3 could not be found. Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c5b8d5da-1406-4ad3-b6d5-e4a0ce6c6390 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Request method failure captured: Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3 HTTP/1.1 Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL29oVeq1tSokQtiulSH-jZ1loxxpChILZU-Pa06b6-kCb6dFkOOJBNdJ_QcaKscjUES5R_tS1-OieV5kH0KkPOlTTA9X0pCwK9h7UEm1S-26agS6j9cctGC_s1VYRa78TLofA_VVZthTEqxyXcEWUeNZtNimDb5OE0iEVryQoS5lhjQ Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: ffbf416811f64df0b56656a0cf7778ce Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-LiveMigrationNegativeTest-981125536 Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ffbf416811f64df0b56656a0cf7778ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ffbf416811f64df0b56656a0cf7778ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ffbf416811f64df0b56656a0cf7778ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ffbf416811f64df0b56656a0cf7778ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-LiveMigrationNegativeTest-981125536 Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: ffbf416811f64df0b56656a0cf7778ce Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-981125536 Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-LiveMigrationNegativeTest-981125536-project Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 1a343dddda044b8fa4eb797a4b64556a Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-LiveMigrationNegativeTest-981125536-project Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 72bfdb29-fd39-41a3-8314-624925dcd0b3 could not be found. Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '72bfdb29-fd39-41a3-8314-624925dcd0b3'} Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72bfdb29-fd39-41a3-8314-624925dcd0b3 could not be found. Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72bfdb29-fd39-41a3-8314-624925dcd0b3 could not be found. Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:59:17.766632 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:59:17.770226 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:17.770226 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:59:17.770226 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:59:17.770226 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:59:17.770226 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:59:17.770226 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72bfdb29-fd39-41a3-8314-624925dcd0b3 could not be found. Sep 24 20:59:17.770226 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:59:17.770226 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c5b8d5da-1406-4ad3-b6d5-e4a0ce6c6390 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] Returning 404 to user: Instance 72bfdb29-fd39-41a3-8314-624925dcd0b3 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:59:17.770226 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c5b8d5da-1406-4ad3-b6d5-e4a0ce6c6390 tempest-LiveMigrationNegativeTest-981125536 tempest-LiveMigrationNegativeTest-981125536-project] 10.222.0.52 "GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3" status: 404 len: 111 microversion: 2.1 time: 0.038018 Sep 24 20:59:17.772039 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1301/2601] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:17 2022] GET /compute/v2.1/servers/72bfdb29-fd39-41a3-8314-624925dcd0b3 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:59:17.777553 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-66635f32-784b-4660-9748-2059c58d5fa5 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:17.778185 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-66635f32-784b-4660-9748-2059c58d5fa5 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:17.785557 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66635f32-784b-4660-9748-2059c58d5fa5 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:17.786062 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66635f32-784b-4660-9748-2059c58d5fa5 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:17.786536 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66635f32-784b-4660-9748-2059c58d5fa5 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:17.787289 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66635f32-784b-4660-9748-2059c58d5fa5 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:17.787756 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66635f32-784b-4660-9748-2059c58d5fa5 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:17.788192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66635f32-784b-4660-9748-2059c58d5fa5 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:17.811702 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-01f88478-95f4-481c-a74b-1e696510d7a8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:59:17.812444 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-01f88478-95f4-481c-a74b-1e696510d7a8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:59:17.813493 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-01f88478-95f4-481c-a74b-1e696510d7a8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:59:17.813914 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-01f88478-95f4-481c-a74b-1e696510d7a8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:59:17.814523 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-01f88478-95f4-481c-a74b-1e696510d7a8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:59:17.830403 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01f88478-95f4-481c-a74b-1e696510d7a8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:17.830918 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01f88478-95f4-481c-a74b-1e696510d7a8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:17.831358 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01f88478-95f4-481c-a74b-1e696510d7a8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:17.832098 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01f88478-95f4-481c-a74b-1e696510d7a8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:17.832565 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01f88478-95f4-481c-a74b-1e696510d7a8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:17.832983 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01f88478-95f4-481c-a74b-1e696510d7a8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:17.853874 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-01f88478-95f4-481c-a74b-1e696510d7a8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Getting quotas for project 8c875b2746384d5a9d02548faab6fd5d. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:59:17.860876 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-01f88478-95f4-481c-a74b-1e696510d7a8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Getting quotas for user c84e7493d0ed47aca659dc925e8ca39c and project 8c875b2746384d5a9d02548faab6fd5d. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:59:17.877166 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-01f88478-95f4-481c-a74b-1e696510d7a8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:59:17.879768 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-01f88478-95f4-481c-a74b-1e696510d7a8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:59:17.932844 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-01f88478-95f4-481c-a74b-1e696510d7a8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.862100 Sep 24 20:59:17.934301 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1301/2602] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:59:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:59:17.947663 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-66635f32-784b-4660-9748-2059c58d5fa5 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00585dbe7f814eeebda43417ca1d0ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265d7d88bb6f45708203ea74df8f3214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:17.952911 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-13aac007-b1a3-454f-bae5-52f769e8d6a8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:17.956104 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-13aac007-b1a3-454f-bae5-52f769e8d6a8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:17.964472 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-66635f32-784b-4660-9748-2059c58d5fa5 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/servers/4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51" status: 200 len: 1479 microversion: 2.1 time: 0.190914 Sep 24 20:59:17.965017 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1302/2603] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:17 2022] GET /compute/v2.1/servers/4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51 => generated 1479 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:17.971574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-ba4acbff-e63b-4e02-a1b8-b0bf6a57ef79 req-b1d545b2-4cc2-48f6-8e84-909ea905ba16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72bfdb29-fd39-41a3-8314-624925dcd0b3", "name": "network-vif-deleted", "tag": "220a9783-4cc5-43f0-9857-3df4d11f076f"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:17.996678 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-ba4acbff-e63b-4e02-a1b8-b0bf6a57ef79 req-b1d545b2-4cc2-48f6-8e84-909ea905ba16 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:17.997179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-ba4acbff-e63b-4e02-a1b8-b0bf6a57ef79 req-b1d545b2-4cc2-48f6-8e84-909ea905ba16 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:17.997630 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-ba4acbff-e63b-4e02-a1b8-b0bf6a57ef79 req-b1d545b2-4cc2-48f6-8e84-909ea905ba16 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:18.027918 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-ba4acbff-e63b-4e02-a1b8-b0bf6a57ef79 req-b1d545b2-4cc2-48f6-8e84-909ea905ba16 service nova] Creating event network-vif-deleted:220a9783-4cc5-43f0-9857-3df4d11f076f for instance 72bfdb29-fd39-41a3-8314-624925dcd0b3 on nch1-master-1 Sep 24 20:59:18.043798 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-ba4acbff-e63b-4e02-a1b8-b0bf6a57ef79 req-b1d545b2-4cc2-48f6-8e84-909ea905ba16 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076739 Sep 24 20:59:18.044419 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1303/2604] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:59:18.056403 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8062e311-5336-4acf-b0aa-2d7153332c97 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:18.062067 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-13aac007-b1a3-454f-bae5-52f769e8d6a8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:18.067298 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8062e311-5336-4acf-b0aa-2d7153332c97 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:18.073934 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-13aac007-b1a3-454f-bae5-52f769e8d6a8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1217 microversion: 2.1 time: 0.127972 Sep 24 20:59:18.076939 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1302/2605] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:17 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1217 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:59:18.097153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8062e311-5336-4acf-b0aa-2d7153332c97 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:18.097774 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8062e311-5336-4acf-b0aa-2d7153332c97 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:18.098324 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8062e311-5336-4acf-b0aa-2d7153332c97 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:18.099212 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8062e311-5336-4acf-b0aa-2d7153332c97 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:18.099773 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8062e311-5336-4acf-b0aa-2d7153332c97 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:18.100358 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8062e311-5336-4acf-b0aa-2d7153332c97 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:18.128168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:59:18.149296 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8062e311-5336-4acf-b0aa-2d7153332c97 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.099127 Sep 24 20:59:18.149821 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1304/2606] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:18 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:59:18.354173 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-26c9db49-5266-490e-977c-a4475b2359eb tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:18.355111 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-26c9db49-5266-490e-977c-a4475b2359eb tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 5a17fd57-ce1b-4b51-8219-cae5add11ef2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:18.364320 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26c9db49-5266-490e-977c-a4475b2359eb tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:18.365128 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26c9db49-5266-490e-977c-a4475b2359eb tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:18.365649 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26c9db49-5266-490e-977c-a4475b2359eb tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:18.366659 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26c9db49-5266-490e-977c-a4475b2359eb tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:18.367207 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26c9db49-5266-490e-977c-a4475b2359eb tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:18.367712 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26c9db49-5266-490e-977c-a4475b2359eb tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:18.373195 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:59:18.437394 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-73b6a0bf-0c8d-4443-a5aa-c00b2cfef261 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:18.439666 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-73b6a0bf-0c8d-4443-a5aa-c00b2cfef261 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: 61376b92-427e-4de0-9a8f-89828ce607fd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:18.447330 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-73b6a0bf-0c8d-4443-a5aa-c00b2cfef261 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:18.447989 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-73b6a0bf-0c8d-4443-a5aa-c00b2cfef261 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:18.448453 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-73b6a0bf-0c8d-4443-a5aa-c00b2cfef261 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:18.449511 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-73b6a0bf-0c8d-4443-a5aa-c00b2cfef261 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:18.449987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-73b6a0bf-0c8d-4443-a5aa-c00b2cfef261 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:18.450424 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-73b6a0bf-0c8d-4443-a5aa-c00b2cfef261 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:18.549743 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-73b6a0bf-0c8d-4443-a5aa-c00b2cfef261 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:18.569446 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-73b6a0bf-0c8d-4443-a5aa-c00b2cfef261 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/61376b92-427e-4de0-9a8f-89828ce607fd" status: 200 len: 1275 microversion: 2.1 time: 0.130963 Sep 24 20:59:18.570389 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1305/2607] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:18 2022] GET /compute/v2.1/servers/61376b92-427e-4de0-9a8f-89828ce607fd => generated 1275 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:59:18.606243 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-26c9db49-5266-490e-977c-a4475b2359eb tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:18.616201 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-26c9db49-5266-490e-977c-a4475b2359eb tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2" status: 200 len: 1333 microversion: 2.1 time: 0.267589 Sep 24 20:59:18.617273 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1303/2608] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:18 2022] GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2 => generated 1333 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:18.689989 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-96985597-3574-4ba1-b867-f8d9d8232506 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:18.690699 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-96985597-3574-4ba1-b867-f8d9d8232506 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9f8f487c-5fb4-4c63-8146-a71154f73046] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:18.697058 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96985597-3574-4ba1-b867-f8d9d8232506 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:18.697757 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96985597-3574-4ba1-b867-f8d9d8232506 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:18.698330 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96985597-3574-4ba1-b867-f8d9d8232506 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:18.699293 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96985597-3574-4ba1-b867-f8d9d8232506 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:18.699853 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96985597-3574-4ba1-b867-f8d9d8232506 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:18.700393 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96985597-3574-4ba1-b867-f8d9d8232506 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:18.852598 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-96985597-3574-4ba1-b867-f8d9d8232506 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:18.864613 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-96985597-3574-4ba1-b867-f8d9d8232506 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046" status: 200 len: 1315 microversion: 2.1 time: 0.179082 Sep 24 20:59:18.865480 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1306/2609] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:18 2022] GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:18.988633 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5b4ef721-2775-4b33-ac15-75df1bc1a124 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:18.989283 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5b4ef721-2775-4b33-ac15-75df1bc1a124 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:18.996030 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b4ef721-2775-4b33-ac15-75df1bc1a124 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:19.000460 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b4ef721-2775-4b33-ac15-75df1bc1a124 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:19.002738 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b4ef721-2775-4b33-ac15-75df1bc1a124 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:19.003743 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b4ef721-2775-4b33-ac15-75df1bc1a124 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:19.004572 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b4ef721-2775-4b33-ac15-75df1bc1a124 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:19.005392 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b4ef721-2775-4b33-ac15-75df1bc1a124 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:19.099659 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b57eaf2f-e0fe-438b-9440-a7fd3bd23e20 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:19.100317 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b57eaf2f-e0fe-438b-9440-a7fd3bd23e20 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:19.108203 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b57eaf2f-e0fe-438b-9440-a7fd3bd23e20 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:19.109377 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b57eaf2f-e0fe-438b-9440-a7fd3bd23e20 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:19.110087 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b57eaf2f-e0fe-438b-9440-a7fd3bd23e20 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:19.111108 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b57eaf2f-e0fe-438b-9440-a7fd3bd23e20 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:19.111786 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b57eaf2f-e0fe-438b-9440-a7fd3bd23e20 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:19.112422 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b57eaf2f-e0fe-438b-9440-a7fd3bd23e20 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:19.198828 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b57eaf2f-e0fe-438b-9440-a7fd3bd23e20 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:19.207998 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b57eaf2f-e0fe-438b-9440-a7fd3bd23e20 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1269 microversion: 2.1 time: 0.112389 Sep 24 20:59:19.208846 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1307/2610] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:19 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1269 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:19.213756 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7b2f05a9-9f05-4482-8ea5-fad7e4d5dff3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:19.216429 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7b2f05a9-9f05-4482-8ea5-fad7e4d5dff3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:19.222790 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b2f05a9-9f05-4482-8ea5-fad7e4d5dff3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:19.223568 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b2f05a9-9f05-4482-8ea5-fad7e4d5dff3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:19.224227 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b2f05a9-9f05-4482-8ea5-fad7e4d5dff3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:19.225365 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b2f05a9-9f05-4482-8ea5-fad7e4d5dff3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:19.226387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b2f05a9-9f05-4482-8ea5-fad7e4d5dff3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:19.227090 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b2f05a9-9f05-4482-8ea5-fad7e4d5dff3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:19.273037 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7b2f05a9-9f05-4482-8ea5-fad7e4d5dff3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.062920 Sep 24 20:59:19.274354 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1308/2611] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:19 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:59:19.286832 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5b4ef721-2775-4b33-ac15-75df1bc1a124 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00585dbe7f814eeebda43417ca1d0ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265d7d88bb6f45708203ea74df8f3214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:19.296326 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5b4ef721-2775-4b33-ac15-75df1bc1a124 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/servers/4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51" status: 200 len: 1466 microversion: 2.1 time: 0.312461 Sep 24 20:59:19.296924 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1304/2612] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:18 2022] GET /compute/v2.1/servers/4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51 => generated 1466 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:19.324602 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b550cbcb-148d-43c0-8e81-8ec085b2a55f tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b0cf6e3a0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:19.473050 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b550cbcb-148d-43c0-8e81-8ec085b2a55f tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images?changes-since=2022-09-24T20%3A57%3A08Z" status: 200 len: 1901 microversion: 2.1 time: 0.153672 Sep 24 20:59:19.473979 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1309/2613] 10.222.0.52 () {58 vars in 1199 bytes} [Sat Sep 24 20:59:19 2022] GET /compute/v2.1/images?changes-since=2022-09-24T20%3A57%3A08Z => generated 1901 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:19.488909 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3b45300f-3c01-4b2c-9987-d7d1c91e59b6 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b07d86e50>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:19.583881 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3b45300f-3c01-4b2c-9987-d7d1c91e59b6 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1170071323" status: 200 len: 485 microversion: 2.1 time: 0.099969 Sep 24 20:59:19.584964 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1305/2614] 10.222.0.52 () {58 vars in 1231 bytes} [Sat Sep 24 20:59:19 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1170071323 => generated 485 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:59:19.597753 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0b3e1fe8-5212-457d-bb79-87c2691cd610 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:19.599291 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0b3e1fe8-5212-457d-bb79-87c2691cd610 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: 61376b92-427e-4de0-9a8f-89828ce607fd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:19.604811 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-18fe2213-a564-454e-9fee-10783e540e50 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b07d8dca0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:19.608973 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b3e1fe8-5212-457d-bb79-87c2691cd610 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:19.609742 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b3e1fe8-5212-457d-bb79-87c2691cd610 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:19.610369 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b3e1fe8-5212-457d-bb79-87c2691cd610 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:19.611461 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b3e1fe8-5212-457d-bb79-87c2691cd610 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:19.612589 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b3e1fe8-5212-457d-bb79-87c2691cd610 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:19.613241 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b3e1fe8-5212-457d-bb79-87c2691cd610 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:19.776285 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-18fe2213-a564-454e-9fee-10783e540e50 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images?server=4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51" status: 200 len: 957 microversion: 2.1 time: 0.176378 Sep 24 20:59:19.787954 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1306/2615] 10.222.0.52 () {58 vars in 1209 bytes} [Sat Sep 24 20:59:19 2022] GET /compute/v2.1/images?server=4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51 => generated 957 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:59:19.795045 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f455e6ec-1ff1-4ef9-b843-65ef926d8896 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:19.796883 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0b3e1fe8-5212-457d-bb79-87c2691cd610 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:19.798312 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f455e6ec-1ff1-4ef9-b843-65ef926d8896 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 5a17fd57-ce1b-4b51-8219-cae5add11ef2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:19.814488 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0b3e1fe8-5212-457d-bb79-87c2691cd610 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/61376b92-427e-4de0-9a8f-89828ce607fd" status: 200 len: 1275 microversion: 2.1 time: 0.224332 Sep 24 20:59:19.815436 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1310/2616] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:19 2022] GET /compute/v2.1/servers/61376b92-427e-4de0-9a8f-89828ce607fd => generated 1275 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:19.817496 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f455e6ec-1ff1-4ef9-b843-65ef926d8896 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:19.819697 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f455e6ec-1ff1-4ef9-b843-65ef926d8896 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:19.821113 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f455e6ec-1ff1-4ef9-b843-65ef926d8896 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:19.822882 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f455e6ec-1ff1-4ef9-b843-65ef926d8896 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:19.824197 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5603e48e-3b0e-46b7-b7f2-52253e95acf4 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b0cb925e0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:19.829169 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f455e6ec-1ff1-4ef9-b843-65ef926d8896 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:19.830008 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f455e6ec-1ff1-4ef9-b843-65ef926d8896 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:19.928403 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5603e48e-3b0e-46b7-b7f2-52253e95acf4 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fv2.1%2Fservers%2F8f800d64-00f6-4135-8090-c95d84acd232" status: 200 len: 484 microversion: 2.1 time: 0.109869 Sep 24 20:59:19.931321 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1311/2617] 10.222.0.52 () {58 vars in 1317 bytes} [Sat Sep 24 20:59:19 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fv2.1%2Fservers%2F8f800d64-00f6-4135-8090-c95d84acd232 => generated 484 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:59:19.949903 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d19b663f-b62d-4af4-955a-dd16e5a00784 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:19.958992 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d19b663f-b62d-4af4-955a-dd16e5a00784 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9f8f487c-5fb4-4c63-8146-a71154f73046] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:19.975639 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d19b663f-b62d-4af4-955a-dd16e5a00784 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:19.976348 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d19b663f-b62d-4af4-955a-dd16e5a00784 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:19.977684 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d19b663f-b62d-4af4-955a-dd16e5a00784 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:19.979325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d19b663f-b62d-4af4-955a-dd16e5a00784 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:19.980676 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d19b663f-b62d-4af4-955a-dd16e5a00784 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:19.981341 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d19b663f-b62d-4af4-955a-dd16e5a00784 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:20.312895 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f455e6ec-1ff1-4ef9-b843-65ef926d8896 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:20.322263 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f455e6ec-1ff1-4ef9-b843-65ef926d8896 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2" status: 200 len: 1333 microversion: 2.1 time: 0.532789 Sep 24 20:59:20.350951 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1307/2618] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:19 2022] GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2 => generated 1333 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:20.369316 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8fafb95a-1343-48ec-8f80-f556fbef6470 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b07da3820>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:20.380165 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d19b663f-b62d-4af4-955a-dd16e5a00784 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:20.392900 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d19b663f-b62d-4af4-955a-dd16e5a00784 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046" status: 200 len: 1315 microversion: 2.1 time: 0.456587 Sep 24 20:59:20.396776 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1312/2619] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:19 2022] GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046 => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:20.409663 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-6b190b08-37a3-451f-8620-3b3a280ae9f2 req-80cfa561-d1b1-4e9b-87ac-abc522d63163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f8f487c-5fb4-4c63-8146-a71154f73046", "name": "network-vif-plugged", "status": "completed", "tag": "0028c831-6285-486f-978f-e4a36e4183a5"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:20.435092 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-6b190b08-37a3-451f-8620-3b3a280ae9f2 req-80cfa561-d1b1-4e9b-87ac-abc522d63163 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:20.442155 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-6b190b08-37a3-451f-8620-3b3a280ae9f2 req-80cfa561-d1b1-4e9b-87ac-abc522d63163 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:20.443629 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-6b190b08-37a3-451f-8620-3b3a280ae9f2 req-80cfa561-d1b1-4e9b-87ac-abc522d63163 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:20.501606 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-6b190b08-37a3-451f-8620-3b3a280ae9f2 req-80cfa561-d1b1-4e9b-87ac-abc522d63163 service nova] Creating event network-vif-plugged:0028c831-6285-486f-978f-e4a36e4183a5 for instance 9f8f487c-5fb4-4c63-8146-a71154f73046 on nch2-master-1 Sep 24 20:59:20.513777 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8fafb95a-1343-48ec-8f80-f556fbef6470 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fservers%2F8f800d64-00f6-4135-8090-c95d84acd232" status: 200 len: 484 microversion: 2.1 time: 0.154231 Sep 24 20:59:20.515197 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1308/2620] 10.222.0.52 () {58 vars in 1303 bytes} [Sat Sep 24 20:59:20 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fservers%2F8f800d64-00f6-4135-8090-c95d84acd232 => generated 484 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:59:20.517673 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-6b190b08-37a3-451f-8620-3b3a280ae9f2 req-80cfa561-d1b1-4e9b-87ac-abc522d63163 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118745 Sep 24 20:59:20.518442 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1313/2621] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:59:20.525831 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fd1a23cc-6203-4dec-9dcc-48e79e970049 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:20.526457 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fd1a23cc-6203-4dec-9dcc-48e79e970049 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:20.531651 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-b9f7c897-4b83-4fd2-b8a9-6ed3cf993c3a req-8b0d2f8f-afca-4618-b3d8-753b5933ccb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7021278a-14b3-48a6-a442-5278d7d00fd5", "name": "network-vif-deleted", "tag": "cea7414d-85d7-4b4b-9261-8e06b9e885f7"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:20.551034 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd1a23cc-6203-4dec-9dcc-48e79e970049 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:20.551697 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd1a23cc-6203-4dec-9dcc-48e79e970049 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:20.560882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-b9f7c897-4b83-4fd2-b8a9-6ed3cf993c3a req-8b0d2f8f-afca-4618-b3d8-753b5933ccb6 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:20.561374 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-b9f7c897-4b83-4fd2-b8a9-6ed3cf993c3a req-8b0d2f8f-afca-4618-b3d8-753b5933ccb6 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:20.561811 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-b9f7c897-4b83-4fd2-b8a9-6ed3cf993c3a req-8b0d2f8f-afca-4618-b3d8-753b5933ccb6 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:20.565151 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd1a23cc-6203-4dec-9dcc-48e79e970049 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:20.566011 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd1a23cc-6203-4dec-9dcc-48e79e970049 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:20.569215 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd1a23cc-6203-4dec-9dcc-48e79e970049 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:20.570295 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd1a23cc-6203-4dec-9dcc-48e79e970049 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:20.606679 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-b9f7c897-4b83-4fd2-b8a9-6ed3cf993c3a req-8b0d2f8f-afca-4618-b3d8-753b5933ccb6 service nova] Creating event network-vif-deleted:cea7414d-85d7-4b4b-9261-8e06b9e885f7 for instance 7021278a-14b3-48a6-a442-5278d7d00fd5 on nch2-master-1 Sep 24 20:59:20.616532 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-b9f7c897-4b83-4fd2-b8a9-6ed3cf993c3a req-8b0d2f8f-afca-4618-b3d8-753b5933ccb6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096372 Sep 24 20:59:20.617487 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1314/2622] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:59:20.631134 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9456fc41-1e1b-4e7d-85b8-a0824063ea80 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:20.653432 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9456fc41-1e1b-4e7d-85b8-a0824063ea80 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:20.661468 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9456fc41-1e1b-4e7d-85b8-a0824063ea80 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:20.665750 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9456fc41-1e1b-4e7d-85b8-a0824063ea80 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:20.666196 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9456fc41-1e1b-4e7d-85b8-a0824063ea80 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:20.667881 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9456fc41-1e1b-4e7d-85b8-a0824063ea80 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:20.669186 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9456fc41-1e1b-4e7d-85b8-a0824063ea80 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:20.674223 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9456fc41-1e1b-4e7d-85b8-a0824063ea80 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:20.717877 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9456fc41-1e1b-4e7d-85b8-a0824063ea80 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.098915 Sep 24 20:59:20.719727 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1315/2623] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:20 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:59:20.725163 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c15b3e85-c894-473f-a79f-54304dda8357 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b11155940>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:20.885565 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c15b3e85-c894-473f-a79f-54304dda8357 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.163814 Sep 24 20:59:20.887500 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1316/2624] 10.222.0.52 () {58 vars in 1149 bytes} [Sat Sep 24 20:59:20 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:20.894104 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8bb00cff-4e15-4c11-a426-d0f78c29fc0b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:20.894982 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8bb00cff-4e15-4c11-a426-d0f78c29fc0b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: 61376b92-427e-4de0-9a8f-89828ce607fd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:20.910640 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8bb00cff-4e15-4c11-a426-d0f78c29fc0b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:20.911537 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8bb00cff-4e15-4c11-a426-d0f78c29fc0b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:20.913446 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8bb00cff-4e15-4c11-a426-d0f78c29fc0b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:20.917109 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8bb00cff-4e15-4c11-a426-d0f78c29fc0b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:20.917637 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8bb00cff-4e15-4c11-a426-d0f78c29fc0b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:20.918088 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8bb00cff-4e15-4c11-a426-d0f78c29fc0b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:21.092740 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fd1a23cc-6203-4dec-9dcc-48e79e970049 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:21.108609 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fd1a23cc-6203-4dec-9dcc-48e79e970049 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1317 microversion: 2.1 time: 0.587134 Sep 24 20:59:21.109225 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1309/2625] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:20 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1317 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:21.118121 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-69671a11-2d7c-4f37-8d8f-074886b1b560 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b07da3940>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:21.222910 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8bb00cff-4e15-4c11-a426-d0f78c29fc0b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:21.236084 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8bb00cff-4e15-4c11-a426-d0f78c29fc0b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/61376b92-427e-4de0-9a8f-89828ce607fd" status: 200 len: 1317 microversion: 2.1 time: 0.347076 Sep 24 20:59:21.237383 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1317/2626] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:20 2022] GET /compute/v2.1/servers/61376b92-427e-4de0-9a8f-89828ce607fd => generated 1317 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:21.252490 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-69671a11-2d7c-4f37-8d8f-074886b1b560 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.141514 Sep 24 20:59:21.253688 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1310/2627] 10.222.0.52 () {58 vars in 1149 bytes} [Sat Sep 24 20:59:21 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:21.268422 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-240852d5-a66a-4203-84d4-8321397f4922 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b11155b80>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:21.357905 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-be91df88-3518-4cc0-b6a1-31f078dacb2e tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:21.358790 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-be91df88-3518-4cc0-b6a1-31f078dacb2e tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 5a17fd57-ce1b-4b51-8219-cae5add11ef2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:21.387868 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-240852d5-a66a-4203-84d4-8321397f4922 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.120651 Sep 24 20:59:21.390114 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1318/2628] 10.222.0.52 () {58 vars in 1137 bytes} [Sat Sep 24 20:59:21 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:59:21.399940 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-be91df88-3518-4cc0-b6a1-31f078dacb2e tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:21.399940 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-be91df88-3518-4cc0-b6a1-31f078dacb2e tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:21.399940 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-be91df88-3518-4cc0-b6a1-31f078dacb2e tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:21.399940 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-be91df88-3518-4cc0-b6a1-31f078dacb2e tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:21.399940 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-be91df88-3518-4cc0-b6a1-31f078dacb2e tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:21.399940 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-be91df88-3518-4cc0-b6a1-31f078dacb2e tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:21.408984 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-678e9223-2cef-4ad5-8c44-a9c9bfd9eb96 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b0c3b1040>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:21.592603 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-678e9223-2cef-4ad5-8c44-a9c9bfd9eb96 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/detail?changes-since=2022-09-24T20%3A57%3A04Z" status: 200 len: 6321 microversion: 2.1 time: 0.190617 Sep 24 20:59:21.596086 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1319/2629] 10.222.0.52 () {58 vars in 1220 bytes} [Sat Sep 24 20:59:21 2022] GET /compute/v2.1/images/detail?changes-since=2022-09-24T20%3A57%3A04Z => generated 6321 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:21.601346 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f0f0800c-03f3-41e8-8a57-7cafb95dfc21 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:21.602168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f0f0800c-03f3-41e8-8a57-7cafb95dfc21 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9f8f487c-5fb4-4c63-8146-a71154f73046] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:21.611882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f0f0800c-03f3-41e8-8a57-7cafb95dfc21 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:21.612568 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f0f0800c-03f3-41e8-8a57-7cafb95dfc21 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:21.613778 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f0f0800c-03f3-41e8-8a57-7cafb95dfc21 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:21.613778 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f0f0800c-03f3-41e8-8a57-7cafb95dfc21 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:21.614233 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f0f0800c-03f3-41e8-8a57-7cafb95dfc21 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:21.615002 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f0f0800c-03f3-41e8-8a57-7cafb95dfc21 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:21.850039 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-be91df88-3518-4cc0-b6a1-31f078dacb2e tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:21.862283 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-be91df88-3518-4cc0-b6a1-31f078dacb2e tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2" status: 200 len: 1333 microversion: 2.1 time: 0.508207 Sep 24 20:59:21.884458 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1311/2630] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:21 2022] GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2 => generated 1333 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:21.894260 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d4dbde0c-6da9-4533-994d-670faef2914b tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b07dfeb80>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:21.938302 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f0f0800c-03f3-41e8-8a57-7cafb95dfc21 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:21.949748 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f0f0800c-03f3-41e8-8a57-7cafb95dfc21 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046" status: 200 len: 1315 microversion: 2.1 time: 0.352243 Sep 24 20:59:21.950220 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1320/2631] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:21 2022] GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046 => generated 1315 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:21.956937 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d4dbde0c-6da9-4533-994d-670faef2914b tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1170071323" status: 200 len: 665 microversion: 2.1 time: 0.070440 Sep 24 20:59:21.957533 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1312/2632] 10.222.0.52 () {58 vars in 1252 bytes} [Sat Sep 24 20:59:21 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1170071323 => generated 665 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:59:21.958940 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-45119cca-d38f-492c-9511-401a7f064596 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:21.961202 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-45119cca-d38f-492c-9511-401a7f064596 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:21.973412 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45119cca-d38f-492c-9511-401a7f064596 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:21.974265 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45119cca-d38f-492c-9511-401a7f064596 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:21.974888 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45119cca-d38f-492c-9511-401a7f064596 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:21.975961 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45119cca-d38f-492c-9511-401a7f064596 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:21.976593 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45119cca-d38f-492c-9511-401a7f064596 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:21.977032 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45119cca-d38f-492c-9511-401a7f064596 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:21.980077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fb7e4d24-fc34-4bad-8432-e54e7738bc44 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b07da3310>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:22.034075 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-45119cca-d38f-492c-9511-401a7f064596 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.082721 Sep 24 20:59:22.036232 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1321/2633] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:21 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:59:22.089753 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fb7e4d24-fc34-4bad-8432-e54e7738bc44 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fv2.1%2Fservers%2F8f800d64-00f6-4135-8090-c95d84acd232" status: 200 len: 1462 microversion: 2.1 time: 0.113922 Sep 24 20:59:22.106341 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1313/2634] 10.222.0.52 () {58 vars in 1338 bytes} [Sat Sep 24 20:59:21 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fv2.1%2Fservers%2F8f800d64-00f6-4135-8090-c95d84acd232 => generated 1462 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:22.109043 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-53fea255-1764-4ae0-81c8-be159f54e19a tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b0ca2d0d0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:22.135046 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-95b4fd7c-d67c-4461-ba95-775913ebb66a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:22.135674 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-95b4fd7c-d67c-4461-ba95-775913ebb66a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:22.148230 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-95b4fd7c-d67c-4461-ba95-775913ebb66a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:22.149370 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-95b4fd7c-d67c-4461-ba95-775913ebb66a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:22.150419 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-95b4fd7c-d67c-4461-ba95-775913ebb66a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:22.155288 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-95b4fd7c-d67c-4461-ba95-775913ebb66a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:22.156522 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-95b4fd7c-d67c-4461-ba95-775913ebb66a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:22.157279 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-95b4fd7c-d67c-4461-ba95-775913ebb66a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:22.211524 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-53fea255-1764-4ae0-81c8-be159f54e19a tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fservers%2F8f800d64-00f6-4135-8090-c95d84acd232" status: 200 len: 1462 microversion: 2.1 time: 0.105906 Sep 24 20:59:22.212468 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1322/2635] 10.222.0.52 () {58 vars in 1324 bytes} [Sat Sep 24 20:59:22 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fservers%2F8f800d64-00f6-4135-8090-c95d84acd232 => generated 1462 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:59:22.229837 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9b93cdca-c135-4bfb-9446-a6ff1723770a tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b0c9f31f0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:22.450947 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-95b4fd7c-d67c-4461-ba95-775913ebb66a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:22.464013 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-95b4fd7c-d67c-4461-ba95-775913ebb66a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1317 microversion: 2.1 time: 0.333040 Sep 24 20:59:22.464843 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1314/2636] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:22 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1317 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:59:22.488574 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3c684cd7-8753-40a2-9c23-e1b322868f25 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:22.489253 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3c684cd7-8753-40a2-9c23-e1b322868f25 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: 61376b92-427e-4de0-9a8f-89828ce607fd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:22.495416 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c684cd7-8753-40a2-9c23-e1b322868f25 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:22.495910 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c684cd7-8753-40a2-9c23-e1b322868f25 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:22.496356 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c684cd7-8753-40a2-9c23-e1b322868f25 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:22.497076 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c684cd7-8753-40a2-9c23-e1b322868f25 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:22.497533 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c684cd7-8753-40a2-9c23-e1b322868f25 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:22.497964 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c684cd7-8753-40a2-9c23-e1b322868f25 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:22.578016 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9b93cdca-c135-4bfb-9446-a6ff1723770a tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7096 microversion: 2.1 time: 0.352912 Sep 24 20:59:22.594731 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1323/2637] 10.222.0.52 () {58 vars in 1170 bytes} [Sat Sep 24 20:59:22 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7096 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:59:22.737782 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3c684cd7-8753-40a2-9c23-e1b322868f25 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:22.746583 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3c684cd7-8753-40a2-9c23-e1b322868f25 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/61376b92-427e-4de0-9a8f-89828ce607fd" status: 200 len: 1317 microversion: 2.1 time: 0.261780 Sep 24 20:59:22.748221 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1315/2638] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:22 2022] GET /compute/v2.1/servers/61376b92-427e-4de0-9a8f-89828ce607fd => generated 1317 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:22.753296 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-39fd72b4-d6b4-4c10-b6fe-ad9b7fce67c3 req-3438461f-0e96-435a-826e-a58dbc056f93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51", "name": "network-vif-unplugged", "status": "completed", "tag": "00c8986f-e263-4bab-8396-0009b8e0c3e8"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:22.768376 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-39fd72b4-d6b4-4c10-b6fe-ad9b7fce67c3 req-3438461f-0e96-435a-826e-a58dbc056f93 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:22.768802 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-39fd72b4-d6b4-4c10-b6fe-ad9b7fce67c3 req-3438461f-0e96-435a-826e-a58dbc056f93 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:22.769241 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-39fd72b4-d6b4-4c10-b6fe-ad9b7fce67c3 req-3438461f-0e96-435a-826e-a58dbc056f93 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:22.787863 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-39fd72b4-d6b4-4c10-b6fe-ad9b7fce67c3 req-3438461f-0e96-435a-826e-a58dbc056f93 service nova] Creating event network-vif-unplugged:00c8986f-e263-4bab-8396-0009b8e0c3e8 for instance 4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51 on nch2-master-1 Sep 24 20:59:22.795065 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-39fd72b4-d6b4-4c10-b6fe-ad9b7fce67c3 req-3438461f-0e96-435a-826e-a58dbc056f93 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045582 Sep 24 20:59:22.795774 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1316/2639] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:59:22.802110 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-77206e93-8790-49b9-8e78-accfa9e7c6a9 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b07da3790>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:22.821767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a4f06b20-a2da-452e-a11c-aba69688ff23 tempest-SecurityGroupsTestAdminJSON-603641672 tempest-SecurityGroupsTestAdminJSON-603641672-project] Action: 'create', calling method: .version_select at 0x7f4b0ca2d0d0>, body: {"security_group": {"name": "tempest-securitygroup-1536245898", "description": "tempest-description-397519604"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:22.871341 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-77206e93-8790-49b9-8e78-accfa9e7c6a9 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4363 microversion: 2.1 time: 0.074117 Sep 24 20:59:22.882891 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1317/2640] 10.222.0.52 () {58 vars in 1170 bytes} [Sat Sep 24 20:59:22 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4363 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:22.882891 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-63aa6dcc-daf0-44e2-9f16-32196d6b0b2b req-f714fc5c-6ed1-4023-afed-44a433f01792 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf34d10c-76c3-4798-9a3f-083aeb681fd6", "tag": "e7eddae5-24be-47f8-893f-5fecfb04b6ef"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:22.888621 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-63aa6dcc-daf0-44e2-9f16-32196d6b0b2b req-f714fc5c-6ed1-4023-afed-44a433f01792 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:22.889105 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-63aa6dcc-daf0-44e2-9f16-32196d6b0b2b req-f714fc5c-6ed1-4023-afed-44a433f01792 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:22.889538 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-63aa6dcc-daf0-44e2-9f16-32196d6b0b2b req-f714fc5c-6ed1-4023-afed-44a433f01792 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:22.900795 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-63aa6dcc-daf0-44e2-9f16-32196d6b0b2b req-f714fc5c-6ed1-4023-afed-44a433f01792 service nova] Creating event network-changed:e7eddae5-24be-47f8-893f-5fecfb04b6ef for instance cf34d10c-76c3-4798-9a3f-083aeb681fd6 on nch1-master-1 Sep 24 20:59:22.905646 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-63aa6dcc-daf0-44e2-9f16-32196d6b0b2b req-f714fc5c-6ed1-4023-afed-44a433f01792 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032605 Sep 24 20:59:22.907157 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1318/2641] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:59:22.912426 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-a6cc8688-fa08-48a4-bdd7-32e2380f09b2 req-de00f8f6-7d48-446f-a7b8-cd1ba5334d79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61376b92-427e-4de0-9a8f-89828ce607fd", "tag": "6e895bae-4346-4a9f-bace-ea69859c2106"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:22.922803 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-a6cc8688-fa08-48a4-bdd7-32e2380f09b2 req-de00f8f6-7d48-446f-a7b8-cd1ba5334d79 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:22.923287 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-a6cc8688-fa08-48a4-bdd7-32e2380f09b2 req-de00f8f6-7d48-446f-a7b8-cd1ba5334d79 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:22.923720 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-a6cc8688-fa08-48a4-bdd7-32e2380f09b2 req-de00f8f6-7d48-446f-a7b8-cd1ba5334d79 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:22.935368 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-a6cc8688-fa08-48a4-bdd7-32e2380f09b2 req-de00f8f6-7d48-446f-a7b8-cd1ba5334d79 service nova] Creating event network-changed:6e895bae-4346-4a9f-bace-ea69859c2106 for instance 61376b92-427e-4de0-9a8f-89828ce607fd on nch1-master-1 Sep 24 20:59:22.940980 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-a6cc8688-fa08-48a4-bdd7-32e2380f09b2 req-de00f8f6-7d48-446f-a7b8-cd1ba5334d79 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032373 Sep 24 20:59:22.941985 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1319/2642] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:59:22.948832 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-12e3750e-d94c-40ec-bdc9-499e49d8c65e tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b07da3670>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:23.001552 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-12e3750e-d94c-40ec-bdc9-499e49d8c65e tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/4c30e8e9-8fb2-4377-83f1-98322cb17799" status: 200 len: 784 microversion: 2.1 time: 0.057955 Sep 24 20:59:23.002658 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1320/2643] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 20:59:22 2022] GET /compute/v2.1/images/4c30e8e9-8fb2-4377-83f1-98322cb17799 => generated 784 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:59:23.022306 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6327916f-af59-46cc-b363-78d263c73947 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:23.023139 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6327916f-af59-46cc-b363-78d263c73947 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 5a17fd57-ce1b-4b51-8219-cae5add11ef2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:23.029978 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6327916f-af59-46cc-b363-78d263c73947 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:23.030706 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6327916f-af59-46cc-b363-78d263c73947 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:23.031640 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6327916f-af59-46cc-b363-78d263c73947 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:23.032731 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6327916f-af59-46cc-b363-78d263c73947 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:23.033199 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6327916f-af59-46cc-b363-78d263c73947 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:23.033633 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6327916f-af59-46cc-b363-78d263c73947 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:23.209350 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a4f06b20-a2da-452e-a11c-aba69688ff23 tempest-SecurityGroupsTestAdminJSON-603641672 tempest-SecurityGroupsTestAdminJSON-603641672-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.612478 Sep 24 20:59:23.219507 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1324/2644] 10.222.0.52 () {60 vars in 1180 bytes} [Sat Sep 24 20:59:22 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:59:23.219507 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-35b6fda2-c348-42b7-98d8-6d4ef1de76ea tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:23.219507 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-35b6fda2-c348-42b7-98d8-6d4ef1de76ea tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9f8f487c-5fb4-4c63-8146-a71154f73046] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:23.225543 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35b6fda2-c348-42b7-98d8-6d4ef1de76ea tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:23.226036 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35b6fda2-c348-42b7-98d8-6d4ef1de76ea tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:23.227079 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35b6fda2-c348-42b7-98d8-6d4ef1de76ea tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:23.227793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35b6fda2-c348-42b7-98d8-6d4ef1de76ea tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:23.228259 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35b6fda2-c348-42b7-98d8-6d4ef1de76ea tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:23.228690 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35b6fda2-c348-42b7-98d8-6d4ef1de76ea tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:23.255983 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6327916f-af59-46cc-b363-78d263c73947 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:23.265040 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6327916f-af59-46cc-b363-78d263c73947 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2" status: 200 len: 1333 microversion: 2.1 time: 0.261151 Sep 24 20:59:23.265718 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1321/2645] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:23 2022] GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2 => generated 1333 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:23.278479 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7824d758-f5a5-46ef-b179-8a58c328406a tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b07ea18b0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:23.361420 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7824d758-f5a5-46ef-b179-8a58c328406a tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1606 microversion: 2.1 time: 0.093956 Sep 24 20:59:23.362030 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1322/2646] 10.222.0.52 () {58 vars in 1158 bytes} [Sat Sep 24 20:59:23 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1606 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:23.366814 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-56088c29-46ea-4b15-9682-235afe83959d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:23.369362 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-56088c29-46ea-4b15-9682-235afe83959d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:23.375730 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-56088c29-46ea-4b15-9682-235afe83959d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:23.376624 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-56088c29-46ea-4b15-9682-235afe83959d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:23.377070 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-56088c29-46ea-4b15-9682-235afe83959d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:23.377819 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-56088c29-46ea-4b15-9682-235afe83959d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:23.378280 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-56088c29-46ea-4b15-9682-235afe83959d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:23.378742 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-56088c29-46ea-4b15-9682-235afe83959d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:23.379528 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-35b6fda2-c348-42b7-98d8-6d4ef1de76ea tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:23.388183 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-35b6fda2-c348-42b7-98d8-6d4ef1de76ea tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046" status: 200 len: 1502 microversion: 2.1 time: 0.176391 Sep 24 20:59:23.388782 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1325/2647] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:23 2022] GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046 => generated 1502 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:23.394857 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-028d0e05-d34e-49bd-8b02-a165baad92b4 tempest-SecurityGroupsTestAdminJSON-603641672 tempest-SecurityGroupsTestAdminJSON-603641672-project] Action: 'create', calling method: .version_select at 0x7f4b0c913c10>, body: {"security_group": {"name": "tempest-securitygroup-790207652", "description": "tempest-description-570100574"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:23.432055 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-56088c29-46ea-4b15-9682-235afe83959d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.068929 Sep 24 20:59:23.432727 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1323/2648] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:23 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:59:23.438698 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-20b762bc-d9c0-424f-b6f8-837e93a09383 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b07dee550>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:23.573631 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-028d0e05-d34e-49bd-8b02-a165baad92b4 tempest-SecurityGroupsTestAdminJSON-603641672 tempest-SecurityGroupsTestAdminJSON-603641672-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.179736 Sep 24 20:59:23.576240 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1326/2649] 10.222.0.52 () {60 vars in 1180 bytes} [Sat Sep 24 20:59:23 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:59:23.588999 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-52184023-bc9f-4532-a9e3-19622eef4fca tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:23.591468 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-52184023-bc9f-4532-a9e3-19622eef4fca tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:23.608030 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-52184023-bc9f-4532-a9e3-19622eef4fca tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:23.608686 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-52184023-bc9f-4532-a9e3-19622eef4fca tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:23.609129 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-52184023-bc9f-4532-a9e3-19622eef4fca tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:23.610191 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-52184023-bc9f-4532-a9e3-19622eef4fca tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:23.610695 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-52184023-bc9f-4532-a9e3-19622eef4fca tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:23.611205 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-52184023-bc9f-4532-a9e3-19622eef4fca tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:23.813592 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-52184023-bc9f-4532-a9e3-19622eef4fca tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:23.824976 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-52184023-bc9f-4532-a9e3-19622eef4fca tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1317 microversion: 2.1 time: 0.246329 Sep 24 20:59:23.834869 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1327/2650] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:23 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1317 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:23.913626 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ba5b0d9a-5097-4e58-a87a-2138cc2860c9 tempest-SecurityGroupsTestAdminJSON-809060975 tempest-SecurityGroupsTestAdminJSON-809060975-project-admin] Action: 'create', calling method: .version_select at 0x7f4b1116f9d0>, body: {"security_group": {"name": "tempest-securitygroup-6210565", "description": "tempest-description-1013399404"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:24.189288 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ba5b0d9a-5097-4e58-a87a-2138cc2860c9 tempest-SecurityGroupsTestAdminJSON-809060975 tempest-SecurityGroupsTestAdminJSON-809060975-project-admin] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 218 microversion: 2.1 time: 0.350203 Sep 24 20:59:24.190320 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1328/2651] 10.222.0.52 () {60 vars in 1180 bytes} [Sat Sep 24 20:59:23 2022] POST /compute/v2.1/os-security-groups => generated 218 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:59:24.195364 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-22aa5fa5-616e-4e94-8732-2fc981c81540 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:24.196224 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-22aa5fa5-616e-4e94-8732-2fc981c81540 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: 61376b92-427e-4de0-9a8f-89828ce607fd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:24.204838 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22aa5fa5-616e-4e94-8732-2fc981c81540 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:24.205585 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22aa5fa5-616e-4e94-8732-2fc981c81540 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:24.206180 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22aa5fa5-616e-4e94-8732-2fc981c81540 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:24.207136 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22aa5fa5-616e-4e94-8732-2fc981c81540 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:24.207939 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22aa5fa5-616e-4e94-8732-2fc981c81540 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:24.208558 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22aa5fa5-616e-4e94-8732-2fc981c81540 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:24.219488 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-20b762bc-d9c0-424f-b6f8-837e93a09383 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "DELETE /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3" status: 204 len: 0 microversion: 2.1 time: 0.784847 Sep 24 20:59:24.221062 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1324/2652] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:23 2022] DELETE /compute/v2.1/images/af3c4b43-4f39-439f-86b0-18683d7825f3 => generated 0 bytes in 788 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:59:24.225842 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f29a29fc-df7b-43de-8b7d-9302e092f636 tempest-SecurityGroupsTestAdminJSON-809060975 tempest-SecurityGroupsTestAdminJSON-809060975-project-admin] Action: 'create', calling method: .version_select at 0x7f4b07deed30>, body: {"security_group": {"name": "tempest-securitygroup-2139231027", "description": "tempest-description-219486764"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:24.398881 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-22aa5fa5-616e-4e94-8732-2fc981c81540 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:24.407211 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-22aa5fa5-616e-4e94-8732-2fc981c81540 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/61376b92-427e-4de0-9a8f-89828ce607fd" status: 200 len: 1317 microversion: 2.1 time: 0.215702 Sep 24 20:59:24.407774 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1329/2653] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:24 2022] GET /compute/v2.1/servers/61376b92-427e-4de0-9a8f-89828ce607fd => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:24.412264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7a673784-c950-4aea-abc3-23ba1e62daaa tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b0ca2d1f0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:24.460657 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f29a29fc-df7b-43de-8b7d-9302e092f636 tempest-SecurityGroupsTestAdminJSON-809060975 tempest-SecurityGroupsTestAdminJSON-809060975-project-admin] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.238284 Sep 24 20:59:24.461589 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1325/2654] 10.222.0.52 () {60 vars in 1180 bytes} [Sat Sep 24 20:59:24 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:59:24.466526 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-98f97f4a-e436-4f2b-86b6-ca59450c6024 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:24.467231 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-98f97f4a-e436-4f2b-86b6-ca59450c6024 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 5a17fd57-ce1b-4b51-8219-cae5add11ef2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:24.473745 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98f97f4a-e436-4f2b-86b6-ca59450c6024 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:24.474516 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98f97f4a-e436-4f2b-86b6-ca59450c6024 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:24.475071 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98f97f4a-e436-4f2b-86b6-ca59450c6024 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:24.476069 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98f97f4a-e436-4f2b-86b6-ca59450c6024 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:24.476717 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98f97f4a-e436-4f2b-86b6-ca59450c6024 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:24.477221 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98f97f4a-e436-4f2b-86b6-ca59450c6024 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:24.751635 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-98f97f4a-e436-4f2b-86b6-ca59450c6024 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:24.762109 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-98f97f4a-e436-4f2b-86b6-ca59450c6024 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2" status: 200 len: 1333 microversion: 2.1 time: 0.299167 Sep 24 20:59:24.763550 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1326/2655] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:24 2022] GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2 => generated 1333 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:24.780176 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-42cef30e-b24f-4ad9-b073-fa3e68d70b59 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:24.784586 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-42cef30e-b24f-4ad9-b073-fa3e68d70b59 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:24.801711 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-42cef30e-b24f-4ad9-b073-fa3e68d70b59 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:24.802297 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-42cef30e-b24f-4ad9-b073-fa3e68d70b59 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:24.802824 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-42cef30e-b24f-4ad9-b073-fa3e68d70b59 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:24.803611 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-42cef30e-b24f-4ad9-b073-fa3e68d70b59 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:24.804218 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-42cef30e-b24f-4ad9-b073-fa3e68d70b59 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:24.804736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-42cef30e-b24f-4ad9-b073-fa3e68d70b59 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:24.849896 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-42cef30e-b24f-4ad9-b073-fa3e68d70b59 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.084583 Sep 24 20:59:24.851668 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1327/2656] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:24 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:59:24.856960 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3322da11-7465-4692-ad5d-bb5e89d92b93 tempest-SecurityGroupsTestAdminJSON-809060975 tempest-SecurityGroupsTestAdminJSON-809060975-project-admin] Calling method '.version_select at 0x7f4b07d8d9d0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:24.998297 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7a673784-c950-4aea-abc3-23ba1e62daaa tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "DELETE /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625" status: 204 len: 0 microversion: 2.1 time: 0.589424 Sep 24 20:59:25.002171 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1330/2657] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:24 2022] DELETE /compute/v2.1/images/67d7cd50-463f-4d0d-82e4-b2a361d75625 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:59:25.007026 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e33ff78a-1b2f-4729-9f35-fc81d664ed07 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:25.007745 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e33ff78a-1b2f-4729-9f35-fc81d664ed07 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:25.014706 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e33ff78a-1b2f-4729-9f35-fc81d664ed07 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:25.015440 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e33ff78a-1b2f-4729-9f35-fc81d664ed07 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:25.016612 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e33ff78a-1b2f-4729-9f35-fc81d664ed07 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:25.017734 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e33ff78a-1b2f-4729-9f35-fc81d664ed07 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:25.018588 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e33ff78a-1b2f-4729-9f35-fc81d664ed07 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:25.019165 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e33ff78a-1b2f-4729-9f35-fc81d664ed07 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:25.323922 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e33ff78a-1b2f-4729-9f35-fc81d664ed07 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:25.332264 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e33ff78a-1b2f-4729-9f35-fc81d664ed07 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1317 microversion: 2.1 time: 0.328932 Sep 24 20:59:25.332845 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1331/2658] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:25 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1317 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:25.337351 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-111ce4a5-4895-4c88-9d12-4450c702ed10 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b0c983280>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:25.854165 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-111ce4a5-4895-4c88-9d12-4450c702ed10 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "DELETE /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613" status: 204 len: 0 microversion: 2.1 time: 0.520218 Sep 24 20:59:25.854798 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1332/2659] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:25 2022] DELETE /compute/v2.1/images/b8699be6-6687-4ded-8fd6-6239be174613 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:59:25.860006 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-976a97c5-2483-4ed7-9956-417e24ea45b8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1128255726", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "1d2fee0c-2b4a-497a-b4e0-a76edfbd4190"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:25.924753 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-976a97c5-2483-4ed7-9956-417e24ea45b8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] validate_networks() for [('1d2fee0c-2b4a-497a-b4e0-a76edfbd4190', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:59:26.491244 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-976a97c5-2483-4ed7-9956-417e24ea45b8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:59:26.491822 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-976a97c5-2483-4ed7-9956-417e24ea45b8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:59:26.492280 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-976a97c5-2483-4ed7-9956-417e24ea45b8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:59:26.492756 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-976a97c5-2483-4ed7-9956-417e24ea45b8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:59:26.493241 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-976a97c5-2483-4ed7-9956-417e24ea45b8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:59:26.504682 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-976a97c5-2483-4ed7-9956-417e24ea45b8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:26.505607 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-976a97c5-2483-4ed7-9956-417e24ea45b8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:26.505744 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-976a97c5-2483-4ed7-9956-417e24ea45b8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:26.506603 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-976a97c5-2483-4ed7-9956-417e24ea45b8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:26.507269 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-976a97c5-2483-4ed7-9956-417e24ea45b8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:26.507760 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-976a97c5-2483-4ed7-9956-417e24ea45b8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:26.527814 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-976a97c5-2483-4ed7-9956-417e24ea45b8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Getting quotas for project 8340f7f8fa9848dc822903c738f78f2a. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:59:26.534071 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-976a97c5-2483-4ed7-9956-417e24ea45b8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Getting quotas for user ee21da3ff38a43798bce50c9aba4ae33 and project 8340f7f8fa9848dc822903c738f78f2a. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:59:26.547235 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-976a97c5-2483-4ed7-9956-417e24ea45b8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:59:26.549662 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-976a97c5-2483-4ed7-9956-417e24ea45b8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 8796a326-1534-4c6a-93c1-ab831930166c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:59:26.599298 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-976a97c5-2483-4ed7-9956-417e24ea45b8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.743273 Sep 24 20:59:26.600100 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1333/2660] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:59:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:59:26.604874 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-265f70ef-d2f1-4e76-93ca-e53b0d4b702f tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:26.605687 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-265f70ef-d2f1-4e76-93ca-e53b0d4b702f tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: 61376b92-427e-4de0-9a8f-89828ce607fd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:26.612454 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-265f70ef-d2f1-4e76-93ca-e53b0d4b702f tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:26.612943 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-265f70ef-d2f1-4e76-93ca-e53b0d4b702f tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:26.613377 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-265f70ef-d2f1-4e76-93ca-e53b0d4b702f tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:26.614245 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-265f70ef-d2f1-4e76-93ca-e53b0d4b702f tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:26.614744 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-265f70ef-d2f1-4e76-93ca-e53b0d4b702f tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:26.615175 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-265f70ef-d2f1-4e76-93ca-e53b0d4b702f tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:26.811296 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-265f70ef-d2f1-4e76-93ca-e53b0d4b702f tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:26.821093 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-265f70ef-d2f1-4e76-93ca-e53b0d4b702f tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/61376b92-427e-4de0-9a8f-89828ce607fd" status: 200 len: 1317 microversion: 2.1 time: 0.219785 Sep 24 20:59:26.821675 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1334/2661] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:26 2022] GET /compute/v2.1/servers/61376b92-427e-4de0-9a8f-89828ce607fd => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:26.839513 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c6c5f9fc-ebaf-48a1-970f-6c424158366c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:26.840261 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c6c5f9fc-ebaf-48a1-970f-6c424158366c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 5a17fd57-ce1b-4b51-8219-cae5add11ef2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:26.847887 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6c5f9fc-ebaf-48a1-970f-6c424158366c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:26.848455 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6c5f9fc-ebaf-48a1-970f-6c424158366c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:26.848963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6c5f9fc-ebaf-48a1-970f-6c424158366c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:26.849935 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6c5f9fc-ebaf-48a1-970f-6c424158366c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:26.850397 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6c5f9fc-ebaf-48a1-970f-6c424158366c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:26.850989 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6c5f9fc-ebaf-48a1-970f-6c424158366c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:26.855683 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:59:27.049180 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c6c5f9fc-ebaf-48a1-970f-6c424158366c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:27.064129 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c6c5f9fc-ebaf-48a1-970f-6c424158366c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2" status: 200 len: 1333 microversion: 2.1 time: 0.239107 Sep 24 20:59:27.064129 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1335/2662] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:26 2022] GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2 => generated 1333 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:27.071000 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-738cc5a2-1b01-4829-ba82-4de656fd349c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:27.072183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-738cc5a2-1b01-4829-ba82-4de656fd349c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 8f800d64-00f6-4135-8090-c95d84acd232] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:27.079612 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-738cc5a2-1b01-4829-ba82-4de656fd349c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:27.084012 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-738cc5a2-1b01-4829-ba82-4de656fd349c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:27.084554 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-738cc5a2-1b01-4829-ba82-4de656fd349c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:27.085309 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-738cc5a2-1b01-4829-ba82-4de656fd349c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:27.085775 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-738cc5a2-1b01-4829-ba82-4de656fd349c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:27.086261 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-738cc5a2-1b01-4829-ba82-4de656fd349c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:27.119748 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-738cc5a2-1b01-4829-ba82-4de656fd349c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 8f800d64-00f6-4135-8090-c95d84acd232] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:59:27.207179 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-738cc5a2-1b01-4829-ba82-4de656fd349c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232" status: 204 len: 0 microversion: 2.1 time: 0.141567 Sep 24 20:59:27.208518 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1336/2663] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:59:27 2022] DELETE /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:59:27.217916 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6e76aa16-f63f-4b6b-ba32-398eb4c8fe50 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:27.221778 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6e76aa16-f63f-4b6b-ba32-398eb4c8fe50 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:27.228331 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6e76aa16-f63f-4b6b-ba32-398eb4c8fe50 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:27.228830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6e76aa16-f63f-4b6b-ba32-398eb4c8fe50 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:27.229654 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6e76aa16-f63f-4b6b-ba32-398eb4c8fe50 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:27.231059 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6e76aa16-f63f-4b6b-ba32-398eb4c8fe50 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:27.231664 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6e76aa16-f63f-4b6b-ba32-398eb4c8fe50 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:27.232122 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6e76aa16-f63f-4b6b-ba32-398eb4c8fe50 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:27.270395 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6e76aa16-f63f-4b6b-ba32-398eb4c8fe50 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.060394 Sep 24 20:59:27.271012 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1337/2664] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:27 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:59:27.275849 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c8de0f80-68ea-4055-8f81-a64763bf8958 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:27.276655 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c8de0f80-68ea-4055-8f81-a64763bf8958 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:27.278886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:59:27.287188 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8de0f80-68ea-4055-8f81-a64763bf8958 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:27.287965 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8de0f80-68ea-4055-8f81-a64763bf8958 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:27.288415 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8de0f80-68ea-4055-8f81-a64763bf8958 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:27.289146 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8de0f80-68ea-4055-8f81-a64763bf8958 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:27.289778 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8de0f80-68ea-4055-8f81-a64763bf8958 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:27.290219 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8de0f80-68ea-4055-8f81-a64763bf8958 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:27.372140 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3322da11-7465-4692-ad5d-bb5e89d92b93 tempest-SecurityGroupsTestAdminJSON-809060975 tempest-SecurityGroupsTestAdminJSON-809060975-project-admin] 10.222.0.52 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 12291 microversion: 2.1 time: 2.519136 Sep 24 20:59:27.373320 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1328/2665] 10.222.0.52 () {58 vars in 1191 bytes} [Sat Sep 24 20:59:24 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 12291 bytes in 2521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:59:27.385593 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b46d88ce-28fb-484c-a479-93b2cb451fa5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:27.387351 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b46d88ce-28fb-484c-a479-93b2cb451fa5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 8796a326-1534-4c6a-93c1-ab831930166c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:27.403435 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b46d88ce-28fb-484c-a479-93b2cb451fa5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:27.404004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b46d88ce-28fb-484c-a479-93b2cb451fa5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:27.404637 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b46d88ce-28fb-484c-a479-93b2cb451fa5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:27.405546 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b46d88ce-28fb-484c-a479-93b2cb451fa5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:27.407210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b46d88ce-28fb-484c-a479-93b2cb451fa5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:27.408091 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b46d88ce-28fb-484c-a479-93b2cb451fa5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:27.479725 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b46d88ce-28fb-484c-a479-93b2cb451fa5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:27.482575 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c8de0f80-68ea-4055-8f81-a64763bf8958 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:27.489034 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b46d88ce-28fb-484c-a479-93b2cb451fa5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/8796a326-1534-4c6a-93c1-ab831930166c" status: 200 len: 1219 microversion: 2.1 time: 0.114522 Sep 24 20:59:27.489707 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1329/2666] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:27 2022] GET /compute/v2.1/servers/8796a326-1534-4c6a-93c1-ab831930166c => generated 1219 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:27.491104 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c8de0f80-68ea-4055-8f81-a64763bf8958 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1317 microversion: 2.1 time: 0.218812 Sep 24 20:59:27.491680 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1338/2667] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:27 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:27.509981 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-36492709-4c5a-42f0-b1be-a4b0445009f1 req-987285d0-23f9-48bd-9655-d314bf440b60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a17fd57-ce1b-4b51-8219-cae5add11ef2", "name": "network-vif-plugged", "status": "completed", "tag": "957e661f-4b67-484a-a751-9619aed2316e"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:27.510398 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-179ef0c4-e5af-4728-8405-3758ca55a303 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:27.511043 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-179ef0c4-e5af-4728-8405-3758ca55a303 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 8f800d64-00f6-4135-8090-c95d84acd232] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:27.517694 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-179ef0c4-e5af-4728-8405-3758ca55a303 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:27.518187 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-179ef0c4-e5af-4728-8405-3758ca55a303 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:27.518672 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-179ef0c4-e5af-4728-8405-3758ca55a303 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:27.519381 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-179ef0c4-e5af-4728-8405-3758ca55a303 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:27.519843 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-179ef0c4-e5af-4728-8405-3758ca55a303 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:27.520274 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-179ef0c4-e5af-4728-8405-3758ca55a303 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:27.520545 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-36492709-4c5a-42f0-b1be-a4b0445009f1 req-987285d0-23f9-48bd-9655-d314bf440b60 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:27.521154 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-36492709-4c5a-42f0-b1be-a4b0445009f1 req-987285d0-23f9-48bd-9655-d314bf440b60 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:27.521596 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-36492709-4c5a-42f0-b1be-a4b0445009f1 req-987285d0-23f9-48bd-9655-d314bf440b60 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:27.533540 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-36492709-4c5a-42f0-b1be-a4b0445009f1 req-987285d0-23f9-48bd-9655-d314bf440b60 service nova] Creating event network-vif-plugged:957e661f-4b67-484a-a751-9619aed2316e for instance 5a17fd57-ce1b-4b51-8219-cae5add11ef2 on nch2-master-1 Sep 24 20:59:27.538836 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-36492709-4c5a-42f0-b1be-a4b0445009f1 req-987285d0-23f9-48bd-9655-d314bf440b60 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032458 Sep 24 20:59:27.539601 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1330/2668] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:59:27.544485 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8435a776-8f30-41f5-ab3d-f38424ef4941 tempest-SecurityGroupsTestAdminJSON-603641672 tempest-SecurityGroupsTestAdminJSON-603641672-project] Calling method '.version_select at 0x7f4b07d829d0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:27.699251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-179ef0c4-e5af-4728-8405-3758ca55a303 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00585dbe7f814eeebda43417ca1d0ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265d7d88bb6f45708203ea74df8f3214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:27.707894 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-179ef0c4-e5af-4728-8405-3758ca55a303 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232" status: 200 len: 1474 microversion: 2.1 time: 0.201081 Sep 24 20:59:27.708494 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1339/2669] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:27 2022] GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232 => generated 1474 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:27.713236 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c04df8f2-dbb9-4966-9762-0b294e3e0290 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:27.713749 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c04df8f2-dbb9-4966-9762-0b294e3e0290 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 8796a326-1534-4c6a-93c1-ab831930166c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:27.720760 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c04df8f2-dbb9-4966-9762-0b294e3e0290 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:27.721385 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c04df8f2-dbb9-4966-9762-0b294e3e0290 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:27.721981 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c04df8f2-dbb9-4966-9762-0b294e3e0290 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:27.723013 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c04df8f2-dbb9-4966-9762-0b294e3e0290 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:27.723194 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c04df8f2-dbb9-4966-9762-0b294e3e0290 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:27.723673 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c04df8f2-dbb9-4966-9762-0b294e3e0290 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:27.755388 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c04df8f2-dbb9-4966-9762-0b294e3e0290 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 8796a326-1534-4c6a-93c1-ab831930166c] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:59:27.765175 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c04df8f2-dbb9-4966-9762-0b294e3e0290 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:27.766169 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c04df8f2-dbb9-4966-9762-0b294e3e0290 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:27.766657 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c04df8f2-dbb9-4966-9762-0b294e3e0290 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:27.789981 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8435a776-8f30-41f5-ab3d-f38424ef4941 tempest-SecurityGroupsTestAdminJSON-603641672 tempest-SecurityGroupsTestAdminJSON-603641672-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.249342 Sep 24 20:59:27.790716 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1331/2670] 10.222.0.52 () {58 vars in 1191 bytes} [Sat Sep 24 20:59:27 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:27.804026 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e87d6a21-9afc-4763-86d5-2ac93a567501 tempest-SecurityGroupsTestAdminJSON-809060975 tempest-SecurityGroupsTestAdminJSON-809060975-project-admin] Calling method '.version_select at 0x7f4b07d47430>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:27.816021 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-c04df8f2-dbb9-4966-9762-0b294e3e0290 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lazy-loading 'flavor' on Instance uuid 8796a326-1534-4c6a-93c1-ab831930166c {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:59:27.830202 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-c04df8f2-dbb9-4966-9762-0b294e3e0290 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lazy-loading 'system_metadata' on Instance uuid 8796a326-1534-4c6a-93c1-ab831930166c {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:59:27.843559 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=8 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:59:27.902947 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-c04df8f2-dbb9-4966-9762-0b294e3e0290 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lazy-loading 'metadata' on Instance uuid 8796a326-1534-4c6a-93c1-ab831930166c {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:59:28.067770 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=14 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:59:28.267389 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.scheduler.client.report [None req-c04df8f2-dbb9-4966-9762-0b294e3e0290 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Deleted allocations for instance 8796a326-1534-4c6a-93c1-ab831930166c Sep 24 20:59:28.288836 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c04df8f2-dbb9-4966-9762-0b294e3e0290 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8796a326-1534-4c6a-93c1-ab831930166c" status: 204 len: 0 microversion: 2.1 time: 0.579246 Sep 24 20:59:28.289573 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1340/2671] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:59:27 2022] DELETE /compute/v2.1/servers/8796a326-1534-4c6a-93c1-ab831930166c => generated 0 bytes in 581 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:59:28.295199 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e948e1e0-df1a-4a04-abc8-dcff22511fe8 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:28.295920 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e948e1e0-df1a-4a04-abc8-dcff22511fe8 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: 61376b92-427e-4de0-9a8f-89828ce607fd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:28.302305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e948e1e0-df1a-4a04-abc8-dcff22511fe8 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:28.303105 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e948e1e0-df1a-4a04-abc8-dcff22511fe8 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:28.303618 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e948e1e0-df1a-4a04-abc8-dcff22511fe8 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:28.304737 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e948e1e0-df1a-4a04-abc8-dcff22511fe8 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:28.305322 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e948e1e0-df1a-4a04-abc8-dcff22511fe8 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:28.305974 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e948e1e0-df1a-4a04-abc8-dcff22511fe8 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:28.333542 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e87d6a21-9afc-4763-86d5-2ac93a567501 tempest-SecurityGroupsTestAdminJSON-809060975 tempest-SecurityGroupsTestAdminJSON-809060975-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/502a0596-1527-4232-9bb0-514516ab6a3a" status: 202 len: 0 microversion: 2.1 time: 0.532884 Sep 24 20:59:28.334638 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1332/2672] 10.222.0.52 () {58 vars in 1272 bytes} [Sat Sep 24 20:59:27 2022] DELETE /compute/v2.1/os-security-groups/502a0596-1527-4232-9bb0-514516ab6a3a => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 20:59:28.340401 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e7e23e29-e9b5-469e-a581-d518eb14bdb5 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:28.341139 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e7e23e29-e9b5-469e-a581-d518eb14bdb5 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 5a17fd57-ce1b-4b51-8219-cae5add11ef2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:28.355025 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7e23e29-e9b5-469e-a581-d518eb14bdb5 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:28.355818 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7e23e29-e9b5-469e-a581-d518eb14bdb5 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:28.356577 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7e23e29-e9b5-469e-a581-d518eb14bdb5 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:28.357418 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7e23e29-e9b5-469e-a581-d518eb14bdb5 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:28.358134 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7e23e29-e9b5-469e-a581-d518eb14bdb5 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:28.358942 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7e23e29-e9b5-469e-a581-d518eb14bdb5 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:28.523854 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e948e1e0-df1a-4a04-abc8-dcff22511fe8 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:28.532597 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e948e1e0-df1a-4a04-abc8-dcff22511fe8 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/61376b92-427e-4de0-9a8f-89828ce607fd" status: 200 len: 1317 microversion: 2.1 time: 0.241702 Sep 24 20:59:28.533183 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1341/2673] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:28 2022] GET /compute/v2.1/servers/61376b92-427e-4de0-9a8f-89828ce607fd => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:28.546627 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1544fcaa-3697-4ef2-a951-84b0732d3fb6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:28.546627 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1544fcaa-3697-4ef2-a951-84b0732d3fb6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:28.549312 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1544fcaa-3697-4ef2-a951-84b0732d3fb6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:28.549948 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1544fcaa-3697-4ef2-a951-84b0732d3fb6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:28.550508 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1544fcaa-3697-4ef2-a951-84b0732d3fb6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:28.551342 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1544fcaa-3697-4ef2-a951-84b0732d3fb6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:28.551902 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1544fcaa-3697-4ef2-a951-84b0732d3fb6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:28.553212 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1544fcaa-3697-4ef2-a951-84b0732d3fb6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:28.564385 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e7e23e29-e9b5-469e-a581-d518eb14bdb5 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:28.573517 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e7e23e29-e9b5-469e-a581-d518eb14bdb5 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2" status: 200 len: 1333 microversion: 2.1 time: 0.237615 Sep 24 20:59:28.574297 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1333/2674] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:28 2022] GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2 => generated 1333 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:28.580232 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8b78d0e1-214a-4565-aebb-99c853792ee1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:28.580858 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8b78d0e1-214a-4565-aebb-99c853792ee1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 8796a326-1534-4c6a-93c1-ab831930166c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:28.588500 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8b78d0e1-214a-4565-aebb-99c853792ee1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:28.589003 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8b78d0e1-214a-4565-aebb-99c853792ee1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:28.589446 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8b78d0e1-214a-4565-aebb-99c853792ee1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:28.590163 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8b78d0e1-214a-4565-aebb-99c853792ee1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:28.590653 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8b78d0e1-214a-4565-aebb-99c853792ee1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:28.591083 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8b78d0e1-214a-4565-aebb-99c853792ee1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:28.592836 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1544fcaa-3697-4ef2-a951-84b0732d3fb6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.057320 Sep 24 20:59:28.593505 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1342/2675] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:28 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:59:28.599147 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-531c833a-d1b0-401c-bada-cb438e48c0d5 tempest-SecurityGroupsTestAdminJSON-809060975 tempest-SecurityGroupsTestAdminJSON-809060975-project-admin] Calling method '.version_select at 0x7f4b0c7f6c10>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:28.611832 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-8b78d0e1-214a-4565-aebb-99c853792ee1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] HTTP exception thrown: Instance 8796a326-1534-4c6a-93c1-ab831930166c could not be found. Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8b78d0e1-214a-4565-aebb-99c853792ee1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Request method failure captured: Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/8796a326-1534-4c6a-93c1-ab831930166c HTTP/1.1 Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL29-X0U31bWS-OdLHgyvrqJ9cKeXdCQcU5XDw5ndql8wo4-9uoBN2em1wysBqNzzzY5Bp3FNsC7GdcmIawuHD1dS6A2amzvS90hoLHvMsCDbASCEoRJt0wxOm48tnGq2wGlMnRgEB8mO_grzOCcTdRgOgaHbZsmHcINVEnjYdvyWtzs Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 8340f7f8fa9848dc822903c738f78f2a Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-DeleteServersTestJSON-1814924671 Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-DeleteServersTestJSON-1814924671 Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 8340f7f8fa9848dc822903c738f78f2a Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-DeleteServersTestJSON-1814924671 Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-DeleteServersTestJSON-1814924671-project Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: ee21da3ff38a43798bce50c9aba4ae33 Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-DeleteServersTestJSON-1814924671-project Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 8796a326-1534-4c6a-93c1-ab831930166c could not be found. Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '8796a326-1534-4c6a-93c1-ab831930166c'} Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8796a326-1534-4c6a-93c1-ab831930166c could not be found. Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8796a326-1534-4c6a-93c1-ab831930166c could not be found. Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:59:28.614354 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:28.620266 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:28.620266 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:59:28.620266 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:59:28.620266 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:59:28.620266 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:59:28.620266 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8796a326-1534-4c6a-93c1-ab831930166c could not be found. Sep 24 20:59:28.620266 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:28.622251 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8b78d0e1-214a-4565-aebb-99c853792ee1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Returning 404 to user: Instance 8796a326-1534-4c6a-93c1-ab831930166c could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:59:28.623375 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8b78d0e1-214a-4565-aebb-99c853792ee1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/8796a326-1534-4c6a-93c1-ab831930166c" status: 404 len: 111 microversion: 2.1 time: 0.047744 Sep 24 20:59:28.624073 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1334/2676] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:28 2022] GET /compute/v2.1/servers/8796a326-1534-4c6a-93c1-ab831930166c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:59:28.629643 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fd2fc825-55fd-41d5-b3c0-d74ba4ea52fe tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:28.630268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fd2fc825-55fd-41d5-b3c0-d74ba4ea52fe tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:28.632215 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:59:28.640312 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd2fc825-55fd-41d5-b3c0-d74ba4ea52fe tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:28.641539 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd2fc825-55fd-41d5-b3c0-d74ba4ea52fe tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:28.641980 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd2fc825-55fd-41d5-b3c0-d74ba4ea52fe tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:28.642747 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd2fc825-55fd-41d5-b3c0-d74ba4ea52fe tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:28.643209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd2fc825-55fd-41d5-b3c0-d74ba4ea52fe tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:28.643633 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd2fc825-55fd-41d5-b3c0-d74ba4ea52fe tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:28.852971 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fd2fc825-55fd-41d5-b3c0-d74ba4ea52fe tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:28.862052 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fd2fc825-55fd-41d5-b3c0-d74ba4ea52fe tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1317 microversion: 2.1 time: 0.236455 Sep 24 20:59:28.862556 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1335/2677] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:28 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:28.867209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f1d1efa6-efee-4c68-8788-d62791680284 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-402231201", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "1d2fee0c-2b4a-497a-b4e0-a76edfbd4190"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:28.868029 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-531c833a-d1b0-401c-bada-cb438e48c0d5 tempest-SecurityGroupsTestAdminJSON-809060975 tempest-SecurityGroupsTestAdminJSON-809060975-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/496e63e6-4bd6-484f-b64e-f4915d664462" status: 202 len: 0 microversion: 2.1 time: 0.272277 Sep 24 20:59:28.868841 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1343/2678] 10.222.0.52 () {58 vars in 1272 bytes} [Sat Sep 24 20:59:28 2022] DELETE /compute/v2.1/os-security-groups/496e63e6-4bd6-484f-b64e-f4915d664462 => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:59:28.874313 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-71936c55-04ba-4930-a879-e517f1d88332 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:28.875529 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-71936c55-04ba-4930-a879-e517f1d88332 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 8f800d64-00f6-4135-8090-c95d84acd232] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:28.882533 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71936c55-04ba-4930-a879-e517f1d88332 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:28.883332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71936c55-04ba-4930-a879-e517f1d88332 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:28.884016 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71936c55-04ba-4930-a879-e517f1d88332 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:28.885104 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71936c55-04ba-4930-a879-e517f1d88332 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:28.885998 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71936c55-04ba-4930-a879-e517f1d88332 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:28.886659 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71936c55-04ba-4930-a879-e517f1d88332 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:28.928046 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-f1d1efa6-efee-4c68-8788-d62791680284 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] validate_networks() for [('1d2fee0c-2b4a-497a-b4e0-a76edfbd4190', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:59:29.120048 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-71936c55-04ba-4930-a879-e517f1d88332 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00585dbe7f814eeebda43417ca1d0ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265d7d88bb6f45708203ea74df8f3214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:29.129584 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-71936c55-04ba-4930-a879-e517f1d88332 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232" status: 200 len: 1474 microversion: 2.1 time: 0.259422 Sep 24 20:59:29.136223 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1344/2679] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:28 2022] GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232 => generated 1474 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:29.141364 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0256901e-73e5-46f3-a3c7-a9508fbd06ee tempest-SecurityGroupsTestAdminJSON-603641672 tempest-SecurityGroupsTestAdminJSON-603641672-project] Calling method '.version_select at 0x7f4b0c61edc0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:29.539057 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-f1d1efa6-efee-4c68-8788-d62791680284 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:59:29.539978 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-f1d1efa6-efee-4c68-8788-d62791680284 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:59:29.540563 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-f1d1efa6-efee-4c68-8788-d62791680284 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:59:29.541185 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-f1d1efa6-efee-4c68-8788-d62791680284 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:59:29.541766 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-f1d1efa6-efee-4c68-8788-d62791680284 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:59:29.552141 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0256901e-73e5-46f3-a3c7-a9508fbd06ee tempest-SecurityGroupsTestAdminJSON-603641672 tempest-SecurityGroupsTestAdminJSON-603641672-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/cb2d05f5-6191-48d1-971f-1d2710b7a27c" status: 202 len: 0 microversion: 2.1 time: 0.420266 Sep 24 20:59:29.552857 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1345/2680] 10.222.0.52 () {58 vars in 1272 bytes} [Sat Sep 24 20:59:29 2022] DELETE /compute/v2.1/os-security-groups/cb2d05f5-6191-48d1-971f-1d2710b7a27c => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:59:29.561863 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5b709e23-fd8a-4769-85ae-f943b3ac6449 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:29.563440 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5b709e23-fd8a-4769-85ae-f943b3ac6449 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: 61376b92-427e-4de0-9a8f-89828ce607fd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:29.564694 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f1d1efa6-efee-4c68-8788-d62791680284 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:29.565913 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f1d1efa6-efee-4c68-8788-d62791680284 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:29.577957 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b709e23-fd8a-4769-85ae-f943b3ac6449 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:29.579307 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b709e23-fd8a-4769-85ae-f943b3ac6449 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:29.580878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b709e23-fd8a-4769-85ae-f943b3ac6449 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:29.581718 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b709e23-fd8a-4769-85ae-f943b3ac6449 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:29.586389 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b709e23-fd8a-4769-85ae-f943b3ac6449 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:29.587412 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b709e23-fd8a-4769-85ae-f943b3ac6449 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:29.596640 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f1d1efa6-efee-4c68-8788-d62791680284 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:29.597482 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f1d1efa6-efee-4c68-8788-d62791680284 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:29.598137 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f1d1efa6-efee-4c68-8788-d62791680284 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:29.599756 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f1d1efa6-efee-4c68-8788-d62791680284 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:29.625900 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-f1d1efa6-efee-4c68-8788-d62791680284 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Getting quotas for project 8340f7f8fa9848dc822903c738f78f2a. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:59:29.632617 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-f1d1efa6-efee-4c68-8788-d62791680284 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Getting quotas for user ee21da3ff38a43798bce50c9aba4ae33 and project 8340f7f8fa9848dc822903c738f78f2a. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:59:29.647469 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f1d1efa6-efee-4c68-8788-d62791680284 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:59:29.650093 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f1d1efa6-efee-4c68-8788-d62791680284 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 637c2b11-a4f9-40e9-b309-5cffdcd7b64a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:59:29.709696 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f1d1efa6-efee-4c68-8788-d62791680284 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.845966 Sep 24 20:59:29.711124 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1336/2681] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:59:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:59:29.721613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-e49c5e47-a58d-424d-8f76-323ef4612110 req-bee0141e-2371-4540-b162-6b5dc4ef3ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a17fd57-ce1b-4b51-8219-cae5add11ef2", "name": "network-vif-plugged", "status": "completed", "tag": "dfa66666-312a-49e4-b3f6-f9525bebbd5f"}, {"server_uuid": "61376b92-427e-4de0-9a8f-89828ce607fd", "name": "network-vif-plugged", "status": "completed", "tag": "6e895bae-4346-4a9f-bace-ea69859c2106"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:29.743804 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e49c5e47-a58d-424d-8f76-323ef4612110 req-bee0141e-2371-4540-b162-6b5dc4ef3ea6 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:29.744428 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e49c5e47-a58d-424d-8f76-323ef4612110 req-bee0141e-2371-4540-b162-6b5dc4ef3ea6 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:29.744956 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e49c5e47-a58d-424d-8f76-323ef4612110 req-bee0141e-2371-4540-b162-6b5dc4ef3ea6 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:29.760240 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-e49c5e47-a58d-424d-8f76-323ef4612110 req-bee0141e-2371-4540-b162-6b5dc4ef3ea6 service nova] Creating event network-vif-plugged:dfa66666-312a-49e4-b3f6-f9525bebbd5f for instance 5a17fd57-ce1b-4b51-8219-cae5add11ef2 on nch2-master-1 Sep 24 20:59:29.760917 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-e49c5e47-a58d-424d-8f76-323ef4612110 req-bee0141e-2371-4540-b162-6b5dc4ef3ea6 service nova] Creating event network-vif-plugged:6e895bae-4346-4a9f-bace-ea69859c2106 for instance 61376b92-427e-4de0-9a8f-89828ce607fd on nch1-master-1 Sep 24 20:59:29.772645 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-e49c5e47-a58d-424d-8f76-323ef4612110 req-bee0141e-2371-4540-b162-6b5dc4ef3ea6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.059210 Sep 24 20:59:29.775086 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1337/2682] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:59:29.784345 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4c6f61b8-e873-4496-ae97-b54a1dabb837 tempest-SecurityGroupsTestAdminJSON-603641672 tempest-SecurityGroupsTestAdminJSON-603641672-project] Calling method '.version_select at 0x7f4b07d47a60>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:30.087672 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5b709e23-fd8a-4769-85ae-f943b3ac6449 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:30.097715 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5b709e23-fd8a-4769-85ae-f943b3ac6449 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/61376b92-427e-4de0-9a8f-89828ce607fd" status: 200 len: 1317 microversion: 2.1 time: 0.540097 Sep 24 20:59:30.104718 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1346/2683] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:29 2022] GET /compute/v2.1/servers/61376b92-427e-4de0-9a8f-89828ce607fd => generated 1317 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:30.110475 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-669ef518-4e92-4486-9968-78b3685af5a3 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:30.112673 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-669ef518-4e92-4486-9968-78b3685af5a3 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 5a17fd57-ce1b-4b51-8219-cae5add11ef2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:30.129766 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-669ef518-4e92-4486-9968-78b3685af5a3 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:30.131883 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-669ef518-4e92-4486-9968-78b3685af5a3 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:30.132432 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-669ef518-4e92-4486-9968-78b3685af5a3 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:30.135250 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-669ef518-4e92-4486-9968-78b3685af5a3 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:30.135828 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-669ef518-4e92-4486-9968-78b3685af5a3 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:30.137595 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-669ef518-4e92-4486-9968-78b3685af5a3 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:30.317572 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4c6f61b8-e873-4496-ae97-b54a1dabb837 tempest-SecurityGroupsTestAdminJSON-603641672 tempest-SecurityGroupsTestAdminJSON-603641672-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/a8a6080f-a590-49a9-8194-dc5764b98df6" status: 202 len: 0 microversion: 2.1 time: 0.540609 Sep 24 20:59:30.319020 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1338/2684] 10.222.0.52 () {58 vars in 1272 bytes} [Sat Sep 24 20:59:29 2022] DELETE /compute/v2.1/os-security-groups/a8a6080f-a590-49a9-8194-dc5764b98df6 => generated 0 bytes in 543 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:59:30.330660 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3835dcf3-9cd2-49bc-86f6-d229a6b519ac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:30.333736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3835dcf3-9cd2-49bc-86f6-d229a6b519ac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:30.351601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3835dcf3-9cd2-49bc-86f6-d229a6b519ac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:30.352615 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3835dcf3-9cd2-49bc-86f6-d229a6b519ac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:30.353478 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3835dcf3-9cd2-49bc-86f6-d229a6b519ac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:30.354464 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3835dcf3-9cd2-49bc-86f6-d229a6b519ac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:30.356540 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3835dcf3-9cd2-49bc-86f6-d229a6b519ac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:30.357643 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3835dcf3-9cd2-49bc-86f6-d229a6b519ac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:30.386993 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-669ef518-4e92-4486-9968-78b3685af5a3 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:30.389935 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:59:30.399152 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=12,nova_cell1:INSERT=1,nova_cell1:DELETE=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:59:30.410264 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3835dcf3-9cd2-49bc-86f6-d229a6b519ac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.089156 Sep 24 20:59:30.411672 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1339/2685] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:30 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:59:30.422761 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2198863e-6002-4f29-aec7-11a91762d86c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:30.424360 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2198863e-6002-4f29-aec7-11a91762d86c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 637c2b11-a4f9-40e9-b309-5cffdcd7b64a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:30.429280 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-669ef518-4e92-4486-9968-78b3685af5a3 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2" status: 200 len: 1333 microversion: 2.1 time: 0.323109 Sep 24 20:59:30.431973 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1347/2686] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:30 2022] GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2 => generated 1333 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:30.447770 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2198863e-6002-4f29-aec7-11a91762d86c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:30.447944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2198863e-6002-4f29-aec7-11a91762d86c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:30.448317 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2198863e-6002-4f29-aec7-11a91762d86c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:30.449035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2198863e-6002-4f29-aec7-11a91762d86c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:30.455369 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2198863e-6002-4f29-aec7-11a91762d86c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:30.456026 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2198863e-6002-4f29-aec7-11a91762d86c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:30.477498 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cb0030fe-ca1c-4f01-8542-343ddb1d0587 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:30.480525 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cb0030fe-ca1c-4f01-8542-343ddb1d0587 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:30.498398 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb0030fe-ca1c-4f01-8542-343ddb1d0587 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:30.500718 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb0030fe-ca1c-4f01-8542-343ddb1d0587 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:30.501211 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb0030fe-ca1c-4f01-8542-343ddb1d0587 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:30.503078 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb0030fe-ca1c-4f01-8542-343ddb1d0587 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:30.503570 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb0030fe-ca1c-4f01-8542-343ddb1d0587 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:30.505321 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb0030fe-ca1c-4f01-8542-343ddb1d0587 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:30.569648 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2198863e-6002-4f29-aec7-11a91762d86c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:30.580763 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2198863e-6002-4f29-aec7-11a91762d86c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a" status: 200 len: 1218 microversion: 2.1 time: 0.167610 Sep 24 20:59:30.581940 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1340/2687] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:30 2022] GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a => generated 1218 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:30.587400 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-385fdd10-d1e2-4c0d-bad8-4f1710d41e0a req-d80d02db-ea81-4f4c-83ef-dc0d96fd6909 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f800d64-00f6-4135-8090-c95d84acd232", "name": "network-vif-deleted", "tag": "04879ee8-ed63-4eba-999f-e92bf51322a7"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:30.600372 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-385fdd10-d1e2-4c0d-bad8-4f1710d41e0a req-d80d02db-ea81-4f4c-83ef-dc0d96fd6909 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:30.601324 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-385fdd10-d1e2-4c0d-bad8-4f1710d41e0a req-d80d02db-ea81-4f4c-83ef-dc0d96fd6909 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:30.602363 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-385fdd10-d1e2-4c0d-bad8-4f1710d41e0a req-d80d02db-ea81-4f4c-83ef-dc0d96fd6909 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:30.620287 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-385fdd10-d1e2-4c0d-bad8-4f1710d41e0a req-d80d02db-ea81-4f4c-83ef-dc0d96fd6909 service nova] Creating event network-vif-deleted:04879ee8-ed63-4eba-999f-e92bf51322a7 for instance 8f800d64-00f6-4135-8090-c95d84acd232 on nch2-master-1 Sep 24 20:59:30.625908 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-385fdd10-d1e2-4c0d-bad8-4f1710d41e0a req-d80d02db-ea81-4f4c-83ef-dc0d96fd6909 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042144 Sep 24 20:59:30.627026 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1341/2688] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:59:30.632380 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2a5dc04c-9972-4a8e-83c7-72fdc1e135de tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:30.634044 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2a5dc04c-9972-4a8e-83c7-72fdc1e135de tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 8f800d64-00f6-4135-8090-c95d84acd232] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:30.641426 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a5dc04c-9972-4a8e-83c7-72fdc1e135de tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:30.641904 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a5dc04c-9972-4a8e-83c7-72fdc1e135de tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:30.642798 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a5dc04c-9972-4a8e-83c7-72fdc1e135de tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:30.643742 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a5dc04c-9972-4a8e-83c7-72fdc1e135de tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:30.644401 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a5dc04c-9972-4a8e-83c7-72fdc1e135de tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:30.645671 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a5dc04c-9972-4a8e-83c7-72fdc1e135de tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:30.686937 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a5dc04c-9972-4a8e-83c7-72fdc1e135de tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:30.688377 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a5dc04c-9972-4a8e-83c7-72fdc1e135de tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:30.689546 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a5dc04c-9972-4a8e-83c7-72fdc1e135de tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:30.691106 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-2a5dc04c-9972-4a8e-83c7-72fdc1e135de tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lazy-loading 'fault' on Instance uuid 8f800d64-00f6-4135-8090-c95d84acd232 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:59:30.696910 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cb0030fe-ca1c-4f01-8542-343ddb1d0587 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:30.709726 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cb0030fe-ca1c-4f01-8542-343ddb1d0587 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1317 microversion: 2.1 time: 0.258792 Sep 24 20:59:30.710320 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1348/2689] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:30 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1317 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:30.740495 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2a5dc04c-9972-4a8e-83c7-72fdc1e135de tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00585dbe7f814eeebda43417ca1d0ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265d7d88bb6f45708203ea74df8f3214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:30.748345 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2a5dc04c-9972-4a8e-83c7-72fdc1e135de tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232" status: 200 len: 1308 microversion: 2.1 time: 0.120131 Sep 24 20:59:30.748917 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1342/2690] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:30 2022] GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232 => generated 1308 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:31.126437 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9eb68669-f370-4960-99d4-1eccd584a9a7 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:31.127469 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9eb68669-f370-4960-99d4-1eccd584a9a7 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: 61376b92-427e-4de0-9a8f-89828ce607fd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:31.134549 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9eb68669-f370-4960-99d4-1eccd584a9a7 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:31.135405 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9eb68669-f370-4960-99d4-1eccd584a9a7 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:31.136298 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9eb68669-f370-4960-99d4-1eccd584a9a7 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:31.137492 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9eb68669-f370-4960-99d4-1eccd584a9a7 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:31.138453 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9eb68669-f370-4960-99d4-1eccd584a9a7 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:31.139103 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9eb68669-f370-4960-99d4-1eccd584a9a7 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:31.311574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9eb68669-f370-4960-99d4-1eccd584a9a7 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:31.321113 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9eb68669-f370-4960-99d4-1eccd584a9a7 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/61376b92-427e-4de0-9a8f-89828ce607fd" status: 200 len: 1317 microversion: 2.1 time: 0.199574 Sep 24 20:59:31.322025 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1349/2691] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:31 2022] GET /compute/v2.1/servers/61376b92-427e-4de0-9a8f-89828ce607fd => generated 1317 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:31.424512 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9d9f98ac-dd61-45bf-86bd-b9e4cad3955d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:31.426914 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9d9f98ac-dd61-45bf-86bd-b9e4cad3955d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:31.444429 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d9f98ac-dd61-45bf-86bd-b9e4cad3955d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:31.444930 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d9f98ac-dd61-45bf-86bd-b9e4cad3955d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:31.446193 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d9f98ac-dd61-45bf-86bd-b9e4cad3955d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:31.446968 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d9f98ac-dd61-45bf-86bd-b9e4cad3955d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:31.447425 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d9f98ac-dd61-45bf-86bd-b9e4cad3955d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:31.448163 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d9f98ac-dd61-45bf-86bd-b9e4cad3955d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:31.455091 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-19a29bb6-97a4-4ccd-94ab-630f955a2b0e tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:31.455956 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-19a29bb6-97a4-4ccd-94ab-630f955a2b0e tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 5a17fd57-ce1b-4b51-8219-cae5add11ef2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:31.472665 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-19a29bb6-97a4-4ccd-94ab-630f955a2b0e tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:31.473172 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-19a29bb6-97a4-4ccd-94ab-630f955a2b0e tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:31.473619 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-19a29bb6-97a4-4ccd-94ab-630f955a2b0e tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:31.474344 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-19a29bb6-97a4-4ccd-94ab-630f955a2b0e tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:31.474834 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-19a29bb6-97a4-4ccd-94ab-630f955a2b0e tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:31.475271 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-19a29bb6-97a4-4ccd-94ab-630f955a2b0e tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:31.536042 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9d9f98ac-dd61-45bf-86bd-b9e4cad3955d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.116505 Sep 24 20:59:31.549465 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1343/2692] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:31 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:59:31.605303 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9e709c09-a04f-4d6e-b895-05b3103ea722 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:31.606090 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9e709c09-a04f-4d6e-b895-05b3103ea722 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 637c2b11-a4f9-40e9-b309-5cffdcd7b64a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:31.613581 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9e709c09-a04f-4d6e-b895-05b3103ea722 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:31.614438 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9e709c09-a04f-4d6e-b895-05b3103ea722 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:31.615091 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9e709c09-a04f-4d6e-b895-05b3103ea722 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:31.616426 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9e709c09-a04f-4d6e-b895-05b3103ea722 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:31.616892 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9e709c09-a04f-4d6e-b895-05b3103ea722 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:31.617321 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9e709c09-a04f-4d6e-b895-05b3103ea722 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:31.725895 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9e709c09-a04f-4d6e-b895-05b3103ea722 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:31.735803 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9e709c09-a04f-4d6e-b895-05b3103ea722 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a" status: 200 len: 1266 microversion: 2.1 time: 0.135210 Sep 24 20:59:31.736755 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1344/2693] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:31 2022] GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a => generated 1266 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:59:31.754853 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a0e1235a-27c3-4b48-8510-b7ea6fd87fc9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:31.755851 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a0e1235a-27c3-4b48-8510-b7ea6fd87fc9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:31.771646 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a0e1235a-27c3-4b48-8510-b7ea6fd87fc9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:31.773207 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a0e1235a-27c3-4b48-8510-b7ea6fd87fc9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:31.774073 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a0e1235a-27c3-4b48-8510-b7ea6fd87fc9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:31.776196 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a0e1235a-27c3-4b48-8510-b7ea6fd87fc9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:31.777076 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a0e1235a-27c3-4b48-8510-b7ea6fd87fc9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:31.777613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a0e1235a-27c3-4b48-8510-b7ea6fd87fc9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:31.789120 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-19a29bb6-97a4-4ccd-94ab-630f955a2b0e tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:31.801580 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-19a29bb6-97a4-4ccd-94ab-630f955a2b0e tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2" status: 200 len: 1669 microversion: 2.1 time: 0.349964 Sep 24 20:59:31.803320 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1350/2694] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:31 2022] GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2 => generated 1669 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:59:31.808972 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0d7cc444-f68e-4853-933d-961ba67ab36d tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:31.810559 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0d7cc444-f68e-4853-933d-961ba67ab36d tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 8f800d64-00f6-4135-8090-c95d84acd232] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:31.819407 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d7cc444-f68e-4853-933d-961ba67ab36d tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:31.820179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d7cc444-f68e-4853-933d-961ba67ab36d tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:31.820884 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d7cc444-f68e-4853-933d-961ba67ab36d tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:31.822034 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d7cc444-f68e-4853-933d-961ba67ab36d tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:31.822937 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d7cc444-f68e-4853-933d-961ba67ab36d tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:31.823668 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d7cc444-f68e-4853-933d-961ba67ab36d tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:31.882694 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d7cc444-f68e-4853-933d-961ba67ab36d tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:31.883208 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d7cc444-f68e-4853-933d-961ba67ab36d tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:31.883649 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d7cc444-f68e-4853-933d-961ba67ab36d tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:31.884120 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-0d7cc444-f68e-4853-933d-961ba67ab36d tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lazy-loading 'fault' on Instance uuid 8f800d64-00f6-4135-8090-c95d84acd232 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:59:31.964250 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0d7cc444-f68e-4853-933d-961ba67ab36d tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00585dbe7f814eeebda43417ca1d0ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265d7d88bb6f45708203ea74df8f3214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:31.973880 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0d7cc444-f68e-4853-933d-961ba67ab36d tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232" status: 200 len: 1308 microversion: 2.1 time: 0.168655 Sep 24 20:59:31.986928 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1351/2695] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:31 2022] GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232 => generated 1308 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:31.997487 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-3e97bc60-bfd8-4afe-b7e9-9da99264bf43 req-0279d48a-dcf1-4090-be03-60fea8ebc6c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf34d10c-76c3-4798-9a3f-083aeb681fd6", "name": "network-vif-plugged", "status": "completed", "tag": "e7eddae5-24be-47f8-893f-5fecfb04b6ef"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:32.009528 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-3e97bc60-bfd8-4afe-b7e9-9da99264bf43 req-0279d48a-dcf1-4090-be03-60fea8ebc6c4 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:32.010372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-3e97bc60-bfd8-4afe-b7e9-9da99264bf43 req-0279d48a-dcf1-4090-be03-60fea8ebc6c4 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:32.011096 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-3e97bc60-bfd8-4afe-b7e9-9da99264bf43 req-0279d48a-dcf1-4090-be03-60fea8ebc6c4 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:32.026961 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-3e97bc60-bfd8-4afe-b7e9-9da99264bf43 req-0279d48a-dcf1-4090-be03-60fea8ebc6c4 service nova] Creating event network-vif-plugged:e7eddae5-24be-47f8-893f-5fecfb04b6ef for instance cf34d10c-76c3-4798-9a3f-083aeb681fd6 on nch1-master-1 Sep 24 20:59:32.042054 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a0e1235a-27c3-4b48-8510-b7ea6fd87fc9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:32.042792 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-3e97bc60-bfd8-4afe-b7e9-9da99264bf43 req-0279d48a-dcf1-4090-be03-60fea8ebc6c4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052852 Sep 24 20:59:32.043848 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1352/2696] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:59:32.056545 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a0e1235a-27c3-4b48-8510-b7ea6fd87fc9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1317 microversion: 2.1 time: 0.318417 Sep 24 20:59:32.057838 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1345/2697] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:31 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1317 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:32.059380 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-71170c47-b7f5-4066-9141-d45ad9d37884 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:32.063205 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-71170c47-b7f5-4066-9141-d45ad9d37884 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 5a17fd57-ce1b-4b51-8219-cae5add11ef2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:32.076744 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71170c47-b7f5-4066-9141-d45ad9d37884 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:32.077257 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71170c47-b7f5-4066-9141-d45ad9d37884 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:32.077710 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71170c47-b7f5-4066-9141-d45ad9d37884 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:32.079055 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71170c47-b7f5-4066-9141-d45ad9d37884 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:32.079526 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71170c47-b7f5-4066-9141-d45ad9d37884 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:32.080106 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71170c47-b7f5-4066-9141-d45ad9d37884 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:32.128129 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-71170c47-b7f5-4066-9141-d45ad9d37884 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2/ips" status: 200 len: 180 microversion: 2.1 time: 0.082195 Sep 24 20:59:32.129265 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1353/2698] 10.222.0.52 () {58 vars in 1248 bytes} [Sat Sep 24 20:59:32 2022] GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2/ips => generated 180 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:59:32.142280 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f4ffceea-54ac-4048-a3b8-26275059933f tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:32.143363 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f4ffceea-54ac-4048-a3b8-26275059933f tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 5a17fd57-ce1b-4b51-8219-cae5add11ef2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:32.158868 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f4ffceea-54ac-4048-a3b8-26275059933f tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:32.159965 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f4ffceea-54ac-4048-a3b8-26275059933f tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:32.160442 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f4ffceea-54ac-4048-a3b8-26275059933f tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:32.163615 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f4ffceea-54ac-4048-a3b8-26275059933f tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:32.164388 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f4ffceea-54ac-4048-a3b8-26275059933f tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:32.165260 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f4ffceea-54ac-4048-a3b8-26275059933f tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:32.203879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f4ffceea-54ac-4048-a3b8-26275059933f tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 5a17fd57-ce1b-4b51-8219-cae5add11ef2] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:59:32.317100 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f4ffceea-54ac-4048-a3b8-26275059933f tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2" status: 204 len: 0 microversion: 2.1 time: 0.179867 Sep 24 20:59:32.321433 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1346/2699] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:59:32 2022] DELETE /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 24 20:59:32.326223 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-71931ce1-6db1-499f-aa9a-6e2e25c0fd28 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:32.326893 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-71931ce1-6db1-499f-aa9a-6e2e25c0fd28 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 5a17fd57-ce1b-4b51-8219-cae5add11ef2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:32.333073 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71931ce1-6db1-499f-aa9a-6e2e25c0fd28 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:32.333574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71931ce1-6db1-499f-aa9a-6e2e25c0fd28 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:32.334020 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71931ce1-6db1-499f-aa9a-6e2e25c0fd28 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:32.334761 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71931ce1-6db1-499f-aa9a-6e2e25c0fd28 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:32.335406 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71931ce1-6db1-499f-aa9a-6e2e25c0fd28 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:32.335842 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71931ce1-6db1-499f-aa9a-6e2e25c0fd28 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:32.352352 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-184d198b-11cd-4d09-9459-a15d2222039b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:32.355109 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-184d198b-11cd-4d09-9459-a15d2222039b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: 61376b92-427e-4de0-9a8f-89828ce607fd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:32.362533 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-184d198b-11cd-4d09-9459-a15d2222039b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:32.363280 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-184d198b-11cd-4d09-9459-a15d2222039b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:32.363885 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-184d198b-11cd-4d09-9459-a15d2222039b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:32.364772 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-184d198b-11cd-4d09-9459-a15d2222039b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:32.365232 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-184d198b-11cd-4d09-9459-a15d2222039b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:32.365660 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-184d198b-11cd-4d09-9459-a15d2222039b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:32.575511 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-71931ce1-6db1-499f-aa9a-6e2e25c0fd28 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:32.600781 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-184d198b-11cd-4d09-9459-a15d2222039b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:32.602703 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-71931ce1-6db1-499f-aa9a-6e2e25c0fd28 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2" status: 200 len: 1675 microversion: 2.1 time: 0.269238 Sep 24 20:59:32.605252 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1354/2700] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:32 2022] GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2 => generated 1675 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:32.610605 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-184d198b-11cd-4d09-9459-a15d2222039b tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/61376b92-427e-4de0-9a8f-89828ce607fd" status: 200 len: 1506 microversion: 2.1 time: 0.263109 Sep 24 20:59:32.612194 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1347/2701] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:32 2022] GET /compute/v2.1/servers/61376b92-427e-4de0-9a8f-89828ce607fd => generated 1506 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:32.627121 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-598a2e5e-668c-4b70-83b4-1898843f1e3e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:32.629784 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-598a2e5e-668c-4b70-83b4-1898843f1e3e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:32.636732 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-598a2e5e-668c-4b70-83b4-1898843f1e3e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:32.637244 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-598a2e5e-668c-4b70-83b4-1898843f1e3e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:32.637855 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-598a2e5e-668c-4b70-83b4-1898843f1e3e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:32.638606 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-598a2e5e-668c-4b70-83b4-1898843f1e3e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:32.639226 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-598a2e5e-668c-4b70-83b4-1898843f1e3e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:32.639661 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-598a2e5e-668c-4b70-83b4-1898843f1e3e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:32.684086 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-598a2e5e-668c-4b70-83b4-1898843f1e3e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.077546 Sep 24 20:59:32.690137 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1355/2702] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:32 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:59:32.775350 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4d7c91b8-6ed3-497d-9a74-344804749d07 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:32.777364 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4d7c91b8-6ed3-497d-9a74-344804749d07 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 637c2b11-a4f9-40e9-b309-5cffdcd7b64a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:32.799206 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4d7c91b8-6ed3-497d-9a74-344804749d07 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:32.802347 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4d7c91b8-6ed3-497d-9a74-344804749d07 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:32.803737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4d7c91b8-6ed3-497d-9a74-344804749d07 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:32.805621 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4d7c91b8-6ed3-497d-9a74-344804749d07 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:32.808333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4d7c91b8-6ed3-497d-9a74-344804749d07 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:32.808811 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4d7c91b8-6ed3-497d-9a74-344804749d07 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:33.007096 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-23679402-ef45-4f90-945c-2313bc605280 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:33.007729 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-23679402-ef45-4f90-945c-2313bc605280 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 8f800d64-00f6-4135-8090-c95d84acd232] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:33.017061 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-23679402-ef45-4f90-945c-2313bc605280 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:33.019898 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-23679402-ef45-4f90-945c-2313bc605280 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:33.020354 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-23679402-ef45-4f90-945c-2313bc605280 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:33.021110 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-23679402-ef45-4f90-945c-2313bc605280 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:33.021567 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-23679402-ef45-4f90-945c-2313bc605280 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:33.022002 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-23679402-ef45-4f90-945c-2313bc605280 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:33.071783 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-23679402-ef45-4f90-945c-2313bc605280 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] HTTP exception thrown: Instance 8f800d64-00f6-4135-8090-c95d84acd232 could not be found. Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-23679402-ef45-4f90-945c-2313bc605280 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Request method failure captured: Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232 HTTP/1.1 Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL28f4zxo6mDk8JBoVOAhzoQsb7rjM0IVvkWIShDMYWavHT9fQwg3yV9KKJa-7bHq7Jq-vzUUz7hjFkeTSA0JxRkzqefQG_05iMhfvNLvJg3dUgkZs8Th059UiSQZFtBdSC8sO2OTTmE2ss4lXB7jhVsIVbCW8tMve0CVOkjwkpBOFhE Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 265d7d88bb6f45708203ea74df8f3214 Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ListImageFiltersTestJSON-61324143 Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/265d7d88bb6f45708203ea74df8f3214"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_265d7d88bb6f45708203ea74df8f3214"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/265d7d88bb6f45708203ea74df8f3214"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/265d7d88bb6f45708203ea74df8f3214"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ListImageFiltersTestJSON-61324143 Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 265d7d88bb6f45708203ea74df8f3214 Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-61324143 Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ListImageFiltersTestJSON-61324143-project Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 00585dbe7f814eeebda43417ca1d0ffa Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ListImageFiltersTestJSON-61324143-project Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 8f800d64-00f6-4135-8090-c95d84acd232 could not be found. Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '8f800d64-00f6-4135-8090-c95d84acd232'} Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f800d64-00f6-4135-8090-c95d84acd232 could not be found. Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f800d64-00f6-4135-8090-c95d84acd232 could not be found. Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:59:33.077944 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:59:33.082087 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:33.082087 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:59:33.082087 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:59:33.082087 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:59:33.082087 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:59:33.082087 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f800d64-00f6-4135-8090-c95d84acd232 could not be found. Sep 24 20:59:33.082087 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:59:33.082087 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-23679402-ef45-4f90-945c-2313bc605280 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Returning 404 to user: Instance 8f800d64-00f6-4135-8090-c95d84acd232 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:59:33.083490 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-23679402-ef45-4f90-945c-2313bc605280 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232" status: 404 len: 111 microversion: 2.1 time: 0.083886 Sep 24 20:59:33.088445 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1356/2703] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:32 2022] GET /compute/v2.1/servers/8f800d64-00f6-4135-8090-c95d84acd232 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:59:33.101901 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e4bb78c8-120a-4e83-a4d3-702fcf00ab33 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:33.102963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e4bb78c8-120a-4e83-a4d3-702fcf00ab33 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:33.122484 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e4bb78c8-120a-4e83-a4d3-702fcf00ab33 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:33.123368 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e4bb78c8-120a-4e83-a4d3-702fcf00ab33 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:33.126975 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4d7c91b8-6ed3-497d-9a74-344804749d07 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:33.127662 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e4bb78c8-120a-4e83-a4d3-702fcf00ab33 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:33.128683 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e4bb78c8-120a-4e83-a4d3-702fcf00ab33 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:33.129269 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e4bb78c8-120a-4e83-a4d3-702fcf00ab33 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:33.129811 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e4bb78c8-120a-4e83-a4d3-702fcf00ab33 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:33.138435 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4d7c91b8-6ed3-497d-9a74-344804749d07 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a" status: 200 len: 1314 microversion: 2.1 time: 0.376466 Sep 24 20:59:33.144621 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1348/2704] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:32 2022] GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:33.163037 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cae01d1f-8e3f-4ba0-ba56-31919bb6636b tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:33.163811 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cae01d1f-8e3f-4ba0-ba56-31919bb6636b tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:33.171225 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cae01d1f-8e3f-4ba0-ba56-31919bb6636b tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:33.172440 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cae01d1f-8e3f-4ba0-ba56-31919bb6636b tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:33.173242 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cae01d1f-8e3f-4ba0-ba56-31919bb6636b tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:33.174194 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cae01d1f-8e3f-4ba0-ba56-31919bb6636b tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:33.174763 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cae01d1f-8e3f-4ba0-ba56-31919bb6636b tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:33.175630 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cae01d1f-8e3f-4ba0-ba56-31919bb6636b tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:33.204741 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cae01d1f-8e3f-4ba0-ba56-31919bb6636b tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:59:33.294062 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cae01d1f-8e3f-4ba0-ba56-31919bb6636b tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51" status: 204 len: 0 microversion: 2.1 time: 0.135525 Sep 24 20:59:33.308046 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1349/2705] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:59:33 2022] DELETE /compute/v2.1/servers/4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:59:33.313297 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e4bb78c8-120a-4e83-a4d3-702fcf00ab33 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:33.316200 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-df45c81f-5e7e-4a7b-8b51-eae33236c40c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:33.317025 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-df45c81f-5e7e-4a7b-8b51-eae33236c40c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:33.326401 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e4bb78c8-120a-4e83-a4d3-702fcf00ab33 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1317 microversion: 2.1 time: 0.236615 Sep 24 20:59:33.327018 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1357/2706] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:33 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:33.328251 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df45c81f-5e7e-4a7b-8b51-eae33236c40c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:33.328971 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df45c81f-5e7e-4a7b-8b51-eae33236c40c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:33.329513 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df45c81f-5e7e-4a7b-8b51-eae33236c40c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:33.330473 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df45c81f-5e7e-4a7b-8b51-eae33236c40c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:33.331055 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df45c81f-5e7e-4a7b-8b51-eae33236c40c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:33.331602 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df45c81f-5e7e-4a7b-8b51-eae33236c40c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:33.504705 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-df45c81f-5e7e-4a7b-8b51-eae33236c40c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00585dbe7f814eeebda43417ca1d0ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265d7d88bb6f45708203ea74df8f3214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:33.514487 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-df45c81f-5e7e-4a7b-8b51-eae33236c40c tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/servers/4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51" status: 200 len: 1472 microversion: 2.1 time: 0.204644 Sep 24 20:59:33.527497 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1350/2707] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:33 2022] GET /compute/v2.1/servers/4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51 => generated 1472 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:33.638610 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-217e0c8b-7fa3-437e-9193-55d4873c959c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:33.639312 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-217e0c8b-7fa3-437e-9193-55d4873c959c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 5a17fd57-ce1b-4b51-8219-cae5add11ef2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:33.646879 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-217e0c8b-7fa3-437e-9193-55d4873c959c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:33.647770 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-217e0c8b-7fa3-437e-9193-55d4873c959c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:33.648558 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-217e0c8b-7fa3-437e-9193-55d4873c959c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:33.649476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-217e0c8b-7fa3-437e-9193-55d4873c959c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:33.650165 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-217e0c8b-7fa3-437e-9193-55d4873c959c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:33.650722 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-217e0c8b-7fa3-437e-9193-55d4873c959c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:33.697380 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b4838bdb-417e-43ab-94e8-b52197fdd0e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:33.700443 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b4838bdb-417e-43ab-94e8-b52197fdd0e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:33.712982 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b4838bdb-417e-43ab-94e8-b52197fdd0e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:33.713810 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b4838bdb-417e-43ab-94e8-b52197fdd0e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:33.714899 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b4838bdb-417e-43ab-94e8-b52197fdd0e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:33.716641 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b4838bdb-417e-43ab-94e8-b52197fdd0e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:33.717486 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b4838bdb-417e-43ab-94e8-b52197fdd0e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:33.718102 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b4838bdb-417e-43ab-94e8-b52197fdd0e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:33.775008 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b4838bdb-417e-43ab-94e8-b52197fdd0e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.081249 Sep 24 20:59:33.775239 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1351/2708] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:33 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:59:33.853366 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-217e0c8b-7fa3-437e-9193-55d4873c959c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:33.863496 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-217e0c8b-7fa3-437e-9193-55d4873c959c tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2" status: 200 len: 1675 microversion: 2.1 time: 0.229100 Sep 24 20:59:33.864505 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1358/2709] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:33 2022] GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2 => generated 1675 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:34.157948 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fb354eae-7af9-4976-88d4-2ce0e9a3ff8e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-227227205", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": "none"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:34.168456 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-988669d4-4713-4174-af28-421e0417ffec tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:34.169076 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-988669d4-4713-4174-af28-421e0417ffec tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 637c2b11-a4f9-40e9-b309-5cffdcd7b64a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:34.175664 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-988669d4-4713-4174-af28-421e0417ffec tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:34.176149 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-988669d4-4713-4174-af28-421e0417ffec tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:34.176803 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-988669d4-4713-4174-af28-421e0417ffec tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:34.177523 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-988669d4-4713-4174-af28-421e0417ffec tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:34.177977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-988669d4-4713-4174-af28-421e0417ffec tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:34.178400 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-988669d4-4713-4174-af28-421e0417ffec tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:34.227327 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-fb354eae-7af9-4976-88d4-2ce0e9a3ff8e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:59:34.227771 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-fb354eae-7af9-4976-88d4-2ce0e9a3ff8e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:59:34.228633 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-fb354eae-7af9-4976-88d4-2ce0e9a3ff8e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:59:34.229229 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-fb354eae-7af9-4976-88d4-2ce0e9a3ff8e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:59:34.229802 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-fb354eae-7af9-4976-88d4-2ce0e9a3ff8e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:59:34.240881 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb354eae-7af9-4976-88d4-2ce0e9a3ff8e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:34.241728 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb354eae-7af9-4976-88d4-2ce0e9a3ff8e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:34.242365 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb354eae-7af9-4976-88d4-2ce0e9a3ff8e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:34.243606 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb354eae-7af9-4976-88d4-2ce0e9a3ff8e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:34.245135 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb354eae-7af9-4976-88d4-2ce0e9a3ff8e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:34.245740 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb354eae-7af9-4976-88d4-2ce0e9a3ff8e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:34.271069 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-fb354eae-7af9-4976-88d4-2ce0e9a3ff8e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Getting quotas for project 82b1ace927fb4587a79ac147f5aa7df6. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:59:34.277769 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-fb354eae-7af9-4976-88d4-2ce0e9a3ff8e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Getting quotas for user 3566666c11ed499da3b3d90c080a883c and project 82b1ace927fb4587a79ac147f5aa7df6. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:59:34.297228 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fb354eae-7af9-4976-88d4-2ce0e9a3ff8e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:59:34.301043 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fb354eae-7af9-4976-88d4-2ce0e9a3ff8e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:59:34.371131 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-988669d4-4713-4174-af28-421e0417ffec tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:34.388523 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-988669d4-4713-4174-af28-421e0417ffec tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a" status: 200 len: 1314 microversion: 2.1 time: 0.223688 Sep 24 20:59:34.390479 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1359/2710] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:34 2022] GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:34.405042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7985798d-a2f2-40c7-9d2d-b7d3cd5dafbe tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:34.407061 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7985798d-a2f2-40c7-9d2d-b7d3cd5dafbe tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:34.412672 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fb354eae-7af9-4976-88d4-2ce0e9a3ff8e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.414543 Sep 24 20:59:34.414645 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1352/2711] 10.222.0.52 () {62 vars in 1188 bytes} [Sat Sep 24 20:59:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 417 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 24 20:59:34.421167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-f5be304b-d529-4fee-86e6-a89ab8c863ce req-aff15eb1-ebfa-4dca-95ae-fb18d82b0575 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "637c2b11-a4f9-40e9-b309-5cffdcd7b64a", "tag": "6adca827-a71f-421b-9872-6a1ccba4b327"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:34.431391 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7985798d-a2f2-40c7-9d2d-b7d3cd5dafbe tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:34.432366 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7985798d-a2f2-40c7-9d2d-b7d3cd5dafbe tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:34.434126 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7985798d-a2f2-40c7-9d2d-b7d3cd5dafbe tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:34.434450 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-f5be304b-d529-4fee-86e6-a89ab8c863ce req-aff15eb1-ebfa-4dca-95ae-fb18d82b0575 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:34.435842 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7985798d-a2f2-40c7-9d2d-b7d3cd5dafbe tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:34.436253 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-f5be304b-d529-4fee-86e6-a89ab8c863ce req-aff15eb1-ebfa-4dca-95ae-fb18d82b0575 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:34.436832 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-f5be304b-d529-4fee-86e6-a89ab8c863ce req-aff15eb1-ebfa-4dca-95ae-fb18d82b0575 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:34.439165 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7985798d-a2f2-40c7-9d2d-b7d3cd5dafbe tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:34.440926 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7985798d-a2f2-40c7-9d2d-b7d3cd5dafbe tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:34.456504 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-f5be304b-d529-4fee-86e6-a89ab8c863ce req-aff15eb1-ebfa-4dca-95ae-fb18d82b0575 service nova] Creating event network-changed:6adca827-a71f-421b-9872-6a1ccba4b327 for instance 637c2b11-a4f9-40e9-b309-5cffdcd7b64a on nch1-master-1 Sep 24 20:59:34.462872 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-f5be304b-d529-4fee-86e6-a89ab8c863ce req-aff15eb1-ebfa-4dca-95ae-fb18d82b0575 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046645 Sep 24 20:59:34.464159 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1353/2712] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:59:34.471407 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-76706a9e-7211-45d2-bc4b-7e2f227cd2fc tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:34.472309 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-76706a9e-7211-45d2-bc4b-7e2f227cd2fc tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: 61376b92-427e-4de0-9a8f-89828ce607fd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:34.483499 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76706a9e-7211-45d2-bc4b-7e2f227cd2fc tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:34.484970 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76706a9e-7211-45d2-bc4b-7e2f227cd2fc tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:34.486279 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76706a9e-7211-45d2-bc4b-7e2f227cd2fc tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:34.487232 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76706a9e-7211-45d2-bc4b-7e2f227cd2fc tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:34.487943 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76706a9e-7211-45d2-bc4b-7e2f227cd2fc tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:34.488602 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76706a9e-7211-45d2-bc4b-7e2f227cd2fc tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:34.516479 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:59:34.543735 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-76706a9e-7211-45d2-bc4b-7e2f227cd2fc tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: 61376b92-427e-4de0-9a8f-89828ce607fd] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:59:34.660258 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-76706a9e-7211-45d2-bc4b-7e2f227cd2fc tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "DELETE /compute/v2.1/servers/61376b92-427e-4de0-9a8f-89828ce607fd" status: 204 len: 0 microversion: 2.1 time: 0.194282 Sep 24 20:59:34.669225 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1354/2713] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:59:34 2022] DELETE /compute/v2.1/servers/61376b92-427e-4de0-9a8f-89828ce607fd => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:59:34.676337 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-aa841227-e5a4-40e3-ae58-8be908d951e7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:34.680975 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-aa841227-e5a4-40e3-ae58-8be908d951e7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:34.722181 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7985798d-a2f2-40c7-9d2d-b7d3cd5dafbe tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:34.731897 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7985798d-a2f2-40c7-9d2d-b7d3cd5dafbe tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1506 microversion: 2.1 time: 0.339453 Sep 24 20:59:34.732520 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1360/2714] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:34 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1506 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:34.738554 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b0d4c9f5-415f-4819-92ba-866110d109d4 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:34.739488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b0d4c9f5-415f-4819-92ba-866110d109d4 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:34.745710 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0d4c9f5-415f-4819-92ba-866110d109d4 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:34.746461 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0d4c9f5-415f-4819-92ba-866110d109d4 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:34.747096 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0d4c9f5-415f-4819-92ba-866110d109d4 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:34.748018 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0d4c9f5-415f-4819-92ba-866110d109d4 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:34.748477 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0d4c9f5-415f-4819-92ba-866110d109d4 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:34.749082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0d4c9f5-415f-4819-92ba-866110d109d4 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:34.794431 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-aa841227-e5a4-40e3-ae58-8be908d951e7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:34.804543 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-aa841227-e5a4-40e3-ae58-8be908d951e7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:34.807140 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-aa841227-e5a4-40e3-ae58-8be908d951e7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:34.814952 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-aa841227-e5a4-40e3-ae58-8be908d951e7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "PUT /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1358 microversion: 2.75 time: 0.143661 Sep 24 20:59:34.818707 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1355/2715] 10.222.0.52 () {62 vars in 1297 bytes} [Sat Sep 24 20:59:34 2022] PUT /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:59:34.823250 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-48227a0f-0f4f-4805-9650-6bf6d012e1d3 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:34.823911 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-48227a0f-0f4f-4805-9650-6bf6d012e1d3 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: 61376b92-427e-4de0-9a8f-89828ce607fd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:34.832412 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-48227a0f-0f4f-4805-9650-6bf6d012e1d3 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:34.833186 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-48227a0f-0f4f-4805-9650-6bf6d012e1d3 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:34.833687 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-48227a0f-0f4f-4805-9650-6bf6d012e1d3 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:34.834701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-48227a0f-0f4f-4805-9650-6bf6d012e1d3 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:34.835008 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-48227a0f-0f4f-4805-9650-6bf6d012e1d3 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:34.835440 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-48227a0f-0f4f-4805-9650-6bf6d012e1d3 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:35.006800 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b0d4c9f5-415f-4819-92ba-866110d109d4 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00585dbe7f814eeebda43417ca1d0ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265d7d88bb6f45708203ea74df8f3214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:35.017234 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b0d4c9f5-415f-4819-92ba-866110d109d4 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/servers/4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51" status: 200 len: 1472 microversion: 2.1 time: 0.283499 Sep 24 20:59:35.017959 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1361/2716] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:34 2022] GET /compute/v2.1/servers/4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51 => generated 1472 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:35.023354 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-97c79866-22fa-43f0-9583-bdae08e2533c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:35.024516 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-97c79866-22fa-43f0-9583-bdae08e2533c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:35.035416 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-97c79866-22fa-43f0-9583-bdae08e2533c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:35.036411 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-97c79866-22fa-43f0-9583-bdae08e2533c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:35.037516 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-97c79866-22fa-43f0-9583-bdae08e2533c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:35.038874 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-97c79866-22fa-43f0-9583-bdae08e2533c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:35.039963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-97c79866-22fa-43f0-9583-bdae08e2533c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:35.040705 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-97c79866-22fa-43f0-9583-bdae08e2533c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:35.049219 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-48227a0f-0f4f-4805-9650-6bf6d012e1d3 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:35.058632 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-48227a0f-0f4f-4805-9650-6bf6d012e1d3 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/61376b92-427e-4de0-9a8f-89828ce607fd" status: 200 len: 1512 microversion: 2.1 time: 0.240973 Sep 24 20:59:35.059229 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1356/2717] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:34 2022] GET /compute/v2.1/servers/61376b92-427e-4de0-9a8f-89828ce607fd => generated 1512 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:35.064189 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8f04359b-082d-4e8b-b8f0-8dfef1bb5d4f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:35.066439 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8f04359b-082d-4e8b-b8f0-8dfef1bb5d4f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:35.072669 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8f04359b-082d-4e8b-b8f0-8dfef1bb5d4f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:35.073177 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8f04359b-082d-4e8b-b8f0-8dfef1bb5d4f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:35.073601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8f04359b-082d-4e8b-b8f0-8dfef1bb5d4f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:35.074299 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8f04359b-082d-4e8b-b8f0-8dfef1bb5d4f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:35.074785 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8f04359b-082d-4e8b-b8f0-8dfef1bb5d4f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:35.075210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8f04359b-082d-4e8b-b8f0-8dfef1bb5d4f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:35.107476 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8f04359b-082d-4e8b-b8f0-8dfef1bb5d4f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.047177 Sep 24 20:59:35.108167 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1357/2718] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:35 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:59:35.112811 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2e291f78-fed5-41f6-84fe-3d2b4aa13d9e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:35.113422 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2e291f78-fed5-41f6-84fe-3d2b4aa13d9e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:35.115432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:59:35.120713 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2e291f78-fed5-41f6-84fe-3d2b4aa13d9e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:35.121206 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2e291f78-fed5-41f6-84fe-3d2b4aa13d9e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:35.121648 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2e291f78-fed5-41f6-84fe-3d2b4aa13d9e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:35.122355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2e291f78-fed5-41f6-84fe-3d2b4aa13d9e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:35.122838 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2e291f78-fed5-41f6-84fe-3d2b4aa13d9e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:35.123274 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2e291f78-fed5-41f6-84fe-3d2b4aa13d9e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:35.197326 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2e291f78-fed5-41f6-84fe-3d2b4aa13d9e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:35.206036 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2e291f78-fed5-41f6-84fe-3d2b4aa13d9e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:35.207526 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2e291f78-fed5-41f6-84fe-3d2b4aa13d9e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:35.212401 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2e291f78-fed5-41f6-84fe-3d2b4aa13d9e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1362 microversion: 2.75 time: 0.103262 Sep 24 20:59:35.212977 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1358/2719] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:59:35 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1362 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:59:35.214298 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-97c79866-22fa-43f0-9583-bdae08e2533c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:35.217373 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-712bc025-a31f-4734-876c-9b381c82850a tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:35.218453 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-712bc025-a31f-4734-876c-9b381c82850a tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 5a17fd57-ce1b-4b51-8219-cae5add11ef2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:35.223612 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-97c79866-22fa-43f0-9583-bdae08e2533c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1506 microversion: 2.1 time: 0.204074 Sep 24 20:59:35.232696 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1362/2720] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:35 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1506 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:35.232863 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-712bc025-a31f-4734-876c-9b381c82850a tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:35.232863 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-712bc025-a31f-4734-876c-9b381c82850a tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:35.232863 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-712bc025-a31f-4734-876c-9b381c82850a tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:35.232863 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-712bc025-a31f-4734-876c-9b381c82850a tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:35.232863 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-712bc025-a31f-4734-876c-9b381c82850a tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:35.232863 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-712bc025-a31f-4734-876c-9b381c82850a tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:35.249244 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3faab0b2-4b0c-4d92-a699-b687fc12ea4f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:35.251917 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3faab0b2-4b0c-4d92-a699-b687fc12ea4f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:35.258362 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3faab0b2-4b0c-4d92-a699-b687fc12ea4f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:35.258885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3faab0b2-4b0c-4d92-a699-b687fc12ea4f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:35.259325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3faab0b2-4b0c-4d92-a699-b687fc12ea4f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:35.260029 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3faab0b2-4b0c-4d92-a699-b687fc12ea4f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:35.260487 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3faab0b2-4b0c-4d92-a699-b687fc12ea4f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:35.260917 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3faab0b2-4b0c-4d92-a699-b687fc12ea4f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:35.330346 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3faab0b2-4b0c-4d92-a699-b687fc12ea4f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "PUT /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1078 microversion: 2.1 time: 0.084853 Sep 24 20:59:35.338991 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1363/2721] 10.222.0.52 () {60 vars in 1256 bytes} [Sat Sep 24 20:59:35 2022] PUT /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1078 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:59:35.350266 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b2acdb87-b873-4dcc-b22a-33db3da7ebd0 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:35.350933 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b2acdb87-b873-4dcc-b22a-33db3da7ebd0 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:35.357057 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b2acdb87-b873-4dcc-b22a-33db3da7ebd0 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:35.357577 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b2acdb87-b873-4dcc-b22a-33db3da7ebd0 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:35.358032 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b2acdb87-b873-4dcc-b22a-33db3da7ebd0 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:35.358768 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b2acdb87-b873-4dcc-b22a-33db3da7ebd0 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:35.359301 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b2acdb87-b873-4dcc-b22a-33db3da7ebd0 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:35.359740 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b2acdb87-b873-4dcc-b22a-33db3da7ebd0 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:35.373376 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-712bc025-a31f-4734-876c-9b381c82850a tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:35.381476 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-712bc025-a31f-4734-876c-9b381c82850a tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2" status: 200 len: 1675 microversion: 2.1 time: 0.167520 Sep 24 20:59:35.382055 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1359/2722] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:35 2022] GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2 => generated 1675 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:35.417283 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f59e1354-955c-4726-937f-3aee057bc0c1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:35.418018 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f59e1354-955c-4726-937f-3aee057bc0c1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 637c2b11-a4f9-40e9-b309-5cffdcd7b64a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:35.424239 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f59e1354-955c-4726-937f-3aee057bc0c1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:35.424728 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f59e1354-955c-4726-937f-3aee057bc0c1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:35.425161 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f59e1354-955c-4726-937f-3aee057bc0c1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:35.425857 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f59e1354-955c-4726-937f-3aee057bc0c1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:35.426316 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f59e1354-955c-4726-937f-3aee057bc0c1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:35.426760 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f59e1354-955c-4726-937f-3aee057bc0c1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:35.537725 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b2acdb87-b873-4dcc-b22a-33db3da7ebd0 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:35.545638 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b2acdb87-b873-4dcc-b22a-33db3da7ebd0 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1504 microversion: 2.1 time: 0.199491 Sep 24 20:59:35.546215 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1364/2723] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:35 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1504 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:35.567565 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c6dc031c-c37a-4340-a10b-ac8aea124d88 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:35.568185 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c6dc031c-c37a-4340-a10b-ac8aea124d88 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:35.574110 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6dc031c-c37a-4340-a10b-ac8aea124d88 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:35.574645 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6dc031c-c37a-4340-a10b-ac8aea124d88 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:35.575095 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6dc031c-c37a-4340-a10b-ac8aea124d88 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:35.575791 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6dc031c-c37a-4340-a10b-ac8aea124d88 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:35.576259 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6dc031c-c37a-4340-a10b-ac8aea124d88 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:35.576708 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6dc031c-c37a-4340-a10b-ac8aea124d88 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:35.580905 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:59:35.584358 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f59e1354-955c-4726-937f-3aee057bc0c1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:35.592261 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f59e1354-955c-4726-937f-3aee057bc0c1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a" status: 200 len: 1314 microversion: 2.1 time: 0.178892 Sep 24 20:59:35.592830 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1360/2724] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:35 2022] GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:59:35.711656 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c6dc031c-c37a-4340-a10b-ac8aea124d88 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:35.720154 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c6dc031c-c37a-4340-a10b-ac8aea124d88 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1504 microversion: 2.1 time: 0.156319 Sep 24 20:59:35.721355 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1365/2725] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:35 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:59:35.742685 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-eb10ae48-668d-4679-a5ff-12de34477f6f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:35.745595 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-eb10ae48-668d-4679-a5ff-12de34477f6f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:35.752362 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb10ae48-668d-4679-a5ff-12de34477f6f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:35.752880 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb10ae48-668d-4679-a5ff-12de34477f6f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:35.753317 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb10ae48-668d-4679-a5ff-12de34477f6f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:35.754031 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb10ae48-668d-4679-a5ff-12de34477f6f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:35.754485 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb10ae48-668d-4679-a5ff-12de34477f6f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:35.755198 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb10ae48-668d-4679-a5ff-12de34477f6f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:35.839625 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-eb10ae48-668d-4679-a5ff-12de34477f6f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:59:35.840228 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-eb10ae48-668d-4679-a5ff-12de34477f6f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:59:35.840709 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-eb10ae48-668d-4679-a5ff-12de34477f6f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:59:35.841194 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-eb10ae48-668d-4679-a5ff-12de34477f6f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:59:35.842291 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-eb10ae48-668d-4679-a5ff-12de34477f6f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:59:35.916851 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-eb10ae48-668d-4679-a5ff-12de34477f6f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:35.923809 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb10ae48-668d-4679-a5ff-12de34477f6f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:35.924305 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb10ae48-668d-4679-a5ff-12de34477f6f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:35.924746 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb10ae48-668d-4679-a5ff-12de34477f6f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:35.925460 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb10ae48-668d-4679-a5ff-12de34477f6f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:35.925947 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb10ae48-668d-4679-a5ff-12de34477f6f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:35.926358 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb10ae48-668d-4679-a5ff-12de34477f6f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:35.964215 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-eb10ae48-668d-4679-a5ff-12de34477f6f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "POST /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6/action" status: 202 len: 1110 microversion: 2.1 time: 0.225416 Sep 24 20:59:35.964979 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1361/2726] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:59:35 2022] POST /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6/action => generated 1110 bytes in 227 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 24 20:59:35.984139 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-78ec0ef7-ae53-443b-bdec-33d8fac19fdf tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:35.985618 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-78ec0ef7-ae53-443b-bdec-33d8fac19fdf tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:35.991731 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-78ec0ef7-ae53-443b-bdec-33d8fac19fdf tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:35.992334 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-78ec0ef7-ae53-443b-bdec-33d8fac19fdf tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:35.992863 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-78ec0ef7-ae53-443b-bdec-33d8fac19fdf tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:35.993646 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-78ec0ef7-ae53-443b-bdec-33d8fac19fdf tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:35.994103 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-78ec0ef7-ae53-443b-bdec-33d8fac19fdf tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:35.994544 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-78ec0ef7-ae53-443b-bdec-33d8fac19fdf tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:36.042443 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f3cc75dc-0935-4e87-83f4-2bfc627f5520 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:36.043228 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f3cc75dc-0935-4e87-83f4-2bfc627f5520 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:36.051061 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3cc75dc-0935-4e87-83f4-2bfc627f5520 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:36.052311 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3cc75dc-0935-4e87-83f4-2bfc627f5520 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:36.052801 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3cc75dc-0935-4e87-83f4-2bfc627f5520 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:36.054215 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3cc75dc-0935-4e87-83f4-2bfc627f5520 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:36.054624 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3cc75dc-0935-4e87-83f4-2bfc627f5520 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:36.055085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3cc75dc-0935-4e87-83f4-2bfc627f5520 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:36.209574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-78ec0ef7-ae53-443b-bdec-33d8fac19fdf tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:36.223491 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-78ec0ef7-ae53-443b-bdec-33d8fac19fdf tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1515 microversion: 2.1 time: 0.242497 Sep 24 20:59:36.224528 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1366/2727] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:35 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1515 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:36.232809 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f3cc75dc-0935-4e87-83f4-2bfc627f5520 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00585dbe7f814eeebda43417ca1d0ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265d7d88bb6f45708203ea74df8f3214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:36.243967 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7c325e5b-53e2-4e08-8de4-8d4c6ff4187c tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:36.244746 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7c325e5b-53e2-4e08-8de4-8d4c6ff4187c tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: 61376b92-427e-4de0-9a8f-89828ce607fd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:36.246302 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f3cc75dc-0935-4e87-83f4-2bfc627f5520 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/servers/4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51" status: 200 len: 1472 microversion: 2.1 time: 0.208517 Sep 24 20:59:36.247292 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1362/2728] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:36 2022] GET /compute/v2.1/servers/4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51 => generated 1472 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:59:36.251635 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7c325e5b-53e2-4e08-8de4-8d4c6ff4187c tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:36.252286 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7c325e5b-53e2-4e08-8de4-8d4c6ff4187c tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:36.252720 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b678d7c3-7dc3-452a-a66f-1503e471f64e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:36.252921 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7c325e5b-53e2-4e08-8de4-8d4c6ff4187c tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:36.253746 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7c325e5b-53e2-4e08-8de4-8d4c6ff4187c tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:36.254310 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7c325e5b-53e2-4e08-8de4-8d4c6ff4187c tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:36.254875 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7c325e5b-53e2-4e08-8de4-8d4c6ff4187c tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:36.254982 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b678d7c3-7dc3-452a-a66f-1503e471f64e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:36.261659 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b678d7c3-7dc3-452a-a66f-1503e471f64e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:36.262149 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b678d7c3-7dc3-452a-a66f-1503e471f64e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:36.262600 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b678d7c3-7dc3-452a-a66f-1503e471f64e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:36.263299 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b678d7c3-7dc3-452a-a66f-1503e471f64e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:36.263750 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b678d7c3-7dc3-452a-a66f-1503e471f64e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:36.264173 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b678d7c3-7dc3-452a-a66f-1503e471f64e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:36.300629 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b678d7c3-7dc3-452a-a66f-1503e471f64e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.051612 Sep 24 20:59:36.301323 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1363/2729] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:36 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:59:36.307723 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-70c94f8d-3746-461a-bd6f-3b9cb692507a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:36.308509 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-70c94f8d-3746-461a-bd6f-3b9cb692507a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:36.316232 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-70c94f8d-3746-461a-bd6f-3b9cb692507a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:36.316891 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-70c94f8d-3746-461a-bd6f-3b9cb692507a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:36.317439 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-70c94f8d-3746-461a-bd6f-3b9cb692507a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:36.318256 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-70c94f8d-3746-461a-bd6f-3b9cb692507a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:36.318855 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-70c94f8d-3746-461a-bd6f-3b9cb692507a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:36.319399 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-70c94f8d-3746-461a-bd6f-3b9cb692507a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:36.416391 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-70c94f8d-3746-461a-bd6f-3b9cb692507a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:36.425925 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-70c94f8d-3746-461a-bd6f-3b9cb692507a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:36.427416 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-70c94f8d-3746-461a-bd6f-3b9cb692507a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:36.432744 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-70c94f8d-3746-461a-bd6f-3b9cb692507a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1410 microversion: 2.75 time: 0.128961 Sep 24 20:59:36.444457 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1364/2730] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:59:36 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1410 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:59:36.444457 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2258c0a7-6e87-4823-b5a4-7035ec67949b tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:36.444457 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2258c0a7-6e87-4823-b5a4-7035ec67949b tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 5a17fd57-ce1b-4b51-8219-cae5add11ef2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:36.446450 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2258c0a7-6e87-4823-b5a4-7035ec67949b tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:36.446978 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2258c0a7-6e87-4823-b5a4-7035ec67949b tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:36.447418 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2258c0a7-6e87-4823-b5a4-7035ec67949b tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:36.448117 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2258c0a7-6e87-4823-b5a4-7035ec67949b tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:36.448573 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2258c0a7-6e87-4823-b5a4-7035ec67949b tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:36.449001 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2258c0a7-6e87-4823-b5a4-7035ec67949b tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:36.451059 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7c325e5b-53e2-4e08-8de4-8d4c6ff4187c tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:36.462526 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7c325e5b-53e2-4e08-8de4-8d4c6ff4187c tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/61376b92-427e-4de0-9a8f-89828ce607fd" status: 200 len: 1512 microversion: 2.1 time: 0.235267 Sep 24 20:59:36.463238 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1367/2731] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:36 2022] GET /compute/v2.1/servers/61376b92-427e-4de0-9a8f-89828ce607fd => generated 1512 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:36.604119 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2258c0a7-6e87-4823-b5a4-7035ec67949b tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:36.613463 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2258c0a7-6e87-4823-b5a4-7035ec67949b tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2" status: 200 len: 1675 microversion: 2.1 time: 0.179049 Sep 24 20:59:36.614362 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1365/2732] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:36 2022] GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2 => generated 1675 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:36.616301 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2c24ab52-8d6c-4f33-b111-8662b8c9f2ff tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:36.617057 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2c24ab52-8d6c-4f33-b111-8662b8c9f2ff tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 637c2b11-a4f9-40e9-b309-5cffdcd7b64a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:36.618956 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:59:36.619837 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=8 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:59:36.626351 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c24ab52-8d6c-4f33-b111-8662b8c9f2ff tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:36.627651 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c24ab52-8d6c-4f33-b111-8662b8c9f2ff tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:36.628100 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c24ab52-8d6c-4f33-b111-8662b8c9f2ff tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:36.634524 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c24ab52-8d6c-4f33-b111-8662b8c9f2ff tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:36.634524 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c24ab52-8d6c-4f33-b111-8662b8c9f2ff tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:36.634524 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c24ab52-8d6c-4f33-b111-8662b8c9f2ff tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:36.793487 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2c24ab52-8d6c-4f33-b111-8662b8c9f2ff tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:36.804580 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2c24ab52-8d6c-4f33-b111-8662b8c9f2ff tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a" status: 200 len: 1314 microversion: 2.1 time: 0.192008 Sep 24 20:59:36.805515 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1368/2733] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:36 2022] GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:36.873775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-1cd461fd-71d5-49ee-8d11-ea9d9c752081 req-fd27db1f-a66b-4adb-9e8e-c9685db15984 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a17fd57-ce1b-4b51-8219-cae5add11ef2", "name": "network-vif-deleted", "tag": "dfa66666-312a-49e4-b3f6-f9525bebbd5f"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:36.888889 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-1cd461fd-71d5-49ee-8d11-ea9d9c752081 req-fd27db1f-a66b-4adb-9e8e-c9685db15984 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:36.890075 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-1cd461fd-71d5-49ee-8d11-ea9d9c752081 req-fd27db1f-a66b-4adb-9e8e-c9685db15984 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:36.891630 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-1cd461fd-71d5-49ee-8d11-ea9d9c752081 req-fd27db1f-a66b-4adb-9e8e-c9685db15984 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:36.906985 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-1cd461fd-71d5-49ee-8d11-ea9d9c752081 req-fd27db1f-a66b-4adb-9e8e-c9685db15984 service nova] Creating event network-vif-deleted:dfa66666-312a-49e4-b3f6-f9525bebbd5f for instance 5a17fd57-ce1b-4b51-8219-cae5add11ef2 on nch2-master-1 Sep 24 20:59:36.919192 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-1cd461fd-71d5-49ee-8d11-ea9d9c752081 req-fd27db1f-a66b-4adb-9e8e-c9685db15984 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048776 Sep 24 20:59:36.919994 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1366/2734] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:59:37.249305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d19dadde-6794-458b-bbe0-30e94a5a04a7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:37.250126 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d19dadde-6794-458b-bbe0-30e94a5a04a7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:37.256392 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d19dadde-6794-458b-bbe0-30e94a5a04a7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:37.256884 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d19dadde-6794-458b-bbe0-30e94a5a04a7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:37.257327 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d19dadde-6794-458b-bbe0-30e94a5a04a7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:37.258062 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d19dadde-6794-458b-bbe0-30e94a5a04a7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:37.258535 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d19dadde-6794-458b-bbe0-30e94a5a04a7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:37.258971 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d19dadde-6794-458b-bbe0-30e94a5a04a7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:37.271800 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-47e4e93a-a05e-4bb3-82a8-2e4b27644f86 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:37.272848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-47e4e93a-a05e-4bb3-82a8-2e4b27644f86 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:37.291601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-47e4e93a-a05e-4bb3-82a8-2e4b27644f86 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:37.293496 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-47e4e93a-a05e-4bb3-82a8-2e4b27644f86 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:37.302629 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-47e4e93a-a05e-4bb3-82a8-2e4b27644f86 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:37.303398 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-47e4e93a-a05e-4bb3-82a8-2e4b27644f86 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:37.310929 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-47e4e93a-a05e-4bb3-82a8-2e4b27644f86 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:37.311484 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-47e4e93a-a05e-4bb3-82a8-2e4b27644f86 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:37.376432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-47e4e93a-a05e-4bb3-82a8-2e4b27644f86 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:37.377001 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-47e4e93a-a05e-4bb3-82a8-2e4b27644f86 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:37.377448 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-47e4e93a-a05e-4bb3-82a8-2e4b27644f86 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:37.377925 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-47e4e93a-a05e-4bb3-82a8-2e4b27644f86 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lazy-loading 'fault' on Instance uuid 4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:59:37.436001 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-47e4e93a-a05e-4bb3-82a8-2e4b27644f86 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00585dbe7f814eeebda43417ca1d0ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265d7d88bb6f45708203ea74df8f3214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:37.444595 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-47e4e93a-a05e-4bb3-82a8-2e4b27644f86 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/servers/4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51" status: 200 len: 1307 microversion: 2.1 time: 0.178083 Sep 24 20:59:37.445189 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1367/2735] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:37 2022] GET /compute/v2.1/servers/4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51 => generated 1307 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:37.449858 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e0867a96-70d7-4cab-922d-acebbb1b2653 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:37.452035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e0867a96-70d7-4cab-922d-acebbb1b2653 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:37.464784 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e0867a96-70d7-4cab-922d-acebbb1b2653 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:37.465310 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e0867a96-70d7-4cab-922d-acebbb1b2653 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:37.465848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e0867a96-70d7-4cab-922d-acebbb1b2653 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:37.466889 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e0867a96-70d7-4cab-922d-acebbb1b2653 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:37.467509 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e0867a96-70d7-4cab-922d-acebbb1b2653 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:37.468344 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e0867a96-70d7-4cab-922d-acebbb1b2653 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:37.498982 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:59:37.500516 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d19dadde-6794-458b-bbe0-30e94a5a04a7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:37.506575 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e0867a96-70d7-4cab-922d-acebbb1b2653 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.060307 Sep 24 20:59:37.507180 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1368/2736] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:37 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:59:37.509753 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d19dadde-6794-458b-bbe0-30e94a5a04a7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1515 microversion: 2.1 time: 0.265941 Sep 24 20:59:37.510533 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1369/2737] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:37 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1515 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:37.515183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-42b1b1ec-507d-4168-84e0-ef248a00f626 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:37.516385 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-42b1b1ec-507d-4168-84e0-ef248a00f626 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: 61376b92-427e-4de0-9a8f-89828ce607fd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:37.517010 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ba29a134-c2c7-4fe5-b208-63c2ca2cfba6 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:37.517750 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ba29a134-c2c7-4fe5-b208-63c2ca2cfba6 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:37.526423 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ba29a134-c2c7-4fe5-b208-63c2ca2cfba6 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:37.527022 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ba29a134-c2c7-4fe5-b208-63c2ca2cfba6 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:37.527532 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ba29a134-c2c7-4fe5-b208-63c2ca2cfba6 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:37.528433 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ba29a134-c2c7-4fe5-b208-63c2ca2cfba6 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:37.528972 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ba29a134-c2c7-4fe5-b208-63c2ca2cfba6 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:37.529344 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-42b1b1ec-507d-4168-84e0-ef248a00f626 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:37.529467 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ba29a134-c2c7-4fe5-b208-63c2ca2cfba6 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:37.530072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-42b1b1ec-507d-4168-84e0-ef248a00f626 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:37.530803 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-42b1b1ec-507d-4168-84e0-ef248a00f626 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:37.532769 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-42b1b1ec-507d-4168-84e0-ef248a00f626 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:37.533326 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-42b1b1ec-507d-4168-84e0-ef248a00f626 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:37.533861 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-42b1b1ec-507d-4168-84e0-ef248a00f626 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:37.604402 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ba29a134-c2c7-4fe5-b208-63c2ca2cfba6 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:37.613158 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ba29a134-c2c7-4fe5-b208-63c2ca2cfba6 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:37.614638 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ba29a134-c2c7-4fe5-b208-63c2ca2cfba6 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:37.619483 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ba29a134-c2c7-4fe5-b208-63c2ca2cfba6 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1410 microversion: 2.75 time: 0.111327 Sep 24 20:59:37.620066 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1369/2738] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:59:37 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1410 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:59:37.645868 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-12b409c3-8b59-4eb4-8465-cd77702916da tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:37.647283 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-12b409c3-8b59-4eb4-8465-cd77702916da tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 5a17fd57-ce1b-4b51-8219-cae5add11ef2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:37.654912 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12b409c3-8b59-4eb4-8465-cd77702916da tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:37.655531 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12b409c3-8b59-4eb4-8465-cd77702916da tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:37.656387 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12b409c3-8b59-4eb4-8465-cd77702916da tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:37.659384 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12b409c3-8b59-4eb4-8465-cd77702916da tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:37.659969 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12b409c3-8b59-4eb4-8465-cd77702916da tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:37.660570 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12b409c3-8b59-4eb4-8465-cd77702916da tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:37.720026 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-42b1b1ec-507d-4168-84e0-ef248a00f626 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:37.728313 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-42b1b1ec-507d-4168-84e0-ef248a00f626 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/61376b92-427e-4de0-9a8f-89828ce607fd" status: 200 len: 1512 microversion: 2.1 time: 0.216624 Sep 24 20:59:37.728907 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1370/2739] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:37 2022] GET /compute/v2.1/servers/61376b92-427e-4de0-9a8f-89828ce607fd => generated 1512 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:37.745032 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-12b409c3-8b59-4eb4-8465-cd77702916da tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a38dd114ec04ba5826a68a9e796ab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec085cc2148f4cda9483fbe7257eeb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:37.754142 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-12b409c3-8b59-4eb4-8465-cd77702916da tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2" status: 200 len: 1297 microversion: 2.1 time: 0.116999 Sep 24 20:59:37.757393 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1370/2740] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:37 2022] GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2 => generated 1297 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:37.833562 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a6d2224a-33c7-4862-b801-86545f803842 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:37.834242 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a6d2224a-33c7-4862-b801-86545f803842 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 637c2b11-a4f9-40e9-b309-5cffdcd7b64a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:37.840450 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a6d2224a-33c7-4862-b801-86545f803842 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:37.841017 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a6d2224a-33c7-4862-b801-86545f803842 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:37.841462 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a6d2224a-33c7-4862-b801-86545f803842 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:37.842378 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a6d2224a-33c7-4862-b801-86545f803842 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:37.843056 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a6d2224a-33c7-4862-b801-86545f803842 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:37.843979 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a6d2224a-33c7-4862-b801-86545f803842 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:37.995681 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a6d2224a-33c7-4862-b801-86545f803842 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:38.003979 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a6d2224a-33c7-4862-b801-86545f803842 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a" status: 200 len: 1314 microversion: 2.1 time: 0.175656 Sep 24 20:59:38.004584 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1371/2741] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:37 2022] GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:38.470558 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-58633db0-f531-47eb-8e98-feef8130cf65 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:38.471773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-58633db0-f531-47eb-8e98-feef8130cf65 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] [instance: 4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:38.478784 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58633db0-f531-47eb-8e98-feef8130cf65 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:38.479673 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58633db0-f531-47eb-8e98-feef8130cf65 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:38.480276 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58633db0-f531-47eb-8e98-feef8130cf65 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:38.481489 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58633db0-f531-47eb-8e98-feef8130cf65 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:38.482106 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58633db0-f531-47eb-8e98-feef8130cf65 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:38.482758 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58633db0-f531-47eb-8e98-feef8130cf65 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:38.508619 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-58633db0-f531-47eb-8e98-feef8130cf65 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] HTTP exception thrown: Instance 4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51 could not be found. Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-58633db0-f531-47eb-8e98-feef8130cf65 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Request method failure captured: Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51 HTTP/1.1 Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL28f4zxo6mDk8JBoVOAhzoQsb7rjM0IVvkWIShDMYWavHT9fQwg3yV9KKJa-7bHq7Jq-vzUUz7hjFkeTSA0JxRkzqefQG_05iMhfvNLvJg3dUgkZs8Th059UiSQZFtBdSC8sO2OTTmE2ss4lXB7jhVsIVbCW8tMve0CVOkjwkpBOFhE Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 265d7d88bb6f45708203ea74df8f3214 Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ListImageFiltersTestJSON-61324143 Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/265d7d88bb6f45708203ea74df8f3214"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_265d7d88bb6f45708203ea74df8f3214"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/265d7d88bb6f45708203ea74df8f3214"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/265d7d88bb6f45708203ea74df8f3214"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ListImageFiltersTestJSON-61324143 Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 265d7d88bb6f45708203ea74df8f3214 Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-61324143 Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ListImageFiltersTestJSON-61324143-project Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 00585dbe7f814eeebda43417ca1d0ffa Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ListImageFiltersTestJSON-61324143-project Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51 could not be found. Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51'} Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51 could not be found. Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51 could not be found. Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:59:38.510703 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:38.514700 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:38.514700 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:59:38.514700 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:59:38.514700 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:59:38.514700 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:59:38.514700 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51 could not be found. Sep 24 20:59:38.514700 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:38.516143 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-58633db0-f531-47eb-8e98-feef8130cf65 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Returning 404 to user: Instance 4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:59:38.517189 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-58633db0-f531-47eb-8e98-feef8130cf65 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "GET /compute/v2.1/servers/4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51" status: 404 len: 111 microversion: 2.1 time: 0.051726 Sep 24 20:59:38.519397 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7fa9d4e0-9686-401e-84f4-1e65084c1e3e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:38.521170 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1371/2742] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:38 2022] GET /compute/v2.1/servers/4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:59:38.522241 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7fa9d4e0-9686-401e-84f4-1e65084c1e3e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:38.526274 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-14a5346a-4df1-408d-a6f6-0ea0f3afb3f5 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b07d829d0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:38.546561 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7fa9d4e0-9686-401e-84f4-1e65084c1e3e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:38.547842 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7fa9d4e0-9686-401e-84f4-1e65084c1e3e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:38.548316 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7fa9d4e0-9686-401e-84f4-1e65084c1e3e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:38.549063 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7fa9d4e0-9686-401e-84f4-1e65084c1e3e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:38.549535 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7fa9d4e0-9686-401e-84f4-1e65084c1e3e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:38.549974 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7fa9d4e0-9686-401e-84f4-1e65084c1e3e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:38.622320 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7fa9d4e0-9686-401e-84f4-1e65084c1e3e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.106918 Sep 24 20:59:38.623403 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1372/2743] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:38 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:59:38.629321 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-53ac4e33-6c92-4f82-b94c-8ddbc8eafd24 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:38.630391 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-53ac4e33-6c92-4f82-b94c-8ddbc8eafd24 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:38.638683 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-53ac4e33-6c92-4f82-b94c-8ddbc8eafd24 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:38.639443 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-53ac4e33-6c92-4f82-b94c-8ddbc8eafd24 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:38.640119 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-53ac4e33-6c92-4f82-b94c-8ddbc8eafd24 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:38.641460 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-53ac4e33-6c92-4f82-b94c-8ddbc8eafd24 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:38.642542 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-53ac4e33-6c92-4f82-b94c-8ddbc8eafd24 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:38.643592 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-53ac4e33-6c92-4f82-b94c-8ddbc8eafd24 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:38.860644 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-53ac4e33-6c92-4f82-b94c-8ddbc8eafd24 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:38.873274 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-53ac4e33-6c92-4f82-b94c-8ddbc8eafd24 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1515 microversion: 2.1 time: 0.248588 Sep 24 20:59:38.873843 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1373/2744] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:38 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1515 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:38.886175 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-06052808-2154-460e-9c59-d7fc3df60904 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:38.888720 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-06052808-2154-460e-9c59-d7fc3df60904 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:38.900330 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06052808-2154-460e-9c59-d7fc3df60904 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:38.900956 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06052808-2154-460e-9c59-d7fc3df60904 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:38.901760 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06052808-2154-460e-9c59-d7fc3df60904 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:38.902524 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06052808-2154-460e-9c59-d7fc3df60904 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:38.903157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06052808-2154-460e-9c59-d7fc3df60904 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:38.904057 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06052808-2154-460e-9c59-d7fc3df60904 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:38.991149 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-14a5346a-4df1-408d-a6f6-0ea0f3afb3f5 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "DELETE /compute/v2.1/images/4b6570b7-782e-4bac-a623-bbaa00593a58" status: 204 len: 0 microversion: 2.1 time: 0.468258 Sep 24 20:59:38.992179 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1372/2745] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:38 2022] DELETE /compute/v2.1/images/4b6570b7-782e-4bac-a623-bbaa00593a58 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:59:38.998416 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-194a33a2-31e4-416e-9369-0fb238f87b52 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:39.000620 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-194a33a2-31e4-416e-9369-0fb238f87b52 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: 61376b92-427e-4de0-9a8f-89828ce607fd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:39.009190 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-194a33a2-31e4-416e-9369-0fb238f87b52 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:39.011963 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-194a33a2-31e4-416e-9369-0fb238f87b52 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:39.013079 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-194a33a2-31e4-416e-9369-0fb238f87b52 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:39.014678 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-194a33a2-31e4-416e-9369-0fb238f87b52 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:39.015723 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-194a33a2-31e4-416e-9369-0fb238f87b52 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:39.016871 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-194a33a2-31e4-416e-9369-0fb238f87b52 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:39.084275 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-06052808-2154-460e-9c59-d7fc3df60904 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:39.106035 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-06052808-2154-460e-9c59-d7fc3df60904 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:39.108561 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-06052808-2154-460e-9c59-d7fc3df60904 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:39.118039 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-06052808-2154-460e-9c59-d7fc3df60904 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1418 microversion: 2.75 time: 0.239281 Sep 24 20:59:39.119189 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1374/2746] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:59:38 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1418 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:59:39.132512 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-194a33a2-31e4-416e-9369-0fb238f87b52 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:39.137169 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-147dd550-462b-4c8e-9080-9e13290a4dae tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:39.137955 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-147dd550-462b-4c8e-9080-9e13290a4dae tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 5a17fd57-ce1b-4b51-8219-cae5add11ef2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:39.147845 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-194a33a2-31e4-416e-9369-0fb238f87b52 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/61376b92-427e-4de0-9a8f-89828ce607fd" status: 200 len: 1470 microversion: 2.1 time: 0.154528 Sep 24 20:59:39.149060 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1373/2747] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:38 2022] GET /compute/v2.1/servers/61376b92-427e-4de0-9a8f-89828ce607fd => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:39.151370 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-147dd550-462b-4c8e-9080-9e13290a4dae tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:39.153458 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-147dd550-462b-4c8e-9080-9e13290a4dae tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:39.154061 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-147dd550-462b-4c8e-9080-9e13290a4dae tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:39.155012 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-147dd550-462b-4c8e-9080-9e13290a4dae tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:39.155666 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-147dd550-462b-4c8e-9080-9e13290a4dae tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:39.157317 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-147dd550-462b-4c8e-9080-9e13290a4dae tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:39.158577 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-a863034d-856a-442d-b8cf-76023ba01b85 req-d0f41030-b2e0-4b9f-9f40-8b0d085efc35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51", "name": "network-vif-deleted", "tag": "00c8986f-e263-4bab-8396-0009b8e0c3e8"}, {"server_uuid": "5a17fd57-ce1b-4b51-8219-cae5add11ef2", "name": "network-vif-deleted", "tag": "957e661f-4b67-484a-a751-9619aed2316e"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:39.169407 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-a863034d-856a-442d-b8cf-76023ba01b85 req-d0f41030-b2e0-4b9f-9f40-8b0d085efc35 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:39.170061 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-a863034d-856a-442d-b8cf-76023ba01b85 req-d0f41030-b2e0-4b9f-9f40-8b0d085efc35 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:39.170552 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-a863034d-856a-442d-b8cf-76023ba01b85 req-d0f41030-b2e0-4b9f-9f40-8b0d085efc35 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:39.185738 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-147dd550-462b-4c8e-9080-9e13290a4dae tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] HTTP exception thrown: Instance 5a17fd57-ce1b-4b51-8219-cae5add11ef2 could not be found. Sep 24 20:59:39.186729 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-a863034d-856a-442d-b8cf-76023ba01b85 req-d0f41030-b2e0-4b9f-9f40-8b0d085efc35 service nova] Creating event network-vif-deleted:00c8986f-e263-4bab-8396-0009b8e0c3e8 for instance 4100f6f1-2ecc-4aab-8ff9-3a00a1a94e51 on nch2-master-1 Sep 24 20:59:39.187325 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-a863034d-856a-442d-b8cf-76023ba01b85 req-d0f41030-b2e0-4b9f-9f40-8b0d085efc35 service nova] Creating event network-vif-deleted:957e661f-4b67-484a-a751-9619aed2316e for instance 5a17fd57-ce1b-4b51-8219-cae5add11ef2 on nch2-master-1 Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-147dd550-462b-4c8e-9080-9e13290a4dae tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Request method failure captured: Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2 HTTP/1.1 Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL29H3Y19P2AmVBhvRjNFRCBpolNuadDBOlKSR1Efyzo3E2lbdIYzJx52Dj0lF1bXU_fThOJRme9w_OFrp-J5PiK1Z0egs_IZEWNOQo5vEfMSx65zof8vr97oZ3wNj8FE3wdmHhCSstpezlY19Uo3EC4P6Ah5BMmSZQrPiNhmXPDnAVk Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: ec085cc2148f4cda9483fbe7257eeb14 Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersTestMultiNic-1036123437 Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ec085cc2148f4cda9483fbe7257eeb14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ec085cc2148f4cda9483fbe7257eeb14"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ec085cc2148f4cda9483fbe7257eeb14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ec085cc2148f4cda9483fbe7257eeb14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersTestMultiNic-1036123437 Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: ec085cc2148f4cda9483fbe7257eeb14 Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersTestMultiNic-1036123437 Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersTestMultiNic-1036123437-project Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 6a38dd114ec04ba5826a68a9e796ab8d Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersTestMultiNic-1036123437-project Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 5a17fd57-ce1b-4b51-8219-cae5add11ef2 could not be found. Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '5a17fd57-ce1b-4b51-8219-cae5add11ef2'} Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a17fd57-ce1b-4b51-8219-cae5add11ef2 could not be found. Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a17fd57-ce1b-4b51-8219-cae5add11ef2 could not be found. Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:59:39.189147 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:59:39.194097 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:39.194097 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:59:39.194097 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:59:39.194097 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:59:39.194097 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:59:39.194097 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a17fd57-ce1b-4b51-8219-cae5add11ef2 could not be found. Sep 24 20:59:39.194097 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:59:39.195035 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-a863034d-856a-442d-b8cf-76023ba01b85 req-d0f41030-b2e0-4b9f-9f40-8b0d085efc35 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043914 Sep 24 20:59:39.195321 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1374/2748] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:59:39.197541 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-147dd550-462b-4c8e-9080-9e13290a4dae tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Returning 404 to user: Instance 5a17fd57-ce1b-4b51-8219-cae5add11ef2 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:59:39.198590 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-147dd550-462b-4c8e-9080-9e13290a4dae tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2" status: 404 len: 111 microversion: 2.1 time: 0.078038 Sep 24 20:59:39.200008 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1375/2749] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:39 2022] GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:59:39.200355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1c0b4c6d-46bb-4b6e-83cb-ce3a7edebae8 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b07d11ee0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:39.209836 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-366fb9ef-2546-470e-b9c5-d08516f25baf tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:39.210405 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-366fb9ef-2546-470e-b9c5-d08516f25baf tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 637c2b11-a4f9-40e9-b309-5cffdcd7b64a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:39.217838 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-366fb9ef-2546-470e-b9c5-d08516f25baf tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:39.218332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-366fb9ef-2546-470e-b9c5-d08516f25baf tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:39.219803 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-366fb9ef-2546-470e-b9c5-d08516f25baf tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:39.220649 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-366fb9ef-2546-470e-b9c5-d08516f25baf tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:39.221106 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-366fb9ef-2546-470e-b9c5-d08516f25baf tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:39.221534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-366fb9ef-2546-470e-b9c5-d08516f25baf tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:39.460943 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1c0b4c6d-46bb-4b6e-83cb-ce3a7edebae8 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "DELETE /compute/v2.1/images/6c222011-a7e6-4ffa-843f-508ef2b07e9c" status: 204 len: 0 microversion: 2.1 time: 0.264382 Sep 24 20:59:39.461508 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1375/2750] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:39 2022] DELETE /compute/v2.1/images/6c222011-a7e6-4ffa-843f-508ef2b07e9c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:59:39.467061 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-28aee706-98f8-49bf-9a53-5f12dbdb526d req-d6f5129f-74d9-46b2-be73-3d2946d74f96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61376b92-427e-4de0-9a8f-89828ce607fd", "name": "network-vif-deleted", "tag": "6e895bae-4346-4a9f-bace-ea69859c2106"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:39.481646 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-28aee706-98f8-49bf-9a53-5f12dbdb526d req-d6f5129f-74d9-46b2-be73-3d2946d74f96 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:39.482275 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-28aee706-98f8-49bf-9a53-5f12dbdb526d req-d6f5129f-74d9-46b2-be73-3d2946d74f96 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:39.482770 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-28aee706-98f8-49bf-9a53-5f12dbdb526d req-d6f5129f-74d9-46b2-be73-3d2946d74f96 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:39.497861 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-28aee706-98f8-49bf-9a53-5f12dbdb526d req-d6f5129f-74d9-46b2-be73-3d2946d74f96 service nova] Creating event network-vif-deleted:6e895bae-4346-4a9f-bace-ea69859c2106 for instance 61376b92-427e-4de0-9a8f-89828ce607fd on nch1-master-1 Sep 24 20:59:39.505581 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-28aee706-98f8-49bf-9a53-5f12dbdb526d req-d6f5129f-74d9-46b2-be73-3d2946d74f96 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042060 Sep 24 20:59:39.506095 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1376/2751] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:59:39.513310 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f788cd1b-cc85-47e4-9428-00e4050f05b9 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] Calling method '.version_select at 0x7f4b07d78dc0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:39.545407 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-366fb9ef-2546-470e-b9c5-d08516f25baf tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:39.555944 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-366fb9ef-2546-470e-b9c5-d08516f25baf tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a" status: 200 len: 1314 microversion: 2.1 time: 0.354467 Sep 24 20:59:39.557040 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1376/2752] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:39 2022] GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:39.649822 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ff0a7ec5-79a2-40fb-956d-2f4068938b41 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:39.652552 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ff0a7ec5-79a2-40fb-956d-2f4068938b41 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:39.660574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff0a7ec5-79a2-40fb-956d-2f4068938b41 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:39.661321 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff0a7ec5-79a2-40fb-956d-2f4068938b41 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:39.662351 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff0a7ec5-79a2-40fb-956d-2f4068938b41 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:39.663325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff0a7ec5-79a2-40fb-956d-2f4068938b41 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:39.664098 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff0a7ec5-79a2-40fb-956d-2f4068938b41 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:39.664930 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff0a7ec5-79a2-40fb-956d-2f4068938b41 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:39.698593 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ff0a7ec5-79a2-40fb-956d-2f4068938b41 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.065738 Sep 24 20:59:39.699721 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1377/2753] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:39 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:59:39.842945 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f788cd1b-cc85-47e4-9428-00e4050f05b9 tempest-ListImageFiltersTestJSON-61324143 tempest-ListImageFiltersTestJSON-61324143-project] 10.222.0.52 "DELETE /compute/v2.1/images/173a5f87-44b9-4bad-9ff6-e10630c83424" status: 204 len: 0 microversion: 2.1 time: 0.335196 Sep 24 20:59:39.843417 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1377/2754] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:39 2022] DELETE /compute/v2.1/images/173a5f87-44b9-4bad-9ff6-e10630c83424 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:59:39.901441 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cb2a18ad-49a9-4d52-b1a0-cb7447c72f84 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:39.902871 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cb2a18ad-49a9-4d52-b1a0-cb7447c72f84 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:39.912163 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb2a18ad-49a9-4d52-b1a0-cb7447c72f84 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:39.913009 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb2a18ad-49a9-4d52-b1a0-cb7447c72f84 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:39.913957 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb2a18ad-49a9-4d52-b1a0-cb7447c72f84 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:39.915355 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb2a18ad-49a9-4d52-b1a0-cb7447c72f84 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:39.916031 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb2a18ad-49a9-4d52-b1a0-cb7447c72f84 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:39.916971 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb2a18ad-49a9-4d52-b1a0-cb7447c72f84 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:40.114769 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cb2a18ad-49a9-4d52-b1a0-cb7447c72f84 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:40.122712 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cb2a18ad-49a9-4d52-b1a0-cb7447c72f84 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1515 microversion: 2.1 time: 0.226007 Sep 24 20:59:40.123306 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1378/2755] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:39 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1515 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:40.148149 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dc7c9163-847e-4738-9b93-25179f101d0e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:40.149061 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dc7c9163-847e-4738-9b93-25179f101d0e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:40.156003 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc7c9163-847e-4738-9b93-25179f101d0e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:40.156759 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc7c9163-847e-4738-9b93-25179f101d0e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:40.157392 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc7c9163-847e-4738-9b93-25179f101d0e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:40.158160 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc7c9163-847e-4738-9b93-25179f101d0e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:40.158666 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc7c9163-847e-4738-9b93-25179f101d0e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:40.159264 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc7c9163-847e-4738-9b93-25179f101d0e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:40.172267 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-426790e8-2721-42c8-bdef-ea2faf3a5c79 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:40.173205 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-426790e8-2721-42c8-bdef-ea2faf3a5c79 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: 61376b92-427e-4de0-9a8f-89828ce607fd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:40.181357 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-426790e8-2721-42c8-bdef-ea2faf3a5c79 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:40.183271 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-426790e8-2721-42c8-bdef-ea2faf3a5c79 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:40.187069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-426790e8-2721-42c8-bdef-ea2faf3a5c79 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:40.189177 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-426790e8-2721-42c8-bdef-ea2faf3a5c79 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:40.189857 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-426790e8-2721-42c8-bdef-ea2faf3a5c79 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:40.190557 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-426790e8-2721-42c8-bdef-ea2faf3a5c79 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:40.271186 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dc7c9163-847e-4738-9b93-25179f101d0e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:40.277015 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-426790e8-2721-42c8-bdef-ea2faf3a5c79 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:40.277552 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-426790e8-2721-42c8-bdef-ea2faf3a5c79 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:40.278129 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-426790e8-2721-42c8-bdef-ea2faf3a5c79 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:40.278681 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-426790e8-2721-42c8-bdef-ea2faf3a5c79 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lazy-loading 'fault' on Instance uuid 61376b92-427e-4de0-9a8f-89828ce607fd {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:59:40.288927 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dc7c9163-847e-4738-9b93-25179f101d0e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:40.293951 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dc7c9163-847e-4738-9b93-25179f101d0e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:40.310278 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dc7c9163-847e-4738-9b93-25179f101d0e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1416 microversion: 2.75 time: 0.166132 Sep 24 20:59:40.315679 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1378/2756] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:59:40 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1416 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:59:40.374138 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-426790e8-2721-42c8-bdef-ea2faf3a5c79 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:40.379938 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-fa476649-29e5-4b99-9e89-992f9a4812b9 req-7b1ded25-0db5-4a17-a182-f5ba04f2d48f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "637c2b11-a4f9-40e9-b309-5cffdcd7b64a", "name": "network-vif-plugged", "status": "completed", "tag": "6adca827-a71f-421b-9872-6a1ccba4b327"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:40.384812 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-426790e8-2721-42c8-bdef-ea2faf3a5c79 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/61376b92-427e-4de0-9a8f-89828ce607fd" status: 200 len: 1307 microversion: 2.1 time: 0.216435 Sep 24 20:59:40.385695 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1379/2757] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:40 2022] GET /compute/v2.1/servers/61376b92-427e-4de0-9a8f-89828ce607fd => generated 1307 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:40.419418 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-fa476649-29e5-4b99-9e89-992f9a4812b9 req-7b1ded25-0db5-4a17-a182-f5ba04f2d48f service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:40.420069 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-fa476649-29e5-4b99-9e89-992f9a4812b9 req-7b1ded25-0db5-4a17-a182-f5ba04f2d48f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:40.420605 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-fa476649-29e5-4b99-9e89-992f9a4812b9 req-7b1ded25-0db5-4a17-a182-f5ba04f2d48f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:40.445614 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-fa476649-29e5-4b99-9e89-992f9a4812b9 req-7b1ded25-0db5-4a17-a182-f5ba04f2d48f service nova] Creating event network-vif-plugged:6adca827-a71f-421b-9872-6a1ccba4b327 for instance 637c2b11-a4f9-40e9-b309-5cffdcd7b64a on nch1-master-1 Sep 24 20:59:40.452198 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-fa476649-29e5-4b99-9e89-992f9a4812b9 req-7b1ded25-0db5-4a17-a182-f5ba04f2d48f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077440 Sep 24 20:59:40.454136 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1379/2758] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:59:40.581640 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-60ac3fcb-73ad-447e-a48c-14d2a3082dc4 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:40.582955 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-60ac3fcb-73ad-447e-a48c-14d2a3082dc4 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 637c2b11-a4f9-40e9-b309-5cffdcd7b64a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:40.589848 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-60ac3fcb-73ad-447e-a48c-14d2a3082dc4 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:40.590405 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-60ac3fcb-73ad-447e-a48c-14d2a3082dc4 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:40.591021 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-60ac3fcb-73ad-447e-a48c-14d2a3082dc4 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:40.591795 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-60ac3fcb-73ad-447e-a48c-14d2a3082dc4 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:40.592463 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-60ac3fcb-73ad-447e-a48c-14d2a3082dc4 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:40.592897 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-60ac3fcb-73ad-447e-a48c-14d2a3082dc4 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:40.719227 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d922903f-c83a-4652-8464-0991d3d56df2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:40.722079 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d922903f-c83a-4652-8464-0991d3d56df2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:40.731699 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d922903f-c83a-4652-8464-0991d3d56df2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:40.732623 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d922903f-c83a-4652-8464-0991d3d56df2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:40.733491 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d922903f-c83a-4652-8464-0991d3d56df2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:40.738959 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d922903f-c83a-4652-8464-0991d3d56df2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:40.739873 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d922903f-c83a-4652-8464-0991d3d56df2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:40.741577 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d922903f-c83a-4652-8464-0991d3d56df2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:40.786884 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d922903f-c83a-4652-8464-0991d3d56df2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.078979 Sep 24 20:59:40.788273 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1380/2759] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:40 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 20:59:40.819050 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-60ac3fcb-73ad-447e-a48c-14d2a3082dc4 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:40.830125 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-60ac3fcb-73ad-447e-a48c-14d2a3082dc4 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a" status: 200 len: 1314 microversion: 2.1 time: 0.252422 Sep 24 20:59:40.831026 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1380/2760] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:40 2022] GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:41.147458 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f252db52-511b-45a9-a930-67a775500fde tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:41.148546 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f252db52-511b-45a9-a930-67a775500fde tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:41.155269 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f252db52-511b-45a9-a930-67a775500fde tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:41.156503 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f252db52-511b-45a9-a930-67a775500fde tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:41.158227 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f252db52-511b-45a9-a930-67a775500fde tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:41.159427 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f252db52-511b-45a9-a930-67a775500fde tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:41.160371 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f252db52-511b-45a9-a930-67a775500fde tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:41.160808 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f252db52-511b-45a9-a930-67a775500fde tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:41.330048 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f252db52-511b-45a9-a930-67a775500fde tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:41.334886 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f252db52-511b-45a9-a930-67a775500fde tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1515 microversion: 2.1 time: 0.192280 Sep 24 20:59:41.335473 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1381/2761] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:41 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1515 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:41.344695 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fa44f324-5e98-4a7e-8cf9-1b44254fa99a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:41.345399 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fa44f324-5e98-4a7e-8cf9-1b44254fa99a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:41.356820 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fa44f324-5e98-4a7e-8cf9-1b44254fa99a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:41.357451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fa44f324-5e98-4a7e-8cf9-1b44254fa99a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:41.364288 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fa44f324-5e98-4a7e-8cf9-1b44254fa99a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:41.364288 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fa44f324-5e98-4a7e-8cf9-1b44254fa99a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:41.364288 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fa44f324-5e98-4a7e-8cf9-1b44254fa99a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:41.364288 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fa44f324-5e98-4a7e-8cf9-1b44254fa99a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:41.401885 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-66f4e1ed-2f5e-4ae8-96db-b2cdd481b950 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:41.402400 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-66f4e1ed-2f5e-4ae8-96db-b2cdd481b950 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 5a17fd57-ce1b-4b51-8219-cae5add11ef2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:41.414611 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66f4e1ed-2f5e-4ae8-96db-b2cdd481b950 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:41.415578 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66f4e1ed-2f5e-4ae8-96db-b2cdd481b950 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:41.416287 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66f4e1ed-2f5e-4ae8-96db-b2cdd481b950 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:41.417237 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66f4e1ed-2f5e-4ae8-96db-b2cdd481b950 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:41.417903 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66f4e1ed-2f5e-4ae8-96db-b2cdd481b950 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:41.418478 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66f4e1ed-2f5e-4ae8-96db-b2cdd481b950 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:41.441417 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-66f4e1ed-2f5e-4ae8-96db-b2cdd481b950 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] HTTP exception thrown: Instance 5a17fd57-ce1b-4b51-8219-cae5add11ef2 could not be found. Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-66f4e1ed-2f5e-4ae8-96db-b2cdd481b950 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Request method failure captured: Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2 HTTP/1.1 Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL29H3Y19P2AmVBhvRjNFRCBpolNuadDBOlKSR1Efyzo3E2lbdIYzJx52Dj0lF1bXU_fThOJRme9w_OFrp-J5PiK1Z0egs_IZEWNOQo5vEfMSx65zof8vr97oZ3wNj8FE3wdmHhCSstpezlY19Uo3EC4P6Ah5BMmSZQrPiNhmXPDnAVk Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: ec085cc2148f4cda9483fbe7257eeb14 Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersTestMultiNic-1036123437 Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ec085cc2148f4cda9483fbe7257eeb14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ec085cc2148f4cda9483fbe7257eeb14"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ec085cc2148f4cda9483fbe7257eeb14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ec085cc2148f4cda9483fbe7257eeb14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersTestMultiNic-1036123437 Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: ec085cc2148f4cda9483fbe7257eeb14 Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersTestMultiNic-1036123437 Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersTestMultiNic-1036123437-project Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 6a38dd114ec04ba5826a68a9e796ab8d Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersTestMultiNic-1036123437-project Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 5a17fd57-ce1b-4b51-8219-cae5add11ef2 could not be found. Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '5a17fd57-ce1b-4b51-8219-cae5add11ef2'} Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a17fd57-ce1b-4b51-8219-cae5add11ef2 could not be found. Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:59:41.443060 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:59:41.448176 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a17fd57-ce1b-4b51-8219-cae5add11ef2 could not be found. Sep 24 20:59:41.448176 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:41.448176 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:59:41.448176 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:41.448176 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:41.448176 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:59:41.448176 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:59:41.448176 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:59:41.448176 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:59:41.448176 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a17fd57-ce1b-4b51-8219-cae5add11ef2 could not be found. Sep 24 20:59:41.448176 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:41.448176 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-66f4e1ed-2f5e-4ae8-96db-b2cdd481b950 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Returning 404 to user: Instance 5a17fd57-ce1b-4b51-8219-cae5add11ef2 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:59:41.448176 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-66f4e1ed-2f5e-4ae8-96db-b2cdd481b950 tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2" status: 404 len: 111 microversion: 2.1 time: 0.047018 Sep 24 20:59:41.448176 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1382/2762] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:59:41 2022] DELETE /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 20:59:41.453108 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-920c8961-2774-4137-a881-9e1dde980dcd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:41.453740 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-920c8961-2774-4137-a881-9e1dde980dcd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: 61376b92-427e-4de0-9a8f-89828ce607fd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:41.455901 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fa44f324-5e98-4a7e-8cf9-1b44254fa99a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:41.460448 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-920c8961-2774-4137-a881-9e1dde980dcd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:41.461035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-920c8961-2774-4137-a881-9e1dde980dcd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:41.461380 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-920c8961-2774-4137-a881-9e1dde980dcd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:41.462087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-920c8961-2774-4137-a881-9e1dde980dcd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:41.462700 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-920c8961-2774-4137-a881-9e1dde980dcd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:41.463326 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-920c8961-2774-4137-a881-9e1dde980dcd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:41.465239 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fa44f324-5e98-4a7e-8cf9-1b44254fa99a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:41.466674 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fa44f324-5e98-4a7e-8cf9-1b44254fa99a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:41.470103 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:59:41.473715 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fa44f324-5e98-4a7e-8cf9-1b44254fa99a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1416 microversion: 2.75 time: 0.133283 Sep 24 20:59:41.474381 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1381/2763] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:59:41 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1416 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:59:41.488820 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1c0cb7b5-4eab-4eb8-840a-662a4a2925ff tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:41.489744 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1c0cb7b5-4eab-4eb8-840a-662a4a2925ff tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 5a17fd57-ce1b-4b51-8219-cae5add11ef2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:41.498761 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c0cb7b5-4eab-4eb8-840a-662a4a2925ff tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:41.499518 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c0cb7b5-4eab-4eb8-840a-662a4a2925ff tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:41.500229 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c0cb7b5-4eab-4eb8-840a-662a4a2925ff tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:41.501162 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c0cb7b5-4eab-4eb8-840a-662a4a2925ff tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:41.501781 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c0cb7b5-4eab-4eb8-840a-662a4a2925ff tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:41.502260 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c0cb7b5-4eab-4eb8-840a-662a4a2925ff tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:41.506712 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:59:41.506963 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-920c8961-2774-4137-a881-9e1dde980dcd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:41.507459 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-920c8961-2774-4137-a881-9e1dde980dcd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:41.507909 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-920c8961-2774-4137-a881-9e1dde980dcd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:41.508418 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-920c8961-2774-4137-a881-9e1dde980dcd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lazy-loading 'fault' on Instance uuid 61376b92-427e-4de0-9a8f-89828ce607fd {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:59:41.517639 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-1c0cb7b5-4eab-4eb8-840a-662a4a2925ff tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] HTTP exception thrown: Instance 5a17fd57-ce1b-4b51-8219-cae5add11ef2 could not be found. Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1c0cb7b5-4eab-4eb8-840a-662a4a2925ff tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Request method failure captured: Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2 HTTP/1.1 Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL29H3Y19P2AmVBhvRjNFRCBpolNuadDBOlKSR1Efyzo3E2lbdIYzJx52Dj0lF1bXU_fThOJRme9w_OFrp-J5PiK1Z0egs_IZEWNOQo5vEfMSx65zof8vr97oZ3wNj8FE3wdmHhCSstpezlY19Uo3EC4P6Ah5BMmSZQrPiNhmXPDnAVk Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: ec085cc2148f4cda9483fbe7257eeb14 Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersTestMultiNic-1036123437 Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ec085cc2148f4cda9483fbe7257eeb14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ec085cc2148f4cda9483fbe7257eeb14"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ec085cc2148f4cda9483fbe7257eeb14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ec085cc2148f4cda9483fbe7257eeb14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersTestMultiNic-1036123437 Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: ec085cc2148f4cda9483fbe7257eeb14 Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersTestMultiNic-1036123437 Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersTestMultiNic-1036123437-project Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 6a38dd114ec04ba5826a68a9e796ab8d Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersTestMultiNic-1036123437-project Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 5a17fd57-ce1b-4b51-8219-cae5add11ef2 could not be found. Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '5a17fd57-ce1b-4b51-8219-cae5add11ef2'} Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a17fd57-ce1b-4b51-8219-cae5add11ef2 could not be found. Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a17fd57-ce1b-4b51-8219-cae5add11ef2 could not be found. Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:59:41.519225 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:59:41.523355 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:41.523355 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:59:41.523355 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:59:41.523355 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:59:41.523355 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:59:41.523355 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a17fd57-ce1b-4b51-8219-cae5add11ef2 could not be found. Sep 24 20:59:41.523355 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:59:41.523355 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1c0cb7b5-4eab-4eb8-840a-662a4a2925ff tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Returning 404 to user: Instance 5a17fd57-ce1b-4b51-8219-cae5add11ef2 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:59:41.523355 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1c0cb7b5-4eab-4eb8-840a-662a4a2925ff tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2" status: 404 len: 111 microversion: 2.1 time: 0.036755 Sep 24 20:59:41.523355 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1382/2764] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:41 2022] GET /compute/v2.1/servers/5a17fd57-ce1b-4b51-8219-cae5add11ef2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:59:41.550581 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-920c8961-2774-4137-a881-9e1dde980dcd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:41.559021 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-920c8961-2774-4137-a881-9e1dde980dcd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/61376b92-427e-4de0-9a8f-89828ce607fd" status: 200 len: 1307 microversion: 2.1 time: 0.113064 Sep 24 20:59:41.559986 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1383/2765] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:41 2022] GET /compute/v2.1/servers/61376b92-427e-4de0-9a8f-89828ce607fd => generated 1307 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:41.565047 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f85a21d4-0623-4729-98e6-0e0d1ef9658d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:41.565551 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f85a21d4-0623-4729-98e6-0e0d1ef9658d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:41.572143 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f85a21d4-0623-4729-98e6-0e0d1ef9658d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:41.572633 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f85a21d4-0623-4729-98e6-0e0d1ef9658d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:41.573068 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f85a21d4-0623-4729-98e6-0e0d1ef9658d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:41.573770 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f85a21d4-0623-4729-98e6-0e0d1ef9658d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:41.574431 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f85a21d4-0623-4729-98e6-0e0d1ef9658d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:41.575084 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f85a21d4-0623-4729-98e6-0e0d1ef9658d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:41.590157 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-f85a21d4-0623-4729-98e6-0e0d1ef9658d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] HTTP exception thrown: Instance 1c394113-a640-4199-80e0-1316dd1b2828 could not be found. Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f85a21d4-0623-4729-98e6-0e0d1ef9658d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Request method failure captured: Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 HTTP/1.1 Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL29H3Y19P2AmVBhvRjNFRCBpolNuadDBOlKSR1Efyzo3E2lbdIYzJx52Dj0lF1bXU_fThOJRme9w_OFrp-J5PiK1Z0egs_IZEWNOQo5vEfMSx65zof8vr97oZ3wNj8FE3wdmHhCSstpezlY19Uo3EC4P6Ah5BMmSZQrPiNhmXPDnAVk Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: ec085cc2148f4cda9483fbe7257eeb14 Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersTestMultiNic-1036123437 Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ec085cc2148f4cda9483fbe7257eeb14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ec085cc2148f4cda9483fbe7257eeb14"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ec085cc2148f4cda9483fbe7257eeb14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ec085cc2148f4cda9483fbe7257eeb14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersTestMultiNic-1036123437 Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: ec085cc2148f4cda9483fbe7257eeb14 Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersTestMultiNic-1036123437 Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersTestMultiNic-1036123437-project Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 6a38dd114ec04ba5826a68a9e796ab8d Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersTestMultiNic-1036123437-project Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 1c394113-a640-4199-80e0-1316dd1b2828 could not be found. Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '1c394113-a640-4199-80e0-1316dd1b2828'} Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c394113-a640-4199-80e0-1316dd1b2828 could not be found. Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:59:41.591737 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:59:41.599489 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c394113-a640-4199-80e0-1316dd1b2828 could not be found. Sep 24 20:59:41.599489 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:41.599489 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:59:41.599489 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:41.599489 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:41.599489 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:59:41.599489 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:59:41.599489 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:59:41.599489 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:59:41.599489 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c394113-a640-4199-80e0-1316dd1b2828 could not be found. Sep 24 20:59:41.599489 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:41.599489 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f85a21d4-0623-4729-98e6-0e0d1ef9658d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Returning 404 to user: Instance 1c394113-a640-4199-80e0-1316dd1b2828 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:59:41.599489 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f85a21d4-0623-4729-98e6-0e0d1ef9658d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 404 len: 111 microversion: 2.1 time: 0.031994 Sep 24 20:59:41.599489 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1384/2766] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:59:41 2022] DELETE /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:59:41.601834 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-08d38745-cfaf-4d36-bec9-eb3c6a930d1d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:41.602456 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-08d38745-cfaf-4d36-bec9-eb3c6a930d1d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] [instance: 1c394113-a640-4199-80e0-1316dd1b2828] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:41.608261 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-08d38745-cfaf-4d36-bec9-eb3c6a930d1d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:41.608749 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-08d38745-cfaf-4d36-bec9-eb3c6a930d1d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:41.609840 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-08d38745-cfaf-4d36-bec9-eb3c6a930d1d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:41.610561 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-08d38745-cfaf-4d36-bec9-eb3c6a930d1d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:41.611021 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-08d38745-cfaf-4d36-bec9-eb3c6a930d1d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:41.611451 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-08d38745-cfaf-4d36-bec9-eb3c6a930d1d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:41.625475 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-08d38745-cfaf-4d36-bec9-eb3c6a930d1d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] HTTP exception thrown: Instance 1c394113-a640-4199-80e0-1316dd1b2828 could not be found. Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-08d38745-cfaf-4d36-bec9-eb3c6a930d1d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Request method failure captured: Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 HTTP/1.1 Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL29H3Y19P2AmVBhvRjNFRCBpolNuadDBOlKSR1Efyzo3E2lbdIYzJx52Dj0lF1bXU_fThOJRme9w_OFrp-J5PiK1Z0egs_IZEWNOQo5vEfMSx65zof8vr97oZ3wNj8FE3wdmHhCSstpezlY19Uo3EC4P6Ah5BMmSZQrPiNhmXPDnAVk Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: ec085cc2148f4cda9483fbe7257eeb14 Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersTestMultiNic-1036123437 Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ec085cc2148f4cda9483fbe7257eeb14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ec085cc2148f4cda9483fbe7257eeb14"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ec085cc2148f4cda9483fbe7257eeb14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ec085cc2148f4cda9483fbe7257eeb14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersTestMultiNic-1036123437 Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: ec085cc2148f4cda9483fbe7257eeb14 Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersTestMultiNic-1036123437 Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersTestMultiNic-1036123437-project Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 6a38dd114ec04ba5826a68a9e796ab8d Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersTestMultiNic-1036123437-project Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 1c394113-a640-4199-80e0-1316dd1b2828 could not be found. Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '1c394113-a640-4199-80e0-1316dd1b2828'} Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c394113-a640-4199-80e0-1316dd1b2828 could not be found. Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c394113-a640-4199-80e0-1316dd1b2828 could not be found. Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:59:41.627400 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:41.631561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:41.631561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:59:41.631561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:59:41.631561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:59:41.631561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:59:41.631561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c394113-a640-4199-80e0-1316dd1b2828 could not be found. Sep 24 20:59:41.631561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:41.631561 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-08d38745-cfaf-4d36-bec9-eb3c6a930d1d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] Returning 404 to user: Instance 1c394113-a640-4199-80e0-1316dd1b2828 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:59:41.631561 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-08d38745-cfaf-4d36-bec9-eb3c6a930d1d tempest-ServersTestMultiNic-1036123437 tempest-ServersTestMultiNic-1036123437-project] 10.222.0.52 "GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828" status: 404 len: 111 microversion: 2.1 time: 0.030272 Sep 24 20:59:41.631561 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1385/2767] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:41 2022] GET /compute/v2.1/servers/1c394113-a640-4199-80e0-1316dd1b2828 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:59:41.673271 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f82954ce-565b-4d73-bbbd-0f5f509c57a9 tempest-AbsoluteLimitsNegativeTestJSON-256404892 tempest-AbsoluteLimitsNegativeTestJSON-256404892-project] Calling method '.version_select at 0x7f4b0c58c820>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:41.685102 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f82954ce-565b-4d73-bbbd-0f5f509c57a9 tempest-AbsoluteLimitsNegativeTestJSON-256404892 tempest-AbsoluteLimitsNegativeTestJSON-256404892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:41.685597 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f82954ce-565b-4d73-bbbd-0f5f509c57a9 tempest-AbsoluteLimitsNegativeTestJSON-256404892 tempest-AbsoluteLimitsNegativeTestJSON-256404892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:41.686045 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f82954ce-565b-4d73-bbbd-0f5f509c57a9 tempest-AbsoluteLimitsNegativeTestJSON-256404892 tempest-AbsoluteLimitsNegativeTestJSON-256404892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:41.686812 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f82954ce-565b-4d73-bbbd-0f5f509c57a9 tempest-AbsoluteLimitsNegativeTestJSON-256404892 tempest-AbsoluteLimitsNegativeTestJSON-256404892-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:41.687604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f82954ce-565b-4d73-bbbd-0f5f509c57a9 tempest-AbsoluteLimitsNegativeTestJSON-256404892 tempest-AbsoluteLimitsNegativeTestJSON-256404892-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:41.688147 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f82954ce-565b-4d73-bbbd-0f5f509c57a9 tempest-AbsoluteLimitsNegativeTestJSON-256404892 tempest-AbsoluteLimitsNegativeTestJSON-256404892-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:41.710022 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f82954ce-565b-4d73-bbbd-0f5f509c57a9 tempest-AbsoluteLimitsNegativeTestJSON-256404892 tempest-AbsoluteLimitsNegativeTestJSON-256404892-project] 10.222.0.52 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.187352 Sep 24 20:59:41.710655 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1383/2768] 10.222.0.52 () {58 vars in 1122 bytes} [Sat Sep 24 20:59:41 2022] GET /compute/v2.1/limits => generated 511 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:59:41.766657 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-46e33687-9936-44ac-8452-17c2157d3a59 tempest-AbsoluteLimitsNegativeTestJSON-256404892 tempest-AbsoluteLimitsNegativeTestJSON-256404892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1260907077", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:41.799724 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8d16f513-9d5b-4832-aa61-a7d44c69f650 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:41.802085 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8d16f513-9d5b-4832-aa61-a7d44c69f650 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:41.808589 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d16f513-9d5b-4832-aa61-a7d44c69f650 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:41.809156 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d16f513-9d5b-4832-aa61-a7d44c69f650 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:41.809839 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d16f513-9d5b-4832-aa61-a7d44c69f650 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:41.811076 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d16f513-9d5b-4832-aa61-a7d44c69f650 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:41.811625 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d16f513-9d5b-4832-aa61-a7d44c69f650 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:41.812484 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d16f513-9d5b-4832-aa61-a7d44c69f650 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:41.826293 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-46e33687-9936-44ac-8452-17c2157d3a59 tempest-AbsoluteLimitsNegativeTestJSON-256404892 tempest-AbsoluteLimitsNegativeTestJSON-256404892-project] validate_networks() for None {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:59:41.847953 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8d16f513-9d5b-4832-aa61-a7d44c69f650 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.052351 Sep 24 20:59:41.848106 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1384/2769] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:41 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 20:59:41.855050 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-eea976cd-fcea-4248-ac11-7b47650d7b18 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:41.855694 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-eea976cd-fcea-4248-ac11-7b47650d7b18 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 637c2b11-a4f9-40e9-b309-5cffdcd7b64a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:41.862924 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eea976cd-fcea-4248-ac11-7b47650d7b18 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:41.863408 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eea976cd-fcea-4248-ac11-7b47650d7b18 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:41.864020 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eea976cd-fcea-4248-ac11-7b47650d7b18 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:41.864735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eea976cd-fcea-4248-ac11-7b47650d7b18 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:41.865244 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eea976cd-fcea-4248-ac11-7b47650d7b18 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:41.865736 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eea976cd-fcea-4248-ac11-7b47650d7b18 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:42.103848 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-eea976cd-fcea-4248-ac11-7b47650d7b18 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:42.117330 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-eea976cd-fcea-4248-ac11-7b47650d7b18 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a" status: 200 len: 1314 microversion: 2.1 time: 0.267204 Sep 24 20:59:42.118636 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1385/2770] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:41 2022] GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:59:42.143149 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-46e33687-9936-44ac-8452-17c2157d3a59 tempest-AbsoluteLimitsNegativeTestJSON-256404892 tempest-AbsoluteLimitsNegativeTestJSON-256404892-project] Getting quotas for project fa12532d0ad845f5b227818ca081126d. Resources: dict_keys(['metadata_items']) {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:59:42.149532 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-46e33687-9936-44ac-8452-17c2157d3a59 tempest-AbsoluteLimitsNegativeTestJSON-256404892 tempest-AbsoluteLimitsNegativeTestJSON-256404892-project] Getting quotas for user eb081bddbf954c99b9e70bbb21f81fa3 and project fa12532d0ad845f5b227818ca081126d. Resources: dict_keys(['metadata_items']) {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:59:42.170832 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-46e33687-9936-44ac-8452-17c2157d3a59 tempest-AbsoluteLimitsNegativeTestJSON-256404892 tempest-AbsoluteLimitsNegativeTestJSON-256404892-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Sep 24 20:59:42.174298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-46e33687-9936-44ac-8452-17c2157d3a59 tempest-AbsoluteLimitsNegativeTestJSON-256404892 tempest-AbsoluteLimitsNegativeTestJSON-256404892-project] Request method failure captured: Sep 24 20:59:42.174298 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 24 20:59:42.174298 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:59:42.174298 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:59:42.174298 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:59:42.174298 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 1752 Sep 24 20:59:42.174298 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:59:42.174298 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:59:42.174298 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:59:42.174298 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:59:42.174298 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL2-9ux11K0i0zuLo_KtNdH_9QEiso8H9h3tzHVPusCQrAChiB2cgwaC5lh23R4ALX_uyIp4OazN91FU7FPLjGdEzzneu53TPvh0g96v5SH3DTgPQcYxAihn_kesIA-BpwypEnVYUh-1JscvUHRcc95GN_h6pOifx8lr7494gYFbJmlQ Sep 24 20:59:42.174298 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:59:42.174298 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:59:42.174298 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:59:42.174298 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:59:42.174298 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:59:42.174298 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:59:42.174298 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: fa12532d0ad845f5b227818ca081126d Sep 24 20:59:42.174298 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-256404892 Sep 24 20:59:42.174298 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:59:42.174298 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:59:42.174298 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fa12532d0ad845f5b227818ca081126d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fa12532d0ad845f5b227818ca081126d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fa12532d0ad845f5b227818ca081126d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fa12532d0ad845f5b227818ca081126d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:59:42.174298 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-256404892 Sep 24 20:59:42.174298 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: fa12532d0ad845f5b227818ca081126d Sep 24 20:59:42.174298 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-256404892 Sep 24 20:59:42.174298 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-256404892-project Sep 24 20:59:42.174298 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:59:42.174298 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:59:42.174298 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: eb081bddbf954c99b9e70bbb21f81fa3 Sep 24 20:59:42.174298 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-256404892-project Sep 24 20:59:42.174298 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 20:59:42.174298 ncdv-master-1 devstack@n-api.service[140517]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1260907077", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Sep 24 20:59:42.174298 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:59:42.174298 ncdv-master-1 devstack@n-api.service[140517]: exception: Maximum number of metadata items exceeds 128 Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1260907077', 'imageRef': '4c30e8e9-8fb2-4377-83f1-98322cb17799', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:59:42.176561 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 20:59:42.179649 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 20:59:42.179649 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 24 20:59:42.179649 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 24 20:59:42.179649 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 24 20:59:42.179649 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Sep 24 20:59:42.179649 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:42.179649 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:59:42.179649 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:42.179649 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:42.179649 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:59:42.179649 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:59:42.179649 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:59:42.179649 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:59:42.179649 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Sep 24 20:59:42.179649 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:42.181340 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-46e33687-9936-44ac-8452-17c2157d3a59 tempest-AbsoluteLimitsNegativeTestJSON-256404892 tempest-AbsoluteLimitsNegativeTestJSON-256404892-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:59:42.182434 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-46e33687-9936-44ac-8452-17c2157d3a59 tempest-AbsoluteLimitsNegativeTestJSON-256404892 tempest-AbsoluteLimitsNegativeTestJSON-256404892-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.420337 Sep 24 20:59:42.183531 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1386/2771] 10.222.0.52 () {60 vars in 1148 bytes} [Sat Sep 24 20:59:41 2022] POST /compute/v2.1/servers => generated 87 bytes in 422 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Sep 24 20:59:42.360831 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2c499974-2b25-43e9-8ace-2d7d58b666c5 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:42.361556 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2c499974-2b25-43e9-8ace-2d7d58b666c5 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:42.368080 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c499974-2b25-43e9-8ace-2d7d58b666c5 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:42.368665 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c499974-2b25-43e9-8ace-2d7d58b666c5 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:42.369534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c499974-2b25-43e9-8ace-2d7d58b666c5 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:42.370523 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c499974-2b25-43e9-8ace-2d7d58b666c5 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:42.371069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c499974-2b25-43e9-8ace-2d7d58b666c5 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:42.371580 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c499974-2b25-43e9-8ace-2d7d58b666c5 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:42.503853 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d529564b-6792-49c8-83c7-b5373f2c0324 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:42.506414 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d529564b-6792-49c8-83c7-b5373f2c0324 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:42.514954 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d529564b-6792-49c8-83c7-b5373f2c0324 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:42.516274 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d529564b-6792-49c8-83c7-b5373f2c0324 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:42.516880 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d529564b-6792-49c8-83c7-b5373f2c0324 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:42.517608 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d529564b-6792-49c8-83c7-b5373f2c0324 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:42.518072 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d529564b-6792-49c8-83c7-b5373f2c0324 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:42.518678 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d529564b-6792-49c8-83c7-b5373f2c0324 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:42.555993 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2c499974-2b25-43e9-8ace-2d7d58b666c5 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:42.567761 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2c499974-2b25-43e9-8ace-2d7d58b666c5 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1515 microversion: 2.1 time: 0.211653 Sep 24 20:59:42.568821 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1386/2772] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:42 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1515 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:42.586555 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-951a47db-fd61-4fe3-8515-2c14309de034 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:42.587548 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-951a47db-fd61-4fe3-8515-2c14309de034 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: 61376b92-427e-4de0-9a8f-89828ce607fd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:42.596214 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-951a47db-fd61-4fe3-8515-2c14309de034 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:42.597096 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-951a47db-fd61-4fe3-8515-2c14309de034 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:42.597700 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-951a47db-fd61-4fe3-8515-2c14309de034 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:42.598603 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-951a47db-fd61-4fe3-8515-2c14309de034 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:42.599218 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-951a47db-fd61-4fe3-8515-2c14309de034 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:42.599794 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-951a47db-fd61-4fe3-8515-2c14309de034 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:42.603775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d529564b-6792-49c8-83c7-b5373f2c0324 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:42.613092 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d529564b-6792-49c8-83c7-b5373f2c0324 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:42.614704 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d529564b-6792-49c8-83c7-b5373f2c0324 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:42.615964 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-951a47db-fd61-4fe3-8515-2c14309de034 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] HTTP exception thrown: Instance 61376b92-427e-4de0-9a8f-89828ce607fd could not be found. Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-951a47db-fd61-4fe3-8515-2c14309de034 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Request method failure captured: Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/61376b92-427e-4de0-9a8f-89828ce607fd HTTP/1.1 Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL286ivwP6-bRmXUnR9fKsJTIaXleJ1-mH9YT6UHhlpZ19FE2S8-jY-Wi3HtZY3mBJlgc50LWRsS9hjX6IniaMVpVMC18VBpKeePWZuFADK-MeQTloKc9NamIMv0LdO6POax1rRlR1Xg-bSd6Tt9v-Jct8CvdsBXJ-_WNOR7xezXZFCc Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: c4004a1dbc2441f8a5c4ace42af3e2df Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-VolumesAdminNegativeTest-1782997698 Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4004a1dbc2441f8a5c4ace42af3e2df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4004a1dbc2441f8a5c4ace42af3e2df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4004a1dbc2441f8a5c4ace42af3e2df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4004a1dbc2441f8a5c4ace42af3e2df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-VolumesAdminNegativeTest-1782997698 Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: c4004a1dbc2441f8a5c4ace42af3e2df Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1782997698 Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-VolumesAdminNegativeTest-1782997698-project Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 31761ade4b4a4df580fd5de55426eb0b Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-VolumesAdminNegativeTest-1782997698-project Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 61376b92-427e-4de0-9a8f-89828ce607fd could not be found. Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '61376b92-427e-4de0-9a8f-89828ce607fd'} Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61376b92-427e-4de0-9a8f-89828ce607fd could not be found. Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61376b92-427e-4de0-9a8f-89828ce607fd could not be found. Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:59:42.617875 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:59:42.622213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:42.622213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:59:42.622213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:59:42.622213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:59:42.622213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:59:42.622213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61376b92-427e-4de0-9a8f-89828ce607fd could not be found. Sep 24 20:59:42.622213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:59:42.622639 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d529564b-6792-49c8-83c7-b5373f2c0324 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1416 microversion: 2.75 time: 0.122330 Sep 24 20:59:42.622639 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1387/2773] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:59:42 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1416 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:59:42.623553 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-951a47db-fd61-4fe3-8515-2c14309de034 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Returning 404 to user: Instance 61376b92-427e-4de0-9a8f-89828ce607fd could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:59:42.624445 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-951a47db-fd61-4fe3-8515-2c14309de034 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/61376b92-427e-4de0-9a8f-89828ce607fd" status: 404 len: 111 microversion: 2.1 time: 0.046836 Sep 24 20:59:42.625564 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1387/2774] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:42 2022] GET /compute/v2.1/servers/61376b92-427e-4de0-9a8f-89828ce607fd => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:59:42.799401 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a9705f9a-d61e-489f-95f1-0b0c4ebc9efd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:42.799909 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a9705f9a-d61e-489f-95f1-0b0c4ebc9efd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: e781d448-5d66-4040-bf4c-37452b0f7b1c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:42.806943 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9705f9a-d61e-489f-95f1-0b0c4ebc9efd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:42.807442 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9705f9a-d61e-489f-95f1-0b0c4ebc9efd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:42.807900 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9705f9a-d61e-489f-95f1-0b0c4ebc9efd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:42.808927 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9705f9a-d61e-489f-95f1-0b0c4ebc9efd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:42.809403 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9705f9a-d61e-489f-95f1-0b0c4ebc9efd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:42.809849 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9705f9a-d61e-489f-95f1-0b0c4ebc9efd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:42.837764 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a9705f9a-d61e-489f-95f1-0b0c4ebc9efd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: e781d448-5d66-4040-bf4c-37452b0f7b1c] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:59:42.860475 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d296d603-0c07-44bc-8968-0fa83e38585d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:42.863433 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d296d603-0c07-44bc-8968-0fa83e38585d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:42.869830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d296d603-0c07-44bc-8968-0fa83e38585d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:42.870329 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d296d603-0c07-44bc-8968-0fa83e38585d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:42.871162 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d296d603-0c07-44bc-8968-0fa83e38585d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:42.872005 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d296d603-0c07-44bc-8968-0fa83e38585d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:42.872661 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d296d603-0c07-44bc-8968-0fa83e38585d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:42.873096 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d296d603-0c07-44bc-8968-0fa83e38585d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:42.916257 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d296d603-0c07-44bc-8968-0fa83e38585d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.059644 Sep 24 20:59:42.917222 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1388/2775] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:42 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 20:59:42.927218 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a9705f9a-d61e-489f-95f1-0b0c4ebc9efd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c" status: 204 len: 0 microversion: 2.1 time: 0.131289 Sep 24 20:59:42.928232 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1388/2776] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:59:42 2022] DELETE /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:59:42.936619 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fc429039-b54d-41f0-8238-9dc89bd3d2f9 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:42.938224 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fc429039-b54d-41f0-8238-9dc89bd3d2f9 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: e781d448-5d66-4040-bf4c-37452b0f7b1c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:42.944549 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fc429039-b54d-41f0-8238-9dc89bd3d2f9 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:42.945045 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fc429039-b54d-41f0-8238-9dc89bd3d2f9 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:42.945489 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fc429039-b54d-41f0-8238-9dc89bd3d2f9 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:42.946196 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fc429039-b54d-41f0-8238-9dc89bd3d2f9 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:42.946692 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fc429039-b54d-41f0-8238-9dc89bd3d2f9 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:42.947132 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fc429039-b54d-41f0-8238-9dc89bd3d2f9 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:43.129365 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fc429039-b54d-41f0-8238-9dc89bd3d2f9 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:43.144424 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f612776c-db46-48b2-b63f-3e38e532f5b7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:43.146065 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f612776c-db46-48b2-b63f-3e38e532f5b7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 637c2b11-a4f9-40e9-b309-5cffdcd7b64a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:43.152257 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fc429039-b54d-41f0-8238-9dc89bd3d2f9 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c" status: 200 len: 1679 microversion: 2.1 time: 0.217620 Sep 24 20:59:43.153195 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1389/2777] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:42 2022] GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c => generated 1679 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:43.159717 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f612776c-db46-48b2-b63f-3e38e532f5b7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:43.160977 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f612776c-db46-48b2-b63f-3e38e532f5b7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:43.162557 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f612776c-db46-48b2-b63f-3e38e532f5b7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:43.163484 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f612776c-db46-48b2-b63f-3e38e532f5b7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:43.164191 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f612776c-db46-48b2-b63f-3e38e532f5b7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:43.164739 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f612776c-db46-48b2-b63f-3e38e532f5b7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:43.344372 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f612776c-db46-48b2-b63f-3e38e532f5b7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:43.354346 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f612776c-db46-48b2-b63f-3e38e532f5b7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a" status: 200 len: 1314 microversion: 2.1 time: 0.216610 Sep 24 20:59:43.355572 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1389/2778] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:43 2022] GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:43.591944 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a6f3ed02-cbb9-40fd-b85e-c19ac908bb2f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:43.592952 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a6f3ed02-cbb9-40fd-b85e-c19ac908bb2f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:43.600773 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a6f3ed02-cbb9-40fd-b85e-c19ac908bb2f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:43.601146 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a6f3ed02-cbb9-40fd-b85e-c19ac908bb2f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:43.601588 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a6f3ed02-cbb9-40fd-b85e-c19ac908bb2f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:43.602414 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a6f3ed02-cbb9-40fd-b85e-c19ac908bb2f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:43.602923 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a6f3ed02-cbb9-40fd-b85e-c19ac908bb2f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:43.603471 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a6f3ed02-cbb9-40fd-b85e-c19ac908bb2f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:43.650224 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b89b0126-3aa9-49b1-9286-eb8afa32406e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:43.650878 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b89b0126-3aa9-49b1-9286-eb8afa32406e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:43.664657 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b89b0126-3aa9-49b1-9286-eb8afa32406e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:43.665309 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b89b0126-3aa9-49b1-9286-eb8afa32406e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:43.665894 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b89b0126-3aa9-49b1-9286-eb8afa32406e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:43.666748 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b89b0126-3aa9-49b1-9286-eb8afa32406e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:43.667397 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b89b0126-3aa9-49b1-9286-eb8afa32406e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:43.668011 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b89b0126-3aa9-49b1-9286-eb8afa32406e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:43.768611 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b89b0126-3aa9-49b1-9286-eb8afa32406e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:43.799317 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b89b0126-3aa9-49b1-9286-eb8afa32406e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:43.801337 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b89b0126-3aa9-49b1-9286-eb8afa32406e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:43.808661 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b89b0126-3aa9-49b1-9286-eb8afa32406e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1416 microversion: 2.75 time: 0.162666 Sep 24 20:59:43.809474 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1390/2779] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:59:43 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1416 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:59:43.861294 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a6f3ed02-cbb9-40fd-b85e-c19ac908bb2f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:43.870385 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a6f3ed02-cbb9-40fd-b85e-c19ac908bb2f tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1515 microversion: 2.1 time: 0.283137 Sep 24 20:59:43.871514 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1390/2780] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:43 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1515 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:43.930774 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d0c72e77-ae12-42f0-aaf3-42a8df020761 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:43.933063 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d0c72e77-ae12-42f0-aaf3-42a8df020761 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:43.943219 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d0c72e77-ae12-42f0-aaf3-42a8df020761 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:43.943724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d0c72e77-ae12-42f0-aaf3-42a8df020761 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:43.944168 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d0c72e77-ae12-42f0-aaf3-42a8df020761 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:43.945099 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d0c72e77-ae12-42f0-aaf3-42a8df020761 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:43.946090 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d0c72e77-ae12-42f0-aaf3-42a8df020761 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:43.946090 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d0c72e77-ae12-42f0-aaf3-42a8df020761 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:43.983670 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d0c72e77-ae12-42f0-aaf3-42a8df020761 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.057199 Sep 24 20:59:43.985193 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1391/2781] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:43 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:59:44.179509 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-52685deb-fc83-4d12-ae3a-ec72884a28ac tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:44.180298 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-52685deb-fc83-4d12-ae3a-ec72884a28ac tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: e781d448-5d66-4040-bf4c-37452b0f7b1c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:44.192810 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-52685deb-fc83-4d12-ae3a-ec72884a28ac tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:44.193510 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-52685deb-fc83-4d12-ae3a-ec72884a28ac tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:44.194514 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-52685deb-fc83-4d12-ae3a-ec72884a28ac tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:44.197682 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-52685deb-fc83-4d12-ae3a-ec72884a28ac tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:44.198355 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-52685deb-fc83-4d12-ae3a-ec72884a28ac tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:44.199405 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-52685deb-fc83-4d12-ae3a-ec72884a28ac tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:44.380220 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f38b10f6-b9c3-404e-827a-fc32cef56019 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:44.381137 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f38b10f6-b9c3-404e-827a-fc32cef56019 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 637c2b11-a4f9-40e9-b309-5cffdcd7b64a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:44.384180 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=4 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:59:44.390962 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f38b10f6-b9c3-404e-827a-fc32cef56019 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:44.391877 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f38b10f6-b9c3-404e-827a-fc32cef56019 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:44.392722 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f38b10f6-b9c3-404e-827a-fc32cef56019 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:44.394863 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f38b10f6-b9c3-404e-827a-fc32cef56019 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:44.395811 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f38b10f6-b9c3-404e-827a-fc32cef56019 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:44.396416 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f38b10f6-b9c3-404e-827a-fc32cef56019 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:44.409402 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-52685deb-fc83-4d12-ae3a-ec72884a28ac tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:44.418786 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:59:44.426439 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-52685deb-fc83-4d12-ae3a-ec72884a28ac tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c" status: 200 len: 1679 microversion: 2.1 time: 0.251011 Sep 24 20:59:44.428361 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1391/2782] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:44 2022] GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c => generated 1679 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:44.635629 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f38b10f6-b9c3-404e-827a-fc32cef56019 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:44.646471 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f38b10f6-b9c3-404e-827a-fc32cef56019 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a" status: 200 len: 1500 microversion: 2.1 time: 0.272924 Sep 24 20:59:44.647912 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1392/2783] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:44 2022] GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a => generated 1500 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:59:44.676330 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-58077da0-282c-4cc9-a996-f329738d233e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:44.676878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-58077da0-282c-4cc9-a996-f329738d233e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 637c2b11-a4f9-40e9-b309-5cffdcd7b64a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:44.684936 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-58077da0-282c-4cc9-a996-f329738d233e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:44.685440 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-58077da0-282c-4cc9-a996-f329738d233e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:44.686071 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-58077da0-282c-4cc9-a996-f329738d233e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:44.691419 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-58077da0-282c-4cc9-a996-f329738d233e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:44.692558 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-58077da0-282c-4cc9-a996-f329738d233e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:44.693166 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-58077da0-282c-4cc9-a996-f329738d233e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:44.790279 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-58077da0-282c-4cc9-a996-f329738d233e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "POST /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a/action" status: 202 len: 0 microversion: 2.1 time: 0.117498 Sep 24 20:59:44.794410 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1392/2784] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 20:59:44 2022] POST /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:59:44.800480 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-22914c07-358a-4c2a-a85b-4b97d899461c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:44.801606 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-22914c07-358a-4c2a-a85b-4b97d899461c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 637c2b11-a4f9-40e9-b309-5cffdcd7b64a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:44.817134 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22914c07-358a-4c2a-a85b-4b97d899461c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:44.817441 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22914c07-358a-4c2a-a85b-4b97d899461c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:44.817948 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22914c07-358a-4c2a-a85b-4b97d899461c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:44.818789 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22914c07-358a-4c2a-a85b-4b97d899461c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:44.819192 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22914c07-358a-4c2a-a85b-4b97d899461c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:44.819634 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22914c07-358a-4c2a-a85b-4b97d899461c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:44.838455 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d61f764f-1ea4-41f9-9b40-7224ec6437f7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:44.839471 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d61f764f-1ea4-41f9-9b40-7224ec6437f7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:44.854004 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d61f764f-1ea4-41f9-9b40-7224ec6437f7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:44.854839 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d61f764f-1ea4-41f9-9b40-7224ec6437f7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:44.856635 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d61f764f-1ea4-41f9-9b40-7224ec6437f7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:44.859036 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d61f764f-1ea4-41f9-9b40-7224ec6437f7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:44.859767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d61f764f-1ea4-41f9-9b40-7224ec6437f7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:44.860957 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d61f764f-1ea4-41f9-9b40-7224ec6437f7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:45.291563 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d61f764f-1ea4-41f9-9b40-7224ec6437f7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:45.304747 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d61f764f-1ea4-41f9-9b40-7224ec6437f7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:45.306789 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d61f764f-1ea4-41f9-9b40-7224ec6437f7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:45.313268 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d61f764f-1ea4-41f9-9b40-7224ec6437f7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1437 microversion: 2.75 time: 0.479419 Sep 24 20:59:45.314395 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1393/2785] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:59:44 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1437 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:59:45.325369 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6d043493-b406-4447-bcc9-10b53ea8af14 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:45.326190 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6d043493-b406-4447-bcc9-10b53ea8af14 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:45.339266 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6d043493-b406-4447-bcc9-10b53ea8af14 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:45.339815 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6d043493-b406-4447-bcc9-10b53ea8af14 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:45.341134 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6d043493-b406-4447-bcc9-10b53ea8af14 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:45.341867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6d043493-b406-4447-bcc9-10b53ea8af14 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:45.343168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6d043493-b406-4447-bcc9-10b53ea8af14 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:45.344919 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6d043493-b406-4447-bcc9-10b53ea8af14 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:45.458988 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-22914c07-358a-4c2a-a85b-4b97d899461c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:45.468874 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-22914c07-358a-4c2a-a85b-4b97d899461c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a" status: 200 len: 1505 microversion: 2.1 time: 0.672751 Sep 24 20:59:45.469959 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1393/2786] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:44 2022] GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a => generated 1505 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:45.493110 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a1823995-9362-4366-8d69-cc11c98f982f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:45.496083 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a1823995-9362-4366-8d69-cc11c98f982f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:45.498279 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:59:45.505256 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1823995-9362-4366-8d69-cc11c98f982f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:45.506850 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1823995-9362-4366-8d69-cc11c98f982f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:45.507708 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1823995-9362-4366-8d69-cc11c98f982f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:45.508688 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1823995-9362-4366-8d69-cc11c98f982f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:45.509319 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1823995-9362-4366-8d69-cc11c98f982f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:45.509937 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1823995-9362-4366-8d69-cc11c98f982f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:45.523771 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6d043493-b406-4447-bcc9-10b53ea8af14 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:45.543080 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6d043493-b406-4447-bcc9-10b53ea8af14 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1515 microversion: 2.1 time: 0.227281 Sep 24 20:59:45.553329 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1394/2787] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:45 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1515 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:45.553329 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-456ccaf5-ef64-4403-86c5-aa3a75c355b7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:45.553329 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-456ccaf5-ef64-4403-86c5-aa3a75c355b7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:45.559152 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-456ccaf5-ef64-4403-86c5-aa3a75c355b7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:45.560352 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-456ccaf5-ef64-4403-86c5-aa3a75c355b7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:45.561040 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-456ccaf5-ef64-4403-86c5-aa3a75c355b7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:45.561820 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-456ccaf5-ef64-4403-86c5-aa3a75c355b7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:45.563753 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-456ccaf5-ef64-4403-86c5-aa3a75c355b7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:45.564264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-456ccaf5-ef64-4403-86c5-aa3a75c355b7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:45.571512 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a1823995-9362-4366-8d69-cc11c98f982f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.079367 Sep 24 20:59:45.572077 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1394/2788] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:45 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:59:45.582312 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bcc4cb9f-d6c5-42e9-b928-75064e031439 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:45.583757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bcc4cb9f-d6c5-42e9-b928-75064e031439 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: e781d448-5d66-4040-bf4c-37452b0f7b1c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:45.596625 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bcc4cb9f-d6c5-42e9-b928-75064e031439 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:45.598036 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bcc4cb9f-d6c5-42e9-b928-75064e031439 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:45.598919 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bcc4cb9f-d6c5-42e9-b928-75064e031439 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:45.600112 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bcc4cb9f-d6c5-42e9-b928-75064e031439 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:45.601198 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bcc4cb9f-d6c5-42e9-b928-75064e031439 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:45.601834 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bcc4cb9f-d6c5-42e9-b928-75064e031439 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:45.689034 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-456ccaf5-ef64-4403-86c5-aa3a75c355b7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:59:45.689728 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-456ccaf5-ef64-4403-86c5-aa3a75c355b7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:59:45.691046 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-456ccaf5-ef64-4403-86c5-aa3a75c355b7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:59:45.691800 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-456ccaf5-ef64-4403-86c5-aa3a75c355b7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:59:45.692407 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-456ccaf5-ef64-4403-86c5-aa3a75c355b7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:59:45.778007 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-456ccaf5-ef64-4403-86c5-aa3a75c355b7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:45.785578 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bcc4cb9f-d6c5-42e9-b928-75064e031439 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:45.787231 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-456ccaf5-ef64-4403-86c5-aa3a75c355b7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:45.787949 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-456ccaf5-ef64-4403-86c5-aa3a75c355b7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:45.788622 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-456ccaf5-ef64-4403-86c5-aa3a75c355b7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:45.789712 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-456ccaf5-ef64-4403-86c5-aa3a75c355b7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:45.790381 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-456ccaf5-ef64-4403-86c5-aa3a75c355b7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:45.791039 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-456ccaf5-ef64-4403-86c5-aa3a75c355b7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:45.794740 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bcc4cb9f-d6c5-42e9-b928-75064e031439 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c" status: 200 len: 1679 microversion: 2.1 time: 0.218320 Sep 24 20:59:45.795855 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1395/2789] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:45 2022] GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c => generated 1679 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:45.892314 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-456ccaf5-ef64-4403-86c5-aa3a75c355b7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:45.903887 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-456ccaf5-ef64-4403-86c5-aa3a75c355b7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:45.905778 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-456ccaf5-ef64-4403-86c5-aa3a75c355b7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:45.913396 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-456ccaf5-ef64-4403-86c5-aa3a75c355b7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "POST /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27/action" status: 202 len: 1494 microversion: 2.75 time: 0.367990 Sep 24 20:59:45.914918 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1395/2790] 10.222.0.52 () {62 vars in 1319 bytes} [Sat Sep 24 20:59:45 2022] POST /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27/action => generated 1494 bytes in 370 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 24 20:59:45.945111 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ed33e8d3-2e06-4094-9989-a9d1689eb356 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:45.946449 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ed33e8d3-2e06-4094-9989-a9d1689eb356 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:45.966824 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed33e8d3-2e06-4094-9989-a9d1689eb356 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:45.967810 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed33e8d3-2e06-4094-9989-a9d1689eb356 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:45.968763 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed33e8d3-2e06-4094-9989-a9d1689eb356 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:45.969940 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed33e8d3-2e06-4094-9989-a9d1689eb356 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:45.970615 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed33e8d3-2e06-4094-9989-a9d1689eb356 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:45.971887 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed33e8d3-2e06-4094-9989-a9d1689eb356 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:46.053241 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ed33e8d3-2e06-4094-9989-a9d1689eb356 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:46.061817 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ed33e8d3-2e06-4094-9989-a9d1689eb356 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:46.065147 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ed33e8d3-2e06-4094-9989-a9d1689eb356 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:46.072089 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ed33e8d3-2e06-4094-9989-a9d1689eb356 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1446 microversion: 2.75 time: 0.131245 Sep 24 20:59:46.072807 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1396/2791] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:59:45 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1446 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:59:46.493407 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f5754e7a-d23e-4e1b-a1f3-384b75377aca tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:46.494010 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f5754e7a-d23e-4e1b-a1f3-384b75377aca tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 637c2b11-a4f9-40e9-b309-5cffdcd7b64a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:46.501421 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f5754e7a-d23e-4e1b-a1f3-384b75377aca tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:46.502324 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f5754e7a-d23e-4e1b-a1f3-384b75377aca tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:46.502324 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f5754e7a-d23e-4e1b-a1f3-384b75377aca tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:46.503530 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f5754e7a-d23e-4e1b-a1f3-384b75377aca tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:46.503530 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f5754e7a-d23e-4e1b-a1f3-384b75377aca tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:46.503958 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f5754e7a-d23e-4e1b-a1f3-384b75377aca tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:46.570225 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e1bfea91-1266-4050-9e52-e09e43ed421e tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:46.570612 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e1bfea91-1266-4050-9e52-e09e43ed421e tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:46.585015 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1bfea91-1266-4050-9e52-e09e43ed421e tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:46.586650 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1bfea91-1266-4050-9e52-e09e43ed421e tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:46.587295 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1bfea91-1266-4050-9e52-e09e43ed421e tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:46.588811 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1bfea91-1266-4050-9e52-e09e43ed421e tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:46.589470 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1bfea91-1266-4050-9e52-e09e43ed421e tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:46.590666 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1bfea91-1266-4050-9e52-e09e43ed421e tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:46.909251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f5754e7a-d23e-4e1b-a1f3-384b75377aca tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:46.929402 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f5754e7a-d23e-4e1b-a1f3-384b75377aca tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a" status: 200 len: 1485 microversion: 2.1 time: 0.439734 Sep 24 20:59:46.936777 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1396/2792] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:46 2022] GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a => generated 1485 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:46.949875 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-49a528fc-fa9c-4cad-9b8a-cccbd5f48684 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:46.955137 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-49a528fc-fa9c-4cad-9b8a-cccbd5f48684 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:46.961377 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-49a528fc-fa9c-4cad-9b8a-cccbd5f48684 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:46.961949 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-49a528fc-fa9c-4cad-9b8a-cccbd5f48684 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:46.962488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-49a528fc-fa9c-4cad-9b8a-cccbd5f48684 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:46.963317 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-49a528fc-fa9c-4cad-9b8a-cccbd5f48684 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:46.964386 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-49a528fc-fa9c-4cad-9b8a-cccbd5f48684 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:46.966167 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-49a528fc-fa9c-4cad-9b8a-cccbd5f48684 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:46.971815 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e1bfea91-1266-4050-9e52-e09e43ed421e tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:46.982983 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e1bfea91-1266-4050-9e52-e09e43ed421e tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1515 microversion: 2.1 time: 0.417080 Sep 24 20:59:46.990478 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:59:47.004635 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1397/2793] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:46 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1515 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:47.008660 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-49a528fc-fa9c-4cad-9b8a-cccbd5f48684 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.069774 Sep 24 20:59:47.011783 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e82068fc-62d9-4c3e-b333-85115c98170a tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:47.012579 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e82068fc-62d9-4c3e-b333-85115c98170a tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: e781d448-5d66-4040-bf4c-37452b0f7b1c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:47.014078 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1397/2794] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:46 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:59:47.020051 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-127b1864-cd9c-447f-ac27-3dfc6d728c0e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:47.020854 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-127b1864-cd9c-447f-ac27-3dfc6d728c0e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 637c2b11-a4f9-40e9-b309-5cffdcd7b64a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:47.022329 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e82068fc-62d9-4c3e-b333-85115c98170a tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:47.022876 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e82068fc-62d9-4c3e-b333-85115c98170a tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:47.023297 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e82068fc-62d9-4c3e-b333-85115c98170a tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:47.024464 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e82068fc-62d9-4c3e-b333-85115c98170a tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:47.025146 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e82068fc-62d9-4c3e-b333-85115c98170a tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:47.025722 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e82068fc-62d9-4c3e-b333-85115c98170a tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:47.029464 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-127b1864-cd9c-447f-ac27-3dfc6d728c0e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:47.032050 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-127b1864-cd9c-447f-ac27-3dfc6d728c0e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:47.032050 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-127b1864-cd9c-447f-ac27-3dfc6d728c0e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:47.033072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-127b1864-cd9c-447f-ac27-3dfc6d728c0e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:47.033635 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-127b1864-cd9c-447f-ac27-3dfc6d728c0e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:47.034569 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-127b1864-cd9c-447f-ac27-3dfc6d728c0e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:47.067857 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-127b1864-cd9c-447f-ac27-3dfc6d728c0e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 637c2b11-a4f9-40e9-b309-5cffdcd7b64a] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:59:47.183949 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-127b1864-cd9c-447f-ac27-3dfc6d728c0e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "DELETE /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a" status: 204 len: 0 microversion: 2.1 time: 0.166893 Sep 24 20:59:47.185238 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1398/2795] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 20:59:47 2022] DELETE /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:59:47.205145 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8c09c2b9-c081-426f-83bc-b031184fa4f4 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:47.206486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8c09c2b9-c081-426f-83bc-b031184fa4f4 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:47.211042 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e82068fc-62d9-4c3e-b333-85115c98170a tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:47.223954 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e82068fc-62d9-4c3e-b333-85115c98170a tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c" status: 200 len: 1612 microversion: 2.1 time: 0.213758 Sep 24 20:59:47.224821 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1398/2796] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:47 2022] GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c => generated 1612 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:47.236860 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c09c2b9-c081-426f-83bc-b031184fa4f4 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:47.237388 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c09c2b9-c081-426f-83bc-b031184fa4f4 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:47.240142 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c09c2b9-c081-426f-83bc-b031184fa4f4 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:47.248519 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f3d03c45-2d1d-479c-a201-247489af65e5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:47.250717 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c09c2b9-c081-426f-83bc-b031184fa4f4 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:47.251739 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f3d03c45-2d1d-479c-a201-247489af65e5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 637c2b11-a4f9-40e9-b309-5cffdcd7b64a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:47.252615 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c09c2b9-c081-426f-83bc-b031184fa4f4 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:47.253067 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c09c2b9-c081-426f-83bc-b031184fa4f4 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:47.272620 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3d03c45-2d1d-479c-a201-247489af65e5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:47.273546 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3d03c45-2d1d-479c-a201-247489af65e5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:47.275524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3d03c45-2d1d-479c-a201-247489af65e5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:47.277684 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3d03c45-2d1d-479c-a201-247489af65e5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:47.279891 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3d03c45-2d1d-479c-a201-247489af65e5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:47.280691 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3d03c45-2d1d-479c-a201-247489af65e5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:47.555473 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8c09c2b9-c081-426f-83bc-b031184fa4f4 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:47.568718 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8c09c2b9-c081-426f-83bc-b031184fa4f4 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:47.572986 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8c09c2b9-c081-426f-83bc-b031184fa4f4 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:47.590203 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8c09c2b9-c081-426f-83bc-b031184fa4f4 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1446 microversion: 2.75 time: 0.401712 Sep 24 20:59:47.590924 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1399/2797] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:59:47 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1446 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:59:47.607071 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-b058f88b-a675-4593-902e-e7d166ec7143 req-ca7bae52-04e5-47a9-a071-04e67ae81fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e781d448-5d66-4040-bf4c-37452b0f7b1c", "name": "network-vif-deleted", "tag": "ac7cf96e-fcba-4f98-ab54-6ea3518610bf"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:47.647281 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-b058f88b-a675-4593-902e-e7d166ec7143 req-ca7bae52-04e5-47a9-a071-04e67ae81fe1 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:47.647930 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-b058f88b-a675-4593-902e-e7d166ec7143 req-ca7bae52-04e5-47a9-a071-04e67ae81fe1 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:47.648365 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-b058f88b-a675-4593-902e-e7d166ec7143 req-ca7bae52-04e5-47a9-a071-04e67ae81fe1 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:47.672412 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-b058f88b-a675-4593-902e-e7d166ec7143 req-ca7bae52-04e5-47a9-a071-04e67ae81fe1 service nova] Creating event network-vif-deleted:ac7cf96e-fcba-4f98-ab54-6ea3518610bf for instance e781d448-5d66-4040-bf4c-37452b0f7b1c on nch2-master-1 Sep 24 20:59:47.683013 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-b058f88b-a675-4593-902e-e7d166ec7143 req-ca7bae52-04e5-47a9-a071-04e67ae81fe1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088058 Sep 24 20:59:47.689498 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1400/2798] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:59:47.819563 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f3d03c45-2d1d-479c-a201-247489af65e5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:47.835491 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f3d03c45-2d1d-479c-a201-247489af65e5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a" status: 200 len: 1491 microversion: 2.1 time: 0.608959 Sep 24 20:59:47.844334 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1399/2799] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:47 2022] GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a => generated 1491 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:48.012568 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d90235f2-e3cf-4088-a443-1e47e3a57ca0 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:48.013284 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d90235f2-e3cf-4088-a443-1e47e3a57ca0 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:48.022032 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-316ecbcb-07c9-4fdf-9030-9d916b67ec58 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:48.024711 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-316ecbcb-07c9-4fdf-9030-9d916b67ec58 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:48.044535 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d90235f2-e3cf-4088-a443-1e47e3a57ca0 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:48.045094 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d90235f2-e3cf-4088-a443-1e47e3a57ca0 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:48.045547 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d90235f2-e3cf-4088-a443-1e47e3a57ca0 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:48.046294 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d90235f2-e3cf-4088-a443-1e47e3a57ca0 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:48.049183 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-316ecbcb-07c9-4fdf-9030-9d916b67ec58 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:48.049670 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-316ecbcb-07c9-4fdf-9030-9d916b67ec58 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:48.053536 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-316ecbcb-07c9-4fdf-9030-9d916b67ec58 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:48.054472 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d90235f2-e3cf-4088-a443-1e47e3a57ca0 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:48.055925 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d90235f2-e3cf-4088-a443-1e47e3a57ca0 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:48.056083 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-316ecbcb-07c9-4fdf-9030-9d916b67ec58 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:48.056703 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-316ecbcb-07c9-4fdf-9030-9d916b67ec58 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:48.062865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-316ecbcb-07c9-4fdf-9030-9d916b67ec58 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:48.182777 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-316ecbcb-07c9-4fdf-9030-9d916b67ec58 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.164701 Sep 24 20:59:48.185704 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1400/2800] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:48 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:59:48.256432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-17ac02c8-8e97-4710-950e-8085452005dd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:48.258122 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-17ac02c8-8e97-4710-950e-8085452005dd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: e781d448-5d66-4040-bf4c-37452b0f7b1c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:48.268665 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-17ac02c8-8e97-4710-950e-8085452005dd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:48.271889 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-17ac02c8-8e97-4710-950e-8085452005dd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:48.274073 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-17ac02c8-8e97-4710-950e-8085452005dd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:48.275368 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-17ac02c8-8e97-4710-950e-8085452005dd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:48.278872 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-17ac02c8-8e97-4710-950e-8085452005dd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:48.279493 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-17ac02c8-8e97-4710-950e-8085452005dd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:48.364422 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-17ac02c8-8e97-4710-950e-8085452005dd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:48.365162 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-17ac02c8-8e97-4710-950e-8085452005dd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:48.365865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-17ac02c8-8e97-4710-950e-8085452005dd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:48.367346 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-17ac02c8-8e97-4710-950e-8085452005dd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lazy-loading 'fault' on Instance uuid e781d448-5d66-4040-bf4c-37452b0f7b1c {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:59:48.527046 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d90235f2-e3cf-4088-a443-1e47e3a57ca0 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:48.544789 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d90235f2-e3cf-4088-a443-1e47e3a57ca0 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1515 microversion: 2.1 time: 0.537395 Sep 24 20:59:48.545975 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1401/2801] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:48 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1515 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:48.585277 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-17ac02c8-8e97-4710-950e-8085452005dd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31761ade4b4a4df580fd5de55426eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4004a1dbc2441f8a5c4ace42af3e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:48.596626 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-17ac02c8-8e97-4710-950e-8085452005dd tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c" status: 200 len: 1330 microversion: 2.1 time: 0.350109 Sep 24 20:59:48.598158 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1401/2802] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:48 2022] GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c => generated 1330 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:48.620372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a48e01d9-5fe5-4419-a343-624f65853a16 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:48.621015 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a48e01d9-5fe5-4419-a343-624f65853a16 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:48.630933 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a48e01d9-5fe5-4419-a343-624f65853a16 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:48.631434 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a48e01d9-5fe5-4419-a343-624f65853a16 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:48.631876 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a48e01d9-5fe5-4419-a343-624f65853a16 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:48.632592 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a48e01d9-5fe5-4419-a343-624f65853a16 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:48.633051 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a48e01d9-5fe5-4419-a343-624f65853a16 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:48.633472 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a48e01d9-5fe5-4419-a343-624f65853a16 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:48.792321 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a48e01d9-5fe5-4419-a343-624f65853a16 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:48.811213 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a48e01d9-5fe5-4419-a343-624f65853a16 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:48.813619 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a48e01d9-5fe5-4419-a343-624f65853a16 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:48.821765 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a48e01d9-5fe5-4419-a343-624f65853a16 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1446 microversion: 2.75 time: 0.205403 Sep 24 20:59:48.822739 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1402/2803] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:59:48 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1446 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:59:48.865934 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9239bcfe-ae73-42c8-8db6-2465f0117bde tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:48.867096 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9239bcfe-ae73-42c8-8db6-2465f0117bde tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 637c2b11-a4f9-40e9-b309-5cffdcd7b64a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:48.875436 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9239bcfe-ae73-42c8-8db6-2465f0117bde tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:48.877165 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9239bcfe-ae73-42c8-8db6-2465f0117bde tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:48.877621 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9239bcfe-ae73-42c8-8db6-2465f0117bde tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:48.878434 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9239bcfe-ae73-42c8-8db6-2465f0117bde tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:48.878920 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9239bcfe-ae73-42c8-8db6-2465f0117bde tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:48.879400 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9239bcfe-ae73-42c8-8db6-2465f0117bde tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:49.198017 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-76daa76d-a4f3-49c1-b15a-939be8d59963 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:49.200927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-76daa76d-a4f3-49c1-b15a-939be8d59963 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:49.212942 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76daa76d-a4f3-49c1-b15a-939be8d59963 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:49.213454 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76daa76d-a4f3-49c1-b15a-939be8d59963 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:49.213899 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76daa76d-a4f3-49c1-b15a-939be8d59963 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:49.219815 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76daa76d-a4f3-49c1-b15a-939be8d59963 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:49.221612 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76daa76d-a4f3-49c1-b15a-939be8d59963 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:49.222819 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76daa76d-a4f3-49c1-b15a-939be8d59963 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:49.286589 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-76daa76d-a4f3-49c1-b15a-939be8d59963 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.092722 Sep 24 20:59:49.292077 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1403/2804] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:49 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:59:49.367805 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9239bcfe-ae73-42c8-8db6-2465f0117bde tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:49.379146 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9239bcfe-ae73-42c8-8db6-2465f0117bde tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a" status: 200 len: 1491 microversion: 2.1 time: 0.524079 Sep 24 20:59:49.380303 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1402/2805] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:48 2022] GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a => generated 1491 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:49.574642 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c87def1e-dd82-4c3e-8d8c-a4e5b662db32 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:49.575816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c87def1e-dd82-4c3e-8d8c-a4e5b662db32 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:49.593987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c87def1e-dd82-4c3e-8d8c-a4e5b662db32 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:49.594858 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c87def1e-dd82-4c3e-8d8c-a4e5b662db32 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:49.595720 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c87def1e-dd82-4c3e-8d8c-a4e5b662db32 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:49.597019 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c87def1e-dd82-4c3e-8d8c-a4e5b662db32 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:49.597823 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c87def1e-dd82-4c3e-8d8c-a4e5b662db32 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:49.598458 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c87def1e-dd82-4c3e-8d8c-a4e5b662db32 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:49.670126 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-de325a70-3049-47c1-90ab-a5178ea1d728 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:49.679249 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-de325a70-3049-47c1-90ab-a5178ea1d728 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] [instance: e781d448-5d66-4040-bf4c-37452b0f7b1c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:49.690340 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de325a70-3049-47c1-90ab-a5178ea1d728 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:49.692986 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de325a70-3049-47c1-90ab-a5178ea1d728 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:49.694611 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de325a70-3049-47c1-90ab-a5178ea1d728 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:49.695615 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de325a70-3049-47c1-90ab-a5178ea1d728 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:49.697533 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de325a70-3049-47c1-90ab-a5178ea1d728 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:49.698347 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de325a70-3049-47c1-90ab-a5178ea1d728 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:49.747992 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-de325a70-3049-47c1-90ab-a5178ea1d728 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] HTTP exception thrown: Instance e781d448-5d66-4040-bf4c-37452b0f7b1c could not be found. Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-de325a70-3049-47c1-90ab-a5178ea1d728 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Request method failure captured: Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c HTTP/1.1 Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL286ivwP6-bRmXUnR9fKsJTIaXleJ1-mH9YT6UHhlpZ19FE2S8-jY-Wi3HtZY3mBJlgc50LWRsS9hjX6IniaMVpVMC18VBpKeePWZuFADK-MeQTloKc9NamIMv0LdO6POax1rRlR1Xg-bSd6Tt9v-Jct8CvdsBXJ-_WNOR7xezXZFCc Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: c4004a1dbc2441f8a5c4ace42af3e2df Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-VolumesAdminNegativeTest-1782997698 Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4004a1dbc2441f8a5c4ace42af3e2df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4004a1dbc2441f8a5c4ace42af3e2df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4004a1dbc2441f8a5c4ace42af3e2df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4004a1dbc2441f8a5c4ace42af3e2df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-VolumesAdminNegativeTest-1782997698 Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: c4004a1dbc2441f8a5c4ace42af3e2df Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1782997698 Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-VolumesAdminNegativeTest-1782997698-project Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 31761ade4b4a4df580fd5de55426eb0b Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-VolumesAdminNegativeTest-1782997698-project Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance e781d448-5d66-4040-bf4c-37452b0f7b1c could not be found. Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'e781d448-5d66-4040-bf4c-37452b0f7b1c'} Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e781d448-5d66-4040-bf4c-37452b0f7b1c could not be found. Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e781d448-5d66-4040-bf4c-37452b0f7b1c could not be found. Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:59:49.751097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:49.755446 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:49.755446 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:59:49.755446 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:59:49.755446 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:59:49.755446 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:59:49.755446 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e781d448-5d66-4040-bf4c-37452b0f7b1c could not be found. Sep 24 20:59:49.755446 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 20:59:49.756180 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-de325a70-3049-47c1-90ab-a5178ea1d728 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Returning 404 to user: Instance e781d448-5d66-4040-bf4c-37452b0f7b1c could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:59:49.757046 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-de325a70-3049-47c1-90ab-a5178ea1d728 tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c" status: 404 len: 111 microversion: 2.1 time: 0.134881 Sep 24 20:59:49.758170 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1403/2806] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:49 2022] GET /compute/v2.1/servers/e781d448-5d66-4040-bf4c-37452b0f7b1c => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:59:49.766854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7d79d039-dd80-41be-9d91-5776837ae82c tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] Calling method '.version_select at 0x7f4b07d21ee0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:49.800338 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7d79d039-dd80-41be-9d91-5776837ae82c tempest-VolumesAdminNegativeTest-1782997698 tempest-VolumesAdminNegativeTest-1782997698-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-212877395" status: 202 len: 0 microversion: 2.1 time: 0.038085 Sep 24 20:59:49.805267 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1404/2807] 10.222.0.52 () {58 vars in 1218 bytes} [Sat Sep 24 20:59:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-212877395 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 20:59:49.851472 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bf02f13f-ebf0-4751-8ec6-87e9ff733510 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:49.852430 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bf02f13f-ebf0-4751-8ec6-87e9ff733510 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:49.867200 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf02f13f-ebf0-4751-8ec6-87e9ff733510 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:49.869329 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf02f13f-ebf0-4751-8ec6-87e9ff733510 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:49.870071 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf02f13f-ebf0-4751-8ec6-87e9ff733510 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:49.879913 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf02f13f-ebf0-4751-8ec6-87e9ff733510 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:49.880661 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf02f13f-ebf0-4751-8ec6-87e9ff733510 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:49.881385 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf02f13f-ebf0-4751-8ec6-87e9ff733510 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:50.176316 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c87def1e-dd82-4c3e-8d8c-a4e5b662db32 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:50.190310 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c87def1e-dd82-4c3e-8d8c-a4e5b662db32 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1515 microversion: 2.1 time: 0.623611 Sep 24 20:59:50.200943 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bf02f13f-ebf0-4751-8ec6-87e9ff733510 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:50.208533 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1404/2808] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:49 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1515 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:50.213534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bf02f13f-ebf0-4751-8ec6-87e9ff733510 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:50.216835 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-0c211658-d776-4d27-8ec1-7b9756abd932 req-41117149-be67-4cb3-bdec-455178dedb93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "637c2b11-a4f9-40e9-b309-5cffdcd7b64a", "name": "network-vif-deleted", "tag": "6adca827-a71f-421b-9872-6a1ccba4b327"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:50.218476 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bf02f13f-ebf0-4751-8ec6-87e9ff733510 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:50.231151 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bf02f13f-ebf0-4751-8ec6-87e9ff733510 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1446 microversion: 2.75 time: 0.384338 Sep 24 20:59:50.233506 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1405/2809] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:59:49 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1446 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:59:50.234814 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-0c211658-d776-4d27-8ec1-7b9756abd932 req-41117149-be67-4cb3-bdec-455178dedb93 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:50.235592 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-0c211658-d776-4d27-8ec1-7b9756abd932 req-41117149-be67-4cb3-bdec-455178dedb93 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:50.236240 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-0c211658-d776-4d27-8ec1-7b9756abd932 req-41117149-be67-4cb3-bdec-455178dedb93 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:50.303362 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b7a74389-b5b0-440a-9174-7619b4535c50 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:50.305597 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b7a74389-b5b0-440a-9174-7619b4535c50 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:50.306089 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-0c211658-d776-4d27-8ec1-7b9756abd932 req-41117149-be67-4cb3-bdec-455178dedb93 service nova] Creating event network-vif-deleted:6adca827-a71f-421b-9872-6a1ccba4b327 for instance 637c2b11-a4f9-40e9-b309-5cffdcd7b64a on nch1-master-1 Sep 24 20:59:50.316560 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b7a74389-b5b0-440a-9174-7619b4535c50 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:50.317063 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b7a74389-b5b0-440a-9174-7619b4535c50 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:50.317512 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b7a74389-b5b0-440a-9174-7619b4535c50 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:50.318238 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b7a74389-b5b0-440a-9174-7619b4535c50 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:50.318736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b7a74389-b5b0-440a-9174-7619b4535c50 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:50.319177 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b7a74389-b5b0-440a-9174-7619b4535c50 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:50.324281 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-0c211658-d776-4d27-8ec1-7b9756abd932 req-41117149-be67-4cb3-bdec-455178dedb93 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112951 Sep 24 20:59:50.327253 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1405/2810] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 20:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:59:50.399824 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b7a74389-b5b0-440a-9174-7619b4535c50 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.104087 Sep 24 20:59:50.400770 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1406/2811] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:50 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 20:59:50.409936 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4dceff11-10ae-4109-8b29-8ed5234fe086 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:50.410880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4dceff11-10ae-4109-8b29-8ed5234fe086 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 637c2b11-a4f9-40e9-b309-5cffdcd7b64a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:50.453970 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4dceff11-10ae-4109-8b29-8ed5234fe086 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:50.454467 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4dceff11-10ae-4109-8b29-8ed5234fe086 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:50.468673 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4dceff11-10ae-4109-8b29-8ed5234fe086 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:50.475412 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4dceff11-10ae-4109-8b29-8ed5234fe086 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:50.475921 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4dceff11-10ae-4109-8b29-8ed5234fe086 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:50.476363 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4dceff11-10ae-4109-8b29-8ed5234fe086 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:50.591962 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4dceff11-10ae-4109-8b29-8ed5234fe086 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:50.594484 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4dceff11-10ae-4109-8b29-8ed5234fe086 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:50.595856 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4dceff11-10ae-4109-8b29-8ed5234fe086 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:50.597417 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-4dceff11-10ae-4109-8b29-8ed5234fe086 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lazy-loading 'fault' on Instance uuid 637c2b11-a4f9-40e9-b309-5cffdcd7b64a {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:59:50.867325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4dceff11-10ae-4109-8b29-8ed5234fe086 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:50.881662 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4dceff11-10ae-4109-8b29-8ed5234fe086 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a" status: 200 len: 1304 microversion: 2.1 time: 0.477280 Sep 24 20:59:50.894674 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1406/2812] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:50 2022] GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a => generated 1304 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:51.222813 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e340fced-bea1-4eeb-92af-131e9aec23f2 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:51.223696 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e340fced-bea1-4eeb-92af-131e9aec23f2 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:51.243147 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e340fced-bea1-4eeb-92af-131e9aec23f2 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:51.244077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e340fced-bea1-4eeb-92af-131e9aec23f2 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:51.244712 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e340fced-bea1-4eeb-92af-131e9aec23f2 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:51.245592 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e340fced-bea1-4eeb-92af-131e9aec23f2 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:51.246578 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e340fced-bea1-4eeb-92af-131e9aec23f2 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:51.249916 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e340fced-bea1-4eeb-92af-131e9aec23f2 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:51.272800 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-89f24248-d236-4012-8d78-d2a1db6dd1ac tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:51.275788 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-89f24248-d236-4012-8d78-d2a1db6dd1ac tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:51.292994 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89f24248-d236-4012-8d78-d2a1db6dd1ac tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:51.295274 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89f24248-d236-4012-8d78-d2a1db6dd1ac tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:51.316752 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89f24248-d236-4012-8d78-d2a1db6dd1ac tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:51.317637 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89f24248-d236-4012-8d78-d2a1db6dd1ac tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:51.319460 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89f24248-d236-4012-8d78-d2a1db6dd1ac tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:51.325445 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89f24248-d236-4012-8d78-d2a1db6dd1ac tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:51.537443 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-89f24248-d236-4012-8d78-d2a1db6dd1ac tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:51.583125 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-89f24248-d236-4012-8d78-d2a1db6dd1ac tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:51.585589 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-89f24248-d236-4012-8d78-d2a1db6dd1ac tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:51.593841 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-89f24248-d236-4012-8d78-d2a1db6dd1ac tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1446 microversion: 2.75 time: 0.330452 Sep 24 20:59:51.594937 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1407/2813] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:59:51 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1446 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:59:51.624458 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5b81b47c-7d0d-4397-a3d6-2672868469b8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:51.628259 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5b81b47c-7d0d-4397-a3d6-2672868469b8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:51.637929 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b81b47c-7d0d-4397-a3d6-2672868469b8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:51.638626 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b81b47c-7d0d-4397-a3d6-2672868469b8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:51.640403 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b81b47c-7d0d-4397-a3d6-2672868469b8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:51.646618 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b81b47c-7d0d-4397-a3d6-2672868469b8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:51.648254 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b81b47c-7d0d-4397-a3d6-2672868469b8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:51.648857 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b81b47c-7d0d-4397-a3d6-2672868469b8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:51.690327 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:59:51.698269 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:59:51.718825 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5b81b47c-7d0d-4397-a3d6-2672868469b8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.117578 Sep 24 20:59:51.719433 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1408/2814] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:51 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:59:51.827027 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e340fced-bea1-4eeb-92af-131e9aec23f2 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:51.838154 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e340fced-bea1-4eeb-92af-131e9aec23f2 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1515 microversion: 2.1 time: 0.620526 Sep 24 20:59:51.838779 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1407/2815] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:51 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1515 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:51.911268 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e546e9fa-d24a-4e97-b08e-698f2824f936 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:51.912008 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e546e9fa-d24a-4e97-b08e-698f2824f936 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 637c2b11-a4f9-40e9-b309-5cffdcd7b64a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:51.924223 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e546e9fa-d24a-4e97-b08e-698f2824f936 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:51.924776 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e546e9fa-d24a-4e97-b08e-698f2824f936 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:51.925174 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e546e9fa-d24a-4e97-b08e-698f2824f936 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:51.925886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e546e9fa-d24a-4e97-b08e-698f2824f936 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:51.926339 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e546e9fa-d24a-4e97-b08e-698f2824f936 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:51.933391 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e546e9fa-d24a-4e97-b08e-698f2824f936 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:51.982022 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-e546e9fa-d24a-4e97-b08e-698f2824f936 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] HTTP exception thrown: Instance 637c2b11-a4f9-40e9-b309-5cffdcd7b64a could not be found. Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e546e9fa-d24a-4e97-b08e-698f2824f936 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Request method failure captured: Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a HTTP/1.1 Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL29-X0U31bWS-OdLHgyvrqJ9cKeXdCQcU5XDw5ndql8wo4-9uoBN2em1wysBqNzzzY5Bp3FNsC7GdcmIawuHD1dS6A2amzvS90hoLHvMsCDbASCEoRJt0wxOm48tnGq2wGlMnRgEB8mO_grzOCcTdRgOgaHbZsmHcINVEnjYdvyWtzs Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 8340f7f8fa9848dc822903c738f78f2a Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-DeleteServersTestJSON-1814924671 Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-DeleteServersTestJSON-1814924671 Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 8340f7f8fa9848dc822903c738f78f2a Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-DeleteServersTestJSON-1814924671 Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-DeleteServersTestJSON-1814924671-project Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: ee21da3ff38a43798bce50c9aba4ae33 Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-DeleteServersTestJSON-1814924671-project Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 637c2b11-a4f9-40e9-b309-5cffdcd7b64a could not be found. Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '637c2b11-a4f9-40e9-b309-5cffdcd7b64a'} Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 637c2b11-a4f9-40e9-b309-5cffdcd7b64a could not be found. Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 637c2b11-a4f9-40e9-b309-5cffdcd7b64a could not be found. Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:59:51.986417 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:59:51.990327 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:59:51.990327 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:59:51.990327 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:59:51.990327 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:59:51.990327 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:59:51.990327 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 637c2b11-a4f9-40e9-b309-5cffdcd7b64a could not be found. Sep 24 20:59:51.990327 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 20:59:51.990327 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e546e9fa-d24a-4e97-b08e-698f2824f936 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Returning 404 to user: Instance 637c2b11-a4f9-40e9-b309-5cffdcd7b64a could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:59:51.992210 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e546e9fa-d24a-4e97-b08e-698f2824f936 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a" status: 404 len: 111 microversion: 2.1 time: 0.083200 Sep 24 20:59:51.996041 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1409/2816] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:51 2022] GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 20:59:52.150998 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0c72caf5-c904-47b8-9432-9d303ca750a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1488820525", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "1d2fee0c-2b4a-497a-b4e0-a76edfbd4190"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:52.175818 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=18 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:59:52.235058 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-0c72caf5-c904-47b8-9432-9d303ca750a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] validate_networks() for [('1d2fee0c-2b4a-497a-b4e0-a76edfbd4190', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:59:52.626419 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9c88989d-13e4-4080-92a2-4714dcff3658 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:52.627151 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9c88989d-13e4-4080-92a2-4714dcff3658 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:52.668535 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c88989d-13e4-4080-92a2-4714dcff3658 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:52.669329 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c88989d-13e4-4080-92a2-4714dcff3658 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:52.670331 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c88989d-13e4-4080-92a2-4714dcff3658 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:52.673404 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c88989d-13e4-4080-92a2-4714dcff3658 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:52.674116 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c88989d-13e4-4080-92a2-4714dcff3658 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:52.674783 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c88989d-13e4-4080-92a2-4714dcff3658 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:53.023116 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9c88989d-13e4-4080-92a2-4714dcff3658 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:53.034039 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9c88989d-13e4-4080-92a2-4714dcff3658 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:53.035667 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9c88989d-13e4-4080-92a2-4714dcff3658 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:53.059467 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-0c72caf5-c904-47b8-9432-9d303ca750a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:59:53.059934 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-0c72caf5-c904-47b8-9432-9d303ca750a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:59:53.060409 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-0c72caf5-c904-47b8-9432-9d303ca750a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:59:53.060831 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-0c72caf5-c904-47b8-9432-9d303ca750a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:59:53.061255 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-0c72caf5-c904-47b8-9432-9d303ca750a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:59:53.085468 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9c88989d-13e4-4080-92a2-4714dcff3658 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1446 microversion: 2.75 time: 0.453025 Sep 24 20:59:53.087480 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1410/2817] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:59:52 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1446 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 20:59:53.091473 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c72caf5-c904-47b8-9432-9d303ca750a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:53.092093 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c72caf5-c904-47b8-9432-9d303ca750a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:53.092808 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c72caf5-c904-47b8-9432-9d303ca750a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:53.093773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c72caf5-c904-47b8-9432-9d303ca750a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:53.094359 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c72caf5-c904-47b8-9432-9d303ca750a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:53.094894 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c72caf5-c904-47b8-9432-9d303ca750a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:53.104832 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0bfb8802-da36-475f-81d5-688281d2ef6a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:53.107205 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0bfb8802-da36-475f-81d5-688281d2ef6a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:53.123532 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0bfb8802-da36-475f-81d5-688281d2ef6a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:53.124074 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0bfb8802-da36-475f-81d5-688281d2ef6a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:53.125223 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0bfb8802-da36-475f-81d5-688281d2ef6a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:53.127959 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0bfb8802-da36-475f-81d5-688281d2ef6a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:53.128482 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0bfb8802-da36-475f-81d5-688281d2ef6a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:53.128946 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0bfb8802-da36-475f-81d5-688281d2ef6a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:53.150031 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-0c72caf5-c904-47b8-9432-9d303ca750a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Getting quotas for project 8340f7f8fa9848dc822903c738f78f2a. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:59:53.164322 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-0c72caf5-c904-47b8-9432-9d303ca750a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Getting quotas for user ee21da3ff38a43798bce50c9aba4ae33 and project 8340f7f8fa9848dc822903c738f78f2a. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:59:53.178110 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0bfb8802-da36-475f-81d5-688281d2ef6a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.088804 Sep 24 20:59:53.183061 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1411/2818] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:53 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:59:53.190112 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0c72caf5-c904-47b8-9432-9d303ca750a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:59:53.194272 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0c72caf5-c904-47b8-9432-9d303ca750a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:59:53.194869 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1f092b55-dd12-4e66-ad18-4f97bbf5360b tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:53.195692 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1f092b55-dd12-4e66-ad18-4f97bbf5360b tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:53.206553 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f092b55-dd12-4e66-ad18-4f97bbf5360b tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:53.207193 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f092b55-dd12-4e66-ad18-4f97bbf5360b tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:53.207689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f092b55-dd12-4e66-ad18-4f97bbf5360b tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:53.209236 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f092b55-dd12-4e66-ad18-4f97bbf5360b tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:53.209578 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f092b55-dd12-4e66-ad18-4f97bbf5360b tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:53.210233 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f092b55-dd12-4e66-ad18-4f97bbf5360b tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:53.260126 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0c72caf5-c904-47b8-9432-9d303ca750a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.114261 Sep 24 20:59:53.261908 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1408/2819] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:59:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1117 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:59:53.275057 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-955c289c-6479-4411-a1ab-d43827ed3bbc tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:53.275967 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-955c289c-6479-4411-a1ab-d43827ed3bbc tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:53.494428 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-955c289c-6479-4411-a1ab-d43827ed3bbc tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:53.509401 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-955c289c-6479-4411-a1ab-d43827ed3bbc tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1215 microversion: 2.1 time: 0.238462 Sep 24 20:59:53.517140 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1409/2820] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:53 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1215 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:59:53.673307 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1f092b55-dd12-4e66-ad18-4f97bbf5360b tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:53.697252 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1f092b55-dd12-4e66-ad18-4f97bbf5360b tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1515 microversion: 2.1 time: 0.512597 Sep 24 20:59:53.697998 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1412/2821] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:53 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1515 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:54.118184 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e5352712-e85f-41e1-a608-177e6ebaab26 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:54.119876 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e5352712-e85f-41e1-a608-177e6ebaab26 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:54.143690 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5352712-e85f-41e1-a608-177e6ebaab26 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:54.144736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5352712-e85f-41e1-a608-177e6ebaab26 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:54.146384 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5352712-e85f-41e1-a608-177e6ebaab26 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:54.149228 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5352712-e85f-41e1-a608-177e6ebaab26 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:54.150378 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5352712-e85f-41e1-a608-177e6ebaab26 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:54.152227 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5352712-e85f-41e1-a608-177e6ebaab26 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:54.192255 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d1e94bd7-9b7e-4ba4-8a71-1df371f672c1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:54.194583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d1e94bd7-9b7e-4ba4-8a71-1df371f672c1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:54.218634 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d1e94bd7-9b7e-4ba4-8a71-1df371f672c1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:54.219200 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d1e94bd7-9b7e-4ba4-8a71-1df371f672c1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:54.223693 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d1e94bd7-9b7e-4ba4-8a71-1df371f672c1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:54.224055 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d1e94bd7-9b7e-4ba4-8a71-1df371f672c1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:54.224544 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d1e94bd7-9b7e-4ba4-8a71-1df371f672c1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:54.224980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d1e94bd7-9b7e-4ba4-8a71-1df371f672c1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:54.324153 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d1e94bd7-9b7e-4ba4-8a71-1df371f672c1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.137160 Sep 24 20:59:54.328228 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1413/2822] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:54 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 20:59:54.367084 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e5352712-e85f-41e1-a608-177e6ebaab26 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:54.387917 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e5352712-e85f-41e1-a608-177e6ebaab26 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:54.392193 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e5352712-e85f-41e1-a608-177e6ebaab26 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:54.404732 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e5352712-e85f-41e1-a608-177e6ebaab26 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1446 microversion: 2.75 time: 0.288211 Sep 24 20:59:54.407797 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1410/2823] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:59:54 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1446 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:59:54.540138 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4792044a-9e46-41d6-a930-8ac61168a159 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:54.540810 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4792044a-9e46-41d6-a930-8ac61168a159 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:54.547767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4792044a-9e46-41d6-a930-8ac61168a159 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:54.548391 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4792044a-9e46-41d6-a930-8ac61168a159 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:54.548922 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4792044a-9e46-41d6-a930-8ac61168a159 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:54.549862 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4792044a-9e46-41d6-a930-8ac61168a159 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:54.550555 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4792044a-9e46-41d6-a930-8ac61168a159 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:54.551213 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4792044a-9e46-41d6-a930-8ac61168a159 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:54.569319 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:59:54.698995 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4792044a-9e46-41d6-a930-8ac61168a159 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:54.707510 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4792044a-9e46-41d6-a930-8ac61168a159 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1267 microversion: 2.1 time: 0.171226 Sep 24 20:59:54.711513 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1414/2824] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:54 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:54.729166 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-771a7116-d624-48f3-ad01-a2720b873f67 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:54.731193 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-771a7116-d624-48f3-ad01-a2720b873f67 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:54.754177 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-771a7116-d624-48f3-ad01-a2720b873f67 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:54.754723 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-771a7116-d624-48f3-ad01-a2720b873f67 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:54.758778 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-771a7116-d624-48f3-ad01-a2720b873f67 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:54.759550 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-771a7116-d624-48f3-ad01-a2720b873f67 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:54.765642 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-771a7116-d624-48f3-ad01-a2720b873f67 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:54.766189 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-771a7116-d624-48f3-ad01-a2720b873f67 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:55.010876 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-73beb2c1-c8c7-4684-95e9-3697138278b0 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Action: 'create', calling method: .version_select at 0x7f4b0c413040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-630643766", "description": "tempest-description-2003218044"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:55.493522 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-771a7116-d624-48f3-ad01-a2720b873f67 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:55.495932 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:59:55.508391 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-771a7116-d624-48f3-ad01-a2720b873f67 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1515 microversion: 2.1 time: 0.787299 Sep 24 20:59:55.509031 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1411/2825] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:54 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1515 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:55.520618 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f99f129b-5ef6-402e-9e25-4567a75fd6b1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:55.528956 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f99f129b-5ef6-402e-9e25-4567a75fd6b1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:55.538315 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f99f129b-5ef6-402e-9e25-4567a75fd6b1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:55.541751 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f99f129b-5ef6-402e-9e25-4567a75fd6b1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:55.547473 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f99f129b-5ef6-402e-9e25-4567a75fd6b1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:55.548601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f99f129b-5ef6-402e-9e25-4567a75fd6b1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:55.549285 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f99f129b-5ef6-402e-9e25-4567a75fd6b1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:55.553666 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f99f129b-5ef6-402e-9e25-4567a75fd6b1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:55.611233 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f99f129b-5ef6-402e-9e25-4567a75fd6b1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.099395 Sep 24 20:59:55.612462 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1412/2826] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:55 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:59:55.617394 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f89159a1-a14e-41e7-8925-0952de20cc86 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:55.618240 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f89159a1-a14e-41e7-8925-0952de20cc86 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:55.626413 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f89159a1-a14e-41e7-8925-0952de20cc86 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:55.627215 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f89159a1-a14e-41e7-8925-0952de20cc86 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:55.628004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f89159a1-a14e-41e7-8925-0952de20cc86 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:55.628931 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f89159a1-a14e-41e7-8925-0952de20cc86 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:55.629557 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f89159a1-a14e-41e7-8925-0952de20cc86 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:55.630149 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f89159a1-a14e-41e7-8925-0952de20cc86 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:55.740045 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-73beb2c1-c8c7-4684-95e9-3697138278b0 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.816808 Sep 24 20:59:55.741550 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1415/2827] 10.222.0.52 () {60 vars in 1180 bytes} [Sat Sep 24 20:59:54 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:59:55.755084 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7caf8881-bc6a-42dc-93e7-1c99b35c7eca tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:55.756552 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7caf8881-bc6a-42dc-93e7-1c99b35c7eca tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:55.767190 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7caf8881-bc6a-42dc-93e7-1c99b35c7eca tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:55.769983 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7caf8881-bc6a-42dc-93e7-1c99b35c7eca tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:55.770831 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7caf8881-bc6a-42dc-93e7-1c99b35c7eca tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:55.771716 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7caf8881-bc6a-42dc-93e7-1c99b35c7eca tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:55.772337 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7caf8881-bc6a-42dc-93e7-1c99b35c7eca tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:55.772947 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7caf8881-bc6a-42dc-93e7-1c99b35c7eca tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:55.823983 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f89159a1-a14e-41e7-8925-0952de20cc86 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:55.847510 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f89159a1-a14e-41e7-8925-0952de20cc86 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:55.848980 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f89159a1-a14e-41e7-8925-0952de20cc86 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:55.869060 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f89159a1-a14e-41e7-8925-0952de20cc86 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1446 microversion: 2.75 time: 0.251116 Sep 24 20:59:55.876378 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1413/2828] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:59:55 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1446 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:59:55.891276 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-acd10d57-5f5f-4f06-9583-df4278c64147 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Action: 'create', calling method: .version_select at 0x7f4b07d21160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1715789568", "description": "tempest-description-1152769961"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:55.943002 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7caf8881-bc6a-42dc-93e7-1c99b35c7eca tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:55.956833 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7caf8881-bc6a-42dc-93e7-1c99b35c7eca tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1273 microversion: 2.1 time: 0.213790 Sep 24 20:59:55.959842 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1416/2829] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:55 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1273 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:56.244912 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-acd10d57-5f5f-4f06-9583-df4278c64147 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.366823 Sep 24 20:59:56.260583 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1414/2830] 10.222.0.52 () {60 vars in 1180 bytes} [Sat Sep 24 20:59:55 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:59:56.327938 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-46f8676d-9bf8-4aaf-b32f-ee430259e837 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-888185263", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "8986c514-fc4e-460c-b04d-db52f7674204"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:59:56.403585 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-46f8676d-9bf8-4aaf-b32f-ee430259e837 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] validate_networks() for [('8986c514-fc4e-460c-b04d-db52f7674204', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 20:59:56.534884 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-247f3d0a-e681-4721-8980-852783418f6a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:56.536064 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-247f3d0a-e681-4721-8980-852783418f6a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:56.542804 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-247f3d0a-e681-4721-8980-852783418f6a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:56.543798 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-247f3d0a-e681-4721-8980-852783418f6a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:56.544391 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-247f3d0a-e681-4721-8980-852783418f6a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:56.545379 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-247f3d0a-e681-4721-8980-852783418f6a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:56.546074 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-247f3d0a-e681-4721-8980-852783418f6a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:56.546864 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-247f3d0a-e681-4721-8980-852783418f6a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:56.881575 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-247f3d0a-e681-4721-8980-852783418f6a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:56.892837 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-247f3d0a-e681-4721-8980-852783418f6a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1515 microversion: 2.1 time: 0.363374 Sep 24 20:59:56.911778 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1415/2831] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:56 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1515 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:56.918042 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c7d5ffeb-1d6a-4de5-b531-b348b19c15f1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:56.921314 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c7d5ffeb-1d6a-4de5-b531-b348b19c15f1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:56.928837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c7d5ffeb-1d6a-4de5-b531-b348b19c15f1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:56.929609 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c7d5ffeb-1d6a-4de5-b531-b348b19c15f1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:56.930168 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c7d5ffeb-1d6a-4de5-b531-b348b19c15f1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:56.931210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c7d5ffeb-1d6a-4de5-b531-b348b19c15f1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:56.931881 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c7d5ffeb-1d6a-4de5-b531-b348b19c15f1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:56.932518 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c7d5ffeb-1d6a-4de5-b531-b348b19c15f1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:56.988783 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c7d5ffeb-1d6a-4de5-b531-b348b19c15f1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.075400 Sep 24 20:59:56.989848 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1416/2832] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:56 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:59:56.994690 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-99572183-6273-424d-a660-d4e2f8947f7d tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:56.995441 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-99572183-6273-424d-a660-d4e2f8947f7d tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:57.002191 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-99572183-6273-424d-a660-d4e2f8947f7d tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:57.002926 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-99572183-6273-424d-a660-d4e2f8947f7d tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:57.003475 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-99572183-6273-424d-a660-d4e2f8947f7d tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:57.004293 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-99572183-6273-424d-a660-d4e2f8947f7d tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:57.005483 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-99572183-6273-424d-a660-d4e2f8947f7d tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:57.006026 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-99572183-6273-424d-a660-d4e2f8947f7d tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:57.109202 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-99572183-6273-424d-a660-d4e2f8947f7d tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:57.121517 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-46f8676d-9bf8-4aaf-b32f-ee430259e837 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 20:59:57.121994 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-46f8676d-9bf8-4aaf-b32f-ee430259e837 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 20:59:57.122424 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-46f8676d-9bf8-4aaf-b32f-ee430259e837 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 20:59:57.122982 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-46f8676d-9bf8-4aaf-b32f-ee430259e837 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 20:59:57.123418 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-46f8676d-9bf8-4aaf-b32f-ee430259e837 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 20:59:57.126583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:59:57.144084 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-99572183-6273-424d-a660-d4e2f8947f7d tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:57.149867 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-99572183-6273-424d-a660-d4e2f8947f7d tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:57.152973 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-46f8676d-9bf8-4aaf-b32f-ee430259e837 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:57.153494 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-46f8676d-9bf8-4aaf-b32f-ee430259e837 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:57.155082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-46f8676d-9bf8-4aaf-b32f-ee430259e837 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:57.156257 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-46f8676d-9bf8-4aaf-b32f-ee430259e837 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:57.158555 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-46f8676d-9bf8-4aaf-b32f-ee430259e837 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:57.161162 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-46f8676d-9bf8-4aaf-b32f-ee430259e837 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:57.164910 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-99572183-6273-424d-a660-d4e2f8947f7d tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1446 microversion: 2.75 time: 0.173795 Sep 24 20:59:57.168455 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1417/2833] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:59:56 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1446 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:59:57.185688 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-14d5b63c-5c48-4f99-899b-432f6766cb7c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:57.186592 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-14d5b63c-5c48-4f99-899b-432f6766cb7c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:57.207576 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-14d5b63c-5c48-4f99-899b-432f6766cb7c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:57.208487 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-14d5b63c-5c48-4f99-899b-432f6766cb7c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:57.211104 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-14d5b63c-5c48-4f99-899b-432f6766cb7c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:57.212845 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-14d5b63c-5c48-4f99-899b-432f6766cb7c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:57.216450 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-14d5b63c-5c48-4f99-899b-432f6766cb7c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:57.217097 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-14d5b63c-5c48-4f99-899b-432f6766cb7c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:57.232472 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-46f8676d-9bf8-4aaf-b32f-ee430259e837 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Getting quotas for project 981fdf8ae7524612b9c2f6a3f16c39ec. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 20:59:57.257436 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-46f8676d-9bf8-4aaf-b32f-ee430259e837 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Getting quotas for user 5ddab9c74c004e74a51fd8008886e542 and project 981fdf8ae7524612b9c2f6a3f16c39ec. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 20:59:57.272040 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-46f8676d-9bf8-4aaf-b32f-ee430259e837 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 20:59:57.274988 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-46f8676d-9bf8-4aaf-b32f-ee430259e837 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 1cceb126-5c30-4c10-b02f-f6a27a7420c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 20:59:57.340155 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-46f8676d-9bf8-4aaf-b32f-ee430259e837 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.016145 Sep 24 20:59:57.345974 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1417/2834] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 20:59:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1023 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 20:59:57.348623 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-14d5b63c-5c48-4f99-899b-432f6766cb7c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:57.359417 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-14d5b63c-5c48-4f99-899b-432f6766cb7c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1273 microversion: 2.1 time: 0.188672 Sep 24 20:59:57.371317 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1418/2835] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:57 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1273 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:57.372444 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7a1800b8-c411-47b4-916a-5b4a97183289 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:57.372444 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7a1800b8-c411-47b4-916a-5b4a97183289 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 1cceb126-5c30-4c10-b02f-f6a27a7420c8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:57.484932 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7a1800b8-c411-47b4-916a-5b4a97183289 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddab9c74c004e74a51fd8008886e542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdf8ae7524612b9c2f6a3f16c39ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:57.498108 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7a1800b8-c411-47b4-916a-5b4a97183289 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8" status: 200 len: 1215 microversion: 2.1 time: 0.141331 Sep 24 20:59:57.500854 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1418/2836] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:57 2022] GET /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8 => generated 1215 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:57.919880 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2841c657-ec78-4c70-bac4-4e82d475c726 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:57.920527 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2841c657-ec78-4c70-bac4-4e82d475c726 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:57.948379 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2841c657-ec78-4c70-bac4-4e82d475c726 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:57.948884 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2841c657-ec78-4c70-bac4-4e82d475c726 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:57.958355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2841c657-ec78-4c70-bac4-4e82d475c726 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:57.959674 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2841c657-ec78-4c70-bac4-4e82d475c726 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:57.960362 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2841c657-ec78-4c70-bac4-4e82d475c726 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:57.960955 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2841c657-ec78-4c70-bac4-4e82d475c726 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:58.004299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ec664932-ad7c-4bd8-b560-d19252ff5646 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:58.007491 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ec664932-ad7c-4bd8-b560-d19252ff5646 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:58.040616 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ec664932-ad7c-4bd8-b560-d19252ff5646 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:58.044468 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ec664932-ad7c-4bd8-b560-d19252ff5646 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:58.045160 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ec664932-ad7c-4bd8-b560-d19252ff5646 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:58.046225 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ec664932-ad7c-4bd8-b560-d19252ff5646 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:58.048064 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ec664932-ad7c-4bd8-b560-d19252ff5646 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:58.049166 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ec664932-ad7c-4bd8-b560-d19252ff5646 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:58.095717 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ec664932-ad7c-4bd8-b560-d19252ff5646 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.096851 Sep 24 20:59:58.099800 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1419/2837] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:57 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:59:58.201078 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e07e6138-26db-4b92-a666-e9525307793f tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:58.203744 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e07e6138-26db-4b92-a666-e9525307793f tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:58.214208 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e07e6138-26db-4b92-a666-e9525307793f tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:58.219929 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e07e6138-26db-4b92-a666-e9525307793f tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:58.220691 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e07e6138-26db-4b92-a666-e9525307793f tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:58.221685 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e07e6138-26db-4b92-a666-e9525307793f tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:58.224057 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e07e6138-26db-4b92-a666-e9525307793f tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:58.224772 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e07e6138-26db-4b92-a666-e9525307793f tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:58.369019 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e07e6138-26db-4b92-a666-e9525307793f tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:58.384221 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e07e6138-26db-4b92-a666-e9525307793f tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:58.389394 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e07e6138-26db-4b92-a666-e9525307793f tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:58.402903 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e07e6138-26db-4b92-a666-e9525307793f tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1446 microversion: 2.75 time: 0.206765 Sep 24 20:59:58.422815 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1420/2838] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:59:58 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1446 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:59:58.430754 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-291d5775-4f2e-4f3a-b1fd-81115e48f8dd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:58.440823 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-291d5775-4f2e-4f3a-b1fd-81115e48f8dd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:58.461291 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-291d5775-4f2e-4f3a-b1fd-81115e48f8dd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:58.466137 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-291d5775-4f2e-4f3a-b1fd-81115e48f8dd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:58.478884 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-291d5775-4f2e-4f3a-b1fd-81115e48f8dd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:58.479764 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-291d5775-4f2e-4f3a-b1fd-81115e48f8dd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:58.480259 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-291d5775-4f2e-4f3a-b1fd-81115e48f8dd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:58.480711 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-291d5775-4f2e-4f3a-b1fd-81115e48f8dd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:58.507010 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2841c657-ec78-4c70-bac4-4e82d475c726 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:58.516469 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2841c657-ec78-4c70-bac4-4e82d475c726 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1515 microversion: 2.1 time: 0.601116 Sep 24 20:59:58.525577 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1419/2839] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:57 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1515 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:58.532992 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-53f5df61-992b-4ba5-a8c3-ba0e2cea8903 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:58.542192 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-53f5df61-992b-4ba5-a8c3-ba0e2cea8903 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 1cceb126-5c30-4c10-b02f-f6a27a7420c8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:58.552375 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53f5df61-992b-4ba5-a8c3-ba0e2cea8903 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:58.553113 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53f5df61-992b-4ba5-a8c3-ba0e2cea8903 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:58.554782 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53f5df61-992b-4ba5-a8c3-ba0e2cea8903 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:58.556017 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53f5df61-992b-4ba5-a8c3-ba0e2cea8903 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:58.557817 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53f5df61-992b-4ba5-a8c3-ba0e2cea8903 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:58.560295 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53f5df61-992b-4ba5-a8c3-ba0e2cea8903 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:58.884497 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-53f5df61-992b-4ba5-a8c3-ba0e2cea8903 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddab9c74c004e74a51fd8008886e542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdf8ae7524612b9c2f6a3f16c39ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:58.895002 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-53f5df61-992b-4ba5-a8c3-ba0e2cea8903 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8" status: 200 len: 1267 microversion: 2.1 time: 0.367304 Sep 24 20:59:58.896605 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1420/2840] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:58 2022] GET /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8 => generated 1267 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:59.003867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-291d5775-4f2e-4f3a-b1fd-81115e48f8dd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:59.019190 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-291d5775-4f2e-4f3a-b1fd-81115e48f8dd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1315 microversion: 2.1 time: 0.592531 Sep 24 20:59:59.020317 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1421/2841] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:58 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1315 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:59:59.113944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2470ccd3-9407-4873-a244-35d328740536 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:59.116932 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2470ccd3-9407-4873-a244-35d328740536 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:59.125750 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2470ccd3-9407-4873-a244-35d328740536 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:59.127138 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2470ccd3-9407-4873-a244-35d328740536 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:59.127755 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2470ccd3-9407-4873-a244-35d328740536 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:59.128672 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2470ccd3-9407-4873-a244-35d328740536 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:59.129300 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2470ccd3-9407-4873-a244-35d328740536 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:59.130668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2470ccd3-9407-4873-a244-35d328740536 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:59.182327 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2470ccd3-9407-4873-a244-35d328740536 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.072302 Sep 24 20:59:59.184118 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1421/2842] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 20:59:59 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 20:59:59.454707 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5035feb2-896d-4c75-9943-afb1e5ce3522 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:59.455433 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5035feb2-896d-4c75-9943-afb1e5ce3522 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:59.465864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5035feb2-896d-4c75-9943-afb1e5ce3522 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:59.470183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5035feb2-896d-4c75-9943-afb1e5ce3522 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:59.471033 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5035feb2-896d-4c75-9943-afb1e5ce3522 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:59.473098 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5035feb2-896d-4c75-9943-afb1e5ce3522 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:59.481701 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5035feb2-896d-4c75-9943-afb1e5ce3522 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:59.482166 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5035feb2-896d-4c75-9943-afb1e5ce3522 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:59.568391 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b27a5e5b-6953-40b6-b8ad-1e98e66986e8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:59.568391 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b27a5e5b-6953-40b6-b8ad-1e98e66986e8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:59.574903 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b27a5e5b-6953-40b6-b8ad-1e98e66986e8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:59.575410 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b27a5e5b-6953-40b6-b8ad-1e98e66986e8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:59.575858 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b27a5e5b-6953-40b6-b8ad-1e98e66986e8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:59.576581 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b27a5e5b-6953-40b6-b8ad-1e98e66986e8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:59.577047 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b27a5e5b-6953-40b6-b8ad-1e98e66986e8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:59.578074 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b27a5e5b-6953-40b6-b8ad-1e98e66986e8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:59.660471 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5035feb2-896d-4c75-9943-afb1e5ce3522 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:59.677678 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5035feb2-896d-4c75-9943-afb1e5ce3522 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:59.685776 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5035feb2-896d-4c75-9943-afb1e5ce3522 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:59:59.694798 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5035feb2-896d-4c75-9943-afb1e5ce3522 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1446 microversion: 2.75 time: 0.244109 Sep 24 20:59:59.695951 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1422/2843] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 20:59:59 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1446 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 20:59:59.923200 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ca4b458e-571f-446b-b685-125f0e9acbe2 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:59:59.924396 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ca4b458e-571f-446b-b685-125f0e9acbe2 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 1cceb126-5c30-4c10-b02f-f6a27a7420c8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:59:59.936873 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ca4b458e-571f-446b-b685-125f0e9acbe2 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:59.937822 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ca4b458e-571f-446b-b685-125f0e9acbe2 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:59.938418 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ca4b458e-571f-446b-b685-125f0e9acbe2 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:59:59.941182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ca4b458e-571f-446b-b685-125f0e9acbe2 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:59:59.941828 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ca4b458e-571f-446b-b685-125f0e9acbe2 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:59:59.942434 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ca4b458e-571f-446b-b685-125f0e9acbe2 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:00.025651 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b27a5e5b-6953-40b6-b8ad-1e98e66986e8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:00.045311 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b27a5e5b-6953-40b6-b8ad-1e98e66986e8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1515 microversion: 2.1 time: 0.495682 Sep 24 21:00:00.053845 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1422/2844] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:59 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1515 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:00.060930 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-aa37dc59-4bd5-4ca2-a025-c9f2d385775d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:00.062472 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-aa37dc59-4bd5-4ca2-a025-c9f2d385775d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:00.069794 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aa37dc59-4bd5-4ca2-a025-c9f2d385775d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:00.078567 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aa37dc59-4bd5-4ca2-a025-c9f2d385775d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:00.079793 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aa37dc59-4bd5-4ca2-a025-c9f2d385775d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:00.080780 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aa37dc59-4bd5-4ca2-a025-c9f2d385775d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:00.081464 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aa37dc59-4bd5-4ca2-a025-c9f2d385775d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:00.082114 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aa37dc59-4bd5-4ca2-a025-c9f2d385775d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:00.134587 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ca4b458e-571f-446b-b685-125f0e9acbe2 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddab9c74c004e74a51fd8008886e542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdf8ae7524612b9c2f6a3f16c39ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:00.158294 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ca4b458e-571f-446b-b685-125f0e9acbe2 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8" status: 200 len: 1273 microversion: 2.1 time: 0.234567 Sep 24 21:00:00.160654 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1423/2845] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 20:59:59 2022] GET /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8 => generated 1273 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:00:00.196831 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8fca2f2d-ff37-4eeb-b67d-cd543a4cc6b1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:00.198986 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8fca2f2d-ff37-4eeb-b67d-cd543a4cc6b1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:00.208927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8fca2f2d-ff37-4eeb-b67d-cd543a4cc6b1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:00.208927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8fca2f2d-ff37-4eeb-b67d-cd543a4cc6b1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:00.209143 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8fca2f2d-ff37-4eeb-b67d-cd543a4cc6b1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:00.210100 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8fca2f2d-ff37-4eeb-b67d-cd543a4cc6b1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:00.211198 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8fca2f2d-ff37-4eeb-b67d-cd543a4cc6b1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:00.211895 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8fca2f2d-ff37-4eeb-b67d-cd543a4cc6b1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:00.277111 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8fca2f2d-ff37-4eeb-b67d-cd543a4cc6b1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.084176 Sep 24 21:00:00.278410 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1424/2846] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:00:00 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 21:00:00.284729 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-eab4f8e1-3040-4620-b34c-c9a1da05904e req-39b71aba-b1f2-47ac-b5cb-3fd8e28c1b23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c96f88e-1327-49e3-8e9a-5417f96fb308", "tag": "f8825c51-2e9d-4429-9259-cd32e621d907"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:00.301620 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-eab4f8e1-3040-4620-b34c-c9a1da05904e req-39b71aba-b1f2-47ac-b5cb-3fd8e28c1b23 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:00.302636 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-eab4f8e1-3040-4620-b34c-c9a1da05904e req-39b71aba-b1f2-47ac-b5cb-3fd8e28c1b23 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:00.303647 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-eab4f8e1-3040-4620-b34c-c9a1da05904e req-39b71aba-b1f2-47ac-b5cb-3fd8e28c1b23 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:00.332489 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-eab4f8e1-3040-4620-b34c-c9a1da05904e req-39b71aba-b1f2-47ac-b5cb-3fd8e28c1b23 service nova] Creating event network-changed:f8825c51-2e9d-4429-9259-cd32e621d907 for instance 9c96f88e-1327-49e3-8e9a-5417f96fb308 on nch2-master-1 Sep 24 21:00:00.339740 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-eab4f8e1-3040-4620-b34c-c9a1da05904e req-39b71aba-b1f2-47ac-b5cb-3fd8e28c1b23 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059736 Sep 24 21:00:00.341282 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1425/2847] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:00:00.724817 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0a678d1f-c053-4af0-aeaf-206d0cdc428b tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:00.725533 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0a678d1f-c053-4af0-aeaf-206d0cdc428b tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:00.740778 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0a678d1f-c053-4af0-aeaf-206d0cdc428b tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:00.741483 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0a678d1f-c053-4af0-aeaf-206d0cdc428b tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:00.741934 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0a678d1f-c053-4af0-aeaf-206d0cdc428b tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:00.744441 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0a678d1f-c053-4af0-aeaf-206d0cdc428b tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:00.747230 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0a678d1f-c053-4af0-aeaf-206d0cdc428b tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:00.752028 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0a678d1f-c053-4af0-aeaf-206d0cdc428b tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:00.799740 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-aa37dc59-4bd5-4ca2-a025-c9f2d385775d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:00.821326 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-aa37dc59-4bd5-4ca2-a025-c9f2d385775d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1315 microversion: 2.1 time: 0.765708 Sep 24 21:00:00.824311 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1423/2848] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:00 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1315 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:00.887777 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0a678d1f-c053-4af0-aeaf-206d0cdc428b tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:00.905517 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0a678d1f-c053-4af0-aeaf-206d0cdc428b tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:00.919136 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0a678d1f-c053-4af0-aeaf-206d0cdc428b tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:00.928685 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0a678d1f-c053-4af0-aeaf-206d0cdc428b tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1446 microversion: 2.75 time: 0.208122 Sep 24 21:00:00.929836 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1426/2849] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:00:00 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1446 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:00:01.076338 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4c80a40d-876a-419c-99e0-46496560c497 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:01.076980 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4c80a40d-876a-419c-99e0-46496560c497 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:01.087972 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4c80a40d-876a-419c-99e0-46496560c497 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:01.088789 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4c80a40d-876a-419c-99e0-46496560c497 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:01.089456 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4c80a40d-876a-419c-99e0-46496560c497 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:01.090384 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4c80a40d-876a-419c-99e0-46496560c497 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:01.091200 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4c80a40d-876a-419c-99e0-46496560c497 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:01.091830 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4c80a40d-876a-419c-99e0-46496560c497 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:01.188102 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-08fac866-fe66-4126-887b-8b2cdc6eb1c6 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:01.189255 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-08fac866-fe66-4126-887b-8b2cdc6eb1c6 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 1cceb126-5c30-4c10-b02f-f6a27a7420c8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:01.204700 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-08fac866-fe66-4126-887b-8b2cdc6eb1c6 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:01.205547 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-08fac866-fe66-4126-887b-8b2cdc6eb1c6 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:01.208346 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-08fac866-fe66-4126-887b-8b2cdc6eb1c6 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:01.212255 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-08fac866-fe66-4126-887b-8b2cdc6eb1c6 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:01.214795 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-08fac866-fe66-4126-887b-8b2cdc6eb1c6 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:01.215502 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-08fac866-fe66-4126-887b-8b2cdc6eb1c6 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:01.399997 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-08fac866-fe66-4126-887b-8b2cdc6eb1c6 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddab9c74c004e74a51fd8008886e542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdf8ae7524612b9c2f6a3f16c39ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:01.418276 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-08fac866-fe66-4126-887b-8b2cdc6eb1c6 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8" status: 200 len: 1273 microversion: 2.1 time: 0.233311 Sep 24 21:00:01.423076 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1427/2850] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:01 2022] GET /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8 => generated 1273 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:00:01.453706 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1c14c530-de35-434c-8ee0-a06ad50c2b2e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:01.470249 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1c14c530-de35-434c-8ee0-a06ad50c2b2e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:01.486056 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c14c530-de35-434c-8ee0-a06ad50c2b2e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:01.486930 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c14c530-de35-434c-8ee0-a06ad50c2b2e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:01.487700 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c14c530-de35-434c-8ee0-a06ad50c2b2e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:01.488591 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c14c530-de35-434c-8ee0-a06ad50c2b2e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:01.489361 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c14c530-de35-434c-8ee0-a06ad50c2b2e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:01.492195 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c14c530-de35-434c-8ee0-a06ad50c2b2e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:01.535288 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1c14c530-de35-434c-8ee0-a06ad50c2b2e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.096201 Sep 24 21:00:01.540550 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1428/2851] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:00:01 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:00:01.614425 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f72ef802-0b81-463f-89cc-ae16694329a4 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-222102448", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "1dd327b0-ea80-4b36-9bd6-4bb474cfedec"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:01.699331 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-f72ef802-0b81-463f-89cc-ae16694329a4 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] validate_networks() for [('1dd327b0-ea80-4b36-9bd6-4bb474cfedec', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:00:02.068081 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4c80a40d-876a-419c-99e0-46496560c497 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:02.082037 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4c80a40d-876a-419c-99e0-46496560c497 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1515 microversion: 2.1 time: 1.008948 Sep 24 21:00:02.094538 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1424/2852] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:01 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1515 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:02.094538 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-22dbc030-8746-476e-9a7b-d200ef9cc11c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:02.094538 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-22dbc030-8746-476e-9a7b-d200ef9cc11c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:02.113753 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22dbc030-8746-476e-9a7b-d200ef9cc11c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:02.114895 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22dbc030-8746-476e-9a7b-d200ef9cc11c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:02.115639 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22dbc030-8746-476e-9a7b-d200ef9cc11c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:02.116585 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22dbc030-8746-476e-9a7b-d200ef9cc11c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:02.117980 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22dbc030-8746-476e-9a7b-d200ef9cc11c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:02.118653 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22dbc030-8746-476e-9a7b-d200ef9cc11c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:02.443870 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-22dbc030-8746-476e-9a7b-d200ef9cc11c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:02.451902 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-22dbc030-8746-476e-9a7b-d200ef9cc11c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1315 microversion: 2.1 time: 0.366858 Sep 24 21:00:02.452627 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1425/2853] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:02 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:02.472553 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-97c8b704-bc01-4d03-a0d0-e9178f2d1a6a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:02.473165 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-97c8b704-bc01-4d03-a0d0-e9178f2d1a6a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:02.479326 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97c8b704-bc01-4d03-a0d0-e9178f2d1a6a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:02.479835 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97c8b704-bc01-4d03-a0d0-e9178f2d1a6a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:02.480251 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97c8b704-bc01-4d03-a0d0-e9178f2d1a6a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:02.480940 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97c8b704-bc01-4d03-a0d0-e9178f2d1a6a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:02.481396 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97c8b704-bc01-4d03-a0d0-e9178f2d1a6a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:02.481822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97c8b704-bc01-4d03-a0d0-e9178f2d1a6a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:02.580725 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-97c8b704-bc01-4d03-a0d0-e9178f2d1a6a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:02.589402 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-97c8b704-bc01-4d03-a0d0-e9178f2d1a6a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:02.591096 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-97c8b704-bc01-4d03-a0d0-e9178f2d1a6a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:02.596771 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-97c8b704-bc01-4d03-a0d0-e9178f2d1a6a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1446 microversion: 2.75 time: 0.128897 Sep 24 21:00:02.597487 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1426/2854] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:00:02 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1446 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:00:02.602366 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-87130fb1-828a-432e-885a-99584cecf6c8 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:02.603020 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-87130fb1-828a-432e-885a-99584cecf6c8 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 1cceb126-5c30-4c10-b02f-f6a27a7420c8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:02.609168 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-87130fb1-828a-432e-885a-99584cecf6c8 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:02.610028 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-87130fb1-828a-432e-885a-99584cecf6c8 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:02.610742 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-87130fb1-828a-432e-885a-99584cecf6c8 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:02.611694 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-87130fb1-828a-432e-885a-99584cecf6c8 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:02.612379 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-87130fb1-828a-432e-885a-99584cecf6c8 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:02.613273 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-87130fb1-828a-432e-885a-99584cecf6c8 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:02.939911 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-f72ef802-0b81-463f-89cc-ae16694329a4 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:00:02.940400 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-f72ef802-0b81-463f-89cc-ae16694329a4 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:00:02.941297 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-f72ef802-0b81-463f-89cc-ae16694329a4 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:00:02.941731 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-f72ef802-0b81-463f-89cc-ae16694329a4 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:00:02.942157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-f72ef802-0b81-463f-89cc-ae16694329a4 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:00:02.953674 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f72ef802-0b81-463f-89cc-ae16694329a4 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:02.954248 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f72ef802-0b81-463f-89cc-ae16694329a4 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:02.954962 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f72ef802-0b81-463f-89cc-ae16694329a4 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:02.955952 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f72ef802-0b81-463f-89cc-ae16694329a4 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:02.956598 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f72ef802-0b81-463f-89cc-ae16694329a4 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:02.957245 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f72ef802-0b81-463f-89cc-ae16694329a4 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:02.983207 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-87130fb1-828a-432e-885a-99584cecf6c8 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddab9c74c004e74a51fd8008886e542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdf8ae7524612b9c2f6a3f16c39ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:02.992457 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-f72ef802-0b81-463f-89cc-ae16694329a4 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Getting quotas for project 18a512ecd53242fb8dd25a0367ae8180. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:00:02.999709 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-f72ef802-0b81-463f-89cc-ae16694329a4 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Getting quotas for user 81a689c647524dfdb492184b90c53b05 and project 18a512ecd53242fb8dd25a0367ae8180. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:00:03.002958 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-87130fb1-828a-432e-885a-99584cecf6c8 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8" status: 200 len: 1315 microversion: 2.1 time: 0.397275 Sep 24 21:00:03.003866 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1427/2855] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:02 2022] GET /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8 => generated 1315 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:03.010230 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8e9ef55e-7b37-4522-be27-8d65e306980d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:03.013311 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8e9ef55e-7b37-4522-be27-8d65e306980d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:03.019902 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f72ef802-0b81-463f-89cc-ae16694329a4 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:00:03.027430 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f72ef802-0b81-463f-89cc-ae16694329a4 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] [instance: 6f34bc2b-5e80-41a6-8898-7ca853cb26ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:00:03.052406 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8e9ef55e-7b37-4522-be27-8d65e306980d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:03.052911 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8e9ef55e-7b37-4522-be27-8d65e306980d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:03.053360 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8e9ef55e-7b37-4522-be27-8d65e306980d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:03.054330 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8e9ef55e-7b37-4522-be27-8d65e306980d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:03.054566 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8e9ef55e-7b37-4522-be27-8d65e306980d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:03.055010 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8e9ef55e-7b37-4522-be27-8d65e306980d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:03.130007 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8e9ef55e-7b37-4522-be27-8d65e306980d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.124613 Sep 24 21:00:03.138559 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1428/2856] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:00:03 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:00:03.143569 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ed0a1beb-37ae-4b48-94cd-72d3e8380385 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:03.144200 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ed0a1beb-37ae-4b48-94cd-72d3e8380385 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:03.144906 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f72ef802-0b81-463f-89cc-ae16694329a4 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.603221 Sep 24 21:00:03.145980 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1429/2857] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:00:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:00:03.160627 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a23d825e-2441-4571-bad8-a3f7e60ffc60 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:03.161738 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a23d825e-2441-4571-bad8-a3f7e60ffc60 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] [instance: 6f34bc2b-5e80-41a6-8898-7ca853cb26ab] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:03.163560 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:00:03.164359 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:00:03.165996 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed0a1beb-37ae-4b48-94cd-72d3e8380385 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:03.171792 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed0a1beb-37ae-4b48-94cd-72d3e8380385 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:03.172479 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed0a1beb-37ae-4b48-94cd-72d3e8380385 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:03.173418 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed0a1beb-37ae-4b48-94cd-72d3e8380385 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:03.174041 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed0a1beb-37ae-4b48-94cd-72d3e8380385 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:03.174673 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed0a1beb-37ae-4b48-94cd-72d3e8380385 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:03.217691 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:00:03.307134 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a23d825e-2441-4571-bad8-a3f7e60ffc60 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a689c647524dfdb492184b90c53b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a512ecd53242fb8dd25a0367ae8180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:03.316026 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a23d825e-2441-4571-bad8-a3f7e60ffc60 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] 10.222.0.52 "GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab" status: 200 len: 1224 microversion: 2.1 time: 0.161494 Sep 24 21:00:03.317301 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1430/2858] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:03 2022] GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab => generated 1224 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:03.475044 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ebe28ccb-15ee-4fd7-aa2b-1058fe552b4e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:03.476056 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ebe28ccb-15ee-4fd7-aa2b-1058fe552b4e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:03.483975 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ebe28ccb-15ee-4fd7-aa2b-1058fe552b4e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:03.486077 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ebe28ccb-15ee-4fd7-aa2b-1058fe552b4e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:03.486682 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ebe28ccb-15ee-4fd7-aa2b-1058fe552b4e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:03.487704 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ebe28ccb-15ee-4fd7-aa2b-1058fe552b4e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:03.493264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ebe28ccb-15ee-4fd7-aa2b-1058fe552b4e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:03.493900 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ebe28ccb-15ee-4fd7-aa2b-1058fe552b4e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:03.502206 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=8 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:00:03.643797 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ed0a1beb-37ae-4b48-94cd-72d3e8380385 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:03.653102 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ed0a1beb-37ae-4b48-94cd-72d3e8380385 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1515 microversion: 2.1 time: 0.513386 Sep 24 21:00:03.653880 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1429/2859] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:03 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1515 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:03.666093 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1f39a051-95ef-4a9f-8595-45952452fb5e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:03.666942 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1f39a051-95ef-4a9f-8595-45952452fb5e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:03.680583 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1f39a051-95ef-4a9f-8595-45952452fb5e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:03.681081 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1f39a051-95ef-4a9f-8595-45952452fb5e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:03.681517 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1f39a051-95ef-4a9f-8595-45952452fb5e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:03.683917 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1f39a051-95ef-4a9f-8595-45952452fb5e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:03.690114 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1f39a051-95ef-4a9f-8595-45952452fb5e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:03.690934 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1f39a051-95ef-4a9f-8595-45952452fb5e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:03.814372 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1f39a051-95ef-4a9f-8595-45952452fb5e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:03.829702 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1f39a051-95ef-4a9f-8595-45952452fb5e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:03.831607 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1f39a051-95ef-4a9f-8595-45952452fb5e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:03.846332 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1f39a051-95ef-4a9f-8595-45952452fb5e tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1446 microversion: 2.75 time: 0.186873 Sep 24 21:00:03.859815 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1430/2860] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:00:03 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1446 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:00:03.937539 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ebe28ccb-15ee-4fd7-aa2b-1058fe552b4e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:03.951767 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ebe28ccb-15ee-4fd7-aa2b-1058fe552b4e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1315 microversion: 2.1 time: 0.480543 Sep 24 21:00:03.952955 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1431/2861] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:03 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1315 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:00:04.033425 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8b21a789-fed5-4240-a227-72f87ab995cd tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:04.034112 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8b21a789-fed5-4240-a227-72f87ab995cd tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 1cceb126-5c30-4c10-b02f-f6a27a7420c8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:04.052230 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8b21a789-fed5-4240-a227-72f87ab995cd tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:04.052762 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8b21a789-fed5-4240-a227-72f87ab995cd tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:04.053229 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8b21a789-fed5-4240-a227-72f87ab995cd tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:04.053961 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8b21a789-fed5-4240-a227-72f87ab995cd tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:04.054487 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8b21a789-fed5-4240-a227-72f87ab995cd tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:04.054902 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8b21a789-fed5-4240-a227-72f87ab995cd tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:04.149372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-05c05b69-4369-4759-9484-19a739f0f55c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:04.160411 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-05c05b69-4369-4759-9484-19a739f0f55c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:04.180360 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05c05b69-4369-4759-9484-19a739f0f55c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:04.188073 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05c05b69-4369-4759-9484-19a739f0f55c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:04.190354 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05c05b69-4369-4759-9484-19a739f0f55c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:04.191310 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05c05b69-4369-4759-9484-19a739f0f55c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:04.192262 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05c05b69-4369-4759-9484-19a739f0f55c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:04.192986 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05c05b69-4369-4759-9484-19a739f0f55c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:04.331139 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-05c05b69-4369-4759-9484-19a739f0f55c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.187656 Sep 24 21:00:04.338805 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1432/2862] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:00:04 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:00:04.353452 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-83de16fe-9eaf-446c-9ed1-46b0877c3fc7 req-05d9e0d7-3e9c-4ae0-8548-afd3c3c49af4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cceb126-5c30-4c10-b02f-f6a27a7420c8", "tag": "6b1365fd-2a04-4e08-a3e1-a17d262f6e80"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:04.371339 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-83de16fe-9eaf-446c-9ed1-46b0877c3fc7 req-05d9e0d7-3e9c-4ae0-8548-afd3c3c49af4 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:04.372125 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-83de16fe-9eaf-446c-9ed1-46b0877c3fc7 req-05d9e0d7-3e9c-4ae0-8548-afd3c3c49af4 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:04.372824 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-83de16fe-9eaf-446c-9ed1-46b0877c3fc7 req-05d9e0d7-3e9c-4ae0-8548-afd3c3c49af4 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:04.395317 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8b21a789-fed5-4240-a227-72f87ab995cd tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddab9c74c004e74a51fd8008886e542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdf8ae7524612b9c2f6a3f16c39ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:04.396498 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-83de16fe-9eaf-446c-9ed1-46b0877c3fc7 req-05d9e0d7-3e9c-4ae0-8548-afd3c3c49af4 service nova] Creating event network-changed:6b1365fd-2a04-4e08-a3e1-a17d262f6e80 for instance 1cceb126-5c30-4c10-b02f-f6a27a7420c8 on nch2-master-1 Sep 24 21:00:04.403107 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-83de16fe-9eaf-446c-9ed1-46b0877c3fc7 req-05d9e0d7-3e9c-4ae0-8548-afd3c3c49af4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056439 Sep 24 21:00:04.403998 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1433/2863] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:00:04.411689 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8b21a789-fed5-4240-a227-72f87ab995cd tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8" status: 200 len: 1315 microversion: 2.1 time: 0.383493 Sep 24 21:00:04.412295 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1431/2864] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:04 2022] GET /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8 => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:04.424598 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e4661b8c-c01a-4c11-b56a-83001f07f711 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:04.425681 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e4661b8c-c01a-4c11-b56a-83001f07f711 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] [instance: 6f34bc2b-5e80-41a6-8898-7ca853cb26ab] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:04.440058 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e4661b8c-c01a-4c11-b56a-83001f07f711 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:04.447080 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e4661b8c-c01a-4c11-b56a-83001f07f711 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:04.447689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e4661b8c-c01a-4c11-b56a-83001f07f711 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:04.448551 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e4661b8c-c01a-4c11-b56a-83001f07f711 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:04.449159 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e4661b8c-c01a-4c11-b56a-83001f07f711 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:04.449691 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e4661b8c-c01a-4c11-b56a-83001f07f711 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:04.552655 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e4661b8c-c01a-4c11-b56a-83001f07f711 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a689c647524dfdb492184b90c53b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a512ecd53242fb8dd25a0367ae8180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:04.561313 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e4661b8c-c01a-4c11-b56a-83001f07f711 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] 10.222.0.52 "GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab" status: 200 len: 1228 microversion: 2.1 time: 0.154680 Sep 24 21:00:04.563244 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1434/2865] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:04 2022] GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab => generated 1228 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:04.682446 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2c601fcc-647b-4300-b7f7-19f284c81a37 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:04.683369 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2c601fcc-647b-4300-b7f7-19f284c81a37 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:04.693256 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c601fcc-647b-4300-b7f7-19f284c81a37 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:04.694798 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c601fcc-647b-4300-b7f7-19f284c81a37 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:04.695496 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c601fcc-647b-4300-b7f7-19f284c81a37 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:04.696941 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c601fcc-647b-4300-b7f7-19f284c81a37 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:04.697594 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c601fcc-647b-4300-b7f7-19f284c81a37 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:04.698236 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c601fcc-647b-4300-b7f7-19f284c81a37 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:04.875575 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ea228b00-8527-432c-8fed-84be3a689765 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:04.877394 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ea228b00-8527-432c-8fed-84be3a689765 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:04.893951 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea228b00-8527-432c-8fed-84be3a689765 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:04.894869 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea228b00-8527-432c-8fed-84be3a689765 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:04.895875 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea228b00-8527-432c-8fed-84be3a689765 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:04.898853 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea228b00-8527-432c-8fed-84be3a689765 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:04.900137 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea228b00-8527-432c-8fed-84be3a689765 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:04.902069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea228b00-8527-432c-8fed-84be3a689765 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:04.945545 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2c601fcc-647b-4300-b7f7-19f284c81a37 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:04.967210 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2c601fcc-647b-4300-b7f7-19f284c81a37 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1515 microversion: 2.1 time: 0.290354 Sep 24 21:00:04.969909 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1432/2866] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:04 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1515 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:00:04.985320 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-49fc91f3-2a34-4de1-beff-1ed39bf0af01 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:04.987703 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-49fc91f3-2a34-4de1-beff-1ed39bf0af01 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:05.005197 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-49fc91f3-2a34-4de1-beff-1ed39bf0af01 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:05.007628 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-49fc91f3-2a34-4de1-beff-1ed39bf0af01 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:05.008953 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-49fc91f3-2a34-4de1-beff-1ed39bf0af01 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:05.010145 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-49fc91f3-2a34-4de1-beff-1ed39bf0af01 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:05.012307 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-49fc91f3-2a34-4de1-beff-1ed39bf0af01 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:05.013926 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-49fc91f3-2a34-4de1-beff-1ed39bf0af01 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:05.113445 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ea228b00-8527-432c-8fed-84be3a689765 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:05.123478 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ea228b00-8527-432c-8fed-84be3a689765 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:05.133187 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ea228b00-8527-432c-8fed-84be3a689765 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:05.146212 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ea228b00-8527-432c-8fed-84be3a689765 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1446 microversion: 2.75 time: 0.275978 Sep 24 21:00:05.154679 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1435/2867] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:00:04 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1446 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:00:05.350886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-115d8ba0-cd1d-472d-b35a-236bdc0512f8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:05.353578 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-115d8ba0-cd1d-472d-b35a-236bdc0512f8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:05.367759 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-115d8ba0-cd1d-472d-b35a-236bdc0512f8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:05.369181 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-115d8ba0-cd1d-472d-b35a-236bdc0512f8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:05.370345 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-115d8ba0-cd1d-472d-b35a-236bdc0512f8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:05.372353 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-115d8ba0-cd1d-472d-b35a-236bdc0512f8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:05.373038 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-115d8ba0-cd1d-472d-b35a-236bdc0512f8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:05.373668 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-115d8ba0-cd1d-472d-b35a-236bdc0512f8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:05.408819 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:00:05.425152 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-115d8ba0-cd1d-472d-b35a-236bdc0512f8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.082926 Sep 24 21:00:05.426007 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1436/2868] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:00:05 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:00:05.449141 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9a6833a4-4266-4f11-88c7-a204296e0d48 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:05.454845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9a6833a4-4266-4f11-88c7-a204296e0d48 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 1cceb126-5c30-4c10-b02f-f6a27a7420c8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:05.464981 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9a6833a4-4266-4f11-88c7-a204296e0d48 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:05.465575 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9a6833a4-4266-4f11-88c7-a204296e0d48 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:05.466229 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9a6833a4-4266-4f11-88c7-a204296e0d48 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:05.467308 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9a6833a4-4266-4f11-88c7-a204296e0d48 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:05.468509 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9a6833a4-4266-4f11-88c7-a204296e0d48 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:05.469157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9a6833a4-4266-4f11-88c7-a204296e0d48 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:05.712833 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-49fc91f3-2a34-4de1-beff-1ed39bf0af01 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:05.727088 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-49fc91f3-2a34-4de1-beff-1ed39bf0af01 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1315 microversion: 2.1 time: 0.752403 Sep 24 21:00:05.728744 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1433/2869] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:04 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1315 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:05.738681 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9a6833a4-4266-4f11-88c7-a204296e0d48 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddab9c74c004e74a51fd8008886e542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdf8ae7524612b9c2f6a3f16c39ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:05.747366 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9a6833a4-4266-4f11-88c7-a204296e0d48 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8" status: 200 len: 1315 microversion: 2.1 time: 0.305031 Sep 24 21:00:05.754677 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1437/2870] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:05 2022] GET /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8 => generated 1315 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:05.755330 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f842eaf6-358b-4d4d-ac38-605d48aafc89 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:05.759715 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f842eaf6-358b-4d4d-ac38-605d48aafc89 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] [instance: 6f34bc2b-5e80-41a6-8898-7ca853cb26ab] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:05.769926 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f842eaf6-358b-4d4d-ac38-605d48aafc89 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:05.775094 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f842eaf6-358b-4d4d-ac38-605d48aafc89 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:05.775732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f842eaf6-358b-4d4d-ac38-605d48aafc89 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:05.776677 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f842eaf6-358b-4d4d-ac38-605d48aafc89 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:05.777296 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f842eaf6-358b-4d4d-ac38-605d48aafc89 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:05.777884 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f842eaf6-358b-4d4d-ac38-605d48aafc89 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:05.888952 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f842eaf6-358b-4d4d-ac38-605d48aafc89 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a689c647524dfdb492184b90c53b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a512ecd53242fb8dd25a0367ae8180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:05.900724 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f842eaf6-358b-4d4d-ac38-605d48aafc89 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] 10.222.0.52 "GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab" status: 200 len: 1276 microversion: 2.1 time: 0.170434 Sep 24 21:00:05.902187 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1434/2871] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:05 2022] GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab => generated 1276 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:05.993776 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8bcd8f60-5dc0-48d3-9073-ea97a830d57c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:05.994676 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8bcd8f60-5dc0-48d3-9073-ea97a830d57c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:06.005808 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8bcd8f60-5dc0-48d3-9073-ea97a830d57c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:06.009776 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8bcd8f60-5dc0-48d3-9073-ea97a830d57c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:06.010224 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8bcd8f60-5dc0-48d3-9073-ea97a830d57c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:06.010997 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8bcd8f60-5dc0-48d3-9073-ea97a830d57c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:06.011465 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8bcd8f60-5dc0-48d3-9073-ea97a830d57c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:06.012370 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8bcd8f60-5dc0-48d3-9073-ea97a830d57c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:06.173308 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8bcd8f60-5dc0-48d3-9073-ea97a830d57c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:06.182844 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-574c1c70-d679-4af0-9b9c-dffe2be1d23f tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:06.183483 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-574c1c70-d679-4af0-9b9c-dffe2be1d23f tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:06.187276 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8bcd8f60-5dc0-48d3-9073-ea97a830d57c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1521 microversion: 2.1 time: 0.196637 Sep 24 21:00:06.198872 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-574c1c70-d679-4af0-9b9c-dffe2be1d23f tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:06.198872 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-574c1c70-d679-4af0-9b9c-dffe2be1d23f tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:06.198872 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-574c1c70-d679-4af0-9b9c-dffe2be1d23f tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:06.198872 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-574c1c70-d679-4af0-9b9c-dffe2be1d23f tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:06.200249 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1438/2872] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:05 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:06.208313 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-574c1c70-d679-4af0-9b9c-dffe2be1d23f tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:06.208933 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-574c1c70-d679-4af0-9b9c-dffe2be1d23f tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:06.305139 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-574c1c70-d679-4af0-9b9c-dffe2be1d23f tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:06.316792 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-574c1c70-d679-4af0-9b9c-dffe2be1d23f tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:06.318376 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-574c1c70-d679-4af0-9b9c-dffe2be1d23f tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:06.326370 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-574c1c70-d679-4af0-9b9c-dffe2be1d23f tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1446 microversion: 2.75 time: 0.147975 Sep 24 21:00:06.327960 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1435/2873] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:00:06 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1446 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:00:06.439970 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9fce7048-d0ad-4758-a563-a8a2ae38ff0f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:06.443429 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9fce7048-d0ad-4758-a563-a8a2ae38ff0f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:06.451749 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9fce7048-d0ad-4758-a563-a8a2ae38ff0f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:06.452975 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9fce7048-d0ad-4758-a563-a8a2ae38ff0f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:06.463288 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9fce7048-d0ad-4758-a563-a8a2ae38ff0f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:06.464836 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9fce7048-d0ad-4758-a563-a8a2ae38ff0f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:06.465994 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9fce7048-d0ad-4758-a563-a8a2ae38ff0f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:06.467183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9fce7048-d0ad-4758-a563-a8a2ae38ff0f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:06.505112 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9fce7048-d0ad-4758-a563-a8a2ae38ff0f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.070734 Sep 24 21:00:06.505930 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1439/2874] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:00:06 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:00:06.753158 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-22e4c740-783b-4144-a6cd-6ac3030294e6 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:06.753795 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-22e4c740-783b-4144-a6cd-6ac3030294e6 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:06.761370 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22e4c740-783b-4144-a6cd-6ac3030294e6 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:06.761877 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22e4c740-783b-4144-a6cd-6ac3030294e6 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:06.762329 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22e4c740-783b-4144-a6cd-6ac3030294e6 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:06.763201 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22e4c740-783b-4144-a6cd-6ac3030294e6 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:06.763675 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22e4c740-783b-4144-a6cd-6ac3030294e6 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:06.764136 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22e4c740-783b-4144-a6cd-6ac3030294e6 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:06.780125 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a8ef96d5-39e9-4de9-95d6-8ffddae928c6 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:06.782868 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a8ef96d5-39e9-4de9-95d6-8ffddae928c6 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 1cceb126-5c30-4c10-b02f-f6a27a7420c8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:06.795870 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a8ef96d5-39e9-4de9-95d6-8ffddae928c6 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:06.797384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a8ef96d5-39e9-4de9-95d6-8ffddae928c6 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:06.798043 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a8ef96d5-39e9-4de9-95d6-8ffddae928c6 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:06.799313 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a8ef96d5-39e9-4de9-95d6-8ffddae928c6 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:06.800025 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a8ef96d5-39e9-4de9-95d6-8ffddae928c6 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:06.800668 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a8ef96d5-39e9-4de9-95d6-8ffddae928c6 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:06.997171 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-22e4c740-783b-4144-a6cd-6ac3030294e6 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:07.009369 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-22e4c740-783b-4144-a6cd-6ac3030294e6 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1315 microversion: 2.1 time: 0.260893 Sep 24 21:00:07.010968 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1436/2875] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:06 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:07.019060 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1e62079e-2abf-4203-9d8b-20dcb3b258f5 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:07.020205 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1e62079e-2abf-4203-9d8b-20dcb3b258f5 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] [instance: 6f34bc2b-5e80-41a6-8898-7ca853cb26ab] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:07.029475 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a8ef96d5-39e9-4de9-95d6-8ffddae928c6 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddab9c74c004e74a51fd8008886e542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdf8ae7524612b9c2f6a3f16c39ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:07.036970 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e62079e-2abf-4203-9d8b-20dcb3b258f5 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:07.038075 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e62079e-2abf-4203-9d8b-20dcb3b258f5 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:07.038859 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e62079e-2abf-4203-9d8b-20dcb3b258f5 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:07.039777 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e62079e-2abf-4203-9d8b-20dcb3b258f5 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:07.040219 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a8ef96d5-39e9-4de9-95d6-8ffddae928c6 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8" status: 200 len: 1315 microversion: 2.1 time: 0.264794 Sep 24 21:00:07.040603 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e62079e-2abf-4203-9d8b-20dcb3b258f5 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:07.041208 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e62079e-2abf-4203-9d8b-20dcb3b258f5 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:07.041404 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1440/2876] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:06 2022] GET /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:07.091645 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-1ad4e167-b0e0-4eee-ae1d-cc9abf8ae07d req-34ee408f-c7f9-418c-8db8-0e0114886f42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c96f88e-1327-49e3-8e9a-5417f96fb308", "name": "network-vif-plugged", "status": "completed", "tag": "f8825c51-2e9d-4429-9259-cd32e621d907"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:07.101797 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1ad4e167-b0e0-4eee-ae1d-cc9abf8ae07d req-34ee408f-c7f9-418c-8db8-0e0114886f42 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:07.102388 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1ad4e167-b0e0-4eee-ae1d-cc9abf8ae07d req-34ee408f-c7f9-418c-8db8-0e0114886f42 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:07.103202 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1ad4e167-b0e0-4eee-ae1d-cc9abf8ae07d req-34ee408f-c7f9-418c-8db8-0e0114886f42 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:07.116764 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-1ad4e167-b0e0-4eee-ae1d-cc9abf8ae07d req-34ee408f-c7f9-418c-8db8-0e0114886f42 service nova] Creating event network-vif-plugged:f8825c51-2e9d-4429-9259-cd32e621d907 for instance 9c96f88e-1327-49e3-8e9a-5417f96fb308 on nch2-master-1 Sep 24 21:00:07.122335 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-1ad4e167-b0e0-4eee-ae1d-cc9abf8ae07d req-34ee408f-c7f9-418c-8db8-0e0114886f42 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034354 Sep 24 21:00:07.123676 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1441/2877] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:00:07.131276 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1e62079e-2abf-4203-9d8b-20dcb3b258f5 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a689c647524dfdb492184b90c53b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a512ecd53242fb8dd25a0367ae8180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:07.139183 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1e62079e-2abf-4203-9d8b-20dcb3b258f5 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] 10.222.0.52 "GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab" status: 200 len: 1284 microversion: 2.1 time: 0.126709 Sep 24 21:00:07.139731 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1437/2878] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:07 2022] GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab => generated 1284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:07.216647 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-372519fb-bacd-4e10-9f7d-e6ebdd825786 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:07.218745 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-372519fb-bacd-4e10-9f7d-e6ebdd825786 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:07.227036 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-372519fb-bacd-4e10-9f7d-e6ebdd825786 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:07.227876 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-372519fb-bacd-4e10-9f7d-e6ebdd825786 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:07.229239 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-372519fb-bacd-4e10-9f7d-e6ebdd825786 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:07.230516 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-372519fb-bacd-4e10-9f7d-e6ebdd825786 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:07.231298 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-372519fb-bacd-4e10-9f7d-e6ebdd825786 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:07.231990 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-372519fb-bacd-4e10-9f7d-e6ebdd825786 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:07.355996 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a4c7447c-dd77-43bb-befa-b8bc93c9fa2a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:07.356871 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a4c7447c-dd77-43bb-befa-b8bc93c9fa2a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:07.365862 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4c7447c-dd77-43bb-befa-b8bc93c9fa2a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:07.366667 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4c7447c-dd77-43bb-befa-b8bc93c9fa2a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:07.367276 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4c7447c-dd77-43bb-befa-b8bc93c9fa2a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:07.368161 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4c7447c-dd77-43bb-befa-b8bc93c9fa2a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:07.368780 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4c7447c-dd77-43bb-befa-b8bc93c9fa2a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:07.369371 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4c7447c-dd77-43bb-befa-b8bc93c9fa2a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:07.433650 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-372519fb-bacd-4e10-9f7d-e6ebdd825786 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:07.443692 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-372519fb-bacd-4e10-9f7d-e6ebdd825786 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1521 microversion: 2.1 time: 0.233610 Sep 24 21:00:07.444527 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1442/2879] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:07 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:07.479379 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a4c7447c-dd77-43bb-befa-b8bc93c9fa2a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:07.488527 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a4c7447c-dd77-43bb-befa-b8bc93c9fa2a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:07.490337 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a4c7447c-dd77-43bb-befa-b8bc93c9fa2a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:07.495590 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a4c7447c-dd77-43bb-befa-b8bc93c9fa2a tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1446 microversion: 2.75 time: 0.143933 Sep 24 21:00:07.496300 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1438/2880] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:00:07 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1446 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:00:07.518165 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-521b6f47-693d-4f85-9997-76026bd59505 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:07.520963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-521b6f47-693d-4f85-9997-76026bd59505 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:07.531824 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-521b6f47-693d-4f85-9997-76026bd59505 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:07.532619 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-521b6f47-693d-4f85-9997-76026bd59505 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:07.533288 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-521b6f47-693d-4f85-9997-76026bd59505 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:07.535570 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-521b6f47-693d-4f85-9997-76026bd59505 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:07.536235 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-521b6f47-693d-4f85-9997-76026bd59505 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:07.537998 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-521b6f47-693d-4f85-9997-76026bd59505 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:07.576213 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-521b6f47-693d-4f85-9997-76026bd59505 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.062391 Sep 24 21:00:07.576874 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1443/2881] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:00:07 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:00:08.038095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4d7278e5-343c-43f6-bc6f-7ff80e962fe5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:08.039600 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4d7278e5-343c-43f6-bc6f-7ff80e962fe5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:08.046834 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4d7278e5-343c-43f6-bc6f-7ff80e962fe5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:08.047647 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4d7278e5-343c-43f6-bc6f-7ff80e962fe5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:08.048155 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4d7278e5-343c-43f6-bc6f-7ff80e962fe5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:08.048951 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4d7278e5-343c-43f6-bc6f-7ff80e962fe5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:08.049617 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4d7278e5-343c-43f6-bc6f-7ff80e962fe5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:08.050269 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4d7278e5-343c-43f6-bc6f-7ff80e962fe5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:08.075035 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a7ea2c2c-82f5-47bb-914c-f8900cf2ae12 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:08.079827 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a7ea2c2c-82f5-47bb-914c-f8900cf2ae12 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 1cceb126-5c30-4c10-b02f-f6a27a7420c8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:08.123473 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a7ea2c2c-82f5-47bb-914c-f8900cf2ae12 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:08.123870 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a7ea2c2c-82f5-47bb-914c-f8900cf2ae12 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:08.124917 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a7ea2c2c-82f5-47bb-914c-f8900cf2ae12 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:08.125660 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a7ea2c2c-82f5-47bb-914c-f8900cf2ae12 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:08.126120 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a7ea2c2c-82f5-47bb-914c-f8900cf2ae12 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:08.126623 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a7ea2c2c-82f5-47bb-914c-f8900cf2ae12 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:08.324287 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4d7278e5-343c-43f6-bc6f-7ff80e962fe5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:08.336216 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4d7278e5-343c-43f6-bc6f-7ff80e962fe5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1315 microversion: 2.1 time: 0.302224 Sep 24 21:00:08.337121 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1439/2882] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:08 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:08.353311 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7849d0e1-6a3c-42cd-b98c-2907a3ba6aec tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:08.356806 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7849d0e1-6a3c-42cd-b98c-2907a3ba6aec tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] [instance: 6f34bc2b-5e80-41a6-8898-7ca853cb26ab] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:08.381137 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a7ea2c2c-82f5-47bb-914c-f8900cf2ae12 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddab9c74c004e74a51fd8008886e542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdf8ae7524612b9c2f6a3f16c39ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:08.386529 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7849d0e1-6a3c-42cd-b98c-2907a3ba6aec tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:08.387054 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7849d0e1-6a3c-42cd-b98c-2907a3ba6aec tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:08.387517 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7849d0e1-6a3c-42cd-b98c-2907a3ba6aec tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:08.388265 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7849d0e1-6a3c-42cd-b98c-2907a3ba6aec tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:08.388733 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7849d0e1-6a3c-42cd-b98c-2907a3ba6aec tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:08.389172 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7849d0e1-6a3c-42cd-b98c-2907a3ba6aec tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:08.391552 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a7ea2c2c-82f5-47bb-914c-f8900cf2ae12 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8" status: 200 len: 1315 microversion: 2.1 time: 0.327312 Sep 24 21:00:08.392321 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1444/2883] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:08 2022] GET /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8 => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:08.480390 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ba7addcb-657b-4ff2-afb0-8537f33fe951 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:08.482744 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ba7addcb-657b-4ff2-afb0-8537f33fe951 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:08.516817 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba7addcb-657b-4ff2-afb0-8537f33fe951 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:08.517570 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba7addcb-657b-4ff2-afb0-8537f33fe951 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:08.520294 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba7addcb-657b-4ff2-afb0-8537f33fe951 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:08.521854 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba7addcb-657b-4ff2-afb0-8537f33fe951 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:08.522950 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba7addcb-657b-4ff2-afb0-8537f33fe951 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:08.523608 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba7addcb-657b-4ff2-afb0-8537f33fe951 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:08.562894 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7849d0e1-6a3c-42cd-b98c-2907a3ba6aec tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a689c647524dfdb492184b90c53b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a512ecd53242fb8dd25a0367ae8180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:08.585827 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7849d0e1-6a3c-42cd-b98c-2907a3ba6aec tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] 10.222.0.52 "GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab" status: 200 len: 1284 microversion: 2.1 time: 0.241088 Sep 24 21:00:08.605577 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1440/2884] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:08 2022] GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab => generated 1284 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:08.616846 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b425d820-b69b-4b3c-9744-6d1a64b8f78f tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:08.617745 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b425d820-b69b-4b3c-9744-6d1a64b8f78f tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:08.631951 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b425d820-b69b-4b3c-9744-6d1a64b8f78f tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:08.632774 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b425d820-b69b-4b3c-9744-6d1a64b8f78f tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:08.633354 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b425d820-b69b-4b3c-9744-6d1a64b8f78f tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:08.634634 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b425d820-b69b-4b3c-9744-6d1a64b8f78f tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:08.635267 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b425d820-b69b-4b3c-9744-6d1a64b8f78f tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:08.635882 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b425d820-b69b-4b3c-9744-6d1a64b8f78f tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:08.800687 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b425d820-b69b-4b3c-9744-6d1a64b8f78f tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:08.818611 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b425d820-b69b-4b3c-9744-6d1a64b8f78f tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:08.820206 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b425d820-b69b-4b3c-9744-6d1a64b8f78f tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:08.829930 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b425d820-b69b-4b3c-9744-6d1a64b8f78f tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1446 microversion: 2.75 time: 0.222685 Sep 24 21:00:08.831147 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1441/2885] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:00:08 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1446 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:00:08.836049 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c0d4e9b4-8553-4727-8127-7498c12b6729 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:08.838531 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c0d4e9b4-8553-4727-8127-7498c12b6729 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:08.844785 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0d4e9b4-8553-4727-8127-7498c12b6729 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:08.845509 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0d4e9b4-8553-4727-8127-7498c12b6729 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:08.846112 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0d4e9b4-8553-4727-8127-7498c12b6729 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:08.847011 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0d4e9b4-8553-4727-8127-7498c12b6729 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:08.847606 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0d4e9b4-8553-4727-8127-7498c12b6729 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:08.848360 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0d4e9b4-8553-4727-8127-7498c12b6729 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:08.883582 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c0d4e9b4-8553-4727-8127-7498c12b6729 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.051072 Sep 24 21:00:08.884337 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1442/2886] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:00:08 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:00:08.918621 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ba7addcb-657b-4ff2-afb0-8537f33fe951 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:08.929085 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ba7addcb-657b-4ff2-afb0-8537f33fe951 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1521 microversion: 2.1 time: 0.464619 Sep 24 21:00:08.930294 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1445/2887] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:08 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1521 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:09.160401 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-62bf56b2-c355-4333-bdf3-4de98b457a0f req-d98a5880-9d17-4b0a-8158-ec9553b68e9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf34d10c-76c3-4798-9a3f-083aeb681fd6", "name": "network-vif-unplugged", "status": "completed", "tag": "e7eddae5-24be-47f8-893f-5fecfb04b6ef"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:09.175337 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-62bf56b2-c355-4333-bdf3-4de98b457a0f req-d98a5880-9d17-4b0a-8158-ec9553b68e9d service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:09.177490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-62bf56b2-c355-4333-bdf3-4de98b457a0f req-d98a5880-9d17-4b0a-8158-ec9553b68e9d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:09.178216 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-62bf56b2-c355-4333-bdf3-4de98b457a0f req-d98a5880-9d17-4b0a-8158-ec9553b68e9d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:09.198888 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-62bf56b2-c355-4333-bdf3-4de98b457a0f req-d98a5880-9d17-4b0a-8158-ec9553b68e9d service nova] Creating event network-vif-unplugged:e7eddae5-24be-47f8-893f-5fecfb04b6ef for instance cf34d10c-76c3-4798-9a3f-083aeb681fd6 on nch1-master-1 Sep 24 21:00:09.208205 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-62bf56b2-c355-4333-bdf3-4de98b457a0f req-d98a5880-9d17-4b0a-8158-ec9553b68e9d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056931 Sep 24 21:00:09.209966 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1443/2888] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:00:09.362821 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-05963a29-0cfd-4c9d-8966-0f3f50397034 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:09.363738 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-05963a29-0cfd-4c9d-8966-0f3f50397034 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:09.370811 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05963a29-0cfd-4c9d-8966-0f3f50397034 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:09.371308 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05963a29-0cfd-4c9d-8966-0f3f50397034 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:09.371946 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05963a29-0cfd-4c9d-8966-0f3f50397034 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:09.372836 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05963a29-0cfd-4c9d-8966-0f3f50397034 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:09.373447 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05963a29-0cfd-4c9d-8966-0f3f50397034 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:09.374591 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05963a29-0cfd-4c9d-8966-0f3f50397034 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:09.391549 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2390025a-ad18-4636-8380-49d1dfe137b1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:09.391549 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2390025a-ad18-4636-8380-49d1dfe137b1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:09.404888 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2390025a-ad18-4636-8380-49d1dfe137b1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:09.406746 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2390025a-ad18-4636-8380-49d1dfe137b1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:09.409431 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2390025a-ad18-4636-8380-49d1dfe137b1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:09.411381 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2390025a-ad18-4636-8380-49d1dfe137b1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:09.412299 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2390025a-ad18-4636-8380-49d1dfe137b1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:09.414426 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2390025a-ad18-4636-8380-49d1dfe137b1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:09.612884 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-05963a29-0cfd-4c9d-8966-0f3f50397034 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:09.622178 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-05963a29-0cfd-4c9d-8966-0f3f50397034 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1502 microversion: 2.1 time: 0.264138 Sep 24 21:00:09.625399 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1446/2889] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:09 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1502 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:09.635635 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-856a2328-250d-47f9-b8f8-fa8c4c373e7e tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:09.638316 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-856a2328-250d-47f9-b8f8-fa8c4c373e7e tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 1cceb126-5c30-4c10-b02f-f6a27a7420c8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:09.653594 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-856a2328-250d-47f9-b8f8-fa8c4c373e7e tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:09.654358 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-856a2328-250d-47f9-b8f8-fa8c4c373e7e tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:09.657577 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-856a2328-250d-47f9-b8f8-fa8c4c373e7e tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:09.658538 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-856a2328-250d-47f9-b8f8-fa8c4c373e7e tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:09.659187 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-856a2328-250d-47f9-b8f8-fa8c4c373e7e tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:09.660660 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-856a2328-250d-47f9-b8f8-fa8c4c373e7e tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:09.731131 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2390025a-ad18-4636-8380-49d1dfe137b1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:09.752397 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2390025a-ad18-4636-8380-49d1dfe137b1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.363254 Sep 24 21:00:09.752397 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1444/2890] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:09 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:09.754967 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-589d088f-a34f-478b-8ab3-0dc995f3dcac tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:09.755546 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-589d088f-a34f-478b-8ab3-0dc995f3dcac tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] [instance: 6f34bc2b-5e80-41a6-8898-7ca853cb26ab] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:09.763291 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-589d088f-a34f-478b-8ab3-0dc995f3dcac tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:09.763795 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-589d088f-a34f-478b-8ab3-0dc995f3dcac tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:09.764249 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-589d088f-a34f-478b-8ab3-0dc995f3dcac tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:09.765778 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-589d088f-a34f-478b-8ab3-0dc995f3dcac tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:09.766264 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-589d088f-a34f-478b-8ab3-0dc995f3dcac tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:09.766744 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-589d088f-a34f-478b-8ab3-0dc995f3dcac tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:09.941728 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-856a2328-250d-47f9-b8f8-fa8c4c373e7e tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddab9c74c004e74a51fd8008886e542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdf8ae7524612b9c2f6a3f16c39ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:09.951146 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-856a2328-250d-47f9-b8f8-fa8c4c373e7e tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8" status: 200 len: 1315 microversion: 2.1 time: 0.321042 Sep 24 21:00:09.951836 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1447/2891] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:09 2022] GET /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8 => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:09.967724 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d2b54f52-1c80-4915-9dfa-638b3e63edf2 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:09.970058 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d2b54f52-1c80-4915-9dfa-638b3e63edf2 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:09.980266 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:00:09.981352 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-589d088f-a34f-478b-8ab3-0dc995f3dcac tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a689c647524dfdb492184b90c53b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a512ecd53242fb8dd25a0367ae8180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:09.982172 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d2b54f52-1c80-4915-9dfa-638b3e63edf2 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:09.982790 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d2b54f52-1c80-4915-9dfa-638b3e63edf2 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:09.983628 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d2b54f52-1c80-4915-9dfa-638b3e63edf2 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:09.984736 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d2b54f52-1c80-4915-9dfa-638b3e63edf2 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:09.985884 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d2b54f52-1c80-4915-9dfa-638b3e63edf2 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:09.986488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d2b54f52-1c80-4915-9dfa-638b3e63edf2 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:09.990477 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-589d088f-a34f-478b-8ab3-0dc995f3dcac tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] 10.222.0.52 "GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab" status: 200 len: 1324 microversion: 2.1 time: 0.238990 Sep 24 21:00:09.994919 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1445/2892] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:09 2022] GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab => generated 1324 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:10.003377 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4ddc4400-2ee3-416a-87ab-652a908e6c3b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:10.004534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4ddc4400-2ee3-416a-87ab-652a908e6c3b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:10.016117 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ddc4400-2ee3-416a-87ab-652a908e6c3b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:10.016886 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ddc4400-2ee3-416a-87ab-652a908e6c3b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:10.017499 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ddc4400-2ee3-416a-87ab-652a908e6c3b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:10.018582 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ddc4400-2ee3-416a-87ab-652a908e6c3b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:10.019954 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ddc4400-2ee3-416a-87ab-652a908e6c3b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:10.021006 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ddc4400-2ee3-416a-87ab-652a908e6c3b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:10.024204 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-d2b54f52-1c80-4915-9dfa-638b3e63edf2 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lazy-loading 'flavor' on Instance uuid 9c96f88e-1327-49e3-8e9a-5417f96fb308 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:00:10.212554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4ddc4400-2ee3-416a-87ab-652a908e6c3b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:10.220455 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:00:10.230604 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4ddc4400-2ee3-416a-87ab-652a908e6c3b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.233293 Sep 24 21:00:10.232381 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1446/2893] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:09 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:10.262383 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3b41fc49-80c0-4221-b6e8-8b5a466f673d tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:10.264602 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3b41fc49-80c0-4221-b6e8-8b5a466f673d tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:10.277211 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3b41fc49-80c0-4221-b6e8-8b5a466f673d tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:10.277919 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3b41fc49-80c0-4221-b6e8-8b5a466f673d tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:10.278543 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3b41fc49-80c0-4221-b6e8-8b5a466f673d tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:10.279433 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3b41fc49-80c0-4221-b6e8-8b5a466f673d tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:10.280134 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3b41fc49-80c0-4221-b6e8-8b5a466f673d tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:10.282002 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3b41fc49-80c0-4221-b6e8-8b5a466f673d tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:10.301203 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d2b54f52-1c80-4915-9dfa-638b3e63edf2 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "POST /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308/action" status: 202 len: 0 microversion: 2.1 time: 0.341102 Sep 24 21:00:10.302724 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1448/2894] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:00:09 2022] POST /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:00:10.326592 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6ebef629-595e-4821-872b-c32dba440224 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:10.336486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6ebef629-595e-4821-872b-c32dba440224 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:10.344748 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ebef629-595e-4821-872b-c32dba440224 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:10.345790 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ebef629-595e-4821-872b-c32dba440224 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:10.346650 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ebef629-595e-4821-872b-c32dba440224 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:10.347561 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ebef629-595e-4821-872b-c32dba440224 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:10.348204 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ebef629-595e-4821-872b-c32dba440224 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:10.349091 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ebef629-595e-4821-872b-c32dba440224 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:10.374007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3b41fc49-80c0-4221-b6e8-8b5a466f673d tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:10.383696 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3b41fc49-80c0-4221-b6e8-8b5a466f673d tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:10.386005 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3b41fc49-80c0-4221-b6e8-8b5a466f673d tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:10.392655 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3b41fc49-80c0-4221-b6e8-8b5a466f673d tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1446 microversion: 2.75 time: 0.143629 Sep 24 21:00:10.393684 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1447/2895] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:00:10 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1446 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:00:10.396383 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6ebef629-595e-4821-872b-c32dba440224 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.092098 Sep 24 21:00:10.401511 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1449/2896] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:00:10 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:00:10.403624 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-eaaaffd3-dde7-44db-97b2-a45fd17d3628 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:10.404353 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-eaaaffd3-dde7-44db-97b2-a45fd17d3628 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:10.405138 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8f947280-69db-4793-addf-1b64b74a4ef9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:10.407492 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8f947280-69db-4793-addf-1b64b74a4ef9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:10.414240 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eaaaffd3-dde7-44db-97b2-a45fd17d3628 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:10.414937 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eaaaffd3-dde7-44db-97b2-a45fd17d3628 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:10.415619 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eaaaffd3-dde7-44db-97b2-a45fd17d3628 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:10.416485 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eaaaffd3-dde7-44db-97b2-a45fd17d3628 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:10.416823 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8f947280-69db-4793-addf-1b64b74a4ef9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:10.417158 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eaaaffd3-dde7-44db-97b2-a45fd17d3628 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:10.417684 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eaaaffd3-dde7-44db-97b2-a45fd17d3628 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:10.418410 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8f947280-69db-4793-addf-1b64b74a4ef9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:10.419217 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8f947280-69db-4793-addf-1b64b74a4ef9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:10.420127 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8f947280-69db-4793-addf-1b64b74a4ef9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:10.420737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8f947280-69db-4793-addf-1b64b74a4ef9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:10.421955 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8f947280-69db-4793-addf-1b64b74a4ef9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:10.737725 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8f947280-69db-4793-addf-1b64b74a4ef9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:10.743284 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-eaaaffd3-dde7-44db-97b2-a45fd17d3628 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:10.747036 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8f947280-69db-4793-addf-1b64b74a4ef9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1521 microversion: 2.1 time: 0.352026 Sep 24 21:00:10.762937 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1448/2897] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:10 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1521 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:10.762937 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d219cd92-228a-4151-b38d-35e7957afb98 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:10.762937 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d219cd92-228a-4151-b38d-35e7957afb98 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:10.764065 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d219cd92-228a-4151-b38d-35e7957afb98 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:10.764626 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d219cd92-228a-4151-b38d-35e7957afb98 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:10.765128 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d219cd92-228a-4151-b38d-35e7957afb98 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:10.765900 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d219cd92-228a-4151-b38d-35e7957afb98 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:10.766366 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d219cd92-228a-4151-b38d-35e7957afb98 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:10.767117 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d219cd92-228a-4151-b38d-35e7957afb98 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:10.772143 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-eaaaffd3-dde7-44db-97b2-a45fd17d3628 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.372570 Sep 24 21:00:10.773558 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1450/2898] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:10 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:10.791720 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-1826a90a-b2ad-4db1-b175-e37ee15a483f req-1b82f29f-2941-4691-a533-6973ecc2abc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f34bc2b-5e80-41a6-8898-7ca853cb26ab", "tag": "1a0c9d51-1224-48c7-935d-37553afea2e7"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:10.807407 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1826a90a-b2ad-4db1-b175-e37ee15a483f req-1b82f29f-2941-4691-a533-6973ecc2abc1 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:10.812928 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1826a90a-b2ad-4db1-b175-e37ee15a483f req-1b82f29f-2941-4691-a533-6973ecc2abc1 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:10.813579 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1826a90a-b2ad-4db1-b175-e37ee15a483f req-1b82f29f-2941-4691-a533-6973ecc2abc1 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:10.835269 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-1826a90a-b2ad-4db1-b175-e37ee15a483f req-1b82f29f-2941-4691-a533-6973ecc2abc1 service nova] Creating event network-changed:1a0c9d51-1224-48c7-935d-37553afea2e7 for instance 6f34bc2b-5e80-41a6-8898-7ca853cb26ab on nch1-master-1 Sep 24 21:00:10.841877 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-1826a90a-b2ad-4db1-b175-e37ee15a483f req-1b82f29f-2941-4691-a533-6973ecc2abc1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053590 Sep 24 21:00:10.842486 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1451/2899] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:00:10.849560 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a62a5e80-9a9b-4102-8e65-0f0a1bf5115c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-2112509374"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:10.852167 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a62a5e80-9a9b-4102-8e65-0f0a1bf5115c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:10.860282 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a62a5e80-9a9b-4102-8e65-0f0a1bf5115c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:10.861041 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a62a5e80-9a9b-4102-8e65-0f0a1bf5115c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:10.861896 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a62a5e80-9a9b-4102-8e65-0f0a1bf5115c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:10.862776 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a62a5e80-9a9b-4102-8e65-0f0a1bf5115c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:10.863251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a62a5e80-9a9b-4102-8e65-0f0a1bf5115c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:10.863669 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a62a5e80-9a9b-4102-8e65-0f0a1bf5115c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:10.918921 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:00:11.016972 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d219cd92-228a-4151-b38d-35e7957afb98 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:11.028988 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d219cd92-228a-4151-b38d-35e7957afb98 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1508 microversion: 2.1 time: 0.279947 Sep 24 21:00:11.030385 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1449/2900] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:10 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1508 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:11.040295 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-65aa1808-9a68-4e5a-bcd4-6ffad509ed81 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:11.045095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-65aa1808-9a68-4e5a-bcd4-6ffad509ed81 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 1cceb126-5c30-4c10-b02f-f6a27a7420c8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:11.059611 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65aa1808-9a68-4e5a-bcd4-6ffad509ed81 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:11.060121 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65aa1808-9a68-4e5a-bcd4-6ffad509ed81 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:11.060577 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65aa1808-9a68-4e5a-bcd4-6ffad509ed81 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:11.064561 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65aa1808-9a68-4e5a-bcd4-6ffad509ed81 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:11.065114 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65aa1808-9a68-4e5a-bcd4-6ffad509ed81 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:11.065701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65aa1808-9a68-4e5a-bcd4-6ffad509ed81 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:11.176025 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a62a5e80-9a9b-4102-8e65-0f0a1bf5115c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "POST /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/action" status: 202 len: 0 microversion: 2.1 time: 0.331231 Sep 24 21:00:11.177797 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1452/2901] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:00:10 2022] POST /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 24 21:00:11.186336 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ff180af6-9f14-433c-993e-7d4a52f836c3 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:11.187127 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ff180af6-9f14-433c-993e-7d4a52f836c3 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] [instance: 6f34bc2b-5e80-41a6-8898-7ca853cb26ab] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:11.195383 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff180af6-9f14-433c-993e-7d4a52f836c3 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:11.195995 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff180af6-9f14-433c-993e-7d4a52f836c3 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:11.196531 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff180af6-9f14-433c-993e-7d4a52f836c3 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:11.197458 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff180af6-9f14-433c-993e-7d4a52f836c3 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:11.198199 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff180af6-9f14-433c-993e-7d4a52f836c3 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:11.198699 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff180af6-9f14-433c-993e-7d4a52f836c3 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:11.384757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-65aa1808-9a68-4e5a-bcd4-6ffad509ed81 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddab9c74c004e74a51fd8008886e542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdf8ae7524612b9c2f6a3f16c39ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:11.395734 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-65aa1808-9a68-4e5a-bcd4-6ffad509ed81 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8" status: 200 len: 1315 microversion: 2.1 time: 0.359788 Sep 24 21:00:11.397660 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1450/2902] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:11 2022] GET /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8 => generated 1315 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:11.418632 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-5a4a6767-b8b5-4636-a0a1-31b089d79e8b req-ef4dd3bb-b6e0-44b1-9d54-b7174d69d0b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cceb126-5c30-4c10-b02f-f6a27a7420c8", "name": "network-vif-plugged", "status": "completed", "tag": "6b1365fd-2a04-4e08-a3e1-a17d262f6e80"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:11.430698 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-5a4a6767-b8b5-4636-a0a1-31b089d79e8b req-ef4dd3bb-b6e0-44b1-9d54-b7174d69d0b5 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:11.432029 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-5a4a6767-b8b5-4636-a0a1-31b089d79e8b req-ef4dd3bb-b6e0-44b1-9d54-b7174d69d0b5 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:11.432636 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-5a4a6767-b8b5-4636-a0a1-31b089d79e8b req-ef4dd3bb-b6e0-44b1-9d54-b7174d69d0b5 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:11.447307 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-5a4a6767-b8b5-4636-a0a1-31b089d79e8b req-ef4dd3bb-b6e0-44b1-9d54-b7174d69d0b5 service nova] Creating event network-vif-plugged:6b1365fd-2a04-4e08-a3e1-a17d262f6e80 for instance 1cceb126-5c30-4c10-b02f-f6a27a7420c8 on nch2-master-1 Sep 24 21:00:11.453515 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-5a4a6767-b8b5-4636-a0a1-31b089d79e8b req-ef4dd3bb-b6e0-44b1-9d54-b7174d69d0b5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042738 Sep 24 21:00:11.454766 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1451/2903] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:00:11.461164 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a1e6daa7-25ac-49d9-9bb0-fa795ac8d1d9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:11.464169 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a1e6daa7-25ac-49d9-9bb0-fa795ac8d1d9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:11.471701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1e6daa7-25ac-49d9-9bb0-fa795ac8d1d9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:11.472333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1e6daa7-25ac-49d9-9bb0-fa795ac8d1d9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:11.472994 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1e6daa7-25ac-49d9-9bb0-fa795ac8d1d9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:11.473866 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1e6daa7-25ac-49d9-9bb0-fa795ac8d1d9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:11.474480 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1e6daa7-25ac-49d9-9bb0-fa795ac8d1d9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:11.474936 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1e6daa7-25ac-49d9-9bb0-fa795ac8d1d9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:11.475757 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ff180af6-9f14-433c-993e-7d4a52f836c3 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a689c647524dfdb492184b90c53b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a512ecd53242fb8dd25a0367ae8180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:11.487547 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ff180af6-9f14-433c-993e-7d4a52f836c3 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] 10.222.0.52 "GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab" status: 200 len: 1324 microversion: 2.1 time: 0.308218 Sep 24 21:00:11.488882 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1453/2904] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:11 2022] GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab => generated 1324 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:11.494586 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5c73eac8-cea2-4eef-858a-859c8be063a5 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:11.495558 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5c73eac8-cea2-4eef-858a-859c8be063a5 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:11.505129 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c73eac8-cea2-4eef-858a-859c8be063a5 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:11.505624 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c73eac8-cea2-4eef-858a-859c8be063a5 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:11.506063 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c73eac8-cea2-4eef-858a-859c8be063a5 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:11.506988 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c73eac8-cea2-4eef-858a-859c8be063a5 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:11.507451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c73eac8-cea2-4eef-858a-859c8be063a5 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:11.507881 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c73eac8-cea2-4eef-858a-859c8be063a5 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:11.520777 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a1e6daa7-25ac-49d9-9bb0-fa795ac8d1d9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.064003 Sep 24 21:00:11.521732 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1452/2905] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:00:11 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:00:11.588105 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5c73eac8-cea2-4eef-858a-859c8be063a5 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:11.602827 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5c73eac8-cea2-4eef-858a-859c8be063a5 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:11.604289 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5c73eac8-cea2-4eef-858a-859c8be063a5 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:11.610587 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5c73eac8-cea2-4eef-858a-859c8be063a5 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1446 microversion: 2.75 time: 0.120488 Sep 24 21:00:11.611175 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1454/2906] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:00:11 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1446 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:00:11.769325 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d90e57c8-904b-4595-b051-dadf9d30ca1a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:11.770095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d90e57c8-904b-4595-b051-dadf9d30ca1a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:11.776486 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d90e57c8-904b-4595-b051-dadf9d30ca1a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:11.776977 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d90e57c8-904b-4595-b051-dadf9d30ca1a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:11.777439 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d90e57c8-904b-4595-b051-dadf9d30ca1a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:11.778157 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d90e57c8-904b-4595-b051-dadf9d30ca1a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:11.778651 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d90e57c8-904b-4595-b051-dadf9d30ca1a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:11.779080 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d90e57c8-904b-4595-b051-dadf9d30ca1a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:11.932647 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d90e57c8-904b-4595-b051-dadf9d30ca1a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:11.941994 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d90e57c8-904b-4595-b051-dadf9d30ca1a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1521 microversion: 2.1 time: 0.176624 Sep 24 21:00:11.942922 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1453/2907] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:11 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:12.053327 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ac2e7b0e-a8c1-4b1b-918b-5e4aebdd1ed7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:12.054180 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ac2e7b0e-a8c1-4b1b-918b-5e4aebdd1ed7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:12.061325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac2e7b0e-a8c1-4b1b-918b-5e4aebdd1ed7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:12.062545 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac2e7b0e-a8c1-4b1b-918b-5e4aebdd1ed7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:12.063099 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac2e7b0e-a8c1-4b1b-918b-5e4aebdd1ed7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:12.064007 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac2e7b0e-a8c1-4b1b-918b-5e4aebdd1ed7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:12.064471 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac2e7b0e-a8c1-4b1b-918b-5e4aebdd1ed7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:12.065215 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac2e7b0e-a8c1-4b1b-918b-5e4aebdd1ed7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:12.212418 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ac2e7b0e-a8c1-4b1b-918b-5e4aebdd1ed7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:12.221523 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ac2e7b0e-a8c1-4b1b-918b-5e4aebdd1ed7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1508 microversion: 2.1 time: 0.172172 Sep 24 21:00:12.237941 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1455/2908] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:12 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1508 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:12.422960 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d135f1db-bc43-49be-b86a-e03ca07166b5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:12.424385 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d135f1db-bc43-49be-b86a-e03ca07166b5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 1cceb126-5c30-4c10-b02f-f6a27a7420c8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:12.432000 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d135f1db-bc43-49be-b86a-e03ca07166b5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:12.432764 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d135f1db-bc43-49be-b86a-e03ca07166b5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:12.433462 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d135f1db-bc43-49be-b86a-e03ca07166b5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:12.434407 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d135f1db-bc43-49be-b86a-e03ca07166b5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:12.434975 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d135f1db-bc43-49be-b86a-e03ca07166b5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:12.435613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d135f1db-bc43-49be-b86a-e03ca07166b5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:12.511696 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2edf2f71-f746-4677-ac4e-654cf7c742b3 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:12.512355 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2edf2f71-f746-4677-ac4e-654cf7c742b3 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] [instance: 6f34bc2b-5e80-41a6-8898-7ca853cb26ab] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:12.526054 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2edf2f71-f746-4677-ac4e-654cf7c742b3 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:12.528702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2edf2f71-f746-4677-ac4e-654cf7c742b3 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:12.529387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2edf2f71-f746-4677-ac4e-654cf7c742b3 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:12.530380 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2edf2f71-f746-4677-ac4e-654cf7c742b3 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:12.531084 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2edf2f71-f746-4677-ac4e-654cf7c742b3 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:12.531775 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2edf2f71-f746-4677-ac4e-654cf7c742b3 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:12.708398 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d135f1db-bc43-49be-b86a-e03ca07166b5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddab9c74c004e74a51fd8008886e542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdf8ae7524612b9c2f6a3f16c39ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:12.718917 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d135f1db-bc43-49be-b86a-e03ca07166b5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8" status: 200 len: 1315 microversion: 2.1 time: 0.301043 Sep 24 21:00:12.739150 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1454/2909] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:12 2022] GET /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8 => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:12.743720 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2edf2f71-f746-4677-ac4e-654cf7c742b3 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a689c647524dfdb492184b90c53b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a512ecd53242fb8dd25a0367ae8180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:12.769388 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2edf2f71-f746-4677-ac4e-654cf7c742b3 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] 10.222.0.52 "GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab" status: 200 len: 1324 microversion: 2.1 time: 0.261077 Sep 24 21:00:12.773591 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1751b35d-c849-49bd-8192-c68b574797a3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:12.774056 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1456/2910] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:12 2022] GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab => generated 1324 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:12.779789 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1751b35d-c849-49bd-8192-c68b574797a3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:12.785767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e16fb76a-4689-4191-991d-770cacae357c tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:12.786693 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e16fb76a-4689-4191-991d-770cacae357c tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:12.793162 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1751b35d-c849-49bd-8192-c68b574797a3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:12.793670 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1751b35d-c849-49bd-8192-c68b574797a3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:12.794115 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1751b35d-c849-49bd-8192-c68b574797a3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:12.799236 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1751b35d-c849-49bd-8192-c68b574797a3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:12.800625 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e16fb76a-4689-4191-991d-770cacae357c tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:12.802393 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e16fb76a-4689-4191-991d-770cacae357c tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:12.802864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e16fb76a-4689-4191-991d-770cacae357c tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:12.803048 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1751b35d-c849-49bd-8192-c68b574797a3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:12.803516 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1751b35d-c849-49bd-8192-c68b574797a3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:12.807220 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e16fb76a-4689-4191-991d-770cacae357c tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:12.807699 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e16fb76a-4689-4191-991d-770cacae357c tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:12.808136 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e16fb76a-4689-4191-991d-770cacae357c tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:12.876532 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1751b35d-c849-49bd-8192-c68b574797a3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.135631 Sep 24 21:00:12.878130 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1455/2911] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:00:12 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:00:12.899609 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e16fb76a-4689-4191-991d-770cacae357c tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:12.909233 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e16fb76a-4689-4191-991d-770cacae357c tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:12.910742 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e16fb76a-4689-4191-991d-770cacae357c tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:12.917280 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e16fb76a-4689-4191-991d-770cacae357c tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1446 microversion: 2.75 time: 0.141980 Sep 24 21:00:12.918177 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1457/2912] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:00:12 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1446 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:00:12.974056 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e90746ba-9c56-446e-b021-fee4ba94ad55 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:12.976131 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e90746ba-9c56-446e-b021-fee4ba94ad55 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:13.012221 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e90746ba-9c56-446e-b021-fee4ba94ad55 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:13.013826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e90746ba-9c56-446e-b021-fee4ba94ad55 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:13.014290 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e90746ba-9c56-446e-b021-fee4ba94ad55 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:13.015916 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e90746ba-9c56-446e-b021-fee4ba94ad55 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:13.016679 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e90746ba-9c56-446e-b021-fee4ba94ad55 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:13.017030 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e90746ba-9c56-446e-b021-fee4ba94ad55 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:13.167874 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e90746ba-9c56-446e-b021-fee4ba94ad55 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:13.176898 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e90746ba-9c56-446e-b021-fee4ba94ad55 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1521 microversion: 2.1 time: 0.210801 Sep 24 21:00:13.177523 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1456/2913] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:12 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:13.244856 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9b06cf69-c34d-4dd0-8234-5a01e2fc92ee tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:13.246076 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9b06cf69-c34d-4dd0-8234-5a01e2fc92ee tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:13.248128 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=4 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:00:13.254401 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9b06cf69-c34d-4dd0-8234-5a01e2fc92ee tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:13.254917 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9b06cf69-c34d-4dd0-8234-5a01e2fc92ee tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:13.255356 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9b06cf69-c34d-4dd0-8234-5a01e2fc92ee tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:13.256066 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9b06cf69-c34d-4dd0-8234-5a01e2fc92ee tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:13.256527 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9b06cf69-c34d-4dd0-8234-5a01e2fc92ee tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:13.256956 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9b06cf69-c34d-4dd0-8234-5a01e2fc92ee tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:13.313528 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=16 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:00:13.392678 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9b06cf69-c34d-4dd0-8234-5a01e2fc92ee tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:13.400757 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9b06cf69-c34d-4dd0-8234-5a01e2fc92ee tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1508 microversion: 2.1 time: 0.159933 Sep 24 21:00:13.401511 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1458/2914] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:13 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:13.469416 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-da0bc07e-4dc7-45ba-9bab-84614e6b4989 req-3c9c44b5-48e5-4819-8996-c49eea8e5e04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf34d10c-76c3-4798-9a3f-083aeb681fd6", "name": "network-vif-plugged", "status": "completed", "tag": "e7eddae5-24be-47f8-893f-5fecfb04b6ef"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:13.486481 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-da0bc07e-4dc7-45ba-9bab-84614e6b4989 req-3c9c44b5-48e5-4819-8996-c49eea8e5e04 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:13.487635 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-da0bc07e-4dc7-45ba-9bab-84614e6b4989 req-3c9c44b5-48e5-4819-8996-c49eea8e5e04 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:13.488242 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-da0bc07e-4dc7-45ba-9bab-84614e6b4989 req-3c9c44b5-48e5-4819-8996-c49eea8e5e04 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:13.502736 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-da0bc07e-4dc7-45ba-9bab-84614e6b4989 req-3c9c44b5-48e5-4819-8996-c49eea8e5e04 service nova] Creating event network-vif-plugged:e7eddae5-24be-47f8-893f-5fecfb04b6ef for instance cf34d10c-76c3-4798-9a3f-083aeb681fd6 on nch1-master-1 Sep 24 21:00:13.509515 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-da0bc07e-4dc7-45ba-9bab-84614e6b4989 req-3c9c44b5-48e5-4819-8996-c49eea8e5e04 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044035 Sep 24 21:00:13.511497 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1457/2915] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:00:13.745610 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3c21e0bf-59bf-4553-93ec-15841b680cec tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:13.746489 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3c21e0bf-59bf-4553-93ec-15841b680cec tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 1cceb126-5c30-4c10-b02f-f6a27a7420c8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:13.754051 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c21e0bf-59bf-4553-93ec-15841b680cec tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:13.754813 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c21e0bf-59bf-4553-93ec-15841b680cec tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:13.755436 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c21e0bf-59bf-4553-93ec-15841b680cec tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:13.756315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c21e0bf-59bf-4553-93ec-15841b680cec tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:13.756930 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c21e0bf-59bf-4553-93ec-15841b680cec tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:13.757514 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c21e0bf-59bf-4553-93ec-15841b680cec tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:13.796983 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fa064ae7-b263-4c0f-b542-4b929cc71e62 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:13.800674 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fa064ae7-b263-4c0f-b542-4b929cc71e62 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] [instance: 6f34bc2b-5e80-41a6-8898-7ca853cb26ab] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:13.817568 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa064ae7-b263-4c0f-b542-4b929cc71e62 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:13.822203 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa064ae7-b263-4c0f-b542-4b929cc71e62 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:13.824815 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa064ae7-b263-4c0f-b542-4b929cc71e62 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:13.825774 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa064ae7-b263-4c0f-b542-4b929cc71e62 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:13.828811 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa064ae7-b263-4c0f-b542-4b929cc71e62 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:13.829466 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa064ae7-b263-4c0f-b542-4b929cc71e62 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:14.166305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3c21e0bf-59bf-4553-93ec-15841b680cec tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddab9c74c004e74a51fd8008886e542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdf8ae7524612b9c2f6a3f16c39ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:14.176200 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3c21e0bf-59bf-4553-93ec-15841b680cec tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8" status: 200 len: 1504 microversion: 2.1 time: 0.435314 Sep 24 21:00:14.196701 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1459/2916] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:13 2022] GET /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8 => generated 1504 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:14.201847 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6f75a079-11c4-4663-95c4-a99b8a9cdb2d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:14.205336 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6f75a079-11c4-4663-95c4-a99b8a9cdb2d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:14.211447 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fa064ae7-b263-4c0f-b542-4b929cc71e62 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a689c647524dfdb492184b90c53b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a512ecd53242fb8dd25a0367ae8180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:14.225118 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fa064ae7-b263-4c0f-b542-4b929cc71e62 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] 10.222.0.52 "GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab" status: 200 len: 1324 microversion: 2.1 time: 0.432953 Sep 24 21:00:14.227715 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f75a079-11c4-4663-95c4-a99b8a9cdb2d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:14.239125 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1458/2917] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:13 2022] GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab => generated 1324 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:14.255541 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f75a079-11c4-4663-95c4-a99b8a9cdb2d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:14.259090 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f75a079-11c4-4663-95c4-a99b8a9cdb2d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:14.260105 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f75a079-11c4-4663-95c4-a99b8a9cdb2d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:14.263385 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cd1d53e6-6624-42cf-b61a-bcd1586ebf3d tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:14.264394 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f75a079-11c4-4663-95c4-a99b8a9cdb2d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:14.265493 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f75a079-11c4-4663-95c4-a99b8a9cdb2d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:14.268757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cd1d53e6-6624-42cf-b61a-bcd1586ebf3d tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:14.282705 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd1d53e6-6624-42cf-b61a-bcd1586ebf3d tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:14.287422 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd1d53e6-6624-42cf-b61a-bcd1586ebf3d tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:14.288153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd1d53e6-6624-42cf-b61a-bcd1586ebf3d tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:14.289108 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd1d53e6-6624-42cf-b61a-bcd1586ebf3d tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:14.292045 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd1d53e6-6624-42cf-b61a-bcd1586ebf3d tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:14.292763 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd1d53e6-6624-42cf-b61a-bcd1586ebf3d tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:14.363249 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6f75a079-11c4-4663-95c4-a99b8a9cdb2d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.166778 Sep 24 21:00:14.363863 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1460/2918] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:00:14 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:00:14.371188 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9015c506-2ce8-498b-85b1-b2298a3612e9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:14.376290 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9015c506-2ce8-498b-85b1-b2298a3612e9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:14.388294 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9015c506-2ce8-498b-85b1-b2298a3612e9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:14.388803 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9015c506-2ce8-498b-85b1-b2298a3612e9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:14.395484 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9015c506-2ce8-498b-85b1-b2298a3612e9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:14.396288 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9015c506-2ce8-498b-85b1-b2298a3612e9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:14.398970 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9015c506-2ce8-498b-85b1-b2298a3612e9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:14.405425 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9015c506-2ce8-498b-85b1-b2298a3612e9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:14.449206 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cd1d53e6-6624-42cf-b61a-bcd1586ebf3d tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:14.460369 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cd1d53e6-6624-42cf-b61a-bcd1586ebf3d tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:14.462402 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cd1d53e6-6624-42cf-b61a-bcd1586ebf3d tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:14.475537 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cd1d53e6-6624-42cf-b61a-bcd1586ebf3d tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1446 microversion: 2.75 time: 0.215687 Sep 24 21:00:14.476996 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1459/2919] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:00:14 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1446 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:00:14.482404 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-27adacfe-5e85-4fcb-946c-aff999b03993 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-630643766"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:14.483338 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-27adacfe-5e85-4fcb-946c-aff999b03993 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 1cceb126-5c30-4c10-b02f-f6a27a7420c8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:14.491071 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27adacfe-5e85-4fcb-946c-aff999b03993 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:14.491831 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27adacfe-5e85-4fcb-946c-aff999b03993 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:14.492468 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27adacfe-5e85-4fcb-946c-aff999b03993 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:14.493398 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27adacfe-5e85-4fcb-946c-aff999b03993 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:14.494014 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27adacfe-5e85-4fcb-946c-aff999b03993 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:14.494640 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27adacfe-5e85-4fcb-946c-aff999b03993 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:15.051009 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9015c506-2ce8-498b-85b1-b2298a3612e9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:15.059840 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9015c506-2ce8-498b-85b1-b2298a3612e9 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1521 microversion: 2.1 time: 0.694860 Sep 24 21:00:15.060681 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1461/2920] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:14 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1521 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:15.069304 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-762561bc-e751-4101-8480-80c524597dd7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:15.070240 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-762561bc-e751-4101-8480-80c524597dd7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:15.081316 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-762561bc-e751-4101-8480-80c524597dd7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:15.082012 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-762561bc-e751-4101-8480-80c524597dd7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:15.082441 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.network.security_group_api [None req-27adacfe-5e85-4fcb-946c-aff999b03993 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Adding security group 3aaebb58-55ca-4611-a836-0b5372c23bd5 to port 6b1365fd-2a04-4e08-a3e1-a17d262f6e80 Sep 24 21:00:15.083019 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-762561bc-e751-4101-8480-80c524597dd7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:15.083928 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-762561bc-e751-4101-8480-80c524597dd7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:15.084625 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-762561bc-e751-4101-8480-80c524597dd7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:15.085119 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-762561bc-e751-4101-8480-80c524597dd7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:15.392172 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-762561bc-e751-4101-8480-80c524597dd7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:15.401235 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-762561bc-e751-4101-8480-80c524597dd7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1508 microversion: 2.1 time: 0.338792 Sep 24 21:00:15.402190 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1462/2921] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:15 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1508 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:15.408006 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dda74eba-2f68-4527-a452-6ecef336ea1f tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:15.408821 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-dda74eba-2f68-4527-a452-6ecef336ea1f tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] [instance: 6f34bc2b-5e80-41a6-8898-7ca853cb26ab] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:15.416003 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dda74eba-2f68-4527-a452-6ecef336ea1f tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:15.416746 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dda74eba-2f68-4527-a452-6ecef336ea1f tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:15.417189 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dda74eba-2f68-4527-a452-6ecef336ea1f tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:15.417904 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dda74eba-2f68-4527-a452-6ecef336ea1f tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:15.418359 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dda74eba-2f68-4527-a452-6ecef336ea1f tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:15.419653 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dda74eba-2f68-4527-a452-6ecef336ea1f tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:16.038802 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-dda74eba-2f68-4527-a452-6ecef336ea1f tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a689c647524dfdb492184b90c53b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a512ecd53242fb8dd25a0367ae8180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:16.051817 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-dda74eba-2f68-4527-a452-6ecef336ea1f tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] 10.222.0.52 "GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab" status: 200 len: 1324 microversion: 2.1 time: 0.648373 Sep 24 21:00:16.053021 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1463/2922] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:15 2022] GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab => generated 1324 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:16.057997 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c779c653-ce6e-4939-96d9-72125b55c677 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:16.064627 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c779c653-ce6e-4939-96d9-72125b55c677 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:16.089032 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c779c653-ce6e-4939-96d9-72125b55c677 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:16.089818 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c779c653-ce6e-4939-96d9-72125b55c677 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:16.090603 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c779c653-ce6e-4939-96d9-72125b55c677 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:16.092205 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c779c653-ce6e-4939-96d9-72125b55c677 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:16.093522 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c779c653-ce6e-4939-96d9-72125b55c677 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:16.094490 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c779c653-ce6e-4939-96d9-72125b55c677 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:16.158898 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c779c653-ce6e-4939-96d9-72125b55c677 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.104566 Sep 24 21:00:16.159978 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1464/2923] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:00:16 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:00:16.166148 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3d770d91-cf0a-49fa-9981-f4bb059ac3ba tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:16.169431 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3d770d91-cf0a-49fa-9981-f4bb059ac3ba tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:16.177947 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d770d91-cf0a-49fa-9981-f4bb059ac3ba tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:16.178619 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d770d91-cf0a-49fa-9981-f4bb059ac3ba tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:16.179070 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d770d91-cf0a-49fa-9981-f4bb059ac3ba tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:16.180032 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d770d91-cf0a-49fa-9981-f4bb059ac3ba tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:16.181046 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d770d91-cf0a-49fa-9981-f4bb059ac3ba tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:16.181166 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-27adacfe-5e85-4fcb-946c-aff999b03993 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "POST /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8/action" status: 202 len: 0 microversion: 2.1 time: 1.702729 Sep 24 21:00:16.181584 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d770d91-cf0a-49fa-9981-f4bb059ac3ba tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:16.182205 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1460/2924] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:00:14 2022] POST /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8/action => generated 0 bytes in 1705 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:00:16.188322 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2b574318-811d-4ab3-ac5f-c1c5370c6f7c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:16.189137 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2b574318-811d-4ab3-ac5f-c1c5370c6f7c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:16.203608 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2b574318-811d-4ab3-ac5f-c1c5370c6f7c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:16.204774 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2b574318-811d-4ab3-ac5f-c1c5370c6f7c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:16.205399 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2b574318-811d-4ab3-ac5f-c1c5370c6f7c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:16.206360 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2b574318-811d-4ab3-ac5f-c1c5370c6f7c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:16.212570 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2b574318-811d-4ab3-ac5f-c1c5370c6f7c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:16.214651 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2b574318-811d-4ab3-ac5f-c1c5370c6f7c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:16.326558 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3d770d91-cf0a-49fa-9981-f4bb059ac3ba tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:16.338524 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3d770d91-cf0a-49fa-9981-f4bb059ac3ba tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:16.340292 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3d770d91-cf0a-49fa-9981-f4bb059ac3ba tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:16.347315 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3d770d91-cf0a-49fa-9981-f4bb059ac3ba tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1452 microversion: 2.75 time: 0.185987 Sep 24 21:00:16.348000 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1465/2925] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:00:16 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1452 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:00:16.353088 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0c67c740-bb79-436f-8755-e4d2a8cf34a2 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1715789568"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:16.355994 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0c67c740-bb79-436f-8755-e4d2a8cf34a2 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 1cceb126-5c30-4c10-b02f-f6a27a7420c8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:16.384528 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0c67c740-bb79-436f-8755-e4d2a8cf34a2 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:16.385338 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0c67c740-bb79-436f-8755-e4d2a8cf34a2 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:16.385853 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0c67c740-bb79-436f-8755-e4d2a8cf34a2 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:16.386700 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0c67c740-bb79-436f-8755-e4d2a8cf34a2 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:16.387265 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0c67c740-bb79-436f-8755-e4d2a8cf34a2 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:16.387773 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0c67c740-bb79-436f-8755-e4d2a8cf34a2 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:16.608613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2b574318-811d-4ab3-ac5f-c1c5370c6f7c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:16.624896 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2b574318-811d-4ab3-ac5f-c1c5370c6f7c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1521 microversion: 2.1 time: 0.436884 Sep 24 21:00:16.626768 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1461/2926] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:16 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1521 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:16.722228 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.network.security_group_api [None req-0c67c740-bb79-436f-8755-e4d2a8cf34a2 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Adding security group a1ff6035-f542-428c-9534-ae4a1159d6f8 to port 6b1365fd-2a04-4e08-a3e1-a17d262f6e80 Sep 24 21:00:16.788654 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-3af6e361-8dc4-4259-b036-0b9059906664 req-e4bd3ea3-812b-44a5-84a3-cd6b9f634f08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cceb126-5c30-4c10-b02f-f6a27a7420c8", "tag": "6b1365fd-2a04-4e08-a3e1-a17d262f6e80"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:16.801182 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-3af6e361-8dc4-4259-b036-0b9059906664 req-e4bd3ea3-812b-44a5-84a3-cd6b9f634f08 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:16.801675 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-3af6e361-8dc4-4259-b036-0b9059906664 req-e4bd3ea3-812b-44a5-84a3-cd6b9f634f08 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:16.802647 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-3af6e361-8dc4-4259-b036-0b9059906664 req-e4bd3ea3-812b-44a5-84a3-cd6b9f634f08 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:16.817966 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-3af6e361-8dc4-4259-b036-0b9059906664 req-e4bd3ea3-812b-44a5-84a3-cd6b9f634f08 service nova] Creating event network-changed:6b1365fd-2a04-4e08-a3e1-a17d262f6e80 for instance 1cceb126-5c30-4c10-b02f-f6a27a7420c8 on nch2-master-1 Sep 24 21:00:16.824738 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-3af6e361-8dc4-4259-b036-0b9059906664 req-e4bd3ea3-812b-44a5-84a3-cd6b9f634f08 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.196517 Sep 24 21:00:16.826206 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1462/2927] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:00:16.834158 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dc20d0d9-c0a6-46ac-9ccf-cd65e1c6b376 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:16.836541 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dc20d0d9-c0a6-46ac-9ccf-cd65e1c6b376 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:16.846570 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc20d0d9-c0a6-46ac-9ccf-cd65e1c6b376 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:16.846570 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc20d0d9-c0a6-46ac-9ccf-cd65e1c6b376 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:16.847016 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc20d0d9-c0a6-46ac-9ccf-cd65e1c6b376 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:16.847998 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc20d0d9-c0a6-46ac-9ccf-cd65e1c6b376 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:16.848701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc20d0d9-c0a6-46ac-9ccf-cd65e1c6b376 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:16.849164 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc20d0d9-c0a6-46ac-9ccf-cd65e1c6b376 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:17.237976 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dc20d0d9-c0a6-46ac-9ccf-cd65e1c6b376 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:17.247970 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dc20d0d9-c0a6-46ac-9ccf-cd65e1c6b376 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1508 microversion: 2.1 time: 0.418712 Sep 24 21:00:17.249543 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1463/2928] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:16 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1508 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:17.255435 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-83d560a8-cf55-4cd0-8309-bc088f603610 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:17.256827 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-83d560a8-cf55-4cd0-8309-bc088f603610 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] [instance: 6f34bc2b-5e80-41a6-8898-7ca853cb26ab] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:17.264316 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-83d560a8-cf55-4cd0-8309-bc088f603610 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:17.265141 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-83d560a8-cf55-4cd0-8309-bc088f603610 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:17.266128 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-83d560a8-cf55-4cd0-8309-bc088f603610 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:17.266958 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-83d560a8-cf55-4cd0-8309-bc088f603610 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:17.267561 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-83d560a8-cf55-4cd0-8309-bc088f603610 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:17.268077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-83d560a8-cf55-4cd0-8309-bc088f603610 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:17.559370 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-83d560a8-cf55-4cd0-8309-bc088f603610 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a689c647524dfdb492184b90c53b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a512ecd53242fb8dd25a0367ae8180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:17.576491 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-83d560a8-cf55-4cd0-8309-bc088f603610 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] 10.222.0.52 "GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab" status: 200 len: 1324 microversion: 2.1 time: 0.324509 Sep 24 21:00:17.577322 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1464/2929] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:17 2022] GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab => generated 1324 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:17.583385 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6b6e2af2-6bcd-4292-9f13-4abb5f17c14a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:17.586960 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6b6e2af2-6bcd-4292-9f13-4abb5f17c14a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:17.594931 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b6e2af2-6bcd-4292-9f13-4abb5f17c14a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:17.595894 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b6e2af2-6bcd-4292-9f13-4abb5f17c14a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:17.596524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b6e2af2-6bcd-4292-9f13-4abb5f17c14a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:17.597265 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b6e2af2-6bcd-4292-9f13-4abb5f17c14a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:17.597732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b6e2af2-6bcd-4292-9f13-4abb5f17c14a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:17.598160 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b6e2af2-6bcd-4292-9f13-4abb5f17c14a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:17.630199 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:00:17.637304 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6b6e2af2-6bcd-4292-9f13-4abb5f17c14a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.058588 Sep 24 21:00:17.638144 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1465/2930] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:00:17 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:00:17.644058 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9296c03f-59c7-481d-bcc8-28439185a3a6 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:17.644674 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9296c03f-59c7-481d-bcc8-28439185a3a6 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:17.651288 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9296c03f-59c7-481d-bcc8-28439185a3a6 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:17.652042 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9296c03f-59c7-481d-bcc8-28439185a3a6 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:17.652652 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9296c03f-59c7-481d-bcc8-28439185a3a6 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:17.653536 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9296c03f-59c7-481d-bcc8-28439185a3a6 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:17.654190 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9296c03f-59c7-481d-bcc8-28439185a3a6 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:17.655053 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9296c03f-59c7-481d-bcc8-28439185a3a6 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:17.694361 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0c67c740-bb79-436f-8755-e4d2a8cf34a2 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "POST /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8/action" status: 202 len: 0 microversion: 2.1 time: 1.345222 Sep 24 21:00:17.695195 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1466/2931] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:00:16 2022] POST /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8/action => generated 0 bytes in 1347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:00:17.699952 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-91671b0d-0597-45cc-9b16-e686557b3e87 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:17.700754 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-91671b0d-0597-45cc-9b16-e686557b3e87 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:17.709106 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-91671b0d-0597-45cc-9b16-e686557b3e87 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:17.709797 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-91671b0d-0597-45cc-9b16-e686557b3e87 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:17.710309 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-91671b0d-0597-45cc-9b16-e686557b3e87 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:17.711261 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-91671b0d-0597-45cc-9b16-e686557b3e87 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:17.711992 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-91671b0d-0597-45cc-9b16-e686557b3e87 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:17.712585 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-91671b0d-0597-45cc-9b16-e686557b3e87 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:17.839239 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9296c03f-59c7-481d-bcc8-28439185a3a6 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:17.850766 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9296c03f-59c7-481d-bcc8-28439185a3a6 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:17.852479 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9296c03f-59c7-481d-bcc8-28439185a3a6 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:17.858756 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9296c03f-59c7-481d-bcc8-28439185a3a6 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1452 microversion: 2.75 time: 0.218883 Sep 24 21:00:17.859450 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1466/2932] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:00:17 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1452 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:00:17.864538 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-54773932-773f-47d1-9169-68ba5d4f79a3 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:17.865233 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-54773932-773f-47d1-9169-68ba5d4f79a3 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 1cceb126-5c30-4c10-b02f-f6a27a7420c8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:17.872361 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54773932-773f-47d1-9169-68ba5d4f79a3 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:17.873049 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54773932-773f-47d1-9169-68ba5d4f79a3 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:17.873668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54773932-773f-47d1-9169-68ba5d4f79a3 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:17.875596 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54773932-773f-47d1-9169-68ba5d4f79a3 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:17.876237 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54773932-773f-47d1-9169-68ba5d4f79a3 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:17.876821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54773932-773f-47d1-9169-68ba5d4f79a3 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:18.025274 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-91671b0d-0597-45cc-9b16-e686557b3e87 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:18.038390 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-91671b0d-0597-45cc-9b16-e686557b3e87 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1521 microversion: 2.1 time: 0.342131 Sep 24 21:00:18.039363 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1467/2933] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:17 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:18.087967 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-54773932-773f-47d1-9169-68ba5d4f79a3 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.227145 Sep 24 21:00:18.088551 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1467/2934] 10.222.0.52 () {58 vars in 1293 bytes} [Sat Sep 24 21:00:17 2022] GET /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8/os-security-groups => generated 1158 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:18.106766 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a3af56bc-a920-4629-8abe-91cce420b5cf tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Action: 'create', calling method: .version_select at 0x7f4b0c413160>, body: {"security_group": {"name": " tempest-securitygroup -970026269 ", "description": "tempest-description-1799243800"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:18.183670 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3ab708f1-0562-45d4-9c73-1677739a519a tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1311389666", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "b9fc93d3-0ad7-483a-aed0-543890dc0a39"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:18.243224 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-3ab708f1-0562-45d4-9c73-1677739a519a tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] validate_networks() for [('b9fc93d3-0ad7-483a-aed0-543890dc0a39', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:00:18.286398 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a3af56bc-a920-4629-8abe-91cce420b5cf tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.183747 Sep 24 21:00:18.287179 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1468/2935] 10.222.0.52 () {60 vars in 1180 bytes} [Sat Sep 24 21:00:18 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:00:18.300453 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8a5859d9-329e-47e0-af77-09bb1bcff782 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:18.301762 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8a5859d9-329e-47e0-af77-09bb1bcff782 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:18.308180 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8a5859d9-329e-47e0-af77-09bb1bcff782 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:18.308753 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8a5859d9-329e-47e0-af77-09bb1bcff782 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:18.309441 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8a5859d9-329e-47e0-af77-09bb1bcff782 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:18.310224 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8a5859d9-329e-47e0-af77-09bb1bcff782 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:18.310907 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8a5859d9-329e-47e0-af77-09bb1bcff782 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:18.311785 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8a5859d9-329e-47e0-af77-09bb1bcff782 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:18.316461 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:00:18.528580 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8a5859d9-329e-47e0-af77-09bb1bcff782 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:18.545178 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8a5859d9-329e-47e0-af77-09bb1bcff782 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1508 microversion: 2.1 time: 0.256622 Sep 24 21:00:18.546547 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1469/2936] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:18 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1508 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:18.551398 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2a9d1c08-09cc-464b-a1d7-c939073862c5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '.version_select at 0x7f4b0c561d30>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:18.662784 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2a9d1c08-09cc-464b-a1d7-c939073862c5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/c933467f-b7cd-4c3b-9712-730215a97d52" status: 200 len: 223 microversion: 2.1 time: 0.114830 Sep 24 21:00:18.663482 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1470/2937] 10.222.0.52 () {58 vars in 1269 bytes} [Sat Sep 24 21:00:18 2022] GET /compute/v2.1/os-security-groups/c933467f-b7cd-4c3b-9712-730215a97d52 => generated 223 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:00:18.669215 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e6300e97-a87a-4dd8-9a59-70c70e909a1b tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:18.671918 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e6300e97-a87a-4dd8-9a59-70c70e909a1b tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] [instance: 6f34bc2b-5e80-41a6-8898-7ca853cb26ab] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:18.679920 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6300e97-a87a-4dd8-9a59-70c70e909a1b tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:18.680457 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6300e97-a87a-4dd8-9a59-70c70e909a1b tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:18.681024 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6300e97-a87a-4dd8-9a59-70c70e909a1b tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:18.681993 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6300e97-a87a-4dd8-9a59-70c70e909a1b tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:18.682607 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6300e97-a87a-4dd8-9a59-70c70e909a1b tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:18.683139 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6300e97-a87a-4dd8-9a59-70c70e909a1b tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:18.824686 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-3ab708f1-0562-45d4-9c73-1677739a519a tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:00:18.825262 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-3ab708f1-0562-45d4-9c73-1677739a519a tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:00:18.825758 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-3ab708f1-0562-45d4-9c73-1677739a519a tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:00:18.826181 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-3ab708f1-0562-45d4-9c73-1677739a519a tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:00:18.826630 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-3ab708f1-0562-45d4-9c73-1677739a519a tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:00:18.835725 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ab708f1-0562-45d4-9c73-1677739a519a tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:18.836486 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ab708f1-0562-45d4-9c73-1677739a519a tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:18.837134 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ab708f1-0562-45d4-9c73-1677739a519a tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:18.838048 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ab708f1-0562-45d4-9c73-1677739a519a tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:18.838626 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ab708f1-0562-45d4-9c73-1677739a519a tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:18.839062 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ab708f1-0562-45d4-9c73-1677739a519a tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:18.856722 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-3ab708f1-0562-45d4-9c73-1677739a519a tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Getting quotas for project d4655b536ca04896993223f34d172298. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:00:18.863902 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-3ab708f1-0562-45d4-9c73-1677739a519a tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Getting quotas for user f41f618458eb48f6bb4631fd254addc0 and project d4655b536ca04896993223f34d172298. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:00:18.867351 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:00:18.873027 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e6300e97-a87a-4dd8-9a59-70c70e909a1b tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a689c647524dfdb492184b90c53b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a512ecd53242fb8dd25a0367ae8180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:18.883380 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e6300e97-a87a-4dd8-9a59-70c70e909a1b tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] 10.222.0.52 "GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab" status: 200 len: 1324 microversion: 2.1 time: 0.217464 Sep 24 21:00:18.883970 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1471/2938] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:18 2022] GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab => generated 1324 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:18.884445 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3ab708f1-0562-45d4-9c73-1677739a519a tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:00:18.886946 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3ab708f1-0562-45d4-9c73-1677739a519a tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:00:18.889570 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4735330a-8ad0-43dc-b6e0-c50cf51d9c2f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:18.892085 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4735330a-8ad0-43dc-b6e0-c50cf51d9c2f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:18.899546 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4735330a-8ad0-43dc-b6e0-c50cf51d9c2f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:18.900044 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4735330a-8ad0-43dc-b6e0-c50cf51d9c2f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:18.900694 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4735330a-8ad0-43dc-b6e0-c50cf51d9c2f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:18.902240 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4735330a-8ad0-43dc-b6e0-c50cf51d9c2f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:18.902735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4735330a-8ad0-43dc-b6e0-c50cf51d9c2f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:18.903176 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4735330a-8ad0-43dc-b6e0-c50cf51d9c2f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:18.937555 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4735330a-8ad0-43dc-b6e0-c50cf51d9c2f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.051521 Sep 24 21:00:18.939749 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3ab708f1-0562-45d4-9c73-1677739a519a tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.814679 Sep 24 21:00:18.942650 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1468/2939] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:00:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 24 21:00:18.945933 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1b5c487e-5fba-4f5e-aac2-34e2ffae1651 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '.version_select at 0x7f4b07eb9940>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:18.949845 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1472/2940] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:00:18 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:00:18.956539 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-c3f60f5a-5d05-4692-b49f-d440f14e6953 req-0d653c52-d8e0-4849-ad3c-b0fb00ba3c89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cceb126-5c30-4c10-b02f-f6a27a7420c8", "tag": "6b1365fd-2a04-4e08-a3e1-a17d262f6e80"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:18.991203 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c3f60f5a-5d05-4692-b49f-d440f14e6953 req-0d653c52-d8e0-4849-ad3c-b0fb00ba3c89 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:18.991843 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c3f60f5a-5d05-4692-b49f-d440f14e6953 req-0d653c52-d8e0-4849-ad3c-b0fb00ba3c89 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:18.992390 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c3f60f5a-5d05-4692-b49f-d440f14e6953 req-0d653c52-d8e0-4849-ad3c-b0fb00ba3c89 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:19.015910 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-c3f60f5a-5d05-4692-b49f-d440f14e6953 req-0d653c52-d8e0-4849-ad3c-b0fb00ba3c89 service nova] Creating event network-changed:6b1365fd-2a04-4e08-a3e1-a17d262f6e80 for instance 1cceb126-5c30-4c10-b02f-f6a27a7420c8 on nch2-master-1 Sep 24 21:00:19.023385 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-c3f60f5a-5d05-4692-b49f-d440f14e6953 req-0d653c52-d8e0-4849-ad3c-b0fb00ba3c89 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072119 Sep 24 21:00:19.024321 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1473/2941] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:00:19.030930 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-881999ad-7779-4808-9624-8b363424af93 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:19.031989 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-881999ad-7779-4808-9624-8b363424af93 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:19.039318 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-881999ad-7779-4808-9624-8b363424af93 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:19.039908 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-881999ad-7779-4808-9624-8b363424af93 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:19.040367 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-881999ad-7779-4808-9624-8b363424af93 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:19.041335 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-881999ad-7779-4808-9624-8b363424af93 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:19.041810 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-881999ad-7779-4808-9624-8b363424af93 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:19.042694 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-881999ad-7779-4808-9624-8b363424af93 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:19.137233 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-881999ad-7779-4808-9624-8b363424af93 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:19.153427 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-881999ad-7779-4808-9624-8b363424af93 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:19.155469 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-881999ad-7779-4808-9624-8b363424af93 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:19.165744 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-881999ad-7779-4808-9624-8b363424af93 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1452 microversion: 2.75 time: 0.139329 Sep 24 21:00:19.166782 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1474/2942] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:00:19 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1452 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:00:19.174527 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5e71140a-45d9-4842-9587-d2fb3324aa5d tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:19.175381 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5e71140a-45d9-4842-9587-d2fb3324aa5d tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:19.288366 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5e71140a-45d9-4842-9587-d2fb3324aa5d tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41f618458eb48f6bb4631fd254addc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4655b536ca04896993223f34d172298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:19.299589 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5e71140a-45d9-4842-9587-d2fb3324aa5d tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "GET /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130" status: 200 len: 1224 microversion: 2.1 time: 0.131300 Sep 24 21:00:19.311025 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1475/2943] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:19 2022] GET /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130 => generated 1224 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:19.311461 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1b5c487e-5fba-4f5e-aac2-34e2ffae1651 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/c933467f-b7cd-4c3b-9712-730215a97d52" status: 202 len: 0 microversion: 2.1 time: 0.366944 Sep 24 21:00:19.317049 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1469/2944] 10.222.0.52 () {58 vars in 1272 bytes} [Sat Sep 24 21:00:18 2022] DELETE /compute/v2.1/os-security-groups/c933467f-b7cd-4c3b-9712-730215a97d52 => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:00:19.318026 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-24f9484d-1cab-463c-9e99-b16046fe5cbb tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '.version_select at 0x7f4b07e960d0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:19.327891 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-807f0498-fdee-4cb9-8d76-92e11119ba6e tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:19.328544 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-807f0498-fdee-4cb9-8d76-92e11119ba6e tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:19.342176 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-807f0498-fdee-4cb9-8d76-92e11119ba6e tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:19.343285 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-807f0498-fdee-4cb9-8d76-92e11119ba6e tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:19.345024 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-807f0498-fdee-4cb9-8d76-92e11119ba6e tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:19.345768 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-807f0498-fdee-4cb9-8d76-92e11119ba6e tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:19.346642 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-807f0498-fdee-4cb9-8d76-92e11119ba6e tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:19.346758 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-807f0498-fdee-4cb9-8d76-92e11119ba6e tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:19.382217 ncdv-master-1 devstack@n-api.service[140517]: DEBUG neutronclient.v2_0.client [None req-24f9484d-1cab-463c-9e99-b16046fe5cbb tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c933467f-b7cd-4c3b-9712-730215a97d52 does not exist", "detail": ""}} {{(pid=140517) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 24 21:00:19.383314 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.security_group_api [None req-24f9484d-1cab-463c-9e99-b16046fe5cbb tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Neutron security group c933467f-b7cd-4c3b-9712-730215a97d52 not found {{(pid=140517) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 24 21:00:19.383878 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-24f9484d-1cab-463c-9e99-b16046fe5cbb tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] HTTP exception thrown: Security group c933467f-b7cd-4c3b-9712-730215a97d52 does not exist Sep 24 21:00:19.383878 ncdv-master-1 devstack@n-api.service[140517]: Neutron server returns request_ids: ['req-29d7c356-0e43-4c2b-ab3b-1ae10c4bee39'] Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-24f9484d-1cab-463c-9e99-b16046fe5cbb tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Request method failure captured: Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/os-security-groups/c933467f-b7cd-4c3b-9712-730215a97d52 HTTP/1.1 Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL2_KTBoQE1biSOdbxiN02s3h0D1W3LZT4KXbL5sweudoA3LIqkhpSDHo_3ElsoW-S4pinCvYVIPwwmg75I3QYjyeUH8E9-UCSOe6Wat6dff2LaBOhzu2fRTo0k0Ryv1Z1NW8ftU_9LakKBqftyUWUBvBSk8oz2eNB_e-v5W7ciYbcII Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 981fdf8ae7524612b9c2f6a3f16c39ec Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 981fdf8ae7524612b9c2f6a3f16c39ec Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-SecurityGroupsTestJSON-321124649-project Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 5ddab9c74c004e74a51fd8008886e542 Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-SecurityGroupsTestJSON-321124649-project Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: exception: Security group c933467f-b7cd-4c3b-9712-730215a97d52 does not exist Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: Neutron server returns request_ids: ['req-29d7c356-0e43-4c2b-ab3b-1ae10c4bee39'] Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'c933467f-b7cd-4c3b-9712-730215a97d52'} Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 24 21:00:19.386831 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c933467f-b7cd-4c3b-9712-730215a97d52 does not exist Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-29d7c356-0e43-4c2b-ab3b-1ae10c4bee39'] Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c933467f-b7cd-4c3b-9712-730215a97d52 does not exist Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-29d7c356-0e43-4c2b-ab3b-1ae10c4bee39'] Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c933467f-b7cd-4c3b-9712-730215a97d52 does not exist Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-29d7c356-0e43-4c2b-ab3b-1ae10c4bee39'] Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c933467f-b7cd-4c3b-9712-730215a97d52 does not exist Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-29d7c356-0e43-4c2b-ab3b-1ae10c4bee39'] Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-24f9484d-1cab-463c-9e99-b16046fe5cbb tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Returning 404 to user: Security group c933467f-b7cd-4c3b-9712-730215a97d52 does not exist Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: Neutron server returns request_ids: ['req-29d7c356-0e43-4c2b-ab3b-1ae10c4bee39'] {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-24f9484d-1cab-463c-9e99-b16046fe5cbb tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/c933467f-b7cd-4c3b-9712-730215a97d52" status: 404 len: 194 microversion: 2.1 time: 0.074409 Sep 24 21:00:19.392717 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1470/2945] 10.222.0.52 () {58 vars in 1269 bytes} [Sat Sep 24 21:00:19 2022] GET /compute/v2.1/os-security-groups/c933467f-b7cd-4c3b-9712-730215a97d52 => generated 194 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:00:19.414117 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b1a87593-322f-4d6f-ab83-1b4cf693379e tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Action: 'create', calling method: .version_select at 0x7f4b07e493a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1103721155", "description": "tempest-description-1841816245"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:19.620133 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-807f0498-fdee-4cb9-8d76-92e11119ba6e tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:19.638098 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-807f0498-fdee-4cb9-8d76-92e11119ba6e tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1521 microversion: 2.1 time: 0.336675 Sep 24 21:00:19.640240 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1476/2946] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:19 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1521 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:19.650685 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-56e4923d-3619-4378-9035-e5c8e0f77bde tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:19.652346 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-56e4923d-3619-4378-9035-e5c8e0f77bde tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:19.662825 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56e4923d-3619-4378-9035-e5c8e0f77bde tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:19.664266 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56e4923d-3619-4378-9035-e5c8e0f77bde tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:19.664809 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56e4923d-3619-4378-9035-e5c8e0f77bde tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:19.665729 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56e4923d-3619-4378-9035-e5c8e0f77bde tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:19.666376 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56e4923d-3619-4378-9035-e5c8e0f77bde tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:19.666899 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56e4923d-3619-4378-9035-e5c8e0f77bde tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:19.839230 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b1a87593-322f-4d6f-ab83-1b4cf693379e tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.429752 Sep 24 21:00:19.840466 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1471/2947] 10.222.0.52 () {60 vars in 1180 bytes} [Sat Sep 24 21:00:19 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:00:19.844795 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-0976caf6-821f-44ff-8787-6376b4b3c30b req-5bf5d4d0-b4a6-4e39-8053-8e174db911c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f34bc2b-5e80-41a6-8898-7ca853cb26ab", "name": "network-vif-plugged", "status": "completed", "tag": "1a0c9d51-1224-48c7-935d-37553afea2e7"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:19.872288 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-0976caf6-821f-44ff-8787-6376b4b3c30b req-5bf5d4d0-b4a6-4e39-8053-8e174db911c7 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:19.873292 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-0976caf6-821f-44ff-8787-6376b4b3c30b req-5bf5d4d0-b4a6-4e39-8053-8e174db911c7 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:19.874527 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-0976caf6-821f-44ff-8787-6376b4b3c30b req-5bf5d4d0-b4a6-4e39-8053-8e174db911c7 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:19.903834 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-56e4923d-3619-4378-9035-e5c8e0f77bde tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:19.906481 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-0976caf6-821f-44ff-8787-6376b4b3c30b req-5bf5d4d0-b4a6-4e39-8053-8e174db911c7 service nova] Creating event network-vif-plugged:1a0c9d51-1224-48c7-935d-37553afea2e7 for instance 6f34bc2b-5e80-41a6-8898-7ca853cb26ab on nch1-master-1 Sep 24 21:00:19.912955 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-0976caf6-821f-44ff-8787-6376b4b3c30b req-5bf5d4d0-b4a6-4e39-8053-8e174db911c7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070801 Sep 24 21:00:19.914114 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1472/2948] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:00:19.919835 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a6d915c6-cbbc-40fa-9c8a-849106dbeeb4 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Action: 'create', calling method: .version_select at 0x7f4b07d03a60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-450415491", "description": "tempest-description-1754369095"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:19.920034 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-56e4923d-3619-4378-9035-e5c8e0f77bde tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1508 microversion: 2.1 time: 0.278340 Sep 24 21:00:19.922569 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1477/2949] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:19 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1508 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:19.931499 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-86879e5e-ffd1-4979-9125-77099aaf45f9 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:19.943329 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-86879e5e-ffd1-4979-9125-77099aaf45f9 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] [instance: 6f34bc2b-5e80-41a6-8898-7ca853cb26ab] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:19.952853 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86879e5e-ffd1-4979-9125-77099aaf45f9 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:19.953617 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86879e5e-ffd1-4979-9125-77099aaf45f9 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:19.954340 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86879e5e-ffd1-4979-9125-77099aaf45f9 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:19.955384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86879e5e-ffd1-4979-9125-77099aaf45f9 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:19.956224 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86879e5e-ffd1-4979-9125-77099aaf45f9 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:19.956889 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86879e5e-ffd1-4979-9125-77099aaf45f9 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:20.599011 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-86879e5e-ffd1-4979-9125-77099aaf45f9 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a689c647524dfdb492184b90c53b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a512ecd53242fb8dd25a0367ae8180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:20.609723 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a6d915c6-cbbc-40fa-9c8a-849106dbeeb4 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.694152 Sep 24 21:00:20.610238 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-86879e5e-ffd1-4979-9125-77099aaf45f9 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] 10.222.0.52 "GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab" status: 200 len: 1324 microversion: 2.1 time: 0.684957 Sep 24 21:00:20.611842 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1473/2950] 10.222.0.52 () {60 vars in 1180 bytes} [Sat Sep 24 21:00:19 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:00:20.627241 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1478/2951] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:19 2022] GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab => generated 1324 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:20.632594 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b8652401-6f3f-49ef-9baf-5da3f154bbc0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:20.636810 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b8652401-6f3f-49ef-9baf-5da3f154bbc0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:20.645009 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7ac50338-f024-48e4-b3d9-1193048ed125 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:20.645506 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7ac50338-f024-48e4-b3d9-1193048ed125 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:20.653566 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ac50338-f024-48e4-b3d9-1193048ed125 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:20.654123 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ac50338-f024-48e4-b3d9-1193048ed125 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:20.654592 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ac50338-f024-48e4-b3d9-1193048ed125 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:20.655959 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ac50338-f024-48e4-b3d9-1193048ed125 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:20.657042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ac50338-f024-48e4-b3d9-1193048ed125 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:20.657476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ac50338-f024-48e4-b3d9-1193048ed125 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:20.662049 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b8652401-6f3f-49ef-9baf-5da3f154bbc0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:20.662579 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b8652401-6f3f-49ef-9baf-5da3f154bbc0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:20.663033 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b8652401-6f3f-49ef-9baf-5da3f154bbc0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:20.663749 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b8652401-6f3f-49ef-9baf-5da3f154bbc0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:20.664203 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b8652401-6f3f-49ef-9baf-5da3f154bbc0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:20.664628 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b8652401-6f3f-49ef-9baf-5da3f154bbc0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:20.699579 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b8652401-6f3f-49ef-9baf-5da3f154bbc0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.085997 Sep 24 21:00:20.700147 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1474/2952] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:00:20 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:00:20.707714 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-23b0dad5-f911-4f7a-8c4a-95f790e0b435 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:20.708578 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-23b0dad5-f911-4f7a-8c4a-95f790e0b435 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:20.715518 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23b0dad5-f911-4f7a-8c4a-95f790e0b435 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:20.716212 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23b0dad5-f911-4f7a-8c4a-95f790e0b435 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:20.716838 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23b0dad5-f911-4f7a-8c4a-95f790e0b435 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:20.718638 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23b0dad5-f911-4f7a-8c4a-95f790e0b435 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:20.719299 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23b0dad5-f911-4f7a-8c4a-95f790e0b435 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:20.719887 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23b0dad5-f911-4f7a-8c4a-95f790e0b435 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:20.731046 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7ac50338-f024-48e4-b3d9-1193048ed125 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:20.740637 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7ac50338-f024-48e4-b3d9-1193048ed125 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:20.742893 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7ac50338-f024-48e4-b3d9-1193048ed125 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:20.748632 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7ac50338-f024-48e4-b3d9-1193048ed125 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1452 microversion: 2.75 time: 0.113183 Sep 24 21:00:20.763069 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1479/2953] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:00:20 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1452 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:00:20.768362 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-eb55fb50-fa9c-4b0e-9dde-487239356be8 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Action: 'create', calling method: .version_select at 0x7f4b0c5261f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1109530270", "description": "tempest-description-900882744"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:20.821511 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-23b0dad5-f911-4f7a-8c4a-95f790e0b435 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41f618458eb48f6bb4631fd254addc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4655b536ca04896993223f34d172298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:20.832867 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-23b0dad5-f911-4f7a-8c4a-95f790e0b435 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "GET /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130" status: 200 len: 1276 microversion: 2.1 time: 0.131284 Sep 24 21:00:20.833803 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1475/2954] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:20 2022] GET /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130 => generated 1276 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:20.839399 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-55fe68e5-f76a-4eaa-8b72-37fbc3a95d17 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:20.840395 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-55fe68e5-f76a-4eaa-8b72-37fbc3a95d17 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:20.850639 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-55fe68e5-f76a-4eaa-8b72-37fbc3a95d17 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:20.852096 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-55fe68e5-f76a-4eaa-8b72-37fbc3a95d17 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:20.852756 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-55fe68e5-f76a-4eaa-8b72-37fbc3a95d17 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:20.853643 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-55fe68e5-f76a-4eaa-8b72-37fbc3a95d17 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:20.854441 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-55fe68e5-f76a-4eaa-8b72-37fbc3a95d17 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:20.855089 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-55fe68e5-f76a-4eaa-8b72-37fbc3a95d17 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:21.117855 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-eb55fb50-fa9c-4b0e-9dde-487239356be8 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.353580 Sep 24 21:00:21.118462 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1480/2955] 10.222.0.52 () {60 vars in 1180 bytes} [Sat Sep 24 21:00:20 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:00:21.127022 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3860c71a-a960-430a-b9b7-a91001c09153 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:21.127640 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3860c71a-a960-430a-b9b7-a91001c09153 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:21.137277 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-55fe68e5-f76a-4eaa-8b72-37fbc3a95d17 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:21.146175 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-55fe68e5-f76a-4eaa-8b72-37fbc3a95d17 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1506 microversion: 2.1 time: 0.311130 Sep 24 21:00:21.148413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3860c71a-a960-430a-b9b7-a91001c09153 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:21.150167 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3860c71a-a960-430a-b9b7-a91001c09153 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:21.150830 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1476/2956] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:20 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1506 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:21.151625 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3860c71a-a960-430a-b9b7-a91001c09153 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:21.154474 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3860c71a-a960-430a-b9b7-a91001c09153 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:21.155748 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3860c71a-a960-430a-b9b7-a91001c09153 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:21.156317 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3860c71a-a960-430a-b9b7-a91001c09153 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:21.169119 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-39b7f96b-080e-4f5a-9770-be726226385a tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '.version_select at 0x7f4b07d03f70>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:21.385354 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3860c71a-a960-430a-b9b7-a91001c09153 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:21.398102 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3860c71a-a960-430a-b9b7-a91001c09153 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1508 microversion: 2.1 time: 0.274864 Sep 24 21:00:21.407228 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1481/2957] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:21 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1508 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:21.419768 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a473882c-6638-41c3-aeed-53d431bc07c7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:21.420443 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a473882c-6638-41c3-aeed-53d431bc07c7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:21.442306 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a473882c-6638-41c3-aeed-53d431bc07c7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:21.444631 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a473882c-6638-41c3-aeed-53d431bc07c7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:21.445196 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a473882c-6638-41c3-aeed-53d431bc07c7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:21.447490 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a473882c-6638-41c3-aeed-53d431bc07c7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:21.449094 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a473882c-6638-41c3-aeed-53d431bc07c7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:21.451202 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a473882c-6638-41c3-aeed-53d431bc07c7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:21.667182 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-39b7f96b-080e-4f5a-9770-be726226385a tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups" status: 200 len: 1834 microversion: 2.1 time: 0.514366 Sep 24 21:00:21.667905 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1477/2958] 10.222.0.52 () {58 vars in 1158 bytes} [Sat Sep 24 21:00:21 2022] GET /compute/v2.1/os-security-groups => generated 1834 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:21.673693 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5b9e1714-239a-4274-aaf2-c7d9dd2a4318 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:21.674459 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5b9e1714-239a-4274-aaf2-c7d9dd2a4318 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] [instance: 6f34bc2b-5e80-41a6-8898-7ca853cb26ab] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:21.692467 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b9e1714-239a-4274-aaf2-c7d9dd2a4318 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:21.693249 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b9e1714-239a-4274-aaf2-c7d9dd2a4318 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:21.697195 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b9e1714-239a-4274-aaf2-c7d9dd2a4318 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:21.698150 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b9e1714-239a-4274-aaf2-c7d9dd2a4318 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:21.698791 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b9e1714-239a-4274-aaf2-c7d9dd2a4318 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:21.699345 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b9e1714-239a-4274-aaf2-c7d9dd2a4318 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:21.710425 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a473882c-6638-41c3-aeed-53d431bc07c7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:21.723937 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a473882c-6638-41c3-aeed-53d431bc07c7 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 200 len: 1506 microversion: 2.1 time: 0.315269 Sep 24 21:00:21.724538 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1482/2959] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:21 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 1506 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:21.736289 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-96ed462c-27b5-4d19-8c4c-a042002ae1bf tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '.version_select at 0x7f4b0c5263a0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:21.955548 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5b9e1714-239a-4274-aaf2-c7d9dd2a4318 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a689c647524dfdb492184b90c53b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a512ecd53242fb8dd25a0367ae8180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:21.963854 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5b9e1714-239a-4274-aaf2-c7d9dd2a4318 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] 10.222.0.52 "GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab" status: 200 len: 1324 microversion: 2.1 time: 0.294796 Sep 24 21:00:21.968329 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1478/2960] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:21 2022] GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab => generated 1324 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:21.973858 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a669843c-9477-4d3c-b014-da5fb4aa9a00 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:21.983919 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a669843c-9477-4d3c-b014-da5fb4aa9a00 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:21.992145 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a669843c-9477-4d3c-b014-da5fb4aa9a00 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:21.992918 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a669843c-9477-4d3c-b014-da5fb4aa9a00 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:21.993522 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a669843c-9477-4d3c-b014-da5fb4aa9a00 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:21.994398 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a669843c-9477-4d3c-b014-da5fb4aa9a00 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:21.995032 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a669843c-9477-4d3c-b014-da5fb4aa9a00 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:21.995615 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a669843c-9477-4d3c-b014-da5fb4aa9a00 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:22.069940 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a669843c-9477-4d3c-b014-da5fb4aa9a00 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.100125 Sep 24 21:00:22.071995 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1479/2961] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:00:21 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:00:22.076915 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f0c28a3a-4080-4ca4-bc54-bb3613b069a0 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:22.078384 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f0c28a3a-4080-4ca4-bc54-bb3613b069a0 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:22.087139 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f0c28a3a-4080-4ca4-bc54-bb3613b069a0 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:22.088443 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f0c28a3a-4080-4ca4-bc54-bb3613b069a0 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:22.089055 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f0c28a3a-4080-4ca4-bc54-bb3613b069a0 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:22.089977 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f0c28a3a-4080-4ca4-bc54-bb3613b069a0 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:22.090823 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f0c28a3a-4080-4ca4-bc54-bb3613b069a0 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:22.091414 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f0c28a3a-4080-4ca4-bc54-bb3613b069a0 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:22.133419 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f0c28a3a-4080-4ca4-bc54-bb3613b069a0 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:00:22.198828 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-96ed462c-27b5-4d19-8c4c-a042002ae1bf tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/ea0c2e7a-6b48-448d-83eb-c131cba89471" status: 202 len: 0 microversion: 2.1 time: 0.473173 Sep 24 21:00:22.200075 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1483/2962] 10.222.0.52 () {58 vars in 1272 bytes} [Sat Sep 24 21:00:21 2022] DELETE /compute/v2.1/os-security-groups/ea0c2e7a-6b48-448d-83eb-c131cba89471 => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:00:22.207010 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1d863f1d-8083-43c0-aea1-be9d84e60cc7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:22.207693 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1d863f1d-8083-43c0-aea1-be9d84e60cc7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:22.230545 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d863f1d-8083-43c0-aea1-be9d84e60cc7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:22.235674 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d863f1d-8083-43c0-aea1-be9d84e60cc7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:22.236269 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d863f1d-8083-43c0-aea1-be9d84e60cc7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:22.238821 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d863f1d-8083-43c0-aea1-be9d84e60cc7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:22.239528 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d863f1d-8083-43c0-aea1-be9d84e60cc7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:22.240934 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d863f1d-8083-43c0-aea1-be9d84e60cc7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:22.283390 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f0c28a3a-4080-4ca4-bc54-bb3613b069a0 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 204 len: 0 microversion: 2.1 time: 0.210090 Sep 24 21:00:22.284027 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1480/2963] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:00:22 2022] DELETE /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:00:22.317751 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a3e44af4-3776-431c-bbfb-63c46c881de8 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:22.320527 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a3e44af4-3776-431c-bbfb-63c46c881de8 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:22.334382 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a3e44af4-3776-431c-bbfb-63c46c881de8 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:22.337378 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a3e44af4-3776-431c-bbfb-63c46c881de8 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:22.341408 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a3e44af4-3776-431c-bbfb-63c46c881de8 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:22.343388 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a3e44af4-3776-431c-bbfb-63c46c881de8 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:22.344174 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a3e44af4-3776-431c-bbfb-63c46c881de8 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:22.344834 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a3e44af4-3776-431c-bbfb-63c46c881de8 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:22.344953 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1d863f1d-8083-43c0-aea1-be9d84e60cc7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:22.353776 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1d863f1d-8083-43c0-aea1-be9d84e60cc7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:22.356538 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1d863f1d-8083-43c0-aea1-be9d84e60cc7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:22.362464 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1d863f1d-8083-43c0-aea1-be9d84e60cc7 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1452 microversion: 2.75 time: 0.161185 Sep 24 21:00:22.363605 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1484/2964] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:00:22 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:00:22.368595 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-12ee0ccd-092f-4d84-af8c-10e1b73148ed req-e9445a6d-4dfe-4111-8365-929089ca2d07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d546302-deb3-47c6-b9fd-3155ced00883", "name": "network-vif-plugged", "status": "completed", "tag": "56949465-71b8-45bb-b1d2-4b934bfc9714"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:22.380900 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-12ee0ccd-092f-4d84-af8c-10e1b73148ed req-e9445a6d-4dfe-4111-8365-929089ca2d07 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:22.381761 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-12ee0ccd-092f-4d84-af8c-10e1b73148ed req-e9445a6d-4dfe-4111-8365-929089ca2d07 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:22.382423 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-12ee0ccd-092f-4d84-af8c-10e1b73148ed req-e9445a6d-4dfe-4111-8365-929089ca2d07 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:22.402704 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-12ee0ccd-092f-4d84-af8c-10e1b73148ed req-e9445a6d-4dfe-4111-8365-929089ca2d07 service nova] Creating event network-vif-plugged:56949465-71b8-45bb-b1d2-4b934bfc9714 for instance 0d546302-deb3-47c6-b9fd-3155ced00883 on nch1-master-1 Sep 24 21:00:22.412735 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-12ee0ccd-092f-4d84-af8c-10e1b73148ed req-e9445a6d-4dfe-4111-8365-929089ca2d07 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047572 Sep 24 21:00:22.418328 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1485/2965] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:00:22.425197 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-495aabaa-f1c8-449e-b536-f00c9aa61d80 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '.version_select at 0x7f4b0c5ff8b0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:22.482977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG neutronclient.v2_0.client [None req-495aabaa-f1c8-449e-b536-f00c9aa61d80 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ea0c2e7a-6b48-448d-83eb-c131cba89471 does not exist", "detail": ""}} {{(pid=140516) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 24 21:00:22.484522 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.security_group_api [None req-495aabaa-f1c8-449e-b536-f00c9aa61d80 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Neutron security group ea0c2e7a-6b48-448d-83eb-c131cba89471 not found {{(pid=140516) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 24 21:00:22.485178 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-495aabaa-f1c8-449e-b536-f00c9aa61d80 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] HTTP exception thrown: Security group ea0c2e7a-6b48-448d-83eb-c131cba89471 does not exist Sep 24 21:00:22.485178 ncdv-master-1 devstack@n-api.service[140516]: Neutron server returns request_ids: ['req-a9306a70-7149-4b94-b7f3-c219b1bbb04f'] Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-495aabaa-f1c8-449e-b536-f00c9aa61d80 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Request method failure captured: Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/os-security-groups/ea0c2e7a-6b48-448d-83eb-c131cba89471 HTTP/1.1 Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL2_KTBoQE1biSOdbxiN02s3h0D1W3LZT4KXbL5sweudoA3LIqkhpSDHo_3ElsoW-S4pinCvYVIPwwmg75I3QYjyeUH8E9-UCSOe6Wat6dff2LaBOhzu2fRTo0k0Ryv1Z1NW8ftU_9LakKBqftyUWUBvBSk8oz2eNB_e-v5W7ciYbcII Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 981fdf8ae7524612b9c2f6a3f16c39ec Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 981fdf8ae7524612b9c2f6a3f16c39ec Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-SecurityGroupsTestJSON-321124649-project Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 5ddab9c74c004e74a51fd8008886e542 Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-SecurityGroupsTestJSON-321124649-project Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: exception: Security group ea0c2e7a-6b48-448d-83eb-c131cba89471 does not exist Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: Neutron server returns request_ids: ['req-a9306a70-7149-4b94-b7f3-c219b1bbb04f'] Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'ea0c2e7a-6b48-448d-83eb-c131cba89471'} Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 24 21:00:22.487636 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ea0c2e7a-6b48-448d-83eb-c131cba89471 does not exist Sep 24 21:00:22.492021 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a9306a70-7149-4b94-b7f3-c219b1bbb04f'] Sep 24 21:00:22.492021 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:00:22.492021 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:00:22.492021 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:00:22.492021 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:00:22.492021 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 24 21:00:22.492021 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 24 21:00:22.492021 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 24 21:00:22.492021 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 24 21:00:22.492021 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ea0c2e7a-6b48-448d-83eb-c131cba89471 does not exist Sep 24 21:00:22.492021 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a9306a70-7149-4b94-b7f3-c219b1bbb04f'] Sep 24 21:00:22.492021 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:00:22.492021 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:00:22.492021 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:00:22.492021 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:00:22.492021 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:00:22.492021 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:00:22.492021 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:00:22.492021 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:00:22.492021 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:00:22.492021 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:00:22.492021 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:00:22.492021 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:00:22.492021 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 24 21:00:22.492021 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 24 21:00:22.492021 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ea0c2e7a-6b48-448d-83eb-c131cba89471 does not exist Sep 24 21:00:22.492021 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a9306a70-7149-4b94-b7f3-c219b1bbb04f'] Sep 24 21:00:22.492021 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:00:22.492021 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:00:22.492021 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:00:22.492021 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:00:22.492021 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:00:22.492021 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:00:22.492021 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:00:22.492021 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:00:22.492021 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ea0c2e7a-6b48-448d-83eb-c131cba89471 does not exist Sep 24 21:00:22.492021 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a9306a70-7149-4b94-b7f3-c219b1bbb04f'] Sep 24 21:00:22.492021 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:00:22.494734 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-495aabaa-f1c8-449e-b536-f00c9aa61d80 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Returning 404 to user: Security group ea0c2e7a-6b48-448d-83eb-c131cba89471 does not exist Sep 24 21:00:22.494734 ncdv-master-1 devstack@n-api.service[140516]: Neutron server returns request_ids: ['req-a9306a70-7149-4b94-b7f3-c219b1bbb04f'] {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:00:22.495613 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-495aabaa-f1c8-449e-b536-f00c9aa61d80 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/ea0c2e7a-6b48-448d-83eb-c131cba89471" status: 404 len: 194 microversion: 2.1 time: 0.075162 Sep 24 21:00:22.496769 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1486/2966] 10.222.0.52 () {58 vars in 1269 bytes} [Sat Sep 24 21:00:22 2022] GET /compute/v2.1/os-security-groups/ea0c2e7a-6b48-448d-83eb-c131cba89471 => generated 194 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:00:22.503076 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9cc16a50-9b4b-4999-9092-597c74510c99 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:22.504936 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9cc16a50-9b4b-4999-9092-597c74510c99 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:22.515282 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9cc16a50-9b4b-4999-9092-597c74510c99 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:22.516175 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9cc16a50-9b4b-4999-9092-597c74510c99 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:22.516838 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9cc16a50-9b4b-4999-9092-597c74510c99 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:22.518372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9cc16a50-9b4b-4999-9092-597c74510c99 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:22.519855 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9cc16a50-9b4b-4999-9092-597c74510c99 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:22.520550 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9cc16a50-9b4b-4999-9092-597c74510c99 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:22.555268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a3e44af4-3776-431c-bbfb-63c46c881de8 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41f618458eb48f6bb4631fd254addc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4655b536ca04896993223f34d172298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:22.564048 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a3e44af4-3776-431c-bbfb-63c46c881de8 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "GET /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130" status: 200 len: 1324 microversion: 2.1 time: 0.278278 Sep 24 21:00:22.565282 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1481/2967] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:22 2022] GET /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130 => generated 1324 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:22.570003 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-acff67c4-e4f4-446d-a057-d83c273ce6b5 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-200414669", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "4d177ad8-2ce8-4cf6-95f9-d9dcf8f31aa4"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:22.641042 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-acff67c4-e4f4-446d-a057-d83c273ce6b5 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] validate_networks() for [('4d177ad8-2ce8-4cf6-95f9-d9dcf8f31aa4', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:00:22.791154 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9cc16a50-9b4b-4999-9092-597c74510c99 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:22.810141 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9cc16a50-9b4b-4999-9092-597c74510c99 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1508 microversion: 2.1 time: 0.312033 Sep 24 21:00:22.811400 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1487/2968] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:22 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1508 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:22.816793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-81b95367-2c86-43eb-a13e-da40940de31f tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '.version_select at 0x7f4b0c2f1f70>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:23.209672 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-81b95367-2c86-43eb-a13e-da40940de31f tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/d1298c50-0c5f-40d9-af8f-6161a17e3ed2" status: 202 len: 0 microversion: 2.1 time: 0.396756 Sep 24 21:00:23.210397 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1488/2969] 10.222.0.52 () {58 vars in 1272 bytes} [Sat Sep 24 21:00:22 2022] DELETE /compute/v2.1/os-security-groups/d1298c50-0c5f-40d9-af8f-6161a17e3ed2 => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:00:23.215909 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d2a14ef8-7d03-427a-8052-382e3def8149 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:23.216678 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d2a14ef8-7d03-427a-8052-382e3def8149 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] [instance: 6f34bc2b-5e80-41a6-8898-7ca853cb26ab] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:23.224540 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d2a14ef8-7d03-427a-8052-382e3def8149 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:23.225213 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d2a14ef8-7d03-427a-8052-382e3def8149 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:23.225754 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d2a14ef8-7d03-427a-8052-382e3def8149 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:23.226593 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d2a14ef8-7d03-427a-8052-382e3def8149 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:23.227270 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d2a14ef8-7d03-427a-8052-382e3def8149 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:23.227885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d2a14ef8-7d03-427a-8052-382e3def8149 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:23.254572 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-acff67c4-e4f4-446d-a057-d83c273ce6b5 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:00:23.255749 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-acff67c4-e4f4-446d-a057-d83c273ce6b5 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:00:23.256847 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-acff67c4-e4f4-446d-a057-d83c273ce6b5 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:00:23.257282 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-acff67c4-e4f4-446d-a057-d83c273ce6b5 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:00:23.257753 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-acff67c4-e4f4-446d-a057-d83c273ce6b5 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:00:23.268396 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-acff67c4-e4f4-446d-a057-d83c273ce6b5 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:23.268953 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-acff67c4-e4f4-446d-a057-d83c273ce6b5 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:23.269567 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-acff67c4-e4f4-446d-a057-d83c273ce6b5 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:23.270673 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-acff67c4-e4f4-446d-a057-d83c273ce6b5 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:23.271290 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-acff67c4-e4f4-446d-a057-d83c273ce6b5 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:23.271891 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-acff67c4-e4f4-446d-a057-d83c273ce6b5 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:23.294315 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-acff67c4-e4f4-446d-a057-d83c273ce6b5 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Getting quotas for project 8c875b2746384d5a9d02548faab6fd5d. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:00:23.301623 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-acff67c4-e4f4-446d-a057-d83c273ce6b5 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Getting quotas for user c84e7493d0ed47aca659dc925e8ca39c and project 8c875b2746384d5a9d02548faab6fd5d. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:00:23.315945 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-acff67c4-e4f4-446d-a057-d83c273ce6b5 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:00:23.318562 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-acff67c4-e4f4-446d-a057-d83c273ce6b5 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:00:23.367140 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-acff67c4-e4f4-446d-a057-d83c273ce6b5 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.800665 Sep 24 21:00:23.368050 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1482/2970] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:00:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:00:23.413080 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d2a14ef8-7d03-427a-8052-382e3def8149 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a689c647524dfdb492184b90c53b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a512ecd53242fb8dd25a0367ae8180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:23.422125 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d2a14ef8-7d03-427a-8052-382e3def8149 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] 10.222.0.52 "GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab" status: 200 len: 1324 microversion: 2.1 time: 0.210317 Sep 24 21:00:23.423040 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1489/2971] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:23 2022] GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab => generated 1324 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:23.428726 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9869c64f-0927-4ce0-bd64-5c599bc7930b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:23.431860 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9869c64f-0927-4ce0-bd64-5c599bc7930b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:23.439131 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9869c64f-0927-4ce0-bd64-5c599bc7930b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:23.440087 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9869c64f-0927-4ce0-bd64-5c599bc7930b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:23.440763 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9869c64f-0927-4ce0-bd64-5c599bc7930b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:23.441709 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9869c64f-0927-4ce0-bd64-5c599bc7930b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:23.442388 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9869c64f-0927-4ce0-bd64-5c599bc7930b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:23.443068 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9869c64f-0927-4ce0-bd64-5c599bc7930b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:23.469292 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-4293debe-7090-462f-ad2e-fc8668cb011e req-8c66bd77-389b-40ec-b683-9791f5c1ec5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "547cf9a4-1d05-4cbd-bb2b-ee5cbd406130", "tag": "52b5470e-7c8d-4f6a-b42e-9c45da96e2f1"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:23.479879 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9869c64f-0927-4ce0-bd64-5c599bc7930b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.055470 Sep 24 21:00:23.481026 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1490/2972] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:00:23 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:00:23.486324 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c8747873-e434-4de4-8e1f-78044ae709c3 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '.version_select at 0x7f4b0c5fc670>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:23.513976 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-4293debe-7090-462f-ad2e-fc8668cb011e req-8c66bd77-389b-40ec-b683-9791f5c1ec5c service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:23.514480 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-4293debe-7090-462f-ad2e-fc8668cb011e req-8c66bd77-389b-40ec-b683-9791f5c1ec5c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:23.516508 ncdv-master-1 devstack@n-api.service[140516]: DEBUG neutronclient.v2_0.client [None req-c8747873-e434-4de4-8e1f-78044ae709c3 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d1298c50-0c5f-40d9-af8f-6161a17e3ed2 does not exist", "detail": ""}} {{(pid=140516) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 24 21:00:23.517108 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.security_group_api [None req-c8747873-e434-4de4-8e1f-78044ae709c3 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Neutron security group d1298c50-0c5f-40d9-af8f-6161a17e3ed2 not found {{(pid=140516) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 24 21:00:23.517635 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-c8747873-e434-4de4-8e1f-78044ae709c3 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] HTTP exception thrown: Security group d1298c50-0c5f-40d9-af8f-6161a17e3ed2 does not exist Sep 24 21:00:23.517635 ncdv-master-1 devstack@n-api.service[140516]: Neutron server returns request_ids: ['req-14ca83fa-c6d1-4fb4-951a-256dcf970be2'] Sep 24 21:00:23.518858 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-4293debe-7090-462f-ad2e-fc8668cb011e req-8c66bd77-389b-40ec-b683-9791f5c1ec5c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c8747873-e434-4de4-8e1f-78044ae709c3 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Request method failure captured: Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/os-security-groups/d1298c50-0c5f-40d9-af8f-6161a17e3ed2 HTTP/1.1 Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL2_KTBoQE1biSOdbxiN02s3h0D1W3LZT4KXbL5sweudoA3LIqkhpSDHo_3ElsoW-S4pinCvYVIPwwmg75I3QYjyeUH8E9-UCSOe6Wat6dff2LaBOhzu2fRTo0k0Ryv1Z1NW8ftU_9LakKBqftyUWUBvBSk8oz2eNB_e-v5W7ciYbcII Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 981fdf8ae7524612b9c2f6a3f16c39ec Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 981fdf8ae7524612b9c2f6a3f16c39ec Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-SecurityGroupsTestJSON-321124649-project Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 5ddab9c74c004e74a51fd8008886e542 Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-SecurityGroupsTestJSON-321124649-project Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: exception: Security group d1298c50-0c5f-40d9-af8f-6161a17e3ed2 does not exist Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: Neutron server returns request_ids: ['req-14ca83fa-c6d1-4fb4-951a-256dcf970be2'] Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'd1298c50-0c5f-40d9-af8f-6161a17e3ed2'} Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 24 21:00:23.519529 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d1298c50-0c5f-40d9-af8f-6161a17e3ed2 does not exist Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-14ca83fa-c6d1-4fb4-951a-256dcf970be2'] Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d1298c50-0c5f-40d9-af8f-6161a17e3ed2 does not exist Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-14ca83fa-c6d1-4fb4-951a-256dcf970be2'] Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d1298c50-0c5f-40d9-af8f-6161a17e3ed2 does not exist Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-14ca83fa-c6d1-4fb4-951a-256dcf970be2'] Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d1298c50-0c5f-40d9-af8f-6161a17e3ed2 does not exist Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-14ca83fa-c6d1-4fb4-951a-256dcf970be2'] Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c8747873-e434-4de4-8e1f-78044ae709c3 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Returning 404 to user: Security group d1298c50-0c5f-40d9-af8f-6161a17e3ed2 does not exist Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: Neutron server returns request_ids: ['req-14ca83fa-c6d1-4fb4-951a-256dcf970be2'] {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c8747873-e434-4de4-8e1f-78044ae709c3 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/d1298c50-0c5f-40d9-af8f-6161a17e3ed2" status: 404 len: 194 microversion: 2.1 time: 0.038790 Sep 24 21:00:23.523620 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1491/2973] 10.222.0.52 () {58 vars in 1269 bytes} [Sat Sep 24 21:00:23 2022] GET /compute/v2.1/os-security-groups/d1298c50-0c5f-40d9-af8f-6161a17e3ed2 => generated 194 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:00:23.529218 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-22d4f147-3a35-4e79-8149-c08d0277defb tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:23.529218 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-22d4f147-3a35-4e79-8149-c08d0277defb tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:23.541791 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-4293debe-7090-462f-ad2e-fc8668cb011e req-8c66bd77-389b-40ec-b683-9791f5c1ec5c service nova] Creating event network-changed:52b5470e-7c8d-4f6a-b42e-9c45da96e2f1 for instance 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130 on nch2-master-1 Sep 24 21:00:23.554023 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-4293debe-7090-462f-ad2e-fc8668cb011e req-8c66bd77-389b-40ec-b683-9791f5c1ec5c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185011 Sep 24 21:00:23.555495 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1483/2974] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:00:23.562230 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-93313ab7-fd3a-4028-8526-2407737a23e4 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:23.563367 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-93313ab7-fd3a-4028-8526-2407737a23e4 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:23.570700 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93313ab7-fd3a-4028-8526-2407737a23e4 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:23.571433 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93313ab7-fd3a-4028-8526-2407737a23e4 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:23.572042 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93313ab7-fd3a-4028-8526-2407737a23e4 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:23.573149 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93313ab7-fd3a-4028-8526-2407737a23e4 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:23.574035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93313ab7-fd3a-4028-8526-2407737a23e4 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:23.574701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93313ab7-fd3a-4028-8526-2407737a23e4 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:23.590617 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-22d4f147-3a35-4e79-8149-c08d0277defb tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:23.600114 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-22d4f147-3a35-4e79-8149-c08d0277defb tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c" status: 200 len: 1217 microversion: 2.1 time: 0.076898 Sep 24 21:00:23.615119 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1492/2975] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:23 2022] GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:23.620852 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e2b79b34-dd53-464d-ab04-d76418833287 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '.version_select at 0x7f4b0c569ca0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:23.667085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-93313ab7-fd3a-4028-8526-2407737a23e4 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:23.676336 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-93313ab7-fd3a-4028-8526-2407737a23e4 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:23.678035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-93313ab7-fd3a-4028-8526-2407737a23e4 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:23.683166 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-93313ab7-fd3a-4028-8526-2407737a23e4 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1437 microversion: 2.75 time: 0.126354 Sep 24 21:00:23.684054 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1484/2976] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:00:23 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1437 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:00:23.694450 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-82f0fca2-ca6b-40e1-8bc9-2fdf878596ff tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:23.695368 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-82f0fca2-ca6b-40e1-8bc9-2fdf878596ff tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:23.701758 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82f0fca2-ca6b-40e1-8bc9-2fdf878596ff tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:23.702832 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82f0fca2-ca6b-40e1-8bc9-2fdf878596ff tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:23.703299 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82f0fca2-ca6b-40e1-8bc9-2fdf878596ff tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:23.704110 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82f0fca2-ca6b-40e1-8bc9-2fdf878596ff tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:23.704764 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82f0fca2-ca6b-40e1-8bc9-2fdf878596ff tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:23.705359 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82f0fca2-ca6b-40e1-8bc9-2fdf878596ff tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:23.896982 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-82f0fca2-ca6b-40e1-8bc9-2fdf878596ff tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41f618458eb48f6bb4631fd254addc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4655b536ca04896993223f34d172298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:23.907221 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-82f0fca2-ca6b-40e1-8bc9-2fdf878596ff tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "GET /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130" status: 200 len: 1324 microversion: 2.1 time: 0.221641 Sep 24 21:00:23.907816 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1485/2977] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:23 2022] GET /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130 => generated 1324 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:23.942485 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e2b79b34-dd53-464d-ab04-d76418833287 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/a49c3057-be3b-4d9a-a9d9-fc28db0e243e" status: 202 len: 0 microversion: 2.1 time: 0.326200 Sep 24 21:00:23.943829 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1493/2978] 10.222.0.52 () {58 vars in 1272 bytes} [Sat Sep 24 21:00:23 2022] DELETE /compute/v2.1/os-security-groups/a49c3057-be3b-4d9a-a9d9-fc28db0e243e => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:00:23.953649 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0d077c0a-893c-4733-9809-b91a7cd1479a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:23.955856 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0d077c0a-893c-4733-9809-b91a7cd1479a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:23.993647 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d077c0a-893c-4733-9809-b91a7cd1479a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:23.994534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d077c0a-893c-4733-9809-b91a7cd1479a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:23.995143 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d077c0a-893c-4733-9809-b91a7cd1479a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:23.996007 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d077c0a-893c-4733-9809-b91a7cd1479a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:23.996633 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d077c0a-893c-4733-9809-b91a7cd1479a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:23.997201 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d077c0a-893c-4733-9809-b91a7cd1479a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:24.057558 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-79776785-846c-44cb-8ef1-add3364da03d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:24.060605 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-79776785-846c-44cb-8ef1-add3364da03d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:24.067367 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79776785-846c-44cb-8ef1-add3364da03d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:24.067969 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79776785-846c-44cb-8ef1-add3364da03d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:24.068484 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79776785-846c-44cb-8ef1-add3364da03d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:24.069915 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79776785-846c-44cb-8ef1-add3364da03d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:24.070456 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79776785-846c-44cb-8ef1-add3364da03d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:24.071021 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79776785-846c-44cb-8ef1-add3364da03d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:24.160118 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-79776785-846c-44cb-8ef1-add3364da03d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:00:24.160620 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-79776785-846c-44cb-8ef1-add3364da03d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:00:24.161169 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-79776785-846c-44cb-8ef1-add3364da03d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:00:24.161653 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-79776785-846c-44cb-8ef1-add3364da03d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:00:24.161964 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0d077c0a-893c-4733-9809-b91a7cd1479a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:24.162220 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-79776785-846c-44cb-8ef1-add3364da03d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:00:24.170292 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0d077c0a-893c-4733-9809-b91a7cd1479a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1508 microversion: 2.1 time: 0.225347 Sep 24 21:00:24.171109 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1494/2979] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:23 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1508 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:24.176026 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-05bf2efd-43e8-4608-b2ed-b12c0c1750ec tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '.version_select at 0x7f4b0c569d30>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:24.200070 ncdv-master-1 devstack@n-api.service[140516]: DEBUG neutronclient.v2_0.client [None req-05bf2efd-43e8-4608-b2ed-b12c0c1750ec tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a49c3057-be3b-4d9a-a9d9-fc28db0e243e does not exist", "detail": ""}} {{(pid=140516) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 24 21:00:24.200672 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.security_group_api [None req-05bf2efd-43e8-4608-b2ed-b12c0c1750ec tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Neutron security group a49c3057-be3b-4d9a-a9d9-fc28db0e243e not found {{(pid=140516) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 24 21:00:24.201244 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-05bf2efd-43e8-4608-b2ed-b12c0c1750ec tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] HTTP exception thrown: Security group a49c3057-be3b-4d9a-a9d9-fc28db0e243e does not exist Sep 24 21:00:24.201244 ncdv-master-1 devstack@n-api.service[140516]: Neutron server returns request_ids: ['req-5a0fca3a-cc92-4c9b-af31-af55611aad6b'] Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-05bf2efd-43e8-4608-b2ed-b12c0c1750ec tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Request method failure captured: Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/os-security-groups/a49c3057-be3b-4d9a-a9d9-fc28db0e243e HTTP/1.1 Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL2_KTBoQE1biSOdbxiN02s3h0D1W3LZT4KXbL5sweudoA3LIqkhpSDHo_3ElsoW-S4pinCvYVIPwwmg75I3QYjyeUH8E9-UCSOe6Wat6dff2LaBOhzu2fRTo0k0Ryv1Z1NW8ftU_9LakKBqftyUWUBvBSk8oz2eNB_e-v5W7ciYbcII Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 981fdf8ae7524612b9c2f6a3f16c39ec Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 981fdf8ae7524612b9c2f6a3f16c39ec Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-SecurityGroupsTestJSON-321124649-project Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 5ddab9c74c004e74a51fd8008886e542 Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-SecurityGroupsTestJSON-321124649-project Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: exception: Security group a49c3057-be3b-4d9a-a9d9-fc28db0e243e does not exist Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: Neutron server returns request_ids: ['req-5a0fca3a-cc92-4c9b-af31-af55611aad6b'] Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'a49c3057-be3b-4d9a-a9d9-fc28db0e243e'} Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 24 21:00:24.203915 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a49c3057-be3b-4d9a-a9d9-fc28db0e243e does not exist Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5a0fca3a-cc92-4c9b-af31-af55611aad6b'] Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a49c3057-be3b-4d9a-a9d9-fc28db0e243e does not exist Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5a0fca3a-cc92-4c9b-af31-af55611aad6b'] Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a49c3057-be3b-4d9a-a9d9-fc28db0e243e does not exist Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5a0fca3a-cc92-4c9b-af31-af55611aad6b'] Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a49c3057-be3b-4d9a-a9d9-fc28db0e243e does not exist Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5a0fca3a-cc92-4c9b-af31-af55611aad6b'] Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-05bf2efd-43e8-4608-b2ed-b12c0c1750ec tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Returning 404 to user: Security group a49c3057-be3b-4d9a-a9d9-fc28db0e243e does not exist Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: Neutron server returns request_ids: ['req-5a0fca3a-cc92-4c9b-af31-af55611aad6b'] {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:00:24.208198 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-05bf2efd-43e8-4608-b2ed-b12c0c1750ec tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/a49c3057-be3b-4d9a-a9d9-fc28db0e243e" status: 404 len: 194 microversion: 2.1 time: 0.033061 Sep 24 21:00:24.211192 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1495/2980] 10.222.0.52 () {58 vars in 1269 bytes} [Sat Sep 24 21:00:24 2022] GET /compute/v2.1/os-security-groups/a49c3057-be3b-4d9a-a9d9-fc28db0e243e => generated 194 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:00:24.213977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-86741729-3ce9-427c-ac6b-eee1ac6e515a tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '.version_select at 0x7f4b0c526430>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:24.227516 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-79776785-846c-44cb-8ef1-add3364da03d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:24.238135 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79776785-846c-44cb-8ef1-add3364da03d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:24.238790 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79776785-846c-44cb-8ef1-add3364da03d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:24.239911 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79776785-846c-44cb-8ef1-add3364da03d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:24.240286 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79776785-846c-44cb-8ef1-add3364da03d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:24.241060 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79776785-846c-44cb-8ef1-add3364da03d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:24.241490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79776785-846c-44cb-8ef1-add3364da03d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:24.268430 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:00:24.364640 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-79776785-846c-44cb-8ef1-add3364da03d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lazy-loading 'services' on Instance uuid 1d8bc459-871f-4611-ba95-7bf7d0f08a27 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:00:24.382175 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-79776785-846c-44cb-8ef1-add3364da03d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27/action" status: 202 len: 1940 microversion: 2.75 time: 0.472954 Sep 24 21:00:24.382863 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1486/2981] 10.222.0.52 () {62 vars in 1319 bytes} [Sat Sep 24 21:00:23 2022] POST /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27/action => generated 1940 bytes in 474 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 24 21:00:24.415136 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3301c3b0-33ba-4f06-8670-104478b6af04 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:24.416129 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3301c3b0-33ba-4f06-8670-104478b6af04 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:24.424655 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3301c3b0-33ba-4f06-8670-104478b6af04 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:24.425232 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3301c3b0-33ba-4f06-8670-104478b6af04 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:24.425695 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3301c3b0-33ba-4f06-8670-104478b6af04 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:24.426598 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3301c3b0-33ba-4f06-8670-104478b6af04 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:24.427148 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3301c3b0-33ba-4f06-8670-104478b6af04 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:24.427505 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3301c3b0-33ba-4f06-8670-104478b6af04 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:24.544624 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-3301c3b0-33ba-4f06-8670-104478b6af04 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lazy-loading 'services' on Instance uuid 1d8bc459-871f-4611-ba95-7bf7d0f08a27 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:00:24.556801 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-86741729-3ce9-427c-ac6b-eee1ac6e515a tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.346306 Sep 24 21:00:24.557383 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1496/2982] 10.222.0.52 () {58 vars in 1158 bytes} [Sat Sep 24 21:00:24 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:24.563708 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0ee2f1e2-fa18-4c30-9a18-0bb582dcd85e tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:24.564337 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0ee2f1e2-fa18-4c30-9a18-0bb582dcd85e tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] [instance: 6f34bc2b-5e80-41a6-8898-7ca853cb26ab] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:24.579417 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3301c3b0-33ba-4f06-8670-104478b6af04 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1927 microversion: 2.75 time: 0.171208 Sep 24 21:00:24.579660 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0ee2f1e2-fa18-4c30-9a18-0bb582dcd85e tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:24.580125 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0ee2f1e2-fa18-4c30-9a18-0bb582dcd85e tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:24.580951 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1487/2983] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:00:24 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1927 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:00:24.581873 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0ee2f1e2-fa18-4c30-9a18-0bb582dcd85e tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:24.582791 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0ee2f1e2-fa18-4c30-9a18-0bb582dcd85e tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:24.583432 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0ee2f1e2-fa18-4c30-9a18-0bb582dcd85e tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:24.584061 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0ee2f1e2-fa18-4c30-9a18-0bb582dcd85e tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:24.585585 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9999e647-b7ad-4975-b8ea-13219e1672f1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:24.588433 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9999e647-b7ad-4975-b8ea-13219e1672f1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:24.595217 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9999e647-b7ad-4975-b8ea-13219e1672f1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:24.595873 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9999e647-b7ad-4975-b8ea-13219e1672f1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:24.596424 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9999e647-b7ad-4975-b8ea-13219e1672f1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:24.597269 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9999e647-b7ad-4975-b8ea-13219e1672f1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:24.598178 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9999e647-b7ad-4975-b8ea-13219e1672f1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:24.598887 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9999e647-b7ad-4975-b8ea-13219e1672f1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:24.635166 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9999e647-b7ad-4975-b8ea-13219e1672f1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.053443 Sep 24 21:00:24.640669 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1488/2984] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:00:24 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:00:24.648499 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8c0685e4-c586-42b2-aaa6-ddf749d8f989 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Action: 'create', calling method: .version_select at 0x7f4b07eb9940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2085541972", "description": "tempest-description-959625333"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:24.939981 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0ee2f1e2-fa18-4c30-9a18-0bb582dcd85e tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a689c647524dfdb492184b90c53b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a512ecd53242fb8dd25a0367ae8180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:24.953088 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0ee2f1e2-fa18-4c30-9a18-0bb582dcd85e tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] 10.222.0.52 "GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab" status: 200 len: 1520 microversion: 2.1 time: 0.393803 Sep 24 21:00:24.955283 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1497/2985] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:24 2022] GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab => generated 1520 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:24.973569 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3ce85ef5-f650-4699-b0b4-e958fffea59a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:24.976259 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3ce85ef5-f650-4699-b0b4-e958fffea59a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:24.993351 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3ce85ef5-f650-4699-b0b4-e958fffea59a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:24.993956 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3ce85ef5-f650-4699-b0b4-e958fffea59a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:24.995056 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3ce85ef5-f650-4699-b0b4-e958fffea59a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:24.996068 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3ce85ef5-f650-4699-b0b4-e958fffea59a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:24.996911 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3ce85ef5-f650-4699-b0b4-e958fffea59a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:24.997678 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3ce85ef5-f650-4699-b0b4-e958fffea59a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:25.004624 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:00:25.153025 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8c0685e4-c586-42b2-aaa6-ddf749d8f989 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.511233 Sep 24 21:00:25.153707 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1489/2986] 10.222.0.52 () {60 vars in 1180 bytes} [Sat Sep 24 21:00:24 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:00:25.164072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3ce85ef5-f650-4699-b0b4-e958fffea59a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:25.166970 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-400f4897-a797-4569-bb45-235883102c31 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:25.167881 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-400f4897-a797-4569-bb45-235883102c31 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:25.177249 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-400f4897-a797-4569-bb45-235883102c31 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:25.177992 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-400f4897-a797-4569-bb45-235883102c31 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:25.178715 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-400f4897-a797-4569-bb45-235883102c31 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:25.179642 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-400f4897-a797-4569-bb45-235883102c31 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:25.180408 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-400f4897-a797-4569-bb45-235883102c31 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:25.181056 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-400f4897-a797-4569-bb45-235883102c31 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:25.188601 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3ce85ef5-f650-4699-b0b4-e958fffea59a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c" status: 200 len: 1269 microversion: 2.1 time: 0.230726 Sep 24 21:00:25.204507 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1498/2987] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:24 2022] GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c => generated 1269 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:25.213976 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-19b615b1-6aca-4e24-9798-9ab057995856 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:25.214884 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-19b615b1-6aca-4e24-9798-9ab057995856 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] [instance: 6f34bc2b-5e80-41a6-8898-7ca853cb26ab] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:25.222259 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-19b615b1-6aca-4e24-9798-9ab057995856 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:25.223113 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-19b615b1-6aca-4e24-9798-9ab057995856 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:25.223789 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-19b615b1-6aca-4e24-9798-9ab057995856 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:25.225152 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-19b615b1-6aca-4e24-9798-9ab057995856 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:25.226147 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-19b615b1-6aca-4e24-9798-9ab057995856 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:25.227059 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-19b615b1-6aca-4e24-9798-9ab057995856 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:25.309192 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-19b615b1-6aca-4e24-9798-9ab057995856 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] HTTP exception thrown: Action 999 not found Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-19b615b1-6aca-4e24-9798-9ab057995856 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Request method failure captured: Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab/os-instance-actions/999 HTTP/1.1 Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL2_RP8TkxCW-p0J28yQE4kjMmNTbXIp3rqP91E8cUI8glapgtkErvpBLF9SqP2RYJrThfXNgTsqy7Te_-bvYmvOK3cJvnuOmN0qda-RARgP1F_INVQKiDjBfhuK3E2NTDqnoKWxHiGlgN2ZKfNXq4Jj6lANd1K6RxT_tN-DneusrxMQ Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 18a512ecd53242fb8dd25a0367ae8180 Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1173885560 Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/18a512ecd53242fb8dd25a0367ae8180"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_18a512ecd53242fb8dd25a0367ae8180"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/18a512ecd53242fb8dd25a0367ae8180"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/18a512ecd53242fb8dd25a0367ae8180"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1173885560 Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 18a512ecd53242fb8dd25a0367ae8180 Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1173885560 Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-InstanceActionsNegativeTestJSON-1173885560-project Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 81a689c647524dfdb492184b90c53b05 Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1173885560-project Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: exception: Action 999 not found Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'server_id': '6f34bc2b-5e80-41a6-8898-7ca853cb26ab', 'id': '999'} Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Sep 24 21:00:25.329802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:00:25.350027 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-19b615b1-6aca-4e24-9798-9ab057995856 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Returning 404 to user: Action 999 not found {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:00:25.351301 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-19b615b1-6aca-4e24-9798-9ab057995856 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] 10.222.0.52 "GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.145184 Sep 24 21:00:25.351931 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1499/2988] 10.222.0.52 () {58 vars in 1308 bytes} [Sat Sep 24 21:00:25 2022] GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab/os-instance-actions/999 => generated 66 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 21:00:25.364421 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-572a2648-3dff-49be-afda-59789a5889a5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Action: 'create', calling method: .version_select at 0x7f4b0c133f70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-442181444", "description": "tempest-description-535995081"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:25.655979 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-400f4897-a797-4569-bb45-235883102c31 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41f618458eb48f6bb4631fd254addc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4655b536ca04896993223f34d172298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:25.665733 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-400f4897-a797-4569-bb45-235883102c31 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "GET /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130" status: 200 len: 1324 microversion: 2.1 time: 0.502503 Sep 24 21:00:25.669489 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1490/2989] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:25 2022] GET /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130 => generated 1324 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:25.682747 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-de429494-40b7-4f93-9df6-d4cf4329cb93 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:25.683595 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-de429494-40b7-4f93-9df6-d4cf4329cb93 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:25.700998 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de429494-40b7-4f93-9df6-d4cf4329cb93 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:25.707365 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de429494-40b7-4f93-9df6-d4cf4329cb93 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:25.707834 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de429494-40b7-4f93-9df6-d4cf4329cb93 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:25.708607 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de429494-40b7-4f93-9df6-d4cf4329cb93 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:25.709107 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de429494-40b7-4f93-9df6-d4cf4329cb93 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:25.709529 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de429494-40b7-4f93-9df6-d4cf4329cb93 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:26.142826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-de429494-40b7-4f93-9df6-d4cf4329cb93 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:26.153893 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-de429494-40b7-4f93-9df6-d4cf4329cb93 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1508 microversion: 2.1 time: 0.480948 Sep 24 21:00:26.155703 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1491/2990] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:25 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1508 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:26.161355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-51921a64-c876-41d5-a939-8f42130c9838 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Calling method '.version_select at 0x7f4b07d03d30>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:26.162007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-51921a64-c876-41d5-a939-8f42130c9838 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] [instance: bb369a17-c468-4895-8d62-166f0318130f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:26.168357 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-51921a64-c876-41d5-a939-8f42130c9838 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] HTTP exception thrown: Instance bb369a17-c468-4895-8d62-166f0318130f could not be found. Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-51921a64-c876-41d5-a939-8f42130c9838 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Request method failure captured: Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/bb369a17-c468-4895-8d62-166f0318130f/os-instance-actions HTTP/1.1 Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL2_RP8TkxCW-p0J28yQE4kjMmNTbXIp3rqP91E8cUI8glapgtkErvpBLF9SqP2RYJrThfXNgTsqy7Te_-bvYmvOK3cJvnuOmN0qda-RARgP1F_INVQKiDjBfhuK3E2NTDqnoKWxHiGlgN2ZKfNXq4Jj6lANd1K6RxT_tN-DneusrxMQ Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 18a512ecd53242fb8dd25a0367ae8180 Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1173885560 Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/18a512ecd53242fb8dd25a0367ae8180"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_18a512ecd53242fb8dd25a0367ae8180"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/18a512ecd53242fb8dd25a0367ae8180"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/18a512ecd53242fb8dd25a0367ae8180"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1173885560 Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 18a512ecd53242fb8dd25a0367ae8180 Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1173885560 Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-InstanceActionsNegativeTestJSON-1173885560-project Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 81a689c647524dfdb492184b90c53b05 Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1173885560-project Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance bb369a17-c468-4895-8d62-166f0318130f could not be found. Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'server_id': 'bb369a17-c468-4895-8d62-166f0318130f'} Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb369a17-c468-4895-8d62-166f0318130f could not be found. Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:00:26.171217 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:00:26.176324 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb369a17-c468-4895-8d62-166f0318130f could not be found. Sep 24 21:00:26.176324 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:00:26.176324 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:00:26.176324 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:00:26.176324 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:00:26.176324 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:00:26.176324 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:00:26.176324 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:00:26.176324 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:00:26.176324 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb369a17-c468-4895-8d62-166f0318130f could not be found. Sep 24 21:00:26.176324 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:00:26.178767 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-51921a64-c876-41d5-a939-8f42130c9838 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Returning 404 to user: Instance bb369a17-c468-4895-8d62-166f0318130f could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:00:26.179871 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-51921a64-c876-41d5-a939-8f42130c9838 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] 10.222.0.52 "GET /compute/v2.1/servers/bb369a17-c468-4895-8d62-166f0318130f/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.022948 Sep 24 21:00:26.180957 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1492/2991] 10.222.0.52 () {58 vars in 1296 bytes} [Sat Sep 24 21:00:26 2022] GET /compute/v2.1/servers/bb369a17-c468-4895-8d62-166f0318130f/os-instance-actions => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:00:26.198301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-415c28af-f6c7-47a2-8fbc-673d1a6b84f9 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:26.199375 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-415c28af-f6c7-47a2-8fbc-673d1a6b84f9 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:26.202604 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-572a2648-3dff-49be-afda-59789a5889a5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.848568 Sep 24 21:00:26.203728 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1500/2992] 10.222.0.52 () {60 vars in 1180 bytes} [Sat Sep 24 21:00:25 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:00:26.209095 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9230e0ef-0831-4825-af81-b873a3351965 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:26.211884 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9230e0ef-0831-4825-af81-b873a3351965 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:26.219234 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-415c28af-f6c7-47a2-8fbc-673d1a6b84f9 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:26.219984 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-415c28af-f6c7-47a2-8fbc-673d1a6b84f9 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:26.220580 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-415c28af-f6c7-47a2-8fbc-673d1a6b84f9 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:26.221786 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-415c28af-f6c7-47a2-8fbc-673d1a6b84f9 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:26.222909 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-415c28af-f6c7-47a2-8fbc-673d1a6b84f9 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:26.223580 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-415c28af-f6c7-47a2-8fbc-673d1a6b84f9 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:26.225343 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:00:26.237528 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9230e0ef-0831-4825-af81-b873a3351965 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:26.240057 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9230e0ef-0831-4825-af81-b873a3351965 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:26.240682 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9230e0ef-0831-4825-af81-b873a3351965 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:26.242761 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9230e0ef-0831-4825-af81-b873a3351965 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:26.245528 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9230e0ef-0831-4825-af81-b873a3351965 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:26.246163 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9230e0ef-0831-4825-af81-b873a3351965 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:26.331310 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9230e0ef-0831-4825-af81-b873a3351965 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.126001 Sep 24 21:00:26.331928 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1501/2993] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:00:26 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:00:26.348268 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-0977d7f2-9adf-4248-8160-e25f0cdd0065 req-0203cfa9-122a-4fb3-b016-1ab887066c77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf34d10c-76c3-4798-9a3f-083aeb681fd6", "name": "network-vif-deleted", "tag": "e7eddae5-24be-47f8-893f-5fecfb04b6ef"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:26.361484 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-0977d7f2-9adf-4248-8160-e25f0cdd0065 req-0203cfa9-122a-4fb3-b016-1ab887066c77 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:26.362601 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-0977d7f2-9adf-4248-8160-e25f0cdd0065 req-0203cfa9-122a-4fb3-b016-1ab887066c77 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:26.363377 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-0977d7f2-9adf-4248-8160-e25f0cdd0065 req-0203cfa9-122a-4fb3-b016-1ab887066c77 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:26.399348 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-0977d7f2-9adf-4248-8160-e25f0cdd0065 req-0203cfa9-122a-4fb3-b016-1ab887066c77 service nova] Creating event network-vif-deleted:e7eddae5-24be-47f8-893f-5fecfb04b6ef for instance cf34d10c-76c3-4798-9a3f-083aeb681fd6 on nch1-master-1 Sep 24 21:00:26.409032 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-0977d7f2-9adf-4248-8160-e25f0cdd0065 req-0203cfa9-122a-4fb3-b016-1ab887066c77 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075850 Sep 24 21:00:26.410311 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1502/2994] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:00:26.416062 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-babbd243-d86d-4c7d-8453-d67d70c2ca1f tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:26.416904 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-babbd243-d86d-4c7d-8453-d67d70c2ca1f tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] [instance: 6f34bc2b-5e80-41a6-8898-7ca853cb26ab] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:26.426719 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-babbd243-d86d-4c7d-8453-d67d70c2ca1f tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:26.428114 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-babbd243-d86d-4c7d-8453-d67d70c2ca1f tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:26.428770 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-babbd243-d86d-4c7d-8453-d67d70c2ca1f tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:26.429690 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-babbd243-d86d-4c7d-8453-d67d70c2ca1f tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:26.430344 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-babbd243-d86d-4c7d-8453-d67d70c2ca1f tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:26.431027 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-babbd243-d86d-4c7d-8453-d67d70c2ca1f tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:26.470369 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-babbd243-d86d-4c7d-8453-d67d70c2ca1f tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] [instance: 6f34bc2b-5e80-41a6-8898-7ca853cb26ab] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:00:26.574093 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-415c28af-f6c7-47a2-8fbc-673d1a6b84f9 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lazy-loading 'services' on Instance uuid 1d8bc459-871f-4611-ba95-7bf7d0f08a27 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:00:26.655433 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-415c28af-f6c7-47a2-8fbc-673d1a6b84f9 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1927 microversion: 2.75 time: 0.459282 Sep 24 21:00:26.667010 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1493/2995] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:00:26 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1927 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:00:26.669829 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-babbd243-d86d-4c7d-8453-d67d70c2ca1f tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab" status: 204 len: 0 microversion: 2.1 time: 0.257864 Sep 24 21:00:26.674593 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1503/2996] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:00:26 2022] DELETE /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:00:26.685563 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9d7338d1-dd91-4505-9726-13d1033b01cb tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:26.687161 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9d7338d1-dd91-4505-9726-13d1033b01cb tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:26.694583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3259c1e8-e1d8-4f5c-ad1b-139b70583163 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1274672647", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "8986c514-fc4e-460c-b04d-db52f7674204"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:26.695407 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d7338d1-dd91-4505-9726-13d1033b01cb tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:26.696850 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d7338d1-dd91-4505-9726-13d1033b01cb tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:26.697580 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d7338d1-dd91-4505-9726-13d1033b01cb tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:26.698454 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d7338d1-dd91-4505-9726-13d1033b01cb tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:26.699290 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d7338d1-dd91-4505-9726-13d1033b01cb tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:26.699946 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d7338d1-dd91-4505-9726-13d1033b01cb tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:26.803735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-3259c1e8-e1d8-4f5c-ad1b-139b70583163 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] validate_networks() for [('8986c514-fc4e-460c-b04d-db52f7674204', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:00:26.882565 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9d7338d1-dd91-4505-9726-13d1033b01cb tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:26.900652 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9d7338d1-dd91-4505-9726-13d1033b01cb tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c" status: 200 len: 1275 microversion: 2.1 time: 0.231906 Sep 24 21:00:26.916944 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1494/2997] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:26 2022] GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c => generated 1275 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:26.916944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-57f9d106-caf6-40a8-8d95-c0d556c2e2cf tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:26.916944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-57f9d106-caf6-40a8-8d95-c0d556c2e2cf tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] [instance: 6f34bc2b-5e80-41a6-8898-7ca853cb26ab] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:26.916944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57f9d106-caf6-40a8-8d95-c0d556c2e2cf tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:26.916944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57f9d106-caf6-40a8-8d95-c0d556c2e2cf tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:26.916944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57f9d106-caf6-40a8-8d95-c0d556c2e2cf tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:26.916944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57f9d106-caf6-40a8-8d95-c0d556c2e2cf tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:26.917561 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57f9d106-caf6-40a8-8d95-c0d556c2e2cf tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:26.917561 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57f9d106-caf6-40a8-8d95-c0d556c2e2cf tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:27.232659 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-57f9d106-caf6-40a8-8d95-c0d556c2e2cf tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a689c647524dfdb492184b90c53b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a512ecd53242fb8dd25a0367ae8180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:27.241470 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-57f9d106-caf6-40a8-8d95-c0d556c2e2cf tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] 10.222.0.52 "GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab" status: 200 len: 1526 microversion: 2.1 time: 0.338092 Sep 24 21:00:27.242551 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1495/2998] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:26 2022] GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab => generated 1526 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:27.247475 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3d35af7b-b95d-48c9-bc21-0358cfdcba38 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:27.248324 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3d35af7b-b95d-48c9-bc21-0358cfdcba38 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:27.270879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d35af7b-b95d-48c9-bc21-0358cfdcba38 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:27.272094 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d35af7b-b95d-48c9-bc21-0358cfdcba38 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:27.272835 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d35af7b-b95d-48c9-bc21-0358cfdcba38 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:27.273933 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d35af7b-b95d-48c9-bc21-0358cfdcba38 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:27.274616 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d35af7b-b95d-48c9-bc21-0358cfdcba38 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:27.275207 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d35af7b-b95d-48c9-bc21-0358cfdcba38 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:27.670709 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3d35af7b-b95d-48c9-bc21-0358cfdcba38 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41f618458eb48f6bb4631fd254addc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4655b536ca04896993223f34d172298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:27.732989 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3d35af7b-b95d-48c9-bc21-0358cfdcba38 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "GET /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130" status: 200 len: 1324 microversion: 2.1 time: 0.488861 Sep 24 21:00:27.735839 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1496/2999] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:27 2022] GET /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130 => generated 1324 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:27.741563 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e69d5874-25b6-45fc-b4dc-0885747c2eef tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:27.742874 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e69d5874-25b6-45fc-b4dc-0885747c2eef tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:27.765627 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e69d5874-25b6-45fc-b4dc-0885747c2eef tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:27.766147 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e69d5874-25b6-45fc-b4dc-0885747c2eef tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:27.766626 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e69d5874-25b6-45fc-b4dc-0885747c2eef tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:27.767359 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e69d5874-25b6-45fc-b4dc-0885747c2eef tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:27.767819 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e69d5874-25b6-45fc-b4dc-0885747c2eef tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:27.768249 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e69d5874-25b6-45fc-b4dc-0885747c2eef tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:28.097929 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-3259c1e8-e1d8-4f5c-ad1b-139b70583163 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:00:28.098455 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-3259c1e8-e1d8-4f5c-ad1b-139b70583163 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:00:28.098860 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-3259c1e8-e1d8-4f5c-ad1b-139b70583163 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:00:28.099472 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-3259c1e8-e1d8-4f5c-ad1b-139b70583163 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:00:28.100072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-3259c1e8-e1d8-4f5c-ad1b-139b70583163 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:00:28.103028 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e69d5874-25b6-45fc-b4dc-0885747c2eef tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:28.111136 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3259c1e8-e1d8-4f5c-ad1b-139b70583163 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:28.111894 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3259c1e8-e1d8-4f5c-ad1b-139b70583163 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:28.112210 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e69d5874-25b6-45fc-b4dc-0885747c2eef tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1508 microversion: 2.1 time: 0.374326 Sep 24 21:00:28.112699 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3259c1e8-e1d8-4f5c-ad1b-139b70583163 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:28.113618 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3259c1e8-e1d8-4f5c-ad1b-139b70583163 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:28.114254 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3259c1e8-e1d8-4f5c-ad1b-139b70583163 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:28.114880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3259c1e8-e1d8-4f5c-ad1b-139b70583163 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:28.129951 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1497/3000] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:27 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1508 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:28.135035 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-3259c1e8-e1d8-4f5c-ad1b-139b70583163 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Getting quotas for project 981fdf8ae7524612b9c2f6a3f16c39ec. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:00:28.138135 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3ae28490-fe10-44a4-a870-2ce35f3f71f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:28.142177 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3ae28490-fe10-44a4-a870-2ce35f3f71f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:28.147300 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-3259c1e8-e1d8-4f5c-ad1b-139b70583163 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Getting quotas for user 5ddab9c74c004e74a51fd8008886e542 and project 981fdf8ae7524612b9c2f6a3f16c39ec. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:00:28.150462 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ae28490-fe10-44a4-a870-2ce35f3f71f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:28.151191 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ae28490-fe10-44a4-a870-2ce35f3f71f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:28.151808 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ae28490-fe10-44a4-a870-2ce35f3f71f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:28.152692 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ae28490-fe10-44a4-a870-2ce35f3f71f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:28.153300 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ae28490-fe10-44a4-a870-2ce35f3f71f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:28.153897 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ae28490-fe10-44a4-a870-2ce35f3f71f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:28.169817 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3259c1e8-e1d8-4f5c-ad1b-139b70583163 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:00:28.172643 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3259c1e8-e1d8-4f5c-ad1b-139b70583163 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 7c6ee4f7-82b5-4c95-8865-ab81076df04f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:00:28.207689 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3ae28490-fe10-44a4-a870-2ce35f3f71f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.076372 Sep 24 21:00:28.209142 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1498/3001] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:00:28 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:00:28.215076 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d6415fae-b55a-4e4f-aef6-d0cd060a3edf tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:28.215967 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d6415fae-b55a-4e4f-aef6-d0cd060a3edf tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:28.223630 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6415fae-b55a-4e4f-aef6-d0cd060a3edf tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:28.226127 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6415fae-b55a-4e4f-aef6-d0cd060a3edf tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:28.227095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6415fae-b55a-4e4f-aef6-d0cd060a3edf tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:28.228011 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6415fae-b55a-4e4f-aef6-d0cd060a3edf tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:28.228638 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6415fae-b55a-4e4f-aef6-d0cd060a3edf tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:28.229266 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6415fae-b55a-4e4f-aef6-d0cd060a3edf tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:28.229505 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3259c1e8-e1d8-4f5c-ad1b-139b70583163 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.553480 Sep 24 21:00:28.230633 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1504/3002] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:00:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:00:28.235706 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d574f417-90b6-45bf-9339-3eec40828043 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:28.236641 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d574f417-90b6-45bf-9339-3eec40828043 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:28.245734 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d574f417-90b6-45bf-9339-3eec40828043 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:28.246639 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d574f417-90b6-45bf-9339-3eec40828043 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:28.247324 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d574f417-90b6-45bf-9339-3eec40828043 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:28.248419 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d574f417-90b6-45bf-9339-3eec40828043 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:28.249875 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d574f417-90b6-45bf-9339-3eec40828043 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:28.250573 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d574f417-90b6-45bf-9339-3eec40828043 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:28.440284 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-d6415fae-b55a-4e4f-aef6-d0cd060a3edf tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lazy-loading 'services' on Instance uuid 1d8bc459-871f-4611-ba95-7bf7d0f08a27 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:00:28.486056 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d6415fae-b55a-4e4f-aef6-d0cd060a3edf tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1927 microversion: 2.75 time: 0.275382 Sep 24 21:00:28.487381 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1499/3003] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:00:28 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1927 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:00:28.502562 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-627fa15b-2a95-4cf9-932c-122b4f6681ab tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:28.503556 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-627fa15b-2a95-4cf9-932c-122b4f6681ab tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 7c6ee4f7-82b5-4c95-8865-ab81076df04f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:28.648455 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-627fa15b-2a95-4cf9-932c-122b4f6681ab tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddab9c74c004e74a51fd8008886e542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdf8ae7524612b9c2f6a3f16c39ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:28.658711 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-627fa15b-2a95-4cf9-932c-122b4f6681ab tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f" status: 200 len: 1216 microversion: 2.1 time: 0.169958 Sep 24 21:00:28.661164 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1500/3004] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:28 2022] GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f => generated 1216 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:28.680004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4150b1f8-c59c-4c30-9bfc-e1e07be865ab tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:28.681389 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4150b1f8-c59c-4c30-9bfc-e1e07be865ab tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] [instance: 6f34bc2b-5e80-41a6-8898-7ca853cb26ab] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:28.690825 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4150b1f8-c59c-4c30-9bfc-e1e07be865ab tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:28.704064 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4150b1f8-c59c-4c30-9bfc-e1e07be865ab tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:28.704529 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4150b1f8-c59c-4c30-9bfc-e1e07be865ab tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:28.705300 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4150b1f8-c59c-4c30-9bfc-e1e07be865ab tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:28.705769 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4150b1f8-c59c-4c30-9bfc-e1e07be865ab tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:28.706208 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4150b1f8-c59c-4c30-9bfc-e1e07be865ab tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:28.899642 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d574f417-90b6-45bf-9339-3eec40828043 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:28.915305 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d574f417-90b6-45bf-9339-3eec40828043 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c" status: 200 len: 1317 microversion: 2.1 time: 0.683338 Sep 24 21:00:28.917350 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1505/3005] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:28 2022] GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c => generated 1317 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:29.028181 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-9e28fac0-0bb1-46a8-90bd-8e9a5a3c1891 req-58f08ef7-f5c0-4c4a-ad84-6a74ea87cf85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "547cf9a4-1d05-4cbd-bb2b-ee5cbd406130", "name": "network-vif-plugged", "status": "completed", "tag": "52b5470e-7c8d-4f6a-b42e-9c45da96e2f1"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:29.039692 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-9e28fac0-0bb1-46a8-90bd-8e9a5a3c1891 req-58f08ef7-f5c0-4c4a-ad84-6a74ea87cf85 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:29.040538 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-9e28fac0-0bb1-46a8-90bd-8e9a5a3c1891 req-58f08ef7-f5c0-4c4a-ad84-6a74ea87cf85 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:29.041192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-9e28fac0-0bb1-46a8-90bd-8e9a5a3c1891 req-58f08ef7-f5c0-4c4a-ad84-6a74ea87cf85 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:29.054148 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-9e28fac0-0bb1-46a8-90bd-8e9a5a3c1891 req-58f08ef7-f5c0-4c4a-ad84-6a74ea87cf85 service nova] Creating event network-vif-plugged:52b5470e-7c8d-4f6a-b42e-9c45da96e2f1 for instance 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130 on nch2-master-1 Sep 24 21:00:29.064851 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-9e28fac0-0bb1-46a8-90bd-8e9a5a3c1891 req-58f08ef7-f5c0-4c4a-ad84-6a74ea87cf85 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145882 Sep 24 21:00:29.069866 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1506/3006] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:00:29.075780 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0e7ea131-b73d-4169-ba84-26a057783895 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:29.077695 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0e7ea131-b73d-4169-ba84-26a057783895 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:29.084670 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e7ea131-b73d-4169-ba84-26a057783895 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:29.085472 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e7ea131-b73d-4169-ba84-26a057783895 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:29.086157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e7ea131-b73d-4169-ba84-26a057783895 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:29.087131 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e7ea131-b73d-4169-ba84-26a057783895 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:29.087786 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e7ea131-b73d-4169-ba84-26a057783895 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:29.088411 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e7ea131-b73d-4169-ba84-26a057783895 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:29.793820 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4150b1f8-c59c-4c30-9bfc-e1e07be865ab tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a689c647524dfdb492184b90c53b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a512ecd53242fb8dd25a0367ae8180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:29.805418 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4150b1f8-c59c-4c30-9bfc-e1e07be865ab tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] 10.222.0.52 "GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab" status: 200 len: 1526 microversion: 2.1 time: 1.141158 Sep 24 21:00:29.806023 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1501/3007] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:28 2022] GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab => generated 1526 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:29.816205 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ef8c5847-0964-41fa-b746-6208eda05610 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:29.821023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ef8c5847-0964-41fa-b746-6208eda05610 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:29.833004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef8c5847-0964-41fa-b746-6208eda05610 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:29.834012 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef8c5847-0964-41fa-b746-6208eda05610 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:29.834571 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef8c5847-0964-41fa-b746-6208eda05610 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:29.835377 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef8c5847-0964-41fa-b746-6208eda05610 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:29.836418 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef8c5847-0964-41fa-b746-6208eda05610 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:29.837148 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef8c5847-0964-41fa-b746-6208eda05610 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:29.999979 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0e7ea131-b73d-4169-ba84-26a057783895 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41f618458eb48f6bb4631fd254addc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4655b536ca04896993223f34d172298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:30.012936 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0e7ea131-b73d-4169-ba84-26a057783895 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "GET /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130" status: 200 len: 1324 microversion: 2.1 time: 0.941284 Sep 24 21:00:30.013726 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1507/3008] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:29 2022] GET /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130 => generated 1324 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:30.035992 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6c614372-bea0-4067-803b-264c87c1cf14 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:30.043102 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6c614372-bea0-4067-803b-264c87c1cf14 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:30.071498 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6c614372-bea0-4067-803b-264c87c1cf14 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:30.074532 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6c614372-bea0-4067-803b-264c87c1cf14 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:30.074532 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6c614372-bea0-4067-803b-264c87c1cf14 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:30.075308 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6c614372-bea0-4067-803b-264c87c1cf14 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:30.077651 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6c614372-bea0-4067-803b-264c87c1cf14 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:30.078338 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6c614372-bea0-4067-803b-264c87c1cf14 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:30.175427 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6c614372-bea0-4067-803b-264c87c1cf14 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.156650 Sep 24 21:00:30.181884 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1508/3009] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:00:30 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:00:30.190129 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ec73ef25-c6f1-44cb-8116-b253e5165ad3 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:30.191179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ec73ef25-c6f1-44cb-8116-b253e5165ad3 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:30.200815 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ec73ef25-c6f1-44cb-8116-b253e5165ad3 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:30.202326 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ec73ef25-c6f1-44cb-8116-b253e5165ad3 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:30.203282 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ec73ef25-c6f1-44cb-8116-b253e5165ad3 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:30.204914 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ec73ef25-c6f1-44cb-8116-b253e5165ad3 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:30.205806 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ec73ef25-c6f1-44cb-8116-b253e5165ad3 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:30.206599 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ec73ef25-c6f1-44cb-8116-b253e5165ad3 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:30.402247 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-ec73ef25-c6f1-44cb-8116-b253e5165ad3 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lazy-loading 'services' on Instance uuid 1d8bc459-871f-4611-ba95-7bf7d0f08a27 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:00:30.403633 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ef8c5847-0964-41fa-b746-6208eda05610 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:30.414803 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ef8c5847-0964-41fa-b746-6208eda05610 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1508 microversion: 2.1 time: 0.602693 Sep 24 21:00:30.431391 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1502/3010] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:29 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1508 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:30.431391 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0933974f-6b1a-4539-963f-3ba287638072 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:30.431391 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0933974f-6b1a-4539-963f-3ba287638072 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 7c6ee4f7-82b5-4c95-8865-ab81076df04f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:30.449525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:00:30.451076 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0933974f-6b1a-4539-963f-3ba287638072 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:30.451638 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0933974f-6b1a-4539-963f-3ba287638072 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:30.452591 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0933974f-6b1a-4539-963f-3ba287638072 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:30.453317 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0933974f-6b1a-4539-963f-3ba287638072 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:30.453780 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0933974f-6b1a-4539-963f-3ba287638072 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:30.454214 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0933974f-6b1a-4539-963f-3ba287638072 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:30.475696 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ec73ef25-c6f1-44cb-8116-b253e5165ad3 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1927 microversion: 2.75 time: 0.290681 Sep 24 21:00:30.477792 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1509/3011] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:00:30 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1927 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:00:30.485738 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-559eda73-b411-447a-8c2c-d327c035b98a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:30.502468 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-559eda73-b411-447a-8c2c-d327c035b98a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:30.530884 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-559eda73-b411-447a-8c2c-d327c035b98a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:30.532293 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-559eda73-b411-447a-8c2c-d327c035b98a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:30.532748 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-559eda73-b411-447a-8c2c-d327c035b98a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:30.533492 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-559eda73-b411-447a-8c2c-d327c035b98a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:30.533947 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-559eda73-b411-447a-8c2c-d327c035b98a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:30.535457 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-559eda73-b411-447a-8c2c-d327c035b98a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:30.627822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0933974f-6b1a-4539-963f-3ba287638072 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddab9c74c004e74a51fd8008886e542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdf8ae7524612b9c2f6a3f16c39ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:30.649585 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0933974f-6b1a-4539-963f-3ba287638072 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f" status: 200 len: 1274 microversion: 2.1 time: 0.229051 Sep 24 21:00:30.652798 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1503/3012] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:30 2022] GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f => generated 1274 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:30.672803 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-907b9280-a2c2-4943-997a-a944658f872a req-c679473e-7036-4ef3-90ed-d036785ddf23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f34bc2b-5e80-41a6-8898-7ca853cb26ab", "name": "network-vif-deleted", "tag": "1a0c9d51-1224-48c7-935d-37553afea2e7"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:30.700599 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-907b9280-a2c2-4943-997a-a944658f872a req-c679473e-7036-4ef3-90ed-d036785ddf23 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:30.701868 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-907b9280-a2c2-4943-997a-a944658f872a req-c679473e-7036-4ef3-90ed-d036785ddf23 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:30.711257 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-907b9280-a2c2-4943-997a-a944658f872a req-c679473e-7036-4ef3-90ed-d036785ddf23 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:30.730525 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-907b9280-a2c2-4943-997a-a944658f872a req-c679473e-7036-4ef3-90ed-d036785ddf23 service nova] Creating event network-vif-deleted:1a0c9d51-1224-48c7-935d-37553afea2e7 for instance 6f34bc2b-5e80-41a6-8898-7ca853cb26ab on nch1-master-1 Sep 24 21:00:30.756413 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-907b9280-a2c2-4943-997a-a944658f872a req-c679473e-7036-4ef3-90ed-d036785ddf23 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102114 Sep 24 21:00:30.763627 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1504/3013] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:00:30.833702 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-53d97302-5a36-4a97-a21e-57db96001ba0 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:30.835160 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-53d97302-5a36-4a97-a21e-57db96001ba0 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] [instance: 6f34bc2b-5e80-41a6-8898-7ca853cb26ab] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:30.845866 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53d97302-5a36-4a97-a21e-57db96001ba0 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:30.853007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53d97302-5a36-4a97-a21e-57db96001ba0 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:30.853797 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53d97302-5a36-4a97-a21e-57db96001ba0 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:30.854868 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53d97302-5a36-4a97-a21e-57db96001ba0 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:30.855509 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53d97302-5a36-4a97-a21e-57db96001ba0 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:30.855944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53d97302-5a36-4a97-a21e-57db96001ba0 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:30.902267 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:00:30.925260 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53d97302-5a36-4a97-a21e-57db96001ba0 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:30.925930 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53d97302-5a36-4a97-a21e-57db96001ba0 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:30.926567 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53d97302-5a36-4a97-a21e-57db96001ba0 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:30.927191 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-53d97302-5a36-4a97-a21e-57db96001ba0 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lazy-loading 'fault' on Instance uuid 6f34bc2b-5e80-41a6-8898-7ca853cb26ab {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:00:31.026818 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-53d97302-5a36-4a97-a21e-57db96001ba0 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a689c647524dfdb492184b90c53b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a512ecd53242fb8dd25a0367ae8180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:31.052444 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-53d97302-5a36-4a97-a21e-57db96001ba0 tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] 10.222.0.52 "GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab" status: 200 len: 1314 microversion: 2.1 time: 0.222412 Sep 24 21:00:31.068736 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1505/3014] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:30 2022] GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:00:31.079765 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b2748482-967e-4396-9a81-784cdc60c6e0 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:31.083349 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b2748482-967e-4396-9a81-784cdc60c6e0 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:31.104860 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2748482-967e-4396-9a81-784cdc60c6e0 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:31.105703 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2748482-967e-4396-9a81-784cdc60c6e0 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:31.110735 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2748482-967e-4396-9a81-784cdc60c6e0 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:31.114756 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2748482-967e-4396-9a81-784cdc60c6e0 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:31.116873 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2748482-967e-4396-9a81-784cdc60c6e0 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:31.117761 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2748482-967e-4396-9a81-784cdc60c6e0 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:31.233918 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-559eda73-b411-447a-8c2c-d327c035b98a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:31.245253 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-559eda73-b411-447a-8c2c-d327c035b98a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c" status: 200 len: 1317 microversion: 2.1 time: 0.763661 Sep 24 21:00:31.249198 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1510/3015] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:30 2022] GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c => generated 1317 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:31.265566 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c346f25d-7905-47c9-ba52-fac350d4f889 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:31.272502 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c346f25d-7905-47c9-ba52-fac350d4f889 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:31.288067 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c346f25d-7905-47c9-ba52-fac350d4f889 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:31.288777 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c346f25d-7905-47c9-ba52-fac350d4f889 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:31.289437 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c346f25d-7905-47c9-ba52-fac350d4f889 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:31.294415 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c346f25d-7905-47c9-ba52-fac350d4f889 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:31.295174 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c346f25d-7905-47c9-ba52-fac350d4f889 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:31.295827 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c346f25d-7905-47c9-ba52-fac350d4f889 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:31.423975 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c346f25d-7905-47c9-ba52-fac350d4f889 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.173553 Sep 24 21:00:31.434571 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1511/3016] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:00:31 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:00:31.445999 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5633ee2e-8439-4fdc-9036-c86c7f8f0148 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:31.448033 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5633ee2e-8439-4fdc-9036-c86c7f8f0148 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:31.471252 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5633ee2e-8439-4fdc-9036-c86c7f8f0148 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:31.473778 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5633ee2e-8439-4fdc-9036-c86c7f8f0148 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:31.474564 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5633ee2e-8439-4fdc-9036-c86c7f8f0148 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:31.479162 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5633ee2e-8439-4fdc-9036-c86c7f8f0148 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:31.480726 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5633ee2e-8439-4fdc-9036-c86c7f8f0148 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:31.481415 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5633ee2e-8439-4fdc-9036-c86c7f8f0148 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:32.050490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b2748482-967e-4396-9a81-784cdc60c6e0 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41f618458eb48f6bb4631fd254addc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4655b536ca04896993223f34d172298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:32.059800 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b2748482-967e-4396-9a81-784cdc60c6e0 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "GET /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130" status: 200 len: 1521 microversion: 2.1 time: 0.989632 Sep 24 21:00:32.062796 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1506/3017] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:31 2022] GET /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130 => generated 1521 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:32.088462 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0c554d89-87b0-45a2-917f-96c5acf3837f tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:32.089336 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0c554d89-87b0-45a2-917f-96c5acf3837f tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:32.097677 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c554d89-87b0-45a2-917f-96c5acf3837f tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:32.098587 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c554d89-87b0-45a2-917f-96c5acf3837f tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:32.099209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c554d89-87b0-45a2-917f-96c5acf3837f tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:32.100230 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c554d89-87b0-45a2-917f-96c5acf3837f tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:32.100851 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c554d89-87b0-45a2-917f-96c5acf3837f tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:32.101493 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c554d89-87b0-45a2-917f-96c5acf3837f tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:32.137788 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5633ee2e-8439-4fdc-9036-c86c7f8f0148 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:32.146147 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5633ee2e-8439-4fdc-9036-c86c7f8f0148 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1508 microversion: 2.1 time: 0.704454 Sep 24 21:00:32.155639 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1512/3018] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:31 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1508 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:32.162954 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-418e3bc3-c605-4426-9d20-466d2a63bc02 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:32.169719 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-418e3bc3-c605-4426-9d20-466d2a63bc02 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 7c6ee4f7-82b5-4c95-8865-ab81076df04f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:32.198794 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-418e3bc3-c605-4426-9d20-466d2a63bc02 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:32.199305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-418e3bc3-c605-4426-9d20-466d2a63bc02 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:32.199755 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-418e3bc3-c605-4426-9d20-466d2a63bc02 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:32.200485 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-418e3bc3-c605-4426-9d20-466d2a63bc02 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:32.200950 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-418e3bc3-c605-4426-9d20-466d2a63bc02 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:32.201382 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-418e3bc3-c605-4426-9d20-466d2a63bc02 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:32.261762 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-0c554d89-87b0-45a2-917f-96c5acf3837f tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lazy-loading 'services' on Instance uuid 1d8bc459-871f-4611-ba95-7bf7d0f08a27 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:00:32.290779 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0c554d89-87b0-45a2-917f-96c5acf3837f tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1927 microversion: 2.75 time: 0.214311 Sep 24 21:00:32.291578 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1507/3019] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:00:32 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1927 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:00:32.297777 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-56d1d64c-c48b-48f4-a5a1-b014bded396d tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:32.298669 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-56d1d64c-c48b-48f4-a5a1-b014bded396d tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] [instance: 6f34bc2b-5e80-41a6-8898-7ca853cb26ab] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:32.309049 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-56d1d64c-c48b-48f4-a5a1-b014bded396d tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:32.310075 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-56d1d64c-c48b-48f4-a5a1-b014bded396d tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:32.310801 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-56d1d64c-c48b-48f4-a5a1-b014bded396d tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:32.313097 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-56d1d64c-c48b-48f4-a5a1-b014bded396d tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:32.313744 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-56d1d64c-c48b-48f4-a5a1-b014bded396d tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:32.314549 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-56d1d64c-c48b-48f4-a5a1-b014bded396d tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:32.332678 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-56d1d64c-c48b-48f4-a5a1-b014bded396d tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] HTTP exception thrown: Instance 6f34bc2b-5e80-41a6-8898-7ca853cb26ab could not be found. Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-56d1d64c-c48b-48f4-a5a1-b014bded396d tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Request method failure captured: Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab HTTP/1.1 Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL2_RP8TkxCW-p0J28yQE4kjMmNTbXIp3rqP91E8cUI8glapgtkErvpBLF9SqP2RYJrThfXNgTsqy7Te_-bvYmvOK3cJvnuOmN0qda-RARgP1F_INVQKiDjBfhuK3E2NTDqnoKWxHiGlgN2ZKfNXq4Jj6lANd1K6RxT_tN-DneusrxMQ Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 18a512ecd53242fb8dd25a0367ae8180 Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1173885560 Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/18a512ecd53242fb8dd25a0367ae8180"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_18a512ecd53242fb8dd25a0367ae8180"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/18a512ecd53242fb8dd25a0367ae8180"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/18a512ecd53242fb8dd25a0367ae8180"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1173885560 Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 18a512ecd53242fb8dd25a0367ae8180 Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1173885560 Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-InstanceActionsNegativeTestJSON-1173885560-project Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 81a689c647524dfdb492184b90c53b05 Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1173885560-project Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 6f34bc2b-5e80-41a6-8898-7ca853cb26ab could not be found. Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '6f34bc2b-5e80-41a6-8898-7ca853cb26ab'} Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f34bc2b-5e80-41a6-8898-7ca853cb26ab could not be found. Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f34bc2b-5e80-41a6-8898-7ca853cb26ab could not be found. Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:00:32.334701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:00:32.340293 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:00:32.340293 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:00:32.340293 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:00:32.340293 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:00:32.340293 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:00:32.340293 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:00:32.340293 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f34bc2b-5e80-41a6-8898-7ca853cb26ab could not be found. Sep 24 21:00:32.340293 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:00:32.341674 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-56d1d64c-c48b-48f4-a5a1-b014bded396d tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] Returning 404 to user: Instance 6f34bc2b-5e80-41a6-8898-7ca853cb26ab could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:00:32.344238 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-56d1d64c-c48b-48f4-a5a1-b014bded396d tempest-InstanceActionsNegativeTestJSON-1173885560 tempest-InstanceActionsNegativeTestJSON-1173885560-project] 10.222.0.52 "GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab" status: 404 len: 111 microversion: 2.1 time: 0.051159 Sep 24 21:00:32.346711 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1508/3020] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:32 2022] GET /compute/v2.1/servers/6f34bc2b-5e80-41a6-8898-7ca853cb26ab => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:00:32.350271 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-19038cdf-3798-4b89-a54d-84e23446550a tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Action: 'create', calling method: .version_select at 0x7f4b07e96a60>, body: {"pool": null} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:32.748864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-418e3bc3-c605-4426-9d20-466d2a63bc02 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddab9c74c004e74a51fd8008886e542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdf8ae7524612b9c2f6a3f16c39ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:32.760211 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-418e3bc3-c605-4426-9d20-466d2a63bc02 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f" status: 200 len: 1316 microversion: 2.1 time: 0.603185 Sep 24 21:00:32.776922 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1513/3021] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:32 2022] GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f => generated 1316 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:32.792458 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a5fed864-9320-4517-9f2c-8d4311ab9364 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:32.793303 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a5fed864-9320-4517-9f2c-8d4311ab9364 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:32.804488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5fed864-9320-4517-9f2c-8d4311ab9364 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:32.805361 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5fed864-9320-4517-9f2c-8d4311ab9364 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:32.806483 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5fed864-9320-4517-9f2c-8d4311ab9364 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:32.807418 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5fed864-9320-4517-9f2c-8d4311ab9364 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:32.808953 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5fed864-9320-4517-9f2c-8d4311ab9364 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:32.809580 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5fed864-9320-4517-9f2c-8d4311ab9364 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:33.088289 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a5fed864-9320-4517-9f2c-8d4311ab9364 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:33.102083 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a5fed864-9320-4517-9f2c-8d4311ab9364 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c" status: 200 len: 1317 microversion: 2.1 time: 0.323158 Sep 24 21:00:33.103115 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1514/3022] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:32 2022] GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c => generated 1317 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:33.132759 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-af6787aa-dc3c-409e-a67b-94dbcc86c829 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:33.135698 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-af6787aa-dc3c-409e-a67b-94dbcc86c829 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:33.148289 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af6787aa-dc3c-409e-a67b-94dbcc86c829 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:33.149754 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af6787aa-dc3c-409e-a67b-94dbcc86c829 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:33.150425 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af6787aa-dc3c-409e-a67b-94dbcc86c829 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:33.151346 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af6787aa-dc3c-409e-a67b-94dbcc86c829 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:33.152004 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af6787aa-dc3c-409e-a67b-94dbcc86c829 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:33.152598 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af6787aa-dc3c-409e-a67b-94dbcc86c829 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:33.205303 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:00:33.212282 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-af6787aa-dc3c-409e-a67b-94dbcc86c829 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.084234 Sep 24 21:00:33.218085 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1515/3023] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:00:33 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:00:33.224430 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-1a7c67e0-cfae-4238-82ee-40498e11a0ca req-a617398d-cea7-4e78-9acb-a5527d7baffc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c", "tag": "e38dafb3-b9bf-4d37-8d9e-9abcfaf5d786"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:33.237029 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1a7c67e0-cfae-4238-82ee-40498e11a0ca req-a617398d-cea7-4e78-9acb-a5527d7baffc service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:33.237744 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1a7c67e0-cfae-4238-82ee-40498e11a0ca req-a617398d-cea7-4e78-9acb-a5527d7baffc service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:33.238348 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1a7c67e0-cfae-4238-82ee-40498e11a0ca req-a617398d-cea7-4e78-9acb-a5527d7baffc service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:33.250711 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-1a7c67e0-cfae-4238-82ee-40498e11a0ca req-a617398d-cea7-4e78-9acb-a5527d7baffc service nova] Creating event network-changed:e38dafb3-b9bf-4d37-8d9e-9abcfaf5d786 for instance 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c on nch1-master-1 Sep 24 21:00:33.259535 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-1a7c67e0-cfae-4238-82ee-40498e11a0ca req-a617398d-cea7-4e78-9acb-a5527d7baffc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038032 Sep 24 21:00:33.261252 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1516/3024] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:00:33.269796 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-17052589-f441-4f9a-8774-b150d07f8ca2 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:33.271226 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-17052589-f441-4f9a-8774-b150d07f8ca2 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:33.280823 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17052589-f441-4f9a-8774-b150d07f8ca2 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:33.281552 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17052589-f441-4f9a-8774-b150d07f8ca2 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:33.282583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17052589-f441-4f9a-8774-b150d07f8ca2 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:33.283486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17052589-f441-4f9a-8774-b150d07f8ca2 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:33.284105 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17052589-f441-4f9a-8774-b150d07f8ca2 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:33.284695 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17052589-f441-4f9a-8774-b150d07f8ca2 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:33.285584 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=4 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:00:33.521380 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-17052589-f441-4f9a-8774-b150d07f8ca2 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:33.533899 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-17052589-f441-4f9a-8774-b150d07f8ca2 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1508 microversion: 2.1 time: 0.271160 Sep 24 21:00:33.534892 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1517/3025] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:33 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1508 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:33.540098 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2e43847a-5dd3-4db9-9518-28dae9d33a65 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:33.543507 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2e43847a-5dd3-4db9-9518-28dae9d33a65 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:33.567696 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e43847a-5dd3-4db9-9518-28dae9d33a65 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:33.569017 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e43847a-5dd3-4db9-9518-28dae9d33a65 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:33.569563 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e43847a-5dd3-4db9-9518-28dae9d33a65 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:33.570556 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e43847a-5dd3-4db9-9518-28dae9d33a65 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:33.571094 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e43847a-5dd3-4db9-9518-28dae9d33a65 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:33.571610 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e43847a-5dd3-4db9-9518-28dae9d33a65 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:33.687136 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-2e43847a-5dd3-4db9-9518-28dae9d33a65 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lazy-loading 'services' on Instance uuid 1d8bc459-871f-4611-ba95-7bf7d0f08a27 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:00:33.708554 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2e43847a-5dd3-4db9-9518-28dae9d33a65 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1927 microversion: 2.75 time: 0.171501 Sep 24 21:00:33.723024 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1518/3026] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:00:33 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1927 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:00:33.736560 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-c308def5-b5f5-40e8-bc4c-2ffbb00f8e37 req-c73730a4-2faa-4b1f-bd1d-399e1b877b97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c6ee4f7-82b5-4c95-8865-ab81076df04f", "tag": "e1795d42-5be1-400f-9688-3f2a6d103ce9"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:33.750639 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c308def5-b5f5-40e8-bc4c-2ffbb00f8e37 req-c73730a4-2faa-4b1f-bd1d-399e1b877b97 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:33.752279 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c308def5-b5f5-40e8-bc4c-2ffbb00f8e37 req-c73730a4-2faa-4b1f-bd1d-399e1b877b97 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:33.752885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c308def5-b5f5-40e8-bc4c-2ffbb00f8e37 req-c73730a4-2faa-4b1f-bd1d-399e1b877b97 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:33.765884 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-c308def5-b5f5-40e8-bc4c-2ffbb00f8e37 req-c73730a4-2faa-4b1f-bd1d-399e1b877b97 service nova] Creating event network-changed:e1795d42-5be1-400f-9688-3f2a6d103ce9 for instance 7c6ee4f7-82b5-4c95-8865-ab81076df04f on nch1-master-1 Sep 24 21:00:33.771783 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-c308def5-b5f5-40e8-bc4c-2ffbb00f8e37 req-c73730a4-2faa-4b1f-bd1d-399e1b877b97 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046991 Sep 24 21:00:33.773103 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1519/3027] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:00:33.790246 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-90de90ef-fa5a-433a-a3ff-9d6a6b176e3f tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:33.791099 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-90de90ef-fa5a-433a-a3ff-9d6a6b176e3f tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 7c6ee4f7-82b5-4c95-8865-ab81076df04f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:33.815581 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-90de90ef-fa5a-433a-a3ff-9d6a6b176e3f tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:33.817922 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-90de90ef-fa5a-433a-a3ff-9d6a6b176e3f tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:33.820767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-90de90ef-fa5a-433a-a3ff-9d6a6b176e3f tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:33.821694 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-90de90ef-fa5a-433a-a3ff-9d6a6b176e3f tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:33.823324 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-90de90ef-fa5a-433a-a3ff-9d6a6b176e3f tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:33.824123 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-90de90ef-fa5a-433a-a3ff-9d6a6b176e3f tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:34.097522 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-90de90ef-fa5a-433a-a3ff-9d6a6b176e3f tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddab9c74c004e74a51fd8008886e542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdf8ae7524612b9c2f6a3f16c39ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:34.109020 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-90de90ef-fa5a-433a-a3ff-9d6a6b176e3f tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f" status: 200 len: 1316 microversion: 2.1 time: 0.322620 Sep 24 21:00:34.124606 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1520/3028] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:33 2022] GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f => generated 1316 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:00:34.135394 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1aca3c48-7475-420f-a990-556c80eada42 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:34.136379 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1aca3c48-7475-420f-a990-556c80eada42 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:34.146776 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1aca3c48-7475-420f-a990-556c80eada42 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:34.147632 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1aca3c48-7475-420f-a990-556c80eada42 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:34.148294 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1aca3c48-7475-420f-a990-556c80eada42 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:34.149963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1aca3c48-7475-420f-a990-556c80eada42 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:34.150681 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1aca3c48-7475-420f-a990-556c80eada42 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:34.151801 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1aca3c48-7475-420f-a990-556c80eada42 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:34.580489 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1aca3c48-7475-420f-a990-556c80eada42 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:34.596474 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1aca3c48-7475-420f-a990-556c80eada42 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c" status: 200 len: 1317 microversion: 2.1 time: 0.465730 Sep 24 21:00:34.611795 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1521/3029] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:34 2022] GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c => generated 1317 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:34.611795 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c107111c-926a-479e-8330-d69929d40fef tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:34.620091 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c107111c-926a-479e-8330-d69929d40fef tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:34.632509 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c107111c-926a-479e-8330-d69929d40fef tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:34.633019 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c107111c-926a-479e-8330-d69929d40fef tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:34.633465 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c107111c-926a-479e-8330-d69929d40fef tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:34.634302 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c107111c-926a-479e-8330-d69929d40fef tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:34.643520 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c107111c-926a-479e-8330-d69929d40fef tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:34.644411 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c107111c-926a-479e-8330-d69929d40fef tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:34.684406 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c107111c-926a-479e-8330-d69929d40fef tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.083125 Sep 24 21:00:34.685002 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1522/3030] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:00:34 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:00:34.694824 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7c8a60b1-36bc-488d-9b24-80042280af0c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:34.695451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7c8a60b1-36bc-488d-9b24-80042280af0c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:34.702850 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7c8a60b1-36bc-488d-9b24-80042280af0c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:34.703355 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7c8a60b1-36bc-488d-9b24-80042280af0c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:34.703805 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7c8a60b1-36bc-488d-9b24-80042280af0c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:34.704959 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7c8a60b1-36bc-488d-9b24-80042280af0c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:34.705434 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7c8a60b1-36bc-488d-9b24-80042280af0c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:34.705874 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7c8a60b1-36bc-488d-9b24-80042280af0c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:34.734772 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-19038cdf-3798-4b89-a54d-84e23446550a tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.387139 Sep 24 21:00:34.735584 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1509/3031] 10.222.0.52 () {60 vars in 1170 bytes} [Sat Sep 24 21:00:32 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:00:34.741611 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f4a5f6bf-32e8-4dd1-9e91-48687a1a022a tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:34.742317 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f4a5f6bf-32e8-4dd1-9e91-48687a1a022a tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:34.750178 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f4a5f6bf-32e8-4dd1-9e91-48687a1a022a tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:34.750953 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f4a5f6bf-32e8-4dd1-9e91-48687a1a022a tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:34.751603 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f4a5f6bf-32e8-4dd1-9e91-48687a1a022a tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:34.752330 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f4a5f6bf-32e8-4dd1-9e91-48687a1a022a tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:34.752999 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f4a5f6bf-32e8-4dd1-9e91-48687a1a022a tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:34.753594 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f4a5f6bf-32e8-4dd1-9e91-48687a1a022a tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:34.917877 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-f4a5f6bf-32e8-4dd1-9e91-48687a1a022a tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lazy-loading 'services' on Instance uuid 1d8bc459-871f-4611-ba95-7bf7d0f08a27 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:00:34.927525 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7c8a60b1-36bc-488d-9b24-80042280af0c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:34.939469 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7c8a60b1-36bc-488d-9b24-80042280af0c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1508 microversion: 2.1 time: 0.248265 Sep 24 21:00:34.951234 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1523/3032] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:34 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1508 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:34.951234 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1f186f06-a828-415e-999e-9dc2961c6500 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-2141875346", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "b9fc93d3-0ad7-483a-aed0-543890dc0a39"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:34.961448 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f4a5f6bf-32e8-4dd1-9e91-48687a1a022a tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1927 microversion: 2.75 time: 0.223577 Sep 24 21:00:34.962917 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1510/3033] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:00:34 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1927 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:00:35.042539 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-1f186f06-a828-415e-999e-9dc2961c6500 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] validate_networks() for [('b9fc93d3-0ad7-483a-aed0-543890dc0a39', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:00:35.137356 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b8523d5d-5552-4046-9544-7ffa49ef4afe tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:35.142133 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b8523d5d-5552-4046-9544-7ffa49ef4afe tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 7c6ee4f7-82b5-4c95-8865-ab81076df04f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:35.160864 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b8523d5d-5552-4046-9544-7ffa49ef4afe tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:35.170923 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b8523d5d-5552-4046-9544-7ffa49ef4afe tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:35.179966 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b8523d5d-5552-4046-9544-7ffa49ef4afe tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:35.181027 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b8523d5d-5552-4046-9544-7ffa49ef4afe tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:35.185493 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b8523d5d-5552-4046-9544-7ffa49ef4afe tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:35.188392 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b8523d5d-5552-4046-9544-7ffa49ef4afe tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:36.231216 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b8523d5d-5552-4046-9544-7ffa49ef4afe tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddab9c74c004e74a51fd8008886e542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdf8ae7524612b9c2f6a3f16c39ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:36.260560 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b8523d5d-5552-4046-9544-7ffa49ef4afe tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f" status: 200 len: 1316 microversion: 2.1 time: 1.125033 Sep 24 21:00:36.261554 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1511/3034] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:35 2022] GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f => generated 1316 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:00:36.290583 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7f2479c7-ea11-412e-a96f-da7a8755cf34 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:36.294993 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7f2479c7-ea11-412e-a96f-da7a8755cf34 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:36.313583 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f2479c7-ea11-412e-a96f-da7a8755cf34 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:36.314419 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f2479c7-ea11-412e-a96f-da7a8755cf34 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:36.315284 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f2479c7-ea11-412e-a96f-da7a8755cf34 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:36.319057 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f2479c7-ea11-412e-a96f-da7a8755cf34 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:36.319920 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f2479c7-ea11-412e-a96f-da7a8755cf34 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:36.320534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f2479c7-ea11-412e-a96f-da7a8755cf34 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:36.797990 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7f2479c7-ea11-412e-a96f-da7a8755cf34 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:36.821200 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7f2479c7-ea11-412e-a96f-da7a8755cf34 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c" status: 200 len: 1317 microversion: 2.1 time: 0.551287 Sep 24 21:00:36.823306 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1512/3035] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:36 2022] GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c => generated 1317 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:36.839363 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9fb291bf-6930-4eee-a40d-05917ee07244 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:36.844562 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9fb291bf-6930-4eee-a40d-05917ee07244 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:36.857241 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fb291bf-6930-4eee-a40d-05917ee07244 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:36.859622 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fb291bf-6930-4eee-a40d-05917ee07244 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:36.861519 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fb291bf-6930-4eee-a40d-05917ee07244 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:36.862734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fb291bf-6930-4eee-a40d-05917ee07244 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:36.863015 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fb291bf-6930-4eee-a40d-05917ee07244 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:36.863451 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fb291bf-6930-4eee-a40d-05917ee07244 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:36.929859 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-1f186f06-a828-415e-999e-9dc2961c6500 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:00:36.933118 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-1f186f06-a828-415e-999e-9dc2961c6500 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:00:36.933852 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-1f186f06-a828-415e-999e-9dc2961c6500 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:00:36.934324 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-1f186f06-a828-415e-999e-9dc2961c6500 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:00:36.934796 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-1f186f06-a828-415e-999e-9dc2961c6500 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:00:36.964968 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f186f06-a828-415e-999e-9dc2961c6500 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:36.972039 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f186f06-a828-415e-999e-9dc2961c6500 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:36.972838 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f186f06-a828-415e-999e-9dc2961c6500 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:36.973919 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f186f06-a828-415e-999e-9dc2961c6500 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:36.974404 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f186f06-a828-415e-999e-9dc2961c6500 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:36.974880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f186f06-a828-415e-999e-9dc2961c6500 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:36.992702 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9fb291bf-6930-4eee-a40d-05917ee07244 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.168001 Sep 24 21:00:37.001207 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1513/3036] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:00:36 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:00:37.010449 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-933d1153-6d58-4247-9fa9-f8c855cb3595 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:37.011604 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-933d1153-6d58-4247-9fa9-f8c855cb3595 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:37.035678 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-933d1153-6d58-4247-9fa9-f8c855cb3595 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:37.036082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-1f186f06-a828-415e-999e-9dc2961c6500 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Getting quotas for project d4655b536ca04896993223f34d172298. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:00:37.038075 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-933d1153-6d58-4247-9fa9-f8c855cb3595 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:37.040117 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-933d1153-6d58-4247-9fa9-f8c855cb3595 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:37.043584 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-933d1153-6d58-4247-9fa9-f8c855cb3595 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:37.044656 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-933d1153-6d58-4247-9fa9-f8c855cb3595 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:37.045293 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-933d1153-6d58-4247-9fa9-f8c855cb3595 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:37.048204 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-1f186f06-a828-415e-999e-9dc2961c6500 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Getting quotas for user f41f618458eb48f6bb4631fd254addc0 and project d4655b536ca04896993223f34d172298. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:00:37.094886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1f186f06-a828-415e-999e-9dc2961c6500 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:00:37.108559 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1f186f06-a828-415e-999e-9dc2961c6500 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 5c119929-2744-4871-b523-0a6a05c6c073] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:00:37.234633 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1f186f06-a828-415e-999e-9dc2961c6500 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.287743 Sep 24 21:00:37.238361 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1524/3037] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:00:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2298 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:00:37.262680 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e054832d-dd8f-4697-b1cc-366c2e17167e tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:37.264558 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e054832d-dd8f-4697-b1cc-366c2e17167e tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:37.306257 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e054832d-dd8f-4697-b1cc-366c2e17167e tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:37.306816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e054832d-dd8f-4697-b1cc-366c2e17167e tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:37.307583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e054832d-dd8f-4697-b1cc-366c2e17167e tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:37.308510 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e054832d-dd8f-4697-b1cc-366c2e17167e tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:37.314767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e054832d-dd8f-4697-b1cc-366c2e17167e tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:37.315478 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e054832d-dd8f-4697-b1cc-366c2e17167e tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:37.663827 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-e054832d-dd8f-4697-b1cc-366c2e17167e tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lazy-loading 'services' on Instance uuid 1d8bc459-871f-4611-ba95-7bf7d0f08a27 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:00:37.731345 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e054832d-dd8f-4697-b1cc-366c2e17167e tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1927 microversion: 2.75 time: 0.491571 Sep 24 21:00:37.736651 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1525/3038] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:00:37 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1927 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:00:37.763305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-011d0420-8785-44fe-a883-042e28f1c18a tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:37.764354 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-011d0420-8785-44fe-a883-042e28f1c18a tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 5c119929-2744-4871-b523-0a6a05c6c073] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:37.816189 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-933d1153-6d58-4247-9fa9-f8c855cb3595 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:37.834698 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-933d1153-6d58-4247-9fa9-f8c855cb3595 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1508 microversion: 2.1 time: 0.833987 Sep 24 21:00:37.835800 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1514/3039] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:36 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1508 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:37.864138 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ebd0e8a7-3b91-43f2-b5f6-3b43171941eb tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:37.865417 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ebd0e8a7-3b91-43f2-b5f6-3b43171941eb tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 7c6ee4f7-82b5-4c95-8865-ab81076df04f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:37.887593 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ebd0e8a7-3b91-43f2-b5f6-3b43171941eb tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:37.889881 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ebd0e8a7-3b91-43f2-b5f6-3b43171941eb tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:37.890867 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ebd0e8a7-3b91-43f2-b5f6-3b43171941eb tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:37.894172 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ebd0e8a7-3b91-43f2-b5f6-3b43171941eb tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:37.896284 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ebd0e8a7-3b91-43f2-b5f6-3b43171941eb tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:37.897382 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ebd0e8a7-3b91-43f2-b5f6-3b43171941eb tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:38.195451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-011d0420-8785-44fe-a883-042e28f1c18a tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41f618458eb48f6bb4631fd254addc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4655b536ca04896993223f34d172298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:38.211936 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-011d0420-8785-44fe-a883-042e28f1c18a tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "GET /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073" status: 200 len: 1224 microversion: 2.1 time: 0.468393 Sep 24 21:00:38.213019 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1526/3040] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:37 2022] GET /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073 => generated 1224 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:38.229007 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-666a9685-d4b9-4024-a2ac-718436106a6b tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:38.230180 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-666a9685-d4b9-4024-a2ac-718436106a6b tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:38.243016 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-666a9685-d4b9-4024-a2ac-718436106a6b tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:38.243520 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-666a9685-d4b9-4024-a2ac-718436106a6b tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:38.243992 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-666a9685-d4b9-4024-a2ac-718436106a6b tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:38.244819 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-666a9685-d4b9-4024-a2ac-718436106a6b tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:38.245333 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-666a9685-d4b9-4024-a2ac-718436106a6b tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:38.245589 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-666a9685-d4b9-4024-a2ac-718436106a6b tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:38.549076 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ebd0e8a7-3b91-43f2-b5f6-3b43171941eb tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddab9c74c004e74a51fd8008886e542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdf8ae7524612b9c2f6a3f16c39ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:38.557413 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ebd0e8a7-3b91-43f2-b5f6-3b43171941eb tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f" status: 200 len: 1316 microversion: 2.1 time: 0.720222 Sep 24 21:00:38.577021 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1515/3041] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:37 2022] GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f => generated 1316 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:38.584359 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8d78ba85-70ba-4e6b-8b97-2ca5e2eefe7a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:38.587111 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8d78ba85-70ba-4e6b-8b97-2ca5e2eefe7a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:38.594977 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8d78ba85-70ba-4e6b-8b97-2ca5e2eefe7a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:38.595856 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8d78ba85-70ba-4e6b-8b97-2ca5e2eefe7a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:38.596528 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8d78ba85-70ba-4e6b-8b97-2ca5e2eefe7a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:38.597672 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8d78ba85-70ba-4e6b-8b97-2ca5e2eefe7a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:38.598361 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8d78ba85-70ba-4e6b-8b97-2ca5e2eefe7a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:38.599296 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8d78ba85-70ba-4e6b-8b97-2ca5e2eefe7a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:38.635690 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8d78ba85-70ba-4e6b-8b97-2ca5e2eefe7a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.057008 Sep 24 21:00:38.636665 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1516/3042] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:00:38 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:00:38.754025 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-666a9685-d4b9-4024-a2ac-718436106a6b tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:38.761249 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-192bbd85-0af6-4943-9554-cb749eebc630 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:38.762210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-192bbd85-0af6-4943-9554-cb749eebc630 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:38.768290 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-666a9685-d4b9-4024-a2ac-718436106a6b tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c" status: 200 len: 1317 microversion: 2.1 time: 0.551107 Sep 24 21:00:38.768916 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1527/3043] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:38 2022] GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c => generated 1317 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:38.770980 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=14 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:00:38.772906 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-192bbd85-0af6-4943-9554-cb749eebc630 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:38.773630 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-192bbd85-0af6-4943-9554-cb749eebc630 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:38.774345 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-192bbd85-0af6-4943-9554-cb749eebc630 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:38.775868 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-192bbd85-0af6-4943-9554-cb749eebc630 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:38.776644 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-192bbd85-0af6-4943-9554-cb749eebc630 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:38.777425 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-192bbd85-0af6-4943-9554-cb749eebc630 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:38.862368 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1dfb1ffe-9d83-43d3-b588-69331d8e0f5c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:38.863422 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1dfb1ffe-9d83-43d3-b588-69331d8e0f5c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:38.876980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1dfb1ffe-9d83-43d3-b588-69331d8e0f5c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:38.877662 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1dfb1ffe-9d83-43d3-b588-69331d8e0f5c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:38.878377 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1dfb1ffe-9d83-43d3-b588-69331d8e0f5c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:38.879737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-192bbd85-0af6-4943-9554-cb749eebc630 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lazy-loading 'services' on Instance uuid 1d8bc459-871f-4611-ba95-7bf7d0f08a27 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:00:38.885970 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1dfb1ffe-9d83-43d3-b588-69331d8e0f5c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:38.887728 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1dfb1ffe-9d83-43d3-b588-69331d8e0f5c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:38.888199 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1dfb1ffe-9d83-43d3-b588-69331d8e0f5c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:38.914914 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-192bbd85-0af6-4943-9554-cb749eebc630 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1927 microversion: 2.75 time: 0.158296 Sep 24 21:00:38.916069 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1517/3044] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:00:38 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1927 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:00:39.121888 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1dfb1ffe-9d83-43d3-b588-69331d8e0f5c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:39.137710 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1dfb1ffe-9d83-43d3-b588-69331d8e0f5c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1508 microversion: 2.1 time: 0.279716 Sep 24 21:00:39.138921 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1528/3045] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:38 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1508 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:00:39.236939 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-73444a9f-404d-4ccf-a028-3f908e23fd66 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:39.237844 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-73444a9f-404d-4ccf-a028-3f908e23fd66 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 5c119929-2744-4871-b523-0a6a05c6c073] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:39.248737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-73444a9f-404d-4ccf-a028-3f908e23fd66 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:39.249243 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-73444a9f-404d-4ccf-a028-3f908e23fd66 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:39.249699 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-73444a9f-404d-4ccf-a028-3f908e23fd66 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:39.250426 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-73444a9f-404d-4ccf-a028-3f908e23fd66 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:39.250913 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-73444a9f-404d-4ccf-a028-3f908e23fd66 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:39.251353 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-73444a9f-404d-4ccf-a028-3f908e23fd66 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:39.353071 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-73444a9f-404d-4ccf-a028-3f908e23fd66 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41f618458eb48f6bb4631fd254addc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4655b536ca04896993223f34d172298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:39.365636 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-73444a9f-404d-4ccf-a028-3f908e23fd66 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "GET /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073" status: 200 len: 1276 microversion: 2.1 time: 0.132873 Sep 24 21:00:39.367090 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1518/3046] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:39 2022] GET /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073 => generated 1276 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:39.586569 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-80dcd9a5-c3f1-44bf-8115-d1f849532104 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:39.586569 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-80dcd9a5-c3f1-44bf-8115-d1f849532104 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 7c6ee4f7-82b5-4c95-8865-ab81076df04f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:39.596826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-3cfc24b5-9ad6-44c7-93ac-0afff1aa4014 req-9cd68656-4b18-42a9-971a-1156f3501d79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c", "name": "network-vif-plugged", "status": "completed", "tag": "e38dafb3-b9bf-4d37-8d9e-9abcfaf5d786"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:39.608372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-80dcd9a5-c3f1-44bf-8115-d1f849532104 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:39.612310 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-80dcd9a5-c3f1-44bf-8115-d1f849532104 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:39.613032 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-80dcd9a5-c3f1-44bf-8115-d1f849532104 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:39.616342 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-80dcd9a5-c3f1-44bf-8115-d1f849532104 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:39.617701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-3cfc24b5-9ad6-44c7-93ac-0afff1aa4014 req-9cd68656-4b18-42a9-971a-1156f3501d79 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:39.618444 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-80dcd9a5-c3f1-44bf-8115-d1f849532104 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:39.620559 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-3cfc24b5-9ad6-44c7-93ac-0afff1aa4014 req-9cd68656-4b18-42a9-971a-1156f3501d79 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:39.621082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-80dcd9a5-c3f1-44bf-8115-d1f849532104 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:39.623962 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-3cfc24b5-9ad6-44c7-93ac-0afff1aa4014 req-9cd68656-4b18-42a9-971a-1156f3501d79 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:39.655864 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-3cfc24b5-9ad6-44c7-93ac-0afff1aa4014 req-9cd68656-4b18-42a9-971a-1156f3501d79 service nova] Creating event network-vif-plugged:e38dafb3-b9bf-4d37-8d9e-9abcfaf5d786 for instance 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c on nch1-master-1 Sep 24 21:00:39.663592 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-3cfc24b5-9ad6-44c7-93ac-0afff1aa4014 req-9cd68656-4b18-42a9-971a-1156f3501d79 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072078 Sep 24 21:00:39.667290 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1519/3047] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:00:39.673283 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-45dfbd36-af78-481e-9f21-1d53da717e90 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:39.675716 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-45dfbd36-af78-481e-9f21-1d53da717e90 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:39.681970 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45dfbd36-af78-481e-9f21-1d53da717e90 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:39.682548 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45dfbd36-af78-481e-9f21-1d53da717e90 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:39.682987 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45dfbd36-af78-481e-9f21-1d53da717e90 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:39.683709 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45dfbd36-af78-481e-9f21-1d53da717e90 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:39.684173 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45dfbd36-af78-481e-9f21-1d53da717e90 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:39.684604 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45dfbd36-af78-481e-9f21-1d53da717e90 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:39.746577 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-45dfbd36-af78-481e-9f21-1d53da717e90 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.077958 Sep 24 21:00:39.752689 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1520/3048] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:00:39 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:00:39.804960 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-57f9ab87-8442-452f-acfc-bb021acfc2a2 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:39.805604 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-57f9ab87-8442-452f-acfc-bb021acfc2a2 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:39.823343 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57f9ab87-8442-452f-acfc-bb021acfc2a2 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:39.824083 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57f9ab87-8442-452f-acfc-bb021acfc2a2 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:39.824928 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57f9ab87-8442-452f-acfc-bb021acfc2a2 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:39.825810 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57f9ab87-8442-452f-acfc-bb021acfc2a2 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:39.826483 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57f9ab87-8442-452f-acfc-bb021acfc2a2 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:39.827110 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57f9ab87-8442-452f-acfc-bb021acfc2a2 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:39.883992 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-80dcd9a5-c3f1-44bf-8115-d1f849532104 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddab9c74c004e74a51fd8008886e542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdf8ae7524612b9c2f6a3f16c39ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:39.896085 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-80dcd9a5-c3f1-44bf-8115-d1f849532104 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f" status: 200 len: 1316 microversion: 2.1 time: 0.315092 Sep 24 21:00:39.911831 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1529/3049] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:39 2022] GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f => generated 1316 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:39.953922 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-638597e3-def1-4ce3-b0b5-441ae91b306d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:39.954582 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-638597e3-def1-4ce3-b0b5-441ae91b306d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:39.957184 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:00:39.963412 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-638597e3-def1-4ce3-b0b5-441ae91b306d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:39.963925 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-638597e3-def1-4ce3-b0b5-441ae91b306d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:39.964966 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-638597e3-def1-4ce3-b0b5-441ae91b306d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:39.965891 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-638597e3-def1-4ce3-b0b5-441ae91b306d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:39.966535 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-638597e3-def1-4ce3-b0b5-441ae91b306d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:39.968175 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-638597e3-def1-4ce3-b0b5-441ae91b306d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:40.071851 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-57f9ab87-8442-452f-acfc-bb021acfc2a2 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:40.082171 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-57f9ab87-8442-452f-acfc-bb021acfc2a2 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c" status: 200 len: 1317 microversion: 2.1 time: 0.284639 Sep 24 21:00:40.083606 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1521/3050] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:39 2022] GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c => generated 1317 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:00:40.088438 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-638597e3-def1-4ce3-b0b5-441ae91b306d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lazy-loading 'services' on Instance uuid 1d8bc459-871f-4611-ba95-7bf7d0f08a27 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:00:40.111939 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-638597e3-def1-4ce3-b0b5-441ae91b306d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1927 microversion: 2.75 time: 0.165785 Sep 24 21:00:40.112786 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1530/3051] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:00:39 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1927 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:00:40.162011 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2baf1181-abbd-482e-9559-d04eff1a9a8e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:40.163040 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2baf1181-abbd-482e-9559-d04eff1a9a8e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:40.169558 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2baf1181-abbd-482e-9559-d04eff1a9a8e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:40.170736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2baf1181-abbd-482e-9559-d04eff1a9a8e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:40.171393 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2baf1181-abbd-482e-9559-d04eff1a9a8e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:40.172319 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2baf1181-abbd-482e-9559-d04eff1a9a8e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:40.172781 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2baf1181-abbd-482e-9559-d04eff1a9a8e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:40.173396 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2baf1181-abbd-482e-9559-d04eff1a9a8e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:40.329134 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2baf1181-abbd-482e-9559-d04eff1a9a8e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:40.343834 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2baf1181-abbd-482e-9559-d04eff1a9a8e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1508 microversion: 2.1 time: 0.185623 Sep 24 21:00:40.344459 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1522/3052] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:40 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1508 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:40.389817 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cd4ca154-5038-438f-83b0-95a21e740ef1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:40.390445 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cd4ca154-5038-438f-83b0-95a21e740ef1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 5c119929-2744-4871-b523-0a6a05c6c073] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:40.397990 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd4ca154-5038-438f-83b0-95a21e740ef1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:40.398833 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd4ca154-5038-438f-83b0-95a21e740ef1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:40.399631 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd4ca154-5038-438f-83b0-95a21e740ef1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:40.401202 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd4ca154-5038-438f-83b0-95a21e740ef1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:40.402215 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd4ca154-5038-438f-83b0-95a21e740ef1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:40.402849 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd4ca154-5038-438f-83b0-95a21e740ef1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:40.488923 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cd4ca154-5038-438f-83b0-95a21e740ef1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41f618458eb48f6bb4631fd254addc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4655b536ca04896993223f34d172298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:40.502245 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cd4ca154-5038-438f-83b0-95a21e740ef1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "GET /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073" status: 200 len: 1276 microversion: 2.1 time: 0.116324 Sep 24 21:00:40.515209 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1531/3053] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:40 2022] GET /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073 => generated 1276 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:40.763491 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7d5fc99c-308e-4d80-a169-eff88078bdff tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:40.767988 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7d5fc99c-308e-4d80-a169-eff88078bdff tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:40.774220 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d5fc99c-308e-4d80-a169-eff88078bdff tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:40.774812 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d5fc99c-308e-4d80-a169-eff88078bdff tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:40.775418 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d5fc99c-308e-4d80-a169-eff88078bdff tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:40.776318 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d5fc99c-308e-4d80-a169-eff88078bdff tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:40.776783 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d5fc99c-308e-4d80-a169-eff88078bdff tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:40.777216 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d5fc99c-308e-4d80-a169-eff88078bdff tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:40.782737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:00:40.811905 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7d5fc99c-308e-4d80-a169-eff88078bdff tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.056641 Sep 24 21:00:40.812490 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1523/3054] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:00:40 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 21:00:40.922819 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1a6b539f-4d71-4bd7-814b-8dbb34a33560 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:40.924246 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1a6b539f-4d71-4bd7-814b-8dbb34a33560 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 7c6ee4f7-82b5-4c95-8865-ab81076df04f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:40.931989 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a6b539f-4d71-4bd7-814b-8dbb34a33560 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:40.932775 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a6b539f-4d71-4bd7-814b-8dbb34a33560 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:40.933512 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a6b539f-4d71-4bd7-814b-8dbb34a33560 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:40.934418 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a6b539f-4d71-4bd7-814b-8dbb34a33560 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:40.935071 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a6b539f-4d71-4bd7-814b-8dbb34a33560 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:40.935688 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a6b539f-4d71-4bd7-814b-8dbb34a33560 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:41.105544 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9b6b1f60-b778-4f7d-8b15-50438b6538ec tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:41.106297 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9b6b1f60-b778-4f7d-8b15-50438b6538ec tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:41.119140 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9b6b1f60-b778-4f7d-8b15-50438b6538ec tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:41.119633 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9b6b1f60-b778-4f7d-8b15-50438b6538ec tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:41.123887 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9b6b1f60-b778-4f7d-8b15-50438b6538ec tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:41.125440 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9b6b1f60-b778-4f7d-8b15-50438b6538ec tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:41.126018 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9b6b1f60-b778-4f7d-8b15-50438b6538ec tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:41.126589 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9b6b1f60-b778-4f7d-8b15-50438b6538ec tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:41.365870 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1a6b539f-4d71-4bd7-814b-8dbb34a33560 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddab9c74c004e74a51fd8008886e542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdf8ae7524612b9c2f6a3f16c39ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:41.377011 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1a6b539f-4d71-4bd7-814b-8dbb34a33560 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f" status: 200 len: 1316 microversion: 2.1 time: 0.459255 Sep 24 21:00:41.377613 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1532/3055] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:40 2022] GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f => generated 1316 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:41.394434 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-06d6195b-2317-4a50-a07b-97d96bb36afa tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:41.395359 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-06d6195b-2317-4a50-a07b-97d96bb36afa tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:41.403584 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06d6195b-2317-4a50-a07b-97d96bb36afa tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:41.404116 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06d6195b-2317-4a50-a07b-97d96bb36afa tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:41.405100 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06d6195b-2317-4a50-a07b-97d96bb36afa tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:41.406130 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06d6195b-2317-4a50-a07b-97d96bb36afa tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:41.412725 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06d6195b-2317-4a50-a07b-97d96bb36afa tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:41.413460 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06d6195b-2317-4a50-a07b-97d96bb36afa tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:41.472556 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9b6b1f60-b778-4f7d-8b15-50438b6538ec tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:41.481216 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9b6b1f60-b778-4f7d-8b15-50438b6538ec tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c" status: 200 len: 1317 microversion: 2.1 time: 0.379655 Sep 24 21:00:41.491500 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1524/3056] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:41 2022] GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c => generated 1317 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:00:41.498755 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-24cf1fac-e40b-4dba-97db-ba9755ec35c1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:41.499759 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-24cf1fac-e40b-4dba-97db-ba9755ec35c1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:41.508170 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24cf1fac-e40b-4dba-97db-ba9755ec35c1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:41.508670 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24cf1fac-e40b-4dba-97db-ba9755ec35c1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:41.509122 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24cf1fac-e40b-4dba-97db-ba9755ec35c1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:41.509843 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24cf1fac-e40b-4dba-97db-ba9755ec35c1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:41.510589 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24cf1fac-e40b-4dba-97db-ba9755ec35c1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:41.511244 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24cf1fac-e40b-4dba-97db-ba9755ec35c1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:41.536203 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-06d6195b-2317-4a50-a07b-97d96bb36afa tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lazy-loading 'services' on Instance uuid 1d8bc459-871f-4611-ba95-7bf7d0f08a27 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:00:41.571617 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-06d6195b-2317-4a50-a07b-97d96bb36afa tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1927 microversion: 2.75 time: 0.192078 Sep 24 21:00:41.574041 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1533/3057] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:00:41 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1927 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:00:41.585931 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-10723636-9635-4320-a969-7384245307f0 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:41.589432 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-10723636-9635-4320-a969-7384245307f0 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 5c119929-2744-4871-b523-0a6a05c6c073] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:41.612225 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10723636-9635-4320-a969-7384245307f0 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:41.612999 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10723636-9635-4320-a969-7384245307f0 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:41.613692 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10723636-9635-4320-a969-7384245307f0 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:41.614683 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10723636-9635-4320-a969-7384245307f0 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:41.615423 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10723636-9635-4320-a969-7384245307f0 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:41.619253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10723636-9635-4320-a969-7384245307f0 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:41.631170 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:00:41.748252 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-24cf1fac-e40b-4dba-97db-ba9755ec35c1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:41.760925 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-24cf1fac-e40b-4dba-97db-ba9755ec35c1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1529 microversion: 2.1 time: 0.267464 Sep 24 21:00:41.761527 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1525/3058] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:41 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1529 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:41.780900 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-10723636-9635-4320-a969-7384245307f0 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41f618458eb48f6bb4631fd254addc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4655b536ca04896993223f34d172298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:41.799526 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-10723636-9635-4320-a969-7384245307f0 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "GET /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073" status: 200 len: 1276 microversion: 2.1 time: 0.222445 Sep 24 21:00:41.801361 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1534/3059] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:41 2022] GET /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073 => generated 1276 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:41.848077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-00fbea6a-d6a1-40bc-9bd6-8ed8d0e52e86 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:41.850752 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-00fbea6a-d6a1-40bc-9bd6-8ed8d0e52e86 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:41.866697 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00fbea6a-d6a1-40bc-9bd6-8ed8d0e52e86 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:41.867610 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00fbea6a-d6a1-40bc-9bd6-8ed8d0e52e86 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:41.868506 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00fbea6a-d6a1-40bc-9bd6-8ed8d0e52e86 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:41.869513 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00fbea6a-d6a1-40bc-9bd6-8ed8d0e52e86 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:41.870308 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00fbea6a-d6a1-40bc-9bd6-8ed8d0e52e86 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:41.870956 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00fbea6a-d6a1-40bc-9bd6-8ed8d0e52e86 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:41.945976 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-00fbea6a-d6a1-40bc-9bd6-8ed8d0e52e86 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.104125 Sep 24 21:00:41.950546 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1526/3060] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:00:41 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:00:42.403488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ca6b08d5-3a0a-4aab-b53e-a25aa75b40f0 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:42.404302 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ca6b08d5-3a0a-4aab-b53e-a25aa75b40f0 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 7c6ee4f7-82b5-4c95-8865-ab81076df04f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:42.414147 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ca6b08d5-3a0a-4aab-b53e-a25aa75b40f0 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:42.414777 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ca6b08d5-3a0a-4aab-b53e-a25aa75b40f0 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:42.416265 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ca6b08d5-3a0a-4aab-b53e-a25aa75b40f0 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:42.419151 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ca6b08d5-3a0a-4aab-b53e-a25aa75b40f0 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:42.419845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ca6b08d5-3a0a-4aab-b53e-a25aa75b40f0 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:42.421418 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ca6b08d5-3a0a-4aab-b53e-a25aa75b40f0 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:42.507240 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-be88bb4e-94d3-45a8-9dd8-9b6a5039c232 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:42.508122 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-be88bb4e-94d3-45a8-9dd8-9b6a5039c232 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:42.519644 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-be88bb4e-94d3-45a8-9dd8-9b6a5039c232 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:42.520980 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-be88bb4e-94d3-45a8-9dd8-9b6a5039c232 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:42.522742 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-be88bb4e-94d3-45a8-9dd8-9b6a5039c232 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:42.526172 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-be88bb4e-94d3-45a8-9dd8-9b6a5039c232 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:42.526707 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-be88bb4e-94d3-45a8-9dd8-9b6a5039c232 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:42.527238 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-be88bb4e-94d3-45a8-9dd8-9b6a5039c232 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:42.694451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ca6b08d5-3a0a-4aab-b53e-a25aa75b40f0 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddab9c74c004e74a51fd8008886e542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdf8ae7524612b9c2f6a3f16c39ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:42.707059 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ca6b08d5-3a0a-4aab-b53e-a25aa75b40f0 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f" status: 200 len: 1316 microversion: 2.1 time: 0.308283 Sep 24 21:00:42.724781 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1535/3061] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:42 2022] GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f => generated 1316 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:42.730437 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-48241d44-95b7-4612-a33c-12dd79c6cbbf tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:42.732490 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-48241d44-95b7-4612-a33c-12dd79c6cbbf tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:42.742060 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-48241d44-95b7-4612-a33c-12dd79c6cbbf tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:42.742829 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-48241d44-95b7-4612-a33c-12dd79c6cbbf tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:42.744771 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-48241d44-95b7-4612-a33c-12dd79c6cbbf tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:42.746155 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-48241d44-95b7-4612-a33c-12dd79c6cbbf tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:42.746883 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-48241d44-95b7-4612-a33c-12dd79c6cbbf tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:42.747693 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-48241d44-95b7-4612-a33c-12dd79c6cbbf tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:42.833854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-be88bb4e-94d3-45a8-9dd8-9b6a5039c232 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:42.849461 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-be88bb4e-94d3-45a8-9dd8-9b6a5039c232 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c" status: 200 len: 1317 microversion: 2.1 time: 0.347421 Sep 24 21:00:42.850847 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1527/3062] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:42 2022] GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c => generated 1317 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:42.855837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-00e9710a-aa05-492b-ad7c-7dd70e25b14c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:42.856664 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-00e9710a-aa05-492b-ad7c-7dd70e25b14c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:42.866220 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00e9710a-aa05-492b-ad7c-7dd70e25b14c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:42.867014 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00e9710a-aa05-492b-ad7c-7dd70e25b14c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:42.867618 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00e9710a-aa05-492b-ad7c-7dd70e25b14c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:42.868548 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00e9710a-aa05-492b-ad7c-7dd70e25b14c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:42.869681 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00e9710a-aa05-492b-ad7c-7dd70e25b14c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:42.870281 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-48241d44-95b7-4612-a33c-12dd79c6cbbf tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lazy-loading 'services' on Instance uuid 1d8bc459-871f-4611-ba95-7bf7d0f08a27 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:00:42.871267 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00e9710a-aa05-492b-ad7c-7dd70e25b14c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:42.912763 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-48241d44-95b7-4612-a33c-12dd79c6cbbf tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1927 microversion: 2.75 time: 0.186033 Sep 24 21:00:42.916480 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1536/3063] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:00:42 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1927 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:00:42.922038 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f656439e-4ab5-4360-bbc6-f476e85bfe4e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:42.934754 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f656439e-4ab5-4360-bbc6-f476e85bfe4e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:42.942520 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f656439e-4ab5-4360-bbc6-f476e85bfe4e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:42.944538 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f656439e-4ab5-4360-bbc6-f476e85bfe4e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:42.945177 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f656439e-4ab5-4360-bbc6-f476e85bfe4e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:42.946072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f656439e-4ab5-4360-bbc6-f476e85bfe4e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:42.951111 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f656439e-4ab5-4360-bbc6-f476e85bfe4e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:42.951772 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f656439e-4ab5-4360-bbc6-f476e85bfe4e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:43.222664 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-00e9710a-aa05-492b-ad7c-7dd70e25b14c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:43.238219 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-00e9710a-aa05-492b-ad7c-7dd70e25b14c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1681 microversion: 2.1 time: 0.385949 Sep 24 21:00:43.239110 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1528/3064] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:42 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1681 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:43.243913 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-83e1d548-6f0c-482f-aa0d-3f2d8b7d13de tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:43.244544 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-83e1d548-6f0c-482f-aa0d-3f2d8b7d13de tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 5c119929-2744-4871-b523-0a6a05c6c073] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:43.265982 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-83e1d548-6f0c-482f-aa0d-3f2d8b7d13de tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:43.266755 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-83e1d548-6f0c-482f-aa0d-3f2d8b7d13de tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:43.267396 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-83e1d548-6f0c-482f-aa0d-3f2d8b7d13de tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:43.268306 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-83e1d548-6f0c-482f-aa0d-3f2d8b7d13de tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:43.268935 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-83e1d548-6f0c-482f-aa0d-3f2d8b7d13de tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:43.269530 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-83e1d548-6f0c-482f-aa0d-3f2d8b7d13de tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:43.320431 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f656439e-4ab5-4360-bbc6-f476e85bfe4e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:43.341186 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f656439e-4ab5-4360-bbc6-f476e85bfe4e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1529 microversion: 2.1 time: 0.415633 Sep 24 21:00:43.349414 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1537/3065] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:42 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1529 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:43.363166 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b5314707-ee4b-4985-bb06-e0d0f805d07f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:43.366026 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b5314707-ee4b-4985-bb06-e0d0f805d07f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:43.385727 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5314707-ee4b-4985-bb06-e0d0f805d07f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:43.389484 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5314707-ee4b-4985-bb06-e0d0f805d07f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:43.390258 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5314707-ee4b-4985-bb06-e0d0f805d07f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:43.391284 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5314707-ee4b-4985-bb06-e0d0f805d07f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:43.392980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5314707-ee4b-4985-bb06-e0d0f805d07f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:43.393675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5314707-ee4b-4985-bb06-e0d0f805d07f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:43.413782 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-83e1d548-6f0c-482f-aa0d-3f2d8b7d13de tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41f618458eb48f6bb4631fd254addc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4655b536ca04896993223f34d172298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:43.425571 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-83e1d548-6f0c-482f-aa0d-3f2d8b7d13de tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "GET /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073" status: 200 len: 1282 microversion: 2.1 time: 0.184196 Sep 24 21:00:43.426711 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1529/3066] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:43 2022] GET /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073 => generated 1282 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:43.487752 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b5314707-ee4b-4985-bb06-e0d0f805d07f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.136647 Sep 24 21:00:43.491149 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1538/3067] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:00:43 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:00:43.702464 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-417159a4-c8cf-4ac3-8fa0-1f41249b619e req-3944587a-9036-4900-9709-3e5b8c1e3228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c6ee4f7-82b5-4c95-8865-ab81076df04f", "name": "network-vif-plugged", "status": "completed", "tag": "e1795d42-5be1-400f-9688-3f2a6d103ce9"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:43.725141 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-417159a4-c8cf-4ac3-8fa0-1f41249b619e req-3944587a-9036-4900-9709-3e5b8c1e3228 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:43.725645 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-417159a4-c8cf-4ac3-8fa0-1f41249b619e req-3944587a-9036-4900-9709-3e5b8c1e3228 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:43.726103 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-417159a4-c8cf-4ac3-8fa0-1f41249b619e req-3944587a-9036-4900-9709-3e5b8c1e3228 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:43.746120 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b316c6e9-0061-4f8c-b21b-977a8210faf8 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:43.746808 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b316c6e9-0061-4f8c-b21b-977a8210faf8 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 7c6ee4f7-82b5-4c95-8865-ab81076df04f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:43.758774 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b316c6e9-0061-4f8c-b21b-977a8210faf8 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:43.759467 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b316c6e9-0061-4f8c-b21b-977a8210faf8 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:43.766568 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b316c6e9-0061-4f8c-b21b-977a8210faf8 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:43.771169 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b316c6e9-0061-4f8c-b21b-977a8210faf8 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:43.771817 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b316c6e9-0061-4f8c-b21b-977a8210faf8 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:43.777240 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b316c6e9-0061-4f8c-b21b-977a8210faf8 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:43.780734 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-417159a4-c8cf-4ac3-8fa0-1f41249b619e req-3944587a-9036-4900-9709-3e5b8c1e3228 service nova] Creating event network-vif-plugged:e1795d42-5be1-400f-9688-3f2a6d103ce9 for instance 7c6ee4f7-82b5-4c95-8865-ab81076df04f on nch1-master-1 Sep 24 21:00:43.802355 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-417159a4-c8cf-4ac3-8fa0-1f41249b619e req-3944587a-9036-4900-9709-3e5b8c1e3228 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101783 Sep 24 21:00:43.806857 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1530/3068] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:00:43.878848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-63b9bc37-c67a-4a91-9f15-4e4d83ddc5fd tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:43.879714 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-63b9bc37-c67a-4a91-9f15-4e4d83ddc5fd tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:43.890912 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-63b9bc37-c67a-4a91-9f15-4e4d83ddc5fd tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:43.894856 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-63b9bc37-c67a-4a91-9f15-4e4d83ddc5fd tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:43.895434 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-63b9bc37-c67a-4a91-9f15-4e4d83ddc5fd tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:43.898758 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-63b9bc37-c67a-4a91-9f15-4e4d83ddc5fd tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:43.900350 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-63b9bc37-c67a-4a91-9f15-4e4d83ddc5fd tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:43.902007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-63b9bc37-c67a-4a91-9f15-4e4d83ddc5fd tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:44.319220 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b316c6e9-0061-4f8c-b21b-977a8210faf8 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddab9c74c004e74a51fd8008886e542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdf8ae7524612b9c2f6a3f16c39ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:44.332638 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b316c6e9-0061-4f8c-b21b-977a8210faf8 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f" status: 200 len: 1316 microversion: 2.1 time: 0.595414 Sep 24 21:00:44.335139 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1539/3069] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:43 2022] GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f => generated 1316 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:44.348241 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-372680e9-efca-4528-a64a-29e9000d481e tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:44.351617 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-372680e9-efca-4528-a64a-29e9000d481e tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:44.376660 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-372680e9-efca-4528-a64a-29e9000d481e tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:44.378465 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-372680e9-efca-4528-a64a-29e9000d481e tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:44.379096 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-372680e9-efca-4528-a64a-29e9000d481e tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:44.380765 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-372680e9-efca-4528-a64a-29e9000d481e tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:44.383044 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-372680e9-efca-4528-a64a-29e9000d481e tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:44.383835 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-372680e9-efca-4528-a64a-29e9000d481e tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:44.507013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-63b9bc37-c67a-4a91-9f15-4e4d83ddc5fd tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:44.520548 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-63b9bc37-c67a-4a91-9f15-4e4d83ddc5fd tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c" status: 200 len: 1507 microversion: 2.1 time: 0.644686 Sep 24 21:00:44.522511 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1531/3070] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:43 2022] GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c => generated 1507 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:00:44.547461 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f1b8486e-5e52-420f-960b-a02e411cef86 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:44.548840 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f1b8486e-5e52-420f-960b-a02e411cef86 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:44.561541 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f1b8486e-5e52-420f-960b-a02e411cef86 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:44.562517 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f1b8486e-5e52-420f-960b-a02e411cef86 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:44.563160 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f1b8486e-5e52-420f-960b-a02e411cef86 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:44.564101 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f1b8486e-5e52-420f-960b-a02e411cef86 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:44.564750 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f1b8486e-5e52-420f-960b-a02e411cef86 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:44.565539 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f1b8486e-5e52-420f-960b-a02e411cef86 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:44.735894 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-372680e9-efca-4528-a64a-29e9000d481e tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lazy-loading 'services' on Instance uuid 1d8bc459-871f-4611-ba95-7bf7d0f08a27 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:00:44.762348 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-372680e9-efca-4528-a64a-29e9000d481e tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1927 microversion: 2.75 time: 0.425912 Sep 24 21:00:44.783484 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1540/3071] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:00:44 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1927 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:00:44.790915 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-74670c6e-ba11-4f66-ac07-fd0aba6a6ba3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:44.791885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-74670c6e-ba11-4f66-ac07-fd0aba6a6ba3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:44.798996 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-74670c6e-ba11-4f66-ac07-fd0aba6a6ba3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:44.799724 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-74670c6e-ba11-4f66-ac07-fd0aba6a6ba3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:44.800553 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-74670c6e-ba11-4f66-ac07-fd0aba6a6ba3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:44.801508 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-74670c6e-ba11-4f66-ac07-fd0aba6a6ba3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:44.802035 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-74670c6e-ba11-4f66-ac07-fd0aba6a6ba3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:44.803299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-74670c6e-ba11-4f66-ac07-fd0aba6a6ba3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:45.201502 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f1b8486e-5e52-420f-960b-a02e411cef86 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:45.228093 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f1b8486e-5e52-420f-960b-a02e411cef86 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.687260 Sep 24 21:00:45.234479 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1532/3072] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:44 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:45.270850 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-90c6ee29-f8b6-4428-beaf-868c78518831 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:45.271788 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-90c6ee29-f8b6-4428-beaf-868c78518831 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 5c119929-2744-4871-b523-0a6a05c6c073] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:45.298265 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-90c6ee29-f8b6-4428-beaf-868c78518831 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:45.299162 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-90c6ee29-f8b6-4428-beaf-868c78518831 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:45.299883 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-90c6ee29-f8b6-4428-beaf-868c78518831 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:45.300835 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-90c6ee29-f8b6-4428-beaf-868c78518831 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:45.301499 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-90c6ee29-f8b6-4428-beaf-868c78518831 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:45.302139 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-90c6ee29-f8b6-4428-beaf-868c78518831 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:45.504140 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-74670c6e-ba11-4f66-ac07-fd0aba6a6ba3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:45.522598 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-74670c6e-ba11-4f66-ac07-fd0aba6a6ba3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1524 microversion: 2.1 time: 0.737129 Sep 24 21:00:45.523074 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1541/3073] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:44 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1524 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:45.538367 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7e698230-e114-4723-be02-b1f8b9cabb4e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:45.540849 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7e698230-e114-4723-be02-b1f8b9cabb4e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:45.565035 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7e698230-e114-4723-be02-b1f8b9cabb4e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:45.566322 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7e698230-e114-4723-be02-b1f8b9cabb4e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:45.567068 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7e698230-e114-4723-be02-b1f8b9cabb4e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:45.571414 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7e698230-e114-4723-be02-b1f8b9cabb4e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:45.572410 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7e698230-e114-4723-be02-b1f8b9cabb4e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:45.573365 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7e698230-e114-4723-be02-b1f8b9cabb4e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:45.651457 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7e698230-e114-4723-be02-b1f8b9cabb4e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.127123 Sep 24 21:00:45.656324 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1542/3074] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:00:45 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:00:45.660332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-10a00696-59b9-476e-99d8-94837519d0ed tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:45.660963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-10a00696-59b9-476e-99d8-94837519d0ed tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:45.676013 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10a00696-59b9-476e-99d8-94837519d0ed tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:45.676520 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10a00696-59b9-476e-99d8-94837519d0ed tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:45.676965 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10a00696-59b9-476e-99d8-94837519d0ed tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:45.677686 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10a00696-59b9-476e-99d8-94837519d0ed tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:45.683779 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10a00696-59b9-476e-99d8-94837519d0ed tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:45.684276 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10a00696-59b9-476e-99d8-94837519d0ed tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:45.896127 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-90c6ee29-f8b6-4428-beaf-868c78518831 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41f618458eb48f6bb4631fd254addc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4655b536ca04896993223f34d172298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:45.919083 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-90c6ee29-f8b6-4428-beaf-868c78518831 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "GET /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073" status: 200 len: 1324 microversion: 2.1 time: 0.648222 Sep 24 21:00:45.920754 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1533/3075] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:45 2022] GET /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073 => generated 1324 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:45.930698 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-97d92004-a8e5-41e5-8501-b439e953f0cf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-389364619"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:45.946050 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-97d92004-a8e5-41e5-8501-b439e953f0cf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:45.963686 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97d92004-a8e5-41e5-8501-b439e953f0cf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:45.964550 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97d92004-a8e5-41e5-8501-b439e953f0cf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:45.965369 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97d92004-a8e5-41e5-8501-b439e953f0cf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:45.966729 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97d92004-a8e5-41e5-8501-b439e953f0cf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:45.967587 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97d92004-a8e5-41e5-8501-b439e953f0cf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:45.969058 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97d92004-a8e5-41e5-8501-b439e953f0cf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:46.317759 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-10a00696-59b9-476e-99d8-94837519d0ed tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:46.333997 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-10a00696-59b9-476e-99d8-94837519d0ed tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c" status: 200 len: 1507 microversion: 2.1 time: 0.680424 Sep 24 21:00:46.338299 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1543/3076] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:45 2022] GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c => generated 1507 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:46.350213 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5d4eedab-c03d-48e7-827e-d0d163432110 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:46.352997 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5d4eedab-c03d-48e7-827e-d0d163432110 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 7c6ee4f7-82b5-4c95-8865-ab81076df04f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:46.370278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d4eedab-c03d-48e7-827e-d0d163432110 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:46.371028 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d4eedab-c03d-48e7-827e-d0d163432110 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:46.371632 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d4eedab-c03d-48e7-827e-d0d163432110 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:46.372510 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d4eedab-c03d-48e7-827e-d0d163432110 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:46.374189 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d4eedab-c03d-48e7-827e-d0d163432110 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:46.377649 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d4eedab-c03d-48e7-827e-d0d163432110 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:46.507749 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-97d92004-a8e5-41e5-8501-b439e953f0cf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "POST /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/action" status: 202 len: 0 microversion: 2.1 time: 0.585220 Sep 24 21:00:46.520330 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1534/3077] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:00:45 2022] POST /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/action => generated 0 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 24 21:00:46.530294 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-acf9ba05-f578-4d35-b40e-7f0d04280eac tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:46.531040 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-acf9ba05-f578-4d35-b40e-7f0d04280eac tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:46.567382 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-acf9ba05-f578-4d35-b40e-7f0d04280eac tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:46.573568 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-acf9ba05-f578-4d35-b40e-7f0d04280eac tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:46.577055 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-acf9ba05-f578-4d35-b40e-7f0d04280eac tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:46.580383 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-acf9ba05-f578-4d35-b40e-7f0d04280eac tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:46.583347 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-acf9ba05-f578-4d35-b40e-7f0d04280eac tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:46.584350 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-acf9ba05-f578-4d35-b40e-7f0d04280eac tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:46.776979 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-acf9ba05-f578-4d35-b40e-7f0d04280eac tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lazy-loading 'services' on Instance uuid 1d8bc459-871f-4611-ba95-7bf7d0f08a27 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:00:46.829280 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-acf9ba05-f578-4d35-b40e-7f0d04280eac tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1927 microversion: 2.75 time: 0.304056 Sep 24 21:00:46.860068 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1535/3078] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:00:46 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1927 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:00:46.874955 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-aa174a8b-f002-4398-afa2-fe9e8a631aa0 req-53530a34-9fac-4fdc-b9ba-c65faf68047c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c96f88e-1327-49e3-8e9a-5417f96fb308", "name": "network-vif-plugged", "status": "completed", "tag": "f8825c51-2e9d-4429-9259-cd32e621d907"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:46.900668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-aa174a8b-f002-4398-afa2-fe9e8a631aa0 req-53530a34-9fac-4fdc-b9ba-c65faf68047c service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:46.901225 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-aa174a8b-f002-4398-afa2-fe9e8a631aa0 req-53530a34-9fac-4fdc-b9ba-c65faf68047c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:46.903487 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-aa174a8b-f002-4398-afa2-fe9e8a631aa0 req-53530a34-9fac-4fdc-b9ba-c65faf68047c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:46.930854 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-aa174a8b-f002-4398-afa2-fe9e8a631aa0 req-53530a34-9fac-4fdc-b9ba-c65faf68047c service nova] Creating event network-vif-plugged:f8825c51-2e9d-4429-9259-cd32e621d907 for instance 9c96f88e-1327-49e3-8e9a-5417f96fb308 on nch2-master-1 Sep 24 21:00:46.948392 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-aa174a8b-f002-4398-afa2-fe9e8a631aa0 req-53530a34-9fac-4fdc-b9ba-c65faf68047c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086861 Sep 24 21:00:46.949591 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1536/3079] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:00:46.961038 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-8227d7d0-45d5-4ba0-b8fa-a68d00cf14b6 req-c4b231e8-93a3-49d5-81ec-d3bee745d70a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c119929-2744-4871-b523-0a6a05c6c073", "tag": "328bc618-9c61-46b1-a53c-716485f1d492"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:46.978216 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5d4eedab-c03d-48e7-827e-d0d163432110 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddab9c74c004e74a51fd8008886e542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdf8ae7524612b9c2f6a3f16c39ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:46.985177 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-8227d7d0-45d5-4ba0-b8fa-a68d00cf14b6 req-c4b231e8-93a3-49d5-81ec-d3bee745d70a service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:46.985724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-8227d7d0-45d5-4ba0-b8fa-a68d00cf14b6 req-c4b231e8-93a3-49d5-81ec-d3bee745d70a service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:46.987872 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-8227d7d0-45d5-4ba0-b8fa-a68d00cf14b6 req-c4b231e8-93a3-49d5-81ec-d3bee745d70a service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:46.994030 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5d4eedab-c03d-48e7-827e-d0d163432110 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f" status: 200 len: 1504 microversion: 2.1 time: 0.653649 Sep 24 21:00:46.995115 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1544/3080] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:46 2022] GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f => generated 1504 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:47.006021 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-90a53d2e-7109-4b6c-b3fb-a51dfb2b7803 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:47.008694 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-90a53d2e-7109-4b6c-b3fb-a51dfb2b7803 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:47.024029 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=4 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:00:47.027099 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-90a53d2e-7109-4b6c-b3fb-a51dfb2b7803 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:47.027859 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-90a53d2e-7109-4b6c-b3fb-a51dfb2b7803 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:47.028458 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-90a53d2e-7109-4b6c-b3fb-a51dfb2b7803 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:47.029369 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-90a53d2e-7109-4b6c-b3fb-a51dfb2b7803 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:47.029990 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-90a53d2e-7109-4b6c-b3fb-a51dfb2b7803 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:47.030602 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-90a53d2e-7109-4b6c-b3fb-a51dfb2b7803 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:47.040978 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-8227d7d0-45d5-4ba0-b8fa-a68d00cf14b6 req-c4b231e8-93a3-49d5-81ec-d3bee745d70a service nova] Creating event network-changed:328bc618-9c61-46b1-a53c-716485f1d492 for instance 5c119929-2744-4871-b523-0a6a05c6c073 on nch1-master-1 Sep 24 21:00:47.054606 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-8227d7d0-45d5-4ba0-b8fa-a68d00cf14b6 req-c4b231e8-93a3-49d5-81ec-d3bee745d70a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103482 Sep 24 21:00:47.055686 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1537/3081] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:00:47.061861 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4fdbd77b-840b-45ca-a84a-44312096e2f0 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:47.066395 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4fdbd77b-840b-45ca-a84a-44312096e2f0 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:47.084558 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4fdbd77b-840b-45ca-a84a-44312096e2f0 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:47.088782 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4fdbd77b-840b-45ca-a84a-44312096e2f0 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:47.089524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4fdbd77b-840b-45ca-a84a-44312096e2f0 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:47.090512 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4fdbd77b-840b-45ca-a84a-44312096e2f0 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:47.091203 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4fdbd77b-840b-45ca-a84a-44312096e2f0 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:47.092119 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4fdbd77b-840b-45ca-a84a-44312096e2f0 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:47.124873 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-90a53d2e-7109-4b6c-b3fb-a51dfb2b7803 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "PUT /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c" status: 200 len: 1079 microversion: 2.1 time: 0.127973 Sep 24 21:00:47.126096 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1545/3082] 10.222.0.52 () {60 vars in 1256 bytes} [Sat Sep 24 21:00:46 2022] PUT /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c => generated 1079 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:47.131570 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a2002716-3527-424c-9248-33d53cc67b08 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:47.134027 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a2002716-3527-424c-9248-33d53cc67b08 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:47.141567 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2002716-3527-424c-9248-33d53cc67b08 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:47.142299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2002716-3527-424c-9248-33d53cc67b08 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:47.144124 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2002716-3527-424c-9248-33d53cc67b08 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:47.146103 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2002716-3527-424c-9248-33d53cc67b08 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:47.146779 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2002716-3527-424c-9248-33d53cc67b08 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:47.147376 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2002716-3527-424c-9248-33d53cc67b08 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:47.193604 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a2002716-3527-424c-9248-33d53cc67b08 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.065988 Sep 24 21:00:47.194897 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1546/3083] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:00:47 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:00:47.201799 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d7822b75-635b-4bf9-ba8a-e2c9368693c1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:47.202963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d7822b75-635b-4bf9-ba8a-e2c9368693c1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 5c119929-2744-4871-b523-0a6a05c6c073] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:47.210759 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7822b75-635b-4bf9-ba8a-e2c9368693c1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:47.211514 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7822b75-635b-4bf9-ba8a-e2c9368693c1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:47.212156 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7822b75-635b-4bf9-ba8a-e2c9368693c1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:47.213168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7822b75-635b-4bf9-ba8a-e2c9368693c1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:47.213829 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7822b75-635b-4bf9-ba8a-e2c9368693c1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:47.214418 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7822b75-635b-4bf9-ba8a-e2c9368693c1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:47.697813 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d7822b75-635b-4bf9-ba8a-e2c9368693c1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41f618458eb48f6bb4631fd254addc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4655b536ca04896993223f34d172298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:47.714342 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4fdbd77b-840b-45ca-a84a-44312096e2f0 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:47.725913 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4fdbd77b-840b-45ca-a84a-44312096e2f0 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1524 microversion: 2.1 time: 0.668450 Sep 24 21:00:47.727059 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1538/3084] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:47 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1524 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:47.734301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-117b0c01-6dfb-411e-a097-1d41b61b442e tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2085541972"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:47.735192 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-117b0c01-6dfb-411e-a097-1d41b61b442e tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 7c6ee4f7-82b5-4c95-8865-ab81076df04f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:47.743568 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-117b0c01-6dfb-411e-a097-1d41b61b442e tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:47.744321 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-117b0c01-6dfb-411e-a097-1d41b61b442e tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:47.744914 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-117b0c01-6dfb-411e-a097-1d41b61b442e tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:47.745891 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-117b0c01-6dfb-411e-a097-1d41b61b442e tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:47.746663 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-117b0c01-6dfb-411e-a097-1d41b61b442e tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:47.747237 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-117b0c01-6dfb-411e-a097-1d41b61b442e tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:47.750731 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d7822b75-635b-4bf9-ba8a-e2c9368693c1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "GET /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073" status: 200 len: 1324 microversion: 2.1 time: 0.554502 Sep 24 21:00:47.751465 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1547/3085] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:47 2022] GET /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073 => generated 1324 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:47.756617 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-918f1a0f-8006-4644-ad37-f4bf1cc0d1e4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:47.759425 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-918f1a0f-8006-4644-ad37-f4bf1cc0d1e4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:47.769889 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-918f1a0f-8006-4644-ad37-f4bf1cc0d1e4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:47.770839 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-918f1a0f-8006-4644-ad37-f4bf1cc0d1e4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:47.775257 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-918f1a0f-8006-4644-ad37-f4bf1cc0d1e4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:47.777230 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-918f1a0f-8006-4644-ad37-f4bf1cc0d1e4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:47.777720 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-918f1a0f-8006-4644-ad37-f4bf1cc0d1e4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:47.791168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-918f1a0f-8006-4644-ad37-f4bf1cc0d1e4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:48.205599 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=18 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:00:48.304453 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.network.security_group_api [None req-117b0c01-6dfb-411e-a097-1d41b61b442e tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Adding security group f876d855-6948-4446-a64d-20bd145875d3 to port e1795d42-5be1-400f-9688-3f2a6d103ce9 Sep 24 21:00:48.400500 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-918f1a0f-8006-4644-ad37-f4bf1cc0d1e4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:48.410443 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-918f1a0f-8006-4644-ad37-f4bf1cc0d1e4 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c" status: 200 len: 1505 microversion: 2.1 time: 0.657363 Sep 24 21:00:48.411062 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1548/3086] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:47 2022] GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c => generated 1505 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:48.436188 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-faaa5197-1728-4bbd-a571-8609b999eb8d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:48.437079 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-faaa5197-1728-4bbd-a571-8609b999eb8d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:48.443360 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-faaa5197-1728-4bbd-a571-8609b999eb8d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:48.443845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-faaa5197-1728-4bbd-a571-8609b999eb8d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:48.444457 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-faaa5197-1728-4bbd-a571-8609b999eb8d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:48.445172 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-faaa5197-1728-4bbd-a571-8609b999eb8d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:48.445625 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-faaa5197-1728-4bbd-a571-8609b999eb8d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:48.446052 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-faaa5197-1728-4bbd-a571-8609b999eb8d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:48.478430 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:00:48.609773 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-faaa5197-1728-4bbd-a571-8609b999eb8d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lazy-loading 'services' on Instance uuid 1d8bc459-871f-4611-ba95-7bf7d0f08a27 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:00:48.650684 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-faaa5197-1728-4bbd-a571-8609b999eb8d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1927 microversion: 2.75 time: 0.217726 Sep 24 21:00:48.651528 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1549/3087] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:00:48 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1927 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:00:48.896450 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-814fc1db-8f2c-4829-ae69-70dc9939a962 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1864063570", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "3170c36d-98a6-43e0-abcd-41b9e51b1d2e"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:49.007881 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-814fc1db-8f2c-4829-ae69-70dc9939a962 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] validate_networks() for [('3170c36d-98a6-43e0-abcd-41b9e51b1d2e', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:00:49.098067 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-117b0c01-6dfb-411e-a097-1d41b61b442e tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "POST /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f/action" status: 202 len: 0 microversion: 2.1 time: 1.368828 Sep 24 21:00:49.102385 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1539/3088] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:00:47 2022] POST /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f/action => generated 0 bytes in 1374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:00:49.107992 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-40669379-0848-40f4-baf9-9b553d845241 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:49.110648 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-40669379-0848-40f4-baf9-9b553d845241 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:49.128200 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-40669379-0848-40f4-baf9-9b553d845241 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:49.130174 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-40669379-0848-40f4-baf9-9b553d845241 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:49.134353 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-40669379-0848-40f4-baf9-9b553d845241 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:49.135635 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-40669379-0848-40f4-baf9-9b553d845241 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:49.136337 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-40669379-0848-40f4-baf9-9b553d845241 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:49.136999 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-40669379-0848-40f4-baf9-9b553d845241 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:49.173035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:00:49.200862 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-40669379-0848-40f4-baf9-9b553d845241 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.096967 Sep 24 21:00:49.202781 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1540/3089] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:00:49 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:00:49.208087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-73b697c0-2dc8-4cce-9932-5be4b4cd4f2a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:49.209092 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-73b697c0-2dc8-4cce-9932-5be4b4cd4f2a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:49.215781 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-73b697c0-2dc8-4cce-9932-5be4b4cd4f2a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:49.216618 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-73b697c0-2dc8-4cce-9932-5be4b4cd4f2a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:49.217467 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-73b697c0-2dc8-4cce-9932-5be4b4cd4f2a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:49.218424 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-73b697c0-2dc8-4cce-9932-5be4b4cd4f2a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:49.219169 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-73b697c0-2dc8-4cce-9932-5be4b4cd4f2a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:49.219829 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-73b697c0-2dc8-4cce-9932-5be4b4cd4f2a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:49.624985 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-73b697c0-2dc8-4cce-9932-5be4b4cd4f2a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:49.638185 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-73b697c0-2dc8-4cce-9932-5be4b4cd4f2a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c" status: 200 len: 1505 microversion: 2.1 time: 0.434014 Sep 24 21:00:49.653559 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1541/3090] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:49 2022] GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c => generated 1505 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:49.659575 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bce585ec-d4b6-4d20-9a6c-bf99aeaee054 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:49.660268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bce585ec-d4b6-4d20-9a6c-bf99aeaee054 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:49.672814 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bce585ec-d4b6-4d20-9a6c-bf99aeaee054 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:49.673416 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bce585ec-d4b6-4d20-9a6c-bf99aeaee054 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:49.673766 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bce585ec-d4b6-4d20-9a6c-bf99aeaee054 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:49.674487 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bce585ec-d4b6-4d20-9a6c-bf99aeaee054 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:49.676856 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bce585ec-d4b6-4d20-9a6c-bf99aeaee054 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:49.677334 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bce585ec-d4b6-4d20-9a6c-bf99aeaee054 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:49.966048 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bce585ec-d4b6-4d20-9a6c-bf99aeaee054 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:49.967949 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-814fc1db-8f2c-4829-ae69-70dc9939a962 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:00:49.968539 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-814fc1db-8f2c-4829-ae69-70dc9939a962 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:00:49.969157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-814fc1db-8f2c-4829-ae69-70dc9939a962 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:00:49.969685 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-814fc1db-8f2c-4829-ae69-70dc9939a962 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:00:49.970280 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-814fc1db-8f2c-4829-ae69-70dc9939a962 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:00:49.979716 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bce585ec-d4b6-4d20-9a6c-bf99aeaee054 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1524 microversion: 2.1 time: 0.325501 Sep 24 21:00:49.987845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-814fc1db-8f2c-4829-ae69-70dc9939a962 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:49.990579 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-814fc1db-8f2c-4829-ae69-70dc9939a962 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:49.991715 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-814fc1db-8f2c-4829-ae69-70dc9939a962 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:49.994834 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-814fc1db-8f2c-4829-ae69-70dc9939a962 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:49.997555 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-814fc1db-8f2c-4829-ae69-70dc9939a962 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:49.998908 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-814fc1db-8f2c-4829-ae69-70dc9939a962 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:50.010261 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1542/3091] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:49 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1524 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:50.016234 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-28f77582-3c62-46bb-a8cb-fabd0ba9c2ab tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:50.017086 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-28f77582-3c62-46bb-a8cb-fabd0ba9c2ab tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 5c119929-2744-4871-b523-0a6a05c6c073] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:50.023908 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-28f77582-3c62-46bb-a8cb-fabd0ba9c2ab tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:50.024627 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-28f77582-3c62-46bb-a8cb-fabd0ba9c2ab tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:50.025460 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-28f77582-3c62-46bb-a8cb-fabd0ba9c2ab tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:50.026347 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-28f77582-3c62-46bb-a8cb-fabd0ba9c2ab tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:50.027061 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-28f77582-3c62-46bb-a8cb-fabd0ba9c2ab tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:50.027693 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-28f77582-3c62-46bb-a8cb-fabd0ba9c2ab tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:50.044679 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-814fc1db-8f2c-4829-ae69-70dc9939a962 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Getting quotas for project 5b68f292633a49ca82fb05d18ea83142. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:00:50.051442 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-814fc1db-8f2c-4829-ae69-70dc9939a962 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Getting quotas for user c7c49bed91bb437087a8ad2d865c2647 and project 5b68f292633a49ca82fb05d18ea83142. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:00:50.068061 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-814fc1db-8f2c-4829-ae69-70dc9939a962 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Going to run 2 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:00:50.070702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-814fc1db-8f2c-4829-ae69-70dc9939a962 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] [instance: c660bb73-2186-4c86-b57b-0c6c3be5c9bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:00:50.115411 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-814fc1db-8f2c-4829-ae69-70dc9939a962 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] [instance: a178dffd-f620-41c2-b1b5-5ccc1ec52786] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=c660bb73-2186-4c86-b57b-0c6c3be5c9bf,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:00:50.210690 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-814fc1db-8f2c-4829-ae69-70dc9939a962 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.554483 Sep 24 21:00:50.210690 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1550/3092] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:00:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:00:50.221806 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-398c4b71-4475-4482-a741-76309e07c597 req-782796f5-a91c-4422-94a3-c6f3e47a2754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d546302-deb3-47c6-b9fd-3155ced00883", "name": "network-vif-unplugged", "status": "completed", "tag": "56949465-71b8-45bb-b1d2-4b934bfc9714"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:50.255382 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-398c4b71-4475-4482-a741-76309e07c597 req-782796f5-a91c-4422-94a3-c6f3e47a2754 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:50.256207 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-398c4b71-4475-4482-a741-76309e07c597 req-782796f5-a91c-4422-94a3-c6f3e47a2754 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:50.257872 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-398c4b71-4475-4482-a741-76309e07c597 req-782796f5-a91c-4422-94a3-c6f3e47a2754 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:50.268961 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-28f77582-3c62-46bb-a8cb-fabd0ba9c2ab tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41f618458eb48f6bb4631fd254addc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4655b536ca04896993223f34d172298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:50.276846 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-398c4b71-4475-4482-a741-76309e07c597 req-782796f5-a91c-4422-94a3-c6f3e47a2754 service nova] Creating event network-vif-unplugged:56949465-71b8-45bb-b1d2-4b934bfc9714 for instance 0d546302-deb3-47c6-b9fd-3155ced00883 on nch1-master-1 Sep 24 21:00:50.278907 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-28f77582-3c62-46bb-a8cb-fabd0ba9c2ab tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "GET /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073" status: 200 len: 1324 microversion: 2.1 time: 0.267415 Sep 24 21:00:50.284873 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-398c4b71-4475-4482-a741-76309e07c597 req-782796f5-a91c-4422-94a3-c6f3e47a2754 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072815 Sep 24 21:00:50.286368 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1551/3093] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:00:50.298520 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1543/3094] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:50 2022] GET /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073 => generated 1324 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:50.298792 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6d2de931-e904-4b3c-aa3e-ad96c5c7b7db tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '.version_select at 0x7f4b0c0ea3a0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:50.302703 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-7e42d389-0876-4db6-92e1-7a3c38e0cb10 req-6d6489ea-064d-41b0-ae24-c3f98001e15c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c6ee4f7-82b5-4c95-8865-ab81076df04f", "tag": "e1795d42-5be1-400f-9688-3f2a6d103ce9"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:50.339230 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-7e42d389-0876-4db6-92e1-7a3c38e0cb10 req-6d6489ea-064d-41b0-ae24-c3f98001e15c service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:50.339871 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-7e42d389-0876-4db6-92e1-7a3c38e0cb10 req-6d6489ea-064d-41b0-ae24-c3f98001e15c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:50.342730 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-7e42d389-0876-4db6-92e1-7a3c38e0cb10 req-6d6489ea-064d-41b0-ae24-c3f98001e15c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:50.373269 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-7e42d389-0876-4db6-92e1-7a3c38e0cb10 req-6d6489ea-064d-41b0-ae24-c3f98001e15c service nova] Creating event network-changed:e1795d42-5be1-400f-9688-3f2a6d103ce9 for instance 7c6ee4f7-82b5-4c95-8865-ab81076df04f on nch1-master-1 Sep 24 21:00:50.386922 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-7e42d389-0876-4db6-92e1-7a3c38e0cb10 req-6d6489ea-064d-41b0-ae24-c3f98001e15c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097994 Sep 24 21:00:50.391492 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1544/3095] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:00:50.409784 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-18b7a5e0-41d1-449b-a92c-1523751c4268 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:50.417394 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-18b7a5e0-41d1-449b-a92c-1523751c4268 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:50.444444 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-18b7a5e0-41d1-449b-a92c-1523751c4268 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:50.445606 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-18b7a5e0-41d1-449b-a92c-1523751c4268 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:50.447197 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-18b7a5e0-41d1-449b-a92c-1523751c4268 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:50.450158 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-18b7a5e0-41d1-449b-a92c-1523751c4268 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:50.452865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-18b7a5e0-41d1-449b-a92c-1523751c4268 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:50.454377 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-18b7a5e0-41d1-449b-a92c-1523751c4268 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:50.696388 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-18b7a5e0-41d1-449b-a92c-1523751c4268 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "PUT /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c" status: 200 len: 1081 microversion: 2.1 time: 0.300670 Sep 24 21:00:50.697141 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1545/3096] 10.222.0.52 () {60 vars in 1256 bytes} [Sat Sep 24 21:00:50 2022] PUT /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c => generated 1081 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:50.730387 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a5a5cdcf-b25f-444a-ad9b-2d152b18aa6a tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:50.734994 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a5a5cdcf-b25f-444a-ad9b-2d152b18aa6a tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:50.752086 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5a5cdcf-b25f-444a-ad9b-2d152b18aa6a tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:50.752603 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5a5cdcf-b25f-444a-ad9b-2d152b18aa6a tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:50.753053 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5a5cdcf-b25f-444a-ad9b-2d152b18aa6a tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:50.755685 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5a5cdcf-b25f-444a-ad9b-2d152b18aa6a tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:50.764118 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5a5cdcf-b25f-444a-ad9b-2d152b18aa6a tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:50.764692 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5a5cdcf-b25f-444a-ad9b-2d152b18aa6a tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:51.069345 ncdv-master-1 devstack@n-api.service[140516]: DEBUG neutronclient.v2_0.client [None req-6d2de931-e904-4b3c-aa3e-ad96c5c7b7db tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group f876d855-6948-4446-a64d-20bd145875d3 in use.", "detail": ""}} {{(pid=140516) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 24 21:00:51.071348 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-6d2de931-e904-4b3c-aa3e-ad96c5c7b7db tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] HTTP exception thrown: Security Group f876d855-6948-4446-a64d-20bd145875d3 in use. Sep 24 21:00:51.071348 ncdv-master-1 devstack@n-api.service[140516]: Neutron server returns request_ids: ['req-b9196374-49da-420f-b500-05d7ec755354'] Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6d2de931-e904-4b3c-aa3e-ad96c5c7b7db tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Request method failure captured: Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/os-security-groups/f876d855-6948-4446-a64d-20bd145875d3 HTTP/1.1 Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL2_KTBoQE1biSOdbxiN02s3h0D1W3LZT4KXbL5sweudoA3LIqkhpSDHo_3ElsoW-S4pinCvYVIPwwmg75I3QYjyeUH8E9-UCSOe6Wat6dff2LaBOhzu2fRTo0k0Ryv1Z1NW8ftU_9LakKBqftyUWUBvBSk8oz2eNB_e-v5W7ciYbcII Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 981fdf8ae7524612b9c2f6a3f16c39ec Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 981fdf8ae7524612b9c2f6a3f16c39ec Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-SecurityGroupsTestJSON-321124649-project Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 5ddab9c74c004e74a51fd8008886e542 Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-SecurityGroupsTestJSON-321124649-project Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: exception: Security Group f876d855-6948-4446-a64d-20bd145875d3 in use. Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: Neutron server returns request_ids: ['req-b9196374-49da-420f-b500-05d7ec755354'] Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'f876d855-6948-4446-a64d-20bd145875d3'} Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 24 21:00:51.074130 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group f876d855-6948-4446-a64d-20bd145875d3 in use. Sep 24 21:00:51.077947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b9196374-49da-420f-b500-05d7ec755354'] Sep 24 21:00:51.077947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:00:51.077947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:00:51.077947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:00:51.077947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:00:51.077947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 24 21:00:51.077947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 24 21:00:51.077947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 24 21:00:51.077947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 24 21:00:51.077947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group f876d855-6948-4446-a64d-20bd145875d3 in use. Sep 24 21:00:51.077947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b9196374-49da-420f-b500-05d7ec755354'] Sep 24 21:00:51.077947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:00:51.077947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:00:51.077947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:00:51.077947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:00:51.077947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:00:51.077947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:00:51.077947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:00:51.077947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:00:51.077947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:00:51.077947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:00:51.077947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:00:51.077947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:00:51.077947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 24 21:00:51.077947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 24 21:00:51.077947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group f876d855-6948-4446-a64d-20bd145875d3 in use. Sep 24 21:00:51.077947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b9196374-49da-420f-b500-05d7ec755354'] Sep 24 21:00:51.077947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:00:51.077947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:00:51.077947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:00:51.077947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:00:51.077947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:00:51.077947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:00:51.077947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:00:51.077947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:00:51.077947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group f876d855-6948-4446-a64d-20bd145875d3 in use. Sep 24 21:00:51.077947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b9196374-49da-420f-b500-05d7ec755354'] Sep 24 21:00:51.077947 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:00:51.087522 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6d2de931-e904-4b3c-aa3e-ad96c5c7b7db tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Returning 400 to user: Security Group f876d855-6948-4446-a64d-20bd145875d3 in use. Sep 24 21:00:51.087522 ncdv-master-1 devstack@n-api.service[140516]: Neutron server returns request_ids: ['req-b9196374-49da-420f-b500-05d7ec755354'] {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:00:51.090088 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6d2de931-e904-4b3c-aa3e-ad96c5c7b7db tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/f876d855-6948-4446-a64d-20bd145875d3" status: 400 len: 185 microversion: 2.1 time: 0.802529 Sep 24 21:00:51.095469 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1552/3097] 10.222.0.52 () {58 vars in 1272 bytes} [Sat Sep 24 21:00:50 2022] DELETE /compute/v2.1/os-security-groups/f876d855-6948-4446-a64d-20bd145875d3 => generated 185 bytes in 809 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:00:51.109859 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-a5a5cdcf-b25f-444a-ad9b-2d152b18aa6a tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lazy-loading 'services' on Instance uuid 1d8bc459-871f-4611-ba95-7bf7d0f08a27 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:00:51.121324 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-46e5d0eb-1a5d-4ec6-b86e-a65384ce0098 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:51.124922 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-46e5d0eb-1a5d-4ec6-b86e-a65384ce0098 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:51.149951 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-46e5d0eb-1a5d-4ec6-b86e-a65384ce0098 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:51.155614 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-46e5d0eb-1a5d-4ec6-b86e-a65384ce0098 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:51.163264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-46e5d0eb-1a5d-4ec6-b86e-a65384ce0098 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:51.165030 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-46e5d0eb-1a5d-4ec6-b86e-a65384ce0098 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:51.168956 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-46e5d0eb-1a5d-4ec6-b86e-a65384ce0098 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:51.172041 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-46e5d0eb-1a5d-4ec6-b86e-a65384ce0098 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:51.176760 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a5a5cdcf-b25f-444a-ad9b-2d152b18aa6a tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1927 microversion: 2.75 time: 0.472874 Sep 24 21:00:51.177646 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1546/3098] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:00:50 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1927 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:00:51.194597 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c15fe22f-3db7-4811-86b2-319b45b4f692 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:51.208655 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c15fe22f-3db7-4811-86b2-319b45b4f692 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c7c49bed91bb437087a8ad2d865c2647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b68f292633a49ca82fb05d18ea83142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:51.209703 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c15fe22f-3db7-4811-86b2-319b45b4f692 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Searching by: {'deleted': False, 'project_id': '5b68f292633a49ca82fb05d18ea83142'} {{(pid=140517) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 21:00:51.242792 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c15fe22f-3db7-4811-86b2-319b45b4f692 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:51.249346 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c15fe22f-3db7-4811-86b2-319b45b4f692 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:51.249985 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c15fe22f-3db7-4811-86b2-319b45b4f692 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:51.250909 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c15fe22f-3db7-4811-86b2-319b45b4f692 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:51.251457 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c15fe22f-3db7-4811-86b2-319b45b4f692 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:51.251963 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c15fe22f-3db7-4811-86b2-319b45b4f692 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:51.254894 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-46e5d0eb-1a5d-4ec6-b86e-a65384ce0098 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.151056 Sep 24 21:00:51.255561 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1553/3099] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:00:51 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:00:51.271587 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-acf5c0c0-f0e7-4650-b566-c1d00570a831 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:51.276001 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-acf5c0c0-f0e7-4650-b566-c1d00570a831 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:51.288178 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-acf5c0c0-f0e7-4650-b566-c1d00570a831 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:51.292033 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-acf5c0c0-f0e7-4650-b566-c1d00570a831 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:51.292604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-acf5c0c0-f0e7-4650-b566-c1d00570a831 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:51.295664 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-acf5c0c0-f0e7-4650-b566-c1d00570a831 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:51.296255 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-acf5c0c0-f0e7-4650-b566-c1d00570a831 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:51.296809 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-acf5c0c0-f0e7-4650-b566-c1d00570a831 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:51.308006 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c15fe22f-3db7-4811-86b2-319b45b4f692 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.123171 Sep 24 21:00:51.309637 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1547/3100] 10.222.0.52 () {58 vars in 1125 bytes} [Sat Sep 24 21:00:51 2022] GET /compute/v2.1/servers => generated 677 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:00:51.331609 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-36f3a81d-5407-463b-b6f7-5d28bceb1d29 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:51.333312 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-36f3a81d-5407-463b-b6f7-5d28bceb1d29 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:51.341364 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:00:51.345981 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-36f3a81d-5407-463b-b6f7-5d28bceb1d29 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:51.346820 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-36f3a81d-5407-463b-b6f7-5d28bceb1d29 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:51.348998 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-36f3a81d-5407-463b-b6f7-5d28bceb1d29 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:51.353119 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-36f3a81d-5407-463b-b6f7-5d28bceb1d29 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:51.354001 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-36f3a81d-5407-463b-b6f7-5d28bceb1d29 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:51.354739 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-36f3a81d-5407-463b-b6f7-5d28bceb1d29 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:51.893873 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-36f3a81d-5407-463b-b6f7-5d28bceb1d29 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:51.911269 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-36f3a81d-5407-463b-b6f7-5d28bceb1d29 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1524 microversion: 2.1 time: 0.598270 Sep 24 21:00:51.914947 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1548/3101] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:51 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1524 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:51.929516 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3694ea9b-3948-41b6-a3ce-436be90e28ed tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:51.936641 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3694ea9b-3948-41b6-a3ce-436be90e28ed tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 7c6ee4f7-82b5-4c95-8865-ab81076df04f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:51.953250 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3694ea9b-3948-41b6-a3ce-436be90e28ed tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:51.955092 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3694ea9b-3948-41b6-a3ce-436be90e28ed tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:51.956959 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3694ea9b-3948-41b6-a3ce-436be90e28ed tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:51.958066 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3694ea9b-3948-41b6-a3ce-436be90e28ed tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:51.960066 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3694ea9b-3948-41b6-a3ce-436be90e28ed tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:51.961561 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3694ea9b-3948-41b6-a3ce-436be90e28ed tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:52.005819 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-acf5c0c0-f0e7-4650-b566-c1d00570a831 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:52.032434 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-acf5c0c0-f0e7-4650-b566-c1d00570a831 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c" status: 200 len: 1507 microversion: 2.1 time: 0.774532 Sep 24 21:00:52.033705 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1554/3102] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:51 2022] GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c => generated 1507 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:52.040411 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9fd69032-bf7f-4bef-bb28-001d70216f09 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:52.048560 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9fd69032-bf7f-4bef-bb28-001d70216f09 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 5c119929-2744-4871-b523-0a6a05c6c073] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:52.065229 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9fd69032-bf7f-4bef-bb28-001d70216f09 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:52.066439 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9fd69032-bf7f-4bef-bb28-001d70216f09 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:52.068702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9fd69032-bf7f-4bef-bb28-001d70216f09 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:52.070231 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9fd69032-bf7f-4bef-bb28-001d70216f09 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:52.072617 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9fd69032-bf7f-4bef-bb28-001d70216f09 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:52.073387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9fd69032-bf7f-4bef-bb28-001d70216f09 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:52.180979 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3694ea9b-3948-41b6-a3ce-436be90e28ed tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "POST /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f/action" status: 202 len: 0 microversion: 2.1 time: 0.260900 Sep 24 21:00:52.184487 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1549/3103] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:00:51 2022] POST /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:00:52.191445 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-08151c3c-7922-4a16-b8d8-bac9f6e885fd tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:52.192320 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-08151c3c-7922-4a16-b8d8-bac9f6e885fd tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] [instance: a178dffd-f620-41c2-b1b5-5ccc1ec52786] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:52.202846 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-08151c3c-7922-4a16-b8d8-bac9f6e885fd tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:52.203502 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-08151c3c-7922-4a16-b8d8-bac9f6e885fd tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:52.204098 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-08151c3c-7922-4a16-b8d8-bac9f6e885fd tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:52.204938 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-08151c3c-7922-4a16-b8d8-bac9f6e885fd tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:52.205617 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-08151c3c-7922-4a16-b8d8-bac9f6e885fd tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:52.206179 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-08151c3c-7922-4a16-b8d8-bac9f6e885fd tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:52.401956 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-08151c3c-7922-4a16-b8d8-bac9f6e885fd tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c49bed91bb437087a8ad2d865c2647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b68f292633a49ca82fb05d18ea83142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:52.424931 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-08151c3c-7922-4a16-b8d8-bac9f6e885fd tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] 10.222.0.52 "GET /compute/v2.1/servers/a178dffd-f620-41c2-b1b5-5ccc1ec52786" status: 200 len: 1216 microversion: 2.1 time: 0.236295 Sep 24 21:00:52.437707 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1550/3104] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:52 2022] GET /compute/v2.1/servers/a178dffd-f620-41c2-b1b5-5ccc1ec52786 => generated 1216 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:52.452403 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c614e378-0122-41b2-84b7-49c9fa257e0d tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:52.454141 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c614e378-0122-41b2-84b7-49c9fa257e0d tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:52.474682 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c614e378-0122-41b2-84b7-49c9fa257e0d tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:52.475322 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c614e378-0122-41b2-84b7-49c9fa257e0d tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:52.475725 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c614e378-0122-41b2-84b7-49c9fa257e0d tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:52.476601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c614e378-0122-41b2-84b7-49c9fa257e0d tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:52.480296 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c614e378-0122-41b2-84b7-49c9fa257e0d tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:52.480771 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c614e378-0122-41b2-84b7-49c9fa257e0d tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:52.667749 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9fd69032-bf7f-4bef-bb28-001d70216f09 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41f618458eb48f6bb4631fd254addc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4655b536ca04896993223f34d172298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:52.687461 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9fd69032-bf7f-4bef-bb28-001d70216f09 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "GET /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073" status: 200 len: 1324 microversion: 2.1 time: 0.646464 Sep 24 21:00:52.699716 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1555/3105] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:52 2022] GET /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073 => generated 1324 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:52.709173 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-12126517-bb19-4eb2-9722-9cdde1f80ddc tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:52.709811 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-12126517-bb19-4eb2-9722-9cdde1f80ddc tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 7c6ee4f7-82b5-4c95-8865-ab81076df04f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:52.731759 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-12126517-bb19-4eb2-9722-9cdde1f80ddc tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:52.732328 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-12126517-bb19-4eb2-9722-9cdde1f80ddc tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:52.733284 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-12126517-bb19-4eb2-9722-9cdde1f80ddc tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:52.734022 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-12126517-bb19-4eb2-9722-9cdde1f80ddc tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:52.734490 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-12126517-bb19-4eb2-9722-9cdde1f80ddc tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:52.734945 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-12126517-bb19-4eb2-9722-9cdde1f80ddc tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:53.002798 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c614e378-0122-41b2-84b7-49c9fa257e0d tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:53.011561 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c614e378-0122-41b2-84b7-49c9fa257e0d tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c" status: 200 len: 1507 microversion: 2.1 time: 0.572137 Sep 24 21:00:53.012490 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1551/3106] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:52 2022] GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c => generated 1507 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:53.040897 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-889cda05-b0f0-499d-a4ae-d58cc40d9e0d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:53.041599 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-889cda05-b0f0-499d-a4ae-d58cc40d9e0d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:53.063067 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-889cda05-b0f0-499d-a4ae-d58cc40d9e0d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:53.064847 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-889cda05-b0f0-499d-a4ae-d58cc40d9e0d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:53.066949 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-889cda05-b0f0-499d-a4ae-d58cc40d9e0d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:53.069853 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-889cda05-b0f0-499d-a4ae-d58cc40d9e0d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:53.072083 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-889cda05-b0f0-499d-a4ae-d58cc40d9e0d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:53.072763 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-889cda05-b0f0-499d-a4ae-d58cc40d9e0d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:53.091713 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-12126517-bb19-4eb2-9722-9cdde1f80ddc tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddab9c74c004e74a51fd8008886e542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdf8ae7524612b9c2f6a3f16c39ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:53.113527 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-12126517-bb19-4eb2-9722-9cdde1f80ddc tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f" status: 200 len: 1575 microversion: 2.1 time: 0.402671 Sep 24 21:00:53.115265 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1556/3107] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:52 2022] GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f => generated 1575 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:53.123878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2c208750-e575-41bf-b6fd-fa0ecc544a09 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:53.127594 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2c208750-e575-41bf-b6fd-fa0ecc544a09 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:53.141594 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c208750-e575-41bf-b6fd-fa0ecc544a09 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:53.142264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c208750-e575-41bf-b6fd-fa0ecc544a09 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:53.142832 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c208750-e575-41bf-b6fd-fa0ecc544a09 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:53.143567 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c208750-e575-41bf-b6fd-fa0ecc544a09 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:53.144022 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c208750-e575-41bf-b6fd-fa0ecc544a09 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:53.144452 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c208750-e575-41bf-b6fd-fa0ecc544a09 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:53.220664 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2c208750-e575-41bf-b6fd-fa0ecc544a09 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.103747 Sep 24 21:00:53.225340 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1557/3108] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:00:53 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:00:53.230058 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d7a6f86b-f799-422d-ba75-e2ea7629b031 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:53.240107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d7a6f86b-f799-422d-ba75-e2ea7629b031 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:53.254139 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7a6f86b-f799-422d-ba75-e2ea7629b031 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:53.254917 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7a6f86b-f799-422d-ba75-e2ea7629b031 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:53.255524 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7a6f86b-f799-422d-ba75-e2ea7629b031 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:53.256413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7a6f86b-f799-422d-ba75-e2ea7629b031 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:53.257021 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7a6f86b-f799-422d-ba75-e2ea7629b031 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:53.257599 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7a6f86b-f799-422d-ba75-e2ea7629b031 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:53.261219 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-889cda05-b0f0-499d-a4ae-d58cc40d9e0d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lazy-loading 'services' on Instance uuid 1d8bc459-871f-4611-ba95-7bf7d0f08a27 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:00:53.304978 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-889cda05-b0f0-499d-a4ae-d58cc40d9e0d tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1927 microversion: 2.75 time: 0.277065 Sep 24 21:00:53.308670 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1552/3109] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:00:53 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1927 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:00:53.319894 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6bd1418a-1cf9-4f92-a052-5fd1ba851515 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:53.320695 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6bd1418a-1cf9-4f92-a052-5fd1ba851515 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:53.356656 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6bd1418a-1cf9-4f92-a052-5fd1ba851515 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:53.357644 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6bd1418a-1cf9-4f92-a052-5fd1ba851515 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:53.358302 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6bd1418a-1cf9-4f92-a052-5fd1ba851515 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:53.366529 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6bd1418a-1cf9-4f92-a052-5fd1ba851515 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:53.367288 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6bd1418a-1cf9-4f92-a052-5fd1ba851515 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:53.367905 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6bd1418a-1cf9-4f92-a052-5fd1ba851515 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:53.449226 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6bd1418a-1cf9-4f92-a052-5fd1ba851515 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:00:53.622250 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d7a6f86b-f799-422d-ba75-e2ea7629b031 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:53.634795 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d7a6f86b-f799-422d-ba75-e2ea7629b031 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1524 microversion: 2.1 time: 0.408110 Sep 24 21:00:53.640065 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1558/3110] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:53 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1524 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:53.646397 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8d581387-1d5e-4a76-9900-cf4980b15f45 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:53.647477 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8d581387-1d5e-4a76-9900-cf4980b15f45 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] [instance: a178dffd-f620-41c2-b1b5-5ccc1ec52786] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:53.655110 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d581387-1d5e-4a76-9900-cf4980b15f45 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:53.656024 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d581387-1d5e-4a76-9900-cf4980b15f45 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:53.656815 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d581387-1d5e-4a76-9900-cf4980b15f45 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:53.659047 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d581387-1d5e-4a76-9900-cf4980b15f45 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:53.659764 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d581387-1d5e-4a76-9900-cf4980b15f45 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:53.660426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d581387-1d5e-4a76-9900-cf4980b15f45 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:53.714851 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6bd1418a-1cf9-4f92-a052-5fd1ba851515 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "DELETE /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c" status: 204 len: 0 microversion: 2.1 time: 0.403204 Sep 24 21:00:53.715483 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1553/3111] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:00:53 2022] DELETE /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:00:53.730204 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e5506649-8fae-4cb6-80ff-d8be13a9bb4f tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:53.730953 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e5506649-8fae-4cb6-80ff-d8be13a9bb4f tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 5c119929-2744-4871-b523-0a6a05c6c073] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:53.745538 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5506649-8fae-4cb6-80ff-d8be13a9bb4f tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:53.748730 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5506649-8fae-4cb6-80ff-d8be13a9bb4f tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:53.748730 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5506649-8fae-4cb6-80ff-d8be13a9bb4f tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:53.749504 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5506649-8fae-4cb6-80ff-d8be13a9bb4f tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:53.750033 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5506649-8fae-4cb6-80ff-d8be13a9bb4f tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:53.750477 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5506649-8fae-4cb6-80ff-d8be13a9bb4f tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:53.803658 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:00:53.829243 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8d581387-1d5e-4a76-9900-cf4980b15f45 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c49bed91bb437087a8ad2d865c2647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b68f292633a49ca82fb05d18ea83142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:53.842720 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8d581387-1d5e-4a76-9900-cf4980b15f45 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] 10.222.0.52 "GET /compute/v2.1/servers/a178dffd-f620-41c2-b1b5-5ccc1ec52786" status: 200 len: 1272 microversion: 2.1 time: 0.200455 Sep 24 21:00:53.860077 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1559/3112] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:53 2022] GET /compute/v2.1/servers/a178dffd-f620-41c2-b1b5-5ccc1ec52786 => generated 1272 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:53.865054 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-290fd048-1b63-4b18-88c6-de536e6d519a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:53.865575 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-290fd048-1b63-4b18-88c6-de536e6d519a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:53.872477 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-290fd048-1b63-4b18-88c6-de536e6d519a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:53.873550 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-290fd048-1b63-4b18-88c6-de536e6d519a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:53.874007 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-290fd048-1b63-4b18-88c6-de536e6d519a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:53.874751 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-290fd048-1b63-4b18-88c6-de536e6d519a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:53.875275 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-290fd048-1b63-4b18-88c6-de536e6d519a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:53.875711 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-290fd048-1b63-4b18-88c6-de536e6d519a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:53.940706 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-290fd048-1b63-4b18-88c6-de536e6d519a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:00:54.059133 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.compute.api [None req-290fd048-1b63-4b18-88c6-de536e6d519a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c] Instance is already in deleting state, ignoring this request Sep 24 21:00:54.059993 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-290fd048-1b63-4b18-88c6-de536e6d519a tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "DELETE /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c" status: 204 len: 0 microversion: 2.1 time: 0.198852 Sep 24 21:00:54.065743 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1560/3113] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:00:53 2022] DELETE /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:00:54.075217 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-80cab0b4-4fe2-43b5-b001-845c494d316c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:54.075749 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-80cab0b4-4fe2-43b5-b001-845c494d316c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:54.094441 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-80cab0b4-4fe2-43b5-b001-845c494d316c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:54.099477 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-80cab0b4-4fe2-43b5-b001-845c494d316c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:54.101435 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-80cab0b4-4fe2-43b5-b001-845c494d316c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:54.102369 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-80cab0b4-4fe2-43b5-b001-845c494d316c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:54.105830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-80cab0b4-4fe2-43b5-b001-845c494d316c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:54.106662 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-80cab0b4-4fe2-43b5-b001-845c494d316c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:54.129289 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e5506649-8fae-4cb6-80ff-d8be13a9bb4f tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41f618458eb48f6bb4631fd254addc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4655b536ca04896993223f34d172298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:54.140846 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e5506649-8fae-4cb6-80ff-d8be13a9bb4f tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "GET /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073" status: 200 len: 1324 microversion: 2.1 time: 0.423971 Sep 24 21:00:54.141447 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1554/3114] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:53 2022] GET /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073 => generated 1324 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:54.165815 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d5816993-c6e2-4da4-b1f6-76eb3fc83f32 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:54.182014 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d5816993-c6e2-4da4-b1f6-76eb3fc83f32 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 7c6ee4f7-82b5-4c95-8865-ab81076df04f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:54.207823 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d5816993-c6e2-4da4-b1f6-76eb3fc83f32 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:54.208180 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d5816993-c6e2-4da4-b1f6-76eb3fc83f32 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:54.208754 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d5816993-c6e2-4da4-b1f6-76eb3fc83f32 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:54.209490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d5816993-c6e2-4da4-b1f6-76eb3fc83f32 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:54.210029 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d5816993-c6e2-4da4-b1f6-76eb3fc83f32 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:54.212044 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d5816993-c6e2-4da4-b1f6-76eb3fc83f32 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:54.759093 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-80cab0b4-4fe2-43b5-b001-845c494d316c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:54.775341 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-80cab0b4-4fe2-43b5-b001-845c494d316c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c" status: 200 len: 1513 microversion: 2.1 time: 0.705443 Sep 24 21:00:54.776530 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1561/3115] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:54 2022] GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c => generated 1513 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:54.782846 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9d968ea1-9fe6-493c-aa07-f5387fa77683 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:54.786513 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9d968ea1-9fe6-493c-aa07-f5387fa77683 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:54.788142 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d5816993-c6e2-4da4-b1f6-76eb3fc83f32 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddab9c74c004e74a51fd8008886e542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdf8ae7524612b9c2f6a3f16c39ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:54.801269 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d5816993-c6e2-4da4-b1f6-76eb3fc83f32 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f" status: 200 len: 1575 microversion: 2.1 time: 0.649554 Sep 24 21:00:54.806251 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1555/3116] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:54 2022] GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f => generated 1575 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:54.812424 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d968ea1-9fe6-493c-aa07-f5387fa77683 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:54.812938 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d968ea1-9fe6-493c-aa07-f5387fa77683 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:54.813387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d968ea1-9fe6-493c-aa07-f5387fa77683 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:54.818853 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d968ea1-9fe6-493c-aa07-f5387fa77683 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:54.819371 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d968ea1-9fe6-493c-aa07-f5387fa77683 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:54.819825 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d968ea1-9fe6-493c-aa07-f5387fa77683 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:54.828056 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-84aed7c8-b2e0-4db7-94f8-8ca18893cb97 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:54.828792 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-84aed7c8-b2e0-4db7-94f8-8ca18893cb97 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:54.838077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84aed7c8-b2e0-4db7-94f8-8ca18893cb97 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:54.840267 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84aed7c8-b2e0-4db7-94f8-8ca18893cb97 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:54.840811 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84aed7c8-b2e0-4db7-94f8-8ca18893cb97 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:54.841668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84aed7c8-b2e0-4db7-94f8-8ca18893cb97 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:54.843059 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84aed7c8-b2e0-4db7-94f8-8ca18893cb97 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:54.843999 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84aed7c8-b2e0-4db7-94f8-8ca18893cb97 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:54.890805 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9d968ea1-9fe6-493c-aa07-f5387fa77683 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.112966 Sep 24 21:00:54.906373 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1562/3117] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:00:54 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:00:54.911887 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-61c7c7cf-58c3-4b42-9cba-9a42f8e20be2 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:54.912520 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-61c7c7cf-58c3-4b42-9cba-9a42f8e20be2 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:54.919422 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-61c7c7cf-58c3-4b42-9cba-9a42f8e20be2 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:54.920151 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-61c7c7cf-58c3-4b42-9cba-9a42f8e20be2 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:54.920649 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-61c7c7cf-58c3-4b42-9cba-9a42f8e20be2 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:54.921380 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-61c7c7cf-58c3-4b42-9cba-9a42f8e20be2 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:54.921850 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-61c7c7cf-58c3-4b42-9cba-9a42f8e20be2 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:54.922312 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-61c7c7cf-58c3-4b42-9cba-9a42f8e20be2 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:55.049788 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-84aed7c8-b2e0-4db7-94f8-8ca18893cb97 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lazy-loading 'services' on Instance uuid 1d8bc459-871f-4611-ba95-7bf7d0f08a27 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:00:55.113976 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-84aed7c8-b2e0-4db7-94f8-8ca18893cb97 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1927 microversion: 2.75 time: 0.293708 Sep 24 21:00:55.120147 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1556/3118] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:00:54 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1927 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:00:55.139022 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e40e35f0-d15a-4ce0-8d3e-036ea8de7e32 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:55.141848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e40e35f0-d15a-4ce0-8d3e-036ea8de7e32 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] [instance: a178dffd-f620-41c2-b1b5-5ccc1ec52786] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:55.167241 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e40e35f0-d15a-4ce0-8d3e-036ea8de7e32 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:55.167241 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e40e35f0-d15a-4ce0-8d3e-036ea8de7e32 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:55.167691 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e40e35f0-d15a-4ce0-8d3e-036ea8de7e32 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:55.168419 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e40e35f0-d15a-4ce0-8d3e-036ea8de7e32 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:55.168886 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e40e35f0-d15a-4ce0-8d3e-036ea8de7e32 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:55.169332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e40e35f0-d15a-4ce0-8d3e-036ea8de7e32 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:55.240465 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-61c7c7cf-58c3-4b42-9cba-9a42f8e20be2 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:55.258631 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-61c7c7cf-58c3-4b42-9cba-9a42f8e20be2 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1524 microversion: 2.1 time: 0.350505 Sep 24 21:00:55.259267 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1563/3119] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:54 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1524 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:55.274266 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e40e35f0-d15a-4ce0-8d3e-036ea8de7e32 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c49bed91bb437087a8ad2d865c2647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b68f292633a49ca82fb05d18ea83142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:55.279683 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-98f34e99-0379-41df-ab2f-b4fd48d6f501 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:55.282933 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-98f34e99-0379-41df-ab2f-b4fd48d6f501 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 5c119929-2744-4871-b523-0a6a05c6c073] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:55.283650 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e40e35f0-d15a-4ce0-8d3e-036ea8de7e32 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] 10.222.0.52 "GET /compute/v2.1/servers/a178dffd-f620-41c2-b1b5-5ccc1ec52786" status: 200 len: 1278 microversion: 2.1 time: 0.162317 Sep 24 21:00:55.291986 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-98f34e99-0379-41df-ab2f-b4fd48d6f501 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:55.292860 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-98f34e99-0379-41df-ab2f-b4fd48d6f501 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:55.293600 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-98f34e99-0379-41df-ab2f-b4fd48d6f501 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:55.294675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-98f34e99-0379-41df-ab2f-b4fd48d6f501 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:55.296166 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1557/3120] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:55 2022] GET /compute/v2.1/servers/a178dffd-f620-41c2-b1b5-5ccc1ec52786 => generated 1278 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:55.296822 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-98f34e99-0379-41df-ab2f-b4fd48d6f501 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:55.298121 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-98f34e99-0379-41df-ab2f-b4fd48d6f501 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:55.504519 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-98f34e99-0379-41df-ab2f-b4fd48d6f501 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41f618458eb48f6bb4631fd254addc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4655b536ca04896993223f34d172298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:55.515106 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-98f34e99-0379-41df-ab2f-b4fd48d6f501 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "GET /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073" status: 200 len: 1324 microversion: 2.1 time: 0.241800 Sep 24 21:00:55.519054 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1564/3121] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:55 2022] GET /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073 => generated 1324 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:55.803251 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b4374392-ddcb-4903-aa52-d0657dfac14c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:55.804365 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b4374392-ddcb-4903-aa52-d0657dfac14c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:55.820836 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b4374392-ddcb-4903-aa52-d0657dfac14c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:55.822477 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b4374392-ddcb-4903-aa52-d0657dfac14c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:55.823595 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b4374392-ddcb-4903-aa52-d0657dfac14c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:55.825037 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b4374392-ddcb-4903-aa52-d0657dfac14c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:55.825749 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b4374392-ddcb-4903-aa52-d0657dfac14c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:55.827016 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b4374392-ddcb-4903-aa52-d0657dfac14c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:55.834358 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a2d8c867-716c-473a-baf5-4beb2c286c30 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:55.835112 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a2d8c867-716c-473a-baf5-4beb2c286c30 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 7c6ee4f7-82b5-4c95-8865-ab81076df04f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:55.845145 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2d8c867-716c-473a-baf5-4beb2c286c30 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:55.846332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2d8c867-716c-473a-baf5-4beb2c286c30 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:55.846811 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2d8c867-716c-473a-baf5-4beb2c286c30 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:55.852877 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2d8c867-716c-473a-baf5-4beb2c286c30 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:55.853937 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2d8c867-716c-473a-baf5-4beb2c286c30 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:55.858112 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2d8c867-716c-473a-baf5-4beb2c286c30 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:56.208886 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b4374392-ddcb-4903-aa52-d0657dfac14c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:56.227242 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b4374392-ddcb-4903-aa52-d0657dfac14c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c" status: 200 len: 1513 microversion: 2.1 time: 0.430768 Sep 24 21:00:56.227856 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1558/3122] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:55 2022] GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c => generated 1513 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:56.240077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3f0552f5-35b3-4d7c-8220-8a9ebcc5c712 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:56.245055 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3f0552f5-35b3-4d7c-8220-8a9ebcc5c712 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:56.263823 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3f0552f5-35b3-4d7c-8220-8a9ebcc5c712 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:56.264791 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3f0552f5-35b3-4d7c-8220-8a9ebcc5c712 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:56.270212 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3f0552f5-35b3-4d7c-8220-8a9ebcc5c712 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:56.272719 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3f0552f5-35b3-4d7c-8220-8a9ebcc5c712 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:56.273422 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3f0552f5-35b3-4d7c-8220-8a9ebcc5c712 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:56.274020 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3f0552f5-35b3-4d7c-8220-8a9ebcc5c712 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:56.303599 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a2d8c867-716c-473a-baf5-4beb2c286c30 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddab9c74c004e74a51fd8008886e542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdf8ae7524612b9c2f6a3f16c39ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:56.332647 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a2d8c867-716c-473a-baf5-4beb2c286c30 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f" status: 200 len: 1573 microversion: 2.1 time: 0.501172 Sep 24 21:00:56.333660 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1565/3123] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:55 2022] GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f => generated 1573 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:56.348183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d249ba60-3c61-4f1b-a292-6b8b00584990 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:56.350347 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d249ba60-3c61-4f1b-a292-6b8b00584990 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:56.359466 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3f0552f5-35b3-4d7c-8220-8a9ebcc5c712 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.126940 Sep 24 21:00:56.361755 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1559/3124] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:00:56 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:00:56.370578 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d249ba60-3c61-4f1b-a292-6b8b00584990 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:56.371431 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d249ba60-3c61-4f1b-a292-6b8b00584990 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:56.372112 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d249ba60-3c61-4f1b-a292-6b8b00584990 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:56.374620 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d249ba60-3c61-4f1b-a292-6b8b00584990 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:56.375392 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-101b39dd-a0a5-4aeb-95a0-b059d0f5e56f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:56.377993 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d249ba60-3c61-4f1b-a292-6b8b00584990 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:56.378946 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d249ba60-3c61-4f1b-a292-6b8b00584990 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:56.379607 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-101b39dd-a0a5-4aeb-95a0-b059d0f5e56f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:56.398079 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-101b39dd-a0a5-4aeb-95a0-b059d0f5e56f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:56.399055 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-101b39dd-a0a5-4aeb-95a0-b059d0f5e56f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:56.399939 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-101b39dd-a0a5-4aeb-95a0-b059d0f5e56f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:56.400882 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-101b39dd-a0a5-4aeb-95a0-b059d0f5e56f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:56.401576 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-101b39dd-a0a5-4aeb-95a0-b059d0f5e56f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:56.402249 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-101b39dd-a0a5-4aeb-95a0-b059d0f5e56f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:56.601190 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:00:56.615080 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-d249ba60-3c61-4f1b-a292-6b8b00584990 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lazy-loading 'services' on Instance uuid 1d8bc459-871f-4611-ba95-7bf7d0f08a27 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:00:56.679628 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:00:56.679980 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-101b39dd-a0a5-4aeb-95a0-b059d0f5e56f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:56.683030 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d249ba60-3c61-4f1b-a292-6b8b00584990 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1927 microversion: 2.75 time: 0.344187 Sep 24 21:00:56.691913 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-101b39dd-a0a5-4aeb-95a0-b059d0f5e56f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1524 microversion: 2.1 time: 0.328546 Sep 24 21:00:56.707880 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1560/3125] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:56 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1524 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:56.721493 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-09927c15-9ed6-42c4-9aca-97bd141b1b9f tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:56.722122 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-09927c15-9ed6-42c4-9aca-97bd141b1b9f tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] [instance: a178dffd-f620-41c2-b1b5-5ccc1ec52786] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:56.727420 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1566/3126] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:00:56 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1927 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:00:56.742085 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-28060062-cd53-48db-92b8-8c85c5a3dec5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-442181444"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:56.742799 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-28060062-cd53-48db-92b8-8c85c5a3dec5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 7c6ee4f7-82b5-4c95-8865-ab81076df04f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:56.743246 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09927c15-9ed6-42c4-9aca-97bd141b1b9f tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:56.743753 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09927c15-9ed6-42c4-9aca-97bd141b1b9f tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:56.744195 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09927c15-9ed6-42c4-9aca-97bd141b1b9f tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:56.753089 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09927c15-9ed6-42c4-9aca-97bd141b1b9f tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:56.753678 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09927c15-9ed6-42c4-9aca-97bd141b1b9f tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:56.754209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09927c15-9ed6-42c4-9aca-97bd141b1b9f tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:56.755095 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28060062-cd53-48db-92b8-8c85c5a3dec5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:56.758008 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28060062-cd53-48db-92b8-8c85c5a3dec5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:56.758008 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28060062-cd53-48db-92b8-8c85c5a3dec5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:56.758008 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28060062-cd53-48db-92b8-8c85c5a3dec5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:56.760544 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28060062-cd53-48db-92b8-8c85c5a3dec5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:56.761200 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28060062-cd53-48db-92b8-8c85c5a3dec5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:57.118190 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-09927c15-9ed6-42c4-9aca-97bd141b1b9f tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c49bed91bb437087a8ad2d865c2647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b68f292633a49ca82fb05d18ea83142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:57.133852 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-09927c15-9ed6-42c4-9aca-97bd141b1b9f tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] 10.222.0.52 "GET /compute/v2.1/servers/a178dffd-f620-41c2-b1b5-5ccc1ec52786" status: 200 len: 1320 microversion: 2.1 time: 0.424726 Sep 24 21:00:57.137541 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1561/3127] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:56 2022] GET /compute/v2.1/servers/a178dffd-f620-41c2-b1b5-5ccc1ec52786 => generated 1320 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:57.144690 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-df77496e-2641-46d2-8473-da5658bcff7f tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:57.145352 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-df77496e-2641-46d2-8473-da5658bcff7f tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 5c119929-2744-4871-b523-0a6a05c6c073] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:57.152089 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df77496e-2641-46d2-8473-da5658bcff7f tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:57.155254 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df77496e-2641-46d2-8473-da5658bcff7f tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:57.155948 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df77496e-2641-46d2-8473-da5658bcff7f tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:57.156924 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df77496e-2641-46d2-8473-da5658bcff7f tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:57.158001 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df77496e-2641-46d2-8473-da5658bcff7f tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:57.159001 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df77496e-2641-46d2-8473-da5658bcff7f tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:57.438553 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.network.security_group_api [None req-28060062-cd53-48db-92b8-8c85c5a3dec5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Adding security group 5e70f14d-7785-4f72-a62d-d4ac6c3b9747 to port e1795d42-5be1-400f-9688-3f2a6d103ce9 Sep 24 21:00:57.733725 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-df77496e-2641-46d2-8473-da5658bcff7f tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41f618458eb48f6bb4631fd254addc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4655b536ca04896993223f34d172298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:57.747092 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-df77496e-2641-46d2-8473-da5658bcff7f tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "GET /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073" status: 200 len: 1324 microversion: 2.1 time: 0.607774 Sep 24 21:00:57.750798 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1562/3128] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:57 2022] GET /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073 => generated 1324 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:57.756739 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-65c6b009-39d5-4448-8930-0dd98bf3456e req-0171e773-b7ce-407c-8396-94b8cfc3ab98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c119929-2744-4871-b523-0a6a05c6c073", "name": "network-vif-plugged", "status": "completed", "tag": "328bc618-9c61-46b1-a53c-716485f1d492"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:57.767919 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-65c6b009-39d5-4448-8930-0dd98bf3456e req-0171e773-b7ce-407c-8396-94b8cfc3ab98 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:57.768775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-65c6b009-39d5-4448-8930-0dd98bf3456e req-0171e773-b7ce-407c-8396-94b8cfc3ab98 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:57.769435 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-65c6b009-39d5-4448-8930-0dd98bf3456e req-0171e773-b7ce-407c-8396-94b8cfc3ab98 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:57.786161 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-65c6b009-39d5-4448-8930-0dd98bf3456e req-0171e773-b7ce-407c-8396-94b8cfc3ab98 service nova] Creating event network-vif-plugged:328bc618-9c61-46b1-a53c-716485f1d492 for instance 5c119929-2744-4871-b523-0a6a05c6c073 on nch1-master-1 Sep 24 21:00:57.791718 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-65c6b009-39d5-4448-8930-0dd98bf3456e req-0171e773-b7ce-407c-8396-94b8cfc3ab98 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039363 Sep 24 21:00:57.797201 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1563/3129] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:00:57.803167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dcd04b9a-4248-4380-8016-5e2231d60a11 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:57.804208 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dcd04b9a-4248-4380-8016-5e2231d60a11 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:57.813355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dcd04b9a-4248-4380-8016-5e2231d60a11 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:57.814209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dcd04b9a-4248-4380-8016-5e2231d60a11 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:57.815058 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dcd04b9a-4248-4380-8016-5e2231d60a11 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:57.816452 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dcd04b9a-4248-4380-8016-5e2231d60a11 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:57.817167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dcd04b9a-4248-4380-8016-5e2231d60a11 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:57.817815 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dcd04b9a-4248-4380-8016-5e2231d60a11 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:58.343639 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-28060062-cd53-48db-92b8-8c85c5a3dec5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "POST /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f/action" status: 202 len: 0 microversion: 2.1 time: 1.614917 Sep 24 21:00:58.345347 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1567/3130] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:00:56 2022] POST /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f/action => generated 0 bytes in 1617 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:00:58.350942 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0c873ec3-7f67-4306-adca-ec91b8f6845a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:58.360207 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0c873ec3-7f67-4306-adca-ec91b8f6845a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:58.375201 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0c873ec3-7f67-4306-adca-ec91b8f6845a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:58.378684 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0c873ec3-7f67-4306-adca-ec91b8f6845a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:58.379533 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0c873ec3-7f67-4306-adca-ec91b8f6845a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:58.380767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0c873ec3-7f67-4306-adca-ec91b8f6845a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:58.381450 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0c873ec3-7f67-4306-adca-ec91b8f6845a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:58.384753 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0c873ec3-7f67-4306-adca-ec91b8f6845a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:58.464794 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0c873ec3-7f67-4306-adca-ec91b8f6845a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.117937 Sep 24 21:00:58.470268 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1568/3131] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:00:58 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:00:58.488152 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a588f543-3bd3-4fbe-8532-058e9157c76c tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:58.489343 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a588f543-3bd3-4fbe-8532-058e9157c76c tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:58.522538 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a588f543-3bd3-4fbe-8532-058e9157c76c tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:58.523451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a588f543-3bd3-4fbe-8532-058e9157c76c tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:58.524144 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a588f543-3bd3-4fbe-8532-058e9157c76c tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:58.525120 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a588f543-3bd3-4fbe-8532-058e9157c76c tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:58.525814 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a588f543-3bd3-4fbe-8532-058e9157c76c tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:58.528858 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a588f543-3bd3-4fbe-8532-058e9157c76c tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:58.746983 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-a588f543-3bd3-4fbe-8532-058e9157c76c tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lazy-loading 'services' on Instance uuid 1d8bc459-871f-4611-ba95-7bf7d0f08a27 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:00:58.808279 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a588f543-3bd3-4fbe-8532-058e9157c76c tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1933 microversion: 2.75 time: 0.334240 Sep 24 21:00:58.809076 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1569/3132] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:00:58 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1933 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:00:58.831610 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bb6692af-e73f-4c91-9469-aa0f72be42a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:58.832243 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-bb6692af-e73f-4c91-9469-aa0f72be42a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:58.840855 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dcd04b9a-4248-4380-8016-5e2231d60a11 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:58.849543 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dcd04b9a-4248-4380-8016-5e2231d60a11 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c" status: 200 len: 1513 microversion: 2.1 time: 1.050798 Sep 24 21:00:58.868995 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1564/3133] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:57 2022] GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c => generated 1513 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:58.869242 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb6692af-e73f-4c91-9469-aa0f72be42a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:58.869577 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb6692af-e73f-4c91-9469-aa0f72be42a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:58.875299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb6692af-e73f-4c91-9469-aa0f72be42a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:58.876993 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b0dfa801-2622-4a26-9c7f-1a76809f6b3e tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:58.877953 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb6692af-e73f-4c91-9469-aa0f72be42a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:58.881211 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b0dfa801-2622-4a26-9c7f-1a76809f6b3e tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] [instance: a178dffd-f620-41c2-b1b5-5ccc1ec52786] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:58.881670 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb6692af-e73f-4c91-9469-aa0f72be42a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:58.882372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb6692af-e73f-4c91-9469-aa0f72be42a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:58.912390 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b0dfa801-2622-4a26-9c7f-1a76809f6b3e tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:58.914902 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b0dfa801-2622-4a26-9c7f-1a76809f6b3e tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:58.916049 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b0dfa801-2622-4a26-9c7f-1a76809f6b3e tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:58.922752 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b0dfa801-2622-4a26-9c7f-1a76809f6b3e tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:58.923466 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b0dfa801-2622-4a26-9c7f-1a76809f6b3e tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:58.927197 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b0dfa801-2622-4a26-9c7f-1a76809f6b3e tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:59.410377 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b0dfa801-2622-4a26-9c7f-1a76809f6b3e tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c49bed91bb437087a8ad2d865c2647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b68f292633a49ca82fb05d18ea83142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:59.421325 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b0dfa801-2622-4a26-9c7f-1a76809f6b3e tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] 10.222.0.52 "GET /compute/v2.1/servers/a178dffd-f620-41c2-b1b5-5ccc1ec52786" status: 200 len: 1320 microversion: 2.1 time: 0.560983 Sep 24 21:00:59.448881 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1565/3134] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:58 2022] GET /compute/v2.1/servers/a178dffd-f620-41c2-b1b5-5ccc1ec52786 => generated 1320 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:59.450611 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bb969576-f4b0-40f6-9296-d147da9e7314 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '.version_select at 0x7f4b07ed6700>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:59.789894 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-bb6692af-e73f-4c91-9469-aa0f72be42a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:00:59.812052 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bb6692af-e73f-4c91-9469-aa0f72be42a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1524 microversion: 2.1 time: 0.984171 Sep 24 21:00:59.816343 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1570/3135] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:58 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1524 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:00:59.823295 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-e0e3dac6-f1d7-4ac3-924f-81e5edf12797 req-77d384f4-283f-4e35-ae70-2bb4548d8f50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c6ee4f7-82b5-4c95-8865-ab81076df04f", "tag": "e1795d42-5be1-400f-9688-3f2a6d103ce9"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:00:59.855898 ncdv-master-1 devstack@n-api.service[140517]: DEBUG neutronclient.v2_0.client [None req-bb969576-f4b0-40f6-9296-d147da9e7314 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 5e70f14d-7785-4f72-a62d-d4ac6c3b9747 in use.", "detail": ""}} {{(pid=140517) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 24 21:00:59.857678 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-bb969576-f4b0-40f6-9296-d147da9e7314 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] HTTP exception thrown: Security Group 5e70f14d-7785-4f72-a62d-d4ac6c3b9747 in use. Sep 24 21:00:59.857678 ncdv-master-1 devstack@n-api.service[140517]: Neutron server returns request_ids: ['req-a9a1c981-20a9-424c-a1bb-752c138f4c79'] Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bb969576-f4b0-40f6-9296-d147da9e7314 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Request method failure captured: Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/os-security-groups/5e70f14d-7785-4f72-a62d-d4ac6c3b9747 HTTP/1.1 Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL2_KTBoQE1biSOdbxiN02s3h0D1W3LZT4KXbL5sweudoA3LIqkhpSDHo_3ElsoW-S4pinCvYVIPwwmg75I3QYjyeUH8E9-UCSOe6Wat6dff2LaBOhzu2fRTo0k0Ryv1Z1NW8ftU_9LakKBqftyUWUBvBSk8oz2eNB_e-v5W7ciYbcII Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 981fdf8ae7524612b9c2f6a3f16c39ec Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 981fdf8ae7524612b9c2f6a3f16c39ec Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-SecurityGroupsTestJSON-321124649-project Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 5ddab9c74c004e74a51fd8008886e542 Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-SecurityGroupsTestJSON-321124649-project Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: exception: Security Group 5e70f14d-7785-4f72-a62d-d4ac6c3b9747 in use. Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: Neutron server returns request_ids: ['req-a9a1c981-20a9-424c-a1bb-752c138f4c79'] Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '5e70f14d-7785-4f72-a62d-d4ac6c3b9747'} Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 24 21:00:59.860985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 5e70f14d-7785-4f72-a62d-d4ac6c3b9747 in use. Sep 24 21:00:59.864985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a9a1c981-20a9-424c-a1bb-752c138f4c79'] Sep 24 21:00:59.864985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:00:59.864985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:00:59.864985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:00:59.864985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:00:59.864985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 24 21:00:59.864985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 24 21:00:59.864985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 24 21:00:59.864985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 24 21:00:59.864985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 5e70f14d-7785-4f72-a62d-d4ac6c3b9747 in use. Sep 24 21:00:59.864985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a9a1c981-20a9-424c-a1bb-752c138f4c79'] Sep 24 21:00:59.864985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:00:59.864985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:00:59.864985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:00:59.864985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:00:59.864985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:00:59.864985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:00:59.864985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:00:59.864985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:00:59.864985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:00:59.864985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:00:59.864985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:00:59.864985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:00:59.864985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 24 21:00:59.864985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 24 21:00:59.864985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 5e70f14d-7785-4f72-a62d-d4ac6c3b9747 in use. Sep 24 21:00:59.864985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a9a1c981-20a9-424c-a1bb-752c138f4c79'] Sep 24 21:00:59.864985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:00:59.864985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:00:59.864985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:00:59.864985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:00:59.864985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:00:59.864985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:00:59.864985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:00:59.864985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:00:59.864985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 5e70f14d-7785-4f72-a62d-d4ac6c3b9747 in use. Sep 24 21:00:59.864985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a9a1c981-20a9-424c-a1bb-752c138f4c79'] Sep 24 21:00:59.864985 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:00:59.872394 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bb969576-f4b0-40f6-9296-d147da9e7314 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Returning 400 to user: Security Group 5e70f14d-7785-4f72-a62d-d4ac6c3b9747 in use. Sep 24 21:00:59.872394 ncdv-master-1 devstack@n-api.service[140517]: Neutron server returns request_ids: ['req-a9a1c981-20a9-424c-a1bb-752c138f4c79'] {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:00:59.873781 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bb969576-f4b0-40f6-9296-d147da9e7314 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/5e70f14d-7785-4f72-a62d-d4ac6c3b9747" status: 400 len: 185 microversion: 2.1 time: 0.438168 Sep 24 21:00:59.874631 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1566/3136] 10.222.0.52 () {58 vars in 1272 bytes} [Sat Sep 24 21:00:59 2022] DELETE /compute/v2.1/os-security-groups/5e70f14d-7785-4f72-a62d-d4ac6c3b9747 => generated 185 bytes in 440 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:00:59.884136 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-969deb78-35e4-437a-bff0-ddb1549dac93 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:00:59.891574 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-969deb78-35e4-437a-bff0-ddb1549dac93 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 5c119929-2744-4871-b523-0a6a05c6c073] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:00:59.914168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-e0e3dac6-f1d7-4ac3-924f-81e5edf12797 req-77d384f4-283f-4e35-ae70-2bb4548d8f50 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:59.921562 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-969deb78-35e4-437a-bff0-ddb1549dac93 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:59.922066 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-969deb78-35e4-437a-bff0-ddb1549dac93 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:59.922535 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-969deb78-35e4-437a-bff0-ddb1549dac93 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:59.924689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-e0e3dac6-f1d7-4ac3-924f-81e5edf12797 req-77d384f4-283f-4e35-ae70-2bb4548d8f50 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:59.944656 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-969deb78-35e4-437a-bff0-ddb1549dac93 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:00:59.946590 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-969deb78-35e4-437a-bff0-ddb1549dac93 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:00:59.948378 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-969deb78-35e4-437a-bff0-ddb1549dac93 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:00:59.953721 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-e0e3dac6-f1d7-4ac3-924f-81e5edf12797 req-77d384f4-283f-4e35-ae70-2bb4548d8f50 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:00.036748 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:01:00.051911 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-e0e3dac6-f1d7-4ac3-924f-81e5edf12797 req-77d384f4-283f-4e35-ae70-2bb4548d8f50 service nova] Creating event network-changed:e1795d42-5be1-400f-9688-3f2a6d103ce9 for instance 7c6ee4f7-82b5-4c95-8865-ab81076df04f on nch1-master-1 Sep 24 21:01:00.089642 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-e0e3dac6-f1d7-4ac3-924f-81e5edf12797 req-77d384f4-283f-4e35-ae70-2bb4548d8f50 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.269701 Sep 24 21:01:00.104005 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1571/3137] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:00.129648 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-37e566f7-7af4-4a2c-ac01-b0c036a655fb req-e171fad7-f7d2-4749-a827-12a6ffd05943 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c", "name": "network-vif-deleted", "tag": "e38dafb3-b9bf-4d37-8d9e-9abcfaf5d786"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:00.172769 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:01:00.183500 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-37e566f7-7af4-4a2c-ac01-b0c036a655fb req-e171fad7-f7d2-4749-a827-12a6ffd05943 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:00.184278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-37e566f7-7af4-4a2c-ac01-b0c036a655fb req-e171fad7-f7d2-4749-a827-12a6ffd05943 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:00.187798 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-37e566f7-7af4-4a2c-ac01-b0c036a655fb req-e171fad7-f7d2-4749-a827-12a6ffd05943 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:00.224883 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-37e566f7-7af4-4a2c-ac01-b0c036a655fb req-e171fad7-f7d2-4749-a827-12a6ffd05943 service nova] Creating event network-vif-deleted:e38dafb3-b9bf-4d37-8d9e-9abcfaf5d786 for instance 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c on nch1-master-1 Sep 24 21:01:00.239839 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-37e566f7-7af4-4a2c-ac01-b0c036a655fb req-e171fad7-f7d2-4749-a827-12a6ffd05943 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127296 Sep 24 21:01:00.242322 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1572/3138] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:00.256429 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f497e7de-3107-43b3-a2a6-d93062d4582b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:00.266537 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f497e7de-3107-43b3-a2a6-d93062d4582b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:00.285110 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f497e7de-3107-43b3-a2a6-d93062d4582b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:00.285624 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f497e7de-3107-43b3-a2a6-d93062d4582b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:00.286898 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f497e7de-3107-43b3-a2a6-d93062d4582b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:00.287630 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f497e7de-3107-43b3-a2a6-d93062d4582b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:00.288095 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f497e7de-3107-43b3-a2a6-d93062d4582b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:00.288524 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f497e7de-3107-43b3-a2a6-d93062d4582b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:00.305461 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-969deb78-35e4-437a-bff0-ddb1549dac93 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41f618458eb48f6bb4631fd254addc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4655b536ca04896993223f34d172298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:00.317698 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-969deb78-35e4-437a-bff0-ddb1549dac93 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "GET /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073" status: 200 len: 1324 microversion: 2.1 time: 0.441663 Sep 24 21:01:00.318724 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1567/3139] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:00:59 2022] GET /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073 => generated 1324 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:00.334650 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e560fa58-ff56-42ac-9b0c-322f26558a6e tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:00.335609 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e560fa58-ff56-42ac-9b0c-322f26558a6e tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:00.344777 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e560fa58-ff56-42ac-9b0c-322f26558a6e tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:00.347251 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e560fa58-ff56-42ac-9b0c-322f26558a6e tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:00.351064 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e560fa58-ff56-42ac-9b0c-322f26558a6e tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:00.352669 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e560fa58-ff56-42ac-9b0c-322f26558a6e tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:00.353707 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e560fa58-ff56-42ac-9b0c-322f26558a6e tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:00.355249 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e560fa58-ff56-42ac-9b0c-322f26558a6e tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:00.377436 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f497e7de-3107-43b3-a2a6-d93062d4582b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.132426 Sep 24 21:01:00.382134 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1573/3140] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:01:00 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:01:00.392864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-0c4d98c5-84cf-439d-8a69-9167d4a06f34 req-973e0b39-2dcf-4307-9b95-ba79c8af0c39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d546302-deb3-47c6-b9fd-3155ced00883", "name": "network-vif-plugged", "status": "completed", "tag": "56949465-71b8-45bb-b1d2-4b934bfc9714"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:00.421630 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-0c4d98c5-84cf-439d-8a69-9167d4a06f34 req-973e0b39-2dcf-4307-9b95-ba79c8af0c39 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:00.423041 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-0c4d98c5-84cf-439d-8a69-9167d4a06f34 req-973e0b39-2dcf-4307-9b95-ba79c8af0c39 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:00.423432 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-0c4d98c5-84cf-439d-8a69-9167d4a06f34 req-973e0b39-2dcf-4307-9b95-ba79c8af0c39 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:00.456950 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-0c4d98c5-84cf-439d-8a69-9167d4a06f34 req-973e0b39-2dcf-4307-9b95-ba79c8af0c39 service nova] Creating event network-vif-plugged:56949465-71b8-45bb-b1d2-4b934bfc9714 for instance 0d546302-deb3-47c6-b9fd-3155ced00883 on nch1-master-1 Sep 24 21:01:00.464418 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-0c4d98c5-84cf-439d-8a69-9167d4a06f34 req-973e0b39-2dcf-4307-9b95-ba79c8af0c39 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082373 Sep 24 21:01:00.469088 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1574/3141] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:00.485911 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-17b03073-dce7-4506-83ad-eb79f89c71f5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:00.486919 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-17b03073-dce7-4506-83ad-eb79f89c71f5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 7c6ee4f7-82b5-4c95-8865-ab81076df04f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:00.506740 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17b03073-dce7-4506-83ad-eb79f89c71f5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:00.507244 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17b03073-dce7-4506-83ad-eb79f89c71f5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:00.510143 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17b03073-dce7-4506-83ad-eb79f89c71f5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:00.511043 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17b03073-dce7-4506-83ad-eb79f89c71f5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:00.511537 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17b03073-dce7-4506-83ad-eb79f89c71f5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:00.511984 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17b03073-dce7-4506-83ad-eb79f89c71f5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:00.557026 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-e560fa58-ff56-42ac-9b0c-322f26558a6e tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lazy-loading 'services' on Instance uuid 1d8bc459-871f-4611-ba95-7bf7d0f08a27 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:01:00.600239 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-17b03073-dce7-4506-83ad-eb79f89c71f5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 7c6ee4f7-82b5-4c95-8865-ab81076df04f] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:01:00.605733 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e560fa58-ff56-42ac-9b0c-322f26558a6e tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1933 microversion: 2.75 time: 0.283546 Sep 24 21:01:00.610204 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1568/3142] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:01:00 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1933 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:01:00.617315 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-594a48db-4d0c-4fda-973b-c7cd97cf112c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:00.622340 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-594a48db-4d0c-4fda-973b-c7cd97cf112c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:00.635112 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-594a48db-4d0c-4fda-973b-c7cd97cf112c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:00.641085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-594a48db-4d0c-4fda-973b-c7cd97cf112c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:00.641814 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-594a48db-4d0c-4fda-973b-c7cd97cf112c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:00.642830 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-594a48db-4d0c-4fda-973b-c7cd97cf112c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:00.649807 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-594a48db-4d0c-4fda-973b-c7cd97cf112c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:00.650662 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-594a48db-4d0c-4fda-973b-c7cd97cf112c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:00.722136 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-594a48db-4d0c-4fda-973b-c7cd97cf112c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:00.723061 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-594a48db-4d0c-4fda-973b-c7cd97cf112c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:00.726213 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-594a48db-4d0c-4fda-973b-c7cd97cf112c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:00.727607 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-594a48db-4d0c-4fda-973b-c7cd97cf112c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lazy-loading 'fault' on Instance uuid 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:01:00.795620 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-17b03073-dce7-4506-83ad-eb79f89c71f5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f" status: 204 len: 0 microversion: 2.1 time: 0.324782 Sep 24 21:01:00.797303 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1575/3143] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:01:00 2022] DELETE /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:01:00.807680 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-594a48db-4d0c-4fda-973b-c7cd97cf112c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:00.816886 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-594a48db-4d0c-4fda-973b-c7cd97cf112c tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c" status: 200 len: 1307 microversion: 2.1 time: 0.205202 Sep 24 21:01:00.821856 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cda93450-4f5d-4b2a-828d-6c6458f879f6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:00.822758 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1569/3144] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:00 2022] GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c => generated 1307 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:00.823760 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cda93450-4f5d-4b2a-828d-6c6458f879f6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] [instance: a178dffd-f620-41c2-b1b5-5ccc1ec52786] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:00.836674 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b841c39b-df30-4b1b-9151-e96105f83a9d tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:00.844341 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cda93450-4f5d-4b2a-828d-6c6458f879f6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:00.845326 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b841c39b-df30-4b1b-9151-e96105f83a9d tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 7c6ee4f7-82b5-4c95-8865-ab81076df04f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:00.854459 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cda93450-4f5d-4b2a-828d-6c6458f879f6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:00.857283 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cda93450-4f5d-4b2a-828d-6c6458f879f6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:00.858324 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cda93450-4f5d-4b2a-828d-6c6458f879f6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:00.859082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cda93450-4f5d-4b2a-828d-6c6458f879f6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:00.860801 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cda93450-4f5d-4b2a-828d-6c6458f879f6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:00.870292 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b841c39b-df30-4b1b-9151-e96105f83a9d tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:00.871407 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b841c39b-df30-4b1b-9151-e96105f83a9d tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:00.872082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b841c39b-df30-4b1b-9151-e96105f83a9d tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:00.873208 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b841c39b-df30-4b1b-9151-e96105f83a9d tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:00.874796 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b841c39b-df30-4b1b-9151-e96105f83a9d tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:00.875487 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b841c39b-df30-4b1b-9151-e96105f83a9d tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:01.284394 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:01:01.297421 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b841c39b-df30-4b1b-9151-e96105f83a9d tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddab9c74c004e74a51fd8008886e542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdf8ae7524612b9c2f6a3f16c39ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:01.309080 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b841c39b-df30-4b1b-9151-e96105f83a9d tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f" status: 200 len: 1647 microversion: 2.1 time: 0.484049 Sep 24 21:01:01.311542 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1570/3145] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:00 2022] GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f => generated 1647 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:01.316324 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4735e2f7-9b7b-4a7e-9730-439db52e7ec5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:01.316947 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4735e2f7-9b7b-4a7e-9730-439db52e7ec5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:01.348274 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4735e2f7-9b7b-4a7e-9730-439db52e7ec5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:01.348797 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4735e2f7-9b7b-4a7e-9730-439db52e7ec5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:01.349241 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4735e2f7-9b7b-4a7e-9730-439db52e7ec5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:01.349973 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4735e2f7-9b7b-4a7e-9730-439db52e7ec5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:01.350442 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4735e2f7-9b7b-4a7e-9730-439db52e7ec5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:01.354792 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4735e2f7-9b7b-4a7e-9730-439db52e7ec5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:01.488293 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cda93450-4f5d-4b2a-828d-6c6458f879f6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c49bed91bb437087a8ad2d865c2647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b68f292633a49ca82fb05d18ea83142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:01.499628 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cda93450-4f5d-4b2a-828d-6c6458f879f6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] 10.222.0.52 "GET /compute/v2.1/servers/a178dffd-f620-41c2-b1b5-5ccc1ec52786" status: 200 len: 1320 microversion: 2.1 time: 0.700804 Sep 24 21:01:01.500245 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1576/3146] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:00 2022] GET /compute/v2.1/servers/a178dffd-f620-41c2-b1b5-5ccc1ec52786 => generated 1320 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:01.509858 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-23f54c29-08e0-4ecb-acdb-28e5a651e9b1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:01.510661 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-23f54c29-08e0-4ecb-acdb-28e5a651e9b1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 5c119929-2744-4871-b523-0a6a05c6c073] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:01.533522 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-23f54c29-08e0-4ecb-acdb-28e5a651e9b1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:01.534105 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-23f54c29-08e0-4ecb-acdb-28e5a651e9b1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:01.535025 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-23f54c29-08e0-4ecb-acdb-28e5a651e9b1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:01.542081 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-23f54c29-08e0-4ecb-acdb-28e5a651e9b1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:01.542620 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-23f54c29-08e0-4ecb-acdb-28e5a651e9b1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:01.543072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-23f54c29-08e0-4ecb-acdb-28e5a651e9b1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:01.619995 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4735e2f7-9b7b-4a7e-9730-439db52e7ec5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:01.623114 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:01:01.634370 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4735e2f7-9b7b-4a7e-9730-439db52e7ec5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1524 microversion: 2.1 time: 0.321701 Sep 24 21:01:01.648013 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1571/3147] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:01 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1524 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:01.648013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0bdd8d66-b8d9-4e78-9c3d-380cc1d8613d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:01.648013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0bdd8d66-b8d9-4e78-9c3d-380cc1d8613d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:01.655817 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0bdd8d66-b8d9-4e78-9c3d-380cc1d8613d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:01.655817 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0bdd8d66-b8d9-4e78-9c3d-380cc1d8613d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:01.655817 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0bdd8d66-b8d9-4e78-9c3d-380cc1d8613d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:01.656200 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0bdd8d66-b8d9-4e78-9c3d-380cc1d8613d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:01.656659 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0bdd8d66-b8d9-4e78-9c3d-380cc1d8613d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:01.657355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0bdd8d66-b8d9-4e78-9c3d-380cc1d8613d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:01.735262 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0bdd8d66-b8d9-4e78-9c3d-380cc1d8613d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.098549 Sep 24 21:01:01.740062 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1572/3148] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:01:01 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:01:01.740808 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9dec0997-6f75-430b-bf27-1e0a3b8314a2 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:01.741430 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9dec0997-6f75-430b-bf27-1e0a3b8314a2 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:01.765347 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9dec0997-6f75-430b-bf27-1e0a3b8314a2 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:01.765861 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9dec0997-6f75-430b-bf27-1e0a3b8314a2 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:01.766319 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9dec0997-6f75-430b-bf27-1e0a3b8314a2 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:01.767105 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9dec0997-6f75-430b-bf27-1e0a3b8314a2 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:01.767624 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9dec0997-6f75-430b-bf27-1e0a3b8314a2 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:01.768062 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9dec0997-6f75-430b-bf27-1e0a3b8314a2 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:01.909759 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-9dec0997-6f75-430b-bf27-1e0a3b8314a2 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lazy-loading 'services' on Instance uuid 1d8bc459-871f-4611-ba95-7bf7d0f08a27 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:01:01.930890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-23f54c29-08e0-4ecb-acdb-28e5a651e9b1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41f618458eb48f6bb4631fd254addc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4655b536ca04896993223f34d172298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:01.939962 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-23f54c29-08e0-4ecb-acdb-28e5a651e9b1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "GET /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073" status: 200 len: 1324 microversion: 2.1 time: 0.438518 Sep 24 21:01:01.953061 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1577/3149] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:01 2022] GET /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073 => generated 1324 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:01.972556 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9dec0997-6f75-430b-bf27-1e0a3b8314a2 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1933 microversion: 2.75 time: 0.235166 Sep 24 21:01:01.973351 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1573/3150] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:01:01 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1933 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:01:01.975275 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-06738e6a-f192-45c9-a21e-3ad05e7fb280 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:01.976291 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-06738e6a-f192-45c9-a21e-3ad05e7fb280 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:01.984822 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06738e6a-f192-45c9-a21e-3ad05e7fb280 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:01.985997 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06738e6a-f192-45c9-a21e-3ad05e7fb280 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:01.987014 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06738e6a-f192-45c9-a21e-3ad05e7fb280 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:01.987983 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06738e6a-f192-45c9-a21e-3ad05e7fb280 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:01.988650 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06738e6a-f192-45c9-a21e-3ad05e7fb280 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:01.989467 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06738e6a-f192-45c9-a21e-3ad05e7fb280 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:02.049473 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06738e6a-f192-45c9-a21e-3ad05e7fb280 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:02.050272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06738e6a-f192-45c9-a21e-3ad05e7fb280 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:02.050927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06738e6a-f192-45c9-a21e-3ad05e7fb280 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:02.051574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-06738e6a-f192-45c9-a21e-3ad05e7fb280 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lazy-loading 'fault' on Instance uuid 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:01:02.129931 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-06738e6a-f192-45c9-a21e-3ad05e7fb280 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:02.139710 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-06738e6a-f192-45c9-a21e-3ad05e7fb280 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c" status: 200 len: 1307 microversion: 2.1 time: 0.185652 Sep 24 21:01:02.140305 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1578/3151] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:01 2022] GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c => generated 1307 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:02.300894 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-607dead3-3917-4d4a-aaa1-07db25e676a4 req-31c9acf8-8fb0-42f3-b218-b5a15a00163d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c660bb73-2186-4c86-b57b-0c6c3be5c9bf", "tag": "3c3743a2-0126-4864-bed2-ea84c10b230a"}, {"name": "network-changed", "server_uuid": "a178dffd-f620-41c2-b1b5-5ccc1ec52786", "tag": "30c2493d-8ce1-4427-abd8-f40405c99430"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:02.336462 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-41196be2-f627-4070-86e3-ae36d180b110 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:02.337364 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-41196be2-f627-4070-86e3-ae36d180b110 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 7c6ee4f7-82b5-4c95-8865-ab81076df04f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:02.339166 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-607dead3-3917-4d4a-aaa1-07db25e676a4 req-31c9acf8-8fb0-42f3-b218-b5a15a00163d service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:02.340189 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-607dead3-3917-4d4a-aaa1-07db25e676a4 req-31c9acf8-8fb0-42f3-b218-b5a15a00163d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:02.340751 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-607dead3-3917-4d4a-aaa1-07db25e676a4 req-31c9acf8-8fb0-42f3-b218-b5a15a00163d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:02.345786 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41196be2-f627-4070-86e3-ae36d180b110 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:02.357753 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41196be2-f627-4070-86e3-ae36d180b110 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:02.360226 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41196be2-f627-4070-86e3-ae36d180b110 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:02.362823 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41196be2-f627-4070-86e3-ae36d180b110 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:02.366271 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41196be2-f627-4070-86e3-ae36d180b110 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:02.366873 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41196be2-f627-4070-86e3-ae36d180b110 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:02.377056 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-607dead3-3917-4d4a-aaa1-07db25e676a4 req-31c9acf8-8fb0-42f3-b218-b5a15a00163d service nova] Creating event network-changed:3c3743a2-0126-4864-bed2-ea84c10b230a for instance c660bb73-2186-4c86-b57b-0c6c3be5c9bf on nch2-master-1 Sep 24 21:01:02.379280 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-607dead3-3917-4d4a-aaa1-07db25e676a4 req-31c9acf8-8fb0-42f3-b218-b5a15a00163d service nova] Creating event network-changed:30c2493d-8ce1-4427-abd8-f40405c99430 for instance a178dffd-f620-41c2-b1b5-5ccc1ec52786 on nch2-master-1 Sep 24 21:01:02.406378 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-607dead3-3917-4d4a-aaa1-07db25e676a4 req-31c9acf8-8fb0-42f3-b218-b5a15a00163d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.118089 Sep 24 21:01:02.407641 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1574/3152] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:02.532463 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-982e108d-dfef-4293-bdd7-6a91e859b4e5 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:02.534868 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-982e108d-dfef-4293-bdd7-6a91e859b4e5 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] [instance: a178dffd-f620-41c2-b1b5-5ccc1ec52786] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:02.541857 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-982e108d-dfef-4293-bdd7-6a91e859b4e5 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:02.546875 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-982e108d-dfef-4293-bdd7-6a91e859b4e5 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:02.546875 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-982e108d-dfef-4293-bdd7-6a91e859b4e5 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:02.546875 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-982e108d-dfef-4293-bdd7-6a91e859b4e5 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:02.546875 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-982e108d-dfef-4293-bdd7-6a91e859b4e5 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:02.546875 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-982e108d-dfef-4293-bdd7-6a91e859b4e5 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:02.910476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-41196be2-f627-4070-86e3-ae36d180b110 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddab9c74c004e74a51fd8008886e542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdf8ae7524612b9c2f6a3f16c39ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:02.930090 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-41196be2-f627-4070-86e3-ae36d180b110 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f" status: 200 len: 1647 microversion: 2.1 time: 0.597093 Sep 24 21:01:02.930740 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1579/3153] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:02 2022] GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f => generated 1647 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:01:02.941224 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-edea313b-c3f3-4f4f-b6b1-ce133e299c7d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:02.949433 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-edea313b-c3f3-4f4f-b6b1-ce133e299c7d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:02.963705 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-edea313b-c3f3-4f4f-b6b1-ce133e299c7d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:02.964228 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-edea313b-c3f3-4f4f-b6b1-ce133e299c7d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:02.964680 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-edea313b-c3f3-4f4f-b6b1-ce133e299c7d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:02.968905 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-edea313b-c3f3-4f4f-b6b1-ce133e299c7d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:02.969416 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-edea313b-c3f3-4f4f-b6b1-ce133e299c7d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:02.969877 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-edea313b-c3f3-4f4f-b6b1-ce133e299c7d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:02.995669 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-982e108d-dfef-4293-bdd7-6a91e859b4e5 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c49bed91bb437087a8ad2d865c2647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b68f292633a49ca82fb05d18ea83142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:03.012778 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-982e108d-dfef-4293-bdd7-6a91e859b4e5 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] 10.222.0.52 "GET /compute/v2.1/servers/a178dffd-f620-41c2-b1b5-5ccc1ec52786" status: 200 len: 1320 microversion: 2.1 time: 0.489976 Sep 24 21:01:03.027581 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1575/3154] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:02 2022] GET /compute/v2.1/servers/a178dffd-f620-41c2-b1b5-5ccc1ec52786 => generated 1320 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:03.044750 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a4d10fa1-63ab-4ea0-aad8-fb698d72f483 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:03.047409 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a4d10fa1-63ab-4ea0-aad8-fb698d72f483 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:03.055567 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4d10fa1-63ab-4ea0-aad8-fb698d72f483 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:03.056534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4d10fa1-63ab-4ea0-aad8-fb698d72f483 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:03.057185 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4d10fa1-63ab-4ea0-aad8-fb698d72f483 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:03.058174 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4d10fa1-63ab-4ea0-aad8-fb698d72f483 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:03.058890 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4d10fa1-63ab-4ea0-aad8-fb698d72f483 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:03.060673 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4d10fa1-63ab-4ea0-aad8-fb698d72f483 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:03.121614 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a4d10fa1-63ab-4ea0-aad8-fb698d72f483 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.092351 Sep 24 21:01:03.143530 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1576/3155] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:01:03 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:01:03.152932 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7f81c9f3-3c69-4c4c-9f61-ce6b6a0f87f4 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:03.154360 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7f81c9f3-3c69-4c4c-9f61-ce6b6a0f87f4 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 5c119929-2744-4871-b523-0a6a05c6c073] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:03.179740 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f81c9f3-3c69-4c4c-9f61-ce6b6a0f87f4 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:03.180266 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f81c9f3-3c69-4c4c-9f61-ce6b6a0f87f4 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:03.180749 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f81c9f3-3c69-4c4c-9f61-ce6b6a0f87f4 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:03.181499 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f81c9f3-3c69-4c4c-9f61-ce6b6a0f87f4 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:03.181959 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f81c9f3-3c69-4c4c-9f61-ce6b6a0f87f4 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:03.182388 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f81c9f3-3c69-4c4c-9f61-ce6b6a0f87f4 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:03.303743 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-edea313b-c3f3-4f4f-b6b1-ce133e299c7d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:03.320359 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-edea313b-c3f3-4f4f-b6b1-ce133e299c7d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1524 microversion: 2.1 time: 0.386791 Sep 24 21:01:03.326573 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1580/3156] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:02 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1524 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:03.344836 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-88d4aee9-e9e8-46db-ab55-eeee6422f0a5 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:03.348373 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-88d4aee9-e9e8-46db-ab55-eeee6422f0a5 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:03.365701 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-88d4aee9-e9e8-46db-ab55-eeee6422f0a5 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:03.370487 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-88d4aee9-e9e8-46db-ab55-eeee6422f0a5 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:03.371092 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-88d4aee9-e9e8-46db-ab55-eeee6422f0a5 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:03.379479 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-88d4aee9-e9e8-46db-ab55-eeee6422f0a5 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:03.380181 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-88d4aee9-e9e8-46db-ab55-eeee6422f0a5 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:03.380749 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-88d4aee9-e9e8-46db-ab55-eeee6422f0a5 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:03.499191 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-88d4aee9-e9e8-46db-ab55-eeee6422f0a5 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lazy-loading 'services' on Instance uuid 1d8bc459-871f-4611-ba95-7bf7d0f08a27 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:01:03.539438 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-88d4aee9-e9e8-46db-ab55-eeee6422f0a5 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1933 microversion: 2.75 time: 0.211439 Sep 24 21:01:03.565606 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1581/3157] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:01:03 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1933 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:01:03.572470 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0edc540f-adfc-4d7d-8773-ffe55b78f3e8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:03.573100 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0edc540f-adfc-4d7d-8773-ffe55b78f3e8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:03.585909 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0edc540f-adfc-4d7d-8773-ffe55b78f3e8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:03.585909 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0edc540f-adfc-4d7d-8773-ffe55b78f3e8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:03.585909 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0edc540f-adfc-4d7d-8773-ffe55b78f3e8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:03.585909 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0edc540f-adfc-4d7d-8773-ffe55b78f3e8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:03.585909 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0edc540f-adfc-4d7d-8773-ffe55b78f3e8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:03.586482 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0edc540f-adfc-4d7d-8773-ffe55b78f3e8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:03.616338 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7f81c9f3-3c69-4c4c-9f61-ce6b6a0f87f4 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41f618458eb48f6bb4631fd254addc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4655b536ca04896993223f34d172298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:03.631609 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0edc540f-adfc-4d7d-8773-ffe55b78f3e8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:03.632407 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0edc540f-adfc-4d7d-8773-ffe55b78f3e8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:03.632938 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0edc540f-adfc-4d7d-8773-ffe55b78f3e8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:03.633064 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7f81c9f3-3c69-4c4c-9f61-ce6b6a0f87f4 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "GET /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073" status: 200 len: 1520 microversion: 2.1 time: 0.487372 Sep 24 21:01:03.633404 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-0edc540f-adfc-4d7d-8773-ffe55b78f3e8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lazy-loading 'fault' on Instance uuid 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:01:03.633613 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1577/3158] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:03 2022] GET /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073 => generated 1520 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:03.636950 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:01:03.663904 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-129967ee-10fe-4bf9-a7cd-999cd42cae63 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.7.247"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:03.667787 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-129967ee-10fe-4bf9-a7cd-999cd42cae63 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:03.700485 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-129967ee-10fe-4bf9-a7cd-999cd42cae63 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:03.701670 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-129967ee-10fe-4bf9-a7cd-999cd42cae63 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:03.702251 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-129967ee-10fe-4bf9-a7cd-999cd42cae63 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:03.703032 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-129967ee-10fe-4bf9-a7cd-999cd42cae63 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:03.703497 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-129967ee-10fe-4bf9-a7cd-999cd42cae63 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:03.703939 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-129967ee-10fe-4bf9-a7cd-999cd42cae63 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:03.713538 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0edc540f-adfc-4d7d-8773-ffe55b78f3e8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e7493d0ed47aca659dc925e8ca39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c875b2746384d5a9d02548faab6fd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:03.737715 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0edc540f-adfc-4d7d-8773-ffe55b78f3e8 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c" status: 200 len: 1307 microversion: 2.1 time: 0.160396 Sep 24 21:01:03.737715 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1582/3159] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:03 2022] GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c => generated 1307 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:03.750293 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-129967ee-10fe-4bf9-a7cd-999cd42cae63 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "refresh_cache-547cf9a4-1d05-4cbd-bb2b-ee5cbd406130" {{(pid=140517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 24 21:01:03.751040 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-129967ee-10fe-4bf9-a7cd-999cd42cae63 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquired lock "refresh_cache-547cf9a4-1d05-4cbd-bb2b-ee5cbd406130" {{(pid=140517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 24 21:01:03.954240 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-676db347-d3b1-4447-b973-80ded9ebb720 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:03.955060 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-676db347-d3b1-4447-b973-80ded9ebb720 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 7c6ee4f7-82b5-4c95-8865-ab81076df04f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:03.976122 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-676db347-d3b1-4447-b973-80ded9ebb720 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:03.976615 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-676db347-d3b1-4447-b973-80ded9ebb720 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:03.977056 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-676db347-d3b1-4447-b973-80ded9ebb720 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:03.985865 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-676db347-d3b1-4447-b973-80ded9ebb720 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:03.986689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-676db347-d3b1-4447-b973-80ded9ebb720 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:03.989903 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-676db347-d3b1-4447-b973-80ded9ebb720 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:04.616682 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-676db347-d3b1-4447-b973-80ded9ebb720 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddab9c74c004e74a51fd8008886e542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdf8ae7524612b9c2f6a3f16c39ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:04.629643 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-676db347-d3b1-4447-b973-80ded9ebb720 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f" status: 200 len: 1647 microversion: 2.1 time: 0.680149 Sep 24 21:01:04.660602 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1583/3160] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:03 2022] GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f => generated 1647 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:04.660602 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8158e880-7a79-41a9-b008-e4f8d79f641f tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:04.660602 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8158e880-7a79-41a9-b008-e4f8d79f641f tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] [instance: a178dffd-f620-41c2-b1b5-5ccc1ec52786] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:04.693689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8158e880-7a79-41a9-b008-e4f8d79f641f tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:04.694194 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8158e880-7a79-41a9-b008-e4f8d79f641f tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:04.699369 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8158e880-7a79-41a9-b008-e4f8d79f641f tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:04.700187 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8158e880-7a79-41a9-b008-e4f8d79f641f tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:04.704146 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8158e880-7a79-41a9-b008-e4f8d79f641f tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:04.704646 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8158e880-7a79-41a9-b008-e4f8d79f641f tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:05.726007 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8158e880-7a79-41a9-b008-e4f8d79f641f tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c49bed91bb437087a8ad2d865c2647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b68f292633a49ca82fb05d18ea83142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:05.734474 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8158e880-7a79-41a9-b008-e4f8d79f641f tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] 10.222.0.52 "GET /compute/v2.1/servers/a178dffd-f620-41c2-b1b5-5ccc1ec52786" status: 200 len: 1320 microversion: 2.1 time: 1.093974 Sep 24 21:01:05.751156 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1584/3161] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:04 2022] GET /compute/v2.1/servers/a178dffd-f620-41c2-b1b5-5ccc1ec52786 => generated 1320 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:05.756484 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b378f9e3-acd9-404f-bb00-5f0c227f49df tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:05.759152 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b378f9e3-acd9-404f-bb00-5f0c227f49df tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:05.766235 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b378f9e3-acd9-404f-bb00-5f0c227f49df tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:05.767028 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b378f9e3-acd9-404f-bb00-5f0c227f49df tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:05.767665 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b378f9e3-acd9-404f-bb00-5f0c227f49df tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:05.768580 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b378f9e3-acd9-404f-bb00-5f0c227f49df tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:05.769192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b378f9e3-acd9-404f-bb00-5f0c227f49df tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:05.769784 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b378f9e3-acd9-404f-bb00-5f0c227f49df tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:05.806636 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b378f9e3-acd9-404f-bb00-5f0c227f49df tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.053964 Sep 24 21:01:05.813866 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1585/3162] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:01:05 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:01:05.822900 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-aa3379cb-efaa-46ab-b52d-d65f46a75f73 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:05.824333 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-aa3379cb-efaa-46ab-b52d-d65f46a75f73 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:05.833011 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa3379cb-efaa-46ab-b52d-d65f46a75f73 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:05.833802 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa3379cb-efaa-46ab-b52d-d65f46a75f73 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:05.834420 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa3379cb-efaa-46ab-b52d-d65f46a75f73 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:05.835346 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa3379cb-efaa-46ab-b52d-d65f46a75f73 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:05.835988 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa3379cb-efaa-46ab-b52d-d65f46a75f73 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:05.836876 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa3379cb-efaa-46ab-b52d-d65f46a75f73 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:06.327042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-aa3379cb-efaa-46ab-b52d-d65f46a75f73 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:06.343907 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-aa3379cb-efaa-46ab-b52d-d65f46a75f73 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1506 microversion: 2.1 time: 0.528038 Sep 24 21:01:06.351689 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1586/3163] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:05 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1506 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:06.390757 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d51d0c6b-3696-4749-bf4b-93ff0ae2c195 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:06.392514 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d51d0c6b-3696-4749-bf4b-93ff0ae2c195 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:06.420164 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d51d0c6b-3696-4749-bf4b-93ff0ae2c195 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:06.420495 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d51d0c6b-3696-4749-bf4b-93ff0ae2c195 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:06.420909 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d51d0c6b-3696-4749-bf4b-93ff0ae2c195 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:06.421932 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d51d0c6b-3696-4749-bf4b-93ff0ae2c195 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:06.422140 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d51d0c6b-3696-4749-bf4b-93ff0ae2c195 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:06.422563 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d51d0c6b-3696-4749-bf4b-93ff0ae2c195 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:06.610232 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-d51d0c6b-3696-4749-bf4b-93ff0ae2c195 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] Lazy-loading 'services' on Instance uuid 1d8bc459-871f-4611-ba95-7bf7d0f08a27 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:01:06.660197 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d51d0c6b-3696-4749-bf4b-93ff0ae2c195 tempest-ServersAdmin275Test-9165347 tempest-ServersAdmin275Test-9165347-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1918 microversion: 2.75 time: 0.285547 Sep 24 21:01:06.663746 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1587/3164] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:01:06 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1918 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:01:06.675390 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6e8c5f95-9e2f-4f4e-b128-e734db608b55 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:06.678192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6e8c5f95-9e2f-4f4e-b128-e734db608b55 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:06.695263 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6e8c5f95-9e2f-4f4e-b128-e734db608b55 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:06.696058 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6e8c5f95-9e2f-4f4e-b128-e734db608b55 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:06.696696 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6e8c5f95-9e2f-4f4e-b128-e734db608b55 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:06.700841 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6e8c5f95-9e2f-4f4e-b128-e734db608b55 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:06.703627 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6e8c5f95-9e2f-4f4e-b128-e734db608b55 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:06.704445 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6e8c5f95-9e2f-4f4e-b128-e734db608b55 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:06.740093 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-6e8c5f95-9e2f-4f4e-b128-e734db608b55 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] HTTP exception thrown: Instance 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c could not be found. Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6e8c5f95-9e2f-4f4e-b128-e734db608b55 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Request method failure captured: Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c HTTP/1.1 Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL29WDJMBEwAbZTNNByQX5gf7JFR-0Pn6JsCHQCcgluT7fa5T6UuGxNhdMKCqgBFDdS4hxg9HKcrnkFw6evE8RGB9czj5rzhn4xyznU3NEhcpXN89XH8ipoL66wAhqjVEhgZoTZr-QMKKRbLI6Pi6BTJgI0odJ8FBVIZ9cmOHZjPiROQ Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 8c875b2746384d5a9d02548faab6fd5d Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1306216960 Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8c875b2746384d5a9d02548faab6fd5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8c875b2746384d5a9d02548faab6fd5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8c875b2746384d5a9d02548faab6fd5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8c875b2746384d5a9d02548faab6fd5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServerDiskConfigTestJSON-1306216960 Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 8c875b2746384d5a9d02548faab6fd5d Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1306216960 Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServerDiskConfigTestJSON-1306216960-project Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: c84e7493d0ed47aca659dc925e8ca39c Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServerDiskConfigTestJSON-1306216960-project Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c could not be found. Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c'} Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c could not be found. Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c could not be found. Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:06.744878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:06.750572 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:06.750572 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:06.750572 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:06.750572 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:01:06.750572 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:01:06.750572 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c could not be found. Sep 24 21:01:06.750572 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:06.755765 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6e8c5f95-9e2f-4f4e-b128-e734db608b55 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Returning 404 to user: Instance 218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:01:06.756886 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6e8c5f95-9e2f-4f4e-b128-e734db608b55 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c" status: 404 len: 111 microversion: 2.1 time: 0.091906 Sep 24 21:01:06.759825 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1588/3165] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:06 2022] GET /compute/v2.1/servers/218d9d46-a12f-4c11-9cd9-d8c14e3c0f8c => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:01:06.775839 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ad453fe0-c0c3-4690-b08d-8ad48bec9a95 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:06.776831 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ad453fe0-c0c3-4690-b08d-8ad48bec9a95 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 7c6ee4f7-82b5-4c95-8865-ab81076df04f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:06.800819 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad453fe0-c0c3-4690-b08d-8ad48bec9a95 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:06.801626 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad453fe0-c0c3-4690-b08d-8ad48bec9a95 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:06.802253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad453fe0-c0c3-4690-b08d-8ad48bec9a95 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:06.809467 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad453fe0-c0c3-4690-b08d-8ad48bec9a95 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:06.810237 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad453fe0-c0c3-4690-b08d-8ad48bec9a95 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:06.811825 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad453fe0-c0c3-4690-b08d-8ad48bec9a95 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:06.892073 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad453fe0-c0c3-4690-b08d-8ad48bec9a95 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:06.892844 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad453fe0-c0c3-4690-b08d-8ad48bec9a95 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:06.893311 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad453fe0-c0c3-4690-b08d-8ad48bec9a95 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:06.893764 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-ad453fe0-c0c3-4690-b08d-8ad48bec9a95 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lazy-loading 'fault' on Instance uuid 7c6ee4f7-82b5-4c95-8865-ab81076df04f {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:01:06.954932 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ad453fe0-c0c3-4690-b08d-8ad48bec9a95 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddab9c74c004e74a51fd8008886e542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdf8ae7524612b9c2f6a3f16c39ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:06.963379 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ad453fe0-c0c3-4690-b08d-8ad48bec9a95 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f" status: 200 len: 1306 microversion: 2.1 time: 0.200256 Sep 24 21:01:06.967778 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1589/3166] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:06 2022] GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f => generated 1306 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:06.974474 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-b9463b8b-f464-460d-961c-8a70e7b486b3 req-b8a33f1e-9ade-430f-8115-c3daa9280f7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c6ee4f7-82b5-4c95-8865-ab81076df04f", "name": "network-vif-deleted", "tag": "e1795d42-5be1-400f-9688-3f2a6d103ce9"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:07.012430 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-b9463b8b-f464-460d-961c-8a70e7b486b3 req-b8a33f1e-9ade-430f-8115-c3daa9280f7f service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:07.012778 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-b9463b8b-f464-460d-961c-8a70e7b486b3 req-b8a33f1e-9ade-430f-8115-c3daa9280f7f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:07.014753 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-b9463b8b-f464-460d-961c-8a70e7b486b3 req-b8a33f1e-9ade-430f-8115-c3daa9280f7f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:07.039823 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-b9463b8b-f464-460d-961c-8a70e7b486b3 req-b8a33f1e-9ade-430f-8115-c3daa9280f7f service nova] Creating event network-vif-deleted:e1795d42-5be1-400f-9688-3f2a6d103ce9 for instance 7c6ee4f7-82b5-4c95-8865-ab81076df04f on nch1-master-1 Sep 24 21:01:07.051146 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-b9463b8b-f464-460d-961c-8a70e7b486b3 req-b8a33f1e-9ade-430f-8115-c3daa9280f7f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081898 Sep 24 21:01:07.052381 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1590/3167] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:07.062584 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-09819fb3-4e68-4bec-9967-f7a4415ec0d4 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:07.069429 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-09819fb3-4e68-4bec-9967-f7a4415ec0d4 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:07.084119 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-09819fb3-4e68-4bec-9967-f7a4415ec0d4 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:07.084807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-09819fb3-4e68-4bec-9967-f7a4415ec0d4 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:07.085904 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-09819fb3-4e68-4bec-9967-f7a4415ec0d4 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:07.087770 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-09819fb3-4e68-4bec-9967-f7a4415ec0d4 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:07.089431 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-09819fb3-4e68-4bec-9967-f7a4415ec0d4 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:07.089766 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-09819fb3-4e68-4bec-9967-f7a4415ec0d4 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:07.166197 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-09819fb3-4e68-4bec-9967-f7a4415ec0d4 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:01:07.370332 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-09819fb3-4e68-4bec-9967-f7a4415ec0d4 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 204 len: 0 microversion: 2.75 time: 0.314007 Sep 24 21:01:07.375404 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1591/3168] 10.222.0.52 () {60 vars in 1280 bytes} [Sat Sep 24 21:01:07 2022] DELETE /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 24 21:01:07.385572 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5b204e3e-c57e-42a5-b93a-845c1159e727 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:07.387359 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5b204e3e-c57e-42a5-b93a-845c1159e727 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] [instance: a178dffd-f620-41c2-b1b5-5ccc1ec52786] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:07.407622 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b204e3e-c57e-42a5-b93a-845c1159e727 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:07.408575 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b204e3e-c57e-42a5-b93a-845c1159e727 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:07.410564 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b204e3e-c57e-42a5-b93a-845c1159e727 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:07.411571 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b204e3e-c57e-42a5-b93a-845c1159e727 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:07.415607 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b204e3e-c57e-42a5-b93a-845c1159e727 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:07.416470 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b204e3e-c57e-42a5-b93a-845c1159e727 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:07.473762 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-129967ee-10fe-4bf9-a7cd-999cd42cae63 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130] Building network info cache for instance {{(pid=140517) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 24 21:01:07.845983 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5b204e3e-c57e-42a5-b93a-845c1159e727 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c49bed91bb437087a8ad2d865c2647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b68f292633a49ca82fb05d18ea83142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:07.859836 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5b204e3e-c57e-42a5-b93a-845c1159e727 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] 10.222.0.52 "GET /compute/v2.1/servers/a178dffd-f620-41c2-b1b5-5ccc1ec52786" status: 200 len: 1320 microversion: 2.1 time: 0.485155 Sep 24 21:01:07.861166 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1592/3169] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:07 2022] GET /compute/v2.1/servers/a178dffd-f620-41c2-b1b5-5ccc1ec52786 => generated 1320 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:07.874353 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3aa17f31-7592-4b90-8284-e2be01de54cf tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:07.874904 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3aa17f31-7592-4b90-8284-e2be01de54cf tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:07.886008 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3aa17f31-7592-4b90-8284-e2be01de54cf tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:07.887753 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3aa17f31-7592-4b90-8284-e2be01de54cf tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:07.888260 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3aa17f31-7592-4b90-8284-e2be01de54cf tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:07.888996 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3aa17f31-7592-4b90-8284-e2be01de54cf tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:07.893225 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3aa17f31-7592-4b90-8284-e2be01de54cf tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:07.893867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3aa17f31-7592-4b90-8284-e2be01de54cf tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:07.914611 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-3aa17f31-7592-4b90-8284-e2be01de54cf tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] HTTP exception thrown: Instance cf34d10c-76c3-4798-9a3f-083aeb681fd6 could not be found. Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3aa17f31-7592-4b90-8284-e2be01de54cf tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Request method failure captured: Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 HTTP/1.1 Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL29WDJMBEwAbZTNNByQX5gf7JFR-0Pn6JsCHQCcgluT7fa5T6UuGxNhdMKCqgBFDdS4hxg9HKcrnkFw6evE8RGB9czj5rzhn4xyznU3NEhcpXN89XH8ipoL66wAhqjVEhgZoTZr-QMKKRbLI6Pi6BTJgI0odJ8FBVIZ9cmOHZjPiROQ Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 8c875b2746384d5a9d02548faab6fd5d Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1306216960 Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8c875b2746384d5a9d02548faab6fd5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8c875b2746384d5a9d02548faab6fd5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8c875b2746384d5a9d02548faab6fd5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8c875b2746384d5a9d02548faab6fd5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServerDiskConfigTestJSON-1306216960 Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 8c875b2746384d5a9d02548faab6fd5d Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1306216960 Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServerDiskConfigTestJSON-1306216960-project Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: c84e7493d0ed47aca659dc925e8ca39c Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServerDiskConfigTestJSON-1306216960-project Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance cf34d10c-76c3-4798-9a3f-083aeb681fd6 could not be found. Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'cf34d10c-76c3-4798-9a3f-083aeb681fd6'} Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf34d10c-76c3-4798-9a3f-083aeb681fd6 could not be found. Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:01:07.917173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:01:07.922313 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf34d10c-76c3-4798-9a3f-083aeb681fd6 could not be found. Sep 24 21:01:07.922313 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:07.922313 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:07.922313 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:07.922313 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:07.922313 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:07.922313 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:07.922313 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:01:07.922313 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:01:07.922313 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf34d10c-76c3-4798-9a3f-083aeb681fd6 could not be found. Sep 24 21:01:07.922313 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:07.924253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3aa17f31-7592-4b90-8284-e2be01de54cf tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Returning 404 to user: Instance cf34d10c-76c3-4798-9a3f-083aeb681fd6 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:01:07.925154 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3aa17f31-7592-4b90-8284-e2be01de54cf tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 404 len: 111 microversion: 2.1 time: 0.062834 Sep 24 21:01:07.925929 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1593/3170] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:01:07 2022] DELETE /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:01:07.950405 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5da393a1-5218-44fd-ae50-79ab408a0e19 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:07.956193 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5da393a1-5218-44fd-ae50-79ab408a0e19 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:07.969839 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5da393a1-5218-44fd-ae50-79ab408a0e19 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:07.970399 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5da393a1-5218-44fd-ae50-79ab408a0e19 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:07.970904 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5da393a1-5218-44fd-ae50-79ab408a0e19 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:07.971676 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5da393a1-5218-44fd-ae50-79ab408a0e19 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:07.972183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5da393a1-5218-44fd-ae50-79ab408a0e19 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:07.972629 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5da393a1-5218-44fd-ae50-79ab408a0e19 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:08.037998 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5da393a1-5218-44fd-ae50-79ab408a0e19 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.111136 Sep 24 21:01:08.050874 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1594/3171] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:01:07 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:01:08.055903 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-beaa4347-1645-4267-af67-ceacfab04243 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:08.056529 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-beaa4347-1645-4267-af67-ceacfab04243 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:08.066648 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-beaa4347-1645-4267-af67-ceacfab04243 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:08.067163 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-beaa4347-1645-4267-af67-ceacfab04243 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:08.067619 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-beaa4347-1645-4267-af67-ceacfab04243 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:08.068360 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-beaa4347-1645-4267-af67-ceacfab04243 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:08.068829 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-beaa4347-1645-4267-af67-ceacfab04243 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:08.069269 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-beaa4347-1645-4267-af67-ceacfab04243 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:08.196273 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-beaa4347-1645-4267-af67-ceacfab04243 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:08.213709 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-beaa4347-1645-4267-af67-ceacfab04243 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:08.215938 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-beaa4347-1645-4267-af67-ceacfab04243 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:08.224214 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-beaa4347-1645-4267-af67-ceacfab04243 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1443 microversion: 2.75 time: 0.172047 Sep 24 21:01:08.225458 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1595/3172] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:01:08 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1443 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:01:08.233313 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-be570cbf-ff56-4c03-8234-7201d10a6557 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:08.233736 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-be570cbf-ff56-4c03-8234-7201d10a6557 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:08.242185 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-be570cbf-ff56-4c03-8234-7201d10a6557 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:08.243058 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-be570cbf-ff56-4c03-8234-7201d10a6557 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:08.243513 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-be570cbf-ff56-4c03-8234-7201d10a6557 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:08.244263 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-be570cbf-ff56-4c03-8234-7201d10a6557 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:08.245051 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-be570cbf-ff56-4c03-8234-7201d10a6557 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:08.245498 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-be570cbf-ff56-4c03-8234-7201d10a6557 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:08.506454 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-be570cbf-ff56-4c03-8234-7201d10a6557 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:08.516929 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-be570cbf-ff56-4c03-8234-7201d10a6557 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1506 microversion: 2.1 time: 0.289757 Sep 24 21:01:08.518052 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1596/3173] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:08 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1506 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:08.552119 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-d926a9ea-65f1-4497-aca5-ff1813c082d2 req-623a26ec-7115-4324-89e3-5caec337e6e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a178dffd-f620-41c2-b1b5-5ccc1ec52786", "name": "network-vif-plugged", "status": "completed", "tag": "30c2493d-8ce1-4427-abd8-f40405c99430"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:08.570044 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d926a9ea-65f1-4497-aca5-ff1813c082d2 req-623a26ec-7115-4324-89e3-5caec337e6e4 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:08.570558 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d926a9ea-65f1-4497-aca5-ff1813c082d2 req-623a26ec-7115-4324-89e3-5caec337e6e4 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:08.571004 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d926a9ea-65f1-4497-aca5-ff1813c082d2 req-623a26ec-7115-4324-89e3-5caec337e6e4 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:08.585430 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-d926a9ea-65f1-4497-aca5-ff1813c082d2 req-623a26ec-7115-4324-89e3-5caec337e6e4 service nova] Creating event network-vif-plugged:30c2493d-8ce1-4427-abd8-f40405c99430 for instance a178dffd-f620-41c2-b1b5-5ccc1ec52786 on nch2-master-1 Sep 24 21:01:08.593096 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-d926a9ea-65f1-4497-aca5-ff1813c082d2 req-623a26ec-7115-4324-89e3-5caec337e6e4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073970 Sep 24 21:01:08.594058 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1597/3174] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:08.599659 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5c770da3-2be8-4633-b5c4-e149608bc3c6 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:08.600368 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5c770da3-2be8-4633-b5c4-e149608bc3c6 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: cf34d10c-76c3-4798-9a3f-083aeb681fd6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:08.607475 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c770da3-2be8-4633-b5c4-e149608bc3c6 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:08.608228 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c770da3-2be8-4633-b5c4-e149608bc3c6 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:08.608671 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c770da3-2be8-4633-b5c4-e149608bc3c6 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:08.609384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c770da3-2be8-4633-b5c4-e149608bc3c6 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:08.609842 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c770da3-2be8-4633-b5c4-e149608bc3c6 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:08.610939 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c770da3-2be8-4633-b5c4-e149608bc3c6 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:08.626391 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-5c770da3-2be8-4633-b5c4-e149608bc3c6 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] HTTP exception thrown: Instance cf34d10c-76c3-4798-9a3f-083aeb681fd6 could not be found. Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5c770da3-2be8-4633-b5c4-e149608bc3c6 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Request method failure captured: Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 HTTP/1.1 Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL29WDJMBEwAbZTNNByQX5gf7JFR-0Pn6JsCHQCcgluT7fa5T6UuGxNhdMKCqgBFDdS4hxg9HKcrnkFw6evE8RGB9czj5rzhn4xyznU3NEhcpXN89XH8ipoL66wAhqjVEhgZoTZr-QMKKRbLI6Pi6BTJgI0odJ8FBVIZ9cmOHZjPiROQ Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 8c875b2746384d5a9d02548faab6fd5d Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1306216960 Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8c875b2746384d5a9d02548faab6fd5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8c875b2746384d5a9d02548faab6fd5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8c875b2746384d5a9d02548faab6fd5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8c875b2746384d5a9d02548faab6fd5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServerDiskConfigTestJSON-1306216960 Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 8c875b2746384d5a9d02548faab6fd5d Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1306216960 Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServerDiskConfigTestJSON-1306216960-project Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: c84e7493d0ed47aca659dc925e8ca39c Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServerDiskConfigTestJSON-1306216960-project Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance cf34d10c-76c3-4798-9a3f-083aeb681fd6 could not be found. Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'cf34d10c-76c3-4798-9a3f-083aeb681fd6'} Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf34d10c-76c3-4798-9a3f-083aeb681fd6 could not be found. Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf34d10c-76c3-4798-9a3f-083aeb681fd6 could not be found. Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:08.634443 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:08.638466 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:08.638466 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:08.638466 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:08.638466 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:01:08.638466 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:01:08.638466 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf34d10c-76c3-4798-9a3f-083aeb681fd6 could not be found. Sep 24 21:01:08.638466 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:08.638466 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5c770da3-2be8-4633-b5c4-e149608bc3c6 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Returning 404 to user: Instance cf34d10c-76c3-4798-9a3f-083aeb681fd6 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:01:08.638466 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5c770da3-2be8-4633-b5c4-e149608bc3c6 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6" status: 404 len: 111 microversion: 2.1 time: 0.036352 Sep 24 21:01:08.638466 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1598/3175] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:08 2022] GET /compute/v2.1/servers/cf34d10c-76c3-4798-9a3f-083aeb681fd6 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:01:08.643879 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bd6a1840-c4e7-4c56-817c-64e8ef5a3fdb tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:08.644483 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-bd6a1840-c4e7-4c56-817c-64e8ef5a3fdb tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 7c6ee4f7-82b5-4c95-8865-ab81076df04f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:08.651707 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bd6a1840-c4e7-4c56-817c-64e8ef5a3fdb tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:08.652243 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bd6a1840-c4e7-4c56-817c-64e8ef5a3fdb tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:08.652694 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bd6a1840-c4e7-4c56-817c-64e8ef5a3fdb tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:08.655089 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bd6a1840-c4e7-4c56-817c-64e8ef5a3fdb tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:08.655607 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bd6a1840-c4e7-4c56-817c-64e8ef5a3fdb tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:08.656054 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bd6a1840-c4e7-4c56-817c-64e8ef5a3fdb tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:08.674315 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-bd6a1840-c4e7-4c56-817c-64e8ef5a3fdb tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] HTTP exception thrown: Instance 7c6ee4f7-82b5-4c95-8865-ab81076df04f could not be found. Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bd6a1840-c4e7-4c56-817c-64e8ef5a3fdb tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Request method failure captured: Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f HTTP/1.1 Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL2_KTBoQE1biSOdbxiN02s3h0D1W3LZT4KXbL5sweudoA3LIqkhpSDHo_3ElsoW-S4pinCvYVIPwwmg75I3QYjyeUH8E9-UCSOe6Wat6dff2LaBOhzu2fRTo0k0Ryv1Z1NW8ftU_9LakKBqftyUWUBvBSk8oz2eNB_e-v5W7ciYbcII Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 981fdf8ae7524612b9c2f6a3f16c39ec Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 981fdf8ae7524612b9c2f6a3f16c39ec Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-SecurityGroupsTestJSON-321124649-project Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 5ddab9c74c004e74a51fd8008886e542 Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-SecurityGroupsTestJSON-321124649-project Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 7c6ee4f7-82b5-4c95-8865-ab81076df04f could not be found. Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '7c6ee4f7-82b5-4c95-8865-ab81076df04f'} Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c6ee4f7-82b5-4c95-8865-ab81076df04f could not be found. Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c6ee4f7-82b5-4c95-8865-ab81076df04f could not be found. Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:08.675911 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:08.679683 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:08.679683 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:08.679683 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:08.679683 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:01:08.679683 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:01:08.679683 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c6ee4f7-82b5-4c95-8865-ab81076df04f could not be found. Sep 24 21:01:08.679683 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:08.679683 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bd6a1840-c4e7-4c56-817c-64e8ef5a3fdb tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Returning 404 to user: Instance 7c6ee4f7-82b5-4c95-8865-ab81076df04f could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:01:08.679683 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bd6a1840-c4e7-4c56-817c-64e8ef5a3fdb tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f" status: 404 len: 111 microversion: 2.1 time: 0.040521 Sep 24 21:01:08.681706 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1599/3176] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:08 2022] GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:01:08.686681 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3e13e7a8-5a83-46c8-90d3-7be4b700be54 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:08.687191 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3e13e7a8-5a83-46c8-90d3-7be4b700be54 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:08.698000 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-129967ee-10fe-4bf9-a7cd-999cd42cae63 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130] Updating instance_info_cache with network_info: [{"id": "52b5470e-7c8d-4f6a-b42e-9c45da96e2f1", "address": "fa:16:3e:4c:0c:cb", "network": {"id": "b9fc93d3-0ad7-483a-aed0-543890dc0a39", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1279734249-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.7.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d4655b536ca04896993223f34d172298", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap52b5470e-7c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140517) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 24 21:01:08.708857 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3e13e7a8-5a83-46c8-90d3-7be4b700be54 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:08.709438 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3e13e7a8-5a83-46c8-90d3-7be4b700be54 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:08.709923 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3e13e7a8-5a83-46c8-90d3-7be4b700be54 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:08.710727 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3e13e7a8-5a83-46c8-90d3-7be4b700be54 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:08.711238 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3e13e7a8-5a83-46c8-90d3-7be4b700be54 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:08.711676 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3e13e7a8-5a83-46c8-90d3-7be4b700be54 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:08.713848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-129967ee-10fe-4bf9-a7cd-999cd42cae63 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Releasing lock "refresh_cache-547cf9a4-1d05-4cbd-bb2b-ee5cbd406130" {{(pid=140517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 24 21:01:08.714774 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-129967ee-10fe-4bf9-a7cd-999cd42cae63 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "POST /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130/action" status: 202 len: 0 microversion: 2.1 time: 5.056061 Sep 24 21:01:08.719827 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1578/3177] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:01:03 2022] POST /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130/action => generated 0 bytes in 5063 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Sep 24 21:01:08.725598 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a1c21986-f1b1-4ca6-890a-db23f1c34736 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '.version_select at 0x7f4b0c95ad30>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:08.747437 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-3e13e7a8-5a83-46c8-90d3-7be4b700be54 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] HTTP exception thrown: Instance 7021278a-14b3-48a6-a442-5278d7d00fd5 could not be found. Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3e13e7a8-5a83-46c8-90d3-7be4b700be54 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Request method failure captured: Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 HTTP/1.1 Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL29WDJMBEwAbZTNNByQX5gf7JFR-0Pn6JsCHQCcgluT7fa5T6UuGxNhdMKCqgBFDdS4hxg9HKcrnkFw6evE8RGB9czj5rzhn4xyznU3NEhcpXN89XH8ipoL66wAhqjVEhgZoTZr-QMKKRbLI6Pi6BTJgI0odJ8FBVIZ9cmOHZjPiROQ Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 8c875b2746384d5a9d02548faab6fd5d Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1306216960 Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8c875b2746384d5a9d02548faab6fd5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8c875b2746384d5a9d02548faab6fd5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8c875b2746384d5a9d02548faab6fd5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8c875b2746384d5a9d02548faab6fd5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServerDiskConfigTestJSON-1306216960 Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 8c875b2746384d5a9d02548faab6fd5d Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1306216960 Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServerDiskConfigTestJSON-1306216960-project Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: c84e7493d0ed47aca659dc925e8ca39c Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServerDiskConfigTestJSON-1306216960-project Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 7021278a-14b3-48a6-a442-5278d7d00fd5 could not be found. Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '7021278a-14b3-48a6-a442-5278d7d00fd5'} Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7021278a-14b3-48a6-a442-5278d7d00fd5 could not be found. Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:01:08.750216 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:01:08.754324 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7021278a-14b3-48a6-a442-5278d7d00fd5 could not be found. Sep 24 21:01:08.754324 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:08.754324 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:08.754324 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:08.754324 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:08.754324 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:08.754324 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:08.754324 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:01:08.754324 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:01:08.754324 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7021278a-14b3-48a6-a442-5278d7d00fd5 could not be found. Sep 24 21:01:08.754324 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:08.755594 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3e13e7a8-5a83-46c8-90d3-7be4b700be54 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Returning 404 to user: Instance 7021278a-14b3-48a6-a442-5278d7d00fd5 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:01:08.756580 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3e13e7a8-5a83-46c8-90d3-7be4b700be54 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 404 len: 111 microversion: 2.1 time: 0.073840 Sep 24 21:01:08.763856 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1600/3178] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:01:08 2022] DELETE /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:01:08.769112 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-51258eb0-9640-4cd6-9523-a5f7bb9e5d07 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.7.247"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:08.772192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-51258eb0-9640-4cd6-9523-a5f7bb9e5d07 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 5c119929-2744-4871-b523-0a6a05c6c073] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:08.781705 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51258eb0-9640-4cd6-9523-a5f7bb9e5d07 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:08.782651 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51258eb0-9640-4cd6-9523-a5f7bb9e5d07 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:08.783193 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51258eb0-9640-4cd6-9523-a5f7bb9e5d07 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:08.784147 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51258eb0-9640-4cd6-9523-a5f7bb9e5d07 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:08.784722 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51258eb0-9640-4cd6-9523-a5f7bb9e5d07 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:08.785237 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51258eb0-9640-4cd6-9523-a5f7bb9e5d07 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:08.820237 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:01:08.834515 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51258eb0-9640-4cd6-9523-a5f7bb9e5d07 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "refresh_cache-5c119929-2744-4871-b523-0a6a05c6c073" {{(pid=140516) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 24 21:01:08.835030 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51258eb0-9640-4cd6-9523-a5f7bb9e5d07 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquired lock "refresh_cache-5c119929-2744-4871-b523-0a6a05c6c073" {{(pid=140516) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 24 21:01:09.399427 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a1c21986-f1b1-4ca6-890a-db23f1c34736 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/f876d855-6948-4446-a64d-20bd145875d3" status: 202 len: 0 microversion: 2.1 time: 0.678232 Sep 24 21:01:09.401127 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1579/3179] 10.222.0.52 () {58 vars in 1272 bytes} [Sat Sep 24 21:01:08 2022] DELETE /compute/v2.1/os-security-groups/f876d855-6948-4446-a64d-20bd145875d3 => generated 0 bytes in 680 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:01:09.411753 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4240b4b8-caf3-4829-9c5b-3874db56c6b6 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:09.413102 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4240b4b8-caf3-4829-9c5b-3874db56c6b6 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] [instance: 7021278a-14b3-48a6-a442-5278d7d00fd5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:09.432256 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4240b4b8-caf3-4829-9c5b-3874db56c6b6 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:09.434242 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4240b4b8-caf3-4829-9c5b-3874db56c6b6 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:09.441141 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4240b4b8-caf3-4829-9c5b-3874db56c6b6 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:09.442236 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4240b4b8-caf3-4829-9c5b-3874db56c6b6 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:09.444608 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4240b4b8-caf3-4829-9c5b-3874db56c6b6 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:09.446117 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4240b4b8-caf3-4829-9c5b-3874db56c6b6 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:09.478285 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-4240b4b8-caf3-4829-9c5b-3874db56c6b6 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] HTTP exception thrown: Instance 7021278a-14b3-48a6-a442-5278d7d00fd5 could not be found. Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4240b4b8-caf3-4829-9c5b-3874db56c6b6 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Request method failure captured: Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 HTTP/1.1 Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL29WDJMBEwAbZTNNByQX5gf7JFR-0Pn6JsCHQCcgluT7fa5T6UuGxNhdMKCqgBFDdS4hxg9HKcrnkFw6evE8RGB9czj5rzhn4xyznU3NEhcpXN89XH8ipoL66wAhqjVEhgZoTZr-QMKKRbLI6Pi6BTJgI0odJ8FBVIZ9cmOHZjPiROQ Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 8c875b2746384d5a9d02548faab6fd5d Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1306216960 Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8c875b2746384d5a9d02548faab6fd5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8c875b2746384d5a9d02548faab6fd5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8c875b2746384d5a9d02548faab6fd5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8c875b2746384d5a9d02548faab6fd5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServerDiskConfigTestJSON-1306216960 Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 8c875b2746384d5a9d02548faab6fd5d Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1306216960 Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServerDiskConfigTestJSON-1306216960-project Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: c84e7493d0ed47aca659dc925e8ca39c Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServerDiskConfigTestJSON-1306216960-project Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 7021278a-14b3-48a6-a442-5278d7d00fd5 could not be found. Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '7021278a-14b3-48a6-a442-5278d7d00fd5'} Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7021278a-14b3-48a6-a442-5278d7d00fd5 could not be found. Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7021278a-14b3-48a6-a442-5278d7d00fd5 could not be found. Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:09.496078 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:01:09.499964 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:09.499964 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:09.499964 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:09.499964 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:01:09.499964 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:01:09.499964 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7021278a-14b3-48a6-a442-5278d7d00fd5 could not be found. Sep 24 21:01:09.499964 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:01:09.504718 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4240b4b8-caf3-4829-9c5b-3874db56c6b6 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] Returning 404 to user: Instance 7021278a-14b3-48a6-a442-5278d7d00fd5 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:01:09.509448 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4240b4b8-caf3-4829-9c5b-3874db56c6b6 tempest-ServerDiskConfigTestJSON-1306216960 tempest-ServerDiskConfigTestJSON-1306216960-project] 10.222.0.52 "GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5" status: 404 len: 111 microversion: 2.1 time: 0.103813 Sep 24 21:01:09.510740 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1580/3180] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:09 2022] GET /compute/v2.1/servers/7021278a-14b3-48a6-a442-5278d7d00fd5 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:01:09.521101 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d4a7e6bd-dfdd-4c63-b5c6-b02e4dae7cd5 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:09.525142 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d4a7e6bd-dfdd-4c63-b5c6-b02e4dae7cd5 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] [instance: a178dffd-f620-41c2-b1b5-5ccc1ec52786] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:09.536892 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d4a7e6bd-dfdd-4c63-b5c6-b02e4dae7cd5 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:09.543402 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d4a7e6bd-dfdd-4c63-b5c6-b02e4dae7cd5 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:09.544596 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d4a7e6bd-dfdd-4c63-b5c6-b02e4dae7cd5 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:09.546354 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d4a7e6bd-dfdd-4c63-b5c6-b02e4dae7cd5 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:09.547127 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d4a7e6bd-dfdd-4c63-b5c6-b02e4dae7cd5 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:09.547921 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d4a7e6bd-dfdd-4c63-b5c6-b02e4dae7cd5 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:09.971275 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d4a7e6bd-dfdd-4c63-b5c6-b02e4dae7cd5 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c49bed91bb437087a8ad2d865c2647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b68f292633a49ca82fb05d18ea83142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:09.985728 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d4a7e6bd-dfdd-4c63-b5c6-b02e4dae7cd5 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] 10.222.0.52 "GET /compute/v2.1/servers/a178dffd-f620-41c2-b1b5-5ccc1ec52786" status: 200 len: 1320 microversion: 2.1 time: 0.472793 Sep 24 21:01:10.003314 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1581/3181] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:09 2022] GET /compute/v2.1/servers/a178dffd-f620-41c2-b1b5-5ccc1ec52786 => generated 1320 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:10.009637 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d0d34b75-3722-4b02-acad-3652f62e726e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:10.012754 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d0d34b75-3722-4b02-acad-3652f62e726e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:10.020621 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d0d34b75-3722-4b02-acad-3652f62e726e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:10.021311 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d0d34b75-3722-4b02-acad-3652f62e726e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:10.021863 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d0d34b75-3722-4b02-acad-3652f62e726e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:10.022771 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d0d34b75-3722-4b02-acad-3652f62e726e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:10.023567 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d0d34b75-3722-4b02-acad-3652f62e726e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:10.024168 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d0d34b75-3722-4b02-acad-3652f62e726e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:10.063250 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d0d34b75-3722-4b02-acad-3652f62e726e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.058045 Sep 24 21:01:10.064487 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1582/3182] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:01:10 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:01:10.071162 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-e1c0c93f-3f1c-4713-8969-d57e3f56f23c req-b430358b-1aa9-4e40-a50a-87c91a9cd208 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "547cf9a4-1d05-4cbd-bb2b-ee5cbd406130", "tag": "52b5470e-7c8d-4f6a-b42e-9c45da96e2f1"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:10.080957 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e1c0c93f-3f1c-4713-8969-d57e3f56f23c req-b430358b-1aa9-4e40-a50a-87c91a9cd208 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:10.081571 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e1c0c93f-3f1c-4713-8969-d57e3f56f23c req-b430358b-1aa9-4e40-a50a-87c91a9cd208 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:10.082171 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e1c0c93f-3f1c-4713-8969-d57e3f56f23c req-b430358b-1aa9-4e40-a50a-87c91a9cd208 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:10.100590 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-e1c0c93f-3f1c-4713-8969-d57e3f56f23c req-b430358b-1aa9-4e40-a50a-87c91a9cd208 service nova] Creating event network-changed:52b5470e-7c8d-4f6a-b42e-9c45da96e2f1 for instance 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130 on nch2-master-1 Sep 24 21:01:10.110014 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-e1c0c93f-3f1c-4713-8969-d57e3f56f23c req-b430358b-1aa9-4e40-a50a-87c91a9cd208 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043591 Sep 24 21:01:10.110956 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1583/3183] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:10.116296 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1e3bdda3-9ffc-466b-96c9-ad83955c2fc8 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:10.117675 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1e3bdda3-9ffc-466b-96c9-ad83955c2fc8 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:10.129395 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e3bdda3-9ffc-466b-96c9-ad83955c2fc8 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:10.129595 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e3bdda3-9ffc-466b-96c9-ad83955c2fc8 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:10.131826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e3bdda3-9ffc-466b-96c9-ad83955c2fc8 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:10.131826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e3bdda3-9ffc-466b-96c9-ad83955c2fc8 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:10.131826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e3bdda3-9ffc-466b-96c9-ad83955c2fc8 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:10.131826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e3bdda3-9ffc-466b-96c9-ad83955c2fc8 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:10.191073 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e3bdda3-9ffc-466b-96c9-ad83955c2fc8 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:10.191901 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e3bdda3-9ffc-466b-96c9-ad83955c2fc8 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:10.195296 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e3bdda3-9ffc-466b-96c9-ad83955c2fc8 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:10.196010 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-1e3bdda3-9ffc-466b-96c9-ad83955c2fc8 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lazy-loading 'fault' on Instance uuid 1d8bc459-871f-4611-ba95-7bf7d0f08a27 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:01:10.289087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1e3bdda3-9ffc-466b-96c9-ad83955c2fc8 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:10.302399 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1e3bdda3-9ffc-466b-96c9-ad83955c2fc8 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:10.304853 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1e3bdda3-9ffc-466b-96c9-ad83955c2fc8 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3566666c11ed499da3b3d90c080a883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b1ace927fb4587a79ac147f5aa7df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:10.322406 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1e3bdda3-9ffc-466b-96c9-ad83955c2fc8 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 200 len: 1448 microversion: 2.75 time: 0.210113 Sep 24 21:01:10.324191 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1584/3184] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:01:10 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 1448 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:01:10.338522 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4b7b8c67-1e70-42be-958b-ff859e533248 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '.version_select at 0x7f4b0c767b80>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:11.310458 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4b7b8c67-1e70-42be-958b-ff859e533248 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/5e70f14d-7785-4f72-a62d-d4ac6c3b9747" status: 202 len: 0 microversion: 2.1 time: 0.977462 Sep 24 21:01:11.311861 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1585/3185] 10.222.0.52 () {58 vars in 1272 bytes} [Sat Sep 24 21:01:10 2022] DELETE /compute/v2.1/os-security-groups/5e70f14d-7785-4f72-a62d-d4ac6c3b9747 => generated 0 bytes in 980 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:01:11.322916 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5a987ef5-db1b-4dad-b9aa-ea27d5d25e28 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:11.323826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5a987ef5-db1b-4dad-b9aa-ea27d5d25e28 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:11.333545 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5a987ef5-db1b-4dad-b9aa-ea27d5d25e28 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:11.334362 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5a987ef5-db1b-4dad-b9aa-ea27d5d25e28 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:11.335173 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5a987ef5-db1b-4dad-b9aa-ea27d5d25e28 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:11.336374 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5a987ef5-db1b-4dad-b9aa-ea27d5d25e28 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:11.337208 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5a987ef5-db1b-4dad-b9aa-ea27d5d25e28 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:11.337964 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5a987ef5-db1b-4dad-b9aa-ea27d5d25e28 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:12.006168 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5a987ef5-db1b-4dad-b9aa-ea27d5d25e28 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:12.023993 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5a987ef5-db1b-4dad-b9aa-ea27d5d25e28 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 200 len: 1449 microversion: 2.1 time: 0.710154 Sep 24 21:01:12.030571 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1586/3186] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:11 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 1449 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:12.039541 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-a69f66fd-8309-4c95-b825-ca72b2a5232d req-29aea48c-cccc-4b82-960e-65b3fd395fa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c660bb73-2186-4c86-b57b-0c6c3be5c9bf", "name": "network-vif-plugged", "status": "completed", "tag": "3c3743a2-0126-4864-bed2-ea84c10b230a"}, {"server_uuid": "9c96f88e-1327-49e3-8e9a-5417f96fb308", "name": "network-vif-unplugged", "status": "completed", "tag": "f8825c51-2e9d-4429-9259-cd32e621d907"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:12.052497 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-a69f66fd-8309-4c95-b825-ca72b2a5232d req-29aea48c-cccc-4b82-960e-65b3fd395fa8 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:12.053999 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-a69f66fd-8309-4c95-b825-ca72b2a5232d req-29aea48c-cccc-4b82-960e-65b3fd395fa8 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:12.055690 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-a69f66fd-8309-4c95-b825-ca72b2a5232d req-29aea48c-cccc-4b82-960e-65b3fd395fa8 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:12.070781 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-a69f66fd-8309-4c95-b825-ca72b2a5232d req-29aea48c-cccc-4b82-960e-65b3fd395fa8 service nova] Creating event network-vif-plugged:3c3743a2-0126-4864-bed2-ea84c10b230a for instance c660bb73-2186-4c86-b57b-0c6c3be5c9bf on nch2-master-1 Sep 24 21:01:12.071694 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.compute.server_external_events [req-a69f66fd-8309-4c95-b825-ca72b2a5232d req-29aea48c-cccc-4b82-960e-65b3fd395fa8 service nova] Unable to find a host for instance 9c96f88e-1327-49e3-8e9a-5417f96fb308. Dropping event network-vif-unplugged {{(pid=140517) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 24 21:01:12.078006 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-a69f66fd-8309-4c95-b825-ca72b2a5232d req-29aea48c-cccc-4b82-960e-65b3fd395fa8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 353 microversion: 2.1 time: 0.045706 Sep 24 21:01:12.079347 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1587/3187] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 353 bytes in 48 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 24 21:01:12.086405 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ff09a066-8c24-4ca1-b3f8-6560e3a9d675 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:12.087357 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ff09a066-8c24-4ca1-b3f8-6560e3a9d675 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] [instance: a178dffd-f620-41c2-b1b5-5ccc1ec52786] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:12.096249 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff09a066-8c24-4ca1-b3f8-6560e3a9d675 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:12.096892 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff09a066-8c24-4ca1-b3f8-6560e3a9d675 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:12.097337 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff09a066-8c24-4ca1-b3f8-6560e3a9d675 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:12.098214 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff09a066-8c24-4ca1-b3f8-6560e3a9d675 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:12.098716 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff09a066-8c24-4ca1-b3f8-6560e3a9d675 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:12.099332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff09a066-8c24-4ca1-b3f8-6560e3a9d675 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:12.394030 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ff09a066-8c24-4ca1-b3f8-6560e3a9d675 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c49bed91bb437087a8ad2d865c2647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b68f292633a49ca82fb05d18ea83142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:12.407140 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ff09a066-8c24-4ca1-b3f8-6560e3a9d675 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] 10.222.0.52 "GET /compute/v2.1/servers/a178dffd-f620-41c2-b1b5-5ccc1ec52786" status: 200 len: 1507 microversion: 2.1 time: 0.326277 Sep 24 21:01:12.412602 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1588/3188] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:12 2022] GET /compute/v2.1/servers/a178dffd-f620-41c2-b1b5-5ccc1ec52786 => generated 1507 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:12.423854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e870c666-737c-4eb2-bd0c-ae8a931a6270 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:12.430702 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e870c666-737c-4eb2-bd0c-ae8a931a6270 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:12.442905 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e870c666-737c-4eb2-bd0c-ae8a931a6270 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:12.443413 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e870c666-737c-4eb2-bd0c-ae8a931a6270 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:12.443870 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e870c666-737c-4eb2-bd0c-ae8a931a6270 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:12.444581 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e870c666-737c-4eb2-bd0c-ae8a931a6270 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:12.445051 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e870c666-737c-4eb2-bd0c-ae8a931a6270 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:12.445491 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e870c666-737c-4eb2-bd0c-ae8a931a6270 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:12.489611 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e870c666-737c-4eb2-bd0c-ae8a931a6270 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.075848 Sep 24 21:01:12.491102 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1589/3189] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:01:12 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:01:12.496154 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-62d5f449-574d-4b10-ab9f-91b0b7e90e8f tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Action: 'create', calling method: .version_select at 0x7f4b0c95a670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-423891867", "description": "tempest-description-485056089"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:13.100538 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-62d5f449-574d-4b10-ab9f-91b0b7e90e8f tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.606714 Sep 24 21:01:13.102792 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1590/3190] 10.222.0.52 () {60 vars in 1180 bytes} [Sat Sep 24 21:01:12 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:13.111417 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-44ed2d88-24d8-406f-9bb0-c652172050a0 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:13.112085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-44ed2d88-24d8-406f-9bb0-c652172050a0 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] [instance: 1d8bc459-871f-4611-ba95-7bf7d0f08a27] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:13.129414 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-44ed2d88-24d8-406f-9bb0-c652172050a0 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:13.132750 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-44ed2d88-24d8-406f-9bb0-c652172050a0 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:13.133396 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-44ed2d88-24d8-406f-9bb0-c652172050a0 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:13.134489 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-44ed2d88-24d8-406f-9bb0-c652172050a0 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:13.134999 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-44ed2d88-24d8-406f-9bb0-c652172050a0 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:13.135433 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-44ed2d88-24d8-406f-9bb0-c652172050a0 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:13.162942 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-44ed2d88-24d8-406f-9bb0-c652172050a0 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] HTTP exception thrown: Instance 1d8bc459-871f-4611-ba95-7bf7d0f08a27 could not be found. Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-44ed2d88-24d8-406f-9bb0-c652172050a0 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Request method failure captured: Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 HTTP/1.1 Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL2-1N9NHvk0GA8tOpVo50ZWvyMO2FfrPJ1cBz_7gWQJJsWKB7uVNPV4bB5QIOnJ4y3sBF6lF5wAziFrmF-o7R5q3CsPoeAog3LBt0be2vLkHMkw7erygVFMp_xVtXT9wTbrNge-kLOxJ4ccQyvV1AGBm3envKmlbOOmgjuJqKaFvRqY Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: X-Openstack-Nova-Api-Version: 2.75 Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 82b1ace927fb4587a79ac147f5aa7df6 Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersAdmin275Test-1942380847 Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/82b1ace927fb4587a79ac147f5aa7df6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_82b1ace927fb4587a79ac147f5aa7df6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/82b1ace927fb4587a79ac147f5aa7df6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/82b1ace927fb4587a79ac147f5aa7df6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersAdmin275Test-1942380847 Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 82b1ace927fb4587a79ac147f5aa7df6 Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersAdmin275Test-1942380847 Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersAdmin275Test-1942380847-project Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 3566666c11ed499da3b3d90c080a883c Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersAdmin275Test-1942380847-project Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 1d8bc459-871f-4611-ba95-7bf7d0f08a27 could not be found. Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '1d8bc459-871f-4611-ba95-7bf7d0f08a27'} Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d8bc459-871f-4611-ba95-7bf7d0f08a27 could not be found. Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d8bc459-871f-4611-ba95-7bf7d0f08a27 could not be found. Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:13.166543 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:01:13.173452 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:13.173452 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:13.173452 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:13.173452 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:01:13.173452 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:01:13.173452 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d8bc459-871f-4611-ba95-7bf7d0f08a27 could not be found. Sep 24 21:01:13.173452 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:01:13.176089 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-44ed2d88-24d8-406f-9bb0-c652172050a0 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] Returning 404 to user: Instance 1d8bc459-871f-4611-ba95-7bf7d0f08a27 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:01:13.177343 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-44ed2d88-24d8-406f-9bb0-c652172050a0 tempest-ServersAdmin275Test-1942380847 tempest-ServersAdmin275Test-1942380847-project] 10.222.0.52 "GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27" status: 404 len: 111 microversion: 2.75 time: 0.073656 Sep 24 21:01:13.179173 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1591/3191] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:01:13 2022] GET /compute/v2.1/servers/1d8bc459-871f-4611-ba95-7bf7d0f08a27 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:01:13.187679 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d8962fae-b720-4dd3-8098-d3e5d8cf77f1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:13.188701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d8962fae-b720-4dd3-8098-d3e5d8cf77f1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:13.191633 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:01:13.197886 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d8962fae-b720-4dd3-8098-d3e5d8cf77f1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:13.199155 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d8962fae-b720-4dd3-8098-d3e5d8cf77f1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:13.199856 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d8962fae-b720-4dd3-8098-d3e5d8cf77f1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:13.200946 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d8962fae-b720-4dd3-8098-d3e5d8cf77f1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:13.202230 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d8962fae-b720-4dd3-8098-d3e5d8cf77f1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:13.202979 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d8962fae-b720-4dd3-8098-d3e5d8cf77f1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:13.252846 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d8962fae-b720-4dd3-8098-d3e5d8cf77f1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:01:13.267302 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.compute.api [None req-d8962fae-b720-4dd3-8098-d3e5d8cf77f1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Working on deleting snapshot 1819b745-bbdd-4dac-9e5b-c1a7b3cfcd28 from shelved instance... Sep 24 21:01:14.434572 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:01:14.565988 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d8962fae-b720-4dd3-8098-d3e5d8cf77f1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Doing local delete in cell 788aecb6-32dc-4b71-909a-be050455aded(cell1) {{(pid=140517) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 24 21:01:14.568248 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d8962fae-b720-4dd3-8098-d3e5d8cf77f1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:14.568957 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d8962fae-b720-4dd3-8098-d3e5d8cf77f1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:14.569636 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d8962fae-b720-4dd3-8098-d3e5d8cf77f1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:14.570395 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.compute.api [None req-d8962fae-b720-4dd3-8098-d3e5d8cf77f1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 24 21:01:14.578913 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-d8962fae-b720-4dd3-8098-d3e5d8cf77f1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] deallocate_for_instance() {{(pid=140517) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 24 21:01:14.963886 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.network.neutron [None req-51258eb0-9640-4cd6-9523-a5f7bb9e5d07 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 5c119929-2744-4871-b523-0a6a05c6c073] re-assign floating IP 172.35.7.247 from instance 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130 Sep 24 21:01:14.988068 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-51258eb0-9640-4cd6-9523-a5f7bb9e5d07 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130] Building network info cache for instance {{(pid=140516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 24 21:01:15.928949 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-d8962fae-b720-4dd3-8098-d3e5d8cf77f1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Updating instance_info_cache with network_info: [] {{(pid=140517) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 24 21:01:16.583373 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d8962fae-b720-4dd3-8098-d3e5d8cf77f1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 204 len: 0 microversion: 2.1 time: 3.402704 Sep 24 21:01:16.587873 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1592/3192] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:01:13 2022] DELETE /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 0 bytes in 3404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:01:16.595725 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-054e60b0-9f9c-49ff-a903-971e21c42191 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:16.596450 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-054e60b0-9f9c-49ff-a903-971e21c42191 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] [instance: c660bb73-2186-4c86-b57b-0c6c3be5c9bf] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:16.604592 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-054e60b0-9f9c-49ff-a903-971e21c42191 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:16.604945 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-054e60b0-9f9c-49ff-a903-971e21c42191 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:16.605451 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-054e60b0-9f9c-49ff-a903-971e21c42191 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:16.606301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-054e60b0-9f9c-49ff-a903-971e21c42191 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:16.608557 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-054e60b0-9f9c-49ff-a903-971e21c42191 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:16.609430 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-054e60b0-9f9c-49ff-a903-971e21c42191 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:17.031657 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-51258eb0-9640-4cd6-9523-a5f7bb9e5d07 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130] Updating instance_info_cache with network_info: [{"id": "52b5470e-7c8d-4f6a-b42e-9c45da96e2f1", "address": "fa:16:3e:4c:0c:cb", "network": {"id": "b9fc93d3-0ad7-483a-aed0-543890dc0a39", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1279734249-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d4655b536ca04896993223f34d172298", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap52b5470e-7c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 24 21:01:17.055650 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-51258eb0-9640-4cd6-9523-a5f7bb9e5d07 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 5c119929-2744-4871-b523-0a6a05c6c073] Building network info cache for instance {{(pid=140516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 24 21:01:17.198770 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-054e60b0-9f9c-49ff-a903-971e21c42191 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c49bed91bb437087a8ad2d865c2647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b68f292633a49ca82fb05d18ea83142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:17.221389 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-054e60b0-9f9c-49ff-a903-971e21c42191 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] 10.222.0.52 "GET /compute/v2.1/servers/c660bb73-2186-4c86-b57b-0c6c3be5c9bf" status: 200 len: 1508 microversion: 2.1 time: 0.631645 Sep 24 21:01:17.222225 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1593/3193] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:16 2022] GET /compute/v2.1/servers/c660bb73-2186-4c86-b57b-0c6c3be5c9bf => generated 1508 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:17.237970 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-70c1ef37-03e8-4097-8fba-3f7c7ee1305c tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Action: 'update', calling method: .version_select at 0x7f4b0c9103a0>, body: {"security_group": {"name": "tempest-sg-hth-322068551", "description": "tempest-description-hth-1380735301"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:17.605618 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-70c1ef37-03e8-4097-8fba-3f7c7ee1305c tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "PUT /compute/v2.1/os-security-groups/f9813839-24ce-4511-a8f5-cab8b04c7382" status: 200 len: 217 microversion: 2.1 time: 0.377822 Sep 24 21:01:17.616123 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1594/3194] 10.222.0.52 () {60 vars in 1290 bytes} [Sat Sep 24 21:01:17 2022] PUT /compute/v2.1/os-security-groups/f9813839-24ce-4511-a8f5-cab8b04c7382 => generated 217 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:17.622213 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-90c684c0-19a1-43c1-93db-d10110920f25 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:17.626696 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-90c684c0-19a1-43c1-93db-d10110920f25 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:17.638987 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-90c684c0-19a1-43c1-93db-d10110920f25 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:17.639491 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-90c684c0-19a1-43c1-93db-d10110920f25 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:17.639943 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-90c684c0-19a1-43c1-93db-d10110920f25 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:17.640661 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-90c684c0-19a1-43c1-93db-d10110920f25 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:17.646203 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-90c684c0-19a1-43c1-93db-d10110920f25 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:17.646870 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-90c684c0-19a1-43c1-93db-d10110920f25 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:17.692792 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-90c684c0-19a1-43c1-93db-d10110920f25 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.075247 Sep 24 21:01:17.697417 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1595/3195] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:01:17 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:01:17.698435 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b486d3dc-7ed4-4f40-b52e-a079dd62327c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:17.699130 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b486d3dc-7ed4-4f40-b52e-a079dd62327c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:17.706179 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b486d3dc-7ed4-4f40-b52e-a079dd62327c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:17.706767 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b486d3dc-7ed4-4f40-b52e-a079dd62327c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:17.707545 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b486d3dc-7ed4-4f40-b52e-a079dd62327c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:17.708422 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b486d3dc-7ed4-4f40-b52e-a079dd62327c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:17.709047 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b486d3dc-7ed4-4f40-b52e-a079dd62327c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:17.709641 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b486d3dc-7ed4-4f40-b52e-a079dd62327c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:17.936875 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b486d3dc-7ed4-4f40-b52e-a079dd62327c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:17.945274 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b486d3dc-7ed4-4f40-b52e-a079dd62327c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.250516 Sep 24 21:01:17.945894 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1596/3196] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:17 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:17.950707 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-465479b0-71cc-48af-8330-8b28ef7d25f8 req-ad830a95-5400-4c62-acab-cb82445c0901 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "547cf9a4-1d05-4cbd-bb2b-ee5cbd406130", "tag": "52b5470e-7c8d-4f6a-b42e-9c45da96e2f1"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:17.960155 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-465479b0-71cc-48af-8330-8b28ef7d25f8 req-ad830a95-5400-4c62-acab-cb82445c0901 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:17.960863 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-465479b0-71cc-48af-8330-8b28ef7d25f8 req-ad830a95-5400-4c62-acab-cb82445c0901 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:17.961460 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-465479b0-71cc-48af-8330-8b28ef7d25f8 req-ad830a95-5400-4c62-acab-cb82445c0901 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:17.973368 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-465479b0-71cc-48af-8330-8b28ef7d25f8 req-ad830a95-5400-4c62-acab-cb82445c0901 service nova] Creating event network-changed:52b5470e-7c8d-4f6a-b42e-9c45da96e2f1 for instance 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130 on nch2-master-1 Sep 24 21:01:17.979440 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-465479b0-71cc-48af-8330-8b28ef7d25f8 req-ad830a95-5400-4c62-acab-cb82445c0901 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032168 Sep 24 21:01:17.980519 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1597/3197] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:17.986684 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-45b9aff4-9ce6-41c5-b35b-c8a8e6256dd5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:17.987589 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-45b9aff4-9ce6-41c5-b35b-c8a8e6256dd5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:17.994228 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45b9aff4-9ce6-41c5-b35b-c8a8e6256dd5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:17.994766 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45b9aff4-9ce6-41c5-b35b-c8a8e6256dd5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:17.995213 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45b9aff4-9ce6-41c5-b35b-c8a8e6256dd5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:17.995922 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45b9aff4-9ce6-41c5-b35b-c8a8e6256dd5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:17.996383 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45b9aff4-9ce6-41c5-b35b-c8a8e6256dd5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:17.996821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45b9aff4-9ce6-41c5-b35b-c8a8e6256dd5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:18.014658 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-45b9aff4-9ce6-41c5-b35b-c8a8e6256dd5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] HTTP exception thrown: Instance 9c96f88e-1327-49e3-8e9a-5417f96fb308 could not be found. Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-45b9aff4-9ce6-41c5-b35b-c8a8e6256dd5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Request method failure captured: Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 HTTP/1.1 Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL29-X0U31bWS-OdLHgyvrqJ9cKeXdCQcU5XDw5ndql8wo4-9uoBN2em1wysBqNzzzY5Bp3FNsC7GdcmIawuHD1dS6A2amzvS90hoLHvMsCDbASCEoRJt0wxOm48tnGq2wGlMnRgEB8mO_grzOCcTdRgOgaHbZsmHcINVEnjYdvyWtzs Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 8340f7f8fa9848dc822903c738f78f2a Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 8340f7f8fa9848dc822903c738f78f2a Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-DeleteServersTestJSON-1814924671-project Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: ee21da3ff38a43798bce50c9aba4ae33 Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-DeleteServersTestJSON-1814924671-project Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 9c96f88e-1327-49e3-8e9a-5417f96fb308 could not be found. Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '9c96f88e-1327-49e3-8e9a-5417f96fb308'} Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c96f88e-1327-49e3-8e9a-5417f96fb308 could not be found. Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c96f88e-1327-49e3-8e9a-5417f96fb308 could not be found. Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:18.016248 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:01:18.020311 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:18.020311 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:18.020311 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:18.020311 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:01:18.020311 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:01:18.020311 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c96f88e-1327-49e3-8e9a-5417f96fb308 could not be found. Sep 24 21:01:18.020311 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:01:18.020311 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-45b9aff4-9ce6-41c5-b35b-c8a8e6256dd5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Returning 404 to user: Instance 9c96f88e-1327-49e3-8e9a-5417f96fb308 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:01:18.020311 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-45b9aff4-9ce6-41c5-b35b-c8a8e6256dd5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 404 len: 111 microversion: 2.1 time: 0.035919 Sep 24 21:01:18.020311 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1598/3198] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:17 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:01:18.023119 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-217f14cf-0d41-43e4-b11f-8905d49233a4 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:18.023622 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-217f14cf-0d41-43e4-b11f-8905d49233a4 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] [instance: c660bb73-2186-4c86-b57b-0c6c3be5c9bf] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:18.030664 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-217f14cf-0d41-43e4-b11f-8905d49233a4 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:18.031366 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-217f14cf-0d41-43e4-b11f-8905d49233a4 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:18.031977 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-217f14cf-0d41-43e4-b11f-8905d49233a4 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:18.033101 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-217f14cf-0d41-43e4-b11f-8905d49233a4 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:18.033711 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-217f14cf-0d41-43e4-b11f-8905d49233a4 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:18.034464 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-217f14cf-0d41-43e4-b11f-8905d49233a4 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:18.087721 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-217f14cf-0d41-43e4-b11f-8905d49233a4 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] [instance: c660bb73-2186-4c86-b57b-0c6c3be5c9bf] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:01:18.096766 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-51258eb0-9640-4cd6-9523-a5f7bb9e5d07 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 5c119929-2744-4871-b523-0a6a05c6c073] Updating instance_info_cache with network_info: [{"id": "328bc618-9c61-46b1-a53c-716485f1d492", "address": "fa:16:3e:92:c4:87", "network": {"id": "b9fc93d3-0ad7-483a-aed0-543890dc0a39", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1279734249-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.7.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d4655b536ca04896993223f34d172298", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap328bc618-9c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 24 21:01:18.125639 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51258eb0-9640-4cd6-9523-a5f7bb9e5d07 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Releasing lock "refresh_cache-5c119929-2744-4871-b523-0a6a05c6c073" {{(pid=140516) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 24 21:01:18.128672 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-51258eb0-9640-4cd6-9523-a5f7bb9e5d07 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "POST /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073/action" status: 202 len: 0 microversion: 2.1 time: 9.362325 Sep 24 21:01:18.131611 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1601/3199] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:01:08 2022] POST /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073/action => generated 0 bytes in 9367 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 24 21:01:18.147240 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-89061188-e6c0-4ad9-825a-5fc60e90ec71 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '.version_select at 0x7f4b0c5ff1f0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:18.219891 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-217f14cf-0d41-43e4-b11f-8905d49233a4 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c660bb73-2186-4c86-b57b-0c6c3be5c9bf" status: 204 len: 0 microversion: 2.1 time: 0.197661 Sep 24 21:01:18.225825 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1599/3200] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:01:18 2022] DELETE /compute/v2.1/servers/c660bb73-2186-4c86-b57b-0c6c3be5c9bf => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:01:18.244135 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-89061188-e6c0-4ad9-825a-5fc60e90ec71 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/f9813839-24ce-4511-a8f5-cab8b04c7382" status: 200 len: 217 microversion: 2.1 time: 0.111195 Sep 24 21:01:18.244757 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1602/3201] 10.222.0.52 () {58 vars in 1269 bytes} [Sat Sep 24 21:01:18 2022] GET /compute/v2.1/os-security-groups/f9813839-24ce-4511-a8f5-cab8b04c7382 => generated 217 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:18.250454 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-40750f12-8697-4e32-8241-17633cbba62e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-738502456"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:18.253893 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-40750f12-8697-4e32-8241-17633cbba62e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:18.263113 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40750f12-8697-4e32-8241-17633cbba62e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:18.263751 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40750f12-8697-4e32-8241-17633cbba62e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:18.264668 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40750f12-8697-4e32-8241-17633cbba62e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:18.265990 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40750f12-8697-4e32-8241-17633cbba62e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:18.266463 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40750f12-8697-4e32-8241-17633cbba62e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:18.266943 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40750f12-8697-4e32-8241-17633cbba62e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:18.489096 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-40750f12-8697-4e32-8241-17633cbba62e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "POST /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/action" status: 202 len: 0 microversion: 2.1 time: 0.242776 Sep 24 21:01:18.492824 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1603/3202] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:01:18 2022] POST /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 24 21:01:18.506055 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-caca5f41-96b8-4219-9cd7-9a96d4164bea tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Action: 'action', calling method: .version_select at 0x7f4b0e2eed30>, body: {"removeFloatingIp": {"address": "172.35.7.247"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:18.578241 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fc73cfaf-44d3-4540-8c0a-5ef4e28850ab tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] Action: 'create', calling method: .version_select at 0x7f4b07ed68b0>, body: {"keypair": {"name": "tempest-keypair-591572616", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbptPXsUrW7IQm8HwV0JlqLFMQTuxVVR8lNf519dN16Hf1mm9Qt8lTIVoml4WlGHnjVtVon6LFOGBrLvTKCDh5ArwlmLSQa4wajORGsiXGMjfVpMOB4fDZLQqreiuiZJA=="}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:18.596084 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-fc73cfaf-44d3-4540-8c0a-5ef4e28850ab tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] Getting quotas for project 212a64f6557143739a2f3d232127ccbf. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:01:18.602579 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-fc73cfaf-44d3-4540-8c0a-5ef4e28850ab tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] Getting quotas for user 4a0e7b0511294f0d95ee52d8dacd6446 and project 212a64f6557143739a2f3d232127ccbf. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:01:18.635625 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fc73cfaf-44d3-4540-8c0a-5ef4e28850ab tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.409224 Sep 24 21:01:18.638857 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1600/3203] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 21:01:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:18.644848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-d5f87ac4-db1a-4010-8556-3ea7fcd5bf71 req-ba382b2d-8809-4b0c-997d-f7bbcdea6d1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d546302-deb3-47c6-b9fd-3155ced00883", "name": "network-vif-unplugged", "status": "completed", "tag": "56949465-71b8-45bb-b1d2-4b934bfc9714"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:18.660822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-d5f87ac4-db1a-4010-8556-3ea7fcd5bf71 req-ba382b2d-8809-4b0c-997d-f7bbcdea6d1f service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:18.661849 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-d5f87ac4-db1a-4010-8556-3ea7fcd5bf71 req-ba382b2d-8809-4b0c-997d-f7bbcdea6d1f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:18.662268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-d5f87ac4-db1a-4010-8556-3ea7fcd5bf71 req-ba382b2d-8809-4b0c-997d-f7bbcdea6d1f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:18.663466 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-caca5f41-96b8-4219-9cd7-9a96d4164bea tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 5c119929-2744-4871-b523-0a6a05c6c073] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:18.665467 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:01:18.672723 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-caca5f41-96b8-4219-9cd7-9a96d4164bea tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:18.673487 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-caca5f41-96b8-4219-9cd7-9a96d4164bea tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:18.674336 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-caca5f41-96b8-4219-9cd7-9a96d4164bea tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:18.675629 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-caca5f41-96b8-4219-9cd7-9a96d4164bea tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:18.676122 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-d5f87ac4-db1a-4010-8556-3ea7fcd5bf71 req-ba382b2d-8809-4b0c-997d-f7bbcdea6d1f service nova] Creating event network-vif-unplugged:56949465-71b8-45bb-b1d2-4b934bfc9714 for instance 0d546302-deb3-47c6-b9fd-3155ced00883 on nch1-master-1 Sep 24 21:01:18.676710 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-caca5f41-96b8-4219-9cd7-9a96d4164bea tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:18.677147 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-caca5f41-96b8-4219-9cd7-9a96d4164bea tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:18.681260 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-d5f87ac4-db1a-4010-8556-3ea7fcd5bf71 req-ba382b2d-8809-4b0c-997d-f7bbcdea6d1f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040925 Sep 24 21:01:18.682027 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1601/3204] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:18.687338 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-93eea7fc-3629-4414-8d7e-a3495daa3db8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-291439294", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "1d2fee0c-2b4a-497a-b4e0-a76edfbd4190"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:18.752242 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-93eea7fc-3629-4414-8d7e-a3495daa3db8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] validate_networks() for [('1d2fee0c-2b4a-497a-b4e0-a76edfbd4190', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:01:19.044306 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-caca5f41-96b8-4219-9cd7-9a96d4164bea tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] HTTP exception thrown: Floating IP 172.35.7.247 is not associated with instance 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130. Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-caca5f41-96b8-4219-9cd7-9a96d4164bea tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Request method failure captured: Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130/action HTTP/1.1 Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 49 Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL2_h-Z8Mxd5ivJvUeu-nilEC6fPGB9S2d4aX0ajB7leDARAd7Et7YiLKQ5tPWl4ARe0MFMUuqOPXo4MeDKAbIrnGGcVBa61Br-WWVhKviEFGtP0vuLwt56unMyYSSykXNc3sfP0YClEz09E4oRBLkG4XSmynhYSEJre7LO8YfgpSiOI Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: d4655b536ca04896993223f34d172298 Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-315733725 Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d4655b536ca04896993223f34d172298"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d4655b536ca04896993223f34d172298"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d4655b536ca04896993223f34d172298"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d4655b536ca04896993223f34d172298"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-315733725 Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: d4655b536ca04896993223f34d172298 Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-315733725 Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-FloatingIPsAssociationTestJSON-315733725-project Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: f41f618458eb48f6bb4631fd254addc0 Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-315733725-project Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: {"removeFloatingIp": {"address": "172.35.7.247"}} Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: exception: Floating IP 172.35.7.247 is not associated with instance 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130. Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '547cf9a4-1d05-4cbd-bb2b-ee5cbd406130', 'body': {'removeFloatingIp': {'address': '172.35.7.247'}}} Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.35.7.247 is not associated with instance 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130. Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.35.7.247 is not associated with instance 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130. Sep 24 21:01:19.045941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:19.053383 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-caca5f41-96b8-4219-9cd7-9a96d4164bea tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Returning 409 to user: Floating IP 172.35.7.247 is not associated with instance 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:01:19.053383 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-caca5f41-96b8-4219-9cd7-9a96d4164bea tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "POST /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130/action" status: 409 len: 146 microversion: 2.1 time: 0.556552 Sep 24 21:01:19.053383 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1604/3205] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:01:18 2022] POST /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130/action => generated 146 bytes in 558 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 24 21:01:19.053606 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9ee3ae4d-1439-45ab-918a-2038be1486bc tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:19.054096 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9ee3ae4d-1439-45ab-918a-2038be1486bc tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] [instance: a178dffd-f620-41c2-b1b5-5ccc1ec52786] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:19.062490 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9ee3ae4d-1439-45ab-918a-2038be1486bc tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:19.062933 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9ee3ae4d-1439-45ab-918a-2038be1486bc tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:19.063370 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9ee3ae4d-1439-45ab-918a-2038be1486bc tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:19.064072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9ee3ae4d-1439-45ab-918a-2038be1486bc tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:19.064530 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9ee3ae4d-1439-45ab-918a-2038be1486bc tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:19.064960 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9ee3ae4d-1439-45ab-918a-2038be1486bc tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:19.092597 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9ee3ae4d-1439-45ab-918a-2038be1486bc tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] [instance: a178dffd-f620-41c2-b1b5-5ccc1ec52786] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:01:19.172093 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9ee3ae4d-1439-45ab-918a-2038be1486bc tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a178dffd-f620-41c2-b1b5-5ccc1ec52786" status: 204 len: 0 microversion: 2.1 time: 0.122771 Sep 24 21:01:19.172758 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1605/3206] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:01:19 2022] DELETE /compute/v2.1/servers/a178dffd-f620-41c2-b1b5-5ccc1ec52786 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:01:19.177732 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b21f1d7d-9fb8-4c96-b7af-b804c710116f tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '.version_select at 0x7f4b0c09c040>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:19.603556 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-93eea7fc-3629-4414-8d7e-a3495daa3db8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:01:19.605132 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-93eea7fc-3629-4414-8d7e-a3495daa3db8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:01:19.607211 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-93eea7fc-3629-4414-8d7e-a3495daa3db8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:01:19.607942 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-93eea7fc-3629-4414-8d7e-a3495daa3db8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:01:19.608409 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-93eea7fc-3629-4414-8d7e-a3495daa3db8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:01:19.631542 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93eea7fc-3629-4414-8d7e-a3495daa3db8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:19.632052 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93eea7fc-3629-4414-8d7e-a3495daa3db8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:19.632497 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93eea7fc-3629-4414-8d7e-a3495daa3db8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:19.633435 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93eea7fc-3629-4414-8d7e-a3495daa3db8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:19.633903 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93eea7fc-3629-4414-8d7e-a3495daa3db8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:19.634340 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93eea7fc-3629-4414-8d7e-a3495daa3db8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:19.673323 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b21f1d7d-9fb8-4c96-b7af-b804c710116f tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/f9813839-24ce-4511-a8f5-cab8b04c7382" status: 202 len: 0 microversion: 2.1 time: 0.499420 Sep 24 21:01:19.674328 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1606/3207] 10.222.0.52 () {58 vars in 1272 bytes} [Sat Sep 24 21:01:19 2022] DELETE /compute/v2.1/os-security-groups/f9813839-24ce-4511-a8f5-cab8b04c7382 => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:01:19.679857 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1794f592-ac56-4d0a-b44f-4e204ffd1a8e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:19.680703 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1794f592-ac56-4d0a-b44f-4e204ffd1a8e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:19.689512 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-93eea7fc-3629-4414-8d7e-a3495daa3db8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Getting quotas for project 8340f7f8fa9848dc822903c738f78f2a. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:01:19.698784 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1794f592-ac56-4d0a-b44f-4e204ffd1a8e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:19.699565 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1794f592-ac56-4d0a-b44f-4e204ffd1a8e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:19.700207 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1794f592-ac56-4d0a-b44f-4e204ffd1a8e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:19.701167 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1794f592-ac56-4d0a-b44f-4e204ffd1a8e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:19.702456 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1794f592-ac56-4d0a-b44f-4e204ffd1a8e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:19.703183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1794f592-ac56-4d0a-b44f-4e204ffd1a8e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:19.711300 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-93eea7fc-3629-4414-8d7e-a3495daa3db8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Getting quotas for user ee21da3ff38a43798bce50c9aba4ae33 and project 8340f7f8fa9848dc822903c738f78f2a. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:01:19.726449 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-93eea7fc-3629-4414-8d7e-a3495daa3db8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:01:19.729403 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-93eea7fc-3629-4414-8d7e-a3495daa3db8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:01:19.780140 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-93eea7fc-3629-4414-8d7e-a3495daa3db8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.096962 Sep 24 21:01:19.781048 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1602/3208] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:01:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1099 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:01:19.786176 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-76190703-e6a1-426d-a403-f84bba54386d tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] Calling method '.version_select at 0x7f4b0c910820>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:19.796771 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-76190703-e6a1-426d-a403-f84bba54386d tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs/tempest-keypair-591572616" status: 200 len: 497 microversion: 2.1 time: 0.014490 Sep 24 21:01:19.797971 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1603/3209] 10.222.0.52 () {58 vars in 1215 bytes} [Sat Sep 24 21:01:19 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-591572616 => generated 497 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:19.803264 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4618488e-7496-481f-aec4-f27a37fd80b6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:19.805517 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4618488e-7496-481f-aec4-f27a37fd80b6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:19.814289 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4618488e-7496-481f-aec4-f27a37fd80b6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:19.815064 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4618488e-7496-481f-aec4-f27a37fd80b6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:19.815673 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4618488e-7496-481f-aec4-f27a37fd80b6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:19.816843 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4618488e-7496-481f-aec4-f27a37fd80b6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:19.817979 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4618488e-7496-481f-aec4-f27a37fd80b6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:19.818820 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4618488e-7496-481f-aec4-f27a37fd80b6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:19.852453 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4618488e-7496-481f-aec4-f27a37fd80b6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.053057 Sep 24 21:01:19.853602 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1604/3210] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:01:19 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:01:19.856432 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1794f592-ac56-4d0a-b44f-4e204ffd1a8e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:19.858935 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2d499722-249d-4608-8701-68922ff54303 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.7.247"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:19.867440 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1794f592-ac56-4d0a-b44f-4e204ffd1a8e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1678 microversion: 2.1 time: 0.191893 Sep 24 21:01:19.868707 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1607/3211] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:19 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1678 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:19.874954 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b3de259c-c5f6-4183-9232-be590aa60cfa tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-164538877", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "3170c36d-98a6-43e0-abcd-41b9e51b1d2e"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:19.939480 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-b3de259c-c5f6-4183-9232-be590aa60cfa tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] validate_networks() for [('3170c36d-98a6-43e0-abcd-41b9e51b1d2e', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:01:20.136302 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2d499722-249d-4608-8701-68922ff54303 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 5c119929-2744-4871-b523-0a6a05c6c073] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:20.143745 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d499722-249d-4608-8701-68922ff54303 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:20.144252 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d499722-249d-4608-8701-68922ff54303 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:20.144705 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d499722-249d-4608-8701-68922ff54303 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:20.145434 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d499722-249d-4608-8701-68922ff54303 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:20.145903 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d499722-249d-4608-8701-68922ff54303 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:20.160888 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d499722-249d-4608-8701-68922ff54303 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:20.647456 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d499722-249d-4608-8701-68922ff54303 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "refresh_cache-5c119929-2744-4871-b523-0a6a05c6c073" {{(pid=140517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 24 21:01:20.648535 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d499722-249d-4608-8701-68922ff54303 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquired lock "refresh_cache-5c119929-2744-4871-b523-0a6a05c6c073" {{(pid=140517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 24 21:01:21.151870 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-b3de259c-c5f6-4183-9232-be590aa60cfa tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:01:21.154906 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-b3de259c-c5f6-4183-9232-be590aa60cfa tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:01:21.155996 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-b3de259c-c5f6-4183-9232-be590aa60cfa tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:01:21.156463 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-b3de259c-c5f6-4183-9232-be590aa60cfa tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:01:21.157119 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-b3de259c-c5f6-4183-9232-be590aa60cfa tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:01:21.172345 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b3de259c-c5f6-4183-9232-be590aa60cfa tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:21.173793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b3de259c-c5f6-4183-9232-be590aa60cfa tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:21.174957 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b3de259c-c5f6-4183-9232-be590aa60cfa tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:21.176519 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b3de259c-c5f6-4183-9232-be590aa60cfa tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:21.177205 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b3de259c-c5f6-4183-9232-be590aa60cfa tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:21.177963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b3de259c-c5f6-4183-9232-be590aa60cfa tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:21.207019 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-b3de259c-c5f6-4183-9232-be590aa60cfa tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Getting quotas for project 5b68f292633a49ca82fb05d18ea83142. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:01:21.213345 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-b3de259c-c5f6-4183-9232-be590aa60cfa tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Getting quotas for user c7c49bed91bb437087a8ad2d865c2647 and project 5b68f292633a49ca82fb05d18ea83142. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:01:21.244787 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b3de259c-c5f6-4183-9232-be590aa60cfa tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Going to run 2 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:01:21.247934 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b3de259c-c5f6-4183-9232-be590aa60cfa tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] [instance: d96e45af-4d4d-4282-8b88-ffeb56a4f62c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:01:21.292250 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b3de259c-c5f6-4183-9232-be590aa60cfa tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] [instance: ab5b3a44-e594-4cc2-8d36-51b15722edae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=d96e45af-4d4d-4282-8b88-ffeb56a4f62c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:01:21.358119 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b3de259c-c5f6-4183-9232-be590aa60cfa tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.488038 Sep 24 21:01:21.359123 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1608/3212] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:01:19 2022] POST /compute/v2.1/servers => generated 32 bytes in 1490 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 24 21:01:21.365670 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-287e6d12-39ed-4498-bc8d-16b871255e1b tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:21.366394 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-287e6d12-39ed-4498-bc8d-16b871255e1b tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 7c6ee4f7-82b5-4c95-8865-ab81076df04f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:21.375695 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-287e6d12-39ed-4498-bc8d-16b871255e1b tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:21.376524 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-287e6d12-39ed-4498-bc8d-16b871255e1b tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:21.377146 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-287e6d12-39ed-4498-bc8d-16b871255e1b tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:21.378010 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-287e6d12-39ed-4498-bc8d-16b871255e1b tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:21.378643 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-287e6d12-39ed-4498-bc8d-16b871255e1b tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:21.379426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-287e6d12-39ed-4498-bc8d-16b871255e1b tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:21.400980 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-287e6d12-39ed-4498-bc8d-16b871255e1b tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] HTTP exception thrown: Instance 7c6ee4f7-82b5-4c95-8865-ab81076df04f could not be found. Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-287e6d12-39ed-4498-bc8d-16b871255e1b tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Request method failure captured: Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f HTTP/1.1 Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL2_KTBoQE1biSOdbxiN02s3h0D1W3LZT4KXbL5sweudoA3LIqkhpSDHo_3ElsoW-S4pinCvYVIPwwmg75I3QYjyeUH8E9-UCSOe6Wat6dff2LaBOhzu2fRTo0k0Ryv1Z1NW8ftU_9LakKBqftyUWUBvBSk8oz2eNB_e-v5W7ciYbcII Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 981fdf8ae7524612b9c2f6a3f16c39ec Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 981fdf8ae7524612b9c2f6a3f16c39ec Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-SecurityGroupsTestJSON-321124649-project Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 5ddab9c74c004e74a51fd8008886e542 Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-SecurityGroupsTestJSON-321124649-project Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 7c6ee4f7-82b5-4c95-8865-ab81076df04f could not be found. Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '7c6ee4f7-82b5-4c95-8865-ab81076df04f'} Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c6ee4f7-82b5-4c95-8865-ab81076df04f could not be found. Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:01:21.403870 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:01:21.409681 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c6ee4f7-82b5-4c95-8865-ab81076df04f could not be found. Sep 24 21:01:21.409681 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:21.409681 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:21.409681 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:21.409681 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:21.409681 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:21.409681 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:21.409681 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:01:21.409681 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:01:21.409681 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c6ee4f7-82b5-4c95-8865-ab81076df04f could not be found. Sep 24 21:01:21.409681 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:21.409681 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-287e6d12-39ed-4498-bc8d-16b871255e1b tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Returning 404 to user: Instance 7c6ee4f7-82b5-4c95-8865-ab81076df04f could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:01:21.411810 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-287e6d12-39ed-4498-bc8d-16b871255e1b tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f" status: 404 len: 111 microversion: 2.1 time: 0.050839 Sep 24 21:01:21.412983 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1609/3213] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:01:21 2022] DELETE /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:01:21.418211 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-36c1b4fe-9a94-496e-a254-2e58cb230001 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:21.419820 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-36c1b4fe-9a94-496e-a254-2e58cb230001 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:21.427418 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36c1b4fe-9a94-496e-a254-2e58cb230001 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:21.428320 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36c1b4fe-9a94-496e-a254-2e58cb230001 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:21.431025 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36c1b4fe-9a94-496e-a254-2e58cb230001 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:21.443826 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36c1b4fe-9a94-496e-a254-2e58cb230001 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:21.444910 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36c1b4fe-9a94-496e-a254-2e58cb230001 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:21.445365 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36c1b4fe-9a94-496e-a254-2e58cb230001 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:21.552027 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-36c1b4fe-9a94-496e-a254-2e58cb230001 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:21.562248 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-36c1b4fe-9a94-496e-a254-2e58cb230001 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2" status: 200 len: 1266 microversion: 2.1 time: 0.147602 Sep 24 21:01:21.563665 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1610/3214] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:21 2022] GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:21.584999 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f8e4ee33-c8e8-48fa-a334-9c08ac271897 tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] Calling method '.version_select at 0x7f4b0c09cc10>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:21.656198 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f8e4ee33-c8e8-48fa-a334-9c08ac271897 tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-591572616" status: 202 len: 0 microversion: 2.1 time: 0.090907 Sep 24 21:01:21.659537 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1611/3215] 10.222.0.52 () {58 vars in 1218 bytes} [Sat Sep 24 21:01:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-591572616 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:01:21.668287 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-24435b38-ad36-48b7-96f5-77cfee565f7e req-279b40ef-c92f-4d89-8ce6-a1024a1201cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c119929-2744-4871-b523-0a6a05c6c073", "tag": "328bc618-9c61-46b1-a53c-716485f1d492"}, {"server_uuid": "9c96f88e-1327-49e3-8e9a-5417f96fb308", "name": "network-vif-deleted", "tag": "f8825c51-2e9d-4429-9259-cd32e621d907"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:21.697030 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-24435b38-ad36-48b7-96f5-77cfee565f7e req-279b40ef-c92f-4d89-8ce6-a1024a1201cf service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:21.701327 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-24435b38-ad36-48b7-96f5-77cfee565f7e req-279b40ef-c92f-4d89-8ce6-a1024a1201cf service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:21.703437 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-24435b38-ad36-48b7-96f5-77cfee565f7e req-279b40ef-c92f-4d89-8ce6-a1024a1201cf service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:21.736239 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-24435b38-ad36-48b7-96f5-77cfee565f7e req-279b40ef-c92f-4d89-8ce6-a1024a1201cf service nova] Creating event network-changed:328bc618-9c61-46b1-a53c-716485f1d492 for instance 5c119929-2744-4871-b523-0a6a05c6c073 on nch1-master-1 Sep 24 21:01:21.736875 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.compute.server_external_events [req-24435b38-ad36-48b7-96f5-77cfee565f7e req-279b40ef-c92f-4d89-8ce6-a1024a1201cf service nova] Unable to find a host for instance 9c96f88e-1327-49e3-8e9a-5417f96fb308. Dropping event network-vif-deleted {{(pid=140516) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 24 21:01:21.749533 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-24435b38-ad36-48b7-96f5-77cfee565f7e req-279b40ef-c92f-4d89-8ce6-a1024a1201cf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 347 microversion: 2.1 time: 0.088567 Sep 24 21:01:21.751012 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1612/3216] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 347 bytes in 91 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 24 21:01:21.757132 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9cfb1ffd-213f-44b0-864a-9fc8b90eec9c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:21.773405 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9cfb1ffd-213f-44b0-864a-9fc8b90eec9c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:21.786584 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9cfb1ffd-213f-44b0-864a-9fc8b90eec9c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:21.786895 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9cfb1ffd-213f-44b0-864a-9fc8b90eec9c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:21.787339 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9cfb1ffd-213f-44b0-864a-9fc8b90eec9c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:21.788057 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9cfb1ffd-213f-44b0-864a-9fc8b90eec9c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:21.798776 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9cfb1ffd-213f-44b0-864a-9fc8b90eec9c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:21.799391 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9cfb1ffd-213f-44b0-864a-9fc8b90eec9c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:21.869199 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9cfb1ffd-213f-44b0-864a-9fc8b90eec9c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.116747 Sep 24 21:01:21.869863 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1613/3217] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:01:21 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:01:21.881397 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e3f1e76d-6fe4-43e6-9f8d-2adcc77174d3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:21.886484 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e3f1e76d-6fe4-43e6-9f8d-2adcc77174d3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:21.901815 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e3f1e76d-6fe4-43e6-9f8d-2adcc77174d3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:21.908183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e3f1e76d-6fe4-43e6-9f8d-2adcc77174d3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:21.908651 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e3f1e76d-6fe4-43e6-9f8d-2adcc77174d3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:21.909413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e3f1e76d-6fe4-43e6-9f8d-2adcc77174d3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:21.909898 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e3f1e76d-6fe4-43e6-9f8d-2adcc77174d3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:21.910332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e3f1e76d-6fe4-43e6-9f8d-2adcc77174d3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:22.316020 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e3f1e76d-6fe4-43e6-9f8d-2adcc77174d3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:22.328344 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e3f1e76d-6fe4-43e6-9f8d-2adcc77174d3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1686 microversion: 2.1 time: 0.457319 Sep 24 21:01:22.331560 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1614/3218] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:21 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1686 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:22.336655 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3cd0d77c-6d08-4d7f-9cb2-22fc7d34625d tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:22.350245 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3cd0d77c-6d08-4d7f-9cb2-22fc7d34625d tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c7c49bed91bb437087a8ad2d865c2647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b68f292633a49ca82fb05d18ea83142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:22.359607 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3cd0d77c-6d08-4d7f-9cb2-22fc7d34625d tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Searching by: {'deleted': False, 'project_id': '5b68f292633a49ca82fb05d18ea83142'} {{(pid=140516) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 21:01:22.396006 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3cd0d77c-6d08-4d7f-9cb2-22fc7d34625d tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:22.396500 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3cd0d77c-6d08-4d7f-9cb2-22fc7d34625d tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:22.396943 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3cd0d77c-6d08-4d7f-9cb2-22fc7d34625d tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:22.397681 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3cd0d77c-6d08-4d7f-9cb2-22fc7d34625d tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:22.398138 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3cd0d77c-6d08-4d7f-9cb2-22fc7d34625d tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:22.398590 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3cd0d77c-6d08-4d7f-9cb2-22fc7d34625d tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:22.655231 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.multi_cell_list [None req-3cd0d77c-6d08-4d7f-9cb2-22fc7d34625d tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Listed batch of 4 results from cell out of 998 limit. Returned 4 total so far. {{(pid=140516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 21:01:22.718741 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-2d499722-249d-4608-8701-68922ff54303 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 5c119929-2744-4871-b523-0a6a05c6c073] Building network info cache for instance {{(pid=140517) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 24 21:01:22.807225 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3cd0d77c-6d08-4d7f-9cb2-22fc7d34625d tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.458024 Sep 24 21:01:22.809068 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1615/3219] 10.222.0.52 () {58 vars in 1125 bytes} [Sat Sep 24 21:01:22 2022] GET /compute/v2.1/servers => generated 1335 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:22.818758 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c62546d0-f045-4a9b-8e9c-4f7367efd2d9 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:22.819735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c62546d0-f045-4a9b-8e9c-4f7367efd2d9 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 7c6ee4f7-82b5-4c95-8865-ab81076df04f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:22.838182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c62546d0-f045-4a9b-8e9c-4f7367efd2d9 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:22.839082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c62546d0-f045-4a9b-8e9c-4f7367efd2d9 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:22.839764 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c62546d0-f045-4a9b-8e9c-4f7367efd2d9 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:22.840709 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c62546d0-f045-4a9b-8e9c-4f7367efd2d9 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:22.842360 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c62546d0-f045-4a9b-8e9c-4f7367efd2d9 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:22.843161 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c62546d0-f045-4a9b-8e9c-4f7367efd2d9 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:22.875231 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-c62546d0-f045-4a9b-8e9c-4f7367efd2d9 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] HTTP exception thrown: Instance 7c6ee4f7-82b5-4c95-8865-ab81076df04f could not be found. Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c62546d0-f045-4a9b-8e9c-4f7367efd2d9 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Request method failure captured: Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f HTTP/1.1 Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL2_KTBoQE1biSOdbxiN02s3h0D1W3LZT4KXbL5sweudoA3LIqkhpSDHo_3ElsoW-S4pinCvYVIPwwmg75I3QYjyeUH8E9-UCSOe6Wat6dff2LaBOhzu2fRTo0k0Ryv1Z1NW8ftU_9LakKBqftyUWUBvBSk8oz2eNB_e-v5W7ciYbcII Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 981fdf8ae7524612b9c2f6a3f16c39ec Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 981fdf8ae7524612b9c2f6a3f16c39ec Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-SecurityGroupsTestJSON-321124649-project Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 5ddab9c74c004e74a51fd8008886e542 Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-SecurityGroupsTestJSON-321124649-project Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 7c6ee4f7-82b5-4c95-8865-ab81076df04f could not be found. Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '7c6ee4f7-82b5-4c95-8865-ab81076df04f'} Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c6ee4f7-82b5-4c95-8865-ab81076df04f could not be found. Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c6ee4f7-82b5-4c95-8865-ab81076df04f could not be found. Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:22.877212 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:22.881064 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:22.881064 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:22.881064 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:22.881064 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:01:22.881064 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:01:22.881064 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c6ee4f7-82b5-4c95-8865-ab81076df04f could not be found. Sep 24 21:01:22.881064 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:22.883799 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c62546d0-f045-4a9b-8e9c-4f7367efd2d9 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Returning 404 to user: Instance 7c6ee4f7-82b5-4c95-8865-ab81076df04f could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:01:22.887284 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c62546d0-f045-4a9b-8e9c-4f7367efd2d9 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f" status: 404 len: 111 microversion: 2.1 time: 0.076919 Sep 24 21:01:22.893529 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1616/3220] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:22 2022] GET /compute/v2.1/servers/7c6ee4f7-82b5-4c95-8865-ab81076df04f => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:01:22.905089 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-958d7789-288c-4ffb-b8db-ea0902171a2d tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] Action: 'create', calling method: .version_select at 0x7f4b0c09c9d0>, body: {"keypair": {"name": "tempest-keypair-649450665", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrtzJQgkIk4DUtRCwjm7Mi7mn8iGg+eoufBBubq92wLpx7svuXwZbLwCADH/m0cr4lEOY29oY1/oDBaSE+D7tSMYFoZMkHvtCU0OIVteyPaGMUWxhFmqxBfeAoOFXH/CQ=="}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:22.960037 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-958d7789-288c-4ffb-b8db-ea0902171a2d tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] Getting quotas for project 212a64f6557143739a2f3d232127ccbf. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:01:22.967565 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-958d7789-288c-4ffb-b8db-ea0902171a2d tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] Getting quotas for user 4a0e7b0511294f0d95ee52d8dacd6446 and project 212a64f6557143739a2f3d232127ccbf. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:01:23.003235 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-958d7789-288c-4ffb-b8db-ea0902171a2d tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.106280 Sep 24 21:01:23.004312 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1617/3221] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 21:01:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:23.009252 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7f335f62-45a8-4e0e-b47b-8b8c0f6d0148 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:23.019506 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7f335f62-45a8-4e0e-b47b-8b8c0f6d0148 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:23.050088 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f335f62-45a8-4e0e-b47b-8b8c0f6d0148 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:23.052952 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f335f62-45a8-4e0e-b47b-8b8c0f6d0148 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:23.053533 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f335f62-45a8-4e0e-b47b-8b8c0f6d0148 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:23.054366 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f335f62-45a8-4e0e-b47b-8b8c0f6d0148 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:23.057155 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f335f62-45a8-4e0e-b47b-8b8c0f6d0148 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:23.057735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f335f62-45a8-4e0e-b47b-8b8c0f6d0148 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:23.233546 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7f335f62-45a8-4e0e-b47b-8b8c0f6d0148 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:23.251198 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7f335f62-45a8-4e0e-b47b-8b8c0f6d0148 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2" status: 200 len: 1272 microversion: 2.1 time: 0.241584 Sep 24 21:01:23.252172 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1618/3222] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:23 2022] GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 => generated 1272 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:23.265801 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-906790ea-8508-4277-8789-2b9233993728 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:23.266795 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-906790ea-8508-4277-8789-2b9233993728 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] [instance: ab5b3a44-e594-4cc2-8d36-51b15722edae] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:23.283977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-906790ea-8508-4277-8789-2b9233993728 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:23.284490 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-906790ea-8508-4277-8789-2b9233993728 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:23.286555 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-906790ea-8508-4277-8789-2b9233993728 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:23.287315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-906790ea-8508-4277-8789-2b9233993728 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:23.287793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-906790ea-8508-4277-8789-2b9233993728 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:23.288234 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-906790ea-8508-4277-8789-2b9233993728 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:23.357116 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=4,nova_cell1:RELEASE=2,nova_cell1:INSERT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:01:23.456392 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-906790ea-8508-4277-8789-2b9233993728 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c49bed91bb437087a8ad2d865c2647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b68f292633a49ca82fb05d18ea83142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:23.466996 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-906790ea-8508-4277-8789-2b9233993728 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] 10.222.0.52 "GET /compute/v2.1/servers/ab5b3a44-e594-4cc2-8d36-51b15722edae" status: 200 len: 1269 microversion: 2.1 time: 0.212020 Sep 24 21:01:23.468019 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1619/3223] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:23 2022] GET /compute/v2.1/servers/ab5b3a44-e594-4cc2-8d36-51b15722edae => generated 1269 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:23.474349 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1f1d0e4a-a19d-4812-93f2-deaf0e81c9c4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:23.482106 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1f1d0e4a-a19d-4812-93f2-deaf0e81c9c4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:23.489101 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f1d0e4a-a19d-4812-93f2-deaf0e81c9c4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:23.490047 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f1d0e4a-a19d-4812-93f2-deaf0e81c9c4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:23.490799 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f1d0e4a-a19d-4812-93f2-deaf0e81c9c4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:23.491869 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f1d0e4a-a19d-4812-93f2-deaf0e81c9c4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:23.492491 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f1d0e4a-a19d-4812-93f2-deaf0e81c9c4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:23.493191 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f1d0e4a-a19d-4812-93f2-deaf0e81c9c4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:23.592171 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1f1d0e4a-a19d-4812-93f2-deaf0e81c9c4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.120574 Sep 24 21:01:23.593591 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1620/3224] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:01:23 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:01:23.599905 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dcc78113-2327-451b-bfba-3427985b5541 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '.version_select at 0x7f4b0c100af0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:23.713268 ncdv-master-1 devstack@n-api.service[140516]: DEBUG neutronclient.v2_0.client [None req-dcc78113-2327-451b-bfba-3427985b5541 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5e70f14d-7785-4f72-a62d-d4ac6c3b9747 does not exist", "detail": ""}} {{(pid=140516) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 24 21:01:23.713989 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.security_group_api [None req-dcc78113-2327-451b-bfba-3427985b5541 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Neutron security group 5e70f14d-7785-4f72-a62d-d4ac6c3b9747 not found {{(pid=140516) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 24 21:01:23.714965 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-dcc78113-2327-451b-bfba-3427985b5541 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] HTTP exception thrown: Security group 5e70f14d-7785-4f72-a62d-d4ac6c3b9747 does not exist Sep 24 21:01:23.714965 ncdv-master-1 devstack@n-api.service[140516]: Neutron server returns request_ids: ['req-e4a4053b-6e80-461a-afc3-6da5d48a3f56'] Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dcc78113-2327-451b-bfba-3427985b5541 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Request method failure captured: Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/os-security-groups/5e70f14d-7785-4f72-a62d-d4ac6c3b9747 HTTP/1.1 Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL2_KTBoQE1biSOdbxiN02s3h0D1W3LZT4KXbL5sweudoA3LIqkhpSDHo_3ElsoW-S4pinCvYVIPwwmg75I3QYjyeUH8E9-UCSOe6Wat6dff2LaBOhzu2fRTo0k0Ryv1Z1NW8ftU_9LakKBqftyUWUBvBSk8oz2eNB_e-v5W7ciYbcII Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 981fdf8ae7524612b9c2f6a3f16c39ec Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 981fdf8ae7524612b9c2f6a3f16c39ec Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-SecurityGroupsTestJSON-321124649-project Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 5ddab9c74c004e74a51fd8008886e542 Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-SecurityGroupsTestJSON-321124649-project Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: exception: Security group 5e70f14d-7785-4f72-a62d-d4ac6c3b9747 does not exist Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: Neutron server returns request_ids: ['req-e4a4053b-6e80-461a-afc3-6da5d48a3f56'] Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '5e70f14d-7785-4f72-a62d-d4ac6c3b9747'} Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 24 21:01:23.719220 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5e70f14d-7785-4f72-a62d-d4ac6c3b9747 does not exist Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e4a4053b-6e80-461a-afc3-6da5d48a3f56'] Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5e70f14d-7785-4f72-a62d-d4ac6c3b9747 does not exist Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e4a4053b-6e80-461a-afc3-6da5d48a3f56'] Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5e70f14d-7785-4f72-a62d-d4ac6c3b9747 does not exist Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e4a4053b-6e80-461a-afc3-6da5d48a3f56'] Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5e70f14d-7785-4f72-a62d-d4ac6c3b9747 does not exist Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e4a4053b-6e80-461a-afc3-6da5d48a3f56'] Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dcc78113-2327-451b-bfba-3427985b5541 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Returning 404 to user: Security group 5e70f14d-7785-4f72-a62d-d4ac6c3b9747 does not exist Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: Neutron server returns request_ids: ['req-e4a4053b-6e80-461a-afc3-6da5d48a3f56'] {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:01:23.723545 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-dcc78113-2327-451b-bfba-3427985b5541 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/5e70f14d-7785-4f72-a62d-d4ac6c3b9747" status: 404 len: 194 microversion: 2.1 time: 0.127740 Sep 24 21:01:23.730525 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1621/3225] 10.222.0.52 () {58 vars in 1272 bytes} [Sat Sep 24 21:01:23 2022] DELETE /compute/v2.1/os-security-groups/5e70f14d-7785-4f72-a62d-d4ac6c3b9747 => generated 194 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:01:23.743872 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-18889b2c-bba4-4217-9326-a847b858325d tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] Calling method '.version_select at 0x7f4b0c09cf70>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:23.813606 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-18889b2c-bba4-4217-9326-a847b858325d tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-649450665" status: 202 len: 0 microversion: 2.1 time: 0.084481 Sep 24 21:01:23.814192 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1622/3226] 10.222.0.52 () {58 vars in 1218 bytes} [Sat Sep 24 21:01:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-649450665 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:01:23.820147 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a52d1989-e3ec-4083-87f6-513f7fcf7cca tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:23.820792 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a52d1989-e3ec-4083-87f6-513f7fcf7cca tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:23.838192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a52d1989-e3ec-4083-87f6-513f7fcf7cca tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:23.838724 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a52d1989-e3ec-4083-87f6-513f7fcf7cca tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:23.839159 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a52d1989-e3ec-4083-87f6-513f7fcf7cca tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:23.840337 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a52d1989-e3ec-4083-87f6-513f7fcf7cca tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:23.841528 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a52d1989-e3ec-4083-87f6-513f7fcf7cca tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:23.842522 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a52d1989-e3ec-4083-87f6-513f7fcf7cca tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:24.742639 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a52d1989-e3ec-4083-87f6-513f7fcf7cca tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:24.757056 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a52d1989-e3ec-4083-87f6-513f7fcf7cca tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1686 microversion: 2.1 time: 0.939691 Sep 24 21:01:24.766557 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1623/3227] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:23 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1686 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:24.772683 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-b6dfd9f8-0b6f-43fb-929b-eecf20a27a90 req-3b7cd085-24e3-4f19-abd9-d6e158875e48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c660bb73-2186-4c86-b57b-0c6c3be5c9bf", "name": "network-vif-unplugged", "status": "completed", "tag": "3c3743a2-0126-4864-bed2-ea84c10b230a"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:24.795580 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-b6dfd9f8-0b6f-43fb-929b-eecf20a27a90 req-3b7cd085-24e3-4f19-abd9-d6e158875e48 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:24.796187 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-b6dfd9f8-0b6f-43fb-929b-eecf20a27a90 req-3b7cd085-24e3-4f19-abd9-d6e158875e48 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:24.802079 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-b6dfd9f8-0b6f-43fb-929b-eecf20a27a90 req-3b7cd085-24e3-4f19-abd9-d6e158875e48 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:24.826919 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-b6dfd9f8-0b6f-43fb-929b-eecf20a27a90 req-3b7cd085-24e3-4f19-abd9-d6e158875e48 service nova] Creating event network-vif-unplugged:3c3743a2-0126-4864-bed2-ea84c10b230a for instance c660bb73-2186-4c86-b57b-0c6c3be5c9bf on nch2-master-1 Sep 24 21:01:24.837598 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-b6dfd9f8-0b6f-43fb-929b-eecf20a27a90 req-3b7cd085-24e3-4f19-abd9-d6e158875e48 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072629 Sep 24 21:01:24.842377 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1624/3228] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:24.852900 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-29329e31-c81c-4322-b4dc-49ddd0932f50 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '.version_select at 0x7f4b0c100ca0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:24.976491 ncdv-master-1 devstack@n-api.service[140516]: DEBUG neutronclient.v2_0.client [None req-29329e31-c81c-4322-b4dc-49ddd0932f50 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f876d855-6948-4446-a64d-20bd145875d3 does not exist", "detail": ""}} {{(pid=140516) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 24 21:01:24.977113 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.security_group_api [None req-29329e31-c81c-4322-b4dc-49ddd0932f50 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Neutron security group f876d855-6948-4446-a64d-20bd145875d3 not found {{(pid=140516) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 24 21:01:24.978179 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-29329e31-c81c-4322-b4dc-49ddd0932f50 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] HTTP exception thrown: Security group f876d855-6948-4446-a64d-20bd145875d3 does not exist Sep 24 21:01:24.978179 ncdv-master-1 devstack@n-api.service[140516]: Neutron server returns request_ids: ['req-8d544c6d-f91a-4479-a9d8-ecead04818d6'] Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-29329e31-c81c-4322-b4dc-49ddd0932f50 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Request method failure captured: Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/os-security-groups/f876d855-6948-4446-a64d-20bd145875d3 HTTP/1.1 Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL2_KTBoQE1biSOdbxiN02s3h0D1W3LZT4KXbL5sweudoA3LIqkhpSDHo_3ElsoW-S4pinCvYVIPwwmg75I3QYjyeUH8E9-UCSOe6Wat6dff2LaBOhzu2fRTo0k0Ryv1Z1NW8ftU_9LakKBqftyUWUBvBSk8oz2eNB_e-v5W7ciYbcII Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 981fdf8ae7524612b9c2f6a3f16c39ec Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 981fdf8ae7524612b9c2f6a3f16c39ec Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-SecurityGroupsTestJSON-321124649-project Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 5ddab9c74c004e74a51fd8008886e542 Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-SecurityGroupsTestJSON-321124649-project Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: exception: Security group f876d855-6948-4446-a64d-20bd145875d3 does not exist Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: Neutron server returns request_ids: ['req-8d544c6d-f91a-4479-a9d8-ecead04818d6'] Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'f876d855-6948-4446-a64d-20bd145875d3'} Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 24 21:01:24.980733 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f876d855-6948-4446-a64d-20bd145875d3 does not exist Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8d544c6d-f91a-4479-a9d8-ecead04818d6'] Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f876d855-6948-4446-a64d-20bd145875d3 does not exist Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8d544c6d-f91a-4479-a9d8-ecead04818d6'] Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f876d855-6948-4446-a64d-20bd145875d3 does not exist Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8d544c6d-f91a-4479-a9d8-ecead04818d6'] Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f876d855-6948-4446-a64d-20bd145875d3 does not exist Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8d544c6d-f91a-4479-a9d8-ecead04818d6'] Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-29329e31-c81c-4322-b4dc-49ddd0932f50 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Returning 404 to user: Security group f876d855-6948-4446-a64d-20bd145875d3 does not exist Sep 24 21:01:24.985878 ncdv-master-1 devstack@n-api.service[140516]: Neutron server returns request_ids: ['req-8d544c6d-f91a-4479-a9d8-ecead04818d6'] {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:01:24.993059 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-29329e31-c81c-4322-b4dc-49ddd0932f50 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/f876d855-6948-4446-a64d-20bd145875d3" status: 404 len: 194 microversion: 2.1 time: 0.143568 Sep 24 21:01:24.993059 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1625/3229] 10.222.0.52 () {58 vars in 1272 bytes} [Sat Sep 24 21:01:24 2022] DELETE /compute/v2.1/os-security-groups/f876d855-6948-4446-a64d-20bd145875d3 => generated 194 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:01:25.002688 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4a3dec0a-9bd5-4bbd-86fa-06cb3ee77d8e tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] Action: 'create', calling method: .version_select at 0x7f4b0c08ab80>, body: {"keypair": {"name": "tempest-keypair-1941212445", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:25.038192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-4a3dec0a-9bd5-4bbd-86fa-06cb3ee77d8e tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] Getting quotas for project 212a64f6557143739a2f3d232127ccbf. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:01:25.058305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-4a3dec0a-9bd5-4bbd-86fa-06cb3ee77d8e tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] Getting quotas for user 4a0e7b0511294f0d95ee52d8dacd6446 and project 212a64f6557143739a2f3d232127ccbf. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:01:25.089746 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4a3dec0a-9bd5-4bbd-86fa-06cb3ee77d8e tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.098183 Sep 24 21:01:25.091384 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1626/3230] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 21:01:24 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:25.097844 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-3eb585dc-b9c0-4ca4-90c9-ab9b3c0ce6d5 req-2a244e2c-18d7-49da-a7a3-47fb524fe204 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c119929-2744-4871-b523-0a6a05c6c073", "tag": "328bc618-9c61-46b1-a53c-716485f1d492"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:25.110237 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-3eb585dc-b9c0-4ca4-90c9-ab9b3c0ce6d5 req-2a244e2c-18d7-49da-a7a3-47fb524fe204 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:25.111123 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-3eb585dc-b9c0-4ca4-90c9-ab9b3c0ce6d5 req-2a244e2c-18d7-49da-a7a3-47fb524fe204 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:25.111971 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-3eb585dc-b9c0-4ca4-90c9-ab9b3c0ce6d5 req-2a244e2c-18d7-49da-a7a3-47fb524fe204 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:25.128667 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-3eb585dc-b9c0-4ca4-90c9-ab9b3c0ce6d5 req-2a244e2c-18d7-49da-a7a3-47fb524fe204 service nova] Creating event network-changed:328bc618-9c61-46b1-a53c-716485f1d492 for instance 5c119929-2744-4871-b523-0a6a05c6c073 on nch1-master-1 Sep 24 21:01:25.134967 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-3eb585dc-b9c0-4ca4-90c9-ab9b3c0ce6d5 req-2a244e2c-18d7-49da-a7a3-47fb524fe204 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041687 Sep 24 21:01:25.136457 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1627/3231] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:25.144056 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-35db6456-5eb9-4761-8bec-fdee61639d8b tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:25.145248 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-35db6456-5eb9-4761-8bec-fdee61639d8b tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:25.153109 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35db6456-5eb9-4761-8bec-fdee61639d8b tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:25.154557 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35db6456-5eb9-4761-8bec-fdee61639d8b tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:25.155225 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35db6456-5eb9-4761-8bec-fdee61639d8b tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:25.156450 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35db6456-5eb9-4761-8bec-fdee61639d8b tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:25.158127 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35db6456-5eb9-4761-8bec-fdee61639d8b tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:25.159071 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35db6456-5eb9-4761-8bec-fdee61639d8b tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:25.570663 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-2d499722-249d-4608-8701-68922ff54303 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 5c119929-2744-4871-b523-0a6a05c6c073] Updating instance_info_cache with network_info: [{"id": "328bc618-9c61-46b1-a53c-716485f1d492", "address": "fa:16:3e:92:c4:87", "network": {"id": "b9fc93d3-0ad7-483a-aed0-543890dc0a39", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1279734249-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d4655b536ca04896993223f34d172298", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap328bc618-9c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140517) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 24 21:01:25.581181 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d499722-249d-4608-8701-68922ff54303 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Releasing lock "refresh_cache-5c119929-2744-4871-b523-0a6a05c6c073" {{(pid=140517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 24 21:01:25.585662 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2d499722-249d-4608-8701-68922ff54303 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "POST /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073/action" status: 202 len: 0 microversion: 2.1 time: 5.730865 Sep 24 21:01:25.591458 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1605/3232] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:01:19 2022] POST /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073/action => generated 0 bytes in 5737 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 24 21:01:25.596637 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-3f72edea-a782-41ba-b6f0-877f51483c19 req-3d39990d-73cd-483c-a4b7-e47841228c9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a178dffd-f620-41c2-b1b5-5ccc1ec52786", "name": "network-vif-deleted", "tag": "30c2493d-8ce1-4427-abd8-f40405c99430"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:25.642252 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-3f72edea-a782-41ba-b6f0-877f51483c19 req-3d39990d-73cd-483c-a4b7-e47841228c9b service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:25.643299 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-3f72edea-a782-41ba-b6f0-877f51483c19 req-3d39990d-73cd-483c-a4b7-e47841228c9b service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:25.659323 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-3f72edea-a782-41ba-b6f0-877f51483c19 req-3d39990d-73cd-483c-a4b7-e47841228c9b service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:25.690524 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-3f72edea-a782-41ba-b6f0-877f51483c19 req-3d39990d-73cd-483c-a4b7-e47841228c9b service nova] Creating event network-vif-deleted:30c2493d-8ce1-4427-abd8-f40405c99430 for instance a178dffd-f620-41c2-b1b5-5ccc1ec52786 on nch2-master-1 Sep 24 21:01:25.709278 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-3f72edea-a782-41ba-b6f0-877f51483c19 req-3d39990d-73cd-483c-a4b7-e47841228c9b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114758 Sep 24 21:01:25.713802 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1606/3233] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:25.726311 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-324fb984-fbe5-4865-8dde-cfc4028d90d6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:25.727914 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-324fb984-fbe5-4865-8dde-cfc4028d90d6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] [instance: ab5b3a44-e594-4cc2-8d36-51b15722edae] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:25.747647 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-324fb984-fbe5-4865-8dde-cfc4028d90d6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:25.752882 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-324fb984-fbe5-4865-8dde-cfc4028d90d6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:25.753785 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-324fb984-fbe5-4865-8dde-cfc4028d90d6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:25.754974 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-324fb984-fbe5-4865-8dde-cfc4028d90d6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:25.755725 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-324fb984-fbe5-4865-8dde-cfc4028d90d6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:25.756329 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-324fb984-fbe5-4865-8dde-cfc4028d90d6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:25.818846 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:01:25.978701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-324fb984-fbe5-4865-8dde-cfc4028d90d6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c49bed91bb437087a8ad2d865c2647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b68f292633a49ca82fb05d18ea83142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:25.992992 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-324fb984-fbe5-4865-8dde-cfc4028d90d6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] 10.222.0.52 "GET /compute/v2.1/servers/ab5b3a44-e594-4cc2-8d36-51b15722edae" status: 200 len: 1275 microversion: 2.1 time: 0.277399 Sep 24 21:01:25.994195 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1607/3234] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:25 2022] GET /compute/v2.1/servers/ab5b3a44-e594-4cc2-8d36-51b15722edae => generated 1275 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:25.999956 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7a580942-3b14-4505-bf33-750fcf0d5ad8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:26.002935 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7a580942-3b14-4505-bf33-750fcf0d5ad8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:26.013456 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7a580942-3b14-4505-bf33-750fcf0d5ad8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:26.014559 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7a580942-3b14-4505-bf33-750fcf0d5ad8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:26.015787 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7a580942-3b14-4505-bf33-750fcf0d5ad8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:26.016964 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7a580942-3b14-4505-bf33-750fcf0d5ad8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:26.017436 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7a580942-3b14-4505-bf33-750fcf0d5ad8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:26.018117 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7a580942-3b14-4505-bf33-750fcf0d5ad8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:26.087181 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7a580942-3b14-4505-bf33-750fcf0d5ad8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.075346 Sep 24 21:01:26.087181 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1608/3235] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:01:25 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:01:26.087181 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2b64c47e-09df-4086-a534-b2c4e76dd7ff tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '.version_select at 0x7f4b0cae5f70>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:26.216758 ncdv-master-1 devstack@n-api.service[140517]: DEBUG neutronclient.v2_0.client [None req-2b64c47e-09df-4086-a534-b2c4e76dd7ff tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a49c3057-be3b-4d9a-a9d9-fc28db0e243e does not exist", "detail": ""}} {{(pid=140517) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 24 21:01:26.217781 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.security_group_api [None req-2b64c47e-09df-4086-a534-b2c4e76dd7ff tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Neutron security group a49c3057-be3b-4d9a-a9d9-fc28db0e243e not found {{(pid=140517) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 24 21:01:26.218530 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-2b64c47e-09df-4086-a534-b2c4e76dd7ff tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] HTTP exception thrown: Security group a49c3057-be3b-4d9a-a9d9-fc28db0e243e does not exist Sep 24 21:01:26.218530 ncdv-master-1 devstack@n-api.service[140517]: Neutron server returns request_ids: ['req-fccd8731-5fd3-480a-98a9-9d5f11302d01'] Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2b64c47e-09df-4086-a534-b2c4e76dd7ff tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Request method failure captured: Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/os-security-groups/a49c3057-be3b-4d9a-a9d9-fc28db0e243e HTTP/1.1 Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL2_KTBoQE1biSOdbxiN02s3h0D1W3LZT4KXbL5sweudoA3LIqkhpSDHo_3ElsoW-S4pinCvYVIPwwmg75I3QYjyeUH8E9-UCSOe6Wat6dff2LaBOhzu2fRTo0k0Ryv1Z1NW8ftU_9LakKBqftyUWUBvBSk8oz2eNB_e-v5W7ciYbcII Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 981fdf8ae7524612b9c2f6a3f16c39ec Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 981fdf8ae7524612b9c2f6a3f16c39ec Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-SecurityGroupsTestJSON-321124649-project Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 5ddab9c74c004e74a51fd8008886e542 Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-SecurityGroupsTestJSON-321124649-project Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: exception: Security group a49c3057-be3b-4d9a-a9d9-fc28db0e243e does not exist Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: Neutron server returns request_ids: ['req-fccd8731-5fd3-480a-98a9-9d5f11302d01'] Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'a49c3057-be3b-4d9a-a9d9-fc28db0e243e'} Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 24 21:01:26.222082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a49c3057-be3b-4d9a-a9d9-fc28db0e243e does not exist Sep 24 21:01:26.227015 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fccd8731-5fd3-480a-98a9-9d5f11302d01'] Sep 24 21:01:26.227015 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:01:26.227015 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:26.227015 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:01:26.227015 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:26.227015 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 24 21:01:26.227015 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 24 21:01:26.227015 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 24 21:01:26.227015 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 24 21:01:26.227015 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a49c3057-be3b-4d9a-a9d9-fc28db0e243e does not exist Sep 24 21:01:26.227015 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fccd8731-5fd3-480a-98a9-9d5f11302d01'] Sep 24 21:01:26.227015 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:01:26.227015 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:26.227015 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:01:26.227015 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:26.227015 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:26.227015 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:26.227015 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:01:26.227015 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:01:26.227015 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:01:26.227015 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:01:26.227015 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:01:26.227015 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:01:26.227015 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 24 21:01:26.227015 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 24 21:01:26.227015 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a49c3057-be3b-4d9a-a9d9-fc28db0e243e does not exist Sep 24 21:01:26.227015 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fccd8731-5fd3-480a-98a9-9d5f11302d01'] Sep 24 21:01:26.227015 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:01:26.227015 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:26.227015 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:01:26.227015 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:26.227015 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:26.227015 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:26.227015 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:01:26.227015 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:01:26.227015 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a49c3057-be3b-4d9a-a9d9-fc28db0e243e does not exist Sep 24 21:01:26.227015 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fccd8731-5fd3-480a-98a9-9d5f11302d01'] Sep 24 21:01:26.227015 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:01:26.231912 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2b64c47e-09df-4086-a534-b2c4e76dd7ff tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Returning 404 to user: Security group a49c3057-be3b-4d9a-a9d9-fc28db0e243e does not exist Sep 24 21:01:26.231912 ncdv-master-1 devstack@n-api.service[140517]: Neutron server returns request_ids: ['req-fccd8731-5fd3-480a-98a9-9d5f11302d01'] {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:01:26.233124 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2b64c47e-09df-4086-a534-b2c4e76dd7ff tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/a49c3057-be3b-4d9a-a9d9-fc28db0e243e" status: 404 len: 194 microversion: 2.1 time: 0.151247 Sep 24 21:01:26.234166 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1609/3236] 10.222.0.52 () {58 vars in 1272 bytes} [Sat Sep 24 21:01:26 2022] DELETE /compute/v2.1/os-security-groups/a49c3057-be3b-4d9a-a9d9-fc28db0e243e => generated 194 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:01:26.245444 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8abf4f78-4c12-4233-86ff-d855b20aee1c tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] Calling method '.version_select at 0x7f4b0ce9a4c0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:26.274795 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8abf4f78-4c12-4233-86ff-d855b20aee1c tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1941212445" status: 202 len: 0 microversion: 2.1 time: 0.039216 Sep 24 21:01:26.287315 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1610/3237] 10.222.0.52 () {58 vars in 1221 bytes} [Sat Sep 24 21:01:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1941212445 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:01:26.292884 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5042ff5c-7a4a-4ad1-bc1a-fdb08251923f tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:26.294667 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5042ff5c-7a4a-4ad1-bc1a-fdb08251923f tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 5c119929-2744-4871-b523-0a6a05c6c073] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:26.302449 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5042ff5c-7a4a-4ad1-bc1a-fdb08251923f tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:26.303098 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-35db6456-5eb9-4761-8bec-fdee61639d8b tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:26.304160 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5042ff5c-7a4a-4ad1-bc1a-fdb08251923f tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:26.304985 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5042ff5c-7a4a-4ad1-bc1a-fdb08251923f tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:26.305954 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5042ff5c-7a4a-4ad1-bc1a-fdb08251923f tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:26.306652 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5042ff5c-7a4a-4ad1-bc1a-fdb08251923f tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:26.308063 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5042ff5c-7a4a-4ad1-bc1a-fdb08251923f tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:26.311878 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-35db6456-5eb9-4761-8bec-fdee61639d8b tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2" status: 200 len: 1314 microversion: 2.1 time: 1.173853 Sep 24 21:01:26.312837 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1628/3238] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:25 2022] GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 => generated 1314 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:26.352061 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-56580a75-86ca-4dd7-b427-205b89232021 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:26.352788 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-56580a75-86ca-4dd7-b427-205b89232021 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:26.366040 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5042ff5c-7a4a-4ad1-bc1a-fdb08251923f tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 5c119929-2744-4871-b523-0a6a05c6c073] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:01:26.386179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56580a75-86ca-4dd7-b427-205b89232021 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:26.386916 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56580a75-86ca-4dd7-b427-205b89232021 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:26.387649 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56580a75-86ca-4dd7-b427-205b89232021 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:26.389385 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56580a75-86ca-4dd7-b427-205b89232021 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:26.391457 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56580a75-86ca-4dd7-b427-205b89232021 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:26.394404 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56580a75-86ca-4dd7-b427-205b89232021 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:26.533368 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5042ff5c-7a4a-4ad1-bc1a-fdb08251923f tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073" status: 204 len: 0 microversion: 2.1 time: 0.243733 Sep 24 21:01:26.536002 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1611/3239] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:01:26 2022] DELETE /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:01:26.554705 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c33872f7-8a03-4ed8-a91e-8698e3c85ebd tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '.version_select at 0x7f4b0c9adb80>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:27.006317 ncdv-master-1 devstack@n-api.service[140517]: DEBUG neutronclient.v2_0.client [None req-c33872f7-8a03-4ed8-a91e-8698e3c85ebd tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d1298c50-0c5f-40d9-af8f-6161a17e3ed2 does not exist", "detail": ""}} {{(pid=140517) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 24 21:01:27.006974 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.security_group_api [None req-c33872f7-8a03-4ed8-a91e-8698e3c85ebd tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Neutron security group d1298c50-0c5f-40d9-af8f-6161a17e3ed2 not found {{(pid=140517) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 24 21:01:27.007486 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-c33872f7-8a03-4ed8-a91e-8698e3c85ebd tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] HTTP exception thrown: Security group d1298c50-0c5f-40d9-af8f-6161a17e3ed2 does not exist Sep 24 21:01:27.007486 ncdv-master-1 devstack@n-api.service[140517]: Neutron server returns request_ids: ['req-6695961b-0460-440e-82d6-b43e8160fb0e'] Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c33872f7-8a03-4ed8-a91e-8698e3c85ebd tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Request method failure captured: Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/os-security-groups/d1298c50-0c5f-40d9-af8f-6161a17e3ed2 HTTP/1.1 Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL2_KTBoQE1biSOdbxiN02s3h0D1W3LZT4KXbL5sweudoA3LIqkhpSDHo_3ElsoW-S4pinCvYVIPwwmg75I3QYjyeUH8E9-UCSOe6Wat6dff2LaBOhzu2fRTo0k0Ryv1Z1NW8ftU_9LakKBqftyUWUBvBSk8oz2eNB_e-v5W7ciYbcII Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 981fdf8ae7524612b9c2f6a3f16c39ec Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 981fdf8ae7524612b9c2f6a3f16c39ec Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-SecurityGroupsTestJSON-321124649-project Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 5ddab9c74c004e74a51fd8008886e542 Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-SecurityGroupsTestJSON-321124649-project Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: exception: Security group d1298c50-0c5f-40d9-af8f-6161a17e3ed2 does not exist Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: Neutron server returns request_ids: ['req-6695961b-0460-440e-82d6-b43e8160fb0e'] Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'd1298c50-0c5f-40d9-af8f-6161a17e3ed2'} Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 24 21:01:27.009442 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d1298c50-0c5f-40d9-af8f-6161a17e3ed2 does not exist Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6695961b-0460-440e-82d6-b43e8160fb0e'] Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d1298c50-0c5f-40d9-af8f-6161a17e3ed2 does not exist Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6695961b-0460-440e-82d6-b43e8160fb0e'] Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d1298c50-0c5f-40d9-af8f-6161a17e3ed2 does not exist Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6695961b-0460-440e-82d6-b43e8160fb0e'] Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d1298c50-0c5f-40d9-af8f-6161a17e3ed2 does not exist Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6695961b-0460-440e-82d6-b43e8160fb0e'] Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c33872f7-8a03-4ed8-a91e-8698e3c85ebd tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Returning 404 to user: Security group d1298c50-0c5f-40d9-af8f-6161a17e3ed2 does not exist Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: Neutron server returns request_ids: ['req-6695961b-0460-440e-82d6-b43e8160fb0e'] {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c33872f7-8a03-4ed8-a91e-8698e3c85ebd tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/d1298c50-0c5f-40d9-af8f-6161a17e3ed2" status: 404 len: 194 microversion: 2.1 time: 0.473350 Sep 24 21:01:27.017943 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1612/3240] 10.222.0.52 () {58 vars in 1272 bytes} [Sat Sep 24 21:01:26 2022] DELETE /compute/v2.1/os-security-groups/d1298c50-0c5f-40d9-af8f-6161a17e3ed2 => generated 194 bytes in 475 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:01:27.021987 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-590c1c20-f298-4b89-939f-de8223cc3211 tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] Action: 'create', calling method: .version_select at 0x7f4b0cb29dc0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-850555808", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPW5mBqErcJRD7yiB5hjG+MflQJYbo2XX7JgCYA3o0ukwUcalcBNEcwZ1gMPD1xxtFogdvDx4QWoN8D0cp1OglDUJoziY7+N6rKc6DjI4WLnLfimST3TMSoAuPxNBY6hA=="}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:27.043527 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-590c1c20-f298-4b89-939f-de8223cc3211 tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] Getting quotas for project 212a64f6557143739a2f3d232127ccbf. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:01:27.050135 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-590c1c20-f298-4b89-939f-de8223cc3211 tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] Getting quotas for user 4a0e7b0511294f0d95ee52d8dacd6446 and project 212a64f6557143739a2f3d232127ccbf. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:01:27.082393 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-590c1c20-f298-4b89-939f-de8223cc3211 tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.068733 Sep 24 21:01:27.092701 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1613/3241] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 21:01:27 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:27.101811 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f0151629-eee2-4f48-9641-16f352334050 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.7.247"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:27.105250 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f0151629-eee2-4f48-9641-16f352334050 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:27.114506 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f0151629-eee2-4f48-9641-16f352334050 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:27.115365 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f0151629-eee2-4f48-9641-16f352334050 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:27.116040 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f0151629-eee2-4f48-9641-16f352334050 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:27.117441 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f0151629-eee2-4f48-9641-16f352334050 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:27.118142 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f0151629-eee2-4f48-9641-16f352334050 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:27.119065 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f0151629-eee2-4f48-9641-16f352334050 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:27.150412 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f0151629-eee2-4f48-9641-16f352334050 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "refresh_cache-547cf9a4-1d05-4cbd-bb2b-ee5cbd406130" {{(pid=140517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 24 21:01:27.151186 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f0151629-eee2-4f48-9641-16f352334050 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquired lock "refresh_cache-547cf9a4-1d05-4cbd-bb2b-ee5cbd406130" {{(pid=140517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 24 21:01:27.270082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-56580a75-86ca-4dd7-b427-205b89232021 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:27.279036 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-56580a75-86ca-4dd7-b427-205b89232021 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1686 microversion: 2.1 time: 0.945973 Sep 24 21:01:27.279792 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1629/3242] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:26 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1686 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:27.285114 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0734825f-30f2-4bfe-a0f0-d0f634087f3e tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:27.285997 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0734825f-30f2-4bfe-a0f0-d0f634087f3e tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] [instance: ab5b3a44-e594-4cc2-8d36-51b15722edae] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:27.292666 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0734825f-30f2-4bfe-a0f0-d0f634087f3e tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:27.293516 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0734825f-30f2-4bfe-a0f0-d0f634087f3e tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:27.294390 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0734825f-30f2-4bfe-a0f0-d0f634087f3e tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:27.295769 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0734825f-30f2-4bfe-a0f0-d0f634087f3e tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:27.296449 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0734825f-30f2-4bfe-a0f0-d0f634087f3e tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:27.297119 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0734825f-30f2-4bfe-a0f0-d0f634087f3e tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:28.312230 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0734825f-30f2-4bfe-a0f0-d0f634087f3e tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c49bed91bb437087a8ad2d865c2647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b68f292633a49ca82fb05d18ea83142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:28.329023 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0734825f-30f2-4bfe-a0f0-d0f634087f3e tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] 10.222.0.52 "GET /compute/v2.1/servers/ab5b3a44-e594-4cc2-8d36-51b15722edae" status: 200 len: 1317 microversion: 2.1 time: 1.047792 Sep 24 21:01:28.343459 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1630/3243] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:27 2022] GET /compute/v2.1/servers/ab5b3a44-e594-4cc2-8d36-51b15722edae => generated 1317 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:28.355155 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-782e887b-287c-4479-b572-c89e7d025870 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '.version_select at 0x7f4b0c100ee0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:28.488854 ncdv-master-1 devstack@n-api.service[140516]: DEBUG neutronclient.v2_0.client [None req-782e887b-287c-4479-b572-c89e7d025870 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ea0c2e7a-6b48-448d-83eb-c131cba89471 does not exist", "detail": ""}} {{(pid=140516) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 24 21:01:28.496191 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.security_group_api [None req-782e887b-287c-4479-b572-c89e7d025870 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Neutron security group ea0c2e7a-6b48-448d-83eb-c131cba89471 not found {{(pid=140516) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 24 21:01:28.504674 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-782e887b-287c-4479-b572-c89e7d025870 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] HTTP exception thrown: Security group ea0c2e7a-6b48-448d-83eb-c131cba89471 does not exist Sep 24 21:01:28.504674 ncdv-master-1 devstack@n-api.service[140516]: Neutron server returns request_ids: ['req-8becb3fb-e76b-4aba-b11d-0261f8e763e8'] Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-782e887b-287c-4479-b572-c89e7d025870 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Request method failure captured: Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/os-security-groups/ea0c2e7a-6b48-448d-83eb-c131cba89471 HTTP/1.1 Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL2_KTBoQE1biSOdbxiN02s3h0D1W3LZT4KXbL5sweudoA3LIqkhpSDHo_3ElsoW-S4pinCvYVIPwwmg75I3QYjyeUH8E9-UCSOe6Wat6dff2LaBOhzu2fRTo0k0Ryv1Z1NW8ftU_9LakKBqftyUWUBvBSk8oz2eNB_e-v5W7ciYbcII Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 981fdf8ae7524612b9c2f6a3f16c39ec Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 981fdf8ae7524612b9c2f6a3f16c39ec Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-SecurityGroupsTestJSON-321124649-project Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 5ddab9c74c004e74a51fd8008886e542 Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-SecurityGroupsTestJSON-321124649-project Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: exception: Security group ea0c2e7a-6b48-448d-83eb-c131cba89471 does not exist Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: Neutron server returns request_ids: ['req-8becb3fb-e76b-4aba-b11d-0261f8e763e8'] Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'ea0c2e7a-6b48-448d-83eb-c131cba89471'} Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 24 21:01:28.511661 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ea0c2e7a-6b48-448d-83eb-c131cba89471 does not exist Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8becb3fb-e76b-4aba-b11d-0261f8e763e8'] Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ea0c2e7a-6b48-448d-83eb-c131cba89471 does not exist Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8becb3fb-e76b-4aba-b11d-0261f8e763e8'] Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ea0c2e7a-6b48-448d-83eb-c131cba89471 does not exist Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8becb3fb-e76b-4aba-b11d-0261f8e763e8'] Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ea0c2e7a-6b48-448d-83eb-c131cba89471 does not exist Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8becb3fb-e76b-4aba-b11d-0261f8e763e8'] Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-782e887b-287c-4479-b572-c89e7d025870 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Returning 404 to user: Security group ea0c2e7a-6b48-448d-83eb-c131cba89471 does not exist Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: Neutron server returns request_ids: ['req-8becb3fb-e76b-4aba-b11d-0261f8e763e8'] {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:01:28.517253 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-782e887b-287c-4479-b572-c89e7d025870 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/ea0c2e7a-6b48-448d-83eb-c131cba89471" status: 404 len: 194 microversion: 2.1 time: 0.170748 Sep 24 21:01:28.521583 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1631/3244] 10.222.0.52 () {58 vars in 1272 bytes} [Sat Sep 24 21:01:28 2022] DELETE /compute/v2.1/os-security-groups/ea0c2e7a-6b48-448d-83eb-c131cba89471 => generated 194 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:01:28.556779 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7f37ea7a-edd1-46cb-b3a6-603375547d73 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:28.560281 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7f37ea7a-edd1-46cb-b3a6-603375547d73 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:28.571797 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f37ea7a-edd1-46cb-b3a6-603375547d73 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:28.572293 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f37ea7a-edd1-46cb-b3a6-603375547d73 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:28.575584 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f37ea7a-edd1-46cb-b3a6-603375547d73 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:28.576780 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f37ea7a-edd1-46cb-b3a6-603375547d73 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:28.577274 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f37ea7a-edd1-46cb-b3a6-603375547d73 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:28.577722 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f37ea7a-edd1-46cb-b3a6-603375547d73 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:28.651101 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7f37ea7a-edd1-46cb-b3a6-603375547d73 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.127535 Sep 24 21:01:28.652042 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1632/3245] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:01:28 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:01:28.667667 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ee3a7dd7-5336-49df-9ce3-eaf3e5ca2978 tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] Action: 'create', calling method: .version_select at 0x7f4b0c0ea3a0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-887861698", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEvE9BTViaImouX2YsXyvKRsfNB8GcoOEi66Fsm461wA6KJkIDVCAKSy8I4egIvssCcpu+0RS0ZtB81SA/7/hvwiy/Q327PqTSyvPIPaWmc6X73xxciaiedOV5oGo21Zg=="}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:28.682179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=8,nova_api:DELETE=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:01:28.692321 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-ee3a7dd7-5336-49df-9ce3-eaf3e5ca2978 tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] Getting quotas for project 212a64f6557143739a2f3d232127ccbf. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:01:28.698780 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-ee3a7dd7-5336-49df-9ce3-eaf3e5ca2978 tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] Getting quotas for user 4a0e7b0511294f0d95ee52d8dacd6446 and project 212a64f6557143739a2f3d232127ccbf. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:01:28.748973 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ee3a7dd7-5336-49df-9ce3-eaf3e5ca2978 tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.094540 Sep 24 21:01:28.759150 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1633/3246] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 21:01:28 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:28.759150 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3914c287-dbfa-4182-91a0-a8bea313923c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:28.759150 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3914c287-dbfa-4182-91a0-a8bea313923c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:28.765689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3914c287-dbfa-4182-91a0-a8bea313923c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:28.766310 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3914c287-dbfa-4182-91a0-a8bea313923c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:28.766977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3914c287-dbfa-4182-91a0-a8bea313923c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:28.767641 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3914c287-dbfa-4182-91a0-a8bea313923c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:28.768168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3914c287-dbfa-4182-91a0-a8bea313923c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:28.768909 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3914c287-dbfa-4182-91a0-a8bea313923c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:29.439927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3914c287-dbfa-4182-91a0-a8bea313923c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:29.461480 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3914c287-dbfa-4182-91a0-a8bea313923c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2" status: 200 len: 1314 microversion: 2.1 time: 0.710094 Sep 24 21:01:29.465051 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1634/3247] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:28 2022] GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 => generated 1314 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:29.473260 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-8a024cb4-712c-4ac5-8917-dee4f04484c2 req-bde19f0f-dc74-4a6e-ba7f-0ea09f53ba11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3938cda7-a3b7-4be8-9ea5-79ec625a5bd2", "tag": "a42b250b-5b9b-44f2-939c-4f7b443d78b9"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:29.485383 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-8a024cb4-712c-4ac5-8917-dee4f04484c2 req-bde19f0f-dc74-4a6e-ba7f-0ea09f53ba11 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:29.486078 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-8a024cb4-712c-4ac5-8917-dee4f04484c2 req-bde19f0f-dc74-4a6e-ba7f-0ea09f53ba11 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:29.486810 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-8a024cb4-712c-4ac5-8917-dee4f04484c2 req-bde19f0f-dc74-4a6e-ba7f-0ea09f53ba11 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:29.520631 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-8a024cb4-712c-4ac5-8917-dee4f04484c2 req-bde19f0f-dc74-4a6e-ba7f-0ea09f53ba11 service nova] Creating event network-changed:a42b250b-5b9b-44f2-939c-4f7b443d78b9 for instance 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 on nch1-master-1 Sep 24 21:01:29.551346 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-8a024cb4-712c-4ac5-8917-dee4f04484c2 req-bde19f0f-dc74-4a6e-ba7f-0ea09f53ba11 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081746 Sep 24 21:01:29.552684 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1635/3248] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:29.562818 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-3e97f90f-7783-455e-ad5b-91cce77c14ee req-7eebaf89-179f-4b0b-9791-d94bfc8249dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c660bb73-2186-4c86-b57b-0c6c3be5c9bf", "name": "network-vif-deleted", "tag": "3c3743a2-0126-4864-bed2-ea84c10b230a"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:29.575770 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-3e97f90f-7783-455e-ad5b-91cce77c14ee req-7eebaf89-179f-4b0b-9791-d94bfc8249dc service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:29.579178 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-3e97f90f-7783-455e-ad5b-91cce77c14ee req-7eebaf89-179f-4b0b-9791-d94bfc8249dc service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:29.579966 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-3e97f90f-7783-455e-ad5b-91cce77c14ee req-7eebaf89-179f-4b0b-9791-d94bfc8249dc service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:29.602596 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-3e97f90f-7783-455e-ad5b-91cce77c14ee req-7eebaf89-179f-4b0b-9791-d94bfc8249dc service nova] Creating event network-vif-deleted:3c3743a2-0126-4864-bed2-ea84c10b230a for instance c660bb73-2186-4c86-b57b-0c6c3be5c9bf on nch2-master-1 Sep 24 21:01:29.612752 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-3e97f90f-7783-455e-ad5b-91cce77c14ee req-7eebaf89-179f-4b0b-9791-d94bfc8249dc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057638 Sep 24 21:01:29.615663 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1636/3249] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:29.623045 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-543357ab-3968-445c-8477-74aa29753342 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:29.624828 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-543357ab-3968-445c-8477-74aa29753342 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:29.636307 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-543357ab-3968-445c-8477-74aa29753342 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:29.636307 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-543357ab-3968-445c-8477-74aa29753342 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:29.636307 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-543357ab-3968-445c-8477-74aa29753342 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:29.636307 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-543357ab-3968-445c-8477-74aa29753342 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:29.636307 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-543357ab-3968-445c-8477-74aa29753342 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:29.636699 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-543357ab-3968-445c-8477-74aa29753342 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:29.648221 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:01:30.263901 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-543357ab-3968-445c-8477-74aa29753342 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:30.273281 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-543357ab-3968-445c-8477-74aa29753342 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1681 microversion: 2.1 time: 0.656092 Sep 24 21:01:30.280004 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1637/3250] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:29 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1681 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:30.288058 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-5b733308-7a12-41bc-926a-8d11352dacb3 req-d9757a5b-df74-4a76-976b-0abd4e270172 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d546302-deb3-47c6-b9fd-3155ced00883", "name": "network-vif-plugged", "status": "completed", "tag": "56949465-71b8-45bb-b1d2-4b934bfc9714"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:30.316196 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-5b733308-7a12-41bc-926a-8d11352dacb3 req-d9757a5b-df74-4a76-976b-0abd4e270172 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:30.317035 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-5b733308-7a12-41bc-926a-8d11352dacb3 req-d9757a5b-df74-4a76-976b-0abd4e270172 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:30.317673 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-5b733308-7a12-41bc-926a-8d11352dacb3 req-d9757a5b-df74-4a76-976b-0abd4e270172 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:30.346592 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-5b733308-7a12-41bc-926a-8d11352dacb3 req-d9757a5b-df74-4a76-976b-0abd4e270172 service nova] Creating event network-vif-plugged:56949465-71b8-45bb-b1d2-4b934bfc9714 for instance 0d546302-deb3-47c6-b9fd-3155ced00883 on nch1-master-1 Sep 24 21:01:30.356947 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-5b733308-7a12-41bc-926a-8d11352dacb3 req-d9757a5b-df74-4a76-976b-0abd4e270172 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071919 Sep 24 21:01:30.361870 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1638/3251] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:30.369876 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-290b2803-ed5a-4087-98fb-67e57a7123b5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '.version_select at 0x7f4b0c0c6b80>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:31.065057 ncdv-master-1 devstack@n-api.service[140516]: DEBUG neutronclient.v2_0.client [None req-290b2803-ed5a-4087-98fb-67e57a7123b5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c933467f-b7cd-4c3b-9712-730215a97d52 does not exist", "detail": ""}} {{(pid=140516) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 24 21:01:31.066481 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.security_group_api [None req-290b2803-ed5a-4087-98fb-67e57a7123b5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Neutron security group c933467f-b7cd-4c3b-9712-730215a97d52 not found {{(pid=140516) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 24 21:01:31.067622 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-290b2803-ed5a-4087-98fb-67e57a7123b5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] HTTP exception thrown: Security group c933467f-b7cd-4c3b-9712-730215a97d52 does not exist Sep 24 21:01:31.067622 ncdv-master-1 devstack@n-api.service[140516]: Neutron server returns request_ids: ['req-c208502c-e61f-458e-929d-0be28f823cb1'] Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-290b2803-ed5a-4087-98fb-67e57a7123b5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Request method failure captured: Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/os-security-groups/c933467f-b7cd-4c3b-9712-730215a97d52 HTTP/1.1 Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL2_KTBoQE1biSOdbxiN02s3h0D1W3LZT4KXbL5sweudoA3LIqkhpSDHo_3ElsoW-S4pinCvYVIPwwmg75I3QYjyeUH8E9-UCSOe6Wat6dff2LaBOhzu2fRTo0k0Ryv1Z1NW8ftU_9LakKBqftyUWUBvBSk8oz2eNB_e-v5W7ciYbcII Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 981fdf8ae7524612b9c2f6a3f16c39ec Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 981fdf8ae7524612b9c2f6a3f16c39ec Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-SecurityGroupsTestJSON-321124649-project Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 5ddab9c74c004e74a51fd8008886e542 Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-SecurityGroupsTestJSON-321124649-project Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: exception: Security group c933467f-b7cd-4c3b-9712-730215a97d52 does not exist Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: Neutron server returns request_ids: ['req-c208502c-e61f-458e-929d-0be28f823cb1'] Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'c933467f-b7cd-4c3b-9712-730215a97d52'} Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 24 21:01:31.071450 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c933467f-b7cd-4c3b-9712-730215a97d52 does not exist Sep 24 21:01:31.076813 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c208502c-e61f-458e-929d-0be28f823cb1'] Sep 24 21:01:31.076813 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:31.076813 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:31.076813 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:31.076813 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:31.076813 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 24 21:01:31.076813 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 24 21:01:31.076813 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 24 21:01:31.076813 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 24 21:01:31.076813 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c933467f-b7cd-4c3b-9712-730215a97d52 does not exist Sep 24 21:01:31.076813 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c208502c-e61f-458e-929d-0be28f823cb1'] Sep 24 21:01:31.076813 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:31.076813 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:31.076813 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:31.076813 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:31.076813 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:31.076813 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:31.076813 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:01:31.076813 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:01:31.076813 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:01:31.076813 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:01:31.076813 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:01:31.076813 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:01:31.076813 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 24 21:01:31.076813 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 24 21:01:31.076813 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c933467f-b7cd-4c3b-9712-730215a97d52 does not exist Sep 24 21:01:31.076813 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c208502c-e61f-458e-929d-0be28f823cb1'] Sep 24 21:01:31.076813 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:31.076813 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:31.076813 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:31.076813 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:31.076813 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:31.076813 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:31.076813 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:01:31.076813 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:01:31.076813 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c933467f-b7cd-4c3b-9712-730215a97d52 does not exist Sep 24 21:01:31.076813 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c208502c-e61f-458e-929d-0be28f823cb1'] Sep 24 21:01:31.076813 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:31.085752 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-290b2803-ed5a-4087-98fb-67e57a7123b5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Returning 404 to user: Security group c933467f-b7cd-4c3b-9712-730215a97d52 does not exist Sep 24 21:01:31.085752 ncdv-master-1 devstack@n-api.service[140516]: Neutron server returns request_ids: ['req-c208502c-e61f-458e-929d-0be28f823cb1'] {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:01:31.086945 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-290b2803-ed5a-4087-98fb-67e57a7123b5 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/c933467f-b7cd-4c3b-9712-730215a97d52" status: 404 len: 194 microversion: 2.1 time: 0.723565 Sep 24 21:01:31.088385 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1639/3252] 10.222.0.52 () {58 vars in 1272 bytes} [Sat Sep 24 21:01:30 2022] DELETE /compute/v2.1/os-security-groups/c933467f-b7cd-4c3b-9712-730215a97d52 => generated 194 bytes in 726 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:01:31.099920 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f350dc3d-0167-467a-a733-e2359f00569c tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] Action: 'create', calling method: .version_select at 0x7f4b0c0ea1f0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1981100196", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArpwPkQeiq2IfapK3xEjyAXzysMXbTxN/zs8OTxiE98SiZGuDKkgQpELycLy1LgZe48sQJKBjEjQPjQUQg3BE1VyBJuaJ7yMkqhQTI3ZUfv54Wey6b2Y4RP/DxL/9KEAQ=="}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:31.123540 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-f350dc3d-0167-467a-a733-e2359f00569c tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] Getting quotas for project 212a64f6557143739a2f3d232127ccbf. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:01:31.132746 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-f350dc3d-0167-467a-a733-e2359f00569c tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] Getting quotas for user 4a0e7b0511294f0d95ee52d8dacd6446 and project 212a64f6557143739a2f3d232127ccbf. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:01:31.201767 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f350dc3d-0167-467a-a733-e2359f00569c tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.111974 Sep 24 21:01:31.202394 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1640/3253] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 21:01:31 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:31.231075 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-f0151629-eee2-4f48-9641-16f352334050 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130] Building network info cache for instance {{(pid=140517) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 24 21:01:31.489122 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0017d900-aded-46b0-911e-ad8e7d6905e1 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1641454148", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "9685638f-80ca-4a4f-8996-ce8dedf3d930"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:31.585281 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-0017d900-aded-46b0-911e-ad8e7d6905e1 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] validate_networks() for [('9685638f-80ca-4a4f-8996-ce8dedf3d930', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:01:32.453281 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=4 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:01:32.791365 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-0017d900-aded-46b0-911e-ad8e7d6905e1 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:01:32.791866 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-0017d900-aded-46b0-911e-ad8e7d6905e1 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:01:32.792642 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-0017d900-aded-46b0-911e-ad8e7d6905e1 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:01:32.793169 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-0017d900-aded-46b0-911e-ad8e7d6905e1 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:01:32.795000 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-0017d900-aded-46b0-911e-ad8e7d6905e1 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:01:32.853371 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0017d900-aded-46b0-911e-ad8e7d6905e1 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:32.854377 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0017d900-aded-46b0-911e-ad8e7d6905e1 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:32.855041 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0017d900-aded-46b0-911e-ad8e7d6905e1 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:32.855975 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0017d900-aded-46b0-911e-ad8e7d6905e1 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:32.859133 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0017d900-aded-46b0-911e-ad8e7d6905e1 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:32.859767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0017d900-aded-46b0-911e-ad8e7d6905e1 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:32.890093 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-0017d900-aded-46b0-911e-ad8e7d6905e1 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Getting quotas for project 1408039f0bcf4130a11bedb2206b3cec. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:01:32.917120 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-0017d900-aded-46b0-911e-ad8e7d6905e1 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Getting quotas for user 5e9e57183b3b49c1ba39b5503420b93e and project 1408039f0bcf4130a11bedb2206b3cec. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:01:32.951007 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0017d900-aded-46b0-911e-ad8e7d6905e1 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:01:32.967078 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0017d900-aded-46b0-911e-ad8e7d6905e1 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] [instance: 06c6c840-ee24-4802-bf10-e17f5dfe54ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:01:33.042647 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0017d900-aded-46b0-911e-ad8e7d6905e1 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.838893 Sep 24 21:01:33.043270 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1641/3254] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:01:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:01:33.055742 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4d3cbe9b-2704-4922-823d-4feab9708668 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:33.056799 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4d3cbe9b-2704-4922-823d-4feab9708668 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] [instance: ab5b3a44-e594-4cc2-8d36-51b15722edae] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:33.081032 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4d3cbe9b-2704-4922-823d-4feab9708668 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:33.092453 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4d3cbe9b-2704-4922-823d-4feab9708668 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:33.093171 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4d3cbe9b-2704-4922-823d-4feab9708668 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:33.094119 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4d3cbe9b-2704-4922-823d-4feab9708668 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:33.096074 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4d3cbe9b-2704-4922-823d-4feab9708668 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:33.097244 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4d3cbe9b-2704-4922-823d-4feab9708668 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:33.707729 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-f0151629-eee2-4f48-9641-16f352334050 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130] Updating instance_info_cache with network_info: [{"id": "52b5470e-7c8d-4f6a-b42e-9c45da96e2f1", "address": "fa:16:3e:4c:0c:cb", "network": {"id": "b9fc93d3-0ad7-483a-aed0-543890dc0a39", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1279734249-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.7.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d4655b536ca04896993223f34d172298", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap52b5470e-7c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140517) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 24 21:01:33.733571 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f0151629-eee2-4f48-9641-16f352334050 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Releasing lock "refresh_cache-547cf9a4-1d05-4cbd-bb2b-ee5cbd406130" {{(pid=140517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 24 21:01:33.734728 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f0151629-eee2-4f48-9641-16f352334050 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "POST /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130/action" status: 202 len: 0 microversion: 2.1 time: 6.638664 Sep 24 21:01:33.737191 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1614/3255] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:01:27 2022] POST /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130/action => generated 0 bytes in 6642 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 24 21:01:33.756202 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7ea250e4-db6e-46a5-8a81-25f0fc5f9efc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:33.764289 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7ea250e4-db6e-46a5-8a81-25f0fc5f9efc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:33.775520 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7ea250e4-db6e-46a5-8a81-25f0fc5f9efc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:33.776037 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7ea250e4-db6e-46a5-8a81-25f0fc5f9efc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:33.776487 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7ea250e4-db6e-46a5-8a81-25f0fc5f9efc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:33.777216 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7ea250e4-db6e-46a5-8a81-25f0fc5f9efc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:33.777680 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7ea250e4-db6e-46a5-8a81-25f0fc5f9efc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:33.788662 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7ea250e4-db6e-46a5-8a81-25f0fc5f9efc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:33.847922 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7ea250e4-db6e-46a5-8a81-25f0fc5f9efc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.108353 Sep 24 21:01:33.852593 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1615/3256] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:01:33 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:01:33.853605 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-612dc0ea-43a1-46ba-bbbf-a0c98966d4d3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:33.854600 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-612dc0ea-43a1-46ba-bbbf-a0c98966d4d3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:33.862718 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-612dc0ea-43a1-46ba-bbbf-a0c98966d4d3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:33.863408 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-612dc0ea-43a1-46ba-bbbf-a0c98966d4d3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:33.864049 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-612dc0ea-43a1-46ba-bbbf-a0c98966d4d3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:33.864949 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-612dc0ea-43a1-46ba-bbbf-a0c98966d4d3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:33.865572 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-612dc0ea-43a1-46ba-bbbf-a0c98966d4d3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:33.866284 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-612dc0ea-43a1-46ba-bbbf-a0c98966d4d3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:34.453951 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4d3cbe9b-2704-4922-823d-4feab9708668 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c49bed91bb437087a8ad2d865c2647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b68f292633a49ca82fb05d18ea83142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:34.466829 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4d3cbe9b-2704-4922-823d-4feab9708668 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] 10.222.0.52 "GET /compute/v2.1/servers/ab5b3a44-e594-4cc2-8d36-51b15722edae" status: 200 len: 1317 microversion: 2.1 time: 1.412044 Sep 24 21:01:34.467891 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1642/3257] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:33 2022] GET /compute/v2.1/servers/ab5b3a44-e594-4cc2-8d36-51b15722edae => generated 1317 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:34.487680 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7ff99337-659e-41f8-b589-9e684a4d6251 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:34.491412 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7ff99337-659e-41f8-b589-9e684a4d6251 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 1cceb126-5c30-4c10-b02f-f6a27a7420c8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:34.506587 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ff99337-659e-41f8-b589-9e684a4d6251 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:34.507502 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ff99337-659e-41f8-b589-9e684a4d6251 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:34.509045 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ff99337-659e-41f8-b589-9e684a4d6251 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:34.511788 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ff99337-659e-41f8-b589-9e684a4d6251 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:34.512542 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ff99337-659e-41f8-b589-9e684a4d6251 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:34.516340 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ff99337-659e-41f8-b589-9e684a4d6251 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:34.580382 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7ff99337-659e-41f8-b589-9e684a4d6251 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 1cceb126-5c30-4c10-b02f-f6a27a7420c8] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:01:34.738591 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7ff99337-659e-41f8-b589-9e684a4d6251 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8" status: 204 len: 0 microversion: 2.1 time: 0.259801 Sep 24 21:01:34.741330 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1643/3258] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:01:34 2022] DELETE /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:01:34.750931 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-93e7b3b6-5516-48ea-909c-f61429909906 tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] Calling method '.version_select at 0x7f4b0c13c430>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:34.765118 ncdv-master-1 devstack@n-api.service[140516]: WARNING oslo_db.sqlalchemy.utils [None req-93e7b3b6-5516-48ea-909c-f61429909906 tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 24 21:01:34.774802 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-93e7b3b6-5516-48ea-909c-f61429909906 tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.031975 Sep 24 21:01:34.777686 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1644/3259] 10.222.0.52 () {58 vars in 1137 bytes} [Sat Sep 24 21:01:34 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:34.786571 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5f6aee48-ddfc-46e0-984e-0ffb3a0a4d05 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:34.788224 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5f6aee48-ddfc-46e0-984e-0ffb3a0a4d05 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:34.802857 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-612dc0ea-43a1-46ba-bbbf-a0c98966d4d3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:34.805863 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f6aee48-ddfc-46e0-984e-0ffb3a0a4d05 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:34.806810 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f6aee48-ddfc-46e0-984e-0ffb3a0a4d05 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:34.807477 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f6aee48-ddfc-46e0-984e-0ffb3a0a4d05 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:34.808589 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f6aee48-ddfc-46e0-984e-0ffb3a0a4d05 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:34.809448 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f6aee48-ddfc-46e0-984e-0ffb3a0a4d05 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:34.810107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f6aee48-ddfc-46e0-984e-0ffb3a0a4d05 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:34.834989 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-612dc0ea-43a1-46ba-bbbf-a0c98966d4d3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2" status: 200 len: 1314 microversion: 2.1 time: 0.974247 Sep 24 21:01:34.844736 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1616/3260] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:33 2022] GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 => generated 1314 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:34.861244 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-e52df4e2-0066-49ea-9142-eb2c80c0eb1a req-2f7e8cfb-4ee1-478d-b565-54d4b82b8288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c119929-2744-4871-b523-0a6a05c6c073", "name": "network-vif-deleted", "tag": "328bc618-9c61-46b1-a53c-716485f1d492"}, {"name": "network-changed", "server_uuid": "547cf9a4-1d05-4cbd-bb2b-ee5cbd406130", "tag": "52b5470e-7c8d-4f6a-b42e-9c45da96e2f1"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:34.878911 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:01:34.898875 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e52df4e2-0066-49ea-9142-eb2c80c0eb1a req-2f7e8cfb-4ee1-478d-b565-54d4b82b8288 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:34.899743 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e52df4e2-0066-49ea-9142-eb2c80c0eb1a req-2f7e8cfb-4ee1-478d-b565-54d4b82b8288 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:34.900408 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e52df4e2-0066-49ea-9142-eb2c80c0eb1a req-2f7e8cfb-4ee1-478d-b565-54d4b82b8288 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:34.916232 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-e52df4e2-0066-49ea-9142-eb2c80c0eb1a req-2f7e8cfb-4ee1-478d-b565-54d4b82b8288 service nova] Creating event network-vif-deleted:328bc618-9c61-46b1-a53c-716485f1d492 for instance 5c119929-2744-4871-b523-0a6a05c6c073 on nch1-master-1 Sep 24 21:01:34.917296 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-e52df4e2-0066-49ea-9142-eb2c80c0eb1a req-2f7e8cfb-4ee1-478d-b565-54d4b82b8288 service nova] Creating event network-changed:52b5470e-7c8d-4f6a-b42e-9c45da96e2f1 for instance 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130 on nch2-master-1 Sep 24 21:01:34.927847 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-e52df4e2-0066-49ea-9142-eb2c80c0eb1a req-2f7e8cfb-4ee1-478d-b565-54d4b82b8288 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.081301 Sep 24 21:01:34.929080 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1617/3261] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:34.934767 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-f8383f43-c8fd-4310-b54b-7fd9beb719f8 req-b5d497e0-1250-468c-955e-9ba1ac26dbc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab5b3a44-e594-4cc2-8d36-51b15722edae", "tag": "0d7ec7f2-aabd-4f1b-a5ce-5ad1414dd9cb"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:34.946083 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-f8383f43-c8fd-4310-b54b-7fd9beb719f8 req-b5d497e0-1250-468c-955e-9ba1ac26dbc0 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:34.946949 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-f8383f43-c8fd-4310-b54b-7fd9beb719f8 req-b5d497e0-1250-468c-955e-9ba1ac26dbc0 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:34.947749 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-f8383f43-c8fd-4310-b54b-7fd9beb719f8 req-b5d497e0-1250-468c-955e-9ba1ac26dbc0 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:34.972948 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-f8383f43-c8fd-4310-b54b-7fd9beb719f8 req-b5d497e0-1250-468c-955e-9ba1ac26dbc0 service nova] Creating event network-changed:0d7ec7f2-aabd-4f1b-a5ce-5ad1414dd9cb for instance ab5b3a44-e594-4cc2-8d36-51b15722edae on nch2-master-1 Sep 24 21:01:35.016443 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-f8383f43-c8fd-4310-b54b-7fd9beb719f8 req-b5d497e0-1250-468c-955e-9ba1ac26dbc0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083419 Sep 24 21:01:35.021130 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1618/3262] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:35.035169 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b110e878-d569-43af-8790-0007011bb279 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:35.035581 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b110e878-d569-43af-8790-0007011bb279 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] [instance: 06c6c840-ee24-4802-bf10-e17f5dfe54ae] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:35.046332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b110e878-d569-43af-8790-0007011bb279 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:35.047256 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b110e878-d569-43af-8790-0007011bb279 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:35.048000 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b110e878-d569-43af-8790-0007011bb279 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:35.048979 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b110e878-d569-43af-8790-0007011bb279 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:35.050948 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b110e878-d569-43af-8790-0007011bb279 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:35.052052 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b110e878-d569-43af-8790-0007011bb279 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:35.339488 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b110e878-d569-43af-8790-0007011bb279 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9e57183b3b49c1ba39b5503420b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1408039f0bcf4130a11bedb2206b3cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:35.369879 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b110e878-d569-43af-8790-0007011bb279 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] 10.222.0.52 "GET /compute/v2.1/servers/06c6c840-ee24-4802-bf10-e17f5dfe54ae" status: 200 len: 1269 microversion: 2.1 time: 0.346830 Sep 24 21:01:35.389082 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1619/3263] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:35 2022] GET /compute/v2.1/servers/06c6c840-ee24-4802-bf10-e17f5dfe54ae => generated 1269 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:35.397466 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-209112aa-e29d-4409-8b7c-90cfbbc8de8c tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Calling method '.version_select at 0x7f4b0cfb2f70>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:35.460297 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5f6aee48-ddfc-46e0-984e-0ffb3a0a4d05 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:35.471163 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5f6aee48-ddfc-46e0-984e-0ffb3a0a4d05 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1681 microversion: 2.1 time: 0.691365 Sep 24 21:01:35.476854 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1645/3264] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:34 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1681 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:35.486194 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-aced7a2e-b2f2-477b-93ba-bec7eb996d9b tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:35.493662 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-aced7a2e-b2f2-477b-93ba-bec7eb996d9b tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 1cceb126-5c30-4c10-b02f-f6a27a7420c8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:35.510640 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aced7a2e-b2f2-477b-93ba-bec7eb996d9b tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:35.511189 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aced7a2e-b2f2-477b-93ba-bec7eb996d9b tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:35.511853 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aced7a2e-b2f2-477b-93ba-bec7eb996d9b tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:35.513014 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aced7a2e-b2f2-477b-93ba-bec7eb996d9b tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:35.513597 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aced7a2e-b2f2-477b-93ba-bec7eb996d9b tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:35.514098 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aced7a2e-b2f2-477b-93ba-bec7eb996d9b tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:36.494969 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-209112aa-e29d-4409-8b7c-90cfbbc8de8c tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips/175e8d96-5ff6-4721-a57a-74ba498aa647" status: 200 len: 185 microversion: 2.1 time: 1.103834 Sep 24 21:01:36.495922 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1620/3265] 10.222.0.52 () {58 vars in 1260 bytes} [Sat Sep 24 21:01:35 2022] GET /compute/v2.1/os-floating-ips/175e8d96-5ff6-4721-a57a-74ba498aa647 => generated 185 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:36.502486 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1097340c-d3fa-4472-bb52-e9d6a3a45a04 tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] Calling method '.version_select at 0x7f4b0cfe3940>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:36.520171 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-aced7a2e-b2f2-477b-93ba-bec7eb996d9b tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddab9c74c004e74a51fd8008886e542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdf8ae7524612b9c2f6a3f16c39ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:36.531532 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-aced7a2e-b2f2-477b-93ba-bec7eb996d9b tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8" status: 200 len: 1647 microversion: 2.1 time: 1.053591 Sep 24 21:01:36.532668 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1646/3266] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:35 2022] GET /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8 => generated 1647 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:36.545069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-626d6929-7b3c-4334-9f54-816f809337bb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:36.560551 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-626d6929-7b3c-4334-9f54-816f809337bb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:36.576616 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1097340c-d3fa-4472-bb52-e9d6a3a45a04 tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1981100196" status: 202 len: 0 microversion: 2.1 time: 0.078657 Sep 24 21:01:36.577887 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1621/3267] 10.222.0.52 () {58 vars in 1278 bytes} [Sat Sep 24 21:01:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1981100196 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:01:36.583787 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4fde05ff-8a72-4f20-a04c-833b1bc3b4b3 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:36.587849 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4fde05ff-8a72-4f20-a04c-833b1bc3b4b3 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] [instance: ab5b3a44-e594-4cc2-8d36-51b15722edae] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:36.589556 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-626d6929-7b3c-4334-9f54-816f809337bb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:36.590236 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-626d6929-7b3c-4334-9f54-816f809337bb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:36.602282 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-626d6929-7b3c-4334-9f54-816f809337bb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:36.603240 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-626d6929-7b3c-4334-9f54-816f809337bb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:36.604105 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-626d6929-7b3c-4334-9f54-816f809337bb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:36.604649 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-626d6929-7b3c-4334-9f54-816f809337bb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:36.644563 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4fde05ff-8a72-4f20-a04c-833b1bc3b4b3 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:36.646873 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4fde05ff-8a72-4f20-a04c-833b1bc3b4b3 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:36.648028 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4fde05ff-8a72-4f20-a04c-833b1bc3b4b3 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:36.652069 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4fde05ff-8a72-4f20-a04c-833b1bc3b4b3 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:36.653076 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4fde05ff-8a72-4f20-a04c-833b1bc3b4b3 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:36.654933 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4fde05ff-8a72-4f20-a04c-833b1bc3b4b3 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:36.682299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:01:36.728971 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-626d6929-7b3c-4334-9f54-816f809337bb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.193120 Sep 24 21:01:36.729573 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1647/3268] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:01:36 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:01:36.738768 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-599106aa-4431-45e9-b533-f85dcec4c2d1 req-1da392c4-ef57-47d8-9419-2df29cf1f84a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab5b3a44-e594-4cc2-8d36-51b15722edae", "name": "network-vif-plugged", "status": "completed", "tag": "0d7ec7f2-aabd-4f1b-a5ce-5ad1414dd9cb"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:36.760907 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-599106aa-4431-45e9-b533-f85dcec4c2d1 req-1da392c4-ef57-47d8-9419-2df29cf1f84a service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:36.769912 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-599106aa-4431-45e9-b533-f85dcec4c2d1 req-1da392c4-ef57-47d8-9419-2df29cf1f84a service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:36.770835 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-599106aa-4431-45e9-b533-f85dcec4c2d1 req-1da392c4-ef57-47d8-9419-2df29cf1f84a service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:36.792288 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-599106aa-4431-45e9-b533-f85dcec4c2d1 req-1da392c4-ef57-47d8-9419-2df29cf1f84a service nova] Creating event network-vif-plugged:0d7ec7f2-aabd-4f1b-a5ce-5ad1414dd9cb for instance ab5b3a44-e594-4cc2-8d36-51b15722edae on nch2-master-1 Sep 24 21:01:36.800288 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-599106aa-4431-45e9-b533-f85dcec4c2d1 req-1da392c4-ef57-47d8-9419-2df29cf1f84a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064961 Sep 24 21:01:36.801818 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1648/3269] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:36.808238 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c248e935-172b-41c7-964a-bcdd89f18ac1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:36.810053 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c248e935-172b-41c7-964a-bcdd89f18ac1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:36.819000 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c248e935-172b-41c7-964a-bcdd89f18ac1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:36.820928 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c248e935-172b-41c7-964a-bcdd89f18ac1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:36.821589 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c248e935-172b-41c7-964a-bcdd89f18ac1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:36.822988 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c248e935-172b-41c7-964a-bcdd89f18ac1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:36.823606 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c248e935-172b-41c7-964a-bcdd89f18ac1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:36.824189 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c248e935-172b-41c7-964a-bcdd89f18ac1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:37.059679 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=14 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:01:37.130471 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4fde05ff-8a72-4f20-a04c-833b1bc3b4b3 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c49bed91bb437087a8ad2d865c2647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b68f292633a49ca82fb05d18ea83142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:37.143681 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4fde05ff-8a72-4f20-a04c-833b1bc3b4b3 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] 10.222.0.52 "GET /compute/v2.1/servers/ab5b3a44-e594-4cc2-8d36-51b15722edae" status: 200 len: 1317 microversion: 2.1 time: 0.562176 Sep 24 21:01:37.151548 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c248e935-172b-41c7-964a-bcdd89f18ac1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:37.159130 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1622/3270] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:36 2022] GET /compute/v2.1/servers/ab5b3a44-e594-4cc2-8d36-51b15722edae => generated 1317 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:37.161216 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c248e935-172b-41c7-964a-bcdd89f18ac1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2" status: 200 len: 1314 microversion: 2.1 time: 0.358066 Sep 24 21:01:37.170761 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1649/3271] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:36 2022] GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:37.170883 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cf9ec583-6e99-4421-8693-2fe83fd5f985 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:37.170883 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cf9ec583-6e99-4421-8693-2fe83fd5f985 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] [instance: 06c6c840-ee24-4802-bf10-e17f5dfe54ae] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:37.179195 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c3353026-ae93-41f3-87c0-c33b02041488 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:37.179424 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf9ec583-6e99-4421-8693-2fe83fd5f985 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:37.179424 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf9ec583-6e99-4421-8693-2fe83fd5f985 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:37.179424 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf9ec583-6e99-4421-8693-2fe83fd5f985 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:37.179424 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf9ec583-6e99-4421-8693-2fe83fd5f985 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:37.179424 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf9ec583-6e99-4421-8693-2fe83fd5f985 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:37.179424 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf9ec583-6e99-4421-8693-2fe83fd5f985 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:37.179937 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c3353026-ae93-41f3-87c0-c33b02041488 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:37.191642 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3353026-ae93-41f3-87c0-c33b02041488 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:37.192148 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3353026-ae93-41f3-87c0-c33b02041488 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:37.192595 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3353026-ae93-41f3-87c0-c33b02041488 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:37.193310 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3353026-ae93-41f3-87c0-c33b02041488 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:37.193777 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3353026-ae93-41f3-87c0-c33b02041488 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:37.199251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3353026-ae93-41f3-87c0-c33b02041488 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:37.264852 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cf9ec583-6e99-4421-8693-2fe83fd5f985 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9e57183b3b49c1ba39b5503420b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1408039f0bcf4130a11bedb2206b3cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:37.281206 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cf9ec583-6e99-4421-8693-2fe83fd5f985 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] 10.222.0.52 "GET /compute/v2.1/servers/06c6c840-ee24-4802-bf10-e17f5dfe54ae" status: 200 len: 1275 microversion: 2.1 time: 0.117080 Sep 24 21:01:37.281837 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1623/3272] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:37 2022] GET /compute/v2.1/servers/06c6c840-ee24-4802-bf10-e17f5dfe54ae => generated 1275 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:37.294405 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-82d860f3-b668-4e7b-91ca-74077fdc930d tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.7.247"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:37.422218 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c3353026-ae93-41f3-87c0-c33b02041488 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:37.439930 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c3353026-ae93-41f3-87c0-c33b02041488 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1681 microversion: 2.1 time: 0.273291 Sep 24 21:01:37.444821 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1650/3273] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:37 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1681 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:37.461789 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a3e3e908-e10c-40c3-866a-782bdfc3ee58 tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] Calling method '.version_select at 0x7f4b0c13c310>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:37.499413 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a3e3e908-e10c-40c3-866a-782bdfc3ee58 tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-887861698" status: 202 len: 0 microversion: 2.1 time: 0.052945 Sep 24 21:01:37.500926 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1651/3274] 10.222.0.52 () {58 vars in 1275 bytes} [Sat Sep 24 21:01:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-887861698 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:01:37.513070 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-032e6e94-1314-4f4f-aa5e-eae14f41269e req-134fed01-418f-4ff6-8228-c3a2e8da2c68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d96e45af-4d4d-4282-8b88-ffeb56a4f62c", "tag": "56598417-8aae-4930-a67c-3cb74ad93ea3"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:37.529989 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-032e6e94-1314-4f4f-aa5e-eae14f41269e req-134fed01-418f-4ff6-8228-c3a2e8da2c68 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:37.530690 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-032e6e94-1314-4f4f-aa5e-eae14f41269e req-134fed01-418f-4ff6-8228-c3a2e8da2c68 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:37.530937 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-032e6e94-1314-4f4f-aa5e-eae14f41269e req-134fed01-418f-4ff6-8228-c3a2e8da2c68 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:37.535264 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-82d860f3-b668-4e7b-91ca-74077fdc930d tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:37.542351 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82d860f3-b668-4e7b-91ca-74077fdc930d tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:37.542947 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82d860f3-b668-4e7b-91ca-74077fdc930d tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:37.543410 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-032e6e94-1314-4f4f-aa5e-eae14f41269e req-134fed01-418f-4ff6-8228-c3a2e8da2c68 service nova] Creating event network-changed:56598417-8aae-4930-a67c-3cb74ad93ea3 for instance d96e45af-4d4d-4282-8b88-ffeb56a4f62c on nch1-master-1 Sep 24 21:01:37.544138 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82d860f3-b668-4e7b-91ca-74077fdc930d tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:37.546632 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82d860f3-b668-4e7b-91ca-74077fdc930d tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:37.547450 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82d860f3-b668-4e7b-91ca-74077fdc930d tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:37.548061 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82d860f3-b668-4e7b-91ca-74077fdc930d tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:37.551464 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-032e6e94-1314-4f4f-aa5e-eae14f41269e req-134fed01-418f-4ff6-8228-c3a2e8da2c68 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048870 Sep 24 21:01:37.552206 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1652/3275] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:37.558609 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0e91db99-3444-423e-9ca6-79e50ee1ac80 tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] Calling method '.version_select at 0x7f4b0c08a3a0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:37.585140 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0e91db99-3444-423e-9ca6-79e50ee1ac80 tempest-KeyPairsV2TestJSON-995031503 tempest-KeyPairsV2TestJSON-995031503-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-850555808" status: 202 len: 0 microversion: 2.1 time: 0.031307 Sep 24 21:01:37.586469 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1653/3276] 10.222.0.52 () {58 vars in 1275 bytes} [Sat Sep 24 21:01:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-850555808 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:01:37.611906 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-89c1509e-0055-4420-9c63-990e037b262d tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:37.620552 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-89c1509e-0055-4420-9c63-990e037b262d tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 1cceb126-5c30-4c10-b02f-f6a27a7420c8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:37.653748 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89c1509e-0055-4420-9c63-990e037b262d tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:37.654481 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89c1509e-0055-4420-9c63-990e037b262d tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:37.655174 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89c1509e-0055-4420-9c63-990e037b262d tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:37.670903 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89c1509e-0055-4420-9c63-990e037b262d tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:37.674363 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89c1509e-0055-4420-9c63-990e037b262d tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:37.678988 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89c1509e-0055-4420-9c63-990e037b262d tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:37.854786 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-89c1509e-0055-4420-9c63-990e037b262d tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddab9c74c004e74a51fd8008886e542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdf8ae7524612b9c2f6a3f16c39ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:37.869139 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-89c1509e-0055-4420-9c63-990e037b262d tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8" status: 200 len: 1468 microversion: 2.1 time: 0.278857 Sep 24 21:01:37.883131 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1654/3277] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:37 2022] GET /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8 => generated 1468 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:37.893130 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7817dff1-bb50-4fc7-9d7d-bb269e2c08ef tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:37.896903 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7817dff1-bb50-4fc7-9d7d-bb269e2c08ef tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:37.913549 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7817dff1-bb50-4fc7-9d7d-bb269e2c08ef tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:37.915095 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7817dff1-bb50-4fc7-9d7d-bb269e2c08ef tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:37.916063 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7817dff1-bb50-4fc7-9d7d-bb269e2c08ef tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:37.917251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7817dff1-bb50-4fc7-9d7d-bb269e2c08ef tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:37.918070 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7817dff1-bb50-4fc7-9d7d-bb269e2c08ef tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:37.919312 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7817dff1-bb50-4fc7-9d7d-bb269e2c08ef tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:37.955464 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82d860f3-b668-4e7b-91ca-74077fdc930d tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "refresh_cache-547cf9a4-1d05-4cbd-bb2b-ee5cbd406130" {{(pid=140517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 24 21:01:37.956199 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82d860f3-b668-4e7b-91ca-74077fdc930d tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquired lock "refresh_cache-547cf9a4-1d05-4cbd-bb2b-ee5cbd406130" {{(pid=140517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 24 21:01:37.994401 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7817dff1-bb50-4fc7-9d7d-bb269e2c08ef tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.109681 Sep 24 21:01:38.000478 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1655/3278] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:01:37 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:01:38.010387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-eccede38-a463-471a-8aaa-a2f41a9c1445 req-3d7deba4-51ce-4ae8-bfad-48b740aa27b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cceb126-5c30-4c10-b02f-f6a27a7420c8", "name": "network-vif-deleted", "tag": "6b1365fd-2a04-4e08-a3e1-a17d262f6e80"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:38.021080 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-eccede38-a463-471a-8aaa-a2f41a9c1445 req-3d7deba4-51ce-4ae8-bfad-48b740aa27b9 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:38.021843 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-eccede38-a463-471a-8aaa-a2f41a9c1445 req-3d7deba4-51ce-4ae8-bfad-48b740aa27b9 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:38.022444 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-eccede38-a463-471a-8aaa-a2f41a9c1445 req-3d7deba4-51ce-4ae8-bfad-48b740aa27b9 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:38.037482 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-eccede38-a463-471a-8aaa-a2f41a9c1445 req-3d7deba4-51ce-4ae8-bfad-48b740aa27b9 service nova] Creating event network-vif-deleted:6b1365fd-2a04-4e08-a3e1-a17d262f6e80 for instance 1cceb126-5c30-4c10-b02f-f6a27a7420c8 on nch2-master-1 Sep 24 21:01:38.053417 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-eccede38-a463-471a-8aaa-a2f41a9c1445 req-3d7deba4-51ce-4ae8-bfad-48b740aa27b9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044908 Sep 24 21:01:38.057845 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1656/3279] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:38.173588 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6569c47d-9645-40bc-bfef-5d4434168573 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:38.174314 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6569c47d-9645-40bc-bfef-5d4434168573 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] [instance: ab5b3a44-e594-4cc2-8d36-51b15722edae] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:38.227911 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6569c47d-9645-40bc-bfef-5d4434168573 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:38.230338 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6569c47d-9645-40bc-bfef-5d4434168573 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:38.231896 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6569c47d-9645-40bc-bfef-5d4434168573 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:38.237774 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6569c47d-9645-40bc-bfef-5d4434168573 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:38.239794 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6569c47d-9645-40bc-bfef-5d4434168573 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:38.239794 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6569c47d-9645-40bc-bfef-5d4434168573 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:38.622786 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6569c47d-9645-40bc-bfef-5d4434168573 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c49bed91bb437087a8ad2d865c2647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b68f292633a49ca82fb05d18ea83142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:38.651803 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6569c47d-9645-40bc-bfef-5d4434168573 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] 10.222.0.52 "GET /compute/v2.1/servers/ab5b3a44-e594-4cc2-8d36-51b15722edae" status: 200 len: 1317 microversion: 2.1 time: 0.484905 Sep 24 21:01:38.652419 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1657/3280] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:38 2022] GET /compute/v2.1/servers/ab5b3a44-e594-4cc2-8d36-51b15722edae => generated 1317 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:01:38.679390 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-73745aae-87cb-441e-915f-a15ac34f57e8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:38.680624 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-73745aae-87cb-441e-915f-a15ac34f57e8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:38.691074 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-73745aae-87cb-441e-915f-a15ac34f57e8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:38.691981 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-73745aae-87cb-441e-915f-a15ac34f57e8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:38.692449 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-73745aae-87cb-441e-915f-a15ac34f57e8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:38.693850 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-73745aae-87cb-441e-915f-a15ac34f57e8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:38.694327 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-73745aae-87cb-441e-915f-a15ac34f57e8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:38.695694 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-73745aae-87cb-441e-915f-a15ac34f57e8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:39.627413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-73745aae-87cb-441e-915f-a15ac34f57e8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:39.649904 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-73745aae-87cb-441e-915f-a15ac34f57e8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2" status: 200 len: 1314 microversion: 2.1 time: 0.978945 Sep 24 21:01:39.653527 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1658/3281] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:38 2022] GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 => generated 1314 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:39.661040 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-065a8ff3-47be-4309-aa4c-ac3f3cd00a7b tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:39.663005 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-065a8ff3-47be-4309-aa4c-ac3f3cd00a7b tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] [instance: 06c6c840-ee24-4802-bf10-e17f5dfe54ae] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:39.673081 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-065a8ff3-47be-4309-aa4c-ac3f3cd00a7b tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:39.673928 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-065a8ff3-47be-4309-aa4c-ac3f3cd00a7b tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:39.674693 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-065a8ff3-47be-4309-aa4c-ac3f3cd00a7b tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:39.677079 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-065a8ff3-47be-4309-aa4c-ac3f3cd00a7b tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:39.678378 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-065a8ff3-47be-4309-aa4c-ac3f3cd00a7b tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:39.679116 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-065a8ff3-47be-4309-aa4c-ac3f3cd00a7b tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:40.050866 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-065a8ff3-47be-4309-aa4c-ac3f3cd00a7b tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9e57183b3b49c1ba39b5503420b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1408039f0bcf4130a11bedb2206b3cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:40.067487 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-065a8ff3-47be-4309-aa4c-ac3f3cd00a7b tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] 10.222.0.52 "GET /compute/v2.1/servers/06c6c840-ee24-4802-bf10-e17f5dfe54ae" status: 200 len: 1317 microversion: 2.1 time: 0.412424 Sep 24 21:01:40.084270 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1659/3282] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:39 2022] GET /compute/v2.1/servers/06c6c840-ee24-4802-bf10-e17f5dfe54ae => generated 1317 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:40.093588 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4abc2694-da63-4baa-83b1-ee683e5000f7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:40.094881 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4abc2694-da63-4baa-83b1-ee683e5000f7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:40.101295 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4abc2694-da63-4baa-83b1-ee683e5000f7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:40.102010 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4abc2694-da63-4baa-83b1-ee683e5000f7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:40.102687 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4abc2694-da63-4baa-83b1-ee683e5000f7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:40.103568 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4abc2694-da63-4baa-83b1-ee683e5000f7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:40.104546 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4abc2694-da63-4baa-83b1-ee683e5000f7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:40.105138 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4abc2694-da63-4baa-83b1-ee683e5000f7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:40.628237 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-82d860f3-b668-4e7b-91ca-74077fdc930d tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130] Building network info cache for instance {{(pid=140517) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 24 21:01:40.670001 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4abc2694-da63-4baa-83b1-ee683e5000f7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:40.681850 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4abc2694-da63-4baa-83b1-ee683e5000f7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1681 microversion: 2.1 time: 0.596085 Sep 24 21:01:40.688283 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1660/3283] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:40 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1681 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:40.697305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-14ec2091-07d9-4a36-9b9e-54fd6721c89f req-14b258f3-f8f5-41bb-804e-b35b3629693e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3938cda7-a3b7-4be8-9ea5-79ec625a5bd2", "name": "network-vif-plugged", "status": "completed", "tag": "a42b250b-5b9b-44f2-939c-4f7b443d78b9"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:40.725193 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-14ec2091-07d9-4a36-9b9e-54fd6721c89f req-14b258f3-f8f5-41bb-804e-b35b3629693e service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:40.726092 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-14ec2091-07d9-4a36-9b9e-54fd6721c89f req-14b258f3-f8f5-41bb-804e-b35b3629693e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:40.726811 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-14ec2091-07d9-4a36-9b9e-54fd6721c89f req-14b258f3-f8f5-41bb-804e-b35b3629693e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:40.757255 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-14ec2091-07d9-4a36-9b9e-54fd6721c89f req-14b258f3-f8f5-41bb-804e-b35b3629693e service nova] Creating event network-vif-plugged:a42b250b-5b9b-44f2-939c-4f7b443d78b9 for instance 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 on nch1-master-1 Sep 24 21:01:40.768935 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-14ec2091-07d9-4a36-9b9e-54fd6721c89f req-14b258f3-f8f5-41bb-804e-b35b3629693e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078162 Sep 24 21:01:40.770402 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1661/3284] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:40.807251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9946e51c-d436-41ec-9094-95b3340c3247 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:40.809763 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9946e51c-d436-41ec-9094-95b3340c3247 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] [instance: 1cceb126-5c30-4c10-b02f-f6a27a7420c8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:40.841353 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9946e51c-d436-41ec-9094-95b3340c3247 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:40.842306 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9946e51c-d436-41ec-9094-95b3340c3247 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:40.843029 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9946e51c-d436-41ec-9094-95b3340c3247 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:40.845422 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9946e51c-d436-41ec-9094-95b3340c3247 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:40.846275 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9946e51c-d436-41ec-9094-95b3340c3247 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:40.848659 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9946e51c-d436-41ec-9094-95b3340c3247 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:40.868232 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-9946e51c-d436-41ec-9094-95b3340c3247 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] HTTP exception thrown: Instance 1cceb126-5c30-4c10-b02f-f6a27a7420c8 could not be found. Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9946e51c-d436-41ec-9094-95b3340c3247 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Request method failure captured: Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8 HTTP/1.1 Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL2_KTBoQE1biSOdbxiN02s3h0D1W3LZT4KXbL5sweudoA3LIqkhpSDHo_3ElsoW-S4pinCvYVIPwwmg75I3QYjyeUH8E9-UCSOe6Wat6dff2LaBOhzu2fRTo0k0Ryv1Z1NW8ftU_9LakKBqftyUWUBvBSk8oz2eNB_e-v5W7ciYbcII Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 981fdf8ae7524612b9c2f6a3f16c39ec Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981fdf8ae7524612b9c2f6a3f16c39ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 981fdf8ae7524612b9c2f6a3f16c39ec Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-321124649 Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-SecurityGroupsTestJSON-321124649-project Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 5ddab9c74c004e74a51fd8008886e542 Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-SecurityGroupsTestJSON-321124649-project Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 1cceb126-5c30-4c10-b02f-f6a27a7420c8 could not be found. Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '1cceb126-5c30-4c10-b02f-f6a27a7420c8'} Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cceb126-5c30-4c10-b02f-f6a27a7420c8 could not be found. Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cceb126-5c30-4c10-b02f-f6a27a7420c8 could not be found. Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:40.872493 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:40.876916 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:40.876916 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:40.876916 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:40.876916 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:01:40.876916 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:01:40.876916 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cceb126-5c30-4c10-b02f-f6a27a7420c8 could not be found. Sep 24 21:01:40.876916 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:40.880023 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9946e51c-d436-41ec-9094-95b3340c3247 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Returning 404 to user: Instance 1cceb126-5c30-4c10-b02f-f6a27a7420c8 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:01:40.881186 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9946e51c-d436-41ec-9094-95b3340c3247 tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "GET /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8" status: 404 len: 111 microversion: 2.1 time: 0.109430 Sep 24 21:01:40.885639 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1662/3285] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:40 2022] GET /compute/v2.1/servers/1cceb126-5c30-4c10-b02f-f6a27a7420c8 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:01:40.891643 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1d66a9f9-4a95-434f-9ff8-33c056c4057a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:40.894451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1d66a9f9-4a95-434f-9ff8-33c056c4057a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:40.902268 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:01:40.904606 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d66a9f9-4a95-434f-9ff8-33c056c4057a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:40.905541 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d66a9f9-4a95-434f-9ff8-33c056c4057a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:40.906207 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d66a9f9-4a95-434f-9ff8-33c056c4057a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:40.907243 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d66a9f9-4a95-434f-9ff8-33c056c4057a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:40.908193 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d66a9f9-4a95-434f-9ff8-33c056c4057a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:40.908838 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d66a9f9-4a95-434f-9ff8-33c056c4057a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:40.974133 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1d66a9f9-4a95-434f-9ff8-33c056c4057a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.086763 Sep 24 21:01:40.975455 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1663/3286] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:01:40 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:01:40.980723 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-64730a1c-2cb3-4b41-8581-ec71588051e3 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:40.982266 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-64730a1c-2cb3-4b41-8581-ec71588051e3 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] [instance: ab5b3a44-e594-4cc2-8d36-51b15722edae] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:40.992534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-64730a1c-2cb3-4b41-8581-ec71588051e3 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:40.993593 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-64730a1c-2cb3-4b41-8581-ec71588051e3 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:40.994847 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-64730a1c-2cb3-4b41-8581-ec71588051e3 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:40.995802 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-64730a1c-2cb3-4b41-8581-ec71588051e3 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:40.996757 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-64730a1c-2cb3-4b41-8581-ec71588051e3 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:40.997931 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-64730a1c-2cb3-4b41-8581-ec71588051e3 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:41.691730 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-64730a1c-2cb3-4b41-8581-ec71588051e3 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c49bed91bb437087a8ad2d865c2647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b68f292633a49ca82fb05d18ea83142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:41.704067 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-64730a1c-2cb3-4b41-8581-ec71588051e3 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] 10.222.0.52 "GET /compute/v2.1/servers/ab5b3a44-e594-4cc2-8d36-51b15722edae" status: 200 len: 1505 microversion: 2.1 time: 0.727229 Sep 24 21:01:41.707875 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1664/3287] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:40 2022] GET /compute/v2.1/servers/ab5b3a44-e594-4cc2-8d36-51b15722edae => generated 1505 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:41.728343 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-dcc700c6-5eca-4864-a8b2-ea542dc2dbd6 req-78315304-ec26-45b3-9e38-2d2c6303a972 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06c6c840-ee24-4802-bf10-e17f5dfe54ae", "tag": "421297be-85c7-46b8-b6d4-16c2e392bb3f"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:41.757338 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-dcc700c6-5eca-4864-a8b2-ea542dc2dbd6 req-78315304-ec26-45b3-9e38-2d2c6303a972 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:41.758968 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-dcc700c6-5eca-4864-a8b2-ea542dc2dbd6 req-78315304-ec26-45b3-9e38-2d2c6303a972 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:41.759572 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-dcc700c6-5eca-4864-a8b2-ea542dc2dbd6 req-78315304-ec26-45b3-9e38-2d2c6303a972 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:41.786072 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-dcc700c6-5eca-4864-a8b2-ea542dc2dbd6 req-78315304-ec26-45b3-9e38-2d2c6303a972 service nova] Creating event network-changed:421297be-85c7-46b8-b6d4-16c2e392bb3f for instance 06c6c840-ee24-4802-bf10-e17f5dfe54ae on nch2-master-1 Sep 24 21:01:41.795927 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-dcc700c6-5eca-4864-a8b2-ea542dc2dbd6 req-78315304-ec26-45b3-9e38-2d2c6303a972 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080560 Sep 24 21:01:41.798459 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1665/3288] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:41.804927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-bb1ad90d-af64-457d-a8d0-037569ff4b1c req-e46b192f-8bec-4822-9362-f56ff44d8cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "547cf9a4-1d05-4cbd-bb2b-ee5cbd406130", "tag": "52b5470e-7c8d-4f6a-b42e-9c45da96e2f1"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:41.816154 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-bb1ad90d-af64-457d-a8d0-037569ff4b1c req-e46b192f-8bec-4822-9362-f56ff44d8cd4 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:41.816954 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-bb1ad90d-af64-457d-a8d0-037569ff4b1c req-e46b192f-8bec-4822-9362-f56ff44d8cd4 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:41.817616 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-bb1ad90d-af64-457d-a8d0-037569ff4b1c req-e46b192f-8bec-4822-9362-f56ff44d8cd4 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:41.830328 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-bb1ad90d-af64-457d-a8d0-037569ff4b1c req-e46b192f-8bec-4822-9362-f56ff44d8cd4 service nova] Creating event network-changed:52b5470e-7c8d-4f6a-b42e-9c45da96e2f1 for instance 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130 on nch2-master-1 Sep 24 21:01:41.837473 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-bb1ad90d-af64-457d-a8d0-037569ff4b1c req-e46b192f-8bec-4822-9362-f56ff44d8cd4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037423 Sep 24 21:01:41.842466 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1666/3289] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:41.858875 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-146a826b-3046-47dd-9294-9e188d34d137 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:41.859873 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-146a826b-3046-47dd-9294-9e188d34d137 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:41.888633 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-146a826b-3046-47dd-9294-9e188d34d137 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:41.889716 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-146a826b-3046-47dd-9294-9e188d34d137 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:41.890540 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-146a826b-3046-47dd-9294-9e188d34d137 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:41.891534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-146a826b-3046-47dd-9294-9e188d34d137 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:41.892455 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-146a826b-3046-47dd-9294-9e188d34d137 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:41.893972 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-146a826b-3046-47dd-9294-9e188d34d137 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:42.165161 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-146a826b-3046-47dd-9294-9e188d34d137 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:42.175367 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-146a826b-3046-47dd-9294-9e188d34d137 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2" status: 200 len: 1314 microversion: 2.1 time: 0.331367 Sep 24 21:01:42.180022 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1667/3290] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:41 2022] GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:42.194448 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-968c5d82-8457-4693-abd4-0b43c1a43d7d tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '.version_select at 0x7f4b0c0c6940>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:42.452553 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-82d860f3-b668-4e7b-91ca-74077fdc930d tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130] Updating instance_info_cache with network_info: [{"id": "52b5470e-7c8d-4f6a-b42e-9c45da96e2f1", "address": "fa:16:3e:4c:0c:cb", "network": {"id": "b9fc93d3-0ad7-483a-aed0-543890dc0a39", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1279734249-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d4655b536ca04896993223f34d172298", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap52b5470e-7c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140517) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 24 21:01:42.475026 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82d860f3-b668-4e7b-91ca-74077fdc930d tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Releasing lock "refresh_cache-547cf9a4-1d05-4cbd-bb2b-ee5cbd406130" {{(pid=140517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 24 21:01:42.476868 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-82d860f3-b668-4e7b-91ca-74077fdc930d tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "POST /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130/action" status: 202 len: 0 microversion: 2.1 time: 5.191279 Sep 24 21:01:42.484387 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1624/3291] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:01:37 2022] POST /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130/action => generated 0 bytes in 5202 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 24 21:01:42.491783 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-723fac73-ee8e-4c0d-b60e-d4a4a81a8b80 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:42.492668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-723fac73-ee8e-4c0d-b60e-d4a4a81a8b80 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] [instance: 06c6c840-ee24-4802-bf10-e17f5dfe54ae] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:42.502008 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-723fac73-ee8e-4c0d-b60e-d4a4a81a8b80 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:42.502840 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-723fac73-ee8e-4c0d-b60e-d4a4a81a8b80 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:42.503578 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-723fac73-ee8e-4c0d-b60e-d4a4a81a8b80 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:42.504747 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-723fac73-ee8e-4c0d-b60e-d4a4a81a8b80 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:42.506148 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-723fac73-ee8e-4c0d-b60e-d4a4a81a8b80 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:42.508143 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-723fac73-ee8e-4c0d-b60e-d4a4a81a8b80 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:42.868971 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:01:42.936990 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=28 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:01:43.351731 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-968c5d82-8457-4693-abd4-0b43c1a43d7d tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/a1ff6035-f542-428c-9534-ae4a1159d6f8" status: 202 len: 0 microversion: 2.1 time: 1.170372 Sep 24 21:01:43.352768 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1668/3292] 10.222.0.52 () {58 vars in 1272 bytes} [Sat Sep 24 21:01:42 2022] DELETE /compute/v2.1/os-security-groups/a1ff6035-f542-428c-9534-ae4a1159d6f8 => generated 0 bytes in 1172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:01:43.359199 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f4a759a8-c8b6-4456-9477-b176f97d78ac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:43.360771 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f4a759a8-c8b6-4456-9477-b176f97d78ac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:43.377915 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4a759a8-c8b6-4456-9477-b176f97d78ac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:43.378794 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4a759a8-c8b6-4456-9477-b176f97d78ac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:43.379484 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4a759a8-c8b6-4456-9477-b176f97d78ac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:43.380400 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4a759a8-c8b6-4456-9477-b176f97d78ac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:43.381021 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4a759a8-c8b6-4456-9477-b176f97d78ac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:43.381610 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4a759a8-c8b6-4456-9477-b176f97d78ac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:43.451148 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-723fac73-ee8e-4c0d-b60e-d4a4a81a8b80 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9e57183b3b49c1ba39b5503420b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1408039f0bcf4130a11bedb2206b3cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:43.459074 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-723fac73-ee8e-4c0d-b60e-d4a4a81a8b80 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] 10.222.0.52 "GET /compute/v2.1/servers/06c6c840-ee24-4802-bf10-e17f5dfe54ae" status: 200 len: 1317 microversion: 2.1 time: 0.973244 Sep 24 21:01:43.467804 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1625/3293] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:42 2022] GET /compute/v2.1/servers/06c6c840-ee24-4802-bf10-e17f5dfe54ae => generated 1317 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:43.472824 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2d453050-681f-4d60-849b-70d759e72d37 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:43.473453 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2d453050-681f-4d60-849b-70d759e72d37 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] [instance: d96e45af-4d4d-4282-8b88-ffeb56a4f62c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:43.492561 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d453050-681f-4d60-849b-70d759e72d37 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:43.493324 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d453050-681f-4d60-849b-70d759e72d37 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:43.493920 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d453050-681f-4d60-849b-70d759e72d37 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:43.499715 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d453050-681f-4d60-849b-70d759e72d37 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:43.500576 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d453050-681f-4d60-849b-70d759e72d37 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:43.501185 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d453050-681f-4d60-849b-70d759e72d37 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:43.686063 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f4a759a8-c8b6-4456-9477-b176f97d78ac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:43.694892 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f4a759a8-c8b6-4456-9477-b176f97d78ac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1681 microversion: 2.1 time: 0.340756 Sep 24 21:01:43.695497 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1669/3294] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:43 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1681 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:43.711752 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-527fe931-3199-42b1-bb51-9a631deeae21 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:43.714261 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-527fe931-3199-42b1-bb51-9a631deeae21 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:43.734896 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-527fe931-3199-42b1-bb51-9a631deeae21 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:43.735788 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-527fe931-3199-42b1-bb51-9a631deeae21 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:43.736417 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-527fe931-3199-42b1-bb51-9a631deeae21 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:43.737408 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-527fe931-3199-42b1-bb51-9a631deeae21 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:43.738053 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-527fe931-3199-42b1-bb51-9a631deeae21 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:43.741107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-527fe931-3199-42b1-bb51-9a631deeae21 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:43.784971 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-527fe931-3199-42b1-bb51-9a631deeae21 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.083456 Sep 24 21:01:43.786204 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1670/3295] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:01:43 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:01:43.791201 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-acc77c31-3844-461f-ba9b-da1d52e74968 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:43.792171 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-acc77c31-3844-461f-ba9b-da1d52e74968 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 5c119929-2744-4871-b523-0a6a05c6c073] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:43.799451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-acc77c31-3844-461f-ba9b-da1d52e74968 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:43.800281 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-acc77c31-3844-461f-ba9b-da1d52e74968 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:43.800919 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-acc77c31-3844-461f-ba9b-da1d52e74968 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:43.802168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-acc77c31-3844-461f-ba9b-da1d52e74968 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:43.802943 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-acc77c31-3844-461f-ba9b-da1d52e74968 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:43.803603 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-acc77c31-3844-461f-ba9b-da1d52e74968 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:43.818565 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2d453050-681f-4d60-849b-70d759e72d37 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c49bed91bb437087a8ad2d865c2647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b68f292633a49ca82fb05d18ea83142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:43.824191 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-acc77c31-3844-461f-ba9b-da1d52e74968 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] HTTP exception thrown: Instance 5c119929-2744-4871-b523-0a6a05c6c073 could not be found. Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-acc77c31-3844-461f-ba9b-da1d52e74968 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Request method failure captured: Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073 HTTP/1.1 Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL2_h-Z8Mxd5ivJvUeu-nilEC6fPGB9S2d4aX0ajB7leDARAd7Et7YiLKQ5tPWl4ARe0MFMUuqOPXo4MeDKAbIrnGGcVBa61Br-WWVhKviEFGtP0vuLwt56unMyYSSykXNc3sfP0YClEz09E4oRBLkG4XSmynhYSEJre7LO8YfgpSiOI Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: d4655b536ca04896993223f34d172298 Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-315733725 Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d4655b536ca04896993223f34d172298"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d4655b536ca04896993223f34d172298"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d4655b536ca04896993223f34d172298"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d4655b536ca04896993223f34d172298"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-315733725 Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: d4655b536ca04896993223f34d172298 Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-315733725 Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-FloatingIPsAssociationTestJSON-315733725-project Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: f41f618458eb48f6bb4631fd254addc0 Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-315733725-project Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 5c119929-2744-4871-b523-0a6a05c6c073 could not be found. Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '5c119929-2744-4871-b523-0a6a05c6c073'} Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c119929-2744-4871-b523-0a6a05c6c073 could not be found. Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:01:43.826884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:01:43.830697 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c119929-2744-4871-b523-0a6a05c6c073 could not be found. Sep 24 21:01:43.830697 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:43.830697 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:43.830697 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:43.830697 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:43.830697 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:43.830697 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:43.830697 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:01:43.830697 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:01:43.830697 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c119929-2744-4871-b523-0a6a05c6c073 could not be found. Sep 24 21:01:43.830697 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:43.833372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-acc77c31-3844-461f-ba9b-da1d52e74968 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Returning 404 to user: Instance 5c119929-2744-4871-b523-0a6a05c6c073 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:01:43.834539 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-acc77c31-3844-461f-ba9b-da1d52e74968 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073" status: 404 len: 111 microversion: 2.1 time: 0.047112 Sep 24 21:01:43.834684 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2d453050-681f-4d60-849b-70d759e72d37 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] 10.222.0.52 "GET /compute/v2.1/servers/d96e45af-4d4d-4282-8b88-ffeb56a4f62c" status: 200 len: 1317 microversion: 2.1 time: 0.365493 Sep 24 21:01:43.835811 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1671/3296] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:01:43 2022] DELETE /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:01:43.837849 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1626/3297] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:43 2022] GET /compute/v2.1/servers/d96e45af-4d4d-4282-8b88-ffeb56a4f62c => generated 1317 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:43.843923 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1d61bed3-5556-4f64-a004-701f869112ab tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:43.844927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1d61bed3-5556-4f64-a004-701f869112ab tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:43.851395 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-8b452159-aefe-4469-b589-ad65da6166d1 req-cb329101-a2ed-4651-bed8-312b8a4470f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d96e45af-4d4d-4282-8b88-ffeb56a4f62c", "name": "network-vif-plugged", "status": "completed", "tag": "56598417-8aae-4930-a67c-3cb74ad93ea3"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:43.853001 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d61bed3-5556-4f64-a004-701f869112ab tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:43.853911 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d61bed3-5556-4f64-a004-701f869112ab tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:43.854463 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d61bed3-5556-4f64-a004-701f869112ab tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:43.855378 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d61bed3-5556-4f64-a004-701f869112ab tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:43.856542 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d61bed3-5556-4f64-a004-701f869112ab tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:43.857148 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d61bed3-5556-4f64-a004-701f869112ab tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:43.879910 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-8b452159-aefe-4469-b589-ad65da6166d1 req-cb329101-a2ed-4651-bed8-312b8a4470f5 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:43.880805 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-8b452159-aefe-4469-b589-ad65da6166d1 req-cb329101-a2ed-4651-bed8-312b8a4470f5 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:43.883021 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:01:43.883559 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-8b452159-aefe-4469-b589-ad65da6166d1 req-cb329101-a2ed-4651-bed8-312b8a4470f5 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:43.918411 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-8b452159-aefe-4469-b589-ad65da6166d1 req-cb329101-a2ed-4651-bed8-312b8a4470f5 service nova] Creating event network-vif-plugged:56598417-8aae-4930-a67c-3cb74ad93ea3 for instance d96e45af-4d4d-4282-8b88-ffeb56a4f62c on nch1-master-1 Sep 24 21:01:43.930435 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-8b452159-aefe-4469-b589-ad65da6166d1 req-cb329101-a2ed-4651-bed8-312b8a4470f5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090337 Sep 24 21:01:43.931091 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1627/3298] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:43.962706 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d75002b7-3596-4a46-85e7-b92a8317ffbc tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] Calling method '.version_select at 0x7f4b1110f700>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:44.120012 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1d61bed3-5556-4f64-a004-701f869112ab tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:44.135904 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1d61bed3-5556-4f64-a004-701f869112ab tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2" status: 200 len: 1501 microversion: 2.1 time: 0.291659 Sep 24 21:01:44.137118 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1672/3299] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:43 2022] GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 => generated 1501 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:44.142480 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8abc8a98-1294-4c10-a83c-18db721e5148 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:44.148855 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8abc8a98-1294-4c10-a83c-18db721e5148 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 5c119929-2744-4871-b523-0a6a05c6c073] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:44.167376 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8abc8a98-1294-4c10-a83c-18db721e5148 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:44.168059 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8abc8a98-1294-4c10-a83c-18db721e5148 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:44.170554 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8abc8a98-1294-4c10-a83c-18db721e5148 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:44.172594 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8abc8a98-1294-4c10-a83c-18db721e5148 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:44.177493 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8abc8a98-1294-4c10-a83c-18db721e5148 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:44.178199 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8abc8a98-1294-4c10-a83c-18db721e5148 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:44.223999 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-8abc8a98-1294-4c10-a83c-18db721e5148 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] HTTP exception thrown: Instance 5c119929-2744-4871-b523-0a6a05c6c073 could not be found. Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8abc8a98-1294-4c10-a83c-18db721e5148 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Request method failure captured: Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073 HTTP/1.1 Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL2_h-Z8Mxd5ivJvUeu-nilEC6fPGB9S2d4aX0ajB7leDARAd7Et7YiLKQ5tPWl4ARe0MFMUuqOPXo4MeDKAbIrnGGcVBa61Br-WWVhKviEFGtP0vuLwt56unMyYSSykXNc3sfP0YClEz09E4oRBLkG4XSmynhYSEJre7LO8YfgpSiOI Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: d4655b536ca04896993223f34d172298 Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-315733725 Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d4655b536ca04896993223f34d172298"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d4655b536ca04896993223f34d172298"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d4655b536ca04896993223f34d172298"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d4655b536ca04896993223f34d172298"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-315733725 Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: d4655b536ca04896993223f34d172298 Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-315733725 Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-FloatingIPsAssociationTestJSON-315733725-project Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: f41f618458eb48f6bb4631fd254addc0 Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-315733725-project Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 5c119929-2744-4871-b523-0a6a05c6c073 could not be found. Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '5c119929-2744-4871-b523-0a6a05c6c073'} Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c119929-2744-4871-b523-0a6a05c6c073 could not be found. Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c119929-2744-4871-b523-0a6a05c6c073 could not be found. Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:44.225609 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:44.229715 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:44.229715 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:44.229715 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:44.229715 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:44.229715 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:01:44.229715 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:01:44.229715 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c119929-2744-4871-b523-0a6a05c6c073 could not be found. Sep 24 21:01:44.229715 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:44.229715 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8abc8a98-1294-4c10-a83c-18db721e5148 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Returning 404 to user: Instance 5c119929-2744-4871-b523-0a6a05c6c073 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:01:44.229715 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8abc8a98-1294-4c10-a83c-18db721e5148 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "GET /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073" status: 404 len: 111 microversion: 2.1 time: 0.088505 Sep 24 21:01:44.229715 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1673/3300] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:44 2022] GET /compute/v2.1/servers/5c119929-2744-4871-b523-0a6a05c6c073 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:01:44.235989 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4eeca7eb-36ce-4b05-b0cd-f41bd67a2474 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:44.251675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4eeca7eb-36ce-4b05-b0cd-f41bd67a2474 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:44.253082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4eeca7eb-36ce-4b05-b0cd-f41bd67a2474 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:44.253709 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4eeca7eb-36ce-4b05-b0cd-f41bd67a2474 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:44.326782 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4eeca7eb-36ce-4b05-b0cd-f41bd67a2474 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2] Going to try to stop instance {{(pid=140516) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 24 21:01:44.389168 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4eeca7eb-36ce-4b05-b0cd-f41bd67a2474 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "POST /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2/action" status: 202 len: 0 microversion: 2.1 time: 0.159249 Sep 24 21:01:44.391294 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1674/3301] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:01:44 2022] POST /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:01:44.397897 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1737580e-6f7e-4bb7-87eb-5594b4a22b71 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Calling method '.version_select at 0x7f4b0d081280>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:44.673869 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d75002b7-3596-4a46-85e7-b92a8317ffbc tempest-SecurityGroupsTestJSON-321124649 tempest-SecurityGroupsTestJSON-321124649-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/3aaebb58-55ca-4611-a836-0b5372c23bd5" status: 202 len: 0 microversion: 2.1 time: 0.737832 Sep 24 21:01:44.675049 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1628/3302] 10.222.0.52 () {58 vars in 1272 bytes} [Sat Sep 24 21:01:43 2022] DELETE /compute/v2.1/os-security-groups/3aaebb58-55ca-4611-a836-0b5372c23bd5 => generated 0 bytes in 742 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:01:44.680066 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-eefde8a0-6da7-4758-a74e-cd548614f621 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:44.681087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-eefde8a0-6da7-4758-a74e-cd548614f621 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:44.698482 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eefde8a0-6da7-4758-a74e-cd548614f621 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:44.699343 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eefde8a0-6da7-4758-a74e-cd548614f621 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:44.700367 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eefde8a0-6da7-4758-a74e-cd548614f621 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:44.701663 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eefde8a0-6da7-4758-a74e-cd548614f621 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:44.703267 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eefde8a0-6da7-4758-a74e-cd548614f621 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:44.703928 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eefde8a0-6da7-4758-a74e-cd548614f621 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:45.251247 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-eefde8a0-6da7-4758-a74e-cd548614f621 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:45.256248 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:01:45.273936 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-eefde8a0-6da7-4758-a74e-cd548614f621 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2" status: 200 len: 1511 microversion: 2.1 time: 0.597605 Sep 24 21:01:45.276097 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1629/3303] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:44 2022] GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 => generated 1511 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:45.296169 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-96db8547-c420-4508-8c87-0906ab61f623 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:45.298075 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-96db8547-c420-4508-8c87-0906ab61f623 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] [instance: 06c6c840-ee24-4802-bf10-e17f5dfe54ae] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:45.319240 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96db8547-c420-4508-8c87-0906ab61f623 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:45.324095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96db8547-c420-4508-8c87-0906ab61f623 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:45.327713 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96db8547-c420-4508-8c87-0906ab61f623 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:45.330556 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96db8547-c420-4508-8c87-0906ab61f623 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:45.331668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96db8547-c420-4508-8c87-0906ab61f623 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:45.332898 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96db8547-c420-4508-8c87-0906ab61f623 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:45.676229 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-96db8547-c420-4508-8c87-0906ab61f623 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9e57183b3b49c1ba39b5503420b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1408039f0bcf4130a11bedb2206b3cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:45.698303 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-96db8547-c420-4508-8c87-0906ab61f623 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] 10.222.0.52 "GET /compute/v2.1/servers/06c6c840-ee24-4802-bf10-e17f5dfe54ae" status: 200 len: 1317 microversion: 2.1 time: 0.415085 Sep 24 21:01:45.702065 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1630/3304] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:45 2022] GET /compute/v2.1/servers/06c6c840-ee24-4802-bf10-e17f5dfe54ae => generated 1317 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:45.734579 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-574a38e9-fa5f-44c3-ac3e-d9de8289f8cf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:45.737256 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-574a38e9-fa5f-44c3-ac3e-d9de8289f8cf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:45.757649 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-574a38e9-fa5f-44c3-ac3e-d9de8289f8cf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:45.758356 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-574a38e9-fa5f-44c3-ac3e-d9de8289f8cf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:45.759008 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-574a38e9-fa5f-44c3-ac3e-d9de8289f8cf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:45.761169 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-574a38e9-fa5f-44c3-ac3e-d9de8289f8cf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:45.771293 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-574a38e9-fa5f-44c3-ac3e-d9de8289f8cf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:45.771996 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-574a38e9-fa5f-44c3-ac3e-d9de8289f8cf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:46.283837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-574a38e9-fa5f-44c3-ac3e-d9de8289f8cf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:46.296967 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-574a38e9-fa5f-44c3-ac3e-d9de8289f8cf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1681 microversion: 2.1 time: 0.593488 Sep 24 21:01:46.300524 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1631/3305] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:45 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1681 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:46.315142 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a57dad41-1787-470f-921c-cbbf8686684f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:46.318822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a57dad41-1787-470f-921c-cbbf8686684f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:46.329531 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a57dad41-1787-470f-921c-cbbf8686684f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:46.330420 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a57dad41-1787-470f-921c-cbbf8686684f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:46.331498 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a57dad41-1787-470f-921c-cbbf8686684f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:46.332671 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a57dad41-1787-470f-921c-cbbf8686684f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:46.333302 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a57dad41-1787-470f-921c-cbbf8686684f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:46.333899 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a57dad41-1787-470f-921c-cbbf8686684f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:46.396229 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a57dad41-1787-470f-921c-cbbf8686684f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.091530 Sep 24 21:01:46.397408 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1632/3306] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:01:46 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:01:46.402294 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-99a8c535-69d4-4a48-8171-e2cba57b6fd6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:46.403392 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-99a8c535-69d4-4a48-8171-e2cba57b6fd6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] [instance: d96e45af-4d4d-4282-8b88-ffeb56a4f62c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:46.412358 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-99a8c535-69d4-4a48-8171-e2cba57b6fd6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:46.413167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-99a8c535-69d4-4a48-8171-e2cba57b6fd6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:46.414012 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-99a8c535-69d4-4a48-8171-e2cba57b6fd6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:46.415544 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-99a8c535-69d4-4a48-8171-e2cba57b6fd6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:46.416324 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-99a8c535-69d4-4a48-8171-e2cba57b6fd6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:46.417138 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-99a8c535-69d4-4a48-8171-e2cba57b6fd6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:46.851142 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-99a8c535-69d4-4a48-8171-e2cba57b6fd6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c49bed91bb437087a8ad2d865c2647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b68f292633a49ca82fb05d18ea83142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:46.870804 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-99a8c535-69d4-4a48-8171-e2cba57b6fd6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] 10.222.0.52 "GET /compute/v2.1/servers/d96e45af-4d4d-4282-8b88-ffeb56a4f62c" status: 200 len: 1505 microversion: 2.1 time: 0.471617 Sep 24 21:01:46.884694 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1633/3307] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:46 2022] GET /compute/v2.1/servers/d96e45af-4d4d-4282-8b88-ffeb56a4f62c => generated 1505 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:46.902231 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-b457bcea-e1bf-4975-8e03-474615c5f5c3 req-dbc43d2d-fc8d-4945-a377-2ada6bc7e54d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06c6c840-ee24-4802-bf10-e17f5dfe54ae", "name": "network-vif-plugged", "status": "completed", "tag": "421297be-85c7-46b8-b6d4-16c2e392bb3f"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:46.921734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-b457bcea-e1bf-4975-8e03-474615c5f5c3 req-dbc43d2d-fc8d-4945-a377-2ada6bc7e54d service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:46.922765 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-b457bcea-e1bf-4975-8e03-474615c5f5c3 req-dbc43d2d-fc8d-4945-a377-2ada6bc7e54d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:46.923474 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-b457bcea-e1bf-4975-8e03-474615c5f5c3 req-dbc43d2d-fc8d-4945-a377-2ada6bc7e54d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:46.937069 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-b457bcea-e1bf-4975-8e03-474615c5f5c3 req-dbc43d2d-fc8d-4945-a377-2ada6bc7e54d service nova] Creating event network-vif-plugged:421297be-85c7-46b8-b6d4-16c2e392bb3f for instance 06c6c840-ee24-4802-bf10-e17f5dfe54ae on nch2-master-1 Sep 24 21:01:46.942747 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-b457bcea-e1bf-4975-8e03-474615c5f5c3 req-dbc43d2d-fc8d-4945-a377-2ada6bc7e54d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056042 Sep 24 21:01:46.943699 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1634/3308] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:46.952813 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ce0c8a0c-68b1-4b7c-9f0c-71621d75be36 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:46.953968 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ce0c8a0c-68b1-4b7c-9f0c-71621d75be36 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:46.961189 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ce0c8a0c-68b1-4b7c-9f0c-71621d75be36 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:46.962252 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ce0c8a0c-68b1-4b7c-9f0c-71621d75be36 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:46.962955 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ce0c8a0c-68b1-4b7c-9f0c-71621d75be36 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:46.963953 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ce0c8a0c-68b1-4b7c-9f0c-71621d75be36 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:46.964638 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ce0c8a0c-68b1-4b7c-9f0c-71621d75be36 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:46.965837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ce0c8a0c-68b1-4b7c-9f0c-71621d75be36 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:47.087679 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1737580e-6f7e-4bb7-87eb-5594b4a22b71 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/175e8d96-5ff6-4721-a57a-74ba498aa647" status: 202 len: 0 microversion: 2.1 time: 2.694118 Sep 24 21:01:47.088860 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1675/3309] 10.222.0.52 () {58 vars in 1263 bytes} [Sat Sep 24 21:01:44 2022] DELETE /compute/v2.1/os-floating-ips/175e8d96-5ff6-4721-a57a-74ba498aa647 => generated 0 bytes in 2697 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:01:47.094359 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3e56fc78-15b5-4485-b554-54b29e30062f tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:47.095491 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3e56fc78-15b5-4485-b554-54b29e30062f tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] [instance: 06c6c840-ee24-4802-bf10-e17f5dfe54ae] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:47.108441 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3e56fc78-15b5-4485-b554-54b29e30062f tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:47.110469 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3e56fc78-15b5-4485-b554-54b29e30062f tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:47.111681 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3e56fc78-15b5-4485-b554-54b29e30062f tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:47.112637 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3e56fc78-15b5-4485-b554-54b29e30062f tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:47.113770 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3e56fc78-15b5-4485-b554-54b29e30062f tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:47.114420 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3e56fc78-15b5-4485-b554-54b29e30062f tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:47.339918 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ce0c8a0c-68b1-4b7c-9f0c-71621d75be36 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:47.348894 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ce0c8a0c-68b1-4b7c-9f0c-71621d75be36 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2" status: 200 len: 1511 microversion: 2.1 time: 0.403720 Sep 24 21:01:47.355280 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1635/3310] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:46 2022] GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 => generated 1511 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:47.365787 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-01e9f889-eafb-4136-a289-123092e9ad95 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:47.366328 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-01e9f889-eafb-4136-a289-123092e9ad95 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] [instance: d96e45af-4d4d-4282-8b88-ffeb56a4f62c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:47.379855 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01e9f889-eafb-4136-a289-123092e9ad95 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:47.380515 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01e9f889-eafb-4136-a289-123092e9ad95 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:47.382221 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01e9f889-eafb-4136-a289-123092e9ad95 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:47.383118 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01e9f889-eafb-4136-a289-123092e9ad95 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:47.385667 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01e9f889-eafb-4136-a289-123092e9ad95 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:47.386467 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01e9f889-eafb-4136-a289-123092e9ad95 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:47.449989 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-01e9f889-eafb-4136-a289-123092e9ad95 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] [instance: d96e45af-4d4d-4282-8b88-ffeb56a4f62c] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:01:47.523471 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3e56fc78-15b5-4485-b554-54b29e30062f tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9e57183b3b49c1ba39b5503420b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1408039f0bcf4130a11bedb2206b3cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:47.550533 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3e56fc78-15b5-4485-b554-54b29e30062f tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] 10.222.0.52 "GET /compute/v2.1/servers/06c6c840-ee24-4802-bf10-e17f5dfe54ae" status: 200 len: 1317 microversion: 2.1 time: 0.450263 Sep 24 21:01:47.566804 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1676/3311] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:47 2022] GET /compute/v2.1/servers/06c6c840-ee24-4802-bf10-e17f5dfe54ae => generated 1317 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:47.583766 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3ac68453-68e3-4887-a2e4-51f635c5176c tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:47.584707 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3ac68453-68e3-4887-a2e4-51f635c5176c tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:47.641141 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3ac68453-68e3-4887-a2e4-51f635c5176c tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:47.641666 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3ac68453-68e3-4887-a2e4-51f635c5176c tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:47.642127 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3ac68453-68e3-4887-a2e4-51f635c5176c tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:47.657321 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3ac68453-68e3-4887-a2e4-51f635c5176c tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:47.658144 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3ac68453-68e3-4887-a2e4-51f635c5176c tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:47.663532 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3ac68453-68e3-4887-a2e4-51f635c5176c tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:47.816830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3ac68453-68e3-4887-a2e4-51f635c5176c tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:01:47.825508 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-01e9f889-eafb-4136-a289-123092e9ad95 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d96e45af-4d4d-4282-8b88-ffeb56a4f62c" status: 204 len: 0 microversion: 2.1 time: 0.460789 Sep 24 21:01:47.836127 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1636/3312] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:01:47 2022] DELETE /compute/v2.1/servers/d96e45af-4d4d-4282-8b88-ffeb56a4f62c => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:01:47.873572 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ba2fa337-5f92-4064-babb-c7afe8709ce5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:47.874710 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ba2fa337-5f92-4064-babb-c7afe8709ce5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:47.893270 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ba2fa337-5f92-4064-babb-c7afe8709ce5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:47.894035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ba2fa337-5f92-4064-babb-c7afe8709ce5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:47.899851 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ba2fa337-5f92-4064-babb-c7afe8709ce5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:47.899851 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ba2fa337-5f92-4064-babb-c7afe8709ce5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:47.903145 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ba2fa337-5f92-4064-babb-c7afe8709ce5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:47.904259 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ba2fa337-5f92-4064-babb-c7afe8709ce5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:48.017495 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3ac68453-68e3-4887-a2e4-51f635c5176c tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "DELETE /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130" status: 204 len: 0 microversion: 2.1 time: 0.448649 Sep 24 21:01:48.018718 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1677/3313] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:01:47 2022] DELETE /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:01:48.028241 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f296d11b-e626-43aa-b179-0e0aebb3d1f2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:48.031229 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f296d11b-e626-43aa-b179-0e0aebb3d1f2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:48.040480 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f296d11b-e626-43aa-b179-0e0aebb3d1f2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:48.040986 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f296d11b-e626-43aa-b179-0e0aebb3d1f2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:48.041432 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f296d11b-e626-43aa-b179-0e0aebb3d1f2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:48.042150 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f296d11b-e626-43aa-b179-0e0aebb3d1f2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:48.042656 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f296d11b-e626-43aa-b179-0e0aebb3d1f2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:48.043094 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f296d11b-e626-43aa-b179-0e0aebb3d1f2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:48.100367 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f296d11b-e626-43aa-b179-0e0aebb3d1f2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.079368 Sep 24 21:01:48.102414 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1678/3314] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:01:48 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:01:48.108274 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b6162e4a-e7c9-4276-8df4-ab0984ffe04c tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:48.109043 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b6162e4a-e7c9-4276-8df4-ab0984ffe04c tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] [instance: ab5b3a44-e594-4cc2-8d36-51b15722edae] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:48.141117 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6162e4a-e7c9-4276-8df4-ab0984ffe04c tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:48.142252 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6162e4a-e7c9-4276-8df4-ab0984ffe04c tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:48.144355 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6162e4a-e7c9-4276-8df4-ab0984ffe04c tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:48.145155 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6162e4a-e7c9-4276-8df4-ab0984ffe04c tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:48.145599 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6162e4a-e7c9-4276-8df4-ab0984ffe04c tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:48.146039 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6162e4a-e7c9-4276-8df4-ab0984ffe04c tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:48.196155 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b6162e4a-e7c9-4276-8df4-ab0984ffe04c tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] [instance: ab5b3a44-e594-4cc2-8d36-51b15722edae] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:01:48.242711 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ba2fa337-5f92-4064-babb-c7afe8709ce5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:48.255778 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ba2fa337-5f92-4064-babb-c7afe8709ce5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1681 microversion: 2.1 time: 0.408988 Sep 24 21:01:48.286689 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1637/3315] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:47 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1681 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:48.292976 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4a64b4a9-d335-4fb5-a314-e13ed1827761 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:48.299305 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4a64b4a9-d335-4fb5-a314-e13ed1827761 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:48.320526 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4a64b4a9-d335-4fb5-a314-e13ed1827761 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:48.323307 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4a64b4a9-d335-4fb5-a314-e13ed1827761 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:48.324085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4a64b4a9-d335-4fb5-a314-e13ed1827761 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:48.326872 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4a64b4a9-d335-4fb5-a314-e13ed1827761 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:48.327642 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4a64b4a9-d335-4fb5-a314-e13ed1827761 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:48.330184 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4a64b4a9-d335-4fb5-a314-e13ed1827761 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:48.389914 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b6162e4a-e7c9-4276-8df4-ab0984ffe04c tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ab5b3a44-e594-4cc2-8d36-51b15722edae" status: 204 len: 0 microversion: 2.1 time: 0.282998 Sep 24 21:01:48.393184 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1679/3316] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:01:48 2022] DELETE /compute/v2.1/servers/ab5b3a44-e594-4cc2-8d36-51b15722edae => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:01:48.410317 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-16b52919-2961-4b04-8fca-8422a9824f85 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:48.411130 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-16b52919-2961-4b04-8fca-8422a9824f85 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:48.428709 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-16b52919-2961-4b04-8fca-8422a9824f85 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:48.429304 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-16b52919-2961-4b04-8fca-8422a9824f85 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:48.429760 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-16b52919-2961-4b04-8fca-8422a9824f85 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:48.430512 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-16b52919-2961-4b04-8fca-8422a9824f85 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:48.431036 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-16b52919-2961-4b04-8fca-8422a9824f85 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:48.431955 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-16b52919-2961-4b04-8fca-8422a9824f85 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:49.123139 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4a64b4a9-d335-4fb5-a314-e13ed1827761 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41f618458eb48f6bb4631fd254addc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4655b536ca04896993223f34d172298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:49.135647 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4a64b4a9-d335-4fb5-a314-e13ed1827761 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "GET /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130" status: 200 len: 1527 microversion: 2.1 time: 0.847427 Sep 24 21:01:49.136975 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1638/3317] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:48 2022] GET /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130 => generated 1527 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:49.143166 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-54b50608-cde1-406b-8983-c9ab7d56a94e tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:49.146834 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-54b50608-cde1-406b-8983-c9ab7d56a94e tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] [instance: d96e45af-4d4d-4282-8b88-ffeb56a4f62c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:49.167772 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54b50608-cde1-406b-8983-c9ab7d56a94e tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:49.171213 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-16b52919-2961-4b04-8fca-8422a9824f85 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:49.173975 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54b50608-cde1-406b-8983-c9ab7d56a94e tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:49.174798 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54b50608-cde1-406b-8983-c9ab7d56a94e tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:49.175798 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54b50608-cde1-406b-8983-c9ab7d56a94e tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:49.176496 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54b50608-cde1-406b-8983-c9ab7d56a94e tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:49.177309 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54b50608-cde1-406b-8983-c9ab7d56a94e tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:49.191421 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-16b52919-2961-4b04-8fca-8422a9824f85 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2" status: 200 len: 1511 microversion: 2.1 time: 0.795745 Sep 24 21:01:49.192341 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1680/3318] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:48 2022] GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 => generated 1511 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:49.200300 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4c6a4d8c-527e-461b-a5e1-54819d74a826 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:49.202869 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4c6a4d8c-527e-461b-a5e1-54819d74a826 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] [instance: 06c6c840-ee24-4802-bf10-e17f5dfe54ae] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:49.216475 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4c6a4d8c-527e-461b-a5e1-54819d74a826 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:49.216980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4c6a4d8c-527e-461b-a5e1-54819d74a826 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:49.217430 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4c6a4d8c-527e-461b-a5e1-54819d74a826 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:49.218164 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4c6a4d8c-527e-461b-a5e1-54819d74a826 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:49.218665 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4c6a4d8c-527e-461b-a5e1-54819d74a826 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:49.219106 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4c6a4d8c-527e-461b-a5e1-54819d74a826 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:49.750139 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-54b50608-cde1-406b-8983-c9ab7d56a94e tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c49bed91bb437087a8ad2d865c2647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b68f292633a49ca82fb05d18ea83142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:49.761056 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-54b50608-cde1-406b-8983-c9ab7d56a94e tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] 10.222.0.52 "GET /compute/v2.1/servers/d96e45af-4d4d-4282-8b88-ffeb56a4f62c" status: 200 len: 1511 microversion: 2.1 time: 0.621823 Sep 24 21:01:49.761665 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1639/3319] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:49 2022] GET /compute/v2.1/servers/d96e45af-4d4d-4282-8b88-ffeb56a4f62c => generated 1511 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:49.772211 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c3b23898-a42f-4f78-b723-bec18cbba087 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:49.784917 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c3b23898-a42f-4f78-b723-bec18cbba087 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:49.797109 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c3b23898-a42f-4f78-b723-bec18cbba087 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:49.806085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c3b23898-a42f-4f78-b723-bec18cbba087 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:49.809677 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c3b23898-a42f-4f78-b723-bec18cbba087 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:49.813060 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c3b23898-a42f-4f78-b723-bec18cbba087 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:49.813667 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c3b23898-a42f-4f78-b723-bec18cbba087 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:49.823805 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4c6a4d8c-527e-461b-a5e1-54819d74a826 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9e57183b3b49c1ba39b5503420b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1408039f0bcf4130a11bedb2206b3cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:49.827690 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c3b23898-a42f-4f78-b723-bec18cbba087 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:49.834032 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4c6a4d8c-527e-461b-a5e1-54819d74a826 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] 10.222.0.52 "GET /compute/v2.1/servers/06c6c840-ee24-4802-bf10-e17f5dfe54ae" status: 200 len: 1317 microversion: 2.1 time: 0.640601 Sep 24 21:01:49.843800 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1681/3320] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:49 2022] GET /compute/v2.1/servers/06c6c840-ee24-4802-bf10-e17f5dfe54ae => generated 1317 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:49.852251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ea0a985b-a12a-4b07-af00-d2ab933f4032 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:49.853105 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ea0a985b-a12a-4b07-af00-d2ab933f4032 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:49.878771 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea0a985b-a12a-4b07-af00-d2ab933f4032 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:49.879520 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea0a985b-a12a-4b07-af00-d2ab933f4032 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:49.880146 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea0a985b-a12a-4b07-af00-d2ab933f4032 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:49.883043 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea0a985b-a12a-4b07-af00-d2ab933f4032 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:49.893336 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea0a985b-a12a-4b07-af00-d2ab933f4032 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:49.894218 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea0a985b-a12a-4b07-af00-d2ab933f4032 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:49.897851 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c3b23898-a42f-4f78-b723-bec18cbba087 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.132043 Sep 24 21:01:49.917126 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1640/3321] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:01:49 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:01:50.164541 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2770058a-6836-45df-a743-83d326da74e1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:50.165290 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2770058a-6836-45df-a743-83d326da74e1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:50.180313 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2770058a-6836-45df-a743-83d326da74e1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:50.180827 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2770058a-6836-45df-a743-83d326da74e1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:50.181279 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2770058a-6836-45df-a743-83d326da74e1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:50.182012 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2770058a-6836-45df-a743-83d326da74e1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:50.182481 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2770058a-6836-45df-a743-83d326da74e1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:50.190563 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2770058a-6836-45df-a743-83d326da74e1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:50.228221 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ea0a985b-a12a-4b07-af00-d2ab933f4032 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:50.239377 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ea0a985b-a12a-4b07-af00-d2ab933f4032 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1681 microversion: 2.1 time: 0.394132 Sep 24 21:01:50.264467 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1682/3322] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:49 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1681 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:50.270246 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-803b06f6-5a66-4f14-8e8d-8fd41c4202a0 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:50.275273 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-803b06f6-5a66-4f14-8e8d-8fd41c4202a0 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:50.294018 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-803b06f6-5a66-4f14-8e8d-8fd41c4202a0 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:50.302090 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-803b06f6-5a66-4f14-8e8d-8fd41c4202a0 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:50.302910 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-803b06f6-5a66-4f14-8e8d-8fd41c4202a0 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:50.303969 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-803b06f6-5a66-4f14-8e8d-8fd41c4202a0 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:50.304669 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-803b06f6-5a66-4f14-8e8d-8fd41c4202a0 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:50.305327 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-803b06f6-5a66-4f14-8e8d-8fd41c4202a0 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:50.753394 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2770058a-6836-45df-a743-83d326da74e1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41f618458eb48f6bb4631fd254addc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4655b536ca04896993223f34d172298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:50.767057 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2770058a-6836-45df-a743-83d326da74e1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "GET /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130" status: 200 len: 1527 microversion: 2.1 time: 0.606202 Sep 24 21:01:50.783005 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1641/3323] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:50 2022] GET /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130 => generated 1527 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:01:50.792860 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6117d651-492d-4c9a-ac65-827deeb7be79 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:50.794348 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6117d651-492d-4c9a-ac65-827deeb7be79 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] [instance: d96e45af-4d4d-4282-8b88-ffeb56a4f62c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:50.802150 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6117d651-492d-4c9a-ac65-827deeb7be79 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:50.803138 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6117d651-492d-4c9a-ac65-827deeb7be79 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:50.804065 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6117d651-492d-4c9a-ac65-827deeb7be79 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:50.805188 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6117d651-492d-4c9a-ac65-827deeb7be79 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:50.806206 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6117d651-492d-4c9a-ac65-827deeb7be79 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:50.806889 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6117d651-492d-4c9a-ac65-827deeb7be79 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:50.810951 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-803b06f6-5a66-4f14-8e8d-8fd41c4202a0 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:50.826459 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-803b06f6-5a66-4f14-8e8d-8fd41c4202a0 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2" status: 200 len: 1511 microversion: 2.1 time: 0.554138 Sep 24 21:01:50.828783 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1683/3324] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:50 2022] GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 => generated 1511 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:50.865562 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-83d3f692-e1d7-4726-9b21-8fe644181bb8 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:50.866204 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-83d3f692-e1d7-4726-9b21-8fe644181bb8 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] [instance: 06c6c840-ee24-4802-bf10-e17f5dfe54ae] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:50.875540 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-83d3f692-e1d7-4726-9b21-8fe644181bb8 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:50.876045 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-83d3f692-e1d7-4726-9b21-8fe644181bb8 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:50.876578 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-83d3f692-e1d7-4726-9b21-8fe644181bb8 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:50.884921 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-83d3f692-e1d7-4726-9b21-8fe644181bb8 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:50.885426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-83d3f692-e1d7-4726-9b21-8fe644181bb8 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:50.885943 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-83d3f692-e1d7-4726-9b21-8fe644181bb8 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:51.186213 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6117d651-492d-4c9a-ac65-827deeb7be79 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c49bed91bb437087a8ad2d865c2647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b68f292633a49ca82fb05d18ea83142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:51.197210 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6117d651-492d-4c9a-ac65-827deeb7be79 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] 10.222.0.52 "GET /compute/v2.1/servers/d96e45af-4d4d-4282-8b88-ffeb56a4f62c" status: 200 len: 1511 microversion: 2.1 time: 0.408788 Sep 24 21:01:51.227142 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1642/3325] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:50 2022] GET /compute/v2.1/servers/d96e45af-4d4d-4282-8b88-ffeb56a4f62c => generated 1511 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:51.247415 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6907483a-f593-4752-8026-a7ba3de5f838 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:51.254873 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6907483a-f593-4752-8026-a7ba3de5f838 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:51.272167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6907483a-f593-4752-8026-a7ba3de5f838 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:51.274309 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6907483a-f593-4752-8026-a7ba3de5f838 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:51.274810 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6907483a-f593-4752-8026-a7ba3de5f838 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:51.278014 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6907483a-f593-4752-8026-a7ba3de5f838 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:51.278855 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6907483a-f593-4752-8026-a7ba3de5f838 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:51.279311 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6907483a-f593-4752-8026-a7ba3de5f838 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:51.401938 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-83d3f692-e1d7-4726-9b21-8fe644181bb8 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9e57183b3b49c1ba39b5503420b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1408039f0bcf4130a11bedb2206b3cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:51.408932 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6907483a-f593-4752-8026-a7ba3de5f838 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.178065 Sep 24 21:01:51.409617 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1643/3326] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:01:51 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:01:51.423719 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2c99c286-ad4c-4c71-b004-c73daad8a80d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:51.429964 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2c99c286-ad4c-4c71-b004-c73daad8a80d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:51.440324 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c99c286-ad4c-4c71-b004-c73daad8a80d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:51.441034 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c99c286-ad4c-4c71-b004-c73daad8a80d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:51.443180 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c99c286-ad4c-4c71-b004-c73daad8a80d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:51.443695 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-83d3f692-e1d7-4726-9b21-8fe644181bb8 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] 10.222.0.52 "GET /compute/v2.1/servers/06c6c840-ee24-4802-bf10-e17f5dfe54ae" status: 200 len: 1317 microversion: 2.1 time: 0.582263 Sep 24 21:01:51.444317 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1684/3327] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:50 2022] GET /compute/v2.1/servers/06c6c840-ee24-4802-bf10-e17f5dfe54ae => generated 1317 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:01:51.445673 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c99c286-ad4c-4c71-b004-c73daad8a80d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:51.446176 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c99c286-ad4c-4c71-b004-c73daad8a80d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:51.450641 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c99c286-ad4c-4c71-b004-c73daad8a80d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:51.478943 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-f99097c9-7de5-4cd4-af96-ceeec3c2482f req-e52f0527-39a7-42ab-8dec-1be66d548c18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d96e45af-4d4d-4282-8b88-ffeb56a4f62c", "name": "network-vif-deleted", "tag": "56598417-8aae-4930-a67c-3cb74ad93ea3"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:51.549848 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-f99097c9-7de5-4cd4-af96-ceeec3c2482f req-e52f0527-39a7-42ab-8dec-1be66d548c18 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:51.562571 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-f99097c9-7de5-4cd4-af96-ceeec3c2482f req-e52f0527-39a7-42ab-8dec-1be66d548c18 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:51.567560 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-f99097c9-7de5-4cd4-af96-ceeec3c2482f req-e52f0527-39a7-42ab-8dec-1be66d548c18 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:51.627185 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-f99097c9-7de5-4cd4-af96-ceeec3c2482f req-e52f0527-39a7-42ab-8dec-1be66d548c18 service nova] Creating event network-vif-deleted:56598417-8aae-4930-a67c-3cb74ad93ea3 for instance d96e45af-4d4d-4282-8b88-ffeb56a4f62c on nch1-master-1 Sep 24 21:01:51.656147 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-f99097c9-7de5-4cd4-af96-ceeec3c2482f req-e52f0527-39a7-42ab-8dec-1be66d548c18 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200920 Sep 24 21:01:51.657215 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1685/3328] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:01:51.800466 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2cb19f90-2ca0-4cb0-a8d4-2ba20e0ebb1b tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:51.801563 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2cb19f90-2ca0-4cb0-a8d4-2ba20e0ebb1b tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:51.847856 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2cb19f90-2ca0-4cb0-a8d4-2ba20e0ebb1b tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:51.848386 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2cb19f90-2ca0-4cb0-a8d4-2ba20e0ebb1b tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:51.848847 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2cb19f90-2ca0-4cb0-a8d4-2ba20e0ebb1b tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:51.849592 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2cb19f90-2ca0-4cb0-a8d4-2ba20e0ebb1b tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:51.853433 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2cb19f90-2ca0-4cb0-a8d4-2ba20e0ebb1b tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:51.853922 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2cb19f90-2ca0-4cb0-a8d4-2ba20e0ebb1b tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:51.877839 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2c99c286-ad4c-4c71-b004-c73daad8a80d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:51.894064 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2c99c286-ad4c-4c71-b004-c73daad8a80d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.483240 Sep 24 21:01:51.897037 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1644/3329] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:51 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:51.904220 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9d7f8cfa-13c9-43df-99c5-6daaf719c50f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:51.905709 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9d7f8cfa-13c9-43df-99c5-6daaf719c50f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:51.935021 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d7f8cfa-13c9-43df-99c5-6daaf719c50f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:51.936105 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d7f8cfa-13c9-43df-99c5-6daaf719c50f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:51.942684 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d7f8cfa-13c9-43df-99c5-6daaf719c50f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:51.948094 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d7f8cfa-13c9-43df-99c5-6daaf719c50f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:51.948615 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d7f8cfa-13c9-43df-99c5-6daaf719c50f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:51.949072 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d7f8cfa-13c9-43df-99c5-6daaf719c50f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:52.000373 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:01:52.167792 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2cb19f90-2ca0-4cb0-a8d4-2ba20e0ebb1b tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41f618458eb48f6bb4631fd254addc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4655b536ca04896993223f34d172298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:52.189705 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2cb19f90-2ca0-4cb0-a8d4-2ba20e0ebb1b tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "GET /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130" status: 200 len: 1527 microversion: 2.1 time: 0.398286 Sep 24 21:01:52.197158 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1686/3330] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:51 2022] GET /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130 => generated 1527 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:52.225130 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d3286fd7-4e23-4ce9-a8fa-7261b4b13cfd tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:52.225739 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d3286fd7-4e23-4ce9-a8fa-7261b4b13cfd tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] [instance: d96e45af-4d4d-4282-8b88-ffeb56a4f62c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:52.236015 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d3286fd7-4e23-4ce9-a8fa-7261b4b13cfd tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:52.236594 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d3286fd7-4e23-4ce9-a8fa-7261b4b13cfd tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:52.237077 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d3286fd7-4e23-4ce9-a8fa-7261b4b13cfd tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:52.245610 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9d7f8cfa-13c9-43df-99c5-6daaf719c50f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:52.254044 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d3286fd7-4e23-4ce9-a8fa-7261b4b13cfd tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:52.255846 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d3286fd7-4e23-4ce9-a8fa-7261b4b13cfd tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:52.256313 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d3286fd7-4e23-4ce9-a8fa-7261b4b13cfd tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:52.259744 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9d7f8cfa-13c9-43df-99c5-6daaf719c50f tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2" status: 200 len: 1511 microversion: 2.1 time: 0.361373 Sep 24 21:01:52.263675 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1645/3331] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:51 2022] GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 => generated 1511 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:52.279816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:01:52.321595 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d3286fd7-4e23-4ce9-a8fa-7261b4b13cfd tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:52.322252 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d3286fd7-4e23-4ce9-a8fa-7261b4b13cfd tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:52.326381 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d3286fd7-4e23-4ce9-a8fa-7261b4b13cfd tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:52.330910 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-d3286fd7-4e23-4ce9-a8fa-7261b4b13cfd tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lazy-loading 'fault' on Instance uuid d96e45af-4d4d-4282-8b88-ffeb56a4f62c {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:01:52.425688 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d3286fd7-4e23-4ce9-a8fa-7261b4b13cfd tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c49bed91bb437087a8ad2d865c2647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b68f292633a49ca82fb05d18ea83142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:52.430835 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-56d5cecf-edff-4189-980b-9aace3775756 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:52.436417 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-56d5cecf-edff-4189-980b-9aace3775756 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:52.445821 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d3286fd7-4e23-4ce9-a8fa-7261b4b13cfd tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] 10.222.0.52 "GET /compute/v2.1/servers/d96e45af-4d4d-4282-8b88-ffeb56a4f62c" status: 200 len: 1307 microversion: 2.1 time: 0.225142 Sep 24 21:01:52.462412 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1687/3332] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:52 2022] GET /compute/v2.1/servers/d96e45af-4d4d-4282-8b88-ffeb56a4f62c => generated 1307 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:01:52.463125 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-56d5cecf-edff-4189-980b-9aace3775756 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:52.463125 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-56d5cecf-edff-4189-980b-9aace3775756 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:52.463125 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-56d5cecf-edff-4189-980b-9aace3775756 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:52.463125 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-56d5cecf-edff-4189-980b-9aace3775756 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:52.463125 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-56d5cecf-edff-4189-980b-9aace3775756 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:52.463125 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-56d5cecf-edff-4189-980b-9aace3775756 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:52.470722 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-05dc0520-b36f-4bf9-a787-9e0d31aa667e tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:52.471361 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-05dc0520-b36f-4bf9-a787-9e0d31aa667e tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] [instance: 06c6c840-ee24-4802-bf10-e17f5dfe54ae] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:52.482238 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05dc0520-b36f-4bf9-a787-9e0d31aa667e tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:52.484916 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05dc0520-b36f-4bf9-a787-9e0d31aa667e tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:52.485503 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05dc0520-b36f-4bf9-a787-9e0d31aa667e tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:52.487713 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05dc0520-b36f-4bf9-a787-9e0d31aa667e tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:52.488602 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05dc0520-b36f-4bf9-a787-9e0d31aa667e tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:52.491202 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05dc0520-b36f-4bf9-a787-9e0d31aa667e tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:52.550457 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-56d5cecf-edff-4189-980b-9aace3775756 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.132438 Sep 24 21:01:52.555085 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1646/3333] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:01:52 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 21:01:52.743133 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-05dc0520-b36f-4bf9-a787-9e0d31aa667e tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9e57183b3b49c1ba39b5503420b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1408039f0bcf4130a11bedb2206b3cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:52.752561 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-05dc0520-b36f-4bf9-a787-9e0d31aa667e tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] 10.222.0.52 "GET /compute/v2.1/servers/06c6c840-ee24-4802-bf10-e17f5dfe54ae" status: 200 len: 1505 microversion: 2.1 time: 0.286231 Sep 24 21:01:52.753817 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1688/3334] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:52 2022] GET /compute/v2.1/servers/06c6c840-ee24-4802-bf10-e17f5dfe54ae => generated 1505 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:01:52.779221 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c2aa8256-deed-4154-9866-422e4c825776 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:52.779992 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c2aa8256-deed-4154-9866-422e4c825776 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] [instance: 06c6c840-ee24-4802-bf10-e17f5dfe54ae] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:52.786473 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c2aa8256-deed-4154-9866-422e4c825776 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:52.786997 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c2aa8256-deed-4154-9866-422e4c825776 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:52.787436 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c2aa8256-deed-4154-9866-422e4c825776 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:52.788137 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c2aa8256-deed-4154-9866-422e4c825776 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:52.788821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c2aa8256-deed-4154-9866-422e4c825776 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:52.789254 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c2aa8256-deed-4154-9866-422e4c825776 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:52.816204 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c2aa8256-deed-4154-9866-422e4c825776 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] 10.222.0.52 "GET /compute/v2.1/servers/06c6c840-ee24-4802-bf10-e17f5dfe54ae/ips" status: 200 len: 108 microversion: 2.1 time: 0.042497 Sep 24 21:01:52.816845 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1647/3335] 10.222.0.52 () {58 vars in 1248 bytes} [Sat Sep 24 21:01:52 2022] GET /compute/v2.1/servers/06c6c840-ee24-4802-bf10-e17f5dfe54ae/ips => generated 108 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:52.832685 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-08f82085-7a85-404b-b8cf-28cfa7dfece7 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:52.833598 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-08f82085-7a85-404b-b8cf-28cfa7dfece7 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] [instance: 06c6c840-ee24-4802-bf10-e17f5dfe54ae] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:52.841205 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-08f82085-7a85-404b-b8cf-28cfa7dfece7 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:52.841990 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-08f82085-7a85-404b-b8cf-28cfa7dfece7 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:52.842436 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-08f82085-7a85-404b-b8cf-28cfa7dfece7 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:52.843486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-08f82085-7a85-404b-b8cf-28cfa7dfece7 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:52.843955 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-08f82085-7a85-404b-b8cf-28cfa7dfece7 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:52.844568 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-08f82085-7a85-404b-b8cf-28cfa7dfece7 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:52.879704 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-08f82085-7a85-404b-b8cf-28cfa7dfece7 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] 10.222.0.52 "GET /compute/v2.1/servers/06c6c840-ee24-4802-bf10-e17f5dfe54ae/ips" status: 200 len: 108 microversion: 2.1 time: 0.051944 Sep 24 21:01:52.881623 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1689/3336] 10.222.0.52 () {58 vars in 1248 bytes} [Sat Sep 24 21:01:52 2022] GET /compute/v2.1/servers/06c6c840-ee24-4802-bf10-e17f5dfe54ae/ips => generated 108 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:52.891821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4f3888b4-26c7-4b10-8d75-24e58bb3647d tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:52.892333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4f3888b4-26c7-4b10-8d75-24e58bb3647d tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] [instance: 06c6c840-ee24-4802-bf10-e17f5dfe54ae] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:52.899569 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4f3888b4-26c7-4b10-8d75-24e58bb3647d tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:52.900094 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4f3888b4-26c7-4b10-8d75-24e58bb3647d tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:52.900538 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4f3888b4-26c7-4b10-8d75-24e58bb3647d tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:52.901253 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4f3888b4-26c7-4b10-8d75-24e58bb3647d tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:52.901712 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4f3888b4-26c7-4b10-8d75-24e58bb3647d tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:52.902137 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4f3888b4-26c7-4b10-8d75-24e58bb3647d tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:52.929567 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4f3888b4-26c7-4b10-8d75-24e58bb3647d tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] 10.222.0.52 "GET /compute/v2.1/servers/06c6c840-ee24-4802-bf10-e17f5dfe54ae/ips/tempest-ServerAddressesTestJSON-761250842-network" status: 200 len: 93 microversion: 2.1 time: 0.041814 Sep 24 21:01:52.930166 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1648/3337] 10.222.0.52 () {58 vars in 1398 bytes} [Sat Sep 24 21:01:52 2022] GET /compute/v2.1/servers/06c6c840-ee24-4802-bf10-e17f5dfe54ae/ips/tempest-ServerAddressesTestJSON-761250842-network => generated 93 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 21:01:52.943830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2093f1e2-78e5-4d95-a878-ea203e231919 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:52.944350 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2093f1e2-78e5-4d95-a878-ea203e231919 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] [instance: 06c6c840-ee24-4802-bf10-e17f5dfe54ae] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:52.951789 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2093f1e2-78e5-4d95-a878-ea203e231919 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:52.952813 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2093f1e2-78e5-4d95-a878-ea203e231919 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:52.954574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2093f1e2-78e5-4d95-a878-ea203e231919 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:52.955349 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2093f1e2-78e5-4d95-a878-ea203e231919 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:52.956085 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2093f1e2-78e5-4d95-a878-ea203e231919 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:52.956636 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2093f1e2-78e5-4d95-a878-ea203e231919 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:52.989103 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2093f1e2-78e5-4d95-a878-ea203e231919 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] [instance: 06c6c840-ee24-4802-bf10-e17f5dfe54ae] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:01:53.133457 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2093f1e2-78e5-4d95-a878-ea203e231919 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] 10.222.0.52 "DELETE /compute/v2.1/servers/06c6c840-ee24-4802-bf10-e17f5dfe54ae" status: 204 len: 0 microversion: 2.1 time: 0.193505 Sep 24 21:01:53.134057 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1690/3338] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:01:52 2022] DELETE /compute/v2.1/servers/06c6c840-ee24-4802-bf10-e17f5dfe54ae => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:01:53.144819 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8c648895-13a9-4566-8312-583878044b6d tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:53.145951 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8c648895-13a9-4566-8312-583878044b6d tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] [instance: 06c6c840-ee24-4802-bf10-e17f5dfe54ae] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:53.147572 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a4e55c2b-eda1-4550-afe1-469712b06492 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:53.148211 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a4e55c2b-eda1-4550-afe1-469712b06492 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:53.158285 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c648895-13a9-4566-8312-583878044b6d tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:53.158838 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c648895-13a9-4566-8312-583878044b6d tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:53.159291 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c648895-13a9-4566-8312-583878044b6d tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:53.160016 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c648895-13a9-4566-8312-583878044b6d tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:53.160671 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c648895-13a9-4566-8312-583878044b6d tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:53.161287 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c648895-13a9-4566-8312-583878044b6d tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:53.163103 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4e55c2b-eda1-4550-afe1-469712b06492 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:53.163626 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4e55c2b-eda1-4550-afe1-469712b06492 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:53.164083 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4e55c2b-eda1-4550-afe1-469712b06492 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:53.166967 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4e55c2b-eda1-4550-afe1-469712b06492 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:53.167661 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4e55c2b-eda1-4550-afe1-469712b06492 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:53.168823 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4e55c2b-eda1-4550-afe1-469712b06492 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:53.548608 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a4e55c2b-eda1-4550-afe1-469712b06492 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:53.555927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8c648895-13a9-4566-8312-583878044b6d tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9e57183b3b49c1ba39b5503420b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1408039f0bcf4130a11bedb2206b3cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:53.570021 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a4e55c2b-eda1-4550-afe1-469712b06492 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.427932 Sep 24 21:01:53.571927 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8c648895-13a9-4566-8312-583878044b6d tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] 10.222.0.52 "GET /compute/v2.1/servers/06c6c840-ee24-4802-bf10-e17f5dfe54ae" status: 200 len: 1511 microversion: 2.1 time: 0.431502 Sep 24 21:01:53.575220 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1691/3339] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:53 2022] GET /compute/v2.1/servers/06c6c840-ee24-4802-bf10-e17f5dfe54ae => generated 1511 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:53.589140 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1649/3340] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:53 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:53.591682 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1579f216-a22b-41a6-a457-6617712f06a1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:53.592434 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1579f216-a22b-41a6-a457-6617712f06a1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:53.606885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1579f216-a22b-41a6-a457-6617712f06a1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:53.608785 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1579f216-a22b-41a6-a457-6617712f06a1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:53.610175 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1579f216-a22b-41a6-a457-6617712f06a1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:53.612674 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1579f216-a22b-41a6-a457-6617712f06a1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:53.614634 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-69ef6195-eaed-4e1c-beb0-cee3ea6f83ff tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:53.615580 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1579f216-a22b-41a6-a457-6617712f06a1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:53.617320 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1579f216-a22b-41a6-a457-6617712f06a1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:53.655948 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-69ef6195-eaed-4e1c-beb0-cee3ea6f83ff tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:53.692944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69ef6195-eaed-4e1c-beb0-cee3ea6f83ff tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:53.694635 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69ef6195-eaed-4e1c-beb0-cee3ea6f83ff tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:53.720232 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69ef6195-eaed-4e1c-beb0-cee3ea6f83ff tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:53.724427 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69ef6195-eaed-4e1c-beb0-cee3ea6f83ff tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:53.727715 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69ef6195-eaed-4e1c-beb0-cee3ea6f83ff tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:53.733151 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69ef6195-eaed-4e1c-beb0-cee3ea6f83ff tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:53.939064 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1579f216-a22b-41a6-a457-6617712f06a1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41f618458eb48f6bb4631fd254addc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4655b536ca04896993223f34d172298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:53.951222 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1579f216-a22b-41a6-a457-6617712f06a1 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "GET /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130" status: 200 len: 1527 microversion: 2.1 time: 0.374576 Sep 24 21:01:53.953446 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1692/3341] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:53 2022] GET /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130 => generated 1527 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:53.987727 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6fe5016c-272d-4ace-978f-e0f01cb4fb48 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:53.988686 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6fe5016c-272d-4ace-978f-e0f01cb4fb48 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] [instance: d96e45af-4d4d-4282-8b88-ffeb56a4f62c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:54.009026 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6fe5016c-272d-4ace-978f-e0f01cb4fb48 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:54.010325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6fe5016c-272d-4ace-978f-e0f01cb4fb48 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:54.011760 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6fe5016c-272d-4ace-978f-e0f01cb4fb48 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:54.013248 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6fe5016c-272d-4ace-978f-e0f01cb4fb48 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:54.014275 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6fe5016c-272d-4ace-978f-e0f01cb4fb48 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:54.015268 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6fe5016c-272d-4ace-978f-e0f01cb4fb48 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:54.037427 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-6fe5016c-272d-4ace-978f-e0f01cb4fb48 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] HTTP exception thrown: Instance d96e45af-4d4d-4282-8b88-ffeb56a4f62c could not be found. Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6fe5016c-272d-4ace-978f-e0f01cb4fb48 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Request method failure captured: Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/d96e45af-4d4d-4282-8b88-ffeb56a4f62c HTTP/1.1 Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL2__3nIyPeITRqYb7kKxCt6XY8apdXryr1vCD1x_L6bE6q9JYPcknRGd3MDJAIZarAJbJRa6yXoQ9auKOQT3SxqOSF9tAnDKp7oaEk1zsnrBE9K4INBf4N4jDrvT2EcnsTccaHizD4Wc0QtoEcQjcxVdIgzqUPsehWZs0dRhj1DQR4w Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 5b68f292633a49ca82fb05d18ea83142 Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-MultipleCreateTestJSON-1299926017 Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b68f292633a49ca82fb05d18ea83142"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5b68f292633a49ca82fb05d18ea83142"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5b68f292633a49ca82fb05d18ea83142"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b68f292633a49ca82fb05d18ea83142"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-MultipleCreateTestJSON-1299926017 Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 5b68f292633a49ca82fb05d18ea83142 Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1299926017 Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-MultipleCreateTestJSON-1299926017-project Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: c7c49bed91bb437087a8ad2d865c2647 Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-MultipleCreateTestJSON-1299926017-project Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance d96e45af-4d4d-4282-8b88-ffeb56a4f62c could not be found. Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'd96e45af-4d4d-4282-8b88-ffeb56a4f62c'} Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d96e45af-4d4d-4282-8b88-ffeb56a4f62c could not be found. Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d96e45af-4d4d-4282-8b88-ffeb56a4f62c could not be found. Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:54.039301 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:54.043989 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:54.043989 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:54.043989 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:54.043989 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:01:54.043989 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:01:54.043989 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d96e45af-4d4d-4282-8b88-ffeb56a4f62c could not be found. Sep 24 21:01:54.043989 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:54.046052 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6fe5016c-272d-4ace-978f-e0f01cb4fb48 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Returning 404 to user: Instance d96e45af-4d4d-4282-8b88-ffeb56a4f62c could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:01:54.047414 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6fe5016c-272d-4ace-978f-e0f01cb4fb48 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] 10.222.0.52 "GET /compute/v2.1/servers/d96e45af-4d4d-4282-8b88-ffeb56a4f62c" status: 404 len: 111 microversion: 2.1 time: 0.089979 Sep 24 21:01:54.048459 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1693/3342] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:53 2022] GET /compute/v2.1/servers/d96e45af-4d4d-4282-8b88-ffeb56a4f62c => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:01:54.053501 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-827a8a05-15c4-4982-ab18-18721b9881d7 req-11c91d36-91bf-4435-bfb1-647ebdb4a47f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab5b3a44-e594-4cc2-8d36-51b15722edae", "name": "network-vif-deleted", "tag": "0d7ec7f2-aabd-4f1b-a5ce-5ad1414dd9cb"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:54.071207 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-827a8a05-15c4-4982-ab18-18721b9881d7 req-11c91d36-91bf-4435-bfb1-647ebdb4a47f service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:54.071906 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-827a8a05-15c4-4982-ab18-18721b9881d7 req-11c91d36-91bf-4435-bfb1-647ebdb4a47f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:54.072828 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-827a8a05-15c4-4982-ab18-18721b9881d7 req-11c91d36-91bf-4435-bfb1-647ebdb4a47f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:54.103495 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-827a8a05-15c4-4982-ab18-18721b9881d7 req-11c91d36-91bf-4435-bfb1-647ebdb4a47f service nova] Creating event network-vif-deleted:0d7ec7f2-aabd-4f1b-a5ce-5ad1414dd9cb for instance ab5b3a44-e594-4cc2-8d36-51b15722edae on nch2-master-1 Sep 24 21:01:54.110537 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-827a8a05-15c4-4982-ab18-18721b9881d7 req-11c91d36-91bf-4435-bfb1-647ebdb4a47f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060046 Sep 24 21:01:54.111754 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1694/3343] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:54.120095 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6270cea6-d707-44db-b6d6-82e6b74894f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:54.123476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6270cea6-d707-44db-b6d6-82e6b74894f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:54.131877 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6270cea6-d707-44db-b6d6-82e6b74894f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:54.134703 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6270cea6-d707-44db-b6d6-82e6b74894f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:54.136282 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6270cea6-d707-44db-b6d6-82e6b74894f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:54.137923 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6270cea6-d707-44db-b6d6-82e6b74894f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:54.138354 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6270cea6-d707-44db-b6d6-82e6b74894f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:54.138856 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6270cea6-d707-44db-b6d6-82e6b74894f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:54.156334 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-69ef6195-eaed-4e1c-beb0-cee3ea6f83ff tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:54.232583 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-69ef6195-eaed-4e1c-beb0-cee3ea6f83ff tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2" status: 200 len: 1511 microversion: 2.1 time: 0.638494 Sep 24 21:01:54.237003 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1650/3344] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:53 2022] GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 => generated 1511 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:54.245447 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6270cea6-d707-44db-b6d6-82e6b74894f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.127801 Sep 24 21:01:54.246881 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1695/3345] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:01:54 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:01:54.268159 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-15ec489b-2366-456c-8c71-14a88712c078 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:54.270300 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-15ec489b-2366-456c-8c71-14a88712c078 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] [instance: ab5b3a44-e594-4cc2-8d36-51b15722edae] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:54.280102 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-15ec489b-2366-456c-8c71-14a88712c078 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:54.280618 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-15ec489b-2366-456c-8c71-14a88712c078 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:54.281069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-15ec489b-2366-456c-8c71-14a88712c078 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:54.281827 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-15ec489b-2366-456c-8c71-14a88712c078 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:54.282263 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-15ec489b-2366-456c-8c71-14a88712c078 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:54.283090 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-15ec489b-2366-456c-8c71-14a88712c078 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:54.388059 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-15ec489b-2366-456c-8c71-14a88712c078 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c49bed91bb437087a8ad2d865c2647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b68f292633a49ca82fb05d18ea83142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:54.397342 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-15ec489b-2366-456c-8c71-14a88712c078 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] 10.222.0.52 "GET /compute/v2.1/servers/ab5b3a44-e594-4cc2-8d36-51b15722edae" status: 200 len: 1302 microversion: 2.1 time: 0.149358 Sep 24 21:01:54.398557 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1696/3346] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:54 2022] GET /compute/v2.1/servers/ab5b3a44-e594-4cc2-8d36-51b15722edae => generated 1302 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:54.539984 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-46a023b8-72a4-42fa-b648-054271a2026a tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-75900701", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "a6705abe-ac79-4ade-a282-a7a2ff328ac9"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:54.607150 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c04b98d5-3c0e-4abc-85fc-0118fd3bc6b4 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:54.607150 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c04b98d5-3c0e-4abc-85fc-0118fd3bc6b4 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] [instance: 06c6c840-ee24-4802-bf10-e17f5dfe54ae] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:54.635701 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c04b98d5-3c0e-4abc-85fc-0118fd3bc6b4 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:54.636220 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c04b98d5-3c0e-4abc-85fc-0118fd3bc6b4 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:54.637308 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c04b98d5-3c0e-4abc-85fc-0118fd3bc6b4 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:54.638574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c04b98d5-3c0e-4abc-85fc-0118fd3bc6b4 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:54.639526 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c04b98d5-3c0e-4abc-85fc-0118fd3bc6b4 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:54.644253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c04b98d5-3c0e-4abc-85fc-0118fd3bc6b4 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:54.653631 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-46a023b8-72a4-42fa-b648-054271a2026a tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] validate_networks() for [('a6705abe-ac79-4ade-a282-a7a2ff328ac9', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:01:55.076960 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c04b98d5-3c0e-4abc-85fc-0118fd3bc6b4 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9e57183b3b49c1ba39b5503420b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1408039f0bcf4130a11bedb2206b3cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:55.094325 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c04b98d5-3c0e-4abc-85fc-0118fd3bc6b4 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] 10.222.0.52 "GET /compute/v2.1/servers/06c6c840-ee24-4802-bf10-e17f5dfe54ae" status: 200 len: 1511 microversion: 2.1 time: 0.497835 Sep 24 21:01:55.095970 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1697/3347] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:54 2022] GET /compute/v2.1/servers/06c6c840-ee24-4802-bf10-e17f5dfe54ae => generated 1511 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:01:55.109483 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8cc5a27a-588a-4fd3-b196-2082a05c1312 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:55.110328 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8cc5a27a-588a-4fd3-b196-2082a05c1312 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:55.129191 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8cc5a27a-588a-4fd3-b196-2082a05c1312 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:55.129699 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8cc5a27a-588a-4fd3-b196-2082a05c1312 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:55.137798 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8cc5a27a-588a-4fd3-b196-2082a05c1312 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:55.138698 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8cc5a27a-588a-4fd3-b196-2082a05c1312 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:55.139195 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8cc5a27a-588a-4fd3-b196-2082a05c1312 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:55.139641 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8cc5a27a-588a-4fd3-b196-2082a05c1312 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:55.352584 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8cc5a27a-588a-4fd3-b196-2082a05c1312 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:55.354445 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8cc5a27a-588a-4fd3-b196-2082a05c1312 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:55.354919 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8cc5a27a-588a-4fd3-b196-2082a05c1312 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:55.364113 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-8cc5a27a-588a-4fd3-b196-2082a05c1312 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lazy-loading 'fault' on Instance uuid 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:01:55.605735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8cc5a27a-588a-4fd3-b196-2082a05c1312 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41f618458eb48f6bb4631fd254addc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4655b536ca04896993223f34d172298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:55.616093 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8cc5a27a-588a-4fd3-b196-2082a05c1312 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "GET /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130" status: 200 len: 1314 microversion: 2.1 time: 0.519031 Sep 24 21:01:55.618097 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1698/3348] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:55 2022] GET /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130 => generated 1314 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:55.633010 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-46a023b8-72a4-42fa-b648-054271a2026a tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:01:55.634042 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-46a023b8-72a4-42fa-b648-054271a2026a tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:01:55.635209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-46a023b8-72a4-42fa-b648-054271a2026a tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:01:55.635931 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-46a023b8-72a4-42fa-b648-054271a2026a tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:01:55.636368 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-46a023b8-72a4-42fa-b648-054271a2026a tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:01:55.639766 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-13523798-0a67-4d6d-958e-461eb2a1f8c7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:55.644546 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-13523798-0a67-4d6d-958e-461eb2a1f8c7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:55.651341 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-13523798-0a67-4d6d-958e-461eb2a1f8c7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:55.651845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-13523798-0a67-4d6d-958e-461eb2a1f8c7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:55.653166 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-13523798-0a67-4d6d-958e-461eb2a1f8c7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:55.654010 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-13523798-0a67-4d6d-958e-461eb2a1f8c7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:55.654717 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-13523798-0a67-4d6d-958e-461eb2a1f8c7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:55.655350 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-13523798-0a67-4d6d-958e-461eb2a1f8c7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:55.661444 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46a023b8-72a4-42fa-b648-054271a2026a tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:55.662768 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46a023b8-72a4-42fa-b648-054271a2026a tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:55.663742 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46a023b8-72a4-42fa-b648-054271a2026a tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:55.665715 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46a023b8-72a4-42fa-b648-054271a2026a tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:55.666113 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46a023b8-72a4-42fa-b648-054271a2026a tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:55.666839 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46a023b8-72a4-42fa-b648-054271a2026a tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:55.690428 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-46a023b8-72a4-42fa-b648-054271a2026a tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Getting quotas for project dd4ce6fc820e4fb5b5e731650ed6faad. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:01:55.701255 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-46a023b8-72a4-42fa-b648-054271a2026a tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Getting quotas for user c70045b8fe87481b8fae4597b979b046 and project dd4ce6fc820e4fb5b5e731650ed6faad. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:01:55.719756 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-13523798-0a67-4d6d-958e-461eb2a1f8c7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.097917 Sep 24 21:01:55.720861 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1699/3349] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:01:55 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:01:55.729170 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-46a023b8-72a4-42fa-b648-054271a2026a tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:01:55.737251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a49052b1-b75e-41a2-bb98-38c0387d8a01 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:55.738729 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a49052b1-b75e-41a2-bb98-38c0387d8a01 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:55.739121 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-46a023b8-72a4-42fa-b648-054271a2026a tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] [instance: de3e9921-d647-4ba4-97b4-bfa6edd98b48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:01:55.770712 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a49052b1-b75e-41a2-bb98-38c0387d8a01 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:55.771583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a49052b1-b75e-41a2-bb98-38c0387d8a01 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:55.775740 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a49052b1-b75e-41a2-bb98-38c0387d8a01 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:55.780174 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a49052b1-b75e-41a2-bb98-38c0387d8a01 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:55.780829 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a49052b1-b75e-41a2-bb98-38c0387d8a01 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:55.781301 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a49052b1-b75e-41a2-bb98-38c0387d8a01 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:55.873031 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-46a023b8-72a4-42fa-b648-054271a2026a tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.632380 Sep 24 21:01:55.876423 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1651/3350] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:01:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:01:55.894047 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-32d385d4-605d-48ec-b325-63c1c39121d6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:55.898303 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-32d385d4-605d-48ec-b325-63c1c39121d6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] [instance: ab5b3a44-e594-4cc2-8d36-51b15722edae] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:55.912089 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-32d385d4-605d-48ec-b325-63c1c39121d6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:55.919432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-32d385d4-605d-48ec-b325-63c1c39121d6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:55.920152 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-32d385d4-605d-48ec-b325-63c1c39121d6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:55.921298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-32d385d4-605d-48ec-b325-63c1c39121d6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:55.925932 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-32d385d4-605d-48ec-b325-63c1c39121d6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:55.926884 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-32d385d4-605d-48ec-b325-63c1c39121d6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:55.959302 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-32d385d4-605d-48ec-b325-63c1c39121d6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] HTTP exception thrown: Instance ab5b3a44-e594-4cc2-8d36-51b15722edae could not be found. Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-32d385d4-605d-48ec-b325-63c1c39121d6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Request method failure captured: Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/ab5b3a44-e594-4cc2-8d36-51b15722edae HTTP/1.1 Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL2__3nIyPeITRqYb7kKxCt6XY8apdXryr1vCD1x_L6bE6q9JYPcknRGd3MDJAIZarAJbJRa6yXoQ9auKOQT3SxqOSF9tAnDKp7oaEk1zsnrBE9K4INBf4N4jDrvT2EcnsTccaHizD4Wc0QtoEcQjcxVdIgzqUPsehWZs0dRhj1DQR4w Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 5b68f292633a49ca82fb05d18ea83142 Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-MultipleCreateTestJSON-1299926017 Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b68f292633a49ca82fb05d18ea83142"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5b68f292633a49ca82fb05d18ea83142"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5b68f292633a49ca82fb05d18ea83142"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b68f292633a49ca82fb05d18ea83142"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-MultipleCreateTestJSON-1299926017 Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 5b68f292633a49ca82fb05d18ea83142 Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1299926017 Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-MultipleCreateTestJSON-1299926017-project Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: c7c49bed91bb437087a8ad2d865c2647 Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-MultipleCreateTestJSON-1299926017-project Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance ab5b3a44-e594-4cc2-8d36-51b15722edae could not be found. Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'ab5b3a44-e594-4cc2-8d36-51b15722edae'} Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab5b3a44-e594-4cc2-8d36-51b15722edae could not be found. Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab5b3a44-e594-4cc2-8d36-51b15722edae could not be found. Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:55.962559 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:01:55.968584 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:55.968584 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:55.968584 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:55.968584 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:01:55.968584 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:01:55.968584 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab5b3a44-e594-4cc2-8d36-51b15722edae could not be found. Sep 24 21:01:55.968584 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:01:55.978738 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-32d385d4-605d-48ec-b325-63c1c39121d6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] Returning 404 to user: Instance ab5b3a44-e594-4cc2-8d36-51b15722edae could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:01:55.992780 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-32d385d4-605d-48ec-b325-63c1c39121d6 tempest-MultipleCreateTestJSON-1299926017 tempest-MultipleCreateTestJSON-1299926017-project] 10.222.0.52 "GET /compute/v2.1/servers/ab5b3a44-e594-4cc2-8d36-51b15722edae" status: 404 len: 111 microversion: 2.1 time: 0.111240 Sep 24 21:01:55.994970 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1652/3351] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:55 2022] GET /compute/v2.1/servers/ab5b3a44-e594-4cc2-8d36-51b15722edae => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:01:56.010616 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-279d9fad-f1a4-4e1f-9b64-d0e007cb8e30 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:56.011256 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-279d9fad-f1a4-4e1f-9b64-d0e007cb8e30 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:56.037967 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-279d9fad-f1a4-4e1f-9b64-d0e007cb8e30 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:56.039942 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-279d9fad-f1a4-4e1f-9b64-d0e007cb8e30 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:56.041601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-279d9fad-f1a4-4e1f-9b64-d0e007cb8e30 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:56.045790 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-279d9fad-f1a4-4e1f-9b64-d0e007cb8e30 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:56.047583 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-279d9fad-f1a4-4e1f-9b64-d0e007cb8e30 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:56.048767 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-279d9fad-f1a4-4e1f-9b64-d0e007cb8e30 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:56.240257 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a49052b1-b75e-41a2-bb98-38c0387d8a01 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:56.254791 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a49052b1-b75e-41a2-bb98-38c0387d8a01 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2" status: 200 len: 1511 microversion: 2.1 time: 0.529481 Sep 24 21:01:56.255428 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1700/3352] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:55 2022] GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 => generated 1511 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:56.280891 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-7c2ca590-30e9-4988-b531-532aed53ff20 req-1025854e-13d8-4dcb-9659-4a382fbae2e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d546302-deb3-47c6-b9fd-3155ced00883", "name": "network-vif-unplugged", "status": "completed", "tag": "56949465-71b8-45bb-b1d2-4b934bfc9714"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:56.317398 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-7c2ca590-30e9-4988-b531-532aed53ff20 req-1025854e-13d8-4dcb-9659-4a382fbae2e8 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:56.320035 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-7c2ca590-30e9-4988-b531-532aed53ff20 req-1025854e-13d8-4dcb-9659-4a382fbae2e8 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:56.320493 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-7c2ca590-30e9-4988-b531-532aed53ff20 req-1025854e-13d8-4dcb-9659-4a382fbae2e8 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:56.358731 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-7c2ca590-30e9-4988-b531-532aed53ff20 req-1025854e-13d8-4dcb-9659-4a382fbae2e8 service nova] Creating event network-vif-unplugged:56949465-71b8-45bb-b1d2-4b934bfc9714 for instance 0d546302-deb3-47c6-b9fd-3155ced00883 on nch1-master-1 Sep 24 21:01:56.368584 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-7c2ca590-30e9-4988-b531-532aed53ff20 req-1025854e-13d8-4dcb-9659-4a382fbae2e8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109146 Sep 24 21:01:56.373244 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1701/3353] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:56.380142 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-46be1f64-5285-4aeb-9507-ae465ccaeec8 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:56.380869 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-46be1f64-5285-4aeb-9507-ae465ccaeec8 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] [instance: de3e9921-d647-4ba4-97b4-bfa6edd98b48] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:56.436343 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-279d9fad-f1a4-4e1f-9b64-d0e007cb8e30 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:56.448341 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-279d9fad-f1a4-4e1f-9b64-d0e007cb8e30 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.449225 Sep 24 21:01:56.449002 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1653/3354] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:55 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:56.458374 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f6b9494c-2acf-45fc-a98f-a171ad7bad58 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:56.459507 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f6b9494c-2acf-45fc-a98f-a171ad7bad58 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] [instance: 06c6c840-ee24-4802-bf10-e17f5dfe54ae] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:56.471159 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6b9494c-2acf-45fc-a98f-a171ad7bad58 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:56.471979 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6b9494c-2acf-45fc-a98f-a171ad7bad58 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:56.472851 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6b9494c-2acf-45fc-a98f-a171ad7bad58 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:56.474064 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6b9494c-2acf-45fc-a98f-a171ad7bad58 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:56.478238 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6b9494c-2acf-45fc-a98f-a171ad7bad58 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:56.479195 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6b9494c-2acf-45fc-a98f-a171ad7bad58 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:56.520286 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-46be1f64-5285-4aeb-9507-ae465ccaeec8 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70045b8fe87481b8fae4597b979b046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4ce6fc820e4fb5b5e731650ed6faad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:56.528927 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-46be1f64-5285-4aeb-9507-ae465ccaeec8 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] 10.222.0.52 "GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48" status: 200 len: 1215 microversion: 2.1 time: 0.153719 Sep 24 21:01:56.531395 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1702/3355] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:56 2022] GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48 => generated 1215 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:56.536521 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-4bd5f2ec-7819-4d30-8dca-9bdd3603dcb0 req-4a0a5042-c1eb-4608-9ba5-13a47b1c12d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "547cf9a4-1d05-4cbd-bb2b-ee5cbd406130", "name": "network-vif-deleted", "tag": "52b5470e-7c8d-4f6a-b42e-9c45da96e2f1"}, {"server_uuid": "06c6c840-ee24-4802-bf10-e17f5dfe54ae", "name": "network-vif-deleted", "tag": "421297be-85c7-46b8-b6d4-16c2e392bb3f"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:56.537996 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6b9494c-2acf-45fc-a98f-a171ad7bad58 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:56.538551 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6b9494c-2acf-45fc-a98f-a171ad7bad58 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:56.539008 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6b9494c-2acf-45fc-a98f-a171ad7bad58 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:56.539478 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-f6b9494c-2acf-45fc-a98f-a171ad7bad58 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lazy-loading 'fault' on Instance uuid 06c6c840-ee24-4802-bf10-e17f5dfe54ae {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:01:56.552650 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:01:56.571068 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-4bd5f2ec-7819-4d30-8dca-9bdd3603dcb0 req-4a0a5042-c1eb-4608-9ba5-13a47b1c12d6 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:56.572382 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-4bd5f2ec-7819-4d30-8dca-9bdd3603dcb0 req-4a0a5042-c1eb-4608-9ba5-13a47b1c12d6 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:56.573038 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-4bd5f2ec-7819-4d30-8dca-9bdd3603dcb0 req-4a0a5042-c1eb-4608-9ba5-13a47b1c12d6 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:56.606050 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-4bd5f2ec-7819-4d30-8dca-9bdd3603dcb0 req-4a0a5042-c1eb-4608-9ba5-13a47b1c12d6 service nova] Creating event network-vif-deleted:52b5470e-7c8d-4f6a-b42e-9c45da96e2f1 for instance 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130 on nch2-master-1 Sep 24 21:01:56.606602 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-4bd5f2ec-7819-4d30-8dca-9bdd3603dcb0 req-4a0a5042-c1eb-4608-9ba5-13a47b1c12d6 service nova] Creating event network-vif-deleted:421297be-85c7-46b8-b6d4-16c2e392bb3f for instance 06c6c840-ee24-4802-bf10-e17f5dfe54ae on nch2-master-1 Sep 24 21:01:56.633143 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-4bd5f2ec-7819-4d30-8dca-9bdd3603dcb0 req-4a0a5042-c1eb-4608-9ba5-13a47b1c12d6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.099630 Sep 24 21:01:56.634093 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f6b9494c-2acf-45fc-a98f-a171ad7bad58 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9e57183b3b49c1ba39b5503420b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1408039f0bcf4130a11bedb2206b3cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:56.635031 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1703/3356] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:01:56.647225 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8c0885e3-d242-4ae4-9092-2c8545e84910 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:56.649916 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8c0885e3-d242-4ae4-9092-2c8545e84910 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:56.658826 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f6b9494c-2acf-45fc-a98f-a171ad7bad58 tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] 10.222.0.52 "GET /compute/v2.1/servers/06c6c840-ee24-4802-bf10-e17f5dfe54ae" status: 200 len: 1307 microversion: 2.1 time: 0.204218 Sep 24 21:01:56.659448 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1654/3357] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:56 2022] GET /compute/v2.1/servers/06c6c840-ee24-4802-bf10-e17f5dfe54ae => generated 1307 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:56.668568 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f06c659c-818d-4d7f-9ff8-1ea05c8f0c00 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:56.669178 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f06c659c-818d-4d7f-9ff8-1ea05c8f0c00 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] [instance: 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:56.682676 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f06c659c-818d-4d7f-9ff8-1ea05c8f0c00 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:56.688256 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c0885e3-d242-4ae4-9092-2c8545e84910 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:56.688495 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f06c659c-818d-4d7f-9ff8-1ea05c8f0c00 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:56.689015 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f06c659c-818d-4d7f-9ff8-1ea05c8f0c00 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:56.690306 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c0885e3-d242-4ae4-9092-2c8545e84910 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:56.693231 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f06c659c-818d-4d7f-9ff8-1ea05c8f0c00 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:56.693977 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f06c659c-818d-4d7f-9ff8-1ea05c8f0c00 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:56.694441 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c0885e3-d242-4ae4-9092-2c8545e84910 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:56.694983 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f06c659c-818d-4d7f-9ff8-1ea05c8f0c00 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:56.697325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c0885e3-d242-4ae4-9092-2c8545e84910 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:56.700056 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c0885e3-d242-4ae4-9092-2c8545e84910 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:56.700670 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c0885e3-d242-4ae4-9092-2c8545e84910 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:56.763458 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-f06c659c-818d-4d7f-9ff8-1ea05c8f0c00 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] HTTP exception thrown: Instance 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130 could not be found. Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f06c659c-818d-4d7f-9ff8-1ea05c8f0c00 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Request method failure captured: Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130 HTTP/1.1 Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL2_h-Z8Mxd5ivJvUeu-nilEC6fPGB9S2d4aX0ajB7leDARAd7Et7YiLKQ5tPWl4ARe0MFMUuqOPXo4MeDKAbIrnGGcVBa61Br-WWVhKviEFGtP0vuLwt56unMyYSSykXNc3sfP0YClEz09E4oRBLkG4XSmynhYSEJre7LO8YfgpSiOI Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: d4655b536ca04896993223f34d172298 Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-315733725 Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d4655b536ca04896993223f34d172298"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d4655b536ca04896993223f34d172298"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d4655b536ca04896993223f34d172298"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d4655b536ca04896993223f34d172298"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-315733725 Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: d4655b536ca04896993223f34d172298 Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-315733725 Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-FloatingIPsAssociationTestJSON-315733725-project Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: f41f618458eb48f6bb4631fd254addc0 Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-315733725-project Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130 could not be found. Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '547cf9a4-1d05-4cbd-bb2b-ee5cbd406130'} Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130 could not be found. Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130 could not be found. Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:01:56.766028 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:56.771238 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:01:56.771238 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:56.771238 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:56.771238 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:56.771238 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:01:56.771238 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:01:56.771238 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130 could not be found. Sep 24 21:01:56.771238 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:01:56.773618 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f06c659c-818d-4d7f-9ff8-1ea05c8f0c00 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] Returning 404 to user: Instance 547cf9a4-1d05-4cbd-bb2b-ee5cbd406130 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:01:56.774520 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f06c659c-818d-4d7f-9ff8-1ea05c8f0c00 tempest-FloatingIPsAssociationTestJSON-315733725 tempest-FloatingIPsAssociationTestJSON-315733725-project] 10.222.0.52 "GET /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130" status: 404 len: 111 microversion: 2.1 time: 0.110170 Sep 24 21:01:56.784663 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1655/3358] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:56 2022] GET /compute/v2.1/servers/547cf9a4-1d05-4cbd-bb2b-ee5cbd406130 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:01:56.794029 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-eb4c5239-b7d9-4cb0-acee-35ec64c93f64 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:56.796829 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-eb4c5239-b7d9-4cb0-acee-35ec64c93f64 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:56.821437 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb4c5239-b7d9-4cb0-acee-35ec64c93f64 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:56.823409 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb4c5239-b7d9-4cb0-acee-35ec64c93f64 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:56.825818 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb4c5239-b7d9-4cb0-acee-35ec64c93f64 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:56.828020 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb4c5239-b7d9-4cb0-acee-35ec64c93f64 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:56.829238 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb4c5239-b7d9-4cb0-acee-35ec64c93f64 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:56.830957 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb4c5239-b7d9-4cb0-acee-35ec64c93f64 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:56.911863 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-eb4c5239-b7d9-4cb0-acee-35ec64c93f64 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.125528 Sep 24 21:01:56.916479 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1656/3359] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:01:56 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:01:57.186353 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8c0885e3-d242-4ae4-9092-2c8545e84910 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:57.210656 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8c0885e3-d242-4ae4-9092-2c8545e84910 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.574028 Sep 24 21:01:57.215584 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1704/3360] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:56 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:57.249900 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b7a61133-ff99-43fe-a5bf-d82a8f0ab994 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:57.251190 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b7a61133-ff99-43fe-a5bf-d82a8f0ab994 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:57.262411 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:01:57.267330 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b7a61133-ff99-43fe-a5bf-d82a8f0ab994 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:57.269539 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b7a61133-ff99-43fe-a5bf-d82a8f0ab994 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:57.271518 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b7a61133-ff99-43fe-a5bf-d82a8f0ab994 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:57.273020 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b7a61133-ff99-43fe-a5bf-d82a8f0ab994 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:57.273842 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b7a61133-ff99-43fe-a5bf-d82a8f0ab994 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:57.275392 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b7a61133-ff99-43fe-a5bf-d82a8f0ab994 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:57.280155 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c3dfc9a1-438b-497a-aa38-5a5fbd5aea6c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:57.282967 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c3dfc9a1-438b-497a-aa38-5a5fbd5aea6c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:57.314916 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3dfc9a1-438b-497a-aa38-5a5fbd5aea6c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:57.315420 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3dfc9a1-438b-497a-aa38-5a5fbd5aea6c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:57.315864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3dfc9a1-438b-497a-aa38-5a5fbd5aea6c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:57.326698 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3dfc9a1-438b-497a-aa38-5a5fbd5aea6c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:57.327190 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3dfc9a1-438b-497a-aa38-5a5fbd5aea6c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:57.327634 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3dfc9a1-438b-497a-aa38-5a5fbd5aea6c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:57.359778 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:01:57.677277 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b7a61133-ff99-43fe-a5bf-d82a8f0ab994 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:57.688027 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b7a61133-ff99-43fe-a5bf-d82a8f0ab994 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.446570 Sep 24 21:01:57.689278 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1657/3361] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:57 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:57.696174 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5cbe0a08-fbdc-4661-abe0-d8aa787079c0 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:57.696852 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5cbe0a08-fbdc-4661-abe0-d8aa787079c0 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] [instance: de3e9921-d647-4ba4-97b4-bfa6edd98b48] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:57.705834 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5cbe0a08-fbdc-4661-abe0-d8aa787079c0 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:57.706757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5cbe0a08-fbdc-4661-abe0-d8aa787079c0 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:57.707382 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5cbe0a08-fbdc-4661-abe0-d8aa787079c0 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:57.709045 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5cbe0a08-fbdc-4661-abe0-d8aa787079c0 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:57.710385 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5cbe0a08-fbdc-4661-abe0-d8aa787079c0 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:57.711019 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5cbe0a08-fbdc-4661-abe0-d8aa787079c0 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:57.908212 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c3dfc9a1-438b-497a-aa38-5a5fbd5aea6c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:57.934545 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c3dfc9a1-438b-497a-aa38-5a5fbd5aea6c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2" status: 200 len: 1511 microversion: 2.1 time: 0.657886 Sep 24 21:01:57.962736 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1705/3362] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:57 2022] GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 => generated 1511 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:01:57.972774 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9afcbb10-3646-420e-a2e9-87cfacd1b3ac tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:57.974546 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9afcbb10-3646-420e-a2e9-87cfacd1b3ac tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] [instance: 06c6c840-ee24-4802-bf10-e17f5dfe54ae] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:57.988738 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9afcbb10-3646-420e-a2e9-87cfacd1b3ac tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:57.991050 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9afcbb10-3646-420e-a2e9-87cfacd1b3ac tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:57.991723 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9afcbb10-3646-420e-a2e9-87cfacd1b3ac tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:57.998025 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9afcbb10-3646-420e-a2e9-87cfacd1b3ac tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:57.998856 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9afcbb10-3646-420e-a2e9-87cfacd1b3ac tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:57.999522 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9afcbb10-3646-420e-a2e9-87cfacd1b3ac tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:58.026299 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-9afcbb10-3646-420e-a2e9-87cfacd1b3ac tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] HTTP exception thrown: Instance 06c6c840-ee24-4802-bf10-e17f5dfe54ae could not be found. Sep 24 21:01:58.032101 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5cbe0a08-fbdc-4661-abe0-d8aa787079c0 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70045b8fe87481b8fae4597b979b046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4ce6fc820e4fb5b5e731650ed6faad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9afcbb10-3646-420e-a2e9-87cfacd1b3ac tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Request method failure captured: Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/06c6c840-ee24-4802-bf10-e17f5dfe54ae HTTP/1.1 Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3ApxDQSESzAbQae2DI-Ijyje-g88QYKVNbZq-ItOwWjkcT8SL08QZ0u4-rTBF6Y7i959kffYyXrWR3UKPEgCG3HEzCT8tyE80mdduVHAQ63wpjMRKHEW9iEAxifUtxfmEIl3LNmA6p-EE9RlsyAanT9Bp0pSYGX1EpV2NTSKILJzLA Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 1408039f0bcf4130a11bedb2206b3cec Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServerAddressesTestJSON-1557165351 Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1408039f0bcf4130a11bedb2206b3cec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1408039f0bcf4130a11bedb2206b3cec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1408039f0bcf4130a11bedb2206b3cec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1408039f0bcf4130a11bedb2206b3cec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServerAddressesTestJSON-1557165351 Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 1408039f0bcf4130a11bedb2206b3cec Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1557165351 Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServerAddressesTestJSON-1557165351-project Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 5e9e57183b3b49c1ba39b5503420b93e Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServerAddressesTestJSON-1557165351-project Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 06c6c840-ee24-4802-bf10-e17f5dfe54ae could not be found. Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '06c6c840-ee24-4802-bf10-e17f5dfe54ae'} Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06c6c840-ee24-4802-bf10-e17f5dfe54ae could not be found. Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06c6c840-ee24-4802-bf10-e17f5dfe54ae could not be found. Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:01:58.035999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:58.040763 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:01:58.040763 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:01:58.040763 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:01:58.040763 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:01:58.040763 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:01:58.040763 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06c6c840-ee24-4802-bf10-e17f5dfe54ae could not be found. Sep 24 21:01:58.040763 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:01:58.052018 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5cbe0a08-fbdc-4661-abe0-d8aa787079c0 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] 10.222.0.52 "GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48" status: 200 len: 1267 microversion: 2.1 time: 0.360952 Sep 24 21:01:58.053027 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9afcbb10-3646-420e-a2e9-87cfacd1b3ac tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] Returning 404 to user: Instance 06c6c840-ee24-4802-bf10-e17f5dfe54ae could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:01:58.062144 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1658/3363] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:57 2022] GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48 => generated 1267 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:58.062321 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9afcbb10-3646-420e-a2e9-87cfacd1b3ac tempest-ServerAddressesTestJSON-1557165351 tempest-ServerAddressesTestJSON-1557165351-project] 10.222.0.52 "GET /compute/v2.1/servers/06c6c840-ee24-4802-bf10-e17f5dfe54ae" status: 404 len: 111 microversion: 2.1 time: 0.087342 Sep 24 21:01:58.062321 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1706/3364] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:57 2022] GET /compute/v2.1/servers/06c6c840-ee24-4802-bf10-e17f5dfe54ae => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:01:58.072357 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7dcd6842-5bc1-4a32-8daf-9da97cdb2112 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:01:58.075450 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f8733318-5863-4d62-aeb9-f6f0bb7a7dd3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:58.075654 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7dcd6842-5bc1-4a32-8daf-9da97cdb2112 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:58.081743 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f8733318-5863-4d62-aeb9-f6f0bb7a7dd3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:58.083240 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7dcd6842-5bc1-4a32-8daf-9da97cdb2112 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:58.084030 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7dcd6842-5bc1-4a32-8daf-9da97cdb2112 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:58.084561 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7dcd6842-5bc1-4a32-8daf-9da97cdb2112 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:58.085371 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7dcd6842-5bc1-4a32-8daf-9da97cdb2112 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:58.085933 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7dcd6842-5bc1-4a32-8daf-9da97cdb2112 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:58.086448 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7dcd6842-5bc1-4a32-8daf-9da97cdb2112 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:58.099017 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8733318-5863-4d62-aeb9-f6f0bb7a7dd3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:58.101813 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8733318-5863-4d62-aeb9-f6f0bb7a7dd3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:58.102352 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8733318-5863-4d62-aeb9-f6f0bb7a7dd3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:58.104044 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8733318-5863-4d62-aeb9-f6f0bb7a7dd3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:58.105422 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8733318-5863-4d62-aeb9-f6f0bb7a7dd3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:58.107618 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8733318-5863-4d62-aeb9-f6f0bb7a7dd3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:58.190516 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f8733318-5863-4d62-aeb9-f6f0bb7a7dd3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.131324 Sep 24 21:01:58.202920 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1707/3365] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:01:58 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:01:58.241804 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7dcd6842-5bc1-4a32-8daf-9da97cdb2112 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "POST /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/action" status: 202 len: 0 microversion: 2.1 time: 0.183792 Sep 24 21:01:58.247697 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1659/3366] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:01:58 2022] POST /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:01:58.252273 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0813e6c2-6f5d-427d-a7a3-476eb6ae24c9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:58.253081 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0813e6c2-6f5d-427d-a7a3-476eb6ae24c9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:58.268269 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0813e6c2-6f5d-427d-a7a3-476eb6ae24c9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:58.269564 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0813e6c2-6f5d-427d-a7a3-476eb6ae24c9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:58.275030 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0813e6c2-6f5d-427d-a7a3-476eb6ae24c9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:58.276523 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0813e6c2-6f5d-427d-a7a3-476eb6ae24c9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:58.277035 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0813e6c2-6f5d-427d-a7a3-476eb6ae24c9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:58.278358 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0813e6c2-6f5d-427d-a7a3-476eb6ae24c9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:58.969170 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-189e90fa-e764-462a-bed7-9700479945e4 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:58.970643 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-189e90fa-e764-462a-bed7-9700479945e4 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:58.977401 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-189e90fa-e764-462a-bed7-9700479945e4 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:58.982655 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-189e90fa-e764-462a-bed7-9700479945e4 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:58.983400 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-189e90fa-e764-462a-bed7-9700479945e4 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:58.984409 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-189e90fa-e764-462a-bed7-9700479945e4 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:58.985139 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-189e90fa-e764-462a-bed7-9700479945e4 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:58.985826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-189e90fa-e764-462a-bed7-9700479945e4 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:59.125590 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0813e6c2-6f5d-427d-a7a3-476eb6ae24c9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:59.143274 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0813e6c2-6f5d-427d-a7a3-476eb6ae24c9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1670 microversion: 2.1 time: 0.893840 Sep 24 21:01:59.146058 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1708/3367] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:58 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1670 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:01:59.162413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bac83bbb-28b5-4116-ad26-4c04842e23b1 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:59.163664 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-bac83bbb-28b5-4116-ad26-4c04842e23b1 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] [instance: de3e9921-d647-4ba4-97b4-bfa6edd98b48] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:59.181532 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bac83bbb-28b5-4116-ad26-4c04842e23b1 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:59.182339 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bac83bbb-28b5-4116-ad26-4c04842e23b1 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:59.184452 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bac83bbb-28b5-4116-ad26-4c04842e23b1 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:59.185545 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bac83bbb-28b5-4116-ad26-4c04842e23b1 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:59.186233 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bac83bbb-28b5-4116-ad26-4c04842e23b1 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:59.187506 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bac83bbb-28b5-4116-ad26-4c04842e23b1 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:59.408941 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-bac83bbb-28b5-4116-ad26-4c04842e23b1 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70045b8fe87481b8fae4597b979b046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4ce6fc820e4fb5b5e731650ed6faad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:59.422471 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bac83bbb-28b5-4116-ad26-4c04842e23b1 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] 10.222.0.52 "GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48" status: 200 len: 1273 microversion: 2.1 time: 0.274488 Sep 24 21:01:59.423559 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1709/3368] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:59 2022] GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48 => generated 1273 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:01:59.441427 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b84bf86b-df47-40cb-b799-085316c03c65 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:01:59.444018 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b84bf86b-df47-40cb-b799-085316c03c65 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:01:59.457410 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b84bf86b-df47-40cb-b799-085316c03c65 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:59.458370 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b84bf86b-df47-40cb-b799-085316c03c65 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:59.459067 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b84bf86b-df47-40cb-b799-085316c03c65 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:59.460164 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b84bf86b-df47-40cb-b799-085316c03c65 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:01:59.460844 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b84bf86b-df47-40cb-b799-085316c03c65 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:01:59.461521 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b84bf86b-df47-40cb-b799-085316c03c65 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:01:59.508086 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b84bf86b-df47-40cb-b799-085316c03c65 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.083162 Sep 24 21:01:59.508670 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1710/3369] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:01:59 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:01:59.526895 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-189e90fa-e764-462a-bed7-9700479945e4 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:01:59.544385 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-189e90fa-e764-462a-bed7-9700479945e4 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2" status: 200 len: 1511 microversion: 2.1 time: 0.581509 Sep 24 21:01:59.545727 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1660/3370] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:01:58 2022] GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 => generated 1511 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:02:00.174049 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7a089050-fa33-4bac-b2a3-58413f531753 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:00.175886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7a089050-fa33-4bac-b2a3-58413f531753 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:00.204585 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a089050-fa33-4bac-b2a3-58413f531753 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:00.208100 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a089050-fa33-4bac-b2a3-58413f531753 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:00.210018 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a089050-fa33-4bac-b2a3-58413f531753 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:00.213212 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a089050-fa33-4bac-b2a3-58413f531753 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:00.217394 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a089050-fa33-4bac-b2a3-58413f531753 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:00.219417 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a089050-fa33-4bac-b2a3-58413f531753 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:00.456991 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9c7d33d1-a2de-437f-8af6-5cba121735fd tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:00.457648 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9c7d33d1-a2de-437f-8af6-5cba121735fd tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] [instance: de3e9921-d647-4ba4-97b4-bfa6edd98b48] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:00.468026 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c7d33d1-a2de-437f-8af6-5cba121735fd tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:00.468788 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c7d33d1-a2de-437f-8af6-5cba121735fd tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:00.469427 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c7d33d1-a2de-437f-8af6-5cba121735fd tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:00.470319 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c7d33d1-a2de-437f-8af6-5cba121735fd tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:00.471067 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c7d33d1-a2de-437f-8af6-5cba121735fd tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:00.472222 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c7d33d1-a2de-437f-8af6-5cba121735fd tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:00.676999 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9c7d33d1-a2de-437f-8af6-5cba121735fd tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70045b8fe87481b8fae4597b979b046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4ce6fc820e4fb5b5e731650ed6faad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:00.687315 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9c7d33d1-a2de-437f-8af6-5cba121735fd tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] 10.222.0.52 "GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48" status: 200 len: 1273 microversion: 2.1 time: 0.238981 Sep 24 21:02:00.699322 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1661/3371] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:00 2022] GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48 => generated 1273 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:02:00.707986 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-75fe0607-c669-4de2-bd96-125d949274f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:00.710881 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-75fe0607-c669-4de2-bd96-125d949274f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:00.717719 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75fe0607-c669-4de2-bd96-125d949274f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:00.718218 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75fe0607-c669-4de2-bd96-125d949274f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:00.718847 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75fe0607-c669-4de2-bd96-125d949274f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:00.719926 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75fe0607-c669-4de2-bd96-125d949274f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:00.720643 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75fe0607-c669-4de2-bd96-125d949274f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:00.721243 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75fe0607-c669-4de2-bd96-125d949274f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:00.770802 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-75fe0607-c669-4de2-bd96-125d949274f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.069983 Sep 24 21:02:00.771527 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1662/3372] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:02:00 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:02:00.781672 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5c31084e-c453-4235-9ca9-c6c099362330 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:00.782780 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5c31084e-c453-4235-9ca9-c6c099362330 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:00.791796 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c31084e-c453-4235-9ca9-c6c099362330 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:00.794657 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c31084e-c453-4235-9ca9-c6c099362330 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:00.795618 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c31084e-c453-4235-9ca9-c6c099362330 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:00.797166 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c31084e-c453-4235-9ca9-c6c099362330 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:00.798454 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c31084e-c453-4235-9ca9-c6c099362330 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:00.799112 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c31084e-c453-4235-9ca9-c6c099362330 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:00.832830 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:02:00.931387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7a089050-fa33-4bac-b2a3-58413f531753 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:00.944447 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7a089050-fa33-4bac-b2a3-58413f531753 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1670 microversion: 2.1 time: 0.772938 Sep 24 21:02:00.986577 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1711/3373] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:00 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1670 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:01.299229 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5c31084e-c453-4235-9ca9-c6c099362330 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:01.313996 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5c31084e-c453-4235-9ca9-c6c099362330 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2" status: 200 len: 1511 microversion: 2.1 time: 0.541206 Sep 24 21:02:01.335346 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1663/3374] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:00 2022] GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 => generated 1511 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:01.715544 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b7168c91-0a22-4e8a-b6b4-e56b942aed87 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:01.716874 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b7168c91-0a22-4e8a-b6b4-e56b942aed87 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] [instance: de3e9921-d647-4ba4-97b4-bfa6edd98b48] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:01.723751 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7168c91-0a22-4e8a-b6b4-e56b942aed87 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:01.724601 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7168c91-0a22-4e8a-b6b4-e56b942aed87 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:01.725359 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7168c91-0a22-4e8a-b6b4-e56b942aed87 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:01.726753 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7168c91-0a22-4e8a-b6b4-e56b942aed87 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:01.728066 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7168c91-0a22-4e8a-b6b4-e56b942aed87 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:01.729483 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7168c91-0a22-4e8a-b6b4-e56b942aed87 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:01.788142 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f9fb9d54-03fa-49f8-9560-8ce30a0153bf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:01.790855 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f9fb9d54-03fa-49f8-9560-8ce30a0153bf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:01.812869 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f9fb9d54-03fa-49f8-9560-8ce30a0153bf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:01.817774 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f9fb9d54-03fa-49f8-9560-8ce30a0153bf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:01.820195 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f9fb9d54-03fa-49f8-9560-8ce30a0153bf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:01.824131 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f9fb9d54-03fa-49f8-9560-8ce30a0153bf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:01.826047 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f9fb9d54-03fa-49f8-9560-8ce30a0153bf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:01.830534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f9fb9d54-03fa-49f8-9560-8ce30a0153bf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:01.901632 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f9fb9d54-03fa-49f8-9560-8ce30a0153bf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.118276 Sep 24 21:02:01.908035 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1664/3375] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:02:01 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:02:01.987866 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8e0cbd2a-279f-41e7-9c7d-3649e3080786 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:01.989360 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8e0cbd2a-279f-41e7-9c7d-3649e3080786 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:01.999062 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8e0cbd2a-279f-41e7-9c7d-3649e3080786 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:01.999883 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8e0cbd2a-279f-41e7-9c7d-3649e3080786 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:02.000533 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8e0cbd2a-279f-41e7-9c7d-3649e3080786 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:02.001463 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8e0cbd2a-279f-41e7-9c7d-3649e3080786 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:02.002136 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8e0cbd2a-279f-41e7-9c7d-3649e3080786 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:02.002805 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8e0cbd2a-279f-41e7-9c7d-3649e3080786 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:03.141383 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b7168c91-0a22-4e8a-b6b4-e56b942aed87 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70045b8fe87481b8fae4597b979b046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4ce6fc820e4fb5b5e731650ed6faad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:03.174864 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b7168c91-0a22-4e8a-b6b4-e56b942aed87 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] 10.222.0.52 "GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48" status: 200 len: 1315 microversion: 2.1 time: 1.464895 Sep 24 21:02:03.178315 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1712/3376] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:01 2022] GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48 => generated 1315 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:03.188230 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dbbd9136-fc99-40e4-92f6-e758b28757b5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:03.189226 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-dbbd9136-fc99-40e4-92f6-e758b28757b5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:03.196708 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dbbd9136-fc99-40e4-92f6-e758b28757b5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:03.197435 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dbbd9136-fc99-40e4-92f6-e758b28757b5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:03.198312 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dbbd9136-fc99-40e4-92f6-e758b28757b5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:03.201324 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dbbd9136-fc99-40e4-92f6-e758b28757b5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:03.202019 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dbbd9136-fc99-40e4-92f6-e758b28757b5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:03.203277 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dbbd9136-fc99-40e4-92f6-e758b28757b5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:03.206136 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8e0cbd2a-279f-41e7-9c7d-3649e3080786 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:03.227143 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8e0cbd2a-279f-41e7-9c7d-3649e3080786 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 1.243204 Sep 24 21:02:03.228189 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1665/3377] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:01 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:02:03.233801 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d088049a-0996-41a0-b83b-231a362bd1a9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:03.236448 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d088049a-0996-41a0-b83b-231a362bd1a9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:03.256129 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d088049a-0996-41a0-b83b-231a362bd1a9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:03.256981 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d088049a-0996-41a0-b83b-231a362bd1a9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:03.257692 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d088049a-0996-41a0-b83b-231a362bd1a9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:03.258690 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d088049a-0996-41a0-b83b-231a362bd1a9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:03.259368 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d088049a-0996-41a0-b83b-231a362bd1a9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:03.260016 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d088049a-0996-41a0-b83b-231a362bd1a9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:03.296428 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d088049a-0996-41a0-b83b-231a362bd1a9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.066991 Sep 24 21:02:03.297747 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1666/3378] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:02:03 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:02:03.302745 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d1d976a5-7bb0-4e0e-b051-d61068f7ee14 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:02:03.305320 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d1d976a5-7bb0-4e0e-b051-d61068f7ee14 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:03.313291 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1d976a5-7bb0-4e0e-b051-d61068f7ee14 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:03.314125 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1d976a5-7bb0-4e0e-b051-d61068f7ee14 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:03.314858 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1d976a5-7bb0-4e0e-b051-d61068f7ee14 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:03.315787 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1d976a5-7bb0-4e0e-b051-d61068f7ee14 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:03.316473 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1d976a5-7bb0-4e0e-b051-d61068f7ee14 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:03.317119 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1d976a5-7bb0-4e0e-b051-d61068f7ee14 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:03.405408 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d1d976a5-7bb0-4e0e-b051-d61068f7ee14 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "POST /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/action" status: 200 len: 324 microversion: 2.1 time: 0.105979 Sep 24 21:02:03.406604 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1667/3379] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:02:03 2022] POST /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/action => generated 324 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:02:03.423508 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-593c5e92-a2bb-4ca0-a02b-721d67ecfb09 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:03.427757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-593c5e92-a2bb-4ca0-a02b-721d67ecfb09 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:03.438855 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-593c5e92-a2bb-4ca0-a02b-721d67ecfb09 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:03.439599 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-593c5e92-a2bb-4ca0-a02b-721d67ecfb09 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:03.440213 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-593c5e92-a2bb-4ca0-a02b-721d67ecfb09 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:03.441528 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-593c5e92-a2bb-4ca0-a02b-721d67ecfb09 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:03.442523 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-593c5e92-a2bb-4ca0-a02b-721d67ecfb09 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:03.443135 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-593c5e92-a2bb-4ca0-a02b-721d67ecfb09 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:03.963961 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-dbbd9136-fc99-40e4-92f6-e758b28757b5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:03.973670 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-dbbd9136-fc99-40e4-92f6-e758b28757b5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2" status: 200 len: 1511 microversion: 2.1 time: 0.792088 Sep 24 21:02:03.979976 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1713/3380] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:03 2022] GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 => generated 1511 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:04.143723 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-593c5e92-a2bb-4ca0-a02b-721d67ecfb09 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:04.156072 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-593c5e92-a2bb-4ca0-a02b-721d67ecfb09 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.738155 Sep 24 21:02:04.176834 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1668/3381] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:03 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:04.185841 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-27c6b469-724e-4b22-a641-f714f69c9e20 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:04.187080 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-27c6b469-724e-4b22-a641-f714f69c9e20 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:04.193662 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27c6b469-724e-4b22-a641-f714f69c9e20 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:04.194419 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27c6b469-724e-4b22-a641-f714f69c9e20 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:04.195051 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27c6b469-724e-4b22-a641-f714f69c9e20 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:04.195991 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27c6b469-724e-4b22-a641-f714f69c9e20 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:04.196625 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27c6b469-724e-4b22-a641-f714f69c9e20 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:04.197426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27c6b469-724e-4b22-a641-f714f69c9e20 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:04.206770 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2541cac1-f28b-4ddc-84d6-772dc58562bc tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:04.208072 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2541cac1-f28b-4ddc-84d6-772dc58562bc tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] [instance: de3e9921-d647-4ba4-97b4-bfa6edd98b48] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:04.241156 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2541cac1-f28b-4ddc-84d6-772dc58562bc tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:04.241855 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2541cac1-f28b-4ddc-84d6-772dc58562bc tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:04.242467 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2541cac1-f28b-4ddc-84d6-772dc58562bc tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:04.243485 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2541cac1-f28b-4ddc-84d6-772dc58562bc tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:04.252354 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2541cac1-f28b-4ddc-84d6-772dc58562bc tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:04.253315 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2541cac1-f28b-4ddc-84d6-772dc58562bc tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:04.856151 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-27c6b469-724e-4b22-a641-f714f69c9e20 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:04.875456 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-27c6b469-724e-4b22-a641-f714f69c9e20 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.695154 Sep 24 21:02:04.878962 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1714/3382] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:04 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:04.884043 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7c79cf7e-ddf9-45a9-94e4-f081c849e237 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:04.900532 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7c79cf7e-ddf9-45a9-94e4-f081c849e237 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:04.927730 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7c79cf7e-ddf9-45a9-94e4-f081c849e237 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:04.935255 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7c79cf7e-ddf9-45a9-94e4-f081c849e237 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:04.936121 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7c79cf7e-ddf9-45a9-94e4-f081c849e237 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:04.938680 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7c79cf7e-ddf9-45a9-94e4-f081c849e237 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:04.944202 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7c79cf7e-ddf9-45a9-94e4-f081c849e237 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:04.946733 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7c79cf7e-ddf9-45a9-94e4-f081c849e237 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:05.036259 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7c79cf7e-ddf9-45a9-94e4-f081c849e237 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.155785 Sep 24 21:02:05.037390 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1715/3383] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:02:04 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:02:05.043468 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2f1aa9bd-5c45-4e58-9646-ca8874ef7da5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:05.044475 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2f1aa9bd-5c45-4e58-9646-ca8874ef7da5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:05.064984 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f1aa9bd-5c45-4e58-9646-ca8874ef7da5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:05.065504 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f1aa9bd-5c45-4e58-9646-ca8874ef7da5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:05.065958 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f1aa9bd-5c45-4e58-9646-ca8874ef7da5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:05.069912 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f1aa9bd-5c45-4e58-9646-ca8874ef7da5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:05.070456 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f1aa9bd-5c45-4e58-9646-ca8874ef7da5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:05.071022 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f1aa9bd-5c45-4e58-9646-ca8874ef7da5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:05.092310 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2541cac1-f28b-4ddc-84d6-772dc58562bc tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70045b8fe87481b8fae4597b979b046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4ce6fc820e4fb5b5e731650ed6faad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:05.106149 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2541cac1-f28b-4ddc-84d6-772dc58562bc tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] 10.222.0.52 "GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48" status: 200 len: 1315 microversion: 2.1 time: 0.902863 Sep 24 21:02:05.122086 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1669/3384] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:04 2022] GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48 => generated 1315 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:05.123173 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8431e5d4-876e-49e5-be77-83e599ce4c40 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:05.123908 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8431e5d4-876e-49e5-be77-83e599ce4c40 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:05.141954 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8431e5d4-876e-49e5-be77-83e599ce4c40 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:05.142649 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8431e5d4-876e-49e5-be77-83e599ce4c40 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:05.143844 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8431e5d4-876e-49e5-be77-83e599ce4c40 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:05.144572 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8431e5d4-876e-49e5-be77-83e599ce4c40 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:05.145142 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8431e5d4-876e-49e5-be77-83e599ce4c40 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:05.145676 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8431e5d4-876e-49e5-be77-83e599ce4c40 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:05.676808 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:02:05.714584 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=6 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:02:05.874577 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2f1aa9bd-5c45-4e58-9646-ca8874ef7da5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:05.888222 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8431e5d4-876e-49e5-be77-83e599ce4c40 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:05.889484 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2f1aa9bd-5c45-4e58-9646-ca8874ef7da5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.850788 Sep 24 21:02:05.892367 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1716/3385] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:05 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:05.897677 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-05e768c9-2acf-4396-abc3-d384da841dc9 req-12dafd44-f51b-4cbd-8ec5-510e4b47dc91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de3e9921-d647-4ba4-97b4-bfa6edd98b48", "tag": "d9c1e35c-2108-4ebd-a17b-474bfd75d345"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:02:05.909079 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8431e5d4-876e-49e5-be77-83e599ce4c40 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2" status: 200 len: 1511 microversion: 2.1 time: 0.798824 Sep 24 21:02:05.911258 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1670/3386] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:05 2022] GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 => generated 1511 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:05.944178 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9daaca35-8acd-4a1b-b3ae-22d626bb0edd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:05.949014 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9daaca35-8acd-4a1b-b3ae-22d626bb0edd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:05.956186 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-05e768c9-2acf-4396-abc3-d384da841dc9 req-12dafd44-f51b-4cbd-8ec5-510e4b47dc91 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:05.957812 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-05e768c9-2acf-4396-abc3-d384da841dc9 req-12dafd44-f51b-4cbd-8ec5-510e4b47dc91 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:05.960752 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-05e768c9-2acf-4396-abc3-d384da841dc9 req-12dafd44-f51b-4cbd-8ec5-510e4b47dc91 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:05.964937 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9daaca35-8acd-4a1b-b3ae-22d626bb0edd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:05.971849 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9daaca35-8acd-4a1b-b3ae-22d626bb0edd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:05.972635 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9daaca35-8acd-4a1b-b3ae-22d626bb0edd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:05.975205 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9daaca35-8acd-4a1b-b3ae-22d626bb0edd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:05.976777 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9daaca35-8acd-4a1b-b3ae-22d626bb0edd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:05.981368 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9daaca35-8acd-4a1b-b3ae-22d626bb0edd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:06.022526 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-05e768c9-2acf-4396-abc3-d384da841dc9 req-12dafd44-f51b-4cbd-8ec5-510e4b47dc91 service nova] Creating event network-changed:d9c1e35c-2108-4ebd-a17b-474bfd75d345 for instance de3e9921-d647-4ba4-97b4-bfa6edd98b48 on nch1-master-1 Sep 24 21:02:06.036618 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-05e768c9-2acf-4396-abc3-d384da841dc9 req-12dafd44-f51b-4cbd-8ec5-510e4b47dc91 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142900 Sep 24 21:02:06.048890 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1717/3387] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:02:06.071978 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b1538a74-15f7-4827-942b-183cede64364 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:06.076699 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b1538a74-15f7-4827-942b-183cede64364 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:06.097456 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1538a74-15f7-4827-942b-183cede64364 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:06.098338 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1538a74-15f7-4827-942b-183cede64364 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:06.099509 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1538a74-15f7-4827-942b-183cede64364 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:06.102032 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1538a74-15f7-4827-942b-183cede64364 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:06.103821 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1538a74-15f7-4827-942b-183cede64364 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:06.104538 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1538a74-15f7-4827-942b-183cede64364 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:06.164677 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b1538a74-15f7-4827-942b-183cede64364 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.108123 Sep 24 21:02:06.170814 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1718/3388] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:02:06 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:02:06.179875 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9d869e80-cacb-4ca2-aacb-dedc4c6a0a54 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:06.180990 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9d869e80-cacb-4ca2-aacb-dedc4c6a0a54 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] [instance: de3e9921-d647-4ba4-97b4-bfa6edd98b48] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:06.189571 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d869e80-cacb-4ca2-aacb-dedc4c6a0a54 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:06.190404 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d869e80-cacb-4ca2-aacb-dedc4c6a0a54 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:06.191423 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d869e80-cacb-4ca2-aacb-dedc4c6a0a54 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:06.192525 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d869e80-cacb-4ca2-aacb-dedc4c6a0a54 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:06.193226 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d869e80-cacb-4ca2-aacb-dedc4c6a0a54 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:06.193812 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d869e80-cacb-4ca2-aacb-dedc4c6a0a54 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:06.527769 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:02:06.989199 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9daaca35-8acd-4a1b-b3ae-22d626bb0edd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:06.999485 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9daaca35-8acd-4a1b-b3ae-22d626bb0edd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 1.069449 Sep 24 21:02:07.000415 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1671/3389] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:05 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:07.005955 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0e027f28-4316-41af-ab15-c66da7e8fe66 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:07.006785 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0e027f28-4316-41af-ab15-c66da7e8fe66 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:07.015762 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e027f28-4316-41af-ab15-c66da7e8fe66 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:07.017891 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e027f28-4316-41af-ab15-c66da7e8fe66 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:07.018677 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e027f28-4316-41af-ab15-c66da7e8fe66 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:07.019784 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e027f28-4316-41af-ab15-c66da7e8fe66 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:07.020533 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e027f28-4316-41af-ab15-c66da7e8fe66 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:07.021122 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e027f28-4316-41af-ab15-c66da7e8fe66 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:07.064461 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9d869e80-cacb-4ca2-aacb-dedc4c6a0a54 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70045b8fe87481b8fae4597b979b046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4ce6fc820e4fb5b5e731650ed6faad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:07.072585 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9d869e80-cacb-4ca2-aacb-dedc4c6a0a54 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] 10.222.0.52 "GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48" status: 200 len: 1315 microversion: 2.1 time: 0.900301 Sep 24 21:02:07.075210 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1719/3390] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:06 2022] GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48 => generated 1315 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:07.173190 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-385af302-c891-4d26-9da8-2219984499bf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2110488454", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "75e36a3c-3095-402d-baea-50bb8c960b77"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:02:07.246449 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-385af302-c891-4d26-9da8-2219984499bf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] validate_networks() for [('75e36a3c-3095-402d-baea-50bb8c960b77', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:02:07.588200 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0e027f28-4316-41af-ab15-c66da7e8fe66 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:07.599634 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0e027f28-4316-41af-ab15-c66da7e8fe66 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2" status: 200 len: 1511 microversion: 2.1 time: 0.597914 Sep 24 21:02:07.605751 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1672/3391] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:07 2022] GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 => generated 1511 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:07.611207 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-110e3637-9164-4012-a990-a95e046c3815 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:07.623325 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-110e3637-9164-4012-a990-a95e046c3815 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:07.639127 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-110e3637-9164-4012-a990-a95e046c3815 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:07.639954 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-110e3637-9164-4012-a990-a95e046c3815 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:07.642821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-110e3637-9164-4012-a990-a95e046c3815 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:07.643832 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-110e3637-9164-4012-a990-a95e046c3815 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:07.644536 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-110e3637-9164-4012-a990-a95e046c3815 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:07.646972 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-110e3637-9164-4012-a990-a95e046c3815 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:07.687799 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-110e3637-9164-4012-a990-a95e046c3815 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.080403 Sep 24 21:02:07.688989 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1673/3392] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:02:07 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:02:08.097468 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bfd73bd8-33be-4e51-b9d5-ffdc02a8be81 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:08.098298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bfd73bd8-33be-4e51-b9d5-ffdc02a8be81 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] [instance: de3e9921-d647-4ba4-97b4-bfa6edd98b48] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:08.110297 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bfd73bd8-33be-4e51-b9d5-ffdc02a8be81 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:08.110839 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bfd73bd8-33be-4e51-b9d5-ffdc02a8be81 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:08.111287 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bfd73bd8-33be-4e51-b9d5-ffdc02a8be81 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:08.112016 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bfd73bd8-33be-4e51-b9d5-ffdc02a8be81 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:08.112482 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bfd73bd8-33be-4e51-b9d5-ffdc02a8be81 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:08.112918 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bfd73bd8-33be-4e51-b9d5-ffdc02a8be81 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:08.509264 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bfd73bd8-33be-4e51-b9d5-ffdc02a8be81 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70045b8fe87481b8fae4597b979b046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4ce6fc820e4fb5b5e731650ed6faad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:08.524437 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bfd73bd8-33be-4e51-b9d5-ffdc02a8be81 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] 10.222.0.52 "GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48" status: 200 len: 1315 microversion: 2.1 time: 0.430829 Sep 24 21:02:08.544610 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1674/3393] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:08 2022] GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48 => generated 1315 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:02:08.631590 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-617976e7-aca8-42cc-baf0-0449921b4f40 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:08.632578 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-617976e7-aca8-42cc-baf0-0449921b4f40 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:08.649307 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-617976e7-aca8-42cc-baf0-0449921b4f40 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:08.650230 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-617976e7-aca8-42cc-baf0-0449921b4f40 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:08.651791 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-617976e7-aca8-42cc-baf0-0449921b4f40 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:08.658332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-617976e7-aca8-42cc-baf0-0449921b4f40 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:08.660210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-617976e7-aca8-42cc-baf0-0449921b4f40 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:08.660632 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-617976e7-aca8-42cc-baf0-0449921b4f40 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:08.814265 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-385af302-c891-4d26-9da8-2219984499bf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:02:08.814932 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-385af302-c891-4d26-9da8-2219984499bf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:02:08.815523 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-385af302-c891-4d26-9da8-2219984499bf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:02:08.815946 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-385af302-c891-4d26-9da8-2219984499bf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:02:08.816364 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-385af302-c891-4d26-9da8-2219984499bf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:02:08.829495 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-385af302-c891-4d26-9da8-2219984499bf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:08.834102 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-385af302-c891-4d26-9da8-2219984499bf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:08.834628 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-385af302-c891-4d26-9da8-2219984499bf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:08.835697 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-385af302-c891-4d26-9da8-2219984499bf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:08.836327 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-385af302-c891-4d26-9da8-2219984499bf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:08.837653 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-385af302-c891-4d26-9da8-2219984499bf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:08.867547 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-385af302-c891-4d26-9da8-2219984499bf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Getting quotas for project c1e5d6f3d41e4aa49e630f8c7ac87ded. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:02:08.881239 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-385af302-c891-4d26-9da8-2219984499bf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Getting quotas for user 6493da825aa24f43bdf8f0835a16e3bb and project c1e5d6f3d41e4aa49e630f8c7ac87ded. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:02:08.898373 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-385af302-c891-4d26-9da8-2219984499bf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:02:08.906761 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-385af302-c891-4d26-9da8-2219984499bf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: e6c97c05-a30e-4c8b-b56c-0cdae10ff44c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:02:08.966934 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-385af302-c891-4d26-9da8-2219984499bf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.798245 Sep 24 21:02:08.968239 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1720/3394] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:02:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:02:08.975107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-196af7eb-2cfb-4f63-8e1f-6169657cf9e8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:08.978735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-196af7eb-2cfb-4f63-8e1f-6169657cf9e8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:08.992606 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-196af7eb-2cfb-4f63-8e1f-6169657cf9e8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:08.993384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-196af7eb-2cfb-4f63-8e1f-6169657cf9e8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:08.994069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-196af7eb-2cfb-4f63-8e1f-6169657cf9e8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:08.995096 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-196af7eb-2cfb-4f63-8e1f-6169657cf9e8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:08.995865 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-196af7eb-2cfb-4f63-8e1f-6169657cf9e8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:08.997063 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-196af7eb-2cfb-4f63-8e1f-6169657cf9e8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:09.052787 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-196af7eb-2cfb-4f63-8e1f-6169657cf9e8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.083114 Sep 24 21:02:09.053962 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1721/3395] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:02:08 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:02:09.059857 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-61d2658d-f233-47fc-b91b-07f84e77fb60 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:09.060799 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-61d2658d-f233-47fc-b91b-07f84e77fb60 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: e6c97c05-a30e-4c8b-b56c-0cdae10ff44c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:09.182220 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-61d2658d-f233-47fc-b91b-07f84e77fb60 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:09.194701 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-61d2658d-f233-47fc-b91b-07f84e77fb60 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c" status: 200 len: 1215 microversion: 2.1 time: 0.139229 Sep 24 21:02:09.195332 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1722/3396] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:09 2022] GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c => generated 1215 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:09.228938 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-617976e7-aca8-42cc-baf0-0449921b4f40 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:09.238969 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-617976e7-aca8-42cc-baf0-0449921b4f40 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2" status: 200 len: 1511 microversion: 2.1 time: 0.612368 Sep 24 21:02:09.240670 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1675/3397] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:08 2022] GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 => generated 1511 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:09.562139 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-604495e2-6a00-4f2b-8837-274f2cbb2635 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:09.563308 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-604495e2-6a00-4f2b-8837-274f2cbb2635 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] [instance: de3e9921-d647-4ba4-97b4-bfa6edd98b48] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:09.596746 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-604495e2-6a00-4f2b-8837-274f2cbb2635 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:09.604644 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-604495e2-6a00-4f2b-8837-274f2cbb2635 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:09.608217 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-604495e2-6a00-4f2b-8837-274f2cbb2635 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:09.609154 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-604495e2-6a00-4f2b-8837-274f2cbb2635 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:09.609653 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-604495e2-6a00-4f2b-8837-274f2cbb2635 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:09.616077 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-604495e2-6a00-4f2b-8837-274f2cbb2635 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:10.025796 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-604495e2-6a00-4f2b-8837-274f2cbb2635 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70045b8fe87481b8fae4597b979b046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4ce6fc820e4fb5b5e731650ed6faad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:10.037182 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-604495e2-6a00-4f2b-8837-274f2cbb2635 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] 10.222.0.52 "GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48" status: 200 len: 1315 microversion: 2.1 time: 0.484261 Sep 24 21:02:10.054523 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1723/3398] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:09 2022] GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48 => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:10.067147 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5552d69c-fa6c-4fd6-a295-b16203bf6d1c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:10.070792 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5552d69c-fa6c-4fd6-a295-b16203bf6d1c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:10.089789 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5552d69c-fa6c-4fd6-a295-b16203bf6d1c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:10.091199 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5552d69c-fa6c-4fd6-a295-b16203bf6d1c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:10.101874 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5552d69c-fa6c-4fd6-a295-b16203bf6d1c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:10.104504 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5552d69c-fa6c-4fd6-a295-b16203bf6d1c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:10.107245 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5552d69c-fa6c-4fd6-a295-b16203bf6d1c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:10.110378 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5552d69c-fa6c-4fd6-a295-b16203bf6d1c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:10.223282 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1dcb8fed-516b-409c-a6a1-c4997ce378ad tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:10.224085 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1dcb8fed-516b-409c-a6a1-c4997ce378ad tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: e6c97c05-a30e-4c8b-b56c-0cdae10ff44c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:10.235506 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5552d69c-fa6c-4fd6-a295-b16203bf6d1c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.155893 Sep 24 21:02:10.237518 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1676/3399] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:02:10 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:02:10.237858 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1dcb8fed-516b-409c-a6a1-c4997ce378ad tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:10.238749 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1dcb8fed-516b-409c-a6a1-c4997ce378ad tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:10.239856 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1dcb8fed-516b-409c-a6a1-c4997ce378ad tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:10.242053 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1dcb8fed-516b-409c-a6a1-c4997ce378ad tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:10.243980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1dcb8fed-516b-409c-a6a1-c4997ce378ad tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:10.244680 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1dcb8fed-516b-409c-a6a1-c4997ce378ad tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:10.265752 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-576d6d98-7388-4ad6-ad9a-e5078adf3892 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:10.266782 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-576d6d98-7388-4ad6-ad9a-e5078adf3892 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:10.279129 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-576d6d98-7388-4ad6-ad9a-e5078adf3892 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:10.288461 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-576d6d98-7388-4ad6-ad9a-e5078adf3892 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:10.288937 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-576d6d98-7388-4ad6-ad9a-e5078adf3892 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:10.294144 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-576d6d98-7388-4ad6-ad9a-e5078adf3892 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:10.294725 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-576d6d98-7388-4ad6-ad9a-e5078adf3892 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:10.295185 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-576d6d98-7388-4ad6-ad9a-e5078adf3892 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:10.699277 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1dcb8fed-516b-409c-a6a1-c4997ce378ad tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:10.712567 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1dcb8fed-516b-409c-a6a1-c4997ce378ad tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c" status: 200 len: 1211 microversion: 2.1 time: 0.493688 Sep 24 21:02:10.713176 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1724/3400] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:10 2022] GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c => generated 1211 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:02:11.070898 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f4712caa-b051-43bb-ab5a-3facdd235709 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:11.071691 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f4712caa-b051-43bb-ab5a-3facdd235709 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] [instance: de3e9921-d647-4ba4-97b4-bfa6edd98b48] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:11.108542 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4712caa-b051-43bb-ab5a-3facdd235709 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:11.120402 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4712caa-b051-43bb-ab5a-3facdd235709 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:11.122121 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4712caa-b051-43bb-ab5a-3facdd235709 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:11.130203 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4712caa-b051-43bb-ab5a-3facdd235709 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:11.131271 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4712caa-b051-43bb-ab5a-3facdd235709 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:11.135338 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4712caa-b051-43bb-ab5a-3facdd235709 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:11.148869 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:02:11.181855 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-576d6d98-7388-4ad6-ad9a-e5078adf3892 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:11.198825 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-576d6d98-7388-4ad6-ad9a-e5078adf3892 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2" status: 200 len: 1511 microversion: 2.1 time: 0.933847 Sep 24 21:02:11.200352 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1677/3401] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:10 2022] GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 => generated 1511 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:02:11.253690 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4e55b1e9-626a-4caa-a35f-902056fa387d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:11.256607 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4e55b1e9-626a-4caa-a35f-902056fa387d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:11.264444 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e55b1e9-626a-4caa-a35f-902056fa387d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:11.265279 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e55b1e9-626a-4caa-a35f-902056fa387d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:11.265918 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e55b1e9-626a-4caa-a35f-902056fa387d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:11.266858 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e55b1e9-626a-4caa-a35f-902056fa387d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:11.267629 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e55b1e9-626a-4caa-a35f-902056fa387d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:11.268246 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e55b1e9-626a-4caa-a35f-902056fa387d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:11.317709 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4e55b1e9-626a-4caa-a35f-902056fa387d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.072052 Sep 24 21:02:11.323072 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1678/3402] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:02:11 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 21:02:11.738214 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4bb554c0-cb05-467e-94a7-991bca9d5829 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:11.738866 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4bb554c0-cb05-467e-94a7-991bca9d5829 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: e6c97c05-a30e-4c8b-b56c-0cdae10ff44c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:11.752660 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4bb554c0-cb05-467e-94a7-991bca9d5829 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:11.753162 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4bb554c0-cb05-467e-94a7-991bca9d5829 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:11.753612 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4bb554c0-cb05-467e-94a7-991bca9d5829 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:11.754335 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4bb554c0-cb05-467e-94a7-991bca9d5829 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:11.754818 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4bb554c0-cb05-467e-94a7-991bca9d5829 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:11.755250 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4bb554c0-cb05-467e-94a7-991bca9d5829 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:12.013336 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f4712caa-b051-43bb-ab5a-3facdd235709 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70045b8fe87481b8fae4597b979b046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4ce6fc820e4fb5b5e731650ed6faad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:12.024488 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f4712caa-b051-43bb-ab5a-3facdd235709 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] 10.222.0.52 "GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48" status: 200 len: 1315 microversion: 2.1 time: 0.958409 Sep 24 21:02:12.030701 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1725/3403] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:11 2022] GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48 => generated 1315 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:02:12.100363 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4bb554c0-cb05-467e-94a7-991bca9d5829 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:12.113970 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4bb554c0-cb05-467e-94a7-991bca9d5829 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c" status: 200 len: 1273 microversion: 2.1 time: 0.380258 Sep 24 21:02:12.147510 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1679/3404] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:11 2022] GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c => generated 1273 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:02:12.227535 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-45709fd6-a571-45b2-8ccd-6b071dda40f3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:12.228867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-45709fd6-a571-45b2-8ccd-6b071dda40f3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:12.250874 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45709fd6-a571-45b2-8ccd-6b071dda40f3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:12.252351 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45709fd6-a571-45b2-8ccd-6b071dda40f3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:12.256708 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45709fd6-a571-45b2-8ccd-6b071dda40f3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:12.257762 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45709fd6-a571-45b2-8ccd-6b071dda40f3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:12.260662 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45709fd6-a571-45b2-8ccd-6b071dda40f3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:12.262906 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45709fd6-a571-45b2-8ccd-6b071dda40f3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:12.851766 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-45709fd6-a571-45b2-8ccd-6b071dda40f3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:12.862215 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-45709fd6-a571-45b2-8ccd-6b071dda40f3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2" status: 200 len: 1488 microversion: 2.1 time: 0.640812 Sep 24 21:02:12.866606 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1726/3405] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:12 2022] GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 => generated 1488 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:12.896390 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ac1da04d-3bfb-4f83-b4fd-3c9964ca7ecd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:12.897061 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ac1da04d-3bfb-4f83-b4fd-3c9964ca7ecd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:12.909296 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac1da04d-3bfb-4f83-b4fd-3c9964ca7ecd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:12.910159 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac1da04d-3bfb-4f83-b4fd-3c9964ca7ecd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:12.913189 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac1da04d-3bfb-4f83-b4fd-3c9964ca7ecd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:12.914111 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac1da04d-3bfb-4f83-b4fd-3c9964ca7ecd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:12.915081 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac1da04d-3bfb-4f83-b4fd-3c9964ca7ecd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:12.916128 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac1da04d-3bfb-4f83-b4fd-3c9964ca7ecd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:12.919184 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f0df007f-8353-42de-80d2-2e3068d1e3d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:12.921516 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f0df007f-8353-42de-80d2-2e3068d1e3d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:12.938442 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f0df007f-8353-42de-80d2-2e3068d1e3d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:12.938985 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f0df007f-8353-42de-80d2-2e3068d1e3d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:12.939437 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f0df007f-8353-42de-80d2-2e3068d1e3d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:12.940164 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f0df007f-8353-42de-80d2-2e3068d1e3d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:12.955301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f0df007f-8353-42de-80d2-2e3068d1e3d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:12.956078 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f0df007f-8353-42de-80d2-2e3068d1e3d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:12.988445 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ac1da04d-3bfb-4f83-b4fd-3c9964ca7ecd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:02:13.004168 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:02:13.065287 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f0df007f-8353-42de-80d2-2e3068d1e3d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.737913 Sep 24 21:02:13.065906 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1680/3406] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:02:12 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 21:02:13.074749 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5bffc26e-33c6-4427-8c05-d973aefd975a tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:13.077421 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5bffc26e-33c6-4427-8c05-d973aefd975a tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] [instance: de3e9921-d647-4ba4-97b4-bfa6edd98b48] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:13.093066 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5bffc26e-33c6-4427-8c05-d973aefd975a tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:13.094845 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5bffc26e-33c6-4427-8c05-d973aefd975a tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:13.095630 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5bffc26e-33c6-4427-8c05-d973aefd975a tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:13.098930 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5bffc26e-33c6-4427-8c05-d973aefd975a tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:13.099587 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5bffc26e-33c6-4427-8c05-d973aefd975a tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:13.101306 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5bffc26e-33c6-4427-8c05-d973aefd975a tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:13.224937 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ac1da04d-3bfb-4f83-b4fd-3c9964ca7ecd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2" status: 204 len: 0 microversion: 2.1 time: 0.332186 Sep 24 21:02:13.225956 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1727/3407] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:02:12 2022] DELETE /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:02:13.235657 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a5afc399-f21e-41cc-877c-0b81231fc89f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:13.237320 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a5afc399-f21e-41cc-877c-0b81231fc89f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: e6c97c05-a30e-4c8b-b56c-0cdae10ff44c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:13.254817 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5afc399-f21e-41cc-877c-0b81231fc89f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:13.257460 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5afc399-f21e-41cc-877c-0b81231fc89f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:13.257928 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5afc399-f21e-41cc-877c-0b81231fc89f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:13.264336 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5afc399-f21e-41cc-877c-0b81231fc89f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:13.264845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5afc399-f21e-41cc-877c-0b81231fc89f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:13.265550 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5afc399-f21e-41cc-877c-0b81231fc89f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:14.290068 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5bffc26e-33c6-4427-8c05-d973aefd975a tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70045b8fe87481b8fae4597b979b046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4ce6fc820e4fb5b5e731650ed6faad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:14.298962 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5bffc26e-33c6-4427-8c05-d973aefd975a tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] 10.222.0.52 "GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48" status: 200 len: 1315 microversion: 2.1 time: 1.231941 Sep 24 21:02:14.299562 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1681/3408] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:13 2022] GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48 => generated 1315 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:14.312182 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a95c3843-704f-4722-bd3e-ec5b392301d8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:14.319153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a95c3843-704f-4722-bd3e-ec5b392301d8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:14.344271 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a95c3843-704f-4722-bd3e-ec5b392301d8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:14.344847 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a95c3843-704f-4722-bd3e-ec5b392301d8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:14.345522 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a95c3843-704f-4722-bd3e-ec5b392301d8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:14.346308 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a95c3843-704f-4722-bd3e-ec5b392301d8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:14.346816 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a95c3843-704f-4722-bd3e-ec5b392301d8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:14.349351 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a95c3843-704f-4722-bd3e-ec5b392301d8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:14.359649 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a5afc399-f21e-41cc-877c-0b81231fc89f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:14.383022 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a5afc399-f21e-41cc-877c-0b81231fc89f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c" status: 200 len: 1315 microversion: 2.1 time: 1.153572 Sep 24 21:02:14.383679 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1728/3409] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:13 2022] GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c => generated 1315 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:14.407881 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2b127445-5ad1-47f6-bdcc-a7576a1ec022 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:14.418217 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2b127445-5ad1-47f6-bdcc-a7576a1ec022 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:14.443513 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2b127445-5ad1-47f6-bdcc-a7576a1ec022 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:14.447043 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2b127445-5ad1-47f6-bdcc-a7576a1ec022 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:14.447744 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2b127445-5ad1-47f6-bdcc-a7576a1ec022 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:14.448732 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2b127445-5ad1-47f6-bdcc-a7576a1ec022 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:14.450288 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2b127445-5ad1-47f6-bdcc-a7576a1ec022 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:14.451980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2b127445-5ad1-47f6-bdcc-a7576a1ec022 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:14.544433 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2b127445-5ad1-47f6-bdcc-a7576a1ec022 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.159546 Sep 24 21:02:14.548631 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1729/3410] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:02:14 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:02:15.131863 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a95c3843-704f-4722-bd3e-ec5b392301d8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:15.147247 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a95c3843-704f-4722-bd3e-ec5b392301d8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2" status: 200 len: 1494 microversion: 2.1 time: 0.838894 Sep 24 21:02:15.148407 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1682/3411] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:14 2022] GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 => generated 1494 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:15.332026 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-500925d3-782f-4f56-8901-d10e81b6f56e tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:15.333103 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-500925d3-782f-4f56-8901-d10e81b6f56e tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] [instance: de3e9921-d647-4ba4-97b4-bfa6edd98b48] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:15.362460 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-500925d3-782f-4f56-8901-d10e81b6f56e tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:15.368491 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-500925d3-782f-4f56-8901-d10e81b6f56e tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:15.369256 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-500925d3-782f-4f56-8901-d10e81b6f56e tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:15.371399 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-500925d3-782f-4f56-8901-d10e81b6f56e tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:15.373471 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-500925d3-782f-4f56-8901-d10e81b6f56e tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:15.374092 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-500925d3-782f-4f56-8901-d10e81b6f56e tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:15.415403 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9c55c0c7-57c9-4146-99bc-6b8dbf7ac145 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:15.417025 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9c55c0c7-57c9-4146-99bc-6b8dbf7ac145 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: e6c97c05-a30e-4c8b-b56c-0cdae10ff44c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:15.439406 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c55c0c7-57c9-4146-99bc-6b8dbf7ac145 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:15.440217 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c55c0c7-57c9-4146-99bc-6b8dbf7ac145 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:15.440836 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c55c0c7-57c9-4146-99bc-6b8dbf7ac145 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:15.442954 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c55c0c7-57c9-4146-99bc-6b8dbf7ac145 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:15.443610 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c55c0c7-57c9-4146-99bc-6b8dbf7ac145 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:15.445272 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c55c0c7-57c9-4146-99bc-6b8dbf7ac145 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:16.205197 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-500925d3-782f-4f56-8901-d10e81b6f56e tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70045b8fe87481b8fae4597b979b046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4ce6fc820e4fb5b5e731650ed6faad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:16.206319 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9c55c0c7-57c9-4146-99bc-6b8dbf7ac145 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:16.217841 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-500925d3-782f-4f56-8901-d10e81b6f56e tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] 10.222.0.52 "GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48" status: 200 len: 1315 microversion: 2.1 time: 0.893919 Sep 24 21:02:16.220799 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9c55c0c7-57c9-4146-99bc-6b8dbf7ac145 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c" status: 200 len: 1315 microversion: 2.1 time: 0.811888 Sep 24 21:02:16.221880 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1683/3412] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:15 2022] GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c => generated 1315 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:02:16.233748 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1730/3413] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:15 2022] GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48 => generated 1315 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:16.234425 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-50ae845d-f3d7-4c56-a969-a2b1c0680e92 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:16.237047 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-50ae845d-f3d7-4c56-a969-a2b1c0680e92 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:16.244452 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4a395155-0464-49e8-9778-d629f89be368 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:16.245376 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4a395155-0464-49e8-9778-d629f89be368 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:16.249779 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-50ae845d-f3d7-4c56-a969-a2b1c0680e92 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:16.250284 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-50ae845d-f3d7-4c56-a969-a2b1c0680e92 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:16.250745 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-50ae845d-f3d7-4c56-a969-a2b1c0680e92 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:16.254381 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-50ae845d-f3d7-4c56-a969-a2b1c0680e92 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:16.255416 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a395155-0464-49e8-9778-d629f89be368 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:16.258095 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a395155-0464-49e8-9778-d629f89be368 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:16.258818 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a395155-0464-49e8-9778-d629f89be368 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:16.258967 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-50ae845d-f3d7-4c56-a969-a2b1c0680e92 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:16.259597 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-50ae845d-f3d7-4c56-a969-a2b1c0680e92 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:16.260927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a395155-0464-49e8-9778-d629f89be368 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:16.262317 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a395155-0464-49e8-9778-d629f89be368 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:16.266467 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a395155-0464-49e8-9778-d629f89be368 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:16.363265 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-50ae845d-f3d7-4c56-a969-a2b1c0680e92 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.139764 Sep 24 21:02:16.369430 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1684/3414] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:02:16 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:02:16.838646 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4a395155-0464-49e8-9778-d629f89be368 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:16.851025 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4a395155-0464-49e8-9778-d629f89be368 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2" status: 200 len: 1494 microversion: 2.1 time: 0.615874 Sep 24 21:02:16.853166 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1731/3415] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:16 2022] GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 => generated 1494 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:17.248154 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0a674622-0f10-426b-b3a2-ae3eeacb871e tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:17.248884 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0a674622-0f10-426b-b3a2-ae3eeacb871e tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] [instance: de3e9921-d647-4ba4-97b4-bfa6edd98b48] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:17.249960 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-66fd1d1a-4d75-4e2b-885c-5a609a212747 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:17.250798 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-66fd1d1a-4d75-4e2b-885c-5a609a212747 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: e6c97c05-a30e-4c8b-b56c-0cdae10ff44c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:17.260551 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66fd1d1a-4d75-4e2b-885c-5a609a212747 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:17.260796 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0a674622-0f10-426b-b3a2-ae3eeacb871e tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:17.269843 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0a674622-0f10-426b-b3a2-ae3eeacb871e tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:17.270691 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0a674622-0f10-426b-b3a2-ae3eeacb871e tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:17.271003 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66fd1d1a-4d75-4e2b-885c-5a609a212747 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:17.271488 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0a674622-0f10-426b-b3a2-ae3eeacb871e tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:17.271620 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66fd1d1a-4d75-4e2b-885c-5a609a212747 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:17.272135 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0a674622-0f10-426b-b3a2-ae3eeacb871e tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:17.272467 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66fd1d1a-4d75-4e2b-885c-5a609a212747 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:17.272584 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0a674622-0f10-426b-b3a2-ae3eeacb871e tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:17.272929 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66fd1d1a-4d75-4e2b-885c-5a609a212747 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:17.273365 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66fd1d1a-4d75-4e2b-885c-5a609a212747 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:18.062869 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0a674622-0f10-426b-b3a2-ae3eeacb871e tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70045b8fe87481b8fae4597b979b046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4ce6fc820e4fb5b5e731650ed6faad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:18.071753 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0a674622-0f10-426b-b3a2-ae3eeacb871e tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] 10.222.0.52 "GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48" status: 200 len: 1315 microversion: 2.1 time: 0.829072 Sep 24 21:02:18.083610 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1685/3416] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:17 2022] GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48 => generated 1315 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:18.088764 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cf43674c-c38a-4ffe-8c7f-1b119b8d4f4e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:18.091698 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cf43674c-c38a-4ffe-8c7f-1b119b8d4f4e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:18.107044 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf43674c-c38a-4ffe-8c7f-1b119b8d4f4e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:18.107845 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf43674c-c38a-4ffe-8c7f-1b119b8d4f4e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:18.114470 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf43674c-c38a-4ffe-8c7f-1b119b8d4f4e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:18.115632 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf43674c-c38a-4ffe-8c7f-1b119b8d4f4e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:18.116562 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf43674c-c38a-4ffe-8c7f-1b119b8d4f4e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:18.117198 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf43674c-c38a-4ffe-8c7f-1b119b8d4f4e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:18.195352 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cf43674c-c38a-4ffe-8c7f-1b119b8d4f4e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.110421 Sep 24 21:02:18.196248 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1686/3417] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:02:18 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:02:18.201407 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-68376bc5-77ba-424d-8836-06b6fcdf96b7 req-dab1c913-ca17-47d7-b557-807f56e1ca63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6c97c05-a30e-4c8b-b56c-0cdae10ff44c", "tag": "fb74888f-8f3f-40e6-9054-02d311163034"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:02:18.236688 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-68376bc5-77ba-424d-8836-06b6fcdf96b7 req-dab1c913-ca17-47d7-b557-807f56e1ca63 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:18.236688 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-68376bc5-77ba-424d-8836-06b6fcdf96b7 req-dab1c913-ca17-47d7-b557-807f56e1ca63 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:18.236688 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-68376bc5-77ba-424d-8836-06b6fcdf96b7 req-dab1c913-ca17-47d7-b557-807f56e1ca63 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:18.250514 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-66fd1d1a-4d75-4e2b-885c-5a609a212747 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:18.264093 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-66fd1d1a-4d75-4e2b-885c-5a609a212747 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c" status: 200 len: 1315 microversion: 2.1 time: 1.020306 Sep 24 21:02:18.277103 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-68376bc5-77ba-424d-8836-06b6fcdf96b7 req-dab1c913-ca17-47d7-b557-807f56e1ca63 service nova] Creating event network-changed:fb74888f-8f3f-40e6-9054-02d311163034 for instance e6c97c05-a30e-4c8b-b56c-0cdae10ff44c on nch2-master-1 Sep 24 21:02:18.283682 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-68376bc5-77ba-424d-8836-06b6fcdf96b7 req-dab1c913-ca17-47d7-b557-807f56e1ca63 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083983 Sep 24 21:02:18.283940 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1732/3418] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:17 2022] GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c => generated 1315 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:02:18.287243 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1687/3419] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:02:18.301213 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-db4cd3ca-fb75-4f6d-9053-8afb6c012f05 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:18.302305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-f08b2a19-42c4-418a-ae3c-76aa396caa3c req-f3167a67-de6a-442e-b1c3-1b1702b44389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3938cda7-a3b7-4be8-9ea5-79ec625a5bd2", "name": "network-vif-deleted", "tag": "a42b250b-5b9b-44f2-939c-4f7b443d78b9"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:02:18.306723 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-db4cd3ca-fb75-4f6d-9053-8afb6c012f05 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:18.334137 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db4cd3ca-fb75-4f6d-9053-8afb6c012f05 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:18.336251 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db4cd3ca-fb75-4f6d-9053-8afb6c012f05 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:18.336920 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db4cd3ca-fb75-4f6d-9053-8afb6c012f05 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:18.338637 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db4cd3ca-fb75-4f6d-9053-8afb6c012f05 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:18.340541 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db4cd3ca-fb75-4f6d-9053-8afb6c012f05 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:18.343069 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db4cd3ca-fb75-4f6d-9053-8afb6c012f05 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:18.345894 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-f08b2a19-42c4-418a-ae3c-76aa396caa3c req-f3167a67-de6a-442e-b1c3-1b1702b44389 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:18.352815 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-f08b2a19-42c4-418a-ae3c-76aa396caa3c req-f3167a67-de6a-442e-b1c3-1b1702b44389 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:18.353303 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-f08b2a19-42c4-418a-ae3c-76aa396caa3c req-f3167a67-de6a-442e-b1c3-1b1702b44389 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:18.416480 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-f08b2a19-42c4-418a-ae3c-76aa396caa3c req-f3167a67-de6a-442e-b1c3-1b1702b44389 service nova] Creating event network-vif-deleted:a42b250b-5b9b-44f2-939c-4f7b443d78b9 for instance 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 on nch1-master-1 Sep 24 21:02:18.456229 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-f08b2a19-42c4-418a-ae3c-76aa396caa3c req-f3167a67-de6a-442e-b1c3-1b1702b44389 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167461 Sep 24 21:02:18.458264 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1733/3420] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:02:18.470707 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-e7422c7a-90a8-4326-b222-7ac5fb1a9460 req-0ca627ae-70ea-4a13-9535-b6db6627a289 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de3e9921-d647-4ba4-97b4-bfa6edd98b48", "name": "network-vif-plugged", "status": "completed", "tag": "d9c1e35c-2108-4ebd-a17b-474bfd75d345"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:02:18.487771 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db4cd3ca-fb75-4f6d-9053-8afb6c012f05 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:18.490732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db4cd3ca-fb75-4f6d-9053-8afb6c012f05 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:18.491424 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db4cd3ca-fb75-4f6d-9053-8afb6c012f05 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:18.493305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-e7422c7a-90a8-4326-b222-7ac5fb1a9460 req-0ca627ae-70ea-4a13-9535-b6db6627a289 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:18.493477 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-db4cd3ca-fb75-4f6d-9053-8afb6c012f05 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lazy-loading 'fault' on Instance uuid 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:02:18.493806 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-e7422c7a-90a8-4326-b222-7ac5fb1a9460 req-0ca627ae-70ea-4a13-9535-b6db6627a289 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:18.495058 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-e7422c7a-90a8-4326-b222-7ac5fb1a9460 req-0ca627ae-70ea-4a13-9535-b6db6627a289 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:18.529703 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-e7422c7a-90a8-4326-b222-7ac5fb1a9460 req-0ca627ae-70ea-4a13-9535-b6db6627a289 service nova] Creating event network-vif-plugged:d9c1e35c-2108-4ebd-a17b-474bfd75d345 for instance de3e9921-d647-4ba4-97b4-bfa6edd98b48 on nch1-master-1 Sep 24 21:02:18.541193 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-e7422c7a-90a8-4326-b222-7ac5fb1a9460 req-0ca627ae-70ea-4a13-9535-b6db6627a289 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080513 Sep 24 21:02:18.544374 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1734/3421] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:02:18.724779 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-db4cd3ca-fb75-4f6d-9053-8afb6c012f05 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:18.738682 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-db4cd3ca-fb75-4f6d-9053-8afb6c012f05 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2" status: 200 len: 1304 microversion: 2.1 time: 0.452455 Sep 24 21:02:18.739568 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1688/3422] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:18 2022] GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 => generated 1304 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:18.836571 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f78b7277-fe50-42e6-b475-8099bc925234 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Action: 'create', calling method: .version_select at 0x7f4b0c13c040>, body: {"keypair": {"name": "tempest-keypair-1569532500", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYL4trPH4bj+Q1fp8M7b1Co1VlX0judUzEYs79cJbxj8DWvo7rvnDjut8zdFsOCo2vsc6BFy5TY0ZHKPygTBijOOf+px2BIA1lL+EMp6tnGDvFlZlZ1GimImTsCTxiRcw=="}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:02:18.854279 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:02:18.880972 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-f78b7277-fe50-42e6-b475-8099bc925234 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Getting quotas for project 5e3dbfe14ac3469286aa595d46c28f56. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:02:18.889885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-f78b7277-fe50-42e6-b475-8099bc925234 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Getting quotas for user cea166f15a894cd7b1cee6c5a749679c and project 5e3dbfe14ac3469286aa595d46c28f56. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:02:18.934603 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f78b7277-fe50-42e6-b475-8099bc925234 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.369241 Sep 24 21:02:18.938586 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1735/3423] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 21:02:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:02:19.107513 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e708cf27-986f-44a8-a532-4ec289820e43 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:19.108339 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e708cf27-986f-44a8-a532-4ec289820e43 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] [instance: de3e9921-d647-4ba4-97b4-bfa6edd98b48] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:19.131160 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e708cf27-986f-44a8-a532-4ec289820e43 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:19.132750 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e708cf27-986f-44a8-a532-4ec289820e43 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:19.133293 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e708cf27-986f-44a8-a532-4ec289820e43 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:19.137504 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e708cf27-986f-44a8-a532-4ec289820e43 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:19.137800 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e708cf27-986f-44a8-a532-4ec289820e43 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:19.138259 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e708cf27-986f-44a8-a532-4ec289820e43 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:19.209122 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-50a0c47f-2243-474c-af97-55a882af8382 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:19.213918 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-50a0c47f-2243-474c-af97-55a882af8382 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:19.239256 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-50a0c47f-2243-474c-af97-55a882af8382 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:19.239841 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-50a0c47f-2243-474c-af97-55a882af8382 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:19.240293 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-50a0c47f-2243-474c-af97-55a882af8382 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:19.241937 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-50a0c47f-2243-474c-af97-55a882af8382 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:19.243405 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-50a0c47f-2243-474c-af97-55a882af8382 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:19.244696 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-50a0c47f-2243-474c-af97-55a882af8382 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:19.299311 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-50a0c47f-2243-474c-af97-55a882af8382 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.094817 Sep 24 21:02:19.301877 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1736/3424] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:02:19 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:02:19.310851 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-039f2395-a189-49b6-abbb-a304d1cc1213 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:19.312070 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-039f2395-a189-49b6-abbb-a304d1cc1213 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: e6c97c05-a30e-4c8b-b56c-0cdae10ff44c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:19.318750 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:02:19.321597 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-039f2395-a189-49b6-abbb-a304d1cc1213 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:19.322823 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-039f2395-a189-49b6-abbb-a304d1cc1213 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:19.324762 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-039f2395-a189-49b6-abbb-a304d1cc1213 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:19.325803 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-039f2395-a189-49b6-abbb-a304d1cc1213 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:19.326667 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-039f2395-a189-49b6-abbb-a304d1cc1213 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:19.327301 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-039f2395-a189-49b6-abbb-a304d1cc1213 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:19.880382 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e708cf27-986f-44a8-a532-4ec289820e43 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70045b8fe87481b8fae4597b979b046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4ce6fc820e4fb5b5e731650ed6faad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:19.892786 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e708cf27-986f-44a8-a532-4ec289820e43 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] 10.222.0.52 "GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48" status: 200 len: 1315 microversion: 2.1 time: 0.796931 Sep 24 21:02:19.902891 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1689/3425] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:19 2022] GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48 => generated 1315 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:19.908588 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f5ce608d-8928-4f8b-a425-427fe2441d24 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:19.909752 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f5ce608d-8928-4f8b-a425-427fe2441d24 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:19.916690 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5ce608d-8928-4f8b-a425-427fe2441d24 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:19.918182 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5ce608d-8928-4f8b-a425-427fe2441d24 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:19.919209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5ce608d-8928-4f8b-a425-427fe2441d24 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:19.920187 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5ce608d-8928-4f8b-a425-427fe2441d24 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:19.920881 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5ce608d-8928-4f8b-a425-427fe2441d24 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:19.921538 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5ce608d-8928-4f8b-a425-427fe2441d24 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:19.946925 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-f5ce608d-8928-4f8b-a425-427fe2441d24 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] HTTP exception thrown: Instance 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 could not be found. Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f5ce608d-8928-4f8b-a425-427fe2441d24 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Request method failure captured: Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 HTTP/1.1 Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL29-X0U31bWS-OdLHgyvrqJ9cKeXdCQcU5XDw5ndql8wo4-9uoBN2em1wysBqNzzzY5Bp3FNsC7GdcmIawuHD1dS6A2amzvS90hoLHvMsCDbASCEoRJt0wxOm48tnGq2wGlMnRgEB8mO_grzOCcTdRgOgaHbZsmHcINVEnjYdvyWtzs Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 8340f7f8fa9848dc822903c738f78f2a Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 8340f7f8fa9848dc822903c738f78f2a Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-DeleteServersTestJSON-1814924671-project Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: ee21da3ff38a43798bce50c9aba4ae33 Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-DeleteServersTestJSON-1814924671-project Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 could not be found. Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '3938cda7-a3b7-4be8-9ea5-79ec625a5bd2'} Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 could not be found. Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 could not be found. Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:19.949462 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:19.953774 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:19.953774 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:19.953774 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:19.953774 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:02:19.953774 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:02:19.953774 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 could not be found. Sep 24 21:02:19.953774 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:19.955893 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f5ce608d-8928-4f8b-a425-427fe2441d24 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Returning 404 to user: Instance 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:02:19.957226 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f5ce608d-8928-4f8b-a425-427fe2441d24 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2" status: 404 len: 111 microversion: 2.1 time: 0.052707 Sep 24 21:02:19.979387 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1690/3426] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:19 2022] GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:02:20.017834 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-039f2395-a189-49b6-abbb-a304d1cc1213 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:20.026335 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-039f2395-a189-49b6-abbb-a304d1cc1213 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c" status: 200 len: 1315 microversion: 2.1 time: 0.723058 Sep 24 21:02:20.033116 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1737/3427] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:19 2022] GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c => generated 1315 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:20.133753 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-199a1079-1781-4991-9c9c-193c36421c70 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-381868080", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "1d2fee0c-2b4a-497a-b4e0-a76edfbd4190"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:02:20.269426 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-199a1079-1781-4991-9c9c-193c36421c70 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] validate_networks() for [('1d2fee0c-2b4a-497a-b4e0-a76edfbd4190', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:02:20.315751 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-46960c38-562c-40dd-b3bf-bdaf6f7a3958 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:20.318990 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-46960c38-562c-40dd-b3bf-bdaf6f7a3958 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:20.336461 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-46960c38-562c-40dd-b3bf-bdaf6f7a3958 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:20.343533 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-46960c38-562c-40dd-b3bf-bdaf6f7a3958 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:20.349340 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-46960c38-562c-40dd-b3bf-bdaf6f7a3958 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:20.351521 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-46960c38-562c-40dd-b3bf-bdaf6f7a3958 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:20.357205 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-46960c38-562c-40dd-b3bf-bdaf6f7a3958 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:20.362079 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-46960c38-562c-40dd-b3bf-bdaf6f7a3958 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:20.486178 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-46960c38-562c-40dd-b3bf-bdaf6f7a3958 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.174821 Sep 24 21:02:20.491858 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1738/3428] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:02:20 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 21:02:20.787384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fae9f813-a14a-459a-964d-7b47110ef4f9 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-342987008", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "7b5a8b36-d7ee-411d-a423-fe2d46afa3ec"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:02:20.895007 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-fae9f813-a14a-459a-964d-7b47110ef4f9 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] validate_networks() for [('7b5a8b36-d7ee-411d-a423-fe2d46afa3ec', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:02:22.690332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-199a1079-1781-4991-9c9c-193c36421c70 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:02:22.691159 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-199a1079-1781-4991-9c9c-193c36421c70 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:02:22.691796 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-199a1079-1781-4991-9c9c-193c36421c70 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:02:22.692336 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-199a1079-1781-4991-9c9c-193c36421c70 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:02:22.692874 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-199a1079-1781-4991-9c9c-193c36421c70 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:02:22.713994 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-199a1079-1781-4991-9c9c-193c36421c70 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:22.714922 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-199a1079-1781-4991-9c9c-193c36421c70 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:22.719511 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-199a1079-1781-4991-9c9c-193c36421c70 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:22.721773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-199a1079-1781-4991-9c9c-193c36421c70 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:22.723196 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-199a1079-1781-4991-9c9c-193c36421c70 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:22.731956 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-199a1079-1781-4991-9c9c-193c36421c70 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:22.784102 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-199a1079-1781-4991-9c9c-193c36421c70 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Getting quotas for project 8340f7f8fa9848dc822903c738f78f2a. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:02:22.797669 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-199a1079-1781-4991-9c9c-193c36421c70 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Getting quotas for user ee21da3ff38a43798bce50c9aba4ae33 and project 8340f7f8fa9848dc822903c738f78f2a. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:02:22.831554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-199a1079-1781-4991-9c9c-193c36421c70 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:02:22.838655 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-199a1079-1781-4991-9c9c-193c36421c70 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:02:22.959288 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-199a1079-1781-4991-9c9c-193c36421c70 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.831659 Sep 24 21:02:22.970293 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1691/3429] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:02:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:02:22.979406 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e9c4317d-10b7-4324-857f-81b5f6db4f45 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:22.983473 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e9c4317d-10b7-4324-857f-81b5f6db4f45 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] [instance: de3e9921-d647-4ba4-97b4-bfa6edd98b48] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:23.002821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9c4317d-10b7-4324-857f-81b5f6db4f45 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:23.003737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9c4317d-10b7-4324-857f-81b5f6db4f45 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:23.004527 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9c4317d-10b7-4324-857f-81b5f6db4f45 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:23.006112 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9c4317d-10b7-4324-857f-81b5f6db4f45 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:23.006857 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9c4317d-10b7-4324-857f-81b5f6db4f45 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:23.008244 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9c4317d-10b7-4324-857f-81b5f6db4f45 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:23.145347 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-fae9f813-a14a-459a-964d-7b47110ef4f9 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:02:23.145904 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-fae9f813-a14a-459a-964d-7b47110ef4f9 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:02:23.147440 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-fae9f813-a14a-459a-964d-7b47110ef4f9 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:02:23.148211 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-fae9f813-a14a-459a-964d-7b47110ef4f9 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:02:23.148626 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-fae9f813-a14a-459a-964d-7b47110ef4f9 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:02:23.172284 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fae9f813-a14a-459a-964d-7b47110ef4f9 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:23.173645 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fae9f813-a14a-459a-964d-7b47110ef4f9 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:23.174178 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fae9f813-a14a-459a-964d-7b47110ef4f9 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:23.175045 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fae9f813-a14a-459a-964d-7b47110ef4f9 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:23.177992 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fae9f813-a14a-459a-964d-7b47110ef4f9 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:23.178646 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fae9f813-a14a-459a-964d-7b47110ef4f9 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:23.218886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-fae9f813-a14a-459a-964d-7b47110ef4f9 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Getting quotas for project 2ea87ff9b7b54a44a806283f008bd3d1. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:02:23.247426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-fae9f813-a14a-459a-964d-7b47110ef4f9 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Getting quotas for user a0815c3afecb4fd5b23a0ee395f7aa5e and project 2ea87ff9b7b54a44a806283f008bd3d1. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:02:23.286463 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fae9f813-a14a-459a-964d-7b47110ef4f9 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:02:23.295278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fae9f813-a14a-459a-964d-7b47110ef4f9 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] [instance: 9b4c5a65-d9d6-47b2-b64e-9d048c544ec2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:02:23.401592 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e9c4317d-10b7-4324-857f-81b5f6db4f45 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70045b8fe87481b8fae4597b979b046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4ce6fc820e4fb5b5e731650ed6faad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:23.413189 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e9c4317d-10b7-4324-857f-81b5f6db4f45 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] 10.222.0.52 "GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48" status: 200 len: 1503 microversion: 2.1 time: 0.441280 Sep 24 21:02:23.416606 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1692/3430] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:22 2022] GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48 => generated 1503 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:23.424303 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-26adf7b1-89ad-4a8e-966e-13f9bbf6bfb4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:23.424934 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-26adf7b1-89ad-4a8e-966e-13f9bbf6bfb4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: e6c97c05-a30e-4c8b-b56c-0cdae10ff44c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:23.425913 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fae9f813-a14a-459a-964d-7b47110ef4f9 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.745297 Sep 24 21:02:23.433504 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1739/3431] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:02:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:02:23.440068 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26adf7b1-89ad-4a8e-966e-13f9bbf6bfb4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:23.442776 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26adf7b1-89ad-4a8e-966e-13f9bbf6bfb4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:23.446549 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8b9d91bd-c365-43af-8040-a0204980c4a0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:23.447334 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26adf7b1-89ad-4a8e-966e-13f9bbf6bfb4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:23.448203 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26adf7b1-89ad-4a8e-966e-13f9bbf6bfb4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:23.448741 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26adf7b1-89ad-4a8e-966e-13f9bbf6bfb4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:23.449187 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26adf7b1-89ad-4a8e-966e-13f9bbf6bfb4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:23.482102 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8b9d91bd-c365-43af-8040-a0204980c4a0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:23.506271 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8b9d91bd-c365-43af-8040-a0204980c4a0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:23.508399 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8b9d91bd-c365-43af-8040-a0204980c4a0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:23.509928 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8b9d91bd-c365-43af-8040-a0204980c4a0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:23.511505 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8b9d91bd-c365-43af-8040-a0204980c4a0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:23.513233 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8b9d91bd-c365-43af-8040-a0204980c4a0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:23.515916 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8b9d91bd-c365-43af-8040-a0204980c4a0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:23.609510 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8b9d91bd-c365-43af-8040-a0204980c4a0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.174486 Sep 24 21:02:23.612560 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1740/3432] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:02:23 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:02:23.624306 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-12af14d8-a812-434d-a798-cc8206d33652 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:23.625338 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-12af14d8-a812-434d-a798-cc8206d33652 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:23.852183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-12af14d8-a812-434d-a798-cc8206d33652 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:23.869292 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-12af14d8-a812-434d-a798-cc8206d33652 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec" status: 200 len: 1214 microversion: 2.1 time: 0.251979 Sep 24 21:02:23.888488 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1741/3433] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:23 2022] GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec => generated 1214 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:23.900019 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b6a742a6-db42-407f-98e8-cb6b74a66b12 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:23.901126 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b6a742a6-db42-407f-98e8-cb6b74a66b12 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] [instance: 9b4c5a65-d9d6-47b2-b64e-9d048c544ec2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:24.719588 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b6a742a6-db42-407f-98e8-cb6b74a66b12 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0815c3afecb4fd5b23a0ee395f7aa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea87ff9b7b54a44a806283f008bd3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:24.741629 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b6a742a6-db42-407f-98e8-cb6b74a66b12 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] 10.222.0.52 "GET /compute/v2.1/servers/9b4c5a65-d9d6-47b2-b64e-9d048c544ec2" status: 200 len: 1223 microversion: 2.1 time: 0.851777 Sep 24 21:02:24.743347 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1742/3434] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:23 2022] GET /compute/v2.1/servers/9b4c5a65-d9d6-47b2-b64e-9d048c544ec2 => generated 1223 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:24.765514 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-237a19aa-76af-46d5-87c8-7cf111ff2ec6 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:24.766483 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-237a19aa-76af-46d5-87c8-7cf111ff2ec6 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] [instance: de3e9921-d647-4ba4-97b4-bfa6edd98b48] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:24.793349 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-237a19aa-76af-46d5-87c8-7cf111ff2ec6 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:24.794076 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-237a19aa-76af-46d5-87c8-7cf111ff2ec6 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:24.796407 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-237a19aa-76af-46d5-87c8-7cf111ff2ec6 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:24.797808 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-237a19aa-76af-46d5-87c8-7cf111ff2ec6 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:24.798456 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-237a19aa-76af-46d5-87c8-7cf111ff2ec6 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:24.799146 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-237a19aa-76af-46d5-87c8-7cf111ff2ec6 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:24.880036 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-237a19aa-76af-46d5-87c8-7cf111ff2ec6 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'c70045b8fe87481b8fae4597b979b046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4ce6fc820e4fb5b5e731650ed6faad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:24.881059 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-237a19aa-76af-46d5-87c8-7cf111ff2ec6 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] 10.222.0.52 "GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48/os-instance-actions/req-46a023b8-72a4-42fa-b648-054271a2026a" status: 200 len: 313 microversion: 2.1 time: 0.136662 Sep 24 21:02:24.888182 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1743/3435] 10.222.0.52 () {58 vars in 1419 bytes} [Sat Sep 24 21:02:24 2022] GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48/os-instance-actions/req-46a023b8-72a4-42fa-b648-054271a2026a => generated 313 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:02:24.896761 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c873eebb-9d1d-4e17-beed-bf8f99dc7158 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:24.905177 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c873eebb-9d1d-4e17-beed-bf8f99dc7158 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:24.923306 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c873eebb-9d1d-4e17-beed-bf8f99dc7158 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:24.923802 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c873eebb-9d1d-4e17-beed-bf8f99dc7158 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:24.924242 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c873eebb-9d1d-4e17-beed-bf8f99dc7158 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:24.924970 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c873eebb-9d1d-4e17-beed-bf8f99dc7158 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:24.925424 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c873eebb-9d1d-4e17-beed-bf8f99dc7158 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:24.925858 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c873eebb-9d1d-4e17-beed-bf8f99dc7158 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:24.936373 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-26adf7b1-89ad-4a8e-966e-13f9bbf6bfb4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:24.968524 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-26adf7b1-89ad-4a8e-966e-13f9bbf6bfb4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c" status: 200 len: 1315 microversion: 2.1 time: 1.550049 Sep 24 21:02:24.989856 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1693/3436] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:23 2022] GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c => generated 1315 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:25.001825 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c884cc00-27bc-4765-b7ea-2f107989e729 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:25.003963 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c884cc00-27bc-4765-b7ea-2f107989e729 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:25.025045 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c884cc00-27bc-4765-b7ea-2f107989e729 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:25.025955 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c884cc00-27bc-4765-b7ea-2f107989e729 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:25.026887 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c884cc00-27bc-4765-b7ea-2f107989e729 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:25.027881 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c884cc00-27bc-4765-b7ea-2f107989e729 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:25.028573 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c884cc00-27bc-4765-b7ea-2f107989e729 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:25.029222 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c884cc00-27bc-4765-b7ea-2f107989e729 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:25.044410 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c873eebb-9d1d-4e17-beed-bf8f99dc7158 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.156236 Sep 24 21:02:25.044947 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1744/3437] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:02:24 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:02:25.064840 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e30b18cf-b008-40d6-bbcb-111cc5d7fa7f tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:02:25.092370 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e30b18cf-b008-40d6-bbcb-111cc5d7fa7f tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] [instance: de3e9921-d647-4ba4-97b4-bfa6edd98b48] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:25.109767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e30b18cf-b008-40d6-bbcb-111cc5d7fa7f tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:25.110367 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e30b18cf-b008-40d6-bbcb-111cc5d7fa7f tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:25.110847 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e30b18cf-b008-40d6-bbcb-111cc5d7fa7f tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:25.133408 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e30b18cf-b008-40d6-bbcb-111cc5d7fa7f tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:25.134090 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e30b18cf-b008-40d6-bbcb-111cc5d7fa7f tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:25.139229 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e30b18cf-b008-40d6-bbcb-111cc5d7fa7f tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:25.158265 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:02:25.190650 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c884cc00-27bc-4765-b7ea-2f107989e729 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:25.202538 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c884cc00-27bc-4765-b7ea-2f107989e729 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec" status: 200 len: 1266 microversion: 2.1 time: 0.210988 Sep 24 21:02:25.206230 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1694/3438] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:24 2022] GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:25.365562 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e30b18cf-b008-40d6-bbcb-111cc5d7fa7f tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] 10.222.0.52 "POST /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48/action" status: 202 len: 0 microversion: 2.1 time: 0.319327 Sep 24 21:02:25.369194 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1745/3439] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:02:25 2022] POST /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:02:25.375246 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7fa713b1-f7dd-4cdc-b049-b017712d53f0 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:25.376028 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7fa713b1-f7dd-4cdc-b049-b017712d53f0 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] [instance: de3e9921-d647-4ba4-97b4-bfa6edd98b48] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:25.401237 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7fa713b1-f7dd-4cdc-b049-b017712d53f0 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:25.401237 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7fa713b1-f7dd-4cdc-b049-b017712d53f0 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:25.403475 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7fa713b1-f7dd-4cdc-b049-b017712d53f0 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:25.406212 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7fa713b1-f7dd-4cdc-b049-b017712d53f0 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:25.408424 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7fa713b1-f7dd-4cdc-b049-b017712d53f0 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:25.416285 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7fa713b1-f7dd-4cdc-b049-b017712d53f0 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:25.771276 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-73d18f6c-2b54-4aa9-89ef-6f0187974e82 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:25.772800 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-73d18f6c-2b54-4aa9-89ef-6f0187974e82 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] [instance: 9b4c5a65-d9d6-47b2-b64e-9d048c544ec2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:25.809731 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-73d18f6c-2b54-4aa9-89ef-6f0187974e82 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:25.810885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-73d18f6c-2b54-4aa9-89ef-6f0187974e82 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:25.819210 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-73d18f6c-2b54-4aa9-89ef-6f0187974e82 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:25.825454 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-73d18f6c-2b54-4aa9-89ef-6f0187974e82 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:25.826036 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-73d18f6c-2b54-4aa9-89ef-6f0187974e82 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:25.826575 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-73d18f6c-2b54-4aa9-89ef-6f0187974e82 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:26.156679 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-73d18f6c-2b54-4aa9-89ef-6f0187974e82 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0815c3afecb4fd5b23a0ee395f7aa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea87ff9b7b54a44a806283f008bd3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:26.166071 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-73d18f6c-2b54-4aa9-89ef-6f0187974e82 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] 10.222.0.52 "GET /compute/v2.1/servers/9b4c5a65-d9d6-47b2-b64e-9d048c544ec2" status: 200 len: 1275 microversion: 2.1 time: 0.400179 Sep 24 21:02:26.196620 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1746/3440] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:25 2022] GET /compute/v2.1/servers/9b4c5a65-d9d6-47b2-b64e-9d048c544ec2 => generated 1275 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:26.208041 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ab579ef7-5747-4adb-8d23-eb455e4c256e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:26.208674 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ab579ef7-5747-4adb-8d23-eb455e4c256e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: e6c97c05-a30e-4c8b-b56c-0cdae10ff44c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:26.235859 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab579ef7-5747-4adb-8d23-eb455e4c256e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:26.244227 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab579ef7-5747-4adb-8d23-eb455e4c256e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:26.244902 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab579ef7-5747-4adb-8d23-eb455e4c256e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:26.249346 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab579ef7-5747-4adb-8d23-eb455e4c256e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:26.263146 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab579ef7-5747-4adb-8d23-eb455e4c256e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:26.270309 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab579ef7-5747-4adb-8d23-eb455e4c256e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:26.604289 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7fa713b1-f7dd-4cdc-b049-b017712d53f0 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70045b8fe87481b8fae4597b979b046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4ce6fc820e4fb5b5e731650ed6faad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:26.630807 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7fa713b1-f7dd-4cdc-b049-b017712d53f0 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] 10.222.0.52 "GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48" status: 200 len: 1505 microversion: 2.1 time: 1.258275 Sep 24 21:02:26.632607 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1695/3441] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:25 2022] GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48 => generated 1505 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:26.645897 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-482a3942-55d2-4e9a-ba73-ed34d20c6afe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:26.653616 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-482a3942-55d2-4e9a-ba73-ed34d20c6afe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:26.681364 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-482a3942-55d2-4e9a-ba73-ed34d20c6afe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:26.686160 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-482a3942-55d2-4e9a-ba73-ed34d20c6afe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:26.686972 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-482a3942-55d2-4e9a-ba73-ed34d20c6afe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:26.687909 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-482a3942-55d2-4e9a-ba73-ed34d20c6afe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:26.695055 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-482a3942-55d2-4e9a-ba73-ed34d20c6afe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:26.695568 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-482a3942-55d2-4e9a-ba73-ed34d20c6afe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:26.819174 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-482a3942-55d2-4e9a-ba73-ed34d20c6afe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.185182 Sep 24 21:02:26.820130 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1696/3442] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:02:26 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:02:26.833327 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9fb93c5e-b3e4-4a3e-9e06-d8aa0c33aec8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:26.833965 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9fb93c5e-b3e4-4a3e-9e06-d8aa0c33aec8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:26.850668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fb93c5e-b3e4-4a3e-9e06-d8aa0c33aec8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:26.851234 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fb93c5e-b3e4-4a3e-9e06-d8aa0c33aec8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:26.851607 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fb93c5e-b3e4-4a3e-9e06-d8aa0c33aec8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:26.852333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fb93c5e-b3e4-4a3e-9e06-d8aa0c33aec8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:26.852795 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fb93c5e-b3e4-4a3e-9e06-d8aa0c33aec8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:26.853232 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fb93c5e-b3e4-4a3e-9e06-d8aa0c33aec8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:27.210287 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9fb93c5e-b3e4-4a3e-9e06-d8aa0c33aec8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:27.222036 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9fb93c5e-b3e4-4a3e-9e06-d8aa0c33aec8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec" status: 200 len: 1272 microversion: 2.1 time: 0.400752 Sep 24 21:02:27.223450 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1697/3443] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:26 2022] GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec => generated 1272 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:27.296442 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ab579ef7-5747-4adb-8d23-eb455e4c256e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:27.307320 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ab579ef7-5747-4adb-8d23-eb455e4c256e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c" status: 200 len: 1315 microversion: 2.1 time: 1.109393 Sep 24 21:02:27.309466 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1747/3444] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:26 2022] GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c => generated 1315 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:27.335834 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-837b1fb1-368a-41ec-90b7-cdccfa82e87f tempest-FloatingIPDetailsTestJSON-2096053334 tempest-FloatingIPDetailsTestJSON-2096053334-project] Action: 'create', calling method: .version_select at 0x7f4b0cd9f940>, body: {"pool": null} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:02:27.380451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e491419c-6082-4f02-b2f3-d7b870a32d8e tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-713700866", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "964a2f16-3b2b-4463-9904-f0ad32382dbc"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:02:27.483526 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-e491419c-6082-4f02-b2f3-d7b870a32d8e tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] validate_networks() for [('964a2f16-3b2b-4463-9904-f0ad32382dbc', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:02:29.446478 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-e491419c-6082-4f02-b2f3-d7b870a32d8e tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:02:29.447749 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-e491419c-6082-4f02-b2f3-d7b870a32d8e tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:02:29.448602 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-e491419c-6082-4f02-b2f3-d7b870a32d8e tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:02:29.449391 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-e491419c-6082-4f02-b2f3-d7b870a32d8e tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:02:29.450385 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-e491419c-6082-4f02-b2f3-d7b870a32d8e tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:02:29.481706 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e491419c-6082-4f02-b2f3-d7b870a32d8e tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:29.483886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e491419c-6082-4f02-b2f3-d7b870a32d8e tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:29.484581 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e491419c-6082-4f02-b2f3-d7b870a32d8e tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:29.485620 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e491419c-6082-4f02-b2f3-d7b870a32d8e tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:29.486528 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e491419c-6082-4f02-b2f3-d7b870a32d8e tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:29.487483 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e491419c-6082-4f02-b2f3-d7b870a32d8e tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:29.529896 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-e491419c-6082-4f02-b2f3-d7b870a32d8e tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Getting quotas for project 6af0aa4ac07b40baa00186abc14ee5a1. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:02:29.561806 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-e491419c-6082-4f02-b2f3-d7b870a32d8e tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Getting quotas for user 7c9d24e7a7a94cbd9f235519ac791361 and project 6af0aa4ac07b40baa00186abc14ee5a1. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:02:29.583896 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e491419c-6082-4f02-b2f3-d7b870a32d8e tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:02:29.587362 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e491419c-6082-4f02-b2f3-d7b870a32d8e tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] [instance: de4ec687-83cc-43ea-bed9-24ec92724907] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:02:29.694913 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e491419c-6082-4f02-b2f3-d7b870a32d8e tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.383956 Sep 24 21:02:29.702320 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1748/3445] 10.222.0.52 () {62 vars in 1188 bytes} [Sat Sep 24 21:02:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2392 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 24 21:02:29.707755 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c9a3ef6c-1d50-4167-8c20-84a3316bd6a4 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:29.708384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c9a3ef6c-1d50-4167-8c20-84a3316bd6a4 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] [instance: 9b4c5a65-d9d6-47b2-b64e-9d048c544ec2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:29.725887 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c9a3ef6c-1d50-4167-8c20-84a3316bd6a4 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:29.726703 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c9a3ef6c-1d50-4167-8c20-84a3316bd6a4 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:29.729371 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c9a3ef6c-1d50-4167-8c20-84a3316bd6a4 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:29.731063 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c9a3ef6c-1d50-4167-8c20-84a3316bd6a4 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:29.731753 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c9a3ef6c-1d50-4167-8c20-84a3316bd6a4 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:29.732894 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c9a3ef6c-1d50-4167-8c20-84a3316bd6a4 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:30.506726 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c9a3ef6c-1d50-4167-8c20-84a3316bd6a4 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0815c3afecb4fd5b23a0ee395f7aa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea87ff9b7b54a44a806283f008bd3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:30.522102 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c9a3ef6c-1d50-4167-8c20-84a3316bd6a4 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] 10.222.0.52 "GET /compute/v2.1/servers/9b4c5a65-d9d6-47b2-b64e-9d048c544ec2" status: 200 len: 1323 microversion: 2.1 time: 0.817738 Sep 24 21:02:30.523720 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1749/3446] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:29 2022] GET /compute/v2.1/servers/9b4c5a65-d9d6-47b2-b64e-9d048c544ec2 => generated 1323 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:30.538021 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f6bb5f5f-6f0e-43bb-9e51-0c219685ac80 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-661020630", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "e026a019-11ce-41e8-98a9-2b4cdbc666f2"}], "security_groups": [{"name": "tempest-securitygroup--1894765361"}], "key_name": "tempest-keypair-1569532500", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:02:30.957209 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-f6bb5f5f-6f0e-43bb-9e51-0c219685ac80 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] validate_networks() for [('e026a019-11ce-41e8-98a9-2b4cdbc666f2', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:02:32.760404 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:02:32.818331 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=6 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:02:33.097865 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-f6bb5f5f-6f0e-43bb-9e51-0c219685ac80 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Getting quotas for project 5e3dbfe14ac3469286aa595d46c28f56. Resources: dict_keys(['metadata_items']) {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:02:33.103723 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-f6bb5f5f-6f0e-43bb-9e51-0c219685ac80 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Getting quotas for user cea166f15a894cd7b1cee6c5a749679c and project 5e3dbfe14ac3469286aa595d46c28f56. Resources: dict_keys(['metadata_items']) {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:02:33.119052 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-f6bb5f5f-6f0e-43bb-9e51-0c219685ac80 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:02:33.119486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-f6bb5f5f-6f0e-43bb-9e51-0c219685ac80 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:02:33.120787 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-f6bb5f5f-6f0e-43bb-9e51-0c219685ac80 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:02:33.121734 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-f6bb5f5f-6f0e-43bb-9e51-0c219685ac80 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:02:33.122224 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-f6bb5f5f-6f0e-43bb-9e51-0c219685ac80 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:02:33.130750 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6bb5f5f-6f0e-43bb-9e51-0c219685ac80 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:33.131500 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6bb5f5f-6f0e-43bb-9e51-0c219685ac80 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:33.132006 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6bb5f5f-6f0e-43bb-9e51-0c219685ac80 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:33.132807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6bb5f5f-6f0e-43bb-9e51-0c219685ac80 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:33.133356 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6bb5f5f-6f0e-43bb-9e51-0c219685ac80 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:33.133888 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6bb5f5f-6f0e-43bb-9e51-0c219685ac80 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:33.153698 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-f6bb5f5f-6f0e-43bb-9e51-0c219685ac80 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Getting quotas for project 5e3dbfe14ac3469286aa595d46c28f56. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:02:33.160864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-f6bb5f5f-6f0e-43bb-9e51-0c219685ac80 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Getting quotas for user cea166f15a894cd7b1cee6c5a749679c and project 5e3dbfe14ac3469286aa595d46c28f56. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:02:33.187114 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f6bb5f5f-6f0e-43bb-9e51-0c219685ac80 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:02:33.190865 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f6bb5f5f-6f0e-43bb-9e51-0c219685ac80 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] [instance: 0ab5c42f-da92-43e0-a5f0-c277854edc31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:02:33.252556 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f6bb5f5f-6f0e-43bb-9e51-0c219685ac80 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.725170 Sep 24 21:02:33.259857 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1750/3447] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:02:30 2022] POST /compute/v2.1/servers => generated 409 bytes in 2735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:02:33.271254 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-47a68c6e-b8b9-4b66-ab03-ac5f54359874 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:33.282147 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-47a68c6e-b8b9-4b66-ab03-ac5f54359874 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] [instance: de3e9921-d647-4ba4-97b4-bfa6edd98b48] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:33.312811 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47a68c6e-b8b9-4b66-ab03-ac5f54359874 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:33.313319 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47a68c6e-b8b9-4b66-ab03-ac5f54359874 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:33.313760 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47a68c6e-b8b9-4b66-ab03-ac5f54359874 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:33.314476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47a68c6e-b8b9-4b66-ab03-ac5f54359874 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:33.314979 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47a68c6e-b8b9-4b66-ab03-ac5f54359874 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:33.315431 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47a68c6e-b8b9-4b66-ab03-ac5f54359874 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:33.383294 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-837b1fb1-368a-41ec-90b7-cdccfa82e87f tempest-FloatingIPDetailsTestJSON-2096053334 tempest-FloatingIPDetailsTestJSON-2096053334-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.158378 Sep 24 21:02:33.384540 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1698/3448] 10.222.0.52 () {60 vars in 1170 bytes} [Sat Sep 24 21:02:27 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:02:33.398980 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-41fc304c-546d-456f-a4d9-f879431e60d8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:33.403795 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-41fc304c-546d-456f-a4d9-f879431e60d8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:33.412721 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:02:33.420030 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-41fc304c-546d-456f-a4d9-f879431e60d8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:33.421172 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-41fc304c-546d-456f-a4d9-f879431e60d8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:33.422032 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-41fc304c-546d-456f-a4d9-f879431e60d8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:33.423066 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-41fc304c-546d-456f-a4d9-f879431e60d8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:33.423742 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-41fc304c-546d-456f-a4d9-f879431e60d8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:33.424740 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-41fc304c-546d-456f-a4d9-f879431e60d8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:33.528017 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:02:33.537717 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-41fc304c-546d-456f-a4d9-f879431e60d8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.144514 Sep 24 21:02:33.539187 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1699/3449] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:02:33 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:02:33.550223 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8373a5b4-2e8b-40d0-ac3c-06e7655381f8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:33.551455 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8373a5b4-2e8b-40d0-ac3c-06e7655381f8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:33.564068 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8373a5b4-2e8b-40d0-ac3c-06e7655381f8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:33.565040 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8373a5b4-2e8b-40d0-ac3c-06e7655381f8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:33.565842 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8373a5b4-2e8b-40d0-ac3c-06e7655381f8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:33.567278 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8373a5b4-2e8b-40d0-ac3c-06e7655381f8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:33.567901 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8373a5b4-2e8b-40d0-ac3c-06e7655381f8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:33.568506 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8373a5b4-2e8b-40d0-ac3c-06e7655381f8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:33.936336 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-47a68c6e-b8b9-4b66-ab03-ac5f54359874 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70045b8fe87481b8fae4597b979b046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4ce6fc820e4fb5b5e731650ed6faad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:33.950891 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-47a68c6e-b8b9-4b66-ab03-ac5f54359874 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] 10.222.0.52 "GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48" status: 200 len: 1503 microversion: 2.1 time: 0.686650 Sep 24 21:02:33.954591 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1751/3450] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:33 2022] GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48 => generated 1503 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:33.963314 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-005d476f-c955-49f0-880c-0367a830af01 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:33.965822 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-005d476f-c955-49f0-880c-0367a830af01 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: e6c97c05-a30e-4c8b-b56c-0cdae10ff44c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:33.982011 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-005d476f-c955-49f0-880c-0367a830af01 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:33.984710 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-005d476f-c955-49f0-880c-0367a830af01 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:33.987045 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-005d476f-c955-49f0-880c-0367a830af01 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:33.988458 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-005d476f-c955-49f0-880c-0367a830af01 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:33.991391 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-005d476f-c955-49f0-880c-0367a830af01 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:33.992032 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-005d476f-c955-49f0-880c-0367a830af01 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:34.225736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8373a5b4-2e8b-40d0-ac3c-06e7655381f8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:34.239649 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8373a5b4-2e8b-40d0-ac3c-06e7655381f8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec" status: 200 len: 1314 microversion: 2.1 time: 0.699095 Sep 24 21:02:34.248923 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1700/3451] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:33 2022] GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec => generated 1314 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:34.255667 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-84da3367-192d-4530-be9d-c208ec14039b tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:34.256655 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-84da3367-192d-4530-be9d-c208ec14039b tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] [instance: de4ec687-83cc-43ea-bed9-24ec92724907] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:34.265223 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84da3367-192d-4530-be9d-c208ec14039b tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:34.266067 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84da3367-192d-4530-be9d-c208ec14039b tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:34.272090 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84da3367-192d-4530-be9d-c208ec14039b tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:34.273052 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84da3367-192d-4530-be9d-c208ec14039b tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:34.273694 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84da3367-192d-4530-be9d-c208ec14039b tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:34.274214 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84da3367-192d-4530-be9d-c208ec14039b tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:34.452463 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-005d476f-c955-49f0-880c-0367a830af01 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:34.469727 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-005d476f-c955-49f0-880c-0367a830af01 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c" status: 200 len: 1315 microversion: 2.1 time: 0.515417 Sep 24 21:02:34.484211 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1752/3452] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:33 2022] GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c => generated 1315 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:34.489359 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-93fd61ce-9dd1-4f06-84a1-c4f2b8b29295 req-2adef74c-533b-41ab-8b10-16ed85bde451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6c97c05-a30e-4c8b-b56c-0cdae10ff44c", "name": "network-vif-plugged", "status": "completed", "tag": "fb74888f-8f3f-40e6-9054-02d311163034"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:02:34.511244 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-93fd61ce-9dd1-4f06-84a1-c4f2b8b29295 req-2adef74c-533b-41ab-8b10-16ed85bde451 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:34.511727 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-93fd61ce-9dd1-4f06-84a1-c4f2b8b29295 req-2adef74c-533b-41ab-8b10-16ed85bde451 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:34.512344 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-93fd61ce-9dd1-4f06-84a1-c4f2b8b29295 req-2adef74c-533b-41ab-8b10-16ed85bde451 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:34.535942 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-93fd61ce-9dd1-4f06-84a1-c4f2b8b29295 req-2adef74c-533b-41ab-8b10-16ed85bde451 service nova] Creating event network-vif-plugged:fb74888f-8f3f-40e6-9054-02d311163034 for instance e6c97c05-a30e-4c8b-b56c-0cdae10ff44c on nch2-master-1 Sep 24 21:02:34.548804 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-93fd61ce-9dd1-4f06-84a1-c4f2b8b29295 req-2adef74c-533b-41ab-8b10-16ed85bde451 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063006 Sep 24 21:02:34.551230 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1753/3453] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:02:34.558704 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-98a1f718-0214-4937-9707-209f7c4dc021 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:34.559446 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-98a1f718-0214-4937-9707-209f7c4dc021 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] [instance: 9b4c5a65-d9d6-47b2-b64e-9d048c544ec2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:34.568434 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-98a1f718-0214-4937-9707-209f7c4dc021 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:34.569184 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-98a1f718-0214-4937-9707-209f7c4dc021 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:34.569872 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-98a1f718-0214-4937-9707-209f7c4dc021 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:34.570800 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-98a1f718-0214-4937-9707-209f7c4dc021 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:34.571268 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-98a1f718-0214-4937-9707-209f7c4dc021 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:34.571732 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-98a1f718-0214-4937-9707-209f7c4dc021 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:34.839923 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-84da3367-192d-4530-be9d-c208ec14039b tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c9d24e7a7a94cbd9f235519ac791361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af0aa4ac07b40baa00186abc14ee5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:34.848309 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-84da3367-192d-4530-be9d-c208ec14039b tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c9d24e7a7a94cbd9f235519ac791361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af0aa4ac07b40baa00186abc14ee5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:34.849781 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-84da3367-192d-4530-be9d-c208ec14039b tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c9d24e7a7a94cbd9f235519ac791361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af0aa4ac07b40baa00186abc14ee5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:34.850967 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-84da3367-192d-4530-be9d-c208ec14039b tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] 10.222.0.52 "GET /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907" status: 200 len: 1361 microversion: 2.26 time: 0.599322 Sep 24 21:02:34.851544 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1701/3454] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:02:34 2022] GET /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907 => generated 1361 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:02:34.856788 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2c575173-9946-4ae3-8f83-45cd61dd8980 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:34.857409 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2c575173-9946-4ae3-8f83-45cd61dd8980 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] [instance: 0ab5c42f-da92-43e0-a5f0-c277854edc31] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:34.863579 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c575173-9946-4ae3-8f83-45cd61dd8980 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:34.864263 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c575173-9946-4ae3-8f83-45cd61dd8980 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:34.864714 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c575173-9946-4ae3-8f83-45cd61dd8980 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:34.865442 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c575173-9946-4ae3-8f83-45cd61dd8980 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:34.865895 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c575173-9946-4ae3-8f83-45cd61dd8980 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:34.866333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c575173-9946-4ae3-8f83-45cd61dd8980 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:34.962363 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2c575173-9946-4ae3-8f83-45cd61dd8980 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea166f15a894cd7b1cee6c5a749679c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3dbfe14ac3469286aa595d46c28f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:34.973499 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2c575173-9946-4ae3-8f83-45cd61dd8980 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] 10.222.0.52 "GET /compute/v2.1/servers/0ab5c42f-da92-43e0-a5f0-c277854edc31" status: 200 len: 1329 microversion: 2.1 time: 0.120503 Sep 24 21:02:34.974823 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1702/3455] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:34 2022] GET /compute/v2.1/servers/0ab5c42f-da92-43e0-a5f0-c277854edc31 => generated 1329 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:34.987485 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dbd2803b-d010-49e2-a8e4-972688dc2024 tempest-FloatingIPDetailsTestJSON-2096053334 tempest-FloatingIPDetailsTestJSON-2096053334-project] Action: 'create', calling method: .version_select at 0x7f4b0cae5040>, body: {"pool": null} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:02:35.001420 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-98a1f718-0214-4937-9707-209f7c4dc021 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0815c3afecb4fd5b23a0ee395f7aa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea87ff9b7b54a44a806283f008bd3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:35.010319 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-98a1f718-0214-4937-9707-209f7c4dc021 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] 10.222.0.52 "GET /compute/v2.1/servers/9b4c5a65-d9d6-47b2-b64e-9d048c544ec2" status: 200 len: 1323 microversion: 2.1 time: 0.457847 Sep 24 21:02:35.011166 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1754/3456] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:34 2022] GET /compute/v2.1/servers/9b4c5a65-d9d6-47b2-b64e-9d048c544ec2 => generated 1323 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:35.019334 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-901d581c-9a6d-4b3e-91c3-98e0bafef529 req-a7594bad-3cea-46b8-bebf-f8a013d56f20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b4c5a65-d9d6-47b2-b64e-9d048c544ec2", "tag": "f9d18e66-7d10-4aa4-b762-8793427bfb44"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:02:35.031578 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-901d581c-9a6d-4b3e-91c3-98e0bafef529 req-a7594bad-3cea-46b8-bebf-f8a013d56f20 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:35.032154 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-901d581c-9a6d-4b3e-91c3-98e0bafef529 req-a7594bad-3cea-46b8-bebf-f8a013d56f20 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:35.032664 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-901d581c-9a6d-4b3e-91c3-98e0bafef529 req-a7594bad-3cea-46b8-bebf-f8a013d56f20 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:35.047017 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-901d581c-9a6d-4b3e-91c3-98e0bafef529 req-a7594bad-3cea-46b8-bebf-f8a013d56f20 service nova] Creating event network-changed:f9d18e66-7d10-4aa4-b762-8793427bfb44 for instance 9b4c5a65-d9d6-47b2-b64e-9d048c544ec2 on nch1-master-1 Sep 24 21:02:35.052002 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-901d581c-9a6d-4b3e-91c3-98e0bafef529 req-a7594bad-3cea-46b8-bebf-f8a013d56f20 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039482 Sep 24 21:02:35.052596 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1755/3457] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:02:35.057579 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-662d3b86-691b-469a-a79c-9b3685e17cfc req-4e733c65-eaa3-4d02-b965-ecadd02cae40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de4ec687-83cc-43ea-bed9-24ec92724907", "tag": "b9922c9f-dd9d-4a56-8f56-8211e7c07c8a"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:02:35.066931 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-662d3b86-691b-469a-a79c-9b3685e17cfc req-4e733c65-eaa3-4d02-b965-ecadd02cae40 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:35.067632 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-662d3b86-691b-469a-a79c-9b3685e17cfc req-4e733c65-eaa3-4d02-b965-ecadd02cae40 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:35.068142 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-662d3b86-691b-469a-a79c-9b3685e17cfc req-4e733c65-eaa3-4d02-b965-ecadd02cae40 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:35.080151 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-662d3b86-691b-469a-a79c-9b3685e17cfc req-4e733c65-eaa3-4d02-b965-ecadd02cae40 service nova] Creating event network-changed:b9922c9f-dd9d-4a56-8f56-8211e7c07c8a for instance de4ec687-83cc-43ea-bed9-24ec92724907 on nch2-master-1 Sep 24 21:02:35.085446 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-662d3b86-691b-469a-a79c-9b3685e17cfc req-4e733c65-eaa3-4d02-b965-ecadd02cae40 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031435 Sep 24 21:02:35.086401 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1756/3458] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:02:35.092130 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-57341fe0-eadb-419c-91f1-5d81f518e2e5 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Calling method '.version_select at 0x7f4b0c0b5820>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:35.092813 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-57341fe0-eadb-419c-91f1-5d81f518e2e5 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] [instance: de3e9921-d647-4ba4-97b4-bfa6edd98b48] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:35.099090 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-57341fe0-eadb-419c-91f1-5d81f518e2e5 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:35.099579 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-57341fe0-eadb-419c-91f1-5d81f518e2e5 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:35.100047 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-57341fe0-eadb-419c-91f1-5d81f518e2e5 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:35.100752 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-57341fe0-eadb-419c-91f1-5d81f518e2e5 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:35.101202 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-57341fe0-eadb-419c-91f1-5d81f518e2e5 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:35.101636 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-57341fe0-eadb-419c-91f1-5d81f518e2e5 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:35.133479 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-57341fe0-eadb-419c-91f1-5d81f518e2e5 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] 10.222.0.52 "GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.046163 Sep 24 21:02:35.134645 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1757/3459] 10.222.0.52 () {58 vars in 1296 bytes} [Sat Sep 24 21:02:35 2022] GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48/os-instance-actions => generated 611 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:02:35.140518 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4f5a44c5-f70c-4e84-97ed-e1dc22f59cec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:35.142752 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4f5a44c5-f70c-4e84-97ed-e1dc22f59cec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:35.148832 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f5a44c5-f70c-4e84-97ed-e1dc22f59cec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:35.149318 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f5a44c5-f70c-4e84-97ed-e1dc22f59cec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:35.149752 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f5a44c5-f70c-4e84-97ed-e1dc22f59cec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:35.150451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f5a44c5-f70c-4e84-97ed-e1dc22f59cec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:35.151075 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f5a44c5-f70c-4e84-97ed-e1dc22f59cec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:35.151661 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f5a44c5-f70c-4e84-97ed-e1dc22f59cec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:35.191846 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4f5a44c5-f70c-4e84-97ed-e1dc22f59cec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.055941 Sep 24 21:02:35.192439 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1758/3460] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:02:35 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:02:35.197151 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-26a1bb60-bde0-4cff-98de-277fb14dff99 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:35.197652 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-26a1bb60-bde0-4cff-98de-277fb14dff99 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] [instance: de3e9921-d647-4ba4-97b4-bfa6edd98b48] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:35.199642 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:02:35.205787 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26a1bb60-bde0-4cff-98de-277fb14dff99 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:35.206378 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26a1bb60-bde0-4cff-98de-277fb14dff99 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:35.206878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26a1bb60-bde0-4cff-98de-277fb14dff99 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:35.207779 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26a1bb60-bde0-4cff-98de-277fb14dff99 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:35.208462 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26a1bb60-bde0-4cff-98de-277fb14dff99 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:35.209027 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26a1bb60-bde0-4cff-98de-277fb14dff99 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:35.236018 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-26a1bb60-bde0-4cff-98de-277fb14dff99 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] [instance: de3e9921-d647-4ba4-97b4-bfa6edd98b48] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:02:35.318742 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-26a1bb60-bde0-4cff-98de-277fb14dff99 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] 10.222.0.52 "DELETE /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48" status: 204 len: 0 microversion: 2.1 time: 0.124941 Sep 24 21:02:35.323710 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1759/3461] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:02:35 2022] DELETE /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:02:35.326309 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dd9e06c4-7214-4287-b6bb-ce6dfcdedcf1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:35.327044 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-dd9e06c4-7214-4287-b6bb-ce6dfcdedcf1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:35.333180 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd9e06c4-7214-4287-b6bb-ce6dfcdedcf1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:35.333678 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd9e06c4-7214-4287-b6bb-ce6dfcdedcf1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:35.334145 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd9e06c4-7214-4287-b6bb-ce6dfcdedcf1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:35.334907 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd9e06c4-7214-4287-b6bb-ce6dfcdedcf1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:35.335368 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd9e06c4-7214-4287-b6bb-ce6dfcdedcf1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:35.335800 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd9e06c4-7214-4287-b6bb-ce6dfcdedcf1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:35.572615 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-dd9e06c4-7214-4287-b6bb-ce6dfcdedcf1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:35.585186 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-dd9e06c4-7214-4287-b6bb-ce6dfcdedcf1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec" status: 200 len: 1314 microversion: 2.1 time: 0.263711 Sep 24 21:02:35.585717 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1760/3462] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:35 2022] GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:35.600098 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e332f535-52f9-4a89-9a48-7ee78792dfad tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:35.600727 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e332f535-52f9-4a89-9a48-7ee78792dfad tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] [instance: de3e9921-d647-4ba4-97b4-bfa6edd98b48] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:35.618385 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e332f535-52f9-4a89-9a48-7ee78792dfad tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:35.618926 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e332f535-52f9-4a89-9a48-7ee78792dfad tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:35.621511 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e332f535-52f9-4a89-9a48-7ee78792dfad tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:35.622647 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e332f535-52f9-4a89-9a48-7ee78792dfad tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:35.624422 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e332f535-52f9-4a89-9a48-7ee78792dfad tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:35.624877 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e332f535-52f9-4a89-9a48-7ee78792dfad tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:35.859539 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e332f535-52f9-4a89-9a48-7ee78792dfad tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70045b8fe87481b8fae4597b979b046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4ce6fc820e4fb5b5e731650ed6faad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:35.868623 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e332f535-52f9-4a89-9a48-7ee78792dfad tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] 10.222.0.52 "GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48" status: 200 len: 1509 microversion: 2.1 time: 0.281681 Sep 24 21:02:35.869201 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1761/3463] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:35 2022] GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48 => generated 1509 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:35.875713 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-07651dff-7b7d-4f2e-b271-685aabed7e19 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:35.876331 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-07651dff-7b7d-4f2e-b271-685aabed7e19 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: e6c97c05-a30e-4c8b-b56c-0cdae10ff44c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:35.882278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07651dff-7b7d-4f2e-b271-685aabed7e19 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:35.882806 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07651dff-7b7d-4f2e-b271-685aabed7e19 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:35.883245 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07651dff-7b7d-4f2e-b271-685aabed7e19 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:35.883944 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07651dff-7b7d-4f2e-b271-685aabed7e19 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:35.884400 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07651dff-7b7d-4f2e-b271-685aabed7e19 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:35.884825 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07651dff-7b7d-4f2e-b271-685aabed7e19 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:35.905464 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:02:36.164939 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-07651dff-7b7d-4f2e-b271-685aabed7e19 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:36.173600 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-07651dff-7b7d-4f2e-b271-685aabed7e19 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c" status: 200 len: 1315 microversion: 2.1 time: 0.302475 Sep 24 21:02:36.174741 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1762/3464] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:35 2022] GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:36.195117 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6cc5db38-a2e6-4a5f-84c4-5839d1998322 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:36.195766 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6cc5db38-a2e6-4a5f-84c4-5839d1998322 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] [instance: de4ec687-83cc-43ea-bed9-24ec92724907] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:36.203995 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6cc5db38-a2e6-4a5f-84c4-5839d1998322 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:36.204840 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6cc5db38-a2e6-4a5f-84c4-5839d1998322 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:36.205115 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6cc5db38-a2e6-4a5f-84c4-5839d1998322 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:36.205850 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6cc5db38-a2e6-4a5f-84c4-5839d1998322 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:36.206331 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6cc5db38-a2e6-4a5f-84c4-5839d1998322 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:36.206902 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6cc5db38-a2e6-4a5f-84c4-5839d1998322 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:36.519512 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6cc5db38-a2e6-4a5f-84c4-5839d1998322 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c9d24e7a7a94cbd9f235519ac791361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af0aa4ac07b40baa00186abc14ee5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:36.529816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6cc5db38-a2e6-4a5f-84c4-5839d1998322 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c9d24e7a7a94cbd9f235519ac791361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af0aa4ac07b40baa00186abc14ee5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:36.531504 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6cc5db38-a2e6-4a5f-84c4-5839d1998322 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c9d24e7a7a94cbd9f235519ac791361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af0aa4ac07b40baa00186abc14ee5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:36.532655 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6cc5db38-a2e6-4a5f-84c4-5839d1998322 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] 10.222.0.52 "GET /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907" status: 200 len: 1361 microversion: 2.26 time: 0.357296 Sep 24 21:02:36.533476 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1763/3465] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:02:36 2022] GET /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907 => generated 1361 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:02:36.538078 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d94c5ad0-163a-4a91-9fea-492f192b3a77 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:36.538786 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d94c5ad0-163a-4a91-9fea-492f192b3a77 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] [instance: 0ab5c42f-da92-43e0-a5f0-c277854edc31] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:36.548515 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d94c5ad0-163a-4a91-9fea-492f192b3a77 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:36.549276 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d94c5ad0-163a-4a91-9fea-492f192b3a77 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:36.549882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d94c5ad0-163a-4a91-9fea-492f192b3a77 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:36.550850 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d94c5ad0-163a-4a91-9fea-492f192b3a77 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:36.551317 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d94c5ad0-163a-4a91-9fea-492f192b3a77 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:36.551751 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d94c5ad0-163a-4a91-9fea-492f192b3a77 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:36.609332 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dbd2803b-d010-49e2-a8e4-972688dc2024 tempest-FloatingIPDetailsTestJSON-2096053334 tempest-FloatingIPDetailsTestJSON-2096053334-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.632911 Sep 24 21:02:36.610356 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1703/3466] 10.222.0.52 () {60 vars in 1170 bytes} [Sat Sep 24 21:02:34 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:02:36.615189 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4bc92077-c01c-489d-a140-8a7d21dc6069 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:36.615815 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4bc92077-c01c-489d-a140-8a7d21dc6069 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] [instance: 9b4c5a65-d9d6-47b2-b64e-9d048c544ec2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:36.623180 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4bc92077-c01c-489d-a140-8a7d21dc6069 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:36.626298 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d94c5ad0-163a-4a91-9fea-492f192b3a77 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea166f15a894cd7b1cee6c5a749679c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3dbfe14ac3469286aa595d46c28f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:36.627055 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4bc92077-c01c-489d-a140-8a7d21dc6069 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:36.627519 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4bc92077-c01c-489d-a140-8a7d21dc6069 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:36.628324 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4bc92077-c01c-489d-a140-8a7d21dc6069 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:36.628802 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4bc92077-c01c-489d-a140-8a7d21dc6069 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:36.629235 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4bc92077-c01c-489d-a140-8a7d21dc6069 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:36.635048 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d94c5ad0-163a-4a91-9fea-492f192b3a77 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] 10.222.0.52 "GET /compute/v2.1/servers/0ab5c42f-da92-43e0-a5f0-c277854edc31" status: 200 len: 1347 microversion: 2.1 time: 0.100498 Sep 24 21:02:36.636982 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1764/3467] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:36 2022] GET /compute/v2.1/servers/0ab5c42f-da92-43e0-a5f0-c277854edc31 => generated 1347 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:36.644643 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-41848a1b-08be-48a4-8e72-11579660f5d8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:36.647157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-41848a1b-08be-48a4-8e72-11579660f5d8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:36.654743 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41848a1b-08be-48a4-8e72-11579660f5d8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:36.655326 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41848a1b-08be-48a4-8e72-11579660f5d8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:36.655839 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41848a1b-08be-48a4-8e72-11579660f5d8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:36.656656 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41848a1b-08be-48a4-8e72-11579660f5d8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:36.657194 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41848a1b-08be-48a4-8e72-11579660f5d8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:36.657697 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41848a1b-08be-48a4-8e72-11579660f5d8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:36.689185 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-41848a1b-08be-48a4-8e72-11579660f5d8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.050903 Sep 24 21:02:36.689877 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1765/3468] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:02:36 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:02:36.698796 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f84645d8-b990-4ece-880a-da7aae0d5271 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:36.699413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f84645d8-b990-4ece-880a-da7aae0d5271 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:36.705470 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f84645d8-b990-4ece-880a-da7aae0d5271 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:36.705954 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f84645d8-b990-4ece-880a-da7aae0d5271 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:36.706605 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f84645d8-b990-4ece-880a-da7aae0d5271 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:36.707340 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f84645d8-b990-4ece-880a-da7aae0d5271 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:36.707798 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f84645d8-b990-4ece-880a-da7aae0d5271 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:36.708228 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f84645d8-b990-4ece-880a-da7aae0d5271 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:36.804952 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4bc92077-c01c-489d-a140-8a7d21dc6069 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0815c3afecb4fd5b23a0ee395f7aa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea87ff9b7b54a44a806283f008bd3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:36.814553 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4bc92077-c01c-489d-a140-8a7d21dc6069 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] 10.222.0.52 "GET /compute/v2.1/servers/9b4c5a65-d9d6-47b2-b64e-9d048c544ec2" status: 200 len: 1323 microversion: 2.1 time: 0.202951 Sep 24 21:02:36.815757 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1704/3469] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:36 2022] GET /compute/v2.1/servers/9b4c5a65-d9d6-47b2-b64e-9d048c544ec2 => generated 1323 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:36.822378 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2ff1379d-82d1-4479-a978-397b49508d2e tempest-FloatingIPDetailsTestJSON-2096053334 tempest-FloatingIPDetailsTestJSON-2096053334-project] Action: 'create', calling method: .version_select at 0x7f4b0c9ad790>, body: {"pool": null} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:02:36.911758 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f84645d8-b990-4ece-880a-da7aae0d5271 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:36.921389 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f84645d8-b990-4ece-880a-da7aae0d5271 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec" status: 200 len: 1314 microversion: 2.1 time: 0.229876 Sep 24 21:02:36.926867 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1766/3470] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:36 2022] GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:36.931937 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3df433e9-0e15-46e3-9546-91ba237d560a tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:36.935797 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3df433e9-0e15-46e3-9546-91ba237d560a tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] [instance: de3e9921-d647-4ba4-97b4-bfa6edd98b48] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:36.943660 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3df433e9-0e15-46e3-9546-91ba237d560a tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:36.944338 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3df433e9-0e15-46e3-9546-91ba237d560a tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:36.944789 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3df433e9-0e15-46e3-9546-91ba237d560a tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:36.945547 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3df433e9-0e15-46e3-9546-91ba237d560a tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:36.946013 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3df433e9-0e15-46e3-9546-91ba237d560a tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:36.946449 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3df433e9-0e15-46e3-9546-91ba237d560a tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:37.591651 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3df433e9-0e15-46e3-9546-91ba237d560a tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70045b8fe87481b8fae4597b979b046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4ce6fc820e4fb5b5e731650ed6faad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:37.601647 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3df433e9-0e15-46e3-9546-91ba237d560a tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] 10.222.0.52 "GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48" status: 200 len: 1509 microversion: 2.1 time: 0.673368 Sep 24 21:02:37.602743 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1767/3471] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:36 2022] GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48 => generated 1509 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:37.608630 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-ba1f4574-7c94-4d33-a8e1-958d11fa8acc req-8cdadc74-0b19-47b5-adb5-751a8d963ffb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2274cc1a-6e7c-4ea0-a28b-c5f642a734ec", "tag": "cfefa178-619d-499d-9daa-31b41a795d02"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:02:37.621026 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-ba1f4574-7c94-4d33-a8e1-958d11fa8acc req-8cdadc74-0b19-47b5-adb5-751a8d963ffb service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:37.621693 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-ba1f4574-7c94-4d33-a8e1-958d11fa8acc req-8cdadc74-0b19-47b5-adb5-751a8d963ffb service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:37.622123 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-ba1f4574-7c94-4d33-a8e1-958d11fa8acc req-8cdadc74-0b19-47b5-adb5-751a8d963ffb service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:37.637024 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-ba1f4574-7c94-4d33-a8e1-958d11fa8acc req-8cdadc74-0b19-47b5-adb5-751a8d963ffb service nova] Creating event network-changed:cfefa178-619d-499d-9daa-31b41a795d02 for instance 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec on nch1-master-1 Sep 24 21:02:37.644677 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-ba1f4574-7c94-4d33-a8e1-958d11fa8acc req-8cdadc74-0b19-47b5-adb5-751a8d963ffb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039853 Sep 24 21:02:37.646119 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1768/3472] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:02:37.651659 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2cd14351-0ce0-4ee2-91e7-51cdadc24937 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:37.652633 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2cd14351-0ce0-4ee2-91e7-51cdadc24937 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: e6c97c05-a30e-4c8b-b56c-0cdae10ff44c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:37.660522 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2cd14351-0ce0-4ee2-91e7-51cdadc24937 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:37.661025 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2cd14351-0ce0-4ee2-91e7-51cdadc24937 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:37.661479 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2cd14351-0ce0-4ee2-91e7-51cdadc24937 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:37.662897 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2cd14351-0ce0-4ee2-91e7-51cdadc24937 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:37.663379 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2cd14351-0ce0-4ee2-91e7-51cdadc24937 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:37.663822 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2cd14351-0ce0-4ee2-91e7-51cdadc24937 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:37.913748 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2cd14351-0ce0-4ee2-91e7-51cdadc24937 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:37.929005 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2cd14351-0ce0-4ee2-91e7-51cdadc24937 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c" status: 200 len: 1503 microversion: 2.1 time: 0.281050 Sep 24 21:02:37.929624 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1769/3473] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:37 2022] GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c => generated 1503 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:37.935144 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-da91953f-c3d8-46be-b4fa-8dfb32b5839f tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:37.936014 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-da91953f-c3d8-46be-b4fa-8dfb32b5839f tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] [instance: de4ec687-83cc-43ea-bed9-24ec92724907] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:37.943785 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-da91953f-c3d8-46be-b4fa-8dfb32b5839f tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:37.944565 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-da91953f-c3d8-46be-b4fa-8dfb32b5839f tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:37.945184 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-da91953f-c3d8-46be-b4fa-8dfb32b5839f tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:37.946124 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-da91953f-c3d8-46be-b4fa-8dfb32b5839f tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:37.946918 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-da91953f-c3d8-46be-b4fa-8dfb32b5839f tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:37.947539 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-da91953f-c3d8-46be-b4fa-8dfb32b5839f tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:38.283693 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-da91953f-c3d8-46be-b4fa-8dfb32b5839f tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c9d24e7a7a94cbd9f235519ac791361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af0aa4ac07b40baa00186abc14ee5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:38.294385 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-da91953f-c3d8-46be-b4fa-8dfb32b5839f tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c9d24e7a7a94cbd9f235519ac791361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af0aa4ac07b40baa00186abc14ee5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:38.296127 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-da91953f-c3d8-46be-b4fa-8dfb32b5839f tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c9d24e7a7a94cbd9f235519ac791361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af0aa4ac07b40baa00186abc14ee5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:38.297814 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-da91953f-c3d8-46be-b4fa-8dfb32b5839f tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] 10.222.0.52 "GET /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907" status: 200 len: 1361 microversion: 2.26 time: 0.366850 Sep 24 21:02:38.299014 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1770/3474] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:02:37 2022] GET /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907 => generated 1361 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:02:38.305147 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-daecaca3-0123-465c-924c-f3f17f2dec34 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:38.305984 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-daecaca3-0123-465c-924c-f3f17f2dec34 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] [instance: 0ab5c42f-da92-43e0-a5f0-c277854edc31] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:38.314986 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-daecaca3-0123-465c-924c-f3f17f2dec34 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:38.315628 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-daecaca3-0123-465c-924c-f3f17f2dec34 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:38.316334 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-daecaca3-0123-465c-924c-f3f17f2dec34 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:38.317167 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-daecaca3-0123-465c-924c-f3f17f2dec34 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:38.317738 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-daecaca3-0123-465c-924c-f3f17f2dec34 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:38.318282 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-daecaca3-0123-465c-924c-f3f17f2dec34 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:38.756097 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-daecaca3-0123-465c-924c-f3f17f2dec34 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea166f15a894cd7b1cee6c5a749679c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3dbfe14ac3469286aa595d46c28f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:38.782467 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-daecaca3-0123-465c-924c-f3f17f2dec34 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] 10.222.0.52 "GET /compute/v2.1/servers/0ab5c42f-da92-43e0-a5f0-c277854edc31" status: 200 len: 1403 microversion: 2.1 time: 0.470447 Sep 24 21:02:38.785040 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1771/3475] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:38 2022] GET /compute/v2.1/servers/0ab5c42f-da92-43e0-a5f0-c277854edc31 => generated 1403 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:38.792418 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-40535200-53a3-4301-9f14-f9816c7be963 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:38.796720 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-40535200-53a3-4301-9f14-f9816c7be963 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:38.806212 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40535200-53a3-4301-9f14-f9816c7be963 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:38.806805 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40535200-53a3-4301-9f14-f9816c7be963 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:38.807294 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40535200-53a3-4301-9f14-f9816c7be963 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:38.808175 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40535200-53a3-4301-9f14-f9816c7be963 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:38.808855 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40535200-53a3-4301-9f14-f9816c7be963 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:38.809453 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40535200-53a3-4301-9f14-f9816c7be963 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:38.867745 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-40535200-53a3-4301-9f14-f9816c7be963 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.081283 Sep 24 21:02:38.868363 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1772/3476] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:02:38 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:02:38.881435 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1629a6c1-8256-46d5-a91b-4d6a1242588f tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:38.882399 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1629a6c1-8256-46d5-a91b-4d6a1242588f tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] [instance: 9b4c5a65-d9d6-47b2-b64e-9d048c544ec2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:38.900925 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1629a6c1-8256-46d5-a91b-4d6a1242588f tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:38.902205 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1629a6c1-8256-46d5-a91b-4d6a1242588f tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:38.902708 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1629a6c1-8256-46d5-a91b-4d6a1242588f tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:38.903456 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1629a6c1-8256-46d5-a91b-4d6a1242588f tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:38.905216 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1629a6c1-8256-46d5-a91b-4d6a1242588f tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:38.905886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1629a6c1-8256-46d5-a91b-4d6a1242588f tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:39.171042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1629a6c1-8256-46d5-a91b-4d6a1242588f tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0815c3afecb4fd5b23a0ee395f7aa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea87ff9b7b54a44a806283f008bd3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:39.186129 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1629a6c1-8256-46d5-a91b-4d6a1242588f tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] 10.222.0.52 "GET /compute/v2.1/servers/9b4c5a65-d9d6-47b2-b64e-9d048c544ec2" status: 200 len: 1323 microversion: 2.1 time: 0.310086 Sep 24 21:02:39.187028 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1773/3477] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:38 2022] GET /compute/v2.1/servers/9b4c5a65-d9d6-47b2-b64e-9d048c544ec2 => generated 1323 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:39.207148 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-704b47f2-8be5-4f81-8ca8-f9f6bdb9d4a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:39.207960 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-704b47f2-8be5-4f81-8ca8-f9f6bdb9d4a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:39.218280 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-704b47f2-8be5-4f81-8ca8-f9f6bdb9d4a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:39.218843 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-704b47f2-8be5-4f81-8ca8-f9f6bdb9d4a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:39.219264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-704b47f2-8be5-4f81-8ca8-f9f6bdb9d4a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:39.220153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-704b47f2-8be5-4f81-8ca8-f9f6bdb9d4a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:39.220637 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-704b47f2-8be5-4f81-8ca8-f9f6bdb9d4a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:39.221079 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-704b47f2-8be5-4f81-8ca8-f9f6bdb9d4a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:39.288798 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2ff1379d-82d1-4479-a978-397b49508d2e tempest-FloatingIPDetailsTestJSON-2096053334 tempest-FloatingIPDetailsTestJSON-2096053334-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.471727 Sep 24 21:02:39.289419 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1705/3478] 10.222.0.52 () {60 vars in 1170 bytes} [Sat Sep 24 21:02:36 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:02:39.295373 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9e2471b2-7b7f-477b-aa57-7b9625b8c663 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:02:39.307501 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9e2471b2-7b7f-477b-aa57-7b9625b8c663 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:39.308705 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9e2471b2-7b7f-477b-aa57-7b9625b8c663 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:39.309337 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9e2471b2-7b7f-477b-aa57-7b9625b8c663 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:39.395679 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9e2471b2-7b7f-477b-aa57-7b9625b8c663 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: e6c97c05-a30e-4c8b-b56c-0cdae10ff44c] Going to try to stop instance {{(pid=140517) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 24 21:02:39.414511 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-704b47f2-8be5-4f81-8ca8-f9f6bdb9d4a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:39.423563 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-704b47f2-8be5-4f81-8ca8-f9f6bdb9d4a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec" status: 200 len: 1314 microversion: 2.1 time: 0.220171 Sep 24 21:02:39.424078 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1774/3479] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:39 2022] GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:39.429517 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4a9ec5fa-a712-41a7-b087-afe81a817bed tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:39.430131 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4a9ec5fa-a712-41a7-b087-afe81a817bed tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] [instance: de3e9921-d647-4ba4-97b4-bfa6edd98b48] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:39.437609 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a9ec5fa-a712-41a7-b087-afe81a817bed tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:39.438178 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a9ec5fa-a712-41a7-b087-afe81a817bed tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:39.438665 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a9ec5fa-a712-41a7-b087-afe81a817bed tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:39.439507 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a9ec5fa-a712-41a7-b087-afe81a817bed tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:39.440033 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a9ec5fa-a712-41a7-b087-afe81a817bed tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:39.440476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a9ec5fa-a712-41a7-b087-afe81a817bed tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:39.457887 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9e2471b2-7b7f-477b-aa57-7b9625b8c663 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "POST /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c/action" status: 202 len: 0 microversion: 2.1 time: 0.167228 Sep 24 21:02:39.459171 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1706/3480] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:02:39 2022] POST /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:02:39.464867 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-0bf4cee0-a40b-4703-bf87-0eeb060b9869 req-ee602954-998c-40aa-bc09-c6d9f80f6fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ab5c42f-da92-43e0-a5f0-c277854edc31", "tag": "9ae08dc8-d176-4e64-8af4-718d5d9d5b5c"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:02:39.475038 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-0bf4cee0-a40b-4703-bf87-0eeb060b9869 req-ee602954-998c-40aa-bc09-c6d9f80f6fe8 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:39.475528 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-0bf4cee0-a40b-4703-bf87-0eeb060b9869 req-ee602954-998c-40aa-bc09-c6d9f80f6fe8 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:39.475971 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-0bf4cee0-a40b-4703-bf87-0eeb060b9869 req-ee602954-998c-40aa-bc09-c6d9f80f6fe8 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:39.488672 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-0bf4cee0-a40b-4703-bf87-0eeb060b9869 req-ee602954-998c-40aa-bc09-c6d9f80f6fe8 service nova] Creating event network-changed:9ae08dc8-d176-4e64-8af4-718d5d9d5b5c for instance 0ab5c42f-da92-43e0-a5f0-c277854edc31 on nch2-master-1 Sep 24 21:02:39.496739 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-0bf4cee0-a40b-4703-bf87-0eeb060b9869 req-ee602954-998c-40aa-bc09-c6d9f80f6fe8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035799 Sep 24 21:02:39.497390 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1707/3481] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:02:39.502476 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7cff9437-57fd-41c6-bb43-4ff10aae7086 tempest-FloatingIPDetailsTestJSON-2096053334 tempest-FloatingIPDetailsTestJSON-2096053334-project] Action: 'create', calling method: .version_select at 0x7f4b1104c700>, body: {"pool": null} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:02:39.675887 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4a9ec5fa-a712-41a7-b087-afe81a817bed tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70045b8fe87481b8fae4597b979b046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4ce6fc820e4fb5b5e731650ed6faad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:39.684785 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4a9ec5fa-a712-41a7-b087-afe81a817bed tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] 10.222.0.52 "GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48" status: 200 len: 1509 microversion: 2.1 time: 0.259716 Sep 24 21:02:39.685474 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1775/3482] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:39 2022] GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48 => generated 1509 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:39.690789 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a579ae73-ad0e-4200-bcb4-b4e3d990314c tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:39.691425 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a579ae73-ad0e-4200-bcb4-b4e3d990314c tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] [instance: de4ec687-83cc-43ea-bed9-24ec92724907] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:39.697542 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a579ae73-ad0e-4200-bcb4-b4e3d990314c tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:39.698197 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a579ae73-ad0e-4200-bcb4-b4e3d990314c tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:39.699004 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a579ae73-ad0e-4200-bcb4-b4e3d990314c tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:39.699746 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a579ae73-ad0e-4200-bcb4-b4e3d990314c tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:39.700207 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a579ae73-ad0e-4200-bcb4-b4e3d990314c tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:39.700735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a579ae73-ad0e-4200-bcb4-b4e3d990314c tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:39.934417 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a579ae73-ad0e-4200-bcb4-b4e3d990314c tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c9d24e7a7a94cbd9f235519ac791361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af0aa4ac07b40baa00186abc14ee5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:39.942908 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a579ae73-ad0e-4200-bcb4-b4e3d990314c tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c9d24e7a7a94cbd9f235519ac791361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af0aa4ac07b40baa00186abc14ee5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:39.944446 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a579ae73-ad0e-4200-bcb4-b4e3d990314c tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c9d24e7a7a94cbd9f235519ac791361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af0aa4ac07b40baa00186abc14ee5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:39.945615 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a579ae73-ad0e-4200-bcb4-b4e3d990314c tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] 10.222.0.52 "GET /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907" status: 200 len: 1361 microversion: 2.26 time: 0.259212 Sep 24 21:02:39.946173 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1776/3483] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:02:39 2022] GET /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907 => generated 1361 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:02:39.951481 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c2219fdf-2c0b-46b8-bf8f-de525c4eea15 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:39.952109 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c2219fdf-2c0b-46b8-bf8f-de525c4eea15 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: e6c97c05-a30e-4c8b-b56c-0cdae10ff44c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:39.958192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2219fdf-2c0b-46b8-bf8f-de525c4eea15 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:39.958735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2219fdf-2c0b-46b8-bf8f-de525c4eea15 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:39.959192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2219fdf-2c0b-46b8-bf8f-de525c4eea15 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:39.959898 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2219fdf-2c0b-46b8-bf8f-de525c4eea15 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:39.960367 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2219fdf-2c0b-46b8-bf8f-de525c4eea15 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:39.960804 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2219fdf-2c0b-46b8-bf8f-de525c4eea15 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:40.189565 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c2219fdf-2c0b-46b8-bf8f-de525c4eea15 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:40.198416 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c2219fdf-2c0b-46b8-bf8f-de525c4eea15 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c" status: 200 len: 1513 microversion: 2.1 time: 0.250684 Sep 24 21:02:40.216008 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1777/3484] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:39 2022] GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c => generated 1513 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:40.221883 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bb525a09-d760-4745-82b1-5c34215cc237 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:40.222703 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-bb525a09-d760-4745-82b1-5c34215cc237 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] [instance: 0ab5c42f-da92-43e0-a5f0-c277854edc31] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:40.231627 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb525a09-d760-4745-82b1-5c34215cc237 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:40.232130 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb525a09-d760-4745-82b1-5c34215cc237 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:40.232574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb525a09-d760-4745-82b1-5c34215cc237 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:40.233296 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb525a09-d760-4745-82b1-5c34215cc237 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:40.233758 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb525a09-d760-4745-82b1-5c34215cc237 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:40.234192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb525a09-d760-4745-82b1-5c34215cc237 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:40.451326 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-bb525a09-d760-4745-82b1-5c34215cc237 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea166f15a894cd7b1cee6c5a749679c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3dbfe14ac3469286aa595d46c28f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:40.459795 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bb525a09-d760-4745-82b1-5c34215cc237 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] 10.222.0.52 "GET /compute/v2.1/servers/0ab5c42f-da92-43e0-a5f0-c277854edc31" status: 200 len: 1403 microversion: 2.1 time: 0.242135 Sep 24 21:02:40.460417 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1778/3485] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:40 2022] GET /compute/v2.1/servers/0ab5c42f-da92-43e0-a5f0-c277854edc31 => generated 1403 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:40.466074 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7136ac09-6f32-4d8e-93e8-2bdec04c2859 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:40.468413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7136ac09-6f32-4d8e-93e8-2bdec04c2859 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:40.474799 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7136ac09-6f32-4d8e-93e8-2bdec04c2859 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:40.475395 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7136ac09-6f32-4d8e-93e8-2bdec04c2859 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:40.475837 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7136ac09-6f32-4d8e-93e8-2bdec04c2859 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:40.476535 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7136ac09-6f32-4d8e-93e8-2bdec04c2859 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:40.476989 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7136ac09-6f32-4d8e-93e8-2bdec04c2859 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:40.477411 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7136ac09-6f32-4d8e-93e8-2bdec04c2859 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:40.508614 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:02:40.515831 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7136ac09-6f32-4d8e-93e8-2bdec04c2859 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.052863 Sep 24 21:02:40.515831 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1779/3486] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:02:40 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:02:40.520013 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4b7c138e-ff53-4f60-afec-31e9472dea71 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:40.520625 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4b7c138e-ff53-4f60-afec-31e9472dea71 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] [instance: 9b4c5a65-d9d6-47b2-b64e-9d048c544ec2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:40.528481 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4b7c138e-ff53-4f60-afec-31e9472dea71 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:40.528975 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4b7c138e-ff53-4f60-afec-31e9472dea71 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:40.529417 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4b7c138e-ff53-4f60-afec-31e9472dea71 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:40.530190 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4b7c138e-ff53-4f60-afec-31e9472dea71 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:40.531036 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4b7c138e-ff53-4f60-afec-31e9472dea71 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:40.531482 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4b7c138e-ff53-4f60-afec-31e9472dea71 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:40.752240 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4b7c138e-ff53-4f60-afec-31e9472dea71 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0815c3afecb4fd5b23a0ee395f7aa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea87ff9b7b54a44a806283f008bd3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:40.761883 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4b7c138e-ff53-4f60-afec-31e9472dea71 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] 10.222.0.52 "GET /compute/v2.1/servers/9b4c5a65-d9d6-47b2-b64e-9d048c544ec2" status: 200 len: 1323 microversion: 2.1 time: 0.245666 Sep 24 21:02:40.763697 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1780/3487] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:40 2022] GET /compute/v2.1/servers/9b4c5a65-d9d6-47b2-b64e-9d048c544ec2 => generated 1323 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:40.768846 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-d5eaefd1-8d59-40a6-9817-4a2a6d9da230 req-3a458ef1-5e6a-4d33-9170-f07c541ab612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de4ec687-83cc-43ea-bed9-24ec92724907", "name": "network-vif-plugged", "status": "completed", "tag": "b9922c9f-dd9d-4a56-8f56-8211e7c07c8a"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:02:40.780460 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d5eaefd1-8d59-40a6-9817-4a2a6d9da230 req-3a458ef1-5e6a-4d33-9170-f07c541ab612 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:40.781202 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d5eaefd1-8d59-40a6-9817-4a2a6d9da230 req-3a458ef1-5e6a-4d33-9170-f07c541ab612 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:40.782420 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d5eaefd1-8d59-40a6-9817-4a2a6d9da230 req-3a458ef1-5e6a-4d33-9170-f07c541ab612 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:40.798080 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-d5eaefd1-8d59-40a6-9817-4a2a6d9da230 req-3a458ef1-5e6a-4d33-9170-f07c541ab612 service nova] Creating event network-vif-plugged:b9922c9f-dd9d-4a56-8f56-8211e7c07c8a for instance de4ec687-83cc-43ea-bed9-24ec92724907 on nch2-master-1 Sep 24 21:02:40.804980 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-d5eaefd1-8d59-40a6-9817-4a2a6d9da230 req-3a458ef1-5e6a-4d33-9170-f07c541ab612 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039107 Sep 24 21:02:40.806105 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1781/3488] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:02:40.816907 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-94086449-368a-46be-80bc-4e43a15340fa tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:40.817790 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-94086449-368a-46be-80bc-4e43a15340fa tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:40.828604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-94086449-368a-46be-80bc-4e43a15340fa tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:40.829543 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-94086449-368a-46be-80bc-4e43a15340fa tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:40.830229 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-94086449-368a-46be-80bc-4e43a15340fa tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:40.831422 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-94086449-368a-46be-80bc-4e43a15340fa tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:40.832344 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-94086449-368a-46be-80bc-4e43a15340fa tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:40.832972 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-94086449-368a-46be-80bc-4e43a15340fa tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:41.417040 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-94086449-368a-46be-80bc-4e43a15340fa tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:41.428382 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-94086449-368a-46be-80bc-4e43a15340fa tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec" status: 200 len: 1314 microversion: 2.1 time: 0.619658 Sep 24 21:02:41.429360 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1782/3489] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:40 2022] GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec => generated 1314 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:41.435937 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b1945ae0-c361-4511-bc8c-1e4f41f69117 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:41.436555 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b1945ae0-c361-4511-bc8c-1e4f41f69117 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] [instance: de3e9921-d647-4ba4-97b4-bfa6edd98b48] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:41.443549 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1945ae0-c361-4511-bc8c-1e4f41f69117 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:41.444044 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1945ae0-c361-4511-bc8c-1e4f41f69117 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:41.444481 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1945ae0-c361-4511-bc8c-1e4f41f69117 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:41.445183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1945ae0-c361-4511-bc8c-1e4f41f69117 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:41.446096 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1945ae0-c361-4511-bc8c-1e4f41f69117 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:41.446096 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1945ae0-c361-4511-bc8c-1e4f41f69117 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:41.449735 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7cff9437-57fd-41c6-bb43-4ff10aae7086 tempest-FloatingIPDetailsTestJSON-2096053334 tempest-FloatingIPDetailsTestJSON-2096053334-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.950784 Sep 24 21:02:41.450568 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1708/3490] 10.222.0.52 () {60 vars in 1170 bytes} [Sat Sep 24 21:02:39 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1952 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:02:41.455376 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-44dd193b-09bf-4343-b2dc-85c880f94c91 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:41.456174 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-44dd193b-09bf-4343-b2dc-85c880f94c91 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] [instance: de4ec687-83cc-43ea-bed9-24ec92724907] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:41.472764 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-44dd193b-09bf-4343-b2dc-85c880f94c91 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:41.476425 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-44dd193b-09bf-4343-b2dc-85c880f94c91 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:41.476882 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-44dd193b-09bf-4343-b2dc-85c880f94c91 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:41.478489 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-44dd193b-09bf-4343-b2dc-85c880f94c91 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:41.479093 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-44dd193b-09bf-4343-b2dc-85c880f94c91 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:41.480067 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-44dd193b-09bf-4343-b2dc-85c880f94c91 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:42.019966 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b1945ae0-c361-4511-bc8c-1e4f41f69117 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70045b8fe87481b8fae4597b979b046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4ce6fc820e4fb5b5e731650ed6faad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:42.029423 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b1945ae0-c361-4511-bc8c-1e4f41f69117 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] 10.222.0.52 "GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48" status: 200 len: 1467 microversion: 2.1 time: 0.598917 Sep 24 21:02:42.036610 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1783/3491] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:41 2022] GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48 => generated 1467 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:42.041715 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-36aba2b1-72fc-4407-90a6-7daa4ad81501 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:42.042578 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-36aba2b1-72fc-4407-90a6-7daa4ad81501 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: e6c97c05-a30e-4c8b-b56c-0cdae10ff44c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:42.049931 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36aba2b1-72fc-4407-90a6-7daa4ad81501 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:42.050726 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36aba2b1-72fc-4407-90a6-7daa4ad81501 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:42.051028 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36aba2b1-72fc-4407-90a6-7daa4ad81501 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:42.051869 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36aba2b1-72fc-4407-90a6-7daa4ad81501 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:42.052700 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36aba2b1-72fc-4407-90a6-7daa4ad81501 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:42.052822 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36aba2b1-72fc-4407-90a6-7daa4ad81501 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:42.339356 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-44dd193b-09bf-4343-b2dc-85c880f94c91 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c9d24e7a7a94cbd9f235519ac791361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af0aa4ac07b40baa00186abc14ee5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:42.355990 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-44dd193b-09bf-4343-b2dc-85c880f94c91 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c9d24e7a7a94cbd9f235519ac791361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af0aa4ac07b40baa00186abc14ee5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:42.358593 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-44dd193b-09bf-4343-b2dc-85c880f94c91 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c9d24e7a7a94cbd9f235519ac791361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af0aa4ac07b40baa00186abc14ee5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:42.362474 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-44dd193b-09bf-4343-b2dc-85c880f94c91 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] 10.222.0.52 "GET /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907" status: 200 len: 1361 microversion: 2.26 time: 0.910691 Sep 24 21:02:42.365218 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1709/3492] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:02:41 2022] GET /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907 => generated 1361 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:02:42.366983 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-36aba2b1-72fc-4407-90a6-7daa4ad81501 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:42.375786 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-36aba2b1-72fc-4407-90a6-7daa4ad81501 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c" status: 200 len: 1513 microversion: 2.1 time: 0.344679 Sep 24 21:02:42.383752 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-40007f89-bc27-48b3-a0be-4a8ecf052f77 tempest-FloatingIPDetailsTestJSON-2096053334 tempest-FloatingIPDetailsTestJSON-2096053334-project] Calling method '.version_select at 0x7f4b0c895a60>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:42.384616 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1784/3493] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:42 2022] GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c => generated 1513 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:42.405693 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a4a89b47-d44d-4019-8808-e9f021a482de tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:42.406615 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a4a89b47-d44d-4019-8808-e9f021a482de tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] [instance: 0ab5c42f-da92-43e0-a5f0-c277854edc31] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:42.413512 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a4a89b47-d44d-4019-8808-e9f021a482de tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:42.414571 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a4a89b47-d44d-4019-8808-e9f021a482de tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:42.415313 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a4a89b47-d44d-4019-8808-e9f021a482de tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:42.417403 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a4a89b47-d44d-4019-8808-e9f021a482de tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:42.418380 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a4a89b47-d44d-4019-8808-e9f021a482de tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:42.419265 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a4a89b47-d44d-4019-8808-e9f021a482de tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:42.865008 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a4a89b47-d44d-4019-8808-e9f021a482de tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea166f15a894cd7b1cee6c5a749679c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3dbfe14ac3469286aa595d46c28f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:42.873010 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a4a89b47-d44d-4019-8808-e9f021a482de tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] 10.222.0.52 "GET /compute/v2.1/servers/0ab5c42f-da92-43e0-a5f0-c277854edc31" status: 200 len: 1403 microversion: 2.1 time: 0.487272 Sep 24 21:02:42.873835 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1785/3494] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:42 2022] GET /compute/v2.1/servers/0ab5c42f-da92-43e0-a5f0-c277854edc31 => generated 1403 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:42.878965 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-797b4985-c2c4-479d-b221-3f0c5e086417 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:42.881282 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-797b4985-c2c4-479d-b221-3f0c5e086417 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:42.888153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-797b4985-c2c4-479d-b221-3f0c5e086417 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:42.888985 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-797b4985-c2c4-479d-b221-3f0c5e086417 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:42.889675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-797b4985-c2c4-479d-b221-3f0c5e086417 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:42.890604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-797b4985-c2c4-479d-b221-3f0c5e086417 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:42.891206 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-797b4985-c2c4-479d-b221-3f0c5e086417 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:42.891516 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-797b4985-c2c4-479d-b221-3f0c5e086417 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:42.907484 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-40007f89-bc27-48b3-a0be-4a8ecf052f77 tempest-FloatingIPDetailsTestJSON-2096053334 tempest-FloatingIPDetailsTestJSON-2096053334-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips/765c5e4c-5b65-4966-ab8b-0bdaf581dc73" status: 200 len: 142 microversion: 2.1 time: 0.540809 Sep 24 21:02:42.915572 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1710/3495] 10.222.0.52 () {58 vars in 1260 bytes} [Sat Sep 24 21:02:42 2022] GET /compute/v2.1/os-floating-ips/765c5e4c-5b65-4966-ab8b-0bdaf581dc73 => generated 142 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:02:42.915572 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-78cc2832-ca96-4ca0-b2ec-39d90622bb6a req-510495f1-502d-441f-ad72-3f2e9c146764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de3e9921-d647-4ba4-97b4-bfa6edd98b48", "name": "network-vif-deleted", "tag": "d9c1e35c-2108-4ebd-a17b-474bfd75d345"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:02:42.940019 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-78cc2832-ca96-4ca0-b2ec-39d90622bb6a req-510495f1-502d-441f-ad72-3f2e9c146764 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:42.940605 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-78cc2832-ca96-4ca0-b2ec-39d90622bb6a req-510495f1-502d-441f-ad72-3f2e9c146764 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:42.941048 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-78cc2832-ca96-4ca0-b2ec-39d90622bb6a req-510495f1-502d-441f-ad72-3f2e9c146764 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:42.956902 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-78cc2832-ca96-4ca0-b2ec-39d90622bb6a req-510495f1-502d-441f-ad72-3f2e9c146764 service nova] Creating event network-vif-deleted:d9c1e35c-2108-4ebd-a17b-474bfd75d345 for instance de3e9921-d647-4ba4-97b4-bfa6edd98b48 on nch1-master-1 Sep 24 21:02:42.957158 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-797b4985-c2c4-479d-b221-3f0c5e086417 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.081667 Sep 24 21:02:42.957905 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1786/3496] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:02:42 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:02:42.962650 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-94285cc3-b5d1-4d07-851d-cb1a82025484 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:42.963621 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-94285cc3-b5d1-4d07-851d-cb1a82025484 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] [instance: 9b4c5a65-d9d6-47b2-b64e-9d048c544ec2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:42.966705 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-78cc2832-ca96-4ca0-b2ec-39d90622bb6a req-510495f1-502d-441f-ad72-3f2e9c146764 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056559 Sep 24 21:02:42.967316 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1711/3497] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:02:42.976419 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-94285cc3-b5d1-4d07-851d-cb1a82025484 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:42.976524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bf49abae-f08c-4eba-8369-9ea88741f7f0 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:42.977168 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bf49abae-f08c-4eba-8369-9ea88741f7f0 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:42.977507 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-94285cc3-b5d1-4d07-851d-cb1a82025484 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:42.978193 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-94285cc3-b5d1-4d07-851d-cb1a82025484 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:42.979172 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-94285cc3-b5d1-4d07-851d-cb1a82025484 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:42.988845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-94285cc3-b5d1-4d07-851d-cb1a82025484 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:42.990593 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf49abae-f08c-4eba-8369-9ea88741f7f0 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:42.992344 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf49abae-f08c-4eba-8369-9ea88741f7f0 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:42.993120 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf49abae-f08c-4eba-8369-9ea88741f7f0 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:42.993954 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-94285cc3-b5d1-4d07-851d-cb1a82025484 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:42.995369 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf49abae-f08c-4eba-8369-9ea88741f7f0 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:42.996611 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf49abae-f08c-4eba-8369-9ea88741f7f0 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:42.997271 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf49abae-f08c-4eba-8369-9ea88741f7f0 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:43.142729 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:02:43.169814 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=38 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:02:43.217136 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bf49abae-f08c-4eba-8369-9ea88741f7f0 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:43.220666 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-94285cc3-b5d1-4d07-851d-cb1a82025484 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0815c3afecb4fd5b23a0ee395f7aa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea87ff9b7b54a44a806283f008bd3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:43.227137 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bf49abae-f08c-4eba-8369-9ea88741f7f0 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec" status: 200 len: 1314 microversion: 2.1 time: 0.256648 Sep 24 21:02:43.227725 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1712/3498] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:42 2022] GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:43.228804 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-94285cc3-b5d1-4d07-851d-cb1a82025484 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] 10.222.0.52 "GET /compute/v2.1/servers/9b4c5a65-d9d6-47b2-b64e-9d048c544ec2" status: 200 len: 1323 microversion: 2.1 time: 0.269755 Sep 24 21:02:43.230184 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1787/3499] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:42 2022] GET /compute/v2.1/servers/9b4c5a65-d9d6-47b2-b64e-9d048c544ec2 => generated 1323 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:43.234987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d8cb3dcc-eef0-44f0-bac4-e3b1da05c5a2 tempest-FloatingIPDetailsTestJSON-2096053334 tempest-FloatingIPDetailsTestJSON-2096053334-project] Calling method '.version_select at 0x7f4b0c569160>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:43.249523 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-7f5b8bb3-db25-42bc-85c3-74ff76488d60 req-a1c5a4de-86d9-4bfb-bbf6-b8df3f64a6f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b4c5a65-d9d6-47b2-b64e-9d048c544ec2", "name": "network-vif-plugged", "status": "completed", "tag": "f9d18e66-7d10-4aa4-b762-8793427bfb44"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:02:43.261807 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-7f5b8bb3-db25-42bc-85c3-74ff76488d60 req-a1c5a4de-86d9-4bfb-bbf6-b8df3f64a6f9 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:43.262524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-7f5b8bb3-db25-42bc-85c3-74ff76488d60 req-a1c5a4de-86d9-4bfb-bbf6-b8df3f64a6f9 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:43.263167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-7f5b8bb3-db25-42bc-85c3-74ff76488d60 req-a1c5a4de-86d9-4bfb-bbf6-b8df3f64a6f9 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:43.292148 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-7f5b8bb3-db25-42bc-85c3-74ff76488d60 req-a1c5a4de-86d9-4bfb-bbf6-b8df3f64a6f9 service nova] Creating event network-vif-plugged:f9d18e66-7d10-4aa4-b762-8793427bfb44 for instance 9b4c5a65-d9d6-47b2-b64e-9d048c544ec2 on nch1-master-1 Sep 24 21:02:43.303002 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-7f5b8bb3-db25-42bc-85c3-74ff76488d60 req-a1c5a4de-86d9-4bfb-bbf6-b8df3f64a6f9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073790 Sep 24 21:02:43.304523 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1713/3500] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:02:43.310389 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-688d4081-d7a1-4667-b2ce-e0617e4d41e0 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:43.311143 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-688d4081-d7a1-4667-b2ce-e0617e4d41e0 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] [instance: de3e9921-d647-4ba4-97b4-bfa6edd98b48] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:43.317875 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-688d4081-d7a1-4667-b2ce-e0617e4d41e0 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:43.318374 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-688d4081-d7a1-4667-b2ce-e0617e4d41e0 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:43.318985 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-688d4081-d7a1-4667-b2ce-e0617e4d41e0 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:43.319705 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-688d4081-d7a1-4667-b2ce-e0617e4d41e0 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:43.320174 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-688d4081-d7a1-4667-b2ce-e0617e4d41e0 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:43.320809 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-688d4081-d7a1-4667-b2ce-e0617e4d41e0 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:43.337900 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-688d4081-d7a1-4667-b2ce-e0617e4d41e0 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] HTTP exception thrown: Instance de3e9921-d647-4ba4-97b4-bfa6edd98b48 could not be found. Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-688d4081-d7a1-4667-b2ce-e0617e4d41e0 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Request method failure captured: Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48 HTTP/1.1 Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3BBbkpSmuJnO5m45uTe8Om-aT7QrpN-p5GF0NfQkXu1_N1GYdZJnSlEEA8dUkyg4bitxQsArQToJNFpsKxRl0lOgMZZUtGl6J12kSPh-vJRQ4FJyaeq0tkMbhL8XutI1sq3v5APBpMpOxI-kcU2MsgyOuTBRDPl3PEAqya34XOWiDc Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: dd4ce6fc820e4fb5b5e731650ed6faad Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-InstanceActionsTestJSON-422605995 Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dd4ce6fc820e4fb5b5e731650ed6faad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dd4ce6fc820e4fb5b5e731650ed6faad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dd4ce6fc820e4fb5b5e731650ed6faad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dd4ce6fc820e4fb5b5e731650ed6faad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-InstanceActionsTestJSON-422605995 Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: dd4ce6fc820e4fb5b5e731650ed6faad Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-InstanceActionsTestJSON-422605995 Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-InstanceActionsTestJSON-422605995-project Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: c70045b8fe87481b8fae4597b979b046 Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-InstanceActionsTestJSON-422605995-project Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance de3e9921-d647-4ba4-97b4-bfa6edd98b48 could not be found. Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'de3e9921-d647-4ba4-97b4-bfa6edd98b48'} Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de3e9921-d647-4ba4-97b4-bfa6edd98b48 could not be found. Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de3e9921-d647-4ba4-97b4-bfa6edd98b48 could not be found. Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:43.340627 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:43.345699 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:43.345699 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:43.345699 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:43.345699 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:02:43.345699 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:02:43.345699 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de3e9921-d647-4ba4-97b4-bfa6edd98b48 could not be found. Sep 24 21:02:43.345699 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:43.345699 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-688d4081-d7a1-4667-b2ce-e0617e4d41e0 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] Returning 404 to user: Instance de3e9921-d647-4ba4-97b4-bfa6edd98b48 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:02:43.345699 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-688d4081-d7a1-4667-b2ce-e0617e4d41e0 tempest-InstanceActionsTestJSON-422605995 tempest-InstanceActionsTestJSON-422605995-project] 10.222.0.52 "GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48" status: 404 len: 111 microversion: 2.1 time: 0.038244 Sep 24 21:02:43.345699 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1714/3501] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:43 2022] GET /compute/v2.1/servers/de3e9921-d647-4ba4-97b4-bfa6edd98b48 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:02:43.392029 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2e95d833-e346-44fb-89bc-3186b31a39f4 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:43.392657 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2e95d833-e346-44fb-89bc-3186b31a39f4 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] [instance: de4ec687-83cc-43ea-bed9-24ec92724907] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:43.399668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2e95d833-e346-44fb-89bc-3186b31a39f4 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:43.400416 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2e95d833-e346-44fb-89bc-3186b31a39f4 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:43.401746 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2e95d833-e346-44fb-89bc-3186b31a39f4 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:43.402691 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2e95d833-e346-44fb-89bc-3186b31a39f4 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:43.405135 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2e95d833-e346-44fb-89bc-3186b31a39f4 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:43.405588 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2e95d833-e346-44fb-89bc-3186b31a39f4 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:43.705853 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2e95d833-e346-44fb-89bc-3186b31a39f4 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c9d24e7a7a94cbd9f235519ac791361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af0aa4ac07b40baa00186abc14ee5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:43.715733 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2e95d833-e346-44fb-89bc-3186b31a39f4 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c9d24e7a7a94cbd9f235519ac791361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af0aa4ac07b40baa00186abc14ee5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:43.717879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2e95d833-e346-44fb-89bc-3186b31a39f4 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c9d24e7a7a94cbd9f235519ac791361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af0aa4ac07b40baa00186abc14ee5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:43.722013 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2e95d833-e346-44fb-89bc-3186b31a39f4 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] 10.222.0.52 "GET /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907" status: 200 len: 1545 microversion: 2.26 time: 0.334065 Sep 24 21:02:43.735419 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1715/3502] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:02:43 2022] GET /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907 => generated 1545 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:02:43.750009 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-59f1ab7d-a162-424c-8944-f4b2e5d907ac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:43.750686 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-59f1ab7d-a162-424c-8944-f4b2e5d907ac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: e6c97c05-a30e-4c8b-b56c-0cdae10ff44c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:43.756992 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-59f1ab7d-a162-424c-8944-f4b2e5d907ac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:43.757814 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-59f1ab7d-a162-424c-8944-f4b2e5d907ac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:43.758268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-59f1ab7d-a162-424c-8944-f4b2e5d907ac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:43.760057 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-59f1ab7d-a162-424c-8944-f4b2e5d907ac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:43.761284 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-59f1ab7d-a162-424c-8944-f4b2e5d907ac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:43.762029 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-59f1ab7d-a162-424c-8944-f4b2e5d907ac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:44.001561 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-59f1ab7d-a162-424c-8944-f4b2e5d907ac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:44.009703 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-59f1ab7d-a162-424c-8944-f4b2e5d907ac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c" status: 200 len: 1513 microversion: 2.1 time: 0.272580 Sep 24 21:02:44.022950 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1716/3503] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:43 2022] GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c => generated 1513 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:44.031730 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-af2c874b-6134-43e6-b1b7-7767012895e2 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Calling method '.version_select at 0x7f4b07ed6550>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:44.044893 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af2c874b-6134-43e6-b1b7-7767012895e2 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:44.046311 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af2c874b-6134-43e6-b1b7-7767012895e2 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:44.046970 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af2c874b-6134-43e6-b1b7-7767012895e2 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:44.047724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-af2c874b-6134-43e6-b1b7-7767012895e2 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] [instance: de4ec687-83cc-43ea-bed9-24ec92724907] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:44.055202 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af2c874b-6134-43e6-b1b7-7767012895e2 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:44.056006 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af2c874b-6134-43e6-b1b7-7767012895e2 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:44.056613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af2c874b-6134-43e6-b1b7-7767012895e2 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:44.057557 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af2c874b-6134-43e6-b1b7-7767012895e2 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:44.058314 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af2c874b-6134-43e6-b1b7-7767012895e2 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:44.059554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af2c874b-6134-43e6-b1b7-7767012895e2 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:44.094618 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af2c874b-6134-43e6-b1b7-7767012895e2 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:44.095370 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af2c874b-6134-43e6-b1b7-7767012895e2 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:44.095979 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af2c874b-6134-43e6-b1b7-7767012895e2 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:44.111812 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af2c874b-6134-43e6-b1b7-7767012895e2 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:44.112575 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af2c874b-6134-43e6-b1b7-7767012895e2 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:44.113412 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af2c874b-6134-43e6-b1b7-7767012895e2 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:44.147832 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-af2c874b-6134-43e6-b1b7-7767012895e2 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lazy-loading 'flavor' on Instance uuid de4ec687-83cc-43ea-bed9-24ec92724907 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:02:44.206186 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-af2c874b-6134-43e6-b1b7-7767012895e2 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] 10.222.0.52 "PUT /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907/tags/tempest-tag-796626936" status: 201 len: 0 microversion: 2.26 time: 0.181989 Sep 24 21:02:44.211959 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1717/3504] 10.222.0.52 () {62 vars in 1377 bytes} [Sat Sep 24 21:02:44 2022] PUT /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907/tags/tempest-tag-796626936 => generated 0 bytes in 188 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 24 21:02:44.217519 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8849b4a4-d3ec-4334-a19d-4d06237105e9 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:44.218378 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8849b4a4-d3ec-4334-a19d-4d06237105e9 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] [instance: 0ab5c42f-da92-43e0-a5f0-c277854edc31] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:44.226278 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8849b4a4-d3ec-4334-a19d-4d06237105e9 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:44.227138 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8849b4a4-d3ec-4334-a19d-4d06237105e9 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:44.228107 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8849b4a4-d3ec-4334-a19d-4d06237105e9 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:44.229923 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8849b4a4-d3ec-4334-a19d-4d06237105e9 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:44.230647 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8849b4a4-d3ec-4334-a19d-4d06237105e9 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:44.231432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8849b4a4-d3ec-4334-a19d-4d06237105e9 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:44.360539 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d8cb3dcc-eef0-44f0-bac4-e3b1da05c5a2 tempest-FloatingIPDetailsTestJSON-2096053334 tempest-FloatingIPDetailsTestJSON-2096053334-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/765c5e4c-5b65-4966-ab8b-0bdaf581dc73" status: 202 len: 0 microversion: 2.1 time: 1.129040 Sep 24 21:02:44.361450 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1788/3505] 10.222.0.52 () {58 vars in 1263 bytes} [Sat Sep 24 21:02:43 2022] DELETE /compute/v2.1/os-floating-ips/765c5e4c-5b65-4966-ab8b-0bdaf581dc73 => generated 0 bytes in 1130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:02:44.366652 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-82fdbdf3-de86-42fa-9ac0-afe2a061d917 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:44.369153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-82fdbdf3-de86-42fa-9ac0-afe2a061d917 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:44.375888 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-82fdbdf3-de86-42fa-9ac0-afe2a061d917 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:44.376386 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-82fdbdf3-de86-42fa-9ac0-afe2a061d917 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:44.376837 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-82fdbdf3-de86-42fa-9ac0-afe2a061d917 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:44.377557 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-82fdbdf3-de86-42fa-9ac0-afe2a061d917 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:44.378021 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-82fdbdf3-de86-42fa-9ac0-afe2a061d917 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:44.378457 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-82fdbdf3-de86-42fa-9ac0-afe2a061d917 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:44.412762 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-82fdbdf3-de86-42fa-9ac0-afe2a061d917 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.050030 Sep 24 21:02:44.413783 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1789/3506] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:02:44 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:02:44.419806 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a7ba1b7a-8644-4727-b6dd-ca540fb9a87f tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Calling method '.version_select at 0x7f4b0c5fc430>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:44.427899 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8849b4a4-d3ec-4334-a19d-4d06237105e9 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea166f15a894cd7b1cee6c5a749679c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3dbfe14ac3469286aa595d46c28f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:44.429739 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a7ba1b7a-8644-4727-b6dd-ca540fb9a87f tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:44.430569 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a7ba1b7a-8644-4727-b6dd-ca540fb9a87f tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:44.431182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a7ba1b7a-8644-4727-b6dd-ca540fb9a87f tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:44.436921 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8849b4a4-d3ec-4334-a19d-4d06237105e9 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] 10.222.0.52 "GET /compute/v2.1/servers/0ab5c42f-da92-43e0-a5f0-c277854edc31" status: 200 len: 1403 microversion: 2.1 time: 0.223570 Sep 24 21:02:44.448874 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a7ba1b7a-8644-4727-b6dd-ca540fb9a87f tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] 10.222.0.52 "GET /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907/tags/tempest-tag-796626936" status: 204 len: 0 microversion: 2.26 time: 0.033826 Sep 24 21:02:44.449781 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1790/3507] 10.222.0.52 () {60 vars in 1358 bytes} [Sat Sep 24 21:02:44 2022] GET /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907/tags/tempest-tag-796626936 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 24 21:02:44.451611 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1718/3508] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:44 2022] GET /compute/v2.1/servers/0ab5c42f-da92-43e0-a5f0-c277854edc31 => generated 1403 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:44.454956 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b5b78132-ab24-45c7-94d4-4348cb962540 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:44.455851 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b5b78132-ab24-45c7-94d4-4348cb962540 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:44.458703 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-82374a40-06f6-4cd0-afd8-8386a73c25e2 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:44.459337 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-82374a40-06f6-4cd0-afd8-8386a73c25e2 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] [instance: 9b4c5a65-d9d6-47b2-b64e-9d048c544ec2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:44.464089 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5b78132-ab24-45c7-94d4-4348cb962540 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:44.464876 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5b78132-ab24-45c7-94d4-4348cb962540 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:44.465546 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5b78132-ab24-45c7-94d4-4348cb962540 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:44.466548 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5b78132-ab24-45c7-94d4-4348cb962540 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:44.467220 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82374a40-06f6-4cd0-afd8-8386a73c25e2 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:44.467453 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5b78132-ab24-45c7-94d4-4348cb962540 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:44.467715 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82374a40-06f6-4cd0-afd8-8386a73c25e2 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:44.468166 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82374a40-06f6-4cd0-afd8-8386a73c25e2 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:44.468846 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5b78132-ab24-45c7-94d4-4348cb962540 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:44.468962 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82374a40-06f6-4cd0-afd8-8386a73c25e2 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:44.469441 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82374a40-06f6-4cd0-afd8-8386a73c25e2 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:44.469730 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82374a40-06f6-4cd0-afd8-8386a73c25e2 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:44.670162 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b5b78132-ab24-45c7-94d4-4348cb962540 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:44.678075 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-82374a40-06f6-4cd0-afd8-8386a73c25e2 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0815c3afecb4fd5b23a0ee395f7aa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea87ff9b7b54a44a806283f008bd3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:44.689314 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b5b78132-ab24-45c7-94d4-4348cb962540 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec" status: 200 len: 1314 microversion: 2.1 time: 0.238174 Sep 24 21:02:44.689918 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1791/3509] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:44 2022] GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:44.693200 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-82374a40-06f6-4cd0-afd8-8386a73c25e2 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] 10.222.0.52 "GET /compute/v2.1/servers/9b4c5a65-d9d6-47b2-b64e-9d048c544ec2" status: 200 len: 1323 microversion: 2.1 time: 0.240262 Sep 24 21:02:44.693846 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1719/3510] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:44 2022] GET /compute/v2.1/servers/9b4c5a65-d9d6-47b2-b64e-9d048c544ec2 => generated 1323 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:44.703391 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f3d485b5-0944-4a60-95ac-8375403ee483 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Calling method '.version_select at 0x7f4b0c767e50>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:44.704619 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-30db6077-7180-4f9c-932c-79793642bfdf tempest-FloatingIPDetailsTestJSON-2096053334 tempest-FloatingIPDetailsTestJSON-2096053334-project] Calling method '.version_select at 0x7f4b0c61edc0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:44.725344 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3d485b5-0944-4a60-95ac-8375403ee483 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:44.725878 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3d485b5-0944-4a60-95ac-8375403ee483 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:44.726321 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3d485b5-0944-4a60-95ac-8375403ee483 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:44.727273 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f3d485b5-0944-4a60-95ac-8375403ee483 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] [instance: de4ec687-83cc-43ea-bed9-24ec92724907] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:44.739066 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3d485b5-0944-4a60-95ac-8375403ee483 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:44.739573 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3d485b5-0944-4a60-95ac-8375403ee483 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:44.740024 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3d485b5-0944-4a60-95ac-8375403ee483 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:44.740743 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3d485b5-0944-4a60-95ac-8375403ee483 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:44.741217 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3d485b5-0944-4a60-95ac-8375403ee483 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:44.741655 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3d485b5-0944-4a60-95ac-8375403ee483 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:44.758901 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:02:44.774390 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3d485b5-0944-4a60-95ac-8375403ee483 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:44.774924 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3d485b5-0944-4a60-95ac-8375403ee483 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:44.775378 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3d485b5-0944-4a60-95ac-8375403ee483 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:44.799520 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-f3d485b5-0944-4a60-95ac-8375403ee483 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lazy-loading 'flavor' on Instance uuid de4ec687-83cc-43ea-bed9-24ec92724907 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:02:44.818268 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f3d485b5-0944-4a60-95ac-8375403ee483 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] 10.222.0.52 "DELETE /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907/tags" status: 204 len: 0 microversion: 2.26 time: 0.123088 Sep 24 21:02:44.819474 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1720/3511] 10.222.0.52 () {60 vars in 1295 bytes} [Sat Sep 24 21:02:44 2022] DELETE /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907/tags => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 24 21:02:44.830456 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-97a70314-c5c5-4ff3-b42c-cced67b7bbc1 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Calling method '.version_select at 0x7f4b10f5a700>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:44.841310 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97a70314-c5c5-4ff3-b42c-cced67b7bbc1 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:44.843425 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97a70314-c5c5-4ff3-b42c-cced67b7bbc1 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:44.844058 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97a70314-c5c5-4ff3-b42c-cced67b7bbc1 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:44.854956 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-97a70314-c5c5-4ff3-b42c-cced67b7bbc1 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] 10.222.0.52 "GET /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907/tags" status: 200 len: 12 microversion: 2.26 time: 0.028812 Sep 24 21:02:44.856214 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1721/3512] 10.222.0.52 () {60 vars in 1292 bytes} [Sat Sep 24 21:02:44 2022] GET /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907/tags => generated 12 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:44.866675 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-af68ea40-0b40-48df-82f3-d111f4781dc2 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Calling method '.version_select at 0x7f4b1102fca0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:44.877621 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af68ea40-0b40-48df-82f3-d111f4781dc2 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:44.878625 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af68ea40-0b40-48df-82f3-d111f4781dc2 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:44.879969 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af68ea40-0b40-48df-82f3-d111f4781dc2 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:44.880662 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-af68ea40-0b40-48df-82f3-d111f4781dc2 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] [instance: de4ec687-83cc-43ea-bed9-24ec92724907] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:44.888216 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af68ea40-0b40-48df-82f3-d111f4781dc2 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:44.888721 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af68ea40-0b40-48df-82f3-d111f4781dc2 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:44.889169 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af68ea40-0b40-48df-82f3-d111f4781dc2 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:44.889887 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af68ea40-0b40-48df-82f3-d111f4781dc2 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:44.890806 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af68ea40-0b40-48df-82f3-d111f4781dc2 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:44.890806 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af68ea40-0b40-48df-82f3-d111f4781dc2 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:44.935003 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af68ea40-0b40-48df-82f3-d111f4781dc2 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:44.935779 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af68ea40-0b40-48df-82f3-d111f4781dc2 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:44.936465 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af68ea40-0b40-48df-82f3-d111f4781dc2 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:44.958052 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af68ea40-0b40-48df-82f3-d111f4781dc2 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:44.960996 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af68ea40-0b40-48df-82f3-d111f4781dc2 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:44.961396 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af68ea40-0b40-48df-82f3-d111f4781dc2 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:45.015905 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-af68ea40-0b40-48df-82f3-d111f4781dc2 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lazy-loading 'flavor' on Instance uuid de4ec687-83cc-43ea-bed9-24ec92724907 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:02:45.041211 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-af68ea40-0b40-48df-82f3-d111f4781dc2 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] 10.222.0.52 "PUT /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907/tags/tempest-tag-1361459264" status: 201 len: 0 microversion: 2.26 time: 0.178535 Sep 24 21:02:45.046818 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1722/3513] 10.222.0.52 () {62 vars in 1380 bytes} [Sat Sep 24 21:02:44 2022] PUT /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907/tags/tempest-tag-1361459264 => generated 0 bytes in 181 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Sep 24 21:02:45.051009 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0a35b103-8684-41e8-a623-7c2ab179e8a0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:45.054749 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0a35b103-8684-41e8-a623-7c2ab179e8a0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: e6c97c05-a30e-4c8b-b56c-0cdae10ff44c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:45.067638 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0a35b103-8684-41e8-a623-7c2ab179e8a0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:45.068175 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0a35b103-8684-41e8-a623-7c2ab179e8a0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:45.069812 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0a35b103-8684-41e8-a623-7c2ab179e8a0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:45.070408 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0a35b103-8684-41e8-a623-7c2ab179e8a0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:45.073663 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0a35b103-8684-41e8-a623-7c2ab179e8a0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:45.074249 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0a35b103-8684-41e8-a623-7c2ab179e8a0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:45.125030 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-30db6077-7180-4f9c-932c-79793642bfdf tempest-FloatingIPDetailsTestJSON-2096053334 tempest-FloatingIPDetailsTestJSON-2096053334-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.434030 Sep 24 21:02:45.126199 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1792/3514] 10.222.0.52 () {58 vars in 1164 bytes} [Sat Sep 24 21:02:44 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 21:02:45.136979 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-34c8e4cc-0976-4684-bac4-4b8249b79b09 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Calling method '.version_select at 0x7f4b0c582c10>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:45.145730 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34c8e4cc-0976-4684-bac4-4b8249b79b09 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:45.146289 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34c8e4cc-0976-4684-bac4-4b8249b79b09 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:45.146775 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34c8e4cc-0976-4684-bac4-4b8249b79b09 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:45.159559 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-34c8e4cc-0976-4684-bac4-4b8249b79b09 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] 10.222.0.52 "GET /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907/tags" status: 200 len: 36 microversion: 2.26 time: 0.031493 Sep 24 21:02:45.160512 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1793/3515] 10.222.0.52 () {60 vars in 1292 bytes} [Sat Sep 24 21:02:45 2022] GET /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907/tags => generated 36 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:45.171740 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-44c883e3-7cfd-42cd-8ce8-92b433857876 tempest-FloatingIPDetailsTestJSON-2096053334 tempest-FloatingIPDetailsTestJSON-2096053334-project] Calling method '.version_select at 0x7f4b0c8204c0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:45.484804 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0a35b103-8684-41e8-a623-7c2ab179e8a0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:45.492894 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0a35b103-8684-41e8-a623-7c2ab179e8a0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c" status: 200 len: 1513 microversion: 2.1 time: 0.449021 Sep 24 21:02:45.493513 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1723/3516] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:45 2022] GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c => generated 1513 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:45.505101 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5c5e66c0-c8b9-49cf-9874-7ee82a30be99 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Calling method '.version_select at 0x7f4b10f9e1f0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:45.517014 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c5e66c0-c8b9-49cf-9874-7ee82a30be99 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:45.517755 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c5e66c0-c8b9-49cf-9874-7ee82a30be99 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:45.518395 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c5e66c0-c8b9-49cf-9874-7ee82a30be99 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:45.519066 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5c5e66c0-c8b9-49cf-9874-7ee82a30be99 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] [instance: de4ec687-83cc-43ea-bed9-24ec92724907] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:45.525236 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c5e66c0-c8b9-49cf-9874-7ee82a30be99 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:45.527061 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c5e66c0-c8b9-49cf-9874-7ee82a30be99 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:45.528265 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c5e66c0-c8b9-49cf-9874-7ee82a30be99 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:45.530537 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c5e66c0-c8b9-49cf-9874-7ee82a30be99 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:45.531192 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c5e66c0-c8b9-49cf-9874-7ee82a30be99 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:45.531789 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c5e66c0-c8b9-49cf-9874-7ee82a30be99 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:45.583183 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-44c883e3-7cfd-42cd-8ce8-92b433857876 tempest-FloatingIPDetailsTestJSON-2096053334 tempest-FloatingIPDetailsTestJSON-2096053334-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 0.421311 Sep 24 21:02:45.583948 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c5e66c0-c8b9-49cf-9874-7ee82a30be99 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:45.585137 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1794/3517] 10.222.0.52 () {58 vars in 1149 bytes} [Sat Sep 24 21:02:45 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:02:45.590974 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-ecbe480b-341a-428e-bfd9-792ec82ca16d req-e9c8400d-75b1-46e3-83fb-71e8b1d78edc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ab5c42f-da92-43e0-a5f0-c277854edc31", "name": "network-vif-plugged", "status": "completed", "tag": "9ae08dc8-d176-4e64-8af4-718d5d9d5b5c"}, {"server_uuid": "2274cc1a-6e7c-4ea0-a28b-c5f642a734ec", "name": "network-vif-plugged", "status": "completed", "tag": "cfefa178-619d-499d-9daa-31b41a795d02"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:02:45.591854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c5e66c0-c8b9-49cf-9874-7ee82a30be99 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:45.593661 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c5e66c0-c8b9-49cf-9874-7ee82a30be99 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:45.609830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-ecbe480b-341a-428e-bfd9-792ec82ca16d req-e9c8400d-75b1-46e3-83fb-71e8b1d78edc service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:45.610662 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-ecbe480b-341a-428e-bfd9-792ec82ca16d req-e9c8400d-75b1-46e3-83fb-71e8b1d78edc service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:45.611319 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-ecbe480b-341a-428e-bfd9-792ec82ca16d req-e9c8400d-75b1-46e3-83fb-71e8b1d78edc service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:45.631402 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-ecbe480b-341a-428e-bfd9-792ec82ca16d req-e9c8400d-75b1-46e3-83fb-71e8b1d78edc service nova] Creating event network-vif-plugged:9ae08dc8-d176-4e64-8af4-718d5d9d5b5c for instance 0ab5c42f-da92-43e0-a5f0-c277854edc31 on nch2-master-1 Sep 24 21:02:45.632494 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-ecbe480b-341a-428e-bfd9-792ec82ca16d req-e9c8400d-75b1-46e3-83fb-71e8b1d78edc service nova] Creating event network-vif-plugged:cfefa178-619d-499d-9daa-31b41a795d02 for instance 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec on nch1-master-1 Sep 24 21:02:45.643991 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-ecbe480b-341a-428e-bfd9-792ec82ca16d req-e9c8400d-75b1-46e3-83fb-71e8b1d78edc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.056897 Sep 24 21:02:45.645334 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1795/3518] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:02:45.651931 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8ab2efde-9083-4fcc-b9ef-981781b07258 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:45.653773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-5c5e66c0-c8b9-49cf-9874-7ee82a30be99 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lazy-loading 'flavor' on Instance uuid de4ec687-83cc-43ea-bed9-24ec92724907 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:02:45.654378 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8ab2efde-9083-4fcc-b9ef-981781b07258 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:45.664100 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8ab2efde-9083-4fcc-b9ef-981781b07258 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:45.664846 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8ab2efde-9083-4fcc-b9ef-981781b07258 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:45.665470 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8ab2efde-9083-4fcc-b9ef-981781b07258 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:45.666981 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8ab2efde-9083-4fcc-b9ef-981781b07258 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:45.667610 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8ab2efde-9083-4fcc-b9ef-981781b07258 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:45.668212 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8ab2efde-9083-4fcc-b9ef-981781b07258 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:45.688468 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5c5e66c0-c8b9-49cf-9874-7ee82a30be99 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] 10.222.0.52 "DELETE /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907/tags/tempest-tag-1361459264" status: 204 len: 0 microversion: 2.26 time: 0.193855 Sep 24 21:02:45.689779 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1724/3519] 10.222.0.52 () {60 vars in 1364 bytes} [Sat Sep 24 21:02:45 2022] DELETE /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907/tags/tempest-tag-1361459264 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 24 21:02:45.696614 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-719f633d-724d-414d-b49d-f744f0bea7b5 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:45.702053 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-719f633d-724d-414d-b49d-f744f0bea7b5 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] [instance: 0ab5c42f-da92-43e0-a5f0-c277854edc31] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:45.713246 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8ab2efde-9083-4fcc-b9ef-981781b07258 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.066341 Sep 24 21:02:45.714545 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1796/3520] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:02:45 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:02:45.715671 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-719f633d-724d-414d-b49d-f744f0bea7b5 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:45.718415 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-719f633d-724d-414d-b49d-f744f0bea7b5 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:45.719043 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-719f633d-724d-414d-b49d-f744f0bea7b5 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:45.722319 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-719f633d-724d-414d-b49d-f744f0bea7b5 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:45.722471 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5bf1a44a-b41a-4711-bfe8-9855523dc95b tempest-FloatingIPDetailsTestJSON-2096053334 tempest-FloatingIPDetailsTestJSON-2096053334-project] Calling method '.version_select at 0x7f4b0c50c0d0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:45.723052 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-719f633d-724d-414d-b49d-f744f0bea7b5 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:45.726006 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-719f633d-724d-414d-b49d-f744f0bea7b5 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:46.156178 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-719f633d-724d-414d-b49d-f744f0bea7b5 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea166f15a894cd7b1cee6c5a749679c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3dbfe14ac3469286aa595d46c28f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:46.164273 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-719f633d-724d-414d-b49d-f744f0bea7b5 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] 10.222.0.52 "GET /compute/v2.1/servers/0ab5c42f-da92-43e0-a5f0-c277854edc31" status: 200 len: 1403 microversion: 2.1 time: 0.473104 Sep 24 21:02:46.165054 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1725/3521] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:45 2022] GET /compute/v2.1/servers/0ab5c42f-da92-43e0-a5f0-c277854edc31 => generated 1403 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:46.170003 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f9ca069f-6ac8-4dba-9b75-e62fa2f64a57 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Calling method '.version_select at 0x7f4b10f5aee0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:46.177581 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f9ca069f-6ac8-4dba-9b75-e62fa2f64a57 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:46.178077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f9ca069f-6ac8-4dba-9b75-e62fa2f64a57 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:46.178540 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f9ca069f-6ac8-4dba-9b75-e62fa2f64a57 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:46.189197 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f9ca069f-6ac8-4dba-9b75-e62fa2f64a57 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] 10.222.0.52 "GET /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907/tags" status: 200 len: 12 microversion: 2.26 time: 0.023199 Sep 24 21:02:46.195093 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1726/3522] 10.222.0.52 () {60 vars in 1292 bytes} [Sat Sep 24 21:02:46 2022] GET /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907/tags => generated 12 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:46.200848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-86ee3326-9b77-46d0-bc1f-367772a317a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:46.201483 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-86ee3326-9b77-46d0-bc1f-367772a317a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:46.208692 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-86ee3326-9b77-46d0-bc1f-367772a317a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:46.209357 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-86ee3326-9b77-46d0-bc1f-367772a317a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:46.210066 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-86ee3326-9b77-46d0-bc1f-367772a317a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:46.210749 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-86ee3326-9b77-46d0-bc1f-367772a317a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:46.217656 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-86ee3326-9b77-46d0-bc1f-367772a317a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:46.218181 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-86ee3326-9b77-46d0-bc1f-367772a317a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:46.508654 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-86ee3326-9b77-46d0-bc1f-367772a317a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:46.518959 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-86ee3326-9b77-46d0-bc1f-367772a317a9 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec" status: 200 len: 1314 microversion: 2.1 time: 0.322080 Sep 24 21:02:46.519562 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1727/3523] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:46 2022] GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:46.524662 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-300db1d4-0df7-42b4-b851-8c0841efafb6 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:46.525351 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-300db1d4-0df7-42b4-b851-8c0841efafb6 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] [instance: 9b4c5a65-d9d6-47b2-b64e-9d048c544ec2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:46.533685 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-300db1d4-0df7-42b4-b851-8c0841efafb6 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:46.534532 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-300db1d4-0df7-42b4-b851-8c0841efafb6 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:46.535165 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-300db1d4-0df7-42b4-b851-8c0841efafb6 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:46.535885 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-300db1d4-0df7-42b4-b851-8c0841efafb6 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:46.536424 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-300db1d4-0df7-42b4-b851-8c0841efafb6 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:46.536856 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-300db1d4-0df7-42b4-b851-8c0841efafb6 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:47.085295 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-300db1d4-0df7-42b4-b851-8c0841efafb6 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0815c3afecb4fd5b23a0ee395f7aa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea87ff9b7b54a44a806283f008bd3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:47.095230 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-300db1d4-0df7-42b4-b851-8c0841efafb6 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] 10.222.0.52 "GET /compute/v2.1/servers/9b4c5a65-d9d6-47b2-b64e-9d048c544ec2" status: 200 len: 1520 microversion: 2.1 time: 0.574304 Sep 24 21:02:47.096397 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1728/3524] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:46 2022] GET /compute/v2.1/servers/9b4c5a65-d9d6-47b2-b64e-9d048c544ec2 => generated 1520 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:47.107431 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fa6dabd2-bf7a-4218-b37b-e20ac9d23dc4 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Calling method '.version_select at 0x7f4b0c114b80>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:47.119238 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa6dabd2-bf7a-4218-b37b-e20ac9d23dc4 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:47.120532 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa6dabd2-bf7a-4218-b37b-e20ac9d23dc4 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:47.121237 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa6dabd2-bf7a-4218-b37b-e20ac9d23dc4 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:47.122152 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fa6dabd2-bf7a-4218-b37b-e20ac9d23dc4 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] [instance: de4ec687-83cc-43ea-bed9-24ec92724907] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:47.130445 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa6dabd2-bf7a-4218-b37b-e20ac9d23dc4 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:47.131097 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa6dabd2-bf7a-4218-b37b-e20ac9d23dc4 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:47.132416 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa6dabd2-bf7a-4218-b37b-e20ac9d23dc4 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:47.133742 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa6dabd2-bf7a-4218-b37b-e20ac9d23dc4 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:47.134314 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa6dabd2-bf7a-4218-b37b-e20ac9d23dc4 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:47.134967 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa6dabd2-bf7a-4218-b37b-e20ac9d23dc4 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:47.163684 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa6dabd2-bf7a-4218-b37b-e20ac9d23dc4 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:47.164279 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa6dabd2-bf7a-4218-b37b-e20ac9d23dc4 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:47.164936 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa6dabd2-bf7a-4218-b37b-e20ac9d23dc4 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:47.177453 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-fa6dabd2-bf7a-4218-b37b-e20ac9d23dc4 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lazy-loading 'flavor' on Instance uuid de4ec687-83cc-43ea-bed9-24ec92724907 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:02:47.194472 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fa6dabd2-bf7a-4218-b37b-e20ac9d23dc4 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] 10.222.0.52 "DELETE /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907/tags" status: 204 len: 0 microversion: 2.26 time: 0.092592 Sep 24 21:02:47.199485 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1729/3525] 10.222.0.52 () {60 vars in 1295 bytes} [Sat Sep 24 21:02:47 2022] DELETE /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907/tags => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 24 21:02:47.201204 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fd111aab-bb51-4e51-a899-d1694e655a85 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:47.201914 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fd111aab-bb51-4e51-a899-d1694e655a85 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: e6c97c05-a30e-4c8b-b56c-0cdae10ff44c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:47.222727 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd111aab-bb51-4e51-a899-d1694e655a85 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:47.223147 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd111aab-bb51-4e51-a899-d1694e655a85 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:47.223601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd111aab-bb51-4e51-a899-d1694e655a85 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:47.224470 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd111aab-bb51-4e51-a899-d1694e655a85 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:47.224936 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd111aab-bb51-4e51-a899-d1694e655a85 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:47.225448 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd111aab-bb51-4e51-a899-d1694e655a85 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:47.588829 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fd111aab-bb51-4e51-a899-d1694e655a85 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:47.593102 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5bf1a44a-b41a-4711-bfe8-9855523dc95b tempest-FloatingIPDetailsTestJSON-2096053334 tempest-FloatingIPDetailsTestJSON-2096053334-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/5cc1aeab-f74e-4638-8864-a916019495c1" status: 202 len: 0 microversion: 2.1 time: 1.877203 Sep 24 21:02:47.593689 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1797/3526] 10.222.0.52 () {58 vars in 1263 bytes} [Sat Sep 24 21:02:45 2022] DELETE /compute/v2.1/os-floating-ips/5cc1aeab-f74e-4638-8864-a916019495c1 => generated 0 bytes in 1878 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:02:47.600532 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fd111aab-bb51-4e51-a899-d1694e655a85 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c" status: 200 len: 1513 microversion: 2.1 time: 0.404178 Sep 24 21:02:47.600826 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c419e2fa-b98b-4c7c-aacc-da268f45982b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:47.603749 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c419e2fa-b98b-4c7c-aacc-da268f45982b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:47.619970 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1730/3527] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:47 2022] GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c => generated 1513 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:47.621327 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c419e2fa-b98b-4c7c-aacc-da268f45982b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:47.621945 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c419e2fa-b98b-4c7c-aacc-da268f45982b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:47.622470 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c419e2fa-b98b-4c7c-aacc-da268f45982b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:47.624515 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c419e2fa-b98b-4c7c-aacc-da268f45982b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:47.625080 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c419e2fa-b98b-4c7c-aacc-da268f45982b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:47.625779 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c419e2fa-b98b-4c7c-aacc-da268f45982b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:47.641436 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c5636764-f023-4b78-9dab-82d46afc13c2 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-595731736", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "7b5a8b36-d7ee-411d-a423-fe2d46afa3ec"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c5636764-f023-4b78-9dab-82d46afc13c2 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Request method failure captured: Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 242 Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3BcAXO6-IxcZ0MYeGyT72JPYNqI4IAnjQTz_t0NH1ytLj7857qvVlWD8sI26ex6CJDngsMF20bDZJDm0aCsucAACh_vgzT61-tfgSDWANfO0VPGX9i2uJzvvZ68GTGN1KO7uVzfcUXYPJ9Z8JGWubwIY151JosfATxcDAlgWLHDz2g Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 2ea87ff9b7b54a44a806283f008bd3d1 Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1928850691 Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ea87ff9b7b54a44a806283f008bd3d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2ea87ff9b7b54a44a806283f008bd3d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2ea87ff9b7b54a44a806283f008bd3d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ea87ff9b7b54a44a806283f008bd3d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1928850691 Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 2ea87ff9b7b54a44a806283f008bd3d1 Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1928850691 Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServerMetadataNegativeTestJSON-1928850691-project Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: a0815c3afecb4fd5b23a0ee395f7aa5e Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1928850691-project Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-595731736", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "7b5a8b36-d7ee-411d-a423-fe2d46afa3ec"}]}} Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-595731736', 'imageRef': '4c30e8e9-8fb2-4377-83f1-98322cb17799', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '7b5a8b36-d7ee-411d-a423-fe2d46afa3ec'}]}}} Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise error Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi {'': 'data1'} Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:02:47.663770 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:02:47.675097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:02:47.675097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 21:02:47.675097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 21:02:47.675097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 21:02:47.675097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 21:02:47.675097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 21:02:47.675097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 21:02:47.675097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 24 21:02:47.675097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:47.675097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:47.675097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:47.675097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:47.675097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:47.675097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:47.675097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 21:02:47.675097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 21:02:47.675097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 24 21:02:47.675097 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:47.675097 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c5636764-f023-4b78-9dab-82d46afc13c2 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:02:47.675097 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c5636764-f023-4b78-9dab-82d46afc13c2 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.042636 Sep 24 21:02:47.675097 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1731/3528] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:02:47 2022] POST /compute/v2.1/servers => generated 175 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:02:47.677714 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6f17af9b-a933-4a06-a647-056c8be4cf44 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:47.677714 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6f17af9b-a933-4a06-a647-056c8be4cf44 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] [instance: 0ab5c42f-da92-43e0-a5f0-c277854edc31] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:47.694750 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f17af9b-a933-4a06-a647-056c8be4cf44 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:47.695367 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f17af9b-a933-4a06-a647-056c8be4cf44 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:47.695917 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f17af9b-a933-4a06-a647-056c8be4cf44 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:47.696771 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f17af9b-a933-4a06-a647-056c8be4cf44 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:47.697317 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f17af9b-a933-4a06-a647-056c8be4cf44 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:47.697919 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f17af9b-a933-4a06-a647-056c8be4cf44 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:47.699624 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c419e2fa-b98b-4c7c-aacc-da268f45982b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.104613 Sep 24 21:02:47.700534 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1798/3529] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:02:47 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:02:47.705724 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c76dcc2f-628b-4051-bca9-ad21cbcab160 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Calling method '.version_select at 0x7f4b0c7f6c10>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:47.718368 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c76dcc2f-628b-4051-bca9-ad21cbcab160 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:47.718993 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c76dcc2f-628b-4051-bca9-ad21cbcab160 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:47.719446 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c76dcc2f-628b-4051-bca9-ad21cbcab160 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:47.719940 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c76dcc2f-628b-4051-bca9-ad21cbcab160 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] [instance: de4ec687-83cc-43ea-bed9-24ec92724907] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:47.726330 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c76dcc2f-628b-4051-bca9-ad21cbcab160 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:47.726902 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c76dcc2f-628b-4051-bca9-ad21cbcab160 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:47.727336 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c76dcc2f-628b-4051-bca9-ad21cbcab160 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:47.728695 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c76dcc2f-628b-4051-bca9-ad21cbcab160 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:47.729856 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c76dcc2f-628b-4051-bca9-ad21cbcab160 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:47.730997 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c76dcc2f-628b-4051-bca9-ad21cbcab160 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:47.766307 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c76dcc2f-628b-4051-bca9-ad21cbcab160 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:47.766307 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c76dcc2f-628b-4051-bca9-ad21cbcab160 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:47.766307 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c76dcc2f-628b-4051-bca9-ad21cbcab160 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:47.781555 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c76dcc2f-628b-4051-bca9-ad21cbcab160 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:47.782290 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c76dcc2f-628b-4051-bca9-ad21cbcab160 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:47.783619 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c76dcc2f-628b-4051-bca9-ad21cbcab160 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:47.815813 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-c76dcc2f-628b-4051-bca9-ad21cbcab160 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lazy-loading 'flavor' on Instance uuid de4ec687-83cc-43ea-bed9-24ec92724907 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:02:47.836119 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c76dcc2f-628b-4051-bca9-ad21cbcab160 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] 10.222.0.52 "PUT /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907/tags/tempest-tag-1894053471" status: 201 len: 0 microversion: 2.26 time: 0.133830 Sep 24 21:02:47.836796 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1799/3530] 10.222.0.52 () {62 vars in 1380 bytes} [Sat Sep 24 21:02:47 2022] PUT /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907/tags/tempest-tag-1894053471 => generated 0 bytes in 136 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 24 21:02:47.841557 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6f7f8207-cf32-4786-b3ef-096acde4345c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:47.842597 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6f7f8207-cf32-4786-b3ef-096acde4345c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:47.850037 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f7f8207-cf32-4786-b3ef-096acde4345c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:47.850816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f7f8207-cf32-4786-b3ef-096acde4345c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:47.851333 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f7f8207-cf32-4786-b3ef-096acde4345c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:47.852116 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f7f8207-cf32-4786-b3ef-096acde4345c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:47.852785 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f7f8207-cf32-4786-b3ef-096acde4345c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:47.853314 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f7f8207-cf32-4786-b3ef-096acde4345c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:47.891701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6f17af9b-a933-4a06-a647-056c8be4cf44 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea166f15a894cd7b1cee6c5a749679c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3dbfe14ac3469286aa595d46c28f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:47.903342 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6f17af9b-a933-4a06-a647-056c8be4cf44 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] 10.222.0.52 "GET /compute/v2.1/servers/0ab5c42f-da92-43e0-a5f0-c277854edc31" status: 200 len: 1590 microversion: 2.1 time: 0.234360 Sep 24 21:02:47.904041 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1732/3531] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:47 2022] GET /compute/v2.1/servers/0ab5c42f-da92-43e0-a5f0-c277854edc31 => generated 1590 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:47.909333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e9b6cc79-1534-476f-bd8c-d79a040f3fee tempest-FloatingIPDetailsTestJSON-2096053334 tempest-FloatingIPDetailsTestJSON-2096053334-project] Calling method '.version_select at 0x7f4b0c1143a0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:48.105676 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6f7f8207-cf32-4786-b3ef-096acde4345c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:48.114933 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6f7f8207-cf32-4786-b3ef-096acde4345c tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec" status: 200 len: 1501 microversion: 2.1 time: 0.276958 Sep 24 21:02:48.126256 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1800/3532] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:47 2022] GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec => generated 1501 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:48.126256 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fd477d4f-a43c-4203-802f-e91ef35f6b80 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:48.126256 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fd477d4f-a43c-4203-802f-e91ef35f6b80 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] [instance: ed699994-474d-4f75-8312-999d3b494379] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:48.136082 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-fd477d4f-a43c-4203-802f-e91ef35f6b80 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] HTTP exception thrown: Instance ed699994-474d-4f75-8312-999d3b494379 could not be found. Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fd477d4f-a43c-4203-802f-e91ef35f6b80 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Request method failure captured: Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/ed699994-474d-4f75-8312-999d3b494379/metadata HTTP/1.1 Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3BcAXO6-IxcZ0MYeGyT72JPYNqI4IAnjQTz_t0NH1ytLj7857qvVlWD8sI26ex6CJDngsMF20bDZJDm0aCsucAACh_vgzT61-tfgSDWANfO0VPGX9i2uJzvvZ68GTGN1KO7uVzfcUXYPJ9Z8JGWubwIY151JosfATxcDAlgWLHDz2g Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 2ea87ff9b7b54a44a806283f008bd3d1 Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1928850691 Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ea87ff9b7b54a44a806283f008bd3d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2ea87ff9b7b54a44a806283f008bd3d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2ea87ff9b7b54a44a806283f008bd3d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ea87ff9b7b54a44a806283f008bd3d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1928850691 Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 2ea87ff9b7b54a44a806283f008bd3d1 Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1928850691 Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServerMetadataNegativeTestJSON-1928850691-project Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: a0815c3afecb4fd5b23a0ee395f7aa5e Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1928850691-project Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance ed699994-474d-4f75-8312-999d3b494379 could not be found. Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'server_id': 'ed699994-474d-4f75-8312-999d3b494379'} Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed699994-474d-4f75-8312-999d3b494379 could not be found. Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed699994-474d-4f75-8312-999d3b494379 could not be found. Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:48.163386 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:48.169718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:02:48.169718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:02:48.169718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed699994-474d-4f75-8312-999d3b494379 could not be found. Sep 24 21:02:48.169718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:48.169718 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fd477d4f-a43c-4203-802f-e91ef35f6b80 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Returning 404 to user: Instance ed699994-474d-4f75-8312-999d3b494379 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:02:48.169718 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fd477d4f-a43c-4203-802f-e91ef35f6b80 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] 10.222.0.52 "GET /compute/v2.1/servers/ed699994-474d-4f75-8312-999d3b494379/metadata" status: 404 len: 111 microversion: 2.1 time: 0.048535 Sep 24 21:02:48.169718 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1801/3533] 10.222.0.52 () {58 vars in 1263 bytes} [Sat Sep 24 21:02:48 2022] GET /compute/v2.1/servers/ed699994-474d-4f75-8312-999d3b494379/metadata => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:02:48.190304 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f5506c35-03ca-457a-84fe-0956d0857141 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Calling method '.version_select at 0x7f4b0c820040>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:48.215806 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f5506c35-03ca-457a-84fe-0956d0857141 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:48.216475 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f5506c35-03ca-457a-84fe-0956d0857141 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:48.217022 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f5506c35-03ca-457a-84fe-0956d0857141 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:48.217631 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f5506c35-03ca-457a-84fe-0956d0857141 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] [instance: de4ec687-83cc-43ea-bed9-24ec92724907] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:48.224042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f5506c35-03ca-457a-84fe-0956d0857141 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:48.224670 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f5506c35-03ca-457a-84fe-0956d0857141 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:48.225211 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f5506c35-03ca-457a-84fe-0956d0857141 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:48.226080 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f5506c35-03ca-457a-84fe-0956d0857141 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:48.226704 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f5506c35-03ca-457a-84fe-0956d0857141 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:48.227237 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f5506c35-03ca-457a-84fe-0956d0857141 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:48.232449 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:02:48.257628 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f5506c35-03ca-457a-84fe-0956d0857141 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:48.258374 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f5506c35-03ca-457a-84fe-0956d0857141 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:48.259066 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f5506c35-03ca-457a-84fe-0956d0857141 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:48.275273 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f5506c35-03ca-457a-84fe-0956d0857141 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:48.276458 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f5506c35-03ca-457a-84fe-0956d0857141 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:48.277177 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f5506c35-03ca-457a-84fe-0956d0857141 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:48.320920 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-f5506c35-03ca-457a-84fe-0956d0857141 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lazy-loading 'flavor' on Instance uuid de4ec687-83cc-43ea-bed9-24ec92724907 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:02:48.348687 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f5506c35-03ca-457a-84fe-0956d0857141 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] 10.222.0.52 "PUT /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907/tags/tempest-tag-1500368657" status: 201 len: 0 microversion: 2.26 time: 0.168594 Sep 24 21:02:48.354607 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1802/3534] 10.222.0.52 () {62 vars in 1380 bytes} [Sat Sep 24 21:02:48 2022] PUT /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907/tags/tempest-tag-1500368657 => generated 0 bytes in 188 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 24 21:02:48.360587 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d80da7b0-c937-4e9f-9d11-9cbfc19201fc tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:48.361178 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d80da7b0-c937-4e9f-9d11-9cbfc19201fc tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] [instance: 0ab5c42f-da92-43e0-a5f0-c277854edc31] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:48.368042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d80da7b0-c937-4e9f-9d11-9cbfc19201fc tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:48.368643 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d80da7b0-c937-4e9f-9d11-9cbfc19201fc tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:48.369413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d80da7b0-c937-4e9f-9d11-9cbfc19201fc tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:48.370721 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d80da7b0-c937-4e9f-9d11-9cbfc19201fc tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:48.371598 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d80da7b0-c937-4e9f-9d11-9cbfc19201fc tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:48.372328 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d80da7b0-c937-4e9f-9d11-9cbfc19201fc tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:48.504997 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d80da7b0-c937-4e9f-9d11-9cbfc19201fc tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] 10.222.0.52 "GET /compute/v2.1/servers/0ab5c42f-da92-43e0-a5f0-c277854edc31/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.148087 Sep 24 21:02:48.506947 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1803/3535] 10.222.0.52 () {58 vars in 1275 bytes} [Sat Sep 24 21:02:48 2022] GET /compute/v2.1/servers/0ab5c42f-da92-43e0-a5f0-c277854edc31/os-interface => generated 285 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:02:48.511973 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9d46c10b-9ebd-4198-84c9-a56fc8a63df1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:02:48.512529 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9d46c10b-9ebd-4198-84c9-a56fc8a63df1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:48.519295 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d46c10b-9ebd-4198-84c9-a56fc8a63df1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:48.519867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d46c10b-9ebd-4198-84c9-a56fc8a63df1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:48.520447 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d46c10b-9ebd-4198-84c9-a56fc8a63df1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:48.521238 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d46c10b-9ebd-4198-84c9-a56fc8a63df1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:48.521911 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d46c10b-9ebd-4198-84c9-a56fc8a63df1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:48.522599 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d46c10b-9ebd-4198-84c9-a56fc8a63df1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:48.550259 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-9d46c10b-9ebd-4198-84c9-a56fc8a63df1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lazy-loading 'flavor' on Instance uuid 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:02:48.658056 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9d46c10b-9ebd-4198-84c9-a56fc8a63df1 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "POST /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec/action" status: 202 len: 0 microversion: 2.1 time: 0.148853 Sep 24 21:02:48.663382 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1804/3536] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:02:48 2022] POST /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:02:48.672310 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-037e660a-479f-46e3-a908-9bc0cde6e3f6 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1833097728", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7b5a8b36-d7ee-411d-a423-fe2d46afa3ec"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-037e660a-479f-46e3-a908-9bc0cde6e3f6 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Request method failure captured: Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 499 Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3BcAXO6-IxcZ0MYeGyT72JPYNqI4IAnjQTz_t0NH1ytLj7857qvVlWD8sI26ex6CJDngsMF20bDZJDm0aCsucAACh_vgzT61-tfgSDWANfO0VPGX9i2uJzvvZ68GTGN1KO7uVzfcUXYPJ9Z8JGWubwIY151JosfATxcDAlgWLHDz2g Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 2ea87ff9b7b54a44a806283f008bd3d1 Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1928850691 Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ea87ff9b7b54a44a806283f008bd3d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2ea87ff9b7b54a44a806283f008bd3d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2ea87ff9b7b54a44a806283f008bd3d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ea87ff9b7b54a44a806283f008bd3d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1928850691 Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 2ea87ff9b7b54a44a806283f008bd3d1 Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1928850691 Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServerMetadataNegativeTestJSON-1928850691-project Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: a0815c3afecb4fd5b23a0ee395f7aa5e Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1928850691-project Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1833097728", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7b5a8b36-d7ee-411d-a423-fe2d46afa3ec"}]}} Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1833097728', 'imageRef': '4c30e8e9-8fb2-4377-83f1-98322cb17799', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '7b5a8b36-d7ee-411d-a423-fe2d46afa3ec'}]}}} Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise error Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 24 21:02:48.682423 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 24 21:02:48.686431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 24 21:02:48.686431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:48.686431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 24 21:02:48.686431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 24 21:02:48.686431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:48.686431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:48.686431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:48.686431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:48.686431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:48.686431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:48.686431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:02:48.686431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:02:48.686431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:02:48.686431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:02:48.686431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:02:48.686431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:02:48.686431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 21:02:48.686431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 21:02:48.686431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 21:02:48.686431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 21:02:48.686431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 21:02:48.686431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 21:02:48.686431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 24 21:02:48.686431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:48.686431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:48.686431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:48.686431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:48.686431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:48.686431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:48.686431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 21:02:48.686431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 21:02:48.686431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 24 21:02:48.686431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:48.686431 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-037e660a-479f-46e3-a908-9bc0cde6e3f6 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:02:48.689232 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-037e660a-479f-46e3-a908-9bc0cde6e3f6 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.021853 Sep 24 21:02:48.703690 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1805/3537] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:02:48 2022] POST /compute/v2.1/servers => generated 687 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:02:48.718245 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a3147fbb-cee7-4d58-8d00-cc68b6fd6600 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Calling method '.version_select at 0x7f4b0c561ca0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:48.738023 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3147fbb-cee7-4d58-8d00-cc68b6fd6600 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:48.738830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3147fbb-cee7-4d58-8d00-cc68b6fd6600 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:48.739469 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3147fbb-cee7-4d58-8d00-cc68b6fd6600 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:48.745086 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a3147fbb-cee7-4d58-8d00-cc68b6fd6600 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] [instance: de4ec687-83cc-43ea-bed9-24ec92724907] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:48.766942 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3147fbb-cee7-4d58-8d00-cc68b6fd6600 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:48.767448 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3147fbb-cee7-4d58-8d00-cc68b6fd6600 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:48.767900 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3147fbb-cee7-4d58-8d00-cc68b6fd6600 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:48.768633 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3147fbb-cee7-4d58-8d00-cc68b6fd6600 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:48.769093 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3147fbb-cee7-4d58-8d00-cc68b6fd6600 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:48.769532 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3147fbb-cee7-4d58-8d00-cc68b6fd6600 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:48.796951 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3147fbb-cee7-4d58-8d00-cc68b6fd6600 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:48.797499 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3147fbb-cee7-4d58-8d00-cc68b6fd6600 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:48.798222 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3147fbb-cee7-4d58-8d00-cc68b6fd6600 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:48.821942 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-a3147fbb-cee7-4d58-8d00-cc68b6fd6600 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lazy-loading 'flavor' on Instance uuid de4ec687-83cc-43ea-bed9-24ec92724907 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:02:48.842282 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a3147fbb-cee7-4d58-8d00-cc68b6fd6600 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] 10.222.0.52 "DELETE /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907/tags" status: 204 len: 0 microversion: 2.26 time: 0.137192 Sep 24 21:02:48.844709 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1806/3538] 10.222.0.52 () {60 vars in 1295 bytes} [Sat Sep 24 21:02:48 2022] DELETE /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907/tags => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 24 21:02:48.850973 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8fd33595-0361-4f9f-a995-7da9d2f132e5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:48.852392 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8fd33595-0361-4f9f-a995-7da9d2f132e5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: e6c97c05-a30e-4c8b-b56c-0cdae10ff44c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:48.866859 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8fd33595-0361-4f9f-a995-7da9d2f132e5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:48.867709 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8fd33595-0361-4f9f-a995-7da9d2f132e5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:48.868367 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8fd33595-0361-4f9f-a995-7da9d2f132e5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:48.869300 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8fd33595-0361-4f9f-a995-7da9d2f132e5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:48.870731 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8fd33595-0361-4f9f-a995-7da9d2f132e5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:48.871425 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8fd33595-0361-4f9f-a995-7da9d2f132e5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:49.022907 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e9b6cc79-1534-476f-bd8c-d79a040f3fee tempest-FloatingIPDetailsTestJSON-2096053334 tempest-FloatingIPDetailsTestJSON-2096053334-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/87928cc5-9461-49b4-9d48-7223860ae60e" status: 202 len: 0 microversion: 2.1 time: 1.116935 Sep 24 21:02:49.025325 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1733/3539] 10.222.0.52 () {58 vars in 1263 bytes} [Sat Sep 24 21:02:47 2022] DELETE /compute/v2.1/os-floating-ips/87928cc5-9461-49b4-9d48-7223860ae60e => generated 0 bytes in 1120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:02:49.031827 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2cf0c344-9db3-4b88-86a4-a5b62e09e044 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:49.033362 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2cf0c344-9db3-4b88-86a4-a5b62e09e044 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:49.043538 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2cf0c344-9db3-4b88-86a4-a5b62e09e044 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:49.044054 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2cf0c344-9db3-4b88-86a4-a5b62e09e044 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:49.044504 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2cf0c344-9db3-4b88-86a4-a5b62e09e044 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:49.045230 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2cf0c344-9db3-4b88-86a4-a5b62e09e044 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:49.045696 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2cf0c344-9db3-4b88-86a4-a5b62e09e044 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:49.046284 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2cf0c344-9db3-4b88-86a4-a5b62e09e044 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:49.073229 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8fd33595-0361-4f9f-a995-7da9d2f132e5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:49.082026 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8fd33595-0361-4f9f-a995-7da9d2f132e5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c" status: 200 len: 1513 microversion: 2.1 time: 0.235937 Sep 24 21:02:49.086648 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1807/3540] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:48 2022] GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c => generated 1513 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:49.093319 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b701f005-02c6-4a86-8929-3fc28b89b5df tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:49.096128 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b701f005-02c6-4a86-8929-3fc28b89b5df tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:49.108024 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:02:49.110549 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b701f005-02c6-4a86-8929-3fc28b89b5df tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:49.111065 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b701f005-02c6-4a86-8929-3fc28b89b5df tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:49.111510 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b701f005-02c6-4a86-8929-3fc28b89b5df tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:49.112423 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b701f005-02c6-4a86-8929-3fc28b89b5df tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:49.112874 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b701f005-02c6-4a86-8929-3fc28b89b5df tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:49.113303 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b701f005-02c6-4a86-8929-3fc28b89b5df tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:49.165566 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b701f005-02c6-4a86-8929-3fc28b89b5df tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.076292 Sep 24 21:02:49.167219 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1808/3541] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:02:49 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:02:49.172498 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-34abe7dd-2017-4651-b9ff-68f49cb14a21 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Calling method '.version_select at 0x7f4b0c7d73a0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:49.188348 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34abe7dd-2017-4651-b9ff-68f49cb14a21 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:49.188844 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34abe7dd-2017-4651-b9ff-68f49cb14a21 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:49.189343 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34abe7dd-2017-4651-b9ff-68f49cb14a21 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:49.200789 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-34abe7dd-2017-4651-b9ff-68f49cb14a21 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] 10.222.0.52 "GET /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907/tags" status: 200 len: 12 microversion: 2.26 time: 0.031685 Sep 24 21:02:49.206372 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1809/3542] 10.222.0.52 () {60 vars in 1292 bytes} [Sat Sep 24 21:02:49 2022] GET /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907/tags => generated 12 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:49.211354 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e909b7b4-02e5-4ad6-8acd-0a9217cc4bfd tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-516282842", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7b5a8b36-d7ee-411d-a423-fe2d46afa3ec"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e909b7b4-02e5-4ad6-8acd-0a9217cc4bfd tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Request method failure captured: Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 499 Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3BcAXO6-IxcZ0MYeGyT72JPYNqI4IAnjQTz_t0NH1ytLj7857qvVlWD8sI26ex6CJDngsMF20bDZJDm0aCsucAACh_vgzT61-tfgSDWANfO0VPGX9i2uJzvvZ68GTGN1KO7uVzfcUXYPJ9Z8JGWubwIY151JosfATxcDAlgWLHDz2g Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 2ea87ff9b7b54a44a806283f008bd3d1 Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1928850691 Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ea87ff9b7b54a44a806283f008bd3d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2ea87ff9b7b54a44a806283f008bd3d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2ea87ff9b7b54a44a806283f008bd3d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ea87ff9b7b54a44a806283f008bd3d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1928850691 Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 2ea87ff9b7b54a44a806283f008bd3d1 Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1928850691 Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServerMetadataNegativeTestJSON-1928850691-project Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: a0815c3afecb4fd5b23a0ee395f7aa5e Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1928850691-project Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-516282842", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7b5a8b36-d7ee-411d-a423-fe2d46afa3ec"}]}} Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-516282842', 'imageRef': '4c30e8e9-8fb2-4377-83f1-98322cb17799', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '7b5a8b36-d7ee-411d-a423-fe2d46afa3ec'}]}}} Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise error Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 24 21:02:49.216376 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 24 21:02:49.220200 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 24 21:02:49.220200 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:49.220200 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 24 21:02:49.220200 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 24 21:02:49.220200 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:49.220200 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:49.220200 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:49.220200 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:49.220200 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:49.220200 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:49.220200 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:02:49.220200 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:02:49.220200 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:02:49.220200 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:02:49.220200 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:02:49.220200 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:02:49.220200 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 21:02:49.220200 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 21:02:49.220200 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 21:02:49.220200 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 21:02:49.220200 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 21:02:49.220200 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 21:02:49.220200 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 24 21:02:49.220200 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:49.220200 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:49.220200 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:49.220200 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:49.220200 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:49.220200 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:49.220200 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 21:02:49.220200 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 21:02:49.220200 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 24 21:02:49.220200 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:49.220200 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e909b7b4-02e5-4ad6-8acd-0a9217cc4bfd tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:02:49.220200 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e909b7b4-02e5-4ad6-8acd-0a9217cc4bfd tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.010422 Sep 24 21:02:49.220200 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1810/3543] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:02:49 2022] POST /compute/v2.1/servers => generated 689 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:02:49.223273 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f104473d-2dec-4852-b83d-68b53f33671c tempest-FloatingIPDetailsTestJSON-2096053334 tempest-FloatingIPDetailsTestJSON-2096053334-project] Calling method '.version_select at 0x7f4b0c6809d0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:49.334534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2cf0c344-9db3-4b88-86a4-a5b62e09e044 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:49.344603 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2cf0c344-9db3-4b88-86a4-a5b62e09e044 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec" status: 200 len: 1509 microversion: 2.1 time: 0.317854 Sep 24 21:02:49.345187 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1734/3544] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:49 2022] GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec => generated 1509 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:49.363522 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fb6cf93b-ac60-4c6e-bef4-74404748d85a tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Calling method '.version_select at 0x7f4b0c114f70>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:49.374241 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb6cf93b-ac60-4c6e-bef4-74404748d85a tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:49.375533 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb6cf93b-ac60-4c6e-bef4-74404748d85a tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:49.376104 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb6cf93b-ac60-4c6e-bef4-74404748d85a tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:49.376730 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fb6cf93b-ac60-4c6e-bef4-74404748d85a tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] [instance: de4ec687-83cc-43ea-bed9-24ec92724907] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:49.383102 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb6cf93b-ac60-4c6e-bef4-74404748d85a tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:49.383810 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb6cf93b-ac60-4c6e-bef4-74404748d85a tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:49.384238 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb6cf93b-ac60-4c6e-bef4-74404748d85a tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:49.384973 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb6cf93b-ac60-4c6e-bef4-74404748d85a tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:49.385493 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb6cf93b-ac60-4c6e-bef4-74404748d85a tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:49.385927 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb6cf93b-ac60-4c6e-bef4-74404748d85a tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:49.410476 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb6cf93b-ac60-4c6e-bef4-74404748d85a tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:49.411016 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb6cf93b-ac60-4c6e-bef4-74404748d85a tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:49.411436 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb6cf93b-ac60-4c6e-bef4-74404748d85a tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:49.424545 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-fb6cf93b-ac60-4c6e-bef4-74404748d85a tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lazy-loading 'flavor' on Instance uuid de4ec687-83cc-43ea-bed9-24ec92724907 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:02:49.428945 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=93,nova_cell1:DELETE=4,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:02:49.441621 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fb6cf93b-ac60-4c6e-bef4-74404748d85a tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] 10.222.0.52 "DELETE /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907/tags" status: 204 len: 0 microversion: 2.26 time: 0.089563 Sep 24 21:02:49.442974 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1735/3545] 10.222.0.52 () {60 vars in 1295 bytes} [Sat Sep 24 21:02:49 2022] DELETE /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907/tags => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 24 21:02:49.627974 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-26c67ccc-7768-4e4a-a45b-b5879173c9a0 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-671328820", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": "none"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:02:49.714252 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-26c67ccc-7768-4e4a-a45b-b5879173c9a0 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:02:49.714712 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-26c67ccc-7768-4e4a-a45b-b5879173c9a0 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:02:49.715348 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-26c67ccc-7768-4e4a-a45b-b5879173c9a0 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:02:49.715851 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-26c67ccc-7768-4e4a-a45b-b5879173c9a0 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:02:49.716287 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-26c67ccc-7768-4e4a-a45b-b5879173c9a0 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:02:49.727796 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26c67ccc-7768-4e4a-a45b-b5879173c9a0 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:49.728633 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26c67ccc-7768-4e4a-a45b-b5879173c9a0 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:49.729823 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26c67ccc-7768-4e4a-a45b-b5879173c9a0 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:49.730793 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26c67ccc-7768-4e4a-a45b-b5879173c9a0 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:49.731435 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26c67ccc-7768-4e4a-a45b-b5879173c9a0 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:49.731936 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26c67ccc-7768-4e4a-a45b-b5879173c9a0 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:49.754265 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-26c67ccc-7768-4e4a-a45b-b5879173c9a0 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Getting quotas for project 7128b36583514196945b5a65446e3e2c. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:02:49.760778 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-26c67ccc-7768-4e4a-a45b-b5879173c9a0 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Getting quotas for user b75065b5a5084b639bdab6e7dce97302 and project 7128b36583514196945b5a65446e3e2c. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:02:49.774419 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-26c67ccc-7768-4e4a-a45b-b5879173c9a0 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:02:49.777530 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-26c67ccc-7768-4e4a-a45b-b5879173c9a0 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] [instance: a80e61dd-bfe0-493e-8f38-35df4c09d687] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:02:49.846853 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-26c67ccc-7768-4e4a-a45b-b5879173c9a0 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.402560 Sep 24 21:02:49.847516 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1736/3546] 10.222.0.52 () {62 vars in 1188 bytes} [Sat Sep 24 21:02:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 404 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 24 21:02:49.854593 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-97309461-e5e0-4ea3-ac55-8561083777f1 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-915793507", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7b5a8b36-d7ee-411d-a423-fe2d46afa3ec"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-97309461-e5e0-4ea3-ac55-8561083777f1 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Request method failure captured: Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 753 Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3BcAXO6-IxcZ0MYeGyT72JPYNqI4IAnjQTz_t0NH1ytLj7857qvVlWD8sI26ex6CJDngsMF20bDZJDm0aCsucAACh_vgzT61-tfgSDWANfO0VPGX9i2uJzvvZ68GTGN1KO7uVzfcUXYPJ9Z8JGWubwIY151JosfATxcDAlgWLHDz2g Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 2ea87ff9b7b54a44a806283f008bd3d1 Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1928850691 Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ea87ff9b7b54a44a806283f008bd3d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2ea87ff9b7b54a44a806283f008bd3d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2ea87ff9b7b54a44a806283f008bd3d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ea87ff9b7b54a44a806283f008bd3d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1928850691 Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 2ea87ff9b7b54a44a806283f008bd3d1 Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1928850691 Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServerMetadataNegativeTestJSON-1928850691-project Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: a0815c3afecb4fd5b23a0ee395f7aa5e Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1928850691-project Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-915793507", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7b5a8b36-d7ee-411d-a423-fe2d46afa3ec"}]}} Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-915793507', 'imageRef': '4c30e8e9-8fb2-4377-83f1-98322cb17799', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '7b5a8b36-d7ee-411d-a423-fe2d46afa3ec'}]}}} Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 21:02:49.860942 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 21:02:49.863576 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise error Sep 24 21:02:49.863576 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 24 21:02:49.863576 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:49.863576 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 24 21:02:49.863576 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 24 21:02:49.863576 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 24 21:02:49.863576 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 24 21:02:49.863576 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 24 21:02:49.863576 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:49.863576 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 24 21:02:49.863576 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 24 21:02:49.863576 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:49.863576 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:49.863576 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:49.863576 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:49.863576 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:49.863576 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:49.863576 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:02:49.863576 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:02:49.863576 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:02:49.863576 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:02:49.863576 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:02:49.863576 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:02:49.863576 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 21:02:49.863576 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 21:02:49.863576 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 21:02:49.863576 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 21:02:49.863576 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 21:02:49.863576 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 21:02:49.863576 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 24 21:02:49.863576 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:49.863576 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:49.863576 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:49.863576 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:49.863576 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:49.863576 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:49.863576 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 21:02:49.863576 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 21:02:49.865924 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 24 21:02:49.865924 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:49.868919 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-97309461-e5e0-4ea3-ac55-8561083777f1 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:02:49.872205 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-97309461-e5e0-4ea3-ac55-8561083777f1 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.023666 Sep 24 21:02:49.880879 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1737/3547] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:02:49 2022] POST /compute/v2.1/servers => generated 1197 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Sep 24 21:02:49.881314 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f918907c-54f1-407c-866e-a4b2658d2fad tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Calling method '.version_select at 0x7f4b1100ff70>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:49.900032 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f918907c-54f1-407c-866e-a4b2658d2fad tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:49.900808 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f918907c-54f1-407c-866e-a4b2658d2fad tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:49.901551 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f918907c-54f1-407c-866e-a4b2658d2fad tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:49.902576 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f918907c-54f1-407c-866e-a4b2658d2fad tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] [instance: de4ec687-83cc-43ea-bed9-24ec92724907] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:49.910891 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f918907c-54f1-407c-866e-a4b2658d2fad tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:49.912213 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f918907c-54f1-407c-866e-a4b2658d2fad tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:49.913068 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f918907c-54f1-407c-866e-a4b2658d2fad tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:49.915174 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f918907c-54f1-407c-866e-a4b2658d2fad tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:49.915766 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f918907c-54f1-407c-866e-a4b2658d2fad tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:49.916384 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f918907c-54f1-407c-866e-a4b2658d2fad tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:49.953308 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f918907c-54f1-407c-866e-a4b2658d2fad tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:49.953826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f918907c-54f1-407c-866e-a4b2658d2fad tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:49.954270 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f918907c-54f1-407c-866e-a4b2658d2fad tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:49.967222 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f918907c-54f1-407c-866e-a4b2658d2fad tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:49.971442 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f918907c-54f1-407c-866e-a4b2658d2fad tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:49.972082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f918907c-54f1-407c-866e-a4b2658d2fad tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:50.007364 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-f918907c-54f1-407c-866e-a4b2658d2fad tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lazy-loading 'flavor' on Instance uuid de4ec687-83cc-43ea-bed9-24ec92724907 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:02:50.029958 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f918907c-54f1-407c-866e-a4b2658d2fad tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] 10.222.0.52 "PUT /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907/tags/tempest-tag-1983371579" status: 201 len: 0 microversion: 2.26 time: 0.156081 Sep 24 21:02:50.031823 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1738/3548] 10.222.0.52 () {62 vars in 1380 bytes} [Sat Sep 24 21:02:49 2022] PUT /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907/tags/tempest-tag-1983371579 => generated 0 bytes in 158 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 24 21:02:50.038329 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-03ae719d-e1ce-4fcd-9cf6-06f125fa8cd3 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:50.039930 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-03ae719d-e1ce-4fcd-9cf6-06f125fa8cd3 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] [instance: a80e61dd-bfe0-493e-8f38-35df4c09d687] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:50.126126 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-03ae719d-e1ce-4fcd-9cf6-06f125fa8cd3 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75065b5a5084b639bdab6e7dce97302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7128b36583514196945b5a65446e3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:50.141493 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-03ae719d-e1ce-4fcd-9cf6-06f125fa8cd3 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75065b5a5084b639bdab6e7dce97302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7128b36583514196945b5a65446e3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:50.143035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-03ae719d-e1ce-4fcd-9cf6-06f125fa8cd3 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75065b5a5084b639bdab6e7dce97302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7128b36583514196945b5a65446e3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:50.144230 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-03ae719d-e1ce-4fcd-9cf6-06f125fa8cd3 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] 10.222.0.52 "GET /compute/v2.1/servers/a80e61dd-bfe0-493e-8f38-35df4c09d687" status: 200 len: 1280 microversion: 2.47 time: 0.111218 Sep 24 21:02:50.158887 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1739/3549] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:02:50 2022] GET /compute/v2.1/servers/a80e61dd-bfe0-493e-8f38-35df4c09d687 => generated 1280 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:02:50.170120 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4e325acb-cf54-4fbb-9250-4dcb7c7824d7 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1539442804", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7b5a8b36-d7ee-411d-a423-fe2d46afa3ec"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:02:50.177031 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4e325acb-cf54-4fbb-9250-4dcb7c7824d7 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Request method failure captured: Sep 24 21:02:50.177031 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 24 21:02:50.177031 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:02:50.177031 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:02:50.177031 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:02:50.177031 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 1266 Sep 24 21:02:50.177031 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:02:50.177031 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:02:50.177031 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:02:50.177031 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:02:50.177031 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3BcAXO6-IxcZ0MYeGyT72JPYNqI4IAnjQTz_t0NH1ytLj7857qvVlWD8sI26ex6CJDngsMF20bDZJDm0aCsucAACh_vgzT61-tfgSDWANfO0VPGX9i2uJzvvZ68GTGN1KO7uVzfcUXYPJ9Z8JGWubwIY151JosfATxcDAlgWLHDz2g Sep 24 21:02:50.177031 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:02:50.177031 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:02:50.177031 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:02:50.177031 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:02:50.177031 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:02:50.177031 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:02:50.177031 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 2ea87ff9b7b54a44a806283f008bd3d1 Sep 24 21:02:50.177031 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1928850691 Sep 24 21:02:50.177031 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:02:50.177031 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:02:50.177031 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ea87ff9b7b54a44a806283f008bd3d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2ea87ff9b7b54a44a806283f008bd3d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2ea87ff9b7b54a44a806283f008bd3d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ea87ff9b7b54a44a806283f008bd3d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:02:50.177031 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1928850691 Sep 24 21:02:50.177031 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 2ea87ff9b7b54a44a806283f008bd3d1 Sep 24 21:02:50.177031 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1928850691 Sep 24 21:02:50.177031 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServerMetadataNegativeTestJSON-1928850691-project Sep 24 21:02:50.177031 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:02:50.177031 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:02:50.177031 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: a0815c3afecb4fd5b23a0ee395f7aa5e Sep 24 21:02:50.177031 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1928850691-project Sep 24 21:02:50.177031 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 21:02:50.177031 ncdv-master-1 devstack@n-api.service[140517]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1539442804", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7b5a8b36-d7ee-411d-a423-fe2d46afa3ec"}]}} Sep 24 21:02:50.177031 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:02:50.179272 ncdv-master-1 devstack@n-api.service[140517]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 24 21:02:50.179272 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1539442804', 'imageRef': '4c30e8e9-8fb2-4377-83f1-98322cb17799', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '7b5a8b36-d7ee-411d-a423-fe2d46afa3ec'}]}}} Sep 24 21:02:50.179272 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:02:50.179272 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:50.179272 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 21:02:50.179272 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 21:02:50.179272 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 21:02:50.179272 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise error Sep 24 21:02:50.179272 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 24 21:02:50.179272 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:50.179272 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 24 21:02:50.179272 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 24 21:02:50.179272 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 24 21:02:50.179272 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 24 21:02:50.179272 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 24 21:02:50.179272 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:50.179272 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 24 21:02:50.180501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 24 21:02:50.180501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:50.180501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:50.180501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:50.180501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:50.180501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:50.180501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:50.180501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:02:50.180501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:02:50.180501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:02:50.180501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:02:50.180501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:02:50.180501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:02:50.180501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 21:02:50.180501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 21:02:50.180501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 21:02:50.180501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 21:02:50.180501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 21:02:50.180501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 21:02:50.180501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 24 21:02:50.180501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:50.180501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:50.180501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:50.180501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:50.180501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:50.180501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:50.180501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 21:02:50.180501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 21:02:50.184205 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 24 21:02:50.184205 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:50.184205 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4e325acb-cf54-4fbb-9250-4dcb7c7824d7 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:02:50.184205 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4e325acb-cf54-4fbb-9250-4dcb7c7824d7 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.018539 Sep 24 21:02:50.190926 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1740/3550] 10.222.0.52 () {60 vars in 1148 bytes} [Sat Sep 24 21:02:50 2022] POST /compute/v2.1/servers => generated 2221 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Sep 24 21:02:50.206835 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-52737631-3cda-4e7a-b0f1-f33c85bacc23 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Calling method '.version_select at 0x7f4b07d50b80>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:50.235323 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52737631-3cda-4e7a-b0f1-f33c85bacc23 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:50.236641 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52737631-3cda-4e7a-b0f1-f33c85bacc23 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:50.237086 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52737631-3cda-4e7a-b0f1-f33c85bacc23 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:50.237602 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-52737631-3cda-4e7a-b0f1-f33c85bacc23 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] [instance: de4ec687-83cc-43ea-bed9-24ec92724907] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:50.255313 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:02:50.261563 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52737631-3cda-4e7a-b0f1-f33c85bacc23 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:50.262355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52737631-3cda-4e7a-b0f1-f33c85bacc23 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:50.262938 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52737631-3cda-4e7a-b0f1-f33c85bacc23 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:50.266626 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52737631-3cda-4e7a-b0f1-f33c85bacc23 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:50.267921 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52737631-3cda-4e7a-b0f1-f33c85bacc23 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:50.270348 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52737631-3cda-4e7a-b0f1-f33c85bacc23 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:50.331730 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52737631-3cda-4e7a-b0f1-f33c85bacc23 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:50.332247 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52737631-3cda-4e7a-b0f1-f33c85bacc23 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:50.332977 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52737631-3cda-4e7a-b0f1-f33c85bacc23 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:50.343668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52737631-3cda-4e7a-b0f1-f33c85bacc23 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:50.344449 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52737631-3cda-4e7a-b0f1-f33c85bacc23 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:50.344580 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52737631-3cda-4e7a-b0f1-f33c85bacc23 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:50.389502 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f104473d-2dec-4852-b83d-68b53f33671c tempest-FloatingIPDetailsTestJSON-2096053334 tempest-FloatingIPDetailsTestJSON-2096053334-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/47ad769e-4c8e-4277-b751-efd3d515bd9d" status: 202 len: 0 microversion: 2.1 time: 1.169954 Sep 24 21:02:50.391082 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1811/3551] 10.222.0.52 () {58 vars in 1263 bytes} [Sat Sep 24 21:02:49 2022] DELETE /compute/v2.1/os-floating-ips/47ad769e-4c8e-4277-b751-efd3d515bd9d => generated 0 bytes in 1172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:02:50.397358 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-961953a4-8a19-4239-9f22-572a924dc190 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:50.398293 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-961953a4-8a19-4239-9f22-572a924dc190 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: e6c97c05-a30e-4c8b-b56c-0cdae10ff44c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:50.410066 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-52737631-3cda-4e7a-b0f1-f33c85bacc23 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lazy-loading 'flavor' on Instance uuid de4ec687-83cc-43ea-bed9-24ec92724907 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:02:50.416075 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-961953a4-8a19-4239-9f22-572a924dc190 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:50.419256 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-961953a4-8a19-4239-9f22-572a924dc190 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:50.419892 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-961953a4-8a19-4239-9f22-572a924dc190 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:50.420818 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-961953a4-8a19-4239-9f22-572a924dc190 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:50.423061 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-961953a4-8a19-4239-9f22-572a924dc190 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:50.424458 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-961953a4-8a19-4239-9f22-572a924dc190 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:50.436458 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-52737631-3cda-4e7a-b0f1-f33c85bacc23 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] 10.222.0.52 "PUT /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907/tags/tempest-tag-734664004" status: 201 len: 0 microversion: 2.26 time: 0.243893 Sep 24 21:02:50.437361 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1741/3552] 10.222.0.52 () {62 vars in 1377 bytes} [Sat Sep 24 21:02:50 2022] PUT /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907/tags/tempest-tag-734664004 => generated 0 bytes in 246 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 24 21:02:50.444556 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cadf7841-c6ae-4bcd-8751-b5a5ca23e002 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:50.447037 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cadf7841-c6ae-4bcd-8751-b5a5ca23e002 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:50.474447 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cadf7841-c6ae-4bcd-8751-b5a5ca23e002 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:50.477609 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cadf7841-c6ae-4bcd-8751-b5a5ca23e002 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:50.480702 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cadf7841-c6ae-4bcd-8751-b5a5ca23e002 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:50.481504 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cadf7841-c6ae-4bcd-8751-b5a5ca23e002 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:50.482076 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cadf7841-c6ae-4bcd-8751-b5a5ca23e002 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:50.482402 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cadf7841-c6ae-4bcd-8751-b5a5ca23e002 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:50.521990 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cadf7841-c6ae-4bcd-8751-b5a5ca23e002 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.081547 Sep 24 21:02:50.522905 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1742/3553] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:02:50 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:02:50.533770 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ccb0bc60-b898-4317-93ec-16c71f4d85ed tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:50.534318 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ccb0bc60-b898-4317-93ec-16c71f4d85ed tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] [instance: a63d0f45-ee84-4db9-b3c8-dd7cb7e28443] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:50.539620 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-ccb0bc60-b898-4317-93ec-16c71f4d85ed tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] HTTP exception thrown: Instance a63d0f45-ee84-4db9-b3c8-dd7cb7e28443 could not be found. Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ccb0bc60-b898-4317-93ec-16c71f4d85ed tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Request method failure captured: Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/a63d0f45-ee84-4db9-b3c8-dd7cb7e28443/metadata/test2 HTTP/1.1 Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3BcAXO6-IxcZ0MYeGyT72JPYNqI4IAnjQTz_t0NH1ytLj7857qvVlWD8sI26ex6CJDngsMF20bDZJDm0aCsucAACh_vgzT61-tfgSDWANfO0VPGX9i2uJzvvZ68GTGN1KO7uVzfcUXYPJ9Z8JGWubwIY151JosfATxcDAlgWLHDz2g Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 2ea87ff9b7b54a44a806283f008bd3d1 Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1928850691 Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ea87ff9b7b54a44a806283f008bd3d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2ea87ff9b7b54a44a806283f008bd3d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2ea87ff9b7b54a44a806283f008bd3d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ea87ff9b7b54a44a806283f008bd3d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1928850691 Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 2ea87ff9b7b54a44a806283f008bd3d1 Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1928850691 Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServerMetadataNegativeTestJSON-1928850691-project Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: a0815c3afecb4fd5b23a0ee395f7aa5e Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1928850691-project Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance a63d0f45-ee84-4db9-b3c8-dd7cb7e28443 could not be found. Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'server_id': 'a63d0f45-ee84-4db9-b3c8-dd7cb7e28443', 'id': 'test2'} Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a63d0f45-ee84-4db9-b3c8-dd7cb7e28443 could not be found. Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a63d0f45-ee84-4db9-b3c8-dd7cb7e28443 could not be found. Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:50.543128 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:50.548079 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:02:50.548079 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:02:50.548079 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a63d0f45-ee84-4db9-b3c8-dd7cb7e28443 could not be found. Sep 24 21:02:50.548079 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:50.548079 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ccb0bc60-b898-4317-93ec-16c71f4d85ed tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Returning 404 to user: Instance a63d0f45-ee84-4db9-b3c8-dd7cb7e28443 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:02:50.548079 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ccb0bc60-b898-4317-93ec-16c71f4d85ed tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] 10.222.0.52 "GET /compute/v2.1/servers/a63d0f45-ee84-4db9-b3c8-dd7cb7e28443/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.020794 Sep 24 21:02:50.548079 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1743/3554] 10.222.0.52 () {58 vars in 1281 bytes} [Sat Sep 24 21:02:50 2022] GET /compute/v2.1/servers/a63d0f45-ee84-4db9-b3c8-dd7cb7e28443/metadata/test2 => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:02:50.550397 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e660fae3-e4cb-44a3-a43c-aad17eef736d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:50.551055 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e660fae3-e4cb-44a3-a43c-aad17eef736d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:50.561607 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e660fae3-e4cb-44a3-a43c-aad17eef736d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:50.562651 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e660fae3-e4cb-44a3-a43c-aad17eef736d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:50.563281 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e660fae3-e4cb-44a3-a43c-aad17eef736d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:50.564178 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e660fae3-e4cb-44a3-a43c-aad17eef736d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:50.577716 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e660fae3-e4cb-44a3-a43c-aad17eef736d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:50.580432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e660fae3-e4cb-44a3-a43c-aad17eef736d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:50.779820 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-961953a4-8a19-4239-9f22-572a924dc190 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:50.788484 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-961953a4-8a19-4239-9f22-572a924dc190 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c" status: 200 len: 1513 microversion: 2.1 time: 0.396146 Sep 24 21:02:50.790381 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1812/3555] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:50 2022] GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c => generated 1513 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:50.796292 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3272336f-d9c0-4355-b4c9-30619d83dfd7 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Action: 'update_all', calling method: .version_select at 0x7f4b0c913820>, body: {"tags": ["tempest-tag-1354639681", "tempest-tag-1791554176"]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:02:50.807728 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3272336f-d9c0-4355-b4c9-30619d83dfd7 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:50.808670 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3272336f-d9c0-4355-b4c9-30619d83dfd7 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:50.809507 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3272336f-d9c0-4355-b4c9-30619d83dfd7 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:50.810454 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3272336f-d9c0-4355-b4c9-30619d83dfd7 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] [instance: de4ec687-83cc-43ea-bed9-24ec92724907] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:50.816887 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3272336f-d9c0-4355-b4c9-30619d83dfd7 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:50.817930 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3272336f-d9c0-4355-b4c9-30619d83dfd7 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:50.819598 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3272336f-d9c0-4355-b4c9-30619d83dfd7 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:50.820694 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3272336f-d9c0-4355-b4c9-30619d83dfd7 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:50.821369 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3272336f-d9c0-4355-b4c9-30619d83dfd7 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:50.822294 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3272336f-d9c0-4355-b4c9-30619d83dfd7 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:50.848011 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3272336f-d9c0-4355-b4c9-30619d83dfd7 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:50.848511 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3272336f-d9c0-4355-b4c9-30619d83dfd7 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:50.848955 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3272336f-d9c0-4355-b4c9-30619d83dfd7 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:50.865681 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e660fae3-e4cb-44a3-a43c-aad17eef736d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:50.874826 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e660fae3-e4cb-44a3-a43c-aad17eef736d tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec" status: 200 len: 1492 microversion: 2.1 time: 0.328170 Sep 24 21:02:50.875406 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1744/3556] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:50 2022] GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec => generated 1492 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:50.883154 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ca6912a4-5055-408b-8cb5-d53968a56f19 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:50.884098 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ca6912a4-5055-408b-8cb5-d53968a56f19 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] [instance: 0ab5c42f-da92-43e0-a5f0-c277854edc31] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:50.891857 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-3272336f-d9c0-4355-b4c9-30619d83dfd7 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lazy-loading 'flavor' on Instance uuid de4ec687-83cc-43ea-bed9-24ec92724907 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:02:50.908482 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ca6912a4-5055-408b-8cb5-d53968a56f19 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:50.909085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ca6912a4-5055-408b-8cb5-d53968a56f19 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:50.909608 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ca6912a4-5055-408b-8cb5-d53968a56f19 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:50.910420 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ca6912a4-5055-408b-8cb5-d53968a56f19 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:50.911154 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ca6912a4-5055-408b-8cb5-d53968a56f19 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:50.911662 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ca6912a4-5055-408b-8cb5-d53968a56f19 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:50.917500 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3272336f-d9c0-4355-b4c9-30619d83dfd7 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] 10.222.0.52 "PUT /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907/tags" status: 200 len: 62 microversion: 2.26 time: 0.125634 Sep 24 21:02:50.923088 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1813/3557] 10.222.0.52 () {62 vars in 1312 bytes} [Sat Sep 24 21:02:50 2022] PUT /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907/tags => generated 62 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:50.927082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-35ad3e5e-a0e7-4cf7-b5da-932b101d62b0 req-a2d0bf3b-bcda-45b9-ba77-16ec160770cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ab5c42f-da92-43e0-a5f0-c277854edc31", "tag": "9ae08dc8-d176-4e64-8af4-718d5d9d5b5c"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:02:50.937818 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-35ad3e5e-a0e7-4cf7-b5da-932b101d62b0 req-a2d0bf3b-bcda-45b9-ba77-16ec160770cd service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:50.938309 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-35ad3e5e-a0e7-4cf7-b5da-932b101d62b0 req-a2d0bf3b-bcda-45b9-ba77-16ec160770cd service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:50.938821 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-35ad3e5e-a0e7-4cf7-b5da-932b101d62b0 req-a2d0bf3b-bcda-45b9-ba77-16ec160770cd service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:50.951172 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-35ad3e5e-a0e7-4cf7-b5da-932b101d62b0 req-a2d0bf3b-bcda-45b9-ba77-16ec160770cd service nova] Creating event network-changed:9ae08dc8-d176-4e64-8af4-718d5d9d5b5c for instance 0ab5c42f-da92-43e0-a5f0-c277854edc31 on nch2-master-1 Sep 24 21:02:50.956273 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-35ad3e5e-a0e7-4cf7-b5da-932b101d62b0 req-a2d0bf3b-bcda-45b9-ba77-16ec160770cd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032725 Sep 24 21:02:50.957121 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1814/3558] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:02:50.962456 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b55134f7-95cf-44b2-9b88-71ace58184d3 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:50.963175 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b55134f7-95cf-44b2-9b88-71ace58184d3 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] [instance: 9b4c5a65-d9d6-47b2-b64e-9d048c544ec2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:50.970132 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b55134f7-95cf-44b2-9b88-71ace58184d3 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:50.970659 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b55134f7-95cf-44b2-9b88-71ace58184d3 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:50.971113 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b55134f7-95cf-44b2-9b88-71ace58184d3 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:50.971819 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b55134f7-95cf-44b2-9b88-71ace58184d3 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:50.972275 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b55134f7-95cf-44b2-9b88-71ace58184d3 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:50.972887 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b55134f7-95cf-44b2-9b88-71ace58184d3 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:51.000058 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b55134f7-95cf-44b2-9b88-71ace58184d3 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] [instance: 9b4c5a65-d9d6-47b2-b64e-9d048c544ec2] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:02:51.090543 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b55134f7-95cf-44b2-9b88-71ace58184d3 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9b4c5a65-d9d6-47b2-b64e-9d048c544ec2" status: 204 len: 0 microversion: 2.1 time: 0.131767 Sep 24 21:02:51.094684 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1815/3559] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:02:50 2022] DELETE /compute/v2.1/servers/9b4c5a65-d9d6-47b2-b64e-9d048c544ec2 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:02:51.100801 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bcfdf931-110a-464f-98bd-661cb3279e2a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:51.101658 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-bcfdf931-110a-464f-98bd-661cb3279e2a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:51.108413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bcfdf931-110a-464f-98bd-661cb3279e2a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:51.109170 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bcfdf931-110a-464f-98bd-661cb3279e2a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:51.109793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bcfdf931-110a-464f-98bd-661cb3279e2a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:51.110721 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bcfdf931-110a-464f-98bd-661cb3279e2a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:51.111343 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bcfdf931-110a-464f-98bd-661cb3279e2a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:51.111932 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bcfdf931-110a-464f-98bd-661cb3279e2a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:51.136838 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=4,nova_cell1:RELEASE=1,nova_cell1:UPDATE=3,nova_cell1:DELETE=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:02:51.148799 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-bcfdf931-110a-464f-98bd-661cb3279e2a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:02:51.257361 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bcfdf931-110a-464f-98bd-661cb3279e2a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec" status: 204 len: 0 microversion: 2.1 time: 0.157100 Sep 24 21:02:51.257361 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1816/3560] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:02:51 2022] DELETE /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:02:51.262889 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d7d72e29-2d46-4793-94ee-4278da78e409 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Calling method '.version_select at 0x7f4b0c7f6af0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:51.272151 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7d72e29-2d46-4793-94ee-4278da78e409 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:51.272798 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7d72e29-2d46-4793-94ee-4278da78e409 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:51.273384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7d72e29-2d46-4793-94ee-4278da78e409 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:51.286143 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d7d72e29-2d46-4793-94ee-4278da78e409 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] 10.222.0.52 "GET /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907/tags" status: 200 len: 62 microversion: 2.26 time: 0.029977 Sep 24 21:02:51.287519 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1817/3561] 10.222.0.52 () {60 vars in 1292 bytes} [Sat Sep 24 21:02:51 2022] GET /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907/tags => generated 62 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:51.294136 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7ccc7e1a-89dd-4c34-93ed-57b48f7779b6 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:51.294939 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7ccc7e1a-89dd-4c34-93ed-57b48f7779b6 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] [instance: 9b4c5a65-d9d6-47b2-b64e-9d048c544ec2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:51.304024 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ccc7e1a-89dd-4c34-93ed-57b48f7779b6 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:51.304623 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ccc7e1a-89dd-4c34-93ed-57b48f7779b6 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:51.307705 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ccc7e1a-89dd-4c34-93ed-57b48f7779b6 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:51.308775 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ccc7e1a-89dd-4c34-93ed-57b48f7779b6 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:51.309617 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ccc7e1a-89dd-4c34-93ed-57b48f7779b6 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:51.311086 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ccc7e1a-89dd-4c34-93ed-57b48f7779b6 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:51.507494 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ca6912a4-5055-408b-8cb5-d53968a56f19 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea166f15a894cd7b1cee6c5a749679c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3dbfe14ac3469286aa595d46c28f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:51.515673 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ca6912a4-5055-408b-8cb5-d53968a56f19 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] 10.222.0.52 "GET /compute/v2.1/servers/0ab5c42f-da92-43e0-a5f0-c277854edc31" status: 200 len: 1590 microversion: 2.1 time: 0.637751 Sep 24 21:02:51.516507 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1745/3562] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:50 2022] GET /compute/v2.1/servers/0ab5c42f-da92-43e0-a5f0-c277854edc31 => generated 1590 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:51.539104 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-08de2d2e-24e3-4f96-abe1-28879a37bb5c tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:51.539735 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-08de2d2e-24e3-4f96-abe1-28879a37bb5c tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] [instance: a80e61dd-bfe0-493e-8f38-35df4c09d687] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:51.553183 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-08de2d2e-24e3-4f96-abe1-28879a37bb5c tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:51.558079 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-08de2d2e-24e3-4f96-abe1-28879a37bb5c tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:51.558637 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-08de2d2e-24e3-4f96-abe1-28879a37bb5c tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:51.559422 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-08de2d2e-24e3-4f96-abe1-28879a37bb5c tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:51.559896 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-08de2d2e-24e3-4f96-abe1-28879a37bb5c tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:51.560336 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-08de2d2e-24e3-4f96-abe1-28879a37bb5c tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:51.700451 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-08de2d2e-24e3-4f96-abe1-28879a37bb5c tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75065b5a5084b639bdab6e7dce97302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7128b36583514196945b5a65446e3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:51.709470 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-08de2d2e-24e3-4f96-abe1-28879a37bb5c tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75065b5a5084b639bdab6e7dce97302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7128b36583514196945b5a65446e3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:51.710965 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-08de2d2e-24e3-4f96-abe1-28879a37bb5c tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75065b5a5084b639bdab6e7dce97302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7128b36583514196945b5a65446e3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:51.712328 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-08de2d2e-24e3-4f96-abe1-28879a37bb5c tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] 10.222.0.52 "GET /compute/v2.1/servers/a80e61dd-bfe0-493e-8f38-35df4c09d687" status: 200 len: 1332 microversion: 2.47 time: 0.180752 Sep 24 21:02:51.712896 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1746/3563] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:02:51 2022] GET /compute/v2.1/servers/a80e61dd-bfe0-493e-8f38-35df4c09d687 => generated 1332 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:02:51.719093 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e182193b-a705-475c-a9cd-ecb5ff766bcb tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:51.719923 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e182193b-a705-475c-a9cd-ecb5ff766bcb tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:51.727317 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e182193b-a705-475c-a9cd-ecb5ff766bcb tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:51.728595 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e182193b-a705-475c-a9cd-ecb5ff766bcb tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:51.729778 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e182193b-a705-475c-a9cd-ecb5ff766bcb tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:51.730737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e182193b-a705-475c-a9cd-ecb5ff766bcb tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:51.731360 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e182193b-a705-475c-a9cd-ecb5ff766bcb tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:51.731964 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e182193b-a705-475c-a9cd-ecb5ff766bcb tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:51.782349 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7ccc7e1a-89dd-4c34-93ed-57b48f7779b6 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0815c3afecb4fd5b23a0ee395f7aa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea87ff9b7b54a44a806283f008bd3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:51.792668 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7ccc7e1a-89dd-4c34-93ed-57b48f7779b6 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] 10.222.0.52 "GET /compute/v2.1/servers/9b4c5a65-d9d6-47b2-b64e-9d048c544ec2" status: 200 len: 1526 microversion: 2.1 time: 0.504014 Sep 24 21:02:51.793658 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1818/3564] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:51 2022] GET /compute/v2.1/servers/9b4c5a65-d9d6-47b2-b64e-9d048c544ec2 => generated 1526 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:51.799042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-18bdc256-8d9f-46d5-8b1c-3c545424c543 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Calling method '.version_select at 0x7f4b0c53eee0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:51.810765 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-18bdc256-8d9f-46d5-8b1c-3c545424c543 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:51.811699 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-18bdc256-8d9f-46d5-8b1c-3c545424c543 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:51.812222 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-18bdc256-8d9f-46d5-8b1c-3c545424c543 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:51.813020 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-18bdc256-8d9f-46d5-8b1c-3c545424c543 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] [instance: de4ec687-83cc-43ea-bed9-24ec92724907] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:51.821741 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-18bdc256-8d9f-46d5-8b1c-3c545424c543 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:51.822240 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-18bdc256-8d9f-46d5-8b1c-3c545424c543 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:51.823070 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-18bdc256-8d9f-46d5-8b1c-3c545424c543 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:51.824033 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-18bdc256-8d9f-46d5-8b1c-3c545424c543 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:51.825037 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-18bdc256-8d9f-46d5-8b1c-3c545424c543 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:51.825484 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-18bdc256-8d9f-46d5-8b1c-3c545424c543 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:51.860703 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-18bdc256-8d9f-46d5-8b1c-3c545424c543 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:51.861205 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-18bdc256-8d9f-46d5-8b1c-3c545424c543 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:51.862334 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-18bdc256-8d9f-46d5-8b1c-3c545424c543 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:51.881946 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-18bdc256-8d9f-46d5-8b1c-3c545424c543 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lazy-loading 'flavor' on Instance uuid de4ec687-83cc-43ea-bed9-24ec92724907 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:02:51.903442 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-18bdc256-8d9f-46d5-8b1c-3c545424c543 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] 10.222.0.52 "DELETE /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907/tags" status: 204 len: 0 microversion: 2.26 time: 0.108229 Sep 24 21:02:51.908839 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1819/3565] 10.222.0.52 () {60 vars in 1295 bytes} [Sat Sep 24 21:02:51 2022] DELETE /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907/tags => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 24 21:02:51.913854 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-22812f33-687a-480c-8cc0-37d1315514d4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:51.917989 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-22812f33-687a-480c-8cc0-37d1315514d4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:51.929054 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22812f33-687a-480c-8cc0-37d1315514d4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:51.930209 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22812f33-687a-480c-8cc0-37d1315514d4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:51.930938 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22812f33-687a-480c-8cc0-37d1315514d4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:51.932469 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22812f33-687a-480c-8cc0-37d1315514d4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:51.932948 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22812f33-687a-480c-8cc0-37d1315514d4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:51.933589 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22812f33-687a-480c-8cc0-37d1315514d4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:51.976722 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-22812f33-687a-480c-8cc0-37d1315514d4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.069754 Sep 24 21:02:51.977603 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1820/3566] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:02:51 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:02:51.983153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2cd70b5b-684d-4aef-b767-9fa3270a1096 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:51.983775 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2cd70b5b-684d-4aef-b767-9fa3270a1096 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: e6c97c05-a30e-4c8b-b56c-0cdae10ff44c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:51.990075 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2cd70b5b-684d-4aef-b767-9fa3270a1096 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:51.991262 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2cd70b5b-684d-4aef-b767-9fa3270a1096 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:51.991705 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2cd70b5b-684d-4aef-b767-9fa3270a1096 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:51.993522 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2cd70b5b-684d-4aef-b767-9fa3270a1096 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:51.994182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2cd70b5b-684d-4aef-b767-9fa3270a1096 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:51.995660 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2cd70b5b-684d-4aef-b767-9fa3270a1096 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:51.998577 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e182193b-a705-475c-a9cd-ecb5ff766bcb tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:52.011223 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e182193b-a705-475c-a9cd-ecb5ff766bcb tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec" status: 200 len: 1498 microversion: 2.1 time: 0.296327 Sep 24 21:02:52.015186 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1747/3567] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:51 2022] GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec => generated 1498 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:52.027213 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-62d760b4-1d46-423c-95e6-17920f74484d tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:52.027980 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-62d760b4-1d46-423c-95e6-17920f74484d tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] [instance: de4ec687-83cc-43ea-bed9-24ec92724907] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:52.036799 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62d760b4-1d46-423c-95e6-17920f74484d tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:52.037298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62d760b4-1d46-423c-95e6-17920f74484d tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:52.039932 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62d760b4-1d46-423c-95e6-17920f74484d tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:52.041268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62d760b4-1d46-423c-95e6-17920f74484d tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:52.041995 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62d760b4-1d46-423c-95e6-17920f74484d tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:52.042888 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62d760b4-1d46-423c-95e6-17920f74484d tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:52.089061 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-62d760b4-1d46-423c-95e6-17920f74484d tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] [instance: de4ec687-83cc-43ea-bed9-24ec92724907] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:02:52.189012 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-62d760b4-1d46-423c-95e6-17920f74484d tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] 10.222.0.52 "DELETE /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907" status: 204 len: 0 microversion: 2.26 time: 0.172306 Sep 24 21:02:52.189614 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1748/3568] 10.222.0.52 () {60 vars in 1280 bytes} [Sat Sep 24 21:02:52 2022] DELETE /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 24 21:02:52.198314 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4611bb59-a4e5-4545-897c-6ec45a3f6272 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:52.199162 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4611bb59-a4e5-4545-897c-6ec45a3f6272 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] [instance: de4ec687-83cc-43ea-bed9-24ec92724907] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:52.205470 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4611bb59-a4e5-4545-897c-6ec45a3f6272 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:52.206043 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4611bb59-a4e5-4545-897c-6ec45a3f6272 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:52.206593 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4611bb59-a4e5-4545-897c-6ec45a3f6272 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:52.207858 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4611bb59-a4e5-4545-897c-6ec45a3f6272 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:52.208415 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4611bb59-a4e5-4545-897c-6ec45a3f6272 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:52.209396 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4611bb59-a4e5-4545-897c-6ec45a3f6272 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:52.243329 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2cd70b5b-684d-4aef-b767-9fa3270a1096 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:52.251857 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2cd70b5b-684d-4aef-b767-9fa3270a1096 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c" status: 200 len: 1513 microversion: 2.1 time: 0.272999 Sep 24 21:02:52.252446 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1821/3569] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:51 2022] GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c => generated 1513 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:52.423910 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4611bb59-a4e5-4545-897c-6ec45a3f6272 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c9d24e7a7a94cbd9f235519ac791361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af0aa4ac07b40baa00186abc14ee5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:52.432275 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4611bb59-a4e5-4545-897c-6ec45a3f6272 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c9d24e7a7a94cbd9f235519ac791361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af0aa4ac07b40baa00186abc14ee5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:52.433803 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4611bb59-a4e5-4545-897c-6ec45a3f6272 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c9d24e7a7a94cbd9f235519ac791361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af0aa4ac07b40baa00186abc14ee5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:52.435025 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4611bb59-a4e5-4545-897c-6ec45a3f6272 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] 10.222.0.52 "GET /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907" status: 200 len: 1551 microversion: 2.26 time: 0.241189 Sep 24 21:02:52.435603 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1749/3570] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:02:52 2022] GET /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907 => generated 1551 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:02:52.739647 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-49bd9b49-c896-4313-af46-d452d88ddcc6 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:52.740269 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-49bd9b49-c896-4313-af46-d452d88ddcc6 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] [instance: a80e61dd-bfe0-493e-8f38-35df4c09d687] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:52.746439 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-49bd9b49-c896-4313-af46-d452d88ddcc6 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:52.746989 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-49bd9b49-c896-4313-af46-d452d88ddcc6 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:52.747429 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-49bd9b49-c896-4313-af46-d452d88ddcc6 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:52.748139 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-49bd9b49-c896-4313-af46-d452d88ddcc6 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:52.748598 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-49bd9b49-c896-4313-af46-d452d88ddcc6 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:52.749028 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-49bd9b49-c896-4313-af46-d452d88ddcc6 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:52.816779 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2bcce68c-10a9-410e-a445-d17e723f0e23 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:52.817393 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2bcce68c-10a9-410e-a445-d17e723f0e23 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] [instance: 9b4c5a65-d9d6-47b2-b64e-9d048c544ec2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:52.824538 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2bcce68c-10a9-410e-a445-d17e723f0e23 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:52.824697 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-49bd9b49-c896-4313-af46-d452d88ddcc6 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75065b5a5084b639bdab6e7dce97302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7128b36583514196945b5a65446e3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:52.825084 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2bcce68c-10a9-410e-a445-d17e723f0e23 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:52.825456 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2bcce68c-10a9-410e-a445-d17e723f0e23 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:52.826160 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2bcce68c-10a9-410e-a445-d17e723f0e23 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:52.826829 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2bcce68c-10a9-410e-a445-d17e723f0e23 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:52.827261 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2bcce68c-10a9-410e-a445-d17e723f0e23 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:52.833380 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-49bd9b49-c896-4313-af46-d452d88ddcc6 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75065b5a5084b639bdab6e7dce97302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7128b36583514196945b5a65446e3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:52.834890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-49bd9b49-c896-4313-af46-d452d88ddcc6 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75065b5a5084b639bdab6e7dce97302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7128b36583514196945b5a65446e3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:52.836195 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-49bd9b49-c896-4313-af46-d452d88ddcc6 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] 10.222.0.52 "GET /compute/v2.1/servers/a80e61dd-bfe0-493e-8f38-35df4c09d687" status: 200 len: 1338 microversion: 2.47 time: 0.100538 Sep 24 21:02:52.836794 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1822/3571] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:02:52 2022] GET /compute/v2.1/servers/a80e61dd-bfe0-493e-8f38-35df4c09d687 => generated 1338 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:02:52.989842 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b0fb1ee1-ab82-414d-9482-4939ac6547b1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:52.991772 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b0fb1ee1-ab82-414d-9482-4939ac6547b1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:52.998054 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0fb1ee1-ab82-414d-9482-4939ac6547b1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:52.998583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0fb1ee1-ab82-414d-9482-4939ac6547b1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:52.999034 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0fb1ee1-ab82-414d-9482-4939ac6547b1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:52.999751 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0fb1ee1-ab82-414d-9482-4939ac6547b1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:53.000212 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0fb1ee1-ab82-414d-9482-4939ac6547b1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:53.000709 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0fb1ee1-ab82-414d-9482-4939ac6547b1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:53.031493 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b0fb1ee1-ab82-414d-9482-4939ac6547b1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.046059 Sep 24 21:02:53.032074 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1823/3572] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:02:52 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 21:02:53.041918 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c3f0d20d-e753-4de2-bb45-ad035004c290 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:53.042595 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c3f0d20d-e753-4de2-bb45-ad035004c290 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:53.049014 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3f0d20d-e753-4de2-bb45-ad035004c290 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:53.049219 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3f0d20d-e753-4de2-bb45-ad035004c290 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:53.049622 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3f0d20d-e753-4de2-bb45-ad035004c290 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:53.050339 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3f0d20d-e753-4de2-bb45-ad035004c290 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:53.050839 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3f0d20d-e753-4de2-bb45-ad035004c290 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:53.051281 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3f0d20d-e753-4de2-bb45-ad035004c290 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:53.062578 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2bcce68c-10a9-410e-a445-d17e723f0e23 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0815c3afecb4fd5b23a0ee395f7aa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea87ff9b7b54a44a806283f008bd3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:53.071116 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2bcce68c-10a9-410e-a445-d17e723f0e23 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] 10.222.0.52 "GET /compute/v2.1/servers/9b4c5a65-d9d6-47b2-b64e-9d048c544ec2" status: 200 len: 1526 microversion: 2.1 time: 0.257974 Sep 24 21:02:53.072121 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1750/3573] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:52 2022] GET /compute/v2.1/servers/9b4c5a65-d9d6-47b2-b64e-9d048c544ec2 => generated 1526 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:02:53.282196 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3e451fec-2fda-44d4-9455-a79328fa9763 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:53.283160 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3e451fec-2fda-44d4-9455-a79328fa9763 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: e6c97c05-a30e-4c8b-b56c-0cdae10ff44c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:53.290657 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e451fec-2fda-44d4-9455-a79328fa9763 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:53.291201 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e451fec-2fda-44d4-9455-a79328fa9763 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:53.291829 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e451fec-2fda-44d4-9455-a79328fa9763 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:53.292537 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e451fec-2fda-44d4-9455-a79328fa9763 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:53.292994 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e451fec-2fda-44d4-9455-a79328fa9763 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:53.293423 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e451fec-2fda-44d4-9455-a79328fa9763 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:53.308889 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c3f0d20d-e753-4de2-bb45-ad035004c290 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:53.317598 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c3f0d20d-e753-4de2-bb45-ad035004c290 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec" status: 200 len: 1498 microversion: 2.1 time: 0.279898 Sep 24 21:02:53.330553 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1824/3574] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:53 2022] GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec => generated 1498 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:53.461326 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-71a60051-4933-4e80-81d1-fa3da504ddc6 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:53.462157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-71a60051-4933-4e80-81d1-fa3da504ddc6 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] [instance: de4ec687-83cc-43ea-bed9-24ec92724907] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:53.469427 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71a60051-4933-4e80-81d1-fa3da504ddc6 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:53.469638 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71a60051-4933-4e80-81d1-fa3da504ddc6 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:53.470009 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71a60051-4933-4e80-81d1-fa3da504ddc6 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:53.470751 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71a60051-4933-4e80-81d1-fa3da504ddc6 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:53.471211 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71a60051-4933-4e80-81d1-fa3da504ddc6 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:53.472635 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71a60051-4933-4e80-81d1-fa3da504ddc6 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:53.586124 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3e451fec-2fda-44d4-9455-a79328fa9763 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:53.590668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:UPDATE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:02:53.596670 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3e451fec-2fda-44d4-9455-a79328fa9763 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c" status: 200 len: 1513 microversion: 2.1 time: 0.318067 Sep 24 21:02:53.597377 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1751/3575] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:53 2022] GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c => generated 1513 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:53.778874 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-71a60051-4933-4e80-81d1-fa3da504ddc6 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c9d24e7a7a94cbd9f235519ac791361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af0aa4ac07b40baa00186abc14ee5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:53.788902 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-71a60051-4933-4e80-81d1-fa3da504ddc6 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c9d24e7a7a94cbd9f235519ac791361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af0aa4ac07b40baa00186abc14ee5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:53.790345 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-71a60051-4933-4e80-81d1-fa3da504ddc6 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c9d24e7a7a94cbd9f235519ac791361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af0aa4ac07b40baa00186abc14ee5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:53.792360 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-71a60051-4933-4e80-81d1-fa3da504ddc6 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] 10.222.0.52 "GET /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907" status: 200 len: 1551 microversion: 2.26 time: 0.335033 Sep 24 21:02:53.793192 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1825/3576] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:02:53 2022] GET /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907 => generated 1551 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:02:53.863751 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-481ee272-035a-43f9-9e16-eff912236b56 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:53.864544 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-481ee272-035a-43f9-9e16-eff912236b56 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] [instance: a80e61dd-bfe0-493e-8f38-35df4c09d687] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:53.874044 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-481ee272-035a-43f9-9e16-eff912236b56 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:53.874813 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-481ee272-035a-43f9-9e16-eff912236b56 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:53.875321 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-481ee272-035a-43f9-9e16-eff912236b56 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:53.876112 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-481ee272-035a-43f9-9e16-eff912236b56 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:53.876643 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-481ee272-035a-43f9-9e16-eff912236b56 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:53.878845 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-481ee272-035a-43f9-9e16-eff912236b56 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:53.987122 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-481ee272-035a-43f9-9e16-eff912236b56 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75065b5a5084b639bdab6e7dce97302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7128b36583514196945b5a65446e3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:53.996194 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-481ee272-035a-43f9-9e16-eff912236b56 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75065b5a5084b639bdab6e7dce97302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7128b36583514196945b5a65446e3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:53.997750 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-481ee272-035a-43f9-9e16-eff912236b56 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75065b5a5084b639bdab6e7dce97302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7128b36583514196945b5a65446e3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:53.998945 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-481ee272-035a-43f9-9e16-eff912236b56 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] 10.222.0.52 "GET /compute/v2.1/servers/a80e61dd-bfe0-493e-8f38-35df4c09d687" status: 200 len: 1338 microversion: 2.47 time: 0.139468 Sep 24 21:02:53.999542 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1752/3577] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:02:53 2022] GET /compute/v2.1/servers/a80e61dd-bfe0-493e-8f38-35df4c09d687 => generated 1338 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:02:54.045642 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-197bbe86-f9fd-4a55-a01c-980da229d04a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:54.047967 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-197bbe86-f9fd-4a55-a01c-980da229d04a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:54.054850 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-197bbe86-f9fd-4a55-a01c-980da229d04a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:54.055342 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-197bbe86-f9fd-4a55-a01c-980da229d04a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:54.055780 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-197bbe86-f9fd-4a55-a01c-980da229d04a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:54.056488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-197bbe86-f9fd-4a55-a01c-980da229d04a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:54.057487 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-197bbe86-f9fd-4a55-a01c-980da229d04a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:54.058330 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-197bbe86-f9fd-4a55-a01c-980da229d04a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:54.094165 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-197bbe86-f9fd-4a55-a01c-980da229d04a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.053513 Sep 24 21:02:54.094789 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1826/3578] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:02:54 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:02:54.097042 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0dce51b5-7d29-478b-a8b9-3122b8844468 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:54.097674 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0dce51b5-7d29-478b-a8b9-3122b8844468 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] [instance: 9b4c5a65-d9d6-47b2-b64e-9d048c544ec2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:54.104830 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0dce51b5-7d29-478b-a8b9-3122b8844468 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:54.105246 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0dce51b5-7d29-478b-a8b9-3122b8844468 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:54.105691 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0dce51b5-7d29-478b-a8b9-3122b8844468 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:54.106442 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0dce51b5-7d29-478b-a8b9-3122b8844468 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:54.107003 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0dce51b5-7d29-478b-a8b9-3122b8844468 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:54.107439 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0dce51b5-7d29-478b-a8b9-3122b8844468 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:54.345810 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-576fc8d9-b5d8-4caa-9798-66d1c63ac1fd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:54.346451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-576fc8d9-b5d8-4caa-9798-66d1c63ac1fd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:54.352692 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-576fc8d9-b5d8-4caa-9798-66d1c63ac1fd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:54.353179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-576fc8d9-b5d8-4caa-9798-66d1c63ac1fd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:54.353652 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-576fc8d9-b5d8-4caa-9798-66d1c63ac1fd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:54.355383 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-576fc8d9-b5d8-4caa-9798-66d1c63ac1fd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:54.355866 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-576fc8d9-b5d8-4caa-9798-66d1c63ac1fd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:54.356299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-576fc8d9-b5d8-4caa-9798-66d1c63ac1fd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:54.752176 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0dce51b5-7d29-478b-a8b9-3122b8844468 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0815c3afecb4fd5b23a0ee395f7aa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea87ff9b7b54a44a806283f008bd3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:54.760748 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0dce51b5-7d29-478b-a8b9-3122b8844468 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] 10.222.0.52 "GET /compute/v2.1/servers/9b4c5a65-d9d6-47b2-b64e-9d048c544ec2" status: 200 len: 1526 microversion: 2.1 time: 0.668630 Sep 24 21:02:54.761348 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1753/3579] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:54 2022] GET /compute/v2.1/servers/9b4c5a65-d9d6-47b2-b64e-9d048c544ec2 => generated 1526 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:54.790792 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a2c38165-4a2b-413f-9b3d-1e155cf99b5d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:54.791944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a2c38165-4a2b-413f-9b3d-1e155cf99b5d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: e6c97c05-a30e-4c8b-b56c-0cdae10ff44c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:54.808181 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a2c38165-4a2b-413f-9b3d-1e155cf99b5d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:54.810755 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a2c38165-4a2b-413f-9b3d-1e155cf99b5d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:54.811223 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a2c38165-4a2b-413f-9b3d-1e155cf99b5d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:54.814831 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a2c38165-4a2b-413f-9b3d-1e155cf99b5d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:54.815460 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a2c38165-4a2b-413f-9b3d-1e155cf99b5d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:54.816150 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a2c38165-4a2b-413f-9b3d-1e155cf99b5d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:54.891886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-576fc8d9-b5d8-4caa-9798-66d1c63ac1fd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:54.900000 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-576fc8d9-b5d8-4caa-9798-66d1c63ac1fd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec" status: 200 len: 1498 microversion: 2.1 time: 0.558463 Sep 24 21:02:54.901217 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1827/3580] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:54 2022] GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec => generated 1498 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:02:54.905770 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3eb74195-a601-494f-87f6-f3f530422423 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:54.906643 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3eb74195-a601-494f-87f6-f3f530422423 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] [instance: de4ec687-83cc-43ea-bed9-24ec92724907] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:54.912831 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3eb74195-a601-494f-87f6-f3f530422423 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:54.913321 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3eb74195-a601-494f-87f6-f3f530422423 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:54.913764 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3eb74195-a601-494f-87f6-f3f530422423 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:54.914475 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3eb74195-a601-494f-87f6-f3f530422423 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:54.915113 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3eb74195-a601-494f-87f6-f3f530422423 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:54.915577 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3eb74195-a601-494f-87f6-f3f530422423 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:55.314354 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a2c38165-4a2b-413f-9b3d-1e155cf99b5d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:55.328121 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a2c38165-4a2b-413f-9b3d-1e155cf99b5d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c" status: 200 len: 1513 microversion: 2.1 time: 0.541272 Sep 24 21:02:55.334102 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1754/3581] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:54 2022] GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c => generated 1513 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:55.346245 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0ab331e3-e006-4f90-a426-d64c5010b68a tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:55.347297 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0ab331e3-e006-4f90-a426-d64c5010b68a tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] [instance: a80e61dd-bfe0-493e-8f38-35df4c09d687] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:55.352149 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3eb74195-a601-494f-87f6-f3f530422423 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c9d24e7a7a94cbd9f235519ac791361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af0aa4ac07b40baa00186abc14ee5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:55.373210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0ab331e3-e006-4f90-a426-d64c5010b68a tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:55.374082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0ab331e3-e006-4f90-a426-d64c5010b68a tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:55.374827 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0ab331e3-e006-4f90-a426-d64c5010b68a tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:55.375902 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0ab331e3-e006-4f90-a426-d64c5010b68a tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:55.377648 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3eb74195-a601-494f-87f6-f3f530422423 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c9d24e7a7a94cbd9f235519ac791361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af0aa4ac07b40baa00186abc14ee5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:55.378033 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0ab331e3-e006-4f90-a426-d64c5010b68a tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:55.378713 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0ab331e3-e006-4f90-a426-d64c5010b68a tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:55.385429 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3eb74195-a601-494f-87f6-f3f530422423 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c9d24e7a7a94cbd9f235519ac791361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af0aa4ac07b40baa00186abc14ee5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:55.388184 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3eb74195-a601-494f-87f6-f3f530422423 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] 10.222.0.52 "GET /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907" status: 200 len: 1551 microversion: 2.26 time: 0.485972 Sep 24 21:02:55.390215 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1828/3582] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:02:54 2022] GET /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907 => generated 1551 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:02:55.404770 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ad091512-e67a-4a5e-83fd-3a4a1f4db1dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:55.413863 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ad091512-e67a-4a5e-83fd-3a4a1f4db1dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:55.427069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad091512-e67a-4a5e-83fd-3a4a1f4db1dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:55.433918 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad091512-e67a-4a5e-83fd-3a4a1f4db1dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:55.434571 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad091512-e67a-4a5e-83fd-3a4a1f4db1dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:55.435830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad091512-e67a-4a5e-83fd-3a4a1f4db1dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:55.436557 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad091512-e67a-4a5e-83fd-3a4a1f4db1dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:55.437128 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad091512-e67a-4a5e-83fd-3a4a1f4db1dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:55.479324 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ad091512-e67a-4a5e-83fd-3a4a1f4db1dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.085558 Sep 24 21:02:55.481575 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1829/3583] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:02:55 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:02:55.540329 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0ab331e3-e006-4f90-a426-d64c5010b68a tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75065b5a5084b639bdab6e7dce97302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7128b36583514196945b5a65446e3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:55.581622 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0ab331e3-e006-4f90-a426-d64c5010b68a tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75065b5a5084b639bdab6e7dce97302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7128b36583514196945b5a65446e3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:55.590387 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0ab331e3-e006-4f90-a426-d64c5010b68a tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75065b5a5084b639bdab6e7dce97302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7128b36583514196945b5a65446e3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:55.592412 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0ab331e3-e006-4f90-a426-d64c5010b68a tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] 10.222.0.52 "GET /compute/v2.1/servers/a80e61dd-bfe0-493e-8f38-35df4c09d687" status: 200 len: 1338 microversion: 2.47 time: 0.255120 Sep 24 21:02:55.599120 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1755/3584] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:02:55 2022] GET /compute/v2.1/servers/a80e61dd-bfe0-493e-8f38-35df4c09d687 => generated 1338 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:02:55.620134 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-503caff5-dcde-48a4-9aff-a91c5c5a4c6d req-340f8d3d-0ad7-4236-b238-47a77c166406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b4c5a65-d9d6-47b2-b64e-9d048c544ec2", "name": "network-vif-deleted", "tag": "f9d18e66-7d10-4aa4-b762-8793427bfb44"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:02:55.632320 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-503caff5-dcde-48a4-9aff-a91c5c5a4c6d req-340f8d3d-0ad7-4236-b238-47a77c166406 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:55.633263 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-503caff5-dcde-48a4-9aff-a91c5c5a4c6d req-340f8d3d-0ad7-4236-b238-47a77c166406 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:55.633919 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-503caff5-dcde-48a4-9aff-a91c5c5a4c6d req-340f8d3d-0ad7-4236-b238-47a77c166406 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:55.672181 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-503caff5-dcde-48a4-9aff-a91c5c5a4c6d req-340f8d3d-0ad7-4236-b238-47a77c166406 service nova] Creating event network-vif-deleted:f9d18e66-7d10-4aa4-b762-8793427bfb44 for instance 9b4c5a65-d9d6-47b2-b64e-9d048c544ec2 on nch1-master-1 Sep 24 21:02:55.678883 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-503caff5-dcde-48a4-9aff-a91c5c5a4c6d req-340f8d3d-0ad7-4236-b238-47a77c166406 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064895 Sep 24 21:02:55.680024 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1830/3585] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:02:55.784229 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a9b5fc6b-ce32-44c5-bc53-d27e8af14f28 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:55.785006 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a9b5fc6b-ce32-44c5-bc53-d27e8af14f28 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] [instance: 9b4c5a65-d9d6-47b2-b64e-9d048c544ec2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:55.791652 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9b5fc6b-ce32-44c5-bc53-d27e8af14f28 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:55.792155 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9b5fc6b-ce32-44c5-bc53-d27e8af14f28 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:55.792606 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9b5fc6b-ce32-44c5-bc53-d27e8af14f28 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:55.793326 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9b5fc6b-ce32-44c5-bc53-d27e8af14f28 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:55.793790 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9b5fc6b-ce32-44c5-bc53-d27e8af14f28 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:55.794820 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9b5fc6b-ce32-44c5-bc53-d27e8af14f28 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:55.883183 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9b5fc6b-ce32-44c5-bc53-d27e8af14f28 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:55.883918 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9b5fc6b-ce32-44c5-bc53-d27e8af14f28 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:55.884524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9b5fc6b-ce32-44c5-bc53-d27e8af14f28 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:55.885753 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-a9b5fc6b-ce32-44c5-bc53-d27e8af14f28 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lazy-loading 'fault' on Instance uuid 9b4c5a65-d9d6-47b2-b64e-9d048c544ec2 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:02:55.930467 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b5494c17-b8c4-4b69-9c92-cd52cc94570a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:55.931483 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b5494c17-b8c4-4b69-9c92-cd52cc94570a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:55.962713 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5494c17-b8c4-4b69-9c92-cd52cc94570a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:55.963805 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5494c17-b8c4-4b69-9c92-cd52cc94570a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:55.970337 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5494c17-b8c4-4b69-9c92-cd52cc94570a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:55.971190 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5494c17-b8c4-4b69-9c92-cd52cc94570a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:55.971689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5494c17-b8c4-4b69-9c92-cd52cc94570a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:55.972142 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5494c17-b8c4-4b69-9c92-cd52cc94570a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:55.981845 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a9b5fc6b-ce32-44c5-bc53-d27e8af14f28 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0815c3afecb4fd5b23a0ee395f7aa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea87ff9b7b54a44a806283f008bd3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:56.015323 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a9b5fc6b-ce32-44c5-bc53-d27e8af14f28 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] 10.222.0.52 "GET /compute/v2.1/servers/9b4c5a65-d9d6-47b2-b64e-9d048c544ec2" status: 200 len: 1313 microversion: 2.1 time: 0.234354 Sep 24 21:02:56.018252 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1756/3586] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:55 2022] GET /compute/v2.1/servers/9b4c5a65-d9d6-47b2-b64e-9d048c544ec2 => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:56.152520 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-d314c86c-c937-48f3-8dd5-daca2c371afd req-ee32dee0-f276-4a45-aa21-19686db120ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de4ec687-83cc-43ea-bed9-24ec92724907", "name": "network-vif-deleted", "tag": "b9922c9f-dd9d-4a56-8f56-8211e7c07c8a"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:02:56.194202 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b5494c17-b8c4-4b69-9c92-cd52cc94570a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:56.204776 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-d314c86c-c937-48f3-8dd5-daca2c371afd req-ee32dee0-f276-4a45-aa21-19686db120ac service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:56.205497 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-d314c86c-c937-48f3-8dd5-daca2c371afd req-ee32dee0-f276-4a45-aa21-19686db120ac service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:56.206352 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b5494c17-b8c4-4b69-9c92-cd52cc94570a tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec" status: 200 len: 1290 microversion: 2.1 time: 0.285425 Sep 24 21:02:56.207283 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-d314c86c-c937-48f3-8dd5-daca2c371afd req-ee32dee0-f276-4a45-aa21-19686db120ac service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:56.207667 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1831/3587] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:55 2022] GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec => generated 1290 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:56.243376 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-d314c86c-c937-48f3-8dd5-daca2c371afd req-ee32dee0-f276-4a45-aa21-19686db120ac service nova] Creating event network-vif-deleted:b9922c9f-dd9d-4a56-8f56-8211e7c07c8a for instance de4ec687-83cc-43ea-bed9-24ec92724907 on nch2-master-1 Sep 24 21:02:56.254162 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-d314c86c-c937-48f3-8dd5-daca2c371afd req-ee32dee0-f276-4a45-aa21-19686db120ac service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106440 Sep 24 21:02:56.254814 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1757/3588] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:02:56.356115 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5f37b635-6960-44c4-9878-65b7aa830bb0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:56.357441 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5f37b635-6960-44c4-9878-65b7aa830bb0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: e6c97c05-a30e-4c8b-b56c-0cdae10ff44c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:56.368097 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f37b635-6960-44c4-9878-65b7aa830bb0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:56.376378 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f37b635-6960-44c4-9878-65b7aa830bb0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:56.377150 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f37b635-6960-44c4-9878-65b7aa830bb0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:56.378235 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f37b635-6960-44c4-9878-65b7aa830bb0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:56.378957 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f37b635-6960-44c4-9878-65b7aa830bb0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:56.379689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f37b635-6960-44c4-9878-65b7aa830bb0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:56.385640 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1,nova_cell1:DELETE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:02:56.418159 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-39baa110-217a-4024-af12-5fdc7276de5b tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:56.427014 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-39baa110-217a-4024-af12-5fdc7276de5b tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] [instance: de4ec687-83cc-43ea-bed9-24ec92724907] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:56.440611 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-39baa110-217a-4024-af12-5fdc7276de5b tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:56.442009 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-39baa110-217a-4024-af12-5fdc7276de5b tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:56.444674 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-39baa110-217a-4024-af12-5fdc7276de5b tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:56.445668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-39baa110-217a-4024-af12-5fdc7276de5b tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:56.446807 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-39baa110-217a-4024-af12-5fdc7276de5b tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:56.448515 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-39baa110-217a-4024-af12-5fdc7276de5b tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:56.503292 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-39baa110-217a-4024-af12-5fdc7276de5b tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:56.504006 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-39baa110-217a-4024-af12-5fdc7276de5b tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:56.504612 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-39baa110-217a-4024-af12-5fdc7276de5b tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:56.505388 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-39baa110-217a-4024-af12-5fdc7276de5b tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lazy-loading 'fault' on Instance uuid de4ec687-83cc-43ea-bed9-24ec92724907 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:02:56.624344 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-39baa110-217a-4024-af12-5fdc7276de5b tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c9d24e7a7a94cbd9f235519ac791361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af0aa4ac07b40baa00186abc14ee5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:56.646522 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-39baa110-217a-4024-af12-5fdc7276de5b tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c9d24e7a7a94cbd9f235519ac791361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af0aa4ac07b40baa00186abc14ee5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:56.651342 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-39baa110-217a-4024-af12-5fdc7276de5b tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c9d24e7a7a94cbd9f235519ac791361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af0aa4ac07b40baa00186abc14ee5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:56.656453 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-39baa110-217a-4024-af12-5fdc7276de5b tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] 10.222.0.52 "GET /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907" status: 200 len: 1351 microversion: 2.26 time: 0.242755 Sep 24 21:02:56.657060 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1758/3589] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:02:56 2022] GET /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907 => generated 1351 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:02:56.682204 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bd6eb08f-02a5-40e3-9939-9a9c7abd7e30 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:56.685510 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bd6eb08f-02a5-40e3-9939-9a9c7abd7e30 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:56.692183 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bd6eb08f-02a5-40e3-9939-9a9c7abd7e30 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:56.693249 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bd6eb08f-02a5-40e3-9939-9a9c7abd7e30 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:56.693919 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bd6eb08f-02a5-40e3-9939-9a9c7abd7e30 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:56.695527 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bd6eb08f-02a5-40e3-9939-9a9c7abd7e30 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:56.696562 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bd6eb08f-02a5-40e3-9939-9a9c7abd7e30 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:56.697232 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bd6eb08f-02a5-40e3-9939-9a9c7abd7e30 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:56.743350 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bd6eb08f-02a5-40e3-9939-9a9c7abd7e30 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.066507 Sep 24 21:02:56.744544 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1759/3590] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:02:56 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:02:56.753732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dab6f2c6-e784-44c7-86b2-7b05afbaddfc tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:56.755013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dab6f2c6-e784-44c7-86b2-7b05afbaddfc tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] [instance: a80e61dd-bfe0-493e-8f38-35df4c09d687] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:56.776414 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dab6f2c6-e784-44c7-86b2-7b05afbaddfc tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:56.776960 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dab6f2c6-e784-44c7-86b2-7b05afbaddfc tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:56.777413 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dab6f2c6-e784-44c7-86b2-7b05afbaddfc tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:56.778151 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dab6f2c6-e784-44c7-86b2-7b05afbaddfc tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:56.778651 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dab6f2c6-e784-44c7-86b2-7b05afbaddfc tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:56.779090 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dab6f2c6-e784-44c7-86b2-7b05afbaddfc tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:56.837357 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5f37b635-6960-44c4-9878-65b7aa830bb0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:56.850452 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5f37b635-6960-44c4-9878-65b7aa830bb0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c" status: 200 len: 1513 microversion: 2.1 time: 0.496978 Sep 24 21:02:56.855493 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1832/3591] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:56 2022] GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c => generated 1513 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:56.878869 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dab6f2c6-e784-44c7-86b2-7b05afbaddfc tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75065b5a5084b639bdab6e7dce97302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7128b36583514196945b5a65446e3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:56.888672 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dab6f2c6-e784-44c7-86b2-7b05afbaddfc tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75065b5a5084b639bdab6e7dce97302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7128b36583514196945b5a65446e3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:56.890127 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dab6f2c6-e784-44c7-86b2-7b05afbaddfc tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75065b5a5084b639bdab6e7dce97302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7128b36583514196945b5a65446e3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:56.891322 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dab6f2c6-e784-44c7-86b2-7b05afbaddfc tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] 10.222.0.52 "GET /compute/v2.1/servers/a80e61dd-bfe0-493e-8f38-35df4c09d687" status: 200 len: 1359 microversion: 2.47 time: 0.145504 Sep 24 21:02:56.891910 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1760/3592] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:02:56 2022] GET /compute/v2.1/servers/a80e61dd-bfe0-493e-8f38-35df4c09d687 => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:02:56.919294 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-514459ac-1971-4e34-851e-057f6f41a7c6 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1098955788"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:02:56.921938 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-514459ac-1971-4e34-851e-057f6f41a7c6 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] [instance: a80e61dd-bfe0-493e-8f38-35df4c09d687] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:56.929022 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-514459ac-1971-4e34-851e-057f6f41a7c6 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:56.930335 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-514459ac-1971-4e34-851e-057f6f41a7c6 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:56.930729 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-514459ac-1971-4e34-851e-057f6f41a7c6 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:56.931725 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-514459ac-1971-4e34-851e-057f6f41a7c6 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:56.932496 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-514459ac-1971-4e34-851e-057f6f41a7c6 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:56.932837 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-514459ac-1971-4e34-851e-057f6f41a7c6 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:57.045315 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4e22ed8e-28ac-4c27-b7d5-c6b84aebbd54 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:57.046003 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4e22ed8e-28ac-4c27-b7d5-c6b84aebbd54 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] [instance: 9b4c5a65-d9d6-47b2-b64e-9d048c544ec2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:57.053606 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e22ed8e-28ac-4c27-b7d5-c6b84aebbd54 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:57.054126 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e22ed8e-28ac-4c27-b7d5-c6b84aebbd54 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:57.054720 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e22ed8e-28ac-4c27-b7d5-c6b84aebbd54 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:57.055458 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e22ed8e-28ac-4c27-b7d5-c6b84aebbd54 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:57.056161 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e22ed8e-28ac-4c27-b7d5-c6b84aebbd54 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:57.056656 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e22ed8e-28ac-4c27-b7d5-c6b84aebbd54 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:57.074461 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-4e22ed8e-28ac-4c27-b7d5-c6b84aebbd54 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] HTTP exception thrown: Instance 9b4c5a65-d9d6-47b2-b64e-9d048c544ec2 could not be found. Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4e22ed8e-28ac-4c27-b7d5-c6b84aebbd54 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Request method failure captured: Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/9b4c5a65-d9d6-47b2-b64e-9d048c544ec2 HTTP/1.1 Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3BcAXO6-IxcZ0MYeGyT72JPYNqI4IAnjQTz_t0NH1ytLj7857qvVlWD8sI26ex6CJDngsMF20bDZJDm0aCsucAACh_vgzT61-tfgSDWANfO0VPGX9i2uJzvvZ68GTGN1KO7uVzfcUXYPJ9Z8JGWubwIY151JosfATxcDAlgWLHDz2g Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 2ea87ff9b7b54a44a806283f008bd3d1 Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1928850691 Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ea87ff9b7b54a44a806283f008bd3d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2ea87ff9b7b54a44a806283f008bd3d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2ea87ff9b7b54a44a806283f008bd3d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ea87ff9b7b54a44a806283f008bd3d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1928850691 Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 2ea87ff9b7b54a44a806283f008bd3d1 Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1928850691 Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServerMetadataNegativeTestJSON-1928850691-project Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: a0815c3afecb4fd5b23a0ee395f7aa5e Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1928850691-project Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 9b4c5a65-d9d6-47b2-b64e-9d048c544ec2 could not be found. Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '9b4c5a65-d9d6-47b2-b64e-9d048c544ec2'} Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b4c5a65-d9d6-47b2-b64e-9d048c544ec2 could not be found. Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b4c5a65-d9d6-47b2-b64e-9d048c544ec2 could not be found. Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.076203 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:57.080299 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.080299 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:57.080299 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:57.080299 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:57.080299 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:02:57.080299 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:02:57.080299 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b4c5a65-d9d6-47b2-b64e-9d048c544ec2 could not be found. Sep 24 21:02:57.080299 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.080299 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4e22ed8e-28ac-4c27-b7d5-c6b84aebbd54 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] Returning 404 to user: Instance 9b4c5a65-d9d6-47b2-b64e-9d048c544ec2 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:02:57.080299 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4e22ed8e-28ac-4c27-b7d5-c6b84aebbd54 tempest-ServerMetadataNegativeTestJSON-1928850691 tempest-ServerMetadataNegativeTestJSON-1928850691-project] 10.222.0.52 "GET /compute/v2.1/servers/9b4c5a65-d9d6-47b2-b64e-9d048c544ec2" status: 404 len: 111 microversion: 2.1 time: 0.037473 Sep 24 21:02:57.081904 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1761/3593] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:57 2022] GET /compute/v2.1/servers/9b4c5a65-d9d6-47b2-b64e-9d048c544ec2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 21:02:57.195851 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-514459ac-1971-4e34-851e-057f6f41a7c6 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] 10.222.0.52 "POST /compute/v2.1/servers/a80e61dd-bfe0-493e-8f38-35df4c09d687/action" status: 202 len: 52 microversion: 2.47 time: 0.275894 Sep 24 21:02:57.197754 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1833/3594] 10.222.0.52 () {62 vars in 1319 bytes} [Sat Sep 24 21:02:56 2022] POST /compute/v2.1/servers/a80e61dd-bfe0-493e-8f38-35df4c09d687/action => generated 52 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Sep 24 21:02:57.209447 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6ed54a48-adf3-4879-9c30-25ed99b02c5b tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:57.210797 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6ed54a48-adf3-4879-9c30-25ed99b02c5b tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] [instance: a80e61dd-bfe0-493e-8f38-35df4c09d687] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:57.219894 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ed54a48-adf3-4879-9c30-25ed99b02c5b tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:57.220659 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ed54a48-adf3-4879-9c30-25ed99b02c5b tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:57.221285 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ed54a48-adf3-4879-9c30-25ed99b02c5b tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:57.222214 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ed54a48-adf3-4879-9c30-25ed99b02c5b tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:57.222957 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ed54a48-adf3-4879-9c30-25ed99b02c5b tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:57.223540 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ed54a48-adf3-4879-9c30-25ed99b02c5b tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:57.234099 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-93a295df-1058-4a9a-a32c-33595049cb54 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:57.235061 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-93a295df-1058-4a9a-a32c-33595049cb54 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:57.242863 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93a295df-1058-4a9a-a32c-33595049cb54 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:57.244463 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93a295df-1058-4a9a-a32c-33595049cb54 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:57.245280 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93a295df-1058-4a9a-a32c-33595049cb54 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:57.246120 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93a295df-1058-4a9a-a32c-33595049cb54 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:57.246780 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93a295df-1058-4a9a-a32c-33595049cb54 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:57.247314 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93a295df-1058-4a9a-a32c-33595049cb54 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:57.257425 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6ed54a48-adf3-4879-9c30-25ed99b02c5b tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] [instance: a80e61dd-bfe0-493e-8f38-35df4c09d687] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:02:57.267929 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-93a295df-1058-4a9a-a32c-33595049cb54 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] HTTP exception thrown: Instance 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec could not be found. Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-93a295df-1058-4a9a-a32c-33595049cb54 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Request method failure captured: Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec HTTP/1.1 Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL29-X0U31bWS-OdLHgyvrqJ9cKeXdCQcU5XDw5ndql8wo4-9uoBN2em1wysBqNzzzY5Bp3FNsC7GdcmIawuHD1dS6A2amzvS90hoLHvMsCDbASCEoRJt0wxOm48tnGq2wGlMnRgEB8mO_grzOCcTdRgOgaHbZsmHcINVEnjYdvyWtzs Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 8340f7f8fa9848dc822903c738f78f2a Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 8340f7f8fa9848dc822903c738f78f2a Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-DeleteServersTestJSON-1814924671-project Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: ee21da3ff38a43798bce50c9aba4ae33 Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-DeleteServersTestJSON-1814924671-project Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec could not be found. Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '2274cc1a-6e7c-4ea0-a28b-c5f642a734ec'} Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec could not be found. Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec could not be found. Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:57.269861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.274688 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:57.274688 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:57.274688 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:57.274688 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:02:57.274688 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:02:57.274688 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec could not be found. Sep 24 21:02:57.274688 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.276106 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-93a295df-1058-4a9a-a32c-33595049cb54 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Returning 404 to user: Instance 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:02:57.277410 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-93a295df-1058-4a9a-a32c-33595049cb54 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec" status: 404 len: 111 microversion: 2.1 time: 0.050215 Sep 24 21:02:57.284431 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1834/3595] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:57 2022] GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 21:02:57.315430 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6e4c8eb1-35cc-4f65-a97b-e1906bc5f0a5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:57.323564 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6e4c8eb1-35cc-4f65-a97b-e1906bc5f0a5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:57.348280 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6e4c8eb1-35cc-4f65-a97b-e1906bc5f0a5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:57.349045 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6e4c8eb1-35cc-4f65-a97b-e1906bc5f0a5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:57.350442 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6e4c8eb1-35cc-4f65-a97b-e1906bc5f0a5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:57.356106 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6e4c8eb1-35cc-4f65-a97b-e1906bc5f0a5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:57.359004 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6e4c8eb1-35cc-4f65-a97b-e1906bc5f0a5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:57.359598 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6e4c8eb1-35cc-4f65-a97b-e1906bc5f0a5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:57.393475 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-6e4c8eb1-35cc-4f65-a97b-e1906bc5f0a5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] HTTP exception thrown: Instance 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec could not be found. Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6e4c8eb1-35cc-4f65-a97b-e1906bc5f0a5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Request method failure captured: Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec HTTP/1.1 Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL29-X0U31bWS-OdLHgyvrqJ9cKeXdCQcU5XDw5ndql8wo4-9uoBN2em1wysBqNzzzY5Bp3FNsC7GdcmIawuHD1dS6A2amzvS90hoLHvMsCDbASCEoRJt0wxOm48tnGq2wGlMnRgEB8mO_grzOCcTdRgOgaHbZsmHcINVEnjYdvyWtzs Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 8340f7f8fa9848dc822903c738f78f2a Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 8340f7f8fa9848dc822903c738f78f2a Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-DeleteServersTestJSON-1814924671-project Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: ee21da3ff38a43798bce50c9aba4ae33 Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-DeleteServersTestJSON-1814924671-project Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec could not be found. Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '2274cc1a-6e7c-4ea0-a28b-c5f642a734ec'} Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec could not be found. Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:02:57.395492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:02:57.399315 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec could not be found. Sep 24 21:02:57.399315 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.399315 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:57.399315 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.399315 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:57.399315 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:57.399315 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:57.399315 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:02:57.399315 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:02:57.399315 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec could not be found. Sep 24 21:02:57.399315 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.404648 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6e4c8eb1-35cc-4f65-a97b-e1906bc5f0a5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Returning 404 to user: Instance 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:02:57.405780 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6e4c8eb1-35cc-4f65-a97b-e1906bc5f0a5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec" status: 404 len: 111 microversion: 2.1 time: 0.119957 Sep 24 21:02:57.418778 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1835/3596] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:02:57 2022] DELETE /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:02:57.421507 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6ed54a48-adf3-4879-9c30-25ed99b02c5b tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a80e61dd-bfe0-493e-8f38-35df4c09d687" status: 204 len: 0 microversion: 2.47 time: 0.215040 Sep 24 21:02:57.422378 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1762/3597] 10.222.0.52 () {60 vars in 1280 bytes} [Sat Sep 24 21:02:57 2022] DELETE /compute/v2.1/servers/a80e61dd-bfe0-493e-8f38-35df4c09d687 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 24 21:02:57.425707 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a1782154-4f0d-4314-8f67-4f8d0e0fb396 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:57.426657 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a1782154-4f0d-4314-8f67-4f8d0e0fb396 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:57.432609 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c32a3ca6-dd4f-4f88-be0f-14d4ab96bba8 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:57.433256 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c32a3ca6-dd4f-4f88-be0f-14d4ab96bba8 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] [instance: a80e61dd-bfe0-493e-8f38-35df4c09d687] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:57.440946 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a1782154-4f0d-4314-8f67-4f8d0e0fb396 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:57.443504 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a1782154-4f0d-4314-8f67-4f8d0e0fb396 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:57.444058 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a1782154-4f0d-4314-8f67-4f8d0e0fb396 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:57.444927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a1782154-4f0d-4314-8f67-4f8d0e0fb396 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:57.445219 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c32a3ca6-dd4f-4f88-be0f-14d4ab96bba8 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:57.448959 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c32a3ca6-dd4f-4f88-be0f-14d4ab96bba8 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:57.449147 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a1782154-4f0d-4314-8f67-4f8d0e0fb396 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:57.449252 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c32a3ca6-dd4f-4f88-be0f-14d4ab96bba8 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:57.449587 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a1782154-4f0d-4314-8f67-4f8d0e0fb396 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:57.449958 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c32a3ca6-dd4f-4f88-be0f-14d4ab96bba8 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:57.450447 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c32a3ca6-dd4f-4f88-be0f-14d4ab96bba8 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:57.451014 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c32a3ca6-dd4f-4f88-be0f-14d4ab96bba8 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:57.478604 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-a1782154-4f0d-4314-8f67-4f8d0e0fb396 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] HTTP exception thrown: Instance 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec could not be found. Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a1782154-4f0d-4314-8f67-4f8d0e0fb396 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Request method failure captured: Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec HTTP/1.1 Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL29-X0U31bWS-OdLHgyvrqJ9cKeXdCQcU5XDw5ndql8wo4-9uoBN2em1wysBqNzzzY5Bp3FNsC7GdcmIawuHD1dS6A2amzvS90hoLHvMsCDbASCEoRJt0wxOm48tnGq2wGlMnRgEB8mO_grzOCcTdRgOgaHbZsmHcINVEnjYdvyWtzs Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 8340f7f8fa9848dc822903c738f78f2a Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 8340f7f8fa9848dc822903c738f78f2a Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-DeleteServersTestJSON-1814924671-project Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: ee21da3ff38a43798bce50c9aba4ae33 Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-DeleteServersTestJSON-1814924671-project Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec could not be found. Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '2274cc1a-6e7c-4ea0-a28b-c5f642a734ec'} Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec could not be found. Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec could not be found. Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:57.480400 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.484826 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:57.484826 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:57.484826 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:57.484826 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:02:57.484826 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:02:57.484826 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec could not be found. Sep 24 21:02:57.484826 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.484826 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a1782154-4f0d-4314-8f67-4f8d0e0fb396 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Returning 404 to user: Instance 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:02:57.485334 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a1782154-4f0d-4314-8f67-4f8d0e0fb396 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec" status: 404 len: 111 microversion: 2.1 time: 0.064885 Sep 24 21:02:57.494629 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1836/3598] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:57 2022] GET /compute/v2.1/servers/2274cc1a-6e7c-4ea0-a28b-c5f642a734ec => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:02:57.504546 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-977be6e2-9b2e-473d-82b1-80247a878f71 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:57.505067 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-977be6e2-9b2e-473d-82b1-80247a878f71 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:57.515678 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-977be6e2-9b2e-473d-82b1-80247a878f71 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:57.516360 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-977be6e2-9b2e-473d-82b1-80247a878f71 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:57.517019 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-977be6e2-9b2e-473d-82b1-80247a878f71 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:57.518688 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-977be6e2-9b2e-473d-82b1-80247a878f71 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:57.519193 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-977be6e2-9b2e-473d-82b1-80247a878f71 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:57.519597 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-977be6e2-9b2e-473d-82b1-80247a878f71 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:57.544118 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-977be6e2-9b2e-473d-82b1-80247a878f71 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] HTTP exception thrown: Instance 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 could not be found. Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-977be6e2-9b2e-473d-82b1-80247a878f71 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Request method failure captured: Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 HTTP/1.1 Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL29-X0U31bWS-OdLHgyvrqJ9cKeXdCQcU5XDw5ndql8wo4-9uoBN2em1wysBqNzzzY5Bp3FNsC7GdcmIawuHD1dS6A2amzvS90hoLHvMsCDbASCEoRJt0wxOm48tnGq2wGlMnRgEB8mO_grzOCcTdRgOgaHbZsmHcINVEnjYdvyWtzs Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 8340f7f8fa9848dc822903c738f78f2a Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 8340f7f8fa9848dc822903c738f78f2a Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-DeleteServersTestJSON-1814924671-project Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: ee21da3ff38a43798bce50c9aba4ae33 Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-DeleteServersTestJSON-1814924671-project Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 could not be found. Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '3938cda7-a3b7-4be8-9ea5-79ec625a5bd2'} Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 could not be found. Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:02:57.546178 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:02:57.550133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 could not be found. Sep 24 21:02:57.550133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.550133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:57.550133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.550133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:57.550133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:57.550133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:57.550133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:02:57.550133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:02:57.550133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 could not be found. Sep 24 21:02:57.550133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.552296 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-977be6e2-9b2e-473d-82b1-80247a878f71 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Returning 404 to user: Instance 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:02:57.553171 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-977be6e2-9b2e-473d-82b1-80247a878f71 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2" status: 404 len: 111 microversion: 2.1 time: 0.054124 Sep 24 21:02:57.554087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c32a3ca6-dd4f-4f88-be0f-14d4ab96bba8 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75065b5a5084b639bdab6e7dce97302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7128b36583514196945b5a65446e3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:57.554849 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1837/3599] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:02:57 2022] DELETE /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 21:02:57.563310 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-290b9539-e637-4089-a216-19b6ceb9fae6 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:57.564101 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-290b9539-e637-4089-a216-19b6ceb9fae6 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:57.565269 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c32a3ca6-dd4f-4f88-be0f-14d4ab96bba8 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75065b5a5084b639bdab6e7dce97302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7128b36583514196945b5a65446e3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:57.566816 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c32a3ca6-dd4f-4f88-be0f-14d4ab96bba8 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75065b5a5084b639bdab6e7dce97302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7128b36583514196945b5a65446e3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:57.568187 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c32a3ca6-dd4f-4f88-be0f-14d4ab96bba8 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] 10.222.0.52 "GET /compute/v2.1/servers/a80e61dd-bfe0-493e-8f38-35df4c09d687" status: 200 len: 1365 microversion: 2.47 time: 0.141680 Sep 24 21:02:57.568921 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1763/3600] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:02:57 2022] GET /compute/v2.1/servers/a80e61dd-bfe0-493e-8f38-35df4c09d687 => generated 1365 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:02:57.570996 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-290b9539-e637-4089-a216-19b6ceb9fae6 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:57.571566 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-290b9539-e637-4089-a216-19b6ceb9fae6 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:57.572139 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-290b9539-e637-4089-a216-19b6ceb9fae6 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:57.573488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-290b9539-e637-4089-a216-19b6ceb9fae6 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:57.574042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-290b9539-e637-4089-a216-19b6ceb9fae6 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:57.574560 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-290b9539-e637-4089-a216-19b6ceb9fae6 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:57.589680 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-290b9539-e637-4089-a216-19b6ceb9fae6 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] HTTP exception thrown: Instance 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 could not be found. Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-290b9539-e637-4089-a216-19b6ceb9fae6 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Request method failure captured: Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 HTTP/1.1 Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL29-X0U31bWS-OdLHgyvrqJ9cKeXdCQcU5XDw5ndql8wo4-9uoBN2em1wysBqNzzzY5Bp3FNsC7GdcmIawuHD1dS6A2amzvS90hoLHvMsCDbASCEoRJt0wxOm48tnGq2wGlMnRgEB8mO_grzOCcTdRgOgaHbZsmHcINVEnjYdvyWtzs Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 8340f7f8fa9848dc822903c738f78f2a Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 8340f7f8fa9848dc822903c738f78f2a Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-DeleteServersTestJSON-1814924671-project Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: ee21da3ff38a43798bce50c9aba4ae33 Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-DeleteServersTestJSON-1814924671-project Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 could not be found. Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '3938cda7-a3b7-4be8-9ea5-79ec625a5bd2'} Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 could not be found. Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 could not be found. Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:57.591374 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.596647 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:57.596647 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:57.596647 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:57.596647 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:02:57.596647 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:02:57.596647 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 could not be found. Sep 24 21:02:57.596647 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.596647 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-290b9539-e637-4089-a216-19b6ceb9fae6 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Returning 404 to user: Instance 3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:02:57.596647 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-290b9539-e637-4089-a216-19b6ceb9fae6 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2" status: 404 len: 111 microversion: 2.1 time: 0.034322 Sep 24 21:02:57.596647 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1838/3601] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:57 2022] GET /compute/v2.1/servers/3938cda7-a3b7-4be8-9ea5-79ec625a5bd2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 21:02:57.601649 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7c67c414-47d5-49e9-8951-144ad0ce8375 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:57.602155 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7c67c414-47d5-49e9-8951-144ad0ce8375 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:57.608862 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7c67c414-47d5-49e9-8951-144ad0ce8375 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:57.609354 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7c67c414-47d5-49e9-8951-144ad0ce8375 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:57.609801 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7c67c414-47d5-49e9-8951-144ad0ce8375 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:57.610517 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7c67c414-47d5-49e9-8951-144ad0ce8375 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:57.610987 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7c67c414-47d5-49e9-8951-144ad0ce8375 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:57.611420 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7c67c414-47d5-49e9-8951-144ad0ce8375 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:57.625684 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-7c67c414-47d5-49e9-8951-144ad0ce8375 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] HTTP exception thrown: Instance 9c96f88e-1327-49e3-8e9a-5417f96fb308 could not be found. Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7c67c414-47d5-49e9-8951-144ad0ce8375 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Request method failure captured: Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 HTTP/1.1 Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL29-X0U31bWS-OdLHgyvrqJ9cKeXdCQcU5XDw5ndql8wo4-9uoBN2em1wysBqNzzzY5Bp3FNsC7GdcmIawuHD1dS6A2amzvS90hoLHvMsCDbASCEoRJt0wxOm48tnGq2wGlMnRgEB8mO_grzOCcTdRgOgaHbZsmHcINVEnjYdvyWtzs Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 8340f7f8fa9848dc822903c738f78f2a Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 8340f7f8fa9848dc822903c738f78f2a Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-DeleteServersTestJSON-1814924671-project Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: ee21da3ff38a43798bce50c9aba4ae33 Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-DeleteServersTestJSON-1814924671-project Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 9c96f88e-1327-49e3-8e9a-5417f96fb308 could not be found. Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '9c96f88e-1327-49e3-8e9a-5417f96fb308'} Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c96f88e-1327-49e3-8e9a-5417f96fb308 could not be found. Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:02:57.627387 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:02:57.632039 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c96f88e-1327-49e3-8e9a-5417f96fb308 could not be found. Sep 24 21:02:57.632039 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.632039 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:57.632039 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.632039 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:57.632039 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:57.632039 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:57.632039 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:02:57.632039 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:02:57.632039 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c96f88e-1327-49e3-8e9a-5417f96fb308 could not be found. Sep 24 21:02:57.632039 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.632039 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7c67c414-47d5-49e9-8951-144ad0ce8375 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Returning 404 to user: Instance 9c96f88e-1327-49e3-8e9a-5417f96fb308 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:02:57.632039 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7c67c414-47d5-49e9-8951-144ad0ce8375 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 404 len: 111 microversion: 2.1 time: 0.031164 Sep 24 21:02:57.635647 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1764/3602] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:02:57 2022] DELETE /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:02:57.644872 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ed173f40-b592-442c-8a5d-478c1efe2eb3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:57.645727 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ed173f40-b592-442c-8a5d-478c1efe2eb3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9c96f88e-1327-49e3-8e9a-5417f96fb308] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:57.652153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed173f40-b592-442c-8a5d-478c1efe2eb3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:57.652644 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed173f40-b592-442c-8a5d-478c1efe2eb3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:57.653227 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed173f40-b592-442c-8a5d-478c1efe2eb3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:57.654195 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed173f40-b592-442c-8a5d-478c1efe2eb3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:57.654822 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed173f40-b592-442c-8a5d-478c1efe2eb3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:57.655276 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed173f40-b592-442c-8a5d-478c1efe2eb3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:57.670122 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-ed173f40-b592-442c-8a5d-478c1efe2eb3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] HTTP exception thrown: Instance 9c96f88e-1327-49e3-8e9a-5417f96fb308 could not be found. Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ed173f40-b592-442c-8a5d-478c1efe2eb3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Request method failure captured: Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 HTTP/1.1 Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL29-X0U31bWS-OdLHgyvrqJ9cKeXdCQcU5XDw5ndql8wo4-9uoBN2em1wysBqNzzzY5Bp3FNsC7GdcmIawuHD1dS6A2amzvS90hoLHvMsCDbASCEoRJt0wxOm48tnGq2wGlMnRgEB8mO_grzOCcTdRgOgaHbZsmHcINVEnjYdvyWtzs Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 8340f7f8fa9848dc822903c738f78f2a Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 8340f7f8fa9848dc822903c738f78f2a Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-DeleteServersTestJSON-1814924671-project Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: ee21da3ff38a43798bce50c9aba4ae33 Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-DeleteServersTestJSON-1814924671-project Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 9c96f88e-1327-49e3-8e9a-5417f96fb308 could not be found. Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '9c96f88e-1327-49e3-8e9a-5417f96fb308'} Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c96f88e-1327-49e3-8e9a-5417f96fb308 could not be found. Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c96f88e-1327-49e3-8e9a-5417f96fb308 could not be found. Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:57.671718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.677976 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:57.677976 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:57.677976 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:57.677976 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:02:57.677976 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:02:57.677976 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c96f88e-1327-49e3-8e9a-5417f96fb308 could not be found. Sep 24 21:02:57.677976 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.677976 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ed173f40-b592-442c-8a5d-478c1efe2eb3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Returning 404 to user: Instance 9c96f88e-1327-49e3-8e9a-5417f96fb308 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:02:57.677976 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ed173f40-b592-442c-8a5d-478c1efe2eb3 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308" status: 404 len: 111 microversion: 2.1 time: 0.033758 Sep 24 21:02:57.677976 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1839/3603] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:57 2022] GET /compute/v2.1/servers/9c96f88e-1327-49e3-8e9a-5417f96fb308 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:02:57.682780 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-efc92568-f52c-4eaf-b9c7-5baac56e29c8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:57.683403 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-efc92568-f52c-4eaf-b9c7-5baac56e29c8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 637c2b11-a4f9-40e9-b309-5cffdcd7b64a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:57.689692 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-efc92568-f52c-4eaf-b9c7-5baac56e29c8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:57.690042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8469ab5a-4391-42af-8427-a461325398e3 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:57.690185 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-efc92568-f52c-4eaf-b9c7-5baac56e29c8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:57.690717 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8469ab5a-4391-42af-8427-a461325398e3 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] [instance: de4ec687-83cc-43ea-bed9-24ec92724907] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:57.691037 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-efc92568-f52c-4eaf-b9c7-5baac56e29c8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:57.691897 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-efc92568-f52c-4eaf-b9c7-5baac56e29c8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:57.692367 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-efc92568-f52c-4eaf-b9c7-5baac56e29c8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:57.692799 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-efc92568-f52c-4eaf-b9c7-5baac56e29c8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:57.696971 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8469ab5a-4391-42af-8427-a461325398e3 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:57.697473 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8469ab5a-4391-42af-8427-a461325398e3 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:57.698275 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8469ab5a-4391-42af-8427-a461325398e3 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:57.699072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8469ab5a-4391-42af-8427-a461325398e3 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:57.699534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8469ab5a-4391-42af-8427-a461325398e3 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:57.699982 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8469ab5a-4391-42af-8427-a461325398e3 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:57.708353 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-efc92568-f52c-4eaf-b9c7-5baac56e29c8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] HTTP exception thrown: Instance 637c2b11-a4f9-40e9-b309-5cffdcd7b64a could not be found. Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-efc92568-f52c-4eaf-b9c7-5baac56e29c8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Request method failure captured: Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a HTTP/1.1 Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL29-X0U31bWS-OdLHgyvrqJ9cKeXdCQcU5XDw5ndql8wo4-9uoBN2em1wysBqNzzzY5Bp3FNsC7GdcmIawuHD1dS6A2amzvS90hoLHvMsCDbASCEoRJt0wxOm48tnGq2wGlMnRgEB8mO_grzOCcTdRgOgaHbZsmHcINVEnjYdvyWtzs Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 8340f7f8fa9848dc822903c738f78f2a Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 8340f7f8fa9848dc822903c738f78f2a Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-DeleteServersTestJSON-1814924671-project Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: ee21da3ff38a43798bce50c9aba4ae33 Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-DeleteServersTestJSON-1814924671-project Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 637c2b11-a4f9-40e9-b309-5cffdcd7b64a could not be found. Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '637c2b11-a4f9-40e9-b309-5cffdcd7b64a'} Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 637c2b11-a4f9-40e9-b309-5cffdcd7b64a could not be found. Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:02:57.710336 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:02:57.715142 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 637c2b11-a4f9-40e9-b309-5cffdcd7b64a could not be found. Sep 24 21:02:57.715142 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.715142 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:57.715142 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.715142 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:57.715142 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:57.715142 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:57.715142 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:02:57.715142 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:02:57.715142 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 637c2b11-a4f9-40e9-b309-5cffdcd7b64a could not be found. Sep 24 21:02:57.715142 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.716456 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-8469ab5a-4391-42af-8427-a461325398e3 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] HTTP exception thrown: Instance de4ec687-83cc-43ea-bed9-24ec92724907 could not be found. Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8469ab5a-4391-42af-8427-a461325398e3 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Request method failure captured: Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907 HTTP/1.1 Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3BiuEiw2aUfk9tqygDQjFSwiN4hnaEaNq6faJ1B8WIHHBP3GSdfqYK8DuT0xPBo_79k0GafR3tqNS89f3AlpCvWqnSoS3Gu1l38YkpNSLZgnzGFVU5wT4YW-R4Ecpv74uHK_AQQQRRNuC7p0gEPuFhYaG8NgL2QU6xx17MFaioDD5c Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: X-Openstack-Nova-Api-Version: 2.26 Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 6af0aa4ac07b40baa00186abc14ee5a1 Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServerTagsTestJSON-340149516 Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6af0aa4ac07b40baa00186abc14ee5a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6af0aa4ac07b40baa00186abc14ee5a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6af0aa4ac07b40baa00186abc14ee5a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6af0aa4ac07b40baa00186abc14ee5a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServerTagsTestJSON-340149516 Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 6af0aa4ac07b40baa00186abc14ee5a1 Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServerTagsTestJSON-340149516 Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServerTagsTestJSON-340149516-project Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 7c9d24e7a7a94cbd9f235519ac791361 Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServerTagsTestJSON-340149516-project Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance de4ec687-83cc-43ea-bed9-24ec92724907 could not be found. Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'de4ec687-83cc-43ea-bed9-24ec92724907'} Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de4ec687-83cc-43ea-bed9-24ec92724907 could not be found. Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de4ec687-83cc-43ea-bed9-24ec92724907 could not be found. Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:57.716995 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.728116 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:57.728116 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:57.728116 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:57.728116 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:02:57.728116 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:02:57.728116 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de4ec687-83cc-43ea-bed9-24ec92724907 could not be found. Sep 24 21:02:57.728116 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.728116 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8469ab5a-4391-42af-8427-a461325398e3 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] Returning 404 to user: Instance de4ec687-83cc-43ea-bed9-24ec92724907 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:02:57.728116 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8469ab5a-4391-42af-8427-a461325398e3 tempest-ServerTagsTestJSON-340149516 tempest-ServerTagsTestJSON-340149516-project] 10.222.0.52 "GET /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907" status: 404 len: 111 microversion: 2.26 time: 0.032565 Sep 24 21:02:57.729833 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-efc92568-f52c-4eaf-b9c7-5baac56e29c8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Returning 404 to user: Instance 637c2b11-a4f9-40e9-b309-5cffdcd7b64a could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:02:57.729833 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-efc92568-f52c-4eaf-b9c7-5baac56e29c8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "DELETE /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a" status: 404 len: 111 microversion: 2.1 time: 0.043525 Sep 24 21:02:57.729833 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1765/3605] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:02:57 2022] DELETE /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:02:57.730109 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1840/3605] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:02:57 2022] GET /compute/v2.1/servers/de4ec687-83cc-43ea-bed9-24ec92724907 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 24 21:02:57.732762 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-06a4b1a6-0a4d-4f93-9c36-c6d3e3da8324 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:57.733461 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-06a4b1a6-0a4d-4f93-9c36-c6d3e3da8324 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 637c2b11-a4f9-40e9-b309-5cffdcd7b64a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:57.739680 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-06a4b1a6-0a4d-4f93-9c36-c6d3e3da8324 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:57.740320 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-06a4b1a6-0a4d-4f93-9c36-c6d3e3da8324 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:57.740773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-06a4b1a6-0a4d-4f93-9c36-c6d3e3da8324 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:57.741483 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-06a4b1a6-0a4d-4f93-9c36-c6d3e3da8324 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:57.741946 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-06a4b1a6-0a4d-4f93-9c36-c6d3e3da8324 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:57.742747 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-06a4b1a6-0a4d-4f93-9c36-c6d3e3da8324 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:57.759542 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c7a57c3d-9b7a-43d8-9d54-d87fc512d25c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:57.759934 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-06a4b1a6-0a4d-4f93-9c36-c6d3e3da8324 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] HTTP exception thrown: Instance 637c2b11-a4f9-40e9-b309-5cffdcd7b64a could not be found. Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-06a4b1a6-0a4d-4f93-9c36-c6d3e3da8324 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Request method failure captured: Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a HTTP/1.1 Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL29-X0U31bWS-OdLHgyvrqJ9cKeXdCQcU5XDw5ndql8wo4-9uoBN2em1wysBqNzzzY5Bp3FNsC7GdcmIawuHD1dS6A2amzvS90hoLHvMsCDbASCEoRJt0wxOm48tnGq2wGlMnRgEB8mO_grzOCcTdRgOgaHbZsmHcINVEnjYdvyWtzs Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 8340f7f8fa9848dc822903c738f78f2a Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 8340f7f8fa9848dc822903c738f78f2a Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-DeleteServersTestJSON-1814924671-project Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: ee21da3ff38a43798bce50c9aba4ae33 Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-DeleteServersTestJSON-1814924671-project Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 637c2b11-a4f9-40e9-b309-5cffdcd7b64a could not be found. Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '637c2b11-a4f9-40e9-b309-5cffdcd7b64a'} Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 637c2b11-a4f9-40e9-b309-5cffdcd7b64a could not be found. Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 637c2b11-a4f9-40e9-b309-5cffdcd7b64a could not be found. Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:57.761722 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.774263 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:57.774263 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:57.774263 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:57.774263 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:02:57.774263 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:02:57.774263 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 637c2b11-a4f9-40e9-b309-5cffdcd7b64a could not be found. Sep 24 21:02:57.774263 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.774263 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-06a4b1a6-0a4d-4f93-9c36-c6d3e3da8324 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Returning 404 to user: Instance 637c2b11-a4f9-40e9-b309-5cffdcd7b64a could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:02:57.774263 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-06a4b1a6-0a4d-4f93-9c36-c6d3e3da8324 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a" status: 404 len: 111 microversion: 2.1 time: 0.036671 Sep 24 21:02:57.775968 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c7a57c3d-9b7a-43d8-9d54-d87fc512d25c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:57.776128 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1766/3606] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:57 2022] GET /compute/v2.1/servers/637c2b11-a4f9-40e9-b309-5cffdcd7b64a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:02:57.776286 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c7a57c3d-9b7a-43d8-9d54-d87fc512d25c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:57.776286 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c7a57c3d-9b7a-43d8-9d54-d87fc512d25c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:57.776598 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4ef83fe4-1d3f-47e6-9368-89f40171c986 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:57.776753 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c7a57c3d-9b7a-43d8-9d54-d87fc512d25c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:57.776929 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4ef83fe4-1d3f-47e6-9368-89f40171c986 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 8796a326-1534-4c6a-93c1-ab831930166c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:57.777086 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c7a57c3d-9b7a-43d8-9d54-d87fc512d25c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:57.777086 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c7a57c3d-9b7a-43d8-9d54-d87fc512d25c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:57.777086 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c7a57c3d-9b7a-43d8-9d54-d87fc512d25c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:57.780330 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ef83fe4-1d3f-47e6-9368-89f40171c986 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:57.781818 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ef83fe4-1d3f-47e6-9368-89f40171c986 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:57.781818 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ef83fe4-1d3f-47e6-9368-89f40171c986 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:57.782173 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ef83fe4-1d3f-47e6-9368-89f40171c986 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:57.782565 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ef83fe4-1d3f-47e6-9368-89f40171c986 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:57.783306 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ef83fe4-1d3f-47e6-9368-89f40171c986 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:57.797798 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-4ef83fe4-1d3f-47e6-9368-89f40171c986 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] HTTP exception thrown: Instance 8796a326-1534-4c6a-93c1-ab831930166c could not be found. Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4ef83fe4-1d3f-47e6-9368-89f40171c986 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Request method failure captured: Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/servers/8796a326-1534-4c6a-93c1-ab831930166c HTTP/1.1 Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL29-X0U31bWS-OdLHgyvrqJ9cKeXdCQcU5XDw5ndql8wo4-9uoBN2em1wysBqNzzzY5Bp3FNsC7GdcmIawuHD1dS6A2amzvS90hoLHvMsCDbASCEoRJt0wxOm48tnGq2wGlMnRgEB8mO_grzOCcTdRgOgaHbZsmHcINVEnjYdvyWtzs Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 8340f7f8fa9848dc822903c738f78f2a Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 8340f7f8fa9848dc822903c738f78f2a Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-DeleteServersTestJSON-1814924671-project Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: ee21da3ff38a43798bce50c9aba4ae33 Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-DeleteServersTestJSON-1814924671-project Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 8796a326-1534-4c6a-93c1-ab831930166c could not be found. Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '8796a326-1534-4c6a-93c1-ab831930166c'} Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8796a326-1534-4c6a-93c1-ab831930166c could not be found. Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:02:57.799597 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:02:57.814341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8796a326-1534-4c6a-93c1-ab831930166c could not be found. Sep 24 21:02:57.814341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.814341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:57.814341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.814341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:57.814341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:57.814341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:57.814341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:02:57.814341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:02:57.814341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8796a326-1534-4c6a-93c1-ab831930166c could not be found. Sep 24 21:02:57.814341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.814341 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4ef83fe4-1d3f-47e6-9368-89f40171c986 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Returning 404 to user: Instance 8796a326-1534-4c6a-93c1-ab831930166c could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:02:57.814341 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4ef83fe4-1d3f-47e6-9368-89f40171c986 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8796a326-1534-4c6a-93c1-ab831930166c" status: 404 len: 111 microversion: 2.1 time: 0.032990 Sep 24 21:02:57.814341 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1767/3607] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:02:57 2022] DELETE /compute/v2.1/servers/8796a326-1534-4c6a-93c1-ab831930166c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:02:57.814341 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-303e037d-0b2d-40f1-ab87-60357990ff4f req-91ca0584-7356-4b34-a163-8ed5626a9202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2274cc1a-6e7c-4ea0-a28b-c5f642a734ec", "name": "network-vif-deleted", "tag": "cfefa178-619d-499d-9daa-31b41a795d02"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:02:57.823471 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c7a57c3d-9b7a-43d8-9d54-d87fc512d25c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.061352 Sep 24 21:02:57.823471 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1841/3608] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:02:57 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 21:02:57.823802 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-303e037d-0b2d-40f1-ab87-60357990ff4f req-91ca0584-7356-4b34-a163-8ed5626a9202 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:57.823802 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-303e037d-0b2d-40f1-ab87-60357990ff4f req-91ca0584-7356-4b34-a163-8ed5626a9202 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:57.823802 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-303e037d-0b2d-40f1-ab87-60357990ff4f req-91ca0584-7356-4b34-a163-8ed5626a9202 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:57.824261 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8b396beb-7cd9-4ba0-981b-2e494ef5a462 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:57.824261 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8b396beb-7cd9-4ba0-981b-2e494ef5a462 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 8796a326-1534-4c6a-93c1-ab831930166c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:57.830250 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8b396beb-7cd9-4ba0-981b-2e494ef5a462 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:57.830706 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-303e037d-0b2d-40f1-ab87-60357990ff4f req-91ca0584-7356-4b34-a163-8ed5626a9202 service nova] Creating event network-vif-deleted:cfefa178-619d-499d-9daa-31b41a795d02 for instance 2274cc1a-6e7c-4ea0-a28b-c5f642a734ec on nch1-master-1 Sep 24 21:02:57.830907 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8b396beb-7cd9-4ba0-981b-2e494ef5a462 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:57.831206 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8b396beb-7cd9-4ba0-981b-2e494ef5a462 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:57.831921 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8b396beb-7cd9-4ba0-981b-2e494ef5a462 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:57.832782 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8b396beb-7cd9-4ba0-981b-2e494ef5a462 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:57.833219 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8b396beb-7cd9-4ba0-981b-2e494ef5a462 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:57.836162 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-303e037d-0b2d-40f1-ab87-60357990ff4f req-91ca0584-7356-4b34-a163-8ed5626a9202 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033231 Sep 24 21:02:57.837160 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1768/3609] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:02:57.850964 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-8b396beb-7cd9-4ba0-981b-2e494ef5a462 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] HTTP exception thrown: Instance 8796a326-1534-4c6a-93c1-ab831930166c could not be found. Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8b396beb-7cd9-4ba0-981b-2e494ef5a462 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Request method failure captured: Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/8796a326-1534-4c6a-93c1-ab831930166c HTTP/1.1 Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL29-X0U31bWS-OdLHgyvrqJ9cKeXdCQcU5XDw5ndql8wo4-9uoBN2em1wysBqNzzzY5Bp3FNsC7GdcmIawuHD1dS6A2amzvS90hoLHvMsCDbASCEoRJt0wxOm48tnGq2wGlMnRgEB8mO_grzOCcTdRgOgaHbZsmHcINVEnjYdvyWtzs Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 8340f7f8fa9848dc822903c738f78f2a Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 8340f7f8fa9848dc822903c738f78f2a Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-DeleteServersTestJSON-1814924671-project Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: ee21da3ff38a43798bce50c9aba4ae33 Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-DeleteServersTestJSON-1814924671-project Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 8796a326-1534-4c6a-93c1-ab831930166c could not be found. Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '8796a326-1534-4c6a-93c1-ab831930166c'} Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8796a326-1534-4c6a-93c1-ab831930166c could not be found. Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8796a326-1534-4c6a-93c1-ab831930166c could not be found. Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:02:57.852605 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.859116 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:02:57.859116 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:02:57.859116 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:02:57.859116 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:02:57.859116 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:02:57.859116 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8796a326-1534-4c6a-93c1-ab831930166c could not be found. Sep 24 21:02:57.859116 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:02:57.859116 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8b396beb-7cd9-4ba0-981b-2e494ef5a462 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Returning 404 to user: Instance 8796a326-1534-4c6a-93c1-ab831930166c could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:02:57.859116 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8b396beb-7cd9-4ba0-981b-2e494ef5a462 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/8796a326-1534-4c6a-93c1-ab831930166c" status: 404 len: 111 microversion: 2.1 time: 0.037906 Sep 24 21:02:57.859116 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1842/3610] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:57 2022] GET /compute/v2.1/servers/8796a326-1534-4c6a-93c1-ab831930166c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:02:57.875007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-09fcae8e-f40c-4fc4-b833-668709065fc1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:57.875721 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-09fcae8e-f40c-4fc4-b833-668709065fc1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: e6c97c05-a30e-4c8b-b56c-0cdae10ff44c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:57.881826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09fcae8e-f40c-4fc4-b833-668709065fc1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:57.882698 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09fcae8e-f40c-4fc4-b833-668709065fc1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:57.883144 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09fcae8e-f40c-4fc4-b833-668709065fc1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:57.883947 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09fcae8e-f40c-4fc4-b833-668709065fc1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:57.884415 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09fcae8e-f40c-4fc4-b833-668709065fc1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:57.885541 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09fcae8e-f40c-4fc4-b833-668709065fc1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:58.028354 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5b43fba4-c952-4591-b22c-1cc5d059e2a8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:58.028864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5b43fba4-c952-4591-b22c-1cc5d059e2a8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9f8f487c-5fb4-4c63-8146-a71154f73046] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:58.035437 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b43fba4-c952-4591-b22c-1cc5d059e2a8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:58.036139 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b43fba4-c952-4591-b22c-1cc5d059e2a8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:58.036581 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b43fba4-c952-4591-b22c-1cc5d059e2a8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:58.037287 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b43fba4-c952-4591-b22c-1cc5d059e2a8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:58.037749 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b43fba4-c952-4591-b22c-1cc5d059e2a8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:58.038179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b43fba4-c952-4591-b22c-1cc5d059e2a8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:58.046650 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-09fcae8e-f40c-4fc4-b833-668709065fc1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:58.054328 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-09fcae8e-f40c-4fc4-b833-668709065fc1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c" status: 200 len: 1513 microversion: 2.1 time: 0.183974 Sep 24 21:02:58.054938 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1769/3611] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:57 2022] GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c => generated 1513 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:58.068843 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5b43fba4-c952-4591-b22c-1cc5d059e2a8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9f8f487c-5fb4-4c63-8146-a71154f73046] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:02:58.180688 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5b43fba4-c952-4591-b22c-1cc5d059e2a8 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046" status: 204 len: 0 microversion: 2.1 time: 0.157760 Sep 24 21:02:58.181805 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1843/3612] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:02:58 2022] DELETE /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 24 21:02:58.191404 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d34a5dd0-e8c3-46fe-bf04-0bd8be5c4bb5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:58.192025 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d34a5dd0-e8c3-46fe-bf04-0bd8be5c4bb5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9f8f487c-5fb4-4c63-8146-a71154f73046] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:58.198563 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d34a5dd0-e8c3-46fe-bf04-0bd8be5c4bb5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:58.199299 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d34a5dd0-e8c3-46fe-bf04-0bd8be5c4bb5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:58.199744 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d34a5dd0-e8c3-46fe-bf04-0bd8be5c4bb5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:58.200453 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d34a5dd0-e8c3-46fe-bf04-0bd8be5c4bb5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:58.200904 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d34a5dd0-e8c3-46fe-bf04-0bd8be5c4bb5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:58.201506 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d34a5dd0-e8c3-46fe-bf04-0bd8be5c4bb5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:58.375837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d34a5dd0-e8c3-46fe-bf04-0bd8be5c4bb5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:58.378760 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:02:58.388422 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d34a5dd0-e8c3-46fe-bf04-0bd8be5c4bb5 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046" status: 200 len: 1508 microversion: 2.1 time: 0.200970 Sep 24 21:02:58.389066 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1770/3613] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:58 2022] GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046 => generated 1508 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:58.596721 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9dc1d2a5-a22f-48d7-a16c-d327945b10c2 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:58.598093 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9dc1d2a5-a22f-48d7-a16c-d327945b10c2 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] [instance: a80e61dd-bfe0-493e-8f38-35df4c09d687] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:58.605202 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9dc1d2a5-a22f-48d7-a16c-d327945b10c2 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:58.605982 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9dc1d2a5-a22f-48d7-a16c-d327945b10c2 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:58.606632 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9dc1d2a5-a22f-48d7-a16c-d327945b10c2 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:58.607349 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9dc1d2a5-a22f-48d7-a16c-d327945b10c2 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:58.607809 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9dc1d2a5-a22f-48d7-a16c-d327945b10c2 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:58.608470 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9dc1d2a5-a22f-48d7-a16c-d327945b10c2 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:58.684546 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9dc1d2a5-a22f-48d7-a16c-d327945b10c2 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75065b5a5084b639bdab6e7dce97302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7128b36583514196945b5a65446e3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:58.697015 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9dc1d2a5-a22f-48d7-a16c-d327945b10c2 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75065b5a5084b639bdab6e7dce97302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7128b36583514196945b5a65446e3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:58.699569 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9dc1d2a5-a22f-48d7-a16c-d327945b10c2 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75065b5a5084b639bdab6e7dce97302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7128b36583514196945b5a65446e3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:58.701711 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9dc1d2a5-a22f-48d7-a16c-d327945b10c2 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] 10.222.0.52 "GET /compute/v2.1/servers/a80e61dd-bfe0-493e-8f38-35df4c09d687" status: 200 len: 1365 microversion: 2.47 time: 0.109285 Sep 24 21:02:58.703026 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1844/3614] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:02:58 2022] GET /compute/v2.1/servers/a80e61dd-bfe0-493e-8f38-35df4c09d687 => generated 1365 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:02:58.827879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-86bcb91c-952f-4781-9a9d-da99c83e4151 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:58.830153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-86bcb91c-952f-4781-9a9d-da99c83e4151 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:58.839645 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-86bcb91c-952f-4781-9a9d-da99c83e4151 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:58.840122 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-86bcb91c-952f-4781-9a9d-da99c83e4151 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:58.840567 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-86bcb91c-952f-4781-9a9d-da99c83e4151 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:58.841280 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-86bcb91c-952f-4781-9a9d-da99c83e4151 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:58.841743 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-86bcb91c-952f-4781-9a9d-da99c83e4151 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:58.843058 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-86bcb91c-952f-4781-9a9d-da99c83e4151 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:58.877202 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-86bcb91c-952f-4781-9a9d-da99c83e4151 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.053618 Sep 24 21:02:58.877899 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1771/3615] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:02:58 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:02:59.079779 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-695552b2-7cd7-4012-9e72-9d3227dd5fa3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:59.080803 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-695552b2-7cd7-4012-9e72-9d3227dd5fa3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: e6c97c05-a30e-4c8b-b56c-0cdae10ff44c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:59.088301 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-695552b2-7cd7-4012-9e72-9d3227dd5fa3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:59.089443 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-695552b2-7cd7-4012-9e72-9d3227dd5fa3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:59.090109 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-695552b2-7cd7-4012-9e72-9d3227dd5fa3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:59.091287 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-695552b2-7cd7-4012-9e72-9d3227dd5fa3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:59.091963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-695552b2-7cd7-4012-9e72-9d3227dd5fa3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:59.092557 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-695552b2-7cd7-4012-9e72-9d3227dd5fa3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:59.348613 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-695552b2-7cd7-4012-9e72-9d3227dd5fa3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:59.359838 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-695552b2-7cd7-4012-9e72-9d3227dd5fa3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c" status: 200 len: 1513 microversion: 2.1 time: 0.284960 Sep 24 21:02:59.360612 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1845/3616] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:59 2022] GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c => generated 1513 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:02:59.417684 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ad431b8d-b1fb-42f5-9030-729851b28337 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:59.417684 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ad431b8d-b1fb-42f5-9030-729851b28337 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9f8f487c-5fb4-4c63-8146-a71154f73046] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:59.425652 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ad431b8d-b1fb-42f5-9030-729851b28337 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:59.426241 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ad431b8d-b1fb-42f5-9030-729851b28337 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:59.426922 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ad431b8d-b1fb-42f5-9030-729851b28337 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:59.427747 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ad431b8d-b1fb-42f5-9030-729851b28337 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:59.428305 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ad431b8d-b1fb-42f5-9030-729851b28337 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:59.428820 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ad431b8d-b1fb-42f5-9030-729851b28337 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:59.672809 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ad431b8d-b1fb-42f5-9030-729851b28337 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:59.681111 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ad431b8d-b1fb-42f5-9030-729851b28337 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046" status: 200 len: 1508 microversion: 2.1 time: 0.272068 Sep 24 21:02:59.682917 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1772/3617] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:02:59 2022] GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046 => generated 1508 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:02:59.728593 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0cb0016e-d60a-4a8c-9c8a-668c1a6a5bba tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:59.729949 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0cb0016e-d60a-4a8c-9c8a-668c1a6a5bba tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] [instance: a80e61dd-bfe0-493e-8f38-35df4c09d687] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:59.736350 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0cb0016e-d60a-4a8c-9c8a-668c1a6a5bba tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:59.737125 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0cb0016e-d60a-4a8c-9c8a-668c1a6a5bba tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:59.737497 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0cb0016e-d60a-4a8c-9c8a-668c1a6a5bba tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:59.738285 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0cb0016e-d60a-4a8c-9c8a-668c1a6a5bba tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:59.738852 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0cb0016e-d60a-4a8c-9c8a-668c1a6a5bba tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:59.739538 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0cb0016e-d60a-4a8c-9c8a-668c1a6a5bba tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:59.846257 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0cb0016e-d60a-4a8c-9c8a-668c1a6a5bba tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75065b5a5084b639bdab6e7dce97302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7128b36583514196945b5a65446e3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:59.862186 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0cb0016e-d60a-4a8c-9c8a-668c1a6a5bba tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75065b5a5084b639bdab6e7dce97302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7128b36583514196945b5a65446e3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:59.868614 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0cb0016e-d60a-4a8c-9c8a-668c1a6a5bba tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75065b5a5084b639bdab6e7dce97302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7128b36583514196945b5a65446e3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:02:59.871066 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0cb0016e-d60a-4a8c-9c8a-668c1a6a5bba tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] 10.222.0.52 "GET /compute/v2.1/servers/a80e61dd-bfe0-493e-8f38-35df4c09d687" status: 200 len: 1365 microversion: 2.47 time: 0.146852 Sep 24 21:02:59.872339 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1846/3618] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:02:59 2022] GET /compute/v2.1/servers/a80e61dd-bfe0-493e-8f38-35df4c09d687 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:02:59.895126 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0252f1f9-b4f8-4ac8-9f94-4521fd1fc867 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:02:59.898019 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0252f1f9-b4f8-4ac8-9f94-4521fd1fc867 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:02:59.904997 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:02:59.906993 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0252f1f9-b4f8-4ac8-9f94-4521fd1fc867 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:59.907492 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0252f1f9-b4f8-4ac8-9f94-4521fd1fc867 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:59.908204 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0252f1f9-b4f8-4ac8-9f94-4521fd1fc867 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:59.908923 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0252f1f9-b4f8-4ac8-9f94-4521fd1fc867 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:02:59.909384 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0252f1f9-b4f8-4ac8-9f94-4521fd1fc867 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:02:59.909816 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0252f1f9-b4f8-4ac8-9f94-4521fd1fc867 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:02:59.962403 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0252f1f9-b4f8-4ac8-9f94-4521fd1fc867 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.074128 Sep 24 21:02:59.971988 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1773/3619] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:02:59 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:03:00.391453 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-27e3afef-d3b8-4af4-90b2-773d6f89d73b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:00.394981 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-27e3afef-d3b8-4af4-90b2-773d6f89d73b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: e6c97c05-a30e-4c8b-b56c-0cdae10ff44c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:00.409870 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27e3afef-d3b8-4af4-90b2-773d6f89d73b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:00.411341 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27e3afef-d3b8-4af4-90b2-773d6f89d73b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:00.412000 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27e3afef-d3b8-4af4-90b2-773d6f89d73b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:00.415615 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27e3afef-d3b8-4af4-90b2-773d6f89d73b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:00.417507 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27e3afef-d3b8-4af4-90b2-773d6f89d73b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:00.418684 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27e3afef-d3b8-4af4-90b2-773d6f89d73b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:00.705213 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fab52d6d-fa15-4314-8210-ad1d5a675aeb tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:00.705825 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fab52d6d-fa15-4314-8210-ad1d5a675aeb tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9f8f487c-5fb4-4c63-8146-a71154f73046] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:00.711729 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=8 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:03:00.716404 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fab52d6d-fa15-4314-8210-ad1d5a675aeb tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:00.717203 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fab52d6d-fa15-4314-8210-ad1d5a675aeb tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:00.719227 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fab52d6d-fa15-4314-8210-ad1d5a675aeb tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:00.720283 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fab52d6d-fa15-4314-8210-ad1d5a675aeb tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:00.720986 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fab52d6d-fa15-4314-8210-ad1d5a675aeb tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:00.721649 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fab52d6d-fa15-4314-8210-ad1d5a675aeb tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:00.725372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-27e3afef-d3b8-4af4-90b2-773d6f89d73b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:00.744522 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-27e3afef-d3b8-4af4-90b2-773d6f89d73b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c" status: 200 len: 1513 microversion: 2.1 time: 0.362953 Sep 24 21:03:00.755273 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1847/3620] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:00 2022] GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c => generated 1513 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:00.902202 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a410b888-a9dc-466c-aaa5-6cb4e2a20134 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:00.902855 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a410b888-a9dc-466c-aaa5-6cb4e2a20134 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] [instance: a80e61dd-bfe0-493e-8f38-35df4c09d687] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:00.914896 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a410b888-a9dc-466c-aaa5-6cb4e2a20134 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:00.916666 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a410b888-a9dc-466c-aaa5-6cb4e2a20134 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:00.917691 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a410b888-a9dc-466c-aaa5-6cb4e2a20134 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:00.918956 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a410b888-a9dc-466c-aaa5-6cb4e2a20134 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:00.922291 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a410b888-a9dc-466c-aaa5-6cb4e2a20134 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:00.925450 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a410b888-a9dc-466c-aaa5-6cb4e2a20134 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:00.977055 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fab52d6d-fa15-4314-8210-ad1d5a675aeb tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:00.991261 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fab52d6d-fa15-4314-8210-ad1d5a675aeb tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046" status: 200 len: 1508 microversion: 2.1 time: 0.289823 Sep 24 21:03:00.996620 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1774/3621] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:00 2022] GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046 => generated 1508 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:03:01.010993 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-152fddaa-f616-48fc-a199-5b6c6cf72655 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:01.013527 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-152fddaa-f616-48fc-a199-5b6c6cf72655 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:01.031614 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-152fddaa-f616-48fc-a199-5b6c6cf72655 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:01.032480 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-152fddaa-f616-48fc-a199-5b6c6cf72655 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:01.033467 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-152fddaa-f616-48fc-a199-5b6c6cf72655 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:01.034575 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-152fddaa-f616-48fc-a199-5b6c6cf72655 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:01.035264 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-152fddaa-f616-48fc-a199-5b6c6cf72655 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:01.035916 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-152fddaa-f616-48fc-a199-5b6c6cf72655 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:01.101153 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-152fddaa-f616-48fc-a199-5b6c6cf72655 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.103051 Sep 24 21:03:01.102302 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1775/3622] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:03:00 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:03:01.123932 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a410b888-a9dc-466c-aaa5-6cb4e2a20134 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75065b5a5084b639bdab6e7dce97302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7128b36583514196945b5a65446e3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:01.140735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a410b888-a9dc-466c-aaa5-6cb4e2a20134 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75065b5a5084b639bdab6e7dce97302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7128b36583514196945b5a65446e3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:01.143056 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a410b888-a9dc-466c-aaa5-6cb4e2a20134 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75065b5a5084b639bdab6e7dce97302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7128b36583514196945b5a65446e3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:01.145767 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a410b888-a9dc-466c-aaa5-6cb4e2a20134 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] 10.222.0.52 "GET /compute/v2.1/servers/a80e61dd-bfe0-493e-8f38-35df4c09d687" status: 200 len: 1365 microversion: 2.47 time: 0.247709 Sep 24 21:03:01.147488 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1848/3623] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:03:00 2022] GET /compute/v2.1/servers/a80e61dd-bfe0-493e-8f38-35df4c09d687 => generated 1365 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:03:01.772816 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-23ae7b71-bafd-4517-b76d-1fc70588d83a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:01.773451 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-23ae7b71-bafd-4517-b76d-1fc70588d83a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: e6c97c05-a30e-4c8b-b56c-0cdae10ff44c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:01.823723 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23ae7b71-bafd-4517-b76d-1fc70588d83a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:01.824543 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23ae7b71-bafd-4517-b76d-1fc70588d83a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:01.826270 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23ae7b71-bafd-4517-b76d-1fc70588d83a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:01.827298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23ae7b71-bafd-4517-b76d-1fc70588d83a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:01.827812 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23ae7b71-bafd-4517-b76d-1fc70588d83a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:01.828261 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23ae7b71-bafd-4517-b76d-1fc70588d83a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:02.022229 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e996a704-785f-4f07-8bae-aee8be3acb91 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:02.022874 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e996a704-785f-4f07-8bae-aee8be3acb91 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9f8f487c-5fb4-4c63-8146-a71154f73046] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:02.027168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:03:02.035247 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e996a704-785f-4f07-8bae-aee8be3acb91 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:02.036006 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e996a704-785f-4f07-8bae-aee8be3acb91 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:02.036667 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e996a704-785f-4f07-8bae-aee8be3acb91 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:02.043328 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e996a704-785f-4f07-8bae-aee8be3acb91 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:02.044178 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e996a704-785f-4f07-8bae-aee8be3acb91 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:02.044839 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e996a704-785f-4f07-8bae-aee8be3acb91 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:02.215534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-23ae7b71-bafd-4517-b76d-1fc70588d83a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:02.224717 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-23ae7b71-bafd-4517-b76d-1fc70588d83a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c" status: 200 len: 1513 microversion: 2.1 time: 0.457152 Sep 24 21:03:02.225878 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1776/3624] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:01 2022] GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c => generated 1513 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:02.232509 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ae4cf94c-91f6-4aa5-ac3e-c351cbf640c9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:02.235417 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ae4cf94c-91f6-4aa5-ac3e-c351cbf640c9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:02.245407 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ae4cf94c-91f6-4aa5-ac3e-c351cbf640c9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:02.249458 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ae4cf94c-91f6-4aa5-ac3e-c351cbf640c9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:02.250277 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ae4cf94c-91f6-4aa5-ac3e-c351cbf640c9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:02.251326 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ae4cf94c-91f6-4aa5-ac3e-c351cbf640c9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:02.252088 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ae4cf94c-91f6-4aa5-ac3e-c351cbf640c9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:02.252714 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ae4cf94c-91f6-4aa5-ac3e-c351cbf640c9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:02.291402 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e996a704-785f-4f07-8bae-aee8be3acb91 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:02.303592 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e996a704-785f-4f07-8bae-aee8be3acb91 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046" status: 200 len: 1508 microversion: 2.1 time: 0.285284 Sep 24 21:03:02.327888 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1849/3625] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:02 2022] GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046 => generated 1508 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:02.331134 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ae4cf94c-91f6-4aa5-ac3e-c351cbf640c9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.103866 Sep 24 21:03:02.332113 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1777/3626] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:03:02 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:03:02.341991 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4fc305c1-ba40-495a-b25d-3109f185d913 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:02.343740 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4fc305c1-ba40-495a-b25d-3109f185d913 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] [instance: a80e61dd-bfe0-493e-8f38-35df4c09d687] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:02.358866 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4fc305c1-ba40-495a-b25d-3109f185d913 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:02.359688 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4fc305c1-ba40-495a-b25d-3109f185d913 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:02.360370 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4fc305c1-ba40-495a-b25d-3109f185d913 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:02.361228 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4fc305c1-ba40-495a-b25d-3109f185d913 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:02.362696 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4fc305c1-ba40-495a-b25d-3109f185d913 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:02.363388 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4fc305c1-ba40-495a-b25d-3109f185d913 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:02.472153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4fc305c1-ba40-495a-b25d-3109f185d913 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75065b5a5084b639bdab6e7dce97302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7128b36583514196945b5a65446e3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:02.486413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4fc305c1-ba40-495a-b25d-3109f185d913 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75065b5a5084b639bdab6e7dce97302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7128b36583514196945b5a65446e3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:02.488395 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4fc305c1-ba40-495a-b25d-3109f185d913 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75065b5a5084b639bdab6e7dce97302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7128b36583514196945b5a65446e3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:02.497354 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4fc305c1-ba40-495a-b25d-3109f185d913 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] 10.222.0.52 "GET /compute/v2.1/servers/a80e61dd-bfe0-493e-8f38-35df4c09d687" status: 200 len: 1365 microversion: 2.47 time: 0.161260 Sep 24 21:03:02.499421 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1850/3627] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:03:02 2022] GET /compute/v2.1/servers/a80e61dd-bfe0-493e-8f38-35df4c09d687 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:03:03.252128 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bc5381ed-b4f1-4c54-a6d8-cdd12cde3c1e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:03.252892 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bc5381ed-b4f1-4c54-a6d8-cdd12cde3c1e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: e6c97c05-a30e-4c8b-b56c-0cdae10ff44c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:03.267478 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bc5381ed-b4f1-4c54-a6d8-cdd12cde3c1e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:03.269600 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bc5381ed-b4f1-4c54-a6d8-cdd12cde3c1e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:03.270525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bc5381ed-b4f1-4c54-a6d8-cdd12cde3c1e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:03.273586 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bc5381ed-b4f1-4c54-a6d8-cdd12cde3c1e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:03.276013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bc5381ed-b4f1-4c54-a6d8-cdd12cde3c1e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:03.277100 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bc5381ed-b4f1-4c54-a6d8-cdd12cde3c1e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:03.329074 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-79f91cb4-34f0-437e-8ed3-5e71585f18bd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:03.330284 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-79f91cb4-34f0-437e-8ed3-5e71585f18bd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9f8f487c-5fb4-4c63-8146-a71154f73046] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:03.347613 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-79f91cb4-34f0-437e-8ed3-5e71585f18bd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:03.348380 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-79f91cb4-34f0-437e-8ed3-5e71585f18bd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:03.348980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-79f91cb4-34f0-437e-8ed3-5e71585f18bd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:03.349863 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-79f91cb4-34f0-437e-8ed3-5e71585f18bd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:03.350610 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-79f91cb4-34f0-437e-8ed3-5e71585f18bd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:03.351210 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-79f91cb4-34f0-437e-8ed3-5e71585f18bd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:03.407053 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:03:03.524994 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-79f91cb4-34f0-437e-8ed3-5e71585f18bd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21da3ff38a43798bce50c9aba4ae33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8340f7f8fa9848dc822903c738f78f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:03.551683 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-79f91cb4-34f0-437e-8ed3-5e71585f18bd tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046" status: 200 len: 1466 microversion: 2.1 time: 0.219201 Sep 24 21:03:03.556908 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1851/3628] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:03 2022] GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046 => generated 1466 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:03:03.582333 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-90a21bd0-809b-408b-b916-b7ecaaf1146b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:03.590742 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-90a21bd0-809b-408b-b916-b7ecaaf1146b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:03.609914 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-90a21bd0-809b-408b-b916-b7ecaaf1146b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:03.610702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-90a21bd0-809b-408b-b916-b7ecaaf1146b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:03.615074 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-90a21bd0-809b-408b-b916-b7ecaaf1146b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:03.616102 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-90a21bd0-809b-408b-b916-b7ecaaf1146b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:03.616850 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-90a21bd0-809b-408b-b916-b7ecaaf1146b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:03.617617 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-90a21bd0-809b-408b-b916-b7ecaaf1146b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:03.747756 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-90a21bd0-809b-408b-b916-b7ecaaf1146b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.186339 Sep 24 21:03:03.750549 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1852/3629] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:03:03 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:03:03.759298 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-332d34af-a44d-490e-9cd2-3231856a30c2 req-42d592d6-f18d-4a69-bb34-95f5b136cd74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f8f487c-5fb4-4c63-8146-a71154f73046", "name": "network-vif-deleted", "tag": "0028c831-6285-486f-978f-e4a36e4183a5"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:03.783268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bc5381ed-b4f1-4c54-a6d8-cdd12cde3c1e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:03.803046 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bc5381ed-b4f1-4c54-a6d8-cdd12cde3c1e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c" status: 200 len: 1513 microversion: 2.1 time: 0.554461 Sep 24 21:03:03.810867 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1778/3630] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:03 2022] GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c => generated 1513 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:03.820974 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-332d34af-a44d-490e-9cd2-3231856a30c2 req-42d592d6-f18d-4a69-bb34-95f5b136cd74 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:03.821745 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-332d34af-a44d-490e-9cd2-3231856a30c2 req-42d592d6-f18d-4a69-bb34-95f5b136cd74 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:03.826885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-332d34af-a44d-490e-9cd2-3231856a30c2 req-42d592d6-f18d-4a69-bb34-95f5b136cd74 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:03.830875 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a2599e99-100b-4570-acf6-bb167b97b808 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:03.831705 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a2599e99-100b-4570-acf6-bb167b97b808 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] [instance: a80e61dd-bfe0-493e-8f38-35df4c09d687] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:03.863452 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a2599e99-100b-4570-acf6-bb167b97b808 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:03.864578 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a2599e99-100b-4570-acf6-bb167b97b808 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:03.865404 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a2599e99-100b-4570-acf6-bb167b97b808 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:03.867441 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a2599e99-100b-4570-acf6-bb167b97b808 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:03.871805 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a2599e99-100b-4570-acf6-bb167b97b808 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:03.873679 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-332d34af-a44d-490e-9cd2-3231856a30c2 req-42d592d6-f18d-4a69-bb34-95f5b136cd74 service nova] Creating event network-vif-deleted:0028c831-6285-486f-978f-e4a36e4183a5 for instance 9f8f487c-5fb4-4c63-8146-a71154f73046 on nch2-master-1 Sep 24 21:03:03.874596 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a2599e99-100b-4570-acf6-bb167b97b808 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:03.887865 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-332d34af-a44d-490e-9cd2-3231856a30c2 req-42d592d6-f18d-4a69-bb34-95f5b136cd74 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135327 Sep 24 21:03:03.889959 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1853/3631] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:03:03.899603 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-a2599e99-100b-4570-acf6-bb167b97b808 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] HTTP exception thrown: Instance a80e61dd-bfe0-493e-8f38-35df4c09d687 could not be found. Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a2599e99-100b-4570-acf6-bb167b97b808 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Request method failure captured: Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/a80e61dd-bfe0-493e-8f38-35df4c09d687 HTTP/1.1 Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3B5HBCmNKuq1iWZnxx-c58PtPRcKpHEnkGAk9SgZWQ4tQ5YdJJ90kU8I1m5NvS7Dt0dkYmx46rR0dLjdk5U0CYe1SzdLlKBd0AAv13b7o-MNBxFaxc8lEHST4_T_QCfb03aPWvR_e5fIdtidzSsTxjcFhR4wI9EG7PcJWxyy8_AwBI Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: X-Openstack-Nova-Api-Version: 2.47 Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 7128b36583514196945b5a65446e3e2c Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersAaction247Test-1610917619 Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7128b36583514196945b5a65446e3e2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7128b36583514196945b5a65446e3e2c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7128b36583514196945b5a65446e3e2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7128b36583514196945b5a65446e3e2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersAaction247Test-1610917619 Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 7128b36583514196945b5a65446e3e2c Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersAaction247Test-1610917619 Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersAaction247Test-1610917619-project Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: b75065b5a5084b639bdab6e7dce97302 Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersAaction247Test-1610917619-project Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance a80e61dd-bfe0-493e-8f38-35df4c09d687 could not be found. Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'a80e61dd-bfe0-493e-8f38-35df4c09d687'} Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a80e61dd-bfe0-493e-8f38-35df4c09d687 could not be found. Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a80e61dd-bfe0-493e-8f38-35df4c09d687 could not be found. Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:03:03.902790 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:03:03.907085 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:03:03.907085 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:03.907085 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:03:03.907085 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:03:03.907085 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:03:03.907085 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:03:03.907085 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a80e61dd-bfe0-493e-8f38-35df4c09d687 could not be found. Sep 24 21:03:03.907085 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:03:03.919893 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a2599e99-100b-4570-acf6-bb167b97b808 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] Returning 404 to user: Instance a80e61dd-bfe0-493e-8f38-35df4c09d687 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:03:03.924387 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a2599e99-100b-4570-acf6-bb167b97b808 tempest-ServersAaction247Test-1610917619 tempest-ServersAaction247Test-1610917619-project] 10.222.0.52 "GET /compute/v2.1/servers/a80e61dd-bfe0-493e-8f38-35df4c09d687" status: 404 len: 111 microversion: 2.47 time: 0.112084 Sep 24 21:03:03.928504 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1779/3632] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:03:03 2022] GET /compute/v2.1/servers/a80e61dd-bfe0-493e-8f38-35df4c09d687 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:03:04.578423 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e6173689-dcff-4e7c-96c1-16350542cb67 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:04.579225 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e6173689-dcff-4e7c-96c1-16350542cb67 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 9f8f487c-5fb4-4c63-8146-a71154f73046] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:04.591428 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6173689-dcff-4e7c-96c1-16350542cb67 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:04.597339 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6173689-dcff-4e7c-96c1-16350542cb67 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:04.599040 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6173689-dcff-4e7c-96c1-16350542cb67 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:04.605292 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6173689-dcff-4e7c-96c1-16350542cb67 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:04.606079 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6173689-dcff-4e7c-96c1-16350542cb67 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:04.607893 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6173689-dcff-4e7c-96c1-16350542cb67 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:04.666973 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-e6173689-dcff-4e7c-96c1-16350542cb67 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] HTTP exception thrown: Instance 9f8f487c-5fb4-4c63-8146-a71154f73046 could not be found. Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e6173689-dcff-4e7c-96c1-16350542cb67 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Request method failure captured: Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046 HTTP/1.1 Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL29-X0U31bWS-OdLHgyvrqJ9cKeXdCQcU5XDw5ndql8wo4-9uoBN2em1wysBqNzzzY5Bp3FNsC7GdcmIawuHD1dS6A2amzvS90hoLHvMsCDbASCEoRJt0wxOm48tnGq2wGlMnRgEB8mO_grzOCcTdRgOgaHbZsmHcINVEnjYdvyWtzs Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 8340f7f8fa9848dc822903c738f78f2a Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 8340f7f8fa9848dc822903c738f78f2a Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-DeleteServersTestJSON-1814924671-project Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: ee21da3ff38a43798bce50c9aba4ae33 Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-DeleteServersTestJSON-1814924671-project Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 9f8f487c-5fb4-4c63-8146-a71154f73046 could not be found. Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '9f8f487c-5fb4-4c63-8146-a71154f73046'} Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f8f487c-5fb4-4c63-8146-a71154f73046 could not be found. Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f8f487c-5fb4-4c63-8146-a71154f73046 could not be found. Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:03:04.668677 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:04.674848 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:04.674848 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:03:04.674848 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:03:04.674848 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:03:04.674848 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:03:04.674848 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f8f487c-5fb4-4c63-8146-a71154f73046 could not be found. Sep 24 21:03:04.674848 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:04.674848 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e6173689-dcff-4e7c-96c1-16350542cb67 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Returning 404 to user: Instance 9f8f487c-5fb4-4c63-8146-a71154f73046 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:03:04.674848 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e6173689-dcff-4e7c-96c1-16350542cb67 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046" status: 404 len: 111 microversion: 2.1 time: 0.096592 Sep 24 21:03:04.674848 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1854/3633] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:04 2022] GET /compute/v2.1/servers/9f8f487c-5fb4-4c63-8146-a71154f73046 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:03:04.678718 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3015c9fe-8b32-4f5f-afd7-5bfd238e844e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:04.679230 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3015c9fe-8b32-4f5f-afd7-5bfd238e844e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 0fa728d6-93b7-4c6f-b358-55f15038a503] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:04.687175 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3015c9fe-8b32-4f5f-afd7-5bfd238e844e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:04.687674 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3015c9fe-8b32-4f5f-afd7-5bfd238e844e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:04.688406 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3015c9fe-8b32-4f5f-afd7-5bfd238e844e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:04.688954 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3015c9fe-8b32-4f5f-afd7-5bfd238e844e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:04.689376 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3015c9fe-8b32-4f5f-afd7-5bfd238e844e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:04.689816 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3015c9fe-8b32-4f5f-afd7-5bfd238e844e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:04.705072 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-3015c9fe-8b32-4f5f-afd7-5bfd238e844e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] HTTP exception thrown: Instance 0fa728d6-93b7-4c6f-b358-55f15038a503 could not be found. Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3015c9fe-8b32-4f5f-afd7-5bfd238e844e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Request method failure captured: Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503 HTTP/1.1 Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL29-X0U31bWS-OdLHgyvrqJ9cKeXdCQcU5XDw5ndql8wo4-9uoBN2em1wysBqNzzzY5Bp3FNsC7GdcmIawuHD1dS6A2amzvS90hoLHvMsCDbASCEoRJt0wxOm48tnGq2wGlMnRgEB8mO_grzOCcTdRgOgaHbZsmHcINVEnjYdvyWtzs Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 8340f7f8fa9848dc822903c738f78f2a Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 8340f7f8fa9848dc822903c738f78f2a Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-DeleteServersTestJSON-1814924671-project Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: ee21da3ff38a43798bce50c9aba4ae33 Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-DeleteServersTestJSON-1814924671-project Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 0fa728d6-93b7-4c6f-b358-55f15038a503 could not be found. Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '0fa728d6-93b7-4c6f-b358-55f15038a503'} Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fa728d6-93b7-4c6f-b358-55f15038a503 could not be found. Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:03:04.706714 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:03:04.712037 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fa728d6-93b7-4c6f-b358-55f15038a503 could not be found. Sep 24 21:03:04.712037 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:03:04.712037 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:03:04.712037 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:03:04.712037 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:04.712037 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:03:04.712037 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:03:04.712037 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:03:04.712037 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:03:04.712037 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fa728d6-93b7-4c6f-b358-55f15038a503 could not be found. Sep 24 21:03:04.712037 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:03:04.712037 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3015c9fe-8b32-4f5f-afd7-5bfd238e844e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Returning 404 to user: Instance 0fa728d6-93b7-4c6f-b358-55f15038a503 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:03:04.712037 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3015c9fe-8b32-4f5f-afd7-5bfd238e844e tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503" status: 404 len: 111 microversion: 2.1 time: 0.033269 Sep 24 21:03:04.717233 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f233fa12-ee38-4e45-bdf7-30bdc7ea7ea7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:04.717865 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f233fa12-ee38-4e45-bdf7-30bdc7ea7ea7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] [instance: 0fa728d6-93b7-4c6f-b358-55f15038a503] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:04.722796 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1780/3634] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:03:04 2022] DELETE /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:03:04.724418 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f233fa12-ee38-4e45-bdf7-30bdc7ea7ea7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:04.725120 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f233fa12-ee38-4e45-bdf7-30bdc7ea7ea7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:04.725727 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f233fa12-ee38-4e45-bdf7-30bdc7ea7ea7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:04.727024 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f233fa12-ee38-4e45-bdf7-30bdc7ea7ea7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:04.727671 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f233fa12-ee38-4e45-bdf7-30bdc7ea7ea7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:04.728395 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f233fa12-ee38-4e45-bdf7-30bdc7ea7ea7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:04.743556 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-f233fa12-ee38-4e45-bdf7-30bdc7ea7ea7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] HTTP exception thrown: Instance 0fa728d6-93b7-4c6f-b358-55f15038a503 could not be found. Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f233fa12-ee38-4e45-bdf7-30bdc7ea7ea7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Request method failure captured: Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503 HTTP/1.1 Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL29-X0U31bWS-OdLHgyvrqJ9cKeXdCQcU5XDw5ndql8wo4-9uoBN2em1wysBqNzzzY5Bp3FNsC7GdcmIawuHD1dS6A2amzvS90hoLHvMsCDbASCEoRJt0wxOm48tnGq2wGlMnRgEB8mO_grzOCcTdRgOgaHbZsmHcINVEnjYdvyWtzs Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 8340f7f8fa9848dc822903c738f78f2a Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8340f7f8fa9848dc822903c738f78f2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 8340f7f8fa9848dc822903c738f78f2a Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-DeleteServersTestJSON-1814924671 Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-DeleteServersTestJSON-1814924671-project Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: ee21da3ff38a43798bce50c9aba4ae33 Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-DeleteServersTestJSON-1814924671-project Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 0fa728d6-93b7-4c6f-b358-55f15038a503 could not be found. Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '0fa728d6-93b7-4c6f-b358-55f15038a503'} Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fa728d6-93b7-4c6f-b358-55f15038a503 could not be found. Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fa728d6-93b7-4c6f-b358-55f15038a503 could not be found. Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:03:04.746196 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:04.751176 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:04.751176 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:03:04.751176 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:03:04.751176 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:03:04.751176 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:03:04.751176 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fa728d6-93b7-4c6f-b358-55f15038a503 could not be found. Sep 24 21:03:04.751176 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:04.752401 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f233fa12-ee38-4e45-bdf7-30bdc7ea7ea7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] Returning 404 to user: Instance 0fa728d6-93b7-4c6f-b358-55f15038a503 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:03:04.753417 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f233fa12-ee38-4e45-bdf7-30bdc7ea7ea7 tempest-DeleteServersTestJSON-1814924671 tempest-DeleteServersTestJSON-1814924671-project] 10.222.0.52 "GET /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503" status: 404 len: 111 microversion: 2.1 time: 0.040574 Sep 24 21:03:04.765888 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-802e3313-d0bc-492a-a307-a77ad7863c6e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:04.768433 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-802e3313-d0bc-492a-a307-a77ad7863c6e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:04.771955 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1855/3635] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:04 2022] GET /compute/v2.1/servers/0fa728d6-93b7-4c6f-b358-55f15038a503 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:03:04.775945 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-802e3313-d0bc-492a-a307-a77ad7863c6e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:04.776633 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-802e3313-d0bc-492a-a307-a77ad7863c6e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:04.777244 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-802e3313-d0bc-492a-a307-a77ad7863c6e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:04.778158 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-802e3313-d0bc-492a-a307-a77ad7863c6e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:04.778822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-802e3313-d0bc-492a-a307-a77ad7863c6e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:04.779413 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-802e3313-d0bc-492a-a307-a77ad7863c6e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:04.814205 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-802e3313-d0bc-492a-a307-a77ad7863c6e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.052237 Sep 24 21:03:04.815327 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1781/3636] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:03:04 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:03:04.830414 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ea236eea-c82b-4978-8f57-2534f779e6db tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:04.831878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ea236eea-c82b-4978-8f57-2534f779e6db tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: e6c97c05-a30e-4c8b-b56c-0cdae10ff44c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:04.840107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea236eea-c82b-4978-8f57-2534f779e6db tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:04.840857 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea236eea-c82b-4978-8f57-2534f779e6db tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:04.841515 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea236eea-c82b-4978-8f57-2534f779e6db tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:04.842416 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea236eea-c82b-4978-8f57-2534f779e6db tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:04.850912 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea236eea-c82b-4978-8f57-2534f779e6db tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:04.851629 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea236eea-c82b-4978-8f57-2534f779e6db tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:05.423761 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ea236eea-c82b-4978-8f57-2534f779e6db tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:05.444196 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ea236eea-c82b-4978-8f57-2534f779e6db tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c" status: 200 len: 1513 microversion: 2.1 time: 0.618367 Sep 24 21:03:05.444810 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1856/3637] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:04 2022] GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c => generated 1513 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:05.828428 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ea673f10-729d-460f-8c8a-71242d2e9c36 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:05.831915 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ea673f10-729d-460f-8c8a-71242d2e9c36 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:05.842396 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ea673f10-729d-460f-8c8a-71242d2e9c36 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:05.843242 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ea673f10-729d-460f-8c8a-71242d2e9c36 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:05.844010 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ea673f10-729d-460f-8c8a-71242d2e9c36 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:05.844903 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ea673f10-729d-460f-8c8a-71242d2e9c36 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:05.845530 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ea673f10-729d-460f-8c8a-71242d2e9c36 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:05.847057 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ea673f10-729d-460f-8c8a-71242d2e9c36 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:05.903147 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ea673f10-729d-460f-8c8a-71242d2e9c36 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.079221 Sep 24 21:03:05.904311 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1782/3638] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:03:05 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 21:03:06.469300 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ce31849b-7082-45a9-8a63-1259831a655e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:06.470535 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ce31849b-7082-45a9-8a63-1259831a655e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: e6c97c05-a30e-4c8b-b56c-0cdae10ff44c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:06.488132 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ce31849b-7082-45a9-8a63-1259831a655e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:06.488132 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ce31849b-7082-45a9-8a63-1259831a655e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:06.488132 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ce31849b-7082-45a9-8a63-1259831a655e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:06.489965 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ce31849b-7082-45a9-8a63-1259831a655e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:06.493391 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ce31849b-7082-45a9-8a63-1259831a655e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:06.495193 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ce31849b-7082-45a9-8a63-1259831a655e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:06.918149 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f4425378-b2f5-4c3f-8640-41fce13a9bb7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:06.920859 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f4425378-b2f5-4c3f-8640-41fce13a9bb7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:06.931282 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:03:06.948013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f4425378-b2f5-4c3f-8640-41fce13a9bb7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:06.951739 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f4425378-b2f5-4c3f-8640-41fce13a9bb7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:06.952952 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f4425378-b2f5-4c3f-8640-41fce13a9bb7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:06.955142 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f4425378-b2f5-4c3f-8640-41fce13a9bb7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:06.959163 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f4425378-b2f5-4c3f-8640-41fce13a9bb7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:06.960314 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f4425378-b2f5-4c3f-8640-41fce13a9bb7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:07.059867 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f4425378-b2f5-4c3f-8640-41fce13a9bb7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.147294 Sep 24 21:03:07.070774 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1783/3639] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:03:06 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:03:07.463468 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ce31849b-7082-45a9-8a63-1259831a655e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:07.491541 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ce31849b-7082-45a9-8a63-1259831a655e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c" status: 200 len: 1490 microversion: 2.1 time: 1.027245 Sep 24 21:03:07.500485 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1857/3640] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:06 2022] GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c => generated 1490 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:07.528097 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1e88aac1-71cc-42ff-96c3-7f7271d3f016 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:07.531189 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1e88aac1-71cc-42ff-96c3-7f7271d3f016 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:07.544741 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e88aac1-71cc-42ff-96c3-7f7271d3f016 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:07.547740 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e88aac1-71cc-42ff-96c3-7f7271d3f016 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:07.548185 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e88aac1-71cc-42ff-96c3-7f7271d3f016 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:07.548926 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e88aac1-71cc-42ff-96c3-7f7271d3f016 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:07.549385 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e88aac1-71cc-42ff-96c3-7f7271d3f016 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:07.549815 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e88aac1-71cc-42ff-96c3-7f7271d3f016 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:07.608351 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1e88aac1-71cc-42ff-96c3-7f7271d3f016 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "POST /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/action" status: 200 len: 132 microversion: 2.1 time: 0.085080 Sep 24 21:03:07.618800 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1784/3641] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:03:07 2022] POST /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/action => generated 132 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:03:07.622896 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c4e10422-c155-40e7-bcb0-f08f159753d9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:07.622896 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c4e10422-c155-40e7-bcb0-f08f159753d9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:07.639955 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4e10422-c155-40e7-bcb0-f08f159753d9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:07.641469 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4e10422-c155-40e7-bcb0-f08f159753d9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:07.642212 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4e10422-c155-40e7-bcb0-f08f159753d9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:07.646253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4e10422-c155-40e7-bcb0-f08f159753d9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:07.647119 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4e10422-c155-40e7-bcb0-f08f159753d9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:07.648034 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4e10422-c155-40e7-bcb0-f08f159753d9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:08.075552 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d6fd3878-567a-4626-a135-ca57df1907f1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:08.079330 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d6fd3878-567a-4626-a135-ca57df1907f1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:08.090039 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6fd3878-567a-4626-a135-ca57df1907f1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:08.091433 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6fd3878-567a-4626-a135-ca57df1907f1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:08.092728 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6fd3878-567a-4626-a135-ca57df1907f1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:08.094457 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6fd3878-567a-4626-a135-ca57df1907f1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:08.095342 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6fd3878-567a-4626-a135-ca57df1907f1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:08.096006 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6fd3878-567a-4626-a135-ca57df1907f1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:08.143795 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d6fd3878-567a-4626-a135-ca57df1907f1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.074788 Sep 24 21:03:08.145185 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1785/3642] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:03:08 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 21:03:08.148702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c4e10422-c155-40e7-bcb0-f08f159753d9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:08.161793 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c4e10422-c155-40e7-bcb0-f08f159753d9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.546537 Sep 24 21:03:08.174991 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1858/3643] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:07 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:08.202361 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f4ea174e-b5e5-42d1-93a4-f83205d52e69 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:08.203167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f4ea174e-b5e5-42d1-93a4-f83205d52e69 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:08.210580 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f4ea174e-b5e5-42d1-93a4-f83205d52e69 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:08.211246 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f4ea174e-b5e5-42d1-93a4-f83205d52e69 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:08.211849 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f4ea174e-b5e5-42d1-93a4-f83205d52e69 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:08.213023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f4ea174e-b5e5-42d1-93a4-f83205d52e69 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:08.213664 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f4ea174e-b5e5-42d1-93a4-f83205d52e69 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:08.214265 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f4ea174e-b5e5-42d1-93a4-f83205d52e69 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:08.612308 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f4ea174e-b5e5-42d1-93a4-f83205d52e69 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:08.626643 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f4ea174e-b5e5-42d1-93a4-f83205d52e69 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.427960 Sep 24 21:03:08.627619 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1786/3644] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:08 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:08.653357 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-27337539-3bb1-4c0a-b33f-2ce48cc8a7b8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:08.654481 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-27337539-3bb1-4c0a-b33f-2ce48cc8a7b8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:08.662787 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27337539-3bb1-4c0a-b33f-2ce48cc8a7b8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:08.668651 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27337539-3bb1-4c0a-b33f-2ce48cc8a7b8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:08.670856 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27337539-3bb1-4c0a-b33f-2ce48cc8a7b8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:08.671847 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27337539-3bb1-4c0a-b33f-2ce48cc8a7b8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:08.673895 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27337539-3bb1-4c0a-b33f-2ce48cc8a7b8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:08.677681 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27337539-3bb1-4c0a-b33f-2ce48cc8a7b8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:08.938288 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-149ae46c-b99c-4471-9ecc-9af6ece38c2a tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-188880363", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "bb15b23c-0215-4369-bbdc-77581447330d"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:09.020210 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-149ae46c-b99c-4471-9ecc-9af6ece38c2a tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] validate_networks() for [('bb15b23c-0215-4369-bbdc-77581447330d', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:03:09.107940 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-27337539-3bb1-4c0a-b33f-2ce48cc8a7b8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:09.118830 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-27337539-3bb1-4c0a-b33f-2ce48cc8a7b8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.470192 Sep 24 21:03:09.119898 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1787/3645] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:08 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:03:09.144267 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a5954693-b699-4b42-8bd6-c3a60d8af009 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:09.145341 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a5954693-b699-4b42-8bd6-c3a60d8af009 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:09.152652 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5954693-b699-4b42-8bd6-c3a60d8af009 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:09.153672 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5954693-b699-4b42-8bd6-c3a60d8af009 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:09.154355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5954693-b699-4b42-8bd6-c3a60d8af009 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:09.155308 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5954693-b699-4b42-8bd6-c3a60d8af009 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:09.155984 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5954693-b699-4b42-8bd6-c3a60d8af009 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:09.156628 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5954693-b699-4b42-8bd6-c3a60d8af009 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:09.783189 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a5954693-b699-4b42-8bd6-c3a60d8af009 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:09.799387 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a5954693-b699-4b42-8bd6-c3a60d8af009 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.660391 Sep 24 21:03:09.800360 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1788/3646] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:09 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:09.805338 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9a97aa3c-ce2a-418e-a337-e9d19f2932ab tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:09.808450 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9a97aa3c-ce2a-418e-a337-e9d19f2932ab tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:09.815098 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a97aa3c-ce2a-418e-a337-e9d19f2932ab tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:09.816001 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a97aa3c-ce2a-418e-a337-e9d19f2932ab tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:09.816672 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a97aa3c-ce2a-418e-a337-e9d19f2932ab tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:09.817638 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a97aa3c-ce2a-418e-a337-e9d19f2932ab tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:09.818328 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a97aa3c-ce2a-418e-a337-e9d19f2932ab tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:09.819037 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a97aa3c-ce2a-418e-a337-e9d19f2932ab tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:09.822640 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:03:09.885670 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9a97aa3c-ce2a-418e-a337-e9d19f2932ab tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.084107 Sep 24 21:03:09.891150 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1789/3647] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:03:09 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:03:10.003780 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c3db39ac-1e67-42c2-ae66-d2c5a5d177dd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1850733695", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "75e36a3c-3095-402d-baea-50bb8c960b77"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:10.087947 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-c3db39ac-1e67-42c2-ae66-d2c5a5d177dd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] validate_networks() for [('75e36a3c-3095-402d-baea-50bb8c960b77', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:03:10.995940 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-149ae46c-b99c-4471-9ecc-9af6ece38c2a tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:03:10.996950 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-149ae46c-b99c-4471-9ecc-9af6ece38c2a tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:03:10.997673 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-149ae46c-b99c-4471-9ecc-9af6ece38c2a tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:03:10.998256 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-149ae46c-b99c-4471-9ecc-9af6ece38c2a tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:03:10.999085 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-149ae46c-b99c-4471-9ecc-9af6ece38c2a tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:03:11.012973 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-149ae46c-b99c-4471-9ecc-9af6ece38c2a tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:11.013696 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-149ae46c-b99c-4471-9ecc-9af6ece38c2a tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:11.015223 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-149ae46c-b99c-4471-9ecc-9af6ece38c2a tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:11.016214 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-149ae46c-b99c-4471-9ecc-9af6ece38c2a tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:11.016849 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-149ae46c-b99c-4471-9ecc-9af6ece38c2a tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:11.017452 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-149ae46c-b99c-4471-9ecc-9af6ece38c2a tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:11.061703 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-149ae46c-b99c-4471-9ecc-9af6ece38c2a tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Getting quotas for project dad3759161984bb896e1423af9a91d14. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:03:11.077794 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-149ae46c-b99c-4471-9ecc-9af6ece38c2a tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Getting quotas for user 7d8199c7aba04a9fb1212a2c7e1a52b3 and project dad3759161984bb896e1423af9a91d14. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:03:11.112381 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-149ae46c-b99c-4471-9ecc-9af6ece38c2a tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:03:11.116289 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-149ae46c-b99c-4471-9ecc-9af6ece38c2a tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] [instance: 5be295c0-e7fa-454b-bbba-6b9cddf88575] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:03:11.221076 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-149ae46c-b99c-4471-9ecc-9af6ece38c2a tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.714932 Sep 24 21:03:11.231151 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1859/3648] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:03:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 24 21:03:11.236692 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7406479c-1ab4-404f-afdf-a5aadd0f4066 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:11.239567 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7406479c-1ab4-404f-afdf-a5aadd0f4066 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:11.248311 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7406479c-1ab4-404f-afdf-a5aadd0f4066 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:11.249092 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7406479c-1ab4-404f-afdf-a5aadd0f4066 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:11.250537 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7406479c-1ab4-404f-afdf-a5aadd0f4066 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:11.253314 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7406479c-1ab4-404f-afdf-a5aadd0f4066 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:11.253998 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7406479c-1ab4-404f-afdf-a5aadd0f4066 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:11.254906 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7406479c-1ab4-404f-afdf-a5aadd0f4066 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:11.390316 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7406479c-1ab4-404f-afdf-a5aadd0f4066 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.156109 Sep 24 21:03:11.392885 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1860/3649] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:03:11 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:03:11.407055 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a29d327b-2f1f-4c00-8a40-10bfb65f1c5d tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:11.410347 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a29d327b-2f1f-4c00-8a40-10bfb65f1c5d tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] [instance: 5be295c0-e7fa-454b-bbba-6b9cddf88575] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:11.771136 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a29d327b-2f1f-4c00-8a40-10bfb65f1c5d tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8199c7aba04a9fb1212a2c7e1a52b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad3759161984bb896e1423af9a91d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:11.781200 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a29d327b-2f1f-4c00-8a40-10bfb65f1c5d tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] 10.222.0.52 "GET /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575" status: 200 len: 1215 microversion: 2.1 time: 0.385926 Sep 24 21:03:11.802377 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1861/3650] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:11 2022] GET /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575 => generated 1215 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:12.406649 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-699e0ce4-66c0-4bc4-a100-e0db3fc3171d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:12.411717 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-699e0ce4-66c0-4bc4-a100-e0db3fc3171d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:12.431621 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-699e0ce4-66c0-4bc4-a100-e0db3fc3171d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:12.433835 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-699e0ce4-66c0-4bc4-a100-e0db3fc3171d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:12.435245 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-699e0ce4-66c0-4bc4-a100-e0db3fc3171d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:12.439795 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-699e0ce4-66c0-4bc4-a100-e0db3fc3171d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:12.440496 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-699e0ce4-66c0-4bc4-a100-e0db3fc3171d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:12.441138 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-699e0ce4-66c0-4bc4-a100-e0db3fc3171d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:12.508972 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-699e0ce4-66c0-4bc4-a100-e0db3fc3171d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.106897 Sep 24 21:03:12.511855 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1862/3651] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:03:12 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 21:03:12.614015 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-c3db39ac-1e67-42c2-ae66-d2c5a5d177dd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:03:12.614540 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-c3db39ac-1e67-42c2-ae66-d2c5a5d177dd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:03:12.614968 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-c3db39ac-1e67-42c2-ae66-d2c5a5d177dd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:03:12.615391 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-c3db39ac-1e67-42c2-ae66-d2c5a5d177dd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:03:12.616649 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-c3db39ac-1e67-42c2-ae66-d2c5a5d177dd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:03:12.639094 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c3db39ac-1e67-42c2-ae66-d2c5a5d177dd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:12.639854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c3db39ac-1e67-42c2-ae66-d2c5a5d177dd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:12.640459 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c3db39ac-1e67-42c2-ae66-d2c5a5d177dd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:12.641369 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c3db39ac-1e67-42c2-ae66-d2c5a5d177dd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:12.646655 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c3db39ac-1e67-42c2-ae66-d2c5a5d177dd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:12.647285 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c3db39ac-1e67-42c2-ae66-d2c5a5d177dd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:12.701946 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-c3db39ac-1e67-42c2-ae66-d2c5a5d177dd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Getting quotas for project c1e5d6f3d41e4aa49e630f8c7ac87ded. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:03:12.709346 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-c3db39ac-1e67-42c2-ae66-d2c5a5d177dd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Getting quotas for user 6493da825aa24f43bdf8f0835a16e3bb and project c1e5d6f3d41e4aa49e630f8c7ac87ded. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:03:12.732854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c3db39ac-1e67-42c2-ae66-d2c5a5d177dd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:03:12.748329 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c3db39ac-1e67-42c2-ae66-d2c5a5d177dd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 40178212-5f30-4d39-80a4-b92306531580] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:03:12.809199 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0d0dc417-1ba1-4826-915e-aed75ecc8065 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:12.810063 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0d0dc417-1ba1-4826-915e-aed75ecc8065 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] [instance: 5be295c0-e7fa-454b-bbba-6b9cddf88575] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:12.823678 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d0dc417-1ba1-4826-915e-aed75ecc8065 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:12.824197 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d0dc417-1ba1-4826-915e-aed75ecc8065 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:12.824647 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d0dc417-1ba1-4826-915e-aed75ecc8065 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:12.825372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d0dc417-1ba1-4826-915e-aed75ecc8065 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:12.825837 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d0dc417-1ba1-4826-915e-aed75ecc8065 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:12.826287 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d0dc417-1ba1-4826-915e-aed75ecc8065 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:12.827006 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c3db39ac-1e67-42c2-ae66-d2c5a5d177dd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.827003 Sep 24 21:03:12.827971 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1790/3652] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:03:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 24 21:03:12.841225 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c38d6422-9cbc-4116-a634-ac08d5e4b2b0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:12.842440 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c38d6422-9cbc-4116-a634-ac08d5e4b2b0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 40178212-5f30-4d39-80a4-b92306531580] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:13.140238 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0d0dc417-1ba1-4826-915e-aed75ecc8065 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8199c7aba04a9fb1212a2c7e1a52b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad3759161984bb896e1423af9a91d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:13.152716 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0d0dc417-1ba1-4826-915e-aed75ecc8065 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] 10.222.0.52 "GET /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575" status: 200 len: 1267 microversion: 2.1 time: 0.347577 Sep 24 21:03:13.159462 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1863/3653] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:12 2022] GET /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575 => generated 1267 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:03:13.233329 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c38d6422-9cbc-4116-a634-ac08d5e4b2b0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:13.246783 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c38d6422-9cbc-4116-a634-ac08d5e4b2b0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580" status: 200 len: 1215 microversion: 2.1 time: 0.411813 Sep 24 21:03:13.247375 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1791/3654] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:12 2022] GET /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580 => generated 1215 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:03:13.522883 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ed092abb-8fc5-4c02-8546-dfca1d294631 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:13.525912 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ed092abb-8fc5-4c02-8546-dfca1d294631 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:13.540138 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed092abb-8fc5-4c02-8546-dfca1d294631 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:13.540871 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed092abb-8fc5-4c02-8546-dfca1d294631 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:13.541395 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed092abb-8fc5-4c02-8546-dfca1d294631 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:13.542173 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed092abb-8fc5-4c02-8546-dfca1d294631 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:13.546803 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed092abb-8fc5-4c02-8546-dfca1d294631 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:13.547318 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed092abb-8fc5-4c02-8546-dfca1d294631 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:13.620329 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ed092abb-8fc5-4c02-8546-dfca1d294631 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.101649 Sep 24 21:03:13.620934 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1864/3655] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:03:13 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:03:14.194717 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9fcdd748-304c-4fdd-9816-2e6ac919782e tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:14.195395 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9fcdd748-304c-4fdd-9816-2e6ac919782e tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] [instance: 5be295c0-e7fa-454b-bbba-6b9cddf88575] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:14.224111 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fcdd748-304c-4fdd-9816-2e6ac919782e tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:14.226507 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fcdd748-304c-4fdd-9816-2e6ac919782e tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:14.227117 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fcdd748-304c-4fdd-9816-2e6ac919782e tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:14.230638 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fcdd748-304c-4fdd-9816-2e6ac919782e tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:14.231481 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fcdd748-304c-4fdd-9816-2e6ac919782e tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:14.234171 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fcdd748-304c-4fdd-9816-2e6ac919782e tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:14.273777 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-14bcdc19-ce5c-41b3-8144-6dedc948df2d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:14.274754 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-14bcdc19-ce5c-41b3-8144-6dedc948df2d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 40178212-5f30-4d39-80a4-b92306531580] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:14.292681 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-14bcdc19-ce5c-41b3-8144-6dedc948df2d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:14.294908 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-14bcdc19-ce5c-41b3-8144-6dedc948df2d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:14.297865 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-14bcdc19-ce5c-41b3-8144-6dedc948df2d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:14.299890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-14bcdc19-ce5c-41b3-8144-6dedc948df2d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:14.301490 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-14bcdc19-ce5c-41b3-8144-6dedc948df2d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:14.303772 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-14bcdc19-ce5c-41b3-8144-6dedc948df2d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:14.448593 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9fcdd748-304c-4fdd-9816-2e6ac919782e tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8199c7aba04a9fb1212a2c7e1a52b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad3759161984bb896e1423af9a91d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:14.460063 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9fcdd748-304c-4fdd-9816-2e6ac919782e tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] 10.222.0.52 "GET /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575" status: 200 len: 1273 microversion: 2.1 time: 0.270787 Sep 24 21:03:14.464810 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1792/3656] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:14 2022] GET /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575 => generated 1273 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:14.523275 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-14bcdc19-ce5c-41b3-8144-6dedc948df2d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:14.539069 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-14bcdc19-ce5c-41b3-8144-6dedc948df2d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580" status: 200 len: 1267 microversion: 2.1 time: 0.270180 Sep 24 21:03:14.539985 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1865/3657] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:14 2022] GET /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580 => generated 1267 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:03:14.644872 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bf29158a-8870-4acd-977d-eca93907f473 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:14.647452 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bf29158a-8870-4acd-977d-eca93907f473 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:14.659783 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf29158a-8870-4acd-977d-eca93907f473 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:14.660290 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf29158a-8870-4acd-977d-eca93907f473 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:14.662998 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf29158a-8870-4acd-977d-eca93907f473 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:14.663843 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf29158a-8870-4acd-977d-eca93907f473 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:14.664339 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf29158a-8870-4acd-977d-eca93907f473 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:14.664789 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf29158a-8870-4acd-977d-eca93907f473 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:14.772138 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bf29158a-8870-4acd-977d-eca93907f473 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.142944 Sep 24 21:03:14.772740 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1793/3658] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:03:14 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:03:15.492043 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d054d2dc-b58c-4ac8-ae14-b47053ba732b tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:15.492924 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d054d2dc-b58c-4ac8-ae14-b47053ba732b tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] [instance: 5be295c0-e7fa-454b-bbba-6b9cddf88575] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:15.502470 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d054d2dc-b58c-4ac8-ae14-b47053ba732b tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:15.512019 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d054d2dc-b58c-4ac8-ae14-b47053ba732b tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:15.513427 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d054d2dc-b58c-4ac8-ae14-b47053ba732b tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:15.514413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d054d2dc-b58c-4ac8-ae14-b47053ba732b tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:15.515094 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d054d2dc-b58c-4ac8-ae14-b47053ba732b tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:15.516401 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d054d2dc-b58c-4ac8-ae14-b47053ba732b tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:15.568948 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1679e8c5-760c-44f6-92a2-0da464c8dfa3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:15.569574 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1679e8c5-760c-44f6-92a2-0da464c8dfa3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 40178212-5f30-4d39-80a4-b92306531580] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:15.585918 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1679e8c5-760c-44f6-92a2-0da464c8dfa3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:15.591246 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1679e8c5-760c-44f6-92a2-0da464c8dfa3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:15.592709 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1679e8c5-760c-44f6-92a2-0da464c8dfa3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:15.593486 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1679e8c5-760c-44f6-92a2-0da464c8dfa3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:15.593958 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1679e8c5-760c-44f6-92a2-0da464c8dfa3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:15.594399 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1679e8c5-760c-44f6-92a2-0da464c8dfa3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:16.211902 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1679e8c5-760c-44f6-92a2-0da464c8dfa3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:16.240696 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1679e8c5-760c-44f6-92a2-0da464c8dfa3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580" status: 200 len: 1273 microversion: 2.1 time: 0.676554 Sep 24 21:03:16.241517 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1794/3659] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:15 2022] GET /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580 => generated 1273 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:03:16.269124 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f0a71a47-330f-4b90-9e53-25614b5e246c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:16.273614 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f0a71a47-330f-4b90-9e53-25614b5e246c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:16.294684 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f0a71a47-330f-4b90-9e53-25614b5e246c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:16.296541 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f0a71a47-330f-4b90-9e53-25614b5e246c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:16.297694 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f0a71a47-330f-4b90-9e53-25614b5e246c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:16.299340 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f0a71a47-330f-4b90-9e53-25614b5e246c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:16.301189 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f0a71a47-330f-4b90-9e53-25614b5e246c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:16.301870 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f0a71a47-330f-4b90-9e53-25614b5e246c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:16.395178 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f0a71a47-330f-4b90-9e53-25614b5e246c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.149495 Sep 24 21:03:16.398006 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1795/3660] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:03:16 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:03:16.951662 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d054d2dc-b58c-4ac8-ae14-b47053ba732b tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8199c7aba04a9fb1212a2c7e1a52b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad3759161984bb896e1423af9a91d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:16.961752 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d054d2dc-b58c-4ac8-ae14-b47053ba732b tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] 10.222.0.52 "GET /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575" status: 200 len: 1315 microversion: 2.1 time: 1.473632 Sep 24 21:03:16.977628 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1866/3661] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:15 2022] GET /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575 => generated 1315 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:17.267275 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5b11f7ee-2bc5-4cbf-975a-cf3724c452e0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:17.268761 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5b11f7ee-2bc5-4cbf-975a-cf3724c452e0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 40178212-5f30-4d39-80a4-b92306531580] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:17.287689 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b11f7ee-2bc5-4cbf-975a-cf3724c452e0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:17.291144 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b11f7ee-2bc5-4cbf-975a-cf3724c452e0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:17.292759 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b11f7ee-2bc5-4cbf-975a-cf3724c452e0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:17.296965 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b11f7ee-2bc5-4cbf-975a-cf3724c452e0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:17.300103 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b11f7ee-2bc5-4cbf-975a-cf3724c452e0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:17.303331 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b11f7ee-2bc5-4cbf-975a-cf3724c452e0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:17.409793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4ea99907-3c03-4101-81c0-cc48aefe88ca tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:17.414577 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4ea99907-3c03-4101-81c0-cc48aefe88ca tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:17.433025 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ea99907-3c03-4101-81c0-cc48aefe88ca tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:17.434376 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ea99907-3c03-4101-81c0-cc48aefe88ca tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:17.438319 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ea99907-3c03-4101-81c0-cc48aefe88ca tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:17.439329 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ea99907-3c03-4101-81c0-cc48aefe88ca tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:17.440006 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ea99907-3c03-4101-81c0-cc48aefe88ca tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:17.440615 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ea99907-3c03-4101-81c0-cc48aefe88ca tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:17.511284 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4ea99907-3c03-4101-81c0-cc48aefe88ca tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.106505 Sep 24 21:03:17.522903 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1867/3662] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:03:17 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 21:03:17.619411 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5b11f7ee-2bc5-4cbf-975a-cf3724c452e0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:17.633917 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5b11f7ee-2bc5-4cbf-975a-cf3724c452e0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580" status: 200 len: 1273 microversion: 2.1 time: 0.372254 Sep 24 21:03:17.639379 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1796/3663] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:17 2022] GET /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580 => generated 1273 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:17.997852 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ad2afe36-7e0c-4e1f-a525-8ef2b7c59190 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:17.999176 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ad2afe36-7e0c-4e1f-a525-8ef2b7c59190 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] [instance: 5be295c0-e7fa-454b-bbba-6b9cddf88575] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:18.008667 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad2afe36-7e0c-4e1f-a525-8ef2b7c59190 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:18.009233 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad2afe36-7e0c-4e1f-a525-8ef2b7c59190 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:18.009916 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad2afe36-7e0c-4e1f-a525-8ef2b7c59190 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:18.014973 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad2afe36-7e0c-4e1f-a525-8ef2b7c59190 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:18.015511 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad2afe36-7e0c-4e1f-a525-8ef2b7c59190 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:18.016203 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad2afe36-7e0c-4e1f-a525-8ef2b7c59190 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:18.524056 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d710809d-613c-4ec8-bf02-15a5dca2024b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:18.533454 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d710809d-613c-4ec8-bf02-15a5dca2024b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:18.559951 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d710809d-613c-4ec8-bf02-15a5dca2024b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:18.560268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d710809d-613c-4ec8-bf02-15a5dca2024b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:18.560892 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d710809d-613c-4ec8-bf02-15a5dca2024b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:18.562260 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d710809d-613c-4ec8-bf02-15a5dca2024b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:18.562806 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d710809d-613c-4ec8-bf02-15a5dca2024b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:18.563658 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d710809d-613c-4ec8-bf02-15a5dca2024b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:18.666774 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d710809d-613c-4ec8-bf02-15a5dca2024b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.146675 Sep 24 21:03:18.672119 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1797/3664] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:03:18 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:03:18.677357 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4cec2387-a35a-49eb-94ed-7ef5e244b904 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:18.678266 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4cec2387-a35a-49eb-94ed-7ef5e244b904 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 40178212-5f30-4d39-80a4-b92306531580] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:18.685687 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cec2387-a35a-49eb-94ed-7ef5e244b904 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:18.686577 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cec2387-a35a-49eb-94ed-7ef5e244b904 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:18.687238 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cec2387-a35a-49eb-94ed-7ef5e244b904 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:18.688828 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cec2387-a35a-49eb-94ed-7ef5e244b904 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:18.689558 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cec2387-a35a-49eb-94ed-7ef5e244b904 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:18.690202 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cec2387-a35a-49eb-94ed-7ef5e244b904 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:19.575775 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ad2afe36-7e0c-4e1f-a525-8ef2b7c59190 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8199c7aba04a9fb1212a2c7e1a52b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad3759161984bb896e1423af9a91d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:19.584942 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ad2afe36-7e0c-4e1f-a525-8ef2b7c59190 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] 10.222.0.52 "GET /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575" status: 200 len: 1315 microversion: 2.1 time: 1.592109 Sep 24 21:03:19.585534 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1868/3665] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:17 2022] GET /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575 => generated 1315 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:19.629107 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4cec2387-a35a-49eb-94ed-7ef5e244b904 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:19.640225 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4cec2387-a35a-49eb-94ed-7ef5e244b904 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580" status: 200 len: 1315 microversion: 2.1 time: 0.966632 Sep 24 21:03:19.640844 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1798/3666] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:18 2022] GET /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580 => generated 1315 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:19.686106 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5ad1e9f3-09a2-46df-9d6c-7b32397a20bc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:19.690222 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5ad1e9f3-09a2-46df-9d6c-7b32397a20bc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:19.711216 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ad1e9f3-09a2-46df-9d6c-7b32397a20bc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:19.712288 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ad1e9f3-09a2-46df-9d6c-7b32397a20bc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:19.713628 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ad1e9f3-09a2-46df-9d6c-7b32397a20bc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:19.714657 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ad1e9f3-09a2-46df-9d6c-7b32397a20bc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:19.715347 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ad1e9f3-09a2-46df-9d6c-7b32397a20bc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:19.715997 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ad1e9f3-09a2-46df-9d6c-7b32397a20bc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:19.790045 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5ad1e9f3-09a2-46df-9d6c-7b32397a20bc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.112798 Sep 24 21:03:19.792053 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1869/3667] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:03:19 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:03:20.610936 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c79183b3-0c98-4dc1-bb4f-276d9c0fad72 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:20.611582 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c79183b3-0c98-4dc1-bb4f-276d9c0fad72 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] [instance: 5be295c0-e7fa-454b-bbba-6b9cddf88575] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:20.628736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c79183b3-0c98-4dc1-bb4f-276d9c0fad72 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:20.635379 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c79183b3-0c98-4dc1-bb4f-276d9c0fad72 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:20.639876 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c79183b3-0c98-4dc1-bb4f-276d9c0fad72 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:20.643473 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c79183b3-0c98-4dc1-bb4f-276d9c0fad72 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:20.644948 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c79183b3-0c98-4dc1-bb4f-276d9c0fad72 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:20.655330 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c79183b3-0c98-4dc1-bb4f-276d9c0fad72 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:20.670195 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d2a226ed-7d64-4e82-8869-00ebff5f1fb5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:20.670979 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d2a226ed-7d64-4e82-8869-00ebff5f1fb5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 40178212-5f30-4d39-80a4-b92306531580] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:20.687637 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d2a226ed-7d64-4e82-8869-00ebff5f1fb5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:20.688380 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d2a226ed-7d64-4e82-8869-00ebff5f1fb5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:20.688988 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d2a226ed-7d64-4e82-8869-00ebff5f1fb5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:20.689996 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d2a226ed-7d64-4e82-8869-00ebff5f1fb5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:20.691469 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d2a226ed-7d64-4e82-8869-00ebff5f1fb5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:20.692135 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d2a226ed-7d64-4e82-8869-00ebff5f1fb5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:21.028872 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:03:21.392390 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c79183b3-0c98-4dc1-bb4f-276d9c0fad72 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8199c7aba04a9fb1212a2c7e1a52b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad3759161984bb896e1423af9a91d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:21.401831 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c79183b3-0c98-4dc1-bb4f-276d9c0fad72 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] 10.222.0.52 "GET /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575" status: 200 len: 1315 microversion: 2.1 time: 0.796216 Sep 24 21:03:21.419721 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1799/3668] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:20 2022] GET /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575 => generated 1315 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:21.419721 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-07fb4e38-e3fa-4149-a111-e8149885ca0c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:21.419721 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-07fb4e38-e3fa-4149-a111-e8149885ca0c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:21.426162 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d2a226ed-7d64-4e82-8869-00ebff5f1fb5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:21.433205 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-07fb4e38-e3fa-4149-a111-e8149885ca0c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:21.447553 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-07fb4e38-e3fa-4149-a111-e8149885ca0c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:21.448178 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-07fb4e38-e3fa-4149-a111-e8149885ca0c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:21.449557 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-07fb4e38-e3fa-4149-a111-e8149885ca0c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:21.450108 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-07fb4e38-e3fa-4149-a111-e8149885ca0c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:21.450757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-07fb4e38-e3fa-4149-a111-e8149885ca0c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:21.451082 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d2a226ed-7d64-4e82-8869-00ebff5f1fb5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580" status: 200 len: 1315 microversion: 2.1 time: 0.781062 Sep 24 21:03:21.454703 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1870/3669] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:20 2022] GET /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580 => generated 1315 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:03:21.463239 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-115ce4a6-8e08-42da-b753-a5a8a62b7e78 req-abe55ec9-aa60-4c4b-befc-e6a63dc9cf7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5be295c0-e7fa-454b-bbba-6b9cddf88575", "tag": "21d51de6-e5a8-4196-807a-c4b41d677479"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:21.496122 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-115ce4a6-8e08-42da-b753-a5a8a62b7e78 req-abe55ec9-aa60-4c4b-befc-e6a63dc9cf7a service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:21.496926 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-115ce4a6-8e08-42da-b753-a5a8a62b7e78 req-abe55ec9-aa60-4c4b-befc-e6a63dc9cf7a service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:21.498279 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-115ce4a6-8e08-42da-b753-a5a8a62b7e78 req-abe55ec9-aa60-4c4b-befc-e6a63dc9cf7a service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:21.518635 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-07fb4e38-e3fa-4149-a111-e8149885ca0c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.111012 Sep 24 21:03:21.519337 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1800/3670] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:03:21 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:03:21.528622 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-115ce4a6-8e08-42da-b753-a5a8a62b7e78 req-abe55ec9-aa60-4c4b-befc-e6a63dc9cf7a service nova] Creating event network-changed:21d51de6-e5a8-4196-807a-c4b41d677479 for instance 5be295c0-e7fa-454b-bbba-6b9cddf88575 on nch1-master-1 Sep 24 21:03:21.540761 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-115ce4a6-8e08-42da-b753-a5a8a62b7e78 req-abe55ec9-aa60-4c4b-befc-e6a63dc9cf7a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084483 Sep 24 21:03:21.543977 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1871/3671] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:03:21.620164 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-e7d273b4-f134-4fd0-8196-5b76b62b13a9 req-14ff0de2-1617-4f2d-80e7-e6331b5f8894 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40178212-5f30-4d39-80a4-b92306531580", "tag": "820e2004-3830-4755-9111-459071db40de"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:21.646270 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e7d273b4-f134-4fd0-8196-5b76b62b13a9 req-14ff0de2-1617-4f2d-80e7-e6331b5f8894 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:21.647452 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e7d273b4-f134-4fd0-8196-5b76b62b13a9 req-14ff0de2-1617-4f2d-80e7-e6331b5f8894 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:21.648154 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e7d273b4-f134-4fd0-8196-5b76b62b13a9 req-14ff0de2-1617-4f2d-80e7-e6331b5f8894 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:21.680669 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-e7d273b4-f134-4fd0-8196-5b76b62b13a9 req-14ff0de2-1617-4f2d-80e7-e6331b5f8894 service nova] Creating event network-changed:820e2004-3830-4755-9111-459071db40de for instance 40178212-5f30-4d39-80a4-b92306531580 on nch2-master-1 Sep 24 21:03:21.697074 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-e7d273b4-f134-4fd0-8196-5b76b62b13a9 req-14ff0de2-1617-4f2d-80e7-e6331b5f8894 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081600 Sep 24 21:03:21.697879 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1801/3672] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:03:22.434019 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5abbc4bf-bd46-4d30-b0d8-4ccdeb63dca1 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:22.435512 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5abbc4bf-bd46-4d30-b0d8-4ccdeb63dca1 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] [instance: 5be295c0-e7fa-454b-bbba-6b9cddf88575] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:22.447328 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=8 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:03:22.451192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5abbc4bf-bd46-4d30-b0d8-4ccdeb63dca1 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:22.452998 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5abbc4bf-bd46-4d30-b0d8-4ccdeb63dca1 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:22.454384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5abbc4bf-bd46-4d30-b0d8-4ccdeb63dca1 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:22.460848 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5abbc4bf-bd46-4d30-b0d8-4ccdeb63dca1 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:22.463307 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5abbc4bf-bd46-4d30-b0d8-4ccdeb63dca1 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:22.465601 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5abbc4bf-bd46-4d30-b0d8-4ccdeb63dca1 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:22.473666 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:03:22.483485 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4121fbb7-2a58-4833-9fc1-8d887e69e8ad tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:22.484941 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4121fbb7-2a58-4833-9fc1-8d887e69e8ad tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 40178212-5f30-4d39-80a4-b92306531580] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:22.494721 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4121fbb7-2a58-4833-9fc1-8d887e69e8ad tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:22.503860 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4121fbb7-2a58-4833-9fc1-8d887e69e8ad tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:22.509419 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4121fbb7-2a58-4833-9fc1-8d887e69e8ad tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:22.510686 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4121fbb7-2a58-4833-9fc1-8d887e69e8ad tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:22.512673 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4121fbb7-2a58-4833-9fc1-8d887e69e8ad tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:22.513671 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4121fbb7-2a58-4833-9fc1-8d887e69e8ad tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:22.680509 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:03:22.872118 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5abbc4bf-bd46-4d30-b0d8-4ccdeb63dca1 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8199c7aba04a9fb1212a2c7e1a52b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad3759161984bb896e1423af9a91d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:22.897582 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4121fbb7-2a58-4833-9fc1-8d887e69e8ad tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:22.909017 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5abbc4bf-bd46-4d30-b0d8-4ccdeb63dca1 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] 10.222.0.52 "GET /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575" status: 200 len: 1315 microversion: 2.1 time: 0.480565 Sep 24 21:03:22.912687 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4121fbb7-2a58-4833-9fc1-8d887e69e8ad tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580" status: 200 len: 1315 microversion: 2.1 time: 0.433458 Sep 24 21:03:22.913365 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1802/3673] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:22 2022] GET /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580 => generated 1315 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:22.936565 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1872/3674] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:22 2022] GET /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575 => generated 1315 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:22.946846 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8293c692-19b8-4c8a-80ee-9873ff501961 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:22.951397 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8293c692-19b8-4c8a-80ee-9873ff501961 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:22.960364 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8293c692-19b8-4c8a-80ee-9873ff501961 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:22.961804 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8293c692-19b8-4c8a-80ee-9873ff501961 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:22.963052 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8293c692-19b8-4c8a-80ee-9873ff501961 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:22.964192 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8293c692-19b8-4c8a-80ee-9873ff501961 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:22.965017 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8293c692-19b8-4c8a-80ee-9873ff501961 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:22.965668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8293c692-19b8-4c8a-80ee-9873ff501961 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:23.055295 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8293c692-19b8-4c8a-80ee-9873ff501961 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.140503 Sep 24 21:03:23.067134 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1803/3675] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:03:22 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:03:23.558775 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0a3ce8b9-4288-453c-902e-4fd5d1c52840 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1547527152", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "86ee1dec-a957-4cc1-98d2-2e275615c01a"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:23.667868 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-0a3ce8b9-4288-453c-902e-4fd5d1c52840 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] validate_networks() for [('86ee1dec-a957-4cc1-98d2-2e275615c01a', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:03:23.945247 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-012fac69-c114-4297-ad80-3b12d9057886 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:23.945934 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-012fac69-c114-4297-ad80-3b12d9057886 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 40178212-5f30-4d39-80a4-b92306531580] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:23.965864 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=8 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:03:23.974141 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-012fac69-c114-4297-ad80-3b12d9057886 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:23.977407 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-012fac69-c114-4297-ad80-3b12d9057886 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:23.979407 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-012fac69-c114-4297-ad80-3b12d9057886 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:23.983687 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-012fac69-c114-4297-ad80-3b12d9057886 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:23.987211 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-012fac69-c114-4297-ad80-3b12d9057886 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:23.989530 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-012fac69-c114-4297-ad80-3b12d9057886 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:24.483545 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-012fac69-c114-4297-ad80-3b12d9057886 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:24.505570 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-012fac69-c114-4297-ad80-3b12d9057886 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580" status: 200 len: 1315 microversion: 2.1 time: 0.566434 Sep 24 21:03:24.520835 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1804/3676] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:23 2022] GET /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580 => generated 1315 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:24.542012 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2a03337a-7941-4fc3-a3f1-4953eb547dd1 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:24.542720 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2a03337a-7941-4fc3-a3f1-4953eb547dd1 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] [instance: 5be295c0-e7fa-454b-bbba-6b9cddf88575] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:24.579871 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a03337a-7941-4fc3-a3f1-4953eb547dd1 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:24.583066 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a03337a-7941-4fc3-a3f1-4953eb547dd1 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:24.585088 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a03337a-7941-4fc3-a3f1-4953eb547dd1 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:24.588337 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a03337a-7941-4fc3-a3f1-4953eb547dd1 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:24.595598 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a03337a-7941-4fc3-a3f1-4953eb547dd1 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:24.598998 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a03337a-7941-4fc3-a3f1-4953eb547dd1 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:24.775495 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-0a3ce8b9-4288-453c-902e-4fd5d1c52840 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:03:24.776081 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-0a3ce8b9-4288-453c-902e-4fd5d1c52840 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:03:24.776395 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-0a3ce8b9-4288-453c-902e-4fd5d1c52840 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:03:24.776812 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-0a3ce8b9-4288-453c-902e-4fd5d1c52840 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:03:24.777234 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-0a3ce8b9-4288-453c-902e-4fd5d1c52840 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:03:24.788123 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0a3ce8b9-4288-453c-902e-4fd5d1c52840 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:24.788920 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0a3ce8b9-4288-453c-902e-4fd5d1c52840 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:24.789609 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0a3ce8b9-4288-453c-902e-4fd5d1c52840 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:24.790661 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0a3ce8b9-4288-453c-902e-4fd5d1c52840 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:24.791400 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0a3ce8b9-4288-453c-902e-4fd5d1c52840 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:24.792767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0a3ce8b9-4288-453c-902e-4fd5d1c52840 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:24.813516 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-0a3ce8b9-4288-453c-902e-4fd5d1c52840 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Getting quotas for project accafa2724354ca8b1c9f19940989429. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:03:24.820556 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-0a3ce8b9-4288-453c-902e-4fd5d1c52840 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Getting quotas for user e557d91b49c143499d809a55e85932fd and project accafa2724354ca8b1c9f19940989429. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:03:24.838724 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0a3ce8b9-4288-453c-902e-4fd5d1c52840 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:03:24.842325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0a3ce8b9-4288-453c-902e-4fd5d1c52840 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 17aa6306-aefd-4e46-b6b7-808b5b7224fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:03:24.911477 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0a3ce8b9-4288-453c-902e-4fd5d1c52840 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.973163 Sep 24 21:03:24.912606 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1873/3677] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:03:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:03:24.922522 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3771dcc4-e1f6-4962-9b76-f775a7aa7584 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:24.926767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3771dcc4-e1f6-4962-9b76-f775a7aa7584 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:24.940433 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3771dcc4-e1f6-4962-9b76-f775a7aa7584 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:24.941279 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3771dcc4-e1f6-4962-9b76-f775a7aa7584 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:24.941991 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3771dcc4-e1f6-4962-9b76-f775a7aa7584 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:24.943169 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3771dcc4-e1f6-4962-9b76-f775a7aa7584 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:24.943885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3771dcc4-e1f6-4962-9b76-f775a7aa7584 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:24.944726 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3771dcc4-e1f6-4962-9b76-f775a7aa7584 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:25.036768 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3771dcc4-e1f6-4962-9b76-f775a7aa7584 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.118915 Sep 24 21:03:25.039198 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1874/3678] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:03:24 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:03:25.049462 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-87a86ef6-744d-4f6f-b4f1-98d5b6416b63 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:25.054788 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-87a86ef6-744d-4f6f-b4f1-98d5b6416b63 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 17aa6306-aefd-4e46-b6b7-808b5b7224fb] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:25.217687 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2a03337a-7941-4fc3-a3f1-4953eb547dd1 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8199c7aba04a9fb1212a2c7e1a52b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad3759161984bb896e1423af9a91d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:25.230894 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2a03337a-7941-4fc3-a3f1-4953eb547dd1 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] 10.222.0.52 "GET /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575" status: 200 len: 1315 microversion: 2.1 time: 0.706413 Sep 24 21:03:25.234196 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1805/3679] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:24 2022] GET /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575 => generated 1315 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:25.324250 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-87a86ef6-744d-4f6f-b4f1-98d5b6416b63 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:25.334740 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-87a86ef6-744d-4f6f-b4f1-98d5b6416b63 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/17aa6306-aefd-4e46-b6b7-808b5b7224fb" status: 200 len: 1193 microversion: 2.1 time: 0.293129 Sep 24 21:03:25.337538 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1875/3680] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:25 2022] GET /compute/v2.1/servers/17aa6306-aefd-4e46-b6b7-808b5b7224fb => generated 1193 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:25.531683 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-25d4a34f-cf77-45be-99b2-0ddd895c077b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:25.532623 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-25d4a34f-cf77-45be-99b2-0ddd895c077b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 40178212-5f30-4d39-80a4-b92306531580] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:25.543749 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-25d4a34f-cf77-45be-99b2-0ddd895c077b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:25.545357 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-25d4a34f-cf77-45be-99b2-0ddd895c077b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:25.545897 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-25d4a34f-cf77-45be-99b2-0ddd895c077b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:25.547067 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-25d4a34f-cf77-45be-99b2-0ddd895c077b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:25.548544 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-25d4a34f-cf77-45be-99b2-0ddd895c077b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:25.549456 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-25d4a34f-cf77-45be-99b2-0ddd895c077b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:26.000620 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-25d4a34f-cf77-45be-99b2-0ddd895c077b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:26.016595 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-25d4a34f-cf77-45be-99b2-0ddd895c077b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580" status: 200 len: 1315 microversion: 2.1 time: 0.490381 Sep 24 21:03:26.032705 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1806/3681] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:25 2022] GET /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580 => generated 1315 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:26.052037 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bc7ab450-a814-478b-af33-f991a388b8b5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:26.058412 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-bc7ab450-a814-478b-af33-f991a388b8b5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:26.107255 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bc7ab450-a814-478b-af33-f991a388b8b5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:26.110574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bc7ab450-a814-478b-af33-f991a388b8b5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:26.111223 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bc7ab450-a814-478b-af33-f991a388b8b5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:26.117064 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bc7ab450-a814-478b-af33-f991a388b8b5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:26.118854 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bc7ab450-a814-478b-af33-f991a388b8b5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:26.122005 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bc7ab450-a814-478b-af33-f991a388b8b5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:26.258256 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9d1f6a26-9c8c-40fa-b043-5fdd446b9a89 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:26.259109 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9d1f6a26-9c8c-40fa-b043-5fdd446b9a89 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] [instance: 5be295c0-e7fa-454b-bbba-6b9cddf88575] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:26.267186 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d1f6a26-9c8c-40fa-b043-5fdd446b9a89 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:26.272116 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d1f6a26-9c8c-40fa-b043-5fdd446b9a89 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:26.276826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d1f6a26-9c8c-40fa-b043-5fdd446b9a89 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:26.277880 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d1f6a26-9c8c-40fa-b043-5fdd446b9a89 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:26.279074 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d1f6a26-9c8c-40fa-b043-5fdd446b9a89 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:26.280416 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9d1f6a26-9c8c-40fa-b043-5fdd446b9a89 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:26.320959 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bc7ab450-a814-478b-af33-f991a388b8b5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.272434 Sep 24 21:03:26.326586 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1876/3682] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:03:26 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:03:26.365781 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2be714af-99fb-46ab-bdb5-5f0816f7af12 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:26.366411 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2be714af-99fb-46ab-bdb5-5f0816f7af12 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 17aa6306-aefd-4e46-b6b7-808b5b7224fb] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:26.387106 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2be714af-99fb-46ab-bdb5-5f0816f7af12 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:26.387690 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2be714af-99fb-46ab-bdb5-5f0816f7af12 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:26.388052 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2be714af-99fb-46ab-bdb5-5f0816f7af12 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:26.388779 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2be714af-99fb-46ab-bdb5-5f0816f7af12 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:26.394443 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2be714af-99fb-46ab-bdb5-5f0816f7af12 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:26.395359 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2be714af-99fb-46ab-bdb5-5f0816f7af12 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:26.604527 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2be714af-99fb-46ab-bdb5-5f0816f7af12 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:26.620817 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2be714af-99fb-46ab-bdb5-5f0816f7af12 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/17aa6306-aefd-4e46-b6b7-808b5b7224fb" status: 200 len: 1245 microversion: 2.1 time: 0.257793 Sep 24 21:03:26.636418 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1877/3683] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:26 2022] GET /compute/v2.1/servers/17aa6306-aefd-4e46-b6b7-808b5b7224fb => generated 1245 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:03:26.694243 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9d1f6a26-9c8c-40fa-b043-5fdd446b9a89 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8199c7aba04a9fb1212a2c7e1a52b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad3759161984bb896e1423af9a91d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:26.705430 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9d1f6a26-9c8c-40fa-b043-5fdd446b9a89 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] 10.222.0.52 "GET /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575" status: 200 len: 1315 microversion: 2.1 time: 0.451563 Sep 24 21:03:26.710155 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1807/3684] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:26 2022] GET /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575 => generated 1315 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:26.847042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-813551c8-495e-46ea-80e8-893bc1895730 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-557335679", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:26.928524 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-813551c8-495e-46ea-80e8-893bc1895730 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] validate_networks() for [('756fa214-8579-4d66-b54e-d49c8ab2f2fe', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:03:27.420353 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c1899afd-0038-414d-bc1c-b70c3a45d679 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:27.421275 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c1899afd-0038-414d-bc1c-b70c3a45d679 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 40178212-5f30-4d39-80a4-b92306531580] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:27.451674 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1899afd-0038-414d-bc1c-b70c3a45d679 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:27.452181 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1899afd-0038-414d-bc1c-b70c3a45d679 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:27.452626 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1899afd-0038-414d-bc1c-b70c3a45d679 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:27.453349 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1899afd-0038-414d-bc1c-b70c3a45d679 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:27.453807 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1899afd-0038-414d-bc1c-b70c3a45d679 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:27.454224 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1899afd-0038-414d-bc1c-b70c3a45d679 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:27.479894 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:03:28.340600 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c1899afd-0038-414d-bc1c-b70c3a45d679 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:28.356554 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c1899afd-0038-414d-bc1c-b70c3a45d679 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580" status: 200 len: 1315 microversion: 2.1 time: 1.309952 Sep 24 21:03:28.357773 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1808/3685] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:27 2022] GET /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580 => generated 1315 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:28.372698 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1f60d3ce-5f74-4a0d-8f0a-86eebee5d202 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:28.381822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1f60d3ce-5f74-4a0d-8f0a-86eebee5d202 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cea166f15a894cd7b1cee6c5a749679c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3dbfe14ac3469286aa595d46c28f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:28.385404 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1f60d3ce-5f74-4a0d-8f0a-86eebee5d202 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Searching by: {'deleted': False, 'project_id': '5e3dbfe14ac3469286aa595d46c28f56'} {{(pid=140517) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 21:03:28.398280 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1f60d3ce-5f74-4a0d-8f0a-86eebee5d202 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:28.401358 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1f60d3ce-5f74-4a0d-8f0a-86eebee5d202 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:28.403098 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1f60d3ce-5f74-4a0d-8f0a-86eebee5d202 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:28.404621 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1f60d3ce-5f74-4a0d-8f0a-86eebee5d202 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:28.405390 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1f60d3ce-5f74-4a0d-8f0a-86eebee5d202 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:28.409561 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1f60d3ce-5f74-4a0d-8f0a-86eebee5d202 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:28.470800 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.multi_cell_list [None req-1f60d3ce-5f74-4a0d-8f0a-86eebee5d202 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 21:03:28.523820 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1f60d3ce-5f74-4a0d-8f0a-86eebee5d202 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.163367 Sep 24 21:03:28.525220 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1809/3686] 10.222.0.52 () {58 vars in 1125 bytes} [Sat Sep 24 21:03:28 2022] GET /compute/v2.1/servers => generated 339 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:03:28.530813 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a6c4cd1a-f880-405b-9edf-839d2c0d3d41 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:28.536753 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a6c4cd1a-f880-405b-9edf-839d2c0d3d41 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:28.556989 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a6c4cd1a-f880-405b-9edf-839d2c0d3d41 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:28.558173 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a6c4cd1a-f880-405b-9edf-839d2c0d3d41 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:28.559133 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a6c4cd1a-f880-405b-9edf-839d2c0d3d41 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:28.560262 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a6c4cd1a-f880-405b-9edf-839d2c0d3d41 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:28.561730 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a6c4cd1a-f880-405b-9edf-839d2c0d3d41 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:28.562396 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a6c4cd1a-f880-405b-9edf-839d2c0d3d41 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:28.636410 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a6c4cd1a-f880-405b-9edf-839d2c0d3d41 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.109667 Sep 24 21:03:28.644603 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1810/3687] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:03:28 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:03:28.651838 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1b4aeb35-48ff-457a-9d68-37289a863eed tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:28.652740 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1b4aeb35-48ff-457a-9d68-37289a863eed tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 17aa6306-aefd-4e46-b6b7-808b5b7224fb] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:28.661353 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1b4aeb35-48ff-457a-9d68-37289a863eed tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:28.662101 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1b4aeb35-48ff-457a-9d68-37289a863eed tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:28.662856 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1b4aeb35-48ff-457a-9d68-37289a863eed tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:28.664091 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1b4aeb35-48ff-457a-9d68-37289a863eed tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:28.664773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1b4aeb35-48ff-457a-9d68-37289a863eed tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:28.668354 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1b4aeb35-48ff-457a-9d68-37289a863eed tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:28.868537 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1b4aeb35-48ff-457a-9d68-37289a863eed tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:28.877161 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1b4aeb35-48ff-457a-9d68-37289a863eed tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/17aa6306-aefd-4e46-b6b7-808b5b7224fb" status: 200 len: 1251 microversion: 2.1 time: 0.230860 Sep 24 21:03:28.893790 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-813551c8-495e-46ea-80e8-893bc1895730 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:03:28.893790 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-813551c8-495e-46ea-80e8-893bc1895730 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:03:28.893790 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-813551c8-495e-46ea-80e8-893bc1895730 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:03:28.893790 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-813551c8-495e-46ea-80e8-893bc1895730 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:03:28.893790 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-813551c8-495e-46ea-80e8-893bc1895730 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:03:28.895088 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1811/3688] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:28 2022] GET /compute/v2.1/servers/17aa6306-aefd-4e46-b6b7-808b5b7224fb => generated 1251 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:28.901827 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-813551c8-495e-46ea-80e8-893bc1895730 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:28.902306 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-813551c8-495e-46ea-80e8-893bc1895730 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:28.903300 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-813551c8-495e-46ea-80e8-893bc1895730 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:28.904202 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-813551c8-495e-46ea-80e8-893bc1895730 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:28.904754 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-813551c8-495e-46ea-80e8-893bc1895730 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:28.906124 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-813551c8-495e-46ea-80e8-893bc1895730 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:28.957989 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5ef7b638-a428-464b-82a5-f40f471551da tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Action: 'create', calling method: .version_select at 0x7f4b11081d30>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1224096347", "policies": ["affinity"]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:28.964986 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-813551c8-495e-46ea-80e8-893bc1895730 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Getting quotas for project 3a9bed43edcf4c5594ffde33282bc48c. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:03:28.983074 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-5ef7b638-a428-464b-82a5-f40f471551da tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Getting quotas for project e6d75184d9cd4fed89c0e1d0d5d910fd. Resources: {'server_groups'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:03:28.989528 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-5ef7b638-a428-464b-82a5-f40f471551da tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Getting quotas for user 7654d225081948cabad9d2cdbf03ebda and project e6d75184d9cd4fed89c0e1d0d5d910fd. Resources: {'server_groups'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:03:28.997272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-813551c8-495e-46ea-80e8-893bc1895730 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Getting quotas for user 5cb9430023d842b4a5d930e01f7340f3 and project 3a9bed43edcf4c5594ffde33282bc48c. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:03:29.027959 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:03:29.030058 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-813551c8-495e-46ea-80e8-893bc1895730 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:03:29.032819 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-813551c8-495e-46ea-80e8-893bc1895730 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: acc02ed3-5cf0-4fe4-b4d7-ac40fe691355] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:03:29.064004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-5ef7b638-a428-464b-82a5-f40f471551da tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Getting quotas for project e6d75184d9cd4fed89c0e1d0d5d910fd. Resources: {'server_groups'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:03:29.073740 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-5ef7b638-a428-464b-82a5-f40f471551da tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Getting quotas for user 7654d225081948cabad9d2cdbf03ebda and project e6d75184d9cd4fed89c0e1d0d5d910fd. Resources: {'server_groups'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:03:29.089925 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:03:29.092945 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5ef7b638-a428-464b-82a5-f40f471551da tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.195845 Sep 24 21:03:29.099770 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1812/3689] 10.222.0.52 () {60 vars in 1174 bytes} [Sat Sep 24 21:03:28 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:03:29.105757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6b8d220d-baef-4bbd-a97a-3620ef920a1f tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:29.106523 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6b8d220d-baef-4bbd-a97a-3620ef920a1f tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] [instance: 5be295c0-e7fa-454b-bbba-6b9cddf88575] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:29.121212 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-813551c8-495e-46ea-80e8-893bc1895730 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.480848 Sep 24 21:03:29.123747 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1878/3690] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:03:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 2486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:03:29.129854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b8d220d-baef-4bbd-a97a-3620ef920a1f tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:29.130871 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5c95dc94-11c9-4966-adab-ad0cf408947d tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:29.131042 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b8d220d-baef-4bbd-a97a-3620ef920a1f tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:29.135468 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b8d220d-baef-4bbd-a97a-3620ef920a1f tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:29.136822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b8d220d-baef-4bbd-a97a-3620ef920a1f tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:29.136822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b8d220d-baef-4bbd-a97a-3620ef920a1f tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:29.138335 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b8d220d-baef-4bbd-a97a-3620ef920a1f tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:29.140735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5c95dc94-11c9-4966-adab-ad0cf408947d tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cea166f15a894cd7b1cee6c5a749679c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3dbfe14ac3469286aa595d46c28f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:29.141746 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5c95dc94-11c9-4966-adab-ad0cf408947d tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Searching by: {'deleted': False, 'project_id': '5e3dbfe14ac3469286aa595d46c28f56'} {{(pid=140516) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 21:03:29.155660 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c95dc94-11c9-4966-adab-ad0cf408947d tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:29.156524 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c95dc94-11c9-4966-adab-ad0cf408947d tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:29.157190 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c95dc94-11c9-4966-adab-ad0cf408947d tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:29.159209 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c95dc94-11c9-4966-adab-ad0cf408947d tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:29.160799 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c95dc94-11c9-4966-adab-ad0cf408947d tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:29.162103 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c95dc94-11c9-4966-adab-ad0cf408947d tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:29.200399 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.multi_cell_list [None req-5c95dc94-11c9-4966-adab-ad0cf408947d tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 21:03:29.245704 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5c95dc94-11c9-4966-adab-ad0cf408947d tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea166f15a894cd7b1cee6c5a749679c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3dbfe14ac3469286aa595d46c28f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:29.255350 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c95dc94-11c9-4966-adab-ad0cf408947d tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:29.256842 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c95dc94-11c9-4966-adab-ad0cf408947d tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:29.257487 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c95dc94-11c9-4966-adab-ad0cf408947d tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:29.588147 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6b8d220d-baef-4bbd-a97a-3620ef920a1f tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8199c7aba04a9fb1212a2c7e1a52b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad3759161984bb896e1423af9a91d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:29.596630 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6b8d220d-baef-4bbd-a97a-3620ef920a1f tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] 10.222.0.52 "GET /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575" status: 200 len: 1315 microversion: 2.1 time: 0.495443 Sep 24 21:03:29.614528 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5c95dc94-11c9-4966-adab-ad0cf408947d tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] 10.222.0.52 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 0.477083 Sep 24 21:03:29.614741 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1813/3691] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:29 2022] GET /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575 => generated 1315 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:29.614881 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1879/3692] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 21:03:29 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:29.620630 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-819fd1e2-1496-4788-9c79-6ea1dc383bfe tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:29.622860 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-819fd1e2-1496-4788-9c79-6ea1dc383bfe tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: acc02ed3-5cf0-4fe4-b4d7-ac40fe691355] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:29.633335 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7364834c-e44d-4c39-9e01-3d117721a803 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Action: 'create', calling method: .version_select at 0x7f4b07cf4dc0>, body: {"server_group": {"name": "tempest-server-group-567330107", "policies": ["affinity"]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:29.677184 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-7364834c-e44d-4c39-9e01-3d117721a803 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Getting quotas for project e6d75184d9cd4fed89c0e1d0d5d910fd. Resources: {'server_groups'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:03:29.689373 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-7364834c-e44d-4c39-9e01-3d117721a803 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Getting quotas for user 7654d225081948cabad9d2cdbf03ebda and project e6d75184d9cd4fed89c0e1d0d5d910fd. Resources: {'server_groups'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:03:29.773071 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-7364834c-e44d-4c39-9e01-3d117721a803 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Getting quotas for project e6d75184d9cd4fed89c0e1d0d5d910fd. Resources: {'server_groups'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:03:29.791489 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-7364834c-e44d-4c39-9e01-3d117721a803 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Getting quotas for user 7654d225081948cabad9d2cdbf03ebda and project e6d75184d9cd4fed89c0e1d0d5d910fd. Resources: {'server_groups'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:03:29.796125 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-819fd1e2-1496-4788-9c79-6ea1dc383bfe tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:29.813443 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-819fd1e2-1496-4788-9c79-6ea1dc383bfe tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/acc02ed3-5cf0-4fe4-b4d7-ac40fe691355" status: 200 len: 1221 microversion: 2.1 time: 0.200170 Sep 24 21:03:29.847247 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1880/3693] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:29 2022] GET /compute/v2.1/servers/acc02ed3-5cf0-4fe4-b4d7-ac40fe691355 => generated 1221 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:29.856945 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7364834c-e44d-4c39-9e01-3d117721a803 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.249074 Sep 24 21:03:29.862481 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1814/3694] 10.222.0.52 () {60 vars in 1173 bytes} [Sat Sep 24 21:03:29 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:03:29.869707 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5404ae30-ba2a-45ab-a8d7-8a281b3d764d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:29.873912 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dd6e6128-0da4-4896-9e4c-3079de5832a1 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:29.893875 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5404ae30-ba2a-45ab-a8d7-8a281b3d764d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 40178212-5f30-4d39-80a4-b92306531580] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:29.943306 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5404ae30-ba2a-45ab-a8d7-8a281b3d764d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:29.946734 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5404ae30-ba2a-45ab-a8d7-8a281b3d764d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:29.947227 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5404ae30-ba2a-45ab-a8d7-8a281b3d764d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:29.953777 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5404ae30-ba2a-45ab-a8d7-8a281b3d764d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:29.955026 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dd6e6128-0da4-4896-9e4c-3079de5832a1 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.089154 Sep 24 21:03:29.955192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5404ae30-ba2a-45ab-a8d7-8a281b3d764d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:29.957158 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1815/3695] 10.222.0.52 () {58 vars in 1137 bytes} [Sat Sep 24 21:03:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:03:29.978060 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5404ae30-ba2a-45ab-a8d7-8a281b3d764d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:29.987132 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9ed7802f-86d6-4233-ad6a-fb2820985e56 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:29.992397 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9ed7802f-86d6-4233-ad6a-fb2820985e56 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:30.005912 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ed7802f-86d6-4233-ad6a-fb2820985e56 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:30.007057 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ed7802f-86d6-4233-ad6a-fb2820985e56 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:30.008390 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ed7802f-86d6-4233-ad6a-fb2820985e56 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:30.010364 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ed7802f-86d6-4233-ad6a-fb2820985e56 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:30.010966 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ed7802f-86d6-4233-ad6a-fb2820985e56 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:30.011507 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ed7802f-86d6-4233-ad6a-fb2820985e56 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:30.131477 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9ed7802f-86d6-4233-ad6a-fb2820985e56 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.165210 Sep 24 21:03:30.135338 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1816/3696] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:03:29 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:03:30.148742 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-6265b2a2-2644-40eb-9aab-5bb21b17c06e req-0a722ad1-cbd2-4ca3-bb13-e4703f767be2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5be295c0-e7fa-454b-bbba-6b9cddf88575", "name": "network-vif-plugged", "status": "completed", "tag": "21d51de6-e5a8-4196-807a-c4b41d677479"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:30.178393 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6265b2a2-2644-40eb-9aab-5bb21b17c06e req-0a722ad1-cbd2-4ca3-bb13-e4703f767be2 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:30.179157 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6265b2a2-2644-40eb-9aab-5bb21b17c06e req-0a722ad1-cbd2-4ca3-bb13-e4703f767be2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:30.192060 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6265b2a2-2644-40eb-9aab-5bb21b17c06e req-0a722ad1-cbd2-4ca3-bb13-e4703f767be2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:30.219896 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-6265b2a2-2644-40eb-9aab-5bb21b17c06e req-0a722ad1-cbd2-4ca3-bb13-e4703f767be2 service nova] Creating event network-vif-plugged:21d51de6-e5a8-4196-807a-c4b41d677479 for instance 5be295c0-e7fa-454b-bbba-6b9cddf88575 on nch1-master-1 Sep 24 21:03:30.226225 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-6265b2a2-2644-40eb-9aab-5bb21b17c06e req-0a722ad1-cbd2-4ca3-bb13-e4703f767be2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089066 Sep 24 21:03:30.227697 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1817/3697] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:03:30.234351 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-35f27b38-0654-41db-b65d-83e7edc39032 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Action: 'create', calling method: .version_select at 0x7f4b07ca8ee0>, body: {"server_group": {"name": "tempest-server-group-567330107", "policies": ["affinity"]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:30.305968 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-35f27b38-0654-41db-b65d-83e7edc39032 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Getting quotas for project e6d75184d9cd4fed89c0e1d0d5d910fd. Resources: {'server_groups'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:03:30.329693 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-35f27b38-0654-41db-b65d-83e7edc39032 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Getting quotas for user 7654d225081948cabad9d2cdbf03ebda and project e6d75184d9cd4fed89c0e1d0d5d910fd. Resources: {'server_groups'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:03:30.432642 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-35f27b38-0654-41db-b65d-83e7edc39032 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Getting quotas for project e6d75184d9cd4fed89c0e1d0d5d910fd. Resources: {'server_groups'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:03:30.445881 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-35f27b38-0654-41db-b65d-83e7edc39032 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Getting quotas for user 7654d225081948cabad9d2cdbf03ebda and project e6d75184d9cd4fed89c0e1d0d5d910fd. Resources: {'server_groups'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:03:30.462660 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-35f27b38-0654-41db-b65d-83e7edc39032 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.232557 Sep 24 21:03:30.463791 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1818/3698] 10.222.0.52 () {60 vars in 1173 bytes} [Sat Sep 24 21:03:30 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:03:30.468732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ed4242ad-77bd-499c-b56a-d3468985a9a8 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:30.470132 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ed4242ad-77bd-499c-b56a-d3468985a9a8 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 17aa6306-aefd-4e46-b6b7-808b5b7224fb] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:30.480895 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed4242ad-77bd-499c-b56a-d3468985a9a8 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:30.481606 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed4242ad-77bd-499c-b56a-d3468985a9a8 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:30.482524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed4242ad-77bd-499c-b56a-d3468985a9a8 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:30.483089 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed4242ad-77bd-499c-b56a-d3468985a9a8 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:30.483661 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed4242ad-77bd-499c-b56a-d3468985a9a8 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:30.484099 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed4242ad-77bd-499c-b56a-d3468985a9a8 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:30.709371 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5404ae30-ba2a-45ab-a8d7-8a281b3d764d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:30.723301 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5404ae30-ba2a-45ab-a8d7-8a281b3d764d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580" status: 200 len: 1315 microversion: 2.1 time: 0.872477 Sep 24 21:03:30.736116 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1881/3699] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:29 2022] GET /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580 => generated 1315 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:30.747640 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-aa7c6e5f-a0f9-4bb1-a260-20cc20334da4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-862471137", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:30.854952 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-aa7c6e5f-a0f9-4bb1-a260-20cc20334da4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] validate_networks() for [('756fa214-8579-4d66-b54e-d49c8ab2f2fe', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:03:31.366887 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ed4242ad-77bd-499c-b56a-d3468985a9a8 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:31.376502 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ed4242ad-77bd-499c-b56a-d3468985a9a8 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/17aa6306-aefd-4e46-b6b7-808b5b7224fb" status: 200 len: 1293 microversion: 2.1 time: 0.911344 Sep 24 21:03:31.390919 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1819/3700] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:30 2022] GET /compute/v2.1/servers/17aa6306-aefd-4e46-b6b7-808b5b7224fb => generated 1293 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:31.390919 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-edd2000a-9d1b-45a9-930c-a65ff768df5c tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:31.390919 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-edd2000a-9d1b-45a9-930c-a65ff768df5c tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] [instance: 0ab5c42f-da92-43e0-a5f0-c277854edc31] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:31.396997 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-edd2000a-9d1b-45a9-930c-a65ff768df5c tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:31.397627 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-edd2000a-9d1b-45a9-930c-a65ff768df5c tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:31.398168 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-edd2000a-9d1b-45a9-930c-a65ff768df5c tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:31.399042 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-edd2000a-9d1b-45a9-930c-a65ff768df5c tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:31.400653 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-edd2000a-9d1b-45a9-930c-a65ff768df5c tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:31.400932 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-edd2000a-9d1b-45a9-930c-a65ff768df5c tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:31.446915 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-edd2000a-9d1b-45a9-930c-a65ff768df5c tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] [instance: 0ab5c42f-da92-43e0-a5f0-c277854edc31] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:03:31.586928 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-edd2000a-9d1b-45a9-930c-a65ff768df5c tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0ab5c42f-da92-43e0-a5f0-c277854edc31" status: 204 len: 0 microversion: 2.1 time: 0.207386 Sep 24 21:03:31.588774 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1820/3701] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:03:31 2022] DELETE /compute/v2.1/servers/0ab5c42f-da92-43e0-a5f0-c277854edc31 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:03:31.600097 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-347b4f02-f9a3-4c9c-a477-f4dc2cc84bd2 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:31.665612 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-347b4f02-f9a3-4c9c-a477-f4dc2cc84bd2 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/ff3f9326-c8e4-47f9-a9b7-a4ba31a876cc" status: 204 len: 0 microversion: 2.1 time: 0.071168 Sep 24 21:03:31.666545 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1821/3702] 10.222.0.52 () {58 vars in 1266 bytes} [Sat Sep 24 21:03:31 2022] DELETE /compute/v2.1/os-server-groups/ff3f9326-c8e4-47f9-a9b7-a4ba31a876cc => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:03:31.677373 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5368978c-94fc-4bbe-97d9-64758a9d35d9 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:31.678380 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5368978c-94fc-4bbe-97d9-64758a9d35d9 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] [instance: 5be295c0-e7fa-454b-bbba-6b9cddf88575] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:31.688133 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5368978c-94fc-4bbe-97d9-64758a9d35d9 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:31.688735 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5368978c-94fc-4bbe-97d9-64758a9d35d9 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:31.689983 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5368978c-94fc-4bbe-97d9-64758a9d35d9 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:31.691357 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5368978c-94fc-4bbe-97d9-64758a9d35d9 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:31.693636 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5368978c-94fc-4bbe-97d9-64758a9d35d9 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:31.697412 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5368978c-94fc-4bbe-97d9-64758a9d35d9 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:32.132970 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5368978c-94fc-4bbe-97d9-64758a9d35d9 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8199c7aba04a9fb1212a2c7e1a52b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad3759161984bb896e1423af9a91d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:32.163824 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5368978c-94fc-4bbe-97d9-64758a9d35d9 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] 10.222.0.52 "GET /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575" status: 200 len: 1315 microversion: 2.1 time: 0.492610 Sep 24 21:03:32.166785 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1822/3703] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:31 2022] GET /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575 => generated 1315 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:32.195744 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1c6cfbab-a009-4582-ae14-607ab1dca5f2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:32.206578 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1c6cfbab-a009-4582-ae14-607ab1dca5f2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:32.231877 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1c6cfbab-a009-4582-ae14-607ab1dca5f2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:32.233605 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1c6cfbab-a009-4582-ae14-607ab1dca5f2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:32.234912 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1c6cfbab-a009-4582-ae14-607ab1dca5f2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:32.237294 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1c6cfbab-a009-4582-ae14-607ab1dca5f2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:32.237785 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1c6cfbab-a009-4582-ae14-607ab1dca5f2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:32.238249 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1c6cfbab-a009-4582-ae14-607ab1dca5f2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:32.317712 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1c6cfbab-a009-4582-ae14-607ab1dca5f2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.149559 Sep 24 21:03:32.318892 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1823/3704] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:03:32 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:03:32.341406 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-69bceb49-1108-4b69-a544-4c9f85761531 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:32.342191 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-69bceb49-1108-4b69-a544-4c9f85761531 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] [instance: 0ab5c42f-da92-43e0-a5f0-c277854edc31] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:32.354436 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69bceb49-1108-4b69-a544-4c9f85761531 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:32.354987 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69bceb49-1108-4b69-a544-4c9f85761531 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:32.355607 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69bceb49-1108-4b69-a544-4c9f85761531 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:32.356386 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69bceb49-1108-4b69-a544-4c9f85761531 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:32.356860 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69bceb49-1108-4b69-a544-4c9f85761531 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:32.358164 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69bceb49-1108-4b69-a544-4c9f85761531 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:32.411621 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-aa7c6e5f-a0f9-4bb1-a260-20cc20334da4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:03:32.412342 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-aa7c6e5f-a0f9-4bb1-a260-20cc20334da4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:03:32.412835 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-aa7c6e5f-a0f9-4bb1-a260-20cc20334da4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:03:32.413253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-aa7c6e5f-a0f9-4bb1-a260-20cc20334da4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:03:32.414166 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-aa7c6e5f-a0f9-4bb1-a260-20cc20334da4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:03:32.428687 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa7c6e5f-a0f9-4bb1-a260-20cc20334da4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:32.431411 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa7c6e5f-a0f9-4bb1-a260-20cc20334da4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:32.433309 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa7c6e5f-a0f9-4bb1-a260-20cc20334da4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:32.435576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa7c6e5f-a0f9-4bb1-a260-20cc20334da4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:32.436845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa7c6e5f-a0f9-4bb1-a260-20cc20334da4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:32.437881 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa7c6e5f-a0f9-4bb1-a260-20cc20334da4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:32.465019 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-aa7c6e5f-a0f9-4bb1-a260-20cc20334da4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Getting quotas for project 3a9bed43edcf4c5594ffde33282bc48c. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:03:32.471786 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-aa7c6e5f-a0f9-4bb1-a260-20cc20334da4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Getting quotas for user 5cb9430023d842b4a5d930e01f7340f3 and project 3a9bed43edcf4c5594ffde33282bc48c. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:03:32.503182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-aa7c6e5f-a0f9-4bb1-a260-20cc20334da4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:03:32.505635 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-aa7c6e5f-a0f9-4bb1-a260-20cc20334da4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:03:32.598151 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-aa7c6e5f-a0f9-4bb1-a260-20cc20334da4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.860738 Sep 24 21:03:32.605075 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1882/3705] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:03:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 1862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:03:32.613011 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-54f33cf0-b0e0-4666-acd8-c56357087a74 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:32.614408 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-69bceb49-1108-4b69-a544-4c9f85761531 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea166f15a894cd7b1cee6c5a749679c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3dbfe14ac3469286aa595d46c28f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:32.629440 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-69bceb49-1108-4b69-a544-4c9f85761531 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] 10.222.0.52 "GET /compute/v2.1/servers/0ab5c42f-da92-43e0-a5f0-c277854edc31" status: 200 len: 1715 microversion: 2.1 time: 0.309456 Sep 24 21:03:32.654064 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1824/3706] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:32 2022] GET /compute/v2.1/servers/0ab5c42f-da92-43e0-a5f0-c277854edc31 => generated 1715 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:32.659509 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-49f11ee8-30c5-4d88-9f76-fad2424f29fa tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:32.660131 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-49f11ee8-30c5-4d88-9f76-fad2424f29fa tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 40178212-5f30-4d39-80a4-b92306531580] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:32.688216 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-54f33cf0-b0e0-4666-acd8-c56357087a74 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.082159 Sep 24 21:03:32.688948 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1883/3707] 10.222.0.52 () {58 vars in 1152 bytes} [Sat Sep 24 21:03:32 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:03:32.698109 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-49f11ee8-30c5-4d88-9f76-fad2424f29fa tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:32.698561 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-49f11ee8-30c5-4d88-9f76-fad2424f29fa tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:32.699009 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-49f11ee8-30c5-4d88-9f76-fad2424f29fa tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:32.699726 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-49f11ee8-30c5-4d88-9f76-fad2424f29fa tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:32.700186 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-49f11ee8-30c5-4d88-9f76-fad2424f29fa tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:32.700610 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-49f11ee8-30c5-4d88-9f76-fad2424f29fa tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:32.705190 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-7a13ce13-2b01-49e5-b84b-b4af6f4f6fd7 req-fedda3af-e34a-4dd5-b695-b50fa1ca61c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40178212-5f30-4d39-80a4-b92306531580", "name": "network-vif-plugged", "status": "completed", "tag": "820e2004-3830-4755-9111-459071db40de"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:32.729649 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-7a13ce13-2b01-49e5-b84b-b4af6f4f6fd7 req-fedda3af-e34a-4dd5-b695-b50fa1ca61c6 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:32.730150 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-7a13ce13-2b01-49e5-b84b-b4af6f4f6fd7 req-fedda3af-e34a-4dd5-b695-b50fa1ca61c6 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:32.730618 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-7a13ce13-2b01-49e5-b84b-b4af6f4f6fd7 req-fedda3af-e34a-4dd5-b695-b50fa1ca61c6 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:32.760284 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-7a13ce13-2b01-49e5-b84b-b4af6f4f6fd7 req-fedda3af-e34a-4dd5-b695-b50fa1ca61c6 service nova] Creating event network-vif-plugged:820e2004-3830-4755-9111-459071db40de for instance 40178212-5f30-4d39-80a4-b92306531580 on nch2-master-1 Sep 24 21:03:32.776915 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-7a13ce13-2b01-49e5-b84b-b4af6f4f6fd7 req-fedda3af-e34a-4dd5-b695-b50fa1ca61c6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083171 Sep 24 21:03:32.777543 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1884/3708] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:03:32.800994 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a9eae374-a4e2-4150-a87b-3cead7aae396 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:32.804468 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a9eae374-a4e2-4150-a87b-3cead7aae396 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 17aa6306-aefd-4e46-b6b7-808b5b7224fb] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:32.832078 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a9eae374-a4e2-4150-a87b-3cead7aae396 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:32.832604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a9eae374-a4e2-4150-a87b-3cead7aae396 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:32.833071 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a9eae374-a4e2-4150-a87b-3cead7aae396 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:32.838762 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a9eae374-a4e2-4150-a87b-3cead7aae396 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:32.839935 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a9eae374-a4e2-4150-a87b-3cead7aae396 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:32.840576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a9eae374-a4e2-4150-a87b-3cead7aae396 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:33.073827 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-49f11ee8-30c5-4d88-9f76-fad2424f29fa tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:33.090049 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-49f11ee8-30c5-4d88-9f76-fad2424f29fa tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580" status: 200 len: 1315 microversion: 2.1 time: 0.435084 Sep 24 21:03:33.093708 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1825/3709] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:32 2022] GET /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580 => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:33.102972 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f016d490-23ea-46b6-90b5-3eb522a9fc3d tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:33.106920 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f016d490-23ea-46b6-90b5-3eb522a9fc3d tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:33.245683 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f016d490-23ea-46b6-90b5-3eb522a9fc3d tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:33.256316 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f016d490-23ea-46b6-90b5-3eb522a9fc3d tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1221 microversion: 2.1 time: 0.159280 Sep 24 21:03:33.272730 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1826/3710] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:33 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1221 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:33.279110 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1b73e3bf-265d-41ed-a33f-0b1b7c8ffc80 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:33.303787 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=6 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:03:33.319367 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1b73e3bf-265d-41ed-a33f-0b1b7c8ffc80 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/b8cad649-4f62-411b-b145-986152705cf6" status: 204 len: 0 microversion: 2.1 time: 0.044581 Sep 24 21:03:33.323584 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1827/3711] 10.222.0.52 () {58 vars in 1266 bytes} [Sat Sep 24 21:03:33 2022] DELETE /compute/v2.1/os-server-groups/b8cad649-4f62-411b-b145-986152705cf6 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:03:33.332489 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-da01e92b-ac50-4e2a-a5a0-0f14a6fe3634 req-bf7f3f69-0743-4e84-8543-639dadc32b81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17aa6306-aefd-4e46-b6b7-808b5b7224fb", "tag": "7ba002c9-2db4-4ec4-a4d0-e4197dae31db"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:33.352790 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-da01e92b-ac50-4e2a-a5a0-0f14a6fe3634 req-bf7f3f69-0743-4e84-8543-639dadc32b81 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:33.353336 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-da01e92b-ac50-4e2a-a5a0-0f14a6fe3634 req-bf7f3f69-0743-4e84-8543-639dadc32b81 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:33.357134 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-da01e92b-ac50-4e2a-a5a0-0f14a6fe3634 req-bf7f3f69-0743-4e84-8543-639dadc32b81 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:33.384482 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-da01e92b-ac50-4e2a-a5a0-0f14a6fe3634 req-bf7f3f69-0743-4e84-8543-639dadc32b81 service nova] Creating event network-changed:7ba002c9-2db4-4ec4-a4d0-e4197dae31db for instance 17aa6306-aefd-4e46-b6b7-808b5b7224fb on nch1-master-1 Sep 24 21:03:33.391676 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-da01e92b-ac50-4e2a-a5a0-0f14a6fe3634 req-bf7f3f69-0743-4e84-8543-639dadc32b81 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070587 Sep 24 21:03:33.393193 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1828/3712] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:03:33.403373 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-94270cd8-f76f-4fd6-8497-b50a0a2c13b7 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:33.403652 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a9eae374-a4e2-4150-a87b-3cead7aae396 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:33.404617 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-94270cd8-f76f-4fd6-8497-b50a0a2c13b7 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] [instance: 5be295c0-e7fa-454b-bbba-6b9cddf88575] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:33.415728 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a9eae374-a4e2-4150-a87b-3cead7aae396 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/17aa6306-aefd-4e46-b6b7-808b5b7224fb" status: 200 len: 1293 microversion: 2.1 time: 0.628531 Sep 24 21:03:33.422355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-94270cd8-f76f-4fd6-8497-b50a0a2c13b7 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:33.423427 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-94270cd8-f76f-4fd6-8497-b50a0a2c13b7 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:33.434813 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-94270cd8-f76f-4fd6-8497-b50a0a2c13b7 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:33.434813 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-94270cd8-f76f-4fd6-8497-b50a0a2c13b7 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:33.434813 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-94270cd8-f76f-4fd6-8497-b50a0a2c13b7 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:33.434813 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-94270cd8-f76f-4fd6-8497-b50a0a2c13b7 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:33.435176 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1885/3713] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:32 2022] GET /compute/v2.1/servers/17aa6306-aefd-4e46-b6b7-808b5b7224fb => generated 1293 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:33.436054 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9ddd75f4-4a6e-4460-8f36-55a16aad2135 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:33.455378 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9ddd75f4-4a6e-4460-8f36-55a16aad2135 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.023197 Sep 24 21:03:33.455993 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1886/3714] 10.222.0.52 () {58 vars in 1152 bytes} [Sat Sep 24 21:03:33 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:03:33.467593 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5415078e-413f-4f0b-b7a5-7d7356eaee64 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:33.478658 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5415078e-413f-4f0b-b7a5-7d7356eaee64 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:33.487512 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5415078e-413f-4f0b-b7a5-7d7356eaee64 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:33.491216 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5415078e-413f-4f0b-b7a5-7d7356eaee64 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:33.492753 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5415078e-413f-4f0b-b7a5-7d7356eaee64 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:33.494268 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5415078e-413f-4f0b-b7a5-7d7356eaee64 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:33.496018 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5415078e-413f-4f0b-b7a5-7d7356eaee64 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:33.498653 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5415078e-413f-4f0b-b7a5-7d7356eaee64 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:33.565322 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5415078e-413f-4f0b-b7a5-7d7356eaee64 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.107635 Sep 24 21:03:33.566377 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1887/3715] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:03:33 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:03:33.572723 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-97738b66-f765-4a03-a6f1-c75c501d802e tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Action: 'create', calling method: .version_select at 0x7f4b0ca4ef70>, body: {"server_group": {"name": "tempest-server-group-2137588106", "policies": ["affinity"]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:33.603714 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-97738b66-f765-4a03-a6f1-c75c501d802e tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Getting quotas for project e6d75184d9cd4fed89c0e1d0d5d910fd. Resources: {'server_groups'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:03:33.612126 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-97738b66-f765-4a03-a6f1-c75c501d802e tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Getting quotas for user 7654d225081948cabad9d2cdbf03ebda and project e6d75184d9cd4fed89c0e1d0d5d910fd. Resources: {'server_groups'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:03:33.710140 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-97738b66-f765-4a03-a6f1-c75c501d802e tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Getting quotas for project e6d75184d9cd4fed89c0e1d0d5d910fd. Resources: {'server_groups'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:03:33.723219 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-97738b66-f765-4a03-a6f1-c75c501d802e tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Getting quotas for user 7654d225081948cabad9d2cdbf03ebda and project e6d75184d9cd4fed89c0e1d0d5d910fd. Resources: {'server_groups'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:03:33.748521 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-97738b66-f765-4a03-a6f1-c75c501d802e tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.180681 Sep 24 21:03:33.749358 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1888/3716] 10.222.0.52 () {60 vars in 1173 bytes} [Sat Sep 24 21:03:33 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:03:33.759143 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fc067c79-c4a7-48b3-ae34-23f810769e66 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:33.760242 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fc067c79-c4a7-48b3-ae34-23f810769e66 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] [instance: 0ab5c42f-da92-43e0-a5f0-c277854edc31] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:33.767182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fc067c79-c4a7-48b3-ae34-23f810769e66 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:33.767933 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fc067c79-c4a7-48b3-ae34-23f810769e66 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:33.768543 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fc067c79-c4a7-48b3-ae34-23f810769e66 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:33.769443 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fc067c79-c4a7-48b3-ae34-23f810769e66 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:33.770259 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fc067c79-c4a7-48b3-ae34-23f810769e66 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:33.770887 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fc067c79-c4a7-48b3-ae34-23f810769e66 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:33.857148 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-94270cd8-f76f-4fd6-8497-b50a0a2c13b7 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8199c7aba04a9fb1212a2c7e1a52b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad3759161984bb896e1423af9a91d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:33.875258 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-94270cd8-f76f-4fd6-8497-b50a0a2c13b7 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] 10.222.0.52 "GET /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575" status: 200 len: 1503 microversion: 2.1 time: 0.480167 Sep 24 21:03:33.879099 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1829/3717] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:33 2022] GET /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575 => generated 1503 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:33.892645 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-49e25d3b-1656-4458-a27f-df67b7cfd458 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:33.958905 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-49e25d3b-1656-4458-a27f-df67b7cfd458 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/3fc1e9af-3eb3-4389-b4bf-a9e6da5c98ef" status: 204 len: 0 microversion: 2.1 time: 0.077971 Sep 24 21:03:33.959907 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1830/3718] 10.222.0.52 () {58 vars in 1266 bytes} [Sat Sep 24 21:03:33 2022] DELETE /compute/v2.1/os-server-groups/3fc1e9af-3eb3-4389-b4bf-a9e6da5c98ef => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:03:33.967575 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-988f918e-8998-421d-aba5-3d8100eb2a23 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:33.968399 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-988f918e-8998-421d-aba5-3d8100eb2a23 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] [instance: 5be295c0-e7fa-454b-bbba-6b9cddf88575] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:33.994160 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-988f918e-8998-421d-aba5-3d8100eb2a23 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:33.995024 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-988f918e-8998-421d-aba5-3d8100eb2a23 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:33.995256 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-988f918e-8998-421d-aba5-3d8100eb2a23 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:33.998056 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-988f918e-8998-421d-aba5-3d8100eb2a23 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:33.998623 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-988f918e-8998-421d-aba5-3d8100eb2a23 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:33.999014 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-988f918e-8998-421d-aba5-3d8100eb2a23 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:34.050798 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-988f918e-8998-421d-aba5-3d8100eb2a23 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] [instance: 5be295c0-e7fa-454b-bbba-6b9cddf88575] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:03:34.074283 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:03:34.155656 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fc067c79-c4a7-48b3-ae34-23f810769e66 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea166f15a894cd7b1cee6c5a749679c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3dbfe14ac3469286aa595d46c28f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:34.166611 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fc067c79-c4a7-48b3-ae34-23f810769e66 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] 10.222.0.52 "GET /compute/v2.1/servers/0ab5c42f-da92-43e0-a5f0-c277854edc31" status: 200 len: 1715 microversion: 2.1 time: 0.415389 Sep 24 21:03:34.171750 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1889/3719] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:33 2022] GET /compute/v2.1/servers/0ab5c42f-da92-43e0-a5f0-c277854edc31 => generated 1715 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:34.181906 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b1c9f158-2e3c-4bae-ae6f-c89ff4d3bbee tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:34.203608 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b1c9f158-2e3c-4bae-ae6f-c89ff4d3bbee tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.030511 Sep 24 21:03:34.207574 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1890/3720] 10.222.0.52 () {58 vars in 1152 bytes} [Sat Sep 24 21:03:34 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:03:34.213801 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-988f918e-8998-421d-aba5-3d8100eb2a23 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575" status: 204 len: 0 microversion: 2.1 time: 0.252152 Sep 24 21:03:34.215172 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1831/3721] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:03:33 2022] DELETE /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:03:34.215705 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ef0c7b54-2397-4bcf-ac7e-6e9dbded8ae8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:34.216372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ef0c7b54-2397-4bcf-ac7e-6e9dbded8ae8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 40178212-5f30-4d39-80a4-b92306531580] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:34.222920 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef0c7b54-2397-4bcf-ac7e-6e9dbded8ae8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:34.223411 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b3ead8be-9f43-4969-860d-390c92124583 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Action: 'create', calling method: .version_select at 0x7f4b1100f8b0>, body: {"server_group": {"name": "tempest-server-group-1178862827", "policies": ["anti-affinity"]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:34.223897 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef0c7b54-2397-4bcf-ac7e-6e9dbded8ae8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:34.224534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef0c7b54-2397-4bcf-ac7e-6e9dbded8ae8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:34.225406 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef0c7b54-2397-4bcf-ac7e-6e9dbded8ae8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:34.226056 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef0c7b54-2397-4bcf-ac7e-6e9dbded8ae8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:34.226667 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef0c7b54-2397-4bcf-ac7e-6e9dbded8ae8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:34.249216 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-b3ead8be-9f43-4969-860d-390c92124583 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Getting quotas for project e6d75184d9cd4fed89c0e1d0d5d910fd. Resources: {'server_groups'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:03:34.296557 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-b3ead8be-9f43-4969-860d-390c92124583 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Getting quotas for user 7654d225081948cabad9d2cdbf03ebda and project e6d75184d9cd4fed89c0e1d0d5d910fd. Resources: {'server_groups'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:03:34.418649 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ef0c7b54-2397-4bcf-ac7e-6e9dbded8ae8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:34.420354 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-b3ead8be-9f43-4969-860d-390c92124583 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Getting quotas for project e6d75184d9cd4fed89c0e1d0d5d910fd. Resources: {'server_groups'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:03:34.427281 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-b3ead8be-9f43-4969-860d-390c92124583 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Getting quotas for user 7654d225081948cabad9d2cdbf03ebda and project e6d75184d9cd4fed89c0e1d0d5d910fd. Resources: {'server_groups'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:03:34.440153 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ef0c7b54-2397-4bcf-ac7e-6e9dbded8ae8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580" status: 200 len: 1315 microversion: 2.1 time: 0.228063 Sep 24 21:03:34.441295 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1891/3722] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:34 2022] GET /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:34.460685 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b3ead8be-9f43-4969-860d-390c92124583 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.242310 Sep 24 21:03:34.461552 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1832/3723] 10.222.0.52 () {60 vars in 1173 bytes} [Sat Sep 24 21:03:34 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:03:34.470804 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-12b36155-5d26-4de3-925a-dc6f009e7217 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:34.471032 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-15bb453f-70be-4247-bfa7-b64cea913e31 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:34.471803 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-12b36155-5d26-4de3-925a-dc6f009e7217 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:34.475174 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-15bb453f-70be-4247-bfa7-b64cea913e31 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] [instance: 5be295c0-e7fa-454b-bbba-6b9cddf88575] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:34.479736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12b36155-5d26-4de3-925a-dc6f009e7217 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:34.480243 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12b36155-5d26-4de3-925a-dc6f009e7217 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:34.480691 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12b36155-5d26-4de3-925a-dc6f009e7217 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:34.481992 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12b36155-5d26-4de3-925a-dc6f009e7217 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:34.483084 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12b36155-5d26-4de3-925a-dc6f009e7217 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:34.483613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12b36155-5d26-4de3-925a-dc6f009e7217 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:34.487470 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-15bb453f-70be-4247-bfa7-b64cea913e31 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:34.488215 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-15bb453f-70be-4247-bfa7-b64cea913e31 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:34.489426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-15bb453f-70be-4247-bfa7-b64cea913e31 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:34.490178 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-15bb453f-70be-4247-bfa7-b64cea913e31 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:34.490671 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-15bb453f-70be-4247-bfa7-b64cea913e31 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:34.491109 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-15bb453f-70be-4247-bfa7-b64cea913e31 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:34.569534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-12b36155-5d26-4de3-925a-dc6f009e7217 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:34.581117 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-12b36155-5d26-4de3-925a-dc6f009e7217 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1281 microversion: 2.1 time: 0.118464 Sep 24 21:03:34.583257 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1833/3724] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:34 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1281 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:34.589804 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-563c957d-2f31-4cc3-a50f-a0bc744230dd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:34.591079 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-563c957d-2f31-4cc3-a50f-a0bc744230dd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 17aa6306-aefd-4e46-b6b7-808b5b7224fb] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:34.599498 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-563c957d-2f31-4cc3-a50f-a0bc744230dd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:34.600495 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-563c957d-2f31-4cc3-a50f-a0bc744230dd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:34.603145 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-563c957d-2f31-4cc3-a50f-a0bc744230dd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:34.607258 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-563c957d-2f31-4cc3-a50f-a0bc744230dd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:34.608017 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-563c957d-2f31-4cc3-a50f-a0bc744230dd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:34.609785 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-563c957d-2f31-4cc3-a50f-a0bc744230dd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:34.782145 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-15bb453f-70be-4247-bfa7-b64cea913e31 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8199c7aba04a9fb1212a2c7e1a52b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad3759161984bb896e1423af9a91d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:34.794167 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-15bb453f-70be-4247-bfa7-b64cea913e31 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] 10.222.0.52 "GET /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575" status: 200 len: 1509 microversion: 2.1 time: 0.339957 Sep 24 21:03:34.796041 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1892/3725] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:34 2022] GET /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575 => generated 1509 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:34.810720 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-563c957d-2f31-4cc3-a50f-a0bc744230dd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:34.818655 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-041edcd2-3bfe-43ef-9676-8f2ccef93553 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:34.820706 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-563c957d-2f31-4cc3-a50f-a0bc744230dd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/17aa6306-aefd-4e46-b6b7-808b5b7224fb" status: 200 len: 1293 microversion: 2.1 time: 0.236037 Sep 24 21:03:34.828721 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1834/3726] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:34 2022] GET /compute/v2.1/servers/17aa6306-aefd-4e46-b6b7-808b5b7224fb => generated 1293 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:34.857841 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-802e2b5b-8fd0-4862-ac1a-7f85be863f27 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:34.861183 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-802e2b5b-8fd0-4862-ac1a-7f85be863f27 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:34.867673 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-802e2b5b-8fd0-4862-ac1a-7f85be863f27 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:34.868189 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-802e2b5b-8fd0-4862-ac1a-7f85be863f27 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:34.868875 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-802e2b5b-8fd0-4862-ac1a-7f85be863f27 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:34.870596 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-802e2b5b-8fd0-4862-ac1a-7f85be863f27 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:34.870752 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-802e2b5b-8fd0-4862-ac1a-7f85be863f27 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:34.871322 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-802e2b5b-8fd0-4862-ac1a-7f85be863f27 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:34.888127 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-041edcd2-3bfe-43ef-9676-8f2ccef93553 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/35d3bcbb-147b-4ff3-9af3-d932c8e0017d" status: 204 len: 0 microversion: 2.1 time: 0.078083 Sep 24 21:03:34.889437 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1893/3727] 10.222.0.52 () {58 vars in 1266 bytes} [Sat Sep 24 21:03:34 2022] DELETE /compute/v2.1/os-server-groups/35d3bcbb-147b-4ff3-9af3-d932c8e0017d => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:03:34.898628 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-28d7be47-f5ea-4b8e-ad87-d0bb9f63986b tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:34.915308 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-28d7be47-f5ea-4b8e-ad87-d0bb9f63986b tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.021107 Sep 24 21:03:34.916346 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1894/3728] 10.222.0.52 () {58 vars in 1152 bytes} [Sat Sep 24 21:03:34 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:03:34.941902 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-802e2b5b-8fd0-4862-ac1a-7f85be863f27 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.108299 Sep 24 21:03:34.942654 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1835/3729] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:03:34 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:03:34.984742 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2c5a049b-db3d-4fc5-bb81-574474815222 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-158044993", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "e936a719-1823-4341-9a4c-7e17af81ad8d"}]}, "os:scheduler_hints": {"group": "69c83283-fbf2-49d7-bc6e-8a37519f7786"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:35.052379 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-2c5a049b-db3d-4fc5-bb81-574474815222 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] validate_networks() for [('e936a719-1823-4341-9a4c-7e17af81ad8d', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:03:35.193304 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2a605ed5-bb3e-455c-bcbf-11f4b700bc41 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:35.194882 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2a605ed5-bb3e-455c-bcbf-11f4b700bc41 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] [instance: 0ab5c42f-da92-43e0-a5f0-c277854edc31] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:35.208675 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a605ed5-bb3e-455c-bcbf-11f4b700bc41 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:35.209670 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a605ed5-bb3e-455c-bcbf-11f4b700bc41 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:35.216734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a605ed5-bb3e-455c-bcbf-11f4b700bc41 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:35.217960 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a605ed5-bb3e-455c-bcbf-11f4b700bc41 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:35.218788 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a605ed5-bb3e-455c-bcbf-11f4b700bc41 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:35.219562 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a605ed5-bb3e-455c-bcbf-11f4b700bc41 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:35.330038 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2a605ed5-bb3e-455c-bcbf-11f4b700bc41 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea166f15a894cd7b1cee6c5a749679c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3dbfe14ac3469286aa595d46c28f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:35.344128 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2a605ed5-bb3e-455c-bcbf-11f4b700bc41 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] 10.222.0.52 "GET /compute/v2.1/servers/0ab5c42f-da92-43e0-a5f0-c277854edc31" status: 200 len: 1647 microversion: 2.1 time: 0.154634 Sep 24 21:03:35.344660 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1836/3730] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:35 2022] GET /compute/v2.1/servers/0ab5c42f-da92-43e0-a5f0-c277854edc31 => generated 1647 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:03:35.469052 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6fb15818-926c-498d-81b1-f398064dc973 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:35.469623 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6fb15818-926c-498d-81b1-f398064dc973 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 40178212-5f30-4d39-80a4-b92306531580] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:35.484919 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6fb15818-926c-498d-81b1-f398064dc973 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:35.485433 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6fb15818-926c-498d-81b1-f398064dc973 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:35.485883 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6fb15818-926c-498d-81b1-f398064dc973 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:35.490915 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6fb15818-926c-498d-81b1-f398064dc973 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:35.491778 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6fb15818-926c-498d-81b1-f398064dc973 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:35.492399 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6fb15818-926c-498d-81b1-f398064dc973 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:35.923590 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6fb15818-926c-498d-81b1-f398064dc973 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:35.937181 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6fb15818-926c-498d-81b1-f398064dc973 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580" status: 200 len: 1503 microversion: 2.1 time: 0.472265 Sep 24 21:03:35.937982 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1837/3731] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:35 2022] GET /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580 => generated 1503 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:35.943911 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6e82bf81-c847-451d-b9e0-23ea2acf60f3 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:35.944871 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6e82bf81-c847-451d-b9e0-23ea2acf60f3 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:35.960040 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6e82bf81-c847-451d-b9e0-23ea2acf60f3 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:35.967808 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6e82bf81-c847-451d-b9e0-23ea2acf60f3 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:35.968378 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6e82bf81-c847-451d-b9e0-23ea2acf60f3 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:35.969154 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6e82bf81-c847-451d-b9e0-23ea2acf60f3 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:35.971642 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6e82bf81-c847-451d-b9e0-23ea2acf60f3 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:35.972130 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6e82bf81-c847-451d-b9e0-23ea2acf60f3 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:36.023393 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-2c5a049b-db3d-4fc5-bb81-574474815222 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:03:36.023884 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-2c5a049b-db3d-4fc5-bb81-574474815222 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:03:36.024349 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-2c5a049b-db3d-4fc5-bb81-574474815222 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:03:36.025050 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-2c5a049b-db3d-4fc5-bb81-574474815222 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:03:36.025618 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-2c5a049b-db3d-4fc5-bb81-574474815222 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:03:36.045638 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c5a049b-db3d-4fc5-bb81-574474815222 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:36.046142 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c5a049b-db3d-4fc5-bb81-574474815222 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:36.046624 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c5a049b-db3d-4fc5-bb81-574474815222 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:36.047555 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c5a049b-db3d-4fc5-bb81-574474815222 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:36.048826 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c5a049b-db3d-4fc5-bb81-574474815222 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:36.049445 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c5a049b-db3d-4fc5-bb81-574474815222 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:36.072747 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-2c5a049b-db3d-4fc5-bb81-574474815222 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Getting quotas for project e6d75184d9cd4fed89c0e1d0d5d910fd. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:03:36.081130 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-2c5a049b-db3d-4fc5-bb81-574474815222 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Getting quotas for user 7654d225081948cabad9d2cdbf03ebda and project e6d75184d9cd4fed89c0e1d0d5d910fd. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:03:36.090579 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6e82bf81-c847-451d-b9e0-23ea2acf60f3 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:36.099009 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6e82bf81-c847-451d-b9e0-23ea2acf60f3 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1281 microversion: 2.1 time: 0.160049 Sep 24 21:03:36.110665 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1838/3732] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:35 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1281 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:36.110665 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f8add6d6-f1e8-4302-b24a-1947222f2468 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:36.110665 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f8add6d6-f1e8-4302-b24a-1947222f2468 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] [instance: 5be295c0-e7fa-454b-bbba-6b9cddf88575] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:36.111671 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=8,nova_api:DELETE=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:03:36.122534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2c5a049b-db3d-4fc5-bb81-574474815222 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:03:36.125361 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2c5a049b-db3d-4fc5-bb81-574474815222 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] [instance: b6106703-7709-41ea-a56c-935391c05827] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:03:36.126150 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8add6d6-f1e8-4302-b24a-1947222f2468 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:36.126685 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8add6d6-f1e8-4302-b24a-1947222f2468 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:36.127126 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8add6d6-f1e8-4302-b24a-1947222f2468 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:36.128528 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8add6d6-f1e8-4302-b24a-1947222f2468 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:36.128991 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8add6d6-f1e8-4302-b24a-1947222f2468 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:36.132293 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8add6d6-f1e8-4302-b24a-1947222f2468 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:36.201650 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-2c5a049b-db3d-4fc5-bb81-574474815222 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Getting quotas for project e6d75184d9cd4fed89c0e1d0d5d910fd. Resources: {'server_group_members'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:03:36.213523 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-2c5a049b-db3d-4fc5-bb81-574474815222 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Getting quotas for user 7654d225081948cabad9d2cdbf03ebda and project e6d75184d9cd4fed89c0e1d0d5d910fd. Resources: {'server_group_members'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:03:36.269668 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-2c5a049b-db3d-4fc5-bb81-574474815222 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Getting quotas for project e6d75184d9cd4fed89c0e1d0d5d910fd. Resources: {'server_group_members'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:03:36.279534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-2c5a049b-db3d-4fc5-bb81-574474815222 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Getting quotas for user 7654d225081948cabad9d2cdbf03ebda and project e6d75184d9cd4fed89c0e1d0d5d910fd. Resources: {'server_group_members'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:03:36.312478 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2c5a049b-db3d-4fc5-bb81-574474815222 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.332040 Sep 24 21:03:36.319044 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1895/3733] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:03:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:03:36.319044 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b95152d5-8151-425d-88a1-126332bd2d48 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:36.319044 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b95152d5-8151-425d-88a1-126332bd2d48 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 17aa6306-aefd-4e46-b6b7-808b5b7224fb] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:36.326180 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b95152d5-8151-425d-88a1-126332bd2d48 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:36.327033 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b95152d5-8151-425d-88a1-126332bd2d48 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:36.327698 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b95152d5-8151-425d-88a1-126332bd2d48 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:36.328840 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b95152d5-8151-425d-88a1-126332bd2d48 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:36.329526 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b95152d5-8151-425d-88a1-126332bd2d48 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:36.330178 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b95152d5-8151-425d-88a1-126332bd2d48 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:36.338144 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f8add6d6-f1e8-4302-b24a-1947222f2468 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8199c7aba04a9fb1212a2c7e1a52b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad3759161984bb896e1423af9a91d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:36.347369 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f8add6d6-f1e8-4302-b24a-1947222f2468 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] 10.222.0.52 "GET /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575" status: 200 len: 1509 microversion: 2.1 time: 0.245063 Sep 24 21:03:36.347797 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1839/3734] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:36 2022] GET /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575 => generated 1509 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:36.369963 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-bb839b2b-ba81-497f-9fc5-8a98107e7b65 req-d9768e97-24ad-4f47-a487-351f193cad75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acc02ed3-5cf0-4fe4-b4d7-ac40fe691355", "tag": "5c9ac72a-bbd8-424e-8720-bcc509cc437c"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:36.380247 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-bb839b2b-ba81-497f-9fc5-8a98107e7b65 req-d9768e97-24ad-4f47-a487-351f193cad75 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:36.380739 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-bb839b2b-ba81-497f-9fc5-8a98107e7b65 req-d9768e97-24ad-4f47-a487-351f193cad75 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:36.381202 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-bb839b2b-ba81-497f-9fc5-8a98107e7b65 req-d9768e97-24ad-4f47-a487-351f193cad75 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:36.415587 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-bb839b2b-ba81-497f-9fc5-8a98107e7b65 req-d9768e97-24ad-4f47-a487-351f193cad75 service nova] Creating event network-changed:5c9ac72a-bbd8-424e-8720-bcc509cc437c for instance acc02ed3-5cf0-4fe4-b4d7-ac40fe691355 on nch2-master-1 Sep 24 21:03:36.423104 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-bb839b2b-ba81-497f-9fc5-8a98107e7b65 req-d9768e97-24ad-4f47-a487-351f193cad75 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058583 Sep 24 21:03:36.429703 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1840/3735] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:03:36.441335 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3b07bb16-3162-4d9c-a101-e83055b15a6e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:36.443679 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3b07bb16-3162-4d9c-a101-e83055b15a6e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:36.479381 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3b07bb16-3162-4d9c-a101-e83055b15a6e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:36.481125 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3b07bb16-3162-4d9c-a101-e83055b15a6e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:36.483687 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3b07bb16-3162-4d9c-a101-e83055b15a6e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:36.486208 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3b07bb16-3162-4d9c-a101-e83055b15a6e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:36.489070 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3b07bb16-3162-4d9c-a101-e83055b15a6e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:36.489755 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3b07bb16-3162-4d9c-a101-e83055b15a6e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:36.567953 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3b07bb16-3162-4d9c-a101-e83055b15a6e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.132964 Sep 24 21:03:36.568898 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1841/3736] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:03:36 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:03:36.582893 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8e585a34-a121-4289-bf1b-4b8511415e8f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:36.585718 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8e585a34-a121-4289-bf1b-4b8511415e8f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 40178212-5f30-4d39-80a4-b92306531580] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:36.605013 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b95152d5-8151-425d-88a1-126332bd2d48 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:36.612697 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8e585a34-a121-4289-bf1b-4b8511415e8f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:36.613220 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8e585a34-a121-4289-bf1b-4b8511415e8f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:36.613675 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8e585a34-a121-4289-bf1b-4b8511415e8f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:36.616324 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b95152d5-8151-425d-88a1-126332bd2d48 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/17aa6306-aefd-4e46-b6b7-808b5b7224fb" status: 200 len: 1293 microversion: 2.1 time: 0.301704 Sep 24 21:03:36.617453 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1896/3737] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:36 2022] GET /compute/v2.1/servers/17aa6306-aefd-4e46-b6b7-808b5b7224fb => generated 1293 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:36.626746 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8e585a34-a121-4289-bf1b-4b8511415e8f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:36.627896 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8e585a34-a121-4289-bf1b-4b8511415e8f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:36.628621 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8e585a34-a121-4289-bf1b-4b8511415e8f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:36.633012 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bdcf4b55-2bc2-427c-bc14-3608deef5a7a tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:36.638466 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-bdcf4b55-2bc2-427c-bc14-3608deef5a7a tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] [instance: b6106703-7709-41ea-a56c-935391c05827] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:36.764426 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8e585a34-a121-4289-bf1b-4b8511415e8f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "POST /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580/action" status: 200 len: 14 microversion: 2.1 time: 0.194161 Sep 24 21:03:36.768175 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1842/3738] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:03:36 2022] POST /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580/action => generated 14 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 21:03:36.773392 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-bdcf4b55-2bc2-427c-bc14-3608deef5a7a tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7654d225081948cabad9d2cdbf03ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d75184d9cd4fed89c0e1d0d5d910fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:36.775572 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d3a5f04f-ea1a-4e39-8cb5-3f055b7b82cd tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:36.776676 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d3a5f04f-ea1a-4e39-8cb5-3f055b7b82cd tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] [instance: 0ab5c42f-da92-43e0-a5f0-c277854edc31] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:36.794979 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3a5f04f-ea1a-4e39-8cb5-3f055b7b82cd tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:36.795695 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3a5f04f-ea1a-4e39-8cb5-3f055b7b82cd tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:36.798074 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3a5f04f-ea1a-4e39-8cb5-3f055b7b82cd tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:36.799176 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3a5f04f-ea1a-4e39-8cb5-3f055b7b82cd tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:36.801581 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3a5f04f-ea1a-4e39-8cb5-3f055b7b82cd tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:36.803130 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3a5f04f-ea1a-4e39-8cb5-3f055b7b82cd tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:36.813098 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bdcf4b55-2bc2-427c-bc14-3608deef5a7a tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "GET /compute/v2.1/servers/b6106703-7709-41ea-a56c-935391c05827" status: 200 len: 1212 microversion: 2.1 time: 0.192280 Sep 24 21:03:36.826537 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1897/3739] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:36 2022] GET /compute/v2.1/servers/b6106703-7709-41ea-a56c-935391c05827 => generated 1212 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:36.882595 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3a5f04f-ea1a-4e39-8cb5-3f055b7b82cd tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:36.885148 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3a5f04f-ea1a-4e39-8cb5-3f055b7b82cd tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:36.887107 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3a5f04f-ea1a-4e39-8cb5-3f055b7b82cd tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:36.895458 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-d3a5f04f-ea1a-4e39-8cb5-3f055b7b82cd tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lazy-loading 'fault' on Instance uuid 0ab5c42f-da92-43e0-a5f0-c277854edc31 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:03:36.995837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d3a5f04f-ea1a-4e39-8cb5-3f055b7b82cd tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea166f15a894cd7b1cee6c5a749679c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3dbfe14ac3469286aa595d46c28f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:37.044853 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d3a5f04f-ea1a-4e39-8cb5-3f055b7b82cd tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] 10.222.0.52 "GET /compute/v2.1/servers/0ab5c42f-da92-43e0-a5f0-c277854edc31" status: 200 len: 1367 microversion: 2.1 time: 0.275194 Sep 24 21:03:37.065099 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1843/3740] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:36 2022] GET /compute/v2.1/servers/0ab5c42f-da92-43e0-a5f0-c277854edc31 => generated 1367 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:37.126479 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6500fbd4-6518-42b5-8fc7-eeec27c973ff tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:37.127178 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6500fbd4-6518-42b5-8fc7-eeec27c973ff tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:37.146164 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6500fbd4-6518-42b5-8fc7-eeec27c973ff tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:37.146933 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6500fbd4-6518-42b5-8fc7-eeec27c973ff tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:37.147621 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6500fbd4-6518-42b5-8fc7-eeec27c973ff tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:37.148356 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6500fbd4-6518-42b5-8fc7-eeec27c973ff tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:37.149025 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6500fbd4-6518-42b5-8fc7-eeec27c973ff tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:37.149721 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6500fbd4-6518-42b5-8fc7-eeec27c973ff tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:37.250701 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6500fbd4-6518-42b5-8fc7-eeec27c973ff tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:37.264938 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6500fbd4-6518-42b5-8fc7-eeec27c973ff tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1281 microversion: 2.1 time: 0.141360 Sep 24 21:03:37.265890 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1898/3741] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:37 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1281 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:37.374382 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-929c6309-7c55-46bd-8ef1-50535e6f6506 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:37.376713 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-929c6309-7c55-46bd-8ef1-50535e6f6506 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] [instance: 5be295c0-e7fa-454b-bbba-6b9cddf88575] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:37.419699 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-929c6309-7c55-46bd-8ef1-50535e6f6506 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:37.428188 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-929c6309-7c55-46bd-8ef1-50535e6f6506 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:37.433737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-929c6309-7c55-46bd-8ef1-50535e6f6506 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:37.437959 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-929c6309-7c55-46bd-8ef1-50535e6f6506 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:37.439255 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-929c6309-7c55-46bd-8ef1-50535e6f6506 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:37.442482 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-929c6309-7c55-46bd-8ef1-50535e6f6506 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:37.581980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f9c524e8-7469-4e75-957d-55fd827ff8c2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:37.584891 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f9c524e8-7469-4e75-957d-55fd827ff8c2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:37.594809 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9c524e8-7469-4e75-957d-55fd827ff8c2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:37.603339 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9c524e8-7469-4e75-957d-55fd827ff8c2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:37.606096 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9c524e8-7469-4e75-957d-55fd827ff8c2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:37.609176 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9c524e8-7469-4e75-957d-55fd827ff8c2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:37.610394 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9c524e8-7469-4e75-957d-55fd827ff8c2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:37.611053 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9c524e8-7469-4e75-957d-55fd827ff8c2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:37.710480 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f9c524e8-7469-4e75-957d-55fd827ff8c2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.132897 Sep 24 21:03:37.721161 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1899/3742] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:03:37 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 21:03:37.732395 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-920bd4ee-6556-45fc-888b-926e64747d36 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:37.733217 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-920bd4ee-6556-45fc-888b-926e64747d36 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 17aa6306-aefd-4e46-b6b7-808b5b7224fb] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:37.754349 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-920bd4ee-6556-45fc-888b-926e64747d36 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:37.755089 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-920bd4ee-6556-45fc-888b-926e64747d36 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:37.755597 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-920bd4ee-6556-45fc-888b-926e64747d36 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:37.759892 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-920bd4ee-6556-45fc-888b-926e64747d36 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:37.759892 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-920bd4ee-6556-45fc-888b-926e64747d36 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:37.761376 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-920bd4ee-6556-45fc-888b-926e64747d36 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:37.806944 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:03:38.125526 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-929c6309-7c55-46bd-8ef1-50535e6f6506 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8199c7aba04a9fb1212a2c7e1a52b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad3759161984bb896e1423af9a91d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:38.137074 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-929c6309-7c55-46bd-8ef1-50535e6f6506 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] 10.222.0.52 "GET /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575" status: 200 len: 1509 microversion: 2.1 time: 0.766606 Sep 24 21:03:38.151264 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1844/3743] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:37 2022] GET /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575 => generated 1509 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:38.160295 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-68fcc5db-1b69-4f47-bf50-2453c87cc82e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:38.163016 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-68fcc5db-1b69-4f47-bf50-2453c87cc82e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 40178212-5f30-4d39-80a4-b92306531580] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:38.171506 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68fcc5db-1b69-4f47-bf50-2453c87cc82e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:38.172228 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68fcc5db-1b69-4f47-bf50-2453c87cc82e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:38.172871 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68fcc5db-1b69-4f47-bf50-2453c87cc82e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:38.173812 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68fcc5db-1b69-4f47-bf50-2453c87cc82e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:38.174715 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68fcc5db-1b69-4f47-bf50-2453c87cc82e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:38.175352 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68fcc5db-1b69-4f47-bf50-2453c87cc82e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:38.265365 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-920bd4ee-6556-45fc-888b-926e64747d36 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:38.292339 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-920bd4ee-6556-45fc-888b-926e64747d36 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/17aa6306-aefd-4e46-b6b7-808b5b7224fb" status: 200 len: 1293 microversion: 2.1 time: 0.567657 Sep 24 21:03:38.293264 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1900/3744] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:37 2022] GET /compute/v2.1/servers/17aa6306-aefd-4e46-b6b7-808b5b7224fb => generated 1293 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:38.299016 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-86153ba3-98ab-4f69-be45-cdcc44d1c8be tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:38.299810 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-86153ba3-98ab-4f69-be45-cdcc44d1c8be tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] [instance: b6106703-7709-41ea-a56c-935391c05827] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:38.305963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86153ba3-98ab-4f69-be45-cdcc44d1c8be tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:38.306763 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86153ba3-98ab-4f69-be45-cdcc44d1c8be tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:38.307363 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86153ba3-98ab-4f69-be45-cdcc44d1c8be tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:38.308244 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86153ba3-98ab-4f69-be45-cdcc44d1c8be tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:38.308704 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86153ba3-98ab-4f69-be45-cdcc44d1c8be tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:38.309137 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86153ba3-98ab-4f69-be45-cdcc44d1c8be tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:38.405982 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-86153ba3-98ab-4f69-be45-cdcc44d1c8be tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7654d225081948cabad9d2cdbf03ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d75184d9cd4fed89c0e1d0d5d910fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:38.415337 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-86153ba3-98ab-4f69-be45-cdcc44d1c8be tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "GET /compute/v2.1/servers/b6106703-7709-41ea-a56c-935391c05827" status: 200 len: 1208 microversion: 2.1 time: 0.120858 Sep 24 21:03:38.416364 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1901/3745] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:38 2022] GET /compute/v2.1/servers/b6106703-7709-41ea-a56c-935391c05827 => generated 1208 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:38.435642 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-383b0079-44aa-4556-9492-deea87cb28c1 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:38.436291 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-383b0079-44aa-4556-9492-deea87cb28c1 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] [instance: 0ab5c42f-da92-43e0-a5f0-c277854edc31] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:38.438802 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:03:38.442924 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-383b0079-44aa-4556-9492-deea87cb28c1 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:38.444489 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-383b0079-44aa-4556-9492-deea87cb28c1 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:38.445156 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-383b0079-44aa-4556-9492-deea87cb28c1 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:38.446430 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-383b0079-44aa-4556-9492-deea87cb28c1 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:38.446937 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-383b0079-44aa-4556-9492-deea87cb28c1 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:38.447468 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-383b0079-44aa-4556-9492-deea87cb28c1 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:38.463605 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-383b0079-44aa-4556-9492-deea87cb28c1 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] HTTP exception thrown: Instance 0ab5c42f-da92-43e0-a5f0-c277854edc31 could not be found. Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-383b0079-44aa-4556-9492-deea87cb28c1 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Request method failure captured: Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/0ab5c42f-da92-43e0-a5f0-c277854edc31 HTTP/1.1 Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3BaemJVNEXGa0hxetM-U7x3mN4S0fO8qYbF7fUPwwlvzkPUcC4cAk4Z80kOEV_do7dHoM9bEtx2fAdH656fRacY5p51yBcSQAUBVBCnakN6_F65_xtnu_8YmPy2VRK-Mrm3UPkBpbVDIMpKuD7nlnNXOtIbtFt56CrdGFI_CYGbNnQ Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 5e3dbfe14ac3469286aa595d46c28f56 Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersTestManualDisk-1977679576 Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5e3dbfe14ac3469286aa595d46c28f56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5e3dbfe14ac3469286aa595d46c28f56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5e3dbfe14ac3469286aa595d46c28f56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5e3dbfe14ac3469286aa595d46c28f56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersTestManualDisk-1977679576 Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 5e3dbfe14ac3469286aa595d46c28f56 Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersTestManualDisk-1977679576 Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersTestManualDisk-1977679576-project Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: cea166f15a894cd7b1cee6c5a749679c Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersTestManualDisk-1977679576-project Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 0ab5c42f-da92-43e0-a5f0-c277854edc31 could not be found. Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '0ab5c42f-da92-43e0-a5f0-c277854edc31'} Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ab5c42f-da92-43e0-a5f0-c277854edc31 could not be found. Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ab5c42f-da92-43e0-a5f0-c277854edc31 could not be found. Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:03:38.465289 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:38.469821 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:38.469821 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:03:38.469821 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:03:38.469821 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:03:38.469821 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:03:38.469821 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ab5c42f-da92-43e0-a5f0-c277854edc31 could not be found. Sep 24 21:03:38.469821 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:38.469821 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-383b0079-44aa-4556-9492-deea87cb28c1 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Returning 404 to user: Instance 0ab5c42f-da92-43e0-a5f0-c277854edc31 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:03:38.469821 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-383b0079-44aa-4556-9492-deea87cb28c1 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] 10.222.0.52 "GET /compute/v2.1/servers/0ab5c42f-da92-43e0-a5f0-c277854edc31" status: 404 len: 111 microversion: 2.1 time: 0.049021 Sep 24 21:03:38.469821 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1902/3746] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:38 2022] GET /compute/v2.1/servers/0ab5c42f-da92-43e0-a5f0-c277854edc31 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:03:38.529710 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e5927eb7-7e8f-456c-b4cf-e5ad84a965be tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-34087521", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:38.587816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-e5927eb7-7e8f-456c-b4cf-e5ad84a965be tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] validate_networks() for [('f57270ba-c8fc-413a-afb1-57748c185953', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:03:38.641688 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-68fcc5db-1b69-4f47-bf50-2453c87cc82e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "POST /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580/action" status: 200 len: 14 microversion: 2.1 time: 0.488105 Sep 24 21:03:38.643287 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1845/3747] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:03:38 2022] POST /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580/action => generated 14 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 21:03:38.659243 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ede2c417-1a25-4963-baad-0823ee1566ac tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:38.663297 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ede2c417-1a25-4963-baad-0823ee1566ac tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:38.673731 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ede2c417-1a25-4963-baad-0823ee1566ac tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:38.674852 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ede2c417-1a25-4963-baad-0823ee1566ac tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:38.675616 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ede2c417-1a25-4963-baad-0823ee1566ac tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:38.677055 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ede2c417-1a25-4963-baad-0823ee1566ac tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:38.677800 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ede2c417-1a25-4963-baad-0823ee1566ac tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:38.678457 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ede2c417-1a25-4963-baad-0823ee1566ac tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:39.027678 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ede2c417-1a25-4963-baad-0823ee1566ac tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:39.036464 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ede2c417-1a25-4963-baad-0823ee1566ac tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1279 microversion: 2.1 time: 0.391629 Sep 24 21:03:39.037058 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1846/3748] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:38 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1279 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:39.042175 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-57aec634-43d0-4953-9e43-5c9bdfa237df req-190d23b3-8277-4982-93f7-50aca70111d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ab5c42f-da92-43e0-a5f0-c277854edc31", "name": "network-vif-deleted", "tag": "9ae08dc8-d176-4e64-8af4-718d5d9d5b5c"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:39.067572 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-57aec634-43d0-4953-9e43-5c9bdfa237df req-190d23b3-8277-4982-93f7-50aca70111d7 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:39.068153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-57aec634-43d0-4953-9e43-5c9bdfa237df req-190d23b3-8277-4982-93f7-50aca70111d7 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:39.068489 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-57aec634-43d0-4953-9e43-5c9bdfa237df req-190d23b3-8277-4982-93f7-50aca70111d7 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:39.104893 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-57aec634-43d0-4953-9e43-5c9bdfa237df req-190d23b3-8277-4982-93f7-50aca70111d7 service nova] Creating event network-vif-deleted:9ae08dc8-d176-4e64-8af4-718d5d9d5b5c for instance 0ab5c42f-da92-43e0-a5f0-c277854edc31 on nch2-master-1 Sep 24 21:03:39.109868 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-57aec634-43d0-4953-9e43-5c9bdfa237df req-190d23b3-8277-4982-93f7-50aca70111d7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071618 Sep 24 21:03:39.110523 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1847/3749] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:03:39.123378 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8e5238cb-3255-45b9-8870-3738a989a5b6 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] Calling method '.version_select at 0x7f4b07cf4310>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:39.151288 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8e5238cb-3255-45b9-8870-3738a989a5b6 tempest-ServersTestManualDisk-1977679576 tempest-ServersTestManualDisk-1977679576-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1569532500" status: 202 len: 0 microversion: 2.1 time: 0.038038 Sep 24 21:03:39.152216 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1848/3750] 10.222.0.52 () {58 vars in 1221 bytes} [Sat Sep 24 21:03:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1569532500 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:03:39.163723 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-79bff6b3-3098-4a40-85ec-3a0aad36264d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:39.167724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-79bff6b3-3098-4a40-85ec-3a0aad36264d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:39.188503 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79bff6b3-3098-4a40-85ec-3a0aad36264d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:39.189139 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79bff6b3-3098-4a40-85ec-3a0aad36264d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:39.189889 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79bff6b3-3098-4a40-85ec-3a0aad36264d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:39.191100 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79bff6b3-3098-4a40-85ec-3a0aad36264d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:39.192367 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79bff6b3-3098-4a40-85ec-3a0aad36264d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:39.192776 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79bff6b3-3098-4a40-85ec-3a0aad36264d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:39.229191 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-79bff6b3-3098-4a40-85ec-3a0aad36264d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.072637 Sep 24 21:03:39.229770 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1849/3751] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:03:39 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:03:39.234732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6b6b5d9b-3b4c-4426-8eed-7323d43407ab tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:39.235540 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6b6b5d9b-3b4c-4426-8eed-7323d43407ab tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] [instance: 5be295c0-e7fa-454b-bbba-6b9cddf88575] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:39.242313 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b6b5d9b-3b4c-4426-8eed-7323d43407ab tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:39.242892 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b6b5d9b-3b4c-4426-8eed-7323d43407ab tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:39.243541 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b6b5d9b-3b4c-4426-8eed-7323d43407ab tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:39.244425 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b6b5d9b-3b4c-4426-8eed-7323d43407ab tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:39.244987 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b6b5d9b-3b4c-4426-8eed-7323d43407ab tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:39.245415 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b6b5d9b-3b4c-4426-8eed-7323d43407ab tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:40.189376 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6b6b5d9b-3b4c-4426-8eed-7323d43407ab tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8199c7aba04a9fb1212a2c7e1a52b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad3759161984bb896e1423af9a91d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:40.195370 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:03:40.208958 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6b6b5d9b-3b4c-4426-8eed-7323d43407ab tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] 10.222.0.52 "GET /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575" status: 200 len: 1509 microversion: 2.1 time: 0.977137 Sep 24 21:03:40.226579 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1850/3752] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:39 2022] GET /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575 => generated 1509 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:40.247846 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-24085ac9-c925-453a-8ade-b7f0082d72c7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:40.248483 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-24085ac9-c925-453a-8ade-b7f0082d72c7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 17aa6306-aefd-4e46-b6b7-808b5b7224fb] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:40.260232 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24085ac9-c925-453a-8ade-b7f0082d72c7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:40.260808 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24085ac9-c925-453a-8ade-b7f0082d72c7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:40.261498 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24085ac9-c925-453a-8ade-b7f0082d72c7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:40.262157 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24085ac9-c925-453a-8ade-b7f0082d72c7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:40.262785 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24085ac9-c925-453a-8ade-b7f0082d72c7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:40.263410 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24085ac9-c925-453a-8ade-b7f0082d72c7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:40.818537 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-24085ac9-c925-453a-8ade-b7f0082d72c7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:40.838435 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-24085ac9-c925-453a-8ade-b7f0082d72c7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/17aa6306-aefd-4e46-b6b7-808b5b7224fb" status: 200 len: 1293 microversion: 2.1 time: 0.608270 Sep 24 21:03:40.843481 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1851/3753] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:40 2022] GET /compute/v2.1/servers/17aa6306-aefd-4e46-b6b7-808b5b7224fb => generated 1293 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:40.863087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d167bb0a-cab5-4b63-8148-8cebe46f367e tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:40.863726 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d167bb0a-cab5-4b63-8148-8cebe46f367e tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] [instance: b6106703-7709-41ea-a56c-935391c05827] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:40.879138 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d167bb0a-cab5-4b63-8148-8cebe46f367e tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:40.886617 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d167bb0a-cab5-4b63-8148-8cebe46f367e tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:40.887470 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d167bb0a-cab5-4b63-8148-8cebe46f367e tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:40.889049 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d167bb0a-cab5-4b63-8148-8cebe46f367e tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:40.890125 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d167bb0a-cab5-4b63-8148-8cebe46f367e tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:40.891717 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d167bb0a-cab5-4b63-8148-8cebe46f367e tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:41.011500 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-e5927eb7-7e8f-456c-b4cf-e5ad84a965be tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:03:41.012523 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-e5927eb7-7e8f-456c-b4cf-e5ad84a965be tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:03:41.013271 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-e5927eb7-7e8f-456c-b4cf-e5ad84a965be tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:03:41.014271 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-e5927eb7-7e8f-456c-b4cf-e5ad84a965be tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:03:41.015185 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-e5927eb7-7e8f-456c-b4cf-e5ad84a965be tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:03:41.039078 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e5927eb7-7e8f-456c-b4cf-e5ad84a965be tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:41.041126 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e5927eb7-7e8f-456c-b4cf-e5ad84a965be tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:41.042353 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e5927eb7-7e8f-456c-b4cf-e5ad84a965be tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:41.046129 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e5927eb7-7e8f-456c-b4cf-e5ad84a965be tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:41.046951 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e5927eb7-7e8f-456c-b4cf-e5ad84a965be tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:41.048429 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e5927eb7-7e8f-456c-b4cf-e5ad84a965be tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:41.097663 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-e5927eb7-7e8f-456c-b4cf-e5ad84a965be tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Getting quotas for project 7309c3d3d7e542b1a000490468edec55. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:03:41.117310 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-e5927eb7-7e8f-456c-b4cf-e5ad84a965be tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Getting quotas for user 07d598811ae8427c982bbea05de22daf and project 7309c3d3d7e542b1a000490468edec55. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:03:41.161749 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e5927eb7-7e8f-456c-b4cf-e5ad84a965be tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:03:41.164195 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e5927eb7-7e8f-456c-b4cf-e5ad84a965be tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:03:41.276102 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e5927eb7-7e8f-456c-b4cf-e5ad84a965be tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.807660 Sep 24 21:03:41.283905 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1903/3754] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:03:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 2810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:03:41.291937 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d167bb0a-cab5-4b63-8148-8cebe46f367e tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7654d225081948cabad9d2cdbf03ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d75184d9cd4fed89c0e1d0d5d910fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:41.298286 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ebf567e6-cade-408e-ad5a-c72a64543bfd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:41.302034 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d167bb0a-cab5-4b63-8148-8cebe46f367e tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "GET /compute/v2.1/servers/b6106703-7709-41ea-a56c-935391c05827" status: 200 len: 1312 microversion: 2.1 time: 0.457352 Sep 24 21:03:41.302170 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ebf567e6-cade-408e-ad5a-c72a64543bfd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 40178212-5f30-4d39-80a4-b92306531580] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:41.312394 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ebf567e6-cade-408e-ad5a-c72a64543bfd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:41.313206 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ebf567e6-cade-408e-ad5a-c72a64543bfd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:41.313817 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ebf567e6-cade-408e-ad5a-c72a64543bfd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:41.314827 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ebf567e6-cade-408e-ad5a-c72a64543bfd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:41.315457 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ebf567e6-cade-408e-ad5a-c72a64543bfd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:41.316396 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ebf567e6-cade-408e-ad5a-c72a64543bfd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:41.325939 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1852/3755] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:40 2022] GET /compute/v2.1/servers/b6106703-7709-41ea-a56c-935391c05827 => generated 1312 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:41.358833 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-77be2e32-d3d5-4882-9017-39469129b7d8 req-d4c841c6-5ff4-4166-8391-dd3d08afffd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17aa6306-aefd-4e46-b6b7-808b5b7224fb", "name": "network-vif-plugged", "status": "completed", "tag": "7ba002c9-2db4-4ec4-a4d0-e4197dae31db"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:41.392125 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-77be2e32-d3d5-4882-9017-39469129b7d8 req-d4c841c6-5ff4-4166-8391-dd3d08afffd7 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:41.396790 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-77be2e32-d3d5-4882-9017-39469129b7d8 req-d4c841c6-5ff4-4166-8391-dd3d08afffd7 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:41.398450 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-77be2e32-d3d5-4882-9017-39469129b7d8 req-d4c841c6-5ff4-4166-8391-dd3d08afffd7 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:41.463795 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ebf567e6-cade-408e-ad5a-c72a64543bfd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "POST /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580/action" status: 200 len: 14 microversion: 2.1 time: 0.175926 Sep 24 21:03:41.464885 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1904/3756] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:03:41 2022] POST /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580/action => generated 14 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 21:03:41.483141 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-77be2e32-d3d5-4882-9017-39469129b7d8 req-d4c841c6-5ff4-4166-8391-dd3d08afffd7 service nova] Creating event network-vif-plugged:7ba002c9-2db4-4ec4-a4d0-e4197dae31db for instance 17aa6306-aefd-4e46-b6b7-808b5b7224fb on nch1-master-1 Sep 24 21:03:41.490477 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-822d4ee8-a18d-49f0-845f-2a92be090b56 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:41.491355 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-822d4ee8-a18d-49f0-845f-2a92be090b56 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:41.502891 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-77be2e32-d3d5-4882-9017-39469129b7d8 req-d4c841c6-5ff4-4166-8391-dd3d08afffd7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162349 Sep 24 21:03:41.513058 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1853/3757] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:03:41.531607 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-822d4ee8-a18d-49f0-845f-2a92be090b56 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:41.535205 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-822d4ee8-a18d-49f0-845f-2a92be090b56 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:41.537281 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-822d4ee8-a18d-49f0-845f-2a92be090b56 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:41.538199 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-822d4ee8-a18d-49f0-845f-2a92be090b56 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:41.542181 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-822d4ee8-a18d-49f0-845f-2a92be090b56 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:41.544454 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-822d4ee8-a18d-49f0-845f-2a92be090b56 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:41.552047 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-76b984d4-4a42-4b8f-b8d0-4b199d843b99 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:41.559185 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-76b984d4-4a42-4b8f-b8d0-4b199d843b99 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:41.594979 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76b984d4-4a42-4b8f-b8d0-4b199d843b99 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:41.595499 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76b984d4-4a42-4b8f-b8d0-4b199d843b99 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:41.602593 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76b984d4-4a42-4b8f-b8d0-4b199d843b99 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:41.603585 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76b984d4-4a42-4b8f-b8d0-4b199d843b99 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:41.604078 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76b984d4-4a42-4b8f-b8d0-4b199d843b99 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:41.604525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76b984d4-4a42-4b8f-b8d0-4b199d843b99 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:41.749726 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-76b984d4-4a42-4b8f-b8d0-4b199d843b99 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "POST /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/action" status: 200 len: 38356 microversion: 2.25 time: 0.238550 Sep 24 21:03:41.750719 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1854/3758] 10.222.0.52 () {62 vars in 1319 bytes} [Sat Sep 24 21:03:41 2022] POST /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118/action => generated 38356 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:03:41.756550 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-701a4685-b735-4491-90c6-8e0e458cda51 req-36fbe956-c67e-4406-acdf-e5fe42c18a72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5be295c0-e7fa-454b-bbba-6b9cddf88575", "name": "network-vif-deleted", "tag": "21d51de6-e5a8-4196-807a-c4b41d677479"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:41.801680 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-701a4685-b735-4491-90c6-8e0e458cda51 req-36fbe956-c67e-4406-acdf-e5fe42c18a72 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:41.803132 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-701a4685-b735-4491-90c6-8e0e458cda51 req-36fbe956-c67e-4406-acdf-e5fe42c18a72 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:41.806009 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-701a4685-b735-4491-90c6-8e0e458cda51 req-36fbe956-c67e-4406-acdf-e5fe42c18a72 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:41.821842 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-701a4685-b735-4491-90c6-8e0e458cda51 req-36fbe956-c67e-4406-acdf-e5fe42c18a72 service nova] Creating event network-vif-deleted:21d51de6-e5a8-4196-807a-c4b41d677479 for instance 5be295c0-e7fa-454b-bbba-6b9cddf88575 on nch1-master-1 Sep 24 21:03:41.827316 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-701a4685-b735-4491-90c6-8e0e458cda51 req-36fbe956-c67e-4406-acdf-e5fe42c18a72 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075067 Sep 24 21:03:41.828473 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1855/3759] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:03:41.850105 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5f3fbc06-d19c-45be-8b02-cfeefa3f274c tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:41.851031 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5f3fbc06-d19c-45be-8b02-cfeefa3f274c tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] [instance: 5be295c0-e7fa-454b-bbba-6b9cddf88575] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:41.858602 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f3fbc06-d19c-45be-8b02-cfeefa3f274c tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:41.859254 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f3fbc06-d19c-45be-8b02-cfeefa3f274c tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:41.862813 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f3fbc06-d19c-45be-8b02-cfeefa3f274c tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:41.863941 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f3fbc06-d19c-45be-8b02-cfeefa3f274c tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:41.868735 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f3fbc06-d19c-45be-8b02-cfeefa3f274c tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:41.870210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f3fbc06-d19c-45be-8b02-cfeefa3f274c tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:41.897720 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-5f3fbc06-d19c-45be-8b02-cfeefa3f274c tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] HTTP exception thrown: Instance 5be295c0-e7fa-454b-bbba-6b9cddf88575 could not be found. Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5f3fbc06-d19c-45be-8b02-cfeefa3f274c tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Request method failure captured: Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575 HTTP/1.1 Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3CMWWnzlCfvqANn4H7QZifpu1JrY2ZXWKd0QaUUzk5sZsE_OzDp77Afc5xaDkTbEhicuvNTqFaO_ZQnkPTpAxZv-9Hj5HwFsmTs6srEuVEM61sPM6v9_BJruft77wdl6gAj232gNheM1p4VcJZCmzhF0C-K5eIOtJa1Jxz2dQAp3eY Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: dad3759161984bb896e1423af9a91d14 Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ImagesNegativeTestJSON-915667689 Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dad3759161984bb896e1423af9a91d14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dad3759161984bb896e1423af9a91d14"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dad3759161984bb896e1423af9a91d14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dad3759161984bb896e1423af9a91d14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ImagesNegativeTestJSON-915667689 Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: dad3759161984bb896e1423af9a91d14 Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-915667689 Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ImagesNegativeTestJSON-915667689-project Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 7d8199c7aba04a9fb1212a2c7e1a52b3 Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ImagesNegativeTestJSON-915667689-project Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 5be295c0-e7fa-454b-bbba-6b9cddf88575 could not be found. Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '5be295c0-e7fa-454b-bbba-6b9cddf88575'} Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5be295c0-e7fa-454b-bbba-6b9cddf88575 could not be found. Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5be295c0-e7fa-454b-bbba-6b9cddf88575 could not be found. Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:03:41.903457 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:03:41.908472 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:41.908472 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:03:41.908472 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:03:41.908472 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:03:41.908472 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:03:41.908472 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5be295c0-e7fa-454b-bbba-6b9cddf88575 could not be found. Sep 24 21:03:41.908472 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:03:41.908472 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5f3fbc06-d19c-45be-8b02-cfeefa3f274c tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Returning 404 to user: Instance 5be295c0-e7fa-454b-bbba-6b9cddf88575 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:03:41.908472 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5f3fbc06-d19c-45be-8b02-cfeefa3f274c tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] 10.222.0.52 "GET /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575" status: 404 len: 111 microversion: 2.1 time: 0.077821 Sep 24 21:03:41.913429 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1856/3760] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:41 2022] GET /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:03:41.919565 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-937cb336-2bc5-4892-a1bb-8b177b5b1ec8 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:41.923432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-937cb336-2bc5-4892-a1bb-8b177b5b1ec8 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:41.925884 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=4,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:03:42.049224 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-937cb336-2bc5-4892-a1bb-8b177b5b1ec8 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:42.070317 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-937cb336-2bc5-4892-a1bb-8b177b5b1ec8 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1221 microversion: 2.1 time: 0.153792 Sep 24 21:03:42.074877 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1857/3761] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:41 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1221 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:42.087354 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e86b9441-bf83-4d3e-b4d7-03e42d9dd30d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:42.089947 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e86b9441-bf83-4d3e-b4d7-03e42d9dd30d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 17aa6306-aefd-4e46-b6b7-808b5b7224fb] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:42.109246 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e86b9441-bf83-4d3e-b4d7-03e42d9dd30d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:42.111777 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e86b9441-bf83-4d3e-b4d7-03e42d9dd30d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:42.113272 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e86b9441-bf83-4d3e-b4d7-03e42d9dd30d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:42.115569 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e86b9441-bf83-4d3e-b4d7-03e42d9dd30d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:42.117139 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e86b9441-bf83-4d3e-b4d7-03e42d9dd30d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:42.118256 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e86b9441-bf83-4d3e-b4d7-03e42d9dd30d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:42.328539 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-822d4ee8-a18d-49f0-845f-2a92be090b56 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:42.347392 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-822d4ee8-a18d-49f0-845f-2a92be090b56 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1321 microversion: 2.1 time: 0.872397 Sep 24 21:03:42.348067 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1905/3762] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:41 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1321 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:42.356267 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f9a96030-e6fb-4a37-adf9-df5d2f8b2a9a tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-114620844", "metadata": {"image_type": "test"}}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:42.362364 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f9a96030-e6fb-4a37-adf9-df5d2f8b2a9a tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] [instance: 5be295c0-e7fa-454b-bbba-6b9cddf88575] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:42.381577 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9a96030-e6fb-4a37-adf9-df5d2f8b2a9a tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:42.382412 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9a96030-e6fb-4a37-adf9-df5d2f8b2a9a tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:42.385458 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9a96030-e6fb-4a37-adf9-df5d2f8b2a9a tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:42.386900 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9a96030-e6fb-4a37-adf9-df5d2f8b2a9a tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:42.387861 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9a96030-e6fb-4a37-adf9-df5d2f8b2a9a tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:42.388566 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9a96030-e6fb-4a37-adf9-df5d2f8b2a9a tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:42.411948 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e86b9441-bf83-4d3e-b4d7-03e42d9dd30d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:42.424653 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e86b9441-bf83-4d3e-b4d7-03e42d9dd30d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/17aa6306-aefd-4e46-b6b7-808b5b7224fb" status: 200 len: 1293 microversion: 2.1 time: 0.348465 Sep 24 21:03:42.425639 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-f9a96030-e6fb-4a37-adf9-df5d2f8b2a9a tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] HTTP exception thrown: Instance 5be295c0-e7fa-454b-bbba-6b9cddf88575 could not be found. Sep 24 21:03:42.426525 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1858/3763] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:42 2022] GET /compute/v2.1/servers/17aa6306-aefd-4e46-b6b7-808b5b7224fb => generated 1293 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f9a96030-e6fb-4a37-adf9-df5d2f8b2a9a tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Request method failure captured: Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575/action HTTP/1.1 Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 111 Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3CMWWnzlCfvqANn4H7QZifpu1JrY2ZXWKd0QaUUzk5sZsE_OzDp77Afc5xaDkTbEhicuvNTqFaO_ZQnkPTpAxZv-9Hj5HwFsmTs6srEuVEM61sPM6v9_BJruft77wdl6gAj232gNheM1p4VcJZCmzhF0C-K5eIOtJa1Jxz2dQAp3eY Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: dad3759161984bb896e1423af9a91d14 Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ImagesNegativeTestJSON-915667689 Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dad3759161984bb896e1423af9a91d14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dad3759161984bb896e1423af9a91d14"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dad3759161984bb896e1423af9a91d14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dad3759161984bb896e1423af9a91d14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ImagesNegativeTestJSON-915667689 Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: dad3759161984bb896e1423af9a91d14 Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-915667689 Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ImagesNegativeTestJSON-915667689-project Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 7d8199c7aba04a9fb1212a2c7e1a52b3 Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ImagesNegativeTestJSON-915667689-project Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-114620844", "metadata": {"image_type": "test"}}} Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 5be295c0-e7fa-454b-bbba-6b9cddf88575 could not be found. Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '5be295c0-e7fa-454b-bbba-6b9cddf88575', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-114620844', 'metadata': {'image_type': 'test'}}}} Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5be295c0-e7fa-454b-bbba-6b9cddf88575 could not be found. Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 24 21:03:42.432815 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:03:42.440655 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:03:42.440655 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:03:42.440655 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:03:42.440655 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5be295c0-e7fa-454b-bbba-6b9cddf88575 could not be found. Sep 24 21:03:42.440655 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:42.440655 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:03:42.440655 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:42.440655 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:42.440655 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:03:42.440655 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:03:42.440655 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:03:42.440655 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:03:42.440655 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5be295c0-e7fa-454b-bbba-6b9cddf88575 could not be found. Sep 24 21:03:42.440655 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:42.443358 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f9a96030-e6fb-4a37-adf9-df5d2f8b2a9a tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Returning 404 to user: Instance 5be295c0-e7fa-454b-bbba-6b9cddf88575 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:03:42.445503 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f9a96030-e6fb-4a37-adf9-df5d2f8b2a9a tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] 10.222.0.52 "POST /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575/action" status: 404 len: 111 microversion: 2.1 time: 0.095527 Sep 24 21:03:42.447901 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1906/3764] 10.222.0.52 () {60 vars in 1279 bytes} [Sat Sep 24 21:03:42 2022] POST /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575/action => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:03:42.456728 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e1a36f54-5038-439a-8b41-5d9f77f045e2 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:42.458377 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e1a36f54-5038-439a-8b41-5d9f77f045e2 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] [instance: b6106703-7709-41ea-a56c-935391c05827] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:42.463200 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b8d0cedf-4186-4944-a46a-d5d600016f14 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1041693824", "metadata": {"image_type": "test"}}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:42.466247 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b8d0cedf-4186-4944-a46a-d5d600016f14 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Failed to fetch instance by id tempest-invalid-1148119183 {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 24 21:03:42.466784 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1a36f54-5038-439a-8b41-5d9f77f045e2 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:42.467280 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-b8d0cedf-4186-4944-a46a-d5d600016f14 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] HTTP exception thrown: Instance tempest-invalid-1148119183 could not be found. Sep 24 21:03:42.468318 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1a36f54-5038-439a-8b41-5d9f77f045e2 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:42.468932 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1a36f54-5038-439a-8b41-5d9f77f045e2 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:42.470771 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1a36f54-5038-439a-8b41-5d9f77f045e2 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:42.471434 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1a36f54-5038-439a-8b41-5d9f77f045e2 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:42.472087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1a36f54-5038-439a-8b41-5d9f77f045e2 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b8d0cedf-4186-4944-a46a-d5d600016f14 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Request method failure captured: Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/servers/tempest-invalid-1148119183/action HTTP/1.1 Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 112 Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3CMWWnzlCfvqANn4H7QZifpu1JrY2ZXWKd0QaUUzk5sZsE_OzDp77Afc5xaDkTbEhicuvNTqFaO_ZQnkPTpAxZv-9Hj5HwFsmTs6srEuVEM61sPM6v9_BJruft77wdl6gAj232gNheM1p4VcJZCmzhF0C-K5eIOtJa1Jxz2dQAp3eY Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: dad3759161984bb896e1423af9a91d14 Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ImagesNegativeTestJSON-915667689 Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dad3759161984bb896e1423af9a91d14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dad3759161984bb896e1423af9a91d14"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dad3759161984bb896e1423af9a91d14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dad3759161984bb896e1423af9a91d14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ImagesNegativeTestJSON-915667689 Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: dad3759161984bb896e1423af9a91d14 Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-915667689 Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ImagesNegativeTestJSON-915667689-project Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 7d8199c7aba04a9fb1212a2c7e1a52b3 Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ImagesNegativeTestJSON-915667689-project Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1041693824", "metadata": {"image_type": "test"}}} Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance tempest-invalid-1148119183 could not be found. Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'tempest-invalid-1148119183', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1041693824', 'metadata': {'image_type': 'test'}}}} Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1148119183 could not be found. Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:03:42.473785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1148119183 could not be found. Sep 24 21:03:42.479123 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:42.479123 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:03:42.479123 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:42.479123 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:42.479123 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:03:42.479123 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:03:42.479123 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:03:42.479123 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:03:42.479123 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1148119183 could not be found. Sep 24 21:03:42.479123 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:42.479123 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b8d0cedf-4186-4944-a46a-d5d600016f14 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Returning 404 to user: Instance tempest-invalid-1148119183 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:03:42.479123 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b8d0cedf-4186-4944-a46a-d5d600016f14 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] 10.222.0.52 "POST /compute/v2.1/servers/tempest-invalid-1148119183/action" status: 404 len: 101 microversion: 2.1 time: 0.020522 Sep 24 21:03:42.479123 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1907/3765] 10.222.0.52 () {60 vars in 1249 bytes} [Sat Sep 24 21:03:42 2022] POST /compute/v2.1/servers/tempest-invalid-1148119183/action => generated 101 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:03:42.488501 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8e4ead17-7d37-428d-b5e3-b76c2893268f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:42.490759 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8e4ead17-7d37-428d-b5e3-b76c2893268f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 40178212-5f30-4d39-80a4-b92306531580] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:42.511955 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8e4ead17-7d37-428d-b5e3-b76c2893268f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:42.512354 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8e4ead17-7d37-428d-b5e3-b76c2893268f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:42.512986 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8e4ead17-7d37-428d-b5e3-b76c2893268f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:42.514067 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8e4ead17-7d37-428d-b5e3-b76c2893268f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:42.514727 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8e4ead17-7d37-428d-b5e3-b76c2893268f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:42.515326 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8e4ead17-7d37-428d-b5e3-b76c2893268f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:42.594064 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8e4ead17-7d37-428d-b5e3-b76c2893268f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "POST /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580/action" status: 200 len: 14 microversion: 2.1 time: 0.116547 Sep 24 21:03:42.595858 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1908/3766] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:03:42 2022] POST /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 21:03:42.605234 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b71332d7-7fff-467f-ae6e-f36c8d1bb1ea tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1024446579"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:42.608524 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b71332d7-7fff-467f-ae6e-f36c8d1bb1ea tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 24 21:03:42.609359 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-b71332d7-7fff-467f-ae6e-f36c8d1bb1ea tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b71332d7-7fff-467f-ae6e-f36c8d1bb1ea tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Request method failure captured: Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 57 Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3CMWWnzlCfvqANn4H7QZifpu1JrY2ZXWKd0QaUUzk5sZsE_OzDp77Afc5xaDkTbEhicuvNTqFaO_ZQnkPTpAxZv-9Hj5HwFsmTs6srEuVEM61sPM6v9_BJruft77wdl6gAj232gNheM1p4VcJZCmzhF0C-K5eIOtJa1Jxz2dQAp3eY Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: dad3759161984bb896e1423af9a91d14 Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ImagesNegativeTestJSON-915667689 Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dad3759161984bb896e1423af9a91d14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dad3759161984bb896e1423af9a91d14"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dad3759161984bb896e1423af9a91d14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dad3759161984bb896e1423af9a91d14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ImagesNegativeTestJSON-915667689 Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: dad3759161984bb896e1423af9a91d14 Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-915667689 Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ImagesNegativeTestJSON-915667689-project Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 7d8199c7aba04a9fb1212a2c7e1a52b3 Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ImagesNegativeTestJSON-915667689-project Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: {"createImage": {"name": "tempest-test-snap-1024446579"}} Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1024446579'}}} Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 24 21:03:42.612831 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:42.622336 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:03:42.622336 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:42.622336 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:42.622336 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:03:42.622336 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:03:42.622336 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:03:42.622336 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:03:42.622336 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 24 21:03:42.622336 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:42.625800 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b71332d7-7fff-467f-ae6e-f36c8d1bb1ea tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:03:42.627170 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b71332d7-7fff-467f-ae6e-f36c8d1bb1ea tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] 10.222.0.52 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.029554 Sep 24 21:03:42.635979 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1909/3767] 10.222.0.52 () {60 vars in 1275 bytes} [Sat Sep 24 21:03:42 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:03:42.655303 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-eaa6273d-aa5b-4f7a-abc4-0d90d4eeb246 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-653297332"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:42.659843 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-eaa6273d-aa5b-4f7a-abc4-0d90d4eeb246 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 24 21:03:42.660301 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-eaa6273d-aa5b-4f7a-abc4-0d90d4eeb246 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-eaa6273d-aa5b-4f7a-abc4-0d90d4eeb246 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Request method failure captured: Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 56 Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3CMWWnzlCfvqANn4H7QZifpu1JrY2ZXWKd0QaUUzk5sZsE_OzDp77Afc5xaDkTbEhicuvNTqFaO_ZQnkPTpAxZv-9Hj5HwFsmTs6srEuVEM61sPM6v9_BJruft77wdl6gAj232gNheM1p4VcJZCmzhF0C-K5eIOtJa1Jxz2dQAp3eY Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: dad3759161984bb896e1423af9a91d14 Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ImagesNegativeTestJSON-915667689 Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dad3759161984bb896e1423af9a91d14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dad3759161984bb896e1423af9a91d14"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dad3759161984bb896e1423af9a91d14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dad3759161984bb896e1423af9a91d14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ImagesNegativeTestJSON-915667689 Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: dad3759161984bb896e1423af9a91d14 Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-915667689 Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ImagesNegativeTestJSON-915667689-project Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 7d8199c7aba04a9fb1212a2c7e1a52b3 Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ImagesNegativeTestJSON-915667689-project Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: {"createImage": {"name": "tempest-test-snap-653297332"}} Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-653297332'}}} Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 24 21:03:42.661941 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:42.668996 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:03:42.668996 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:42.668996 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:42.668996 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:03:42.668996 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:03:42.668996 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:03:42.668996 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:03:42.668996 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 24 21:03:42.668996 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:42.668996 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-eaa6273d-aa5b-4f7a-abc4-0d90d4eeb246 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:03:42.670788 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-eaa6273d-aa5b-4f7a-abc4-0d90d4eeb246 tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] 10.222.0.52 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.030626 Sep 24 21:03:42.675471 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1910/3768] 10.222.0.52 () {60 vars in 1281 bytes} [Sat Sep 24 21:03:42 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:03:42.692256 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d5379e28-24ac-45e1-876e-a2c4311dee8f tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:42.693939 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d5379e28-24ac-45e1-876e-a2c4311dee8f tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] [instance: 5be295c0-e7fa-454b-bbba-6b9cddf88575] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:42.702947 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d5379e28-24ac-45e1-876e-a2c4311dee8f tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:42.703438 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d5379e28-24ac-45e1-876e-a2c4311dee8f tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:42.704497 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d5379e28-24ac-45e1-876e-a2c4311dee8f tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:42.705528 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d5379e28-24ac-45e1-876e-a2c4311dee8f tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:42.706904 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d5379e28-24ac-45e1-876e-a2c4311dee8f tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:42.707512 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d5379e28-24ac-45e1-876e-a2c4311dee8f tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:42.725798 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-d5379e28-24ac-45e1-876e-a2c4311dee8f tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] HTTP exception thrown: Instance 5be295c0-e7fa-454b-bbba-6b9cddf88575 could not be found. Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d5379e28-24ac-45e1-876e-a2c4311dee8f tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Request method failure captured: Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575 HTTP/1.1 Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3CMWWnzlCfvqANn4H7QZifpu1JrY2ZXWKd0QaUUzk5sZsE_OzDp77Afc5xaDkTbEhicuvNTqFaO_ZQnkPTpAxZv-9Hj5HwFsmTs6srEuVEM61sPM6v9_BJruft77wdl6gAj232gNheM1p4VcJZCmzhF0C-K5eIOtJa1Jxz2dQAp3eY Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: dad3759161984bb896e1423af9a91d14 Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ImagesNegativeTestJSON-915667689 Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dad3759161984bb896e1423af9a91d14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dad3759161984bb896e1423af9a91d14"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dad3759161984bb896e1423af9a91d14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dad3759161984bb896e1423af9a91d14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ImagesNegativeTestJSON-915667689 Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: dad3759161984bb896e1423af9a91d14 Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-915667689 Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ImagesNegativeTestJSON-915667689-project Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 7d8199c7aba04a9fb1212a2c7e1a52b3 Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ImagesNegativeTestJSON-915667689-project Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 5be295c0-e7fa-454b-bbba-6b9cddf88575 could not be found. Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '5be295c0-e7fa-454b-bbba-6b9cddf88575'} Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5be295c0-e7fa-454b-bbba-6b9cddf88575 could not be found. Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:03:42.728314 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:03:42.733085 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5be295c0-e7fa-454b-bbba-6b9cddf88575 could not be found. Sep 24 21:03:42.733085 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:42.733085 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:03:42.733085 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:42.733085 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:42.733085 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:03:42.733085 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:03:42.733085 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:03:42.733085 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:03:42.733085 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5be295c0-e7fa-454b-bbba-6b9cddf88575 could not be found. Sep 24 21:03:42.733085 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:42.735039 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d5379e28-24ac-45e1-876e-a2c4311dee8f tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Returning 404 to user: Instance 5be295c0-e7fa-454b-bbba-6b9cddf88575 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:03:42.736160 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d5379e28-24ac-45e1-876e-a2c4311dee8f tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575" status: 404 len: 111 microversion: 2.1 time: 0.058604 Sep 24 21:03:42.741552 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1911/3769] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:03:42 2022] DELETE /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:03:42.748306 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-67beddd7-6a7c-4aae-b6b4-d7fdac5e2cdb tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:42.749156 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-67beddd7-6a7c-4aae-b6b4-d7fdac5e2cdb tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] [instance: 5be295c0-e7fa-454b-bbba-6b9cddf88575] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:42.774082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67beddd7-6a7c-4aae-b6b4-d7fdac5e2cdb tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:42.775235 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67beddd7-6a7c-4aae-b6b4-d7fdac5e2cdb tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:42.775838 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67beddd7-6a7c-4aae-b6b4-d7fdac5e2cdb tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:42.776741 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67beddd7-6a7c-4aae-b6b4-d7fdac5e2cdb tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:42.777467 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67beddd7-6a7c-4aae-b6b4-d7fdac5e2cdb tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:42.778050 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67beddd7-6a7c-4aae-b6b4-d7fdac5e2cdb tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:42.796589 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-67beddd7-6a7c-4aae-b6b4-d7fdac5e2cdb tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] HTTP exception thrown: Instance 5be295c0-e7fa-454b-bbba-6b9cddf88575 could not be found. Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-67beddd7-6a7c-4aae-b6b4-d7fdac5e2cdb tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Request method failure captured: Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575 HTTP/1.1 Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3CMWWnzlCfvqANn4H7QZifpu1JrY2ZXWKd0QaUUzk5sZsE_OzDp77Afc5xaDkTbEhicuvNTqFaO_ZQnkPTpAxZv-9Hj5HwFsmTs6srEuVEM61sPM6v9_BJruft77wdl6gAj232gNheM1p4VcJZCmzhF0C-K5eIOtJa1Jxz2dQAp3eY Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: dad3759161984bb896e1423af9a91d14 Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ImagesNegativeTestJSON-915667689 Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dad3759161984bb896e1423af9a91d14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dad3759161984bb896e1423af9a91d14"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dad3759161984bb896e1423af9a91d14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dad3759161984bb896e1423af9a91d14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ImagesNegativeTestJSON-915667689 Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: dad3759161984bb896e1423af9a91d14 Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-915667689 Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ImagesNegativeTestJSON-915667689-project Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 7d8199c7aba04a9fb1212a2c7e1a52b3 Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ImagesNegativeTestJSON-915667689-project Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 5be295c0-e7fa-454b-bbba-6b9cddf88575 could not be found. Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '5be295c0-e7fa-454b-bbba-6b9cddf88575'} Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5be295c0-e7fa-454b-bbba-6b9cddf88575 could not be found. Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5be295c0-e7fa-454b-bbba-6b9cddf88575 could not be found. Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:03:42.798585 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:42.802977 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:42.802977 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:03:42.802977 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:03:42.802977 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:03:42.802977 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:03:42.802977 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5be295c0-e7fa-454b-bbba-6b9cddf88575 could not be found. Sep 24 21:03:42.802977 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:42.804785 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-67beddd7-6a7c-4aae-b6b4-d7fdac5e2cdb tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] Returning 404 to user: Instance 5be295c0-e7fa-454b-bbba-6b9cddf88575 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:03:42.806133 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-67beddd7-6a7c-4aae-b6b4-d7fdac5e2cdb tempest-ImagesNegativeTestJSON-915667689 tempest-ImagesNegativeTestJSON-915667689-project] 10.222.0.52 "GET /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575" status: 404 len: 111 microversion: 2.1 time: 0.062953 Sep 24 21:03:42.810678 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1912/3770] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:42 2022] GET /compute/v2.1/servers/5be295c0-e7fa-454b-bbba-6b9cddf88575 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:03:42.965882 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e1a36f54-5038-439a-8b41-5d9f77f045e2 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7654d225081948cabad9d2cdbf03ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d75184d9cd4fed89c0e1d0d5d910fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:42.979721 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e1a36f54-5038-439a-8b41-5d9f77f045e2 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "GET /compute/v2.1/servers/b6106703-7709-41ea-a56c-935391c05827" status: 200 len: 1312 microversion: 2.1 time: 0.550583 Sep 24 21:03:42.996844 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1859/3771] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:42 2022] GET /compute/v2.1/servers/b6106703-7709-41ea-a56c-935391c05827 => generated 1312 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:43.099511 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ba5eda93-20cc-40e3-85e0-13d6ce65d1bd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:43.100194 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ba5eda93-20cc-40e3-85e0-13d6ce65d1bd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:43.107216 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba5eda93-20cc-40e3-85e0-13d6ce65d1bd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:43.107704 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba5eda93-20cc-40e3-85e0-13d6ce65d1bd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:43.109122 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba5eda93-20cc-40e3-85e0-13d6ce65d1bd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:43.111829 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba5eda93-20cc-40e3-85e0-13d6ce65d1bd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:43.112657 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba5eda93-20cc-40e3-85e0-13d6ce65d1bd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:43.113259 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba5eda93-20cc-40e3-85e0-13d6ce65d1bd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:43.282273 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ba5eda93-20cc-40e3-85e0-13d6ce65d1bd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:43.306963 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ba5eda93-20cc-40e3-85e0-13d6ce65d1bd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1273 microversion: 2.1 time: 0.215238 Sep 24 21:03:43.328287 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1913/3772] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:43 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1273 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:43.375910 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-39bba476-4537-4fd8-bdb7-621ddbbef03d tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:43.376825 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-39bba476-4537-4fd8-bdb7-621ddbbef03d tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:43.389706 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-39bba476-4537-4fd8-bdb7-621ddbbef03d tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:43.394150 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-39bba476-4537-4fd8-bdb7-621ddbbef03d tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:43.396703 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-39bba476-4537-4fd8-bdb7-621ddbbef03d tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:43.398881 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-39bba476-4537-4fd8-bdb7-621ddbbef03d tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:43.399654 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-39bba476-4537-4fd8-bdb7-621ddbbef03d tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:43.402168 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-39bba476-4537-4fd8-bdb7-621ddbbef03d tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:43.456789 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-baa8a73c-cffc-4b99-808c-5aa99572c456 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:43.458127 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-baa8a73c-cffc-4b99-808c-5aa99572c456 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 17aa6306-aefd-4e46-b6b7-808b5b7224fb] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:43.478440 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-baa8a73c-cffc-4b99-808c-5aa99572c456 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:43.479265 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-baa8a73c-cffc-4b99-808c-5aa99572c456 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:43.479875 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-baa8a73c-cffc-4b99-808c-5aa99572c456 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:43.480802 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-baa8a73c-cffc-4b99-808c-5aa99572c456 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:43.481443 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-baa8a73c-cffc-4b99-808c-5aa99572c456 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:43.482675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-baa8a73c-cffc-4b99-808c-5aa99572c456 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:43.905133 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-39bba476-4537-4fd8-bdb7-621ddbbef03d tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:43.918728 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-39bba476-4537-4fd8-bdb7-621ddbbef03d tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1321 microversion: 2.1 time: 0.547638 Sep 24 21:03:43.920744 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1860/3773] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:43 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1321 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:43.938211 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-027ff143-4ff2-4c7d-b850-7588e2df59da req-d7465c32-fb11-4f8e-9172-f31bde006c57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acc02ed3-5cf0-4fe4-b4d7-ac40fe691355", "name": "network-vif-plugged", "status": "completed", "tag": "5c9ac72a-bbd8-424e-8720-bcc509cc437c"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:43.948366 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-027ff143-4ff2-4c7d-b850-7588e2df59da req-d7465c32-fb11-4f8e-9172-f31bde006c57 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:43.948852 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-027ff143-4ff2-4c7d-b850-7588e2df59da req-d7465c32-fb11-4f8e-9172-f31bde006c57 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:43.949287 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-027ff143-4ff2-4c7d-b850-7588e2df59da req-d7465c32-fb11-4f8e-9172-f31bde006c57 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:43.964335 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-027ff143-4ff2-4c7d-b850-7588e2df59da req-d7465c32-fb11-4f8e-9172-f31bde006c57 service nova] Creating event network-vif-plugged:5c9ac72a-bbd8-424e-8720-bcc509cc437c for instance acc02ed3-5cf0-4fe4-b4d7-ac40fe691355 on nch2-master-1 Sep 24 21:03:43.970355 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-027ff143-4ff2-4c7d-b850-7588e2df59da req-d7465c32-fb11-4f8e-9172-f31bde006c57 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046781 Sep 24 21:03:43.971525 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1861/3774] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:03:43.977983 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-66d50709-58ec-4eaf-a314-e3fec40035e1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:43.980660 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-66d50709-58ec-4eaf-a314-e3fec40035e1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 40178212-5f30-4d39-80a4-b92306531580] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:43.987405 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66d50709-58ec-4eaf-a314-e3fec40035e1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:43.988099 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66d50709-58ec-4eaf-a314-e3fec40035e1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:43.988705 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66d50709-58ec-4eaf-a314-e3fec40035e1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:43.989613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66d50709-58ec-4eaf-a314-e3fec40035e1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:43.990234 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66d50709-58ec-4eaf-a314-e3fec40035e1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:43.990875 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66d50709-58ec-4eaf-a314-e3fec40035e1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:43.999267 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-baa8a73c-cffc-4b99-808c-5aa99572c456 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:44.016949 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-baa8a73c-cffc-4b99-808c-5aa99572c456 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/17aa6306-aefd-4e46-b6b7-808b5b7224fb" status: 200 len: 1475 microversion: 2.1 time: 0.570886 Sep 24 21:03:44.017554 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1914/3775] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:43 2022] GET /compute/v2.1/servers/17aa6306-aefd-4e46-b6b7-808b5b7224fb => generated 1475 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:44.022074 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-98922d39-cb75-47c2-a435-b93014ad6e96 req-e902dc44-95c1-454c-95ca-6d042e16dd12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e765d57a-1bbe-4504-a194-d2c3d906577f", "tag": "5261759a-9b03-4931-8c0d-b4ebcec3b6fc"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:44.048881 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-98922d39-cb75-47c2-a435-b93014ad6e96 req-e902dc44-95c1-454c-95ca-6d042e16dd12 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:44.059876 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-98922d39-cb75-47c2-a435-b93014ad6e96 req-e902dc44-95c1-454c-95ca-6d042e16dd12 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:44.060329 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-98922d39-cb75-47c2-a435-b93014ad6e96 req-e902dc44-95c1-454c-95ca-6d042e16dd12 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:44.083425 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-66d50709-58ec-4eaf-a314-e3fec40035e1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "POST /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580/action" status: 200 len: 14 microversion: 2.1 time: 0.109967 Sep 24 21:03:44.085613 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1862/3776] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:03:43 2022] POST /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 21:03:44.090347 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-98922d39-cb75-47c2-a435-b93014ad6e96 req-e902dc44-95c1-454c-95ca-6d042e16dd12 service nova] Creating event network-changed:5261759a-9b03-4931-8c0d-b4ebcec3b6fc for instance e765d57a-1bbe-4504-a194-d2c3d906577f on nch1-master-1 Sep 24 21:03:44.095198 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-78577f45-1121-4b4c-9c92-2bae3c9f90a9 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:44.100060 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-78577f45-1121-4b4c-9c92-2bae3c9f90a9 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] [instance: b6106703-7709-41ea-a56c-935391c05827] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:44.113246 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-98922d39-cb75-47c2-a435-b93014ad6e96 req-e902dc44-95c1-454c-95ca-6d042e16dd12 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094332 Sep 24 21:03:44.115095 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1915/3777] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:03:44.119179 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78577f45-1121-4b4c-9c92-2bae3c9f90a9 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:44.120455 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78577f45-1121-4b4c-9c92-2bae3c9f90a9 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:44.121095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78577f45-1121-4b4c-9c92-2bae3c9f90a9 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:44.122359 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78577f45-1121-4b4c-9c92-2bae3c9f90a9 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:44.123075 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78577f45-1121-4b4c-9c92-2bae3c9f90a9 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:44.123676 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78577f45-1121-4b4c-9c92-2bae3c9f90a9 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:44.217114 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f821a359-de74-4b51-abef-9c4e243a5569 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-189712777", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:44.282414 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-f821a359-de74-4b51-abef-9c4e243a5569 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] validate_networks() for [('86ee1dec-a957-4cc1-98d2-2e275615c01a', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:03:44.925409 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-78577f45-1121-4b4c-9c92-2bae3c9f90a9 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7654d225081948cabad9d2cdbf03ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d75184d9cd4fed89c0e1d0d5d910fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:44.936285 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-78577f45-1121-4b4c-9c92-2bae3c9f90a9 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "GET /compute/v2.1/servers/b6106703-7709-41ea-a56c-935391c05827" status: 200 len: 1312 microversion: 2.1 time: 0.845441 Sep 24 21:03:44.938593 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1863/3778] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:44 2022] GET /compute/v2.1/servers/b6106703-7709-41ea-a56c-935391c05827 => generated 1312 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:44.955352 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5d98a86e-41c7-410b-8010-305de7fe4810 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:44.956332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5d98a86e-41c7-410b-8010-305de7fe4810 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:44.969899 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d98a86e-41c7-410b-8010-305de7fe4810 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:44.970784 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d98a86e-41c7-410b-8010-305de7fe4810 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:44.971467 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d98a86e-41c7-410b-8010-305de7fe4810 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:44.972585 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d98a86e-41c7-410b-8010-305de7fe4810 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:44.973252 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d98a86e-41c7-410b-8010-305de7fe4810 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:44.973967 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d98a86e-41c7-410b-8010-305de7fe4810 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:45.132241 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5d98a86e-41c7-410b-8010-305de7fe4810 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:45.141437 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5d98a86e-41c7-410b-8010-305de7fe4810 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1279 microversion: 2.1 time: 0.201580 Sep 24 21:03:45.142850 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1864/3779] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:44 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1279 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:45.163067 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-52ccc29f-df8a-4deb-9006-a0126f6d1fca req-b83197ee-1094-4e68-ace7-44e314c6fc42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6106703-7709-41ea-a56c-935391c05827", "tag": "19e3d6bb-23c8-4195-b009-14e01e93950c"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:45.174205 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-52ccc29f-df8a-4deb-9006-a0126f6d1fca req-b83197ee-1094-4e68-ace7-44e314c6fc42 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:45.174894 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-52ccc29f-df8a-4deb-9006-a0126f6d1fca req-b83197ee-1094-4e68-ace7-44e314c6fc42 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:45.175395 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-52ccc29f-df8a-4deb-9006-a0126f6d1fca req-b83197ee-1094-4e68-ace7-44e314c6fc42 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:45.190037 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-52ccc29f-df8a-4deb-9006-a0126f6d1fca req-b83197ee-1094-4e68-ace7-44e314c6fc42 service nova] Creating event network-changed:19e3d6bb-23c8-4195-b009-14e01e93950c for instance b6106703-7709-41ea-a56c-935391c05827 on nch2-master-1 Sep 24 21:03:45.196728 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-52ccc29f-df8a-4deb-9006-a0126f6d1fca req-b83197ee-1094-4e68-ace7-44e314c6fc42 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036534 Sep 24 21:03:45.197441 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1865/3780] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:03:45.203708 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-66d18de2-8cf8-472d-aa6f-aea48a4010ff tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:45.204637 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-66d18de2-8cf8-472d-aa6f-aea48a4010ff tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:45.212838 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66d18de2-8cf8-472d-aa6f-aea48a4010ff tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:45.213339 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66d18de2-8cf8-472d-aa6f-aea48a4010ff tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:45.213791 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66d18de2-8cf8-472d-aa6f-aea48a4010ff tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:45.214537 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66d18de2-8cf8-472d-aa6f-aea48a4010ff tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:45.214999 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66d18de2-8cf8-472d-aa6f-aea48a4010ff tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:45.215782 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66d18de2-8cf8-472d-aa6f-aea48a4010ff tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:45.807458 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-66d18de2-8cf8-472d-aa6f-aea48a4010ff tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:45.818442 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-66d18de2-8cf8-472d-aa6f-aea48a4010ff tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1321 microversion: 2.1 time: 0.619006 Sep 24 21:03:45.838589 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1866/3781] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:45 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1321 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:45.845691 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4f547ae4-8566-4665-ad70-954725b4ec3c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:45.852872 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4f547ae4-8566-4665-ad70-954725b4ec3c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 40178212-5f30-4d39-80a4-b92306531580] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:45.862792 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4f547ae4-8566-4665-ad70-954725b4ec3c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:45.863626 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4f547ae4-8566-4665-ad70-954725b4ec3c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:45.864385 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4f547ae4-8566-4665-ad70-954725b4ec3c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:45.866004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4f547ae4-8566-4665-ad70-954725b4ec3c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:45.867259 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4f547ae4-8566-4665-ad70-954725b4ec3c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:45.868799 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4f547ae4-8566-4665-ad70-954725b4ec3c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:45.943348 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4f547ae4-8566-4665-ad70-954725b4ec3c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "POST /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580/action" status: 200 len: 14 microversion: 2.1 time: 0.101055 Sep 24 21:03:45.945149 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1867/3782] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:03:45 2022] POST /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 21:03:45.964275 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1adac919-d5a6-40bc-934c-96fbcdadfea6 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:45.965835 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1adac919-d5a6-40bc-934c-96fbcdadfea6 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] [instance: b6106703-7709-41ea-a56c-935391c05827] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:45.975111 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1adac919-d5a6-40bc-934c-96fbcdadfea6 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:45.975867 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1adac919-d5a6-40bc-934c-96fbcdadfea6 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:45.976757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1adac919-d5a6-40bc-934c-96fbcdadfea6 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:45.977990 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1adac919-d5a6-40bc-934c-96fbcdadfea6 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:45.978697 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1adac919-d5a6-40bc-934c-96fbcdadfea6 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:45.979961 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1adac919-d5a6-40bc-934c-96fbcdadfea6 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:46.324027 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-f821a359-de74-4b51-abef-9c4e243a5569 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:03:46.324565 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-f821a359-de74-4b51-abef-9c4e243a5569 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:03:46.325094 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-f821a359-de74-4b51-abef-9c4e243a5569 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:03:46.325515 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-f821a359-de74-4b51-abef-9c4e243a5569 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:03:46.325939 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-f821a359-de74-4b51-abef-9c4e243a5569 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:03:46.335180 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f821a359-de74-4b51-abef-9c4e243a5569 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:46.335723 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f821a359-de74-4b51-abef-9c4e243a5569 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:46.336813 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f821a359-de74-4b51-abef-9c4e243a5569 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:46.337669 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f821a359-de74-4b51-abef-9c4e243a5569 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:46.338365 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f821a359-de74-4b51-abef-9c4e243a5569 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:46.338834 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f821a359-de74-4b51-abef-9c4e243a5569 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:46.357952 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-f821a359-de74-4b51-abef-9c4e243a5569 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Getting quotas for project accafa2724354ca8b1c9f19940989429. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:03:46.364139 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-f821a359-de74-4b51-abef-9c4e243a5569 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Getting quotas for user e557d91b49c143499d809a55e85932fd and project accafa2724354ca8b1c9f19940989429. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:03:46.377729 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f821a359-de74-4b51-abef-9c4e243a5569 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:03:46.380207 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f821a359-de74-4b51-abef-9c4e243a5569 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 66e31e89-34c3-4cf9-b35d-8084f9c5a509] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:03:46.428663 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f821a359-de74-4b51-abef-9c4e243a5569 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.216564 Sep 24 21:03:46.435729 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1916/3783] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:03:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2218 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:03:46.435729 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-aa9edc59-598d-4243-a345-69441ad23207 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:46.435729 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-aa9edc59-598d-4243-a345-69441ad23207 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:46.442535 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa9edc59-598d-4243-a345-69441ad23207 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:46.443372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa9edc59-598d-4243-a345-69441ad23207 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:46.443525 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa9edc59-598d-4243-a345-69441ad23207 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:46.444665 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa9edc59-598d-4243-a345-69441ad23207 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:46.444665 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa9edc59-598d-4243-a345-69441ad23207 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:46.445104 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa9edc59-598d-4243-a345-69441ad23207 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:46.612165 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-aa9edc59-598d-4243-a345-69441ad23207 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:46.632118 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-aa9edc59-598d-4243-a345-69441ad23207 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1279 microversion: 2.1 time: 0.201128 Sep 24 21:03:46.643107 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1917/3784] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:46 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1279 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:46.654597 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e7b9d66a-f83a-42f8-aff3-6a298acada7d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:46.655047 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e7b9d66a-f83a-42f8-aff3-6a298acada7d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 66e31e89-34c3-4cf9-b35d-8084f9c5a509] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:46.671976 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:03:46.686112 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e7b9d66a-f83a-42f8-aff3-6a298acada7d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 66e31e89-34c3-4cf9-b35d-8084f9c5a509] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:03:46.727541 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1adac919-d5a6-40bc-934c-96fbcdadfea6 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7654d225081948cabad9d2cdbf03ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d75184d9cd4fed89c0e1d0d5d910fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:46.740925 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1adac919-d5a6-40bc-934c-96fbcdadfea6 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "GET /compute/v2.1/servers/b6106703-7709-41ea-a56c-935391c05827" status: 200 len: 1312 microversion: 2.1 time: 0.782708 Sep 24 21:03:46.756986 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1868/3785] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:45 2022] GET /compute/v2.1/servers/b6106703-7709-41ea-a56c-935391c05827 => generated 1312 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:46.847598 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-70e78724-8d1d-400e-a0f0-57bbdbdba775 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:46.848279 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-70e78724-8d1d-400e-a0f0-57bbdbdba775 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:46.856876 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-70e78724-8d1d-400e-a0f0-57bbdbdba775 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:46.858225 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-70e78724-8d1d-400e-a0f0-57bbdbdba775 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:46.859219 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-70e78724-8d1d-400e-a0f0-57bbdbdba775 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:46.860403 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-70e78724-8d1d-400e-a0f0-57bbdbdba775 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:46.861361 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-70e78724-8d1d-400e-a0f0-57bbdbdba775 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:46.862150 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-70e78724-8d1d-400e-a0f0-57bbdbdba775 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:46.865859 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.scheduler.client.report [None req-e7b9d66a-f83a-42f8-aff3-6a298acada7d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Deleted allocations for instance 66e31e89-34c3-4cf9-b35d-8084f9c5a509 Sep 24 21:03:46.873125 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.compute.api [None req-e7b9d66a-f83a-42f8-aff3-6a298acada7d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 66e31e89-34c3-4cf9-b35d-8084f9c5a509] Instance Mapping does not exist while attempting local delete cleanup. Sep 24 21:03:46.875010 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e7b9d66a-f83a-42f8-aff3-6a298acada7d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "DELETE /compute/v2.1/servers/66e31e89-34c3-4cf9-b35d-8084f9c5a509" status: 204 len: 0 microversion: 2.1 time: 0.230870 Sep 24 21:03:46.876163 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1918/3786] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:03:46 2022] DELETE /compute/v2.1/servers/66e31e89-34c3-4cf9-b35d-8084f9c5a509 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:03:46.885235 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c103efe2-8b3e-49d2-984c-42c897d873b2 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:46.885872 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c103efe2-8b3e-49d2-984c-42c897d873b2 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 66e31e89-34c3-4cf9-b35d-8084f9c5a509] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:46.891773 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-c103efe2-8b3e-49d2-984c-42c897d873b2 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] HTTP exception thrown: Instance 66e31e89-34c3-4cf9-b35d-8084f9c5a509 could not be found. Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c103efe2-8b3e-49d2-984c-42c897d873b2 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Request method failure captured: Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/66e31e89-34c3-4cf9-b35d-8084f9c5a509 HTTP/1.1 Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3CaLUabI_YBYC2XnM21T8dL5FNXXvceQt6A3bijM2xUqNxa7o1mArSf5dFDgPeh3vgkyUYVZenobpLU3uEqGcvnEbw-nMZfSWEM5OkDmeYEccMJ8-yhXeZa1T-3DnHpo2MRC1ewpBuezwDhE04pucSEH5uW1HzlM0IgaFpEaRXllaA Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersTestJSON-1457868986 Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersTestJSON-1457868986-project Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: e557d91b49c143499d809a55e85932fd Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersTestJSON-1457868986-project Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 66e31e89-34c3-4cf9-b35d-8084f9c5a509 could not be found. Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '66e31e89-34c3-4cf9-b35d-8084f9c5a509'} Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66e31e89-34c3-4cf9-b35d-8084f9c5a509 could not be found. Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66e31e89-34c3-4cf9-b35d-8084f9c5a509 could not be found. Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:46.893411 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:03:46.898173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:03:46.898173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:03:46.898173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:03:46.898173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66e31e89-34c3-4cf9-b35d-8084f9c5a509 could not be found. Sep 24 21:03:46.898173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:03:46.899538 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c103efe2-8b3e-49d2-984c-42c897d873b2 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Returning 404 to user: Instance 66e31e89-34c3-4cf9-b35d-8084f9c5a509 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:03:46.900702 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c103efe2-8b3e-49d2-984c-42c897d873b2 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/66e31e89-34c3-4cf9-b35d-8084f9c5a509" status: 404 len: 111 microversion: 2.1 time: 0.020377 Sep 24 21:03:46.901754 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1919/3787] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:46 2022] GET /compute/v2.1/servers/66e31e89-34c3-4cf9-b35d-8084f9c5a509 => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:03:46.956029 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7dd9cce8-dc0c-4dbe-946b-052096754eca tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:46.958210 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7dd9cce8-dc0c-4dbe-946b-052096754eca tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 40178212-5f30-4d39-80a4-b92306531580] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:46.971673 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7dd9cce8-dc0c-4dbe-946b-052096754eca tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:46.972515 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7dd9cce8-dc0c-4dbe-946b-052096754eca tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:46.973128 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7dd9cce8-dc0c-4dbe-946b-052096754eca tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:46.973843 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7dd9cce8-dc0c-4dbe-946b-052096754eca tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:46.974509 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7dd9cce8-dc0c-4dbe-946b-052096754eca tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:46.975310 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7dd9cce8-dc0c-4dbe-946b-052096754eca tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:47.147730 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7dd9cce8-dc0c-4dbe-946b-052096754eca tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "POST /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580/action" status: 200 len: 14 microversion: 2.1 time: 0.195502 Sep 24 21:03:47.149108 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1920/3788] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:03:46 2022] POST /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580/action => generated 14 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 24 21:03:47.156517 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f92dbde9-48fb-4f5b-9de4-8934daa76588 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1921494112", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "86ee1dec-a957-4cc1-98d2-2e275615c01a"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:47.250109 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-f92dbde9-48fb-4f5b-9de4-8934daa76588 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] validate_networks() for [('86ee1dec-a957-4cc1-98d2-2e275615c01a', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:03:47.372385 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-70e78724-8d1d-400e-a0f0-57bbdbdba775 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:47.380715 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-70e78724-8d1d-400e-a0f0-57bbdbdba775 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1321 microversion: 2.1 time: 0.541094 Sep 24 21:03:47.381542 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1869/3789] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:46 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1321 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:47.661008 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1f729c49-5310-462e-9515-c007081635b9 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:47.661814 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1f729c49-5310-462e-9515-c007081635b9 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:47.669306 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1f729c49-5310-462e-9515-c007081635b9 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:47.669863 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1f729c49-5310-462e-9515-c007081635b9 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:47.670715 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1f729c49-5310-462e-9515-c007081635b9 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:47.671524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1f729c49-5310-462e-9515-c007081635b9 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:47.672077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1f729c49-5310-462e-9515-c007081635b9 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:47.672717 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1f729c49-5310-462e-9515-c007081635b9 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:48.552961 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1f729c49-5310-462e-9515-c007081635b9 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:48.563073 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1f729c49-5310-462e-9515-c007081635b9 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1321 microversion: 2.1 time: 0.906199 Sep 24 21:03:48.563660 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1870/3790] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:47 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1321 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:48.579205 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-45c6ae54-db51-4bd2-b2c3-113d09dee760 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:48.579818 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-45c6ae54-db51-4bd2-b2c3-113d09dee760 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] [instance: b6106703-7709-41ea-a56c-935391c05827] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:48.587537 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45c6ae54-db51-4bd2-b2c3-113d09dee760 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:48.588085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45c6ae54-db51-4bd2-b2c3-113d09dee760 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:48.589157 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45c6ae54-db51-4bd2-b2c3-113d09dee760 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:48.591375 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45c6ae54-db51-4bd2-b2c3-113d09dee760 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:48.592101 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45c6ae54-db51-4bd2-b2c3-113d09dee760 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:48.592597 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45c6ae54-db51-4bd2-b2c3-113d09dee760 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:49.058623 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-f92dbde9-48fb-4f5b-9de4-8934daa76588 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:03:49.059711 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-f92dbde9-48fb-4f5b-9de4-8934daa76588 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:03:49.060134 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-f92dbde9-48fb-4f5b-9de4-8934daa76588 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:03:49.060736 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-f92dbde9-48fb-4f5b-9de4-8934daa76588 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:03:49.061346 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-f92dbde9-48fb-4f5b-9de4-8934daa76588 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:03:49.071618 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f92dbde9-48fb-4f5b-9de4-8934daa76588 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:49.072111 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f92dbde9-48fb-4f5b-9de4-8934daa76588 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:49.072754 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f92dbde9-48fb-4f5b-9de4-8934daa76588 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:49.074164 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f92dbde9-48fb-4f5b-9de4-8934daa76588 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:49.074697 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f92dbde9-48fb-4f5b-9de4-8934daa76588 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:49.075142 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f92dbde9-48fb-4f5b-9de4-8934daa76588 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:49.102824 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-f92dbde9-48fb-4f5b-9de4-8934daa76588 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Getting quotas for project accafa2724354ca8b1c9f19940989429. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:03:49.109442 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-f92dbde9-48fb-4f5b-9de4-8934daa76588 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Getting quotas for user e557d91b49c143499d809a55e85932fd and project accafa2724354ca8b1c9f19940989429. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:03:49.124267 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f92dbde9-48fb-4f5b-9de4-8934daa76588 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:03:49.127069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f92dbde9-48fb-4f5b-9de4-8934daa76588 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ff3106d1-5214-48ea-857b-fd505d8712c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:03:49.190680 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f92dbde9-48fb-4f5b-9de4-8934daa76588 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.039735 Sep 24 21:03:49.198361 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1921/3791] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:03:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:03:49.203984 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0455f804-346b-4f77-aa1a-9ab47704eca3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:49.206647 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0455f804-346b-4f77-aa1a-9ab47704eca3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 40178212-5f30-4d39-80a4-b92306531580] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:49.213707 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-45c6ae54-db51-4bd2-b2c3-113d09dee760 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7654d225081948cabad9d2cdbf03ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d75184d9cd4fed89c0e1d0d5d910fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:49.215556 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0455f804-346b-4f77-aa1a-9ab47704eca3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:49.216347 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0455f804-346b-4f77-aa1a-9ab47704eca3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:49.216970 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0455f804-346b-4f77-aa1a-9ab47704eca3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:49.218043 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0455f804-346b-4f77-aa1a-9ab47704eca3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:49.218900 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0455f804-346b-4f77-aa1a-9ab47704eca3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:49.219504 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0455f804-346b-4f77-aa1a-9ab47704eca3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:49.239280 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-45c6ae54-db51-4bd2-b2c3-113d09dee760 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "GET /compute/v2.1/servers/b6106703-7709-41ea-a56c-935391c05827" status: 200 len: 1312 microversion: 2.1 time: 0.661757 Sep 24 21:03:49.254525 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1871/3792] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:48 2022] GET /compute/v2.1/servers/b6106703-7709-41ea-a56c-935391c05827 => generated 1312 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:49.282048 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-eb8b5474-3e07-4c2e-a535-2e9c3289b0d1 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:49.285242 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-eb8b5474-3e07-4c2e-a535-2e9c3289b0d1 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:49.292467 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb8b5474-3e07-4c2e-a535-2e9c3289b0d1 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:49.294311 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb8b5474-3e07-4c2e-a535-2e9c3289b0d1 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:49.294987 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb8b5474-3e07-4c2e-a535-2e9c3289b0d1 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:49.296045 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb8b5474-3e07-4c2e-a535-2e9c3289b0d1 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:49.296761 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb8b5474-3e07-4c2e-a535-2e9c3289b0d1 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:49.298067 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb8b5474-3e07-4c2e-a535-2e9c3289b0d1 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:49.326616 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0455f804-346b-4f77-aa1a-9ab47704eca3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "POST /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580/action" status: 200 len: 16400 microversion: 2.1 time: 0.126538 Sep 24 21:03:49.327505 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1922/3793] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:03:49 2022] POST /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580/action => generated 16400 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:03:49.344033 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-37c3dc64-3c31-4c38-bbb7-1d7d37fa264c tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:49.347462 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-37c3dc64-3c31-4c38-bbb7-1d7d37fa264c tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ff3106d1-5214-48ea-857b-fd505d8712c7] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:49.581657 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-37c3dc64-3c31-4c38-bbb7-1d7d37fa264c tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:49.591382 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-37c3dc64-3c31-4c38-bbb7-1d7d37fa264c tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/ff3106d1-5214-48ea-857b-fd505d8712c7" status: 200 len: 1221 microversion: 2.1 time: 0.257666 Sep 24 21:03:49.593677 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1923/3794] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:49 2022] GET /compute/v2.1/servers/ff3106d1-5214-48ea-857b-fd505d8712c7 => generated 1221 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:49.599144 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fff26bb5-92bc-4fcf-8596-742c4cd82e1c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:49.604235 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fff26bb5-92bc-4fcf-8596-742c4cd82e1c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:49.615702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fff26bb5-92bc-4fcf-8596-742c4cd82e1c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:49.622153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fff26bb5-92bc-4fcf-8596-742c4cd82e1c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:49.625373 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fff26bb5-92bc-4fcf-8596-742c4cd82e1c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:49.627242 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fff26bb5-92bc-4fcf-8596-742c4cd82e1c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:49.627962 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fff26bb5-92bc-4fcf-8596-742c4cd82e1c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:49.628629 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fff26bb5-92bc-4fcf-8596-742c4cd82e1c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:49.880152 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-eb8b5474-3e07-4c2e-a535-2e9c3289b0d1 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:49.883357 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:03:49.890940 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-eb8b5474-3e07-4c2e-a535-2e9c3289b0d1 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1321 microversion: 2.1 time: 0.647445 Sep 24 21:03:49.891536 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1872/3795] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:49 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1321 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:49.910555 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4b0c5d49-5512-4478-be76-c64552469e7f tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:49.911486 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4b0c5d49-5512-4478-be76-c64552469e7f tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:49.928432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4b0c5d49-5512-4478-be76-c64552469e7f tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:49.929194 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4b0c5d49-5512-4478-be76-c64552469e7f tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:49.930385 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4b0c5d49-5512-4478-be76-c64552469e7f tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:49.931157 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4b0c5d49-5512-4478-be76-c64552469e7f tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:49.931658 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4b0c5d49-5512-4478-be76-c64552469e7f tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:49.932281 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4b0c5d49-5512-4478-be76-c64552469e7f tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:50.544608 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fff26bb5-92bc-4fcf-8596-742c4cd82e1c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:50.557932 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fff26bb5-92bc-4fcf-8596-742c4cd82e1c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.962908 Sep 24 21:03:50.563858 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1924/3796] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:49 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:50.568964 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d6b62e22-bee6-4852-ac0e-746405591c01 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:50.571691 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d6b62e22-bee6-4852-ac0e-746405591c01 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] [instance: b6106703-7709-41ea-a56c-935391c05827] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:50.580641 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d6b62e22-bee6-4852-ac0e-746405591c01 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:50.587066 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d6b62e22-bee6-4852-ac0e-746405591c01 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:50.587795 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d6b62e22-bee6-4852-ac0e-746405591c01 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:50.595823 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d6b62e22-bee6-4852-ac0e-746405591c01 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:50.596227 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d6b62e22-bee6-4852-ac0e-746405591c01 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:50.596680 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d6b62e22-bee6-4852-ac0e-746405591c01 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:50.745331 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4b0c5d49-5512-4478-be76-c64552469e7f tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:50.763421 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4b0c5d49-5512-4478-be76-c64552469e7f tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1321 microversion: 2.1 time: 0.866764 Sep 24 21:03:50.764710 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1873/3797] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:49 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1321 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:50.769555 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-73d0041b-da9b-4b6f-aa46-98c60f390eac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:50.770401 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-73d0041b-da9b-4b6f-aa46-98c60f390eac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:50.779495 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-73d0041b-da9b-4b6f-aa46-98c60f390eac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:50.783798 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-73d0041b-da9b-4b6f-aa46-98c60f390eac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:50.784458 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-73d0041b-da9b-4b6f-aa46-98c60f390eac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:50.785974 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-73d0041b-da9b-4b6f-aa46-98c60f390eac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:50.790803 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-73d0041b-da9b-4b6f-aa46-98c60f390eac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:50.791465 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-73d0041b-da9b-4b6f-aa46-98c60f390eac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:51.112465 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d6b62e22-bee6-4852-ac0e-746405591c01 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7654d225081948cabad9d2cdbf03ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d75184d9cd4fed89c0e1d0d5d910fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:51.123462 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d6b62e22-bee6-4852-ac0e-746405591c01 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "GET /compute/v2.1/servers/b6106703-7709-41ea-a56c-935391c05827" status: 200 len: 1312 microversion: 2.1 time: 0.558182 Sep 24 21:03:51.124273 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1925/3798] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:50 2022] GET /compute/v2.1/servers/b6106703-7709-41ea-a56c-935391c05827 => generated 1312 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:51.143801 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d6337f52-8b5f-48a9-8598-236c33e9ef5b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:51.144532 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d6337f52-8b5f-48a9-8598-236c33e9ef5b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ff3106d1-5214-48ea-857b-fd505d8712c7] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:51.153896 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d6337f52-8b5f-48a9-8598-236c33e9ef5b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:51.154705 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d6337f52-8b5f-48a9-8598-236c33e9ef5b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:51.155352 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d6337f52-8b5f-48a9-8598-236c33e9ef5b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:51.156075 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d6337f52-8b5f-48a9-8598-236c33e9ef5b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:51.156543 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d6337f52-8b5f-48a9-8598-236c33e9ef5b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:51.156981 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d6337f52-8b5f-48a9-8598-236c33e9ef5b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:51.268574 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-73d0041b-da9b-4b6f-aa46-98c60f390eac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:51.276372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d6337f52-8b5f-48a9-8598-236c33e9ef5b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:51.284342 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-73d0041b-da9b-4b6f-aa46-98c60f390eac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.518358 Sep 24 21:03:51.289676 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1874/3799] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:50 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:51.291873 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d6337f52-8b5f-48a9-8598-236c33e9ef5b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/ff3106d1-5214-48ea-857b-fd505d8712c7" status: 200 len: 1273 microversion: 2.1 time: 0.154454 Sep 24 21:03:51.292466 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1926/3800] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:51 2022] GET /compute/v2.1/servers/ff3106d1-5214-48ea-857b-fd505d8712c7 => generated 1273 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:51.303186 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9f3101b8-15a9-414b-8494-ff11fd5e55e5 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:51.304139 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9f3101b8-15a9-414b-8494-ff11fd5e55e5 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:51.311119 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f3101b8-15a9-414b-8494-ff11fd5e55e5 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:51.311956 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f3101b8-15a9-414b-8494-ff11fd5e55e5 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:51.312627 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f3101b8-15a9-414b-8494-ff11fd5e55e5 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:51.313581 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f3101b8-15a9-414b-8494-ff11fd5e55e5 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:51.314245 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f3101b8-15a9-414b-8494-ff11fd5e55e5 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:51.315081 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f3101b8-15a9-414b-8494-ff11fd5e55e5 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:51.342237 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a2d154d2-e416-417b-8b99-1b7a0a4092a7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:51.343454 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a2d154d2-e416-417b-8b99-1b7a0a4092a7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:51.353400 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2d154d2-e416-417b-8b99-1b7a0a4092a7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:51.354173 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2d154d2-e416-417b-8b99-1b7a0a4092a7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:51.354966 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2d154d2-e416-417b-8b99-1b7a0a4092a7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:51.355867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2d154d2-e416-417b-8b99-1b7a0a4092a7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:51.356489 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2d154d2-e416-417b-8b99-1b7a0a4092a7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:51.357126 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2d154d2-e416-417b-8b99-1b7a0a4092a7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:51.949453 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9f3101b8-15a9-414b-8494-ff11fd5e55e5 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:51.967243 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9f3101b8-15a9-414b-8494-ff11fd5e55e5 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1321 microversion: 2.1 time: 0.676205 Sep 24 21:03:51.968380 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1875/3801] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:51 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1321 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:51.973111 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-87c7528e-a10a-44fb-b890-48eedf354f9a req-6d40ed08-71d9-4bb7-b304-3cfc59da8983 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b2e4ce4-809e-4888-8205-eae021e2fb8c", "tag": "463ee47f-dd1b-4d52-b5e6-b06f1390b340"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:51.990720 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-87c7528e-a10a-44fb-b890-48eedf354f9a req-6d40ed08-71d9-4bb7-b304-3cfc59da8983 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:51.991453 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-87c7528e-a10a-44fb-b890-48eedf354f9a req-6d40ed08-71d9-4bb7-b304-3cfc59da8983 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:51.992188 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-87c7528e-a10a-44fb-b890-48eedf354f9a req-6d40ed08-71d9-4bb7-b304-3cfc59da8983 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:51.992661 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a2d154d2-e416-417b-8b99-1b7a0a4092a7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:52.001218 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a2d154d2-e416-417b-8b99-1b7a0a4092a7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.668597 Sep 24 21:03:52.002028 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1927/3802] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:51 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:03:52.020203 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-121a5cac-e56a-428b-9b16-dbea7cc98fc2 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:52.020852 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-121a5cac-e56a-428b-9b16-dbea7cc98fc2 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:52.026289 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-87c7528e-a10a-44fb-b890-48eedf354f9a req-6d40ed08-71d9-4bb7-b304-3cfc59da8983 service nova] Creating event network-changed:463ee47f-dd1b-4d52-b5e6-b06f1390b340 for instance 1b2e4ce4-809e-4888-8205-eae021e2fb8c on nch1-master-1 Sep 24 21:03:52.028489 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-121a5cac-e56a-428b-9b16-dbea7cc98fc2 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:52.032094 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-121a5cac-e56a-428b-9b16-dbea7cc98fc2 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:52.032561 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-121a5cac-e56a-428b-9b16-dbea7cc98fc2 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:52.033578 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-121a5cac-e56a-428b-9b16-dbea7cc98fc2 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:52.034055 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-121a5cac-e56a-428b-9b16-dbea7cc98fc2 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:52.034522 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-121a5cac-e56a-428b-9b16-dbea7cc98fc2 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:52.043131 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-87c7528e-a10a-44fb-b890-48eedf354f9a req-6d40ed08-71d9-4bb7-b304-3cfc59da8983 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072942 Sep 24 21:03:52.046810 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1876/3803] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:03:52.056330 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e379d5a5-f98f-41b3-9cf6-c52a8d5d8468 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:52.057617 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e379d5a5-f98f-41b3-9cf6-c52a8d5d8468 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:52.064161 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=36 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:03:52.068330 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e379d5a5-f98f-41b3-9cf6-c52a8d5d8468 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:52.069260 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e379d5a5-f98f-41b3-9cf6-c52a8d5d8468 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:52.071514 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e379d5a5-f98f-41b3-9cf6-c52a8d5d8468 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:52.072930 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e379d5a5-f98f-41b3-9cf6-c52a8d5d8468 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:52.073886 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e379d5a5-f98f-41b3-9cf6-c52a8d5d8468 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:52.074964 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e379d5a5-f98f-41b3-9cf6-c52a8d5d8468 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:52.596055 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e379d5a5-f98f-41b3-9cf6-c52a8d5d8468 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:52.607024 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e379d5a5-f98f-41b3-9cf6-c52a8d5d8468 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.558850 Sep 24 21:03:52.607631 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1877/3804] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:52 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:52.623924 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9064a86d-d12b-47d8-8da4-b585df4fe010 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:52.624808 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9064a86d-d12b-47d8-8da4-b585df4fe010 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] [instance: b6106703-7709-41ea-a56c-935391c05827] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:52.646554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9064a86d-d12b-47d8-8da4-b585df4fe010 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:52.649414 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9064a86d-d12b-47d8-8da4-b585df4fe010 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:52.657388 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-121a5cac-e56a-428b-9b16-dbea7cc98fc2 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:52.662549 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9064a86d-d12b-47d8-8da4-b585df4fe010 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:52.665796 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9064a86d-d12b-47d8-8da4-b585df4fe010 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:52.666671 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9064a86d-d12b-47d8-8da4-b585df4fe010 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:52.667356 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9064a86d-d12b-47d8-8da4-b585df4fe010 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:52.693517 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-121a5cac-e56a-428b-9b16-dbea7cc98fc2 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1321 microversion: 2.1 time: 0.685764 Sep 24 21:03:52.706614 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1928/3805] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:52 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1321 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:52.706614 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8316a5f7-6829-43ca-89fc-49101ae7a947 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:52.709113 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8316a5f7-6829-43ca-89fc-49101ae7a947 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ff3106d1-5214-48ea-857b-fd505d8712c7] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:52.727810 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8316a5f7-6829-43ca-89fc-49101ae7a947 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:52.728371 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8316a5f7-6829-43ca-89fc-49101ae7a947 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:52.728825 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8316a5f7-6829-43ca-89fc-49101ae7a947 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:52.730310 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8316a5f7-6829-43ca-89fc-49101ae7a947 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:52.730802 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8316a5f7-6829-43ca-89fc-49101ae7a947 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:52.731233 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8316a5f7-6829-43ca-89fc-49101ae7a947 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:53.200023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9064a86d-d12b-47d8-8da4-b585df4fe010 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7654d225081948cabad9d2cdbf03ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d75184d9cd4fed89c0e1d0d5d910fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:53.208710 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9064a86d-d12b-47d8-8da4-b585df4fe010 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "GET /compute/v2.1/servers/b6106703-7709-41ea-a56c-935391c05827" status: 200 len: 1312 microversion: 2.1 time: 0.592537 Sep 24 21:03:53.233217 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1878/3806] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:52 2022] GET /compute/v2.1/servers/b6106703-7709-41ea-a56c-935391c05827 => generated 1312 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:53.239229 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8316a5f7-6829-43ca-89fc-49101ae7a947 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:53.239774 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fd3c46ee-bd8e-455a-bdd0-b947333c71ed tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:53.240816 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fd3c46ee-bd8e-455a-bdd0-b947333c71ed tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:53.243843 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:03:53.250034 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd3c46ee-bd8e-455a-bdd0-b947333c71ed tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:53.250839 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd3c46ee-bd8e-455a-bdd0-b947333c71ed tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:53.251746 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd3c46ee-bd8e-455a-bdd0-b947333c71ed tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:53.251959 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8316a5f7-6829-43ca-89fc-49101ae7a947 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/ff3106d1-5214-48ea-857b-fd505d8712c7" status: 200 len: 1321 microversion: 2.1 time: 0.555199 Sep 24 21:03:53.253166 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd3c46ee-bd8e-455a-bdd0-b947333c71ed tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:53.254013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd3c46ee-bd8e-455a-bdd0-b947333c71ed tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:53.254706 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd3c46ee-bd8e-455a-bdd0-b947333c71ed tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:53.256203 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1929/3807] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:52 2022] GET /compute/v2.1/servers/ff3106d1-5214-48ea-857b-fd505d8712c7 => generated 1321 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:53.264882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b27eef22-64c0-452f-9da5-3705e35238ca tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:53.268212 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b27eef22-64c0-452f-9da5-3705e35238ca tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:53.299662 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b27eef22-64c0-452f-9da5-3705e35238ca tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:53.300540 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b27eef22-64c0-452f-9da5-3705e35238ca tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:53.300993 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b27eef22-64c0-452f-9da5-3705e35238ca tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:53.301847 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b27eef22-64c0-452f-9da5-3705e35238ca tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:53.302317 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b27eef22-64c0-452f-9da5-3705e35238ca tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:53.302832 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b27eef22-64c0-452f-9da5-3705e35238ca tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:53.339541 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fd3c46ee-bd8e-455a-bdd0-b947333c71ed tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Locking {{(pid=140517) lock /opt/stack/nova/nova/compute/api.py:4845}} Sep 24 21:03:53.409460 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fd3c46ee-bd8e-455a-bdd0-b947333c71ed tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "POST /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/action" status: 202 len: 0 microversion: 2.1 time: 0.174877 Sep 24 21:03:53.410147 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1879/3808] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:03:53 2022] POST /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:03:53.425788 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-44c4ceeb-e009-4a14-8a5c-5b180c521220 req-4f1d431a-279b-414e-b884-7b87161a77fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6106703-7709-41ea-a56c-935391c05827", "name": "network-vif-plugged", "status": "completed", "tag": "19e3d6bb-23c8-4195-b009-14e01e93950c"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:53.442802 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-44c4ceeb-e009-4a14-8a5c-5b180c521220 req-4f1d431a-279b-414e-b884-7b87161a77fa service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:53.443704 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-44c4ceeb-e009-4a14-8a5c-5b180c521220 req-4f1d431a-279b-414e-b884-7b87161a77fa service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:53.445043 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-44c4ceeb-e009-4a14-8a5c-5b180c521220 req-4f1d431a-279b-414e-b884-7b87161a77fa service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:53.469848 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-44c4ceeb-e009-4a14-8a5c-5b180c521220 req-4f1d431a-279b-414e-b884-7b87161a77fa service nova] Creating event network-vif-plugged:19e3d6bb-23c8-4195-b009-14e01e93950c for instance b6106703-7709-41ea-a56c-935391c05827 on nch2-master-1 Sep 24 21:03:53.475324 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-44c4ceeb-e009-4a14-8a5c-5b180c521220 req-4f1d431a-279b-414e-b884-7b87161a77fa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063977 Sep 24 21:03:53.476412 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1880/3809] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:03:53.485525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0596c0e8-41ca-4af6-ae68-bc243ff5242e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:53.486730 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0596c0e8-41ca-4af6-ae68-bc243ff5242e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:53.495187 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0596c0e8-41ca-4af6-ae68-bc243ff5242e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:53.496178 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0596c0e8-41ca-4af6-ae68-bc243ff5242e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:53.496553 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0596c0e8-41ca-4af6-ae68-bc243ff5242e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:53.497351 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0596c0e8-41ca-4af6-ae68-bc243ff5242e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:53.498320 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0596c0e8-41ca-4af6-ae68-bc243ff5242e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:53.499064 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0596c0e8-41ca-4af6-ae68-bc243ff5242e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:53.545648 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b27eef22-64c0-452f-9da5-3705e35238ca tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:53.563475 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b27eef22-64c0-452f-9da5-3705e35238ca tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1321 microversion: 2.1 time: 0.305918 Sep 24 21:03:53.583353 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1930/3810] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:53 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1321 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:53.705715 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0596c0e8-41ca-4af6-ae68-bc243ff5242e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:53.725493 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-736f83d8-464a-4a8b-8cd5-b45396c3f526 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:53.726293 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-736f83d8-464a-4a8b-8cd5-b45396c3f526 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:53.728632 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0596c0e8-41ca-4af6-ae68-bc243ff5242e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.248124 Sep 24 21:03:53.738598 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1881/3811] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:53 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:53.738867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-736f83d8-464a-4a8b-8cd5-b45396c3f526 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:53.738867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-736f83d8-464a-4a8b-8cd5-b45396c3f526 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:53.738867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-736f83d8-464a-4a8b-8cd5-b45396c3f526 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:53.738867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-736f83d8-464a-4a8b-8cd5-b45396c3f526 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:53.738867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-736f83d8-464a-4a8b-8cd5-b45396c3f526 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:53.738867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-736f83d8-464a-4a8b-8cd5-b45396c3f526 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:53.763936 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c327569f-205b-4ac4-9515-591346e8208b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:53.776995 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c327569f-205b-4ac4-9515-591346e8208b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:53.777652 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c327569f-205b-4ac4-9515-591346e8208b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:53.778167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c327569f-205b-4ac4-9515-591346e8208b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:53.806873 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-c327569f-205b-4ac4-9515-591346e8208b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] HTTP exception thrown: Instance 0d546302-deb3-47c6-b9fd-3155ced00883 is locked Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c327569f-205b-4ac4-9515-591346e8208b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Request method failure captured: Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/action HTTP/1.1 Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 15 Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL29yHrVYRYwVIMWo2FFW4S-9sOLnTcN4ZPz2bIXXtjP3hR_rvMAsvdLWM0kalFDPOwMk_M10lFN-gbxnQwiJu4TSxB4ycd3rCGdKr5Nw8GDIx9wcghUlARhBCrxFGL7o-GhjN7quWX5q6oNDb9ZRd-9sEHZ12a6ieFkQm4pZttrgvsw Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: c1e5d6f3d41e4aa49e630f8c7ac87ded Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServerActionsTestJSON-1880156492 Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c1e5d6f3d41e4aa49e630f8c7ac87ded"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c1e5d6f3d41e4aa49e630f8c7ac87ded"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c1e5d6f3d41e4aa49e630f8c7ac87ded"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c1e5d6f3d41e4aa49e630f8c7ac87ded"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServerActionsTestJSON-1880156492 Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: c1e5d6f3d41e4aa49e630f8c7ac87ded Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServerActionsTestJSON-1880156492 Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServerActionsTestJSON-1880156492-project Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 6493da825aa24f43bdf8f0835a16e3bb Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServerActionsTestJSON-1880156492-project Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: {"os-stop": {}} Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 0d546302-deb3-47c6-b9fd-3155ced00883 is locked Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '0d546302-deb3-47c6-b9fd-3155ced00883', 'body': {'os-stop': {}}} Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 0d546302-deb3-47c6-b9fd-3155ced00883 is locked Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 0d546302-deb3-47c6-b9fd-3155ced00883 is locked Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d546302-deb3-47c6-b9fd-3155ced00883 is locked Sep 24 21:03:53.811717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:03:53.816222 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c327569f-205b-4ac4-9515-591346e8208b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Returning 409 to user: Instance 0d546302-deb3-47c6-b9fd-3155ced00883 is locked {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:03:53.816222 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c327569f-205b-4ac4-9515-591346e8208b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "POST /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/action" status: 409 len: 107 microversion: 2.1 time: 0.056563 Sep 24 21:03:53.816222 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1882/3812] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:03:53 2022] POST /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/action => generated 107 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 24 21:03:53.823875 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7e384b5e-8930-4d1d-9acb-ffda010e74b8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:53.824437 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7e384b5e-8930-4d1d-9acb-ffda010e74b8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:53.831206 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7e384b5e-8930-4d1d-9acb-ffda010e74b8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:53.831708 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7e384b5e-8930-4d1d-9acb-ffda010e74b8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:53.832158 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7e384b5e-8930-4d1d-9acb-ffda010e74b8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:53.832881 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7e384b5e-8930-4d1d-9acb-ffda010e74b8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:53.833344 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7e384b5e-8930-4d1d-9acb-ffda010e74b8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:53.833776 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7e384b5e-8930-4d1d-9acb-ffda010e74b8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:53.893467 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7e384b5e-8930-4d1d-9acb-ffda010e74b8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Unlocking {{(pid=140517) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 24 21:03:53.992995 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7e384b5e-8930-4d1d-9acb-ffda010e74b8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "POST /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/action" status: 202 len: 0 microversion: 2.1 time: 0.172295 Sep 24 21:03:54.000790 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1883/3813] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:03:53 2022] POST /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:03:54.008554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fccd64f8-6bdf-49a4-a4a2-b101ea8592cc tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:54.009356 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-736f83d8-464a-4a8b-8cd5-b45396c3f526 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:54.016243 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fccd64f8-6bdf-49a4-a4a2-b101ea8592cc tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:54.016804 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fccd64f8-6bdf-49a4-a4a2-b101ea8592cc tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:54.017316 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fccd64f8-6bdf-49a4-a4a2-b101ea8592cc tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:54.021584 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-736f83d8-464a-4a8b-8cd5-b45396c3f526 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1321 microversion: 2.1 time: 0.303636 Sep 24 21:03:54.022802 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1931/3814] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:53 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1321 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:54.059151 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fccd64f8-6bdf-49a4-a4a2-b101ea8592cc tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Going to try to stop instance {{(pid=140517) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 24 21:03:54.109172 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fccd64f8-6bdf-49a4-a4a2-b101ea8592cc tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "POST /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/action" status: 202 len: 0 microversion: 2.1 time: 0.106716 Sep 24 21:03:54.111377 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1884/3815] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:03:54 2022] POST /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:03:54.119193 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-23f7ec5c-6fc9-4043-afe6-717487a9edb1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:54.120182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-23f7ec5c-6fc9-4043-afe6-717487a9edb1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:54.130925 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-23f7ec5c-6fc9-4043-afe6-717487a9edb1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:54.131583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-23f7ec5c-6fc9-4043-afe6-717487a9edb1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:54.132119 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-23f7ec5c-6fc9-4043-afe6-717487a9edb1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:54.133861 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-23f7ec5c-6fc9-4043-afe6-717487a9edb1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:54.134538 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-23f7ec5c-6fc9-4043-afe6-717487a9edb1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:54.135140 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-23f7ec5c-6fc9-4043-afe6-717487a9edb1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:54.241068 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7c2ffd47-e3fa-46c5-b1df-989db6edf928 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:54.241773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7c2ffd47-e3fa-46c5-b1df-989db6edf928 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] [instance: b6106703-7709-41ea-a56c-935391c05827] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:54.265605 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7c2ffd47-e3fa-46c5-b1df-989db6edf928 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:54.266113 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7c2ffd47-e3fa-46c5-b1df-989db6edf928 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:54.266929 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7c2ffd47-e3fa-46c5-b1df-989db6edf928 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:54.267905 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7c2ffd47-e3fa-46c5-b1df-989db6edf928 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:54.269237 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7c2ffd47-e3fa-46c5-b1df-989db6edf928 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:54.271587 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7c2ffd47-e3fa-46c5-b1df-989db6edf928 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:54.282258 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=5,nova_cell1:UPDATE=9 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:03:54.292840 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-23f7ec5c-6fc9-4043-afe6-717487a9edb1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:54.304013 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-23f7ec5c-6fc9-4043-afe6-717487a9edb1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1678 microversion: 2.1 time: 0.189512 Sep 24 21:03:54.306708 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1932/3816] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:54 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1678 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:54.325103 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-97e40cb4-5876-4949-85e4-ff7e226eeb64 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:54.325742 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-97e40cb4-5876-4949-85e4-ff7e226eeb64 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ff3106d1-5214-48ea-857b-fd505d8712c7] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:54.343678 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-97e40cb4-5876-4949-85e4-ff7e226eeb64 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:54.344438 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-97e40cb4-5876-4949-85e4-ff7e226eeb64 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:54.344896 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-97e40cb4-5876-4949-85e4-ff7e226eeb64 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:54.345621 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-97e40cb4-5876-4949-85e4-ff7e226eeb64 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:54.346118 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-97e40cb4-5876-4949-85e4-ff7e226eeb64 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:54.346533 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-97e40cb4-5876-4949-85e4-ff7e226eeb64 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:54.558738 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7c2ffd47-e3fa-46c5-b1df-989db6edf928 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7654d225081948cabad9d2cdbf03ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d75184d9cd4fed89c0e1d0d5d910fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:54.569952 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7c2ffd47-e3fa-46c5-b1df-989db6edf928 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "GET /compute/v2.1/servers/b6106703-7709-41ea-a56c-935391c05827" status: 200 len: 1312 microversion: 2.1 time: 0.332932 Sep 24 21:03:54.573887 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1885/3817] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:54 2022] GET /compute/v2.1/servers/b6106703-7709-41ea-a56c-935391c05827 => generated 1312 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:54.598840 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-02f3dbea-2f1b-4dd3-ae1d-26d2d146ebc5 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:54.599954 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-02f3dbea-2f1b-4dd3-ae1d-26d2d146ebc5 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:54.606681 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-02f3dbea-2f1b-4dd3-ae1d-26d2d146ebc5 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:54.610234 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-02f3dbea-2f1b-4dd3-ae1d-26d2d146ebc5 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:54.612205 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-02f3dbea-2f1b-4dd3-ae1d-26d2d146ebc5 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:54.612955 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-02f3dbea-2f1b-4dd3-ae1d-26d2d146ebc5 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:54.613424 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-02f3dbea-2f1b-4dd3-ae1d-26d2d146ebc5 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:54.613856 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-02f3dbea-2f1b-4dd3-ae1d-26d2d146ebc5 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:54.689755 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-97e40cb4-5876-4949-85e4-ff7e226eeb64 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:54.701253 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-97e40cb4-5876-4949-85e4-ff7e226eeb64 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/ff3106d1-5214-48ea-857b-fd505d8712c7" status: 200 len: 1321 microversion: 2.1 time: 0.392955 Sep 24 21:03:54.706803 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1933/3818] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:54 2022] GET /compute/v2.1/servers/ff3106d1-5214-48ea-857b-fd505d8712c7 => generated 1321 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:54.856197 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-02f3dbea-2f1b-4dd3-ae1d-26d2d146ebc5 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:54.869267 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-02f3dbea-2f1b-4dd3-ae1d-26d2d146ebc5 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1321 microversion: 2.1 time: 0.273248 Sep 24 21:03:54.886154 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1886/3819] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:54 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1321 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:03:54.891390 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-5218a396-e4c9-4d04-b8dc-de50146d37db req-35b95e86-8885-49ab-b5fb-8e3db1942dbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff3106d1-5214-48ea-857b-fd505d8712c7", "tag": "c94cdbed-0fb2-4f9b-bbfd-fc0d8d9b75a8"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:54.902681 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-5218a396-e4c9-4d04-b8dc-de50146d37db req-35b95e86-8885-49ab-b5fb-8e3db1942dbe service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:54.903267 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-5218a396-e4c9-4d04-b8dc-de50146d37db req-35b95e86-8885-49ab-b5fb-8e3db1942dbe service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:54.903777 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-5218a396-e4c9-4d04-b8dc-de50146d37db req-35b95e86-8885-49ab-b5fb-8e3db1942dbe service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:54.919410 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-5218a396-e4c9-4d04-b8dc-de50146d37db req-35b95e86-8885-49ab-b5fb-8e3db1942dbe service nova] Creating event network-changed:c94cdbed-0fb2-4f9b-bbfd-fc0d8d9b75a8 for instance ff3106d1-5214-48ea-857b-fd505d8712c7 on nch2-master-1 Sep 24 21:03:54.930332 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-5218a396-e4c9-4d04-b8dc-de50146d37db req-35b95e86-8885-49ab-b5fb-8e3db1942dbe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041939 Sep 24 21:03:54.931370 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1887/3820] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:03:55.046936 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8113145e-2735-4e52-a280-bab540d661e4 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:55.047659 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8113145e-2735-4e52-a280-bab540d661e4 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:55.059924 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8113145e-2735-4e52-a280-bab540d661e4 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:55.060564 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8113145e-2735-4e52-a280-bab540d661e4 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:55.060885 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8113145e-2735-4e52-a280-bab540d661e4 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:55.061869 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8113145e-2735-4e52-a280-bab540d661e4 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:55.062313 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8113145e-2735-4e52-a280-bab540d661e4 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:55.066653 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8113145e-2735-4e52-a280-bab540d661e4 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:55.088842 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-19ac125e-2f4c-4fd2-aa21-cedf790e8a58 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-220848403", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "4f0ce836-dd9f-42eb-88b9-a6791d51189a"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:55.178148 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-19ac125e-2f4c-4fd2-aa21-cedf790e8a58 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] validate_networks() for [('4f0ce836-dd9f-42eb-88b9-a6791d51189a', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:03:55.729406 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8113145e-2735-4e52-a280-bab540d661e4 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:55.739613 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8113145e-2735-4e52-a280-bab540d661e4 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1321 microversion: 2.1 time: 0.697897 Sep 24 21:03:55.744484 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1888/3821] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:55 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1321 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:03:55.763984 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2906ab20-7557-49b3-9be7-3dd3039dbdb1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:55.764854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2906ab20-7557-49b3-9be7-3dd3039dbdb1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:55.771677 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2906ab20-7557-49b3-9be7-3dd3039dbdb1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:55.772494 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2906ab20-7557-49b3-9be7-3dd3039dbdb1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:55.773319 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2906ab20-7557-49b3-9be7-3dd3039dbdb1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:55.774584 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2906ab20-7557-49b3-9be7-3dd3039dbdb1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:55.776070 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2906ab20-7557-49b3-9be7-3dd3039dbdb1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:55.784311 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2906ab20-7557-49b3-9be7-3dd3039dbdb1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:56.175461 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2906ab20-7557-49b3-9be7-3dd3039dbdb1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:56.184797 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2906ab20-7557-49b3-9be7-3dd3039dbdb1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1678 microversion: 2.1 time: 0.439107 Sep 24 21:03:56.185480 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1889/3822] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:55 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1678 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:56.191333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-12b3ab54-1f63-459f-a408-212dd9026a30 req-90609b58-3f5e-4729-b38b-3d46311458a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e765d57a-1bbe-4504-a194-d2c3d906577f", "name": "network-vif-plugged", "status": "completed", "tag": "5261759a-9b03-4931-8c0d-b4ebcec3b6fc"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:56.201148 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-12b3ab54-1f63-459f-a408-212dd9026a30 req-90609b58-3f5e-4729-b38b-3d46311458a6 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:56.201908 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-12b3ab54-1f63-459f-a408-212dd9026a30 req-90609b58-3f5e-4729-b38b-3d46311458a6 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:56.202563 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-12b3ab54-1f63-459f-a408-212dd9026a30 req-90609b58-3f5e-4729-b38b-3d46311458a6 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:56.217035 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-12b3ab54-1f63-459f-a408-212dd9026a30 req-90609b58-3f5e-4729-b38b-3d46311458a6 service nova] Creating event network-vif-plugged:5261759a-9b03-4931-8c0d-b4ebcec3b6fc for instance e765d57a-1bbe-4504-a194-d2c3d906577f on nch1-master-1 Sep 24 21:03:56.222389 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-12b3ab54-1f63-459f-a408-212dd9026a30 req-90609b58-3f5e-4729-b38b-3d46311458a6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035699 Sep 24 21:03:56.223150 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1890/3823] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:03:56.229021 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c0401f89-24aa-4583-bc56-c638961fd66a tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:56.229758 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c0401f89-24aa-4583-bc56-c638961fd66a tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] [instance: b6106703-7709-41ea-a56c-935391c05827] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:56.238960 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0401f89-24aa-4583-bc56-c638961fd66a tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:56.239463 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0401f89-24aa-4583-bc56-c638961fd66a tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:56.240107 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0401f89-24aa-4583-bc56-c638961fd66a tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:56.240994 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0401f89-24aa-4583-bc56-c638961fd66a tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:56.241640 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0401f89-24aa-4583-bc56-c638961fd66a tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:56.242827 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0401f89-24aa-4583-bc56-c638961fd66a tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:56.606295 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-19ac125e-2f4c-4fd2-aa21-cedf790e8a58 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:03:56.606978 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-19ac125e-2f4c-4fd2-aa21-cedf790e8a58 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:03:56.607518 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-19ac125e-2f4c-4fd2-aa21-cedf790e8a58 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:03:56.608150 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-19ac125e-2f4c-4fd2-aa21-cedf790e8a58 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:03:56.608721 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-19ac125e-2f4c-4fd2-aa21-cedf790e8a58 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:03:56.615057 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=71 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:03:56.621714 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-19ac125e-2f4c-4fd2-aa21-cedf790e8a58 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:56.622197 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-19ac125e-2f4c-4fd2-aa21-cedf790e8a58 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:56.622850 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-19ac125e-2f4c-4fd2-aa21-cedf790e8a58 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:56.623575 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-19ac125e-2f4c-4fd2-aa21-cedf790e8a58 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:56.624499 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-19ac125e-2f4c-4fd2-aa21-cedf790e8a58 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:56.624775 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-19ac125e-2f4c-4fd2-aa21-cedf790e8a58 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:56.634354 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=17 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:03:56.640314 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c0401f89-24aa-4583-bc56-c638961fd66a tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7654d225081948cabad9d2cdbf03ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d75184d9cd4fed89c0e1d0d5d910fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:56.653816 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c0401f89-24aa-4583-bc56-c638961fd66a tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "GET /compute/v2.1/servers/b6106703-7709-41ea-a56c-935391c05827" status: 200 len: 1497 microversion: 2.1 time: 0.429340 Sep 24 21:03:56.654664 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1891/3824] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:56 2022] GET /compute/v2.1/servers/b6106703-7709-41ea-a56c-935391c05827 => generated 1497 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:56.675672 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-42ff904d-c623-4b7b-b5db-c490643ede2d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:56.678764 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-42ff904d-c623-4b7b-b5db-c490643ede2d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ff3106d1-5214-48ea-857b-fd505d8712c7] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:56.682220 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-19ac125e-2f4c-4fd2-aa21-cedf790e8a58 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Getting quotas for project 6b7f252278c74e2d84de081cd3d5a69e. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:03:56.687966 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-42ff904d-c623-4b7b-b5db-c490643ede2d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:56.691720 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-19ac125e-2f4c-4fd2-aa21-cedf790e8a58 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Getting quotas for user dad0b98fdcf145a1960121573524940d and project 6b7f252278c74e2d84de081cd3d5a69e. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:03:56.694526 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-42ff904d-c623-4b7b-b5db-c490643ede2d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:56.694976 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-42ff904d-c623-4b7b-b5db-c490643ede2d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:56.696286 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-42ff904d-c623-4b7b-b5db-c490643ede2d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:56.696916 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-42ff904d-c623-4b7b-b5db-c490643ede2d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:56.697357 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-42ff904d-c623-4b7b-b5db-c490643ede2d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:56.721190 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-19ac125e-2f4c-4fd2-aa21-cedf790e8a58 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:03:56.723814 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-19ac125e-2f4c-4fd2-aa21-cedf790e8a58 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 06ef44f5-3eae-4780-b544-62102fd945a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:03:56.772846 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-19ac125e-2f4c-4fd2-aa21-cedf790e8a58 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.062616 Sep 24 21:03:56.773814 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1934/3825] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:03:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:03:56.779333 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ff457204-f403-4445-82b8-985f26490ba5 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:56.781598 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ff457204-f403-4445-82b8-985f26490ba5 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:56.809319 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff457204-f403-4445-82b8-985f26490ba5 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:56.811143 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff457204-f403-4445-82b8-985f26490ba5 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:56.811904 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff457204-f403-4445-82b8-985f26490ba5 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:56.815304 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff457204-f403-4445-82b8-985f26490ba5 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:56.817352 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff457204-f403-4445-82b8-985f26490ba5 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:56.819503 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff457204-f403-4445-82b8-985f26490ba5 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:57.015990 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-42ff904d-c623-4b7b-b5db-c490643ede2d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:57.027168 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-42ff904d-c623-4b7b-b5db-c490643ede2d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/ff3106d1-5214-48ea-857b-fd505d8712c7" status: 200 len: 1321 microversion: 2.1 time: 0.361733 Sep 24 21:03:57.064807 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1892/3826] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:56 2022] GET /compute/v2.1/servers/ff3106d1-5214-48ea-857b-fd505d8712c7 => generated 1321 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:57.091893 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ff457204-f403-4445-82b8-985f26490ba5 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:57.107360 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ff457204-f403-4445-82b8-985f26490ba5 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1321 microversion: 2.1 time: 0.326586 Sep 24 21:03:57.108018 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1935/3827] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:56 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1321 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:57.115904 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f17c976b-9293-4cf5-8448-13eea0dcdbb3 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:57.200213 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.compute.server_groups [None req-f17c976b-9293-4cf5-8448-13eea0dcdbb3 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Querying cell 788aecb6-32dc-4b71-909a-be050455aded(cell1) for 1 instances {{(pid=140516) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 24 21:03:57.201745 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f17c976b-9293-4cf5-8448-13eea0dcdbb3 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:57.202462 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f17c976b-9293-4cf5-8448-13eea0dcdbb3 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:57.203149 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f17c976b-9293-4cf5-8448-13eea0dcdbb3 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:57.258785 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f17c976b-9293-4cf5-8448-13eea0dcdbb3 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups/69c83283-fbf2-49d7-bc6e-8a37519f7786" status: 200 len: 222 microversion: 2.1 time: 0.147704 Sep 24 21:03:57.259397 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1936/3828] 10.222.0.52 () {58 vars in 1263 bytes} [Sat Sep 24 21:03:57 2022] GET /compute/v2.1/os-server-groups/69c83283-fbf2-49d7-bc6e-8a37519f7786 => generated 222 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:03:57.273135 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-96336bc7-5bc0-46a4-ace5-a86a6f1bd8e3 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:57.273956 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-96336bc7-5bc0-46a4-ace5-a86a6f1bd8e3 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:57.290147 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96336bc7-5bc0-46a4-ace5-a86a6f1bd8e3 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:57.290686 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96336bc7-5bc0-46a4-ace5-a86a6f1bd8e3 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:57.291491 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96336bc7-5bc0-46a4-ace5-a86a6f1bd8e3 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:57.292698 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96336bc7-5bc0-46a4-ace5-a86a6f1bd8e3 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:57.294074 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96336bc7-5bc0-46a4-ace5-a86a6f1bd8e3 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:57.294753 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96336bc7-5bc0-46a4-ace5-a86a6f1bd8e3 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:57.302068 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-83dae148-e77d-4f87-8be2-f35ccb2e13b7 tempest-AbsoluteLimitsTestJSON-1685293216 tempest-AbsoluteLimitsTestJSON-1685293216-project] Calling method '.version_select at 0x7f4b07beb1f0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:57.315929 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-83dae148-e77d-4f87-8be2-f35ccb2e13b7 tempest-AbsoluteLimitsTestJSON-1685293216 tempest-AbsoluteLimitsTestJSON-1685293216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:57.316443 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-83dae148-e77d-4f87-8be2-f35ccb2e13b7 tempest-AbsoluteLimitsTestJSON-1685293216 tempest-AbsoluteLimitsTestJSON-1685293216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:57.316992 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-83dae148-e77d-4f87-8be2-f35ccb2e13b7 tempest-AbsoluteLimitsTestJSON-1685293216 tempest-AbsoluteLimitsTestJSON-1685293216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:57.317733 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-83dae148-e77d-4f87-8be2-f35ccb2e13b7 tempest-AbsoluteLimitsTestJSON-1685293216 tempest-AbsoluteLimitsTestJSON-1685293216-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:57.318217 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-83dae148-e77d-4f87-8be2-f35ccb2e13b7 tempest-AbsoluteLimitsTestJSON-1685293216 tempest-AbsoluteLimitsTestJSON-1685293216-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:57.318773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-83dae148-e77d-4f87-8be2-f35ccb2e13b7 tempest-AbsoluteLimitsTestJSON-1685293216 tempest-AbsoluteLimitsTestJSON-1685293216-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:57.341236 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-83dae148-e77d-4f87-8be2-f35ccb2e13b7 tempest-AbsoluteLimitsTestJSON-1685293216 tempest-AbsoluteLimitsTestJSON-1685293216-project] 10.222.0.52 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.274912 Sep 24 21:03:57.342074 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1893/3829] 10.222.0.52 () {58 vars in 1122 bytes} [Sat Sep 24 21:03:57 2022] GET /compute/v2.1/limits => generated 511 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:03:57.347661 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a5fc1bf4-e5d3-4b82-90e8-fbd3aaaeac14 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-250454232", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "4f0ce836-dd9f-42eb-88b9-a6791d51189a"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:57.415334 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-a5fc1bf4-e5d3-4b82-90e8-fbd3aaaeac14 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] validate_networks() for [('4f0ce836-dd9f-42eb-88b9-a6791d51189a', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:03:57.613401 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-96336bc7-5bc0-46a4-ace5-a86a6f1bd8e3 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:57.623711 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-96336bc7-5bc0-46a4-ace5-a86a6f1bd8e3 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1321 microversion: 2.1 time: 0.362393 Sep 24 21:03:57.640643 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1937/3830] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:57 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1321 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:57.645774 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c562a5e4-c469-4541-966f-62f4e044f135 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:57.646299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c562a5e4-c469-4541-966f-62f4e044f135 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:57.660781 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c562a5e4-c469-4541-966f-62f4e044f135 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:57.665586 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c562a5e4-c469-4541-966f-62f4e044f135 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:57.671020 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c562a5e4-c469-4541-966f-62f4e044f135 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:57.672302 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c562a5e4-c469-4541-966f-62f4e044f135 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:57.673114 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c562a5e4-c469-4541-966f-62f4e044f135 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:57.673735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c562a5e4-c469-4541-966f-62f4e044f135 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:58.102570 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-a5fc1bf4-e5d3-4b82-90e8-fbd3aaaeac14 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:03:58.103231 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-a5fc1bf4-e5d3-4b82-90e8-fbd3aaaeac14 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:03:58.103569 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c562a5e4-c469-4541-966f-62f4e044f135 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:58.103915 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-a5fc1bf4-e5d3-4b82-90e8-fbd3aaaeac14 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:03:58.104338 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-a5fc1bf4-e5d3-4b82-90e8-fbd3aaaeac14 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:03:58.104756 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-a5fc1bf4-e5d3-4b82-90e8-fbd3aaaeac14 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:03:58.115466 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5fc1bf4-e5d3-4b82-90e8-fbd3aaaeac14 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:58.116095 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c562a5e4-c469-4541-966f-62f4e044f135 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1678 microversion: 2.1 time: 0.474167 Sep 24 21:03:58.116471 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5fc1bf4-e5d3-4b82-90e8-fbd3aaaeac14 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:58.117123 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1938/3831] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:57 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1678 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:58.124839 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0929e70f-d438-4af5-9e40-259aa2b8e4f5 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:58.124839 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0929e70f-d438-4af5-9e40-259aa2b8e4f5 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] [instance: b6106703-7709-41ea-a56c-935391c05827] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:58.133533 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5fc1bf4-e5d3-4b82-90e8-fbd3aaaeac14 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:58.134489 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5fc1bf4-e5d3-4b82-90e8-fbd3aaaeac14 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:58.135013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5fc1bf4-e5d3-4b82-90e8-fbd3aaaeac14 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:58.135655 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5fc1bf4-e5d3-4b82-90e8-fbd3aaaeac14 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:58.143542 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0929e70f-d438-4af5-9e40-259aa2b8e4f5 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:58.144041 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0929e70f-d438-4af5-9e40-259aa2b8e4f5 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:58.144473 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0929e70f-d438-4af5-9e40-259aa2b8e4f5 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:58.145442 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0929e70f-d438-4af5-9e40-259aa2b8e4f5 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:58.146052 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0929e70f-d438-4af5-9e40-259aa2b8e4f5 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:58.146675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0929e70f-d438-4af5-9e40-259aa2b8e4f5 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:58.161596 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-a5fc1bf4-e5d3-4b82-90e8-fbd3aaaeac14 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Getting quotas for project 6b7f252278c74e2d84de081cd3d5a69e. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:03:58.169510 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-a5fc1bf4-e5d3-4b82-90e8-fbd3aaaeac14 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Getting quotas for user dad0b98fdcf145a1960121573524940d and project 6b7f252278c74e2d84de081cd3d5a69e. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:03:58.178848 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0929e70f-d438-4af5-9e40-259aa2b8e4f5 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] [instance: b6106703-7709-41ea-a56c-935391c05827] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:03:58.187000 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a5fc1bf4-e5d3-4b82-90e8-fbd3aaaeac14 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:03:58.190318 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a5fc1bf4-e5d3-4b82-90e8-fbd3aaaeac14 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 275263e1-8a0a-4f58-b863-b56c2bf3a7c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:03:58.272869 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a5fc1bf4-e5d3-4b82-90e8-fbd3aaaeac14 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.929070 Sep 24 21:03:58.274083 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1894/3832] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:03:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:03:58.286235 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1d7f93be-933c-473f-9820-a96f180abfb7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:58.287197 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1d7f93be-933c-473f-9820-a96f180abfb7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ff3106d1-5214-48ea-857b-fd505d8712c7] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:58.296706 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1d7f93be-933c-473f-9820-a96f180abfb7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:58.297416 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1d7f93be-933c-473f-9820-a96f180abfb7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:58.298219 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1d7f93be-933c-473f-9820-a96f180abfb7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:58.299518 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1d7f93be-933c-473f-9820-a96f180abfb7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:58.300309 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1d7f93be-933c-473f-9820-a96f180abfb7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:58.300911 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1d7f93be-933c-473f-9820-a96f180abfb7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:58.398778 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0929e70f-d438-4af5-9e40-259aa2b8e4f5 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b6106703-7709-41ea-a56c-935391c05827" status: 204 len: 0 microversion: 2.1 time: 0.278557 Sep 24 21:03:58.403441 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1939/3833] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:03:58 2022] DELETE /compute/v2.1/servers/b6106703-7709-41ea-a56c-935391c05827 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:03:58.412110 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5623861c-c964-4ee2-8407-9b21a94e7606 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:58.413105 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5623861c-c964-4ee2-8407-9b21a94e7606 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:58.426996 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5623861c-c964-4ee2-8407-9b21a94e7606 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:58.428980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5623861c-c964-4ee2-8407-9b21a94e7606 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:58.431174 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5623861c-c964-4ee2-8407-9b21a94e7606 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:58.433362 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5623861c-c964-4ee2-8407-9b21a94e7606 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:58.434753 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5623861c-c964-4ee2-8407-9b21a94e7606 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:58.436071 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5623861c-c964-4ee2-8407-9b21a94e7606 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:58.631450 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1d7f93be-933c-473f-9820-a96f180abfb7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:58.640944 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1d7f93be-933c-473f-9820-a96f180abfb7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/ff3106d1-5214-48ea-857b-fd505d8712c7" status: 200 len: 1321 microversion: 2.1 time: 0.365294 Sep 24 21:03:58.654124 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1895/3834] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:58 2022] GET /compute/v2.1/servers/ff3106d1-5214-48ea-857b-fd505d8712c7 => generated 1321 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:58.654124 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fa1622fa-c9ae-40fe-8e5a-a98dc025fda9 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:58.654124 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fa1622fa-c9ae-40fe-8e5a-a98dc025fda9 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] [instance: b6106703-7709-41ea-a56c-935391c05827] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:58.663374 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa1622fa-c9ae-40fe-8e5a-a98dc025fda9 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:58.664262 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa1622fa-c9ae-40fe-8e5a-a98dc025fda9 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:58.664707 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa1622fa-c9ae-40fe-8e5a-a98dc025fda9 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:58.665427 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa1622fa-c9ae-40fe-8e5a-a98dc025fda9 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:58.665888 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa1622fa-c9ae-40fe-8e5a-a98dc025fda9 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:58.666351 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa1622fa-c9ae-40fe-8e5a-a98dc025fda9 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:58.684292 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5623861c-c964-4ee2-8407-9b21a94e7606 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:58.694121 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5623861c-c964-4ee2-8407-9b21a94e7606 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1516 microversion: 2.1 time: 0.288380 Sep 24 21:03:58.695094 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1940/3835] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:58 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1516 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:58.701451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1421e414-50ce-4961-ab6b-3e55a236bbbf tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-398503828", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "451", "networks": [{"uuid": "4f0ce836-dd9f-42eb-88b9-a6791d51189a"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:58.763965 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-1421e414-50ce-4961-ab6b-3e55a236bbbf tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] validate_networks() for [('4f0ce836-dd9f-42eb-88b9-a6791d51189a', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:03:59.053930 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fa1622fa-c9ae-40fe-8e5a-a98dc025fda9 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7654d225081948cabad9d2cdbf03ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d75184d9cd4fed89c0e1d0d5d910fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:59.072726 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fa1622fa-c9ae-40fe-8e5a-a98dc025fda9 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "GET /compute/v2.1/servers/b6106703-7709-41ea-a56c-935391c05827" status: 200 len: 1503 microversion: 2.1 time: 0.425138 Sep 24 21:03:59.073317 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1896/3836] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:58 2022] GET /compute/v2.1/servers/b6106703-7709-41ea-a56c-935391c05827 => generated 1503 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:59.078267 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ed2a4923-3010-48b3-9b94-661856099aa2 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:59.078905 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ed2a4923-3010-48b3-9b94-661856099aa2 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:59.080812 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:03:59.098104 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed2a4923-3010-48b3-9b94-661856099aa2 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:59.098620 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed2a4923-3010-48b3-9b94-661856099aa2 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:59.099366 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed2a4923-3010-48b3-9b94-661856099aa2 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:59.100502 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed2a4923-3010-48b3-9b94-661856099aa2 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:59.101963 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed2a4923-3010-48b3-9b94-661856099aa2 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:59.103053 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed2a4923-3010-48b3-9b94-661856099aa2 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:59.369951 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-1421e414-50ce-4961-ab6b-3e55a236bbbf tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:03:59.370683 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-1421e414-50ce-4961-ab6b-3e55a236bbbf tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:03:59.371399 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-1421e414-50ce-4961-ab6b-3e55a236bbbf tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:03:59.371819 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-1421e414-50ce-4961-ab6b-3e55a236bbbf tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:03:59.372243 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-1421e414-50ce-4961-ab6b-3e55a236bbbf tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:03:59.390001 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1421e414-50ce-4961-ab6b-3e55a236bbbf tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:59.390819 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1421e414-50ce-4961-ab6b-3e55a236bbbf tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:59.391995 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1421e414-50ce-4961-ab6b-3e55a236bbbf tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:59.393066 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1421e414-50ce-4961-ab6b-3e55a236bbbf tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:59.393623 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1421e414-50ce-4961-ab6b-3e55a236bbbf tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:59.394181 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1421e414-50ce-4961-ab6b-3e55a236bbbf tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:59.416703 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-1421e414-50ce-4961-ab6b-3e55a236bbbf tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Getting quotas for project 6b7f252278c74e2d84de081cd3d5a69e. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:03:59.423736 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-1421e414-50ce-4961-ab6b-3e55a236bbbf tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Getting quotas for user dad0b98fdcf145a1960121573524940d and project 6b7f252278c74e2d84de081cd3d5a69e. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:03:59.425238 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ed2a4923-3010-48b3-9b94-661856099aa2 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:59.429232 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:03:59.437478 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ed2a4923-3010-48b3-9b94-661856099aa2 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1321 microversion: 2.1 time: 0.362767 Sep 24 21:03:59.438171 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1897/3837] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:59 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1321 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:59.450865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-605b0f61-12f1-4fd6-85da-f35685750490 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:03:59.457124 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-605b0f61-12f1-4fd6-85da-f35685750490 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:59.464816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1421e414-50ce-4961-ab6b-3e55a236bbbf tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:03:59.465775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-605b0f61-12f1-4fd6-85da-f35685750490 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:59.466363 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-605b0f61-12f1-4fd6-85da-f35685750490 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:59.466914 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-605b0f61-12f1-4fd6-85da-f35685750490 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:59.467677 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-605b0f61-12f1-4fd6-85da-f35685750490 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:59.467896 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1421e414-50ce-4961-ab6b-3e55a236bbbf tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 1f788a90-8f36-4262-957b-6d4e43e6568d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:03:59.468145 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-605b0f61-12f1-4fd6-85da-f35685750490 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:59.468587 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-605b0f61-12f1-4fd6-85da-f35685750490 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:59.496556 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-605b0f61-12f1-4fd6-85da-f35685750490 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lazy-loading 'flavor' on Instance uuid e765d57a-1bbe-4504-a194-d2c3d906577f {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:03:59.561336 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1421e414-50ce-4961-ab6b-3e55a236bbbf tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.861912 Sep 24 21:03:59.563158 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1941/3838] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:03:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:03:59.574779 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-659b53b3-04bf-441b-af1d-33a4ec82b8e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:59.577752 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-659b53b3-04bf-441b-af1d-33a4ec82b8e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:59.587342 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-659b53b3-04bf-441b-af1d-33a4ec82b8e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:59.587841 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-659b53b3-04bf-441b-af1d-33a4ec82b8e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:59.588281 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-659b53b3-04bf-441b-af1d-33a4ec82b8e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:59.589137 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-659b53b3-04bf-441b-af1d-33a4ec82b8e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:59.589629 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-659b53b3-04bf-441b-af1d-33a4ec82b8e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:59.590040 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-659b53b3-04bf-441b-af1d-33a4ec82b8e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:59.606290 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-605b0f61-12f1-4fd6-85da-f35685750490 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "POST /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f/action" status: 200 len: 32 microversion: 2.1 time: 0.166422 Sep 24 21:03:59.609074 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1898/3839] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:03:59 2022] POST /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f/action => generated 32 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 21:03:59.615678 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9d521bdc-3336-456d-a11a-6f189ad72580 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:59.616707 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9d521bdc-3336-456d-a11a-6f189ad72580 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 1f788a90-8f36-4262-957b-6d4e43e6568d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:59.763213 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9d521bdc-3336-456d-a11a-6f189ad72580 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:59.773052 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9d521bdc-3336-456d-a11a-6f189ad72580 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d" status: 200 len: 1220 microversion: 2.1 time: 0.162376 Sep 24 21:03:59.790905 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1899/3840] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:59 2022] GET /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d => generated 1220 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:59.798373 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-14a600ea-3478-4aa4-bbd9-f55f301f1aa4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:59.799221 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-14a600ea-3478-4aa4-bbd9-f55f301f1aa4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:59.809393 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-14a600ea-3478-4aa4-bbd9-f55f301f1aa4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:59.810395 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-14a600ea-3478-4aa4-bbd9-f55f301f1aa4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:59.811662 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-14a600ea-3478-4aa4-bbd9-f55f301f1aa4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:59.812477 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-14a600ea-3478-4aa4-bbd9-f55f301f1aa4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:59.813601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-14a600ea-3478-4aa4-bbd9-f55f301f1aa4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:59.814351 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-14a600ea-3478-4aa4-bbd9-f55f301f1aa4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:59.885593 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-659b53b3-04bf-441b-af1d-33a4ec82b8e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:03:59.893740 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-659b53b3-04bf-441b-af1d-33a4ec82b8e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1678 microversion: 2.1 time: 0.324444 Sep 24 21:03:59.894325 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1942/3841] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:59 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1678 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:03:59.917228 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-91950e03-35f1-427e-9fad-503758aaadbe tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:03:59.920158 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-91950e03-35f1-427e-9fad-503758aaadbe tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ff3106d1-5214-48ea-857b-fd505d8712c7] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:03:59.929275 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-91950e03-35f1-427e-9fad-503758aaadbe tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:59.930480 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-91950e03-35f1-427e-9fad-503758aaadbe tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:59.931495 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-91950e03-35f1-427e-9fad-503758aaadbe tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:03:59.933571 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-91950e03-35f1-427e-9fad-503758aaadbe tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:03:59.934269 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-91950e03-35f1-427e-9fad-503758aaadbe tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:03:59.935125 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-91950e03-35f1-427e-9fad-503758aaadbe tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:00.557937 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-14a600ea-3478-4aa4-bbd9-f55f301f1aa4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:00.566075 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-14a600ea-3478-4aa4-bbd9-f55f301f1aa4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1522 microversion: 2.1 time: 0.773026 Sep 24 21:04:00.582558 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1900/3842] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:59 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1522 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:00.589040 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-135cd797-17dd-4f19-b7bc-44e91aa87711 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:00.590009 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-135cd797-17dd-4f19-b7bc-44e91aa87711 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] [instance: b6106703-7709-41ea-a56c-935391c05827] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:00.596679 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-135cd797-17dd-4f19-b7bc-44e91aa87711 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:00.597523 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-135cd797-17dd-4f19-b7bc-44e91aa87711 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:00.598229 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-135cd797-17dd-4f19-b7bc-44e91aa87711 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:00.599210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-135cd797-17dd-4f19-b7bc-44e91aa87711 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:00.600202 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-135cd797-17dd-4f19-b7bc-44e91aa87711 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:00.600966 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-135cd797-17dd-4f19-b7bc-44e91aa87711 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:00.696606 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-91950e03-35f1-427e-9fad-503758aaadbe tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:00.706205 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-91950e03-35f1-427e-9fad-503758aaadbe tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/ff3106d1-5214-48ea-857b-fd505d8712c7" status: 200 len: 1321 microversion: 2.1 time: 0.808657 Sep 24 21:04:00.707034 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1943/3843] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:03:59 2022] GET /compute/v2.1/servers/ff3106d1-5214-48ea-857b-fd505d8712c7 => generated 1321 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:00.713017 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-836dbebe-6b3a-488e-99f4-03e8c5e179e4 req-7995bf61-d0ee-4166-85a8-48d9b1e37bbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b2e4ce4-809e-4888-8205-eae021e2fb8c", "name": "network-vif-plugged", "status": "completed", "tag": "463ee47f-dd1b-4d52-b5e6-b06f1390b340"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:00.740860 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-836dbebe-6b3a-488e-99f4-03e8c5e179e4 req-7995bf61-d0ee-4166-85a8-48d9b1e37bbf service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:00.741435 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-836dbebe-6b3a-488e-99f4-03e8c5e179e4 req-7995bf61-d0ee-4166-85a8-48d9b1e37bbf service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:00.743227 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-836dbebe-6b3a-488e-99f4-03e8c5e179e4 req-7995bf61-d0ee-4166-85a8-48d9b1e37bbf service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:00.771325 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-836dbebe-6b3a-488e-99f4-03e8c5e179e4 req-7995bf61-d0ee-4166-85a8-48d9b1e37bbf service nova] Creating event network-vif-plugged:463ee47f-dd1b-4d52-b5e6-b06f1390b340 for instance 1b2e4ce4-809e-4888-8205-eae021e2fb8c on nch1-master-1 Sep 24 21:04:00.779968 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-836dbebe-6b3a-488e-99f4-03e8c5e179e4 req-7995bf61-d0ee-4166-85a8-48d9b1e37bbf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071032 Sep 24 21:04:00.781245 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1944/3844] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:04:00.789430 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8d92bfb2-c904-446a-819b-90ca6667cacc tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:00.790662 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8d92bfb2-c904-446a-819b-90ca6667cacc tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:00.802785 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d92bfb2-c904-446a-819b-90ca6667cacc tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:00.805467 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d92bfb2-c904-446a-819b-90ca6667cacc tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:00.808020 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d92bfb2-c904-446a-819b-90ca6667cacc tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:00.808646 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d92bfb2-c904-446a-819b-90ca6667cacc tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:00.809789 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d92bfb2-c904-446a-819b-90ca6667cacc tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:00.811800 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d92bfb2-c904-446a-819b-90ca6667cacc tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:01.146382 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-135cd797-17dd-4f19-b7bc-44e91aa87711 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7654d225081948cabad9d2cdbf03ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d75184d9cd4fed89c0e1d0d5d910fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:01.156097 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-135cd797-17dd-4f19-b7bc-44e91aa87711 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "GET /compute/v2.1/servers/b6106703-7709-41ea-a56c-935391c05827" status: 200 len: 1503 microversion: 2.1 time: 0.571623 Sep 24 21:04:01.157624 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1901/3845] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:00 2022] GET /compute/v2.1/servers/b6106703-7709-41ea-a56c-935391c05827 => generated 1503 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:01.164091 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8b9eb967-548d-4a40-a10c-e2e15e140149 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:01.165397 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8b9eb967-548d-4a40-a10c-e2e15e140149 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 1f788a90-8f36-4262-957b-6d4e43e6568d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:01.175240 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8b9eb967-548d-4a40-a10c-e2e15e140149 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:01.176973 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8b9eb967-548d-4a40-a10c-e2e15e140149 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:01.178158 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8b9eb967-548d-4a40-a10c-e2e15e140149 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:01.180029 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8b9eb967-548d-4a40-a10c-e2e15e140149 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:01.181309 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8b9eb967-548d-4a40-a10c-e2e15e140149 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:01.182230 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8b9eb967-548d-4a40-a10c-e2e15e140149 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:01.213185 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8d92bfb2-c904-446a-819b-90ca6667cacc tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:01.224549 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8d92bfb2-c904-446a-819b-90ca6667cacc tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1321 microversion: 2.1 time: 0.441765 Sep 24 21:04:01.225338 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1945/3846] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:00 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1321 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:01.235986 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bfa5cf38-c54f-4a26-b73d-3237809472e1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:01.236818 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-bfa5cf38-c54f-4a26-b73d-3237809472e1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:01.245935 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bfa5cf38-c54f-4a26-b73d-3237809472e1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:01.246594 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bfa5cf38-c54f-4a26-b73d-3237809472e1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:01.247112 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bfa5cf38-c54f-4a26-b73d-3237809472e1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:01.248239 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bfa5cf38-c54f-4a26-b73d-3237809472e1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:01.249097 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bfa5cf38-c54f-4a26-b73d-3237809472e1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:01.249644 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bfa5cf38-c54f-4a26-b73d-3237809472e1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:01.277517 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8b9eb967-548d-4a40-a10c-e2e15e140149 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:01.287673 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8b9eb967-548d-4a40-a10c-e2e15e140149 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d" status: 200 len: 1272 microversion: 2.1 time: 0.127721 Sep 24 21:04:01.288376 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1902/3847] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:01 2022] GET /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d => generated 1272 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:01.475733 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fd3cced3-b615-41bf-8f2a-c1185c55ba09 tempest-ComputeTenantNetworksTest-377546632 tempest-ComputeTenantNetworksTest-377546632-project] Calling method '.version_select at 0x7f4b07bd0670>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:01.825599 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-bfa5cf38-c54f-4a26-b73d-3237809472e1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:01.833792 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bfa5cf38-c54f-4a26-b73d-3237809472e1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1678 microversion: 2.1 time: 0.607204 Sep 24 21:04:01.841395 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1946/3848] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:01 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1678 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:01.846845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ff316ede-0d69-4eca-9121-92c3c38ac6d6 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:01.847821 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ff316ede-0d69-4eca-9121-92c3c38ac6d6 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:01.856105 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff316ede-0d69-4eca-9121-92c3c38ac6d6 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:01.856652 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff316ede-0d69-4eca-9121-92c3c38ac6d6 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:01.857097 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff316ede-0d69-4eca-9121-92c3c38ac6d6 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:01.857816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff316ede-0d69-4eca-9121-92c3c38ac6d6 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:01.858532 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff316ede-0d69-4eca-9121-92c3c38ac6d6 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:01.858984 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff316ede-0d69-4eca-9121-92c3c38ac6d6 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:01.864063 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:04:01.922160 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fd3cced3-b615-41bf-8f2a-c1185c55ba09 tempest-ComputeTenantNetworksTest-377546632 tempest-ComputeTenantNetworksTest-377546632-project] 10.222.0.52 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.629362 Sep 24 21:04:01.922956 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1903/3849] 10.222.0.52 () {58 vars in 1158 bytes} [Sat Sep 24 21:04:01 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:04:01.930333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6eb24644-757f-46e2-9f02-41d273766d3f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:01.930639 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6eb24644-757f-46e2-9f02-41d273766d3f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ff3106d1-5214-48ea-857b-fd505d8712c7] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:01.938998 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6eb24644-757f-46e2-9f02-41d273766d3f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:01.939901 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6eb24644-757f-46e2-9f02-41d273766d3f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:01.940451 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6eb24644-757f-46e2-9f02-41d273766d3f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:01.941291 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6eb24644-757f-46e2-9f02-41d273766d3f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:01.941951 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6eb24644-757f-46e2-9f02-41d273766d3f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:01.942685 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6eb24644-757f-46e2-9f02-41d273766d3f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:01.978612 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:04:02.290541 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ff316ede-0d69-4eca-9121-92c3c38ac6d6 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:02.299406 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ff316ede-0d69-4eca-9121-92c3c38ac6d6 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1522 microversion: 2.1 time: 0.462210 Sep 24 21:04:02.300356 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1947/3850] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:01 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1522 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:02.305365 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f18e1a0b-2801-4656-8c73-d03099674d52 tempest-ComputeTenantNetworksTest-377546632 tempest-ComputeTenantNetworksTest-377546632-project] Calling method '.version_select at 0x7f4b1106ae50>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:02.357849 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6eb24644-757f-46e2-9f02-41d273766d3f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:02.367788 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6eb24644-757f-46e2-9f02-41d273766d3f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/ff3106d1-5214-48ea-857b-fd505d8712c7" status: 200 len: 1321 microversion: 2.1 time: 0.442796 Sep 24 21:04:02.378517 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1904/3851] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:01 2022] GET /compute/v2.1/servers/ff3106d1-5214-48ea-857b-fd505d8712c7 => generated 1321 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:02.378517 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-008c71fe-b2fb-43f4-a0bd-bc169d10b8cd req-cd90f9c5-b21b-4ace-a49f-a623e2861ce3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6106703-7709-41ea-a56c-935391c05827", "name": "network-vif-deleted", "tag": "19e3d6bb-23c8-4195-b009-14e01e93950c"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:02.383120 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-008c71fe-b2fb-43f4-a0bd-bc169d10b8cd req-cd90f9c5-b21b-4ace-a49f-a623e2861ce3 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:02.383616 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-008c71fe-b2fb-43f4-a0bd-bc169d10b8cd req-cd90f9c5-b21b-4ace-a49f-a623e2861ce3 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:02.384060 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-008c71fe-b2fb-43f4-a0bd-bc169d10b8cd req-cd90f9c5-b21b-4ace-a49f-a623e2861ce3 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:02.395215 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-008c71fe-b2fb-43f4-a0bd-bc169d10b8cd req-cd90f9c5-b21b-4ace-a49f-a623e2861ce3 service nova] Creating event network-vif-deleted:19e3d6bb-23c8-4195-b009-14e01e93950c for instance b6106703-7709-41ea-a56c-935391c05827 on nch2-master-1 Sep 24 21:04:02.400113 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-008c71fe-b2fb-43f4-a0bd-bc169d10b8cd req-cd90f9c5-b21b-4ace-a49f-a623e2861ce3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030021 Sep 24 21:04:02.400706 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1905/3852] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:04:02.409240 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9987a821-af2e-4f1a-8529-b4b4d4105aad tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:02.409958 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9987a821-af2e-4f1a-8529-b4b4d4105aad tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] [instance: b6106703-7709-41ea-a56c-935391c05827] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:02.417203 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9987a821-af2e-4f1a-8529-b4b4d4105aad tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:02.417973 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9987a821-af2e-4f1a-8529-b4b4d4105aad tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:02.418430 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9987a821-af2e-4f1a-8529-b4b4d4105aad tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:02.419489 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9987a821-af2e-4f1a-8529-b4b4d4105aad tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:02.419876 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9987a821-af2e-4f1a-8529-b4b4d4105aad tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:02.420411 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9987a821-af2e-4f1a-8529-b4b4d4105aad tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:02.435291 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f18e1a0b-2801-4656-8c73-d03099674d52 tempest-ComputeTenantNetworksTest-377546632 tempest-ComputeTenantNetworksTest-377546632-project] 10.222.0.52 "GET /compute/v2.1/os-tenant-networks/165b4b92-c533-4fad-953c-6e2dec5c1c21" status: 200 len: 140 microversion: 2.1 time: 0.134107 Sep 24 21:04:02.436093 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1948/3853] 10.222.0.52 () {58 vars in 1269 bytes} [Sat Sep 24 21:04:02 2022] GET /compute/v2.1/os-tenant-networks/165b4b92-c533-4fad-953c-6e2dec5c1c21 => generated 140 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:04:02.442060 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7e003a34-6e7e-49ca-92e3-a698eb0c2ebd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:02.443886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7e003a34-6e7e-49ca-92e3-a698eb0c2ebd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:02.451949 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7e003a34-6e7e-49ca-92e3-a698eb0c2ebd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:02.452674 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7e003a34-6e7e-49ca-92e3-a698eb0c2ebd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:02.453283 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7e003a34-6e7e-49ca-92e3-a698eb0c2ebd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:02.454201 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7e003a34-6e7e-49ca-92e3-a698eb0c2ebd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:02.454861 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7e003a34-6e7e-49ca-92e3-a698eb0c2ebd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:02.455462 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7e003a34-6e7e-49ca-92e3-a698eb0c2ebd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:02.506805 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9987a821-af2e-4f1a-8529-b4b4d4105aad tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:02.507310 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9987a821-af2e-4f1a-8529-b4b4d4105aad tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:02.508888 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9987a821-af2e-4f1a-8529-b4b4d4105aad tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:02.509703 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-9987a821-af2e-4f1a-8529-b4b4d4105aad tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lazy-loading 'fault' on Instance uuid b6106703-7709-41ea-a56c-935391c05827 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:04:02.932311 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9987a821-af2e-4f1a-8529-b4b4d4105aad tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7654d225081948cabad9d2cdbf03ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d75184d9cd4fed89c0e1d0d5d910fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:02.940785 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9987a821-af2e-4f1a-8529-b4b4d4105aad tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "GET /compute/v2.1/servers/b6106703-7709-41ea-a56c-935391c05827" status: 200 len: 1302 microversion: 2.1 time: 0.535797 Sep 24 21:04:02.941486 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1906/3854] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:02 2022] GET /compute/v2.1/servers/b6106703-7709-41ea-a56c-935391c05827 => generated 1302 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:02.959495 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-396f6481-8de0-4f58-9382-9cf8e2cbfeb7 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:02.962127 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-396f6481-8de0-4f58-9382-9cf8e2cbfeb7 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 1f788a90-8f36-4262-957b-6d4e43e6568d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:02.978209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-396f6481-8de0-4f58-9382-9cf8e2cbfeb7 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:02.980028 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-396f6481-8de0-4f58-9382-9cf8e2cbfeb7 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:02.980769 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-396f6481-8de0-4f58-9382-9cf8e2cbfeb7 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:02.981755 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-396f6481-8de0-4f58-9382-9cf8e2cbfeb7 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:02.982350 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-396f6481-8de0-4f58-9382-9cf8e2cbfeb7 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:02.982897 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-396f6481-8de0-4f58-9382-9cf8e2cbfeb7 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:03.110945 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-396f6481-8de0-4f58-9382-9cf8e2cbfeb7 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:03.127464 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-396f6481-8de0-4f58-9382-9cf8e2cbfeb7 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d" status: 200 len: 1278 microversion: 2.1 time: 0.183662 Sep 24 21:04:03.128843 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1907/3855] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:02 2022] GET /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d => generated 1278 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:03.134830 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-b545099f-0bab-4b95-8b53-8420668ac7c6 req-98f0f1c9-6edc-4eff-844a-60eea302a036 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff3106d1-5214-48ea-857b-fd505d8712c7", "name": "network-vif-plugged", "status": "completed", "tag": "c94cdbed-0fb2-4f9b-bbfd-fc0d8d9b75a8"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:03.145873 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-b545099f-0bab-4b95-8b53-8420668ac7c6 req-98f0f1c9-6edc-4eff-844a-60eea302a036 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:03.146795 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-b545099f-0bab-4b95-8b53-8420668ac7c6 req-98f0f1c9-6edc-4eff-844a-60eea302a036 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:03.147458 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-b545099f-0bab-4b95-8b53-8420668ac7c6 req-98f0f1c9-6edc-4eff-844a-60eea302a036 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:03.161112 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-b545099f-0bab-4b95-8b53-8420668ac7c6 req-98f0f1c9-6edc-4eff-844a-60eea302a036 service nova] Creating event network-vif-plugged:c94cdbed-0fb2-4f9b-bbfd-fc0d8d9b75a8 for instance ff3106d1-5214-48ea-857b-fd505d8712c7 on nch2-master-1 Sep 24 21:04:03.170692 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-b545099f-0bab-4b95-8b53-8420668ac7c6 req-98f0f1c9-6edc-4eff-844a-60eea302a036 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040331 Sep 24 21:04:03.179329 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1908/3856] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:04:03.190077 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7e003a34-6e7e-49ca-92e3-a698eb0c2ebd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:03.193764 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-de66b350-dc68-4d35-9879-fd92239c7c71 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:03.195299 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-de66b350-dc68-4d35-9879-fd92239c7c71 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:03.202666 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de66b350-dc68-4d35-9879-fd92239c7c71 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:03.203539 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de66b350-dc68-4d35-9879-fd92239c7c71 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:03.204336 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de66b350-dc68-4d35-9879-fd92239c7c71 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:03.205297 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de66b350-dc68-4d35-9879-fd92239c7c71 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:03.206062 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de66b350-dc68-4d35-9879-fd92239c7c71 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:03.206924 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de66b350-dc68-4d35-9879-fd92239c7c71 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:03.212729 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7e003a34-6e7e-49ca-92e3-a698eb0c2ebd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1321 microversion: 2.1 time: 0.775068 Sep 24 21:04:03.228838 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1949/3857] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:02 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1321 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:03.326145 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-00e56090-ff84-4bac-9c71-19bf82f10f87 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:03.326944 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-00e56090-ff84-4bac-9c71-19bf82f10f87 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:03.334184 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00e56090-ff84-4bac-9c71-19bf82f10f87 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:03.335032 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00e56090-ff84-4bac-9c71-19bf82f10f87 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:03.335587 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00e56090-ff84-4bac-9c71-19bf82f10f87 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:03.336406 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00e56090-ff84-4bac-9c71-19bf82f10f87 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:03.336968 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00e56090-ff84-4bac-9c71-19bf82f10f87 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:03.337473 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00e56090-ff84-4bac-9c71-19bf82f10f87 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:03.669963 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-de66b350-dc68-4d35-9879-fd92239c7c71 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:03.681087 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-de66b350-dc68-4d35-9879-fd92239c7c71 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1678 microversion: 2.1 time: 0.495117 Sep 24 21:04:03.685067 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1909/3858] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:03 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1678 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:03.695819 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-449a7b10-e0c5-4fe8-993e-d71aa14bdf6e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:03.696557 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-449a7b10-e0c5-4fe8-993e-d71aa14bdf6e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ff3106d1-5214-48ea-857b-fd505d8712c7] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:03.704101 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-449a7b10-e0c5-4fe8-993e-d71aa14bdf6e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:03.704797 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-449a7b10-e0c5-4fe8-993e-d71aa14bdf6e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:03.713547 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-449a7b10-e0c5-4fe8-993e-d71aa14bdf6e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:03.714742 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-449a7b10-e0c5-4fe8-993e-d71aa14bdf6e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:03.715305 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-449a7b10-e0c5-4fe8-993e-d71aa14bdf6e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:03.716429 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-449a7b10-e0c5-4fe8-993e-d71aa14bdf6e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:03.843910 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-00e56090-ff84-4bac-9c71-19bf82f10f87 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:03.854877 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-00e56090-ff84-4bac-9c71-19bf82f10f87 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1522 microversion: 2.1 time: 0.532693 Sep 24 21:04:03.872993 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1950/3859] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:03 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1522 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:03.968524 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-aaf71f57-84d5-43bb-9a32-4831e00ec7f3 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:03.969064 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-aaf71f57-84d5-43bb-9a32-4831e00ec7f3 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] [instance: b6106703-7709-41ea-a56c-935391c05827] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:03.980484 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aaf71f57-84d5-43bb-9a32-4831e00ec7f3 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:03.983100 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aaf71f57-84d5-43bb-9a32-4831e00ec7f3 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:03.983413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aaf71f57-84d5-43bb-9a32-4831e00ec7f3 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:03.984172 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aaf71f57-84d5-43bb-9a32-4831e00ec7f3 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:03.987916 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aaf71f57-84d5-43bb-9a32-4831e00ec7f3 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:03.988647 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aaf71f57-84d5-43bb-9a32-4831e00ec7f3 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:04.020371 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-aaf71f57-84d5-43bb-9a32-4831e00ec7f3 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] HTTP exception thrown: Instance b6106703-7709-41ea-a56c-935391c05827 could not be found. Sep 24 21:04:04.020581 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-449a7b10-e0c5-4fe8-993e-d71aa14bdf6e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-aaf71f57-84d5-43bb-9a32-4831e00ec7f3 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Request method failure captured: Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/b6106703-7709-41ea-a56c-935391c05827 HTTP/1.1 Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3CfFkvMtQ-NIIdh7CGtv9WnAQGH9bRqSFef-TqCK_o7577Pk_h4HNGLONsuac2evFYB4z8sbB4mVtrZ-2m6RMSGTeKHa3keg-H9kb_M9p9MiYVrjumLZOzzorxtMsVrT0fOYulxtDeaRrEuJk0SM3E3drKb8MJ7OkBJ1K1UJV57Bsc Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: e6d75184d9cd4fed89c0e1d0d5d910fd Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServerGroupTestJSON-525270238 Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6d75184d9cd4fed89c0e1d0d5d910fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e6d75184d9cd4fed89c0e1d0d5d910fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e6d75184d9cd4fed89c0e1d0d5d910fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6d75184d9cd4fed89c0e1d0d5d910fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServerGroupTestJSON-525270238 Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: e6d75184d9cd4fed89c0e1d0d5d910fd Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServerGroupTestJSON-525270238 Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServerGroupTestJSON-525270238-project Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 7654d225081948cabad9d2cdbf03ebda Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServerGroupTestJSON-525270238-project Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance b6106703-7709-41ea-a56c-935391c05827 could not be found. Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'b6106703-7709-41ea-a56c-935391c05827'} Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6106703-7709-41ea-a56c-935391c05827 could not be found. Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6106703-7709-41ea-a56c-935391c05827 could not be found. Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:04:04.022429 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:04:04.027396 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:04.027396 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:04:04.027396 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:04:04.027396 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:04:04.027396 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:04:04.027396 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6106703-7709-41ea-a56c-935391c05827 could not be found. Sep 24 21:04:04.027396 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:04:04.029707 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-aaf71f57-84d5-43bb-9a32-4831e00ec7f3 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Returning 404 to user: Instance b6106703-7709-41ea-a56c-935391c05827 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:04:04.031081 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-aaf71f57-84d5-43bb-9a32-4831e00ec7f3 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "GET /compute/v2.1/servers/b6106703-7709-41ea-a56c-935391c05827" status: 404 len: 111 microversion: 2.1 time: 0.067882 Sep 24 21:04:04.042562 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-449a7b10-e0c5-4fe8-993e-d71aa14bdf6e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/ff3106d1-5214-48ea-857b-fd505d8712c7" status: 200 len: 1321 microversion: 2.1 time: 0.346370 Sep 24 21:04:04.042562 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1910/3860] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:03 2022] GET /compute/v2.1/servers/ff3106d1-5214-48ea-857b-fd505d8712c7 => generated 1321 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:04.043709 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1951/3861] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:03 2022] GET /compute/v2.1/servers/b6106703-7709-41ea-a56c-935391c05827 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 21:04:04.047203 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e19f22b0-678d-419c-8bc6-ae92bd65d8d3 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:04.088790 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.compute.server_groups [None req-e19f22b0-678d-419c-8bc6-ae92bd65d8d3 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Querying cell 788aecb6-32dc-4b71-909a-be050455aded(cell1) for 1 instances {{(pid=140517) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 24 21:04:04.089822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e19f22b0-678d-419c-8bc6-ae92bd65d8d3 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:04.090318 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e19f22b0-678d-419c-8bc6-ae92bd65d8d3 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:04.090822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e19f22b0-678d-419c-8bc6-ae92bd65d8d3 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:04.101472 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e19f22b0-678d-419c-8bc6-ae92bd65d8d3 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.058980 Sep 24 21:04:04.102073 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1911/3862] 10.222.0.52 () {58 vars in 1152 bytes} [Sat Sep 24 21:04:04 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:04:04.115258 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4aecfc5d-5ec0-4dd0-bc1d-8bd6c062a8c2 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:04.130712 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.compute.server_groups [None req-4aecfc5d-5ec0-4dd0-bc1d-8bd6c062a8c2 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Querying cell 788aecb6-32dc-4b71-909a-be050455aded(cell1) for 1 instances {{(pid=140516) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 24 21:04:04.131478 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4aecfc5d-5ec0-4dd0-bc1d-8bd6c062a8c2 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:04.131962 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4aecfc5d-5ec0-4dd0-bc1d-8bd6c062a8c2 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:04.133191 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4aecfc5d-5ec0-4dd0-bc1d-8bd6c062a8c2 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:04.144663 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4aecfc5d-5ec0-4dd0-bc1d-8bd6c062a8c2 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups/69c83283-fbf2-49d7-bc6e-8a37519f7786" status: 200 len: 184 microversion: 2.1 time: 0.033111 Sep 24 21:04:04.146616 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1952/3863] 10.222.0.52 () {58 vars in 1263 bytes} [Sat Sep 24 21:04:04 2022] GET /compute/v2.1/os-server-groups/69c83283-fbf2-49d7-bc6e-8a37519f7786 => generated 184 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:04:04.159203 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7da5e399-59e1-423d-bd44-e77e54bac02b tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:04.159711 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7da5e399-59e1-423d-bd44-e77e54bac02b tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] [instance: b6106703-7709-41ea-a56c-935391c05827] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:04.162440 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1f8b1aa6-aad5-492c-a303-3b4ca937225a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:04.164090 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1f8b1aa6-aad5-492c-a303-3b4ca937225a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 1f788a90-8f36-4262-957b-6d4e43e6568d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:04.167842 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7da5e399-59e1-423d-bd44-e77e54bac02b tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:04.168538 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7da5e399-59e1-423d-bd44-e77e54bac02b tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:04.169192 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7da5e399-59e1-423d-bd44-e77e54bac02b tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:04.170160 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7da5e399-59e1-423d-bd44-e77e54bac02b tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:04.171304 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7da5e399-59e1-423d-bd44-e77e54bac02b tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:04.171948 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7da5e399-59e1-423d-bd44-e77e54bac02b tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:04.175173 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f8b1aa6-aad5-492c-a303-3b4ca937225a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:04.175678 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f8b1aa6-aad5-492c-a303-3b4ca937225a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:04.176247 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f8b1aa6-aad5-492c-a303-3b4ca937225a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:04.178692 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f8b1aa6-aad5-492c-a303-3b4ca937225a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:04.179829 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f8b1aa6-aad5-492c-a303-3b4ca937225a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:04.180279 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f8b1aa6-aad5-492c-a303-3b4ca937225a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:04.187808 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-7da5e399-59e1-423d-bd44-e77e54bac02b tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] HTTP exception thrown: Instance b6106703-7709-41ea-a56c-935391c05827 could not be found. Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7da5e399-59e1-423d-bd44-e77e54bac02b tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Request method failure captured: Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/servers/b6106703-7709-41ea-a56c-935391c05827 HTTP/1.1 Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3CfFkvMtQ-NIIdh7CGtv9WnAQGH9bRqSFef-TqCK_o7577Pk_h4HNGLONsuac2evFYB4z8sbB4mVtrZ-2m6RMSGTeKHa3keg-H9kb_M9p9MiYVrjumLZOzzorxtMsVrT0fOYulxtDeaRrEuJk0SM3E3drKb8MJ7OkBJ1K1UJV57Bsc Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: e6d75184d9cd4fed89c0e1d0d5d910fd Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServerGroupTestJSON-525270238 Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6d75184d9cd4fed89c0e1d0d5d910fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e6d75184d9cd4fed89c0e1d0d5d910fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e6d75184d9cd4fed89c0e1d0d5d910fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6d75184d9cd4fed89c0e1d0d5d910fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServerGroupTestJSON-525270238 Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: e6d75184d9cd4fed89c0e1d0d5d910fd Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServerGroupTestJSON-525270238 Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServerGroupTestJSON-525270238-project Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 7654d225081948cabad9d2cdbf03ebda Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServerGroupTestJSON-525270238-project Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance b6106703-7709-41ea-a56c-935391c05827 could not be found. Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'b6106703-7709-41ea-a56c-935391c05827'} Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6106703-7709-41ea-a56c-935391c05827 could not be found. Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:04:04.189738 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:04:04.195945 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6106703-7709-41ea-a56c-935391c05827 could not be found. Sep 24 21:04:04.195945 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:04.195945 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:04:04.195945 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:04.195945 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:04.195945 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:04:04.195945 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:04:04.195945 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:04:04.195945 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:04:04.195945 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6106703-7709-41ea-a56c-935391c05827 could not be found. Sep 24 21:04:04.195945 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:04.199403 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7da5e399-59e1-423d-bd44-e77e54bac02b tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Returning 404 to user: Instance b6106703-7709-41ea-a56c-935391c05827 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:04:04.200883 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7da5e399-59e1-423d-bd44-e77e54bac02b tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b6106703-7709-41ea-a56c-935391c05827" status: 404 len: 111 microversion: 2.1 time: 0.046836 Sep 24 21:04:04.205568 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1912/3864] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:04:04 2022] DELETE /compute/v2.1/servers/b6106703-7709-41ea-a56c-935391c05827 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 21:04:04.213255 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b163cb99-2d53-42a2-8d45-8ce69e3b54a3 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:04.214380 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b163cb99-2d53-42a2-8d45-8ce69e3b54a3 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] [instance: b6106703-7709-41ea-a56c-935391c05827] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:04.220972 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b163cb99-2d53-42a2-8d45-8ce69e3b54a3 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:04.221404 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b163cb99-2d53-42a2-8d45-8ce69e3b54a3 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:04.221855 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b163cb99-2d53-42a2-8d45-8ce69e3b54a3 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:04.222604 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b163cb99-2d53-42a2-8d45-8ce69e3b54a3 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:04.223273 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b163cb99-2d53-42a2-8d45-8ce69e3b54a3 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:04.223804 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b163cb99-2d53-42a2-8d45-8ce69e3b54a3 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:04.243807 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-b163cb99-2d53-42a2-8d45-8ce69e3b54a3 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] HTTP exception thrown: Instance b6106703-7709-41ea-a56c-935391c05827 could not be found. Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b163cb99-2d53-42a2-8d45-8ce69e3b54a3 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Request method failure captured: Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/b6106703-7709-41ea-a56c-935391c05827 HTTP/1.1 Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3CfFkvMtQ-NIIdh7CGtv9WnAQGH9bRqSFef-TqCK_o7577Pk_h4HNGLONsuac2evFYB4z8sbB4mVtrZ-2m6RMSGTeKHa3keg-H9kb_M9p9MiYVrjumLZOzzorxtMsVrT0fOYulxtDeaRrEuJk0SM3E3drKb8MJ7OkBJ1K1UJV57Bsc Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: e6d75184d9cd4fed89c0e1d0d5d910fd Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServerGroupTestJSON-525270238 Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6d75184d9cd4fed89c0e1d0d5d910fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e6d75184d9cd4fed89c0e1d0d5d910fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e6d75184d9cd4fed89c0e1d0d5d910fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6d75184d9cd4fed89c0e1d0d5d910fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServerGroupTestJSON-525270238 Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: e6d75184d9cd4fed89c0e1d0d5d910fd Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServerGroupTestJSON-525270238 Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServerGroupTestJSON-525270238-project Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 7654d225081948cabad9d2cdbf03ebda Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServerGroupTestJSON-525270238-project Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance b6106703-7709-41ea-a56c-935391c05827 could not be found. Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'b6106703-7709-41ea-a56c-935391c05827'} Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6106703-7709-41ea-a56c-935391c05827 could not be found. Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6106703-7709-41ea-a56c-935391c05827 could not be found. Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:04:04.246323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:04.250598 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:04.250598 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:04:04.250598 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:04:04.250598 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:04:04.250598 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:04:04.250598 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6106703-7709-41ea-a56c-935391c05827 could not be found. Sep 24 21:04:04.250598 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:04.252293 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b163cb99-2d53-42a2-8d45-8ce69e3b54a3 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Returning 404 to user: Instance b6106703-7709-41ea-a56c-935391c05827 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:04:04.253442 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b163cb99-2d53-42a2-8d45-8ce69e3b54a3 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "GET /compute/v2.1/servers/b6106703-7709-41ea-a56c-935391c05827" status: 404 len: 111 microversion: 2.1 time: 0.046705 Sep 24 21:04:04.257589 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1913/3865] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:04 2022] GET /compute/v2.1/servers/b6106703-7709-41ea-a56c-935391c05827 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:04:04.260304 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-52c51d48-0568-427e-a94e-a813da742e46 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:04.260927 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-52c51d48-0568-427e-a94e-a813da742e46 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:04.267790 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52c51d48-0568-427e-a94e-a813da742e46 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:04.268787 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52c51d48-0568-427e-a94e-a813da742e46 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:04.268787 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52c51d48-0568-427e-a94e-a813da742e46 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:04.269408 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52c51d48-0568-427e-a94e-a813da742e46 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:04.269866 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52c51d48-0568-427e-a94e-a813da742e46 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:04.270301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52c51d48-0568-427e-a94e-a813da742e46 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:04.509722 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1f8b1aa6-aad5-492c-a303-3b4ca937225a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:04.519894 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1f8b1aa6-aad5-492c-a303-3b4ca937225a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d" status: 200 len: 1320 microversion: 2.1 time: 0.365230 Sep 24 21:04:04.520717 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1953/3866] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:04 2022] GET /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d => generated 1320 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:04.526583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ba3cd7cf-5268-4239-a7e7-3970e7db7572 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:04.537871 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-ba3cd7cf-5268-4239-a7e7-3970e7db7572 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] HTTP exception thrown: Instance group 35d3bcbb-147b-4ff3-9af3-d932c8e0017d could not be found. Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ba3cd7cf-5268-4239-a7e7-3970e7db7572 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Request method failure captured: Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/os-server-groups/35d3bcbb-147b-4ff3-9af3-d932c8e0017d HTTP/1.1 Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3CfFkvMtQ-NIIdh7CGtv9WnAQGH9bRqSFef-TqCK_o7577Pk_h4HNGLONsuac2evFYB4z8sbB4mVtrZ-2m6RMSGTeKHa3keg-H9kb_M9p9MiYVrjumLZOzzorxtMsVrT0fOYulxtDeaRrEuJk0SM3E3drKb8MJ7OkBJ1K1UJV57Bsc Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: e6d75184d9cd4fed89c0e1d0d5d910fd Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServerGroupTestJSON-525270238 Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6d75184d9cd4fed89c0e1d0d5d910fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e6d75184d9cd4fed89c0e1d0d5d910fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e6d75184d9cd4fed89c0e1d0d5d910fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6d75184d9cd4fed89c0e1d0d5d910fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServerGroupTestJSON-525270238 Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: e6d75184d9cd4fed89c0e1d0d5d910fd Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServerGroupTestJSON-525270238 Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServerGroupTestJSON-525270238-project Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 7654d225081948cabad9d2cdbf03ebda Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServerGroupTestJSON-525270238-project Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance group 35d3bcbb-147b-4ff3-9af3-d932c8e0017d could not be found. Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '35d3bcbb-147b-4ff3-9af3-d932c8e0017d'} Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 35d3bcbb-147b-4ff3-9af3-d932c8e0017d could not be found. Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 35d3bcbb-147b-4ff3-9af3-d932c8e0017d could not be found. Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:04:04.546294 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:04.551953 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:04:04.551953 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:04:04.551953 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:04:04.551953 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:04:04.551953 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 35d3bcbb-147b-4ff3-9af3-d932c8e0017d could not be found. Sep 24 21:04:04.551953 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:04:04.558807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ba3cd7cf-5268-4239-a7e7-3970e7db7572 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Returning 404 to user: Instance group 35d3bcbb-147b-4ff3-9af3-d932c8e0017d could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:04:04.560022 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ba3cd7cf-5268-4239-a7e7-3970e7db7572 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/35d3bcbb-147b-4ff3-9af3-d932c8e0017d" status: 404 len: 117 microversion: 2.1 time: 0.037964 Sep 24 21:04:04.561271 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1954/3867] 10.222.0.52 () {58 vars in 1266 bytes} [Sat Sep 24 21:04:04 2022] DELETE /compute/v2.1/os-server-groups/35d3bcbb-147b-4ff3-9af3-d932c8e0017d => generated 117 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:04:04.568830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5978f2fe-170b-4787-9690-ec943a859fc4 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:04.571806 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-52c51d48-0568-427e-a94e-a813da742e46 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:04.576859 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-5978f2fe-170b-4787-9690-ec943a859fc4 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] HTTP exception thrown: Instance group 3fc1e9af-3eb3-4389-b4bf-a9e6da5c98ef could not be found. Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5978f2fe-170b-4787-9690-ec943a859fc4 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Request method failure captured: Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/os-server-groups/3fc1e9af-3eb3-4389-b4bf-a9e6da5c98ef HTTP/1.1 Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3CfFkvMtQ-NIIdh7CGtv9WnAQGH9bRqSFef-TqCK_o7577Pk_h4HNGLONsuac2evFYB4z8sbB4mVtrZ-2m6RMSGTeKHa3keg-H9kb_M9p9MiYVrjumLZOzzorxtMsVrT0fOYulxtDeaRrEuJk0SM3E3drKb8MJ7OkBJ1K1UJV57Bsc Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: e6d75184d9cd4fed89c0e1d0d5d910fd Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServerGroupTestJSON-525270238 Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6d75184d9cd4fed89c0e1d0d5d910fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e6d75184d9cd4fed89c0e1d0d5d910fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e6d75184d9cd4fed89c0e1d0d5d910fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6d75184d9cd4fed89c0e1d0d5d910fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServerGroupTestJSON-525270238 Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: e6d75184d9cd4fed89c0e1d0d5d910fd Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServerGroupTestJSON-525270238 Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServerGroupTestJSON-525270238-project Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 7654d225081948cabad9d2cdbf03ebda Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServerGroupTestJSON-525270238-project Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance group 3fc1e9af-3eb3-4389-b4bf-a9e6da5c98ef could not be found. Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '3fc1e9af-3eb3-4389-b4bf-a9e6da5c98ef'} Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 3fc1e9af-3eb3-4389-b4bf-a9e6da5c98ef could not be found. Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 3fc1e9af-3eb3-4389-b4bf-a9e6da5c98ef could not be found. Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:04:04.578486 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:04.583397 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:04:04.583397 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:04:04.583397 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:04:04.583397 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:04:04.583397 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 3fc1e9af-3eb3-4389-b4bf-a9e6da5c98ef could not be found. Sep 24 21:04:04.583397 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:04:04.583397 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5978f2fe-170b-4787-9690-ec943a859fc4 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Returning 404 to user: Instance group 3fc1e9af-3eb3-4389-b4bf-a9e6da5c98ef could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:04:04.584732 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5978f2fe-170b-4787-9690-ec943a859fc4 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/3fc1e9af-3eb3-4389-b4bf-a9e6da5c98ef" status: 404 len: 117 microversion: 2.1 time: 0.019682 Sep 24 21:04:04.585744 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1955/3868] 10.222.0.52 () {58 vars in 1266 bytes} [Sat Sep 24 21:04:04 2022] DELETE /compute/v2.1/os-server-groups/3fc1e9af-3eb3-4389-b4bf-a9e6da5c98ef => generated 117 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 21:04:04.591184 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-52c51d48-0568-427e-a94e-a813da742e46 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1513 microversion: 2.1 time: 0.335091 Sep 24 21:04:04.592931 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1914/3869] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:04 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1513 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:04.609767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a3d5b8ac-71c7-4d82-829f-db7f4480d010 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:04.620922 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-a3d5b8ac-71c7-4d82-829f-db7f4480d010 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] HTTP exception thrown: Instance group b8cad649-4f62-411b-b145-986152705cf6 could not be found. Sep 24 21:04:04.621445 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bcae6a55-e041-46ce-a030-0e131640ff9e tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a3d5b8ac-71c7-4d82-829f-db7f4480d010 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Request method failure captured: Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/os-server-groups/b8cad649-4f62-411b-b145-986152705cf6 HTTP/1.1 Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3CfFkvMtQ-NIIdh7CGtv9WnAQGH9bRqSFef-TqCK_o7577Pk_h4HNGLONsuac2evFYB4z8sbB4mVtrZ-2m6RMSGTeKHa3keg-H9kb_M9p9MiYVrjumLZOzzorxtMsVrT0fOYulxtDeaRrEuJk0SM3E3drKb8MJ7OkBJ1K1UJV57Bsc Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: e6d75184d9cd4fed89c0e1d0d5d910fd Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServerGroupTestJSON-525270238 Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6d75184d9cd4fed89c0e1d0d5d910fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e6d75184d9cd4fed89c0e1d0d5d910fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e6d75184d9cd4fed89c0e1d0d5d910fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6d75184d9cd4fed89c0e1d0d5d910fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServerGroupTestJSON-525270238 Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: e6d75184d9cd4fed89c0e1d0d5d910fd Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServerGroupTestJSON-525270238 Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServerGroupTestJSON-525270238-project Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 7654d225081948cabad9d2cdbf03ebda Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServerGroupTestJSON-525270238-project Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance group b8cad649-4f62-411b-b145-986152705cf6 could not be found. Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'b8cad649-4f62-411b-b145-986152705cf6'} Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group b8cad649-4f62-411b-b145-986152705cf6 could not be found. Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group b8cad649-4f62-411b-b145-986152705cf6 could not be found. Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:04:04.623322 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:04.627490 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:04:04.627490 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:04:04.627490 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:04:04.627490 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:04:04.627490 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group b8cad649-4f62-411b-b145-986152705cf6 could not be found. Sep 24 21:04:04.627490 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:04:04.628149 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bcae6a55-e041-46ce-a030-0e131640ff9e tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:04.630150 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a3d5b8ac-71c7-4d82-829f-db7f4480d010 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Returning 404 to user: Instance group b8cad649-4f62-411b-b145-986152705cf6 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:04:04.631288 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a3d5b8ac-71c7-4d82-829f-db7f4480d010 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/b8cad649-4f62-411b-b145-986152705cf6" status: 404 len: 117 microversion: 2.1 time: 0.041472 Sep 24 21:04:04.632664 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1956/3870] 10.222.0.52 () {58 vars in 1266 bytes} [Sat Sep 24 21:04:04 2022] DELETE /compute/v2.1/os-server-groups/b8cad649-4f62-411b-b145-986152705cf6 => generated 117 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 21:04:04.642001 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bfc75101-9d06-4e1e-ab7c-7bc8fa8389ff tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:04.643152 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bcae6a55-e041-46ce-a030-0e131640ff9e tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:04.643848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bcae6a55-e041-46ce-a030-0e131640ff9e tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:04.645100 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bcae6a55-e041-46ce-a030-0e131640ff9e tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:04.646019 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bcae6a55-e041-46ce-a030-0e131640ff9e tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:04.646690 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bcae6a55-e041-46ce-a030-0e131640ff9e tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:04.647312 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bcae6a55-e041-46ce-a030-0e131640ff9e tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:04.650133 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-bfc75101-9d06-4e1e-ab7c-7bc8fa8389ff tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] HTTP exception thrown: Instance group ff3f9326-c8e4-47f9-a9b7-a4ba31a876cc could not be found. Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bfc75101-9d06-4e1e-ab7c-7bc8fa8389ff tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Request method failure captured: Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/os-server-groups/ff3f9326-c8e4-47f9-a9b7-a4ba31a876cc HTTP/1.1 Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3CfFkvMtQ-NIIdh7CGtv9WnAQGH9bRqSFef-TqCK_o7577Pk_h4HNGLONsuac2evFYB4z8sbB4mVtrZ-2m6RMSGTeKHa3keg-H9kb_M9p9MiYVrjumLZOzzorxtMsVrT0fOYulxtDeaRrEuJk0SM3E3drKb8MJ7OkBJ1K1UJV57Bsc Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: e6d75184d9cd4fed89c0e1d0d5d910fd Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServerGroupTestJSON-525270238 Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6d75184d9cd4fed89c0e1d0d5d910fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e6d75184d9cd4fed89c0e1d0d5d910fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e6d75184d9cd4fed89c0e1d0d5d910fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6d75184d9cd4fed89c0e1d0d5d910fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServerGroupTestJSON-525270238 Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: e6d75184d9cd4fed89c0e1d0d5d910fd Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServerGroupTestJSON-525270238 Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServerGroupTestJSON-525270238-project Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 7654d225081948cabad9d2cdbf03ebda Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServerGroupTestJSON-525270238-project Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance group ff3f9326-c8e4-47f9-a9b7-a4ba31a876cc could not be found. Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'ff3f9326-c8e4-47f9-a9b7-a4ba31a876cc'} Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ff3f9326-c8e4-47f9-a9b7-a4ba31a876cc could not be found. Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ff3f9326-c8e4-47f9-a9b7-a4ba31a876cc could not be found. Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:04:04.653304 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:04.658428 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:04:04.658428 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:04:04.658428 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:04:04.658428 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:04:04.658428 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ff3f9326-c8e4-47f9-a9b7-a4ba31a876cc could not be found. Sep 24 21:04:04.658428 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:04:04.658428 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bfc75101-9d06-4e1e-ab7c-7bc8fa8389ff tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Returning 404 to user: Instance group ff3f9326-c8e4-47f9-a9b7-a4ba31a876cc could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:04:04.659040 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bfc75101-9d06-4e1e-ab7c-7bc8fa8389ff tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/ff3f9326-c8e4-47f9-a9b7-a4ba31a876cc" status: 404 len: 117 microversion: 2.1 time: 0.020204 Sep 24 21:04:04.660172 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1957/3871] 10.222.0.52 () {58 vars in 1266 bytes} [Sat Sep 24 21:04:04 2022] DELETE /compute/v2.1/os-server-groups/ff3f9326-c8e4-47f9-a9b7-a4ba31a876cc => generated 117 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:04:04.668293 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6eca0ca9-f321-4834-920f-c62c6c101d35 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:04.680972 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-bcae6a55-e041-46ce-a030-0e131640ff9e tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lazy-loading 'flavor' on Instance uuid 1b2e4ce4-809e-4888-8205-eae021e2fb8c {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:04:04.704155 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6eca0ca9-f321-4834-920f-c62c6c101d35 tempest-ServerGroupTestJSON-525270238 tempest-ServerGroupTestJSON-525270238-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/69c83283-fbf2-49d7-bc6e-8a37519f7786" status: 204 len: 0 microversion: 2.1 time: 0.040318 Sep 24 21:04:04.705250 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1958/3872] 10.222.0.52 () {58 vars in 1266 bytes} [Sat Sep 24 21:04:04 2022] DELETE /compute/v2.1/os-server-groups/69c83283-fbf2-49d7-bc6e-8a37519f7786 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:04:04.715482 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f36c5c1f-87a1-46d2-bd6a-c7623eb13e08 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:04.716597 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f36c5c1f-87a1-46d2-bd6a-c7623eb13e08 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:04.724718 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f36c5c1f-87a1-46d2-bd6a-c7623eb13e08 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:04.725249 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f36c5c1f-87a1-46d2-bd6a-c7623eb13e08 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:04.729582 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f36c5c1f-87a1-46d2-bd6a-c7623eb13e08 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:04.729582 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f36c5c1f-87a1-46d2-bd6a-c7623eb13e08 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:04.729582 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f36c5c1f-87a1-46d2-bd6a-c7623eb13e08 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:04.729582 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f36c5c1f-87a1-46d2-bd6a-c7623eb13e08 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:04.780285 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bcae6a55-e041-46ce-a030-0e131640ff9e tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "POST /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c/action" status: 200 len: 32 microversion: 2.1 time: 0.163393 Sep 24 21:04:04.781237 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1915/3873] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:04:04 2022] POST /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c/action => generated 32 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 24 21:04:04.794048 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-98010be7-cf74-429f-a83c-da8ddaae9738 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:04.795389 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-98010be7-cf74-429f-a83c-da8ddaae9738 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:04.805225 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98010be7-cf74-429f-a83c-da8ddaae9738 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:04.805961 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98010be7-cf74-429f-a83c-da8ddaae9738 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:04.807457 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98010be7-cf74-429f-a83c-da8ddaae9738 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:04.808770 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98010be7-cf74-429f-a83c-da8ddaae9738 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:04.809542 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98010be7-cf74-429f-a83c-da8ddaae9738 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:04.810882 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98010be7-cf74-429f-a83c-da8ddaae9738 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:05.455877 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-98010be7-cf74-429f-a83c-da8ddaae9738 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:05.464471 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-98010be7-cf74-429f-a83c-da8ddaae9738 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1519 microversion: 2.1 time: 0.676436 Sep 24 21:04:05.479533 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1916/3874] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:04 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1519 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:05.486775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9c75d707-1c8a-473e-a1d2-3461bbbc4f55 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:05.487650 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9c75d707-1c8a-473e-a1d2-3461bbbc4f55 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:05.494739 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c75d707-1c8a-473e-a1d2-3461bbbc4f55 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:05.495460 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c75d707-1c8a-473e-a1d2-3461bbbc4f55 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:05.496240 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c75d707-1c8a-473e-a1d2-3461bbbc4f55 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:05.497450 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c75d707-1c8a-473e-a1d2-3461bbbc4f55 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:05.498192 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c75d707-1c8a-473e-a1d2-3461bbbc4f55 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:05.498774 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c75d707-1c8a-473e-a1d2-3461bbbc4f55 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:05.566480 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f36c5c1f-87a1-46d2-bd6a-c7623eb13e08 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:05.581164 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f36c5c1f-87a1-46d2-bd6a-c7623eb13e08 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1678 microversion: 2.1 time: 0.874488 Sep 24 21:04:05.582066 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1959/3875] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:04 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1678 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:05.603940 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-66e8f511-98ab-4367-a204-4aec0131f2c8 req-d64e29a4-5c3a-4780-87ef-a4ce28cb386b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06ef44f5-3eae-4780-b544-62102fd945a7", "tag": "cb75d66c-318e-44c6-a426-ef41aef9d16c"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:05.620654 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-66e8f511-98ab-4367-a204-4aec0131f2c8 req-d64e29a4-5c3a-4780-87ef-a4ce28cb386b service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:05.621484 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-66e8f511-98ab-4367-a204-4aec0131f2c8 req-d64e29a4-5c3a-4780-87ef-a4ce28cb386b service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:05.622077 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-66e8f511-98ab-4367-a204-4aec0131f2c8 req-d64e29a4-5c3a-4780-87ef-a4ce28cb386b service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:05.640450 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-66e8f511-98ab-4367-a204-4aec0131f2c8 req-d64e29a4-5c3a-4780-87ef-a4ce28cb386b service nova] Creating event network-changed:cb75d66c-318e-44c6-a426-ef41aef9d16c for instance 06ef44f5-3eae-4780-b544-62102fd945a7 on nch2-master-1 Sep 24 21:04:05.646684 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-66e8f511-98ab-4367-a204-4aec0131f2c8 req-d64e29a4-5c3a-4780-87ef-a4ce28cb386b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062340 Sep 24 21:04:05.648047 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1960/3876] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:04:05.654850 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-22784d23-8cdb-4fb6-aa24-2559b6a1e90b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:05.657565 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-22784d23-8cdb-4fb6-aa24-2559b6a1e90b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ff3106d1-5214-48ea-857b-fd505d8712c7] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:05.666272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22784d23-8cdb-4fb6-aa24-2559b6a1e90b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:05.667231 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22784d23-8cdb-4fb6-aa24-2559b6a1e90b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:05.667894 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22784d23-8cdb-4fb6-aa24-2559b6a1e90b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:05.668972 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22784d23-8cdb-4fb6-aa24-2559b6a1e90b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:05.669674 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22784d23-8cdb-4fb6-aa24-2559b6a1e90b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:05.670430 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22784d23-8cdb-4fb6-aa24-2559b6a1e90b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:06.363182 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9c75d707-1c8a-473e-a1d2-3461bbbc4f55 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:06.372221 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9c75d707-1c8a-473e-a1d2-3461bbbc4f55 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1522 microversion: 2.1 time: 0.891224 Sep 24 21:04:06.372806 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1917/3877] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:05 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1522 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:06.377639 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-e0a04141-3f18-438b-b096-133af40faca9 req-7dc6e741-d6c7-45d8-9519-77cabfdbdf65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "275263e1-8a0a-4f58-b863-b56c2bf3a7c0", "tag": "8fb22600-0f74-4477-87fa-054ddb7fc0af"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:06.390390 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e0a04141-3f18-438b-b096-133af40faca9 req-7dc6e741-d6c7-45d8-9519-77cabfdbdf65 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:06.391013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e0a04141-3f18-438b-b096-133af40faca9 req-7dc6e741-d6c7-45d8-9519-77cabfdbdf65 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:06.391514 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e0a04141-3f18-438b-b096-133af40faca9 req-7dc6e741-d6c7-45d8-9519-77cabfdbdf65 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:06.400308 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-22784d23-8cdb-4fb6-aa24-2559b6a1e90b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:06.404413 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-e0a04141-3f18-438b-b096-133af40faca9 req-7dc6e741-d6c7-45d8-9519-77cabfdbdf65 service nova] Creating event network-changed:8fb22600-0f74-4477-87fa-054ddb7fc0af for instance 275263e1-8a0a-4f58-b863-b56c2bf3a7c0 on nch1-master-1 Sep 24 21:04:06.410164 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-e0a04141-3f18-438b-b096-133af40faca9 req-7dc6e741-d6c7-45d8-9519-77cabfdbdf65 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035813 Sep 24 21:04:06.410867 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1918/3878] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:04:06.414243 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-22784d23-8cdb-4fb6-aa24-2559b6a1e90b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/ff3106d1-5214-48ea-857b-fd505d8712c7" status: 200 len: 1502 microversion: 2.1 time: 0.764678 Sep 24 21:04:06.416070 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1961/3879] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:05 2022] GET /compute/v2.1/servers/ff3106d1-5214-48ea-857b-fd505d8712c7 => generated 1502 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:06.428222 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f8199a8c-8111-4651-9821-f95ee2123974 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:06.437397 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f8199a8c-8111-4651-9821-f95ee2123974 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 1f788a90-8f36-4262-957b-6d4e43e6568d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:06.446877 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e8d4d57c-d0dc-44c1-ad6f-59422f00c383 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:06.447670 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e8d4d57c-d0dc-44c1-ad6f-59422f00c383 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ff3106d1-5214-48ea-857b-fd505d8712c7] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:06.448098 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8199a8c-8111-4651-9821-f95ee2123974 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:06.448768 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8199a8c-8111-4651-9821-f95ee2123974 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:06.449209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8199a8c-8111-4651-9821-f95ee2123974 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:06.450096 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8199a8c-8111-4651-9821-f95ee2123974 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:06.450760 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8199a8c-8111-4651-9821-f95ee2123974 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:06.451197 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8199a8c-8111-4651-9821-f95ee2123974 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:06.460013 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e8d4d57c-d0dc-44c1-ad6f-59422f00c383 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:06.461055 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e8d4d57c-d0dc-44c1-ad6f-59422f00c383 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:06.461683 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e8d4d57c-d0dc-44c1-ad6f-59422f00c383 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:06.462400 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e8d4d57c-d0dc-44c1-ad6f-59422f00c383 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:06.462927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e8d4d57c-d0dc-44c1-ad6f-59422f00c383 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:06.463989 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e8d4d57c-d0dc-44c1-ad6f-59422f00c383 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:06.780876 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e8d4d57c-d0dc-44c1-ad6f-59422f00c383 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:06.785849 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f8199a8c-8111-4651-9821-f95ee2123974 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:06.796128 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e8d4d57c-d0dc-44c1-ad6f-59422f00c383 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/ff3106d1-5214-48ea-857b-fd505d8712c7" status: 200 len: 1502 microversion: 2.1 time: 0.355761 Sep 24 21:04:06.796729 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1962/3880] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:06 2022] GET /compute/v2.1/servers/ff3106d1-5214-48ea-857b-fd505d8712c7 => generated 1502 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:06.802075 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f8199a8c-8111-4651-9821-f95ee2123974 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d" status: 200 len: 1320 microversion: 2.1 time: 0.389848 Sep 24 21:04:06.803287 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1919/3881] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:06 2022] GET /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d => generated 1320 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:06.814798 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e5a26267-b64e-43d2-817a-4660b6bfcff1 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:06.816389 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d33da4b3-ad3d-44a9-aaac-65cc678d7347 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:06.817101 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e5a26267-b64e-43d2-817a-4660b6bfcff1 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:06.819379 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d33da4b3-ad3d-44a9-aaac-65cc678d7347 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:06.826369 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5a26267-b64e-43d2-817a-4660b6bfcff1 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:06.826897 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5a26267-b64e-43d2-817a-4660b6bfcff1 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:06.829092 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5a26267-b64e-43d2-817a-4660b6bfcff1 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:06.830007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5a26267-b64e-43d2-817a-4660b6bfcff1 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:06.830687 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5a26267-b64e-43d2-817a-4660b6bfcff1 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:06.831464 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5a26267-b64e-43d2-817a-4660b6bfcff1 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:06.833293 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d33da4b3-ad3d-44a9-aaac-65cc678d7347 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:06.834473 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d33da4b3-ad3d-44a9-aaac-65cc678d7347 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:06.835021 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d33da4b3-ad3d-44a9-aaac-65cc678d7347 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:06.835845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d33da4b3-ad3d-44a9-aaac-65cc678d7347 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:06.837081 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d33da4b3-ad3d-44a9-aaac-65cc678d7347 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:06.837590 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d33da4b3-ad3d-44a9-aaac-65cc678d7347 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:07.139495 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e5a26267-b64e-43d2-817a-4660b6bfcff1 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:07.147523 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e5a26267-b64e-43d2-817a-4660b6bfcff1 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1519 microversion: 2.1 time: 0.343040 Sep 24 21:04:07.148424 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1920/3882] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:06 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1519 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:07.162674 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d33da4b3-ad3d-44a9-aaac-65cc678d7347 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:07.169455 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ffc31ee8-0fe3-4fd9-b4a6-3d7fa10cffb9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:07.170222 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ffc31ee8-0fe3-4fd9-b4a6-3d7fa10cffb9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ff3106d1-5214-48ea-857b-fd505d8712c7] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:07.172165 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d33da4b3-ad3d-44a9-aaac-65cc678d7347 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1678 microversion: 2.1 time: 0.365326 Sep 24 21:04:07.173109 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1963/3883] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:06 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1678 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:07.192586 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ffc31ee8-0fe3-4fd9-b4a6-3d7fa10cffb9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:07.193085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ffc31ee8-0fe3-4fd9-b4a6-3d7fa10cffb9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:07.193526 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ffc31ee8-0fe3-4fd9-b4a6-3d7fa10cffb9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:07.194238 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ffc31ee8-0fe3-4fd9-b4a6-3d7fa10cffb9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:07.194758 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ffc31ee8-0fe3-4fd9-b4a6-3d7fa10cffb9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:07.195733 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ffc31ee8-0fe3-4fd9-b4a6-3d7fa10cffb9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:07.222226 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ffc31ee8-0fe3-4fd9-b4a6-3d7fa10cffb9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ff3106d1-5214-48ea-857b-fd505d8712c7] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:04:07.270952 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:04:07.338260 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ffc31ee8-0fe3-4fd9-b4a6-3d7fa10cffb9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ff3106d1-5214-48ea-857b-fd505d8712c7" status: 204 len: 0 microversion: 2.1 time: 0.173623 Sep 24 21:04:07.339161 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1921/3884] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:04:07 2022] DELETE /compute/v2.1/servers/ff3106d1-5214-48ea-857b-fd505d8712c7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:04:07.347917 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1b5ec3a0-57fb-451b-ab0f-4ae1ea4e17b3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:07.348714 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1b5ec3a0-57fb-451b-ab0f-4ae1ea4e17b3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ff3106d1-5214-48ea-857b-fd505d8712c7] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:07.358474 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1b5ec3a0-57fb-451b-ab0f-4ae1ea4e17b3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:07.359003 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1b5ec3a0-57fb-451b-ab0f-4ae1ea4e17b3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:07.359438 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1b5ec3a0-57fb-451b-ab0f-4ae1ea4e17b3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:07.360144 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1b5ec3a0-57fb-451b-ab0f-4ae1ea4e17b3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:07.360607 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1b5ec3a0-57fb-451b-ab0f-4ae1ea4e17b3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:07.361023 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1b5ec3a0-57fb-451b-ab0f-4ae1ea4e17b3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:07.397183 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5277e835-ede7-4395-8f19-3340f8482725 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:07.398552 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5277e835-ede7-4395-8f19-3340f8482725 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:07.405395 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5277e835-ede7-4395-8f19-3340f8482725 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:07.406116 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5277e835-ede7-4395-8f19-3340f8482725 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:07.406759 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5277e835-ede7-4395-8f19-3340f8482725 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:07.407676 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5277e835-ede7-4395-8f19-3340f8482725 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:07.408724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5277e835-ede7-4395-8f19-3340f8482725 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:07.409471 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5277e835-ede7-4395-8f19-3340f8482725 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:07.721127 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1b5ec3a0-57fb-451b-ab0f-4ae1ea4e17b3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:07.730534 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1b5ec3a0-57fb-451b-ab0f-4ae1ea4e17b3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/ff3106d1-5214-48ea-857b-fd505d8712c7" status: 200 len: 1508 microversion: 2.1 time: 0.386703 Sep 24 21:04:07.731462 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1964/3885] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:07 2022] GET /compute/v2.1/servers/ff3106d1-5214-48ea-857b-fd505d8712c7 => generated 1508 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:07.736304 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-de1c11d4-c9c0-4006-a902-182898f7856b req-92cc022e-b97f-46b1-8f1a-a41fcf7d9204 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f788a90-8f36-4262-957b-6d4e43e6568d", "tag": "0e66214c-049f-4d06-931d-a3ff744e01ae"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:07.746417 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-de1c11d4-c9c0-4006-a902-182898f7856b req-92cc022e-b97f-46b1-8f1a-a41fcf7d9204 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:07.746880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-de1c11d4-c9c0-4006-a902-182898f7856b req-92cc022e-b97f-46b1-8f1a-a41fcf7d9204 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:07.747563 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-de1c11d4-c9c0-4006-a902-182898f7856b req-92cc022e-b97f-46b1-8f1a-a41fcf7d9204 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:07.749901 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5277e835-ede7-4395-8f19-3340f8482725 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:07.760051 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-de1c11d4-c9c0-4006-a902-182898f7856b req-92cc022e-b97f-46b1-8f1a-a41fcf7d9204 service nova] Creating event network-changed:0e66214c-049f-4d06-931d-a3ff744e01ae for instance 1f788a90-8f36-4262-957b-6d4e43e6568d on nch1-master-1 Sep 24 21:04:07.760992 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5277e835-ede7-4395-8f19-3340f8482725 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1522 microversion: 2.1 time: 0.367913 Sep 24 21:04:07.761915 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1922/3886] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:07 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1522 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:04:07.766185 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-de1c11d4-c9c0-4006-a902-182898f7856b req-92cc022e-b97f-46b1-8f1a-a41fcf7d9204 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033475 Sep 24 21:04:07.766815 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1965/3887] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:04:07.830874 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c1fd7848-55cd-4d67-b8d1-bf03aa827f9f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:07.832007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c1fd7848-55cd-4d67-b8d1-bf03aa827f9f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 1f788a90-8f36-4262-957b-6d4e43e6568d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:07.841734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1fd7848-55cd-4d67-b8d1-bf03aa827f9f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:07.842425 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1fd7848-55cd-4d67-b8d1-bf03aa827f9f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:07.843069 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1fd7848-55cd-4d67-b8d1-bf03aa827f9f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:07.843998 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1fd7848-55cd-4d67-b8d1-bf03aa827f9f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:07.844632 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1fd7848-55cd-4d67-b8d1-bf03aa827f9f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:07.845283 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1fd7848-55cd-4d67-b8d1-bf03aa827f9f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:08.102551 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c1fd7848-55cd-4d67-b8d1-bf03aa827f9f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:08.111561 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c1fd7848-55cd-4d67-b8d1-bf03aa827f9f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d" status: 200 len: 1320 microversion: 2.1 time: 0.285555 Sep 24 21:04:08.123468 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1923/3888] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:07 2022] GET /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d => generated 1320 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:08.178802 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8ea94454-cf04-4f91-af5b-9eed36447872 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:08.180737 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8ea94454-cf04-4f91-af5b-9eed36447872 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:08.188063 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8ea94454-cf04-4f91-af5b-9eed36447872 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:08.188549 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8ea94454-cf04-4f91-af5b-9eed36447872 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:08.189416 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8ea94454-cf04-4f91-af5b-9eed36447872 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:08.190652 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8ea94454-cf04-4f91-af5b-9eed36447872 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:08.196714 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5b9b2511-3be1-45cd-b5ac-9f1be40b74b6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:08.197333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5b9b2511-3be1-45cd-b5ac-9f1be40b74b6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:08.200809 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=4 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:04:08.202293 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8ea94454-cf04-4f91-af5b-9eed36447872 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:08.202777 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8ea94454-cf04-4f91-af5b-9eed36447872 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:08.212296 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b9b2511-3be1-45cd-b5ac-9f1be40b74b6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:08.212799 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b9b2511-3be1-45cd-b5ac-9f1be40b74b6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:08.214470 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b9b2511-3be1-45cd-b5ac-9f1be40b74b6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:08.215541 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b9b2511-3be1-45cd-b5ac-9f1be40b74b6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:08.216024 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b9b2511-3be1-45cd-b5ac-9f1be40b74b6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:08.216464 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b9b2511-3be1-45cd-b5ac-9f1be40b74b6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:08.654928 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5b9b2511-3be1-45cd-b5ac-9f1be40b74b6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:08.672211 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5b9b2511-3be1-45cd-b5ac-9f1be40b74b6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1678 microversion: 2.1 time: 0.477476 Sep 24 21:04:08.672839 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1924/3889] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:08 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1678 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:08.755684 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c0555f11-6e73-4033-bc8b-68c66706dbde tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:08.756674 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c0555f11-6e73-4033-bc8b-68c66706dbde tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ff3106d1-5214-48ea-857b-fd505d8712c7] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:08.778992 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0555f11-6e73-4033-bc8b-68c66706dbde tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:08.779846 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0555f11-6e73-4033-bc8b-68c66706dbde tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:08.780490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0555f11-6e73-4033-bc8b-68c66706dbde tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:08.783362 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0555f11-6e73-4033-bc8b-68c66706dbde tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:08.784922 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0555f11-6e73-4033-bc8b-68c66706dbde tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:08.785677 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0555f11-6e73-4033-bc8b-68c66706dbde tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:09.291855 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8ea94454-cf04-4f91-af5b-9eed36447872 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:09.305242 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8ea94454-cf04-4f91-af5b-9eed36447872 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1519 microversion: 2.1 time: 1.132067 Sep 24 21:04:09.306284 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1966/3890] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:08 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1519 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:09.315146 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bd01111b-562a-4200-83b1-3ea9f8b043c4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:09.316064 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-bd01111b-562a-4200-83b1-3ea9f8b043c4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:09.334279 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bd01111b-562a-4200-83b1-3ea9f8b043c4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:09.335169 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bd01111b-562a-4200-83b1-3ea9f8b043c4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:09.335987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bd01111b-562a-4200-83b1-3ea9f8b043c4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:09.337204 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bd01111b-562a-4200-83b1-3ea9f8b043c4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:09.337901 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bd01111b-562a-4200-83b1-3ea9f8b043c4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:09.338581 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bd01111b-562a-4200-83b1-3ea9f8b043c4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:09.405970 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:04:09.437547 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=11 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:04:09.683008 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c0555f11-6e73-4033-bc8b-68c66706dbde tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:09.701920 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c0555f11-6e73-4033-bc8b-68c66706dbde tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/ff3106d1-5214-48ea-857b-fd505d8712c7" status: 200 len: 1508 microversion: 2.1 time: 0.950026 Sep 24 21:04:09.708080 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1925/3891] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:08 2022] GET /compute/v2.1/servers/ff3106d1-5214-48ea-857b-fd505d8712c7 => generated 1508 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:09.726632 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a3a46cf3-d722-4dd7-adbe-f65c5270ea55 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:09.728193 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a3a46cf3-d722-4dd7-adbe-f65c5270ea55 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 1f788a90-8f36-4262-957b-6d4e43e6568d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:09.740036 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a3a46cf3-d722-4dd7-adbe-f65c5270ea55 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:09.753004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a3a46cf3-d722-4dd7-adbe-f65c5270ea55 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:09.753704 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a3a46cf3-d722-4dd7-adbe-f65c5270ea55 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:09.754572 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a3a46cf3-d722-4dd7-adbe-f65c5270ea55 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:09.755064 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a3a46cf3-d722-4dd7-adbe-f65c5270ea55 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:09.755506 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a3a46cf3-d722-4dd7-adbe-f65c5270ea55 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:09.772519 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=10 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:04:09.917537 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-bd01111b-562a-4200-83b1-3ea9f8b043c4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:09.931142 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bd01111b-562a-4200-83b1-3ea9f8b043c4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1522 microversion: 2.1 time: 0.619626 Sep 24 21:04:09.931727 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1967/3892] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:09 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1522 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:09.936579 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d59149c3-f4d9-4c77-ab8f-af2d4081b249 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:09.937195 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d59149c3-f4d9-4c77-ab8f-af2d4081b249 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:09.949281 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d59149c3-f4d9-4c77-ab8f-af2d4081b249 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:09.950032 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d59149c3-f4d9-4c77-ab8f-af2d4081b249 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:09.950644 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d59149c3-f4d9-4c77-ab8f-af2d4081b249 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:09.962211 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d59149c3-f4d9-4c77-ab8f-af2d4081b249 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:09.962756 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d59149c3-f4d9-4c77-ab8f-af2d4081b249 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:09.963213 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d59149c3-f4d9-4c77-ab8f-af2d4081b249 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:10.278759 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a3a46cf3-d722-4dd7-adbe-f65c5270ea55 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:10.297586 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a3a46cf3-d722-4dd7-adbe-f65c5270ea55 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d" status: 200 len: 1320 microversion: 2.1 time: 0.584665 Sep 24 21:04:10.298431 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1926/3893] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:09 2022] GET /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d => generated 1320 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:10.306461 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-0ccf3e49-22fd-41d7-bca1-b3b00707a585 req-9df4628e-17ac-4a86-85f1-6e67f82a7cba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff3106d1-5214-48ea-857b-fd505d8712c7", "name": "network-vif-deleted", "tag": "c94cdbed-0fb2-4f9b-bbfd-fc0d8d9b75a8"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:10.351989 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-0ccf3e49-22fd-41d7-bca1-b3b00707a585 req-9df4628e-17ac-4a86-85f1-6e67f82a7cba service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:10.352674 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-0ccf3e49-22fd-41d7-bca1-b3b00707a585 req-9df4628e-17ac-4a86-85f1-6e67f82a7cba service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:10.353121 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-0ccf3e49-22fd-41d7-bca1-b3b00707a585 req-9df4628e-17ac-4a86-85f1-6e67f82a7cba service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:10.395501 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-0ccf3e49-22fd-41d7-bca1-b3b00707a585 req-9df4628e-17ac-4a86-85f1-6e67f82a7cba service nova] Creating event network-vif-deleted:c94cdbed-0fb2-4f9b-bbfd-fc0d8d9b75a8 for instance ff3106d1-5214-48ea-857b-fd505d8712c7 on nch2-master-1 Sep 24 21:04:10.406667 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-0ccf3e49-22fd-41d7-bca1-b3b00707a585 req-9df4628e-17ac-4a86-85f1-6e67f82a7cba service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106809 Sep 24 21:04:10.406812 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d59149c3-f4d9-4c77-ab8f-af2d4081b249 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:10.408676 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1927/3894] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:04:10.420578 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5fd19a9d-5816-42cc-8027-02b8dcac3758 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:10.421304 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5fd19a9d-5816-42cc-8027-02b8dcac3758 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:10.421755 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d59149c3-f4d9-4c77-ab8f-af2d4081b249 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1678 microversion: 2.1 time: 0.488966 Sep 24 21:04:10.422446 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1968/3895] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:09 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1678 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:10.437451 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5fd19a9d-5816-42cc-8027-02b8dcac3758 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:10.438035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5fd19a9d-5816-42cc-8027-02b8dcac3758 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:10.438530 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5fd19a9d-5816-42cc-8027-02b8dcac3758 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:10.439305 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5fd19a9d-5816-42cc-8027-02b8dcac3758 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:10.443378 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5fd19a9d-5816-42cc-8027-02b8dcac3758 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:10.444329 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5fd19a9d-5816-42cc-8027-02b8dcac3758 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:10.731611 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-47a1c6e5-0c52-468c-966c-075b4b8213cb tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:10.732433 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-47a1c6e5-0c52-468c-966c-075b4b8213cb tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ff3106d1-5214-48ea-857b-fd505d8712c7] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:10.740994 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47a1c6e5-0c52-468c-966c-075b4b8213cb tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:10.742069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47a1c6e5-0c52-468c-966c-075b4b8213cb tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:10.742477 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47a1c6e5-0c52-468c-966c-075b4b8213cb tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:10.743228 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47a1c6e5-0c52-468c-966c-075b4b8213cb tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:10.743884 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47a1c6e5-0c52-468c-966c-075b4b8213cb tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:10.744324 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47a1c6e5-0c52-468c-966c-075b4b8213cb tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:10.782197 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47a1c6e5-0c52-468c-966c-075b4b8213cb tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:10.782735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47a1c6e5-0c52-468c-966c-075b4b8213cb tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:10.783455 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47a1c6e5-0c52-468c-966c-075b4b8213cb tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:10.783919 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-47a1c6e5-0c52-468c-966c-075b4b8213cb tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lazy-loading 'fault' on Instance uuid ff3106d1-5214-48ea-857b-fd505d8712c7 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:04:10.911043 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-47a1c6e5-0c52-468c-966c-075b4b8213cb tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:10.940059 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-47a1c6e5-0c52-468c-966c-075b4b8213cb tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/ff3106d1-5214-48ea-857b-fd505d8712c7" status: 200 len: 1311 microversion: 2.1 time: 0.193610 Sep 24 21:04:10.940917 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1969/3896] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:10 2022] GET /compute/v2.1/servers/ff3106d1-5214-48ea-857b-fd505d8712c7 => generated 1311 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:10.958166 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-04cceb60-4d25-4ee9-9fd9-8bf9e42896f7 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:10.958823 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-04cceb60-4d25-4ee9-9fd9-8bf9e42896f7 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:10.973186 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-04cceb60-4d25-4ee9-9fd9-8bf9e42896f7 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:10.973917 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-04cceb60-4d25-4ee9-9fd9-8bf9e42896f7 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:10.974378 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-04cceb60-4d25-4ee9-9fd9-8bf9e42896f7 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:10.975136 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-04cceb60-4d25-4ee9-9fd9-8bf9e42896f7 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:10.975599 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-04cceb60-4d25-4ee9-9fd9-8bf9e42896f7 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:10.977476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-04cceb60-4d25-4ee9-9fd9-8bf9e42896f7 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:11.041813 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5fd19a9d-5816-42cc-8027-02b8dcac3758 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:11.062641 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5fd19a9d-5816-42cc-8027-02b8dcac3758 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1519 microversion: 2.1 time: 0.642890 Sep 24 21:04:11.063328 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1928/3897] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:10 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1519 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:11.255025 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-04cceb60-4d25-4ee9-9fd9-8bf9e42896f7 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:11.272894 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-04cceb60-4d25-4ee9-9fd9-8bf9e42896f7 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1522 microversion: 2.1 time: 0.318469 Sep 24 21:04:11.276069 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1970/3898] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:10 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:11.322834 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-262059c4-3b55-47f0-acd4-f14f89dad33c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:11.323477 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-262059c4-3b55-47f0-acd4-f14f89dad33c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 1f788a90-8f36-4262-957b-6d4e43e6568d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:11.332460 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-262059c4-3b55-47f0-acd4-f14f89dad33c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:11.340013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-262059c4-3b55-47f0-acd4-f14f89dad33c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:11.340613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-262059c4-3b55-47f0-acd4-f14f89dad33c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:11.342721 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-262059c4-3b55-47f0-acd4-f14f89dad33c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:11.344341 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-262059c4-3b55-47f0-acd4-f14f89dad33c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:11.344790 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-262059c4-3b55-47f0-acd4-f14f89dad33c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:11.448591 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-486edc20-45ed-4f83-99d0-f37054f68124 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:11.449229 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-486edc20-45ed-4f83-99d0-f37054f68124 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:11.460455 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-486edc20-45ed-4f83-99d0-f37054f68124 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:11.460973 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-486edc20-45ed-4f83-99d0-f37054f68124 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:11.461508 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-486edc20-45ed-4f83-99d0-f37054f68124 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:11.463761 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-486edc20-45ed-4f83-99d0-f37054f68124 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:11.464255 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-486edc20-45ed-4f83-99d0-f37054f68124 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:11.464703 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-486edc20-45ed-4f83-99d0-f37054f68124 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:11.622049 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-262059c4-3b55-47f0-acd4-f14f89dad33c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:11.647883 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-262059c4-3b55-47f0-acd4-f14f89dad33c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d" status: 200 len: 1320 microversion: 2.1 time: 0.329270 Sep 24 21:04:11.648581 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1929/3899] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:11 2022] GET /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d => generated 1320 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:11.659390 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-04618fbc-96e5-493d-9235-e52cd4563da0 req-95a1c603-3b1a-4834-93cf-a76a289267a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06ef44f5-3eae-4780-b544-62102fd945a7", "name": "network-vif-plugged", "status": "completed", "tag": "cb75d66c-318e-44c6-a426-ef41aef9d16c"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:11.686927 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-04618fbc-96e5-493d-9235-e52cd4563da0 req-95a1c603-3b1a-4834-93cf-a76a289267a5 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:11.687423 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-04618fbc-96e5-493d-9235-e52cd4563da0 req-95a1c603-3b1a-4834-93cf-a76a289267a5 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:11.687871 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-04618fbc-96e5-493d-9235-e52cd4563da0 req-95a1c603-3b1a-4834-93cf-a76a289267a5 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:11.705783 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-04618fbc-96e5-493d-9235-e52cd4563da0 req-95a1c603-3b1a-4834-93cf-a76a289267a5 service nova] Creating event network-vif-plugged:cb75d66c-318e-44c6-a426-ef41aef9d16c for instance 06ef44f5-3eae-4780-b544-62102fd945a7 on nch2-master-1 Sep 24 21:04:11.716969 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-04618fbc-96e5-493d-9235-e52cd4563da0 req-95a1c603-3b1a-4834-93cf-a76a289267a5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061305 Sep 24 21:04:11.717456 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-486edc20-45ed-4f83-99d0-f37054f68124 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:11.717563 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1930/3900] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:04:11.730787 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-486edc20-45ed-4f83-99d0-f37054f68124 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1678 microversion: 2.1 time: 0.287375 Sep 24 21:04:11.731642 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1971/3901] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:11 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1678 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:11.968864 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4cc58cf7-42e2-4eb0-928d-d9d1494fa529 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:11.969512 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4cc58cf7-42e2-4eb0-928d-d9d1494fa529 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ff3106d1-5214-48ea-857b-fd505d8712c7] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:11.978517 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cc58cf7-42e2-4eb0-928d-d9d1494fa529 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:11.979203 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cc58cf7-42e2-4eb0-928d-d9d1494fa529 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:11.979709 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cc58cf7-42e2-4eb0-928d-d9d1494fa529 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:11.980359 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cc58cf7-42e2-4eb0-928d-d9d1494fa529 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:11.981307 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cc58cf7-42e2-4eb0-928d-d9d1494fa529 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:11.982024 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cc58cf7-42e2-4eb0-928d-d9d1494fa529 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:11.999117 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-4cc58cf7-42e2-4eb0-928d-d9d1494fa529 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] HTTP exception thrown: Instance ff3106d1-5214-48ea-857b-fd505d8712c7 could not be found. Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4cc58cf7-42e2-4eb0-928d-d9d1494fa529 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Request method failure captured: Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/ff3106d1-5214-48ea-857b-fd505d8712c7 HTTP/1.1 Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3CaLUabI_YBYC2XnM21T8dL5FNXXvceQt6A3bijM2xUqNxa7o1mArSf5dFDgPeh3vgkyUYVZenobpLU3uEqGcvnEbw-nMZfSWEM5OkDmeYEccMJ8-yhXeZa1T-3DnHpo2MRC1ewpBuezwDhE04pucSEH5uW1HzlM0IgaFpEaRXllaA Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersTestJSON-1457868986 Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersTestJSON-1457868986-project Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: e557d91b49c143499d809a55e85932fd Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersTestJSON-1457868986-project Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance ff3106d1-5214-48ea-857b-fd505d8712c7 could not be found. Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'ff3106d1-5214-48ea-857b-fd505d8712c7'} Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff3106d1-5214-48ea-857b-fd505d8712c7 could not be found. Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff3106d1-5214-48ea-857b-fd505d8712c7 could not be found. Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:04:12.001052 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:12.005204 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:12.005204 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:04:12.005204 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:04:12.005204 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:04:12.005204 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:04:12.005204 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff3106d1-5214-48ea-857b-fd505d8712c7 could not be found. Sep 24 21:04:12.005204 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:12.007931 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4cc58cf7-42e2-4eb0-928d-d9d1494fa529 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Returning 404 to user: Instance ff3106d1-5214-48ea-857b-fd505d8712c7 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:04:12.009151 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4cc58cf7-42e2-4eb0-928d-d9d1494fa529 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/ff3106d1-5214-48ea-857b-fd505d8712c7" status: 404 len: 111 microversion: 2.1 time: 0.045035 Sep 24 21:04:12.010352 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1931/3902] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:11 2022] GET /compute/v2.1/servers/ff3106d1-5214-48ea-857b-fd505d8712c7 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:04:12.025075 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7ecb50a0-690a-4567-b43c-53751b23f26e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Action: 'create', calling method: .version_select at 0x7f4b110750d0>, body: {"keypair": {"name": "tempest-key-1790091851", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXsfE0Dod0TZfnYxSLqnPpM5Bm1zOlncr87g6O5XdnekXQrzp4qh+5E4aKjmxut9m0din/VUh8AIFn6x6Az0nVRgmQu28/Fzi2rOh0nWpnYoWOxWTxpxCN7ONlzO2pDSw=="}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:12.044103 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-7ecb50a0-690a-4567-b43c-53751b23f26e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Getting quotas for project accafa2724354ca8b1c9f19940989429. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:04:12.052663 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-7ecb50a0-690a-4567-b43c-53751b23f26e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Getting quotas for user e557d91b49c143499d809a55e85932fd and project accafa2724354ca8b1c9f19940989429. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:04:12.080903 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7ecb50a0-690a-4567-b43c-53751b23f26e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.061950 Sep 24 21:04:12.081680 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1972/3903] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 21:04:12 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:04:12.089737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-305db6d5-a894-4fb1-9537-e0b1b66b76dd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:12.090978 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-305db6d5-a894-4fb1-9537-e0b1b66b76dd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:12.095108 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2ef9c39a-f0c8-4075-9b84-d085af412291 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '.version_select at 0x7f4b11140af0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:12.099144 ncdv-master-1 devstack@n-api.service[140516]: WARNING oslo_db.sqlalchemy.utils [None req-2ef9c39a-f0c8-4075-9b84-d085af412291 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 24 21:04:12.099299 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-305db6d5-a894-4fb1-9537-e0b1b66b76dd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:12.100306 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-305db6d5-a894-4fb1-9537-e0b1b66b76dd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:12.101535 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-305db6d5-a894-4fb1-9537-e0b1b66b76dd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:12.102783 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-305db6d5-a894-4fb1-9537-e0b1b66b76dd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:12.103712 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-305db6d5-a894-4fb1-9537-e0b1b66b76dd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:12.104376 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-305db6d5-a894-4fb1-9537-e0b1b66b76dd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:12.105684 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2ef9c39a-f0c8-4075-9b84-d085af412291 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.015806 Sep 24 21:04:12.106276 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1973/3904] 10.222.0.52 () {58 vars in 1137 bytes} [Sat Sep 24 21:04:12 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:04:12.251230 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-355a6a66-5a01-4a5d-9d62-31b4bdda8b51 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1835564716", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "key_name": "tempest-key-1790091851", "networks": [{"uuid": "86ee1dec-a957-4cc1-98d2-2e275615c01a"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:12.336642 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-355a6a66-5a01-4a5d-9d62-31b4bdda8b51 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] validate_networks() for [('86ee1dec-a957-4cc1-98d2-2e275615c01a', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:04:12.383377 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-305db6d5-a894-4fb1-9537-e0b1b66b76dd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:12.402709 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-305db6d5-a894-4fb1-9537-e0b1b66b76dd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1519 microversion: 2.1 time: 0.317420 Sep 24 21:04:12.420023 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1932/3905] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:12 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1519 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:12.428667 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-089433d7-6497-4512-8532-b1095267f27c tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:12.429824 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-089433d7-6497-4512-8532-b1095267f27c tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:12.446689 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-089433d7-6497-4512-8532-b1095267f27c tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:12.447786 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-089433d7-6497-4512-8532-b1095267f27c tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:12.449600 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-089433d7-6497-4512-8532-b1095267f27c tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:12.450713 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-089433d7-6497-4512-8532-b1095267f27c tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:12.451376 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-089433d7-6497-4512-8532-b1095267f27c tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:12.452014 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-089433d7-6497-4512-8532-b1095267f27c tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:13.004357 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-089433d7-6497-4512-8532-b1095267f27c tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:13.016339 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-089433d7-6497-4512-8532-b1095267f27c tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1522 microversion: 2.1 time: 0.594288 Sep 24 21:04:13.017658 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1933/3906] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:12 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1522 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:13.026325 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-527172dc-4671-4263-8e01-b069b8a00ae0 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:13.027346 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-527172dc-4671-4263-8e01-b069b8a00ae0 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 1f788a90-8f36-4262-957b-6d4e43e6568d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:13.039177 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-527172dc-4671-4263-8e01-b069b8a00ae0 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:13.040060 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-527172dc-4671-4263-8e01-b069b8a00ae0 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:13.040901 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-527172dc-4671-4263-8e01-b069b8a00ae0 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:13.041908 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-527172dc-4671-4263-8e01-b069b8a00ae0 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:13.042932 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-527172dc-4671-4263-8e01-b069b8a00ae0 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:13.044167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-527172dc-4671-4263-8e01-b069b8a00ae0 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:13.498087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-527172dc-4671-4263-8e01-b069b8a00ae0 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:13.528275 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-527172dc-4671-4263-8e01-b069b8a00ae0 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d" status: 200 len: 1320 microversion: 2.1 time: 0.505327 Sep 24 21:04:13.543305 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1934/3907] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:13 2022] GET /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d => generated 1320 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:13.551932 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e3b8ce8b-b888-443b-b416-681a65cd2aac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:13.552636 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e3b8ce8b-b888-443b-b416-681a65cd2aac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:13.560327 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3b8ce8b-b888-443b-b416-681a65cd2aac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:13.561747 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3b8ce8b-b888-443b-b416-681a65cd2aac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:13.562208 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3b8ce8b-b888-443b-b416-681a65cd2aac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:13.563276 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3b8ce8b-b888-443b-b416-681a65cd2aac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:13.564702 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3b8ce8b-b888-443b-b416-681a65cd2aac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:13.565407 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3b8ce8b-b888-443b-b416-681a65cd2aac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:13.855579 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-355a6a66-5a01-4a5d-9d62-31b4bdda8b51 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:04:13.856606 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-355a6a66-5a01-4a5d-9d62-31b4bdda8b51 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:04:13.857272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-355a6a66-5a01-4a5d-9d62-31b4bdda8b51 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:04:13.858132 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-355a6a66-5a01-4a5d-9d62-31b4bdda8b51 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:04:13.859668 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-355a6a66-5a01-4a5d-9d62-31b4bdda8b51 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:04:13.874996 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-355a6a66-5a01-4a5d-9d62-31b4bdda8b51 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:13.876063 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-355a6a66-5a01-4a5d-9d62-31b4bdda8b51 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:13.876705 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-355a6a66-5a01-4a5d-9d62-31b4bdda8b51 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:13.877822 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-355a6a66-5a01-4a5d-9d62-31b4bdda8b51 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:13.879191 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-355a6a66-5a01-4a5d-9d62-31b4bdda8b51 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:13.879812 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-355a6a66-5a01-4a5d-9d62-31b4bdda8b51 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:13.895115 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:04:13.912748 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-355a6a66-5a01-4a5d-9d62-31b4bdda8b51 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Getting quotas for project accafa2724354ca8b1c9f19940989429. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:04:13.918950 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-355a6a66-5a01-4a5d-9d62-31b4bdda8b51 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Getting quotas for user e557d91b49c143499d809a55e85932fd and project accafa2724354ca8b1c9f19940989429. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:04:13.923580 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:04:13.936784 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-355a6a66-5a01-4a5d-9d62-31b4bdda8b51 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:04:13.939459 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-355a6a66-5a01-4a5d-9d62-31b4bdda8b51 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 81ced789-a25d-407f-89e3-a65be79d2edd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:04:13.990301 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-355a6a66-5a01-4a5d-9d62-31b4bdda8b51 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.745561 Sep 24 21:04:13.991033 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1974/3908] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:04:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 24 21:04:14.005809 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fb79f5ba-2b10-4766-a642-0718e0a6dac2 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:14.006817 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fb79f5ba-2b10-4766-a642-0718e0a6dac2 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:14.024514 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb79f5ba-2b10-4766-a642-0718e0a6dac2 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:14.025167 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb79f5ba-2b10-4766-a642-0718e0a6dac2 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:14.025760 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb79f5ba-2b10-4766-a642-0718e0a6dac2 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:14.026722 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb79f5ba-2b10-4766-a642-0718e0a6dac2 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:14.027195 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb79f5ba-2b10-4766-a642-0718e0a6dac2 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:14.027826 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb79f5ba-2b10-4766-a642-0718e0a6dac2 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:14.078249 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e3b8ce8b-b888-443b-b416-681a65cd2aac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:14.086842 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e3b8ce8b-b888-443b-b416-681a65cd2aac tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1655 microversion: 2.1 time: 0.541757 Sep 24 21:04:14.103492 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1935/3909] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:13 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1655 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:14.110551 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-83b34369-0c92-4070-bd6e-6cafd4cf6c4c req-bbec2eba-5df0-4a89-8b11-53e66547fb06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f788a90-8f36-4262-957b-6d4e43e6568d", "name": "network-vif-plugged", "status": "completed", "tag": "0e66214c-049f-4d06-931d-a3ff744e01ae"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:14.122796 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-83b34369-0c92-4070-bd6e-6cafd4cf6c4c req-bbec2eba-5df0-4a89-8b11-53e66547fb06 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:14.123775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-83b34369-0c92-4070-bd6e-6cafd4cf6c4c req-bbec2eba-5df0-4a89-8b11-53e66547fb06 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:14.124383 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-83b34369-0c92-4070-bd6e-6cafd4cf6c4c req-bbec2eba-5df0-4a89-8b11-53e66547fb06 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:14.138087 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-83b34369-0c92-4070-bd6e-6cafd4cf6c4c req-bbec2eba-5df0-4a89-8b11-53e66547fb06 service nova] Creating event network-vif-plugged:0e66214c-049f-4d06-931d-a3ff744e01ae for instance 1f788a90-8f36-4262-957b-6d4e43e6568d on nch1-master-1 Sep 24 21:04:14.144424 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-83b34369-0c92-4070-bd6e-6cafd4cf6c4c req-bbec2eba-5df0-4a89-8b11-53e66547fb06 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038828 Sep 24 21:04:14.145241 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1936/3910] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:04:14.153020 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-943b091c-f615-4f33-a9b8-c0e9b214b003 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:14.153927 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-943b091c-f615-4f33-a9b8-c0e9b214b003 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 81ced789-a25d-407f-89e3-a65be79d2edd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:14.307843 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-943b091c-f615-4f33-a9b8-c0e9b214b003 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:14.327928 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-943b091c-f615-4f33-a9b8-c0e9b214b003 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/81ced789-a25d-407f-89e3-a65be79d2edd" status: 200 len: 1229 microversion: 2.1 time: 0.180666 Sep 24 21:04:14.328565 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1937/3911] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:14 2022] GET /compute/v2.1/servers/81ced789-a25d-407f-89e3-a65be79d2edd => generated 1229 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:14.362734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-291b6866-4607-40d8-9f03-2d198ed4f022 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:14.363465 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-291b6866-4607-40d8-9f03-2d198ed4f022 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:14.380517 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-291b6866-4607-40d8-9f03-2d198ed4f022 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:14.381007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-291b6866-4607-40d8-9f03-2d198ed4f022 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:14.381672 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-291b6866-4607-40d8-9f03-2d198ed4f022 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:14.382680 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-291b6866-4607-40d8-9f03-2d198ed4f022 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:14.383480 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-291b6866-4607-40d8-9f03-2d198ed4f022 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:14.384141 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-291b6866-4607-40d8-9f03-2d198ed4f022 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:14.448233 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fb79f5ba-2b10-4766-a642-0718e0a6dac2 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:14.458417 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fb79f5ba-2b10-4766-a642-0718e0a6dac2 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1519 microversion: 2.1 time: 0.465782 Sep 24 21:04:14.464090 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1975/3912] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:13 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1519 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:14.488357 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9b87bdb8-5ef2-492d-913b-d27dfdf72596 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:14.515564 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9b87bdb8-5ef2-492d-913b-d27dfdf72596 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:14.516069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9b87bdb8-5ef2-492d-913b-d27dfdf72596 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:14.516504 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9b87bdb8-5ef2-492d-913b-d27dfdf72596 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:14.575535 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9b87bdb8-5ef2-492d-913b-d27dfdf72596 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Going to try to start instance {{(pid=140516) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 24 21:04:14.681496 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9b87bdb8-5ef2-492d-913b-d27dfdf72596 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "POST /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/action" status: 202 len: 0 microversion: 2.1 time: 0.201504 Sep 24 21:04:14.682126 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1976/3913] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:04:14 2022] POST /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:04:14.686170 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-291b6866-4607-40d8-9f03-2d198ed4f022 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:14.699896 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-291b6866-4607-40d8-9f03-2d198ed4f022 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1522 microversion: 2.1 time: 0.355093 Sep 24 21:04:14.700665 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1938/3914] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:14 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1522 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:14.722910 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-542c3831-6ff7-4a9c-b953-2afde475fd0f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:14.723642 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-108e218a-db3c-4e4d-bf9f-1e975d9efde4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:14.724270 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-108e218a-db3c-4e4d-bf9f-1e975d9efde4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:14.724639 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-542c3831-6ff7-4a9c-b953-2afde475fd0f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 1f788a90-8f36-4262-957b-6d4e43e6568d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:14.742641 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-542c3831-6ff7-4a9c-b953-2afde475fd0f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:14.743948 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-542c3831-6ff7-4a9c-b953-2afde475fd0f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:14.744913 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-542c3831-6ff7-4a9c-b953-2afde475fd0f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:14.746785 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-542c3831-6ff7-4a9c-b953-2afde475fd0f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:14.746936 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-108e218a-db3c-4e4d-bf9f-1e975d9efde4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:14.747774 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-108e218a-db3c-4e4d-bf9f-1e975d9efde4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:14.750922 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-108e218a-db3c-4e4d-bf9f-1e975d9efde4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:14.751560 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-542c3831-6ff7-4a9c-b953-2afde475fd0f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:14.754296 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-542c3831-6ff7-4a9c-b953-2afde475fd0f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:14.754630 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-108e218a-db3c-4e4d-bf9f-1e975d9efde4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:14.755687 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-108e218a-db3c-4e4d-bf9f-1e975d9efde4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:14.761286 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-108e218a-db3c-4e4d-bf9f-1e975d9efde4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:15.128905 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-108e218a-db3c-4e4d-bf9f-1e975d9efde4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:15.137255 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-108e218a-db3c-4e4d-bf9f-1e975d9efde4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1664 microversion: 2.1 time: 0.435408 Sep 24 21:04:15.138091 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1939/3915] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:14 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1664 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:15.152364 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-542c3831-6ff7-4a9c-b953-2afde475fd0f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:15.165594 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-542c3831-6ff7-4a9c-b953-2afde475fd0f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d" status: 200 len: 1320 microversion: 2.1 time: 0.472492 Sep 24 21:04:15.184264 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1977/3916] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:14 2022] GET /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d => generated 1320 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:15.364422 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-650f42c4-b5f3-41f7-80e2-37dec514d502 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:15.365054 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-650f42c4-b5f3-41f7-80e2-37dec514d502 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 81ced789-a25d-407f-89e3-a65be79d2edd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:15.376795 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-650f42c4-b5f3-41f7-80e2-37dec514d502 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:15.377536 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-650f42c4-b5f3-41f7-80e2-37dec514d502 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:15.377961 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-650f42c4-b5f3-41f7-80e2-37dec514d502 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:15.378718 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-650f42c4-b5f3-41f7-80e2-37dec514d502 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:15.379953 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-650f42c4-b5f3-41f7-80e2-37dec514d502 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:15.380925 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-650f42c4-b5f3-41f7-80e2-37dec514d502 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:15.467556 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-650f42c4-b5f3-41f7-80e2-37dec514d502 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:15.475860 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-650f42c4-b5f3-41f7-80e2-37dec514d502 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/81ced789-a25d-407f-89e3-a65be79d2edd" status: 200 len: 1281 microversion: 2.1 time: 0.118051 Sep 24 21:04:15.491037 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f3447d81-9bb6-4efa-9da2-ff0e6385ce44 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:15.493271 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f3447d81-9bb6-4efa-9da2-ff0e6385ce44 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:15.493594 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1940/3917] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:15 2022] GET /compute/v2.1/servers/81ced789-a25d-407f-89e3-a65be79d2edd => generated 1281 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:15.503597 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f3447d81-9bb6-4efa-9da2-ff0e6385ce44 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:15.504545 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f3447d81-9bb6-4efa-9da2-ff0e6385ce44 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:15.505374 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f3447d81-9bb6-4efa-9da2-ff0e6385ce44 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:15.506579 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f3447d81-9bb6-4efa-9da2-ff0e6385ce44 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:15.508688 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f3447d81-9bb6-4efa-9da2-ff0e6385ce44 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:15.509728 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f3447d81-9bb6-4efa-9da2-ff0e6385ce44 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:15.724174 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6c2d4eaa-65b1-44cb-ad36-2eb659c21e15 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:15.724838 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6c2d4eaa-65b1-44cb-ad36-2eb659c21e15 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:15.730351 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:04:15.742213 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c2d4eaa-65b1-44cb-ad36-2eb659c21e15 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:15.744450 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c2d4eaa-65b1-44cb-ad36-2eb659c21e15 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:15.746293 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c2d4eaa-65b1-44cb-ad36-2eb659c21e15 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:15.749217 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c2d4eaa-65b1-44cb-ad36-2eb659c21e15 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:15.749754 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c2d4eaa-65b1-44cb-ad36-2eb659c21e15 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:15.750635 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c2d4eaa-65b1-44cb-ad36-2eb659c21e15 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:15.775417 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:04:15.962963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f3447d81-9bb6-4efa-9da2-ff0e6385ce44 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:15.981218 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f3447d81-9bb6-4efa-9da2-ff0e6385ce44 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1519 microversion: 2.1 time: 0.496092 Sep 24 21:04:15.982446 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1978/3918] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:15 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1519 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:16.039705 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6c2d4eaa-65b1-44cb-ad36-2eb659c21e15 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:16.048702 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6c2d4eaa-65b1-44cb-ad36-2eb659c21e15 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1522 microversion: 2.1 time: 0.328458 Sep 24 21:04:16.049264 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1941/3919] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:15 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:16.167714 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2d8337e5-0685-4d17-874d-ee493a5d6394 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:16.170510 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2d8337e5-0685-4d17-874d-ee493a5d6394 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:16.182221 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2d8337e5-0685-4d17-874d-ee493a5d6394 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:16.183286 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2d8337e5-0685-4d17-874d-ee493a5d6394 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:16.183978 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2d8337e5-0685-4d17-874d-ee493a5d6394 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:16.184934 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2d8337e5-0685-4d17-874d-ee493a5d6394 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:16.185807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2d8337e5-0685-4d17-874d-ee493a5d6394 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:16.187332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2d8337e5-0685-4d17-874d-ee493a5d6394 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:16.199379 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e73eae90-f8dd-4244-8d89-97f94d746fa3 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:16.201490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e73eae90-f8dd-4244-8d89-97f94d746fa3 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 1f788a90-8f36-4262-957b-6d4e43e6568d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:16.223494 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e73eae90-f8dd-4244-8d89-97f94d746fa3 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:16.224377 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e73eae90-f8dd-4244-8d89-97f94d746fa3 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:16.224839 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e73eae90-f8dd-4244-8d89-97f94d746fa3 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:16.228175 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e73eae90-f8dd-4244-8d89-97f94d746fa3 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:16.229055 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e73eae90-f8dd-4244-8d89-97f94d746fa3 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:16.239057 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e73eae90-f8dd-4244-8d89-97f94d746fa3 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:16.941504 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e73eae90-f8dd-4244-8d89-97f94d746fa3 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:16.961585 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e73eae90-f8dd-4244-8d89-97f94d746fa3 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d" status: 200 len: 1509 microversion: 2.1 time: 0.772106 Sep 24 21:04:16.965115 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1942/3920] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:16 2022] GET /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d => generated 1509 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:16.976933 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0bd55a25-c1bf-4ca7-99c5-f40e2d972a5c tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:16.977848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0bd55a25-c1bf-4ca7-99c5-f40e2d972a5c tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 81ced789-a25d-407f-89e3-a65be79d2edd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:16.985101 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0bd55a25-c1bf-4ca7-99c5-f40e2d972a5c tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:16.985772 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0bd55a25-c1bf-4ca7-99c5-f40e2d972a5c tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:16.988021 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0bd55a25-c1bf-4ca7-99c5-f40e2d972a5c tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:16.988924 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0bd55a25-c1bf-4ca7-99c5-f40e2d972a5c tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:16.989376 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0bd55a25-c1bf-4ca7-99c5-f40e2d972a5c tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:16.992418 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0bd55a25-c1bf-4ca7-99c5-f40e2d972a5c tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:17.007512 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2d8337e5-0685-4d17-874d-ee493a5d6394 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:17.016864 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2d8337e5-0685-4d17-874d-ee493a5d6394 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1664 microversion: 2.1 time: 0.858899 Sep 24 21:04:17.024624 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1979/3921] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:16 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1664 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:17.036416 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-4eb261a9-4006-4175-b245-1239535c6202 req-727b188b-d464-4b86-ace5-0d44b0bdeb12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "275263e1-8a0a-4f58-b863-b56c2bf3a7c0", "name": "network-vif-plugged", "status": "completed", "tag": "8fb22600-0f74-4477-87fa-054ddb7fc0af"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:17.051349 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-4eb261a9-4006-4175-b245-1239535c6202 req-727b188b-d464-4b86-ace5-0d44b0bdeb12 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:17.052193 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-4eb261a9-4006-4175-b245-1239535c6202 req-727b188b-d464-4b86-ace5-0d44b0bdeb12 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:17.052886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-4eb261a9-4006-4175-b245-1239535c6202 req-727b188b-d464-4b86-ace5-0d44b0bdeb12 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:17.070674 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-4eb261a9-4006-4175-b245-1239535c6202 req-727b188b-d464-4b86-ace5-0d44b0bdeb12 service nova] Creating event network-vif-plugged:8fb22600-0f74-4477-87fa-054ddb7fc0af for instance 275263e1-8a0a-4f58-b863-b56c2bf3a7c0 on nch1-master-1 Sep 24 21:04:17.076820 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-4eb261a9-4006-4175-b245-1239535c6202 req-727b188b-d464-4b86-ace5-0d44b0bdeb12 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044797 Sep 24 21:04:17.077841 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1980/3922] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:04:17.089620 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f006c45e-1181-425f-906f-1789e1dd0c28 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:17.090815 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f006c45e-1181-425f-906f-1789e1dd0c28 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 06ef44f5-3eae-4780-b544-62102fd945a7] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:17.098600 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f006c45e-1181-425f-906f-1789e1dd0c28 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:17.099589 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f006c45e-1181-425f-906f-1789e1dd0c28 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:17.103762 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f006c45e-1181-425f-906f-1789e1dd0c28 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:17.105591 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f006c45e-1181-425f-906f-1789e1dd0c28 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:17.106100 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f006c45e-1181-425f-906f-1789e1dd0c28 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:17.107603 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f006c45e-1181-425f-906f-1789e1dd0c28 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:17.855662 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0bd55a25-c1bf-4ca7-99c5-f40e2d972a5c tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:17.872112 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f006c45e-1181-425f-906f-1789e1dd0c28 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:17.880193 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0bd55a25-c1bf-4ca7-99c5-f40e2d972a5c tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/81ced789-a25d-407f-89e3-a65be79d2edd" status: 200 len: 1329 microversion: 2.1 time: 0.913477 Sep 24 21:04:17.881707 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1943/3923] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:16 2022] GET /compute/v2.1/servers/81ced789-a25d-407f-89e3-a65be79d2edd => generated 1329 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:17.891166 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ef4988c5-048b-4f2e-bf00-a57fba2aaf26 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:17.892131 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ef4988c5-048b-4f2e-bf00-a57fba2aaf26 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:17.902133 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f006c45e-1181-425f-906f-1789e1dd0c28 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7" status: 200 len: 1509 microversion: 2.1 time: 0.822442 Sep 24 21:04:17.905102 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef4988c5-048b-4f2e-bf00-a57fba2aaf26 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:17.905687 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef4988c5-048b-4f2e-bf00-a57fba2aaf26 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:17.906329 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef4988c5-048b-4f2e-bf00-a57fba2aaf26 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:17.907255 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef4988c5-048b-4f2e-bf00-a57fba2aaf26 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:17.907499 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1981/3924] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:17 2022] GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7 => generated 1509 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:17.909539 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef4988c5-048b-4f2e-bf00-a57fba2aaf26 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:17.910184 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef4988c5-048b-4f2e-bf00-a57fba2aaf26 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:17.914486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-40f5776a-c984-421e-83e7-58c09e34991d tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:17.915306 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-40f5776a-c984-421e-83e7-58c09e34991d tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:17.941882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40f5776a-c984-421e-83e7-58c09e34991d tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:17.941882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40f5776a-c984-421e-83e7-58c09e34991d tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:17.941882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40f5776a-c984-421e-83e7-58c09e34991d tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:17.941882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40f5776a-c984-421e-83e7-58c09e34991d tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:17.941882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40f5776a-c984-421e-83e7-58c09e34991d tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:17.960278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40f5776a-c984-421e-83e7-58c09e34991d tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:18.323916 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ef4988c5-048b-4f2e-bf00-a57fba2aaf26 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:18.340967 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ef4988c5-048b-4f2e-bf00-a57fba2aaf26 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1519 microversion: 2.1 time: 0.456946 Sep 24 21:04:18.356633 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-40f5776a-c984-421e-83e7-58c09e34991d tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:18.366819 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1944/3925] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:17 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1519 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:18.390535 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-40f5776a-c984-421e-83e7-58c09e34991d tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1522 microversion: 2.1 time: 0.480340 Sep 24 21:04:18.398365 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1982/3926] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:17 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1522 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:18.405979 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c9042c29-eb43-458d-9249-c77b58a812ab tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:18.410295 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c9042c29-eb43-458d-9249-c77b58a812ab tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 275263e1-8a0a-4f58-b863-b56c2bf3a7c0] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:18.417612 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-457c4cf8-61b3-4f68-a808-245c1352c5d6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:18.418653 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-457c4cf8-61b3-4f68-a808-245c1352c5d6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:18.428492 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c9042c29-eb43-458d-9249-c77b58a812ab tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:18.434281 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c9042c29-eb43-458d-9249-c77b58a812ab tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:18.436268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c9042c29-eb43-458d-9249-c77b58a812ab tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:18.440404 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c9042c29-eb43-458d-9249-c77b58a812ab tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:18.442394 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-457c4cf8-61b3-4f68-a808-245c1352c5d6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:18.443936 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c9042c29-eb43-458d-9249-c77b58a812ab tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:18.449140 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-457c4cf8-61b3-4f68-a808-245c1352c5d6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:18.450361 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c9042c29-eb43-458d-9249-c77b58a812ab tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:18.451003 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-457c4cf8-61b3-4f68-a808-245c1352c5d6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:18.455053 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-457c4cf8-61b3-4f68-a808-245c1352c5d6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:18.456778 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-457c4cf8-61b3-4f68-a808-245c1352c5d6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:18.457513 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-457c4cf8-61b3-4f68-a808-245c1352c5d6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:18.800262 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c9042c29-eb43-458d-9249-c77b58a812ab tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:18.811777 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c9042c29-eb43-458d-9249-c77b58a812ab tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/275263e1-8a0a-4f58-b863-b56c2bf3a7c0" status: 200 len: 1320 microversion: 2.1 time: 0.443148 Sep 24 21:04:18.812953 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1945/3927] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:18 2022] GET /compute/v2.1/servers/275263e1-8a0a-4f58-b863-b56c2bf3a7c0 => generated 1320 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:18.820443 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-ce45c576-4278-4c39-b8e0-859560b09b0d req-dc7ed4f5-b0b2-41d5-ab92-d22acf1dcda2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81ced789-a25d-407f-89e3-a65be79d2edd", "tag": "f9a7bf2c-e3f8-4b7f-aa5c-aeceafe6b6de"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:18.832233 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-ce45c576-4278-4c39-b8e0-859560b09b0d req-dc7ed4f5-b0b2-41d5-ab92-d22acf1dcda2 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:18.832958 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-ce45c576-4278-4c39-b8e0-859560b09b0d req-dc7ed4f5-b0b2-41d5-ab92-d22acf1dcda2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:18.833588 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-ce45c576-4278-4c39-b8e0-859560b09b0d req-dc7ed4f5-b0b2-41d5-ab92-d22acf1dcda2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:18.856289 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-ce45c576-4278-4c39-b8e0-859560b09b0d req-dc7ed4f5-b0b2-41d5-ab92-d22acf1dcda2 service nova] Creating event network-changed:f9a7bf2c-e3f8-4b7f-aa5c-aeceafe6b6de for instance 81ced789-a25d-407f-89e3-a65be79d2edd on nch2-master-1 Sep 24 21:04:18.862112 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-ce45c576-4278-4c39-b8e0-859560b09b0d req-dc7ed4f5-b0b2-41d5-ab92-d22acf1dcda2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047615 Sep 24 21:04:18.863136 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1946/3928] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:04:18.878605 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-457c4cf8-61b3-4f68-a808-245c1352c5d6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:18.898621 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-457c4cf8-61b3-4f68-a808-245c1352c5d6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.497866 Sep 24 21:04:18.919424 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1983/3929] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:18 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:18.925444 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fc9c45f8-dae2-46cf-961b-f9fdc4221af8 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:18.927075 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fc9c45f8-dae2-46cf-961b-f9fdc4221af8 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 81ced789-a25d-407f-89e3-a65be79d2edd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:18.940457 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc9c45f8-dae2-46cf-961b-f9fdc4221af8 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:18.941393 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc9c45f8-dae2-46cf-961b-f9fdc4221af8 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:18.942074 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc9c45f8-dae2-46cf-961b-f9fdc4221af8 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:18.943356 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc9c45f8-dae2-46cf-961b-f9fdc4221af8 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:18.945688 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc9c45f8-dae2-46cf-961b-f9fdc4221af8 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:18.946742 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc9c45f8-dae2-46cf-961b-f9fdc4221af8 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:18.947775 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c5e1c25a-6880-4f6a-917b-ccfc492b81a3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:18.948072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c5e1c25a-6880-4f6a-917b-ccfc492b81a3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:18.979927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5e1c25a-6880-4f6a-917b-ccfc492b81a3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:18.983348 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5e1c25a-6880-4f6a-917b-ccfc492b81a3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:18.983804 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5e1c25a-6880-4f6a-917b-ccfc492b81a3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:18.984537 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5e1c25a-6880-4f6a-917b-ccfc492b81a3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:18.985004 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5e1c25a-6880-4f6a-917b-ccfc492b81a3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:18.985433 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5e1c25a-6880-4f6a-917b-ccfc492b81a3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:19.370298 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c5e1c25a-6880-4f6a-917b-ccfc492b81a3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:19.382475 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c5e1c25a-6880-4f6a-917b-ccfc492b81a3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.457797 Sep 24 21:04:19.384555 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1984/3930] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:18 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:04:19.391010 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f22ce1c6-deaf-4522-acdc-4ba5ceb35e76 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:19.392207 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f22ce1c6-deaf-4522-acdc-4ba5ceb35e76 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:19.400167 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f22ce1c6-deaf-4522-acdc-4ba5ceb35e76 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:19.401025 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f22ce1c6-deaf-4522-acdc-4ba5ceb35e76 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:19.401711 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f22ce1c6-deaf-4522-acdc-4ba5ceb35e76 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:19.402730 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f22ce1c6-deaf-4522-acdc-4ba5ceb35e76 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:19.403434 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f22ce1c6-deaf-4522-acdc-4ba5ceb35e76 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:19.404302 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f22ce1c6-deaf-4522-acdc-4ba5ceb35e76 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:19.432220 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fc9c45f8-dae2-46cf-961b-f9fdc4221af8 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:19.442891 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fc9c45f8-dae2-46cf-961b-f9fdc4221af8 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/81ced789-a25d-407f-89e3-a65be79d2edd" status: 200 len: 1329 microversion: 2.1 time: 0.522964 Sep 24 21:04:19.443791 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1947/3931] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:18 2022] GET /compute/v2.1/servers/81ced789-a25d-407f-89e3-a65be79d2edd => generated 1329 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:04:19.459239 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b58d438b-ce29-4fb8-9bc9-aafda59a1da1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:19.460726 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b58d438b-ce29-4fb8-9bc9-aafda59a1da1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:19.469552 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b58d438b-ce29-4fb8-9bc9-aafda59a1da1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:19.470350 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b58d438b-ce29-4fb8-9bc9-aafda59a1da1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:19.471006 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b58d438b-ce29-4fb8-9bc9-aafda59a1da1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:19.471938 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b58d438b-ce29-4fb8-9bc9-aafda59a1da1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:19.472618 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b58d438b-ce29-4fb8-9bc9-aafda59a1da1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:19.473262 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b58d438b-ce29-4fb8-9bc9-aafda59a1da1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:19.531419 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b58d438b-ce29-4fb8-9bc9-aafda59a1da1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Unlocking {{(pid=140517) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 24 21:04:19.593164 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b58d438b-ce29-4fb8-9bc9-aafda59a1da1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "POST /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/action" status: 202 len: 0 microversion: 2.1 time: 0.147366 Sep 24 21:04:19.593848 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1948/3932] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:04:19 2022] POST /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:04:19.600396 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8ca5897b-9beb-4034-adad-1255ae5fc299 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:19.601855 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8ca5897b-9beb-4034-adad-1255ae5fc299 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:19.610198 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8ca5897b-9beb-4034-adad-1255ae5fc299 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:19.611149 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8ca5897b-9beb-4034-adad-1255ae5fc299 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:19.611868 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8ca5897b-9beb-4034-adad-1255ae5fc299 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:19.614372 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8ca5897b-9beb-4034-adad-1255ae5fc299 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:19.615215 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8ca5897b-9beb-4034-adad-1255ae5fc299 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:19.615903 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8ca5897b-9beb-4034-adad-1255ae5fc299 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:19.789953 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f22ce1c6-deaf-4522-acdc-4ba5ceb35e76 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:19.798268 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f22ce1c6-deaf-4522-acdc-4ba5ceb35e76 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1519 microversion: 2.1 time: 0.412151 Sep 24 21:04:19.799012 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1985/3933] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:19 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1519 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:19.803380 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-278903bb-5e1b-4169-b449-2222b807c75f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:19.804830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-278903bb-5e1b-4169-b449-2222b807c75f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:19.811039 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-278903bb-5e1b-4169-b449-2222b807c75f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:19.811732 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-278903bb-5e1b-4169-b449-2222b807c75f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:19.812175 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-278903bb-5e1b-4169-b449-2222b807c75f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:19.812879 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-278903bb-5e1b-4169-b449-2222b807c75f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:19.813339 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-278903bb-5e1b-4169-b449-2222b807c75f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:19.813780 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-278903bb-5e1b-4169-b449-2222b807c75f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:19.948678 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8ca5897b-9beb-4034-adad-1255ae5fc299 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:19.957454 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8ca5897b-9beb-4034-adad-1255ae5fc299 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1522 microversion: 2.1 time: 0.362215 Sep 24 21:04:19.970437 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1949/3934] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:19 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1522 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:19.977447 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-77aec716-0d91-43eb-88a9-4f50af3b87a0 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:19.979380 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-77aec716-0d91-43eb-88a9-4f50af3b87a0 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 275263e1-8a0a-4f58-b863-b56c2bf3a7c0] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:19.987636 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77aec716-0d91-43eb-88a9-4f50af3b87a0 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:19.988318 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77aec716-0d91-43eb-88a9-4f50af3b87a0 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:19.988864 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77aec716-0d91-43eb-88a9-4f50af3b87a0 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:19.989649 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77aec716-0d91-43eb-88a9-4f50af3b87a0 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:19.990940 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77aec716-0d91-43eb-88a9-4f50af3b87a0 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:19.992247 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77aec716-0d91-43eb-88a9-4f50af3b87a0 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:20.036347 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-278903bb-5e1b-4169-b449-2222b807c75f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:20.045089 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-278903bb-5e1b-4169-b449-2222b807c75f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.245172 Sep 24 21:04:20.048899 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1986/3935] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:19 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:20.074310 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3768ef16-14b2-4097-a8af-f2610cb621cc tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:20.075046 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3768ef16-14b2-4097-a8af-f2610cb621cc tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:20.081295 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3768ef16-14b2-4097-a8af-f2610cb621cc tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:20.081899 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3768ef16-14b2-4097-a8af-f2610cb621cc tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:20.082227 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3768ef16-14b2-4097-a8af-f2610cb621cc tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:20.083121 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3768ef16-14b2-4097-a8af-f2610cb621cc tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:20.083466 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3768ef16-14b2-4097-a8af-f2610cb621cc tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:20.083967 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3768ef16-14b2-4097-a8af-f2610cb621cc tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:20.278018 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-77aec716-0d91-43eb-88a9-4f50af3b87a0 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:20.305283 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-77aec716-0d91-43eb-88a9-4f50af3b87a0 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/275263e1-8a0a-4f58-b863-b56c2bf3a7c0" status: 200 len: 1509 microversion: 2.1 time: 0.320395 Sep 24 21:04:20.308910 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1950/3936] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:19 2022] GET /compute/v2.1/servers/275263e1-8a0a-4f58-b863-b56c2bf3a7c0 => generated 1509 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:20.331933 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-33aced12-3242-46e5-890b-c405abefcda2 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:20.340588 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-33aced12-3242-46e5-890b-c405abefcda2 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:20.341894 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-33aced12-3242-46e5-890b-c405abefcda2 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e'} {{(pid=140517) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 21:04:20.357962 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33aced12-3242-46e5-890b-c405abefcda2 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:20.359279 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33aced12-3242-46e5-890b-c405abefcda2 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:20.360026 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33aced12-3242-46e5-890b-c405abefcda2 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:20.361074 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33aced12-3242-46e5-890b-c405abefcda2 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:20.361802 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33aced12-3242-46e5-890b-c405abefcda2 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:20.365399 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3768ef16-14b2-4097-a8af-f2610cb621cc tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:20.378355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33aced12-3242-46e5-890b-c405abefcda2 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:20.384310 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3768ef16-14b2-4097-a8af-f2610cb621cc tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.314313 Sep 24 21:04:20.386897 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1987/3937] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:20 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:04:20.411011 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1eab7ceb-ef23-477a-8c44-aed383e4755b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:20.411857 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1eab7ceb-ef23-477a-8c44-aed383e4755b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:20.426068 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1eab7ceb-ef23-477a-8c44-aed383e4755b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:20.426846 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1eab7ceb-ef23-477a-8c44-aed383e4755b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:20.430807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1eab7ceb-ef23-477a-8c44-aed383e4755b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:20.431846 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1eab7ceb-ef23-477a-8c44-aed383e4755b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:20.432489 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1eab7ceb-ef23-477a-8c44-aed383e4755b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:20.433325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1eab7ceb-ef23-477a-8c44-aed383e4755b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:20.507085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.multi_cell_list [None req-33aced12-3242-46e5-890b-c405abefcda2 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 21:04:20.595147 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-33aced12-3242-46e5-890b-c405abefcda2 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:20.602601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33aced12-3242-46e5-890b-c405abefcda2 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:20.603106 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33aced12-3242-46e5-890b-c405abefcda2 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:20.603559 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33aced12-3242-46e5-890b-c405abefcda2 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:21.027780 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1eab7ceb-ef23-477a-8c44-aed383e4755b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:21.036479 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1eab7ceb-ef23-477a-8c44-aed383e4755b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.629967 Sep 24 21:04:21.048236 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1988/3938] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:20 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:21.048236 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6d118ef5-a315-4d23-8746-ccabd8c83360 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:21.048236 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6d118ef5-a315-4d23-8746-ccabd8c83360 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 81ced789-a25d-407f-89e3-a65be79d2edd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:21.059245 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6d118ef5-a315-4d23-8746-ccabd8c83360 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:21.060304 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6d118ef5-a315-4d23-8746-ccabd8c83360 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:21.060853 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6d118ef5-a315-4d23-8746-ccabd8c83360 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:21.061637 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6d118ef5-a315-4d23-8746-ccabd8c83360 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:21.062176 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6d118ef5-a315-4d23-8746-ccabd8c83360 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:21.062842 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6d118ef5-a315-4d23-8746-ccabd8c83360 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:21.112272 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-33aced12-3242-46e5-890b-c405abefcda2 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1512 microversion: 2.1 time: 0.784744 Sep 24 21:04:21.113925 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1951/3939] 10.222.0.52 () {58 vars in 1167 bytes} [Sat Sep 24 21:04:20 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1512 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:21.121652 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5ce8440f-5811-436a-964d-16331137aa68 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:21.122612 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5ce8440f-5811-436a-964d-16331137aa68 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:21.130802 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ce8440f-5811-436a-964d-16331137aa68 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:21.132950 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ce8440f-5811-436a-964d-16331137aa68 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:21.133787 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ce8440f-5811-436a-964d-16331137aa68 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:21.134987 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ce8440f-5811-436a-964d-16331137aa68 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:21.135754 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ce8440f-5811-436a-964d-16331137aa68 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:21.136552 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ce8440f-5811-436a-964d-16331137aa68 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:21.403617 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6d118ef5-a315-4d23-8746-ccabd8c83360 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:21.412599 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5ce8440f-5811-436a-964d-16331137aa68 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:21.413760 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6d118ef5-a315-4d23-8746-ccabd8c83360 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/81ced789-a25d-407f-89e3-a65be79d2edd" status: 200 len: 1329 microversion: 2.1 time: 0.374130 Sep 24 21:04:21.423538 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1989/3940] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:21 2022] GET /compute/v2.1/servers/81ced789-a25d-407f-89e3-a65be79d2edd => generated 1329 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:21.433888 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5ce8440f-5811-436a-964d-16331137aa68 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1519 microversion: 2.1 time: 0.318183 Sep 24 21:04:21.436809 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9353cf1a-faaa-41b3-bf3f-028bb57b7ac4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:21.437134 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1952/3941] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:21 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1519 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:21.449783 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9353cf1a-faaa-41b3-bf3f-028bb57b7ac4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:21.450119 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cd972819-0f20-4013-b68c-52adaa0aa395 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:21.450119 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cd972819-0f20-4013-b68c-52adaa0aa395 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:21.450343 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9353cf1a-faaa-41b3-bf3f-028bb57b7ac4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:21.450887 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9353cf1a-faaa-41b3-bf3f-028bb57b7ac4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:21.455106 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9353cf1a-faaa-41b3-bf3f-028bb57b7ac4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:21.455863 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9353cf1a-faaa-41b3-bf3f-028bb57b7ac4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:21.456353 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9353cf1a-faaa-41b3-bf3f-028bb57b7ac4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:21.456510 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd972819-0f20-4013-b68c-52adaa0aa395 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:21.457113 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd972819-0f20-4013-b68c-52adaa0aa395 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:21.457288 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd972819-0f20-4013-b68c-52adaa0aa395 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:21.458103 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd972819-0f20-4013-b68c-52adaa0aa395 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:21.458838 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd972819-0f20-4013-b68c-52adaa0aa395 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:21.459292 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd972819-0f20-4013-b68c-52adaa0aa395 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:21.459437 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9353cf1a-faaa-41b3-bf3f-028bb57b7ac4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:21.538230 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cd972819-0f20-4013-b68c-52adaa0aa395 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "POST /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/action" status: 202 len: 0 microversion: 2.1 time: 0.099367 Sep 24 21:04:21.540206 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1953/3942] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:04:21 2022] POST /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:04:21.548234 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-482647ba-9c5a-40cb-91fe-fc48d599f89f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:21.559419 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-482647ba-9c5a-40cb-91fe-fc48d599f89f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:21.563258 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-482647ba-9c5a-40cb-91fe-fc48d599f89f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-220848403', 'deleted': False, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e'} {{(pid=140517) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 21:04:21.576368 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-482647ba-9c5a-40cb-91fe-fc48d599f89f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:21.578094 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-482647ba-9c5a-40cb-91fe-fc48d599f89f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:21.578964 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-482647ba-9c5a-40cb-91fe-fc48d599f89f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:21.580621 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-482647ba-9c5a-40cb-91fe-fc48d599f89f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:21.581282 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-482647ba-9c5a-40cb-91fe-fc48d599f89f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:21.582770 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-482647ba-9c5a-40cb-91fe-fc48d599f89f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:21.716255 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.multi_cell_list [None req-482647ba-9c5a-40cb-91fe-fc48d599f89f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 21:04:21.722185 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:04:21.728987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9353cf1a-faaa-41b3-bf3f-028bb57b7ac4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:21.754415 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9353cf1a-faaa-41b3-bf3f-028bb57b7ac4 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1522 microversion: 2.1 time: 0.329478 Sep 24 21:04:21.757723 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1990/3943] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:21 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1522 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:21.773143 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-68bb5e3d-cfef-41af-9da6-dba37aa96c41 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:21.776541 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-68bb5e3d-cfef-41af-9da6-dba37aa96c41 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:21.798611 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-68bb5e3d-cfef-41af-9da6-dba37aa96c41 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:21.799125 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-68bb5e3d-cfef-41af-9da6-dba37aa96c41 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:21.799568 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-68bb5e3d-cfef-41af-9da6-dba37aa96c41 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:21.800294 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-68bb5e3d-cfef-41af-9da6-dba37aa96c41 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:21.800757 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-68bb5e3d-cfef-41af-9da6-dba37aa96c41 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:21.801189 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-68bb5e3d-cfef-41af-9da6-dba37aa96c41 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:21.815403 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:04:21.821006 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-482647ba-9c5a-40cb-91fe-fc48d599f89f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:21.847920 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-482647ba-9c5a-40cb-91fe-fc48d599f89f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:21.848627 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-482647ba-9c5a-40cb-91fe-fc48d599f89f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:21.849338 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-482647ba-9c5a-40cb-91fe-fc48d599f89f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:22.119735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-68bb5e3d-cfef-41af-9da6-dba37aa96c41 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:22.128723 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-68bb5e3d-cfef-41af-9da6-dba37aa96c41 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1653 microversion: 2.1 time: 0.369045 Sep 24 21:04:22.143195 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1991/3944] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:21 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1653 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:22.144732 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-482647ba-9c5a-40cb-91fe-fc48d599f89f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-220848403" status: 200 len: 1512 microversion: 2.1 time: 0.603070 Sep 24 21:04:22.145354 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1954/3945] 10.222.0.52 () {58 vars in 1261 bytes} [Sat Sep 24 21:04:21 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-220848403 => generated 1512 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:22.175410 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1f5b665c-af60-443a-8258-a1b02fe5400f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:22.175982 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1f5b665c-af60-443a-8258-a1b02fe5400f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:22.177714 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4e3ad414-f4b7-4385-9897-342669f4f211 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:22.184033 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f5b665c-af60-443a-8258-a1b02fe5400f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:22.184532 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f5b665c-af60-443a-8258-a1b02fe5400f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:22.185035 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f5b665c-af60-443a-8258-a1b02fe5400f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:22.185706 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f5b665c-af60-443a-8258-a1b02fe5400f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:22.186173 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f5b665c-af60-443a-8258-a1b02fe5400f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:22.186633 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f5b665c-af60-443a-8258-a1b02fe5400f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:22.192672 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4e3ad414-f4b7-4385-9897-342669f4f211 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:22.193788 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4e3ad414-f4b7-4385-9897-342669f4f211 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e'} {{(pid=140517) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 21:04:22.201106 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e3ad414-f4b7-4385-9897-342669f4f211 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:22.201961 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e3ad414-f4b7-4385-9897-342669f4f211 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:22.202881 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e3ad414-f4b7-4385-9897-342669f4f211 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:22.203858 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e3ad414-f4b7-4385-9897-342669f4f211 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:22.207326 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e3ad414-f4b7-4385-9897-342669f4f211 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:22.208075 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e3ad414-f4b7-4385-9897-342669f4f211 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:22.287025 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1f5b665c-af60-443a-8258-a1b02fe5400f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "POST /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/action" status: 202 len: 0 microversion: 2.1 time: 0.123177 Sep 24 21:04:22.288808 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1992/3946] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:04:22 2022] POST /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:04:22.327948 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c6026738-45dc-4ca1-9963-1d25fa7d8ebf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:22.330512 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c6026738-45dc-4ca1-9963-1d25fa7d8ebf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:22.343474 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6026738-45dc-4ca1-9963-1d25fa7d8ebf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:22.344324 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6026738-45dc-4ca1-9963-1d25fa7d8ebf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:22.344989 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6026738-45dc-4ca1-9963-1d25fa7d8ebf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:22.348698 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6026738-45dc-4ca1-9963-1d25fa7d8ebf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:22.349940 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6026738-45dc-4ca1-9963-1d25fa7d8ebf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:22.351326 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6026738-45dc-4ca1-9963-1d25fa7d8ebf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:22.411495 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.multi_cell_list [None req-4e3ad414-f4b7-4385-9897-342669f4f211 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 21:04:22.512483 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4e3ad414-f4b7-4385-9897-342669f4f211 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:22.521687 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e3ad414-f4b7-4385-9897-342669f4f211 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:22.522308 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e3ad414-f4b7-4385-9897-342669f4f211 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:22.523172 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e3ad414-f4b7-4385-9897-342669f4f211 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:22.768842 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c6026738-45dc-4ca1-9963-1d25fa7d8ebf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:22.781976 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c6026738-45dc-4ca1-9963-1d25fa7d8ebf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1660 microversion: 2.1 time: 0.470760 Sep 24 21:04:22.782595 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1993/3947] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:22 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1660 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:22.789168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9952bbb4-14c9-450f-9bef-f59ec80d0f93 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:22.790620 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9952bbb4-14c9-450f-9bef-f59ec80d0f93 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 81ced789-a25d-407f-89e3-a65be79d2edd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:22.797042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9952bbb4-14c9-450f-9bef-f59ec80d0f93 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:22.797781 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9952bbb4-14c9-450f-9bef-f59ec80d0f93 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:22.798460 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9952bbb4-14c9-450f-9bef-f59ec80d0f93 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:22.799369 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9952bbb4-14c9-450f-9bef-f59ec80d0f93 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:22.800183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9952bbb4-14c9-450f-9bef-f59ec80d0f93 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:22.800976 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9952bbb4-14c9-450f-9bef-f59ec80d0f93 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:22.851921 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4e3ad414-f4b7-4385-9897-342669f4f211 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4510 microversion: 2.1 time: 0.678111 Sep 24 21:04:22.853731 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1955/3948] 10.222.0.52 () {58 vars in 1173 bytes} [Sat Sep 24 21:04:22 2022] GET /compute/v2.1/servers/detail?status=active => generated 4510 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:22.858879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ff50f178-5736-4e06-9390-45083523445a tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:22.859834 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ff50f178-5736-4e06-9390-45083523445a tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:22.867721 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff50f178-5736-4e06-9390-45083523445a tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:22.868647 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff50f178-5736-4e06-9390-45083523445a tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:22.869405 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff50f178-5736-4e06-9390-45083523445a tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:22.870546 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff50f178-5736-4e06-9390-45083523445a tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:22.871206 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff50f178-5736-4e06-9390-45083523445a tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:22.871836 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff50f178-5736-4e06-9390-45083523445a tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:23.207467 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9952bbb4-14c9-450f-9bef-f59ec80d0f93 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:23.217002 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9952bbb4-14c9-450f-9bef-f59ec80d0f93 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/81ced789-a25d-407f-89e3-a65be79d2edd" status: 200 len: 1329 microversion: 2.1 time: 0.432456 Sep 24 21:04:23.217687 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1994/3949] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:22 2022] GET /compute/v2.1/servers/81ced789-a25d-407f-89e3-a65be79d2edd => generated 1329 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:23.234810 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-781f4f69-d622-4683-9062-73eb1512cf34 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:23.235442 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-781f4f69-d622-4683-9062-73eb1512cf34 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:23.237252 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ff50f178-5736-4e06-9390-45083523445a tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:23.242565 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-781f4f69-d622-4683-9062-73eb1512cf34 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:23.243074 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-781f4f69-d622-4683-9062-73eb1512cf34 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:23.243887 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-781f4f69-d622-4683-9062-73eb1512cf34 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:23.244238 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-781f4f69-d622-4683-9062-73eb1512cf34 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:23.244699 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-781f4f69-d622-4683-9062-73eb1512cf34 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:23.245133 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-781f4f69-d622-4683-9062-73eb1512cf34 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:23.249745 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ff50f178-5736-4e06-9390-45083523445a tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1519 microversion: 2.1 time: 0.394009 Sep 24 21:04:23.250708 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1956/3950] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:22 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1519 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:23.261395 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-76ec6ac9-1f0c-4f8e-9f6c-5d4eff881bfb tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:23.279452 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-76ec6ac9-1f0c-4f8e-9f6c-5d4eff881bfb tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:23.280229 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.compute.servers [None req-76ec6ac9-1f0c-4f8e-9f6c-5d4eff881bfb tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Removing options 'limit' from query {{(pid=140517) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 24 21:04:23.284733 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-76ec6ac9-1f0c-4f8e-9f6c-5d4eff881bfb tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Searching by: {'deleted': False, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e'} {{(pid=140517) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 21:04:23.297599 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76ec6ac9-1f0c-4f8e-9f6c-5d4eff881bfb tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:23.298303 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76ec6ac9-1f0c-4f8e-9f6c-5d4eff881bfb tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:23.299251 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76ec6ac9-1f0c-4f8e-9f6c-5d4eff881bfb tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:23.302461 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76ec6ac9-1f0c-4f8e-9f6c-5d4eff881bfb tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:23.304469 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76ec6ac9-1f0c-4f8e-9f6c-5d4eff881bfb tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:23.306115 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76ec6ac9-1f0c-4f8e-9f6c-5d4eff881bfb tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:23.353391 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-76ec6ac9-1f0c-4f8e-9f6c-5d4eff881bfb tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:23.360687 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76ec6ac9-1f0c-4f8e-9f6c-5d4eff881bfb tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:23.361454 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76ec6ac9-1f0c-4f8e-9f6c-5d4eff881bfb tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:23.363037 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76ec6ac9-1f0c-4f8e-9f6c-5d4eff881bfb tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:23.565424 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-781f4f69-d622-4683-9062-73eb1512cf34 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:23.579069 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-781f4f69-d622-4683-9062-73eb1512cf34 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1522 microversion: 2.1 time: 0.360242 Sep 24 21:04:23.580246 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1995/3951] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:23 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1522 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:23.614342 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-7d59d9f2-0b59-45f7-80a0-9bd95a39b608 req-1dfbcdf8-a8a0-4359-87f3-2aa02a6a14a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81ced789-a25d-407f-89e3-a65be79d2edd", "name": "network-vif-plugged", "status": "completed", "tag": "f9a7bf2c-e3f8-4b7f-aa5c-aeceafe6b6de"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:23.625703 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-7d59d9f2-0b59-45f7-80a0-9bd95a39b608 req-1dfbcdf8-a8a0-4359-87f3-2aa02a6a14a8 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:23.626200 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-7d59d9f2-0b59-45f7-80a0-9bd95a39b608 req-1dfbcdf8-a8a0-4359-87f3-2aa02a6a14a8 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:23.629517 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-7d59d9f2-0b59-45f7-80a0-9bd95a39b608 req-1dfbcdf8-a8a0-4359-87f3-2aa02a6a14a8 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:23.642802 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-7d59d9f2-0b59-45f7-80a0-9bd95a39b608 req-1dfbcdf8-a8a0-4359-87f3-2aa02a6a14a8 service nova] Creating event network-vif-plugged:f9a7bf2c-e3f8-4b7f-aa5c-aeceafe6b6de for instance 81ced789-a25d-407f-89e3-a65be79d2edd on nch2-master-1 Sep 24 21:04:23.654106 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-7d59d9f2-0b59-45f7-80a0-9bd95a39b608 req-1dfbcdf8-a8a0-4359-87f3-2aa02a6a14a8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044032 Sep 24 21:04:23.655341 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1996/3952] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:04:23.686874 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-76ec6ac9-1f0c-4f8e-9f6c-5d4eff881bfb tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1658 microversion: 2.1 time: 0.430730 Sep 24 21:04:23.687484 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1957/3953] 10.222.0.52 () {58 vars in 1161 bytes} [Sat Sep 24 21:04:23 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1658 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:23.713677 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-70563733-b5d2-44a9-982e-26f049d4c07a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:23.718926 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-70563733-b5d2-44a9-982e-26f049d4c07a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:23.721458 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-70563733-b5d2-44a9-982e-26f049d4c07a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e'} {{(pid=140516) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 21:04:23.740662 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-70563733-b5d2-44a9-982e-26f049d4c07a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:23.741865 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-70563733-b5d2-44a9-982e-26f049d4c07a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:23.742393 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-70563733-b5d2-44a9-982e-26f049d4c07a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:23.743212 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-70563733-b5d2-44a9-982e-26f049d4c07a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:23.743743 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-70563733-b5d2-44a9-982e-26f049d4c07a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:23.744235 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-70563733-b5d2-44a9-982e-26f049d4c07a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:23.793840 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.multi_cell_list [None req-70563733-b5d2-44a9-982e-26f049d4c07a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 21:04:23.809432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ce87de6d-7181-4746-ae66-13a061e3d3fe tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:23.810444 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ce87de6d-7181-4746-ae66-13a061e3d3fe tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:23.817526 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ce87de6d-7181-4746-ae66-13a061e3d3fe tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:23.818123 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ce87de6d-7181-4746-ae66-13a061e3d3fe tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:23.818708 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ce87de6d-7181-4746-ae66-13a061e3d3fe tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:23.820572 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ce87de6d-7181-4746-ae66-13a061e3d3fe tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:23.821279 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ce87de6d-7181-4746-ae66-13a061e3d3fe tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:23.821929 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ce87de6d-7181-4746-ae66-13a061e3d3fe tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:23.839993 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-70563733-b5d2-44a9-982e-26f049d4c07a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers?status=active" status: 200 len: 1009 microversion: 2.1 time: 0.130663 Sep 24 21:04:23.840598 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1997/3954] 10.222.0.52 () {58 vars in 1152 bytes} [Sat Sep 24 21:04:23 2022] GET /compute/v2.1/servers?status=active => generated 1009 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:23.861356 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4b703697-81e5-4b0e-b22a-3b141618a1a6 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:23.867156 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4b703697-81e5-4b0e-b22a-3b141618a1a6 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:23.870207 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.compute.servers [None req-4b703697-81e5-4b0e-b22a-3b141618a1a6 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Removing options 'limit' from query {{(pid=140516) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 24 21:04:23.875352 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4b703697-81e5-4b0e-b22a-3b141618a1a6 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Searching by: {'deleted': False, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e'} {{(pid=140516) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 21:04:23.881119 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4b703697-81e5-4b0e-b22a-3b141618a1a6 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:23.882137 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4b703697-81e5-4b0e-b22a-3b141618a1a6 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:23.882960 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4b703697-81e5-4b0e-b22a-3b141618a1a6 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:23.883900 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4b703697-81e5-4b0e-b22a-3b141618a1a6 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:23.884536 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4b703697-81e5-4b0e-b22a-3b141618a1a6 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:23.885153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4b703697-81e5-4b0e-b22a-3b141618a1a6 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:23.916597 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.multi_cell_list [None req-4b703697-81e5-4b0e-b22a-3b141618a1a6 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 21:04:23.932520 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=10 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:04:23.949760 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4b703697-81e5-4b0e-b22a-3b141618a1a6 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1009 microversion: 2.1 time: 0.092787 Sep 24 21:04:23.950873 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1998/3955] 10.222.0.52 () {58 vars in 1150 bytes} [Sat Sep 24 21:04:23 2022] GET /compute/v2.1/servers?limit=100000 => generated 1009 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:04:23.964946 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cd72dc7f-171c-4209-8940-cc16b1be2e52 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:23.969918 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cd72dc7f-171c-4209-8940-cc16b1be2e52 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:23.970695 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cd72dc7f-171c-4209-8940-cc16b1be2e52 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Searching by: {'deleted': False, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e'} {{(pid=140516) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 21:04:23.977302 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd72dc7f-171c-4209-8940-cc16b1be2e52 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:23.977885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd72dc7f-171c-4209-8940-cc16b1be2e52 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:23.978398 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd72dc7f-171c-4209-8940-cc16b1be2e52 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:23.979229 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd72dc7f-171c-4209-8940-cc16b1be2e52 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:23.979753 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd72dc7f-171c-4209-8940-cc16b1be2e52 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:23.980407 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd72dc7f-171c-4209-8940-cc16b1be2e52 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:23.995066 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ce87de6d-7181-4746-ae66-13a061e3d3fe tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:24.005017 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ce87de6d-7181-4746-ae66-13a061e3d3fe tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.201038 Sep 24 21:04:24.008544 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1958/3956] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:23 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:04:24.016410 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.multi_cell_list [None req-cd72dc7f-171c-4209-8940-cc16b1be2e52 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 21:04:24.032080 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3d195104-2cfc-4fc3-8825-53e7fb9cacec tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:24.033238 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3d195104-2cfc-4fc3-8825-53e7fb9cacec tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:24.041336 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d195104-2cfc-4fc3-8825-53e7fb9cacec tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:24.042095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d195104-2cfc-4fc3-8825-53e7fb9cacec tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:24.042583 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d195104-2cfc-4fc3-8825-53e7fb9cacec tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:24.043504 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d195104-2cfc-4fc3-8825-53e7fb9cacec tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:24.043972 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d195104-2cfc-4fc3-8825-53e7fb9cacec tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:24.044413 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d195104-2cfc-4fc3-8825-53e7fb9cacec tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:24.052377 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cd72dc7f-171c-4209-8940-cc16b1be2e52 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 1009 microversion: 2.1 time: 0.091744 Sep 24 21:04:24.053271 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 1999/3957] 10.222.0.52 () {58 vars in 1125 bytes} [Sat Sep 24 21:04:23 2022] GET /compute/v2.1/servers => generated 1009 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:24.196168 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3d195104-2cfc-4fc3-8825-53e7fb9cacec tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:24.203169 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9272fefb-5046-43ec-851b-22f95fc101dc tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1635527670", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "b51982af-7e1e-4e73-8b96-2c7d0ba1398d"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:24.204495 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3d195104-2cfc-4fc3-8825-53e7fb9cacec tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.176574 Sep 24 21:04:24.210743 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1959/3958] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:24 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:24.217008 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5f164156-7cfc-4b29-a225-e5ff10bc4965 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:24.228521 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5f164156-7cfc-4b29-a225-e5ff10bc4965 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:24.229181 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5f164156-7cfc-4b29-a225-e5ff10bc4965 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e'} {{(pid=140517) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 21:04:24.243420 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f164156-7cfc-4b29-a225-e5ff10bc4965 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:24.243911 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f164156-7cfc-4b29-a225-e5ff10bc4965 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:24.244349 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f164156-7cfc-4b29-a225-e5ff10bc4965 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:24.245250 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f164156-7cfc-4b29-a225-e5ff10bc4965 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:24.245714 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f164156-7cfc-4b29-a225-e5ff10bc4965 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:24.246147 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f164156-7cfc-4b29-a225-e5ff10bc4965 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:24.271755 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-9272fefb-5046-43ec-851b-22f95fc101dc tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] validate_networks() for [('b51982af-7e1e-4e73-8b96-2c7d0ba1398d', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:04:24.347368 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.multi_cell_list [None req-5f164156-7cfc-4b29-a225-e5ff10bc4965 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 21:04:24.411174 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5f164156-7cfc-4b29-a225-e5ff10bc4965 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.204594 Sep 24 21:04:24.411773 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1960/3959] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 21:04:24 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:04:24.417477 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7de70c0b-a359-47ea-9d1f-0a270ccbd0e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:24.417926 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7de70c0b-a359-47ea-9d1f-0a270ccbd0e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:24.423977 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7de70c0b-a359-47ea-9d1f-0a270ccbd0e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:24.424468 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7de70c0b-a359-47ea-9d1f-0a270ccbd0e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:24.425123 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7de70c0b-a359-47ea-9d1f-0a270ccbd0e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:24.425823 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7de70c0b-a359-47ea-9d1f-0a270ccbd0e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:24.426287 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7de70c0b-a359-47ea-9d1f-0a270ccbd0e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:24.426859 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7de70c0b-a359-47ea-9d1f-0a270ccbd0e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:24.650359 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7de70c0b-a359-47ea-9d1f-0a270ccbd0e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:24.667561 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7de70c0b-a359-47ea-9d1f-0a270ccbd0e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.254716 Sep 24 21:04:24.668150 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1961/3960] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:24 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:24.673947 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0f1a03cc-1d77-49fe-8a60-2bc128711e22 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:24.674840 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0f1a03cc-1d77-49fe-8a60-2bc128711e22 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 81ced789-a25d-407f-89e3-a65be79d2edd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:24.682001 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f1a03cc-1d77-49fe-8a60-2bc128711e22 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:24.683001 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f1a03cc-1d77-49fe-8a60-2bc128711e22 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:24.683709 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f1a03cc-1d77-49fe-8a60-2bc128711e22 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:24.684995 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f1a03cc-1d77-49fe-8a60-2bc128711e22 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:24.685743 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f1a03cc-1d77-49fe-8a60-2bc128711e22 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:24.686979 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f1a03cc-1d77-49fe-8a60-2bc128711e22 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:24.816838 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-9272fefb-5046-43ec-851b-22f95fc101dc tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:04:24.817611 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-9272fefb-5046-43ec-851b-22f95fc101dc tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:04:24.818440 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-9272fefb-5046-43ec-851b-22f95fc101dc tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:04:24.819107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-9272fefb-5046-43ec-851b-22f95fc101dc tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:04:24.819773 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-9272fefb-5046-43ec-851b-22f95fc101dc tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:04:24.832405 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9272fefb-5046-43ec-851b-22f95fc101dc tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:24.833151 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9272fefb-5046-43ec-851b-22f95fc101dc tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:24.834456 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9272fefb-5046-43ec-851b-22f95fc101dc tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:24.835583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9272fefb-5046-43ec-851b-22f95fc101dc tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:24.836278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9272fefb-5046-43ec-851b-22f95fc101dc tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:24.837179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9272fefb-5046-43ec-851b-22f95fc101dc tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:24.858946 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0f1a03cc-1d77-49fe-8a60-2bc128711e22 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:24.861768 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-9272fefb-5046-43ec-851b-22f95fc101dc tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Getting quotas for project 9c334364e60349c38fae5ca1915a93ef. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:04:24.868433 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-9272fefb-5046-43ec-851b-22f95fc101dc tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Getting quotas for user aec06fda18be425bbb3fb60ddcdcb006 and project 9c334364e60349c38fae5ca1915a93ef. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:04:24.870521 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0f1a03cc-1d77-49fe-8a60-2bc128711e22 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/81ced789-a25d-407f-89e3-a65be79d2edd" status: 200 len: 1329 microversion: 2.1 time: 0.200934 Sep 24 21:04:24.871315 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1962/3961] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:24 2022] GET /compute/v2.1/servers/81ced789-a25d-407f-89e3-a65be79d2edd => generated 1329 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:24.886239 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9272fefb-5046-43ec-851b-22f95fc101dc tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:04:24.889555 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9272fefb-5046-43ec-851b-22f95fc101dc tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] [instance: 48279c29-3878-4f58-b160-bb1acb07960d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:04:24.890405 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b33549c1-aabd-4ba5-9203-661d0d227987 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:24.891058 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b33549c1-aabd-4ba5-9203-661d0d227987 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:24.901165 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b33549c1-aabd-4ba5-9203-661d0d227987 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:24.901582 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b33549c1-aabd-4ba5-9203-661d0d227987 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:24.902029 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b33549c1-aabd-4ba5-9203-661d0d227987 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:24.902777 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b33549c1-aabd-4ba5-9203-661d0d227987 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:24.903220 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b33549c1-aabd-4ba5-9203-661d0d227987 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:24.903851 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b33549c1-aabd-4ba5-9203-661d0d227987 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:24.948652 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9272fefb-5046-43ec-851b-22f95fc101dc tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.893408 Sep 24 21:04:24.956248 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2000/3962] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:04:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:04:24.962975 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b886c894-f4e1-42f6-af45-1051634c3e9d tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:24.968834 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b886c894-f4e1-42f6-af45-1051634c3e9d tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:24.969601 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.compute.servers [None req-b886c894-f4e1-42f6-af45-1051634c3e9d tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Removing options 'limit' from query {{(pid=140516) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 24 21:04:24.970710 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b886c894-f4e1-42f6-af45-1051634c3e9d tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Searching by: {'deleted': False, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e'} {{(pid=140516) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 21:04:24.983908 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b886c894-f4e1-42f6-af45-1051634c3e9d tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:24.984690 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b886c894-f4e1-42f6-af45-1051634c3e9d tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:24.985341 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b886c894-f4e1-42f6-af45-1051634c3e9d tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:24.986283 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b886c894-f4e1-42f6-af45-1051634c3e9d tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:24.987119 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b886c894-f4e1-42f6-af45-1051634c3e9d tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:24.987876 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b886c894-f4e1-42f6-af45-1051634c3e9d tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:25.018126 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b886c894-f4e1-42f6-af45-1051634c3e9d tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.060135 Sep 24 21:04:25.019728 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2001/3963] 10.222.0.52 () {58 vars in 1140 bytes} [Sat Sep 24 21:04:24 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:04:25.033641 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-881eab51-b17c-478d-a264-08a323f0844c tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:25.035002 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-881eab51-b17c-478d-a264-08a323f0844c tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:25.050315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-881eab51-b17c-478d-a264-08a323f0844c tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:25.051115 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-881eab51-b17c-478d-a264-08a323f0844c tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:25.051771 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-881eab51-b17c-478d-a264-08a323f0844c tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:25.052884 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-881eab51-b17c-478d-a264-08a323f0844c tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:25.054173 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-881eab51-b17c-478d-a264-08a323f0844c tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:25.055126 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-881eab51-b17c-478d-a264-08a323f0844c tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:25.098617 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b33549c1-aabd-4ba5-9203-661d0d227987 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:25.109048 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b33549c1-aabd-4ba5-9203-661d0d227987 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1519 microversion: 2.1 time: 0.222357 Sep 24 21:04:25.109769 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1963/3964] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:24 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1519 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:25.115269 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e38072d5-bbec-4326-94d7-b20877324d4d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:25.116571 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e38072d5-bbec-4326-94d7-b20877324d4d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:25.131139 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e38072d5-bbec-4326-94d7-b20877324d4d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:25.136615 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e38072d5-bbec-4326-94d7-b20877324d4d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:25.137165 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e38072d5-bbec-4326-94d7-b20877324d4d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:25.138174 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e38072d5-bbec-4326-94d7-b20877324d4d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:25.139478 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e38072d5-bbec-4326-94d7-b20877324d4d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:25.139478 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e38072d5-bbec-4326-94d7-b20877324d4d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:25.248150 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-881eab51-b17c-478d-a264-08a323f0844c tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:25.259627 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-881eab51-b17c-478d-a264-08a323f0844c tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1522 microversion: 2.1 time: 0.238494 Sep 24 21:04:25.260589 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2002/3965] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:25 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:25.271098 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-54580634-5ae7-4e00-b8c6-1c9e980c6525 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:25.271098 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-54580634-5ae7-4e00-b8c6-1c9e980c6525 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] [instance: 48279c29-3878-4f58-b160-bb1acb07960d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:25.359018 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-54580634-5ae7-4e00-b8c6-1c9e980c6525 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec06fda18be425bbb3fb60ddcdcb006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c334364e60349c38fae5ca1915a93ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:25.364491 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e38072d5-bbec-4326-94d7-b20877324d4d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:25.367684 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-54580634-5ae7-4e00-b8c6-1c9e980c6525 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] 10.222.0.52 "GET /compute/v2.1/servers/48279c29-3878-4f58-b160-bb1acb07960d" status: 200 len: 1216 microversion: 2.1 time: 0.105869 Sep 24 21:04:25.368279 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2003/3966] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:25 2022] GET /compute/v2.1/servers/48279c29-3878-4f58-b160-bb1acb07960d => generated 1216 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:25.390743 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e38072d5-bbec-4326-94d7-b20877324d4d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.279166 Sep 24 21:04:25.391517 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1964/3967] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:25 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:25.401305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-472d7a14-6c52-4758-823c-a26560334762 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:25.409315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-472d7a14-6c52-4758-823c-a26560334762 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:25.414930 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-472d7a14-6c52-4758-823c-a26560334762 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-220848403', 'deleted': False, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e'} {{(pid=140516) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 21:04:25.416582 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4036db96-1ed6-4ea3-aedd-15c284ffcb16 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:25.417606 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4036db96-1ed6-4ea3-aedd-15c284ffcb16 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:25.428091 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-472d7a14-6c52-4758-823c-a26560334762 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:25.429425 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-472d7a14-6c52-4758-823c-a26560334762 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:25.430361 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-472d7a14-6c52-4758-823c-a26560334762 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:25.431927 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4036db96-1ed6-4ea3-aedd-15c284ffcb16 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:25.433179 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4036db96-1ed6-4ea3-aedd-15c284ffcb16 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:25.433328 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-472d7a14-6c52-4758-823c-a26560334762 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:25.433675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-472d7a14-6c52-4758-823c-a26560334762 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:25.434188 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4036db96-1ed6-4ea3-aedd-15c284ffcb16 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:25.434315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-472d7a14-6c52-4758-823c-a26560334762 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:25.435265 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4036db96-1ed6-4ea3-aedd-15c284ffcb16 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:25.436300 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4036db96-1ed6-4ea3-aedd-15c284ffcb16 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:25.437069 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4036db96-1ed6-4ea3-aedd-15c284ffcb16 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:25.531028 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.multi_cell_list [None req-472d7a14-6c52-4758-823c-a26560334762 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 21:04:25.645073 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-472d7a14-6c52-4758-823c-a26560334762 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-220848403" status: 200 len: 345 microversion: 2.1 time: 0.274520 Sep 24 21:04:25.646683 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2004/3968] 10.222.0.52 () {58 vars in 1240 bytes} [Sat Sep 24 21:04:25 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-220848403 => generated 345 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:04:25.669735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b95d393f-23aa-43e4-b10b-c4dc324b449b tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:25.677614 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b95d393f-23aa-43e4-b10b-c4dc324b449b tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:25.678668 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b95d393f-23aa-43e4-b10b-c4dc324b449b tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:25.679318 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b95d393f-23aa-43e4-b10b-c4dc324b449b tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:25.705552 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b95d393f-23aa-43e4-b10b-c4dc324b449b tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 06ef44f5-3eae-4780-b544-62102fd945a7] Going to try to stop instance {{(pid=140516) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 24 21:04:25.776446 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b95d393f-23aa-43e4-b10b-c4dc324b449b tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "POST /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7/action" status: 202 len: 0 microversion: 2.1 time: 0.117004 Sep 24 21:04:25.780176 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2005/3969] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:04:25 2022] POST /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:04:25.803087 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0444fe7f-2619-466f-b7ce-e4e9017d59bc tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:25.805605 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0444fe7f-2619-466f-b7ce-e4e9017d59bc tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 06ef44f5-3eae-4780-b544-62102fd945a7] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:25.814755 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0444fe7f-2619-466f-b7ce-e4e9017d59bc tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:25.815221 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0444fe7f-2619-466f-b7ce-e4e9017d59bc tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:25.815840 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0444fe7f-2619-466f-b7ce-e4e9017d59bc tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:25.816671 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0444fe7f-2619-466f-b7ce-e4e9017d59bc tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:25.817244 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0444fe7f-2619-466f-b7ce-e4e9017d59bc tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:25.817821 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0444fe7f-2619-466f-b7ce-e4e9017d59bc tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:25.995184 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4036db96-1ed6-4ea3-aedd-15c284ffcb16 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:26.005435 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4036db96-1ed6-4ea3-aedd-15c284ffcb16 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.593876 Sep 24 21:04:26.018621 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1965/3970] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:25 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:04:26.018621 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a3fd1d6a-7f18-4893-8bc1-356c5e1ca65c tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:26.018621 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a3fd1d6a-7f18-4893-8bc1-356c5e1ca65c tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 81ced789-a25d-407f-89e3-a65be79d2edd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:26.021964 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0444fe7f-2619-466f-b7ce-e4e9017d59bc tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:26.028870 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a3fd1d6a-7f18-4893-8bc1-356c5e1ca65c tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:26.029371 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a3fd1d6a-7f18-4893-8bc1-356c5e1ca65c tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:26.035014 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0444fe7f-2619-466f-b7ce-e4e9017d59bc tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7" status: 200 len: 1519 microversion: 2.1 time: 0.249347 Sep 24 21:04:26.036192 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2006/3971] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:25 2022] GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7 => generated 1519 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:26.042885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-eca547cb-3515-4cc7-8488-c015673479fe tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:26.043196 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a3fd1d6a-7f18-4893-8bc1-356c5e1ca65c tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:26.043763 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-eca547cb-3515-4cc7-8488-c015673479fe tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:26.044520 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a3fd1d6a-7f18-4893-8bc1-356c5e1ca65c tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:26.045167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a3fd1d6a-7f18-4893-8bc1-356c5e1ca65c tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:26.046015 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a3fd1d6a-7f18-4893-8bc1-356c5e1ca65c tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:26.050280 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eca547cb-3515-4cc7-8488-c015673479fe tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:26.050801 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eca547cb-3515-4cc7-8488-c015673479fe tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:26.052873 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eca547cb-3515-4cc7-8488-c015673479fe tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:26.054443 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eca547cb-3515-4cc7-8488-c015673479fe tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:26.054970 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eca547cb-3515-4cc7-8488-c015673479fe tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:26.055413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eca547cb-3515-4cc7-8488-c015673479fe tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:26.096475 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:04:26.315773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a3fd1d6a-7f18-4893-8bc1-356c5e1ca65c tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:26.339002 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a3fd1d6a-7f18-4893-8bc1-356c5e1ca65c tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/81ced789-a25d-407f-89e3-a65be79d2edd" status: 200 len: 1510 microversion: 2.1 time: 0.331328 Sep 24 21:04:26.341242 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1966/3972] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:26 2022] GET /compute/v2.1/servers/81ced789-a25d-407f-89e3-a65be79d2edd => generated 1510 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:26.348638 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b85c625a-1a53-4dcb-8dd3-ce9d2382f483 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:26.349863 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b85c625a-1a53-4dcb-8dd3-ce9d2382f483 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:26.363484 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b85c625a-1a53-4dcb-8dd3-ce9d2382f483 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:26.363974 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b85c625a-1a53-4dcb-8dd3-ce9d2382f483 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:26.364206 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-eca547cb-3515-4cc7-8488-c015673479fe tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:26.364753 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b85c625a-1a53-4dcb-8dd3-ce9d2382f483 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:26.365219 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b85c625a-1a53-4dcb-8dd3-ce9d2382f483 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:26.365697 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b85c625a-1a53-4dcb-8dd3-ce9d2382f483 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:26.366648 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b85c625a-1a53-4dcb-8dd3-ce9d2382f483 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:26.375469 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-eca547cb-3515-4cc7-8488-c015673479fe tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.336015 Sep 24 21:04:26.387914 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2007/3973] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:26 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:26.401923 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7d887863-fc8f-4f31-a464-7a72373f9473 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:26.403894 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7d887863-fc8f-4f31-a464-7a72373f9473 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:26.416122 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7d887863-fc8f-4f31-a464-7a72373f9473 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:26.416819 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7d887863-fc8f-4f31-a464-7a72373f9473 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:26.417755 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7d887863-fc8f-4f31-a464-7a72373f9473 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:26.418528 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7d887863-fc8f-4f31-a464-7a72373f9473 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:26.418987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7d887863-fc8f-4f31-a464-7a72373f9473 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:26.420333 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7d887863-fc8f-4f31-a464-7a72373f9473 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:26.609359 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b85c625a-1a53-4dcb-8dd3-ce9d2382f483 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:26.618420 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b85c625a-1a53-4dcb-8dd3-ce9d2382f483 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1519 microversion: 2.1 time: 0.274389 Sep 24 21:04:26.633945 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1967/3974] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:26 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1519 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:26.641087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8004a197-b6cf-4f63-baf6-afa05f916343 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:26.641997 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8004a197-b6cf-4f63-baf6-afa05f916343 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 81ced789-a25d-407f-89e3-a65be79d2edd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:26.649758 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7d887863-fc8f-4f31-a464-7a72373f9473 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:26.652163 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8004a197-b6cf-4f63-baf6-afa05f916343 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:26.652908 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8004a197-b6cf-4f63-baf6-afa05f916343 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:26.654549 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8004a197-b6cf-4f63-baf6-afa05f916343 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:26.655827 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8004a197-b6cf-4f63-baf6-afa05f916343 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:26.656717 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8004a197-b6cf-4f63-baf6-afa05f916343 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:26.657685 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8004a197-b6cf-4f63-baf6-afa05f916343 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:26.660855 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7d887863-fc8f-4f31-a464-7a72373f9473 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1522 microversion: 2.1 time: 0.271753 Sep 24 21:04:26.661631 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2008/3975] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:26 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:26.668373 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-26450e63-e66a-48df-97a7-06ac36f8e1ca tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:26.669006 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-26450e63-e66a-48df-97a7-06ac36f8e1ca tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] [instance: 48279c29-3878-4f58-b160-bb1acb07960d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:26.675514 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26450e63-e66a-48df-97a7-06ac36f8e1ca tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:26.676015 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26450e63-e66a-48df-97a7-06ac36f8e1ca tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:26.676462 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26450e63-e66a-48df-97a7-06ac36f8e1ca tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:26.677296 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26450e63-e66a-48df-97a7-06ac36f8e1ca tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:26.677801 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26450e63-e66a-48df-97a7-06ac36f8e1ca tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:26.678242 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26450e63-e66a-48df-97a7-06ac36f8e1ca tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:26.796692 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-26450e63-e66a-48df-97a7-06ac36f8e1ca tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec06fda18be425bbb3fb60ddcdcb006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c334364e60349c38fae5ca1915a93ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:26.815517 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-26450e63-e66a-48df-97a7-06ac36f8e1ca tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] 10.222.0.52 "GET /compute/v2.1/servers/48279c29-3878-4f58-b160-bb1acb07960d" status: 200 len: 1268 microversion: 2.1 time: 0.152802 Sep 24 21:04:26.818411 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2009/3976] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:26 2022] GET /compute/v2.1/servers/48279c29-3878-4f58-b160-bb1acb07960d => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:26.872169 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8004a197-b6cf-4f63-baf6-afa05f916343 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:26.881120 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8004a197-b6cf-4f63-baf6-afa05f916343 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/81ced789-a25d-407f-89e3-a65be79d2edd" status: 200 len: 1510 microversion: 2.1 time: 0.245603 Sep 24 21:04:26.881760 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1968/3977] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:26 2022] GET /compute/v2.1/servers/81ced789-a25d-407f-89e3-a65be79d2edd => generated 1510 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:26.904405 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-76895a62-efdb-4c50-866a-546a8035503e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:26.904919 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-76895a62-efdb-4c50-866a-546a8035503e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 81ced789-a25d-407f-89e3-a65be79d2edd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:26.922774 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76895a62-efdb-4c50-866a-546a8035503e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:26.923301 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76895a62-efdb-4c50-866a-546a8035503e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:26.923746 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76895a62-efdb-4c50-866a-546a8035503e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:26.924459 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76895a62-efdb-4c50-866a-546a8035503e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:26.924919 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76895a62-efdb-4c50-866a-546a8035503e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:26.925343 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76895a62-efdb-4c50-866a-546a8035503e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:26.974435 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-76895a62-efdb-4c50-866a-546a8035503e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 81ced789-a25d-407f-89e3-a65be79d2edd] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:04:27.060954 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7640dac0-8766-474e-8afb-65ffc4f75f7e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:27.061934 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7640dac0-8766-474e-8afb-65ffc4f75f7e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 06ef44f5-3eae-4780-b544-62102fd945a7] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:27.075200 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7640dac0-8766-474e-8afb-65ffc4f75f7e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:27.075984 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7640dac0-8766-474e-8afb-65ffc4f75f7e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:27.076641 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7640dac0-8766-474e-8afb-65ffc4f75f7e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:27.082885 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7640dac0-8766-474e-8afb-65ffc4f75f7e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:27.083632 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7640dac0-8766-474e-8afb-65ffc4f75f7e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:27.084250 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7640dac0-8766-474e-8afb-65ffc4f75f7e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:27.092506 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:04:27.099947 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-76895a62-efdb-4c50-866a-546a8035503e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "DELETE /compute/v2.1/servers/81ced789-a25d-407f-89e3-a65be79d2edd" status: 204 len: 0 microversion: 2.1 time: 0.199219 Sep 24 21:04:27.110287 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2010/3978] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:04:26 2022] DELETE /compute/v2.1/servers/81ced789-a25d-407f-89e3-a65be79d2edd => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 24 21:04:27.122474 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b6103880-70f0-4af2-85d4-aeb1165e294d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:27.123845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b6103880-70f0-4af2-85d4-aeb1165e294d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 81ced789-a25d-407f-89e3-a65be79d2edd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:27.134538 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6103880-70f0-4af2-85d4-aeb1165e294d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:27.135189 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6103880-70f0-4af2-85d4-aeb1165e294d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:27.135859 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6103880-70f0-4af2-85d4-aeb1165e294d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:27.137552 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6103880-70f0-4af2-85d4-aeb1165e294d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:27.138130 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6103880-70f0-4af2-85d4-aeb1165e294d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:27.138750 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6103880-70f0-4af2-85d4-aeb1165e294d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:27.307852 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7640dac0-8766-474e-8afb-65ffc4f75f7e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:27.322625 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:04:27.328626 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7640dac0-8766-474e-8afb-65ffc4f75f7e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7" status: 200 len: 1519 microversion: 2.1 time: 0.271656 Sep 24 21:04:27.329866 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1969/3979] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:27 2022] GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7 => generated 1519 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:04:27.367978 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b6103880-70f0-4af2-85d4-aeb1165e294d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:27.378162 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b6103880-70f0-4af2-85d4-aeb1165e294d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/81ced789-a25d-407f-89e3-a65be79d2edd" status: 200 len: 1516 microversion: 2.1 time: 0.264768 Sep 24 21:04:27.379906 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2011/3980] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:27 2022] GET /compute/v2.1/servers/81ced789-a25d-407f-89e3-a65be79d2edd => generated 1516 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:27.645467 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-be2a7c44-6dee-47c9-bb9a-841be97bd4dd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:27.646023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-be2a7c44-6dee-47c9-bb9a-841be97bd4dd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:27.654801 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-be2a7c44-6dee-47c9-bb9a-841be97bd4dd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:27.656346 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-be2a7c44-6dee-47c9-bb9a-841be97bd4dd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:27.657302 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-be2a7c44-6dee-47c9-bb9a-841be97bd4dd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:27.659470 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-be2a7c44-6dee-47c9-bb9a-841be97bd4dd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:27.660112 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-be2a7c44-6dee-47c9-bb9a-841be97bd4dd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:27.661873 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-be2a7c44-6dee-47c9-bb9a-841be97bd4dd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:27.685810 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-04c5b7ae-414e-4f62-9379-b16d69d0adc9 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:27.686853 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-04c5b7ae-414e-4f62-9379-b16d69d0adc9 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:27.707088 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-04c5b7ae-414e-4f62-9379-b16d69d0adc9 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:27.707813 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-04c5b7ae-414e-4f62-9379-b16d69d0adc9 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:27.709516 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-04c5b7ae-414e-4f62-9379-b16d69d0adc9 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:27.711200 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-04c5b7ae-414e-4f62-9379-b16d69d0adc9 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:27.711848 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-04c5b7ae-414e-4f62-9379-b16d69d0adc9 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:27.712452 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-04c5b7ae-414e-4f62-9379-b16d69d0adc9 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:27.879658 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-be2a7c44-6dee-47c9-bb9a-841be97bd4dd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:27.889108 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-be2a7c44-6dee-47c9-bb9a-841be97bd4dd tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1519 microversion: 2.1 time: 0.251469 Sep 24 21:04:27.889697 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1970/3981] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:27 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1519 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:27.900137 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e98749ef-a9ec-4ad7-bb1e-7757bb5c5121 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:27.901025 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e98749ef-a9ec-4ad7-bb1e-7757bb5c5121 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] [instance: 48279c29-3878-4f58-b160-bb1acb07960d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:27.907320 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e98749ef-a9ec-4ad7-bb1e-7757bb5c5121 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:27.907810 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e98749ef-a9ec-4ad7-bb1e-7757bb5c5121 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:27.908513 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e98749ef-a9ec-4ad7-bb1e-7757bb5c5121 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:27.909207 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e98749ef-a9ec-4ad7-bb1e-7757bb5c5121 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:27.909662 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e98749ef-a9ec-4ad7-bb1e-7757bb5c5121 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:27.910085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e98749ef-a9ec-4ad7-bb1e-7757bb5c5121 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:27.926262 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-04c5b7ae-414e-4f62-9379-b16d69d0adc9 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:27.935050 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-04c5b7ae-414e-4f62-9379-b16d69d0adc9 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1522 microversion: 2.1 time: 0.253020 Sep 24 21:04:27.935654 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2012/3982] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:27 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:28.045905 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e98749ef-a9ec-4ad7-bb1e-7757bb5c5121 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec06fda18be425bbb3fb60ddcdcb006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c334364e60349c38fae5ca1915a93ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:28.053660 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e98749ef-a9ec-4ad7-bb1e-7757bb5c5121 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] 10.222.0.52 "GET /compute/v2.1/servers/48279c29-3878-4f58-b160-bb1acb07960d" status: 200 len: 1316 microversion: 2.1 time: 0.162784 Sep 24 21:04:28.054235 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1971/3983] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:27 2022] GET /compute/v2.1/servers/48279c29-3878-4f58-b160-bb1acb07960d => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:28.350837 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-47152f28-7f78-4804-8e0b-c2f8f840b4d9 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:28.351613 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-47152f28-7f78-4804-8e0b-c2f8f840b4d9 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 06ef44f5-3eae-4780-b544-62102fd945a7] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:28.357825 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47152f28-7f78-4804-8e0b-c2f8f840b4d9 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:28.358318 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47152f28-7f78-4804-8e0b-c2f8f840b4d9 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:28.358782 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47152f28-7f78-4804-8e0b-c2f8f840b4d9 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:28.359488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47152f28-7f78-4804-8e0b-c2f8f840b4d9 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:28.359942 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47152f28-7f78-4804-8e0b-c2f8f840b4d9 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:28.360365 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47152f28-7f78-4804-8e0b-c2f8f840b4d9 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:28.402145 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-659772fd-fa22-43e5-b42c-361ad8d4d846 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:28.405134 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-659772fd-fa22-43e5-b42c-361ad8d4d846 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 81ced789-a25d-407f-89e3-a65be79d2edd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:28.409560 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-659772fd-fa22-43e5-b42c-361ad8d4d846 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:28.410222 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-659772fd-fa22-43e5-b42c-361ad8d4d846 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:28.410732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-659772fd-fa22-43e5-b42c-361ad8d4d846 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:28.411449 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-659772fd-fa22-43e5-b42c-361ad8d4d846 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:28.412184 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-659772fd-fa22-43e5-b42c-361ad8d4d846 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:28.412463 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-659772fd-fa22-43e5-b42c-361ad8d4d846 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:28.569987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-47152f28-7f78-4804-8e0b-c2f8f840b4d9 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:28.578574 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-47152f28-7f78-4804-8e0b-c2f8f840b4d9 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7" status: 200 len: 1519 microversion: 2.1 time: 0.231645 Sep 24 21:04:28.579376 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2013/3984] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:28 2022] GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7 => generated 1519 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:28.606313 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-659772fd-fa22-43e5-b42c-361ad8d4d846 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:28.614522 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-659772fd-fa22-43e5-b42c-361ad8d4d846 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/81ced789-a25d-407f-89e3-a65be79d2edd" status: 200 len: 1516 microversion: 2.1 time: 0.217069 Sep 24 21:04:28.615217 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1972/3985] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:28 2022] GET /compute/v2.1/servers/81ced789-a25d-407f-89e3-a65be79d2edd => generated 1516 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:04:28.912567 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-989cbf57-6786-42ed-bb73-736c1c036a82 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:28.913904 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-989cbf57-6786-42ed-bb73-736c1c036a82 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:28.920835 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-989cbf57-6786-42ed-bb73-736c1c036a82 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:28.921332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-989cbf57-6786-42ed-bb73-736c1c036a82 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:28.921778 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-989cbf57-6786-42ed-bb73-736c1c036a82 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:28.922488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-989cbf57-6786-42ed-bb73-736c1c036a82 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:28.922977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-989cbf57-6786-42ed-bb73-736c1c036a82 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:28.923413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-989cbf57-6786-42ed-bb73-736c1c036a82 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:28.957874 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d5d4386d-a8c2-4e40-a361-a8cb46ea75b1 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:28.958513 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d5d4386d-a8c2-4e40-a361-a8cb46ea75b1 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:28.965738 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d5d4386d-a8c2-4e40-a361-a8cb46ea75b1 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:28.966232 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d5d4386d-a8c2-4e40-a361-a8cb46ea75b1 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:28.966904 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d5d4386d-a8c2-4e40-a361-a8cb46ea75b1 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:28.967799 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d5d4386d-a8c2-4e40-a361-a8cb46ea75b1 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:28.968270 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d5d4386d-a8c2-4e40-a361-a8cb46ea75b1 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:28.968709 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d5d4386d-a8c2-4e40-a361-a8cb46ea75b1 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:29.119211 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-989cbf57-6786-42ed-bb73-736c1c036a82 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:29.127354 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-989cbf57-6786-42ed-bb73-736c1c036a82 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1519 microversion: 2.1 time: 0.219001 Sep 24 21:04:29.128192 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2014/3986] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:28 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1519 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:29.133709 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8fe5f657-8ce7-48e5-b21c-54c8215c5813 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:29.134682 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8fe5f657-8ce7-48e5-b21c-54c8215c5813 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] [instance: 48279c29-3878-4f58-b160-bb1acb07960d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:29.142322 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8fe5f657-8ce7-48e5-b21c-54c8215c5813 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:29.143130 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8fe5f657-8ce7-48e5-b21c-54c8215c5813 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:29.143846 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8fe5f657-8ce7-48e5-b21c-54c8215c5813 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:29.144854 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8fe5f657-8ce7-48e5-b21c-54c8215c5813 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:29.145578 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8fe5f657-8ce7-48e5-b21c-54c8215c5813 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:29.146111 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8fe5f657-8ce7-48e5-b21c-54c8215c5813 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:29.159536 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d5d4386d-a8c2-4e40-a361-a8cb46ea75b1 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:29.167421 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d5d4386d-a8c2-4e40-a361-a8cb46ea75b1 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1522 microversion: 2.1 time: 0.213250 Sep 24 21:04:29.168010 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1973/3987] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:28 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:04:29.284857 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8fe5f657-8ce7-48e5-b21c-54c8215c5813 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec06fda18be425bbb3fb60ddcdcb006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c334364e60349c38fae5ca1915a93ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:29.293855 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8fe5f657-8ce7-48e5-b21c-54c8215c5813 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] 10.222.0.52 "GET /compute/v2.1/servers/48279c29-3878-4f58-b160-bb1acb07960d" status: 200 len: 1316 microversion: 2.1 time: 0.164348 Sep 24 21:04:29.294420 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2015/3988] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:29 2022] GET /compute/v2.1/servers/48279c29-3878-4f58-b160-bb1acb07960d => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:29.310430 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-e96cdad0-02fc-47f9-bfec-a5bca71c4b76 req-6c81a6fc-b0ff-48c2-8b36-a728ccdb48b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48279c29-3878-4f58-b160-bb1acb07960d", "tag": "dd065a4d-1cc7-44b8-986a-6bf2049db577"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:29.321429 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e96cdad0-02fc-47f9-bfec-a5bca71c4b76 req-6c81a6fc-b0ff-48c2-8b36-a728ccdb48b8 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:29.321913 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e96cdad0-02fc-47f9-bfec-a5bca71c4b76 req-6c81a6fc-b0ff-48c2-8b36-a728ccdb48b8 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:29.322702 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e96cdad0-02fc-47f9-bfec-a5bca71c4b76 req-6c81a6fc-b0ff-48c2-8b36-a728ccdb48b8 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:29.333771 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-e96cdad0-02fc-47f9-bfec-a5bca71c4b76 req-6c81a6fc-b0ff-48c2-8b36-a728ccdb48b8 service nova] Creating event network-changed:dd065a4d-1cc7-44b8-986a-6bf2049db577 for instance 48279c29-3878-4f58-b160-bb1acb07960d on nch2-master-1 Sep 24 21:04:29.339411 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-e96cdad0-02fc-47f9-bfec-a5bca71c4b76 req-6c81a6fc-b0ff-48c2-8b36-a728ccdb48b8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034018 Sep 24 21:04:29.340311 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1974/3989] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:04:29.605548 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b9b0f8a9-86ea-4293-b96f-fed05d99e22a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:29.606172 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b9b0f8a9-86ea-4293-b96f-fed05d99e22a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 06ef44f5-3eae-4780-b544-62102fd945a7] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:29.612819 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b9b0f8a9-86ea-4293-b96f-fed05d99e22a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:29.613823 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b9b0f8a9-86ea-4293-b96f-fed05d99e22a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:29.614460 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b9b0f8a9-86ea-4293-b96f-fed05d99e22a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:29.616685 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b9b0f8a9-86ea-4293-b96f-fed05d99e22a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:29.617793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b9b0f8a9-86ea-4293-b96f-fed05d99e22a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:29.618721 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b9b0f8a9-86ea-4293-b96f-fed05d99e22a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:29.639023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1511ac46-aa68-44b0-8ac8-10c0c9958e68 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:29.640308 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1511ac46-aa68-44b0-8ac8-10c0c9958e68 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 81ced789-a25d-407f-89e3-a65be79d2edd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:29.649278 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1511ac46-aa68-44b0-8ac8-10c0c9958e68 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:29.649788 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1511ac46-aa68-44b0-8ac8-10c0c9958e68 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:29.650239 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1511ac46-aa68-44b0-8ac8-10c0c9958e68 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:29.659234 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1511ac46-aa68-44b0-8ac8-10c0c9958e68 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:29.659957 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1511ac46-aa68-44b0-8ac8-10c0c9958e68 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:29.661214 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1511ac46-aa68-44b0-8ac8-10c0c9958e68 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:29.780488 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1511ac46-aa68-44b0-8ac8-10c0c9958e68 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:29.791765 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1511ac46-aa68-44b0-8ac8-10c0c9958e68 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/81ced789-a25d-407f-89e3-a65be79d2edd" status: 200 len: 1314 microversion: 2.1 time: 0.157372 Sep 24 21:04:29.793800 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1975/3990] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:29 2022] GET /compute/v2.1/servers/81ced789-a25d-407f-89e3-a65be79d2edd => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:04:29.835546 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b9b0f8a9-86ea-4293-b96f-fed05d99e22a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:29.844730 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b9b0f8a9-86ea-4293-b96f-fed05d99e22a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7" status: 200 len: 1519 microversion: 2.1 time: 0.244669 Sep 24 21:04:29.845315 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2016/3991] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:29 2022] GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7 => generated 1519 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:30.153074 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-887c7d7e-60fe-4d27-95b5-fddf32e2f4f8 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:30.153608 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-887c7d7e-60fe-4d27-95b5-fddf32e2f4f8 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:30.160399 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-887c7d7e-60fe-4d27-95b5-fddf32e2f4f8 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:30.160892 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-887c7d7e-60fe-4d27-95b5-fddf32e2f4f8 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:30.161331 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-887c7d7e-60fe-4d27-95b5-fddf32e2f4f8 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:30.162031 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-887c7d7e-60fe-4d27-95b5-fddf32e2f4f8 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:30.162514 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-887c7d7e-60fe-4d27-95b5-fddf32e2f4f8 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:30.163948 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-887c7d7e-60fe-4d27-95b5-fddf32e2f4f8 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:30.190122 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ad937c65-7973-498b-9654-316c7dd0b8d8 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:30.190761 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ad937c65-7973-498b-9654-316c7dd0b8d8 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:30.197820 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad937c65-7973-498b-9654-316c7dd0b8d8 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:30.198309 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad937c65-7973-498b-9654-316c7dd0b8d8 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:30.198778 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad937c65-7973-498b-9654-316c7dd0b8d8 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:30.199483 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad937c65-7973-498b-9654-316c7dd0b8d8 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:30.199936 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad937c65-7973-498b-9654-316c7dd0b8d8 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:30.200367 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad937c65-7973-498b-9654-316c7dd0b8d8 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:30.352442 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-887c7d7e-60fe-4d27-95b5-fddf32e2f4f8 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:30.360320 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-887c7d7e-60fe-4d27-95b5-fddf32e2f4f8 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1519 microversion: 2.1 time: 0.211358 Sep 24 21:04:30.360900 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1976/3992] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:30 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1519 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:30.365761 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b3bd0117-77f0-469e-9336-0dce98414c0f tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:30.366679 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b3bd0117-77f0-469e-9336-0dce98414c0f tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] [instance: 48279c29-3878-4f58-b160-bb1acb07960d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:30.372875 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b3bd0117-77f0-469e-9336-0dce98414c0f tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:30.373372 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b3bd0117-77f0-469e-9336-0dce98414c0f tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:30.373819 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b3bd0117-77f0-469e-9336-0dce98414c0f tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:30.374548 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b3bd0117-77f0-469e-9336-0dce98414c0f tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:30.375013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b3bd0117-77f0-469e-9336-0dce98414c0f tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:30.375448 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b3bd0117-77f0-469e-9336-0dce98414c0f tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:30.383168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ad937c65-7973-498b-9654-316c7dd0b8d8 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:30.391062 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ad937c65-7973-498b-9654-316c7dd0b8d8 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1522 microversion: 2.1 time: 0.204722 Sep 24 21:04:30.391638 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2017/3993] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:30 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:30.507573 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b3bd0117-77f0-469e-9336-0dce98414c0f tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec06fda18be425bbb3fb60ddcdcb006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c334364e60349c38fae5ca1915a93ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:30.515283 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b3bd0117-77f0-469e-9336-0dce98414c0f tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] 10.222.0.52 "GET /compute/v2.1/servers/48279c29-3878-4f58-b160-bb1acb07960d" status: 200 len: 1316 microversion: 2.1 time: 0.153129 Sep 24 21:04:30.515848 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1977/3994] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:30 2022] GET /compute/v2.1/servers/48279c29-3878-4f58-b160-bb1acb07960d => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:30.818596 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-083f708f-3d19-45ec-b615-c9e97dd99de0 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:30.819178 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-083f708f-3d19-45ec-b615-c9e97dd99de0 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 81ced789-a25d-407f-89e3-a65be79d2edd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:30.825280 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-083f708f-3d19-45ec-b615-c9e97dd99de0 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:30.825766 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-083f708f-3d19-45ec-b615-c9e97dd99de0 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:30.826872 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-083f708f-3d19-45ec-b615-c9e97dd99de0 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:30.826980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-083f708f-3d19-45ec-b615-c9e97dd99de0 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:30.827402 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-083f708f-3d19-45ec-b615-c9e97dd99de0 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:30.827835 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-083f708f-3d19-45ec-b615-c9e97dd99de0 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:30.859064 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-083f708f-3d19-45ec-b615-c9e97dd99de0 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:30.859551 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-083f708f-3d19-45ec-b615-c9e97dd99de0 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:30.859985 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-083f708f-3d19-45ec-b615-c9e97dd99de0 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:30.860430 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-083f708f-3d19-45ec-b615-c9e97dd99de0 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lazy-loading 'fault' on Instance uuid 81ced789-a25d-407f-89e3-a65be79d2edd {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:04:30.869110 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f7e0e1c5-1fff-491f-aeda-887ba1eead68 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:30.869763 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f7e0e1c5-1fff-491f-aeda-887ba1eead68 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 06ef44f5-3eae-4780-b544-62102fd945a7] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:30.876182 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7e0e1c5-1fff-491f-aeda-887ba1eead68 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:30.876684 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7e0e1c5-1fff-491f-aeda-887ba1eead68 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:30.877134 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7e0e1c5-1fff-491f-aeda-887ba1eead68 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:30.877853 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7e0e1c5-1fff-491f-aeda-887ba1eead68 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:30.878321 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7e0e1c5-1fff-491f-aeda-887ba1eead68 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:30.878791 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7e0e1c5-1fff-491f-aeda-887ba1eead68 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:30.903551 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-083f708f-3d19-45ec-b615-c9e97dd99de0 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:30.911834 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-083f708f-3d19-45ec-b615-c9e97dd99de0 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/81ced789-a25d-407f-89e3-a65be79d2edd" status: 200 len: 1319 microversion: 2.1 time: 0.097139 Sep 24 21:04:30.912426 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2018/3995] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:30 2022] GET /compute/v2.1/servers/81ced789-a25d-407f-89e3-a65be79d2edd => generated 1319 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:31.021828 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f7e0e1c5-1fff-491f-aeda-887ba1eead68 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:31.031151 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f7e0e1c5-1fff-491f-aeda-887ba1eead68 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7" status: 200 len: 1519 microversion: 2.1 time: 0.166399 Sep 24 21:04:31.032048 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1978/3996] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:30 2022] GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:04:31.360138 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-5f593288-5243-4be2-8b36-1263e054765b req-c31b1a90-7900-4e81-a107-b17cca8c158e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81ced789-a25d-407f-89e3-a65be79d2edd", "name": "network-vif-deleted", "tag": "f9a7bf2c-e3f8-4b7f-aa5c-aeceafe6b6de"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:31.372085 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-5f593288-5243-4be2-8b36-1263e054765b req-c31b1a90-7900-4e81-a107-b17cca8c158e service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:31.372568 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-5f593288-5243-4be2-8b36-1263e054765b req-c31b1a90-7900-4e81-a107-b17cca8c158e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:31.373011 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-5f593288-5243-4be2-8b36-1263e054765b req-c31b1a90-7900-4e81-a107-b17cca8c158e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:31.385313 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-5f593288-5243-4be2-8b36-1263e054765b req-c31b1a90-7900-4e81-a107-b17cca8c158e service nova] Creating event network-vif-deleted:f9a7bf2c-e3f8-4b7f-aa5c-aeceafe6b6de for instance 81ced789-a25d-407f-89e3-a65be79d2edd on nch2-master-1 Sep 24 21:04:31.386013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5fd2008a-4dce-4a66-b747-57b899c17994 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:31.386670 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5fd2008a-4dce-4a66-b747-57b899c17994 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:31.390158 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-5f593288-5243-4be2-8b36-1263e054765b req-c31b1a90-7900-4e81-a107-b17cca8c158e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033877 Sep 24 21:04:31.390842 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2019/3997] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:04:31.394761 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5fd2008a-4dce-4a66-b747-57b899c17994 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:31.395220 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5fd2008a-4dce-4a66-b747-57b899c17994 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:31.395669 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5fd2008a-4dce-4a66-b747-57b899c17994 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:31.396394 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5fd2008a-4dce-4a66-b747-57b899c17994 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:31.396862 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5fd2008a-4dce-4a66-b747-57b899c17994 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:31.397411 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5fd2008a-4dce-4a66-b747-57b899c17994 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:31.416012 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-55433424-bcd2-4926-8a57-4a4d58ab3544 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:31.416734 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-55433424-bcd2-4926-8a57-4a4d58ab3544 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:31.427947 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-55433424-bcd2-4926-8a57-4a4d58ab3544 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:31.429156 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-55433424-bcd2-4926-8a57-4a4d58ab3544 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:31.430051 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-55433424-bcd2-4926-8a57-4a4d58ab3544 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:31.430852 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-55433424-bcd2-4926-8a57-4a4d58ab3544 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:31.431796 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-55433424-bcd2-4926-8a57-4a4d58ab3544 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:31.432233 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-55433424-bcd2-4926-8a57-4a4d58ab3544 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:31.646018 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5fd2008a-4dce-4a66-b747-57b899c17994 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:31.653309 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-55433424-bcd2-4926-8a57-4a4d58ab3544 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:31.661810 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5fd2008a-4dce-4a66-b747-57b899c17994 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1519 microversion: 2.1 time: 0.281177 Sep 24 21:04:31.662264 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-55433424-bcd2-4926-8a57-4a4d58ab3544 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1522 microversion: 2.1 time: 0.251216 Sep 24 21:04:31.667860 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1979/3998] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:31 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1519 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:04:31.668013 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2020/3999] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:31 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:04:31.670235 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-54a841c6-1f3b-42fe-aa04-3e4f1509d218 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:31.671190 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-54a841c6-1f3b-42fe-aa04-3e4f1509d218 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] [instance: 48279c29-3878-4f58-b160-bb1acb07960d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:31.677101 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54a841c6-1f3b-42fe-aa04-3e4f1509d218 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:31.677602 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54a841c6-1f3b-42fe-aa04-3e4f1509d218 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:31.678041 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54a841c6-1f3b-42fe-aa04-3e4f1509d218 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:31.679409 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54a841c6-1f3b-42fe-aa04-3e4f1509d218 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:31.679905 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54a841c6-1f3b-42fe-aa04-3e4f1509d218 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:31.680334 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54a841c6-1f3b-42fe-aa04-3e4f1509d218 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:31.812724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-54a841c6-1f3b-42fe-aa04-3e4f1509d218 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec06fda18be425bbb3fb60ddcdcb006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c334364e60349c38fae5ca1915a93ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:31.821184 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-54a841c6-1f3b-42fe-aa04-3e4f1509d218 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] 10.222.0.52 "GET /compute/v2.1/servers/48279c29-3878-4f58-b160-bb1acb07960d" status: 200 len: 1316 microversion: 2.1 time: 0.157372 Sep 24 21:04:31.821753 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1980/4000] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:31 2022] GET /compute/v2.1/servers/48279c29-3878-4f58-b160-bb1acb07960d => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:31.935491 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-24d99f70-6675-41cb-903a-230f23607df6 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:31.936088 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-24d99f70-6675-41cb-903a-230f23607df6 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 81ced789-a25d-407f-89e3-a65be79d2edd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:31.942102 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-24d99f70-6675-41cb-903a-230f23607df6 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:31.942629 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-24d99f70-6675-41cb-903a-230f23607df6 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:31.943075 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-24d99f70-6675-41cb-903a-230f23607df6 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:31.943764 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-24d99f70-6675-41cb-903a-230f23607df6 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:31.945013 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-24d99f70-6675-41cb-903a-230f23607df6 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:31.945448 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-24d99f70-6675-41cb-903a-230f23607df6 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:31.958900 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-24d99f70-6675-41cb-903a-230f23607df6 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] HTTP exception thrown: Instance 81ced789-a25d-407f-89e3-a65be79d2edd could not be found. Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-24d99f70-6675-41cb-903a-230f23607df6 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Request method failure captured: Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/81ced789-a25d-407f-89e3-a65be79d2edd HTTP/1.1 Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3CaLUabI_YBYC2XnM21T8dL5FNXXvceQt6A3bijM2xUqNxa7o1mArSf5dFDgPeh3vgkyUYVZenobpLU3uEqGcvnEbw-nMZfSWEM5OkDmeYEccMJ8-yhXeZa1T-3DnHpo2MRC1ewpBuezwDhE04pucSEH5uW1HzlM0IgaFpEaRXllaA Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersTestJSON-1457868986 Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersTestJSON-1457868986-project Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: e557d91b49c143499d809a55e85932fd Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersTestJSON-1457868986-project Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 81ced789-a25d-407f-89e3-a65be79d2edd could not be found. Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '81ced789-a25d-407f-89e3-a65be79d2edd'} Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81ced789-a25d-407f-89e3-a65be79d2edd could not be found. Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81ced789-a25d-407f-89e3-a65be79d2edd could not be found. Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:04:31.961372 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:04:31.966792 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:31.966792 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:04:31.966792 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:04:31.966792 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:04:31.966792 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:04:31.966792 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81ced789-a25d-407f-89e3-a65be79d2edd could not be found. Sep 24 21:04:31.966792 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:04:31.966792 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-24d99f70-6675-41cb-903a-230f23607df6 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Returning 404 to user: Instance 81ced789-a25d-407f-89e3-a65be79d2edd could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:04:31.966792 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-24d99f70-6675-41cb-903a-230f23607df6 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/81ced789-a25d-407f-89e3-a65be79d2edd" status: 404 len: 111 microversion: 2.1 time: 0.031275 Sep 24 21:04:31.966792 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2021/4001] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:31 2022] GET /compute/v2.1/servers/81ced789-a25d-407f-89e3-a65be79d2edd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:04:31.971753 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-32704cd4-87a5-447e-82d0-a4756b750739 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '.version_select at 0x7f4b1100f430>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:31.991386 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-32704cd4-87a5-447e-82d0-a4756b750739 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-key-1790091851" status: 202 len: 0 microversion: 2.1 time: 0.023381 Sep 24 21:04:31.991962 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1981/4002] 10.222.0.52 () {58 vars in 1209 bytes} [Sat Sep 24 21:04:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1790091851 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:04:32.054362 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4c70134c-160c-4639-a4fc-48f66103bef9 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:32.055154 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4c70134c-160c-4639-a4fc-48f66103bef9 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 06ef44f5-3eae-4780-b544-62102fd945a7] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:32.061413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4c70134c-160c-4639-a4fc-48f66103bef9 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:32.061912 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4c70134c-160c-4639-a4fc-48f66103bef9 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:32.062355 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4c70134c-160c-4639-a4fc-48f66103bef9 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:32.063096 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4c70134c-160c-4639-a4fc-48f66103bef9 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:32.063564 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4c70134c-160c-4639-a4fc-48f66103bef9 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:32.064200 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4c70134c-160c-4639-a4fc-48f66103bef9 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:32.102393 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-eb30abd1-f406-4634-b4a0-1e24e070e16d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-859307982", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "86ee1dec-a957-4cc1-98d2-2e275615c01a"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:32.158383 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-eb30abd1-f406-4634-b4a0-1e24e070e16d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] validate_networks() for [('86ee1dec-a957-4cc1-98d2-2e275615c01a', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:04:32.259640 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4c70134c-160c-4639-a4fc-48f66103bef9 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:32.267548 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4c70134c-160c-4639-a4fc-48f66103bef9 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7" status: 200 len: 1519 microversion: 2.1 time: 0.217209 Sep 24 21:04:32.268319 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2022/4003] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:32 2022] GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7 => generated 1519 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:32.563660 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-eb30abd1-f406-4634-b4a0-1e24e070e16d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:04:32.564086 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-eb30abd1-f406-4634-b4a0-1e24e070e16d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:04:32.564568 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-eb30abd1-f406-4634-b4a0-1e24e070e16d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:04:32.564986 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-eb30abd1-f406-4634-b4a0-1e24e070e16d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:04:32.565401 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-eb30abd1-f406-4634-b4a0-1e24e070e16d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:04:32.574765 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb30abd1-f406-4634-b4a0-1e24e070e16d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:32.575248 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb30abd1-f406-4634-b4a0-1e24e070e16d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:32.575716 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb30abd1-f406-4634-b4a0-1e24e070e16d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:32.576470 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb30abd1-f406-4634-b4a0-1e24e070e16d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:32.576928 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb30abd1-f406-4634-b4a0-1e24e070e16d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:32.577353 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb30abd1-f406-4634-b4a0-1e24e070e16d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:32.589830 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:04:32.596452 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-eb30abd1-f406-4634-b4a0-1e24e070e16d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Getting quotas for project accafa2724354ca8b1c9f19940989429. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:04:32.603097 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-eb30abd1-f406-4634-b4a0-1e24e070e16d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Getting quotas for user e557d91b49c143499d809a55e85932fd and project accafa2724354ca8b1c9f19940989429. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:04:32.619468 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-eb30abd1-f406-4634-b4a0-1e24e070e16d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:04:32.621774 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-eb30abd1-f406-4634-b4a0-1e24e070e16d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ca4c8bfe-e06d-427f-85fb-1d2729572b07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:04:32.672737 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-eb30abd1-f406-4634-b4a0-1e24e070e16d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.574183 Sep 24 21:04:32.673387 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1982/4004] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:04:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 24 21:04:32.685107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0e80ffa8-4289-4b13-ba6b-87a32fc4a388 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:32.685851 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0e80ffa8-4289-4b13-ba6b-87a32fc4a388 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ca4c8bfe-e06d-427f-85fb-1d2729572b07] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:32.686183 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-90b7f07d-f1fa-4934-afe1-37d22bb47eb5 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:32.686841 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-90b7f07d-f1fa-4934-afe1-37d22bb47eb5 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:32.695048 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-90b7f07d-f1fa-4934-afe1-37d22bb47eb5 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:32.696027 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-90b7f07d-f1fa-4934-afe1-37d22bb47eb5 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:32.696441 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-90b7f07d-f1fa-4934-afe1-37d22bb47eb5 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:32.697390 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-90b7f07d-f1fa-4934-afe1-37d22bb47eb5 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:32.697971 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-90b7f07d-f1fa-4934-afe1-37d22bb47eb5 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:32.698415 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-90b7f07d-f1fa-4934-afe1-37d22bb47eb5 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:32.750737 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0e80ffa8-4289-4b13-ba6b-87a32fc4a388 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:32.759029 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0e80ffa8-4289-4b13-ba6b-87a32fc4a388 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07" status: 200 len: 1208 microversion: 2.1 time: 0.077696 Sep 24 21:04:32.759927 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2023/4005] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:32 2022] GET /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07 => generated 1208 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:32.765145 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1b7cee8c-3f2b-4522-9380-e9788ce3e94e tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:32.765759 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1b7cee8c-3f2b-4522-9380-e9788ce3e94e tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:32.772773 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1b7cee8c-3f2b-4522-9380-e9788ce3e94e tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:32.773270 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1b7cee8c-3f2b-4522-9380-e9788ce3e94e tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:32.773708 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1b7cee8c-3f2b-4522-9380-e9788ce3e94e tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:32.774413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1b7cee8c-3f2b-4522-9380-e9788ce3e94e tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:32.774906 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1b7cee8c-3f2b-4522-9380-e9788ce3e94e tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:32.775339 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1b7cee8c-3f2b-4522-9380-e9788ce3e94e tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:32.791673 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:04:32.926260 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-90b7f07d-f1fa-4934-afe1-37d22bb47eb5 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:32.937275 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-90b7f07d-f1fa-4934-afe1-37d22bb47eb5 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1519 microversion: 2.1 time: 0.255178 Sep 24 21:04:32.937872 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1983/4006] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:32 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1519 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:32.942636 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-38554aa9-271a-4b70-b949-cfa2bdd866fa tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:32.943250 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-38554aa9-271a-4b70-b949-cfa2bdd866fa tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] [instance: 48279c29-3878-4f58-b160-bb1acb07960d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:32.949225 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38554aa9-271a-4b70-b949-cfa2bdd866fa tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:32.949731 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38554aa9-271a-4b70-b949-cfa2bdd866fa tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:32.950171 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38554aa9-271a-4b70-b949-cfa2bdd866fa tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:32.951036 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38554aa9-271a-4b70-b949-cfa2bdd866fa tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:32.951502 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38554aa9-271a-4b70-b949-cfa2bdd866fa tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:32.951968 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38554aa9-271a-4b70-b949-cfa2bdd866fa tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:32.956757 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1b7cee8c-3f2b-4522-9380-e9788ce3e94e tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:32.965631 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1b7cee8c-3f2b-4522-9380-e9788ce3e94e tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1522 microversion: 2.1 time: 0.204285 Sep 24 21:04:32.966983 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2024/4007] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:32 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:33.097500 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-38554aa9-271a-4b70-b949-cfa2bdd866fa tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec06fda18be425bbb3fb60ddcdcb006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c334364e60349c38fae5ca1915a93ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:33.106910 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-38554aa9-271a-4b70-b949-cfa2bdd866fa tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] 10.222.0.52 "GET /compute/v2.1/servers/48279c29-3878-4f58-b160-bb1acb07960d" status: 200 len: 1316 microversion: 2.1 time: 0.167947 Sep 24 21:04:33.107500 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1984/4008] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:32 2022] GET /compute/v2.1/servers/48279c29-3878-4f58-b160-bb1acb07960d => generated 1316 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:33.293603 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d9c5c62b-ab5f-408b-9f1c-b1c45137e17c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:33.294328 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d9c5c62b-ab5f-408b-9f1c-b1c45137e17c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 06ef44f5-3eae-4780-b544-62102fd945a7] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:33.302442 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d9c5c62b-ab5f-408b-9f1c-b1c45137e17c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:33.303052 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d9c5c62b-ab5f-408b-9f1c-b1c45137e17c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:33.304057 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d9c5c62b-ab5f-408b-9f1c-b1c45137e17c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:33.304695 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d9c5c62b-ab5f-408b-9f1c-b1c45137e17c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:33.305222 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d9c5c62b-ab5f-408b-9f1c-b1c45137e17c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:33.306101 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d9c5c62b-ab5f-408b-9f1c-b1c45137e17c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:33.438028 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d9c5c62b-ab5f-408b-9f1c-b1c45137e17c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:33.449425 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d9c5c62b-ab5f-408b-9f1c-b1c45137e17c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7" status: 200 len: 1519 microversion: 2.1 time: 0.160681 Sep 24 21:04:33.450026 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2025/4009] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:33 2022] GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:04:33.781097 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fc6d6e89-417f-481b-8b1d-5c1d6fbf8c22 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:33.781718 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fc6d6e89-417f-481b-8b1d-5c1d6fbf8c22 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ca4c8bfe-e06d-427f-85fb-1d2729572b07] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:33.789163 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc6d6e89-417f-481b-8b1d-5c1d6fbf8c22 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:33.790053 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc6d6e89-417f-481b-8b1d-5c1d6fbf8c22 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:33.790810 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc6d6e89-417f-481b-8b1d-5c1d6fbf8c22 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:33.791757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc6d6e89-417f-481b-8b1d-5c1d6fbf8c22 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:33.792438 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc6d6e89-417f-481b-8b1d-5c1d6fbf8c22 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:33.793090 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc6d6e89-417f-481b-8b1d-5c1d6fbf8c22 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:33.859033 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fc6d6e89-417f-481b-8b1d-5c1d6fbf8c22 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:33.866787 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fc6d6e89-417f-481b-8b1d-5c1d6fbf8c22 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07" status: 200 len: 1260 microversion: 2.1 time: 0.089529 Sep 24 21:04:33.867602 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1985/4010] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:33 2022] GET /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07 => generated 1260 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:33.963648 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1e8c13d8-f6c2-4958-96a2-a9707b82a9ae tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:33.964273 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1e8c13d8-f6c2-4958-96a2-a9707b82a9ae tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:33.971239 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e8c13d8-f6c2-4958-96a2-a9707b82a9ae tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:33.971762 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e8c13d8-f6c2-4958-96a2-a9707b82a9ae tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:33.972205 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e8c13d8-f6c2-4958-96a2-a9707b82a9ae tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:33.972910 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e8c13d8-f6c2-4958-96a2-a9707b82a9ae tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:33.973373 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e8c13d8-f6c2-4958-96a2-a9707b82a9ae tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:33.973806 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e8c13d8-f6c2-4958-96a2-a9707b82a9ae tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:33.989165 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f93cb8ca-05d2-4116-afa9-14966bb043bc tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:33.989934 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f93cb8ca-05d2-4116-afa9-14966bb043bc tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:33.996923 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f93cb8ca-05d2-4116-afa9-14966bb043bc tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:33.997414 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f93cb8ca-05d2-4116-afa9-14966bb043bc tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:33.997852 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f93cb8ca-05d2-4116-afa9-14966bb043bc tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:33.998582 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f93cb8ca-05d2-4116-afa9-14966bb043bc tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:33.999044 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f93cb8ca-05d2-4116-afa9-14966bb043bc tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:33.999473 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f93cb8ca-05d2-4116-afa9-14966bb043bc tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:34.197261 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1e8c13d8-f6c2-4958-96a2-a9707b82a9ae tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:34.206563 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1e8c13d8-f6c2-4958-96a2-a9707b82a9ae tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1519 microversion: 2.1 time: 0.247737 Sep 24 21:04:34.211963 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2026/4011] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:33 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1519 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:04:34.217907 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2a844bcf-fe20-481a-bdd5-0e72f5717a6c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:34.218784 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2a844bcf-fe20-481a-bdd5-0e72f5717a6c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] [instance: 48279c29-3878-4f58-b160-bb1acb07960d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:34.225278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2a844bcf-fe20-481a-bdd5-0e72f5717a6c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:34.226544 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2a844bcf-fe20-481a-bdd5-0e72f5717a6c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:34.227272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2a844bcf-fe20-481a-bdd5-0e72f5717a6c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:34.228730 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2a844bcf-fe20-481a-bdd5-0e72f5717a6c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:34.229699 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2a844bcf-fe20-481a-bdd5-0e72f5717a6c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:34.230580 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2a844bcf-fe20-481a-bdd5-0e72f5717a6c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:34.248579 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f93cb8ca-05d2-4116-afa9-14966bb043bc tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:34.257303 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f93cb8ca-05d2-4116-afa9-14966bb043bc tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1522 microversion: 2.1 time: 0.271928 Sep 24 21:04:34.258605 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1986/4012] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:33 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:04:34.383981 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2a844bcf-fe20-481a-bdd5-0e72f5717a6c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec06fda18be425bbb3fb60ddcdcb006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c334364e60349c38fae5ca1915a93ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:34.392740 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2a844bcf-fe20-481a-bdd5-0e72f5717a6c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] 10.222.0.52 "GET /compute/v2.1/servers/48279c29-3878-4f58-b160-bb1acb07960d" status: 200 len: 1316 microversion: 2.1 time: 0.179371 Sep 24 21:04:34.402754 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2027/4013] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:34 2022] GET /compute/v2.1/servers/48279c29-3878-4f58-b160-bb1acb07960d => generated 1316 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:34.473391 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-50f920c6-c580-4f7f-a780-8006726b6ec4 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:34.474032 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-50f920c6-c580-4f7f-a780-8006726b6ec4 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 06ef44f5-3eae-4780-b544-62102fd945a7] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:34.480295 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-50f920c6-c580-4f7f-a780-8006726b6ec4 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:34.480786 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-50f920c6-c580-4f7f-a780-8006726b6ec4 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:34.481231 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-50f920c6-c580-4f7f-a780-8006726b6ec4 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:34.481936 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-50f920c6-c580-4f7f-a780-8006726b6ec4 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:34.482394 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-50f920c6-c580-4f7f-a780-8006726b6ec4 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:34.482852 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-50f920c6-c580-4f7f-a780-8006726b6ec4 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:34.615071 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-50f920c6-c580-4f7f-a780-8006726b6ec4 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:34.623625 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-50f920c6-c580-4f7f-a780-8006726b6ec4 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7" status: 200 len: 1519 microversion: 2.1 time: 0.154049 Sep 24 21:04:34.624488 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1987/4014] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:34 2022] GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:34.889481 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8fda9b19-c73f-4e17-850a-08a41ce1f75e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:34.890010 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8fda9b19-c73f-4e17-850a-08a41ce1f75e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ca4c8bfe-e06d-427f-85fb-1d2729572b07] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:34.896087 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8fda9b19-c73f-4e17-850a-08a41ce1f75e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:34.896575 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8fda9b19-c73f-4e17-850a-08a41ce1f75e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:34.897015 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8fda9b19-c73f-4e17-850a-08a41ce1f75e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:34.897715 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8fda9b19-c73f-4e17-850a-08a41ce1f75e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:34.898174 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8fda9b19-c73f-4e17-850a-08a41ce1f75e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:34.899179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8fda9b19-c73f-4e17-850a-08a41ce1f75e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:34.972190 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8fda9b19-c73f-4e17-850a-08a41ce1f75e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:34.982020 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8fda9b19-c73f-4e17-850a-08a41ce1f75e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07" status: 200 len: 1266 microversion: 2.1 time: 0.096468 Sep 24 21:04:34.998000 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2028/4015] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:34 2022] GET /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07 => generated 1266 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:35.237521 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e30ba054-4e38-483e-bcd1-6ea50bf9f098 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:35.238159 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e30ba054-4e38-483e-bcd1-6ea50bf9f098 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:35.251007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e30ba054-4e38-483e-bcd1-6ea50bf9f098 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:35.252181 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e30ba054-4e38-483e-bcd1-6ea50bf9f098 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:35.253416 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e30ba054-4e38-483e-bcd1-6ea50bf9f098 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:35.253696 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e30ba054-4e38-483e-bcd1-6ea50bf9f098 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:35.254387 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e30ba054-4e38-483e-bcd1-6ea50bf9f098 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:35.255046 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e30ba054-4e38-483e-bcd1-6ea50bf9f098 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:35.282162 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-07100472-6587-4dbf-8b30-867c166e73b0 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:35.283413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-07100472-6587-4dbf-8b30-867c166e73b0 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:35.293072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07100472-6587-4dbf-8b30-867c166e73b0 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:35.297160 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07100472-6587-4dbf-8b30-867c166e73b0 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:35.297832 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07100472-6587-4dbf-8b30-867c166e73b0 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:35.299161 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07100472-6587-4dbf-8b30-867c166e73b0 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:35.299806 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07100472-6587-4dbf-8b30-867c166e73b0 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:35.300417 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07100472-6587-4dbf-8b30-867c166e73b0 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:35.481558 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=14 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:04:35.538715 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e30ba054-4e38-483e-bcd1-6ea50bf9f098 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:35.542074 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:04:35.556026 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-07100472-6587-4dbf-8b30-867c166e73b0 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:35.556447 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e30ba054-4e38-483e-bcd1-6ea50bf9f098 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1519 microversion: 2.1 time: 0.322903 Sep 24 21:04:35.572781 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1988/4016] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:35 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1519 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:35.578817 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-07100472-6587-4dbf-8b30-867c166e73b0 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1522 microversion: 2.1 time: 0.300533 Sep 24 21:04:35.607022 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2029/4017] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:35 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:35.607312 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-8e63d132-fcde-4725-af67-a1d065c98e6a req-f11b47dd-4023-46e5-84fa-ea233096249f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48279c29-3878-4f58-b160-bb1acb07960d", "name": "network-vif-plugged", "status": "completed", "tag": "dd065a4d-1cc7-44b8-986a-6bf2049db577"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:35.607420 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c5758ccd-4d59-4e1c-a8a6-5effa8fe17d8 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:35.607420 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c5758ccd-4d59-4e1c-a8a6-5effa8fe17d8 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] [instance: 48279c29-3878-4f58-b160-bb1acb07960d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:35.607599 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-8e63d132-fcde-4725-af67-a1d065c98e6a req-f11b47dd-4023-46e5-84fa-ea233096249f service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:35.607599 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-8e63d132-fcde-4725-af67-a1d065c98e6a req-f11b47dd-4023-46e5-84fa-ea233096249f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:35.607599 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-8e63d132-fcde-4725-af67-a1d065c98e6a req-f11b47dd-4023-46e5-84fa-ea233096249f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:35.607853 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5758ccd-4d59-4e1c-a8a6-5effa8fe17d8 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:35.607853 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5758ccd-4d59-4e1c-a8a6-5effa8fe17d8 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:35.607853 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5758ccd-4d59-4e1c-a8a6-5effa8fe17d8 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:35.607853 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5758ccd-4d59-4e1c-a8a6-5effa8fe17d8 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:35.607853 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5758ccd-4d59-4e1c-a8a6-5effa8fe17d8 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:35.607853 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5758ccd-4d59-4e1c-a8a6-5effa8fe17d8 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:35.609300 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-8e63d132-fcde-4725-af67-a1d065c98e6a req-f11b47dd-4023-46e5-84fa-ea233096249f service nova] Creating event network-vif-plugged:dd065a4d-1cc7-44b8-986a-6bf2049db577 for instance 48279c29-3878-4f58-b160-bb1acb07960d on nch2-master-1 Sep 24 21:04:35.619566 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-8e63d132-fcde-4725-af67-a1d065c98e6a req-f11b47dd-4023-46e5-84fa-ea233096249f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045202 Sep 24 21:04:35.620581 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1989/4018] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:04:35.649389 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9e94b880-6032-48ff-8a3e-fa23cfebf305 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:35.650101 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9e94b880-6032-48ff-8a3e-fa23cfebf305 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 06ef44f5-3eae-4780-b544-62102fd945a7] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:35.656571 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9e94b880-6032-48ff-8a3e-fa23cfebf305 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:35.657060 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9e94b880-6032-48ff-8a3e-fa23cfebf305 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:35.657731 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9e94b880-6032-48ff-8a3e-fa23cfebf305 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:35.658796 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9e94b880-6032-48ff-8a3e-fa23cfebf305 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:35.659270 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9e94b880-6032-48ff-8a3e-fa23cfebf305 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:35.659778 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9e94b880-6032-48ff-8a3e-fa23cfebf305 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:35.814398 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c5758ccd-4d59-4e1c-a8a6-5effa8fe17d8 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec06fda18be425bbb3fb60ddcdcb006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c334364e60349c38fae5ca1915a93ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:35.824048 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c5758ccd-4d59-4e1c-a8a6-5effa8fe17d8 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] 10.222.0.52 "GET /compute/v2.1/servers/48279c29-3878-4f58-b160-bb1acb07960d" status: 200 len: 1316 microversion: 2.1 time: 0.242597 Sep 24 21:04:35.825096 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2030/4019] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:35 2022] GET /compute/v2.1/servers/48279c29-3878-4f58-b160-bb1acb07960d => generated 1316 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:35.843901 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9e94b880-6032-48ff-8a3e-fa23cfebf305 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:35.852586 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9e94b880-6032-48ff-8a3e-fa23cfebf305 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7" status: 200 len: 1519 microversion: 2.1 time: 0.208009 Sep 24 21:04:35.853169 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1990/4020] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:35 2022] GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7 => generated 1519 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:04:36.005807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-51db2aa4-580f-4d2b-b272-63d48d873754 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:36.007201 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-51db2aa4-580f-4d2b-b272-63d48d873754 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ca4c8bfe-e06d-427f-85fb-1d2729572b07] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:36.014332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51db2aa4-580f-4d2b-b272-63d48d873754 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:36.015409 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51db2aa4-580f-4d2b-b272-63d48d873754 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:36.015859 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51db2aa4-580f-4d2b-b272-63d48d873754 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:36.016597 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51db2aa4-580f-4d2b-b272-63d48d873754 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:36.017403 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51db2aa4-580f-4d2b-b272-63d48d873754 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:36.018011 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51db2aa4-580f-4d2b-b272-63d48d873754 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:36.022124 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-9679146f-cc27-4cc4-ac1d-0f808c67c324 req-3543a24b-c17f-4066-bb7a-54c2cdb1afef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca4c8bfe-e06d-427f-85fb-1d2729572b07", "tag": "f1ef0e43-058d-4c31-b2c8-ae05ef2ff17a"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:36.032574 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-9679146f-cc27-4cc4-ac1d-0f808c67c324 req-3543a24b-c17f-4066-bb7a-54c2cdb1afef service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:36.033420 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-9679146f-cc27-4cc4-ac1d-0f808c67c324 req-3543a24b-c17f-4066-bb7a-54c2cdb1afef service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:36.033927 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-9679146f-cc27-4cc4-ac1d-0f808c67c324 req-3543a24b-c17f-4066-bb7a-54c2cdb1afef service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:36.046296 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-9679146f-cc27-4cc4-ac1d-0f808c67c324 req-3543a24b-c17f-4066-bb7a-54c2cdb1afef service nova] Creating event network-changed:f1ef0e43-058d-4c31-b2c8-ae05ef2ff17a for instance ca4c8bfe-e06d-427f-85fb-1d2729572b07 on nch2-master-1 Sep 24 21:04:36.051443 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-9679146f-cc27-4cc4-ac1d-0f808c67c324 req-3543a24b-c17f-4066-bb7a-54c2cdb1afef service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033149 Sep 24 21:04:36.052629 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1991/4021] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:04:36.155009 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-51db2aa4-580f-4d2b-b272-63d48d873754 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:36.163205 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-51db2aa4-580f-4d2b-b272-63d48d873754 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07" status: 200 len: 1308 microversion: 2.1 time: 0.161761 Sep 24 21:04:36.163760 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2031/4022] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:36 2022] GET /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07 => generated 1308 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:36.579727 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-635d88e0-6dd0-4e3d-a0d9-e9f83e459b9b tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:36.580436 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-635d88e0-6dd0-4e3d-a0d9-e9f83e459b9b tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:36.588266 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-635d88e0-6dd0-4e3d-a0d9-e9f83e459b9b tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:36.588756 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-635d88e0-6dd0-4e3d-a0d9-e9f83e459b9b tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:36.589204 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-635d88e0-6dd0-4e3d-a0d9-e9f83e459b9b tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:36.589905 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-635d88e0-6dd0-4e3d-a0d9-e9f83e459b9b tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:36.590369 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-635d88e0-6dd0-4e3d-a0d9-e9f83e459b9b tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:36.590830 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-635d88e0-6dd0-4e3d-a0d9-e9f83e459b9b tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:36.613718 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-638277c9-7dae-45bd-b266-bb78e49aad4c tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:36.614331 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-638277c9-7dae-45bd-b266-bb78e49aad4c tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:36.621064 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-638277c9-7dae-45bd-b266-bb78e49aad4c tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:36.621491 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-638277c9-7dae-45bd-b266-bb78e49aad4c tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:36.621928 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-638277c9-7dae-45bd-b266-bb78e49aad4c tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:36.622658 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-638277c9-7dae-45bd-b266-bb78e49aad4c tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:36.623113 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-638277c9-7dae-45bd-b266-bb78e49aad4c tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:36.623538 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-638277c9-7dae-45bd-b266-bb78e49aad4c tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:36.784756 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-635d88e0-6dd0-4e3d-a0d9-e9f83e459b9b tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:36.793522 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-635d88e0-6dd0-4e3d-a0d9-e9f83e459b9b tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1519 microversion: 2.1 time: 0.217881 Sep 24 21:04:36.794417 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1992/4023] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:36 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1519 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:36.814612 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-638277c9-7dae-45bd-b266-bb78e49aad4c tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:36.824820 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-638277c9-7dae-45bd-b266-bb78e49aad4c tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1522 microversion: 2.1 time: 0.214868 Sep 24 21:04:36.825673 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2032/4024] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:36 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:04:36.847371 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-921be017-67e5-413b-afca-f02997e54f6c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:36.847994 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-921be017-67e5-413b-afca-f02997e54f6c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] [instance: 48279c29-3878-4f58-b160-bb1acb07960d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:36.855351 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-921be017-67e5-413b-afca-f02997e54f6c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:36.856038 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-921be017-67e5-413b-afca-f02997e54f6c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:36.856693 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-921be017-67e5-413b-afca-f02997e54f6c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:36.857593 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-921be017-67e5-413b-afca-f02997e54f6c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:36.858051 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-921be017-67e5-413b-afca-f02997e54f6c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:36.858478 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-921be017-67e5-413b-afca-f02997e54f6c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:36.875768 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1fcf6c8c-c8e1-43ad-9498-f7ed8f699991 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:36.876303 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1fcf6c8c-c8e1-43ad-9498-f7ed8f699991 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 06ef44f5-3eae-4780-b544-62102fd945a7] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:36.883747 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1fcf6c8c-c8e1-43ad-9498-f7ed8f699991 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:36.884262 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1fcf6c8c-c8e1-43ad-9498-f7ed8f699991 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:36.884832 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1fcf6c8c-c8e1-43ad-9498-f7ed8f699991 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:36.885553 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1fcf6c8c-c8e1-43ad-9498-f7ed8f699991 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:36.886017 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1fcf6c8c-c8e1-43ad-9498-f7ed8f699991 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:36.886451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1fcf6c8c-c8e1-43ad-9498-f7ed8f699991 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:37.072854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-921be017-67e5-413b-afca-f02997e54f6c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec06fda18be425bbb3fb60ddcdcb006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c334364e60349c38fae5ca1915a93ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:37.077113 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1fcf6c8c-c8e1-43ad-9498-f7ed8f699991 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:37.080933 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-921be017-67e5-413b-afca-f02997e54f6c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] 10.222.0.52 "GET /compute/v2.1/servers/48279c29-3878-4f58-b160-bb1acb07960d" status: 200 len: 1316 microversion: 2.1 time: 0.237392 Sep 24 21:04:37.081519 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1993/4025] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:36 2022] GET /compute/v2.1/servers/48279c29-3878-4f58-b160-bb1acb07960d => generated 1316 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:37.084964 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1fcf6c8c-c8e1-43ad-9498-f7ed8f699991 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7" status: 200 len: 1519 microversion: 2.1 time: 0.213122 Sep 24 21:04:37.085554 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2033/4026] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:36 2022] GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7 => generated 1519 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:04:37.187230 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-53012b56-7821-4969-a82a-68bc32d142dd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:37.187883 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-53012b56-7821-4969-a82a-68bc32d142dd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ca4c8bfe-e06d-427f-85fb-1d2729572b07] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:37.194064 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53012b56-7821-4969-a82a-68bc32d142dd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:37.194602 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53012b56-7821-4969-a82a-68bc32d142dd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:37.195105 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53012b56-7821-4969-a82a-68bc32d142dd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:37.196822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53012b56-7821-4969-a82a-68bc32d142dd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:37.197288 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53012b56-7821-4969-a82a-68bc32d142dd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:37.197879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53012b56-7821-4969-a82a-68bc32d142dd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:37.329901 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-53012b56-7821-4969-a82a-68bc32d142dd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:37.337758 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-53012b56-7821-4969-a82a-68bc32d142dd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07" status: 200 len: 1308 microversion: 2.1 time: 0.154689 Sep 24 21:04:37.338582 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1994/4027] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:37 2022] GET /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07 => generated 1308 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:37.817516 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-197a92d6-57af-456d-8d0b-103a86145c89 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:37.818137 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-197a92d6-57af-456d-8d0b-103a86145c89 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:37.824367 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-197a92d6-57af-456d-8d0b-103a86145c89 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:37.824848 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-197a92d6-57af-456d-8d0b-103a86145c89 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:37.825282 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-197a92d6-57af-456d-8d0b-103a86145c89 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:37.825977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-197a92d6-57af-456d-8d0b-103a86145c89 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:37.826424 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-197a92d6-57af-456d-8d0b-103a86145c89 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:37.826878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-197a92d6-57af-456d-8d0b-103a86145c89 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:37.848043 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a9af7384-f0b9-4296-bae2-09db1d6b72a0 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:37.848667 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a9af7384-f0b9-4296-bae2-09db1d6b72a0 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:37.856214 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9af7384-f0b9-4296-bae2-09db1d6b72a0 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:37.856712 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9af7384-f0b9-4296-bae2-09db1d6b72a0 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:37.857155 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9af7384-f0b9-4296-bae2-09db1d6b72a0 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:37.857863 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9af7384-f0b9-4296-bae2-09db1d6b72a0 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:37.858324 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9af7384-f0b9-4296-bae2-09db1d6b72a0 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:37.858790 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9af7384-f0b9-4296-bae2-09db1d6b72a0 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:38.024533 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-197a92d6-57af-456d-8d0b-103a86145c89 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:38.032617 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-197a92d6-57af-456d-8d0b-103a86145c89 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1519 microversion: 2.1 time: 0.219612 Sep 24 21:04:38.033485 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2034/4028] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:37 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1519 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:38.036083 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a9af7384-f0b9-4296-bae2-09db1d6b72a0 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:38.044500 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a9af7384-f0b9-4296-bae2-09db1d6b72a0 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1502 microversion: 2.1 time: 0.200260 Sep 24 21:04:38.045217 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1995/4029] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:37 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1502 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:04:38.067005 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-87006bdc-8c2e-4fe2-bbc7-d1d99bc09b5f tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:38.067657 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-87006bdc-8c2e-4fe2-bbc7-d1d99bc09b5f tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: acc02ed3-5cf0-4fe4-b4d7-ac40fe691355] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:38.074184 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-87006bdc-8c2e-4fe2-bbc7-d1d99bc09b5f tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:38.074716 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-87006bdc-8c2e-4fe2-bbc7-d1d99bc09b5f tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:38.075159 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-87006bdc-8c2e-4fe2-bbc7-d1d99bc09b5f tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:38.075860 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-87006bdc-8c2e-4fe2-bbc7-d1d99bc09b5f tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:38.076319 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-87006bdc-8c2e-4fe2-bbc7-d1d99bc09b5f tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:38.076752 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-87006bdc-8c2e-4fe2-bbc7-d1d99bc09b5f tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:38.103979 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ae77dfb9-4019-4cec-8472-4a3dd4129d2f tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:38.104640 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ae77dfb9-4019-4cec-8472-4a3dd4129d2f tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] [instance: 48279c29-3878-4f58-b160-bb1acb07960d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:38.110788 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ae77dfb9-4019-4cec-8472-4a3dd4129d2f tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:38.111284 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ae77dfb9-4019-4cec-8472-4a3dd4129d2f tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:38.111753 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ae77dfb9-4019-4cec-8472-4a3dd4129d2f tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:38.112445 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ae77dfb9-4019-4cec-8472-4a3dd4129d2f tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:38.112906 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ae77dfb9-4019-4cec-8472-4a3dd4129d2f tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:38.113342 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ae77dfb9-4019-4cec-8472-4a3dd4129d2f tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:38.266559 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-87006bdc-8c2e-4fe2-bbc7-d1d99bc09b5f tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:38.275865 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-87006bdc-8c2e-4fe2-bbc7-d1d99bc09b5f tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/acc02ed3-5cf0-4fe4-b4d7-ac40fe691355" status: 200 len: 1515 microversion: 2.1 time: 0.212671 Sep 24 21:04:38.276695 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2035/4030] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:38 2022] GET /compute/v2.1/servers/acc02ed3-5cf0-4fe4-b4d7-ac40fe691355 => generated 1515 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:04:38.281383 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-538adc9f-920d-4c01-a25a-42640623ecf3 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:38.282177 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-538adc9f-920d-4c01-a25a-42640623ecf3 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 06ef44f5-3eae-4780-b544-62102fd945a7] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:38.288211 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-538adc9f-920d-4c01-a25a-42640623ecf3 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:38.288679 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-538adc9f-920d-4c01-a25a-42640623ecf3 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:38.289312 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-538adc9f-920d-4c01-a25a-42640623ecf3 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:38.290274 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-538adc9f-920d-4c01-a25a-42640623ecf3 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:38.290751 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-538adc9f-920d-4c01-a25a-42640623ecf3 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:38.291172 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-538adc9f-920d-4c01-a25a-42640623ecf3 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:38.294326 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ae77dfb9-4019-4cec-8472-4a3dd4129d2f tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec06fda18be425bbb3fb60ddcdcb006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c334364e60349c38fae5ca1915a93ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:38.302294 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ae77dfb9-4019-4cec-8472-4a3dd4129d2f tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] 10.222.0.52 "GET /compute/v2.1/servers/48279c29-3878-4f58-b160-bb1acb07960d" status: 200 len: 1504 microversion: 2.1 time: 0.202304 Sep 24 21:04:38.302985 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1996/4031] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:38 2022] GET /compute/v2.1/servers/48279c29-3878-4f58-b160-bb1acb07960d => generated 1504 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:04:38.307623 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cc2bf5e2-fb3c-4db6-9676-f1e74e292ad6 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:38.310238 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cc2bf5e2-fb3c-4db6-9676-f1e74e292ad6 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: d1798afb-913b-45a1-9e3b-2a981ea8713e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:38.315870 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-cc2bf5e2-fb3c-4db6-9676-f1e74e292ad6 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] HTTP exception thrown: Instance d1798afb-913b-45a1-9e3b-2a981ea8713e could not be found. Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cc2bf5e2-fb3c-4db6-9676-f1e74e292ad6 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Request method failure captured: Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers/d1798afb-913b-45a1-9e3b-2a981ea8713e/action HTTP/1.1 Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 14 Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3CejOkEbEqme5Iu5NaNNYGxm_xyFOFmUSNFDPLyLevAaMpOaK2kD9jvX8gKBoGWjrZ4l9265-kGjEZEOFmEJCxuMoMRcw7FLPLvLOa4eFdrLfTFgk4mHHNpy9ceB5UPclIag2JcoR5KXK9iG6pPICQS8M2TNnyIAxR5hdIsUaQK52Y Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 3a9bed43edcf4c5594ffde33282bc48c Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1027624478 Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3a9bed43edcf4c5594ffde33282bc48c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3a9bed43edcf4c5594ffde33282bc48c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3a9bed43edcf4c5594ffde33282bc48c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3a9bed43edcf4c5594ffde33282bc48c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1027624478 Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 3a9bed43edcf4c5594ffde33282bc48c Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1027624478 Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServerRescueNegativeTestJSON-1027624478-project Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 5cb9430023d842b4a5d930e01f7340f3 Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1027624478-project Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: {"rescue": {}} Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance d1798afb-913b-45a1-9e3b-2a981ea8713e could not be found. Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'd1798afb-913b-45a1-9e3b-2a981ea8713e', 'body': {'rescue': {}}} Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1798afb-913b-45a1-9e3b-2a981ea8713e could not be found. Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1798afb-913b-45a1-9e3b-2a981ea8713e could not be found. Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:38.323053 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:38.328489 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:04:38.328489 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:04:38.328489 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:04:38.328489 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:04:38.328489 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1798afb-913b-45a1-9e3b-2a981ea8713e could not be found. Sep 24 21:04:38.328489 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:38.328489 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cc2bf5e2-fb3c-4db6-9676-f1e74e292ad6 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Returning 404 to user: Instance d1798afb-913b-45a1-9e3b-2a981ea8713e could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:04:38.328489 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cc2bf5e2-fb3c-4db6-9676-f1e74e292ad6 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "POST /compute/v2.1/servers/d1798afb-913b-45a1-9e3b-2a981ea8713e/action" status: 404 len: 111 microversion: 2.1 time: 0.021342 Sep 24 21:04:38.328489 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1997/4032] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:04:38 2022] POST /compute/v2.1/servers/d1798afb-913b-45a1-9e3b-2a981ea8713e/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:04:38.334113 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-46bbf196-1e79-4699-aa0a-beafe06ebb78 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:38.334633 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-46bbf196-1e79-4699-aa0a-beafe06ebb78 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] [instance: 48279c29-3878-4f58-b160-bb1acb07960d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:38.342847 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46bbf196-1e79-4699-aa0a-beafe06ebb78 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:38.343368 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46bbf196-1e79-4699-aa0a-beafe06ebb78 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:38.343806 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46bbf196-1e79-4699-aa0a-beafe06ebb78 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:38.344505 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46bbf196-1e79-4699-aa0a-beafe06ebb78 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:38.344962 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46bbf196-1e79-4699-aa0a-beafe06ebb78 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:38.345525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46bbf196-1e79-4699-aa0a-beafe06ebb78 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:38.415601 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-46bbf196-1e79-4699-aa0a-beafe06ebb78 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] 10.222.0.52 "DELETE /compute/v2.1/servers/48279c29-3878-4f58-b160-bb1acb07960d/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.088109 Sep 24 21:04:38.416387 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1998/4033] 10.222.0.52 () {58 vars in 1296 bytes} [Sat Sep 24 21:04:38 2022] DELETE /compute/v2.1/servers/48279c29-3878-4f58-b160-bb1acb07960d/os-server-password => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:04:38.425795 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b29bc28c-4785-405c-ae2b-cc957cc96820 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:38.426332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b29bc28c-4785-405c-ae2b-cc957cc96820 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: acc02ed3-5cf0-4fe4-b4d7-ac40fe691355] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:38.430904 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-538adc9f-920d-4c01-a25a-42640623ecf3 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:38.433745 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b29bc28c-4785-405c-ae2b-cc957cc96820 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:38.434235 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b29bc28c-4785-405c-ae2b-cc957cc96820 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:38.434728 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b29bc28c-4785-405c-ae2b-cc957cc96820 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:38.435432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b29bc28c-4785-405c-ae2b-cc957cc96820 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:38.435895 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b29bc28c-4785-405c-ae2b-cc957cc96820 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:38.436317 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b29bc28c-4785-405c-ae2b-cc957cc96820 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:38.439790 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-538adc9f-920d-4c01-a25a-42640623ecf3 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7" status: 200 len: 1519 microversion: 2.1 time: 0.161900 Sep 24 21:04:38.440577 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2036/4034] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:38 2022] GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:38.445574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a9c76bfe-e57c-421e-b346-c8252c71d934 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:38.446390 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a9c76bfe-e57c-421e-b346-c8252c71d934 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ca4c8bfe-e06d-427f-85fb-1d2729572b07] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:38.452419 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a9c76bfe-e57c-421e-b346-c8252c71d934 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:38.452910 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a9c76bfe-e57c-421e-b346-c8252c71d934 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:38.453350 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a9c76bfe-e57c-421e-b346-c8252c71d934 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:38.454061 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a9c76bfe-e57c-421e-b346-c8252c71d934 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:38.454531 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a9c76bfe-e57c-421e-b346-c8252c71d934 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:38.454964 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a9c76bfe-e57c-421e-b346-c8252c71d934 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:38.525406 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b29bc28c-4785-405c-ae2b-cc957cc96820 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "POST /compute/v2.1/servers/acc02ed3-5cf0-4fe4-b4d7-ac40fe691355/action" status: 202 len: 0 microversion: 2.1 time: 0.105732 Sep 24 21:04:38.530987 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 1999/4035] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:04:38 2022] POST /compute/v2.1/servers/acc02ed3-5cf0-4fe4-b4d7-ac40fe691355/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:04:38.534670 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7dd2eb4e-bb75-4341-a315-941cb673a3ef tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:38.535331 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7dd2eb4e-bb75-4341-a315-941cb673a3ef tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] [instance: 48279c29-3878-4f58-b160-bb1acb07960d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:38.543896 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7dd2eb4e-bb75-4341-a315-941cb673a3ef tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:38.544415 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7dd2eb4e-bb75-4341-a315-941cb673a3ef tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:38.544866 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7dd2eb4e-bb75-4341-a315-941cb673a3ef tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:38.545595 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7dd2eb4e-bb75-4341-a315-941cb673a3ef tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:38.546044 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7dd2eb4e-bb75-4341-a315-941cb673a3ef tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:38.546474 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7dd2eb4e-bb75-4341-a315-941cb673a3ef tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:38.574105 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7dd2eb4e-bb75-4341-a315-941cb673a3ef tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] 10.222.0.52 "GET /compute/v2.1/servers/48279c29-3878-4f58-b160-bb1acb07960d/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.044820 Sep 24 21:04:38.574716 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2000/4036] 10.222.0.52 () {58 vars in 1293 bytes} [Sat Sep 24 21:04:38 2022] GET /compute/v2.1/servers/48279c29-3878-4f58-b160-bb1acb07960d/os-server-password => generated 16 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 21:04:38.582711 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-97601ad3-4f5c-429e-84d5-1578d7b1adb1 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:38.583347 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-97601ad3-4f5c-429e-84d5-1578d7b1adb1 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: acc02ed3-5cf0-4fe4-b4d7-ac40fe691355] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:38.589793 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97601ad3-4f5c-429e-84d5-1578d7b1adb1 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:38.590286 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97601ad3-4f5c-429e-84d5-1578d7b1adb1 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:38.590763 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97601ad3-4f5c-429e-84d5-1578d7b1adb1 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:38.591472 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97601ad3-4f5c-429e-84d5-1578d7b1adb1 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:38.591935 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97601ad3-4f5c-429e-84d5-1578d7b1adb1 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:38.592367 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97601ad3-4f5c-429e-84d5-1578d7b1adb1 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:38.681234 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a9c76bfe-e57c-421e-b346-c8252c71d934 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:38.688987 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a9c76bfe-e57c-421e-b346-c8252c71d934 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07" status: 200 len: 1308 microversion: 2.1 time: 0.247074 Sep 24 21:04:38.689568 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2037/4037] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:38 2022] GET /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07 => generated 1308 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:38.694236 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-da2a5cbd-f104-4f8d-b070-748df99017ae tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:38.694765 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-da2a5cbd-f104-4f8d-b070-748df99017ae tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] [instance: 48279c29-3878-4f58-b160-bb1acb07960d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:38.700868 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-da2a5cbd-f104-4f8d-b070-748df99017ae tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:38.701355 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-da2a5cbd-f104-4f8d-b070-748df99017ae tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:38.701987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-da2a5cbd-f104-4f8d-b070-748df99017ae tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:38.702902 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-da2a5cbd-f104-4f8d-b070-748df99017ae tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:38.703538 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-da2a5cbd-f104-4f8d-b070-748df99017ae tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:38.704131 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-da2a5cbd-f104-4f8d-b070-748df99017ae tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:38.733094 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-da2a5cbd-f104-4f8d-b070-748df99017ae tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] [instance: 48279c29-3878-4f58-b160-bb1acb07960d] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:04:38.815213 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-da2a5cbd-f104-4f8d-b070-748df99017ae tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] 10.222.0.52 "DELETE /compute/v2.1/servers/48279c29-3878-4f58-b160-bb1acb07960d" status: 204 len: 0 microversion: 2.1 time: 0.123732 Sep 24 21:04:38.818670 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2038/4038] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:04:38 2022] DELETE /compute/v2.1/servers/48279c29-3878-4f58-b160-bb1acb07960d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:04:38.825297 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-97601ad3-4f5c-429e-84d5-1578d7b1adb1 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:38.830310 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-037fe80a-d737-4ce8-a100-961711485c5c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:38.831356 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-037fe80a-d737-4ce8-a100-961711485c5c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] [instance: 48279c29-3878-4f58-b160-bb1acb07960d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:38.835439 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-97601ad3-4f5c-429e-84d5-1578d7b1adb1 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/acc02ed3-5cf0-4fe4-b4d7-ac40fe691355" status: 200 len: 1520 microversion: 2.1 time: 0.259481 Sep 24 21:04:38.835932 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2001/4039] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:38 2022] GET /compute/v2.1/servers/acc02ed3-5cf0-4fe4-b4d7-ac40fe691355 => generated 1520 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:38.850778 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-037fe80a-d737-4ce8-a100-961711485c5c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:38.850778 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-037fe80a-d737-4ce8-a100-961711485c5c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:38.850778 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-037fe80a-d737-4ce8-a100-961711485c5c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:38.850778 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-037fe80a-d737-4ce8-a100-961711485c5c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:38.850778 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-037fe80a-d737-4ce8-a100-961711485c5c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:38.850778 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-037fe80a-d737-4ce8-a100-961711485c5c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:38.873274 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:04:39.058190 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-91cc3be9-5ed2-467e-ae99-bcbf3f444dea tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:39.059514 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-91cc3be9-5ed2-467e-ae99-bcbf3f444dea tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:39.067177 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-91cc3be9-5ed2-467e-ae99-bcbf3f444dea tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:39.067604 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-91cc3be9-5ed2-467e-ae99-bcbf3f444dea tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:39.068045 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-91cc3be9-5ed2-467e-ae99-bcbf3f444dea tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:39.069052 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-91cc3be9-5ed2-467e-ae99-bcbf3f444dea tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:39.069508 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-91cc3be9-5ed2-467e-ae99-bcbf3f444dea tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:39.070212 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-91cc3be9-5ed2-467e-ae99-bcbf3f444dea tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:39.079466 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-037fe80a-d737-4ce8-a100-961711485c5c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec06fda18be425bbb3fb60ddcdcb006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c334364e60349c38fae5ca1915a93ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:39.090282 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-037fe80a-d737-4ce8-a100-961711485c5c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] 10.222.0.52 "GET /compute/v2.1/servers/48279c29-3878-4f58-b160-bb1acb07960d" status: 200 len: 1510 microversion: 2.1 time: 0.268417 Sep 24 21:04:39.102513 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2039/4040] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:38 2022] GET /compute/v2.1/servers/48279c29-3878-4f58-b160-bb1acb07960d => generated 1510 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:39.297740 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-91cc3be9-5ed2-467e-ae99-bcbf3f444dea tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:39.305885 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-91cc3be9-5ed2-467e-ae99-bcbf3f444dea tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1519 microversion: 2.1 time: 0.252997 Sep 24 21:04:39.307155 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2002/4041] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:39 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1519 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:39.465761 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-845dfd4a-d020-4598-9e1f-f8c3ebbb1d2e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:39.466384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-845dfd4a-d020-4598-9e1f-f8c3ebbb1d2e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 06ef44f5-3eae-4780-b544-62102fd945a7] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:39.472604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-845dfd4a-d020-4598-9e1f-f8c3ebbb1d2e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:39.473095 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-845dfd4a-d020-4598-9e1f-f8c3ebbb1d2e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:39.473536 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-845dfd4a-d020-4598-9e1f-f8c3ebbb1d2e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:39.474237 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-845dfd4a-d020-4598-9e1f-f8c3ebbb1d2e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:39.474728 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-845dfd4a-d020-4598-9e1f-f8c3ebbb1d2e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:39.475172 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-845dfd4a-d020-4598-9e1f-f8c3ebbb1d2e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:39.712953 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e3018642-ba44-432a-aea2-2fab46c1dea3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:39.713580 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e3018642-ba44-432a-aea2-2fab46c1dea3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ca4c8bfe-e06d-427f-85fb-1d2729572b07] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:39.719897 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3018642-ba44-432a-aea2-2fab46c1dea3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:39.720335 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3018642-ba44-432a-aea2-2fab46c1dea3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:39.720783 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3018642-ba44-432a-aea2-2fab46c1dea3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:39.721508 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3018642-ba44-432a-aea2-2fab46c1dea3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:39.721974 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3018642-ba44-432a-aea2-2fab46c1dea3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:39.722412 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3018642-ba44-432a-aea2-2fab46c1dea3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:39.917815 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-845dfd4a-d020-4598-9e1f-f8c3ebbb1d2e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:39.927310 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-845dfd4a-d020-4598-9e1f-f8c3ebbb1d2e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7" status: 200 len: 1519 microversion: 2.1 time: 0.465471 Sep 24 21:04:39.928014 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2040/4042] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:39 2022] GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7 => generated 1519 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:39.929109 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e3018642-ba44-432a-aea2-2fab46c1dea3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:39.933749 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a06aab04-d7b7-4b39-b88b-edc65d2f4dfa tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:39.934476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a06aab04-d7b7-4b39-b88b-edc65d2f4dfa tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: acc02ed3-5cf0-4fe4-b4d7-ac40fe691355] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:39.939389 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e3018642-ba44-432a-aea2-2fab46c1dea3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07" status: 200 len: 1308 microversion: 2.1 time: 0.230680 Sep 24 21:04:39.940095 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2003/4043] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:39 2022] GET /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07 => generated 1308 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:04:39.950936 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a06aab04-d7b7-4b39-b88b-edc65d2f4dfa tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:39.952933 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a06aab04-d7b7-4b39-b88b-edc65d2f4dfa tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:39.953461 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a06aab04-d7b7-4b39-b88b-edc65d2f4dfa tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:39.954262 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a06aab04-d7b7-4b39-b88b-edc65d2f4dfa tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:39.954841 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a06aab04-d7b7-4b39-b88b-edc65d2f4dfa tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:39.955350 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a06aab04-d7b7-4b39-b88b-edc65d2f4dfa tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:40.102769 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a06aab04-d7b7-4b39-b88b-edc65d2f4dfa tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:40.113318 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a06aab04-d7b7-4b39-b88b-edc65d2f4dfa tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/acc02ed3-5cf0-4fe4-b4d7-ac40fe691355" status: 200 len: 1520 microversion: 2.1 time: 0.184184 Sep 24 21:04:40.114444 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2041/4044] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:39 2022] GET /compute/v2.1/servers/acc02ed3-5cf0-4fe4-b4d7-ac40fe691355 => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:40.116718 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-37dd60a9-5a4f-499f-b5df-1c7509203f8c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:40.117937 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-37dd60a9-5a4f-499f-b5df-1c7509203f8c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] [instance: 48279c29-3878-4f58-b160-bb1acb07960d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:40.126270 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-37dd60a9-5a4f-499f-b5df-1c7509203f8c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:40.126798 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-37dd60a9-5a4f-499f-b5df-1c7509203f8c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:40.127243 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-37dd60a9-5a4f-499f-b5df-1c7509203f8c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:40.127956 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-37dd60a9-5a4f-499f-b5df-1c7509203f8c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:40.128445 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-37dd60a9-5a4f-499f-b5df-1c7509203f8c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:40.128877 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-37dd60a9-5a4f-499f-b5df-1c7509203f8c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:40.293674 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-37dd60a9-5a4f-499f-b5df-1c7509203f8c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec06fda18be425bbb3fb60ddcdcb006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c334364e60349c38fae5ca1915a93ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:40.302604 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-37dd60a9-5a4f-499f-b5df-1c7509203f8c tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] 10.222.0.52 "GET /compute/v2.1/servers/48279c29-3878-4f58-b160-bb1acb07960d" status: 200 len: 1510 microversion: 2.1 time: 0.190382 Sep 24 21:04:40.303180 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2004/4045] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:40 2022] GET /compute/v2.1/servers/48279c29-3878-4f58-b160-bb1acb07960d => generated 1510 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:04:40.329504 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b3598836-d75a-4ab6-86a1-16ce50b7dbce tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:40.330167 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b3598836-d75a-4ab6-86a1-16ce50b7dbce tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:40.337139 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b3598836-d75a-4ab6-86a1-16ce50b7dbce tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:40.337626 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b3598836-d75a-4ab6-86a1-16ce50b7dbce tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:40.338061 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b3598836-d75a-4ab6-86a1-16ce50b7dbce tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:40.338806 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b3598836-d75a-4ab6-86a1-16ce50b7dbce tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:40.339243 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b3598836-d75a-4ab6-86a1-16ce50b7dbce tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:40.339669 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b3598836-d75a-4ab6-86a1-16ce50b7dbce tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:40.499264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b3598836-d75a-4ab6-86a1-16ce50b7dbce tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:40.511578 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b3598836-d75a-4ab6-86a1-16ce50b7dbce tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1519 microversion: 2.1 time: 0.186048 Sep 24 21:04:40.512177 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2042/4046] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:40 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1519 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:04:40.937551 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-865392c9-1e7e-40bb-a00b-8f63c34d6874 req-e6d8cd33-170a-42e6-913e-8b22f5cd4511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48279c29-3878-4f58-b160-bb1acb07960d", "name": "network-vif-deleted", "tag": "dd065a4d-1cc7-44b8-986a-6bf2049db577"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:40.951854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-865392c9-1e7e-40bb-a00b-8f63c34d6874 req-e6d8cd33-170a-42e6-913e-8b22f5cd4511 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:40.952125 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-117a1973-d9a5-425b-9631-95e3c5f52db4 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:40.952827 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-117a1973-d9a5-425b-9631-95e3c5f52db4 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 06ef44f5-3eae-4780-b544-62102fd945a7] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:40.953386 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-865392c9-1e7e-40bb-a00b-8f63c34d6874 req-e6d8cd33-170a-42e6-913e-8b22f5cd4511 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:40.953982 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-865392c9-1e7e-40bb-a00b-8f63c34d6874 req-e6d8cd33-170a-42e6-913e-8b22f5cd4511 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:40.971100 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-117a1973-d9a5-425b-9631-95e3c5f52db4 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:40.971701 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-117a1973-d9a5-425b-9631-95e3c5f52db4 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:40.971833 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-865392c9-1e7e-40bb-a00b-8f63c34d6874 req-e6d8cd33-170a-42e6-913e-8b22f5cd4511 service nova] Creating event network-vif-deleted:dd065a4d-1cc7-44b8-986a-6bf2049db577 for instance 48279c29-3878-4f58-b160-bb1acb07960d on nch2-master-1 Sep 24 21:04:40.972299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-117a1973-d9a5-425b-9631-95e3c5f52db4 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:40.973090 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-117a1973-d9a5-425b-9631-95e3c5f52db4 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:40.973636 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-117a1973-d9a5-425b-9631-95e3c5f52db4 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:40.974269 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-117a1973-d9a5-425b-9631-95e3c5f52db4 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:40.978683 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-865392c9-1e7e-40bb-a00b-8f63c34d6874 req-e6d8cd33-170a-42e6-913e-8b22f5cd4511 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045799 Sep 24 21:04:40.979602 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2005/4047] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:04:40.985413 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-55e3a4e5-fa29-4fe9-8a2e-082e9bbad29f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:40.986118 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-55e3a4e5-fa29-4fe9-8a2e-082e9bbad29f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ca4c8bfe-e06d-427f-85fb-1d2729572b07] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:40.992894 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-55e3a4e5-fa29-4fe9-8a2e-082e9bbad29f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:40.993382 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-55e3a4e5-fa29-4fe9-8a2e-082e9bbad29f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:40.993817 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-55e3a4e5-fa29-4fe9-8a2e-082e9bbad29f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:40.994545 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-55e3a4e5-fa29-4fe9-8a2e-082e9bbad29f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:40.995004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-55e3a4e5-fa29-4fe9-8a2e-082e9bbad29f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:40.995425 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-55e3a4e5-fa29-4fe9-8a2e-082e9bbad29f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:41.014449 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:04:41.178401 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-117a1973-d9a5-425b-9631-95e3c5f52db4 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:41.187932 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-117a1973-d9a5-425b-9631-95e3c5f52db4 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7" status: 200 len: 1519 microversion: 2.1 time: 0.240086 Sep 24 21:04:41.197416 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2043/4048] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:40 2022] GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7 => generated 1519 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:41.205527 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-28cb5467-7188-44c4-b8ec-77c8511d7d48 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:41.206195 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-28cb5467-7188-44c4-b8ec-77c8511d7d48 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: acc02ed3-5cf0-4fe4-b4d7-ac40fe691355] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:41.214645 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28cb5467-7188-44c4-b8ec-77c8511d7d48 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:41.215148 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28cb5467-7188-44c4-b8ec-77c8511d7d48 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:41.215783 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28cb5467-7188-44c4-b8ec-77c8511d7d48 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:41.216504 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28cb5467-7188-44c4-b8ec-77c8511d7d48 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:41.217540 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28cb5467-7188-44c4-b8ec-77c8511d7d48 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:41.218055 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28cb5467-7188-44c4-b8ec-77c8511d7d48 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:41.245169 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-55e3a4e5-fa29-4fe9-8a2e-082e9bbad29f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:41.255591 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-55e3a4e5-fa29-4fe9-8a2e-082e9bbad29f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07" status: 200 len: 1308 microversion: 2.1 time: 0.274444 Sep 24 21:04:41.256687 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2006/4049] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:40 2022] GET /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07 => generated 1308 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:41.328459 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1d7e7613-2415-4693-a930-4fc0a6320191 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:41.329480 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1d7e7613-2415-4693-a930-4fc0a6320191 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] [instance: 48279c29-3878-4f58-b160-bb1acb07960d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:41.339251 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1d7e7613-2415-4693-a930-4fc0a6320191 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:41.340108 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1d7e7613-2415-4693-a930-4fc0a6320191 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:41.340665 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1d7e7613-2415-4693-a930-4fc0a6320191 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:41.341712 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1d7e7613-2415-4693-a930-4fc0a6320191 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:41.342678 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1d7e7613-2415-4693-a930-4fc0a6320191 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:41.346920 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1d7e7613-2415-4693-a930-4fc0a6320191 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:41.381095 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-28cb5467-7188-44c4-b8ec-77c8511d7d48 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:41.386823 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1d7e7613-2415-4693-a930-4fc0a6320191 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:41.387711 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1d7e7613-2415-4693-a930-4fc0a6320191 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:41.388356 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1d7e7613-2415-4693-a930-4fc0a6320191 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:41.388829 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-1d7e7613-2415-4693-a930-4fc0a6320191 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lazy-loading 'fault' on Instance uuid 48279c29-3878-4f58-b160-bb1acb07960d {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:04:41.399020 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-28cb5467-7188-44c4-b8ec-77c8511d7d48 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/acc02ed3-5cf0-4fe4-b4d7-ac40fe691355" status: 200 len: 1500 microversion: 2.1 time: 0.199807 Sep 24 21:04:41.399881 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2044/4050] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:41 2022] GET /compute/v2.1/servers/acc02ed3-5cf0-4fe4-b4d7-ac40fe691355 => generated 1500 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:41.436655 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-39287aae-2bed-4474-8cf4-b47beb568378 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:41.447129 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-39287aae-2bed-4474-8cf4-b47beb568378 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: acc02ed3-5cf0-4fe4-b4d7-ac40fe691355] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:41.448964 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1d7e7613-2415-4693-a930-4fc0a6320191 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec06fda18be425bbb3fb60ddcdcb006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c334364e60349c38fae5ca1915a93ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:41.460915 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1d7e7613-2415-4693-a930-4fc0a6320191 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] 10.222.0.52 "GET /compute/v2.1/servers/48279c29-3878-4f58-b160-bb1acb07960d" status: 200 len: 1306 microversion: 2.1 time: 0.137074 Sep 24 21:04:41.461652 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-39287aae-2bed-4474-8cf4-b47beb568378 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:41.462399 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-39287aae-2bed-4474-8cf4-b47beb568378 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:41.462592 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2007/4051] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:41 2022] GET /compute/v2.1/servers/48279c29-3878-4f58-b160-bb1acb07960d => generated 1306 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:04:41.463209 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-39287aae-2bed-4474-8cf4-b47beb568378 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:41.464295 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-39287aae-2bed-4474-8cf4-b47beb568378 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:41.464948 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-39287aae-2bed-4474-8cf4-b47beb568378 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:41.465569 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-39287aae-2bed-4474-8cf4-b47beb568378 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:41.494423 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-39287aae-2bed-4474-8cf4-b47beb568378 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lazy-loading 'flavor' on Instance uuid acc02ed3-5cf0-4fe4-b4d7-ac40fe691355 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:04:41.506297 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-39287aae-2bed-4474-8cf4-b47beb568378 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] HTTP exception thrown: Cannot 'rescue' instance acc02ed3-5cf0-4fe4-b4d7-ac40fe691355 while it is in vm_state paused Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-39287aae-2bed-4474-8cf4-b47beb568378 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Request method failure captured: Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/servers/acc02ed3-5cf0-4fe4-b4d7-ac40fe691355/action HTTP/1.1 Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 14 Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3CejOkEbEqme5Iu5NaNNYGxm_xyFOFmUSNFDPLyLevAaMpOaK2kD9jvX8gKBoGWjrZ4l9265-kGjEZEOFmEJCxuMoMRcw7FLPLvLOa4eFdrLfTFgk4mHHNpy9ceB5UPclIag2JcoR5KXK9iG6pPICQS8M2TNnyIAxR5hdIsUaQK52Y Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 3a9bed43edcf4c5594ffde33282bc48c Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1027624478 Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3a9bed43edcf4c5594ffde33282bc48c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3a9bed43edcf4c5594ffde33282bc48c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3a9bed43edcf4c5594ffde33282bc48c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3a9bed43edcf4c5594ffde33282bc48c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1027624478 Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 3a9bed43edcf4c5594ffde33282bc48c Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1027624478 Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServerRescueNegativeTestJSON-1027624478-project Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 5cb9430023d842b4a5d930e01f7340f3 Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1027624478-project Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: {"rescue": {}} Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: exception: Cannot 'rescue' instance acc02ed3-5cf0-4fe4-b4d7-ac40fe691355 while it is in vm_state paused Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'acc02ed3-5cf0-4fe4-b4d7-ac40fe691355', 'body': {'rescue': {}}} Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance acc02ed3-5cf0-4fe4-b4d7-ac40fe691355 in vm_state paused. Cannot rescue while the instance is in this state. Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance acc02ed3-5cf0-4fe4-b4d7-ac40fe691355 while it is in vm_state paused Sep 24 21:04:41.509139 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:04:41.514012 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:04:41.514012 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:04:41.514012 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:41.514012 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:04:41.514012 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:04:41.514012 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:04:41.514012 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:04:41.514012 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance acc02ed3-5cf0-4fe4-b4d7-ac40fe691355 while it is in vm_state paused Sep 24 21:04:41.514012 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:04:41.514012 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-39287aae-2bed-4474-8cf4-b47beb568378 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Returning 409 to user: Cannot 'rescue' instance acc02ed3-5cf0-4fe4-b4d7-ac40fe691355 while it is in vm_state paused {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:04:41.514012 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-39287aae-2bed-4474-8cf4-b47beb568378 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "POST /compute/v2.1/servers/acc02ed3-5cf0-4fe4-b4d7-ac40fe691355/action" status: 409 len: 144 microversion: 2.1 time: 0.091973 Sep 24 21:04:41.514012 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2045/4052] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:04:41 2022] POST /compute/v2.1/servers/acc02ed3-5cf0-4fe4-b4d7-ac40fe691355/action => generated 144 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 24 21:04:41.519424 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-abfe6511-b884-47a3-a9d8-06b33810d8ac tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:41.519968 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-abfe6511-b884-47a3-a9d8-06b33810d8ac tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: acc02ed3-5cf0-4fe4-b4d7-ac40fe691355] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:41.526485 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-abfe6511-b884-47a3-a9d8-06b33810d8ac tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:41.527005 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-abfe6511-b884-47a3-a9d8-06b33810d8ac tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:41.527443 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-abfe6511-b884-47a3-a9d8-06b33810d8ac tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:41.528137 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-abfe6511-b884-47a3-a9d8-06b33810d8ac tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:41.528758 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-abfe6511-b884-47a3-a9d8-06b33810d8ac tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:41.529186 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-abfe6511-b884-47a3-a9d8-06b33810d8ac tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:41.539401 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2435de74-0864-438a-bd0d-5cde73b0e991 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:41.540017 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2435de74-0864-438a-bd0d-5cde73b0e991 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:41.546398 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2435de74-0864-438a-bd0d-5cde73b0e991 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:41.546938 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2435de74-0864-438a-bd0d-5cde73b0e991 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:41.547357 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2435de74-0864-438a-bd0d-5cde73b0e991 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:41.548064 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2435de74-0864-438a-bd0d-5cde73b0e991 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:41.548607 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2435de74-0864-438a-bd0d-5cde73b0e991 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:41.549475 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2435de74-0864-438a-bd0d-5cde73b0e991 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:41.614482 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-abfe6511-b884-47a3-a9d8-06b33810d8ac tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "POST /compute/v2.1/servers/acc02ed3-5cf0-4fe4-b4d7-ac40fe691355/action" status: 202 len: 0 microversion: 2.1 time: 0.098568 Sep 24 21:04:41.618966 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2008/4053] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:04:41 2022] POST /compute/v2.1/servers/acc02ed3-5cf0-4fe4-b4d7-ac40fe691355/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 21:04:41.628405 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9a3cfeed-6267-4559-a8a2-e2b6ea281ea6 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:41.629303 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9a3cfeed-6267-4559-a8a2-e2b6ea281ea6 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: acc02ed3-5cf0-4fe4-b4d7-ac40fe691355] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:41.640030 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a3cfeed-6267-4559-a8a2-e2b6ea281ea6 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:41.640566 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a3cfeed-6267-4559-a8a2-e2b6ea281ea6 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:41.641010 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a3cfeed-6267-4559-a8a2-e2b6ea281ea6 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:41.641733 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a3cfeed-6267-4559-a8a2-e2b6ea281ea6 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:41.642274 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a3cfeed-6267-4559-a8a2-e2b6ea281ea6 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:41.642738 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a3cfeed-6267-4559-a8a2-e2b6ea281ea6 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:41.731268 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2435de74-0864-438a-bd0d-5cde73b0e991 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:41.740221 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2435de74-0864-438a-bd0d-5cde73b0e991 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1519 microversion: 2.1 time: 0.204862 Sep 24 21:04:41.742267 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2046/4054] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:41 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1519 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:41.796910 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9a3cfeed-6267-4559-a8a2-e2b6ea281ea6 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:41.806315 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9a3cfeed-6267-4559-a8a2-e2b6ea281ea6 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/acc02ed3-5cf0-4fe4-b4d7-ac40fe691355" status: 200 len: 1507 microversion: 2.1 time: 0.183410 Sep 24 21:04:41.807149 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2009/4055] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:41 2022] GET /compute/v2.1/servers/acc02ed3-5cf0-4fe4-b4d7-ac40fe691355 => generated 1507 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:42.213251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5bcf439b-9ab5-40a9-a451-e7d7cf5ff703 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:42.213847 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5bcf439b-9ab5-40a9-a451-e7d7cf5ff703 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 06ef44f5-3eae-4780-b544-62102fd945a7] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:42.220673 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5bcf439b-9ab5-40a9-a451-e7d7cf5ff703 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:42.221155 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5bcf439b-9ab5-40a9-a451-e7d7cf5ff703 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:42.221588 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5bcf439b-9ab5-40a9-a451-e7d7cf5ff703 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:42.222285 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5bcf439b-9ab5-40a9-a451-e7d7cf5ff703 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:42.222757 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5bcf439b-9ab5-40a9-a451-e7d7cf5ff703 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:42.223181 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5bcf439b-9ab5-40a9-a451-e7d7cf5ff703 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:42.280401 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e698acfb-5b3c-406a-ad23-3523a925135d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:42.281000 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e698acfb-5b3c-406a-ad23-3523a925135d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ca4c8bfe-e06d-427f-85fb-1d2729572b07] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:42.288296 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e698acfb-5b3c-406a-ad23-3523a925135d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:42.289364 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e698acfb-5b3c-406a-ad23-3523a925135d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:42.289805 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e698acfb-5b3c-406a-ad23-3523a925135d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:42.290736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e698acfb-5b3c-406a-ad23-3523a925135d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:42.291200 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e698acfb-5b3c-406a-ad23-3523a925135d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:42.291629 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e698acfb-5b3c-406a-ad23-3523a925135d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:42.401705 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5bcf439b-9ab5-40a9-a451-e7d7cf5ff703 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:42.409834 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5bcf439b-9ab5-40a9-a451-e7d7cf5ff703 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7" status: 200 len: 1496 microversion: 2.1 time: 0.201344 Sep 24 21:04:42.410414 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2047/4056] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:42 2022] GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7 => generated 1496 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:42.433215 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c66a6e5f-8242-4870-a930-05881fa9fdad tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:42.438086 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c66a6e5f-8242-4870-a930-05881fa9fdad tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:42.438933 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c66a6e5f-8242-4870-a930-05881fa9fdad tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e'} {{(pid=140516) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 21:04:42.444303 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c66a6e5f-8242-4870-a930-05881fa9fdad tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:42.444781 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c66a6e5f-8242-4870-a930-05881fa9fdad tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:42.445400 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c66a6e5f-8242-4870-a930-05881fa9fdad tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:42.446371 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c66a6e5f-8242-4870-a930-05881fa9fdad tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:42.446853 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c66a6e5f-8242-4870-a930-05881fa9fdad tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:42.447276 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c66a6e5f-8242-4870-a930-05881fa9fdad tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:42.448949 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e698acfb-5b3c-406a-ad23-3523a925135d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:42.459372 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e698acfb-5b3c-406a-ad23-3523a925135d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07" status: 200 len: 1308 microversion: 2.1 time: 0.182811 Sep 24 21:04:42.459955 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2010/4057] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:42 2022] GET /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07 => generated 1308 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:42.473097 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.multi_cell_list [None req-c66a6e5f-8242-4870-a930-05881fa9fdad tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 21:04:42.483951 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9005a3dc-8198-4cd9-99f3-a900e4e4a954 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:42.484570 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9005a3dc-8198-4cd9-99f3-a900e4e4a954 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] [instance: 48279c29-3878-4f58-b160-bb1acb07960d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:42.490629 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9005a3dc-8198-4cd9-99f3-a900e4e4a954 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:42.491130 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9005a3dc-8198-4cd9-99f3-a900e4e4a954 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:42.491576 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9005a3dc-8198-4cd9-99f3-a900e4e4a954 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:42.492360 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9005a3dc-8198-4cd9-99f3-a900e4e4a954 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:42.493346 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9005a3dc-8198-4cd9-99f3-a900e4e4a954 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:42.493563 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9005a3dc-8198-4cd9-99f3-a900e4e4a954 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:42.504264 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c66a6e5f-8242-4870-a930-05881fa9fdad tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.075092 Sep 24 21:04:42.505073 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2048/4058] 10.222.0.52 () {58 vars in 1154 bytes} [Sat Sep 24 21:04:42 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-9005a3dc-8198-4cd9-99f3-a900e4e4a954 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] HTTP exception thrown: Instance 48279c29-3878-4f58-b160-bb1acb07960d could not be found. Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9005a3dc-8198-4cd9-99f3-a900e4e4a954 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Request method failure captured: Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/48279c29-3878-4f58-b160-bb1acb07960d HTTP/1.1 Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3DX2WB0rsVm58L68zjyFaaDDNryUfAdNSd7R8sUDvS1bC-y3B3GPkVhrrMXkea0otUqTdkHj8JrQuqy7kNl6rV6RzNQpdyyab8z-DZYWSacPmXXjmiMd74IAVOHbA2V3-6EGLiZlGUPAEPloL3-JUsZJNzWFfg-NPH1hFAiKVvXPuk Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 9c334364e60349c38fae5ca1915a93ef Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServerPasswordTestJSON-328603142 Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9c334364e60349c38fae5ca1915a93ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9c334364e60349c38fae5ca1915a93ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9c334364e60349c38fae5ca1915a93ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9c334364e60349c38fae5ca1915a93ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServerPasswordTestJSON-328603142 Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 9c334364e60349c38fae5ca1915a93ef Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServerPasswordTestJSON-328603142 Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServerPasswordTestJSON-328603142-project Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: aec06fda18be425bbb3fb60ddcdcb006 Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServerPasswordTestJSON-328603142-project Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 48279c29-3878-4f58-b160-bb1acb07960d could not be found. Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '48279c29-3878-4f58-b160-bb1acb07960d'} Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48279c29-3878-4f58-b160-bb1acb07960d could not be found. Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:04:42.512795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:04:42.517202 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48279c29-3878-4f58-b160-bb1acb07960d could not be found. Sep 24 21:04:42.517202 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:42.517202 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:04:42.517202 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:42.517202 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:42.517202 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:04:42.517202 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:04:42.517202 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:04:42.517202 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:04:42.517202 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48279c29-3878-4f58-b160-bb1acb07960d could not be found. Sep 24 21:04:42.517202 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:42.517202 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9005a3dc-8198-4cd9-99f3-a900e4e4a954 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] Returning 404 to user: Instance 48279c29-3878-4f58-b160-bb1acb07960d could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:04:42.517202 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9005a3dc-8198-4cd9-99f3-a900e4e4a954 tempest-ServerPasswordTestJSON-328603142 tempest-ServerPasswordTestJSON-328603142-project] 10.222.0.52 "GET /compute/v2.1/servers/48279c29-3878-4f58-b160-bb1acb07960d" status: 404 len: 111 microversion: 2.1 time: 0.033740 Sep 24 21:04:42.517202 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2011/4059] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:42 2022] GET /compute/v2.1/servers/48279c29-3878-4f58-b160-bb1acb07960d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 21:04:42.518719 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-41650d0a-ca7e-476e-a9e2-1eb833446ba9 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:42.526059 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41650d0a-ca7e-476e-a9e2-1eb833446ba9 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:42.526610 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41650d0a-ca7e-476e-a9e2-1eb833446ba9 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:42.527049 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41650d0a-ca7e-476e-a9e2-1eb833446ba9 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:42.549804 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-41650d0a-ca7e-476e-a9e2-1eb833446ba9 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 06ef44f5-3eae-4780-b544-62102fd945a7] Going to try to start instance {{(pid=140516) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 24 21:04:42.593675 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-41650d0a-ca7e-476e-a9e2-1eb833446ba9 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "POST /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7/action" status: 202 len: 0 microversion: 2.1 time: 0.079445 Sep 24 21:04:42.594540 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2049/4060] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:04:42 2022] POST /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:04:42.604946 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b925be4e-a006-4b3e-8cff-7cf67bf2100a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:42.606025 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b925be4e-a006-4b3e-8cff-7cf67bf2100a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 06ef44f5-3eae-4780-b544-62102fd945a7] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:42.609041 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=12 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:04:42.611628 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=16 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:04:42.618611 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b925be4e-a006-4b3e-8cff-7cf67bf2100a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:42.619314 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b925be4e-a006-4b3e-8cff-7cf67bf2100a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:42.620028 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b925be4e-a006-4b3e-8cff-7cf67bf2100a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:42.621196 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b925be4e-a006-4b3e-8cff-7cf67bf2100a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:42.622087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b925be4e-a006-4b3e-8cff-7cf67bf2100a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:42.622758 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b925be4e-a006-4b3e-8cff-7cf67bf2100a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:42.766479 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=10 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:04:42.774743 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0ae4a752-e3e2-4868-9a51-55656d78149b tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:42.775922 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0ae4a752-e3e2-4868-9a51-55656d78149b tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:42.780992 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b925be4e-a006-4b3e-8cff-7cf67bf2100a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:42.785720 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0ae4a752-e3e2-4868-9a51-55656d78149b tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:42.786232 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0ae4a752-e3e2-4868-9a51-55656d78149b tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:42.786725 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0ae4a752-e3e2-4868-9a51-55656d78149b tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:42.787447 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0ae4a752-e3e2-4868-9a51-55656d78149b tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:42.787910 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0ae4a752-e3e2-4868-9a51-55656d78149b tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:42.788346 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0ae4a752-e3e2-4868-9a51-55656d78149b tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:42.791428 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b925be4e-a006-4b3e-8cff-7cf67bf2100a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7" status: 200 len: 1505 microversion: 2.1 time: 0.192178 Sep 24 21:04:42.792615 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2012/4061] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:42 2022] GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7 => generated 1505 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:04:42.841737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f10281df-46ab-4235-a241-4df7fa04eacb tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:42.841737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f10281df-46ab-4235-a241-4df7fa04eacb tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: acc02ed3-5cf0-4fe4-b4d7-ac40fe691355] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:42.841737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f10281df-46ab-4235-a241-4df7fa04eacb tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:42.841737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f10281df-46ab-4235-a241-4df7fa04eacb tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:42.841737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f10281df-46ab-4235-a241-4df7fa04eacb tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:42.842579 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f10281df-46ab-4235-a241-4df7fa04eacb tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:42.845347 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f10281df-46ab-4235-a241-4df7fa04eacb tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:42.845912 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f10281df-46ab-4235-a241-4df7fa04eacb tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:42.997885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0ae4a752-e3e2-4868-9a51-55656d78149b tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:43.006662 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0ae4a752-e3e2-4868-9a51-55656d78149b tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1519 microversion: 2.1 time: 0.240488 Sep 24 21:04:43.008573 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2050/4062] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:42 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1519 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:43.022789 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f10281df-46ab-4235-a241-4df7fa04eacb tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:43.031694 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f10281df-46ab-4235-a241-4df7fa04eacb tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/acc02ed3-5cf0-4fe4-b4d7-ac40fe691355" status: 200 len: 1515 microversion: 2.1 time: 0.206271 Sep 24 21:04:43.032749 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2013/4063] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:42 2022] GET /compute/v2.1/servers/acc02ed3-5cf0-4fe4-b4d7-ac40fe691355 => generated 1515 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:43.235964 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-ebc2e68c-0d46-4cab-ba15-8b9b097238d5 req-34751514-17a2-47ed-bd33-14b69739fcbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca4c8bfe-e06d-427f-85fb-1d2729572b07", "name": "network-vif-plugged", "status": "completed", "tag": "f1ef0e43-058d-4c31-b2c8-ae05ef2ff17a"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:43.254620 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-ebc2e68c-0d46-4cab-ba15-8b9b097238d5 req-34751514-17a2-47ed-bd33-14b69739fcbb service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:43.255376 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-ebc2e68c-0d46-4cab-ba15-8b9b097238d5 req-34751514-17a2-47ed-bd33-14b69739fcbb service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:43.256249 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-ebc2e68c-0d46-4cab-ba15-8b9b097238d5 req-34751514-17a2-47ed-bd33-14b69739fcbb service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:43.270479 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-ebc2e68c-0d46-4cab-ba15-8b9b097238d5 req-34751514-17a2-47ed-bd33-14b69739fcbb service nova] Creating event network-vif-plugged:f1ef0e43-058d-4c31-b2c8-ae05ef2ff17a for instance ca4c8bfe-e06d-427f-85fb-1d2729572b07 on nch2-master-1 Sep 24 21:04:43.276495 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-ebc2e68c-0d46-4cab-ba15-8b9b097238d5 req-34751514-17a2-47ed-bd33-14b69739fcbb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047958 Sep 24 21:04:43.277639 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2051/4064] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:04:43.485329 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d7ed464c-3c30-48bb-a962-c216d97d0d1b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:43.485954 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d7ed464c-3c30-48bb-a962-c216d97d0d1b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ca4c8bfe-e06d-427f-85fb-1d2729572b07] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:43.493030 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d7ed464c-3c30-48bb-a962-c216d97d0d1b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:43.493524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d7ed464c-3c30-48bb-a962-c216d97d0d1b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:43.493975 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d7ed464c-3c30-48bb-a962-c216d97d0d1b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:43.494715 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d7ed464c-3c30-48bb-a962-c216d97d0d1b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:43.495180 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d7ed464c-3c30-48bb-a962-c216d97d0d1b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:43.495614 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d7ed464c-3c30-48bb-a962-c216d97d0d1b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:43.648404 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d7ed464c-3c30-48bb-a962-c216d97d0d1b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:43.659093 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d7ed464c-3c30-48bb-a962-c216d97d0d1b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07" status: 200 len: 1308 microversion: 2.1 time: 0.177612 Sep 24 21:04:43.659980 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2014/4065] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:43 2022] GET /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07 => generated 1308 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:43.814533 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5bb4c6f2-6cd4-4e60-8e97-c2458d49e8bc tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:43.815278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5bb4c6f2-6cd4-4e60-8e97-c2458d49e8bc tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 06ef44f5-3eae-4780-b544-62102fd945a7] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:43.822473 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5bb4c6f2-6cd4-4e60-8e97-c2458d49e8bc tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:43.823314 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5bb4c6f2-6cd4-4e60-8e97-c2458d49e8bc tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:43.824014 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5bb4c6f2-6cd4-4e60-8e97-c2458d49e8bc tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:43.825192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5bb4c6f2-6cd4-4e60-8e97-c2458d49e8bc tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:43.825893 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5bb4c6f2-6cd4-4e60-8e97-c2458d49e8bc tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:43.826584 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5bb4c6f2-6cd4-4e60-8e97-c2458d49e8bc tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:43.999865 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5bb4c6f2-6cd4-4e60-8e97-c2458d49e8bc tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:44.008431 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5bb4c6f2-6cd4-4e60-8e97-c2458d49e8bc tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7" status: 200 len: 1505 microversion: 2.1 time: 0.198047 Sep 24 21:04:44.009250 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2052/4066] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:43 2022] GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7 => generated 1505 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:44.032369 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-27f605b0-97a0-4527-9d54-9edfcbd78179 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:44.033716 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-27f605b0-97a0-4527-9d54-9edfcbd78179 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:44.041004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27f605b0-97a0-4527-9d54-9edfcbd78179 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:44.041607 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27f605b0-97a0-4527-9d54-9edfcbd78179 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:44.042358 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27f605b0-97a0-4527-9d54-9edfcbd78179 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:44.043419 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27f605b0-97a0-4527-9d54-9edfcbd78179 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:44.044549 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27f605b0-97a0-4527-9d54-9edfcbd78179 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:44.045373 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27f605b0-97a0-4527-9d54-9edfcbd78179 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:44.289696 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-27f605b0-97a0-4527-9d54-9edfcbd78179 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:44.297958 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-27f605b0-97a0-4527-9d54-9edfcbd78179 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1519 microversion: 2.1 time: 0.269776 Sep 24 21:04:44.298653 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2015/4067] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:44 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1519 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:44.684435 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f5034c9d-41b3-489f-bec5-b007d3a2626e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:44.685389 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f5034c9d-41b3-489f-bec5-b007d3a2626e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ca4c8bfe-e06d-427f-85fb-1d2729572b07] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:44.700031 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f5034c9d-41b3-489f-bec5-b007d3a2626e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:44.701477 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f5034c9d-41b3-489f-bec5-b007d3a2626e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:44.704148 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f5034c9d-41b3-489f-bec5-b007d3a2626e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:44.704946 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f5034c9d-41b3-489f-bec5-b007d3a2626e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:44.705422 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f5034c9d-41b3-489f-bec5-b007d3a2626e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:44.705878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f5034c9d-41b3-489f-bec5-b007d3a2626e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:45.033440 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1be12b97-9d9a-4b31-908c-df914d118fd5 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:45.034700 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1be12b97-9d9a-4b31-908c-df914d118fd5 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 06ef44f5-3eae-4780-b544-62102fd945a7] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:45.043508 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1be12b97-9d9a-4b31-908c-df914d118fd5 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:45.044267 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1be12b97-9d9a-4b31-908c-df914d118fd5 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:45.044902 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1be12b97-9d9a-4b31-908c-df914d118fd5 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:45.045799 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1be12b97-9d9a-4b31-908c-df914d118fd5 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:45.046420 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1be12b97-9d9a-4b31-908c-df914d118fd5 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:45.047033 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1be12b97-9d9a-4b31-908c-df914d118fd5 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:45.271648 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f5034c9d-41b3-489f-bec5-b007d3a2626e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:45.280699 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f5034c9d-41b3-489f-bec5-b007d3a2626e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07" status: 200 len: 1308 microversion: 2.1 time: 0.601854 Sep 24 21:04:45.295076 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2053/4068] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:44 2022] GET /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07 => generated 1308 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:45.325500 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c05c8dd0-b5e8-44f6-95f7-7105dc02fd5e tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:45.326458 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c05c8dd0-b5e8-44f6-95f7-7105dc02fd5e tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:45.339682 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c05c8dd0-b5e8-44f6-95f7-7105dc02fd5e tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:45.340647 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c05c8dd0-b5e8-44f6-95f7-7105dc02fd5e tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:45.341455 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c05c8dd0-b5e8-44f6-95f7-7105dc02fd5e tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:45.342527 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c05c8dd0-b5e8-44f6-95f7-7105dc02fd5e tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:45.343190 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c05c8dd0-b5e8-44f6-95f7-7105dc02fd5e tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:45.343955 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c05c8dd0-b5e8-44f6-95f7-7105dc02fd5e tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:45.387669 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1be12b97-9d9a-4b31-908c-df914d118fd5 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:45.396864 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1be12b97-9d9a-4b31-908c-df914d118fd5 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7" status: 200 len: 1509 microversion: 2.1 time: 0.368097 Sep 24 21:04:45.397376 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2016/4069] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:45 2022] GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7 => generated 1509 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:45.423105 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-70f9f7fe-f8f8-405d-a089-2ba562fec5ab tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:45.428682 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-70f9f7fe-f8f8-405d-a089-2ba562fec5ab tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:45.430212 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.compute.servers [None req-70f9f7fe-f8f8-405d-a089-2ba562fec5ab tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Removing options 'limit' from query {{(pid=140517) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 24 21:04:45.431859 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-70f9f7fe-f8f8-405d-a089-2ba562fec5ab tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Searching by: {'deleted': False, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e'} {{(pid=140517) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 21:04:45.433258 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-70f9f7fe-f8f8-405d-a089-2ba562fec5ab tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:45.433814 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-70f9f7fe-f8f8-405d-a089-2ba562fec5ab tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:45.434322 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-70f9f7fe-f8f8-405d-a089-2ba562fec5ab tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:45.435187 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-70f9f7fe-f8f8-405d-a089-2ba562fec5ab tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:45.435882 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-70f9f7fe-f8f8-405d-a089-2ba562fec5ab tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:45.436725 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-70f9f7fe-f8f8-405d-a089-2ba562fec5ab tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:45.438413 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-70f9f7fe-f8f8-405d-a089-2ba562fec5ab tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.019082 Sep 24 21:04:45.440280 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2017/4070] 10.222.0.52 () {58 vars in 1140 bytes} [Sat Sep 24 21:04:45 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 21:04:45.453461 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-598ab98e-7c81-482a-a2d2-08697bfb0c64 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:45.455102 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-598ab98e-7c81-482a-a2d2-08697bfb0c64 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 06ef44f5-3eae-4780-b544-62102fd945a7] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:45.463911 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-598ab98e-7c81-482a-a2d2-08697bfb0c64 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:45.464800 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-598ab98e-7c81-482a-a2d2-08697bfb0c64 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:45.465482 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-598ab98e-7c81-482a-a2d2-08697bfb0c64 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:45.466552 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-598ab98e-7c81-482a-a2d2-08697bfb0c64 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:45.467364 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-598ab98e-7c81-482a-a2d2-08697bfb0c64 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:45.467999 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-598ab98e-7c81-482a-a2d2-08697bfb0c64 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:45.694352 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c05c8dd0-b5e8-44f6-95f7-7105dc02fd5e tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:45.704407 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c05c8dd0-b5e8-44f6-95f7-7105dc02fd5e tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1519 microversion: 2.1 time: 0.386574 Sep 24 21:04:45.705366 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2054/4071] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:45 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1519 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:04:45.750665 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-598ab98e-7c81-482a-a2d2-08697bfb0c64 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:45.759446 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-598ab98e-7c81-482a-a2d2-08697bfb0c64 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7" status: 200 len: 1509 microversion: 2.1 time: 0.309899 Sep 24 21:04:45.760255 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2018/4072] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:45 2022] GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7 => generated 1509 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:04:45.782261 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6fa189bc-d781-4c2c-aa77-efe74e16d707 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:45.782921 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6fa189bc-d781-4c2c-aa77-efe74e16d707 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 275263e1-8a0a-4f58-b863-b56c2bf3a7c0] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:45.788154 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:04:45.791409 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6fa189bc-d781-4c2c-aa77-efe74e16d707 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:45.791905 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6fa189bc-d781-4c2c-aa77-efe74e16d707 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:45.792347 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6fa189bc-d781-4c2c-aa77-efe74e16d707 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:45.793061 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6fa189bc-d781-4c2c-aa77-efe74e16d707 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:45.793522 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6fa189bc-d781-4c2c-aa77-efe74e16d707 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:45.793954 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6fa189bc-d781-4c2c-aa77-efe74e16d707 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:45.816938 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:04:46.083632 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-46c00ba9-665a-4c17-b58d-d81ae6110822 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:46.086877 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-46c00ba9-665a-4c17-b58d-d81ae6110822 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:46.097686 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46c00ba9-665a-4c17-b58d-d81ae6110822 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:46.098196 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46c00ba9-665a-4c17-b58d-d81ae6110822 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:46.098684 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46c00ba9-665a-4c17-b58d-d81ae6110822 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:46.099596 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46c00ba9-665a-4c17-b58d-d81ae6110822 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:46.100223 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46c00ba9-665a-4c17-b58d-d81ae6110822 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:46.100460 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6fa189bc-d781-4c2c-aa77-efe74e16d707 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:46.101113 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46c00ba9-665a-4c17-b58d-d81ae6110822 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:46.119731 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6fa189bc-d781-4c2c-aa77-efe74e16d707 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/275263e1-8a0a-4f58-b863-b56c2bf3a7c0" status: 200 len: 1509 microversion: 2.1 time: 0.340554 Sep 24 21:04:46.121275 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2055/4073] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:45 2022] GET /compute/v2.1/servers/275263e1-8a0a-4f58-b863-b56c2bf3a7c0 => generated 1509 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:46.147249 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-46c00ba9-665a-4c17-b58d-d81ae6110822 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] HTTP exception thrown: Cannot 'reboot' instance e765d57a-1bbe-4504-a194-d2c3d906577f while it is in vm_state rescued Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-46c00ba9-665a-4c17-b58d-d81ae6110822 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Request method failure captured: Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f/action HTTP/1.1 Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 28 Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3CejOkEbEqme5Iu5NaNNYGxm_xyFOFmUSNFDPLyLevAaMpOaK2kD9jvX8gKBoGWjrZ4l9265-kGjEZEOFmEJCxuMoMRcw7FLPLvLOa4eFdrLfTFgk4mHHNpy9ceB5UPclIag2JcoR5KXK9iG6pPICQS8M2TNnyIAxR5hdIsUaQK52Y Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 3a9bed43edcf4c5594ffde33282bc48c Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1027624478 Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3a9bed43edcf4c5594ffde33282bc48c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3a9bed43edcf4c5594ffde33282bc48c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3a9bed43edcf4c5594ffde33282bc48c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3a9bed43edcf4c5594ffde33282bc48c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1027624478 Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 3a9bed43edcf4c5594ffde33282bc48c Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1027624478 Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServerRescueNegativeTestJSON-1027624478-project Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 5cb9430023d842b4a5d930e01f7340f3 Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1027624478-project Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: {"reboot": {"type": "HARD"}} Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: exception: Cannot 'reboot' instance e765d57a-1bbe-4504-a194-d2c3d906577f while it is in vm_state rescued Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'e765d57a-1bbe-4504-a194-d2c3d906577f', 'body': {'reboot': {'type': 'HARD'}}} Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e765d57a-1bbe-4504-a194-d2c3d906577f in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 24 21:04:46.149678 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 24 21:04:46.154655 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance e765d57a-1bbe-4504-a194-d2c3d906577f while it is in vm_state rescued Sep 24 21:04:46.154655 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:46.154655 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:04:46.154655 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:46.154655 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:46.154655 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:04:46.154655 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:04:46.154655 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:04:46.154655 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:04:46.154655 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance e765d57a-1bbe-4504-a194-d2c3d906577f while it is in vm_state rescued Sep 24 21:04:46.154655 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:46.156624 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-46c00ba9-665a-4c17-b58d-d81ae6110822 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Returning 409 to user: Cannot 'reboot' instance e765d57a-1bbe-4504-a194-d2c3d906577f while it is in vm_state rescued {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:04:46.157661 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-46c00ba9-665a-4c17-b58d-d81ae6110822 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "POST /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f/action" status: 409 len: 145 microversion: 2.1 time: 0.078300 Sep 24 21:04:46.157793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7707ddf4-f461-438e-bfdc-d9f08316c527 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:46.158815 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2019/4074] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:04:46 2022] POST /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f/action => generated 145 bytes in 80 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 24 21:04:46.160943 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7707ddf4-f461-438e-bfdc-d9f08316c527 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 1f788a90-8f36-4262-957b-6d4e43e6568d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:46.169923 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c0404c50-727c-42a2-9c1a-616a8f52d513 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:46.172964 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c0404c50-727c-42a2-9c1a-616a8f52d513 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:46.194426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7707ddf4-f461-438e-bfdc-d9f08316c527 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:46.194426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7707ddf4-f461-438e-bfdc-d9f08316c527 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:46.194426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7707ddf4-f461-438e-bfdc-d9f08316c527 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:46.194426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7707ddf4-f461-438e-bfdc-d9f08316c527 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:46.194426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7707ddf4-f461-438e-bfdc-d9f08316c527 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:46.194426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7707ddf4-f461-438e-bfdc-d9f08316c527 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:46.196700 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0404c50-727c-42a2-9c1a-616a8f52d513 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:46.198570 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0404c50-727c-42a2-9c1a-616a8f52d513 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:46.199230 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0404c50-727c-42a2-9c1a-616a8f52d513 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:46.200174 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0404c50-727c-42a2-9c1a-616a8f52d513 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:46.200897 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0404c50-727c-42a2-9c1a-616a8f52d513 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:46.201502 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0404c50-727c-42a2-9c1a-616a8f52d513 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:46.240795 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-c0404c50-727c-42a2-9c1a-616a8f52d513 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] HTTP exception thrown: Cannot 'rebuild' instance e765d57a-1bbe-4504-a194-d2c3d906577f while it is in vm_state rescued Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c0404c50-727c-42a2-9c1a-616a8f52d513 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Request method failure captured: Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f/action HTTP/1.1 Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 65 Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3CejOkEbEqme5Iu5NaNNYGxm_xyFOFmUSNFDPLyLevAaMpOaK2kD9jvX8gKBoGWjrZ4l9265-kGjEZEOFmEJCxuMoMRcw7FLPLvLOa4eFdrLfTFgk4mHHNpy9ceB5UPclIag2JcoR5KXK9iG6pPICQS8M2TNnyIAxR5hdIsUaQK52Y Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 3a9bed43edcf4c5594ffde33282bc48c Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1027624478 Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3a9bed43edcf4c5594ffde33282bc48c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3a9bed43edcf4c5594ffde33282bc48c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3a9bed43edcf4c5594ffde33282bc48c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3a9bed43edcf4c5594ffde33282bc48c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1027624478 Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 3a9bed43edcf4c5594ffde33282bc48c Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1027624478 Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServerRescueNegativeTestJSON-1027624478-project Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 5cb9430023d842b4a5d930e01f7340f3 Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1027624478-project Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: {"rebuild": {"imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799"}} Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: exception: Cannot 'rebuild' instance e765d57a-1bbe-4504-a194-d2c3d906577f while it is in vm_state rescued Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'e765d57a-1bbe-4504-a194-d2c3d906577f', 'body': {'rebuild': {'imageRef': '4c30e8e9-8fb2-4377-83f1-98322cb17799'}}} Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e765d57a-1bbe-4504-a194-d2c3d906577f in vm_state rescued. Cannot rebuild while the instance is in this state. Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:04:46.243427 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:04:46.247854 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:04:46.247854 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 24 21:04:46.247854 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Sep 24 21:04:46.247854 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 24 21:04:46.247854 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 24 21:04:46.247854 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 24 21:04:46.247854 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance e765d57a-1bbe-4504-a194-d2c3d906577f while it is in vm_state rescued Sep 24 21:04:46.247854 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:46.247854 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:04:46.247854 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:46.247854 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:46.247854 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:04:46.247854 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:04:46.247854 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:04:46.247854 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:04:46.247854 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance e765d57a-1bbe-4504-a194-d2c3d906577f while it is in vm_state rescued Sep 24 21:04:46.247854 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:46.247854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c0404c50-727c-42a2-9c1a-616a8f52d513 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Returning 409 to user: Cannot 'rebuild' instance e765d57a-1bbe-4504-a194-d2c3d906577f while it is in vm_state rescued {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:04:46.247854 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c0404c50-727c-42a2-9c1a-616a8f52d513 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "POST /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f/action" status: 409 len: 146 microversion: 2.1 time: 0.079287 Sep 24 21:04:46.249947 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2020/4075] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:04:46 2022] POST /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f/action => generated 146 bytes in 85 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 24 21:04:46.308475 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4653a02a-5d16-4882-803a-847d992dc7f9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:46.309126 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4653a02a-5d16-4882-803a-847d992dc7f9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ca4c8bfe-e06d-427f-85fb-1d2729572b07] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:46.329451 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4653a02a-5d16-4882-803a-847d992dc7f9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:46.330029 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4653a02a-5d16-4882-803a-847d992dc7f9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:46.330745 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4653a02a-5d16-4882-803a-847d992dc7f9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:46.331735 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4653a02a-5d16-4882-803a-847d992dc7f9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:46.332632 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4653a02a-5d16-4882-803a-847d992dc7f9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:46.333369 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4653a02a-5d16-4882-803a-847d992dc7f9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:46.480370 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7707ddf4-f461-438e-bfdc-d9f08316c527 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:46.491475 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7707ddf4-f461-438e-bfdc-d9f08316c527 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d" status: 200 len: 1509 microversion: 2.1 time: 0.349491 Sep 24 21:04:46.539536 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2056/4076] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:46 2022] GET /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d => generated 1509 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:46.552154 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8714e3c5-1d63-432d-adb0-4480046c6e4c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:46.580550 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8714e3c5-1d63-432d-adb0-4480046c6e4c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:46.581569 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8714e3c5-1d63-432d-adb0-4480046c6e4c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Searching by: {'ip': '172.20.0.8', 'deleted': False, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e'} {{(pid=140516) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 21:04:46.837003 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8714e3c5-1d63-432d-adb0-4480046c6e4c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:46.837944 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8714e3c5-1d63-432d-adb0-4480046c6e4c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:46.839029 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8714e3c5-1d63-432d-adb0-4480046c6e4c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:46.839994 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8714e3c5-1d63-432d-adb0-4480046c6e4c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:46.840635 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8714e3c5-1d63-432d-adb0-4480046c6e4c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:46.841307 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8714e3c5-1d63-432d-adb0-4480046c6e4c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:46.879575 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4653a02a-5d16-4882-803a-847d992dc7f9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:46.890459 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4653a02a-5d16-4882-803a-847d992dc7f9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07" status: 200 len: 1489 microversion: 2.1 time: 0.588522 Sep 24 21:04:46.916906 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2021/4077] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:46 2022] GET /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07 => generated 1489 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:46.924820 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9c7d8005-14aa-4965-a840-b2eca6fa141e tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:46.928640 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9c7d8005-14aa-4965-a840-b2eca6fa141e tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:46.943980 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c7d8005-14aa-4965-a840-b2eca6fa141e tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:46.945417 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c7d8005-14aa-4965-a840-b2eca6fa141e tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:46.947201 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c7d8005-14aa-4965-a840-b2eca6fa141e tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:46.948881 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c7d8005-14aa-4965-a840-b2eca6fa141e tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:46.951189 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c7d8005-14aa-4965-a840-b2eca6fa141e tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:46.951885 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c7d8005-14aa-4965-a840-b2eca6fa141e tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:46.993967 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9c7d8005-14aa-4965-a840-b2eca6fa141e tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:04:47.013634 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.multi_cell_list [None req-8714e3c5-1d63-432d-adb0-4480046c6e4c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 21:04:47.087086 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:04:47.129136 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9c7d8005-14aa-4965-a840-b2eca6fa141e tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 204 len: 0 microversion: 2.1 time: 0.210652 Sep 24 21:04:47.130485 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2022/4078] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:04:46 2022] DELETE /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:04:47.138553 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fe2b5b43-6179-48db-b0c6-a19904037adb tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:47.139590 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fe2b5b43-6179-48db-b0c6-a19904037adb tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:47.143418 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8714e3c5-1d63-432d-adb0-4480046c6e4c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers?ip=172.20.0.8" status: 200 len: 345 microversion: 2.1 time: 0.602398 Sep 24 21:04:47.145206 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2057/4079] 10.222.0.52 () {58 vars in 1152 bytes} [Sat Sep 24 21:04:46 2022] GET /compute/v2.1/servers?ip=172.20.0.8 => generated 345 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:04:47.147380 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fe2b5b43-6179-48db-b0c6-a19904037adb tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:47.148000 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fe2b5b43-6179-48db-b0c6-a19904037adb tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:47.148879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fe2b5b43-6179-48db-b0c6-a19904037adb tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:47.149782 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fe2b5b43-6179-48db-b0c6-a19904037adb tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:47.150411 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fe2b5b43-6179-48db-b0c6-a19904037adb tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:47.151086 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fe2b5b43-6179-48db-b0c6-a19904037adb tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:47.151278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cd0d3889-ac95-4e91-a1d3-568c0e557021 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-859307982", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "86ee1dec-a957-4cc1-98d2-2e275615c01a"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:47.266356 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-cd0d3889-ac95-4e91-a1d3-568c0e557021 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] validate_networks() for [('86ee1dec-a957-4cc1-98d2-2e275615c01a', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:04:47.476514 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fe2b5b43-6179-48db-b0c6-a19904037adb tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:47.490919 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fe2b5b43-6179-48db-b0c6-a19904037adb tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1499 microversion: 2.1 time: 0.358743 Sep 24 21:04:47.492648 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2023/4080] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:47 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1499 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:47.497928 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8f873010-0e3a-455a-9b1f-2dca2cb34883 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:47.498967 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8f873010-0e3a-455a-9b1f-2dca2cb34883 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:47.506030 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:04:47.509736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8f873010-0e3a-455a-9b1f-2dca2cb34883 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:47.510691 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8f873010-0e3a-455a-9b1f-2dca2cb34883 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:47.511457 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8f873010-0e3a-455a-9b1f-2dca2cb34883 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:47.512374 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8f873010-0e3a-455a-9b1f-2dca2cb34883 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:47.513156 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8f873010-0e3a-455a-9b1f-2dca2cb34883 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:47.513753 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8f873010-0e3a-455a-9b1f-2dca2cb34883 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:47.969950 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-cd0d3889-ac95-4e91-a1d3-568c0e557021 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:04:47.970447 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-cd0d3889-ac95-4e91-a1d3-568c0e557021 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:04:47.970973 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-cd0d3889-ac95-4e91-a1d3-568c0e557021 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:04:47.971388 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-cd0d3889-ac95-4e91-a1d3-568c0e557021 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:04:47.972136 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-cd0d3889-ac95-4e91-a1d3-568c0e557021 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:04:47.983075 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd0d3889-ac95-4e91-a1d3-568c0e557021 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:47.983807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd0d3889-ac95-4e91-a1d3-568c0e557021 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:47.984731 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd0d3889-ac95-4e91-a1d3-568c0e557021 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:47.985652 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd0d3889-ac95-4e91-a1d3-568c0e557021 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:47.986387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd0d3889-ac95-4e91-a1d3-568c0e557021 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:47.987605 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd0d3889-ac95-4e91-a1d3-568c0e557021 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:48.012300 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-cd0d3889-ac95-4e91-a1d3-568c0e557021 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Getting quotas for project accafa2724354ca8b1c9f19940989429. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:04:48.019824 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-cd0d3889-ac95-4e91-a1d3-568c0e557021 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Getting quotas for user e557d91b49c143499d809a55e85932fd and project accafa2724354ca8b1c9f19940989429. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:04:48.035604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cd0d3889-ac95-4e91-a1d3-568c0e557021 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:04:48.038061 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cd0d3889-ac95-4e91-a1d3-568c0e557021 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 95dc95dc-ef74-4f92-9d5a-7e199fc802f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:04:48.100195 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cd0d3889-ac95-4e91-a1d3-568c0e557021 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.953552 Sep 24 21:04:48.110055 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2058/4081] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:04:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:04:48.116136 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f69c97e0-9487-4a88-abed-1e918cbd40bf tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:48.117078 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f69c97e0-9487-4a88-abed-1e918cbd40bf tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 06ef44f5-3eae-4780-b544-62102fd945a7] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:48.117617 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8f873010-0e3a-455a-9b1f-2dca2cb34883 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:48.129666 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8f873010-0e3a-455a-9b1f-2dca2cb34883 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1508 microversion: 2.1 time: 0.633605 Sep 24 21:04:48.131030 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f69c97e0-9487-4a88-abed-1e918cbd40bf tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:48.131722 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2024/4082] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:47 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1508 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:48.131960 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f69c97e0-9487-4a88-abed-1e918cbd40bf tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:48.133570 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f69c97e0-9487-4a88-abed-1e918cbd40bf tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:48.134665 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f69c97e0-9487-4a88-abed-1e918cbd40bf tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:48.135535 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f69c97e0-9487-4a88-abed-1e918cbd40bf tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:48.136143 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f69c97e0-9487-4a88-abed-1e918cbd40bf tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:48.139732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cb8705cb-dbe0-4fe1-b4f5-596bbe852063 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Action: 'create', calling method: .version_select at 0x7f4b110c7310>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-869602264", "description": "tempest-description-1336260293"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:48.366298 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f69c97e0-9487-4a88-abed-1e918cbd40bf tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:48.391172 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f69c97e0-9487-4a88-abed-1e918cbd40bf tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7" status: 200 len: 1509 microversion: 2.1 time: 0.279357 Sep 24 21:04:48.391663 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2059/4083] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:48 2022] GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7 => generated 1509 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:48.416060 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-88169e27-e537-4d77-ad74-0e115e434c43 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:48.416879 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-88169e27-e537-4d77-ad74-0e115e434c43 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 95dc95dc-ef74-4f92-9d5a-7e199fc802f5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:48.489882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-88169e27-e537-4d77-ad74-0e115e434c43 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:48.498821 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-88169e27-e537-4d77-ad74-0e115e434c43 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5" status: 200 len: 1208 microversion: 2.1 time: 0.090308 Sep 24 21:04:48.499418 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2060/4084] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:48 2022] GET /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5 => generated 1208 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:48.520218 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0fbb5690-4203-4e3b-bf3b-cc87e8651801 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:48.521030 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0fbb5690-4203-4e3b-bf3b-cc87e8651801 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 275263e1-8a0a-4f58-b863-b56c2bf3a7c0] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:48.535355 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0fbb5690-4203-4e3b-bf3b-cc87e8651801 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:48.537551 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0fbb5690-4203-4e3b-bf3b-cc87e8651801 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:48.538223 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0fbb5690-4203-4e3b-bf3b-cc87e8651801 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:48.539756 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0fbb5690-4203-4e3b-bf3b-cc87e8651801 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:48.540227 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0fbb5690-4203-4e3b-bf3b-cc87e8651801 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:48.541106 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0fbb5690-4203-4e3b-bf3b-cc87e8651801 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:48.545526 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cb8705cb-dbe0-4fe1-b4f5-596bbe852063 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.410673 Sep 24 21:04:48.546310 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2025/4085] 10.222.0.52 () {60 vars in 1180 bytes} [Sat Sep 24 21:04:48 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:04:48.561421 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7fe5df46-9846-4bcd-8277-01d058438747 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-869602264"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:48.561974 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7fe5df46-9846-4bcd-8277-01d058438747 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:48.572911 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7fe5df46-9846-4bcd-8277-01d058438747 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:48.573260 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7fe5df46-9846-4bcd-8277-01d058438747 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:48.573713 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7fe5df46-9846-4bcd-8277-01d058438747 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:48.574547 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7fe5df46-9846-4bcd-8277-01d058438747 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:48.574937 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7fe5df46-9846-4bcd-8277-01d058438747 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:48.575374 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7fe5df46-9846-4bcd-8277-01d058438747 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:48.815780 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0fbb5690-4203-4e3b-bf3b-cc87e8651801 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:48.825647 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0fbb5690-4203-4e3b-bf3b-cc87e8651801 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/275263e1-8a0a-4f58-b863-b56c2bf3a7c0" status: 200 len: 1509 microversion: 2.1 time: 0.313706 Sep 24 21:04:48.827294 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2061/4086] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:48 2022] GET /compute/v2.1/servers/275263e1-8a0a-4f58-b863-b56c2bf3a7c0 => generated 1509 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:48.849081 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-35c201fe-9de6-466f-badd-69d3ca1267c4 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:48.849782 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-35c201fe-9de6-466f-badd-69d3ca1267c4 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 1f788a90-8f36-4262-957b-6d4e43e6568d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:48.862089 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35c201fe-9de6-466f-badd-69d3ca1267c4 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:48.862715 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35c201fe-9de6-466f-badd-69d3ca1267c4 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:48.871052 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35c201fe-9de6-466f-badd-69d3ca1267c4 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:48.872210 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35c201fe-9de6-466f-badd-69d3ca1267c4 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:48.872702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35c201fe-9de6-466f-badd-69d3ca1267c4 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:48.873337 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35c201fe-9de6-466f-badd-69d3ca1267c4 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:48.878825 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.network.security_group_api [None req-7fe5df46-9846-4bcd-8277-01d058438747 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Adding security group 9bd7a4e2-cb80-4e60-b005-ad8141bdf32a to port 463ee47f-dd1b-4d52-b5e6-b06f1390b340 Sep 24 21:04:49.152500 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-35c201fe-9de6-466f-badd-69d3ca1267c4 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:49.162566 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-35c201fe-9de6-466f-badd-69d3ca1267c4 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d" status: 200 len: 1509 microversion: 2.1 time: 0.317413 Sep 24 21:04:49.163152 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2062/4087] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:48 2022] GET /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d => generated 1509 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:04:49.187625 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d2dff832-ac91-496f-8f06-b142d825b2b8 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:49.188545 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d2dff832-ac91-496f-8f06-b142d825b2b8 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:49.195606 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d2dff832-ac91-496f-8f06-b142d825b2b8 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:49.196099 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d2dff832-ac91-496f-8f06-b142d825b2b8 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:49.196542 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d2dff832-ac91-496f-8f06-b142d825b2b8 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:49.197263 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d2dff832-ac91-496f-8f06-b142d825b2b8 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:49.197718 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d2dff832-ac91-496f-8f06-b142d825b2b8 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:49.198424 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d2dff832-ac91-496f-8f06-b142d825b2b8 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:49.703425 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d2dff832-ac91-496f-8f06-b142d825b2b8 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:49.714407 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d2dff832-ac91-496f-8f06-b142d825b2b8 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1508 microversion: 2.1 time: 0.537539 Sep 24 21:04:49.726804 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2063/4088] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:49 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1508 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:49.733511 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7f2ceb1e-f239-46ea-b0d1-211224554057 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:49.753356 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7f2ceb1e-f239-46ea-b0d1-211224554057 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:49.754315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7f2ceb1e-f239-46ea-b0d1-211224554057 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Searching by: {'deleted': False, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e'} {{(pid=140516) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 21:04:49.760190 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f2ceb1e-f239-46ea-b0d1-211224554057 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:49.760710 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f2ceb1e-f239-46ea-b0d1-211224554057 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:49.761155 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f2ceb1e-f239-46ea-b0d1-211224554057 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:49.761886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f2ceb1e-f239-46ea-b0d1-211224554057 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:49.762345 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f2ceb1e-f239-46ea-b0d1-211224554057 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:49.762793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f2ceb1e-f239-46ea-b0d1-211224554057 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:49.778567 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7fe5df46-9846-4bcd-8277-01d058438747 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "POST /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c/action" status: 202 len: 0 microversion: 2.1 time: 1.221202 Sep 24 21:04:49.779209 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2026/4089] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:04:48 2022] POST /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c/action => generated 0 bytes in 1223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:04:49.794751 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a5319ee3-9421-42bc-8daf-3ff886042bc4 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:49.798362 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a5319ee3-9421-42bc-8daf-3ff886042bc4 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 95dc95dc-ef74-4f92-9d5a-7e199fc802f5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:49.841878 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5319ee3-9421-42bc-8daf-3ff886042bc4 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:49.842428 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5319ee3-9421-42bc-8daf-3ff886042bc4 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:49.842948 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5319ee3-9421-42bc-8daf-3ff886042bc4 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:49.843690 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5319ee3-9421-42bc-8daf-3ff886042bc4 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:49.844153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5319ee3-9421-42bc-8daf-3ff886042bc4 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:49.844593 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5319ee3-9421-42bc-8daf-3ff886042bc4 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:49.893131 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.multi_cell_list [None req-7f2ceb1e-f239-46ea-b0d1-211224554057 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 21:04:49.952457 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7f2ceb1e-f239-46ea-b0d1-211224554057 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:49.965674 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f2ceb1e-f239-46ea-b0d1-211224554057 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:49.968727 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f2ceb1e-f239-46ea-b0d1-211224554057 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:49.969518 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f2ceb1e-f239-46ea-b0d1-211224554057 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:50.058886 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a5319ee3-9421-42bc-8daf-3ff886042bc4 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:50.073946 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a5319ee3-9421-42bc-8daf-3ff886042bc4 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5" status: 200 len: 1260 microversion: 2.1 time: 0.293641 Sep 24 21:04:50.086748 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2027/4090] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:49 2022] GET /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5 => generated 1260 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:50.098113 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2eef528e-c582-444c-bd7a-fca14d1b87c8 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-869602264"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:50.099295 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2eef528e-c582-444c-bd7a-fca14d1b87c8 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:50.117807 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2eef528e-c582-444c-bd7a-fca14d1b87c8 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:50.118652 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2eef528e-c582-444c-bd7a-fca14d1b87c8 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:50.119111 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2eef528e-c582-444c-bd7a-fca14d1b87c8 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:50.120438 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2eef528e-c582-444c-bd7a-fca14d1b87c8 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:50.120924 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2eef528e-c582-444c-bd7a-fca14d1b87c8 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:50.121365 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2eef528e-c582-444c-bd7a-fca14d1b87c8 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:50.401822 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7f2ceb1e-f239-46ea-b0d1-211224554057 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/detail" status: 200 len: 4510 microversion: 2.1 time: 0.685225 Sep 24 21:04:50.402559 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2064/4091] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 21:04:49 2022] GET /compute/v2.1/servers/detail => generated 4510 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:50.440278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-6c181ec6-9cba-47c7-ad03-0cbb4e34360a req-a91029c1-6b24-458e-b622-1e1bfb8a883c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b2e4ce4-809e-4888-8205-eae021e2fb8c", "tag": "463ee47f-dd1b-4d52-b5e6-b06f1390b340"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:50.453932 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-6c181ec6-9cba-47c7-ad03-0cbb4e34360a req-a91029c1-6b24-458e-b622-1e1bfb8a883c service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:50.455143 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-6c181ec6-9cba-47c7-ad03-0cbb4e34360a req-a91029c1-6b24-458e-b622-1e1bfb8a883c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:50.455785 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-6c181ec6-9cba-47c7-ad03-0cbb4e34360a req-a91029c1-6b24-458e-b622-1e1bfb8a883c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:50.497283 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-6c181ec6-9cba-47c7-ad03-0cbb4e34360a req-a91029c1-6b24-458e-b622-1e1bfb8a883c service nova] Creating event network-changed:463ee47f-dd1b-4d52-b5e6-b06f1390b340 for instance 1b2e4ce4-809e-4888-8205-eae021e2fb8c on nch1-master-1 Sep 24 21:04:50.515777 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-6c181ec6-9cba-47c7-ad03-0cbb4e34360a req-a91029c1-6b24-458e-b622-1e1bfb8a883c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082507 Sep 24 21:04:50.516730 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2065/4092] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:04:50.537924 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c99f2c57-b50d-4bb3-b970-9d78886c394b tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:50.547290 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c99f2c57-b50d-4bb3-b970-9d78886c394b tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:50.548199 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c99f2c57-b50d-4bb3-b970-9d78886c394b tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e'} {{(pid=140516) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 21:04:50.647222 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.network.security_group_api [None req-2eef528e-c582-444c-bd7a-fca14d1b87c8 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Removing security group 9bd7a4e2-cb80-4e60-b005-ad8141bdf32a from port 463ee47f-dd1b-4d52-b5e6-b06f1390b340 Sep 24 21:04:50.793590 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c99f2c57-b50d-4bb3-b970-9d78886c394b tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:50.794079 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c99f2c57-b50d-4bb3-b970-9d78886c394b tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:50.794553 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c99f2c57-b50d-4bb3-b970-9d78886c394b tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:50.795542 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c99f2c57-b50d-4bb3-b970-9d78886c394b tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:50.796386 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c99f2c57-b50d-4bb3-b970-9d78886c394b tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:50.796809 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c99f2c57-b50d-4bb3-b970-9d78886c394b tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:50.860082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.multi_cell_list [None req-c99f2c57-b50d-4bb3-b970-9d78886c394b tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 21:04:50.923150 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c99f2c57-b50d-4bb3-b970-9d78886c394b tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1009 microversion: 2.1 time: 0.403350 Sep 24 21:04:50.925256 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2066/4093] 10.222.0.52 () {58 vars in 1150 bytes} [Sat Sep 24 21:04:50 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1009 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:50.939102 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5a096ad2-3f09-4141-8fe2-7c59e7f4b2cf tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:50.939894 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5a096ad2-3f09-4141-8fe2-7c59e7f4b2cf tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:50.952830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5a096ad2-3f09-4141-8fe2-7c59e7f4b2cf tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:50.955928 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5a096ad2-3f09-4141-8fe2-7c59e7f4b2cf tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:50.958642 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5a096ad2-3f09-4141-8fe2-7c59e7f4b2cf tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:50.959735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5a096ad2-3f09-4141-8fe2-7c59e7f4b2cf tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:50.961633 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5a096ad2-3f09-4141-8fe2-7c59e7f4b2cf tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:50.962282 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5a096ad2-3f09-4141-8fe2-7c59e7f4b2cf tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:51.623167 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5a096ad2-3f09-4141-8fe2-7c59e7f4b2cf tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:51.643849 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5a096ad2-3f09-4141-8fe2-7c59e7f4b2cf tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 200 len: 1508 microversion: 2.1 time: 0.717496 Sep 24 21:04:51.644433 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2067/4094] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:50 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 1508 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:51.673945 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1d4e08bd-974a-4169-93fd-bf53d370493f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:51.696936 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1d4e08bd-974a-4169-93fd-bf53d370493f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:51.697434 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1d4e08bd-974a-4169-93fd-bf53d370493f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e'} {{(pid=140516) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 21:04:51.723599 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d4e08bd-974a-4169-93fd-bf53d370493f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:51.724108 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d4e08bd-974a-4169-93fd-bf53d370493f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:51.724544 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d4e08bd-974a-4169-93fd-bf53d370493f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:51.732428 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d4e08bd-974a-4169-93fd-bf53d370493f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:51.733847 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d4e08bd-974a-4169-93fd-bf53d370493f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:51.734294 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d4e08bd-974a-4169-93fd-bf53d370493f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:51.920412 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.multi_cell_list [None req-1d4e08bd-974a-4169-93fd-bf53d370493f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 21:04:51.953567 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2eef528e-c582-444c-bd7a-fca14d1b87c8 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "POST /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c/action" status: 202 len: 0 microversion: 2.1 time: 1.865422 Sep 24 21:04:51.955818 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2028/4095] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:04:50 2022] POST /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c/action => generated 0 bytes in 1868 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:04:51.962339 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6645b006-668e-4bbf-b922-c7ef9e0f561d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:51.963253 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6645b006-668e-4bbf-b922-c7ef9e0f561d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 95dc95dc-ef74-4f92-9d5a-7e199fc802f5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:52.000234 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6645b006-668e-4bbf-b922-c7ef9e0f561d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:52.006213 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6645b006-668e-4bbf-b922-c7ef9e0f561d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:52.007015 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6645b006-668e-4bbf-b922-c7ef9e0f561d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:52.008211 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1d4e08bd-974a-4169-93fd-bf53d370493f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1009 microversion: 2.1 time: 0.348585 Sep 24 21:04:52.011158 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6645b006-668e-4bbf-b922-c7ef9e0f561d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:52.012859 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6645b006-668e-4bbf-b922-c7ef9e0f561d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:52.014950 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6645b006-668e-4bbf-b922-c7ef9e0f561d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:52.017952 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2068/4096] 10.222.0.52 () {58 vars in 1212 bytes} [Sat Sep 24 21:04:51 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1009 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:52.030538 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3b0c6093-e50c-48a7-b2b1-e2e600950ab9 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Action: 'create', calling method: .version_select at 0x7f4b0c09c700>, body: {"pool": null} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:52.569333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6645b006-668e-4bbf-b922-c7ef9e0f561d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:52.595296 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6645b006-668e-4bbf-b922-c7ef9e0f561d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5" status: 200 len: 1308 microversion: 2.1 time: 0.623223 Sep 24 21:04:52.598150 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2029/4097] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:51 2022] GET /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5 => generated 1308 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:52.619718 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-19a91717-3cb3-4fb5-8985-d0f9989b445e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:52.636725 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-19a91717-3cb3-4fb5-8985-d0f9989b445e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:52.638473 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-19a91717-3cb3-4fb5-8985-d0f9989b445e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e'} {{(pid=140517) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 21:04:52.652991 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-19a91717-3cb3-4fb5-8985-d0f9989b445e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:52.653719 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-19a91717-3cb3-4fb5-8985-d0f9989b445e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:52.654341 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-19a91717-3cb3-4fb5-8985-d0f9989b445e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:52.655288 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-19a91717-3cb3-4fb5-8985-d0f9989b445e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:52.656136 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-19a91717-3cb3-4fb5-8985-d0f9989b445e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:52.656743 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-19a91717-3cb3-4fb5-8985-d0f9989b445e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:52.863683 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.multi_cell_list [None req-19a91717-3cb3-4fb5-8985-d0f9989b445e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 21:04:52.991841 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-19a91717-3cb3-4fb5-8985-d0f9989b445e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1009 microversion: 2.1 time: 0.381336 Sep 24 21:04:53.005885 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2030/4098] 10.222.0.52 () {58 vars in 1196 bytes} [Sat Sep 24 21:04:52 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1009 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:53.011810 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-3ecaa0aa-f902-48e9-b7bd-c70e5e772eac req-10cb6446-236d-443c-8224-e98aa99ad886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e765d57a-1bbe-4504-a194-d2c3d906577f", "name": "network-vif-deleted", "tag": "5261759a-9b03-4931-8c0d-b4ebcec3b6fc"}, {"name": "network-changed", "server_uuid": "1b2e4ce4-809e-4888-8205-eae021e2fb8c", "tag": "463ee47f-dd1b-4d52-b5e6-b06f1390b340"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:53.031237 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-3ecaa0aa-f902-48e9-b7bd-c70e5e772eac req-10cb6446-236d-443c-8224-e98aa99ad886 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:53.031727 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-3ecaa0aa-f902-48e9-b7bd-c70e5e772eac req-10cb6446-236d-443c-8224-e98aa99ad886 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:53.032167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-3ecaa0aa-f902-48e9-b7bd-c70e5e772eac req-10cb6446-236d-443c-8224-e98aa99ad886 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:53.056193 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-3ecaa0aa-f902-48e9-b7bd-c70e5e772eac req-10cb6446-236d-443c-8224-e98aa99ad886 service nova] Creating event network-vif-deleted:5261759a-9b03-4931-8c0d-b4ebcec3b6fc for instance e765d57a-1bbe-4504-a194-d2c3d906577f on nch1-master-1 Sep 24 21:04:53.056708 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-3ecaa0aa-f902-48e9-b7bd-c70e5e772eac req-10cb6446-236d-443c-8224-e98aa99ad886 service nova] Creating event network-changed:463ee47f-dd1b-4d52-b5e6-b06f1390b340 for instance 1b2e4ce4-809e-4888-8205-eae021e2fb8c on nch1-master-1 Sep 24 21:04:53.072109 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-3ecaa0aa-f902-48e9-b7bd-c70e5e772eac req-10cb6446-236d-443c-8224-e98aa99ad886 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.064805 Sep 24 21:04:53.074650 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2031/4099] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:04:53.080270 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c7132128-c310-4a46-b5d8-3ac6115f4d7e tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:53.089841 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c7132128-c310-4a46-b5d8-3ac6115f4d7e tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: e765d57a-1bbe-4504-a194-d2c3d906577f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:53.102001 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c7132128-c310-4a46-b5d8-3ac6115f4d7e tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:53.105377 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c7132128-c310-4a46-b5d8-3ac6115f4d7e tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:53.106829 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c7132128-c310-4a46-b5d8-3ac6115f4d7e tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:53.112173 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c7132128-c310-4a46-b5d8-3ac6115f4d7e tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:53.112859 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c7132128-c310-4a46-b5d8-3ac6115f4d7e tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:53.113509 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c7132128-c310-4a46-b5d8-3ac6115f4d7e tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:53.145790 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-c7132128-c310-4a46-b5d8-3ac6115f4d7e tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] HTTP exception thrown: Instance e765d57a-1bbe-4504-a194-d2c3d906577f could not be found. Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c7132128-c310-4a46-b5d8-3ac6115f4d7e tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Request method failure captured: Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f HTTP/1.1 Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3CejOkEbEqme5Iu5NaNNYGxm_xyFOFmUSNFDPLyLevAaMpOaK2kD9jvX8gKBoGWjrZ4l9265-kGjEZEOFmEJCxuMoMRcw7FLPLvLOa4eFdrLfTFgk4mHHNpy9ceB5UPclIag2JcoR5KXK9iG6pPICQS8M2TNnyIAxR5hdIsUaQK52Y Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 3a9bed43edcf4c5594ffde33282bc48c Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1027624478 Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3a9bed43edcf4c5594ffde33282bc48c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3a9bed43edcf4c5594ffde33282bc48c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3a9bed43edcf4c5594ffde33282bc48c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3a9bed43edcf4c5594ffde33282bc48c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1027624478 Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 3a9bed43edcf4c5594ffde33282bc48c Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1027624478 Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServerRescueNegativeTestJSON-1027624478-project Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 5cb9430023d842b4a5d930e01f7340f3 Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1027624478-project Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance e765d57a-1bbe-4504-a194-d2c3d906577f could not be found. Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'e765d57a-1bbe-4504-a194-d2c3d906577f'} Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e765d57a-1bbe-4504-a194-d2c3d906577f could not be found. Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e765d57a-1bbe-4504-a194-d2c3d906577f could not be found. Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:53.152386 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:04:53.157889 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:53.157889 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:53.157889 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:04:53.157889 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:04:53.157889 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:04:53.157889 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:04:53.157889 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e765d57a-1bbe-4504-a194-d2c3d906577f could not be found. Sep 24 21:04:53.157889 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:53.157889 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c7132128-c310-4a46-b5d8-3ac6115f4d7e tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Returning 404 to user: Instance e765d57a-1bbe-4504-a194-d2c3d906577f could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:04:53.158933 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c7132128-c310-4a46-b5d8-3ac6115f4d7e tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f" status: 404 len: 111 microversion: 2.1 time: 0.080413 Sep 24 21:04:53.159501 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2032/4100] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:53 2022] GET /compute/v2.1/servers/e765d57a-1bbe-4504-a194-d2c3d906577f => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:04:53.181004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-da23f6ba-22d3-4bdd-8f0b-e8855560ce71 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:53.196145 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-da23f6ba-22d3-4bdd-8f0b-e8855560ce71 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:53.198854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-da23f6ba-22d3-4bdd-8f0b-e8855560ce71 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Searching by: {'name': '-220848403', 'deleted': False, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e'} {{(pid=140517) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 21:04:53.213906 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-da23f6ba-22d3-4bdd-8f0b-e8855560ce71 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:53.214892 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-da23f6ba-22d3-4bdd-8f0b-e8855560ce71 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:53.215503 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-da23f6ba-22d3-4bdd-8f0b-e8855560ce71 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:53.217653 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-da23f6ba-22d3-4bdd-8f0b-e8855560ce71 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:53.218136 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-da23f6ba-22d3-4bdd-8f0b-e8855560ce71 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:53.218605 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-da23f6ba-22d3-4bdd-8f0b-e8855560ce71 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:53.442685 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.multi_cell_list [None req-da23f6ba-22d3-4bdd-8f0b-e8855560ce71 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 21:04:53.578337 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-da23f6ba-22d3-4bdd-8f0b-e8855560ce71 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers?name=-220848403" status: 200 len: 345 microversion: 2.1 time: 0.412255 Sep 24 21:04:53.581579 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2033/4101] 10.222.0.52 () {58 vars in 1156 bytes} [Sat Sep 24 21:04:53 2022] GET /compute/v2.1/servers?name=-220848403 => generated 345 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:04:53.588354 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d1b149c3-2afc-4871-88b0-a5ec075574d8 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:53.596959 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d1b149c3-2afc-4871-88b0-a5ec075574d8 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: acc02ed3-5cf0-4fe4-b4d7-ac40fe691355] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:53.614490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1b149c3-2afc-4871-88b0-a5ec075574d8 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:53.615749 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1b149c3-2afc-4871-88b0-a5ec075574d8 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:53.616538 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1b149c3-2afc-4871-88b0-a5ec075574d8 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:53.621000 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1b149c3-2afc-4871-88b0-a5ec075574d8 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:53.621970 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1b149c3-2afc-4871-88b0-a5ec075574d8 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:53.623212 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1b149c3-2afc-4871-88b0-a5ec075574d8 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:53.676792 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d1b149c3-2afc-4871-88b0-a5ec075574d8 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: acc02ed3-5cf0-4fe4-b4d7-ac40fe691355] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:04:53.841951 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d1b149c3-2afc-4871-88b0-a5ec075574d8 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "DELETE /compute/v2.1/servers/acc02ed3-5cf0-4fe4-b4d7-ac40fe691355" status: 204 len: 0 microversion: 2.1 time: 0.258097 Sep 24 21:04:53.845060 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2034/4102] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:04:53 2022] DELETE /compute/v2.1/servers/acc02ed3-5cf0-4fe4-b4d7-ac40fe691355 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:04:53.867683 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-e03383c3-8039-4ea0-a544-3490668b9bec req-19cd924a-7ac8-4820-81f3-dbd436490694 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95dc95dc-ef74-4f92-9d5a-7e199fc802f5", "tag": "2bbb1b2e-5192-48be-a4f8-0c1cb200c21c"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:53.893963 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e03383c3-8039-4ea0-a544-3490668b9bec req-19cd924a-7ac8-4820-81f3-dbd436490694 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:53.894446 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e03383c3-8039-4ea0-a544-3490668b9bec req-19cd924a-7ac8-4820-81f3-dbd436490694 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:53.896507 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e03383c3-8039-4ea0-a544-3490668b9bec req-19cd924a-7ac8-4820-81f3-dbd436490694 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:53.926754 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-e03383c3-8039-4ea0-a544-3490668b9bec req-19cd924a-7ac8-4820-81f3-dbd436490694 service nova] Creating event network-changed:2bbb1b2e-5192-48be-a4f8-0c1cb200c21c for instance 95dc95dc-ef74-4f92-9d5a-7e199fc802f5 on nch1-master-1 Sep 24 21:04:53.936554 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-e03383c3-8039-4ea0-a544-3490668b9bec req-19cd924a-7ac8-4820-81f3-dbd436490694 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088304 Sep 24 21:04:53.940936 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2035/4103] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:04:53.969403 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5906b3c3-92b2-4ed5-b07f-14a4bfb9d8c9 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:53.975051 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5906b3c3-92b2-4ed5-b07f-14a4bfb9d8c9 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:53.976877 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5906b3c3-92b2-4ed5-b07f-14a4bfb9d8c9 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e'} {{(pid=140517) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 21:04:53.982938 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5906b3c3-92b2-4ed5-b07f-14a4bfb9d8c9 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:53.983423 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5906b3c3-92b2-4ed5-b07f-14a4bfb9d8c9 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:53.983860 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5906b3c3-92b2-4ed5-b07f-14a4bfb9d8c9 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:53.984581 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5906b3c3-92b2-4ed5-b07f-14a4bfb9d8c9 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:53.985034 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5906b3c3-92b2-4ed5-b07f-14a4bfb9d8c9 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:53.985455 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5906b3c3-92b2-4ed5-b07f-14a4bfb9d8c9 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:54.087116 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.multi_cell_list [None req-5906b3c3-92b2-4ed5-b07f-14a4bfb9d8c9 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 21:04:54.167296 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5906b3c3-92b2-4ed5-b07f-14a4bfb9d8c9 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1009 microversion: 2.1 time: 0.220310 Sep 24 21:04:54.177219 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2036/4104] 10.222.0.52 () {58 vars in 1154 bytes} [Sat Sep 24 21:04:53 2022] GET /compute/v2.1/servers?name=-instance => generated 1009 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:54.201162 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5ec4f3e4-4c9b-431f-ad0d-7f417f7f7466 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:54.205543 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5ec4f3e4-4c9b-431f-ad0d-7f417f7f7466 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 95dc95dc-ef74-4f92-9d5a-7e199fc802f5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:54.221640 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ec4f3e4-4c9b-431f-ad0d-7f417f7f7466 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:54.227246 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ec4f3e4-4c9b-431f-ad0d-7f417f7f7466 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:54.227717 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ec4f3e4-4c9b-431f-ad0d-7f417f7f7466 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:54.228495 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ec4f3e4-4c9b-431f-ad0d-7f417f7f7466 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:54.228960 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ec4f3e4-4c9b-431f-ad0d-7f417f7f7466 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:54.229386 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ec4f3e4-4c9b-431f-ad0d-7f417f7f7466 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:54.632800 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5ec4f3e4-4c9b-431f-ad0d-7f417f7f7466 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:54.651051 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5ec4f3e4-4c9b-431f-ad0d-7f417f7f7466 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5" status: 200 len: 1308 microversion: 2.1 time: 0.472248 Sep 24 21:04:54.652003 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2037/4105] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:54 2022] GET /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5 => generated 1308 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:54.658561 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-df2de500-9a28-4d5b-82c3-22916e483a0f tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:54.659569 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-df2de500-9a28-4d5b-82c3-22916e483a0f tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: acc02ed3-5cf0-4fe4-b4d7-ac40fe691355] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:54.673035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df2de500-9a28-4d5b-82c3-22916e483a0f tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:54.675801 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df2de500-9a28-4d5b-82c3-22916e483a0f tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:54.676889 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df2de500-9a28-4d5b-82c3-22916e483a0f tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:54.680509 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df2de500-9a28-4d5b-82c3-22916e483a0f tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:54.681296 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df2de500-9a28-4d5b-82c3-22916e483a0f tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:54.681903 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-df2de500-9a28-4d5b-82c3-22916e483a0f tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:55.001878 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-df2de500-9a28-4d5b-82c3-22916e483a0f tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:55.016563 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-df2de500-9a28-4d5b-82c3-22916e483a0f tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/acc02ed3-5cf0-4fe4-b4d7-ac40fe691355" status: 200 len: 1521 microversion: 2.1 time: 0.362518 Sep 24 21:04:55.018130 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2038/4106] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:54 2022] GET /compute/v2.1/servers/acc02ed3-5cf0-4fe4-b4d7-ac40fe691355 => generated 1521 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:55.025512 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-972bfa14-4792-472a-b7d8-56e271315aa7 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:55.034550 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-972bfa14-4792-472a-b7d8-56e271315aa7 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:55.041581 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-972bfa14-4792-472a-b7d8-56e271315aa7 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-22084840', 'deleted': False, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e'} {{(pid=140517) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 21:04:55.051615 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-972bfa14-4792-472a-b7d8-56e271315aa7 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:55.054808 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-972bfa14-4792-472a-b7d8-56e271315aa7 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:55.055577 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-972bfa14-4792-472a-b7d8-56e271315aa7 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:55.056946 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-972bfa14-4792-472a-b7d8-56e271315aa7 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:55.058581 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-972bfa14-4792-472a-b7d8-56e271315aa7 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:55.059334 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-972bfa14-4792-472a-b7d8-56e271315aa7 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:55.194717 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.multi_cell_list [None req-972bfa14-4792-472a-b7d8-56e271315aa7 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 21:04:55.214407 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:04:55.271265 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-972bfa14-4792-472a-b7d8-56e271315aa7 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-22084840" status: 200 len: 345 microversion: 2.1 time: 0.251355 Sep 24 21:04:55.281417 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2039/4107] 10.222.0.52 () {58 vars in 1226 bytes} [Sat Sep 24 21:04:55 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-22084840 => generated 345 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:04:55.289905 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d740acf7-50af-443d-b869-f1b64b14cd33 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:55.290473 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d740acf7-50af-443d-b869-f1b64b14cd33 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 1f788a90-8f36-4262-957b-6d4e43e6568d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:55.299322 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d740acf7-50af-443d-b869-f1b64b14cd33 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:55.299643 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d740acf7-50af-443d-b869-f1b64b14cd33 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:55.300216 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d740acf7-50af-443d-b869-f1b64b14cd33 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:55.301387 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d740acf7-50af-443d-b869-f1b64b14cd33 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:55.302082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d740acf7-50af-443d-b869-f1b64b14cd33 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:55.302558 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d740acf7-50af-443d-b869-f1b64b14cd33 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:55.337078 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d740acf7-50af-443d-b869-f1b64b14cd33 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 1f788a90-8f36-4262-957b-6d4e43e6568d] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:04:55.489592 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d740acf7-50af-443d-b869-f1b64b14cd33 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d" status: 204 len: 0 microversion: 2.1 time: 0.206593 Sep 24 21:04:55.490877 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2040/4108] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:04:55 2022] DELETE /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:04:55.500242 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cb631f1a-50e6-41e9-8159-659a26aa5824 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:55.501042 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cb631f1a-50e6-41e9-8159-659a26aa5824 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 1f788a90-8f36-4262-957b-6d4e43e6568d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:55.508750 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cb631f1a-50e6-41e9-8159-659a26aa5824 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:55.509348 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cb631f1a-50e6-41e9-8159-659a26aa5824 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:55.510261 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cb631f1a-50e6-41e9-8159-659a26aa5824 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:55.510710 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cb631f1a-50e6-41e9-8159-659a26aa5824 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:55.511245 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cb631f1a-50e6-41e9-8159-659a26aa5824 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:55.512468 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cb631f1a-50e6-41e9-8159-659a26aa5824 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:55.925568 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cb631f1a-50e6-41e9-8159-659a26aa5824 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:55.934123 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cb631f1a-50e6-41e9-8159-659a26aa5824 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d" status: 200 len: 1515 microversion: 2.1 time: 0.438752 Sep 24 21:04:55.938114 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2041/4109] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:55 2022] GET /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d => generated 1515 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:04:55.950016 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e40b72e9-f3fc-459e-94e6-a89d621d525d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:55.952861 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e40b72e9-f3fc-459e-94e6-a89d621d525d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 95dc95dc-ef74-4f92-9d5a-7e199fc802f5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:55.973214 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e40b72e9-f3fc-459e-94e6-a89d621d525d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:55.974025 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e40b72e9-f3fc-459e-94e6-a89d621d525d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:55.975575 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e40b72e9-f3fc-459e-94e6-a89d621d525d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:55.976668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e40b72e9-f3fc-459e-94e6-a89d621d525d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:55.980398 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e40b72e9-f3fc-459e-94e6-a89d621d525d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:55.981068 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e40b72e9-f3fc-459e-94e6-a89d621d525d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:56.769446 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e40b72e9-f3fc-459e-94e6-a89d621d525d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:56.780962 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e40b72e9-f3fc-459e-94e6-a89d621d525d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5" status: 200 len: 1308 microversion: 2.1 time: 0.838818 Sep 24 21:04:56.781839 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2042/4110] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:55 2022] GET /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5 => generated 1308 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:56.787549 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-903eb023-c34a-40c0-a42b-35a6e87c0728 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:56.788679 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-903eb023-c34a-40c0-a42b-35a6e87c0728 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: acc02ed3-5cf0-4fe4-b4d7-ac40fe691355] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:56.795487 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3b0c6093-e50c-48a7-b2b1-e2e600950ab9 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.775563 Sep 24 21:04:56.796672 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2069/4111] 10.222.0.52 () {60 vars in 1170 bytes} [Sat Sep 24 21:04:52 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:04:56.805397 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-1b24feef-8cc3-4a5e-b97a-cc0299f7c79c req-a5207d47-71ae-4aa9-80e2-fda9bee60bfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acc02ed3-5cf0-4fe4-b4d7-ac40fe691355", "name": "network-vif-deleted", "tag": "5c9ac72a-bbd8-424e-8720-bcc509cc437c"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:56.821201 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-903eb023-c34a-40c0-a42b-35a6e87c0728 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:56.823406 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-903eb023-c34a-40c0-a42b-35a6e87c0728 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:56.824284 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-903eb023-c34a-40c0-a42b-35a6e87c0728 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:56.826906 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-903eb023-c34a-40c0-a42b-35a6e87c0728 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:56.827383 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-903eb023-c34a-40c0-a42b-35a6e87c0728 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:56.827820 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-903eb023-c34a-40c0-a42b-35a6e87c0728 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:56.833010 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1b24feef-8cc3-4a5e-b97a-cc0299f7c79c req-a5207d47-71ae-4aa9-80e2-fda9bee60bfc service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:56.833998 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1b24feef-8cc3-4a5e-b97a-cc0299f7c79c req-a5207d47-71ae-4aa9-80e2-fda9bee60bfc service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:56.836739 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1b24feef-8cc3-4a5e-b97a-cc0299f7c79c req-a5207d47-71ae-4aa9-80e2-fda9bee60bfc service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:56.866982 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-1b24feef-8cc3-4a5e-b97a-cc0299f7c79c req-a5207d47-71ae-4aa9-80e2-fda9bee60bfc service nova] Creating event network-vif-deleted:5c9ac72a-bbd8-424e-8720-bcc509cc437c for instance acc02ed3-5cf0-4fe4-b4d7-ac40fe691355 on nch2-master-1 Sep 24 21:04:56.877626 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-1b24feef-8cc3-4a5e-b97a-cc0299f7c79c req-a5207d47-71ae-4aa9-80e2-fda9bee60bfc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078644 Sep 24 21:04:56.878940 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2070/4112] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:04:56.887357 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a21f2808-51b3-48cc-b4b5-a364cf895031 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.7.187"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:04:56.890628 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a21f2808-51b3-48cc-b4b5-a364cf895031 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:56.899353 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a21f2808-51b3-48cc-b4b5-a364cf895031 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:56.900046 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a21f2808-51b3-48cc-b4b5-a364cf895031 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:56.900865 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a21f2808-51b3-48cc-b4b5-a364cf895031 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:56.902948 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a21f2808-51b3-48cc-b4b5-a364cf895031 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:56.903589 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a21f2808-51b3-48cc-b4b5-a364cf895031 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:56.904195 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a21f2808-51b3-48cc-b4b5-a364cf895031 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:56.928623 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-903eb023-c34a-40c0-a42b-35a6e87c0728 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:56.931727 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-903eb023-c34a-40c0-a42b-35a6e87c0728 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:56.932941 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-903eb023-c34a-40c0-a42b-35a6e87c0728 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:56.933638 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-903eb023-c34a-40c0-a42b-35a6e87c0728 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lazy-loading 'fault' on Instance uuid acc02ed3-5cf0-4fe4-b4d7-ac40fe691355 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:04:56.936395 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a21f2808-51b3-48cc-b4b5-a364cf895031 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "refresh_cache-1b2e4ce4-809e-4888-8205-eae021e2fb8c" {{(pid=140516) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 24 21:04:56.936975 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a21f2808-51b3-48cc-b4b5-a364cf895031 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquired lock "refresh_cache-1b2e4ce4-809e-4888-8205-eae021e2fb8c" {{(pid=140516) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 24 21:04:57.150317 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-903eb023-c34a-40c0-a42b-35a6e87c0728 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb9430023d842b4a5d930e01f7340f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9bed43edcf4c5594ffde33282bc48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:57.172920 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-903eb023-c34a-40c0-a42b-35a6e87c0728 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/acc02ed3-5cf0-4fe4-b4d7-ac40fe691355" status: 200 len: 1311 microversion: 2.1 time: 0.389659 Sep 24 21:04:57.174253 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2043/4113] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:56 2022] GET /compute/v2.1/servers/acc02ed3-5cf0-4fe4-b4d7-ac40fe691355 => generated 1311 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:57.182523 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b60cea1c-27b0-4b02-9d48-56c684bcba07 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:57.183514 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b60cea1c-27b0-4b02-9d48-56c684bcba07 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 1f788a90-8f36-4262-957b-6d4e43e6568d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:57.192632 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b60cea1c-27b0-4b02-9d48-56c684bcba07 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:57.194473 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b60cea1c-27b0-4b02-9d48-56c684bcba07 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:57.195682 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b60cea1c-27b0-4b02-9d48-56c684bcba07 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:57.196982 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b60cea1c-27b0-4b02-9d48-56c684bcba07 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:57.197872 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b60cea1c-27b0-4b02-9d48-56c684bcba07 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:57.198908 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b60cea1c-27b0-4b02-9d48-56c684bcba07 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:57.676731 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b60cea1c-27b0-4b02-9d48-56c684bcba07 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:57.686015 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b60cea1c-27b0-4b02-9d48-56c684bcba07 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d" status: 200 len: 1515 microversion: 2.1 time: 0.510250 Sep 24 21:04:57.693793 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2044/4114] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:57 2022] GET /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d => generated 1515 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:57.811077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-99b507e8-03a3-437a-9601-a2e003578fa3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:57.813411 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-99b507e8-03a3-437a-9601-a2e003578fa3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 95dc95dc-ef74-4f92-9d5a-7e199fc802f5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:57.828943 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-99b507e8-03a3-437a-9601-a2e003578fa3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:57.829444 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-99b507e8-03a3-437a-9601-a2e003578fa3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:57.830191 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-99b507e8-03a3-437a-9601-a2e003578fa3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:57.830947 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-99b507e8-03a3-437a-9601-a2e003578fa3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:57.831410 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-99b507e8-03a3-437a-9601-a2e003578fa3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:57.832045 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-99b507e8-03a3-437a-9601-a2e003578fa3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:58.365678 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-99b507e8-03a3-437a-9601-a2e003578fa3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:58.379559 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-99b507e8-03a3-437a-9601-a2e003578fa3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5" status: 200 len: 1308 microversion: 2.1 time: 0.571445 Sep 24 21:04:58.380863 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2045/4115] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:57 2022] GET /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5 => generated 1308 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:04:58.387696 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-00ff59c2-0b51-4cfe-931b-ad067b787da7 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:58.389891 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-00ff59c2-0b51-4cfe-931b-ad067b787da7 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] [instance: acc02ed3-5cf0-4fe4-b4d7-ac40fe691355] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:58.398168 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00ff59c2-0b51-4cfe-931b-ad067b787da7 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:58.401036 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00ff59c2-0b51-4cfe-931b-ad067b787da7 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:58.401686 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00ff59c2-0b51-4cfe-931b-ad067b787da7 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:58.407314 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00ff59c2-0b51-4cfe-931b-ad067b787da7 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:58.408295 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00ff59c2-0b51-4cfe-931b-ad067b787da7 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:58.408914 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00ff59c2-0b51-4cfe-931b-ad067b787da7 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:58.424313 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-00ff59c2-0b51-4cfe-931b-ad067b787da7 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] HTTP exception thrown: Instance acc02ed3-5cf0-4fe4-b4d7-ac40fe691355 could not be found. Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-00ff59c2-0b51-4cfe-931b-ad067b787da7 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Request method failure captured: Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/acc02ed3-5cf0-4fe4-b4d7-ac40fe691355 HTTP/1.1 Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3CejOkEbEqme5Iu5NaNNYGxm_xyFOFmUSNFDPLyLevAaMpOaK2kD9jvX8gKBoGWjrZ4l9265-kGjEZEOFmEJCxuMoMRcw7FLPLvLOa4eFdrLfTFgk4mHHNpy9ceB5UPclIag2JcoR5KXK9iG6pPICQS8M2TNnyIAxR5hdIsUaQK52Y Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 3a9bed43edcf4c5594ffde33282bc48c Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1027624478 Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3a9bed43edcf4c5594ffde33282bc48c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3a9bed43edcf4c5594ffde33282bc48c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3a9bed43edcf4c5594ffde33282bc48c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3a9bed43edcf4c5594ffde33282bc48c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1027624478 Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 3a9bed43edcf4c5594ffde33282bc48c Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1027624478 Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServerRescueNegativeTestJSON-1027624478-project Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 5cb9430023d842b4a5d930e01f7340f3 Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1027624478-project Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance acc02ed3-5cf0-4fe4-b4d7-ac40fe691355 could not be found. Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'acc02ed3-5cf0-4fe4-b4d7-ac40fe691355'} Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acc02ed3-5cf0-4fe4-b4d7-ac40fe691355 could not be found. Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acc02ed3-5cf0-4fe4-b4d7-ac40fe691355 could not be found. Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:58.426327 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:04:58.432132 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:58.432132 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:04:58.432132 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:04:58.432132 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:04:58.432132 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:04:58.432132 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:04:58.432132 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acc02ed3-5cf0-4fe4-b4d7-ac40fe691355 could not be found. Sep 24 21:04:58.432132 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:04:58.433559 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-00ff59c2-0b51-4cfe-931b-ad067b787da7 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] Returning 404 to user: Instance acc02ed3-5cf0-4fe4-b4d7-ac40fe691355 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:04:58.434641 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-00ff59c2-0b51-4cfe-931b-ad067b787da7 tempest-ServerRescueNegativeTestJSON-1027624478 tempest-ServerRescueNegativeTestJSON-1027624478-project] 10.222.0.52 "GET /compute/v2.1/servers/acc02ed3-5cf0-4fe4-b4d7-ac40fe691355" status: 404 len: 111 microversion: 2.1 time: 0.052505 Sep 24 21:04:58.435683 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2046/4116] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:58 2022] GET /compute/v2.1/servers/acc02ed3-5cf0-4fe4-b4d7-ac40fe691355 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:04:58.709613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-425ecd30-7afb-41c1-a5c1-4ed1fc417949 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:58.710940 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-425ecd30-7afb-41c1-a5c1-4ed1fc417949 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 1f788a90-8f36-4262-957b-6d4e43e6568d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:58.721938 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-425ecd30-7afb-41c1-a5c1-4ed1fc417949 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:58.722392 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-425ecd30-7afb-41c1-a5c1-4ed1fc417949 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:58.724787 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-425ecd30-7afb-41c1-a5c1-4ed1fc417949 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:58.726204 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-425ecd30-7afb-41c1-a5c1-4ed1fc417949 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:58.726783 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-425ecd30-7afb-41c1-a5c1-4ed1fc417949 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:58.727395 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-425ecd30-7afb-41c1-a5c1-4ed1fc417949 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:59.441893 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-425ecd30-7afb-41c1-a5c1-4ed1fc417949 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:04:59.462064 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-425ecd30-7afb-41c1-a5c1-4ed1fc417949 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d" status: 200 len: 1515 microversion: 2.1 time: 0.756499 Sep 24 21:04:59.473459 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2047/4117] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:58 2022] GET /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d => generated 1515 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:04:59.478723 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-62d1aab7-4534-4174-94e9-0952437070f7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:04:59.491695 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-62d1aab7-4534-4174-94e9-0952437070f7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 95dc95dc-ef74-4f92-9d5a-7e199fc802f5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:04:59.512760 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62d1aab7-4534-4174-94e9-0952437070f7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:59.513926 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62d1aab7-4534-4174-94e9-0952437070f7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:59.514757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62d1aab7-4534-4174-94e9-0952437070f7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:59.519772 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62d1aab7-4534-4174-94e9-0952437070f7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:04:59.520269 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62d1aab7-4534-4174-94e9-0952437070f7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:04:59.520719 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62d1aab7-4534-4174-94e9-0952437070f7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:04:59.950321 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=10 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:05:00.139405 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-62d1aab7-4534-4174-94e9-0952437070f7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:00.149087 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-62d1aab7-4534-4174-94e9-0952437070f7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5" status: 200 len: 1308 microversion: 2.1 time: 0.675065 Sep 24 21:05:00.149656 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2048/4118] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:04:59 2022] GET /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5 => generated 1308 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:00.489148 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-184ed4e5-e670-47a1-83c2-dfe566e73f23 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:00.491242 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-184ed4e5-e670-47a1-83c2-dfe566e73f23 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 1f788a90-8f36-4262-957b-6d4e43e6568d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:00.503509 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-184ed4e5-e670-47a1-83c2-dfe566e73f23 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:00.504001 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-184ed4e5-e670-47a1-83c2-dfe566e73f23 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:00.504451 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-184ed4e5-e670-47a1-83c2-dfe566e73f23 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:00.505162 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-184ed4e5-e670-47a1-83c2-dfe566e73f23 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:00.505612 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-184ed4e5-e670-47a1-83c2-dfe566e73f23 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:00.506042 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-184ed4e5-e670-47a1-83c2-dfe566e73f23 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:00.984904 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-a21f2808-51b3-48cc-b4b5-a364cf895031 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Building network info cache for instance {{(pid=140516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 24 21:05:01.246735 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-184ed4e5-e670-47a1-83c2-dfe566e73f23 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:01.258424 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-184ed4e5-e670-47a1-83c2-dfe566e73f23 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d" status: 200 len: 1515 microversion: 2.1 time: 0.772491 Sep 24 21:05:01.260860 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2049/4119] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:00 2022] GET /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d => generated 1515 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:05:01.280479 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-2e14afce-2f11-43a2-b9d6-7e750e268301 req-13e406fd-e6d3-46f6-b30f-7795fa3174f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b2e4ce4-809e-4888-8205-eae021e2fb8c", "tag": "463ee47f-dd1b-4d52-b5e6-b06f1390b340"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:05:01.312590 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-2e14afce-2f11-43a2-b9d6-7e750e268301 req-13e406fd-e6d3-46f6-b30f-7795fa3174f2 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:01.315571 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-2e14afce-2f11-43a2-b9d6-7e750e268301 req-13e406fd-e6d3-46f6-b30f-7795fa3174f2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:01.317668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-2e14afce-2f11-43a2-b9d6-7e750e268301 req-13e406fd-e6d3-46f6-b30f-7795fa3174f2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:01.345045 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-2e14afce-2f11-43a2-b9d6-7e750e268301 req-13e406fd-e6d3-46f6-b30f-7795fa3174f2 service nova] Creating event network-changed:463ee47f-dd1b-4d52-b5e6-b06f1390b340 for instance 1b2e4ce4-809e-4888-8205-eae021e2fb8c on nch1-master-1 Sep 24 21:05:01.384136 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-2e14afce-2f11-43a2-b9d6-7e750e268301 req-13e406fd-e6d3-46f6-b30f-7795fa3174f2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121372 Sep 24 21:05:01.389073 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2050/4120] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:05:01.425948 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8b97e621-3b6b-4451-abcb-71e5d90a9ad5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:01.427298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8b97e621-3b6b-4451-abcb-71e5d90a9ad5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 95dc95dc-ef74-4f92-9d5a-7e199fc802f5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:01.453893 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8b97e621-3b6b-4451-abcb-71e5d90a9ad5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:01.454409 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8b97e621-3b6b-4451-abcb-71e5d90a9ad5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:01.469294 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8b97e621-3b6b-4451-abcb-71e5d90a9ad5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:01.471975 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8b97e621-3b6b-4451-abcb-71e5d90a9ad5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:01.473324 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8b97e621-3b6b-4451-abcb-71e5d90a9ad5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:01.475314 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8b97e621-3b6b-4451-abcb-71e5d90a9ad5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:01.801383 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=12 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:05:01.994853 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8b97e621-3b6b-4451-abcb-71e5d90a9ad5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:02.006175 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8b97e621-3b6b-4451-abcb-71e5d90a9ad5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5" status: 200 len: 1308 microversion: 2.1 time: 0.615235 Sep 24 21:05:02.007747 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2051/4121] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:01 2022] GET /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5 => generated 1308 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:02.290555 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8e073b51-4e59-486f-a235-d33e8892fbe7 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:02.291960 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8e073b51-4e59-486f-a235-d33e8892fbe7 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 1f788a90-8f36-4262-957b-6d4e43e6568d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:02.308660 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8e073b51-4e59-486f-a235-d33e8892fbe7 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:02.309458 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8e073b51-4e59-486f-a235-d33e8892fbe7 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:02.310131 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8e073b51-4e59-486f-a235-d33e8892fbe7 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:02.311148 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8e073b51-4e59-486f-a235-d33e8892fbe7 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:02.312488 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8e073b51-4e59-486f-a235-d33e8892fbe7 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:02.313153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8e073b51-4e59-486f-a235-d33e8892fbe7 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:02.403122 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8e073b51-4e59-486f-a235-d33e8892fbe7 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:02.404042 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8e073b51-4e59-486f-a235-d33e8892fbe7 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:02.406234 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8e073b51-4e59-486f-a235-d33e8892fbe7 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:02.410051 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-8e073b51-4e59-486f-a235-d33e8892fbe7 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lazy-loading 'fault' on Instance uuid 1f788a90-8f36-4262-957b-6d4e43e6568d {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:05:02.721157 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8e073b51-4e59-486f-a235-d33e8892fbe7 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:02.735222 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8e073b51-4e59-486f-a235-d33e8892fbe7 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d" status: 200 len: 1310 microversion: 2.1 time: 0.447952 Sep 24 21:05:02.737530 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2052/4122] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:02 2022] GET /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d => generated 1310 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:05:02.761320 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-314e6edf-870f-45ac-8928-fab7f031ba04 req-19f8c49d-9aed-40d2-8e64-77a88653bb3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95dc95dc-ef74-4f92-9d5a-7e199fc802f5", "name": "network-vif-plugged", "status": "completed", "tag": "2bbb1b2e-5192-48be-a4f8-0c1cb200c21c"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:05:02.792883 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-314e6edf-870f-45ac-8928-fab7f031ba04 req-19f8c49d-9aed-40d2-8e64-77a88653bb3d service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:02.793384 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-314e6edf-870f-45ac-8928-fab7f031ba04 req-19f8c49d-9aed-40d2-8e64-77a88653bb3d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:02.793825 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-314e6edf-870f-45ac-8928-fab7f031ba04 req-19f8c49d-9aed-40d2-8e64-77a88653bb3d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:02.812300 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-314e6edf-870f-45ac-8928-fab7f031ba04 req-19f8c49d-9aed-40d2-8e64-77a88653bb3d service nova] Creating event network-vif-plugged:2bbb1b2e-5192-48be-a4f8-0c1cb200c21c for instance 95dc95dc-ef74-4f92-9d5a-7e199fc802f5 on nch1-master-1 Sep 24 21:05:02.824192 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-314e6edf-870f-45ac-8928-fab7f031ba04 req-19f8c49d-9aed-40d2-8e64-77a88653bb3d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083719 Sep 24 21:05:02.831358 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2053/4123] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:05:03.036325 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dd3bf1f6-8366-4209-839f-bb49f1cadfd9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:03.037037 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dd3bf1f6-8366-4209-839f-bb49f1cadfd9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 95dc95dc-ef74-4f92-9d5a-7e199fc802f5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:03.051174 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dd3bf1f6-8366-4209-839f-bb49f1cadfd9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:03.058486 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dd3bf1f6-8366-4209-839f-bb49f1cadfd9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:03.059312 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dd3bf1f6-8366-4209-839f-bb49f1cadfd9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:03.060332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dd3bf1f6-8366-4209-839f-bb49f1cadfd9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:03.061131 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dd3bf1f6-8366-4209-839f-bb49f1cadfd9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:03.061805 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dd3bf1f6-8366-4209-839f-bb49f1cadfd9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:03.391480 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-a21f2808-51b3-48cc-b4b5-a364cf895031 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Updating instance_info_cache with network_info: [{"id": "463ee47f-dd1b-4d52-b5e6-b06f1390b340", "address": "fa:16:3e:ef:37:a5", "network": {"id": "f57270ba-c8fc-413a-afb1-57748c185953", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-6414712-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.7.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7309c3d3d7e542b1a000490468edec55", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap463ee47f-dd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 24 21:05:03.415095 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a21f2808-51b3-48cc-b4b5-a364cf895031 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Releasing lock "refresh_cache-1b2e4ce4-809e-4888-8205-eae021e2fb8c" {{(pid=140516) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 24 21:05:03.417408 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a21f2808-51b3-48cc-b4b5-a364cf895031 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "POST /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c/action" status: 202 len: 0 microversion: 2.1 time: 6.535586 Sep 24 21:05:03.423333 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2071/4124] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:04:56 2022] POST /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c/action => generated 0 bytes in 6543 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 24 21:05:03.430232 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-59bdea82-52a0-4913-b628-0d879cd3a9b3 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.7.187"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:05:03.826334 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dd3bf1f6-8366-4209-839f-bb49f1cadfd9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:03.883068 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dd3bf1f6-8366-4209-839f-bb49f1cadfd9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5" status: 200 len: 1308 microversion: 2.1 time: 0.846674 Sep 24 21:05:03.890139 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2054/4125] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:03 2022] GET /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5 => generated 1308 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:03.915564 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-7cdc84bf-3d16-4041-bd05-aac687742c01 req-f4b0a831-ef00-44f6-a678-ce2370b428e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f788a90-8f36-4262-957b-6d4e43e6568d", "name": "network-vif-deleted", "tag": "0e66214c-049f-4d06-931d-a3ff744e01ae"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:05:03.941982 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-59bdea82-52a0-4913-b628-0d879cd3a9b3 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:03.950447 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-59bdea82-52a0-4913-b628-0d879cd3a9b3 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:03.951223 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-59bdea82-52a0-4913-b628-0d879cd3a9b3 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:03.952588 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-59bdea82-52a0-4913-b628-0d879cd3a9b3 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:03.960858 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-7cdc84bf-3d16-4041-bd05-aac687742c01 req-f4b0a831-ef00-44f6-a678-ce2370b428e6 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:03.963517 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-59bdea82-52a0-4913-b628-0d879cd3a9b3 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:03.964016 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-59bdea82-52a0-4913-b628-0d879cd3a9b3 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:03.964175 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-7cdc84bf-3d16-4041-bd05-aac687742c01 req-f4b0a831-ef00-44f6-a678-ce2370b428e6 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:03.964625 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-7cdc84bf-3d16-4041-bd05-aac687742c01 req-f4b0a831-ef00-44f6-a678-ce2370b428e6 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:03.969105 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-59bdea82-52a0-4913-b628-0d879cd3a9b3 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:04.001353 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-7cdc84bf-3d16-4041-bd05-aac687742c01 req-f4b0a831-ef00-44f6-a678-ce2370b428e6 service nova] Creating event network-vif-deleted:0e66214c-049f-4d06-931d-a3ff744e01ae for instance 1f788a90-8f36-4262-957b-6d4e43e6568d on nch1-master-1 Sep 24 21:05:04.009366 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-7cdc84bf-3d16-4041-bd05-aac687742c01 req-f4b0a831-ef00-44f6-a678-ce2370b428e6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114611 Sep 24 21:05:04.010902 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2055/4126] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:05:04.029820 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1645f277-c2d4-491d-bf6d-9ff01c3d4020 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:04.031529 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1645f277-c2d4-491d-bf6d-9ff01c3d4020 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 1f788a90-8f36-4262-957b-6d4e43e6568d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:04.049885 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1645f277-c2d4-491d-bf6d-9ff01c3d4020 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:04.053353 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1645f277-c2d4-491d-bf6d-9ff01c3d4020 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:04.077050 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1645f277-c2d4-491d-bf6d-9ff01c3d4020 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:04.079594 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1645f277-c2d4-491d-bf6d-9ff01c3d4020 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:04.080761 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1645f277-c2d4-491d-bf6d-9ff01c3d4020 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:04.085680 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1645f277-c2d4-491d-bf6d-9ff01c3d4020 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:04.113677 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-1645f277-c2d4-491d-bf6d-9ff01c3d4020 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] HTTP exception thrown: Instance 1f788a90-8f36-4262-957b-6d4e43e6568d could not be found. Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1645f277-c2d4-491d-bf6d-9ff01c3d4020 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Request method failure captured: Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d HTTP/1.1 Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3C6Gfkvywn-r9ntg78NR5l27PA-mik9Pm7PcYTPFewLTSAms76NSRIZ6Ctpy8u0RFHQNDUIjkf_WOu3PAxqzYzH2KvGfx0I2dCsnvBNaJ5stDoVnlNuRslHrC9gxTPsHznJq7BQkv61k7iPpKGxg-iOML4pXo-FGeSWDB9lDyto8k0 Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 6b7f252278c74e2d84de081cd3d5a69e Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ListServerFiltersTestJSON-609227914 Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6b7f252278c74e2d84de081cd3d5a69e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6b7f252278c74e2d84de081cd3d5a69e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6b7f252278c74e2d84de081cd3d5a69e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6b7f252278c74e2d84de081cd3d5a69e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ListServerFiltersTestJSON-609227914 Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 6b7f252278c74e2d84de081cd3d5a69e Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-609227914 Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ListServerFiltersTestJSON-609227914-project Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: dad0b98fdcf145a1960121573524940d Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ListServerFiltersTestJSON-609227914-project Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 1f788a90-8f36-4262-957b-6d4e43e6568d could not be found. Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '1f788a90-8f36-4262-957b-6d4e43e6568d'} Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f788a90-8f36-4262-957b-6d4e43e6568d could not be found. Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f788a90-8f36-4262-957b-6d4e43e6568d could not be found. Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:05:04.117151 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:05:04.123241 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:05:04.123241 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:05:04.123241 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:05:04.123241 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:05:04.123241 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:05:04.123241 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f788a90-8f36-4262-957b-6d4e43e6568d could not be found. Sep 24 21:05:04.123241 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:05:04.125700 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1645f277-c2d4-491d-bf6d-9ff01c3d4020 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Returning 404 to user: Instance 1f788a90-8f36-4262-957b-6d4e43e6568d could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:05:04.126929 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1645f277-c2d4-491d-bf6d-9ff01c3d4020 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d" status: 404 len: 111 microversion: 2.1 time: 0.114671 Sep 24 21:05:04.127714 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2056/4127] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:04 2022] GET /compute/v2.1/servers/1f788a90-8f36-4262-957b-6d4e43e6568d => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:05:04.138706 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-18c39104-dbf0-4c16-8cf5-0efba47c09be tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:04.139402 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-18c39104-dbf0-4c16-8cf5-0efba47c09be tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 275263e1-8a0a-4f58-b863-b56c2bf3a7c0] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:04.161821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-18c39104-dbf0-4c16-8cf5-0efba47c09be tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:04.162656 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-18c39104-dbf0-4c16-8cf5-0efba47c09be tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:04.163519 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-18c39104-dbf0-4c16-8cf5-0efba47c09be tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:04.164519 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-18c39104-dbf0-4c16-8cf5-0efba47c09be tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:04.166161 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-18c39104-dbf0-4c16-8cf5-0efba47c09be tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:04.167278 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-18c39104-dbf0-4c16-8cf5-0efba47c09be tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:04.199520 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:05:04.208650 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-18c39104-dbf0-4c16-8cf5-0efba47c09be tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 275263e1-8a0a-4f58-b863-b56c2bf3a7c0] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:05:04.387628 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-18c39104-dbf0-4c16-8cf5-0efba47c09be tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "DELETE /compute/v2.1/servers/275263e1-8a0a-4f58-b863-b56c2bf3a7c0" status: 204 len: 0 microversion: 2.1 time: 0.254379 Sep 24 21:05:04.388664 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2057/4128] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:05:04 2022] DELETE /compute/v2.1/servers/275263e1-8a0a-4f58-b863-b56c2bf3a7c0 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:05:04.402862 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3005c2b3-74ea-4719-9229-361457ff9285 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:04.404989 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3005c2b3-74ea-4719-9229-361457ff9285 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 275263e1-8a0a-4f58-b863-b56c2bf3a7c0] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:04.456845 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3005c2b3-74ea-4719-9229-361457ff9285 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:04.458868 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3005c2b3-74ea-4719-9229-361457ff9285 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:04.459888 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3005c2b3-74ea-4719-9229-361457ff9285 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:04.462326 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3005c2b3-74ea-4719-9229-361457ff9285 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:04.465150 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3005c2b3-74ea-4719-9229-361457ff9285 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:04.483655 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3005c2b3-74ea-4719-9229-361457ff9285 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:04.578331 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-59bdea82-52a0-4913-b628-0d879cd3a9b3 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "refresh_cache-1b2e4ce4-809e-4888-8205-eae021e2fb8c" {{(pid=140516) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 24 21:05:04.578891 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-59bdea82-52a0-4913-b628-0d879cd3a9b3 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquired lock "refresh_cache-1b2e4ce4-809e-4888-8205-eae021e2fb8c" {{(pid=140516) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 24 21:05:05.046070 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3005c2b3-74ea-4719-9229-361457ff9285 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:05.056910 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3005c2b3-74ea-4719-9229-361457ff9285 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/275263e1-8a0a-4f58-b863-b56c2bf3a7c0" status: 200 len: 1515 microversion: 2.1 time: 0.663697 Sep 24 21:05:05.061958 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2058/4129] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:04 2022] GET /compute/v2.1/servers/275263e1-8a0a-4f58-b863-b56c2bf3a7c0 => generated 1515 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:05:05.066918 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0d528f54-487c-4ff2-9df3-4bdde97f665b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:05.072663 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0d528f54-487c-4ff2-9df3-4bdde97f665b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 95dc95dc-ef74-4f92-9d5a-7e199fc802f5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:05.089913 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d528f54-487c-4ff2-9df3-4bdde97f665b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:05.090445 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d528f54-487c-4ff2-9df3-4bdde97f665b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:05.091158 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d528f54-487c-4ff2-9df3-4bdde97f665b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:05.092126 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d528f54-487c-4ff2-9df3-4bdde97f665b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:05.092772 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d528f54-487c-4ff2-9df3-4bdde97f665b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:05.094708 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d528f54-487c-4ff2-9df3-4bdde97f665b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:05.107325 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=8 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:05:06.537026 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0d528f54-487c-4ff2-9df3-4bdde97f665b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:06.550743 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0d528f54-487c-4ff2-9df3-4bdde97f665b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5" status: 200 len: 1308 microversion: 2.1 time: 1.487530 Sep 24 21:05:06.551851 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2059/4130] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:05 2022] GET /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5 => generated 1308 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:06.563318 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-90a10124-d040-41af-b143-8322f04aff2a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:06.564490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-90a10124-d040-41af-b143-8322f04aff2a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 275263e1-8a0a-4f58-b863-b56c2bf3a7c0] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:06.573486 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-90a10124-d040-41af-b143-8322f04aff2a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:06.575217 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-90a10124-d040-41af-b143-8322f04aff2a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:06.576735 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-90a10124-d040-41af-b143-8322f04aff2a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:06.577861 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-90a10124-d040-41af-b143-8322f04aff2a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:06.579781 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-90a10124-d040-41af-b143-8322f04aff2a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:06.580519 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-90a10124-d040-41af-b143-8322f04aff2a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:07.038685 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-90a10124-d040-41af-b143-8322f04aff2a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:07.070481 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-90a10124-d040-41af-b143-8322f04aff2a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/275263e1-8a0a-4f58-b863-b56c2bf3a7c0" status: 200 len: 1515 microversion: 2.1 time: 0.515880 Sep 24 21:05:07.071207 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2060/4131] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:06 2022] GET /compute/v2.1/servers/275263e1-8a0a-4f58-b863-b56c2bf3a7c0 => generated 1515 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:07.128161 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-59bdea82-52a0-4913-b628-0d879cd3a9b3 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Building network info cache for instance {{(pid=140516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 24 21:05:07.143360 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-102e9038-1bb6-4dea-bf80-2cc4eddf09b0 req-291255bf-e0b9-43e6-b185-5eb52966bbc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b2e4ce4-809e-4888-8205-eae021e2fb8c", "tag": "463ee47f-dd1b-4d52-b5e6-b06f1390b340"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:05:07.158272 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-102e9038-1bb6-4dea-bf80-2cc4eddf09b0 req-291255bf-e0b9-43e6-b185-5eb52966bbc2 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:07.159146 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-102e9038-1bb6-4dea-bf80-2cc4eddf09b0 req-291255bf-e0b9-43e6-b185-5eb52966bbc2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:07.159777 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-102e9038-1bb6-4dea-bf80-2cc4eddf09b0 req-291255bf-e0b9-43e6-b185-5eb52966bbc2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:07.179015 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-102e9038-1bb6-4dea-bf80-2cc4eddf09b0 req-291255bf-e0b9-43e6-b185-5eb52966bbc2 service nova] Creating event network-changed:463ee47f-dd1b-4d52-b5e6-b06f1390b340 for instance 1b2e4ce4-809e-4888-8205-eae021e2fb8c on nch1-master-1 Sep 24 21:05:07.186234 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-102e9038-1bb6-4dea-bf80-2cc4eddf09b0 req-291255bf-e0b9-43e6-b185-5eb52966bbc2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046680 Sep 24 21:05:07.190075 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2061/4132] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:05:07.575737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9c811731-ed28-4891-88e7-3561f62a83a5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:07.576440 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9c811731-ed28-4891-88e7-3561f62a83a5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 95dc95dc-ef74-4f92-9d5a-7e199fc802f5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:07.591812 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c811731-ed28-4891-88e7-3561f62a83a5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:07.593674 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c811731-ed28-4891-88e7-3561f62a83a5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:07.598613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c811731-ed28-4891-88e7-3561f62a83a5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:07.600728 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c811731-ed28-4891-88e7-3561f62a83a5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:07.601778 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c811731-ed28-4891-88e7-3561f62a83a5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:07.602490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c811731-ed28-4891-88e7-3561f62a83a5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:08.674475 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9c811731-ed28-4891-88e7-3561f62a83a5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:08.688972 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9c811731-ed28-4891-88e7-3561f62a83a5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5" status: 200 len: 1490 microversion: 2.1 time: 1.116478 Sep 24 21:05:08.690994 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2062/4133] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:07 2022] GET /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5 => generated 1490 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:08.702997 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-27286bbf-417d-42db-9d79-be5bf7239e9e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:08.707111 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-27286bbf-417d-42db-9d79-be5bf7239e9e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 275263e1-8a0a-4f58-b863-b56c2bf3a7c0] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:08.721919 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27286bbf-417d-42db-9d79-be5bf7239e9e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:08.725005 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27286bbf-417d-42db-9d79-be5bf7239e9e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:08.727207 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27286bbf-417d-42db-9d79-be5bf7239e9e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:08.728275 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27286bbf-417d-42db-9d79-be5bf7239e9e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:08.731291 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27286bbf-417d-42db-9d79-be5bf7239e9e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:08.732048 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27286bbf-417d-42db-9d79-be5bf7239e9e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:08.838538 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:05:08.843718 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27286bbf-417d-42db-9d79-be5bf7239e9e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:08.847721 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27286bbf-417d-42db-9d79-be5bf7239e9e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:08.848353 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-27286bbf-417d-42db-9d79-be5bf7239e9e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:08.853661 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-27286bbf-417d-42db-9d79-be5bf7239e9e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lazy-loading 'fault' on Instance uuid 275263e1-8a0a-4f58-b863-b56c2bf3a7c0 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:05:09.598338 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-27286bbf-417d-42db-9d79-be5bf7239e9e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:09.611644 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-27286bbf-417d-42db-9d79-be5bf7239e9e tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/275263e1-8a0a-4f58-b863-b56c2bf3a7c0" status: 200 len: 1310 microversion: 2.1 time: 0.916673 Sep 24 21:05:09.646665 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2063/4134] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:08 2022] GET /compute/v2.1/servers/275263e1-8a0a-4f58-b863-b56c2bf3a7c0 => generated 1310 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:09.655276 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-38f640d5-0dec-4d8c-aee9-65ea8e30e8b5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:09.655894 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-38f640d5-0dec-4d8c-aee9-65ea8e30e8b5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ca4c8bfe-e06d-427f-85fb-1d2729572b07] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:09.670059 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38f640d5-0dec-4d8c-aee9-65ea8e30e8b5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:09.670523 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38f640d5-0dec-4d8c-aee9-65ea8e30e8b5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:09.671897 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38f640d5-0dec-4d8c-aee9-65ea8e30e8b5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:09.672635 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38f640d5-0dec-4d8c-aee9-65ea8e30e8b5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:09.673101 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38f640d5-0dec-4d8c-aee9-65ea8e30e8b5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:09.673534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38f640d5-0dec-4d8c-aee9-65ea8e30e8b5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:10.382604 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-38f640d5-0dec-4d8c-aee9-65ea8e30e8b5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:10.396300 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-38f640d5-0dec-4d8c-aee9-65ea8e30e8b5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07" status: 200 len: 1489 microversion: 2.1 time: 0.747840 Sep 24 21:05:10.413703 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2064/4135] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:09 2022] GET /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07 => generated 1489 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:10.426088 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-7fa6a0dc-a4a4-46fb-8f83-36ad7f4278bd req-04d3a05d-c09d-43d9-9c32-eec55bd7545b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "275263e1-8a0a-4f58-b863-b56c2bf3a7c0", "name": "network-vif-deleted", "tag": "8fb22600-0f74-4477-87fa-054ddb7fc0af"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:05:10.465137 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-7fa6a0dc-a4a4-46fb-8f83-36ad7f4278bd req-04d3a05d-c09d-43d9-9c32-eec55bd7545b service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:10.465633 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-7fa6a0dc-a4a4-46fb-8f83-36ad7f4278bd req-04d3a05d-c09d-43d9-9c32-eec55bd7545b service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:10.466080 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-7fa6a0dc-a4a4-46fb-8f83-36ad7f4278bd req-04d3a05d-c09d-43d9-9c32-eec55bd7545b service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:10.511297 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-7fa6a0dc-a4a4-46fb-8f83-36ad7f4278bd req-04d3a05d-c09d-43d9-9c32-eec55bd7545b service nova] Creating event network-vif-deleted:8fb22600-0f74-4477-87fa-054ddb7fc0af for instance 275263e1-8a0a-4f58-b863-b56c2bf3a7c0 on nch1-master-1 Sep 24 21:05:10.526336 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-7fa6a0dc-a4a4-46fb-8f83-36ad7f4278bd req-04d3a05d-c09d-43d9-9c32-eec55bd7545b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107352 Sep 24 21:05:10.526986 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2065/4136] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:05:10.532470 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e6ceffb5-f74b-4f2e-bdae-ca9af82b35cc tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:10.533664 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e6ceffb5-f74b-4f2e-bdae-ca9af82b35cc tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 95dc95dc-ef74-4f92-9d5a-7e199fc802f5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:10.542116 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6ceffb5-f74b-4f2e-bdae-ca9af82b35cc tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:10.543115 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6ceffb5-f74b-4f2e-bdae-ca9af82b35cc tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:10.543730 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6ceffb5-f74b-4f2e-bdae-ca9af82b35cc tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:10.544625 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6ceffb5-f74b-4f2e-bdae-ca9af82b35cc tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:10.545654 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6ceffb5-f74b-4f2e-bdae-ca9af82b35cc tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:10.546265 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6ceffb5-f74b-4f2e-bdae-ca9af82b35cc tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:10.768287 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-59bdea82-52a0-4913-b628-0d879cd3a9b3 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Updating instance_info_cache with network_info: [{"id": "463ee47f-dd1b-4d52-b5e6-b06f1390b340", "address": "fa:16:3e:ef:37:a5", "network": {"id": "f57270ba-c8fc-413a-afb1-57748c185953", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-6414712-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7309c3d3d7e542b1a000490468edec55", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap463ee47f-dd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 24 21:05:10.786366 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=1,nova_cell1:RELEASE=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:05:10.794891 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-59bdea82-52a0-4913-b628-0d879cd3a9b3 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Releasing lock "refresh_cache-1b2e4ce4-809e-4888-8205-eae021e2fb8c" {{(pid=140516) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 24 21:05:10.795798 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-59bdea82-52a0-4913-b628-0d879cd3a9b3 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "POST /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c/action" status: 202 len: 0 microversion: 2.1 time: 7.371101 Sep 24 21:05:10.796421 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2072/4137] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:05:03 2022] POST /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c/action => generated 0 bytes in 7372 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 24 21:05:10.810948 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8e6182bc-6ecb-42bb-9c2f-c86b812b846c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:10.827020 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8e6182bc-6ecb-42bb-9c2f-c86b812b846c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 275263e1-8a0a-4f58-b863-b56c2bf3a7c0] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:10.848488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8e6182bc-6ecb-42bb-9c2f-c86b812b846c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:10.848994 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8e6182bc-6ecb-42bb-9c2f-c86b812b846c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:10.849443 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8e6182bc-6ecb-42bb-9c2f-c86b812b846c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:10.850860 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8e6182bc-6ecb-42bb-9c2f-c86b812b846c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:10.851370 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8e6182bc-6ecb-42bb-9c2f-c86b812b846c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:10.851899 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8e6182bc-6ecb-42bb-9c2f-c86b812b846c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:10.871485 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-8e6182bc-6ecb-42bb-9c2f-c86b812b846c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] HTTP exception thrown: Instance 275263e1-8a0a-4f58-b863-b56c2bf3a7c0 could not be found. Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8e6182bc-6ecb-42bb-9c2f-c86b812b846c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Request method failure captured: Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/275263e1-8a0a-4f58-b863-b56c2bf3a7c0 HTTP/1.1 Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3C6Gfkvywn-r9ntg78NR5l27PA-mik9Pm7PcYTPFewLTSAms76NSRIZ6Ctpy8u0RFHQNDUIjkf_WOu3PAxqzYzH2KvGfx0I2dCsnvBNaJ5stDoVnlNuRslHrC9gxTPsHznJq7BQkv61k7iPpKGxg-iOML4pXo-FGeSWDB9lDyto8k0 Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 6b7f252278c74e2d84de081cd3d5a69e Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ListServerFiltersTestJSON-609227914 Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6b7f252278c74e2d84de081cd3d5a69e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6b7f252278c74e2d84de081cd3d5a69e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6b7f252278c74e2d84de081cd3d5a69e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6b7f252278c74e2d84de081cd3d5a69e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ListServerFiltersTestJSON-609227914 Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 6b7f252278c74e2d84de081cd3d5a69e Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-609227914 Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ListServerFiltersTestJSON-609227914-project Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: dad0b98fdcf145a1960121573524940d Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ListServerFiltersTestJSON-609227914-project Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 275263e1-8a0a-4f58-b863-b56c2bf3a7c0 could not be found. Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '275263e1-8a0a-4f58-b863-b56c2bf3a7c0'} Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 275263e1-8a0a-4f58-b863-b56c2bf3a7c0 could not be found. Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 275263e1-8a0a-4f58-b863-b56c2bf3a7c0 could not be found. Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:05:10.873149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:05:10.878583 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:05:10.878583 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:05:10.878583 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:05:10.878583 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:05:10.878583 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:05:10.878583 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 275263e1-8a0a-4f58-b863-b56c2bf3a7c0 could not be found. Sep 24 21:05:10.878583 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:05:10.878583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8e6182bc-6ecb-42bb-9c2f-c86b812b846c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Returning 404 to user: Instance 275263e1-8a0a-4f58-b863-b56c2bf3a7c0 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:05:10.878583 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8e6182bc-6ecb-42bb-9c2f-c86b812b846c tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/275263e1-8a0a-4f58-b863-b56c2bf3a7c0" status: 404 len: 111 microversion: 2.1 time: 0.078707 Sep 24 21:05:10.880552 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2073/4138] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:10 2022] GET /compute/v2.1/servers/275263e1-8a0a-4f58-b863-b56c2bf3a7c0 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:05:10.885438 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1291579c-b29f-4743-a4e5-10b7f66da210 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '.version_select at 0x7f4b0770edc0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:11.052507 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e6ceffb5-f74b-4f2e-bdae-ca9af82b35cc tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:11.061022 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e6ceffb5-f74b-4f2e-bdae-ca9af82b35cc tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5" status: 200 len: 1490 microversion: 2.1 time: 0.532553 Sep 24 21:05:11.062823 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2066/4139] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:10 2022] GET /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5 => generated 1490 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:11.071009 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2d95488e-6274-4230-b2ca-cffc34f8f6d2 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:11.073202 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2d95488e-6274-4230-b2ca-cffc34f8f6d2 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 06ef44f5-3eae-4780-b544-62102fd945a7] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:11.097942 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d95488e-6274-4230-b2ca-cffc34f8f6d2 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:11.101865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d95488e-6274-4230-b2ca-cffc34f8f6d2 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:11.104124 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d95488e-6274-4230-b2ca-cffc34f8f6d2 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:11.114362 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d95488e-6274-4230-b2ca-cffc34f8f6d2 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:11.115081 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d95488e-6274-4230-b2ca-cffc34f8f6d2 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:11.116423 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d95488e-6274-4230-b2ca-cffc34f8f6d2 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:11.149596 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2d95488e-6274-4230-b2ca-cffc34f8f6d2 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 06ef44f5-3eae-4780-b544-62102fd945a7] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:05:11.320406 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2d95488e-6274-4230-b2ca-cffc34f8f6d2 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "DELETE /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7" status: 204 len: 0 microversion: 2.1 time: 0.243710 Sep 24 21:05:11.324209 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2067/4140] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:05:11 2022] DELETE /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:05:11.337457 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e1c97ebd-ccc3-4365-aeeb-f39fbc2044bc tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:11.338457 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e1c97ebd-ccc3-4365-aeeb-f39fbc2044bc tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 95dc95dc-ef74-4f92-9d5a-7e199fc802f5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:11.373004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1c97ebd-ccc3-4365-aeeb-f39fbc2044bc tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:11.373971 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1c97ebd-ccc3-4365-aeeb-f39fbc2044bc tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:11.375633 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1c97ebd-ccc3-4365-aeeb-f39fbc2044bc tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:11.378610 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1c97ebd-ccc3-4365-aeeb-f39fbc2044bc tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:11.381494 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1c97ebd-ccc3-4365-aeeb-f39fbc2044bc tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:11.382382 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1c97ebd-ccc3-4365-aeeb-f39fbc2044bc tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:11.433516 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e1c97ebd-ccc3-4365-aeeb-f39fbc2044bc tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 95dc95dc-ef74-4f92-9d5a-7e199fc802f5] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:05:11.673010 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e1c97ebd-ccc3-4365-aeeb-f39fbc2044bc tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "DELETE /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5" status: 204 len: 0 microversion: 2.1 time: 0.346798 Sep 24 21:05:11.673892 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2068/4141] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:05:11 2022] DELETE /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:05:11.697276 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-670c78e4-9150-435f-8a3b-583c186e245f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:11.698404 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-670c78e4-9150-435f-8a3b-583c186e245f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 06ef44f5-3eae-4780-b544-62102fd945a7] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:11.712193 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-670c78e4-9150-435f-8a3b-583c186e245f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:11.712831 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-670c78e4-9150-435f-8a3b-583c186e245f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:11.714019 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-670c78e4-9150-435f-8a3b-583c186e245f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:11.717218 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-670c78e4-9150-435f-8a3b-583c186e245f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:11.717728 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-670c78e4-9150-435f-8a3b-583c186e245f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:11.718240 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-670c78e4-9150-435f-8a3b-583c186e245f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:12.187043 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-670c78e4-9150-435f-8a3b-583c186e245f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:12.200039 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-670c78e4-9150-435f-8a3b-583c186e245f tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7" status: 200 len: 1515 microversion: 2.1 time: 0.524369 Sep 24 21:05:12.211560 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2069/4142] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:11 2022] GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7 => generated 1515 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:12.211560 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ba7b319a-99ef-429f-8825-833c9229a40e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:12.211560 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ba7b319a-99ef-429f-8825-833c9229a40e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 95dc95dc-ef74-4f92-9d5a-7e199fc802f5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:12.239429 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ba7b319a-99ef-429f-8825-833c9229a40e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:12.239946 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ba7b319a-99ef-429f-8825-833c9229a40e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:12.240398 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ba7b319a-99ef-429f-8825-833c9229a40e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:12.241179 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ba7b319a-99ef-429f-8825-833c9229a40e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:12.241645 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ba7b319a-99ef-429f-8825-833c9229a40e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:12.242079 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ba7b319a-99ef-429f-8825-833c9229a40e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:12.245158 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:05:12.821286 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ba7b319a-99ef-429f-8825-833c9229a40e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:12.830325 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ba7b319a-99ef-429f-8825-833c9229a40e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5" status: 200 len: 1496 microversion: 2.1 time: 0.628292 Sep 24 21:05:12.844815 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2070/4143] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:12 2022] GET /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5 => generated 1496 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:13.203825 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1291579c-b29f-4743-a4e5-10b7f66da210 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/68f0fa42-8fd6-4257-8245-b3242c55b83b" status: 202 len: 0 microversion: 2.1 time: 2.322296 Sep 24 21:05:13.204466 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2074/4144] 10.222.0.52 () {58 vars in 1263 bytes} [Sat Sep 24 21:05:10 2022] DELETE /compute/v2.1/os-floating-ips/68f0fa42-8fd6-4257-8245-b3242c55b83b => generated 0 bytes in 2324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:05:13.214115 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1862ede5-af98-4383-a1fd-ed579b92a372 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '.version_select at 0x7f4b0c957c10>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:13.228349 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-759c947e-e10c-465d-87e2-ae0ec7270e05 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:13.228983 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-759c947e-e10c-465d-87e2-ae0ec7270e05 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 06ef44f5-3eae-4780-b544-62102fd945a7] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:13.241100 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-759c947e-e10c-465d-87e2-ae0ec7270e05 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:13.242066 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-759c947e-e10c-465d-87e2-ae0ec7270e05 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:13.242557 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-759c947e-e10c-465d-87e2-ae0ec7270e05 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:13.243309 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-759c947e-e10c-465d-87e2-ae0ec7270e05 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:13.243782 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-759c947e-e10c-465d-87e2-ae0ec7270e05 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:13.244225 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-759c947e-e10c-465d-87e2-ae0ec7270e05 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:13.646147 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-759c947e-e10c-465d-87e2-ae0ec7270e05 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:13.667072 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-759c947e-e10c-465d-87e2-ae0ec7270e05 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7" status: 200 len: 1515 microversion: 2.1 time: 0.441283 Sep 24 21:05:13.668873 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2075/4145] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:13 2022] GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7 => generated 1515 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:13.767726 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1862ede5-af98-4383-a1fd-ed579b92a372 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/9bd7a4e2-cb80-4e60-b005-ad8141bdf32a" status: 202 len: 0 microversion: 2.1 time: 0.558080 Sep 24 21:05:13.768658 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2071/4146] 10.222.0.52 () {58 vars in 1272 bytes} [Sat Sep 24 21:05:13 2022] DELETE /compute/v2.1/os-security-groups/9bd7a4e2-cb80-4e60-b005-ad8141bdf32a => generated 0 bytes in 560 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:05:13.784575 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a02bf29b-5690-4e78-82da-041c96634341 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:13.785247 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a02bf29b-5690-4e78-82da-041c96634341 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:13.794226 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a02bf29b-5690-4e78-82da-041c96634341 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:13.794795 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a02bf29b-5690-4e78-82da-041c96634341 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:13.795710 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a02bf29b-5690-4e78-82da-041c96634341 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:13.797596 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a02bf29b-5690-4e78-82da-041c96634341 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:13.798520 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a02bf29b-5690-4e78-82da-041c96634341 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:13.799728 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a02bf29b-5690-4e78-82da-041c96634341 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:13.865262 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a02bf29b-5690-4e78-82da-041c96634341 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:05:13.973605 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a02bf29b-5690-4e78-82da-041c96634341 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 204 len: 0 microversion: 2.1 time: 0.195969 Sep 24 21:05:13.976452 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2072/4147] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:05:13 2022] DELETE /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:05:14.007273 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-71c154a6-99b2-4e88-a3a1-a7c75ca45b87 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:14.008107 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-71c154a6-99b2-4e88-a3a1-a7c75ca45b87 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 95dc95dc-ef74-4f92-9d5a-7e199fc802f5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:14.030738 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71c154a6-99b2-4e88-a3a1-a7c75ca45b87 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:14.031236 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71c154a6-99b2-4e88-a3a1-a7c75ca45b87 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:14.031687 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71c154a6-99b2-4e88-a3a1-a7c75ca45b87 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:14.032424 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71c154a6-99b2-4e88-a3a1-a7c75ca45b87 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:14.032891 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71c154a6-99b2-4e88-a3a1-a7c75ca45b87 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:14.033595 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71c154a6-99b2-4e88-a3a1-a7c75ca45b87 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:14.200296 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7680ed42-ab05-415c-be95-0585f082693e tempest-ExtensionsTest-655587933 tempest-ExtensionsTest-655587933-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:14.201943 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7680ed42-ab05-415c-be95-0585f082693e tempest-ExtensionsTest-655587933 tempest-ExtensionsTest-655587933-project] 10.222.0.52 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.428869 Sep 24 21:05:14.206914 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2076/4148] 10.222.0.52 () {58 vars in 1170 bytes} [Sat Sep 24 21:05:13 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:05:14.211889 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c0f02e3a-a263-492f-bb4e-df48c728b14b tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:14.212518 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c0f02e3a-a263-492f-bb4e-df48c728b14b tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:14.221286 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c0f02e3a-a263-492f-bb4e-df48c728b14b tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:14.221880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c0f02e3a-a263-492f-bb4e-df48c728b14b tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:14.222382 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c0f02e3a-a263-492f-bb4e-df48c728b14b tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:14.223399 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c0f02e3a-a263-492f-bb4e-df48c728b14b tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:14.224119 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c0f02e3a-a263-492f-bb4e-df48c728b14b tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:14.224809 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c0f02e3a-a263-492f-bb4e-df48c728b14b tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:14.758355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-71c154a6-99b2-4e88-a3a1-a7c75ca45b87 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:14.769140 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-71c154a6-99b2-4e88-a3a1-a7c75ca45b87 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5" status: 200 len: 1496 microversion: 2.1 time: 0.791444 Sep 24 21:05:14.774374 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2073/4149] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:13 2022] GET /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5 => generated 1496 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:14.782114 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5bb02173-e416-42e9-b6cc-88d87f0b05ae tempest-ExtensionsTest-655587933 tempest-ExtensionsTest-655587933-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:14.784764 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5bb02173-e416-42e9-b6cc-88d87f0b05ae tempest-ExtensionsTest-655587933 tempest-ExtensionsTest-655587933-project] 10.222.0.52 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.009130 Sep 24 21:05:14.798914 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c0f02e3a-a263-492f-bb4e-df48c728b14b tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:14.811379 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2074/4150] 10.222.0.52 () {58 vars in 1134 bytes} [Sat Sep 24 21:05:14 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:05:14.824949 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c0f02e3a-a263-492f-bb4e-df48c728b14b tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1505 microversion: 2.1 time: 0.616845 Sep 24 21:05:14.826223 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2077/4151] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:14 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1505 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:14.829050 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-50d4455f-be36-49b4-be26-97efe3e12d9f req-9dc9cd47-18c2-4a61-85b6-31b005c8d027 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06ef44f5-3eae-4780-b544-62102fd945a7", "name": "network-vif-deleted", "tag": "cb75d66c-318e-44c6-a426-ef41aef9d16c"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:05:14.831957 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-41f41cf1-8fc4-4e80-ae36-3e97a0838994 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:14.832951 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-41f41cf1-8fc4-4e80-ae36-3e97a0838994 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 06ef44f5-3eae-4780-b544-62102fd945a7] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:14.850621 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-50d4455f-be36-49b4-be26-97efe3e12d9f req-9dc9cd47-18c2-4a61-85b6-31b005c8d027 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:14.854649 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-50d4455f-be36-49b4-be26-97efe3e12d9f req-9dc9cd47-18c2-4a61-85b6-31b005c8d027 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:14.856363 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-50d4455f-be36-49b4-be26-97efe3e12d9f req-9dc9cd47-18c2-4a61-85b6-31b005c8d027 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:14.871338 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41f41cf1-8fc4-4e80-ae36-3e97a0838994 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:14.872192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41f41cf1-8fc4-4e80-ae36-3e97a0838994 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:14.872802 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41f41cf1-8fc4-4e80-ae36-3e97a0838994 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:14.874384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41f41cf1-8fc4-4e80-ae36-3e97a0838994 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:14.875134 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41f41cf1-8fc4-4e80-ae36-3e97a0838994 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:14.875746 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41f41cf1-8fc4-4e80-ae36-3e97a0838994 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:14.887053 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-50d4455f-be36-49b4-be26-97efe3e12d9f req-9dc9cd47-18c2-4a61-85b6-31b005c8d027 service nova] Creating event network-vif-deleted:cb75d66c-318e-44c6-a426-ef41aef9d16c for instance 06ef44f5-3eae-4780-b544-62102fd945a7 on nch2-master-1 Sep 24 21:05:14.892476 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-50d4455f-be36-49b4-be26-97efe3e12d9f req-9dc9cd47-18c2-4a61-85b6-31b005c8d027 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078809 Sep 24 21:05:14.893698 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2075/4152] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:05:14.926657 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41f41cf1-8fc4-4e80-ae36-3e97a0838994 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:14.927415 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41f41cf1-8fc4-4e80-ae36-3e97a0838994 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:14.930094 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41f41cf1-8fc4-4e80-ae36-3e97a0838994 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:14.931237 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-41f41cf1-8fc4-4e80-ae36-3e97a0838994 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lazy-loading 'fault' on Instance uuid 06ef44f5-3eae-4780-b544-62102fd945a7 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:05:15.011890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-41f41cf1-8fc4-4e80-ae36-3e97a0838994 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad0b98fdcf145a1960121573524940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7f252278c74e2d84de081cd3d5a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:15.021528 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-41f41cf1-8fc4-4e80-ae36-3e97a0838994 tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7" status: 200 len: 1310 microversion: 2.1 time: 0.193805 Sep 24 21:05:15.022714 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2078/4153] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:14 2022] GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7 => generated 1310 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:15.690130 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-446b634f-6ff3-45f8-b868-0c374a81fa93 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1425041455", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "3910bbb1-d21d-45c7-ba47-09ea3c984fa4"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:05:15.785840 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-446b634f-6ff3-45f8-b868-0c374a81fa93 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] validate_networks() for [('3910bbb1-d21d-45c7-ba47-09ea3c984fa4', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:05:15.801901 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-017db3a3-570e-4556-8779-5571cb767d45 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:15.803573 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-017db3a3-570e-4556-8779-5571cb767d45 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 95dc95dc-ef74-4f92-9d5a-7e199fc802f5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:15.811801 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-017db3a3-570e-4556-8779-5571cb767d45 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:15.812700 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-017db3a3-570e-4556-8779-5571cb767d45 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:15.813414 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-017db3a3-570e-4556-8779-5571cb767d45 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:15.814442 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-017db3a3-570e-4556-8779-5571cb767d45 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:15.815160 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-017db3a3-570e-4556-8779-5571cb767d45 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:15.815830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-017db3a3-570e-4556-8779-5571cb767d45 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:15.988624 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-017db3a3-570e-4556-8779-5571cb767d45 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:16.004291 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-017db3a3-570e-4556-8779-5571cb767d45 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5" status: 200 len: 1454 microversion: 2.1 time: 0.208480 Sep 24 21:05:16.012035 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2079/4154] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:15 2022] GET /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5 => generated 1454 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:05:16.025744 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e6dd34a8-d781-4642-a1de-fac4220ef88e tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:16.026411 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e6dd34a8-d781-4642-a1de-fac4220ef88e tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:16.037887 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:05:16.045967 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6dd34a8-d781-4642-a1de-fac4220ef88e tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:16.052055 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6dd34a8-d781-4642-a1de-fac4220ef88e tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:16.052521 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6dd34a8-d781-4642-a1de-fac4220ef88e tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:16.054020 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6dd34a8-d781-4642-a1de-fac4220ef88e tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:16.055158 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6dd34a8-d781-4642-a1de-fac4220ef88e tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:16.055905 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6dd34a8-d781-4642-a1de-fac4220ef88e tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:16.446119 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e6dd34a8-d781-4642-a1de-fac4220ef88e tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:16.461927 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e6dd34a8-d781-4642-a1de-fac4220ef88e tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1505 microversion: 2.1 time: 0.448264 Sep 24 21:05:16.476110 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2080/4155] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:16 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1505 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:16.487371 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f1c7bbc8-0a89-4700-9590-bd54e430819a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:16.488329 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f1c7bbc8-0a89-4700-9590-bd54e430819a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] [instance: 06ef44f5-3eae-4780-b544-62102fd945a7] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:16.495558 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1c7bbc8-0a89-4700-9590-bd54e430819a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:16.496479 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1c7bbc8-0a89-4700-9590-bd54e430819a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:16.497153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1c7bbc8-0a89-4700-9590-bd54e430819a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:16.498113 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1c7bbc8-0a89-4700-9590-bd54e430819a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:16.498846 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1c7bbc8-0a89-4700-9590-bd54e430819a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:16.499499 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1c7bbc8-0a89-4700-9590-bd54e430819a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:16.518300 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-f1c7bbc8-0a89-4700-9590-bd54e430819a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] HTTP exception thrown: Instance 06ef44f5-3eae-4780-b544-62102fd945a7 could not be found. Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f1c7bbc8-0a89-4700-9590-bd54e430819a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Request method failure captured: Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7 HTTP/1.1 Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3C6Gfkvywn-r9ntg78NR5l27PA-mik9Pm7PcYTPFewLTSAms76NSRIZ6Ctpy8u0RFHQNDUIjkf_WOu3PAxqzYzH2KvGfx0I2dCsnvBNaJ5stDoVnlNuRslHrC9gxTPsHznJq7BQkv61k7iPpKGxg-iOML4pXo-FGeSWDB9lDyto8k0 Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 6b7f252278c74e2d84de081cd3d5a69e Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ListServerFiltersTestJSON-609227914 Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6b7f252278c74e2d84de081cd3d5a69e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6b7f252278c74e2d84de081cd3d5a69e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6b7f252278c74e2d84de081cd3d5a69e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6b7f252278c74e2d84de081cd3d5a69e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ListServerFiltersTestJSON-609227914 Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 6b7f252278c74e2d84de081cd3d5a69e Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-609227914 Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ListServerFiltersTestJSON-609227914-project Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: dad0b98fdcf145a1960121573524940d Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ListServerFiltersTestJSON-609227914-project Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 06ef44f5-3eae-4780-b544-62102fd945a7 could not be found. Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '06ef44f5-3eae-4780-b544-62102fd945a7'} Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06ef44f5-3eae-4780-b544-62102fd945a7 could not be found. Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06ef44f5-3eae-4780-b544-62102fd945a7 could not be found. Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:05:16.520510 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:05:16.526028 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:05:16.526028 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:05:16.526028 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:05:16.526028 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:05:16.526028 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:05:16.526028 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06ef44f5-3eae-4780-b544-62102fd945a7 could not be found. Sep 24 21:05:16.526028 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:05:16.529066 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f1c7bbc8-0a89-4700-9590-bd54e430819a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] Returning 404 to user: Instance 06ef44f5-3eae-4780-b544-62102fd945a7 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:05:16.530416 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f1c7bbc8-0a89-4700-9590-bd54e430819a tempest-ListServerFiltersTestJSON-609227914 tempest-ListServerFiltersTestJSON-609227914-project] 10.222.0.52 "GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7" status: 404 len: 111 microversion: 2.1 time: 0.052973 Sep 24 21:05:16.531874 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2081/4156] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:16 2022] GET /compute/v2.1/servers/06ef44f5-3eae-4780-b544-62102fd945a7 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:05:16.610809 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-446b634f-6ff3-45f8-b868-0c374a81fa93 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:05:16.611346 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-446b634f-6ff3-45f8-b868-0c374a81fa93 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:05:16.611872 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-446b634f-6ff3-45f8-b868-0c374a81fa93 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:05:16.612449 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-446b634f-6ff3-45f8-b868-0c374a81fa93 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:05:16.613324 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-446b634f-6ff3-45f8-b868-0c374a81fa93 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:05:16.625436 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-446b634f-6ff3-45f8-b868-0c374a81fa93 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:16.626564 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-446b634f-6ff3-45f8-b868-0c374a81fa93 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:16.627215 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-446b634f-6ff3-45f8-b868-0c374a81fa93 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:16.628344 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-446b634f-6ff3-45f8-b868-0c374a81fa93 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:16.630428 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-446b634f-6ff3-45f8-b868-0c374a81fa93 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:16.632089 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-446b634f-6ff3-45f8-b868-0c374a81fa93 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:16.667985 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-446b634f-6ff3-45f8-b868-0c374a81fa93 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Getting quotas for project 3ee2eb7dffa647fb89edd0cf7d1cb454. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:05:16.675710 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-446b634f-6ff3-45f8-b868-0c374a81fa93 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Getting quotas for user f05599f233ca45c39ccd351c0432f1ba and project 3ee2eb7dffa647fb89edd0cf7d1cb454. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:05:16.781013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-446b634f-6ff3-45f8-b868-0c374a81fa93 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:05:16.803926 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-446b634f-6ff3-45f8-b868-0c374a81fa93 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] [instance: aaf7e661-b399-490d-9890-487af6418b95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:05:16.959012 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-446b634f-6ff3-45f8-b868-0c374a81fa93 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.731207 Sep 24 21:05:16.971775 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2076/4157] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:05:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:05:16.976447 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cc9ca343-f180-457c-8271-9a8ef5c2ca2e tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:16.978104 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cc9ca343-f180-457c-8271-9a8ef5c2ca2e tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] [instance: aaf7e661-b399-490d-9890-487af6418b95] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:17.031965 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-40c9c0bd-f945-4533-8778-3c2170ca478d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:17.033314 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-40c9c0bd-f945-4533-8778-3c2170ca478d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 95dc95dc-ef74-4f92-9d5a-7e199fc802f5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:17.063425 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-40c9c0bd-f945-4533-8778-3c2170ca478d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:17.064418 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-40c9c0bd-f945-4533-8778-3c2170ca478d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:17.065093 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-40c9c0bd-f945-4533-8778-3c2170ca478d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:17.067532 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-40c9c0bd-f945-4533-8778-3c2170ca478d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:17.068269 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-40c9c0bd-f945-4533-8778-3c2170ca478d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:17.073535 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-40c9c0bd-f945-4533-8778-3c2170ca478d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:17.145145 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-40c9c0bd-f945-4533-8778-3c2170ca478d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] HTTP exception thrown: Instance 95dc95dc-ef74-4f92-9d5a-7e199fc802f5 could not be found. Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-40c9c0bd-f945-4533-8778-3c2170ca478d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Request method failure captured: Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5 HTTP/1.1 Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3CaLUabI_YBYC2XnM21T8dL5FNXXvceQt6A3bijM2xUqNxa7o1mArSf5dFDgPeh3vgkyUYVZenobpLU3uEqGcvnEbw-nMZfSWEM5OkDmeYEccMJ8-yhXeZa1T-3DnHpo2MRC1ewpBuezwDhE04pucSEH5uW1HzlM0IgaFpEaRXllaA Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersTestJSON-1457868986 Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersTestJSON-1457868986-project Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: e557d91b49c143499d809a55e85932fd Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersTestJSON-1457868986-project Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 95dc95dc-ef74-4f92-9d5a-7e199fc802f5 could not be found. Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '95dc95dc-ef74-4f92-9d5a-7e199fc802f5'} Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95dc95dc-ef74-4f92-9d5a-7e199fc802f5 could not be found. Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95dc95dc-ef74-4f92-9d5a-7e199fc802f5 could not be found. Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:05:17.161775 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:05:17.168867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:05:17.168867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:05:17.168867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:05:17.168867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:05:17.168867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:05:17.168867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95dc95dc-ef74-4f92-9d5a-7e199fc802f5 could not be found. Sep 24 21:05:17.168867 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:05:17.183343 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-40c9c0bd-f945-4533-8778-3c2170ca478d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Returning 404 to user: Instance 95dc95dc-ef74-4f92-9d5a-7e199fc802f5 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:05:17.191217 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-40c9c0bd-f945-4533-8778-3c2170ca478d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5" status: 404 len: 111 microversion: 2.1 time: 0.166474 Sep 24 21:05:17.192527 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2077/4158] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:17 2022] GET /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5 => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 21:05:17.204673 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fea4baa0-3130-473f-9249-483200583562 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:17.212367 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fea4baa0-3130-473f-9249-483200583562 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ca4c8bfe-e06d-427f-85fb-1d2729572b07] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:17.233695 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fea4baa0-3130-473f-9249-483200583562 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:17.242082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fea4baa0-3130-473f-9249-483200583562 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:17.244972 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fea4baa0-3130-473f-9249-483200583562 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:17.246269 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fea4baa0-3130-473f-9249-483200583562 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:17.249157 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fea4baa0-3130-473f-9249-483200583562 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:17.254156 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fea4baa0-3130-473f-9249-483200583562 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:17.370162 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fea4baa0-3130-473f-9249-483200583562 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ca4c8bfe-e06d-427f-85fb-1d2729572b07] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:05:17.450385 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cc9ca343-f180-457c-8271-9a8ef5c2ca2e tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05599f233ca45c39ccd351c0432f1ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee2eb7dffa647fb89edd0cf7d1cb454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:17.466884 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cc9ca343-f180-457c-8271-9a8ef5c2ca2e tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] 10.222.0.52 "GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95" status: 200 len: 1228 microversion: 2.1 time: 0.494721 Sep 24 21:05:17.502321 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2082/4159] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:16 2022] GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95 => generated 1228 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:05:17.526113 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-fe9f8bd1-63d3-4272-8c4e-e79b9401c534 req-241145f8-e7de-4410-bcc9-43d5c511853c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95dc95dc-ef74-4f92-9d5a-7e199fc802f5", "name": "network-vif-deleted", "tag": "2bbb1b2e-5192-48be-a4f8-0c1cb200c21c"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:05:17.573243 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-fe9f8bd1-63d3-4272-8c4e-e79b9401c534 req-241145f8-e7de-4410-bcc9-43d5c511853c service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:17.574750 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-fe9f8bd1-63d3-4272-8c4e-e79b9401c534 req-241145f8-e7de-4410-bcc9-43d5c511853c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:17.575404 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-fe9f8bd1-63d3-4272-8c4e-e79b9401c534 req-241145f8-e7de-4410-bcc9-43d5c511853c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:17.614801 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-fe9f8bd1-63d3-4272-8c4e-e79b9401c534 req-241145f8-e7de-4410-bcc9-43d5c511853c service nova] Creating event network-vif-deleted:2bbb1b2e-5192-48be-a4f8-0c1cb200c21c for instance 95dc95dc-ef74-4f92-9d5a-7e199fc802f5 on nch1-master-1 Sep 24 21:05:17.630703 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-fe9f8bd1-63d3-4272-8c4e-e79b9401c534 req-241145f8-e7de-4410-bcc9-43d5c511853c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126717 Sep 24 21:05:17.636102 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2083/4160] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:05:17.642120 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fea4baa0-3130-473f-9249-483200583562 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07" status: 204 len: 0 microversion: 2.1 time: 0.441993 Sep 24 21:05:17.644877 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2078/4161] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:05:17 2022] DELETE /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:05:17.656075 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b3c1da90-98a4-4b30-9def-6fc72f12db38 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:17.656807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b3c1da90-98a4-4b30-9def-6fc72f12db38 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:17.658459 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1bc08267-cbb6-42a0-a85a-bd8ff4231359 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:17.659452 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1bc08267-cbb6-42a0-a85a-bd8ff4231359 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ca4c8bfe-e06d-427f-85fb-1d2729572b07] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:17.667783 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1bc08267-cbb6-42a0-a85a-bd8ff4231359 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:17.668721 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1bc08267-cbb6-42a0-a85a-bd8ff4231359 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:17.669387 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1bc08267-cbb6-42a0-a85a-bd8ff4231359 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:17.671044 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1bc08267-cbb6-42a0-a85a-bd8ff4231359 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:17.671778 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1bc08267-cbb6-42a0-a85a-bd8ff4231359 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:17.672443 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1bc08267-cbb6-42a0-a85a-bd8ff4231359 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:17.678370 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b3c1da90-98a4-4b30-9def-6fc72f12db38 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:17.678907 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b3c1da90-98a4-4b30-9def-6fc72f12db38 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:17.679351 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b3c1da90-98a4-4b30-9def-6fc72f12db38 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:17.693892 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b3c1da90-98a4-4b30-9def-6fc72f12db38 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:17.694421 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b3c1da90-98a4-4b30-9def-6fc72f12db38 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:17.696400 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b3c1da90-98a4-4b30-9def-6fc72f12db38 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:18.300538 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1bc08267-cbb6-42a0-a85a-bd8ff4231359 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:18.314234 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1bc08267-cbb6-42a0-a85a-bd8ff4231359 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07" status: 200 len: 1495 microversion: 2.1 time: 0.661143 Sep 24 21:05:18.316305 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2079/4162] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:17 2022] GET /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07 => generated 1495 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:18.331037 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b3c1da90-98a4-4b30-9def-6fc72f12db38 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:18.347583 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b3c1da90-98a4-4b30-9def-6fc72f12db38 tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1505 microversion: 2.1 time: 0.700831 Sep 24 21:05:18.348619 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2084/4163] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:17 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1505 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:18.494656 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f54f6b47-b332-4d79-bd6e-024ef0575326 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:18.496380 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f54f6b47-b332-4d79-bd6e-024ef0575326 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] [instance: aaf7e661-b399-490d-9890-487af6418b95] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:18.504823 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f54f6b47-b332-4d79-bd6e-024ef0575326 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:18.505598 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f54f6b47-b332-4d79-bd6e-024ef0575326 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:18.507222 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f54f6b47-b332-4d79-bd6e-024ef0575326 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:18.508655 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f54f6b47-b332-4d79-bd6e-024ef0575326 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:18.509410 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f54f6b47-b332-4d79-bd6e-024ef0575326 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:18.510120 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f54f6b47-b332-4d79-bd6e-024ef0575326 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:18.690884 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f54f6b47-b332-4d79-bd6e-024ef0575326 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05599f233ca45c39ccd351c0432f1ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee2eb7dffa647fb89edd0cf7d1cb454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:18.704561 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f54f6b47-b332-4d79-bd6e-024ef0575326 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] 10.222.0.52 "GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95" status: 200 len: 1232 microversion: 2.1 time: 0.214800 Sep 24 21:05:18.705664 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2080/4164] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:18 2022] GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95 => generated 1232 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:19.352411 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1524306a-aa16-4cb2-8987-23a691a71030 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:19.353147 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1524306a-aa16-4cb2-8987-23a691a71030 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ca4c8bfe-e06d-427f-85fb-1d2729572b07] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:19.379250 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-991b50a2-dbcc-45fe-aea3-8ef658b823de tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:19.380381 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-991b50a2-dbcc-45fe-aea3-8ef658b823de tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:19.386555 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1524306a-aa16-4cb2-8987-23a691a71030 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:19.388471 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1524306a-aa16-4cb2-8987-23a691a71030 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:19.393297 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1524306a-aa16-4cb2-8987-23a691a71030 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:19.395216 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1524306a-aa16-4cb2-8987-23a691a71030 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:19.396777 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1524306a-aa16-4cb2-8987-23a691a71030 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:19.403968 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1524306a-aa16-4cb2-8987-23a691a71030 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:19.405170 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-991b50a2-dbcc-45fe-aea3-8ef658b823de tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:19.409153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-991b50a2-dbcc-45fe-aea3-8ef658b823de tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:19.410798 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-991b50a2-dbcc-45fe-aea3-8ef658b823de tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:19.413752 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-991b50a2-dbcc-45fe-aea3-8ef658b823de tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:19.417140 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-991b50a2-dbcc-45fe-aea3-8ef658b823de tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:19.418468 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-991b50a2-dbcc-45fe-aea3-8ef658b823de tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:19.806430 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-991b50a2-dbcc-45fe-aea3-8ef658b823de tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d598811ae8427c982bbea05de22daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7309c3d3d7e542b1a000490468edec55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:19.828328 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-991b50a2-dbcc-45fe-aea3-8ef658b823de tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 200 len: 1292 microversion: 2.1 time: 0.455785 Sep 24 21:05:19.830356 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2081/4165] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:19 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 1292 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:05:19.837626 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-96e93364-d37d-4c99-80ac-7874b3299e45 req-4a2e329d-20d2-41bc-9854-7ad7d33dea65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b2e4ce4-809e-4888-8205-eae021e2fb8c", "name": "network-vif-deleted", "tag": "463ee47f-dd1b-4d52-b5e6-b06f1390b340"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:05:19.856771 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-96e93364-d37d-4c99-80ac-7874b3299e45 req-4a2e329d-20d2-41bc-9854-7ad7d33dea65 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:19.857872 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-96e93364-d37d-4c99-80ac-7874b3299e45 req-4a2e329d-20d2-41bc-9854-7ad7d33dea65 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:19.859281 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-96e93364-d37d-4c99-80ac-7874b3299e45 req-4a2e329d-20d2-41bc-9854-7ad7d33dea65 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:19.898955 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-96e93364-d37d-4c99-80ac-7874b3299e45 req-4a2e329d-20d2-41bc-9854-7ad7d33dea65 service nova] Creating event network-vif-deleted:463ee47f-dd1b-4d52-b5e6-b06f1390b340 for instance 1b2e4ce4-809e-4888-8205-eae021e2fb8c on nch1-master-1 Sep 24 21:05:19.906426 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-96e93364-d37d-4c99-80ac-7874b3299e45 req-4a2e329d-20d2-41bc-9854-7ad7d33dea65 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074394 Sep 24 21:05:19.909266 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2082/4166] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:05:19.932883 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-00555269-b7f9-4f4a-b568-32931dd85b9e tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:19.934677 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-00555269-b7f9-4f4a-b568-32931dd85b9e tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] [instance: aaf7e661-b399-490d-9890-487af6418b95] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:19.949677 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00555269-b7f9-4f4a-b568-32931dd85b9e tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:19.951481 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00555269-b7f9-4f4a-b568-32931dd85b9e tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:19.952586 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00555269-b7f9-4f4a-b568-32931dd85b9e tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:19.976582 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00555269-b7f9-4f4a-b568-32931dd85b9e tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:19.977421 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00555269-b7f9-4f4a-b568-32931dd85b9e tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:19.978089 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00555269-b7f9-4f4a-b568-32931dd85b9e tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:20.016059 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1524306a-aa16-4cb2-8987-23a691a71030 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:20.028063 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1524306a-aa16-4cb2-8987-23a691a71030 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07" status: 200 len: 1495 microversion: 2.1 time: 0.687692 Sep 24 21:05:20.048350 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2085/4167] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:19 2022] GET /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07 => generated 1495 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:20.244280 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-00555269-b7f9-4f4a-b568-32931dd85b9e tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05599f233ca45c39ccd351c0432f1ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee2eb7dffa647fb89edd0cf7d1cb454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:20.264180 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-00555269-b7f9-4f4a-b568-32931dd85b9e tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] 10.222.0.52 "GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95" status: 200 len: 1280 microversion: 2.1 time: 0.353014 Sep 24 21:05:20.265328 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2083/4168] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:19 2022] GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95 => generated 1280 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:20.855669 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7bb88fd6-3005-4dd0-bf29-8d3291e7d5dc tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:20.856370 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7bb88fd6-3005-4dd0-bf29-8d3291e7d5dc tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] [instance: 1b2e4ce4-809e-4888-8205-eae021e2fb8c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:20.882801 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7bb88fd6-3005-4dd0-bf29-8d3291e7d5dc tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:20.885508 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7bb88fd6-3005-4dd0-bf29-8d3291e7d5dc tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:20.886021 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7bb88fd6-3005-4dd0-bf29-8d3291e7d5dc tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:20.886814 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7bb88fd6-3005-4dd0-bf29-8d3291e7d5dc tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:20.892320 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7bb88fd6-3005-4dd0-bf29-8d3291e7d5dc tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:20.892936 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7bb88fd6-3005-4dd0-bf29-8d3291e7d5dc tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:20.939257 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-7bb88fd6-3005-4dd0-bf29-8d3291e7d5dc tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] HTTP exception thrown: Instance 1b2e4ce4-809e-4888-8205-eae021e2fb8c could not be found. Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7bb88fd6-3005-4dd0-bf29-8d3291e7d5dc tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Request method failure captured: Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c HTTP/1.1 Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3CquGl2ziNfxN4kNErkOWjuFPOprmhIZe9rdv7rYy0s_xd3-XeEsDNtl6haR1zpRc_53lSIzwFyCcRIkYtr_1zDvJQlz1V2GUTdk9AAwLVDaztrxrEIGjBmji7bkFsvFt06MVLSRC3mP4HBq_Ms-XRSwiaIy_3TWhATOB7Ci83sHVc Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 7309c3d3d7e542b1a000490468edec55 Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-460747088 Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7309c3d3d7e542b1a000490468edec55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7309c3d3d7e542b1a000490468edec55"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7309c3d3d7e542b1a000490468edec55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7309c3d3d7e542b1a000490468edec55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-460747088 Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 7309c3d3d7e542b1a000490468edec55 Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-460747088 Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServerRescueTestJSONUnderV235-460747088-project Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 07d598811ae8427c982bbea05de22daf Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-460747088-project Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 1b2e4ce4-809e-4888-8205-eae021e2fb8c could not be found. Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '1b2e4ce4-809e-4888-8205-eae021e2fb8c'} Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b2e4ce4-809e-4888-8205-eae021e2fb8c could not be found. Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b2e4ce4-809e-4888-8205-eae021e2fb8c could not be found. Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:05:20.946267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:05:20.951485 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:05:20.951485 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:05:20.951485 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:05:20.951485 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:05:20.951485 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:05:20.951485 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:05:20.951485 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b2e4ce4-809e-4888-8205-eae021e2fb8c could not be found. Sep 24 21:05:20.951485 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:05:20.956563 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7bb88fd6-3005-4dd0-bf29-8d3291e7d5dc tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] Returning 404 to user: Instance 1b2e4ce4-809e-4888-8205-eae021e2fb8c could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:05:20.957950 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7bb88fd6-3005-4dd0-bf29-8d3291e7d5dc tempest-ServerRescueTestJSONUnderV235-460747088 tempest-ServerRescueTestJSONUnderV235-460747088-project] 10.222.0.52 "GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c" status: 404 len: 111 microversion: 2.1 time: 0.107797 Sep 24 21:05:20.963369 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2086/4169] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:20 2022] GET /compute/v2.1/servers/1b2e4ce4-809e-4888-8205-eae021e2fb8c => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:05:21.057685 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-049be9ff-0eb6-412e-826a-bc78c8298e5a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:21.060587 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-049be9ff-0eb6-412e-826a-bc78c8298e5a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ca4c8bfe-e06d-427f-85fb-1d2729572b07] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:21.084803 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-049be9ff-0eb6-412e-826a-bc78c8298e5a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:21.085573 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-049be9ff-0eb6-412e-826a-bc78c8298e5a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:21.086395 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-049be9ff-0eb6-412e-826a-bc78c8298e5a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:21.087313 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-049be9ff-0eb6-412e-826a-bc78c8298e5a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:21.087956 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-049be9ff-0eb6-412e-826a-bc78c8298e5a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:21.088829 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-049be9ff-0eb6-412e-826a-bc78c8298e5a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:21.143875 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-049be9ff-0eb6-412e-826a-bc78c8298e5a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:21.144767 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-049be9ff-0eb6-412e-826a-bc78c8298e5a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:21.145541 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-049be9ff-0eb6-412e-826a-bc78c8298e5a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:21.146431 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-049be9ff-0eb6-412e-826a-bc78c8298e5a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lazy-loading 'fault' on Instance uuid ca4c8bfe-e06d-427f-85fb-1d2729572b07 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:05:21.214202 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-049be9ff-0eb6-412e-826a-bc78c8298e5a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:21.226276 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-049be9ff-0eb6-412e-826a-bc78c8298e5a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07" status: 200 len: 1298 microversion: 2.1 time: 0.173001 Sep 24 21:05:21.228186 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2084/4170] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:21 2022] GET /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07 => generated 1298 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:21.297265 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5cd4433f-31e6-4b7d-9082-b15b495007c4 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:21.300054 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5cd4433f-31e6-4b7d-9082-b15b495007c4 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] [instance: aaf7e661-b399-490d-9890-487af6418b95] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:21.321925 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5cd4433f-31e6-4b7d-9082-b15b495007c4 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:21.322899 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5cd4433f-31e6-4b7d-9082-b15b495007c4 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:21.323692 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5cd4433f-31e6-4b7d-9082-b15b495007c4 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:21.324770 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5cd4433f-31e6-4b7d-9082-b15b495007c4 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:21.325925 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5cd4433f-31e6-4b7d-9082-b15b495007c4 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:21.326832 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5cd4433f-31e6-4b7d-9082-b15b495007c4 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:21.876574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5cd4433f-31e6-4b7d-9082-b15b495007c4 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05599f233ca45c39ccd351c0432f1ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee2eb7dffa647fb89edd0cf7d1cb454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:21.900931 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5cd4433f-31e6-4b7d-9082-b15b495007c4 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] 10.222.0.52 "GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95" status: 200 len: 1286 microversion: 2.1 time: 0.611111 Sep 24 21:05:21.902128 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2087/4171] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:21 2022] GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95 => generated 1286 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:22.022796 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-e1c70457-d5e5-45f5-999d-1047b3c83ba3 req-50d637ff-eeca-4a7f-a5b2-3dfcecefed40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca4c8bfe-e06d-427f-85fb-1d2729572b07", "name": "network-vif-deleted", "tag": "f1ef0e43-058d-4c31-b2c8-ae05ef2ff17a"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:05:22.040502 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e1c70457-d5e5-45f5-999d-1047b3c83ba3 req-50d637ff-eeca-4a7f-a5b2-3dfcecefed40 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:22.040996 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e1c70457-d5e5-45f5-999d-1047b3c83ba3 req-50d637ff-eeca-4a7f-a5b2-3dfcecefed40 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:22.041435 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e1c70457-d5e5-45f5-999d-1047b3c83ba3 req-50d637ff-eeca-4a7f-a5b2-3dfcecefed40 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:22.068284 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-e1c70457-d5e5-45f5-999d-1047b3c83ba3 req-50d637ff-eeca-4a7f-a5b2-3dfcecefed40 service nova] Creating event network-vif-deleted:f1ef0e43-058d-4c31-b2c8-ae05ef2ff17a for instance ca4c8bfe-e06d-427f-85fb-1d2729572b07 on nch2-master-1 Sep 24 21:05:22.099919 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-e1c70457-d5e5-45f5-999d-1047b3c83ba3 req-50d637ff-eeca-4a7f-a5b2-3dfcecefed40 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079090 Sep 24 21:05:22.103459 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2085/4172] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:05:22.249584 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-21afff58-eae0-4a13-b782-10252af7cfef tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:22.250781 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-21afff58-eae0-4a13-b782-10252af7cfef tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ca4c8bfe-e06d-427f-85fb-1d2729572b07] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:22.270412 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-21afff58-eae0-4a13-b782-10252af7cfef tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:22.271501 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-21afff58-eae0-4a13-b782-10252af7cfef tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:22.273036 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-21afff58-eae0-4a13-b782-10252af7cfef tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:22.274012 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-21afff58-eae0-4a13-b782-10252af7cfef tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:22.274719 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-21afff58-eae0-4a13-b782-10252af7cfef tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:22.275440 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-21afff58-eae0-4a13-b782-10252af7cfef tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:22.309961 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-21afff58-eae0-4a13-b782-10252af7cfef tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] HTTP exception thrown: Instance ca4c8bfe-e06d-427f-85fb-1d2729572b07 could not be found. Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-21afff58-eae0-4a13-b782-10252af7cfef tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Request method failure captured: Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07 HTTP/1.1 Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3CaLUabI_YBYC2XnM21T8dL5FNXXvceQt6A3bijM2xUqNxa7o1mArSf5dFDgPeh3vgkyUYVZenobpLU3uEqGcvnEbw-nMZfSWEM5OkDmeYEccMJ8-yhXeZa1T-3DnHpo2MRC1ewpBuezwDhE04pucSEH5uW1HzlM0IgaFpEaRXllaA Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersTestJSON-1457868986 Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersTestJSON-1457868986-project Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: e557d91b49c143499d809a55e85932fd Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersTestJSON-1457868986-project Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance ca4c8bfe-e06d-427f-85fb-1d2729572b07 could not be found. Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'ca4c8bfe-e06d-427f-85fb-1d2729572b07'} Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca4c8bfe-e06d-427f-85fb-1d2729572b07 could not be found. Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca4c8bfe-e06d-427f-85fb-1d2729572b07 could not be found. Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:05:22.312191 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:05:22.319550 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:05:22.319550 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:05:22.319550 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:05:22.319550 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:05:22.319550 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:05:22.319550 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca4c8bfe-e06d-427f-85fb-1d2729572b07 could not be found. Sep 24 21:05:22.319550 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:05:22.321597 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-21afff58-eae0-4a13-b782-10252af7cfef tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Returning 404 to user: Instance ca4c8bfe-e06d-427f-85fb-1d2729572b07 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:05:22.322716 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-21afff58-eae0-4a13-b782-10252af7cfef tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07" status: 404 len: 111 microversion: 2.1 time: 0.077274 Sep 24 21:05:22.323806 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2088/4173] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:22 2022] GET /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:05:22.453087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2c4b2cdd-78db-4c8f-addf-204dd6aaa9fd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:05:22.457190 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2c4b2cdd-78db-4c8f-addf-204dd6aaa9fd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:22.480795 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c4b2cdd-78db-4c8f-addf-204dd6aaa9fd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:22.481817 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c4b2cdd-78db-4c8f-addf-204dd6aaa9fd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:22.484403 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c4b2cdd-78db-4c8f-addf-204dd6aaa9fd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:22.485513 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c4b2cdd-78db-4c8f-addf-204dd6aaa9fd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:22.486458 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c4b2cdd-78db-4c8f-addf-204dd6aaa9fd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:22.488163 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c4b2cdd-78db-4c8f-addf-204dd6aaa9fd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:22.602434 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-549b32b7-4ac2-4fb5-8a2e-81dcea3f4d49 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-53114603", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "86ee1dec-a957-4cc1-98d2-2e275615c01a"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:05:22.699653 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-549b32b7-4ac2-4fb5-8a2e-81dcea3f4d49 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] validate_networks() for [('86ee1dec-a957-4cc1-98d2-2e275615c01a', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:05:22.732418 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2c4b2cdd-78db-4c8f-addf-204dd6aaa9fd tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "POST /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/action" status: 202 len: 0 microversion: 2.1 time: 0.287492 Sep 24 21:05:22.732998 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2086/4174] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:05:22 2022] POST /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:05:22.746488 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7577de4e-144b-4b06-b6f4-815382f0d871 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:22.752567 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7577de4e-144b-4b06-b6f4-815382f0d871 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:22.794791 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7577de4e-144b-4b06-b6f4-815382f0d871 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:22.800428 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7577de4e-144b-4b06-b6f4-815382f0d871 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:22.800895 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7577de4e-144b-4b06-b6f4-815382f0d871 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:22.801819 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7577de4e-144b-4b06-b6f4-815382f0d871 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:22.802293 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7577de4e-144b-4b06-b6f4-815382f0d871 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:22.806004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7577de4e-144b-4b06-b6f4-815382f0d871 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:22.864105 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:05:23.474266 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7577de4e-144b-4b06-b6f4-815382f0d871 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:23.485140 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7577de4e-144b-4b06-b6f4-815382f0d871 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1670 microversion: 2.1 time: 0.747765 Sep 24 21:05:23.495186 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2087/4175] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:22 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1670 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:23.500873 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f5d9db91-eb72-434d-b62e-402fa5cf94c8 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:23.501790 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f5d9db91-eb72-434d-b62e-402fa5cf94c8 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] [instance: aaf7e661-b399-490d-9890-487af6418b95] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:23.508654 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5d9db91-eb72-434d-b62e-402fa5cf94c8 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:23.509512 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5d9db91-eb72-434d-b62e-402fa5cf94c8 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:23.510197 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5d9db91-eb72-434d-b62e-402fa5cf94c8 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:23.511221 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5d9db91-eb72-434d-b62e-402fa5cf94c8 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:23.511925 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5d9db91-eb72-434d-b62e-402fa5cf94c8 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:23.512581 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5d9db91-eb72-434d-b62e-402fa5cf94c8 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:24.027094 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f5d9db91-eb72-434d-b62e-402fa5cf94c8 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05599f233ca45c39ccd351c0432f1ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee2eb7dffa647fb89edd0cf7d1cb454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:24.036893 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f5d9db91-eb72-434d-b62e-402fa5cf94c8 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] 10.222.0.52 "GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95" status: 200 len: 1328 microversion: 2.1 time: 0.540222 Sep 24 21:05:24.038180 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2088/4176] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:23 2022] GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95 => generated 1328 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:24.357474 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-549b32b7-4ac2-4fb5-8a2e-81dcea3f4d49 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:05:24.359967 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-549b32b7-4ac2-4fb5-8a2e-81dcea3f4d49 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:05:24.361030 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-549b32b7-4ac2-4fb5-8a2e-81dcea3f4d49 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:05:24.361728 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-549b32b7-4ac2-4fb5-8a2e-81dcea3f4d49 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:05:24.362434 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-549b32b7-4ac2-4fb5-8a2e-81dcea3f4d49 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:05:24.377967 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-549b32b7-4ac2-4fb5-8a2e-81dcea3f4d49 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:24.378986 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-549b32b7-4ac2-4fb5-8a2e-81dcea3f4d49 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:24.380028 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-549b32b7-4ac2-4fb5-8a2e-81dcea3f4d49 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:24.383133 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-549b32b7-4ac2-4fb5-8a2e-81dcea3f4d49 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:24.383888 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-549b32b7-4ac2-4fb5-8a2e-81dcea3f4d49 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:24.384515 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-549b32b7-4ac2-4fb5-8a2e-81dcea3f4d49 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:24.415001 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-549b32b7-4ac2-4fb5-8a2e-81dcea3f4d49 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Getting quotas for project accafa2724354ca8b1c9f19940989429. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:05:24.422959 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-549b32b7-4ac2-4fb5-8a2e-81dcea3f4d49 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Getting quotas for user e557d91b49c143499d809a55e85932fd and project accafa2724354ca8b1c9f19940989429. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:05:24.442164 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-549b32b7-4ac2-4fb5-8a2e-81dcea3f4d49 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:05:24.445036 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-549b32b7-4ac2-4fb5-8a2e-81dcea3f4d49 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:05:24.509472 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-549b32b7-4ac2-4fb5-8a2e-81dcea3f4d49 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.910540 Sep 24 21:05:24.511652 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2089/4177] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:05:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:05:24.523707 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dacd8660-5583-48c3-860a-312c8897fe89 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:24.524499 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dacd8660-5583-48c3-860a-312c8897fe89 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:24.534818 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-220933d8-13b1-457a-bad2-190d8cc8ee64 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:24.542366 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-220933d8-13b1-457a-bad2-190d8cc8ee64 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:24.553794 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-220933d8-13b1-457a-bad2-190d8cc8ee64 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:24.554600 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-220933d8-13b1-457a-bad2-190d8cc8ee64 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:24.555227 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-220933d8-13b1-457a-bad2-190d8cc8ee64 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:24.556145 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-220933d8-13b1-457a-bad2-190d8cc8ee64 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:24.556767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-220933d8-13b1-457a-bad2-190d8cc8ee64 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:24.557362 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-220933d8-13b1-457a-bad2-190d8cc8ee64 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:24.645998 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dacd8660-5583-48c3-860a-312c8897fe89 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:24.657845 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dacd8660-5583-48c3-860a-312c8897fe89 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a" status: 200 len: 1207 microversion: 2.1 time: 0.138708 Sep 24 21:05:24.660538 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2089/4178] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:24 2022] GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a => generated 1207 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:24.926669 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-220933d8-13b1-457a-bad2-190d8cc8ee64 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:24.950844 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-220933d8-13b1-457a-bad2-190d8cc8ee64 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1670 microversion: 2.1 time: 0.419648 Sep 24 21:05:24.954357 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2090/4179] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:24 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1670 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:25.063875 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5dfb7caa-fbb2-4d5e-af7f-10e5bef94fad tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:25.064412 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5dfb7caa-fbb2-4d5e-af7f-10e5bef94fad tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] [instance: aaf7e661-b399-490d-9890-487af6418b95] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:25.078129 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5dfb7caa-fbb2-4d5e-af7f-10e5bef94fad tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:25.078898 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5dfb7caa-fbb2-4d5e-af7f-10e5bef94fad tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:25.079537 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5dfb7caa-fbb2-4d5e-af7f-10e5bef94fad tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:25.080433 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5dfb7caa-fbb2-4d5e-af7f-10e5bef94fad tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:25.081058 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5dfb7caa-fbb2-4d5e-af7f-10e5bef94fad tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:25.081652 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5dfb7caa-fbb2-4d5e-af7f-10e5bef94fad tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:25.440972 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5dfb7caa-fbb2-4d5e-af7f-10e5bef94fad tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05599f233ca45c39ccd351c0432f1ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee2eb7dffa647fb89edd0cf7d1cb454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:25.457664 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5dfb7caa-fbb2-4d5e-af7f-10e5bef94fad tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] 10.222.0.52 "GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95" status: 200 len: 1328 microversion: 2.1 time: 0.396566 Sep 24 21:05:25.462295 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2090/4180] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:25 2022] GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95 => generated 1328 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:25.692924 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1387f9fa-fb62-4c7e-83bf-fe8f6a6c9fed tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:25.694702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1387f9fa-fb62-4c7e-83bf-fe8f6a6c9fed tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:25.703018 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1387f9fa-fb62-4c7e-83bf-fe8f6a6c9fed tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:25.703807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1387f9fa-fb62-4c7e-83bf-fe8f6a6c9fed tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:25.704647 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1387f9fa-fb62-4c7e-83bf-fe8f6a6c9fed tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:25.705730 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1387f9fa-fb62-4c7e-83bf-fe8f6a6c9fed tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:25.706833 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1387f9fa-fb62-4c7e-83bf-fe8f6a6c9fed tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:25.707652 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1387f9fa-fb62-4c7e-83bf-fe8f6a6c9fed tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:25.981734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7f42c47c-46ad-47a5-81cb-ccb021a71c1f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:25.983699 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7f42c47c-46ad-47a5-81cb-ccb021a71c1f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:25.993731 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f42c47c-46ad-47a5-81cb-ccb021a71c1f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:25.994729 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f42c47c-46ad-47a5-81cb-ccb021a71c1f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:25.995371 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f42c47c-46ad-47a5-81cb-ccb021a71c1f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:25.997853 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f42c47c-46ad-47a5-81cb-ccb021a71c1f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:25.998577 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f42c47c-46ad-47a5-81cb-ccb021a71c1f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:25.999303 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f42c47c-46ad-47a5-81cb-ccb021a71c1f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:26.142985 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1387f9fa-fb62-4c7e-83bf-fe8f6a6c9fed tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:26.154868 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1387f9fa-fb62-4c7e-83bf-fe8f6a6c9fed tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a" status: 200 len: 1259 microversion: 2.1 time: 0.472967 Sep 24 21:05:26.159593 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2091/4181] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:25 2022] GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a => generated 1259 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:26.431518 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7f42c47c-46ad-47a5-81cb-ccb021a71c1f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:26.447311 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7f42c47c-46ad-47a5-81cb-ccb021a71c1f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1675 microversion: 2.1 time: 0.471104 Sep 24 21:05:26.465407 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2091/4182] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:25 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1675 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:26.489243 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-66b21d76-3435-48f3-bffa-c55da26b7846 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:26.491890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-66b21d76-3435-48f3-bffa-c55da26b7846 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] [instance: aaf7e661-b399-490d-9890-487af6418b95] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:26.505666 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66b21d76-3435-48f3-bffa-c55da26b7846 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:26.506675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66b21d76-3435-48f3-bffa-c55da26b7846 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:26.507860 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66b21d76-3435-48f3-bffa-c55da26b7846 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:26.550204 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66b21d76-3435-48f3-bffa-c55da26b7846 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:26.566619 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66b21d76-3435-48f3-bffa-c55da26b7846 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:26.569756 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66b21d76-3435-48f3-bffa-c55da26b7846 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:26.655669 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:05:27.182370 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-44524423-fdda-4dea-ba83-3a1ffb912930 req-ac74a0ab-99a6-4c10-98c8-fe09957bb459 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaf7e661-b399-490d-9890-487af6418b95", "tag": "efa62d63-5684-4475-8cad-bb83c067cfbc"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:05:27.198315 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-44524423-fdda-4dea-ba83-3a1ffb912930 req-ac74a0ab-99a6-4c10-98c8-fe09957bb459 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:27.198834 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-44524423-fdda-4dea-ba83-3a1ffb912930 req-ac74a0ab-99a6-4c10-98c8-fe09957bb459 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:27.203572 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-44524423-fdda-4dea-ba83-3a1ffb912930 req-ac74a0ab-99a6-4c10-98c8-fe09957bb459 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:27.244188 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-44524423-fdda-4dea-ba83-3a1ffb912930 req-ac74a0ab-99a6-4c10-98c8-fe09957bb459 service nova] Creating event network-changed:efa62d63-5684-4475-8cad-bb83c067cfbc for instance aaf7e661-b399-490d-9890-487af6418b95 on nch2-master-1 Sep 24 21:05:27.256888 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-44524423-fdda-4dea-ba83-3a1ffb912930 req-ac74a0ab-99a6-4c10-98c8-fe09957bb459 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.740233 Sep 24 21:05:27.257517 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2092/4183] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:05:27.264047 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f8a4aa8c-ea95-4cee-bdf4-a87dd01af632 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:27.272004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f8a4aa8c-ea95-4cee-bdf4-a87dd01af632 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:27.308406 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8a4aa8c-ea95-4cee-bdf4-a87dd01af632 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:27.309205 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8a4aa8c-ea95-4cee-bdf4-a87dd01af632 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:27.310034 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8a4aa8c-ea95-4cee-bdf4-a87dd01af632 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:27.310991 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8a4aa8c-ea95-4cee-bdf4-a87dd01af632 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:27.311653 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8a4aa8c-ea95-4cee-bdf4-a87dd01af632 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:27.312260 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8a4aa8c-ea95-4cee-bdf4-a87dd01af632 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:27.477079 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f8a4aa8c-ea95-4cee-bdf4-a87dd01af632 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:27.495113 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f8a4aa8c-ea95-4cee-bdf4-a87dd01af632 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a" status: 200 len: 1259 microversion: 2.1 time: 0.233973 Sep 24 21:05:27.496684 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2093/4184] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:27 2022] GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a => generated 1259 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:27.512114 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8a1458f3-9cb4-44ff-901f-a467728390e4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:27.515548 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8a1458f3-9cb4-44ff-901f-a467728390e4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:27.517666 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:INSERT=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:05:27.535824 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8a1458f3-9cb4-44ff-901f-a467728390e4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:27.536684 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8a1458f3-9cb4-44ff-901f-a467728390e4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:27.539958 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8a1458f3-9cb4-44ff-901f-a467728390e4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:27.542166 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8a1458f3-9cb4-44ff-901f-a467728390e4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:27.543864 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8a1458f3-9cb4-44ff-901f-a467728390e4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:27.545511 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8a1458f3-9cb4-44ff-901f-a467728390e4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:27.587517 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-66b21d76-3435-48f3-bffa-c55da26b7846 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05599f233ca45c39ccd351c0432f1ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee2eb7dffa647fb89edd0cf7d1cb454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:27.595429 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-66b21d76-3435-48f3-bffa-c55da26b7846 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] 10.222.0.52 "GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95" status: 200 len: 1328 microversion: 2.1 time: 1.112478 Sep 24 21:05:27.600122 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2092/4185] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:26 2022] GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95 => generated 1328 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:28.495449 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8a1458f3-9cb4-44ff-901f-a467728390e4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:28.510864 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8a1458f3-9cb4-44ff-901f-a467728390e4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1675 microversion: 2.1 time: 1.009706 Sep 24 21:05:28.511747 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2094/4186] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:27 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1675 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:28.534281 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-316849bf-5ded-4998-a93e-2258163e874e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:28.535106 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-316849bf-5ded-4998-a93e-2258163e874e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:28.544288 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-316849bf-5ded-4998-a93e-2258163e874e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:28.546851 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-316849bf-5ded-4998-a93e-2258163e874e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:28.551358 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-316849bf-5ded-4998-a93e-2258163e874e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:28.553888 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-316849bf-5ded-4998-a93e-2258163e874e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:28.554751 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-316849bf-5ded-4998-a93e-2258163e874e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:28.556114 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-316849bf-5ded-4998-a93e-2258163e874e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:28.637200 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cdcc15a3-f0e5-4933-b926-b60047e2a107 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:28.637682 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cdcc15a3-f0e5-4933-b926-b60047e2a107 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] [instance: aaf7e661-b399-490d-9890-487af6418b95] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:28.648795 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cdcc15a3-f0e5-4933-b926-b60047e2a107 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:28.649295 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cdcc15a3-f0e5-4933-b926-b60047e2a107 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:28.657398 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cdcc15a3-f0e5-4933-b926-b60047e2a107 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:28.658482 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cdcc15a3-f0e5-4933-b926-b60047e2a107 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:28.659095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cdcc15a3-f0e5-4933-b926-b60047e2a107 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:28.659528 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cdcc15a3-f0e5-4933-b926-b60047e2a107 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:28.749174 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-316849bf-5ded-4998-a93e-2258163e874e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:28.767014 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-316849bf-5ded-4998-a93e-2258163e874e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a" status: 200 len: 1259 microversion: 2.1 time: 0.234281 Sep 24 21:05:28.768986 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2093/4187] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:28 2022] GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a => generated 1259 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:29.191068 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cdcc15a3-f0e5-4933-b926-b60047e2a107 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05599f233ca45c39ccd351c0432f1ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee2eb7dffa647fb89edd0cf7d1cb454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:29.202312 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cdcc15a3-f0e5-4933-b926-b60047e2a107 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] 10.222.0.52 "GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95" status: 200 len: 1328 microversion: 2.1 time: 0.569334 Sep 24 21:05:29.203168 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2095/4188] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:28 2022] GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95 => generated 1328 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:29.543263 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-27aa1c75-677b-4c69-8ac6-1f039cb9f6df tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:29.544355 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-27aa1c75-677b-4c69-8ac6-1f039cb9f6df tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:29.555729 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27aa1c75-677b-4c69-8ac6-1f039cb9f6df tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:29.556946 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27aa1c75-677b-4c69-8ac6-1f039cb9f6df tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:29.557557 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27aa1c75-677b-4c69-8ac6-1f039cb9f6df tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:29.558646 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27aa1c75-677b-4c69-8ac6-1f039cb9f6df tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:29.559376 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27aa1c75-677b-4c69-8ac6-1f039cb9f6df tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:29.559977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27aa1c75-677b-4c69-8ac6-1f039cb9f6df tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:29.793426 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-64f8cee5-4639-45fd-9af5-b5bed2551b33 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:29.794049 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-64f8cee5-4639-45fd-9af5-b5bed2551b33 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:29.801388 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-64f8cee5-4639-45fd-9af5-b5bed2551b33 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:29.801884 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-64f8cee5-4639-45fd-9af5-b5bed2551b33 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:29.803174 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-64f8cee5-4639-45fd-9af5-b5bed2551b33 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:29.804234 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-64f8cee5-4639-45fd-9af5-b5bed2551b33 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:29.804887 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-64f8cee5-4639-45fd-9af5-b5bed2551b33 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:29.805496 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-64f8cee5-4639-45fd-9af5-b5bed2551b33 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:30.164936 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-64f8cee5-4639-45fd-9af5-b5bed2551b33 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:30.175235 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-64f8cee5-4639-45fd-9af5-b5bed2551b33 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a" status: 200 len: 1259 microversion: 2.1 time: 0.385556 Sep 24 21:05:30.178863 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2096/4189] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:29 2022] GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a => generated 1259 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:30.227845 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-18fb6324-3d0e-49ad-9d3d-e47ebf6fd880 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:30.228374 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-18fb6324-3d0e-49ad-9d3d-e47ebf6fd880 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] [instance: aaf7e661-b399-490d-9890-487af6418b95] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:30.239024 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-18fb6324-3d0e-49ad-9d3d-e47ebf6fd880 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:30.239516 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-18fb6324-3d0e-49ad-9d3d-e47ebf6fd880 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:30.240067 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-18fb6324-3d0e-49ad-9d3d-e47ebf6fd880 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:30.244954 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-18fb6324-3d0e-49ad-9d3d-e47ebf6fd880 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:30.251694 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-18fb6324-3d0e-49ad-9d3d-e47ebf6fd880 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:30.252769 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-18fb6324-3d0e-49ad-9d3d-e47ebf6fd880 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:30.437802 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-27aa1c75-677b-4c69-8ac6-1f039cb9f6df tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:30.449856 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-27aa1c75-677b-4c69-8ac6-1f039cb9f6df tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1675 microversion: 2.1 time: 0.912018 Sep 24 21:05:30.453438 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2094/4190] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:29 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1675 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:30.747468 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-18fb6324-3d0e-49ad-9d3d-e47ebf6fd880 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05599f233ca45c39ccd351c0432f1ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee2eb7dffa647fb89edd0cf7d1cb454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:30.759878 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-18fb6324-3d0e-49ad-9d3d-e47ebf6fd880 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] 10.222.0.52 "GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95" status: 200 len: 1328 microversion: 2.1 time: 0.538215 Sep 24 21:05:30.760494 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2097/4191] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:30 2022] GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95 => generated 1328 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:31.198024 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dd258eda-8f25-46e7-b265-04e257303850 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:31.198914 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-dd258eda-8f25-46e7-b265-04e257303850 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:31.209790 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd258eda-8f25-46e7-b265-04e257303850 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:31.212942 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd258eda-8f25-46e7-b265-04e257303850 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:31.214358 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd258eda-8f25-46e7-b265-04e257303850 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:31.219786 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd258eda-8f25-46e7-b265-04e257303850 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:31.220997 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd258eda-8f25-46e7-b265-04e257303850 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:31.222294 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd258eda-8f25-46e7-b265-04e257303850 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:31.453386 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-dd258eda-8f25-46e7-b265-04e257303850 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:31.464340 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-dd258eda-8f25-46e7-b265-04e257303850 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a" status: 200 len: 1259 microversion: 2.1 time: 0.270692 Sep 24 21:05:31.467676 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2095/4192] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:31 2022] GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a => generated 1259 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:31.480240 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f76a4389-2c2c-4ee2-a103-5d6cc4b82bc3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:31.480901 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f76a4389-2c2c-4ee2-a103-5d6cc4b82bc3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:31.509620 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f76a4389-2c2c-4ee2-a103-5d6cc4b82bc3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:31.510138 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f76a4389-2c2c-4ee2-a103-5d6cc4b82bc3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:31.513229 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f76a4389-2c2c-4ee2-a103-5d6cc4b82bc3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:31.514016 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f76a4389-2c2c-4ee2-a103-5d6cc4b82bc3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:31.519260 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f76a4389-2c2c-4ee2-a103-5d6cc4b82bc3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:31.523751 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f76a4389-2c2c-4ee2-a103-5d6cc4b82bc3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:31.788845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-104d218a-b568-440f-a466-79f65edcfb4f tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:31.790482 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-104d218a-b568-440f-a466-79f65edcfb4f tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] [instance: aaf7e661-b399-490d-9890-487af6418b95] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:31.809160 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-104d218a-b568-440f-a466-79f65edcfb4f tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:31.810262 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-104d218a-b568-440f-a466-79f65edcfb4f tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:31.811245 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-104d218a-b568-440f-a466-79f65edcfb4f tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:31.817579 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-104d218a-b568-440f-a466-79f65edcfb4f tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:31.819640 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-104d218a-b568-440f-a466-79f65edcfb4f tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:31.820632 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-104d218a-b568-440f-a466-79f65edcfb4f tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:31.837743 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:05:32.192111 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f76a4389-2c2c-4ee2-a103-5d6cc4b82bc3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:32.208474 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f76a4389-2c2c-4ee2-a103-5d6cc4b82bc3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.734643 Sep 24 21:05:32.210189 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2098/4193] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:31 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:32.451601 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-104d218a-b568-440f-a466-79f65edcfb4f tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05599f233ca45c39ccd351c0432f1ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee2eb7dffa647fb89edd0cf7d1cb454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:32.470467 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-104d218a-b568-440f-a466-79f65edcfb4f tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] 10.222.0.52 "GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95" status: 200 len: 1328 microversion: 2.1 time: 0.688539 Sep 24 21:05:32.473526 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2096/4194] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:31 2022] GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95 => generated 1328 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:32.503431 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-94259d3a-ba93-4349-9678-97283106bb2d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:32.504957 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-94259d3a-ba93-4349-9678-97283106bb2d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:32.521576 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-94259d3a-ba93-4349-9678-97283106bb2d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:32.524252 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-94259d3a-ba93-4349-9678-97283106bb2d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:32.524999 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-94259d3a-ba93-4349-9678-97283106bb2d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:32.526207 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-94259d3a-ba93-4349-9678-97283106bb2d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:32.529043 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-94259d3a-ba93-4349-9678-97283106bb2d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:32.532632 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-94259d3a-ba93-4349-9678-97283106bb2d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:32.659878 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-94259d3a-ba93-4349-9678-97283106bb2d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:32.674782 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-94259d3a-ba93-4349-9678-97283106bb2d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a" status: 200 len: 1265 microversion: 2.1 time: 0.180914 Sep 24 21:05:32.693038 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2099/4195] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:32 2022] GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:05:33.067006 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0b744f5b-6d1b-41f0-bed6-6d7d650e9950 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-819019492", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": "none"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:05:33.135933 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-0b744f5b-6d1b-41f0-bed6-6d7d650e9950 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:05:33.136550 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-0b744f5b-6d1b-41f0-bed6-6d7d650e9950 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:05:33.137387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-0b744f5b-6d1b-41f0-bed6-6d7d650e9950 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:05:33.137974 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-0b744f5b-6d1b-41f0-bed6-6d7d650e9950 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:05:33.138586 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-0b744f5b-6d1b-41f0-bed6-6d7d650e9950 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:05:33.148699 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b744f5b-6d1b-41f0-bed6-6d7d650e9950 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:33.149457 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b744f5b-6d1b-41f0-bed6-6d7d650e9950 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:33.150243 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b744f5b-6d1b-41f0-bed6-6d7d650e9950 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:33.151238 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b744f5b-6d1b-41f0-bed6-6d7d650e9950 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:33.151896 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b744f5b-6d1b-41f0-bed6-6d7d650e9950 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:33.152514 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b744f5b-6d1b-41f0-bed6-6d7d650e9950 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:33.175349 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-0b744f5b-6d1b-41f0-bed6-6d7d650e9950 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Getting quotas for project b9bb8e91bd434e1e91c19ba084855d7c. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:05:33.192138 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-0b744f5b-6d1b-41f0-bed6-6d7d650e9950 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Getting quotas for user 6910dfaa89b04d3b9316992d78e9424c and project b9bb8e91bd434e1e91c19ba084855d7c. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:05:33.229238 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0b744f5b-6d1b-41f0-bed6-6d7d650e9950 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:05:33.231730 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0b744f5b-6d1b-41f0-bed6-6d7d650e9950 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: 2a528bdf-0173-49f6-ad84-55b3f67f0c77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:05:33.319766 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0b744f5b-6d1b-41f0-bed6-6d7d650e9950 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.515003 Sep 24 21:05:33.322569 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2097/4196] 10.222.0.52 () {62 vars in 1188 bytes} [Sat Sep 24 21:05:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 24 21:05:33.334712 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1db03da2-c18b-4b26-b010-5e96326b7f58 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:33.335614 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1db03da2-c18b-4b26-b010-5e96326b7f58 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: 2a528bdf-0173-49f6-ad84-55b3f67f0c77] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:33.499507 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-af90be93-cb98-4b0c-ac94-93abae56d509 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:33.500013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1db03da2-c18b-4b26-b010-5e96326b7f58 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:33.500386 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-af90be93-cb98-4b0c-ac94-93abae56d509 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] [instance: aaf7e661-b399-490d-9890-487af6418b95] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:33.515107 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1db03da2-c18b-4b26-b010-5e96326b7f58 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:33.516668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1db03da2-c18b-4b26-b010-5e96326b7f58 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:33.518026 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1db03da2-c18b-4b26-b010-5e96326b7f58 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/2a528bdf-0173-49f6-ad84-55b3f67f0c77" status: 200 len: 1277 microversion: 2.47 time: 0.188395 Sep 24 21:05:33.530523 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af90be93-cb98-4b0c-ac94-93abae56d509 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:33.530775 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2100/4197] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:05:33 2022] GET /compute/v2.1/servers/2a528bdf-0173-49f6-ad84-55b3f67f0c77 => generated 1277 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:05:33.530894 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af90be93-cb98-4b0c-ac94-93abae56d509 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:33.530894 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af90be93-cb98-4b0c-ac94-93abae56d509 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:33.530894 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af90be93-cb98-4b0c-ac94-93abae56d509 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:33.530894 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af90be93-cb98-4b0c-ac94-93abae56d509 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:33.530894 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af90be93-cb98-4b0c-ac94-93abae56d509 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:33.603975 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e57efba5-8ef3-4050-ad18-39d50fa601fa tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-687290094", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": "none"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:05:33.723009 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-e57efba5-8ef3-4050-ad18-39d50fa601fa tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:05:33.723625 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-e57efba5-8ef3-4050-ad18-39d50fa601fa tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:05:33.724344 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-e57efba5-8ef3-4050-ad18-39d50fa601fa tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:05:33.725074 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-e57efba5-8ef3-4050-ad18-39d50fa601fa tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:05:33.726532 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-e57efba5-8ef3-4050-ad18-39d50fa601fa tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:05:33.750136 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e57efba5-8ef3-4050-ad18-39d50fa601fa tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:33.750711 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e57efba5-8ef3-4050-ad18-39d50fa601fa tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:33.754814 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e57efba5-8ef3-4050-ad18-39d50fa601fa tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:33.766296 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e57efba5-8ef3-4050-ad18-39d50fa601fa tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:33.767570 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e57efba5-8ef3-4050-ad18-39d50fa601fa tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:33.768208 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e57efba5-8ef3-4050-ad18-39d50fa601fa tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:33.837140 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-e57efba5-8ef3-4050-ad18-39d50fa601fa tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Getting quotas for project b9bb8e91bd434e1e91c19ba084855d7c. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:05:33.862982 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-e57efba5-8ef3-4050-ad18-39d50fa601fa tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Getting quotas for user 6910dfaa89b04d3b9316992d78e9424c and project b9bb8e91bd434e1e91c19ba084855d7c. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:05:33.894027 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e57efba5-8ef3-4050-ad18-39d50fa601fa tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:05:33.899777 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e57efba5-8ef3-4050-ad18-39d50fa601fa tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:05:34.041201 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e57efba5-8ef3-4050-ad18-39d50fa601fa tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.441908 Sep 24 21:05:34.042587 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2101/4198] 10.222.0.52 () {62 vars in 1188 bytes} [Sat Sep 24 21:05:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 444 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 24 21:05:34.048768 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fe42770b-2278-4d32-bfd9-ff36cad19ef5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:34.050272 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fe42770b-2278-4d32-bfd9-ff36cad19ef5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:34.058907 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fe42770b-2278-4d32-bfd9-ff36cad19ef5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:34.059691 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fe42770b-2278-4d32-bfd9-ff36cad19ef5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:34.060355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fe42770b-2278-4d32-bfd9-ff36cad19ef5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:34.061326 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fe42770b-2278-4d32-bfd9-ff36cad19ef5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:34.062022 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fe42770b-2278-4d32-bfd9-ff36cad19ef5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:34.062581 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fe42770b-2278-4d32-bfd9-ff36cad19ef5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:34.188487 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-af90be93-cb98-4b0c-ac94-93abae56d509 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05599f233ca45c39ccd351c0432f1ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee2eb7dffa647fb89edd0cf7d1cb454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:34.198535 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-af90be93-cb98-4b0c-ac94-93abae56d509 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] 10.222.0.52 "GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95" status: 200 len: 1328 microversion: 2.1 time: 0.704883 Sep 24 21:05:34.206850 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2098/4199] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:33 2022] GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95 => generated 1328 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:34.576023 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-c65f2009-0043-4ce0-8d86-a73928d3db52 req-2ecca652-514b-4ed4-bf00-1e4ddd7868bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaf7e661-b399-490d-9890-487af6418b95", "name": "network-vif-plugged", "status": "completed", "tag": "efa62d63-5684-4475-8cad-bb83c067cfbc"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:05:34.586042 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fe42770b-2278-4d32-bfd9-ff36cad19ef5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:34.598274 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fe42770b-2278-4d32-bfd9-ff36cad19ef5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a" status: 200 len: 1307 microversion: 2.1 time: 0.554166 Sep 24 21:05:34.598924 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2102/4200] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:34 2022] GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a => generated 1307 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:34.602346 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c65f2009-0043-4ce0-8d86-a73928d3db52 req-2ecca652-514b-4ed4-bf00-1e4ddd7868bc service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:34.604591 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c65f2009-0043-4ce0-8d86-a73928d3db52 req-2ecca652-514b-4ed4-bf00-1e4ddd7868bc service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:34.606544 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c65f2009-0043-4ce0-8d86-a73928d3db52 req-2ecca652-514b-4ed4-bf00-1e4ddd7868bc service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:34.625988 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-82224f6a-ea70-4d49-a25b-b25cf9262d35 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:05:34.648482 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-82224f6a-ea70-4d49-a25b-b25cf9262d35 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:34.651737 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-c65f2009-0043-4ce0-8d86-a73928d3db52 req-2ecca652-514b-4ed4-bf00-1e4ddd7868bc service nova] Creating event network-vif-plugged:efa62d63-5684-4475-8cad-bb83c067cfbc for instance aaf7e661-b399-490d-9890-487af6418b95 on nch2-master-1 Sep 24 21:05:34.682858 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-c65f2009-0043-4ce0-8d86-a73928d3db52 req-2ecca652-514b-4ed4-bf00-1e4ddd7868bc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.474277 Sep 24 21:05:34.683477 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2099/4201] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:05:34.689571 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-d2807304-5ff9-4cf4-aacf-f42dc8de128d req-7d07df07-d75a-403f-a3dc-b6a4f157b272 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a", "tag": "2407e9d3-2a9d-4740-9d8e-dd3109d28da2"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:05:34.710785 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-82224f6a-ea70-4d49-a25b-b25cf9262d35 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "PUT /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 991 microversion: 2.47 time: 0.098150 Sep 24 21:05:34.711704 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2103/4202] 10.222.0.52 () {62 vars in 1297 bytes} [Sat Sep 24 21:05:34 2022] PUT /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 991 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:05:34.734979 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-696947b6-cee4-4f7a-8628-e9f62281a2f6 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:34.735668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-696947b6-cee4-4f7a-8628-e9f62281a2f6 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:34.744732 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d2807304-5ff9-4cf4-aacf-f42dc8de128d req-7d07df07-d75a-403f-a3dc-b6a4f157b272 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:34.745203 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d2807304-5ff9-4cf4-aacf-f42dc8de128d req-7d07df07-d75a-403f-a3dc-b6a4f157b272 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:34.745706 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d2807304-5ff9-4cf4-aacf-f42dc8de128d req-7d07df07-d75a-403f-a3dc-b6a4f157b272 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:34.770829 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-d2807304-5ff9-4cf4-aacf-f42dc8de128d req-7d07df07-d75a-403f-a3dc-b6a4f157b272 service nova] Creating event network-changed:2407e9d3-2a9d-4740-9d8e-dd3109d28da2 for instance fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a on nch1-master-1 Sep 24 21:05:34.786118 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-d2807304-5ff9-4cf4-aacf-f42dc8de128d req-7d07df07-d75a-403f-a3dc-b6a4f157b272 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100950 Sep 24 21:05:34.786834 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2100/4203] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:05:34.980127 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-696947b6-cee4-4f7a-8628-e9f62281a2f6 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:34.988777 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-696947b6-cee4-4f7a-8628-e9f62281a2f6 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:34.994082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-696947b6-cee4-4f7a-8628-e9f62281a2f6 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:34.997766 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-696947b6-cee4-4f7a-8628-e9f62281a2f6 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1277 microversion: 2.47 time: 0.267257 Sep 24 21:05:34.999111 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2104/4204] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:05:34 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1277 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:05:35.229274 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ecf06851-54ae-45da-ab7a-0e498eb3b061 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:35.229851 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ecf06851-54ae-45da-ab7a-0e498eb3b061 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] [instance: aaf7e661-b399-490d-9890-487af6418b95] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:35.244609 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ecf06851-54ae-45da-ab7a-0e498eb3b061 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:35.247352 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ecf06851-54ae-45da-ab7a-0e498eb3b061 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:35.251480 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ecf06851-54ae-45da-ab7a-0e498eb3b061 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:35.253132 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ecf06851-54ae-45da-ab7a-0e498eb3b061 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:35.253784 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ecf06851-54ae-45da-ab7a-0e498eb3b061 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:35.254545 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ecf06851-54ae-45da-ab7a-0e498eb3b061 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:35.626874 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0b4578d1-f255-4e83-9aa4-34dba1191c67 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:35.627604 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0b4578d1-f255-4e83-9aa4-34dba1191c67 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:35.642659 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0b4578d1-f255-4e83-9aa4-34dba1191c67 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:35.643165 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0b4578d1-f255-4e83-9aa4-34dba1191c67 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:35.643611 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0b4578d1-f255-4e83-9aa4-34dba1191c67 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:35.644430 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0b4578d1-f255-4e83-9aa4-34dba1191c67 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:35.644886 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0b4578d1-f255-4e83-9aa4-34dba1191c67 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:35.659382 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0b4578d1-f255-4e83-9aa4-34dba1191c67 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:36.105430 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ecf06851-54ae-45da-ab7a-0e498eb3b061 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05599f233ca45c39ccd351c0432f1ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee2eb7dffa647fb89edd0cf7d1cb454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:36.116642 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ecf06851-54ae-45da-ab7a-0e498eb3b061 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] 10.222.0.52 "GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95" status: 200 len: 1328 microversion: 2.1 time: 0.894917 Sep 24 21:05:36.118960 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2101/4205] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:35 2022] GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95 => generated 1328 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:36.123870 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7d028634-f6d9-49b0-b4b9-9da62fee8f65 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:36.125073 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7d028634-f6d9-49b0-b4b9-9da62fee8f65 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:36.132601 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7d028634-f6d9-49b0-b4b9-9da62fee8f65 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:36.134307 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7d028634-f6d9-49b0-b4b9-9da62fee8f65 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:36.135012 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7d028634-f6d9-49b0-b4b9-9da62fee8f65 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:36.135924 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7d028634-f6d9-49b0-b4b9-9da62fee8f65 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:36.136555 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7d028634-f6d9-49b0-b4b9-9da62fee8f65 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:36.137175 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7d028634-f6d9-49b0-b4b9-9da62fee8f65 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:36.259121 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7d028634-f6d9-49b0-b4b9-9da62fee8f65 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:36.274356 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7d028634-f6d9-49b0-b4b9-9da62fee8f65 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:36.276982 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7d028634-f6d9-49b0-b4b9-9da62fee8f65 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:36.281577 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7d028634-f6d9-49b0-b4b9-9da62fee8f65 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1329 microversion: 2.47 time: 0.161349 Sep 24 21:05:36.282745 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2102/4206] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:05:36 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1329 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:05:36.359087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0b4578d1-f255-4e83-9aa4-34dba1191c67 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:36.373271 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0b4578d1-f255-4e83-9aa4-34dba1191c67 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a" status: 200 len: 1307 microversion: 2.1 time: 0.750325 Sep 24 21:05:36.388077 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2105/4207] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:35 2022] GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a => generated 1307 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:37.147358 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ccd99ddc-4ab3-46af-a9e7-fdc7c5b58704 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:37.148874 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ccd99ddc-4ab3-46af-a9e7-fdc7c5b58704 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] [instance: aaf7e661-b399-490d-9890-487af6418b95] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:37.156631 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ccd99ddc-4ab3-46af-a9e7-fdc7c5b58704 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:37.157640 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ccd99ddc-4ab3-46af-a9e7-fdc7c5b58704 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:37.159922 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ccd99ddc-4ab3-46af-a9e7-fdc7c5b58704 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:37.161337 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ccd99ddc-4ab3-46af-a9e7-fdc7c5b58704 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:37.161985 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ccd99ddc-4ab3-46af-a9e7-fdc7c5b58704 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:37.162430 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ccd99ddc-4ab3-46af-a9e7-fdc7c5b58704 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:37.309857 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b2992b4f-4b78-45c7-b793-7a051ca7ecfb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:37.310555 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b2992b4f-4b78-45c7-b793-7a051ca7ecfb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:37.324580 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2992b4f-4b78-45c7-b793-7a051ca7ecfb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:37.325561 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2992b4f-4b78-45c7-b793-7a051ca7ecfb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:37.326193 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2992b4f-4b78-45c7-b793-7a051ca7ecfb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:37.331904 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2992b4f-4b78-45c7-b793-7a051ca7ecfb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:37.332987 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2992b4f-4b78-45c7-b793-7a051ca7ecfb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:37.334383 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2992b4f-4b78-45c7-b793-7a051ca7ecfb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:37.461345 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b2992b4f-4b78-45c7-b793-7a051ca7ecfb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:37.471148 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b2992b4f-4b78-45c7-b793-7a051ca7ecfb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:37.473287 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b2992b4f-4b78-45c7-b793-7a051ca7ecfb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:37.475249 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b2992b4f-4b78-45c7-b793-7a051ca7ecfb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1329 microversion: 2.47 time: 0.170070 Sep 24 21:05:37.476314 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2106/4208] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:05:37 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1329 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:05:37.494073 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-82e5799b-ac67-42b2-bc83-4bbab66f5ae2 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:37.495036 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-82e5799b-ac67-42b2-bc83-4bbab66f5ae2 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:37.502679 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82e5799b-ac67-42b2-bc83-4bbab66f5ae2 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:37.503993 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82e5799b-ac67-42b2-bc83-4bbab66f5ae2 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:37.504655 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82e5799b-ac67-42b2-bc83-4bbab66f5ae2 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:37.506198 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82e5799b-ac67-42b2-bc83-4bbab66f5ae2 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:37.507565 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82e5799b-ac67-42b2-bc83-4bbab66f5ae2 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:37.508174 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82e5799b-ac67-42b2-bc83-4bbab66f5ae2 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:37.568898 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ccd99ddc-4ab3-46af-a9e7-fdc7c5b58704 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05599f233ca45c39ccd351c0432f1ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee2eb7dffa647fb89edd0cf7d1cb454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:37.578125 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ccd99ddc-4ab3-46af-a9e7-fdc7c5b58704 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] 10.222.0.52 "GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95" status: 200 len: 1528 microversion: 2.1 time: 0.438020 Sep 24 21:05:37.584017 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2103/4209] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:37 2022] GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95 => generated 1528 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:37.603124 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-43c7c8d7-ed17-4566-bf55-b91d2560fd87 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:37.603763 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-43c7c8d7-ed17-4566-bf55-b91d2560fd87 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] [instance: aaf7e661-b399-490d-9890-487af6418b95] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:37.621745 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-43c7c8d7-ed17-4566-bf55-b91d2560fd87 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:37.622306 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-43c7c8d7-ed17-4566-bf55-b91d2560fd87 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:37.623530 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-43c7c8d7-ed17-4566-bf55-b91d2560fd87 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:37.624319 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-43c7c8d7-ed17-4566-bf55-b91d2560fd87 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:37.624793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-43c7c8d7-ed17-4566-bf55-b91d2560fd87 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:37.626369 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-43c7c8d7-ed17-4566-bf55-b91d2560fd87 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:37.877882 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-82e5799b-ac67-42b2-bc83-4bbab66f5ae2 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:37.894446 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-82e5799b-ac67-42b2-bc83-4bbab66f5ae2 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a" status: 200 len: 1307 microversion: 2.1 time: 0.416865 Sep 24 21:05:37.912474 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2107/4210] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:37 2022] GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a => generated 1307 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:37.938674 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-43c7c8d7-ed17-4566-bf55-b91d2560fd87 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05599f233ca45c39ccd351c0432f1ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee2eb7dffa647fb89edd0cf7d1cb454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:37.951304 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-43c7c8d7-ed17-4566-bf55-b91d2560fd87 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] 10.222.0.52 "GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95" status: 200 len: 1528 microversion: 2.1 time: 0.352861 Sep 24 21:05:37.962886 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2104/4211] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:37 2022] GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95 => generated 1528 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:05:38.208213 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-94019ed6-0828-49b0-9fbe-b5feb9b04aff tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-702772017", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "4ceddc74-bd13-4267-96ac-1bb472667a6c"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:05:38.317275 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-94019ed6-0828-49b0-9fbe-b5feb9b04aff tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] validate_networks() for [('4ceddc74-bd13-4267-96ac-1bb472667a6c', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:05:38.385715 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6162c8a0-500e-416e-9294-39c5f6957d24 tempest-ServersNegativeTestMultiTenantJSON-1912298894 tempest-ServersNegativeTestMultiTenantJSON-1912298894-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:38.386298 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6162c8a0-500e-416e-9294-39c5f6957d24 tempest-ServersNegativeTestMultiTenantJSON-1912298894 tempest-ServersNegativeTestMultiTenantJSON-1912298894-project] [instance: aaf7e661-b399-490d-9890-487af6418b95] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:38.393746 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6162c8a0-500e-416e-9294-39c5f6957d24 tempest-ServersNegativeTestMultiTenantJSON-1912298894 tempest-ServersNegativeTestMultiTenantJSON-1912298894-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:38.394253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6162c8a0-500e-416e-9294-39c5f6957d24 tempest-ServersNegativeTestMultiTenantJSON-1912298894 tempest-ServersNegativeTestMultiTenantJSON-1912298894-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:38.394725 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6162c8a0-500e-416e-9294-39c5f6957d24 tempest-ServersNegativeTestMultiTenantJSON-1912298894 tempest-ServersNegativeTestMultiTenantJSON-1912298894-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:38.395653 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6162c8a0-500e-416e-9294-39c5f6957d24 tempest-ServersNegativeTestMultiTenantJSON-1912298894 tempest-ServersNegativeTestMultiTenantJSON-1912298894-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:38.396957 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6162c8a0-500e-416e-9294-39c5f6957d24 tempest-ServersNegativeTestMultiTenantJSON-1912298894 tempest-ServersNegativeTestMultiTenantJSON-1912298894-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:38.398066 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6162c8a0-500e-416e-9294-39c5f6957d24 tempest-ServersNegativeTestMultiTenantJSON-1912298894 tempest-ServersNegativeTestMultiTenantJSON-1912298894-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:38.420280 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-6162c8a0-500e-416e-9294-39c5f6957d24 tempest-ServersNegativeTestMultiTenantJSON-1912298894 tempest-ServersNegativeTestMultiTenantJSON-1912298894-project] HTTP exception thrown: Instance aaf7e661-b399-490d-9890-487af6418b95 could not be found. Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6162c8a0-500e-416e-9294-39c5f6957d24 tempest-ServersNegativeTestMultiTenantJSON-1912298894 tempest-ServersNegativeTestMultiTenantJSON-1912298894-project] Request method failure captured: Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95 HTTP/1.1 Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3EKaVHej_ZQYtl9ZK3FFy2PLgXQxnqEsopf7gshn9aaAWTYzqiapnRciMYy-xKjZ4rcODSGsMuHYhlacaeC5Lr_UTJdCYX_E8g2To1x6FT9y2zyLiOJtBJR9jE1Em1cWx2SbdxSzJby6hkQQ820nqKkUJoDOp2nMLLEzzFiKX3dm-I Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: d9836534a7794c98b32eaec0170e83b8 Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1912298894 Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d9836534a7794c98b32eaec0170e83b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d9836534a7794c98b32eaec0170e83b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d9836534a7794c98b32eaec0170e83b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d9836534a7794c98b32eaec0170e83b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1912298894 Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: d9836534a7794c98b32eaec0170e83b8 Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1912298894 Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1912298894-project Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 09443ab1a6ac4b5db4567fa891abe1d1 Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1912298894-project Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance aaf7e661-b399-490d-9890-487af6418b95 could not be found. Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'aaf7e661-b399-490d-9890-487af6418b95'} Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaf7e661-b399-490d-9890-487af6418b95 could not be found. Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:05:38.421999 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:05:38.427710 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaf7e661-b399-490d-9890-487af6418b95 could not be found. Sep 24 21:05:38.427710 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:05:38.427710 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:05:38.427710 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:05:38.427710 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:05:38.427710 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:05:38.427710 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:05:38.427710 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:05:38.427710 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:05:38.427710 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaf7e661-b399-490d-9890-487af6418b95 could not be found. Sep 24 21:05:38.427710 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:05:38.427710 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6162c8a0-500e-416e-9294-39c5f6957d24 tempest-ServersNegativeTestMultiTenantJSON-1912298894 tempest-ServersNegativeTestMultiTenantJSON-1912298894-project] Returning 404 to user: Instance aaf7e661-b399-490d-9890-487af6418b95 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:05:38.427710 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6162c8a0-500e-416e-9294-39c5f6957d24 tempest-ServersNegativeTestMultiTenantJSON-1912298894 tempest-ServersNegativeTestMultiTenantJSON-1912298894-project] 10.222.0.52 "DELETE /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95" status: 404 len: 111 microversion: 2.1 time: 0.451240 Sep 24 21:05:38.446667 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2105/4212] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:05:37 2022] DELETE /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95 => generated 111 bytes in 464 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 21:05:38.466696 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a61e1c00-0e0b-4014-808a-1e2988b74a1b tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:38.469214 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a61e1c00-0e0b-4014-808a-1e2988b74a1b tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] [instance: aaf7e661-b399-490d-9890-487af6418b95] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:38.486459 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a61e1c00-0e0b-4014-808a-1e2988b74a1b tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:38.486459 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a61e1c00-0e0b-4014-808a-1e2988b74a1b tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:38.486763 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a61e1c00-0e0b-4014-808a-1e2988b74a1b tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:38.491676 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a61e1c00-0e0b-4014-808a-1e2988b74a1b tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:38.492259 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a61e1c00-0e0b-4014-808a-1e2988b74a1b tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:38.492766 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a61e1c00-0e0b-4014-808a-1e2988b74a1b tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:38.816509 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a61e1c00-0e0b-4014-808a-1e2988b74a1b tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05599f233ca45c39ccd351c0432f1ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee2eb7dffa647fb89edd0cf7d1cb454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:38.827492 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a61e1c00-0e0b-4014-808a-1e2988b74a1b tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] 10.222.0.52 "GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95" status: 200 len: 1528 microversion: 2.1 time: 0.379569 Sep 24 21:05:38.830846 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2106/4213] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:38 2022] GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95 => generated 1528 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:38.837207 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e37cea0c-d7e3-456d-ad4e-c98ca1f2ef0a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:38.844251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e37cea0c-d7e3-456d-ad4e-c98ca1f2ef0a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:38.864637 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e37cea0c-d7e3-456d-ad4e-c98ca1f2ef0a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:38.867014 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e37cea0c-d7e3-456d-ad4e-c98ca1f2ef0a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:38.870846 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e37cea0c-d7e3-456d-ad4e-c98ca1f2ef0a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:38.871891 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e37cea0c-d7e3-456d-ad4e-c98ca1f2ef0a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:38.873208 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e37cea0c-d7e3-456d-ad4e-c98ca1f2ef0a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:38.875555 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e37cea0c-d7e3-456d-ad4e-c98ca1f2ef0a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:39.041468 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e37cea0c-d7e3-456d-ad4e-c98ca1f2ef0a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:39.054834 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e37cea0c-d7e3-456d-ad4e-c98ca1f2ef0a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:39.062563 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e37cea0c-d7e3-456d-ad4e-c98ca1f2ef0a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:39.064194 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e37cea0c-d7e3-456d-ad4e-c98ca1f2ef0a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1337 microversion: 2.47 time: 0.231739 Sep 24 21:05:39.065097 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2107/4214] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:05:38 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1337 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:05:39.071460 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ee09ad08-cd85-4cc9-9856-c5bb9ac3891b tempest-ServersNegativeTestMultiTenantJSON-1912298894 tempest-ServersNegativeTestMultiTenantJSON-1912298894-project] Action: 'update', calling method: >, body: {"server": {"name": "aaf7e661-b399-490d-9890-487af6418b95_new"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:05:39.074124 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ee09ad08-cd85-4cc9-9856-c5bb9ac3891b tempest-ServersNegativeTestMultiTenantJSON-1912298894 tempest-ServersNegativeTestMultiTenantJSON-1912298894-project] [instance: aaf7e661-b399-490d-9890-487af6418b95] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:39.082722 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee09ad08-cd85-4cc9-9856-c5bb9ac3891b tempest-ServersNegativeTestMultiTenantJSON-1912298894 tempest-ServersNegativeTestMultiTenantJSON-1912298894-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:39.083221 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee09ad08-cd85-4cc9-9856-c5bb9ac3891b tempest-ServersNegativeTestMultiTenantJSON-1912298894 tempest-ServersNegativeTestMultiTenantJSON-1912298894-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:39.084659 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee09ad08-cd85-4cc9-9856-c5bb9ac3891b tempest-ServersNegativeTestMultiTenantJSON-1912298894 tempest-ServersNegativeTestMultiTenantJSON-1912298894-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:39.085582 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee09ad08-cd85-4cc9-9856-c5bb9ac3891b tempest-ServersNegativeTestMultiTenantJSON-1912298894 tempest-ServersNegativeTestMultiTenantJSON-1912298894-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:39.086193 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee09ad08-cd85-4cc9-9856-c5bb9ac3891b tempest-ServersNegativeTestMultiTenantJSON-1912298894 tempest-ServersNegativeTestMultiTenantJSON-1912298894-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:39.086661 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee09ad08-cd85-4cc9-9856-c5bb9ac3891b tempest-ServersNegativeTestMultiTenantJSON-1912298894 tempest-ServersNegativeTestMultiTenantJSON-1912298894-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:39.103367 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-ee09ad08-cd85-4cc9-9856-c5bb9ac3891b tempest-ServersNegativeTestMultiTenantJSON-1912298894 tempest-ServersNegativeTestMultiTenantJSON-1912298894-project] HTTP exception thrown: Instance aaf7e661-b399-490d-9890-487af6418b95 could not be found. Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ee09ad08-cd85-4cc9-9856-c5bb9ac3891b tempest-ServersNegativeTestMultiTenantJSON-1912298894 tempest-ServersNegativeTestMultiTenantJSON-1912298894-project] Request method failure captured: Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: request: PUT /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95 HTTP/1.1 Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 64 Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3EKaVHej_ZQYtl9ZK3FFy2PLgXQxnqEsopf7gshn9aaAWTYzqiapnRciMYy-xKjZ4rcODSGsMuHYhlacaeC5Lr_UTJdCYX_E8g2To1x6FT9y2zyLiOJtBJR9jE1Em1cWx2SbdxSzJby6hkQQ820nqKkUJoDOp2nMLLEzzFiKX3dm-I Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: d9836534a7794c98b32eaec0170e83b8 Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1912298894 Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d9836534a7794c98b32eaec0170e83b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d9836534a7794c98b32eaec0170e83b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d9836534a7794c98b32eaec0170e83b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d9836534a7794c98b32eaec0170e83b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1912298894 Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: d9836534a7794c98b32eaec0170e83b8 Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1912298894 Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1912298894-project Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 09443ab1a6ac4b5db4567fa891abe1d1 Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1912298894-project Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: {"server": {"name": "aaf7e661-b399-490d-9890-487af6418b95_new"}} Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance aaf7e661-b399-490d-9890-487af6418b95 could not be found. Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'aaf7e661-b399-490d-9890-487af6418b95', 'body': {'server': {'name': 'aaf7e661-b399-490d-9890-487af6418b95_new'}}} Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaf7e661-b399-490d-9890-487af6418b95 could not be found. Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:05:39.105262 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 24 21:05:39.111282 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 24 21:05:39.111282 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 24 21:05:39.111282 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:05:39.111282 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:05:39.111282 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:05:39.111282 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:05:39.111282 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaf7e661-b399-490d-9890-487af6418b95 could not be found. Sep 24 21:05:39.111282 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:05:39.111282 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:05:39.111282 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:05:39.111282 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:05:39.111282 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:05:39.111282 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:05:39.111282 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:05:39.111282 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:05:39.111282 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaf7e661-b399-490d-9890-487af6418b95 could not be found. Sep 24 21:05:39.111282 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:05:39.111282 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ee09ad08-cd85-4cc9-9856-c5bb9ac3891b tempest-ServersNegativeTestMultiTenantJSON-1912298894 tempest-ServersNegativeTestMultiTenantJSON-1912298894-project] Returning 404 to user: Instance aaf7e661-b399-490d-9890-487af6418b95 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:05:39.111282 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ee09ad08-cd85-4cc9-9856-c5bb9ac3891b tempest-ServersNegativeTestMultiTenantJSON-1912298894 tempest-ServersNegativeTestMultiTenantJSON-1912298894-project] 10.222.0.52 "PUT /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95" status: 404 len: 111 microversion: 2.1 time: 0.039794 Sep 24 21:05:39.114404 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2108/4215] 10.222.0.52 () {60 vars in 1256 bytes} [Sat Sep 24 21:05:39 2022] PUT /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:05:39.120992 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a32f2fbf-10c9-4219-9fd5-54b3c7701137 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:39.120992 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a32f2fbf-10c9-4219-9fd5-54b3c7701137 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:39.137248 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a32f2fbf-10c9-4219-9fd5-54b3c7701137 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:39.137773 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a32f2fbf-10c9-4219-9fd5-54b3c7701137 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:39.139927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a32f2fbf-10c9-4219-9fd5-54b3c7701137 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:39.143341 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a32f2fbf-10c9-4219-9fd5-54b3c7701137 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:39.144622 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a32f2fbf-10c9-4219-9fd5-54b3c7701137 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:39.145837 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a32f2fbf-10c9-4219-9fd5-54b3c7701137 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:39.267753 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-94019ed6-0828-49b0-9fbe-b5feb9b04aff tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:05:39.268351 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-94019ed6-0828-49b0-9fbe-b5feb9b04aff tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:05:39.269207 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-94019ed6-0828-49b0-9fbe-b5feb9b04aff tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:05:39.269874 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-94019ed6-0828-49b0-9fbe-b5feb9b04aff tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:05:39.270531 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-94019ed6-0828-49b0-9fbe-b5feb9b04aff tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:05:39.282385 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-94019ed6-0828-49b0-9fbe-b5feb9b04aff tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:39.283435 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-94019ed6-0828-49b0-9fbe-b5feb9b04aff tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:39.284499 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-94019ed6-0828-49b0-9fbe-b5feb9b04aff tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:39.285485 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-94019ed6-0828-49b0-9fbe-b5feb9b04aff tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:39.286245 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-94019ed6-0828-49b0-9fbe-b5feb9b04aff tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:39.287397 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-94019ed6-0828-49b0-9fbe-b5feb9b04aff tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:39.329018 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-94019ed6-0828-49b0-9fbe-b5feb9b04aff tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Getting quotas for project 648cf4f432a3400b8dcf2b57a99d082e. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:05:39.343328 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-94019ed6-0828-49b0-9fbe-b5feb9b04aff tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Getting quotas for user 762f4e35de9e4083bd0e7a4d0de3c136 and project 648cf4f432a3400b8dcf2b57a99d082e. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:05:39.375600 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-94019ed6-0828-49b0-9fbe-b5feb9b04aff tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Going to run 3 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:05:39.378403 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-94019ed6-0828-49b0-9fbe-b5feb9b04aff tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: 4f857f30-f6d8-4107-b14d-12502a60fc74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:05:39.404971 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a32f2fbf-10c9-4219-9fd5-54b3c7701137 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:39.426938 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a32f2fbf-10c9-4219-9fd5-54b3c7701137 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a" status: 200 len: 1307 microversion: 2.1 time: 0.308092 Sep 24 21:05:39.430525 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2109/4216] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:39 2022] GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a => generated 1307 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:39.432741 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-94019ed6-0828-49b0-9fbe-b5feb9b04aff tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: fd3a51be-17a5-4293-9bad-a3768d7ec10b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=4f857f30-f6d8-4107-b14d-12502a60fc74,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:05:39.435954 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-10ba4b5f-ad03-4d8b-913d-0853141725a7 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:39.436740 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-10ba4b5f-ad03-4d8b-913d-0853141725a7 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] [instance: aaf7e661-b399-490d-9890-487af6418b95] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:39.467094 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10ba4b5f-ad03-4d8b-913d-0853141725a7 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:39.468060 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10ba4b5f-ad03-4d8b-913d-0853141725a7 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:39.468758 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10ba4b5f-ad03-4d8b-913d-0853141725a7 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:39.469720 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10ba4b5f-ad03-4d8b-913d-0853141725a7 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:39.470383 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10ba4b5f-ad03-4d8b-913d-0853141725a7 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:39.471600 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10ba4b5f-ad03-4d8b-913d-0853141725a7 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:39.504544 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-94019ed6-0828-49b0-9fbe-b5feb9b04aff tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: c5bd74b9-2a72-452a-b603-9b99fba57f9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=fd3a51be-17a5-4293-9bad-a3768d7ec10b,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:05:39.541985 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-10ba4b5f-ad03-4d8b-913d-0853141725a7 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] [instance: aaf7e661-b399-490d-9890-487af6418b95] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:05:39.597430 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-94019ed6-0828-49b0-9fbe-b5feb9b04aff tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.654779 Sep 24 21:05:39.598742 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2108/4217] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:05:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 24 21:05:39.615292 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-49bc2fd1-24d0-4196-8a99-f1fac2d7880d tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:39.623351 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-49bc2fd1-24d0-4196-8a99-f1fac2d7880d tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:39.624603 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-49bc2fd1-24d0-4196-8a99-f1fac2d7880d tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Searching by: {'deleted': False, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e'} {{(pid=140517) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 21:05:39.659496 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-49bc2fd1-24d0-4196-8a99-f1fac2d7880d tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:39.660361 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-49bc2fd1-24d0-4196-8a99-f1fac2d7880d tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:39.660914 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-49bc2fd1-24d0-4196-8a99-f1fac2d7880d tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:39.662350 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-49bc2fd1-24d0-4196-8a99-f1fac2d7880d tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:39.663489 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-49bc2fd1-24d0-4196-8a99-f1fac2d7880d tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:39.664114 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-49bc2fd1-24d0-4196-8a99-f1fac2d7880d tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:39.689025 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-49bc2fd1-24d0-4196-8a99-f1fac2d7880d tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.082354 Sep 24 21:05:39.689827 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2109/4218] 10.222.0.52 () {58 vars in 1125 bytes} [Sat Sep 24 21:05:39 2022] GET /compute/v2.1/servers => generated 1015 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:39.704274 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c61885b3-8cfe-48d6-ad5e-e6f5510a7e55 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:39.705608 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c61885b3-8cfe-48d6-ad5e-e6f5510a7e55 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: c5bd74b9-2a72-452a-b603-9b99fba57f9b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:39.799869 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-10ba4b5f-ad03-4d8b-913d-0853141725a7 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] 10.222.0.52 "DELETE /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95" status: 204 len: 0 microversion: 2.1 time: 0.366982 Sep 24 21:05:39.813558 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2110/4219] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:05:39 2022] DELETE /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:05:39.825660 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9402a0f2-873c-4e45-81ed-165dd7359a44 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:39.826783 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9402a0f2-873c-4e45-81ed-165dd7359a44 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] [instance: aaf7e661-b399-490d-9890-487af6418b95] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:39.835517 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9402a0f2-873c-4e45-81ed-165dd7359a44 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:39.836357 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9402a0f2-873c-4e45-81ed-165dd7359a44 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:39.837013 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9402a0f2-873c-4e45-81ed-165dd7359a44 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:39.838099 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9402a0f2-873c-4e45-81ed-165dd7359a44 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:39.838798 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9402a0f2-873c-4e45-81ed-165dd7359a44 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:39.839431 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9402a0f2-873c-4e45-81ed-165dd7359a44 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:40.326365 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c61885b3-8cfe-48d6-ad5e-e6f5510a7e55 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:40.337177 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c61885b3-8cfe-48d6-ad5e-e6f5510a7e55 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b" status: 200 len: 1222 microversion: 2.1 time: 0.637784 Sep 24 21:05:40.338093 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2110/4220] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:39 2022] GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b => generated 1222 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:40.342914 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-58ca2886-825e-49ea-89e8-b85471db8aeb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:40.343526 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-58ca2886-825e-49ea-89e8-b85471db8aeb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:40.371317 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58ca2886-825e-49ea-89e8-b85471db8aeb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:40.371810 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58ca2886-825e-49ea-89e8-b85471db8aeb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:40.372243 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58ca2886-825e-49ea-89e8-b85471db8aeb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:40.374054 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58ca2886-825e-49ea-89e8-b85471db8aeb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:40.374989 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58ca2886-825e-49ea-89e8-b85471db8aeb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:40.375857 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58ca2886-825e-49ea-89e8-b85471db8aeb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:40.522366 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-58ca2886-825e-49ea-89e8-b85471db8aeb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:40.525304 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:05:40.540012 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-58ca2886-825e-49ea-89e8-b85471db8aeb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:40.545021 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-58ca2886-825e-49ea-89e8-b85471db8aeb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:40.548441 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-58ca2886-825e-49ea-89e8-b85471db8aeb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1337 microversion: 2.47 time: 0.207905 Sep 24 21:05:40.550750 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2111/4221] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:05:40 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1337 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:05:40.563077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6d6485bd-6ea6-4f8c-b2c8-84330324e68e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:40.567836 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6d6485bd-6ea6-4f8c-b2c8-84330324e68e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:40.580758 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6d6485bd-6ea6-4f8c-b2c8-84330324e68e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:40.583694 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6d6485bd-6ea6-4f8c-b2c8-84330324e68e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:40.587130 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6d6485bd-6ea6-4f8c-b2c8-84330324e68e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:40.588241 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6d6485bd-6ea6-4f8c-b2c8-84330324e68e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:40.588938 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6d6485bd-6ea6-4f8c-b2c8-84330324e68e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:40.589522 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6d6485bd-6ea6-4f8c-b2c8-84330324e68e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:40.644343 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9402a0f2-873c-4e45-81ed-165dd7359a44 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05599f233ca45c39ccd351c0432f1ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee2eb7dffa647fb89edd0cf7d1cb454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:40.678485 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9402a0f2-873c-4e45-81ed-165dd7359a44 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] 10.222.0.52 "GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95" status: 200 len: 1534 microversion: 2.1 time: 0.858967 Sep 24 21:05:40.698620 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2111/4222] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:39 2022] GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95 => generated 1534 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:40.979495 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6d6485bd-6ea6-4f8c-b2c8-84330324e68e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:40.990710 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6d6485bd-6ea6-4f8c-b2c8-84330324e68e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a" status: 200 len: 1307 microversion: 2.1 time: 0.436186 Sep 24 21:05:40.994549 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2112/4223] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:40 2022] GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a => generated 1307 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:41.360792 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-98f9f913-9880-4a23-b451-235d55f9d05e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:41.361626 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-98f9f913-9880-4a23-b451-235d55f9d05e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: c5bd74b9-2a72-452a-b603-9b99fba57f9b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:41.382645 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:05:41.386927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-98f9f913-9880-4a23-b451-235d55f9d05e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:41.389140 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-98f9f913-9880-4a23-b451-235d55f9d05e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:41.390706 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-98f9f913-9880-4a23-b451-235d55f9d05e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:41.392658 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-98f9f913-9880-4a23-b451-235d55f9d05e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:41.394684 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-98f9f913-9880-4a23-b451-235d55f9d05e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:41.400846 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-98f9f913-9880-4a23-b451-235d55f9d05e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:41.545423 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-98f9f913-9880-4a23-b451-235d55f9d05e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:41.555532 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-98f9f913-9880-4a23-b451-235d55f9d05e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b" status: 200 len: 1226 microversion: 2.1 time: 0.199092 Sep 24 21:05:41.556390 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2112/4224] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:41 2022] GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b => generated 1226 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:41.577233 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-db8b3b67-97dd-4c1a-ae3d-77d97e23471f tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:41.577850 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-db8b3b67-97dd-4c1a-ae3d-77d97e23471f tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:41.586029 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db8b3b67-97dd-4c1a-ae3d-77d97e23471f tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:41.588139 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db8b3b67-97dd-4c1a-ae3d-77d97e23471f tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:41.591026 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db8b3b67-97dd-4c1a-ae3d-77d97e23471f tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:41.592049 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db8b3b67-97dd-4c1a-ae3d-77d97e23471f tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:41.592769 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db8b3b67-97dd-4c1a-ae3d-77d97e23471f tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:41.593466 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db8b3b67-97dd-4c1a-ae3d-77d97e23471f tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:41.705695 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2b8221ed-2fbd-4ca7-b369-3469e72c5669 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:41.707008 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2b8221ed-2fbd-4ca7-b369-3469e72c5669 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] [instance: aaf7e661-b399-490d-9890-487af6418b95] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:41.716211 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2b8221ed-2fbd-4ca7-b369-3469e72c5669 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:41.723307 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2b8221ed-2fbd-4ca7-b369-3469e72c5669 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:41.725907 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2b8221ed-2fbd-4ca7-b369-3469e72c5669 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:41.726901 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2b8221ed-2fbd-4ca7-b369-3469e72c5669 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:41.728746 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2b8221ed-2fbd-4ca7-b369-3469e72c5669 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:41.729833 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2b8221ed-2fbd-4ca7-b369-3469e72c5669 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:41.742065 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-db8b3b67-97dd-4c1a-ae3d-77d97e23471f tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:41.760276 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-db8b3b67-97dd-4c1a-ae3d-77d97e23471f tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:41.764305 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-db8b3b67-97dd-4c1a-ae3d-77d97e23471f tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:41.769125 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-db8b3b67-97dd-4c1a-ae3d-77d97e23471f tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1335 microversion: 2.47 time: 0.195658 Sep 24 21:05:41.771420 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2113/4225] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:05:41 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1335 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:05:42.023087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a45e7af3-2b7e-462e-9291-84c93fdecf6d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:42.023711 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a45e7af3-2b7e-462e-9291-84c93fdecf6d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:42.056648 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a45e7af3-2b7e-462e-9291-84c93fdecf6d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:42.061102 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a45e7af3-2b7e-462e-9291-84c93fdecf6d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:42.062300 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a45e7af3-2b7e-462e-9291-84c93fdecf6d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:42.067569 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a45e7af3-2b7e-462e-9291-84c93fdecf6d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:42.068204 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a45e7af3-2b7e-462e-9291-84c93fdecf6d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:42.069336 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a45e7af3-2b7e-462e-9291-84c93fdecf6d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:42.131941 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2b8221ed-2fbd-4ca7-b369-3469e72c5669 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05599f233ca45c39ccd351c0432f1ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee2eb7dffa647fb89edd0cf7d1cb454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:42.150902 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2b8221ed-2fbd-4ca7-b369-3469e72c5669 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] 10.222.0.52 "GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95" status: 200 len: 1534 microversion: 2.1 time: 0.446419 Sep 24 21:05:42.153993 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2113/4226] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:41 2022] GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95 => generated 1534 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:42.543408 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a45e7af3-2b7e-462e-9291-84c93fdecf6d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:42.559327 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a45e7af3-2b7e-462e-9291-84c93fdecf6d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a" status: 200 len: 1307 microversion: 2.1 time: 0.546466 Sep 24 21:05:42.564170 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2114/4227] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:42 2022] GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a => generated 1307 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:42.582396 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2e63ce7f-d518-4bab-bd5d-b73830bdf7bd tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:42.584273 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2e63ce7f-d518-4bab-bd5d-b73830bdf7bd tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: c5bd74b9-2a72-452a-b603-9b99fba57f9b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:42.597272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e63ce7f-d518-4bab-bd5d-b73830bdf7bd tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:42.599713 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e63ce7f-d518-4bab-bd5d-b73830bdf7bd tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:42.601378 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e63ce7f-d518-4bab-bd5d-b73830bdf7bd tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:42.605515 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e63ce7f-d518-4bab-bd5d-b73830bdf7bd tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:42.609968 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e63ce7f-d518-4bab-bd5d-b73830bdf7bd tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:42.611354 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2e63ce7f-d518-4bab-bd5d-b73830bdf7bd tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:42.679258 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:05:42.723639 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-323ae936-b1ed-49d2-8cc0-94582df1c18f req-c6f0a2a9-e7e8-42d1-8a18-ac8cfdf3ecfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaf7e661-b399-490d-9890-487af6418b95", "name": "network-vif-deleted", "tag": "efa62d63-5684-4475-8cad-bb83c067cfbc"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:05:42.760923 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-323ae936-b1ed-49d2-8cc0-94582df1c18f req-c6f0a2a9-e7e8-42d1-8a18-ac8cfdf3ecfe service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:42.765886 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-323ae936-b1ed-49d2-8cc0-94582df1c18f req-c6f0a2a9-e7e8-42d1-8a18-ac8cfdf3ecfe service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:42.766530 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-323ae936-b1ed-49d2-8cc0-94582df1c18f req-c6f0a2a9-e7e8-42d1-8a18-ac8cfdf3ecfe service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:42.795850 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2e63ce7f-d518-4bab-bd5d-b73830bdf7bd tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:42.796499 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-323ae936-b1ed-49d2-8cc0-94582df1c18f req-c6f0a2a9-e7e8-42d1-8a18-ac8cfdf3ecfe service nova] Creating event network-vif-deleted:efa62d63-5684-4475-8cad-bb83c067cfbc for instance aaf7e661-b399-490d-9890-487af6418b95 on nch2-master-1 Sep 24 21:05:42.809243 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-323ae936-b1ed-49d2-8cc0-94582df1c18f req-c6f0a2a9-e7e8-42d1-8a18-ac8cfdf3ecfe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101574 Sep 24 21:05:42.811852 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2e63ce7f-d518-4bab-bd5d-b73830bdf7bd tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b" status: 200 len: 1226 microversion: 2.1 time: 0.233373 Sep 24 21:05:42.812365 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2115/4228] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:05:42.813879 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2114/4229] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:42 2022] GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b => generated 1226 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:42.822276 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-16cb86c1-0578-44c1-98f4-fd87c933c958 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:42.840400 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-16cb86c1-0578-44c1-98f4-fd87c933c958 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:42.854313 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-16cb86c1-0578-44c1-98f4-fd87c933c958 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:42.855263 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-16cb86c1-0578-44c1-98f4-fd87c933c958 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:42.855852 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-16cb86c1-0578-44c1-98f4-fd87c933c958 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:42.856746 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-16cb86c1-0578-44c1-98f4-fd87c933c958 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:42.861106 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-16cb86c1-0578-44c1-98f4-fd87c933c958 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:42.861794 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-16cb86c1-0578-44c1-98f4-fd87c933c958 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:43.035693 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-16cb86c1-0578-44c1-98f4-fd87c933c958 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:43.045212 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-16cb86c1-0578-44c1-98f4-fd87c933c958 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:43.047300 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-16cb86c1-0578-44c1-98f4-fd87c933c958 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:43.049095 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-16cb86c1-0578-44c1-98f4-fd87c933c958 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1335 microversion: 2.47 time: 0.235265 Sep 24 21:05:43.049686 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2116/4230] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:05:42 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1335 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:05:43.182576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7b75964a-cfd7-48ce-822f-4a33aaab384e tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:43.183858 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7b75964a-cfd7-48ce-822f-4a33aaab384e tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] [instance: aaf7e661-b399-490d-9890-487af6418b95] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:43.195000 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=4 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:05:43.198897 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b75964a-cfd7-48ce-822f-4a33aaab384e tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:43.200248 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b75964a-cfd7-48ce-822f-4a33aaab384e tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:43.201337 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b75964a-cfd7-48ce-822f-4a33aaab384e tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:43.205532 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b75964a-cfd7-48ce-822f-4a33aaab384e tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:43.208753 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b75964a-cfd7-48ce-822f-4a33aaab384e tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:43.210157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b75964a-cfd7-48ce-822f-4a33aaab384e tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:43.214163 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=14 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:05:43.304190 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b75964a-cfd7-48ce-822f-4a33aaab384e tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:43.305212 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b75964a-cfd7-48ce-822f-4a33aaab384e tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:43.307792 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b75964a-cfd7-48ce-822f-4a33aaab384e tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:43.309137 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-7b75964a-cfd7-48ce-822f-4a33aaab384e tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lazy-loading 'fault' on Instance uuid aaf7e661-b399-490d-9890-487af6418b95 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:05:43.377427 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7b75964a-cfd7-48ce-822f-4a33aaab384e tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05599f233ca45c39ccd351c0432f1ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee2eb7dffa647fb89edd0cf7d1cb454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:43.389381 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7b75964a-cfd7-48ce-822f-4a33aaab384e tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] 10.222.0.52 "GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95" status: 200 len: 1318 microversion: 2.1 time: 0.214453 Sep 24 21:05:43.391482 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2115/4231] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:43 2022] GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:43.526132 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-09417d92-ebf9-4a0f-a96c-9e3a036eb885 req-c55b064f-d806-498a-ba1c-1f5ed63ce53e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a", "name": "network-vif-plugged", "status": "completed", "tag": "2407e9d3-2a9d-4740-9d8e-dd3109d28da2"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:05:43.563224 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-09417d92-ebf9-4a0f-a96c-9e3a036eb885 req-c55b064f-d806-498a-ba1c-1f5ed63ce53e service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:43.565066 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-09417d92-ebf9-4a0f-a96c-9e3a036eb885 req-c55b064f-d806-498a-ba1c-1f5ed63ce53e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:43.568758 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-09417d92-ebf9-4a0f-a96c-9e3a036eb885 req-c55b064f-d806-498a-ba1c-1f5ed63ce53e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:43.600885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-69f69d2a-921d-4a99-b9c6-96bd0a40c671 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:43.601853 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-69f69d2a-921d-4a99-b9c6-96bd0a40c671 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:43.608288 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-09417d92-ebf9-4a0f-a96c-9e3a036eb885 req-c55b064f-d806-498a-ba1c-1f5ed63ce53e service nova] Creating event network-vif-plugged:2407e9d3-2a9d-4740-9d8e-dd3109d28da2 for instance fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a on nch1-master-1 Sep 24 21:05:43.615230 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-09417d92-ebf9-4a0f-a96c-9e3a036eb885 req-c55b064f-d806-498a-ba1c-1f5ed63ce53e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094669 Sep 24 21:05:43.616479 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2117/4232] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:05:43.617904 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-69f69d2a-921d-4a99-b9c6-96bd0a40c671 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:43.618822 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-69f69d2a-921d-4a99-b9c6-96bd0a40c671 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:43.619485 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-69f69d2a-921d-4a99-b9c6-96bd0a40c671 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:43.620203 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-69f69d2a-921d-4a99-b9c6-96bd0a40c671 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:43.621988 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-69f69d2a-921d-4a99-b9c6-96bd0a40c671 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:43.622678 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-69f69d2a-921d-4a99-b9c6-96bd0a40c671 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:43.847922 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f8377eaa-69a3-45a2-8246-c6a275c8c95e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:43.851810 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f8377eaa-69a3-45a2-8246-c6a275c8c95e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: c5bd74b9-2a72-452a-b603-9b99fba57f9b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:43.874984 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8377eaa-69a3-45a2-8246-c6a275c8c95e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:43.877372 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8377eaa-69a3-45a2-8246-c6a275c8c95e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:43.878041 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8377eaa-69a3-45a2-8246-c6a275c8c95e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:43.881948 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8377eaa-69a3-45a2-8246-c6a275c8c95e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:43.882742 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8377eaa-69a3-45a2-8246-c6a275c8c95e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:43.883369 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8377eaa-69a3-45a2-8246-c6a275c8c95e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:44.011737 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-69f69d2a-921d-4a99-b9c6-96bd0a40c671 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:44.024842 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-69f69d2a-921d-4a99-b9c6-96bd0a40c671 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a" status: 200 len: 1307 microversion: 2.1 time: 0.428723 Sep 24 21:05:44.025701 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2116/4233] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:43 2022] GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a => generated 1307 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:44.034947 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f8377eaa-69a3-45a2-8246-c6a275c8c95e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:44.048022 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f8377eaa-69a3-45a2-8246-c6a275c8c95e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b" status: 200 len: 1226 microversion: 2.1 time: 0.213218 Sep 24 21:05:44.050979 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2118/4234] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:43 2022] GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b => generated 1226 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:44.078227 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a5e5405b-33ac-4b40-8984-c2b030550a1a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:44.078878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a5e5405b-33ac-4b40-8984-c2b030550a1a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:44.094435 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5e5405b-33ac-4b40-8984-c2b030550a1a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:44.095375 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5e5405b-33ac-4b40-8984-c2b030550a1a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:44.095851 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5e5405b-33ac-4b40-8984-c2b030550a1a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:44.097910 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5e5405b-33ac-4b40-8984-c2b030550a1a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:44.101158 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5e5405b-33ac-4b40-8984-c2b030550a1a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:44.101630 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5e5405b-33ac-4b40-8984-c2b030550a1a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:44.307775 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a5e5405b-33ac-4b40-8984-c2b030550a1a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:44.317296 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a5e5405b-33ac-4b40-8984-c2b030550a1a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:44.328418 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a5e5405b-33ac-4b40-8984-c2b030550a1a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:44.333510 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a5e5405b-33ac-4b40-8984-c2b030550a1a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1335 microversion: 2.47 time: 0.260080 Sep 24 21:05:44.335988 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2117/4235] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:05:44 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1335 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:05:44.415496 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8c5eb926-4bac-4d45-aadf-8e4633b1f102 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:44.416120 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8c5eb926-4bac-4d45-aadf-8e4633b1f102 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] [instance: aaf7e661-b399-490d-9890-487af6418b95] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:44.428186 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8c5eb926-4bac-4d45-aadf-8e4633b1f102 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:44.429199 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8c5eb926-4bac-4d45-aadf-8e4633b1f102 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:44.430743 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8c5eb926-4bac-4d45-aadf-8e4633b1f102 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:44.431675 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8c5eb926-4bac-4d45-aadf-8e4633b1f102 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:44.433453 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8c5eb926-4bac-4d45-aadf-8e4633b1f102 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:44.437528 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8c5eb926-4bac-4d45-aadf-8e4633b1f102 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:44.512215 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:05:44.529451 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8c5eb926-4bac-4d45-aadf-8e4633b1f102 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:44.530020 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8c5eb926-4bac-4d45-aadf-8e4633b1f102 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:44.530530 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8c5eb926-4bac-4d45-aadf-8e4633b1f102 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:44.530985 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-8c5eb926-4bac-4d45-aadf-8e4633b1f102 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lazy-loading 'fault' on Instance uuid aaf7e661-b399-490d-9890-487af6418b95 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:05:44.700805 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8c5eb926-4bac-4d45-aadf-8e4633b1f102 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05599f233ca45c39ccd351c0432f1ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee2eb7dffa647fb89edd0cf7d1cb454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:44.708602 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8c5eb926-4bac-4d45-aadf-8e4633b1f102 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] 10.222.0.52 "GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95" status: 200 len: 1318 microversion: 2.1 time: 0.296761 Sep 24 21:05:44.709967 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2119/4236] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:44 2022] GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95 => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:45.050838 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-34ba45e5-9a01-463c-9a9d-c4f322d29956 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:45.052735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-34ba45e5-9a01-463c-9a9d-c4f322d29956 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:45.076293 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-615056ac-5a5e-4940-8c1b-2df626f15fd1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:45.076895 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-615056ac-5a5e-4940-8c1b-2df626f15fd1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: c5bd74b9-2a72-452a-b603-9b99fba57f9b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:45.080330 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34ba45e5-9a01-463c-9a9d-c4f322d29956 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:45.083256 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34ba45e5-9a01-463c-9a9d-c4f322d29956 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:45.085144 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34ba45e5-9a01-463c-9a9d-c4f322d29956 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:45.088469 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34ba45e5-9a01-463c-9a9d-c4f322d29956 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:45.089487 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34ba45e5-9a01-463c-9a9d-c4f322d29956 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:45.091576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34ba45e5-9a01-463c-9a9d-c4f322d29956 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:45.091925 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-615056ac-5a5e-4940-8c1b-2df626f15fd1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:45.092704 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-615056ac-5a5e-4940-8c1b-2df626f15fd1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:45.093371 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-615056ac-5a5e-4940-8c1b-2df626f15fd1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:45.094280 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-615056ac-5a5e-4940-8c1b-2df626f15fd1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:45.094943 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-615056ac-5a5e-4940-8c1b-2df626f15fd1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:45.095550 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-615056ac-5a5e-4940-8c1b-2df626f15fd1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:45.176652 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-615056ac-5a5e-4940-8c1b-2df626f15fd1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:45.186937 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-615056ac-5a5e-4940-8c1b-2df626f15fd1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b" status: 200 len: 1274 microversion: 2.1 time: 0.114295 Sep 24 21:05:45.189926 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2120/4237] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:45 2022] GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b => generated 1274 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:05:45.273848 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-34ba45e5-9a01-463c-9a9d-c4f322d29956 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:45.282573 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-34ba45e5-9a01-463c-9a9d-c4f322d29956 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a" status: 200 len: 1307 microversion: 2.1 time: 0.237086 Sep 24 21:05:45.283711 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2118/4238] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:45 2022] GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a => generated 1307 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:45.367245 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f8cd540b-f4ea-4af5-8df2-0b8c483cf9c2 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:45.368351 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f8cd540b-f4ea-4af5-8df2-0b8c483cf9c2 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:45.375208 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8cd540b-f4ea-4af5-8df2-0b8c483cf9c2 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:45.376041 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8cd540b-f4ea-4af5-8df2-0b8c483cf9c2 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:45.376708 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8cd540b-f4ea-4af5-8df2-0b8c483cf9c2 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:45.377612 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8cd540b-f4ea-4af5-8df2-0b8c483cf9c2 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:45.379490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8cd540b-f4ea-4af5-8df2-0b8c483cf9c2 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:45.380376 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8cd540b-f4ea-4af5-8df2-0b8c483cf9c2 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:45.459485 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f8cd540b-f4ea-4af5-8df2-0b8c483cf9c2 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:45.469356 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f8cd540b-f4ea-4af5-8df2-0b8c483cf9c2 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:45.471142 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f8cd540b-f4ea-4af5-8df2-0b8c483cf9c2 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:45.472301 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f8cd540b-f4ea-4af5-8df2-0b8c483cf9c2 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1335 microversion: 2.47 time: 0.109658 Sep 24 21:05:45.472867 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2121/4239] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:05:45 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1335 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:05:45.735962 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bc7304bf-f00f-4ec8-bb37-be8785f462c3 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:45.737581 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-bc7304bf-f00f-4ec8-bb37-be8785f462c3 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] [instance: aaf7e661-b399-490d-9890-487af6418b95] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:45.748869 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bc7304bf-f00f-4ec8-bb37-be8785f462c3 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:45.749774 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bc7304bf-f00f-4ec8-bb37-be8785f462c3 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:45.751014 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bc7304bf-f00f-4ec8-bb37-be8785f462c3 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:45.752728 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bc7304bf-f00f-4ec8-bb37-be8785f462c3 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:45.754106 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bc7304bf-f00f-4ec8-bb37-be8785f462c3 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:45.754773 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bc7304bf-f00f-4ec8-bb37-be8785f462c3 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:45.778570 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-bc7304bf-f00f-4ec8-bb37-be8785f462c3 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] HTTP exception thrown: Instance aaf7e661-b399-490d-9890-487af6418b95 could not be found. Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bc7304bf-f00f-4ec8-bb37-be8785f462c3 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Request method failure captured: Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95 HTTP/1.1 Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3D9y6WTES79BbpDWy4FcQUhjHyYf2bxxLgAFlIqTQxNf2xYhSdFRpGiJQkk8mWCV2c0bbmgBzRnkCihtF35HfVi55TiJI7WWaQHCIJ5bRKIyUNP9PvG0iZKG6EwK0QQSWWtMOAIny871KrSOMFV75U1iwUjZWAUX4sF8Haqq07_cy0 Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 3ee2eb7dffa647fb89edd0cf7d1cb454 Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-52210750 Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3ee2eb7dffa647fb89edd0cf7d1cb454"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3ee2eb7dffa647fb89edd0cf7d1cb454"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3ee2eb7dffa647fb89edd0cf7d1cb454"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3ee2eb7dffa647fb89edd0cf7d1cb454"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-52210750 Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 3ee2eb7dffa647fb89edd0cf7d1cb454 Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-52210750 Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersNegativeTestMultiTenantJSON-52210750-project Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: f05599f233ca45c39ccd351c0432f1ba Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-52210750-project Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance aaf7e661-b399-490d-9890-487af6418b95 could not be found. Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'aaf7e661-b399-490d-9890-487af6418b95'} Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaf7e661-b399-490d-9890-487af6418b95 could not be found. Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaf7e661-b399-490d-9890-487af6418b95 could not be found. Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:05:45.781236 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:05:45.787833 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:05:45.787833 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:05:45.787833 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:05:45.787833 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:05:45.787833 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:05:45.787833 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:05:45.787833 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaf7e661-b399-490d-9890-487af6418b95 could not be found. Sep 24 21:05:45.787833 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:05:45.787833 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bc7304bf-f00f-4ec8-bb37-be8785f462c3 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] Returning 404 to user: Instance aaf7e661-b399-490d-9890-487af6418b95 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:05:45.787833 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bc7304bf-f00f-4ec8-bb37-be8785f462c3 tempest-ServersNegativeTestMultiTenantJSON-52210750 tempest-ServersNegativeTestMultiTenantJSON-52210750-project] 10.222.0.52 "GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95" status: 404 len: 111 microversion: 2.1 time: 0.052479 Sep 24 21:05:45.787833 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2119/4240] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:45 2022] GET /compute/v2.1/servers/aaf7e661-b399-490d-9890-487af6418b95 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:05:46.216018 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-47eb66bf-dc93-432b-a54a-8f37cbdfcdc5 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:46.219024 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-47eb66bf-dc93-432b-a54a-8f37cbdfcdc5 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: c5bd74b9-2a72-452a-b603-9b99fba57f9b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:46.229762 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-47eb66bf-dc93-432b-a54a-8f37cbdfcdc5 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:46.231400 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-47eb66bf-dc93-432b-a54a-8f37cbdfcdc5 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:46.233138 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-47eb66bf-dc93-432b-a54a-8f37cbdfcdc5 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:46.236694 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-47eb66bf-dc93-432b-a54a-8f37cbdfcdc5 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:46.237314 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-47eb66bf-dc93-432b-a54a-8f37cbdfcdc5 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:46.237930 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-47eb66bf-dc93-432b-a54a-8f37cbdfcdc5 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:46.314902 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cea723bf-d3c4-445a-b364-f7eb07269689 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:46.316778 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cea723bf-d3c4-445a-b364-f7eb07269689 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:46.343513 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-47eb66bf-dc93-432b-a54a-8f37cbdfcdc5 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:46.346476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cea723bf-d3c4-445a-b364-f7eb07269689 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:46.348308 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cea723bf-d3c4-445a-b364-f7eb07269689 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:46.349767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cea723bf-d3c4-445a-b364-f7eb07269689 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:46.352199 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cea723bf-d3c4-445a-b364-f7eb07269689 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:46.353830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cea723bf-d3c4-445a-b364-f7eb07269689 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:46.354894 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cea723bf-d3c4-445a-b364-f7eb07269689 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:46.360018 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-47eb66bf-dc93-432b-a54a-8f37cbdfcdc5 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b" status: 200 len: 1274 microversion: 2.1 time: 0.152554 Sep 24 21:05:46.361529 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2122/4241] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:46 2022] GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b => generated 1274 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:46.501215 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0c5dbefe-04e7-4a42-82a9-2607f11799bf tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:46.502165 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0c5dbefe-04e7-4a42-82a9-2607f11799bf tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:46.512080 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c5dbefe-04e7-4a42-82a9-2607f11799bf tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:46.512883 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c5dbefe-04e7-4a42-82a9-2607f11799bf tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:46.513546 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c5dbefe-04e7-4a42-82a9-2607f11799bf tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:46.515175 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c5dbefe-04e7-4a42-82a9-2607f11799bf tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:46.516024 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c5dbefe-04e7-4a42-82a9-2607f11799bf tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:46.517187 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c5dbefe-04e7-4a42-82a9-2607f11799bf tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:46.920052 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0c5dbefe-04e7-4a42-82a9-2607f11799bf tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:46.936569 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0c5dbefe-04e7-4a42-82a9-2607f11799bf tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:46.938525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0c5dbefe-04e7-4a42-82a9-2607f11799bf tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:46.939738 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0c5dbefe-04e7-4a42-82a9-2607f11799bf tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1356 microversion: 2.47 time: 0.443918 Sep 24 21:05:46.940634 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2123/4242] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:05:46 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1356 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:05:46.949678 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-066f48e0-4669-41b4-b637-036802c379af req-a275f31a-bde9-45f9-971f-b41af607e1c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd3a51be-17a5-4293-9bad-a3768d7ec10b", "tag": "50c9da6c-eed0-476d-b42f-e3195ac755fc"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:05:46.970917 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-066f48e0-4669-41b4-b637-036802c379af req-a275f31a-bde9-45f9-971f-b41af607e1c1 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:46.971268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-066f48e0-4669-41b4-b637-036802c379af req-a275f31a-bde9-45f9-971f-b41af607e1c1 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:46.971681 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-066f48e0-4669-41b4-b637-036802c379af req-a275f31a-bde9-45f9-971f-b41af607e1c1 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:46.992732 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-066f48e0-4669-41b4-b637-036802c379af req-a275f31a-bde9-45f9-971f-b41af607e1c1 service nova] Creating event network-changed:50c9da6c-eed0-476d-b42f-e3195ac755fc for instance fd3a51be-17a5-4293-9bad-a3768d7ec10b on nch2-master-1 Sep 24 21:05:47.023917 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-066f48e0-4669-41b4-b637-036802c379af req-a275f31a-bde9-45f9-971f-b41af607e1c1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078993 Sep 24 21:05:47.028025 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2124/4243] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:05:47.041864 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dbe77df1-127a-4362-a077-ce53739622fb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:05:47.048210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dbe77df1-127a-4362-a077-ce53739622fb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:47.072955 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dbe77df1-127a-4362-a077-ce53739622fb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:47.073642 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dbe77df1-127a-4362-a077-ce53739622fb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:47.074772 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dbe77df1-127a-4362-a077-ce53739622fb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:47.077175 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dbe77df1-127a-4362-a077-ce53739622fb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:47.077872 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dbe77df1-127a-4362-a077-ce53739622fb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:47.078339 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dbe77df1-127a-4362-a077-ce53739622fb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:47.209685 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-dbe77df1-127a-4362-a077-ce53739622fb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:05:47.210936 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-dbe77df1-127a-4362-a077-ce53739622fb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:05:47.212922 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-dbe77df1-127a-4362-a077-ce53739622fb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:05:47.213656 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-dbe77df1-127a-4362-a077-ce53739622fb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:05:47.215155 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-dbe77df1-127a-4362-a077-ce53739622fb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:05:47.352873 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dbe77df1-127a-4362-a077-ce53739622fb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:47.372497 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dbe77df1-127a-4362-a077-ce53739622fb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:47.375310 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cea723bf-d3c4-445a-b364-f7eb07269689 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:47.377169 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dbe77df1-127a-4362-a077-ce53739622fb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:47.377899 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dbe77df1-127a-4362-a077-ce53739622fb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:47.382048 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dbe77df1-127a-4362-a077-ce53739622fb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:47.388582 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dbe77df1-127a-4362-a077-ce53739622fb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:47.391068 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dbe77df1-127a-4362-a077-ce53739622fb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:47.392942 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cea723bf-d3c4-445a-b364-f7eb07269689 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a" status: 200 len: 1307 microversion: 2.1 time: 1.087524 Sep 24 21:05:47.395189 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2120/4244] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:46 2022] GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a => generated 1307 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:47.411771 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6a4e15d9-53b8-4363-8509-2ddf14ebfe3f tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:47.413824 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6a4e15d9-53b8-4363-8509-2ddf14ebfe3f tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: c5bd74b9-2a72-452a-b603-9b99fba57f9b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:47.431693 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6a4e15d9-53b8-4363-8509-2ddf14ebfe3f tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:47.434370 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6a4e15d9-53b8-4363-8509-2ddf14ebfe3f tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:47.435477 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6a4e15d9-53b8-4363-8509-2ddf14ebfe3f tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:47.438302 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6a4e15d9-53b8-4363-8509-2ddf14ebfe3f tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:47.440218 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6a4e15d9-53b8-4363-8509-2ddf14ebfe3f tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:47.443662 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6a4e15d9-53b8-4363-8509-2ddf14ebfe3f tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:47.509754 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dbe77df1-127a-4362-a077-ce53739622fb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "POST /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a/action" status: 202 len: 1078 microversion: 2.47 time: 0.477885 Sep 24 21:05:47.512568 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2125/4245] 10.222.0.52 () {62 vars in 1319 bytes} [Sat Sep 24 21:05:47 2022] POST /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a/action => generated 1078 bytes in 484 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 24 21:05:47.534628 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-51f7df70-c7f3-4e99-b894-3242f888890b tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:47.535543 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-51f7df70-c7f3-4e99-b894-3242f888890b tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:47.542979 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-51f7df70-c7f3-4e99-b894-3242f888890b tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:47.543750 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-51f7df70-c7f3-4e99-b894-3242f888890b tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:47.544411 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-51f7df70-c7f3-4e99-b894-3242f888890b tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:47.545314 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-51f7df70-c7f3-4e99-b894-3242f888890b tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:47.545951 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-51f7df70-c7f3-4e99-b894-3242f888890b tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:47.546591 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-51f7df70-c7f3-4e99-b894-3242f888890b tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:47.822159 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-51f7df70-c7f3-4e99-b894-3242f888890b tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:47.830365 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6a4e15d9-53b8-4363-8509-2ddf14ebfe3f tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:47.836578 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-51f7df70-c7f3-4e99-b894-3242f888890b tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:47.838166 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-51f7df70-c7f3-4e99-b894-3242f888890b tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:47.839720 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-51f7df70-c7f3-4e99-b894-3242f888890b tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1365 microversion: 2.47 time: 0.309933 Sep 24 21:05:47.842854 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6a4e15d9-53b8-4363-8509-2ddf14ebfe3f tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b" status: 200 len: 1292 microversion: 2.1 time: 0.444033 Sep 24 21:05:47.843935 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2121/4246] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:47 2022] GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b => generated 1292 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:47.859677 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2126/4247] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:05:47 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1365 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:05:48.424170 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4d11d6c0-00ec-4448-af7b-f30c9353db07 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:48.425231 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4d11d6c0-00ec-4448-af7b-f30c9353db07 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:48.433894 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4d11d6c0-00ec-4448-af7b-f30c9353db07 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:48.434759 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4d11d6c0-00ec-4448-af7b-f30c9353db07 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:48.435380 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4d11d6c0-00ec-4448-af7b-f30c9353db07 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:48.436485 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4d11d6c0-00ec-4448-af7b-f30c9353db07 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:48.437428 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4d11d6c0-00ec-4448-af7b-f30c9353db07 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:48.438047 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4d11d6c0-00ec-4448-af7b-f30c9353db07 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:48.879795 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-83939ea2-ba19-4cc1-b38b-773e23f5ba91 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:48.880751 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-83939ea2-ba19-4cc1-b38b-773e23f5ba91 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:48.887262 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-83939ea2-ba19-4cc1-b38b-773e23f5ba91 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:48.887755 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-83939ea2-ba19-4cc1-b38b-773e23f5ba91 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:48.888196 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-83939ea2-ba19-4cc1-b38b-773e23f5ba91 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:48.888906 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-83939ea2-ba19-4cc1-b38b-773e23f5ba91 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:48.889361 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-83939ea2-ba19-4cc1-b38b-773e23f5ba91 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:48.889791 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-83939ea2-ba19-4cc1-b38b-773e23f5ba91 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:48.891867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4d11d6c0-00ec-4448-af7b-f30c9353db07 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:48.907502 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4d11d6c0-00ec-4448-af7b-f30c9353db07 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a" status: 200 len: 1488 microversion: 2.1 time: 0.487293 Sep 24 21:05:48.908537 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2122/4248] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:48 2022] GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a => generated 1488 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:48.917886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4ca4c200-e1ee-4620-9b98-0883ff4b2004 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:48.919025 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4ca4c200-e1ee-4620-9b98-0883ff4b2004 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: c5bd74b9-2a72-452a-b603-9b99fba57f9b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:48.926218 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ca4c200-e1ee-4620-9b98-0883ff4b2004 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:48.927099 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ca4c200-e1ee-4620-9b98-0883ff4b2004 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:48.928321 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ca4c200-e1ee-4620-9b98-0883ff4b2004 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:48.929467 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ca4c200-e1ee-4620-9b98-0883ff4b2004 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:48.930063 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ca4c200-e1ee-4620-9b98-0883ff4b2004 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:48.930685 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ca4c200-e1ee-4620-9b98-0883ff4b2004 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:49.040257 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-83939ea2-ba19-4cc1-b38b-773e23f5ba91 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:49.049247 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-83939ea2-ba19-4cc1-b38b-773e23f5ba91 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:49.050845 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-83939ea2-ba19-4cc1-b38b-773e23f5ba91 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:49.052104 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-83939ea2-ba19-4cc1-b38b-773e23f5ba91 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1365 microversion: 2.47 time: 0.186288 Sep 24 21:05:49.052771 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2127/4249] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:05:48 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:05:49.059992 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b18d27e7-9800-4362-b174-b8c00aa73627 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:05:49.063520 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b18d27e7-9800-4362-b174-b8c00aa73627 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:49.072115 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b18d27e7-9800-4362-b174-b8c00aa73627 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:49.072892 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b18d27e7-9800-4362-b174-b8c00aa73627 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:49.073345 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b18d27e7-9800-4362-b174-b8c00aa73627 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:49.074175 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b18d27e7-9800-4362-b174-b8c00aa73627 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:49.074699 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b18d27e7-9800-4362-b174-b8c00aa73627 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:49.075189 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b18d27e7-9800-4362-b174-b8c00aa73627 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:49.080576 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:05:49.105221 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4ca4c200-e1ee-4620-9b98-0883ff4b2004 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:49.115036 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4ca4c200-e1ee-4620-9b98-0883ff4b2004 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b" status: 200 len: 1280 microversion: 2.1 time: 0.205096 Sep 24 21:05:49.131963 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2123/4250] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:48 2022] GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b => generated 1280 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:49.140689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-923c72e8-20dd-457b-b5f2-89910f65afe0 req-466eda20-820c-4f35-b954-4484085aba2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f857f30-f6d8-4107-b14d-12502a60fc74", "tag": "6287fe41-9f95-412b-a43f-6f1030bebe2e"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:05:49.166077 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-923c72e8-20dd-457b-b5f2-89910f65afe0 req-466eda20-820c-4f35-b954-4484085aba2e service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:49.166759 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-923c72e8-20dd-457b-b5f2-89910f65afe0 req-466eda20-820c-4f35-b954-4484085aba2e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:49.167466 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-923c72e8-20dd-457b-b5f2-89910f65afe0 req-466eda20-820c-4f35-b954-4484085aba2e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:49.181850 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b18d27e7-9800-4362-b174-b8c00aa73627 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "PUT /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a" status: 200 len: 1083 microversion: 2.1 time: 0.127689 Sep 24 21:05:49.182888 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2128/4251] 10.222.0.52 () {60 vars in 1256 bytes} [Sat Sep 24 21:05:49 2022] PUT /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a => generated 1083 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:49.208759 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-923c72e8-20dd-457b-b5f2-89910f65afe0 req-466eda20-820c-4f35-b954-4484085aba2e service nova] Creating event network-changed:6287fe41-9f95-412b-a43f-6f1030bebe2e for instance 4f857f30-f6d8-4107-b14d-12502a60fc74 on nch2-master-1 Sep 24 21:05:49.228523 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-923c72e8-20dd-457b-b5f2-89910f65afe0 req-466eda20-820c-4f35-b954-4484085aba2e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093813 Sep 24 21:05:49.228687 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d7387a2f-2180-4fd4-8395-eaa8a650e834 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:49.229321 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d7387a2f-2180-4fd4-8395-eaa8a650e834 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:49.229584 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2124/4252] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:05:49.247987 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d7387a2f-2180-4fd4-8395-eaa8a650e834 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:49.247987 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d7387a2f-2180-4fd4-8395-eaa8a650e834 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:49.247987 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d7387a2f-2180-4fd4-8395-eaa8a650e834 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:49.247987 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d7387a2f-2180-4fd4-8395-eaa8a650e834 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:49.249666 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d7387a2f-2180-4fd4-8395-eaa8a650e834 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:49.249666 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d7387a2f-2180-4fd4-8395-eaa8a650e834 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:49.670902 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=6 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:05:50.082155 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-63b0e4f1-74f8-4195-90a2-14c2471c0853 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:50.083908 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-63b0e4f1-74f8-4195-90a2-14c2471c0853 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:50.104128 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-63b0e4f1-74f8-4195-90a2-14c2471c0853 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:50.105032 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-63b0e4f1-74f8-4195-90a2-14c2471c0853 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:50.105740 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-63b0e4f1-74f8-4195-90a2-14c2471c0853 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:50.106757 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-63b0e4f1-74f8-4195-90a2-14c2471c0853 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:50.107476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-63b0e4f1-74f8-4195-90a2-14c2471c0853 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:50.108175 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-63b0e4f1-74f8-4195-90a2-14c2471c0853 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:50.112429 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d7387a2f-2180-4fd4-8395-eaa8a650e834 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:50.121230 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d7387a2f-2180-4fd4-8395-eaa8a650e834 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a" status: 200 len: 1509 microversion: 2.1 time: 0.917948 Sep 24 21:05:50.121821 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2129/4253] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:49 2022] GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a => generated 1509 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:50.149330 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d553d1d3-2532-4a68-865e-2d2df0c3bbb1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:50.150483 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d553d1d3-2532-4a68-865e-2d2df0c3bbb1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: c5bd74b9-2a72-452a-b603-9b99fba57f9b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:50.161409 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d553d1d3-2532-4a68-865e-2d2df0c3bbb1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:50.162187 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d553d1d3-2532-4a68-865e-2d2df0c3bbb1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:50.162672 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d553d1d3-2532-4a68-865e-2d2df0c3bbb1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:50.170716 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d553d1d3-2532-4a68-865e-2d2df0c3bbb1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:50.172681 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d553d1d3-2532-4a68-865e-2d2df0c3bbb1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:50.173983 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d553d1d3-2532-4a68-865e-2d2df0c3bbb1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:50.242248 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-63b0e4f1-74f8-4195-90a2-14c2471c0853 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:50.251606 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-63b0e4f1-74f8-4195-90a2-14c2471c0853 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:50.252996 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-63b0e4f1-74f8-4195-90a2-14c2471c0853 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:50.254382 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-63b0e4f1-74f8-4195-90a2-14c2471c0853 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1365 microversion: 2.47 time: 0.177793 Sep 24 21:05:50.264089 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2125/4254] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:05:50 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:05:50.271506 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dc198953-a56d-4a9d-b240-ea3ccf9bb9b0 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:50.272510 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-dc198953-a56d-4a9d-b240-ea3ccf9bb9b0 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:50.281169 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc198953-a56d-4a9d-b240-ea3ccf9bb9b0 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:50.281675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc198953-a56d-4a9d-b240-ea3ccf9bb9b0 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:50.282387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc198953-a56d-4a9d-b240-ea3ccf9bb9b0 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:50.283529 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc198953-a56d-4a9d-b240-ea3ccf9bb9b0 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:50.284027 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc198953-a56d-4a9d-b240-ea3ccf9bb9b0 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:50.284464 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc198953-a56d-4a9d-b240-ea3ccf9bb9b0 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:50.330851 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=26 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:05:50.894452 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d553d1d3-2532-4a68-865e-2d2df0c3bbb1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:50.908279 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d553d1d3-2532-4a68-865e-2d2df0c3bbb1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b" status: 200 len: 1322 microversion: 2.1 time: 0.767774 Sep 24 21:05:50.923815 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2130/4255] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:50 2022] GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b => generated 1322 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:05:50.966165 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-dc198953-a56d-4a9d-b240-ea3ccf9bb9b0 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:50.981808 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-dc198953-a56d-4a9d-b240-ea3ccf9bb9b0 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a" status: 200 len: 1509 microversion: 2.1 time: 0.723612 Sep 24 21:05:50.982583 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2126/4256] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:50 2022] GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a => generated 1509 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:51.011051 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-eed93ce8-59d1-4cd0-8ea6-5f7aa2a502b8 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:51.011678 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-eed93ce8-59d1-4cd0-8ea6-5f7aa2a502b8 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:51.018476 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eed93ce8-59d1-4cd0-8ea6-5f7aa2a502b8 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:51.019722 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eed93ce8-59d1-4cd0-8ea6-5f7aa2a502b8 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:51.019722 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eed93ce8-59d1-4cd0-8ea6-5f7aa2a502b8 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:51.020172 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eed93ce8-59d1-4cd0-8ea6-5f7aa2a502b8 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:51.020968 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eed93ce8-59d1-4cd0-8ea6-5f7aa2a502b8 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:51.021690 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eed93ce8-59d1-4cd0-8ea6-5f7aa2a502b8 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:51.054121 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-eed93ce8-59d1-4cd0-8ea6-5f7aa2a502b8 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:05:51.168960 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-eed93ce8-59d1-4cd0-8ea6-5f7aa2a502b8 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a" status: 204 len: 0 microversion: 2.1 time: 0.165456 Sep 24 21:05:51.175939 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2131/4257] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:05:51 2022] DELETE /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:05:51.180708 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-81c62ceb-ad2c-4f9f-8854-daf9ea5e44cc tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:51.181866 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-81c62ceb-ad2c-4f9f-8854-daf9ea5e44cc tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:51.194768 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81c62ceb-ad2c-4f9f-8854-daf9ea5e44cc tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:51.197417 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81c62ceb-ad2c-4f9f-8854-daf9ea5e44cc tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:51.197733 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81c62ceb-ad2c-4f9f-8854-daf9ea5e44cc tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:51.198558 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81c62ceb-ad2c-4f9f-8854-daf9ea5e44cc tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:51.198959 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81c62ceb-ad2c-4f9f-8854-daf9ea5e44cc tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:51.200035 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81c62ceb-ad2c-4f9f-8854-daf9ea5e44cc tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:51.301436 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a1c6d153-4773-42ed-8f13-a92d5ff677fb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:51.302774 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a1c6d153-4773-42ed-8f13-a92d5ff677fb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:51.318737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1c6d153-4773-42ed-8f13-a92d5ff677fb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:51.321031 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1c6d153-4773-42ed-8f13-a92d5ff677fb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:51.321493 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1c6d153-4773-42ed-8f13-a92d5ff677fb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:51.322973 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1c6d153-4773-42ed-8f13-a92d5ff677fb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:51.324029 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1c6d153-4773-42ed-8f13-a92d5ff677fb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:51.327644 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1c6d153-4773-42ed-8f13-a92d5ff677fb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:51.679845 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a1c6d153-4773-42ed-8f13-a92d5ff677fb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:51.696474 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a1c6d153-4773-42ed-8f13-a92d5ff677fb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:51.706373 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a1c6d153-4773-42ed-8f13-a92d5ff677fb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:51.707685 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a1c6d153-4773-42ed-8f13-a92d5ff677fb tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1365 microversion: 2.47 time: 0.424154 Sep 24 21:05:51.718845 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2132/4258] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:05:51 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1365 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:05:51.792814 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-81c62ceb-ad2c-4f9f-8854-daf9ea5e44cc tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:51.805202 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-81c62ceb-ad2c-4f9f-8854-daf9ea5e44cc tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a" status: 200 len: 1515 microversion: 2.1 time: 0.629013 Sep 24 21:05:51.816409 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2127/4259] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:51 2022] GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a => generated 1515 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:51.933361 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-780239cc-8806-45b6-8257-c7f085aaabf7 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:51.934041 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-780239cc-8806-45b6-8257-c7f085aaabf7 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: c5bd74b9-2a72-452a-b603-9b99fba57f9b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:51.956272 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-780239cc-8806-45b6-8257-c7f085aaabf7 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:51.956980 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-780239cc-8806-45b6-8257-c7f085aaabf7 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:51.957602 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-780239cc-8806-45b6-8257-c7f085aaabf7 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:51.963502 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-780239cc-8806-45b6-8257-c7f085aaabf7 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:51.963998 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-780239cc-8806-45b6-8257-c7f085aaabf7 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:51.964449 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-780239cc-8806-45b6-8257-c7f085aaabf7 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:52.474276 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-780239cc-8806-45b6-8257-c7f085aaabf7 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:52.483396 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-780239cc-8806-45b6-8257-c7f085aaabf7 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b" status: 200 len: 1322 microversion: 2.1 time: 0.553783 Sep 24 21:05:52.495939 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2133/4260] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:51 2022] GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b => generated 1322 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:52.737089 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b712834e-5f13-4fb2-90c5-91d21b6dfe2d tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:52.738337 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b712834e-5f13-4fb2-90c5-91d21b6dfe2d tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:52.747086 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b712834e-5f13-4fb2-90c5-91d21b6dfe2d tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:52.747926 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b712834e-5f13-4fb2-90c5-91d21b6dfe2d tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:52.748672 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b712834e-5f13-4fb2-90c5-91d21b6dfe2d tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:52.749644 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b712834e-5f13-4fb2-90c5-91d21b6dfe2d tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:52.750268 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b712834e-5f13-4fb2-90c5-91d21b6dfe2d tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:52.763911 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b712834e-5f13-4fb2-90c5-91d21b6dfe2d tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:52.832152 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5c96b392-a578-4c94-a421-5218702dcc01 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:52.832827 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5c96b392-a578-4c94-a421-5218702dcc01 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:52.847177 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c96b392-a578-4c94-a421-5218702dcc01 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:52.850108 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c96b392-a578-4c94-a421-5218702dcc01 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:52.850837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c96b392-a578-4c94-a421-5218702dcc01 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:52.852572 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c96b392-a578-4c94-a421-5218702dcc01 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:52.855191 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c96b392-a578-4c94-a421-5218702dcc01 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:52.855656 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c96b392-a578-4c94-a421-5218702dcc01 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:52.980899 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b712834e-5f13-4fb2-90c5-91d21b6dfe2d tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:52.996049 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b712834e-5f13-4fb2-90c5-91d21b6dfe2d tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:52.998083 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b712834e-5f13-4fb2-90c5-91d21b6dfe2d tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:53.001115 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b712834e-5f13-4fb2-90c5-91d21b6dfe2d tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1365 microversion: 2.47 time: 0.268328 Sep 24 21:05:53.003325 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2128/4261] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:05:52 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1365 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:05:53.512616 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bf3763d8-2782-4760-9110-da078bbc8608 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:53.513549 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-bf3763d8-2782-4760-9110-da078bbc8608 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: c5bd74b9-2a72-452a-b603-9b99fba57f9b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:53.528329 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bf3763d8-2782-4760-9110-da078bbc8608 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:53.529042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bf3763d8-2782-4760-9110-da078bbc8608 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:53.529690 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bf3763d8-2782-4760-9110-da078bbc8608 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:53.530669 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bf3763d8-2782-4760-9110-da078bbc8608 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:53.532730 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bf3763d8-2782-4760-9110-da078bbc8608 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:53.533910 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bf3763d8-2782-4760-9110-da078bbc8608 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:53.738271 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5c96b392-a578-4c94-a421-5218702dcc01 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:53.762159 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5c96b392-a578-4c94-a421-5218702dcc01 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a" status: 200 len: 1515 microversion: 2.1 time: 0.934613 Sep 24 21:05:53.762843 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2134/4262] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:52 2022] GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a => generated 1515 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:54.023421 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-bf3763d8-2782-4760-9110-da078bbc8608 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:54.041665 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-38fe99f8-cc57-4ad4-915d-68c38c6bde19 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:54.044740 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-38fe99f8-cc57-4ad4-915d-68c38c6bde19 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:54.048861 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bf3763d8-2782-4760-9110-da078bbc8608 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b" status: 200 len: 1322 microversion: 2.1 time: 0.544055 Sep 24 21:05:54.063048 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2129/4263] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:53 2022] GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b => generated 1322 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:54.083846 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38fe99f8-cc57-4ad4-915d-68c38c6bde19 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:54.085525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38fe99f8-cc57-4ad4-915d-68c38c6bde19 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:54.086710 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38fe99f8-cc57-4ad4-915d-68c38c6bde19 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:54.091701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38fe99f8-cc57-4ad4-915d-68c38c6bde19 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:54.094884 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38fe99f8-cc57-4ad4-915d-68c38c6bde19 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:54.097015 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38fe99f8-cc57-4ad4-915d-68c38c6bde19 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:54.355684 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-38fe99f8-cc57-4ad4-915d-68c38c6bde19 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:54.369731 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-38fe99f8-cc57-4ad4-915d-68c38c6bde19 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:54.372206 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-38fe99f8-cc57-4ad4-915d-68c38c6bde19 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:54.378997 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-38fe99f8-cc57-4ad4-915d-68c38c6bde19 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1365 microversion: 2.47 time: 0.348854 Sep 24 21:05:54.382087 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2135/4264] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:05:54 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1365 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:05:54.410874 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-cd2f3268-cf2e-420c-9e6a-008303b47c92 req-cc761998-e032-4e01-881a-c69049214cfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd3a51be-17a5-4293-9bad-a3768d7ec10b", "name": "network-vif-plugged", "status": "completed", "tag": "50c9da6c-eed0-476d-b42f-e3195ac755fc"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:05:54.459527 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-cd2f3268-cf2e-420c-9e6a-008303b47c92 req-cc761998-e032-4e01-881a-c69049214cfa service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:54.461007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-cd2f3268-cf2e-420c-9e6a-008303b47c92 req-cc761998-e032-4e01-881a-c69049214cfa service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:54.462620 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-cd2f3268-cf2e-420c-9e6a-008303b47c92 req-cc761998-e032-4e01-881a-c69049214cfa service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:54.518832 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-cd2f3268-cf2e-420c-9e6a-008303b47c92 req-cc761998-e032-4e01-881a-c69049214cfa service nova] Creating event network-vif-plugged:50c9da6c-eed0-476d-b42f-e3195ac755fc for instance fd3a51be-17a5-4293-9bad-a3768d7ec10b on nch2-master-1 Sep 24 21:05:54.531421 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-9afabf8e-2515-4001-adb8-9f580ef707ba req-33ed18dd-a325-4781-97d3-0319178193df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5bd74b9-2a72-452a-b603-9b99fba57f9b", "tag": "d25008d5-04dc-438e-bb15-84c9839c9094"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:05:54.539244 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-cd2f3268-cf2e-420c-9e6a-008303b47c92 req-cc761998-e032-4e01-881a-c69049214cfa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154465 Sep 24 21:05:54.542707 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2136/4265] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:05:54.563396 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-9afabf8e-2515-4001-adb8-9f580ef707ba req-33ed18dd-a325-4781-97d3-0319178193df service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:54.570384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-9afabf8e-2515-4001-adb8-9f580ef707ba req-33ed18dd-a325-4781-97d3-0319178193df service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:54.571413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-9afabf8e-2515-4001-adb8-9f580ef707ba req-33ed18dd-a325-4781-97d3-0319178193df service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:54.601747 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-9afabf8e-2515-4001-adb8-9f580ef707ba req-33ed18dd-a325-4781-97d3-0319178193df service nova] Creating event network-changed:d25008d5-04dc-438e-bb15-84c9839c9094 for instance c5bd74b9-2a72-452a-b603-9b99fba57f9b on nch1-master-1 Sep 24 21:05:54.617511 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-9afabf8e-2515-4001-adb8-9f580ef707ba req-33ed18dd-a325-4781-97d3-0319178193df service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.465282 Sep 24 21:05:54.627015 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2130/4266] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:05:54.793666 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7b4c786d-dbfa-4ca4-9e67-563ac9be4e89 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:54.796481 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7b4c786d-dbfa-4ca4-9e67-563ac9be4e89 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:54.807049 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b4c786d-dbfa-4ca4-9e67-563ac9be4e89 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:54.808074 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b4c786d-dbfa-4ca4-9e67-563ac9be4e89 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:54.808701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b4c786d-dbfa-4ca4-9e67-563ac9be4e89 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:54.809745 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b4c786d-dbfa-4ca4-9e67-563ac9be4e89 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:54.810275 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b4c786d-dbfa-4ca4-9e67-563ac9be4e89 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:54.810820 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b4c786d-dbfa-4ca4-9e67-563ac9be4e89 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:55.076951 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b26c48c4-2252-4568-997a-3bcc4c51554e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:55.077803 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b26c48c4-2252-4568-997a-3bcc4c51554e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: c5bd74b9-2a72-452a-b603-9b99fba57f9b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:55.085655 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b26c48c4-2252-4568-997a-3bcc4c51554e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:55.086155 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b26c48c4-2252-4568-997a-3bcc4c51554e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:55.086623 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b26c48c4-2252-4568-997a-3bcc4c51554e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:55.087560 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b26c48c4-2252-4568-997a-3bcc4c51554e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:55.088109 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b26c48c4-2252-4568-997a-3bcc4c51554e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:55.088814 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b26c48c4-2252-4568-997a-3bcc4c51554e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:55.383128 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7b4c786d-dbfa-4ca4-9e67-563ac9be4e89 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:55.416996 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7b4c786d-dbfa-4ca4-9e67-563ac9be4e89 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a" status: 200 len: 1515 microversion: 2.1 time: 0.631840 Sep 24 21:05:55.417604 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2137/4267] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:54 2022] GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a => generated 1515 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:55.425588 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5bbcdad6-7745-4e23-a07d-0fbda8596074 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:55.426459 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5bbcdad6-7745-4e23-a07d-0fbda8596074 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:55.434933 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5bbcdad6-7745-4e23-a07d-0fbda8596074 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:55.435766 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5bbcdad6-7745-4e23-a07d-0fbda8596074 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:55.436451 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5bbcdad6-7745-4e23-a07d-0fbda8596074 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:55.448835 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5bbcdad6-7745-4e23-a07d-0fbda8596074 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:55.452431 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5bbcdad6-7745-4e23-a07d-0fbda8596074 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:55.453380 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5bbcdad6-7745-4e23-a07d-0fbda8596074 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:55.638360 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5bbcdad6-7745-4e23-a07d-0fbda8596074 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:55.652899 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5bbcdad6-7745-4e23-a07d-0fbda8596074 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:55.656669 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5bbcdad6-7745-4e23-a07d-0fbda8596074 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:55.658724 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5bbcdad6-7745-4e23-a07d-0fbda8596074 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1365 microversion: 2.47 time: 0.238577 Sep 24 21:05:55.659842 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2138/4268] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:05:55 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1365 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:05:55.786601 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b26c48c4-2252-4568-997a-3bcc4c51554e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:55.800377 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b26c48c4-2252-4568-997a-3bcc4c51554e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b" status: 200 len: 1322 microversion: 2.1 time: 0.728948 Sep 24 21:05:55.801181 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2131/4269] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:55 2022] GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b => generated 1322 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:56.441817 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-05a9ae37-400d-4eec-a94a-20769325a844 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:56.443125 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-05a9ae37-400d-4eec-a94a-20769325a844 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:56.463476 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05a9ae37-400d-4eec-a94a-20769325a844 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:56.465000 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05a9ae37-400d-4eec-a94a-20769325a844 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:56.466138 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05a9ae37-400d-4eec-a94a-20769325a844 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:56.466979 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05a9ae37-400d-4eec-a94a-20769325a844 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:56.467982 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05a9ae37-400d-4eec-a94a-20769325a844 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:56.468438 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05a9ae37-400d-4eec-a94a-20769325a844 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:56.512494 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05a9ae37-400d-4eec-a94a-20769325a844 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:56.513203 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05a9ae37-400d-4eec-a94a-20769325a844 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:56.513792 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05a9ae37-400d-4eec-a94a-20769325a844 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:56.514430 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-05a9ae37-400d-4eec-a94a-20769325a844 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lazy-loading 'fault' on Instance uuid fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:05:56.565386 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-20919d3d-e5f8-48d1-ad29-55dbffcb94d6 req-0978ccf5-ce2d-4a91-b063-af28f5c0602c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f857f30-f6d8-4107-b14d-12502a60fc74", "name": "network-vif-plugged", "status": "completed", "tag": "6287fe41-9f95-412b-a43f-6f1030bebe2e"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:05:56.577897 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-20919d3d-e5f8-48d1-ad29-55dbffcb94d6 req-0978ccf5-ce2d-4a91-b063-af28f5c0602c service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:56.578386 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-20919d3d-e5f8-48d1-ad29-55dbffcb94d6 req-0978ccf5-ce2d-4a91-b063-af28f5c0602c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:56.578857 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-20919d3d-e5f8-48d1-ad29-55dbffcb94d6 req-0978ccf5-ce2d-4a91-b063-af28f5c0602c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:56.589931 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-05a9ae37-400d-4eec-a94a-20769325a844 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:56.598323 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-05a9ae37-400d-4eec-a94a-20769325a844 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a" status: 200 len: 1318 microversion: 2.1 time: 0.161496 Sep 24 21:05:56.600135 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-20919d3d-e5f8-48d1-ad29-55dbffcb94d6 req-0978ccf5-ce2d-4a91-b063-af28f5c0602c service nova] Creating event network-vif-plugged:6287fe41-9f95-412b-a43f-6f1030bebe2e for instance 4f857f30-f6d8-4107-b14d-12502a60fc74 on nch2-master-1 Sep 24 21:05:56.606114 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-20919d3d-e5f8-48d1-ad29-55dbffcb94d6 req-0978ccf5-ce2d-4a91-b063-af28f5c0602c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048230 Sep 24 21:05:56.607772 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2132/4270] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:05:56.615321 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2139/4271] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:56 2022] GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:56.673000 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-b9f6c013-58bf-4844-819f-6e0b3ea58af1 req-c71cf52f-f83b-4091-871a-ee2aaa02aa05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a", "name": "network-vif-deleted", "tag": "2407e9d3-2a9d-4740-9d8e-dd3109d28da2"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:05:56.687518 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-b9f6c013-58bf-4844-819f-6e0b3ea58af1 req-c71cf52f-f83b-4091-871a-ee2aaa02aa05 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:56.688180 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-b9f6c013-58bf-4844-819f-6e0b3ea58af1 req-c71cf52f-f83b-4091-871a-ee2aaa02aa05 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:56.689622 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-b9f6c013-58bf-4844-819f-6e0b3ea58af1 req-c71cf52f-f83b-4091-871a-ee2aaa02aa05 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:56.694404 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-28637b98-c22a-4bc5-a82f-e579db3fa296 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:56.698851 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-28637b98-c22a-4bc5-a82f-e579db3fa296 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:56.704222 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-b9f6c013-58bf-4844-819f-6e0b3ea58af1 req-c71cf52f-f83b-4091-871a-ee2aaa02aa05 service nova] Creating event network-vif-deleted:2407e9d3-2a9d-4740-9d8e-dd3109d28da2 for instance fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a on nch1-master-1 Sep 24 21:05:56.708862 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-28637b98-c22a-4bc5-a82f-e579db3fa296 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:56.713190 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-28637b98-c22a-4bc5-a82f-e579db3fa296 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:56.713658 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-28637b98-c22a-4bc5-a82f-e579db3fa296 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:56.714398 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-b9f6c013-58bf-4844-819f-6e0b3ea58af1 req-c71cf52f-f83b-4091-871a-ee2aaa02aa05 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047176 Sep 24 21:05:56.714559 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-28637b98-c22a-4bc5-a82f-e579db3fa296 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:56.715352 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-28637b98-c22a-4bc5-a82f-e579db3fa296 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:56.715792 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-28637b98-c22a-4bc5-a82f-e579db3fa296 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:56.717876 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2133/4272] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:05:56.825877 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ed492c3d-08a9-4fd3-a4a3-d1219f4aefe9 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:56.826709 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ed492c3d-08a9-4fd3-a4a3-d1219f4aefe9 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: c5bd74b9-2a72-452a-b603-9b99fba57f9b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:56.833853 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed492c3d-08a9-4fd3-a4a3-d1219f4aefe9 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:56.834454 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed492c3d-08a9-4fd3-a4a3-d1219f4aefe9 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:56.834995 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed492c3d-08a9-4fd3-a4a3-d1219f4aefe9 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:56.835781 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed492c3d-08a9-4fd3-a4a3-d1219f4aefe9 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:56.836252 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed492c3d-08a9-4fd3-a4a3-d1219f4aefe9 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:56.836688 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed492c3d-08a9-4fd3-a4a3-d1219f4aefe9 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:56.841061 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:05:56.850342 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-28637b98-c22a-4bc5-a82f-e579db3fa296 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:56.861510 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-28637b98-c22a-4bc5-a82f-e579db3fa296 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:56.865768 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-28637b98-c22a-4bc5-a82f-e579db3fa296 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:56.868864 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-28637b98-c22a-4bc5-a82f-e579db3fa296 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1365 microversion: 2.47 time: 0.183266 Sep 24 21:05:56.870118 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2140/4273] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:05:56 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:05:57.137296 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ed492c3d-08a9-4fd3-a4a3-d1219f4aefe9 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:57.146766 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ed492c3d-08a9-4fd3-a4a3-d1219f4aefe9 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b" status: 200 len: 1322 microversion: 2.1 time: 0.325197 Sep 24 21:05:57.147991 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2134/4274] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:56 2022] GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b => generated 1322 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:05:57.622811 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5de1c1cf-d013-4bdb-aa1b-577480003dd7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:57.624132 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5de1c1cf-d013-4bdb-aa1b-577480003dd7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:57.651918 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5de1c1cf-d013-4bdb-aa1b-577480003dd7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:57.653435 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5de1c1cf-d013-4bdb-aa1b-577480003dd7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:57.654115 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5de1c1cf-d013-4bdb-aa1b-577480003dd7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:57.655116 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5de1c1cf-d013-4bdb-aa1b-577480003dd7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:57.656020 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5de1c1cf-d013-4bdb-aa1b-577480003dd7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:57.656651 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5de1c1cf-d013-4bdb-aa1b-577480003dd7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:57.709958 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5de1c1cf-d013-4bdb-aa1b-577480003dd7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:57.710972 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5de1c1cf-d013-4bdb-aa1b-577480003dd7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:57.711594 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5de1c1cf-d013-4bdb-aa1b-577480003dd7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:57.712394 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-5de1c1cf-d013-4bdb-aa1b-577480003dd7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lazy-loading 'fault' on Instance uuid fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:05:57.771835 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5de1c1cf-d013-4bdb-aa1b-577480003dd7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:57.780565 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5de1c1cf-d013-4bdb-aa1b-577480003dd7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a" status: 200 len: 1318 microversion: 2.1 time: 0.161725 Sep 24 21:05:57.781339 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2141/4275] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:57 2022] GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:57.898932 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d01334ca-e6ed-422d-b0cd-584fe757faac tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:57.899572 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d01334ca-e6ed-422d-b0cd-584fe757faac tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:57.906189 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d01334ca-e6ed-422d-b0cd-584fe757faac tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:57.907124 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d01334ca-e6ed-422d-b0cd-584fe757faac tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:57.908669 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d01334ca-e6ed-422d-b0cd-584fe757faac tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:57.909629 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d01334ca-e6ed-422d-b0cd-584fe757faac tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:57.910287 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d01334ca-e6ed-422d-b0cd-584fe757faac tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:57.911200 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d01334ca-e6ed-422d-b0cd-584fe757faac tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:58.030741 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d01334ca-e6ed-422d-b0cd-584fe757faac tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:58.041441 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d01334ca-e6ed-422d-b0cd-584fe757faac tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:58.042939 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d01334ca-e6ed-422d-b0cd-584fe757faac tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:58.044138 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d01334ca-e6ed-422d-b0cd-584fe757faac tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1365 microversion: 2.47 time: 0.151864 Sep 24 21:05:58.045014 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2135/4276] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:05:57 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:05:58.171663 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e808e5fb-176b-4e0e-b2c3-d7f02429133d tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:58.172348 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e808e5fb-176b-4e0e-b2c3-d7f02429133d tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: c5bd74b9-2a72-452a-b603-9b99fba57f9b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:58.179125 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e808e5fb-176b-4e0e-b2c3-d7f02429133d tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:58.180006 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e808e5fb-176b-4e0e-b2c3-d7f02429133d tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:58.181059 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e808e5fb-176b-4e0e-b2c3-d7f02429133d tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:58.181810 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e808e5fb-176b-4e0e-b2c3-d7f02429133d tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:58.182263 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e808e5fb-176b-4e0e-b2c3-d7f02429133d tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:58.182974 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e808e5fb-176b-4e0e-b2c3-d7f02429133d tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:58.202167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:05:58.500489 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e808e5fb-176b-4e0e-b2c3-d7f02429133d tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:58.508520 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e808e5fb-176b-4e0e-b2c3-d7f02429133d tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b" status: 200 len: 1322 microversion: 2.1 time: 0.341853 Sep 24 21:05:58.524856 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2142/4277] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:58 2022] GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b => generated 1322 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:05:58.808360 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3811cb4a-09b0-41a4-bf06-d12cf52c5104 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:58.809478 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3811cb4a-09b0-41a4-bf06-d12cf52c5104 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:58.822439 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3811cb4a-09b0-41a4-bf06-d12cf52c5104 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:58.825070 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3811cb4a-09b0-41a4-bf06-d12cf52c5104 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:58.825815 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3811cb4a-09b0-41a4-bf06-d12cf52c5104 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:58.827008 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3811cb4a-09b0-41a4-bf06-d12cf52c5104 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:58.827817 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3811cb4a-09b0-41a4-bf06-d12cf52c5104 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:58.828484 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3811cb4a-09b0-41a4-bf06-d12cf52c5104 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:58.929237 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3811cb4a-09b0-41a4-bf06-d12cf52c5104 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:58.929815 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3811cb4a-09b0-41a4-bf06-d12cf52c5104 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:58.930224 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3811cb4a-09b0-41a4-bf06-d12cf52c5104 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:58.931860 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-3811cb4a-09b0-41a4-bf06-d12cf52c5104 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lazy-loading 'fault' on Instance uuid fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:05:59.033654 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3811cb4a-09b0-41a4-bf06-d12cf52c5104 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:59.045425 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3811cb4a-09b0-41a4-bf06-d12cf52c5104 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a" status: 200 len: 1318 microversion: 2.1 time: 0.245347 Sep 24 21:05:59.054899 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2136/4278] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:58 2022] GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:05:59.079822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-292261e4-ab0b-4e39-8728-181df7deed7e tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:59.081233 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-292261e4-ab0b-4e39-8728-181df7deed7e tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:59.090518 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-292261e4-ab0b-4e39-8728-181df7deed7e tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:59.091982 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-292261e4-ab0b-4e39-8728-181df7deed7e tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:59.092668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-292261e4-ab0b-4e39-8728-181df7deed7e tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:59.094133 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-292261e4-ab0b-4e39-8728-181df7deed7e tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:59.095024 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-292261e4-ab0b-4e39-8728-181df7deed7e tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:59.095829 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-292261e4-ab0b-4e39-8728-181df7deed7e tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:59.237756 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-292261e4-ab0b-4e39-8728-181df7deed7e tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:59.247484 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-292261e4-ab0b-4e39-8728-181df7deed7e tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:59.255961 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-292261e4-ab0b-4e39-8728-181df7deed7e tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:59.257201 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-292261e4-ab0b-4e39-8728-181df7deed7e tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1365 microversion: 2.47 time: 0.182255 Sep 24 21:05:59.257763 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2143/4279] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:05:59 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:05:59.532112 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ea565a51-6cbf-4e41-a786-cca373ee23f9 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:05:59.533170 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ea565a51-6cbf-4e41-a786-cca373ee23f9 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: c5bd74b9-2a72-452a-b603-9b99fba57f9b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:05:59.540807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea565a51-6cbf-4e41-a786-cca373ee23f9 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:59.541558 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea565a51-6cbf-4e41-a786-cca373ee23f9 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:59.542010 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea565a51-6cbf-4e41-a786-cca373ee23f9 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:59.542747 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea565a51-6cbf-4e41-a786-cca373ee23f9 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:05:59.543279 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea565a51-6cbf-4e41-a786-cca373ee23f9 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:05:59.543714 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea565a51-6cbf-4e41-a786-cca373ee23f9 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:05:59.791817 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ea565a51-6cbf-4e41-a786-cca373ee23f9 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:05:59.800963 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ea565a51-6cbf-4e41-a786-cca373ee23f9 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b" status: 200 len: 1322 microversion: 2.1 time: 0.272961 Sep 24 21:05:59.808806 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2137/4280] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:05:59 2022] GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b => generated 1322 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:00.069856 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-341ee965-a336-459e-a357-538d3776ce78 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:00.070958 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-341ee965-a336-459e-a357-538d3776ce78 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:00.077307 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-341ee965-a336-459e-a357-538d3776ce78 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:00.077814 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-341ee965-a336-459e-a357-538d3776ce78 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:00.078258 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-341ee965-a336-459e-a357-538d3776ce78 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:00.079011 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-341ee965-a336-459e-a357-538d3776ce78 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:00.079481 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-341ee965-a336-459e-a357-538d3776ce78 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:00.079921 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-341ee965-a336-459e-a357-538d3776ce78 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:00.096992 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-341ee965-a336-459e-a357-538d3776ce78 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] HTTP exception thrown: Instance fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a could not be found. Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-341ee965-a336-459e-a357-538d3776ce78 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Request method failure captured: Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a HTTP/1.1 Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3CaLUabI_YBYC2XnM21T8dL5FNXXvceQt6A3bijM2xUqNxa7o1mArSf5dFDgPeh3vgkyUYVZenobpLU3uEqGcvnEbw-nMZfSWEM5OkDmeYEccMJ8-yhXeZa1T-3DnHpo2MRC1ewpBuezwDhE04pucSEH5uW1HzlM0IgaFpEaRXllaA Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersTestJSON-1457868986 Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersTestJSON-1457868986-project Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: e557d91b49c143499d809a55e85932fd Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersTestJSON-1457868986-project Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a could not be found. Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a'} Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a could not be found. Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a could not be found. Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:00.099306 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:00.108555 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:00.108555 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:00.108555 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:00.108555 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:06:00.108555 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:06:00.108555 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a could not be found. Sep 24 21:06:00.108555 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:00.108555 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-341ee965-a336-459e-a357-538d3776ce78 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Returning 404 to user: Instance fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:06:00.108555 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-341ee965-a336-459e-a357-538d3776ce78 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a" status: 404 len: 111 microversion: 2.1 time: 0.035484 Sep 24 21:06:00.108555 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2144/4281] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:00 2022] GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:06:00.259595 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-40970b1f-e463-4aab-9d9d-70a2c5346eda tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1274977809", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "86ee1dec-a957-4cc1-98d2-2e275615c01a"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:06:00.291684 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a393c0fe-f81d-46e3-8c82-21a101637be9 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:00.292452 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a393c0fe-f81d-46e3-8c82-21a101637be9 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:00.303559 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a393c0fe-f81d-46e3-8c82-21a101637be9 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:00.304221 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a393c0fe-f81d-46e3-8c82-21a101637be9 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:00.304773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a393c0fe-f81d-46e3-8c82-21a101637be9 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:00.306140 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a393c0fe-f81d-46e3-8c82-21a101637be9 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:00.307135 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a393c0fe-f81d-46e3-8c82-21a101637be9 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:00.307836 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a393c0fe-f81d-46e3-8c82-21a101637be9 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:00.344456 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-40970b1f-e463-4aab-9d9d-70a2c5346eda tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] validate_networks() for [('86ee1dec-a957-4cc1-98d2-2e275615c01a', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:06:00.428210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a393c0fe-f81d-46e3-8c82-21a101637be9 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:00.444401 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a393c0fe-f81d-46e3-8c82-21a101637be9 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:00.446210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a393c0fe-f81d-46e3-8c82-21a101637be9 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:00.451316 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a393c0fe-f81d-46e3-8c82-21a101637be9 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1365 microversion: 2.47 time: 0.168417 Sep 24 21:06:00.451985 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2145/4282] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:06:00 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:06:00.830594 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7d6c7240-f022-46f3-be30-fe27294335a1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:00.831530 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7d6c7240-f022-46f3-be30-fe27294335a1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: c5bd74b9-2a72-452a-b603-9b99fba57f9b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:00.849961 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d6c7240-f022-46f3-be30-fe27294335a1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:00.850462 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d6c7240-f022-46f3-be30-fe27294335a1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:00.850925 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d6c7240-f022-46f3-be30-fe27294335a1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:00.858579 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d6c7240-f022-46f3-be30-fe27294335a1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:00.859075 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d6c7240-f022-46f3-be30-fe27294335a1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:00.859643 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d6c7240-f022-46f3-be30-fe27294335a1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:01.594618 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-40970b1f-e463-4aab-9d9d-70a2c5346eda tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:06:01.596886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-40970b1f-e463-4aab-9d9d-70a2c5346eda tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:06:01.598976 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-40970b1f-e463-4aab-9d9d-70a2c5346eda tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:06:01.600017 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-40970b1f-e463-4aab-9d9d-70a2c5346eda tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:06:01.601845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-40970b1f-e463-4aab-9d9d-70a2c5346eda tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:06:01.620442 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40970b1f-e463-4aab-9d9d-70a2c5346eda tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:01.621427 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40970b1f-e463-4aab-9d9d-70a2c5346eda tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:01.622110 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40970b1f-e463-4aab-9d9d-70a2c5346eda tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:01.623115 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40970b1f-e463-4aab-9d9d-70a2c5346eda tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:01.625225 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40970b1f-e463-4aab-9d9d-70a2c5346eda tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:01.626205 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40970b1f-e463-4aab-9d9d-70a2c5346eda tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:01.632793 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7d6c7240-f022-46f3-be30-fe27294335a1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:01.645568 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7d6c7240-f022-46f3-be30-fe27294335a1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b" status: 200 len: 1322 microversion: 2.1 time: 0.819356 Sep 24 21:06:01.670944 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2146/4283] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:00 2022] GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b => generated 1322 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:01.673702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-40970b1f-e463-4aab-9d9d-70a2c5346eda tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Getting quotas for project accafa2724354ca8b1c9f19940989429. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:06:01.678705 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6c3ce6ef-b669-40d3-8a9e-aac9011636ff tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:01.680043 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6c3ce6ef-b669-40d3-8a9e-aac9011636ff tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:01.681089 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-40970b1f-e463-4aab-9d9d-70a2c5346eda tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Getting quotas for user e557d91b49c143499d809a55e85932fd and project accafa2724354ca8b1c9f19940989429. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:06:01.686872 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c3ce6ef-b669-40d3-8a9e-aac9011636ff tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:01.687626 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c3ce6ef-b669-40d3-8a9e-aac9011636ff tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:01.688239 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c3ce6ef-b669-40d3-8a9e-aac9011636ff tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:01.689144 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c3ce6ef-b669-40d3-8a9e-aac9011636ff tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:01.689780 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c3ce6ef-b669-40d3-8a9e-aac9011636ff tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:01.690946 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c3ce6ef-b669-40d3-8a9e-aac9011636ff tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:01.703350 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-40970b1f-e463-4aab-9d9d-70a2c5346eda tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:06:01.705986 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-40970b1f-e463-4aab-9d9d-70a2c5346eda tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:06:01.757711 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-40970b1f-e463-4aab-9d9d-70a2c5346eda tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.501959 Sep 24 21:06:01.758375 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2138/4284] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:06:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:06:01.807685 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6c3ce6ef-b669-40d3-8a9e-aac9011636ff tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:01.844594 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6c3ce6ef-b669-40d3-8a9e-aac9011636ff tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:01.848568 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6c3ce6ef-b669-40d3-8a9e-aac9011636ff tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:01.857874 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6c3ce6ef-b669-40d3-8a9e-aac9011636ff tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1365 microversion: 2.47 time: 0.184171 Sep 24 21:06:01.858485 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2147/4285] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:06:01 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1365 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:06:01.888169 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-130b56d2-ef24-4677-af6b-3d78d1b860b4 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:01.889330 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-130b56d2-ef24-4677-af6b-3d78d1b860b4 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:02.057155 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-130b56d2-ef24-4677-af6b-3d78d1b860b4 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:02.068373 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-130b56d2-ef24-4677-af6b-3d78d1b860b4 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 200 len: 1209 microversion: 2.1 time: 0.191281 Sep 24 21:06:02.071246 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2148/4286] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:01 2022] GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 1209 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:02.170528 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-86231448-96f8-40b1-9036-c524015277dc tempest-PortsAdminExtendedAttrsTestJSON-1433726541 tempest-PortsAdminExtendedAttrsTestJSON-1433726541-project-admin] Calling method '.version_select at 0x7f4b078db310>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:02.172548 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86231448-96f8-40b1-9036-c524015277dc tempest-PortsAdminExtendedAttrsTestJSON-1433726541 tempest-PortsAdminExtendedAttrsTestJSON-1433726541-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:02.173053 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86231448-96f8-40b1-9036-c524015277dc tempest-PortsAdminExtendedAttrsTestJSON-1433726541 tempest-PortsAdminExtendedAttrsTestJSON-1433726541-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:02.173503 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86231448-96f8-40b1-9036-c524015277dc tempest-PortsAdminExtendedAttrsTestJSON-1433726541 tempest-PortsAdminExtendedAttrsTestJSON-1433726541-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:02.241139 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86231448-96f8-40b1-9036-c524015277dc tempest-PortsAdminExtendedAttrsTestJSON-1433726541 tempest-PortsAdminExtendedAttrsTestJSON-1433726541-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:02.245445 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86231448-96f8-40b1-9036-c524015277dc tempest-PortsAdminExtendedAttrsTestJSON-1433726541 tempest-PortsAdminExtendedAttrsTestJSON-1433726541-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:02.246818 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86231448-96f8-40b1-9036-c524015277dc tempest-PortsAdminExtendedAttrsTestJSON-1433726541 tempest-PortsAdminExtendedAttrsTestJSON-1433726541-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:02.279195 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86231448-96f8-40b1-9036-c524015277dc tempest-PortsAdminExtendedAttrsTestJSON-1433726541 tempest-PortsAdminExtendedAttrsTestJSON-1433726541-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:02.280524 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86231448-96f8-40b1-9036-c524015277dc tempest-PortsAdminExtendedAttrsTestJSON-1433726541 tempest-PortsAdminExtendedAttrsTestJSON-1433726541-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:02.281996 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86231448-96f8-40b1-9036-c524015277dc tempest-PortsAdminExtendedAttrsTestJSON-1433726541 tempest-PortsAdminExtendedAttrsTestJSON-1433726541-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:02.320444 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-86231448-96f8-40b1-9036-c524015277dc tempest-PortsAdminExtendedAttrsTestJSON-1433726541 tempest-PortsAdminExtendedAttrsTestJSON-1433726541-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.560696 Sep 24 21:06:02.326107 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2139/4287] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 21:06:01 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:06:02.678334 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9bcff04d-e87f-4a4f-86e2-200ec4c59f44 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:02.679067 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9bcff04d-e87f-4a4f-86e2-200ec4c59f44 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: c5bd74b9-2a72-452a-b603-9b99fba57f9b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:02.688793 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9bcff04d-e87f-4a4f-86e2-200ec4c59f44 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:02.689294 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9bcff04d-e87f-4a4f-86e2-200ec4c59f44 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:02.689745 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9bcff04d-e87f-4a4f-86e2-200ec4c59f44 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:02.690473 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9bcff04d-e87f-4a4f-86e2-200ec4c59f44 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:02.690977 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9bcff04d-e87f-4a4f-86e2-200ec4c59f44 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:02.691413 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9bcff04d-e87f-4a4f-86e2-200ec4c59f44 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:02.888233 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2a93581a-d1f4-493e-b11f-c469413a3b4c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:02.889644 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2a93581a-d1f4-493e-b11f-c469413a3b4c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:02.904720 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9bcff04d-e87f-4a4f-86e2-200ec4c59f44 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:02.916646 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2a93581a-d1f4-493e-b11f-c469413a3b4c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:02.918031 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2a93581a-d1f4-493e-b11f-c469413a3b4c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:02.918927 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9bcff04d-e87f-4a4f-86e2-200ec4c59f44 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b" status: 200 len: 1322 microversion: 2.1 time: 0.242507 Sep 24 21:06:02.919603 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2a93581a-d1f4-493e-b11f-c469413a3b4c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:02.921038 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2149/4288] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:02 2022] GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:02.921521 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2a93581a-d1f4-493e-b11f-c469413a3b4c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:02.922013 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2a93581a-d1f4-493e-b11f-c469413a3b4c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:02.925364 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2a93581a-d1f4-493e-b11f-c469413a3b4c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:03.053791 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2a93581a-d1f4-493e-b11f-c469413a3b4c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:03.068878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2a93581a-d1f4-493e-b11f-c469413a3b4c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:03.071448 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2a93581a-d1f4-493e-b11f-c469413a3b4c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:03.073005 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2a93581a-d1f4-493e-b11f-c469413a3b4c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1365 microversion: 2.47 time: 0.189824 Sep 24 21:06:03.074270 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2140/4289] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:06:02 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1365 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:06:03.102860 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2c78bb16-72de-4607-a483-2beafb4e38a1 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:03.103491 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2c78bb16-72de-4607-a483-2beafb4e38a1 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:03.128693 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c78bb16-72de-4607-a483-2beafb4e38a1 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:03.129298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c78bb16-72de-4607-a483-2beafb4e38a1 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:03.129929 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c78bb16-72de-4607-a483-2beafb4e38a1 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:03.132499 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c78bb16-72de-4607-a483-2beafb4e38a1 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:03.132972 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c78bb16-72de-4607-a483-2beafb4e38a1 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:03.133408 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c78bb16-72de-4607-a483-2beafb4e38a1 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:03.205659 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2c78bb16-72de-4607-a483-2beafb4e38a1 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:03.215647 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2c78bb16-72de-4607-a483-2beafb4e38a1 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 200 len: 1261 microversion: 2.1 time: 0.124959 Sep 24 21:06:03.227230 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2150/4290] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:03 2022] GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 1261 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:03.421427 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-55776933-0e87-436e-b9e2-67379939cc76 req-db6d889f-7f20-4f43-a532-dabfe60976a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5bd74b9-2a72-452a-b603-9b99fba57f9b", "name": "network-vif-plugged", "status": "completed", "tag": "d25008d5-04dc-438e-bb15-84c9839c9094"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:06:03.448222 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-55776933-0e87-436e-b9e2-67379939cc76 req-db6d889f-7f20-4f43-a532-dabfe60976a3 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:03.449195 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-55776933-0e87-436e-b9e2-67379939cc76 req-db6d889f-7f20-4f43-a532-dabfe60976a3 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:03.450135 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-55776933-0e87-436e-b9e2-67379939cc76 req-db6d889f-7f20-4f43-a532-dabfe60976a3 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:03.493480 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-55776933-0e87-436e-b9e2-67379939cc76 req-db6d889f-7f20-4f43-a532-dabfe60976a3 service nova] Creating event network-vif-plugged:d25008d5-04dc-438e-bb15-84c9839c9094 for instance c5bd74b9-2a72-452a-b603-9b99fba57f9b on nch1-master-1 Sep 24 21:06:03.503631 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-55776933-0e87-436e-b9e2-67379939cc76 req-db6d889f-7f20-4f43-a532-dabfe60976a3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086145 Sep 24 21:06:03.521373 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2141/4291] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:06:03.945646 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1a9b76e4-6e61-4920-9e44-deccf918d529 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:03.946399 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1a9b76e4-6e61-4920-9e44-deccf918d529 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: c5bd74b9-2a72-452a-b603-9b99fba57f9b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:03.952917 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a9b76e4-6e61-4920-9e44-deccf918d529 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:03.953730 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a9b76e4-6e61-4920-9e44-deccf918d529 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:03.954396 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a9b76e4-6e61-4920-9e44-deccf918d529 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:03.955224 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a9b76e4-6e61-4920-9e44-deccf918d529 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:03.955755 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a9b76e4-6e61-4920-9e44-deccf918d529 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:03.956186 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a9b76e4-6e61-4920-9e44-deccf918d529 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:04.107209 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3cb15e9d-d733-4b22-bfdd-0d2e45f0cb99 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:04.110032 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3cb15e9d-d733-4b22-bfdd-0d2e45f0cb99 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:04.120803 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3cb15e9d-d733-4b22-bfdd-0d2e45f0cb99 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:04.122603 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3cb15e9d-d733-4b22-bfdd-0d2e45f0cb99 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:04.123281 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3cb15e9d-d733-4b22-bfdd-0d2e45f0cb99 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:04.124327 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3cb15e9d-d733-4b22-bfdd-0d2e45f0cb99 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:04.125090 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3cb15e9d-d733-4b22-bfdd-0d2e45f0cb99 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:04.125692 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3cb15e9d-d733-4b22-bfdd-0d2e45f0cb99 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:04.150910 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1a9b76e4-6e61-4920-9e44-deccf918d529 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:04.167728 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1a9b76e4-6e61-4920-9e44-deccf918d529 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b" status: 200 len: 1322 microversion: 2.1 time: 0.226866 Sep 24 21:06:04.174641 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2151/4292] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:03 2022] GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:06:04.242413 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a62ca04a-26a9-4178-815c-d80705f9f2b1 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:04.243326 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a62ca04a-26a9-4178-815c-d80705f9f2b1 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:04.249505 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a62ca04a-26a9-4178-815c-d80705f9f2b1 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:04.250006 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a62ca04a-26a9-4178-815c-d80705f9f2b1 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:04.250449 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a62ca04a-26a9-4178-815c-d80705f9f2b1 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:04.251193 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a62ca04a-26a9-4178-815c-d80705f9f2b1 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:04.251660 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a62ca04a-26a9-4178-815c-d80705f9f2b1 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:04.252096 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a62ca04a-26a9-4178-815c-d80705f9f2b1 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:04.277460 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3cb15e9d-d733-4b22-bfdd-0d2e45f0cb99 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:04.289714 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3cb15e9d-d733-4b22-bfdd-0d2e45f0cb99 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:04.291362 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3cb15e9d-d733-4b22-bfdd-0d2e45f0cb99 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:04.292908 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3cb15e9d-d733-4b22-bfdd-0d2e45f0cb99 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1365 microversion: 2.47 time: 0.191946 Sep 24 21:06:04.294125 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2142/4293] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:06:04 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1365 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:06:04.355774 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a62ca04a-26a9-4178-815c-d80705f9f2b1 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:04.366480 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a62ca04a-26a9-4178-815c-d80705f9f2b1 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 200 len: 1267 microversion: 2.1 time: 0.128876 Sep 24 21:06:04.368636 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2152/4294] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:04 2022] GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 1267 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:06:05.194381 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d5fe2ce9-1955-4b95-94f3-01775aaeb6d7 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:05.195320 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d5fe2ce9-1955-4b95-94f3-01775aaeb6d7 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: c5bd74b9-2a72-452a-b603-9b99fba57f9b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:05.210287 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d5fe2ce9-1955-4b95-94f3-01775aaeb6d7 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:05.210835 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d5fe2ce9-1955-4b95-94f3-01775aaeb6d7 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:05.224823 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d5fe2ce9-1955-4b95-94f3-01775aaeb6d7 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:05.226579 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d5fe2ce9-1955-4b95-94f3-01775aaeb6d7 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:05.255542 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d5fe2ce9-1955-4b95-94f3-01775aaeb6d7 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:05.257005 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d5fe2ce9-1955-4b95-94f3-01775aaeb6d7 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:05.320849 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7fb14d01-ca21-4b09-857c-7718a85ee54e tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:05.321608 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7fb14d01-ca21-4b09-857c-7718a85ee54e tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:05.336218 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7fb14d01-ca21-4b09-857c-7718a85ee54e tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:05.346855 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7fb14d01-ca21-4b09-857c-7718a85ee54e tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:05.347754 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7fb14d01-ca21-4b09-857c-7718a85ee54e tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:05.352126 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7fb14d01-ca21-4b09-857c-7718a85ee54e tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:05.352915 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7fb14d01-ca21-4b09-857c-7718a85ee54e tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:05.354979 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7fb14d01-ca21-4b09-857c-7718a85ee54e tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:05.571486 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7fb14d01-ca21-4b09-857c-7718a85ee54e tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:05.586109 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7fb14d01-ca21-4b09-857c-7718a85ee54e tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:05.589358 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7fb14d01-ca21-4b09-857c-7718a85ee54e tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:05.592356 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7fb14d01-ca21-4b09-857c-7718a85ee54e tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1365 microversion: 2.47 time: 0.275598 Sep 24 21:06:05.594049 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2153/4295] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:06:05 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1365 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:06:05.613342 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-96c9c6dc-135a-47ca-8a02-2b43df712f11 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:05.615426 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-96c9c6dc-135a-47ca-8a02-2b43df712f11 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:05.645856 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96c9c6dc-135a-47ca-8a02-2b43df712f11 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:05.647719 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96c9c6dc-135a-47ca-8a02-2b43df712f11 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:05.652453 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96c9c6dc-135a-47ca-8a02-2b43df712f11 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:05.654189 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96c9c6dc-135a-47ca-8a02-2b43df712f11 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:05.656595 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96c9c6dc-135a-47ca-8a02-2b43df712f11 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:05.657220 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96c9c6dc-135a-47ca-8a02-2b43df712f11 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:05.828154 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d5fe2ce9-1955-4b95-94f3-01775aaeb6d7 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:05.842408 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d5fe2ce9-1955-4b95-94f3-01775aaeb6d7 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b" status: 200 len: 1513 microversion: 2.1 time: 0.652204 Sep 24 21:06:05.844231 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2143/4296] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:05 2022] GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b => generated 1513 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:05.867792 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c3189163-964c-4bc3-8c5c-c633c9d5e6f9 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:05.868637 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c3189163-964c-4bc3-8c5c-c633c9d5e6f9 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: fd3a51be-17a5-4293-9bad-a3768d7ec10b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:05.876928 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3189163-964c-4bc3-8c5c-c633c9d5e6f9 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:05.877732 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3189163-964c-4bc3-8c5c-c633c9d5e6f9 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:05.880014 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3189163-964c-4bc3-8c5c-c633c9d5e6f9 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:05.881192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3189163-964c-4bc3-8c5c-c633c9d5e6f9 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:05.881840 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3189163-964c-4bc3-8c5c-c633c9d5e6f9 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:05.882453 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3189163-964c-4bc3-8c5c-c633c9d5e6f9 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:05.988272 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-96c9c6dc-135a-47ca-8a02-2b43df712f11 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:05.999754 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-96c9c6dc-135a-47ca-8a02-2b43df712f11 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 200 len: 1309 microversion: 2.1 time: 0.403384 Sep 24 21:06:06.000693 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2154/4297] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:05 2022] GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 1309 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:06.080131 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c3189163-964c-4bc3-8c5c-c633c9d5e6f9 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:06.089880 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c3189163-964c-4bc3-8c5c-c633c9d5e6f9 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers/fd3a51be-17a5-4293-9bad-a3768d7ec10b" status: 200 len: 1514 microversion: 2.1 time: 0.227141 Sep 24 21:06:06.090769 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2144/4298] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:05 2022] GET /compute/v2.1/servers/fd3a51be-17a5-4293-9bad-a3768d7ec10b => generated 1514 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:06:06.114401 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ffe9bc7c-ef9f-423e-8a0d-e5134f997fa3 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:06.116073 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ffe9bc7c-ef9f-423e-8a0d-e5134f997fa3 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: 4f857f30-f6d8-4107-b14d-12502a60fc74] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:06.122934 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ffe9bc7c-ef9f-423e-8a0d-e5134f997fa3 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:06.123560 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ffe9bc7c-ef9f-423e-8a0d-e5134f997fa3 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:06.124387 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ffe9bc7c-ef9f-423e-8a0d-e5134f997fa3 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:06.125916 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ffe9bc7c-ef9f-423e-8a0d-e5134f997fa3 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:06.126627 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ffe9bc7c-ef9f-423e-8a0d-e5134f997fa3 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:06.127362 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ffe9bc7c-ef9f-423e-8a0d-e5134f997fa3 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:06.304272 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ffe9bc7c-ef9f-423e-8a0d-e5134f997fa3 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:06.314416 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ffe9bc7c-ef9f-423e-8a0d-e5134f997fa3 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers/4f857f30-f6d8-4107-b14d-12502a60fc74" status: 200 len: 1513 microversion: 2.1 time: 0.204560 Sep 24 21:06:06.326535 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2155/4299] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:06 2022] GET /compute/v2.1/servers/4f857f30-f6d8-4107-b14d-12502a60fc74 => generated 1513 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:06.338405 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-55f89e8d-8be1-45dd-a7d4-bec9beacd7f6 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:06.339000 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-55f89e8d-8be1-45dd-a7d4-bec9beacd7f6 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: 4f857f30-f6d8-4107-b14d-12502a60fc74] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:06.346057 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-55f89e8d-8be1-45dd-a7d4-bec9beacd7f6 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:06.346579 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-55f89e8d-8be1-45dd-a7d4-bec9beacd7f6 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:06.347169 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-55f89e8d-8be1-45dd-a7d4-bec9beacd7f6 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:06.349084 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-55f89e8d-8be1-45dd-a7d4-bec9beacd7f6 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:06.349595 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-55f89e8d-8be1-45dd-a7d4-bec9beacd7f6 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:06.350031 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-55f89e8d-8be1-45dd-a7d4-bec9beacd7f6 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:06.384292 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-55f89e8d-8be1-45dd-a7d4-bec9beacd7f6 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: 4f857f30-f6d8-4107-b14d-12502a60fc74] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:06:06.507996 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-55f89e8d-8be1-45dd-a7d4-bec9beacd7f6 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4f857f30-f6d8-4107-b14d-12502a60fc74" status: 204 len: 0 microversion: 2.1 time: 0.173327 Sep 24 21:06:06.509454 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2145/4300] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:06:06 2022] DELETE /compute/v2.1/servers/4f857f30-f6d8-4107-b14d-12502a60fc74 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:06:06.517178 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a1cec908-a23a-4df6-9a37-0f365045cfb1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:06.517858 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a1cec908-a23a-4df6-9a37-0f365045cfb1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: 4f857f30-f6d8-4107-b14d-12502a60fc74] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:06.525905 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1cec908-a23a-4df6-9a37-0f365045cfb1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:06.526556 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1cec908-a23a-4df6-9a37-0f365045cfb1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:06.527104 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1cec908-a23a-4df6-9a37-0f365045cfb1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:06.527932 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1cec908-a23a-4df6-9a37-0f365045cfb1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:06.528499 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1cec908-a23a-4df6-9a37-0f365045cfb1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:06.529196 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1cec908-a23a-4df6-9a37-0f365045cfb1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:06.621926 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-01a3c523-2e1b-4c2d-8ce5-a22585ae9539 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:06.622692 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-01a3c523-2e1b-4c2d-8ce5-a22585ae9539 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:06.639353 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-01a3c523-2e1b-4c2d-8ce5-a22585ae9539 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:06.639855 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-01a3c523-2e1b-4c2d-8ce5-a22585ae9539 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:06.642024 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-01a3c523-2e1b-4c2d-8ce5-a22585ae9539 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:06.647793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-01a3c523-2e1b-4c2d-8ce5-a22585ae9539 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:06.648286 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-01a3c523-2e1b-4c2d-8ce5-a22585ae9539 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:06.648801 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-01a3c523-2e1b-4c2d-8ce5-a22585ae9539 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:06.702232 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a1cec908-a23a-4df6-9a37-0f365045cfb1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:06.713263 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a1cec908-a23a-4df6-9a37-0f365045cfb1 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers/4f857f30-f6d8-4107-b14d-12502a60fc74" status: 200 len: 1519 microversion: 2.1 time: 0.200128 Sep 24 21:06:06.734268 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2156/4301] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:06 2022] GET /compute/v2.1/servers/4f857f30-f6d8-4107-b14d-12502a60fc74 => generated 1519 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:06.741840 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-01a3c523-2e1b-4c2d-8ce5-a22585ae9539 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:06.752338 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-01a3c523-2e1b-4c2d-8ce5-a22585ae9539 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:06.754838 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-01a3c523-2e1b-4c2d-8ce5-a22585ae9539 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:06.756501 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-01a3c523-2e1b-4c2d-8ce5-a22585ae9539 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1365 microversion: 2.47 time: 0.139538 Sep 24 21:06:06.757558 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2146/4302] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:06:06 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1365 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:06:06.797704 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-53564bba-e65b-42a2-a672-e09024c57032 req-858ca917-2d53-42de-a2d8-811cf4f618ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9", "tag": "469139a1-1d76-4eb6-86e4-e74cc739b5df"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:06:06.809896 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-53564bba-e65b-42a2-a672-e09024c57032 req-858ca917-2d53-42de-a2d8-811cf4f618ec service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:06.810378 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-53564bba-e65b-42a2-a672-e09024c57032 req-858ca917-2d53-42de-a2d8-811cf4f618ec service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:06.810837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-53564bba-e65b-42a2-a672-e09024c57032 req-858ca917-2d53-42de-a2d8-811cf4f618ec service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:06.825301 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-53564bba-e65b-42a2-a672-e09024c57032 req-858ca917-2d53-42de-a2d8-811cf4f618ec service nova] Creating event network-changed:469139a1-1d76-4eb6-86e4-e74cc739b5df for instance 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 on nch2-master-1 Sep 24 21:06:06.830796 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-53564bba-e65b-42a2-a672-e09024c57032 req-858ca917-2d53-42de-a2d8-811cf4f618ec service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037570 Sep 24 21:06:06.831487 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2157/4303] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:06:07.026665 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-edfacefc-53d9-4cde-9a4e-a2afdf4f0048 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:07.027562 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-edfacefc-53d9-4cde-9a4e-a2afdf4f0048 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:07.035622 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-edfacefc-53d9-4cde-9a4e-a2afdf4f0048 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:07.036406 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-edfacefc-53d9-4cde-9a4e-a2afdf4f0048 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:07.037083 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-edfacefc-53d9-4cde-9a4e-a2afdf4f0048 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:07.038189 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-edfacefc-53d9-4cde-9a4e-a2afdf4f0048 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:07.038990 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-edfacefc-53d9-4cde-9a4e-a2afdf4f0048 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:07.039429 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-edfacefc-53d9-4cde-9a4e-a2afdf4f0048 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:07.411399 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-edfacefc-53d9-4cde-9a4e-a2afdf4f0048 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:07.435410 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-edfacefc-53d9-4cde-9a4e-a2afdf4f0048 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 200 len: 1309 microversion: 2.1 time: 0.413618 Sep 24 21:06:07.437909 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2147/4304] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:07 2022] GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 1309 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:06:07.538206 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3d9dae12-06c6-4ca6-b1ef-fbeaebb39aff tempest-PortsAdminExtendedAttrsIpV6TestJSON-847546156 tempest-PortsAdminExtendedAttrsIpV6TestJSON-847546156-project-admin] Calling method '.version_select at 0x7f4b0c8d4280>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:07.540630 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d9dae12-06c6-4ca6-b1ef-fbeaebb39aff tempest-PortsAdminExtendedAttrsIpV6TestJSON-847546156 tempest-PortsAdminExtendedAttrsIpV6TestJSON-847546156-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:07.541308 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d9dae12-06c6-4ca6-b1ef-fbeaebb39aff tempest-PortsAdminExtendedAttrsIpV6TestJSON-847546156 tempest-PortsAdminExtendedAttrsIpV6TestJSON-847546156-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:07.541917 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d9dae12-06c6-4ca6-b1ef-fbeaebb39aff tempest-PortsAdminExtendedAttrsIpV6TestJSON-847546156 tempest-PortsAdminExtendedAttrsIpV6TestJSON-847546156-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:07.565583 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d9dae12-06c6-4ca6-b1ef-fbeaebb39aff tempest-PortsAdminExtendedAttrsIpV6TestJSON-847546156 tempest-PortsAdminExtendedAttrsIpV6TestJSON-847546156-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:07.566280 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d9dae12-06c6-4ca6-b1ef-fbeaebb39aff tempest-PortsAdminExtendedAttrsIpV6TestJSON-847546156 tempest-PortsAdminExtendedAttrsIpV6TestJSON-847546156-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:07.567547 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d9dae12-06c6-4ca6-b1ef-fbeaebb39aff tempest-PortsAdminExtendedAttrsIpV6TestJSON-847546156 tempest-PortsAdminExtendedAttrsIpV6TestJSON-847546156-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:07.578227 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d9dae12-06c6-4ca6-b1ef-fbeaebb39aff tempest-PortsAdminExtendedAttrsIpV6TestJSON-847546156 tempest-PortsAdminExtendedAttrsIpV6TestJSON-847546156-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:07.578838 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d9dae12-06c6-4ca6-b1ef-fbeaebb39aff tempest-PortsAdminExtendedAttrsIpV6TestJSON-847546156 tempest-PortsAdminExtendedAttrsIpV6TestJSON-847546156-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:07.579284 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d9dae12-06c6-4ca6-b1ef-fbeaebb39aff tempest-PortsAdminExtendedAttrsIpV6TestJSON-847546156 tempest-PortsAdminExtendedAttrsIpV6TestJSON-847546156-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:07.585650 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3d9dae12-06c6-4ca6-b1ef-fbeaebb39aff tempest-PortsAdminExtendedAttrsIpV6TestJSON-847546156 tempest-PortsAdminExtendedAttrsIpV6TestJSON-847546156-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.259416 Sep 24 21:06:07.586962 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2158/4305] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 21:06:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:06:07.743139 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5f82f263-1902-4c43-bc78-231d5276dc10 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:07.744963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5f82f263-1902-4c43-bc78-231d5276dc10 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: 4f857f30-f6d8-4107-b14d-12502a60fc74] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:07.752095 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f82f263-1902-4c43-bc78-231d5276dc10 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:07.752811 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f82f263-1902-4c43-bc78-231d5276dc10 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:07.753443 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f82f263-1902-4c43-bc78-231d5276dc10 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:07.755227 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f82f263-1902-4c43-bc78-231d5276dc10 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:07.755902 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f82f263-1902-4c43-bc78-231d5276dc10 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:07.756519 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f82f263-1902-4c43-bc78-231d5276dc10 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:07.786760 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a17f7565-1449-4448-a0dd-9f96c47ffec8 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:07.788027 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a17f7565-1449-4448-a0dd-9f96c47ffec8 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:07.796345 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a17f7565-1449-4448-a0dd-9f96c47ffec8 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:07.797680 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a17f7565-1449-4448-a0dd-9f96c47ffec8 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:07.798337 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a17f7565-1449-4448-a0dd-9f96c47ffec8 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:07.800209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a17f7565-1449-4448-a0dd-9f96c47ffec8 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:07.801516 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a17f7565-1449-4448-a0dd-9f96c47ffec8 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:07.807825 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a17f7565-1449-4448-a0dd-9f96c47ffec8 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:08.028136 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a17f7565-1449-4448-a0dd-9f96c47ffec8 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:08.048630 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a17f7565-1449-4448-a0dd-9f96c47ffec8 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:08.052318 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a17f7565-1449-4448-a0dd-9f96c47ffec8 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:08.055396 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a17f7565-1449-4448-a0dd-9f96c47ffec8 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1365 microversion: 2.47 time: 0.273060 Sep 24 21:06:08.056960 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2159/4306] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:06:07 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1365 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:06:08.112810 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5f82f263-1902-4c43-bc78-231d5276dc10 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:08.123555 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5f82f263-1902-4c43-bc78-231d5276dc10 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers/4f857f30-f6d8-4107-b14d-12502a60fc74" status: 200 len: 1519 microversion: 2.1 time: 0.385478 Sep 24 21:06:08.124902 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2148/4307] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:07 2022] GET /compute/v2.1/servers/4f857f30-f6d8-4107-b14d-12502a60fc74 => generated 1519 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:08.462598 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e583539a-bad5-4a43-8989-6562dec8b219 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:08.463864 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e583539a-bad5-4a43-8989-6562dec8b219 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:08.471874 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:06:08.474618 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e583539a-bad5-4a43-8989-6562dec8b219 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:08.475389 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e583539a-bad5-4a43-8989-6562dec8b219 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:08.476232 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e583539a-bad5-4a43-8989-6562dec8b219 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:08.477272 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e583539a-bad5-4a43-8989-6562dec8b219 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:08.477979 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e583539a-bad5-4a43-8989-6562dec8b219 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:08.478700 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e583539a-bad5-4a43-8989-6562dec8b219 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:08.881051 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e583539a-bad5-4a43-8989-6562dec8b219 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:08.891937 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e583539a-bad5-4a43-8989-6562dec8b219 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 200 len: 1309 microversion: 2.1 time: 0.434884 Sep 24 21:06:08.899626 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2160/4308] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:08 2022] GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 1309 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:09.086896 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ab69c705-fa07-46c8-9c6e-73839d506ec3 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:09.088155 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ab69c705-fa07-46c8-9c6e-73839d506ec3 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:09.091116 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:06:09.098192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab69c705-fa07-46c8-9c6e-73839d506ec3 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:09.099014 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab69c705-fa07-46c8-9c6e-73839d506ec3 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:09.099462 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab69c705-fa07-46c8-9c6e-73839d506ec3 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:09.100637 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab69c705-fa07-46c8-9c6e-73839d506ec3 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:09.101484 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab69c705-fa07-46c8-9c6e-73839d506ec3 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:09.101836 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab69c705-fa07-46c8-9c6e-73839d506ec3 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:09.148996 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2382a496-96d8-4648-a67c-1be5e597877e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:09.150948 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2382a496-96d8-4648-a67c-1be5e597877e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: 4f857f30-f6d8-4107-b14d-12502a60fc74] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:09.158319 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2382a496-96d8-4648-a67c-1be5e597877e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:09.158927 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2382a496-96d8-4648-a67c-1be5e597877e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:09.159833 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2382a496-96d8-4648-a67c-1be5e597877e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:09.160609 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2382a496-96d8-4648-a67c-1be5e597877e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:09.161357 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2382a496-96d8-4648-a67c-1be5e597877e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:09.161971 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2382a496-96d8-4648-a67c-1be5e597877e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:09.189973 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:06:09.205549 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ab69c705-fa07-46c8-9c6e-73839d506ec3 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:09.216251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ab69c705-fa07-46c8-9c6e-73839d506ec3 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:09.217732 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ab69c705-fa07-46c8-9c6e-73839d506ec3 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:09.219493 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ab69c705-fa07-46c8-9c6e-73839d506ec3 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1365 microversion: 2.47 time: 0.136754 Sep 24 21:06:09.220071 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2149/4309] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:06:09 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1365 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:06:09.445973 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2382a496-96d8-4648-a67c-1be5e597877e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:09.458866 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2382a496-96d8-4648-a67c-1be5e597877e tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers/4f857f30-f6d8-4107-b14d-12502a60fc74" status: 200 len: 1519 microversion: 2.1 time: 0.314396 Sep 24 21:06:09.475752 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2161/4310] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:09 2022] GET /compute/v2.1/servers/4f857f30-f6d8-4107-b14d-12502a60fc74 => generated 1519 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:06:09.934715 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a72d2668-8d41-4031-9a89-498730154c9d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:09.935843 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a72d2668-8d41-4031-9a89-498730154c9d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:09.958942 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a72d2668-8d41-4031-9a89-498730154c9d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:09.960278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a72d2668-8d41-4031-9a89-498730154c9d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:09.963088 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a72d2668-8d41-4031-9a89-498730154c9d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:09.967251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a72d2668-8d41-4031-9a89-498730154c9d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:09.968933 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a72d2668-8d41-4031-9a89-498730154c9d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:09.969644 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a72d2668-8d41-4031-9a89-498730154c9d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:09.979360 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:06:10.015987 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-713f0df8-9565-433c-b0ec-1ff2a65139df req-883ceb5b-c5ef-4e5a-844e-a7ab83e0de66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f857f30-f6d8-4107-b14d-12502a60fc74", "name": "network-vif-deleted", "tag": "6287fe41-9f95-412b-a43f-6f1030bebe2e"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:06:10.038535 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-713f0df8-9565-433c-b0ec-1ff2a65139df req-883ceb5b-c5ef-4e5a-844e-a7ab83e0de66 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:10.040282 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-713f0df8-9565-433c-b0ec-1ff2a65139df req-883ceb5b-c5ef-4e5a-844e-a7ab83e0de66 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:10.040906 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-713f0df8-9565-433c-b0ec-1ff2a65139df req-883ceb5b-c5ef-4e5a-844e-a7ab83e0de66 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:10.083707 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-713f0df8-9565-433c-b0ec-1ff2a65139df req-883ceb5b-c5ef-4e5a-844e-a7ab83e0de66 service nova] Creating event network-vif-deleted:6287fe41-9f95-412b-a43f-6f1030bebe2e for instance 4f857f30-f6d8-4107-b14d-12502a60fc74 on nch2-master-1 Sep 24 21:06:10.094147 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-713f0df8-9565-433c-b0ec-1ff2a65139df req-883ceb5b-c5ef-4e5a-844e-a7ab83e0de66 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082921 Sep 24 21:06:10.095624 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2162/4311] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:06:10.249569 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-54a746eb-a604-406c-af5b-1875c237cc6c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:10.251659 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-54a746eb-a604-406c-af5b-1875c237cc6c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:10.264284 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54a746eb-a604-406c-af5b-1875c237cc6c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:10.265724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54a746eb-a604-406c-af5b-1875c237cc6c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:10.267564 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54a746eb-a604-406c-af5b-1875c237cc6c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:10.268593 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54a746eb-a604-406c-af5b-1875c237cc6c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:10.271330 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54a746eb-a604-406c-af5b-1875c237cc6c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:10.272051 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54a746eb-a604-406c-af5b-1875c237cc6c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:10.475173 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-54a746eb-a604-406c-af5b-1875c237cc6c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:10.483928 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-54a746eb-a604-406c-af5b-1875c237cc6c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:10.485900 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-54a746eb-a604-406c-af5b-1875c237cc6c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:10.487323 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-54a746eb-a604-406c-af5b-1875c237cc6c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1365 microversion: 2.47 time: 0.243448 Sep 24 21:06:10.488082 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2163/4312] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:06:10 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1365 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:06:10.493848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a6b75e07-5f44-4028-9a26-9685a80f9cc2 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:10.494701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a6b75e07-5f44-4028-9a26-9685a80f9cc2 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: 4f857f30-f6d8-4107-b14d-12502a60fc74] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:10.501019 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a6b75e07-5f44-4028-9a26-9685a80f9cc2 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:10.501729 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a6b75e07-5f44-4028-9a26-9685a80f9cc2 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:10.502340 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a6b75e07-5f44-4028-9a26-9685a80f9cc2 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:10.503309 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a6b75e07-5f44-4028-9a26-9685a80f9cc2 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:10.504073 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a6b75e07-5f44-4028-9a26-9685a80f9cc2 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:10.505101 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a6b75e07-5f44-4028-9a26-9685a80f9cc2 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:10.548962 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a72d2668-8d41-4031-9a89-498730154c9d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:10.571852 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a72d2668-8d41-4031-9a89-498730154c9d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 200 len: 1309 microversion: 2.1 time: 0.650324 Sep 24 21:06:10.573567 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2150/4313] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:09 2022] GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 1309 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:10.689259 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a6b75e07-5f44-4028-9a26-9685a80f9cc2 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:10.708895 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a6b75e07-5f44-4028-9a26-9685a80f9cc2 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers/4f857f30-f6d8-4107-b14d-12502a60fc74" status: 200 len: 1477 microversion: 2.1 time: 0.218421 Sep 24 21:06:10.710107 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2164/4314] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:10 2022] GET /compute/v2.1/servers/4f857f30-f6d8-4107-b14d-12502a60fc74 => generated 1477 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:11.517628 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dc61ef32-2be5-4836-b623-66e93243a4b8 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:11.518517 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-dc61ef32-2be5-4836-b623-66e93243a4b8 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:11.525807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc61ef32-2be5-4836-b623-66e93243a4b8 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:11.526630 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc61ef32-2be5-4836-b623-66e93243a4b8 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:11.527250 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc61ef32-2be5-4836-b623-66e93243a4b8 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:11.528133 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc61ef32-2be5-4836-b623-66e93243a4b8 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:11.528790 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc61ef32-2be5-4836-b623-66e93243a4b8 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:11.529397 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc61ef32-2be5-4836-b623-66e93243a4b8 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:11.608021 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6c1f6b86-68c1-459a-8166-b87484e59b7d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:11.609262 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6c1f6b86-68c1-459a-8166-b87484e59b7d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:11.618190 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c1f6b86-68c1-459a-8166-b87484e59b7d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:11.618989 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c1f6b86-68c1-459a-8166-b87484e59b7d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:11.619836 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c1f6b86-68c1-459a-8166-b87484e59b7d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:11.620723 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c1f6b86-68c1-459a-8166-b87484e59b7d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:11.621385 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c1f6b86-68c1-459a-8166-b87484e59b7d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:11.622080 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c1f6b86-68c1-459a-8166-b87484e59b7d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:11.662536 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-dc61ef32-2be5-4836-b623-66e93243a4b8 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:11.679392 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:06:11.701396 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-dc61ef32-2be5-4836-b623-66e93243a4b8 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:11.705530 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-dc61ef32-2be5-4836-b623-66e93243a4b8 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:11.712975 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-dc61ef32-2be5-4836-b623-66e93243a4b8 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1365 microversion: 2.47 time: 0.195773 Sep 24 21:06:11.713919 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2151/4315] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:06:11 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:06:11.741167 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c0b89954-dce8-4863-b7a7-c2636745fbda tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:11.744343 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c0b89954-dce8-4863-b7a7-c2636745fbda tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: 4f857f30-f6d8-4107-b14d-12502a60fc74] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:11.749574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:06:11.763922 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c0b89954-dce8-4863-b7a7-c2636745fbda tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:11.764430 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c0b89954-dce8-4863-b7a7-c2636745fbda tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:11.764877 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c0b89954-dce8-4863-b7a7-c2636745fbda tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:11.765604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c0b89954-dce8-4863-b7a7-c2636745fbda tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:11.766064 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c0b89954-dce8-4863-b7a7-c2636745fbda tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:11.769328 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c0b89954-dce8-4863-b7a7-c2636745fbda tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:11.816627 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c0b89954-dce8-4863-b7a7-c2636745fbda tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:11.817283 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c0b89954-dce8-4863-b7a7-c2636745fbda tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:11.817568 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c0b89954-dce8-4863-b7a7-c2636745fbda tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:11.818095 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-c0b89954-dce8-4863-b7a7-c2636745fbda tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lazy-loading 'fault' on Instance uuid 4f857f30-f6d8-4107-b14d-12502a60fc74 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:06:11.974264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c0b89954-dce8-4863-b7a7-c2636745fbda tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:11.974264 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c0b89954-dce8-4863-b7a7-c2636745fbda tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers/4f857f30-f6d8-4107-b14d-12502a60fc74" status: 200 len: 1312 microversion: 2.1 time: 0.242322 Sep 24 21:06:11.986905 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2152/4316] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:11 2022] GET /compute/v2.1/servers/4f857f30-f6d8-4107-b14d-12502a60fc74 => generated 1312 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:12.064264 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:06:12.216964 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6c1f6b86-68c1-459a-8166-b87484e59b7d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:12.231321 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6c1f6b86-68c1-459a-8166-b87484e59b7d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 200 len: 1309 microversion: 2.1 time: 0.633204 Sep 24 21:06:12.233379 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2165/4317] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:11 2022] GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 1309 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:12.743522 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-68cc740a-c98a-4646-b3f5-e14fe706cd94 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:12.744139 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-68cc740a-c98a-4646-b3f5-e14fe706cd94 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:12.757209 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-68cc740a-c98a-4646-b3f5-e14fe706cd94 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:12.757787 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-68cc740a-c98a-4646-b3f5-e14fe706cd94 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:12.759053 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-68cc740a-c98a-4646-b3f5-e14fe706cd94 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:12.763786 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-68cc740a-c98a-4646-b3f5-e14fe706cd94 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:12.764463 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-68cc740a-c98a-4646-b3f5-e14fe706cd94 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:12.764941 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-68cc740a-c98a-4646-b3f5-e14fe706cd94 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:12.890544 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-68cc740a-c98a-4646-b3f5-e14fe706cd94 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:12.905972 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-68cc740a-c98a-4646-b3f5-e14fe706cd94 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:12.908351 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-68cc740a-c98a-4646-b3f5-e14fe706cd94 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:12.910160 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-68cc740a-c98a-4646-b3f5-e14fe706cd94 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1365 microversion: 2.47 time: 0.171501 Sep 24 21:06:12.911840 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2153/4318] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:06:12 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:06:12.997323 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dc2be2e2-ffe3-46b7-9da3-6462f23a9953 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:12.999062 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dc2be2e2-ffe3-46b7-9da3-6462f23a9953 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: 4f857f30-f6d8-4107-b14d-12502a60fc74] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:13.008295 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc2be2e2-ffe3-46b7-9da3-6462f23a9953 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:13.009677 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc2be2e2-ffe3-46b7-9da3-6462f23a9953 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:13.011776 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc2be2e2-ffe3-46b7-9da3-6462f23a9953 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:13.012934 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc2be2e2-ffe3-46b7-9da3-6462f23a9953 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:13.013720 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc2be2e2-ffe3-46b7-9da3-6462f23a9953 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:13.014816 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc2be2e2-ffe3-46b7-9da3-6462f23a9953 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:13.038328 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-dc2be2e2-ffe3-46b7-9da3-6462f23a9953 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] HTTP exception thrown: Instance 4f857f30-f6d8-4107-b14d-12502a60fc74 could not be found. Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dc2be2e2-ffe3-46b7-9da3-6462f23a9953 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Request method failure captured: Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/4f857f30-f6d8-4107-b14d-12502a60fc74 HTTP/1.1 Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3EhZ-HtiwIPHoyznSVqzFSZetGXFfmPOfqGkIX-h00QLl5nvAWsxqzQ7l-9opE5RxsO0XPTOvNkVuNJHQuzTNeV3HgggHqZKZTjs_WJAzI2JM9I-KMa3XhYtiyT2T6gzqcDBNT71feQvT2HzVYvzjuyd5SOoI1VSuVpC1DCgcq6OVY Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 648cf4f432a3400b8dcf2b57a99d082e Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ListServersNegativeTestJSON-1353676620 Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/648cf4f432a3400b8dcf2b57a99d082e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_648cf4f432a3400b8dcf2b57a99d082e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/648cf4f432a3400b8dcf2b57a99d082e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/648cf4f432a3400b8dcf2b57a99d082e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ListServersNegativeTestJSON-1353676620 Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 648cf4f432a3400b8dcf2b57a99d082e Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1353676620 Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ListServersNegativeTestJSON-1353676620-project Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 762f4e35de9e4083bd0e7a4d0de3c136 Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ListServersNegativeTestJSON-1353676620-project Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 4f857f30-f6d8-4107-b14d-12502a60fc74 could not be found. Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '4f857f30-f6d8-4107-b14d-12502a60fc74'} Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f857f30-f6d8-4107-b14d-12502a60fc74 could not be found. Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f857f30-f6d8-4107-b14d-12502a60fc74 could not be found. Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:13.040819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:13.047612 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:13.047612 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:13.047612 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:13.047612 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:13.047612 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:06:13.047612 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:06:13.047612 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f857f30-f6d8-4107-b14d-12502a60fc74 could not be found. Sep 24 21:06:13.047612 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:13.049459 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dc2be2e2-ffe3-46b7-9da3-6462f23a9953 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Returning 404 to user: Instance 4f857f30-f6d8-4107-b14d-12502a60fc74 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:06:13.049459 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dc2be2e2-ffe3-46b7-9da3-6462f23a9953 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers/4f857f30-f6d8-4107-b14d-12502a60fc74" status: 404 len: 111 microversion: 2.1 time: 0.057086 Sep 24 21:06:13.057111 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2166/4319] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:12 2022] GET /compute/v2.1/servers/4f857f30-f6d8-4107-b14d-12502a60fc74 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:06:13.060178 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bb46e055-a762-4dc3-9724-94e1bbc530bf tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:13.067297 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-bb46e055-a762-4dc3-9724-94e1bbc530bf tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:13.069238 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-bb46e055-a762-4dc3-9724-94e1bbc530bf tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '648cf4f432a3400b8dcf2b57a99d082e'} {{(pid=140516) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 21:06:13.077234 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb46e055-a762-4dc3-9724-94e1bbc530bf tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:13.077794 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb46e055-a762-4dc3-9724-94e1bbc530bf tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:13.078461 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb46e055-a762-4dc3-9724-94e1bbc530bf tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:13.079237 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb46e055-a762-4dc3-9724-94e1bbc530bf tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:13.079702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb46e055-a762-4dc3-9724-94e1bbc530bf tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:13.080141 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb46e055-a762-4dc3-9724-94e1bbc530bf tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:13.184215 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bb46e055-a762-4dc3-9724-94e1bbc530bf tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.128886 Sep 24 21:06:13.185165 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2154/4320] 10.222.0.52 () {58 vars in 1230 bytes} [Sat Sep 24 21:06:13 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 21:06:13.200460 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-77747d20-9be1-4afc-9c3b-c3cc98ea6965 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-77747d20-9be1-4afc-9c3b-c3cc98ea6965 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Request method failure captured: Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3EhZ-HtiwIPHoyznSVqzFSZetGXFfmPOfqGkIX-h00QLl5nvAWsxqzQ7l-9opE5RxsO0XPTOvNkVuNJHQuzTNeV3HgggHqZKZTjs_WJAzI2JM9I-KMa3XhYtiyT2T6gzqcDBNT71feQvT2HzVYvzjuyd5SOoI1VSuVpC1DCgcq6OVY Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 648cf4f432a3400b8dcf2b57a99d082e Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ListServersNegativeTestJSON-1353676620 Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/648cf4f432a3400b8dcf2b57a99d082e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_648cf4f432a3400b8dcf2b57a99d082e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/648cf4f432a3400b8dcf2b57a99d082e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/648cf4f432a3400b8dcf2b57a99d082e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ListServersNegativeTestJSON-1353676620 Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 648cf4f432a3400b8dcf2b57a99d082e Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1353676620 Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ListServersNegativeTestJSON-1353676620-project Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 762f4e35de9e4083bd0e7a4d0de3c136 Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ListServersNegativeTestJSON-1353676620-project Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: action_args: {} Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise error Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi '2011/01/01' Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 24 21:06:13.205210 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 21:06:13.211874 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 21:06:13.211874 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 21:06:13.211874 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 21:06:13.211874 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 24 21:06:13.211874 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:13.211874 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:13.211874 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:13.211874 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:13.211874 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:13.211874 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:13.211874 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 21:06:13.211874 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 21:06:13.211874 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 24 21:06:13.211874 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:13.214700 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-77747d20-9be1-4afc-9c3b-c3cc98ea6965 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:06:13.215826 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-77747d20-9be1-4afc-9c3b-c3cc98ea6965 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.020590 Sep 24 21:06:13.220696 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2167/4321] 10.222.0.52 () {58 vars in 1182 bytes} [Sat Sep 24 21:06:13 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:06:13.227269 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e39cb061-7bf6-4bda-bf48-bc3c35dc355d tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:13.249740 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e39cb061-7bf6-4bda-bf48-bc3c35dc355d tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:13.251090 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e39cb061-7bf6-4bda-bf48-bc3c35dc355d tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Searching by: {'deleted': False, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e'} {{(pid=140516) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 21:06:13.256031 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-556b49dc-82c4-46b5-aba1-798d38b7badd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:13.256677 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-556b49dc-82c4-46b5-aba1-798d38b7badd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:13.259947 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e39cb061-7bf6-4bda-bf48-bc3c35dc355d tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:13.260631 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e39cb061-7bf6-4bda-bf48-bc3c35dc355d tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:13.261145 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e39cb061-7bf6-4bda-bf48-bc3c35dc355d tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:13.261962 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e39cb061-7bf6-4bda-bf48-bc3c35dc355d tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:13.263379 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e39cb061-7bf6-4bda-bf48-bc3c35dc355d tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:13.264121 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e39cb061-7bf6-4bda-bf48-bc3c35dc355d tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:13.280660 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-556b49dc-82c4-46b5-aba1-798d38b7badd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:13.281173 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-556b49dc-82c4-46b5-aba1-798d38b7badd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:13.282707 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-556b49dc-82c4-46b5-aba1-798d38b7badd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:13.283872 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-556b49dc-82c4-46b5-aba1-798d38b7badd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:13.284811 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-556b49dc-82c4-46b5-aba1-798d38b7badd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:13.285628 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-556b49dc-82c4-46b5-aba1-798d38b7badd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:13.296423 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.multi_cell_list [None req-e39cb061-7bf6-4bda-bf48-bc3c35dc355d tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 21:06:13.368482 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e39cb061-7bf6-4bda-bf48-bc3c35dc355d tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.146569 Sep 24 21:06:13.378275 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2155/4322] 10.222.0.52 () {58 vars in 1125 bytes} [Sat Sep 24 21:06:13 2022] GET /compute/v2.1/servers => generated 681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:06:13.386134 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9fbcf934-bc63-428b-acf0-52fc81664b16 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:13.401614 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9fbcf934-bc63-428b-acf0-52fc81664b16 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:13.402343 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.compute.servers [None req-9fbcf934-bc63-428b-acf0-52fc81664b16 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Removing options 'limit' from query {{(pid=140516) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 24 21:06:13.403240 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9fbcf934-bc63-428b-acf0-52fc81664b16 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Searching by: {'deleted': False, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e'} {{(pid=140516) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 21:06:13.409682 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9fbcf934-bc63-428b-acf0-52fc81664b16 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:13.410464 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9fbcf934-bc63-428b-acf0-52fc81664b16 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:13.411116 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9fbcf934-bc63-428b-acf0-52fc81664b16 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:13.412066 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9fbcf934-bc63-428b-acf0-52fc81664b16 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:13.412724 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9fbcf934-bc63-428b-acf0-52fc81664b16 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:13.413917 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9fbcf934-bc63-428b-acf0-52fc81664b16 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:13.452001 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.multi_cell_list [None req-9fbcf934-bc63-428b-acf0-52fc81664b16 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=140516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 21:06:13.502915 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9fbcf934-bc63-428b-acf0-52fc81664b16 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.117448 Sep 24 21:06:13.503573 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2156/4323] 10.222.0.52 () {58 vars in 1144 bytes} [Sat Sep 24 21:06:13 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:06:13.524104 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dfe59302-bb94-4235-8963-e375f54ed3c9 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dfe59302-bb94-4235-8963-e375f54ed3c9 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Request method failure captured: Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3EhZ-HtiwIPHoyznSVqzFSZetGXFfmPOfqGkIX-h00QLl5nvAWsxqzQ7l-9opE5RxsO0XPTOvNkVuNJHQuzTNeV3HgggHqZKZTjs_WJAzI2JM9I-KMa3XhYtiyT2T6gzqcDBNT71feQvT2HzVYvzjuyd5SOoI1VSuVpC1DCgcq6OVY Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 648cf4f432a3400b8dcf2b57a99d082e Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ListServersNegativeTestJSON-1353676620 Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/648cf4f432a3400b8dcf2b57a99d082e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_648cf4f432a3400b8dcf2b57a99d082e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/648cf4f432a3400b8dcf2b57a99d082e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/648cf4f432a3400b8dcf2b57a99d082e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ListServersNegativeTestJSON-1353676620 Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 648cf4f432a3400b8dcf2b57a99d082e Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1353676620 Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ListServersNegativeTestJSON-1353676620-project Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 762f4e35de9e4083bd0e7a4d0de3c136 Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ListServersNegativeTestJSON-1353676620-project Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: action_args: {} Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise error Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi '-1' Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 24 21:06:13.528595 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 24 21:06:13.536760 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 21:06:13.536760 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 21:06:13.536760 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 21:06:13.536760 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 21:06:13.536760 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 24 21:06:13.536760 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:13.536760 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:13.536760 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:13.536760 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:13.536760 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:13.536760 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:13.536760 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 21:06:13.536760 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 21:06:13.536760 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 24 21:06:13.536760 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:13.536760 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dfe59302-bb94-4235-8963-e375f54ed3c9 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:06:13.536760 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-dfe59302-bb94-4235-8963-e375f54ed3c9 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.016290 Sep 24 21:06:13.536760 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2157/4324] 10.222.0.52 () {58 vars in 1142 bytes} [Sat Sep 24 21:06:13 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:06:13.544879 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d2b7d0a4-a586-47bb-944d-591f99147cb3 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d2b7d0a4-a586-47bb-944d-591f99147cb3 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Request method failure captured: Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3EhZ-HtiwIPHoyznSVqzFSZetGXFfmPOfqGkIX-h00QLl5nvAWsxqzQ7l-9opE5RxsO0XPTOvNkVuNJHQuzTNeV3HgggHqZKZTjs_WJAzI2JM9I-KMa3XhYtiyT2T6gzqcDBNT71feQvT2HzVYvzjuyd5SOoI1VSuVpC1DCgcq6OVY Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 648cf4f432a3400b8dcf2b57a99d082e Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ListServersNegativeTestJSON-1353676620 Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/648cf4f432a3400b8dcf2b57a99d082e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_648cf4f432a3400b8dcf2b57a99d082e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/648cf4f432a3400b8dcf2b57a99d082e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/648cf4f432a3400b8dcf2b57a99d082e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ListServersNegativeTestJSON-1353676620 Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 648cf4f432a3400b8dcf2b57a99d082e Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1353676620 Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ListServersNegativeTestJSON-1353676620-project Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 762f4e35de9e4083bd0e7a4d0de3c136 Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ListServersNegativeTestJSON-1353676620-project Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: action_args: {} Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise error Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'testing' Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 24 21:06:13.550166 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 24 21:06:13.559919 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 21:06:13.559919 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 21:06:13.559919 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 21:06:13.559919 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 21:06:13.559919 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 24 21:06:13.559919 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:13.559919 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:13.559919 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:13.559919 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:13.559919 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:13.559919 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:13.559919 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 21:06:13.559919 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 21:06:13.559919 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 24 21:06:13.559919 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:13.559919 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d2b7d0a4-a586-47bb-944d-591f99147cb3 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:06:13.559919 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d2b7d0a4-a586-47bb-944d-591f99147cb3 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.015271 Sep 24 21:06:13.559919 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2158/4325] 10.222.0.52 () {58 vars in 1152 bytes} [Sat Sep 24 21:06:13 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:06:13.566724 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5edb8770-55ee-48a7-a526-cab4ea0d9d1a tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:13.574152 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5edb8770-55ee-48a7-a526-cab4ea0d9d1a tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:13.574885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5edb8770-55ee-48a7-a526-cab4ea0d9d1a tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e'} {{(pid=140516) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 21:06:13.581817 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.compute.servers [None req-5edb8770-55ee-48a7-a526-cab4ea0d9d1a tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Flavor 'non_existing_flavor' could not be found {{(pid=140516) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Sep 24 21:06:13.583922 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5edb8770-55ee-48a7-a526-cab4ea0d9d1a tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.024945 Sep 24 21:06:13.592317 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2159/4326] 10.222.0.52 () {58 vars in 1178 bytes} [Sat Sep 24 21:06:13 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 21:06:13.600935 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2f9456ab-c19d-469c-9936-7fb847ec290b tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:13.607312 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2f9456ab-c19d-469c-9936-7fb847ec290b tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:13.608102 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2f9456ab-c19d-469c-9936-7fb847ec290b tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e'} {{(pid=140516) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 21:06:13.614038 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f9456ab-c19d-469c-9936-7fb847ec290b tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:13.614540 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f9456ab-c19d-469c-9936-7fb847ec290b tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:13.615006 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f9456ab-c19d-469c-9936-7fb847ec290b tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:13.615795 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f9456ab-c19d-469c-9936-7fb847ec290b tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:13.616210 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f9456ab-c19d-469c-9936-7fb847ec290b tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:13.616650 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f9456ab-c19d-469c-9936-7fb847ec290b tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:13.764750 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2f9456ab-c19d-469c-9936-7fb847ec290b tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.169897 Sep 24 21:06:13.767086 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2160/4327] 10.222.0.52 () {58 vars in 1174 bytes} [Sat Sep 24 21:06:13 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 21:06:13.780120 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ee684074-3845-4ca1-beb0-d75dd3bdbde5 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:13.788200 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ee684074-3845-4ca1-beb0-d75dd3bdbde5 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:13.789305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ee684074-3845-4ca1-beb0-d75dd3bdbde5 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e'} {{(pid=140516) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 21:06:13.796719 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee684074-3845-4ca1-beb0-d75dd3bdbde5 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:13.797519 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee684074-3845-4ca1-beb0-d75dd3bdbde5 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:13.798217 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee684074-3845-4ca1-beb0-d75dd3bdbde5 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:13.799263 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee684074-3845-4ca1-beb0-d75dd3bdbde5 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:13.800221 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee684074-3845-4ca1-beb0-d75dd3bdbde5 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:13.801495 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee684074-3845-4ca1-beb0-d75dd3bdbde5 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:13.860306 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-556b49dc-82c4-46b5-aba1-798d38b7badd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:13.886398 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-556b49dc-82c4-46b5-aba1-798d38b7badd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 200 len: 1309 microversion: 2.1 time: 0.635533 Sep 24 21:06:13.891275 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2168/4328] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:13 2022] GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 1309 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:06:13.937751 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ee684074-3845-4ca1-beb0-d75dd3bdbde5 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.161321 Sep 24 21:06:13.939400 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2161/4329] 10.222.0.52 () {58 vars in 1184 bytes} [Sat Sep 24 21:06:13 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 21:06:13.940431 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e8ba95e9-1dea-4133-831f-e7b861a7858c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:13.941173 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e8ba95e9-1dea-4133-831f-e7b861a7858c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:13.953041 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b4f3881b-aa3a-4983-8ad0-e7090f874681 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:13.954812 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e8ba95e9-1dea-4133-831f-e7b861a7858c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:13.960783 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e8ba95e9-1dea-4133-831f-e7b861a7858c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:13.961793 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e8ba95e9-1dea-4133-831f-e7b861a7858c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:13.962780 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e8ba95e9-1dea-4133-831f-e7b861a7858c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:13.966092 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e8ba95e9-1dea-4133-831f-e7b861a7858c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:13.966807 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e8ba95e9-1dea-4133-831f-e7b861a7858c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:13.976093 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b4f3881b-aa3a-4983-8ad0-e7090f874681 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:13.977773 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b4f3881b-aa3a-4983-8ad0-e7090f874681 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Searching by: {'deleted': False, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e'} {{(pid=140516) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 21:06:13.986313 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b4f3881b-aa3a-4983-8ad0-e7090f874681 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:13.989356 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b4f3881b-aa3a-4983-8ad0-e7090f874681 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:13.991532 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b4f3881b-aa3a-4983-8ad0-e7090f874681 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:13.992519 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b4f3881b-aa3a-4983-8ad0-e7090f874681 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:13.993592 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b4f3881b-aa3a-4983-8ad0-e7090f874681 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:13.996485 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b4f3881b-aa3a-4983-8ad0-e7090f874681 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:14.072703 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.multi_cell_list [None req-b4f3881b-aa3a-4983-8ad0-e7090f874681 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 21:06:14.145569 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e8ba95e9-1dea-4133-831f-e7b861a7858c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:14.155891 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e8ba95e9-1dea-4133-831f-e7b861a7858c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:14.157254 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e8ba95e9-1dea-4133-831f-e7b861a7858c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:14.158774 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e8ba95e9-1dea-4133-831f-e7b861a7858c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1365 microversion: 2.47 time: 0.224245 Sep 24 21:06:14.165086 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b4f3881b-aa3a-4983-8ad0-e7090f874681 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:14.165344 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2169/4330] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:06:13 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:06:14.173196 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b4f3881b-aa3a-4983-8ad0-e7090f874681 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:14.174111 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b4f3881b-aa3a-4983-8ad0-e7090f874681 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:14.174831 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b4f3881b-aa3a-4983-8ad0-e7090f874681 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:14.192410 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-59d23a77-11ab-45b6-9c4b-9932eb566e04 req-d24168dc-b7cc-4011-82ad-a5bd011bd34e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9", "name": "network-vif-plugged", "status": "completed", "tag": "469139a1-1d76-4eb6-86e4-e74cc739b5df"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:06:14.219000 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-59d23a77-11ab-45b6-9c4b-9932eb566e04 req-d24168dc-b7cc-4011-82ad-a5bd011bd34e service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:14.220885 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-59d23a77-11ab-45b6-9c4b-9932eb566e04 req-d24168dc-b7cc-4011-82ad-a5bd011bd34e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:14.227495 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-59d23a77-11ab-45b6-9c4b-9932eb566e04 req-d24168dc-b7cc-4011-82ad-a5bd011bd34e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:14.255399 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-59d23a77-11ab-45b6-9c4b-9932eb566e04 req-d24168dc-b7cc-4011-82ad-a5bd011bd34e service nova] Creating event network-vif-plugged:469139a1-1d76-4eb6-86e4-e74cc739b5df for instance 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 on nch2-master-1 Sep 24 21:06:14.271201 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-59d23a77-11ab-45b6-9c4b-9932eb566e04 req-d24168dc-b7cc-4011-82ad-a5bd011bd34e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104280 Sep 24 21:06:14.274328 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2170/4331] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:06:14.922429 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8ef4f916-3fdf-4233-868d-0ea0e6062bb7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:14.924099 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8ef4f916-3fdf-4233-868d-0ea0e6062bb7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:14.935243 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8ef4f916-3fdf-4233-868d-0ea0e6062bb7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:14.935756 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8ef4f916-3fdf-4233-868d-0ea0e6062bb7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:14.936490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8ef4f916-3fdf-4233-868d-0ea0e6062bb7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:14.937498 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8ef4f916-3fdf-4233-868d-0ea0e6062bb7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:14.937979 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8ef4f916-3fdf-4233-868d-0ea0e6062bb7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:14.940250 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8ef4f916-3fdf-4233-868d-0ea0e6062bb7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:15.034106 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b4f3881b-aa3a-4983-8ad0-e7090f874681 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers/detail" status: 200 len: 3020 microversion: 2.1 time: 1.087058 Sep 24 21:06:15.035288 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2162/4332] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 21:06:13 2022] GET /compute/v2.1/servers/detail => generated 3020 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:15.060234 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a26deabb-6cb9-43a8-a3b3-0ed194d9529b tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:15.068878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a26deabb-6cb9-43a8-a3b3-0ed194d9529b tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:15.070427 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a26deabb-6cb9-43a8-a3b3-0ed194d9529b tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.014198 Sep 24 21:06:15.080367 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2163/4333] 10.222.0.52 () {58 vars in 1178 bytes} [Sat Sep 24 21:06:15 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 24 21:06:15.086583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d505cc3d-ef05-41dc-93b0-ef224ceb45c5 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:15.093552 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d505cc3d-ef05-41dc-93b0-ef224ceb45c5 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:15.094254 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d505cc3d-ef05-41dc-93b0-ef224ceb45c5 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Searching by: {'deleted': False, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e'} {{(pid=140516) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 21:06:15.103227 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d505cc3d-ef05-41dc-93b0-ef224ceb45c5 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:15.104001 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d505cc3d-ef05-41dc-93b0-ef224ceb45c5 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:15.104516 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d505cc3d-ef05-41dc-93b0-ef224ceb45c5 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:15.105748 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d505cc3d-ef05-41dc-93b0-ef224ceb45c5 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:15.106225 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d505cc3d-ef05-41dc-93b0-ef224ceb45c5 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:15.106897 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d505cc3d-ef05-41dc-93b0-ef224ceb45c5 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:15.143416 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.multi_cell_list [None req-d505cc3d-ef05-41dc-93b0-ef224ceb45c5 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 21:06:15.165196 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8ef4f916-3fdf-4233-868d-0ea0e6062bb7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:15.179029 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8ef4f916-3fdf-4233-868d-0ea0e6062bb7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 200 len: 1309 microversion: 2.1 time: 0.261542 Sep 24 21:06:15.194093 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2171/4334] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:14 2022] GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 1309 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:15.207698 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8e402090-56d4-44c3-9479-548d255c3f94 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:15.209627 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8e402090-56d4-44c3-9479-548d255c3f94 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:15.209997 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d505cc3d-ef05-41dc-93b0-ef224ceb45c5 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.127423 Sep 24 21:06:15.220325 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2164/4335] 10.222.0.52 () {58 vars in 1125 bytes} [Sat Sep 24 21:06:15 2022] GET /compute/v2.1/servers => generated 681 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:06:15.239388 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e19017ec-4559-4d7f-9639-e0669fdf5e0b tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:15.240272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e19017ec-4559-4d7f-9639-e0669fdf5e0b tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: 4f857f30-f6d8-4107-b14d-12502a60fc74] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:15.248304 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e19017ec-4559-4d7f-9639-e0669fdf5e0b tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:15.249061 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e19017ec-4559-4d7f-9639-e0669fdf5e0b tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:15.250643 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e19017ec-4559-4d7f-9639-e0669fdf5e0b tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:15.251923 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e19017ec-4559-4d7f-9639-e0669fdf5e0b tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:15.252406 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8e402090-56d4-44c3-9479-548d255c3f94 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:15.252937 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e19017ec-4559-4d7f-9639-e0669fdf5e0b tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:15.253548 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8e402090-56d4-44c3-9479-548d255c3f94 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:15.253802 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e19017ec-4559-4d7f-9639-e0669fdf5e0b tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:15.256835 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8e402090-56d4-44c3-9479-548d255c3f94 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:15.257736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8e402090-56d4-44c3-9479-548d255c3f94 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:15.263145 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8e402090-56d4-44c3-9479-548d255c3f94 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:15.263848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8e402090-56d4-44c3-9479-548d255c3f94 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:15.281787 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-e19017ec-4559-4d7f-9639-e0669fdf5e0b tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] HTTP exception thrown: Instance 4f857f30-f6d8-4107-b14d-12502a60fc74 could not be found. Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e19017ec-4559-4d7f-9639-e0669fdf5e0b tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Request method failure captured: Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/servers/4f857f30-f6d8-4107-b14d-12502a60fc74 HTTP/1.1 Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3EhZ-HtiwIPHoyznSVqzFSZetGXFfmPOfqGkIX-h00QLl5nvAWsxqzQ7l-9opE5RxsO0XPTOvNkVuNJHQuzTNeV3HgggHqZKZTjs_WJAzI2JM9I-KMa3XhYtiyT2T6gzqcDBNT71feQvT2HzVYvzjuyd5SOoI1VSuVpC1DCgcq6OVY Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 648cf4f432a3400b8dcf2b57a99d082e Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ListServersNegativeTestJSON-1353676620 Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/648cf4f432a3400b8dcf2b57a99d082e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_648cf4f432a3400b8dcf2b57a99d082e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/648cf4f432a3400b8dcf2b57a99d082e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/648cf4f432a3400b8dcf2b57a99d082e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ListServersNegativeTestJSON-1353676620 Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 648cf4f432a3400b8dcf2b57a99d082e Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1353676620 Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ListServersNegativeTestJSON-1353676620-project Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 762f4e35de9e4083bd0e7a4d0de3c136 Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ListServersNegativeTestJSON-1353676620-project Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 4f857f30-f6d8-4107-b14d-12502a60fc74 could not be found. Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '4f857f30-f6d8-4107-b14d-12502a60fc74'} Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f857f30-f6d8-4107-b14d-12502a60fc74 could not be found. Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:06:15.287992 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:06:15.293307 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f857f30-f6d8-4107-b14d-12502a60fc74 could not be found. Sep 24 21:06:15.293307 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:15.293307 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:15.293307 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:15.293307 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:15.293307 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:15.293307 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:15.293307 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:06:15.293307 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:06:15.293307 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f857f30-f6d8-4107-b14d-12502a60fc74 could not be found. Sep 24 21:06:15.293307 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:15.295241 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e19017ec-4559-4d7f-9639-e0669fdf5e0b tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Returning 404 to user: Instance 4f857f30-f6d8-4107-b14d-12502a60fc74 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:06:15.296640 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e19017ec-4559-4d7f-9639-e0669fdf5e0b tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4f857f30-f6d8-4107-b14d-12502a60fc74" status: 404 len: 111 microversion: 2.1 time: 0.074150 Sep 24 21:06:15.301425 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2165/4336] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:06:15 2022] DELETE /compute/v2.1/servers/4f857f30-f6d8-4107-b14d-12502a60fc74 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:06:15.309863 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-993869e4-1b04-41f7-9eb5-303696c08151 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:15.312050 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-993869e4-1b04-41f7-9eb5-303696c08151 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: fd3a51be-17a5-4293-9bad-a3768d7ec10b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:15.334767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-993869e4-1b04-41f7-9eb5-303696c08151 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:15.337881 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-993869e4-1b04-41f7-9eb5-303696c08151 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:15.338341 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-993869e4-1b04-41f7-9eb5-303696c08151 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:15.343167 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-993869e4-1b04-41f7-9eb5-303696c08151 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:15.343855 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-993869e4-1b04-41f7-9eb5-303696c08151 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:15.344644 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-993869e4-1b04-41f7-9eb5-303696c08151 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:15.435751 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8e402090-56d4-44c3-9479-548d255c3f94 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:15.440031 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-993869e4-1b04-41f7-9eb5-303696c08151 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: fd3a51be-17a5-4293-9bad-a3768d7ec10b] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:06:15.458246 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8e402090-56d4-44c3-9479-548d255c3f94 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:15.463400 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8e402090-56d4-44c3-9479-548d255c3f94 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:15.464872 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8e402090-56d4-44c3-9479-548d255c3f94 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1365 microversion: 2.47 time: 0.268063 Sep 24 21:06:15.465409 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2172/4337] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:06:15 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1365 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:06:15.622327 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-993869e4-1b04-41f7-9eb5-303696c08151 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fd3a51be-17a5-4293-9bad-a3768d7ec10b" status: 204 len: 0 microversion: 2.1 time: 0.319312 Sep 24 21:06:15.622936 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2166/4338] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:06:15 2022] DELETE /compute/v2.1/servers/fd3a51be-17a5-4293-9bad-a3768d7ec10b => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:06:15.634390 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-11b0f97a-4068-428d-9534-a09bae67f21b tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:15.636918 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-11b0f97a-4068-428d-9534-a09bae67f21b tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: c5bd74b9-2a72-452a-b603-9b99fba57f9b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:15.647749 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-11b0f97a-4068-428d-9534-a09bae67f21b tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:15.648255 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-11b0f97a-4068-428d-9534-a09bae67f21b tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:15.648703 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-11b0f97a-4068-428d-9534-a09bae67f21b tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:15.649565 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-11b0f97a-4068-428d-9534-a09bae67f21b tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:15.650038 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-11b0f97a-4068-428d-9534-a09bae67f21b tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:15.650474 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-11b0f97a-4068-428d-9534-a09bae67f21b tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:15.708637 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-11b0f97a-4068-428d-9534-a09bae67f21b tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: c5bd74b9-2a72-452a-b603-9b99fba57f9b] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:06:15.833649 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-11b0f97a-4068-428d-9534-a09bae67f21b tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b" status: 204 len: 0 microversion: 2.1 time: 0.206015 Sep 24 21:06:15.835683 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2173/4339] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:06:15 2022] DELETE /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 24 21:06:15.843184 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2f7388aa-fcd2-4b64-84d5-eefba649a597 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:15.843960 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2f7388aa-fcd2-4b64-84d5-eefba649a597 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: 4f857f30-f6d8-4107-b14d-12502a60fc74] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:15.855409 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f7388aa-fcd2-4b64-84d5-eefba649a597 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:15.855960 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f7388aa-fcd2-4b64-84d5-eefba649a597 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:15.856359 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f7388aa-fcd2-4b64-84d5-eefba649a597 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:15.857086 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f7388aa-fcd2-4b64-84d5-eefba649a597 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:15.857549 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f7388aa-fcd2-4b64-84d5-eefba649a597 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:15.857984 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f7388aa-fcd2-4b64-84d5-eefba649a597 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:15.882119 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-2f7388aa-fcd2-4b64-84d5-eefba649a597 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] HTTP exception thrown: Instance 4f857f30-f6d8-4107-b14d-12502a60fc74 could not be found. Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2f7388aa-fcd2-4b64-84d5-eefba649a597 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Request method failure captured: Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/4f857f30-f6d8-4107-b14d-12502a60fc74 HTTP/1.1 Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3EhZ-HtiwIPHoyznSVqzFSZetGXFfmPOfqGkIX-h00QLl5nvAWsxqzQ7l-9opE5RxsO0XPTOvNkVuNJHQuzTNeV3HgggHqZKZTjs_WJAzI2JM9I-KMa3XhYtiyT2T6gzqcDBNT71feQvT2HzVYvzjuyd5SOoI1VSuVpC1DCgcq6OVY Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 648cf4f432a3400b8dcf2b57a99d082e Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ListServersNegativeTestJSON-1353676620 Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/648cf4f432a3400b8dcf2b57a99d082e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_648cf4f432a3400b8dcf2b57a99d082e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/648cf4f432a3400b8dcf2b57a99d082e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/648cf4f432a3400b8dcf2b57a99d082e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ListServersNegativeTestJSON-1353676620 Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 648cf4f432a3400b8dcf2b57a99d082e Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1353676620 Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ListServersNegativeTestJSON-1353676620-project Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 762f4e35de9e4083bd0e7a4d0de3c136 Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ListServersNegativeTestJSON-1353676620-project Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 4f857f30-f6d8-4107-b14d-12502a60fc74 could not be found. Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '4f857f30-f6d8-4107-b14d-12502a60fc74'} Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f857f30-f6d8-4107-b14d-12502a60fc74 could not be found. Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f857f30-f6d8-4107-b14d-12502a60fc74 could not be found. Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:15.884083 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:15.889798 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:15.889798 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:15.889798 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:15.889798 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:15.889798 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:06:15.889798 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:06:15.889798 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f857f30-f6d8-4107-b14d-12502a60fc74 could not be found. Sep 24 21:06:15.889798 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:15.891316 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2f7388aa-fcd2-4b64-84d5-eefba649a597 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Returning 404 to user: Instance 4f857f30-f6d8-4107-b14d-12502a60fc74 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:06:15.892387 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2f7388aa-fcd2-4b64-84d5-eefba649a597 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers/4f857f30-f6d8-4107-b14d-12502a60fc74" status: 404 len: 111 microversion: 2.1 time: 0.053517 Sep 24 21:06:15.893453 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2167/4340] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:15 2022] GET /compute/v2.1/servers/4f857f30-f6d8-4107-b14d-12502a60fc74 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:06:15.906828 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5b49b59f-2fb8-44d3-baca-bcab372175d2 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:15.907971 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5b49b59f-2fb8-44d3-baca-bcab372175d2 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: fd3a51be-17a5-4293-9bad-a3768d7ec10b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:15.914696 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b49b59f-2fb8-44d3-baca-bcab372175d2 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:15.915195 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b49b59f-2fb8-44d3-baca-bcab372175d2 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:15.915643 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b49b59f-2fb8-44d3-baca-bcab372175d2 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:15.916410 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b49b59f-2fb8-44d3-baca-bcab372175d2 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:15.916877 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b49b59f-2fb8-44d3-baca-bcab372175d2 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:15.917318 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b49b59f-2fb8-44d3-baca-bcab372175d2 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:16.149787 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5b49b59f-2fb8-44d3-baca-bcab372175d2 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:16.162206 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5b49b59f-2fb8-44d3-baca-bcab372175d2 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers/fd3a51be-17a5-4293-9bad-a3768d7ec10b" status: 200 len: 1520 microversion: 2.1 time: 0.262290 Sep 24 21:06:16.179277 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2168/4341] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:15 2022] GET /compute/v2.1/servers/fd3a51be-17a5-4293-9bad-a3768d7ec10b => generated 1520 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:06:16.206048 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bdec150c-1fd6-4821-a687-ef94f1eff547 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:16.210485 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-bdec150c-1fd6-4821-a687-ef94f1eff547 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:16.240635 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bdec150c-1fd6-4821-a687-ef94f1eff547 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:16.241581 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bdec150c-1fd6-4821-a687-ef94f1eff547 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:16.242162 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bdec150c-1fd6-4821-a687-ef94f1eff547 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:16.244487 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bdec150c-1fd6-4821-a687-ef94f1eff547 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:16.246161 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bdec150c-1fd6-4821-a687-ef94f1eff547 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:16.246763 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bdec150c-1fd6-4821-a687-ef94f1eff547 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:16.445896 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-bdec150c-1fd6-4821-a687-ef94f1eff547 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:16.457370 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bdec150c-1fd6-4821-a687-ef94f1eff547 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 200 len: 1491 microversion: 2.1 time: 0.255205 Sep 24 21:06:16.459015 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2169/4342] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:16 2022] GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 1491 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:16.477290 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e5cdb449-e3d4-4568-9ea0-f725baf5a74c tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Action: 'create', calling method: .version_select at 0x7f4b07df13a0>, body: {"keypair": {"name": "tempest-keypair-1770304215", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKzRKWUGJRpBxSI7hBAdgHSH/lkhgYw7L+IUY8rVbRSXdG5T6xGhyzO6jJLpap6DVUkhD9GxzP2lD5YrSLL42lGkJvmYrQ8zPLhL37jHwYLVqUg9BQu/hXeQ3d84xaDkA=="}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:06:16.493409 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-04a28bd5-48ca-439a-870a-c4a54f0f35ad tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-219001286"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:06:16.496319 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-04a28bd5-48ca-439a-870a-c4a54f0f35ad tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:16.513231 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-04a28bd5-48ca-439a-870a-c4a54f0f35ad tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:16.513824 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-04a28bd5-48ca-439a-870a-c4a54f0f35ad tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:16.518548 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-04a28bd5-48ca-439a-870a-c4a54f0f35ad tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:16.519271 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-04a28bd5-48ca-439a-870a-c4a54f0f35ad tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:16.519993 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-04a28bd5-48ca-439a-870a-c4a54f0f35ad tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:16.521387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-04a28bd5-48ca-439a-870a-c4a54f0f35ad tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:16.525040 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-e5cdb449-e3d4-4568-9ea0-f725baf5a74c tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Getting quotas for project ede438e67af3496cae36fc89abc0aba3. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:06:16.541489 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-e5cdb449-e3d4-4568-9ea0-f725baf5a74c tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Getting quotas for user 370b057b12c148cdbb673ba6c06bd6b4 and project ede438e67af3496cae36fc89abc0aba3. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:06:16.566983 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:06:16.578816 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e5cdb449-e3d4-4568-9ea0-f725baf5a74c tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.688692 Sep 24 21:06:16.580623 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2174/4343] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 21:06:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:06:16.590002 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4ad39fa3-b0a8-4e9f-a3cd-a0d0f2319f6a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:16.592045 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4ad39fa3-b0a8-4e9f-a3cd-a0d0f2319f6a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:16.610091 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ad39fa3-b0a8-4e9f-a3cd-a0d0f2319f6a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:16.610625 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ad39fa3-b0a8-4e9f-a3cd-a0d0f2319f6a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:16.611654 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ad39fa3-b0a8-4e9f-a3cd-a0d0f2319f6a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:16.618571 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ad39fa3-b0a8-4e9f-a3cd-a0d0f2319f6a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:16.618571 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ad39fa3-b0a8-4e9f-a3cd-a0d0f2319f6a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:16.619021 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ad39fa3-b0a8-4e9f-a3cd-a0d0f2319f6a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:16.674221 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-04a28bd5-48ca-439a-870a-c4a54f0f35ad tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "PUT /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 200 len: 1075 microversion: 2.1 time: 0.193641 Sep 24 21:06:16.679409 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2170/4344] 10.222.0.52 () {60 vars in 1256 bytes} [Sat Sep 24 21:06:16 2022] PUT /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 1075 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:16.697887 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f4ac8d0c-ef13-4bc0-b6cc-cb43457c1330 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:16.699356 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f4ac8d0c-ef13-4bc0-b6cc-cb43457c1330 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:16.708869 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4ac8d0c-ef13-4bc0-b6cc-cb43457c1330 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:16.710230 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4ac8d0c-ef13-4bc0-b6cc-cb43457c1330 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:16.711013 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4ac8d0c-ef13-4bc0-b6cc-cb43457c1330 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:16.712080 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4ac8d0c-ef13-4bc0-b6cc-cb43457c1330 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:16.712878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4ac8d0c-ef13-4bc0-b6cc-cb43457c1330 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:16.713413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4ac8d0c-ef13-4bc0-b6cc-cb43457c1330 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:16.768097 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4ad39fa3-b0a8-4e9f-a3cd-a0d0f2319f6a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:16.781728 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4ad39fa3-b0a8-4e9f-a3cd-a0d0f2319f6a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:16.783636 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4ad39fa3-b0a8-4e9f-a3cd-a0d0f2319f6a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:16.787871 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4ad39fa3-b0a8-4e9f-a3cd-a0d0f2319f6a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1365 microversion: 2.47 time: 0.204896 Sep 24 21:06:16.791096 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2175/4345] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:06:16 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1365 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:06:16.950104 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f4ac8d0c-ef13-4bc0-b6cc-cb43457c1330 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:16.964978 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f4ac8d0c-ef13-4bc0-b6cc-cb43457c1330 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 200 len: 1501 microversion: 2.1 time: 0.271135 Sep 24 21:06:16.980110 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2171/4346] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:16 2022] GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 1501 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:16.990896 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5b72bdb3-dec0-4238-8ae9-b5a089d0163d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:16.991532 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5b72bdb3-dec0-4238-8ae9-b5a089d0163d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:17.005590 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b72bdb3-dec0-4238-8ae9-b5a089d0163d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:17.006113 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b72bdb3-dec0-4238-8ae9-b5a089d0163d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:17.006604 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b72bdb3-dec0-4238-8ae9-b5a089d0163d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:17.007431 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b72bdb3-dec0-4238-8ae9-b5a089d0163d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:17.008097 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b72bdb3-dec0-4238-8ae9-b5a089d0163d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:17.008708 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5b72bdb3-dec0-4238-8ae9-b5a089d0163d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:17.188206 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-65720e76-07d4-4721-87cc-b3b17d1726bd tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:17.189878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-65720e76-07d4-4721-87cc-b3b17d1726bd tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: fd3a51be-17a5-4293-9bad-a3768d7ec10b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:17.202292 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65720e76-07d4-4721-87cc-b3b17d1726bd tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:17.203206 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65720e76-07d4-4721-87cc-b3b17d1726bd tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:17.204322 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65720e76-07d4-4721-87cc-b3b17d1726bd tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:17.206401 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65720e76-07d4-4721-87cc-b3b17d1726bd tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:17.207144 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65720e76-07d4-4721-87cc-b3b17d1726bd tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:17.208379 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65720e76-07d4-4721-87cc-b3b17d1726bd tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:17.349465 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5b72bdb3-dec0-4238-8ae9-b5a089d0163d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:17.358859 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5b72bdb3-dec0-4238-8ae9-b5a089d0163d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 200 len: 1501 microversion: 2.1 time: 0.372309 Sep 24 21:06:17.378396 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2176/4347] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:16 2022] GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 1501 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:17.384392 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9c34ef0c-8e88-4515-b028-56edbdd1d5ae tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:06:17.392134 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c34ef0c-8e88-4515-b028-56edbdd1d5ae tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:17.392944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c34ef0c-8e88-4515-b028-56edbdd1d5ae tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:17.393630 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c34ef0c-8e88-4515-b028-56edbdd1d5ae tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:17.432802 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9c34ef0c-8e88-4515-b028-56edbdd1d5ae tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Going to try to stop instance {{(pid=140517) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 24 21:06:17.576414 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9c34ef0c-8e88-4515-b028-56edbdd1d5ae tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "POST /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9/action" status: 202 len: 0 microversion: 2.1 time: 0.191537 Sep 24 21:06:17.577123 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2177/4348] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:06:17 2022] POST /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 21:06:17.613826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-22f40641-37a5-4a64-b32a-f3411e9fbb5a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:17.617783 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-22f40641-37a5-4a64-b32a-f3411e9fbb5a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:17.633411 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22f40641-37a5-4a64-b32a-f3411e9fbb5a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:17.634300 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22f40641-37a5-4a64-b32a-f3411e9fbb5a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:17.634965 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22f40641-37a5-4a64-b32a-f3411e9fbb5a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:17.636124 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22f40641-37a5-4a64-b32a-f3411e9fbb5a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:17.638564 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22f40641-37a5-4a64-b32a-f3411e9fbb5a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:17.639230 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22f40641-37a5-4a64-b32a-f3411e9fbb5a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:17.751312 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-65720e76-07d4-4721-87cc-b3b17d1726bd tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:17.767248 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-65720e76-07d4-4721-87cc-b3b17d1726bd tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers/fd3a51be-17a5-4293-9bad-a3768d7ec10b" status: 200 len: 1520 microversion: 2.1 time: 0.582323 Sep 24 21:06:17.770227 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2172/4349] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:17 2022] GET /compute/v2.1/servers/fd3a51be-17a5-4293-9bad-a3768d7ec10b => generated 1520 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:06:17.821745 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-feb093ea-faca-45bb-a995-06bf8d1b3c66 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:17.822374 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-feb093ea-faca-45bb-a995-06bf8d1b3c66 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:17.833685 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-feb093ea-faca-45bb-a995-06bf8d1b3c66 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:17.834785 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-feb093ea-faca-45bb-a995-06bf8d1b3c66 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:17.835826 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-feb093ea-faca-45bb-a995-06bf8d1b3c66 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:17.837356 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-feb093ea-faca-45bb-a995-06bf8d1b3c66 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:17.839192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-feb093ea-faca-45bb-a995-06bf8d1b3c66 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:17.841248 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-feb093ea-faca-45bb-a995-06bf8d1b3c66 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:17.978319 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-feb093ea-faca-45bb-a995-06bf8d1b3c66 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:17.999826 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-feb093ea-faca-45bb-a995-06bf8d1b3c66 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:18.009131 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-feb093ea-faca-45bb-a995-06bf8d1b3c66 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:18.010821 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-feb093ea-faca-45bb-a995-06bf8d1b3c66 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1365 microversion: 2.47 time: 0.193027 Sep 24 21:06:18.011613 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2173/4350] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:06:17 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1365 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:06:18.252848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-22f40641-37a5-4a64-b32a-f3411e9fbb5a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:18.292754 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-22f40641-37a5-4a64-b32a-f3411e9fbb5a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 200 len: 1511 microversion: 2.1 time: 0.691873 Sep 24 21:06:18.293676 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2178/4351] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:17 2022] GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 1511 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:18.664779 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-66be70cd-69ae-45c0-a593-8064941b80e5 req-8c26e74d-977a-4181-b78f-97d9dbce6ddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd3a51be-17a5-4293-9bad-a3768d7ec10b", "name": "network-vif-deleted", "tag": "50c9da6c-eed0-476d-b42f-e3195ac755fc"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:06:18.681741 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-66be70cd-69ae-45c0-a593-8064941b80e5 req-8c26e74d-977a-4181-b78f-97d9dbce6ddf service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:18.682665 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-66be70cd-69ae-45c0-a593-8064941b80e5 req-8c26e74d-977a-4181-b78f-97d9dbce6ddf service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:18.684808 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-66be70cd-69ae-45c0-a593-8064941b80e5 req-8c26e74d-977a-4181-b78f-97d9dbce6ddf service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:18.718832 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-66be70cd-69ae-45c0-a593-8064941b80e5 req-8c26e74d-977a-4181-b78f-97d9dbce6ddf service nova] Creating event network-vif-deleted:50c9da6c-eed0-476d-b42f-e3195ac755fc for instance fd3a51be-17a5-4293-9bad-a3768d7ec10b on nch2-master-1 Sep 24 21:06:18.737079 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-66be70cd-69ae-45c0-a593-8064941b80e5 req-8c26e74d-977a-4181-b78f-97d9dbce6ddf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075738 Sep 24 21:06:18.741196 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2174/4352] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:06:18.794190 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-be45293e-9720-4610-b076-70b8f1737de4 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:18.794912 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-be45293e-9720-4610-b076-70b8f1737de4 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: fd3a51be-17a5-4293-9bad-a3768d7ec10b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:18.812193 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-be45293e-9720-4610-b076-70b8f1737de4 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:18.820941 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-be45293e-9720-4610-b076-70b8f1737de4 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:18.821530 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-be45293e-9720-4610-b076-70b8f1737de4 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:18.822345 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-be45293e-9720-4610-b076-70b8f1737de4 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:18.822870 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-be45293e-9720-4610-b076-70b8f1737de4 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:18.823349 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-be45293e-9720-4610-b076-70b8f1737de4 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:18.856999 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:06:18.933214 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-be45293e-9720-4610-b076-70b8f1737de4 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:18.933727 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-be45293e-9720-4610-b076-70b8f1737de4 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:18.934177 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-be45293e-9720-4610-b076-70b8f1737de4 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:18.934701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-be45293e-9720-4610-b076-70b8f1737de4 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lazy-loading 'fault' on Instance uuid fd3a51be-17a5-4293-9bad-a3768d7ec10b {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:06:18.996229 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-be45293e-9720-4610-b076-70b8f1737de4 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:19.008009 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-be45293e-9720-4610-b076-70b8f1737de4 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers/fd3a51be-17a5-4293-9bad-a3768d7ec10b" status: 200 len: 1312 microversion: 2.1 time: 0.218489 Sep 24 21:06:19.010019 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2179/4353] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:18 2022] GET /compute/v2.1/servers/fd3a51be-17a5-4293-9bad-a3768d7ec10b => generated 1312 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:19.052599 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bc955cfc-ee4e-4f3f-88d8-e931fba198b3 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:19.053318 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-bc955cfc-ee4e-4f3f-88d8-e931fba198b3 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:19.073868 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bc955cfc-ee4e-4f3f-88d8-e931fba198b3 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:19.074363 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bc955cfc-ee4e-4f3f-88d8-e931fba198b3 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:19.074834 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bc955cfc-ee4e-4f3f-88d8-e931fba198b3 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:19.075542 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bc955cfc-ee4e-4f3f-88d8-e931fba198b3 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:19.076006 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bc955cfc-ee4e-4f3f-88d8-e931fba198b3 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:19.076453 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bc955cfc-ee4e-4f3f-88d8-e931fba198b3 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:19.225178 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-bc955cfc-ee4e-4f3f-88d8-e931fba198b3 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:19.236721 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-bc955cfc-ee4e-4f3f-88d8-e931fba198b3 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:19.238827 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-bc955cfc-ee4e-4f3f-88d8-e931fba198b3 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:19.241388 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bc955cfc-ee4e-4f3f-88d8-e931fba198b3 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1365 microversion: 2.47 time: 0.199565 Sep 24 21:06:19.242211 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2175/4354] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:06:19 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1365 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:06:19.321220 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e9265087-48d6-4832-92cb-e07759659e0d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:19.321834 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e9265087-48d6-4832-92cb-e07759659e0d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:19.335614 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9265087-48d6-4832-92cb-e07759659e0d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:19.336836 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9265087-48d6-4832-92cb-e07759659e0d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:19.338103 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9265087-48d6-4832-92cb-e07759659e0d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:19.339733 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9265087-48d6-4832-92cb-e07759659e0d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:19.340512 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9265087-48d6-4832-92cb-e07759659e0d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:19.342093 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9265087-48d6-4832-92cb-e07759659e0d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:19.556637 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-d36133ae-16d4-45e7-bbbe-c5a87c792fcf req-1de50ecb-6658-41d2-9925-03c4d465f3ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5bd74b9-2a72-452a-b603-9b99fba57f9b", "name": "network-vif-deleted", "tag": "d25008d5-04dc-438e-bb15-84c9839c9094"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:06:19.591267 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d36133ae-16d4-45e7-bbbe-c5a87c792fcf req-1de50ecb-6658-41d2-9925-03c4d465f3ca service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:19.592233 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d36133ae-16d4-45e7-bbbe-c5a87c792fcf req-1de50ecb-6658-41d2-9925-03c4d465f3ca service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:19.593705 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d36133ae-16d4-45e7-bbbe-c5a87c792fcf req-1de50ecb-6658-41d2-9925-03c4d465f3ca service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:19.630777 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-d36133ae-16d4-45e7-bbbe-c5a87c792fcf req-1de50ecb-6658-41d2-9925-03c4d465f3ca service nova] Creating event network-vif-deleted:d25008d5-04dc-438e-bb15-84c9839c9094 for instance c5bd74b9-2a72-452a-b603-9b99fba57f9b on nch1-master-1 Sep 24 21:06:19.645313 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-d36133ae-16d4-45e7-bbbe-c5a87c792fcf req-1de50ecb-6658-41d2-9925-03c4d465f3ca service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097079 Sep 24 21:06:19.647323 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2176/4355] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:06:19.993496 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e9265087-48d6-4832-92cb-e07759659e0d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:20.009963 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e9265087-48d6-4832-92cb-e07759659e0d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 200 len: 1511 microversion: 2.1 time: 0.692041 Sep 24 21:06:20.035367 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2180/4356] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:19 2022] GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 1511 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:20.039280 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e1f68059-ee5d-4f15-9b6e-beeabc3400ec tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:20.041395 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e1f68059-ee5d-4f15-9b6e-beeabc3400ec tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: fd3a51be-17a5-4293-9bad-a3768d7ec10b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:20.048796 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e1f68059-ee5d-4f15-9b6e-beeabc3400ec tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:20.049763 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e1f68059-ee5d-4f15-9b6e-beeabc3400ec tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:20.051335 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e1f68059-ee5d-4f15-9b6e-beeabc3400ec tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:20.052359 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e1f68059-ee5d-4f15-9b6e-beeabc3400ec tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:20.053085 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e1f68059-ee5d-4f15-9b6e-beeabc3400ec tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:20.054281 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e1f68059-ee5d-4f15-9b6e-beeabc3400ec tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:20.079132 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-e1f68059-ee5d-4f15-9b6e-beeabc3400ec tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] HTTP exception thrown: Instance fd3a51be-17a5-4293-9bad-a3768d7ec10b could not be found. Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e1f68059-ee5d-4f15-9b6e-beeabc3400ec tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Request method failure captured: Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/fd3a51be-17a5-4293-9bad-a3768d7ec10b HTTP/1.1 Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3EhZ-HtiwIPHoyznSVqzFSZetGXFfmPOfqGkIX-h00QLl5nvAWsxqzQ7l-9opE5RxsO0XPTOvNkVuNJHQuzTNeV3HgggHqZKZTjs_WJAzI2JM9I-KMa3XhYtiyT2T6gzqcDBNT71feQvT2HzVYvzjuyd5SOoI1VSuVpC1DCgcq6OVY Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 648cf4f432a3400b8dcf2b57a99d082e Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ListServersNegativeTestJSON-1353676620 Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/648cf4f432a3400b8dcf2b57a99d082e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_648cf4f432a3400b8dcf2b57a99d082e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/648cf4f432a3400b8dcf2b57a99d082e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/648cf4f432a3400b8dcf2b57a99d082e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ListServersNegativeTestJSON-1353676620 Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 648cf4f432a3400b8dcf2b57a99d082e Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1353676620 Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ListServersNegativeTestJSON-1353676620-project Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 762f4e35de9e4083bd0e7a4d0de3c136 Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ListServersNegativeTestJSON-1353676620-project Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance fd3a51be-17a5-4293-9bad-a3768d7ec10b could not be found. Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'fd3a51be-17a5-4293-9bad-a3768d7ec10b'} Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd3a51be-17a5-4293-9bad-a3768d7ec10b could not be found. Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd3a51be-17a5-4293-9bad-a3768d7ec10b could not be found. Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:20.080940 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:20.087918 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:20.087918 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:20.087918 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:20.087918 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:20.087918 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:06:20.087918 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:06:20.087918 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd3a51be-17a5-4293-9bad-a3768d7ec10b could not be found. Sep 24 21:06:20.087918 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:20.087918 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e1f68059-ee5d-4f15-9b6e-beeabc3400ec tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Returning 404 to user: Instance fd3a51be-17a5-4293-9bad-a3768d7ec10b could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:06:20.087918 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e1f68059-ee5d-4f15-9b6e-beeabc3400ec tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers/fd3a51be-17a5-4293-9bad-a3768d7ec10b" status: 404 len: 111 microversion: 2.1 time: 0.052480 Sep 24 21:06:20.089306 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2177/4357] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:20 2022] GET /compute/v2.1/servers/fd3a51be-17a5-4293-9bad-a3768d7ec10b => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 21:06:20.096883 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-57ec65ca-5b32-4437-8a03-ae1a7ae63239 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:20.098299 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-57ec65ca-5b32-4437-8a03-ae1a7ae63239 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: c5bd74b9-2a72-452a-b603-9b99fba57f9b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:20.112691 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57ec65ca-5b32-4437-8a03-ae1a7ae63239 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:20.114062 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57ec65ca-5b32-4437-8a03-ae1a7ae63239 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:20.114542 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57ec65ca-5b32-4437-8a03-ae1a7ae63239 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:20.115326 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57ec65ca-5b32-4437-8a03-ae1a7ae63239 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:20.116888 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57ec65ca-5b32-4437-8a03-ae1a7ae63239 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:20.117363 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57ec65ca-5b32-4437-8a03-ae1a7ae63239 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:20.225507 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57ec65ca-5b32-4437-8a03-ae1a7ae63239 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:20.225507 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57ec65ca-5b32-4437-8a03-ae1a7ae63239 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:20.225507 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57ec65ca-5b32-4437-8a03-ae1a7ae63239 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:20.225507 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-57ec65ca-5b32-4437-8a03-ae1a7ae63239 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lazy-loading 'fault' on Instance uuid c5bd74b9-2a72-452a-b603-9b99fba57f9b {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:06:20.277417 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-76ec653e-8dba-4d7b-a768-e7a5d8264125 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:20.278158 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-76ec653e-8dba-4d7b-a768-e7a5d8264125 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:20.292236 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76ec653e-8dba-4d7b-a768-e7a5d8264125 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:20.292757 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76ec653e-8dba-4d7b-a768-e7a5d8264125 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:20.293207 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76ec653e-8dba-4d7b-a768-e7a5d8264125 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:20.293936 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76ec653e-8dba-4d7b-a768-e7a5d8264125 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:20.294404 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76ec653e-8dba-4d7b-a768-e7a5d8264125 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:20.294867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76ec653e-8dba-4d7b-a768-e7a5d8264125 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:20.305478 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-57ec65ca-5b32-4437-8a03-ae1a7ae63239 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762f4e35de9e4083bd0e7a4d0de3c136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648cf4f432a3400b8dcf2b57a99d082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:20.317259 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-57ec65ca-5b32-4437-8a03-ae1a7ae63239 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b" status: 200 len: 1312 microversion: 2.1 time: 0.227754 Sep 24 21:06:20.319400 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2181/4358] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:20 2022] GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b => generated 1312 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:20.425888 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-76ec653e-8dba-4d7b-a768-e7a5d8264125 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:20.446385 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-76ec653e-8dba-4d7b-a768-e7a5d8264125 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:20.450979 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-76ec653e-8dba-4d7b-a768-e7a5d8264125 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:20.454581 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-76ec653e-8dba-4d7b-a768-e7a5d8264125 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1371 microversion: 2.47 time: 0.186193 Sep 24 21:06:20.458552 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2178/4359] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:06:20 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:06:21.036941 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-91da4759-360a-4c40-9967-394dde6f5073 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:21.038227 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-91da4759-360a-4c40-9967-394dde6f5073 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:21.047122 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-91da4759-360a-4c40-9967-394dde6f5073 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:21.047960 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-91da4759-360a-4c40-9967-394dde6f5073 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:21.049099 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-91da4759-360a-4c40-9967-394dde6f5073 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:21.050159 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-91da4759-360a-4c40-9967-394dde6f5073 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:21.051775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-91da4759-360a-4c40-9967-394dde6f5073 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:21.052390 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-91da4759-360a-4c40-9967-394dde6f5073 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:21.167986 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4f3c1f91-c9ea-4e5d-a18c-4c996446661a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-55780803", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6640486c-9b61-4251-91b8-eded7b0b3bda"}], "security_groups": [{"name": "tempest-securitygroup--2046360073"}], "key_name": "tempest-keypair-1770304215", "user_data": "}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:06:21.261821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-91da4759-360a-4c40-9967-394dde6f5073 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:21.280715 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-91da4759-360a-4c40-9967-394dde6f5073 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 200 len: 1511 microversion: 2.1 time: 0.245239 Sep 24 21:06:21.282156 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2182/4360] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:21 2022] GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 1511 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:21.312313 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-4f3c1f91-c9ea-4e5d-a18c-4c996446661a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] validate_networks() for [('6640486c-9b61-4251-91b8-eded7b0b3bda', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:06:21.341558 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5265275a-c56b-4e92-bca7-ed2d384a5f68 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:21.342423 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5265275a-c56b-4e92-bca7-ed2d384a5f68 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] [instance: c5bd74b9-2a72-452a-b603-9b99fba57f9b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:21.349715 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5265275a-c56b-4e92-bca7-ed2d384a5f68 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:21.350214 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5265275a-c56b-4e92-bca7-ed2d384a5f68 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:21.350689 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5265275a-c56b-4e92-bca7-ed2d384a5f68 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:21.351391 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5265275a-c56b-4e92-bca7-ed2d384a5f68 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:21.352036 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5265275a-c56b-4e92-bca7-ed2d384a5f68 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:21.352463 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5265275a-c56b-4e92-bca7-ed2d384a5f68 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:21.367166 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-5265275a-c56b-4e92-bca7-ed2d384a5f68 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] HTTP exception thrown: Instance c5bd74b9-2a72-452a-b603-9b99fba57f9b could not be found. Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5265275a-c56b-4e92-bca7-ed2d384a5f68 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Request method failure captured: Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b HTTP/1.1 Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3EhZ-HtiwIPHoyznSVqzFSZetGXFfmPOfqGkIX-h00QLl5nvAWsxqzQ7l-9opE5RxsO0XPTOvNkVuNJHQuzTNeV3HgggHqZKZTjs_WJAzI2JM9I-KMa3XhYtiyT2T6gzqcDBNT71feQvT2HzVYvzjuyd5SOoI1VSuVpC1DCgcq6OVY Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 648cf4f432a3400b8dcf2b57a99d082e Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ListServersNegativeTestJSON-1353676620 Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/648cf4f432a3400b8dcf2b57a99d082e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_648cf4f432a3400b8dcf2b57a99d082e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/648cf4f432a3400b8dcf2b57a99d082e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/648cf4f432a3400b8dcf2b57a99d082e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ListServersNegativeTestJSON-1353676620 Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 648cf4f432a3400b8dcf2b57a99d082e Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1353676620 Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ListServersNegativeTestJSON-1353676620-project Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 762f4e35de9e4083bd0e7a4d0de3c136 Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ListServersNegativeTestJSON-1353676620-project Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance c5bd74b9-2a72-452a-b603-9b99fba57f9b could not be found. Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'c5bd74b9-2a72-452a-b603-9b99fba57f9b'} Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5bd74b9-2a72-452a-b603-9b99fba57f9b could not be found. Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5bd74b9-2a72-452a-b603-9b99fba57f9b could not be found. Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:21.368864 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:21.373554 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:21.373554 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:21.373554 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:21.373554 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:21.373554 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:06:21.373554 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:06:21.373554 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5bd74b9-2a72-452a-b603-9b99fba57f9b could not be found. Sep 24 21:06:21.373554 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:21.373554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5265275a-c56b-4e92-bca7-ed2d384a5f68 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] Returning 404 to user: Instance c5bd74b9-2a72-452a-b603-9b99fba57f9b could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:06:21.373554 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5265275a-c56b-4e92-bca7-ed2d384a5f68 tempest-ListServersNegativeTestJSON-1353676620 tempest-ListServersNegativeTestJSON-1353676620-project] 10.222.0.52 "GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b" status: 404 len: 111 microversion: 2.1 time: 0.032957 Sep 24 21:06:21.375112 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2183/4361] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:21 2022] GET /compute/v2.1/servers/c5bd74b9-2a72-452a-b603-9b99fba57f9b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 21:06:21.485135 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-031709e0-7ac5-4022-a5ec-3693ed05a519 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:21.485704 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-031709e0-7ac5-4022-a5ec-3693ed05a519 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:21.492696 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-031709e0-7ac5-4022-a5ec-3693ed05a519 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:21.493201 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-031709e0-7ac5-4022-a5ec-3693ed05a519 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:21.493656 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-031709e0-7ac5-4022-a5ec-3693ed05a519 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:21.494384 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-031709e0-7ac5-4022-a5ec-3693ed05a519 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:21.494934 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-031709e0-7ac5-4022-a5ec-3693ed05a519 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:21.495611 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-031709e0-7ac5-4022-a5ec-3693ed05a519 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:21.620905 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-031709e0-7ac5-4022-a5ec-3693ed05a519 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:21.631172 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-031709e0-7ac5-4022-a5ec-3693ed05a519 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:21.633729 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-031709e0-7ac5-4022-a5ec-3693ed05a519 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:21.635558 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-031709e0-7ac5-4022-a5ec-3693ed05a519 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1371 microversion: 2.47 time: 0.154542 Sep 24 21:06:21.650805 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2184/4362] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:06:21 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:06:22.309376 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1faea2c2-ab81-4c63-a289-946c00ff7548 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:22.310041 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1faea2c2-ab81-4c63-a289-946c00ff7548 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:22.319464 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1faea2c2-ab81-4c63-a289-946c00ff7548 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:22.320560 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1faea2c2-ab81-4c63-a289-946c00ff7548 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:22.321208 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1faea2c2-ab81-4c63-a289-946c00ff7548 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:22.322663 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1faea2c2-ab81-4c63-a289-946c00ff7548 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:22.323347 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1faea2c2-ab81-4c63-a289-946c00ff7548 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:22.324231 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1faea2c2-ab81-4c63-a289-946c00ff7548 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:22.587330 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-4f3c1f91-c9ea-4e5d-a18c-4c996446661a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:06:22.590195 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-4f3c1f91-c9ea-4e5d-a18c-4c996446661a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:06:22.591800 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-4f3c1f91-c9ea-4e5d-a18c-4c996446661a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:06:22.592589 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-4f3c1f91-c9ea-4e5d-a18c-4c996446661a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:06:22.593193 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-4f3c1f91-c9ea-4e5d-a18c-4c996446661a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:06:22.615366 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f3c1f91-c9ea-4e5d-a18c-4c996446661a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:22.616855 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f3c1f91-c9ea-4e5d-a18c-4c996446661a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:22.617506 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f3c1f91-c9ea-4e5d-a18c-4c996446661a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:22.618293 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1faea2c2-ab81-4c63-a289-946c00ff7548 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:22.618931 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f3c1f91-c9ea-4e5d-a18c-4c996446661a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:22.619629 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f3c1f91-c9ea-4e5d-a18c-4c996446661a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:22.620907 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f3c1f91-c9ea-4e5d-a18c-4c996446661a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:22.632340 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1faea2c2-ab81-4c63-a289-946c00ff7548 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 200 len: 1511 microversion: 2.1 time: 0.326410 Sep 24 21:06:22.633622 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2185/4363] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:22 2022] GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 1511 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:06:22.664675 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a8a958ef-7149-4307-bdac-2426214fb6cd tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:22.665734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a8a958ef-7149-4307-bdac-2426214fb6cd tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:22.672460 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a8a958ef-7149-4307-bdac-2426214fb6cd tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:22.673247 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a8a958ef-7149-4307-bdac-2426214fb6cd tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:22.674022 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a8a958ef-7149-4307-bdac-2426214fb6cd tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:22.675070 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a8a958ef-7149-4307-bdac-2426214fb6cd tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:22.676673 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a8a958ef-7149-4307-bdac-2426214fb6cd tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:22.677451 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a8a958ef-7149-4307-bdac-2426214fb6cd tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:22.687809 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-4f3c1f91-c9ea-4e5d-a18c-4c996446661a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Getting quotas for project ede438e67af3496cae36fc89abc0aba3. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:06:22.700988 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-4f3c1f91-c9ea-4e5d-a18c-4c996446661a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Getting quotas for user 370b057b12c148cdbb673ba6c06bd6b4 and project ede438e67af3496cae36fc89abc0aba3. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:06:22.719684 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4f3c1f91-c9ea-4e5d-a18c-4c996446661a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:06:22.723194 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4f3c1f91-c9ea-4e5d-a18c-4c996446661a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 7caa7efc-79ef-47c3-b024-dbcb34877a65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:06:22.790844 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4f3c1f91-c9ea-4e5d-a18c-4c996446661a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.627129 Sep 24 21:06:22.791842 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2179/4364] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:06:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 1629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 24 21:06:22.809596 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-22c5a64c-50bc-481e-9278-18b37b5bef2d tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:22.810712 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-22c5a64c-50bc-481e-9278-18b37b5bef2d tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 7caa7efc-79ef-47c3-b024-dbcb34877a65] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:22.826212 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a8a958ef-7149-4307-bdac-2426214fb6cd tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:22.848969 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a8a958ef-7149-4307-bdac-2426214fb6cd tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:22.855717 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a8a958ef-7149-4307-bdac-2426214fb6cd tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:22.859065 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a8a958ef-7149-4307-bdac-2426214fb6cd tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1371 microversion: 2.47 time: 0.199147 Sep 24 21:06:22.859951 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2186/4365] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:06:22 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1371 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:06:22.925246 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-22c5a64c-50bc-481e-9278-18b37b5bef2d tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:22.936775 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-22c5a64c-50bc-481e-9278-18b37b5bef2d tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65" status: 200 len: 1240 microversion: 2.1 time: 0.137681 Sep 24 21:06:22.951848 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2180/4366] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:22 2022] GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65 => generated 1240 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:23.661673 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2443bfcb-ca6a-4703-b7d5-580302375a43 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:23.663344 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2443bfcb-ca6a-4703-b7d5-580302375a43 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:23.671583 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2443bfcb-ca6a-4703-b7d5-580302375a43 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:23.672389 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2443bfcb-ca6a-4703-b7d5-580302375a43 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:23.673242 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2443bfcb-ca6a-4703-b7d5-580302375a43 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:23.674577 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2443bfcb-ca6a-4703-b7d5-580302375a43 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:23.675908 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2443bfcb-ca6a-4703-b7d5-580302375a43 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:23.677503 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2443bfcb-ca6a-4703-b7d5-580302375a43 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:23.888399 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6b6bc16e-9492-46bb-ba52-cc7811c41ab4 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:23.889117 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6b6bc16e-9492-46bb-ba52-cc7811c41ab4 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:23.905641 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b6bc16e-9492-46bb-ba52-cc7811c41ab4 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:23.907540 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b6bc16e-9492-46bb-ba52-cc7811c41ab4 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:23.909110 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b6bc16e-9492-46bb-ba52-cc7811c41ab4 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:23.911157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b6bc16e-9492-46bb-ba52-cc7811c41ab4 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:23.912779 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b6bc16e-9492-46bb-ba52-cc7811c41ab4 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:23.913997 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b6bc16e-9492-46bb-ba52-cc7811c41ab4 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:23.948366 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2443bfcb-ca6a-4703-b7d5-580302375a43 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:23.957721 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2443bfcb-ca6a-4703-b7d5-580302375a43 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 200 len: 1511 microversion: 2.1 time: 0.302845 Sep 24 21:06:23.975254 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2187/4367] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:23 2022] GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 1511 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:23.991155 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9ec32be0-3635-463f-a118-070fc9c6fea9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:23.993472 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9ec32be0-3635-463f-a118-070fc9c6fea9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 7caa7efc-79ef-47c3-b024-dbcb34877a65] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:24.007410 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ec32be0-3635-463f-a118-070fc9c6fea9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:24.008535 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ec32be0-3635-463f-a118-070fc9c6fea9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:24.009217 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ec32be0-3635-463f-a118-070fc9c6fea9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:24.010329 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ec32be0-3635-463f-a118-070fc9c6fea9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:24.011251 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ec32be0-3635-463f-a118-070fc9c6fea9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:24.012098 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ec32be0-3635-463f-a118-070fc9c6fea9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:24.059579 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6b6bc16e-9492-46bb-ba52-cc7811c41ab4 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:24.071316 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6b6bc16e-9492-46bb-ba52-cc7811c41ab4 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:24.072802 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6b6bc16e-9492-46bb-ba52-cc7811c41ab4 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:24.074003 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6b6bc16e-9492-46bb-ba52-cc7811c41ab4 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1371 microversion: 2.47 time: 0.190797 Sep 24 21:06:24.091265 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2181/4368] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:06:23 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1371 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:06:24.187218 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9ec32be0-3635-463f-a118-070fc9c6fea9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:24.198358 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9ec32be0-3635-463f-a118-070fc9c6fea9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65" status: 200 len: 1236 microversion: 2.1 time: 0.222599 Sep 24 21:06:24.201003 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2188/4369] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:23 2022] GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65 => generated 1236 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:24.988399 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4fd2c1fb-ffa2-41e3-b01a-b5b0f10486e3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:24.989792 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4fd2c1fb-ffa2-41e3-b01a-b5b0f10486e3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:24.998540 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4fd2c1fb-ffa2-41e3-b01a-b5b0f10486e3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:25.005296 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4fd2c1fb-ffa2-41e3-b01a-b5b0f10486e3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:25.005753 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4fd2c1fb-ffa2-41e3-b01a-b5b0f10486e3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:25.006535 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4fd2c1fb-ffa2-41e3-b01a-b5b0f10486e3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:25.006996 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4fd2c1fb-ffa2-41e3-b01a-b5b0f10486e3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:25.007432 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4fd2c1fb-ffa2-41e3-b01a-b5b0f10486e3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:25.104455 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ae67d06b-9444-4ad2-8c14-ee9197485f8e tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:25.105727 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ae67d06b-9444-4ad2-8c14-ee9197485f8e tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:25.114755 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ae67d06b-9444-4ad2-8c14-ee9197485f8e tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:25.115257 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ae67d06b-9444-4ad2-8c14-ee9197485f8e tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:25.115736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ae67d06b-9444-4ad2-8c14-ee9197485f8e tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:25.116449 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ae67d06b-9444-4ad2-8c14-ee9197485f8e tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:25.117066 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ae67d06b-9444-4ad2-8c14-ee9197485f8e tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:25.117738 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ae67d06b-9444-4ad2-8c14-ee9197485f8e tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:25.214436 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ae67d06b-9444-4ad2-8c14-ee9197485f8e tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:25.220069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4fd2c1fb-ffa2-41e3-b01a-b5b0f10486e3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:25.227399 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ae67d06b-9444-4ad2-8c14-ee9197485f8e tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:25.232232 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ae67d06b-9444-4ad2-8c14-ee9197485f8e tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:25.232695 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4fd2c1fb-ffa2-41e3-b01a-b5b0f10486e3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 200 len: 1511 microversion: 2.1 time: 0.248458 Sep 24 21:06:25.233556 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2182/4370] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:24 2022] GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 1511 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:25.236052 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ae67d06b-9444-4ad2-8c14-ee9197485f8e tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1356 microversion: 2.47 time: 0.134993 Sep 24 21:06:25.236629 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2189/4371] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:06:25 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1356 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:06:25.239695 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3999fdc0-a88f-4f8f-8e9c-cbcd5f3db1e4 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:25.240334 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3999fdc0-a88f-4f8f-8e9c-cbcd5f3db1e4 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 7caa7efc-79ef-47c3-b024-dbcb34877a65] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:25.246766 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3999fdc0-a88f-4f8f-8e9c-cbcd5f3db1e4 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:25.247436 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3999fdc0-a88f-4f8f-8e9c-cbcd5f3db1e4 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:25.247943 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3999fdc0-a88f-4f8f-8e9c-cbcd5f3db1e4 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:25.248880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3999fdc0-a88f-4f8f-8e9c-cbcd5f3db1e4 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:25.249406 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3999fdc0-a88f-4f8f-8e9c-cbcd5f3db1e4 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:25.250094 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3999fdc0-a88f-4f8f-8e9c-cbcd5f3db1e4 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:25.263822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-85275419-25cf-4b49-bbae-e7da1800548c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:25.269435 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-85275419-25cf-4b49-bbae-e7da1800548c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:25.270813 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-85275419-25cf-4b49-bbae-e7da1800548c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Searching by: {'deleted': False, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c'} {{(pid=140517) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 21:06:25.277294 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85275419-25cf-4b49-bbae-e7da1800548c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:25.277866 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85275419-25cf-4b49-bbae-e7da1800548c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:25.278383 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85275419-25cf-4b49-bbae-e7da1800548c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:25.279289 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85275419-25cf-4b49-bbae-e7da1800548c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:25.279830 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85275419-25cf-4b49-bbae-e7da1800548c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:25.280513 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85275419-25cf-4b49-bbae-e7da1800548c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:25.361302 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3999fdc0-a88f-4f8f-8e9c-cbcd5f3db1e4 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:25.375300 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3999fdc0-a88f-4f8f-8e9c-cbcd5f3db1e4 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65" status: 200 len: 1298 microversion: 2.1 time: 0.140230 Sep 24 21:06:25.380072 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2183/4372] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:25 2022] GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65 => generated 1298 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:25.828726 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.multi_cell_list [None req-85275419-25cf-4b49-bbae-e7da1800548c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 21:06:25.938792 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-85275419-25cf-4b49-bbae-e7da1800548c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:25.947625 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85275419-25cf-4b49-bbae-e7da1800548c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:25.948534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85275419-25cf-4b49-bbae-e7da1800548c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:25.948669 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85275419-25cf-4b49-bbae-e7da1800548c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:25.965418 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-85275419-25cf-4b49-bbae-e7da1800548c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:25.966572 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-85275419-25cf-4b49-bbae-e7da1800548c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:26.021554 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-85275419-25cf-4b49-bbae-e7da1800548c tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.761838 Sep 24 21:06:26.022961 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2190/4373] 10.222.0.52 () {60 vars in 1187 bytes} [Sat Sep 24 21:06:25 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:06:26.073880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d214e9ac-7d39-445e-8d0f-bc301a14b180 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:26.073880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d214e9ac-7d39-445e-8d0f-bc301a14b180 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:26.086209 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d214e9ac-7d39-445e-8d0f-bc301a14b180 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:26.089005 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d214e9ac-7d39-445e-8d0f-bc301a14b180 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:26.090396 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d214e9ac-7d39-445e-8d0f-bc301a14b180 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:26.093702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d214e9ac-7d39-445e-8d0f-bc301a14b180 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:26.094780 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d214e9ac-7d39-445e-8d0f-bc301a14b180 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:26.095491 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d214e9ac-7d39-445e-8d0f-bc301a14b180 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:26.182261 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d214e9ac-7d39-445e-8d0f-bc301a14b180 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:06:26.261152 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-aefedb13-a246-473a-aaba-1cd18860b1ad tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:26.263142 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-aefedb13-a246-473a-aaba-1cd18860b1ad tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:26.284319 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aefedb13-a246-473a-aaba-1cd18860b1ad tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:26.286474 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aefedb13-a246-473a-aaba-1cd18860b1ad tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:26.289286 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aefedb13-a246-473a-aaba-1cd18860b1ad tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:26.290678 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aefedb13-a246-473a-aaba-1cd18860b1ad tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:26.292278 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aefedb13-a246-473a-aaba-1cd18860b1ad tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:26.294822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aefedb13-a246-473a-aaba-1cd18860b1ad tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:26.345213 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d214e9ac-7d39-445e-8d0f-bc301a14b180 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 204 len: 0 microversion: 2.47 time: 0.288493 Sep 24 21:06:26.350555 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2184/4374] 10.222.0.52 () {60 vars in 1280 bytes} [Sat Sep 24 21:06:26 2022] DELETE /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 24 21:06:26.367900 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bad94e87-a656-4b40-ab2b-9cebd307073b tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:26.377494 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-bad94e87-a656-4b40-ab2b-9cebd307073b tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:26.384844 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:06:26.395025 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bad94e87-a656-4b40-ab2b-9cebd307073b tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:26.396897 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bad94e87-a656-4b40-ab2b-9cebd307073b tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:26.397461 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bad94e87-a656-4b40-ab2b-9cebd307073b tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:26.398835 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bad94e87-a656-4b40-ab2b-9cebd307073b tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:26.400139 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bad94e87-a656-4b40-ab2b-9cebd307073b tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:26.400760 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bad94e87-a656-4b40-ab2b-9cebd307073b tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:26.613786 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-bad94e87-a656-4b40-ab2b-9cebd307073b tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:26.622342 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-bad94e87-a656-4b40-ab2b-9cebd307073b tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:26.624321 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-bad94e87-a656-4b40-ab2b-9cebd307073b tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:26.625972 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bad94e87-a656-4b40-ab2b-9cebd307073b tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1362 microversion: 2.47 time: 0.272346 Sep 24 21:06:26.626683 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2185/4375] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:06:26 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1362 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:06:26.633343 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-aa653a6e-f532-4828-8c35-d319951dd3de tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:26.634195 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-aa653a6e-f532-4828-8c35-d319951dd3de tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 7caa7efc-79ef-47c3-b024-dbcb34877a65] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:26.645759 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa653a6e-f532-4828-8c35-d319951dd3de tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:26.647025 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa653a6e-f532-4828-8c35-d319951dd3de tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:26.647703 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa653a6e-f532-4828-8c35-d319951dd3de tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:26.648661 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa653a6e-f532-4828-8c35-d319951dd3de tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:26.649274 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa653a6e-f532-4828-8c35-d319951dd3de tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:26.649988 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa653a6e-f532-4828-8c35-d319951dd3de tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:27.193072 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-aefedb13-a246-473a-aaba-1cd18860b1ad tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:27.201125 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-aefedb13-a246-473a-aaba-1cd18860b1ad tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 200 len: 1511 microversion: 2.1 time: 0.948125 Sep 24 21:06:27.213865 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2191/4376] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:26 2022] GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 1511 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:27.213865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-115bd6da-df95-4507-a9fb-c7811b5ed2cf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:27.213865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-115bd6da-df95-4507-a9fb-c7811b5ed2cf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:27.213865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-115bd6da-df95-4507-a9fb-c7811b5ed2cf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:27.214640 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-115bd6da-df95-4507-a9fb-c7811b5ed2cf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:27.214640 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-115bd6da-df95-4507-a9fb-c7811b5ed2cf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:27.215196 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-115bd6da-df95-4507-a9fb-c7811b5ed2cf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:27.215860 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-115bd6da-df95-4507-a9fb-c7811b5ed2cf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:27.216453 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-115bd6da-df95-4507-a9fb-c7811b5ed2cf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:27.684342 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-aa653a6e-f532-4828-8c35-d319951dd3de tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:27.701731 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-aa653a6e-f532-4828-8c35-d319951dd3de tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65" status: 200 len: 1366 microversion: 2.1 time: 1.065878 Sep 24 21:06:27.703597 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2186/4377] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:26 2022] GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65 => generated 1366 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:27.726260 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4c2b7183-5ef3-40b5-99a0-656aa24b4dd0 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:27.727393 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4c2b7183-5ef3-40b5-99a0-656aa24b4dd0 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:27.734140 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4c2b7183-5ef3-40b5-99a0-656aa24b4dd0 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:27.735030 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4c2b7183-5ef3-40b5-99a0-656aa24b4dd0 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:27.735868 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4c2b7183-5ef3-40b5-99a0-656aa24b4dd0 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:27.736866 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4c2b7183-5ef3-40b5-99a0-656aa24b4dd0 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:27.737602 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4c2b7183-5ef3-40b5-99a0-656aa24b4dd0 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:27.738276 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4c2b7183-5ef3-40b5-99a0-656aa24b4dd0 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:27.910146 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4c2b7183-5ef3-40b5-99a0-656aa24b4dd0 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:27.919943 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4c2b7183-5ef3-40b5-99a0-656aa24b4dd0 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:27.921807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4c2b7183-5ef3-40b5-99a0-656aa24b4dd0 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:27.923424 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4c2b7183-5ef3-40b5-99a0-656aa24b4dd0 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1362 microversion: 2.47 time: 0.206569 Sep 24 21:06:27.924103 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2187/4378] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:06:27 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1362 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:06:28.031542 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-115bd6da-df95-4507-a9fb-c7811b5ed2cf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:28.040016 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-115bd6da-df95-4507-a9fb-c7811b5ed2cf tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.836914 Sep 24 21:06:28.040874 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2192/4379] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:27 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:28.081593 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9a6c8618-6944-40b1-8496-965ed12dd389 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:28.082542 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9a6c8618-6944-40b1-8496-965ed12dd389 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:28.095188 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a6c8618-6944-40b1-8496-965ed12dd389 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:28.096062 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a6c8618-6944-40b1-8496-965ed12dd389 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:28.096785 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a6c8618-6944-40b1-8496-965ed12dd389 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:28.098128 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a6c8618-6944-40b1-8496-965ed12dd389 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:28.098801 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a6c8618-6944-40b1-8496-965ed12dd389 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:28.099483 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a6c8618-6944-40b1-8496-965ed12dd389 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:28.101128 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-ecad0f0d-9bd5-42cd-aec9-e4bce31a69aa req-03479ecc-8c50-43c5-9181-85e1f30e5def service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7caa7efc-79ef-47c3-b024-dbcb34877a65", "tag": "12ef86dc-2a21-4148-b45a-ed3026b5e112"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:06:28.154083 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-ecad0f0d-9bd5-42cd-aec9-e4bce31a69aa req-03479ecc-8c50-43c5-9181-85e1f30e5def service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:28.157069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-ecad0f0d-9bd5-42cd-aec9-e4bce31a69aa req-03479ecc-8c50-43c5-9181-85e1f30e5def service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:28.160276 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-ecad0f0d-9bd5-42cd-aec9-e4bce31a69aa req-03479ecc-8c50-43c5-9181-85e1f30e5def service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:28.197366 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-ecad0f0d-9bd5-42cd-aec9-e4bce31a69aa req-03479ecc-8c50-43c5-9181-85e1f30e5def service nova] Creating event network-changed:12ef86dc-2a21-4148-b45a-ed3026b5e112 for instance 7caa7efc-79ef-47c3-b024-dbcb34877a65 on nch2-master-1 Sep 24 21:06:28.209391 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-ecad0f0d-9bd5-42cd-aec9-e4bce31a69aa req-03479ecc-8c50-43c5-9181-85e1f30e5def service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132935 Sep 24 21:06:28.211175 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2188/4380] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:06:28.234126 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-082426f1-9347-4c9d-ac93-b6e91ba1b105 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:28.235124 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-082426f1-9347-4c9d-ac93-b6e91ba1b105 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:28.251593 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-082426f1-9347-4c9d-ac93-b6e91ba1b105 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:28.252325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-082426f1-9347-4c9d-ac93-b6e91ba1b105 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:28.252966 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-082426f1-9347-4c9d-ac93-b6e91ba1b105 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:28.257211 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-082426f1-9347-4c9d-ac93-b6e91ba1b105 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:28.260091 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-082426f1-9347-4c9d-ac93-b6e91ba1b105 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:28.260564 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-082426f1-9347-4c9d-ac93-b6e91ba1b105 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:28.265260 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:06:28.543252 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9a6c8618-6944-40b1-8496-965ed12dd389 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:28.558911 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9a6c8618-6944-40b1-8496-965ed12dd389 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.481353 Sep 24 21:06:28.579938 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2193/4381] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:28 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:28.593367 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-68786b18-ff40-423f-b64f-09750b0a4fc9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:28.594021 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-68786b18-ff40-423f-b64f-09750b0a4fc9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:28.617242 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68786b18-ff40-423f-b64f-09750b0a4fc9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:28.617759 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68786b18-ff40-423f-b64f-09750b0a4fc9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:28.618213 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68786b18-ff40-423f-b64f-09750b0a4fc9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:28.624283 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68786b18-ff40-423f-b64f-09750b0a4fc9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:28.630205 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68786b18-ff40-423f-b64f-09750b0a4fc9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:28.631007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68786b18-ff40-423f-b64f-09750b0a4fc9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:28.886099 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-082426f1-9347-4c9d-ac93-b6e91ba1b105 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:28.896359 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-082426f1-9347-4c9d-ac93-b6e91ba1b105 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 200 len: 1511 microversion: 2.1 time: 0.670352 Sep 24 21:06:28.911442 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2189/4382] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:28 2022] GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 1511 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:06:28.920299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3199ed3b-7d3f-46d8-a677-11ca0db33930 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:28.921206 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3199ed3b-7d3f-46d8-a677-11ca0db33930 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 7caa7efc-79ef-47c3-b024-dbcb34877a65] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:28.927806 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3199ed3b-7d3f-46d8-a677-11ca0db33930 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:28.928495 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3199ed3b-7d3f-46d8-a677-11ca0db33930 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:28.929132 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3199ed3b-7d3f-46d8-a677-11ca0db33930 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:28.930174 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3199ed3b-7d3f-46d8-a677-11ca0db33930 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:28.930847 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3199ed3b-7d3f-46d8-a677-11ca0db33930 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:28.931456 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3199ed3b-7d3f-46d8-a677-11ca0db33930 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:29.118880 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-68786b18-ff40-423f-b64f-09750b0a4fc9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:29.142106 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-68786b18-ff40-423f-b64f-09750b0a4fc9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.552580 Sep 24 21:06:29.143365 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2194/4383] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:28 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:29.151105 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-eb85b744-bdb1-445e-a612-29aa0f46e1cd tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:29.154937 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-eb85b744-bdb1-445e-a612-29aa0f46e1cd tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:29.166946 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb85b744-bdb1-445e-a612-29aa0f46e1cd tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:29.167761 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb85b744-bdb1-445e-a612-29aa0f46e1cd tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:29.168400 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb85b744-bdb1-445e-a612-29aa0f46e1cd tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:29.169304 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb85b744-bdb1-445e-a612-29aa0f46e1cd tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:29.169961 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb85b744-bdb1-445e-a612-29aa0f46e1cd tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:29.170595 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb85b744-bdb1-445e-a612-29aa0f46e1cd tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:29.188261 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:06:29.304997 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-eb85b744-bdb1-445e-a612-29aa0f46e1cd tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:29.317480 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-eb85b744-bdb1-445e-a612-29aa0f46e1cd tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:29.324258 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-eb85b744-bdb1-445e-a612-29aa0f46e1cd tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:29.325947 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-eb85b744-bdb1-445e-a612-29aa0f46e1cd tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 200 len: 1362 microversion: 2.47 time: 0.180317 Sep 24 21:06:29.326983 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2195/4384] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:06:29 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:06:29.357321 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b90a830d-6d9d-441e-9bd4-0ba57cc12dc5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:29.358201 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b90a830d-6d9d-441e-9bd4-0ba57cc12dc5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:29.375902 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b90a830d-6d9d-441e-9bd4-0ba57cc12dc5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:29.380475 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b90a830d-6d9d-441e-9bd4-0ba57cc12dc5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:29.381196 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b90a830d-6d9d-441e-9bd4-0ba57cc12dc5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:29.383674 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b90a830d-6d9d-441e-9bd4-0ba57cc12dc5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:29.384369 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b90a830d-6d9d-441e-9bd4-0ba57cc12dc5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:29.385912 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b90a830d-6d9d-441e-9bd4-0ba57cc12dc5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:29.461103 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3199ed3b-7d3f-46d8-a677-11ca0db33930 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:29.478435 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3199ed3b-7d3f-46d8-a677-11ca0db33930 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65" status: 200 len: 1366 microversion: 2.1 time: 0.565482 Sep 24 21:06:29.496993 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2190/4385] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:28 2022] GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65 => generated 1366 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:29.775112 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b90a830d-6d9d-441e-9bd4-0ba57cc12dc5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:29.795981 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b90a830d-6d9d-441e-9bd4-0ba57cc12dc5 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.467269 Sep 24 21:06:29.796591 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2196/4386] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:29 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:29.927182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f7300ff5-466e-46b7-8f13-003a8e211466 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:29.927965 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f7300ff5-466e-46b7-8f13-003a8e211466 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:29.951397 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f7300ff5-466e-46b7-8f13-003a8e211466 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:29.951930 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f7300ff5-466e-46b7-8f13-003a8e211466 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:29.952384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f7300ff5-466e-46b7-8f13-003a8e211466 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:29.959332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f7300ff5-466e-46b7-8f13-003a8e211466 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:29.959921 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f7300ff5-466e-46b7-8f13-003a8e211466 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:29.960377 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f7300ff5-466e-46b7-8f13-003a8e211466 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:29.964537 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b33de1fd-fda1-47f4-834f-2539084cec46 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1034869616", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "75e36a3c-3095-402d-baea-50bb8c960b77"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:06:30.058900 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-b33de1fd-fda1-47f4-834f-2539084cec46 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] validate_networks() for [('75e36a3c-3095-402d-baea-50bb8c960b77', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:06:30.482180 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f7300ff5-466e-46b7-8f13-003a8e211466 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:30.491309 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f7300ff5-466e-46b7-8f13-003a8e211466 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 200 len: 1511 microversion: 2.1 time: 0.569032 Sep 24 21:06:30.492505 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2191/4387] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:29 2022] GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 1511 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:30.513319 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-383955d4-5536-4b6c-9890-0b92d6e747bd tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:30.513957 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-383955d4-5536-4b6c-9890-0b92d6e747bd tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: c911c9c8-18e9-49b6-8302-292423e1708a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:30.525912 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-383955d4-5536-4b6c-9890-0b92d6e747bd tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:30.526446 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-383955d4-5536-4b6c-9890-0b92d6e747bd tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:30.527075 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-383955d4-5536-4b6c-9890-0b92d6e747bd tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:30.536017 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-383955d4-5536-4b6c-9890-0b92d6e747bd tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:30.536542 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-383955d4-5536-4b6c-9890-0b92d6e747bd tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:30.537002 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-383955d4-5536-4b6c-9890-0b92d6e747bd tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:30.574837 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-383955d4-5536-4b6c-9890-0b92d6e747bd tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] HTTP exception thrown: Instance c911c9c8-18e9-49b6-8302-292423e1708a could not be found. Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-383955d4-5536-4b6c-9890-0b92d6e747bd tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Request method failure captured: Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a HTTP/1.1 Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3Ec2v482I4eLHAhrWUIq4K8l3IPkveMuERZgk12eoCtGZLxIteGWrTflFQnfIX4u1g0dU7xT0gAFRspNzqWIKttbk_7sryZr_qVbSx5k4s_OfCNJp_kDwJI8UXtgGKKiUQdnQTsDnsbx5GKAjgfsBYNZ202rAsvZPc0zV7XRcA5Hgk Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: X-Openstack-Nova-Api-Version: 2.47 Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: b9bb8e91bd434e1e91c19ba084855d7c Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServerShowV247Test-869160883 Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b9bb8e91bd434e1e91c19ba084855d7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b9bb8e91bd434e1e91c19ba084855d7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b9bb8e91bd434e1e91c19ba084855d7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b9bb8e91bd434e1e91c19ba084855d7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServerShowV247Test-869160883 Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: b9bb8e91bd434e1e91c19ba084855d7c Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServerShowV247Test-869160883 Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServerShowV247Test-869160883-project Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 6910dfaa89b04d3b9316992d78e9424c Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServerShowV247Test-869160883-project Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance c911c9c8-18e9-49b6-8302-292423e1708a could not be found. Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'c911c9c8-18e9-49b6-8302-292423e1708a'} Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c911c9c8-18e9-49b6-8302-292423e1708a could not be found. Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c911c9c8-18e9-49b6-8302-292423e1708a could not be found. Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:30.576559 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:30.583095 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:30.583095 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:30.583095 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:30.583095 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:06:30.583095 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:06:30.583095 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c911c9c8-18e9-49b6-8302-292423e1708a could not be found. Sep 24 21:06:30.583095 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:30.583095 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-383955d4-5536-4b6c-9890-0b92d6e747bd tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Returning 404 to user: Instance c911c9c8-18e9-49b6-8302-292423e1708a could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:06:30.583095 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-383955d4-5536-4b6c-9890-0b92d6e747bd tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a" status: 404 len: 111 microversion: 2.47 time: 0.086688 Sep 24 21:06:30.583095 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2192/4388] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:06:30 2022] GET /compute/v2.1/servers/c911c9c8-18e9-49b6-8302-292423e1708a => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:06:30.593974 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3cc0408b-1d03-4a78-b57c-bb7838d92f6a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:30.594691 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3cc0408b-1d03-4a78-b57c-bb7838d92f6a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 7caa7efc-79ef-47c3-b024-dbcb34877a65] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:30.612082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3cc0408b-1d03-4a78-b57c-bb7838d92f6a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:30.612633 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3cc0408b-1d03-4a78-b57c-bb7838d92f6a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:30.613084 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3cc0408b-1d03-4a78-b57c-bb7838d92f6a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:30.614380 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3cc0408b-1d03-4a78-b57c-bb7838d92f6a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:30.614380 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3cc0408b-1d03-4a78-b57c-bb7838d92f6a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:30.614724 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3cc0408b-1d03-4a78-b57c-bb7838d92f6a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:31.117032 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3cc0408b-1d03-4a78-b57c-bb7838d92f6a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:31.130892 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3cc0408b-1d03-4a78-b57c-bb7838d92f6a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65" status: 200 len: 1366 microversion: 2.1 time: 0.542314 Sep 24 21:06:31.132276 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2193/4389] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:30 2022] GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65 => generated 1366 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:31.137885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-65529e33-f713-438c-b85f-0bd0b26612b8 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:31.139528 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-65529e33-f713-438c-b85f-0bd0b26612b8 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: 2a528bdf-0173-49f6-ad84-55b3f67f0c77] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:31.147686 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65529e33-f713-438c-b85f-0bd0b26612b8 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:31.148463 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65529e33-f713-438c-b85f-0bd0b26612b8 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:31.149137 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65529e33-f713-438c-b85f-0bd0b26612b8 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:31.150106 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65529e33-f713-438c-b85f-0bd0b26612b8 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:31.151107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65529e33-f713-438c-b85f-0bd0b26612b8 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:31.151984 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65529e33-f713-438c-b85f-0bd0b26612b8 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:31.187545 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-65529e33-f713-438c-b85f-0bd0b26612b8 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: 2a528bdf-0173-49f6-ad84-55b3f67f0c77] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:06:31.308179 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-65529e33-f713-438c-b85f-0bd0b26612b8 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2a528bdf-0173-49f6-ad84-55b3f67f0c77" status: 204 len: 0 microversion: 2.47 time: 0.174068 Sep 24 21:06:31.308783 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2194/4390] 10.222.0.52 () {60 vars in 1280 bytes} [Sat Sep 24 21:06:31 2022] DELETE /compute/v2.1/servers/2a528bdf-0173-49f6-ad84-55b3f67f0c77 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 24 21:06:31.321454 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d0aff17f-8e80-430d-8575-10e9320957d9 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:31.322546 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d0aff17f-8e80-430d-8575-10e9320957d9 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: 2a528bdf-0173-49f6-ad84-55b3f67f0c77] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:31.334786 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0aff17f-8e80-430d-8575-10e9320957d9 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:31.335377 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0aff17f-8e80-430d-8575-10e9320957d9 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:31.335881 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0aff17f-8e80-430d-8575-10e9320957d9 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:31.337019 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0aff17f-8e80-430d-8575-10e9320957d9 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:31.338031 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0aff17f-8e80-430d-8575-10e9320957d9 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:31.338718 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0aff17f-8e80-430d-8575-10e9320957d9 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:31.872649 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d0aff17f-8e80-430d-8575-10e9320957d9 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:31.888272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d0aff17f-8e80-430d-8575-10e9320957d9 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:31.889867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d0aff17f-8e80-430d-8575-10e9320957d9 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:31.893093 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d0aff17f-8e80-430d-8575-10e9320957d9 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/2a528bdf-0173-49f6-ad84-55b3f67f0c77" status: 200 len: 1362 microversion: 2.47 time: 0.579464 Sep 24 21:06:31.894438 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2195/4391] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:06:31 2022] GET /compute/v2.1/servers/2a528bdf-0173-49f6-ad84-55b3f67f0c77 => generated 1362 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:06:31.900160 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-297ab18b-d041-49f1-a9f8-95263c3bef90 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:31.900788 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-297ab18b-d041-49f1-a9f8-95263c3bef90 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:31.911027 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-297ab18b-d041-49f1-a9f8-95263c3bef90 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:31.911875 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-297ab18b-d041-49f1-a9f8-95263c3bef90 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:31.913040 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-297ab18b-d041-49f1-a9f8-95263c3bef90 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:31.914016 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-297ab18b-d041-49f1-a9f8-95263c3bef90 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:31.915363 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-297ab18b-d041-49f1-a9f8-95263c3bef90 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:31.917400 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-297ab18b-d041-49f1-a9f8-95263c3bef90 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:32.006489 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-b33de1fd-fda1-47f4-834f-2539084cec46 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:06:32.007821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-b33de1fd-fda1-47f4-834f-2539084cec46 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:06:32.008647 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-b33de1fd-fda1-47f4-834f-2539084cec46 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:06:32.009302 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-b33de1fd-fda1-47f4-834f-2539084cec46 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:06:32.009734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-b33de1fd-fda1-47f4-834f-2539084cec46 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:06:32.023422 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b33de1fd-fda1-47f4-834f-2539084cec46 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:32.024671 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b33de1fd-fda1-47f4-834f-2539084cec46 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:32.026608 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b33de1fd-fda1-47f4-834f-2539084cec46 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:32.027581 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b33de1fd-fda1-47f4-834f-2539084cec46 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:32.028519 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b33de1fd-fda1-47f4-834f-2539084cec46 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:32.029157 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b33de1fd-fda1-47f4-834f-2539084cec46 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:32.059318 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-b33de1fd-fda1-47f4-834f-2539084cec46 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Getting quotas for project c1e5d6f3d41e4aa49e630f8c7ac87ded. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:06:32.066850 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:06:32.069663 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-b33de1fd-fda1-47f4-834f-2539084cec46 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Getting quotas for user 6493da825aa24f43bdf8f0835a16e3bb and project c1e5d6f3d41e4aa49e630f8c7ac87ded. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:06:32.089902 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b33de1fd-fda1-47f4-834f-2539084cec46 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:06:32.092754 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b33de1fd-fda1-47f4-834f-2539084cec46 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 51c91704-c6eb-47bf-b3d1-9899df6ce119] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:06:32.165121 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b33de1fd-fda1-47f4-834f-2539084cec46 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.209300 Sep 24 21:06:32.173615 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2197/4392] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:06:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:06:32.185732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e68f581f-fb34-431e-8c37-00736ce80fa1 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:32.186645 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e68f581f-fb34-431e-8c37-00736ce80fa1 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 7caa7efc-79ef-47c3-b024-dbcb34877a65] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:32.213152 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e68f581f-fb34-431e-8c37-00736ce80fa1 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:32.213661 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e68f581f-fb34-431e-8c37-00736ce80fa1 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:32.214118 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e68f581f-fb34-431e-8c37-00736ce80fa1 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:32.214870 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e68f581f-fb34-431e-8c37-00736ce80fa1 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:32.233147 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e68f581f-fb34-431e-8c37-00736ce80fa1 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:32.233622 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e68f581f-fb34-431e-8c37-00736ce80fa1 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:32.643085 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=16 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:06:32.790888 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-297ab18b-d041-49f1-a9f8-95263c3bef90 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:32.801890 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-297ab18b-d041-49f1-a9f8-95263c3bef90 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 200 len: 1511 microversion: 2.1 time: 0.905113 Sep 24 21:06:32.802700 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2196/4393] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:31 2022] GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 1511 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:32.807658 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fc08b13d-f594-4112-b301-c3bef889b673 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:32.808546 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fc08b13d-f594-4112-b301-c3bef889b673 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 51c91704-c6eb-47bf-b3d1-9899df6ce119] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:32.906748 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e68f581f-fb34-431e-8c37-00736ce80fa1 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:32.917801 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fc08b13d-f594-4112-b301-c3bef889b673 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:32.921742 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e68f581f-fb34-431e-8c37-00736ce80fa1 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65" status: 200 len: 1366 microversion: 2.1 time: 0.744473 Sep 24 21:06:32.922657 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2198/4394] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:32 2022] GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65 => generated 1366 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:32.928142 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fc08b13d-f594-4112-b301-c3bef889b673 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119" status: 200 len: 1215 microversion: 2.1 time: 0.123972 Sep 24 21:06:32.929116 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2197/4395] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:32 2022] GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119 => generated 1215 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:32.942902 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9505581a-14f2-4437-9c11-1d8374a27df4 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:32.943797 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9505581a-14f2-4437-9c11-1d8374a27df4 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: 2a528bdf-0173-49f6-ad84-55b3f67f0c77] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:32.950337 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9505581a-14f2-4437-9c11-1d8374a27df4 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:32.951093 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9505581a-14f2-4437-9c11-1d8374a27df4 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:32.951541 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9505581a-14f2-4437-9c11-1d8374a27df4 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:32.952262 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9505581a-14f2-4437-9c11-1d8374a27df4 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:32.952728 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9505581a-14f2-4437-9c11-1d8374a27df4 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:32.953401 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9505581a-14f2-4437-9c11-1d8374a27df4 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:33.054253 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9505581a-14f2-4437-9c11-1d8374a27df4 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:33.074736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9505581a-14f2-4437-9c11-1d8374a27df4 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:33.078673 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9505581a-14f2-4437-9c11-1d8374a27df4 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:33.084127 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9505581a-14f2-4437-9c11-1d8374a27df4 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/2a528bdf-0173-49f6-ad84-55b3f67f0c77" status: 200 len: 1362 microversion: 2.47 time: 0.158531 Sep 24 21:06:33.159694 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2199/4396] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:06:32 2022] GET /compute/v2.1/servers/2a528bdf-0173-49f6-ad84-55b3f67f0c77 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:06:33.835240 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f1445423-4e61-4128-9968-52b5b18bb6f7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:33.836551 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f1445423-4e61-4128-9968-52b5b18bb6f7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:33.850310 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1445423-4e61-4128-9968-52b5b18bb6f7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:33.853003 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1445423-4e61-4128-9968-52b5b18bb6f7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:33.853784 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1445423-4e61-4128-9968-52b5b18bb6f7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:33.854776 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1445423-4e61-4128-9968-52b5b18bb6f7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:33.855450 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1445423-4e61-4128-9968-52b5b18bb6f7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:33.855997 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1445423-4e61-4128-9968-52b5b18bb6f7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:33.946490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e71b9f38-ca6d-4b6f-ac65-4198a1805f5a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:33.947463 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e71b9f38-ca6d-4b6f-ac65-4198a1805f5a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 7caa7efc-79ef-47c3-b024-dbcb34877a65] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:33.963306 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e71b9f38-ca6d-4b6f-ac65-4198a1805f5a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:33.964012 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e71b9f38-ca6d-4b6f-ac65-4198a1805f5a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:33.968205 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e71b9f38-ca6d-4b6f-ac65-4198a1805f5a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:33.969163 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e71b9f38-ca6d-4b6f-ac65-4198a1805f5a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:33.969640 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e71b9f38-ca6d-4b6f-ac65-4198a1805f5a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:33.971056 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e71b9f38-ca6d-4b6f-ac65-4198a1805f5a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:34.380341 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f1445423-4e61-4128-9968-52b5b18bb6f7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:34.388308 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f1445423-4e61-4128-9968-52b5b18bb6f7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 200 len: 1511 microversion: 2.1 time: 0.564518 Sep 24 21:06:34.398910 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2198/4397] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:33 2022] GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 1511 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:34.411427 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-72e11f11-ade1-4f7e-a1fd-5e61d6252b05 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:34.412280 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-72e11f11-ade1-4f7e-a1fd-5e61d6252b05 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 51c91704-c6eb-47bf-b3d1-9899df6ce119] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:34.418834 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72e11f11-ade1-4f7e-a1fd-5e61d6252b05 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:34.419539 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72e11f11-ade1-4f7e-a1fd-5e61d6252b05 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:34.420116 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72e11f11-ade1-4f7e-a1fd-5e61d6252b05 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:34.420980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72e11f11-ade1-4f7e-a1fd-5e61d6252b05 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:34.421605 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72e11f11-ade1-4f7e-a1fd-5e61d6252b05 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:34.422177 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-72e11f11-ade1-4f7e-a1fd-5e61d6252b05 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:34.588329 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-72e11f11-ade1-4f7e-a1fd-5e61d6252b05 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:34.605037 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-72e11f11-ade1-4f7e-a1fd-5e61d6252b05 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119" status: 200 len: 1267 microversion: 2.1 time: 0.204687 Sep 24 21:06:34.605641 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2199/4398] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:34 2022] GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119 => generated 1267 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:34.610821 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d8dace39-8062-4efa-b973-fa27a986598a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:34.611779 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d8dace39-8062-4efa-b973-fa27a986598a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: 2a528bdf-0173-49f6-ad84-55b3f67f0c77] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:34.618432 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d8dace39-8062-4efa-b973-fa27a986598a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:34.619161 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d8dace39-8062-4efa-b973-fa27a986598a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:34.619733 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d8dace39-8062-4efa-b973-fa27a986598a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:34.620634 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d8dace39-8062-4efa-b973-fa27a986598a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:34.621542 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d8dace39-8062-4efa-b973-fa27a986598a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:34.622327 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d8dace39-8062-4efa-b973-fa27a986598a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:34.683113 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d8dace39-8062-4efa-b973-fa27a986598a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:34.683943 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d8dace39-8062-4efa-b973-fa27a986598a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:34.684631 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d8dace39-8062-4efa-b973-fa27a986598a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:34.685384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-d8dace39-8062-4efa-b973-fa27a986598a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lazy-loading 'fault' on Instance uuid 2a528bdf-0173-49f6-ad84-55b3f67f0c77 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:06:35.086165 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e71b9f38-ca6d-4b6f-ac65-4198a1805f5a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:35.096363 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e71b9f38-ca6d-4b6f-ac65-4198a1805f5a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65" status: 200 len: 1366 microversion: 2.1 time: 1.154178 Sep 24 21:06:35.099596 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2200/4399] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:33 2022] GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65 => generated 1366 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:06:35.110527 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-6f6559d6-2cce-4bf8-b093-0a43bfacd5c7 req-af1e57d3-d22c-4800-af2e-4d6f9e5d79ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7caa7efc-79ef-47c3-b024-dbcb34877a65", "name": "network-vif-plugged", "status": "completed", "tag": "12ef86dc-2a21-4148-b45a-ed3026b5e112"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:06:35.129425 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6f6559d6-2cce-4bf8-b093-0a43bfacd5c7 req-af1e57d3-d22c-4800-af2e-4d6f9e5d79ae service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:35.130424 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6f6559d6-2cce-4bf8-b093-0a43bfacd5c7 req-af1e57d3-d22c-4800-af2e-4d6f9e5d79ae service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:35.131221 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6f6559d6-2cce-4bf8-b093-0a43bfacd5c7 req-af1e57d3-d22c-4800-af2e-4d6f9e5d79ae service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:35.139866 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d8dace39-8062-4efa-b973-fa27a986598a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:35.150688 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d8dace39-8062-4efa-b973-fa27a986598a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:35.152478 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d8dace39-8062-4efa-b973-fa27a986598a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6910dfaa89b04d3b9316992d78e9424c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bb8e91bd434e1e91c19ba084855d7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:35.154076 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d8dace39-8062-4efa-b973-fa27a986598a tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/2a528bdf-0173-49f6-ad84-55b3f67f0c77" status: 200 len: 1367 microversion: 2.47 time: 0.547425 Sep 24 21:06:35.157896 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-6f6559d6-2cce-4bf8-b093-0a43bfacd5c7 req-af1e57d3-d22c-4800-af2e-4d6f9e5d79ae service nova] Creating event network-vif-plugged:12ef86dc-2a21-4148-b45a-ed3026b5e112 for instance 7caa7efc-79ef-47c3-b024-dbcb34877a65 on nch2-master-1 Sep 24 21:06:35.169006 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2200/4400] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:06:34 2022] GET /compute/v2.1/servers/2a528bdf-0173-49f6-ad84-55b3f67f0c77 => generated 1367 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:06:35.171998 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-6f6559d6-2cce-4bf8-b093-0a43bfacd5c7 req-af1e57d3-d22c-4800-af2e-4d6f9e5d79ae service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069560 Sep 24 21:06:35.173267 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2201/4401] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:06:35.417220 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cea73cef-28e6-4b4e-afba-952a91c596bb tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:35.418937 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cea73cef-28e6-4b4e-afba-952a91c596bb tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:35.429466 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cea73cef-28e6-4b4e-afba-952a91c596bb tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:35.430366 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cea73cef-28e6-4b4e-afba-952a91c596bb tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:35.430989 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cea73cef-28e6-4b4e-afba-952a91c596bb tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:35.432006 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cea73cef-28e6-4b4e-afba-952a91c596bb tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:35.432694 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cea73cef-28e6-4b4e-afba-952a91c596bb tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:35.433360 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cea73cef-28e6-4b4e-afba-952a91c596bb tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:35.633590 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-64ac5a62-3913-4580-81ed-049f7b064750 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:35.634599 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-64ac5a62-3913-4580-81ed-049f7b064750 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 51c91704-c6eb-47bf-b3d1-9899df6ce119] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:35.642305 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-64ac5a62-3913-4580-81ed-049f7b064750 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:35.643535 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-64ac5a62-3913-4580-81ed-049f7b064750 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:35.646617 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-64ac5a62-3913-4580-81ed-049f7b064750 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:35.647541 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-64ac5a62-3913-4580-81ed-049f7b064750 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:35.648161 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-64ac5a62-3913-4580-81ed-049f7b064750 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:35.648742 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-64ac5a62-3913-4580-81ed-049f7b064750 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:35.862014 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-64ac5a62-3913-4580-81ed-049f7b064750 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:35.873469 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-64ac5a62-3913-4580-81ed-049f7b064750 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119" status: 200 len: 1273 microversion: 2.1 time: 0.245266 Sep 24 21:06:35.877003 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2202/4402] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:35 2022] GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119 => generated 1273 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:06:35.989688 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cea73cef-28e6-4b4e-afba-952a91c596bb tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:35.997772 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cea73cef-28e6-4b4e-afba-952a91c596bb tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 200 len: 1511 microversion: 2.1 time: 0.584994 Sep 24 21:06:35.998282 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2201/4403] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:35 2022] GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 1511 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:36.130855 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6748a509-2ea1-46cb-ac7e-c5a4b9f0020d tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:36.131596 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6748a509-2ea1-46cb-ac7e-c5a4b9f0020d tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 7caa7efc-79ef-47c3-b024-dbcb34877a65] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:36.149607 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6748a509-2ea1-46cb-ac7e-c5a4b9f0020d tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:36.151577 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6748a509-2ea1-46cb-ac7e-c5a4b9f0020d tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:36.153799 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6748a509-2ea1-46cb-ac7e-c5a4b9f0020d tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:36.159597 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6748a509-2ea1-46cb-ac7e-c5a4b9f0020d tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:36.164486 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6748a509-2ea1-46cb-ac7e-c5a4b9f0020d tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:36.165745 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6748a509-2ea1-46cb-ac7e-c5a4b9f0020d tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:36.192541 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-45dd7718-114c-42c2-9b80-5722d3d1a3d9 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:36.193447 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-45dd7718-114c-42c2-9b80-5722d3d1a3d9 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] [instance: 2a528bdf-0173-49f6-ad84-55b3f67f0c77] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:36.209334 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45dd7718-114c-42c2-9b80-5722d3d1a3d9 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:36.227391 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45dd7718-114c-42c2-9b80-5722d3d1a3d9 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:36.228884 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45dd7718-114c-42c2-9b80-5722d3d1a3d9 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:36.231281 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45dd7718-114c-42c2-9b80-5722d3d1a3d9 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:36.234153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45dd7718-114c-42c2-9b80-5722d3d1a3d9 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:36.236681 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45dd7718-114c-42c2-9b80-5722d3d1a3d9 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:36.285439 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-45dd7718-114c-42c2-9b80-5722d3d1a3d9 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] HTTP exception thrown: Instance 2a528bdf-0173-49f6-ad84-55b3f67f0c77 could not be found. Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-45dd7718-114c-42c2-9b80-5722d3d1a3d9 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Request method failure captured: Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/2a528bdf-0173-49f6-ad84-55b3f67f0c77 HTTP/1.1 Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3Ec2v482I4eLHAhrWUIq4K8l3IPkveMuERZgk12eoCtGZLxIteGWrTflFQnfIX4u1g0dU7xT0gAFRspNzqWIKttbk_7sryZr_qVbSx5k4s_OfCNJp_kDwJI8UXtgGKKiUQdnQTsDnsbx5GKAjgfsBYNZ202rAsvZPc0zV7XRcA5Hgk Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: X-Openstack-Nova-Api-Version: 2.47 Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: b9bb8e91bd434e1e91c19ba084855d7c Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServerShowV247Test-869160883 Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b9bb8e91bd434e1e91c19ba084855d7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b9bb8e91bd434e1e91c19ba084855d7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b9bb8e91bd434e1e91c19ba084855d7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b9bb8e91bd434e1e91c19ba084855d7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServerShowV247Test-869160883 Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: b9bb8e91bd434e1e91c19ba084855d7c Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServerShowV247Test-869160883 Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServerShowV247Test-869160883-project Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 6910dfaa89b04d3b9316992d78e9424c Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServerShowV247Test-869160883-project Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 2a528bdf-0173-49f6-ad84-55b3f67f0c77 could not be found. Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '2a528bdf-0173-49f6-ad84-55b3f67f0c77'} Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a528bdf-0173-49f6-ad84-55b3f67f0c77 could not be found. Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a528bdf-0173-49f6-ad84-55b3f67f0c77 could not be found. Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:36.287856 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:36.291468 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:36.291468 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:36.291468 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:36.291468 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:06:36.291468 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:06:36.291468 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a528bdf-0173-49f6-ad84-55b3f67f0c77 could not be found. Sep 24 21:06:36.291468 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:36.292929 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-45dd7718-114c-42c2-9b80-5722d3d1a3d9 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] Returning 404 to user: Instance 2a528bdf-0173-49f6-ad84-55b3f67f0c77 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:06:36.308621 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-45dd7718-114c-42c2-9b80-5722d3d1a3d9 tempest-ServerShowV247Test-869160883 tempest-ServerShowV247Test-869160883-project] 10.222.0.52 "GET /compute/v2.1/servers/2a528bdf-0173-49f6-ad84-55b3f67f0c77" status: 404 len: 111 microversion: 2.47 time: 0.127026 Sep 24 21:06:36.312547 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2202/4404] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:06:36 2022] GET /compute/v2.1/servers/2a528bdf-0173-49f6-ad84-55b3f67f0c77 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 24 21:06:36.901458 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4ab30e41-74a5-42e8-8167-19d662a9dbf1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:36.902674 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4ab30e41-74a5-42e8-8167-19d662a9dbf1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 51c91704-c6eb-47bf-b3d1-9899df6ce119] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:36.912145 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ab30e41-74a5-42e8-8167-19d662a9dbf1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:36.912991 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ab30e41-74a5-42e8-8167-19d662a9dbf1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:36.913607 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ab30e41-74a5-42e8-8167-19d662a9dbf1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:36.915361 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ab30e41-74a5-42e8-8167-19d662a9dbf1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:36.917209 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ab30e41-74a5-42e8-8167-19d662a9dbf1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:36.917807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ab30e41-74a5-42e8-8167-19d662a9dbf1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:37.127447 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6748a509-2ea1-46cb-ac7e-c5a4b9f0020d tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:37.140078 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6748a509-2ea1-46cb-ac7e-c5a4b9f0020d tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65" status: 200 len: 1366 microversion: 2.1 time: 1.017048 Sep 24 21:06:37.142841 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2203/4405] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:36 2022] GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65 => generated 1366 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:37.150708 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-81b1182a-20de-48f8-a453-c766acb2b002 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:37.151688 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-81b1182a-20de-48f8-a453-c766acb2b002 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:37.168917 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-81b1182a-20de-48f8-a453-c766acb2b002 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:37.170980 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-81b1182a-20de-48f8-a453-c766acb2b002 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:37.175545 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-81b1182a-20de-48f8-a453-c766acb2b002 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:37.176820 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-81b1182a-20de-48f8-a453-c766acb2b002 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:37.178536 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-81b1182a-20de-48f8-a453-c766acb2b002 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:37.180808 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-81b1182a-20de-48f8-a453-c766acb2b002 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:37.183387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4ab30e41-74a5-42e8-8167-19d662a9dbf1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:37.199367 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4ab30e41-74a5-42e8-8167-19d662a9dbf1 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119" status: 200 len: 1273 microversion: 2.1 time: 0.302125 Sep 24 21:06:37.200675 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2203/4406] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:36 2022] GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119 => generated 1273 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:06:37.656171 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-81b1182a-20de-48f8-a453-c766acb2b002 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:37.665364 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-81b1182a-20de-48f8-a453-c766acb2b002 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 200 len: 1511 microversion: 2.1 time: 0.520589 Sep 24 21:06:37.666960 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2204/4407] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:37 2022] GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 1511 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:38.168692 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-edd9520a-c0bf-4dc4-b7e7-0c3d54ef6a74 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:38.169681 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-edd9520a-c0bf-4dc4-b7e7-0c3d54ef6a74 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 7caa7efc-79ef-47c3-b024-dbcb34877a65] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:38.211509 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-edd9520a-c0bf-4dc4-b7e7-0c3d54ef6a74 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:38.215238 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-edd9520a-c0bf-4dc4-b7e7-0c3d54ef6a74 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:38.231957 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a86094ca-28e4-4ab0-a910-79f7a5cc5c08 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:38.233383 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a86094ca-28e4-4ab0-a910-79f7a5cc5c08 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 51c91704-c6eb-47bf-b3d1-9899df6ce119] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:38.241122 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-edd9520a-c0bf-4dc4-b7e7-0c3d54ef6a74 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:38.246009 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-edd9520a-c0bf-4dc4-b7e7-0c3d54ef6a74 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:38.248282 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-edd9520a-c0bf-4dc4-b7e7-0c3d54ef6a74 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:38.249047 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-edd9520a-c0bf-4dc4-b7e7-0c3d54ef6a74 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:38.260419 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a86094ca-28e4-4ab0-a910-79f7a5cc5c08 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:38.276798 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a86094ca-28e4-4ab0-a910-79f7a5cc5c08 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:38.279049 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a86094ca-28e4-4ab0-a910-79f7a5cc5c08 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:38.283332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a86094ca-28e4-4ab0-a910-79f7a5cc5c08 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:38.287423 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a86094ca-28e4-4ab0-a910-79f7a5cc5c08 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:38.288143 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a86094ca-28e4-4ab0-a910-79f7a5cc5c08 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:38.791826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a86094ca-28e4-4ab0-a910-79f7a5cc5c08 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:38.816839 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a86094ca-28e4-4ab0-a910-79f7a5cc5c08 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119" status: 200 len: 1315 microversion: 2.1 time: 0.590903 Sep 24 21:06:38.820143 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2205/4408] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:38 2022] GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119 => generated 1315 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:38.847931 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-82986993-39df-41ea-b891-92c4d2e75896 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:38.849439 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-82986993-39df-41ea-b891-92c4d2e75896 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:38.861679 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-edd9520a-c0bf-4dc4-b7e7-0c3d54ef6a74 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:38.867827 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82986993-39df-41ea-b891-92c4d2e75896 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:38.872758 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82986993-39df-41ea-b891-92c4d2e75896 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:38.876016 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82986993-39df-41ea-b891-92c4d2e75896 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:38.880802 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-edd9520a-c0bf-4dc4-b7e7-0c3d54ef6a74 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65" status: 200 len: 1556 microversion: 2.1 time: 0.716678 Sep 24 21:06:38.881153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82986993-39df-41ea-b891-92c4d2e75896 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:38.881889 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82986993-39df-41ea-b891-92c4d2e75896 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:38.882745 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2204/4409] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:38 2022] GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65 => generated 1556 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:38.883524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82986993-39df-41ea-b891-92c4d2e75896 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:38.905972 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a0624935-d7fe-4b08-acd2-c91fe89762c2 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:38.908056 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a0624935-d7fe-4b08-acd2-c91fe89762c2 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 7caa7efc-79ef-47c3-b024-dbcb34877a65] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:38.926005 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a0624935-d7fe-4b08-acd2-c91fe89762c2 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:38.927849 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a0624935-d7fe-4b08-acd2-c91fe89762c2 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:38.929517 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a0624935-d7fe-4b08-acd2-c91fe89762c2 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:38.931294 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a0624935-d7fe-4b08-acd2-c91fe89762c2 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:38.933234 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a0624935-d7fe-4b08-acd2-c91fe89762c2 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:38.933906 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a0624935-d7fe-4b08-acd2-c91fe89762c2 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:39.593840 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a0624935-d7fe-4b08-acd2-c91fe89762c2 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.693022 Sep 24 21:06:39.594437 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2205/4410] 10.222.0.52 () {58 vars in 1275 bytes} [Sat Sep 24 21:06:38 2022] GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65/os-interface => generated 284 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:06:39.844299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fb6b06b3-508f-432c-a261-0c1803c875c6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:39.844925 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fb6b06b3-508f-432c-a261-0c1803c875c6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 51c91704-c6eb-47bf-b3d1-9899df6ce119] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:39.856290 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb6b06b3-508f-432c-a261-0c1803c875c6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:39.857011 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb6b06b3-508f-432c-a261-0c1803c875c6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:39.858325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb6b06b3-508f-432c-a261-0c1803c875c6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:39.861193 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb6b06b3-508f-432c-a261-0c1803c875c6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:39.861323 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-82986993-39df-41ea-b891-92c4d2e75896 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:39.863195 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb6b06b3-508f-432c-a261-0c1803c875c6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:39.864427 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb6b06b3-508f-432c-a261-0c1803c875c6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:39.879318 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-82986993-39df-41ea-b891-92c4d2e75896 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 200 len: 1511 microversion: 2.1 time: 1.055490 Sep 24 21:06:39.881311 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2206/4411] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:38 2022] GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 1511 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:39.921842 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:06:40.438421 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fb6b06b3-508f-432c-a261-0c1803c875c6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:40.453715 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fb6b06b3-508f-432c-a261-0c1803c875c6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119" status: 200 len: 1315 microversion: 2.1 time: 0.614490 Sep 24 21:06:40.454348 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2206/4412] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:39 2022] GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119 => generated 1315 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:06:40.906823 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-93afea95-ba4c-43b6-a5d2-1c42cf3a1e9e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:40.911138 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-93afea95-ba4c-43b6-a5d2-1c42cf3a1e9e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:40.919930 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93afea95-ba4c-43b6-a5d2-1c42cf3a1e9e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:40.920742 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93afea95-ba4c-43b6-a5d2-1c42cf3a1e9e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:40.921422 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93afea95-ba4c-43b6-a5d2-1c42cf3a1e9e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:40.922552 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93afea95-ba4c-43b6-a5d2-1c42cf3a1e9e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:40.923217 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93afea95-ba4c-43b6-a5d2-1c42cf3a1e9e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:40.923983 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93afea95-ba4c-43b6-a5d2-1c42cf3a1e9e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:41.482002 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-724d0281-e920-45e8-8ff3-bba2e945ce38 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:41.482658 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-724d0281-e920-45e8-8ff3-bba2e945ce38 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 51c91704-c6eb-47bf-b3d1-9899df6ce119] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:41.490804 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-724d0281-e920-45e8-8ff3-bba2e945ce38 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:41.491700 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-724d0281-e920-45e8-8ff3-bba2e945ce38 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:41.492349 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-724d0281-e920-45e8-8ff3-bba2e945ce38 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:41.493302 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-724d0281-e920-45e8-8ff3-bba2e945ce38 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:41.494002 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-724d0281-e920-45e8-8ff3-bba2e945ce38 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:41.494672 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-724d0281-e920-45e8-8ff3-bba2e945ce38 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:41.708023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-93afea95-ba4c-43b6-a5d2-1c42cf3a1e9e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:41.718612 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-93afea95-ba4c-43b6-a5d2-1c42cf3a1e9e tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 200 len: 1511 microversion: 2.1 time: 0.818141 Sep 24 21:06:41.719898 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2207/4413] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:40 2022] GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 1511 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:41.726010 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-bfeb801e-5f3a-436f-bc07-a00803624f9c req-b40a1756-6227-4594-8ba6-8fa2dd5a0571 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51c91704-c6eb-47bf-b3d1-9899df6ce119", "tag": "cb689b35-55b9-4a33-8d15-19ff8d5cc56b"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:06:41.738940 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-bfeb801e-5f3a-436f-bc07-a00803624f9c req-b40a1756-6227-4594-8ba6-8fa2dd5a0571 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:41.739776 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-bfeb801e-5f3a-436f-bc07-a00803624f9c req-b40a1756-6227-4594-8ba6-8fa2dd5a0571 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:41.740457 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-bfeb801e-5f3a-436f-bc07-a00803624f9c req-b40a1756-6227-4594-8ba6-8fa2dd5a0571 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:41.755194 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-bfeb801e-5f3a-436f-bc07-a00803624f9c req-b40a1756-6227-4594-8ba6-8fa2dd5a0571 service nova] Creating event network-changed:cb689b35-55b9-4a33-8d15-19ff8d5cc56b for instance 51c91704-c6eb-47bf-b3d1-9899df6ce119 on nch1-master-1 Sep 24 21:06:41.762483 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-bfeb801e-5f3a-436f-bc07-a00803624f9c req-b40a1756-6227-4594-8ba6-8fa2dd5a0571 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040871 Sep 24 21:06:41.763794 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2208/4414] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:06:42.280914 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=4 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:06:42.282919 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=12 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:06:42.298738 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-d6e2d5a5-d90a-4eb6-921d-a5ff3e4c21a3 req-9bdd6d3a-9624-4920-9cec-bdcc47982cfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7caa7efc-79ef-47c3-b024-dbcb34877a65", "tag": "12ef86dc-2a21-4148-b45a-ed3026b5e112"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:06:42.323954 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-d6e2d5a5-d90a-4eb6-921d-a5ff3e4c21a3 req-9bdd6d3a-9624-4920-9cec-bdcc47982cfa service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:42.324811 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-d6e2d5a5-d90a-4eb6-921d-a5ff3e4c21a3 req-9bdd6d3a-9624-4920-9cec-bdcc47982cfa service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:42.325473 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-d6e2d5a5-d90a-4eb6-921d-a5ff3e4c21a3 req-9bdd6d3a-9624-4920-9cec-bdcc47982cfa service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:42.345028 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-d6e2d5a5-d90a-4eb6-921d-a5ff3e4c21a3 req-9bdd6d3a-9624-4920-9cec-bdcc47982cfa service nova] Creating event network-changed:12ef86dc-2a21-4148-b45a-ed3026b5e112 for instance 7caa7efc-79ef-47c3-b024-dbcb34877a65 on nch2-master-1 Sep 24 21:06:42.353657 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-d6e2d5a5-d90a-4eb6-921d-a5ff3e4c21a3 req-9bdd6d3a-9624-4920-9cec-bdcc47982cfa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074645 Sep 24 21:06:42.355593 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2209/4415] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:06:42.503333 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-724d0281-e920-45e8-8ff3-bba2e945ce38 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:42.514266 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-724d0281-e920-45e8-8ff3-bba2e945ce38 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119" status: 200 len: 1315 microversion: 2.1 time: 1.036721 Sep 24 21:06:42.534984 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2207/4416] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:41 2022] GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119 => generated 1315 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:42.759852 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9dd9652e-cbc5-4b88-aae2-7d4f1aa325d5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:42.760647 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9dd9652e-cbc5-4b88-aae2-7d4f1aa325d5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:42.781859 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9dd9652e-cbc5-4b88-aae2-7d4f1aa325d5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:42.782469 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9dd9652e-cbc5-4b88-aae2-7d4f1aa325d5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:42.786206 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9dd9652e-cbc5-4b88-aae2-7d4f1aa325d5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:42.789795 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9dd9652e-cbc5-4b88-aae2-7d4f1aa325d5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:42.790317 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9dd9652e-cbc5-4b88-aae2-7d4f1aa325d5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:42.792964 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9dd9652e-cbc5-4b88-aae2-7d4f1aa325d5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:43.541966 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-553956db-e485-48fd-9587-824c27278a28 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:43.543290 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-553956db-e485-48fd-9587-824c27278a28 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 51c91704-c6eb-47bf-b3d1-9899df6ce119] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:43.547914 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=12 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:06:43.568656 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-553956db-e485-48fd-9587-824c27278a28 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:43.569459 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-553956db-e485-48fd-9587-824c27278a28 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:43.570068 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-553956db-e485-48fd-9587-824c27278a28 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:43.572949 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-553956db-e485-48fd-9587-824c27278a28 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:43.573680 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-553956db-e485-48fd-9587-824c27278a28 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:43.574299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-553956db-e485-48fd-9587-824c27278a28 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:43.860199 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9dd9652e-cbc5-4b88-aae2-7d4f1aa325d5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:43.875186 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9dd9652e-cbc5-4b88-aae2-7d4f1aa325d5 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 200 len: 1511 microversion: 2.1 time: 1.129879 Sep 24 21:06:43.875780 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2210/4417] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:42 2022] GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 1511 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:06:44.477059 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-553956db-e485-48fd-9587-824c27278a28 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:44.489862 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-553956db-e485-48fd-9587-824c27278a28 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119" status: 200 len: 1315 microversion: 2.1 time: 0.952665 Sep 24 21:06:44.491076 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2208/4418] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:43 2022] GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119 => generated 1315 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:44.905301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6846c4f2-6411-4483-82a3-e6989fe8044a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:44.909191 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6846c4f2-6411-4483-82a3-e6989fe8044a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:44.926540 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6846c4f2-6411-4483-82a3-e6989fe8044a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:44.927804 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6846c4f2-6411-4483-82a3-e6989fe8044a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:44.928784 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6846c4f2-6411-4483-82a3-e6989fe8044a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:44.930259 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6846c4f2-6411-4483-82a3-e6989fe8044a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:44.931174 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6846c4f2-6411-4483-82a3-e6989fe8044a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:44.931801 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6846c4f2-6411-4483-82a3-e6989fe8044a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:45.475599 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6846c4f2-6411-4483-82a3-e6989fe8044a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:45.487985 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6846c4f2-6411-4483-82a3-e6989fe8044a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 200 len: 1488 microversion: 2.1 time: 0.589340 Sep 24 21:06:45.503764 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2211/4419] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:44 2022] GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 1488 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:45.515411 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cc185574-f8e0-469c-b73f-ba72b9367dd2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:45.516865 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cc185574-f8e0-469c-b73f-ba72b9367dd2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 51c91704-c6eb-47bf-b3d1-9899df6ce119] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:45.528146 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cc185574-f8e0-469c-b73f-ba72b9367dd2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:45.531071 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-42f6911f-bb98-431a-9dfd-82a7fe553269 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1322075043"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:06:45.531826 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cc185574-f8e0-469c-b73f-ba72b9367dd2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:45.532426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cc185574-f8e0-469c-b73f-ba72b9367dd2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:45.534714 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cc185574-f8e0-469c-b73f-ba72b9367dd2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:45.535352 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cc185574-f8e0-469c-b73f-ba72b9367dd2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:45.537310 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-42f6911f-bb98-431a-9dfd-82a7fe553269 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:45.539561 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cc185574-f8e0-469c-b73f-ba72b9367dd2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:45.552277 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-42f6911f-bb98-431a-9dfd-82a7fe553269 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:45.554816 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-42f6911f-bb98-431a-9dfd-82a7fe553269 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:45.555421 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-42f6911f-bb98-431a-9dfd-82a7fe553269 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:45.558824 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-42f6911f-bb98-431a-9dfd-82a7fe553269 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:45.559547 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-42f6911f-bb98-431a-9dfd-82a7fe553269 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:45.560133 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-42f6911f-bb98-431a-9dfd-82a7fe553269 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:45.668553 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-42f6911f-bb98-431a-9dfd-82a7fe553269 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "PUT /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 200 len: 1062 microversion: 2.1 time: 0.146193 Sep 24 21:06:45.669337 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2212/4420] 10.222.0.52 () {60 vars in 1256 bytes} [Sat Sep 24 21:06:45 2022] PUT /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 1062 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:45.688602 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5d348097-2f5d-4994-8645-8f2c2120cfff tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:45.689624 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5d348097-2f5d-4994-8645-8f2c2120cfff tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:45.700506 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d348097-2f5d-4994-8645-8f2c2120cfff tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:45.701388 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d348097-2f5d-4994-8645-8f2c2120cfff tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:45.702051 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d348097-2f5d-4994-8645-8f2c2120cfff tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:45.703798 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d348097-2f5d-4994-8645-8f2c2120cfff tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:45.704509 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d348097-2f5d-4994-8645-8f2c2120cfff tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:45.705618 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d348097-2f5d-4994-8645-8f2c2120cfff tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:46.366832 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cc185574-f8e0-469c-b73f-ba72b9367dd2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:46.379657 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cc185574-f8e0-469c-b73f-ba72b9367dd2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119" status: 200 len: 1315 microversion: 2.1 time: 0.868894 Sep 24 21:06:46.380793 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2209/4421] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:45 2022] GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119 => generated 1315 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:46.506436 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5d348097-2f5d-4994-8645-8f2c2120cfff tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:46.515217 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5d348097-2f5d-4994-8645-8f2c2120cfff tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 200 len: 1489 microversion: 2.1 time: 0.830808 Sep 24 21:06:46.515808 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2213/4422] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:45 2022] GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 1489 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:06:46.540266 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f7378037-b605-4e55-ae3a-b56b703d1b68 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:46.540987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f7378037-b605-4e55-ae3a-b56b703d1b68 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:46.548900 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f7378037-b605-4e55-ae3a-b56b703d1b68 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:46.549535 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f7378037-b605-4e55-ae3a-b56b703d1b68 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:46.550461 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f7378037-b605-4e55-ae3a-b56b703d1b68 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:46.551347 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f7378037-b605-4e55-ae3a-b56b703d1b68 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:46.551890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f7378037-b605-4e55-ae3a-b56b703d1b68 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:46.552392 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f7378037-b605-4e55-ae3a-b56b703d1b68 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:47.128018 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f7378037-b605-4e55-ae3a-b56b703d1b68 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:47.137092 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f7378037-b605-4e55-ae3a-b56b703d1b68 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 200 len: 1489 microversion: 2.1 time: 0.600617 Sep 24 21:06:47.137681 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2210/4423] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:46 2022] GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 1489 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:47.159756 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-16e2e44e-4811-4240-8587-5243dbde90cb tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:47.160263 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-16e2e44e-4811-4240-8587-5243dbde90cb tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:47.167281 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-16e2e44e-4811-4240-8587-5243dbde90cb tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:47.167996 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-16e2e44e-4811-4240-8587-5243dbde90cb tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:47.168591 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-16e2e44e-4811-4240-8587-5243dbde90cb tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:47.169462 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-16e2e44e-4811-4240-8587-5243dbde90cb tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:47.170100 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-16e2e44e-4811-4240-8587-5243dbde90cb tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:47.170518 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-16e2e44e-4811-4240-8587-5243dbde90cb tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:47.175129 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:06:47.202011 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-16e2e44e-4811-4240-8587-5243dbde90cb tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:06:47.291240 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-16e2e44e-4811-4240-8587-5243dbde90cb tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 204 len: 0 microversion: 2.1 time: 0.135205 Sep 24 21:06:47.293259 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2214/4424] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:06:47 2022] DELETE /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:06:47.302024 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d191bb6e-d26c-4313-b961-d835571473e7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:47.302691 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d191bb6e-d26c-4313-b961-d835571473e7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:47.309336 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d191bb6e-d26c-4313-b961-d835571473e7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:47.309848 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d191bb6e-d26c-4313-b961-d835571473e7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:47.310611 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d191bb6e-d26c-4313-b961-d835571473e7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:47.311474 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d191bb6e-d26c-4313-b961-d835571473e7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:47.312154 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d191bb6e-d26c-4313-b961-d835571473e7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:47.312541 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d191bb6e-d26c-4313-b961-d835571473e7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:47.410615 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3f3c5b98-923e-4b46-8bd7-f703daad0c42 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:47.411436 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3f3c5b98-923e-4b46-8bd7-f703daad0c42 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 51c91704-c6eb-47bf-b3d1-9899df6ce119] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:47.419879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3f3c5b98-923e-4b46-8bd7-f703daad0c42 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:47.420643 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3f3c5b98-923e-4b46-8bd7-f703daad0c42 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:47.421268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3f3c5b98-923e-4b46-8bd7-f703daad0c42 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:47.422186 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3f3c5b98-923e-4b46-8bd7-f703daad0c42 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:47.422830 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3f3c5b98-923e-4b46-8bd7-f703daad0c42 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:47.423403 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3f3c5b98-923e-4b46-8bd7-f703daad0c42 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:47.932879 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d191bb6e-d26c-4313-b961-d835571473e7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:47.966775 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d191bb6e-d26c-4313-b961-d835571473e7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 200 len: 1495 microversion: 2.1 time: 0.669253 Sep 24 21:06:47.986943 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2211/4425] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:47 2022] GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 1495 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:48.040161 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3f3c5b98-923e-4b46-8bd7-f703daad0c42 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:48.050588 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3f3c5b98-923e-4b46-8bd7-f703daad0c42 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119" status: 200 len: 1315 microversion: 2.1 time: 0.648098 Sep 24 21:06:48.066619 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2215/4426] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:47 2022] GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119 => generated 1315 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:48.994378 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-17839efd-5711-4346-bcb4-a644e0176b3f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:48.995201 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-17839efd-5711-4346-bcb4-a644e0176b3f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:49.004391 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17839efd-5711-4346-bcb4-a644e0176b3f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:49.005340 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17839efd-5711-4346-bcb4-a644e0176b3f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:49.006013 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17839efd-5711-4346-bcb4-a644e0176b3f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:49.007031 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17839efd-5711-4346-bcb4-a644e0176b3f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:49.007706 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17839efd-5711-4346-bcb4-a644e0176b3f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:49.008364 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17839efd-5711-4346-bcb4-a644e0176b3f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:49.083123 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-990f14c1-c248-4cf4-b2a8-2be726e6f12f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:49.083826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-990f14c1-c248-4cf4-b2a8-2be726e6f12f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 51c91704-c6eb-47bf-b3d1-9899df6ce119] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:49.104269 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-990f14c1-c248-4cf4-b2a8-2be726e6f12f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:49.105362 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-990f14c1-c248-4cf4-b2a8-2be726e6f12f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:49.105976 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-990f14c1-c248-4cf4-b2a8-2be726e6f12f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:49.106778 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-990f14c1-c248-4cf4-b2a8-2be726e6f12f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:49.107300 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-990f14c1-c248-4cf4-b2a8-2be726e6f12f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:49.107856 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-990f14c1-c248-4cf4-b2a8-2be726e6f12f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:49.844770 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-17839efd-5711-4346-bcb4-a644e0176b3f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:49.859309 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-17839efd-5711-4346-bcb4-a644e0176b3f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 200 len: 1495 microversion: 2.1 time: 0.867701 Sep 24 21:06:49.860063 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-990f14c1-c248-4cf4-b2a8-2be726e6f12f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:49.860551 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2212/4427] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:48 2022] GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 1495 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:49.887630 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-990f14c1-c248-4cf4-b2a8-2be726e6f12f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119" status: 200 len: 1315 microversion: 2.1 time: 0.807471 Sep 24 21:06:49.889421 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2216/4428] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:49 2022] GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119 => generated 1315 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:50.184577 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-05c2a09d-1146-4041-92cb-3e939eb0e673 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-819516697", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "776b0a8a-79cd-48f3-be9e-6b339ff21422"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:06:50.355424 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-05c2a09d-1146-4041-92cb-3e939eb0e673 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] validate_networks() for [('776b0a8a-79cd-48f3-be9e-6b339ff21422', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:06:50.795106 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-0d3d83ce-f44f-4a25-9429-16a71a50b67e req-406a7f5d-2d31-472b-ab17-a5edf630fc73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9", "name": "network-vif-deleted", "tag": "469139a1-1d76-4eb6-86e4-e74cc739b5df"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:06:50.816798 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-0d3d83ce-f44f-4a25-9429-16a71a50b67e req-406a7f5d-2d31-472b-ab17-a5edf630fc73 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:50.817301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-0d3d83ce-f44f-4a25-9429-16a71a50b67e req-406a7f5d-2d31-472b-ab17-a5edf630fc73 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:50.823111 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-0d3d83ce-f44f-4a25-9429-16a71a50b67e req-406a7f5d-2d31-472b-ab17-a5edf630fc73 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:50.843862 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-0d3d83ce-f44f-4a25-9429-16a71a50b67e req-406a7f5d-2d31-472b-ab17-a5edf630fc73 service nova] Creating event network-vif-deleted:469139a1-1d76-4eb6-86e4-e74cc739b5df for instance 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 on nch2-master-1 Sep 24 21:06:50.861275 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-0d3d83ce-f44f-4a25-9429-16a71a50b67e req-406a7f5d-2d31-472b-ab17-a5edf630fc73 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070139 Sep 24 21:06:50.863455 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2217/4429] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:06:50.885814 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3c0e35de-6d96-4177-adb6-8521ee2cbf09 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:50.888118 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3c0e35de-6d96-4177-adb6-8521ee2cbf09 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:50.898204 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c0e35de-6d96-4177-adb6-8521ee2cbf09 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:50.900902 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c0e35de-6d96-4177-adb6-8521ee2cbf09 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:50.905100 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c0e35de-6d96-4177-adb6-8521ee2cbf09 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:50.906421 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c0e35de-6d96-4177-adb6-8521ee2cbf09 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:50.907147 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c0e35de-6d96-4177-adb6-8521ee2cbf09 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:50.908065 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c0e35de-6d96-4177-adb6-8521ee2cbf09 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:51.045919 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c0e35de-6d96-4177-adb6-8521ee2cbf09 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:51.047085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c0e35de-6d96-4177-adb6-8521ee2cbf09 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:51.047717 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c0e35de-6d96-4177-adb6-8521ee2cbf09 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:51.048376 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-3c0e35de-6d96-4177-adb6-8521ee2cbf09 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lazy-loading 'fault' on Instance uuid 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:06:51.263071 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3c0e35de-6d96-4177-adb6-8521ee2cbf09 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:51.279251 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3c0e35de-6d96-4177-adb6-8521ee2cbf09 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 200 len: 1310 microversion: 2.1 time: 0.397611 Sep 24 21:06:51.279860 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2218/4430] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:50 2022] GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 1310 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:06:51.297171 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-68b748bb-dc09-464b-a469-670235c4e79c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:51.297171 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-68b748bb-dc09-464b-a469-670235c4e79c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 51c91704-c6eb-47bf-b3d1-9899df6ce119] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:51.315531 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68b748bb-dc09-464b-a469-670235c4e79c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:51.316048 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68b748bb-dc09-464b-a469-670235c4e79c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:51.316499 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68b748bb-dc09-464b-a469-670235c4e79c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:51.320230 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68b748bb-dc09-464b-a469-670235c4e79c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:51.321100 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68b748bb-dc09-464b-a469-670235c4e79c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:51.328384 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68b748bb-dc09-464b-a469-670235c4e79c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:51.828481 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-05c2a09d-1146-4041-92cb-3e939eb0e673 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:06:51.832439 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-05c2a09d-1146-4041-92cb-3e939eb0e673 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:06:51.833151 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-05c2a09d-1146-4041-92cb-3e939eb0e673 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:06:51.837465 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-05c2a09d-1146-4041-92cb-3e939eb0e673 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:06:51.838264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-05c2a09d-1146-4041-92cb-3e939eb0e673 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:06:51.879893 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05c2a09d-1146-4041-92cb-3e939eb0e673 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:51.882074 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05c2a09d-1146-4041-92cb-3e939eb0e673 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:51.883665 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05c2a09d-1146-4041-92cb-3e939eb0e673 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:51.885941 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05c2a09d-1146-4041-92cb-3e939eb0e673 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:51.887827 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05c2a09d-1146-4041-92cb-3e939eb0e673 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:51.888617 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-05c2a09d-1146-4041-92cb-3e939eb0e673 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:51.950802 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-05c2a09d-1146-4041-92cb-3e939eb0e673 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Getting quotas for project b0c1b7c4c6ff480c82a1f9708b7dbe62. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:06:51.959113 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-05c2a09d-1146-4041-92cb-3e939eb0e673 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Getting quotas for user d142c33eccd048bfa3415b1661ee373f and project b0c1b7c4c6ff480c82a1f9708b7dbe62. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:06:51.977077 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-05c2a09d-1146-4041-92cb-3e939eb0e673 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:06:51.980616 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-05c2a09d-1146-4041-92cb-3e939eb0e673 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] [instance: 4bbb3958-6fd0-4c00-adff-4865f868d0bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:06:52.089492 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-05c2a09d-1146-4041-92cb-3e939eb0e673 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.172131 Sep 24 21:06:52.090835 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2213/4431] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:06:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2174 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:06:52.120227 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6a9aae16-e2e7-4e06-9374-f462e73763a9 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:52.122433 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6a9aae16-e2e7-4e06-9374-f462e73763a9 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] [instance: 4bbb3958-6fd0-4c00-adff-4865f868d0bc] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:52.525461 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6a9aae16-e2e7-4e06-9374-f462e73763a9 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd142c33eccd048bfa3415b1661ee373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c1b7c4c6ff480c82a1f9708b7dbe62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:52.530421 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-68b748bb-dc09-464b-a469-670235c4e79c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:52.539139 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6a9aae16-e2e7-4e06-9374-f462e73763a9 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] 10.222.0.52 "GET /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc" status: 200 len: 1224 microversion: 2.1 time: 0.431873 Sep 24 21:06:52.540263 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2214/4432] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:52 2022] GET /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc => generated 1224 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:52.546478 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-68b748bb-dc09-464b-a469-670235c4e79c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119" status: 200 len: 1315 microversion: 2.1 time: 1.262925 Sep 24 21:06:52.559115 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2219/4433] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:51 2022] GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119 => generated 1315 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:52.575238 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-987e484d-0deb-4045-b907-8a63593dcdb3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:52.575997 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-987e484d-0deb-4045-b907-8a63593dcdb3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:52.591044 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-987e484d-0deb-4045-b907-8a63593dcdb3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:52.591740 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-987e484d-0deb-4045-b907-8a63593dcdb3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:52.592265 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-987e484d-0deb-4045-b907-8a63593dcdb3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:52.593124 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-987e484d-0deb-4045-b907-8a63593dcdb3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:52.593875 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-987e484d-0deb-4045-b907-8a63593dcdb3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:52.594404 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-987e484d-0deb-4045-b907-8a63593dcdb3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:52.617706 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-987e484d-0deb-4045-b907-8a63593dcdb3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] HTTP exception thrown: Instance 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 could not be found. Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-987e484d-0deb-4045-b907-8a63593dcdb3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Request method failure captured: Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 HTTP/1.1 Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3CaLUabI_YBYC2XnM21T8dL5FNXXvceQt6A3bijM2xUqNxa7o1mArSf5dFDgPeh3vgkyUYVZenobpLU3uEqGcvnEbw-nMZfSWEM5OkDmeYEccMJ8-yhXeZa1T-3DnHpo2MRC1ewpBuezwDhE04pucSEH5uW1HzlM0IgaFpEaRXllaA Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersTestJSON-1457868986 Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersTestJSON-1457868986-project Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: e557d91b49c143499d809a55e85932fd Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersTestJSON-1457868986-project Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 could not be found. Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9'} Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 could not be found. Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 could not be found. Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:52.619795 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:52.622901 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:52.622901 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:52.622901 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:52.622901 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:06:52.622901 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:06:52.622901 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 could not be found. Sep 24 21:06:52.622901 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:52.624708 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-987e484d-0deb-4045-b907-8a63593dcdb3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Returning 404 to user: Instance 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:06:52.625705 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-987e484d-0deb-4045-b907-8a63593dcdb3 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 404 len: 111 microversion: 2.1 time: 0.065472 Sep 24 21:06:52.630751 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2220/4434] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:52 2022] GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:06:52.648786 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5c521af8-706c-425b-82bd-2b99c5de4027 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:52.655766 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5c521af8-706c-425b-82bd-2b99c5de4027 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:52.672388 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-55b4fafd-bcda-49e2-b042-1feea525794b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Action: 'create', calling method: .version_select at 0x7f4b1106e160>, body: {"keypair": {"name": "tempest-keypair-1303507742", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzHcSUGBeDnVBtdnWFL7MrlxqHLFElCWG85mqClmEPaI7uuhO9f0RtwRS9NFs3lrUzhrif4Urco9NXNNFd72Amvm0lwCed9/Vxs7g/bsaM3EuyI0jjKfu23jtrRoXc7ZQ=="}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:06:52.676625 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c521af8-706c-425b-82bd-2b99c5de4027 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:52.677202 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c521af8-706c-425b-82bd-2b99c5de4027 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:52.677846 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c521af8-706c-425b-82bd-2b99c5de4027 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:52.678775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c521af8-706c-425b-82bd-2b99c5de4027 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:52.679424 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c521af8-706c-425b-82bd-2b99c5de4027 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:52.680060 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c521af8-706c-425b-82bd-2b99c5de4027 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:52.702923 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-55b4fafd-bcda-49e2-b042-1feea525794b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Getting quotas for project d0e5867b34544cadbb354439808248aa. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:06:52.711856 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-55b4fafd-bcda-49e2-b042-1feea525794b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Getting quotas for user 9eca15a31e064f4199bfc4b04de7c5b2 and project d0e5867b34544cadbb354439808248aa. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:06:52.725220 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-5c521af8-706c-425b-82bd-2b99c5de4027 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] HTTP exception thrown: Instance 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 could not be found. Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5c521af8-706c-425b-82bd-2b99c5de4027 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Request method failure captured: Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 HTTP/1.1 Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3CaLUabI_YBYC2XnM21T8dL5FNXXvceQt6A3bijM2xUqNxa7o1mArSf5dFDgPeh3vgkyUYVZenobpLU3uEqGcvnEbw-nMZfSWEM5OkDmeYEccMJ8-yhXeZa1T-3DnHpo2MRC1ewpBuezwDhE04pucSEH5uW1HzlM0IgaFpEaRXllaA Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersTestJSON-1457868986 Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersTestJSON-1457868986-project Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: e557d91b49c143499d809a55e85932fd Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersTestJSON-1457868986-project Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 could not be found. Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9'} Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 could not be found. Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:06:52.727434 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 could not be found. Sep 24 21:06:52.733766 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:52.733766 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:52.733766 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:52.733766 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:52.733766 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:52.733766 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:52.733766 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:06:52.733766 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:06:52.733766 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 could not be found. Sep 24 21:06:52.733766 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:52.733766 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5c521af8-706c-425b-82bd-2b99c5de4027 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Returning 404 to user: Instance 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:06:52.733766 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5c521af8-706c-425b-82bd-2b99c5de4027 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 404 len: 111 microversion: 2.1 time: 0.093286 Sep 24 21:06:52.733766 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2221/4435] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:06:52 2022] DELETE /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:06:52.749046 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-55b4fafd-bcda-49e2-b042-1feea525794b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.206044 Sep 24 21:06:52.750236 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2215/4436] 10.222.0.52 () {62 vars in 1200 bytes} [Sat Sep 24 21:06:52 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 209 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 24 21:06:52.754041 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3834d9b5-db77-4717-82a9-70c87d04622b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:52.757309 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3834d9b5-db77-4717-82a9-70c87d04622b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:52.780595 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3834d9b5-db77-4717-82a9-70c87d04622b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:52.781112 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3834d9b5-db77-4717-82a9-70c87d04622b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:52.784050 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3834d9b5-db77-4717-82a9-70c87d04622b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:52.790191 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3834d9b5-db77-4717-82a9-70c87d04622b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:52.793332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3834d9b5-db77-4717-82a9-70c87d04622b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:52.796208 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3834d9b5-db77-4717-82a9-70c87d04622b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:52.857707 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-3834d9b5-db77-4717-82a9-70c87d04622b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] HTTP exception thrown: Instance 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 could not be found. Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3834d9b5-db77-4717-82a9-70c87d04622b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Request method failure captured: Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 HTTP/1.1 Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3CaLUabI_YBYC2XnM21T8dL5FNXXvceQt6A3bijM2xUqNxa7o1mArSf5dFDgPeh3vgkyUYVZenobpLU3uEqGcvnEbw-nMZfSWEM5OkDmeYEccMJ8-yhXeZa1T-3DnHpo2MRC1ewpBuezwDhE04pucSEH5uW1HzlM0IgaFpEaRXllaA Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersTestJSON-1457868986 Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersTestJSON-1457868986-project Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: e557d91b49c143499d809a55e85932fd Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersTestJSON-1457868986-project Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 could not be found. Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9'} Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 could not be found. Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 could not be found. Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:52.860934 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:52.866914 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:52.866914 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:52.866914 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:52.866914 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:06:52.866914 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:06:52.866914 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 could not be found. Sep 24 21:06:52.866914 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:52.868376 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3834d9b5-db77-4717-82a9-70c87d04622b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Returning 404 to user: Instance 2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:06:52.870236 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3834d9b5-db77-4717-82a9-70c87d04622b tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9" status: 404 len: 111 microversion: 2.1 time: 0.127428 Sep 24 21:06:52.871419 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2222/4437] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:52 2022] GET /compute/v2.1/servers/2b4c49cf-76ee-4fc1-a78b-8b59d4497dd9 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:06:52.880602 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-aa93ff03-d39a-4daa-ac74-5a1beaa89078 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:52.881232 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-aa93ff03-d39a-4daa-ac74-5a1beaa89078 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:52.897601 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa93ff03-d39a-4daa-ac74-5a1beaa89078 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:52.900458 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa93ff03-d39a-4daa-ac74-5a1beaa89078 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:52.901582 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa93ff03-d39a-4daa-ac74-5a1beaa89078 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:52.904230 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa93ff03-d39a-4daa-ac74-5a1beaa89078 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:52.904968 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa93ff03-d39a-4daa-ac74-5a1beaa89078 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:52.906644 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa93ff03-d39a-4daa-ac74-5a1beaa89078 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:52.944948 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-aa93ff03-d39a-4daa-ac74-5a1beaa89078 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] HTTP exception thrown: Instance fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a could not be found. Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-aa93ff03-d39a-4daa-ac74-5a1beaa89078 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Request method failure captured: Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a HTTP/1.1 Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3CaLUabI_YBYC2XnM21T8dL5FNXXvceQt6A3bijM2xUqNxa7o1mArSf5dFDgPeh3vgkyUYVZenobpLU3uEqGcvnEbw-nMZfSWEM5OkDmeYEccMJ8-yhXeZa1T-3DnHpo2MRC1ewpBuezwDhE04pucSEH5uW1HzlM0IgaFpEaRXllaA Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersTestJSON-1457868986 Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersTestJSON-1457868986-project Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: e557d91b49c143499d809a55e85932fd Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersTestJSON-1457868986-project Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a could not be found. Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a'} Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a could not be found. Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:06:52.946594 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a could not be found. Sep 24 21:06:52.950317 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:52.950317 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:52.950317 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:52.950317 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:52.950317 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:52.950317 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:52.950317 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:06:52.950317 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:06:52.950317 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a could not be found. Sep 24 21:06:52.950317 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:52.952344 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-aa93ff03-d39a-4daa-ac74-5a1beaa89078 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Returning 404 to user: Instance fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:06:52.953626 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-aa93ff03-d39a-4daa-ac74-5a1beaa89078 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a" status: 404 len: 111 microversion: 2.1 time: 0.078046 Sep 24 21:06:52.955954 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2216/4438] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:06:52 2022] DELETE /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:06:52.965238 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-127b8448-af09-4e03-9124-94f83a784b92 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:52.966153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-127b8448-af09-4e03-9124-94f83a784b92 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:52.974393 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-127b8448-af09-4e03-9124-94f83a784b92 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:52.975493 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-127b8448-af09-4e03-9124-94f83a784b92 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:52.976156 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-127b8448-af09-4e03-9124-94f83a784b92 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:52.977057 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-127b8448-af09-4e03-9124-94f83a784b92 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:52.977696 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-127b8448-af09-4e03-9124-94f83a784b92 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:52.978301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-127b8448-af09-4e03-9124-94f83a784b92 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:53.000472 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-127b8448-af09-4e03-9124-94f83a784b92 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] HTTP exception thrown: Instance fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a could not be found. Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-127b8448-af09-4e03-9124-94f83a784b92 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Request method failure captured: Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a HTTP/1.1 Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3CaLUabI_YBYC2XnM21T8dL5FNXXvceQt6A3bijM2xUqNxa7o1mArSf5dFDgPeh3vgkyUYVZenobpLU3uEqGcvnEbw-nMZfSWEM5OkDmeYEccMJ8-yhXeZa1T-3DnHpo2MRC1ewpBuezwDhE04pucSEH5uW1HzlM0IgaFpEaRXllaA Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersTestJSON-1457868986 Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersTestJSON-1457868986-project Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: e557d91b49c143499d809a55e85932fd Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersTestJSON-1457868986-project Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a could not be found. Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a'} Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a could not be found. Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a could not be found. Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:53.004555 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.007768 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:53.007768 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:53.007768 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:53.007768 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:06:53.007768 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:06:53.007768 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a could not be found. Sep 24 21:06:53.007768 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.019514 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-127b8448-af09-4e03-9124-94f83a784b92 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Returning 404 to user: Instance fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:06:53.020343 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-127b8448-af09-4e03-9124-94f83a784b92 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a" status: 404 len: 111 microversion: 2.1 time: 0.060602 Sep 24 21:06:53.020937 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2223/4439] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:52 2022] GET /compute/v2.1/servers/fcfd53ab-2bc1-4ec0-b9a6-959d9db7649a => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:06:53.031990 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f0fd5cd0-f7e6-42bd-9685-08e76748fa30 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:53.035290 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f0fd5cd0-f7e6-42bd-9685-08e76748fa30 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 95dc95dc-ef74-4f92-9d5a-7e199fc802f5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:53.048655 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:06:53.052627 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f0fd5cd0-f7e6-42bd-9685-08e76748fa30 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:53.054594 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f0fd5cd0-f7e6-42bd-9685-08e76748fa30 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:53.055664 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f0fd5cd0-f7e6-42bd-9685-08e76748fa30 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:53.057054 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f0fd5cd0-f7e6-42bd-9685-08e76748fa30 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:53.057658 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f0fd5cd0-f7e6-42bd-9685-08e76748fa30 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:53.058352 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f0fd5cd0-f7e6-42bd-9685-08e76748fa30 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:53.082821 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-f0fd5cd0-f7e6-42bd-9685-08e76748fa30 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] HTTP exception thrown: Instance 95dc95dc-ef74-4f92-9d5a-7e199fc802f5 could not be found. Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f0fd5cd0-f7e6-42bd-9685-08e76748fa30 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Request method failure captured: Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5 HTTP/1.1 Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3CaLUabI_YBYC2XnM21T8dL5FNXXvceQt6A3bijM2xUqNxa7o1mArSf5dFDgPeh3vgkyUYVZenobpLU3uEqGcvnEbw-nMZfSWEM5OkDmeYEccMJ8-yhXeZa1T-3DnHpo2MRC1ewpBuezwDhE04pucSEH5uW1HzlM0IgaFpEaRXllaA Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersTestJSON-1457868986 Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersTestJSON-1457868986-project Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: e557d91b49c143499d809a55e85932fd Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersTestJSON-1457868986-project Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 95dc95dc-ef74-4f92-9d5a-7e199fc802f5 could not be found. Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '95dc95dc-ef74-4f92-9d5a-7e199fc802f5'} Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95dc95dc-ef74-4f92-9d5a-7e199fc802f5 could not be found. Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:06:53.084705 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95dc95dc-ef74-4f92-9d5a-7e199fc802f5 could not be found. Sep 24 21:06:53.087783 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.087783 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:53.087783 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.087783 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:53.087783 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:53.087783 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:53.087783 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:06:53.087783 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:06:53.087783 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95dc95dc-ef74-4f92-9d5a-7e199fc802f5 could not be found. Sep 24 21:06:53.087783 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.087783 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f0fd5cd0-f7e6-42bd-9685-08e76748fa30 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Returning 404 to user: Instance 95dc95dc-ef74-4f92-9d5a-7e199fc802f5 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:06:53.087783 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f0fd5cd0-f7e6-42bd-9685-08e76748fa30 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "DELETE /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5" status: 404 len: 111 microversion: 2.1 time: 0.060796 Sep 24 21:06:53.091316 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2217/4440] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:06:53 2022] DELETE /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:06:53.096021 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-88459351-9701-46ea-a4c8-aea2de1c4ce0 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:53.096730 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-88459351-9701-46ea-a4c8-aea2de1c4ce0 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 95dc95dc-ef74-4f92-9d5a-7e199fc802f5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:53.106032 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-88459351-9701-46ea-a4c8-aea2de1c4ce0 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:53.107592 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-88459351-9701-46ea-a4c8-aea2de1c4ce0 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:53.115241 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-88459351-9701-46ea-a4c8-aea2de1c4ce0 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:53.116417 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-88459351-9701-46ea-a4c8-aea2de1c4ce0 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:53.117047 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-88459351-9701-46ea-a4c8-aea2de1c4ce0 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:53.118281 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-88459351-9701-46ea-a4c8-aea2de1c4ce0 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:53.150283 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-88459351-9701-46ea-a4c8-aea2de1c4ce0 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] HTTP exception thrown: Instance 95dc95dc-ef74-4f92-9d5a-7e199fc802f5 could not be found. Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-88459351-9701-46ea-a4c8-aea2de1c4ce0 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Request method failure captured: Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5 HTTP/1.1 Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3CaLUabI_YBYC2XnM21T8dL5FNXXvceQt6A3bijM2xUqNxa7o1mArSf5dFDgPeh3vgkyUYVZenobpLU3uEqGcvnEbw-nMZfSWEM5OkDmeYEccMJ8-yhXeZa1T-3DnHpo2MRC1ewpBuezwDhE04pucSEH5uW1HzlM0IgaFpEaRXllaA Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersTestJSON-1457868986 Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersTestJSON-1457868986-project Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: e557d91b49c143499d809a55e85932fd Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersTestJSON-1457868986-project Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 95dc95dc-ef74-4f92-9d5a-7e199fc802f5 could not be found. Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '95dc95dc-ef74-4f92-9d5a-7e199fc802f5'} Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95dc95dc-ef74-4f92-9d5a-7e199fc802f5 could not be found. Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95dc95dc-ef74-4f92-9d5a-7e199fc802f5 could not be found. Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:53.158664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.162290 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:53.162290 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:53.162290 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:53.162290 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:06:53.162290 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:06:53.162290 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95dc95dc-ef74-4f92-9d5a-7e199fc802f5 could not be found. Sep 24 21:06:53.162290 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.166457 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-88459351-9701-46ea-a4c8-aea2de1c4ce0 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Returning 404 to user: Instance 95dc95dc-ef74-4f92-9d5a-7e199fc802f5 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:06:53.167441 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-88459351-9701-46ea-a4c8-aea2de1c4ce0 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5" status: 404 len: 111 microversion: 2.1 time: 0.075420 Sep 24 21:06:53.168340 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2224/4441] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:53 2022] GET /compute/v2.1/servers/95dc95dc-ef74-4f92-9d5a-7e199fc802f5 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:06:53.177424 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c0147f9f-4fe7-4cb6-8e21-0971939fdad4 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:53.178534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c0147f9f-4fe7-4cb6-8e21-0971939fdad4 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ca4c8bfe-e06d-427f-85fb-1d2729572b07] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:53.190902 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c0147f9f-4fe7-4cb6-8e21-0971939fdad4 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:53.193689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c0147f9f-4fe7-4cb6-8e21-0971939fdad4 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:53.194315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c0147f9f-4fe7-4cb6-8e21-0971939fdad4 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:53.196550 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c0147f9f-4fe7-4cb6-8e21-0971939fdad4 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:53.197287 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c0147f9f-4fe7-4cb6-8e21-0971939fdad4 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:53.198186 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c0147f9f-4fe7-4cb6-8e21-0971939fdad4 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:53.221509 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-c0147f9f-4fe7-4cb6-8e21-0971939fdad4 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] HTTP exception thrown: Instance ca4c8bfe-e06d-427f-85fb-1d2729572b07 could not be found. Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c0147f9f-4fe7-4cb6-8e21-0971939fdad4 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Request method failure captured: Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07 HTTP/1.1 Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3CaLUabI_YBYC2XnM21T8dL5FNXXvceQt6A3bijM2xUqNxa7o1mArSf5dFDgPeh3vgkyUYVZenobpLU3uEqGcvnEbw-nMZfSWEM5OkDmeYEccMJ8-yhXeZa1T-3DnHpo2MRC1ewpBuezwDhE04pucSEH5uW1HzlM0IgaFpEaRXllaA Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersTestJSON-1457868986 Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersTestJSON-1457868986-project Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: e557d91b49c143499d809a55e85932fd Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersTestJSON-1457868986-project Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance ca4c8bfe-e06d-427f-85fb-1d2729572b07 could not be found. Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'ca4c8bfe-e06d-427f-85fb-1d2729572b07'} Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca4c8bfe-e06d-427f-85fb-1d2729572b07 could not be found. Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:06:53.223630 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca4c8bfe-e06d-427f-85fb-1d2729572b07 could not be found. Sep 24 21:06:53.227551 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.227551 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:53.227551 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.227551 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:53.227551 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:53.227551 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:53.227551 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:06:53.227551 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:06:53.227551 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca4c8bfe-e06d-427f-85fb-1d2729572b07 could not be found. Sep 24 21:06:53.227551 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.230012 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c0147f9f-4fe7-4cb6-8e21-0971939fdad4 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Returning 404 to user: Instance ca4c8bfe-e06d-427f-85fb-1d2729572b07 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:06:53.231278 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c0147f9f-4fe7-4cb6-8e21-0971939fdad4 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07" status: 404 len: 111 microversion: 2.1 time: 0.058857 Sep 24 21:06:53.236190 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2218/4442] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:06:53 2022] DELETE /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:06:53.241032 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-325291b5-bf8c-4a53-a19c-ce733388efd4 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:53.241662 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-325291b5-bf8c-4a53-a19c-ce733388efd4 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ca4c8bfe-e06d-427f-85fb-1d2729572b07] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:53.255435 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-325291b5-bf8c-4a53-a19c-ce733388efd4 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:53.255888 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-325291b5-bf8c-4a53-a19c-ce733388efd4 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:53.256372 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-325291b5-bf8c-4a53-a19c-ce733388efd4 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:53.257042 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-325291b5-bf8c-4a53-a19c-ce733388efd4 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:53.258760 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-325291b5-bf8c-4a53-a19c-ce733388efd4 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:53.260282 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-325291b5-bf8c-4a53-a19c-ce733388efd4 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:53.281276 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-325291b5-bf8c-4a53-a19c-ce733388efd4 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] HTTP exception thrown: Instance ca4c8bfe-e06d-427f-85fb-1d2729572b07 could not be found. Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-325291b5-bf8c-4a53-a19c-ce733388efd4 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Request method failure captured: Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07 HTTP/1.1 Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3CaLUabI_YBYC2XnM21T8dL5FNXXvceQt6A3bijM2xUqNxa7o1mArSf5dFDgPeh3vgkyUYVZenobpLU3uEqGcvnEbw-nMZfSWEM5OkDmeYEccMJ8-yhXeZa1T-3DnHpo2MRC1ewpBuezwDhE04pucSEH5uW1HzlM0IgaFpEaRXllaA Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersTestJSON-1457868986 Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersTestJSON-1457868986-project Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: e557d91b49c143499d809a55e85932fd Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersTestJSON-1457868986-project Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance ca4c8bfe-e06d-427f-85fb-1d2729572b07 could not be found. Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'ca4c8bfe-e06d-427f-85fb-1d2729572b07'} Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca4c8bfe-e06d-427f-85fb-1d2729572b07 could not be found. Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca4c8bfe-e06d-427f-85fb-1d2729572b07 could not be found. Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:53.283156 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.287082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:53.287082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:53.287082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:53.287082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:06:53.287082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:06:53.287082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca4c8bfe-e06d-427f-85fb-1d2729572b07 could not be found. Sep 24 21:06:53.287082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.287082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-325291b5-bf8c-4a53-a19c-ce733388efd4 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Returning 404 to user: Instance ca4c8bfe-e06d-427f-85fb-1d2729572b07 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:06:53.287082 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-325291b5-bf8c-4a53-a19c-ce733388efd4 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07" status: 404 len: 111 microversion: 2.1 time: 0.048153 Sep 24 21:06:53.287082 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2225/4443] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:53 2022] GET /compute/v2.1/servers/ca4c8bfe-e06d-427f-85fb-1d2729572b07 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:06:53.294292 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a0240839-8836-44da-8b69-756dcd3f9d1a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:53.295188 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a0240839-8836-44da-8b69-756dcd3f9d1a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 81ced789-a25d-407f-89e3-a65be79d2edd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:53.303876 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a0240839-8836-44da-8b69-756dcd3f9d1a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:53.304637 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a0240839-8836-44da-8b69-756dcd3f9d1a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:53.305756 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a0240839-8836-44da-8b69-756dcd3f9d1a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:53.307031 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a0240839-8836-44da-8b69-756dcd3f9d1a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:53.307606 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a0240839-8836-44da-8b69-756dcd3f9d1a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:53.308139 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a0240839-8836-44da-8b69-756dcd3f9d1a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:53.326175 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-a0240839-8836-44da-8b69-756dcd3f9d1a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] HTTP exception thrown: Instance 81ced789-a25d-407f-89e3-a65be79d2edd could not be found. Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a0240839-8836-44da-8b69-756dcd3f9d1a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Request method failure captured: Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/servers/81ced789-a25d-407f-89e3-a65be79d2edd HTTP/1.1 Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3CaLUabI_YBYC2XnM21T8dL5FNXXvceQt6A3bijM2xUqNxa7o1mArSf5dFDgPeh3vgkyUYVZenobpLU3uEqGcvnEbw-nMZfSWEM5OkDmeYEccMJ8-yhXeZa1T-3DnHpo2MRC1ewpBuezwDhE04pucSEH5uW1HzlM0IgaFpEaRXllaA Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersTestJSON-1457868986 Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersTestJSON-1457868986-project Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: e557d91b49c143499d809a55e85932fd Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersTestJSON-1457868986-project Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 81ced789-a25d-407f-89e3-a65be79d2edd could not be found. Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '81ced789-a25d-407f-89e3-a65be79d2edd'} Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81ced789-a25d-407f-89e3-a65be79d2edd could not be found. Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:06:53.327961 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81ced789-a25d-407f-89e3-a65be79d2edd could not be found. Sep 24 21:06:53.331769 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.331769 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:53.331769 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.331769 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:53.331769 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:53.331769 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:53.331769 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:06:53.331769 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:06:53.331769 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81ced789-a25d-407f-89e3-a65be79d2edd could not be found. Sep 24 21:06:53.331769 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.331769 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a0240839-8836-44da-8b69-756dcd3f9d1a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Returning 404 to user: Instance 81ced789-a25d-407f-89e3-a65be79d2edd could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:06:53.331769 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a0240839-8836-44da-8b69-756dcd3f9d1a tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "DELETE /compute/v2.1/servers/81ced789-a25d-407f-89e3-a65be79d2edd" status: 404 len: 111 microversion: 2.1 time: 0.041183 Sep 24 21:06:53.335124 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2219/4444] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:06:53 2022] DELETE /compute/v2.1/servers/81ced789-a25d-407f-89e3-a65be79d2edd => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:06:53.341683 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-71cc949d-30f1-46bd-937f-5d03433b98bd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:53.342745 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-71cc949d-30f1-46bd-937f-5d03433b98bd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 81ced789-a25d-407f-89e3-a65be79d2edd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:53.349808 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71cc949d-30f1-46bd-937f-5d03433b98bd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:53.351538 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71cc949d-30f1-46bd-937f-5d03433b98bd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:53.352747 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71cc949d-30f1-46bd-937f-5d03433b98bd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:53.354046 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71cc949d-30f1-46bd-937f-5d03433b98bd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:53.354828 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71cc949d-30f1-46bd-937f-5d03433b98bd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:53.355552 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71cc949d-30f1-46bd-937f-5d03433b98bd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:53.375619 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-71cc949d-30f1-46bd-937f-5d03433b98bd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] HTTP exception thrown: Instance 81ced789-a25d-407f-89e3-a65be79d2edd could not be found. Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-71cc949d-30f1-46bd-937f-5d03433b98bd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Request method failure captured: Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/81ced789-a25d-407f-89e3-a65be79d2edd HTTP/1.1 Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3CaLUabI_YBYC2XnM21T8dL5FNXXvceQt6A3bijM2xUqNxa7o1mArSf5dFDgPeh3vgkyUYVZenobpLU3uEqGcvnEbw-nMZfSWEM5OkDmeYEccMJ8-yhXeZa1T-3DnHpo2MRC1ewpBuezwDhE04pucSEH5uW1HzlM0IgaFpEaRXllaA Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersTestJSON-1457868986 Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersTestJSON-1457868986-project Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: e557d91b49c143499d809a55e85932fd Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersTestJSON-1457868986-project Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 81ced789-a25d-407f-89e3-a65be79d2edd could not be found. Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '81ced789-a25d-407f-89e3-a65be79d2edd'} Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81ced789-a25d-407f-89e3-a65be79d2edd could not be found. Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81ced789-a25d-407f-89e3-a65be79d2edd could not be found. Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:53.377919 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.381106 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:53.381106 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:53.381106 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:53.381106 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:06:53.381106 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:06:53.381106 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81ced789-a25d-407f-89e3-a65be79d2edd could not be found. Sep 24 21:06:53.381106 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.383362 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-71cc949d-30f1-46bd-937f-5d03433b98bd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Returning 404 to user: Instance 81ced789-a25d-407f-89e3-a65be79d2edd could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:06:53.384502 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-71cc949d-30f1-46bd-937f-5d03433b98bd tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/81ced789-a25d-407f-89e3-a65be79d2edd" status: 404 len: 111 microversion: 2.1 time: 0.047206 Sep 24 21:06:53.385592 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2226/4445] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:53 2022] GET /compute/v2.1/servers/81ced789-a25d-407f-89e3-a65be79d2edd => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:06:53.396736 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8ad0ab03-1b86-46dc-9aca-85568e81123d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:53.397471 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8ad0ab03-1b86-46dc-9aca-85568e81123d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ff3106d1-5214-48ea-857b-fd505d8712c7] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:53.407330 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8ad0ab03-1b86-46dc-9aca-85568e81123d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:53.408750 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8ad0ab03-1b86-46dc-9aca-85568e81123d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:53.409584 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8ad0ab03-1b86-46dc-9aca-85568e81123d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:53.410633 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8ad0ab03-1b86-46dc-9aca-85568e81123d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:53.418376 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8ad0ab03-1b86-46dc-9aca-85568e81123d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:53.418967 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8ad0ab03-1b86-46dc-9aca-85568e81123d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:53.447659 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-8ad0ab03-1b86-46dc-9aca-85568e81123d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] HTTP exception thrown: Instance ff3106d1-5214-48ea-857b-fd505d8712c7 could not be found. Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8ad0ab03-1b86-46dc-9aca-85568e81123d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Request method failure captured: Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/servers/ff3106d1-5214-48ea-857b-fd505d8712c7 HTTP/1.1 Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3CaLUabI_YBYC2XnM21T8dL5FNXXvceQt6A3bijM2xUqNxa7o1mArSf5dFDgPeh3vgkyUYVZenobpLU3uEqGcvnEbw-nMZfSWEM5OkDmeYEccMJ8-yhXeZa1T-3DnHpo2MRC1ewpBuezwDhE04pucSEH5uW1HzlM0IgaFpEaRXllaA Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersTestJSON-1457868986 Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersTestJSON-1457868986-project Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: e557d91b49c143499d809a55e85932fd Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersTestJSON-1457868986-project Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance ff3106d1-5214-48ea-857b-fd505d8712c7 could not be found. Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'ff3106d1-5214-48ea-857b-fd505d8712c7'} Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff3106d1-5214-48ea-857b-fd505d8712c7 could not be found. Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:06:53.450173 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff3106d1-5214-48ea-857b-fd505d8712c7 could not be found. Sep 24 21:06:53.453609 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.453609 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:53.453609 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.453609 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:53.453609 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:53.453609 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:53.453609 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:06:53.453609 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:06:53.453609 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff3106d1-5214-48ea-857b-fd505d8712c7 could not be found. Sep 24 21:06:53.453609 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.455312 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8ad0ab03-1b86-46dc-9aca-85568e81123d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Returning 404 to user: Instance ff3106d1-5214-48ea-857b-fd505d8712c7 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:06:53.456375 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8ad0ab03-1b86-46dc-9aca-85568e81123d tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ff3106d1-5214-48ea-857b-fd505d8712c7" status: 404 len: 111 microversion: 2.1 time: 0.066242 Sep 24 21:06:53.465915 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2220/4446] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:06:53 2022] DELETE /compute/v2.1/servers/ff3106d1-5214-48ea-857b-fd505d8712c7 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:06:53.466485 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d6393e7a-70b3-451b-af25-c99106bd6e40 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:53.467978 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d6393e7a-70b3-451b-af25-c99106bd6e40 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: ff3106d1-5214-48ea-857b-fd505d8712c7] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:53.478836 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6393e7a-70b3-451b-af25-c99106bd6e40 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:53.479652 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6393e7a-70b3-451b-af25-c99106bd6e40 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:53.480978 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6393e7a-70b3-451b-af25-c99106bd6e40 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:53.483570 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6393e7a-70b3-451b-af25-c99106bd6e40 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:53.485652 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6393e7a-70b3-451b-af25-c99106bd6e40 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:53.486198 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6393e7a-70b3-451b-af25-c99106bd6e40 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:53.510933 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-d6393e7a-70b3-451b-af25-c99106bd6e40 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] HTTP exception thrown: Instance ff3106d1-5214-48ea-857b-fd505d8712c7 could not be found. Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d6393e7a-70b3-451b-af25-c99106bd6e40 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Request method failure captured: Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/ff3106d1-5214-48ea-857b-fd505d8712c7 HTTP/1.1 Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3CaLUabI_YBYC2XnM21T8dL5FNXXvceQt6A3bijM2xUqNxa7o1mArSf5dFDgPeh3vgkyUYVZenobpLU3uEqGcvnEbw-nMZfSWEM5OkDmeYEccMJ8-yhXeZa1T-3DnHpo2MRC1ewpBuezwDhE04pucSEH5uW1HzlM0IgaFpEaRXllaA Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersTestJSON-1457868986 Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersTestJSON-1457868986-project Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: e557d91b49c143499d809a55e85932fd Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersTestJSON-1457868986-project Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance ff3106d1-5214-48ea-857b-fd505d8712c7 could not be found. Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'ff3106d1-5214-48ea-857b-fd505d8712c7'} Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff3106d1-5214-48ea-857b-fd505d8712c7 could not be found. Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff3106d1-5214-48ea-857b-fd505d8712c7 could not be found. Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:53.512788 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.516238 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:53.516238 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:53.516238 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:53.516238 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:06:53.516238 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:06:53.516238 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff3106d1-5214-48ea-857b-fd505d8712c7 could not be found. Sep 24 21:06:53.516238 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.519651 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d6393e7a-70b3-451b-af25-c99106bd6e40 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Returning 404 to user: Instance ff3106d1-5214-48ea-857b-fd505d8712c7 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:06:53.520335 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d6393e7a-70b3-451b-af25-c99106bd6e40 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/ff3106d1-5214-48ea-857b-fd505d8712c7" status: 404 len: 111 microversion: 2.1 time: 0.058442 Sep 24 21:06:53.529264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e2ff04c0-b168-43be-9358-39a40f7f4272 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:53.529630 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e2ff04c0-b168-43be-9358-39a40f7f4272 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 66e31e89-34c3-4cf9-b35d-8084f9c5a509] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:53.532898 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2227/4447] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:53 2022] GET /compute/v2.1/servers/ff3106d1-5214-48ea-857b-fd505d8712c7 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 21:06:53.536421 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-e2ff04c0-b168-43be-9358-39a40f7f4272 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] HTTP exception thrown: Instance 66e31e89-34c3-4cf9-b35d-8084f9c5a509 could not be found. Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e2ff04c0-b168-43be-9358-39a40f7f4272 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Request method failure captured: Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/servers/66e31e89-34c3-4cf9-b35d-8084f9c5a509 HTTP/1.1 Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3CaLUabI_YBYC2XnM21T8dL5FNXXvceQt6A3bijM2xUqNxa7o1mArSf5dFDgPeh3vgkyUYVZenobpLU3uEqGcvnEbw-nMZfSWEM5OkDmeYEccMJ8-yhXeZa1T-3DnHpo2MRC1ewpBuezwDhE04pucSEH5uW1HzlM0IgaFpEaRXllaA Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersTestJSON-1457868986 Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersTestJSON-1457868986-project Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: e557d91b49c143499d809a55e85932fd Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersTestJSON-1457868986-project Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 66e31e89-34c3-4cf9-b35d-8084f9c5a509 could not be found. Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '66e31e89-34c3-4cf9-b35d-8084f9c5a509'} Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66e31e89-34c3-4cf9-b35d-8084f9c5a509 could not be found. Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66e31e89-34c3-4cf9-b35d-8084f9c5a509 could not be found. Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:53.538708 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.541816 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:53.541816 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:53.541816 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:53.541816 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:06:53.541816 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:06:53.541816 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66e31e89-34c3-4cf9-b35d-8084f9c5a509 could not be found. Sep 24 21:06:53.541816 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.543439 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e2ff04c0-b168-43be-9358-39a40f7f4272 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Returning 404 to user: Instance 66e31e89-34c3-4cf9-b35d-8084f9c5a509 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:06:53.544484 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e2ff04c0-b168-43be-9358-39a40f7f4272 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "DELETE /compute/v2.1/servers/66e31e89-34c3-4cf9-b35d-8084f9c5a509" status: 404 len: 111 microversion: 2.1 time: 0.019228 Sep 24 21:06:53.545526 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2221/4448] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:06:53 2022] DELETE /compute/v2.1/servers/66e31e89-34c3-4cf9-b35d-8084f9c5a509 => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 21:06:53.554171 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e2ef0aa3-a215-4963-95e8-001712b06f87 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:53.555034 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e2ef0aa3-a215-4963-95e8-001712b06f87 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 66e31e89-34c3-4cf9-b35d-8084f9c5a509] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:53.576043 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-e2ef0aa3-a215-4963-95e8-001712b06f87 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] HTTP exception thrown: Instance 66e31e89-34c3-4cf9-b35d-8084f9c5a509 could not be found. Sep 24 21:06:53.577906 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-accef886-6a8b-4bff-8aee-4d5b81326822 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e2ef0aa3-a215-4963-95e8-001712b06f87 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Request method failure captured: Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/66e31e89-34c3-4cf9-b35d-8084f9c5a509 HTTP/1.1 Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3CaLUabI_YBYC2XnM21T8dL5FNXXvceQt6A3bijM2xUqNxa7o1mArSf5dFDgPeh3vgkyUYVZenobpLU3uEqGcvnEbw-nMZfSWEM5OkDmeYEccMJ8-yhXeZa1T-3DnHpo2MRC1ewpBuezwDhE04pucSEH5uW1HzlM0IgaFpEaRXllaA Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersTestJSON-1457868986 Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersTestJSON-1457868986-project Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: e557d91b49c143499d809a55e85932fd Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersTestJSON-1457868986-project Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 66e31e89-34c3-4cf9-b35d-8084f9c5a509 could not be found. Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '66e31e89-34c3-4cf9-b35d-8084f9c5a509'} Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66e31e89-34c3-4cf9-b35d-8084f9c5a509 could not be found. Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66e31e89-34c3-4cf9-b35d-8084f9c5a509 could not be found. Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:06:53.578024 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:06:53.581747 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:06:53.581747 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:06:53.581747 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:06:53.581747 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66e31e89-34c3-4cf9-b35d-8084f9c5a509 could not be found. Sep 24 21:06:53.581747 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:06:53.583759 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e2ef0aa3-a215-4963-95e8-001712b06f87 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Returning 404 to user: Instance 66e31e89-34c3-4cf9-b35d-8084f9c5a509 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:06:53.584852 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-accef886-6a8b-4bff-8aee-4d5b81326822 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] [instance: 4bbb3958-6fd0-4c00-adff-4865f868d0bc] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:53.586738 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e2ef0aa3-a215-4963-95e8-001712b06f87 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/66e31e89-34c3-4cf9-b35d-8084f9c5a509" status: 404 len: 111 microversion: 2.1 time: 0.036728 Sep 24 21:06:53.587833 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2228/4449] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:53 2022] GET /compute/v2.1/servers/66e31e89-34c3-4cf9-b35d-8084f9c5a509 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:06:53.597368 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-89cd2e00-887c-4ec0-84dc-5a0da927227f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:53.601699 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-accef886-6a8b-4bff-8aee-4d5b81326822 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:53.602771 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-accef886-6a8b-4bff-8aee-4d5b81326822 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:53.603454 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-accef886-6a8b-4bff-8aee-4d5b81326822 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:53.604715 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-accef886-6a8b-4bff-8aee-4d5b81326822 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:53.605409 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-accef886-6a8b-4bff-8aee-4d5b81326822 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:53.606182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-accef886-6a8b-4bff-8aee-4d5b81326822 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:53.611272 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-89cd2e00-887c-4ec0-84dc-5a0da927227f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 51c91704-c6eb-47bf-b3d1-9899df6ce119] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:53.651070 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-89cd2e00-887c-4ec0-84dc-5a0da927227f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:53.651587 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-89cd2e00-887c-4ec0-84dc-5a0da927227f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:53.655947 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-89cd2e00-887c-4ec0-84dc-5a0da927227f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:53.662204 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-89cd2e00-887c-4ec0-84dc-5a0da927227f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:53.665790 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-89cd2e00-887c-4ec0-84dc-5a0da927227f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:53.667345 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-89cd2e00-887c-4ec0-84dc-5a0da927227f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:53.804244 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-accef886-6a8b-4bff-8aee-4d5b81326822 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd142c33eccd048bfa3415b1661ee373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c1b7c4c6ff480c82a1f9708b7dbe62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:53.840078 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-accef886-6a8b-4bff-8aee-4d5b81326822 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] 10.222.0.52 "GET /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc" status: 200 len: 1276 microversion: 2.1 time: 0.263091 Sep 24 21:06:53.844787 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2222/4450] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:53 2022] GET /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc => generated 1276 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:06:53.866261 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cea031d9-8228-43b8-9898-b198b80e2247 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:53.868374 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cea031d9-8228-43b8-9898-b198b80e2247 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 17aa6306-aefd-4e46-b6b7-808b5b7224fb] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:53.880582 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cea031d9-8228-43b8-9898-b198b80e2247 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:53.882746 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cea031d9-8228-43b8-9898-b198b80e2247 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:53.885674 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cea031d9-8228-43b8-9898-b198b80e2247 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:53.887448 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cea031d9-8228-43b8-9898-b198b80e2247 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:53.890774 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cea031d9-8228-43b8-9898-b198b80e2247 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:53.891278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cea031d9-8228-43b8-9898-b198b80e2247 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:53.961026 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cea031d9-8228-43b8-9898-b198b80e2247 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 17aa6306-aefd-4e46-b6b7-808b5b7224fb] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:06:54.115025 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cea031d9-8228-43b8-9898-b198b80e2247 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "DELETE /compute/v2.1/servers/17aa6306-aefd-4e46-b6b7-808b5b7224fb" status: 204 len: 0 microversion: 2.1 time: 0.264084 Sep 24 21:06:54.120818 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2223/4451] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:06:53 2022] DELETE /compute/v2.1/servers/17aa6306-aefd-4e46-b6b7-808b5b7224fb => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:06:54.135222 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d8ea0850-c5b3-432a-8f92-29be6bfdebe7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:54.136384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d8ea0850-c5b3-432a-8f92-29be6bfdebe7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 17aa6306-aefd-4e46-b6b7-808b5b7224fb] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:54.149107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d8ea0850-c5b3-432a-8f92-29be6bfdebe7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:54.150734 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d8ea0850-c5b3-432a-8f92-29be6bfdebe7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:54.152745 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d8ea0850-c5b3-432a-8f92-29be6bfdebe7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:54.153908 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d8ea0850-c5b3-432a-8f92-29be6bfdebe7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:54.154763 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d8ea0850-c5b3-432a-8f92-29be6bfdebe7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:54.155391 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d8ea0850-c5b3-432a-8f92-29be6bfdebe7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:54.478903 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-89cd2e00-887c-4ec0-84dc-5a0da927227f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:54.490372 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-89cd2e00-887c-4ec0-84dc-5a0da927227f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119" status: 200 len: 1315 microversion: 2.1 time: 0.900575 Sep 24 21:06:54.491397 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2229/4452] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:53 2022] GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119 => generated 1315 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:54.579063 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d8ea0850-c5b3-432a-8f92-29be6bfdebe7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:54.590821 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d8ea0850-c5b3-432a-8f92-29be6bfdebe7 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/17aa6306-aefd-4e46-b6b7-808b5b7224fb" status: 200 len: 1481 microversion: 2.1 time: 0.467350 Sep 24 21:06:54.613149 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2224/4453] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:54 2022] GET /compute/v2.1/servers/17aa6306-aefd-4e46-b6b7-808b5b7224fb => generated 1481 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:54.740043 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-58d9eaa2-0dad-44dd-aac4-97a3b60eb802 req-04850fd9-b00b-475a-9a00-e3391d266a95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51c91704-c6eb-47bf-b3d1-9899df6ce119", "name": "network-vif-plugged", "status": "completed", "tag": "cb689b35-55b9-4a33-8d15-19ff8d5cc56b"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:06:54.786089 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-58d9eaa2-0dad-44dd-aac4-97a3b60eb802 req-04850fd9-b00b-475a-9a00-e3391d266a95 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:54.787837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-58d9eaa2-0dad-44dd-aac4-97a3b60eb802 req-04850fd9-b00b-475a-9a00-e3391d266a95 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:54.789159 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-58d9eaa2-0dad-44dd-aac4-97a3b60eb802 req-04850fd9-b00b-475a-9a00-e3391d266a95 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:54.815521 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-58d9eaa2-0dad-44dd-aac4-97a3b60eb802 req-04850fd9-b00b-475a-9a00-e3391d266a95 service nova] Creating event network-vif-plugged:cb689b35-55b9-4a33-8d15-19ff8d5cc56b for instance 51c91704-c6eb-47bf-b3d1-9899df6ce119 on nch1-master-1 Sep 24 21:06:54.826456 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-58d9eaa2-0dad-44dd-aac4-97a3b60eb802 req-04850fd9-b00b-475a-9a00-e3391d266a95 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092762 Sep 24 21:06:54.827674 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2230/4454] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:06:54.869277 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c87b7620-b2c0-43d7-a038-cac2267982bb tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:54.871472 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c87b7620-b2c0-43d7-a038-cac2267982bb tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] [instance: 4bbb3958-6fd0-4c00-adff-4865f868d0bc] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:54.882711 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c87b7620-b2c0-43d7-a038-cac2267982bb tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:54.884778 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c87b7620-b2c0-43d7-a038-cac2267982bb tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:54.885858 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c87b7620-b2c0-43d7-a038-cac2267982bb tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:54.887710 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c87b7620-b2c0-43d7-a038-cac2267982bb tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:54.888374 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c87b7620-b2c0-43d7-a038-cac2267982bb tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:54.889032 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c87b7620-b2c0-43d7-a038-cac2267982bb tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:55.019645 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c87b7620-b2c0-43d7-a038-cac2267982bb tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd142c33eccd048bfa3415b1661ee373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c1b7c4c6ff480c82a1f9708b7dbe62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:55.028045 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c87b7620-b2c0-43d7-a038-cac2267982bb tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] 10.222.0.52 "GET /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc" status: 200 len: 1294 microversion: 2.1 time: 0.162690 Sep 24 21:06:55.029107 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2225/4455] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:54 2022] GET /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc => generated 1294 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:55.529386 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5dc5726e-05ad-4ad4-9c7b-902669079795 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:55.530467 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5dc5726e-05ad-4ad4-9c7b-902669079795 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 51c91704-c6eb-47bf-b3d1-9899df6ce119] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:55.547555 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5dc5726e-05ad-4ad4-9c7b-902669079795 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:55.548406 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5dc5726e-05ad-4ad4-9c7b-902669079795 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:55.549104 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5dc5726e-05ad-4ad4-9c7b-902669079795 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:55.552647 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5dc5726e-05ad-4ad4-9c7b-902669079795 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:55.553720 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5dc5726e-05ad-4ad4-9c7b-902669079795 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:55.555012 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5dc5726e-05ad-4ad4-9c7b-902669079795 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:55.621682 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f104431a-1fe7-4dd1-acd7-322f4490666f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:55.624044 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f104431a-1fe7-4dd1-acd7-322f4490666f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 17aa6306-aefd-4e46-b6b7-808b5b7224fb] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:55.641974 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f104431a-1fe7-4dd1-acd7-322f4490666f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:55.642759 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f104431a-1fe7-4dd1-acd7-322f4490666f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:55.643399 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f104431a-1fe7-4dd1-acd7-322f4490666f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:55.644367 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f104431a-1fe7-4dd1-acd7-322f4490666f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:55.645053 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f104431a-1fe7-4dd1-acd7-322f4490666f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:55.645732 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f104431a-1fe7-4dd1-acd7-322f4490666f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:55.897102 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5dc5726e-05ad-4ad4-9c7b-902669079795 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:55.911686 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5dc5726e-05ad-4ad4-9c7b-902669079795 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119" status: 200 len: 1315 microversion: 2.1 time: 0.385812 Sep 24 21:06:55.912912 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2231/4456] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:55 2022] GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119 => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:55.991121 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f104431a-1fe7-4dd1-acd7-322f4490666f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:56.007686 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f104431a-1fe7-4dd1-acd7-322f4490666f tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/17aa6306-aefd-4e46-b6b7-808b5b7224fb" status: 200 len: 1481 microversion: 2.1 time: 0.391522 Sep 24 21:06:56.028168 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2226/4457] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:55 2022] GET /compute/v2.1/servers/17aa6306-aefd-4e46-b6b7-808b5b7224fb => generated 1481 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:56.053915 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-845f1246-1234-4180-9ac3-ad8ccc0a5e35 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:56.055532 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-845f1246-1234-4180-9ac3-ad8ccc0a5e35 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] [instance: 4bbb3958-6fd0-4c00-adff-4865f868d0bc] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:56.062778 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-845f1246-1234-4180-9ac3-ad8ccc0a5e35 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:56.063885 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-845f1246-1234-4180-9ac3-ad8ccc0a5e35 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:56.065738 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-845f1246-1234-4180-9ac3-ad8ccc0a5e35 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:56.066730 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-845f1246-1234-4180-9ac3-ad8ccc0a5e35 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:56.068882 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-845f1246-1234-4180-9ac3-ad8ccc0a5e35 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:56.069520 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-845f1246-1234-4180-9ac3-ad8ccc0a5e35 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:56.154903 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-845f1246-1234-4180-9ac3-ad8ccc0a5e35 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd142c33eccd048bfa3415b1661ee373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c1b7c4c6ff480c82a1f9708b7dbe62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:56.202627 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-845f1246-1234-4180-9ac3-ad8ccc0a5e35 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] 10.222.0.52 "GET /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc" status: 200 len: 1282 microversion: 2.1 time: 0.154527 Sep 24 21:06:56.203769 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2232/4458] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:56 2022] GET /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc => generated 1282 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:56.951468 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9e873c94-08cc-4aae-b071-79eb8e1846a4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:56.952213 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9e873c94-08cc-4aae-b071-79eb8e1846a4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 51c91704-c6eb-47bf-b3d1-9899df6ce119] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:56.967714 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e873c94-08cc-4aae-b071-79eb8e1846a4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:56.973391 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e873c94-08cc-4aae-b071-79eb8e1846a4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:56.975534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e873c94-08cc-4aae-b071-79eb8e1846a4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:56.977052 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e873c94-08cc-4aae-b071-79eb8e1846a4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:56.978478 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e873c94-08cc-4aae-b071-79eb8e1846a4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:56.994798 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e873c94-08cc-4aae-b071-79eb8e1846a4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:57.036060 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a143a95a-2830-4870-bc7e-1f90f0f7eed9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:57.036854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a143a95a-2830-4870-bc7e-1f90f0f7eed9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 17aa6306-aefd-4e46-b6b7-808b5b7224fb] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:57.078668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a143a95a-2830-4870-bc7e-1f90f0f7eed9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:57.082772 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a143a95a-2830-4870-bc7e-1f90f0f7eed9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:57.084697 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a143a95a-2830-4870-bc7e-1f90f0f7eed9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:57.087792 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a143a95a-2830-4870-bc7e-1f90f0f7eed9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:57.089769 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a143a95a-2830-4870-bc7e-1f90f0f7eed9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:57.093248 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a143a95a-2830-4870-bc7e-1f90f0f7eed9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:57.882837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a143a95a-2830-4870-bc7e-1f90f0f7eed9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:57.899511 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9e873c94-08cc-4aae-b071-79eb8e1846a4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:57.904587 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a143a95a-2830-4870-bc7e-1f90f0f7eed9 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/17aa6306-aefd-4e46-b6b7-808b5b7224fb" status: 200 len: 1481 microversion: 2.1 time: 0.874808 Sep 24 21:06:57.906426 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2233/4459] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:57 2022] GET /compute/v2.1/servers/17aa6306-aefd-4e46-b6b7-808b5b7224fb => generated 1481 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:57.924782 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-35a4db68-61ce-4cad-8252-d3ff766f78a6 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:57.926232 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-35a4db68-61ce-4cad-8252-d3ff766f78a6 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] [instance: 4bbb3958-6fd0-4c00-adff-4865f868d0bc] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:57.929299 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9e873c94-08cc-4aae-b071-79eb8e1846a4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119" status: 200 len: 1315 microversion: 2.1 time: 0.996494 Sep 24 21:06:57.940597 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2227/4460] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:56 2022] GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119 => generated 1315 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:57.947787 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-35a4db68-61ce-4cad-8252-d3ff766f78a6 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:57.948266 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-35a4db68-61ce-4cad-8252-d3ff766f78a6 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:57.948754 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-35a4db68-61ce-4cad-8252-d3ff766f78a6 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:57.949501 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-35a4db68-61ce-4cad-8252-d3ff766f78a6 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:57.949981 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-35a4db68-61ce-4cad-8252-d3ff766f78a6 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:57.950480 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-35a4db68-61ce-4cad-8252-d3ff766f78a6 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:57.951820 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2d57cf85-cc2f-4909-a24c-00415f6a5da6 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1975659540", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a7c3a4b7-da1a-4e3c-8c0c-b42a35dbeab5"}], "security_groups": [{"name": "tempest-securitygroup--114004797"}], "key_name": "tempest-keypair-1303507742", "user_data": "}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:06:58.461106 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-2d57cf85-cc2f-4909-a24c-00415f6a5da6 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] validate_networks() for [('a7c3a4b7-da1a-4e3c-8c0c-b42a35dbeab5', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:06:58.680277 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-35a4db68-61ce-4cad-8252-d3ff766f78a6 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd142c33eccd048bfa3415b1661ee373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c1b7c4c6ff480c82a1f9708b7dbe62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:58.712651 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-35a4db68-61ce-4cad-8252-d3ff766f78a6 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] 10.222.0.52 "GET /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc" status: 200 len: 1324 microversion: 2.1 time: 0.804694 Sep 24 21:06:58.713613 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2234/4461] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:57 2022] GET /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc => generated 1324 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:58.719840 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-44e71b6c-d778-4066-9b49-01470bef4314 req-5a2c15ce-9c75-4a2c-bb8a-31890526e2b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17aa6306-aefd-4e46-b6b7-808b5b7224fb", "name": "network-vif-deleted", "tag": "7ba002c9-2db4-4ec4-a4d0-e4197dae31db"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:06:58.751257 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-44e71b6c-d778-4066-9b49-01470bef4314 req-5a2c15ce-9c75-4a2c-bb8a-31890526e2b3 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:58.752656 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-44e71b6c-d778-4066-9b49-01470bef4314 req-5a2c15ce-9c75-4a2c-bb8a-31890526e2b3 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:58.753540 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-44e71b6c-d778-4066-9b49-01470bef4314 req-5a2c15ce-9c75-4a2c-bb8a-31890526e2b3 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:58.771541 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-44e71b6c-d778-4066-9b49-01470bef4314 req-5a2c15ce-9c75-4a2c-bb8a-31890526e2b3 service nova] Creating event network-vif-deleted:7ba002c9-2db4-4ec4-a4d0-e4197dae31db for instance 17aa6306-aefd-4e46-b6b7-808b5b7224fb on nch1-master-1 Sep 24 21:06:58.779628 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-44e71b6c-d778-4066-9b49-01470bef4314 req-5a2c15ce-9c75-4a2c-bb8a-31890526e2b3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064411 Sep 24 21:06:58.786787 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2235/4462] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:06:58.944612 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0c911421-9a67-48d6-8e08-df06a7337a8c tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:58.950281 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0c911421-9a67-48d6-8e08-df06a7337a8c tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 17aa6306-aefd-4e46-b6b7-808b5b7224fb] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:58.976330 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c911421-9a67-48d6-8e08-df06a7337a8c tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:58.978004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c911421-9a67-48d6-8e08-df06a7337a8c tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:58.980619 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c911421-9a67-48d6-8e08-df06a7337a8c tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:58.981568 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c911421-9a67-48d6-8e08-df06a7337a8c tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:58.982742 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c911421-9a67-48d6-8e08-df06a7337a8c tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:58.983335 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c911421-9a67-48d6-8e08-df06a7337a8c tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:59.029172 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c911421-9a67-48d6-8e08-df06a7337a8c tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:59.030143 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c911421-9a67-48d6-8e08-df06a7337a8c tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:59.030626 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c911421-9a67-48d6-8e08-df06a7337a8c tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:59.031130 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-0c911421-9a67-48d6-8e08-df06a7337a8c tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lazy-loading 'fault' on Instance uuid 17aa6306-aefd-4e46-b6b7-808b5b7224fb {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:06:59.151077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0c911421-9a67-48d6-8e08-df06a7337a8c tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e557d91b49c143499d809a55e85932fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accafa2724354ca8b1c9f19940989429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:06:59.153899 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:06:59.171708 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0c911421-9a67-48d6-8e08-df06a7337a8c tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/17aa6306-aefd-4e46-b6b7-808b5b7224fb" status: 200 len: 1283 microversion: 2.1 time: 0.242433 Sep 24 21:06:59.197860 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2236/4463] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:58 2022] GET /compute/v2.1/servers/17aa6306-aefd-4e46-b6b7-808b5b7224fb => generated 1283 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:06:59.203068 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7de96e11-17f2-4dc2-89f2-d506b0aaf6b6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:06:59.203868 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7de96e11-17f2-4dc2-89f2-d506b0aaf6b6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 51c91704-c6eb-47bf-b3d1-9899df6ce119] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:06:59.212022 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7de96e11-17f2-4dc2-89f2-d506b0aaf6b6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:59.212697 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7de96e11-17f2-4dc2-89f2-d506b0aaf6b6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:59.213284 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7de96e11-17f2-4dc2-89f2-d506b0aaf6b6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:59.214177 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7de96e11-17f2-4dc2-89f2-d506b0aaf6b6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:59.214809 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7de96e11-17f2-4dc2-89f2-d506b0aaf6b6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:59.215381 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7de96e11-17f2-4dc2-89f2-d506b0aaf6b6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:59.842546 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-2d57cf85-cc2f-4909-a24c-00415f6a5da6 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:06:59.843552 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-2d57cf85-cc2f-4909-a24c-00415f6a5da6 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:06:59.844221 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-2d57cf85-cc2f-4909-a24c-00415f6a5da6 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:06:59.844777 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-2d57cf85-cc2f-4909-a24c-00415f6a5da6 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:06:59.845344 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-2d57cf85-cc2f-4909-a24c-00415f6a5da6 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:06:59.869015 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2d57cf85-cc2f-4909-a24c-00415f6a5da6 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:59.869816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2d57cf85-cc2f-4909-a24c-00415f6a5da6 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:59.871228 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2d57cf85-cc2f-4909-a24c-00415f6a5da6 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:59.872161 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2d57cf85-cc2f-4909-a24c-00415f6a5da6 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:06:59.872785 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2d57cf85-cc2f-4909-a24c-00415f6a5da6 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:06:59.873392 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2d57cf85-cc2f-4909-a24c-00415f6a5da6 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:06:59.932839 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-2d57cf85-cc2f-4909-a24c-00415f6a5da6 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Getting quotas for project d0e5867b34544cadbb354439808248aa. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:06:59.945571 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-2d57cf85-cc2f-4909-a24c-00415f6a5da6 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Getting quotas for user 9eca15a31e064f4199bfc4b04de7c5b2 and project d0e5867b34544cadbb354439808248aa. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:06:59.979699 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2d57cf85-cc2f-4909-a24c-00415f6a5da6 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:06:59.989208 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2d57cf85-cc2f-4909-a24c-00415f6a5da6 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 0896ae3f-f6f6-49dd-87df-c73f911c78be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:07:00.096654 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2d57cf85-cc2f-4909-a24c-00415f6a5da6 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.147980 Sep 24 21:07:00.105293 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2228/4464] 10.222.0.52 () {62 vars in 1188 bytes} [Sat Sep 24 21:06:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 2164 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 24 21:07:00.128253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b7a7e02a-0c10-4265-bcd3-88414ecb2063 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:00.129241 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b7a7e02a-0c10-4265-bcd3-88414ecb2063 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] [instance: 4bbb3958-6fd0-4c00-adff-4865f868d0bc] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:00.139133 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7a7e02a-0c10-4265-bcd3-88414ecb2063 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:00.139645 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7a7e02a-0c10-4265-bcd3-88414ecb2063 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:00.140138 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7a7e02a-0c10-4265-bcd3-88414ecb2063 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:00.140901 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7a7e02a-0c10-4265-bcd3-88414ecb2063 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:00.142205 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7a7e02a-0c10-4265-bcd3-88414ecb2063 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:00.143437 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7a7e02a-0c10-4265-bcd3-88414ecb2063 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:00.149600 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:07:00.280191 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7de96e11-17f2-4dc2-89f2-d506b0aaf6b6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:00.292955 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7de96e11-17f2-4dc2-89f2-d506b0aaf6b6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119" status: 200 len: 1503 microversion: 2.1 time: 1.093818 Sep 24 21:07:00.293752 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2237/4465] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:06:59 2022] GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119 => generated 1503 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:00.318366 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-975d96f4-e02c-4f0b-a592-87dd33dcd69d tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:00.319342 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-975d96f4-e02c-4f0b-a592-87dd33dcd69d tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 0896ae3f-f6f6-49dd-87df-c73f911c78be] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:00.337433 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:07:00.501144 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-975d96f4-e02c-4f0b-a592-87dd33dcd69d tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:00.510319 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-975d96f4-e02c-4f0b-a592-87dd33dcd69d tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:00.513368 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b7a7e02a-0c10-4265-bcd3-88414ecb2063 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd142c33eccd048bfa3415b1661ee373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c1b7c4c6ff480c82a1f9708b7dbe62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:00.518710 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-975d96f4-e02c-4f0b-a592-87dd33dcd69d tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:00.519755 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-975d96f4-e02c-4f0b-a592-87dd33dcd69d tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be" status: 200 len: 1282 microversion: 2.20 time: 0.224902 Sep 24 21:07:00.525536 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b7a7e02a-0c10-4265-bcd3-88414ecb2063 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] 10.222.0.52 "GET /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc" status: 200 len: 1324 microversion: 2.1 time: 0.419057 Sep 24 21:07:00.532250 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2238/4466] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:00 2022] GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be => generated 1282 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:00.548110 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2229/4467] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:00 2022] GET /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc => generated 1324 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:00.560845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f6929bb7-67d9-478a-9d3c-203440505b38 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:07:00.564877 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0c3b98f9-cde5-4780-b3b9-f77ccf1f6324 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:00.565503 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0c3b98f9-cde5-4780-b3b9-f77ccf1f6324 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] [instance: 17aa6306-aefd-4e46-b6b7-808b5b7224fb] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:00.575387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f6929bb7-67d9-478a-9d3c-203440505b38 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 51c91704-c6eb-47bf-b3d1-9899df6ce119] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:00.589558 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6929bb7-67d9-478a-9d3c-203440505b38 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:00.593150 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6929bb7-67d9-478a-9d3c-203440505b38 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:00.593911 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6929bb7-67d9-478a-9d3c-203440505b38 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:00.597125 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c3b98f9-cde5-4780-b3b9-f77ccf1f6324 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:00.597639 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c3b98f9-cde5-4780-b3b9-f77ccf1f6324 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:00.597759 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6929bb7-67d9-478a-9d3c-203440505b38 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:00.598103 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c3b98f9-cde5-4780-b3b9-f77ccf1f6324 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:00.598841 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c3b98f9-cde5-4780-b3b9-f77ccf1f6324 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:00.599354 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6929bb7-67d9-478a-9d3c-203440505b38 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:00.599716 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c3b98f9-cde5-4780-b3b9-f77ccf1f6324 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:00.600311 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6929bb7-67d9-478a-9d3c-203440505b38 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:00.600531 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c3b98f9-cde5-4780-b3b9-f77ccf1f6324 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:00.626624 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-0c3b98f9-cde5-4780-b3b9-f77ccf1f6324 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] HTTP exception thrown: Instance 17aa6306-aefd-4e46-b6b7-808b5b7224fb could not be found. Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0c3b98f9-cde5-4780-b3b9-f77ccf1f6324 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Request method failure captured: Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/17aa6306-aefd-4e46-b6b7-808b5b7224fb HTTP/1.1 Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3CaLUabI_YBYC2XnM21T8dL5FNXXvceQt6A3bijM2xUqNxa7o1mArSf5dFDgPeh3vgkyUYVZenobpLU3uEqGcvnEbw-nMZfSWEM5OkDmeYEccMJ8-yhXeZa1T-3DnHpo2MRC1ewpBuezwDhE04pucSEH5uW1HzlM0IgaFpEaRXllaA Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/accafa2724354ca8b1c9f19940989429"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/accafa2724354ca8b1c9f19940989429"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersTestJSON-1457868986 Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: accafa2724354ca8b1c9f19940989429 Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersTestJSON-1457868986 Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersTestJSON-1457868986-project Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: e557d91b49c143499d809a55e85932fd Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersTestJSON-1457868986-project Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 17aa6306-aefd-4e46-b6b7-808b5b7224fb could not be found. Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '17aa6306-aefd-4e46-b6b7-808b5b7224fb'} Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17aa6306-aefd-4e46-b6b7-808b5b7224fb could not be found. Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17aa6306-aefd-4e46-b6b7-808b5b7224fb could not be found. Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:07:00.652428 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:07:00.656368 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:07:00.656368 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:07:00.656368 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:07:00.656368 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:07:00.656368 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:07:00.656368 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17aa6306-aefd-4e46-b6b7-808b5b7224fb could not be found. Sep 24 21:07:00.656368 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:07:00.656368 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0c3b98f9-cde5-4780-b3b9-f77ccf1f6324 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] Returning 404 to user: Instance 17aa6306-aefd-4e46-b6b7-808b5b7224fb could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:07:00.656368 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0c3b98f9-cde5-4780-b3b9-f77ccf1f6324 tempest-ServersTestJSON-1457868986 tempest-ServersTestJSON-1457868986-project] 10.222.0.52 "GET /compute/v2.1/servers/17aa6306-aefd-4e46-b6b7-808b5b7224fb" status: 404 len: 111 microversion: 2.1 time: 0.104130 Sep 24 21:07:00.659787 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2239/4468] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:00 2022] GET /compute/v2.1/servers/17aa6306-aefd-4e46-b6b7-808b5b7224fb => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:07:00.921060 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-f65df28a-b974-41c2-a65d-6f7be4fbe09f req-40098160-6aef-4d20-8861-21d2fb0922c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bbb3958-6fd0-4c00-adff-4865f868d0bc", "tag": "2a899001-3efd-4a15-95d6-c3d508ff2fe3"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:07:00.941111 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-f65df28a-b974-41c2-a65d-6f7be4fbe09f req-40098160-6aef-4d20-8861-21d2fb0922c0 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:00.943285 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-f65df28a-b974-41c2-a65d-6f7be4fbe09f req-40098160-6aef-4d20-8861-21d2fb0922c0 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:00.946909 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-f65df28a-b974-41c2-a65d-6f7be4fbe09f req-40098160-6aef-4d20-8861-21d2fb0922c0 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:00.973622 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-f65df28a-b974-41c2-a65d-6f7be4fbe09f req-40098160-6aef-4d20-8861-21d2fb0922c0 service nova] Creating event network-changed:2a899001-3efd-4a15-95d6-c3d508ff2fe3 for instance 4bbb3958-6fd0-4c00-adff-4865f868d0bc on nch1-master-1 Sep 24 21:07:00.989368 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-f65df28a-b974-41c2-a65d-6f7be4fbe09f req-40098160-6aef-4d20-8861-21d2fb0922c0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069884 Sep 24 21:07:00.993462 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2240/4469] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:07:01.562924 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e22b8a9f-b687-43e9-a06d-8ab73f4b8e07 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:01.563647 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e22b8a9f-b687-43e9-a06d-8ab73f4b8e07 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 0896ae3f-f6f6-49dd-87df-c73f911c78be] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:01.585256 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e22b8a9f-b687-43e9-a06d-8ab73f4b8e07 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:01.586307 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e22b8a9f-b687-43e9-a06d-8ab73f4b8e07 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:01.587876 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e22b8a9f-b687-43e9-a06d-8ab73f4b8e07 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:01.590776 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e22b8a9f-b687-43e9-a06d-8ab73f4b8e07 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:01.591509 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e22b8a9f-b687-43e9-a06d-8ab73f4b8e07 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:01.592756 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e22b8a9f-b687-43e9-a06d-8ab73f4b8e07 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:01.618742 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.network.security_group_api [None req-f6929bb7-67d9-478a-9d3c-203440505b38 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Removing security group 3dcdaa8d-2341-4090-b387-3ec16f7cb83a from port cb689b35-55b9-4a33-8d15-19ff8d5cc56b Sep 24 21:07:01.746445 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e22b8a9f-b687-43e9-a06d-8ab73f4b8e07 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:01.768346 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e22b8a9f-b687-43e9-a06d-8ab73f4b8e07 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:01.770320 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e22b8a9f-b687-43e9-a06d-8ab73f4b8e07 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:01.771533 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e22b8a9f-b687-43e9-a06d-8ab73f4b8e07 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be" status: 200 len: 1334 microversion: 2.20 time: 0.213704 Sep 24 21:07:01.774745 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2241/4470] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:01 2022] GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be => generated 1334 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:07:01.797216 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f7b548f2-c0d2-49f1-aa33-42d78f6ef452 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:01.800997 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f7b548f2-c0d2-49f1-aa33-42d78f6ef452 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] [instance: 4bbb3958-6fd0-4c00-adff-4865f868d0bc] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:01.817380 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7b548f2-c0d2-49f1-aa33-42d78f6ef452 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:01.818853 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7b548f2-c0d2-49f1-aa33-42d78f6ef452 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:01.820507 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7b548f2-c0d2-49f1-aa33-42d78f6ef452 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:01.823054 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7b548f2-c0d2-49f1-aa33-42d78f6ef452 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:01.823545 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7b548f2-c0d2-49f1-aa33-42d78f6ef452 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:01.826220 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7b548f2-c0d2-49f1-aa33-42d78f6ef452 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:02.534078 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f7b548f2-c0d2-49f1-aa33-42d78f6ef452 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd142c33eccd048bfa3415b1661ee373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c1b7c4c6ff480c82a1f9708b7dbe62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:02.548147 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f7b548f2-c0d2-49f1-aa33-42d78f6ef452 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] 10.222.0.52 "GET /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc" status: 200 len: 1324 microversion: 2.1 time: 0.760837 Sep 24 21:07:02.551371 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2242/4471] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:01 2022] GET /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc => generated 1324 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:02.607700 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f6929bb7-67d9-478a-9d3c-203440505b38 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "POST /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119/action" status: 202 len: 0 microversion: 2.1 time: 2.049477 Sep 24 21:07:02.608878 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2230/4472] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:07:00 2022] POST /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119/action => generated 0 bytes in 2058 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:07:02.617092 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-53c0814d-ec2a-4119-960c-6b81729dc243 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:02.618314 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-53c0814d-ec2a-4119-960c-6b81729dc243 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 51c91704-c6eb-47bf-b3d1-9899df6ce119] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:02.627761 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53c0814d-ec2a-4119-960c-6b81729dc243 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:02.646062 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53c0814d-ec2a-4119-960c-6b81729dc243 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:02.646964 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53c0814d-ec2a-4119-960c-6b81729dc243 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:02.648517 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53c0814d-ec2a-4119-960c-6b81729dc243 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:02.649188 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53c0814d-ec2a-4119-960c-6b81729dc243 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:02.649884 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53c0814d-ec2a-4119-960c-6b81729dc243 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:02.796005 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-53c0814d-ec2a-4119-960c-6b81729dc243 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:02.809045 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cd96668a-9ddd-4478-bb5c-43176d46c6ca tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:02.809662 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cd96668a-9ddd-4478-bb5c-43176d46c6ca tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 0896ae3f-f6f6-49dd-87df-c73f911c78be] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:02.815760 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-53c0814d-ec2a-4119-960c-6b81729dc243 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119" status: 200 len: 1461 microversion: 2.1 time: 0.202317 Sep 24 21:07:02.821981 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd96668a-9ddd-4478-bb5c-43176d46c6ca tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:02.824948 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2243/4473] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:02 2022] GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119 => generated 1461 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:02.835422 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd96668a-9ddd-4478-bb5c-43176d46c6ca tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:02.836241 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd96668a-9ddd-4478-bb5c-43176d46c6ca tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:02.837374 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd96668a-9ddd-4478-bb5c-43176d46c6ca tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:02.837948 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd96668a-9ddd-4478-bb5c-43176d46c6ca tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:02.838479 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd96668a-9ddd-4478-bb5c-43176d46c6ca tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:02.848520 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e6196bae-b7c0-41eb-9bfd-e0112c795240 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:02.849536 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e6196bae-b7c0-41eb-9bfd-e0112c795240 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:02.856188 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6196bae-b7c0-41eb-9bfd-e0112c795240 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:02.856929 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6196bae-b7c0-41eb-9bfd-e0112c795240 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:02.857524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6196bae-b7c0-41eb-9bfd-e0112c795240 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:02.858386 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6196bae-b7c0-41eb-9bfd-e0112c795240 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:02.859011 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6196bae-b7c0-41eb-9bfd-e0112c795240 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:02.859609 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6196bae-b7c0-41eb-9bfd-e0112c795240 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:03.070643 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cd96668a-9ddd-4478-bb5c-43176d46c6ca tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:03.092641 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cd96668a-9ddd-4478-bb5c-43176d46c6ca tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:03.100305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cd96668a-9ddd-4478-bb5c-43176d46c6ca tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:03.106319 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cd96668a-9ddd-4478-bb5c-43176d46c6ca tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be" status: 200 len: 1340 microversion: 2.20 time: 0.301347 Sep 24 21:07:03.108947 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2231/4474] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:02 2022] GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be => generated 1340 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:07:03.113827 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-4e1fdb92-eb6a-4bce-bd9f-9319d00c36b4 req-424efbf6-355d-487c-a826-03ab993c501d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51c91704-c6eb-47bf-b3d1-9899df6ce119", "tag": "cb689b35-55b9-4a33-8d15-19ff8d5cc56b"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:07:03.133183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-4e1fdb92-eb6a-4bce-bd9f-9319d00c36b4 req-424efbf6-355d-487c-a826-03ab993c501d service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:03.135079 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-4e1fdb92-eb6a-4bce-bd9f-9319d00c36b4 req-424efbf6-355d-487c-a826-03ab993c501d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:03.135878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-4e1fdb92-eb6a-4bce-bd9f-9319d00c36b4 req-424efbf6-355d-487c-a826-03ab993c501d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:03.167361 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-4e1fdb92-eb6a-4bce-bd9f-9319d00c36b4 req-424efbf6-355d-487c-a826-03ab993c501d service nova] Creating event network-changed:cb689b35-55b9-4a33-8d15-19ff8d5cc56b for instance 51c91704-c6eb-47bf-b3d1-9899df6ce119 on nch1-master-1 Sep 24 21:07:03.184758 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-4e1fdb92-eb6a-4bce-bd9f-9319d00c36b4 req-424efbf6-355d-487c-a826-03ab993c501d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074310 Sep 24 21:07:03.185908 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2232/4475] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:07:03.289023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e6196bae-b7c0-41eb-9bfd-e0112c795240 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:03.305576 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e6196bae-b7c0-41eb-9bfd-e0112c795240 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.461164 Sep 24 21:07:03.307208 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2244/4476] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:02 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:07:03.341148 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ffcc0e77-7169-4f58-ba9e-aa24ae193149 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:03.342586 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ffcc0e77-7169-4f58-ba9e-aa24ae193149 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:03.350350 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ffcc0e77-7169-4f58-ba9e-aa24ae193149 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:03.351209 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ffcc0e77-7169-4f58-ba9e-aa24ae193149 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:03.352085 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ffcc0e77-7169-4f58-ba9e-aa24ae193149 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:03.353204 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ffcc0e77-7169-4f58-ba9e-aa24ae193149 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:03.354685 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ffcc0e77-7169-4f58-ba9e-aa24ae193149 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:03.355335 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ffcc0e77-7169-4f58-ba9e-aa24ae193149 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:03.581949 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-04f356d0-01a3-4820-83a1-790a97acc538 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:03.586331 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-04f356d0-01a3-4820-83a1-790a97acc538 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] [instance: 4bbb3958-6fd0-4c00-adff-4865f868d0bc] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:03.606611 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-04f356d0-01a3-4820-83a1-790a97acc538 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:03.608092 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-04f356d0-01a3-4820-83a1-790a97acc538 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:03.608755 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-04f356d0-01a3-4820-83a1-790a97acc538 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:03.610146 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-04f356d0-01a3-4820-83a1-790a97acc538 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:03.610894 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-04f356d0-01a3-4820-83a1-790a97acc538 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:03.612127 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-04f356d0-01a3-4820-83a1-790a97acc538 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:04.098481 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ffcc0e77-7169-4f58-ba9e-aa24ae193149 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:04.107314 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ffcc0e77-7169-4f58-ba9e-aa24ae193149 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.771043 Sep 24 21:07:04.108477 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2233/4477] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:03 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:04.132830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-86d17251-64cf-4f42-bb60-1cffdf332b9e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:04.133650 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-86d17251-64cf-4f42-bb60-1cffdf332b9e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:04.140445 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86d17251-64cf-4f42-bb60-1cffdf332b9e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:04.141195 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86d17251-64cf-4f42-bb60-1cffdf332b9e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:04.142295 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86d17251-64cf-4f42-bb60-1cffdf332b9e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:04.143842 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86d17251-64cf-4f42-bb60-1cffdf332b9e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:04.144519 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86d17251-64cf-4f42-bb60-1cffdf332b9e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:04.145627 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86d17251-64cf-4f42-bb60-1cffdf332b9e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:04.273224 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-04f356d0-01a3-4820-83a1-790a97acc538 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd142c33eccd048bfa3415b1661ee373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c1b7c4c6ff480c82a1f9708b7dbe62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:04.290783 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-04f356d0-01a3-4820-83a1-790a97acc538 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] 10.222.0.52 "GET /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc" status: 200 len: 1324 microversion: 2.1 time: 0.718107 Sep 24 21:07:04.309018 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2245/4478] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:03 2022] GET /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc => generated 1324 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:04.316095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a4605f92-923b-4436-8e0e-6f8756015695 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:04.317265 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a4605f92-923b-4436-8e0e-6f8756015695 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 0896ae3f-f6f6-49dd-87df-c73f911c78be] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:04.337928 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4605f92-923b-4436-8e0e-6f8756015695 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:04.339577 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4605f92-923b-4436-8e0e-6f8756015695 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:04.341945 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4605f92-923b-4436-8e0e-6f8756015695 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:04.343004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4605f92-923b-4436-8e0e-6f8756015695 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:04.346857 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4605f92-923b-4436-8e0e-6f8756015695 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:04.347552 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4605f92-923b-4436-8e0e-6f8756015695 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:04.822340 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a4605f92-923b-4436-8e0e-6f8756015695 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:04.832063 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a4605f92-923b-4436-8e0e-6f8756015695 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:04.833802 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a4605f92-923b-4436-8e0e-6f8756015695 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:04.835126 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a4605f92-923b-4436-8e0e-6f8756015695 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be" status: 200 len: 1340 microversion: 2.20 time: 0.525017 Sep 24 21:07:04.836994 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2246/4479] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:04 2022] GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be => generated 1340 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:05.021702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-86d17251-64cf-4f42-bb60-1cffdf332b9e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:05.038488 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-86d17251-64cf-4f42-bb60-1cffdf332b9e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.909815 Sep 24 21:07:05.039949 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2234/4480] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:04 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:07:05.067768 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9455bd7d-ca65-4b22-81eb-574a66800182 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:05.068842 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9455bd7d-ca65-4b22-81eb-574a66800182 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:05.078334 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9455bd7d-ca65-4b22-81eb-574a66800182 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:05.079173 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9455bd7d-ca65-4b22-81eb-574a66800182 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:05.080878 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9455bd7d-ca65-4b22-81eb-574a66800182 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:05.081845 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9455bd7d-ca65-4b22-81eb-574a66800182 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:05.082693 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9455bd7d-ca65-4b22-81eb-574a66800182 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:05.083660 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9455bd7d-ca65-4b22-81eb-574a66800182 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:05.315142 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-89f7dcef-5b63-455b-862a-932e70c8614f tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:05.315857 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-89f7dcef-5b63-455b-862a-932e70c8614f tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] [instance: 4bbb3958-6fd0-4c00-adff-4865f868d0bc] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:05.324511 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89f7dcef-5b63-455b-862a-932e70c8614f tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:05.325108 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89f7dcef-5b63-455b-862a-932e70c8614f tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:05.325620 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89f7dcef-5b63-455b-862a-932e70c8614f tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:05.326626 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89f7dcef-5b63-455b-862a-932e70c8614f tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:05.327303 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89f7dcef-5b63-455b-862a-932e70c8614f tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:05.327922 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89f7dcef-5b63-455b-862a-932e70c8614f tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:05.672278 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9455bd7d-ca65-4b22-81eb-574a66800182 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:05.681595 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9455bd7d-ca65-4b22-81eb-574a66800182 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.620400 Sep 24 21:07:05.682473 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2247/4481] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:05 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:05.820737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dc05e4fb-5f28-4ecd-a41a-49d990db2dd3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2041638427", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "75e36a3c-3095-402d-baea-50bb8c960b77"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:07:05.855072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-89f7dcef-5b63-455b-862a-932e70c8614f tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd142c33eccd048bfa3415b1661ee373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c1b7c4c6ff480c82a1f9708b7dbe62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:05.872229 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-89f7dcef-5b63-455b-862a-932e70c8614f tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] 10.222.0.52 "GET /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc" status: 200 len: 1324 microversion: 2.1 time: 0.560815 Sep 24 21:07:05.873221 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2235/4482] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:05 2022] GET /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc => generated 1324 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:07:05.884149 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-45d2f032-e996-4124-b2cf-23b45c85bfc1 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:05.884776 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-45d2f032-e996-4124-b2cf-23b45c85bfc1 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 0896ae3f-f6f6-49dd-87df-c73f911c78be] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:05.903619 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-dc05e4fb-5f28-4ecd-a41a-49d990db2dd3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] validate_networks() for [('75e36a3c-3095-402d-baea-50bb8c960b77', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:07:05.909683 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45d2f032-e996-4124-b2cf-23b45c85bfc1 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:05.910604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45d2f032-e996-4124-b2cf-23b45c85bfc1 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:05.911313 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45d2f032-e996-4124-b2cf-23b45c85bfc1 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:05.913083 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45d2f032-e996-4124-b2cf-23b45c85bfc1 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:05.913874 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45d2f032-e996-4124-b2cf-23b45c85bfc1 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:05.914697 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45d2f032-e996-4124-b2cf-23b45c85bfc1 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:06.374401 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-45d2f032-e996-4124-b2cf-23b45c85bfc1 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:06.383572 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-45d2f032-e996-4124-b2cf-23b45c85bfc1 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:06.397174 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-45d2f032-e996-4124-b2cf-23b45c85bfc1 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:06.400702 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-45d2f032-e996-4124-b2cf-23b45c85bfc1 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be" status: 200 len: 1407 microversion: 2.20 time: 0.520795 Sep 24 21:07:06.401315 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2236/4483] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:05 2022] GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be => generated 1407 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:06.857646 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-dc05e4fb-5f28-4ecd-a41a-49d990db2dd3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:07:06.858711 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-dc05e4fb-5f28-4ecd-a41a-49d990db2dd3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:07:06.859413 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-dc05e4fb-5f28-4ecd-a41a-49d990db2dd3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:07:06.860076 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-dc05e4fb-5f28-4ecd-a41a-49d990db2dd3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:07:06.860754 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-dc05e4fb-5f28-4ecd-a41a-49d990db2dd3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:07:06.877111 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc05e4fb-5f28-4ecd-a41a-49d990db2dd3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:06.882151 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc05e4fb-5f28-4ecd-a41a-49d990db2dd3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:06.882978 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc05e4fb-5f28-4ecd-a41a-49d990db2dd3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:06.884048 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc05e4fb-5f28-4ecd-a41a-49d990db2dd3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:06.884748 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc05e4fb-5f28-4ecd-a41a-49d990db2dd3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:06.885539 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc05e4fb-5f28-4ecd-a41a-49d990db2dd3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:06.897550 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e06d21a2-2282-4464-a744-1646bd51448d tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:06.898047 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e06d21a2-2282-4464-a744-1646bd51448d tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] [instance: 4bbb3958-6fd0-4c00-adff-4865f868d0bc] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:06.909998 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e06d21a2-2282-4464-a744-1646bd51448d tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:06.910535 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e06d21a2-2282-4464-a744-1646bd51448d tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:06.912638 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e06d21a2-2282-4464-a744-1646bd51448d tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:06.913980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e06d21a2-2282-4464-a744-1646bd51448d tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:06.921272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e06d21a2-2282-4464-a744-1646bd51448d tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:06.921911 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e06d21a2-2282-4464-a744-1646bd51448d tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:06.943545 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-dc05e4fb-5f28-4ecd-a41a-49d990db2dd3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Getting quotas for project c1e5d6f3d41e4aa49e630f8c7ac87ded. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:07:06.956602 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-dc05e4fb-5f28-4ecd-a41a-49d990db2dd3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Getting quotas for user 6493da825aa24f43bdf8f0835a16e3bb and project c1e5d6f3d41e4aa49e630f8c7ac87ded. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:07:06.982146 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dc05e4fb-5f28-4ecd-a41a-49d990db2dd3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:07:06.989726 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dc05e4fb-5f28-4ecd-a41a-49d990db2dd3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:07:07.141929 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dc05e4fb-5f28-4ecd-a41a-49d990db2dd3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.325253 Sep 24 21:07:07.149719 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2248/4484] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:07:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1333 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 24 21:07:07.172286 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d854e72b-25e0-430b-b587-04f16a1c5b30 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:07.172286 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d854e72b-25e0-430b-b587-04f16a1c5b30 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:07.743149 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d854e72b-25e0-430b-b587-04f16a1c5b30 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:07.750468 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d854e72b-25e0-430b-b587-04f16a1c5b30 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9" status: 200 len: 1215 microversion: 2.1 time: 0.599474 Sep 24 21:07:07.751088 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2249/4485] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:07 2022] GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 => generated 1215 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:07.762901 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-8a9bc1e1-6862-4ce9-acd4-c539f78181d3 req-bec359aa-0dc8-40e6-b7f5-52ab8d191909 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0896ae3f-f6f6-49dd-87df-c73f911c78be", "tag": "29c8bcaf-e987-4103-8e4a-20d1ad7bfbe6"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:07:07.794814 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-8a9bc1e1-6862-4ce9-acd4-c539f78181d3 req-bec359aa-0dc8-40e6-b7f5-52ab8d191909 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:07.795445 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-8a9bc1e1-6862-4ce9-acd4-c539f78181d3 req-bec359aa-0dc8-40e6-b7f5-52ab8d191909 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:07.795907 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-8a9bc1e1-6862-4ce9-acd4-c539f78181d3 req-bec359aa-0dc8-40e6-b7f5-52ab8d191909 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:07.818269 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-8a9bc1e1-6862-4ce9-acd4-c539f78181d3 req-bec359aa-0dc8-40e6-b7f5-52ab8d191909 service nova] Creating event network-changed:29c8bcaf-e987-4103-8e4a-20d1ad7bfbe6 for instance 0896ae3f-f6f6-49dd-87df-c73f911c78be on nch2-master-1 Sep 24 21:07:07.824273 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-8a9bc1e1-6862-4ce9-acd4-c539f78181d3 req-bec359aa-0dc8-40e6-b7f5-52ab8d191909 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069071 Sep 24 21:07:07.825402 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2250/4486] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:07:07.832863 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4294e911-666b-4a8c-bfee-495d9998eaa2 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:07.833755 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4294e911-666b-4a8c-bfee-495d9998eaa2 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 0896ae3f-f6f6-49dd-87df-c73f911c78be] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:07.845746 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4294e911-666b-4a8c-bfee-495d9998eaa2 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:07.847797 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4294e911-666b-4a8c-bfee-495d9998eaa2 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:07.851652 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4294e911-666b-4a8c-bfee-495d9998eaa2 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:07.852646 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4294e911-666b-4a8c-bfee-495d9998eaa2 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:07.855532 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4294e911-666b-4a8c-bfee-495d9998eaa2 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:07.856172 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4294e911-666b-4a8c-bfee-495d9998eaa2 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:08.075130 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e06d21a2-2282-4464-a744-1646bd51448d tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd142c33eccd048bfa3415b1661ee373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c1b7c4c6ff480c82a1f9708b7dbe62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:08.085285 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e06d21a2-2282-4464-a744-1646bd51448d tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] 10.222.0.52 "GET /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc" status: 200 len: 1324 microversion: 2.1 time: 1.191670 Sep 24 21:07:08.088525 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2237/4487] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:06 2022] GET /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc => generated 1324 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:08.240781 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4294e911-666b-4a8c-bfee-495d9998eaa2 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:08.253915 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4294e911-666b-4a8c-bfee-495d9998eaa2 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:08.256666 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4294e911-666b-4a8c-bfee-495d9998eaa2 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:08.262200 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4294e911-666b-4a8c-bfee-495d9998eaa2 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be" status: 200 len: 1407 microversion: 2.20 time: 0.435481 Sep 24 21:07:08.263066 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2251/4488] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:07 2022] GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be => generated 1407 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:08.382009 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-b40fcf81-b0d2-4cfb-8089-f60e52834ced req-2b8226e7-1a66-41a2-a5b6-ace7f8b2935e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bbb3958-6fd0-4c00-adff-4865f868d0bc", "name": "network-vif-plugged", "status": "completed", "tag": "2a899001-3efd-4a15-95d6-c3d508ff2fe3"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:07:08.393184 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-b40fcf81-b0d2-4cfb-8089-f60e52834ced req-2b8226e7-1a66-41a2-a5b6-ace7f8b2935e service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:08.393832 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-b40fcf81-b0d2-4cfb-8089-f60e52834ced req-2b8226e7-1a66-41a2-a5b6-ace7f8b2935e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:08.394430 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-b40fcf81-b0d2-4cfb-8089-f60e52834ced req-2b8226e7-1a66-41a2-a5b6-ace7f8b2935e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:08.412922 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-b40fcf81-b0d2-4cfb-8089-f60e52834ced req-2b8226e7-1a66-41a2-a5b6-ace7f8b2935e service nova] Creating event network-vif-plugged:2a899001-3efd-4a15-95d6-c3d508ff2fe3 for instance 4bbb3958-6fd0-4c00-adff-4865f868d0bc on nch1-master-1 Sep 24 21:07:08.418913 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-b40fcf81-b0d2-4cfb-8089-f60e52834ced req-2b8226e7-1a66-41a2-a5b6-ace7f8b2935e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040483 Sep 24 21:07:08.420132 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2238/4489] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:07:08.775316 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5ced4978-bf96-4def-9651-bb0acd7b024e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:08.775951 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5ced4978-bf96-4def-9651-bb0acd7b024e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:08.784510 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ced4978-bf96-4def-9651-bb0acd7b024e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:08.785310 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ced4978-bf96-4def-9651-bb0acd7b024e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:08.785922 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ced4978-bf96-4def-9651-bb0acd7b024e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:08.787048 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ced4978-bf96-4def-9651-bb0acd7b024e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:08.787665 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ced4978-bf96-4def-9651-bb0acd7b024e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:08.788250 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ced4978-bf96-4def-9651-bb0acd7b024e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:08.948085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5ced4978-bf96-4def-9651-bb0acd7b024e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:08.970711 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5ced4978-bf96-4def-9651-bb0acd7b024e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9" status: 200 len: 1267 microversion: 2.1 time: 0.187567 Sep 24 21:07:08.971737 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2252/4490] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:08 2022] GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 => generated 1267 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:09.119060 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c6930aa7-d0a4-4880-bf20-bbeeb905ce0e tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:09.119792 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c6930aa7-d0a4-4880-bf20-bbeeb905ce0e tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] [instance: 4bbb3958-6fd0-4c00-adff-4865f868d0bc] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:09.130053 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6930aa7-d0a4-4880-bf20-bbeeb905ce0e tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:09.141484 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6930aa7-d0a4-4880-bf20-bbeeb905ce0e tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:09.141959 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6930aa7-d0a4-4880-bf20-bbeeb905ce0e tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:09.143416 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6930aa7-d0a4-4880-bf20-bbeeb905ce0e tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:09.143952 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6930aa7-d0a4-4880-bf20-bbeeb905ce0e tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:09.144376 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6930aa7-d0a4-4880-bf20-bbeeb905ce0e tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:09.310128 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-988ab56f-3561-438b-82ea-e126174baf7b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:09.311453 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-988ab56f-3561-438b-82ea-e126174baf7b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 0896ae3f-f6f6-49dd-87df-c73f911c78be] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:09.355133 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-988ab56f-3561-438b-82ea-e126174baf7b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:09.361940 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-988ab56f-3561-438b-82ea-e126174baf7b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:09.376461 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-988ab56f-3561-438b-82ea-e126174baf7b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:09.377463 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-988ab56f-3561-438b-82ea-e126174baf7b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:09.382166 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-988ab56f-3561-438b-82ea-e126174baf7b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:09.383004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-988ab56f-3561-438b-82ea-e126174baf7b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:09.550586 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c6930aa7-d0a4-4880-bf20-bbeeb905ce0e tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd142c33eccd048bfa3415b1661ee373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c1b7c4c6ff480c82a1f9708b7dbe62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:09.577124 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c6930aa7-d0a4-4880-bf20-bbeeb905ce0e tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] 10.222.0.52 "GET /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc" status: 200 len: 1324 microversion: 2.1 time: 0.468479 Sep 24 21:07:09.592524 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2239/4491] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:09 2022] GET /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc => generated 1324 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:09.746832 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-988ab56f-3561-438b-82ea-e126174baf7b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:09.773333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-988ab56f-3561-438b-82ea-e126174baf7b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:09.793549 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-988ab56f-3561-438b-82ea-e126174baf7b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:09.795751 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-988ab56f-3561-438b-82ea-e126174baf7b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be" status: 200 len: 1407 microversion: 2.20 time: 0.502493 Sep 24 21:07:09.796578 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2253/4492] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:09 2022] GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be => generated 1407 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:09.999603 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-98996486-a081-43d8-bbd8-d2b5020230c0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:10.000500 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-98996486-a081-43d8-bbd8-d2b5020230c0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:10.008415 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=4 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:07:10.009523 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=18 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:07:10.012323 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-98996486-a081-43d8-bbd8-d2b5020230c0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:10.013156 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-98996486-a081-43d8-bbd8-d2b5020230c0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:10.020619 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-98996486-a081-43d8-bbd8-d2b5020230c0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:10.024650 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-98996486-a081-43d8-bbd8-d2b5020230c0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:10.025245 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-98996486-a081-43d8-bbd8-d2b5020230c0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:10.025771 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-98996486-a081-43d8-bbd8-d2b5020230c0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:10.127855 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-98996486-a081-43d8-bbd8-d2b5020230c0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:10.142031 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-98996486-a081-43d8-bbd8-d2b5020230c0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9" status: 200 len: 1275 microversion: 2.1 time: 0.147080 Sep 24 21:07:10.151570 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2240/4493] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:09 2022] GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 => generated 1275 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:10.603173 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7ff361ff-3eed-4c57-9313-16026998529d tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:10.604581 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7ff361ff-3eed-4c57-9313-16026998529d tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] [instance: 4bbb3958-6fd0-4c00-adff-4865f868d0bc] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:10.622172 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7ff361ff-3eed-4c57-9313-16026998529d tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:10.622804 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7ff361ff-3eed-4c57-9313-16026998529d tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:10.625451 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7ff361ff-3eed-4c57-9313-16026998529d tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:10.626395 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7ff361ff-3eed-4c57-9313-16026998529d tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:10.643276 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7ff361ff-3eed-4c57-9313-16026998529d tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:10.644848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7ff361ff-3eed-4c57-9313-16026998529d tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:10.821427 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fb965038-b626-446e-9245-ea4e6b26bd20 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:10.822281 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fb965038-b626-446e-9245-ea4e6b26bd20 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 0896ae3f-f6f6-49dd-87df-c73f911c78be] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:10.828779 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb965038-b626-446e-9245-ea4e6b26bd20 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:10.830264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb965038-b626-446e-9245-ea4e6b26bd20 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:10.830959 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb965038-b626-446e-9245-ea4e6b26bd20 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:10.833301 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb965038-b626-446e-9245-ea4e6b26bd20 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:10.833923 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb965038-b626-446e-9245-ea4e6b26bd20 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:10.834702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb965038-b626-446e-9245-ea4e6b26bd20 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:11.056533 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7ff361ff-3eed-4c57-9313-16026998529d tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd142c33eccd048bfa3415b1661ee373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c1b7c4c6ff480c82a1f9708b7dbe62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:11.076317 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7ff361ff-3eed-4c57-9313-16026998529d tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] 10.222.0.52 "GET /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc" status: 200 len: 1521 microversion: 2.1 time: 0.476727 Sep 24 21:07:11.092488 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2254/4494] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:10 2022] GET /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc => generated 1521 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:11.098695 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fb965038-b626-446e-9245-ea4e6b26bd20 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:11.115969 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fb965038-b626-446e-9245-ea4e6b26bd20 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:11.118099 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a051373c-cc38-4e00-bcd9-ae6dfc44c828 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:11.118906 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a051373c-cc38-4e00-bcd9-ae6dfc44c828 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] [instance: 4bbb3958-6fd0-4c00-adff-4865f868d0bc] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:11.119026 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fb965038-b626-446e-9245-ea4e6b26bd20 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:11.120118 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fb965038-b626-446e-9245-ea4e6b26bd20 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be" status: 200 len: 1407 microversion: 2.20 time: 0.302750 Sep 24 21:07:11.121186 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2241/4495] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:10 2022] GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be => generated 1407 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:07:11.137324 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a051373c-cc38-4e00-bcd9-ae6dfc44c828 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:11.138196 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a051373c-cc38-4e00-bcd9-ae6dfc44c828 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:11.138747 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a051373c-cc38-4e00-bcd9-ae6dfc44c828 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:11.140842 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a051373c-cc38-4e00-bcd9-ae6dfc44c828 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:11.141707 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a051373c-cc38-4e00-bcd9-ae6dfc44c828 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:11.143868 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a051373c-cc38-4e00-bcd9-ae6dfc44c828 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:11.167449 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f0f99b22-1e8c-4878-9a62-1f7e160f0e6c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:11.168777 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f0f99b22-1e8c-4878-9a62-1f7e160f0e6c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:11.176419 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f0f99b22-1e8c-4878-9a62-1f7e160f0e6c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:11.177188 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f0f99b22-1e8c-4878-9a62-1f7e160f0e6c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:11.177611 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-a051373c-cc38-4e00-bcd9-ae6dfc44c828 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] HTTP exception thrown: Instance is not a member of specified network Sep 24 21:07:11.178152 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f0f99b22-1e8c-4878-9a62-1f7e160f0e6c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:11.179187 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f0f99b22-1e8c-4878-9a62-1f7e160f0e6c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:11.179796 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f0f99b22-1e8c-4878-9a62-1f7e160f0e6c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:11.180230 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f0f99b22-1e8c-4878-9a62-1f7e160f0e6c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a051373c-cc38-4e00-bcd9-ae6dfc44c828 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Request method failure captured: Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc/ips/invalid HTTP/1.1 Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3FpssVcjcTvek9r_CGgSKaGBvusMnv1IjCmVQEZ2gygrPd-EZu-EMtzKvJUPCkQZ6tGmvRYAX72366co7gDVGSAgqSM4G1r-wNcxTI1Du8q49whlMv_D0aer9U-eXOajH9nFDKi5rtsXr7w9z61Qb-Ckoj8adG3XMm89Sddj0oUpBE Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: b0c1b7c4c6ff480c82a1f9708b7dbe62 Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-382138128 Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b0c1b7c4c6ff480c82a1f9708b7dbe62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b0c1b7c4c6ff480c82a1f9708b7dbe62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b0c1b7c4c6ff480c82a1f9708b7dbe62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b0c1b7c4c6ff480c82a1f9708b7dbe62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-382138128 Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: b0c1b7c4c6ff480c82a1f9708b7dbe62 Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-382138128 Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServerAddressesNegativeTestJSON-382138128-project Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: d142c33eccd048bfa3415b1661ee373f Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-382138128-project Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance is not a member of specified network Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'server_id': '4bbb3958-6fd0-4c00-adff-4865f868d0bc', 'id': 'invalid'} Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Sep 24 21:07:11.186690 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:07:11.190343 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a051373c-cc38-4e00-bcd9-ae6dfc44c828 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Returning 404 to user: Instance is not a member of specified network {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:07:11.195701 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a051373c-cc38-4e00-bcd9-ae6dfc44c828 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] 10.222.0.52 "GET /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.084719 Sep 24 21:07:11.202658 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2255/4496] 10.222.0.52 () {58 vars in 1272 bytes} [Sat Sep 24 21:07:11 2022] GET /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc/ips/invalid => generated 91 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 21:07:11.212113 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-12e4ba59-c5c1-497c-b8bf-cb23fd4f1923 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:11.213148 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-12e4ba59-c5c1-497c-b8bf-cb23fd4f1923 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Failed to fetch instance by id 999 {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 24 21:07:11.214243 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-12e4ba59-c5c1-497c-b8bf-cb23fd4f1923 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] HTTP exception thrown: Instance 999 could not be found. Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-12e4ba59-c5c1-497c-b8bf-cb23fd4f1923 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Request method failure captured: Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3FpssVcjcTvek9r_CGgSKaGBvusMnv1IjCmVQEZ2gygrPd-EZu-EMtzKvJUPCkQZ6tGmvRYAX72366co7gDVGSAgqSM4G1r-wNcxTI1Du8q49whlMv_D0aer9U-eXOajH9nFDKi5rtsXr7w9z61Qb-Ckoj8adG3XMm89Sddj0oUpBE Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: b0c1b7c4c6ff480c82a1f9708b7dbe62 Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-382138128 Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b0c1b7c4c6ff480c82a1f9708b7dbe62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b0c1b7c4c6ff480c82a1f9708b7dbe62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b0c1b7c4c6ff480c82a1f9708b7dbe62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b0c1b7c4c6ff480c82a1f9708b7dbe62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-382138128 Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: b0c1b7c4c6ff480c82a1f9708b7dbe62 Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-382138128 Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServerAddressesNegativeTestJSON-382138128-project Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: d142c33eccd048bfa3415b1661ee373f Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-382138128-project Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 999 could not be found. Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'server_id': '999'} Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 24 21:07:11.215984 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:07:11.221137 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-12e4ba59-c5c1-497c-b8bf-cb23fd4f1923 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Returning 404 to user: Instance 999 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:07:11.222007 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-12e4ba59-c5c1-497c-b8bf-cb23fd4f1923 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] 10.222.0.52 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.017611 Sep 24 21:07:11.222869 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2256/4497] 10.222.0.52 () {58 vars in 1149 bytes} [Sat Sep 24 21:07:11 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 21:07:11.233594 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ac60e71b-542a-4e44-ba8f-3a44fd85305b tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:11.234423 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ac60e71b-542a-4e44-ba8f-3a44fd85305b tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] [instance: 4bbb3958-6fd0-4c00-adff-4865f868d0bc] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:11.242473 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ac60e71b-542a-4e44-ba8f-3a44fd85305b tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:11.243115 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ac60e71b-542a-4e44-ba8f-3a44fd85305b tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:11.243558 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ac60e71b-542a-4e44-ba8f-3a44fd85305b tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:11.244663 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ac60e71b-542a-4e44-ba8f-3a44fd85305b tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:11.245128 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ac60e71b-542a-4e44-ba8f-3a44fd85305b tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:11.245560 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ac60e71b-542a-4e44-ba8f-3a44fd85305b tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:11.272448 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f0f99b22-1e8c-4878-9a62-1f7e160f0e6c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:11.276498 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ac60e71b-542a-4e44-ba8f-3a44fd85305b tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] [instance: 4bbb3958-6fd0-4c00-adff-4865f868d0bc] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:07:11.286503 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f0f99b22-1e8c-4878-9a62-1f7e160f0e6c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9" status: 200 len: 1273 microversion: 2.1 time: 0.122915 Sep 24 21:07:11.288944 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2242/4498] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:11 2022] GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 => generated 1273 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:11.348692 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:07:11.385200 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ac60e71b-542a-4e44-ba8f-3a44fd85305b tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc" status: 204 len: 0 microversion: 2.1 time: 0.152306 Sep 24 21:07:11.389528 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2257/4499] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:07:11 2022] DELETE /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:07:11.400148 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-35a5b114-7bcc-4942-961d-ad1c2daf5ae7 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:11.401640 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-35a5b114-7bcc-4942-961d-ad1c2daf5ae7 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] [instance: 4bbb3958-6fd0-4c00-adff-4865f868d0bc] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:11.409898 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35a5b114-7bcc-4942-961d-ad1c2daf5ae7 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:11.421192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35a5b114-7bcc-4942-961d-ad1c2daf5ae7 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:11.424838 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35a5b114-7bcc-4942-961d-ad1c2daf5ae7 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:11.425998 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35a5b114-7bcc-4942-961d-ad1c2daf5ae7 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:11.427437 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35a5b114-7bcc-4942-961d-ad1c2daf5ae7 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:11.427891 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35a5b114-7bcc-4942-961d-ad1c2daf5ae7 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:11.693521 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-35a5b114-7bcc-4942-961d-ad1c2daf5ae7 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd142c33eccd048bfa3415b1661ee373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c1b7c4c6ff480c82a1f9708b7dbe62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:11.710108 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-35a5b114-7bcc-4942-961d-ad1c2daf5ae7 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] 10.222.0.52 "GET /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc" status: 200 len: 1527 microversion: 2.1 time: 0.315416 Sep 24 21:07:11.713571 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2243/4500] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:11 2022] GET /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc => generated 1527 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:12.150785 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-32638063-2650-4109-ad2c-bc48f0712ddb tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:12.154951 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-32638063-2650-4109-ad2c-bc48f0712ddb tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 0896ae3f-f6f6-49dd-87df-c73f911c78be] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:12.167863 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-32638063-2650-4109-ad2c-bc48f0712ddb tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:12.173069 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-32638063-2650-4109-ad2c-bc48f0712ddb tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:12.173715 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-32638063-2650-4109-ad2c-bc48f0712ddb tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:12.176606 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-32638063-2650-4109-ad2c-bc48f0712ddb tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:12.177224 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-32638063-2650-4109-ad2c-bc48f0712ddb tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:12.178068 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-32638063-2650-4109-ad2c-bc48f0712ddb tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:12.321329 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-09e35edd-5dc6-48ef-820e-5c8e0c8c4319 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:12.322223 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-09e35edd-5dc6-48ef-820e-5c8e0c8c4319 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:12.333421 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-09e35edd-5dc6-48ef-820e-5c8e0c8c4319 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:12.333913 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-09e35edd-5dc6-48ef-820e-5c8e0c8c4319 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:12.339553 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-09e35edd-5dc6-48ef-820e-5c8e0c8c4319 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:12.344021 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-09e35edd-5dc6-48ef-820e-5c8e0c8c4319 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:12.347709 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-09e35edd-5dc6-48ef-820e-5c8e0c8c4319 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:12.350996 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-09e35edd-5dc6-48ef-820e-5c8e0c8c4319 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:12.561163 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-32638063-2650-4109-ad2c-bc48f0712ddb tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:12.586313 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-32638063-2650-4109-ad2c-bc48f0712ddb tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:12.587896 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-32638063-2650-4109-ad2c-bc48f0712ddb tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:12.589033 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-32638063-2650-4109-ad2c-bc48f0712ddb tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be" status: 200 len: 1407 microversion: 2.20 time: 0.447477 Sep 24 21:07:12.589908 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2258/4501] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:12 2022] GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be => generated 1407 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:12.736669 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e2b6e8f7-3976-40ee-863f-2c70cb6d020b tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:12.737492 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e2b6e8f7-3976-40ee-863f-2c70cb6d020b tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] [instance: 4bbb3958-6fd0-4c00-adff-4865f868d0bc] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:12.745463 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e2b6e8f7-3976-40ee-863f-2c70cb6d020b tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:12.746703 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e2b6e8f7-3976-40ee-863f-2c70cb6d020b tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:12.747300 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e2b6e8f7-3976-40ee-863f-2c70cb6d020b tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:12.748442 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e2b6e8f7-3976-40ee-863f-2c70cb6d020b tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:12.749049 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e2b6e8f7-3976-40ee-863f-2c70cb6d020b tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:12.749632 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e2b6e8f7-3976-40ee-863f-2c70cb6d020b tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:12.886980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-09e35edd-5dc6-48ef-820e-5c8e0c8c4319 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:12.896263 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-09e35edd-5dc6-48ef-820e-5c8e0c8c4319 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9" status: 200 len: 1315 microversion: 2.1 time: 0.579045 Sep 24 21:07:12.896854 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2244/4502] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:12 2022] GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 => generated 1315 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:07:12.901668 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-1d46c675-aeff-44d7-8c69-495118cb5d50 req-25fc869b-e819-4667-b79d-2ddc7ed6554d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0896ae3f-f6f6-49dd-87df-c73f911c78be", "name": "network-vif-plugged", "status": "completed", "tag": "29c8bcaf-e987-4103-8e4a-20d1ad7bfbe6"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:07:12.915025 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1d46c675-aeff-44d7-8c69-495118cb5d50 req-25fc869b-e819-4667-b79d-2ddc7ed6554d service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:12.915536 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1d46c675-aeff-44d7-8c69-495118cb5d50 req-25fc869b-e819-4667-b79d-2ddc7ed6554d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:12.916153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1d46c675-aeff-44d7-8c69-495118cb5d50 req-25fc869b-e819-4667-b79d-2ddc7ed6554d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:12.928531 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-1d46c675-aeff-44d7-8c69-495118cb5d50 req-25fc869b-e819-4667-b79d-2ddc7ed6554d service nova] Creating event network-vif-plugged:29c8bcaf-e987-4103-8e4a-20d1ad7bfbe6 for instance 0896ae3f-f6f6-49dd-87df-c73f911c78be on nch2-master-1 Sep 24 21:07:12.933842 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-1d46c675-aeff-44d7-8c69-495118cb5d50 req-25fc869b-e819-4667-b79d-2ddc7ed6554d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035641 Sep 24 21:07:12.934954 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2245/4503] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:07:13.092700 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1dffb949-e1a2-4a38-a21e-e970fffa5d0d tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1148845240", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": "none"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:07:13.111380 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e2b6e8f7-3976-40ee-863f-2c70cb6d020b tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd142c33eccd048bfa3415b1661ee373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c1b7c4c6ff480c82a1f9708b7dbe62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:13.122730 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e2b6e8f7-3976-40ee-863f-2c70cb6d020b tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] 10.222.0.52 "GET /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc" status: 200 len: 1527 microversion: 2.1 time: 0.390808 Sep 24 21:07:13.127763 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2259/4504] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:12 2022] GET /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc => generated 1527 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:13.208266 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-1dffb949-e1a2-4a38-a21e-e970fffa5d0d tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:07:13.214327 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-1dffb949-e1a2-4a38-a21e-e970fffa5d0d tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:07:13.215078 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-1dffb949-e1a2-4a38-a21e-e970fffa5d0d tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:07:13.215615 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-1dffb949-e1a2-4a38-a21e-e970fffa5d0d tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:07:13.216144 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-1dffb949-e1a2-4a38-a21e-e970fffa5d0d tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:07:13.239503 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1dffb949-e1a2-4a38-a21e-e970fffa5d0d tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:13.240357 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1dffb949-e1a2-4a38-a21e-e970fffa5d0d tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:13.241209 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1dffb949-e1a2-4a38-a21e-e970fffa5d0d tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:13.242699 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1dffb949-e1a2-4a38-a21e-e970fffa5d0d tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:13.243395 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1dffb949-e1a2-4a38-a21e-e970fffa5d0d tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:13.244667 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1dffb949-e1a2-4a38-a21e-e970fffa5d0d tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:13.285005 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-1dffb949-e1a2-4a38-a21e-e970fffa5d0d tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Getting quotas for project 28e486847ec742fbbd1ed13b404eb519. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:07:13.293099 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-1dffb949-e1a2-4a38-a21e-e970fffa5d0d tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Getting quotas for user f718a9c5980641d3b67ce061de573c71 and project 28e486847ec742fbbd1ed13b404eb519. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:07:13.314850 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1dffb949-e1a2-4a38-a21e-e970fffa5d0d tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:07:13.318204 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1dffb949-e1a2-4a38-a21e-e970fffa5d0d tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] [instance: 975ea9e6-e609-49c1-9492-87e8fb8d2109] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:07:13.379779 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1dffb949-e1a2-4a38-a21e-e970fffa5d0d tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.438143 Sep 24 21:07:13.381639 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2246/4505] 10.222.0.52 () {62 vars in 1188 bytes} [Sat Sep 24 21:07:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 443 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 24 21:07:13.396504 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5fae43f0-e2c4-41d3-93f2-bbc624bce399 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:13.398334 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5fae43f0-e2c4-41d3-93f2-bbc624bce399 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] [instance: 975ea9e6-e609-49c1-9492-87e8fb8d2109] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:13.558863 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5fae43f0-e2c4-41d3-93f2-bbc624bce399 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:13.567015 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5fae43f0-e2c4-41d3-93f2-bbc624bce399 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:13.568739 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5fae43f0-e2c4-41d3-93f2-bbc624bce399 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:13.570886 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5fae43f0-e2c4-41d3-93f2-bbc624bce399 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] 10.222.0.52 "GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109" status: 200 len: 1278 microversion: 2.57 time: 0.182131 Sep 24 21:07:13.572811 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2260/4506] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:13 2022] GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109 => generated 1278 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:13.618833 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4d71d6ff-3a33-4257-aeb1-70d600639f94 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:13.619455 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4d71d6ff-3a33-4257-aeb1-70d600639f94 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 0896ae3f-f6f6-49dd-87df-c73f911c78be] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:13.639759 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4d71d6ff-3a33-4257-aeb1-70d600639f94 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:13.640442 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4d71d6ff-3a33-4257-aeb1-70d600639f94 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:13.641068 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4d71d6ff-3a33-4257-aeb1-70d600639f94 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:13.642627 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4d71d6ff-3a33-4257-aeb1-70d600639f94 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:13.643246 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4d71d6ff-3a33-4257-aeb1-70d600639f94 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:13.643910 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4d71d6ff-3a33-4257-aeb1-70d600639f94 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:13.920754 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3383fb0b-89ba-4317-9ad2-e3ae88e36fca tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:13.921521 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3383fb0b-89ba-4317-9ad2-e3ae88e36fca tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:13.931336 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3383fb0b-89ba-4317-9ad2-e3ae88e36fca tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:13.932066 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3383fb0b-89ba-4317-9ad2-e3ae88e36fca tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:13.932767 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3383fb0b-89ba-4317-9ad2-e3ae88e36fca tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:13.933693 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3383fb0b-89ba-4317-9ad2-e3ae88e36fca tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:13.934291 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3383fb0b-89ba-4317-9ad2-e3ae88e36fca tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:13.934890 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3383fb0b-89ba-4317-9ad2-e3ae88e36fca tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:14.075634 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4d71d6ff-3a33-4257-aeb1-70d600639f94 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:14.084414 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4d71d6ff-3a33-4257-aeb1-70d600639f94 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:14.088571 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4d71d6ff-3a33-4257-aeb1-70d600639f94 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:14.090769 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4d71d6ff-3a33-4257-aeb1-70d600639f94 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be" status: 200 len: 1407 microversion: 2.20 time: 0.476644 Sep 24 21:07:14.107026 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2247/4507] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:13 2022] GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be => generated 1407 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:14.115475 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-8a4d9c23-4c87-4528-9630-fee9225cf4cd req-5461833b-d2f4-49fe-8901-e67e51e351af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dda4c066-f7bb-45df-9e57-b0e2d23fd7b9", "tag": "760158dc-6fec-418e-aae5-f938ec813cb9"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:07:14.125913 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-8a4d9c23-4c87-4528-9630-fee9225cf4cd req-5461833b-d2f4-49fe-8901-e67e51e351af service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:14.126059 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-8a4d9c23-4c87-4528-9630-fee9225cf4cd req-5461833b-d2f4-49fe-8901-e67e51e351af service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:14.126880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-8a4d9c23-4c87-4528-9630-fee9225cf4cd req-5461833b-d2f4-49fe-8901-e67e51e351af service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:14.140252 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-8a4d9c23-4c87-4528-9630-fee9225cf4cd req-5461833b-d2f4-49fe-8901-e67e51e351af service nova] Creating event network-changed:760158dc-6fec-418e-aae5-f938ec813cb9 for instance dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 on nch2-master-1 Sep 24 21:07:14.147031 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-8a4d9c23-4c87-4528-9630-fee9225cf4cd req-5461833b-d2f4-49fe-8901-e67e51e351af service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038380 Sep 24 21:07:14.147861 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2248/4508] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:07:14.153411 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cab85f88-3f3e-4cec-8a45-31402db72869 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:14.154704 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cab85f88-3f3e-4cec-8a45-31402db72869 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] [instance: 4bbb3958-6fd0-4c00-adff-4865f868d0bc] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:14.157002 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:07:14.165612 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cab85f88-3f3e-4cec-8a45-31402db72869 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:14.166659 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cab85f88-3f3e-4cec-8a45-31402db72869 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:14.167448 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cab85f88-3f3e-4cec-8a45-31402db72869 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:14.168341 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cab85f88-3f3e-4cec-8a45-31402db72869 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:14.168977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cab85f88-3f3e-4cec-8a45-31402db72869 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:14.169671 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cab85f88-3f3e-4cec-8a45-31402db72869 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:14.195491 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:07:14.368042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cab85f88-3f3e-4cec-8a45-31402db72869 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd142c33eccd048bfa3415b1661ee373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c1b7c4c6ff480c82a1f9708b7dbe62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:14.381977 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cab85f88-3f3e-4cec-8a45-31402db72869 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] 10.222.0.52 "GET /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc" status: 200 len: 1485 microversion: 2.1 time: 0.230135 Sep 24 21:07:14.383704 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2249/4509] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:14 2022] GET /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc => generated 1485 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:14.396348 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-20036e12-8e28-4fc0-83d2-878d1e9f7531 req-ed7ffa7b-44d1-4b19-a64a-6f8d64596fc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bbb3958-6fd0-4c00-adff-4865f868d0bc", "name": "network-vif-deleted", "tag": "2a899001-3efd-4a15-95d6-c3d508ff2fe3"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:07:14.422873 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-20036e12-8e28-4fc0-83d2-878d1e9f7531 req-ed7ffa7b-44d1-4b19-a64a-6f8d64596fc3 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:14.424005 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-20036e12-8e28-4fc0-83d2-878d1e9f7531 req-ed7ffa7b-44d1-4b19-a64a-6f8d64596fc3 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:14.424816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-20036e12-8e28-4fc0-83d2-878d1e9f7531 req-ed7ffa7b-44d1-4b19-a64a-6f8d64596fc3 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:14.447798 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-20036e12-8e28-4fc0-83d2-878d1e9f7531 req-ed7ffa7b-44d1-4b19-a64a-6f8d64596fc3 service nova] Creating event network-vif-deleted:2a899001-3efd-4a15-95d6-c3d508ff2fe3 for instance 4bbb3958-6fd0-4c00-adff-4865f868d0bc on nch1-master-1 Sep 24 21:07:14.464594 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-20036e12-8e28-4fc0-83d2-878d1e9f7531 req-ed7ffa7b-44d1-4b19-a64a-6f8d64596fc3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077517 Sep 24 21:07:14.465230 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2250/4510] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:07:14.531281 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3383fb0b-89ba-4317-9ad2-e3ae88e36fca tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:14.548971 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3383fb0b-89ba-4317-9ad2-e3ae88e36fca tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9" status: 200 len: 1315 microversion: 2.1 time: 0.631968 Sep 24 21:07:14.551182 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2261/4511] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:13 2022] GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 => generated 1315 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:14.599003 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f10a9f4a-f689-44f2-97b7-06ec01a28138 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:14.599724 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f10a9f4a-f689-44f2-97b7-06ec01a28138 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] [instance: 975ea9e6-e609-49c1-9492-87e8fb8d2109] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:14.608185 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f10a9f4a-f689-44f2-97b7-06ec01a28138 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:14.608684 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f10a9f4a-f689-44f2-97b7-06ec01a28138 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:14.615584 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f10a9f4a-f689-44f2-97b7-06ec01a28138 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:14.616601 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f10a9f4a-f689-44f2-97b7-06ec01a28138 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:14.617390 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f10a9f4a-f689-44f2-97b7-06ec01a28138 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:14.618076 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f10a9f4a-f689-44f2-97b7-06ec01a28138 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:14.712952 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8bad15fa-01a5-434e-aae1-8b927a8a2031 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:14.713457 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8bad15fa-01a5-434e-aae1-8b927a8a2031 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 7caa7efc-79ef-47c3-b024-dbcb34877a65] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:14.721423 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8bad15fa-01a5-434e-aae1-8b927a8a2031 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:14.721834 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8bad15fa-01a5-434e-aae1-8b927a8a2031 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:14.723217 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8bad15fa-01a5-434e-aae1-8b927a8a2031 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:14.724159 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8bad15fa-01a5-434e-aae1-8b927a8a2031 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:14.724887 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8bad15fa-01a5-434e-aae1-8b927a8a2031 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:14.725825 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8bad15fa-01a5-434e-aae1-8b927a8a2031 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:14.732039 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f10a9f4a-f689-44f2-97b7-06ec01a28138 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:14.753121 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f10a9f4a-f689-44f2-97b7-06ec01a28138 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:14.756355 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f10a9f4a-f689-44f2-97b7-06ec01a28138 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:14.757844 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f10a9f4a-f689-44f2-97b7-06ec01a28138 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] 10.222.0.52 "GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109" status: 200 len: 1330 microversion: 2.57 time: 0.163892 Sep 24 21:07:14.759725 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2251/4512] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:14 2022] GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109 => generated 1330 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:14.821732 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8bad15fa-01a5-434e-aae1-8b927a8a2031 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65/ips" status: 200 len: 150 microversion: 2.1 time: 0.112774 Sep 24 21:07:14.831826 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2262/4513] 10.222.0.52 () {58 vars in 1248 bytes} [Sat Sep 24 21:07:14 2022] GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65/ips => generated 150 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:07:15.127126 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-077969fd-7dbb-4b1b-beee-bda642252e8a tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:15.129956 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-077969fd-7dbb-4b1b-beee-bda642252e8a tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 0896ae3f-f6f6-49dd-87df-c73f911c78be] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:15.141861 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-077969fd-7dbb-4b1b-beee-bda642252e8a tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:15.144103 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-077969fd-7dbb-4b1b-beee-bda642252e8a tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:15.146066 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-077969fd-7dbb-4b1b-beee-bda642252e8a tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:15.148365 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-077969fd-7dbb-4b1b-beee-bda642252e8a tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:15.150088 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-077969fd-7dbb-4b1b-beee-bda642252e8a tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:15.151780 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-077969fd-7dbb-4b1b-beee-bda642252e8a tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:15.411933 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1347baa2-cdfd-4853-ba75-11623e13664e tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:15.417639 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1347baa2-cdfd-4853-ba75-11623e13664e tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] [instance: 4bbb3958-6fd0-4c00-adff-4865f868d0bc] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:15.422330 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-077969fd-7dbb-4b1b-beee-bda642252e8a tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:15.434846 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1347baa2-cdfd-4853-ba75-11623e13664e tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:15.435244 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1347baa2-cdfd-4853-ba75-11623e13664e tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:15.435699 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1347baa2-cdfd-4853-ba75-11623e13664e tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:15.436420 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1347baa2-cdfd-4853-ba75-11623e13664e tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:15.436960 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1347baa2-cdfd-4853-ba75-11623e13664e tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:15.437486 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1347baa2-cdfd-4853-ba75-11623e13664e tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:15.440410 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-077969fd-7dbb-4b1b-beee-bda642252e8a tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:15.441960 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-077969fd-7dbb-4b1b-beee-bda642252e8a tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:15.449453 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-077969fd-7dbb-4b1b-beee-bda642252e8a tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be" status: 200 len: 1598 microversion: 2.20 time: 0.332092 Sep 24 21:07:15.450052 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2252/4514] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:15 2022] GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be => generated 1598 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:15.480637 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8fb3e976-3beb-418a-8f34-4943ac002fb8 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:15.481352 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8fb3e976-3beb-418a-8f34-4943ac002fb8 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 0896ae3f-f6f6-49dd-87df-c73f911c78be] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:15.488124 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8fb3e976-3beb-418a-8f34-4943ac002fb8 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:15.488841 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8fb3e976-3beb-418a-8f34-4943ac002fb8 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:15.489468 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8fb3e976-3beb-418a-8f34-4943ac002fb8 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:15.490423 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8fb3e976-3beb-418a-8f34-4943ac002fb8 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:15.490976 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8fb3e976-3beb-418a-8f34-4943ac002fb8 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:15.491590 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8fb3e976-3beb-418a-8f34-4943ac002fb8 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:15.576312 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1347baa2-cdfd-4853-ba75-11623e13664e tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:15.578901 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1347baa2-cdfd-4853-ba75-11623e13664e tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:15.586848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1347baa2-cdfd-4853-ba75-11623e13664e tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:15.587480 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-1347baa2-cdfd-4853-ba75-11623e13664e tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lazy-loading 'fault' on Instance uuid 4bbb3958-6fd0-4c00-adff-4865f868d0bc {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:07:15.691570 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1347baa2-cdfd-4853-ba75-11623e13664e tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd142c33eccd048bfa3415b1661ee373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c1b7c4c6ff480c82a1f9708b7dbe62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:15.702926 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1347baa2-cdfd-4853-ba75-11623e13664e tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] 10.222.0.52 "GET /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc" status: 200 len: 1314 microversion: 2.1 time: 0.300096 Sep 24 21:07:15.704138 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2263/4515] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:15 2022] GET /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:15.710315 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3e08e676-3935-4866-987f-3db4c6da6ac6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:15.710922 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3e08e676-3935-4866-987f-3db4c6da6ac6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:15.717890 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e08e676-3935-4866-987f-3db4c6da6ac6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:15.718701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e08e676-3935-4866-987f-3db4c6da6ac6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:15.719152 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e08e676-3935-4866-987f-3db4c6da6ac6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:15.720398 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e08e676-3935-4866-987f-3db4c6da6ac6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:15.721059 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e08e676-3935-4866-987f-3db4c6da6ac6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:15.721673 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e08e676-3935-4866-987f-3db4c6da6ac6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:15.736341 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8fb3e976-3beb-418a-8f34-4943ac002fb8 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.259641 Sep 24 21:07:15.737611 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2253/4516] 10.222.0.52 () {60 vars in 1316 bytes} [Sat Sep 24 21:07:15 2022] GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be/os-interface => generated 284 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:07:15.786638 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b81031bc-7cf1-4f6e-b79e-a366b83b76f4 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:15.787809 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b81031bc-7cf1-4f6e-b79e-a366b83b76f4 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] [instance: 975ea9e6-e609-49c1-9492-87e8fb8d2109] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:15.796585 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b81031bc-7cf1-4f6e-b79e-a366b83b76f4 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:15.797413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b81031bc-7cf1-4f6e-b79e-a366b83b76f4 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:15.798958 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b81031bc-7cf1-4f6e-b79e-a366b83b76f4 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:15.799985 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b81031bc-7cf1-4f6e-b79e-a366b83b76f4 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:15.800672 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b81031bc-7cf1-4f6e-b79e-a366b83b76f4 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:15.801305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b81031bc-7cf1-4f6e-b79e-a366b83b76f4 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:16.177641 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b81031bc-7cf1-4f6e-b79e-a366b83b76f4 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:16.194535 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b81031bc-7cf1-4f6e-b79e-a366b83b76f4 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:16.196319 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b81031bc-7cf1-4f6e-b79e-a366b83b76f4 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:16.197589 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b81031bc-7cf1-4f6e-b79e-a366b83b76f4 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] 10.222.0.52 "GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109" status: 200 len: 1336 microversion: 2.57 time: 0.415931 Sep 24 21:07:16.198265 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2254/4517] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:15 2022] GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109 => generated 1336 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:07:16.310987 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3e08e676-3935-4866-987f-3db4c6da6ac6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:16.324630 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3e08e676-3935-4866-987f-3db4c6da6ac6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9" status: 200 len: 1315 microversion: 2.1 time: 0.616987 Sep 24 21:07:16.324630 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2264/4518] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:15 2022] GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 => generated 1315 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:16.405825 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-12a2b042-6e9c-4b98-b628-b6c6af6abbc7 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:16.406413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-12a2b042-6e9c-4b98-b628-b6c6af6abbc7 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 7caa7efc-79ef-47c3-b024-dbcb34877a65] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:16.413558 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-12a2b042-6e9c-4b98-b628-b6c6af6abbc7 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:16.419445 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-12a2b042-6e9c-4b98-b628-b6c6af6abbc7 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:16.420003 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-12a2b042-6e9c-4b98-b628-b6c6af6abbc7 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:16.420997 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-12a2b042-6e9c-4b98-b628-b6c6af6abbc7 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:16.423698 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-12a2b042-6e9c-4b98-b628-b6c6af6abbc7 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:16.425892 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-12a2b042-6e9c-4b98-b628-b6c6af6abbc7 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:16.471109 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-12a2b042-6e9c-4b98-b628-b6c6af6abbc7 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 7caa7efc-79ef-47c3-b024-dbcb34877a65] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:07:16.590450 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-12a2b042-6e9c-4b98-b628-b6c6af6abbc7 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65" status: 204 len: 0 microversion: 2.1 time: 0.188059 Sep 24 21:07:16.594714 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2255/4519] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:07:16 2022] DELETE /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:07:16.600356 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fc48a8a7-2765-4932-ab47-36f32d58eb17 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:16.601555 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fc48a8a7-2765-4932-ab47-36f32d58eb17 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 7caa7efc-79ef-47c3-b024-dbcb34877a65] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:16.614157 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc48a8a7-2765-4932-ab47-36f32d58eb17 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:16.614699 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc48a8a7-2765-4932-ab47-36f32d58eb17 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:16.624841 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc48a8a7-2765-4932-ab47-36f32d58eb17 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:16.625821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc48a8a7-2765-4932-ab47-36f32d58eb17 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:16.626954 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc48a8a7-2765-4932-ab47-36f32d58eb17 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:16.628153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc48a8a7-2765-4932-ab47-36f32d58eb17 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:16.728016 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0d4267b4-affb-4f13-ad1a-74a3204485b2 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:16.729038 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0d4267b4-affb-4f13-ad1a-74a3204485b2 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] [instance: 4bbb3958-6fd0-4c00-adff-4865f868d0bc] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:16.745087 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d4267b4-affb-4f13-ad1a-74a3204485b2 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:16.746689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d4267b4-affb-4f13-ad1a-74a3204485b2 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:16.750246 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d4267b4-affb-4f13-ad1a-74a3204485b2 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:16.758701 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d4267b4-affb-4f13-ad1a-74a3204485b2 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:16.760395 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d4267b4-affb-4f13-ad1a-74a3204485b2 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:16.762949 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d4267b4-affb-4f13-ad1a-74a3204485b2 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:16.788064 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-0d4267b4-affb-4f13-ad1a-74a3204485b2 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] HTTP exception thrown: Instance 4bbb3958-6fd0-4c00-adff-4865f868d0bc could not be found. Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0d4267b4-affb-4f13-ad1a-74a3204485b2 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Request method failure captured: Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc HTTP/1.1 Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3FpssVcjcTvek9r_CGgSKaGBvusMnv1IjCmVQEZ2gygrPd-EZu-EMtzKvJUPCkQZ6tGmvRYAX72366co7gDVGSAgqSM4G1r-wNcxTI1Du8q49whlMv_D0aer9U-eXOajH9nFDKi5rtsXr7w9z61Qb-Ckoj8adG3XMm89Sddj0oUpBE Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: b0c1b7c4c6ff480c82a1f9708b7dbe62 Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-382138128 Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b0c1b7c4c6ff480c82a1f9708b7dbe62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b0c1b7c4c6ff480c82a1f9708b7dbe62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b0c1b7c4c6ff480c82a1f9708b7dbe62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b0c1b7c4c6ff480c82a1f9708b7dbe62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-382138128 Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: b0c1b7c4c6ff480c82a1f9708b7dbe62 Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-382138128 Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServerAddressesNegativeTestJSON-382138128-project Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: d142c33eccd048bfa3415b1661ee373f Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-382138128-project Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 4bbb3958-6fd0-4c00-adff-4865f868d0bc could not be found. Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '4bbb3958-6fd0-4c00-adff-4865f868d0bc'} Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bbb3958-6fd0-4c00-adff-4865f868d0bc could not be found. Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bbb3958-6fd0-4c00-adff-4865f868d0bc could not be found. Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:07:16.789793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:07:16.794785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:07:16.794785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:07:16.794785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:07:16.794785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:07:16.794785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:07:16.794785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:07:16.794785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bbb3958-6fd0-4c00-adff-4865f868d0bc could not be found. Sep 24 21:07:16.794785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:07:16.794785 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0d4267b4-affb-4f13-ad1a-74a3204485b2 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] Returning 404 to user: Instance 4bbb3958-6fd0-4c00-adff-4865f868d0bc could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:07:16.794785 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0d4267b4-affb-4f13-ad1a-74a3204485b2 tempest-ServerAddressesNegativeTestJSON-382138128 tempest-ServerAddressesNegativeTestJSON-382138128-project] 10.222.0.52 "GET /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc" status: 404 len: 111 microversion: 2.1 time: 0.069487 Sep 24 21:07:16.797056 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2256/4520] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:16 2022] GET /compute/v2.1/servers/4bbb3958-6fd0-4c00-adff-4865f868d0bc => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:07:16.908595 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:07:16.942365 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fc48a8a7-2765-4932-ab47-36f32d58eb17 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:16.950713 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fc48a8a7-2765-4932-ab47-36f32d58eb17 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65" status: 200 len: 1681 microversion: 2.1 time: 0.354182 Sep 24 21:07:16.952578 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2265/4521] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:16 2022] GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65 => generated 1681 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:17.228071 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ac466f02-6716-4d69-8c6a-efc48011f536 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:17.228707 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ac466f02-6716-4d69-8c6a-efc48011f536 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] [instance: 975ea9e6-e609-49c1-9492-87e8fb8d2109] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:17.235329 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac466f02-6716-4d69-8c6a-efc48011f536 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:17.236563 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac466f02-6716-4d69-8c6a-efc48011f536 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:17.238478 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac466f02-6716-4d69-8c6a-efc48011f536 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:17.239259 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac466f02-6716-4d69-8c6a-efc48011f536 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:17.239739 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac466f02-6716-4d69-8c6a-efc48011f536 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:17.240183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac466f02-6716-4d69-8c6a-efc48011f536 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:17.339523 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ac466f02-6716-4d69-8c6a-efc48011f536 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:17.352161 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-819e909f-3bcf-44e4-9d8f-136c3fa2e932 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:17.353077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-819e909f-3bcf-44e4-9d8f-136c3fa2e932 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:17.361443 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ac466f02-6716-4d69-8c6a-efc48011f536 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:17.363849 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ac466f02-6716-4d69-8c6a-efc48011f536 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:17.364111 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-819e909f-3bcf-44e4-9d8f-136c3fa2e932 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:17.364992 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-819e909f-3bcf-44e4-9d8f-136c3fa2e932 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:17.366189 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-819e909f-3bcf-44e4-9d8f-136c3fa2e932 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:17.367250 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-819e909f-3bcf-44e4-9d8f-136c3fa2e932 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:17.367639 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ac466f02-6716-4d69-8c6a-efc48011f536 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] 10.222.0.52 "GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109" status: 200 len: 1336 microversion: 2.57 time: 0.144498 Sep 24 21:07:17.368756 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-819e909f-3bcf-44e4-9d8f-136c3fa2e932 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:17.370229 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-819e909f-3bcf-44e4-9d8f-136c3fa2e932 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:17.372068 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2257/4522] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:17 2022] GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109 => generated 1336 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:07:17.824937 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-819e909f-3bcf-44e4-9d8f-136c3fa2e932 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:17.834883 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-819e909f-3bcf-44e4-9d8f-136c3fa2e932 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9" status: 200 len: 1315 microversion: 2.1 time: 0.486978 Sep 24 21:07:17.848606 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2266/4523] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:17 2022] GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 => generated 1315 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:17.976327 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3756f6cb-8b54-4ed6-9673-f4de5e0dbb9e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:17.977651 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3756f6cb-8b54-4ed6-9673-f4de5e0dbb9e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 7caa7efc-79ef-47c3-b024-dbcb34877a65] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:17.986831 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3756f6cb-8b54-4ed6-9673-f4de5e0dbb9e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:17.988220 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3756f6cb-8b54-4ed6-9673-f4de5e0dbb9e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:17.990365 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3756f6cb-8b54-4ed6-9673-f4de5e0dbb9e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:17.991766 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3756f6cb-8b54-4ed6-9673-f4de5e0dbb9e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:17.993481 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3756f6cb-8b54-4ed6-9673-f4de5e0dbb9e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:17.994145 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3756f6cb-8b54-4ed6-9673-f4de5e0dbb9e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:18.310855 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-666a50fb-0587-4522-8c63-38494336f426 req-05513461-b6e9-4194-9f84-48416cd548f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0896ae3f-f6f6-49dd-87df-c73f911c78be", "tag": "29c8bcaf-e987-4103-8e4a-20d1ad7bfbe6"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:07:18.333716 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-666a50fb-0587-4522-8c63-38494336f426 req-05513461-b6e9-4194-9f84-48416cd548f4 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:18.334578 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-666a50fb-0587-4522-8c63-38494336f426 req-05513461-b6e9-4194-9f84-48416cd548f4 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:18.335234 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-666a50fb-0587-4522-8c63-38494336f426 req-05513461-b6e9-4194-9f84-48416cd548f4 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:18.362926 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-666a50fb-0587-4522-8c63-38494336f426 req-05513461-b6e9-4194-9f84-48416cd548f4 service nova] Creating event network-changed:29c8bcaf-e987-4103-8e4a-20d1ad7bfbe6 for instance 0896ae3f-f6f6-49dd-87df-c73f911c78be on nch2-master-1 Sep 24 21:07:18.374268 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-666a50fb-0587-4522-8c63-38494336f426 req-05513461-b6e9-4194-9f84-48416cd548f4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067860 Sep 24 21:07:18.398867 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2267/4524] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:07:18.399548 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6ccf536b-09b2-4592-a0df-f30d7e495bc0 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:18.403285 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6ccf536b-09b2-4592-a0df-f30d7e495bc0 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] [instance: 975ea9e6-e609-49c1-9492-87e8fb8d2109] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:18.419957 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ccf536b-09b2-4592-a0df-f30d7e495bc0 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:18.420884 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ccf536b-09b2-4592-a0df-f30d7e495bc0 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:18.421566 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ccf536b-09b2-4592-a0df-f30d7e495bc0 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:18.422619 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ccf536b-09b2-4592-a0df-f30d7e495bc0 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:18.423622 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ccf536b-09b2-4592-a0df-f30d7e495bc0 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:18.424304 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ccf536b-09b2-4592-a0df-f30d7e495bc0 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:18.618251 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6ccf536b-09b2-4592-a0df-f30d7e495bc0 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:18.619781 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3756f6cb-8b54-4ed6-9673-f4de5e0dbb9e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:18.629242 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3756f6cb-8b54-4ed6-9673-f4de5e0dbb9e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65" status: 200 len: 1681 microversion: 2.1 time: 0.656757 Sep 24 21:07:18.633442 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2258/4525] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:17 2022] GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65 => generated 1681 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:07:18.646155 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6ccf536b-09b2-4592-a0df-f30d7e495bc0 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:18.647853 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6ccf536b-09b2-4592-a0df-f30d7e495bc0 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:18.649265 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6ccf536b-09b2-4592-a0df-f30d7e495bc0 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] 10.222.0.52 "GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109" status: 200 len: 1336 microversion: 2.57 time: 0.253949 Sep 24 21:07:18.663508 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2268/4526] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:18 2022] GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109 => generated 1336 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:18.861552 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fb03ce0b-d21c-4e90-9fef-79ef707ec396 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:18.862709 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fb03ce0b-d21c-4e90-9fef-79ef707ec396 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:18.872515 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb03ce0b-d21c-4e90-9fef-79ef707ec396 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:18.874206 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb03ce0b-d21c-4e90-9fef-79ef707ec396 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:18.874897 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb03ce0b-d21c-4e90-9fef-79ef707ec396 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:18.876675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb03ce0b-d21c-4e90-9fef-79ef707ec396 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:18.879221 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb03ce0b-d21c-4e90-9fef-79ef707ec396 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:18.880211 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb03ce0b-d21c-4e90-9fef-79ef707ec396 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:19.241006 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fb03ce0b-d21c-4e90-9fef-79ef707ec396 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:19.267275 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fb03ce0b-d21c-4e90-9fef-79ef707ec396 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9" status: 200 len: 1315 microversion: 2.1 time: 0.410563 Sep 24 21:07:19.272269 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2259/4527] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:18 2022] GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 => generated 1315 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:19.653446 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4accd942-ca35-42b3-bd30-832eedb613f7 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:19.654078 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4accd942-ca35-42b3-bd30-832eedb613f7 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 7caa7efc-79ef-47c3-b024-dbcb34877a65] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:19.662324 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4accd942-ca35-42b3-bd30-832eedb613f7 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:19.663391 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4accd942-ca35-42b3-bd30-832eedb613f7 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:19.664132 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4accd942-ca35-42b3-bd30-832eedb613f7 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:19.665009 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4accd942-ca35-42b3-bd30-832eedb613f7 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:19.665633 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4accd942-ca35-42b3-bd30-832eedb613f7 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:19.666213 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4accd942-ca35-42b3-bd30-832eedb613f7 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:19.677451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f3d9d351-3368-44cc-a304-a78a1b543401 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:19.678380 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f3d9d351-3368-44cc-a304-a78a1b543401 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] [instance: 975ea9e6-e609-49c1-9492-87e8fb8d2109] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:19.689616 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f3d9d351-3368-44cc-a304-a78a1b543401 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:19.699703 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f3d9d351-3368-44cc-a304-a78a1b543401 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:19.700421 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f3d9d351-3368-44cc-a304-a78a1b543401 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:19.701457 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f3d9d351-3368-44cc-a304-a78a1b543401 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:19.702093 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f3d9d351-3368-44cc-a304-a78a1b543401 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:19.702733 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f3d9d351-3368-44cc-a304-a78a1b543401 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:20.024407 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f3d9d351-3368-44cc-a304-a78a1b543401 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:20.038267 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f3d9d351-3368-44cc-a304-a78a1b543401 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:20.040095 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f3d9d351-3368-44cc-a304-a78a1b543401 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:20.041868 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f3d9d351-3368-44cc-a304-a78a1b543401 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] 10.222.0.52 "GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109" status: 200 len: 1357 microversion: 2.57 time: 0.368372 Sep 24 21:07:20.043246 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2260/4528] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:19 2022] GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109 => generated 1357 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:20.071985 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ef77ca1f-c07c-40d8-8513-c990f1de6cd5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:07:20.080499 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ef77ca1f-c07c-40d8-8513-c990f1de6cd5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] [instance: 975ea9e6-e609-49c1-9492-87e8fb8d2109] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:20.094940 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef77ca1f-c07c-40d8-8513-c990f1de6cd5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:20.095805 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef77ca1f-c07c-40d8-8513-c990f1de6cd5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:20.096501 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef77ca1f-c07c-40d8-8513-c990f1de6cd5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:20.097434 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef77ca1f-c07c-40d8-8513-c990f1de6cd5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:20.098123 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef77ca1f-c07c-40d8-8513-c990f1de6cd5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:20.098810 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef77ca1f-c07c-40d8-8513-c990f1de6cd5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:20.228276 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-ef77ca1f-c07c-40d8-8513-c990f1de6cd5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:07:20.228717 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-ef77ca1f-c07c-40d8-8513-c990f1de6cd5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:07:20.229208 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-ef77ca1f-c07c-40d8-8513-c990f1de6cd5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:07:20.229621 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-ef77ca1f-c07c-40d8-8513-c990f1de6cd5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:07:20.230377 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-ef77ca1f-c07c-40d8-8513-c990f1de6cd5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:07:20.322799 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ef77ca1f-c07c-40d8-8513-c990f1de6cd5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] [instance: 975ea9e6-e609-49c1-9492-87e8fb8d2109] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:20.331189 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef77ca1f-c07c-40d8-8513-c990f1de6cd5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:20.331762 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef77ca1f-c07c-40d8-8513-c990f1de6cd5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:20.332222 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef77ca1f-c07c-40d8-8513-c990f1de6cd5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:20.333628 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef77ca1f-c07c-40d8-8513-c990f1de6cd5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:20.334931 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef77ca1f-c07c-40d8-8513-c990f1de6cd5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:20.335397 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef77ca1f-c07c-40d8-8513-c990f1de6cd5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:20.385253 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ef77ca1f-c07c-40d8-8513-c990f1de6cd5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] 10.222.0.52 "POST /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109/action" status: 202 len: 1138 microversion: 2.57 time: 0.316797 Sep 24 21:07:20.385996 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2261/4529] 10.222.0.52 () {62 vars in 1320 bytes} [Sat Sep 24 21:07:20 2022] POST /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109/action => generated 1138 bytes in 320 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Sep 24 21:07:20.396820 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-07b0214c-50dd-40a5-83da-0f23ee5ef08c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:20.397510 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-07b0214c-50dd-40a5-83da-0f23ee5ef08c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:20.407233 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07b0214c-50dd-40a5-83da-0f23ee5ef08c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:20.408932 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07b0214c-50dd-40a5-83da-0f23ee5ef08c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:20.409400 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07b0214c-50dd-40a5-83da-0f23ee5ef08c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:20.410287 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07b0214c-50dd-40a5-83da-0f23ee5ef08c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:20.410907 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07b0214c-50dd-40a5-83da-0f23ee5ef08c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:20.411349 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07b0214c-50dd-40a5-83da-0f23ee5ef08c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:20.505510 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4accd942-ca35-42b3-bd30-832eedb613f7 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:20.517694 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4accd942-ca35-42b3-bd30-832eedb613f7 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65" status: 200 len: 1681 microversion: 2.1 time: 0.867933 Sep 24 21:07:20.518799 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2269/4530] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:19 2022] GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65 => generated 1681 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:20.525396 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0b8b0649-2aee-4ed3-a33f-a70ad76914fa tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:20.526243 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0b8b0649-2aee-4ed3-a33f-a70ad76914fa tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] [instance: 975ea9e6-e609-49c1-9492-87e8fb8d2109] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:20.539497 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0b8b0649-2aee-4ed3-a33f-a70ad76914fa tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:20.540250 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0b8b0649-2aee-4ed3-a33f-a70ad76914fa tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:20.540849 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0b8b0649-2aee-4ed3-a33f-a70ad76914fa tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:20.541731 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0b8b0649-2aee-4ed3-a33f-a70ad76914fa tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:20.542429 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0b8b0649-2aee-4ed3-a33f-a70ad76914fa tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:20.543227 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0b8b0649-2aee-4ed3-a33f-a70ad76914fa tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:20.652774 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0b8b0649-2aee-4ed3-a33f-a70ad76914fa tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:20.669852 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0b8b0649-2aee-4ed3-a33f-a70ad76914fa tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:20.672229 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0b8b0649-2aee-4ed3-a33f-a70ad76914fa tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:20.676228 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0b8b0649-2aee-4ed3-a33f-a70ad76914fa tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] 10.222.0.52 "GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109" status: 200 len: 1366 microversion: 2.57 time: 0.156286 Sep 24 21:07:20.681123 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2270/4531] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:20 2022] GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:20.693881 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-07b0214c-50dd-40a5-83da-0f23ee5ef08c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:20.701688 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-07b0214c-50dd-40a5-83da-0f23ee5ef08c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9" status: 200 len: 1315 microversion: 2.1 time: 0.314595 Sep 24 21:07:20.702288 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2262/4532] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:20 2022] GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:21.109620 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-029e3c8c-41fb-4957-afa6-de4de303aa54 req-030c6541-cf5e-43bb-a4e5-e002ef621275 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dda4c066-f7bb-45df-9e57-b0e2d23fd7b9", "name": "network-vif-plugged", "status": "completed", "tag": "760158dc-6fec-418e-aae5-f938ec813cb9"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:07:21.130489 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-029e3c8c-41fb-4957-afa6-de4de303aa54 req-030c6541-cf5e-43bb-a4e5-e002ef621275 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:21.131077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-029e3c8c-41fb-4957-afa6-de4de303aa54 req-030c6541-cf5e-43bb-a4e5-e002ef621275 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:21.131493 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-029e3c8c-41fb-4957-afa6-de4de303aa54 req-030c6541-cf5e-43bb-a4e5-e002ef621275 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:21.154114 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-029e3c8c-41fb-4957-afa6-de4de303aa54 req-030c6541-cf5e-43bb-a4e5-e002ef621275 service nova] Creating event network-vif-plugged:760158dc-6fec-418e-aae5-f938ec813cb9 for instance dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 on nch2-master-1 Sep 24 21:07:21.172178 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-029e3c8c-41fb-4957-afa6-de4de303aa54 req-030c6541-cf5e-43bb-a4e5-e002ef621275 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066068 Sep 24 21:07:21.173725 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2271/4533] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:07:21.541473 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-069fd7ae-3b62-4edc-b5dc-019f32fb5d91 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:21.542105 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-069fd7ae-3b62-4edc-b5dc-019f32fb5d91 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 7caa7efc-79ef-47c3-b024-dbcb34877a65] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:21.552373 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-069fd7ae-3b62-4edc-b5dc-019f32fb5d91 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:21.552874 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-069fd7ae-3b62-4edc-b5dc-019f32fb5d91 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:21.567306 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-069fd7ae-3b62-4edc-b5dc-019f32fb5d91 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:21.568466 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-069fd7ae-3b62-4edc-b5dc-019f32fb5d91 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:21.569117 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-069fd7ae-3b62-4edc-b5dc-019f32fb5d91 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:21.569794 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-069fd7ae-3b62-4edc-b5dc-019f32fb5d91 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:21.708710 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9971295d-22fc-48e2-83b0-a7ee06c84cf6 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:21.709342 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9971295d-22fc-48e2-83b0-a7ee06c84cf6 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] [instance: 975ea9e6-e609-49c1-9492-87e8fb8d2109] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:21.716668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9971295d-22fc-48e2-83b0-a7ee06c84cf6 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:21.717411 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9971295d-22fc-48e2-83b0-a7ee06c84cf6 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:21.718027 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9971295d-22fc-48e2-83b0-a7ee06c84cf6 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:21.718940 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9971295d-22fc-48e2-83b0-a7ee06c84cf6 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:21.719559 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9971295d-22fc-48e2-83b0-a7ee06c84cf6 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:21.722807 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9971295d-22fc-48e2-83b0-a7ee06c84cf6 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:21.819841 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-069fd7ae-3b62-4edc-b5dc-019f32fb5d91 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:21.827731 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-069fd7ae-3b62-4edc-b5dc-019f32fb5d91 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65" status: 200 len: 1613 microversion: 2.1 time: 0.290241 Sep 24 21:07:21.828560 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2263/4534] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:21 2022] GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65 => generated 1613 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:21.833856 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-13093b7f-8c4f-46b1-a460-24b00d47d759 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:21.834730 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-13093b7f-8c4f-46b1-a460-24b00d47d759 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:21.841404 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-13093b7f-8c4f-46b1-a460-24b00d47d759 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:21.842061 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-13093b7f-8c4f-46b1-a460-24b00d47d759 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:21.842793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-13093b7f-8c4f-46b1-a460-24b00d47d759 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:21.843675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-13093b7f-8c4f-46b1-a460-24b00d47d759 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:21.844282 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-13093b7f-8c4f-46b1-a460-24b00d47d759 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:21.845433 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-13093b7f-8c4f-46b1-a460-24b00d47d759 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:21.851926 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:07:21.896610 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9971295d-22fc-48e2-83b0-a7ee06c84cf6 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:21.917498 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9971295d-22fc-48e2-83b0-a7ee06c84cf6 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:21.920525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9971295d-22fc-48e2-83b0-a7ee06c84cf6 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:21.924692 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9971295d-22fc-48e2-83b0-a7ee06c84cf6 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] 10.222.0.52 "GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109" status: 200 len: 1366 microversion: 2.57 time: 0.219244 Sep 24 21:07:21.925839 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2272/4535] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:21 2022] GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:22.125730 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-13093b7f-8c4f-46b1-a460-24b00d47d759 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:22.146033 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-13093b7f-8c4f-46b1-a460-24b00d47d759 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9" status: 200 len: 1315 microversion: 2.1 time: 0.316052 Sep 24 21:07:22.159253 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2264/4536] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:21 2022] GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:22.209741 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-759706df-9153-4452-8b0f-199c0072a6db req-8eb0ede7-c783-426b-84bc-0c5be48db287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7caa7efc-79ef-47c3-b024-dbcb34877a65", "name": "network-vif-deleted", "tag": "12ef86dc-2a21-4148-b45a-ed3026b5e112"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:07:22.237924 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-759706df-9153-4452-8b0f-199c0072a6db req-8eb0ede7-c783-426b-84bc-0c5be48db287 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:22.238228 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-759706df-9153-4452-8b0f-199c0072a6db req-8eb0ede7-c783-426b-84bc-0c5be48db287 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:22.238799 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-759706df-9153-4452-8b0f-199c0072a6db req-8eb0ede7-c783-426b-84bc-0c5be48db287 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:22.266051 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-759706df-9153-4452-8b0f-199c0072a6db req-8eb0ede7-c783-426b-84bc-0c5be48db287 service nova] Creating event network-vif-deleted:12ef86dc-2a21-4148-b45a-ed3026b5e112 for instance 7caa7efc-79ef-47c3-b024-dbcb34877a65 on nch2-master-1 Sep 24 21:07:22.278862 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-759706df-9153-4452-8b0f-199c0072a6db req-8eb0ede7-c783-426b-84bc-0c5be48db287 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075099 Sep 24 21:07:22.280061 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2273/4537] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:07:22.856065 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ce1e6841-4eeb-4b38-afec-47972f520abc tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:22.857373 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ce1e6841-4eeb-4b38-afec-47972f520abc tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 7caa7efc-79ef-47c3-b024-dbcb34877a65] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:22.871784 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ce1e6841-4eeb-4b38-afec-47972f520abc tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:22.887192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ce1e6841-4eeb-4b38-afec-47972f520abc tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:22.888019 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ce1e6841-4eeb-4b38-afec-47972f520abc tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:22.889063 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ce1e6841-4eeb-4b38-afec-47972f520abc tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:22.889834 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ce1e6841-4eeb-4b38-afec-47972f520abc tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:22.890519 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ce1e6841-4eeb-4b38-afec-47972f520abc tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:22.961079 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cd6818ba-69c6-4db0-99dd-f125ae638632 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:22.965367 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cd6818ba-69c6-4db0-99dd-f125ae638632 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] [instance: 975ea9e6-e609-49c1-9492-87e8fb8d2109] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:22.995667 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ce1e6841-4eeb-4b38-afec-47972f520abc tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:22.997061 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd6818ba-69c6-4db0-99dd-f125ae638632 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:22.997727 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ce1e6841-4eeb-4b38-afec-47972f520abc tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:22.998609 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ce1e6841-4eeb-4b38-afec-47972f520abc tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:23.000700 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-ce1e6841-4eeb-4b38-afec-47972f520abc tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lazy-loading 'fault' on Instance uuid 7caa7efc-79ef-47c3-b024-dbcb34877a65 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:07:23.012689 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd6818ba-69c6-4db0-99dd-f125ae638632 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:23.018013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd6818ba-69c6-4db0-99dd-f125ae638632 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:23.018966 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd6818ba-69c6-4db0-99dd-f125ae638632 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:23.021347 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd6818ba-69c6-4db0-99dd-f125ae638632 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:23.022063 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd6818ba-69c6-4db0-99dd-f125ae638632 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:23.120459 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ce1e6841-4eeb-4b38-afec-47972f520abc tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:23.138084 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ce1e6841-4eeb-4b38-afec-47972f520abc tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65" status: 200 len: 1330 microversion: 2.1 time: 0.284403 Sep 24 21:07:23.139902 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2265/4538] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:22 2022] GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65 => generated 1330 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:23.205085 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-70a14208-63e0-42be-ac23-59d6c15f8aed tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:23.226474 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-70a14208-63e0-42be-ac23-59d6c15f8aed tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:23.244497 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-70a14208-63e0-42be-ac23-59d6c15f8aed tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:23.245383 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-70a14208-63e0-42be-ac23-59d6c15f8aed tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:23.245996 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-70a14208-63e0-42be-ac23-59d6c15f8aed tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:23.246957 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-70a14208-63e0-42be-ac23-59d6c15f8aed tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:23.247569 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-70a14208-63e0-42be-ac23-59d6c15f8aed tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:23.248305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-70a14208-63e0-42be-ac23-59d6c15f8aed tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:23.252990 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cd6818ba-69c6-4db0-99dd-f125ae638632 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:23.264837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cd6818ba-69c6-4db0-99dd-f125ae638632 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:23.294449 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cd6818ba-69c6-4db0-99dd-f125ae638632 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:23.297319 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cd6818ba-69c6-4db0-99dd-f125ae638632 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] 10.222.0.52 "GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109" status: 200 len: 1366 microversion: 2.57 time: 0.350206 Sep 24 21:07:23.302661 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:07:23.316188 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2274/4539] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:22 2022] GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109 => generated 1366 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:23.325393 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:07:23.608553 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-70a14208-63e0-42be-ac23-59d6c15f8aed tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:23.621675 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-70a14208-63e0-42be-ac23-59d6c15f8aed tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9" status: 200 len: 1502 microversion: 2.1 time: 0.425007 Sep 24 21:07:23.623542 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2266/4540] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:23 2022] GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 => generated 1502 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:23.650631 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9b986196-9a35-40ff-8bbf-16c451a6e224 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:07:23.652803 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9b986196-9a35-40ff-8bbf-16c451a6e224 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:23.664499 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=12 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:07:23.665856 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:07:23.668416 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9b986196-9a35-40ff-8bbf-16c451a6e224 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:23.669318 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9b986196-9a35-40ff-8bbf-16c451a6e224 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:23.671043 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9b986196-9a35-40ff-8bbf-16c451a6e224 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:23.672887 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9b986196-9a35-40ff-8bbf-16c451a6e224 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:23.673723 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9b986196-9a35-40ff-8bbf-16c451a6e224 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:23.674587 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9b986196-9a35-40ff-8bbf-16c451a6e224 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:23.861498 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9b986196-9a35-40ff-8bbf-16c451a6e224 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "POST /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9/action" status: 202 len: 0 microversion: 2.1 time: 0.205019 Sep 24 21:07:23.867011 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2275/4541] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:07:23 2022] POST /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:07:23.873467 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c1dd3110-8f7b-4c79-8b84-777a0f133dc0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:23.874184 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c1dd3110-8f7b-4c79-8b84-777a0f133dc0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:23.899223 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c1dd3110-8f7b-4c79-8b84-777a0f133dc0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:23.899812 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c1dd3110-8f7b-4c79-8b84-777a0f133dc0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:23.900423 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c1dd3110-8f7b-4c79-8b84-777a0f133dc0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:23.901506 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c1dd3110-8f7b-4c79-8b84-777a0f133dc0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:23.902213 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c1dd3110-8f7b-4c79-8b84-777a0f133dc0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:23.903848 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c1dd3110-8f7b-4c79-8b84-777a0f133dc0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:24.174887 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0ff5d988-3bc2-4d1a-b68b-d33dab24285e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:24.176601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0ff5d988-3bc2-4d1a-b68b-d33dab24285e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 7caa7efc-79ef-47c3-b024-dbcb34877a65] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:24.187611 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0ff5d988-3bc2-4d1a-b68b-d33dab24285e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:24.188606 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c1dd3110-8f7b-4c79-8b84-777a0f133dc0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:24.200862 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c1dd3110-8f7b-4c79-8b84-777a0f133dc0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9" status: 200 len: 1507 microversion: 2.1 time: 0.332089 Sep 24 21:07:24.207311 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2267/4542] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:23 2022] GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 => generated 1507 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:24.209559 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0ff5d988-3bc2-4d1a-b68b-d33dab24285e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:24.210115 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0ff5d988-3bc2-4d1a-b68b-d33dab24285e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:24.212387 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0ff5d988-3bc2-4d1a-b68b-d33dab24285e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:24.213069 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0ff5d988-3bc2-4d1a-b68b-d33dab24285e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:24.213671 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0ff5d988-3bc2-4d1a-b68b-d33dab24285e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:24.266147 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-0ff5d988-3bc2-4d1a-b68b-d33dab24285e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] HTTP exception thrown: Instance 7caa7efc-79ef-47c3-b024-dbcb34877a65 could not be found. Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0ff5d988-3bc2-4d1a-b68b-d33dab24285e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Request method failure captured: Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65 HTTP/1.1 Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3FHajgQDXwDLPMdCneYsWMRO5KNyPHbfz7MOl1V6BQj2tCeZ2BgA1Mx3ktQ4m5HdNZhq5ppxGBz6lcC3ya-83mTOrwZRf93lvlUCMm9tAmwFMDFSArAIXGx5zWOL9fV8cMG0WLcDOQ7UmGyVIS3hmxMWF5HkXywVAOGRIZ6csTGTS0 Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: ede438e67af3496cae36fc89abc0aba3 Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-AttachVolumeNegativeTest-1729429408 Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ede438e67af3496cae36fc89abc0aba3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ede438e67af3496cae36fc89abc0aba3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ede438e67af3496cae36fc89abc0aba3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ede438e67af3496cae36fc89abc0aba3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-AttachVolumeNegativeTest-1729429408 Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: ede438e67af3496cae36fc89abc0aba3 Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1729429408 Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-AttachVolumeNegativeTest-1729429408-project Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 370b057b12c148cdbb673ba6c06bd6b4 Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-AttachVolumeNegativeTest-1729429408-project Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 7caa7efc-79ef-47c3-b024-dbcb34877a65 could not be found. Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '7caa7efc-79ef-47c3-b024-dbcb34877a65'} Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7caa7efc-79ef-47c3-b024-dbcb34877a65 could not be found. Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7caa7efc-79ef-47c3-b024-dbcb34877a65 could not be found. Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:07:24.273486 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:07:24.277893 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:07:24.277893 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:07:24.277893 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:07:24.277893 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:07:24.277893 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:07:24.277893 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7caa7efc-79ef-47c3-b024-dbcb34877a65 could not be found. Sep 24 21:07:24.277893 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:07:24.279525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0ff5d988-3bc2-4d1a-b68b-d33dab24285e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Returning 404 to user: Instance 7caa7efc-79ef-47c3-b024-dbcb34877a65 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:07:24.280552 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0ff5d988-3bc2-4d1a-b68b-d33dab24285e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65" status: 404 len: 111 microversion: 2.1 time: 0.115684 Sep 24 21:07:24.285619 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2276/4543] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:24 2022] GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 21:07:24.294777 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0dd353f1-a1d6-4259-8d5d-d9e2eeb1a86f tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '.version_select at 0x7f4b0c374280>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:24.323240 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0dd353f1-a1d6-4259-8d5d-d9e2eeb1a86f tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1770304215" status: 202 len: 0 microversion: 2.1 time: 0.036234 Sep 24 21:07:24.327467 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2268/4544] 10.222.0.52 () {58 vars in 1221 bytes} [Sat Sep 24 21:07:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1770304215 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:07:24.339493 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6fec91e2-b5da-4f49-a624-a9723897394b tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:24.340447 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6fec91e2-b5da-4f49-a624-a9723897394b tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] [instance: 975ea9e6-e609-49c1-9492-87e8fb8d2109] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:24.350676 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6fec91e2-b5da-4f49-a624-a9723897394b tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:24.351849 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6fec91e2-b5da-4f49-a624-a9723897394b tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:24.352093 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6fec91e2-b5da-4f49-a624-a9723897394b tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:24.352902 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6fec91e2-b5da-4f49-a624-a9723897394b tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:24.356770 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6fec91e2-b5da-4f49-a624-a9723897394b tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:24.357654 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6fec91e2-b5da-4f49-a624-a9723897394b tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:24.366441 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:07:24.465040 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6fec91e2-b5da-4f49-a624-a9723897394b tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:24.488973 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6fec91e2-b5da-4f49-a624-a9723897394b tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:24.490490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6fec91e2-b5da-4f49-a624-a9723897394b tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:24.494925 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6fec91e2-b5da-4f49-a624-a9723897394b tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] 10.222.0.52 "GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109" status: 200 len: 1366 microversion: 2.57 time: 0.160419 Sep 24 21:07:24.519003 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2277/4545] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:24 2022] GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:25.230188 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-940775de-a9f8-481b-b9fd-dc5e8b4ea2d2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:25.231889 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-940775de-a9f8-481b-b9fd-dc5e8b4ea2d2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:25.240399 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-940775de-a9f8-481b-b9fd-dc5e8b4ea2d2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:25.241055 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-940775de-a9f8-481b-b9fd-dc5e8b4ea2d2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:25.242279 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-940775de-a9f8-481b-b9fd-dc5e8b4ea2d2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:25.247428 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-940775de-a9f8-481b-b9fd-dc5e8b4ea2d2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:25.248203 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-940775de-a9f8-481b-b9fd-dc5e8b4ea2d2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:25.248656 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-940775de-a9f8-481b-b9fd-dc5e8b4ea2d2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:25.417732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-be2e3b0f-55e9-4d28-9a78-13cc9a57e30e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Action: 'create', calling method: .version_select at 0x7f4b110aa280>, body: {"keypair": {"name": "tempest-keypair-1049484806", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPHc7o8n+kP8OkGAQtclBc04sVRwQ++C7n/gLhaRSQ82iWwUlGYpBQ7IrpNGofqPBSq3QG7/yokCdoKocs6UeiEb+naa+R0iIurcrCSduSaUGMyxpexQ4g40v2rXk294AA=="}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:07:25.457263 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-be2e3b0f-55e9-4d28-9a78-13cc9a57e30e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Getting quotas for project ede438e67af3496cae36fc89abc0aba3. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:07:25.470666 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-be2e3b0f-55e9-4d28-9a78-13cc9a57e30e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Getting quotas for user 370b057b12c148cdbb673ba6c06bd6b4 and project ede438e67af3496cae36fc89abc0aba3. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:07:25.504262 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-be2e3b0f-55e9-4d28-9a78-13cc9a57e30e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.091970 Sep 24 21:07:25.505206 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2278/4546] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 21:07:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:07:25.516272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-940775de-a9f8-481b-b9fd-dc5e8b4ea2d2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:25.529055 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-940775de-a9f8-481b-b9fd-dc5e8b4ea2d2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9" status: 200 len: 1487 microversion: 2.1 time: 0.303701 Sep 24 21:07:25.530063 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2269/4547] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:25 2022] GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 => generated 1487 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:25.531670 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-431b2f30-be6d-4058-a39b-3b7e0a2192e5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:25.533644 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-431b2f30-be6d-4058-a39b-3b7e0a2192e5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] [instance: 975ea9e6-e609-49c1-9492-87e8fb8d2109] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:25.540960 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-431b2f30-be6d-4058-a39b-3b7e0a2192e5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:25.541729 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-431b2f30-be6d-4058-a39b-3b7e0a2192e5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:25.542387 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-431b2f30-be6d-4058-a39b-3b7e0a2192e5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:25.543537 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-431b2f30-be6d-4058-a39b-3b7e0a2192e5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:25.544755 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-431b2f30-be6d-4058-a39b-3b7e0a2192e5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:25.545590 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-431b2f30-be6d-4058-a39b-3b7e0a2192e5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:25.562770 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c6a0b9d2-30f6-4842-91f0-c831113aa966 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:07:25.564235 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c6a0b9d2-30f6-4842-91f0-c831113aa966 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:25.574484 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6a0b9d2-30f6-4842-91f0-c831113aa966 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:25.576513 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6a0b9d2-30f6-4842-91f0-c831113aa966 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:25.577234 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6a0b9d2-30f6-4842-91f0-c831113aa966 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:25.580812 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6a0b9d2-30f6-4842-91f0-c831113aa966 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:25.581617 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6a0b9d2-30f6-4842-91f0-c831113aa966 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:25.583193 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6a0b9d2-30f6-4842-91f0-c831113aa966 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:25.651782 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-c6a0b9d2-30f6-4842-91f0-c831113aa966 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lazy-loading 'flavor' on Instance uuid dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:07:25.710179 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-431b2f30-be6d-4058-a39b-3b7e0a2192e5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:25.728109 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-431b2f30-be6d-4058-a39b-3b7e0a2192e5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:25.740409 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-431b2f30-be6d-4058-a39b-3b7e0a2192e5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:25.741660 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-431b2f30-be6d-4058-a39b-3b7e0a2192e5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] 10.222.0.52 "GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109" status: 200 len: 1366 microversion: 2.57 time: 0.216795 Sep 24 21:07:25.742240 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2279/4548] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:25 2022] GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:26.015695 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c6a0b9d2-30f6-4842-91f0-c831113aa966 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "POST /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9/action" status: 202 len: 0 microversion: 2.1 time: 0.457958 Sep 24 21:07:26.019447 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2270/4549] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:07:25 2022] POST /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9/action => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:07:26.027216 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-43963ecd-a767-477b-aeb7-725c9fb9a6b4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:26.027853 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-43963ecd-a767-477b-aeb7-725c9fb9a6b4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:26.042443 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-43963ecd-a767-477b-aeb7-725c9fb9a6b4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:26.043787 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-43963ecd-a767-477b-aeb7-725c9fb9a6b4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:26.044588 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-43963ecd-a767-477b-aeb7-725c9fb9a6b4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:26.047179 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-43963ecd-a767-477b-aeb7-725c9fb9a6b4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:26.048665 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-43963ecd-a767-477b-aeb7-725c9fb9a6b4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:26.049571 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-43963ecd-a767-477b-aeb7-725c9fb9a6b4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:26.365146 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-43963ecd-a767-477b-aeb7-725c9fb9a6b4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:26.375327 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-43963ecd-a767-477b-aeb7-725c9fb9a6b4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9" status: 200 len: 1493 microversion: 2.1 time: 0.351921 Sep 24 21:07:26.380235 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2280/4550] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:26 2022] GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 => generated 1493 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:26.771108 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c9045f21-d47c-4e41-a406-a5faa828ad73 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:26.771993 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c9045f21-d47c-4e41-a406-a5faa828ad73 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] [instance: 975ea9e6-e609-49c1-9492-87e8fb8d2109] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:26.780656 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c9045f21-d47c-4e41-a406-a5faa828ad73 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:26.781449 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c9045f21-d47c-4e41-a406-a5faa828ad73 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:26.783075 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c9045f21-d47c-4e41-a406-a5faa828ad73 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:26.783992 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c9045f21-d47c-4e41-a406-a5faa828ad73 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:26.784651 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c9045f21-d47c-4e41-a406-a5faa828ad73 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:26.785276 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c9045f21-d47c-4e41-a406-a5faa828ad73 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:26.890639 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c9045f21-d47c-4e41-a406-a5faa828ad73 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:26.906009 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c9045f21-d47c-4e41-a406-a5faa828ad73 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:26.907998 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c9045f21-d47c-4e41-a406-a5faa828ad73 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:26.911057 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c9045f21-d47c-4e41-a406-a5faa828ad73 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] 10.222.0.52 "GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109" status: 200 len: 1366 microversion: 2.57 time: 0.145111 Sep 24 21:07:26.911802 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2271/4551] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:26 2022] GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:27.406575 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7f946424-aab0-4ec6-8b20-0c08c0065ea3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:27.411479 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7f946424-aab0-4ec6-8b20-0c08c0065ea3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:27.425278 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f946424-aab0-4ec6-8b20-0c08c0065ea3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:27.426240 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f946424-aab0-4ec6-8b20-0c08c0065ea3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:27.427737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f946424-aab0-4ec6-8b20-0c08c0065ea3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:27.428851 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f946424-aab0-4ec6-8b20-0c08c0065ea3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:27.429904 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f946424-aab0-4ec6-8b20-0c08c0065ea3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:27.430780 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f946424-aab0-4ec6-8b20-0c08c0065ea3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:27.840118 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7f946424-aab0-4ec6-8b20-0c08c0065ea3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:27.860575 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7f946424-aab0-4ec6-8b20-0c08c0065ea3 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9" status: 200 len: 1514 microversion: 2.1 time: 0.458473 Sep 24 21:07:27.862162 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2281/4552] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:27 2022] GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 => generated 1514 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:27.938576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b2a47d2e-15e0-4423-8b63-7b6c336265f8 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:27.940038 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b2a47d2e-15e0-4423-8b63-7b6c336265f8 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] [instance: 975ea9e6-e609-49c1-9492-87e8fb8d2109] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:27.949125 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b2a47d2e-15e0-4423-8b63-7b6c336265f8 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:27.950050 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b2a47d2e-15e0-4423-8b63-7b6c336265f8 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:27.950666 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b2a47d2e-15e0-4423-8b63-7b6c336265f8 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:27.951563 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b2a47d2e-15e0-4423-8b63-7b6c336265f8 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:27.952159 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b2a47d2e-15e0-4423-8b63-7b6c336265f8 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:27.952890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b2a47d2e-15e0-4423-8b63-7b6c336265f8 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:28.048470 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b2a47d2e-15e0-4423-8b63-7b6c336265f8 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:28.062091 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b2a47d2e-15e0-4423-8b63-7b6c336265f8 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:28.065762 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b2a47d2e-15e0-4423-8b63-7b6c336265f8 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:28.067584 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b2a47d2e-15e0-4423-8b63-7b6c336265f8 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] 10.222.0.52 "GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109" status: 200 len: 1366 microversion: 2.57 time: 0.133232 Sep 24 21:07:28.068691 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2272/4553] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:27 2022] GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109 => generated 1366 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:28.887896 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-723113ec-8390-4a9d-9151-c5cdc569cf50 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:28.891054 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-723113ec-8390-4a9d-9151-c5cdc569cf50 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:28.903439 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-723113ec-8390-4a9d-9151-c5cdc569cf50 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:28.905919 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-723113ec-8390-4a9d-9151-c5cdc569cf50 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:28.908189 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-723113ec-8390-4a9d-9151-c5cdc569cf50 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:28.909276 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-723113ec-8390-4a9d-9151-c5cdc569cf50 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:28.910249 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-723113ec-8390-4a9d-9151-c5cdc569cf50 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:28.910971 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-723113ec-8390-4a9d-9151-c5cdc569cf50 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:29.009586 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-65d58311-3ebd-4267-9f55-f4ad1e69e950 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1909621407", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6640486c-9b61-4251-91b8-eded7b0b3bda"}], "security_groups": [{"name": "tempest-securitygroup--337105797"}], "key_name": "tempest-keypair-1049484806", "user_data": "}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:07:29.324491 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-65d58311-3ebd-4267-9f55-f4ad1e69e950 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] validate_networks() for [('6640486c-9b61-4251-91b8-eded7b0b3bda', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:07:29.333453 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-723113ec-8390-4a9d-9151-c5cdc569cf50 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:29.350327 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-723113ec-8390-4a9d-9151-c5cdc569cf50 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9" status: 200 len: 1509 microversion: 2.1 time: 0.468484 Sep 24 21:07:29.351176 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2282/4554] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:28 2022] GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 => generated 1509 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:29.370337 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6238057e-ad06-43d3-b618-a08da1a110e9 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:29.371024 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6238057e-ad06-43d3-b618-a08da1a110e9 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] [instance: 975ea9e6-e609-49c1-9492-87e8fb8d2109] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:29.379358 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6238057e-ad06-43d3-b618-a08da1a110e9 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:29.379864 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6238057e-ad06-43d3-b618-a08da1a110e9 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:29.380312 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6238057e-ad06-43d3-b618-a08da1a110e9 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:29.381033 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6238057e-ad06-43d3-b618-a08da1a110e9 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:29.381496 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6238057e-ad06-43d3-b618-a08da1a110e9 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:29.381937 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6238057e-ad06-43d3-b618-a08da1a110e9 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:29.561436 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6238057e-ad06-43d3-b618-a08da1a110e9 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:29.582302 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6238057e-ad06-43d3-b618-a08da1a110e9 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:29.583866 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6238057e-ad06-43d3-b618-a08da1a110e9 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:29.589626 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6238057e-ad06-43d3-b618-a08da1a110e9 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] 10.222.0.52 "GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109" status: 200 len: 1366 microversion: 2.57 time: 0.237273 Sep 24 21:07:29.595282 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2283/4555] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:29 2022] GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109 => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:30.055304 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-65d58311-3ebd-4267-9f55-f4ad1e69e950 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:07:30.056923 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-65d58311-3ebd-4267-9f55-f4ad1e69e950 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:07:30.057440 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-65d58311-3ebd-4267-9f55-f4ad1e69e950 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:07:30.057866 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-65d58311-3ebd-4267-9f55-f4ad1e69e950 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:07:30.059895 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-65d58311-3ebd-4267-9f55-f4ad1e69e950 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:07:30.076262 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65d58311-3ebd-4267-9f55-f4ad1e69e950 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:30.076777 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65d58311-3ebd-4267-9f55-f4ad1e69e950 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:30.077263 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65d58311-3ebd-4267-9f55-f4ad1e69e950 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:30.079159 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65d58311-3ebd-4267-9f55-f4ad1e69e950 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:30.081270 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65d58311-3ebd-4267-9f55-f4ad1e69e950 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:30.082058 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65d58311-3ebd-4267-9f55-f4ad1e69e950 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:30.117290 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-65d58311-3ebd-4267-9f55-f4ad1e69e950 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Getting quotas for project ede438e67af3496cae36fc89abc0aba3. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:07:30.123858 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-65d58311-3ebd-4267-9f55-f4ad1e69e950 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Getting quotas for user 370b057b12c148cdbb673ba6c06bd6b4 and project ede438e67af3496cae36fc89abc0aba3. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:07:30.144914 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-65d58311-3ebd-4267-9f55-f4ad1e69e950 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:07:30.147952 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-65d58311-3ebd-4267-9f55-f4ad1e69e950 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 2fc426bb-02cf-4911-9f74-93866eb1868a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:07:30.262869 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-65d58311-3ebd-4267-9f55-f4ad1e69e950 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.256079 Sep 24 21:07:30.274402 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2273/4556] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:07:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 1270 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:07:30.277718 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-270b91f4-8a7f-49ad-b3cb-828a1ef99037 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:30.279102 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-270b91f4-8a7f-49ad-b3cb-828a1ef99037 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 2fc426bb-02cf-4911-9f74-93866eb1868a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:30.376518 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7da6479c-451c-4ddf-b763-98de32ca8643 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:30.377504 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7da6479c-451c-4ddf-b763-98de32ca8643 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:30.385866 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7da6479c-451c-4ddf-b763-98de32ca8643 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:30.389908 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7da6479c-451c-4ddf-b763-98de32ca8643 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:30.390576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7da6479c-451c-4ddf-b763-98de32ca8643 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:30.394105 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7da6479c-451c-4ddf-b763-98de32ca8643 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:30.394944 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7da6479c-451c-4ddf-b763-98de32ca8643 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:30.402346 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7da6479c-451c-4ddf-b763-98de32ca8643 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:30.424333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-270b91f4-8a7f-49ad-b3cb-828a1ef99037 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:30.435289 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-270b91f4-8a7f-49ad-b3cb-828a1ef99037 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a" status: 200 len: 1242 microversion: 2.1 time: 0.158132 Sep 24 21:07:30.436006 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2284/4557] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:30 2022] GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a => generated 1242 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:30.624348 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7808947e-038b-44f4-88ff-0c2a58b29a59 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:30.625149 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7808947e-038b-44f4-88ff-0c2a58b29a59 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] [instance: 975ea9e6-e609-49c1-9492-87e8fb8d2109] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:30.654008 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7808947e-038b-44f4-88ff-0c2a58b29a59 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:30.659219 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7808947e-038b-44f4-88ff-0c2a58b29a59 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:30.663563 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7808947e-038b-44f4-88ff-0c2a58b29a59 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:30.665133 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7808947e-038b-44f4-88ff-0c2a58b29a59 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:30.665761 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7808947e-038b-44f4-88ff-0c2a58b29a59 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:30.666345 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7808947e-038b-44f4-88ff-0c2a58b29a59 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:30.971579 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7da6479c-451c-4ddf-b763-98de32ca8643 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:30.980426 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7808947e-038b-44f4-88ff-0c2a58b29a59 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:30.993502 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7808947e-038b-44f4-88ff-0c2a58b29a59 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:30.994971 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7da6479c-451c-4ddf-b763-98de32ca8643 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9" status: 200 len: 1509 microversion: 2.1 time: 0.622848 Sep 24 21:07:31.007381 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2274/4558] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:30 2022] GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 => generated 1509 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:07:31.008758 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7808947e-038b-44f4-88ff-0c2a58b29a59 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:31.010012 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7808947e-038b-44f4-88ff-0c2a58b29a59 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] 10.222.0.52 "GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109" status: 200 len: 1366 microversion: 2.57 time: 0.396100 Sep 24 21:07:31.031647 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2285/4559] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:30 2022] GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109 => generated 1366 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:31.420426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-81d32c20-1aef-4592-b740-1a746781b614 req-bfa7f87f-0e88-4c51-b55c-fd792b262ebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dda4c066-f7bb-45df-9e57-b0e2d23fd7b9", "name": "network-vif-plugged", "status": "completed", "tag": "760158dc-6fec-418e-aae5-f938ec813cb9"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:07:31.441874 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-81d32c20-1aef-4592-b740-1a746781b614 req-bfa7f87f-0e88-4c51-b55c-fd792b262ebd service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:31.442670 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-81d32c20-1aef-4592-b740-1a746781b614 req-bfa7f87f-0e88-4c51-b55c-fd792b262ebd service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:31.443257 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-81d32c20-1aef-4592-b740-1a746781b614 req-bfa7f87f-0e88-4c51-b55c-fd792b262ebd service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:31.467874 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-acef8771-5002-4534-b128-cc39ad0db4f2 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:31.470000 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-acef8771-5002-4534-b128-cc39ad0db4f2 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 2fc426bb-02cf-4911-9f74-93866eb1868a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:31.497018 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-81d32c20-1aef-4592-b740-1a746781b614 req-bfa7f87f-0e88-4c51-b55c-fd792b262ebd service nova] Creating event network-vif-plugged:760158dc-6fec-418e-aae5-f938ec813cb9 for instance dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 on nch2-master-1 Sep 24 21:07:31.499876 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-acef8771-5002-4534-b128-cc39ad0db4f2 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:31.500709 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-acef8771-5002-4534-b128-cc39ad0db4f2 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:31.501647 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-acef8771-5002-4534-b128-cc39ad0db4f2 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:31.503456 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-acef8771-5002-4534-b128-cc39ad0db4f2 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:31.504080 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-acef8771-5002-4534-b128-cc39ad0db4f2 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:31.505229 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-acef8771-5002-4534-b128-cc39ad0db4f2 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:31.517342 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-81d32c20-1aef-4592-b740-1a746781b614 req-bfa7f87f-0e88-4c51-b55c-fd792b262ebd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101413 Sep 24 21:07:31.517977 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2275/4560] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:07:31.864818 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-acef8771-5002-4534-b128-cc39ad0db4f2 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:31.884302 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-acef8771-5002-4534-b128-cc39ad0db4f2 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a" status: 200 len: 1238 microversion: 2.1 time: 0.421246 Sep 24 21:07:31.885364 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2286/4561] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:31 2022] GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a => generated 1238 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:32.025256 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a790c69f-da5c-47d0-9754-c1afbb69be38 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:32.026059 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a790c69f-da5c-47d0-9754-c1afbb69be38 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:32.038720 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a790c69f-da5c-47d0-9754-c1afbb69be38 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:32.039261 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a790c69f-da5c-47d0-9754-c1afbb69be38 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:32.039738 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a790c69f-da5c-47d0-9754-c1afbb69be38 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:32.046408 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a790c69f-da5c-47d0-9754-c1afbb69be38 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:32.046621 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ebec9c1b-a423-4f24-be3f-7a6ab6de38ce tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:32.047095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ebec9c1b-a423-4f24-be3f-7a6ab6de38ce tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] [instance: 975ea9e6-e609-49c1-9492-87e8fb8d2109] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:32.048320 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a790c69f-da5c-47d0-9754-c1afbb69be38 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:32.048936 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a790c69f-da5c-47d0-9754-c1afbb69be38 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:32.063659 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ebec9c1b-a423-4f24-be3f-7a6ab6de38ce tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:32.065929 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ebec9c1b-a423-4f24-be3f-7a6ab6de38ce tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:32.066594 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ebec9c1b-a423-4f24-be3f-7a6ab6de38ce tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:32.067902 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ebec9c1b-a423-4f24-be3f-7a6ab6de38ce tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:32.068525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ebec9c1b-a423-4f24-be3f-7a6ab6de38ce tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:32.069134 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ebec9c1b-a423-4f24-be3f-7a6ab6de38ce tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:32.761702 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ebec9c1b-a423-4f24-be3f-7a6ab6de38ce tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:32.770827 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ebec9c1b-a423-4f24-be3f-7a6ab6de38ce tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:32.772286 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ebec9c1b-a423-4f24-be3f-7a6ab6de38ce tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:32.783125 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ebec9c1b-a423-4f24-be3f-7a6ab6de38ce tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] 10.222.0.52 "GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109" status: 200 len: 1366 microversion: 2.57 time: 0.740961 Sep 24 21:07:32.783964 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2287/4562] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:32 2022] GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109 => generated 1366 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:32.905311 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a790c69f-da5c-47d0-9754-c1afbb69be38 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:32.915320 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a790c69f-da5c-47d0-9754-c1afbb69be38 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9" status: 200 len: 1509 microversion: 2.1 time: 0.894327 Sep 24 21:07:32.915903 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2276/4563] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:32 2022] GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 => generated 1509 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:32.916396 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-33f264ad-a34c-45e6-a111-02eba1a81e0d tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:32.917448 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-33f264ad-a34c-45e6-a111-02eba1a81e0d tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 2fc426bb-02cf-4911-9f74-93866eb1868a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:32.933087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33f264ad-a34c-45e6-a111-02eba1a81e0d tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:32.933986 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33f264ad-a34c-45e6-a111-02eba1a81e0d tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:32.935133 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33f264ad-a34c-45e6-a111-02eba1a81e0d tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:32.936935 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33f264ad-a34c-45e6-a111-02eba1a81e0d tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:32.939919 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33f264ad-a34c-45e6-a111-02eba1a81e0d tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:32.941516 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33f264ad-a34c-45e6-a111-02eba1a81e0d tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:33.138985 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-33f264ad-a34c-45e6-a111-02eba1a81e0d tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:33.153665 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-33f264ad-a34c-45e6-a111-02eba1a81e0d tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a" status: 200 len: 1300 microversion: 2.1 time: 0.242319 Sep 24 21:07:33.159856 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2288/4564] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:32 2022] GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a => generated 1300 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:07:33.812160 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a70b5f71-cfc0-40e7-9072-298aba3a6907 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:33.812786 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a70b5f71-cfc0-40e7-9072-298aba3a6907 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] [instance: 975ea9e6-e609-49c1-9492-87e8fb8d2109] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:33.828081 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a70b5f71-cfc0-40e7-9072-298aba3a6907 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:33.829207 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a70b5f71-cfc0-40e7-9072-298aba3a6907 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:33.830368 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a70b5f71-cfc0-40e7-9072-298aba3a6907 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:33.831157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a70b5f71-cfc0-40e7-9072-298aba3a6907 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:33.831623 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a70b5f71-cfc0-40e7-9072-298aba3a6907 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:33.832072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a70b5f71-cfc0-40e7-9072-298aba3a6907 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:33.949396 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3c6a0e2c-53f8-4252-af61-856f04d6ef91 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:33.950019 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3c6a0e2c-53f8-4252-af61-856f04d6ef91 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:33.960778 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c6a0e2c-53f8-4252-af61-856f04d6ef91 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:33.961278 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c6a0e2c-53f8-4252-af61-856f04d6ef91 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:33.961717 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c6a0e2c-53f8-4252-af61-856f04d6ef91 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:33.962437 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c6a0e2c-53f8-4252-af61-856f04d6ef91 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:33.962923 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c6a0e2c-53f8-4252-af61-856f04d6ef91 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:33.963350 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c6a0e2c-53f8-4252-af61-856f04d6ef91 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:34.001296 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a70b5f71-cfc0-40e7-9072-298aba3a6907 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:34.015021 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a70b5f71-cfc0-40e7-9072-298aba3a6907 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:34.016740 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a70b5f71-cfc0-40e7-9072-298aba3a6907 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:34.018218 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a70b5f71-cfc0-40e7-9072-298aba3a6907 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] 10.222.0.52 "GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109" status: 200 len: 1366 microversion: 2.57 time: 0.209989 Sep 24 21:07:34.029018 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2277/4565] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:33 2022] GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:34.184722 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-55704595-c28b-4d5a-b6f9-ad6179894491 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:34.185953 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-55704595-c28b-4d5a-b6f9-ad6179894491 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 2fc426bb-02cf-4911-9f74-93866eb1868a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:34.204575 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-55704595-c28b-4d5a-b6f9-ad6179894491 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:34.206761 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-55704595-c28b-4d5a-b6f9-ad6179894491 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:34.209571 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-55704595-c28b-4d5a-b6f9-ad6179894491 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:34.212082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-55704595-c28b-4d5a-b6f9-ad6179894491 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:34.212741 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-55704595-c28b-4d5a-b6f9-ad6179894491 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:34.215284 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-55704595-c28b-4d5a-b6f9-ad6179894491 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:34.328209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3c6a0e2c-53f8-4252-af61-856f04d6ef91 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:34.361912 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3c6a0e2c-53f8-4252-af61-856f04d6ef91 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9" status: 200 len: 1509 microversion: 2.1 time: 0.414406 Sep 24 21:07:34.362558 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2289/4566] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:33 2022] GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 => generated 1509 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:07:34.372404 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-55704595-c28b-4d5a-b6f9-ad6179894491 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:34.383210 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-55704595-c28b-4d5a-b6f9-ad6179894491 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a" status: 200 len: 1300 microversion: 2.1 time: 0.205734 Sep 24 21:07:34.391103 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2278/4567] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:34 2022] GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a => generated 1300 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:35.060259 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5a1a33ce-45c4-48bf-bc2d-81722eff80d7 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:35.060914 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5a1a33ce-45c4-48bf-bc2d-81722eff80d7 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] [instance: 975ea9e6-e609-49c1-9492-87e8fb8d2109] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:35.082271 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5a1a33ce-45c4-48bf-bc2d-81722eff80d7 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:35.082808 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5a1a33ce-45c4-48bf-bc2d-81722eff80d7 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:35.083255 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5a1a33ce-45c4-48bf-bc2d-81722eff80d7 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:35.083997 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5a1a33ce-45c4-48bf-bc2d-81722eff80d7 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:35.084459 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5a1a33ce-45c4-48bf-bc2d-81722eff80d7 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:35.084975 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5a1a33ce-45c4-48bf-bc2d-81722eff80d7 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:35.386468 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bb713608-707b-4571-ba13-a20404b7dd4f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:35.387182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-bb713608-707b-4571-ba13-a20404b7dd4f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:35.408509 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb713608-707b-4571-ba13-a20404b7dd4f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:35.409207 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb713608-707b-4571-ba13-a20404b7dd4f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:35.409746 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb713608-707b-4571-ba13-a20404b7dd4f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:35.417598 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb713608-707b-4571-ba13-a20404b7dd4f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:35.428160 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb713608-707b-4571-ba13-a20404b7dd4f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:35.428635 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb713608-707b-4571-ba13-a20404b7dd4f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:35.762582 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5a1a33ce-45c4-48bf-bc2d-81722eff80d7 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:35.777642 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5a1a33ce-45c4-48bf-bc2d-81722eff80d7 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:35.779526 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5a1a33ce-45c4-48bf-bc2d-81722eff80d7 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:35.785409 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5a1a33ce-45c4-48bf-bc2d-81722eff80d7 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] 10.222.0.52 "GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109" status: 200 len: 1366 microversion: 2.57 time: 0.727437 Sep 24 21:07:35.786304 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2290/4568] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:35 2022] GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109 => generated 1366 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:35.800781 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bf717274-b918-45ca-a199-4628f5be68c3 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:35.802089 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bf717274-b918-45ca-a199-4628f5be68c3 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 2fc426bb-02cf-4911-9f74-93866eb1868a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:35.816977 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf717274-b918-45ca-a199-4628f5be68c3 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:35.818302 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf717274-b918-45ca-a199-4628f5be68c3 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:35.819176 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf717274-b918-45ca-a199-4628f5be68c3 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:35.820134 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf717274-b918-45ca-a199-4628f5be68c3 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:35.820936 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf717274-b918-45ca-a199-4628f5be68c3 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:35.821588 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf717274-b918-45ca-a199-4628f5be68c3 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:36.347905 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-bb713608-707b-4571-ba13-a20404b7dd4f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:36.364622 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bb713608-707b-4571-ba13-a20404b7dd4f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9" status: 200 len: 1509 microversion: 2.1 time: 0.982020 Sep 24 21:07:36.372860 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2279/4569] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:35 2022] GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 => generated 1509 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:36.504252 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bf717274-b918-45ca-a199-4628f5be68c3 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:36.519807 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bf717274-b918-45ca-a199-4628f5be68c3 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a" status: 200 len: 1367 microversion: 2.1 time: 0.731073 Sep 24 21:07:36.556089 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2291/4570] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:35 2022] GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a => generated 1367 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:36.818514 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5e36a7fe-b70d-4c15-92c1-2e72ff95fdd4 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:36.819812 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5e36a7fe-b70d-4c15-92c1-2e72ff95fdd4 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] [instance: 975ea9e6-e609-49c1-9492-87e8fb8d2109] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:36.836379 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e36a7fe-b70d-4c15-92c1-2e72ff95fdd4 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:36.837058 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e36a7fe-b70d-4c15-92c1-2e72ff95fdd4 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:36.837729 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e36a7fe-b70d-4c15-92c1-2e72ff95fdd4 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:36.839507 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e36a7fe-b70d-4c15-92c1-2e72ff95fdd4 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:36.842811 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e36a7fe-b70d-4c15-92c1-2e72ff95fdd4 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:36.843474 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e36a7fe-b70d-4c15-92c1-2e72ff95fdd4 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:37.062199 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5e36a7fe-b70d-4c15-92c1-2e72ff95fdd4 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:37.069486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:07:37.077505 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5e36a7fe-b70d-4c15-92c1-2e72ff95fdd4 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:37.081501 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5e36a7fe-b70d-4c15-92c1-2e72ff95fdd4 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:37.084679 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5e36a7fe-b70d-4c15-92c1-2e72ff95fdd4 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] 10.222.0.52 "GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109" status: 200 len: 1366 microversion: 2.57 time: 0.270798 Sep 24 21:07:37.114176 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2280/4571] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:36 2022] GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109 => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:37.363364 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-392be674-ba97-495d-87b0-edd5d91fdb98 req-9676ec66-49aa-48d3-acd0-9efee079d497 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fc426bb-02cf-4911-9f74-93866eb1868a", "tag": "258619fb-3f57-4b71-bb4e-ac577a68a7fc"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:07:37.389912 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-392be674-ba97-495d-87b0-edd5d91fdb98 req-9676ec66-49aa-48d3-acd0-9efee079d497 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:37.390435 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-392be674-ba97-495d-87b0-edd5d91fdb98 req-9676ec66-49aa-48d3-acd0-9efee079d497 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:37.392979 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-392be674-ba97-495d-87b0-edd5d91fdb98 req-9676ec66-49aa-48d3-acd0-9efee079d497 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:37.405644 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ccb85aa1-dd8b-4e43-9674-e452da0d6df9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:37.406271 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ccb85aa1-dd8b-4e43-9674-e452da0d6df9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:37.425924 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-392be674-ba97-495d-87b0-edd5d91fdb98 req-9676ec66-49aa-48d3-acd0-9efee079d497 service nova] Creating event network-changed:258619fb-3f57-4b71-bb4e-ac577a68a7fc for instance 2fc426bb-02cf-4911-9f74-93866eb1868a on nch1-master-1 Sep 24 21:07:37.426176 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ccb85aa1-dd8b-4e43-9674-e452da0d6df9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:37.426675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ccb85aa1-dd8b-4e43-9674-e452da0d6df9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:37.427305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ccb85aa1-dd8b-4e43-9674-e452da0d6df9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:37.436403 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-392be674-ba97-495d-87b0-edd5d91fdb98 req-9676ec66-49aa-48d3-acd0-9efee079d497 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079775 Sep 24 21:07:37.441023 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2292/4572] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:07:37.444069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ccb85aa1-dd8b-4e43-9674-e452da0d6df9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:37.444580 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ccb85aa1-dd8b-4e43-9674-e452da0d6df9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:37.445043 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ccb85aa1-dd8b-4e43-9674-e452da0d6df9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:37.554244 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3e045289-b9d9-43e1-9ac2-1a29025cc951 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:37.558530 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3e045289-b9d9-43e1-9ac2-1a29025cc951 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 2fc426bb-02cf-4911-9f74-93866eb1868a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:37.569676 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e045289-b9d9-43e1-9ac2-1a29025cc951 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:37.572388 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e045289-b9d9-43e1-9ac2-1a29025cc951 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:37.573034 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e045289-b9d9-43e1-9ac2-1a29025cc951 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:37.574959 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e045289-b9d9-43e1-9ac2-1a29025cc951 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:37.579088 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e045289-b9d9-43e1-9ac2-1a29025cc951 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:37.579764 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e045289-b9d9-43e1-9ac2-1a29025cc951 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:38.701084 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ccb85aa1-dd8b-4e43-9674-e452da0d6df9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:38.713345 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ccb85aa1-dd8b-4e43-9674-e452da0d6df9 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9" status: 200 len: 1509 microversion: 2.1 time: 1.311929 Sep 24 21:07:38.748803 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2281/4573] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:37 2022] GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 => generated 1509 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:38.756151 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-00931d6d-6fe2-4955-8d42-22b90e7c87f6 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:38.757128 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-00931d6d-6fe2-4955-8d42-22b90e7c87f6 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] [instance: 975ea9e6-e609-49c1-9492-87e8fb8d2109] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:38.766923 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00931d6d-6fe2-4955-8d42-22b90e7c87f6 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:38.767791 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00931d6d-6fe2-4955-8d42-22b90e7c87f6 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:38.769061 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00931d6d-6fe2-4955-8d42-22b90e7c87f6 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:38.770021 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00931d6d-6fe2-4955-8d42-22b90e7c87f6 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:38.770791 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00931d6d-6fe2-4955-8d42-22b90e7c87f6 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:38.771439 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00931d6d-6fe2-4955-8d42-22b90e7c87f6 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:38.812691 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3e045289-b9d9-43e1-9ac2-1a29025cc951 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:38.832716 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3e045289-b9d9-43e1-9ac2-1a29025cc951 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a" status: 200 len: 1367 microversion: 2.1 time: 1.281857 Sep 24 21:07:38.837677 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2293/4574] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:37 2022] GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a => generated 1367 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:38.908993 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-00931d6d-6fe2-4955-8d42-22b90e7c87f6 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:38.925987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-00931d6d-6fe2-4955-8d42-22b90e7c87f6 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:38.928605 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-00931d6d-6fe2-4955-8d42-22b90e7c87f6 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:38.931445 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-00931d6d-6fe2-4955-8d42-22b90e7c87f6 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] 10.222.0.52 "GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109" status: 200 len: 1366 microversion: 2.57 time: 0.179992 Sep 24 21:07:38.958264 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2282/4575] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:38 2022] GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:39.153682 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2a36e898-57fd-45a3-aacc-292f896b75fe tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-583996110", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:07:39.284984 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-2a36e898-57fd-45a3-aacc-292f896b75fe tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] validate_networks() for [('67500988-9ebb-4c72-92f3-b6a92bf3ea65', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:07:39.741237 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-eda51477-7a25-4a91-9aa2-8dce5786a22f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:39.741846 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-eda51477-7a25-4a91-9aa2-8dce5786a22f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:39.752724 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eda51477-7a25-4a91-9aa2-8dce5786a22f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:39.753481 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eda51477-7a25-4a91-9aa2-8dce5786a22f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:39.754089 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eda51477-7a25-4a91-9aa2-8dce5786a22f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:39.763821 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eda51477-7a25-4a91-9aa2-8dce5786a22f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:39.767499 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eda51477-7a25-4a91-9aa2-8dce5786a22f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:39.768174 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eda51477-7a25-4a91-9aa2-8dce5786a22f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:40.099259 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:07:40.133778 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:07:40.192830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-eda51477-7a25-4a91-9aa2-8dce5786a22f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:40.206116 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-eda51477-7a25-4a91-9aa2-8dce5786a22f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9" status: 200 len: 1509 microversion: 2.1 time: 0.463470 Sep 24 21:07:40.207070 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2283/4576] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:39 2022] GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 => generated 1509 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:07:40.229243 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-186fe59e-fe44-4bd8-9c78-b53fb56f0fc8 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:40.230521 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-186fe59e-fe44-4bd8-9c78-b53fb56f0fc8 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 2fc426bb-02cf-4911-9f74-93866eb1868a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:40.244475 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:07:40.260087 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-186fe59e-fe44-4bd8-9c78-b53fb56f0fc8 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:40.269608 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-186fe59e-fe44-4bd8-9c78-b53fb56f0fc8 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:40.270237 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-186fe59e-fe44-4bd8-9c78-b53fb56f0fc8 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:40.272832 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-186fe59e-fe44-4bd8-9c78-b53fb56f0fc8 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:40.273569 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-186fe59e-fe44-4bd8-9c78-b53fb56f0fc8 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:40.274082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-186fe59e-fe44-4bd8-9c78-b53fb56f0fc8 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:40.429140 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=6 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:07:41.122455 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-2a36e898-57fd-45a3-aacc-292f896b75fe tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:07:41.125783 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-2a36e898-57fd-45a3-aacc-292f896b75fe tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:07:41.126825 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-2a36e898-57fd-45a3-aacc-292f896b75fe tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:07:41.127578 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-2a36e898-57fd-45a3-aacc-292f896b75fe tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:07:41.128296 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-2a36e898-57fd-45a3-aacc-292f896b75fe tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:07:41.153240 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a36e898-57fd-45a3-aacc-292f896b75fe tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:41.161720 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a36e898-57fd-45a3-aacc-292f896b75fe tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:41.164756 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a36e898-57fd-45a3-aacc-292f896b75fe tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:41.168202 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-186fe59e-fe44-4bd8-9c78-b53fb56f0fc8 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:41.172006 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a36e898-57fd-45a3-aacc-292f896b75fe tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:41.173298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a36e898-57fd-45a3-aacc-292f896b75fe tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:41.177575 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a36e898-57fd-45a3-aacc-292f896b75fe tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:41.184048 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-186fe59e-fe44-4bd8-9c78-b53fb56f0fc8 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a" status: 200 len: 1367 microversion: 2.1 time: 0.968349 Sep 24 21:07:41.187026 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2284/4577] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:40 2022] GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a => generated 1367 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:41.206419 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-209960ac-ba2a-4310-8bd2-73b3450748a5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:41.208607 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-209960ac-ba2a-4310-8bd2-73b3450748a5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] [instance: 975ea9e6-e609-49c1-9492-87e8fb8d2109] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:41.215973 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-209960ac-ba2a-4310-8bd2-73b3450748a5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:41.224071 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-209960ac-ba2a-4310-8bd2-73b3450748a5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:41.224292 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-209960ac-ba2a-4310-8bd2-73b3450748a5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:41.225038 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-209960ac-ba2a-4310-8bd2-73b3450748a5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:41.225503 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-209960ac-ba2a-4310-8bd2-73b3450748a5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:41.225937 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-209960ac-ba2a-4310-8bd2-73b3450748a5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:41.258884 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-2a36e898-57fd-45a3-aacc-292f896b75fe tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Getting quotas for project 8428ee98cbdc457192d9889bf10d1036. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:07:41.272433 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-2a36e898-57fd-45a3-aacc-292f896b75fe tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Getting quotas for user fdbd9a2294414c0e932ef46d11f8e4b6 and project 8428ee98cbdc457192d9889bf10d1036. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:07:41.311848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2a36e898-57fd-45a3-aacc-292f896b75fe tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:07:41.318073 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2a36e898-57fd-45a3-aacc-292f896b75fe tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 89fb92e7-ef4c-4796-9797-2ed6faf2048c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:07:41.416835 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2a36e898-57fd-45a3-aacc-292f896b75fe tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.510720 Sep 24 21:07:41.421683 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2294/4578] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:07:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 2516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 24 21:07:41.434316 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cabb3532-10a9-4309-a587-3366dba1046d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:41.442136 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cabb3532-10a9-4309-a587-3366dba1046d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:41.451313 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cabb3532-10a9-4309-a587-3366dba1046d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:41.452027 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cabb3532-10a9-4309-a587-3366dba1046d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:41.452637 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cabb3532-10a9-4309-a587-3366dba1046d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:41.455020 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cabb3532-10a9-4309-a587-3366dba1046d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:41.455678 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cabb3532-10a9-4309-a587-3366dba1046d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:41.456658 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cabb3532-10a9-4309-a587-3366dba1046d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:41.496292 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-209960ac-ba2a-4310-8bd2-73b3450748a5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:41.514959 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-209960ac-ba2a-4310-8bd2-73b3450748a5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:41.517233 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-209960ac-ba2a-4310-8bd2-73b3450748a5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:41.518683 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-209960ac-ba2a-4310-8bd2-73b3450748a5 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] 10.222.0.52 "GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109" status: 200 len: 1366 microversion: 2.57 time: 0.327169 Sep 24 21:07:41.523254 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2285/4579] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:41 2022] GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109 => generated 1366 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:41.528361 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-58e62218-094f-4c9d-bf54-5addb7708adb tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:41.528986 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-58e62218-094f-4c9d-bf54-5addb7708adb tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 89fb92e7-ef4c-4796-9797-2ed6faf2048c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:41.708302 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-58e62218-094f-4c9d-bf54-5addb7708adb tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:41.722315 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-58e62218-094f-4c9d-bf54-5addb7708adb tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c" status: 200 len: 1213 microversion: 2.1 time: 0.197022 Sep 24 21:07:41.722977 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2286/4580] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:41 2022] GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c => generated 1213 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:41.884709 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cabb3532-10a9-4309-a587-3366dba1046d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:41.897664 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cabb3532-10a9-4309-a587-3366dba1046d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9" status: 200 len: 1509 microversion: 2.1 time: 0.468053 Sep 24 21:07:41.903569 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2295/4581] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:41 2022] GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 => generated 1509 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:42.212237 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-34f6f7ec-7df1-4a6a-9f68-8024eeaf47f5 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:42.212961 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-34f6f7ec-7df1-4a6a-9f68-8024eeaf47f5 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 2fc426bb-02cf-4911-9f74-93866eb1868a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:42.232587 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34f6f7ec-7df1-4a6a-9f68-8024eeaf47f5 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:42.233097 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34f6f7ec-7df1-4a6a-9f68-8024eeaf47f5 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:42.233534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34f6f7ec-7df1-4a6a-9f68-8024eeaf47f5 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:42.234664 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34f6f7ec-7df1-4a6a-9f68-8024eeaf47f5 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:42.235478 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34f6f7ec-7df1-4a6a-9f68-8024eeaf47f5 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:42.236341 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34f6f7ec-7df1-4a6a-9f68-8024eeaf47f5 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:42.554349 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fd449dbb-eb17-46b4-bf51-cc7d0794dbbf tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:42.555829 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fd449dbb-eb17-46b4-bf51-cc7d0794dbbf tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] [instance: 975ea9e6-e609-49c1-9492-87e8fb8d2109] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:42.568481 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd449dbb-eb17-46b4-bf51-cc7d0794dbbf tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:42.570086 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd449dbb-eb17-46b4-bf51-cc7d0794dbbf tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:42.572998 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd449dbb-eb17-46b4-bf51-cc7d0794dbbf tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:42.573825 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd449dbb-eb17-46b4-bf51-cc7d0794dbbf tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:42.576146 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd449dbb-eb17-46b4-bf51-cc7d0794dbbf tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:42.576758 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd449dbb-eb17-46b4-bf51-cc7d0794dbbf tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:42.674645 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-34f6f7ec-7df1-4a6a-9f68-8024eeaf47f5 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:42.685221 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-34f6f7ec-7df1-4a6a-9f68-8024eeaf47f5 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a" status: 200 len: 1367 microversion: 2.1 time: 0.479177 Sep 24 21:07:42.688805 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2287/4582] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:42 2022] GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a => generated 1367 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:42.747213 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fd449dbb-eb17-46b4-bf51-cc7d0794dbbf tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:42.752810 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8d800b77-3a14-480d-a8cc-520d5cf21c5b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:42.753442 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8d800b77-3a14-480d-a8cc-520d5cf21c5b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 89fb92e7-ef4c-4796-9797-2ed6faf2048c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:42.771096 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d800b77-3a14-480d-a8cc-520d5cf21c5b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:42.771608 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d800b77-3a14-480d-a8cc-520d5cf21c5b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:42.772120 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d800b77-3a14-480d-a8cc-520d5cf21c5b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:42.773012 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d800b77-3a14-480d-a8cc-520d5cf21c5b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:42.773287 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fd449dbb-eb17-46b4-bf51-cc7d0794dbbf tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:42.775622 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d800b77-3a14-480d-a8cc-520d5cf21c5b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:42.776285 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d800b77-3a14-480d-a8cc-520d5cf21c5b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:42.780024 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fd449dbb-eb17-46b4-bf51-cc7d0794dbbf tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:42.784329 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fd449dbb-eb17-46b4-bf51-cc7d0794dbbf tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] 10.222.0.52 "GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109" status: 200 len: 1366 microversion: 2.57 time: 0.235950 Sep 24 21:07:42.811193 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2296/4583] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:42 2022] GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109 => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:07:42.922924 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f90195e1-291b-4516-8594-1ec19f7d92f8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:42.923964 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f90195e1-291b-4516-8594-1ec19f7d92f8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:42.943093 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f90195e1-291b-4516-8594-1ec19f7d92f8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:42.944314 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f90195e1-291b-4516-8594-1ec19f7d92f8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:42.948981 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f90195e1-291b-4516-8594-1ec19f7d92f8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:42.949945 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f90195e1-291b-4516-8594-1ec19f7d92f8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:42.953933 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f90195e1-291b-4516-8594-1ec19f7d92f8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:42.956604 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f90195e1-291b-4516-8594-1ec19f7d92f8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:42.969965 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8d800b77-3a14-480d-a8cc-520d5cf21c5b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:42.972933 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:07:42.978740 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8d800b77-3a14-480d-a8cc-520d5cf21c5b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c" status: 200 len: 1209 microversion: 2.1 time: 0.231036 Sep 24 21:07:43.002477 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2288/4584] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:42 2022] GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c => generated 1209 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:43.700512 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f90195e1-291b-4516-8594-1ec19f7d92f8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:43.713696 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f90195e1-291b-4516-8594-1ec19f7d92f8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9" status: 200 len: 1509 microversion: 2.1 time: 0.795445 Sep 24 21:07:43.730525 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d0377601-4aa1-453a-b91a-28fd5a95b052 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:43.730525 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d0377601-4aa1-453a-b91a-28fd5a95b052 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 2fc426bb-02cf-4911-9f74-93866eb1868a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:43.731405 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2297/4585] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:42 2022] GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 => generated 1509 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:07:43.751134 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0377601-4aa1-453a-b91a-28fd5a95b052 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:43.751781 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0377601-4aa1-453a-b91a-28fd5a95b052 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:43.752289 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0377601-4aa1-453a-b91a-28fd5a95b052 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:43.753013 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0377601-4aa1-453a-b91a-28fd5a95b052 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:43.753479 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0377601-4aa1-453a-b91a-28fd5a95b052 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:43.778209 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0377601-4aa1-453a-b91a-28fd5a95b052 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:43.818705 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-279064e0-26e9-428d-8ba6-41af2f28e199 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:43.820458 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-279064e0-26e9-428d-8ba6-41af2f28e199 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] [instance: 975ea9e6-e609-49c1-9492-87e8fb8d2109] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:43.847538 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-279064e0-26e9-428d-8ba6-41af2f28e199 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:43.848074 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-279064e0-26e9-428d-8ba6-41af2f28e199 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:43.848526 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-279064e0-26e9-428d-8ba6-41af2f28e199 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:43.851935 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-279064e0-26e9-428d-8ba6-41af2f28e199 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:43.854890 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-279064e0-26e9-428d-8ba6-41af2f28e199 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:43.857002 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-279064e0-26e9-428d-8ba6-41af2f28e199 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:44.531854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-279064e0-26e9-428d-8ba6-41af2f28e199 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:44.553094 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-279064e0-26e9-428d-8ba6-41af2f28e199 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:44.554951 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-279064e0-26e9-428d-8ba6-41af2f28e199 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:44.556368 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-279064e0-26e9-428d-8ba6-41af2f28e199 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] 10.222.0.52 "GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109" status: 200 len: 1366 microversion: 2.57 time: 0.741664 Sep 24 21:07:44.557447 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2298/4586] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:43 2022] GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109 => generated 1366 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:44.564224 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e245e5f6-ce31-45ca-ad7a-978197510231 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:44.570911 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e245e5f6-ce31-45ca-ad7a-978197510231 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 89fb92e7-ef4c-4796-9797-2ed6faf2048c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:44.589639 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e245e5f6-ce31-45ca-ad7a-978197510231 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:44.590402 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e245e5f6-ce31-45ca-ad7a-978197510231 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:44.591053 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e245e5f6-ce31-45ca-ad7a-978197510231 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:44.591944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e245e5f6-ce31-45ca-ad7a-978197510231 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:44.598689 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e245e5f6-ce31-45ca-ad7a-978197510231 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:44.599419 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e245e5f6-ce31-45ca-ad7a-978197510231 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:44.728698 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d0377601-4aa1-453a-b91a-28fd5a95b052 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:44.745365 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d0377601-4aa1-453a-b91a-28fd5a95b052 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a" status: 200 len: 1367 microversion: 2.1 time: 1.034135 Sep 24 21:07:44.746068 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2289/4587] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:43 2022] GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a => generated 1367 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:07:44.781060 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2c3e26d1-7a24-4876-81ff-0db2d12ec192 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:44.784205 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2c3e26d1-7a24-4876-81ff-0db2d12ec192 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:44.820291 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c3e26d1-7a24-4876-81ff-0db2d12ec192 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:44.824080 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c3e26d1-7a24-4876-81ff-0db2d12ec192 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:44.826263 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c3e26d1-7a24-4876-81ff-0db2d12ec192 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:44.831799 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c3e26d1-7a24-4876-81ff-0db2d12ec192 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:44.834147 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c3e26d1-7a24-4876-81ff-0db2d12ec192 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:44.837782 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c3e26d1-7a24-4876-81ff-0db2d12ec192 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:44.904003 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e245e5f6-ce31-45ca-ad7a-978197510231 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:44.922696 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e245e5f6-ce31-45ca-ad7a-978197510231 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c" status: 200 len: 1271 microversion: 2.1 time: 0.362098 Sep 24 21:07:44.925101 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2299/4588] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:44 2022] GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c => generated 1271 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:45.378899 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2c3e26d1-7a24-4876-81ff-0db2d12ec192 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:45.408072 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2c3e26d1-7a24-4876-81ff-0db2d12ec192 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9" status: 200 len: 1509 microversion: 2.1 time: 0.651672 Sep 24 21:07:45.412288 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2290/4589] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:44 2022] GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 => generated 1509 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:45.593196 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-13f614d2-7f83-4d4f-ae30-78cbac492eed tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:45.594337 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-13f614d2-7f83-4d4f-ae30-78cbac492eed tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] [instance: 975ea9e6-e609-49c1-9492-87e8fb8d2109] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:45.606197 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-13f614d2-7f83-4d4f-ae30-78cbac492eed tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:45.607024 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-13f614d2-7f83-4d4f-ae30-78cbac492eed tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:45.608276 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-13f614d2-7f83-4d4f-ae30-78cbac492eed tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:45.609303 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-13f614d2-7f83-4d4f-ae30-78cbac492eed tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:45.610217 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-13f614d2-7f83-4d4f-ae30-78cbac492eed tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:45.610945 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-13f614d2-7f83-4d4f-ae30-78cbac492eed tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:45.716730 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-13f614d2-7f83-4d4f-ae30-78cbac492eed tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:45.744558 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-13f614d2-7f83-4d4f-ae30-78cbac492eed tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:45.746275 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-13f614d2-7f83-4d4f-ae30-78cbac492eed tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:45.747985 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-13f614d2-7f83-4d4f-ae30-78cbac492eed tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] 10.222.0.52 "GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109" status: 200 len: 1366 microversion: 2.57 time: 0.160583 Sep 24 21:07:45.759211 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2300/4590] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:45 2022] GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:45.779119 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4af7f11a-2d6a-4a5c-b750-7ae0f314d015 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:45.779764 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4af7f11a-2d6a-4a5c-b750-7ae0f314d015 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 2fc426bb-02cf-4911-9f74-93866eb1868a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:45.789814 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4af7f11a-2d6a-4a5c-b750-7ae0f314d015 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:45.790310 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4af7f11a-2d6a-4a5c-b750-7ae0f314d015 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:45.790847 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4af7f11a-2d6a-4a5c-b750-7ae0f314d015 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:45.797051 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4af7f11a-2d6a-4a5c-b750-7ae0f314d015 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:45.797663 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4af7f11a-2d6a-4a5c-b750-7ae0f314d015 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:45.798103 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4af7f11a-2d6a-4a5c-b750-7ae0f314d015 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:45.956063 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-122c771f-d075-40f2-82f4-2e50fb07e20f tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:45.958379 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-122c771f-d075-40f2-82f4-2e50fb07e20f tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 89fb92e7-ef4c-4796-9797-2ed6faf2048c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:45.974225 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-122c771f-d075-40f2-82f4-2e50fb07e20f tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:45.979024 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-122c771f-d075-40f2-82f4-2e50fb07e20f tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:45.979665 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-122c771f-d075-40f2-82f4-2e50fb07e20f tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:45.980623 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-122c771f-d075-40f2-82f4-2e50fb07e20f tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:45.981481 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-122c771f-d075-40f2-82f4-2e50fb07e20f tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:45.984136 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-122c771f-d075-40f2-82f4-2e50fb07e20f tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:46.105448 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4af7f11a-2d6a-4a5c-b750-7ae0f314d015 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:46.119685 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4af7f11a-2d6a-4a5c-b750-7ae0f314d015 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a" status: 200 len: 1367 microversion: 2.1 time: 0.343761 Sep 24 21:07:46.122127 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2291/4591] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:45 2022] GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a => generated 1367 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:46.187664 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-122c771f-d075-40f2-82f4-2e50fb07e20f tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:46.198125 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-122c771f-d075-40f2-82f4-2e50fb07e20f tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c" status: 200 len: 1271 microversion: 2.1 time: 0.247322 Sep 24 21:07:46.198734 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2301/4592] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:45 2022] GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c => generated 1271 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:07:46.435619 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ebab9f02-ed3e-4630-9619-26b5e2cf723e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:46.436540 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ebab9f02-ed3e-4630-9619-26b5e2cf723e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:46.453062 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ebab9f02-ed3e-4630-9619-26b5e2cf723e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:46.455375 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ebab9f02-ed3e-4630-9619-26b5e2cf723e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:46.456052 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ebab9f02-ed3e-4630-9619-26b5e2cf723e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:46.457772 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ebab9f02-ed3e-4630-9619-26b5e2cf723e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:46.458250 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ebab9f02-ed3e-4630-9619-26b5e2cf723e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:46.458731 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ebab9f02-ed3e-4630-9619-26b5e2cf723e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:46.748043 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ebab9f02-ed3e-4630-9619-26b5e2cf723e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:46.757852 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ebab9f02-ed3e-4630-9619-26b5e2cf723e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9" status: 200 len: 1509 microversion: 2.1 time: 0.326297 Sep 24 21:07:46.761584 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2292/4593] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:46 2022] GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 => generated 1509 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:46.785337 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8c1c5aab-33b5-4516-ac0b-bc44697fa542 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:46.786357 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8c1c5aab-33b5-4516-ac0b-bc44697fa542 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] [instance: 975ea9e6-e609-49c1-9492-87e8fb8d2109] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:46.799409 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8c1c5aab-33b5-4516-ac0b-bc44697fa542 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:46.801161 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8c1c5aab-33b5-4516-ac0b-bc44697fa542 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:46.804305 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8c1c5aab-33b5-4516-ac0b-bc44697fa542 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:46.805280 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8c1c5aab-33b5-4516-ac0b-bc44697fa542 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:46.806114 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8c1c5aab-33b5-4516-ac0b-bc44697fa542 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:46.808032 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8c1c5aab-33b5-4516-ac0b-bc44697fa542 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:46.914895 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8c1c5aab-33b5-4516-ac0b-bc44697fa542 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:46.924508 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8c1c5aab-33b5-4516-ac0b-bc44697fa542 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:46.929255 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8c1c5aab-33b5-4516-ac0b-bc44697fa542 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:46.938796 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8c1c5aab-33b5-4516-ac0b-bc44697fa542 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] 10.222.0.52 "GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109" status: 200 len: 1366 microversion: 2.57 time: 0.160974 Sep 24 21:07:46.940105 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2302/4594] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:46 2022] GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:47.147390 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5ef18d3d-3b95-43db-b424-210086dd368a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:47.148973 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5ef18d3d-3b95-43db-b424-210086dd368a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 2fc426bb-02cf-4911-9f74-93866eb1868a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:47.171462 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ef18d3d-3b95-43db-b424-210086dd368a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:47.175236 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ef18d3d-3b95-43db-b424-210086dd368a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:47.175901 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ef18d3d-3b95-43db-b424-210086dd368a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:47.176808 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ef18d3d-3b95-43db-b424-210086dd368a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:47.179396 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ef18d3d-3b95-43db-b424-210086dd368a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:47.187721 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ef18d3d-3b95-43db-b424-210086dd368a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:47.227777 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5d357aef-756d-42c5-a14e-6ed3315a7181 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:47.228404 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5d357aef-756d-42c5-a14e-6ed3315a7181 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 89fb92e7-ef4c-4796-9797-2ed6faf2048c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:47.236814 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d357aef-756d-42c5-a14e-6ed3315a7181 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:47.246609 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d357aef-756d-42c5-a14e-6ed3315a7181 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:47.247481 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d357aef-756d-42c5-a14e-6ed3315a7181 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:47.251287 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d357aef-756d-42c5-a14e-6ed3315a7181 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:47.251981 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d357aef-756d-42c5-a14e-6ed3315a7181 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:47.252582 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d357aef-756d-42c5-a14e-6ed3315a7181 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:48.146388 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5ef18d3d-3b95-43db-b424-210086dd368a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:48.156839 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5ef18d3d-3b95-43db-b424-210086dd368a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a" status: 200 len: 1367 microversion: 2.1 time: 1.012713 Sep 24 21:07:48.169287 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2293/4595] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:47 2022] GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a => generated 1367 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:48.177927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-76196b81-fc87-4326-806f-f6a61687aec6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:48.178894 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-76196b81-fc87-4326-806f-f6a61687aec6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:48.185160 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5d357aef-756d-42c5-a14e-6ed3315a7181 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:48.205371 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5d357aef-756d-42c5-a14e-6ed3315a7181 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c" status: 200 len: 1313 microversion: 2.1 time: 0.973965 Sep 24 21:07:48.206036 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2303/4596] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:47 2022] GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c => generated 1313 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:07:48.217375 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c5ceff9f-3b6d-42b7-91c0-5005ad9a3b96 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:48.221170 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76196b81-fc87-4326-806f-f6a61687aec6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:48.221969 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76196b81-fc87-4326-806f-f6a61687aec6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:48.225432 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76196b81-fc87-4326-806f-f6a61687aec6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:48.226408 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76196b81-fc87-4326-806f-f6a61687aec6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:48.227055 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76196b81-fc87-4326-806f-f6a61687aec6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:48.228129 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c5ceff9f-3b6d-42b7-91c0-5005ad9a3b96 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] [instance: 975ea9e6-e609-49c1-9492-87e8fb8d2109] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:48.229209 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76196b81-fc87-4326-806f-f6a61687aec6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:48.252045 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c5ceff9f-3b6d-42b7-91c0-5005ad9a3b96 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:48.259436 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c5ceff9f-3b6d-42b7-91c0-5005ad9a3b96 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:48.266972 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c5ceff9f-3b6d-42b7-91c0-5005ad9a3b96 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:48.268026 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c5ceff9f-3b6d-42b7-91c0-5005ad9a3b96 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:48.268771 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c5ceff9f-3b6d-42b7-91c0-5005ad9a3b96 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:48.269476 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c5ceff9f-3b6d-42b7-91c0-5005ad9a3b96 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:48.475203 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c5ceff9f-3b6d-42b7-91c0-5005ad9a3b96 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:48.488726 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c5ceff9f-3b6d-42b7-91c0-5005ad9a3b96 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:48.490217 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c5ceff9f-3b6d-42b7-91c0-5005ad9a3b96 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:48.502861 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c5ceff9f-3b6d-42b7-91c0-5005ad9a3b96 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] 10.222.0.52 "GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109" status: 200 len: 1366 microversion: 2.57 time: 0.294633 Sep 24 21:07:48.503731 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2304/4597] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:48 2022] GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109 => generated 1366 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:48.628316 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-76196b81-fc87-4326-806f-f6a61687aec6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:48.640944 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-76196b81-fc87-4326-806f-f6a61687aec6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9" status: 200 len: 1509 microversion: 2.1 time: 0.467963 Sep 24 21:07:48.642074 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2294/4598] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:48 2022] GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 => generated 1509 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:48.749485 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-1e1d5cbb-1362-44aa-bbe0-65daad9d2e6f req-dd0eb015-c58c-40a7-b2e7-61b2f70710e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fc426bb-02cf-4911-9f74-93866eb1868a", "name": "network-vif-plugged", "status": "completed", "tag": "258619fb-3f57-4b71-bb4e-ac577a68a7fc"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:07:48.769231 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-1e1d5cbb-1362-44aa-bbe0-65daad9d2e6f req-dd0eb015-c58c-40a7-b2e7-61b2f70710e2 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:48.775974 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-1e1d5cbb-1362-44aa-bbe0-65daad9d2e6f req-dd0eb015-c58c-40a7-b2e7-61b2f70710e2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:48.779284 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-1e1d5cbb-1362-44aa-bbe0-65daad9d2e6f req-dd0eb015-c58c-40a7-b2e7-61b2f70710e2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:48.829848 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-1e1d5cbb-1362-44aa-bbe0-65daad9d2e6f req-dd0eb015-c58c-40a7-b2e7-61b2f70710e2 service nova] Creating event network-vif-plugged:258619fb-3f57-4b71-bb4e-ac577a68a7fc for instance 2fc426bb-02cf-4911-9f74-93866eb1868a on nch1-master-1 Sep 24 21:07:48.838448 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-1e1d5cbb-1362-44aa-bbe0-65daad9d2e6f req-dd0eb015-c58c-40a7-b2e7-61b2f70710e2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092404 Sep 24 21:07:48.839810 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2305/4599] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:07:49.184563 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6f5ca806-08df-42ae-b487-0cfe95dd4430 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:49.185351 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6f5ca806-08df-42ae-b487-0cfe95dd4430 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 2fc426bb-02cf-4911-9f74-93866eb1868a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:49.201193 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f5ca806-08df-42ae-b487-0cfe95dd4430 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:49.206284 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f5ca806-08df-42ae-b487-0cfe95dd4430 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:49.207297 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f5ca806-08df-42ae-b487-0cfe95dd4430 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:49.208772 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f5ca806-08df-42ae-b487-0cfe95dd4430 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:49.209469 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f5ca806-08df-42ae-b487-0cfe95dd4430 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:49.210157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f5ca806-08df-42ae-b487-0cfe95dd4430 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:49.239802 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6ec240ff-a875-4c5a-87db-70f6985b443d tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:49.242073 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6ec240ff-a875-4c5a-87db-70f6985b443d tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 89fb92e7-ef4c-4796-9797-2ed6faf2048c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:49.254746 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ec240ff-a875-4c5a-87db-70f6985b443d tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:49.255535 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ec240ff-a875-4c5a-87db-70f6985b443d tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:49.256405 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ec240ff-a875-4c5a-87db-70f6985b443d tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:49.258745 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ec240ff-a875-4c5a-87db-70f6985b443d tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:49.259428 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ec240ff-a875-4c5a-87db-70f6985b443d tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:49.260064 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ec240ff-a875-4c5a-87db-70f6985b443d tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:49.995986 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6f5ca806-08df-42ae-b487-0cfe95dd4430 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:50.014698 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6f5ca806-08df-42ae-b487-0cfe95dd4430 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a" status: 200 len: 1367 microversion: 2.1 time: 0.833909 Sep 24 21:07:50.017345 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2295/4600] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:49 2022] GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a => generated 1367 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:50.024170 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-463e06bb-0823-4217-a126-39c62a47977b tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:50.025901 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-463e06bb-0823-4217-a126-39c62a47977b tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] [instance: 975ea9e6-e609-49c1-9492-87e8fb8d2109] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:50.036818 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-463e06bb-0823-4217-a126-39c62a47977b tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:50.037799 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-463e06bb-0823-4217-a126-39c62a47977b tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:50.038487 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-463e06bb-0823-4217-a126-39c62a47977b tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:50.039400 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-463e06bb-0823-4217-a126-39c62a47977b tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:50.040060 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-463e06bb-0823-4217-a126-39c62a47977b tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:50.047132 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-463e06bb-0823-4217-a126-39c62a47977b tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:50.088688 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6ec240ff-a875-4c5a-87db-70f6985b443d tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:50.101071 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6ec240ff-a875-4c5a-87db-70f6985b443d tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c" status: 200 len: 1313 microversion: 2.1 time: 0.868884 Sep 24 21:07:50.102778 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2306/4601] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:49 2022] GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c => generated 1313 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:07:50.115928 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e82092ac-2853-4490-b680-d5e49b476f1c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:50.116928 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e82092ac-2853-4490-b680-d5e49b476f1c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:50.131815 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e82092ac-2853-4490-b680-d5e49b476f1c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:50.133434 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e82092ac-2853-4490-b680-d5e49b476f1c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:50.134125 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e82092ac-2853-4490-b680-d5e49b476f1c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:50.135383 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e82092ac-2853-4490-b680-d5e49b476f1c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:50.136104 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e82092ac-2853-4490-b680-d5e49b476f1c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:50.136890 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e82092ac-2853-4490-b680-d5e49b476f1c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:50.276322 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-463e06bb-0823-4217-a126-39c62a47977b tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:50.292156 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-463e06bb-0823-4217-a126-39c62a47977b tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:50.303319 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-463e06bb-0823-4217-a126-39c62a47977b tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:50.304592 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-463e06bb-0823-4217-a126-39c62a47977b tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] 10.222.0.52 "GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109" status: 200 len: 1372 microversion: 2.57 time: 0.285931 Sep 24 21:07:50.329726 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2296/4602] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:50 2022] GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109 => generated 1372 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:50.455273 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-7085e1a8-fd09-4399-b2c8-c3dca40e8ded req-47cb42ed-8e33-43d7-a56c-3d3e3529d461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89fb92e7-ef4c-4796-9797-2ed6faf2048c", "tag": "35d21c9b-f44f-4fcc-8461-4452c23d1fc9"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:07:50.491042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-7085e1a8-fd09-4399-b2c8-c3dca40e8ded req-47cb42ed-8e33-43d7-a56c-3d3e3529d461 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:50.491042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-7085e1a8-fd09-4399-b2c8-c3dca40e8ded req-47cb42ed-8e33-43d7-a56c-3d3e3529d461 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:50.491042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-7085e1a8-fd09-4399-b2c8-c3dca40e8ded req-47cb42ed-8e33-43d7-a56c-3d3e3529d461 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:50.516862 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-7085e1a8-fd09-4399-b2c8-c3dca40e8ded req-47cb42ed-8e33-43d7-a56c-3d3e3529d461 service nova] Creating event network-changed:35d21c9b-f44f-4fcc-8461-4452c23d1fc9 for instance 89fb92e7-ef4c-4796-9797-2ed6faf2048c on nch2-master-1 Sep 24 21:07:50.528275 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-7085e1a8-fd09-4399-b2c8-c3dca40e8ded req-47cb42ed-8e33-43d7-a56c-3d3e3529d461 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082919 Sep 24 21:07:50.539196 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2297/4603] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:07:50.617618 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e82092ac-2853-4490-b680-d5e49b476f1c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:50.628103 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e82092ac-2853-4490-b680-d5e49b476f1c tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9" status: 200 len: 1509 microversion: 2.1 time: 0.522654 Sep 24 21:07:50.634970 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2307/4604] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:50 2022] GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 => generated 1509 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:51.046598 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c68bf0e6-9583-42a9-820b-d82aee7b773d tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:51.048166 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c68bf0e6-9583-42a9-820b-d82aee7b773d tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 2fc426bb-02cf-4911-9f74-93866eb1868a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:51.060491 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c68bf0e6-9583-42a9-820b-d82aee7b773d tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:51.061491 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c68bf0e6-9583-42a9-820b-d82aee7b773d tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:51.063215 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c68bf0e6-9583-42a9-820b-d82aee7b773d tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:51.064917 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c68bf0e6-9583-42a9-820b-d82aee7b773d tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:51.065698 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c68bf0e6-9583-42a9-820b-d82aee7b773d tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:51.066328 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c68bf0e6-9583-42a9-820b-d82aee7b773d tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:51.125860 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bde2ccea-83fe-4b12-82db-26f34164a6c7 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:51.126792 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bde2ccea-83fe-4b12-82db-26f34164a6c7 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 89fb92e7-ef4c-4796-9797-2ed6faf2048c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:51.147441 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bde2ccea-83fe-4b12-82db-26f34164a6c7 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:51.148321 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bde2ccea-83fe-4b12-82db-26f34164a6c7 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:51.150058 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bde2ccea-83fe-4b12-82db-26f34164a6c7 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:51.152267 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bde2ccea-83fe-4b12-82db-26f34164a6c7 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:51.153819 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bde2ccea-83fe-4b12-82db-26f34164a6c7 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:51.158286 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bde2ccea-83fe-4b12-82db-26f34164a6c7 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:51.240210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:07:51.295398 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=6 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:07:51.448168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c68bf0e6-9583-42a9-820b-d82aee7b773d tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:51.461555 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c68bf0e6-9583-42a9-820b-d82aee7b773d tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a" status: 200 len: 1367 microversion: 2.1 time: 0.421976 Sep 24 21:07:51.468348 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bde2ccea-83fe-4b12-82db-26f34164a6c7 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:51.471622 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2298/4605] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:51 2022] GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a => generated 1367 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:51.476933 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bb5a90a9-9b61-4ac2-920b-5b350cdd97e3 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:51.477472 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-bb5a90a9-9b61-4ac2-920b-5b350cdd97e3 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] [instance: 975ea9e6-e609-49c1-9492-87e8fb8d2109] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:51.478081 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bde2ccea-83fe-4b12-82db-26f34164a6c7 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c" status: 200 len: 1313 microversion: 2.1 time: 0.356300 Sep 24 21:07:51.487148 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb5a90a9-9b61-4ac2-920b-5b350cdd97e3 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:51.488816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb5a90a9-9b61-4ac2-920b-5b350cdd97e3 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:51.489606 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb5a90a9-9b61-4ac2-920b-5b350cdd97e3 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:51.490753 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb5a90a9-9b61-4ac2-920b-5b350cdd97e3 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:51.491532 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb5a90a9-9b61-4ac2-920b-5b350cdd97e3 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:51.492124 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb5a90a9-9b61-4ac2-920b-5b350cdd97e3 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:51.500665 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2308/4606] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:51 2022] GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c => generated 1313 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:51.504412 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:07:51.637973 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-bb5a90a9-9b61-4ac2-920b-5b350cdd97e3 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:51.653151 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-bb5a90a9-9b61-4ac2-920b-5b350cdd97e3 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:51.657703 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-bb5a90a9-9b61-4ac2-920b-5b350cdd97e3 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:51.660024 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bb5a90a9-9b61-4ac2-920b-5b350cdd97e3 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] 10.222.0.52 "GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109" status: 200 len: 1372 microversion: 2.57 time: 0.187321 Sep 24 21:07:51.661228 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cbf392eb-2231-46e8-9c52-eb6137e47847 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:51.662845 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2299/4607] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:51 2022] GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109 => generated 1372 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:51.663094 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cbf392eb-2231-46e8-9c52-eb6137e47847 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:51.690616 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cbf392eb-2231-46e8-9c52-eb6137e47847 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:51.693583 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cbf392eb-2231-46e8-9c52-eb6137e47847 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:51.694069 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cbf392eb-2231-46e8-9c52-eb6137e47847 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:51.706725 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cbf392eb-2231-46e8-9c52-eb6137e47847 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:51.707749 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cbf392eb-2231-46e8-9c52-eb6137e47847 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:51.708364 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cbf392eb-2231-46e8-9c52-eb6137e47847 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:51.914464 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cbf392eb-2231-46e8-9c52-eb6137e47847 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:51.925768 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cbf392eb-2231-46e8-9c52-eb6137e47847 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9" status: 200 len: 1509 microversion: 2.1 time: 0.270523 Sep 24 21:07:51.928377 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2309/4608] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:51 2022] GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 => generated 1509 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:52.493818 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b1ff711f-71a2-4110-b41b-7fa281a272e6 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:52.494419 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b1ff711f-71a2-4110-b41b-7fa281a272e6 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 2fc426bb-02cf-4911-9f74-93866eb1868a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:52.496363 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:07:52.507854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f075d705-3025-44b2-8435-4b7e1cec212c tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:52.508682 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f075d705-3025-44b2-8435-4b7e1cec212c tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 89fb92e7-ef4c-4796-9797-2ed6faf2048c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:52.509867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1ff711f-71a2-4110-b41b-7fa281a272e6 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:52.512440 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1ff711f-71a2-4110-b41b-7fa281a272e6 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:52.512989 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1ff711f-71a2-4110-b41b-7fa281a272e6 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:52.513817 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1ff711f-71a2-4110-b41b-7fa281a272e6 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:52.514643 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1ff711f-71a2-4110-b41b-7fa281a272e6 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:52.515497 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1ff711f-71a2-4110-b41b-7fa281a272e6 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:52.517675 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f075d705-3025-44b2-8435-4b7e1cec212c tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:52.518445 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f075d705-3025-44b2-8435-4b7e1cec212c tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:52.519217 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f075d705-3025-44b2-8435-4b7e1cec212c tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:52.520380 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f075d705-3025-44b2-8435-4b7e1cec212c tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:52.521055 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f075d705-3025-44b2-8435-4b7e1cec212c tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:52.521728 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f075d705-3025-44b2-8435-4b7e1cec212c tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:52.762942 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b1ff711f-71a2-4110-b41b-7fa281a272e6 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:52.780133 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f075d705-3025-44b2-8435-4b7e1cec212c tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:52.791976 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b1ff711f-71a2-4110-b41b-7fa281a272e6 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a" status: 200 len: 1558 microversion: 2.1 time: 0.301945 Sep 24 21:07:52.798989 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2300/4609] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:52 2022] GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a => generated 1558 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:52.810644 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3ddf20d9-ed5c-48b0-b26a-eaf97d6f5214 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:52.810935 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f075d705-3025-44b2-8435-4b7e1cec212c tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c" status: 200 len: 1313 microversion: 2.1 time: 0.305914 Sep 24 21:07:52.813150 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2310/4610] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:52 2022] GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c => generated 1313 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:07:52.813278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3ddf20d9-ed5c-48b0-b26a-eaf97d6f5214 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] [instance: 975ea9e6-e609-49c1-9492-87e8fb8d2109] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:52.831864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3ddf20d9-ed5c-48b0-b26a-eaf97d6f5214 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:52.832313 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3724fb63-d502-4803-97a9-f4db7848b62a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:52.832436 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3ddf20d9-ed5c-48b0-b26a-eaf97d6f5214 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:52.832818 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3ddf20d9-ed5c-48b0-b26a-eaf97d6f5214 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:52.833278 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3724fb63-d502-4803-97a9-f4db7848b62a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 2fc426bb-02cf-4911-9f74-93866eb1868a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:52.833547 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3ddf20d9-ed5c-48b0-b26a-eaf97d6f5214 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:52.834012 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3ddf20d9-ed5c-48b0-b26a-eaf97d6f5214 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:52.834446 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3ddf20d9-ed5c-48b0-b26a-eaf97d6f5214 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:52.842179 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3724fb63-d502-4803-97a9-f4db7848b62a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:52.842845 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3724fb63-d502-4803-97a9-f4db7848b62a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:52.844129 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3724fb63-d502-4803-97a9-f4db7848b62a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:52.845549 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3724fb63-d502-4803-97a9-f4db7848b62a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:52.846149 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3724fb63-d502-4803-97a9-f4db7848b62a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:52.847136 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3724fb63-d502-4803-97a9-f4db7848b62a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:52.990127 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3ddf20d9-ed5c-48b0-b26a-eaf97d6f5214 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:52.998699 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3ddf20d9-ed5c-48b0-b26a-eaf97d6f5214 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:53.001151 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3ddf20d9-ed5c-48b0-b26a-eaf97d6f5214 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:53.002476 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3ddf20d9-ed5c-48b0-b26a-eaf97d6f5214 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] 10.222.0.52 "GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109" status: 200 len: 1372 microversion: 2.57 time: 0.200963 Sep 24 21:07:53.003284 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2301/4611] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:52 2022] GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109 => generated 1372 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:53.007837 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d9326910-2992-45ac-b8e0-7355fbe3c400 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:53.008710 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d9326910-2992-45ac-b8e0-7355fbe3c400 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:53.015865 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d9326910-2992-45ac-b8e0-7355fbe3c400 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:53.016708 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d9326910-2992-45ac-b8e0-7355fbe3c400 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:53.017220 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d9326910-2992-45ac-b8e0-7355fbe3c400 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:53.017939 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d9326910-2992-45ac-b8e0-7355fbe3c400 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:53.018880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d9326910-2992-45ac-b8e0-7355fbe3c400 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:53.019028 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d9326910-2992-45ac-b8e0-7355fbe3c400 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:53.049360 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3724fb63-d502-4803-97a9-f4db7848b62a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.227367 Sep 24 21:07:53.052536 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2311/4612] 10.222.0.52 () {58 vars in 1275 bytes} [Sat Sep 24 21:07:52 2022] GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a/os-interface => generated 285 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:07:53.195891 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-85e34725-f6ff-4e92-bd21-ca74a113f810 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:53.196658 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-85e34725-f6ff-4e92-bd21-ca74a113f810 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 0896ae3f-f6f6-49dd-87df-c73f911c78be] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:53.198748 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:07:53.206082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85e34725-f6ff-4e92-bd21-ca74a113f810 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:53.206610 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85e34725-f6ff-4e92-bd21-ca74a113f810 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:53.207050 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85e34725-f6ff-4e92-bd21-ca74a113f810 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:53.207758 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85e34725-f6ff-4e92-bd21-ca74a113f810 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:53.208210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85e34725-f6ff-4e92-bd21-ca74a113f810 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:53.208825 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85e34725-f6ff-4e92-bd21-ca74a113f810 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:53.251198 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d9326910-2992-45ac-b8e0-7355fbe3c400 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:53.255637 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-85e34725-f6ff-4e92-bd21-ca74a113f810 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be/ips" status: 200 len: 151 microversion: 2.20 time: 0.064588 Sep 24 21:07:53.268432 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2312/4613] 10.222.0.52 () {60 vars in 1289 bytes} [Sat Sep 24 21:07:53 2022] GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be/ips => generated 151 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 21:07:53.270746 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d9326910-2992-45ac-b8e0-7355fbe3c400 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9" status: 200 len: 1509 microversion: 2.1 time: 0.266272 Sep 24 21:07:53.271371 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2302/4614] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:53 2022] GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 => generated 1509 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:53.853513 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cca504ad-4571-4423-b41d-2b2c7035b5eb tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:53.854766 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cca504ad-4571-4423-b41d-2b2c7035b5eb tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 89fb92e7-ef4c-4796-9797-2ed6faf2048c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:53.869534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cca504ad-4571-4423-b41d-2b2c7035b5eb tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:53.872857 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cca504ad-4571-4423-b41d-2b2c7035b5eb tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:53.873512 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cca504ad-4571-4423-b41d-2b2c7035b5eb tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:53.874405 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cca504ad-4571-4423-b41d-2b2c7035b5eb tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:53.876502 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cca504ad-4571-4423-b41d-2b2c7035b5eb tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:53.877107 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cca504ad-4571-4423-b41d-2b2c7035b5eb tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:54.029924 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-42d0b053-bb74-4cef-836b-c35c325e4807 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:54.031883 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-42d0b053-bb74-4cef-836b-c35c325e4807 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] [instance: 975ea9e6-e609-49c1-9492-87e8fb8d2109] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:54.043426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-42d0b053-bb74-4cef-836b-c35c325e4807 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:54.044146 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-42d0b053-bb74-4cef-836b-c35c325e4807 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:54.044979 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-42d0b053-bb74-4cef-836b-c35c325e4807 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:54.045930 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-42d0b053-bb74-4cef-836b-c35c325e4807 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:54.047611 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-42d0b053-bb74-4cef-836b-c35c325e4807 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:54.048501 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-42d0b053-bb74-4cef-836b-c35c325e4807 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:54.205839 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-42d0b053-bb74-4cef-836b-c35c325e4807 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:54.228125 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-42d0b053-bb74-4cef-836b-c35c325e4807 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:54.235272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-42d0b053-bb74-4cef-836b-c35c325e4807 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:54.236583 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-42d0b053-bb74-4cef-836b-c35c325e4807 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] 10.222.0.52 "GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109" status: 200 len: 1357 microversion: 2.57 time: 0.211226 Sep 24 21:07:54.251914 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2303/4615] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:54 2022] GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109 => generated 1357 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:54.274101 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-76607fe6-95a7-4eb6-b589-52f062ae9738 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:54.274735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-76607fe6-95a7-4eb6-b589-52f062ae9738 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] [instance: 975ea9e6-e609-49c1-9492-87e8fb8d2109] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:54.281771 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76607fe6-95a7-4eb6-b589-52f062ae9738 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:54.282681 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76607fe6-95a7-4eb6-b589-52f062ae9738 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:54.283193 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76607fe6-95a7-4eb6-b589-52f062ae9738 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:54.284004 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76607fe6-95a7-4eb6-b589-52f062ae9738 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:54.284536 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76607fe6-95a7-4eb6-b589-52f062ae9738 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:54.284996 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76607fe6-95a7-4eb6-b589-52f062ae9738 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:54.318759 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-76607fe6-95a7-4eb6-b589-52f062ae9738 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] [instance: 975ea9e6-e609-49c1-9492-87e8fb8d2109] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:07:54.362097 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cca504ad-4571-4423-b41d-2b2c7035b5eb tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:54.377611 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cca504ad-4571-4423-b41d-2b2c7035b5eb tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c" status: 200 len: 1313 microversion: 2.1 time: 0.528874 Sep 24 21:07:54.382238 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2313/4616] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:53 2022] GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c => generated 1313 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:54.388197 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-012950a3-23dd-406e-bb24-ddfcb32019e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:54.389404 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-012950a3-23dd-406e-bb24-ddfcb32019e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:54.399254 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-012950a3-23dd-406e-bb24-ddfcb32019e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:54.400140 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-012950a3-23dd-406e-bb24-ddfcb32019e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:54.400818 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-012950a3-23dd-406e-bb24-ddfcb32019e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:54.401903 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-012950a3-23dd-406e-bb24-ddfcb32019e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:54.402611 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-012950a3-23dd-406e-bb24-ddfcb32019e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:54.403250 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-012950a3-23dd-406e-bb24-ddfcb32019e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:54.442610 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-76607fe6-95a7-4eb6-b589-52f062ae9738 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] 10.222.0.52 "DELETE /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109" status: 204 len: 0 microversion: 2.57 time: 0.172086 Sep 24 21:07:54.443527 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2304/4617] 10.222.0.52 () {60 vars in 1280 bytes} [Sat Sep 24 21:07:54 2022] DELETE /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 24 21:07:54.461230 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ed805e1c-25ba-4ad1-982f-c189c77815aa tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:54.462328 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ed805e1c-25ba-4ad1-982f-c189c77815aa tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] [instance: 975ea9e6-e609-49c1-9492-87e8fb8d2109] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:54.470906 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed805e1c-25ba-4ad1-982f-c189c77815aa tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:54.471757 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed805e1c-25ba-4ad1-982f-c189c77815aa tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:54.472414 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed805e1c-25ba-4ad1-982f-c189c77815aa tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:54.473202 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed805e1c-25ba-4ad1-982f-c189c77815aa tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:54.473736 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed805e1c-25ba-4ad1-982f-c189c77815aa tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:54.474236 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed805e1c-25ba-4ad1-982f-c189c77815aa tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:54.618344 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ed805e1c-25ba-4ad1-982f-c189c77815aa tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:54.631206 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ed805e1c-25ba-4ad1-982f-c189c77815aa tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:54.633552 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ed805e1c-25ba-4ad1-982f-c189c77815aa tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:54.635253 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ed805e1c-25ba-4ad1-982f-c189c77815aa tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] 10.222.0.52 "GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109" status: 200 len: 1363 microversion: 2.57 time: 0.187051 Sep 24 21:07:54.635961 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2305/4618] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:54 2022] GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:54.879757 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-42e6cd37-1d06-4a07-b5ba-60664efda124 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:54.880882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-42e6cd37-1d06-4a07-b5ba-60664efda124 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 0896ae3f-f6f6-49dd-87df-c73f911c78be] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:54.888513 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-42e6cd37-1d06-4a07-b5ba-60664efda124 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:54.889213 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-42e6cd37-1d06-4a07-b5ba-60664efda124 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:54.889802 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-42e6cd37-1d06-4a07-b5ba-60664efda124 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:54.891511 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-42e6cd37-1d06-4a07-b5ba-60664efda124 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:54.892802 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-42e6cd37-1d06-4a07-b5ba-60664efda124 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:54.893387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-42e6cd37-1d06-4a07-b5ba-60664efda124 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:54.902213 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-012950a3-23dd-406e-bb24-ddfcb32019e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:54.919763 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-012950a3-23dd-406e-bb24-ddfcb32019e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9" status: 200 len: 1506 microversion: 2.1 time: 0.535499 Sep 24 21:07:54.922687 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2314/4619] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:54 2022] GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 => generated 1506 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:54.941396 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-42e6cd37-1d06-4a07-b5ba-60664efda124 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 0896ae3f-f6f6-49dd-87df-c73f911c78be] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:07:55.087799 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-42e6cd37-1d06-4a07-b5ba-60664efda124 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be" status: 204 len: 0 microversion: 2.20 time: 0.211702 Sep 24 21:07:55.089028 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2306/4620] 10.222.0.52 () {60 vars in 1280 bytes} [Sat Sep 24 21:07:54 2022] DELETE /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 24 21:07:55.098405 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4c9c93ec-a766-411e-ae67-65e7c12d3b69 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:55.099185 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4c9c93ec-a766-411e-ae67-65e7c12d3b69 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 0896ae3f-f6f6-49dd-87df-c73f911c78be] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:55.108411 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4c9c93ec-a766-411e-ae67-65e7c12d3b69 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:55.109731 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4c9c93ec-a766-411e-ae67-65e7c12d3b69 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:55.110588 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4c9c93ec-a766-411e-ae67-65e7c12d3b69 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:55.114845 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4c9c93ec-a766-411e-ae67-65e7c12d3b69 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:55.117870 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4c9c93ec-a766-411e-ae67-65e7c12d3b69 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:55.118860 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4c9c93ec-a766-411e-ae67-65e7c12d3b69 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:55.128516 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:07:55.414254 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d74bc2d5-c720-40bb-815e-259ac496d2c9 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:55.415796 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d74bc2d5-c720-40bb-815e-259ac496d2c9 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 89fb92e7-ef4c-4796-9797-2ed6faf2048c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:55.424238 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d74bc2d5-c720-40bb-815e-259ac496d2c9 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:55.424974 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d74bc2d5-c720-40bb-815e-259ac496d2c9 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:55.425661 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d74bc2d5-c720-40bb-815e-259ac496d2c9 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:55.426731 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d74bc2d5-c720-40bb-815e-259ac496d2c9 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:55.427401 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d74bc2d5-c720-40bb-815e-259ac496d2c9 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:55.428032 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d74bc2d5-c720-40bb-815e-259ac496d2c9 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:55.465914 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4c9c93ec-a766-411e-ae67-65e7c12d3b69 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:55.479275 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4c9c93ec-a766-411e-ae67-65e7c12d3b69 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:55.480821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4c9c93ec-a766-411e-ae67-65e7c12d3b69 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:55.486095 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4c9c93ec-a766-411e-ae67-65e7c12d3b69 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be" status: 200 len: 1723 microversion: 2.20 time: 0.392453 Sep 24 21:07:55.499154 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2315/4621] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:55 2022] GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be => generated 1723 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:55.663355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-34d68310-9f8f-4be8-aac6-db5afde0eaee tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:55.664566 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-34d68310-9f8f-4be8-aac6-db5afde0eaee tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] [instance: 975ea9e6-e609-49c1-9492-87e8fb8d2109] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:55.678284 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-34d68310-9f8f-4be8-aac6-db5afde0eaee tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:55.681291 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-34d68310-9f8f-4be8-aac6-db5afde0eaee tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:55.682658 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-34d68310-9f8f-4be8-aac6-db5afde0eaee tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:55.683627 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-34d68310-9f8f-4be8-aac6-db5afde0eaee tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:55.683833 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d74bc2d5-c720-40bb-815e-259ac496d2c9 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:55.684860 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-34d68310-9f8f-4be8-aac6-db5afde0eaee tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:55.685511 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-34d68310-9f8f-4be8-aac6-db5afde0eaee tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:55.704482 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d74bc2d5-c720-40bb-815e-259ac496d2c9 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c" status: 200 len: 1313 microversion: 2.1 time: 0.295570 Sep 24 21:07:55.706291 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2307/4622] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:55 2022] GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c => generated 1313 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:55.776665 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-34d68310-9f8f-4be8-aac6-db5afde0eaee tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:55.790700 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-34d68310-9f8f-4be8-aac6-db5afde0eaee tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:55.792712 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-34d68310-9f8f-4be8-aac6-db5afde0eaee tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:55.794761 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-34d68310-9f8f-4be8-aac6-db5afde0eaee tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] 10.222.0.52 "GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109" status: 200 len: 1363 microversion: 2.57 time: 0.135640 Sep 24 21:07:55.795994 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2316/4623] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:55 2022] GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109 => generated 1363 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:07:55.948583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bdaf186b-c87f-4459-8bca-696adfcb2573 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:55.948794 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-bdaf186b-c87f-4459-8bca-696adfcb2573 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:55.955298 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bdaf186b-c87f-4459-8bca-696adfcb2573 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:55.955818 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bdaf186b-c87f-4459-8bca-696adfcb2573 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:55.956254 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bdaf186b-c87f-4459-8bca-696adfcb2573 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:55.957028 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bdaf186b-c87f-4459-8bca-696adfcb2573 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:55.957446 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bdaf186b-c87f-4459-8bca-696adfcb2573 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:55.957886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bdaf186b-c87f-4459-8bca-696adfcb2573 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:56.514306 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-bdaf186b-c87f-4459-8bca-696adfcb2573 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:56.515630 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ad66c660-188d-4c19-a28e-a3a28a90f402 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:56.516257 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ad66c660-188d-4c19-a28e-a3a28a90f402 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 0896ae3f-f6f6-49dd-87df-c73f911c78be] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:56.530190 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bdaf186b-c87f-4459-8bca-696adfcb2573 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9" status: 200 len: 1506 microversion: 2.1 time: 0.585899 Sep 24 21:07:56.532543 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ad66c660-188d-4c19-a28e-a3a28a90f402 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:56.533041 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ad66c660-188d-4c19-a28e-a3a28a90f402 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:56.533234 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2308/4624] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:55 2022] GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 => generated 1506 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:56.535033 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ad66c660-188d-4c19-a28e-a3a28a90f402 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:56.535764 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ad66c660-188d-4c19-a28e-a3a28a90f402 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:56.536234 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ad66c660-188d-4c19-a28e-a3a28a90f402 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:56.536757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ad66c660-188d-4c19-a28e-a3a28a90f402 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:56.733275 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6df3f87d-07fa-42c9-95c7-0f9715814ae9 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:56.739933 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6df3f87d-07fa-42c9-95c7-0f9715814ae9 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 89fb92e7-ef4c-4796-9797-2ed6faf2048c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:56.761148 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6df3f87d-07fa-42c9-95c7-0f9715814ae9 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:56.761779 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6df3f87d-07fa-42c9-95c7-0f9715814ae9 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:56.763083 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6df3f87d-07fa-42c9-95c7-0f9715814ae9 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:56.764039 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6df3f87d-07fa-42c9-95c7-0f9715814ae9 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:56.764822 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6df3f87d-07fa-42c9-95c7-0f9715814ae9 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:56.771043 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6df3f87d-07fa-42c9-95c7-0f9715814ae9 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:56.855577 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ad66c660-188d-4c19-a28e-a3a28a90f402 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:56.870956 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ad66c660-188d-4c19-a28e-a3a28a90f402 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:56.872694 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ad66c660-188d-4c19-a28e-a3a28a90f402 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:56.877026 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ad66c660-188d-4c19-a28e-a3a28a90f402 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be" status: 200 len: 1723 microversion: 2.20 time: 0.365987 Sep 24 21:07:56.883468 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2317/4625] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:56 2022] GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be => generated 1723 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:07:56.895516 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4794d0bb-0d32-4f58-ab32-c848e5834641 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:56.899648 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4794d0bb-0d32-4f58-ab32-c848e5834641 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] [instance: 975ea9e6-e609-49c1-9492-87e8fb8d2109] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:56.915773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4794d0bb-0d32-4f58-ab32-c848e5834641 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:56.916247 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4794d0bb-0d32-4f58-ab32-c848e5834641 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:56.927017 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4794d0bb-0d32-4f58-ab32-c848e5834641 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:56.927885 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4794d0bb-0d32-4f58-ab32-c848e5834641 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:56.928380 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4794d0bb-0d32-4f58-ab32-c848e5834641 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:56.928820 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4794d0bb-0d32-4f58-ab32-c848e5834641 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:56.990530 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4794d0bb-0d32-4f58-ab32-c848e5834641 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:56.991275 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4794d0bb-0d32-4f58-ab32-c848e5834641 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:56.991989 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4794d0bb-0d32-4f58-ab32-c848e5834641 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:56.993002 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-4794d0bb-0d32-4f58-ab32-c848e5834641 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lazy-loading 'fault' on Instance uuid 975ea9e6-e609-49c1-9492-87e8fb8d2109 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:07:57.185568 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4794d0bb-0d32-4f58-ab32-c848e5834641 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:57.202002 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4794d0bb-0d32-4f58-ab32-c848e5834641 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:57.204279 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4794d0bb-0d32-4f58-ab32-c848e5834641 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f718a9c5980641d3b67ce061de573c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e486847ec742fbbd1ed13b404eb519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:57.213274 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4794d0bb-0d32-4f58-ab32-c848e5834641 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] 10.222.0.52 "GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109" status: 200 len: 1368 microversion: 2.57 time: 0.326066 Sep 24 21:07:57.213649 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2318/4626] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:56 2022] GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109 => generated 1368 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:57.250328 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-b8b3f29a-8f9b-4d5d-bc7f-cb32d5c8f356 req-39219411-9cf0-478f-8141-2800bbffb896 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fc426bb-02cf-4911-9f74-93866eb1868a", "tag": "258619fb-3f57-4b71-bb4e-ac577a68a7fc"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:07:57.262642 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6df3f87d-07fa-42c9-95c7-0f9715814ae9 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:57.277023 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6df3f87d-07fa-42c9-95c7-0f9715814ae9 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c" status: 200 len: 1313 microversion: 2.1 time: 0.548619 Sep 24 21:07:57.298882 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2309/4627] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:56 2022] GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c => generated 1313 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:07:57.301240 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-b8b3f29a-8f9b-4d5d-bc7f-cb32d5c8f356 req-39219411-9cf0-478f-8141-2800bbffb896 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:57.301741 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-b8b3f29a-8f9b-4d5d-bc7f-cb32d5c8f356 req-39219411-9cf0-478f-8141-2800bbffb896 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:57.302272 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-b8b3f29a-8f9b-4d5d-bc7f-cb32d5c8f356 req-39219411-9cf0-478f-8141-2800bbffb896 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:57.316853 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-b8b3f29a-8f9b-4d5d-bc7f-cb32d5c8f356 req-39219411-9cf0-478f-8141-2800bbffb896 service nova] Creating event network-changed:258619fb-3f57-4b71-bb4e-ac577a68a7fc for instance 2fc426bb-02cf-4911-9f74-93866eb1868a on nch1-master-1 Sep 24 21:07:57.326419 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-b8b3f29a-8f9b-4d5d-bc7f-cb32d5c8f356 req-39219411-9cf0-478f-8141-2800bbffb896 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097935 Sep 24 21:07:57.327851 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2319/4628] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:07:57.559232 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f4ed7355-5890-45d0-b13d-5c2dfd4d2e87 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:57.560559 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f4ed7355-5890-45d0-b13d-5c2dfd4d2e87 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:57.567454 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4ed7355-5890-45d0-b13d-5c2dfd4d2e87 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:57.568309 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4ed7355-5890-45d0-b13d-5c2dfd4d2e87 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:57.568964 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4ed7355-5890-45d0-b13d-5c2dfd4d2e87 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:57.570635 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4ed7355-5890-45d0-b13d-5c2dfd4d2e87 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:57.573823 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4ed7355-5890-45d0-b13d-5c2dfd4d2e87 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:57.575331 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4ed7355-5890-45d0-b13d-5c2dfd4d2e87 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:57.729025 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-dcad740e-b264-471a-a65c-9afb4550ec7b req-ca963de8-2f79-4506-abd6-b977612acafe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89fb92e7-ef4c-4796-9797-2ed6faf2048c", "name": "network-vif-plugged", "status": "completed", "tag": "35d21c9b-f44f-4fcc-8461-4452c23d1fc9"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:07:57.740581 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-dcad740e-b264-471a-a65c-9afb4550ec7b req-ca963de8-2f79-4506-abd6-b977612acafe service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:57.741067 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-dcad740e-b264-471a-a65c-9afb4550ec7b req-ca963de8-2f79-4506-abd6-b977612acafe service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:57.741682 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-dcad740e-b264-471a-a65c-9afb4550ec7b req-ca963de8-2f79-4506-abd6-b977612acafe service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:57.753661 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-dcad740e-b264-471a-a65c-9afb4550ec7b req-ca963de8-2f79-4506-abd6-b977612acafe service nova] Creating event network-vif-plugged:35d21c9b-f44f-4fcc-8461-4452c23d1fc9 for instance 89fb92e7-ef4c-4796-9797-2ed6faf2048c on nch2-master-1 Sep 24 21:07:57.759056 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-dcad740e-b264-471a-a65c-9afb4550ec7b req-ca963de8-2f79-4506-abd6-b977612acafe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034155 Sep 24 21:07:57.760178 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2320/4629] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:07:57.914022 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e80384da-38ec-4702-afb3-70a87783bdbc tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:57.914929 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e80384da-38ec-4702-afb3-70a87783bdbc tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 0896ae3f-f6f6-49dd-87df-c73f911c78be] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:57.927864 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e80384da-38ec-4702-afb3-70a87783bdbc tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:57.928435 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e80384da-38ec-4702-afb3-70a87783bdbc tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:57.928887 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e80384da-38ec-4702-afb3-70a87783bdbc tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:57.932050 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e80384da-38ec-4702-afb3-70a87783bdbc tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:57.932740 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e80384da-38ec-4702-afb3-70a87783bdbc tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:57.935899 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e80384da-38ec-4702-afb3-70a87783bdbc tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:58.109477 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f4ed7355-5890-45d0-b13d-5c2dfd4d2e87 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:58.118238 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f4ed7355-5890-45d0-b13d-5c2dfd4d2e87 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9" status: 200 len: 1506 microversion: 2.1 time: 0.565208 Sep 24 21:07:58.139559 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2310/4630] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:57 2022] GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 => generated 1506 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:58.248994 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3ccefe5a-7349-4e86-a715-6005599e3326 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:58.250194 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3ccefe5a-7349-4e86-a715-6005599e3326 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] [instance: 975ea9e6-e609-49c1-9492-87e8fb8d2109] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:58.262012 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3ccefe5a-7349-4e86-a715-6005599e3326 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:58.262792 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3ccefe5a-7349-4e86-a715-6005599e3326 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:58.268164 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3ccefe5a-7349-4e86-a715-6005599e3326 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:58.269152 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3ccefe5a-7349-4e86-a715-6005599e3326 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:58.270089 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3ccefe5a-7349-4e86-a715-6005599e3326 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:58.270756 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3ccefe5a-7349-4e86-a715-6005599e3326 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:58.320066 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-3ccefe5a-7349-4e86-a715-6005599e3326 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] HTTP exception thrown: Instance 975ea9e6-e609-49c1-9492-87e8fb8d2109 could not be found. Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3ccefe5a-7349-4e86-a715-6005599e3326 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Request method failure captured: Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109 HTTP/1.1 Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3GAXEkfUqDGj-yIF-C9AiQ28PHjw1-34Kf0JbN8YzZyUH7naRe7xrAWWznYXMYUr5YS21494hhEjp5Df5Kh2Ri7Z4jKGTMwq3_PvapfzwrUBBW0-YEjrzruJPvv3hWcLvvZOtMWffMIaylaOYc4mnUUSeLNs4Gpmbec_5jrk8LrYPs Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: X-Openstack-Nova-Api-Version: 2.57 Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 28e486847ec742fbbd1ed13b404eb519 Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServerShowV257Test-1212096795 Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/28e486847ec742fbbd1ed13b404eb519"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_28e486847ec742fbbd1ed13b404eb519"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/28e486847ec742fbbd1ed13b404eb519"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/28e486847ec742fbbd1ed13b404eb519"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServerShowV257Test-1212096795 Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 28e486847ec742fbbd1ed13b404eb519 Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServerShowV257Test-1212096795 Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServerShowV257Test-1212096795-project Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: f718a9c5980641d3b67ce061de573c71 Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServerShowV257Test-1212096795-project Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 975ea9e6-e609-49c1-9492-87e8fb8d2109 could not be found. Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '975ea9e6-e609-49c1-9492-87e8fb8d2109'} Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 975ea9e6-e609-49c1-9492-87e8fb8d2109 could not be found. Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 975ea9e6-e609-49c1-9492-87e8fb8d2109 could not be found. Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:07:58.321838 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:07:58.326213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:07:58.326213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:07:58.326213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:07:58.326213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:07:58.326213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:07:58.326213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 975ea9e6-e609-49c1-9492-87e8fb8d2109 could not be found. Sep 24 21:07:58.326213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:07:58.326213 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3ccefe5a-7349-4e86-a715-6005599e3326 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] Returning 404 to user: Instance 975ea9e6-e609-49c1-9492-87e8fb8d2109 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:07:58.326213 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3ccefe5a-7349-4e86-a715-6005599e3326 tempest-ServerShowV257Test-1212096795 tempest-ServerShowV257Test-1212096795-project] 10.222.0.52 "GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109" status: 404 len: 111 microversion: 2.57 time: 0.079785 Sep 24 21:07:58.327773 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2311/4631] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:58 2022] GET /compute/v2.1/servers/975ea9e6-e609-49c1-9492-87e8fb8d2109 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:07:58.332566 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4b6d573e-e219-46cb-83fa-cb02b3d27565 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:58.333192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4b6d573e-e219-46cb-83fa-cb02b3d27565 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 89fb92e7-ef4c-4796-9797-2ed6faf2048c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:58.354106 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4b6d573e-e219-46cb-83fa-cb02b3d27565 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:58.354822 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4b6d573e-e219-46cb-83fa-cb02b3d27565 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:58.355434 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4b6d573e-e219-46cb-83fa-cb02b3d27565 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:58.356337 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4b6d573e-e219-46cb-83fa-cb02b3d27565 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:58.356946 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4b6d573e-e219-46cb-83fa-cb02b3d27565 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:58.357536 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4b6d573e-e219-46cb-83fa-cb02b3d27565 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:58.612023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e80384da-38ec-4702-afb3-70a87783bdbc tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:58.625833 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e80384da-38ec-4702-afb3-70a87783bdbc tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:58.627777 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e80384da-38ec-4702-afb3-70a87783bdbc tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:58.631260 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e80384da-38ec-4702-afb3-70a87783bdbc tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be" status: 200 len: 1723 microversion: 2.20 time: 0.722376 Sep 24 21:07:58.652944 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2321/4632] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:57 2022] GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be => generated 1723 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:58.946173 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4b6d573e-e219-46cb-83fa-cb02b3d27565 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:58.966132 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4b6d573e-e219-46cb-83fa-cb02b3d27565 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c" status: 200 len: 1313 microversion: 2.1 time: 0.637254 Sep 24 21:07:58.966781 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2312/4633] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:58 2022] GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c => generated 1313 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:07:59.154202 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dfeb8de5-45df-4674-960b-8ac5df1069ae tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:59.159285 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dfeb8de5-45df-4674-960b-8ac5df1069ae tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:59.184574 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dfeb8de5-45df-4674-960b-8ac5df1069ae tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:59.186202 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dfeb8de5-45df-4674-960b-8ac5df1069ae tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:59.188810 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dfeb8de5-45df-4674-960b-8ac5df1069ae tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:59.190151 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dfeb8de5-45df-4674-960b-8ac5df1069ae tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:59.190804 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dfeb8de5-45df-4674-960b-8ac5df1069ae tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:59.194036 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dfeb8de5-45df-4674-960b-8ac5df1069ae tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:59.517525 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-f35ca94f-f886-49f7-ad3c-be94802696fa req-29ff9fab-f13e-4196-b8c2-a7b25958eae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0896ae3f-f6f6-49dd-87df-c73f911c78be", "name": "network-vif-deleted", "tag": "29c8bcaf-e987-4103-8e4a-20d1ad7bfbe6"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:07:59.556251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-f35ca94f-f886-49f7-ad3c-be94802696fa req-29ff9fab-f13e-4196-b8c2-a7b25958eae3 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:59.556745 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-f35ca94f-f886-49f7-ad3c-be94802696fa req-29ff9fab-f13e-4196-b8c2-a7b25958eae3 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:59.557174 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-f35ca94f-f886-49f7-ad3c-be94802696fa req-29ff9fab-f13e-4196-b8c2-a7b25958eae3 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:59.607745 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:07:59.642774 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-f35ca94f-f886-49f7-ad3c-be94802696fa req-29ff9fab-f13e-4196-b8c2-a7b25958eae3 service nova] Creating event network-vif-deleted:29c8bcaf-e987-4103-8e4a-20d1ad7bfbe6 for instance 0896ae3f-f6f6-49dd-87df-c73f911c78be on nch2-master-1 Sep 24 21:07:59.664852 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-f35ca94f-f886-49f7-ad3c-be94802696fa req-29ff9fab-f13e-4196-b8c2-a7b25958eae3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151991 Sep 24 21:07:59.665888 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2313/4634] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:07:59.673912 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3017a4ea-2f0f-4130-871d-85dd13b79c97 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:07:59.674922 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3017a4ea-2f0f-4130-871d-85dd13b79c97 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 0896ae3f-f6f6-49dd-87df-c73f911c78be] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:07:59.683082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3017a4ea-2f0f-4130-871d-85dd13b79c97 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:59.683853 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3017a4ea-2f0f-4130-871d-85dd13b79c97 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:59.684958 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3017a4ea-2f0f-4130-871d-85dd13b79c97 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:59.685994 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3017a4ea-2f0f-4130-871d-85dd13b79c97 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:59.687841 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3017a4ea-2f0f-4130-871d-85dd13b79c97 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:59.689191 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3017a4ea-2f0f-4130-871d-85dd13b79c97 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:59.753048 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3017a4ea-2f0f-4130-871d-85dd13b79c97 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:59.753766 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3017a4ea-2f0f-4130-871d-85dd13b79c97 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:59.754406 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3017a4ea-2f0f-4130-871d-85dd13b79c97 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:59.755036 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-3017a4ea-2f0f-4130-871d-85dd13b79c97 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lazy-loading 'fault' on Instance uuid 0896ae3f-f6f6-49dd-87df-c73f911c78be {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:07:59.867425 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3017a4ea-2f0f-4130-871d-85dd13b79c97 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:59.895896 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3017a4ea-2f0f-4130-871d-85dd13b79c97 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:59.899433 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3017a4ea-2f0f-4130-871d-85dd13b79c97 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:07:59.900650 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3017a4ea-2f0f-4130-871d-85dd13b79c97 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be" status: 200 len: 1372 microversion: 2.20 time: 0.233460 Sep 24 21:07:59.905501 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2314/4635] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:07:59 2022] GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be => generated 1372 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:07:59.921150 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-23e854a8-bd0d-4bb3-b52a-7c986d5f7abf req-7db4f196-0fe3-4863-896f-0f1472ac4bc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dda4c066-f7bb-45df-9e57-b0e2d23fd7b9", "name": "network-vif-unplugged", "status": "completed", "tag": "760158dc-6fec-418e-aae5-f938ec813cb9"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:07:59.937447 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-23e854a8-bd0d-4bb3-b52a-7c986d5f7abf req-7db4f196-0fe3-4863-896f-0f1472ac4bc9 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:07:59.944780 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-23e854a8-bd0d-4bb3-b52a-7c986d5f7abf req-7db4f196-0fe3-4863-896f-0f1472ac4bc9 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:07:59.945462 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-23e854a8-bd0d-4bb3-b52a-7c986d5f7abf req-7db4f196-0fe3-4863-896f-0f1472ac4bc9 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:07:59.977013 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-23e854a8-bd0d-4bb3-b52a-7c986d5f7abf req-7db4f196-0fe3-4863-896f-0f1472ac4bc9 service nova] Creating event network-vif-unplugged:760158dc-6fec-418e-aae5-f938ec813cb9 for instance dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 on nch2-master-1 Sep 24 21:07:59.997384 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-23e854a8-bd0d-4bb3-b52a-7c986d5f7abf req-7db4f196-0fe3-4863-896f-0f1472ac4bc9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089916 Sep 24 21:08:00.001860 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2315/4636] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:08:00.011705 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-faf26066-0845-44ab-9d89-ea1ad6f6e2d4 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:00.017374 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-faf26066-0845-44ab-9d89-ea1ad6f6e2d4 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 89fb92e7-ef4c-4796-9797-2ed6faf2048c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:00.037685 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-faf26066-0845-44ab-9d89-ea1ad6f6e2d4 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:00.038607 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-faf26066-0845-44ab-9d89-ea1ad6f6e2d4 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:00.040045 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-faf26066-0845-44ab-9d89-ea1ad6f6e2d4 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:00.041118 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-faf26066-0845-44ab-9d89-ea1ad6f6e2d4 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:00.041737 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-faf26066-0845-44ab-9d89-ea1ad6f6e2d4 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:00.047890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-faf26066-0845-44ab-9d89-ea1ad6f6e2d4 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:00.383400 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dfeb8de5-45df-4674-960b-8ac5df1069ae tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:00.397287 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dfeb8de5-45df-4674-960b-8ac5df1069ae tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9" status: 200 len: 1506 microversion: 2.1 time: 1.249169 Sep 24 21:08:00.406970 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2322/4637] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:07:59 2022] GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 => generated 1506 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:00.492568 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-faf26066-0845-44ab-9d89-ea1ad6f6e2d4 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:00.514412 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-faf26066-0845-44ab-9d89-ea1ad6f6e2d4 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c" status: 200 len: 1313 microversion: 2.1 time: 0.510715 Sep 24 21:08:00.516658 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2316/4638] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:00 2022] GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c => generated 1313 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:00.932827 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-14d56d3d-50fd-46cc-ba41-bf62568006a5 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:00.933616 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-14d56d3d-50fd-46cc-ba41-bf62568006a5 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 0896ae3f-f6f6-49dd-87df-c73f911c78be] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:00.951447 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-14d56d3d-50fd-46cc-ba41-bf62568006a5 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:00.952106 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-14d56d3d-50fd-46cc-ba41-bf62568006a5 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:00.953567 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-14d56d3d-50fd-46cc-ba41-bf62568006a5 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:00.954469 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-14d56d3d-50fd-46cc-ba41-bf62568006a5 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:00.955136 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-14d56d3d-50fd-46cc-ba41-bf62568006a5 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:00.955818 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-14d56d3d-50fd-46cc-ba41-bf62568006a5 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:01.047714 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-14d56d3d-50fd-46cc-ba41-bf62568006a5 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:01.051475 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-14d56d3d-50fd-46cc-ba41-bf62568006a5 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:01.054781 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-14d56d3d-50fd-46cc-ba41-bf62568006a5 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:01.055675 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-14d56d3d-50fd-46cc-ba41-bf62568006a5 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lazy-loading 'fault' on Instance uuid 0896ae3f-f6f6-49dd-87df-c73f911c78be {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:08:01.360878 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-14d56d3d-50fd-46cc-ba41-bf62568006a5 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:01.371745 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-14d56d3d-50fd-46cc-ba41-bf62568006a5 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:01.373852 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-14d56d3d-50fd-46cc-ba41-bf62568006a5 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:01.375977 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-14d56d3d-50fd-46cc-ba41-bf62568006a5 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be" status: 200 len: 1372 microversion: 2.20 time: 0.447467 Sep 24 21:08:01.402520 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2323/4639] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:08:00 2022] GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be => generated 1372 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:08:01.425567 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-09e2cfcf-dfba-403d-9c19-eb141c580278 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:01.426125 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-09e2cfcf-dfba-403d-9c19-eb141c580278 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:01.442673 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-09e2cfcf-dfba-403d-9c19-eb141c580278 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:01.443558 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-09e2cfcf-dfba-403d-9c19-eb141c580278 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:01.444234 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-09e2cfcf-dfba-403d-9c19-eb141c580278 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:01.445208 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-09e2cfcf-dfba-403d-9c19-eb141c580278 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:01.445921 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-09e2cfcf-dfba-403d-9c19-eb141c580278 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:01.447148 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-09e2cfcf-dfba-403d-9c19-eb141c580278 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:01.547008 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-33394967-ebe3-4451-9b60-28ba3f855e58 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:01.547719 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-33394967-ebe3-4451-9b60-28ba3f855e58 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 89fb92e7-ef4c-4796-9797-2ed6faf2048c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:01.559573 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33394967-ebe3-4451-9b60-28ba3f855e58 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:01.560193 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33394967-ebe3-4451-9b60-28ba3f855e58 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:01.560932 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33394967-ebe3-4451-9b60-28ba3f855e58 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:01.562401 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33394967-ebe3-4451-9b60-28ba3f855e58 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:01.563330 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33394967-ebe3-4451-9b60-28ba3f855e58 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:01.567722 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33394967-ebe3-4451-9b60-28ba3f855e58 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:01.809941 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-09e2cfcf-dfba-403d-9c19-eb141c580278 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:01.820355 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-09e2cfcf-dfba-403d-9c19-eb141c580278 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9" status: 200 len: 1509 microversion: 2.1 time: 0.399836 Sep 24 21:08:01.821576 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2317/4640] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:01 2022] GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 => generated 1509 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:01.864228 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e37ee608-1981-46c7-bf6d-736b1bdf4b7f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:01.867354 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e37ee608-1981-46c7-bf6d-736b1bdf4b7f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:01.886213 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e37ee608-1981-46c7-bf6d-736b1bdf4b7f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:01.887388 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e37ee608-1981-46c7-bf6d-736b1bdf4b7f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:01.888074 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e37ee608-1981-46c7-bf6d-736b1bdf4b7f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:01.889156 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e37ee608-1981-46c7-bf6d-736b1bdf4b7f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:01.890488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e37ee608-1981-46c7-bf6d-736b1bdf4b7f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:01.891793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e37ee608-1981-46c7-bf6d-736b1bdf4b7f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:02.406332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-33394967-ebe3-4451-9b60-28ba3f855e58 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:02.416148 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-33394967-ebe3-4451-9b60-28ba3f855e58 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c" status: 200 len: 1499 microversion: 2.1 time: 0.877140 Sep 24 21:08:02.431100 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2324/4641] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:01 2022] GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c => generated 1499 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:08:02.442654 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-26ba738e-2b41-426c-b3b6-4d6d8442943a tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:02.444248 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-26ba738e-2b41-426c-b3b6-4d6d8442943a tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 0896ae3f-f6f6-49dd-87df-c73f911c78be] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:02.455962 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26ba738e-2b41-426c-b3b6-4d6d8442943a tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:02.456478 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26ba738e-2b41-426c-b3b6-4d6d8442943a tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:02.456930 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26ba738e-2b41-426c-b3b6-4d6d8442943a tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:02.457672 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26ba738e-2b41-426c-b3b6-4d6d8442943a tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:02.458134 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26ba738e-2b41-426c-b3b6-4d6d8442943a tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:02.458994 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26ba738e-2b41-426c-b3b6-4d6d8442943a tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:02.502869 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-26ba738e-2b41-426c-b3b6-4d6d8442943a tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] HTTP exception thrown: Instance 0896ae3f-f6f6-49dd-87df-c73f911c78be could not be found. Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-26ba738e-2b41-426c-b3b6-4d6d8442943a tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Request method failure captured: Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be HTTP/1.1 Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3FsjrdoTLdOxdYmSkauE7lKrc3DklKixyOWEkY-acuxghYf1MEyq1FlbMnye7QPphQ81HUjsPLkmACfRJ2SJWJ6vGYAvmnFmt2mi-WvCPzzKogs5-wVH-W1AQ1F6LII5Yt5aBY60WfX68LX1xWBQcUP9NLsqBGXFNDpojv6-BRdYsU Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: X-Openstack-Nova-Api-Version: 2.20 Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: d0e5867b34544cadbb354439808248aa Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-809062567 Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d0e5867b34544cadbb354439808248aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d0e5867b34544cadbb354439808248aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d0e5867b34544cadbb354439808248aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d0e5867b34544cadbb354439808248aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-AttachVolumeShelveTestJSON-809062567 Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: d0e5867b34544cadbb354439808248aa Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-809062567 Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-AttachVolumeShelveTestJSON-809062567-project Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 9eca15a31e064f4199bfc4b04de7c5b2 Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-AttachVolumeShelveTestJSON-809062567-project Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 0896ae3f-f6f6-49dd-87df-c73f911c78be could not be found. Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '0896ae3f-f6f6-49dd-87df-c73f911c78be'} Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0896ae3f-f6f6-49dd-87df-c73f911c78be could not be found. Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0896ae3f-f6f6-49dd-87df-c73f911c78be could not be found. Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:08:02.506065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:08:02.509826 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:08:02.509826 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:08:02.509826 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:08:02.509826 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:08:02.509826 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:08:02.509826 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:08:02.509826 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0896ae3f-f6f6-49dd-87df-c73f911c78be could not be found. Sep 24 21:08:02.509826 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:08:02.515284 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-26ba738e-2b41-426c-b3b6-4d6d8442943a tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Returning 404 to user: Instance 0896ae3f-f6f6-49dd-87df-c73f911c78be could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:08:02.517885 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-26ba738e-2b41-426c-b3b6-4d6d8442943a tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be" status: 404 len: 111 microversion: 2.20 time: 0.085644 Sep 24 21:08:02.520005 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2325/4642] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:08:02 2022] GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:08:02.532557 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a95a846d-7060-448f-86a8-5566ab4a00c4 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:08:02.538718 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a95a846d-7060-448f-86a8-5566ab4a00c4 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 89fb92e7-ef4c-4796-9797-2ed6faf2048c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:02.555084 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a95a846d-7060-448f-86a8-5566ab4a00c4 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:02.558282 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a95a846d-7060-448f-86a8-5566ab4a00c4 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:02.558983 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a95a846d-7060-448f-86a8-5566ab4a00c4 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:02.560916 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a95a846d-7060-448f-86a8-5566ab4a00c4 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:02.562431 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a95a846d-7060-448f-86a8-5566ab4a00c4 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:02.565485 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a95a846d-7060-448f-86a8-5566ab4a00c4 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:02.606108 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-a95a846d-7060-448f-86a8-5566ab4a00c4 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lazy-loading 'flavor' on Instance uuid 89fb92e7-ef4c-4796-9797-2ed6faf2048c {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:08:02.637316 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e37ee608-1981-46c7-bf6d-736b1bdf4b7f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:02.648714 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e37ee608-1981-46c7-bf6d-736b1bdf4b7f tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.795871 Sep 24 21:08:02.649839 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2318/4643] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:01 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:02.672798 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-893bf019-d47b-4fdc-97ae-f82f52bda1e8 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '.version_select at 0x7f4b0c08ab80>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:02.711257 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-893bf019-d47b-4fdc-97ae-f82f52bda1e8 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1303507742" status: 204 len: 0 microversion: 2.20 time: 0.056316 Sep 24 21:08:02.711935 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2319/4644] 10.222.0.52 () {60 vars in 1262 bytes} [Sat Sep 24 21:08:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1303507742 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 24 21:08:02.719408 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bce6ab84-113f-4349-b0b5-314bcb365218 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:02.720269 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-bce6ab84-113f-4349-b0b5-314bcb365218 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:02.728295 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bce6ab84-113f-4349-b0b5-314bcb365218 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:02.729049 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bce6ab84-113f-4349-b0b5-314bcb365218 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:02.729645 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bce6ab84-113f-4349-b0b5-314bcb365218 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:02.731123 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bce6ab84-113f-4349-b0b5-314bcb365218 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:02.731777 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bce6ab84-113f-4349-b0b5-314bcb365218 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:02.732449 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bce6ab84-113f-4349-b0b5-314bcb365218 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:02.739283 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a95a846d-7060-448f-86a8-5566ab4a00c4 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "POST /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c/action" status: 200 len: 32 microversion: 2.1 time: 0.213852 Sep 24 21:08:02.743096 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2326/4645] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:08:02 2022] POST /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c/action => generated 32 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 21:08:02.755878 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fba4b4c7-7a77-4b6e-a6b4-aa142c55ee0a tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:02.757149 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fba4b4c7-7a77-4b6e-a6b4-aa142c55ee0a tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 89fb92e7-ef4c-4796-9797-2ed6faf2048c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:02.763724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fba4b4c7-7a77-4b6e-a6b4-aa142c55ee0a tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:02.764586 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fba4b4c7-7a77-4b6e-a6b4-aa142c55ee0a tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:02.766138 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fba4b4c7-7a77-4b6e-a6b4-aa142c55ee0a tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:02.767239 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fba4b4c7-7a77-4b6e-a6b4-aa142c55ee0a tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:02.767965 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fba4b4c7-7a77-4b6e-a6b4-aa142c55ee0a tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:02.768616 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fba4b4c7-7a77-4b6e-a6b4-aa142c55ee0a tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:03.304596 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fba4b4c7-7a77-4b6e-a6b4-aa142c55ee0a tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:03.313268 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fba4b4c7-7a77-4b6e-a6b4-aa142c55ee0a tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c" status: 200 len: 1505 microversion: 2.1 time: 0.564521 Sep 24 21:08:03.314193 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2327/4646] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:02 2022] GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c => generated 1505 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:03.348304 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-bce6ab84-113f-4349-b0b5-314bcb365218 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:03.358824 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bce6ab84-113f-4349-b0b5-314bcb365218 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.645436 Sep 24 21:08:03.359538 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2320/4647] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:02 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:03.384183 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-116fc1f5-a67e-4b4c-9333-2c019389b250 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:03.384804 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-116fc1f5-a67e-4b4c-9333-2c019389b250 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:03.391932 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-116fc1f5-a67e-4b4c-9333-2c019389b250 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:03.392740 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-116fc1f5-a67e-4b4c-9333-2c019389b250 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:03.393389 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-116fc1f5-a67e-4b4c-9333-2c019389b250 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:03.394284 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-116fc1f5-a67e-4b4c-9333-2c019389b250 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:03.394955 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-116fc1f5-a67e-4b4c-9333-2c019389b250 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:03.395563 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-116fc1f5-a67e-4b4c-9333-2c019389b250 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:03.908944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-116fc1f5-a67e-4b4c-9333-2c019389b250 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:03.925296 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-116fc1f5-a67e-4b4c-9333-2c019389b250 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.545231 Sep 24 21:08:03.931973 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2328/4648] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:03 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:03.959116 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-85fbe6ef-d0fd-455c-bb75-c8332980de14 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:03.960676 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-85fbe6ef-d0fd-455c-bb75-c8332980de14 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:03.968245 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-85fbe6ef-d0fd-455c-bb75-c8332980de14 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:03.968981 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-85fbe6ef-d0fd-455c-bb75-c8332980de14 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:03.969615 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-85fbe6ef-d0fd-455c-bb75-c8332980de14 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:03.970534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-85fbe6ef-d0fd-455c-bb75-c8332980de14 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:03.971157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-85fbe6ef-d0fd-455c-bb75-c8332980de14 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:03.971738 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-85fbe6ef-d0fd-455c-bb75-c8332980de14 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:04.335980 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2ce50c3d-3205-4c91-800b-8cfb48dcfa36 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:04.336715 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2ce50c3d-3205-4c91-800b-8cfb48dcfa36 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 89fb92e7-ef4c-4796-9797-2ed6faf2048c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:04.344493 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ce50c3d-3205-4c91-800b-8cfb48dcfa36 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:04.345103 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ce50c3d-3205-4c91-800b-8cfb48dcfa36 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:04.345934 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ce50c3d-3205-4c91-800b-8cfb48dcfa36 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:04.346883 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ce50c3d-3205-4c91-800b-8cfb48dcfa36 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:04.347416 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ce50c3d-3205-4c91-800b-8cfb48dcfa36 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:04.348075 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ce50c3d-3205-4c91-800b-8cfb48dcfa36 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:04.664954 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-85fbe6ef-d0fd-455c-bb75-c8332980de14 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:04.673707 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-85fbe6ef-d0fd-455c-bb75-c8332980de14 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.720278 Sep 24 21:08:04.687852 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2321/4649] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:03 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:04.698061 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fdd3c4a3-2eef-455c-ad21-24a16b6573b0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:08:04.705033 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fdd3c4a3-2eef-455c-ad21-24a16b6573b0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:04.705853 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fdd3c4a3-2eef-455c-ad21-24a16b6573b0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:04.706556 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fdd3c4a3-2eef-455c-ad21-24a16b6573b0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:04.741501 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fdd3c4a3-2eef-455c-ad21-24a16b6573b0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Going to try to stop instance {{(pid=140516) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 24 21:08:04.795615 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fdd3c4a3-2eef-455c-ad21-24a16b6573b0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "POST /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/action" status: 202 len: 0 microversion: 2.1 time: 0.101321 Sep 24 21:08:04.797138 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2322/4650] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:08:04 2022] POST /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 21:08:04.806777 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8d7f1fca-3dcc-4aa7-9ed8-8c15354193a2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:04.807770 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8d7f1fca-3dcc-4aa7-9ed8-8c15354193a2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:04.820088 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d7f1fca-3dcc-4aa7-9ed8-8c15354193a2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:04.820626 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d7f1fca-3dcc-4aa7-9ed8-8c15354193a2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:04.821082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d7f1fca-3dcc-4aa7-9ed8-8c15354193a2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:04.821837 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d7f1fca-3dcc-4aa7-9ed8-8c15354193a2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:04.822312 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d7f1fca-3dcc-4aa7-9ed8-8c15354193a2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:04.822777 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d7f1fca-3dcc-4aa7-9ed8-8c15354193a2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:05.447992 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2ce50c3d-3205-4c91-800b-8cfb48dcfa36 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:05.460574 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2ce50c3d-3205-4c91-800b-8cfb48dcfa36 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c" status: 200 len: 1505 microversion: 2.1 time: 1.128439 Sep 24 21:08:05.461281 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2329/4651] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:04 2022] GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c => generated 1505 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:08:05.705454 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8d7f1fca-3dcc-4aa7-9ed8-8c15354193a2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:05.715819 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8d7f1fca-3dcc-4aa7-9ed8-8c15354193a2 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1678 microversion: 2.1 time: 0.913997 Sep 24 21:08:05.716878 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2323/4652] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:04 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1678 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:05.793326 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7b0e9234-9246-4343-a949-aa25a926d76f tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Action: 'create', calling method: .version_select at 0x7f4b0c0b0160>, body: {"keypair": {"name": "tempest-keypair-1792455767", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlA8q0dSNEtMxBrp2JV3ej7upQaKcLvLRstKgF1EKN6+1R3igFmomFsTsblT9tU0mUN/GtnOwiW/Kmai6sdoCpbhN9tVD8ob9BF4wneyLZYnrvSzxvj/C98PdLmUkLESA=="}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:08:05.815003 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-7b0e9234-9246-4343-a949-aa25a926d76f tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Getting quotas for project d0e5867b34544cadbb354439808248aa. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:08:05.821019 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-7b0e9234-9246-4343-a949-aa25a926d76f tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Getting quotas for user 9eca15a31e064f4199bfc4b04de7c5b2 and project d0e5867b34544cadbb354439808248aa. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:08:05.857209 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7b0e9234-9246-4343-a949-aa25a926d76f tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.069460 Sep 24 21:08:05.858181 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2330/4653] 10.222.0.52 () {62 vars in 1200 bytes} [Sat Sep 24 21:08:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 72 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 24 21:08:06.489181 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c42ab7a8-46a2-45c8-9507-d27061339e56 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:06.492466 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c42ab7a8-46a2-45c8-9507-d27061339e56 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 89fb92e7-ef4c-4796-9797-2ed6faf2048c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:06.506638 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c42ab7a8-46a2-45c8-9507-d27061339e56 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:06.507436 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c42ab7a8-46a2-45c8-9507-d27061339e56 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:06.508139 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c42ab7a8-46a2-45c8-9507-d27061339e56 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:06.519586 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c42ab7a8-46a2-45c8-9507-d27061339e56 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:06.521097 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c42ab7a8-46a2-45c8-9507-d27061339e56 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:06.521713 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c42ab7a8-46a2-45c8-9507-d27061339e56 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:06.748337 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-179fcc76-96a4-43bb-a05e-4fe692f0a9ec tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:06.750286 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-179fcc76-96a4-43bb-a05e-4fe692f0a9ec tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:06.761463 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-179fcc76-96a4-43bb-a05e-4fe692f0a9ec tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:06.762941 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-179fcc76-96a4-43bb-a05e-4fe692f0a9ec tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:06.763769 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-179fcc76-96a4-43bb-a05e-4fe692f0a9ec tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:06.765855 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-179fcc76-96a4-43bb-a05e-4fe692f0a9ec tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:06.767216 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-179fcc76-96a4-43bb-a05e-4fe692f0a9ec tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:06.767957 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-179fcc76-96a4-43bb-a05e-4fe692f0a9ec tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:07.060108 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c42ab7a8-46a2-45c8-9507-d27061339e56 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:07.083061 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c42ab7a8-46a2-45c8-9507-d27061339e56 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c" status: 200 len: 1505 microversion: 2.1 time: 0.602051 Sep 24 21:08:07.085730 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2324/4654] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:06 2022] GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c => generated 1505 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:07.239528 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-179fcc76-96a4-43bb-a05e-4fe692f0a9ec tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:07.259005 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-179fcc76-96a4-43bb-a05e-4fe692f0a9ec tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1678 microversion: 2.1 time: 0.518247 Sep 24 21:08:07.260186 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2331/4655] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:06 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1678 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:08.107067 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-02bbfad8-c04b-4c71-81f9-c27aa0f20146 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:08.107686 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-02bbfad8-c04b-4c71-81f9-c27aa0f20146 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 89fb92e7-ef4c-4796-9797-2ed6faf2048c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:08.112025 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:08:08.130195 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-02bbfad8-c04b-4c71-81f9-c27aa0f20146 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:08.131070 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-02bbfad8-c04b-4c71-81f9-c27aa0f20146 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:08.131747 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-02bbfad8-c04b-4c71-81f9-c27aa0f20146 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:08.132705 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-02bbfad8-c04b-4c71-81f9-c27aa0f20146 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:08.133383 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-02bbfad8-c04b-4c71-81f9-c27aa0f20146 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:08.134024 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-02bbfad8-c04b-4c71-81f9-c27aa0f20146 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:08.294668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d9e51b6b-6390-4a33-991b-5fe4cd3efe69 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:08.296090 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d9e51b6b-6390-4a33-991b-5fe4cd3efe69 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:08.307525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d9e51b6b-6390-4a33-991b-5fe4cd3efe69 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:08.308552 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d9e51b6b-6390-4a33-991b-5fe4cd3efe69 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:08.309357 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d9e51b6b-6390-4a33-991b-5fe4cd3efe69 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:08.310574 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d9e51b6b-6390-4a33-991b-5fe4cd3efe69 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:08.311165 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d9e51b6b-6390-4a33-991b-5fe4cd3efe69 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:08.312509 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d9e51b6b-6390-4a33-991b-5fe4cd3efe69 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:08.320114 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:08:08.604718 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-02bbfad8-c04b-4c71-81f9-c27aa0f20146 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:08.618191 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-02bbfad8-c04b-4c71-81f9-c27aa0f20146 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c" status: 200 len: 1505 microversion: 2.1 time: 0.514920 Sep 24 21:08:08.619046 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2325/4656] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:08 2022] GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c => generated 1505 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:08.659606 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d803e02a-2a06-4862-8653-83ab70eef392 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1036500330", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a7c3a4b7-da1a-4e3c-8c0c-b42a35dbeab5"}], "security_groups": [{"name": "tempest-securitygroup--784136747"}], "key_name": "tempest-keypair-1792455767", "user_data": "}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:08:08.742575 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d9e51b6b-6390-4a33-991b-5fe4cd3efe69 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:08.751391 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d9e51b6b-6390-4a33-991b-5fe4cd3efe69 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1678 microversion: 2.1 time: 0.469998 Sep 24 21:08:08.768178 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2332/4657] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:08 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1678 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:08.833952 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-d803e02a-2a06-4862-8653-83ab70eef392 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] validate_networks() for [('a7c3a4b7-da1a-4e3c-8c0c-b42a35dbeab5', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:08:09.651449 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9a330575-7980-49dd-83c0-c27392f86234 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:09.653021 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9a330575-7980-49dd-83c0-c27392f86234 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 89fb92e7-ef4c-4796-9797-2ed6faf2048c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:09.667779 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a330575-7980-49dd-83c0-c27392f86234 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:09.668542 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a330575-7980-49dd-83c0-c27392f86234 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:09.669732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a330575-7980-49dd-83c0-c27392f86234 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:09.671806 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a330575-7980-49dd-83c0-c27392f86234 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:09.675365 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a330575-7980-49dd-83c0-c27392f86234 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:09.677128 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a330575-7980-49dd-83c0-c27392f86234 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:09.970214 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-d803e02a-2a06-4862-8653-83ab70eef392 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:08:09.971792 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-d803e02a-2a06-4862-8653-83ab70eef392 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:08:09.972450 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-d803e02a-2a06-4862-8653-83ab70eef392 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:08:09.973033 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-d803e02a-2a06-4862-8653-83ab70eef392 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:08:09.973821 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-d803e02a-2a06-4862-8653-83ab70eef392 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:08:10.013394 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d803e02a-2a06-4862-8653-83ab70eef392 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:10.016506 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d803e02a-2a06-4862-8653-83ab70eef392 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:10.017878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d803e02a-2a06-4862-8653-83ab70eef392 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:10.019863 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d803e02a-2a06-4862-8653-83ab70eef392 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:10.020697 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d803e02a-2a06-4862-8653-83ab70eef392 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:10.021678 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d803e02a-2a06-4862-8653-83ab70eef392 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:10.066029 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-d803e02a-2a06-4862-8653-83ab70eef392 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Getting quotas for project d0e5867b34544cadbb354439808248aa. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:08:10.073908 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-d803e02a-2a06-4862-8653-83ab70eef392 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Getting quotas for user 9eca15a31e064f4199bfc4b04de7c5b2 and project d0e5867b34544cadbb354439808248aa. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:08:10.097772 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d803e02a-2a06-4862-8653-83ab70eef392 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:08:10.102356 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d803e02a-2a06-4862-8653-83ab70eef392 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:08:10.178009 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d803e02a-2a06-4862-8653-83ab70eef392 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.523252 Sep 24 21:08:10.179861 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2326/4658] 10.222.0.52 () {62 vars in 1188 bytes} [Sat Sep 24 21:08:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 1526 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 24 21:08:10.194521 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b5c53386-9137-4072-a84d-d03bf20bdfa0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:10.196025 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b5c53386-9137-4072-a84d-d03bf20bdfa0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:10.212699 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5c53386-9137-4072-a84d-d03bf20bdfa0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:10.213397 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5c53386-9137-4072-a84d-d03bf20bdfa0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:10.214611 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5c53386-9137-4072-a84d-d03bf20bdfa0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:10.215533 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5c53386-9137-4072-a84d-d03bf20bdfa0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:10.216769 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5c53386-9137-4072-a84d-d03bf20bdfa0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:10.217606 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5c53386-9137-4072-a84d-d03bf20bdfa0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:10.229557 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9a330575-7980-49dd-83c0-c27392f86234 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:10.247167 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9a330575-7980-49dd-83c0-c27392f86234 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c" status: 200 len: 1505 microversion: 2.1 time: 0.593894 Sep 24 21:08:10.248462 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2333/4659] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:09 2022] GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c => generated 1505 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:08:10.269886 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c1713cd2-1fa9-4c83-9ae8-b0540a40180d tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:10.270930 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c1713cd2-1fa9-4c83-9ae8-b0540a40180d tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:10.414263 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c1713cd2-1fa9-4c83-9ae8-b0540a40180d tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:10.430081 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c1713cd2-1fa9-4c83-9ae8-b0540a40180d tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:10.431976 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c1713cd2-1fa9-4c83-9ae8-b0540a40180d tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:10.433118 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c1713cd2-1fa9-4c83-9ae8-b0540a40180d tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f" status: 200 len: 1282 microversion: 2.20 time: 0.182906 Sep 24 21:08:10.433874 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2334/4660] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:08:10 2022] GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f => generated 1282 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:08:10.658665 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b5c53386-9137-4072-a84d-d03bf20bdfa0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:10.668478 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b5c53386-9137-4072-a84d-d03bf20bdfa0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1678 microversion: 2.1 time: 0.487288 Sep 24 21:08:10.683657 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2327/4661] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:10 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1678 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:11.277185 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4f6d30cb-5fb9-4929-8f1f-242f42b9092e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:11.278639 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4f6d30cb-5fb9-4929-8f1f-242f42b9092e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 89fb92e7-ef4c-4796-9797-2ed6faf2048c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:11.294103 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4f6d30cb-5fb9-4929-8f1f-242f42b9092e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:11.297858 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4f6d30cb-5fb9-4929-8f1f-242f42b9092e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:11.299535 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4f6d30cb-5fb9-4929-8f1f-242f42b9092e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:11.300640 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4f6d30cb-5fb9-4929-8f1f-242f42b9092e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:11.301834 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4f6d30cb-5fb9-4929-8f1f-242f42b9092e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:11.303533 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4f6d30cb-5fb9-4929-8f1f-242f42b9092e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:11.463644 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d2fc96c3-85e6-4cee-9aaa-57554b3f4246 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:11.465206 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d2fc96c3-85e6-4cee-9aaa-57554b3f4246 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:11.478404 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d2fc96c3-85e6-4cee-9aaa-57554b3f4246 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:11.480765 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d2fc96c3-85e6-4cee-9aaa-57554b3f4246 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:11.482993 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d2fc96c3-85e6-4cee-9aaa-57554b3f4246 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:11.502091 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d2fc96c3-85e6-4cee-9aaa-57554b3f4246 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:11.506734 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d2fc96c3-85e6-4cee-9aaa-57554b3f4246 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:11.509937 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d2fc96c3-85e6-4cee-9aaa-57554b3f4246 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:11.821635 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d2fc96c3-85e6-4cee-9aaa-57554b3f4246 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:11.837805 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d2fc96c3-85e6-4cee-9aaa-57554b3f4246 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:11.849918 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d2fc96c3-85e6-4cee-9aaa-57554b3f4246 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:11.852348 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d2fc96c3-85e6-4cee-9aaa-57554b3f4246 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f" status: 200 len: 1334 microversion: 2.20 time: 0.393070 Sep 24 21:08:11.853593 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2328/4662] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:08:11 2022] GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f => generated 1334 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:08:11.875494 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-eca3aa8e-1ced-4cc3-883e-79c354ea0107 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:11.876644 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-eca3aa8e-1ced-4cc3-883e-79c354ea0107 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:11.891202 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eca3aa8e-1ced-4cc3-883e-79c354ea0107 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:11.892098 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eca3aa8e-1ced-4cc3-883e-79c354ea0107 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:11.893983 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eca3aa8e-1ced-4cc3-883e-79c354ea0107 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:11.894781 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eca3aa8e-1ced-4cc3-883e-79c354ea0107 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:11.895251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eca3aa8e-1ced-4cc3-883e-79c354ea0107 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:11.900753 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eca3aa8e-1ced-4cc3-883e-79c354ea0107 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:11.947774 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4f6d30cb-5fb9-4929-8f1f-242f42b9092e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:11.962006 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4f6d30cb-5fb9-4929-8f1f-242f42b9092e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c" status: 200 len: 1505 microversion: 2.1 time: 0.689533 Sep 24 21:08:11.977327 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2335/4663] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:11 2022] GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c => generated 1505 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:12.468882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-eca3aa8e-1ced-4cc3-883e-79c354ea0107 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:12.487593 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-eca3aa8e-1ced-4cc3-883e-79c354ea0107 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1678 microversion: 2.1 time: 0.631962 Sep 24 21:08:12.489133 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2329/4664] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:11 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1678 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:12.884244 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-23accd17-92bd-4ca2-b88e-4546c2c38495 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:12.885390 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-23accd17-92bd-4ca2-b88e-4546c2c38495 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:12.893274 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23accd17-92bd-4ca2-b88e-4546c2c38495 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:12.893768 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23accd17-92bd-4ca2-b88e-4546c2c38495 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:12.894380 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23accd17-92bd-4ca2-b88e-4546c2c38495 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:12.899021 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23accd17-92bd-4ca2-b88e-4546c2c38495 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:12.906259 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23accd17-92bd-4ca2-b88e-4546c2c38495 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:12.907567 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23accd17-92bd-4ca2-b88e-4546c2c38495 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:12.987335 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-672f946f-2432-4f83-979d-7254516e961c tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:12.987966 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-672f946f-2432-4f83-979d-7254516e961c tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 89fb92e7-ef4c-4796-9797-2ed6faf2048c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:13.003082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-672f946f-2432-4f83-979d-7254516e961c tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:13.003826 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-672f946f-2432-4f83-979d-7254516e961c tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:13.004271 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-672f946f-2432-4f83-979d-7254516e961c tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:13.005334 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-672f946f-2432-4f83-979d-7254516e961c tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:13.005812 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-672f946f-2432-4f83-979d-7254516e961c tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:13.006250 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-672f946f-2432-4f83-979d-7254516e961c tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:13.123649 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-23accd17-92bd-4ca2-b88e-4546c2c38495 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:13.148088 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-23accd17-92bd-4ca2-b88e-4546c2c38495 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:13.162153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-23accd17-92bd-4ca2-b88e-4546c2c38495 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:13.163751 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-23accd17-92bd-4ca2-b88e-4546c2c38495 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f" status: 200 len: 1340 microversion: 2.20 time: 0.283477 Sep 24 21:08:13.165101 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2336/4665] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:08:12 2022] GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f => generated 1340 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:08:13.452623 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-672f946f-2432-4f83-979d-7254516e961c tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:13.464572 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-672f946f-2432-4f83-979d-7254516e961c tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c" status: 200 len: 1505 microversion: 2.1 time: 0.481584 Sep 24 21:08:13.465261 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2330/4666] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:12 2022] GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c => generated 1505 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:13.514198 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-af467ab6-13c2-4aa1-b5ba-7e022b819e80 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:13.515552 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-af467ab6-13c2-4aa1-b5ba-7e022b819e80 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:13.523552 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af467ab6-13c2-4aa1-b5ba-7e022b819e80 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:13.524481 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af467ab6-13c2-4aa1-b5ba-7e022b819e80 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:13.525336 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af467ab6-13c2-4aa1-b5ba-7e022b819e80 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:13.526253 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af467ab6-13c2-4aa1-b5ba-7e022b819e80 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:13.527273 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af467ab6-13c2-4aa1-b5ba-7e022b819e80 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:13.528103 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af467ab6-13c2-4aa1-b5ba-7e022b819e80 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:14.018756 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-af467ab6-13c2-4aa1-b5ba-7e022b819e80 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:14.045274 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-af467ab6-13c2-4aa1-b5ba-7e022b819e80 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1678 microversion: 2.1 time: 0.534557 Sep 24 21:08:14.048360 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2337/4667] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:13 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1678 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:14.194089 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dddfa1b5-a289-4bdc-8c22-cb736d515139 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:14.195377 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-dddfa1b5-a289-4bdc-8c22-cb736d515139 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:14.213650 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dddfa1b5-a289-4bdc-8c22-cb736d515139 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:14.216470 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dddfa1b5-a289-4bdc-8c22-cb736d515139 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:14.217104 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dddfa1b5-a289-4bdc-8c22-cb736d515139 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:14.221158 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dddfa1b5-a289-4bdc-8c22-cb736d515139 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:14.221935 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dddfa1b5-a289-4bdc-8c22-cb736d515139 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:14.223152 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dddfa1b5-a289-4bdc-8c22-cb736d515139 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:14.272268 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:08:14.492058 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1e873933-2537-4c6e-973a-27012b10a9b3 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:14.492690 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1e873933-2537-4c6e-973a-27012b10a9b3 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 89fb92e7-ef4c-4796-9797-2ed6faf2048c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:14.499781 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e873933-2537-4c6e-973a-27012b10a9b3 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:14.500524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e873933-2537-4c6e-973a-27012b10a9b3 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:14.501126 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e873933-2537-4c6e-973a-27012b10a9b3 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:14.502018 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e873933-2537-4c6e-973a-27012b10a9b3 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:14.502855 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e873933-2537-4c6e-973a-27012b10a9b3 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:14.503460 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e873933-2537-4c6e-973a-27012b10a9b3 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:14.686955 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-dddfa1b5-a289-4bdc-8c22-cb736d515139 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:14.731040 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-dddfa1b5-a289-4bdc-8c22-cb736d515139 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:14.744721 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-dddfa1b5-a289-4bdc-8c22-cb736d515139 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:14.746886 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-dddfa1b5-a289-4bdc-8c22-cb736d515139 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f" status: 200 len: 1407 microversion: 2.20 time: 0.556188 Sep 24 21:08:14.769274 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2331/4668] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:08:14 2022] GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f => generated 1407 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:08:14.921331 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1e873933-2537-4c6e-973a-27012b10a9b3 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:14.932259 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1e873933-2537-4c6e-973a-27012b10a9b3 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c" status: 200 len: 1505 microversion: 2.1 time: 0.444473 Sep 24 21:08:14.934394 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2338/4669] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:14 2022] GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c => generated 1505 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:08:15.081885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2143e4b2-4dc8-4b93-af0f-d66ecdb0d63a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:15.082782 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2143e4b2-4dc8-4b93-af0f-d66ecdb0d63a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:15.097058 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2143e4b2-4dc8-4b93-af0f-d66ecdb0d63a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:15.100276 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2143e4b2-4dc8-4b93-af0f-d66ecdb0d63a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:15.103967 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2143e4b2-4dc8-4b93-af0f-d66ecdb0d63a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:15.105805 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2143e4b2-4dc8-4b93-af0f-d66ecdb0d63a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:15.107326 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2143e4b2-4dc8-4b93-af0f-d66ecdb0d63a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:15.110860 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2143e4b2-4dc8-4b93-af0f-d66ecdb0d63a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:15.392930 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2143e4b2-4dc8-4b93-af0f-d66ecdb0d63a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:15.408014 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2143e4b2-4dc8-4b93-af0f-d66ecdb0d63a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1655 microversion: 2.1 time: 0.330503 Sep 24 21:08:15.422525 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2332/4670] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:15 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1655 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:15.446120 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-239a456f-263e-459e-955d-6c89e9039e6a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:08:15.470319 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-239a456f-263e-459e-955d-6c89e9039e6a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:15.470953 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-239a456f-263e-459e-955d-6c89e9039e6a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:15.472407 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-239a456f-263e-459e-955d-6c89e9039e6a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:15.556935 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-239a456f-263e-459e-955d-6c89e9039e6a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Going to try to start instance {{(pid=140517) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 24 21:08:15.668947 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-239a456f-263e-459e-955d-6c89e9039e6a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "POST /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/action" status: 202 len: 0 microversion: 2.1 time: 0.236008 Sep 24 21:08:15.669913 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2339/4671] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:08:15 2022] POST /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:08:15.687592 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d0586eb6-4e2f-427e-9e73-2bf9872322d7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:15.689011 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d0586eb6-4e2f-427e-9e73-2bf9872322d7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:15.706832 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0586eb6-4e2f-427e-9e73-2bf9872322d7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:15.710491 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0586eb6-4e2f-427e-9e73-2bf9872322d7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:15.711265 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0586eb6-4e2f-427e-9e73-2bf9872322d7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:15.712312 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0586eb6-4e2f-427e-9e73-2bf9872322d7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:15.714272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0586eb6-4e2f-427e-9e73-2bf9872322d7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:15.714946 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0586eb6-4e2f-427e-9e73-2bf9872322d7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:16.009536 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5bcb6348-c503-4459-a97e-dbc449c716be tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-900203594", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "4cf0d4ca-4d29-4d04-b103-2ecdbbb3545f"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:08:16.097418 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-5bcb6348-c503-4459-a97e-dbc449c716be tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] validate_networks() for [('4cf0d4ca-4d29-4d04-b103-2ecdbbb3545f', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:08:16.918581 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d0586eb6-4e2f-427e-9e73-2bf9872322d7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:16.936301 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d0586eb6-4e2f-427e-9e73-2bf9872322d7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1664 microversion: 2.1 time: 1.261173 Sep 24 21:08:16.937638 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2333/4672] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:15 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1664 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:16.944004 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4a3b8cde-bd1e-4798-bf14-89b7790522f7 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:16.944836 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4a3b8cde-bd1e-4798-bf14-89b7790522f7 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:16.952917 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a3b8cde-bd1e-4798-bf14-89b7790522f7 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:16.974867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a3b8cde-bd1e-4798-bf14-89b7790522f7 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:16.977093 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a3b8cde-bd1e-4798-bf14-89b7790522f7 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:16.978047 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a3b8cde-bd1e-4798-bf14-89b7790522f7 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:16.979556 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a3b8cde-bd1e-4798-bf14-89b7790522f7 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:16.980752 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a3b8cde-bd1e-4798-bf14-89b7790522f7 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:17.479927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4a3b8cde-bd1e-4798-bf14-89b7790522f7 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:17.492059 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4a3b8cde-bd1e-4798-bf14-89b7790522f7 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:17.495115 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4a3b8cde-bd1e-4798-bf14-89b7790522f7 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:17.496690 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4a3b8cde-bd1e-4798-bf14-89b7790522f7 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f" status: 200 len: 1407 microversion: 2.20 time: 0.557678 Sep 24 21:08:17.497717 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2334/4673] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:08:16 2022] GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f => generated 1407 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:08:17.507570 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5e03f1b2-0e3b-43c3-9a9d-ab4861a02235 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:17.508489 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5e03f1b2-0e3b-43c3-9a9d-ab4861a02235 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 89fb92e7-ef4c-4796-9797-2ed6faf2048c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:17.518908 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e03f1b2-0e3b-43c3-9a9d-ab4861a02235 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:17.520381 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e03f1b2-0e3b-43c3-9a9d-ab4861a02235 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:17.521734 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e03f1b2-0e3b-43c3-9a9d-ab4861a02235 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:17.522807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e03f1b2-0e3b-43c3-9a9d-ab4861a02235 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:17.523479 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e03f1b2-0e3b-43c3-9a9d-ab4861a02235 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:17.524126 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e03f1b2-0e3b-43c3-9a9d-ab4861a02235 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:18.202660 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5e03f1b2-0e3b-43c3-9a9d-ab4861a02235 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:18.210531 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5e03f1b2-0e3b-43c3-9a9d-ab4861a02235 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c" status: 200 len: 1505 microversion: 2.1 time: 0.710078 Sep 24 21:08:18.226955 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2335/4674] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:17 2022] GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c => generated 1505 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:18.233975 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-c80eee83-f020-49fd-ae26-5b2ba06b1113 req-b6718fba-7049-4c1c-b4d0-3570c799a23b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f", "tag": "757d7845-8f16-4ea6-9591-83a6aeade3b6"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:08:18.246987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c80eee83-f020-49fd-ae26-5b2ba06b1113 req-b6718fba-7049-4c1c-b4d0-3570c799a23b service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:18.247842 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c80eee83-f020-49fd-ae26-5b2ba06b1113 req-b6718fba-7049-4c1c-b4d0-3570c799a23b service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:18.249488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c80eee83-f020-49fd-ae26-5b2ba06b1113 req-b6718fba-7049-4c1c-b4d0-3570c799a23b service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:18.266131 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-c80eee83-f020-49fd-ae26-5b2ba06b1113 req-b6718fba-7049-4c1c-b4d0-3570c799a23b service nova] Creating event network-changed:757d7845-8f16-4ea6-9591-83a6aeade3b6 for instance 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f on nch1-master-1 Sep 24 21:08:18.271802 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-c80eee83-f020-49fd-ae26-5b2ba06b1113 req-b6718fba-7049-4c1c-b4d0-3570c799a23b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043195 Sep 24 21:08:18.273054 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2336/4675] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:08:18.278574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d17bf70a-645f-4a21-9885-c934a9a71f87 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:18.282245 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d17bf70a-645f-4a21-9885-c934a9a71f87 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:18.288971 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d17bf70a-645f-4a21-9885-c934a9a71f87 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:18.289778 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d17bf70a-645f-4a21-9885-c934a9a71f87 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:18.290450 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d17bf70a-645f-4a21-9885-c934a9a71f87 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:18.291448 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d17bf70a-645f-4a21-9885-c934a9a71f87 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:18.292113 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d17bf70a-645f-4a21-9885-c934a9a71f87 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:18.292746 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d17bf70a-645f-4a21-9885-c934a9a71f87 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:18.421000 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-5bcb6348-c503-4459-a97e-dbc449c716be tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:08:18.421994 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-5bcb6348-c503-4459-a97e-dbc449c716be tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:08:18.422854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-5bcb6348-c503-4459-a97e-dbc449c716be tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:08:18.425832 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-5bcb6348-c503-4459-a97e-dbc449c716be tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:08:18.426090 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-5bcb6348-c503-4459-a97e-dbc449c716be tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:08:18.438461 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5bcb6348-c503-4459-a97e-dbc449c716be tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:18.439214 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5bcb6348-c503-4459-a97e-dbc449c716be tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:18.440040 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5bcb6348-c503-4459-a97e-dbc449c716be tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:18.441026 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5bcb6348-c503-4459-a97e-dbc449c716be tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:18.441635 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5bcb6348-c503-4459-a97e-dbc449c716be tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:18.442222 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5bcb6348-c503-4459-a97e-dbc449c716be tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:18.490223 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-5bcb6348-c503-4459-a97e-dbc449c716be tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Getting quotas for project b170a25f4e4d44ba88fffcdc51d3fbbe. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:08:18.497371 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-5bcb6348-c503-4459-a97e-dbc449c716be tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Getting quotas for user a22830d73cb043b8b9c2e070afa7af55 and project b170a25f4e4d44ba88fffcdc51d3fbbe. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:08:18.515607 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5bcb6348-c503-4459-a97e-dbc449c716be tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:08:18.518331 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5bcb6348-c503-4459-a97e-dbc449c716be tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:08:18.581810 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5bcb6348-c503-4459-a97e-dbc449c716be tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.830314 Sep 24 21:08:18.582903 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2340/4676] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:08:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 24 21:08:18.602235 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-579f17a5-07eb-40af-99cc-9d42d582f5a1 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:18.604196 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-579f17a5-07eb-40af-99cc-9d42d582f5a1 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:18.626739 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-579f17a5-07eb-40af-99cc-9d42d582f5a1 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:18.627504 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-579f17a5-07eb-40af-99cc-9d42d582f5a1 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:18.628204 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-579f17a5-07eb-40af-99cc-9d42d582f5a1 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:18.642109 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-579f17a5-07eb-40af-99cc-9d42d582f5a1 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:18.642845 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-579f17a5-07eb-40af-99cc-9d42d582f5a1 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:18.648574 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-579f17a5-07eb-40af-99cc-9d42d582f5a1 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:20.019832 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d17bf70a-645f-4a21-9885-c934a9a71f87 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:20.033989 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d17bf70a-645f-4a21-9885-c934a9a71f87 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1664 microversion: 2.1 time: 1.759093 Sep 24 21:08:20.049143 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2337/4677] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:18 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1664 bytes in 1769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:20.049143 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3ae810ff-289b-44a1-9852-4e25cd37db76 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:20.049143 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3ae810ff-289b-44a1-9852-4e25cd37db76 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:20.065569 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:08:20.067539 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3ae810ff-289b-44a1-9852-4e25cd37db76 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:20.068055 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3ae810ff-289b-44a1-9852-4e25cd37db76 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:20.068511 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3ae810ff-289b-44a1-9852-4e25cd37db76 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:20.069872 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3ae810ff-289b-44a1-9852-4e25cd37db76 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:20.071115 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3ae810ff-289b-44a1-9852-4e25cd37db76 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:20.071782 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3ae810ff-289b-44a1-9852-4e25cd37db76 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:20.109910 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:08:20.222723 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-579f17a5-07eb-40af-99cc-9d42d582f5a1 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:20.234249 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-579f17a5-07eb-40af-99cc-9d42d582f5a1 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:20.239742 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-579f17a5-07eb-40af-99cc-9d42d582f5a1 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:20.240045 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-579f17a5-07eb-40af-99cc-9d42d582f5a1 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f" status: 200 len: 1407 microversion: 2.20 time: 1.655209 Sep 24 21:08:20.241141 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2341/4678] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:08:18 2022] GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f => generated 1407 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:08:20.247220 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a78305eb-187c-4268-b341-3642f45c0978 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:20.248076 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a78305eb-187c-4268-b341-3642f45c0978 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 89fb92e7-ef4c-4796-9797-2ed6faf2048c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:20.256212 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a78305eb-187c-4268-b341-3642f45c0978 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:20.256942 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a78305eb-187c-4268-b341-3642f45c0978 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:20.257546 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a78305eb-187c-4268-b341-3642f45c0978 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:20.258833 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a78305eb-187c-4268-b341-3642f45c0978 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:20.259773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a78305eb-187c-4268-b341-3642f45c0978 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:20.262229 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a78305eb-187c-4268-b341-3642f45c0978 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:20.322932 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3ae810ff-289b-44a1-9852-4e25cd37db76 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:20.334914 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3ae810ff-289b-44a1-9852-4e25cd37db76 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1268 microversion: 2.1 time: 0.290813 Sep 24 21:08:20.335515 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2338/4679] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:20 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1268 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:20.603517 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a78305eb-187c-4268-b341-3642f45c0978 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:20.616254 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a78305eb-187c-4268-b341-3642f45c0978 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c" status: 200 len: 1505 microversion: 2.1 time: 0.373065 Sep 24 21:08:20.617104 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2342/4680] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:20 2022] GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c => generated 1505 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:21.064475 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-50ac5923-ed82-4ee1-9e1a-52ddcb34bf2b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:21.064475 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-50ac5923-ed82-4ee1-9e1a-52ddcb34bf2b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:21.070854 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-50ac5923-ed82-4ee1-9e1a-52ddcb34bf2b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:21.071836 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-50ac5923-ed82-4ee1-9e1a-52ddcb34bf2b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:21.072404 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-50ac5923-ed82-4ee1-9e1a-52ddcb34bf2b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:21.073237 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-50ac5923-ed82-4ee1-9e1a-52ddcb34bf2b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:21.073817 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-50ac5923-ed82-4ee1-9e1a-52ddcb34bf2b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:21.074349 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-50ac5923-ed82-4ee1-9e1a-52ddcb34bf2b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:21.265915 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4e9b37f0-d920-42b4-94eb-8f30c7fa3de0 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:21.267460 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4e9b37f0-d920-42b4-94eb-8f30c7fa3de0 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:21.280021 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e9b37f0-d920-42b4-94eb-8f30c7fa3de0 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:21.282239 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e9b37f0-d920-42b4-94eb-8f30c7fa3de0 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:21.287450 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e9b37f0-d920-42b4-94eb-8f30c7fa3de0 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:21.288674 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e9b37f0-d920-42b4-94eb-8f30c7fa3de0 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:21.289483 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e9b37f0-d920-42b4-94eb-8f30c7fa3de0 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:21.290191 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e9b37f0-d920-42b4-94eb-8f30c7fa3de0 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:21.452246 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-50ac5923-ed82-4ee1-9e1a-52ddcb34bf2b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:21.464122 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-50ac5923-ed82-4ee1-9e1a-52ddcb34bf2b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.404975 Sep 24 21:08:21.464728 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2339/4681] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:21 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:21.492338 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d43db696-190b-406c-b0ef-fe8437028888 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:21.493783 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d43db696-190b-406c-b0ef-fe8437028888 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:21.502945 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d43db696-190b-406c-b0ef-fe8437028888 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:21.503558 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d43db696-190b-406c-b0ef-fe8437028888 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:21.503934 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d43db696-190b-406c-b0ef-fe8437028888 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:21.504609 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d43db696-190b-406c-b0ef-fe8437028888 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:21.505238 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d43db696-190b-406c-b0ef-fe8437028888 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:21.505833 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d43db696-190b-406c-b0ef-fe8437028888 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:21.800864 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4e9b37f0-d920-42b4-94eb-8f30c7fa3de0 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:21.809882 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4e9b37f0-d920-42b4-94eb-8f30c7fa3de0 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:21.820541 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4e9b37f0-d920-42b4-94eb-8f30c7fa3de0 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:21.821716 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4e9b37f0-d920-42b4-94eb-8f30c7fa3de0 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f" status: 200 len: 1407 microversion: 2.20 time: 0.560278 Sep 24 21:08:21.822640 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2343/4682] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:08:21 2022] GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f => generated 1407 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:08:21.827818 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9c629647-a198-4c1d-9580-e8780668295a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:21.828438 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9c629647-a198-4c1d-9580-e8780668295a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:21.845437 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c629647-a198-4c1d-9580-e8780668295a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:21.845939 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c629647-a198-4c1d-9580-e8780668295a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:21.846383 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c629647-a198-4c1d-9580-e8780668295a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:21.847117 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c629647-a198-4c1d-9580-e8780668295a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:21.847575 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c629647-a198-4c1d-9580-e8780668295a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:21.848002 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c629647-a198-4c1d-9580-e8780668295a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:22.145413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d43db696-190b-406c-b0ef-fe8437028888 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:22.156118 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d43db696-190b-406c-b0ef-fe8437028888 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1316 microversion: 2.1 time: 0.675413 Sep 24 21:08:22.166689 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2340/4683] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:21 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1316 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:22.166689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a795ff44-2db9-4adb-88ba-a0d1c7324ab2 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:22.166689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a795ff44-2db9-4adb-88ba-a0d1c7324ab2 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 89fb92e7-ef4c-4796-9797-2ed6faf2048c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:22.169257 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a795ff44-2db9-4adb-88ba-a0d1c7324ab2 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:22.169942 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a795ff44-2db9-4adb-88ba-a0d1c7324ab2 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:22.171787 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a795ff44-2db9-4adb-88ba-a0d1c7324ab2 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:22.172846 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a795ff44-2db9-4adb-88ba-a0d1c7324ab2 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:22.173784 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a795ff44-2db9-4adb-88ba-a0d1c7324ab2 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:22.174241 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a795ff44-2db9-4adb-88ba-a0d1c7324ab2 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:22.399490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9c629647-a198-4c1d-9580-e8780668295a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:22.431804 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9c629647-a198-4c1d-9580-e8780668295a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.608066 Sep 24 21:08:22.455399 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2344/4684] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:21 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:22.468649 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a4a3178e-7b1f-401c-b611-6c2349eb621e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:22.469275 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a4a3178e-7b1f-401c-b611-6c2349eb621e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:22.485387 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4a3178e-7b1f-401c-b611-6c2349eb621e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:22.487577 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4a3178e-7b1f-401c-b611-6c2349eb621e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:22.488297 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4a3178e-7b1f-401c-b611-6c2349eb621e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:22.489298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4a3178e-7b1f-401c-b611-6c2349eb621e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:22.490092 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4a3178e-7b1f-401c-b611-6c2349eb621e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:22.491035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4a3178e-7b1f-401c-b611-6c2349eb621e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:22.512839 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a795ff44-2db9-4adb-88ba-a0d1c7324ab2 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:22.527127 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a795ff44-2db9-4adb-88ba-a0d1c7324ab2 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c" status: 200 len: 1505 microversion: 2.1 time: 0.368616 Sep 24 21:08:22.539947 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2341/4685] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:22 2022] GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c => generated 1505 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:22.816967 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a4a3178e-7b1f-401c-b611-6c2349eb621e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:22.827668 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a4a3178e-7b1f-401c-b611-6c2349eb621e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.365287 Sep 24 21:08:22.831008 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2345/4686] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:22 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:08:22.848606 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8c772c5f-50da-474a-876e-0241254af465 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:22.849485 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8c772c5f-50da-474a-876e-0241254af465 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:22.854344 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-f21b0c37-a5cd-4211-baf2-1c1c047232eb req-1417c6a9-8fcb-45e7-b81e-42026865c721 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3fcc34d-d09a-4475-bd96-51ac0074cb5f", "tag": "2ca29bee-7747-4b85-b335-ac8c4538a67e"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:08:22.857720 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c772c5f-50da-474a-876e-0241254af465 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:22.861100 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c772c5f-50da-474a-876e-0241254af465 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:22.862179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c772c5f-50da-474a-876e-0241254af465 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:22.863121 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c772c5f-50da-474a-876e-0241254af465 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:22.863578 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c772c5f-50da-474a-876e-0241254af465 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:22.865975 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-f21b0c37-a5cd-4211-baf2-1c1c047232eb req-1417c6a9-8fcb-45e7-b81e-42026865c721 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:22.867394 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-f21b0c37-a5cd-4211-baf2-1c1c047232eb req-1417c6a9-8fcb-45e7-b81e-42026865c721 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:22.867940 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-f21b0c37-a5cd-4211-baf2-1c1c047232eb req-1417c6a9-8fcb-45e7-b81e-42026865c721 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:22.871352 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c772c5f-50da-474a-876e-0241254af465 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:22.881275 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-f21b0c37-a5cd-4211-baf2-1c1c047232eb req-1417c6a9-8fcb-45e7-b81e-42026865c721 service nova] Creating event network-changed:2ca29bee-7747-4b85-b335-ac8c4538a67e for instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f on nch2-master-1 Sep 24 21:08:22.886334 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-f21b0c37-a5cd-4211-baf2-1c1c047232eb req-1417c6a9-8fcb-45e7-b81e-42026865c721 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036052 Sep 24 21:08:22.887644 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2346/4687] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:08:22.894639 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-aab59696-eb69-451c-a600-87f8e54625c8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:22.895801 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-aab59696-eb69-451c-a600-87f8e54625c8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:22.901852 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:08:22.904304 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aab59696-eb69-451c-a600-87f8e54625c8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:22.905991 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aab59696-eb69-451c-a600-87f8e54625c8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:22.906748 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aab59696-eb69-451c-a600-87f8e54625c8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:22.908154 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aab59696-eb69-451c-a600-87f8e54625c8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:22.908885 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aab59696-eb69-451c-a600-87f8e54625c8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:22.909533 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aab59696-eb69-451c-a600-87f8e54625c8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:23.293185 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-aab59696-eb69-451c-a600-87f8e54625c8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:23.306881 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-aab59696-eb69-451c-a600-87f8e54625c8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.417613 Sep 24 21:08:23.307820 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2347/4688] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:22 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:23.315019 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0e6ba85c-6983-45af-a502-6a25e15ddedd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:23.317295 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0e6ba85c-6983-45af-a502-6a25e15ddedd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:23.322759 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8c772c5f-50da-474a-876e-0241254af465 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:23.332885 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e6ba85c-6983-45af-a502-6a25e15ddedd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:23.333653 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e6ba85c-6983-45af-a502-6a25e15ddedd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:23.334327 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e6ba85c-6983-45af-a502-6a25e15ddedd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:23.335763 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e6ba85c-6983-45af-a502-6a25e15ddedd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:23.336806 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e6ba85c-6983-45af-a502-6a25e15ddedd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:23.337448 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8c772c5f-50da-474a-876e-0241254af465 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:23.339350 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e6ba85c-6983-45af-a502-6a25e15ddedd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:23.339599 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8c772c5f-50da-474a-876e-0241254af465 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:23.340770 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8c772c5f-50da-474a-876e-0241254af465 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f" status: 200 len: 1407 microversion: 2.20 time: 0.496023 Sep 24 21:08:23.341332 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2342/4689] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:08:22 2022] GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f => generated 1407 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:08:23.351512 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ad05f9b4-97bb-4b71-8c77-f14b2373dd89 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:23.356491 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ad05f9b4-97bb-4b71-8c77-f14b2373dd89 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:23.374814 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad05f9b4-97bb-4b71-8c77-f14b2373dd89 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:23.376515 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad05f9b4-97bb-4b71-8c77-f14b2373dd89 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:23.377986 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad05f9b4-97bb-4b71-8c77-f14b2373dd89 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:23.381765 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad05f9b4-97bb-4b71-8c77-f14b2373dd89 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:23.382457 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad05f9b4-97bb-4b71-8c77-f14b2373dd89 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:23.383120 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad05f9b4-97bb-4b71-8c77-f14b2373dd89 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:24.222008 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0e6ba85c-6983-45af-a502-6a25e15ddedd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:24.230543 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0e6ba85c-6983-45af-a502-6a25e15ddedd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1316 microversion: 2.1 time: 0.920515 Sep 24 21:08:24.243021 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2348/4690] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:23 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1316 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:24.251649 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6f3bda17-9f25-4e7b-8d95-950b425843b3 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:24.252465 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6f3bda17-9f25-4e7b-8d95-950b425843b3 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 89fb92e7-ef4c-4796-9797-2ed6faf2048c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:24.264492 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f3bda17-9f25-4e7b-8d95-950b425843b3 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:24.265366 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f3bda17-9f25-4e7b-8d95-950b425843b3 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:24.266028 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f3bda17-9f25-4e7b-8d95-950b425843b3 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:24.267167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f3bda17-9f25-4e7b-8d95-950b425843b3 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:24.267854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f3bda17-9f25-4e7b-8d95-950b425843b3 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:24.268496 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f3bda17-9f25-4e7b-8d95-950b425843b3 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:24.313700 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ad05f9b4-97bb-4b71-8c77-f14b2373dd89 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:24.328605 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ad05f9b4-97bb-4b71-8c77-f14b2373dd89 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.982782 Sep 24 21:08:24.329903 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2343/4691] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:23 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:24.358693 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-85b10f8e-e703-491e-b641-891c4ccf2a55 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:08:24.359875 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-85b10f8e-e703-491e-b641-891c4ccf2a55 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:24.366535 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-85b10f8e-e703-491e-b641-891c4ccf2a55 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:24.367156 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-85b10f8e-e703-491e-b641-891c4ccf2a55 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:24.367747 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-85b10f8e-e703-491e-b641-891c4ccf2a55 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:24.368659 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-85b10f8e-e703-491e-b641-891c4ccf2a55 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:24.369316 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-85b10f8e-e703-491e-b641-891c4ccf2a55 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:24.369843 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-85b10f8e-e703-491e-b641-891c4ccf2a55 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:24.408785 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-85b10f8e-e703-491e-b641-891c4ccf2a55 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lazy-loading 'flavor' on Instance uuid 0d546302-deb3-47c6-b9fd-3155ced00883 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:08:24.548468 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-85b10f8e-e703-491e-b641-891c4ccf2a55 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "POST /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/action" status: 202 len: 0 microversion: 2.1 time: 0.195071 Sep 24 21:08:24.555265 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2344/4692] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:08:24 2022] POST /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:08:24.564202 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-efcc72d1-df1d-45a1-8d63-0e42e1da52e5 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:24.565405 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-efcc72d1-df1d-45a1-8d63-0e42e1da52e5 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:24.576099 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6f3bda17-9f25-4e7b-8d95-950b425843b3 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:24.591887 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6f3bda17-9f25-4e7b-8d95-950b425843b3 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c" status: 200 len: 1505 microversion: 2.1 time: 0.347459 Sep 24 21:08:24.593097 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2349/4693] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:24 2022] GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c => generated 1505 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:24.602017 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-efcc72d1-df1d-45a1-8d63-0e42e1da52e5 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:24.602017 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-efcc72d1-df1d-45a1-8d63-0e42e1da52e5 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:24.602017 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-efcc72d1-df1d-45a1-8d63-0e42e1da52e5 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:24.602017 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-efcc72d1-df1d-45a1-8d63-0e42e1da52e5 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:24.602017 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-efcc72d1-df1d-45a1-8d63-0e42e1da52e5 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:24.602017 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-efcc72d1-df1d-45a1-8d63-0e42e1da52e5 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:24.609181 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e52c4b93-9757-486c-8844-6e17a5d7d4fe tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:24.610285 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e52c4b93-9757-486c-8844-6e17a5d7d4fe tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:24.619726 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e52c4b93-9757-486c-8844-6e17a5d7d4fe tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:24.620227 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e52c4b93-9757-486c-8844-6e17a5d7d4fe tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:24.620668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e52c4b93-9757-486c-8844-6e17a5d7d4fe tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:24.622704 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e52c4b93-9757-486c-8844-6e17a5d7d4fe tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:24.623915 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e52c4b93-9757-486c-8844-6e17a5d7d4fe tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:24.624877 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e52c4b93-9757-486c-8844-6e17a5d7d4fe tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:24.645845 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:08:24.922011 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-efcc72d1-df1d-45a1-8d63-0e42e1da52e5 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:24.928713 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e52c4b93-9757-486c-8844-6e17a5d7d4fe tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:24.931607 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-efcc72d1-df1d-45a1-8d63-0e42e1da52e5 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:24.933101 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-efcc72d1-df1d-45a1-8d63-0e42e1da52e5 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:24.934221 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-efcc72d1-df1d-45a1-8d63-0e42e1da52e5 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f" status: 200 len: 1407 microversion: 2.20 time: 0.376836 Sep 24 21:08:24.934838 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2345/4694] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:08:24 2022] GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f => generated 1407 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:08:24.944197 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e52c4b93-9757-486c-8844-6e17a5d7d4fe tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1676 microversion: 2.1 time: 0.340035 Sep 24 21:08:24.945101 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2350/4695] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:24 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1676 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:25.256274 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2b5bd9dc-0b07-4396-a1d9-b69e8e38e3f8 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:25.256974 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2b5bd9dc-0b07-4396-a1d9-b69e8e38e3f8 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:25.265584 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2b5bd9dc-0b07-4396-a1d9-b69e8e38e3f8 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:25.266096 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2b5bd9dc-0b07-4396-a1d9-b69e8e38e3f8 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:25.266559 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2b5bd9dc-0b07-4396-a1d9-b69e8e38e3f8 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:25.267285 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2b5bd9dc-0b07-4396-a1d9-b69e8e38e3f8 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:25.267737 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2b5bd9dc-0b07-4396-a1d9-b69e8e38e3f8 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:25.268437 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2b5bd9dc-0b07-4396-a1d9-b69e8e38e3f8 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:25.462524 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2b5bd9dc-0b07-4396-a1d9-b69e8e38e3f8 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:25.471443 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2b5bd9dc-0b07-4396-a1d9-b69e8e38e3f8 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1316 microversion: 2.1 time: 0.218862 Sep 24 21:08:25.474233 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2346/4696] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:25 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1316 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:25.616095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-da4d8c3a-2e7e-4314-85a7-4c429ded5b20 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:25.616712 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-da4d8c3a-2e7e-4314-85a7-4c429ded5b20 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 89fb92e7-ef4c-4796-9797-2ed6faf2048c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:25.624435 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-da4d8c3a-2e7e-4314-85a7-4c429ded5b20 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:25.624935 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-da4d8c3a-2e7e-4314-85a7-4c429ded5b20 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:25.625383 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-da4d8c3a-2e7e-4314-85a7-4c429ded5b20 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:25.626370 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-da4d8c3a-2e7e-4314-85a7-4c429ded5b20 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:25.626861 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-da4d8c3a-2e7e-4314-85a7-4c429ded5b20 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:25.627291 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-da4d8c3a-2e7e-4314-85a7-4c429ded5b20 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:25.817721 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-da4d8c3a-2e7e-4314-85a7-4c429ded5b20 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:25.829299 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-da4d8c3a-2e7e-4314-85a7-4c429ded5b20 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c" status: 200 len: 1505 microversion: 2.1 time: 0.216836 Sep 24 21:08:25.844435 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2351/4697] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:25 2022] GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c => generated 1505 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:25.965333 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e6fa6822-332c-4d6a-8644-d92537383e99 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:25.966140 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e6fa6822-332c-4d6a-8644-d92537383e99 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:25.971169 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b62dae21-c46d-463b-b7fd-fe772770ac48 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:25.971795 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b62dae21-c46d-463b-b7fd-fe772770ac48 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:25.975816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6fa6822-332c-4d6a-8644-d92537383e99 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:25.976600 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6fa6822-332c-4d6a-8644-d92537383e99 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:25.977406 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6fa6822-332c-4d6a-8644-d92537383e99 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:25.978707 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6fa6822-332c-4d6a-8644-d92537383e99 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:25.979658 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6fa6822-332c-4d6a-8644-d92537383e99 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:25.980474 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6fa6822-332c-4d6a-8644-d92537383e99 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:25.980585 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b62dae21-c46d-463b-b7fd-fe772770ac48 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:25.981137 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b62dae21-c46d-463b-b7fd-fe772770ac48 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:25.981588 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b62dae21-c46d-463b-b7fd-fe772770ac48 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:25.983113 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b62dae21-c46d-463b-b7fd-fe772770ac48 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:25.983699 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b62dae21-c46d-463b-b7fd-fe772770ac48 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:25.984128 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b62dae21-c46d-463b-b7fd-fe772770ac48 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:26.010320 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:08:26.221604 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b62dae21-c46d-463b-b7fd-fe772770ac48 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:26.228737 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e6fa6822-332c-4d6a-8644-d92537383e99 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:26.231658 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b62dae21-c46d-463b-b7fd-fe772770ac48 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1659 microversion: 2.1 time: 0.266922 Sep 24 21:08:26.232410 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2352/4698] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:25 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1659 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:26.243481 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e6fa6822-332c-4d6a-8644-d92537383e99 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:26.244931 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e6fa6822-332c-4d6a-8644-d92537383e99 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:26.246471 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e6fa6822-332c-4d6a-8644-d92537383e99 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f" status: 200 len: 1407 microversion: 2.20 time: 0.289925 Sep 24 21:08:26.247632 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2347/4699] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:08:25 2022] GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f => generated 1407 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:08:26.256897 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e7005791-71b1-4046-a371-3866bddddd04 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:08:26.257713 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e7005791-71b1-4046-a371-3866bddddd04 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:26.264543 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7005791-71b1-4046-a371-3866bddddd04 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:26.265347 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7005791-71b1-4046-a371-3866bddddd04 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:26.265797 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7005791-71b1-4046-a371-3866bddddd04 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:26.266578 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7005791-71b1-4046-a371-3866bddddd04 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:26.267050 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7005791-71b1-4046-a371-3866bddddd04 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:26.267487 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7005791-71b1-4046-a371-3866bddddd04 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:26.351577 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e7005791-71b1-4046-a371-3866bddddd04 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "POST /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/action" status: 202 len: 0 microversion: 2.1 time: 0.098470 Sep 24 21:08:26.352790 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2353/4700] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:08:26 2022] POST /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:08:26.361254 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e4f3dbd5-a58e-4156-88e3-b27eca2e606a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:26.362116 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e4f3dbd5-a58e-4156-88e3-b27eca2e606a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:26.369273 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e4f3dbd5-a58e-4156-88e3-b27eca2e606a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:26.369767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e4f3dbd5-a58e-4156-88e3-b27eca2e606a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:26.370462 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e4f3dbd5-a58e-4156-88e3-b27eca2e606a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:26.371305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e4f3dbd5-a58e-4156-88e3-b27eca2e606a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:26.371992 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e4f3dbd5-a58e-4156-88e3-b27eca2e606a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:26.372624 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e4f3dbd5-a58e-4156-88e3-b27eca2e606a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:26.502390 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d9e35c94-f5db-4dd1-928b-757fdb6a0364 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:26.504466 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d9e35c94-f5db-4dd1-928b-757fdb6a0364 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:26.515272 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d9e35c94-f5db-4dd1-928b-757fdb6a0364 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:26.518209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d9e35c94-f5db-4dd1-928b-757fdb6a0364 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:26.519078 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d9e35c94-f5db-4dd1-928b-757fdb6a0364 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:26.522114 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d9e35c94-f5db-4dd1-928b-757fdb6a0364 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:26.523020 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d9e35c94-f5db-4dd1-928b-757fdb6a0364 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:26.524972 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d9e35c94-f5db-4dd1-928b-757fdb6a0364 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:26.795139 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e4f3dbd5-a58e-4156-88e3-b27eca2e606a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:26.808521 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e4f3dbd5-a58e-4156-88e3-b27eca2e606a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1665 microversion: 2.1 time: 0.451709 Sep 24 21:08:26.826007 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2348/4701] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:26 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1665 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:08:26.860327 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-299ecc2a-196e-4ace-af9a-eef33a7cf847 req-1952546d-2334-4488-990c-6212b7f2e266 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f", "name": "network-vif-plugged", "status": "completed", "tag": "757d7845-8f16-4ea6-9591-83a6aeade3b6"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:08:26.881191 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-299ecc2a-196e-4ace-af9a-eef33a7cf847 req-1952546d-2334-4488-990c-6212b7f2e266 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:26.881954 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-299ecc2a-196e-4ace-af9a-eef33a7cf847 req-1952546d-2334-4488-990c-6212b7f2e266 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:26.883627 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-299ecc2a-196e-4ace-af9a-eef33a7cf847 req-1952546d-2334-4488-990c-6212b7f2e266 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:26.907360 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-299ecc2a-196e-4ace-af9a-eef33a7cf847 req-1952546d-2334-4488-990c-6212b7f2e266 service nova] Creating event network-vif-plugged:757d7845-8f16-4ea6-9591-83a6aeade3b6 for instance 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f on nch1-master-1 Sep 24 21:08:26.914097 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-299ecc2a-196e-4ace-af9a-eef33a7cf847 req-1952546d-2334-4488-990c-6212b7f2e266 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061936 Sep 24 21:08:26.914268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d9e35c94-f5db-4dd1-928b-757fdb6a0364 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:26.914803 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2349/4702] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:08:26.921720 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-313d9e49-d92f-4696-920c-154dde328a87 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:26.922693 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-313d9e49-d92f-4696-920c-154dde328a87 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 89fb92e7-ef4c-4796-9797-2ed6faf2048c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:26.927504 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d9e35c94-f5db-4dd1-928b-757fdb6a0364 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1316 microversion: 2.1 time: 0.429516 Sep 24 21:08:26.929998 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-313d9e49-d92f-4696-920c-154dde328a87 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:26.930153 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2354/4703] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:26 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1316 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:08:26.931143 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-313d9e49-d92f-4696-920c-154dde328a87 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:26.931784 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-313d9e49-d92f-4696-920c-154dde328a87 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:26.933296 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-313d9e49-d92f-4696-920c-154dde328a87 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:26.934118 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-313d9e49-d92f-4696-920c-154dde328a87 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:26.934839 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-313d9e49-d92f-4696-920c-154dde328a87 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:27.272828 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f113fb4a-41ed-4ef2-9faf-0ae814ee0a17 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:27.273739 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f113fb4a-41ed-4ef2-9faf-0ae814ee0a17 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:27.286879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f113fb4a-41ed-4ef2-9faf-0ae814ee0a17 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:27.287641 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f113fb4a-41ed-4ef2-9faf-0ae814ee0a17 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:27.288238 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f113fb4a-41ed-4ef2-9faf-0ae814ee0a17 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:27.289292 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f113fb4a-41ed-4ef2-9faf-0ae814ee0a17 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:27.292643 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f113fb4a-41ed-4ef2-9faf-0ae814ee0a17 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:27.293550 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f113fb4a-41ed-4ef2-9faf-0ae814ee0a17 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:27.474269 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-313d9e49-d92f-4696-920c-154dde328a87 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:27.489912 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-313d9e49-d92f-4696-920c-154dde328a87 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c" status: 200 len: 1505 microversion: 2.1 time: 0.573561 Sep 24 21:08:27.496830 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2350/4704] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:26 2022] GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c => generated 1505 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:27.594141 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f113fb4a-41ed-4ef2-9faf-0ae814ee0a17 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:27.605051 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f113fb4a-41ed-4ef2-9faf-0ae814ee0a17 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:27.606727 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f113fb4a-41ed-4ef2-9faf-0ae814ee0a17 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:27.608920 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f113fb4a-41ed-4ef2-9faf-0ae814ee0a17 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f" status: 200 len: 1407 microversion: 2.20 time: 0.339955 Sep 24 21:08:27.610074 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2355/4705] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:08:27 2022] GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f => generated 1407 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:08:27.957754 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-71921feb-25b2-4f31-9be4-af103f528188 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:27.958370 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-71921feb-25b2-4f31-9be4-af103f528188 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:27.966889 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71921feb-25b2-4f31-9be4-af103f528188 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:27.976009 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71921feb-25b2-4f31-9be4-af103f528188 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:27.977322 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71921feb-25b2-4f31-9be4-af103f528188 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:27.978401 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71921feb-25b2-4f31-9be4-af103f528188 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:27.980142 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71921feb-25b2-4f31-9be4-af103f528188 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:27.984973 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71921feb-25b2-4f31-9be4-af103f528188 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:28.239413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-63c9bfa7-4088-45d7-971f-1e7bfaf5525e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:28.240878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-63c9bfa7-4088-45d7-971f-1e7bfaf5525e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:28.254895 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-63c9bfa7-4088-45d7-971f-1e7bfaf5525e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:28.255718 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-63c9bfa7-4088-45d7-971f-1e7bfaf5525e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:28.256396 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-63c9bfa7-4088-45d7-971f-1e7bfaf5525e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:28.257299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-63c9bfa7-4088-45d7-971f-1e7bfaf5525e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:28.257942 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-63c9bfa7-4088-45d7-971f-1e7bfaf5525e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:28.258584 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-63c9bfa7-4088-45d7-971f-1e7bfaf5525e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:28.276070 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-71921feb-25b2-4f31-9be4-af103f528188 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:28.294622 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-71921feb-25b2-4f31-9be4-af103f528188 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1316 microversion: 2.1 time: 0.340778 Sep 24 21:08:28.300513 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2356/4706] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:27 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1316 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:08:28.475574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-63c9bfa7-4088-45d7-971f-1e7bfaf5525e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:28.485827 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-63c9bfa7-4088-45d7-971f-1e7bfaf5525e tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1665 microversion: 2.1 time: 0.652442 Sep 24 21:08:28.486987 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2351/4707] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:27 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1665 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:08:28.524691 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0bd325ab-49e8-4f5e-b15b-4d3dbc360079 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:28.525649 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0bd325ab-49e8-4f5e-b15b-4d3dbc360079 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 89fb92e7-ef4c-4796-9797-2ed6faf2048c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:28.533548 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:08:28.535836 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=12 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:08:28.537937 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0bd325ab-49e8-4f5e-b15b-4d3dbc360079 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:28.539013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0bd325ab-49e8-4f5e-b15b-4d3dbc360079 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:28.539655 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0bd325ab-49e8-4f5e-b15b-4d3dbc360079 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:28.540703 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0bd325ab-49e8-4f5e-b15b-4d3dbc360079 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:28.541465 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0bd325ab-49e8-4f5e-b15b-4d3dbc360079 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:28.542313 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0bd325ab-49e8-4f5e-b15b-4d3dbc360079 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:28.637849 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5f3d2822-d7bd-4391-849e-2c99b7864689 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:28.638559 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5f3d2822-d7bd-4391-849e-2c99b7864689 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:28.652536 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f3d2822-d7bd-4391-849e-2c99b7864689 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:28.654019 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f3d2822-d7bd-4391-849e-2c99b7864689 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:28.655710 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f3d2822-d7bd-4391-849e-2c99b7864689 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:28.656803 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f3d2822-d7bd-4391-849e-2c99b7864689 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:28.658197 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f3d2822-d7bd-4391-849e-2c99b7864689 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:28.661620 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f3d2822-d7bd-4391-849e-2c99b7864689 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:28.737789 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0bd325ab-49e8-4f5e-b15b-4d3dbc360079 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:28.747948 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0bd325ab-49e8-4f5e-b15b-4d3dbc360079 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c" status: 200 len: 1505 microversion: 2.1 time: 0.227155 Sep 24 21:08:28.759964 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2357/4708] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:28 2022] GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c => generated 1505 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:28.886859 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5f3d2822-d7bd-4391-849e-2c99b7864689 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:28.897957 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5f3d2822-d7bd-4391-849e-2c99b7864689 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:28.900733 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5f3d2822-d7bd-4391-849e-2c99b7864689 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:28.903590 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5f3d2822-d7bd-4391-849e-2c99b7864689 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f" status: 200 len: 1407 microversion: 2.20 time: 0.271158 Sep 24 21:08:28.904950 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2352/4709] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:08:28 2022] GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f => generated 1407 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:08:29.338852 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a454f5bb-6cac-4b8d-a2f7-6d37b1f6625a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:29.339642 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a454f5bb-6cac-4b8d-a2f7-6d37b1f6625a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:29.362208 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-6579f695-0591-4095-b141-1cd2a30610e2 req-f7a9cc9b-8f51-4b9b-9876-11c368e021ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3fcc34d-d09a-4475-bd96-51ac0074cb5f", "name": "network-vif-plugged", "status": "completed", "tag": "2ca29bee-7747-4b85-b335-ac8c4538a67e"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:08:29.389537 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-6579f695-0591-4095-b141-1cd2a30610e2 req-f7a9cc9b-8f51-4b9b-9876-11c368e021ae service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:29.391502 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-6579f695-0591-4095-b141-1cd2a30610e2 req-f7a9cc9b-8f51-4b9b-9876-11c368e021ae service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:29.392105 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a454f5bb-6cac-4b8d-a2f7-6d37b1f6625a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:29.392455 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-6579f695-0591-4095-b141-1cd2a30610e2 req-f7a9cc9b-8f51-4b9b-9876-11c368e021ae service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:29.395312 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a454f5bb-6cac-4b8d-a2f7-6d37b1f6625a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:29.395982 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a454f5bb-6cac-4b8d-a2f7-6d37b1f6625a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:29.397585 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a454f5bb-6cac-4b8d-a2f7-6d37b1f6625a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:29.398288 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a454f5bb-6cac-4b8d-a2f7-6d37b1f6625a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:29.399099 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a454f5bb-6cac-4b8d-a2f7-6d37b1f6625a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:29.440189 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-6579f695-0591-4095-b141-1cd2a30610e2 req-f7a9cc9b-8f51-4b9b-9876-11c368e021ae service nova] Creating event network-vif-plugged:2ca29bee-7747-4b85-b335-ac8c4538a67e for instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f on nch2-master-1 Sep 24 21:08:29.453375 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-6579f695-0591-4095-b141-1cd2a30610e2 req-f7a9cc9b-8f51-4b9b-9876-11c368e021ae service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097069 Sep 24 21:08:29.454304 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2353/4710] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:08:29.511712 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0705895c-51f9-4778-8df8-83812e04dd96 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:29.512593 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0705895c-51f9-4778-8df8-83812e04dd96 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:29.526088 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0705895c-51f9-4778-8df8-83812e04dd96 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:29.528185 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0705895c-51f9-4778-8df8-83812e04dd96 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:29.529067 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0705895c-51f9-4778-8df8-83812e04dd96 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:29.534223 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0705895c-51f9-4778-8df8-83812e04dd96 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:29.534992 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0705895c-51f9-4778-8df8-83812e04dd96 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:29.535444 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0705895c-51f9-4778-8df8-83812e04dd96 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:29.899688 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0705895c-51f9-4778-8df8-83812e04dd96 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:29.910365 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0705895c-51f9-4778-8df8-83812e04dd96 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1665 microversion: 2.1 time: 0.402771 Sep 24 21:08:29.911573 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2354/4711] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:29 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1665 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:29.924218 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fce0a4a9-c1e4-42f3-91e2-47f0e3334f33 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:29.925233 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fce0a4a9-c1e4-42f3-91e2-47f0e3334f33 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 89fb92e7-ef4c-4796-9797-2ed6faf2048c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:29.928864 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a454f5bb-6cac-4b8d-a2f7-6d37b1f6625a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:29.938898 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fce0a4a9-c1e4-42f3-91e2-47f0e3334f33 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:29.939477 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fce0a4a9-c1e4-42f3-91e2-47f0e3334f33 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:29.940050 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fce0a4a9-c1e4-42f3-91e2-47f0e3334f33 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:29.941186 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fce0a4a9-c1e4-42f3-91e2-47f0e3334f33 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:29.942242 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fce0a4a9-c1e4-42f3-91e2-47f0e3334f33 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:29.942992 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fce0a4a9-c1e4-42f3-91e2-47f0e3334f33 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:29.954389 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a454f5bb-6cac-4b8d-a2f7-6d37b1f6625a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1316 microversion: 2.1 time: 0.620444 Sep 24 21:08:29.956117 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2358/4712] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:29 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1316 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:29.974077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cce12cb4-5ed8-4144-8ae5-cc6fd140fcb8 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:29.975097 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cce12cb4-5ed8-4144-8ae5-cc6fd140fcb8 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:29.988157 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cce12cb4-5ed8-4144-8ae5-cc6fd140fcb8 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:29.990380 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cce12cb4-5ed8-4144-8ae5-cc6fd140fcb8 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:29.997436 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cce12cb4-5ed8-4144-8ae5-cc6fd140fcb8 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:30.004324 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cce12cb4-5ed8-4144-8ae5-cc6fd140fcb8 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:30.004890 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cce12cb4-5ed8-4144-8ae5-cc6fd140fcb8 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:30.005452 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cce12cb4-5ed8-4144-8ae5-cc6fd140fcb8 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:30.117922 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fce0a4a9-c1e4-42f3-91e2-47f0e3334f33 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:30.133799 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fce0a4a9-c1e4-42f3-91e2-47f0e3334f33 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c" status: 200 len: 1505 microversion: 2.1 time: 0.220306 Sep 24 21:08:30.135313 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2355/4713] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:29 2022] GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c => generated 1505 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:30.289241 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cce12cb4-5ed8-4144-8ae5-cc6fd140fcb8 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:30.300795 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cce12cb4-5ed8-4144-8ae5-cc6fd140fcb8 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:30.304073 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cce12cb4-5ed8-4144-8ae5-cc6fd140fcb8 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:30.305530 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cce12cb4-5ed8-4144-8ae5-cc6fd140fcb8 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f" status: 200 len: 1598 microversion: 2.20 time: 0.348205 Sep 24 21:08:30.306757 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2359/4714] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:08:29 2022] GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f => generated 1598 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:08:30.336735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f62f82c2-484c-4473-a616-5fde6f4615f9 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:30.337242 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f62f82c2-484c-4473-a616-5fde6f4615f9 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:30.358596 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f62f82c2-484c-4473-a616-5fde6f4615f9 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:30.359134 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f62f82c2-484c-4473-a616-5fde6f4615f9 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:30.360989 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f62f82c2-484c-4473-a616-5fde6f4615f9 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:30.361880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f62f82c2-484c-4473-a616-5fde6f4615f9 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:30.364673 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f62f82c2-484c-4473-a616-5fde6f4615f9 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:30.365210 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f62f82c2-484c-4473-a616-5fde6f4615f9 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:30.472286 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f62f82c2-484c-4473-a616-5fde6f4615f9 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.139730 Sep 24 21:08:30.473204 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2356/4715] 10.222.0.52 () {60 vars in 1316 bytes} [Sat Sep 24 21:08:30 2022] GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f/os-interface => generated 284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:08:30.942215 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-705d3d17-fde8-4868-b126-227f0b58d0b0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:30.942864 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-705d3d17-fde8-4868-b126-227f0b58d0b0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:30.949886 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-705d3d17-fde8-4868-b126-227f0b58d0b0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:30.950616 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-705d3d17-fde8-4868-b126-227f0b58d0b0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:30.951255 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-705d3d17-fde8-4868-b126-227f0b58d0b0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:30.952155 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-705d3d17-fde8-4868-b126-227f0b58d0b0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:30.952775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-705d3d17-fde8-4868-b126-227f0b58d0b0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:30.953363 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-705d3d17-fde8-4868-b126-227f0b58d0b0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:30.984491 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5962065d-d80d-4b0d-8917-a6383f73e36e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:30.985416 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5962065d-d80d-4b0d-8917-a6383f73e36e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:30.995060 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5962065d-d80d-4b0d-8917-a6383f73e36e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:30.995569 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5962065d-d80d-4b0d-8917-a6383f73e36e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:30.996021 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5962065d-d80d-4b0d-8917-a6383f73e36e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:30.996763 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5962065d-d80d-4b0d-8917-a6383f73e36e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:30.997223 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5962065d-d80d-4b0d-8917-a6383f73e36e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:30.997661 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5962065d-d80d-4b0d-8917-a6383f73e36e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:31.385431 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-705d3d17-fde8-4868-b126-227f0b58d0b0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:31.399961 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-705d3d17-fde8-4868-b126-227f0b58d0b0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.461435 Sep 24 21:08:31.400424 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5962065d-d80d-4b0d-8917-a6383f73e36e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:31.400880 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2360/4716] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:30 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:31.414979 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6ebabbe9-3b16-4a49-96ef-807b9b39b650 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:31.414979 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6ebabbe9-3b16-4a49-96ef-807b9b39b650 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 89fb92e7-ef4c-4796-9797-2ed6faf2048c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:31.425960 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ebabbe9-3b16-4a49-96ef-807b9b39b650 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:31.426470 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ebabbe9-3b16-4a49-96ef-807b9b39b650 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:31.426944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ebabbe9-3b16-4a49-96ef-807b9b39b650 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:31.427665 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ebabbe9-3b16-4a49-96ef-807b9b39b650 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:31.428133 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ebabbe9-3b16-4a49-96ef-807b9b39b650 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:31.428256 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5962065d-d80d-4b0d-8917-a6383f73e36e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1316 microversion: 2.1 time: 0.447392 Sep 24 21:08:31.428571 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ebabbe9-3b16-4a49-96ef-807b9b39b650 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:31.444954 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2357/4717] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:30 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1316 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:31.466048 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2fc5caa7-106e-4322-93f9-c0534b6c47ad tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:31.473951 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2fc5caa7-106e-4322-93f9-c0534b6c47ad tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:31.494804 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2fc5caa7-106e-4322-93f9-c0534b6c47ad tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:31.497541 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2fc5caa7-106e-4322-93f9-c0534b6c47ad tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:31.499011 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2fc5caa7-106e-4322-93f9-c0534b6c47ad tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:31.500089 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2fc5caa7-106e-4322-93f9-c0534b6c47ad tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:31.500853 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2fc5caa7-106e-4322-93f9-c0534b6c47ad tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:31.502240 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2fc5caa7-106e-4322-93f9-c0534b6c47ad tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:32.192832 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6ebabbe9-3b16-4a49-96ef-807b9b39b650 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:32.204463 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6ebabbe9-3b16-4a49-96ef-807b9b39b650 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c" status: 200 len: 1505 microversion: 2.1 time: 0.802819 Sep 24 21:08:32.220594 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2361/4718] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:31 2022] GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c => generated 1505 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:32.300617 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2fc5caa7-106e-4322-93f9-c0534b6c47ad tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:32.334918 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2fc5caa7-106e-4322-93f9-c0534b6c47ad tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1668 microversion: 2.1 time: 0.885659 Sep 24 21:08:32.338732 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2358/4719] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:31 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1668 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:32.367287 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8bcb3d44-1016-4f7f-9d0a-2b07cdf1c2c8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:32.367802 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8bcb3d44-1016-4f7f-9d0a-2b07cdf1c2c8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:32.377481 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8bcb3d44-1016-4f7f-9d0a-2b07cdf1c2c8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:32.378369 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8bcb3d44-1016-4f7f-9d0a-2b07cdf1c2c8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:32.379056 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8bcb3d44-1016-4f7f-9d0a-2b07cdf1c2c8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:32.380019 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8bcb3d44-1016-4f7f-9d0a-2b07cdf1c2c8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:32.380682 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8bcb3d44-1016-4f7f-9d0a-2b07cdf1c2c8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:32.381312 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8bcb3d44-1016-4f7f-9d0a-2b07cdf1c2c8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:32.416703 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8bcb3d44-1016-4f7f-9d0a-2b07cdf1c2c8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:08:32.424836 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.compute.api [None req-8bcb3d44-1016-4f7f-9d0a-2b07cdf1c2c8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Working on deleting snapshot df516826-acc7-4802-a1f3-d083d71405ba from shelved instance... Sep 24 21:08:32.452909 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bb66676a-c6e9-4280-ab21-234ee7a575c3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:32.453620 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-bb66676a-c6e9-4280-ab21-234ee7a575c3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:32.464963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb66676a-c6e9-4280-ab21-234ee7a575c3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:32.465559 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb66676a-c6e9-4280-ab21-234ee7a575c3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:32.468079 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb66676a-c6e9-4280-ab21-234ee7a575c3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:32.468966 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb66676a-c6e9-4280-ab21-234ee7a575c3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:32.469509 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb66676a-c6e9-4280-ab21-234ee7a575c3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:32.470845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bb66676a-c6e9-4280-ab21-234ee7a575c3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:32.970430 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-bb66676a-c6e9-4280-ab21-234ee7a575c3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:32.982807 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bb66676a-c6e9-4280-ab21-234ee7a575c3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.533860 Sep 24 21:08:32.984011 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2359/4720] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:32 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:08:33.214073 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-35bd54c7-223e-44d5-a4e3-f02c8a15f07d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-389034118", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "4cf0d4ca-4d29-4d04-b103-2ecdbbb3545f"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:08:33.315076 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-35bd54c7-223e-44d5-a4e3-f02c8a15f07d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] validate_networks() for [('4cf0d4ca-4d29-4d04-b103-2ecdbbb3545f', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:08:33.476394 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8bcb3d44-1016-4f7f-9d0a-2b07cdf1c2c8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Doing local delete in cell 788aecb6-32dc-4b71-909a-be050455aded(cell1) {{(pid=140517) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 24 21:08:33.481642 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8bcb3d44-1016-4f7f-9d0a-2b07cdf1c2c8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:33.483398 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8bcb3d44-1016-4f7f-9d0a-2b07cdf1c2c8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:33.486223 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8bcb3d44-1016-4f7f-9d0a-2b07cdf1c2c8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:33.489846 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.compute.api [None req-8bcb3d44-1016-4f7f-9d0a-2b07cdf1c2c8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 24 21:08:33.497777 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-8bcb3d44-1016-4f7f-9d0a-2b07cdf1c2c8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] deallocate_for_instance() {{(pid=140517) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 24 21:08:34.218747 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-35bd54c7-223e-44d5-a4e3-f02c8a15f07d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:08:34.219898 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-35bd54c7-223e-44d5-a4e3-f02c8a15f07d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:08:34.220599 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-35bd54c7-223e-44d5-a4e3-f02c8a15f07d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:08:34.221222 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-35bd54c7-223e-44d5-a4e3-f02c8a15f07d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:08:34.221862 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-35bd54c7-223e-44d5-a4e3-f02c8a15f07d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:08:34.239864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35bd54c7-223e-44d5-a4e3-f02c8a15f07d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:34.240626 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35bd54c7-223e-44d5-a4e3-f02c8a15f07d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:34.242687 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35bd54c7-223e-44d5-a4e3-f02c8a15f07d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:34.244462 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35bd54c7-223e-44d5-a4e3-f02c8a15f07d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:34.248908 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35bd54c7-223e-44d5-a4e3-f02c8a15f07d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:34.250065 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35bd54c7-223e-44d5-a4e3-f02c8a15f07d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:34.277946 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-35bd54c7-223e-44d5-a4e3-f02c8a15f07d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Getting quotas for project b170a25f4e4d44ba88fffcdc51d3fbbe. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:08:34.284836 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-35bd54c7-223e-44d5-a4e3-f02c8a15f07d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Getting quotas for user a22830d73cb043b8b9c2e070afa7af55 and project b170a25f4e4d44ba88fffcdc51d3fbbe. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:08:34.298173 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-35bd54c7-223e-44d5-a4e3-f02c8a15f07d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:08:34.301647 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-35bd54c7-223e-44d5-a4e3-f02c8a15f07d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: 23ed2980-eb42-4f9e-b65e-77a238d7b976] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:08:34.346313 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:08:34.369761 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-35bd54c7-223e-44d5-a4e3-f02c8a15f07d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.160498 Sep 24 21:08:34.371193 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2360/4721] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:08:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 24 21:08:34.393544 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-59eb6a45-7b6f-4032-9cc5-a8f7d9096324 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:34.395070 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-59eb6a45-7b6f-4032-9cc5-a8f7d9096324 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 89fb92e7-ef4c-4796-9797-2ed6faf2048c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:34.403698 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-59eb6a45-7b6f-4032-9cc5-a8f7d9096324 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:34.405407 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-59eb6a45-7b6f-4032-9cc5-a8f7d9096324 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:34.406357 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-59eb6a45-7b6f-4032-9cc5-a8f7d9096324 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:34.407774 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-59eb6a45-7b6f-4032-9cc5-a8f7d9096324 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:34.408447 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-59eb6a45-7b6f-4032-9cc5-a8f7d9096324 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:34.409081 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-59eb6a45-7b6f-4032-9cc5-a8f7d9096324 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:34.916599 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-8bcb3d44-1016-4f7f-9d0a-2b07cdf1c2c8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Updating instance_info_cache with network_info: [] {{(pid=140517) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 24 21:08:34.942384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-59eb6a45-7b6f-4032-9cc5-a8f7d9096324 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:34.984485 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-59eb6a45-7b6f-4032-9cc5-a8f7d9096324 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c" status: 200 len: 1485 microversion: 2.1 time: 0.611267 Sep 24 21:08:34.987405 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2361/4722] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:34 2022] GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c => generated 1485 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:35.007736 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-58c9c0b3-8068-4fcf-b8ee-ec5b1533fade req-09dc6bb3-0f42-418e-bb7e-ba163feb8f67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f", "tag": "757d7845-8f16-4ea6-9591-83a6aeade3b6"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:08:35.051995 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-58c9c0b3-8068-4fcf-b8ee-ec5b1533fade req-09dc6bb3-0f42-418e-bb7e-ba163feb8f67 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:35.052502 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-58c9c0b3-8068-4fcf-b8ee-ec5b1533fade req-09dc6bb3-0f42-418e-bb7e-ba163feb8f67 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:35.052949 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-58c9c0b3-8068-4fcf-b8ee-ec5b1533fade req-09dc6bb3-0f42-418e-bb7e-ba163feb8f67 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:35.113822 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-58c9c0b3-8068-4fcf-b8ee-ec5b1533fade req-09dc6bb3-0f42-418e-bb7e-ba163feb8f67 service nova] Creating event network-changed:757d7845-8f16-4ea6-9591-83a6aeade3b6 for instance 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f on nch1-master-1 Sep 24 21:08:35.138438 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-58c9c0b3-8068-4fcf-b8ee-ec5b1533fade req-09dc6bb3-0f42-418e-bb7e-ba163feb8f67 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148075 Sep 24 21:08:35.154393 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2362/4723] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:08:35.170190 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d4ee17c2-d647-4edb-a713-1576a8d6c2b1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:35.176207 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d4ee17c2-d647-4edb-a713-1576a8d6c2b1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: 23ed2980-eb42-4f9e-b65e-77a238d7b976] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:35.344215 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d4ee17c2-d647-4edb-a713-1576a8d6c2b1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:35.355577 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d4ee17c2-d647-4edb-a713-1576a8d6c2b1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976" status: 200 len: 1216 microversion: 2.1 time: 0.197041 Sep 24 21:08:35.357809 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2363/4724] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:35 2022] GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976 => generated 1216 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:35.421900 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:08:35.428220 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d7284b82-4f4b-442c-8aa0-305299de36b3 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-841454972", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:08:35.560552 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-d7284b82-4f4b-442c-8aa0-305299de36b3 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] validate_networks() for [('67500988-9ebb-4c72-92f3-b6a92bf3ea65', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:08:35.674747 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8bcb3d44-1016-4f7f-9d0a-2b07cdf1c2c8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "DELETE /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9" status: 204 len: 0 microversion: 2.1 time: 3.311724 Sep 24 21:08:35.675916 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2362/4725] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:08:32 2022] DELETE /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 => generated 0 bytes in 3313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:08:35.684055 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d4387974-f0ef-4a67-ae27-72be503d994d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:35.684673 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d4387974-f0ef-4a67-ae27-72be503d994d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: dda4c066-f7bb-45df-9e57-b0e2d23fd7b9] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:35.692515 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d4387974-f0ef-4a67-ae27-72be503d994d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:35.693466 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d4387974-f0ef-4a67-ae27-72be503d994d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:35.694088 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d4387974-f0ef-4a67-ae27-72be503d994d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:35.695137 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d4387974-f0ef-4a67-ae27-72be503d994d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:35.695794 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d4387974-f0ef-4a67-ae27-72be503d994d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:35.696415 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d4387974-f0ef-4a67-ae27-72be503d994d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:35.739842 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-d4387974-f0ef-4a67-ae27-72be503d994d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] HTTP exception thrown: Instance dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 could not be found. Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d4387974-f0ef-4a67-ae27-72be503d994d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Request method failure captured: Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 HTTP/1.1 Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL29yHrVYRYwVIMWo2FFW4S-9sOLnTcN4ZPz2bIXXtjP3hR_rvMAsvdLWM0kalFDPOwMk_M10lFN-gbxnQwiJu4TSxB4ycd3rCGdKr5Nw8GDIx9wcghUlARhBCrxFGL7o-GhjN7quWX5q6oNDb9ZRd-9sEHZ12a6ieFkQm4pZttrgvsw Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: c1e5d6f3d41e4aa49e630f8c7ac87ded Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServerActionsTestJSON-1880156492 Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c1e5d6f3d41e4aa49e630f8c7ac87ded"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c1e5d6f3d41e4aa49e630f8c7ac87ded"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c1e5d6f3d41e4aa49e630f8c7ac87ded"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c1e5d6f3d41e4aa49e630f8c7ac87ded"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServerActionsTestJSON-1880156492 Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: c1e5d6f3d41e4aa49e630f8c7ac87ded Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServerActionsTestJSON-1880156492 Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServerActionsTestJSON-1880156492-project Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 6493da825aa24f43bdf8f0835a16e3bb Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServerActionsTestJSON-1880156492-project Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 could not be found. Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'dda4c066-f7bb-45df-9e57-b0e2d23fd7b9'} Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 could not be found. Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 could not be found. Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:08:35.742921 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:08:35.746737 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:08:35.746737 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:08:35.746737 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:08:35.746737 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:08:35.746737 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:08:35.746737 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 could not be found. Sep 24 21:08:35.746737 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:08:35.748697 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d4387974-f0ef-4a67-ae27-72be503d994d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Returning 404 to user: Instance dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:08:35.750979 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d4387974-f0ef-4a67-ae27-72be503d994d tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9" status: 404 len: 111 microversion: 2.1 time: 0.070871 Sep 24 21:08:35.752433 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2363/4726] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:35 2022] GET /compute/v2.1/servers/dda4c066-f7bb-45df-9e57-b0e2d23fd7b9 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 21:08:35.776260 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-958a98d0-b3aa-4950-b03b-4bcca99d64a7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:35.777792 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-958a98d0-b3aa-4950-b03b-4bcca99d64a7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 51c91704-c6eb-47bf-b3d1-9899df6ce119] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:35.801614 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-958a98d0-b3aa-4950-b03b-4bcca99d64a7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:35.804130 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-958a98d0-b3aa-4950-b03b-4bcca99d64a7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:35.806379 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-958a98d0-b3aa-4950-b03b-4bcca99d64a7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:35.808100 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-958a98d0-b3aa-4950-b03b-4bcca99d64a7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:35.818845 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-958a98d0-b3aa-4950-b03b-4bcca99d64a7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:35.820164 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-958a98d0-b3aa-4950-b03b-4bcca99d64a7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:35.875715 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-958a98d0-b3aa-4950-b03b-4bcca99d64a7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 51c91704-c6eb-47bf-b3d1-9899df6ce119] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:08:36.103852 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-958a98d0-b3aa-4950-b03b-4bcca99d64a7 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "DELETE /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119" status: 204 len: 0 microversion: 2.1 time: 0.345485 Sep 24 21:08:36.110446 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2364/4727] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:08:35 2022] DELETE /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 24 21:08:36.129961 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b28cf7d8-012f-478a-94d7-7676fed8f307 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:36.131022 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b28cf7d8-012f-478a-94d7-7676fed8f307 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 51c91704-c6eb-47bf-b3d1-9899df6ce119] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:36.140047 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b28cf7d8-012f-478a-94d7-7676fed8f307 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:36.140999 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b28cf7d8-012f-478a-94d7-7676fed8f307 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:36.142262 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b28cf7d8-012f-478a-94d7-7676fed8f307 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:36.143822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b28cf7d8-012f-478a-94d7-7676fed8f307 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:36.144511 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b28cf7d8-012f-478a-94d7-7676fed8f307 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:36.145457 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b28cf7d8-012f-478a-94d7-7676fed8f307 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:36.470477 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b28cf7d8-012f-478a-94d7-7676fed8f307 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:36.488018 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b28cf7d8-012f-478a-94d7-7676fed8f307 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119" status: 200 len: 1467 microversion: 2.1 time: 0.373104 Sep 24 21:08:36.514004 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2365/4728] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:36 2022] GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119 => generated 1467 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:36.519600 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e9304883-4fa1-44ee-b421-599b856e2ef3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:36.525567 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e9304883-4fa1-44ee-b421-599b856e2ef3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: 23ed2980-eb42-4f9e-b65e-77a238d7b976] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:36.537412 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9304883-4fa1-44ee-b421-599b856e2ef3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:36.538167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9304883-4fa1-44ee-b421-599b856e2ef3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:36.538913 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9304883-4fa1-44ee-b421-599b856e2ef3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:36.539826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9304883-4fa1-44ee-b421-599b856e2ef3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:36.540443 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9304883-4fa1-44ee-b421-599b856e2ef3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:36.541096 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9304883-4fa1-44ee-b421-599b856e2ef3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:36.668829 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e9304883-4fa1-44ee-b421-599b856e2ef3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:36.680917 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e9304883-4fa1-44ee-b421-599b856e2ef3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976" status: 200 len: 1268 microversion: 2.1 time: 0.164492 Sep 24 21:08:36.682577 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2366/4729] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:36 2022] GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976 => generated 1268 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:37.035435 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-d7284b82-4f4b-442c-8aa0-305299de36b3 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:08:37.036367 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-d7284b82-4f4b-442c-8aa0-305299de36b3 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:08:37.037637 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-d7284b82-4f4b-442c-8aa0-305299de36b3 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:08:37.039124 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-d7284b82-4f4b-442c-8aa0-305299de36b3 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:08:37.040062 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-d7284b82-4f4b-442c-8aa0-305299de36b3 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:08:37.065228 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7284b82-4f4b-442c-8aa0-305299de36b3 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:37.067399 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7284b82-4f4b-442c-8aa0-305299de36b3 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:37.068384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7284b82-4f4b-442c-8aa0-305299de36b3 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:37.069585 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7284b82-4f4b-442c-8aa0-305299de36b3 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:37.070717 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7284b82-4f4b-442c-8aa0-305299de36b3 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:37.071313 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7284b82-4f4b-442c-8aa0-305299de36b3 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:37.110992 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-d7284b82-4f4b-442c-8aa0-305299de36b3 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Getting quotas for project 8428ee98cbdc457192d9889bf10d1036. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:08:37.119733 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-d7284b82-4f4b-442c-8aa0-305299de36b3 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Getting quotas for user fdbd9a2294414c0e932ef46d11f8e4b6 and project 8428ee98cbdc457192d9889bf10d1036. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:08:37.140977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d7284b82-4f4b-442c-8aa0-305299de36b3 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:08:37.146649 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d7284b82-4f4b-442c-8aa0-305299de36b3 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:08:37.202162 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-cb28c2cb-f52b-4018-bc75-369e992f44ed req-816d75a1-c7bd-4ff0-a6c4-ace87e1d6986 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dda4c066-f7bb-45df-9e57-b0e2d23fd7b9", "name": "network-vif-deleted", "tag": "760158dc-6fec-418e-aae5-f938ec813cb9"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:08:37.224370 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-cb28c2cb-f52b-4018-bc75-369e992f44ed req-816d75a1-c7bd-4ff0-a6c4-ace87e1d6986 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:37.227168 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-cb28c2cb-f52b-4018-bc75-369e992f44ed req-816d75a1-c7bd-4ff0-a6c4-ace87e1d6986 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:37.227734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-cb28c2cb-f52b-4018-bc75-369e992f44ed req-816d75a1-c7bd-4ff0-a6c4-ace87e1d6986 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:37.245750 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d7284b82-4f4b-442c-8aa0-305299de36b3 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.822370 Sep 24 21:08:37.257612 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2364/4730] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:08:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 1833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:08:37.286905 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fae64312-5715-4b14-9840-1662900dafec tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:37.287805 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fae64312-5715-4b14-9840-1662900dafec tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:37.306103 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.compute.server_external_events [req-cb28c2cb-f52b-4018-bc75-369e992f44ed req-816d75a1-c7bd-4ff0-a6c4-ace87e1d6986 service nova] Unable to find a host for instance dda4c066-f7bb-45df-9e57-b0e2d23fd7b9. Dropping event network-vif-deleted {{(pid=140517) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 24 21:08:37.315233 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-cb28c2cb-f52b-4018-bc75-369e992f44ed req-816d75a1-c7bd-4ff0-a6c4-ace87e1d6986 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.109134 Sep 24 21:08:37.316760 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2367/4731] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 119 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 24 21:08:37.483323 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fae64312-5715-4b14-9840-1662900dafec tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:37.494065 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fae64312-5715-4b14-9840-1662900dafec tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1213 microversion: 2.1 time: 0.233966 Sep 24 21:08:37.496813 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2365/4732] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:37 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1213 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:37.514003 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f71b8568-262c-4157-a258-398cebb6a7d8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:37.514711 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f71b8568-262c-4157-a258-398cebb6a7d8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 51c91704-c6eb-47bf-b3d1-9899df6ce119] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:37.527937 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f71b8568-262c-4157-a258-398cebb6a7d8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:37.528383 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f71b8568-262c-4157-a258-398cebb6a7d8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:37.530056 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f71b8568-262c-4157-a258-398cebb6a7d8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:37.532518 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f71b8568-262c-4157-a258-398cebb6a7d8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:37.534169 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f71b8568-262c-4157-a258-398cebb6a7d8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:37.535231 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f71b8568-262c-4157-a258-398cebb6a7d8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:37.707988 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fd093b23-90a7-4c47-ae21-d847afd311f2 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:37.708786 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fd093b23-90a7-4c47-ae21-d847afd311f2 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: 23ed2980-eb42-4f9e-b65e-77a238d7b976] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:37.718685 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fd093b23-90a7-4c47-ae21-d847afd311f2 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:37.718920 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fd093b23-90a7-4c47-ae21-d847afd311f2 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:37.735933 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fd093b23-90a7-4c47-ae21-d847afd311f2 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:37.737122 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fd093b23-90a7-4c47-ae21-d847afd311f2 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:37.737619 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fd093b23-90a7-4c47-ae21-d847afd311f2 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:37.738063 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fd093b23-90a7-4c47-ae21-d847afd311f2 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:38.178456 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f71b8568-262c-4157-a258-398cebb6a7d8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:38.187465 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f71b8568-262c-4157-a258-398cebb6a7d8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119" status: 200 len: 1467 microversion: 2.1 time: 0.679611 Sep 24 21:08:38.188059 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2368/4733] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:37 2022] GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119 => generated 1467 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:38.214765 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fd093b23-90a7-4c47-ae21-d847afd311f2 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:38.224122 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fd093b23-90a7-4c47-ae21-d847afd311f2 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976" status: 200 len: 1268 microversion: 2.1 time: 0.520183 Sep 24 21:08:38.235943 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2366/4734] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:37 2022] GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976 => generated 1268 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:38.524715 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6f23eb99-31f6-4ad3-bd53-83234af33f38 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:38.526171 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6f23eb99-31f6-4ad3-bd53-83234af33f38 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:38.539230 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f23eb99-31f6-4ad3-bd53-83234af33f38 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:38.540506 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f23eb99-31f6-4ad3-bd53-83234af33f38 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:38.542757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f23eb99-31f6-4ad3-bd53-83234af33f38 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:38.545648 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f23eb99-31f6-4ad3-bd53-83234af33f38 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:38.547335 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f23eb99-31f6-4ad3-bd53-83234af33f38 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:38.548101 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f23eb99-31f6-4ad3-bd53-83234af33f38 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:39.124068 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6f23eb99-31f6-4ad3-bd53-83234af33f38 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:39.141209 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6f23eb99-31f6-4ad3-bd53-83234af33f38 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1265 microversion: 2.1 time: 0.620530 Sep 24 21:08:39.142594 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2369/4735] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:38 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1265 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:39.232968 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b0807c14-d0d1-4067-b02e-450ae6227047 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:39.234252 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b0807c14-d0d1-4067-b02e-450ae6227047 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 51c91704-c6eb-47bf-b3d1-9899df6ce119] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:39.245998 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0807c14-d0d1-4067-b02e-450ae6227047 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:39.246864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0807c14-d0d1-4067-b02e-450ae6227047 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:39.251193 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0807c14-d0d1-4067-b02e-450ae6227047 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:39.252823 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0807c14-d0d1-4067-b02e-450ae6227047 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:39.253494 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0807c14-d0d1-4067-b02e-450ae6227047 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:39.254114 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0807c14-d0d1-4067-b02e-450ae6227047 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:39.259368 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c8da0fb4-ce9a-4481-938b-66e77dcf93cd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:39.259996 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c8da0fb4-ce9a-4481-938b-66e77dcf93cd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: 23ed2980-eb42-4f9e-b65e-77a238d7b976] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:39.281060 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c8da0fb4-ce9a-4481-938b-66e77dcf93cd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:39.281568 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c8da0fb4-ce9a-4481-938b-66e77dcf93cd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:39.282559 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c8da0fb4-ce9a-4481-938b-66e77dcf93cd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:39.284201 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c8da0fb4-ce9a-4481-938b-66e77dcf93cd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:39.284693 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c8da0fb4-ce9a-4481-938b-66e77dcf93cd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:39.285170 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c8da0fb4-ce9a-4481-938b-66e77dcf93cd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:39.690223 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b0807c14-d0d1-4067-b02e-450ae6227047 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:39.698946 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b0807c14-d0d1-4067-b02e-450ae6227047 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119" status: 200 len: 1467 microversion: 2.1 time: 0.470078 Sep 24 21:08:39.714892 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2367/4736] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:39 2022] GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119 => generated 1467 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:39.976913 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c8da0fb4-ce9a-4481-938b-66e77dcf93cd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:39.986055 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c8da0fb4-ce9a-4481-938b-66e77dcf93cd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976" status: 200 len: 1316 microversion: 2.1 time: 0.730403 Sep 24 21:08:39.986689 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2370/4737] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:39 2022] GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976 => generated 1316 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:08:40.165930 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1ea4fd07-5c29-4309-9306-da9186dcd5c2 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:40.166603 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1ea4fd07-5c29-4309-9306-da9186dcd5c2 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:40.174300 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1ea4fd07-5c29-4309-9306-da9186dcd5c2 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:40.174836 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1ea4fd07-5c29-4309-9306-da9186dcd5c2 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:40.179226 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1ea4fd07-5c29-4309-9306-da9186dcd5c2 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:40.187164 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1ea4fd07-5c29-4309-9306-da9186dcd5c2 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:40.188317 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1ea4fd07-5c29-4309-9306-da9186dcd5c2 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:40.188942 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1ea4fd07-5c29-4309-9306-da9186dcd5c2 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:40.308488 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-64fa1b89-5d4a-45f1-927a-03774db15e98 req-740d42b5-3d63-4cdc-8d20-bc99170b7d88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51c91704-c6eb-47bf-b3d1-9899df6ce119", "name": "network-vif-deleted", "tag": "cb689b35-55b9-4a33-8d15-19ff8d5cc56b"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:08:40.334596 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-64fa1b89-5d4a-45f1-927a-03774db15e98 req-740d42b5-3d63-4cdc-8d20-bc99170b7d88 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:40.335368 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-64fa1b89-5d4a-45f1-927a-03774db15e98 req-740d42b5-3d63-4cdc-8d20-bc99170b7d88 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:40.335975 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-64fa1b89-5d4a-45f1-927a-03774db15e98 req-740d42b5-3d63-4cdc-8d20-bc99170b7d88 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:40.342642 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1ea4fd07-5c29-4309-9306-da9186dcd5c2 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:40.352605 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1ea4fd07-5c29-4309-9306-da9186dcd5c2 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1271 microversion: 2.1 time: 0.191120 Sep 24 21:08:40.365532 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2368/4738] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:40 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1271 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:40.371542 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-64fa1b89-5d4a-45f1-927a-03774db15e98 req-740d42b5-3d63-4cdc-8d20-bc99170b7d88 service nova] Creating event network-vif-deleted:cb689b35-55b9-4a33-8d15-19ff8d5cc56b for instance 51c91704-c6eb-47bf-b3d1-9899df6ce119 on nch1-master-1 Sep 24 21:08:40.385397 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-64fa1b89-5d4a-45f1-927a-03774db15e98 req-740d42b5-3d63-4cdc-8d20-bc99170b7d88 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080561 Sep 24 21:08:40.386342 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2371/4739] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:08:40.729009 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-22e4ee07-2cf2-4e1d-a07d-30a78beb92fb tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:40.729897 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-22e4ee07-2cf2-4e1d-a07d-30a78beb92fb tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 51c91704-c6eb-47bf-b3d1-9899df6ce119] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:40.740543 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22e4ee07-2cf2-4e1d-a07d-30a78beb92fb tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:40.754384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22e4ee07-2cf2-4e1d-a07d-30a78beb92fb tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:40.755200 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22e4ee07-2cf2-4e1d-a07d-30a78beb92fb tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:40.757841 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22e4ee07-2cf2-4e1d-a07d-30a78beb92fb tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:40.758804 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22e4ee07-2cf2-4e1d-a07d-30a78beb92fb tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:40.760137 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22e4ee07-2cf2-4e1d-a07d-30a78beb92fb tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:40.814990 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:08:40.856517 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22e4ee07-2cf2-4e1d-a07d-30a78beb92fb tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:40.857700 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22e4ee07-2cf2-4e1d-a07d-30a78beb92fb tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:40.858704 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-22e4ee07-2cf2-4e1d-a07d-30a78beb92fb tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:40.859414 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-22e4ee07-2cf2-4e1d-a07d-30a78beb92fb tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lazy-loading 'fault' on Instance uuid 51c91704-c6eb-47bf-b3d1-9899df6ce119 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:08:40.907486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-22e4ee07-2cf2-4e1d-a07d-30a78beb92fb tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:40.916729 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-22e4ee07-2cf2-4e1d-a07d-30a78beb92fb tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119" status: 200 len: 1305 microversion: 2.1 time: 0.191462 Sep 24 21:08:40.922650 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2369/4740] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:40 2022] GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119 => generated 1305 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:41.014350 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f8b87878-2ab7-487f-8c9c-d337627ea0f6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:41.015148 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f8b87878-2ab7-487f-8c9c-d337627ea0f6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: 23ed2980-eb42-4f9e-b65e-77a238d7b976] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:41.021740 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8b87878-2ab7-487f-8c9c-d337627ea0f6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:41.022239 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8b87878-2ab7-487f-8c9c-d337627ea0f6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:41.022723 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8b87878-2ab7-487f-8c9c-d337627ea0f6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:41.023638 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8b87878-2ab7-487f-8c9c-d337627ea0f6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:41.024105 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8b87878-2ab7-487f-8c9c-d337627ea0f6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:41.024542 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f8b87878-2ab7-487f-8c9c-d337627ea0f6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:41.330734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f8b87878-2ab7-487f-8c9c-d337627ea0f6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:41.350938 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f8b87878-2ab7-487f-8c9c-d337627ea0f6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976" status: 200 len: 1316 microversion: 2.1 time: 0.342436 Sep 24 21:08:41.352505 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2372/4741] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:41 2022] GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976 => generated 1316 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:41.392178 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-40d91eb6-326b-4e03-9e05-f0aa874b924b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:41.393556 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-40d91eb6-326b-4e03-9e05-f0aa874b924b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:41.403904 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40d91eb6-326b-4e03-9e05-f0aa874b924b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:41.404954 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40d91eb6-326b-4e03-9e05-f0aa874b924b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:41.405550 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40d91eb6-326b-4e03-9e05-f0aa874b924b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:41.406423 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40d91eb6-326b-4e03-9e05-f0aa874b924b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:41.407483 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40d91eb6-326b-4e03-9e05-f0aa874b924b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:41.408095 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40d91eb6-326b-4e03-9e05-f0aa874b924b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:41.693667 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-40d91eb6-326b-4e03-9e05-f0aa874b924b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:41.719882 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-40d91eb6-326b-4e03-9e05-f0aa874b924b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1271 microversion: 2.1 time: 0.334249 Sep 24 21:08:41.720514 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2370/4742] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:41 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1271 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:41.942118 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8d7c0433-5b7d-4f6e-91e6-0476f5c4df2a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:41.943194 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8d7c0433-5b7d-4f6e-91e6-0476f5c4df2a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 51c91704-c6eb-47bf-b3d1-9899df6ce119] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:41.951777 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8d7c0433-5b7d-4f6e-91e6-0476f5c4df2a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:41.952635 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8d7c0433-5b7d-4f6e-91e6-0476f5c4df2a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:41.953360 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8d7c0433-5b7d-4f6e-91e6-0476f5c4df2a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:41.954458 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8d7c0433-5b7d-4f6e-91e6-0476f5c4df2a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:41.955140 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8d7c0433-5b7d-4f6e-91e6-0476f5c4df2a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:41.960320 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8d7c0433-5b7d-4f6e-91e6-0476f5c4df2a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:41.979449 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-8d7c0433-5b7d-4f6e-91e6-0476f5c4df2a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] HTTP exception thrown: Instance 51c91704-c6eb-47bf-b3d1-9899df6ce119 could not be found. Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8d7c0433-5b7d-4f6e-91e6-0476f5c4df2a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Request method failure captured: Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119 HTTP/1.1 Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL29yHrVYRYwVIMWo2FFW4S-9sOLnTcN4ZPz2bIXXtjP3hR_rvMAsvdLWM0kalFDPOwMk_M10lFN-gbxnQwiJu4TSxB4ycd3rCGdKr5Nw8GDIx9wcghUlARhBCrxFGL7o-GhjN7quWX5q6oNDb9ZRd-9sEHZ12a6ieFkQm4pZttrgvsw Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: c1e5d6f3d41e4aa49e630f8c7ac87ded Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServerActionsTestJSON-1880156492 Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c1e5d6f3d41e4aa49e630f8c7ac87ded"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c1e5d6f3d41e4aa49e630f8c7ac87ded"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c1e5d6f3d41e4aa49e630f8c7ac87ded"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c1e5d6f3d41e4aa49e630f8c7ac87ded"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServerActionsTestJSON-1880156492 Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: c1e5d6f3d41e4aa49e630f8c7ac87ded Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServerActionsTestJSON-1880156492 Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServerActionsTestJSON-1880156492-project Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 6493da825aa24f43bdf8f0835a16e3bb Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServerActionsTestJSON-1880156492-project Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 51c91704-c6eb-47bf-b3d1-9899df6ce119 could not be found. Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '51c91704-c6eb-47bf-b3d1-9899df6ce119'} Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51c91704-c6eb-47bf-b3d1-9899df6ce119 could not be found. Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51c91704-c6eb-47bf-b3d1-9899df6ce119 could not be found. Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:08:41.981302 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:08:41.985790 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:08:41.985790 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:08:41.985790 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:08:41.985790 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:08:41.985790 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:08:41.985790 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51c91704-c6eb-47bf-b3d1-9899df6ce119 could not be found. Sep 24 21:08:41.985790 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:08:41.992302 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8d7c0433-5b7d-4f6e-91e6-0476f5c4df2a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Returning 404 to user: Instance 51c91704-c6eb-47bf-b3d1-9899df6ce119 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:08:41.993752 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8d7c0433-5b7d-4f6e-91e6-0476f5c4df2a tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119" status: 404 len: 111 microversion: 2.1 time: 0.055756 Sep 24 21:08:41.994889 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2373/4743] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:41 2022] GET /compute/v2.1/servers/51c91704-c6eb-47bf-b3d1-9899df6ce119 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:08:42.003468 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-077252d0-2a2e-4ce1-910f-c77e394d5498 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:42.003977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-077252d0-2a2e-4ce1-910f-c77e394d5498 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 40178212-5f30-4d39-80a4-b92306531580] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:42.010836 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-077252d0-2a2e-4ce1-910f-c77e394d5498 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:42.011347 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-077252d0-2a2e-4ce1-910f-c77e394d5498 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:42.011775 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-077252d0-2a2e-4ce1-910f-c77e394d5498 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:42.012486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-077252d0-2a2e-4ce1-910f-c77e394d5498 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:42.012973 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-077252d0-2a2e-4ce1-910f-c77e394d5498 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:42.013713 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-077252d0-2a2e-4ce1-910f-c77e394d5498 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:42.050263 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-077252d0-2a2e-4ce1-910f-c77e394d5498 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 40178212-5f30-4d39-80a4-b92306531580] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:08:42.184010 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-077252d0-2a2e-4ce1-910f-c77e394d5498 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "DELETE /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580" status: 204 len: 0 microversion: 2.1 time: 0.184032 Sep 24 21:08:42.188327 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2371/4744] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:08:41 2022] DELETE /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 24 21:08:42.194388 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ecd31fc1-92d6-4601-b686-3f0369e187be tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:42.195317 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ecd31fc1-92d6-4601-b686-3f0369e187be tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 40178212-5f30-4d39-80a4-b92306531580] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:42.208884 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ecd31fc1-92d6-4601-b686-3f0369e187be tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:42.209390 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ecd31fc1-92d6-4601-b686-3f0369e187be tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:42.209839 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ecd31fc1-92d6-4601-b686-3f0369e187be tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:42.210591 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ecd31fc1-92d6-4601-b686-3f0369e187be tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:42.211256 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ecd31fc1-92d6-4601-b686-3f0369e187be tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:42.211757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ecd31fc1-92d6-4601-b686-3f0369e187be tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:42.378942 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3052c075-ac53-4cd4-ac82-319984b3caa7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:42.379872 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3052c075-ac53-4cd4-ac82-319984b3caa7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: 23ed2980-eb42-4f9e-b65e-77a238d7b976] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:42.389727 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3052c075-ac53-4cd4-ac82-319984b3caa7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:42.394469 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3052c075-ac53-4cd4-ac82-319984b3caa7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:42.395577 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3052c075-ac53-4cd4-ac82-319984b3caa7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:42.397426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3052c075-ac53-4cd4-ac82-319984b3caa7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:42.398429 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3052c075-ac53-4cd4-ac82-319984b3caa7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:42.399914 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3052c075-ac53-4cd4-ac82-319984b3caa7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:42.439858 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ecd31fc1-92d6-4601-b686-3f0369e187be tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:42.464740 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ecd31fc1-92d6-4601-b686-3f0369e187be tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580" status: 200 len: 1509 microversion: 2.1 time: 0.275253 Sep 24 21:08:42.468827 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2374/4745] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:42 2022] GET /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580 => generated 1509 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:42.737002 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3052c075-ac53-4cd4-ac82-319984b3caa7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:42.745639 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d1a2a2d3-a5e7-4ef7-b2a0-b62a96e42437 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:42.747296 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d1a2a2d3-a5e7-4ef7-b2a0-b62a96e42437 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:42.754647 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3052c075-ac53-4cd4-ac82-319984b3caa7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976" status: 200 len: 1316 microversion: 2.1 time: 0.383636 Sep 24 21:08:42.755722 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2372/4746] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:42 2022] GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976 => generated 1316 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:42.759902 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1a2a2d3-a5e7-4ef7-b2a0-b62a96e42437 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:42.760544 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1a2a2d3-a5e7-4ef7-b2a0-b62a96e42437 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:42.762188 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1a2a2d3-a5e7-4ef7-b2a0-b62a96e42437 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:42.765417 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1a2a2d3-a5e7-4ef7-b2a0-b62a96e42437 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:42.766147 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1a2a2d3-a5e7-4ef7-b2a0-b62a96e42437 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:42.766759 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1a2a2d3-a5e7-4ef7-b2a0-b62a96e42437 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:42.994398 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d1a2a2d3-a5e7-4ef7-b2a0-b62a96e42437 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:43.004046 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d1a2a2d3-a5e7-4ef7-b2a0-b62a96e42437 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1313 microversion: 2.1 time: 0.262852 Sep 24 21:08:43.005008 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2375/4747] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:42 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:43.452363 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-51651f90-ddd5-493b-b0d3-4a629eb73617 req-fd691bc4-3e09-4d23-81b7-a069fd3e9e6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23ed2980-eb42-4f9e-b65e-77a238d7b976", "tag": "e5570b41-f756-4b4f-ade6-798afcf06c62"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:08:43.469727 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-51651f90-ddd5-493b-b0d3-4a629eb73617 req-fd691bc4-3e09-4d23-81b7-a069fd3e9e6c service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:43.474591 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-51651f90-ddd5-493b-b0d3-4a629eb73617 req-fd691bc4-3e09-4d23-81b7-a069fd3e9e6c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:43.474999 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-51651f90-ddd5-493b-b0d3-4a629eb73617 req-fd691bc4-3e09-4d23-81b7-a069fd3e9e6c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:43.497983 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bfe91ddc-1080-496d-9e84-48de196f3803 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:43.499485 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bfe91ddc-1080-496d-9e84-48de196f3803 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 40178212-5f30-4d39-80a4-b92306531580] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:43.506519 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bfe91ddc-1080-496d-9e84-48de196f3803 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:43.506715 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-51651f90-ddd5-493b-b0d3-4a629eb73617 req-fd691bc4-3e09-4d23-81b7-a069fd3e9e6c service nova] Creating event network-changed:e5570b41-f756-4b4f-ade6-798afcf06c62 for instance 23ed2980-eb42-4f9e-b65e-77a238d7b976 on nch1-master-1 Sep 24 21:08:43.507621 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bfe91ddc-1080-496d-9e84-48de196f3803 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:43.519876 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bfe91ddc-1080-496d-9e84-48de196f3803 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:43.521275 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bfe91ddc-1080-496d-9e84-48de196f3803 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:43.522000 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bfe91ddc-1080-496d-9e84-48de196f3803 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:43.522713 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bfe91ddc-1080-496d-9e84-48de196f3803 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:43.528319 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-51651f90-ddd5-493b-b0d3-4a629eb73617 req-fd691bc4-3e09-4d23-81b7-a069fd3e9e6c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079744 Sep 24 21:08:43.533655 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2373/4748] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:08:43.780642 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5844169d-e527-4e73-bc35-1d1cf3a05cb4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:43.781548 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5844169d-e527-4e73-bc35-1d1cf3a05cb4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: 23ed2980-eb42-4f9e-b65e-77a238d7b976] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:43.795792 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5844169d-e527-4e73-bc35-1d1cf3a05cb4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:43.796316 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5844169d-e527-4e73-bc35-1d1cf3a05cb4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:43.796807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5844169d-e527-4e73-bc35-1d1cf3a05cb4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:43.797539 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5844169d-e527-4e73-bc35-1d1cf3a05cb4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:43.798003 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5844169d-e527-4e73-bc35-1d1cf3a05cb4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:43.798479 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5844169d-e527-4e73-bc35-1d1cf3a05cb4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:44.307778 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bfe91ddc-1080-496d-9e84-48de196f3803 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:44.331009 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bfe91ddc-1080-496d-9e84-48de196f3803 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580" status: 200 len: 1509 microversion: 2.1 time: 0.838211 Sep 24 21:08:44.331659 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2376/4749] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:43 2022] GET /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580 => generated 1509 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:44.337148 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-aa42b680-3498-48fb-9259-38e542a0cad7 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:44.337972 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-aa42b680-3498-48fb-9259-38e542a0cad7 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:44.346298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aa42b680-3498-48fb-9259-38e542a0cad7 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:44.347524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aa42b680-3498-48fb-9259-38e542a0cad7 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:44.348192 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aa42b680-3498-48fb-9259-38e542a0cad7 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:44.349079 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aa42b680-3498-48fb-9259-38e542a0cad7 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:44.349700 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aa42b680-3498-48fb-9259-38e542a0cad7 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:44.351339 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aa42b680-3498-48fb-9259-38e542a0cad7 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:44.435381 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=13,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:08:44.449230 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5844169d-e527-4e73-bc35-1d1cf3a05cb4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:44.466532 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5844169d-e527-4e73-bc35-1d1cf3a05cb4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976" status: 200 len: 1316 microversion: 2.1 time: 0.690289 Sep 24 21:08:44.468002 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2374/4750] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:43 2022] GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976 => generated 1316 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:08:44.839123 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-aa42b680-3498-48fb-9259-38e542a0cad7 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:44.850797 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-aa42b680-3498-48fb-9259-38e542a0cad7 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1313 microversion: 2.1 time: 0.517991 Sep 24 21:08:44.857270 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2377/4751] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:44 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1313 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:45.368438 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e453a7ce-fa94-472c-b9c8-ddf368a9adc4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:45.371921 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e453a7ce-fa94-472c-b9c8-ddf368a9adc4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 40178212-5f30-4d39-80a4-b92306531580] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:45.392539 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e453a7ce-fa94-472c-b9c8-ddf368a9adc4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:45.395262 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e453a7ce-fa94-472c-b9c8-ddf368a9adc4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:45.395985 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e453a7ce-fa94-472c-b9c8-ddf368a9adc4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:45.398126 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e453a7ce-fa94-472c-b9c8-ddf368a9adc4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:45.398993 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e453a7ce-fa94-472c-b9c8-ddf368a9adc4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:45.399614 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e453a7ce-fa94-472c-b9c8-ddf368a9adc4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:45.492151 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-60b76cf2-71ac-4c9e-96f8-3d1e962edc41 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:45.494093 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-60b76cf2-71ac-4c9e-96f8-3d1e962edc41 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: 23ed2980-eb42-4f9e-b65e-77a238d7b976] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:45.526996 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e453a7ce-fa94-472c-b9c8-ddf368a9adc4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:45.528323 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e453a7ce-fa94-472c-b9c8-ddf368a9adc4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:45.530031 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-60b76cf2-71ac-4c9e-96f8-3d1e962edc41 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:45.530719 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-60b76cf2-71ac-4c9e-96f8-3d1e962edc41 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:45.531032 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-60b76cf2-71ac-4c9e-96f8-3d1e962edc41 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:45.532056 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-60b76cf2-71ac-4c9e-96f8-3d1e962edc41 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:45.532624 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-60b76cf2-71ac-4c9e-96f8-3d1e962edc41 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:45.532946 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-60b76cf2-71ac-4c9e-96f8-3d1e962edc41 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:45.534220 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e453a7ce-fa94-472c-b9c8-ddf368a9adc4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:45.535123 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-e453a7ce-fa94-472c-b9c8-ddf368a9adc4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lazy-loading 'fault' on Instance uuid 40178212-5f30-4d39-80a4-b92306531580 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:08:45.711854 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e453a7ce-fa94-472c-b9c8-ddf368a9adc4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:45.728319 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e453a7ce-fa94-472c-b9c8-ddf368a9adc4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580" status: 200 len: 1305 microversion: 2.1 time: 0.371949 Sep 24 21:08:45.729817 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2375/4752] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:45 2022] GET /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580 => generated 1305 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:45.740628 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-cc1073e0-1134-4e96-aec3-ec5663730039 req-83d430a4-df24-465a-884a-41a9671e226f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40178212-5f30-4d39-80a4-b92306531580", "name": "network-vif-deleted", "tag": "820e2004-3830-4755-9111-459071db40de"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:08:45.758993 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-cc1073e0-1134-4e96-aec3-ec5663730039 req-83d430a4-df24-465a-884a-41a9671e226f service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:45.759822 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-cc1073e0-1134-4e96-aec3-ec5663730039 req-83d430a4-df24-465a-884a-41a9671e226f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:45.760661 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-cc1073e0-1134-4e96-aec3-ec5663730039 req-83d430a4-df24-465a-884a-41a9671e226f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:45.783525 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-cc1073e0-1134-4e96-aec3-ec5663730039 req-83d430a4-df24-465a-884a-41a9671e226f service nova] Creating event network-vif-deleted:820e2004-3830-4755-9111-459071db40de for instance 40178212-5f30-4d39-80a4-b92306531580 on nch2-master-1 Sep 24 21:08:45.813962 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-cc1073e0-1134-4e96-aec3-ec5663730039 req-83d430a4-df24-465a-884a-41a9671e226f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081926 Sep 24 21:08:45.818581 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2376/4753] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:08:45.892410 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-88fb4a33-f7b1-48ba-a76d-e99171e27cf1 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:45.893143 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-88fb4a33-f7b1-48ba-a76d-e99171e27cf1 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:45.907912 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-88fb4a33-f7b1-48ba-a76d-e99171e27cf1 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:45.909701 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-88fb4a33-f7b1-48ba-a76d-e99171e27cf1 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:45.910979 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-88fb4a33-f7b1-48ba-a76d-e99171e27cf1 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:45.912356 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-88fb4a33-f7b1-48ba-a76d-e99171e27cf1 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:45.913747 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-88fb4a33-f7b1-48ba-a76d-e99171e27cf1 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:45.914186 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-88fb4a33-f7b1-48ba-a76d-e99171e27cf1 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:46.261933 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-60b76cf2-71ac-4c9e-96f8-3d1e962edc41 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:46.276114 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-60b76cf2-71ac-4c9e-96f8-3d1e962edc41 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976" status: 200 len: 1316 microversion: 2.1 time: 0.787940 Sep 24 21:08:46.292581 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2378/4754] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:45 2022] GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976 => generated 1316 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:46.377020 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-88fb4a33-f7b1-48ba-a76d-e99171e27cf1 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:46.390913 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-88fb4a33-f7b1-48ba-a76d-e99171e27cf1 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1313 microversion: 2.1 time: 0.507197 Sep 24 21:08:46.406600 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2377/4755] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:45 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1313 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:46.756314 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-17b07077-9744-4190-a6d9-c822290bcf87 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:46.757344 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-17b07077-9744-4190-a6d9-c822290bcf87 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 40178212-5f30-4d39-80a4-b92306531580] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:46.769147 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-17b07077-9744-4190-a6d9-c822290bcf87 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:46.772600 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-17b07077-9744-4190-a6d9-c822290bcf87 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:46.773535 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-17b07077-9744-4190-a6d9-c822290bcf87 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:46.775779 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-17b07077-9744-4190-a6d9-c822290bcf87 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:46.776467 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-17b07077-9744-4190-a6d9-c822290bcf87 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:46.778804 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-17b07077-9744-4190-a6d9-c822290bcf87 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:46.812101 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-17b07077-9744-4190-a6d9-c822290bcf87 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] HTTP exception thrown: Instance 40178212-5f30-4d39-80a4-b92306531580 could not be found. Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-17b07077-9744-4190-a6d9-c822290bcf87 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Request method failure captured: Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580 HTTP/1.1 Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL29yHrVYRYwVIMWo2FFW4S-9sOLnTcN4ZPz2bIXXtjP3hR_rvMAsvdLWM0kalFDPOwMk_M10lFN-gbxnQwiJu4TSxB4ycd3rCGdKr5Nw8GDIx9wcghUlARhBCrxFGL7o-GhjN7quWX5q6oNDb9ZRd-9sEHZ12a6ieFkQm4pZttrgvsw Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: c1e5d6f3d41e4aa49e630f8c7ac87ded Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServerActionsTestJSON-1880156492 Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c1e5d6f3d41e4aa49e630f8c7ac87ded"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c1e5d6f3d41e4aa49e630f8c7ac87ded"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c1e5d6f3d41e4aa49e630f8c7ac87ded"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c1e5d6f3d41e4aa49e630f8c7ac87ded"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServerActionsTestJSON-1880156492 Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: c1e5d6f3d41e4aa49e630f8c7ac87ded Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServerActionsTestJSON-1880156492 Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServerActionsTestJSON-1880156492-project Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 6493da825aa24f43bdf8f0835a16e3bb Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServerActionsTestJSON-1880156492-project Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 40178212-5f30-4d39-80a4-b92306531580 could not be found. Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '40178212-5f30-4d39-80a4-b92306531580'} Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40178212-5f30-4d39-80a4-b92306531580 could not be found. Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40178212-5f30-4d39-80a4-b92306531580 could not be found. Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:08:46.818994 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:08:46.822909 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:08:46.822909 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:08:46.822909 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:08:46.822909 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:08:46.822909 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:08:46.822909 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40178212-5f30-4d39-80a4-b92306531580 could not be found. Sep 24 21:08:46.822909 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:08:46.822909 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-17b07077-9744-4190-a6d9-c822290bcf87 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Returning 404 to user: Instance 40178212-5f30-4d39-80a4-b92306531580 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:08:46.824777 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-17b07077-9744-4190-a6d9-c822290bcf87 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580" status: 404 len: 111 microversion: 2.1 time: 0.073931 Sep 24 21:08:46.827192 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2379/4756] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:46 2022] GET /compute/v2.1/servers/40178212-5f30-4d39-80a4-b92306531580 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:08:46.837046 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c31c2e82-e46e-4f37-8367-1d62a047c9e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:46.838272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c31c2e82-e46e-4f37-8367-1d62a047c9e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: e6c97c05-a30e-4c8b-b56c-0cdae10ff44c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:46.847801 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c31c2e82-e46e-4f37-8367-1d62a047c9e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:46.848762 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c31c2e82-e46e-4f37-8367-1d62a047c9e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:46.849362 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c31c2e82-e46e-4f37-8367-1d62a047c9e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:46.850359 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c31c2e82-e46e-4f37-8367-1d62a047c9e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:46.851142 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c31c2e82-e46e-4f37-8367-1d62a047c9e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:46.851780 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c31c2e82-e46e-4f37-8367-1d62a047c9e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:46.903633 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c31c2e82-e46e-4f37-8367-1d62a047c9e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: e6c97c05-a30e-4c8b-b56c-0cdae10ff44c] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:08:47.057938 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c31c2e82-e46e-4f37-8367-1d62a047c9e8 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c" status: 204 len: 0 microversion: 2.1 time: 0.225667 Sep 24 21:08:47.059026 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2378/4757] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:08:46 2022] DELETE /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:08:47.069576 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-24d2ebe3-5b00-4016-a74f-27db4a5c0e97 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:47.071772 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-24d2ebe3-5b00-4016-a74f-27db4a5c0e97 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: e6c97c05-a30e-4c8b-b56c-0cdae10ff44c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:47.088435 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24d2ebe3-5b00-4016-a74f-27db4a5c0e97 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:47.089446 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24d2ebe3-5b00-4016-a74f-27db4a5c0e97 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:47.090709 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24d2ebe3-5b00-4016-a74f-27db4a5c0e97 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:47.107395 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24d2ebe3-5b00-4016-a74f-27db4a5c0e97 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:47.108475 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24d2ebe3-5b00-4016-a74f-27db4a5c0e97 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:47.109394 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24d2ebe3-5b00-4016-a74f-27db4a5c0e97 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:47.306957 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0bc1e904-34cd-4b86-9aa3-82d0d5cb80f7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:47.307966 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0bc1e904-34cd-4b86-9aa3-82d0d5cb80f7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: 23ed2980-eb42-4f9e-b65e-77a238d7b976] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:47.314276 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=4 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:08:47.317223 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0bc1e904-34cd-4b86-9aa3-82d0d5cb80f7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:47.318070 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0bc1e904-34cd-4b86-9aa3-82d0d5cb80f7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:47.318720 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0bc1e904-34cd-4b86-9aa3-82d0d5cb80f7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:47.319618 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0bc1e904-34cd-4b86-9aa3-82d0d5cb80f7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:47.320244 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0bc1e904-34cd-4b86-9aa3-82d0d5cb80f7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:47.321476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0bc1e904-34cd-4b86-9aa3-82d0d5cb80f7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:47.488285 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=16 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:08:47.584135 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0bc1e904-34cd-4b86-9aa3-82d0d5cb80f7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:47.594430 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0bc1e904-34cd-4b86-9aa3-82d0d5cb80f7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976" status: 200 len: 1316 microversion: 2.1 time: 0.294810 Sep 24 21:08:47.597492 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2379/4758] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:47 2022] GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976 => generated 1316 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:47.606806 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f55b4580-5588-4259-8317-eb5e0e584b6a tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:47.607834 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f55b4580-5588-4259-8317-eb5e0e584b6a tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:47.622849 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-24d2ebe3-5b00-4016-a74f-27db4a5c0e97 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:47.623629 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f55b4580-5588-4259-8317-eb5e0e584b6a tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:47.624215 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f55b4580-5588-4259-8317-eb5e0e584b6a tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:47.625213 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f55b4580-5588-4259-8317-eb5e0e584b6a tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:47.627345 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f55b4580-5588-4259-8317-eb5e0e584b6a tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:47.636343 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f55b4580-5588-4259-8317-eb5e0e584b6a tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:47.636833 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f55b4580-5588-4259-8317-eb5e0e584b6a tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:47.637098 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-24d2ebe3-5b00-4016-a74f-27db4a5c0e97 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c" status: 200 len: 1496 microversion: 2.1 time: 0.572854 Sep 24 21:08:47.639785 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2380/4759] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:47 2022] GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c => generated 1496 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:47.861020 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-1aa7d651-bf83-4dfd-8682-a722f679a701 req-28d32b94-6d81-41e1-94a7-52926c309fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0496cfe1-2be3-438a-965a-c2994623a96c", "tag": "a0dac7b8-a522-4a81-add9-68f10e113998"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:08:47.877559 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-1aa7d651-bf83-4dfd-8682-a722f679a701 req-28d32b94-6d81-41e1-94a7-52926c309fe3 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:47.878273 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-1aa7d651-bf83-4dfd-8682-a722f679a701 req-28d32b94-6d81-41e1-94a7-52926c309fe3 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:47.878891 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-1aa7d651-bf83-4dfd-8682-a722f679a701 req-28d32b94-6d81-41e1-94a7-52926c309fe3 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:47.911152 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-1aa7d651-bf83-4dfd-8682-a722f679a701 req-28d32b94-6d81-41e1-94a7-52926c309fe3 service nova] Creating event network-changed:a0dac7b8-a522-4a81-add9-68f10e113998 for instance 0496cfe1-2be3-438a-965a-c2994623a96c on nch2-master-1 Sep 24 21:08:47.921586 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-1aa7d651-bf83-4dfd-8682-a722f679a701 req-28d32b94-6d81-41e1-94a7-52926c309fe3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064115 Sep 24 21:08:47.922954 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2381/4760] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:08:47.983012 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f55b4580-5588-4259-8317-eb5e0e584b6a tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:47.996165 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f55b4580-5588-4259-8317-eb5e0e584b6a tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1313 microversion: 2.1 time: 0.397492 Sep 24 21:08:47.997978 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2380/4761] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:47 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1313 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:48.625720 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4691e5d1-5cf9-4a73-b9f9-f3c131214ca3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:48.626446 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4691e5d1-5cf9-4a73-b9f9-f3c131214ca3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: 23ed2980-eb42-4f9e-b65e-77a238d7b976] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:48.653152 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4691e5d1-5cf9-4a73-b9f9-f3c131214ca3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:48.653721 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4691e5d1-5cf9-4a73-b9f9-f3c131214ca3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:48.654782 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4691e5d1-5cf9-4a73-b9f9-f3c131214ca3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:48.655532 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4691e5d1-5cf9-4a73-b9f9-f3c131214ca3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:48.656001 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4691e5d1-5cf9-4a73-b9f9-f3c131214ca3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:48.656444 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4691e5d1-5cf9-4a73-b9f9-f3c131214ca3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:48.673634 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4e776add-1228-41af-b896-2391cc1b64de tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:48.674819 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4e776add-1228-41af-b896-2391cc1b64de tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: e6c97c05-a30e-4c8b-b56c-0cdae10ff44c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:48.683548 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e776add-1228-41af-b896-2391cc1b64de tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:48.684419 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e776add-1228-41af-b896-2391cc1b64de tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:48.685788 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e776add-1228-41af-b896-2391cc1b64de tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:48.686809 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e776add-1228-41af-b896-2391cc1b64de tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:48.687496 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e776add-1228-41af-b896-2391cc1b64de tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:48.688153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e776add-1228-41af-b896-2391cc1b64de tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:48.839722 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4e776add-1228-41af-b896-2391cc1b64de tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:48.849129 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4e776add-1228-41af-b896-2391cc1b64de tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c" status: 200 len: 1454 microversion: 2.1 time: 0.179332 Sep 24 21:08:48.849959 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2381/4762] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:48 2022] GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c => generated 1454 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:48.975721 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4691e5d1-5cf9-4a73-b9f9-f3c131214ca3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:48.990609 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4691e5d1-5cf9-4a73-b9f9-f3c131214ca3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976" status: 200 len: 1316 microversion: 2.1 time: 0.365074 Sep 24 21:08:48.990609 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2382/4763] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:48 2022] GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976 => generated 1316 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:49.022146 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6acded86-7fcb-43a7-b9f4-f6ddd6ef4205 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:49.022817 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6acded86-7fcb-43a7-b9f4-f6ddd6ef4205 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:49.033521 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6acded86-7fcb-43a7-b9f4-f6ddd6ef4205 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:49.038835 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6acded86-7fcb-43a7-b9f4-f6ddd6ef4205 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:49.039472 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6acded86-7fcb-43a7-b9f4-f6ddd6ef4205 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:49.042513 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6acded86-7fcb-43a7-b9f4-f6ddd6ef4205 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:49.046433 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6acded86-7fcb-43a7-b9f4-f6ddd6ef4205 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:49.047087 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6acded86-7fcb-43a7-b9f4-f6ddd6ef4205 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:49.305984 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6acded86-7fcb-43a7-b9f4-f6ddd6ef4205 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:49.316411 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6acded86-7fcb-43a7-b9f4-f6ddd6ef4205 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1313 microversion: 2.1 time: 0.298276 Sep 24 21:08:49.317007 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2382/4764] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:49 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:49.959272 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c2250448-f500-47cf-9edd-566df90f9536 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:49.960950 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c2250448-f500-47cf-9edd-566df90f9536 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: e6c97c05-a30e-4c8b-b56c-0cdae10ff44c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:49.962084 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-a7df7790-ea09-455c-aaee-346c172a3eac req-bce38e2e-afe6-4573-945a-a9819810d1d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6c97c05-a30e-4c8b-b56c-0cdae10ff44c", "name": "network-vif-deleted", "tag": "fb74888f-8f3f-40e6-9054-02d311163034"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:08:49.971000 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c2250448-f500-47cf-9edd-566df90f9536 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:49.971922 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c2250448-f500-47cf-9edd-566df90f9536 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:49.972443 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c2250448-f500-47cf-9edd-566df90f9536 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:49.973291 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c2250448-f500-47cf-9edd-566df90f9536 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:49.974000 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c2250448-f500-47cf-9edd-566df90f9536 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:49.974685 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c2250448-f500-47cf-9edd-566df90f9536 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:49.984480 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a7df7790-ea09-455c-aaee-346c172a3eac req-bce38e2e-afe6-4573-945a-a9819810d1d2 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:49.984974 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a7df7790-ea09-455c-aaee-346c172a3eac req-bce38e2e-afe6-4573-945a-a9819810d1d2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:49.985414 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a7df7790-ea09-455c-aaee-346c172a3eac req-bce38e2e-afe6-4573-945a-a9819810d1d2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:50.009435 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-a7df7790-ea09-455c-aaee-346c172a3eac req-bce38e2e-afe6-4573-945a-a9819810d1d2 service nova] Creating event network-vif-deleted:fb74888f-8f3f-40e6-9054-02d311163034 for instance e6c97c05-a30e-4c8b-b56c-0cdae10ff44c on nch2-master-1 Sep 24 21:08:50.021569 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-a7df7790-ea09-455c-aaee-346c172a3eac req-bce38e2e-afe6-4573-945a-a9819810d1d2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064351 Sep 24 21:08:50.023862 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2383/4765] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:08:50.034751 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b497c0f7-13c8-438e-b9e7-38266b7394ef tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:50.037646 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c2250448-f500-47cf-9edd-566df90f9536 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:50.038298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c2250448-f500-47cf-9edd-566df90f9536 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:50.038971 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c2250448-f500-47cf-9edd-566df90f9536 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:50.039788 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-c2250448-f500-47cf-9edd-566df90f9536 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lazy-loading 'fault' on Instance uuid e6c97c05-a30e-4c8b-b56c-0cdae10ff44c {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:08:50.040654 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b497c0f7-13c8-438e-b9e7-38266b7394ef tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: 23ed2980-eb42-4f9e-b65e-77a238d7b976] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:50.064370 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b497c0f7-13c8-438e-b9e7-38266b7394ef tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:50.066786 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b497c0f7-13c8-438e-b9e7-38266b7394ef tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:50.067503 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b497c0f7-13c8-438e-b9e7-38266b7394ef tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:50.068514 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b497c0f7-13c8-438e-b9e7-38266b7394ef tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:50.069081 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b497c0f7-13c8-438e-b9e7-38266b7394ef tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:50.069645 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b497c0f7-13c8-438e-b9e7-38266b7394ef tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:50.074715 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:08:50.105037 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c2250448-f500-47cf-9edd-566df90f9536 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:50.121970 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c2250448-f500-47cf-9edd-566df90f9536 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c" status: 200 len: 1305 microversion: 2.1 time: 0.166811 Sep 24 21:08:50.134585 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2383/4766] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:49 2022] GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c => generated 1305 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:50.353236 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6be148f4-7041-4120-a77f-6cd731690cb0 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:50.355210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6be148f4-7041-4120-a77f-6cd731690cb0 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:50.375418 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6be148f4-7041-4120-a77f-6cd731690cb0 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:50.376473 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6be148f4-7041-4120-a77f-6cd731690cb0 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:50.377180 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6be148f4-7041-4120-a77f-6cd731690cb0 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:50.378195 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6be148f4-7041-4120-a77f-6cd731690cb0 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:50.379433 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6be148f4-7041-4120-a77f-6cd731690cb0 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:50.381955 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6be148f4-7041-4120-a77f-6cd731690cb0 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:50.593295 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b497c0f7-13c8-438e-b9e7-38266b7394ef tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:50.607274 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b497c0f7-13c8-438e-b9e7-38266b7394ef tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976" status: 200 len: 1316 microversion: 2.1 time: 0.579075 Sep 24 21:08:50.607871 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2384/4767] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:50 2022] GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976 => generated 1316 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:50.828973 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6be148f4-7041-4120-a77f-6cd731690cb0 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:50.839939 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6be148f4-7041-4120-a77f-6cd731690cb0 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1313 microversion: 2.1 time: 0.502077 Sep 24 21:08:50.849319 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2384/4768] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:50 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1313 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:08:51.149714 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fc73754d-32ad-4dee-9577-7f6807e4f203 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:51.150394 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fc73754d-32ad-4dee-9577-7f6807e4f203 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: e6c97c05-a30e-4c8b-b56c-0cdae10ff44c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:51.163163 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fc73754d-32ad-4dee-9577-7f6807e4f203 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:51.163776 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fc73754d-32ad-4dee-9577-7f6807e4f203 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:51.164294 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fc73754d-32ad-4dee-9577-7f6807e4f203 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:51.169622 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fc73754d-32ad-4dee-9577-7f6807e4f203 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:51.170363 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fc73754d-32ad-4dee-9577-7f6807e4f203 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:51.170914 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fc73754d-32ad-4dee-9577-7f6807e4f203 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-fc73754d-32ad-4dee-9577-7f6807e4f203 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] HTTP exception thrown: Instance e6c97c05-a30e-4c8b-b56c-0cdae10ff44c could not be found. Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fc73754d-32ad-4dee-9577-7f6807e4f203 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Request method failure captured: Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c HTTP/1.1 Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL29yHrVYRYwVIMWo2FFW4S-9sOLnTcN4ZPz2bIXXtjP3hR_rvMAsvdLWM0kalFDPOwMk_M10lFN-gbxnQwiJu4TSxB4ycd3rCGdKr5Nw8GDIx9wcghUlARhBCrxFGL7o-GhjN7quWX5q6oNDb9ZRd-9sEHZ12a6ieFkQm4pZttrgvsw Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: c1e5d6f3d41e4aa49e630f8c7ac87ded Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServerActionsTestJSON-1880156492 Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c1e5d6f3d41e4aa49e630f8c7ac87ded"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c1e5d6f3d41e4aa49e630f8c7ac87ded"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c1e5d6f3d41e4aa49e630f8c7ac87ded"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c1e5d6f3d41e4aa49e630f8c7ac87ded"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServerActionsTestJSON-1880156492 Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: c1e5d6f3d41e4aa49e630f8c7ac87ded Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServerActionsTestJSON-1880156492 Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServerActionsTestJSON-1880156492-project Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 6493da825aa24f43bdf8f0835a16e3bb Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServerActionsTestJSON-1880156492-project Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance e6c97c05-a30e-4c8b-b56c-0cdae10ff44c could not be found. Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'e6c97c05-a30e-4c8b-b56c-0cdae10ff44c'} Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6c97c05-a30e-4c8b-b56c-0cdae10ff44c could not be found. Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:08:51.199143 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:08:51.203474 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6c97c05-a30e-4c8b-b56c-0cdae10ff44c could not be found. Sep 24 21:08:51.203474 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:08:51.203474 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:08:51.203474 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:08:51.203474 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:08:51.203474 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:08:51.203474 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:08:51.203474 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:08:51.203474 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:08:51.203474 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6c97c05-a30e-4c8b-b56c-0cdae10ff44c could not be found. Sep 24 21:08:51.203474 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:08:51.203474 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fc73754d-32ad-4dee-9577-7f6807e4f203 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Returning 404 to user: Instance e6c97c05-a30e-4c8b-b56c-0cdae10ff44c could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:08:51.203474 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fc73754d-32ad-4dee-9577-7f6807e4f203 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c" status: 404 len: 111 microversion: 2.1 time: 0.054671 Sep 24 21:08:51.209500 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cba8bb1c-8840-437b-be8a-72f7cf9253b4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:51.210004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cba8bb1c-8840-437b-be8a-72f7cf9253b4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:51.210852 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2385/4769] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:51 2022] GET /compute/v2.1/servers/e6c97c05-a30e-4c8b-b56c-0cdae10ff44c => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:08:51.220114 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cba8bb1c-8840-437b-be8a-72f7cf9253b4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:51.220606 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cba8bb1c-8840-437b-be8a-72f7cf9253b4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:51.223118 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cba8bb1c-8840-437b-be8a-72f7cf9253b4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:51.224360 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cba8bb1c-8840-437b-be8a-72f7cf9253b4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:51.225243 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cba8bb1c-8840-437b-be8a-72f7cf9253b4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:51.229407 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cba8bb1c-8840-437b-be8a-72f7cf9253b4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:51.273777 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cba8bb1c-8840-437b-be8a-72f7cf9253b4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:08:51.368403 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cba8bb1c-8840-437b-be8a-72f7cf9253b4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 204 len: 0 microversion: 2.1 time: 0.161852 Sep 24 21:08:51.370701 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2385/4770] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:08:51 2022] DELETE /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:08:51.385939 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-63636910-13d5-4aec-a045-43618da99ea0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:51.386793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-63636910-13d5-4aec-a045-43618da99ea0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:51.395094 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-63636910-13d5-4aec-a045-43618da99ea0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:51.396316 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-63636910-13d5-4aec-a045-43618da99ea0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:51.396777 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-63636910-13d5-4aec-a045-43618da99ea0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:51.397539 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-63636910-13d5-4aec-a045-43618da99ea0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:51.398006 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-63636910-13d5-4aec-a045-43618da99ea0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:51.398441 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-63636910-13d5-4aec-a045-43618da99ea0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:51.651592 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-15a3772e-3e4a-412e-9b79-b87f81968bf1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:51.652353 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-15a3772e-3e4a-412e-9b79-b87f81968bf1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: 23ed2980-eb42-4f9e-b65e-77a238d7b976] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:51.664574 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:08:51.666912 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15a3772e-3e4a-412e-9b79-b87f81968bf1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:51.667691 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15a3772e-3e4a-412e-9b79-b87f81968bf1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:51.670566 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15a3772e-3e4a-412e-9b79-b87f81968bf1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:51.672688 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15a3772e-3e4a-412e-9b79-b87f81968bf1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:51.674797 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15a3772e-3e4a-412e-9b79-b87f81968bf1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:51.676294 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15a3772e-3e4a-412e-9b79-b87f81968bf1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:51.889278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-63636910-13d5-4aec-a045-43618da99ea0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:51.906070 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-63636910-13d5-4aec-a045-43618da99ea0 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1674 microversion: 2.1 time: 0.529540 Sep 24 21:08:51.911746 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2386/4771] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:51 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1674 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:51.925185 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e4b4c0a8-d63f-4edb-8522-7a9c2247d58b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:51.927146 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e4b4c0a8-d63f-4edb-8522-7a9c2247d58b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:51.942674 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e4b4c0a8-d63f-4edb-8522-7a9c2247d58b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:51.943356 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e4b4c0a8-d63f-4edb-8522-7a9c2247d58b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:51.943929 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e4b4c0a8-d63f-4edb-8522-7a9c2247d58b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:51.944735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e4b4c0a8-d63f-4edb-8522-7a9c2247d58b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:51.945282 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e4b4c0a8-d63f-4edb-8522-7a9c2247d58b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:51.946142 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e4b4c0a8-d63f-4edb-8522-7a9c2247d58b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:52.421288 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-15a3772e-3e4a-412e-9b79-b87f81968bf1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:52.440981 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-15a3772e-3e4a-412e-9b79-b87f81968bf1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976" status: 200 len: 1316 microversion: 2.1 time: 0.815115 Sep 24 21:08:52.441792 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2386/4772] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:51 2022] GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976 => generated 1316 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:08:52.537568 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e4b4c0a8-d63f-4edb-8522-7a9c2247d58b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:52.546861 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e4b4c0a8-d63f-4edb-8522-7a9c2247d58b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1313 microversion: 2.1 time: 0.633688 Sep 24 21:08:52.562087 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2387/4773] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:51 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1313 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:52.933419 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7b367069-13b9-427c-ac23-810d902707c6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:52.934315 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7b367069-13b9-427c-ac23-810d902707c6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:52.942783 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b367069-13b9-427c-ac23-810d902707c6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:52.943370 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b367069-13b9-427c-ac23-810d902707c6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:52.944047 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b367069-13b9-427c-ac23-810d902707c6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:52.945041 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b367069-13b9-427c-ac23-810d902707c6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:52.945754 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b367069-13b9-427c-ac23-810d902707c6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:52.946812 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b367069-13b9-427c-ac23-810d902707c6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:53.083302 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-f099869a-1209-4f9a-8818-3e90eb93578e req-fd024e47-74d7-4343-9aaf-8fa2c9359839 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23ed2980-eb42-4f9e-b65e-77a238d7b976", "name": "network-vif-plugged", "status": "completed", "tag": "e5570b41-f756-4b4f-ade6-798afcf06c62"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:08:53.095879 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-f099869a-1209-4f9a-8818-3e90eb93578e req-fd024e47-74d7-4343-9aaf-8fa2c9359839 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:53.096440 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-f099869a-1209-4f9a-8818-3e90eb93578e req-fd024e47-74d7-4343-9aaf-8fa2c9359839 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:53.097167 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-f099869a-1209-4f9a-8818-3e90eb93578e req-fd024e47-74d7-4343-9aaf-8fa2c9359839 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:53.112876 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-f099869a-1209-4f9a-8818-3e90eb93578e req-fd024e47-74d7-4343-9aaf-8fa2c9359839 service nova] Creating event network-vif-plugged:e5570b41-f756-4b4f-ade6-798afcf06c62 for instance 23ed2980-eb42-4f9e-b65e-77a238d7b976 on nch1-master-1 Sep 24 21:08:53.126219 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-f099869a-1209-4f9a-8818-3e90eb93578e req-fd024e47-74d7-4343-9aaf-8fa2c9359839 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045821 Sep 24 21:08:53.127465 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2388/4774] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:08:53.306098 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7b367069-13b9-427c-ac23-810d902707c6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:53.325955 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7b367069-13b9-427c-ac23-810d902707c6 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1674 microversion: 2.1 time: 0.396550 Sep 24 21:08:53.338531 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2387/4775] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:52 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1674 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:53.465212 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5978f391-0cef-4383-8116-1a6aebf686f4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:53.465935 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5978f391-0cef-4383-8116-1a6aebf686f4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: 23ed2980-eb42-4f9e-b65e-77a238d7b976] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:53.473958 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5978f391-0cef-4383-8116-1a6aebf686f4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:53.474754 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5978f391-0cef-4383-8116-1a6aebf686f4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:53.475949 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5978f391-0cef-4383-8116-1a6aebf686f4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:53.476691 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5978f391-0cef-4383-8116-1a6aebf686f4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:53.477157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5978f391-0cef-4383-8116-1a6aebf686f4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:53.477771 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5978f391-0cef-4383-8116-1a6aebf686f4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:53.570303 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0cc1f05a-9e77-4019-bee6-54408b6ee2f5 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:53.570974 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0cc1f05a-9e77-4019-bee6-54408b6ee2f5 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:53.581044 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0cc1f05a-9e77-4019-bee6-54408b6ee2f5 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:53.581637 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0cc1f05a-9e77-4019-bee6-54408b6ee2f5 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:53.582185 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0cc1f05a-9e77-4019-bee6-54408b6ee2f5 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:53.583498 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0cc1f05a-9e77-4019-bee6-54408b6ee2f5 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:53.583974 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0cc1f05a-9e77-4019-bee6-54408b6ee2f5 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:53.584749 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0cc1f05a-9e77-4019-bee6-54408b6ee2f5 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:54.054099 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5978f391-0cef-4383-8116-1a6aebf686f4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:54.062811 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5978f391-0cef-4383-8116-1a6aebf686f4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976" status: 200 len: 1316 microversion: 2.1 time: 0.601806 Sep 24 21:08:54.063406 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2389/4776] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:53 2022] GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976 => generated 1316 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:54.190524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0cc1f05a-9e77-4019-bee6-54408b6ee2f5 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:54.198919 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0cc1f05a-9e77-4019-bee6-54408b6ee2f5 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1313 microversion: 2.1 time: 0.632887 Sep 24 21:08:54.211041 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2388/4777] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:53 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1313 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:08:54.349637 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e9cebb31-df36-4594-9566-042ec6f656bc tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:54.350534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e9cebb31-df36-4594-9566-042ec6f656bc tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:54.360990 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e9cebb31-df36-4594-9566-042ec6f656bc tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:54.361593 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e9cebb31-df36-4594-9566-042ec6f656bc tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:54.362145 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e9cebb31-df36-4594-9566-042ec6f656bc tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:54.363091 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e9cebb31-df36-4594-9566-042ec6f656bc tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:54.363630 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e9cebb31-df36-4594-9566-042ec6f656bc tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:54.364136 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e9cebb31-df36-4594-9566-042ec6f656bc tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:54.747876 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e9cebb31-df36-4594-9566-042ec6f656bc tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:54.765615 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e9cebb31-df36-4594-9566-042ec6f656bc tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1674 microversion: 2.1 time: 0.419502 Sep 24 21:08:54.769636 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2390/4778] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:54 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1674 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:55.086082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-117284f3-6b29-4233-a600-ad0a1a0d9a92 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:55.088439 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-117284f3-6b29-4233-a600-ad0a1a0d9a92 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: 23ed2980-eb42-4f9e-b65e-77a238d7b976] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:55.098917 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-117284f3-6b29-4233-a600-ad0a1a0d9a92 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:55.099668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-117284f3-6b29-4233-a600-ad0a1a0d9a92 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:55.100341 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-117284f3-6b29-4233-a600-ad0a1a0d9a92 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:55.101864 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-117284f3-6b29-4233-a600-ad0a1a0d9a92 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:55.102621 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-117284f3-6b29-4233-a600-ad0a1a0d9a92 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:55.103238 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-117284f3-6b29-4233-a600-ad0a1a0d9a92 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:55.146385 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-384f0bef-587e-4a2b-9d61-1f23e0de5b46 req-fc96a44a-e41c-4504-a968-8c1a0901aead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0496cfe1-2be3-438a-965a-c2994623a96c", "name": "network-vif-plugged", "status": "completed", "tag": "a0dac7b8-a522-4a81-add9-68f10e113998"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:08:55.159526 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-384f0bef-587e-4a2b-9d61-1f23e0de5b46 req-fc96a44a-e41c-4504-a968-8c1a0901aead service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:55.160378 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-384f0bef-587e-4a2b-9d61-1f23e0de5b46 req-fc96a44a-e41c-4504-a968-8c1a0901aead service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:55.161004 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-384f0bef-587e-4a2b-9d61-1f23e0de5b46 req-fc96a44a-e41c-4504-a968-8c1a0901aead service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:55.179088 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-384f0bef-587e-4a2b-9d61-1f23e0de5b46 req-fc96a44a-e41c-4504-a968-8c1a0901aead service nova] Creating event network-vif-plugged:a0dac7b8-a522-4a81-add9-68f10e113998 for instance 0496cfe1-2be3-438a-965a-c2994623a96c on nch2-master-1 Sep 24 21:08:55.187024 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-384f0bef-587e-4a2b-9d61-1f23e0de5b46 req-fc96a44a-e41c-4504-a968-8c1a0901aead service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045118 Sep 24 21:08:55.193470 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2391/4779] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:08:55.227043 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5e15dc47-efdd-4301-80d8-9812583019ce tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:55.240577 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5e15dc47-efdd-4301-80d8-9812583019ce tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:55.257966 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e15dc47-efdd-4301-80d8-9812583019ce tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:55.258996 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e15dc47-efdd-4301-80d8-9812583019ce tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:55.259672 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e15dc47-efdd-4301-80d8-9812583019ce tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:55.260664 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e15dc47-efdd-4301-80d8-9812583019ce tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:55.261342 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e15dc47-efdd-4301-80d8-9812583019ce tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:55.261983 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e15dc47-efdd-4301-80d8-9812583019ce tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:55.424554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-117284f3-6b29-4233-a600-ad0a1a0d9a92 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:55.432852 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-117284f3-6b29-4233-a600-ad0a1a0d9a92 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976" status: 200 len: 1505 microversion: 2.1 time: 0.351473 Sep 24 21:08:55.433569 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2389/4780] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:55 2022] GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976 => generated 1505 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:55.461044 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-84a405da-e2a9-45e0-a9ba-ef8ad7df1758 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:55.461591 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-84a405da-e2a9-45e0-a9ba-ef8ad7df1758 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: 23ed2980-eb42-4f9e-b65e-77a238d7b976] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:55.476290 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84a405da-e2a9-45e0-a9ba-ef8ad7df1758 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:55.476800 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84a405da-e2a9-45e0-a9ba-ef8ad7df1758 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:55.477243 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84a405da-e2a9-45e0-a9ba-ef8ad7df1758 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:55.479434 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84a405da-e2a9-45e0-a9ba-ef8ad7df1758 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:55.483747 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84a405da-e2a9-45e0-a9ba-ef8ad7df1758 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:55.484213 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84a405da-e2a9-45e0-a9ba-ef8ad7df1758 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:55.520585 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-84a405da-e2a9-45e0-a9ba-ef8ad7df1758 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: 23ed2980-eb42-4f9e-b65e-77a238d7b976] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:08:55.622310 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-84a405da-e2a9-45e0-a9ba-ef8ad7df1758 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "DELETE /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976" status: 204 len: 0 microversion: 2.1 time: 0.165647 Sep 24 21:08:55.627270 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2390/4781] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:08:55 2022] DELETE /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:08:55.633844 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-005dd364-d374-4672-a378-65b282ceb65c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:55.634867 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-005dd364-d374-4672-a378-65b282ceb65c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: 23ed2980-eb42-4f9e-b65e-77a238d7b976] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:55.642919 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-005dd364-d374-4672-a378-65b282ceb65c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:55.643760 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-005dd364-d374-4672-a378-65b282ceb65c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:55.644477 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-005dd364-d374-4672-a378-65b282ceb65c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:55.645455 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-005dd364-d374-4672-a378-65b282ceb65c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:55.646081 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-005dd364-d374-4672-a378-65b282ceb65c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:55.646776 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-005dd364-d374-4672-a378-65b282ceb65c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:55.671199 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:08:55.959753 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5e15dc47-efdd-4301-80d8-9812583019ce tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:55.971913 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5e15dc47-efdd-4301-80d8-9812583019ce tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1313 microversion: 2.1 time: 0.749732 Sep 24 21:08:55.988779 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2392/4782] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:55 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1313 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:56.002264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f7acce3e-8fbe-4710-916a-6ddf1e5e123b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:56.004438 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f7acce3e-8fbe-4710-916a-6ddf1e5e123b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:56.012068 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-005dd364-d374-4672-a378-65b282ceb65c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:56.029138 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-005dd364-d374-4672-a378-65b282ceb65c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976" status: 200 len: 1511 microversion: 2.1 time: 0.396945 Sep 24 21:08:56.029774 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2391/4783] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:55 2022] GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976 => generated 1511 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:56.052496 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=94,nova_api:UPDATE=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:08:56.058422 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f7acce3e-8fbe-4710-916a-6ddf1e5e123b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:56.061030 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f7acce3e-8fbe-4710-916a-6ddf1e5e123b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:56.061628 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f7acce3e-8fbe-4710-916a-6ddf1e5e123b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:56.061972 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-1317c11d-7387-48cd-ae6e-c10e54436bd5 req-9c9118ae-116d-42c9-95cc-1ae0016df3f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d546302-deb3-47c6-b9fd-3155ced00883", "name": "network-vif-deleted", "tag": "56949465-71b8-45bb-b1d2-4b934bfc9714"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:08:56.064653 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f7acce3e-8fbe-4710-916a-6ddf1e5e123b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:56.066489 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f7acce3e-8fbe-4710-916a-6ddf1e5e123b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:56.066977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f7acce3e-8fbe-4710-916a-6ddf1e5e123b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:56.083805 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-1317c11d-7387-48cd-ae6e-c10e54436bd5 req-9c9118ae-116d-42c9-95cc-1ae0016df3f3 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:56.084295 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-1317c11d-7387-48cd-ae6e-c10e54436bd5 req-9c9118ae-116d-42c9-95cc-1ae0016df3f3 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:56.085370 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-1317c11d-7387-48cd-ae6e-c10e54436bd5 req-9c9118ae-116d-42c9-95cc-1ae0016df3f3 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:56.105498 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-1317c11d-7387-48cd-ae6e-c10e54436bd5 req-9c9118ae-116d-42c9-95cc-1ae0016df3f3 service nova] Creating event network-vif-deleted:56949465-71b8-45bb-b1d2-4b934bfc9714 for instance 0d546302-deb3-47c6-b9fd-3155ced00883 on nch1-master-1 Sep 24 21:08:56.114041 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-1317c11d-7387-48cd-ae6e-c10e54436bd5 req-9c9118ae-116d-42c9-95cc-1ae0016df3f3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065819 Sep 24 21:08:56.119363 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2392/4784] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:08:56.154736 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f7acce3e-8fbe-4710-916a-6ddf1e5e123b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:56.163850 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f7acce3e-8fbe-4710-916a-6ddf1e5e123b tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1606 microversion: 2.1 time: 0.173280 Sep 24 21:08:56.164541 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2393/4785] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:55 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1606 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:57.002158 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ac2f8618-b68a-4e89-9719-48d80fd3df81 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:57.002872 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ac2f8618-b68a-4e89-9719-48d80fd3df81 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:57.017739 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ac2f8618-b68a-4e89-9719-48d80fd3df81 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:57.018160 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ac2f8618-b68a-4e89-9719-48d80fd3df81 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:57.018574 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ac2f8618-b68a-4e89-9719-48d80fd3df81 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:57.019311 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ac2f8618-b68a-4e89-9719-48d80fd3df81 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:57.019782 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ac2f8618-b68a-4e89-9719-48d80fd3df81 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:57.020295 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ac2f8618-b68a-4e89-9719-48d80fd3df81 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:57.055726 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-851ff2e4-9435-4146-96b7-5fb275ab378c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:57.056470 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-851ff2e4-9435-4146-96b7-5fb275ab378c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: 23ed2980-eb42-4f9e-b65e-77a238d7b976] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:57.068908 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-851ff2e4-9435-4146-96b7-5fb275ab378c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:57.073958 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-851ff2e4-9435-4146-96b7-5fb275ab378c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:57.077825 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-851ff2e4-9435-4146-96b7-5fb275ab378c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:57.079498 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-851ff2e4-9435-4146-96b7-5fb275ab378c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:57.079988 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-851ff2e4-9435-4146-96b7-5fb275ab378c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:57.083233 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-851ff2e4-9435-4146-96b7-5fb275ab378c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:57.533564 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-851ff2e4-9435-4146-96b7-5fb275ab378c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:57.554671 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-851ff2e4-9435-4146-96b7-5fb275ab378c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976" status: 200 len: 1511 microversion: 2.1 time: 0.502803 Sep 24 21:08:57.556492 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2394/4786] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:57 2022] GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976 => generated 1511 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:57.566358 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ac2f8618-b68a-4e89-9719-48d80fd3df81 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:57.574277 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9233171f-15a9-4bf6-8aa0-7729a19d28eb tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:57.576213 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9233171f-15a9-4bf6-8aa0-7729a19d28eb tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:57.580437 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ac2f8618-b68a-4e89-9719-48d80fd3df81 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1313 microversion: 2.1 time: 0.580830 Sep 24 21:08:57.580437 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2393/4787] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:56 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1313 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:57.591701 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9233171f-15a9-4bf6-8aa0-7729a19d28eb tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:57.592901 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9233171f-15a9-4bf6-8aa0-7729a19d28eb tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:57.593561 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9233171f-15a9-4bf6-8aa0-7729a19d28eb tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:57.594543 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9233171f-15a9-4bf6-8aa0-7729a19d28eb tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:57.595244 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9233171f-15a9-4bf6-8aa0-7729a19d28eb tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:57.596004 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9233171f-15a9-4bf6-8aa0-7729a19d28eb tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:57.666290 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9233171f-15a9-4bf6-8aa0-7729a19d28eb tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:57.667144 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9233171f-15a9-4bf6-8aa0-7729a19d28eb tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:57.667808 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9233171f-15a9-4bf6-8aa0-7729a19d28eb tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:57.668483 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-9233171f-15a9-4bf6-8aa0-7729a19d28eb tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lazy-loading 'fault' on Instance uuid 0d546302-deb3-47c6-b9fd-3155ced00883 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:08:57.794930 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9233171f-15a9-4bf6-8aa0-7729a19d28eb tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6493da825aa24f43bdf8f0835a16e3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e5d6f3d41e4aa49e630f8c7ac87ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:57.804706 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9233171f-15a9-4bf6-8aa0-7729a19d28eb tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 200 len: 1327 microversion: 2.1 time: 0.245185 Sep 24 21:08:57.805317 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2395/4788] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:57 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 1327 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:58.582981 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3c9b687f-b907-4e2c-a2b7-8051af7c960d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:58.584839 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3c9b687f-b907-4e2c-a2b7-8051af7c960d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: 23ed2980-eb42-4f9e-b65e-77a238d7b976] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:58.592205 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c9b687f-b907-4e2c-a2b7-8051af7c960d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:58.592912 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c9b687f-b907-4e2c-a2b7-8051af7c960d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:58.593500 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c9b687f-b907-4e2c-a2b7-8051af7c960d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:58.594396 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c9b687f-b907-4e2c-a2b7-8051af7c960d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:58.595133 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c9b687f-b907-4e2c-a2b7-8051af7c960d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:58.595731 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c9b687f-b907-4e2c-a2b7-8051af7c960d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:58.610918 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4bdb50c3-3473-4b12-98d9-98319ffcbb4f tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:58.612391 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4bdb50c3-3473-4b12-98d9-98319ffcbb4f tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:58.630171 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4bdb50c3-3473-4b12-98d9-98319ffcbb4f tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:58.632109 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4bdb50c3-3473-4b12-98d9-98319ffcbb4f tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:58.632738 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4bdb50c3-3473-4b12-98d9-98319ffcbb4f tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:58.635255 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4bdb50c3-3473-4b12-98d9-98319ffcbb4f tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:58.636946 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4bdb50c3-3473-4b12-98d9-98319ffcbb4f tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:58.641966 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4bdb50c3-3473-4b12-98d9-98319ffcbb4f tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:58.886532 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3c9b687f-b907-4e2c-a2b7-8051af7c960d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:58.895281 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3c9b687f-b907-4e2c-a2b7-8051af7c960d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976" status: 200 len: 1469 microversion: 2.1 time: 0.316437 Sep 24 21:08:58.895888 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2394/4789] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:58 2022] GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976 => generated 1469 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:58.907536 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-c64de4fd-54d7-4535-90c3-8fb8b5e14f77 req-003267b4-514c-4653-847c-2080cbfcec44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23ed2980-eb42-4f9e-b65e-77a238d7b976", "name": "network-vif-deleted", "tag": "e5570b41-f756-4b4f-ade6-798afcf06c62"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:08:58.942550 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-c64de4fd-54d7-4535-90c3-8fb8b5e14f77 req-003267b4-514c-4653-847c-2080cbfcec44 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:58.947261 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-c64de4fd-54d7-4535-90c3-8fb8b5e14f77 req-003267b4-514c-4653-847c-2080cbfcec44 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:58.947722 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-c64de4fd-54d7-4535-90c3-8fb8b5e14f77 req-003267b4-514c-4653-847c-2080cbfcec44 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:58.980329 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-c64de4fd-54d7-4535-90c3-8fb8b5e14f77 req-003267b4-514c-4653-847c-2080cbfcec44 service nova] Creating event network-vif-deleted:e5570b41-f756-4b4f-ade6-798afcf06c62 for instance 23ed2980-eb42-4f9e-b65e-77a238d7b976 on nch1-master-1 Sep 24 21:08:59.010984 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-c64de4fd-54d7-4535-90c3-8fb8b5e14f77 req-003267b4-514c-4653-847c-2080cbfcec44 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113789 Sep 24 21:08:59.017463 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2395/4790] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:08:59.036950 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4bdb50c3-3473-4b12-98d9-98319ffcbb4f tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:59.050794 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d514923e-6351-41e3-9f79-e3426b85e5f4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:59.053753 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d514923e-6351-41e3-9f79-e3426b85e5f4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] [instance: 0d546302-deb3-47c6-b9fd-3155ced00883] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:59.068993 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d514923e-6351-41e3-9f79-e3426b85e5f4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:59.088711 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d514923e-6351-41e3-9f79-e3426b85e5f4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:59.089167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d514923e-6351-41e3-9f79-e3426b85e5f4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:59.089786 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4bdb50c3-3473-4b12-98d9-98319ffcbb4f tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1498 microversion: 2.1 time: 0.483263 Sep 24 21:08:59.089925 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d514923e-6351-41e3-9f79-e3426b85e5f4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:59.094931 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2396/4791] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:58 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1498 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:59.097804 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d514923e-6351-41e3-9f79-e3426b85e5f4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:59.099516 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d514923e-6351-41e3-9f79-e3426b85e5f4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:59.120385 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-12b49632-190e-4808-98da-99bdab9636df tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:08:59.124959 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-d514923e-6351-41e3-9f79-e3426b85e5f4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] HTTP exception thrown: Instance 0d546302-deb3-47c6-b9fd-3155ced00883 could not be found. Sep 24 21:08:59.129842 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-12b49632-190e-4808-98da-99bdab9636df tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d514923e-6351-41e3-9f79-e3426b85e5f4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Request method failure captured: Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 HTTP/1.1 Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL29yHrVYRYwVIMWo2FFW4S-9sOLnTcN4ZPz2bIXXtjP3hR_rvMAsvdLWM0kalFDPOwMk_M10lFN-gbxnQwiJu4TSxB4ycd3rCGdKr5Nw8GDIx9wcghUlARhBCrxFGL7o-GhjN7quWX5q6oNDb9ZRd-9sEHZ12a6ieFkQm4pZttrgvsw Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: c1e5d6f3d41e4aa49e630f8c7ac87ded Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServerActionsTestJSON-1880156492 Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c1e5d6f3d41e4aa49e630f8c7ac87ded"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c1e5d6f3d41e4aa49e630f8c7ac87ded"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c1e5d6f3d41e4aa49e630f8c7ac87ded"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c1e5d6f3d41e4aa49e630f8c7ac87ded"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServerActionsTestJSON-1880156492 Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: c1e5d6f3d41e4aa49e630f8c7ac87ded Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServerActionsTestJSON-1880156492 Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServerActionsTestJSON-1880156492-project Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 6493da825aa24f43bdf8f0835a16e3bb Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServerActionsTestJSON-1880156492-project Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 0d546302-deb3-47c6-b9fd-3155ced00883 could not be found. Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '0d546302-deb3-47c6-b9fd-3155ced00883'} Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d546302-deb3-47c6-b9fd-3155ced00883 could not be found. Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d546302-deb3-47c6-b9fd-3155ced00883 could not be found. Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:08:59.139398 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:08:59.143160 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:08:59.143160 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:08:59.143160 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:08:59.143160 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:08:59.143160 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:08:59.143160 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d546302-deb3-47c6-b9fd-3155ced00883 could not be found. Sep 24 21:08:59.143160 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:08:59.145529 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-12b49632-190e-4808-98da-99bdab9636df tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:59.146055 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-12b49632-190e-4808-98da-99bdab9636df tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:59.147233 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-12b49632-190e-4808-98da-99bdab9636df tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:59.147781 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-12b49632-190e-4808-98da-99bdab9636df tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:59.148251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-12b49632-190e-4808-98da-99bdab9636df tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:59.148735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-12b49632-190e-4808-98da-99bdab9636df tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:59.150618 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d514923e-6351-41e3-9f79-e3426b85e5f4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Returning 404 to user: Instance 0d546302-deb3-47c6-b9fd-3155ced00883 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:08:59.156057 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d514923e-6351-41e3-9f79-e3426b85e5f4 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883" status: 404 len: 111 microversion: 2.1 time: 0.136324 Sep 24 21:08:59.157453 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2396/4792] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:59 2022] GET /compute/v2.1/servers/0d546302-deb3-47c6-b9fd-3155ced00883 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:08:59.165267 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e966ae70-cdd7-4101-a3cb-ca38e4269874 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] Calling method '.version_select at 0x7f4b0c8a4f70>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:59.185404 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-12b49632-190e-4808-98da-99bdab9636df tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lazy-loading 'flavor' on Instance uuid 0496cfe1-2be3-438a-965a-c2994623a96c {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:08:59.207785 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e966ae70-cdd7-4101-a3cb-ca38e4269874 tempest-ServerActionsTestJSON-1880156492 tempest-ServerActionsTestJSON-1880156492-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-93033218" status: 202 len: 0 microversion: 2.1 time: 0.046011 Sep 24 21:08:59.214832 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2397/4793] 10.222.0.52 () {58 vars in 1215 bytes} [Sat Sep 24 21:08:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-93033218 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:08:59.297050 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-12b49632-190e-4808-98da-99bdab9636df tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "POST /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c/action" status: 200 len: 32 microversion: 2.1 time: 0.181662 Sep 24 21:08:59.298355 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2397/4794] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:08:59 2022] POST /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c/action => generated 32 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 21:08:59.309299 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c4e0fddc-2c6d-41ed-aa06-81b4acc36883 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:59.309941 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c4e0fddc-2c6d-41ed-aa06-81b4acc36883 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:59.322880 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c4e0fddc-2c6d-41ed-aa06-81b4acc36883 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:59.323448 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c4e0fddc-2c6d-41ed-aa06-81b4acc36883 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:59.323902 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c4e0fddc-2c6d-41ed-aa06-81b4acc36883 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:59.324660 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c4e0fddc-2c6d-41ed-aa06-81b4acc36883 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:59.325410 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c4e0fddc-2c6d-41ed-aa06-81b4acc36883 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:59.325751 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c4e0fddc-2c6d-41ed-aa06-81b4acc36883 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:59.540763 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c4e0fddc-2c6d-41ed-aa06-81b4acc36883 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:08:59.559834 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c4e0fddc-2c6d-41ed-aa06-81b4acc36883 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1504 microversion: 2.1 time: 0.256027 Sep 24 21:08:59.560919 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2398/4795] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:59 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1504 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:08:59.922464 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-53a71b2b-899d-460a-af50-ad646116ee87 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:59.923911 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-53a71b2b-899d-460a-af50-ad646116ee87 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: 23ed2980-eb42-4f9e-b65e-77a238d7b976] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:59.930726 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-53a71b2b-899d-460a-af50-ad646116ee87 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:59.931571 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-53a71b2b-899d-460a-af50-ad646116ee87 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:59.932244 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-53a71b2b-899d-460a-af50-ad646116ee87 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:59.933198 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-53a71b2b-899d-460a-af50-ad646116ee87 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:08:59.933869 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-53a71b2b-899d-460a-af50-ad646116ee87 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:08:59.935469 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-53a71b2b-899d-460a-af50-ad646116ee87 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:08:59.960069 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-53a71b2b-899d-460a-af50-ad646116ee87 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] HTTP exception thrown: Instance 23ed2980-eb42-4f9e-b65e-77a238d7b976 could not be found. Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-53a71b2b-899d-460a-af50-ad646116ee87 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976 HTTP/1.1 Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 23ed2980-eb42-4f9e-b65e-77a238d7b976 could not be found. Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '23ed2980-eb42-4f9e-b65e-77a238d7b976'} Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23ed2980-eb42-4f9e-b65e-77a238d7b976 could not be found. Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23ed2980-eb42-4f9e-b65e-77a238d7b976 could not be found. Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:08:59.962197 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:08:59.967006 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:08:59.967006 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:08:59.967006 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:08:59.967006 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:08:59.967006 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:08:59.967006 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23ed2980-eb42-4f9e-b65e-77a238d7b976 could not be found. Sep 24 21:08:59.967006 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:08:59.969449 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-53a71b2b-899d-460a-af50-ad646116ee87 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 404 to user: Instance 23ed2980-eb42-4f9e-b65e-77a238d7b976 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:08:59.970664 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-53a71b2b-899d-460a-af50-ad646116ee87 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976" status: 404 len: 111 microversion: 2.1 time: 0.053852 Sep 24 21:08:59.971834 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2398/4796] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:59 2022] GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:08:59.986096 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f12c1e70-d812-4f1c-96d3-f1783f05881e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:08:59.986869 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f12c1e70-d812-4f1c-96d3-f1783f05881e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:08:59.995949 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f12c1e70-d812-4f1c-96d3-f1783f05881e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:00.004245 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f12c1e70-d812-4f1c-96d3-f1783f05881e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:00.004887 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f12c1e70-d812-4f1c-96d3-f1783f05881e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:00.005805 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f12c1e70-d812-4f1c-96d3-f1783f05881e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:00.006461 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f12c1e70-d812-4f1c-96d3-f1783f05881e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:00.007096 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f12c1e70-d812-4f1c-96d3-f1783f05881e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:00.521014 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f12c1e70-d812-4f1c-96d3-f1783f05881e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:00.530962 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f12c1e70-d812-4f1c-96d3-f1783f05881e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.553976 Sep 24 21:09:00.532273 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2399/4797] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:08:59 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:00.589769 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6f30dcb9-ca6c-4023-be42-a42de8e47b2b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:00.591814 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6f30dcb9-ca6c-4023-be42-a42de8e47b2b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:00.609537 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f30dcb9-ca6c-4023-be42-a42de8e47b2b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:00.611051 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f30dcb9-ca6c-4023-be42-a42de8e47b2b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:00.615837 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f30dcb9-ca6c-4023-be42-a42de8e47b2b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:00.617130 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f30dcb9-ca6c-4023-be42-a42de8e47b2b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:00.618776 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f30dcb9-ca6c-4023-be42-a42de8e47b2b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:00.622072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f30dcb9-ca6c-4023-be42-a42de8e47b2b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:00.738111 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-89e0ce89-b4ab-4f68-a3f2-8192ce1ddf0e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "4cf0d4ca-4d29-4d04-b103-2ecdbbb3545f"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-89e0ce89-b4ab-4f68-a3f2-8192ce1ddf0e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 163 Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: {"server": {"name": 12345, "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "4cf0d4ca-4d29-4d04-b103-2ecdbbb3545f"}]}} Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '4c30e8e9-8fb2-4377-83f1-98322cb17799', 'flavorRef': '452', 'networks': [{'uuid': '4cf0d4ca-4d29-4d04-b103-2ecdbbb3545f'}]}}} Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise error Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi 12345 Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 21:09:00.742924 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 21:09:00.748250 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 21:09:00.748250 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 24 21:09:00.748250 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:00.748250 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:00.748250 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:00.748250 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:00.748250 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:00.748250 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:00.748250 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 21:09:00.748250 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 21:09:00.748250 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 24 21:09:00.748250 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:00.748250 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-89e0ce89-b4ab-4f68-a3f2-8192ce1ddf0e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:09:00.748250 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-89e0ce89-b4ab-4f68-a3f2-8192ce1ddf0e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.010386 Sep 24 21:09:00.748250 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2400/4798] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:09:00 2022] POST /compute/v2.1/servers => generated 127 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 24 21:09:00.755507 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e9b1d6f6-d561-4e48-b099-e5a4b89706bf tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:00.756133 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e9b1d6f6-d561-4e48-b099-e5a4b89706bf tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:00.776059 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9b1d6f6-d561-4e48-b099-e5a4b89706bf tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:00.776951 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9b1d6f6-d561-4e48-b099-e5a4b89706bf tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:00.779632 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9b1d6f6-d561-4e48-b099-e5a4b89706bf tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:00.780853 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9b1d6f6-d561-4e48-b099-e5a4b89706bf tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:00.783570 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9b1d6f6-d561-4e48-b099-e5a4b89706bf tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:00.784077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9b1d6f6-d561-4e48-b099-e5a4b89706bf tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:01.006900 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6f30dcb9-ca6c-4023-be42-a42de8e47b2b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:01.024638 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6f30dcb9-ca6c-4023-be42-a42de8e47b2b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1504 microversion: 2.1 time: 0.440903 Sep 24 21:09:01.027577 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2399/4799] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:00 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1504 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:01.202514 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e9b1d6f6-d561-4e48-b099-e5a4b89706bf tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:01.217849 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e9b1d6f6-d561-4e48-b099-e5a4b89706bf tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.467408 Sep 24 21:09:01.219684 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2401/4800] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:00 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:01.247356 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c5f7a97c-be0a-4add-8b07-8209fab83376 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:01.248251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c5f7a97c-be0a-4add-8b07-8209fab83376 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:01.260704 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5f7a97c-be0a-4add-8b07-8209fab83376 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:01.261299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5f7a97c-be0a-4add-8b07-8209fab83376 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:01.265266 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5f7a97c-be0a-4add-8b07-8209fab83376 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:01.267231 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5f7a97c-be0a-4add-8b07-8209fab83376 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:01.267944 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5f7a97c-be0a-4add-8b07-8209fab83376 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:01.269156 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5f7a97c-be0a-4add-8b07-8209fab83376 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:01.541321 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c5f7a97c-be0a-4add-8b07-8209fab83376 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:01.549552 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c5f7a97c-be0a-4add-8b07-8209fab83376 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.306711 Sep 24 21:09:01.550154 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2400/4801] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:01 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:02.055078 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-109ca053-5698-44b8-9bd7-67a3c008fa14 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:02.058075 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-109ca053-5698-44b8-9bd7-67a3c008fa14 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:02.089259 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-109ca053-5698-44b8-9bd7-67a3c008fa14 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:02.089259 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-109ca053-5698-44b8-9bd7-67a3c008fa14 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:02.089590 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-109ca053-5698-44b8-9bd7-67a3c008fa14 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:02.090810 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-109ca053-5698-44b8-9bd7-67a3c008fa14 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:02.091304 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-109ca053-5698-44b8-9bd7-67a3c008fa14 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:02.091880 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-109ca053-5698-44b8-9bd7-67a3c008fa14 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:02.476178 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-109ca053-5698-44b8-9bd7-67a3c008fa14 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:02.487070 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-109ca053-5698-44b8-9bd7-67a3c008fa14 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1504 microversion: 2.1 time: 0.436264 Sep 24 21:09:02.492959 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2402/4802] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:02 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1504 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:03.265374 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ec792b85-1980-45a0-80fe-f0e2946816b4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:03.266337 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ec792b85-1980-45a0-80fe-f0e2946816b4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:03.278375 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ec792b85-1980-45a0-80fe-f0e2946816b4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:03.278890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ec792b85-1980-45a0-80fe-f0e2946816b4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:03.279327 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ec792b85-1980-45a0-80fe-f0e2946816b4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:03.295527 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ec792b85-1980-45a0-80fe-f0e2946816b4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:03.296498 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ec792b85-1980-45a0-80fe-f0e2946816b4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:03.300658 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ec792b85-1980-45a0-80fe-f0e2946816b4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:03.312323 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:09:03.514727 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-74b9592a-7ceb-41c2-bc84-0b5ac0775992 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:03.515489 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-74b9592a-7ceb-41c2-bc84-0b5ac0775992 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:03.523740 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-74b9592a-7ceb-41c2-bc84-0b5ac0775992 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:03.524373 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-74b9592a-7ceb-41c2-bc84-0b5ac0775992 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:03.524923 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-74b9592a-7ceb-41c2-bc84-0b5ac0775992 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:03.526061 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-74b9592a-7ceb-41c2-bc84-0b5ac0775992 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:03.526947 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-74b9592a-7ceb-41c2-bc84-0b5ac0775992 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:03.527507 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-74b9592a-7ceb-41c2-bc84-0b5ac0775992 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:03.661351 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ec792b85-1980-45a0-80fe-f0e2946816b4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:03.675853 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ec792b85-1980-45a0-80fe-f0e2946816b4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.415025 Sep 24 21:09:03.678900 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2401/4803] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:03 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:03.705650 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6ca9583e-43cb-4f43-b018-9ca8078bd6a2 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:03.706930 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6ca9583e-43cb-4f43-b018-9ca8078bd6a2 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:03.720946 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ca9583e-43cb-4f43-b018-9ca8078bd6a2 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:03.721835 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ca9583e-43cb-4f43-b018-9ca8078bd6a2 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:03.723826 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ca9583e-43cb-4f43-b018-9ca8078bd6a2 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:03.726595 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ca9583e-43cb-4f43-b018-9ca8078bd6a2 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:03.728184 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ca9583e-43cb-4f43-b018-9ca8078bd6a2 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:03.729321 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ca9583e-43cb-4f43-b018-9ca8078bd6a2 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:04.046331 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-74b9592a-7ceb-41c2-bc84-0b5ac0775992 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:04.058213 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-74b9592a-7ceb-41c2-bc84-0b5ac0775992 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1504 microversion: 2.1 time: 0.548815 Sep 24 21:09:04.060880 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2403/4804] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:03 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1504 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:04.066000 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6ca9583e-43cb-4f43-b018-9ca8078bd6a2 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:04.075189 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6ca9583e-43cb-4f43-b018-9ca8078bd6a2 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.375019 Sep 24 21:09:04.081970 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2402/4805] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:03 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:05.085695 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-38881ebb-ed28-4a99-8786-73206539c974 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:05.086332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-38881ebb-ed28-4a99-8786-73206539c974 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:05.100456 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38881ebb-ed28-4a99-8786-73206539c974 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:05.101256 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38881ebb-ed28-4a99-8786-73206539c974 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:05.101871 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38881ebb-ed28-4a99-8786-73206539c974 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:05.102984 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38881ebb-ed28-4a99-8786-73206539c974 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:05.115346 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38881ebb-ed28-4a99-8786-73206539c974 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:05.115811 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38881ebb-ed28-4a99-8786-73206539c974 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:05.602892 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-38881ebb-ed28-4a99-8786-73206539c974 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:05.612372 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-38881ebb-ed28-4a99-8786-73206539c974 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1504 microversion: 2.1 time: 0.531748 Sep 24 21:09:05.630933 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2404/4806] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:05 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1504 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:05.690091 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1261ab5a-d15b-4e42-adc2-56296cd62607 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:05.691327 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1261ab5a-d15b-4e42-adc2-56296cd62607 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:05.698533 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1261ab5a-d15b-4e42-adc2-56296cd62607 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:05.699041 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1261ab5a-d15b-4e42-adc2-56296cd62607 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:05.700046 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1261ab5a-d15b-4e42-adc2-56296cd62607 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:05.700825 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1261ab5a-d15b-4e42-adc2-56296cd62607 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:05.701501 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1261ab5a-d15b-4e42-adc2-56296cd62607 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:05.702023 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1261ab5a-d15b-4e42-adc2-56296cd62607 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:05.853692 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1261ab5a-d15b-4e42-adc2-56296cd62607 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:05.871118 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1261ab5a-d15b-4e42-adc2-56296cd62607 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.183990 Sep 24 21:09:05.876003 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2403/4807] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:05 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:05.907712 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-61c881d5-7abf-4eab-803e-0be483830a88 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:05.908583 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-61c881d5-7abf-4eab-803e-0be483830a88 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:05.917413 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-61c881d5-7abf-4eab-803e-0be483830a88 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:05.918261 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-61c881d5-7abf-4eab-803e-0be483830a88 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:05.918915 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-61c881d5-7abf-4eab-803e-0be483830a88 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:05.920914 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-61c881d5-7abf-4eab-803e-0be483830a88 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:05.923033 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-61c881d5-7abf-4eab-803e-0be483830a88 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:05.923920 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-61c881d5-7abf-4eab-803e-0be483830a88 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:06.108075 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-61c881d5-7abf-4eab-803e-0be483830a88 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:06.116656 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-61c881d5-7abf-4eab-803e-0be483830a88 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.213262 Sep 24 21:09:06.117242 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2405/4808] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:05 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:06.183410 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7843a854-3cb5-48e6-ab73-7a6305a18b40 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-8987223", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "4cf0d4ca-4d29-4d04-b103-2ecdbbb3545f"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7843a854-3cb5-48e6-ab73-7a6305a18b40 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 489 Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-8987223", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "4cf0d4ca-4d29-4d04-b103-2ecdbbb3545f"}]}} Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-8987223', 'imageRef': '4c30e8e9-8fb2-4377-83f1-98322cb17799', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '4cf0d4ca-4d29-4d04-b103-2ecdbbb3545f'}]}}} Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise error Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:06.188171 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Sep 24 21:09:06.191957 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Sep 24 21:09:06.191957 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:06.191957 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:06.191957 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:06.191957 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:06.191957 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:06.191957 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:06.191957 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:09:06.191957 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:09:06.191957 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:09:06.191957 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:09:06.191957 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:09:06.191957 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:09:06.191957 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 21:09:06.191957 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 21:09:06.191957 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 21:09:06.191957 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 21:09:06.191957 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 21:09:06.191957 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 21:09:06.191957 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 24 21:09:06.191957 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:06.191957 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:06.191957 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:06.191957 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:06.191957 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:06.191957 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:06.191957 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 21:09:06.191957 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 21:09:06.191957 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 24 21:09:06.191957 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:06.191957 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7843a854-3cb5-48e6-ab73-7a6305a18b40 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:09:06.191957 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7843a854-3cb5-48e6-ab73-7a6305a18b40 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.010258 Sep 24 21:09:06.200492 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fc22363e-0e83-4946-8a8d-ce02141248cb tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:06.201133 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fc22363e-0e83-4946-8a8d-ce02141248cb tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:06.207503 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc22363e-0e83-4946-8a8d-ce02141248cb tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:06.207769 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2404/4809] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:09:06 2022] POST /compute/v2.1/servers => generated 624 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:09:06.208207 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc22363e-0e83-4946-8a8d-ce02141248cb tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:06.215743 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc22363e-0e83-4946-8a8d-ce02141248cb tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:06.216888 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc22363e-0e83-4946-8a8d-ce02141248cb tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:06.217395 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc22363e-0e83-4946-8a8d-ce02141248cb tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:06.217879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc22363e-0e83-4946-8a8d-ce02141248cb tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:06.458233 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fc22363e-0e83-4946-8a8d-ce02141248cb tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:06.477236 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fc22363e-0e83-4946-8a8d-ce02141248cb tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.277506 Sep 24 21:09:06.479539 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2406/4810] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:06 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:09:06.505872 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f3008cb8-db53-4f7c-b65d-9691fdd73a56 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:06.506788 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f3008cb8-db53-4f7c-b65d-9691fdd73a56 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:06.536729 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f3008cb8-db53-4f7c-b65d-9691fdd73a56 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:06.538817 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f3008cb8-db53-4f7c-b65d-9691fdd73a56 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:06.539323 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f3008cb8-db53-4f7c-b65d-9691fdd73a56 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:06.541155 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f3008cb8-db53-4f7c-b65d-9691fdd73a56 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:06.541646 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f3008cb8-db53-4f7c-b65d-9691fdd73a56 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:06.545629 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f3008cb8-db53-4f7c-b65d-9691fdd73a56 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:06.636317 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b3a96697-f3df-45d7-a186-d3e454d8d14b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:06.638243 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b3a96697-f3df-45d7-a186-d3e454d8d14b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:06.649189 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b3a96697-f3df-45d7-a186-d3e454d8d14b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:06.649803 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b3a96697-f3df-45d7-a186-d3e454d8d14b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:06.650262 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b3a96697-f3df-45d7-a186-d3e454d8d14b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:06.652018 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b3a96697-f3df-45d7-a186-d3e454d8d14b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:06.653002 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b3a96697-f3df-45d7-a186-d3e454d8d14b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:06.653701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b3a96697-f3df-45d7-a186-d3e454d8d14b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:06.870472 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f3008cb8-db53-4f7c-b65d-9691fdd73a56 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:06.882059 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f3008cb8-db53-4f7c-b65d-9691fdd73a56 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.382274 Sep 24 21:09:06.883000 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2405/4811] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:06 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:06.928525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b3a96697-f3df-45d7-a186-d3e454d8d14b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:06.942152 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b3a96697-f3df-45d7-a186-d3e454d8d14b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1504 microversion: 2.1 time: 0.309657 Sep 24 21:09:06.944723 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2407/4812] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:06 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1504 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:06.962856 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0ef310ec-6fcc-4fdb-811c-ccf14cb1b907 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "4cf0d4ca-4d29-4d04-b103-2ecdbbb3545f"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0ef310ec-6fcc-4fdb-811c-ccf14cb1b907 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 416 Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "4cf0d4ca-4d29-4d04-b103-2ecdbbb3545f"}]}} Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '4c30e8e9-8fb2-4377-83f1-98322cb17799', 'flavorRef': '452', 'networks': [{'uuid': '4cf0d4ca-4d29-4d04-b103-2ecdbbb3545f'}]}}} Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise error Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:06.975430 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:06.979247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:06.979247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:06.979247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:06.979247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:06.979247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:09:06.979247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:09:06.979247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:09:06.979247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:09:06.979247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:09:06.979247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:09:06.979247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 21:09:06.979247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 21:09:06.979247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 21:09:06.979247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 21:09:06.979247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 21:09:06.979247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 21:09:06.979247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 24 21:09:06.979247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:06.979247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:06.979247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:06.979247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:06.979247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:06.979247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:06.979247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 21:09:06.979247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 21:09:06.979247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 24 21:09:06.979247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:06.979247 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0ef310ec-6fcc-4fdb-811c-ccf14cb1b907 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:09:06.979247 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0ef310ec-6fcc-4fdb-811c-ccf14cb1b907 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.018153 Sep 24 21:09:06.982061 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2406/4813] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:09:06 2022] POST /compute/v2.1/servers => generated 619 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:09:06.986380 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1eff66cc-4ef5-4095-b88b-5a2692602326 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:06.987729 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1eff66cc-4ef5-4095-b88b-5a2692602326 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:07.005098 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1eff66cc-4ef5-4095-b88b-5a2692602326 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:07.005821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1eff66cc-4ef5-4095-b88b-5a2692602326 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:07.010757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1eff66cc-4ef5-4095-b88b-5a2692602326 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:07.011709 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1eff66cc-4ef5-4095-b88b-5a2692602326 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:07.014658 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1eff66cc-4ef5-4095-b88b-5a2692602326 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:07.017959 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1eff66cc-4ef5-4095-b88b-5a2692602326 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:07.271304 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1eff66cc-4ef5-4095-b88b-5a2692602326 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:07.280303 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1eff66cc-4ef5-4095-b88b-5a2692602326 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.297673 Sep 24 21:09:07.305718 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2408/4814] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:06 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:07.314280 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-031915b7-2336-4a6f-b1e2-f1977a18782c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:07.315840 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-031915b7-2336-4a6f-b1e2-f1977a18782c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:07.327270 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-031915b7-2336-4a6f-b1e2-f1977a18782c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:07.328174 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-031915b7-2336-4a6f-b1e2-f1977a18782c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:07.328850 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-031915b7-2336-4a6f-b1e2-f1977a18782c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:07.329924 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-031915b7-2336-4a6f-b1e2-f1977a18782c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:07.331101 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-031915b7-2336-4a6f-b1e2-f1977a18782c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:07.331757 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-031915b7-2336-4a6f-b1e2-f1977a18782c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:07.864055 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-031915b7-2336-4a6f-b1e2-f1977a18782c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:07.898707 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-031915b7-2336-4a6f-b1e2-f1977a18782c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.591014 Sep 24 21:09:07.900000 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2407/4815] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:07 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:07.968426 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fb651b36-1498-4dda-b122-462661646978 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:07.969361 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fb651b36-1498-4dda-b122-462661646978 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:07.988537 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb651b36-1498-4dda-b122-462661646978 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:07.989988 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb651b36-1498-4dda-b122-462661646978 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:07.992887 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb651b36-1498-4dda-b122-462661646978 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:07.993780 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb651b36-1498-4dda-b122-462661646978 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:07.999160 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb651b36-1498-4dda-b122-462661646978 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:07.999621 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb651b36-1498-4dda-b122-462661646978 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:08.018702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-192e8945-93eb-415e-a0e4-9bea09e645be tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1940772510", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": -1, "networks": [{"uuid": "4cf0d4ca-4d29-4d04-b103-2ecdbbb3545f"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:09:08.043646 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-192e8945-93eb-415e-a0e4-9bea09e645be tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] HTTP exception thrown: Flavor -1 could not be found. Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-192e8945-93eb-415e-a0e4-9bea09e645be tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 206 Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1940772510", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": -1, "networks": [{"uuid": "4cf0d4ca-4d29-4d04-b103-2ecdbbb3545f"}]}} Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: exception: Flavor -1 could not be found. Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1940772510', 'imageRef': '4c30e8e9-8fb2-4377-83f1-98322cb17799', 'flavorRef': -1, 'networks': [{'uuid': '4cf0d4ca-4d29-4d04-b103-2ecdbbb3545f'}]}}} Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:09:08.049119 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:09:08.053069 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:09:08.053069 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:09:08.053069 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:09:08.053069 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:09:08.053069 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 24 21:09:08.053069 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 24 21:09:08.053069 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 24 21:09:08.053069 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Sep 24 21:09:08.053069 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:08.053069 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:08.053069 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:08.053069 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:08.053069 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:08.053069 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:08.053069 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:09:08.053069 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:09:08.053069 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Sep 24 21:09:08.053069 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:08.053069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-192e8945-93eb-415e-a0e4-9bea09e645be tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:09:08.053069 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-192e8945-93eb-415e-a0e4-9bea09e645be tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.037257 Sep 24 21:09:08.061515 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2408/4816] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:09:08 2022] POST /compute/v2.1/servers => generated 73 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 24 21:09:08.066990 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-854cdd6c-8a36-4074-8333-57c102ec470d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:08.075890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-854cdd6c-8a36-4074-8333-57c102ec470d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:08.088426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-854cdd6c-8a36-4074-8333-57c102ec470d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:08.091493 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-854cdd6c-8a36-4074-8333-57c102ec470d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:08.092924 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-854cdd6c-8a36-4074-8333-57c102ec470d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:08.094868 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-854cdd6c-8a36-4074-8333-57c102ec470d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:08.098049 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-854cdd6c-8a36-4074-8333-57c102ec470d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:08.098942 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-854cdd6c-8a36-4074-8333-57c102ec470d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:08.309721 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fb651b36-1498-4dda-b122-462661646978 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:08.329629 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fb651b36-1498-4dda-b122-462661646978 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1504 microversion: 2.1 time: 0.363357 Sep 24 21:09:08.340015 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2409/4817] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:07 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1504 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:08.376236 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-854cdd6c-8a36-4074-8333-57c102ec470d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:08.384164 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-854cdd6c-8a36-4074-8333-57c102ec470d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.321533 Sep 24 21:09:08.384734 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2409/4818] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:08 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:08.409675 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5cee55f5-cf19-4426-a01b-5fa0a0478fa6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:08.410304 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5cee55f5-cf19-4426-a01b-5fa0a0478fa6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:08.416749 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5cee55f5-cf19-4426-a01b-5fa0a0478fa6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:08.417489 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5cee55f5-cf19-4426-a01b-5fa0a0478fa6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:08.418753 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5cee55f5-cf19-4426-a01b-5fa0a0478fa6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:08.419854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5cee55f5-cf19-4426-a01b-5fa0a0478fa6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:08.420328 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5cee55f5-cf19-4426-a01b-5fa0a0478fa6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:08.420769 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5cee55f5-cf19-4426-a01b-5fa0a0478fa6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:08.675198 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5cee55f5-cf19-4426-a01b-5fa0a0478fa6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:08.686248 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5cee55f5-cf19-4426-a01b-5fa0a0478fa6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.280663 Sep 24 21:09:08.713915 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2410/4819] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:08 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:08.817297 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ea342aec-2140-4a73-821d-b374dd66ce85 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1954800506", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "4cf0d4ca-4d29-4d04-b103-2ecdbbb3545f"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ea342aec-2140-4a73-821d-b374dd66ce85 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 173 Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1954800506", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "4cf0d4ca-4d29-4d04-b103-2ecdbbb3545f"}]}} Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1954800506', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '4cf0d4ca-4d29-4d04-b103-2ecdbbb3545f'}]}}} Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise error Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi -1 Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 21:09:08.821819 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 21:09:08.826109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 21:09:08.826109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 21:09:08.826109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 21:09:08.826109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 24 21:09:08.826109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:08.826109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:08.826109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:08.826109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:08.826109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:08.826109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:08.826109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 21:09:08.826109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 21:09:08.826109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 24 21:09:08.826109 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:08.826109 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ea342aec-2140-4a73-821d-b374dd66ce85 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:09:08.826109 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ea342aec-2140-4a73-821d-b374dd66ce85 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.010121 Sep 24 21:09:08.826109 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2410/4820] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:09:08 2022] POST /compute/v2.1/servers => generated 145 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:09:08.832382 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a095edba-9bf9-4d1f-953a-12d78df39da0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:08.833136 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a095edba-9bf9-4d1f-953a-12d78df39da0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:08.839628 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a095edba-9bf9-4d1f-953a-12d78df39da0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:08.841414 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a095edba-9bf9-4d1f-953a-12d78df39da0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:08.841867 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a095edba-9bf9-4d1f-953a-12d78df39da0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:08.843018 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a095edba-9bf9-4d1f-953a-12d78df39da0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:08.843633 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a095edba-9bf9-4d1f-953a-12d78df39da0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:08.844209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a095edba-9bf9-4d1f-953a-12d78df39da0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:09.003883 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a095edba-9bf9-4d1f-953a-12d78df39da0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:09.012277 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a095edba-9bf9-4d1f-953a-12d78df39da0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.183650 Sep 24 21:09:09.023016 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2411/4821] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:08 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:09.038558 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c876144a-273c-4d4c-a672-11c4ee04669e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:09.039253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c876144a-273c-4d4c-a672-11c4ee04669e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:09.047649 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c876144a-273c-4d4c-a672-11c4ee04669e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:09.048150 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c876144a-273c-4d4c-a672-11c4ee04669e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:09.048618 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c876144a-273c-4d4c-a672-11c4ee04669e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:09.049635 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c876144a-273c-4d4c-a672-11c4ee04669e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:09.050098 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c876144a-273c-4d4c-a672-11c4ee04669e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:09.050587 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c876144a-273c-4d4c-a672-11c4ee04669e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:09.114039 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-96546830-b258-4dd3-a37b-732f1baa3086 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:09.114567 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-96546830-b258-4dd3-a37b-732f1baa3086 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 2fc426bb-02cf-4911-9f74-93866eb1868a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:09.128081 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96546830-b258-4dd3-a37b-732f1baa3086 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:09.128503 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96546830-b258-4dd3-a37b-732f1baa3086 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:09.129214 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96546830-b258-4dd3-a37b-732f1baa3086 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:09.130409 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96546830-b258-4dd3-a37b-732f1baa3086 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:09.131657 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96546830-b258-4dd3-a37b-732f1baa3086 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:09.133263 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96546830-b258-4dd3-a37b-732f1baa3086 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:09.159675 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:09:09.172883 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-96546830-b258-4dd3-a37b-732f1baa3086 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a/ips" status: 200 len: 150 microversion: 2.1 time: 0.062579 Sep 24 21:09:09.173714 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2412/4822] 10.222.0.52 () {58 vars in 1248 bytes} [Sat Sep 24 21:09:09 2022] GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a/ips => generated 150 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:09:09.304253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c876144a-273c-4d4c-a672-11c4ee04669e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:09.317620 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c876144a-273c-4d4c-a672-11c4ee04669e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.283395 Sep 24 21:09:09.319873 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2411/4823] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:09 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:09.357649 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ab58eb7f-1c59-4f5b-afa5-c1dc55b2dcce tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:09.358483 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ab58eb7f-1c59-4f5b-afa5-c1dc55b2dcce tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:09.368615 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ab58eb7f-1c59-4f5b-afa5-c1dc55b2dcce tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:09.369610 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ab58eb7f-1c59-4f5b-afa5-c1dc55b2dcce tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:09.370776 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ab58eb7f-1c59-4f5b-afa5-c1dc55b2dcce tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:09.373378 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ab58eb7f-1c59-4f5b-afa5-c1dc55b2dcce tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:09.374085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ab58eb7f-1c59-4f5b-afa5-c1dc55b2dcce tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:09.376456 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ab58eb7f-1c59-4f5b-afa5-c1dc55b2dcce tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:09.472590 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-44efc1b2-a7b8-416c-9232-1cb373954a8d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-97245077", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:09:09.482170 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-44efc1b2-a7b8-416c-9232-1cb373954a8d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-44efc1b2-a7b8-416c-9232-1cb373954a8d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 214 Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-97245077", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-97245077', 'imageRef': '4c30e8e9-8fb2-4377-83f1-98322cb17799', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._validate_network_id( Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:09.490095 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:09.499827 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:09.499827 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:09.499827 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:09.499827 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:09.499827 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:09:09.499827 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:09:09.499827 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 24 21:09:09.499827 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:09.499827 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-44efc1b2-a7b8-416c-9232-1cb373954a8d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:09:09.499827 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-44efc1b2-a7b8-416c-9232-1cb373954a8d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.025829 Sep 24 21:09:09.499827 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2412/4824] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:09:09 2022] POST /compute/v2.1/servers => generated 123 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 24 21:09:09.513600 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-18217a27-fe0b-4c83-864c-ce7488fd8885 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:09.514571 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-18217a27-fe0b-4c83-864c-ce7488fd8885 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:09.528954 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-18217a27-fe0b-4c83-864c-ce7488fd8885 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:09.529698 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-18217a27-fe0b-4c83-864c-ce7488fd8885 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:09.530392 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-18217a27-fe0b-4c83-864c-ce7488fd8885 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:09.531344 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-18217a27-fe0b-4c83-864c-ce7488fd8885 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:09.532408 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-18217a27-fe0b-4c83-864c-ce7488fd8885 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:09.533048 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-18217a27-fe0b-4c83-864c-ce7488fd8885 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:09.698242 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ab58eb7f-1c59-4f5b-afa5-c1dc55b2dcce tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:09.715992 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ab58eb7f-1c59-4f5b-afa5-c1dc55b2dcce tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1504 microversion: 2.1 time: 0.362460 Sep 24 21:09:09.719101 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2413/4825] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:09 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1504 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:09.799877 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-18217a27-fe0b-4c83-864c-ce7488fd8885 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:09.815899 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-18217a27-fe0b-4c83-864c-ce7488fd8885 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.317185 Sep 24 21:09:09.817714 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2413/4826] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:09 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:09.841001 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a79a4a18-19a0-41e0-a61b-fbbf21bed004 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:09.841633 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a79a4a18-19a0-41e0-a61b-fbbf21bed004 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:09.887571 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a79a4a18-19a0-41e0-a61b-fbbf21bed004 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:09.890710 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a79a4a18-19a0-41e0-a61b-fbbf21bed004 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:09.891413 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a79a4a18-19a0-41e0-a61b-fbbf21bed004 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:09.892392 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a79a4a18-19a0-41e0-a61b-fbbf21bed004 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:09.894794 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a79a4a18-19a0-41e0-a61b-fbbf21bed004 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:09.896953 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a79a4a18-19a0-41e0-a61b-fbbf21bed004 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:10.053776 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0713e5a9-0e0f-47ff-a409-484800da8250 tempest-QuotasTestJSON-71753034 tempest-QuotasTestJSON-71753034-project] Calling method '.version_select at 0x7f4b075c91f0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:10.126110 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0713e5a9-0e0f-47ff-a409-484800da8250 tempest-QuotasTestJSON-71753034 tempest-QuotasTestJSON-71753034-project] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/1aa2a7852b3646a28ddf1ecc9c17513a/defaults" status: 200 len: 371 microversion: 2.1 time: 0.257551 Sep 24 21:09:10.134031 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2414/4827] 10.222.0.52 () {58 vars in 1269 bytes} [Sat Sep 24 21:09:09 2022] GET /compute/v2.1/os-quota-sets/1aa2a7852b3646a28ddf1ecc9c17513a/defaults => generated 371 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:09:10.139421 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-60fd3449-8b7a-470a-b180-868cff465970 tempest-QuotasTestJSON-71753034 tempest-QuotasTestJSON-71753034-project] Calling method '.version_select at 0x7f4b0c2f1d30>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:10.197322 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a79a4a18-19a0-41e0-a61b-fbbf21bed004 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:10.207011 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a79a4a18-19a0-41e0-a61b-fbbf21bed004 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.369788 Sep 24 21:09:10.207607 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2414/4828] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:09 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:10.219239 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-60fd3449-8b7a-470a-b180-868cff465970 tempest-QuotasTestJSON-71753034 tempest-QuotasTestJSON-71753034-project] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/1aa2a7852b3646a28ddf1ecc9c17513a" status: 200 len: 371 microversion: 2.1 time: 0.082117 Sep 24 21:09:10.219239 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2415/4829] 10.222.0.52 () {58 vars in 1242 bytes} [Sat Sep 24 21:09:10 2022] GET /compute/v2.1/os-quota-sets/1aa2a7852b3646a28ddf1ecc9c17513a => generated 371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:09:10.232673 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1ff272d4-cae2-44e6-afe8-59dfc5c8c712 tempest-QuotasTestJSON-71753034 tempest-QuotasTestJSON-71753034-project] Calling method '.version_select at 0x7f4b07e96b80>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:10.317668 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1ff272d4-cae2-44e6-afe8-59dfc5c8c712 tempest-QuotasTestJSON-71753034 tempest-QuotasTestJSON-71753034-project] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/1aa2a7852b3646a28ddf1ecc9c17513a/defaults" status: 200 len: 371 microversion: 2.1 time: 0.089344 Sep 24 21:09:10.318582 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2415/4830] 10.222.0.52 () {58 vars in 1269 bytes} [Sat Sep 24 21:09:10 2022] GET /compute/v2.1/os-quota-sets/1aa2a7852b3646a28ddf1ecc9c17513a/defaults => generated 371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:09:10.336491 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-51a01dbd-429e-4813-9279-273a293065ad tempest-QuotasTestJSON-71753034 tempest-QuotasTestJSON-71753034-project] Calling method '.version_select at 0x7f4b075f70d0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:10.390602 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-70d92df0-05be-464c-968c-cb3e57747b63 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1611937526", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "key_name": "tempest-key-1319143130", "networks": [{"uuid": "4cf0d4ca-4d29-4d04-b103-2ecdbbb3545f"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:09:10.491752 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-70d92df0-05be-464c-968c-cb3e57747b63 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] validate_networks() for [('4cf0d4ca-4d29-4d04-b103-2ecdbbb3545f', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:09:10.499926 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-51a01dbd-429e-4813-9279-273a293065ad tempest-QuotasTestJSON-71753034 tempest-QuotasTestJSON-71753034-project] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/1aa2a7852b3646a28ddf1ecc9c17513a" status: 200 len: 371 microversion: 2.1 time: 0.167091 Sep 24 21:09:10.510068 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2416/4831] 10.222.0.52 () {58 vars in 1242 bytes} [Sat Sep 24 21:09:10 2022] GET /compute/v2.1/os-quota-sets/1aa2a7852b3646a28ddf1ecc9c17513a => generated 371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:09:10.517306 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-adf54b5f-8b3e-41cf-a443-7bccf9f5ddb3 tempest-QuotasTestJSON-71753034 tempest-QuotasTestJSON-71753034-project] Calling method '.version_select at 0x7f4b075e80d0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:10.620004 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-adf54b5f-8b3e-41cf-a443-7bccf9f5ddb3 tempest-QuotasTestJSON-71753034 tempest-QuotasTestJSON-71753034-project] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/1aa2a7852b3646a28ddf1ecc9c17513a?user_id=7ab52927e8594b4f8ffb59e014292a49" status: 200 len: 371 microversion: 2.1 time: 0.108583 Sep 24 21:09:10.621629 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2417/4832] 10.222.0.52 () {58 vars in 1323 bytes} [Sat Sep 24 21:09:10 2022] GET /compute/v2.1/os-quota-sets/1aa2a7852b3646a28ddf1ecc9c17513a?user_id=7ab52927e8594b4f8ffb59e014292a49 => generated 371 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:09:10.744941 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bc2fda1d-9245-47bc-8e2f-0434c368fdfa tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:10.745746 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-bc2fda1d-9245-47bc-8e2f-0434c368fdfa tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:10.755746 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bc2fda1d-9245-47bc-8e2f-0434c368fdfa tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:10.756265 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bc2fda1d-9245-47bc-8e2f-0434c368fdfa tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:10.756724 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bc2fda1d-9245-47bc-8e2f-0434c368fdfa tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:10.757462 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bc2fda1d-9245-47bc-8e2f-0434c368fdfa tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:10.757930 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bc2fda1d-9245-47bc-8e2f-0434c368fdfa tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:10.758370 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bc2fda1d-9245-47bc-8e2f-0434c368fdfa tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:11.370488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-bc2fda1d-9245-47bc-8e2f-0434c368fdfa tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:11.384227 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bc2fda1d-9245-47bc-8e2f-0434c368fdfa tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1504 microversion: 2.1 time: 0.643324 Sep 24 21:09:11.398955 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2418/4833] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:10 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1504 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:09:11.403667 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fa1acb8d-2f36-4814-8a04-7a643b9653be tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:11.404298 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fa1acb8d-2f36-4814-8a04-7a643b9653be tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 2fc426bb-02cf-4911-9f74-93866eb1868a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:11.411584 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fa1acb8d-2f36-4814-8a04-7a643b9653be tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:11.412056 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fa1acb8d-2f36-4814-8a04-7a643b9653be tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:11.412707 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fa1acb8d-2f36-4814-8a04-7a643b9653be tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:11.413570 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fa1acb8d-2f36-4814-8a04-7a643b9653be tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:11.417163 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fa1acb8d-2f36-4814-8a04-7a643b9653be tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:11.418403 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fa1acb8d-2f36-4814-8a04-7a643b9653be tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:11.455595 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fa1acb8d-2f36-4814-8a04-7a643b9653be tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 2fc426bb-02cf-4911-9f74-93866eb1868a] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:09:11.539572 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-70d92df0-05be-464c-968c-cb3e57747b63 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] HTTP exception thrown: Invalid key_name provided. Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-70d92df0-05be-464c-968c-cb3e57747b63 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 247 Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1611937526", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "key_name": "tempest-key-1319143130", "networks": [{"uuid": "4cf0d4ca-4d29-4d04-b103-2ecdbbb3545f"}]}} Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: exception: Invalid key_name provided. Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1611937526', 'imageRef': '4c30e8e9-8fb2-4377-83f1-98322cb17799', 'flavorRef': '452', 'key_name': 'tempest-key-1319143130', 'networks': [{'uuid': '4cf0d4ca-4d29-4d04-b103-2ecdbbb3545f'}]}}} Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1319143130 not found for user a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:11.542218 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:11.546743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:11.546743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:09:11.546743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:09:11.546743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:09:11.546743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:09:11.546743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:09:11.546743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:09:11.546743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:09:11.546743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:09:11.546743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:09:11.546743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:09:11.546743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 24 21:09:11.546743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Sep 24 21:09:11.546743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 24 21:09:11.546743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Sep 24 21:09:11.546743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:11.546743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:11.546743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:11.546743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:11.546743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:11.546743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:11.546743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:09:11.546743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:09:11.546743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Sep 24 21:09:11.546743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:11.549321 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-70d92df0-05be-464c-968c-cb3e57747b63 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 400 to user: Invalid key_name provided. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:09:11.550376 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-70d92df0-05be-464c-968c-cb3e57747b63 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.166063 Sep 24 21:09:11.551460 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2416/4834] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:09:10 2022] POST /compute/v2.1/servers => generated 70 bytes in 1168 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 24 21:09:11.560102 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-75aa2211-f0ec-4e4b-8e72-89330962a9ff tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:11.561357 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-75aa2211-f0ec-4e4b-8e72-89330962a9ff tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:11.582906 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75aa2211-f0ec-4e4b-8e72-89330962a9ff tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:11.584150 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75aa2211-f0ec-4e4b-8e72-89330962a9ff tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:11.584900 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75aa2211-f0ec-4e4b-8e72-89330962a9ff tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:11.586079 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75aa2211-f0ec-4e4b-8e72-89330962a9ff tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:11.591483 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75aa2211-f0ec-4e4b-8e72-89330962a9ff tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:11.592118 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75aa2211-f0ec-4e4b-8e72-89330962a9ff tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:11.592818 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fa1acb8d-2f36-4814-8a04-7a643b9653be tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a" status: 204 len: 0 microversion: 2.1 time: 0.205469 Sep 24 21:09:11.594176 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2419/4835] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:09:11 2022] DELETE /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:09:11.604737 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5d3a6f3b-cbb6-4ed1-89a4-f7c7cd018c77 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:11.606137 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5d3a6f3b-cbb6-4ed1-89a4-f7c7cd018c77 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 2fc426bb-02cf-4911-9f74-93866eb1868a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:11.613336 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d3a6f3b-cbb6-4ed1-89a4-f7c7cd018c77 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:11.616629 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d3a6f3b-cbb6-4ed1-89a4-f7c7cd018c77 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:11.616629 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d3a6f3b-cbb6-4ed1-89a4-f7c7cd018c77 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:11.616629 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d3a6f3b-cbb6-4ed1-89a4-f7c7cd018c77 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:11.617175 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d3a6f3b-cbb6-4ed1-89a4-f7c7cd018c77 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:11.617690 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d3a6f3b-cbb6-4ed1-89a4-f7c7cd018c77 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:11.999109 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-75aa2211-f0ec-4e4b-8e72-89330962a9ff tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:12.004035 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5d3a6f3b-cbb6-4ed1-89a4-f7c7cd018c77 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:12.012996 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-75aa2211-f0ec-4e4b-8e72-89330962a9ff tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.457095 Sep 24 21:09:12.017520 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2417/4836] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:11 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:12.028027 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5d3a6f3b-cbb6-4ed1-89a4-f7c7cd018c77 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a" status: 200 len: 1682 microversion: 2.1 time: 0.425901 Sep 24 21:09:12.029719 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2420/4837] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:11 2022] GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a => generated 1682 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:12.051742 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a4292237-f4dd-4634-bab2-9b852db663b1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:12.052820 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a4292237-f4dd-4634-bab2-9b852db663b1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:12.063298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4292237-f4dd-4634-bab2-9b852db663b1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:12.063812 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4292237-f4dd-4634-bab2-9b852db663b1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:12.064264 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4292237-f4dd-4634-bab2-9b852db663b1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:12.064993 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4292237-f4dd-4634-bab2-9b852db663b1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:12.065458 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4292237-f4dd-4634-bab2-9b852db663b1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:12.066865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4292237-f4dd-4634-bab2-9b852db663b1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:12.409880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e6395b16-d691-4159-ae26-e76d32d7c9e0 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:12.410570 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e6395b16-d691-4159-ae26-e76d32d7c9e0 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:12.421987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6395b16-d691-4159-ae26-e76d32d7c9e0 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:12.422985 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6395b16-d691-4159-ae26-e76d32d7c9e0 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:12.425862 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a4292237-f4dd-4634-bab2-9b852db663b1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:12.426208 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6395b16-d691-4159-ae26-e76d32d7c9e0 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:12.427183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6395b16-d691-4159-ae26-e76d32d7c9e0 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:12.427814 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6395b16-d691-4159-ae26-e76d32d7c9e0 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:12.428787 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6395b16-d691-4159-ae26-e76d32d7c9e0 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:12.441674 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a4292237-f4dd-4634-bab2-9b852db663b1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.394974 Sep 24 21:09:12.480043 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2418/4838] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:12 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:12.666304 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7dc6c889-975b-4735-ae48-dbf58499880d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1934154930", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "4cf0d4ca-4d29-4d04-b103-2ecdbbb3545f"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:09:12.871867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e6395b16-d691-4159-ae26-e76d32d7c9e0 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:12.883839 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e6395b16-d691-4159-ae26-e76d32d7c9e0 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1504 microversion: 2.1 time: 0.475308 Sep 24 21:09:12.884815 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2421/4839] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:12 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1504 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:12.900276 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.security_group_api [None req-7dc6c889-975b-4735-ae48-dbf58499880d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Neutron security group does_not_exist not found {{(pid=140517) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Sep 24 21:09:12.900974 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-7dc6c889-975b-4735-ae48-dbf58499880d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7dc6c889-975b-4735-ae48-dbf58499880d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 258 Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1934154930", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "4cf0d4ca-4d29-4d04-b103-2ecdbbb3545f"}]}} Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: exception: Unable to find security_group with name or id 'does_not_exist' Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1934154930', 'imageRef': '4c30e8e9-8fb2-4377-83f1-98322cb17799', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '4cf0d4ca-4d29-4d04-b103-2ecdbbb3545f'}]}}} Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Sep 24 21:09:12.909735 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Sep 24 21:09:12.914010 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:12.919730 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7dc6c889-975b-4735-ae48-dbf58499880d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:09:12.920808 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7dc6c889-975b-4735-ae48-dbf58499880d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.259220 Sep 24 21:09:12.925480 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2419/4840] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:09:12 2022] POST /compute/v2.1/servers => generated 106 bytes in 264 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:09:12.930338 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8c3052d8-2ac3-4410-885b-89848d26f764 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:12.930992 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8c3052d8-2ac3-4410-885b-89848d26f764 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:12.944717 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c3052d8-2ac3-4410-885b-89848d26f764 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:12.945509 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c3052d8-2ac3-4410-885b-89848d26f764 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:12.946178 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c3052d8-2ac3-4410-885b-89848d26f764 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:12.947148 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c3052d8-2ac3-4410-885b-89848d26f764 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:12.947846 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c3052d8-2ac3-4410-885b-89848d26f764 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:12.948488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c3052d8-2ac3-4410-885b-89848d26f764 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:13.066760 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-82c2f6f3-ef08-43fd-8c7a-5de52bf27415 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:13.067627 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-82c2f6f3-ef08-43fd-8c7a-5de52bf27415 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 2fc426bb-02cf-4911-9f74-93866eb1868a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:13.076589 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82c2f6f3-ef08-43fd-8c7a-5de52bf27415 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:13.077438 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82c2f6f3-ef08-43fd-8c7a-5de52bf27415 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:13.078134 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82c2f6f3-ef08-43fd-8c7a-5de52bf27415 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:13.079607 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82c2f6f3-ef08-43fd-8c7a-5de52bf27415 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:13.080499 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82c2f6f3-ef08-43fd-8c7a-5de52bf27415 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:13.081169 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82c2f6f3-ef08-43fd-8c7a-5de52bf27415 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:13.276644 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8c3052d8-2ac3-4410-885b-89848d26f764 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:13.288350 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8c3052d8-2ac3-4410-885b-89848d26f764 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.361968 Sep 24 21:09:13.304063 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2422/4841] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:12 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:09:13.425982 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-82c2f6f3-ef08-43fd-8c7a-5de52bf27415 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:13.434949 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-82c2f6f3-ef08-43fd-8c7a-5de52bf27415 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a" status: 200 len: 1682 microversion: 2.1 time: 0.382238 Sep 24 21:09:13.436245 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2420/4842] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:13 2022] GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a => generated 1682 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:09:13.441429 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b97235c1-1ed5-49b3-ab5f-2966166da2ac tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:13.442235 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b97235c1-1ed5-49b3-ab5f-2966166da2ac tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:13.448570 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b97235c1-1ed5-49b3-ab5f-2966166da2ac tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:13.450309 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b97235c1-1ed5-49b3-ab5f-2966166da2ac tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:13.450973 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b97235c1-1ed5-49b3-ab5f-2966166da2ac tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:13.451869 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b97235c1-1ed5-49b3-ab5f-2966166da2ac tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:13.452674 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b97235c1-1ed5-49b3-ab5f-2966166da2ac tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:13.453276 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b97235c1-1ed5-49b3-ab5f-2966166da2ac tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:13.501325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f2923498-796e-465a-8127-ca76c7e9e16f tempest-VolumesSnapshotsTestJSON-384710423 tempest-VolumesSnapshotsTestJSON-384710423-project] Action: 'create', calling method: .version_select at 0x7f4b075bb940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-540624455"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:09:13.696166 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b97235c1-1ed5-49b3-ab5f-2966166da2ac tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:13.708207 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b97235c1-1ed5-49b3-ab5f-2966166da2ac tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.270499 Sep 24 21:09:13.709898 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2421/4843] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:13 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:13.742488 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-424d10c9-a49a-4b16-a21f-961aa0cde446 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:13.743092 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-424d10c9-a49a-4b16-a21f-961aa0cde446 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: e774c8b8-a165-4568-83e5-e2f72d10db52] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:13.752809 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-424d10c9-a49a-4b16-a21f-961aa0cde446 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] HTTP exception thrown: Instance e774c8b8-a165-4568-83e5-e2f72d10db52 could not be found. Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-424d10c9-a49a-4b16-a21f-961aa0cde446 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/servers/e774c8b8-a165-4568-83e5-e2f72d10db52 HTTP/1.1 Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance e774c8b8-a165-4568-83e5-e2f72d10db52 could not be found. Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'e774c8b8-a165-4568-83e5-e2f72d10db52'} Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e774c8b8-a165-4568-83e5-e2f72d10db52 could not be found. Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e774c8b8-a165-4568-83e5-e2f72d10db52 could not be found. Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:13.754826 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:13.759697 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:13.759697 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:13.759697 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:13.759697 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:13.759697 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:09:13.759697 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:09:13.759697 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e774c8b8-a165-4568-83e5-e2f72d10db52 could not be found. Sep 24 21:09:13.759697 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:13.762636 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-424d10c9-a49a-4b16-a21f-961aa0cde446 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 404 to user: Instance e774c8b8-a165-4568-83e5-e2f72d10db52 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:09:13.763820 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-424d10c9-a49a-4b16-a21f-961aa0cde446 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e774c8b8-a165-4568-83e5-e2f72d10db52" status: 404 len: 111 microversion: 2.1 time: 0.034238 Sep 24 21:09:13.764510 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2422/4844] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:09:13 2022] DELETE /compute/v2.1/servers/e774c8b8-a165-4568-83e5-e2f72d10db52 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:09:13.774396 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4c1b2871-33c9-493d-931e-c1bba9bef231 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:13.775261 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4c1b2871-33c9-493d-931e-c1bba9bef231 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:13.784503 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4c1b2871-33c9-493d-931e-c1bba9bef231 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:13.785171 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4c1b2871-33c9-493d-931e-c1bba9bef231 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:13.785760 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4c1b2871-33c9-493d-931e-c1bba9bef231 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:13.786939 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4c1b2871-33c9-493d-931e-c1bba9bef231 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:13.787543 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4c1b2871-33c9-493d-931e-c1bba9bef231 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:13.788287 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4c1b2871-33c9-493d-931e-c1bba9bef231 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:13.956529 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f2923498-796e-465a-8127-ca76c7e9e16f tempest-VolumesSnapshotsTestJSON-384710423 tempest-VolumesSnapshotsTestJSON-384710423-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 337 microversion: 2.1 time: 0.650899 Sep 24 21:09:13.957167 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2423/4845] 10.222.0.52 () {60 vars in 1155 bytes} [Sat Sep 24 21:09:13 2022] POST /compute/v2.1/os-volumes => generated 337 bytes in 653 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 24 21:09:13.969276 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-468b9be5-4019-4dcd-9c3b-5d96cbe92520 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:13.969981 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-468b9be5-4019-4dcd-9c3b-5d96cbe92520 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:13.980498 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-468b9be5-4019-4dcd-9c3b-5d96cbe92520 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:13.981342 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-468b9be5-4019-4dcd-9c3b-5d96cbe92520 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:13.982132 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-468b9be5-4019-4dcd-9c3b-5d96cbe92520 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:13.983069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-468b9be5-4019-4dcd-9c3b-5d96cbe92520 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:13.983745 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-468b9be5-4019-4dcd-9c3b-5d96cbe92520 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:13.984443 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-468b9be5-4019-4dcd-9c3b-5d96cbe92520 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:14.057692 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4c1b2871-33c9-493d-931e-c1bba9bef231 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:14.068058 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4c1b2871-33c9-493d-931e-c1bba9bef231 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.298868 Sep 24 21:09:14.069117 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2423/4846] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:13 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:14.099184 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-905c2439-f1ae-4fa9-bdc4-cc7e309f8233 tempest-VolumesSnapshotsTestJSON-384710423 tempest-VolumesSnapshotsTestJSON-384710423-project] Calling method '.version_select at 0x7f4b07bd8b80>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:14.156803 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-905c2439-f1ae-4fa9-bdc4-cc7e309f8233 tempest-VolumesSnapshotsTestJSON-384710423 tempest-VolumesSnapshotsTestJSON-384710423-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/1d7eabde-cd37-4d6f-8c3b-66e3ceae6af9" status: 200 len: 334 microversion: 2.1 time: 0.085564 Sep 24 21:09:14.157738 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2424/4847] 10.222.0.52 () {58 vars in 1245 bytes} [Sat Sep 24 21:09:14 2022] GET /compute/v2.1/os-volumes/1d7eabde-cd37-4d6f-8c3b-66e3ceae6af9 => generated 334 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:09:14.165522 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-94efa661-a359-4c61-899e-1bb888beda3d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:14.167203 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-94efa661-a359-4c61-899e-1bb888beda3d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:14.183244 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-94efa661-a359-4c61-899e-1bb888beda3d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:14.194113 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-94efa661-a359-4c61-899e-1bb888beda3d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:14.195693 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-94efa661-a359-4c61-899e-1bb888beda3d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:14.198890 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-94efa661-a359-4c61-899e-1bb888beda3d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:14.200645 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-94efa661-a359-4c61-899e-1bb888beda3d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:14.205193 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-94efa661-a359-4c61-899e-1bb888beda3d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:14.259590 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-468b9be5-4019-4dcd-9c3b-5d96cbe92520 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:14.269531 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-468b9be5-4019-4dcd-9c3b-5d96cbe92520 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1504 microversion: 2.1 time: 0.311090 Sep 24 21:09:14.273538 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2424/4848] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:13 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1504 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:14.469666 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c8aa31ef-787d-4616-a8ff-ce3c1ed4f56e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:14.471530 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c8aa31ef-787d-4616-a8ff-ce3c1ed4f56e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 2fc426bb-02cf-4911-9f74-93866eb1868a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:14.483174 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8aa31ef-787d-4616-a8ff-ce3c1ed4f56e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:14.484084 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8aa31ef-787d-4616-a8ff-ce3c1ed4f56e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:14.484597 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8aa31ef-787d-4616-a8ff-ce3c1ed4f56e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:14.485443 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8aa31ef-787d-4616-a8ff-ce3c1ed4f56e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:14.485967 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8aa31ef-787d-4616-a8ff-ce3c1ed4f56e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:14.486774 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8aa31ef-787d-4616-a8ff-ce3c1ed4f56e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:14.489102 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-94efa661-a359-4c61-899e-1bb888beda3d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:14.500792 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-94efa661-a359-4c61-899e-1bb888beda3d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.341557 Sep 24 21:09:14.501643 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2425/4849] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:14 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:14.527427 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6d4c5321-527a-475b-98bd-db3fd4759e03 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:14.528068 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6d4c5321-527a-475b-98bd-db3fd4759e03 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Failed to fetch instance by id 9223372036854775808 {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 24 21:09:14.528595 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-6d4c5321-527a-475b-98bd-db3fd4759e03 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6d4c5321-527a-475b-98bd-db3fd4759e03 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 9223372036854775808 could not be found. Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '9223372036854775808'} Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:14.530090 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:14.538467 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:14.538467 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:09:14.538467 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:09:14.538467 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Sep 24 21:09:14.538467 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:14.538467 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6d4c5321-527a-475b-98bd-db3fd4759e03 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:09:14.538467 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6d4c5321-527a-475b-98bd-db3fd4759e03 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.008902 Sep 24 21:09:14.538467 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2426/4850] 10.222.0.52 () {58 vars in 1188 bytes} [Sat Sep 24 21:09:14 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 21:09:14.547455 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b2ae9daf-0b4e-44d6-b7ea-65dfefdb7ef1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:14.548159 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b2ae9daf-0b4e-44d6-b7ea-65dfefdb7ef1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:14.563908 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2ae9daf-0b4e-44d6-b7ea-65dfefdb7ef1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:14.564410 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2ae9daf-0b4e-44d6-b7ea-65dfefdb7ef1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:14.564854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2ae9daf-0b4e-44d6-b7ea-65dfefdb7ef1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:14.565580 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2ae9daf-0b4e-44d6-b7ea-65dfefdb7ef1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:14.566043 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2ae9daf-0b4e-44d6-b7ea-65dfefdb7ef1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:14.566476 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b2ae9daf-0b4e-44d6-b7ea-65dfefdb7ef1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:14.665172 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c8aa31ef-787d-4616-a8ff-ce3c1ed4f56e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:14.683452 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c8aa31ef-787d-4616-a8ff-ce3c1ed4f56e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a" status: 200 len: 1615 microversion: 2.1 time: 0.222784 Sep 24 21:09:14.698915 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2425/4851] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:14 2022] GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a => generated 1615 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:09:14.953501 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-bf7a879b-edb9-45be-b599-962a2b28887a req-eda9fd1e-a432-42e9-bd74-ab45639d5319 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fc426bb-02cf-4911-9f74-93866eb1868a", "name": "network-vif-deleted", "tag": "258619fb-3f57-4b71-bb4e-ac577a68a7fc"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:09:14.988673 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-bf7a879b-edb9-45be-b599-962a2b28887a req-eda9fd1e-a432-42e9-bd74-ab45639d5319 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:14.990392 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b2ae9daf-0b4e-44d6-b7ea-65dfefdb7ef1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:14.991214 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-bf7a879b-edb9-45be-b599-962a2b28887a req-eda9fd1e-a432-42e9-bd74-ab45639d5319 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:14.993804 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-bf7a879b-edb9-45be-b599-962a2b28887a req-eda9fd1e-a432-42e9-bd74-ab45639d5319 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:15.001417 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b2ae9daf-0b4e-44d6-b7ea-65dfefdb7ef1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.463763 Sep 24 21:09:15.006586 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2427/4852] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:14 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:15.013828 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:09:15.033168 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cb7ad282-ac9f-43b2-abba-98d0706d574a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:15.034053 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cb7ad282-ac9f-43b2-abba-98d0706d574a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:15.049578 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-bf7a879b-edb9-45be-b599-962a2b28887a req-eda9fd1e-a432-42e9-bd74-ab45639d5319 service nova] Creating event network-vif-deleted:258619fb-3f57-4b71-bb4e-ac577a68a7fc for instance 2fc426bb-02cf-4911-9f74-93866eb1868a on nch1-master-1 Sep 24 21:09:15.050551 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cb7ad282-ac9f-43b2-abba-98d0706d574a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:15.051927 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cb7ad282-ac9f-43b2-abba-98d0706d574a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:15.053531 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cb7ad282-ac9f-43b2-abba-98d0706d574a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:15.055522 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cb7ad282-ac9f-43b2-abba-98d0706d574a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:15.058063 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cb7ad282-ac9f-43b2-abba-98d0706d574a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:15.062336 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cb7ad282-ac9f-43b2-abba-98d0706d574a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:15.074300 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-bf7a879b-edb9-45be-b599-962a2b28887a req-eda9fd1e-a432-42e9-bd74-ab45639d5319 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121234 Sep 24 21:09:15.076779 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2426/4853] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:09:15.189203 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-af1362e9-9faa-4231-9a67-7e3614d4d21a tempest-VolumesSnapshotsTestJSON-384710423 tempest-VolumesSnapshotsTestJSON-384710423-project] Calling method '.version_select at 0x7f4b075be550>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:15.307813 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-af1362e9-9faa-4231-9a67-7e3614d4d21a tempest-VolumesSnapshotsTestJSON-384710423 tempest-VolumesSnapshotsTestJSON-384710423-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/1d7eabde-cd37-4d6f-8c3b-66e3ceae6af9" status: 200 len: 334 microversion: 2.1 time: 0.136545 Sep 24 21:09:15.309269 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2427/4854] 10.222.0.52 () {58 vars in 1245 bytes} [Sat Sep 24 21:09:15 2022] GET /compute/v2.1/os-volumes/1d7eabde-cd37-4d6f-8c3b-66e3ceae6af9 => generated 334 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:09:15.321602 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-446565bc-befb-457a-9ba3-4f3d57feca3a tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:15.322673 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-446565bc-befb-457a-9ba3-4f3d57feca3a tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:15.335563 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-446565bc-befb-457a-9ba3-4f3d57feca3a tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:15.343535 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-446565bc-befb-457a-9ba3-4f3d57feca3a tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:15.344072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-446565bc-befb-457a-9ba3-4f3d57feca3a tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:15.345315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-446565bc-befb-457a-9ba3-4f3d57feca3a tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:15.345960 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-446565bc-befb-457a-9ba3-4f3d57feca3a tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:15.346586 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-446565bc-befb-457a-9ba3-4f3d57feca3a tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:15.376965 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cb7ad282-ac9f-43b2-abba-98d0706d574a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:15.393521 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cb7ad282-ac9f-43b2-abba-98d0706d574a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.365885 Sep 24 21:09:15.415567 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2428/4855] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:15 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:15.428163 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6c9f05b2-8515-4cb0-90a7-c61a858840ac tempest-VolumesSnapshotsTestJSON-384710423 tempest-VolumesSnapshotsTestJSON-384710423-project] Calling method '.version_select at 0x7f4b07ecf0d0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:15.588447 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-446565bc-befb-457a-9ba3-4f3d57feca3a tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:15.602618 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-446565bc-befb-457a-9ba3-4f3d57feca3a tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1504 microversion: 2.1 time: 0.290802 Sep 24 21:09:15.620868 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2428/4856] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:15 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1504 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:15.639858 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-838352ef-017a-48e4-86c5-8f7d6027c7f6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:15.640847 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-838352ef-017a-48e4-86c5-8f7d6027c7f6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Failed to fetch instance by id -1 {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 24 21:09:15.641718 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-838352ef-017a-48e4-86c5-8f7d6027c7f6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] HTTP exception thrown: Instance -1 could not be found. Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-838352ef-017a-48e4-86c5-8f7d6027c7f6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance -1 could not be found. Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '-1'} Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:15.644002 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:15.648896 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:09:15.648896 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:09:15.648896 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Sep 24 21:09:15.648896 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:15.663756 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-838352ef-017a-48e4-86c5-8f7d6027c7f6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 404 to user: Instance -1 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:09:15.665224 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-838352ef-017a-48e4-86c5-8f7d6027c7f6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.041839 Sep 24 21:09:15.667156 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2429/4857] 10.222.0.52 () {58 vars in 1137 bytes} [Sat Sep 24 21:09:15 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 21:09:15.676830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3c3fa006-0040-4ed0-9a00-695d04059daa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:15.677909 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3c3fa006-0040-4ed0-9a00-695d04059daa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:15.687312 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6c9f05b2-8515-4cb0-90a7-c61a858840ac tempest-VolumesSnapshotsTestJSON-384710423 tempest-VolumesSnapshotsTestJSON-384710423-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/1d7eabde-cd37-4d6f-8c3b-66e3ceae6af9" status: 202 len: 0 microversion: 2.1 time: 0.269222 Sep 24 21:09:15.687892 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2429/4858] 10.222.0.52 () {58 vars in 1248 bytes} [Sat Sep 24 21:09:15 2022] DELETE /compute/v2.1/os-volumes/1d7eabde-cd37-4d6f-8c3b-66e3ceae6af9 => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:09:15.691217 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c3fa006-0040-4ed0-9a00-695d04059daa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:15.691217 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c3fa006-0040-4ed0-9a00-695d04059daa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:15.691450 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c3fa006-0040-4ed0-9a00-695d04059daa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:15.691969 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c3fa006-0040-4ed0-9a00-695d04059daa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:15.692434 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c3fa006-0040-4ed0-9a00-695d04059daa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:15.692869 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c3fa006-0040-4ed0-9a00-695d04059daa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:15.695711 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5daecfcf-9966-4d0b-a75f-953ab73c2ca8 tempest-VolumesSnapshotsTestJSON-384710423 tempest-VolumesSnapshotsTestJSON-384710423-project] Calling method '.version_select at 0x7f4b0c767a60>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:15.774800 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-5daecfcf-9966-4d0b-a75f-953ab73c2ca8 tempest-VolumesSnapshotsTestJSON-384710423 tempest-VolumesSnapshotsTestJSON-384710423-project] HTTP exception thrown: Volume 1d7eabde-cd37-4d6f-8c3b-66e3ceae6af9 could not be found. Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5daecfcf-9966-4d0b-a75f-953ab73c2ca8 tempest-VolumesSnapshotsTestJSON-384710423 tempest-VolumesSnapshotsTestJSON-384710423-project] Request method failure captured: Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/os-volumes/1d7eabde-cd37-4d6f-8c3b-66e3ceae6af9 HTTP/1.1 Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3H4HWqaT6IflijzNcPE7ZSmd9X3_610ov_BxnnvJkQes_pie1Bc7erjAUUkS6adu3NMLFZSeVcLUeESlDNnf1Bio5iDQYjr2KL_txFAp_SX0yItOkFEQ0o2VQacDBi4TH3ScfoS31DNHrIsuinZpciEoBHtI2y8MobBWVxjPjRHqNs Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: c4ff4a00aa31492e9dd9c89044491436 Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-384710423 Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4ff4a00aa31492e9dd9c89044491436"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4ff4a00aa31492e9dd9c89044491436"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4ff4a00aa31492e9dd9c89044491436"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4ff4a00aa31492e9dd9c89044491436"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-VolumesSnapshotsTestJSON-384710423 Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: c4ff4a00aa31492e9dd9c89044491436 Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-384710423 Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-VolumesSnapshotsTestJSON-384710423-project Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: d85cf31166d04a4892e26eee76951762 Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-VolumesSnapshotsTestJSON-384710423-project Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: exception: Volume 1d7eabde-cd37-4d6f-8c3b-66e3ceae6af9 could not be found. Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '1d7eabde-cd37-4d6f-8c3b-66e3ceae6af9'} Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1d7eabde-cd37-4d6f-8c3b-66e3ceae6af9 could not be found. (HTTP 404) (Request-ID: req-e3ab24c7-294d-4c68-ba28-0a69bac3eb8a) Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 24 21:09:15.809915 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 21:09:15.814420 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 21:09:15.814420 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 24 21:09:15.814420 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 24 21:09:15.814420 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 24 21:09:15.814420 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 24 21:09:15.814420 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 21:09:15.814420 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 21:09:15.814420 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 21:09:15.814420 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 21:09:15.814420 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 21:09:15.814420 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 21:09:15.814420 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 21:09:15.814420 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 21:09:15.814420 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1d7eabde-cd37-4d6f-8c3b-66e3ceae6af9 could not be found. Sep 24 21:09:15.814420 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:15.814420 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:15.814420 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:15.814420 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:15.814420 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:15.814420 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:15.814420 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:09:15.814420 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:09:15.814420 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:09:15.814420 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:09:15.814420 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:09:15.814420 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:09:15.814420 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 24 21:09:15.814420 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:09:15.814420 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1d7eabde-cd37-4d6f-8c3b-66e3ceae6af9 could not be found. Sep 24 21:09:15.814420 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:15.814420 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:15.814420 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:15.814420 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:15.814420 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:15.814420 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:15.814420 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:09:15.814420 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:09:15.814420 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1d7eabde-cd37-4d6f-8c3b-66e3ceae6af9 could not be found. Sep 24 21:09:15.814420 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:15.818132 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5daecfcf-9966-4d0b-a75f-953ab73c2ca8 tempest-VolumesSnapshotsTestJSON-384710423 tempest-VolumesSnapshotsTestJSON-384710423-project] Returning 404 to user: Volume 1d7eabde-cd37-4d6f-8c3b-66e3ceae6af9 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:09:15.818132 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5daecfcf-9966-4d0b-a75f-953ab73c2ca8 tempest-VolumesSnapshotsTestJSON-384710423 tempest-VolumesSnapshotsTestJSON-384710423-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/1d7eabde-cd37-4d6f-8c3b-66e3ceae6af9" status: 404 len: 109 microversion: 2.1 time: 0.124858 Sep 24 21:09:15.818132 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2430/4859] 10.222.0.52 () {58 vars in 1245 bytes} [Sat Sep 24 21:09:15 2022] GET /compute/v2.1/os-volumes/1d7eabde-cd37-4d6f-8c3b-66e3ceae6af9 => generated 109 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:09:15.846389 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c10642f2-4eca-48da-88f9-63ebe1e98d7e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:15.847168 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c10642f2-4eca-48da-88f9-63ebe1e98d7e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 2fc426bb-02cf-4911-9f74-93866eb1868a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:15.875423 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c10642f2-4eca-48da-88f9-63ebe1e98d7e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:15.878111 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c10642f2-4eca-48da-88f9-63ebe1e98d7e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:15.878644 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c10642f2-4eca-48da-88f9-63ebe1e98d7e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:15.879712 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c10642f2-4eca-48da-88f9-63ebe1e98d7e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:15.880518 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c10642f2-4eca-48da-88f9-63ebe1e98d7e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:15.882328 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c10642f2-4eca-48da-88f9-63ebe1e98d7e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:15.937255 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-c10642f2-4eca-48da-88f9-63ebe1e98d7e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] HTTP exception thrown: Instance 2fc426bb-02cf-4911-9f74-93866eb1868a could not be found. Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c10642f2-4eca-48da-88f9-63ebe1e98d7e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Request method failure captured: Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a HTTP/1.1 Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3FHajgQDXwDLPMdCneYsWMRO5KNyPHbfz7MOl1V6BQj2tCeZ2BgA1Mx3ktQ4m5HdNZhq5ppxGBz6lcC3ya-83mTOrwZRf93lvlUCMm9tAmwFMDFSArAIXGx5zWOL9fV8cMG0WLcDOQ7UmGyVIS3hmxMWF5HkXywVAOGRIZ6csTGTS0 Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: ede438e67af3496cae36fc89abc0aba3 Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-AttachVolumeNegativeTest-1729429408 Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ede438e67af3496cae36fc89abc0aba3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ede438e67af3496cae36fc89abc0aba3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ede438e67af3496cae36fc89abc0aba3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ede438e67af3496cae36fc89abc0aba3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-AttachVolumeNegativeTest-1729429408 Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: ede438e67af3496cae36fc89abc0aba3 Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1729429408 Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-AttachVolumeNegativeTest-1729429408-project Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 370b057b12c148cdbb673ba6c06bd6b4 Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-AttachVolumeNegativeTest-1729429408-project Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 2fc426bb-02cf-4911-9f74-93866eb1868a could not be found. Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '2fc426bb-02cf-4911-9f74-93866eb1868a'} Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fc426bb-02cf-4911-9f74-93866eb1868a could not be found. Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fc426bb-02cf-4911-9f74-93866eb1868a could not be found. Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:15.939307 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:15.943507 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:15.943507 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:15.943507 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:15.943507 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:09:15.943507 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:09:15.943507 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fc426bb-02cf-4911-9f74-93866eb1868a could not be found. Sep 24 21:09:15.943507 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:15.946193 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c10642f2-4eca-48da-88f9-63ebe1e98d7e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Returning 404 to user: Instance 2fc426bb-02cf-4911-9f74-93866eb1868a could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:09:15.947341 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c10642f2-4eca-48da-88f9-63ebe1e98d7e tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a" status: 404 len: 111 microversion: 2.1 time: 0.121265 Sep 24 21:09:15.948254 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2431/4860] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:15 2022] GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:09:15.959331 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e6acbaa3-2369-4119-85b1-61800875306c tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '.version_select at 0x7f4b07bd8dc0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:15.984872 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e6acbaa3-2369-4119-85b1-61800875306c tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1049484806" status: 202 len: 0 microversion: 2.1 time: 0.029696 Sep 24 21:09:15.987658 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3c3fa006-0040-4ed0-9a00-695d04059daa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:15.991155 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2432/4861] 10.222.0.52 () {58 vars in 1221 bytes} [Sat Sep 24 21:09:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1049484806 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:09:16.006399 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3c3fa006-0040-4ed0-9a00-695d04059daa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.330358 Sep 24 21:09:16.007881 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2430/4862] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:15 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:09:16.036512 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-33981907-6742-44e1-af79-b41677043dcf tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:16.038053 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-33981907-6742-44e1-af79-b41677043dcf tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:16.062736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33981907-6742-44e1-af79-b41677043dcf tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:16.063270 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33981907-6742-44e1-af79-b41677043dcf tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:16.063733 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33981907-6742-44e1-af79-b41677043dcf tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:16.064528 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33981907-6742-44e1-af79-b41677043dcf tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:16.083572 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33981907-6742-44e1-af79-b41677043dcf tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:16.084121 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33981907-6742-44e1-af79-b41677043dcf tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:16.485909 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-33981907-6742-44e1-af79-b41677043dcf tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:16.495138 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-33981907-6742-44e1-af79-b41677043dcf tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.463774 Sep 24 21:09:16.497605 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2433/4863] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:16 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:16.520497 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e8277b25-279e-44e3-bbb7-347af6635ef7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:09:16.521351 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e8277b25-279e-44e3-bbb7-347af6635ef7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: 3599f3f4-705e-4b34-a882-d494204c4105] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:16.534177 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-e8277b25-279e-44e3-bbb7-347af6635ef7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] HTTP exception thrown: Instance 3599f3f4-705e-4b34-a882-d494204c4105 could not be found. Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e8277b25-279e-44e3-bbb7-347af6635ef7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/servers/3599f3f4-705e-4b34-a882-d494204c4105/action HTTP/1.1 Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 19 Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: {"forceDelete": {}} Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 3599f3f4-705e-4b34-a882-d494204c4105 could not be found. Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '3599f3f4-705e-4b34-a882-d494204c4105', 'body': {'forceDelete': {}}} Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3599f3f4-705e-4b34-a882-d494204c4105 could not be found. Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3599f3f4-705e-4b34-a882-d494204c4105 could not be found. Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:16.540531 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:16.545011 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:09:16.545011 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:09:16.545011 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3599f3f4-705e-4b34-a882-d494204c4105 could not be found. Sep 24 21:09:16.545011 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:16.552336 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e8277b25-279e-44e3-bbb7-347af6635ef7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 404 to user: Instance 3599f3f4-705e-4b34-a882-d494204c4105 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:09:16.553833 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e8277b25-279e-44e3-bbb7-347af6635ef7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers/3599f3f4-705e-4b34-a882-d494204c4105/action" status: 404 len: 111 microversion: 2.1 time: 0.037360 Sep 24 21:09:16.558045 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2431/4864] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:09:16 2022] POST /compute/v2.1/servers/3599f3f4-705e-4b34-a882-d494204c4105/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:09:16.566892 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fb8fa52c-92f8-4206-8a85-31765a14599e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:16.567525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fb8fa52c-92f8-4206-8a85-31765a14599e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:16.585682 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb8fa52c-92f8-4206-8a85-31765a14599e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:16.586378 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb8fa52c-92f8-4206-8a85-31765a14599e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:16.587008 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb8fa52c-92f8-4206-8a85-31765a14599e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:16.587909 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb8fa52c-92f8-4206-8a85-31765a14599e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:16.588539 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb8fa52c-92f8-4206-8a85-31765a14599e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:16.589297 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb8fa52c-92f8-4206-8a85-31765a14599e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:16.629037 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-831d1546-83f3-443e-9490-061a7f694316 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:16.630807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-831d1546-83f3-443e-9490-061a7f694316 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:16.647547 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-831d1546-83f3-443e-9490-061a7f694316 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:16.648525 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-831d1546-83f3-443e-9490-061a7f694316 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:16.650459 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-831d1546-83f3-443e-9490-061a7f694316 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:16.652848 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-831d1546-83f3-443e-9490-061a7f694316 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:16.653729 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-831d1546-83f3-443e-9490-061a7f694316 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:16.654389 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-831d1546-83f3-443e-9490-061a7f694316 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:17.397616 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fb8fa52c-92f8-4206-8a85-31765a14599e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:17.408928 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fb8fa52c-92f8-4206-8a85-31765a14599e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.845733 Sep 24 21:09:17.410256 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2434/4865] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:16 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:17.434991 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-831d1546-83f3-443e-9490-061a7f694316 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:17.437337 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-19d7b529-4ef7-4af3-bec8-08bd84de334d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:17.437963 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-19d7b529-4ef7-4af3-bec8-08bd84de334d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:17.444330 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:09:17.446111 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-19d7b529-4ef7-4af3-bec8-08bd84de334d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:17.447071 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-19d7b529-4ef7-4af3-bec8-08bd84de334d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:17.447810 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-19d7b529-4ef7-4af3-bec8-08bd84de334d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:17.448819 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-19d7b529-4ef7-4af3-bec8-08bd84de334d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:17.450182 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-19d7b529-4ef7-4af3-bec8-08bd84de334d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:17.450942 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-19d7b529-4ef7-4af3-bec8-08bd84de334d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:17.452365 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-831d1546-83f3-443e-9490-061a7f694316 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1504 microversion: 2.1 time: 0.828663 Sep 24 21:09:17.453800 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2432/4866] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:16 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1504 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:17.821017 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-19d7b529-4ef7-4af3-bec8-08bd84de334d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:17.821288 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cdb2903e-5510-4646-acbc-4966061e4fa4 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Action: 'create', calling method: .version_select at 0x7f4b075be5e0>, body: {"keypair": {"name": "tempest-keypair-1860547824", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7Mr76v1gwUAznUaUMJtJOnjFtnWtGYX6xU+GipE5BTTrkxkef7prvvCW8SG0ChyzImVb67lJyKov1pdd4rZfpvniglArDlc++Car5rjk5164PmHXOyl11GxIR0YwyIBA=="}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:09:17.829362 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-19d7b529-4ef7-4af3-bec8-08bd84de334d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.397522 Sep 24 21:09:17.830490 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2435/4867] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:17 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:17.841026 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-cdb2903e-5510-4646-acbc-4966061e4fa4 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Getting quotas for project ede438e67af3496cae36fc89abc0aba3. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:09:17.847794 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-cdb2903e-5510-4646-acbc-4966061e4fa4 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Getting quotas for user 370b057b12c148cdbb673ba6c06bd6b4 and project ede438e67af3496cae36fc89abc0aba3. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:09:17.854348 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-426fa796-1580-400a-9616-3616f857d0c5 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:09:17.857778 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-426fa796-1580-400a-9616-3616f857d0c5 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: 85d71c30-b476-4d29-8010-28f5ca94767c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:17.865225 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-426fa796-1580-400a-9616-3616f857d0c5 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] HTTP exception thrown: Instance 85d71c30-b476-4d29-8010-28f5ca94767c could not be found. Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-426fa796-1580-400a-9616-3616f857d0c5 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers/85d71c30-b476-4d29-8010-28f5ca94767c/action HTTP/1.1 Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 39 Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: {"os-getConsoleOutput": {"length": 10}} Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 85d71c30-b476-4d29-8010-28f5ca94767c could not be found. Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '85d71c30-b476-4d29-8010-28f5ca94767c', 'body': {'os-getConsoleOutput': {'length': 10}}} Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85d71c30-b476-4d29-8010-28f5ca94767c could not be found. Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85d71c30-b476-4d29-8010-28f5ca94767c could not be found. Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:17.871500 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:17.876319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:17.876319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:17.876319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:09:17.876319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:09:17.876319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85d71c30-b476-4d29-8010-28f5ca94767c could not be found. Sep 24 21:09:17.876319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:17.876319 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-426fa796-1580-400a-9616-3616f857d0c5 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 404 to user: Instance 85d71c30-b476-4d29-8010-28f5ca94767c could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:09:17.876319 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-426fa796-1580-400a-9616-3616f857d0c5 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers/85d71c30-b476-4d29-8010-28f5ca94767c/action" status: 404 len: 111 microversion: 2.1 time: 0.025177 Sep 24 21:09:17.878684 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2436/4868] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:09:17 2022] POST /compute/v2.1/servers/85d71c30-b476-4d29-8010-28f5ca94767c/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 21:09:17.882724 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cdb2903e-5510-4646-acbc-4966061e4fa4 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.065270 Sep 24 21:09:17.884535 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2433/4869] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 21:09:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:09:17.890790 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-56a9ee3c-4568-4e43-972e-1394d3ef0cf6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:17.891632 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-56a9ee3c-4568-4e43-972e-1394d3ef0cf6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:17.898366 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-56a9ee3c-4568-4e43-972e-1394d3ef0cf6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:17.898903 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-56a9ee3c-4568-4e43-972e-1394d3ef0cf6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:17.899328 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-56a9ee3c-4568-4e43-972e-1394d3ef0cf6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:17.900029 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-56a9ee3c-4568-4e43-972e-1394d3ef0cf6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:17.900497 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-56a9ee3c-4568-4e43-972e-1394d3ef0cf6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:17.900911 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-56a9ee3c-4568-4e43-972e-1394d3ef0cf6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:18.176226 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-56a9ee3c-4568-4e43-972e-1394d3ef0cf6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:18.185701 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-56a9ee3c-4568-4e43-972e-1394d3ef0cf6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.301470 Sep 24 21:09:18.193301 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2437/4870] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:17 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:18.216517 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ce3dc155-04c7-483a-977d-15962e6665db tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:18.217504 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ce3dc155-04c7-483a-977d-15962e6665db tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:18.224203 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ce3dc155-04c7-483a-977d-15962e6665db tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:18.224938 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ce3dc155-04c7-483a-977d-15962e6665db tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:18.225383 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ce3dc155-04c7-483a-977d-15962e6665db tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:18.226292 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ce3dc155-04c7-483a-977d-15962e6665db tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:18.226951 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ce3dc155-04c7-483a-977d-15962e6665db tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:18.227540 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ce3dc155-04c7-483a-977d-15962e6665db tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:18.475890 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0c16105e-c310-4777-a6e2-fa2a6500bb20 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:18.477029 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0c16105e-c310-4777-a6e2-fa2a6500bb20 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:18.484372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ce3dc155-04c7-483a-977d-15962e6665db tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:18.491181 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c16105e-c310-4777-a6e2-fa2a6500bb20 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:18.491701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c16105e-c310-4777-a6e2-fa2a6500bb20 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:18.492210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c16105e-c310-4777-a6e2-fa2a6500bb20 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:18.498639 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ce3dc155-04c7-483a-977d-15962e6665db tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.285942 Sep 24 21:09:18.499227 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2434/4871] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:18 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:18.521814 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c16105e-c310-4777-a6e2-fa2a6500bb20 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:18.522554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c16105e-c310-4777-a6e2-fa2a6500bb20 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:18.525615 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c16105e-c310-4777-a6e2-fa2a6500bb20 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:18.528082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-94889e2e-29f4-4a67-8ed4-f042306985ea tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:18.528791 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-94889e2e-29f4-4a67-8ed4-f042306985ea tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: 58b75908-39e3-4559-872b-ba20cb9eb3d7] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:18.536651 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-94889e2e-29f4-4a67-8ed4-f042306985ea tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] HTTP exception thrown: Instance 58b75908-39e3-4559-872b-ba20cb9eb3d7 could not be found. Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-94889e2e-29f4-4a67-8ed4-f042306985ea tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/58b75908-39e3-4559-872b-ba20cb9eb3d7 HTTP/1.1 Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 58b75908-39e3-4559-872b-ba20cb9eb3d7 could not be found. Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '58b75908-39e3-4559-872b-ba20cb9eb3d7'} Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58b75908-39e3-4559-872b-ba20cb9eb3d7 could not be found. Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58b75908-39e3-4559-872b-ba20cb9eb3d7 could not be found. Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:18.538234 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:18.544103 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:18.544103 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:09:18.544103 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:09:18.544103 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58b75908-39e3-4559-872b-ba20cb9eb3d7 could not be found. Sep 24 21:09:18.544103 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:18.544103 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-94889e2e-29f4-4a67-8ed4-f042306985ea tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 404 to user: Instance 58b75908-39e3-4559-872b-ba20cb9eb3d7 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:09:18.544103 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-94889e2e-29f4-4a67-8ed4-f042306985ea tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/58b75908-39e3-4559-872b-ba20cb9eb3d7" status: 404 len: 111 microversion: 2.1 time: 0.016794 Sep 24 21:09:18.544103 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2435/4872] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:18 2022] GET /compute/v2.1/servers/58b75908-39e3-4559-872b-ba20cb9eb3d7 => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:09:18.549526 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c4237e46-8088-4dda-aeac-6851991fe07a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:18.550223 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c4237e46-8088-4dda-aeac-6851991fe07a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:18.557693 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4237e46-8088-4dda-aeac-6851991fe07a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:18.558308 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4237e46-8088-4dda-aeac-6851991fe07a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:18.559233 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4237e46-8088-4dda-aeac-6851991fe07a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:18.560174 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4237e46-8088-4dda-aeac-6851991fe07a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:18.561062 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4237e46-8088-4dda-aeac-6851991fe07a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:18.561684 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4237e46-8088-4dda-aeac-6851991fe07a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:18.982856 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c4237e46-8088-4dda-aeac-6851991fe07a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:18.999143 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c4237e46-8088-4dda-aeac-6851991fe07a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.447810 Sep 24 21:09:19.010360 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0c16105e-c310-4777-a6e2-fa2a6500bb20 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:19.018885 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2436/4873] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:18 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:19.040306 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0834b54b-e32b-456e-8910-34864a5f5f93 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:19.040946 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0834b54b-e32b-456e-8910-34864a5f5f93 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:19.041117 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0c16105e-c310-4777-a6e2-fa2a6500bb20 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1504 microversion: 2.1 time: 0.562565 Sep 24 21:09:19.042278 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2438/4874] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:18 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1504 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:09:19.047010 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:09:19.052841 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0834b54b-e32b-456e-8910-34864a5f5f93 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:19.058350 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0834b54b-e32b-456e-8910-34864a5f5f93 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:19.060116 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0834b54b-e32b-456e-8910-34864a5f5f93 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:19.064268 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0834b54b-e32b-456e-8910-34864a5f5f93 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:19.065086 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0834b54b-e32b-456e-8910-34864a5f5f93 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:19.065532 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0834b54b-e32b-456e-8910-34864a5f5f93 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:19.690168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0834b54b-e32b-456e-8910-34864a5f5f93 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:19.702947 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0834b54b-e32b-456e-8910-34864a5f5f93 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.675351 Sep 24 21:09:19.704431 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2437/4875] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:19 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:19.931490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-55c7e037-7c80-4005-8699-e19729df5bb8 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1628294124", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "4cf0d4ca-4d29-4d04-b103-2ecdbbb3545f"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-55c7e037-7c80-4005-8699-e19729df5bb8 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 238 Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1628294124", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "4cf0d4ca-4d29-4d04-b103-2ecdbbb3545f"}]}} Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1628294124', 'imageRef': '4c30e8e9-8fb2-4377-83f1-98322cb17799', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '4cf0d4ca-4d29-4d04-b103-2ecdbbb3545f'}]}}} Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise error Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:19.957132 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:19.966259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:19.966259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:19.966259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:09:19.966259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:09:19.966259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:09:19.966259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:09:19.966259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:09:19.966259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:09:19.966259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 21:09:19.966259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 21:09:19.966259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 21:09:19.966259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 21:09:19.966259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 21:09:19.966259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 21:09:19.966259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 24 21:09:19.966259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:19.966259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:19.966259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:19.966259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:19.966259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:19.966259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:19.966259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 21:09:19.966259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 21:09:19.966259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 24 21:09:19.966259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:19.966259 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-55c7e037-7c80-4005-8699-e19729df5bb8 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:09:19.966259 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-55c7e037-7c80-4005-8699-e19729df5bb8 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.034721 Sep 24 21:09:19.966259 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2439/4876] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:09:19 2022] POST /compute/v2.1/servers => generated 139 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:09:19.971033 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1a511a98-6354-4352-9330-c3d6ad2b6ef7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:19.971655 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1a511a98-6354-4352-9330-c3d6ad2b6ef7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:19.986423 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a511a98-6354-4352-9330-c3d6ad2b6ef7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:19.987537 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a511a98-6354-4352-9330-c3d6ad2b6ef7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:19.988097 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a511a98-6354-4352-9330-c3d6ad2b6ef7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:19.988836 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a511a98-6354-4352-9330-c3d6ad2b6ef7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:19.991802 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a511a98-6354-4352-9330-c3d6ad2b6ef7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:19.992677 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a511a98-6354-4352-9330-c3d6ad2b6ef7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:20.080454 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-67cff882-d3f5-43dd-8626-95b00a782160 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:20.081321 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-67cff882-d3f5-43dd-8626-95b00a782160 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:20.114116 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-67cff882-d3f5-43dd-8626-95b00a782160 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:20.115023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-67cff882-d3f5-43dd-8626-95b00a782160 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:20.116004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-67cff882-d3f5-43dd-8626-95b00a782160 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:20.120387 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-67cff882-d3f5-43dd-8626-95b00a782160 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:20.124859 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-67cff882-d3f5-43dd-8626-95b00a782160 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:20.125497 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-67cff882-d3f5-43dd-8626-95b00a782160 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:20.634628 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-67cff882-d3f5-43dd-8626-95b00a782160 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:20.638603 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:09:20.651535 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1a511a98-6354-4352-9330-c3d6ad2b6ef7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:20.654633 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-67cff882-d3f5-43dd-8626-95b00a782160 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1504 microversion: 2.1 time: 0.589498 Sep 24 21:09:20.655832 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2440/4877] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:20 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1504 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:20.665388 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1a511a98-6354-4352-9330-c3d6ad2b6ef7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.699646 Sep 24 21:09:20.670059 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2438/4878] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:19 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:20.713856 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b82689b6-0704-45b7-90c6-c1ab1c3793e5 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:20.719095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b82689b6-0704-45b7-90c6-c1ab1c3793e5 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:20.732664 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b82689b6-0704-45b7-90c6-c1ab1c3793e5 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:20.733470 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b82689b6-0704-45b7-90c6-c1ab1c3793e5 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:20.734307 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b82689b6-0704-45b7-90c6-c1ab1c3793e5 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:20.735298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b82689b6-0704-45b7-90c6-c1ab1c3793e5 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:20.735916 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b82689b6-0704-45b7-90c6-c1ab1c3793e5 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:20.736506 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b82689b6-0704-45b7-90c6-c1ab1c3793e5 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:21.039418 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b82689b6-0704-45b7-90c6-c1ab1c3793e5 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:21.053207 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b82689b6-0704-45b7-90c6-c1ab1c3793e5 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.344602 Sep 24 21:09:21.055137 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2441/4879] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:20 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:21.290634 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-85cc0dcf-3248-470c-9e57-0fc09c459305 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1284300186", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "4cf0d4ca-4d29-4d04-b103-2ecdbbb3545f"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-85cc0dcf-3248-470c-9e57-0fc09c459305 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 235 Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1284300186", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "4cf0d4ca-4d29-4d04-b103-2ecdbbb3545f"}]}} Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1284300186', 'imageRef': '4c30e8e9-8fb2-4377-83f1-98322cb17799', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '4cf0d4ca-4d29-4d04-b103-2ecdbbb3545f'}]}}} Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise error Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'notvalid' Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:21.298259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:21.302832 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:21.302832 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:21.302832 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:09:21.302832 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:09:21.302832 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:09:21.302832 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:09:21.302832 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:09:21.302832 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:09:21.302832 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 21:09:21.302832 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 21:09:21.302832 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 21:09:21.302832 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 21:09:21.302832 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 21:09:21.302832 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 21:09:21.302832 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 24 21:09:21.302832 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:21.302832 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:21.302832 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:21.302832 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:21.302832 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:21.302832 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:21.302832 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 21:09:21.302832 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 21:09:21.302832 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 24 21:09:21.302832 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:21.306156 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-85cc0dcf-3248-470c-9e57-0fc09c459305 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:09:21.306156 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-85cc0dcf-3248-470c-9e57-0fc09c459305 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.019780 Sep 24 21:09:21.306833 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2439/4880] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:09:21 2022] POST /compute/v2.1/servers => generated 133 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:09:21.316600 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fc5d8b30-b44c-4146-b7a0-4ae7c826bda6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:21.317222 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fc5d8b30-b44c-4146-b7a0-4ae7c826bda6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:21.333257 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc5d8b30-b44c-4146-b7a0-4ae7c826bda6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:21.333766 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc5d8b30-b44c-4146-b7a0-4ae7c826bda6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:21.334219 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc5d8b30-b44c-4146-b7a0-4ae7c826bda6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:21.334994 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc5d8b30-b44c-4146-b7a0-4ae7c826bda6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:21.335473 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc5d8b30-b44c-4146-b7a0-4ae7c826bda6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:21.336020 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fc5d8b30-b44c-4146-b7a0-4ae7c826bda6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:21.499910 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7310f65e-bac2-4087-b9d0-7002fe500867 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1642571441", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6640486c-9b61-4251-91b8-eded7b0b3bda"}], "security_groups": [{"name": "tempest-securitygroup--99010117"}], "key_name": "tempest-keypair-1860547824", "user_data": "}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:09:21.722658 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fc5d8b30-b44c-4146-b7a0-4ae7c826bda6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:21.732349 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fc5d8b30-b44c-4146-b7a0-4ae7c826bda6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.419703 Sep 24 21:09:21.735900 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2442/4881] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:21 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:21.746945 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-93e1ea8b-b0b8-40f3-8047-66095804df1e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:21.748487 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-93e1ea8b-b0b8-40f3-8047-66095804df1e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:21.765994 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93e1ea8b-b0b8-40f3-8047-66095804df1e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:21.768339 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93e1ea8b-b0b8-40f3-8047-66095804df1e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:21.769055 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93e1ea8b-b0b8-40f3-8047-66095804df1e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:21.771551 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93e1ea8b-b0b8-40f3-8047-66095804df1e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:21.773347 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93e1ea8b-b0b8-40f3-8047-66095804df1e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:21.774562 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93e1ea8b-b0b8-40f3-8047-66095804df1e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:21.793241 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-7310f65e-bac2-4087-b9d0-7002fe500867 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] validate_networks() for [('6640486c-9b61-4251-91b8-eded7b0b3bda', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:09:22.241684 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-93e1ea8b-b0b8-40f3-8047-66095804df1e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:22.256025 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-93e1ea8b-b0b8-40f3-8047-66095804df1e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1504 microversion: 2.1 time: 0.518373 Sep 24 21:09:22.273553 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2443/4882] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:21 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1504 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:22.287098 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-77451e1b-5832-4cce-96d3-220286c507cf tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:22.296151 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-77451e1b-5832-4cce-96d3-220286c507cf tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:22.304371 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77451e1b-5832-4cce-96d3-220286c507cf tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:22.309689 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77451e1b-5832-4cce-96d3-220286c507cf tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:22.318072 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77451e1b-5832-4cce-96d3-220286c507cf tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:22.319128 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77451e1b-5832-4cce-96d3-220286c507cf tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:22.319779 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77451e1b-5832-4cce-96d3-220286c507cf tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:22.322679 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77451e1b-5832-4cce-96d3-220286c507cf tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:22.663510 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-7310f65e-bac2-4087-b9d0-7002fe500867 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:09:22.664045 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-7310f65e-bac2-4087-b9d0-7002fe500867 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:09:22.664503 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-7310f65e-bac2-4087-b9d0-7002fe500867 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:09:22.664982 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-7310f65e-bac2-4087-b9d0-7002fe500867 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:09:22.665579 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-7310f65e-bac2-4087-b9d0-7002fe500867 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:09:22.666976 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-77451e1b-5832-4cce-96d3-220286c507cf tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:22.677526 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-77451e1b-5832-4cce-96d3-220286c507cf tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.402750 Sep 24 21:09:22.678842 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2444/4883] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:22 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:22.687005 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7310f65e-bac2-4087-b9d0-7002fe500867 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:22.687760 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7310f65e-bac2-4087-b9d0-7002fe500867 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:22.688364 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7310f65e-bac2-4087-b9d0-7002fe500867 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:22.689288 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7310f65e-bac2-4087-b9d0-7002fe500867 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:22.690070 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7310f65e-bac2-4087-b9d0-7002fe500867 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:22.698349 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7310f65e-bac2-4087-b9d0-7002fe500867 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:22.706667 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-23fbb13a-d538-434a-81fd-0b25ea009e7f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:09:22.707498 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-23fbb13a-d538-434a-81fd-0b25ea009e7f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: 33e29d38-c888-423a-ad9a-15e2685c453c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:22.715238 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-23fbb13a-d538-434a-81fd-0b25ea009e7f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] HTTP exception thrown: Instance 33e29d38-c888-423a-ad9a-15e2685c453c could not be found. Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-23fbb13a-d538-434a-81fd-0b25ea009e7f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers/33e29d38-c888-423a-ad9a-15e2685c453c/action HTTP/1.1 Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 13 Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: {"pause": {}} Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 33e29d38-c888-423a-ad9a-15e2685c453c could not be found. Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '33e29d38-c888-423a-ad9a-15e2685c453c', 'body': {'pause': {}}} Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33e29d38-c888-423a-ad9a-15e2685c453c could not be found. Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33e29d38-c888-423a-ad9a-15e2685c453c could not be found. Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:22.720319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:22.724693 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:09:22.724693 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:09:22.724693 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33e29d38-c888-423a-ad9a-15e2685c453c could not be found. Sep 24 21:09:22.724693 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:22.724693 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-23fbb13a-d538-434a-81fd-0b25ea009e7f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 404 to user: Instance 33e29d38-c888-423a-ad9a-15e2685c453c could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:09:22.724988 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-23fbb13a-d538-434a-81fd-0b25ea009e7f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers/33e29d38-c888-423a-ad9a-15e2685c453c/action" status: 404 len: 111 microversion: 2.1 time: 0.024005 Sep 24 21:09:22.737259 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2445/4884] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:09:22 2022] POST /compute/v2.1/servers/33e29d38-c888-423a-ad9a-15e2685c453c/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 21:09:22.743205 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d2c74a79-30bf-47e8-b84a-50463f366bb4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:22.745319 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d2c74a79-30bf-47e8-b84a-50463f366bb4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:22.745851 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-7310f65e-bac2-4087-b9d0-7002fe500867 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Getting quotas for project ede438e67af3496cae36fc89abc0aba3. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:09:22.752602 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-7310f65e-bac2-4087-b9d0-7002fe500867 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Getting quotas for user 370b057b12c148cdbb673ba6c06bd6b4 and project ede438e67af3496cae36fc89abc0aba3. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:09:22.767031 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7310f65e-bac2-4087-b9d0-7002fe500867 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:09:22.768385 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d2c74a79-30bf-47e8-b84a-50463f366bb4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:22.769090 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d2c74a79-30bf-47e8-b84a-50463f366bb4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:22.769381 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7310f65e-bac2-4087-b9d0-7002fe500867 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 480b3ea3-dcc4-4a43-a334-00f5cd435884] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:09:22.770307 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d2c74a79-30bf-47e8-b84a-50463f366bb4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:22.771736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d2c74a79-30bf-47e8-b84a-50463f366bb4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:22.772650 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d2c74a79-30bf-47e8-b84a-50463f366bb4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:22.773272 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d2c74a79-30bf-47e8-b84a-50463f366bb4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:22.855485 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7310f65e-bac2-4087-b9d0-7002fe500867 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.361483 Sep 24 21:09:22.864073 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2440/4885] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:09:21 2022] POST /compute/v2.1/servers => generated 400 bytes in 1370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:09:22.874636 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6ee2e276-a2e1-4247-934f-b665a5d0bd18 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:22.875696 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6ee2e276-a2e1-4247-934f-b665a5d0bd18 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 480b3ea3-dcc4-4a43-a334-00f5cd435884] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:23.009766 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6ee2e276-a2e1-4247-934f-b665a5d0bd18 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:23.024478 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6ee2e276-a2e1-4247-934f-b665a5d0bd18 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884" status: 200 len: 1242 microversion: 2.1 time: 0.157864 Sep 24 21:09:23.039363 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2441/4886] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:22 2022] GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884 => generated 1242 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:23.059470 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d2c74a79-30bf-47e8-b84a-50463f366bb4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:23.083063 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d2c74a79-30bf-47e8-b84a-50463f366bb4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.343848 Sep 24 21:09:23.085544 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2446/4887] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:22 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:23.114133 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-df909ea8-c556-4958-bdca-1a0d36df68c4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:23.114870 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-df909ea8-c556-4958-bdca-1a0d36df68c4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:23.123239 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-df909ea8-c556-4958-bdca-1a0d36df68c4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:23.124827 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-df909ea8-c556-4958-bdca-1a0d36df68c4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:23.125462 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-df909ea8-c556-4958-bdca-1a0d36df68c4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:23.127735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-df909ea8-c556-4958-bdca-1a0d36df68c4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:23.129614 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-df909ea8-c556-4958-bdca-1a0d36df68c4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:23.130172 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-df909ea8-c556-4958-bdca-1a0d36df68c4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:23.284677 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-481d5a1e-4b0b-4d63-96cf-e6644e642dbf tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:23.286940 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-481d5a1e-4b0b-4d63-96cf-e6644e642dbf tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:23.295972 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-481d5a1e-4b0b-4d63-96cf-e6644e642dbf tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:23.296959 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-481d5a1e-4b0b-4d63-96cf-e6644e642dbf tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:23.297894 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-481d5a1e-4b0b-4d63-96cf-e6644e642dbf tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:23.299128 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-481d5a1e-4b0b-4d63-96cf-e6644e642dbf tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:23.299866 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-481d5a1e-4b0b-4d63-96cf-e6644e642dbf tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:23.300523 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-481d5a1e-4b0b-4d63-96cf-e6644e642dbf tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:23.391999 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-df909ea8-c556-4958-bdca-1a0d36df68c4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:23.406434 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-df909ea8-c556-4958-bdca-1a0d36df68c4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.292308 Sep 24 21:09:23.407572 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2442/4888] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:23 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:09:23.442565 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1756dfae-7c43-4b5f-aff1-dbc3a1edd799 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:09:23.446767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1756dfae-7c43-4b5f-aff1-dbc3a1edd799 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:23.466928 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1756dfae-7c43-4b5f-aff1-dbc3a1edd799 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:23.467912 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1756dfae-7c43-4b5f-aff1-dbc3a1edd799 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:23.468546 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1756dfae-7c43-4b5f-aff1-dbc3a1edd799 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:23.469605 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1756dfae-7c43-4b5f-aff1-dbc3a1edd799 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:23.470940 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1756dfae-7c43-4b5f-aff1-dbc3a1edd799 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:23.472506 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1756dfae-7c43-4b5f-aff1-dbc3a1edd799 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:23.618816 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-481d5a1e-4b0b-4d63-96cf-e6644e642dbf tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:23.621903 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1756dfae-7c43-4b5f-aff1-dbc3a1edd799 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f/action" status: 202 len: 0 microversion: 2.1 time: 0.189773 Sep 24 21:09:23.623028 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2443/4889] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:09:23 2022] POST /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:09:23.633637 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cb14a2fe-ba51-4d4b-af73-f14e8839ae4f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:23.634832 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cb14a2fe-ba51-4d4b-af73-f14e8839ae4f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:23.645692 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb14a2fe-ba51-4d4b-af73-f14e8839ae4f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:23.648530 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb14a2fe-ba51-4d4b-af73-f14e8839ae4f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:23.648661 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-481d5a1e-4b0b-4d63-96cf-e6644e642dbf tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1504 microversion: 2.1 time: 0.351086 Sep 24 21:09:23.649472 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb14a2fe-ba51-4d4b-af73-f14e8839ae4f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:23.651129 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb14a2fe-ba51-4d4b-af73-f14e8839ae4f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:23.652267 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb14a2fe-ba51-4d4b-af73-f14e8839ae4f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:23.653104 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb14a2fe-ba51-4d4b-af73-f14e8839ae4f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:23.657446 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2447/4890] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:23 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1504 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:09:23.991365 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cb14a2fe-ba51-4d4b-af73-f14e8839ae4f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:24.003241 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cb14a2fe-ba51-4d4b-af73-f14e8839ae4f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1511 microversion: 2.1 time: 0.376126 Sep 24 21:09:24.003837 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2444/4891] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:23 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1511 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:09:24.055374 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5eb31fe7-d984-4c86-b428-72a8586e7db9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:24.056306 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5eb31fe7-d984-4c86-b428-72a8586e7db9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 480b3ea3-dcc4-4a43-a334-00f5cd435884] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:24.070964 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5eb31fe7-d984-4c86-b428-72a8586e7db9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:24.072048 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5eb31fe7-d984-4c86-b428-72a8586e7db9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:24.072519 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5eb31fe7-d984-4c86-b428-72a8586e7db9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:24.075843 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5eb31fe7-d984-4c86-b428-72a8586e7db9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:24.076341 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5eb31fe7-d984-4c86-b428-72a8586e7db9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:24.076837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5eb31fe7-d984-4c86-b428-72a8586e7db9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:24.184967 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5eb31fe7-d984-4c86-b428-72a8586e7db9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:24.194604 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5eb31fe7-d984-4c86-b428-72a8586e7db9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884" status: 200 len: 1294 microversion: 2.1 time: 0.143131 Sep 24 21:09:24.213677 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2448/4892] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:24 2022] GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884 => generated 1294 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:24.673808 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-39019a62-dafe-4672-8a41-c4c5aa0a8518 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:24.674455 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-39019a62-dafe-4672-8a41-c4c5aa0a8518 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:24.683998 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-39019a62-dafe-4672-8a41-c4c5aa0a8518 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:24.685221 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-39019a62-dafe-4672-8a41-c4c5aa0a8518 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:24.685883 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-39019a62-dafe-4672-8a41-c4c5aa0a8518 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:24.686878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-39019a62-dafe-4672-8a41-c4c5aa0a8518 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:24.687542 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-39019a62-dafe-4672-8a41-c4c5aa0a8518 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:24.688348 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-39019a62-dafe-4672-8a41-c4c5aa0a8518 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:24.993625 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-39019a62-dafe-4672-8a41-c4c5aa0a8518 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:25.002892 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-39019a62-dafe-4672-8a41-c4c5aa0a8518 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1504 microversion: 2.1 time: 0.333317 Sep 24 21:09:25.003485 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2445/4893] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:24 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1504 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:25.040932 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b6751cbd-9094-4261-bbeb-caa0ae87cd4f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:25.043018 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b6751cbd-9094-4261-bbeb-caa0ae87cd4f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:25.063407 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b6751cbd-9094-4261-bbeb-caa0ae87cd4f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:25.063907 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b6751cbd-9094-4261-bbeb-caa0ae87cd4f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:25.064567 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b6751cbd-9094-4261-bbeb-caa0ae87cd4f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:25.065435 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b6751cbd-9094-4261-bbeb-caa0ae87cd4f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:25.066074 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b6751cbd-9094-4261-bbeb-caa0ae87cd4f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:25.066693 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b6751cbd-9094-4261-bbeb-caa0ae87cd4f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:25.223520 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f7c07c7e-8d74-4a68-8fee-2155c425e2f9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:25.224287 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f7c07c7e-8d74-4a68-8fee-2155c425e2f9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 480b3ea3-dcc4-4a43-a334-00f5cd435884] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:25.232789 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f7c07c7e-8d74-4a68-8fee-2155c425e2f9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:25.233414 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f7c07c7e-8d74-4a68-8fee-2155c425e2f9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:25.234052 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f7c07c7e-8d74-4a68-8fee-2155c425e2f9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:25.235105 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f7c07c7e-8d74-4a68-8fee-2155c425e2f9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:25.235727 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f7c07c7e-8d74-4a68-8fee-2155c425e2f9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:25.238983 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f7c07c7e-8d74-4a68-8fee-2155c425e2f9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:25.296484 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b6751cbd-9094-4261-bbeb-caa0ae87cd4f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:25.312376 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b6751cbd-9094-4261-bbeb-caa0ae87cd4f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1491 microversion: 2.1 time: 0.287303 Sep 24 21:09:25.317360 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2449/4894] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:25 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1491 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:25.340774 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d51d3973-2468-4129-94d6-4e74262d7c14 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:09:25.342219 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d51d3973-2468-4129-94d6-4e74262d7c14 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:25.353241 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d51d3973-2468-4129-94d6-4e74262d7c14 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:25.353241 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d51d3973-2468-4129-94d6-4e74262d7c14 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:25.353558 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d51d3973-2468-4129-94d6-4e74262d7c14 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:25.354195 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d51d3973-2468-4129-94d6-4e74262d7c14 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:25.355493 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d51d3973-2468-4129-94d6-4e74262d7c14 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:25.356646 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d51d3973-2468-4129-94d6-4e74262d7c14 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:25.384488 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-d51d3973-2468-4129-94d6-4e74262d7c14 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] HTTP exception thrown: Cannot 'pause' instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f while it is in vm_state paused Sep 24 21:09:25.384694 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f7c07c7e-8d74-4a68-8fee-2155c425e2f9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d51d3973-2468-4129-94d6-4e74262d7c14 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f/action HTTP/1.1 Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 13 Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: {"pause": {}} Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: exception: Cannot 'pause' instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f while it is in vm_state paused Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'f3fcc34d-d09a-4475-bd96-51ac0074cb5f', 'body': {'pause': {}}} Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f in vm_state paused. Cannot pause while the instance is in this state. Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f while it is in vm_state paused Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:25.387265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:25.391845 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:25.391845 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:09:25.391845 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:09:25.391845 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f while it is in vm_state paused Sep 24 21:09:25.391845 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:25.393654 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d51d3973-2468-4129-94d6-4e74262d7c14 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 409 to user: Cannot 'pause' instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f while it is in vm_state paused {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:09:25.395727 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d51d3973-2468-4129-94d6-4e74262d7c14 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f/action" status: 409 len: 143 microversion: 2.1 time: 0.060176 Sep 24 21:09:25.396552 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2450/4895] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:09:25 2022] POST /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f/action => generated 143 bytes in 62 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 24 21:09:25.407380 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f7c07c7e-8d74-4a68-8fee-2155c425e2f9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884" status: 200 len: 1300 microversion: 2.1 time: 0.185683 Sep 24 21:09:25.408185 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2446/4896] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:25 2022] GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884 => generated 1300 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:09:25.436189 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ee08370b-8a9f-4711-8f06-b2fdd5e0848d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:09:25.437311 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ee08370b-8a9f-4711-8f06-b2fdd5e0848d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:25.444607 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ee08370b-8a9f-4711-8f06-b2fdd5e0848d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:25.445415 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ee08370b-8a9f-4711-8f06-b2fdd5e0848d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:25.446650 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ee08370b-8a9f-4711-8f06-b2fdd5e0848d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:25.448104 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ee08370b-8a9f-4711-8f06-b2fdd5e0848d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:25.448505 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ee08370b-8a9f-4711-8f06-b2fdd5e0848d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:25.450259 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ee08370b-8a9f-4711-8f06-b2fdd5e0848d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:25.590194 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ee08370b-8a9f-4711-8f06-b2fdd5e0848d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f/action" status: 202 len: 0 microversion: 2.1 time: 0.185386 Sep 24 21:09:25.592191 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2451/4897] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:09:25 2022] POST /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:09:25.612015 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4ac02d31-f90f-48a5-a5fb-961b5f3ad716 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:25.613030 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4ac02d31-f90f-48a5-a5fb-961b5f3ad716 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:25.650427 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ac02d31-f90f-48a5-a5fb-961b5f3ad716 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:25.650993 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ac02d31-f90f-48a5-a5fb-961b5f3ad716 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:25.651496 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ac02d31-f90f-48a5-a5fb-961b5f3ad716 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:25.653098 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ac02d31-f90f-48a5-a5fb-961b5f3ad716 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:25.653560 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ac02d31-f90f-48a5-a5fb-961b5f3ad716 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:25.653989 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ac02d31-f90f-48a5-a5fb-961b5f3ad716 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:26.020009 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4ac02d31-f90f-48a5-a5fb-961b5f3ad716 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:26.044887 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-923fa2b0-eaff-4cbc-8e31-2e819650dcd8 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:26.045533 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-923fa2b0-eaff-4cbc-8e31-2e819650dcd8 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:26.063605 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4ac02d31-f90f-48a5-a5fb-961b5f3ad716 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1498 microversion: 2.1 time: 0.464369 Sep 24 21:09:26.064213 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2447/4898] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:25 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1498 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:26.079655 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-923fa2b0-eaff-4cbc-8e31-2e819650dcd8 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:26.080751 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-923fa2b0-eaff-4cbc-8e31-2e819650dcd8 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:26.081207 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-923fa2b0-eaff-4cbc-8e31-2e819650dcd8 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:26.081920 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-923fa2b0-eaff-4cbc-8e31-2e819650dcd8 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:26.082401 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-923fa2b0-eaff-4cbc-8e31-2e819650dcd8 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:26.082852 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-923fa2b0-eaff-4cbc-8e31-2e819650dcd8 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:26.381417 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-923fa2b0-eaff-4cbc-8e31-2e819650dcd8 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:26.390015 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-923fa2b0-eaff-4cbc-8e31-2e819650dcd8 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1504 microversion: 2.1 time: 0.363254 Sep 24 21:09:26.390997 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2452/4899] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:26 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1504 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:26.438559 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-63a1f6ed-e646-436b-b555-ab8d61345577 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:26.439883 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-63a1f6ed-e646-436b-b555-ab8d61345577 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 480b3ea3-dcc4-4a43-a334-00f5cd435884] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:26.456012 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-63a1f6ed-e646-436b-b555-ab8d61345577 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:26.457138 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-63a1f6ed-e646-436b-b555-ab8d61345577 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:26.457807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-63a1f6ed-e646-436b-b555-ab8d61345577 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:26.464770 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-63a1f6ed-e646-436b-b555-ab8d61345577 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:26.465523 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-63a1f6ed-e646-436b-b555-ab8d61345577 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:26.466136 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-63a1f6ed-e646-436b-b555-ab8d61345577 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:26.804575 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-63a1f6ed-e646-436b-b555-ab8d61345577 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:26.815958 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-63a1f6ed-e646-436b-b555-ab8d61345577 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884" status: 200 len: 1366 microversion: 2.1 time: 0.384426 Sep 24 21:09:26.819894 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2448/4900] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:26 2022] GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884 => generated 1366 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:27.089958 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-839553db-15ec-47c8-9c9e-8cbbf2fb9978 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:27.090747 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-839553db-15ec-47c8-9c9e-8cbbf2fb9978 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:27.109012 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-839553db-15ec-47c8-9c9e-8cbbf2fb9978 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:27.109557 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-839553db-15ec-47c8-9c9e-8cbbf2fb9978 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:27.109936 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-839553db-15ec-47c8-9c9e-8cbbf2fb9978 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:27.110691 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-839553db-15ec-47c8-9c9e-8cbbf2fb9978 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:27.111150 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-839553db-15ec-47c8-9c9e-8cbbf2fb9978 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:27.111579 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-839553db-15ec-47c8-9c9e-8cbbf2fb9978 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:27.415911 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f062a1f8-5de5-4e09-86b6-8e70a1abcfbf tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:27.416701 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f062a1f8-5de5-4e09-86b6-8e70a1abcfbf tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:27.428709 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f062a1f8-5de5-4e09-86b6-8e70a1abcfbf tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:27.430237 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f062a1f8-5de5-4e09-86b6-8e70a1abcfbf tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:27.434196 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f062a1f8-5de5-4e09-86b6-8e70a1abcfbf tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:27.436945 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f062a1f8-5de5-4e09-86b6-8e70a1abcfbf tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:27.438765 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f062a1f8-5de5-4e09-86b6-8e70a1abcfbf tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:27.441401 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f062a1f8-5de5-4e09-86b6-8e70a1abcfbf tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:27.856480 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f062a1f8-5de5-4e09-86b6-8e70a1abcfbf tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:27.885284 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-839553db-15ec-47c8-9c9e-8cbbf2fb9978 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:27.894000 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f062a1f8-5de5-4e09-86b6-8e70a1abcfbf tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1504 microversion: 2.1 time: 0.456776 Sep 24 21:09:27.894738 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2449/4901] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:27 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1504 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:09:27.906864 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-839553db-15ec-47c8-9c9e-8cbbf2fb9978 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.820941 Sep 24 21:09:27.908112 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2453/4902] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:27 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:27.934584 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-24fada5f-d2ed-4d1f-a46b-37d366075000 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:27.937590 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-24fada5f-d2ed-4d1f-a46b-37d366075000 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 480b3ea3-dcc4-4a43-a334-00f5cd435884] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:27.939355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-121e302b-a90c-421d-84fc-5ba23017d50a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:27.940077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-121e302b-a90c-421d-84fc-5ba23017d50a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:27.949824 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-121e302b-a90c-421d-84fc-5ba23017d50a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:27.952216 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-121e302b-a90c-421d-84fc-5ba23017d50a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:27.952956 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-121e302b-a90c-421d-84fc-5ba23017d50a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:27.956198 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-121e302b-a90c-421d-84fc-5ba23017d50a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:27.956965 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-121e302b-a90c-421d-84fc-5ba23017d50a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:27.957642 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-121e302b-a90c-421d-84fc-5ba23017d50a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:27.967294 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-24fada5f-d2ed-4d1f-a46b-37d366075000 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:27.967814 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-24fada5f-d2ed-4d1f-a46b-37d366075000 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:27.968272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-24fada5f-d2ed-4d1f-a46b-37d366075000 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:27.971044 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-24fada5f-d2ed-4d1f-a46b-37d366075000 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:27.975381 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-24fada5f-d2ed-4d1f-a46b-37d366075000 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:27.976138 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-24fada5f-d2ed-4d1f-a46b-37d366075000 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:27.985601 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:09:28.454673 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-121e302b-a90c-421d-84fc-5ba23017d50a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:28.469847 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-121e302b-a90c-421d-84fc-5ba23017d50a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.534921 Sep 24 21:09:28.471397 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2454/4903] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:27 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:28.484519 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-32a1d743-1eca-4f93-ae36-76865554a031 req-0b160fbc-47ad-4bce-8bda-4f1c7ff139d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "480b3ea3-dcc4-4a43-a334-00f5cd435884", "tag": "cc46c09b-dd44-4ab4-9d14-2c6fa3de14ac"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:09:28.513534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-32a1d743-1eca-4f93-ae36-76865554a031 req-0b160fbc-47ad-4bce-8bda-4f1c7ff139d9 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:28.514528 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-32a1d743-1eca-4f93-ae36-76865554a031 req-0b160fbc-47ad-4bce-8bda-4f1c7ff139d9 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:28.515335 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-32a1d743-1eca-4f93-ae36-76865554a031 req-0b160fbc-47ad-4bce-8bda-4f1c7ff139d9 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:28.553302 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-32a1d743-1eca-4f93-ae36-76865554a031 req-0b160fbc-47ad-4bce-8bda-4f1c7ff139d9 service nova] Creating event network-changed:cc46c09b-dd44-4ab4-9d14-2c6fa3de14ac for instance 480b3ea3-dcc4-4a43-a334-00f5cd435884 on nch1-master-1 Sep 24 21:09:28.570875 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-32a1d743-1eca-4f93-ae36-76865554a031 req-0b160fbc-47ad-4bce-8bda-4f1c7ff139d9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092863 Sep 24 21:09:28.571941 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2455/4904] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:09:28.587368 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-24fada5f-d2ed-4d1f-a46b-37d366075000 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:28.595023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2000ed60-cd4e-4aff-9fa8-99f6d0b0e4f6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:09:28.599268 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-24fada5f-d2ed-4d1f-a46b-37d366075000 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884" status: 200 len: 1366 microversion: 2.1 time: 0.703371 Sep 24 21:09:28.602809 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2450/4905] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:27 2022] GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884 => generated 1366 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:28.603268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2000ed60-cd4e-4aff-9fa8-99f6d0b0e4f6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: 23ed2980-eb42-4f9e-b65e-77a238d7b976] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:28.619695 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2000ed60-cd4e-4aff-9fa8-99f6d0b0e4f6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:28.622737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2000ed60-cd4e-4aff-9fa8-99f6d0b0e4f6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:28.623391 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2000ed60-cd4e-4aff-9fa8-99f6d0b0e4f6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:28.625972 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2000ed60-cd4e-4aff-9fa8-99f6d0b0e4f6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:28.626680 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2000ed60-cd4e-4aff-9fa8-99f6d0b0e4f6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:28.629529 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2000ed60-cd4e-4aff-9fa8-99f6d0b0e4f6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:28.671479 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-2000ed60-cd4e-4aff-9fa8-99f6d0b0e4f6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] HTTP exception thrown: Instance 23ed2980-eb42-4f9e-b65e-77a238d7b976 could not be found. Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2000ed60-cd4e-4aff-9fa8-99f6d0b0e4f6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976/action HTTP/1.1 Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 28 Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: {"reboot": {"type": "SOFT"}} Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 23ed2980-eb42-4f9e-b65e-77a238d7b976 could not be found. Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '23ed2980-eb42-4f9e-b65e-77a238d7b976', 'body': {'reboot': {'type': 'SOFT'}}} Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23ed2980-eb42-4f9e-b65e-77a238d7b976 could not be found. Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:09:28.673743 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:09:28.677498 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23ed2980-eb42-4f9e-b65e-77a238d7b976 could not be found. Sep 24 21:09:28.677498 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:28.677498 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:28.677498 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:28.677498 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:28.677498 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:28.677498 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:28.677498 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:09:28.677498 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:09:28.677498 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23ed2980-eb42-4f9e-b65e-77a238d7b976 could not be found. Sep 24 21:09:28.677498 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:28.682548 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2000ed60-cd4e-4aff-9fa8-99f6d0b0e4f6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 404 to user: Instance 23ed2980-eb42-4f9e-b65e-77a238d7b976 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:09:28.684352 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2000ed60-cd4e-4aff-9fa8-99f6d0b0e4f6 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976/action" status: 404 len: 111 microversion: 2.1 time: 0.108173 Sep 24 21:09:28.691954 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2456/4906] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:09:28 2022] POST /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976/action => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:09:28.702936 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b8757055-4419-4c78-b507-86fa40937e37 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:28.703794 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b8757055-4419-4c78-b507-86fa40937e37 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:28.713973 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b8757055-4419-4c78-b507-86fa40937e37 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:28.715612 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b8757055-4419-4c78-b507-86fa40937e37 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:28.716622 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b8757055-4419-4c78-b507-86fa40937e37 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:28.717582 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b8757055-4419-4c78-b507-86fa40937e37 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:28.718264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b8757055-4419-4c78-b507-86fa40937e37 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:28.719093 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b8757055-4419-4c78-b507-86fa40937e37 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:28.922116 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-55a9e0ee-b498-498a-a27e-c3e4ebb9c282 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:28.923257 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-55a9e0ee-b498-498a-a27e-c3e4ebb9c282 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:28.932573 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-55a9e0ee-b498-498a-a27e-c3e4ebb9c282 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:28.936452 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-55a9e0ee-b498-498a-a27e-c3e4ebb9c282 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:28.938307 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-55a9e0ee-b498-498a-a27e-c3e4ebb9c282 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:28.939515 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-55a9e0ee-b498-498a-a27e-c3e4ebb9c282 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:28.941304 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-55a9e0ee-b498-498a-a27e-c3e4ebb9c282 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:28.946489 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-55a9e0ee-b498-498a-a27e-c3e4ebb9c282 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:29.003944 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b8757055-4419-4c78-b507-86fa40937e37 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:29.016944 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b8757055-4419-4c78-b507-86fa40937e37 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.317457 Sep 24 21:09:29.018164 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2451/4907] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:28 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:29.045461 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8aea31cb-8fcf-4cf4-8278-1cf5ecd3be28 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:29.046515 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8aea31cb-8fcf-4cf4-8278-1cf5ecd3be28 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:29.055182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8aea31cb-8fcf-4cf4-8278-1cf5ecd3be28 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:29.056376 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8aea31cb-8fcf-4cf4-8278-1cf5ecd3be28 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:29.057075 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8aea31cb-8fcf-4cf4-8278-1cf5ecd3be28 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:29.058730 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8aea31cb-8fcf-4cf4-8278-1cf5ecd3be28 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:29.059763 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8aea31cb-8fcf-4cf4-8278-1cf5ecd3be28 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:29.060428 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8aea31cb-8fcf-4cf4-8278-1cf5ecd3be28 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:29.249650 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-55a9e0ee-b498-498a-a27e-c3e4ebb9c282 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:29.263080 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-55a9e0ee-b498-498a-a27e-c3e4ebb9c282 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1484 microversion: 2.1 time: 0.345672 Sep 24 21:09:29.274551 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2457/4908] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:28 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1484 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:09:29.289777 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5f29651a-79dd-4b6b-a4bd-fe26028b5b1b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:09:29.290442 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5f29651a-79dd-4b6b-a4bd-fe26028b5b1b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:29.302511 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f29651a-79dd-4b6b-a4bd-fe26028b5b1b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:29.305769 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f29651a-79dd-4b6b-a4bd-fe26028b5b1b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:29.306488 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f29651a-79dd-4b6b-a4bd-fe26028b5b1b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:29.307380 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f29651a-79dd-4b6b-a4bd-fe26028b5b1b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:29.308601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f29651a-79dd-4b6b-a4bd-fe26028b5b1b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:29.312331 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f29651a-79dd-4b6b-a4bd-fe26028b5b1b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:29.451649 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:09:29.463501 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8aea31cb-8fcf-4cf4-8278-1cf5ecd3be28 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:29.478516 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8aea31cb-8fcf-4cf4-8278-1cf5ecd3be28 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.438138 Sep 24 21:09:29.481605 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2452/4909] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:29 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:29.515892 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b2ea3051-d208-4da4-b622-a064dd96e957 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:09:29.521090 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b2ea3051-d208-4da4-b622-a064dd96e957 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: 21ecfd0e-5719-45c4-9bdb-68577920bab2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:29.528342 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5f29651a-79dd-4b6b-a4bd-fe26028b5b1b tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "POST /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c/action" status: 202 len: 0 microversion: 2.1 time: 0.241324 Sep 24 21:09:29.529052 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2458/4910] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:09:29 2022] POST /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 21:09:29.545321 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-840740a2-42c3-4c7e-8cd9-9935b4131a4e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:29.548795 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-840740a2-42c3-4c7e-8cd9-9935b4131a4e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:29.561755 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-b2ea3051-d208-4da4-b622-a064dd96e957 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] HTTP exception thrown: Instance 21ecfd0e-5719-45c4-9bdb-68577920bab2 could not be found. Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b2ea3051-d208-4da4-b622-a064dd96e957 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/servers/21ecfd0e-5719-45c4-9bdb-68577920bab2/action HTTP/1.1 Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 28 Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: {"reboot": {"type": "SOFT"}} Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 21ecfd0e-5719-45c4-9bdb-68577920bab2 could not be found. Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '21ecfd0e-5719-45c4-9bdb-68577920bab2', 'body': {'reboot': {'type': 'SOFT'}}} Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21ecfd0e-5719-45c4-9bdb-68577920bab2 could not be found. Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21ecfd0e-5719-45c4-9bdb-68577920bab2 could not be found. Sep 24 21:09:29.568062 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:29.572643 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:29.572643 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:29.572643 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:29.572643 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:29.572643 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:29.572643 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:09:29.572643 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:09:29.572643 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21ecfd0e-5719-45c4-9bdb-68577920bab2 could not be found. Sep 24 21:09:29.572643 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:29.574298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-840740a2-42c3-4c7e-8cd9-9935b4131a4e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:29.574298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-840740a2-42c3-4c7e-8cd9-9935b4131a4e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:29.574298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-840740a2-42c3-4c7e-8cd9-9935b4131a4e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:29.574298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-840740a2-42c3-4c7e-8cd9-9935b4131a4e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:29.574298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-840740a2-42c3-4c7e-8cd9-9935b4131a4e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:29.574714 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-840740a2-42c3-4c7e-8cd9-9935b4131a4e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:29.577175 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b2ea3051-d208-4da4-b622-a064dd96e957 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 404 to user: Instance 21ecfd0e-5719-45c4-9bdb-68577920bab2 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:09:29.578242 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b2ea3051-d208-4da4-b622-a064dd96e957 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers/21ecfd0e-5719-45c4-9bdb-68577920bab2/action" status: 404 len: 111 microversion: 2.1 time: 0.072472 Sep 24 21:09:29.583721 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2453/4911] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:09:29 2022] POST /compute/v2.1/servers/21ecfd0e-5719-45c4-9bdb-68577920bab2/action => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:09:29.590712 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-242d4fe7-5ed1-4133-91b0-19e268f9808a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:29.596830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-242d4fe7-5ed1-4133-91b0-19e268f9808a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:29.637621 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-242d4fe7-5ed1-4133-91b0-19e268f9808a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:29.647570 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-242d4fe7-5ed1-4133-91b0-19e268f9808a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:29.648540 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-242d4fe7-5ed1-4133-91b0-19e268f9808a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:29.648823 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-242d4fe7-5ed1-4133-91b0-19e268f9808a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:29.649306 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-242d4fe7-5ed1-4133-91b0-19e268f9808a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:29.656750 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-242d4fe7-5ed1-4133-91b0-19e268f9808a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:29.964425 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-242d4fe7-5ed1-4133-91b0-19e268f9808a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:29.973718 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-242d4fe7-5ed1-4133-91b0-19e268f9808a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.388646 Sep 24 21:09:29.980180 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2454/4912] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:29 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:29.984626 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5ccc7273-11ab-40dc-a3f9-61c6b027b199 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:29.985366 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5ccc7273-11ab-40dc-a3f9-61c6b027b199 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 480b3ea3-dcc4-4a43-a334-00f5cd435884] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:29.994454 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ccc7273-11ab-40dc-a3f9-61c6b027b199 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:29.996443 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ccc7273-11ab-40dc-a3f9-61c6b027b199 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:29.997134 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ccc7273-11ab-40dc-a3f9-61c6b027b199 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:29.998083 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ccc7273-11ab-40dc-a3f9-61c6b027b199 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:29.998733 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ccc7273-11ab-40dc-a3f9-61c6b027b199 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:29.999343 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ccc7273-11ab-40dc-a3f9-61c6b027b199 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:30.034851 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-840740a2-42c3-4c7e-8cd9-9935b4131a4e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:30.044823 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-840740a2-42c3-4c7e-8cd9-9935b4131a4e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1492 microversion: 2.1 time: 0.511245 Sep 24 21:09:30.054878 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2459/4913] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:29 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1492 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:30.059255 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ca4fc27e-170b-4a41-a991-c23ff5fab1d4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:30.059997 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ca4fc27e-170b-4a41-a991-c23ff5fab1d4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:30.066828 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ca4fc27e-170b-4a41-a991-c23ff5fab1d4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:30.067336 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ca4fc27e-170b-4a41-a991-c23ff5fab1d4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:30.067784 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ca4fc27e-170b-4a41-a991-c23ff5fab1d4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:30.068500 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ca4fc27e-170b-4a41-a991-c23ff5fab1d4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:30.068966 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ca4fc27e-170b-4a41-a991-c23ff5fab1d4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:30.069396 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ca4fc27e-170b-4a41-a991-c23ff5fab1d4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:30.303813 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5ccc7273-11ab-40dc-a3f9-61c6b027b199 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:30.318903 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5ccc7273-11ab-40dc-a3f9-61c6b027b199 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884" status: 200 len: 1366 microversion: 2.1 time: 0.339829 Sep 24 21:09:30.323936 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2455/4914] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:29 2022] GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884 => generated 1366 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:30.379116 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ca4fc27e-170b-4a41-a991-c23ff5fab1d4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:30.390478 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ca4fc27e-170b-4a41-a991-c23ff5fab1d4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.341734 Sep 24 21:09:30.391129 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2460/4915] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:30 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:30.419449 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ed9d290b-a04e-4652-8eba-38a5b1c398c5 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:09:30.422611 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ed9d290b-a04e-4652-8eba-38a5b1c398c5 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: 23ed2980-eb42-4f9e-b65e-77a238d7b976] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:30.429413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed9d290b-a04e-4652-8eba-38a5b1c398c5 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:30.430469 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed9d290b-a04e-4652-8eba-38a5b1c398c5 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:30.430963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed9d290b-a04e-4652-8eba-38a5b1c398c5 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:30.431678 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed9d290b-a04e-4652-8eba-38a5b1c398c5 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:30.432176 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed9d290b-a04e-4652-8eba-38a5b1c398c5 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:30.432709 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed9d290b-a04e-4652-8eba-38a5b1c398c5 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:30.450322 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-ed9d290b-a04e-4652-8eba-38a5b1c398c5 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] HTTP exception thrown: Instance 23ed2980-eb42-4f9e-b65e-77a238d7b976 could not be found. Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ed9d290b-a04e-4652-8eba-38a5b1c398c5 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976/action HTTP/1.1 Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 65 Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: {"rebuild": {"imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799"}} Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 23ed2980-eb42-4f9e-b65e-77a238d7b976 could not be found. Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '23ed2980-eb42-4f9e-b65e-77a238d7b976', 'body': {'rebuild': {'imageRef': '4c30e8e9-8fb2-4377-83f1-98322cb17799'}}} Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23ed2980-eb42-4f9e-b65e-77a238d7b976 could not be found. Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 24 21:09:30.452333 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 24 21:09:30.459674 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 24 21:09:30.459674 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:09:30.459674 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:09:30.459674 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:09:30.459674 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:09:30.459674 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23ed2980-eb42-4f9e-b65e-77a238d7b976 could not be found. Sep 24 21:09:30.459674 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:30.459674 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:30.459674 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:30.459674 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:30.459674 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:30.459674 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:30.459674 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:09:30.459674 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:09:30.459674 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23ed2980-eb42-4f9e-b65e-77a238d7b976 could not be found. Sep 24 21:09:30.459674 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:30.459674 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ed9d290b-a04e-4652-8eba-38a5b1c398c5 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 404 to user: Instance 23ed2980-eb42-4f9e-b65e-77a238d7b976 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:09:30.459674 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ed9d290b-a04e-4652-8eba-38a5b1c398c5 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976/action" status: 404 len: 111 microversion: 2.1 time: 0.039902 Sep 24 21:09:30.459674 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2456/4916] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:09:30 2022] POST /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:09:30.468162 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-77d631f6-adbf-431d-8493-eb5b0094f76d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:30.468790 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-77d631f6-adbf-431d-8493-eb5b0094f76d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:30.478722 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77d631f6-adbf-431d-8493-eb5b0094f76d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:30.479222 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77d631f6-adbf-431d-8493-eb5b0094f76d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:30.480243 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77d631f6-adbf-431d-8493-eb5b0094f76d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:30.480988 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77d631f6-adbf-431d-8493-eb5b0094f76d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:30.481433 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77d631f6-adbf-431d-8493-eb5b0094f76d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:30.481860 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77d631f6-adbf-431d-8493-eb5b0094f76d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:30.757002 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-77d631f6-adbf-431d-8493-eb5b0094f76d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:30.766001 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-77d631f6-adbf-431d-8493-eb5b0094f76d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.301931 Sep 24 21:09:30.766607 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2461/4917] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:30 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:30.796886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c83c46f5-8c11-405f-b3f7-e7e06ae5146b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:30.801506 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c83c46f5-8c11-405f-b3f7-e7e06ae5146b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:30.810488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c83c46f5-8c11-405f-b3f7-e7e06ae5146b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:30.811190 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c83c46f5-8c11-405f-b3f7-e7e06ae5146b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:30.811782 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c83c46f5-8c11-405f-b3f7-e7e06ae5146b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:30.812644 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c83c46f5-8c11-405f-b3f7-e7e06ae5146b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:30.817461 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c83c46f5-8c11-405f-b3f7-e7e06ae5146b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:30.818109 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c83c46f5-8c11-405f-b3f7-e7e06ae5146b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:31.062031 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c83c46f5-8c11-405f-b3f7-e7e06ae5146b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:31.069414 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-98329717-f5e6-4645-b3f1-59adf28fa353 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:31.070302 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-98329717-f5e6-4645-b3f1-59adf28fa353 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:31.082006 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c83c46f5-8c11-405f-b3f7-e7e06ae5146b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.291114 Sep 24 21:09:31.083516 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98329717-f5e6-4645-b3f1-59adf28fa353 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:31.084447 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98329717-f5e6-4645-b3f1-59adf28fa353 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:31.085454 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2457/4918] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:30 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:31.086222 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98329717-f5e6-4645-b3f1-59adf28fa353 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:31.087448 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98329717-f5e6-4645-b3f1-59adf28fa353 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:31.088132 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98329717-f5e6-4645-b3f1-59adf28fa353 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:31.088771 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98329717-f5e6-4645-b3f1-59adf28fa353 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:31.113459 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ed37a3b4-57f1-4788-a940-57890ec63b83 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:09:31.117024 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ed37a3b4-57f1-4788-a940-57890ec63b83 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: dcbcb809-95c7-4224-9efd-b8f55a722a05] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:31.128520 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-ed37a3b4-57f1-4788-a940-57890ec63b83 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] HTTP exception thrown: Instance dcbcb809-95c7-4224-9efd-b8f55a722a05 could not be found. Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ed37a3b4-57f1-4788-a940-57890ec63b83 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/servers/dcbcb809-95c7-4224-9efd-b8f55a722a05/action HTTP/1.1 Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 65 Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: {"rebuild": {"imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799"}} Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance dcbcb809-95c7-4224-9efd-b8f55a722a05 could not be found. Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'dcbcb809-95c7-4224-9efd-b8f55a722a05', 'body': {'rebuild': {'imageRef': '4c30e8e9-8fb2-4377-83f1-98322cb17799'}}} Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcbcb809-95c7-4224-9efd-b8f55a722a05 could not be found. Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 24 21:09:31.134627 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:09:31.139414 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:09:31.139414 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:09:31.139414 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:09:31.139414 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcbcb809-95c7-4224-9efd-b8f55a722a05 could not be found. Sep 24 21:09:31.139414 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:31.139414 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:31.139414 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:31.139414 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:31.139414 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:31.139414 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:31.139414 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:09:31.139414 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:09:31.139414 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcbcb809-95c7-4224-9efd-b8f55a722a05 could not be found. Sep 24 21:09:31.139414 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:31.141867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ed37a3b4-57f1-4788-a940-57890ec63b83 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 404 to user: Instance dcbcb809-95c7-4224-9efd-b8f55a722a05 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:09:31.143273 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ed37a3b4-57f1-4788-a940-57890ec63b83 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers/dcbcb809-95c7-4224-9efd-b8f55a722a05/action" status: 404 len: 111 microversion: 2.1 time: 0.033650 Sep 24 21:09:31.147345 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2458/4919] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:09:31 2022] POST /compute/v2.1/servers/dcbcb809-95c7-4224-9efd-b8f55a722a05/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 21:09:31.162783 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-be150ecc-5bf1-4370-9715-6ae18431d770 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:31.163982 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-be150ecc-5bf1-4370-9715-6ae18431d770 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:31.182574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-be150ecc-5bf1-4370-9715-6ae18431d770 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:31.183157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-be150ecc-5bf1-4370-9715-6ae18431d770 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:31.195572 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-be150ecc-5bf1-4370-9715-6ae18431d770 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:31.196360 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-be150ecc-5bf1-4370-9715-6ae18431d770 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:31.203985 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-be150ecc-5bf1-4370-9715-6ae18431d770 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:31.205026 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-be150ecc-5bf1-4370-9715-6ae18431d770 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:31.478940 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-98329717-f5e6-4645-b3f1-59adf28fa353 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:31.491152 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-98329717-f5e6-4645-b3f1-59adf28fa353 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1492 microversion: 2.1 time: 0.424575 Sep 24 21:09:31.493851 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2462/4920] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:31 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1492 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:31.500365 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0e0ec484-0c29-4454-92c6-738364002166 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:31.501470 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0e0ec484-0c29-4454-92c6-738364002166 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 480b3ea3-dcc4-4a43-a334-00f5cd435884] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:31.509106 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e0ec484-0c29-4454-92c6-738364002166 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:31.509740 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e0ec484-0c29-4454-92c6-738364002166 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:31.510285 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e0ec484-0c29-4454-92c6-738364002166 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:31.511490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e0ec484-0c29-4454-92c6-738364002166 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:31.512445 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e0ec484-0c29-4454-92c6-738364002166 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:31.513700 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e0ec484-0c29-4454-92c6-738364002166 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:31.601693 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-be150ecc-5bf1-4370-9715-6ae18431d770 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:31.615059 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-be150ecc-5bf1-4370-9715-6ae18431d770 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.455973 Sep 24 21:09:31.615725 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2459/4921] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:31 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:31.648560 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-452f6da4-fc41-4100-966e-e9e1fff0e79b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:31.649554 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-452f6da4-fc41-4100-966e-e9e1fff0e79b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:31.661244 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-452f6da4-fc41-4100-966e-e9e1fff0e79b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:31.663165 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-452f6da4-fc41-4100-966e-e9e1fff0e79b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:31.663793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-452f6da4-fc41-4100-966e-e9e1fff0e79b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:31.664702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-452f6da4-fc41-4100-966e-e9e1fff0e79b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:31.665441 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-452f6da4-fc41-4100-966e-e9e1fff0e79b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:31.667815 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-452f6da4-fc41-4100-966e-e9e1fff0e79b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:31.893484 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0e0ec484-0c29-4454-92c6-738364002166 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:31.904791 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0e0ec484-0c29-4454-92c6-738364002166 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884" status: 200 len: 1366 microversion: 2.1 time: 0.409506 Sep 24 21:09:31.922350 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2463/4922] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:31 2022] GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884 => generated 1366 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:32.003921 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-452f6da4-fc41-4100-966e-e9e1fff0e79b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:32.015581 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-452f6da4-fc41-4100-966e-e9e1fff0e79b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.371251 Sep 24 21:09:32.016755 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2460/4923] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:31 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:09:32.039482 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4093830b-760f-4bd8-b009-95d317323c21 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:09:32.040201 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4093830b-760f-4bd8-b009-95d317323c21 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: 5db05eea-b761-44cd-bff1-db9303492609] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:32.047335 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-4093830b-760f-4bd8-b009-95d317323c21 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] HTTP exception thrown: Instance 5db05eea-b761-44cd-bff1-db9303492609 could not be found. Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4093830b-760f-4bd8-b009-95d317323c21 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers/5db05eea-b761-44cd-bff1-db9303492609/action HTTP/1.1 Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 15 Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: {"restore": {}} Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 5db05eea-b761-44cd-bff1-db9303492609 could not be found. Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '5db05eea-b761-44cd-bff1-db9303492609', 'body': {'restore': {}}} Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5db05eea-b761-44cd-bff1-db9303492609 could not be found. Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5db05eea-b761-44cd-bff1-db9303492609 could not be found. Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:32.050216 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:32.056639 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:09:32.056639 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:09:32.056639 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5db05eea-b761-44cd-bff1-db9303492609 could not be found. Sep 24 21:09:32.056639 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:32.058326 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4093830b-760f-4bd8-b009-95d317323c21 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 404 to user: Instance 5db05eea-b761-44cd-bff1-db9303492609 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:09:32.059545 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4093830b-760f-4bd8-b009-95d317323c21 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers/5db05eea-b761-44cd-bff1-db9303492609/action" status: 404 len: 111 microversion: 2.1 time: 0.024378 Sep 24 21:09:32.060669 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2464/4924] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:09:32 2022] POST /compute/v2.1/servers/5db05eea-b761-44cd-bff1-db9303492609/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:09:32.070568 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-00dcb962-a5a3-4705-800f-5d0e499afd3a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:32.071472 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-00dcb962-a5a3-4705-800f-5d0e499afd3a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:32.079320 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00dcb962-a5a3-4705-800f-5d0e499afd3a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:32.080196 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00dcb962-a5a3-4705-800f-5d0e499afd3a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:32.080845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00dcb962-a5a3-4705-800f-5d0e499afd3a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:32.082425 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00dcb962-a5a3-4705-800f-5d0e499afd3a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:32.083378 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00dcb962-a5a3-4705-800f-5d0e499afd3a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:32.084009 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00dcb962-a5a3-4705-800f-5d0e499afd3a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:32.324248 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-00dcb962-a5a3-4705-800f-5d0e499afd3a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:32.336201 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-00dcb962-a5a3-4705-800f-5d0e499afd3a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.271405 Sep 24 21:09:32.337809 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2461/4925] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:32 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:09:32.362247 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-12076221-e77f-4161-b8e5-2925bc39f932 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:32.364634 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-12076221-e77f-4161-b8e5-2925bc39f932 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:32.381343 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12076221-e77f-4161-b8e5-2925bc39f932 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:32.382193 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12076221-e77f-4161-b8e5-2925bc39f932 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:32.382902 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12076221-e77f-4161-b8e5-2925bc39f932 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:32.385482 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12076221-e77f-4161-b8e5-2925bc39f932 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:32.386935 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12076221-e77f-4161-b8e5-2925bc39f932 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:32.387809 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12076221-e77f-4161-b8e5-2925bc39f932 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:32.534279 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-01677a7f-37fc-462c-9c24-f5f31e9912c7 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:32.540215 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-01677a7f-37fc-462c-9c24-f5f31e9912c7 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:32.549060 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-01677a7f-37fc-462c-9c24-f5f31e9912c7 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:32.549531 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-01677a7f-37fc-462c-9c24-f5f31e9912c7 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:32.549933 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-01677a7f-37fc-462c-9c24-f5f31e9912c7 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:32.550698 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-01677a7f-37fc-462c-9c24-f5f31e9912c7 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:32.551167 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-01677a7f-37fc-462c-9c24-f5f31e9912c7 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:32.551596 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-01677a7f-37fc-462c-9c24-f5f31e9912c7 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:32.558555 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-12076221-e77f-4161-b8e5-2925bc39f932 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:32.568641 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-12076221-e77f-4161-b8e5-2925bc39f932 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.212926 Sep 24 21:09:32.569853 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2465/4926] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:32 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:32.592613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7ff3c297-7c13-494c-88a7-e543ade249f1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:09:32.593518 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7ff3c297-7c13-494c-88a7-e543ade249f1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:32.600012 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7ff3c297-7c13-494c-88a7-e543ade249f1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:32.600748 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7ff3c297-7c13-494c-88a7-e543ade249f1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:32.601840 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7ff3c297-7c13-494c-88a7-e543ade249f1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:32.602793 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7ff3c297-7c13-494c-88a7-e543ade249f1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:32.603491 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7ff3c297-7c13-494c-88a7-e543ade249f1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:32.605127 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7ff3c297-7c13-494c-88a7-e543ade249f1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:32.639955 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-7ff3c297-7c13-494c-88a7-e543ade249f1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] HTTP exception thrown: Cannot 'restore' instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f while it is in vm_state active Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7ff3c297-7c13-494c-88a7-e543ade249f1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f/action HTTP/1.1 Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 15 Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: {"restore": {}} Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: exception: Cannot 'restore' instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f while it is in vm_state active Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'f3fcc34d-d09a-4475-bd96-51ac0074cb5f', 'body': {'restore': {}}} Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f in vm_state active. Cannot restore while the instance is in this state. Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f while it is in vm_state active Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:32.642873 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:32.648745 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:32.648745 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:09:32.648745 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:09:32.648745 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f while it is in vm_state active Sep 24 21:09:32.648745 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:32.652690 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7ff3c297-7c13-494c-88a7-e543ade249f1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 409 to user: Cannot 'restore' instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f while it is in vm_state active {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:09:32.653909 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7ff3c297-7c13-494c-88a7-e543ade249f1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f/action" status: 409 len: 145 microversion: 2.1 time: 0.066207 Sep 24 21:09:32.655548 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2466/4927] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:09:32 2022] POST /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f/action => generated 145 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 24 21:09:32.664027 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dfd9b678-407c-4cf9-a2fe-4ffeb4ba3c4e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:32.664654 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dfd9b678-407c-4cf9-a2fe-4ffeb4ba3c4e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:32.673154 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dfd9b678-407c-4cf9-a2fe-4ffeb4ba3c4e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:32.673526 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dfd9b678-407c-4cf9-a2fe-4ffeb4ba3c4e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:32.677153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dfd9b678-407c-4cf9-a2fe-4ffeb4ba3c4e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:32.678086 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dfd9b678-407c-4cf9-a2fe-4ffeb4ba3c4e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:32.680756 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dfd9b678-407c-4cf9-a2fe-4ffeb4ba3c4e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:32.681374 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dfd9b678-407c-4cf9-a2fe-4ffeb4ba3c4e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:32.738282 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:09:33.020682 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=20 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:09:33.188272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-01677a7f-37fc-462c-9c24-f5f31e9912c7 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:33.204007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dfd9b678-407c-4cf9-a2fe-4ffeb4ba3c4e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:33.213026 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-01677a7f-37fc-462c-9c24-f5f31e9912c7 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1492 microversion: 2.1 time: 0.682591 Sep 24 21:09:33.214431 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2462/4928] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:32 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1492 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:33.216890 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dfd9b678-407c-4cf9-a2fe-4ffeb4ba3c4e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.556524 Sep 24 21:09:33.219531 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2467/4929] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:32 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:33.223195 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c03299d4-2722-4aab-8840-b3438ad28b2f tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:33.223810 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c03299d4-2722-4aab-8840-b3438ad28b2f tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 480b3ea3-dcc4-4a43-a334-00f5cd435884] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:33.233516 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c03299d4-2722-4aab-8840-b3438ad28b2f tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:33.233931 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c03299d4-2722-4aab-8840-b3438ad28b2f tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:33.242242 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9f5f8a7a-bd94-4a0d-afc1-6253f2387765 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:33.242915 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9f5f8a7a-bd94-4a0d-afc1-6253f2387765 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:33.252830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c03299d4-2722-4aab-8840-b3438ad28b2f tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:33.253605 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c03299d4-2722-4aab-8840-b3438ad28b2f tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:33.254086 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c03299d4-2722-4aab-8840-b3438ad28b2f tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:33.256811 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c03299d4-2722-4aab-8840-b3438ad28b2f tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:33.258994 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f5f8a7a-bd94-4a0d-afc1-6253f2387765 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:33.261414 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f5f8a7a-bd94-4a0d-afc1-6253f2387765 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:33.262923 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f5f8a7a-bd94-4a0d-afc1-6253f2387765 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:33.264859 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f5f8a7a-bd94-4a0d-afc1-6253f2387765 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:33.265836 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f5f8a7a-bd94-4a0d-afc1-6253f2387765 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:33.267071 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9f5f8a7a-bd94-4a0d-afc1-6253f2387765 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:33.743105 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c03299d4-2722-4aab-8840-b3438ad28b2f tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:33.755333 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c03299d4-2722-4aab-8840-b3438ad28b2f tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884" status: 200 len: 1366 microversion: 2.1 time: 0.539362 Sep 24 21:09:33.771487 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2463/4930] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:33 2022] GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884 => generated 1366 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:33.794594 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9f5f8a7a-bd94-4a0d-afc1-6253f2387765 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:33.810677 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9f5f8a7a-bd94-4a0d-afc1-6253f2387765 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.572931 Sep 24 21:09:33.811527 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2468/4931] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:33 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:33.836132 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8c7b20da-b2a3-48c0-b3e3-645874747343 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:09:33.837379 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8c7b20da-b2a3-48c0-b3e3-645874747343 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: 3f6e95e4-0a01-4afd-8989-0e7c61e8628a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:33.845692 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-8c7b20da-b2a3-48c0-b3e3-645874747343 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] HTTP exception thrown: Instance 3f6e95e4-0a01-4afd-8989-0e7c61e8628a could not be found. Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8c7b20da-b2a3-48c0-b3e3-645874747343 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/servers/3f6e95e4-0a01-4afd-8989-0e7c61e8628a/action HTTP/1.1 Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 14 Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: {"resume": {}} Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 3f6e95e4-0a01-4afd-8989-0e7c61e8628a could not be found. Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '3f6e95e4-0a01-4afd-8989-0e7c61e8628a', 'body': {'resume': {}}} Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f6e95e4-0a01-4afd-8989-0e7c61e8628a could not be found. Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f6e95e4-0a01-4afd-8989-0e7c61e8628a could not be found. Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:33.852972 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:33.859095 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:09:33.859095 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:09:33.859095 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f6e95e4-0a01-4afd-8989-0e7c61e8628a could not be found. Sep 24 21:09:33.859095 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:33.866948 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8c7b20da-b2a3-48c0-b3e3-645874747343 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 404 to user: Instance 3f6e95e4-0a01-4afd-8989-0e7c61e8628a could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:09:33.867954 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8c7b20da-b2a3-48c0-b3e3-645874747343 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers/3f6e95e4-0a01-4afd-8989-0e7c61e8628a/action" status: 404 len: 111 microversion: 2.1 time: 0.036998 Sep 24 21:09:33.871082 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2464/4932] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:09:33 2022] POST /compute/v2.1/servers/3f6e95e4-0a01-4afd-8989-0e7c61e8628a/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 21:09:33.877608 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6c80cc67-6ba9-4835-96a1-6973e3f05dc3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:33.878142 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6c80cc67-6ba9-4835-96a1-6973e3f05dc3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:33.894106 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c80cc67-6ba9-4835-96a1-6973e3f05dc3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:33.894844 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c80cc67-6ba9-4835-96a1-6973e3f05dc3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:33.895632 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c80cc67-6ba9-4835-96a1-6973e3f05dc3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:33.896519 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c80cc67-6ba9-4835-96a1-6973e3f05dc3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:33.896979 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c80cc67-6ba9-4835-96a1-6973e3f05dc3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:33.897406 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c80cc67-6ba9-4835-96a1-6973e3f05dc3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:34.236763 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b0c35b24-4483-479f-b67f-828e8e36f4eb tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:34.238108 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b0c35b24-4483-479f-b67f-828e8e36f4eb tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:34.246776 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0c35b24-4483-479f-b67f-828e8e36f4eb tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:34.247645 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0c35b24-4483-479f-b67f-828e8e36f4eb tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:34.248316 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0c35b24-4483-479f-b67f-828e8e36f4eb tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:34.249326 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0c35b24-4483-479f-b67f-828e8e36f4eb tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:34.250006 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0c35b24-4483-479f-b67f-828e8e36f4eb tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:34.251290 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0c35b24-4483-479f-b67f-828e8e36f4eb tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:34.314162 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6c80cc67-6ba9-4835-96a1-6973e3f05dc3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:34.332241 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6c80cc67-6ba9-4835-96a1-6973e3f05dc3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.458304 Sep 24 21:09:34.332954 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2469/4933] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:33 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:34.368837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7ea819cb-a5c9-488a-92b8-5d0fea151c67 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:34.370699 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7ea819cb-a5c9-488a-92b8-5d0fea151c67 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:34.381068 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7ea819cb-a5c9-488a-92b8-5d0fea151c67 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:34.382027 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7ea819cb-a5c9-488a-92b8-5d0fea151c67 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:34.384118 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7ea819cb-a5c9-488a-92b8-5d0fea151c67 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:34.385575 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7ea819cb-a5c9-488a-92b8-5d0fea151c67 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:34.386542 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7ea819cb-a5c9-488a-92b8-5d0fea151c67 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:34.387313 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7ea819cb-a5c9-488a-92b8-5d0fea151c67 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:35.041380 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b0c35b24-4483-479f-b67f-828e8e36f4eb tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:35.056789 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b0c35b24-4483-479f-b67f-828e8e36f4eb tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1498 microversion: 2.1 time: 0.823895 Sep 24 21:09:35.057923 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2465/4934] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:34 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1498 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:09:35.085188 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4de6edbf-93cb-49a1-a748-671d41252cf3 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:35.086915 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4de6edbf-93cb-49a1-a748-671d41252cf3 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 480b3ea3-dcc4-4a43-a334-00f5cd435884] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:35.099757 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4de6edbf-93cb-49a1-a748-671d41252cf3 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:35.101376 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4de6edbf-93cb-49a1-a748-671d41252cf3 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:35.101996 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4de6edbf-93cb-49a1-a748-671d41252cf3 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:35.104189 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4de6edbf-93cb-49a1-a748-671d41252cf3 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:35.105070 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4de6edbf-93cb-49a1-a748-671d41252cf3 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:35.105740 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4de6edbf-93cb-49a1-a748-671d41252cf3 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:35.119593 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7ea819cb-a5c9-488a-92b8-5d0fea151c67 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:35.133801 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7ea819cb-a5c9-488a-92b8-5d0fea151c67 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.775541 Sep 24 21:09:35.136831 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2470/4935] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:34 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:35.144159 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5881fb31-0d53-45a9-94ca-5eb28477e422 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:35.144672 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5881fb31-0d53-45a9-94ca-5eb28477e422 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:35.166634 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5881fb31-0d53-45a9-94ca-5eb28477e422 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:35.167663 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5881fb31-0d53-45a9-94ca-5eb28477e422 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:35.167981 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5881fb31-0d53-45a9-94ca-5eb28477e422 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:35.169002 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5881fb31-0d53-45a9-94ca-5eb28477e422 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:35.169324 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5881fb31-0d53-45a9-94ca-5eb28477e422 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:35.169909 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5881fb31-0d53-45a9-94ca-5eb28477e422 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:35.206937 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5881fb31-0d53-45a9-94ca-5eb28477e422 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:09:35.306426 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5881fb31-0d53-45a9-94ca-5eb28477e422 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 204 len: 0 microversion: 2.1 time: 0.168305 Sep 24 21:09:35.316160 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2471/4936] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:09:35 2022] DELETE /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:09:35.339760 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-99276d79-2de5-46d4-b6d6-530db8b9e8b9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:09:35.340479 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-99276d79-2de5-46d4-b6d6-530db8b9e8b9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:35.360116 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-99276d79-2de5-46d4-b6d6-530db8b9e8b9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:35.360664 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-99276d79-2de5-46d4-b6d6-530db8b9e8b9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:35.361115 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-99276d79-2de5-46d4-b6d6-530db8b9e8b9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:35.361856 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-99276d79-2de5-46d4-b6d6-530db8b9e8b9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:35.362312 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-99276d79-2de5-46d4-b6d6-530db8b9e8b9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:35.362764 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-99276d79-2de5-46d4-b6d6-530db8b9e8b9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:35.424641 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4de6edbf-93cb-49a1-a748-671d41252cf3 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:35.435248 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-99276d79-2de5-46d4-b6d6-530db8b9e8b9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] HTTP exception thrown: Cannot 'resume' instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f while it is in vm_state active Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-99276d79-2de5-46d4-b6d6-530db8b9e8b9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f/action HTTP/1.1 Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 14 Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: {"resume": {}} Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: exception: Cannot 'resume' instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f while it is in vm_state active Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'f3fcc34d-d09a-4475-bd96-51ac0074cb5f', 'body': {'resume': {}}} Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f in vm_state active. Cannot resume while the instance is in this state. Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f while it is in vm_state active Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:35.437188 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:35.440999 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:35.440999 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:35.440999 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:35.440999 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:09:35.440999 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:09:35.440999 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f while it is in vm_state active Sep 24 21:09:35.440999 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:35.440999 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-99276d79-2de5-46d4-b6d6-530db8b9e8b9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 409 to user: Cannot 'resume' instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f while it is in vm_state active {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:09:35.440999 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-99276d79-2de5-46d4-b6d6-530db8b9e8b9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f/action" status: 409 len: 144 microversion: 2.1 time: 0.108743 Sep 24 21:09:35.456826 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2472/4937] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:09:35 2022] POST /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f/action => generated 144 bytes in 140 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 24 21:09:35.470554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-20c1afa0-1507-4b1d-a40a-df52c5ad5e26 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:35.471375 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-20c1afa0-1507-4b1d-a40a-df52c5ad5e26 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:35.480382 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-20c1afa0-1507-4b1d-a40a-df52c5ad5e26 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:35.481842 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4de6edbf-93cb-49a1-a748-671d41252cf3 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884" status: 200 len: 1366 microversion: 2.1 time: 0.421959 Sep 24 21:09:35.484608 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2466/4938] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:35 2022] GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884 => generated 1366 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:35.495599 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-20c1afa0-1507-4b1d-a40a-df52c5ad5e26 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:35.499169 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-20c1afa0-1507-4b1d-a40a-df52c5ad5e26 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:35.500181 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-20c1afa0-1507-4b1d-a40a-df52c5ad5e26 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:35.501316 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-20c1afa0-1507-4b1d-a40a-df52c5ad5e26 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:35.503067 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c2fb0f4a-3a23-48bc-b5aa-a36e3715fdad tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:35.503199 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-20c1afa0-1507-4b1d-a40a-df52c5ad5e26 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:35.503764 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c2fb0f4a-3a23-48bc-b5aa-a36e3715fdad tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:35.543434 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2fb0f4a-3a23-48bc-b5aa-a36e3715fdad tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:35.548182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2fb0f4a-3a23-48bc-b5aa-a36e3715fdad tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:35.549048 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2fb0f4a-3a23-48bc-b5aa-a36e3715fdad tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:35.553135 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2fb0f4a-3a23-48bc-b5aa-a36e3715fdad tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:35.553847 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2fb0f4a-3a23-48bc-b5aa-a36e3715fdad tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:35.554451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2fb0f4a-3a23-48bc-b5aa-a36e3715fdad tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:35.926432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-20c1afa0-1507-4b1d-a40a-df52c5ad5e26 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:35.939173 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c2fb0f4a-3a23-48bc-b5aa-a36e3715fdad tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:35.940456 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-20c1afa0-1507-4b1d-a40a-df52c5ad5e26 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1504 microversion: 2.1 time: 0.482470 Sep 24 21:09:35.942314 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2473/4939] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:35 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1504 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:35.947219 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c2fb0f4a-3a23-48bc-b5aa-a36e3715fdad tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.459442 Sep 24 21:09:35.947796 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2467/4940] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:35 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:35.972305 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-66f9d7bf-6c62-41f9-88d0-2941463388cf req-127e3069-1b7e-48d7-b743-180d087f6b0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "480b3ea3-dcc4-4a43-a334-00f5cd435884", "name": "network-vif-plugged", "status": "completed", "tag": "cc46c09b-dd44-4ab4-9d14-2c6fa3de14ac"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:09:35.977451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c031d2d5-6d76-44cc-b622-d7cde436d511 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:35.978434 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c031d2d5-6d76-44cc-b622-d7cde436d511 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:35.984982 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-66f9d7bf-6c62-41f9-88d0-2941463388cf req-127e3069-1b7e-48d7-b743-180d087f6b0c service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:35.985467 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-66f9d7bf-6c62-41f9-88d0-2941463388cf req-127e3069-1b7e-48d7-b743-180d087f6b0c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:35.985905 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-66f9d7bf-6c62-41f9-88d0-2941463388cf req-127e3069-1b7e-48d7-b743-180d087f6b0c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:35.986260 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c031d2d5-6d76-44cc-b622-d7cde436d511 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:35.986980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c031d2d5-6d76-44cc-b622-d7cde436d511 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:35.987590 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c031d2d5-6d76-44cc-b622-d7cde436d511 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:35.988640 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c031d2d5-6d76-44cc-b622-d7cde436d511 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:35.989256 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c031d2d5-6d76-44cc-b622-d7cde436d511 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:35.989861 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c031d2d5-6d76-44cc-b622-d7cde436d511 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:35.998785 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-66f9d7bf-6c62-41f9-88d0-2941463388cf req-127e3069-1b7e-48d7-b743-180d087f6b0c service nova] Creating event network-vif-plugged:cc46c09b-dd44-4ab4-9d14-2c6fa3de14ac for instance 480b3ea3-dcc4-4a43-a334-00f5cd435884 on nch1-master-1 Sep 24 21:09:36.010741 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-66f9d7bf-6c62-41f9-88d0-2941463388cf req-127e3069-1b7e-48d7-b743-180d087f6b0c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063418 Sep 24 21:09:36.017330 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2474/4941] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:09:36.272666 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c031d2d5-6d76-44cc-b622-d7cde436d511 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:36.281691 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c031d2d5-6d76-44cc-b622-d7cde436d511 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.307683 Sep 24 21:09:36.282271 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2468/4942] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:35 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:36.429123 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1801781b-aa67-47ac-81ab-c280c2732b92 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "4cf0d4ca-4d29-4d04-b103-2ecdbbb3545f"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1801781b-aa67-47ac-81ab-c280c2732b92 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 160 Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: {"server": {"name": "", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "4cf0d4ca-4d29-4d04-b103-2ecdbbb3545f"}]}} Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'body': {'server': {'name': '', 'imageRef': '4c30e8e9-8fb2-4377-83f1-98322cb17799', 'flavorRef': '452', 'networks': [{'uuid': '4cf0d4ca-4d29-4d04-b103-2ecdbbb3545f'}]}}} Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise error Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi '' Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 21:09:36.433973 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 21:09:36.438072 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 21:09:36.438072 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 24 21:09:36.438072 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:36.438072 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:36.438072 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:36.438072 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:36.438072 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:36.438072 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:36.438072 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 21:09:36.438072 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 21:09:36.438072 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 24 21:09:36.438072 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:36.438072 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1801781b-aa67-47ac-81ab-c280c2732b92 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:09:36.438072 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1801781b-aa67-47ac-81ab-c280c2732b92 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.011607 Sep 24 21:09:36.444778 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7dfd3e17-32d0-4a01-897b-39ec93e67011 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:36.445512 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7dfd3e17-32d0-4a01-897b-39ec93e67011 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:36.449715 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2475/4943] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:09:36 2022] POST /compute/v2.1/servers => generated 108 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:09:36.453264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7dfd3e17-32d0-4a01-897b-39ec93e67011 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:36.453737 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7dfd3e17-32d0-4a01-897b-39ec93e67011 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:36.454246 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7dfd3e17-32d0-4a01-897b-39ec93e67011 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:36.455047 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7dfd3e17-32d0-4a01-897b-39ec93e67011 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:36.455713 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7dfd3e17-32d0-4a01-897b-39ec93e67011 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:36.456235 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7dfd3e17-32d0-4a01-897b-39ec93e67011 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:36.513412 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0068a27a-0ea5-44b4-9646-9196a478eae4 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:36.514552 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0068a27a-0ea5-44b4-9646-9196a478eae4 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 480b3ea3-dcc4-4a43-a334-00f5cd435884] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:36.522762 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0068a27a-0ea5-44b4-9646-9196a478eae4 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:36.523359 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0068a27a-0ea5-44b4-9646-9196a478eae4 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:36.523863 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0068a27a-0ea5-44b4-9646-9196a478eae4 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:36.525210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0068a27a-0ea5-44b4-9646-9196a478eae4 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:36.525832 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0068a27a-0ea5-44b4-9646-9196a478eae4 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:36.526883 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0068a27a-0ea5-44b4-9646-9196a478eae4 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:36.547157 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:09:36.715829 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7dfd3e17-32d0-4a01-897b-39ec93e67011 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:36.737183 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7dfd3e17-32d0-4a01-897b-39ec93e67011 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.292823 Sep 24 21:09:36.741180 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2469/4944] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:36 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:36.763721 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2aaeeae1-7cc7-4691-90b7-7d3b23a71fb3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:36.767054 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0068a27a-0ea5-44b4-9646-9196a478eae4 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:36.770321 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2aaeeae1-7cc7-4691-90b7-7d3b23a71fb3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:36.782474 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2aaeeae1-7cc7-4691-90b7-7d3b23a71fb3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:36.782994 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2aaeeae1-7cc7-4691-90b7-7d3b23a71fb3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:36.783440 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2aaeeae1-7cc7-4691-90b7-7d3b23a71fb3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:36.784154 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2aaeeae1-7cc7-4691-90b7-7d3b23a71fb3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:36.784873 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0068a27a-0ea5-44b4-9646-9196a478eae4 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884" status: 200 len: 1366 microversion: 2.1 time: 0.272152 Sep 24 21:09:36.785507 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2476/4945] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:36 2022] GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884 => generated 1366 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:36.785841 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2aaeeae1-7cc7-4691-90b7-7d3b23a71fb3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:36.786276 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2aaeeae1-7cc7-4691-90b7-7d3b23a71fb3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:36.806379 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:09:36.956550 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2aaeeae1-7cc7-4691-90b7-7d3b23a71fb3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:36.965729 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-93ed7dc3-7450-4ce5-9638-60f642d7e595 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:36.967814 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-93ed7dc3-7450-4ce5-9638-60f642d7e595 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:36.973589 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2aaeeae1-7cc7-4691-90b7-7d3b23a71fb3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.213450 Sep 24 21:09:36.979058 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93ed7dc3-7450-4ce5-9638-60f642d7e595 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:36.980760 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93ed7dc3-7450-4ce5-9638-60f642d7e595 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:36.981373 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93ed7dc3-7450-4ce5-9638-60f642d7e595 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:36.983256 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93ed7dc3-7450-4ce5-9638-60f642d7e595 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:36.984174 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93ed7dc3-7450-4ce5-9638-60f642d7e595 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:36.984760 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93ed7dc3-7450-4ce5-9638-60f642d7e595 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:36.988740 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2470/4946] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:36 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:36.997637 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fc7ec085-dac7-4b07-8190-4eb42baf1722 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:09:36.999263 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fc7ec085-dac7-4b07-8190-4eb42baf1722 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: b01c54c6-89c9-4abc-ab59-1c2af8149ee9] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:37.008172 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-fc7ec085-dac7-4b07-8190-4eb42baf1722 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] HTTP exception thrown: Instance b01c54c6-89c9-4abc-ab59-1c2af8149ee9 could not be found. Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fc7ec085-dac7-4b07-8190-4eb42baf1722 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/servers/b01c54c6-89c9-4abc-ab59-1c2af8149ee9/action HTTP/1.1 Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 14 Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: {"shelve": {}} Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance b01c54c6-89c9-4abc-ab59-1c2af8149ee9 could not be found. Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'b01c54c6-89c9-4abc-ab59-1c2af8149ee9', 'body': {'shelve': {}}} Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b01c54c6-89c9-4abc-ab59-1c2af8149ee9 could not be found. Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b01c54c6-89c9-4abc-ab59-1c2af8149ee9 could not be found. Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:37.017793 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:37.023003 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:09:37.023003 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:09:37.023003 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b01c54c6-89c9-4abc-ab59-1c2af8149ee9 could not be found. Sep 24 21:09:37.023003 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:37.024617 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fc7ec085-dac7-4b07-8190-4eb42baf1722 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 404 to user: Instance b01c54c6-89c9-4abc-ab59-1c2af8149ee9 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:09:37.025573 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fc7ec085-dac7-4b07-8190-4eb42baf1722 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers/b01c54c6-89c9-4abc-ab59-1c2af8149ee9/action" status: 404 len: 111 microversion: 2.1 time: 0.032168 Sep 24 21:09:37.027923 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2471/4947] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:09:36 2022] POST /compute/v2.1/servers/b01c54c6-89c9-4abc-ab59-1c2af8149ee9/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 21:09:37.036353 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b6574f39-5e79-4a48-b1be-2c8cc7a2aa36 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:37.040999 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b6574f39-5e79-4a48-b1be-2c8cc7a2aa36 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:37.050393 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6574f39-5e79-4a48-b1be-2c8cc7a2aa36 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:37.050936 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6574f39-5e79-4a48-b1be-2c8cc7a2aa36 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:37.051379 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6574f39-5e79-4a48-b1be-2c8cc7a2aa36 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:37.054602 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6574f39-5e79-4a48-b1be-2c8cc7a2aa36 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:37.055252 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6574f39-5e79-4a48-b1be-2c8cc7a2aa36 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:37.055853 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6574f39-5e79-4a48-b1be-2c8cc7a2aa36 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:37.297140 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b6574f39-5e79-4a48-b1be-2c8cc7a2aa36 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:37.307185 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b6574f39-5e79-4a48-b1be-2c8cc7a2aa36 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.272741 Sep 24 21:09:37.310978 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2472/4948] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:37 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:09:37.319381 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-93ed7dc3-7450-4ce5-9638-60f642d7e595 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:37.332458 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-10acd171-e5d8-49c6-b389-25fac11ee047 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:37.333713 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-10acd171-e5d8-49c6-b389-25fac11ee047 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:37.334997 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-93ed7dc3-7450-4ce5-9638-60f642d7e595 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1504 microversion: 2.1 time: 0.374058 Sep 24 21:09:37.341655 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10acd171-e5d8-49c6-b389-25fac11ee047 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:37.342372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10acd171-e5d8-49c6-b389-25fac11ee047 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:37.343185 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10acd171-e5d8-49c6-b389-25fac11ee047 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:37.344171 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10acd171-e5d8-49c6-b389-25fac11ee047 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:37.344574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10acd171-e5d8-49c6-b389-25fac11ee047 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:37.345008 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10acd171-e5d8-49c6-b389-25fac11ee047 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:37.350872 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2477/4949] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:36 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1504 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:37.505691 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-10acd171-e5d8-49c6-b389-25fac11ee047 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:37.515311 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-10acd171-e5d8-49c6-b389-25fac11ee047 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.186714 Sep 24 21:09:37.531741 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2473/4950] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:37 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:09:37.539509 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-33d446f2-e589-4684-bf25-9685cdb4ccee tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:09:37.540060 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-33d446f2-e589-4684-bf25-9685cdb4ccee tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:37.547286 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33d446f2-e589-4684-bf25-9685cdb4ccee tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:37.547787 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33d446f2-e589-4684-bf25-9685cdb4ccee tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:37.548228 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33d446f2-e589-4684-bf25-9685cdb4ccee tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:37.548941 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33d446f2-e589-4684-bf25-9685cdb4ccee tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:37.549399 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33d446f2-e589-4684-bf25-9685cdb4ccee tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:37.549826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33d446f2-e589-4684-bf25-9685cdb4ccee tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:37.576025 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-33d446f2-e589-4684-bf25-9685cdb4ccee tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lazy-loading 'flavor' on Instance uuid f3fcc34d-d09a-4475-bd96-51ac0074cb5f {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:09:37.812994 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-06d62854-0838-4bda-b220-1aee2b14d5d9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:37.813650 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-06d62854-0838-4bda-b220-1aee2b14d5d9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 480b3ea3-dcc4-4a43-a334-00f5cd435884] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:37.823686 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06d62854-0838-4bda-b220-1aee2b14d5d9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:37.824659 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06d62854-0838-4bda-b220-1aee2b14d5d9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:37.825289 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06d62854-0838-4bda-b220-1aee2b14d5d9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:37.826257 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06d62854-0838-4bda-b220-1aee2b14d5d9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:37.826856 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06d62854-0838-4bda-b220-1aee2b14d5d9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:37.827278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06d62854-0838-4bda-b220-1aee2b14d5d9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:37.908475 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-33d446f2-e589-4684-bf25-9685cdb4ccee tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f/action" status: 202 len: 0 microversion: 2.1 time: 0.370125 Sep 24 21:09:37.913855 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2478/4951] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:09:37 2022] POST /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:09:37.924474 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d3396acb-aa52-4385-91e6-d4d1f4f24ff9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:37.925260 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d3396acb-aa52-4385-91e6-d4d1f4f24ff9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:37.935404 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3396acb-aa52-4385-91e6-d4d1f4f24ff9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:37.936139 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3396acb-aa52-4385-91e6-d4d1f4f24ff9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:37.936753 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3396acb-aa52-4385-91e6-d4d1f4f24ff9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:37.937798 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3396acb-aa52-4385-91e6-d4d1f4f24ff9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:37.938766 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3396acb-aa52-4385-91e6-d4d1f4f24ff9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:37.939416 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3396acb-aa52-4385-91e6-d4d1f4f24ff9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:38.014123 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-06d62854-0838-4bda-b220-1aee2b14d5d9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:38.022726 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-06d62854-0838-4bda-b220-1aee2b14d5d9 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884" status: 200 len: 1556 microversion: 2.1 time: 0.216447 Sep 24 21:09:38.024051 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2474/4952] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:37 2022] GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884 => generated 1556 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:38.048209 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b7720bc9-07c8-4548-9c02-ad403a874218 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:38.048991 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b7720bc9-07c8-4548-9c02-ad403a874218 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 480b3ea3-dcc4-4a43-a334-00f5cd435884] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:38.063575 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7720bc9-07c8-4548-9c02-ad403a874218 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:38.064219 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7720bc9-07c8-4548-9c02-ad403a874218 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:38.065631 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7720bc9-07c8-4548-9c02-ad403a874218 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:38.066752 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7720bc9-07c8-4548-9c02-ad403a874218 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:38.067627 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7720bc9-07c8-4548-9c02-ad403a874218 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:38.068763 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7720bc9-07c8-4548-9c02-ad403a874218 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:38.203780 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d3396acb-aa52-4385-91e6-d4d1f4f24ff9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:38.215880 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b7720bc9-07c8-4548-9c02-ad403a874218 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.171861 Sep 24 21:09:38.218835 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d3396acb-aa52-4385-91e6-d4d1f4f24ff9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1512 microversion: 2.1 time: 0.302676 Sep 24 21:09:38.220166 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2479/4953] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:37 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1512 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:09:38.222401 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2475/4954] 10.222.0.52 () {58 vars in 1275 bytes} [Sat Sep 24 21:09:38 2022] GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884/os-interface => generated 284 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:09:38.365607 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0596a43e-243e-43a8-8509-72be0d12721e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:38.366315 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0596a43e-243e-43a8-8509-72be0d12721e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:38.376328 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0596a43e-243e-43a8-8509-72be0d12721e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:38.377036 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0596a43e-243e-43a8-8509-72be0d12721e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:38.378621 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0596a43e-243e-43a8-8509-72be0d12721e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:38.380019 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0596a43e-243e-43a8-8509-72be0d12721e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:38.380662 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0596a43e-243e-43a8-8509-72be0d12721e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:38.381891 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0596a43e-243e-43a8-8509-72be0d12721e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:38.863088 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0596a43e-243e-43a8-8509-72be0d12721e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:38.873367 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0596a43e-243e-43a8-8509-72be0d12721e tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1504 microversion: 2.1 time: 0.516663 Sep 24 21:09:38.875178 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2480/4955] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:38 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1504 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:39.243420 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f4621f84-091f-4f5f-875d-f25626895453 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:39.245146 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f4621f84-091f-4f5f-875d-f25626895453 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:39.259186 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4621f84-091f-4f5f-875d-f25626895453 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:39.260909 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4621f84-091f-4f5f-875d-f25626895453 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:39.261774 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4621f84-091f-4f5f-875d-f25626895453 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:39.263553 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4621f84-091f-4f5f-875d-f25626895453 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:39.267423 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4621f84-091f-4f5f-875d-f25626895453 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:39.268166 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4621f84-091f-4f5f-875d-f25626895453 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:39.610930 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-230a156c-8251-401e-9bc8-c95884d7bd9f req-a3cf1900-5091-4c59-bb93-8d9b008dadd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0496cfe1-2be3-438a-965a-c2994623a96c", "name": "network-vif-deleted", "tag": "a0dac7b8-a522-4a81-add9-68f10e113998"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:09:39.660051 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-230a156c-8251-401e-9bc8-c95884d7bd9f req-a3cf1900-5091-4c59-bb93-8d9b008dadd5 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:39.664468 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-230a156c-8251-401e-9bc8-c95884d7bd9f req-a3cf1900-5091-4c59-bb93-8d9b008dadd5 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:39.666324 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-230a156c-8251-401e-9bc8-c95884d7bd9f req-a3cf1900-5091-4c59-bb93-8d9b008dadd5 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:39.703063 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-230a156c-8251-401e-9bc8-c95884d7bd9f req-a3cf1900-5091-4c59-bb93-8d9b008dadd5 service nova] Creating event network-vif-deleted:a0dac7b8-a522-4a81-add9-68f10e113998 for instance 0496cfe1-2be3-438a-965a-c2994623a96c on nch2-master-1 Sep 24 21:09:39.709716 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-230a156c-8251-401e-9bc8-c95884d7bd9f req-a3cf1900-5091-4c59-bb93-8d9b008dadd5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102129 Sep 24 21:09:39.710992 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2481/4956] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:09:39.838929 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f4621f84-091f-4f5f-875d-f25626895453 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:39.855668 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f4621f84-091f-4f5f-875d-f25626895453 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1512 microversion: 2.1 time: 0.617267 Sep 24 21:09:39.856533 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2476/4957] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:39 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1512 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:39.904300 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-91a0d2b1-537c-41fd-a491-e7b155ce2a60 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:39.905564 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-91a0d2b1-537c-41fd-a491-e7b155ce2a60 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:39.919135 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-91a0d2b1-537c-41fd-a491-e7b155ce2a60 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:39.920357 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-91a0d2b1-537c-41fd-a491-e7b155ce2a60 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:39.921721 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-91a0d2b1-537c-41fd-a491-e7b155ce2a60 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:39.922807 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-91a0d2b1-537c-41fd-a491-e7b155ce2a60 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:39.923588 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-91a0d2b1-537c-41fd-a491-e7b155ce2a60 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:39.927205 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-91a0d2b1-537c-41fd-a491-e7b155ce2a60 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:39.969923 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-91a0d2b1-537c-41fd-a491-e7b155ce2a60 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:39.970738 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-91a0d2b1-537c-41fd-a491-e7b155ce2a60 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:39.971347 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-91a0d2b1-537c-41fd-a491-e7b155ce2a60 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:39.972126 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-91a0d2b1-537c-41fd-a491-e7b155ce2a60 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lazy-loading 'fault' on Instance uuid 0496cfe1-2be3-438a-965a-c2994623a96c {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:09:40.101162 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-91a0d2b1-537c-41fd-a491-e7b155ce2a60 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:40.117992 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-91a0d2b1-537c-41fd-a491-e7b155ce2a60 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 200 len: 1303 microversion: 2.1 time: 0.221297 Sep 24 21:09:40.118914 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2482/4958] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:39 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 1303 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:40.743375 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-4d28e058-c240-4f05-86f7-f1fcd4a9d1a2 req-7602d92e-160c-4220-a7a1-4c2332fae1ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "480b3ea3-dcc4-4a43-a334-00f5cd435884", "tag": "cc46c09b-dd44-4ab4-9d14-2c6fa3de14ac"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:09:40.764323 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-4d28e058-c240-4f05-86f7-f1fcd4a9d1a2 req-7602d92e-160c-4220-a7a1-4c2332fae1ee service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:40.767037 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-4d28e058-c240-4f05-86f7-f1fcd4a9d1a2 req-7602d92e-160c-4220-a7a1-4c2332fae1ee service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:40.767523 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-4d28e058-c240-4f05-86f7-f1fcd4a9d1a2 req-7602d92e-160c-4220-a7a1-4c2332fae1ee service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:40.790917 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-4d28e058-c240-4f05-86f7-f1fcd4a9d1a2 req-7602d92e-160c-4220-a7a1-4c2332fae1ee service nova] Creating event network-changed:cc46c09b-dd44-4ab4-9d14-2c6fa3de14ac for instance 480b3ea3-dcc4-4a43-a334-00f5cd435884 on nch1-master-1 Sep 24 21:09:40.799344 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-4d28e058-c240-4f05-86f7-f1fcd4a9d1a2 req-7602d92e-160c-4220-a7a1-4c2332fae1ee service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060705 Sep 24 21:09:40.800700 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2477/4959] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:09:40.883261 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3ffec5e5-3134-45ed-9b53-2126fc1654fd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:40.883896 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3ffec5e5-3134-45ed-9b53-2126fc1654fd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:40.890832 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:09:40.903737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ffec5e5-3134-45ed-9b53-2126fc1654fd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:40.903967 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ffec5e5-3134-45ed-9b53-2126fc1654fd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:40.910568 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ffec5e5-3134-45ed-9b53-2126fc1654fd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:40.912129 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ffec5e5-3134-45ed-9b53-2126fc1654fd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:40.913482 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ffec5e5-3134-45ed-9b53-2126fc1654fd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:40.914084 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ffec5e5-3134-45ed-9b53-2126fc1654fd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:41.142790 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b71660ed-8f6f-4bc7-84ec-b790e3980cbc tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:41.143512 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b71660ed-8f6f-4bc7-84ec-b790e3980cbc tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 0496cfe1-2be3-438a-965a-c2994623a96c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:41.154226 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b71660ed-8f6f-4bc7-84ec-b790e3980cbc tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:41.154769 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b71660ed-8f6f-4bc7-84ec-b790e3980cbc tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:41.155215 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b71660ed-8f6f-4bc7-84ec-b790e3980cbc tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:41.160627 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b71660ed-8f6f-4bc7-84ec-b790e3980cbc tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:41.163674 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b71660ed-8f6f-4bc7-84ec-b790e3980cbc tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:41.166228 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b71660ed-8f6f-4bc7-84ec-b790e3980cbc tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:41.200013 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-b71660ed-8f6f-4bc7-84ec-b790e3980cbc tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] HTTP exception thrown: Instance 0496cfe1-2be3-438a-965a-c2994623a96c could not be found. Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b71660ed-8f6f-4bc7-84ec-b790e3980cbc tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Request method failure captured: Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c HTTP/1.1 Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3Gac4a3b903vN2Ger8qc987ZXqsGRBouzU8aDgD3rc1PTnWq3As5vXy7kDuXvMvTP0pdg-b6RvWm9_gLSKeqpsX6dInnjLxXzI8ROHX6pq7WxDlH4acfUN37uZZJDkNTuwqrzlgqe80A_FX4D0fUHTc0H9OVD8fCCFErH6YdrmeGNA Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 8428ee98cbdc457192d9889bf10d1036 Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServerRescueTestJSON-1760218422 Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8428ee98cbdc457192d9889bf10d1036"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8428ee98cbdc457192d9889bf10d1036"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8428ee98cbdc457192d9889bf10d1036"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8428ee98cbdc457192d9889bf10d1036"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServerRescueTestJSON-1760218422 Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 8428ee98cbdc457192d9889bf10d1036 Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServerRescueTestJSON-1760218422 Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServerRescueTestJSON-1760218422-project Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: fdbd9a2294414c0e932ef46d11f8e4b6 Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServerRescueTestJSON-1760218422-project Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 0496cfe1-2be3-438a-965a-c2994623a96c could not be found. Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '0496cfe1-2be3-438a-965a-c2994623a96c'} Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0496cfe1-2be3-438a-965a-c2994623a96c could not be found. Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0496cfe1-2be3-438a-965a-c2994623a96c could not be found. Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:41.202979 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:41.207723 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:41.207723 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:41.207723 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:41.207723 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:09:41.207723 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:09:41.207723 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0496cfe1-2be3-438a-965a-c2994623a96c could not be found. Sep 24 21:09:41.207723 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:41.209486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b71660ed-8f6f-4bc7-84ec-b790e3980cbc tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Returning 404 to user: Instance 0496cfe1-2be3-438a-965a-c2994623a96c could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:09:41.217430 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b71660ed-8f6f-4bc7-84ec-b790e3980cbc tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c" status: 404 len: 111 microversion: 2.1 time: 0.077327 Sep 24 21:09:41.219782 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2478/4960] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:41 2022] GET /compute/v2.1/servers/0496cfe1-2be3-438a-965a-c2994623a96c => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:09:41.232050 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6542f231-1783-44d4-bdf9-2b27515aad01 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:41.232983 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6542f231-1783-44d4-bdf9-2b27515aad01 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 89fb92e7-ef4c-4796-9797-2ed6faf2048c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:41.235853 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:09:41.253580 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6542f231-1783-44d4-bdf9-2b27515aad01 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:41.256114 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6542f231-1783-44d4-bdf9-2b27515aad01 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:41.257887 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6542f231-1783-44d4-bdf9-2b27515aad01 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:41.260905 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6542f231-1783-44d4-bdf9-2b27515aad01 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:41.262948 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6542f231-1783-44d4-bdf9-2b27515aad01 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:41.264078 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6542f231-1783-44d4-bdf9-2b27515aad01 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:41.330123 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6542f231-1783-44d4-bdf9-2b27515aad01 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 89fb92e7-ef4c-4796-9797-2ed6faf2048c] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:09:41.340084 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3ffec5e5-3134-45ed-9b53-2126fc1654fd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:41.353737 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3ffec5e5-3134-45ed-9b53-2126fc1654fd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1512 microversion: 2.1 time: 0.475256 Sep 24 21:09:41.355529 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2483/4961] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:40 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1512 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:41.494410 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6542f231-1783-44d4-bdf9-2b27515aad01 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "DELETE /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c" status: 204 len: 0 microversion: 2.1 time: 0.269451 Sep 24 21:09:41.497308 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2479/4962] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:09:41 2022] DELETE /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 24 21:09:41.506990 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-242ac32d-d61f-4128-92d9-c40805e6e7a1 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:41.507628 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-242ac32d-d61f-4128-92d9-c40805e6e7a1 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 89fb92e7-ef4c-4796-9797-2ed6faf2048c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:41.524939 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-242ac32d-d61f-4128-92d9-c40805e6e7a1 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:41.527503 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-242ac32d-d61f-4128-92d9-c40805e6e7a1 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:41.530536 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-242ac32d-d61f-4128-92d9-c40805e6e7a1 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:41.531856 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-242ac32d-d61f-4128-92d9-c40805e6e7a1 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:41.537553 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-242ac32d-d61f-4128-92d9-c40805e6e7a1 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:41.538535 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-242ac32d-d61f-4128-92d9-c40805e6e7a1 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:42.383686 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a360d1b1-a854-4781-80b6-72ac65f23f70 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:42.386868 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a360d1b1-a854-4781-80b6-72ac65f23f70 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:42.400750 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a360d1b1-a854-4781-80b6-72ac65f23f70 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:42.403515 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a360d1b1-a854-4781-80b6-72ac65f23f70 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:42.404844 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a360d1b1-a854-4781-80b6-72ac65f23f70 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:42.407212 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a360d1b1-a854-4781-80b6-72ac65f23f70 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:42.422385 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a360d1b1-a854-4781-80b6-72ac65f23f70 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:42.424417 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a360d1b1-a854-4781-80b6-72ac65f23f70 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:42.796321 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-242ac32d-d61f-4128-92d9-c40805e6e7a1 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:42.806567 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-242ac32d-d61f-4128-92d9-c40805e6e7a1 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c" status: 200 len: 1491 microversion: 2.1 time: 1.304850 Sep 24 21:09:42.823413 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2484/4963] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:41 2022] GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c => generated 1491 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:42.992842 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a360d1b1-a854-4781-80b6-72ac65f23f70 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:43.005848 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a360d1b1-a854-4781-80b6-72ac65f23f70 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1512 microversion: 2.1 time: 0.626995 Sep 24 21:09:43.007459 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2480/4964] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:42 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1512 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:43.840013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6537cc2c-e5ed-4090-bc00-831e7697adeb tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:43.840726 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6537cc2c-e5ed-4090-bc00-831e7697adeb tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 89fb92e7-ef4c-4796-9797-2ed6faf2048c] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:43.864054 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6537cc2c-e5ed-4090-bc00-831e7697adeb tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:43.864508 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6537cc2c-e5ed-4090-bc00-831e7697adeb tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:43.864962 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6537cc2c-e5ed-4090-bc00-831e7697adeb tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:43.866210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6537cc2c-e5ed-4090-bc00-831e7697adeb tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:43.866723 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6537cc2c-e5ed-4090-bc00-831e7697adeb tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:43.867160 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6537cc2c-e5ed-4090-bc00-831e7697adeb tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:44.029488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-019058c9-9ee6-45af-ab5b-f1651e7bee2f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:44.030118 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-019058c9-9ee6-45af-ab5b-f1651e7bee2f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:44.043927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-019058c9-9ee6-45af-ab5b-f1651e7bee2f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:44.044675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-019058c9-9ee6-45af-ab5b-f1651e7bee2f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:44.045312 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-019058c9-9ee6-45af-ab5b-f1651e7bee2f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:44.051513 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-019058c9-9ee6-45af-ab5b-f1651e7bee2f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:44.052419 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-019058c9-9ee6-45af-ab5b-f1651e7bee2f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:44.053035 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-019058c9-9ee6-45af-ab5b-f1651e7bee2f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:44.973600 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-019058c9-9ee6-45af-ab5b-f1651e7bee2f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:44.985327 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-019058c9-9ee6-45af-ab5b-f1651e7bee2f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1512 microversion: 2.1 time: 0.960028 Sep 24 21:09:44.987301 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2481/4965] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:44 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1512 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:44.992608 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-b031f39c-419f-4926-8ce9-f3237dc43d64 req-87c6a28a-7914-439a-8546-14745e345d10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89fb92e7-ef4c-4796-9797-2ed6faf2048c", "name": "network-vif-deleted", "tag": "35d21c9b-f44f-4fcc-8461-4452c23d1fc9"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:09:45.007700 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-b031f39c-419f-4926-8ce9-f3237dc43d64 req-87c6a28a-7914-439a-8546-14745e345d10 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:45.009067 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-b031f39c-419f-4926-8ce9-f3237dc43d64 req-87c6a28a-7914-439a-8546-14745e345d10 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:45.009694 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-b031f39c-419f-4926-8ce9-f3237dc43d64 req-87c6a28a-7914-439a-8546-14745e345d10 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:45.044233 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6537cc2c-e5ed-4090-bc00-831e7697adeb tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbd9a2294414c0e932ef46d11f8e4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8428ee98cbdc457192d9889bf10d1036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:45.072138 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6537cc2c-e5ed-4090-bc00-831e7697adeb tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c" status: 200 len: 1491 microversion: 2.1 time: 1.242398 Sep 24 21:09:45.074383 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2485/4966] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:43 2022] GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c => generated 1491 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:09:45.089381 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-b031f39c-419f-4926-8ce9-f3237dc43d64 req-87c6a28a-7914-439a-8546-14745e345d10 service nova] Creating event network-vif-deleted:35d21c9b-f44f-4fcc-8461-4452c23d1fc9 for instance 89fb92e7-ef4c-4796-9797-2ed6faf2048c on nch2-master-1 Sep 24 21:09:45.100168 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-b031f39c-419f-4926-8ce9-f3237dc43d64 req-87c6a28a-7914-439a-8546-14745e345d10 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111248 Sep 24 21:09:45.106274 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2482/4967] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:09:46.016859 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3d1108d1-c29d-4170-b856-6bb382bd48d0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:46.017557 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3d1108d1-c29d-4170-b856-6bb382bd48d0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:46.030554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d1108d1-c29d-4170-b856-6bb382bd48d0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:46.031039 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d1108d1-c29d-4170-b856-6bb382bd48d0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:46.031754 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d1108d1-c29d-4170-b856-6bb382bd48d0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:46.032478 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d1108d1-c29d-4170-b856-6bb382bd48d0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:46.040744 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d1108d1-c29d-4170-b856-6bb382bd48d0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:46.043091 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d1108d1-c29d-4170-b856-6bb382bd48d0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:46.109585 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5c7fba65-aa49-43a2-819a-890ab2da5c22 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:46.110388 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5c7fba65-aa49-43a2-819a-890ab2da5c22 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] [instance: 89fb92e7-ef4c-4796-9797-2ed6faf2048c] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:46.137376 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c7fba65-aa49-43a2-819a-890ab2da5c22 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:46.137893 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c7fba65-aa49-43a2-819a-890ab2da5c22 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:46.138354 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c7fba65-aa49-43a2-819a-890ab2da5c22 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:46.151651 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c7fba65-aa49-43a2-819a-890ab2da5c22 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:46.156191 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c7fba65-aa49-43a2-819a-890ab2da5c22 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:46.159053 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c7fba65-aa49-43a2-819a-890ab2da5c22 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:46.223858 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-5c7fba65-aa49-43a2-819a-890ab2da5c22 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] HTTP exception thrown: Instance 89fb92e7-ef4c-4796-9797-2ed6faf2048c could not be found. Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5c7fba65-aa49-43a2-819a-890ab2da5c22 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Request method failure captured: Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c HTTP/1.1 Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3Gac4a3b903vN2Ger8qc987ZXqsGRBouzU8aDgD3rc1PTnWq3As5vXy7kDuXvMvTP0pdg-b6RvWm9_gLSKeqpsX6dInnjLxXzI8ROHX6pq7WxDlH4acfUN37uZZJDkNTuwqrzlgqe80A_FX4D0fUHTc0H9OVD8fCCFErH6YdrmeGNA Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 8428ee98cbdc457192d9889bf10d1036 Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServerRescueTestJSON-1760218422 Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8428ee98cbdc457192d9889bf10d1036"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8428ee98cbdc457192d9889bf10d1036"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8428ee98cbdc457192d9889bf10d1036"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8428ee98cbdc457192d9889bf10d1036"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServerRescueTestJSON-1760218422 Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 8428ee98cbdc457192d9889bf10d1036 Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServerRescueTestJSON-1760218422 Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServerRescueTestJSON-1760218422-project Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: fdbd9a2294414c0e932ef46d11f8e4b6 Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServerRescueTestJSON-1760218422-project Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 89fb92e7-ef4c-4796-9797-2ed6faf2048c could not be found. Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '89fb92e7-ef4c-4796-9797-2ed6faf2048c'} Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89fb92e7-ef4c-4796-9797-2ed6faf2048c could not be found. Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89fb92e7-ef4c-4796-9797-2ed6faf2048c could not be found. Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:46.227259 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:46.233328 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:46.233328 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:46.233328 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:46.233328 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:09:46.233328 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:09:46.233328 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89fb92e7-ef4c-4796-9797-2ed6faf2048c could not be found. Sep 24 21:09:46.233328 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:46.235701 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5c7fba65-aa49-43a2-819a-890ab2da5c22 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] Returning 404 to user: Instance 89fb92e7-ef4c-4796-9797-2ed6faf2048c could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:09:46.256087 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5c7fba65-aa49-43a2-819a-890ab2da5c22 tempest-ServerRescueTestJSON-1760218422 tempest-ServerRescueTestJSON-1760218422-project] 10.222.0.52 "GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c" status: 404 len: 111 microversion: 2.1 time: 0.159898 Sep 24 21:09:46.257458 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2483/4968] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:46 2022] GET /compute/v2.1/servers/89fb92e7-ef4c-4796-9797-2ed6faf2048c => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 21:09:46.541026 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-407f8d78-c0cf-4155-b492-97628c3f4d36 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:46.542556 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-407f8d78-c0cf-4155-b492-97628c3f4d36 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:46.557543 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-407f8d78-c0cf-4155-b492-97628c3f4d36 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:46.560697 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-407f8d78-c0cf-4155-b492-97628c3f4d36 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:46.562044 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-407f8d78-c0cf-4155-b492-97628c3f4d36 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:46.564208 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-407f8d78-c0cf-4155-b492-97628c3f4d36 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:46.564692 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-407f8d78-c0cf-4155-b492-97628c3f4d36 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:46.565158 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-407f8d78-c0cf-4155-b492-97628c3f4d36 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:46.619943 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3d1108d1-c29d-4170-b856-6bb382bd48d0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:46.642156 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-407f8d78-c0cf-4155-b492-97628c3f4d36 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f/ips" status: 200 len: 151 microversion: 2.20 time: 0.110013 Sep 24 21:09:46.661245 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3d1108d1-c29d-4170-b856-6bb382bd48d0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1512 microversion: 2.1 time: 0.651761 Sep 24 21:09:46.661729 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2486/4969] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:46 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1512 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:09:46.662106 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2484/4970] 10.222.0.52 () {60 vars in 1289 bytes} [Sat Sep 24 21:09:46 2022] GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f/ips => generated 151 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 21:09:47.690261 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-465179da-e83a-4e6d-a976-54e8a2a1907a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:47.691086 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-465179da-e83a-4e6d-a976-54e8a2a1907a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:47.697945 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-465179da-e83a-4e6d-a976-54e8a2a1907a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:47.698648 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-465179da-e83a-4e6d-a976-54e8a2a1907a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:47.699087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-465179da-e83a-4e6d-a976-54e8a2a1907a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:47.699801 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-465179da-e83a-4e6d-a976-54e8a2a1907a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:47.700252 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-465179da-e83a-4e6d-a976-54e8a2a1907a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:47.700832 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-465179da-e83a-4e6d-a976-54e8a2a1907a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:48.297287 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7a140031-c8aa-4e25-b018-05ef325e9151 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:48.298426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7a140031-c8aa-4e25-b018-05ef325e9151 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:48.308317 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a140031-c8aa-4e25-b018-05ef325e9151 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:48.309086 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a140031-c8aa-4e25-b018-05ef325e9151 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:48.309696 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a140031-c8aa-4e25-b018-05ef325e9151 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:48.310614 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a140031-c8aa-4e25-b018-05ef325e9151 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:48.311369 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a140031-c8aa-4e25-b018-05ef325e9151 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:48.311985 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a140031-c8aa-4e25-b018-05ef325e9151 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:48.349075 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7a140031-c8aa-4e25-b018-05ef325e9151 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:09:48.436130 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-465179da-e83a-4e6d-a976-54e8a2a1907a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:48.457028 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-465179da-e83a-4e6d-a976-54e8a2a1907a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1512 microversion: 2.1 time: 0.769836 Sep 24 21:09:48.458412 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7a140031-c8aa-4e25-b018-05ef325e9151 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f" status: 204 len: 0 microversion: 2.20 time: 0.165007 Sep 24 21:09:48.458589 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2487/4971] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:47 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1512 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:48.460117 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2485/4972] 10.222.0.52 () {60 vars in 1280 bytes} [Sat Sep 24 21:09:48 2022] DELETE /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 24 21:09:48.478765 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-eecf4d77-2322-4ea7-9a63-d46e563d98a1 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:48.479605 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-eecf4d77-2322-4ea7-9a63-d46e563d98a1 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:48.487810 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eecf4d77-2322-4ea7-9a63-d46e563d98a1 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:48.488404 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eecf4d77-2322-4ea7-9a63-d46e563d98a1 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:48.489068 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eecf4d77-2322-4ea7-9a63-d46e563d98a1 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:48.490167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eecf4d77-2322-4ea7-9a63-d46e563d98a1 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:48.491001 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eecf4d77-2322-4ea7-9a63-d46e563d98a1 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:48.491646 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eecf4d77-2322-4ea7-9a63-d46e563d98a1 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:48.846394 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-eecf4d77-2322-4ea7-9a63-d46e563d98a1 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:48.862165 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-eecf4d77-2322-4ea7-9a63-d46e563d98a1 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:48.864570 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-eecf4d77-2322-4ea7-9a63-d46e563d98a1 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:48.865844 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-eecf4d77-2322-4ea7-9a63-d46e563d98a1 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f" status: 200 len: 1723 microversion: 2.20 time: 0.400440 Sep 24 21:09:48.868204 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2488/4973] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:09:48 2022] GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f => generated 1723 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:09:49.483884 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cb88c8e0-0495-4a3d-82c2-ed6a0d759024 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:49.485192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cb88c8e0-0495-4a3d-82c2-ed6a0d759024 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:49.506218 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb88c8e0-0495-4a3d-82c2-ed6a0d759024 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:49.506760 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb88c8e0-0495-4a3d-82c2-ed6a0d759024 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:49.507200 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb88c8e0-0495-4a3d-82c2-ed6a0d759024 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:49.507905 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb88c8e0-0495-4a3d-82c2-ed6a0d759024 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:49.508366 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb88c8e0-0495-4a3d-82c2-ed6a0d759024 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:49.508788 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb88c8e0-0495-4a3d-82c2-ed6a0d759024 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:49.908739 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-992d60d7-3cd6-4748-9866-bac36e1caec4 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:49.910205 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-992d60d7-3cd6-4748-9866-bac36e1caec4 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:49.920531 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-992d60d7-3cd6-4748-9866-bac36e1caec4 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:49.921287 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-992d60d7-3cd6-4748-9866-bac36e1caec4 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:49.921915 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-992d60d7-3cd6-4748-9866-bac36e1caec4 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:49.923666 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-992d60d7-3cd6-4748-9866-bac36e1caec4 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:49.924343 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-992d60d7-3cd6-4748-9866-bac36e1caec4 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:49.928589 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-992d60d7-3cd6-4748-9866-bac36e1caec4 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:50.739103 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cb88c8e0-0495-4a3d-82c2-ed6a0d759024 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:50.753523 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cb88c8e0-0495-4a3d-82c2-ed6a0d759024 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1512 microversion: 2.1 time: 1.274201 Sep 24 21:09:50.754348 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-992d60d7-3cd6-4748-9866-bac36e1caec4 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:50.755855 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2486/4974] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:49 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1512 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:50.783138 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-992d60d7-3cd6-4748-9866-bac36e1caec4 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:50.803702 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-992d60d7-3cd6-4748-9866-bac36e1caec4 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:50.805569 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-992d60d7-3cd6-4748-9866-bac36e1caec4 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f" status: 200 len: 1723 microversion: 2.20 time: 0.905841 Sep 24 21:09:50.807879 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2489/4975] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:09:49 2022] GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f => generated 1723 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:09:51.781118 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bc666140-fd31-4223-b39a-ca0f7225c024 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:51.782280 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-bc666140-fd31-4223-b39a-ca0f7225c024 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:51.794851 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bc666140-fd31-4223-b39a-ca0f7225c024 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:51.796832 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bc666140-fd31-4223-b39a-ca0f7225c024 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:51.799980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bc666140-fd31-4223-b39a-ca0f7225c024 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:51.801887 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bc666140-fd31-4223-b39a-ca0f7225c024 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:51.805300 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bc666140-fd31-4223-b39a-ca0f7225c024 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:51.808622 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bc666140-fd31-4223-b39a-ca0f7225c024 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:51.840754 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-93a9d5be-e07d-4ae4-82a1-272c4d48750b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:51.841386 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-93a9d5be-e07d-4ae4-82a1-272c4d48750b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:51.862901 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93a9d5be-e07d-4ae4-82a1-272c4d48750b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:51.868286 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93a9d5be-e07d-4ae4-82a1-272c4d48750b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:51.868802 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93a9d5be-e07d-4ae4-82a1-272c4d48750b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:51.870157 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93a9d5be-e07d-4ae4-82a1-272c4d48750b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:51.870858 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93a9d5be-e07d-4ae4-82a1-272c4d48750b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:51.871306 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93a9d5be-e07d-4ae4-82a1-272c4d48750b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:52.471952 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-bc666140-fd31-4223-b39a-ca0f7225c024 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:52.484886 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bc666140-fd31-4223-b39a-ca0f7225c024 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1512 microversion: 2.1 time: 0.707977 Sep 24 21:09:52.486103 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2487/4976] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:51 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1512 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:52.883854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-93a9d5be-e07d-4ae4-82a1-272c4d48750b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:52.897714 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-93a9d5be-e07d-4ae4-82a1-272c4d48750b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:52.901681 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-93a9d5be-e07d-4ae4-82a1-272c4d48750b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:52.903961 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-93a9d5be-e07d-4ae4-82a1-272c4d48750b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f" status: 200 len: 1723 microversion: 2.20 time: 1.071464 Sep 24 21:09:52.905208 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2490/4977] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:09:51 2022] GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f => generated 1723 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:09:53.514340 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0d84bdf2-bae3-4991-9080-d7e551864124 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:53.515555 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0d84bdf2-bae3-4991-9080-d7e551864124 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:53.531899 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d84bdf2-bae3-4991-9080-d7e551864124 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:53.532988 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d84bdf2-bae3-4991-9080-d7e551864124 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:53.532988 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d84bdf2-bae3-4991-9080-d7e551864124 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:53.533601 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d84bdf2-bae3-4991-9080-d7e551864124 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:53.534090 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d84bdf2-bae3-4991-9080-d7e551864124 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:53.534667 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d84bdf2-bae3-4991-9080-d7e551864124 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:53.539618 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:09:53.815503 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-a7a1f356-7464-4ce4-b287-6d32e4f70d6b req-bef9357a-f7b3-4ad1-8979-a6dd8da0c013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f", "name": "network-vif-deleted", "tag": "757d7845-8f16-4ea6-9591-83a6aeade3b6"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:09:53.831956 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-a7a1f356-7464-4ce4-b287-6d32e4f70d6b req-bef9357a-f7b3-4ad1-8979-a6dd8da0c013 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:53.833469 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-a7a1f356-7464-4ce4-b287-6d32e4f70d6b req-bef9357a-f7b3-4ad1-8979-a6dd8da0c013 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:53.834261 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-a7a1f356-7464-4ce4-b287-6d32e4f70d6b req-bef9357a-f7b3-4ad1-8979-a6dd8da0c013 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:53.863912 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-a7a1f356-7464-4ce4-b287-6d32e4f70d6b req-bef9357a-f7b3-4ad1-8979-a6dd8da0c013 service nova] Creating event network-vif-deleted:757d7845-8f16-4ea6-9591-83a6aeade3b6 for instance 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f on nch1-master-1 Sep 24 21:09:53.873570 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-a7a1f356-7464-4ce4-b287-6d32e4f70d6b req-bef9357a-f7b3-4ad1-8979-a6dd8da0c013 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062462 Sep 24 21:09:53.874662 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2491/4978] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:09:53.934373 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-98fa4f3f-1d47-49ad-82ad-db32e6f53a18 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:53.936291 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-98fa4f3f-1d47-49ad-82ad-db32e6f53a18 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:53.953844 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98fa4f3f-1d47-49ad-82ad-db32e6f53a18 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:53.957401 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98fa4f3f-1d47-49ad-82ad-db32e6f53a18 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:53.958585 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98fa4f3f-1d47-49ad-82ad-db32e6f53a18 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:53.960632 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98fa4f3f-1d47-49ad-82ad-db32e6f53a18 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:53.962137 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98fa4f3f-1d47-49ad-82ad-db32e6f53a18 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:53.964128 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98fa4f3f-1d47-49ad-82ad-db32e6f53a18 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:53.981850 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:09:54.038595 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98fa4f3f-1d47-49ad-82ad-db32e6f53a18 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:54.039629 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98fa4f3f-1d47-49ad-82ad-db32e6f53a18 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:54.040301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98fa4f3f-1d47-49ad-82ad-db32e6f53a18 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:54.044985 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-98fa4f3f-1d47-49ad-82ad-db32e6f53a18 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lazy-loading 'fault' on Instance uuid 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:09:54.267155 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-98fa4f3f-1d47-49ad-82ad-db32e6f53a18 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:54.287640 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-98fa4f3f-1d47-49ad-82ad-db32e6f53a18 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:54.292050 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-98fa4f3f-1d47-49ad-82ad-db32e6f53a18 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9eca15a31e064f4199bfc4b04de7c5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e5867b34544cadbb354439808248aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:54.295899 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-98fa4f3f-1d47-49ad-82ad-db32e6f53a18 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f" status: 200 len: 1372 microversion: 2.20 time: 0.368536 Sep 24 21:09:54.300704 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2492/4979] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:09:53 2022] GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f => generated 1372 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:09:54.342282 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0d84bdf2-bae3-4991-9080-d7e551864124 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:54.364192 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0d84bdf2-bae3-4991-9080-d7e551864124 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1512 microversion: 2.1 time: 0.857222 Sep 24 21:09:54.377681 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2488/4980] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:53 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1512 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:55.322820 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-98a3390a-e2b0-4e34-bdee-5ee5d54d3069 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:55.323470 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-98a3390a-e2b0-4e34-bdee-5ee5d54d3069 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:55.334941 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98a3390a-e2b0-4e34-bdee-5ee5d54d3069 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:55.335451 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98a3390a-e2b0-4e34-bdee-5ee5d54d3069 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:55.336170 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98a3390a-e2b0-4e34-bdee-5ee5d54d3069 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:55.337154 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98a3390a-e2b0-4e34-bdee-5ee5d54d3069 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:55.338480 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98a3390a-e2b0-4e34-bdee-5ee5d54d3069 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:55.338985 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-98a3390a-e2b0-4e34-bdee-5ee5d54d3069 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:55.370169 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-98a3390a-e2b0-4e34-bdee-5ee5d54d3069 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] HTTP exception thrown: Instance 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f could not be found. Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-98a3390a-e2b0-4e34-bdee-5ee5d54d3069 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Request method failure captured: Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f HTTP/1.1 Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3FsjrdoTLdOxdYmSkauE7lKrc3DklKixyOWEkY-acuxghYf1MEyq1FlbMnye7QPphQ81HUjsPLkmACfRJ2SJWJ6vGYAvmnFmt2mi-WvCPzzKogs5-wVH-W1AQ1F6LII5Yt5aBY60WfX68LX1xWBQcUP9NLsqBGXFNDpojv6-BRdYsU Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: X-Openstack-Nova-Api-Version: 2.20 Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: d0e5867b34544cadbb354439808248aa Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-809062567 Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d0e5867b34544cadbb354439808248aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d0e5867b34544cadbb354439808248aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d0e5867b34544cadbb354439808248aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d0e5867b34544cadbb354439808248aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-AttachVolumeShelveTestJSON-809062567 Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: d0e5867b34544cadbb354439808248aa Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-809062567 Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-AttachVolumeShelveTestJSON-809062567-project Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 9eca15a31e064f4199bfc4b04de7c5b2 Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-AttachVolumeShelveTestJSON-809062567-project Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f could not be found. Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f'} Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f could not be found. Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f could not be found. Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:55.376449 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:55.380348 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:55.380348 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:55.380348 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:55.380348 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:55.380348 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:09:55.380348 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:09:55.380348 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f could not be found. Sep 24 21:09:55.380348 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:55.380348 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-98a3390a-e2b0-4e34-bdee-5ee5d54d3069 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Returning 404 to user: Instance 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:09:55.380348 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-98a3390a-e2b0-4e34-bdee-5ee5d54d3069 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f" status: 404 len: 111 microversion: 2.20 time: 0.059447 Sep 24 21:09:55.383632 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2493/4981] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:09:55 2022] GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:09:55.401232 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f61ed8d4-27f9-4c28-a1c5-794a2404e724 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '.version_select at 0x7f4b0756fa60>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:55.423089 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6e67d98c-1ab4-41b1-bacc-f71346d06152 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:55.427170 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6e67d98c-1ab4-41b1-bacc-f71346d06152 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:55.440364 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6e67d98c-1ab4-41b1-bacc-f71346d06152 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:55.443161 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6e67d98c-1ab4-41b1-bacc-f71346d06152 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:55.444028 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6e67d98c-1ab4-41b1-bacc-f71346d06152 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:55.445059 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6e67d98c-1ab4-41b1-bacc-f71346d06152 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:55.446200 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6e67d98c-1ab4-41b1-bacc-f71346d06152 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:55.447179 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6e67d98c-1ab4-41b1-bacc-f71346d06152 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:55.458337 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f61ed8d4-27f9-4c28-a1c5-794a2404e724 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1792455767" status: 204 len: 0 microversion: 2.20 time: 0.069630 Sep 24 21:09:55.465586 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2489/4982] 10.222.0.52 () {60 vars in 1262 bytes} [Sat Sep 24 21:09:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1792455767 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 24 21:09:56.006070 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6e67d98c-1ab4-41b1-bacc-f71346d06152 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:56.016427 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6e67d98c-1ab4-41b1-bacc-f71346d06152 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1512 microversion: 2.1 time: 0.607717 Sep 24 21:09:56.017026 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2494/4983] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:55 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1512 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:57.052761 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-205fd80d-c973-4d2e-83e4-2e2d4ce1c0d2 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:57.054396 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-205fd80d-c973-4d2e-83e4-2e2d4ce1c0d2 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:57.066583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-205fd80d-c973-4d2e-83e4-2e2d4ce1c0d2 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:57.067637 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-205fd80d-c973-4d2e-83e4-2e2d4ce1c0d2 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:57.068918 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-205fd80d-c973-4d2e-83e4-2e2d4ce1c0d2 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:57.070343 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-205fd80d-c973-4d2e-83e4-2e2d4ce1c0d2 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:57.071053 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-205fd80d-c973-4d2e-83e4-2e2d4ce1c0d2 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:57.071832 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-205fd80d-c973-4d2e-83e4-2e2d4ce1c0d2 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:57.234060 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2fa2dc94-9cf0-462f-86ed-a9b5e072937c tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:57.234717 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2fa2dc94-9cf0-462f-86ed-a9b5e072937c tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:57.245332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2fa2dc94-9cf0-462f-86ed-a9b5e072937c tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:57.245911 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2fa2dc94-9cf0-462f-86ed-a9b5e072937c tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:57.246423 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2fa2dc94-9cf0-462f-86ed-a9b5e072937c tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:57.247979 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2fa2dc94-9cf0-462f-86ed-a9b5e072937c tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:57.248765 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2fa2dc94-9cf0-462f-86ed-a9b5e072937c tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:57.249495 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2fa2dc94-9cf0-462f-86ed-a9b5e072937c tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:57.269660 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-2fa2dc94-9cf0-462f-86ed-a9b5e072937c tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] HTTP exception thrown: Instance 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f could not be found. Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2fa2dc94-9cf0-462f-86ed-a9b5e072937c tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Request method failure captured: Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f HTTP/1.1 Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3FsjrdoTLdOxdYmSkauE7lKrc3DklKixyOWEkY-acuxghYf1MEyq1FlbMnye7QPphQ81HUjsPLkmACfRJ2SJWJ6vGYAvmnFmt2mi-WvCPzzKogs5-wVH-W1AQ1F6LII5Yt5aBY60WfX68LX1xWBQcUP9NLsqBGXFNDpojv6-BRdYsU Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: X-Openstack-Nova-Api-Version: 2.20 Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: d0e5867b34544cadbb354439808248aa Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-809062567 Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d0e5867b34544cadbb354439808248aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d0e5867b34544cadbb354439808248aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d0e5867b34544cadbb354439808248aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d0e5867b34544cadbb354439808248aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-AttachVolumeShelveTestJSON-809062567 Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: d0e5867b34544cadbb354439808248aa Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-809062567 Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-AttachVolumeShelveTestJSON-809062567-project Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 9eca15a31e064f4199bfc4b04de7c5b2 Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-AttachVolumeShelveTestJSON-809062567-project Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f could not be found. Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f'} Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f could not be found. Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:09:57.271292 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:09:57.276701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f could not be found. Sep 24 21:09:57.276701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:57.276701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:57.276701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:57.276701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:57.276701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:57.276701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:57.276701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:09:57.276701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:09:57.276701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f could not be found. Sep 24 21:09:57.276701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:57.276701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2fa2dc94-9cf0-462f-86ed-a9b5e072937c tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Returning 404 to user: Instance 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:09:57.276701 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2fa2dc94-9cf0-462f-86ed-a9b5e072937c tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f" status: 404 len: 111 microversion: 2.20 time: 0.042742 Sep 24 21:09:57.276701 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2495/4984] 10.222.0.52 () {60 vars in 1280 bytes} [Sat Sep 24 21:09:57 2022] DELETE /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:09:57.282794 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d66ac087-38a7-4368-addc-6f6757a57088 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:57.283418 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d66ac087-38a7-4368-addc-6f6757a57088 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:57.290171 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d66ac087-38a7-4368-addc-6f6757a57088 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:57.291346 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d66ac087-38a7-4368-addc-6f6757a57088 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:57.291799 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d66ac087-38a7-4368-addc-6f6757a57088 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:57.292518 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d66ac087-38a7-4368-addc-6f6757a57088 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:57.292982 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d66ac087-38a7-4368-addc-6f6757a57088 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:57.293617 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d66ac087-38a7-4368-addc-6f6757a57088 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:57.310329 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-d66ac087-38a7-4368-addc-6f6757a57088 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] HTTP exception thrown: Instance 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f could not be found. Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d66ac087-38a7-4368-addc-6f6757a57088 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Request method failure captured: Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f HTTP/1.1 Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3FsjrdoTLdOxdYmSkauE7lKrc3DklKixyOWEkY-acuxghYf1MEyq1FlbMnye7QPphQ81HUjsPLkmACfRJ2SJWJ6vGYAvmnFmt2mi-WvCPzzKogs5-wVH-W1AQ1F6LII5Yt5aBY60WfX68LX1xWBQcUP9NLsqBGXFNDpojv6-BRdYsU Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: X-Openstack-Nova-Api-Version: 2.20 Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: d0e5867b34544cadbb354439808248aa Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-809062567 Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d0e5867b34544cadbb354439808248aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d0e5867b34544cadbb354439808248aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d0e5867b34544cadbb354439808248aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d0e5867b34544cadbb354439808248aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-AttachVolumeShelveTestJSON-809062567 Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: d0e5867b34544cadbb354439808248aa Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-809062567 Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-AttachVolumeShelveTestJSON-809062567-project Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 9eca15a31e064f4199bfc4b04de7c5b2 Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-AttachVolumeShelveTestJSON-809062567-project Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f could not be found. Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f'} Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f could not be found. Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f could not be found. Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:57.312323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:57.316758 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:57.316758 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:57.316758 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:57.316758 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:57.316758 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:09:57.316758 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:09:57.316758 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f could not be found. Sep 24 21:09:57.316758 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:57.318070 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d66ac087-38a7-4368-addc-6f6757a57088 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Returning 404 to user: Instance 4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:09:57.319456 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d66ac087-38a7-4368-addc-6f6757a57088 tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f" status: 404 len: 111 microversion: 2.20 time: 0.040753 Sep 24 21:09:57.320500 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2496/4985] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:09:57 2022] GET /compute/v2.1/servers/4aa90cf8-fc5a-4307-a81d-b3d1a4c5306f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:09:57.649638 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7402dbc0-613e-4860-9306-d4818925c35a tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:57.650715 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7402dbc0-613e-4860-9306-d4818925c35a tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 0896ae3f-f6f6-49dd-87df-c73f911c78be] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:57.657734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7402dbc0-613e-4860-9306-d4818925c35a tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:57.658620 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-205fd80d-c973-4d2e-83e4-2e2d4ce1c0d2 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:57.658929 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7402dbc0-613e-4860-9306-d4818925c35a tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:57.659579 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7402dbc0-613e-4860-9306-d4818925c35a tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:57.660522 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7402dbc0-613e-4860-9306-d4818925c35a tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:57.661208 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7402dbc0-613e-4860-9306-d4818925c35a tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:57.661634 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7402dbc0-613e-4860-9306-d4818925c35a tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:57.675608 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-205fd80d-c973-4d2e-83e4-2e2d4ce1c0d2 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1512 microversion: 2.1 time: 0.637493 Sep 24 21:09:57.678841 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2490/4986] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:57 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1512 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:09:57.711895 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-7402dbc0-613e-4860-9306-d4818925c35a tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] HTTP exception thrown: Instance 0896ae3f-f6f6-49dd-87df-c73f911c78be could not be found. Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7402dbc0-613e-4860-9306-d4818925c35a tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Request method failure captured: Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be HTTP/1.1 Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3FsjrdoTLdOxdYmSkauE7lKrc3DklKixyOWEkY-acuxghYf1MEyq1FlbMnye7QPphQ81HUjsPLkmACfRJ2SJWJ6vGYAvmnFmt2mi-WvCPzzKogs5-wVH-W1AQ1F6LII5Yt5aBY60WfX68LX1xWBQcUP9NLsqBGXFNDpojv6-BRdYsU Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: X-Openstack-Nova-Api-Version: 2.20 Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: d0e5867b34544cadbb354439808248aa Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-809062567 Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d0e5867b34544cadbb354439808248aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d0e5867b34544cadbb354439808248aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d0e5867b34544cadbb354439808248aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d0e5867b34544cadbb354439808248aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-AttachVolumeShelveTestJSON-809062567 Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: d0e5867b34544cadbb354439808248aa Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-809062567 Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-AttachVolumeShelveTestJSON-809062567-project Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 9eca15a31e064f4199bfc4b04de7c5b2 Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-AttachVolumeShelveTestJSON-809062567-project Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 0896ae3f-f6f6-49dd-87df-c73f911c78be could not be found. Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '0896ae3f-f6f6-49dd-87df-c73f911c78be'} Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0896ae3f-f6f6-49dd-87df-c73f911c78be could not be found. Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:09:57.714671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:09:57.720896 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0896ae3f-f6f6-49dd-87df-c73f911c78be could not be found. Sep 24 21:09:57.720896 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:57.720896 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:57.720896 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:57.720896 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:57.720896 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:57.720896 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:57.720896 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:09:57.720896 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:09:57.720896 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0896ae3f-f6f6-49dd-87df-c73f911c78be could not be found. Sep 24 21:09:57.720896 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:09:57.720896 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7402dbc0-613e-4860-9306-d4818925c35a tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Returning 404 to user: Instance 0896ae3f-f6f6-49dd-87df-c73f911c78be could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:09:57.720896 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7402dbc0-613e-4860-9306-d4818925c35a tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be" status: 404 len: 111 microversion: 2.20 time: 0.070849 Sep 24 21:09:57.720896 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2497/4987] 10.222.0.52 () {60 vars in 1280 bytes} [Sat Sep 24 21:09:57 2022] DELETE /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:09:57.732468 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1f0a2ff2-595d-4c61-b6f5-bd8b6aae568b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:57.737164 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1f0a2ff2-595d-4c61-b6f5-bd8b6aae568b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] [instance: 0896ae3f-f6f6-49dd-87df-c73f911c78be] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:57.750078 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f0a2ff2-595d-4c61-b6f5-bd8b6aae568b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:57.751902 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f0a2ff2-595d-4c61-b6f5-bd8b6aae568b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:57.753989 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f0a2ff2-595d-4c61-b6f5-bd8b6aae568b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:57.755798 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f0a2ff2-595d-4c61-b6f5-bd8b6aae568b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:57.757489 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f0a2ff2-595d-4c61-b6f5-bd8b6aae568b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:57.759548 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f0a2ff2-595d-4c61-b6f5-bd8b6aae568b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:57.793644 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-1f0a2ff2-595d-4c61-b6f5-bd8b6aae568b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] HTTP exception thrown: Instance 0896ae3f-f6f6-49dd-87df-c73f911c78be could not be found. Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1f0a2ff2-595d-4c61-b6f5-bd8b6aae568b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Request method failure captured: Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be HTTP/1.1 Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3FsjrdoTLdOxdYmSkauE7lKrc3DklKixyOWEkY-acuxghYf1MEyq1FlbMnye7QPphQ81HUjsPLkmACfRJ2SJWJ6vGYAvmnFmt2mi-WvCPzzKogs5-wVH-W1AQ1F6LII5Yt5aBY60WfX68LX1xWBQcUP9NLsqBGXFNDpojv6-BRdYsU Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: X-Openstack-Nova-Api-Version: 2.20 Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: d0e5867b34544cadbb354439808248aa Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-809062567 Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d0e5867b34544cadbb354439808248aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d0e5867b34544cadbb354439808248aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d0e5867b34544cadbb354439808248aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d0e5867b34544cadbb354439808248aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-AttachVolumeShelveTestJSON-809062567 Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: d0e5867b34544cadbb354439808248aa Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-809062567 Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-AttachVolumeShelveTestJSON-809062567-project Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 9eca15a31e064f4199bfc4b04de7c5b2 Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-AttachVolumeShelveTestJSON-809062567-project Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 0896ae3f-f6f6-49dd-87df-c73f911c78be could not be found. Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '0896ae3f-f6f6-49dd-87df-c73f911c78be'} Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0896ae3f-f6f6-49dd-87df-c73f911c78be could not be found. Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0896ae3f-f6f6-49dd-87df-c73f911c78be could not be found. Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:57.796410 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:09:57.800373 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:57.800373 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:09:57.800373 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:09:57.800373 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:09:57.800373 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:09:57.800373 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:09:57.800373 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0896ae3f-f6f6-49dd-87df-c73f911c78be could not be found. Sep 24 21:09:57.800373 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:09:57.803905 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1f0a2ff2-595d-4c61-b6f5-bd8b6aae568b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] Returning 404 to user: Instance 0896ae3f-f6f6-49dd-87df-c73f911c78be could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:09:57.805020 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1f0a2ff2-595d-4c61-b6f5-bd8b6aae568b tempest-AttachVolumeShelveTestJSON-809062567 tempest-AttachVolumeShelveTestJSON-809062567-project] 10.222.0.52 "GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be" status: 404 len: 111 microversion: 2.20 time: 0.081740 Sep 24 21:09:57.806826 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2491/4988] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:09:57 2022] GET /compute/v2.1/servers/0896ae3f-f6f6-49dd-87df-c73f911c78be => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 24 21:09:58.705841 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b72de071-1daa-45c0-91fd-71413fd79897 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:09:58.707129 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b72de071-1daa-45c0-91fd-71413fd79897 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:09:58.715188 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b72de071-1daa-45c0-91fd-71413fd79897 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:58.716157 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b72de071-1daa-45c0-91fd-71413fd79897 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:58.716841 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b72de071-1daa-45c0-91fd-71413fd79897 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:58.717776 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b72de071-1daa-45c0-91fd-71413fd79897 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:09:58.718468 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b72de071-1daa-45c0-91fd-71413fd79897 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:09:58.719189 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b72de071-1daa-45c0-91fd-71413fd79897 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:09:59.268983 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b72de071-1daa-45c0-91fd-71413fd79897 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:09:59.287250 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b72de071-1daa-45c0-91fd-71413fd79897 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1533 microversion: 2.1 time: 0.589040 Sep 24 21:09:59.287837 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2498/4989] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:09:58 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1533 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:10:00.316313 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5e7f4fcf-456f-4b89-8b4d-6e0c0ff2eee4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:00.317502 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5e7f4fcf-456f-4b89-8b4d-6e0c0ff2eee4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:00.333278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e7f4fcf-456f-4b89-8b4d-6e0c0ff2eee4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:00.335237 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e7f4fcf-456f-4b89-8b4d-6e0c0ff2eee4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:00.336211 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e7f4fcf-456f-4b89-8b4d-6e0c0ff2eee4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:00.337571 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e7f4fcf-456f-4b89-8b4d-6e0c0ff2eee4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:00.338618 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e7f4fcf-456f-4b89-8b4d-6e0c0ff2eee4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:00.344378 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e7f4fcf-456f-4b89-8b4d-6e0c0ff2eee4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:00.962264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5e7f4fcf-456f-4b89-8b4d-6e0c0ff2eee4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:10:00.974048 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5e7f4fcf-456f-4b89-8b4d-6e0c0ff2eee4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1533 microversion: 2.1 time: 0.661813 Sep 24 21:10:00.975324 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2492/4990] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:10:00 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1533 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:10:01.998449 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0e3e5f39-0881-4a07-8907-9dad8bf20f64 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:01.999952 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0e3e5f39-0881-4a07-8907-9dad8bf20f64 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:02.012609 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e3e5f39-0881-4a07-8907-9dad8bf20f64 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:02.015549 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e3e5f39-0881-4a07-8907-9dad8bf20f64 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:02.017922 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e3e5f39-0881-4a07-8907-9dad8bf20f64 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:02.018761 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e3e5f39-0881-4a07-8907-9dad8bf20f64 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:02.019236 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e3e5f39-0881-4a07-8907-9dad8bf20f64 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:02.019708 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e3e5f39-0881-4a07-8907-9dad8bf20f64 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:02.350610 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0e3e5f39-0881-4a07-8907-9dad8bf20f64 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:10:02.360853 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0e3e5f39-0881-4a07-8907-9dad8bf20f64 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1528 microversion: 2.1 time: 0.367453 Sep 24 21:10:02.385820 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2499/4991] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:10:01 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1528 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:10:03.389807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dc57116f-c643-4ec6-9564-1fcb1bab457f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:03.390374 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-dc57116f-c643-4ec6-9564-1fcb1bab457f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:03.410369 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc57116f-c643-4ec6-9564-1fcb1bab457f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:03.410906 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc57116f-c643-4ec6-9564-1fcb1bab457f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:03.419173 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc57116f-c643-4ec6-9564-1fcb1bab457f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:03.420145 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc57116f-c643-4ec6-9564-1fcb1bab457f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:03.423402 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc57116f-c643-4ec6-9564-1fcb1bab457f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:03.426566 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc57116f-c643-4ec6-9564-1fcb1bab457f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:04.392025 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-dc57116f-c643-4ec6-9564-1fcb1bab457f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:10:04.412851 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-dc57116f-c643-4ec6-9564-1fcb1bab457f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1528 microversion: 2.1 time: 1.023796 Sep 24 21:10:04.426607 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2493/4992] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:10:03 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1528 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:10:04.501178 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-a9a405da-1517-4deb-8314-0960dd01ae03 req-0837c0cc-4e9e-4a85-a74f-2494fc82ddf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3fcc34d-d09a-4475-bd96-51ac0074cb5f", "name": "network-vif-plugged", "status": "completed", "tag": "2ca29bee-7747-4b85-b335-ac8c4538a67e"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:10:04.522722 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-a9a405da-1517-4deb-8314-0960dd01ae03 req-0837c0cc-4e9e-4a85-a74f-2494fc82ddf2 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:04.526742 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-a9a405da-1517-4deb-8314-0960dd01ae03 req-0837c0cc-4e9e-4a85-a74f-2494fc82ddf2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:04.527440 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-a9a405da-1517-4deb-8314-0960dd01ae03 req-0837c0cc-4e9e-4a85-a74f-2494fc82ddf2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:04.577535 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-a9a405da-1517-4deb-8314-0960dd01ae03 req-0837c0cc-4e9e-4a85-a74f-2494fc82ddf2 service nova] Creating event network-vif-plugged:2ca29bee-7747-4b85-b335-ac8c4538a67e for instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f on nch2-master-1 Sep 24 21:10:04.611801 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-a9a405da-1517-4deb-8314-0960dd01ae03 req-0837c0cc-4e9e-4a85-a74f-2494fc82ddf2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125840 Sep 24 21:10:04.620731 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2500/4993] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:10:05.443127 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d0981a80-e91a-40e7-a81d-d690f4bbea66 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:05.444434 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d0981a80-e91a-40e7-a81d-d690f4bbea66 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:05.467962 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0981a80-e91a-40e7-a81d-d690f4bbea66 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:05.468464 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0981a80-e91a-40e7-a81d-d690f4bbea66 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:05.469842 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0981a80-e91a-40e7-a81d-d690f4bbea66 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:05.471835 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0981a80-e91a-40e7-a81d-d690f4bbea66 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:05.475579 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0981a80-e91a-40e7-a81d-d690f4bbea66 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:05.479543 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0981a80-e91a-40e7-a81d-d690f4bbea66 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:06.538102 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d0981a80-e91a-40e7-a81d-d690f4bbea66 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:10:06.574265 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d0981a80-e91a-40e7-a81d-d690f4bbea66 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1528 microversion: 2.1 time: 1.136741 Sep 24 21:10:06.578891 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2494/4994] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:10:05 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1528 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:10:07.606570 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4d0dd5ad-b19c-4071-bc3f-9f00d8283f5b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:07.607199 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4d0dd5ad-b19c-4071-bc3f-9f00d8283f5b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:07.622088 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4d0dd5ad-b19c-4071-bc3f-9f00d8283f5b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:07.622770 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4d0dd5ad-b19c-4071-bc3f-9f00d8283f5b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:07.623219 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4d0dd5ad-b19c-4071-bc3f-9f00d8283f5b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:07.623946 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4d0dd5ad-b19c-4071-bc3f-9f00d8283f5b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:07.624565 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4d0dd5ad-b19c-4071-bc3f-9f00d8283f5b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:07.624844 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4d0dd5ad-b19c-4071-bc3f-9f00d8283f5b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:09.227897 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4d0dd5ad-b19c-4071-bc3f-9f00d8283f5b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:10:09.239057 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4d0dd5ad-b19c-4071-bc3f-9f00d8283f5b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1528 microversion: 2.1 time: 1.637476 Sep 24 21:10:09.243618 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2501/4995] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:10:07 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1528 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:10:10.270435 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-265feebd-d3a0-42f6-b4db-4c86c363705b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:10.272314 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-265feebd-d3a0-42f6-b4db-4c86c363705b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:10.295037 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-265feebd-d3a0-42f6-b4db-4c86c363705b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:10.296975 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-265feebd-d3a0-42f6-b4db-4c86c363705b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:10.298657 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-265feebd-d3a0-42f6-b4db-4c86c363705b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:10.301764 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-265feebd-d3a0-42f6-b4db-4c86c363705b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:10.302953 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-265feebd-d3a0-42f6-b4db-4c86c363705b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:10.303643 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-265feebd-d3a0-42f6-b4db-4c86c363705b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:10.807368 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d406d1e6-d6c4-4b3d-af3b-89f1f8f3a76c tempest-VolumesGetTestJSON-461793596 tempest-VolumesGetTestJSON-461793596-project] Action: 'create', calling method: .version_select at 0x7f4b07525b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1346814577", "metadata": {"Type": "work"}}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:10:11.139380 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-265feebd-d3a0-42f6-b4db-4c86c363705b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:10:11.152941 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-265feebd-d3a0-42f6-b4db-4c86c363705b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1528 microversion: 2.1 time: 0.887543 Sep 24 21:10:11.157981 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2502/4996] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:10:10 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1528 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:10:11.618792 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d406d1e6-d6c4-4b3d-af3b-89f1f8f3a76c tempest-VolumesGetTestJSON-461793596 tempest-VolumesGetTestJSON-461793596-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 346 microversion: 2.1 time: 1.672634 Sep 24 21:10:11.621436 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2495/4997] 10.222.0.52 () {60 vars in 1156 bytes} [Sat Sep 24 21:10:09 2022] POST /compute/v2.1/os-volumes => generated 346 bytes in 1676 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 24 21:10:11.651639 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0b2c3c33-c188-4bb3-b311-aa9cdcdc5884 tempest-VolumesGetTestJSON-461793596 tempest-VolumesGetTestJSON-461793596-project] Calling method '.version_select at 0x7f4b074a8ca0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:11.780038 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0b2c3c33-c188-4bb3-b311-aa9cdcdc5884 tempest-VolumesGetTestJSON-461793596 tempest-VolumesGetTestJSON-461793596-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/9f39f3bf-3e61-45b5-9b22-e69f5ac93a32" status: 200 len: 346 microversion: 2.1 time: 0.138702 Sep 24 21:10:11.782488 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2503/4998] 10.222.0.52 () {58 vars in 1245 bytes} [Sat Sep 24 21:10:11 2022] GET /compute/v2.1/os-volumes/9f39f3bf-3e61-45b5-9b22-e69f5ac93a32 => generated 346 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:10:12.186977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6ef6dfac-06e9-46b9-a0cc-41591132be8f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:12.187698 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6ef6dfac-06e9-46b9-a0cc-41591132be8f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:12.207267 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:10:12.217230 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ef6dfac-06e9-46b9-a0cc-41591132be8f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:12.217979 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ef6dfac-06e9-46b9-a0cc-41591132be8f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:12.225370 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ef6dfac-06e9-46b9-a0cc-41591132be8f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:12.226456 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ef6dfac-06e9-46b9-a0cc-41591132be8f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:12.227139 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ef6dfac-06e9-46b9-a0cc-41591132be8f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:12.227791 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ef6dfac-06e9-46b9-a0cc-41591132be8f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:12.799699 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9f2a2625-6ba8-4446-abfc-8c275df39355 tempest-VolumesGetTestJSON-461793596 tempest-VolumesGetTestJSON-461793596-project] Calling method '.version_select at 0x7f4b07dee4c0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:12.951508 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9f2a2625-6ba8-4446-abfc-8c275df39355 tempest-VolumesGetTestJSON-461793596 tempest-VolumesGetTestJSON-461793596-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/9f39f3bf-3e61-45b5-9b22-e69f5ac93a32" status: 200 len: 343 microversion: 2.1 time: 0.157861 Sep 24 21:10:12.953578 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2504/4999] 10.222.0.52 () {58 vars in 1245 bytes} [Sat Sep 24 21:10:12 2022] GET /compute/v2.1/os-volumes/9f39f3bf-3e61-45b5-9b22-e69f5ac93a32 => generated 343 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:10:12.973236 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-baf93c38-3dd5-47b2-8064-58e772aa6adc tempest-VolumesGetTestJSON-461793596 tempest-VolumesGetTestJSON-461793596-project] Calling method '.version_select at 0x7f4b110245e0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:13.331013 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-baf93c38-3dd5-47b2-8064-58e772aa6adc tempest-VolumesGetTestJSON-461793596 tempest-VolumesGetTestJSON-461793596-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/9f39f3bf-3e61-45b5-9b22-e69f5ac93a32" status: 202 len: 0 microversion: 2.1 time: 0.362781 Sep 24 21:10:13.331852 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2505/5000] 10.222.0.52 () {58 vars in 1248 bytes} [Sat Sep 24 21:10:12 2022] DELETE /compute/v2.1/os-volumes/9f39f3bf-3e61-45b5-9b22-e69f5ac93a32 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 21:10:13.342260 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cfd24a97-e688-4b8b-869f-ef85a2ce52e0 tempest-VolumesGetTestJSON-461793596 tempest-VolumesGetTestJSON-461793596-project] Calling method '.version_select at 0x7f4b074f6700>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:13.426369 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-cfd24a97-e688-4b8b-869f-ef85a2ce52e0 tempest-VolumesGetTestJSON-461793596 tempest-VolumesGetTestJSON-461793596-project] HTTP exception thrown: Volume 9f39f3bf-3e61-45b5-9b22-e69f5ac93a32 could not be found. Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cfd24a97-e688-4b8b-869f-ef85a2ce52e0 tempest-VolumesGetTestJSON-461793596 tempest-VolumesGetTestJSON-461793596-project] Request method failure captured: Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/os-volumes/9f39f3bf-3e61-45b5-9b22-e69f5ac93a32 HTTP/1.1 Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3Ix9dkoKIpJyLYTmEGMZPnwS5rx9MtuU08Pwf6wePCHUYSk0N0ZxzkB0IpFuTklrTcb2gD-AOvdnXwSuOtKh3oPnNjYuq1lUNlUu6OI8UTqhVaRn-ecDEw3GC0dc3o--abKyD-lUZChlJ5xyItJlYxH17oeFMu5Gv4nWeYL_saHRH8 Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 09b303d9b041415aa4b96dbb7dfe4dae Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-VolumesGetTestJSON-461793596 Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09b303d9b041415aa4b96dbb7dfe4dae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_09b303d9b041415aa4b96dbb7dfe4dae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/09b303d9b041415aa4b96dbb7dfe4dae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09b303d9b041415aa4b96dbb7dfe4dae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-VolumesGetTestJSON-461793596 Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 09b303d9b041415aa4b96dbb7dfe4dae Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-VolumesGetTestJSON-461793596 Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-VolumesGetTestJSON-461793596-project Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: dc0a3805b2924155a370e40d79091eec Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-VolumesGetTestJSON-461793596-project Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: exception: Volume 9f39f3bf-3e61-45b5-9b22-e69f5ac93a32 could not be found. Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '9f39f3bf-3e61-45b5-9b22-e69f5ac93a32'} Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9f39f3bf-3e61-45b5-9b22-e69f5ac93a32 could not be found. (HTTP 404) (Request-ID: req-ac2752e9-9987-4d5b-92d0-97bbbddd1da4) Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 24 21:10:13.428939 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 21:10:13.433732 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 21:10:13.433732 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 24 21:10:13.433732 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 24 21:10:13.433732 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 24 21:10:13.433732 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 24 21:10:13.433732 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 21:10:13.433732 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 21:10:13.433732 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 21:10:13.433732 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 21:10:13.433732 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 21:10:13.433732 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 21:10:13.433732 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 21:10:13.433732 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 21:10:13.433732 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9f39f3bf-3e61-45b5-9b22-e69f5ac93a32 could not be found. Sep 24 21:10:13.433732 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:10:13.433732 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:10:13.433732 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:10:13.433732 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:10:13.433732 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:10:13.433732 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:10:13.433732 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:10:13.433732 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:10:13.433732 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:10:13.433732 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:10:13.433732 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:10:13.433732 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:10:13.433732 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 24 21:10:13.433732 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:10:13.433732 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9f39f3bf-3e61-45b5-9b22-e69f5ac93a32 could not be found. Sep 24 21:10:13.433732 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:10:13.433732 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:10:13.433732 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:10:13.433732 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:10:13.433732 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:10:13.433732 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:10:13.433732 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:10:13.433732 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:10:13.433732 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9f39f3bf-3e61-45b5-9b22-e69f5ac93a32 could not be found. Sep 24 21:10:13.433732 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:10:13.438600 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cfd24a97-e688-4b8b-869f-ef85a2ce52e0 tempest-VolumesGetTestJSON-461793596 tempest-VolumesGetTestJSON-461793596-project] Returning 404 to user: Volume 9f39f3bf-3e61-45b5-9b22-e69f5ac93a32 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:10:13.439688 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cfd24a97-e688-4b8b-869f-ef85a2ce52e0 tempest-VolumesGetTestJSON-461793596 tempest-VolumesGetTestJSON-461793596-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/9f39f3bf-3e61-45b5-9b22-e69f5ac93a32" status: 404 len: 109 microversion: 2.1 time: 0.101855 Sep 24 21:10:13.440434 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2506/5001] 10.222.0.52 () {58 vars in 1245 bytes} [Sat Sep 24 21:10:13 2022] GET /compute/v2.1/os-volumes/9f39f3bf-3e61-45b5-9b22-e69f5ac93a32 => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:10:13.664528 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6ef6dfac-06e9-46b9-a0cc-41591132be8f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:10:13.674238 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6ef6dfac-06e9-46b9-a0cc-41591132be8f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1528 microversion: 2.1 time: 1.492280 Sep 24 21:10:13.700080 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2496/5002] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:10:12 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1528 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:10:14.717129 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f48199ae-3a56-4922-b096-51da71db6720 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:14.717678 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f48199ae-3a56-4922-b096-51da71db6720 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:14.736425 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=42 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:10:14.738913 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f48199ae-3a56-4922-b096-51da71db6720 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:14.739785 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f48199ae-3a56-4922-b096-51da71db6720 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:14.740388 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f48199ae-3a56-4922-b096-51da71db6720 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:14.741418 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f48199ae-3a56-4922-b096-51da71db6720 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:14.742041 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f48199ae-3a56-4922-b096-51da71db6720 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:14.742661 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f48199ae-3a56-4922-b096-51da71db6720 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:15.608493 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f48199ae-3a56-4922-b096-51da71db6720 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:10:15.621987 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f48199ae-3a56-4922-b096-51da71db6720 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1528 microversion: 2.1 time: 0.911511 Sep 24 21:10:15.636092 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2507/5003] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:10:14 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1528 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:10:16.651715 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2019b746-f10b-4499-aa83-274d0268f698 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:16.652481 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2019b746-f10b-4499-aa83-274d0268f698 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:16.673055 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2019b746-f10b-4499-aa83-274d0268f698 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:16.673609 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2019b746-f10b-4499-aa83-274d0268f698 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:16.674065 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2019b746-f10b-4499-aa83-274d0268f698 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:16.685405 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2019b746-f10b-4499-aa83-274d0268f698 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:16.687629 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2019b746-f10b-4499-aa83-274d0268f698 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:16.691306 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2019b746-f10b-4499-aa83-274d0268f698 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:17.229223 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2019b746-f10b-4499-aa83-274d0268f698 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:10:17.252092 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2019b746-f10b-4499-aa83-274d0268f698 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1528 microversion: 2.1 time: 0.600049 Sep 24 21:10:17.276376 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2497/5004] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:10:16 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1528 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:10:18.284458 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-76528fd5-a73a-4c5f-8023-dd33dcda24a0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:18.285091 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-76528fd5-a73a-4c5f-8023-dd33dcda24a0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:18.331411 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76528fd5-a73a-4c5f-8023-dd33dcda24a0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:18.332775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76528fd5-a73a-4c5f-8023-dd33dcda24a0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:18.334731 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76528fd5-a73a-4c5f-8023-dd33dcda24a0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:18.335653 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76528fd5-a73a-4c5f-8023-dd33dcda24a0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:18.346345 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76528fd5-a73a-4c5f-8023-dd33dcda24a0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:18.347297 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76528fd5-a73a-4c5f-8023-dd33dcda24a0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:19.548978 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-76528fd5-a73a-4c5f-8023-dd33dcda24a0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:10:19.560613 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-76528fd5-a73a-4c5f-8023-dd33dcda24a0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1528 microversion: 2.1 time: 1.286408 Sep 24 21:10:19.566094 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2508/5005] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:10:18 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1528 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:10:20.597313 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fbe10544-a1e2-4b3d-b310-ead5139af4b0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:20.598648 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fbe10544-a1e2-4b3d-b310-ead5139af4b0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:20.630526 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fbe10544-a1e2-4b3d-b310-ead5139af4b0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:20.633245 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fbe10544-a1e2-4b3d-b310-ead5139af4b0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:20.638165 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fbe10544-a1e2-4b3d-b310-ead5139af4b0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:20.642760 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fbe10544-a1e2-4b3d-b310-ead5139af4b0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:20.646477 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fbe10544-a1e2-4b3d-b310-ead5139af4b0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:20.650206 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fbe10544-a1e2-4b3d-b310-ead5139af4b0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:21.653510 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-76528fd5-a73a-4c5f-8023-dd33dcda24a0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:21.654640 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-76528fd5-a73a-4c5f-8023-dd33dcda24a0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001391 Sep 24 21:10:21.654910 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2509/5006] 10.222.0.52 () {56 vars in 886 bytes} [Sat Sep 24 21:10:21 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 24 21:10:21.936112 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fbe10544-a1e2-4b3d-b310-ead5139af4b0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:10:21.950912 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fbe10544-a1e2-4b3d-b310-ead5139af4b0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1528 microversion: 2.1 time: 1.357732 Sep 24 21:10:21.967700 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2498/5007] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:10:20 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1528 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:10:22.982630 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cfd44b12-6152-4d91-9453-809fbe774bb7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:22.983368 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cfd44b12-6152-4d91-9453-809fbe774bb7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:23.008341 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cfd44b12-6152-4d91-9453-809fbe774bb7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:23.009262 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cfd44b12-6152-4d91-9453-809fbe774bb7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:23.009744 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cfd44b12-6152-4d91-9453-809fbe774bb7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:23.024839 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cfd44b12-6152-4d91-9453-809fbe774bb7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:23.028442 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cfd44b12-6152-4d91-9453-809fbe774bb7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:23.031468 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cfd44b12-6152-4d91-9453-809fbe774bb7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:24.075951 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cfd44b12-6152-4d91-9453-809fbe774bb7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:10:24.082654 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=64 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:10:24.088955 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cfd44b12-6152-4d91-9453-809fbe774bb7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1528 microversion: 2.1 time: 1.110840 Sep 24 21:10:24.089576 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2510/5008] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:10:22 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1528 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:10:25.120948 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a3d20f8f-2394-4487-b5e3-0e2d2b94cc6f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:25.121897 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a3d20f8f-2394-4487-b5e3-0e2d2b94cc6f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:25.157261 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3d20f8f-2394-4487-b5e3-0e2d2b94cc6f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:25.160380 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3d20f8f-2394-4487-b5e3-0e2d2b94cc6f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:25.162605 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3d20f8f-2394-4487-b5e3-0e2d2b94cc6f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:25.165482 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3d20f8f-2394-4487-b5e3-0e2d2b94cc6f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:25.166353 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3d20f8f-2394-4487-b5e3-0e2d2b94cc6f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:25.166986 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3d20f8f-2394-4487-b5e3-0e2d2b94cc6f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:25.296053 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=49 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:10:26.297308 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a3d20f8f-2394-4487-b5e3-0e2d2b94cc6f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:10:26.306016 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a3d20f8f-2394-4487-b5e3-0e2d2b94cc6f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1528 microversion: 2.1 time: 1.193320 Sep 24 21:10:26.306736 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2499/5009] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:10:25 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1528 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:10:27.332150 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f5f06a46-b4be-460e-bbde-7cee4bfe79f7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:27.332685 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f5f06a46-b4be-460e-bbde-7cee4bfe79f7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:27.358450 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5f06a46-b4be-460e-bbde-7cee4bfe79f7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:27.359103 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5f06a46-b4be-460e-bbde-7cee4bfe79f7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:27.359567 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5f06a46-b4be-460e-bbde-7cee4bfe79f7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:27.360324 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5f06a46-b4be-460e-bbde-7cee4bfe79f7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:27.360813 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5f06a46-b4be-460e-bbde-7cee4bfe79f7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:27.368232 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5f06a46-b4be-460e-bbde-7cee4bfe79f7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:27.953800 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f5f06a46-b4be-460e-bbde-7cee4bfe79f7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:10:27.963863 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f5f06a46-b4be-460e-bbde-7cee4bfe79f7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1528 microversion: 2.1 time: 0.637918 Sep 24 21:10:27.975877 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2511/5010] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:10:27 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1528 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:10:29.001146 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-800d7c5e-6420-485e-bdfc-f4fe401df18e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:29.004520 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-800d7c5e-6420-485e-bdfc-f4fe401df18e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:29.014781 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-800d7c5e-6420-485e-bdfc-f4fe401df18e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:29.015551 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-800d7c5e-6420-485e-bdfc-f4fe401df18e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:29.016227 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-800d7c5e-6420-485e-bdfc-f4fe401df18e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:29.017265 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-800d7c5e-6420-485e-bdfc-f4fe401df18e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:29.017943 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-800d7c5e-6420-485e-bdfc-f4fe401df18e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:29.051398 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-800d7c5e-6420-485e-bdfc-f4fe401df18e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:31.174841 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-800d7c5e-6420-485e-bdfc-f4fe401df18e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:10:31.199616 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-800d7c5e-6420-485e-bdfc-f4fe401df18e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1528 microversion: 2.1 time: 2.191254 Sep 24 21:10:31.203617 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2500/5011] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:10:28 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1528 bytes in 2209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:10:32.225700 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-51a4838b-391f-4fd6-98dd-3eb4ed457a3d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:32.227642 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-51a4838b-391f-4fd6-98dd-3eb4ed457a3d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:32.247033 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-51a4838b-391f-4fd6-98dd-3eb4ed457a3d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:32.247520 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-51a4838b-391f-4fd6-98dd-3eb4ed457a3d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:32.247987 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-51a4838b-391f-4fd6-98dd-3eb4ed457a3d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:32.248722 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-51a4838b-391f-4fd6-98dd-3eb4ed457a3d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:32.249191 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-51a4838b-391f-4fd6-98dd-3eb4ed457a3d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:32.274310 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-51a4838b-391f-4fd6-98dd-3eb4ed457a3d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:33.296705 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-51a4838b-391f-4fd6-98dd-3eb4ed457a3d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:10:33.306320 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-51a4838b-391f-4fd6-98dd-3eb4ed457a3d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1528 microversion: 2.1 time: 1.084893 Sep 24 21:10:33.325029 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2512/5012] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:10:32 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1528 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:10:34.338009 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-34bbe9e4-ee50-4aef-83a9-f5a6604741cd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:34.338809 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-34bbe9e4-ee50-4aef-83a9-f5a6604741cd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:34.350377 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34bbe9e4-ee50-4aef-83a9-f5a6604741cd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:34.353212 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34bbe9e4-ee50-4aef-83a9-f5a6604741cd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:34.355466 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34bbe9e4-ee50-4aef-83a9-f5a6604741cd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:34.356639 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34bbe9e4-ee50-4aef-83a9-f5a6604741cd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:34.358939 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34bbe9e4-ee50-4aef-83a9-f5a6604741cd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:34.359557 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34bbe9e4-ee50-4aef-83a9-f5a6604741cd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:35.184679 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-34bbe9e4-ee50-4aef-83a9-f5a6604741cd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:10:35.196882 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-34bbe9e4-ee50-4aef-83a9-f5a6604741cd tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1528 microversion: 2.1 time: 0.863455 Sep 24 21:10:35.197506 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2501/5013] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:10:34 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1528 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:10:36.225711 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8b16a38c-b19f-4e3b-849e-33f45c8b981d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:36.229884 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8b16a38c-b19f-4e3b-849e-33f45c8b981d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:36.243444 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8b16a38c-b19f-4e3b-849e-33f45c8b981d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:36.249812 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8b16a38c-b19f-4e3b-849e-33f45c8b981d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:36.250267 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8b16a38c-b19f-4e3b-849e-33f45c8b981d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:36.252258 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8b16a38c-b19f-4e3b-849e-33f45c8b981d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:36.259733 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8b16a38c-b19f-4e3b-849e-33f45c8b981d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:36.260429 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8b16a38c-b19f-4e3b-849e-33f45c8b981d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:37.500017 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8b16a38c-b19f-4e3b-849e-33f45c8b981d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:10:37.526553 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8b16a38c-b19f-4e3b-849e-33f45c8b981d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1528 microversion: 2.1 time: 1.305846 Sep 24 21:10:37.533611 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2513/5014] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:10:36 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1528 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:10:38.563163 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9578c1f8-4d6d-45d8-bd9a-c2229bf609ad tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:38.564290 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9578c1f8-4d6d-45d8-bd9a-c2229bf609ad tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:38.578365 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9578c1f8-4d6d-45d8-bd9a-c2229bf609ad tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:38.578889 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9578c1f8-4d6d-45d8-bd9a-c2229bf609ad tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:38.579325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9578c1f8-4d6d-45d8-bd9a-c2229bf609ad tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:38.580051 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9578c1f8-4d6d-45d8-bd9a-c2229bf609ad tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:38.585686 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9578c1f8-4d6d-45d8-bd9a-c2229bf609ad tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:38.587914 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9578c1f8-4d6d-45d8-bd9a-c2229bf609ad tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:38.999211 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9578c1f8-4d6d-45d8-bd9a-c2229bf609ad tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:10:39.010851 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9578c1f8-4d6d-45d8-bd9a-c2229bf609ad tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1510 microversion: 2.1 time: 0.450714 Sep 24 21:10:39.014839 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2502/5015] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:10:38 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1510 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:10:40.050227 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-073a1949-060c-464c-a43c-af77214da66c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:40.052203 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-073a1949-060c-464c-a43c-af77214da66c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:40.079977 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-073a1949-060c-464c-a43c-af77214da66c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:40.081991 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-073a1949-060c-464c-a43c-af77214da66c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:40.083142 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-073a1949-060c-464c-a43c-af77214da66c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:40.084414 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-073a1949-060c-464c-a43c-af77214da66c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:40.085093 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-073a1949-060c-464c-a43c-af77214da66c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:40.095091 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-073a1949-060c-464c-a43c-af77214da66c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:40.990307 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-073a1949-060c-464c-a43c-af77214da66c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:10:41.007852 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-073a1949-060c-464c-a43c-af77214da66c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1513 microversion: 2.1 time: 0.971717 Sep 24 21:10:41.008651 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2514/5016] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:10:40 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1513 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:10:41.010799 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-6e45c362-86ed-449e-a277-bce486d194ee req-48ad2f09-a205-49f3-af93-0a21c527e689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3fcc34d-d09a-4475-bd96-51ac0074cb5f", "name": "network-vif-unplugged", "status": "completed", "tag": "2ca29bee-7747-4b85-b335-ac8c4538a67e"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:10:41.032053 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a8e33dbf-f1f2-4c28-877a-1837d94115fa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:41.032974 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a8e33dbf-f1f2-4c28-877a-1837d94115fa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:41.036395 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-6e45c362-86ed-449e-a277-bce486d194ee req-48ad2f09-a205-49f3-af93-0a21c527e689 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:41.037132 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-6e45c362-86ed-449e-a277-bce486d194ee req-48ad2f09-a205-49f3-af93-0a21c527e689 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:41.038568 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-6e45c362-86ed-449e-a277-bce486d194ee req-48ad2f09-a205-49f3-af93-0a21c527e689 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:41.040560 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a8e33dbf-f1f2-4c28-877a-1837d94115fa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:41.041239 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a8e33dbf-f1f2-4c28-877a-1837d94115fa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:41.041860 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a8e33dbf-f1f2-4c28-877a-1837d94115fa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:41.042810 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a8e33dbf-f1f2-4c28-877a-1837d94115fa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:41.043434 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a8e33dbf-f1f2-4c28-877a-1837d94115fa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:41.044184 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a8e33dbf-f1f2-4c28-877a-1837d94115fa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:41.070591 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.compute.server_external_events [req-6e45c362-86ed-449e-a277-bce486d194ee req-48ad2f09-a205-49f3-af93-0a21c527e689 service nova] Unable to find a host for instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f. Dropping event network-vif-unplugged {{(pid=140516) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 24 21:10:41.071893 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-6e45c362-86ed-449e-a277-bce486d194ee req-48ad2f09-a205-49f3-af93-0a21c527e689 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.400697 Sep 24 21:10:41.073675 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2503/5017] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 403 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 24 21:10:41.389230 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a8e33dbf-f1f2-4c28-877a-1837d94115fa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:10:41.415887 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a8e33dbf-f1f2-4c28-877a-1837d94115fa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1453 microversion: 2.1 time: 0.385640 Sep 24 21:10:41.416533 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2515/5018] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:10:41 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1453 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:10:41.520624 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2dbdbc56-863c-4fb1-b580-1b6de47ecb6e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:10:41.521515 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2dbdbc56-863c-4fb1-b580-1b6de47ecb6e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:41.529673 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2dbdbc56-863c-4fb1-b580-1b6de47ecb6e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:41.530475 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2dbdbc56-863c-4fb1-b580-1b6de47ecb6e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:41.531406 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2dbdbc56-863c-4fb1-b580-1b6de47ecb6e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:41.532400 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2dbdbc56-863c-4fb1-b580-1b6de47ecb6e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:41.533095 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2dbdbc56-863c-4fb1-b580-1b6de47ecb6e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:41.533784 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2dbdbc56-863c-4fb1-b580-1b6de47ecb6e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:41.562025 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-2dbdbc56-863c-4fb1-b580-1b6de47ecb6e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lazy-loading 'flavor' on Instance uuid f3fcc34d-d09a-4475-bd96-51ac0074cb5f {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:10:41.578917 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-2dbdbc56-863c-4fb1-b580-1b6de47ecb6e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] HTTP exception thrown: Cannot 'shelve' instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f while it is in vm_state shelved_offloaded Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2dbdbc56-863c-4fb1-b580-1b6de47ecb6e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f/action HTTP/1.1 Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 14 Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: {"shelve": {}} Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: exception: Cannot 'shelve' instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f while it is in vm_state shelved_offloaded Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'f3fcc34d-d09a-4475-bd96-51ac0074cb5f', 'body': {'shelve': {}}} Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 24 21:10:41.580779 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 24 21:10:41.586195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 24 21:10:41.586195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f while it is in vm_state shelved_offloaded Sep 24 21:10:41.586195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:10:41.586195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:10:41.586195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:10:41.586195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:10:41.586195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:10:41.586195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:10:41.586195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:10:41.586195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:10:41.586195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f while it is in vm_state shelved_offloaded Sep 24 21:10:41.586195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:10:41.588301 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2dbdbc56-863c-4fb1-b580-1b6de47ecb6e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 409 to user: Cannot 'shelve' instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f while it is in vm_state shelved_offloaded {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:10:41.589332 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2dbdbc56-863c-4fb1-b580-1b6de47ecb6e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f/action" status: 409 len: 155 microversion: 2.1 time: 0.073309 Sep 24 21:10:41.590438 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2504/5019] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:10:41 2022] POST /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f/action => generated 155 bytes in 75 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 24 21:10:41.599208 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6830f9b3-e694-454d-9202-565074d18df9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:10:41.599997 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6830f9b3-e694-454d-9202-565074d18df9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:41.608427 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6830f9b3-e694-454d-9202-565074d18df9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:41.610834 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6830f9b3-e694-454d-9202-565074d18df9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:41.611445 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6830f9b3-e694-454d-9202-565074d18df9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:41.612565 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6830f9b3-e694-454d-9202-565074d18df9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:41.613283 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6830f9b3-e694-454d-9202-565074d18df9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:41.614049 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6830f9b3-e694-454d-9202-565074d18df9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:41.746626 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6830f9b3-e694-454d-9202-565074d18df9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=140517) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 24 21:10:41.805026 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dfb14aa9-008a-4929-bd1f-5fde77058449 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:41.805534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-dfb14aa9-008a-4929-bd1f-5fde77058449 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 480b3ea3-dcc4-4a43-a334-00f5cd435884] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:41.815828 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dfb14aa9-008a-4929-bd1f-5fde77058449 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:41.820914 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dfb14aa9-008a-4929-bd1f-5fde77058449 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:41.821382 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dfb14aa9-008a-4929-bd1f-5fde77058449 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:41.822145 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dfb14aa9-008a-4929-bd1f-5fde77058449 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:41.822637 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dfb14aa9-008a-4929-bd1f-5fde77058449 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:41.823073 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dfb14aa9-008a-4929-bd1f-5fde77058449 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:41.880535 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-dfb14aa9-008a-4929-bd1f-5fde77058449 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884/ips" status: 200 len: 150 microversion: 2.1 time: 0.079547 Sep 24 21:10:41.881779 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2505/5020] 10.222.0.52 () {58 vars in 1248 bytes} [Sat Sep 24 21:10:41 2022] GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884/ips => generated 150 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:10:41.892132 ncdv-master-1 devstack@n-api.service[140517]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6830f9b3-e694-454d-9202-565074d18df9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [b2927123-9c53-40f7-b59d-6217e3ed0022] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 24 21:10:42.905203 ncdv-master-1 devstack@n-api.service[140517]: INFO oslo.messaging._drivers.impl_rabbit [None req-6830f9b3-e694-454d-9202-565074d18df9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [b2927123-9c53-40f7-b59d-6217e3ed0022] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 36310. Sep 24 21:10:42.911426 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6830f9b3-e694-454d-9202-565074d18df9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f/action" status: 202 len: 0 microversion: 2.1 time: 1.316675 Sep 24 21:10:42.912067 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2516/5021] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:10:41 2022] POST /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f/action => generated 0 bytes in 1318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:10:42.921792 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6ebac29a-2f36-4655-80e9-386678980a06 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:42.922381 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6ebac29a-2f36-4655-80e9-386678980a06 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:42.927216 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=20 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:10:42.937646 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ebac29a-2f36-4655-80e9-386678980a06 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:42.941441 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ebac29a-2f36-4655-80e9-386678980a06 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:42.941921 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ebac29a-2f36-4655-80e9-386678980a06 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:42.942811 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ebac29a-2f36-4655-80e9-386678980a06 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:42.943291 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ebac29a-2f36-4655-80e9-386678980a06 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:42.943728 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ebac29a-2f36-4655-80e9-386678980a06 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:43.375669 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6ebac29a-2f36-4655-80e9-386678980a06 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:10:43.402749 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6ebac29a-2f36-4655-80e9-386678980a06 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1461 microversion: 2.1 time: 0.485507 Sep 24 21:10:43.418025 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2506/5022] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:10:42 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1461 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:10:43.644885 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ffe8d280-fc66-4534-a5e9-d18608ebef46 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:43.645592 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ffe8d280-fc66-4534-a5e9-d18608ebef46 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 480b3ea3-dcc4-4a43-a334-00f5cd435884] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:43.688472 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ffe8d280-fc66-4534-a5e9-d18608ebef46 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:43.690115 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ffe8d280-fc66-4534-a5e9-d18608ebef46 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:43.691338 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ffe8d280-fc66-4534-a5e9-d18608ebef46 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:43.694056 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ffe8d280-fc66-4534-a5e9-d18608ebef46 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:43.695762 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ffe8d280-fc66-4534-a5e9-d18608ebef46 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:43.696855 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ffe8d280-fc66-4534-a5e9-d18608ebef46 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:43.745661 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ffe8d280-fc66-4534-a5e9-d18608ebef46 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 480b3ea3-dcc4-4a43-a334-00f5cd435884] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:10:43.901878 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ffe8d280-fc66-4534-a5e9-d18608ebef46 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "DELETE /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884" status: 204 len: 0 microversion: 2.1 time: 0.266265 Sep 24 21:10:43.907202 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2517/5023] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:10:43 2022] DELETE /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:10:43.913118 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5b1fe57f-9bd3-4648-b46c-eab4b9ece1b5 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:43.914401 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5b1fe57f-9bd3-4648-b46c-eab4b9ece1b5 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 480b3ea3-dcc4-4a43-a334-00f5cd435884] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:43.927762 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b1fe57f-9bd3-4648-b46c-eab4b9ece1b5 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:43.929394 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b1fe57f-9bd3-4648-b46c-eab4b9ece1b5 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:43.932323 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b1fe57f-9bd3-4648-b46c-eab4b9ece1b5 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:43.933338 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b1fe57f-9bd3-4648-b46c-eab4b9ece1b5 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:43.933816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b1fe57f-9bd3-4648-b46c-eab4b9ece1b5 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:43.934254 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b1fe57f-9bd3-4648-b46c-eab4b9ece1b5 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:44.249225 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5b1fe57f-9bd3-4648-b46c-eab4b9ece1b5 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:10:44.265303 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5b1fe57f-9bd3-4648-b46c-eab4b9ece1b5 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884" status: 200 len: 1681 microversion: 2.1 time: 0.354774 Sep 24 21:10:44.265918 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2507/5024] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:10:43 2022] GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884 => generated 1681 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:10:44.441324 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6a248510-535b-4516-9b13-18d735d3a450 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:44.442566 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6a248510-535b-4516-9b13-18d735d3a450 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:44.459993 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6a248510-535b-4516-9b13-18d735d3a450 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:44.462542 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6a248510-535b-4516-9b13-18d735d3a450 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:44.463001 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6a248510-535b-4516-9b13-18d735d3a450 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:44.463748 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6a248510-535b-4516-9b13-18d735d3a450 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:44.464845 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6a248510-535b-4516-9b13-18d735d3a450 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:44.465300 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6a248510-535b-4516-9b13-18d735d3a450 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:44.873608 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6a248510-535b-4516-9b13-18d735d3a450 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:10:44.882198 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6a248510-535b-4516-9b13-18d735d3a450 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1461 microversion: 2.1 time: 0.451911 Sep 24 21:10:44.903141 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2518/5025] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:10:44 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1461 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:10:45.297006 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d231189a-2f8c-4a06-9679-882825f14ff8 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:45.298469 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d231189a-2f8c-4a06-9679-882825f14ff8 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 480b3ea3-dcc4-4a43-a334-00f5cd435884] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:45.316938 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d231189a-2f8c-4a06-9679-882825f14ff8 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:45.318837 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d231189a-2f8c-4a06-9679-882825f14ff8 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:45.321384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d231189a-2f8c-4a06-9679-882825f14ff8 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:45.324195 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d231189a-2f8c-4a06-9679-882825f14ff8 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:45.325453 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d231189a-2f8c-4a06-9679-882825f14ff8 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:45.326576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d231189a-2f8c-4a06-9679-882825f14ff8 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:45.912936 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-26880a86-08ce-4ea4-bbfc-4cb7543b8f77 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:45.915682 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-26880a86-08ce-4ea4-bbfc-4cb7543b8f77 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:45.930901 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:10:45.936355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26880a86-08ce-4ea4-bbfc-4cb7543b8f77 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:45.937538 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26880a86-08ce-4ea4-bbfc-4cb7543b8f77 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:45.942577 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26880a86-08ce-4ea4-bbfc-4cb7543b8f77 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:45.943648 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26880a86-08ce-4ea4-bbfc-4cb7543b8f77 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:45.945317 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26880a86-08ce-4ea4-bbfc-4cb7543b8f77 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:45.946967 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26880a86-08ce-4ea4-bbfc-4cb7543b8f77 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:46.078279 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d231189a-2f8c-4a06-9679-882825f14ff8 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:10:46.097695 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d231189a-2f8c-4a06-9679-882825f14ff8 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884" status: 200 len: 1681 microversion: 2.1 time: 0.800626 Sep 24 21:10:46.098704 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2508/5026] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:10:45 2022] GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884 => generated 1681 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:10:46.690728 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-26880a86-08ce-4ea4-bbfc-4cb7543b8f77 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:10:46.701379 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-26880a86-08ce-4ea4-bbfc-4cb7543b8f77 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1461 microversion: 2.1 time: 0.794859 Sep 24 21:10:46.701975 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2519/5027] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:10:45 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1461 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:10:47.131414 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f1c6dd27-9d5d-45d9-9218-393e6799a0a1 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:47.133349 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f1c6dd27-9d5d-45d9-9218-393e6799a0a1 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 480b3ea3-dcc4-4a43-a334-00f5cd435884] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:47.143207 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1c6dd27-9d5d-45d9-9218-393e6799a0a1 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:47.144375 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1c6dd27-9d5d-45d9-9218-393e6799a0a1 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:47.145047 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1c6dd27-9d5d-45d9-9218-393e6799a0a1 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:47.146123 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1c6dd27-9d5d-45d9-9218-393e6799a0a1 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:47.146909 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1c6dd27-9d5d-45d9-9218-393e6799a0a1 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:47.147583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1c6dd27-9d5d-45d9-9218-393e6799a0a1 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:47.732530 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0c45521a-0301-47f1-be6e-4d0682ce4e68 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:47.734201 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0c45521a-0301-47f1-be6e-4d0682ce4e68 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:47.744846 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c45521a-0301-47f1-be6e-4d0682ce4e68 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:47.746233 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c45521a-0301-47f1-be6e-4d0682ce4e68 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:47.751649 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c45521a-0301-47f1-be6e-4d0682ce4e68 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:47.752682 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c45521a-0301-47f1-be6e-4d0682ce4e68 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:47.755623 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c45521a-0301-47f1-be6e-4d0682ce4e68 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:47.756037 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0c45521a-0301-47f1-be6e-4d0682ce4e68 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:47.961156 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f1c6dd27-9d5d-45d9-9218-393e6799a0a1 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:10:47.988510 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f1c6dd27-9d5d-45d9-9218-393e6799a0a1 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884" status: 200 len: 1681 microversion: 2.1 time: 0.857492 Sep 24 21:10:47.991355 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2509/5028] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:10:47 2022] GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884 => generated 1681 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:10:48.161814 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0c45521a-0301-47f1-be6e-4d0682ce4e68 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:10:48.171028 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0c45521a-0301-47f1-be6e-4d0682ce4e68 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1519 microversion: 2.1 time: 0.446059 Sep 24 21:10:48.187460 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2520/5029] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:10:47 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1519 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:10:48.817531 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-02724cae-717d-4054-b106-00dc5bfb2dfc req-9cbf70d7-496d-431f-b7fb-8f00ccb88b8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3fcc34d-d09a-4475-bd96-51ac0074cb5f", "tag": "2ca29bee-7747-4b85-b335-ac8c4538a67e"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:10:48.838878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-02724cae-717d-4054-b106-00dc5bfb2dfc req-9cbf70d7-496d-431f-b7fb-8f00ccb88b8f service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:48.839579 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-02724cae-717d-4054-b106-00dc5bfb2dfc req-9cbf70d7-496d-431f-b7fb-8f00ccb88b8f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:48.840076 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-02724cae-717d-4054-b106-00dc5bfb2dfc req-9cbf70d7-496d-431f-b7fb-8f00ccb88b8f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:48.867209 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-02724cae-717d-4054-b106-00dc5bfb2dfc req-9cbf70d7-496d-431f-b7fb-8f00ccb88b8f service nova] Creating event network-changed:2ca29bee-7747-4b85-b335-ac8c4538a67e for instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f on nch1-master-1 Sep 24 21:10:48.879291 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-02724cae-717d-4054-b106-00dc5bfb2dfc req-9cbf70d7-496d-431f-b7fb-8f00ccb88b8f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065074 Sep 24 21:10:48.883890 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2510/5030] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:10:49.017050 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-316a3b8d-0523-4a6d-9e26-adb7f8e0353b tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:49.017731 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-316a3b8d-0523-4a6d-9e26-adb7f8e0353b tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 480b3ea3-dcc4-4a43-a334-00f5cd435884] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:49.032451 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-316a3b8d-0523-4a6d-9e26-adb7f8e0353b tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:49.032957 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-316a3b8d-0523-4a6d-9e26-adb7f8e0353b tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:49.033483 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-316a3b8d-0523-4a6d-9e26-adb7f8e0353b tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:49.034279 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-316a3b8d-0523-4a6d-9e26-adb7f8e0353b tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:49.045936 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-316a3b8d-0523-4a6d-9e26-adb7f8e0353b tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:49.046681 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-316a3b8d-0523-4a6d-9e26-adb7f8e0353b tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:49.203617 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8a43be17-bca4-40bf-b5f1-9a1022221ae5 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:49.204815 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8a43be17-bca4-40bf-b5f1-9a1022221ae5 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:49.222088 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8a43be17-bca4-40bf-b5f1-9a1022221ae5 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:49.223207 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8a43be17-bca4-40bf-b5f1-9a1022221ae5 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:49.224888 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8a43be17-bca4-40bf-b5f1-9a1022221ae5 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:49.228249 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8a43be17-bca4-40bf-b5f1-9a1022221ae5 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:49.229042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8a43be17-bca4-40bf-b5f1-9a1022221ae5 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:49.230671 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8a43be17-bca4-40bf-b5f1-9a1022221ae5 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:49.456765 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-316a3b8d-0523-4a6d-9e26-adb7f8e0353b tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370b057b12c148cdbb673ba6c06bd6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede438e67af3496cae36fc89abc0aba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:10:49.491267 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-316a3b8d-0523-4a6d-9e26-adb7f8e0353b tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884" status: 200 len: 1615 microversion: 2.1 time: 0.476594 Sep 24 21:10:49.492648 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2521/5031] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:10:49 2022] GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884 => generated 1615 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:10:49.911942 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8a43be17-bca4-40bf-b5f1-9a1022221ae5 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:10:49.932315 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8a43be17-bca4-40bf-b5f1-9a1022221ae5 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1519 microversion: 2.1 time: 0.733611 Sep 24 21:10:49.936120 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2511/5032] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:10:49 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1519 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:10:50.081945 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-1948d508-ffe2-4352-b8c1-d79ff5807d13 req-8d3c8d8d-3500-40d8-a8e9-ad5b5e8a6d01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "480b3ea3-dcc4-4a43-a334-00f5cd435884", "name": "network-vif-deleted", "tag": "cc46c09b-dd44-4ab4-9d14-2c6fa3de14ac"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:10:50.131476 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-1948d508-ffe2-4352-b8c1-d79ff5807d13 req-8d3c8d8d-3500-40d8-a8e9-ad5b5e8a6d01 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:50.136151 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-1948d508-ffe2-4352-b8c1-d79ff5807d13 req-8d3c8d8d-3500-40d8-a8e9-ad5b5e8a6d01 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:50.137734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-1948d508-ffe2-4352-b8c1-d79ff5807d13 req-8d3c8d8d-3500-40d8-a8e9-ad5b5e8a6d01 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:50.160929 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-1948d508-ffe2-4352-b8c1-d79ff5807d13 req-8d3c8d8d-3500-40d8-a8e9-ad5b5e8a6d01 service nova] Creating event network-vif-deleted:cc46c09b-dd44-4ab4-9d14-2c6fa3de14ac for instance 480b3ea3-dcc4-4a43-a334-00f5cd435884 on nch1-master-1 Sep 24 21:10:50.171497 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-1948d508-ffe2-4352-b8c1-d79ff5807d13 req-8d3c8d8d-3500-40d8-a8e9-ad5b5e8a6d01 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.675475 Sep 24 21:10:50.178313 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2522/5033] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:10:50.521819 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c02498a0-1303-4286-9315-1cc5b62e2cc1 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:50.532309 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c02498a0-1303-4286-9315-1cc5b62e2cc1 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 480b3ea3-dcc4-4a43-a334-00f5cd435884] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:50.554614 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c02498a0-1303-4286-9315-1cc5b62e2cc1 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:50.561771 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c02498a0-1303-4286-9315-1cc5b62e2cc1 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:50.562583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c02498a0-1303-4286-9315-1cc5b62e2cc1 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:50.564269 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c02498a0-1303-4286-9315-1cc5b62e2cc1 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:50.568283 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c02498a0-1303-4286-9315-1cc5b62e2cc1 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:50.571030 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c02498a0-1303-4286-9315-1cc5b62e2cc1 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:50.606899 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-c02498a0-1303-4286-9315-1cc5b62e2cc1 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] HTTP exception thrown: Instance 480b3ea3-dcc4-4a43-a334-00f5cd435884 could not be found. Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c02498a0-1303-4286-9315-1cc5b62e2cc1 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Request method failure captured: Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884 HTTP/1.1 Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3FHajgQDXwDLPMdCneYsWMRO5KNyPHbfz7MOl1V6BQj2tCeZ2BgA1Mx3ktQ4m5HdNZhq5ppxGBz6lcC3ya-83mTOrwZRf93lvlUCMm9tAmwFMDFSArAIXGx5zWOL9fV8cMG0WLcDOQ7UmGyVIS3hmxMWF5HkXywVAOGRIZ6csTGTS0 Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: ede438e67af3496cae36fc89abc0aba3 Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-AttachVolumeNegativeTest-1729429408 Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ede438e67af3496cae36fc89abc0aba3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ede438e67af3496cae36fc89abc0aba3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ede438e67af3496cae36fc89abc0aba3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ede438e67af3496cae36fc89abc0aba3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-AttachVolumeNegativeTest-1729429408 Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: ede438e67af3496cae36fc89abc0aba3 Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1729429408 Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-AttachVolumeNegativeTest-1729429408-project Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 370b057b12c148cdbb673ba6c06bd6b4 Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-AttachVolumeNegativeTest-1729429408-project Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 480b3ea3-dcc4-4a43-a334-00f5cd435884 could not be found. Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '480b3ea3-dcc4-4a43-a334-00f5cd435884'} Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 480b3ea3-dcc4-4a43-a334-00f5cd435884 could not be found. Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 480b3ea3-dcc4-4a43-a334-00f5cd435884 could not be found. Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:10:50.609456 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:10:50.614972 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:10:50.614972 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:10:50.614972 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:10:50.614972 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:10:50.614972 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:10:50.614972 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 480b3ea3-dcc4-4a43-a334-00f5cd435884 could not be found. Sep 24 21:10:50.614972 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:10:50.617165 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c02498a0-1303-4286-9315-1cc5b62e2cc1 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Returning 404 to user: Instance 480b3ea3-dcc4-4a43-a334-00f5cd435884 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:10:50.618807 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c02498a0-1303-4286-9315-1cc5b62e2cc1 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884" status: 404 len: 111 microversion: 2.1 time: 0.101946 Sep 24 21:10:50.619717 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2512/5034] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:10:50 2022] GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:10:50.634663 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6894db51-49f8-45de-8cef-11a441897af2 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '.version_select at 0x7f4b07441a60>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:50.674402 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6894db51-49f8-45de-8cef-11a441897af2 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1860547824" status: 202 len: 0 microversion: 2.1 time: 0.049027 Sep 24 21:10:50.676210 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2523/5035] 10.222.0.52 () {58 vars in 1221 bytes} [Sat Sep 24 21:10:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1860547824 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:10:50.961743 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bd892c8a-903d-45a4-bc30-fc9501eea2ef tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:50.962448 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-bd892c8a-903d-45a4-bc30-fc9501eea2ef tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:50.977071 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bd892c8a-903d-45a4-bc30-fc9501eea2ef tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:50.979222 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bd892c8a-903d-45a4-bc30-fc9501eea2ef tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:50.995752 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bd892c8a-903d-45a4-bc30-fc9501eea2ef tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:51.007140 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bd892c8a-903d-45a4-bc30-fc9501eea2ef tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:51.008365 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bd892c8a-903d-45a4-bc30-fc9501eea2ef tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:51.009047 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bd892c8a-903d-45a4-bc30-fc9501eea2ef tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:51.806669 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-bd892c8a-903d-45a4-bc30-fc9501eea2ef tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:10:51.822746 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bd892c8a-903d-45a4-bc30-fc9501eea2ef tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1519 microversion: 2.1 time: 0.861072 Sep 24 21:10:51.824259 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2513/5036] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:10:50 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1519 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:10:52.856480 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-21142a8d-3d94-4aa9-a3d8-24277ba34788 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:52.857306 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-21142a8d-3d94-4aa9-a3d8-24277ba34788 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:52.884126 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-21142a8d-3d94-4aa9-a3d8-24277ba34788 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:52.887837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-21142a8d-3d94-4aa9-a3d8-24277ba34788 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:52.891634 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-21142a8d-3d94-4aa9-a3d8-24277ba34788 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:52.894588 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-21142a8d-3d94-4aa9-a3d8-24277ba34788 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:52.899636 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-21142a8d-3d94-4aa9-a3d8-24277ba34788 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:52.901718 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-21142a8d-3d94-4aa9-a3d8-24277ba34788 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:53.932257 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dc6ec718-598c-4a25-b250-9d7f087002ba tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:53.932822 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-dc6ec718-598c-4a25-b250-9d7f087002ba tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 480b3ea3-dcc4-4a43-a334-00f5cd435884] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:53.969268 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc6ec718-598c-4a25-b250-9d7f087002ba tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:53.969981 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc6ec718-598c-4a25-b250-9d7f087002ba tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:53.978179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc6ec718-598c-4a25-b250-9d7f087002ba tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:53.979712 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc6ec718-598c-4a25-b250-9d7f087002ba tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:53.980927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc6ec718-598c-4a25-b250-9d7f087002ba tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:53.981565 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc6ec718-598c-4a25-b250-9d7f087002ba tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:54.001223 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-dc6ec718-598c-4a25-b250-9d7f087002ba tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] HTTP exception thrown: Instance 480b3ea3-dcc4-4a43-a334-00f5cd435884 could not be found. Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dc6ec718-598c-4a25-b250-9d7f087002ba tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Request method failure captured: Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884 HTTP/1.1 Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3FHajgQDXwDLPMdCneYsWMRO5KNyPHbfz7MOl1V6BQj2tCeZ2BgA1Mx3ktQ4m5HdNZhq5ppxGBz6lcC3ya-83mTOrwZRf93lvlUCMm9tAmwFMDFSArAIXGx5zWOL9fV8cMG0WLcDOQ7UmGyVIS3hmxMWF5HkXywVAOGRIZ6csTGTS0 Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: ede438e67af3496cae36fc89abc0aba3 Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-AttachVolumeNegativeTest-1729429408 Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ede438e67af3496cae36fc89abc0aba3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ede438e67af3496cae36fc89abc0aba3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ede438e67af3496cae36fc89abc0aba3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ede438e67af3496cae36fc89abc0aba3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-AttachVolumeNegativeTest-1729429408 Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: ede438e67af3496cae36fc89abc0aba3 Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1729429408 Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-AttachVolumeNegativeTest-1729429408-project Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 370b057b12c148cdbb673ba6c06bd6b4 Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-AttachVolumeNegativeTest-1729429408-project Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 480b3ea3-dcc4-4a43-a334-00f5cd435884 could not be found. Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '480b3ea3-dcc4-4a43-a334-00f5cd435884'} Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 480b3ea3-dcc4-4a43-a334-00f5cd435884 could not be found. Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:10:54.012862 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:10:54.017057 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 480b3ea3-dcc4-4a43-a334-00f5cd435884 could not be found. Sep 24 21:10:54.017057 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:10:54.017057 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:10:54.017057 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:10:54.017057 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:10:54.017057 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:10:54.017057 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:10:54.017057 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:10:54.017057 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:10:54.017057 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 480b3ea3-dcc4-4a43-a334-00f5cd435884 could not be found. Sep 24 21:10:54.017057 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:10:54.021000 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dc6ec718-598c-4a25-b250-9d7f087002ba tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Returning 404 to user: Instance 480b3ea3-dcc4-4a43-a334-00f5cd435884 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:10:54.022551 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-dc6ec718-598c-4a25-b250-9d7f087002ba tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "DELETE /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884" status: 404 len: 111 microversion: 2.1 time: 0.096428 Sep 24 21:10:54.024088 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2514/5037] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:10:53 2022] DELETE /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 21:10:54.046316 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-473d6569-359d-482e-b33e-77c9802f5881 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:54.048529 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-473d6569-359d-482e-b33e-77c9802f5881 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 480b3ea3-dcc4-4a43-a334-00f5cd435884] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:54.062077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-21142a8d-3d94-4aa9-a3d8-24277ba34788 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:10:54.089541 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-21142a8d-3d94-4aa9-a3d8-24277ba34788 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1519 microversion: 2.1 time: 1.237990 Sep 24 21:10:54.090937 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-473d6569-359d-482e-b33e-77c9802f5881 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:54.091628 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-473d6569-359d-482e-b33e-77c9802f5881 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:54.093794 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2524/5038] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:10:52 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1519 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:10:54.096289 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-473d6569-359d-482e-b33e-77c9802f5881 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:54.097072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-473d6569-359d-482e-b33e-77c9802f5881 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:54.097544 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-473d6569-359d-482e-b33e-77c9802f5881 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:54.103624 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-473d6569-359d-482e-b33e-77c9802f5881 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:54.168964 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-473d6569-359d-482e-b33e-77c9802f5881 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] HTTP exception thrown: Instance 480b3ea3-dcc4-4a43-a334-00f5cd435884 could not be found. Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-473d6569-359d-482e-b33e-77c9802f5881 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Request method failure captured: Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884 HTTP/1.1 Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3FHajgQDXwDLPMdCneYsWMRO5KNyPHbfz7MOl1V6BQj2tCeZ2BgA1Mx3ktQ4m5HdNZhq5ppxGBz6lcC3ya-83mTOrwZRf93lvlUCMm9tAmwFMDFSArAIXGx5zWOL9fV8cMG0WLcDOQ7UmGyVIS3hmxMWF5HkXywVAOGRIZ6csTGTS0 Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: ede438e67af3496cae36fc89abc0aba3 Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-AttachVolumeNegativeTest-1729429408 Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ede438e67af3496cae36fc89abc0aba3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ede438e67af3496cae36fc89abc0aba3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ede438e67af3496cae36fc89abc0aba3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ede438e67af3496cae36fc89abc0aba3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-AttachVolumeNegativeTest-1729429408 Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: ede438e67af3496cae36fc89abc0aba3 Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1729429408 Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-AttachVolumeNegativeTest-1729429408-project Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 370b057b12c148cdbb673ba6c06bd6b4 Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-AttachVolumeNegativeTest-1729429408-project Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 480b3ea3-dcc4-4a43-a334-00f5cd435884 could not be found. Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '480b3ea3-dcc4-4a43-a334-00f5cd435884'} Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 480b3ea3-dcc4-4a43-a334-00f5cd435884 could not be found. Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 480b3ea3-dcc4-4a43-a334-00f5cd435884 could not be found. Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:10:54.174457 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:10:54.181278 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:10:54.181278 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:10:54.181278 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:10:54.181278 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:10:54.181278 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:10:54.181278 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 480b3ea3-dcc4-4a43-a334-00f5cd435884 could not be found. Sep 24 21:10:54.181278 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:10:54.186700 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-473d6569-359d-482e-b33e-77c9802f5881 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Returning 404 to user: Instance 480b3ea3-dcc4-4a43-a334-00f5cd435884 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:10:54.188566 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-473d6569-359d-482e-b33e-77c9802f5881 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884" status: 404 len: 111 microversion: 2.1 time: 0.155479 Sep 24 21:10:54.194303 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2515/5039] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:10:54 2022] GET /compute/v2.1/servers/480b3ea3-dcc4-4a43-a334-00f5cd435884 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:10:54.562357 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-54f6ed9f-fc02-4c90-b970-b06373565674 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:54.575577 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-54f6ed9f-fc02-4c90-b970-b06373565674 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 2fc426bb-02cf-4911-9f74-93866eb1868a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:54.612911 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54f6ed9f-fc02-4c90-b970-b06373565674 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:54.616599 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54f6ed9f-fc02-4c90-b970-b06373565674 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:54.617357 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54f6ed9f-fc02-4c90-b970-b06373565674 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:54.621168 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54f6ed9f-fc02-4c90-b970-b06373565674 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:54.622592 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54f6ed9f-fc02-4c90-b970-b06373565674 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:54.626138 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-54f6ed9f-fc02-4c90-b970-b06373565674 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:54.678530 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-54f6ed9f-fc02-4c90-b970-b06373565674 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] HTTP exception thrown: Instance 2fc426bb-02cf-4911-9f74-93866eb1868a could not be found. Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-54f6ed9f-fc02-4c90-b970-b06373565674 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Request method failure captured: Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a HTTP/1.1 Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3FHajgQDXwDLPMdCneYsWMRO5KNyPHbfz7MOl1V6BQj2tCeZ2BgA1Mx3ktQ4m5HdNZhq5ppxGBz6lcC3ya-83mTOrwZRf93lvlUCMm9tAmwFMDFSArAIXGx5zWOL9fV8cMG0WLcDOQ7UmGyVIS3hmxMWF5HkXywVAOGRIZ6csTGTS0 Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: ede438e67af3496cae36fc89abc0aba3 Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-AttachVolumeNegativeTest-1729429408 Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ede438e67af3496cae36fc89abc0aba3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ede438e67af3496cae36fc89abc0aba3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ede438e67af3496cae36fc89abc0aba3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ede438e67af3496cae36fc89abc0aba3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-AttachVolumeNegativeTest-1729429408 Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: ede438e67af3496cae36fc89abc0aba3 Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1729429408 Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-AttachVolumeNegativeTest-1729429408-project Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 370b057b12c148cdbb673ba6c06bd6b4 Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-AttachVolumeNegativeTest-1729429408-project Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 2fc426bb-02cf-4911-9f74-93866eb1868a could not be found. Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '2fc426bb-02cf-4911-9f74-93866eb1868a'} Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fc426bb-02cf-4911-9f74-93866eb1868a could not be found. Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:10:54.682027 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:10:54.692065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fc426bb-02cf-4911-9f74-93866eb1868a could not be found. Sep 24 21:10:54.692065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:10:54.692065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:10:54.692065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:10:54.692065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:10:54.692065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:10:54.692065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:10:54.692065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:10:54.692065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:10:54.692065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fc426bb-02cf-4911-9f74-93866eb1868a could not be found. Sep 24 21:10:54.692065 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:10:54.692065 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-54f6ed9f-fc02-4c90-b970-b06373565674 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Returning 404 to user: Instance 2fc426bb-02cf-4911-9f74-93866eb1868a could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:10:54.692065 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-54f6ed9f-fc02-4c90-b970-b06373565674 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a" status: 404 len: 111 microversion: 2.1 time: 0.135878 Sep 24 21:10:54.692065 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2525/5040] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:10:54 2022] DELETE /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:10:54.696010 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7868be3a-c35c-432e-9fe4-7fd0dbc74865 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:54.701287 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7868be3a-c35c-432e-9fe4-7fd0dbc74865 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 2fc426bb-02cf-4911-9f74-93866eb1868a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:54.708530 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7868be3a-c35c-432e-9fe4-7fd0dbc74865 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:54.710649 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7868be3a-c35c-432e-9fe4-7fd0dbc74865 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:54.712504 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7868be3a-c35c-432e-9fe4-7fd0dbc74865 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:54.714958 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7868be3a-c35c-432e-9fe4-7fd0dbc74865 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:54.715721 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7868be3a-c35c-432e-9fe4-7fd0dbc74865 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:54.716449 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7868be3a-c35c-432e-9fe4-7fd0dbc74865 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:54.742953 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-7868be3a-c35c-432e-9fe4-7fd0dbc74865 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] HTTP exception thrown: Instance 2fc426bb-02cf-4911-9f74-93866eb1868a could not be found. Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7868be3a-c35c-432e-9fe4-7fd0dbc74865 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Request method failure captured: Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a HTTP/1.1 Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3FHajgQDXwDLPMdCneYsWMRO5KNyPHbfz7MOl1V6BQj2tCeZ2BgA1Mx3ktQ4m5HdNZhq5ppxGBz6lcC3ya-83mTOrwZRf93lvlUCMm9tAmwFMDFSArAIXGx5zWOL9fV8cMG0WLcDOQ7UmGyVIS3hmxMWF5HkXywVAOGRIZ6csTGTS0 Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: ede438e67af3496cae36fc89abc0aba3 Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-AttachVolumeNegativeTest-1729429408 Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ede438e67af3496cae36fc89abc0aba3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ede438e67af3496cae36fc89abc0aba3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ede438e67af3496cae36fc89abc0aba3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ede438e67af3496cae36fc89abc0aba3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-AttachVolumeNegativeTest-1729429408 Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: ede438e67af3496cae36fc89abc0aba3 Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1729429408 Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-AttachVolumeNegativeTest-1729429408-project Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 370b057b12c148cdbb673ba6c06bd6b4 Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-AttachVolumeNegativeTest-1729429408-project Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 2fc426bb-02cf-4911-9f74-93866eb1868a could not be found. Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '2fc426bb-02cf-4911-9f74-93866eb1868a'} Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fc426bb-02cf-4911-9f74-93866eb1868a could not be found. Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fc426bb-02cf-4911-9f74-93866eb1868a could not be found. Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:10:54.745298 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:10:54.751037 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:10:54.751037 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:10:54.751037 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:10:54.751037 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:10:54.751037 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:10:54.751037 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fc426bb-02cf-4911-9f74-93866eb1868a could not be found. Sep 24 21:10:54.751037 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:10:54.755302 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7868be3a-c35c-432e-9fe4-7fd0dbc74865 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Returning 404 to user: Instance 2fc426bb-02cf-4911-9f74-93866eb1868a could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:10:54.756604 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7868be3a-c35c-432e-9fe4-7fd0dbc74865 tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a" status: 404 len: 111 microversion: 2.1 time: 0.064848 Sep 24 21:10:54.758278 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2516/5041] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:10:54 2022] GET /compute/v2.1/servers/2fc426bb-02cf-4911-9f74-93866eb1868a => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:10:55.079622 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-714433a0-b8bd-4eae-a8d6-992f2eae914a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:55.081456 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-714433a0-b8bd-4eae-a8d6-992f2eae914a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 7caa7efc-79ef-47c3-b024-dbcb34877a65] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:55.096946 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-714433a0-b8bd-4eae-a8d6-992f2eae914a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:55.099056 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-714433a0-b8bd-4eae-a8d6-992f2eae914a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:55.101461 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-714433a0-b8bd-4eae-a8d6-992f2eae914a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:55.102961 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-714433a0-b8bd-4eae-a8d6-992f2eae914a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:55.106704 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-714433a0-b8bd-4eae-a8d6-992f2eae914a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:55.109513 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-714433a0-b8bd-4eae-a8d6-992f2eae914a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:55.118197 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e34fbd80-deed-4626-ba2f-1465805f80b9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:55.119584 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e34fbd80-deed-4626-ba2f-1465805f80b9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:55.142062 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e34fbd80-deed-4626-ba2f-1465805f80b9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:55.144864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e34fbd80-deed-4626-ba2f-1465805f80b9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:55.150759 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e34fbd80-deed-4626-ba2f-1465805f80b9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:55.152063 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e34fbd80-deed-4626-ba2f-1465805f80b9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:55.155151 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e34fbd80-deed-4626-ba2f-1465805f80b9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:55.158687 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e34fbd80-deed-4626-ba2f-1465805f80b9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:55.185762 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-714433a0-b8bd-4eae-a8d6-992f2eae914a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] HTTP exception thrown: Instance 7caa7efc-79ef-47c3-b024-dbcb34877a65 could not be found. Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-714433a0-b8bd-4eae-a8d6-992f2eae914a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Request method failure captured: Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65 HTTP/1.1 Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3FHajgQDXwDLPMdCneYsWMRO5KNyPHbfz7MOl1V6BQj2tCeZ2BgA1Mx3ktQ4m5HdNZhq5ppxGBz6lcC3ya-83mTOrwZRf93lvlUCMm9tAmwFMDFSArAIXGx5zWOL9fV8cMG0WLcDOQ7UmGyVIS3hmxMWF5HkXywVAOGRIZ6csTGTS0 Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: ede438e67af3496cae36fc89abc0aba3 Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-AttachVolumeNegativeTest-1729429408 Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ede438e67af3496cae36fc89abc0aba3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ede438e67af3496cae36fc89abc0aba3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ede438e67af3496cae36fc89abc0aba3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ede438e67af3496cae36fc89abc0aba3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-AttachVolumeNegativeTest-1729429408 Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: ede438e67af3496cae36fc89abc0aba3 Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1729429408 Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-AttachVolumeNegativeTest-1729429408-project Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 370b057b12c148cdbb673ba6c06bd6b4 Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-AttachVolumeNegativeTest-1729429408-project Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 7caa7efc-79ef-47c3-b024-dbcb34877a65 could not be found. Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '7caa7efc-79ef-47c3-b024-dbcb34877a65'} Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7caa7efc-79ef-47c3-b024-dbcb34877a65 could not be found. Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:10:55.189747 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:10:55.197416 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7caa7efc-79ef-47c3-b024-dbcb34877a65 could not be found. Sep 24 21:10:55.197416 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:10:55.197416 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:10:55.197416 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:10:55.197416 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:10:55.197416 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:10:55.197416 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:10:55.197416 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:10:55.197416 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:10:55.197416 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7caa7efc-79ef-47c3-b024-dbcb34877a65 could not be found. Sep 24 21:10:55.197416 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:10:55.208561 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-714433a0-b8bd-4eae-a8d6-992f2eae914a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Returning 404 to user: Instance 7caa7efc-79ef-47c3-b024-dbcb34877a65 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:10:55.208561 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-714433a0-b8bd-4eae-a8d6-992f2eae914a tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65" status: 404 len: 111 microversion: 2.1 time: 0.133294 Sep 24 21:10:55.210743 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2526/5042] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:10:55 2022] DELETE /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:10:55.218853 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a853dcf4-59c3-4ebd-9bf9-8b650c1ad97c tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:55.220286 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a853dcf4-59c3-4ebd-9bf9-8b650c1ad97c tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] [instance: 7caa7efc-79ef-47c3-b024-dbcb34877a65] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:55.242331 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a853dcf4-59c3-4ebd-9bf9-8b650c1ad97c tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:55.244349 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a853dcf4-59c3-4ebd-9bf9-8b650c1ad97c tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:55.247184 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a853dcf4-59c3-4ebd-9bf9-8b650c1ad97c tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:55.248216 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a853dcf4-59c3-4ebd-9bf9-8b650c1ad97c tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:55.248911 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a853dcf4-59c3-4ebd-9bf9-8b650c1ad97c tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:55.251344 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a853dcf4-59c3-4ebd-9bf9-8b650c1ad97c tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:55.287705 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-a853dcf4-59c3-4ebd-9bf9-8b650c1ad97c tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] HTTP exception thrown: Instance 7caa7efc-79ef-47c3-b024-dbcb34877a65 could not be found. Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a853dcf4-59c3-4ebd-9bf9-8b650c1ad97c tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Request method failure captured: Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65 HTTP/1.1 Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3FHajgQDXwDLPMdCneYsWMRO5KNyPHbfz7MOl1V6BQj2tCeZ2BgA1Mx3ktQ4m5HdNZhq5ppxGBz6lcC3ya-83mTOrwZRf93lvlUCMm9tAmwFMDFSArAIXGx5zWOL9fV8cMG0WLcDOQ7UmGyVIS3hmxMWF5HkXywVAOGRIZ6csTGTS0 Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: ede438e67af3496cae36fc89abc0aba3 Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-AttachVolumeNegativeTest-1729429408 Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ede438e67af3496cae36fc89abc0aba3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ede438e67af3496cae36fc89abc0aba3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ede438e67af3496cae36fc89abc0aba3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ede438e67af3496cae36fc89abc0aba3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-AttachVolumeNegativeTest-1729429408 Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: ede438e67af3496cae36fc89abc0aba3 Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1729429408 Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-AttachVolumeNegativeTest-1729429408-project Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 370b057b12c148cdbb673ba6c06bd6b4 Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-AttachVolumeNegativeTest-1729429408-project Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 7caa7efc-79ef-47c3-b024-dbcb34877a65 could not be found. Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '7caa7efc-79ef-47c3-b024-dbcb34877a65'} Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7caa7efc-79ef-47c3-b024-dbcb34877a65 could not be found. Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7caa7efc-79ef-47c3-b024-dbcb34877a65 could not be found. Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:10:55.290328 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:10:55.295119 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:10:55.295119 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:10:55.295119 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:10:55.295119 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:10:55.295119 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:10:55.295119 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7caa7efc-79ef-47c3-b024-dbcb34877a65 could not be found. Sep 24 21:10:55.295119 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:10:55.300339 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a853dcf4-59c3-4ebd-9bf9-8b650c1ad97c tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] Returning 404 to user: Instance 7caa7efc-79ef-47c3-b024-dbcb34877a65 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:10:55.301461 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a853dcf4-59c3-4ebd-9bf9-8b650c1ad97c tempest-AttachVolumeNegativeTest-1729429408 tempest-AttachVolumeNegativeTest-1729429408-project] 10.222.0.52 "GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65" status: 404 len: 111 microversion: 2.1 time: 0.087485 Sep 24 21:10:55.302703 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2527/5043] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:10:55 2022] GET /compute/v2.1/servers/7caa7efc-79ef-47c3-b024-dbcb34877a65 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 21:10:56.573161 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e34fbd80-deed-4626-ba2f-1465805f80b9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:10:56.583081 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=86 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:10:56.597289 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e34fbd80-deed-4626-ba2f-1465805f80b9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1519 microversion: 2.1 time: 1.482839 Sep 24 21:10:56.601542 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2517/5044] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:10:55 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1519 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:10:57.628001 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4a486ab9-08b3-4496-ae17-049136a4590a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:57.629039 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4a486ab9-08b3-4496-ae17-049136a4590a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:57.649489 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4a486ab9-08b3-4496-ae17-049136a4590a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:57.650965 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4a486ab9-08b3-4496-ae17-049136a4590a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:57.651592 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4a486ab9-08b3-4496-ae17-049136a4590a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:57.654322 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4a486ab9-08b3-4496-ae17-049136a4590a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:57.656919 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4a486ab9-08b3-4496-ae17-049136a4590a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:57.657486 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4a486ab9-08b3-4496-ae17-049136a4590a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:57.674342 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:10:58.893899 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4a486ab9-08b3-4496-ae17-049136a4590a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:10:58.903285 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4a486ab9-08b3-4496-ae17-049136a4590a tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1519 microversion: 2.1 time: 1.282200 Sep 24 21:10:58.908796 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2528/5045] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:10:57 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1519 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:10:59.929464 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-08e44ad4-ddf8-4884-b6d4-ef9d8e9af79b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:10:59.930469 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-08e44ad4-ddf8-4884-b6d4-ef9d8e9af79b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:10:59.963449 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-08e44ad4-ddf8-4884-b6d4-ef9d8e9af79b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:59.965867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-08e44ad4-ddf8-4884-b6d4-ef9d8e9af79b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:59.966822 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-08e44ad4-ddf8-4884-b6d4-ef9d8e9af79b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:10:59.967589 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-08e44ad4-ddf8-4884-b6d4-ef9d8e9af79b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:10:59.971269 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-08e44ad4-ddf8-4884-b6d4-ef9d8e9af79b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:10:59.973325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-08e44ad4-ddf8-4884-b6d4-ef9d8e9af79b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:00.590719 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-08e44ad4-ddf8-4884-b6d4-ef9d8e9af79b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:00.614567 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-08e44ad4-ddf8-4884-b6d4-ef9d8e9af79b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1519 microversion: 2.1 time: 0.689659 Sep 24 21:11:00.618811 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2518/5046] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:10:59 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1519 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:11:01.642913 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-57473629-3ec2-42d1-b9af-1d136c3686a4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:01.643601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-57473629-3ec2-42d1-b9af-1d136c3686a4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:01.658377 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57473629-3ec2-42d1-b9af-1d136c3686a4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:01.658983 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57473629-3ec2-42d1-b9af-1d136c3686a4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:01.659526 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57473629-3ec2-42d1-b9af-1d136c3686a4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:01.660385 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57473629-3ec2-42d1-b9af-1d136c3686a4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:01.685261 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57473629-3ec2-42d1-b9af-1d136c3686a4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:01.706873 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57473629-3ec2-42d1-b9af-1d136c3686a4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:02.276147 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-57473629-3ec2-42d1-b9af-1d136c3686a4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:02.304479 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-57473629-3ec2-42d1-b9af-1d136c3686a4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1519 microversion: 2.1 time: 0.664394 Sep 24 21:11:02.306428 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2529/5047] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:01 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1519 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:11:03.331938 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1b381b59-2f63-49e4-97db-2485d659316b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:03.333611 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1b381b59-2f63-49e4-97db-2485d659316b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:03.369372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1b381b59-2f63-49e4-97db-2485d659316b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:03.370265 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1b381b59-2f63-49e4-97db-2485d659316b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:03.389643 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1b381b59-2f63-49e4-97db-2485d659316b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:03.394659 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1b381b59-2f63-49e4-97db-2485d659316b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:03.395773 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1b381b59-2f63-49e4-97db-2485d659316b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:03.396409 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1b381b59-2f63-49e4-97db-2485d659316b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:04.677802 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1b381b59-2f63-49e4-97db-2485d659316b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:04.706821 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1b381b59-2f63-49e4-97db-2485d659316b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1519 microversion: 2.1 time: 1.375959 Sep 24 21:11:04.708128 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2519/5048] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:03 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1519 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:11:05.735835 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9a06918c-2658-48cd-aaeb-2d540fb7831e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:05.737459 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9a06918c-2658-48cd-aaeb-2d540fb7831e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:05.762227 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a06918c-2658-48cd-aaeb-2d540fb7831e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:05.763233 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a06918c-2658-48cd-aaeb-2d540fb7831e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:05.764721 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a06918c-2658-48cd-aaeb-2d540fb7831e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:05.768775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a06918c-2658-48cd-aaeb-2d540fb7831e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:05.770468 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a06918c-2658-48cd-aaeb-2d540fb7831e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:05.775457 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a06918c-2658-48cd-aaeb-2d540fb7831e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:06.793026 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9a06918c-2658-48cd-aaeb-2d540fb7831e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:06.810974 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9a06918c-2658-48cd-aaeb-2d540fb7831e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1519 microversion: 2.1 time: 1.076503 Sep 24 21:11:06.814579 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2530/5049] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:05 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1519 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:11:07.842280 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-101bcbd2-413e-4f32-a4b3-3c287a20403e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:07.844088 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-101bcbd2-413e-4f32-a4b3-3c287a20403e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:07.855085 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-101bcbd2-413e-4f32-a4b3-3c287a20403e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:07.855835 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-101bcbd2-413e-4f32-a4b3-3c287a20403e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:07.856629 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-101bcbd2-413e-4f32-a4b3-3c287a20403e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:07.859009 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-101bcbd2-413e-4f32-a4b3-3c287a20403e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:07.859819 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-101bcbd2-413e-4f32-a4b3-3c287a20403e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:07.860675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-101bcbd2-413e-4f32-a4b3-3c287a20403e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:08.436054 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-101bcbd2-413e-4f32-a4b3-3c287a20403e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:08.452737 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-101bcbd2-413e-4f32-a4b3-3c287a20403e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1519 microversion: 2.1 time: 0.615834 Sep 24 21:11:08.453288 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2520/5050] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:07 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1519 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:11:09.479680 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0b989628-29c3-4bc6-bc4c-4f05a258ab9c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:09.481420 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0b989628-29c3-4bc6-bc4c-4f05a258ab9c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:09.498662 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0b989628-29c3-4bc6-bc4c-4f05a258ab9c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:09.502236 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0b989628-29c3-4bc6-bc4c-4f05a258ab9c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:09.504110 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0b989628-29c3-4bc6-bc4c-4f05a258ab9c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:09.508492 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0b989628-29c3-4bc6-bc4c-4f05a258ab9c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:09.509967 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0b989628-29c3-4bc6-bc4c-4f05a258ab9c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:09.510623 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0b989628-29c3-4bc6-bc4c-4f05a258ab9c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:10.024317 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0b989628-29c3-4bc6-bc4c-4f05a258ab9c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:10.036012 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0b989628-29c3-4bc6-bc4c-4f05a258ab9c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1519 microversion: 2.1 time: 0.560724 Sep 24 21:11:10.050957 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2531/5051] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:09 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1519 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:11:11.066975 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-462918ff-7eb8-45c8-8af9-15b17422fce0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:11.069855 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-462918ff-7eb8-45c8-8af9-15b17422fce0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:11.088582 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-462918ff-7eb8-45c8-8af9-15b17422fce0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:11.089881 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-462918ff-7eb8-45c8-8af9-15b17422fce0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:11.090349 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-462918ff-7eb8-45c8-8af9-15b17422fce0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:11.092961 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-462918ff-7eb8-45c8-8af9-15b17422fce0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:11.096083 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-462918ff-7eb8-45c8-8af9-15b17422fce0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:11.114761 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-462918ff-7eb8-45c8-8af9-15b17422fce0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:12.189012 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-462918ff-7eb8-45c8-8af9-15b17422fce0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:12.216134 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-462918ff-7eb8-45c8-8af9-15b17422fce0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1519 microversion: 2.1 time: 1.152656 Sep 24 21:11:12.217509 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2521/5052] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:11 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1519 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:11:13.249446 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-11a2da6f-d295-4f03-ba08-a40af8738d67 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:13.250070 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-11a2da6f-d295-4f03-ba08-a40af8738d67 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:13.259556 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-11a2da6f-d295-4f03-ba08-a40af8738d67 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:13.260045 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-11a2da6f-d295-4f03-ba08-a40af8738d67 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:13.262417 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-11a2da6f-d295-4f03-ba08-a40af8738d67 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:13.263349 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-11a2da6f-d295-4f03-ba08-a40af8738d67 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:13.265655 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-11a2da6f-d295-4f03-ba08-a40af8738d67 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:13.266272 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-11a2da6f-d295-4f03-ba08-a40af8738d67 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:13.737370 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-11a2da6f-d295-4f03-ba08-a40af8738d67 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:13.764982 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-11a2da6f-d295-4f03-ba08-a40af8738d67 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1519 microversion: 2.1 time: 0.518510 Sep 24 21:11:13.782237 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2532/5053] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:13 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1519 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:11:14.749708 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-677dd7b4-7496-4a63-a393-429ac707b5b2 tempest-VolumesNegativeTest-1422592882 tempest-VolumesNegativeTest-1422592882-project] Action: 'create', calling method: .version_select at 0x7f4b075e80d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-437718664", "metadata": {"Type": "work"}}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-677dd7b4-7496-4a63-a393-429ac707b5b2 tempest-VolumesNegativeTest-1422592882 tempest-VolumesNegativeTest-1422592882-project] Request method failure captured: Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 121 Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3JxPLqt_apq6Xjm5NtlbqPtFbqXSESsg8CbbxUAt4qCCt0TPzL8SeQoauYNmcRQi-59z_ZJx2CNyYV91uJeB5Ih0lRhTOo72Qcr2RIKuWv8c5dOZI-_YbR7pte97Ov2pkKC9Kw6KzTERMB8Q_NWwdGuQ7Od9gsKvaGNjUzr6FxgQWU Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: e6054fc080d149c7ac0d6f9096d0545d Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-VolumesNegativeTest-1422592882 Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6054fc080d149c7ac0d6f9096d0545d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e6054fc080d149c7ac0d6f9096d0545d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e6054fc080d149c7ac0d6f9096d0545d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6054fc080d149c7ac0d6f9096d0545d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-VolumesNegativeTest-1422592882 Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: e6054fc080d149c7ac0d6f9096d0545d Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-VolumesNegativeTest-1422592882 Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-VolumesNegativeTest-1422592882-project Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 8eced8ee4f5e45b19895743896aae2da Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-VolumesNegativeTest-1422592882-project Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-437718664", "metadata": {"Type": "work"}}} Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-437718664', 'metadata': {'Type': 'work'}}}} Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise error Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi '#$%' Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 21:11:14.754953 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 21:11:14.760827 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 24 21:11:14.760827 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:11:14.760827 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:14.760827 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:11:14.760827 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:14.760827 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:11:14.760827 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:11:14.760827 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 21:11:14.760827 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 21:11:14.760827 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 24 21:11:14.760827 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:11:14.763352 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-677dd7b4-7496-4a63-a393-429ac707b5b2 tempest-VolumesNegativeTest-1422592882 tempest-VolumesNegativeTest-1422592882-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:11:14.767975 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-677dd7b4-7496-4a63-a393-429ac707b5b2 tempest-VolumesNegativeTest-1422592882 tempest-VolumesNegativeTest-1422592882-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.675052 Sep 24 21:11:14.769050 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2522/5054] 10.222.0.52 () {60 vars in 1156 bytes} [Sat Sep 24 21:11:14 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 677 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:11:14.781204 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-822c335f-3fde-4fd4-b0a2-a1a0bcd5454f tempest-VolumesNegativeTest-1422592882 tempest-VolumesNegativeTest-1422592882-project] Action: 'create', calling method: .version_select at 0x7f4b0740ab80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2023460326", "metadata": {"Type": "work"}}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-822c335f-3fde-4fd4-b0a2-a1a0bcd5454f tempest-VolumesNegativeTest-1422592882 tempest-VolumesNegativeTest-1422592882-project] Request method failure captured: Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 120 Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3JxPLqt_apq6Xjm5NtlbqPtFbqXSESsg8CbbxUAt4qCCt0TPzL8SeQoauYNmcRQi-59z_ZJx2CNyYV91uJeB5Ih0lRhTOo72Qcr2RIKuWv8c5dOZI-_YbR7pte97Ov2pkKC9Kw6KzTERMB8Q_NWwdGuQ7Od9gsKvaGNjUzr6FxgQWU Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: e6054fc080d149c7ac0d6f9096d0545d Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-VolumesNegativeTest-1422592882 Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6054fc080d149c7ac0d6f9096d0545d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e6054fc080d149c7ac0d6f9096d0545d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e6054fc080d149c7ac0d6f9096d0545d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6054fc080d149c7ac0d6f9096d0545d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-VolumesNegativeTest-1422592882 Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: e6054fc080d149c7ac0d6f9096d0545d Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-VolumesNegativeTest-1422592882 Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-VolumesNegativeTest-1422592882-project Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 8eced8ee4f5e45b19895743896aae2da Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-VolumesNegativeTest-1422592882-project Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2023460326", "metadata": {"Type": "work"}}} Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2023460326', 'metadata': {'Type': 'work'}}}} Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise error Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi '0' Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 21:11:14.787718 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 21:11:14.792080 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 24 21:11:14.792080 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:14.792080 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:14.792080 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:14.792080 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:14.792080 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:11:14.792080 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:11:14.792080 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 21:11:14.792080 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 21:11:14.792080 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 24 21:11:14.792080 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:14.799023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-822c335f-3fde-4fd4-b0a2-a1a0bcd5454f tempest-VolumesNegativeTest-1422592882 tempest-VolumesNegativeTest-1422592882-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:11:14.799552 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c928ada3-c290-402e-a726-6587d006c765 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:14.800193 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c928ada3-c290-402e-a726-6587d006c765 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:14.801150 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-822c335f-3fde-4fd4-b0a2-a1a0bcd5454f tempest-VolumesNegativeTest-1422592882 tempest-VolumesNegativeTest-1422592882-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.024763 Sep 24 21:11:14.806567 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2533/5055] 10.222.0.52 () {60 vars in 1156 bytes} [Sat Sep 24 21:11:14 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:11:14.816875 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-648b3e80-5088-4e98-a56e-98d0bbce5287 tempest-VolumesNegativeTest-1422592882 tempest-VolumesNegativeTest-1422592882-project] Action: 'create', calling method: .version_select at 0x7f4b074a8040>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1990806179", "metadata": {"Type": "work"}}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:11:14.817692 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=32 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:11:14.825455 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c928ada3-c290-402e-a726-6587d006c765 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:14.826046 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c928ada3-c290-402e-a726-6587d006c765 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:14.827947 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c928ada3-c290-402e-a726-6587d006c765 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:14.828713 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c928ada3-c290-402e-a726-6587d006c765 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:14.829191 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c928ada3-c290-402e-a726-6587d006c765 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:14.829636 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c928ada3-c290-402e-a726-6587d006c765 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-648b3e80-5088-4e98-a56e-98d0bbce5287 tempest-VolumesNegativeTest-1422592882 tempest-VolumesNegativeTest-1422592882-project] Request method failure captured: Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 119 Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3JxPLqt_apq6Xjm5NtlbqPtFbqXSESsg8CbbxUAt4qCCt0TPzL8SeQoauYNmcRQi-59z_ZJx2CNyYV91uJeB5Ih0lRhTOo72Qcr2RIKuWv8c5dOZI-_YbR7pte97Ov2pkKC9Kw6KzTERMB8Q_NWwdGuQ7Od9gsKvaGNjUzr6FxgQWU Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: e6054fc080d149c7ac0d6f9096d0545d Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-VolumesNegativeTest-1422592882 Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6054fc080d149c7ac0d6f9096d0545d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e6054fc080d149c7ac0d6f9096d0545d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e6054fc080d149c7ac0d6f9096d0545d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6054fc080d149c7ac0d6f9096d0545d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-VolumesNegativeTest-1422592882 Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: e6054fc080d149c7ac0d6f9096d0545d Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-VolumesNegativeTest-1422592882 Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-VolumesNegativeTest-1422592882-project Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 8eced8ee4f5e45b19895743896aae2da Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-VolumesNegativeTest-1422592882-project Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1990806179", "metadata": {"Type": "work"}}} Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1990806179', 'metadata': {'Type': 'work'}}}} Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise error Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi '' Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 21:11:14.830270 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 21:11:14.834393 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 24 21:11:14.834393 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:14.834393 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:14.834393 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:14.834393 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:14.834393 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:11:14.834393 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:11:14.834393 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 21:11:14.834393 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 21:11:14.834393 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 24 21:11:14.834393 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:14.837286 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-648b3e80-5088-4e98-a56e-98d0bbce5287 tempest-VolumesNegativeTest-1422592882 tempest-VolumesNegativeTest-1422592882-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:11:14.839473 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-648b3e80-5088-4e98-a56e-98d0bbce5287 tempest-VolumesNegativeTest-1422592882 tempest-VolumesNegativeTest-1422592882-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.027842 Sep 24 21:11:14.842914 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2534/5056] 10.222.0.52 () {60 vars in 1156 bytes} [Sat Sep 24 21:11:14 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:11:14.855094 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b7c1126e-0bc8-4d50-83b6-e952a05a9d5b tempest-VolumesNegativeTest-1422592882 tempest-VolumesNegativeTest-1422592882-project] Calling method '.version_select at 0x7f4b07d03430>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:14.903280 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-b7c1126e-0bc8-4d50-83b6-e952a05a9d5b tempest-VolumesNegativeTest-1422592882 tempest-VolumesNegativeTest-1422592882-project] HTTP exception thrown: Volume tempest-invalid-1145497989 could not be found. Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b7c1126e-0bc8-4d50-83b6-e952a05a9d5b tempest-VolumesNegativeTest-1422592882 tempest-VolumesNegativeTest-1422592882-project] Request method failure captured: Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1145497989 HTTP/1.1 Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3JxPLqt_apq6Xjm5NtlbqPtFbqXSESsg8CbbxUAt4qCCt0TPzL8SeQoauYNmcRQi-59z_ZJx2CNyYV91uJeB5Ih0lRhTOo72Qcr2RIKuWv8c5dOZI-_YbR7pte97Ov2pkKC9Kw6KzTERMB8Q_NWwdGuQ7Od9gsKvaGNjUzr6FxgQWU Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: e6054fc080d149c7ac0d6f9096d0545d Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-VolumesNegativeTest-1422592882 Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6054fc080d149c7ac0d6f9096d0545d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e6054fc080d149c7ac0d6f9096d0545d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e6054fc080d149c7ac0d6f9096d0545d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6054fc080d149c7ac0d6f9096d0545d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-VolumesNegativeTest-1422592882 Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: e6054fc080d149c7ac0d6f9096d0545d Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-VolumesNegativeTest-1422592882 Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-VolumesNegativeTest-1422592882-project Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 8eced8ee4f5e45b19895743896aae2da Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-VolumesNegativeTest-1422592882-project Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: exception: Volume tempest-invalid-1145497989 could not be found. Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'tempest-invalid-1145497989'} Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1145497989 could not be found. (HTTP 404) (Request-ID: req-65041708-351e-4468-939b-98fa221f6e19) Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 24 21:11:14.905961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 21:11:14.909888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 21:11:14.909888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 24 21:11:14.909888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 24 21:11:14.909888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 24 21:11:14.909888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 24 21:11:14.909888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 24 21:11:14.909888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 24 21:11:14.909888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 24 21:11:14.909888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 24 21:11:14.909888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 21:11:14.909888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 21:11:14.909888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 21:11:14.909888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 21:11:14.909888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1145497989 could not be found. Sep 24 21:11:14.909888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:14.909888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:14.909888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:14.909888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:14.909888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:11:14.909888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:11:14.909888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:11:14.909888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:11:14.909888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:11:14.909888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:11:14.909888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:11:14.909888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:11:14.909888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 24 21:11:14.909888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:11:14.909888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1145497989 could not be found. Sep 24 21:11:14.909888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:14.909888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:14.909888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:14.909888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:14.909888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:11:14.909888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:11:14.909888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:11:14.909888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:11:14.909888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1145497989 could not be found. Sep 24 21:11:14.909888 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:14.914223 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b7c1126e-0bc8-4d50-83b6-e952a05a9d5b tempest-VolumesNegativeTest-1422592882 tempest-VolumesNegativeTest-1422592882-project] Returning 404 to user: Volume tempest-invalid-1145497989 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:11:14.915342 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b7c1126e-0bc8-4d50-83b6-e952a05a9d5b tempest-VolumesNegativeTest-1422592882 tempest-VolumesNegativeTest-1422592882-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1145497989" status: 404 len: 99 microversion: 2.1 time: 0.064386 Sep 24 21:11:14.916131 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2535/5057] 10.222.0.52 () {58 vars in 1218 bytes} [Sat Sep 24 21:11:14 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1145497989 => generated 99 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 21:11:14.932120 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-87321768-cfb6-4344-98d8-ba79916c84e9 tempest-VolumesNegativeTest-1422592882 tempest-VolumesNegativeTest-1422592882-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008386 Sep 24 21:11:14.944138 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2536/5058] 10.222.0.52 () {58 vars in 1140 bytes} [Sat Sep 24 21:11:14 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 20 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 24 21:11:14.955156 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2550a896-7313-4c06-9603-5059a80c8b4a tempest-VolumesNegativeTest-1422592882 tempest-VolumesNegativeTest-1422592882-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004053 Sep 24 21:11:14.956087 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2537/5059] 10.222.0.52 () {58 vars in 1137 bytes} [Sat Sep 24 21:11:14 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 24 21:11:14.969022 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-55af9593-4513-408b-9196-ee19f88727d8 tempest-VolumesNegativeTest-1422592882 tempest-VolumesNegativeTest-1422592882-project] Calling method '.version_select at 0x7f4b0c8894c0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:15.015030 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-55af9593-4513-408b-9196-ee19f88727d8 tempest-VolumesNegativeTest-1422592882 tempest-VolumesNegativeTest-1422592882-project] HTTP exception thrown: Volume 44b93b22-4fd0-471e-9f4b-199738879397 could not be found. Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-55af9593-4513-408b-9196-ee19f88727d8 tempest-VolumesNegativeTest-1422592882 tempest-VolumesNegativeTest-1422592882-project] Request method failure captured: Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/os-volumes/44b93b22-4fd0-471e-9f4b-199738879397 HTTP/1.1 Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3JxPLqt_apq6Xjm5NtlbqPtFbqXSESsg8CbbxUAt4qCCt0TPzL8SeQoauYNmcRQi-59z_ZJx2CNyYV91uJeB5Ih0lRhTOo72Qcr2RIKuWv8c5dOZI-_YbR7pte97Ov2pkKC9Kw6KzTERMB8Q_NWwdGuQ7Od9gsKvaGNjUzr6FxgQWU Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: e6054fc080d149c7ac0d6f9096d0545d Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-VolumesNegativeTest-1422592882 Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6054fc080d149c7ac0d6f9096d0545d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e6054fc080d149c7ac0d6f9096d0545d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e6054fc080d149c7ac0d6f9096d0545d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6054fc080d149c7ac0d6f9096d0545d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-VolumesNegativeTest-1422592882 Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: e6054fc080d149c7ac0d6f9096d0545d Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-VolumesNegativeTest-1422592882 Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-VolumesNegativeTest-1422592882-project Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 8eced8ee4f5e45b19895743896aae2da Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-VolumesNegativeTest-1422592882-project Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: exception: Volume 44b93b22-4fd0-471e-9f4b-199738879397 could not be found. Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '44b93b22-4fd0-471e-9f4b-199738879397'} Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 44b93b22-4fd0-471e-9f4b-199738879397 could not be found. (HTTP 404) (Request-ID: req-c5891271-dd76-43b1-9c1a-fa76bbc55f6f) Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 24 21:11:15.017066 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 21:11:15.022530 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 21:11:15.022530 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 24 21:11:15.022530 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 24 21:11:15.022530 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 24 21:11:15.022530 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 24 21:11:15.022530 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 24 21:11:15.022530 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 24 21:11:15.022530 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 24 21:11:15.022530 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 24 21:11:15.022530 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 21:11:15.022530 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 21:11:15.022530 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 21:11:15.022530 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 21:11:15.022530 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 44b93b22-4fd0-471e-9f4b-199738879397 could not be found. Sep 24 21:11:15.022530 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:15.022530 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:15.022530 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:15.022530 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:15.022530 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:11:15.022530 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:11:15.022530 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:11:15.022530 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:11:15.022530 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:11:15.022530 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:11:15.022530 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:11:15.022530 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:11:15.022530 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 24 21:11:15.022530 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:11:15.022530 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 44b93b22-4fd0-471e-9f4b-199738879397 could not be found. Sep 24 21:11:15.022530 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:15.022530 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:15.022530 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:15.022530 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:15.022530 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:11:15.022530 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:11:15.022530 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:11:15.022530 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:11:15.022530 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 44b93b22-4fd0-471e-9f4b-199738879397 could not be found. Sep 24 21:11:15.022530 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:15.026705 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-55af9593-4513-408b-9196-ee19f88727d8 tempest-VolumesNegativeTest-1422592882 tempest-VolumesNegativeTest-1422592882-project] Returning 404 to user: Volume 44b93b22-4fd0-471e-9f4b-199738879397 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:11:15.031377 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-55af9593-4513-408b-9196-ee19f88727d8 tempest-VolumesNegativeTest-1422592882 tempest-VolumesNegativeTest-1422592882-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/44b93b22-4fd0-471e-9f4b-199738879397" status: 404 len: 109 microversion: 2.1 time: 0.062505 Sep 24 21:11:15.032137 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2538/5060] 10.222.0.52 () {58 vars in 1248 bytes} [Sat Sep 24 21:11:14 2022] DELETE /compute/v2.1/os-volumes/44b93b22-4fd0-471e-9f4b-199738879397 => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 21:11:15.045457 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-60746ec9-a83d-4ecc-8be2-4055d6d87a5a tempest-VolumesNegativeTest-1422592882 tempest-VolumesNegativeTest-1422592882-project] Calling method '.version_select at 0x7f4b074a8e50>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:15.129903 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-60746ec9-a83d-4ecc-8be2-4055d6d87a5a tempest-VolumesNegativeTest-1422592882 tempest-VolumesNegativeTest-1422592882-project] HTTP exception thrown: Volume 322e5394-ca1d-4c27-b19b-0742f75e44c6 could not be found. Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-60746ec9-a83d-4ecc-8be2-4055d6d87a5a tempest-VolumesNegativeTest-1422592882 tempest-VolumesNegativeTest-1422592882-project] Request method failure captured: Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/os-volumes/322e5394-ca1d-4c27-b19b-0742f75e44c6 HTTP/1.1 Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3JxPLqt_apq6Xjm5NtlbqPtFbqXSESsg8CbbxUAt4qCCt0TPzL8SeQoauYNmcRQi-59z_ZJx2CNyYV91uJeB5Ih0lRhTOo72Qcr2RIKuWv8c5dOZI-_YbR7pte97Ov2pkKC9Kw6KzTERMB8Q_NWwdGuQ7Od9gsKvaGNjUzr6FxgQWU Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: e6054fc080d149c7ac0d6f9096d0545d Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-VolumesNegativeTest-1422592882 Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6054fc080d149c7ac0d6f9096d0545d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e6054fc080d149c7ac0d6f9096d0545d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e6054fc080d149c7ac0d6f9096d0545d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6054fc080d149c7ac0d6f9096d0545d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-VolumesNegativeTest-1422592882 Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: e6054fc080d149c7ac0d6f9096d0545d Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-VolumesNegativeTest-1422592882 Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-VolumesNegativeTest-1422592882-project Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 8eced8ee4f5e45b19895743896aae2da Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-VolumesNegativeTest-1422592882-project Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: exception: Volume 322e5394-ca1d-4c27-b19b-0742f75e44c6 could not be found. Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '322e5394-ca1d-4c27-b19b-0742f75e44c6'} Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 322e5394-ca1d-4c27-b19b-0742f75e44c6 could not be found. (HTTP 404) (Request-ID: req-7140fc1b-1bf5-4be5-9c3a-b762ea970d0b) Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 24 21:11:15.133519 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 21:11:15.138099 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 21:11:15.138099 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 24 21:11:15.138099 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 24 21:11:15.138099 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 24 21:11:15.138099 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 24 21:11:15.138099 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 21:11:15.138099 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 21:11:15.138099 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 21:11:15.138099 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 21:11:15.138099 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 21:11:15.138099 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 21:11:15.138099 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 21:11:15.138099 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 21:11:15.138099 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 322e5394-ca1d-4c27-b19b-0742f75e44c6 could not be found. Sep 24 21:11:15.138099 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:15.138099 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:15.138099 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:15.138099 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:15.138099 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:11:15.138099 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:11:15.138099 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:11:15.138099 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:11:15.138099 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:11:15.138099 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:11:15.138099 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:11:15.138099 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:11:15.138099 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 24 21:11:15.138099 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:11:15.138099 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 322e5394-ca1d-4c27-b19b-0742f75e44c6 could not be found. Sep 24 21:11:15.138099 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:15.138099 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:15.138099 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:15.138099 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:15.138099 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:11:15.138099 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:11:15.138099 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:11:15.138099 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:11:15.138099 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 322e5394-ca1d-4c27-b19b-0742f75e44c6 could not be found. Sep 24 21:11:15.138099 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:15.147503 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-60746ec9-a83d-4ecc-8be2-4055d6d87a5a tempest-VolumesNegativeTest-1422592882 tempest-VolumesNegativeTest-1422592882-project] Returning 404 to user: Volume 322e5394-ca1d-4c27-b19b-0742f75e44c6 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:11:15.147503 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-60746ec9-a83d-4ecc-8be2-4055d6d87a5a tempest-VolumesNegativeTest-1422592882 tempest-VolumesNegativeTest-1422592882-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/322e5394-ca1d-4c27-b19b-0742f75e44c6" status: 404 len: 109 microversion: 2.1 time: 0.099886 Sep 24 21:11:15.147503 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2539/5061] 10.222.0.52 () {58 vars in 1245 bytes} [Sat Sep 24 21:11:15 2022] GET /compute/v2.1/os-volumes/322e5394-ca1d-4c27-b19b-0742f75e44c6 => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 21:11:15.560251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c928ada3-c290-402e-a726-6587d006c765 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:15.588450 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c928ada3-c290-402e-a726-6587d006c765 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1519 microversion: 2.1 time: 0.794421 Sep 24 21:11:15.590882 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2523/5062] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:14 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1519 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:11:16.614104 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-274624da-9f11-41db-a5f1-cdcb0e98c570 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:16.615519 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-274624da-9f11-41db-a5f1-cdcb0e98c570 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:16.617814 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:11:16.637730 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-274624da-9f11-41db-a5f1-cdcb0e98c570 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:16.638567 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-274624da-9f11-41db-a5f1-cdcb0e98c570 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:16.639250 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-274624da-9f11-41db-a5f1-cdcb0e98c570 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:16.640238 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-274624da-9f11-41db-a5f1-cdcb0e98c570 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:16.642290 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-274624da-9f11-41db-a5f1-cdcb0e98c570 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:16.643037 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-274624da-9f11-41db-a5f1-cdcb0e98c570 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:17.335679 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-274624da-9f11-41db-a5f1-cdcb0e98c570 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:17.348461 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-274624da-9f11-41db-a5f1-cdcb0e98c570 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1519 microversion: 2.1 time: 0.737656 Sep 24 21:11:17.352023 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2540/5063] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:16 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1519 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:11:18.380138 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-77188685-1d7f-4cf4-a64f-4bc2fac8c855 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:18.382335 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-77188685-1d7f-4cf4-a64f-4bc2fac8c855 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:18.398976 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-77188685-1d7f-4cf4-a64f-4bc2fac8c855 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:18.400900 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-77188685-1d7f-4cf4-a64f-4bc2fac8c855 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:18.402847 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-77188685-1d7f-4cf4-a64f-4bc2fac8c855 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:18.405968 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-77188685-1d7f-4cf4-a64f-4bc2fac8c855 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:18.407703 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-77188685-1d7f-4cf4-a64f-4bc2fac8c855 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:18.408349 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-77188685-1d7f-4cf4-a64f-4bc2fac8c855 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:19.208834 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-63a02cba-3fff-4728-9fca-f535c280aaed req-2acfb88c-7b3d-4ac0-ae87-efe9835721f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3fcc34d-d09a-4475-bd96-51ac0074cb5f", "name": "network-vif-plugged", "status": "completed", "tag": "2ca29bee-7747-4b85-b335-ac8c4538a67e"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:11:19.235233 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-63a02cba-3fff-4728-9fca-f535c280aaed req-2acfb88c-7b3d-4ac0-ae87-efe9835721f0 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:19.239877 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-63a02cba-3fff-4728-9fca-f535c280aaed req-2acfb88c-7b3d-4ac0-ae87-efe9835721f0 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:19.241778 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-63a02cba-3fff-4728-9fca-f535c280aaed req-2acfb88c-7b3d-4ac0-ae87-efe9835721f0 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:19.276747 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-63a02cba-3fff-4728-9fca-f535c280aaed req-2acfb88c-7b3d-4ac0-ae87-efe9835721f0 service nova] Creating event network-vif-plugged:2ca29bee-7747-4b85-b335-ac8c4538a67e for instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f on nch1-master-1 Sep 24 21:11:19.289492 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-63a02cba-3fff-4728-9fca-f535c280aaed req-2acfb88c-7b3d-4ac0-ae87-efe9835721f0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084622 Sep 24 21:11:19.294966 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2541/5064] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:11:19.543115 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-77188685-1d7f-4cf4-a64f-4bc2fac8c855 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:19.558265 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-77188685-1d7f-4cf4-a64f-4bc2fac8c855 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1519 microversion: 2.1 time: 1.188681 Sep 24 21:11:19.575643 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2524/5065] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:18 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1519 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:11:20.592266 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6a09b09f-e8cd-4db5-b50c-c95c6028186e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:20.592996 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6a09b09f-e8cd-4db5-b50c-c95c6028186e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:20.620117 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6a09b09f-e8cd-4db5-b50c-c95c6028186e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:20.622425 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6a09b09f-e8cd-4db5-b50c-c95c6028186e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:20.627155 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6a09b09f-e8cd-4db5-b50c-c95c6028186e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:20.633320 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6a09b09f-e8cd-4db5-b50c-c95c6028186e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:20.638742 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6a09b09f-e8cd-4db5-b50c-c95c6028186e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:20.642722 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6a09b09f-e8cd-4db5-b50c-c95c6028186e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:21.263625 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6a09b09f-e8cd-4db5-b50c-c95c6028186e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:21.286292 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6a09b09f-e8cd-4db5-b50c-c95c6028186e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1519 microversion: 2.1 time: 0.700414 Sep 24 21:11:21.288626 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2542/5066] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:20 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1519 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:11:22.310941 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9d8bf174-1f20-432b-b3ee-2b61ed035c49 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:22.314174 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9d8bf174-1f20-432b-b3ee-2b61ed035c49 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:22.347523 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d8bf174-1f20-432b-b3ee-2b61ed035c49 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:22.352315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d8bf174-1f20-432b-b3ee-2b61ed035c49 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:22.353206 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d8bf174-1f20-432b-b3ee-2b61ed035c49 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:22.358288 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d8bf174-1f20-432b-b3ee-2b61ed035c49 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:22.359417 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d8bf174-1f20-432b-b3ee-2b61ed035c49 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:22.362236 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d8bf174-1f20-432b-b3ee-2b61ed035c49 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:23.206160 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9d8bf174-1f20-432b-b3ee-2b61ed035c49 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:23.264610 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9d8bf174-1f20-432b-b3ee-2b61ed035c49 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1519 microversion: 2.1 time: 0.955269 Sep 24 21:11:23.280875 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2525/5067] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:22 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1519 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:11:24.293325 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a3a205b2-0eba-4b7d-97ec-5d160a517081 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:24.299865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a3a205b2-0eba-4b7d-97ec-5d160a517081 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:24.316791 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a3a205b2-0eba-4b7d-97ec-5d160a517081 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:24.319951 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a3a205b2-0eba-4b7d-97ec-5d160a517081 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:24.321648 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a3a205b2-0eba-4b7d-97ec-5d160a517081 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:24.323629 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a3a205b2-0eba-4b7d-97ec-5d160a517081 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:24.324430 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a3a205b2-0eba-4b7d-97ec-5d160a517081 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:24.325458 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a3a205b2-0eba-4b7d-97ec-5d160a517081 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:24.644536 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a3a205b2-0eba-4b7d-97ec-5d160a517081 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:24.653523 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a3a205b2-0eba-4b7d-97ec-5d160a517081 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.367140 Sep 24 21:11:24.660978 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2543/5068] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:24 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:11:24.682814 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fe89128f-0517-4d8a-a8a6-8e1ba16cda01 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:24.684839 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fe89128f-0517-4d8a-a8a6-8e1ba16cda01 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:24.694967 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fe89128f-0517-4d8a-a8a6-8e1ba16cda01 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:24.695960 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fe89128f-0517-4d8a-a8a6-8e1ba16cda01 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:24.696639 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fe89128f-0517-4d8a-a8a6-8e1ba16cda01 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:24.697805 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fe89128f-0517-4d8a-a8a6-8e1ba16cda01 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:24.698542 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fe89128f-0517-4d8a-a8a6-8e1ba16cda01 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:24.699203 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fe89128f-0517-4d8a-a8a6-8e1ba16cda01 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:25.021190 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fe89128f-0517-4d8a-a8a6-8e1ba16cda01 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:25.031268 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fe89128f-0517-4d8a-a8a6-8e1ba16cda01 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.353693 Sep 24 21:11:25.035539 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2526/5069] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:24 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:11:25.068125 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e65ee8ab-5e90-47f1-b4aa-974fba277164 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:25.069096 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e65ee8ab-5e90-47f1-b4aa-974fba277164 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:25.075994 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e65ee8ab-5e90-47f1-b4aa-974fba277164 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:25.076660 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e65ee8ab-5e90-47f1-b4aa-974fba277164 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:25.077487 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e65ee8ab-5e90-47f1-b4aa-974fba277164 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:25.078904 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e65ee8ab-5e90-47f1-b4aa-974fba277164 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:25.079522 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e65ee8ab-5e90-47f1-b4aa-974fba277164 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:25.079791 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e65ee8ab-5e90-47f1-b4aa-974fba277164 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:25.362116 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e65ee8ab-5e90-47f1-b4aa-974fba277164 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:25.372880 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e65ee8ab-5e90-47f1-b4aa-974fba277164 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.309610 Sep 24 21:11:25.373479 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2544/5070] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:25 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:11:25.399176 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e45ee417-1b56-4e79-a5eb-6b7684f8fb8c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:11:25.413443 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-e45ee417-1b56-4e79-a5eb-6b7684f8fb8c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] HTTP exception thrown: Instance 5a545352-8c23-4c59-b8c3-fe6dd83eab95 has no mapping to a cell. Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e45ee417-1b56-4e79-a5eb-6b7684f8fb8c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/servers/5a545352-8c23-4c59-b8c3-fe6dd83eab95/action HTTP/1.1 Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 15 Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: {"os-stop": {}} Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 5a545352-8c23-4c59-b8c3-fe6dd83eab95 has no mapping to a cell. Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '5a545352-8c23-4c59-b8c3-fe6dd83eab95', 'body': {'os-stop': {}}} Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 5a545352-8c23-4c59-b8c3-fe6dd83eab95 has no mapping to a cell. Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:11:25.426091 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a545352-8c23-4c59-b8c3-fe6dd83eab95 has no mapping to a cell. Sep 24 21:11:25.430968 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:11:25.430968 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:25.430968 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:11:25.430968 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:25.430968 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:11:25.430968 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:11:25.430968 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:11:25.430968 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:11:25.430968 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a545352-8c23-4c59-b8c3-fe6dd83eab95 has no mapping to a cell. Sep 24 21:11:25.430968 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:11:25.430968 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e45ee417-1b56-4e79-a5eb-6b7684f8fb8c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 404 to user: Instance 5a545352-8c23-4c59-b8c3-fe6dd83eab95 has no mapping to a cell. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:11:25.430968 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e45ee417-1b56-4e79-a5eb-6b7684f8fb8c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers/5a545352-8c23-4c59-b8c3-fe6dd83eab95/action" status: 404 len: 117 microversion: 2.1 time: 0.034643 Sep 24 21:11:25.430968 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2527/5071] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:11:25 2022] POST /compute/v2.1/servers/5a545352-8c23-4c59-b8c3-fe6dd83eab95/action => generated 117 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:11:25.437234 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f2304620-85dc-4a68-aeb1-06dc2866d414 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:25.437864 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f2304620-85dc-4a68-aeb1-06dc2866d414 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:25.447021 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f2304620-85dc-4a68-aeb1-06dc2866d414 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:25.447525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f2304620-85dc-4a68-aeb1-06dc2866d414 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:25.447963 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f2304620-85dc-4a68-aeb1-06dc2866d414 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:25.449674 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f2304620-85dc-4a68-aeb1-06dc2866d414 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:25.450332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f2304620-85dc-4a68-aeb1-06dc2866d414 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:25.450964 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f2304620-85dc-4a68-aeb1-06dc2866d414 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:25.846735 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f2304620-85dc-4a68-aeb1-06dc2866d414 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:25.860856 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f2304620-85dc-4a68-aeb1-06dc2866d414 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.427486 Sep 24 21:11:25.864456 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2545/5072] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:25 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:11:25.887601 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cbc5a906-47f3-41b4-ba5b-63e46c8ea61f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:25.888222 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cbc5a906-47f3-41b4-ba5b-63e46c8ea61f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:25.905938 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cbc5a906-47f3-41b4-ba5b-63e46c8ea61f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:25.906741 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cbc5a906-47f3-41b4-ba5b-63e46c8ea61f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:25.907627 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cbc5a906-47f3-41b4-ba5b-63e46c8ea61f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:25.908550 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cbc5a906-47f3-41b4-ba5b-63e46c8ea61f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:25.909246 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cbc5a906-47f3-41b4-ba5b-63e46c8ea61f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:25.909836 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cbc5a906-47f3-41b4-ba5b-63e46c8ea61f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:26.234112 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cbc5a906-47f3-41b4-ba5b-63e46c8ea61f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:26.247212 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cbc5a906-47f3-41b4-ba5b-63e46c8ea61f tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.360234 Sep 24 21:11:26.247954 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2528/5073] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:25 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:11:26.279717 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-140b0ec2-0efd-4a69-82f4-83715adb122d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:11:26.280612 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-140b0ec2-0efd-4a69-82f4-83715adb122d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: a66078ef-1a00-4752-abe2-e9afd7672dd0] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:26.295477 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-140b0ec2-0efd-4a69-82f4-83715adb122d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] HTTP exception thrown: Instance a66078ef-1a00-4752-abe2-e9afd7672dd0 could not be found. Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-140b0ec2-0efd-4a69-82f4-83715adb122d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers/a66078ef-1a00-4752-abe2-e9afd7672dd0/action HTTP/1.1 Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 15 Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: {"suspend": {}} Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance a66078ef-1a00-4752-abe2-e9afd7672dd0 could not be found. Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'a66078ef-1a00-4752-abe2-e9afd7672dd0', 'body': {'suspend': {}}} Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a66078ef-1a00-4752-abe2-e9afd7672dd0 could not be found. Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a66078ef-1a00-4752-abe2-e9afd7672dd0 could not be found. Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:11:26.299533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:11:26.308563 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:11:26.308563 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:11:26.308563 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a66078ef-1a00-4752-abe2-e9afd7672dd0 could not be found. Sep 24 21:11:26.308563 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:26.308563 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-140b0ec2-0efd-4a69-82f4-83715adb122d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 404 to user: Instance a66078ef-1a00-4752-abe2-e9afd7672dd0 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:11:26.308563 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-140b0ec2-0efd-4a69-82f4-83715adb122d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers/a66078ef-1a00-4752-abe2-e9afd7672dd0/action" status: 404 len: 111 microversion: 2.1 time: 0.031813 Sep 24 21:11:26.308563 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2546/5074] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:11:26 2022] POST /compute/v2.1/servers/a66078ef-1a00-4752-abe2-e9afd7672dd0/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:11:26.323634 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4f85362e-6da5-45ed-9b39-c6182f880192 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:26.326619 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4f85362e-6da5-45ed-9b39-c6182f880192 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:26.336885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f85362e-6da5-45ed-9b39-c6182f880192 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:26.344829 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f85362e-6da5-45ed-9b39-c6182f880192 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:26.345626 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f85362e-6da5-45ed-9b39-c6182f880192 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:26.346659 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f85362e-6da5-45ed-9b39-c6182f880192 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:26.350868 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f85362e-6da5-45ed-9b39-c6182f880192 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:26.351613 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f85362e-6da5-45ed-9b39-c6182f880192 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:26.665917 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4f85362e-6da5-45ed-9b39-c6182f880192 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:26.668363 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=60 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:11:26.675939 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4f85362e-6da5-45ed-9b39-c6182f880192 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.366866 Sep 24 21:11:26.679595 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2529/5075] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:26 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:11:26.704246 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-409e369b-cea5-4133-b467-d84360dceae1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:26.704838 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-409e369b-cea5-4133-b467-d84360dceae1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:26.720661 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-409e369b-cea5-4133-b467-d84360dceae1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:26.725029 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-409e369b-cea5-4133-b467-d84360dceae1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:26.726098 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-409e369b-cea5-4133-b467-d84360dceae1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:26.727049 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-409e369b-cea5-4133-b467-d84360dceae1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:26.731415 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-409e369b-cea5-4133-b467-d84360dceae1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:26.732063 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-409e369b-cea5-4133-b467-d84360dceae1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:27.030650 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-409e369b-cea5-4133-b467-d84360dceae1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:27.040425 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-409e369b-cea5-4133-b467-d84360dceae1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.340594 Sep 24 21:11:27.041657 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2547/5076] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:26 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:11:27.065426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-36f68c9f-de69-43ac-b938-ecae13eed231 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:11:27.066002 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-36f68c9f-de69-43ac-b938-ecae13eed231 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:27.076559 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36f68c9f-de69-43ac-b938-ecae13eed231 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:27.077296 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36f68c9f-de69-43ac-b938-ecae13eed231 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:27.083132 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36f68c9f-de69-43ac-b938-ecae13eed231 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:27.085459 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36f68c9f-de69-43ac-b938-ecae13eed231 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:27.086118 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36f68c9f-de69-43ac-b938-ecae13eed231 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:27.086860 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36f68c9f-de69-43ac-b938-ecae13eed231 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:27.123946 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-36f68c9f-de69-43ac-b938-ecae13eed231 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lazy-loading 'flavor' on Instance uuid f3fcc34d-d09a-4475-bd96-51ac0074cb5f {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:11:27.233277 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-36f68c9f-de69-43ac-b938-ecae13eed231 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f/action" status: 202 len: 0 microversion: 2.1 time: 0.172267 Sep 24 21:11:27.234382 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2530/5077] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:11:27 2022] POST /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:11:27.248239 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e846b348-b840-4359-8b03-ce90fa9f2727 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:27.248827 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e846b348-b840-4359-8b03-ce90fa9f2727 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:27.270370 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e846b348-b840-4359-8b03-ce90fa9f2727 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:27.275144 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e846b348-b840-4359-8b03-ce90fa9f2727 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:27.275719 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e846b348-b840-4359-8b03-ce90fa9f2727 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:27.278290 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e846b348-b840-4359-8b03-ce90fa9f2727 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:27.279039 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e846b348-b840-4359-8b03-ce90fa9f2727 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:27.279920 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e846b348-b840-4359-8b03-ce90fa9f2727 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:27.576801 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e846b348-b840-4359-8b03-ce90fa9f2727 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:27.585270 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e846b348-b840-4359-8b03-ce90fa9f2727 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1514 microversion: 2.1 time: 0.347031 Sep 24 21:11:27.605695 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2548/5078] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:27 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1514 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:11:28.615190 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b6cbd2c4-f6e1-4974-b52a-7cbbf39d017d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:28.616008 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b6cbd2c4-f6e1-4974-b52a-7cbbf39d017d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:28.633068 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6cbd2c4-f6e1-4974-b52a-7cbbf39d017d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:28.633641 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6cbd2c4-f6e1-4974-b52a-7cbbf39d017d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:28.634160 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6cbd2c4-f6e1-4974-b52a-7cbbf39d017d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:28.634983 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6cbd2c4-f6e1-4974-b52a-7cbbf39d017d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:28.638575 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6cbd2c4-f6e1-4974-b52a-7cbbf39d017d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:28.639874 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6cbd2c4-f6e1-4974-b52a-7cbbf39d017d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:29.214736 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b6cbd2c4-f6e1-4974-b52a-7cbbf39d017d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:29.228960 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b6cbd2c4-f6e1-4974-b52a-7cbbf39d017d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1497 microversion: 2.1 time: 0.619165 Sep 24 21:11:29.244132 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2531/5079] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:28 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1497 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:11:29.258708 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c81294d8-039f-4573-9b98-04bbd56ae4aa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:11:29.259795 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c81294d8-039f-4573-9b98-04bbd56ae4aa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:29.272287 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c81294d8-039f-4573-9b98-04bbd56ae4aa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:29.272998 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c81294d8-039f-4573-9b98-04bbd56ae4aa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:29.273786 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c81294d8-039f-4573-9b98-04bbd56ae4aa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:29.276960 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c81294d8-039f-4573-9b98-04bbd56ae4aa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:29.279216 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c81294d8-039f-4573-9b98-04bbd56ae4aa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:29.279780 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c81294d8-039f-4573-9b98-04bbd56ae4aa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:29.317673 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=74 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:11:29.323213 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-c81294d8-039f-4573-9b98-04bbd56ae4aa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lazy-loading 'flavor' on Instance uuid f3fcc34d-d09a-4475-bd96-51ac0074cb5f {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:11:29.339331 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-c81294d8-039f-4573-9b98-04bbd56ae4aa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] HTTP exception thrown: Cannot 'suspend' instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f while it is in vm_state suspended Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c81294d8-039f-4573-9b98-04bbd56ae4aa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f/action HTTP/1.1 Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 15 Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: {"suspend": {}} Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: exception: Cannot 'suspend' instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f while it is in vm_state suspended Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'f3fcc34d-d09a-4475-bd96-51ac0074cb5f', 'body': {'suspend': {}}} Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f in vm_state suspended. Cannot suspend while the instance is in this state. Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Sep 24 21:11:29.341572 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 24 21:11:29.346238 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 24 21:11:29.346238 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 24 21:11:29.346238 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f while it is in vm_state suspended Sep 24 21:11:29.346238 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:29.346238 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:29.346238 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:29.346238 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:29.346238 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:11:29.346238 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:11:29.346238 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:11:29.346238 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:11:29.346238 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f while it is in vm_state suspended Sep 24 21:11:29.346238 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:29.356857 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c81294d8-039f-4573-9b98-04bbd56ae4aa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 409 to user: Cannot 'suspend' instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f while it is in vm_state suspended {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:11:29.359143 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c81294d8-039f-4573-9b98-04bbd56ae4aa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f/action" status: 409 len: 148 microversion: 2.1 time: 0.105175 Sep 24 21:11:29.370863 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e49c85fc-0a2d-4f1b-9c9f-fdae3b011324 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:11:29.371155 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e49c85fc-0a2d-4f1b-9c9f-fdae3b011324 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:29.378287 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2549/5080] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:11:29 2022] POST /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f/action => generated 148 bytes in 125 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 24 21:11:29.382169 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e49c85fc-0a2d-4f1b-9c9f-fdae3b011324 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:29.383067 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e49c85fc-0a2d-4f1b-9c9f-fdae3b011324 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:29.383572 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e49c85fc-0a2d-4f1b-9c9f-fdae3b011324 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:29.384818 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e49c85fc-0a2d-4f1b-9c9f-fdae3b011324 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:29.385283 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e49c85fc-0a2d-4f1b-9c9f-fdae3b011324 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:29.386169 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e49c85fc-0a2d-4f1b-9c9f-fdae3b011324 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:29.531363 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e49c85fc-0a2d-4f1b-9c9f-fdae3b011324 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f/action" status: 202 len: 0 microversion: 2.1 time: 0.164111 Sep 24 21:11:29.544831 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-252ade86-13a6-4007-beeb-02c4538d1265 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:29.546003 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-252ade86-13a6-4007-beeb-02c4538d1265 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:29.549341 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2532/5081] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:11:29 2022] POST /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:11:29.566015 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-252ade86-13a6-4007-beeb-02c4538d1265 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:29.569103 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-252ade86-13a6-4007-beeb-02c4538d1265 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:29.570063 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-252ade86-13a6-4007-beeb-02c4538d1265 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:29.571579 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-252ade86-13a6-4007-beeb-02c4538d1265 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:29.574653 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-252ade86-13a6-4007-beeb-02c4538d1265 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:29.575782 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-252ade86-13a6-4007-beeb-02c4538d1265 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:30.988625 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-252ade86-13a6-4007-beeb-02c4538d1265 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:31.010520 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-252ade86-13a6-4007-beeb-02c4538d1265 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1503 microversion: 2.1 time: 1.471164 Sep 24 21:11:31.011132 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2550/5082] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:29 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1503 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:11:32.039326 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a7d475fe-d144-4056-9089-ea73d1a7fbb7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:32.041154 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a7d475fe-d144-4056-9089-ea73d1a7fbb7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:32.058235 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a7d475fe-d144-4056-9089-ea73d1a7fbb7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:32.061298 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a7d475fe-d144-4056-9089-ea73d1a7fbb7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:32.061624 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a7d475fe-d144-4056-9089-ea73d1a7fbb7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:32.062376 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a7d475fe-d144-4056-9089-ea73d1a7fbb7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:32.066127 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a7d475fe-d144-4056-9089-ea73d1a7fbb7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:32.066635 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a7d475fe-d144-4056-9089-ea73d1a7fbb7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:32.893412 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a7d475fe-d144-4056-9089-ea73d1a7fbb7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:32.905443 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a7d475fe-d144-4056-9089-ea73d1a7fbb7 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1503 microversion: 2.1 time: 0.871278 Sep 24 21:11:32.920731 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2533/5083] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:32 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1503 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:11:33.938774 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c0c6de30-e40d-47a3-9048-55a00748f96e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:33.939403 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c0c6de30-e40d-47a3-9048-55a00748f96e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:33.968646 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0c6de30-e40d-47a3-9048-55a00748f96e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:33.971596 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0c6de30-e40d-47a3-9048-55a00748f96e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:33.972116 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0c6de30-e40d-47a3-9048-55a00748f96e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:33.976376 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0c6de30-e40d-47a3-9048-55a00748f96e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:33.976887 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0c6de30-e40d-47a3-9048-55a00748f96e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:33.979267 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0c6de30-e40d-47a3-9048-55a00748f96e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:34.408336 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c0c6de30-e40d-47a3-9048-55a00748f96e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:34.421797 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c0c6de30-e40d-47a3-9048-55a00748f96e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.489206 Sep 24 21:11:34.438566 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2551/5084] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:33 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:11:34.451627 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-95f1ce13-d1b5-463e-8525-2685c2f4e34b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:34.452883 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-95f1ce13-d1b5-463e-8525-2685c2f4e34b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:34.462191 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-95f1ce13-d1b5-463e-8525-2685c2f4e34b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:34.462742 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-95f1ce13-d1b5-463e-8525-2685c2f4e34b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:34.463189 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-95f1ce13-d1b5-463e-8525-2685c2f4e34b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:34.463913 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-95f1ce13-d1b5-463e-8525-2685c2f4e34b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:34.470050 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-95f1ce13-d1b5-463e-8525-2685c2f4e34b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:34.470623 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-95f1ce13-d1b5-463e-8525-2685c2f4e34b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:34.773810 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-95f1ce13-d1b5-463e-8525-2685c2f4e34b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:34.791384 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-95f1ce13-d1b5-463e-8525-2685c2f4e34b tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.342417 Sep 24 21:11:34.807898 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2534/5085] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:34 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:11:34.820849 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-90776008-709c-4d49-993c-9b16928e2367 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:11:34.821801 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-90776008-709c-4d49-993c-9b16928e2367 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: 334e1d21-3674-4f1e-a732-495a9c695da6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:34.844434 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-90776008-709c-4d49-993c-9b16928e2367 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] HTTP exception thrown: Instance 334e1d21-3674-4f1e-a732-495a9c695da6 could not be found. Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-90776008-709c-4d49-993c-9b16928e2367 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers/334e1d21-3674-4f1e-a732-495a9c695da6/action HTTP/1.1 Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 15 Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: {"unpause": {}} Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 334e1d21-3674-4f1e-a732-495a9c695da6 could not be found. Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '334e1d21-3674-4f1e-a732-495a9c695da6', 'body': {'unpause': {}}} Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 334e1d21-3674-4f1e-a732-495a9c695da6 could not be found. Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 334e1d21-3674-4f1e-a732-495a9c695da6 could not be found. Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:11:34.850331 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:11:34.857356 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:11:34.857356 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:11:34.857356 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 334e1d21-3674-4f1e-a732-495a9c695da6 could not be found. Sep 24 21:11:34.857356 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:34.858094 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-90776008-709c-4d49-993c-9b16928e2367 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 404 to user: Instance 334e1d21-3674-4f1e-a732-495a9c695da6 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:11:34.861784 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-90776008-709c-4d49-993c-9b16928e2367 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers/334e1d21-3674-4f1e-a732-495a9c695da6/action" status: 404 len: 111 microversion: 2.1 time: 0.046354 Sep 24 21:11:34.872926 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7ddb35d8-980f-40d8-94c4-88a9a7a72258 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:34.873569 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7ddb35d8-980f-40d8-94c4-88a9a7a72258 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:34.883297 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2552/5086] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:11:34 2022] POST /compute/v2.1/servers/334e1d21-3674-4f1e-a732-495a9c695da6/action => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:11:34.895623 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ddb35d8-980f-40d8-94c4-88a9a7a72258 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:34.898682 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ddb35d8-980f-40d8-94c4-88a9a7a72258 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:34.901604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ddb35d8-980f-40d8-94c4-88a9a7a72258 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:34.904026 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ddb35d8-980f-40d8-94c4-88a9a7a72258 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:34.910530 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ddb35d8-980f-40d8-94c4-88a9a7a72258 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:34.913067 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ddb35d8-980f-40d8-94c4-88a9a7a72258 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:35.634970 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7ddb35d8-980f-40d8-94c4-88a9a7a72258 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:35.645685 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7ddb35d8-980f-40d8-94c4-88a9a7a72258 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.778291 Sep 24 21:11:35.655505 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2535/5087] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:34 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:11:35.683722 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cb7b8bc2-48de-446e-8afc-0e23b336062c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:35.684509 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cb7b8bc2-48de-446e-8afc-0e23b336062c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:35.703546 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cb7b8bc2-48de-446e-8afc-0e23b336062c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:35.705438 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cb7b8bc2-48de-446e-8afc-0e23b336062c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:35.705438 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cb7b8bc2-48de-446e-8afc-0e23b336062c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:35.705674 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cb7b8bc2-48de-446e-8afc-0e23b336062c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:35.708260 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cb7b8bc2-48de-446e-8afc-0e23b336062c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:35.710215 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cb7b8bc2-48de-446e-8afc-0e23b336062c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:36.368081 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cb7b8bc2-48de-446e-8afc-0e23b336062c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:36.388350 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cb7b8bc2-48de-446e-8afc-0e23b336062c tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.708626 Sep 24 21:11:36.389581 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2553/5088] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:35 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:11:36.416075 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-47146bfd-832d-40e0-b8ac-2490b5f30fd0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:11:36.416622 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-47146bfd-832d-40e0-b8ac-2490b5f30fd0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:36.431674 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47146bfd-832d-40e0-b8ac-2490b5f30fd0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:36.432198 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47146bfd-832d-40e0-b8ac-2490b5f30fd0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:36.432656 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47146bfd-832d-40e0-b8ac-2490b5f30fd0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:36.434080 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47146bfd-832d-40e0-b8ac-2490b5f30fd0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:36.434927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47146bfd-832d-40e0-b8ac-2490b5f30fd0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:36.437127 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-47146bfd-832d-40e0-b8ac-2490b5f30fd0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:36.492798 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-47146bfd-832d-40e0-b8ac-2490b5f30fd0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] HTTP exception thrown: Cannot 'unpause' instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f while it is in vm_state active Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-47146bfd-832d-40e0-b8ac-2490b5f30fd0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f/action HTTP/1.1 Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 15 Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: {"unpause": {}} Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: exception: Cannot 'unpause' instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f while it is in vm_state active Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'f3fcc34d-d09a-4475-bd96-51ac0074cb5f', 'body': {'unpause': {}}} Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f in vm_state active. Cannot unpause while the instance is in this state. Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f while it is in vm_state active Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:36.495659 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:11:36.499840 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:11:36.499840 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:11:36.499840 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:11:36.499840 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f while it is in vm_state active Sep 24 21:11:36.499840 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:11:36.502332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-47146bfd-832d-40e0-b8ac-2490b5f30fd0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 409 to user: Cannot 'unpause' instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f while it is in vm_state active {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:11:36.503326 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-47146bfd-832d-40e0-b8ac-2490b5f30fd0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f/action" status: 409 len: 145 microversion: 2.1 time: 0.091932 Sep 24 21:11:36.515752 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5ba1cfbf-cebe-46be-ba03-701dba419861 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:36.518038 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2536/5089] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:11:36 2022] POST /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f/action => generated 145 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 24 21:11:36.520812 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5ba1cfbf-cebe-46be-ba03-701dba419861 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:36.537485 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ba1cfbf-cebe-46be-ba03-701dba419861 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:36.541942 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ba1cfbf-cebe-46be-ba03-701dba419861 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:36.543265 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ba1cfbf-cebe-46be-ba03-701dba419861 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:36.544251 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ba1cfbf-cebe-46be-ba03-701dba419861 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:36.545961 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ba1cfbf-cebe-46be-ba03-701dba419861 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:36.549095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ba1cfbf-cebe-46be-ba03-701dba419861 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:36.912272 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5ba1cfbf-cebe-46be-ba03-701dba419861 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:36.928073 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5ba1cfbf-cebe-46be-ba03-701dba419861 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.415323 Sep 24 21:11:36.928800 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2554/5090] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:36 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:11:36.957688 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3f35439b-c20a-4714-8f17-541ab361c769 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:36.967413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3f35439b-c20a-4714-8f17-541ab361c769 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:36.983276 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3f35439b-c20a-4714-8f17-541ab361c769 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:36.986912 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3f35439b-c20a-4714-8f17-541ab361c769 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:36.987658 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3f35439b-c20a-4714-8f17-541ab361c769 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:36.988589 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3f35439b-c20a-4714-8f17-541ab361c769 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:36.989914 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3f35439b-c20a-4714-8f17-541ab361c769 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:36.990360 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3f35439b-c20a-4714-8f17-541ab361c769 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:37.290942 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3f35439b-c20a-4714-8f17-541ab361c769 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:37.308194 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3f35439b-c20a-4714-8f17-541ab361c769 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.354113 Sep 24 21:11:37.310617 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2537/5091] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:36 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:11:37.331963 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ddd6a1b6-0be4-49fe-8c12-0053c226b2d3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:11:37.333381 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ddd6a1b6-0be4-49fe-8c12-0053c226b2d3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: c5804c92-0522-424e-8d1d-ba8fc4900a80] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:37.344840 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-ddd6a1b6-0be4-49fe-8c12-0053c226b2d3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] HTTP exception thrown: Instance c5804c92-0522-424e-8d1d-ba8fc4900a80 could not be found. Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ddd6a1b6-0be4-49fe-8c12-0053c226b2d3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers/c5804c92-0522-424e-8d1d-ba8fc4900a80/action HTTP/1.1 Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 18 Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: {"unshelve": null} Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance c5804c92-0522-424e-8d1d-ba8fc4900a80 could not be found. Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'c5804c92-0522-424e-8d1d-ba8fc4900a80', 'body': {'unshelve': None}} Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5804c92-0522-424e-8d1d-ba8fc4900a80 could not be found. Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5804c92-0522-424e-8d1d-ba8fc4900a80 could not be found. Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:37.349646 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:37.361717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:37.361717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:37.361717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:11:37.361717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:11:37.361717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:11:37.361717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:11:37.361717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5804c92-0522-424e-8d1d-ba8fc4900a80 could not be found. Sep 24 21:11:37.361717 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:37.361717 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ddd6a1b6-0be4-49fe-8c12-0053c226b2d3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 404 to user: Instance c5804c92-0522-424e-8d1d-ba8fc4900a80 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:11:37.361717 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ddd6a1b6-0be4-49fe-8c12-0053c226b2d3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers/c5804c92-0522-424e-8d1d-ba8fc4900a80/action" status: 404 len: 111 microversion: 2.1 time: 0.025368 Sep 24 21:11:37.361717 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2555/5092] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:11:37 2022] POST /compute/v2.1/servers/c5804c92-0522-424e-8d1d-ba8fc4900a80/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:11:37.364604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8c1eae54-8bcb-4b65-9f4a-e28bb0b51dd9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:37.365263 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8c1eae54-8bcb-4b65-9f4a-e28bb0b51dd9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:37.374645 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c1eae54-8bcb-4b65-9f4a-e28bb0b51dd9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:37.375676 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c1eae54-8bcb-4b65-9f4a-e28bb0b51dd9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:37.376614 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c1eae54-8bcb-4b65-9f4a-e28bb0b51dd9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:37.380562 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c1eae54-8bcb-4b65-9f4a-e28bb0b51dd9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:37.381115 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c1eae54-8bcb-4b65-9f4a-e28bb0b51dd9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:37.381673 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c1eae54-8bcb-4b65-9f4a-e28bb0b51dd9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:37.662468 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8c1eae54-8bcb-4b65-9f4a-e28bb0b51dd9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:37.675137 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8c1eae54-8bcb-4b65-9f4a-e28bb0b51dd9 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.317379 Sep 24 21:11:37.676422 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2538/5093] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:37 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:11:37.704963 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ef3735f6-d5c8-4fb8-92e7-5ad08b501a98 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:37.705965 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ef3735f6-d5c8-4fb8-92e7-5ad08b501a98 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:37.717503 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef3735f6-d5c8-4fb8-92e7-5ad08b501a98 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:37.718456 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef3735f6-d5c8-4fb8-92e7-5ad08b501a98 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:37.719175 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef3735f6-d5c8-4fb8-92e7-5ad08b501a98 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:37.720147 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef3735f6-d5c8-4fb8-92e7-5ad08b501a98 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:37.720841 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef3735f6-d5c8-4fb8-92e7-5ad08b501a98 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:37.721494 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef3735f6-d5c8-4fb8-92e7-5ad08b501a98 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:37.914154 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ef3735f6-d5c8-4fb8-92e7-5ad08b501a98 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:37.928147 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ef3735f6-d5c8-4fb8-92e7-5ad08b501a98 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.226281 Sep 24 21:11:37.928757 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2556/5094] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:37 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:11:37.951729 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dc594153-7da1-44d7-9a98-c9cea4622254 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:11:37.952669 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-dc594153-7da1-44d7-9a98-c9cea4622254 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:37.959772 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc594153-7da1-44d7-9a98-c9cea4622254 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:37.961224 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc594153-7da1-44d7-9a98-c9cea4622254 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:37.961853 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc594153-7da1-44d7-9a98-c9cea4622254 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:37.962774 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc594153-7da1-44d7-9a98-c9cea4622254 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:37.963410 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc594153-7da1-44d7-9a98-c9cea4622254 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:37.963838 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc594153-7da1-44d7-9a98-c9cea4622254 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:38.469437 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-dc594153-7da1-44d7-9a98-c9cea4622254 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] HTTP exception thrown: Cannot 'unshelve' instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f while it is in vm_state active Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dc594153-7da1-44d7-9a98-c9cea4622254 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f/action HTTP/1.1 Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 18 Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: {"unshelve": null} Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: exception: Cannot 'unshelve' instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f while it is in vm_state active Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'f3fcc34d-d09a-4475-bd96-51ac0074cb5f', 'body': {'unshelve': None}} Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f in vm_state active. Cannot unshelve while the instance is in this state. Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 24 21:11:38.472667 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 24 21:11:38.478767 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f while it is in vm_state active Sep 24 21:11:38.478767 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:11:38.478767 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:38.478767 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:11:38.478767 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:38.478767 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:11:38.478767 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:11:38.478767 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:11:38.478767 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:11:38.478767 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f while it is in vm_state active Sep 24 21:11:38.478767 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:11:38.478767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dc594153-7da1-44d7-9a98-c9cea4622254 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 409 to user: Cannot 'unshelve' instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f while it is in vm_state active {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:11:38.478767 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-dc594153-7da1-44d7-9a98-c9cea4622254 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "POST /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f/action" status: 409 len: 146 microversion: 2.1 time: 0.526956 Sep 24 21:11:38.478767 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2539/5095] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:11:37 2022] POST /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f/action => generated 146 bytes in 528 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 24 21:11:38.485724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9226fc85-5383-4070-ad5b-734dbcea5204 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:38.486356 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9226fc85-5383-4070-ad5b-734dbcea5204 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:38.501907 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9226fc85-5383-4070-ad5b-734dbcea5204 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:38.502417 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9226fc85-5383-4070-ad5b-734dbcea5204 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:38.508582 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9226fc85-5383-4070-ad5b-734dbcea5204 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:38.509943 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9226fc85-5383-4070-ad5b-734dbcea5204 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:38.511639 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9226fc85-5383-4070-ad5b-734dbcea5204 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:38.514067 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9226fc85-5383-4070-ad5b-734dbcea5204 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:38.992283 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9226fc85-5383-4070-ad5b-734dbcea5204 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:39.010878 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9226fc85-5383-4070-ad5b-734dbcea5204 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.528427 Sep 24 21:11:39.012558 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2557/5096] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:38 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:11:39.039217 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4e60dddd-0300-4cdb-a602-5a09ce765f6d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:39.039856 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4e60dddd-0300-4cdb-a602-5a09ce765f6d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:39.055509 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e60dddd-0300-4cdb-a602-5a09ce765f6d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:39.056037 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e60dddd-0300-4cdb-a602-5a09ce765f6d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:39.056492 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e60dddd-0300-4cdb-a602-5a09ce765f6d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:39.057240 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e60dddd-0300-4cdb-a602-5a09ce765f6d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:39.057705 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e60dddd-0300-4cdb-a602-5a09ce765f6d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:39.061074 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e60dddd-0300-4cdb-a602-5a09ce765f6d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:39.655857 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4e60dddd-0300-4cdb-a602-5a09ce765f6d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:39.670566 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4e60dddd-0300-4cdb-a602-5a09ce765f6d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.635109 Sep 24 21:11:39.674357 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2540/5097] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:39 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:11:39.701342 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b8d1332c-93c0-4b95-ab41-bbcc10fb6bd0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-356416999_updated"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:11:39.703959 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b8d1332c-93c0-4b95-ab41-bbcc10fb6bd0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: bbe0d1b0-854c-411b-a5bb-01f7a4500f62] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:39.717056 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-b8d1332c-93c0-4b95-ab41-bbcc10fb6bd0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] HTTP exception thrown: Instance bbe0d1b0-854c-411b-a5bb-01f7a4500f62 could not be found. Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b8d1332c-93c0-4b95-ab41-bbcc10fb6bd0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: request: PUT /compute/v2.1/servers/bbe0d1b0-854c-411b-a5bb-01f7a4500f62 HTTP/1.1 Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 80 Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-356416999_updated"}} Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance bbe0d1b0-854c-411b-a5bb-01f7a4500f62 could not be found. Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'bbe0d1b0-854c-411b-a5bb-01f7a4500f62', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-356416999_updated'}}} Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbe0d1b0-854c-411b-a5bb-01f7a4500f62 could not be found. Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 24 21:11:39.720606 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:11:39.728119 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:11:39.728119 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:11:39.728119 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:11:39.728119 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbe0d1b0-854c-411b-a5bb-01f7a4500f62 could not be found. Sep 24 21:11:39.728119 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:39.728119 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:39.728119 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:39.728119 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:39.728119 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:11:39.728119 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:11:39.728119 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:11:39.728119 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:11:39.728119 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbe0d1b0-854c-411b-a5bb-01f7a4500f62 could not be found. Sep 24 21:11:39.728119 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:39.728119 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b8d1332c-93c0-4b95-ab41-bbcc10fb6bd0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 404 to user: Instance bbe0d1b0-854c-411b-a5bb-01f7a4500f62 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:11:39.730619 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b8d1332c-93c0-4b95-ab41-bbcc10fb6bd0 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "PUT /compute/v2.1/servers/bbe0d1b0-854c-411b-a5bb-01f7a4500f62" status: 404 len: 111 microversion: 2.1 time: 0.032985 Sep 24 21:11:39.731180 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2558/5098] 10.222.0.52 () {60 vars in 1256 bytes} [Sat Sep 24 21:11:39 2022] PUT /compute/v2.1/servers/bbe0d1b0-854c-411b-a5bb-01f7a4500f62 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:11:39.741461 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c8fb8869-4393-4414-a784-86139e021c4d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:39.743147 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c8fb8869-4393-4414-a784-86139e021c4d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:39.752489 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8fb8869-4393-4414-a784-86139e021c4d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:39.753417 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8fb8869-4393-4414-a784-86139e021c4d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:39.754421 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8fb8869-4393-4414-a784-86139e021c4d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:39.756577 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8fb8869-4393-4414-a784-86139e021c4d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:39.757265 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8fb8869-4393-4414-a784-86139e021c4d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:39.758690 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8fb8869-4393-4414-a784-86139e021c4d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:40.087847 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c8fb8869-4393-4414-a784-86139e021c4d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:40.104401 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c8fb8869-4393-4414-a784-86139e021c4d tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.368922 Sep 24 21:11:40.106894 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2541/5099] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:39 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:11:40.134233 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6aebb748-52b8-4548-bb5b-10ed44f16ccc tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:40.135554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6aebb748-52b8-4548-bb5b-10ed44f16ccc tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:40.170035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6aebb748-52b8-4548-bb5b-10ed44f16ccc tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:40.170979 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6aebb748-52b8-4548-bb5b-10ed44f16ccc tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:40.171641 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6aebb748-52b8-4548-bb5b-10ed44f16ccc tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:40.174076 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6aebb748-52b8-4548-bb5b-10ed44f16ccc tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:40.175558 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6aebb748-52b8-4548-bb5b-10ed44f16ccc tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:40.178333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6aebb748-52b8-4548-bb5b-10ed44f16ccc tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:40.537768 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6aebb748-52b8-4548-bb5b-10ed44f16ccc tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:40.547708 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6aebb748-52b8-4548-bb5b-10ed44f16ccc tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.418823 Sep 24 21:11:40.570936 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2559/5100] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:40 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:11:40.577056 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-47ea5cd9-bce3-4b53-9810-e69053223517 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-47ea5cd9-bce3-4b53-9810-e69053223517 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: request: PUT /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f HTTP/1.1 Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 280 Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'f3fcc34d-d09a-4475-bd96-51ac0074cb5f', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise error Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:11:40.583020 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:40.590213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:11:40.590213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:11:40.590213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:11:40.590213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:11:40.590213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:11:40.590213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:11:40.590213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:11:40.590213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:11:40.590213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 21:11:40.590213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 21:11:40.590213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 21:11:40.590213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 21:11:40.590213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 21:11:40.590213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 21:11:40.590213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 24 21:11:40.590213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:11:40.590213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:40.590213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:11:40.590213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:40.590213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:11:40.590213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:11:40.590213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 21:11:40.590213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 21:11:40.590213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 24 21:11:40.590213 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:11:40.590213 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-47ea5cd9-bce3-4b53-9810-e69053223517 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:11:40.590213 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-47ea5cd9-bce3-4b53-9810-e69053223517 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "PUT /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 400 len: 619 microversion: 2.1 time: 0.012433 Sep 24 21:11:40.590213 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2542/5101] 10.222.0.52 () {60 vars in 1257 bytes} [Sat Sep 24 21:11:40 2022] PUT /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 619 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:11:40.593643 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-08cbb465-f34c-4ad3-af38-5a6d0d6aef4e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:40.594267 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-08cbb465-f34c-4ad3-af38-5a6d0d6aef4e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:40.612977 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-08cbb465-f34c-4ad3-af38-5a6d0d6aef4e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:40.613490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-08cbb465-f34c-4ad3-af38-5a6d0d6aef4e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:40.618199 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-08cbb465-f34c-4ad3-af38-5a6d0d6aef4e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:40.619613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-08cbb465-f34c-4ad3-af38-5a6d0d6aef4e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:40.622857 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-08cbb465-f34c-4ad3-af38-5a6d0d6aef4e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:40.623313 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-08cbb465-f34c-4ad3-af38-5a6d0d6aef4e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:41.133086 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-08cbb465-f34c-4ad3-af38-5a6d0d6aef4e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:41.150743 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-08cbb465-f34c-4ad3-af38-5a6d0d6aef4e tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.561067 Sep 24 21:11:41.154101 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2560/5102] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:40 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:11:41.189040 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cd11fda6-a972-459a-927f-c384ec1460aa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:41.189683 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cd11fda6-a972-459a-927f-c384ec1460aa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:41.204585 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd11fda6-a972-459a-927f-c384ec1460aa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:41.205158 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd11fda6-a972-459a-927f-c384ec1460aa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:41.208714 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd11fda6-a972-459a-927f-c384ec1460aa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:41.209699 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd11fda6-a972-459a-927f-c384ec1460aa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:41.210185 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd11fda6-a972-459a-927f-c384ec1460aa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:41.210652 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cd11fda6-a972-459a-927f-c384ec1460aa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:41.756349 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cd11fda6-a972-459a-927f-c384ec1460aa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:41.780687 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cd11fda6-a972-459a-927f-c384ec1460aa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.593879 Sep 24 21:11:41.782632 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2543/5103] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:41 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:11:41.813563 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c0a3fec4-6318-42b3-bb8a-93324feccd66 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c0a3fec4-6318-42b3-bb8a-93324feccd66 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: request: PUT /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f HTTP/1.1 Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 24 Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: {"server": {"name": ""}} Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'f3fcc34d-d09a-4475-bd96-51ac0074cb5f', 'body': {'server': {'name': ''}}} Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise error Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi '' Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 21:11:41.819095 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 21:11:41.823374 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 24 21:11:41.823374 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:41.823374 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:41.823374 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:41.823374 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:41.823374 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:11:41.823374 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:11:41.823374 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 21:11:41.823374 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 21:11:41.823374 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 24 21:11:41.823374 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:41.825714 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c0a3fec4-6318-42b3-bb8a-93324feccd66 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:11:41.826969 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c0a3fec4-6318-42b3-bb8a-93324feccd66 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "PUT /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 400 len: 108 microversion: 2.1 time: 0.018147 Sep 24 21:11:41.831381 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2561/5104] 10.222.0.52 () {60 vars in 1256 bytes} [Sat Sep 24 21:11:41 2022] PUT /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 108 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:11:41.838845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-234f1164-4a83-4e3a-98ff-bcd6aa9ab402 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:41.839479 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-234f1164-4a83-4e3a-98ff-bcd6aa9ab402 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:41.851081 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-234f1164-4a83-4e3a-98ff-bcd6aa9ab402 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:41.852336 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-234f1164-4a83-4e3a-98ff-bcd6aa9ab402 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:41.855326 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-234f1164-4a83-4e3a-98ff-bcd6aa9ab402 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:41.856866 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-234f1164-4a83-4e3a-98ff-bcd6aa9ab402 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:41.857759 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-234f1164-4a83-4e3a-98ff-bcd6aa9ab402 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:41.858253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-234f1164-4a83-4e3a-98ff-bcd6aa9ab402 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:42.502432 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-234f1164-4a83-4e3a-98ff-bcd6aa9ab402 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:42.517942 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-234f1164-4a83-4e3a-98ff-bcd6aa9ab402 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1506 microversion: 2.1 time: 0.685174 Sep 24 21:11:42.519731 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2544/5105] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:41 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1506 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:11:43.150327 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f6824b1e-85bd-4b1d-9c13-01a54c585e61 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:43.150891 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f6824b1e-85bd-4b1d-9c13-01a54c585e61 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: 23ed2980-eb42-4f9e-b65e-77a238d7b976] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:43.159107 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6824b1e-85bd-4b1d-9c13-01a54c585e61 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:43.163716 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6824b1e-85bd-4b1d-9c13-01a54c585e61 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:43.164228 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6824b1e-85bd-4b1d-9c13-01a54c585e61 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:43.174565 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6824b1e-85bd-4b1d-9c13-01a54c585e61 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:43.175397 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6824b1e-85bd-4b1d-9c13-01a54c585e61 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:43.176052 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6824b1e-85bd-4b1d-9c13-01a54c585e61 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:43.204060 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-f6824b1e-85bd-4b1d-9c13-01a54c585e61 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] HTTP exception thrown: Instance 23ed2980-eb42-4f9e-b65e-77a238d7b976 could not be found. Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f6824b1e-85bd-4b1d-9c13-01a54c585e61 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976 HTTP/1.1 Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 23ed2980-eb42-4f9e-b65e-77a238d7b976 could not be found. Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '23ed2980-eb42-4f9e-b65e-77a238d7b976'} Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23ed2980-eb42-4f9e-b65e-77a238d7b976 could not be found. Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:11:43.211993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:11:43.216093 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23ed2980-eb42-4f9e-b65e-77a238d7b976 could not be found. Sep 24 21:11:43.216093 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:43.216093 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:43.216093 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:43.216093 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:43.216093 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:11:43.216093 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:11:43.216093 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:11:43.216093 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:11:43.216093 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23ed2980-eb42-4f9e-b65e-77a238d7b976 could not be found. Sep 24 21:11:43.216093 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:11:43.216093 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f6824b1e-85bd-4b1d-9c13-01a54c585e61 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 404 to user: Instance 23ed2980-eb42-4f9e-b65e-77a238d7b976 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:11:43.216093 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f6824b1e-85bd-4b1d-9c13-01a54c585e61 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "DELETE /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976" status: 404 len: 111 microversion: 2.1 time: 0.069119 Sep 24 21:11:43.216093 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2562/5106] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:11:43 2022] DELETE /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:11:43.222415 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-54f06d3e-fa64-4198-8be0-12b1106ee8c4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:43.223084 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-54f06d3e-fa64-4198-8be0-12b1106ee8c4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: 23ed2980-eb42-4f9e-b65e-77a238d7b976] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:43.235325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-54f06d3e-fa64-4198-8be0-12b1106ee8c4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:43.235836 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-54f06d3e-fa64-4198-8be0-12b1106ee8c4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:43.236288 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-54f06d3e-fa64-4198-8be0-12b1106ee8c4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:43.237016 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-54f06d3e-fa64-4198-8be0-12b1106ee8c4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:43.237861 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-54f06d3e-fa64-4198-8be0-12b1106ee8c4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:43.238298 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-54f06d3e-fa64-4198-8be0-12b1106ee8c4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:43.255586 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-54f06d3e-fa64-4198-8be0-12b1106ee8c4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] HTTP exception thrown: Instance 23ed2980-eb42-4f9e-b65e-77a238d7b976 could not be found. Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-54f06d3e-fa64-4198-8be0-12b1106ee8c4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976 HTTP/1.1 Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 23ed2980-eb42-4f9e-b65e-77a238d7b976 could not be found. Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '23ed2980-eb42-4f9e-b65e-77a238d7b976'} Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23ed2980-eb42-4f9e-b65e-77a238d7b976 could not be found. Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23ed2980-eb42-4f9e-b65e-77a238d7b976 could not be found. Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:43.257846 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:11:43.262655 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:43.262655 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:11:43.262655 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:11:43.262655 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:11:43.262655 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:11:43.262655 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23ed2980-eb42-4f9e-b65e-77a238d7b976 could not be found. Sep 24 21:11:43.262655 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:11:43.263318 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-54f06d3e-fa64-4198-8be0-12b1106ee8c4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 404 to user: Instance 23ed2980-eb42-4f9e-b65e-77a238d7b976 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:11:43.264201 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-54f06d3e-fa64-4198-8be0-12b1106ee8c4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976" status: 404 len: 111 microversion: 2.1 time: 0.045756 Sep 24 21:11:43.264785 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2545/5107] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:43 2022] GET /compute/v2.1/servers/23ed2980-eb42-4f9e-b65e-77a238d7b976 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:11:43.274420 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-19d9ac22-33f9-4e1a-87d2-3b8446f79ce1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:43.275239 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-19d9ac22-33f9-4e1a-87d2-3b8446f79ce1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:43.284930 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-19d9ac22-33f9-4e1a-87d2-3b8446f79ce1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:43.285423 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-19d9ac22-33f9-4e1a-87d2-3b8446f79ce1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:43.285914 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-19d9ac22-33f9-4e1a-87d2-3b8446f79ce1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:43.289203 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-19d9ac22-33f9-4e1a-87d2-3b8446f79ce1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:43.289416 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-19d9ac22-33f9-4e1a-87d2-3b8446f79ce1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:43.289863 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-19d9ac22-33f9-4e1a-87d2-3b8446f79ce1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:43.325652 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-19d9ac22-33f9-4e1a-87d2-3b8446f79ce1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:11:43.417851 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-19d9ac22-33f9-4e1a-87d2-3b8446f79ce1 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 204 len: 0 microversion: 2.1 time: 0.147884 Sep 24 21:11:43.420435 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2563/5108] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:11:43 2022] DELETE /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:11:43.430424 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6a86ace8-ac97-435a-8bfb-59a9695534b3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:43.431215 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6a86ace8-ac97-435a-8bfb-59a9695534b3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:43.443561 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6a86ace8-ac97-435a-8bfb-59a9695534b3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:43.444377 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6a86ace8-ac97-435a-8bfb-59a9695534b3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:43.446178 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6a86ace8-ac97-435a-8bfb-59a9695534b3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:43.447244 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6a86ace8-ac97-435a-8bfb-59a9695534b3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:43.448173 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6a86ace8-ac97-435a-8bfb-59a9695534b3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:43.448849 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6a86ace8-ac97-435a-8bfb-59a9695534b3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:43.454438 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:11:43.752873 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6a86ace8-ac97-435a-8bfb-59a9695534b3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:43.765675 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6a86ace8-ac97-435a-8bfb-59a9695534b3 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1512 microversion: 2.1 time: 0.340772 Sep 24 21:11:43.766778 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2546/5109] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:43 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1512 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:11:44.794457 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1365c682-d369-4660-a9f2-f74f9e07b371 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:44.795305 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1365c682-d369-4660-a9f2-f74f9e07b371 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:44.812200 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1365c682-d369-4660-a9f2-f74f9e07b371 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:44.812936 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1365c682-d369-4660-a9f2-f74f9e07b371 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:44.813551 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1365c682-d369-4660-a9f2-f74f9e07b371 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:44.815927 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1365c682-d369-4660-a9f2-f74f9e07b371 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:44.817811 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1365c682-d369-4660-a9f2-f74f9e07b371 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:44.820726 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1365c682-d369-4660-a9f2-f74f9e07b371 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:45.318907 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1365c682-d369-4660-a9f2-f74f9e07b371 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:45.330401 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1365c682-d369-4660-a9f2-f74f9e07b371 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1512 microversion: 2.1 time: 0.538659 Sep 24 21:11:45.347726 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2564/5110] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:44 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1512 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:11:46.361795 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-92e6aea8-9d97-4123-8eb0-6fb895504be4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:46.362630 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-92e6aea8-9d97-4123-8eb0-6fb895504be4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:46.375273 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=46 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:11:46.378420 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-92e6aea8-9d97-4123-8eb0-6fb895504be4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:46.379188 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-92e6aea8-9d97-4123-8eb0-6fb895504be4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:46.380026 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-92e6aea8-9d97-4123-8eb0-6fb895504be4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:46.380977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-92e6aea8-9d97-4123-8eb0-6fb895504be4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:46.381655 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-92e6aea8-9d97-4123-8eb0-6fb895504be4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:46.382294 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-92e6aea8-9d97-4123-8eb0-6fb895504be4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:46.540828 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-92e6aea8-9d97-4123-8eb0-6fb895504be4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22830d73cb043b8b9c2e070afa7af55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b170a25f4e4d44ba88fffcdc51d3fbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:11:46.551646 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-92e6aea8-9d97-4123-8eb0-6fb895504be4 tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 200 len: 1470 microversion: 2.1 time: 0.193465 Sep 24 21:11:46.559214 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2547/5111] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:46 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 1470 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:11:47.363022 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-366183d7-5466-46c8-aa3c-bade41c74920 req-14c2cd9b-9b26-4596-99eb-511ab4a6c866 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3fcc34d-d09a-4475-bd96-51ac0074cb5f", "name": "network-vif-deleted", "tag": "2ca29bee-7747-4b85-b335-ac8c4538a67e"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:11:47.368710 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:11:47.385861 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-366183d7-5466-46c8-aa3c-bade41c74920 req-14c2cd9b-9b26-4596-99eb-511ab4a6c866 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:47.387819 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-366183d7-5466-46c8-aa3c-bade41c74920 req-14c2cd9b-9b26-4596-99eb-511ab4a6c866 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:47.388270 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-366183d7-5466-46c8-aa3c-bade41c74920 req-14c2cd9b-9b26-4596-99eb-511ab4a6c866 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:47.404908 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-366183d7-5466-46c8-aa3c-bade41c74920 req-14c2cd9b-9b26-4596-99eb-511ab4a6c866 service nova] Creating event network-vif-deleted:2ca29bee-7747-4b85-b335-ac8c4538a67e for instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f on nch1-master-1 Sep 24 21:11:47.430792 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-366183d7-5466-46c8-aa3c-bade41c74920 req-14c2cd9b-9b26-4596-99eb-511ab4a6c866 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.695022 Sep 24 21:11:47.433196 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2565/5112] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:11:47.584735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1691b498-26cb-4952-9cc7-be895d4402fa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:11:47.585367 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1691b498-26cb-4952-9cc7-be895d4402fa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] [instance: f3fcc34d-d09a-4475-bd96-51ac0074cb5f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:11:47.602746 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1691b498-26cb-4952-9cc7-be895d4402fa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:47.603504 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1691b498-26cb-4952-9cc7-be895d4402fa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:47.603962 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1691b498-26cb-4952-9cc7-be895d4402fa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:47.604690 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1691b498-26cb-4952-9cc7-be895d4402fa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:11:47.605151 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1691b498-26cb-4952-9cc7-be895d4402fa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:11:47.608110 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1691b498-26cb-4952-9cc7-be895d4402fa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:11:47.664784 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-1691b498-26cb-4952-9cc7-be895d4402fa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] HTTP exception thrown: Instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f could not be found. Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1691b498-26cb-4952-9cc7-be895d4402fa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Request method failure captured: Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f HTTP/1.1 Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3G_QJwNvgmVtVHrF8sylkTFPCGdLNv5SdfGyhQRjWacjuOFkTYbT4KpR47dOiI-u9DDUWUoPQAOWrHMSWti73P5wwoRvsmE4lhYUVf1X4YdP2yUnOaMquA4oRfyp7hOBqrmeIUi4BZpdb_zStVycIln5jB8aELKeL8vJZya0b6DhLo Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b170a25f4e4d44ba88fffcdc51d3fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: b170a25f4e4d44ba88fffcdc51d3fbbe Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1646194640 Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: a22830d73cb043b8b9c2e070afa7af55 Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersNegativeTestJSON-1646194640-project Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f could not be found. Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'f3fcc34d-d09a-4475-bd96-51ac0074cb5f'} Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f could not be found. Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f could not be found. Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:11:47.668149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:11:47.672452 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:11:47.672452 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:11:47.672452 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:11:47.672452 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:11:47.672452 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:11:47.672452 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f could not be found. Sep 24 21:11:47.672452 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:11:47.672452 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1691b498-26cb-4952-9cc7-be895d4402fa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Returning 404 to user: Instance f3fcc34d-d09a-4475-bd96-51ac0074cb5f could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:11:47.672452 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1691b498-26cb-4952-9cc7-be895d4402fa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f" status: 404 len: 111 microversion: 2.1 time: 0.091785 Sep 24 21:11:47.675556 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2548/5113] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:11:47 2022] GET /compute/v2.1/servers/f3fcc34d-d09a-4475-bd96-51ac0074cb5f => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:12:00.299674 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-366183d7-5466-46c8-aa3c-bade41c74920 req-14c2cd9b-9b26-4596-99eb-511ab4a6c866 service nova] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:12:00.302240 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-366183d7-5466-46c8-aa3c-bade41c74920 req-14c2cd9b-9b26-4596-99eb-511ab4a6c866 service nova] 10.222.0.52 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003515 Sep 24 21:12:00.309898 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2566/5114] 10.222.0.52 () {56 vars in 886 bytes} [Sat Sep 24 21:12:00 2022] GET /compute/ => generated 377 bytes in 9 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 24 21:12:05.323335 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1691b498-26cb-4952-9cc7-be895d4402fa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:12:05.325340 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1691b498-26cb-4952-9cc7-be895d4402fa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002323 Sep 24 21:12:05.325689 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2549/5115] 10.222.0.52 () {56 vars in 886 bytes} [Sat Sep 24 21:12:05 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 24 21:12:05.334609 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-366183d7-5466-46c8-aa3c-bade41c74920 req-14c2cd9b-9b26-4596-99eb-511ab4a6c866 service nova] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:12:05.336186 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-366183d7-5466-46c8-aa3c-bade41c74920 req-14c2cd9b-9b26-4596-99eb-511ab4a6c866 service nova] 10.222.0.52 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002539 Sep 24 21:12:05.337529 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2567/5116] 10.222.0.52 () {54 vars in 1035 bytes} [Sat Sep 24 21:12:05 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Sep 24 21:12:05.343921 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1691b498-26cb-4952-9cc7-be895d4402fa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:12:05.345468 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1691b498-26cb-4952-9cc7-be895d4402fa tempest-ServersNegativeTestJSON-1646194640 tempest-ServersNegativeTestJSON-1646194640-project] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001513 Sep 24 21:12:05.346041 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2550/5117] 10.222.0.52 () {54 vars in 1041 bytes} [Sat Sep 24 21:12:05 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:12:05.356363 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-366183d7-5466-46c8-aa3c-bade41c74920 req-14c2cd9b-9b26-4596-99eb-511ab4a6c866 service nova] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:12:05.357533 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-366183d7-5466-46c8-aa3c-bade41c74920 req-14c2cd9b-9b26-4596-99eb-511ab4a6c866 service nova] 10.222.0.52 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002228 Sep 24 21:12:05.358187 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2568/5118] 10.222.0.52 () {56 vars in 886 bytes} [Sat Sep 24 21:12:05 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 24 21:12:21.833995 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:12:21.835270 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=13 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:12:22.116865 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c905f7bb-e0b2-408a-ae08-d9da76256d00 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Action: 'create', calling method: .version_select at 0x7f4b074b60d0>, body: {"keypair": {"name": "tempest-keypair-1724777043", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4ew0VRvlBsFksMLdmrO1U4KFw79Apt6hkK1BJPtLQWyBVJrvsoZdEdpjzsFwPUnl+f6KoX2dVsnuE4EEdyfIYF671znVw9cAk9R6cPeSLt9DtZuL/7VPgXDH94GvhgBw=="}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:12:22.164321 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-c905f7bb-e0b2-408a-ae08-d9da76256d00 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Getting quotas for project 8590b56a0c924f76ba18920e735e6b4d. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:12:22.177798 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-c905f7bb-e0b2-408a-ae08-d9da76256d00 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Getting quotas for user 57c163c13444454c9a23703c08a9cc5a and project 8590b56a0c924f76ba18920e735e6b4d. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:12:22.243045 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c905f7bb-e0b2-408a-ae08-d9da76256d00 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.415289 Sep 24 21:12:22.243862 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2551/5119] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 21:12:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:12:27.996768 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1fe7a5b5-72a0-4783-ae92-c87d7cff6f32 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1239749414", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a162c3f9-67fd-43a6-90ef-ab00f099918b"}], "security_groups": [{"name": "tempest-securitygroup--548961328"}], "key_name": "tempest-keypair-1724777043", "user_data": "}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:12:28.086980 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:12:28.090107 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:12:28.610817 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-1fe7a5b5-72a0-4783-ae92-c87d7cff6f32 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] validate_networks() for [('a162c3f9-67fd-43a6-90ef-ab00f099918b', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:12:30.399908 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-1fe7a5b5-72a0-4783-ae92-c87d7cff6f32 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:12:30.400498 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-1fe7a5b5-72a0-4783-ae92-c87d7cff6f32 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:12:30.401502 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-1fe7a5b5-72a0-4783-ae92-c87d7cff6f32 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:12:30.401943 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-1fe7a5b5-72a0-4783-ae92-c87d7cff6f32 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:12:30.402372 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-1fe7a5b5-72a0-4783-ae92-c87d7cff6f32 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:12:30.425967 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1fe7a5b5-72a0-4783-ae92-c87d7cff6f32 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:12:30.427694 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1fe7a5b5-72a0-4783-ae92-c87d7cff6f32 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:12:30.428156 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1fe7a5b5-72a0-4783-ae92-c87d7cff6f32 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:12:30.431910 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1fe7a5b5-72a0-4783-ae92-c87d7cff6f32 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:12:30.435240 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1fe7a5b5-72a0-4783-ae92-c87d7cff6f32 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:12:30.436931 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1fe7a5b5-72a0-4783-ae92-c87d7cff6f32 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:12:30.475353 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-1fe7a5b5-72a0-4783-ae92-c87d7cff6f32 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Getting quotas for project 8590b56a0c924f76ba18920e735e6b4d. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:12:30.483843 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-1fe7a5b5-72a0-4783-ae92-c87d7cff6f32 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Getting quotas for user 57c163c13444454c9a23703c08a9cc5a and project 8590b56a0c924f76ba18920e735e6b4d. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:12:30.504090 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1fe7a5b5-72a0-4783-ae92-c87d7cff6f32 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:12:30.507105 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1fe7a5b5-72a0-4783-ae92-c87d7cff6f32 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: de9c58e0-4a42-463b-8d44-4f2ac1d55a20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:12:30.615140 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1fe7a5b5-72a0-4783-ae92-c87d7cff6f32 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.631374 Sep 24 21:12:30.615977 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2569/5120] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:12:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 2633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:12:30.629533 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dc68a36a-d827-49f7-b1d7-6a5a74595dce tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:12:30.630240 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-dc68a36a-d827-49f7-b1d7-6a5a74595dce tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: de9c58e0-4a42-463b-8d44-4f2ac1d55a20] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:12:30.864009 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-dc68a36a-d827-49f7-b1d7-6a5a74595dce tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c163c13444454c9a23703c08a9cc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8590b56a0c924f76ba18920e735e6b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:12:30.895457 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-dc68a36a-d827-49f7-b1d7-6a5a74595dce tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20" status: 200 len: 1238 microversion: 2.1 time: 0.269042 Sep 24 21:12:30.920428 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2552/5121] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:12:30 2022] GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20 => generated 1238 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:12:31.932500 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-766d3128-3745-4cc2-9a4f-bbeb86051d73 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:12:31.933148 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-766d3128-3745-4cc2-9a4f-bbeb86051d73 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: de9c58e0-4a42-463b-8d44-4f2ac1d55a20] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:12:31.947060 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-766d3128-3745-4cc2-9a4f-bbeb86051d73 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:12:31.949293 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-766d3128-3745-4cc2-9a4f-bbeb86051d73 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:12:31.949945 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-766d3128-3745-4cc2-9a4f-bbeb86051d73 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:12:31.951310 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-766d3128-3745-4cc2-9a4f-bbeb86051d73 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:12:31.952693 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-766d3128-3745-4cc2-9a4f-bbeb86051d73 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:12:31.954136 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-766d3128-3745-4cc2-9a4f-bbeb86051d73 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:12:32.120997 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-766d3128-3745-4cc2-9a4f-bbeb86051d73 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c163c13444454c9a23703c08a9cc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8590b56a0c924f76ba18920e735e6b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:12:32.145936 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-766d3128-3745-4cc2-9a4f-bbeb86051d73 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20" status: 200 len: 1234 microversion: 2.1 time: 0.217489 Sep 24 21:12:32.148495 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2570/5122] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:12:31 2022] GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20 => generated 1234 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:12:33.172481 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b6aa6592-efe6-491c-91bc-e53bce4f48cd tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:12:33.173098 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b6aa6592-efe6-491c-91bc-e53bce4f48cd tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: de9c58e0-4a42-463b-8d44-4f2ac1d55a20] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:12:33.187726 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6aa6592-efe6-491c-91bc-e53bce4f48cd tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:12:33.188602 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6aa6592-efe6-491c-91bc-e53bce4f48cd tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:12:33.189243 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6aa6592-efe6-491c-91bc-e53bce4f48cd tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:12:33.192620 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6aa6592-efe6-491c-91bc-e53bce4f48cd tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:12:33.195358 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6aa6592-efe6-491c-91bc-e53bce4f48cd tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:12:33.196149 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6aa6592-efe6-491c-91bc-e53bce4f48cd tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:12:33.405149 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b6aa6592-efe6-491c-91bc-e53bce4f48cd tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c163c13444454c9a23703c08a9cc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8590b56a0c924f76ba18920e735e6b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:12:33.426099 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b6aa6592-efe6-491c-91bc-e53bce4f48cd tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20" status: 200 len: 1296 microversion: 2.1 time: 0.257234 Sep 24 21:12:33.433413 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2553/5123] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:12:33 2022] GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20 => generated 1296 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:12:34.455816 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-71360b7a-7ad1-4c03-94dc-02c2654aa030 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:12:34.457134 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-71360b7a-7ad1-4c03-94dc-02c2654aa030 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: de9c58e0-4a42-463b-8d44-4f2ac1d55a20] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:12:34.472808 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71360b7a-7ad1-4c03-94dc-02c2654aa030 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:12:34.473325 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71360b7a-7ad1-4c03-94dc-02c2654aa030 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:12:34.473777 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71360b7a-7ad1-4c03-94dc-02c2654aa030 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:12:34.474973 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71360b7a-7ad1-4c03-94dc-02c2654aa030 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:12:34.475440 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71360b7a-7ad1-4c03-94dc-02c2654aa030 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:12:34.475873 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71360b7a-7ad1-4c03-94dc-02c2654aa030 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:12:34.724569 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-71360b7a-7ad1-4c03-94dc-02c2654aa030 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c163c13444454c9a23703c08a9cc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8590b56a0c924f76ba18920e735e6b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:12:34.738549 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-71360b7a-7ad1-4c03-94dc-02c2654aa030 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20" status: 200 len: 1296 microversion: 2.1 time: 0.287375 Sep 24 21:12:34.739590 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2571/5124] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:12:34 2022] GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20 => generated 1296 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:12:35.767982 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c2ee4e13-01e4-4db7-b4fa-aeca9abc3695 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:12:35.768986 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c2ee4e13-01e4-4db7-b4fa-aeca9abc3695 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: de9c58e0-4a42-463b-8d44-4f2ac1d55a20] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:12:35.787969 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2ee4e13-01e4-4db7-b4fa-aeca9abc3695 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:12:35.788541 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2ee4e13-01e4-4db7-b4fa-aeca9abc3695 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:12:35.789154 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2ee4e13-01e4-4db7-b4fa-aeca9abc3695 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:12:35.789892 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2ee4e13-01e4-4db7-b4fa-aeca9abc3695 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:12:35.790352 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2ee4e13-01e4-4db7-b4fa-aeca9abc3695 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:12:35.790819 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2ee4e13-01e4-4db7-b4fa-aeca9abc3695 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:12:36.329250 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c2ee4e13-01e4-4db7-b4fa-aeca9abc3695 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c163c13444454c9a23703c08a9cc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8590b56a0c924f76ba18920e735e6b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:12:36.344683 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c2ee4e13-01e4-4db7-b4fa-aeca9abc3695 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20" status: 200 len: 1363 microversion: 2.1 time: 0.583477 Sep 24 21:12:36.364849 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2554/5125] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:12:35 2022] GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20 => generated 1363 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:12:37.375905 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7898c0be-0737-4a33-9829-70e0b2c550e7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:12:37.377365 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7898c0be-0737-4a33-9829-70e0b2c550e7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: de9c58e0-4a42-463b-8d44-4f2ac1d55a20] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:12:37.386822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7898c0be-0737-4a33-9829-70e0b2c550e7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:12:37.387554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7898c0be-0737-4a33-9829-70e0b2c550e7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:12:37.389054 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7898c0be-0737-4a33-9829-70e0b2c550e7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:12:37.389796 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7898c0be-0737-4a33-9829-70e0b2c550e7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:12:37.390684 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7898c0be-0737-4a33-9829-70e0b2c550e7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:12:37.391318 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7898c0be-0737-4a33-9829-70e0b2c550e7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:12:37.968085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7898c0be-0737-4a33-9829-70e0b2c550e7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c163c13444454c9a23703c08a9cc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8590b56a0c924f76ba18920e735e6b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:12:37.983103 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7898c0be-0737-4a33-9829-70e0b2c550e7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20" status: 200 len: 1363 microversion: 2.1 time: 0.613333 Sep 24 21:12:38.005231 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2572/5126] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:12:37 2022] GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20 => generated 1363 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:12:39.025283 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d89e5626-2a69-4c70-a8f8-182c016ac7ab tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:12:39.025999 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d89e5626-2a69-4c70-a8f8-182c016ac7ab tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: de9c58e0-4a42-463b-8d44-4f2ac1d55a20] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:12:39.027701 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-b761119f-7071-41b2-85ee-874da9a640c4 req-731df883-9181-4f49-9530-da43b7870c26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de9c58e0-4a42-463b-8d44-4f2ac1d55a20", "tag": "edbbdbcb-9a85-4000-b01d-2f8b7bf45ed2"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:12:39.065621 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d89e5626-2a69-4c70-a8f8-182c016ac7ab tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:12:39.067696 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d89e5626-2a69-4c70-a8f8-182c016ac7ab tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:12:39.077657 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d89e5626-2a69-4c70-a8f8-182c016ac7ab tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:12:39.079225 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d89e5626-2a69-4c70-a8f8-182c016ac7ab tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:12:39.094699 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d89e5626-2a69-4c70-a8f8-182c016ac7ab tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:12:39.095239 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d89e5626-2a69-4c70-a8f8-182c016ac7ab tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:12:39.100591 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-b761119f-7071-41b2-85ee-874da9a640c4 req-731df883-9181-4f49-9530-da43b7870c26 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:12:39.101207 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-b761119f-7071-41b2-85ee-874da9a640c4 req-731df883-9181-4f49-9530-da43b7870c26 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:12:39.101963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-b761119f-7071-41b2-85ee-874da9a640c4 req-731df883-9181-4f49-9530-da43b7870c26 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:12:39.179597 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-b761119f-7071-41b2-85ee-874da9a640c4 req-731df883-9181-4f49-9530-da43b7870c26 service nova] Creating event network-changed:edbbdbcb-9a85-4000-b01d-2f8b7bf45ed2 for instance de9c58e0-4a42-463b-8d44-4f2ac1d55a20 on nch1-master-1 Sep 24 21:12:39.197642 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-b761119f-7071-41b2-85ee-874da9a640c4 req-731df883-9181-4f49-9530-da43b7870c26 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184969 Sep 24 21:12:39.204003 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2555/5127] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:12:39.878826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d89e5626-2a69-4c70-a8f8-182c016ac7ab tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c163c13444454c9a23703c08a9cc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8590b56a0c924f76ba18920e735e6b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:12:39.891623 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d89e5626-2a69-4c70-a8f8-182c016ac7ab tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20" status: 200 len: 1363 microversion: 2.1 time: 0.878200 Sep 24 21:12:39.892275 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2573/5128] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:12:39 2022] GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20 => generated 1363 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:12:40.916130 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8a4c405b-798b-43ab-a377-d4f44d4db28c tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:12:40.916926 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8a4c405b-798b-43ab-a377-d4f44d4db28c tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: de9c58e0-4a42-463b-8d44-4f2ac1d55a20] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:12:40.932782 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:12:40.941560 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8a4c405b-798b-43ab-a377-d4f44d4db28c tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:12:40.942717 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8a4c405b-798b-43ab-a377-d4f44d4db28c tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:12:40.945420 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8a4c405b-798b-43ab-a377-d4f44d4db28c tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:12:40.946443 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8a4c405b-798b-43ab-a377-d4f44d4db28c tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:12:40.949618 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8a4c405b-798b-43ab-a377-d4f44d4db28c tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:12:40.950819 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8a4c405b-798b-43ab-a377-d4f44d4db28c tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:12:41.707385 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8a4c405b-798b-43ab-a377-d4f44d4db28c tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c163c13444454c9a23703c08a9cc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8590b56a0c924f76ba18920e735e6b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:12:41.720064 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8a4c405b-798b-43ab-a377-d4f44d4db28c tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20" status: 200 len: 1363 microversion: 2.1 time: 0.808213 Sep 24 21:12:41.722569 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2556/5129] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:12:40 2022] GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20 => generated 1363 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:12:42.747290 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f4d6c069-9464-4c3d-a4b3-4cda1c263011 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:12:42.748960 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f4d6c069-9464-4c3d-a4b3-4cda1c263011 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: de9c58e0-4a42-463b-8d44-4f2ac1d55a20] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:12:42.754638 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:12:42.758230 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=6 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:12:42.768788 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f4d6c069-9464-4c3d-a4b3-4cda1c263011 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:12:42.769607 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f4d6c069-9464-4c3d-a4b3-4cda1c263011 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:12:42.770311 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f4d6c069-9464-4c3d-a4b3-4cda1c263011 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:12:42.771635 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f4d6c069-9464-4c3d-a4b3-4cda1c263011 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:12:42.772116 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f4d6c069-9464-4c3d-a4b3-4cda1c263011 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:12:42.773098 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f4d6c069-9464-4c3d-a4b3-4cda1c263011 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:12:43.422069 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f4d6c069-9464-4c3d-a4b3-4cda1c263011 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c163c13444454c9a23703c08a9cc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8590b56a0c924f76ba18920e735e6b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:12:43.432224 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f4d6c069-9464-4c3d-a4b3-4cda1c263011 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20" status: 200 len: 1363 microversion: 2.1 time: 0.689351 Sep 24 21:12:43.434351 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2574/5130] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:12:42 2022] GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20 => generated 1363 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:12:44.457505 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4f000971-1ea3-4031-8753-724832667093 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:12:44.458243 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4f000971-1ea3-4031-8753-724832667093 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: de9c58e0-4a42-463b-8d44-4f2ac1d55a20] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:12:44.469733 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f000971-1ea3-4031-8753-724832667093 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:12:44.470880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f000971-1ea3-4031-8753-724832667093 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:12:44.471336 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f000971-1ea3-4031-8753-724832667093 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:12:44.472077 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f000971-1ea3-4031-8753-724832667093 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:12:44.472543 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f000971-1ea3-4031-8753-724832667093 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:12:44.472979 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4f000971-1ea3-4031-8753-724832667093 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:12:45.353695 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4f000971-1ea3-4031-8753-724832667093 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c163c13444454c9a23703c08a9cc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8590b56a0c924f76ba18920e735e6b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:12:45.363569 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4f000971-1ea3-4031-8753-724832667093 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20" status: 200 len: 1363 microversion: 2.1 time: 0.910322 Sep 24 21:12:45.365414 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2557/5131] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:12:44 2022] GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20 => generated 1363 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:12:46.401201 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-30c67cbe-83a0-4585-8ac2-87554ba51e53 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:12:46.406381 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-30c67cbe-83a0-4585-8ac2-87554ba51e53 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: de9c58e0-4a42-463b-8d44-4f2ac1d55a20] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:12:46.428194 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30c67cbe-83a0-4585-8ac2-87554ba51e53 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:12:46.428609 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30c67cbe-83a0-4585-8ac2-87554ba51e53 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:12:46.429054 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30c67cbe-83a0-4585-8ac2-87554ba51e53 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:12:46.443765 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30c67cbe-83a0-4585-8ac2-87554ba51e53 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:12:46.444139 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30c67cbe-83a0-4585-8ac2-87554ba51e53 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:12:46.444594 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30c67cbe-83a0-4585-8ac2-87554ba51e53 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:12:46.665931 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-9e29bb7d-25cf-4599-ac2a-318c12994c6b req-26f9402f-fb23-4a63-9237-e195293f4ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de9c58e0-4a42-463b-8d44-4f2ac1d55a20", "name": "network-vif-plugged", "status": "completed", "tag": "edbbdbcb-9a85-4000-b01d-2f8b7bf45ed2"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:12:46.704372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-9e29bb7d-25cf-4599-ac2a-318c12994c6b req-26f9402f-fb23-4a63-9237-e195293f4ad4 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:12:46.704372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-9e29bb7d-25cf-4599-ac2a-318c12994c6b req-26f9402f-fb23-4a63-9237-e195293f4ad4 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:12:46.705415 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-9e29bb7d-25cf-4599-ac2a-318c12994c6b req-26f9402f-fb23-4a63-9237-e195293f4ad4 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:12:46.740391 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-30c67cbe-83a0-4585-8ac2-87554ba51e53 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c163c13444454c9a23703c08a9cc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8590b56a0c924f76ba18920e735e6b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:12:46.749755 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-30c67cbe-83a0-4585-8ac2-87554ba51e53 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20" status: 200 len: 1363 microversion: 2.1 time: 0.358363 Sep 24 21:12:46.753018 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-9e29bb7d-25cf-4599-ac2a-318c12994c6b req-26f9402f-fb23-4a63-9237-e195293f4ad4 service nova] Creating event network-vif-plugged:edbbdbcb-9a85-4000-b01d-2f8b7bf45ed2 for instance de9c58e0-4a42-463b-8d44-4f2ac1d55a20 on nch1-master-1 Sep 24 21:12:46.753318 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2575/5132] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:12:46 2022] GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20 => generated 1363 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:12:46.771909 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-9e29bb7d-25cf-4599-ac2a-318c12994c6b req-26f9402f-fb23-4a63-9237-e195293f4ad4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125521 Sep 24 21:12:46.772826 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2558/5133] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:12:47.776280 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f11e2566-74eb-4813-9921-945fbe7681c7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:12:47.777505 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f11e2566-74eb-4813-9921-945fbe7681c7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: de9c58e0-4a42-463b-8d44-4f2ac1d55a20] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:12:47.785730 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f11e2566-74eb-4813-9921-945fbe7681c7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:12:47.786723 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f11e2566-74eb-4813-9921-945fbe7681c7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:12:47.787352 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f11e2566-74eb-4813-9921-945fbe7681c7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:12:47.788220 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f11e2566-74eb-4813-9921-945fbe7681c7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:12:47.788840 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f11e2566-74eb-4813-9921-945fbe7681c7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:12:47.789431 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f11e2566-74eb-4813-9921-945fbe7681c7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:12:48.059208 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f11e2566-74eb-4813-9921-945fbe7681c7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c163c13444454c9a23703c08a9cc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8590b56a0c924f76ba18920e735e6b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:12:48.074467 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f11e2566-74eb-4813-9921-945fbe7681c7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20" status: 200 len: 1363 microversion: 2.1 time: 0.298219 Sep 24 21:12:48.075281 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2576/5134] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:12:47 2022] GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20 => generated 1363 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:12:49.104256 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-32c13e1b-9cbf-44e5-a896-2a2c3791b989 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:12:49.106266 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-32c13e1b-9cbf-44e5-a896-2a2c3791b989 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: de9c58e0-4a42-463b-8d44-4f2ac1d55a20] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:12:49.126285 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-32c13e1b-9cbf-44e5-a896-2a2c3791b989 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:12:49.127379 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-32c13e1b-9cbf-44e5-a896-2a2c3791b989 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:12:49.129990 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-32c13e1b-9cbf-44e5-a896-2a2c3791b989 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:12:49.134874 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-32c13e1b-9cbf-44e5-a896-2a2c3791b989 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:12:49.137996 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-32c13e1b-9cbf-44e5-a896-2a2c3791b989 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:12:49.138734 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-32c13e1b-9cbf-44e5-a896-2a2c3791b989 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:12:49.473128 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-32c13e1b-9cbf-44e5-a896-2a2c3791b989 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c163c13444454c9a23703c08a9cc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8590b56a0c924f76ba18920e735e6b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:12:49.491000 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-32c13e1b-9cbf-44e5-a896-2a2c3791b989 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20" status: 200 len: 1550 microversion: 2.1 time: 0.395616 Sep 24 21:12:49.491621 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2559/5135] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:12:49 2022] GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20 => generated 1550 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:12:49.518205 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5620d8ca-9bcb-4185-9716-2f35ecf28345 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:12:49.519429 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5620d8ca-9bcb-4185-9716-2f35ecf28345 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: de9c58e0-4a42-463b-8d44-4f2ac1d55a20] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:12:49.527641 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5620d8ca-9bcb-4185-9716-2f35ecf28345 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:12:49.528471 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5620d8ca-9bcb-4185-9716-2f35ecf28345 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:12:49.529122 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5620d8ca-9bcb-4185-9716-2f35ecf28345 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:12:49.530323 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5620d8ca-9bcb-4185-9716-2f35ecf28345 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:12:49.531008 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5620d8ca-9bcb-4185-9716-2f35ecf28345 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:12:49.531649 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5620d8ca-9bcb-4185-9716-2f35ecf28345 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:12:49.826889 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5620d8ca-9bcb-4185-9716-2f35ecf28345 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.312796 Sep 24 21:12:49.827934 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2577/5136] 10.222.0.52 () {58 vars in 1275 bytes} [Sat Sep 24 21:12:49 2022] GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20/os-interface => generated 285 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:12:54.137157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-4d2d63a9-2e5e-4d78-a903-02a6ac8b5e13 req-eb25a383-7e5a-4a33-9d61-4906dcc89137 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de9c58e0-4a42-463b-8d44-4f2ac1d55a20", "tag": "edbbdbcb-9a85-4000-b01d-2f8b7bf45ed2"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:12:54.153516 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:12:54.165840 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-4d2d63a9-2e5e-4d78-a903-02a6ac8b5e13 req-eb25a383-7e5a-4a33-9d61-4906dcc89137 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:12:54.173084 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-4d2d63a9-2e5e-4d78-a903-02a6ac8b5e13 req-eb25a383-7e5a-4a33-9d61-4906dcc89137 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:12:54.173800 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-4d2d63a9-2e5e-4d78-a903-02a6ac8b5e13 req-eb25a383-7e5a-4a33-9d61-4906dcc89137 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:12:54.223524 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-4d2d63a9-2e5e-4d78-a903-02a6ac8b5e13 req-eb25a383-7e5a-4a33-9d61-4906dcc89137 service nova] Creating event network-changed:edbbdbcb-9a85-4000-b01d-2f8b7bf45ed2 for instance de9c58e0-4a42-463b-8d44-4f2ac1d55a20 on nch1-master-1 Sep 24 21:12:54.251944 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-4d2d63a9-2e5e-4d78-a903-02a6ac8b5e13 req-eb25a383-7e5a-4a33-9d61-4906dcc89137 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118740 Sep 24 21:12:54.253092 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2560/5137] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:13:17.198512 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:13:17.201073 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=48 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:13:17.212761 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-226294f4-c591-4829-b419-5f2acd7873d6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Action: 'create', calling method: .version_select at 0x7f4b07434160>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1148172071", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDP8/8JHiZqeIQvchzAvOCdt8k0sjNf1Iy6gyDjEMMJjIlB8UwaYZAjP06/sFJSZrWCOMFsIcX+/NVG87rxlQdANJ+FjNlJw30G5YnQvg5MniV2X3wn+u7Ma/6BZfPHkQ=="}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:13:17.255713 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-226294f4-c591-4829-b419-5f2acd7873d6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Getting quotas for project 026ea39b3679444a9c3541e58d2e9f7b. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:13:17.290643 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-226294f4-c591-4829-b419-5f2acd7873d6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Getting quotas for user c1acf8d4b1384c8c8d7014bd8baf897e and project 026ea39b3679444a9c3541e58d2e9f7b. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:13:17.349623 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-226294f4-c591-4829-b419-5f2acd7873d6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.152827 Sep 24 21:13:17.350375 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2578/5138] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 21:13:17 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:13:23.035098 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-28302a31-e593-40b3-a810-8b72a5ec11fb tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1831439556", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "85cce92c-ddd7-4f99-9a76-4e56f300f564"}], "key_name": "tempest-TestNetworkBasicOps-1148172071", "security_groups": [{"name": "tempest-secgroup-smoke-407566131"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:13:23.094423 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=36 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:13:23.096243 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:13:23.368125 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-28302a31-e593-40b3-a810-8b72a5ec11fb tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] validate_networks() for [('85cce92c-ddd7-4f99-9a76-4e56f300f564', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:13:25.048568 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-28302a31-e593-40b3-a810-8b72a5ec11fb tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:13:25.049215 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-28302a31-e593-40b3-a810-8b72a5ec11fb tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:13:25.049481 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-28302a31-e593-40b3-a810-8b72a5ec11fb tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:13:25.049904 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-28302a31-e593-40b3-a810-8b72a5ec11fb tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:13:25.050329 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-28302a31-e593-40b3-a810-8b72a5ec11fb tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:13:25.082213 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28302a31-e593-40b3-a810-8b72a5ec11fb tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:13:25.083057 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28302a31-e593-40b3-a810-8b72a5ec11fb tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:13:25.084472 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28302a31-e593-40b3-a810-8b72a5ec11fb tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:13:25.088039 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28302a31-e593-40b3-a810-8b72a5ec11fb tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:13:25.088709 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28302a31-e593-40b3-a810-8b72a5ec11fb tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:13:25.090713 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28302a31-e593-40b3-a810-8b72a5ec11fb tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:13:25.138684 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-28302a31-e593-40b3-a810-8b72a5ec11fb tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Getting quotas for project 026ea39b3679444a9c3541e58d2e9f7b. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:13:25.152512 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-28302a31-e593-40b3-a810-8b72a5ec11fb tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Getting quotas for user c1acf8d4b1384c8c8d7014bd8baf897e and project 026ea39b3679444a9c3541e58d2e9f7b. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:13:25.185686 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-28302a31-e593-40b3-a810-8b72a5ec11fb tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:13:25.194164 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-28302a31-e593-40b3-a810-8b72a5ec11fb tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: ffc72415-a082-4a15-a036-86c522dd437e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:13:25.318067 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-28302a31-e593-40b3-a810-8b72a5ec11fb tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.327156 Sep 24 21:13:25.318786 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2561/5139] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:13:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 2329 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:13:25.332108 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5f28a2cf-d8d9-4627-8ec6-d83a7eda366d tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:13:25.332884 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5f28a2cf-d8d9-4627-8ec6-d83a7eda366d tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: ffc72415-a082-4a15-a036-86c522dd437e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:13:26.449568 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5f28a2cf-d8d9-4627-8ec6-d83a7eda366d tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:13:26.462770 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5f28a2cf-d8d9-4627-8ec6-d83a7eda366d tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e" status: 200 len: 1249 microversion: 2.1 time: 1.136333 Sep 24 21:13:26.466032 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2579/5140] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:13:25 2022] GET /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e => generated 1249 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:13:27.495187 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-327773c1-d4ed-4f76-a7b4-c5d5ecbc9f88 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:13:27.495963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-327773c1-d4ed-4f76-a7b4-c5d5ecbc9f88 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: ffc72415-a082-4a15-a036-86c522dd437e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:13:27.506281 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-327773c1-d4ed-4f76-a7b4-c5d5ecbc9f88 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:13:27.510533 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-327773c1-d4ed-4f76-a7b4-c5d5ecbc9f88 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:13:27.512338 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-327773c1-d4ed-4f76-a7b4-c5d5ecbc9f88 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:13:27.514255 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-327773c1-d4ed-4f76-a7b4-c5d5ecbc9f88 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:13:27.516138 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-327773c1-d4ed-4f76-a7b4-c5d5ecbc9f88 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:13:27.517336 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-327773c1-d4ed-4f76-a7b4-c5d5ecbc9f88 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:13:27.769488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-327773c1-d4ed-4f76-a7b4-c5d5ecbc9f88 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:13:27.786777 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-327773c1-d4ed-4f76-a7b4-c5d5ecbc9f88 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e" status: 200 len: 1309 microversion: 2.1 time: 0.297971 Sep 24 21:13:27.798573 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2562/5141] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:13:27 2022] GET /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e => generated 1309 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:13:28.813333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-346ce4eb-1510-445c-86bc-5531fd4a3ed3 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:13:28.814656 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-346ce4eb-1510-445c-86bc-5531fd4a3ed3 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: ffc72415-a082-4a15-a036-86c522dd437e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:13:28.834189 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-346ce4eb-1510-445c-86bc-5531fd4a3ed3 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:13:28.844624 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-346ce4eb-1510-445c-86bc-5531fd4a3ed3 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:13:28.845094 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-346ce4eb-1510-445c-86bc-5531fd4a3ed3 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:13:28.845858 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-346ce4eb-1510-445c-86bc-5531fd4a3ed3 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:13:28.846335 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-346ce4eb-1510-445c-86bc-5531fd4a3ed3 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:13:28.846797 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-346ce4eb-1510-445c-86bc-5531fd4a3ed3 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:13:28.970283 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-346ce4eb-1510-445c-86bc-5531fd4a3ed3 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:13:28.980097 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-346ce4eb-1510-445c-86bc-5531fd4a3ed3 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e" status: 200 len: 1307 microversion: 2.1 time: 0.169451 Sep 24 21:13:28.980967 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2580/5142] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:13:28 2022] GET /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e => generated 1307 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:13:30.005619 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a93df81f-01bd-46cf-bf37-c1c3374d4c15 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:13:30.006249 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a93df81f-01bd-46cf-bf37-c1c3374d4c15 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: ffc72415-a082-4a15-a036-86c522dd437e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:13:30.029302 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a93df81f-01bd-46cf-bf37-c1c3374d4c15 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:13:30.035198 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a93df81f-01bd-46cf-bf37-c1c3374d4c15 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:13:30.035922 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a93df81f-01bd-46cf-bf37-c1c3374d4c15 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:13:30.036855 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a93df81f-01bd-46cf-bf37-c1c3374d4c15 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:13:30.037498 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a93df81f-01bd-46cf-bf37-c1c3374d4c15 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:13:30.040886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a93df81f-01bd-46cf-bf37-c1c3374d4c15 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:13:30.243179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a93df81f-01bd-46cf-bf37-c1c3374d4c15 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:13:30.253300 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a93df81f-01bd-46cf-bf37-c1c3374d4c15 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e" status: 200 len: 1307 microversion: 2.1 time: 0.251413 Sep 24 21:13:30.254549 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2563/5143] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:13:30 2022] GET /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e => generated 1307 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:13:31.278549 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3142a0a3-4fd1-4eb4-af83-c84bec6fa981 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:13:31.279504 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3142a0a3-4fd1-4eb4-af83-c84bec6fa981 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: ffc72415-a082-4a15-a036-86c522dd437e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:13:31.296103 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3142a0a3-4fd1-4eb4-af83-c84bec6fa981 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:13:31.296918 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3142a0a3-4fd1-4eb4-af83-c84bec6fa981 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:13:31.302168 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3142a0a3-4fd1-4eb4-af83-c84bec6fa981 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:13:31.304665 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3142a0a3-4fd1-4eb4-af83-c84bec6fa981 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:13:31.308140 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3142a0a3-4fd1-4eb4-af83-c84bec6fa981 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:13:31.309168 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3142a0a3-4fd1-4eb4-af83-c84bec6fa981 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:13:31.864540 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3142a0a3-4fd1-4eb4-af83-c84bec6fa981 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:13:31.875122 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3142a0a3-4fd1-4eb4-af83-c84bec6fa981 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e" status: 200 len: 1374 microversion: 2.1 time: 0.600274 Sep 24 21:13:31.892897 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2581/5144] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:13:31 2022] GET /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e => generated 1374 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:13:32.915256 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5ac75188-ed87-4dbf-b8cd-cfb04aaf6c5b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:13:32.917224 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5ac75188-ed87-4dbf-b8cd-cfb04aaf6c5b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: ffc72415-a082-4a15-a036-86c522dd437e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:13:32.945675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ac75188-ed87-4dbf-b8cd-cfb04aaf6c5b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:13:32.948690 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ac75188-ed87-4dbf-b8cd-cfb04aaf6c5b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:13:32.949695 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ac75188-ed87-4dbf-b8cd-cfb04aaf6c5b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:13:32.951004 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ac75188-ed87-4dbf-b8cd-cfb04aaf6c5b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:13:32.952170 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ac75188-ed87-4dbf-b8cd-cfb04aaf6c5b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:13:32.953381 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ac75188-ed87-4dbf-b8cd-cfb04aaf6c5b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:13:33.357060 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5ac75188-ed87-4dbf-b8cd-cfb04aaf6c5b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:13:33.376617 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5ac75188-ed87-4dbf-b8cd-cfb04aaf6c5b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e" status: 200 len: 1374 microversion: 2.1 time: 0.473235 Sep 24 21:13:33.378095 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2564/5145] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:13:32 2022] GET /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e => generated 1374 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:13:34.406405 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-62e0f6bc-25a9-40cf-8ec8-1c3856c5b456 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:13:34.407084 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-62e0f6bc-25a9-40cf-8ec8-1c3856c5b456 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: ffc72415-a082-4a15-a036-86c522dd437e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:13:34.430159 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62e0f6bc-25a9-40cf-8ec8-1c3856c5b456 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:13:34.431177 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62e0f6bc-25a9-40cf-8ec8-1c3856c5b456 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:13:34.431797 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62e0f6bc-25a9-40cf-8ec8-1c3856c5b456 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:13:34.432724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62e0f6bc-25a9-40cf-8ec8-1c3856c5b456 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:13:34.433511 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62e0f6bc-25a9-40cf-8ec8-1c3856c5b456 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:13:34.434109 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62e0f6bc-25a9-40cf-8ec8-1c3856c5b456 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:13:34.840722 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-62e0f6bc-25a9-40cf-8ec8-1c3856c5b456 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:13:34.852922 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-62e0f6bc-25a9-40cf-8ec8-1c3856c5b456 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e" status: 200 len: 1374 microversion: 2.1 time: 0.452534 Sep 24 21:13:34.854222 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2582/5146] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:13:34 2022] GET /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e => generated 1374 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:13:34.919716 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-bec9c303-81ab-4d12-a888-c7e4290fe834 req-70ef9001-51d1-4640-92e6-c3add49f558e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffc72415-a082-4a15-a036-86c522dd437e", "tag": "f45ac4cc-f086-4c47-b06d-f18061694c58"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:13:34.941357 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-bec9c303-81ab-4d12-a888-c7e4290fe834 req-70ef9001-51d1-4640-92e6-c3add49f558e service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:13:34.941856 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-bec9c303-81ab-4d12-a888-c7e4290fe834 req-70ef9001-51d1-4640-92e6-c3add49f558e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:13:34.942761 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-bec9c303-81ab-4d12-a888-c7e4290fe834 req-70ef9001-51d1-4640-92e6-c3add49f558e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:13:34.976908 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-bec9c303-81ab-4d12-a888-c7e4290fe834 req-70ef9001-51d1-4640-92e6-c3add49f558e service nova] Creating event network-changed:f45ac4cc-f086-4c47-b06d-f18061694c58 for instance ffc72415-a082-4a15-a036-86c522dd437e on nch2-master-1 Sep 24 21:13:34.988226 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-bec9c303-81ab-4d12-a888-c7e4290fe834 req-70ef9001-51d1-4640-92e6-c3add49f558e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069852 Sep 24 21:13:34.989624 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2565/5147] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:13:35.881859 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-11271377-57a5-42ab-8fa7-a46f1977d886 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:13:35.885916 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-11271377-57a5-42ab-8fa7-a46f1977d886 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: ffc72415-a082-4a15-a036-86c522dd437e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:13:35.898692 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-11271377-57a5-42ab-8fa7-a46f1977d886 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:13:35.900189 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-11271377-57a5-42ab-8fa7-a46f1977d886 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:13:35.900852 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-11271377-57a5-42ab-8fa7-a46f1977d886 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:13:35.902748 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-11271377-57a5-42ab-8fa7-a46f1977d886 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:13:35.903518 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-11271377-57a5-42ab-8fa7-a46f1977d886 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:13:35.904551 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-11271377-57a5-42ab-8fa7-a46f1977d886 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:13:36.221480 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-11271377-57a5-42ab-8fa7-a46f1977d886 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:13:36.250558 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-11271377-57a5-42ab-8fa7-a46f1977d886 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e" status: 200 len: 1374 microversion: 2.1 time: 0.376500 Sep 24 21:13:36.271148 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2583/5148] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:13:35 2022] GET /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e => generated 1374 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:13:37.281054 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:13:37.282186 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:13:37.301159 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e0a91305-a69b-4b03-a97b-daa8a8ba602a tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:13:37.302663 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e0a91305-a69b-4b03-a97b-daa8a8ba602a tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: ffc72415-a082-4a15-a036-86c522dd437e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:13:37.312356 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e0a91305-a69b-4b03-a97b-daa8a8ba602a tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:13:37.313223 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e0a91305-a69b-4b03-a97b-daa8a8ba602a tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:13:37.314448 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e0a91305-a69b-4b03-a97b-daa8a8ba602a tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:13:37.316977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e0a91305-a69b-4b03-a97b-daa8a8ba602a tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:13:37.317708 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e0a91305-a69b-4b03-a97b-daa8a8ba602a tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:13:37.318319 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e0a91305-a69b-4b03-a97b-daa8a8ba602a tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:13:37.763118 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e0a91305-a69b-4b03-a97b-daa8a8ba602a tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:13:37.772927 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e0a91305-a69b-4b03-a97b-daa8a8ba602a tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e" status: 200 len: 1374 microversion: 2.1 time: 0.493982 Sep 24 21:13:37.790869 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2566/5149] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:13:37 2022] GET /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e => generated 1374 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:13:38.798122 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-633c7e31-fdde-463a-ac09-6f1e7f34f801 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:13:38.799548 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-633c7e31-fdde-463a-ac09-6f1e7f34f801 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: ffc72415-a082-4a15-a036-86c522dd437e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:13:38.802105 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=6 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:13:38.809928 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-633c7e31-fdde-463a-ac09-6f1e7f34f801 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:13:38.811524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-633c7e31-fdde-463a-ac09-6f1e7f34f801 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:13:38.812387 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-633c7e31-fdde-463a-ac09-6f1e7f34f801 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:13:38.813727 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-633c7e31-fdde-463a-ac09-6f1e7f34f801 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:13:38.814431 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-633c7e31-fdde-463a-ac09-6f1e7f34f801 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:13:38.815272 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-633c7e31-fdde-463a-ac09-6f1e7f34f801 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:13:39.500957 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-633c7e31-fdde-463a-ac09-6f1e7f34f801 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:13:39.512764 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-633c7e31-fdde-463a-ac09-6f1e7f34f801 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e" status: 200 len: 1374 microversion: 2.1 time: 0.718948 Sep 24 21:13:39.526688 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2584/5150] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:13:38 2022] GET /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e => generated 1374 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:13:40.541359 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7d88ef55-78b4-4775-a3ed-e2f399ff9d18 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:13:40.542636 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7d88ef55-78b4-4775-a3ed-e2f399ff9d18 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: ffc72415-a082-4a15-a036-86c522dd437e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:13:40.552667 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7d88ef55-78b4-4775-a3ed-e2f399ff9d18 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:13:40.553154 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7d88ef55-78b4-4775-a3ed-e2f399ff9d18 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:13:40.559120 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7d88ef55-78b4-4775-a3ed-e2f399ff9d18 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:13:40.559886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7d88ef55-78b4-4775-a3ed-e2f399ff9d18 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:13:40.560365 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7d88ef55-78b4-4775-a3ed-e2f399ff9d18 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:13:40.560799 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7d88ef55-78b4-4775-a3ed-e2f399ff9d18 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:13:41.146128 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7d88ef55-78b4-4775-a3ed-e2f399ff9d18 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:13:41.157040 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7d88ef55-78b4-4775-a3ed-e2f399ff9d18 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e" status: 200 len: 1374 microversion: 2.1 time: 0.619499 Sep 24 21:13:41.162765 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2567/5151] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:13:40 2022] GET /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e => generated 1374 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:13:41.414762 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-1188a703-aff5-4983-a7a6-0e487ea4ca9d req-c12e1f5a-743d-481a-a349-72f03118b9b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc72415-a082-4a15-a036-86c522dd437e", "name": "network-vif-plugged", "status": "completed", "tag": "f45ac4cc-f086-4c47-b06d-f18061694c58"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:13:41.433767 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-1188a703-aff5-4983-a7a6-0e487ea4ca9d req-c12e1f5a-743d-481a-a349-72f03118b9b9 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:13:41.437714 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-1188a703-aff5-4983-a7a6-0e487ea4ca9d req-c12e1f5a-743d-481a-a349-72f03118b9b9 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:13:41.439889 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-1188a703-aff5-4983-a7a6-0e487ea4ca9d req-c12e1f5a-743d-481a-a349-72f03118b9b9 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:13:41.470186 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-1188a703-aff5-4983-a7a6-0e487ea4ca9d req-c12e1f5a-743d-481a-a349-72f03118b9b9 service nova] Creating event network-vif-plugged:f45ac4cc-f086-4c47-b06d-f18061694c58 for instance ffc72415-a082-4a15-a036-86c522dd437e on nch2-master-1 Sep 24 21:13:41.479028 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-1188a703-aff5-4983-a7a6-0e487ea4ca9d req-c12e1f5a-743d-481a-a349-72f03118b9b9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067916 Sep 24 21:13:41.484978 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2585/5152] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:13:42.192864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-41817c95-c7ca-4504-acdf-37a0812f45d6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:13:42.193498 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-41817c95-c7ca-4504-acdf-37a0812f45d6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: ffc72415-a082-4a15-a036-86c522dd437e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:13:42.204490 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41817c95-c7ca-4504-acdf-37a0812f45d6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:13:42.204996 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41817c95-c7ca-4504-acdf-37a0812f45d6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:13:42.211916 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41817c95-c7ca-4504-acdf-37a0812f45d6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:13:42.213141 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41817c95-c7ca-4504-acdf-37a0812f45d6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:13:42.213800 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41817c95-c7ca-4504-acdf-37a0812f45d6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:13:42.214534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41817c95-c7ca-4504-acdf-37a0812f45d6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:13:42.708389 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-41817c95-c7ca-4504-acdf-37a0812f45d6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:13:42.722657 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-41817c95-c7ca-4504-acdf-37a0812f45d6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e" status: 200 len: 1374 microversion: 2.1 time: 0.536448 Sep 24 21:13:42.738689 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2568/5153] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:13:42 2022] GET /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e => generated 1374 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:13:43.751513 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-baf54b71-c0db-49f2-ac44-4296eec56cba tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:13:43.752989 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-baf54b71-c0db-49f2-ac44-4296eec56cba tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: ffc72415-a082-4a15-a036-86c522dd437e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:13:43.760032 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-baf54b71-c0db-49f2-ac44-4296eec56cba tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:13:43.765666 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-baf54b71-c0db-49f2-ac44-4296eec56cba tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:13:43.766438 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-baf54b71-c0db-49f2-ac44-4296eec56cba tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:13:43.768350 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-baf54b71-c0db-49f2-ac44-4296eec56cba tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:13:43.772921 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-baf54b71-c0db-49f2-ac44-4296eec56cba tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:13:43.773608 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-baf54b71-c0db-49f2-ac44-4296eec56cba tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:13:44.157967 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-baf54b71-c0db-49f2-ac44-4296eec56cba tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:13:44.167534 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-baf54b71-c0db-49f2-ac44-4296eec56cba tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e" status: 200 len: 1546 microversion: 2.1 time: 0.422138 Sep 24 21:13:44.168337 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2586/5154] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:13:43 2022] GET /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e => generated 1546 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:13:44.191805 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7ec96901-0867-4836-98e2-43d7d50e9c7f tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:13:44.192428 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7ec96901-0867-4836-98e2-43d7d50e9c7f tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: ffc72415-a082-4a15-a036-86c522dd437e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:13:44.199341 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ec96901-0867-4836-98e2-43d7d50e9c7f tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:13:44.200069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ec96901-0867-4836-98e2-43d7d50e9c7f tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:13:44.200699 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ec96901-0867-4836-98e2-43d7d50e9c7f tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:13:44.201651 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ec96901-0867-4836-98e2-43d7d50e9c7f tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:13:44.202121 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ec96901-0867-4836-98e2-43d7d50e9c7f tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:13:44.202741 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ec96901-0867-4836-98e2-43d7d50e9c7f tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:13:44.346476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7ec96901-0867-4836-98e2-43d7d50e9c7f tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:13:44.354486 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7ec96901-0867-4836-98e2-43d7d50e9c7f tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e" status: 200 len: 1546 microversion: 2.1 time: 0.166662 Sep 24 21:13:44.355296 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2569/5155] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:13:44 2022] GET /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e => generated 1546 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:13:47.660832 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-88797ac3-ab09-4d33-a00f-7e42e73a4277 req-f391db66-1e4d-4014-ac8c-80628f410d5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffc72415-a082-4a15-a036-86c522dd437e", "tag": "f45ac4cc-f086-4c47-b06d-f18061694c58"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:13:47.682999 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:13:47.701245 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-88797ac3-ab09-4d33-a00f-7e42e73a4277 req-f391db66-1e4d-4014-ac8c-80628f410d5e service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:13:47.702997 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-88797ac3-ab09-4d33-a00f-7e42e73a4277 req-f391db66-1e4d-4014-ac8c-80628f410d5e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:13:47.705121 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-88797ac3-ab09-4d33-a00f-7e42e73a4277 req-f391db66-1e4d-4014-ac8c-80628f410d5e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:13:47.726243 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-88797ac3-ab09-4d33-a00f-7e42e73a4277 req-f391db66-1e4d-4014-ac8c-80628f410d5e service nova] Creating event network-changed:f45ac4cc-f086-4c47-b06d-f18061694c58 for instance ffc72415-a082-4a15-a036-86c522dd437e on nch2-master-1 Sep 24 21:13:47.731387 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-88797ac3-ab09-4d33-a00f-7e42e73a4277 req-f391db66-1e4d-4014-ac8c-80628f410d5e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074121 Sep 24 21:13:47.733217 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2587/5156] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:13:55.616741 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5e92f1a6-19e2-473c-94e8-98d3f05f15bd tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:13:55.617842 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5e92f1a6-19e2-473c-94e8-98d3f05f15bd tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: de9c58e0-4a42-463b-8d44-4f2ac1d55a20] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:13:55.628204 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:13:55.647285 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=46 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:13:55.650897 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e92f1a6-19e2-473c-94e8-98d3f05f15bd tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:13:55.652367 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e92f1a6-19e2-473c-94e8-98d3f05f15bd tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:13:55.655782 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e92f1a6-19e2-473c-94e8-98d3f05f15bd tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:13:55.666630 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e92f1a6-19e2-473c-94e8-98d3f05f15bd tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:13:55.674147 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e92f1a6-19e2-473c-94e8-98d3f05f15bd tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:13:55.675188 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e92f1a6-19e2-473c-94e8-98d3f05f15bd tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:13:55.745734 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5e92f1a6-19e2-473c-94e8-98d3f05f15bd tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20/ips" status: 200 len: 147 microversion: 2.1 time: 0.133627 Sep 24 21:13:55.767114 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2570/5157] 10.222.0.52 () {58 vars in 1248 bytes} [Sat Sep 24 21:13:55 2022] GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20/ips => generated 147 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:13:58.496219 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=40 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:13:58.505447 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-26ee2b5a-a696-473e-95e9-1c9bcb98080a tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:13:58.506092 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-26ee2b5a-a696-473e-95e9-1c9bcb98080a tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: de9c58e0-4a42-463b-8d44-4f2ac1d55a20] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:13:58.514916 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26ee2b5a-a696-473e-95e9-1c9bcb98080a tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:13:58.515168 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26ee2b5a-a696-473e-95e9-1c9bcb98080a tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:13:58.515483 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26ee2b5a-a696-473e-95e9-1c9bcb98080a tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:13:58.516468 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26ee2b5a-a696-473e-95e9-1c9bcb98080a tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:13:58.516942 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26ee2b5a-a696-473e-95e9-1c9bcb98080a tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:13:58.517382 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26ee2b5a-a696-473e-95e9-1c9bcb98080a tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:13:58.571062 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-26ee2b5a-a696-473e-95e9-1c9bcb98080a tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: de9c58e0-4a42-463b-8d44-4f2ac1d55a20] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:13:58.711942 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-26ee2b5a-a696-473e-95e9-1c9bcb98080a tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "DELETE /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20" status: 204 len: 0 microversion: 2.1 time: 0.219360 Sep 24 21:13:58.717421 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2588/5158] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:13:58 2022] DELETE /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:13:58.722115 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b49956c1-4ec6-4929-8eac-42652b11f345 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:13:58.723887 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b49956c1-4ec6-4929-8eac-42652b11f345 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: de9c58e0-4a42-463b-8d44-4f2ac1d55a20] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:13:58.747147 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b49956c1-4ec6-4929-8eac-42652b11f345 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:13:58.748317 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b49956c1-4ec6-4929-8eac-42652b11f345 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:13:58.748784 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b49956c1-4ec6-4929-8eac-42652b11f345 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:13:58.752649 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b49956c1-4ec6-4929-8eac-42652b11f345 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:13:58.753046 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b49956c1-4ec6-4929-8eac-42652b11f345 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:13:58.753799 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b49956c1-4ec6-4929-8eac-42652b11f345 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:13:59.052270 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b49956c1-4ec6-4929-8eac-42652b11f345 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c163c13444454c9a23703c08a9cc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8590b56a0c924f76ba18920e735e6b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:13:59.062431 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b49956c1-4ec6-4929-8eac-42652b11f345 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20" status: 200 len: 1675 microversion: 2.1 time: 0.344731 Sep 24 21:13:59.065165 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2571/5159] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:13:58 2022] GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20 => generated 1675 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:14:00.093299 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9264bdba-878f-4b5d-85dc-28c1ffab71f7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:14:00.095401 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9264bdba-878f-4b5d-85dc-28c1ffab71f7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: de9c58e0-4a42-463b-8d44-4f2ac1d55a20] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:14:00.106803 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9264bdba-878f-4b5d-85dc-28c1ffab71f7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:00.107814 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9264bdba-878f-4b5d-85dc-28c1ffab71f7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:00.108472 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9264bdba-878f-4b5d-85dc-28c1ffab71f7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:00.109553 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9264bdba-878f-4b5d-85dc-28c1ffab71f7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:00.110296 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9264bdba-878f-4b5d-85dc-28c1ffab71f7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:00.111164 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9264bdba-878f-4b5d-85dc-28c1ffab71f7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:00.418994 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9264bdba-878f-4b5d-85dc-28c1ffab71f7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c163c13444454c9a23703c08a9cc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8590b56a0c924f76ba18920e735e6b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:14:00.428029 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9264bdba-878f-4b5d-85dc-28c1ffab71f7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20" status: 200 len: 1675 microversion: 2.1 time: 0.342518 Sep 24 21:14:00.428722 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2589/5160] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:14:00 2022] GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20 => generated 1675 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:14:01.453307 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a88912f3-4985-48ce-b5a2-1b4f74a9c752 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:14:01.453937 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a88912f3-4985-48ce-b5a2-1b4f74a9c752 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: de9c58e0-4a42-463b-8d44-4f2ac1d55a20] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:14:01.463461 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a88912f3-4985-48ce-b5a2-1b4f74a9c752 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:01.463725 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a88912f3-4985-48ce-b5a2-1b4f74a9c752 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:01.464168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a88912f3-4985-48ce-b5a2-1b4f74a9c752 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:01.464886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a88912f3-4985-48ce-b5a2-1b4f74a9c752 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:01.465349 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a88912f3-4985-48ce-b5a2-1b4f74a9c752 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:01.466089 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a88912f3-4985-48ce-b5a2-1b4f74a9c752 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:01.734691 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a88912f3-4985-48ce-b5a2-1b4f74a9c752 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c163c13444454c9a23703c08a9cc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8590b56a0c924f76ba18920e735e6b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:14:01.760820 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a88912f3-4985-48ce-b5a2-1b4f74a9c752 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20" status: 200 len: 1675 microversion: 2.1 time: 0.308227 Sep 24 21:14:01.761458 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2572/5161] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:14:01 2022] GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20 => generated 1675 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:14:02.787871 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c087b0af-b9f9-4253-a7c8-2d4d1304a393 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:14:02.788504 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c087b0af-b9f9-4253-a7c8-2d4d1304a393 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: de9c58e0-4a42-463b-8d44-4f2ac1d55a20] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:14:02.802717 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c087b0af-b9f9-4253-a7c8-2d4d1304a393 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:02.803553 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c087b0af-b9f9-4253-a7c8-2d4d1304a393 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:02.804186 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c087b0af-b9f9-4253-a7c8-2d4d1304a393 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:02.807435 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c087b0af-b9f9-4253-a7c8-2d4d1304a393 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:02.808307 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c087b0af-b9f9-4253-a7c8-2d4d1304a393 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:02.808898 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c087b0af-b9f9-4253-a7c8-2d4d1304a393 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:03.034445 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c087b0af-b9f9-4253-a7c8-2d4d1304a393 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c163c13444454c9a23703c08a9cc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8590b56a0c924f76ba18920e735e6b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:14:03.046127 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c087b0af-b9f9-4253-a7c8-2d4d1304a393 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20" status: 200 len: 1608 microversion: 2.1 time: 0.261104 Sep 24 21:14:03.070610 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2590/5162] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:14:02 2022] GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20 => generated 1608 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:14:03.372004 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-77346896-f589-4915-9e1e-f7016422e6c6 req-b60d1eca-6520-4080-996d-892314321a97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de9c58e0-4a42-463b-8d44-4f2ac1d55a20", "name": "network-vif-deleted", "tag": "edbbdbcb-9a85-4000-b01d-2f8b7bf45ed2"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:14:03.393353 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-77346896-f589-4915-9e1e-f7016422e6c6 req-b60d1eca-6520-4080-996d-892314321a97 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:03.395324 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-77346896-f589-4915-9e1e-f7016422e6c6 req-b60d1eca-6520-4080-996d-892314321a97 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:03.397482 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-77346896-f589-4915-9e1e-f7016422e6c6 req-b60d1eca-6520-4080-996d-892314321a97 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:03.430097 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-77346896-f589-4915-9e1e-f7016422e6c6 req-b60d1eca-6520-4080-996d-892314321a97 service nova] Creating event network-vif-deleted:edbbdbcb-9a85-4000-b01d-2f8b7bf45ed2 for instance de9c58e0-4a42-463b-8d44-4f2ac1d55a20 on nch1-master-1 Sep 24 21:14:03.448792 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-77346896-f589-4915-9e1e-f7016422e6c6 req-b60d1eca-6520-4080-996d-892314321a97 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077546 Sep 24 21:14:03.451553 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2573/5163] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:14:04.084331 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7b3a0928-1a63-4be4-b687-8875c83ac135 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:14:04.086114 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7b3a0928-1a63-4be4-b687-8875c83ac135 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: de9c58e0-4a42-463b-8d44-4f2ac1d55a20] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:14:04.094596 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b3a0928-1a63-4be4-b687-8875c83ac135 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:04.095410 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b3a0928-1a63-4be4-b687-8875c83ac135 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:04.096320 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b3a0928-1a63-4be4-b687-8875c83ac135 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:04.097780 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b3a0928-1a63-4be4-b687-8875c83ac135 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:04.098531 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b3a0928-1a63-4be4-b687-8875c83ac135 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:04.099450 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b3a0928-1a63-4be4-b687-8875c83ac135 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:04.118703 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-7b3a0928-1a63-4be4-b687-8875c83ac135 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] HTTP exception thrown: Instance de9c58e0-4a42-463b-8d44-4f2ac1d55a20 could not be found. Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7b3a0928-1a63-4be4-b687-8875c83ac135 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Request method failure captured: Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20 HTTP/1.1 Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3K1nf_HBYtZAmOWJb9X8T8-52HS4-bJBgE0FO69QBXQac8VM7cR_F2qW00AIk7g1CUKO4_BQ_Tfhidimc8mSjzdF5nPccqRruIVq_qrXf1-hDH63yPrbl6WwwFBAVYQLcPo8zGr8HRbhqHfflQP76-UovOPa_Fff7McW4FVNGSk9s4 Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 8590b56a0c924f76ba18920e735e6b4d Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-AttachVolumeTestJSON-1763919755 Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8590b56a0c924f76ba18920e735e6b4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8590b56a0c924f76ba18920e735e6b4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8590b56a0c924f76ba18920e735e6b4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8590b56a0c924f76ba18920e735e6b4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-AttachVolumeTestJSON-1763919755 Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 8590b56a0c924f76ba18920e735e6b4d Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1763919755 Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-AttachVolumeTestJSON-1763919755-project Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 57c163c13444454c9a23703c08a9cc5a Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-AttachVolumeTestJSON-1763919755-project Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance de9c58e0-4a42-463b-8d44-4f2ac1d55a20 could not be found. Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'de9c58e0-4a42-463b-8d44-4f2ac1d55a20'} Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de9c58e0-4a42-463b-8d44-4f2ac1d55a20 could not be found. Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de9c58e0-4a42-463b-8d44-4f2ac1d55a20 could not be found. Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:14:04.120901 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:14:04.126236 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:14:04.126236 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:14:04.126236 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:14:04.126236 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:14:04.126236 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:14:04.126236 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de9c58e0-4a42-463b-8d44-4f2ac1d55a20 could not be found. Sep 24 21:14:04.126236 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:14:04.128911 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7b3a0928-1a63-4be4-b687-8875c83ac135 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Returning 404 to user: Instance de9c58e0-4a42-463b-8d44-4f2ac1d55a20 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:14:04.130000 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7b3a0928-1a63-4be4-b687-8875c83ac135 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20" status: 404 len: 111 microversion: 2.1 time: 0.049582 Sep 24 21:14:04.131186 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2591/5164] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:14:04 2022] GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:14:04.141321 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b6c10e1f-302f-4111-80eb-e8b83846ce5a tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '.version_select at 0x7f4b07455940>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:14:04.180243 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b6c10e1f-302f-4111-80eb-e8b83846ce5a tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1724777043" status: 202 len: 0 microversion: 2.1 time: 0.042147 Sep 24 21:14:04.182816 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2574/5165] 10.222.0.52 () {58 vars in 1221 bytes} [Sat Sep 24 21:14:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1724777043 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:14:06.426679 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2c42679f-9336-4b6e-9880-cdf7c5861270 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Action: 'create', calling method: .version_select at 0x7f4b07437670>, body: {"keypair": {"name": "tempest-keypair-1219694105", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcL6uLbP359DNLk5iJ7i8V3okWg0KP/59Tl+p7xg4+GMTFmwPmns+ee4wcYCj1mzvkr9MOvcGO/BzrVF3LIeoQ7jNGFE0JB/5h/6ZPQNC7Q0TXK/cWkfPQnPBDi9yAE6g=="}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:14:06.448484 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-2c42679f-9336-4b6e-9880-cdf7c5861270 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Getting quotas for project 8590b56a0c924f76ba18920e735e6b4d. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:14:06.456645 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-2c42679f-9336-4b6e-9880-cdf7c5861270 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Getting quotas for user 57c163c13444454c9a23703c08a9cc5a and project 8590b56a0c924f76ba18920e735e6b4d. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:14:06.490382 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2c42679f-9336-4b6e-9880-cdf7c5861270 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.069371 Sep 24 21:14:06.499498 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2592/5166] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 21:14:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:14:08.361070 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-07c7df59-85ee-48c0-92f7-c7b14f97d659 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:14:08.363597 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-07c7df59-85ee-48c0-92f7-c7b14f97d659 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: ffc72415-a082-4a15-a036-86c522dd437e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:14:08.372008 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07c7df59-85ee-48c0-92f7-c7b14f97d659 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:08.373165 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07c7df59-85ee-48c0-92f7-c7b14f97d659 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:08.373622 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07c7df59-85ee-48c0-92f7-c7b14f97d659 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:08.374375 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07c7df59-85ee-48c0-92f7-c7b14f97d659 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:08.374873 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07c7df59-85ee-48c0-92f7-c7b14f97d659 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:08.375497 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07c7df59-85ee-48c0-92f7-c7b14f97d659 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:08.454345 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-07c7df59-85ee-48c0-92f7-c7b14f97d659 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "POST /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e/action" status: 200 len: 24569 microversion: 2.1 time: 0.098296 Sep 24 21:14:08.455193 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2575/5167] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:14:08 2022] POST /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e/action => generated 24569 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:14:08.816271 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c9d05f86-74f2-42ec-b9b2-c0318b93b38e tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1255498507", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a162c3f9-67fd-43a6-90ef-ab00f099918b"}], "security_groups": [{"name": "tempest-securitygroup--605826644"}], "key_name": "tempest-keypair-1219694105", "user_data": "}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:14:09.065213 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-c9d05f86-74f2-42ec-b9b2-c0318b93b38e tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] validate_networks() for [('a162c3f9-67fd-43a6-90ef-ab00f099918b', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:14:10.960403 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-c9d05f86-74f2-42ec-b9b2-c0318b93b38e tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:14:10.961889 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-c9d05f86-74f2-42ec-b9b2-c0318b93b38e tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:14:10.962727 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-c9d05f86-74f2-42ec-b9b2-c0318b93b38e tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:14:10.976729 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-c9d05f86-74f2-42ec-b9b2-c0318b93b38e tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:14:10.979985 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-c9d05f86-74f2-42ec-b9b2-c0318b93b38e tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:14:10.999130 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c9d05f86-74f2-42ec-b9b2-c0318b93b38e tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:10.999621 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c9d05f86-74f2-42ec-b9b2-c0318b93b38e tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:11.000505 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c9d05f86-74f2-42ec-b9b2-c0318b93b38e tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:11.001677 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c9d05f86-74f2-42ec-b9b2-c0318b93b38e tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:11.002164 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c9d05f86-74f2-42ec-b9b2-c0318b93b38e tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:11.003841 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c9d05f86-74f2-42ec-b9b2-c0318b93b38e tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:11.036200 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-c9d05f86-74f2-42ec-b9b2-c0318b93b38e tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Getting quotas for project 8590b56a0c924f76ba18920e735e6b4d. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:14:11.050792 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-c9d05f86-74f2-42ec-b9b2-c0318b93b38e tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Getting quotas for user 57c163c13444454c9a23703c08a9cc5a and project 8590b56a0c924f76ba18920e735e6b4d. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:14:11.072976 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c9d05f86-74f2-42ec-b9b2-c0318b93b38e tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:14:11.077545 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c9d05f86-74f2-42ec-b9b2-c0318b93b38e tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: 6029de15-fd98-4be1-8c3d-7d63be381363] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:14:11.173486 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c9d05f86-74f2-42ec-b9b2-c0318b93b38e tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.364757 Sep 24 21:14:11.174151 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2593/5168] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:14:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 2367 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:14:11.186709 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fe03488e-cf7b-4378-a731-222518e387a8 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:14:11.188242 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fe03488e-cf7b-4378-a731-222518e387a8 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: 6029de15-fd98-4be1-8c3d-7d63be381363] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:14:11.392228 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fe03488e-cf7b-4378-a731-222518e387a8 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c163c13444454c9a23703c08a9cc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8590b56a0c924f76ba18920e735e6b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:14:11.399914 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fe03488e-cf7b-4378-a731-222518e387a8 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363" status: 200 len: 1238 microversion: 2.1 time: 0.218263 Sep 24 21:14:11.404945 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2576/5169] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:14:11 2022] GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363 => generated 1238 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:14:12.429383 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4745fb0f-f28f-4b06-b27c-8366191e63de tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:14:12.431231 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4745fb0f-f28f-4b06-b27c-8366191e63de tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: 6029de15-fd98-4be1-8c3d-7d63be381363] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:14:12.439187 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4745fb0f-f28f-4b06-b27c-8366191e63de tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:12.439976 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4745fb0f-f28f-4b06-b27c-8366191e63de tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:12.440790 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4745fb0f-f28f-4b06-b27c-8366191e63de tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:12.441776 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4745fb0f-f28f-4b06-b27c-8366191e63de tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:12.442420 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4745fb0f-f28f-4b06-b27c-8366191e63de tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:12.443041 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4745fb0f-f28f-4b06-b27c-8366191e63de tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:12.631531 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4745fb0f-f28f-4b06-b27c-8366191e63de tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c163c13444454c9a23703c08a9cc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8590b56a0c924f76ba18920e735e6b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:14:12.644589 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4745fb0f-f28f-4b06-b27c-8366191e63de tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363" status: 200 len: 1290 microversion: 2.1 time: 0.221233 Sep 24 21:14:12.666425 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2594/5170] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:14:12 2022] GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363 => generated 1290 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:14:13.673473 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a25a37c4-e3da-4d46-8971-2e1a9b53068d tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:14:13.675256 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a25a37c4-e3da-4d46-8971-2e1a9b53068d tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: 6029de15-fd98-4be1-8c3d-7d63be381363] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:14:13.686351 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a25a37c4-e3da-4d46-8971-2e1a9b53068d tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:13.687319 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a25a37c4-e3da-4d46-8971-2e1a9b53068d tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:13.687942 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a25a37c4-e3da-4d46-8971-2e1a9b53068d tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:13.689145 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a25a37c4-e3da-4d46-8971-2e1a9b53068d tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:13.690020 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a25a37c4-e3da-4d46-8971-2e1a9b53068d tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:13.690661 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a25a37c4-e3da-4d46-8971-2e1a9b53068d tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:13.891315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a25a37c4-e3da-4d46-8971-2e1a9b53068d tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c163c13444454c9a23703c08a9cc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8590b56a0c924f76ba18920e735e6b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:14:13.904148 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a25a37c4-e3da-4d46-8971-2e1a9b53068d tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363" status: 200 len: 1296 microversion: 2.1 time: 0.236608 Sep 24 21:14:13.911929 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2577/5171] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:14:13 2022] GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363 => generated 1296 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:14:14.935613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-877a82f6-e386-4e22-a084-dc7d8a90ee07 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:14:14.937032 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-877a82f6-e386-4e22-a084-dc7d8a90ee07 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: 6029de15-fd98-4be1-8c3d-7d63be381363] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:14:14.951919 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-877a82f6-e386-4e22-a084-dc7d8a90ee07 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:14.953624 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-877a82f6-e386-4e22-a084-dc7d8a90ee07 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:14.954272 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-877a82f6-e386-4e22-a084-dc7d8a90ee07 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:14.957865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-877a82f6-e386-4e22-a084-dc7d8a90ee07 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:14.958756 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-877a82f6-e386-4e22-a084-dc7d8a90ee07 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:14.960846 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-877a82f6-e386-4e22-a084-dc7d8a90ee07 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:15.147413 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-877a82f6-e386-4e22-a084-dc7d8a90ee07 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c163c13444454c9a23703c08a9cc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8590b56a0c924f76ba18920e735e6b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:14:15.165336 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-877a82f6-e386-4e22-a084-dc7d8a90ee07 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363" status: 200 len: 1296 microversion: 2.1 time: 0.231248 Sep 24 21:14:15.166391 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2595/5172] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:14:14 2022] GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363 => generated 1296 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:14:16.200644 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fe334b55-39ad-4730-848e-1dbc37222c5a tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:14:16.201279 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fe334b55-39ad-4730-848e-1dbc37222c5a tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: 6029de15-fd98-4be1-8c3d-7d63be381363] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:14:16.218085 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fe334b55-39ad-4730-848e-1dbc37222c5a tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:16.223933 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fe334b55-39ad-4730-848e-1dbc37222c5a tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:16.227393 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fe334b55-39ad-4730-848e-1dbc37222c5a tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:16.228185 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fe334b55-39ad-4730-848e-1dbc37222c5a tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:16.228670 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fe334b55-39ad-4730-848e-1dbc37222c5a tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:16.229112 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fe334b55-39ad-4730-848e-1dbc37222c5a tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:16.865870 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fe334b55-39ad-4730-848e-1dbc37222c5a tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c163c13444454c9a23703c08a9cc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8590b56a0c924f76ba18920e735e6b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:14:16.882067 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fe334b55-39ad-4730-848e-1dbc37222c5a tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363" status: 200 len: 1363 microversion: 2.1 time: 0.681017 Sep 24 21:14:16.884037 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2578/5173] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:14:16 2022] GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363 => generated 1363 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:14:17.910856 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4e325490-2600-4396-8df6-0b5827aef1b5 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:14:17.911464 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4e325490-2600-4396-8df6-0b5827aef1b5 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: 6029de15-fd98-4be1-8c3d-7d63be381363] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:14:17.922286 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e325490-2600-4396-8df6-0b5827aef1b5 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:17.922816 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e325490-2600-4396-8df6-0b5827aef1b5 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:17.923261 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e325490-2600-4396-8df6-0b5827aef1b5 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:17.923981 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e325490-2600-4396-8df6-0b5827aef1b5 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:17.924441 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e325490-2600-4396-8df6-0b5827aef1b5 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:17.924874 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4e325490-2600-4396-8df6-0b5827aef1b5 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:18.255483 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4e325490-2600-4396-8df6-0b5827aef1b5 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c163c13444454c9a23703c08a9cc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8590b56a0c924f76ba18920e735e6b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:14:18.273754 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4e325490-2600-4396-8df6-0b5827aef1b5 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363" status: 200 len: 1363 microversion: 2.1 time: 0.367064 Sep 24 21:14:18.306613 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2596/5174] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:14:17 2022] GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363 => generated 1363 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:14:19.069793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-6f963b85-5466-48de-9352-0b65594d6adf req-ea1e0995-2310-4ff4-9984-f57574c19a12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6029de15-fd98-4be1-8c3d-7d63be381363", "tag": "d73312e8-32fb-499c-b5d9-1b6927e0b7ea"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:14:19.105072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-6f963b85-5466-48de-9352-0b65594d6adf req-ea1e0995-2310-4ff4-9984-f57574c19a12 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:19.105910 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-6f963b85-5466-48de-9352-0b65594d6adf req-ea1e0995-2310-4ff4-9984-f57574c19a12 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:19.108685 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-6f963b85-5466-48de-9352-0b65594d6adf req-ea1e0995-2310-4ff4-9984-f57574c19a12 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:19.152445 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-6f963b85-5466-48de-9352-0b65594d6adf req-ea1e0995-2310-4ff4-9984-f57574c19a12 service nova] Creating event network-changed:d73312e8-32fb-499c-b5d9-1b6927e0b7ea for instance 6029de15-fd98-4be1-8c3d-7d63be381363 on nch1-master-1 Sep 24 21:14:19.166718 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-6f963b85-5466-48de-9352-0b65594d6adf req-ea1e0995-2310-4ff4-9984-f57574c19a12 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099583 Sep 24 21:14:19.167516 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2579/5175] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:14:19.337434 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-78803a5c-45d1-41fe-b1e7-1a1c5e1e0087 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:14:19.338381 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-78803a5c-45d1-41fe-b1e7-1a1c5e1e0087 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: 6029de15-fd98-4be1-8c3d-7d63be381363] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:14:19.351555 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78803a5c-45d1-41fe-b1e7-1a1c5e1e0087 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:19.353004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78803a5c-45d1-41fe-b1e7-1a1c5e1e0087 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:19.353450 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78803a5c-45d1-41fe-b1e7-1a1c5e1e0087 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:19.355375 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78803a5c-45d1-41fe-b1e7-1a1c5e1e0087 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:19.358685 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78803a5c-45d1-41fe-b1e7-1a1c5e1e0087 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:19.359718 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78803a5c-45d1-41fe-b1e7-1a1c5e1e0087 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:19.836466 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-78803a5c-45d1-41fe-b1e7-1a1c5e1e0087 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c163c13444454c9a23703c08a9cc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8590b56a0c924f76ba18920e735e6b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:14:19.853733 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-78803a5c-45d1-41fe-b1e7-1a1c5e1e0087 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363" status: 200 len: 1363 microversion: 2.1 time: 0.522278 Sep 24 21:14:19.857042 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2597/5176] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:14:19 2022] GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363 => generated 1363 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:14:20.883252 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ae5bfbdd-bdd4-407e-bcf3-9232640232ae tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:14:20.884991 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ae5bfbdd-bdd4-407e-bcf3-9232640232ae tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: 6029de15-fd98-4be1-8c3d-7d63be381363] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:14:20.902154 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ae5bfbdd-bdd4-407e-bcf3-9232640232ae tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:20.905033 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ae5bfbdd-bdd4-407e-bcf3-9232640232ae tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:20.905932 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ae5bfbdd-bdd4-407e-bcf3-9232640232ae tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:20.906944 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ae5bfbdd-bdd4-407e-bcf3-9232640232ae tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:20.909716 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ae5bfbdd-bdd4-407e-bcf3-9232640232ae tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:20.910829 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ae5bfbdd-bdd4-407e-bcf3-9232640232ae tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:21.385854 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ae5bfbdd-bdd4-407e-bcf3-9232640232ae tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c163c13444454c9a23703c08a9cc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8590b56a0c924f76ba18920e735e6b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:14:21.399188 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ae5bfbdd-bdd4-407e-bcf3-9232640232ae tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363" status: 200 len: 1363 microversion: 2.1 time: 0.521499 Sep 24 21:14:21.405873 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2580/5177] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:14:20 2022] GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363 => generated 1363 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:14:22.435172 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9fd6b387-6d62-4142-80b0-1977b7a78b80 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:14:22.436564 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9fd6b387-6d62-4142-80b0-1977b7a78b80 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: 6029de15-fd98-4be1-8c3d-7d63be381363] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:14:22.461734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:14:22.464244 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=10 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:14:22.472342 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fd6b387-6d62-4142-80b0-1977b7a78b80 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:22.474277 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fd6b387-6d62-4142-80b0-1977b7a78b80 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:22.477109 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fd6b387-6d62-4142-80b0-1977b7a78b80 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:22.479740 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fd6b387-6d62-4142-80b0-1977b7a78b80 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:22.481554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fd6b387-6d62-4142-80b0-1977b7a78b80 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:22.482289 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9fd6b387-6d62-4142-80b0-1977b7a78b80 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:23.070621 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9fd6b387-6d62-4142-80b0-1977b7a78b80 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c163c13444454c9a23703c08a9cc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8590b56a0c924f76ba18920e735e6b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:14:23.083151 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9fd6b387-6d62-4142-80b0-1977b7a78b80 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363" status: 200 len: 1363 microversion: 2.1 time: 0.655790 Sep 24 21:14:23.084895 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2598/5178] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:14:22 2022] GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363 => generated 1363 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:14:24.111803 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ed1bc1b2-583b-45d8-a4bf-ff5ea4da9114 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:14:24.112440 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ed1bc1b2-583b-45d8-a4bf-ff5ea4da9114 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: 6029de15-fd98-4be1-8c3d-7d63be381363] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:14:24.114526 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:14:24.130005 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed1bc1b2-583b-45d8-a4bf-ff5ea4da9114 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:24.130580 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed1bc1b2-583b-45d8-a4bf-ff5ea4da9114 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:24.139090 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed1bc1b2-583b-45d8-a4bf-ff5ea4da9114 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:24.139878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed1bc1b2-583b-45d8-a4bf-ff5ea4da9114 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:24.140361 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed1bc1b2-583b-45d8-a4bf-ff5ea4da9114 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:24.140961 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed1bc1b2-583b-45d8-a4bf-ff5ea4da9114 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:24.946754 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ed1bc1b2-583b-45d8-a4bf-ff5ea4da9114 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c163c13444454c9a23703c08a9cc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8590b56a0c924f76ba18920e735e6b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:14:24.966561 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ed1bc1b2-583b-45d8-a4bf-ff5ea4da9114 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363" status: 200 len: 1363 microversion: 2.1 time: 0.858511 Sep 24 21:14:24.968077 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2581/5179] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:14:24 2022] GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363 => generated 1363 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:14:25.998864 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-89d7d396-9fed-4004-aada-5821584a0da5 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:14:25.998864 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-89d7d396-9fed-4004-aada-5821584a0da5 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: 6029de15-fd98-4be1-8c3d-7d63be381363] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:14:26.018775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-89d7d396-9fed-4004-aada-5821584a0da5 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:26.019300 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-89d7d396-9fed-4004-aada-5821584a0da5 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:26.019755 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-89d7d396-9fed-4004-aada-5821584a0da5 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:26.020500 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-89d7d396-9fed-4004-aada-5821584a0da5 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:26.020972 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-89d7d396-9fed-4004-aada-5821584a0da5 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:26.021422 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-89d7d396-9fed-4004-aada-5821584a0da5 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:26.584994 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c7a83f0a-aaa9-4894-9fde-4956618d5804 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Action: 'create', calling method: .version_select at 0x7f4b0745bdc0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1999024207", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkRPVeZ8W9iMikIPjo/qMcCWHulNBh9nqtB7oZHc80kCD2lSMxoPwg1EYnU1j87FShQEJ0msYmFDFeoSPpOo+mbRUzPTNxcQpi2p7AnKIg5CJ4IeTkvH8ctiXZouy2tIw=="}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:14:26.596207 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:14:26.616268 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-c7a83f0a-aaa9-4894-9fde-4956618d5804 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Getting quotas for project 026ea39b3679444a9c3541e58d2e9f7b. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:14:26.628709 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-c7a83f0a-aaa9-4894-9fde-4956618d5804 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Getting quotas for user c1acf8d4b1384c8c8d7014bd8baf897e and project 026ea39b3679444a9c3541e58d2e9f7b. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:14:26.634128 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-89d7d396-9fed-4004-aada-5821584a0da5 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c163c13444454c9a23703c08a9cc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8590b56a0c924f76ba18920e735e6b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:14:26.647986 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-89d7d396-9fed-4004-aada-5821584a0da5 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363" status: 200 len: 1363 microversion: 2.1 time: 0.660698 Sep 24 21:14:26.649881 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2599/5180] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:14:25 2022] GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363 => generated 1363 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:14:26.685048 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c7a83f0a-aaa9-4894-9fde-4956618d5804 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.103787 Sep 24 21:14:26.686296 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2582/5181] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 21:14:26 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:14:27.216308 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-1ebe07d6-51c8-4220-9ad4-7e5c8d2603c2 req-e4440b46-8659-4044-ac4e-6f37d96fce15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6029de15-fd98-4be1-8c3d-7d63be381363", "name": "network-vif-plugged", "status": "completed", "tag": "d73312e8-32fb-499c-b5d9-1b6927e0b7ea"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:14:27.245167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-1ebe07d6-51c8-4220-9ad4-7e5c8d2603c2 req-e4440b46-8659-4044-ac4e-6f37d96fce15 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:27.247227 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-1ebe07d6-51c8-4220-9ad4-7e5c8d2603c2 req-e4440b46-8659-4044-ac4e-6f37d96fce15 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:27.248591 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-1ebe07d6-51c8-4220-9ad4-7e5c8d2603c2 req-e4440b46-8659-4044-ac4e-6f37d96fce15 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:27.269249 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-1ebe07d6-51c8-4220-9ad4-7e5c8d2603c2 req-e4440b46-8659-4044-ac4e-6f37d96fce15 service nova] Creating event network-vif-plugged:d73312e8-32fb-499c-b5d9-1b6927e0b7ea for instance 6029de15-fd98-4be1-8c3d-7d63be381363 on nch1-master-1 Sep 24 21:14:27.281276 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-1ebe07d6-51c8-4220-9ad4-7e5c8d2603c2 req-e4440b46-8659-4044-ac4e-6f37d96fce15 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085726 Sep 24 21:14:27.282850 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2600/5182] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:14:27.677078 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-71bb9fce-0256-4845-85a4-4c25439d46e3 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:14:27.679315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-71bb9fce-0256-4845-85a4-4c25439d46e3 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: 6029de15-fd98-4be1-8c3d-7d63be381363] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:14:27.688603 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71bb9fce-0256-4845-85a4-4c25439d46e3 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:27.689223 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71bb9fce-0256-4845-85a4-4c25439d46e3 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:27.689923 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71bb9fce-0256-4845-85a4-4c25439d46e3 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:27.691306 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71bb9fce-0256-4845-85a4-4c25439d46e3 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:27.693602 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71bb9fce-0256-4845-85a4-4c25439d46e3 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:27.694677 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-71bb9fce-0256-4845-85a4-4c25439d46e3 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:27.698735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=49 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:14:28.108939 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-71bb9fce-0256-4845-85a4-4c25439d46e3 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c163c13444454c9a23703c08a9cc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8590b56a0c924f76ba18920e735e6b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:14:28.118527 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-71bb9fce-0256-4845-85a4-4c25439d46e3 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363" status: 200 len: 1363 microversion: 2.1 time: 0.445538 Sep 24 21:14:28.120165 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2583/5183] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:14:27 2022] GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363 => generated 1363 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:14:29.154232 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2f1fd68b-145f-4264-beec-c5d019a5260d tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:14:29.157113 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2f1fd68b-145f-4264-beec-c5d019a5260d tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: 6029de15-fd98-4be1-8c3d-7d63be381363] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:14:29.186341 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:14:29.200660 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2f1fd68b-145f-4264-beec-c5d019a5260d tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:29.205264 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2f1fd68b-145f-4264-beec-c5d019a5260d tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:29.206043 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2f1fd68b-145f-4264-beec-c5d019a5260d tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:29.207128 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2f1fd68b-145f-4264-beec-c5d019a5260d tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:29.210250 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2f1fd68b-145f-4264-beec-c5d019a5260d tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:29.211142 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2f1fd68b-145f-4264-beec-c5d019a5260d tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:29.290177 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:14:29.386363 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-26c45e08-db3d-452d-9e04-a60e123111d6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1936180934", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "871e2ace-a3b9-435b-88ca-d91b69555374"}], "key_name": "tempest-TestNetworkBasicOps-1999024207", "security_groups": [{"name": "tempest-secgroup-smoke-851455901"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:14:29.867931 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-26c45e08-db3d-452d-9e04-a60e123111d6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] validate_networks() for [('871e2ace-a3b9-435b-88ca-d91b69555374', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:14:29.874657 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2f1fd68b-145f-4264-beec-c5d019a5260d tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c163c13444454c9a23703c08a9cc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8590b56a0c924f76ba18920e735e6b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:14:29.887644 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2f1fd68b-145f-4264-beec-c5d019a5260d tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363" status: 200 len: 1549 microversion: 2.1 time: 0.749196 Sep 24 21:14:29.888259 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2601/5184] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:14:29 2022] GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363 => generated 1549 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:14:29.915439 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4617afd6-de6a-4c49-abbc-ff31d976c718 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:14:29.915763 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4617afd6-de6a-4c49-abbc-ff31d976c718 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: 6029de15-fd98-4be1-8c3d-7d63be381363] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:14:29.929882 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4617afd6-de6a-4c49-abbc-ff31d976c718 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:29.930576 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4617afd6-de6a-4c49-abbc-ff31d976c718 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:29.931251 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4617afd6-de6a-4c49-abbc-ff31d976c718 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:29.932168 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4617afd6-de6a-4c49-abbc-ff31d976c718 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:29.932800 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4617afd6-de6a-4c49-abbc-ff31d976c718 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:29.933452 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4617afd6-de6a-4c49-abbc-ff31d976c718 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:30.240422 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4617afd6-de6a-4c49-abbc-ff31d976c718 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.330350 Sep 24 21:14:30.241016 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2602/5185] 10.222.0.52 () {58 vars in 1275 bytes} [Sat Sep 24 21:14:29 2022] GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363/os-interface => generated 284 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:14:32.914080 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-26c45e08-db3d-452d-9e04-a60e123111d6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:14:32.915561 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-26c45e08-db3d-452d-9e04-a60e123111d6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:14:32.916962 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-26c45e08-db3d-452d-9e04-a60e123111d6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:14:32.919708 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-26c45e08-db3d-452d-9e04-a60e123111d6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:14:32.920262 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-26c45e08-db3d-452d-9e04-a60e123111d6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:14:32.991075 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26c45e08-db3d-452d-9e04-a60e123111d6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:32.993433 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26c45e08-db3d-452d-9e04-a60e123111d6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:33.004900 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26c45e08-db3d-452d-9e04-a60e123111d6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:33.006914 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26c45e08-db3d-452d-9e04-a60e123111d6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:33.009052 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26c45e08-db3d-452d-9e04-a60e123111d6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:33.009919 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26c45e08-db3d-452d-9e04-a60e123111d6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:33.088420 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-26c45e08-db3d-452d-9e04-a60e123111d6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Getting quotas for project 026ea39b3679444a9c3541e58d2e9f7b. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:14:33.111251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-26c45e08-db3d-452d-9e04-a60e123111d6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Getting quotas for user c1acf8d4b1384c8c8d7014bd8baf897e and project 026ea39b3679444a9c3541e58d2e9f7b. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:14:33.147400 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-26c45e08-db3d-452d-9e04-a60e123111d6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:14:33.154906 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-26c45e08-db3d-452d-9e04-a60e123111d6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 0d61035b-7f6c-4be1-8928-29f872093427] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:14:33.294839 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-26c45e08-db3d-452d-9e04-a60e123111d6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.914268 Sep 24 21:14:33.309311 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2584/5186] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:14:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 3929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:14:33.315647 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9f2ca1f7-0175-43ec-ae23-514d8e3aaa3c tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:14:33.317608 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9f2ca1f7-0175-43ec-ae23-514d8e3aaa3c tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 0d61035b-7f6c-4be1-8928-29f872093427] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:14:33.647020 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9f2ca1f7-0175-43ec-ae23-514d8e3aaa3c tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:14:33.655660 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9f2ca1f7-0175-43ec-ae23-514d8e3aaa3c tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/0d61035b-7f6c-4be1-8928-29f872093427" status: 200 len: 1249 microversion: 2.1 time: 0.345203 Sep 24 21:14:33.658953 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2603/5187] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:14:33 2022] GET /compute/v2.1/servers/0d61035b-7f6c-4be1-8928-29f872093427 => generated 1249 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:14:34.690397 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fe6e6ea1-6985-491e-b18d-65baa84e9b1e tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:14:34.691127 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fe6e6ea1-6985-491e-b18d-65baa84e9b1e tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 0d61035b-7f6c-4be1-8928-29f872093427] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:14:34.722566 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fe6e6ea1-6985-491e-b18d-65baa84e9b1e tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:34.724711 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fe6e6ea1-6985-491e-b18d-65baa84e9b1e tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:34.725194 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fe6e6ea1-6985-491e-b18d-65baa84e9b1e tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:34.726350 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fe6e6ea1-6985-491e-b18d-65baa84e9b1e tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:34.729776 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fe6e6ea1-6985-491e-b18d-65baa84e9b1e tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:34.754691 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fe6e6ea1-6985-491e-b18d-65baa84e9b1e tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:34.932635 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-0c0ba858-545d-44f1-9920-2d138e8fd265 req-c57b5f8f-ca78-4607-892b-c0670e75cfab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6029de15-fd98-4be1-8c3d-7d63be381363", "tag": "d73312e8-32fb-499c-b5d9-1b6927e0b7ea"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:14:34.969489 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-0c0ba858-545d-44f1-9920-2d138e8fd265 req-c57b5f8f-ca78-4607-892b-c0670e75cfab service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:34.974081 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-0c0ba858-545d-44f1-9920-2d138e8fd265 req-c57b5f8f-ca78-4607-892b-c0670e75cfab service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:34.976369 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-0c0ba858-545d-44f1-9920-2d138e8fd265 req-c57b5f8f-ca78-4607-892b-c0670e75cfab service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:35.000433 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fe6e6ea1-6985-491e-b18d-65baa84e9b1e tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:14:35.008052 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-0c0ba858-545d-44f1-9920-2d138e8fd265 req-c57b5f8f-ca78-4607-892b-c0670e75cfab service nova] Creating event network-changed:d73312e8-32fb-499c-b5d9-1b6927e0b7ea for instance 6029de15-fd98-4be1-8c3d-7d63be381363 on nch1-master-1 Sep 24 21:14:35.012588 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fe6e6ea1-6985-491e-b18d-65baa84e9b1e tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/0d61035b-7f6c-4be1-8928-29f872093427" status: 200 len: 1245 microversion: 2.1 time: 0.331138 Sep 24 21:14:35.013773 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2585/5188] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:14:34 2022] GET /compute/v2.1/servers/0d61035b-7f6c-4be1-8928-29f872093427 => generated 1245 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:14:35.020736 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-0c0ba858-545d-44f1-9920-2d138e8fd265 req-c57b5f8f-ca78-4607-892b-c0670e75cfab service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092138 Sep 24 21:14:35.021646 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2604/5189] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:14:35.775392 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-84ac0411-7b42-434b-b64e-e3a61249f170 tempest-TestVolumeBootPattern-1416871037 tempest-TestVolumeBootPattern-1416871037-project] Action: 'create', calling method: .version_select at 0x7f4b074a4e50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1604420127", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOb1qdIOKxAeFGtXuZsuv9kAko2MiAEfu7b+0R5f9LBXt1VQn3vfUh6UrzjdC4tueZ0XoB26R7Gppi1LCFwFNxb1s/5Id7zH29brgPF7MVndN2JBGEEXfpsjQE6g/i+Uuw=="}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:14:35.810479 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-84ac0411-7b42-434b-b64e-e3a61249f170 tempest-TestVolumeBootPattern-1416871037 tempest-TestVolumeBootPattern-1416871037-project] Getting quotas for project c3d65fb083bf46fbaa1ac97228b5b4a2. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:14:35.829831 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-84ac0411-7b42-434b-b64e-e3a61249f170 tempest-TestVolumeBootPattern-1416871037 tempest-TestVolumeBootPattern-1416871037-project] Getting quotas for user 2876ced64d6344e4a4be30a9b09f88d1 and project c3d65fb083bf46fbaa1ac97228b5b4a2. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:14:35.904061 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-84ac0411-7b42-434b-b64e-e3a61249f170 tempest-TestVolumeBootPattern-1416871037 tempest-TestVolumeBootPattern-1416871037-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.129882 Sep 24 21:14:35.907578 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2586/5190] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 21:14:35 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:14:36.040538 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dff7d982-538c-4dcc-bdc7-dd89ae7ebc6b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:14:36.041246 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dff7d982-538c-4dcc-bdc7-dd89ae7ebc6b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 0d61035b-7f6c-4be1-8928-29f872093427] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:14:36.056676 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dff7d982-538c-4dcc-bdc7-dd89ae7ebc6b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:36.057191 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dff7d982-538c-4dcc-bdc7-dd89ae7ebc6b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:36.072048 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dff7d982-538c-4dcc-bdc7-dd89ae7ebc6b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:36.075291 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dff7d982-538c-4dcc-bdc7-dd89ae7ebc6b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:36.078459 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dff7d982-538c-4dcc-bdc7-dd89ae7ebc6b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:36.079035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dff7d982-538c-4dcc-bdc7-dd89ae7ebc6b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:36.305265 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dff7d982-538c-4dcc-bdc7-dd89ae7ebc6b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:14:36.325753 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dff7d982-538c-4dcc-bdc7-dd89ae7ebc6b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/0d61035b-7f6c-4be1-8928-29f872093427" status: 200 len: 1307 microversion: 2.1 time: 0.290250 Sep 24 21:14:36.326375 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2605/5191] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:14:36 2022] GET /compute/v2.1/servers/0d61035b-7f6c-4be1-8928-29f872093427 => generated 1307 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:14:37.359360 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c0228cbc-3a45-41db-b589-3885e04f33ad tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:14:37.360545 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c0228cbc-3a45-41db-b589-3885e04f33ad tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 0d61035b-7f6c-4be1-8928-29f872093427] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:14:37.377041 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c0228cbc-3a45-41db-b589-3885e04f33ad tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:37.380044 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c0228cbc-3a45-41db-b589-3885e04f33ad tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:37.380719 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c0228cbc-3a45-41db-b589-3885e04f33ad tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:37.382096 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c0228cbc-3a45-41db-b589-3885e04f33ad tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:37.382761 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c0228cbc-3a45-41db-b589-3885e04f33ad tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:37.383340 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c0228cbc-3a45-41db-b589-3885e04f33ad tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:37.619008 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c0228cbc-3a45-41db-b589-3885e04f33ad tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:14:37.628080 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c0228cbc-3a45-41db-b589-3885e04f33ad tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/0d61035b-7f6c-4be1-8928-29f872093427" status: 200 len: 1307 microversion: 2.1 time: 0.279191 Sep 24 21:14:37.645878 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2587/5192] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:14:37 2022] GET /compute/v2.1/servers/0d61035b-7f6c-4be1-8928-29f872093427 => generated 1307 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:14:38.654315 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6533c0ce-a4a7-4304-826a-43008ff1e778 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:14:38.654969 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6533c0ce-a4a7-4304-826a-43008ff1e778 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 0d61035b-7f6c-4be1-8928-29f872093427] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:14:38.691096 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6533c0ce-a4a7-4304-826a-43008ff1e778 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:38.708224 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6533c0ce-a4a7-4304-826a-43008ff1e778 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:38.709112 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6533c0ce-a4a7-4304-826a-43008ff1e778 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:38.728203 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6533c0ce-a4a7-4304-826a-43008ff1e778 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:38.728830 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6533c0ce-a4a7-4304-826a-43008ff1e778 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:38.740122 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6533c0ce-a4a7-4304-826a-43008ff1e778 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:39.153975 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6533c0ce-a4a7-4304-826a-43008ff1e778 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:14:39.175187 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6533c0ce-a4a7-4304-826a-43008ff1e778 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/0d61035b-7f6c-4be1-8928-29f872093427" status: 200 len: 1374 microversion: 2.1 time: 0.525322 Sep 24 21:14:39.177223 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2606/5193] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:14:38 2022] GET /compute/v2.1/servers/0d61035b-7f6c-4be1-8928-29f872093427 => generated 1374 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:14:40.208375 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b96fa7db-78a6-40ca-b868-80b90f1a7957 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:14:40.213003 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-d49b0302-1ebd-4fb5-b9d9-cf8e453da15f req-f1451d27-44ee-40fd-8b59-d27d0871b8e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d61035b-7f6c-4be1-8928-29f872093427", "tag": "6ce7f648-9626-448a-b02c-aa480dbb59a0"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:14:40.215227 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b96fa7db-78a6-40ca-b868-80b90f1a7957 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 0d61035b-7f6c-4be1-8928-29f872093427] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:14:40.228991 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b96fa7db-78a6-40ca-b868-80b90f1a7957 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:40.232175 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b96fa7db-78a6-40ca-b868-80b90f1a7957 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:40.238401 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b96fa7db-78a6-40ca-b868-80b90f1a7957 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:40.239474 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b96fa7db-78a6-40ca-b868-80b90f1a7957 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:40.240266 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b96fa7db-78a6-40ca-b868-80b90f1a7957 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:40.241472 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b96fa7db-78a6-40ca-b868-80b90f1a7957 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:40.247045 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d49b0302-1ebd-4fb5-b9d9-cf8e453da15f req-f1451d27-44ee-40fd-8b59-d27d0871b8e8 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:40.247518 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d49b0302-1ebd-4fb5-b9d9-cf8e453da15f req-f1451d27-44ee-40fd-8b59-d27d0871b8e8 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:40.247968 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d49b0302-1ebd-4fb5-b9d9-cf8e453da15f req-f1451d27-44ee-40fd-8b59-d27d0871b8e8 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:40.288136 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-d49b0302-1ebd-4fb5-b9d9-cf8e453da15f req-f1451d27-44ee-40fd-8b59-d27d0871b8e8 service nova] Creating event network-changed:6ce7f648-9626-448a-b02c-aa480dbb59a0 for instance 0d61035b-7f6c-4be1-8928-29f872093427 on nch2-master-1 Sep 24 21:14:40.302704 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-d49b0302-1ebd-4fb5-b9d9-cf8e453da15f req-f1451d27-44ee-40fd-8b59-d27d0871b8e8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108982 Sep 24 21:14:40.303697 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2588/5194] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:14:40.827327 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b96fa7db-78a6-40ca-b868-80b90f1a7957 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:14:40.854095 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b96fa7db-78a6-40ca-b868-80b90f1a7957 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/0d61035b-7f6c-4be1-8928-29f872093427" status: 200 len: 1374 microversion: 2.1 time: 0.653930 Sep 24 21:14:40.874644 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2607/5195] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:14:40 2022] GET /compute/v2.1/servers/0d61035b-7f6c-4be1-8928-29f872093427 => generated 1374 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:14:41.078395 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e8a6a57a-bf2f-470e-a03f-aad3ca7ade4e tempest-TestVolumeBootPattern-1416871037 tempest-TestVolumeBootPattern-1416871037-project] Calling method '.version_select at 0x7f4b07455ca0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:14:41.127456 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e8a6a57a-bf2f-470e-a03f-aad3ca7ade4e tempest-TestVolumeBootPattern-1416871037 tempest-TestVolumeBootPattern-1416871037-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1604420127" status: 202 len: 0 microversion: 2.1 time: 0.054228 Sep 24 21:14:41.128225 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2589/5196] 10.222.0.52 () {58 vars in 1263 bytes} [Sat Sep 24 21:14:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1604420127 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:14:41.882732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b7a1e168-a3e1-4c5a-a24e-8011af1ab701 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:14:41.883872 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b7a1e168-a3e1-4c5a-a24e-8011af1ab701 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 0d61035b-7f6c-4be1-8928-29f872093427] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:14:41.900097 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b7a1e168-a3e1-4c5a-a24e-8011af1ab701 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:41.901488 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b7a1e168-a3e1-4c5a-a24e-8011af1ab701 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:41.902330 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b7a1e168-a3e1-4c5a-a24e-8011af1ab701 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:41.903665 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b7a1e168-a3e1-4c5a-a24e-8011af1ab701 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:41.904286 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b7a1e168-a3e1-4c5a-a24e-8011af1ab701 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:41.905508 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b7a1e168-a3e1-4c5a-a24e-8011af1ab701 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:42.351678 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b7a1e168-a3e1-4c5a-a24e-8011af1ab701 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:14:42.363398 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b7a1e168-a3e1-4c5a-a24e-8011af1ab701 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/0d61035b-7f6c-4be1-8928-29f872093427" status: 200 len: 1374 microversion: 2.1 time: 0.485805 Sep 24 21:14:42.365411 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2608/5197] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:14:41 2022] GET /compute/v2.1/servers/0d61035b-7f6c-4be1-8928-29f872093427 => generated 1374 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:14:43.388779 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:14:43.393082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-534e2eea-99a8-4a16-a3f9-917de4173b77 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:14:43.393585 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-534e2eea-99a8-4a16-a3f9-917de4173b77 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 0d61035b-7f6c-4be1-8928-29f872093427] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:14:43.407302 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-534e2eea-99a8-4a16-a3f9-917de4173b77 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:43.407803 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-534e2eea-99a8-4a16-a3f9-917de4173b77 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:43.408245 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-534e2eea-99a8-4a16-a3f9-917de4173b77 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:43.409114 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-534e2eea-99a8-4a16-a3f9-917de4173b77 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:43.409721 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-534e2eea-99a8-4a16-a3f9-917de4173b77 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:43.410156 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-534e2eea-99a8-4a16-a3f9-917de4173b77 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:43.672850 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-534e2eea-99a8-4a16-a3f9-917de4173b77 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:14:43.686588 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-534e2eea-99a8-4a16-a3f9-917de4173b77 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/0d61035b-7f6c-4be1-8928-29f872093427" status: 200 len: 1374 microversion: 2.1 time: 0.300046 Sep 24 21:14:43.699656 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2590/5198] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:14:43 2022] GET /compute/v2.1/servers/0d61035b-7f6c-4be1-8928-29f872093427 => generated 1374 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:14:44.711475 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-961b62db-f108-42ec-99ca-4b0587dbceb1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:14:44.712801 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-961b62db-f108-42ec-99ca-4b0587dbceb1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 0d61035b-7f6c-4be1-8928-29f872093427] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:14:44.716190 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:14:44.727565 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-961b62db-f108-42ec-99ca-4b0587dbceb1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:44.728065 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-961b62db-f108-42ec-99ca-4b0587dbceb1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:44.728526 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-961b62db-f108-42ec-99ca-4b0587dbceb1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:44.729254 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-961b62db-f108-42ec-99ca-4b0587dbceb1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:44.730447 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-961b62db-f108-42ec-99ca-4b0587dbceb1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:44.730772 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-961b62db-f108-42ec-99ca-4b0587dbceb1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:45.067037 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-961b62db-f108-42ec-99ca-4b0587dbceb1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:14:45.076337 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-961b62db-f108-42ec-99ca-4b0587dbceb1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/0d61035b-7f6c-4be1-8928-29f872093427" status: 200 len: 1374 microversion: 2.1 time: 0.368715 Sep 24 21:14:45.076995 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2609/5199] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:14:44 2022] GET /compute/v2.1/servers/0d61035b-7f6c-4be1-8928-29f872093427 => generated 1374 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:14:46.101607 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-35d806eb-5d78-47c9-b556-f497067c0b41 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:14:46.102273 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-35d806eb-5d78-47c9-b556-f497067c0b41 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 0d61035b-7f6c-4be1-8928-29f872093427] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:14:46.110350 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=14 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:14:46.120721 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35d806eb-5d78-47c9-b556-f497067c0b41 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:46.121816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35d806eb-5d78-47c9-b556-f497067c0b41 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:46.122269 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35d806eb-5d78-47c9-b556-f497067c0b41 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:46.126763 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35d806eb-5d78-47c9-b556-f497067c0b41 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:46.127339 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35d806eb-5d78-47c9-b556-f497067c0b41 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:46.127803 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35d806eb-5d78-47c9-b556-f497067c0b41 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:46.567307 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-35d806eb-5d78-47c9-b556-f497067c0b41 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:14:46.583637 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-35d806eb-5d78-47c9-b556-f497067c0b41 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/0d61035b-7f6c-4be1-8928-29f872093427" status: 200 len: 1374 microversion: 2.1 time: 0.486150 Sep 24 21:14:46.601972 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2591/5200] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:14:46 2022] GET /compute/v2.1/servers/0d61035b-7f6c-4be1-8928-29f872093427 => generated 1374 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:14:47.559713 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-34a86696-5500-4b31-8296-ce50c72791d2 req-8ae9ef3b-7251-4265-b3a2-d6f9684984fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d61035b-7f6c-4be1-8928-29f872093427", "name": "network-vif-plugged", "status": "completed", "tag": "6ce7f648-9626-448a-b02c-aa480dbb59a0"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:14:47.579837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-34a86696-5500-4b31-8296-ce50c72791d2 req-8ae9ef3b-7251-4265-b3a2-d6f9684984fd service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:47.580811 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-34a86696-5500-4b31-8296-ce50c72791d2 req-8ae9ef3b-7251-4265-b3a2-d6f9684984fd service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:47.581360 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-34a86696-5500-4b31-8296-ce50c72791d2 req-8ae9ef3b-7251-4265-b3a2-d6f9684984fd service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:47.594929 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-34a86696-5500-4b31-8296-ce50c72791d2 req-8ae9ef3b-7251-4265-b3a2-d6f9684984fd service nova] Creating event network-vif-plugged:6ce7f648-9626-448a-b02c-aa480dbb59a0 for instance 0d61035b-7f6c-4be1-8928-29f872093427 on nch2-master-1 Sep 24 21:14:47.601317 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-34a86696-5500-4b31-8296-ce50c72791d2 req-8ae9ef3b-7251-4265-b3a2-d6f9684984fd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045954 Sep 24 21:14:47.602826 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2610/5201] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:14:47.615228 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-552ee8a5-1557-44be-9559-6c392f31dd9a tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:14:47.616070 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-552ee8a5-1557-44be-9559-6c392f31dd9a tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 0d61035b-7f6c-4be1-8928-29f872093427] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:14:47.631115 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-552ee8a5-1557-44be-9559-6c392f31dd9a tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:47.633486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-552ee8a5-1557-44be-9559-6c392f31dd9a tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:47.635120 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-552ee8a5-1557-44be-9559-6c392f31dd9a tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:47.650220 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-552ee8a5-1557-44be-9559-6c392f31dd9a tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:47.655399 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-552ee8a5-1557-44be-9559-6c392f31dd9a tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:47.659422 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-552ee8a5-1557-44be-9559-6c392f31dd9a tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:47.984867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-552ee8a5-1557-44be-9559-6c392f31dd9a tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:14:47.998885 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-552ee8a5-1557-44be-9559-6c392f31dd9a tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/0d61035b-7f6c-4be1-8928-29f872093427" status: 200 len: 1374 microversion: 2.1 time: 0.387517 Sep 24 21:14:48.004752 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2592/5202] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:14:47 2022] GET /compute/v2.1/servers/0d61035b-7f6c-4be1-8928-29f872093427 => generated 1374 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:14:49.027326 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-868f2335-68fd-4df7-bb06-28931cfc9671 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:14:49.028323 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-868f2335-68fd-4df7-bb06-28931cfc9671 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 0d61035b-7f6c-4be1-8928-29f872093427] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:14:49.085386 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-868f2335-68fd-4df7-bb06-28931cfc9671 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:49.087593 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-868f2335-68fd-4df7-bb06-28931cfc9671 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:49.088276 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-868f2335-68fd-4df7-bb06-28931cfc9671 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:49.092351 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-868f2335-68fd-4df7-bb06-28931cfc9671 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:49.094821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-868f2335-68fd-4df7-bb06-28931cfc9671 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:49.095905 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-868f2335-68fd-4df7-bb06-28931cfc9671 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:49.655445 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-868f2335-68fd-4df7-bb06-28931cfc9671 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:14:49.664494 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-868f2335-68fd-4df7-bb06-28931cfc9671 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/0d61035b-7f6c-4be1-8928-29f872093427" status: 200 len: 1374 microversion: 2.1 time: 0.642869 Sep 24 21:14:49.666552 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2611/5203] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:14:49 2022] GET /compute/v2.1/servers/0d61035b-7f6c-4be1-8928-29f872093427 => generated 1374 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:14:50.690886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9f1222c5-9d33-4383-a0d8-f3236341c084 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:14:50.691578 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9f1222c5-9d33-4383-a0d8-f3236341c084 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 0d61035b-7f6c-4be1-8928-29f872093427] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:14:50.705528 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9f1222c5-9d33-4383-a0d8-f3236341c084 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:50.706021 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9f1222c5-9d33-4383-a0d8-f3236341c084 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:50.706463 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9f1222c5-9d33-4383-a0d8-f3236341c084 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:50.707223 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9f1222c5-9d33-4383-a0d8-f3236341c084 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:50.707691 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9f1222c5-9d33-4383-a0d8-f3236341c084 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:50.708123 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9f1222c5-9d33-4383-a0d8-f3236341c084 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:50.966444 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9f1222c5-9d33-4383-a0d8-f3236341c084 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:14:50.978374 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9f1222c5-9d33-4383-a0d8-f3236341c084 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/0d61035b-7f6c-4be1-8928-29f872093427" status: 200 len: 1547 microversion: 2.1 time: 0.291611 Sep 24 21:14:50.980408 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2593/5204] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:14:50 2022] GET /compute/v2.1/servers/0d61035b-7f6c-4be1-8928-29f872093427 => generated 1547 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:14:51.004874 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-902c8fdb-7c55-4c40-aef6-c915ddd439e0 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:14:51.006096 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-902c8fdb-7c55-4c40-aef6-c915ddd439e0 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 0d61035b-7f6c-4be1-8928-29f872093427] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:14:51.014640 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-902c8fdb-7c55-4c40-aef6-c915ddd439e0 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:51.015707 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-902c8fdb-7c55-4c40-aef6-c915ddd439e0 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:51.016456 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-902c8fdb-7c55-4c40-aef6-c915ddd439e0 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:51.017550 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-902c8fdb-7c55-4c40-aef6-c915ddd439e0 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:14:51.018252 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-902c8fdb-7c55-4c40-aef6-c915ddd439e0 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:14:51.018873 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-902c8fdb-7c55-4c40-aef6-c915ddd439e0 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:14:51.266390 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-902c8fdb-7c55-4c40-aef6-c915ddd439e0 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:14:51.290081 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-902c8fdb-7c55-4c40-aef6-c915ddd439e0 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/0d61035b-7f6c-4be1-8928-29f872093427" status: 200 len: 1547 microversion: 2.1 time: 0.278088 Sep 24 21:14:51.304601 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2612/5205] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:14:50 2022] GET /compute/v2.1/servers/0d61035b-7f6c-4be1-8928-29f872093427 => generated 1547 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:15:01.392842 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:15:01.393651 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=45 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:15:01.525832 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d872763e-d542-4c02-8583-854e77b70b06 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-834178465", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "24626e9f-8a4c-46e2-9486-bc6741fdfcce"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:15:01.764516 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-d872763e-d542-4c02-8583-854e77b70b06 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] validate_networks() for [('24626e9f-8a4c-46e2-9486-bc6741fdfcce', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:15:02.215513 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-d872763e-d542-4c02-8583-854e77b70b06 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:15:02.215951 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-d872763e-d542-4c02-8583-854e77b70b06 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:15:02.216437 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-d872763e-d542-4c02-8583-854e77b70b06 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:15:02.217025 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-d872763e-d542-4c02-8583-854e77b70b06 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:15:02.217599 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-d872763e-d542-4c02-8583-854e77b70b06 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:15:02.228430 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d872763e-d542-4c02-8583-854e77b70b06 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:02.229641 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d872763e-d542-4c02-8583-854e77b70b06 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:02.230193 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d872763e-d542-4c02-8583-854e77b70b06 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:02.231373 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d872763e-d542-4c02-8583-854e77b70b06 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:02.232037 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d872763e-d542-4c02-8583-854e77b70b06 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:02.232482 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d872763e-d542-4c02-8583-854e77b70b06 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:02.254653 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-d872763e-d542-4c02-8583-854e77b70b06 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Getting quotas for project bcdcaa646ba54f75abea17bdd8a6a62d. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:15:02.261708 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-d872763e-d542-4c02-8583-854e77b70b06 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Getting quotas for user 82a854bf2b0042439e87b8aa0476b0e4 and project bcdcaa646ba54f75abea17bdd8a6a62d. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:15:02.277242 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d872763e-d542-4c02-8583-854e77b70b06 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:15:02.280465 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d872763e-d542-4c02-8583-854e77b70b06 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] [instance: 2082c363-3653-45fb-a4d8-ebad42de9c54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:15:02.336461 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d872763e-d542-4c02-8583-854e77b70b06 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.949734 Sep 24 21:15:02.337678 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2594/5206] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:15:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 24 21:15:02.349757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-68d15453-2a44-4e46-b89b-d06c71e12507 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:02.351099 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-68d15453-2a44-4e46-b89b-d06c71e12507 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] [instance: 2082c363-3653-45fb-a4d8-ebad42de9c54] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:02.371299 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=25 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:15:02.372242 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=55 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:15:02.522575 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-68d15453-2a44-4e46-b89b-d06c71e12507 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a854bf2b0042439e87b8aa0476b0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdcaa646ba54f75abea17bdd8a6a62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:02.543794 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-68d15453-2a44-4e46-b89b-d06c71e12507 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] 10.222.0.52 "GET /compute/v2.1/servers/2082c363-3653-45fb-a4d8-ebad42de9c54" status: 200 len: 1213 microversion: 2.1 time: 0.198527 Sep 24 21:15:02.544935 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2613/5207] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:15:02 2022] GET /compute/v2.1/servers/2082c363-3653-45fb-a4d8-ebad42de9c54 => generated 1213 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:15:03.579766 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b793524d-2ee0-4286-b947-8e11f52c1033 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:03.580408 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b793524d-2ee0-4286-b947-8e11f52c1033 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] [instance: 2082c363-3653-45fb-a4d8-ebad42de9c54] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:03.589696 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b793524d-2ee0-4286-b947-8e11f52c1033 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:03.590197 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b793524d-2ee0-4286-b947-8e11f52c1033 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:03.590670 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b793524d-2ee0-4286-b947-8e11f52c1033 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:03.593034 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b793524d-2ee0-4286-b947-8e11f52c1033 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:03.593674 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b793524d-2ee0-4286-b947-8e11f52c1033 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:03.594447 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b793524d-2ee0-4286-b947-8e11f52c1033 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:03.701757 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b793524d-2ee0-4286-b947-8e11f52c1033 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a854bf2b0042439e87b8aa0476b0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdcaa646ba54f75abea17bdd8a6a62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:03.714694 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b793524d-2ee0-4286-b947-8e11f52c1033 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] 10.222.0.52 "GET /compute/v2.1/servers/2082c363-3653-45fb-a4d8-ebad42de9c54" status: 200 len: 1283 microversion: 2.1 time: 0.142644 Sep 24 21:15:03.719218 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2595/5208] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:15:03 2022] GET /compute/v2.1/servers/2082c363-3653-45fb-a4d8-ebad42de9c54 => generated 1283 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:15:04.743014 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-85d6a9b9-9eb0-4916-99a1-717ae49eacf0 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:04.743625 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-85d6a9b9-9eb0-4916-99a1-717ae49eacf0 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] [instance: 2082c363-3653-45fb-a4d8-ebad42de9c54] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:04.755817 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85d6a9b9-9eb0-4916-99a1-717ae49eacf0 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:04.756311 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85d6a9b9-9eb0-4916-99a1-717ae49eacf0 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:04.756751 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85d6a9b9-9eb0-4916-99a1-717ae49eacf0 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:04.757460 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85d6a9b9-9eb0-4916-99a1-717ae49eacf0 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:04.757924 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85d6a9b9-9eb0-4916-99a1-717ae49eacf0 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:04.758364 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85d6a9b9-9eb0-4916-99a1-717ae49eacf0 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:04.985654 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-85d6a9b9-9eb0-4916-99a1-717ae49eacf0 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a854bf2b0042439e87b8aa0476b0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdcaa646ba54f75abea17bdd8a6a62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:04.993825 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-85d6a9b9-9eb0-4916-99a1-717ae49eacf0 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] 10.222.0.52 "GET /compute/v2.1/servers/2082c363-3653-45fb-a4d8-ebad42de9c54" status: 200 len: 1313 microversion: 2.1 time: 0.254559 Sep 24 21:15:04.996077 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2614/5209] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:15:04 2022] GET /compute/v2.1/servers/2082c363-3653-45fb-a4d8-ebad42de9c54 => generated 1313 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:15:05.303451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-cd9aea66-1bd8-47af-8ce1-96f32a165974 req-93d58165-c8e2-41ea-99d5-89e050ac2566 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2082c363-3653-45fb-a4d8-ebad42de9c54", "tag": "264545b2-e2d0-40a4-be52-c97009a8f717"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:15:05.322765 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-cd9aea66-1bd8-47af-8ce1-96f32a165974 req-93d58165-c8e2-41ea-99d5-89e050ac2566 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:05.323776 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-cd9aea66-1bd8-47af-8ce1-96f32a165974 req-93d58165-c8e2-41ea-99d5-89e050ac2566 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:05.325088 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-cd9aea66-1bd8-47af-8ce1-96f32a165974 req-93d58165-c8e2-41ea-99d5-89e050ac2566 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:05.343320 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-cd9aea66-1bd8-47af-8ce1-96f32a165974 req-93d58165-c8e2-41ea-99d5-89e050ac2566 service nova] Creating event network-changed:264545b2-e2d0-40a4-be52-c97009a8f717 for instance 2082c363-3653-45fb-a4d8-ebad42de9c54 on nch1-master-1 Sep 24 21:15:05.349555 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-cd9aea66-1bd8-47af-8ce1-96f32a165974 req-93d58165-c8e2-41ea-99d5-89e050ac2566 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049907 Sep 24 21:15:05.351487 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2596/5210] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:15:06.020629 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9e61bd10-e79e-4fce-a416-14107de21ad3 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:06.021864 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9e61bd10-e79e-4fce-a416-14107de21ad3 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] [instance: 2082c363-3653-45fb-a4d8-ebad42de9c54] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:06.031107 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9e61bd10-e79e-4fce-a416-14107de21ad3 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:06.031615 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9e61bd10-e79e-4fce-a416-14107de21ad3 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:06.032066 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9e61bd10-e79e-4fce-a416-14107de21ad3 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:06.033129 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9e61bd10-e79e-4fce-a416-14107de21ad3 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:06.033598 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9e61bd10-e79e-4fce-a416-14107de21ad3 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:06.034210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9e61bd10-e79e-4fce-a416-14107de21ad3 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:06.175733 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9e61bd10-e79e-4fce-a416-14107de21ad3 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a854bf2b0042439e87b8aa0476b0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdcaa646ba54f75abea17bdd8a6a62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:06.186710 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9e61bd10-e79e-4fce-a416-14107de21ad3 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] 10.222.0.52 "GET /compute/v2.1/servers/2082c363-3653-45fb-a4d8-ebad42de9c54" status: 200 len: 1313 microversion: 2.1 time: 0.170274 Sep 24 21:15:06.187896 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2615/5211] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:15:06 2022] GET /compute/v2.1/servers/2082c363-3653-45fb-a4d8-ebad42de9c54 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:15:07.212381 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a65dabfb-e8f2-40ff-9077-2f2f67327c08 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:07.213341 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a65dabfb-e8f2-40ff-9077-2f2f67327c08 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] [instance: 2082c363-3653-45fb-a4d8-ebad42de9c54] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:07.221038 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a65dabfb-e8f2-40ff-9077-2f2f67327c08 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:07.221536 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a65dabfb-e8f2-40ff-9077-2f2f67327c08 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:07.221979 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a65dabfb-e8f2-40ff-9077-2f2f67327c08 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:07.222886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a65dabfb-e8f2-40ff-9077-2f2f67327c08 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:07.223504 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a65dabfb-e8f2-40ff-9077-2f2f67327c08 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:07.224206 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a65dabfb-e8f2-40ff-9077-2f2f67327c08 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:07.376526 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a65dabfb-e8f2-40ff-9077-2f2f67327c08 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a854bf2b0042439e87b8aa0476b0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdcaa646ba54f75abea17bdd8a6a62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:07.386410 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a65dabfb-e8f2-40ff-9077-2f2f67327c08 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] 10.222.0.52 "GET /compute/v2.1/servers/2082c363-3653-45fb-a4d8-ebad42de9c54" status: 200 len: 1313 microversion: 2.1 time: 0.178701 Sep 24 21:15:07.387473 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2597/5212] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:15:07 2022] GET /compute/v2.1/servers/2082c363-3653-45fb-a4d8-ebad42de9c54 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:15:08.409637 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2da7a320-e8bc-4700-a90c-74652bbef4eb tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:08.410153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2da7a320-e8bc-4700-a90c-74652bbef4eb tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] [instance: 2082c363-3653-45fb-a4d8-ebad42de9c54] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:08.421124 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2da7a320-e8bc-4700-a90c-74652bbef4eb tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:08.421787 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2da7a320-e8bc-4700-a90c-74652bbef4eb tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:08.422337 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2da7a320-e8bc-4700-a90c-74652bbef4eb tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:08.423379 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2da7a320-e8bc-4700-a90c-74652bbef4eb tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:08.423952 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2da7a320-e8bc-4700-a90c-74652bbef4eb tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:08.425334 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2da7a320-e8bc-4700-a90c-74652bbef4eb tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:08.624667 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2da7a320-e8bc-4700-a90c-74652bbef4eb tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a854bf2b0042439e87b8aa0476b0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdcaa646ba54f75abea17bdd8a6a62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:08.642461 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2da7a320-e8bc-4700-a90c-74652bbef4eb tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] 10.222.0.52 "GET /compute/v2.1/servers/2082c363-3653-45fb-a4d8-ebad42de9c54" status: 200 len: 1313 microversion: 2.1 time: 0.235224 Sep 24 21:15:08.643876 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2616/5213] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:15:08 2022] GET /compute/v2.1/servers/2082c363-3653-45fb-a4d8-ebad42de9c54 => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:15:09.675501 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-96ebed3d-2b5c-4580-86c4-d2815d90fd8e tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:09.677747 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-96ebed3d-2b5c-4580-86c4-d2815d90fd8e tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] [instance: 2082c363-3653-45fb-a4d8-ebad42de9c54] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:09.689918 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96ebed3d-2b5c-4580-86c4-d2815d90fd8e tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:09.690818 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96ebed3d-2b5c-4580-86c4-d2815d90fd8e tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:09.691844 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96ebed3d-2b5c-4580-86c4-d2815d90fd8e tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:09.693392 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96ebed3d-2b5c-4580-86c4-d2815d90fd8e tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:09.694657 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96ebed3d-2b5c-4580-86c4-d2815d90fd8e tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:09.695754 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96ebed3d-2b5c-4580-86c4-d2815d90fd8e tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:09.938650 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-96ebed3d-2b5c-4580-86c4-d2815d90fd8e tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a854bf2b0042439e87b8aa0476b0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdcaa646ba54f75abea17bdd8a6a62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:09.950098 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-96ebed3d-2b5c-4580-86c4-d2815d90fd8e tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] 10.222.0.52 "GET /compute/v2.1/servers/2082c363-3653-45fb-a4d8-ebad42de9c54" status: 200 len: 1313 microversion: 2.1 time: 0.285552 Sep 24 21:15:09.951236 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2598/5214] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:15:09 2022] GET /compute/v2.1/servers/2082c363-3653-45fb-a4d8-ebad42de9c54 => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:15:10.889329 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-3fa1deac-25af-481b-bff9-9fbfe7328d2b req-8b12fc1b-a75f-49bf-ba55-d2fd86bfe2c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2082c363-3653-45fb-a4d8-ebad42de9c54", "name": "network-vif-plugged", "status": "completed", "tag": "264545b2-e2d0-40a4-be52-c97009a8f717"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:15:10.911084 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-3fa1deac-25af-481b-bff9-9fbfe7328d2b req-8b12fc1b-a75f-49bf-ba55-d2fd86bfe2c5 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:10.912624 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-3fa1deac-25af-481b-bff9-9fbfe7328d2b req-8b12fc1b-a75f-49bf-ba55-d2fd86bfe2c5 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:10.914600 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-3fa1deac-25af-481b-bff9-9fbfe7328d2b req-8b12fc1b-a75f-49bf-ba55-d2fd86bfe2c5 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:10.950681 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-3fa1deac-25af-481b-bff9-9fbfe7328d2b req-8b12fc1b-a75f-49bf-ba55-d2fd86bfe2c5 service nova] Creating event network-vif-plugged:264545b2-e2d0-40a4-be52-c97009a8f717 for instance 2082c363-3653-45fb-a4d8-ebad42de9c54 on nch1-master-1 Sep 24 21:15:10.960705 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-3fa1deac-25af-481b-bff9-9fbfe7328d2b req-8b12fc1b-a75f-49bf-ba55-d2fd86bfe2c5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074997 Sep 24 21:15:10.966976 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2617/5215] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:15:10.977804 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c1561f2b-2a22-4b06-9dd7-eca32eaf7de3 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:10.982714 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c1561f2b-2a22-4b06-9dd7-eca32eaf7de3 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] [instance: 2082c363-3653-45fb-a4d8-ebad42de9c54] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:11.002851 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c1561f2b-2a22-4b06-9dd7-eca32eaf7de3 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:11.016897 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c1561f2b-2a22-4b06-9dd7-eca32eaf7de3 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:11.017385 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c1561f2b-2a22-4b06-9dd7-eca32eaf7de3 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:11.018147 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c1561f2b-2a22-4b06-9dd7-eca32eaf7de3 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:11.023323 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c1561f2b-2a22-4b06-9dd7-eca32eaf7de3 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:11.026596 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c1561f2b-2a22-4b06-9dd7-eca32eaf7de3 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:11.294644 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c1561f2b-2a22-4b06-9dd7-eca32eaf7de3 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a854bf2b0042439e87b8aa0476b0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdcaa646ba54f75abea17bdd8a6a62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:11.318037 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c1561f2b-2a22-4b06-9dd7-eca32eaf7de3 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] 10.222.0.52 "GET /compute/v2.1/servers/2082c363-3653-45fb-a4d8-ebad42de9c54" status: 200 len: 1313 microversion: 2.1 time: 0.343944 Sep 24 21:15:11.320130 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2599/5216] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:15:10 2022] GET /compute/v2.1/servers/2082c363-3653-45fb-a4d8-ebad42de9c54 => generated 1313 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:15:12.348798 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3e178196-46a1-4a11-ba82-c56bd5665018 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:12.350153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3e178196-46a1-4a11-ba82-c56bd5665018 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] [instance: 2082c363-3653-45fb-a4d8-ebad42de9c54] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:12.358348 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e178196-46a1-4a11-ba82-c56bd5665018 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:12.358889 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e178196-46a1-4a11-ba82-c56bd5665018 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:12.359448 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e178196-46a1-4a11-ba82-c56bd5665018 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:12.360141 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e178196-46a1-4a11-ba82-c56bd5665018 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:12.360801 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e178196-46a1-4a11-ba82-c56bd5665018 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:12.361399 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e178196-46a1-4a11-ba82-c56bd5665018 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:12.547215 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:15:12.557609 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3e178196-46a1-4a11-ba82-c56bd5665018 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a854bf2b0042439e87b8aa0476b0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdcaa646ba54f75abea17bdd8a6a62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:12.569189 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3e178196-46a1-4a11-ba82-c56bd5665018 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] 10.222.0.52 "GET /compute/v2.1/servers/2082c363-3653-45fb-a4d8-ebad42de9c54" status: 200 len: 1313 microversion: 2.1 time: 0.224867 Sep 24 21:15:12.569954 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2618/5217] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:15:12 2022] GET /compute/v2.1/servers/2082c363-3653-45fb-a4d8-ebad42de9c54 => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:15:13.595068 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a06d3aed-7a68-4472-99ea-b598740ba67c tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:13.595860 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a06d3aed-7a68-4472-99ea-b598740ba67c tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] [instance: 2082c363-3653-45fb-a4d8-ebad42de9c54] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:13.598777 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:15:13.599738 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:15:13.605604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a06d3aed-7a68-4472-99ea-b598740ba67c tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:13.606443 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a06d3aed-7a68-4472-99ea-b598740ba67c tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:13.607147 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a06d3aed-7a68-4472-99ea-b598740ba67c tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:13.608085 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a06d3aed-7a68-4472-99ea-b598740ba67c tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:13.608774 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a06d3aed-7a68-4472-99ea-b598740ba67c tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:13.609300 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a06d3aed-7a68-4472-99ea-b598740ba67c tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:13.781164 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a06d3aed-7a68-4472-99ea-b598740ba67c tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a854bf2b0042439e87b8aa0476b0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdcaa646ba54f75abea17bdd8a6a62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:13.795749 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a06d3aed-7a68-4472-99ea-b598740ba67c tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] 10.222.0.52 "GET /compute/v2.1/servers/2082c363-3653-45fb-a4d8-ebad42de9c54" status: 200 len: 1498 microversion: 2.1 time: 0.204712 Sep 24 21:15:13.796354 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2600/5218] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:15:13 2022] GET /compute/v2.1/servers/2082c363-3653-45fb-a4d8-ebad42de9c54 => generated 1498 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:15:15.355638 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3f8a1e66-f1fe-4f54-91b7-78bca51b4f20 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:15.356887 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3f8a1e66-f1fe-4f54-91b7-78bca51b4f20 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] [instance: 2082c363-3653-45fb-a4d8-ebad42de9c54] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:15.372858 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3f8a1e66-f1fe-4f54-91b7-78bca51b4f20 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:15.373705 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3f8a1e66-f1fe-4f54-91b7-78bca51b4f20 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:15.374364 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3f8a1e66-f1fe-4f54-91b7-78bca51b4f20 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:15.375364 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3f8a1e66-f1fe-4f54-91b7-78bca51b4f20 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:15.376072 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3f8a1e66-f1fe-4f54-91b7-78bca51b4f20 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:15.376994 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3f8a1e66-f1fe-4f54-91b7-78bca51b4f20 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:15.410924 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3f8a1e66-f1fe-4f54-91b7-78bca51b4f20 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] [instance: 2082c363-3653-45fb-a4d8-ebad42de9c54] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:15:15.559475 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3f8a1e66-f1fe-4f54-91b7-78bca51b4f20 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2082c363-3653-45fb-a4d8-ebad42de9c54" status: 204 len: 0 microversion: 2.1 time: 0.206449 Sep 24 21:15:15.560100 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2619/5219] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:15:15 2022] DELETE /compute/v2.1/servers/2082c363-3653-45fb-a4d8-ebad42de9c54 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:15:15.569512 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-809ffbb7-cc78-40ff-9fa6-20811b2d6585 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:15.570302 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-809ffbb7-cc78-40ff-9fa6-20811b2d6585 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] [instance: 2082c363-3653-45fb-a4d8-ebad42de9c54] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:15.587349 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-809ffbb7-cc78-40ff-9fa6-20811b2d6585 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:15.588599 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-809ffbb7-cc78-40ff-9fa6-20811b2d6585 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:15.589129 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-809ffbb7-cc78-40ff-9fa6-20811b2d6585 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:15.589986 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-809ffbb7-cc78-40ff-9fa6-20811b2d6585 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:15.590761 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-809ffbb7-cc78-40ff-9fa6-20811b2d6585 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:15.591204 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-809ffbb7-cc78-40ff-9fa6-20811b2d6585 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:15.913012 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-809ffbb7-cc78-40ff-9fa6-20811b2d6585 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a854bf2b0042439e87b8aa0476b0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdcaa646ba54f75abea17bdd8a6a62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:15.922952 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-809ffbb7-cc78-40ff-9fa6-20811b2d6585 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] 10.222.0.52 "GET /compute/v2.1/servers/2082c363-3653-45fb-a4d8-ebad42de9c54" status: 200 len: 1504 microversion: 2.1 time: 0.358086 Sep 24 21:15:15.927571 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2601/5220] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:15:15 2022] GET /compute/v2.1/servers/2082c363-3653-45fb-a4d8-ebad42de9c54 => generated 1504 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:15:16.960817 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0f065b33-aeff-4cd0-a5bc-6fc262a409c4 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:16.962197 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0f065b33-aeff-4cd0-a5bc-6fc262a409c4 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] [instance: 2082c363-3653-45fb-a4d8-ebad42de9c54] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:16.974819 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f065b33-aeff-4cd0-a5bc-6fc262a409c4 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:16.977708 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f065b33-aeff-4cd0-a5bc-6fc262a409c4 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:16.979121 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f065b33-aeff-4cd0-a5bc-6fc262a409c4 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:16.981986 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f065b33-aeff-4cd0-a5bc-6fc262a409c4 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:16.983761 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f065b33-aeff-4cd0-a5bc-6fc262a409c4 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:16.984449 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f065b33-aeff-4cd0-a5bc-6fc262a409c4 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:17.403873 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0f065b33-aeff-4cd0-a5bc-6fc262a409c4 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a854bf2b0042439e87b8aa0476b0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdcaa646ba54f75abea17bdd8a6a62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:17.418223 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0f065b33-aeff-4cd0-a5bc-6fc262a409c4 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] 10.222.0.52 "GET /compute/v2.1/servers/2082c363-3653-45fb-a4d8-ebad42de9c54" status: 200 len: 1504 microversion: 2.1 time: 0.461594 Sep 24 21:15:17.421083 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2620/5221] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:15:16 2022] GET /compute/v2.1/servers/2082c363-3653-45fb-a4d8-ebad42de9c54 => generated 1504 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:15:17.607442 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d7a0e8ca-ceb3-4866-a1b4-8dbff2218192 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:17.608662 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d7a0e8ca-ceb3-4866-a1b4-8dbff2218192 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 0d61035b-7f6c-4be1-8928-29f872093427] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:17.619244 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7a0e8ca-ceb3-4866-a1b4-8dbff2218192 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:17.623042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7a0e8ca-ceb3-4866-a1b4-8dbff2218192 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:17.625199 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7a0e8ca-ceb3-4866-a1b4-8dbff2218192 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:17.626078 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7a0e8ca-ceb3-4866-a1b4-8dbff2218192 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:17.627318 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7a0e8ca-ceb3-4866-a1b4-8dbff2218192 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:17.629296 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7a0e8ca-ceb3-4866-a1b4-8dbff2218192 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:17.699489 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d7a0e8ca-ceb3-4866-a1b4-8dbff2218192 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 0d61035b-7f6c-4be1-8928-29f872093427] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:15:17.901936 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d7a0e8ca-ceb3-4866-a1b4-8dbff2218192 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0d61035b-7f6c-4be1-8928-29f872093427" status: 204 len: 0 microversion: 2.1 time: 0.296993 Sep 24 21:15:17.905271 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2602/5222] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:15:17 2022] DELETE /compute/v2.1/servers/0d61035b-7f6c-4be1-8928-29f872093427 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:15:17.919486 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4cfb2fb5-be8c-46d4-b0f4-8a82018a920b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:17.920360 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4cfb2fb5-be8c-46d4-b0f4-8a82018a920b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 0d61035b-7f6c-4be1-8928-29f872093427] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:17.939732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cfb2fb5-be8c-46d4-b0f4-8a82018a920b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:17.942599 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cfb2fb5-be8c-46d4-b0f4-8a82018a920b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:17.943172 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cfb2fb5-be8c-46d4-b0f4-8a82018a920b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:17.945851 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cfb2fb5-be8c-46d4-b0f4-8a82018a920b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:17.950256 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cfb2fb5-be8c-46d4-b0f4-8a82018a920b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:17.952452 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cfb2fb5-be8c-46d4-b0f4-8a82018a920b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:18.185229 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-a54c790a-22ae-41d4-9dc3-cd72e6cb1dc4 req-08548d0d-4afb-46e9-b996-4859bb4ee627 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2082c363-3653-45fb-a4d8-ebad42de9c54", "name": "network-vif-deleted", "tag": "264545b2-e2d0-40a4-be52-c97009a8f717"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:15:18.233675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a54c790a-22ae-41d4-9dc3-cd72e6cb1dc4 req-08548d0d-4afb-46e9-b996-4859bb4ee627 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:18.235871 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a54c790a-22ae-41d4-9dc3-cd72e6cb1dc4 req-08548d0d-4afb-46e9-b996-4859bb4ee627 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:18.237015 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a54c790a-22ae-41d4-9dc3-cd72e6cb1dc4 req-08548d0d-4afb-46e9-b996-4859bb4ee627 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:18.273114 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-a54c790a-22ae-41d4-9dc3-cd72e6cb1dc4 req-08548d0d-4afb-46e9-b996-4859bb4ee627 service nova] Creating event network-vif-deleted:264545b2-e2d0-40a4-be52-c97009a8f717 for instance 2082c363-3653-45fb-a4d8-ebad42de9c54 on nch1-master-1 Sep 24 21:15:18.297728 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-a54c790a-22ae-41d4-9dc3-cd72e6cb1dc4 req-08548d0d-4afb-46e9-b996-4859bb4ee627 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117451 Sep 24 21:15:18.299961 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2603/5223] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:15:18.345468 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4cfb2fb5-be8c-46d4-b0f4-8a82018a920b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:18.367398 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4cfb2fb5-be8c-46d4-b0f4-8a82018a920b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/0d61035b-7f6c-4be1-8928-29f872093427" status: 200 len: 1553 microversion: 2.1 time: 0.455345 Sep 24 21:15:18.368011 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2621/5224] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:15:17 2022] GET /compute/v2.1/servers/0d61035b-7f6c-4be1-8928-29f872093427 => generated 1553 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:15:18.448242 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9d207527-f7c8-4ba1-99f8-d11e687eca35 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:18.448982 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9d207527-f7c8-4ba1-99f8-d11e687eca35 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] [instance: 2082c363-3653-45fb-a4d8-ebad42de9c54] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:18.473262 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d207527-f7c8-4ba1-99f8-d11e687eca35 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:18.481721 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d207527-f7c8-4ba1-99f8-d11e687eca35 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:18.482348 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d207527-f7c8-4ba1-99f8-d11e687eca35 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:18.487699 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d207527-f7c8-4ba1-99f8-d11e687eca35 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:18.489520 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d207527-f7c8-4ba1-99f8-d11e687eca35 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:18.489984 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d207527-f7c8-4ba1-99f8-d11e687eca35 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:18.609964 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d207527-f7c8-4ba1-99f8-d11e687eca35 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:18.610483 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d207527-f7c8-4ba1-99f8-d11e687eca35 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:18.616484 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d207527-f7c8-4ba1-99f8-d11e687eca35 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:18.617170 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-9d207527-f7c8-4ba1-99f8-d11e687eca35 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lazy-loading 'fault' on Instance uuid 2082c363-3653-45fb-a4d8-ebad42de9c54 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:15:18.822964 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9d207527-f7c8-4ba1-99f8-d11e687eca35 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a854bf2b0042439e87b8aa0476b0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdcaa646ba54f75abea17bdd8a6a62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:18.840182 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9d207527-f7c8-4ba1-99f8-d11e687eca35 tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] 10.222.0.52 "GET /compute/v2.1/servers/2082c363-3653-45fb-a4d8-ebad42de9c54" status: 200 len: 1303 microversion: 2.1 time: 0.400970 Sep 24 21:15:18.841112 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2604/5225] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:15:18 2022] GET /compute/v2.1/servers/2082c363-3653-45fb-a4d8-ebad42de9c54 => generated 1303 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:15:19.532678 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3c38f2f1-9d92-44c8-aba3-b7db5fd40608 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:19.533551 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3c38f2f1-9d92-44c8-aba3-b7db5fd40608 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 0d61035b-7f6c-4be1-8928-29f872093427] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:19.549880 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c38f2f1-9d92-44c8-aba3-b7db5fd40608 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:19.550367 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c38f2f1-9d92-44c8-aba3-b7db5fd40608 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:19.553036 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c38f2f1-9d92-44c8-aba3-b7db5fd40608 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:19.553815 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c38f2f1-9d92-44c8-aba3-b7db5fd40608 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:19.554300 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c38f2f1-9d92-44c8-aba3-b7db5fd40608 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:19.557591 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c38f2f1-9d92-44c8-aba3-b7db5fd40608 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:19.863615 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e1241e5e-e7da-47e0-9b64-14e9973dd82b tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:19.864802 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e1241e5e-e7da-47e0-9b64-14e9973dd82b tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] [instance: 2082c363-3653-45fb-a4d8-ebad42de9c54] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:19.890804 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e1241e5e-e7da-47e0-9b64-14e9973dd82b tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:19.891836 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e1241e5e-e7da-47e0-9b64-14e9973dd82b tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:19.892429 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e1241e5e-e7da-47e0-9b64-14e9973dd82b tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:19.894076 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e1241e5e-e7da-47e0-9b64-14e9973dd82b tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:19.895846 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e1241e5e-e7da-47e0-9b64-14e9973dd82b tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:19.896487 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e1241e5e-e7da-47e0-9b64-14e9973dd82b tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:19.958250 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-e1241e5e-e7da-47e0-9b64-14e9973dd82b tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] HTTP exception thrown: Instance 2082c363-3653-45fb-a4d8-ebad42de9c54 could not be found. Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e1241e5e-e7da-47e0-9b64-14e9973dd82b tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Request method failure captured: Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/2082c363-3653-45fb-a4d8-ebad42de9c54 HTTP/1.1 Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3NTgy4x367ga2dbkP23H3aC3gyDRiE4ZjOxaSnwdiprfw2OCjFG1ZvCJsgtMgtw1bLbNOJzCLnkCo7q904U5bEdCcWgCk_vwL2103vtDj2W3x1gNbFYfmmgz_9ZdF04xAs93P1REqpAx7ZCql_FtQ9r_yLznaMCwEzv5FlP-dKnV7E Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: bcdcaa646ba54f75abea17bdd8a6a62d Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-VolumesActionsTest-216683067 Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bcdcaa646ba54f75abea17bdd8a6a62d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bcdcaa646ba54f75abea17bdd8a6a62d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bcdcaa646ba54f75abea17bdd8a6a62d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bcdcaa646ba54f75abea17bdd8a6a62d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-VolumesActionsTest-216683067 Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: bcdcaa646ba54f75abea17bdd8a6a62d Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-VolumesActionsTest-216683067 Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-VolumesActionsTest-216683067-project Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 82a854bf2b0042439e87b8aa0476b0e4 Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-VolumesActionsTest-216683067-project Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 2082c363-3653-45fb-a4d8-ebad42de9c54 could not be found. Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '2082c363-3653-45fb-a4d8-ebad42de9c54'} Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2082c363-3653-45fb-a4d8-ebad42de9c54 could not be found. Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2082c363-3653-45fb-a4d8-ebad42de9c54 could not be found. Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:15:19.962149 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:15:19.966004 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:15:19.966004 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:15:19.966004 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:15:19.966004 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:15:19.966004 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:15:19.966004 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2082c363-3653-45fb-a4d8-ebad42de9c54 could not be found. Sep 24 21:15:19.966004 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:15:19.966004 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e1241e5e-e7da-47e0-9b64-14e9973dd82b tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] Returning 404 to user: Instance 2082c363-3653-45fb-a4d8-ebad42de9c54 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:15:19.966004 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e1241e5e-e7da-47e0-9b64-14e9973dd82b tempest-VolumesActionsTest-216683067 tempest-VolumesActionsTest-216683067-project] 10.222.0.52 "GET /compute/v2.1/servers/2082c363-3653-45fb-a4d8-ebad42de9c54" status: 404 len: 111 microversion: 2.1 time: 0.104584 Sep 24 21:15:19.995332 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2605/5226] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:15:19 2022] GET /compute/v2.1/servers/2082c363-3653-45fb-a4d8-ebad42de9c54 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 21:15:20.317889 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3c38f2f1-9d92-44c8-aba3-b7db5fd40608 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:20.351414 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-de2a3ed1-046b-4958-b55d-0286d878b841 req-442c3492-39e1-4988-a42d-ec2dc2f28b74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d61035b-7f6c-4be1-8928-29f872093427", "name": "network-vif-deleted", "tag": "6ce7f648-9626-448a-b02c-aa480dbb59a0"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:15:20.376110 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3c38f2f1-9d92-44c8-aba3-b7db5fd40608 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/0d61035b-7f6c-4be1-8928-29f872093427" status: 200 len: 1553 microversion: 2.1 time: 0.841784 Sep 24 21:15:20.397567 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2622/5227] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:15:19 2022] GET /compute/v2.1/servers/0d61035b-7f6c-4be1-8928-29f872093427 => generated 1553 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:15:20.402846 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-de2a3ed1-046b-4958-b55d-0286d878b841 req-442c3492-39e1-4988-a42d-ec2dc2f28b74 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:20.404342 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-de2a3ed1-046b-4958-b55d-0286d878b841 req-442c3492-39e1-4988-a42d-ec2dc2f28b74 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:20.404701 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-de2a3ed1-046b-4958-b55d-0286d878b841 req-442c3492-39e1-4988-a42d-ec2dc2f28b74 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:20.442286 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-de2a3ed1-046b-4958-b55d-0286d878b841 req-442c3492-39e1-4988-a42d-ec2dc2f28b74 service nova] Creating event network-vif-deleted:6ce7f648-9626-448a-b02c-aa480dbb59a0 for instance 0d61035b-7f6c-4be1-8928-29f872093427 on nch2-master-1 Sep 24 21:15:20.450551 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-de2a3ed1-046b-4958-b55d-0286d878b841 req-442c3492-39e1-4988-a42d-ec2dc2f28b74 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103501 Sep 24 21:15:20.457139 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2606/5228] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:15:21.405234 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ed0913eb-d9c1-4fc0-b39f-059e03ffbdd5 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:21.405849 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ed0913eb-d9c1-4fc0-b39f-059e03ffbdd5 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 0d61035b-7f6c-4be1-8928-29f872093427] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:21.413132 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed0913eb-d9c1-4fc0-b39f-059e03ffbdd5 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:21.413634 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed0913eb-d9c1-4fc0-b39f-059e03ffbdd5 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:21.414072 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed0913eb-d9c1-4fc0-b39f-059e03ffbdd5 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:21.414802 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed0913eb-d9c1-4fc0-b39f-059e03ffbdd5 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:21.415349 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed0913eb-d9c1-4fc0-b39f-059e03ffbdd5 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:21.416826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed0913eb-d9c1-4fc0-b39f-059e03ffbdd5 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:21.439980 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-ed0913eb-d9c1-4fc0-b39f-059e03ffbdd5 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] HTTP exception thrown: Instance 0d61035b-7f6c-4be1-8928-29f872093427 could not be found. Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ed0913eb-d9c1-4fc0-b39f-059e03ffbdd5 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Request method failure captured: Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/0d61035b-7f6c-4be1-8928-29f872093427 HTTP/1.1 Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3LbnV8mCWJ6FgxfH9q4EKgvMb1JSjzpbYve959NeESy_sQhJToq9h52C_P8gtbUmCMXx1tBjKlrx99QZ3XLUF4T7dqGj481OcwRYKAcnr9kOqXeY-e2Y0SYM8N511519IaicdeEMvMkvR3KcQ5N1ysWl7OyfTs3FEtNQJiRJG5uuIE Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 026ea39b3679444a9c3541e58d2e9f7b Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-TestNetworkBasicOps-911154638 Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/026ea39b3679444a9c3541e58d2e9f7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_026ea39b3679444a9c3541e58d2e9f7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/026ea39b3679444a9c3541e58d2e9f7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/026ea39b3679444a9c3541e58d2e9f7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-TestNetworkBasicOps-911154638 Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 026ea39b3679444a9c3541e58d2e9f7b Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-TestNetworkBasicOps-911154638 Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-TestNetworkBasicOps-911154638-project Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: c1acf8d4b1384c8c8d7014bd8baf897e Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-TestNetworkBasicOps-911154638-project Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 0d61035b-7f6c-4be1-8928-29f872093427 could not be found. Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '0d61035b-7f6c-4be1-8928-29f872093427'} Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d61035b-7f6c-4be1-8928-29f872093427 could not be found. Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d61035b-7f6c-4be1-8928-29f872093427 could not be found. Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:15:21.441912 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:15:21.445953 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:15:21.445953 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:15:21.445953 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:15:21.445953 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:15:21.445953 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:15:21.445953 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d61035b-7f6c-4be1-8928-29f872093427 could not be found. Sep 24 21:15:21.445953 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:15:21.449958 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ed0913eb-d9c1-4fc0-b39f-059e03ffbdd5 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Returning 404 to user: Instance 0d61035b-7f6c-4be1-8928-29f872093427 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:15:21.451048 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ed0913eb-d9c1-4fc0-b39f-059e03ffbdd5 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/0d61035b-7f6c-4be1-8928-29f872093427" status: 404 len: 111 microversion: 2.1 time: 0.051189 Sep 24 21:15:21.455443 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2623/5229] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:15:21 2022] GET /compute/v2.1/servers/0d61035b-7f6c-4be1-8928-29f872093427 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:15:21.692902 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b2f1a495-bba6-40db-99ab-bbb017792dfe tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '.version_select at 0x7f4b07404280>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:21.720073 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b2f1a495-bba6-40db-99ab-bbb017792dfe tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1999024207" status: 202 len: 0 microversion: 2.1 time: 0.031727 Sep 24 21:15:21.720801 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2607/5230] 10.222.0.52 () {58 vars in 1257 bytes} [Sat Sep 24 21:15:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1999024207 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:15:22.001652 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e87413de-6056-4285-ad49-a1a1fd67358a tempest-TestAggregatesBasicOps-571604883 tempest-TestAggregatesBasicOps-571604883-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-882306090", "availability_zone": "foo_zone"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:15:22.005354 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.aggregate [None req-e87413de-6056-4285-ad49-a1a1fd67358a tempest-TestAggregatesBasicOps-571604883 tempest-TestAggregatesBasicOps-571604883-project-admin] Generated uuid 7e324ac8-c86c-442f-968c-c23af32223cf for aggregate {{(pid=140517) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 24 21:15:22.044404 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e87413de-6056-4285-ad49-a1a1fd67358a tempest-TestAggregatesBasicOps-571604883 tempest-TestAggregatesBasicOps-571604883-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.248940 Sep 24 21:15:22.045222 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2624/5231] 10.222.0.52 () {60 vars in 1164 bytes} [Sat Sep 24 21:15:21 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:15:22.058785 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a9a72ce2-e048-4aa0-9a68-bb4e3dd482fd tempest-TestAggregatesBasicOps-571604883 tempest-TestAggregatesBasicOps-571604883-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:15:22.096908 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a9a72ce2-e048-4aa0-9a68-bb4e3dd482fd tempest-TestAggregatesBasicOps-571604883 tempest-TestAggregatesBasicOps-571604883-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.043134 Sep 24 21:15:22.098218 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2608/5232] 10.222.0.52 () {60 vars in 1194 bytes} [Sat Sep 24 21:15:22 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:15:22.110760 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d5832935-4b32-401b-b19e-4b155d17abaf tempest-TestAggregatesBasicOps-571604883 tempest-TestAggregatesBasicOps-571604883-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:22.114437 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d5832935-4b32-401b-b19e-4b155d17abaf tempest-TestAggregatesBasicOps-571604883 tempest-TestAggregatesBasicOps-571604883-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:22.114959 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d5832935-4b32-401b-b19e-4b155d17abaf tempest-TestAggregatesBasicOps-571604883 tempest-TestAggregatesBasicOps-571604883-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:22.115406 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d5832935-4b32-401b-b19e-4b155d17abaf tempest-TestAggregatesBasicOps-571604883 tempest-TestAggregatesBasicOps-571604883-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:22.116150 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d5832935-4b32-401b-b19e-4b155d17abaf tempest-TestAggregatesBasicOps-571604883 tempest-TestAggregatesBasicOps-571604883-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:22.116619 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d5832935-4b32-401b-b19e-4b155d17abaf tempest-TestAggregatesBasicOps-571604883 tempest-TestAggregatesBasicOps-571604883-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:22.117052 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d5832935-4b32-401b-b19e-4b155d17abaf tempest-TestAggregatesBasicOps-571604883 tempest-TestAggregatesBasicOps-571604883-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:22.151093 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d5832935-4b32-401b-b19e-4b155d17abaf tempest-TestAggregatesBasicOps-571604883 tempest-TestAggregatesBasicOps-571604883-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.044731 Sep 24 21:15:22.152507 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2625/5233] 10.222.0.52 () {58 vars in 1176 bytes} [Sat Sep 24 21:15:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:15:22.164811 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7f08b325-f75e-4707-a50c-b4bf1089bfc4 tempest-TestAggregatesBasicOps-571604883 tempest-TestAggregatesBasicOps-571604883-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:22.177750 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7f08b325-f75e-4707-a50c-b4bf1089bfc4 tempest-TestAggregatesBasicOps-571604883 tempest-TestAggregatesBasicOps-571604883-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.016887 Sep 24 21:15:22.192465 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2609/5234] 10.222.0.52 () {58 vars in 1143 bytes} [Sat Sep 24 21:15:22 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:15:22.195480 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a257a70a-9dfa-4747-a235-12079a832dbe tempest-TestAggregatesBasicOps-571604883 tempest-TestAggregatesBasicOps-571604883-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:15:22.211695 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a257a70a-9dfa-4747-a235-12079a832dbe tempest-TestAggregatesBasicOps-571604883 tempest-TestAggregatesBasicOps-571604883-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:22.212375 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a257a70a-9dfa-4747-a235-12079a832dbe tempest-TestAggregatesBasicOps-571604883 tempest-TestAggregatesBasicOps-571604883-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:22.213066 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a257a70a-9dfa-4747-a235-12079a832dbe tempest-TestAggregatesBasicOps-571604883 tempest-TestAggregatesBasicOps-571604883-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:22.736250 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a257a70a-9dfa-4747-a235-12079a832dbe tempest-TestAggregatesBasicOps-571604883 tempest-TestAggregatesBasicOps-571604883-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.544853 Sep 24 21:15:22.750165 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2626/5235] 10.222.0.52 () {60 vars in 1194 bytes} [Sat Sep 24 21:15:22 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:15:22.760451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-592f83bd-7930-467f-b8a4-1c47e0a4a4b5 tempest-TestAggregatesBasicOps-571604883 tempest-TestAggregatesBasicOps-571604883-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:22.786676 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-592f83bd-7930-467f-b8a4-1c47e0a4a4b5 tempest-TestAggregatesBasicOps-571604883 tempest-TestAggregatesBasicOps-571604883-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.026608 Sep 24 21:15:22.795727 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2610/5236] 10.222.0.52 () {58 vars in 1152 bytes} [Sat Sep 24 21:15:22 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:15:22.800552 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-394d9dcb-ad07-433e-9e70-ce30e40498c0 tempest-TestAggregatesBasicOps-571604883 tempest-TestAggregatesBasicOps-571604883-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1048522672", "availability_zone": "foo_zone"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:15:22.939691 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-394d9dcb-ad07-433e-9e70-ce30e40498c0 tempest-TestAggregatesBasicOps-571604883 tempest-TestAggregatesBasicOps-571604883-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.143434 Sep 24 21:15:22.944231 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2627/5237] 10.222.0.52 () {60 vars in 1173 bytes} [Sat Sep 24 21:15:22 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:15:22.955074 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-907bf26c-ca49-4213-b1c8-37b8aef77ff6 tempest-TestAggregatesBasicOps-571604883 tempest-TestAggregatesBasicOps-571604883-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:15:23.066692 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-907bf26c-ca49-4213-b1c8-37b8aef77ff6 tempest-TestAggregatesBasicOps-571604883 tempest-TestAggregatesBasicOps-571604883-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.115787 Sep 24 21:15:23.068622 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2611/5238] 10.222.0.52 () {60 vars in 1194 bytes} [Sat Sep 24 21:15:22 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:15:23.083731 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0efb582f-9c05-461a-8252-ddb5aa6f36c5 tempest-TestAggregatesBasicOps-571604883 tempest-TestAggregatesBasicOps-571604883-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:23.107710 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0efb582f-9c05-461a-8252-ddb5aa6f36c5 tempest-TestAggregatesBasicOps-571604883 tempest-TestAggregatesBasicOps-571604883-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.030601 Sep 24 21:15:23.123028 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-82c11a54-a7d7-4c3a-8592-a1927d994da6 tempest-TestAggregatesBasicOps-571604883 tempest-TestAggregatesBasicOps-571604883-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:15:23.148241 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2628/5239] 10.222.0.52 () {58 vars in 1152 bytes} [Sat Sep 24 21:15:23 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:15:23.169463 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-82c11a54-a7d7-4c3a-8592-a1927d994da6 tempest-TestAggregatesBasicOps-571604883 tempest-TestAggregatesBasicOps-571604883-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:23.186644 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-82c11a54-a7d7-4c3a-8592-a1927d994da6 tempest-TestAggregatesBasicOps-571604883 tempest-TestAggregatesBasicOps-571604883-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:23.188803 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-82c11a54-a7d7-4c3a-8592-a1927d994da6 tempest-TestAggregatesBasicOps-571604883 tempest-TestAggregatesBasicOps-571604883-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:23.579956 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-82c11a54-a7d7-4c3a-8592-a1927d994da6 tempest-TestAggregatesBasicOps-571604883 tempest-TestAggregatesBasicOps-571604883-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.462159 Sep 24 21:15:23.581227 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2612/5240] 10.222.0.52 () {60 vars in 1194 bytes} [Sat Sep 24 21:15:23 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:15:23.595510 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7b028fe4-9d24-4b3a-a052-baa24c1c78f0 tempest-TestAggregatesBasicOps-571604883 tempest-TestAggregatesBasicOps-571604883-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:23.642963 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7b028fe4-9d24-4b3a-a052-baa24c1c78f0 tempest-TestAggregatesBasicOps-571604883 tempest-TestAggregatesBasicOps-571604883-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.051555 Sep 24 21:15:23.650163 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2629/5241] 10.222.0.52 () {58 vars in 1155 bytes} [Sat Sep 24 21:15:23 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 24 21:15:25.506033 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b5d6ee7a-9f34-4183-893f-1094997d48fc tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:25.506679 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b5d6ee7a-9f34-4183-893f-1094997d48fc tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: ffc72415-a082-4a15-a036-86c522dd437e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:25.524820 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-e0edce2f-f42e-437e-8341-cc83ca386e36 req-6b18c2f6-34d2-44e0-924f-8af63f744d9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffc72415-a082-4a15-a036-86c522dd437e", "tag": "f45ac4cc-f086-4c47-b06d-f18061694c58"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:15:25.531741 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5d6ee7a-9f34-4183-893f-1094997d48fc tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:25.532221 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5d6ee7a-9f34-4183-893f-1094997d48fc tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:25.532655 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5d6ee7a-9f34-4183-893f-1094997d48fc tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:25.545045 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5d6ee7a-9f34-4183-893f-1094997d48fc tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:25.546048 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5d6ee7a-9f34-4183-893f-1094997d48fc tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:25.546733 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5d6ee7a-9f34-4183-893f-1094997d48fc tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:25.552916 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e0edce2f-f42e-437e-8341-cc83ca386e36 req-6b18c2f6-34d2-44e0-924f-8af63f744d9e service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:25.555081 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e0edce2f-f42e-437e-8341-cc83ca386e36 req-6b18c2f6-34d2-44e0-924f-8af63f744d9e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:25.559312 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e0edce2f-f42e-437e-8341-cc83ca386e36 req-6b18c2f6-34d2-44e0-924f-8af63f744d9e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:25.595271 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-e0edce2f-f42e-437e-8341-cc83ca386e36 req-6b18c2f6-34d2-44e0-924f-8af63f744d9e service nova] Creating event network-changed:f45ac4cc-f086-4c47-b06d-f18061694c58 for instance ffc72415-a082-4a15-a036-86c522dd437e on nch2-master-1 Sep 24 21:15:25.624489 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-e0edce2f-f42e-437e-8341-cc83ca386e36 req-6b18c2f6-34d2-44e0-924f-8af63f744d9e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100135 Sep 24 21:15:25.627794 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2630/5242] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:15:25.649176 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b5d6ee7a-9f34-4183-893f-1094997d48fc tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: ffc72415-a082-4a15-a036-86c522dd437e] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:15:25.811186 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b5d6ee7a-9f34-4183-893f-1094997d48fc tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e" status: 204 len: 0 microversion: 2.1 time: 0.307917 Sep 24 21:15:25.812009 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2613/5243] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:15:25 2022] DELETE /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:15:25.822429 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-45de5612-b064-4ed6-8f16-e99ca6986d76 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:25.823202 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-45de5612-b064-4ed6-8f16-e99ca6986d76 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: ffc72415-a082-4a15-a036-86c522dd437e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:25.832371 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45de5612-b064-4ed6-8f16-e99ca6986d76 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:25.832593 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45de5612-b064-4ed6-8f16-e99ca6986d76 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:25.833014 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45de5612-b064-4ed6-8f16-e99ca6986d76 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:25.835905 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45de5612-b064-4ed6-8f16-e99ca6986d76 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:25.836646 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45de5612-b064-4ed6-8f16-e99ca6986d76 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:25.837795 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45de5612-b064-4ed6-8f16-e99ca6986d76 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:26.146231 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-45de5612-b064-4ed6-8f16-e99ca6986d76 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:26.159085 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-45de5612-b064-4ed6-8f16-e99ca6986d76 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e" status: 200 len: 1671 microversion: 2.1 time: 0.341750 Sep 24 21:15:26.175194 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2631/5244] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:15:25 2022] GET /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e => generated 1671 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:15:27.207381 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b8c313b7-10fc-4d6a-969a-d05fd0cabd76 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:27.208099 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b8c313b7-10fc-4d6a-969a-d05fd0cabd76 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: ffc72415-a082-4a15-a036-86c522dd437e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:27.224283 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b8c313b7-10fc-4d6a-969a-d05fd0cabd76 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:27.225824 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b8c313b7-10fc-4d6a-969a-d05fd0cabd76 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:27.227073 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b8c313b7-10fc-4d6a-969a-d05fd0cabd76 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:27.229491 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b8c313b7-10fc-4d6a-969a-d05fd0cabd76 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:27.230068 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b8c313b7-10fc-4d6a-969a-d05fd0cabd76 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:27.230811 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b8c313b7-10fc-4d6a-969a-d05fd0cabd76 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:27.467139 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b8c313b7-10fc-4d6a-969a-d05fd0cabd76 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:27.506039 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b8c313b7-10fc-4d6a-969a-d05fd0cabd76 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e" status: 200 len: 1671 microversion: 2.1 time: 0.323110 Sep 24 21:15:27.520376 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2614/5245] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:15:27 2022] GET /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e => generated 1671 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:15:28.535870 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-93c4fec2-ad7e-4ba9-8487-8ee1b2b45f35 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:28.536506 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-93c4fec2-ad7e-4ba9-8487-8ee1b2b45f35 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: ffc72415-a082-4a15-a036-86c522dd437e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:28.558461 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93c4fec2-ad7e-4ba9-8487-8ee1b2b45f35 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:28.559070 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93c4fec2-ad7e-4ba9-8487-8ee1b2b45f35 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:28.559559 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93c4fec2-ad7e-4ba9-8487-8ee1b2b45f35 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:28.560290 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93c4fec2-ad7e-4ba9-8487-8ee1b2b45f35 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:28.560757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93c4fec2-ad7e-4ba9-8487-8ee1b2b45f35 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:28.572207 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93c4fec2-ad7e-4ba9-8487-8ee1b2b45f35 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:28.854251 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-93c4fec2-ad7e-4ba9-8487-8ee1b2b45f35 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:28.887185 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-93c4fec2-ad7e-4ba9-8487-8ee1b2b45f35 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e" status: 200 len: 1552 microversion: 2.1 time: 0.354517 Sep 24 21:15:28.889718 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2632/5246] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:15:28 2022] GET /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e => generated 1552 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:15:28.986401 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-76174426-89d6-4ccb-8feb-793f259bcd64 req-006d6972-3c77-4bb0-bca6-66ec2a2d7a60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc72415-a082-4a15-a036-86c522dd437e", "name": "network-vif-deleted", "tag": "f45ac4cc-f086-4c47-b06d-f18061694c58"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:15:29.006793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-76174426-89d6-4ccb-8feb-793f259bcd64 req-006d6972-3c77-4bb0-bca6-66ec2a2d7a60 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:29.007292 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-76174426-89d6-4ccb-8feb-793f259bcd64 req-006d6972-3c77-4bb0-bca6-66ec2a2d7a60 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:29.007733 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-76174426-89d6-4ccb-8feb-793f259bcd64 req-006d6972-3c77-4bb0-bca6-66ec2a2d7a60 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:29.029171 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-76174426-89d6-4ccb-8feb-793f259bcd64 req-006d6972-3c77-4bb0-bca6-66ec2a2d7a60 service nova] Creating event network-vif-deleted:f45ac4cc-f086-4c47-b06d-f18061694c58 for instance ffc72415-a082-4a15-a036-86c522dd437e on nch2-master-1 Sep 24 21:15:29.048120 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-76174426-89d6-4ccb-8feb-793f259bcd64 req-006d6972-3c77-4bb0-bca6-66ec2a2d7a60 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065334 Sep 24 21:15:29.049161 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2615/5247] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:15:29.917070 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-80988ed7-62e2-46f5-8d4c-50715a8d81de tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:29.917704 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-80988ed7-62e2-46f5-8d4c-50715a8d81de tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: ffc72415-a082-4a15-a036-86c522dd437e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:29.932306 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-80988ed7-62e2-46f5-8d4c-50715a8d81de tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:29.932816 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-80988ed7-62e2-46f5-8d4c-50715a8d81de tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:29.933266 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-80988ed7-62e2-46f5-8d4c-50715a8d81de tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:29.934005 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-80988ed7-62e2-46f5-8d4c-50715a8d81de tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:29.934513 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-80988ed7-62e2-46f5-8d4c-50715a8d81de tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:29.937363 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-80988ed7-62e2-46f5-8d4c-50715a8d81de tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:30.028710 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-80988ed7-62e2-46f5-8d4c-50715a8d81de tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:30.029216 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-80988ed7-62e2-46f5-8d4c-50715a8d81de tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:30.029671 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-80988ed7-62e2-46f5-8d4c-50715a8d81de tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:30.030143 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-80988ed7-62e2-46f5-8d4c-50715a8d81de tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lazy-loading 'fault' on Instance uuid ffc72415-a082-4a15-a036-86c522dd437e {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:15:30.132343 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-80988ed7-62e2-46f5-8d4c-50715a8d81de tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:30.143782 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-80988ed7-62e2-46f5-8d4c-50715a8d81de tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e" status: 200 len: 1339 microversion: 2.1 time: 0.231049 Sep 24 21:15:30.144883 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2633/5248] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:15:29 2022] GET /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e => generated 1339 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:15:31.173242 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f9374ba4-2d55-437c-873f-af171dcdc1ad tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:31.174107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f9374ba4-2d55-437c-873f-af171dcdc1ad tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: ffc72415-a082-4a15-a036-86c522dd437e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:31.203642 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9374ba4-2d55-437c-873f-af171dcdc1ad tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:31.207149 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9374ba4-2d55-437c-873f-af171dcdc1ad tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:31.208574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9374ba4-2d55-437c-873f-af171dcdc1ad tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:31.210109 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9374ba4-2d55-437c-873f-af171dcdc1ad tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:31.219766 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9374ba4-2d55-437c-873f-af171dcdc1ad tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:31.220696 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9374ba4-2d55-437c-873f-af171dcdc1ad tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:31.260424 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:15:31.262697 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-f9374ba4-2d55-437c-873f-af171dcdc1ad tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] HTTP exception thrown: Instance ffc72415-a082-4a15-a036-86c522dd437e could not be found. Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f9374ba4-2d55-437c-873f-af171dcdc1ad tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Request method failure captured: Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e HTTP/1.1 Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3LbnV8mCWJ6FgxfH9q4EKgvMb1JSjzpbYve959NeESy_sQhJToq9h52C_P8gtbUmCMXx1tBjKlrx99QZ3XLUF4T7dqGj481OcwRYKAcnr9kOqXeY-e2Y0SYM8N511519IaicdeEMvMkvR3KcQ5N1ysWl7OyfTs3FEtNQJiRJG5uuIE Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 026ea39b3679444a9c3541e58d2e9f7b Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-TestNetworkBasicOps-911154638 Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/026ea39b3679444a9c3541e58d2e9f7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_026ea39b3679444a9c3541e58d2e9f7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/026ea39b3679444a9c3541e58d2e9f7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/026ea39b3679444a9c3541e58d2e9f7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-TestNetworkBasicOps-911154638 Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 026ea39b3679444a9c3541e58d2e9f7b Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-TestNetworkBasicOps-911154638 Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-TestNetworkBasicOps-911154638-project Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: c1acf8d4b1384c8c8d7014bd8baf897e Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-TestNetworkBasicOps-911154638-project Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance ffc72415-a082-4a15-a036-86c522dd437e could not be found. Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'ffc72415-a082-4a15-a036-86c522dd437e'} Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffc72415-a082-4a15-a036-86c522dd437e could not be found. Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffc72415-a082-4a15-a036-86c522dd437e could not be found. Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:15:31.264247 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:15:31.268091 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:15:31.268091 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:15:31.268091 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:15:31.268091 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:15:31.268091 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:15:31.268091 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffc72415-a082-4a15-a036-86c522dd437e could not be found. Sep 24 21:15:31.268091 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:15:31.269499 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f9374ba4-2d55-437c-873f-af171dcdc1ad tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Returning 404 to user: Instance ffc72415-a082-4a15-a036-86c522dd437e could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:15:31.271873 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f9374ba4-2d55-437c-873f-af171dcdc1ad tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e" status: 404 len: 111 microversion: 2.1 time: 0.104478 Sep 24 21:15:31.272483 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2616/5249] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:15:31 2022] GET /compute/v2.1/servers/ffc72415-a082-4a15-a036-86c522dd437e => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:15:31.722948 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e028b8d5-0086-4a19-8191-364d5cb6a140 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '.version_select at 0x7f4b07434550>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:31.769683 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e028b8d5-0086-4a19-8191-364d5cb6a140 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1148172071" status: 202 len: 0 microversion: 2.1 time: 0.051376 Sep 24 21:15:31.773961 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2634/5250] 10.222.0.52 () {58 vars in 1257 bytes} [Sat Sep 24 21:15:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1148172071 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:15:36.349825 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c2ce5e2c-e6ef-4c84-8624-23abf9697eaf tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:36.350332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c2ce5e2c-e6ef-4c84-8624-23abf9697eaf tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: 6029de15-fd98-4be1-8c3d-7d63be381363] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:36.360169 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=5,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:15:36.374618 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2ce5e2c-e6ef-4c84-8624-23abf9697eaf tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:36.376224 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2ce5e2c-e6ef-4c84-8624-23abf9697eaf tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:36.377066 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2ce5e2c-e6ef-4c84-8624-23abf9697eaf tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:36.378032 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2ce5e2c-e6ef-4c84-8624-23abf9697eaf tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:36.379215 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2ce5e2c-e6ef-4c84-8624-23abf9697eaf tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:36.381208 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2ce5e2c-e6ef-4c84-8624-23abf9697eaf tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:36.421191 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c2ce5e2c-e6ef-4c84-8624-23abf9697eaf tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363/ips" status: 200 len: 146 microversion: 2.1 time: 0.077513 Sep 24 21:15:36.423870 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2617/5251] 10.222.0.52 () {58 vars in 1248 bytes} [Sat Sep 24 21:15:36 2022] GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363/ips => generated 146 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:15:38.140459 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:15:38.148869 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6e647de8-9bdd-4291-a682-46a37869ca8c tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:38.150713 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6e647de8-9bdd-4291-a682-46a37869ca8c tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: 6029de15-fd98-4be1-8c3d-7d63be381363] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:38.155142 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:15:38.164865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6e647de8-9bdd-4291-a682-46a37869ca8c tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:38.171382 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6e647de8-9bdd-4291-a682-46a37869ca8c tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:38.171382 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6e647de8-9bdd-4291-a682-46a37869ca8c tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:38.171382 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6e647de8-9bdd-4291-a682-46a37869ca8c tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:38.171382 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6e647de8-9bdd-4291-a682-46a37869ca8c tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:38.171382 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6e647de8-9bdd-4291-a682-46a37869ca8c tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:38.175932 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:15:38.225678 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6e647de8-9bdd-4291-a682-46a37869ca8c tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: 6029de15-fd98-4be1-8c3d-7d63be381363] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:15:38.354901 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6e647de8-9bdd-4291-a682-46a37869ca8c tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363" status: 204 len: 0 microversion: 2.1 time: 0.214635 Sep 24 21:15:38.356037 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2635/5252] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:15:38 2022] DELETE /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:15:38.365031 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-848c2dcf-c74f-4e03-bccc-33d8b30f1f2c tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:38.366577 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-848c2dcf-c74f-4e03-bccc-33d8b30f1f2c tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: 6029de15-fd98-4be1-8c3d-7d63be381363] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:38.378052 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-848c2dcf-c74f-4e03-bccc-33d8b30f1f2c tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:38.379399 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-848c2dcf-c74f-4e03-bccc-33d8b30f1f2c tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:38.379865 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-848c2dcf-c74f-4e03-bccc-33d8b30f1f2c tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:38.380920 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-848c2dcf-c74f-4e03-bccc-33d8b30f1f2c tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:38.381965 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-848c2dcf-c74f-4e03-bccc-33d8b30f1f2c tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:38.383123 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-848c2dcf-c74f-4e03-bccc-33d8b30f1f2c tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:38.744573 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-848c2dcf-c74f-4e03-bccc-33d8b30f1f2c tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c163c13444454c9a23703c08a9cc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8590b56a0c924f76ba18920e735e6b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:38.760267 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-848c2dcf-c74f-4e03-bccc-33d8b30f1f2c tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363" status: 200 len: 1674 microversion: 2.1 time: 0.399763 Sep 24 21:15:38.764635 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2618/5253] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:15:38 2022] GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363 => generated 1674 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:15:39.796155 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d253e964-efda-4a39-805b-fa36c0c2d8f4 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:39.797897 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d253e964-efda-4a39-805b-fa36c0c2d8f4 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: 6029de15-fd98-4be1-8c3d-7d63be381363] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:39.807406 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d253e964-efda-4a39-805b-fa36c0c2d8f4 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:39.808232 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d253e964-efda-4a39-805b-fa36c0c2d8f4 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:39.808674 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d253e964-efda-4a39-805b-fa36c0c2d8f4 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:39.809626 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d253e964-efda-4a39-805b-fa36c0c2d8f4 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:39.810082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d253e964-efda-4a39-805b-fa36c0c2d8f4 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:39.810698 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d253e964-efda-4a39-805b-fa36c0c2d8f4 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:40.142901 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d253e964-efda-4a39-805b-fa36c0c2d8f4 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c163c13444454c9a23703c08a9cc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8590b56a0c924f76ba18920e735e6b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:40.155825 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d253e964-efda-4a39-805b-fa36c0c2d8f4 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363" status: 200 len: 1674 microversion: 2.1 time: 0.366709 Sep 24 21:15:40.156978 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2636/5254] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:15:39 2022] GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363 => generated 1674 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:15:41.181231 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-51abe1a8-ef2f-4a51-9e35-0a7792af80f2 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:41.182682 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-51abe1a8-ef2f-4a51-9e35-0a7792af80f2 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: 6029de15-fd98-4be1-8c3d-7d63be381363] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:41.194266 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51abe1a8-ef2f-4a51-9e35-0a7792af80f2 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:41.194809 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51abe1a8-ef2f-4a51-9e35-0a7792af80f2 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:41.195261 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51abe1a8-ef2f-4a51-9e35-0a7792af80f2 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:41.210712 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51abe1a8-ef2f-4a51-9e35-0a7792af80f2 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:41.211832 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51abe1a8-ef2f-4a51-9e35-0a7792af80f2 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:41.212348 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51abe1a8-ef2f-4a51-9e35-0a7792af80f2 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:41.438609 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-51abe1a8-ef2f-4a51-9e35-0a7792af80f2 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c163c13444454c9a23703c08a9cc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8590b56a0c924f76ba18920e735e6b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:41.448183 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-51abe1a8-ef2f-4a51-9e35-0a7792af80f2 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363" status: 200 len: 1607 microversion: 2.1 time: 0.270882 Sep 24 21:15:41.463310 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2619/5255] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:15:41 2022] GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363 => generated 1607 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:15:41.944220 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-eb721879-c57a-4bc5-8223-8ee42fd36414 req-de9b703c-be98-41f9-ba1b-270472a1bbab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6029de15-fd98-4be1-8c3d-7d63be381363", "name": "network-vif-deleted", "tag": "d73312e8-32fb-499c-b5d9-1b6927e0b7ea"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:15:41.972623 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-eb721879-c57a-4bc5-8223-8ee42fd36414 req-de9b703c-be98-41f9-ba1b-270472a1bbab service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:41.982947 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-eb721879-c57a-4bc5-8223-8ee42fd36414 req-de9b703c-be98-41f9-ba1b-270472a1bbab service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:41.985618 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-eb721879-c57a-4bc5-8223-8ee42fd36414 req-de9b703c-be98-41f9-ba1b-270472a1bbab service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:42.015483 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-eb721879-c57a-4bc5-8223-8ee42fd36414 req-de9b703c-be98-41f9-ba1b-270472a1bbab service nova] Creating event network-vif-deleted:d73312e8-32fb-499c-b5d9-1b6927e0b7ea for instance 6029de15-fd98-4be1-8c3d-7d63be381363 on nch1-master-1 Sep 24 21:15:42.028712 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-eb721879-c57a-4bc5-8223-8ee42fd36414 req-de9b703c-be98-41f9-ba1b-270472a1bbab service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088996 Sep 24 21:15:42.033013 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2637/5256] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:15:42.475532 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-33905592-68a4-450b-848e-7aff79d80fd7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:42.477982 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-33905592-68a4-450b-848e-7aff79d80fd7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: 6029de15-fd98-4be1-8c3d-7d63be381363] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:42.491341 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-33905592-68a4-450b-848e-7aff79d80fd7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:42.497839 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-33905592-68a4-450b-848e-7aff79d80fd7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:42.498542 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-33905592-68a4-450b-848e-7aff79d80fd7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:42.499488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-33905592-68a4-450b-848e-7aff79d80fd7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:42.499968 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-33905592-68a4-450b-848e-7aff79d80fd7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:42.500412 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-33905592-68a4-450b-848e-7aff79d80fd7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:42.593655 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-33905592-68a4-450b-848e-7aff79d80fd7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:42.594589 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-33905592-68a4-450b-848e-7aff79d80fd7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:42.603745 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-33905592-68a4-450b-848e-7aff79d80fd7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:42.604849 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-33905592-68a4-450b-848e-7aff79d80fd7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lazy-loading 'fault' on Instance uuid 6029de15-fd98-4be1-8c3d-7d63be381363 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:15:42.774831 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-33905592-68a4-450b-848e-7aff79d80fd7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c163c13444454c9a23703c08a9cc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8590b56a0c924f76ba18920e735e6b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:42.801974 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-33905592-68a4-450b-848e-7aff79d80fd7 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363" status: 200 len: 1328 microversion: 2.1 time: 0.327984 Sep 24 21:15:42.808377 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2620/5257] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:15:42 2022] GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363 => generated 1328 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:15:43.830405 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-da8f4e47-035c-47d3-8818-90d0d1d9f05e tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:43.831638 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-da8f4e47-035c-47d3-8818-90d0d1d9f05e tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: 6029de15-fd98-4be1-8c3d-7d63be381363] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:43.847684 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-da8f4e47-035c-47d3-8818-90d0d1d9f05e tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:43.848455 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-da8f4e47-035c-47d3-8818-90d0d1d9f05e tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:43.851061 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-da8f4e47-035c-47d3-8818-90d0d1d9f05e tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:43.853193 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-da8f4e47-035c-47d3-8818-90d0d1d9f05e tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:43.853833 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-da8f4e47-035c-47d3-8818-90d0d1d9f05e tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:43.856542 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-da8f4e47-035c-47d3-8818-90d0d1d9f05e tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:43.904883 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-da8f4e47-035c-47d3-8818-90d0d1d9f05e tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] HTTP exception thrown: Instance 6029de15-fd98-4be1-8c3d-7d63be381363 could not be found. Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-da8f4e47-035c-47d3-8818-90d0d1d9f05e tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Request method failure captured: Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363 HTTP/1.1 Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3K1nf_HBYtZAmOWJb9X8T8-52HS4-bJBgE0FO69QBXQac8VM7cR_F2qW00AIk7g1CUKO4_BQ_Tfhidimc8mSjzdF5nPccqRruIVq_qrXf1-hDH63yPrbl6WwwFBAVYQLcPo8zGr8HRbhqHfflQP76-UovOPa_Fff7McW4FVNGSk9s4 Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 8590b56a0c924f76ba18920e735e6b4d Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-AttachVolumeTestJSON-1763919755 Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8590b56a0c924f76ba18920e735e6b4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8590b56a0c924f76ba18920e735e6b4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8590b56a0c924f76ba18920e735e6b4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8590b56a0c924f76ba18920e735e6b4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-AttachVolumeTestJSON-1763919755 Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 8590b56a0c924f76ba18920e735e6b4d Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1763919755 Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-AttachVolumeTestJSON-1763919755-project Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 57c163c13444454c9a23703c08a9cc5a Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-AttachVolumeTestJSON-1763919755-project Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 6029de15-fd98-4be1-8c3d-7d63be381363 could not be found. Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '6029de15-fd98-4be1-8c3d-7d63be381363'} Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6029de15-fd98-4be1-8c3d-7d63be381363 could not be found. Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6029de15-fd98-4be1-8c3d-7d63be381363 could not be found. Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:15:43.911993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:15:43.916314 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:15:43.916314 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:15:43.916314 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:15:43.916314 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:15:43.916314 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:15:43.916314 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6029de15-fd98-4be1-8c3d-7d63be381363 could not be found. Sep 24 21:15:43.916314 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:15:43.918435 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-da8f4e47-035c-47d3-8818-90d0d1d9f05e tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Returning 404 to user: Instance 6029de15-fd98-4be1-8c3d-7d63be381363 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:15:43.919602 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-da8f4e47-035c-47d3-8818-90d0d1d9f05e tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363" status: 404 len: 111 microversion: 2.1 time: 0.095237 Sep 24 21:15:43.920850 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2638/5258] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:15:43 2022] GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:15:43.930996 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-579a4e10-1c18-4dcd-a9e0-6699354cf922 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '.version_select at 0x7f4b07525310>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:44.001423 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-579a4e10-1c18-4dcd-a9e0-6699354cf922 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1219694105" status: 202 len: 0 microversion: 2.1 time: 0.074106 Sep 24 21:15:44.003541 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2621/5259] 10.222.0.52 () {58 vars in 1221 bytes} [Sat Sep 24 21:15:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1219694105 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:15:44.515209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-15151068-6de8-43ea-b2ac-7d6c0ad8de8a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:44.515716 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-15151068-6de8-43ea-b2ac-7d6c0ad8de8a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:44.522234 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15151068-6de8-43ea-b2ac-7d6c0ad8de8a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:44.522951 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15151068-6de8-43ea-b2ac-7d6c0ad8de8a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:44.523929 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15151068-6de8-43ea-b2ac-7d6c0ad8de8a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:44.524736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15151068-6de8-43ea-b2ac-7d6c0ad8de8a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:44.525565 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15151068-6de8-43ea-b2ac-7d6c0ad8de8a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:44.526005 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15151068-6de8-43ea-b2ac-7d6c0ad8de8a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:44.588007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-15151068-6de8-43ea-b2ac-7d6c0ad8de8a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:15:44.795094 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-15151068-6de8-43ea-b2ac-7d6c0ad8de8a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "DELETE /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 204 len: 0 microversion: 2.25 time: 0.283808 Sep 24 21:15:44.796020 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2639/5260] 10.222.0.52 () {60 vars in 1280 bytes} [Sat Sep 24 21:15:44 2022] DELETE /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 24 21:15:44.805029 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d0d7325e-5556-43b2-a330-d3c2ab9041f7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:44.806037 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d0d7325e-5556-43b2-a330-d3c2ab9041f7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:45.890647 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0d7325e-5556-43b2-a330-d3c2ab9041f7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:45.895815 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0d7325e-5556-43b2-a330-d3c2ab9041f7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:45.902698 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0d7325e-5556-43b2-a330-d3c2ab9041f7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:45.903721 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0d7325e-5556-43b2-a330-d3c2ab9041f7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:45.904354 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0d7325e-5556-43b2-a330-d3c2ab9041f7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:45.904946 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0d7325e-5556-43b2-a330-d3c2ab9041f7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:46.837514 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d0d7325e-5556-43b2-a330-d3c2ab9041f7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:46.854192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d0d7325e-5556-43b2-a330-d3c2ab9041f7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:46.855754 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d0d7325e-5556-43b2-a330-d3c2ab9041f7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:46.877707 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d0d7325e-5556-43b2-a330-d3c2ab9041f7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1808 microversion: 2.25 time: 2.077231 Sep 24 21:15:46.883648 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2622/5261] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:15:44 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1808 bytes in 2083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:15:47.913174 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a10a9a14-c7c3-4e3d-b532-20dae6f34a03 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:47.915493 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a10a9a14-c7c3-4e3d-b532-20dae6f34a03 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:47.926705 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a10a9a14-c7c3-4e3d-b532-20dae6f34a03 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:47.930215 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a10a9a14-c7c3-4e3d-b532-20dae6f34a03 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:47.931089 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a10a9a14-c7c3-4e3d-b532-20dae6f34a03 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:47.933589 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a10a9a14-c7c3-4e3d-b532-20dae6f34a03 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:47.936755 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a10a9a14-c7c3-4e3d-b532-20dae6f34a03 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:47.937475 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a10a9a14-c7c3-4e3d-b532-20dae6f34a03 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:48.193700 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a10a9a14-c7c3-4e3d-b532-20dae6f34a03 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:48.212677 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a10a9a14-c7c3-4e3d-b532-20dae6f34a03 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:48.218302 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a10a9a14-c7c3-4e3d-b532-20dae6f34a03 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:48.219596 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a10a9a14-c7c3-4e3d-b532-20dae6f34a03 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1740 microversion: 2.25 time: 0.310568 Sep 24 21:15:48.232290 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2623/5262] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:15:47 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1740 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:15:48.249086 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f7a49a10-2e8b-4b55-b997-cddbed4a94a0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Action: 'create', calling method: .version_select at 0x7f4b07424670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1248371900", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAd+9qL0GJHOlrKHLdyoWoUEmUAyjdV7wm+tCbbiCzbasIjExwSWFYP1TBpRJK0DWhU/Gm5xXEMlXIXdTHb8MTPiEwJ0qdiAt4Uof4MvsEGRLlkEepRVyqiWX7Fh3HrMw=="}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:15:48.250722 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c9e8f187-a20f-4472-8072-524d8706ea85 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:48.251261 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c9e8f187-a20f-4472-8072-524d8706ea85 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: 6029de15-fd98-4be1-8c3d-7d63be381363] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:48.270293 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c9e8f187-a20f-4472-8072-524d8706ea85 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:48.270917 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c9e8f187-a20f-4472-8072-524d8706ea85 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:48.271379 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c9e8f187-a20f-4472-8072-524d8706ea85 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:48.278534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c9e8f187-a20f-4472-8072-524d8706ea85 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:48.279272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c9e8f187-a20f-4472-8072-524d8706ea85 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:48.279747 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c9e8f187-a20f-4472-8072-524d8706ea85 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:48.309681 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-f7a49a10-2e8b-4b55-b997-cddbed4a94a0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Getting quotas for project a5c4c9ce4cb946a9a381271ab15aee09. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:15:48.315927 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-c9e8f187-a20f-4472-8072-524d8706ea85 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] HTTP exception thrown: Instance 6029de15-fd98-4be1-8c3d-7d63be381363 could not be found. Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c9e8f187-a20f-4472-8072-524d8706ea85 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Request method failure captured: Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363 HTTP/1.1 Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3K1nf_HBYtZAmOWJb9X8T8-52HS4-bJBgE0FO69QBXQac8VM7cR_F2qW00AIk7g1CUKO4_BQ_Tfhidimc8mSjzdF5nPccqRruIVq_qrXf1-hDH63yPrbl6WwwFBAVYQLcPo8zGr8HRbhqHfflQP76-UovOPa_Fff7McW4FVNGSk9s4 Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 8590b56a0c924f76ba18920e735e6b4d Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-AttachVolumeTestJSON-1763919755 Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8590b56a0c924f76ba18920e735e6b4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8590b56a0c924f76ba18920e735e6b4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8590b56a0c924f76ba18920e735e6b4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8590b56a0c924f76ba18920e735e6b4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-AttachVolumeTestJSON-1763919755 Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 8590b56a0c924f76ba18920e735e6b4d Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1763919755 Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-AttachVolumeTestJSON-1763919755-project Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 57c163c13444454c9a23703c08a9cc5a Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-AttachVolumeTestJSON-1763919755-project Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 6029de15-fd98-4be1-8c3d-7d63be381363 could not be found. Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '6029de15-fd98-4be1-8c3d-7d63be381363'} Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6029de15-fd98-4be1-8c3d-7d63be381363 could not be found. Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:15:48.317808 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:15:48.322267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6029de15-fd98-4be1-8c3d-7d63be381363 could not be found. Sep 24 21:15:48.322267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:15:48.322267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:15:48.322267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:15:48.322267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:15:48.322267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:15:48.322267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:15:48.322267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:15:48.322267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:15:48.322267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6029de15-fd98-4be1-8c3d-7d63be381363 could not be found. Sep 24 21:15:48.322267 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:15:48.324795 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c9e8f187-a20f-4472-8072-524d8706ea85 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Returning 404 to user: Instance 6029de15-fd98-4be1-8c3d-7d63be381363 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:15:48.325890 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c9e8f187-a20f-4472-8072-524d8706ea85 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363" status: 404 len: 111 microversion: 2.1 time: 0.092529 Sep 24 21:15:48.326835 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2624/5263] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:15:48 2022] DELETE /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:15:48.331597 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-f7a49a10-2e8b-4b55-b997-cddbed4a94a0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Getting quotas for user 82c2160fcae947138ddd7b1b4df1e361 and project a5c4c9ce4cb946a9a381271ab15aee09. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:15:48.336947 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-df7c019d-ce5a-48a7-b144-2b299bd65d38 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:48.338344 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-df7c019d-ce5a-48a7-b144-2b299bd65d38 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: 6029de15-fd98-4be1-8c3d-7d63be381363] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:48.345988 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-df7c019d-ce5a-48a7-b144-2b299bd65d38 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:48.346883 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-df7c019d-ce5a-48a7-b144-2b299bd65d38 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:48.347549 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-df7c019d-ce5a-48a7-b144-2b299bd65d38 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:48.348491 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-df7c019d-ce5a-48a7-b144-2b299bd65d38 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:48.349167 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-df7c019d-ce5a-48a7-b144-2b299bd65d38 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:48.349782 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-df7c019d-ce5a-48a7-b144-2b299bd65d38 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:48.366125 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-df7c019d-ce5a-48a7-b144-2b299bd65d38 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] HTTP exception thrown: Instance 6029de15-fd98-4be1-8c3d-7d63be381363 could not be found. Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-df7c019d-ce5a-48a7-b144-2b299bd65d38 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Request method failure captured: Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363 HTTP/1.1 Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3K1nf_HBYtZAmOWJb9X8T8-52HS4-bJBgE0FO69QBXQac8VM7cR_F2qW00AIk7g1CUKO4_BQ_Tfhidimc8mSjzdF5nPccqRruIVq_qrXf1-hDH63yPrbl6WwwFBAVYQLcPo8zGr8HRbhqHfflQP76-UovOPa_Fff7McW4FVNGSk9s4 Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 8590b56a0c924f76ba18920e735e6b4d Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-AttachVolumeTestJSON-1763919755 Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8590b56a0c924f76ba18920e735e6b4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8590b56a0c924f76ba18920e735e6b4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8590b56a0c924f76ba18920e735e6b4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8590b56a0c924f76ba18920e735e6b4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-AttachVolumeTestJSON-1763919755 Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 8590b56a0c924f76ba18920e735e6b4d Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1763919755 Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-AttachVolumeTestJSON-1763919755-project Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 57c163c13444454c9a23703c08a9cc5a Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-AttachVolumeTestJSON-1763919755-project Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 6029de15-fd98-4be1-8c3d-7d63be381363 could not be found. Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '6029de15-fd98-4be1-8c3d-7d63be381363'} Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6029de15-fd98-4be1-8c3d-7d63be381363 could not be found. Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6029de15-fd98-4be1-8c3d-7d63be381363 could not be found. Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:15:48.368481 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:15:48.372024 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:15:48.372024 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:15:48.372024 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:15:48.372024 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:15:48.372024 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:15:48.372024 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6029de15-fd98-4be1-8c3d-7d63be381363 could not be found. Sep 24 21:15:48.372024 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:15:48.376294 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-df7c019d-ce5a-48a7-b144-2b299bd65d38 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Returning 404 to user: Instance 6029de15-fd98-4be1-8c3d-7d63be381363 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:15:48.377709 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-df7c019d-ce5a-48a7-b144-2b299bd65d38 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363" status: 404 len: 111 microversion: 2.1 time: 0.046491 Sep 24 21:15:48.382118 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2625/5264] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:15:48 2022] GET /compute/v2.1/servers/6029de15-fd98-4be1-8c3d-7d63be381363 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:15:48.419467 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f7a49a10-2e8b-4b55-b997-cddbed4a94a0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.653700 Sep 24 21:15:48.420060 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2640/5265] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 21:15:47 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:15:48.719400 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1b4f24b7-85fc-4bb4-bcb5-2005fea477c2 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:48.719944 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1b4f24b7-85fc-4bb4-bcb5-2005fea477c2 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: de9c58e0-4a42-463b-8d44-4f2ac1d55a20] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:48.735127 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1b4f24b7-85fc-4bb4-bcb5-2005fea477c2 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:48.735627 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1b4f24b7-85fc-4bb4-bcb5-2005fea477c2 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:48.736085 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1b4f24b7-85fc-4bb4-bcb5-2005fea477c2 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:48.740844 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1b4f24b7-85fc-4bb4-bcb5-2005fea477c2 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:48.741358 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1b4f24b7-85fc-4bb4-bcb5-2005fea477c2 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:48.741830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1b4f24b7-85fc-4bb4-bcb5-2005fea477c2 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:48.775906 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-1b4f24b7-85fc-4bb4-bcb5-2005fea477c2 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] HTTP exception thrown: Instance de9c58e0-4a42-463b-8d44-4f2ac1d55a20 could not be found. Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1b4f24b7-85fc-4bb4-bcb5-2005fea477c2 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Request method failure captured: Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20 HTTP/1.1 Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3K1nf_HBYtZAmOWJb9X8T8-52HS4-bJBgE0FO69QBXQac8VM7cR_F2qW00AIk7g1CUKO4_BQ_Tfhidimc8mSjzdF5nPccqRruIVq_qrXf1-hDH63yPrbl6WwwFBAVYQLcPo8zGr8HRbhqHfflQP76-UovOPa_Fff7McW4FVNGSk9s4 Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 8590b56a0c924f76ba18920e735e6b4d Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-AttachVolumeTestJSON-1763919755 Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8590b56a0c924f76ba18920e735e6b4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8590b56a0c924f76ba18920e735e6b4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8590b56a0c924f76ba18920e735e6b4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8590b56a0c924f76ba18920e735e6b4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-AttachVolumeTestJSON-1763919755 Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 8590b56a0c924f76ba18920e735e6b4d Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1763919755 Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-AttachVolumeTestJSON-1763919755-project Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 57c163c13444454c9a23703c08a9cc5a Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-AttachVolumeTestJSON-1763919755-project Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance de9c58e0-4a42-463b-8d44-4f2ac1d55a20 could not be found. Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'de9c58e0-4a42-463b-8d44-4f2ac1d55a20'} Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de9c58e0-4a42-463b-8d44-4f2ac1d55a20 could not be found. Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:15:48.784112 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:15:48.788216 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de9c58e0-4a42-463b-8d44-4f2ac1d55a20 could not be found. Sep 24 21:15:48.788216 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:15:48.788216 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:15:48.788216 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:15:48.788216 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:15:48.788216 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:15:48.788216 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:15:48.788216 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:15:48.788216 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:15:48.788216 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de9c58e0-4a42-463b-8d44-4f2ac1d55a20 could not be found. Sep 24 21:15:48.788216 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:15:48.790299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1b4f24b7-85fc-4bb4-bcb5-2005fea477c2 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Returning 404 to user: Instance de9c58e0-4a42-463b-8d44-4f2ac1d55a20 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:15:48.794395 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1b4f24b7-85fc-4bb4-bcb5-2005fea477c2 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "DELETE /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20" status: 404 len: 111 microversion: 2.1 time: 0.079438 Sep 24 21:15:48.798255 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2626/5266] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:15:48 2022] DELETE /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:15:48.804125 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6f89ed90-4ca1-4da0-8abb-ee12710b0047 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:48.805447 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6f89ed90-4ca1-4da0-8abb-ee12710b0047 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] [instance: de9c58e0-4a42-463b-8d44-4f2ac1d55a20] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:48.812156 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f89ed90-4ca1-4da0-8abb-ee12710b0047 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:48.813064 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f89ed90-4ca1-4da0-8abb-ee12710b0047 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:48.813704 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f89ed90-4ca1-4da0-8abb-ee12710b0047 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:48.814634 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f89ed90-4ca1-4da0-8abb-ee12710b0047 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:48.816113 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f89ed90-4ca1-4da0-8abb-ee12710b0047 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:48.816731 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f89ed90-4ca1-4da0-8abb-ee12710b0047 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:48.859299 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-6f89ed90-4ca1-4da0-8abb-ee12710b0047 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] HTTP exception thrown: Instance de9c58e0-4a42-463b-8d44-4f2ac1d55a20 could not be found. Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6f89ed90-4ca1-4da0-8abb-ee12710b0047 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Request method failure captured: Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20 HTTP/1.1 Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3K1nf_HBYtZAmOWJb9X8T8-52HS4-bJBgE0FO69QBXQac8VM7cR_F2qW00AIk7g1CUKO4_BQ_Tfhidimc8mSjzdF5nPccqRruIVq_qrXf1-hDH63yPrbl6WwwFBAVYQLcPo8zGr8HRbhqHfflQP76-UovOPa_Fff7McW4FVNGSk9s4 Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 8590b56a0c924f76ba18920e735e6b4d Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-AttachVolumeTestJSON-1763919755 Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8590b56a0c924f76ba18920e735e6b4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8590b56a0c924f76ba18920e735e6b4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8590b56a0c924f76ba18920e735e6b4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8590b56a0c924f76ba18920e735e6b4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-AttachVolumeTestJSON-1763919755 Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 8590b56a0c924f76ba18920e735e6b4d Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1763919755 Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-AttachVolumeTestJSON-1763919755-project Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 57c163c13444454c9a23703c08a9cc5a Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-AttachVolumeTestJSON-1763919755-project Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance de9c58e0-4a42-463b-8d44-4f2ac1d55a20 could not be found. Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'de9c58e0-4a42-463b-8d44-4f2ac1d55a20'} Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de9c58e0-4a42-463b-8d44-4f2ac1d55a20 could not be found. Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de9c58e0-4a42-463b-8d44-4f2ac1d55a20 could not be found. Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:15:48.861020 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:15:48.868869 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:15:48.868869 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:15:48.868869 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:15:48.868869 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:15:48.868869 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:15:48.868869 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de9c58e0-4a42-463b-8d44-4f2ac1d55a20 could not be found. Sep 24 21:15:48.868869 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:15:48.868869 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6f89ed90-4ca1-4da0-8abb-ee12710b0047 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] Returning 404 to user: Instance de9c58e0-4a42-463b-8d44-4f2ac1d55a20 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:15:48.868869 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6f89ed90-4ca1-4da0-8abb-ee12710b0047 tempest-AttachVolumeTestJSON-1763919755 tempest-AttachVolumeTestJSON-1763919755-project] 10.222.0.52 "GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20" status: 404 len: 111 microversion: 2.1 time: 0.063235 Sep 24 21:15:48.874100 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2641/5267] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:15:48 2022] GET /compute/v2.1/servers/de9c58e0-4a42-463b-8d44-4f2ac1d55a20 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:15:49.075123 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-1bd83b09-03c5-4b4b-8a99-45ee6928f2f7 req-f6fa7056-139e-443e-99cd-0951d1e4d6d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54ec06be-cb4b-4b5f-9ed8-904a328cc118", "name": "network-vif-deleted", "tag": "f450a593-c9dc-4f8e-8acb-60edeb836cea"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:15:49.116079 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1bd83b09-03c5-4b4b-8a99-45ee6928f2f7 req-f6fa7056-139e-443e-99cd-0951d1e4d6d5 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:49.118551 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1bd83b09-03c5-4b4b-8a99-45ee6928f2f7 req-f6fa7056-139e-443e-99cd-0951d1e4d6d5 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:49.120352 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1bd83b09-03c5-4b4b-8a99-45ee6928f2f7 req-f6fa7056-139e-443e-99cd-0951d1e4d6d5 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:49.175381 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-1bd83b09-03c5-4b4b-8a99-45ee6928f2f7 req-f6fa7056-139e-443e-99cd-0951d1e4d6d5 service nova] Creating event network-vif-deleted:f450a593-c9dc-4f8e-8acb-60edeb836cea for instance 54ec06be-cb4b-4b5f-9ed8-904a328cc118 on nch2-master-1 Sep 24 21:15:49.194512 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-1bd83b09-03c5-4b4b-8a99-45ee6928f2f7 req-f6fa7056-139e-443e-99cd-0951d1e4d6d5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126505 Sep 24 21:15:49.196059 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2627/5268] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:15:49.252943 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ecd63ed5-26da-479c-8d41-1ac3177dc2c4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:49.254270 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ecd63ed5-26da-479c-8d41-1ac3177dc2c4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:49.270126 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ecd63ed5-26da-479c-8d41-1ac3177dc2c4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:49.270883 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ecd63ed5-26da-479c-8d41-1ac3177dc2c4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:49.271349 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ecd63ed5-26da-479c-8d41-1ac3177dc2c4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:49.272121 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ecd63ed5-26da-479c-8d41-1ac3177dc2c4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:49.272851 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ecd63ed5-26da-479c-8d41-1ac3177dc2c4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:49.273944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ecd63ed5-26da-479c-8d41-1ac3177dc2c4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:49.424081 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ecd63ed5-26da-479c-8d41-1ac3177dc2c4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:49.434383 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ecd63ed5-26da-479c-8d41-1ac3177dc2c4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:49.446346 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ecd63ed5-26da-479c-8d41-1ac3177dc2c4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:49.447642 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ecd63ed5-26da-479c-8d41-1ac3177dc2c4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.199430 Sep 24 21:15:49.448256 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2642/5269] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:15:49 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:15:50.364378 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-05eacbc9-3f94-4828-b445-a7eb639ce0dc tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Action: 'create', calling method: .version_select at 0x7f4b074a4550>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2099500262", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTD32VMT1B8vfAi9Aub1Wa0O0/1NaNGGbddh8uSu8cqXr3LxCeMm+KewA79qLuSRKXaaUcrKazbwbXIJ3DWOwy8UsOWv0/bSaCKXaf05dHxzJcu3U3h+4jgwmjD8tJjWw=="}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:15:50.423417 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-05eacbc9-3f94-4828-b445-a7eb639ce0dc tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Getting quotas for project 026ea39b3679444a9c3541e58d2e9f7b. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:15:50.441175 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-05eacbc9-3f94-4828-b445-a7eb639ce0dc tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Getting quotas for user c1acf8d4b1384c8c8d7014bd8baf897e and project 026ea39b3679444a9c3541e58d2e9f7b. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:15:50.484029 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4f89a309-4bfa-4538-9878-457665b79c14 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:50.485158 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4f89a309-4bfa-4538-9878-457665b79c14 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:50.496996 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4f89a309-4bfa-4538-9878-457665b79c14 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:50.497678 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4f89a309-4bfa-4538-9878-457665b79c14 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:50.499092 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4f89a309-4bfa-4538-9878-457665b79c14 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:50.501424 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4f89a309-4bfa-4538-9878-457665b79c14 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:50.503437 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4f89a309-4bfa-4538-9878-457665b79c14 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:50.504110 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4f89a309-4bfa-4538-9878-457665b79c14 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:50.515104 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-05eacbc9-3f94-4828-b445-a7eb639ce0dc tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.155627 Sep 24 21:15:50.515968 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2628/5270] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 21:15:50 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:15:50.712344 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4f89a309-4bfa-4538-9878-457665b79c14 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:50.728352 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4f89a309-4bfa-4538-9878-457665b79c14 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:50.733946 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4f89a309-4bfa-4538-9878-457665b79c14 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:50.735234 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4f89a309-4bfa-4538-9878-457665b79c14 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.260948 Sep 24 21:15:50.735798 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2643/5271] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:15:50 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:15:51.779112 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-27329f7b-70ca-4c8e-9c8a-279de7470eb0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:51.780715 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-27329f7b-70ca-4c8e-9c8a-279de7470eb0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:51.807770 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27329f7b-70ca-4c8e-9c8a-279de7470eb0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:51.808294 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27329f7b-70ca-4c8e-9c8a-279de7470eb0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:51.808733 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27329f7b-70ca-4c8e-9c8a-279de7470eb0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:51.809478 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27329f7b-70ca-4c8e-9c8a-279de7470eb0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:51.809947 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27329f7b-70ca-4c8e-9c8a-279de7470eb0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:51.810377 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27329f7b-70ca-4c8e-9c8a-279de7470eb0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:51.997092 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-27329f7b-70ca-4c8e-9c8a-279de7470eb0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:52.018870 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-27329f7b-70ca-4c8e-9c8a-279de7470eb0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:52.021261 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-27329f7b-70ca-4c8e-9c8a-279de7470eb0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:52.028921 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-27329f7b-70ca-4c8e-9c8a-279de7470eb0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.268476 Sep 24 21:15:52.030150 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2629/5272] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:15:51 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:15:53.066737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e281e94d-e38b-4964-be41-037023f415ec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:53.067491 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e281e94d-e38b-4964-be41-037023f415ec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:53.093680 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e281e94d-e38b-4964-be41-037023f415ec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:53.112472 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e281e94d-e38b-4964-be41-037023f415ec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:53.113270 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e281e94d-e38b-4964-be41-037023f415ec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:53.116898 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e281e94d-e38b-4964-be41-037023f415ec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:53.141863 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e281e94d-e38b-4964-be41-037023f415ec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:53.143592 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e281e94d-e38b-4964-be41-037023f415ec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:53.606447 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e281e94d-e38b-4964-be41-037023f415ec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:53.624912 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e281e94d-e38b-4964-be41-037023f415ec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:53.631295 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e281e94d-e38b-4964-be41-037023f415ec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:53.636930 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e281e94d-e38b-4964-be41-037023f415ec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.574767 Sep 24 21:15:53.639829 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2644/5273] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:15:53 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:15:54.342726 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9133c807-089f-454a-b696-26254477ece1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-433185891", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "7ffd48e6-aa8a-4b62-8680-fc345f12d50d"}], "key_name": "tempest-TestNetworkBasicOps-2099500262", "security_groups": [{"name": "tempest-secgroup-smoke-1685606071"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:15:54.615081 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-9133c807-089f-454a-b696-26254477ece1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] validate_networks() for [('7ffd48e6-aa8a-4b62-8680-fc345f12d50d', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:15:54.672950 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4b83b3c1-86dd-4a79-8463-cf89b39d7f0f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:54.673699 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4b83b3c1-86dd-4a79-8463-cf89b39d7f0f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:54.687152 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4b83b3c1-86dd-4a79-8463-cf89b39d7f0f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:54.688074 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4b83b3c1-86dd-4a79-8463-cf89b39d7f0f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:54.690773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4b83b3c1-86dd-4a79-8463-cf89b39d7f0f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:54.696571 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4b83b3c1-86dd-4a79-8463-cf89b39d7f0f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:54.697900 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4b83b3c1-86dd-4a79-8463-cf89b39d7f0f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:54.698879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4b83b3c1-86dd-4a79-8463-cf89b39d7f0f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:54.980004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4b83b3c1-86dd-4a79-8463-cf89b39d7f0f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:55.011007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4b83b3c1-86dd-4a79-8463-cf89b39d7f0f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:55.012700 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4b83b3c1-86dd-4a79-8463-cf89b39d7f0f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:55.019860 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4b83b3c1-86dd-4a79-8463-cf89b39d7f0f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.354715 Sep 24 21:15:55.020548 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2645/5274] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:15:54 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:15:56.040529 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-9133c807-089f-454a-b696-26254477ece1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:15:56.040529 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-9133c807-089f-454a-b696-26254477ece1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:15:56.041072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-9133c807-089f-454a-b696-26254477ece1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:15:56.041207 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-9133c807-089f-454a-b696-26254477ece1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:15:56.041642 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-9133c807-089f-454a-b696-26254477ece1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:15:56.051733 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c5c01042-e5ad-47bd-838a-239e3016a636 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:56.052358 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c5c01042-e5ad-47bd-838a-239e3016a636 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:56.074268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c5c01042-e5ad-47bd-838a-239e3016a636 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:56.078245 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9133c807-089f-454a-b696-26254477ece1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:56.082149 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c5c01042-e5ad-47bd-838a-239e3016a636 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:56.083515 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9133c807-089f-454a-b696-26254477ece1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:56.084004 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9133c807-089f-454a-b696-26254477ece1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:56.084803 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9133c807-089f-454a-b696-26254477ece1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:56.085313 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9133c807-089f-454a-b696-26254477ece1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:56.086298 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9133c807-089f-454a-b696-26254477ece1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:56.089494 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c5c01042-e5ad-47bd-838a-239e3016a636 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:56.090325 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c5c01042-e5ad-47bd-838a-239e3016a636 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:56.091688 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c5c01042-e5ad-47bd-838a-239e3016a636 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:56.092150 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c5c01042-e5ad-47bd-838a-239e3016a636 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:56.137265 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-9133c807-089f-454a-b696-26254477ece1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Getting quotas for project 026ea39b3679444a9c3541e58d2e9f7b. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:15:56.180066 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-9133c807-089f-454a-b696-26254477ece1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Getting quotas for user c1acf8d4b1384c8c8d7014bd8baf897e and project 026ea39b3679444a9c3541e58d2e9f7b. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:15:56.220383 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9133c807-089f-454a-b696-26254477ece1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:15:56.228489 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9133c807-089f-454a-b696-26254477ece1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 15287602-2fd6-4d60-9d26-662b52d6c547] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:15:56.261829 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c5c01042-e5ad-47bd-838a-239e3016a636 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:56.301028 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c5c01042-e5ad-47bd-838a-239e3016a636 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:56.301028 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c5c01042-e5ad-47bd-838a-239e3016a636 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:56.301028 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c5c01042-e5ad-47bd-838a-239e3016a636 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.250061 Sep 24 21:15:56.316632 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2646/5275] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:15:56 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:15:56.381066 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9133c807-089f-454a-b696-26254477ece1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.045404 Sep 24 21:15:56.382973 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2630/5276] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:15:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 2049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:15:56.393908 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-723a04c2-b67b-4379-bfe7-407a8a9afaa3 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:56.394555 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-723a04c2-b67b-4379-bfe7-407a8a9afaa3 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 15287602-2fd6-4d60-9d26-662b52d6c547] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:57.086419 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-723a04c2-b67b-4379-bfe7-407a8a9afaa3 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:57.115908 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-723a04c2-b67b-4379-bfe7-407a8a9afaa3 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547" status: 200 len: 1248 microversion: 2.1 time: 0.716811 Sep 24 21:15:57.119721 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2647/5277] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:15:56 2022] GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547 => generated 1248 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:15:57.332421 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f51b2175-dc01-4864-9d98-08d4c7ec1291 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:57.334413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f51b2175-dc01-4864-9d98-08d4c7ec1291 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:57.364217 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f51b2175-dc01-4864-9d98-08d4c7ec1291 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:57.367834 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f51b2175-dc01-4864-9d98-08d4c7ec1291 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:57.368604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f51b2175-dc01-4864-9d98-08d4c7ec1291 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:57.371521 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f51b2175-dc01-4864-9d98-08d4c7ec1291 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:57.372543 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f51b2175-dc01-4864-9d98-08d4c7ec1291 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:57.373794 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f51b2175-dc01-4864-9d98-08d4c7ec1291 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:57.561567 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f51b2175-dc01-4864-9d98-08d4c7ec1291 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:57.615238 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f51b2175-dc01-4864-9d98-08d4c7ec1291 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:57.618144 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f51b2175-dc01-4864-9d98-08d4c7ec1291 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:57.619478 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f51b2175-dc01-4864-9d98-08d4c7ec1291 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.291530 Sep 24 21:15:57.628690 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2631/5278] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:15:57 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:15:58.144365 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e411bc1d-a27a-404c-956e-08f56512ded6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:58.145070 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e411bc1d-a27a-404c-956e-08f56512ded6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 15287602-2fd6-4d60-9d26-662b52d6c547] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:58.166735 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e411bc1d-a27a-404c-956e-08f56512ded6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:58.167471 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e411bc1d-a27a-404c-956e-08f56512ded6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:58.169694 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e411bc1d-a27a-404c-956e-08f56512ded6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:58.171178 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e411bc1d-a27a-404c-956e-08f56512ded6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:58.172422 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e411bc1d-a27a-404c-956e-08f56512ded6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:58.172883 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e411bc1d-a27a-404c-956e-08f56512ded6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:58.302421 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e411bc1d-a27a-404c-956e-08f56512ded6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:58.317643 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e411bc1d-a27a-404c-956e-08f56512ded6 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547" status: 200 len: 1300 microversion: 2.1 time: 0.178689 Sep 24 21:15:58.323382 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2648/5279] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:15:58 2022] GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547 => generated 1300 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:15:58.649744 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-81abf42c-0b6e-49c1-8a34-a14232e94ff2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:58.651052 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-81abf42c-0b6e-49c1-8a34-a14232e94ff2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:58.661780 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81abf42c-0b6e-49c1-8a34-a14232e94ff2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:58.662951 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81abf42c-0b6e-49c1-8a34-a14232e94ff2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:58.664194 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81abf42c-0b6e-49c1-8a34-a14232e94ff2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:58.665374 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81abf42c-0b6e-49c1-8a34-a14232e94ff2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:58.666841 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81abf42c-0b6e-49c1-8a34-a14232e94ff2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:58.668324 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81abf42c-0b6e-49c1-8a34-a14232e94ff2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:58.808902 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-81abf42c-0b6e-49c1-8a34-a14232e94ff2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:58.818632 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-81abf42c-0b6e-49c1-8a34-a14232e94ff2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:58.828756 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-81abf42c-0b6e-49c1-8a34-a14232e94ff2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:58.830446 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-81abf42c-0b6e-49c1-8a34-a14232e94ff2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.186488 Sep 24 21:15:58.833222 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2632/5280] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:15:58 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:15:59.346101 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-61c6cfd5-e9ee-4191-b85f-dfaaeda2aef4 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:59.347385 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-61c6cfd5-e9ee-4191-b85f-dfaaeda2aef4 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 15287602-2fd6-4d60-9d26-662b52d6c547] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:59.361535 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-61c6cfd5-e9ee-4191-b85f-dfaaeda2aef4 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:59.364259 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-61c6cfd5-e9ee-4191-b85f-dfaaeda2aef4 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:59.367067 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-61c6cfd5-e9ee-4191-b85f-dfaaeda2aef4 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:59.369609 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-61c6cfd5-e9ee-4191-b85f-dfaaeda2aef4 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:59.370186 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-61c6cfd5-e9ee-4191-b85f-dfaaeda2aef4 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:59.372089 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-61c6cfd5-e9ee-4191-b85f-dfaaeda2aef4 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:59.520235 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-61c6cfd5-e9ee-4191-b85f-dfaaeda2aef4 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:15:59.535880 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-61c6cfd5-e9ee-4191-b85f-dfaaeda2aef4 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547" status: 200 len: 1306 microversion: 2.1 time: 0.194555 Sep 24 21:15:59.551805 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2649/5281] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:15:59 2022] GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547 => generated 1306 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:15:59.869087 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-203ef0b4-6ffb-40a4-a27e-0a3284ea9782 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:15:59.870245 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-203ef0b4-6ffb-40a4-a27e-0a3284ea9782 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:15:59.893238 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-203ef0b4-6ffb-40a4-a27e-0a3284ea9782 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:59.895858 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-203ef0b4-6ffb-40a4-a27e-0a3284ea9782 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:59.896331 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-203ef0b4-6ffb-40a4-a27e-0a3284ea9782 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:15:59.898992 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-203ef0b4-6ffb-40a4-a27e-0a3284ea9782 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:15:59.904134 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-203ef0b4-6ffb-40a4-a27e-0a3284ea9782 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:15:59.904807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-203ef0b4-6ffb-40a4-a27e-0a3284ea9782 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:00.183140 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-203ef0b4-6ffb-40a4-a27e-0a3284ea9782 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:00.204541 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-203ef0b4-6ffb-40a4-a27e-0a3284ea9782 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:00.208921 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-203ef0b4-6ffb-40a4-a27e-0a3284ea9782 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:00.213566 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-203ef0b4-6ffb-40a4-a27e-0a3284ea9782 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.353580 Sep 24 21:16:00.214598 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2633/5282] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:15:59 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:00.563318 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0cc7d260-5684-41c6-afb7-f6c33c166e17 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:00.564477 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0cc7d260-5684-41c6-afb7-f6c33c166e17 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 15287602-2fd6-4d60-9d26-662b52d6c547] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:00.575906 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0cc7d260-5684-41c6-afb7-f6c33c166e17 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:00.579556 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0cc7d260-5684-41c6-afb7-f6c33c166e17 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:00.580189 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0cc7d260-5684-41c6-afb7-f6c33c166e17 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:00.581137 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0cc7d260-5684-41c6-afb7-f6c33c166e17 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:00.581750 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0cc7d260-5684-41c6-afb7-f6c33c166e17 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:00.582341 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0cc7d260-5684-41c6-afb7-f6c33c166e17 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:00.768313 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0cc7d260-5684-41c6-afb7-f6c33c166e17 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:00.779112 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0cc7d260-5684-41c6-afb7-f6c33c166e17 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547" status: 200 len: 1306 microversion: 2.1 time: 0.220406 Sep 24 21:16:00.783420 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2650/5283] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:00 2022] GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547 => generated 1306 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:01.241544 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3f07c05b-2991-4c82-b729-96e53509edc6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:01.242253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3f07c05b-2991-4c82-b729-96e53509edc6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:01.256825 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3f07c05b-2991-4c82-b729-96e53509edc6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:01.257951 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3f07c05b-2991-4c82-b729-96e53509edc6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:01.258426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3f07c05b-2991-4c82-b729-96e53509edc6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:01.259174 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3f07c05b-2991-4c82-b729-96e53509edc6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:01.259645 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3f07c05b-2991-4c82-b729-96e53509edc6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:01.260153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3f07c05b-2991-4c82-b729-96e53509edc6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:01.465800 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3f07c05b-2991-4c82-b729-96e53509edc6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:01.482082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3f07c05b-2991-4c82-b729-96e53509edc6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:01.483557 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3f07c05b-2991-4c82-b729-96e53509edc6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:01.494865 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3f07c05b-2991-4c82-b729-96e53509edc6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.251401 Sep 24 21:16:01.496345 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2634/5284] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:01 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:01.810373 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4863c310-ea8c-4773-966d-d23a2af6056a tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:01.811045 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4863c310-ea8c-4773-966d-d23a2af6056a tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 15287602-2fd6-4d60-9d26-662b52d6c547] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:01.826526 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4863c310-ea8c-4773-966d-d23a2af6056a tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:01.827051 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4863c310-ea8c-4773-966d-d23a2af6056a tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:01.829035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4863c310-ea8c-4773-966d-d23a2af6056a tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:01.829819 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4863c310-ea8c-4773-966d-d23a2af6056a tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:01.830305 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4863c310-ea8c-4773-966d-d23a2af6056a tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:01.835132 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4863c310-ea8c-4773-966d-d23a2af6056a tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:02.527476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-27d14806-1f4d-45f6-a9f0-3b767bf27dbe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:02.529025 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-27d14806-1f4d-45f6-a9f0-3b767bf27dbe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:02.543368 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27d14806-1f4d-45f6-a9f0-3b767bf27dbe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:02.545946 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27d14806-1f4d-45f6-a9f0-3b767bf27dbe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:02.546988 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27d14806-1f4d-45f6-a9f0-3b767bf27dbe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:02.549314 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27d14806-1f4d-45f6-a9f0-3b767bf27dbe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:02.551411 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27d14806-1f4d-45f6-a9f0-3b767bf27dbe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:02.552097 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27d14806-1f4d-45f6-a9f0-3b767bf27dbe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:02.852178 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-27d14806-1f4d-45f6-a9f0-3b767bf27dbe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:02.866321 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4863c310-ea8c-4773-966d-d23a2af6056a tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:02.873469 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-27d14806-1f4d-45f6-a9f0-3b767bf27dbe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:02.876466 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-27d14806-1f4d-45f6-a9f0-3b767bf27dbe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:02.878585 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4863c310-ea8c-4773-966d-d23a2af6056a tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547" status: 200 len: 1374 microversion: 2.1 time: 1.069568 Sep 24 21:16:02.879397 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2651/5285] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:01 2022] GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547 => generated 1374 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:16:02.887184 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-27d14806-1f4d-45f6-a9f0-3b767bf27dbe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.366159 Sep 24 21:16:02.890476 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2635/5286] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:02 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:16:03.911215 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-da10fdf2-c099-415b-a51f-015396e57445 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:03.912023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-da10fdf2-c099-415b-a51f-015396e57445 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 15287602-2fd6-4d60-9d26-662b52d6c547] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:03.922099 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a18a931d-73b4-4874-9f85-007452ede421 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:03.923491 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a18a931d-73b4-4874-9f85-007452ede421 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:03.931554 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a18a931d-73b4-4874-9f85-007452ede421 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:03.932296 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a18a931d-73b4-4874-9f85-007452ede421 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:03.932924 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a18a931d-73b4-4874-9f85-007452ede421 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:03.934045 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a18a931d-73b4-4874-9f85-007452ede421 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:03.934702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a18a931d-73b4-4874-9f85-007452ede421 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:03.935281 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a18a931d-73b4-4874-9f85-007452ede421 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:03.942886 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-da10fdf2-c099-415b-a51f-015396e57445 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:03.943286 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-da10fdf2-c099-415b-a51f-015396e57445 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:03.943750 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-da10fdf2-c099-415b-a51f-015396e57445 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:03.944575 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-da10fdf2-c099-415b-a51f-015396e57445 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:03.945055 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-da10fdf2-c099-415b-a51f-015396e57445 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:03.945496 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-da10fdf2-c099-415b-a51f-015396e57445 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:04.002663 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:16:04.228219 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a18a931d-73b4-4874-9f85-007452ede421 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:04.244572 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a18a931d-73b4-4874-9f85-007452ede421 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:04.264051 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a18a931d-73b4-4874-9f85-007452ede421 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:04.271020 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a18a931d-73b4-4874-9f85-007452ede421 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.352845 Sep 24 21:16:04.283741 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2636/5287] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:03 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:04.642337 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-da10fdf2-c099-415b-a51f-015396e57445 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:04.656842 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-da10fdf2-c099-415b-a51f-015396e57445 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547" status: 200 len: 1374 microversion: 2.1 time: 0.751636 Sep 24 21:16:04.659140 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2652/5288] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:03 2022] GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547 => generated 1374 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:05.316067 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-96360a2d-2315-4880-8290-8a3b6bec8a1c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:05.316690 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-96360a2d-2315-4880-8290-8a3b6bec8a1c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:05.335733 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96360a2d-2315-4880-8290-8a3b6bec8a1c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:05.344860 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96360a2d-2315-4880-8290-8a3b6bec8a1c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:05.347706 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96360a2d-2315-4880-8290-8a3b6bec8a1c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:05.352287 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96360a2d-2315-4880-8290-8a3b6bec8a1c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:05.353725 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96360a2d-2315-4880-8290-8a3b6bec8a1c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:05.354483 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96360a2d-2315-4880-8290-8a3b6bec8a1c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:05.553323 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-96360a2d-2315-4880-8290-8a3b6bec8a1c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:05.576513 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-96360a2d-2315-4880-8290-8a3b6bec8a1c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:05.578001 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-96360a2d-2315-4880-8290-8a3b6bec8a1c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:05.579232 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-96360a2d-2315-4880-8290-8a3b6bec8a1c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.267890 Sep 24 21:16:05.602379 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2637/5289] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:05 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:05.687136 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f8fe8169-dbb4-44ba-baed-3dc43813a074 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:05.688609 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f8fe8169-dbb4-44ba-baed-3dc43813a074 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 15287602-2fd6-4d60-9d26-662b52d6c547] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:05.703065 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8fe8169-dbb4-44ba-baed-3dc43813a074 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:05.708665 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8fe8169-dbb4-44ba-baed-3dc43813a074 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:05.712171 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8fe8169-dbb4-44ba-baed-3dc43813a074 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:05.715107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8fe8169-dbb4-44ba-baed-3dc43813a074 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:05.719472 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8fe8169-dbb4-44ba-baed-3dc43813a074 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:05.722364 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8fe8169-dbb4-44ba-baed-3dc43813a074 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:06.112799 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-edfe574a-3885-48f1-abe7-edb25db8ddc1 req-28d6cb57-615d-4060-8bc5-d083193706af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15287602-2fd6-4d60-9d26-662b52d6c547", "tag": "38f2cbc5-9847-4764-9680-1c6ba97c79cf"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:16:06.127217 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:16:06.137359 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-edfe574a-3885-48f1-abe7-edb25db8ddc1 req-28d6cb57-615d-4060-8bc5-d083193706af service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:06.140819 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-edfe574a-3885-48f1-abe7-edb25db8ddc1 req-28d6cb57-615d-4060-8bc5-d083193706af service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:06.141308 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-edfe574a-3885-48f1-abe7-edb25db8ddc1 req-28d6cb57-615d-4060-8bc5-d083193706af service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:06.165813 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-edfe574a-3885-48f1-abe7-edb25db8ddc1 req-28d6cb57-615d-4060-8bc5-d083193706af service nova] Creating event network-changed:38f2cbc5-9847-4764-9680-1c6ba97c79cf for instance 15287602-2fd6-4d60-9d26-662b52d6c547 on nch1-master-1 Sep 24 21:16:06.184634 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-edfe574a-3885-48f1-abe7-edb25db8ddc1 req-28d6cb57-615d-4060-8bc5-d083193706af service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.510724 Sep 24 21:16:06.185440 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2653/5290] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:16:06.203009 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=10 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:16:06.615142 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-682657bb-ab1b-4013-9dfc-07b0ff47824a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:06.620667 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-682657bb-ab1b-4013-9dfc-07b0ff47824a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:06.639561 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-682657bb-ab1b-4013-9dfc-07b0ff47824a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:06.639997 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-682657bb-ab1b-4013-9dfc-07b0ff47824a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:06.640340 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-682657bb-ab1b-4013-9dfc-07b0ff47824a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:06.641055 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-682657bb-ab1b-4013-9dfc-07b0ff47824a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:06.641510 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-682657bb-ab1b-4013-9dfc-07b0ff47824a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:06.653031 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-682657bb-ab1b-4013-9dfc-07b0ff47824a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:06.913049 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-682657bb-ab1b-4013-9dfc-07b0ff47824a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:06.943088 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-682657bb-ab1b-4013-9dfc-07b0ff47824a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:06.944658 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-682657bb-ab1b-4013-9dfc-07b0ff47824a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:06.946098 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-682657bb-ab1b-4013-9dfc-07b0ff47824a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.340397 Sep 24 21:16:06.951114 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2654/5291] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:06 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:16:07.079226 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f8fe8169-dbb4-44ba-baed-3dc43813a074 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:07.086576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=99 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:16:07.098969 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f8fe8169-dbb4-44ba-baed-3dc43813a074 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547" status: 200 len: 1374 microversion: 2.1 time: 1.421224 Sep 24 21:16:07.123712 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2638/5292] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:05 2022] GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547 => generated 1374 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:16:07.987762 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-189c65ba-727f-4861-b7af-78a35908e96a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:07.988491 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-189c65ba-727f-4861-b7af-78a35908e96a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:07.990837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=6 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:16:08.012521 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-189c65ba-727f-4861-b7af-78a35908e96a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:08.029696 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-189c65ba-727f-4861-b7af-78a35908e96a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:08.033749 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-189c65ba-727f-4861-b7af-78a35908e96a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:08.034910 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-189c65ba-727f-4861-b7af-78a35908e96a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:08.035615 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-189c65ba-727f-4861-b7af-78a35908e96a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:08.036779 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-189c65ba-727f-4861-b7af-78a35908e96a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:08.132680 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-52fecfc3-eb75-4b0a-b9e1-9b280544963f tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:08.134083 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-52fecfc3-eb75-4b0a-b9e1-9b280544963f tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 15287602-2fd6-4d60-9d26-662b52d6c547] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:08.154306 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:16:08.157036 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-52fecfc3-eb75-4b0a-b9e1-9b280544963f tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:08.161924 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-52fecfc3-eb75-4b0a-b9e1-9b280544963f tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:08.162841 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-52fecfc3-eb75-4b0a-b9e1-9b280544963f tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:08.164424 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-52fecfc3-eb75-4b0a-b9e1-9b280544963f tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:08.164978 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-52fecfc3-eb75-4b0a-b9e1-9b280544963f tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:08.165495 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-52fecfc3-eb75-4b0a-b9e1-9b280544963f tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:08.574417 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-189c65ba-727f-4861-b7af-78a35908e96a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:08.593409 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-189c65ba-727f-4861-b7af-78a35908e96a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:08.595613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-189c65ba-727f-4861-b7af-78a35908e96a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:08.598801 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-189c65ba-727f-4861-b7af-78a35908e96a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.616677 Sep 24 21:16:08.628416 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2655/5293] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:07 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:08.791604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-52fecfc3-eb75-4b0a-b9e1-9b280544963f tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:08.805769 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-52fecfc3-eb75-4b0a-b9e1-9b280544963f tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547" status: 200 len: 1374 microversion: 2.1 time: 0.676555 Sep 24 21:16:08.808554 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2639/5294] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:08 2022] GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547 => generated 1374 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:16:08.931052 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-864f8f56-14ba-425b-9f19-831f4dcbd3d1 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2038893237", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "5f3d84dd-7cdf-44b0-9254-e9c91059380c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1248371900", "security_groups": [{"name": "tempest-secgroup-smoke-2087458780"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:16:08.945730 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:16:09.158807 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-864f8f56-14ba-425b-9f19-831f4dcbd3d1 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] validate_networks() for [('5f3d84dd-7cdf-44b0-9254-e9c91059380c', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:16:09.640914 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cb2b678e-3033-493b-8638-0cb0a7a935f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:09.641638 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cb2b678e-3033-493b-8638-0cb0a7a935f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:09.659074 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb2b678e-3033-493b-8638-0cb0a7a935f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:09.659676 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb2b678e-3033-493b-8638-0cb0a7a935f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:09.661165 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb2b678e-3033-493b-8638-0cb0a7a935f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:09.662092 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb2b678e-3033-493b-8638-0cb0a7a935f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:09.664410 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb2b678e-3033-493b-8638-0cb0a7a935f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:09.668745 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb2b678e-3033-493b-8638-0cb0a7a935f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:09.802102 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cb2b678e-3033-493b-8638-0cb0a7a935f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:09.816819 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cb2b678e-3033-493b-8638-0cb0a7a935f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:09.820443 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cb2b678e-3033-493b-8638-0cb0a7a935f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:09.821641 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cb2b678e-3033-493b-8638-0cb0a7a935f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.191207 Sep 24 21:16:09.828178 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2640/5295] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:09 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:09.956469 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-864f8f56-14ba-425b-9f19-831f4dcbd3d1 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:16:09.957945 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-864f8f56-14ba-425b-9f19-831f4dcbd3d1 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:16:09.958977 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-864f8f56-14ba-425b-9f19-831f4dcbd3d1 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:16:09.959402 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-864f8f56-14ba-425b-9f19-831f4dcbd3d1 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:16:09.960390 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-864f8f56-14ba-425b-9f19-831f4dcbd3d1 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:16:09.993472 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-864f8f56-14ba-425b-9f19-831f4dcbd3d1 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:09.994961 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-864f8f56-14ba-425b-9f19-831f4dcbd3d1 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:09.996497 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-864f8f56-14ba-425b-9f19-831f4dcbd3d1 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:09.997577 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-864f8f56-14ba-425b-9f19-831f4dcbd3d1 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:09.999504 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-864f8f56-14ba-425b-9f19-831f4dcbd3d1 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:10.000153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-864f8f56-14ba-425b-9f19-831f4dcbd3d1 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:10.058086 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-864f8f56-14ba-425b-9f19-831f4dcbd3d1 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Getting quotas for project a5c4c9ce4cb946a9a381271ab15aee09. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:16:10.073828 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-864f8f56-14ba-425b-9f19-831f4dcbd3d1 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Getting quotas for user 82c2160fcae947138ddd7b1b4df1e361 and project a5c4c9ce4cb946a9a381271ab15aee09. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:16:10.110037 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-864f8f56-14ba-425b-9f19-831f4dcbd3d1 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:16:10.115153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-864f8f56-14ba-425b-9f19-831f4dcbd3d1 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:16:10.230328 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-864f8f56-14ba-425b-9f19-831f4dcbd3d1 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.303157 Sep 24 21:16:10.237902 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2656/5296] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:16:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 1312 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:16:10.244920 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-330d1541-03eb-41c7-b085-81d0ba52a48f tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:10.245770 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-330d1541-03eb-41c7-b085-81d0ba52a48f tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 15287602-2fd6-4d60-9d26-662b52d6c547] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:10.254216 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-330d1541-03eb-41c7-b085-81d0ba52a48f tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:10.255019 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-330d1541-03eb-41c7-b085-81d0ba52a48f tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:10.256120 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-330d1541-03eb-41c7-b085-81d0ba52a48f tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:10.258269 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-330d1541-03eb-41c7-b085-81d0ba52a48f tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:10.259305 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-330d1541-03eb-41c7-b085-81d0ba52a48f tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:10.259883 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-330d1541-03eb-41c7-b085-81d0ba52a48f tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:10.330150 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-157d1cc1-f1dc-4fa7-9b90-c73257181950 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:10.333845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-157d1cc1-f1dc-4fa7-9b90-c73257181950 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:10.334659 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-157d1cc1-f1dc-4fa7-9b90-c73257181950 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:10.335351 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-157d1cc1-f1dc-4fa7-9b90-c73257181950 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:10.336405 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-157d1cc1-f1dc-4fa7-9b90-c73257181950 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:10.339642 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-157d1cc1-f1dc-4fa7-9b90-c73257181950 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:10.340182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-157d1cc1-f1dc-4fa7-9b90-c73257181950 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:10.411150 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-157d1cc1-f1dc-4fa7-9b90-c73257181950 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.581383 Sep 24 21:16:10.415322 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2641/5297] 10.222.0.52 () {58 vars in 1185 bytes} [Sat Sep 24 21:16:09 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:16:10.428900 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8b25c121-3abd-4e40-a3a0-bac427443aed tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:10.431651 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8b25c121-3abd-4e40-a3a0-bac427443aed tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:10.714470 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8b25c121-3abd-4e40-a3a0-bac427443aed tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:10.739214 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8b25c121-3abd-4e40-a3a0-bac427443aed tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1267 microversion: 2.1 time: 0.322050 Sep 24 21:16:10.742882 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2642/5298] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:10 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1267 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:10.766242 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b22046e4-eeac-495a-a026-b5a5194b5fc8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-77884550", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "availability_zone": "nova:nch2-master-1", "networks": [{"uuid": "e32880bc-cd12-4305-9754-1a3ea4c1b444"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:16:10.913583 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-330d1541-03eb-41c7-b085-81d0ba52a48f tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:10.930234 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-b22046e4-eeac-495a-a026-b5a5194b5fc8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] validate_networks() for [('e32880bc-cd12-4305-9754-1a3ea4c1b444', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:16:10.938799 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-330d1541-03eb-41c7-b085-81d0ba52a48f tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547" status: 200 len: 1374 microversion: 2.1 time: 0.695655 Sep 24 21:16:10.941238 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2657/5299] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:10 2022] GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547 => generated 1374 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:10.961619 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-74079aa9-480b-4f2a-b1ca-bd27b756a79a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:10.962556 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-74079aa9-480b-4f2a-b1ca-bd27b756a79a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:10.976226 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-74079aa9-480b-4f2a-b1ca-bd27b756a79a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:10.979142 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-74079aa9-480b-4f2a-b1ca-bd27b756a79a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:10.981906 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-74079aa9-480b-4f2a-b1ca-bd27b756a79a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:10.985227 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-74079aa9-480b-4f2a-b1ca-bd27b756a79a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:10.985923 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-74079aa9-480b-4f2a-b1ca-bd27b756a79a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:10.987970 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-74079aa9-480b-4f2a-b1ca-bd27b756a79a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:11.174332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-74079aa9-480b-4f2a-b1ca-bd27b756a79a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:11.190971 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-74079aa9-480b-4f2a-b1ca-bd27b756a79a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:11.196732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-74079aa9-480b-4f2a-b1ca-bd27b756a79a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:11.200494 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-74079aa9-480b-4f2a-b1ca-bd27b756a79a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.257343 Sep 24 21:16:11.202223 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2658/5300] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:10 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:11.769054 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-85f45f35-a0fd-49e8-bb26-bb2759413ec8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:11.771480 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-85f45f35-a0fd-49e8-bb26-bb2759413ec8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:11.789120 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85f45f35-a0fd-49e8-bb26-bb2759413ec8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:11.792516 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85f45f35-a0fd-49e8-bb26-bb2759413ec8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:11.793681 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85f45f35-a0fd-49e8-bb26-bb2759413ec8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:11.795305 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85f45f35-a0fd-49e8-bb26-bb2759413ec8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:11.797780 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85f45f35-a0fd-49e8-bb26-bb2759413ec8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:11.800415 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85f45f35-a0fd-49e8-bb26-bb2759413ec8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:11.933249 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-85f45f35-a0fd-49e8-bb26-bb2759413ec8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:11.942758 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-85f45f35-a0fd-49e8-bb26-bb2759413ec8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1319 microversion: 2.1 time: 0.179800 Sep 24 21:16:11.944218 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2659/5301] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:11 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:11.970663 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c3d746b2-9401-42c6-ab7f-c0354ff14ce2 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:11.971586 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c3d746b2-9401-42c6-ab7f-c0354ff14ce2 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 15287602-2fd6-4d60-9d26-662b52d6c547] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:11.981727 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c3d746b2-9401-42c6-ab7f-c0354ff14ce2 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:11.982566 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c3d746b2-9401-42c6-ab7f-c0354ff14ce2 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:11.983830 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c3d746b2-9401-42c6-ab7f-c0354ff14ce2 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:11.984993 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c3d746b2-9401-42c6-ab7f-c0354ff14ce2 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:11.985666 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c3d746b2-9401-42c6-ab7f-c0354ff14ce2 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:11.986903 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c3d746b2-9401-42c6-ab7f-c0354ff14ce2 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:12.177339 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-b22046e4-eeac-495a-a026-b5a5194b5fc8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:16:12.177803 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-b22046e4-eeac-495a-a026-b5a5194b5fc8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:16:12.178915 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-b22046e4-eeac-495a-a026-b5a5194b5fc8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:16:12.179954 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-b22046e4-eeac-495a-a026-b5a5194b5fc8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:16:12.180786 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-b22046e4-eeac-495a-a026-b5a5194b5fc8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:16:12.199745 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b22046e4-eeac-495a-a026-b5a5194b5fc8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:12.202387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b22046e4-eeac-495a-a026-b5a5194b5fc8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:12.203250 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b22046e4-eeac-495a-a026-b5a5194b5fc8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:12.204482 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b22046e4-eeac-495a-a026-b5a5194b5fc8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:12.209028 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b22046e4-eeac-495a-a026-b5a5194b5fc8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:12.211078 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b22046e4-eeac-495a-a026-b5a5194b5fc8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:12.236004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c3d746b2-9401-42c6-ab7f-c0354ff14ce2 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:12.249665 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c3d746b2-9401-42c6-ab7f-c0354ff14ce2 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547" status: 200 len: 1374 microversion: 2.1 time: 0.281042 Sep 24 21:16:12.250777 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2660/5302] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:11 2022] GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547 => generated 1374 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:16:12.279761 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-23a55e77-b897-4859-bd6c-66c88ffcc335 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:12.281634 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-23a55e77-b897-4859-bd6c-66c88ffcc335 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:12.290441 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-b22046e4-eeac-495a-a026-b5a5194b5fc8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Getting quotas for project 0c0033b625ca4995bff138c485673fd8. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:16:12.297016 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23a55e77-b897-4859-bd6c-66c88ffcc335 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:12.299189 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23a55e77-b897-4859-bd6c-66c88ffcc335 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:12.299847 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23a55e77-b897-4859-bd6c-66c88ffcc335 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:12.306023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23a55e77-b897-4859-bd6c-66c88ffcc335 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:12.306773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23a55e77-b897-4859-bd6c-66c88ffcc335 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:12.307422 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23a55e77-b897-4859-bd6c-66c88ffcc335 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:12.314061 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-b22046e4-eeac-495a-a026-b5a5194b5fc8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Getting quotas for user fc712fcf0f814a59bb52e16685ab1c9b and project 0c0033b625ca4995bff138c485673fd8. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:16:12.376605 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b22046e4-eeac-495a-a026-b5a5194b5fc8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:16:12.382042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b22046e4-eeac-495a-a026-b5a5194b5fc8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: d2a62532-3ddd-4eb5-b0c0-3877ff6be556] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:16:12.444047 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-23a55e77-b897-4859-bd6c-66c88ffcc335 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:12.453491 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-23a55e77-b897-4859-bd6c-66c88ffcc335 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:12.457612 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-23a55e77-b897-4859-bd6c-66c88ffcc335 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:12.459292 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-23a55e77-b897-4859-bd6c-66c88ffcc335 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.187354 Sep 24 21:16:12.465304 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2661/5303] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:12 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:12.583200 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b22046e4-eeac-495a-a026-b5a5194b5fc8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.829836 Sep 24 21:16:12.584087 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2643/5304] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:16:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:16:12.597886 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5052a464-5cc4-4268-b763-cd8a143c39f9 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:12.609579 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5052a464-5cc4-4268-b763-cd8a143c39f9 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: d2a62532-3ddd-4eb5-b0c0-3877ff6be556] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:12.969208 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5052a464-5cc4-4268-b763-cd8a143c39f9 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556" status: 200 len: 1327 microversion: 2.1 time: 0.375318 Sep 24 21:16:12.976070 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0ae66d03-cf0a-4806-b6c1-e3d800578c17 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:12.977355 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0ae66d03-cf0a-4806-b6c1-e3d800578c17 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:12.991141 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2662/5305] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:12 2022] GET /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556 => generated 1327 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:12.993509 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0ae66d03-cf0a-4806-b6c1-e3d800578c17 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:12.995216 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0ae66d03-cf0a-4806-b6c1-e3d800578c17 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:12.997609 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0ae66d03-cf0a-4806-b6c1-e3d800578c17 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:13.000259 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0ae66d03-cf0a-4806-b6c1-e3d800578c17 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:13.002231 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0ae66d03-cf0a-4806-b6c1-e3d800578c17 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:13.003015 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0ae66d03-cf0a-4806-b6c1-e3d800578c17 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:13.219913 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0ae66d03-cf0a-4806-b6c1-e3d800578c17 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:13.232039 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0ae66d03-cf0a-4806-b6c1-e3d800578c17 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1325 microversion: 2.1 time: 0.264088 Sep 24 21:16:13.233583 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2644/5306] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:12 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1325 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:13.278702 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6093811d-503d-4e7e-995f-9c950cb27601 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:13.279652 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6093811d-503d-4e7e-995f-9c950cb27601 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 15287602-2fd6-4d60-9d26-662b52d6c547] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:13.300885 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6093811d-503d-4e7e-995f-9c950cb27601 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:13.304718 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6093811d-503d-4e7e-995f-9c950cb27601 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:13.305742 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6093811d-503d-4e7e-995f-9c950cb27601 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:13.309865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6093811d-503d-4e7e-995f-9c950cb27601 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:13.312297 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6093811d-503d-4e7e-995f-9c950cb27601 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:13.313680 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6093811d-503d-4e7e-995f-9c950cb27601 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:13.494516 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-54931331-98eb-41d3-850b-d2ccb7f3bacd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:13.495216 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-54931331-98eb-41d3-850b-d2ccb7f3bacd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:13.516473 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-54931331-98eb-41d3-850b-d2ccb7f3bacd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:13.517248 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-54931331-98eb-41d3-850b-d2ccb7f3bacd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:13.517984 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-54931331-98eb-41d3-850b-d2ccb7f3bacd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:13.523861 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-54931331-98eb-41d3-850b-d2ccb7f3bacd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:13.529975 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-54931331-98eb-41d3-850b-d2ccb7f3bacd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:13.530609 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-54931331-98eb-41d3-850b-d2ccb7f3bacd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:13.875092 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-54931331-98eb-41d3-850b-d2ccb7f3bacd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:13.893391 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-54931331-98eb-41d3-850b-d2ccb7f3bacd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:13.896641 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-54931331-98eb-41d3-850b-d2ccb7f3bacd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:13.900252 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-54931331-98eb-41d3-850b-d2ccb7f3bacd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.410933 Sep 24 21:16:13.917033 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2645/5307] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:13 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:13.998271 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9cadfcd9-96d0-4861-8dc5-d55be842a9c9 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:13.999915 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9cadfcd9-96d0-4861-8dc5-d55be842a9c9 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: d2a62532-3ddd-4eb5-b0c0-3877ff6be556] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:14.031182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9cadfcd9-96d0-4861-8dc5-d55be842a9c9 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:14.034223 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9cadfcd9-96d0-4861-8dc5-d55be842a9c9 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:14.035061 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9cadfcd9-96d0-4861-8dc5-d55be842a9c9 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:14.038276 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9cadfcd9-96d0-4861-8dc5-d55be842a9c9 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:14.039868 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9cadfcd9-96d0-4861-8dc5-d55be842a9c9 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:14.042125 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9cadfcd9-96d0-4861-8dc5-d55be842a9c9 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:14.104695 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6093811d-503d-4e7e-995f-9c950cb27601 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:14.113045 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6093811d-503d-4e7e-995f-9c950cb27601 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547" status: 200 len: 1374 microversion: 2.1 time: 0.839530 Sep 24 21:16:14.113637 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2663/5308] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:13 2022] GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547 => generated 1374 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:14.181182 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9cadfcd9-96d0-4861-8dc5-d55be842a9c9 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556" status: 200 len: 1336 microversion: 2.1 time: 0.188953 Sep 24 21:16:14.191102 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2646/5309] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:13 2022] GET /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556 => generated 1336 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:14.259296 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f5b804d0-b920-4a93-9417-937c67e17d3f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:14.261310 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f5b804d0-b920-4a93-9417-937c67e17d3f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:14.268500 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5b804d0-b920-4a93-9417-937c67e17d3f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:14.269460 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5b804d0-b920-4a93-9417-937c67e17d3f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:14.270598 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5b804d0-b920-4a93-9417-937c67e17d3f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:14.271581 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5b804d0-b920-4a93-9417-937c67e17d3f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:14.273422 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5b804d0-b920-4a93-9417-937c67e17d3f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:14.274121 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5b804d0-b920-4a93-9417-937c67e17d3f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:14.613076 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f5b804d0-b920-4a93-9417-937c67e17d3f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:14.622993 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f5b804d0-b920-4a93-9417-937c67e17d3f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1393 microversion: 2.1 time: 0.369396 Sep 24 21:16:14.624180 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2664/5310] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:14 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1393 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:14.941024 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2dacea78-7d30-4341-8e9d-7496af996ba9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:14.942401 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2dacea78-7d30-4341-8e9d-7496af996ba9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:14.973089 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2dacea78-7d30-4341-8e9d-7496af996ba9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:14.973698 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2dacea78-7d30-4341-8e9d-7496af996ba9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:14.980412 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2dacea78-7d30-4341-8e9d-7496af996ba9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:14.981294 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2dacea78-7d30-4341-8e9d-7496af996ba9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:14.981793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2dacea78-7d30-4341-8e9d-7496af996ba9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:14.982751 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2dacea78-7d30-4341-8e9d-7496af996ba9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:15.142200 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2dacea78-7d30-4341-8e9d-7496af996ba9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:15.149576 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a6bb88be-8706-4406-b9a9-7e004784ae80 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:15.150192 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a6bb88be-8706-4406-b9a9-7e004784ae80 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 15287602-2fd6-4d60-9d26-662b52d6c547] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:15.169433 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2dacea78-7d30-4341-8e9d-7496af996ba9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:15.180724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a6bb88be-8706-4406-b9a9-7e004784ae80 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:15.181961 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a6bb88be-8706-4406-b9a9-7e004784ae80 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:15.182422 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a6bb88be-8706-4406-b9a9-7e004784ae80 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:15.183579 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2dacea78-7d30-4341-8e9d-7496af996ba9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:15.184899 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2dacea78-7d30-4341-8e9d-7496af996ba9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.256860 Sep 24 21:16:15.187279 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a6bb88be-8706-4406-b9a9-7e004784ae80 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:15.189496 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a6bb88be-8706-4406-b9a9-7e004784ae80 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:15.190997 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2647/5311] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:14 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:15.191480 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a6bb88be-8706-4406-b9a9-7e004784ae80 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:15.221349 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1e458b35-fabe-4062-8c4b-b53b9abe1122 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:15.222239 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1e458b35-fabe-4062-8c4b-b53b9abe1122 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: d2a62532-3ddd-4eb5-b0c0-3877ff6be556] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:15.239114 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e458b35-fabe-4062-8c4b-b53b9abe1122 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:15.239620 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e458b35-fabe-4062-8c4b-b53b9abe1122 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:15.240298 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e458b35-fabe-4062-8c4b-b53b9abe1122 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:15.241671 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e458b35-fabe-4062-8c4b-b53b9abe1122 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:15.242699 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e458b35-fabe-4062-8c4b-b53b9abe1122 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:15.243322 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e458b35-fabe-4062-8c4b-b53b9abe1122 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:15.455818 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1e458b35-fabe-4062-8c4b-b53b9abe1122 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556" status: 200 len: 1422 microversion: 2.1 time: 0.233659 Sep 24 21:16:15.456490 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2648/5312] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:15 2022] GET /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556 => generated 1422 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:16:15.615217 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a6bb88be-8706-4406-b9a9-7e004784ae80 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:15.624114 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a6bb88be-8706-4406-b9a9-7e004784ae80 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547" status: 200 len: 1374 microversion: 2.1 time: 0.486140 Sep 24 21:16:15.625404 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2665/5313] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:15 2022] GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547 => generated 1374 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:15.652716 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b062e042-bfaf-494f-bac3-360edd373878 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:15.653953 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b062e042-bfaf-494f-bac3-360edd373878 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:15.672787 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b062e042-bfaf-494f-bac3-360edd373878 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:15.677451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b062e042-bfaf-494f-bac3-360edd373878 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:15.679154 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b062e042-bfaf-494f-bac3-360edd373878 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:15.680177 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b062e042-bfaf-494f-bac3-360edd373878 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:15.680880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b062e042-bfaf-494f-bac3-360edd373878 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:15.681543 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b062e042-bfaf-494f-bac3-360edd373878 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:16.053039 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b062e042-bfaf-494f-bac3-360edd373878 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:16.070322 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b062e042-bfaf-494f-bac3-360edd373878 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1393 microversion: 2.1 time: 0.421434 Sep 24 21:16:16.071418 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2649/5314] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:15 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1393 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:16.241953 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-052b7c4f-3efd-4dc9-962a-301cfa1a93b2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:16.242746 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-052b7c4f-3efd-4dc9-962a-301cfa1a93b2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:16.244496 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-0e53f66e-e8f7-44b5-9ace-06bc4cad5ef2 req-2852938b-0220-4b12-97de-4ee97391de7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15287602-2fd6-4d60-9d26-662b52d6c547", "name": "network-vif-plugged", "status": "completed", "tag": "38f2cbc5-9847-4764-9680-1c6ba97c79cf"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:16:16.268809 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-052b7c4f-3efd-4dc9-962a-301cfa1a93b2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:16.269306 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-052b7c4f-3efd-4dc9-962a-301cfa1a93b2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:16.276592 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-0e53f66e-e8f7-44b5-9ace-06bc4cad5ef2 req-2852938b-0220-4b12-97de-4ee97391de7d service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:16.278231 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-0e53f66e-e8f7-44b5-9ace-06bc4cad5ef2 req-2852938b-0220-4b12-97de-4ee97391de7d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:16.280861 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-0e53f66e-e8f7-44b5-9ace-06bc4cad5ef2 req-2852938b-0220-4b12-97de-4ee97391de7d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:16.281616 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-052b7c4f-3efd-4dc9-962a-301cfa1a93b2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:16.282555 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-052b7c4f-3efd-4dc9-962a-301cfa1a93b2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:16.283058 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-052b7c4f-3efd-4dc9-962a-301cfa1a93b2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:16.283510 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-052b7c4f-3efd-4dc9-962a-301cfa1a93b2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:16.305959 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-0e53f66e-e8f7-44b5-9ace-06bc4cad5ef2 req-2852938b-0220-4b12-97de-4ee97391de7d service nova] Creating event network-vif-plugged:38f2cbc5-9847-4764-9680-1c6ba97c79cf for instance 15287602-2fd6-4d60-9d26-662b52d6c547 on nch1-master-1 Sep 24 21:16:16.312164 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-0e53f66e-e8f7-44b5-9ace-06bc4cad5ef2 req-2852938b-0220-4b12-97de-4ee97391de7d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.343244 Sep 24 21:16:16.341278 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2666/5315] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:16:16.485998 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f617ecfb-7ce4-4e3c-a300-bdbf5d33174f tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:16.487555 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f617ecfb-7ce4-4e3c-a300-bdbf5d33174f tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: d2a62532-3ddd-4eb5-b0c0-3877ff6be556] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:16.493636 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-052b7c4f-3efd-4dc9-962a-301cfa1a93b2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:16.513366 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-052b7c4f-3efd-4dc9-962a-301cfa1a93b2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:16.514796 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-052b7c4f-3efd-4dc9-962a-301cfa1a93b2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:16.515974 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-052b7c4f-3efd-4dc9-962a-301cfa1a93b2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.291268 Sep 24 21:16:16.516877 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2650/5316] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:16 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:16.529159 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f617ecfb-7ce4-4e3c-a300-bdbf5d33174f tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:16.530230 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f617ecfb-7ce4-4e3c-a300-bdbf5d33174f tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:16.530926 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f617ecfb-7ce4-4e3c-a300-bdbf5d33174f tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:16.532267 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f617ecfb-7ce4-4e3c-a300-bdbf5d33174f tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:16.533058 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f617ecfb-7ce4-4e3c-a300-bdbf5d33174f tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:16.534125 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f617ecfb-7ce4-4e3c-a300-bdbf5d33174f tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:16.650790 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a8617eb0-5def-4e38-b310-bb908d419697 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:16.651706 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a8617eb0-5def-4e38-b310-bb908d419697 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 15287602-2fd6-4d60-9d26-662b52d6c547] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:16.672379 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a8617eb0-5def-4e38-b310-bb908d419697 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:16.672889 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a8617eb0-5def-4e38-b310-bb908d419697 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:16.673522 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a8617eb0-5def-4e38-b310-bb908d419697 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:16.674404 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a8617eb0-5def-4e38-b310-bb908d419697 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:16.694435 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a8617eb0-5def-4e38-b310-bb908d419697 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:16.695081 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a8617eb0-5def-4e38-b310-bb908d419697 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:16.730522 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f617ecfb-7ce4-4e3c-a300-bdbf5d33174f tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556" status: 200 len: 1420 microversion: 2.1 time: 0.251155 Sep 24 21:16:16.731751 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2667/5317] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:16 2022] GET /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556 => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:16:16.994725 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a8617eb0-5def-4e38-b310-bb908d419697 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:17.006830 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a8617eb0-5def-4e38-b310-bb908d419697 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547" status: 200 len: 1374 microversion: 2.1 time: 0.360075 Sep 24 21:16:17.011121 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2651/5318] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:16 2022] GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547 => generated 1374 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:16:17.097799 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-45c14022-e745-4bc1-93ac-5f773580cc27 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:17.099571 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-45c14022-e745-4bc1-93ac-5f773580cc27 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:17.107444 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45c14022-e745-4bc1-93ac-5f773580cc27 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:17.108341 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45c14022-e745-4bc1-93ac-5f773580cc27 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:17.109737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45c14022-e745-4bc1-93ac-5f773580cc27 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:17.110896 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45c14022-e745-4bc1-93ac-5f773580cc27 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:17.111582 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45c14022-e745-4bc1-93ac-5f773580cc27 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:17.112251 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45c14022-e745-4bc1-93ac-5f773580cc27 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:17.389336 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-45c14022-e745-4bc1-93ac-5f773580cc27 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:17.408010 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-45c14022-e745-4bc1-93ac-5f773580cc27 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1393 microversion: 2.1 time: 0.315061 Sep 24 21:16:17.423850 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2668/5319] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:17 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1393 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:16:17.548391 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b83f86de-ddd2-4e88-a7c0-3120e3dfdea6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:17.549095 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b83f86de-ddd2-4e88-a7c0-3120e3dfdea6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:17.557357 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b83f86de-ddd2-4e88-a7c0-3120e3dfdea6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:17.557933 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b83f86de-ddd2-4e88-a7c0-3120e3dfdea6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:17.558444 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b83f86de-ddd2-4e88-a7c0-3120e3dfdea6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:17.559421 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b83f86de-ddd2-4e88-a7c0-3120e3dfdea6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:17.560309 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b83f86de-ddd2-4e88-a7c0-3120e3dfdea6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:17.560842 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b83f86de-ddd2-4e88-a7c0-3120e3dfdea6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:17.668331 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b83f86de-ddd2-4e88-a7c0-3120e3dfdea6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:17.681052 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b83f86de-ddd2-4e88-a7c0-3120e3dfdea6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:17.689551 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b83f86de-ddd2-4e88-a7c0-3120e3dfdea6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:17.691040 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b83f86de-ddd2-4e88-a7c0-3120e3dfdea6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.146998 Sep 24 21:16:17.691941 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2652/5320] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:17 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:17.754125 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e999f0b3-7571-473e-9908-b8bcc63eeaaf tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:17.754774 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e999f0b3-7571-473e-9908-b8bcc63eeaaf tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: d2a62532-3ddd-4eb5-b0c0-3877ff6be556] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:17.763662 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e999f0b3-7571-473e-9908-b8bcc63eeaaf tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:17.764157 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e999f0b3-7571-473e-9908-b8bcc63eeaaf tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:17.765168 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e999f0b3-7571-473e-9908-b8bcc63eeaaf tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:17.766074 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e999f0b3-7571-473e-9908-b8bcc63eeaaf tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:17.766571 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e999f0b3-7571-473e-9908-b8bcc63eeaaf tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:17.767038 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e999f0b3-7571-473e-9908-b8bcc63eeaaf tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:17.940794 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e999f0b3-7571-473e-9908-b8bcc63eeaaf tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556" status: 200 len: 1462 microversion: 2.1 time: 0.190284 Sep 24 21:16:17.941894 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2669/5321] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:17 2022] GET /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556 => generated 1462 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:18.034623 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cc6d0b6b-df5d-4c8e-8e99-71973bf37d2b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:18.035511 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cc6d0b6b-df5d-4c8e-8e99-71973bf37d2b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 15287602-2fd6-4d60-9d26-662b52d6c547] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:18.042625 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cc6d0b6b-df5d-4c8e-8e99-71973bf37d2b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:18.044126 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cc6d0b6b-df5d-4c8e-8e99-71973bf37d2b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:18.044955 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cc6d0b6b-df5d-4c8e-8e99-71973bf37d2b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:18.045840 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cc6d0b6b-df5d-4c8e-8e99-71973bf37d2b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:18.046520 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cc6d0b6b-df5d-4c8e-8e99-71973bf37d2b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:18.047135 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cc6d0b6b-df5d-4c8e-8e99-71973bf37d2b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:18.100971 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-9fd32e6e-6583-4d3a-8569-71e520dad6af req-17cae010-8849-4598-9ea0-298229162d36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97863e58-47a8-44be-a268-26807a10f037", "tag": "72dd520b-415e-4703-95f2-fa48dc8a2c00"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:16:18.122661 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-9fd32e6e-6583-4d3a-8569-71e520dad6af req-17cae010-8849-4598-9ea0-298229162d36 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:18.124516 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-9fd32e6e-6583-4d3a-8569-71e520dad6af req-17cae010-8849-4598-9ea0-298229162d36 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:18.125178 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-9fd32e6e-6583-4d3a-8569-71e520dad6af req-17cae010-8849-4598-9ea0-298229162d36 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:18.160234 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-9fd32e6e-6583-4d3a-8569-71e520dad6af req-17cae010-8849-4598-9ea0-298229162d36 service nova] Creating event network-changed:72dd520b-415e-4703-95f2-fa48dc8a2c00 for instance 97863e58-47a8-44be-a268-26807a10f037 on nch2-master-1 Sep 24 21:16:18.171178 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-9fd32e6e-6583-4d3a-8569-71e520dad6af req-17cae010-8849-4598-9ea0-298229162d36 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078615 Sep 24 21:16:18.172580 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2670/5322] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:16:18.278186 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cc6d0b6b-df5d-4c8e-8e99-71973bf37d2b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:18.294695 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cc6d0b6b-df5d-4c8e-8e99-71973bf37d2b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547" status: 200 len: 1374 microversion: 2.1 time: 0.264807 Sep 24 21:16:18.313278 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2653/5323] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:18 2022] GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547 => generated 1374 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:18.435250 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-495dc0de-49bd-4197-aa02-edcbe0b92590 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:18.437231 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-495dc0de-49bd-4197-aa02-edcbe0b92590 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:18.445339 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-495dc0de-49bd-4197-aa02-edcbe0b92590 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:18.446325 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-495dc0de-49bd-4197-aa02-edcbe0b92590 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:18.447197 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-495dc0de-49bd-4197-aa02-edcbe0b92590 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:18.448163 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-495dc0de-49bd-4197-aa02-edcbe0b92590 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:18.448840 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-495dc0de-49bd-4197-aa02-edcbe0b92590 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:18.449853 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-495dc0de-49bd-4197-aa02-edcbe0b92590 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:18.677157 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-495dc0de-49bd-4197-aa02-edcbe0b92590 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:18.677157 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-495dc0de-49bd-4197-aa02-edcbe0b92590 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1393 microversion: 2.1 time: 0.246855 Sep 24 21:16:18.691167 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2671/5324] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:18 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1393 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:18.717650 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-33430627-21b2-4ba6-8954-29b98e97c636 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:18.718269 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-33430627-21b2-4ba6-8954-29b98e97c636 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:18.731233 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-33430627-21b2-4ba6-8954-29b98e97c636 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:18.733333 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-33430627-21b2-4ba6-8954-29b98e97c636 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:18.734043 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-33430627-21b2-4ba6-8954-29b98e97c636 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:18.735197 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-33430627-21b2-4ba6-8954-29b98e97c636 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:18.735924 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-33430627-21b2-4ba6-8954-29b98e97c636 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:18.736610 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-33430627-21b2-4ba6-8954-29b98e97c636 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:18.814301 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-33430627-21b2-4ba6-8954-29b98e97c636 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:18.827795 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-33430627-21b2-4ba6-8954-29b98e97c636 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:18.829248 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-33430627-21b2-4ba6-8954-29b98e97c636 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:18.831079 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-33430627-21b2-4ba6-8954-29b98e97c636 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.117372 Sep 24 21:16:18.834655 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2654/5325] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:18 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:18.973090 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f7d539fc-87bc-4c86-89ba-f8bfd4248f80 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:18.973883 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f7d539fc-87bc-4c86-89ba-f8bfd4248f80 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: d2a62532-3ddd-4eb5-b0c0-3877ff6be556] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:18.987491 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-260c0bb4-77de-45c3-8f79-d26f0123a7b0 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-456199401", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "8a442d1d-ac1c-4bfb-82ef-d4c15eab4337"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:16:18.991811 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f7d539fc-87bc-4c86-89ba-f8bfd4248f80 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:18.992615 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f7d539fc-87bc-4c86-89ba-f8bfd4248f80 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:18.994069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f7d539fc-87bc-4c86-89ba-f8bfd4248f80 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:18.994940 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f7d539fc-87bc-4c86-89ba-f8bfd4248f80 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:18.995752 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f7d539fc-87bc-4c86-89ba-f8bfd4248f80 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:18.996394 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f7d539fc-87bc-4c86-89ba-f8bfd4248f80 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:19.053466 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-260c0bb4-77de-45c3-8f79-d26f0123a7b0 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] validate_networks() for [('8a442d1d-ac1c-4bfb-82ef-d4c15eab4337', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:16:19.260944 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f7d539fc-87bc-4c86-89ba-f8bfd4248f80 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556" status: 200 len: 1462 microversion: 2.1 time: 0.299524 Sep 24 21:16:19.274653 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2655/5326] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:18 2022] GET /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556 => generated 1462 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:19.319553 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e8dbb356-360d-4142-af85-022754855cd1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:19.320257 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e8dbb356-360d-4142-af85-022754855cd1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 15287602-2fd6-4d60-9d26-662b52d6c547] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:19.326623 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e8dbb356-360d-4142-af85-022754855cd1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:19.327132 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e8dbb356-360d-4142-af85-022754855cd1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:19.327581 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e8dbb356-360d-4142-af85-022754855cd1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:19.328440 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e8dbb356-360d-4142-af85-022754855cd1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:19.329097 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e8dbb356-360d-4142-af85-022754855cd1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:19.329541 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e8dbb356-360d-4142-af85-022754855cd1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:19.564689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e8dbb356-360d-4142-af85-022754855cd1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:19.573209 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e8dbb356-360d-4142-af85-022754855cd1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547" status: 200 len: 1546 microversion: 2.1 time: 0.258234 Sep 24 21:16:19.573929 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2656/5327] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:19 2022] GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547 => generated 1546 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:16:19.593681 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-260c0bb4-77de-45c3-8f79-d26f0123a7b0 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:16:19.594279 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-260c0bb4-77de-45c3-8f79-d26f0123a7b0 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:16:19.594975 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-260c0bb4-77de-45c3-8f79-d26f0123a7b0 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:16:19.595525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-260c0bb4-77de-45c3-8f79-d26f0123a7b0 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:16:19.596030 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-260c0bb4-77de-45c3-8f79-d26f0123a7b0 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:16:19.604029 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dd1db568-1c98-4825-b240-3f2440329088 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:19.604650 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-dd1db568-1c98-4825-b240-3f2440329088 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 15287602-2fd6-4d60-9d26-662b52d6c547] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:19.611822 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd1db568-1c98-4825-b240-3f2440329088 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:19.612545 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd1db568-1c98-4825-b240-3f2440329088 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:19.612981 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd1db568-1c98-4825-b240-3f2440329088 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:19.614045 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd1db568-1c98-4825-b240-3f2440329088 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:19.614489 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-260c0bb4-77de-45c3-8f79-d26f0123a7b0 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:19.614733 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd1db568-1c98-4825-b240-3f2440329088 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:19.615241 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd1db568-1c98-4825-b240-3f2440329088 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:19.616091 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-260c0bb4-77de-45c3-8f79-d26f0123a7b0 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:19.616540 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-260c0bb4-77de-45c3-8f79-d26f0123a7b0 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:19.617889 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-260c0bb4-77de-45c3-8f79-d26f0123a7b0 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:19.618379 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-260c0bb4-77de-45c3-8f79-d26f0123a7b0 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:19.619004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-260c0bb4-77de-45c3-8f79-d26f0123a7b0 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:19.643399 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-260c0bb4-77de-45c3-8f79-d26f0123a7b0 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Getting quotas for project 3601e0eb4f654079810627bef64cb0da. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:16:19.649917 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-260c0bb4-77de-45c3-8f79-d26f0123a7b0 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Getting quotas for user b53b6cad57584720aa0ecbe097fe92c9 and project 3601e0eb4f654079810627bef64cb0da. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:16:19.663267 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-260c0bb4-77de-45c3-8f79-d26f0123a7b0 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:16:19.665646 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-260c0bb4-77de-45c3-8f79-d26f0123a7b0 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] [instance: 55393c6d-70c2-43ad-abbf-fc266238e783] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:16:19.716056 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-260c0bb4-77de-45c3-8f79-d26f0123a7b0 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.895259 Sep 24 21:16:19.717698 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2672/5328] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:16:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 24 21:16:19.722592 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5f24904a-5131-4145-82e8-c96690379055 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:19.723355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5f24904a-5131-4145-82e8-c96690379055 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:19.730148 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f24904a-5131-4145-82e8-c96690379055 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:19.730694 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f24904a-5131-4145-82e8-c96690379055 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:19.731148 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f24904a-5131-4145-82e8-c96690379055 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:19.732739 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f24904a-5131-4145-82e8-c96690379055 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:19.733214 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f24904a-5131-4145-82e8-c96690379055 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:19.733847 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f24904a-5131-4145-82e8-c96690379055 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:19.750960 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:16:19.801304 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-dd1db568-1c98-4825-b240-3f2440329088 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:19.804066 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:16:19.814265 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-dd1db568-1c98-4825-b240-3f2440329088 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547" status: 200 len: 1546 microversion: 2.1 time: 0.214508 Sep 24 21:16:19.823920 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2657/5329] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:19 2022] GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547 => generated 1546 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:19.823920 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3ca4054c-fe88-465d-ae49-2893389b2d04 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:19.823920 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3ca4054c-fe88-465d-ae49-2893389b2d04 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] [instance: 55393c6d-70c2-43ad-abbf-fc266238e783] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:19.930639 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3ca4054c-fe88-465d-ae49-2893389b2d04 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b53b6cad57584720aa0ecbe097fe92c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3601e0eb4f654079810627bef64cb0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:19.953454 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3ca4054c-fe88-465d-ae49-2893389b2d04 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] 10.222.0.52 "GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783" status: 200 len: 1214 microversion: 2.1 time: 0.137053 Sep 24 21:16:19.955025 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2658/5330] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:19 2022] GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783 => generated 1214 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:19.969486 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5f24904a-5131-4145-82e8-c96690379055 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:19.977507 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f55e5a69-4668-4928-b7f8-1e1afdda2136 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:19.980525 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f55e5a69-4668-4928-b7f8-1e1afdda2136 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:19.987214 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5f24904a-5131-4145-82e8-c96690379055 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1393 microversion: 2.1 time: 0.268410 Sep 24 21:16:19.988119 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2673/5331] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:19 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1393 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:20.005202 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f55e5a69-4668-4928-b7f8-1e1afdda2136 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:20.005882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f55e5a69-4668-4928-b7f8-1e1afdda2136 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:20.008360 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f55e5a69-4668-4928-b7f8-1e1afdda2136 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:20.010853 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f55e5a69-4668-4928-b7f8-1e1afdda2136 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:20.011551 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f55e5a69-4668-4928-b7f8-1e1afdda2136 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:20.012033 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f55e5a69-4668-4928-b7f8-1e1afdda2136 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:20.167068 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f55e5a69-4668-4928-b7f8-1e1afdda2136 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:20.179558 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f55e5a69-4668-4928-b7f8-1e1afdda2136 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:20.181378 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f55e5a69-4668-4928-b7f8-1e1afdda2136 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:20.182837 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f55e5a69-4668-4928-b7f8-1e1afdda2136 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.226890 Sep 24 21:16:20.183634 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2659/5332] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:19 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:20.220490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-25758322-7caf-4d0d-9cfd-1d55c26ddb35 req-18bdd1fd-8595-4c86-abfa-fdb3d4d273f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2a62532-3ddd-4eb5-b0c0-3877ff6be556", "tag": "80b60318-7e7e-4426-9677-d4bdda71e38c"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:16:20.232509 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-25758322-7caf-4d0d-9cfd-1d55c26ddb35 req-18bdd1fd-8595-4c86-abfa-fdb3d4d273f8 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:20.233637 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-25758322-7caf-4d0d-9cfd-1d55c26ddb35 req-18bdd1fd-8595-4c86-abfa-fdb3d4d273f8 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:20.234330 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-25758322-7caf-4d0d-9cfd-1d55c26ddb35 req-18bdd1fd-8595-4c86-abfa-fdb3d4d273f8 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:20.248690 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-25758322-7caf-4d0d-9cfd-1d55c26ddb35 req-18bdd1fd-8595-4c86-abfa-fdb3d4d273f8 service nova] Creating event network-changed:80b60318-7e7e-4426-9677-d4bdda71e38c for instance d2a62532-3ddd-4eb5-b0c0-3877ff6be556 on nch2-master-1 Sep 24 21:16:20.255466 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-25758322-7caf-4d0d-9cfd-1d55c26ddb35 req-18bdd1fd-8595-4c86-abfa-fdb3d4d273f8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038866 Sep 24 21:16:20.258119 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2674/5333] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:16:20.292249 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5d002935-8d33-4e24-9de1-8be94e4e24c8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:20.293216 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5d002935-8d33-4e24-9de1-8be94e4e24c8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: d2a62532-3ddd-4eb5-b0c0-3877ff6be556] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:20.301761 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d002935-8d33-4e24-9de1-8be94e4e24c8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:20.302880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d002935-8d33-4e24-9de1-8be94e4e24c8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:20.303901 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d002935-8d33-4e24-9de1-8be94e4e24c8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:20.305650 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d002935-8d33-4e24-9de1-8be94e4e24c8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:20.306347 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d002935-8d33-4e24-9de1-8be94e4e24c8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:20.307449 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d002935-8d33-4e24-9de1-8be94e4e24c8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:20.532096 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5d002935-8d33-4e24-9de1-8be94e4e24c8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556" status: 200 len: 1462 microversion: 2.1 time: 0.248031 Sep 24 21:16:20.532790 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2660/5334] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:20 2022] GET /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556 => generated 1462 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:20.981900 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-de175533-a55c-4d8a-af8f-8b8bc0511a1a tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:20.982732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-de175533-a55c-4d8a-af8f-8b8bc0511a1a tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] [instance: 55393c6d-70c2-43ad-abbf-fc266238e783] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:20.993944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de175533-a55c-4d8a-af8f-8b8bc0511a1a tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:20.994333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de175533-a55c-4d8a-af8f-8b8bc0511a1a tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:20.994997 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de175533-a55c-4d8a-af8f-8b8bc0511a1a tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:20.995711 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de175533-a55c-4d8a-af8f-8b8bc0511a1a tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:20.996176 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de175533-a55c-4d8a-af8f-8b8bc0511a1a tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:20.996606 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de175533-a55c-4d8a-af8f-8b8bc0511a1a tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:21.014974 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-51f2f04d-4b7a-43a9-9afb-fbd55b8ac71b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:21.016369 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-51f2f04d-4b7a-43a9-9afb-fbd55b8ac71b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:21.026793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51f2f04d-4b7a-43a9-9afb-fbd55b8ac71b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:21.027930 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51f2f04d-4b7a-43a9-9afb-fbd55b8ac71b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:21.028632 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51f2f04d-4b7a-43a9-9afb-fbd55b8ac71b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:21.029616 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51f2f04d-4b7a-43a9-9afb-fbd55b8ac71b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:21.031243 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51f2f04d-4b7a-43a9-9afb-fbd55b8ac71b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:21.032160 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51f2f04d-4b7a-43a9-9afb-fbd55b8ac71b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:21.171666 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-de175533-a55c-4d8a-af8f-8b8bc0511a1a tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b53b6cad57584720aa0ecbe097fe92c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3601e0eb4f654079810627bef64cb0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:21.182158 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-de175533-a55c-4d8a-af8f-8b8bc0511a1a tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] 10.222.0.52 "GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783" status: 200 len: 1266 microversion: 2.1 time: 0.208298 Sep 24 21:16:21.195641 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2675/5335] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:20 2022] GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:21.209537 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dfeb2a85-1ab8-44a9-98d4-04901f585684 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:21.210333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dfeb2a85-1ab8-44a9-98d4-04901f585684 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:21.219648 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dfeb2a85-1ab8-44a9-98d4-04901f585684 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:21.220200 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dfeb2a85-1ab8-44a9-98d4-04901f585684 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:21.220916 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dfeb2a85-1ab8-44a9-98d4-04901f585684 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:21.223539 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dfeb2a85-1ab8-44a9-98d4-04901f585684 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:21.224983 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dfeb2a85-1ab8-44a9-98d4-04901f585684 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:21.225205 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dfeb2a85-1ab8-44a9-98d4-04901f585684 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:21.263619 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-51f2f04d-4b7a-43a9-9afb-fbd55b8ac71b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:21.277518 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-51f2f04d-4b7a-43a9-9afb-fbd55b8ac71b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1393 microversion: 2.1 time: 0.267652 Sep 24 21:16:21.282540 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2661/5336] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:21 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1393 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:21.322330 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dfeb2a85-1ab8-44a9-98d4-04901f585684 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:21.332756 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dfeb2a85-1ab8-44a9-98d4-04901f585684 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:21.334256 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dfeb2a85-1ab8-44a9-98d4-04901f585684 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:21.335558 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dfeb2a85-1ab8-44a9-98d4-04901f585684 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.130455 Sep 24 21:16:21.336116 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2676/5337] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:21 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:21.560891 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-847c14d2-69e7-4078-9ea1-a73dd8b6b9a2 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:21.561608 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-847c14d2-69e7-4078-9ea1-a73dd8b6b9a2 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: d2a62532-3ddd-4eb5-b0c0-3877ff6be556] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:21.568190 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-847c14d2-69e7-4078-9ea1-a73dd8b6b9a2 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:21.569431 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-847c14d2-69e7-4078-9ea1-a73dd8b6b9a2 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:21.570090 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-847c14d2-69e7-4078-9ea1-a73dd8b6b9a2 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:21.570860 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-847c14d2-69e7-4078-9ea1-a73dd8b6b9a2 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:21.571577 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-847c14d2-69e7-4078-9ea1-a73dd8b6b9a2 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:21.572048 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-847c14d2-69e7-4078-9ea1-a73dd8b6b9a2 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:22.123584 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-847c14d2-69e7-4078-9ea1-a73dd8b6b9a2 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556" status: 200 len: 1462 microversion: 2.1 time: 0.566383 Sep 24 21:16:22.127500 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2662/5338] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:21 2022] GET /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556 => generated 1462 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:22.217292 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7f33b155-6d7f-466d-82bc-22c864d462ef tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:22.219295 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7f33b155-6d7f-466d-82bc-22c864d462ef tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] [instance: 55393c6d-70c2-43ad-abbf-fc266238e783] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:22.231409 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f33b155-6d7f-466d-82bc-22c864d462ef tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:22.232188 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f33b155-6d7f-466d-82bc-22c864d462ef tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:22.232894 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f33b155-6d7f-466d-82bc-22c864d462ef tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:22.234010 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f33b155-6d7f-466d-82bc-22c864d462ef tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:22.234628 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f33b155-6d7f-466d-82bc-22c864d462ef tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:22.235291 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f33b155-6d7f-466d-82bc-22c864d462ef tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:22.302563 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e98fc7c6-20d7-46ae-ada1-e38ed0b6223e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:22.303343 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e98fc7c6-20d7-46ae-ada1-e38ed0b6223e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:22.306472 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=4 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:16:22.309575 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7f33b155-6d7f-466d-82bc-22c864d462ef tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b53b6cad57584720aa0ecbe097fe92c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3601e0eb4f654079810627bef64cb0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:22.315004 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e98fc7c6-20d7-46ae-ada1-e38ed0b6223e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:22.316666 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e98fc7c6-20d7-46ae-ada1-e38ed0b6223e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:22.317404 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e98fc7c6-20d7-46ae-ada1-e38ed0b6223e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:22.319551 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e98fc7c6-20d7-46ae-ada1-e38ed0b6223e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:22.320027 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e98fc7c6-20d7-46ae-ada1-e38ed0b6223e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:22.320474 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e98fc7c6-20d7-46ae-ada1-e38ed0b6223e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:22.321120 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7f33b155-6d7f-466d-82bc-22c864d462ef tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] 10.222.0.52 "GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783" status: 200 len: 1272 microversion: 2.1 time: 0.115391 Sep 24 21:16:22.322229 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2677/5339] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:22 2022] GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783 => generated 1272 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:22.360826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-75ad5bf7-09d2-40f3-bc63-b187a47c4b6c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:22.367446 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-75ad5bf7-09d2-40f3-bc63-b187a47c4b6c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:22.383401 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75ad5bf7-09d2-40f3-bc63-b187a47c4b6c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:22.384157 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75ad5bf7-09d2-40f3-bc63-b187a47c4b6c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:22.384821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75ad5bf7-09d2-40f3-bc63-b187a47c4b6c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:22.385752 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75ad5bf7-09d2-40f3-bc63-b187a47c4b6c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:22.386418 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75ad5bf7-09d2-40f3-bc63-b187a47c4b6c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:22.387079 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75ad5bf7-09d2-40f3-bc63-b187a47c4b6c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:22.494041 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-75ad5bf7-09d2-40f3-bc63-b187a47c4b6c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:22.510723 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-75ad5bf7-09d2-40f3-bc63-b187a47c4b6c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:22.514384 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-75ad5bf7-09d2-40f3-bc63-b187a47c4b6c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:22.519538 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-75ad5bf7-09d2-40f3-bc63-b187a47c4b6c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.162602 Sep 24 21:16:22.523479 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2678/5340] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:22 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:22.545344 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e98fc7c6-20d7-46ae-ada1-e38ed0b6223e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:22.558054 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e98fc7c6-20d7-46ae-ada1-e38ed0b6223e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1393 microversion: 2.1 time: 0.259206 Sep 24 21:16:22.559172 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2663/5341] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:22 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1393 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:23.146861 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7aed0c5a-65a2-45e1-9e67-51a9ebd05931 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:23.147535 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7aed0c5a-65a2-45e1-9e67-51a9ebd05931 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: d2a62532-3ddd-4eb5-b0c0-3877ff6be556] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:23.153831 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7aed0c5a-65a2-45e1-9e67-51a9ebd05931 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:23.154328 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7aed0c5a-65a2-45e1-9e67-51a9ebd05931 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:23.154810 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7aed0c5a-65a2-45e1-9e67-51a9ebd05931 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:23.155525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7aed0c5a-65a2-45e1-9e67-51a9ebd05931 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:23.156177 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7aed0c5a-65a2-45e1-9e67-51a9ebd05931 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:23.156613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7aed0c5a-65a2-45e1-9e67-51a9ebd05931 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:23.312372 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7aed0c5a-65a2-45e1-9e67-51a9ebd05931 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556" status: 200 len: 1462 microversion: 2.1 time: 0.169885 Sep 24 21:16:23.314002 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2679/5342] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:23 2022] GET /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556 => generated 1462 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:23.345593 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d632929f-4aa6-4721-9072-a9102ba4f354 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:23.346293 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d632929f-4aa6-4721-9072-a9102ba4f354 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] [instance: 55393c6d-70c2-43ad-abbf-fc266238e783] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:23.356259 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d632929f-4aa6-4721-9072-a9102ba4f354 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:23.357282 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d632929f-4aa6-4721-9072-a9102ba4f354 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:23.358031 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d632929f-4aa6-4721-9072-a9102ba4f354 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:23.359246 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d632929f-4aa6-4721-9072-a9102ba4f354 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:23.359994 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d632929f-4aa6-4721-9072-a9102ba4f354 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:23.360707 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d632929f-4aa6-4721-9072-a9102ba4f354 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:23.554942 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d632929f-4aa6-4721-9072-a9102ba4f354 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b53b6cad57584720aa0ecbe097fe92c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3601e0eb4f654079810627bef64cb0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:23.559450 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-21d61c6b-a13d-4d51-8a2a-512718b15d78 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:23.560016 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-21d61c6b-a13d-4d51-8a2a-512718b15d78 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:23.568088 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d632929f-4aa6-4721-9072-a9102ba4f354 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] 10.222.0.52 "GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783" status: 200 len: 1314 microversion: 2.1 time: 0.226417 Sep 24 21:16:23.571355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-21d61c6b-a13d-4d51-8a2a-512718b15d78 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:23.571855 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-21d61c6b-a13d-4d51-8a2a-512718b15d78 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:23.572295 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-21d61c6b-a13d-4d51-8a2a-512718b15d78 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:23.573018 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-21d61c6b-a13d-4d51-8a2a-512718b15d78 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:23.573476 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-21d61c6b-a13d-4d51-8a2a-512718b15d78 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:23.573901 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-21d61c6b-a13d-4d51-8a2a-512718b15d78 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:23.586050 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2664/5343] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:23 2022] GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:23.607368 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a50ac8c7-8079-487d-a601-f25b606c38c0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:23.610371 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a50ac8c7-8079-487d-a601-f25b606c38c0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:23.641975 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a50ac8c7-8079-487d-a601-f25b606c38c0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:23.645634 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a50ac8c7-8079-487d-a601-f25b606c38c0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:23.647315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a50ac8c7-8079-487d-a601-f25b606c38c0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:23.649454 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a50ac8c7-8079-487d-a601-f25b606c38c0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:23.652047 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a50ac8c7-8079-487d-a601-f25b606c38c0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:23.653736 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a50ac8c7-8079-487d-a601-f25b606c38c0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:23.682899 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-21d61c6b-a13d-4d51-8a2a-512718b15d78 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:23.695054 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-21d61c6b-a13d-4d51-8a2a-512718b15d78 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:23.697002 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-21d61c6b-a13d-4d51-8a2a-512718b15d78 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:23.700631 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-21d61c6b-a13d-4d51-8a2a-512718b15d78 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.154509 Sep 24 21:16:23.704228 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2680/5344] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:23 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:16:23.858852 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a50ac8c7-8079-487d-a601-f25b606c38c0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:23.870004 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a50ac8c7-8079-487d-a601-f25b606c38c0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1393 microversion: 2.1 time: 0.280793 Sep 24 21:16:23.871038 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2665/5345] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:23 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1393 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:24.265609 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-f63fc21a-c036-4c7c-8ba2-93c4328dad0a req-388b3714-d196-4e88-8d47-5b62e237929a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97863e58-47a8-44be-a268-26807a10f037", "name": "network-vif-plugged", "status": "completed", "tag": "72dd520b-415e-4703-95f2-fa48dc8a2c00"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:16:24.288508 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-f63fc21a-c036-4c7c-8ba2-93c4328dad0a req-388b3714-d196-4e88-8d47-5b62e237929a service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:24.289602 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-f63fc21a-c036-4c7c-8ba2-93c4328dad0a req-388b3714-d196-4e88-8d47-5b62e237929a service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:24.290673 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-f63fc21a-c036-4c7c-8ba2-93c4328dad0a req-388b3714-d196-4e88-8d47-5b62e237929a service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:24.313702 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-f63fc21a-c036-4c7c-8ba2-93c4328dad0a req-388b3714-d196-4e88-8d47-5b62e237929a service nova] Creating event network-vif-plugged:72dd520b-415e-4703-95f2-fa48dc8a2c00 for instance 97863e58-47a8-44be-a268-26807a10f037 on nch2-master-1 Sep 24 21:16:24.322056 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-f63fc21a-c036-4c7c-8ba2-93c4328dad0a req-388b3714-d196-4e88-8d47-5b62e237929a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067291 Sep 24 21:16:24.323271 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2681/5346] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:16:24.340416 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6870a75b-18ce-4a56-b0fd-47f8c8f04327 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:24.342962 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6870a75b-18ce-4a56-b0fd-47f8c8f04327 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: d2a62532-3ddd-4eb5-b0c0-3877ff6be556] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:24.354079 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6870a75b-18ce-4a56-b0fd-47f8c8f04327 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:24.355839 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6870a75b-18ce-4a56-b0fd-47f8c8f04327 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:24.356935 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6870a75b-18ce-4a56-b0fd-47f8c8f04327 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:24.358729 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6870a75b-18ce-4a56-b0fd-47f8c8f04327 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:24.359879 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6870a75b-18ce-4a56-b0fd-47f8c8f04327 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:24.361437 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6870a75b-18ce-4a56-b0fd-47f8c8f04327 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:24.548532 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6870a75b-18ce-4a56-b0fd-47f8c8f04327 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556" status: 200 len: 1462 microversion: 2.1 time: 0.212947 Sep 24 21:16:24.549849 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2666/5347] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:24 2022] GET /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556 => generated 1462 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:24.599159 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d68cd89b-c7e5-4aa8-a9c1-e89fc67815bf tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:24.601240 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d68cd89b-c7e5-4aa8-a9c1-e89fc67815bf tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] [instance: 55393c6d-70c2-43ad-abbf-fc266238e783] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:24.612658 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d68cd89b-c7e5-4aa8-a9c1-e89fc67815bf tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:24.613617 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d68cd89b-c7e5-4aa8-a9c1-e89fc67815bf tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:24.613939 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d68cd89b-c7e5-4aa8-a9c1-e89fc67815bf tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:24.616820 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d68cd89b-c7e5-4aa8-a9c1-e89fc67815bf tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:24.617851 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d68cd89b-c7e5-4aa8-a9c1-e89fc67815bf tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:24.618777 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d68cd89b-c7e5-4aa8-a9c1-e89fc67815bf tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:24.731494 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5f2ed0e8-fb6e-405d-9240-1331633f1642 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:24.732507 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5f2ed0e8-fb6e-405d-9240-1331633f1642 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:24.743486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f2ed0e8-fb6e-405d-9240-1331633f1642 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:24.744331 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f2ed0e8-fb6e-405d-9240-1331633f1642 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:24.745029 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f2ed0e8-fb6e-405d-9240-1331633f1642 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:24.745984 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f2ed0e8-fb6e-405d-9240-1331633f1642 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:24.746938 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f2ed0e8-fb6e-405d-9240-1331633f1642 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:24.748052 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f2ed0e8-fb6e-405d-9240-1331633f1642 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:24.841390 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5f2ed0e8-fb6e-405d-9240-1331633f1642 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:24.860690 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5f2ed0e8-fb6e-405d-9240-1331633f1642 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:24.862245 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5f2ed0e8-fb6e-405d-9240-1331633f1642 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:24.870710 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5f2ed0e8-fb6e-405d-9240-1331633f1642 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.144578 Sep 24 21:16:24.871330 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2667/5348] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:24 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:24.876341 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d68cd89b-c7e5-4aa8-a9c1-e89fc67815bf tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b53b6cad57584720aa0ecbe097fe92c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3601e0eb4f654079810627bef64cb0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:24.886051 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d68cd89b-c7e5-4aa8-a9c1-e89fc67815bf tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] 10.222.0.52 "GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783" status: 200 len: 1314 microversion: 2.1 time: 0.295177 Sep 24 21:16:24.887261 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2682/5349] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:24 2022] GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:24.895364 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-01099ad4-c6ad-4004-8c2f-00994b327e8b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:24.897262 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-01099ad4-c6ad-4004-8c2f-00994b327e8b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:24.906810 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-01099ad4-c6ad-4004-8c2f-00994b327e8b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:24.907331 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-01099ad4-c6ad-4004-8c2f-00994b327e8b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:24.907833 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-01099ad4-c6ad-4004-8c2f-00994b327e8b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:24.908560 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-01099ad4-c6ad-4004-8c2f-00994b327e8b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:24.909030 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-01099ad4-c6ad-4004-8c2f-00994b327e8b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:24.909471 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-01099ad4-c6ad-4004-8c2f-00994b327e8b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:25.098285 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-98e9588e-0fe1-441d-a204-b2b89893889f req-5af62cce-e333-42df-b3bd-d5091a9edc0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15287602-2fd6-4d60-9d26-662b52d6c547", "tag": "38f2cbc5-9847-4764-9680-1c6ba97c79cf"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:16:25.114269 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-98e9588e-0fe1-441d-a204-b2b89893889f req-5af62cce-e333-42df-b3bd-d5091a9edc0e service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:25.114752 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-98e9588e-0fe1-441d-a204-b2b89893889f req-5af62cce-e333-42df-b3bd-d5091a9edc0e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:25.115346 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-98e9588e-0fe1-441d-a204-b2b89893889f req-5af62cce-e333-42df-b3bd-d5091a9edc0e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:25.132396 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-98e9588e-0fe1-441d-a204-b2b89893889f req-5af62cce-e333-42df-b3bd-d5091a9edc0e service nova] Creating event network-changed:38f2cbc5-9847-4764-9680-1c6ba97c79cf for instance 15287602-2fd6-4d60-9d26-662b52d6c547 on nch1-master-1 Sep 24 21:16:25.140546 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-98e9588e-0fe1-441d-a204-b2b89893889f req-5af62cce-e333-42df-b3bd-d5091a9edc0e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050326 Sep 24 21:16:25.141491 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2683/5350] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:16:25.164749 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-01099ad4-c6ad-4004-8c2f-00994b327e8b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:25.175759 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-01099ad4-c6ad-4004-8c2f-00994b327e8b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1393 microversion: 2.1 time: 0.284608 Sep 24 21:16:25.179702 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2668/5351] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:24 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1393 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:16:25.578827 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-363e9456-ce62-4b79-b471-c3ca961574b8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:25.582524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-363e9456-ce62-4b79-b471-c3ca961574b8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: d2a62532-3ddd-4eb5-b0c0-3877ff6be556] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:25.594634 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-363e9456-ce62-4b79-b471-c3ca961574b8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:25.595801 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-363e9456-ce62-4b79-b471-c3ca961574b8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:25.597513 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-363e9456-ce62-4b79-b471-c3ca961574b8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:25.600080 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-363e9456-ce62-4b79-b471-c3ca961574b8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:25.603953 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-363e9456-ce62-4b79-b471-c3ca961574b8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:25.605877 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-363e9456-ce62-4b79-b471-c3ca961574b8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:25.914235 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e60a64a3-cefd-40ef-8ba9-fe4f49176260 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:25.915160 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e60a64a3-cefd-40ef-8ba9-fe4f49176260 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] [instance: 55393c6d-70c2-43ad-abbf-fc266238e783] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:25.923604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e60a64a3-cefd-40ef-8ba9-fe4f49176260 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:25.925215 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-363e9456-ce62-4b79-b471-c3ca961574b8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556" status: 200 len: 1462 microversion: 2.1 time: 0.352209 Sep 24 21:16:25.926226 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2684/5352] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:25 2022] GET /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556 => generated 1462 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:25.932601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e892d269-e049-4085-8e19-c0691d61943d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:25.933448 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e892d269-e049-4085-8e19-c0691d61943d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:25.939956 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e60a64a3-cefd-40ef-8ba9-fe4f49176260 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:25.940544 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e60a64a3-cefd-40ef-8ba9-fe4f49176260 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:25.940802 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e892d269-e049-4085-8e19-c0691d61943d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:25.941323 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e60a64a3-cefd-40ef-8ba9-fe4f49176260 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:25.941626 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e892d269-e049-4085-8e19-c0691d61943d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:25.941807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e60a64a3-cefd-40ef-8ba9-fe4f49176260 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:25.942250 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e60a64a3-cefd-40ef-8ba9-fe4f49176260 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:25.942600 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e892d269-e049-4085-8e19-c0691d61943d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:25.943550 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e892d269-e049-4085-8e19-c0691d61943d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:25.944348 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e892d269-e049-4085-8e19-c0691d61943d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:25.945254 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e892d269-e049-4085-8e19-c0691d61943d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:26.051140 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e892d269-e049-4085-8e19-c0691d61943d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:26.067536 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e892d269-e049-4085-8e19-c0691d61943d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:26.071298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e892d269-e049-4085-8e19-c0691d61943d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:26.074070 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e892d269-e049-4085-8e19-c0691d61943d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.146283 Sep 24 21:16:26.075948 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2685/5353] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:25 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:26.145283 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e60a64a3-cefd-40ef-8ba9-fe4f49176260 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b53b6cad57584720aa0ecbe097fe92c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3601e0eb4f654079810627bef64cb0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:26.154122 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e60a64a3-cefd-40ef-8ba9-fe4f49176260 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] 10.222.0.52 "GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783" status: 200 len: 1314 microversion: 2.1 time: 0.244648 Sep 24 21:16:26.154922 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2669/5354] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:25 2022] GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:16:26.202055 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-65929934-dcad-42cf-8dcc-9efe1fefa777 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:26.204155 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-65929934-dcad-42cf-8dcc-9efe1fefa777 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:26.212246 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65929934-dcad-42cf-8dcc-9efe1fefa777 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:26.213084 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65929934-dcad-42cf-8dcc-9efe1fefa777 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:26.213702 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65929934-dcad-42cf-8dcc-9efe1fefa777 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:26.214633 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65929934-dcad-42cf-8dcc-9efe1fefa777 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:26.215171 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65929934-dcad-42cf-8dcc-9efe1fefa777 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:26.215776 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65929934-dcad-42cf-8dcc-9efe1fefa777 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:26.352717 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-a518b388-0c96-45a5-b3c9-660a762af91c req-d399e366-217c-4796-9282-c0e6b6793b61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2a62532-3ddd-4eb5-b0c0-3877ff6be556", "name": "network-vif-plugged", "status": "completed", "tag": "80b60318-7e7e-4426-9677-d4bdda71e38c"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:16:26.362917 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a518b388-0c96-45a5-b3c9-660a762af91c req-d399e366-217c-4796-9282-c0e6b6793b61 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:26.363626 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a518b388-0c96-45a5-b3c9-660a762af91c req-d399e366-217c-4796-9282-c0e6b6793b61 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:26.364385 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a518b388-0c96-45a5-b3c9-660a762af91c req-d399e366-217c-4796-9282-c0e6b6793b61 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:26.380287 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-a518b388-0c96-45a5-b3c9-660a762af91c req-d399e366-217c-4796-9282-c0e6b6793b61 service nova] Creating event network-vif-plugged:80b60318-7e7e-4426-9677-d4bdda71e38c for instance d2a62532-3ddd-4eb5-b0c0-3877ff6be556 on nch2-master-1 Sep 24 21:16:26.386275 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-a518b388-0c96-45a5-b3c9-660a762af91c req-d399e366-217c-4796-9282-c0e6b6793b61 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038954 Sep 24 21:16:26.387501 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2670/5355] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:16:26.451570 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-65929934-dcad-42cf-8dcc-9efe1fefa777 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:26.464309 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-65929934-dcad-42cf-8dcc-9efe1fefa777 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1565 microversion: 2.1 time: 0.266721 Sep 24 21:16:26.465100 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2686/5356] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:26 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1565 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:26.489692 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-840bb538-4f79-4536-b51b-02e188f6c0a4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:26.491225 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-840bb538-4f79-4536-b51b-02e188f6c0a4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:26.499473 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-840bb538-4f79-4536-b51b-02e188f6c0a4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:26.500096 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-840bb538-4f79-4536-b51b-02e188f6c0a4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:26.500618 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-840bb538-4f79-4536-b51b-02e188f6c0a4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:26.501419 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-840bb538-4f79-4536-b51b-02e188f6c0a4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:26.501965 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-840bb538-4f79-4536-b51b-02e188f6c0a4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:26.502474 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-840bb538-4f79-4536-b51b-02e188f6c0a4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:26.676700 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-840bb538-4f79-4536-b51b-02e188f6c0a4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:26.685834 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-840bb538-4f79-4536-b51b-02e188f6c0a4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1565 microversion: 2.1 time: 0.201141 Sep 24 21:16:26.686429 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2671/5357] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:26 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1565 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:26.951966 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-838021a4-50cf-4c46-9ccc-c00f7a16af8c tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:26.953309 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-838021a4-50cf-4c46-9ccc-c00f7a16af8c tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: d2a62532-3ddd-4eb5-b0c0-3877ff6be556] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:26.961483 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-838021a4-50cf-4c46-9ccc-c00f7a16af8c tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:26.961996 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-838021a4-50cf-4c46-9ccc-c00f7a16af8c tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:26.962539 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-838021a4-50cf-4c46-9ccc-c00f7a16af8c tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:26.963519 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-838021a4-50cf-4c46-9ccc-c00f7a16af8c tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:26.964074 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-838021a4-50cf-4c46-9ccc-c00f7a16af8c tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:26.964605 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-838021a4-50cf-4c46-9ccc-c00f7a16af8c tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:27.105814 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1f6c2116-a8fa-45e0-b61d-1a1e9ed2fccc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:27.106527 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1f6c2116-a8fa-45e0-b61d-1a1e9ed2fccc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:27.112009 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-838021a4-50cf-4c46-9ccc-c00f7a16af8c tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556" status: 200 len: 1462 microversion: 2.1 time: 0.163872 Sep 24 21:16:27.112610 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2687/5358] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:26 2022] GET /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556 => generated 1462 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:27.118035 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f6c2116-a8fa-45e0-b61d-1a1e9ed2fccc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:27.118813 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f6c2116-a8fa-45e0-b61d-1a1e9ed2fccc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:27.119428 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f6c2116-a8fa-45e0-b61d-1a1e9ed2fccc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:27.120334 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f6c2116-a8fa-45e0-b61d-1a1e9ed2fccc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:27.120968 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f6c2116-a8fa-45e0-b61d-1a1e9ed2fccc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:27.121404 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f6c2116-a8fa-45e0-b61d-1a1e9ed2fccc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:27.184520 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0f9e2f8b-9a91-4ae3-ae83-d60c23359430 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:27.185710 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0f9e2f8b-9a91-4ae3-ae83-d60c23359430 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] [instance: 55393c6d-70c2-43ad-abbf-fc266238e783] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:27.195351 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f9e2f8b-9a91-4ae3-ae83-d60c23359430 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:27.196620 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f9e2f8b-9a91-4ae3-ae83-d60c23359430 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:27.197390 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f9e2f8b-9a91-4ae3-ae83-d60c23359430 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:27.199095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f9e2f8b-9a91-4ae3-ae83-d60c23359430 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:27.199573 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f9e2f8b-9a91-4ae3-ae83-d60c23359430 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:27.200070 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f9e2f8b-9a91-4ae3-ae83-d60c23359430 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:27.201054 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1f6c2116-a8fa-45e0-b61d-1a1e9ed2fccc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:27.211180 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1f6c2116-a8fa-45e0-b61d-1a1e9ed2fccc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:27.213064 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1f6c2116-a8fa-45e0-b61d-1a1e9ed2fccc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:27.215088 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1f6c2116-a8fa-45e0-b61d-1a1e9ed2fccc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.113511 Sep 24 21:16:27.226521 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2672/5359] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:27 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:16:27.233684 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-27bdf95e-4b04-48c4-8465-88d0e1f28e1d req-9cd2280b-2ad9-4da7-8fe0-a0b388bfbe02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55393c6d-70c2-43ad-abbf-fc266238e783", "tag": "5b8ec8aa-e282-40e1-b730-150ee9dac87d"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:16:27.248350 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-27bdf95e-4b04-48c4-8465-88d0e1f28e1d req-9cd2280b-2ad9-4da7-8fe0-a0b388bfbe02 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:27.248982 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-27bdf95e-4b04-48c4-8465-88d0e1f28e1d req-9cd2280b-2ad9-4da7-8fe0-a0b388bfbe02 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:27.249422 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-27bdf95e-4b04-48c4-8465-88d0e1f28e1d req-9cd2280b-2ad9-4da7-8fe0-a0b388bfbe02 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:27.272749 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-27bdf95e-4b04-48c4-8465-88d0e1f28e1d req-9cd2280b-2ad9-4da7-8fe0-a0b388bfbe02 service nova] Creating event network-changed:5b8ec8aa-e282-40e1-b730-150ee9dac87d for instance 55393c6d-70c2-43ad-abbf-fc266238e783 on nch1-master-1 Sep 24 21:16:27.279834 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-27bdf95e-4b04-48c4-8465-88d0e1f28e1d req-9cd2280b-2ad9-4da7-8fe0-a0b388bfbe02 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059468 Sep 24 21:16:27.281119 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2673/5360] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:16:27.371447 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0f9e2f8b-9a91-4ae3-ae83-d60c23359430 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b53b6cad57584720aa0ecbe097fe92c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3601e0eb4f654079810627bef64cb0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:27.380478 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0f9e2f8b-9a91-4ae3-ae83-d60c23359430 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] 10.222.0.52 "GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783" status: 200 len: 1314 microversion: 2.1 time: 0.203442 Sep 24 21:16:27.383968 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2688/5361] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:27 2022] GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:28.138533 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-79f73e87-9c63-4c4d-b633-e32b8d6b8ca7 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:28.139832 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-79f73e87-9c63-4c4d-b633-e32b8d6b8ca7 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: d2a62532-3ddd-4eb5-b0c0-3877ff6be556] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:28.146685 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-79f73e87-9c63-4c4d-b633-e32b8d6b8ca7 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:28.147857 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-79f73e87-9c63-4c4d-b633-e32b8d6b8ca7 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:28.148508 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-79f73e87-9c63-4c4d-b633-e32b8d6b8ca7 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:28.149222 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-79f73e87-9c63-4c4d-b633-e32b8d6b8ca7 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:28.149848 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-79f73e87-9c63-4c4d-b633-e32b8d6b8ca7 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:28.150432 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-79f73e87-9c63-4c4d-b633-e32b8d6b8ca7 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:28.242277 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5120b347-a01d-453e-ade1-bbec42e74282 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:28.242929 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5120b347-a01d-453e-ade1-bbec42e74282 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:28.250826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5120b347-a01d-453e-ade1-bbec42e74282 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:28.251233 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5120b347-a01d-453e-ade1-bbec42e74282 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:28.260056 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5120b347-a01d-453e-ade1-bbec42e74282 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:28.261601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5120b347-a01d-453e-ade1-bbec42e74282 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:28.262670 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5120b347-a01d-453e-ade1-bbec42e74282 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:28.263228 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5120b347-a01d-453e-ade1-bbec42e74282 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:28.405827 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5120b347-a01d-453e-ade1-bbec42e74282 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:28.416126 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5120b347-a01d-453e-ade1-bbec42e74282 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:28.418106 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5120b347-a01d-453e-ade1-bbec42e74282 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:28.419470 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5120b347-a01d-453e-ade1-bbec42e74282 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.182389 Sep 24 21:16:28.441406 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-79f73e87-9c63-4c4d-b633-e32b8d6b8ca7 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556" status: 200 len: 1646 microversion: 2.1 time: 0.304510 Sep 24 21:16:28.442332 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2674/5362] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:28 2022] GET /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556 => generated 1646 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:28.443640 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2689/5363] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:28 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:28.462667 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4e544cdb-f97f-4ee4-b9e9-f150f349aa82 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:28.463442 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4e544cdb-f97f-4ee4-b9e9-f150f349aa82 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] [instance: 55393c6d-70c2-43ad-abbf-fc266238e783] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:28.465407 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d24b8170-7aaf-4648-92e3-a9f5202b125a tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:28.467419 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d24b8170-7aaf-4648-92e3-a9f5202b125a tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: d2a62532-3ddd-4eb5-b0c0-3877ff6be556] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:28.470008 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e544cdb-f97f-4ee4-b9e9-f150f349aa82 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:28.470605 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e544cdb-f97f-4ee4-b9e9-f150f349aa82 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:28.471055 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e544cdb-f97f-4ee4-b9e9-f150f349aa82 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:28.471912 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e544cdb-f97f-4ee4-b9e9-f150f349aa82 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:28.472361 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e544cdb-f97f-4ee4-b9e9-f150f349aa82 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:28.472930 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e544cdb-f97f-4ee4-b9e9-f150f349aa82 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:28.479539 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:16:28.487283 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d24b8170-7aaf-4648-92e3-a9f5202b125a tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:28.491368 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d24b8170-7aaf-4648-92e3-a9f5202b125a tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:28.494141 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d24b8170-7aaf-4648-92e3-a9f5202b125a tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:28.495854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d24b8170-7aaf-4648-92e3-a9f5202b125a tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:28.496882 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d24b8170-7aaf-4648-92e3-a9f5202b125a tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:28.498894 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d24b8170-7aaf-4648-92e3-a9f5202b125a tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:28.801772 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4e544cdb-f97f-4ee4-b9e9-f150f349aa82 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b53b6cad57584720aa0ecbe097fe92c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3601e0eb4f654079810627bef64cb0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:28.812623 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4e544cdb-f97f-4ee4-b9e9-f150f349aa82 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] 10.222.0.52 "GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783" status: 200 len: 1314 microversion: 2.1 time: 0.368257 Sep 24 21:16:28.822529 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2675/5364] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:28 2022] GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783 => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:28.822733 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d24b8170-7aaf-4648-92e3-a9f5202b125a tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556" status: 200 len: 1646 microversion: 2.1 time: 0.362620 Sep 24 21:16:28.823172 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2690/5365] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:28 2022] GET /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556 => generated 1646 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:28.828283 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-db95014d-738b-4f29-95ee-968ac5b49918 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:28.829350 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-db95014d-738b-4f29-95ee-968ac5b49918 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:28.840672 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-db95014d-738b-4f29-95ee-968ac5b49918 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:28.841456 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-db95014d-738b-4f29-95ee-968ac5b49918 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:28.842073 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-db95014d-738b-4f29-95ee-968ac5b49918 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:28.843936 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-db95014d-738b-4f29-95ee-968ac5b49918 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:28.846140 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-360ed2b9-f8da-4d84-9679-1d316e40dcf7 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:28.846654 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-db95014d-738b-4f29-95ee-968ac5b49918 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:28.847014 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-360ed2b9-f8da-4d84-9679-1d316e40dcf7 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: d2a62532-3ddd-4eb5-b0c0-3877ff6be556] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:28.847444 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-db95014d-738b-4f29-95ee-968ac5b49918 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:28.853904 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-360ed2b9-f8da-4d84-9679-1d316e40dcf7 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:28.854583 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-360ed2b9-f8da-4d84-9679-1d316e40dcf7 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:28.856560 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-360ed2b9-f8da-4d84-9679-1d316e40dcf7 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:28.857428 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-360ed2b9-f8da-4d84-9679-1d316e40dcf7 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:28.858015 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-360ed2b9-f8da-4d84-9679-1d316e40dcf7 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:28.858610 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-360ed2b9-f8da-4d84-9679-1d316e40dcf7 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:29.077441 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-db95014d-738b-4f29-95ee-968ac5b49918 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:29.082138 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:16:29.090109 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-360ed2b9-f8da-4d84-9679-1d316e40dcf7 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556" status: 200 len: 1646 microversion: 2.1 time: 0.248876 Sep 24 21:16:29.092214 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-db95014d-738b-4f29-95ee-968ac5b49918 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1565 microversion: 2.1 time: 0.277045 Sep 24 21:16:29.103218 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2691/5366] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:28 2022] GET /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556 => generated 1646 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:16:29.111188 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2676/5367] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:28 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1565 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:29.228035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5803a6cc-323e-4f4e-af6a-128490403470 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-646462545", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "availability_zone": "nova:nch1-master-1", "networks": [{"uuid": "e32880bc-cd12-4305-9754-1a3ea4c1b444"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:16:29.299082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-5803a6cc-323e-4f4e-af6a-128490403470 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] validate_networks() for [('e32880bc-cd12-4305-9754-1a3ea4c1b444', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:16:29.300320 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-045a5960-64b4-452f-9722-d0a69e1d3d58 req-eb5be7e5-2937-4dfe-b685-13dfd3b9b9cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97863e58-47a8-44be-a268-26807a10f037", "tag": "72dd520b-415e-4703-95f2-fa48dc8a2c00"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:16:29.312722 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-045a5960-64b4-452f-9722-d0a69e1d3d58 req-eb5be7e5-2937-4dfe-b685-13dfd3b9b9cf service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:29.313356 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-045a5960-64b4-452f-9722-d0a69e1d3d58 req-eb5be7e5-2937-4dfe-b685-13dfd3b9b9cf service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:29.314076 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-045a5960-64b4-452f-9722-d0a69e1d3d58 req-eb5be7e5-2937-4dfe-b685-13dfd3b9b9cf service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:29.327683 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-045a5960-64b4-452f-9722-d0a69e1d3d58 req-eb5be7e5-2937-4dfe-b685-13dfd3b9b9cf service nova] Creating event network-changed:72dd520b-415e-4703-95f2-fa48dc8a2c00 for instance 97863e58-47a8-44be-a268-26807a10f037 on nch2-master-1 Sep 24 21:16:29.339422 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-045a5960-64b4-452f-9722-d0a69e1d3d58 req-eb5be7e5-2937-4dfe-b685-13dfd3b9b9cf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042310 Sep 24 21:16:29.340567 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2677/5368] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:16:29.455653 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1cb008f2-708d-40e9-8e28-8d1e68fa8dbc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:29.457163 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1cb008f2-708d-40e9-8e28-8d1e68fa8dbc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:29.465001 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:16:29.467772 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1cb008f2-708d-40e9-8e28-8d1e68fa8dbc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:29.468900 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1cb008f2-708d-40e9-8e28-8d1e68fa8dbc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:29.470820 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1cb008f2-708d-40e9-8e28-8d1e68fa8dbc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:29.471871 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1cb008f2-708d-40e9-8e28-8d1e68fa8dbc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:29.473124 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1cb008f2-708d-40e9-8e28-8d1e68fa8dbc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:29.473839 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1cb008f2-708d-40e9-8e28-8d1e68fa8dbc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:29.581464 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1cb008f2-708d-40e9-8e28-8d1e68fa8dbc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:29.601621 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1cb008f2-708d-40e9-8e28-8d1e68fa8dbc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:29.604086 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1cb008f2-708d-40e9-8e28-8d1e68fa8dbc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:29.606174 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1cb008f2-708d-40e9-8e28-8d1e68fa8dbc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.156327 Sep 24 21:16:29.607933 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2678/5369] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:29 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:29.628717 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=4 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:16:29.659142 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=14 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:16:29.822111 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-5803a6cc-323e-4f4e-af6a-128490403470 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:16:29.822586 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-5803a6cc-323e-4f4e-af6a-128490403470 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:16:29.823289 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-5803a6cc-323e-4f4e-af6a-128490403470 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:16:29.823870 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-5803a6cc-323e-4f4e-af6a-128490403470 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:16:29.824769 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-5803a6cc-323e-4f4e-af6a-128490403470 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:16:29.837201 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3956fa1d-0ccb-4509-8cd3-44545512f0c6 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:29.837835 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3956fa1d-0ccb-4509-8cd3-44545512f0c6 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] [instance: 55393c6d-70c2-43ad-abbf-fc266238e783] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:29.847058 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3956fa1d-0ccb-4509-8cd3-44545512f0c6 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:29.847578 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3956fa1d-0ccb-4509-8cd3-44545512f0c6 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:29.848029 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3956fa1d-0ccb-4509-8cd3-44545512f0c6 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:29.851382 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5803a6cc-323e-4f4e-af6a-128490403470 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:29.851878 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5803a6cc-323e-4f4e-af6a-128490403470 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:29.852326 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5803a6cc-323e-4f4e-af6a-128490403470 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:29.853686 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3956fa1d-0ccb-4509-8cd3-44545512f0c6 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:29.854168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3956fa1d-0ccb-4509-8cd3-44545512f0c6 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:29.854641 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3956fa1d-0ccb-4509-8cd3-44545512f0c6 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:29.858634 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5803a6cc-323e-4f4e-af6a-128490403470 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:29.859267 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5803a6cc-323e-4f4e-af6a-128490403470 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:29.859726 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5803a6cc-323e-4f4e-af6a-128490403470 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:29.877268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:16:29.909489 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-5803a6cc-323e-4f4e-af6a-128490403470 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Getting quotas for project 0c0033b625ca4995bff138c485673fd8. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:16:29.919174 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-5803a6cc-323e-4f4e-af6a-128490403470 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Getting quotas for user fc712fcf0f814a59bb52e16685ab1c9b and project 0c0033b625ca4995bff138c485673fd8. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:16:29.947701 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=10 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:16:29.950583 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5803a6cc-323e-4f4e-af6a-128490403470 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:16:29.954986 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5803a6cc-323e-4f4e-af6a-128490403470 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: 2d50dc12-3ebf-49e3-8337-b9d87e8c31a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:16:30.060549 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5803a6cc-323e-4f4e-af6a-128490403470 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.838382 Sep 24 21:16:30.062547 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2692/5370] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:16:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:16:30.076786 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3717d521-59d3-4e36-8331-a521be09e34b tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:30.077898 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3717d521-59d3-4e36-8331-a521be09e34b tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: 2d50dc12-3ebf-49e3-8337-b9d87e8c31a0] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:30.165362 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3956fa1d-0ccb-4509-8cd3-44545512f0c6 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b53b6cad57584720aa0ecbe097fe92c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3601e0eb4f654079810627bef64cb0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:30.166248 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3717d521-59d3-4e36-8331-a521be09e34b tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2d50dc12-3ebf-49e3-8337-b9d87e8c31a0" status: 200 len: 1328 microversion: 2.1 time: 0.094646 Sep 24 21:16:30.167546 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2693/5371] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:30 2022] GET /compute/v2.1/servers/2d50dc12-3ebf-49e3-8337-b9d87e8c31a0 => generated 1328 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:30.173473 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3956fa1d-0ccb-4509-8cd3-44545512f0c6 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] 10.222.0.52 "GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783" status: 200 len: 1314 microversion: 2.1 time: 0.340229 Sep 24 21:16:30.175107 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2679/5372] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:29 2022] GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:16:30.634892 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-af48c04b-4fcb-4701-86b8-841fbb0f371f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:30.638660 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-af48c04b-4fcb-4701-86b8-841fbb0f371f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:30.647178 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af48c04b-4fcb-4701-86b8-841fbb0f371f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:30.647990 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af48c04b-4fcb-4701-86b8-841fbb0f371f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:30.648771 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af48c04b-4fcb-4701-86b8-841fbb0f371f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:30.649741 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af48c04b-4fcb-4701-86b8-841fbb0f371f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:30.650409 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af48c04b-4fcb-4701-86b8-841fbb0f371f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:30.651342 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af48c04b-4fcb-4701-86b8-841fbb0f371f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:30.733802 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-af48c04b-4fcb-4701-86b8-841fbb0f371f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:30.744741 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-af48c04b-4fcb-4701-86b8-841fbb0f371f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:30.746586 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-af48c04b-4fcb-4701-86b8-841fbb0f371f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:30.747842 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-af48c04b-4fcb-4701-86b8-841fbb0f371f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.118144 Sep 24 21:16:30.748416 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2694/5373] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:30 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:31.194360 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5e5f1898-1fc6-450c-bf62-2ade9308dc9c tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:31.195584 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5e5f1898-1fc6-450c-bf62-2ade9308dc9c tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: 2d50dc12-3ebf-49e3-8337-b9d87e8c31a0] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:31.203014 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6b671be0-40f2-4acc-993f-d1c376be418d tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:31.203760 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e5f1898-1fc6-450c-bf62-2ade9308dc9c tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:31.204434 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e5f1898-1fc6-450c-bf62-2ade9308dc9c tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:31.205045 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e5f1898-1fc6-450c-bf62-2ade9308dc9c tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:31.205770 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e5f1898-1fc6-450c-bf62-2ade9308dc9c tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:31.206235 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e5f1898-1fc6-450c-bf62-2ade9308dc9c tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:31.206362 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6b671be0-40f2-4acc-993f-d1c376be418d tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] [instance: 55393c6d-70c2-43ad-abbf-fc266238e783] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:31.206835 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e5f1898-1fc6-450c-bf62-2ade9308dc9c tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:31.233228 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b671be0-40f2-4acc-993f-d1c376be418d tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:31.234524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b671be0-40f2-4acc-993f-d1c376be418d tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:31.236939 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b671be0-40f2-4acc-993f-d1c376be418d tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:31.241982 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b671be0-40f2-4acc-993f-d1c376be418d tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:31.242592 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b671be0-40f2-4acc-993f-d1c376be418d tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:31.243552 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6b671be0-40f2-4acc-993f-d1c376be418d tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:31.285912 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5e5f1898-1fc6-450c-bf62-2ade9308dc9c tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2d50dc12-3ebf-49e3-8337-b9d87e8c31a0" status: 200 len: 1415 microversion: 2.1 time: 0.096140 Sep 24 21:16:31.287795 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2680/5374] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:31 2022] GET /compute/v2.1/servers/2d50dc12-3ebf-49e3-8337-b9d87e8c31a0 => generated 1415 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:31.292669 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-87439bcc-4628-4841-9a47-b335bceb0443 req-e54995d3-ab80-4aff-a973-3ce3977017ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55393c6d-70c2-43ad-abbf-fc266238e783", "name": "network-vif-plugged", "status": "completed", "tag": "5b8ec8aa-e282-40e1-b730-150ee9dac87d"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:16:31.304170 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-87439bcc-4628-4841-9a47-b335bceb0443 req-e54995d3-ab80-4aff-a973-3ce3977017ec service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:31.305030 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-87439bcc-4628-4841-9a47-b335bceb0443 req-e54995d3-ab80-4aff-a973-3ce3977017ec service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:31.305632 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-87439bcc-4628-4841-9a47-b335bceb0443 req-e54995d3-ab80-4aff-a973-3ce3977017ec service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:31.319142 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-87439bcc-4628-4841-9a47-b335bceb0443 req-e54995d3-ab80-4aff-a973-3ce3977017ec service nova] Creating event network-vif-plugged:5b8ec8aa-e282-40e1-b730-150ee9dac87d for instance 55393c6d-70c2-43ad-abbf-fc266238e783 on nch1-master-1 Sep 24 21:16:31.326991 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-87439bcc-4628-4841-9a47-b335bceb0443 req-e54995d3-ab80-4aff-a973-3ce3977017ec service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037652 Sep 24 21:16:31.328752 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2681/5375] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:16:31.561091 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6b671be0-40f2-4acc-993f-d1c376be418d tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b53b6cad57584720aa0ecbe097fe92c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3601e0eb4f654079810627bef64cb0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:31.570187 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6b671be0-40f2-4acc-993f-d1c376be418d tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] 10.222.0.52 "GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783" status: 200 len: 1314 microversion: 2.1 time: 0.375375 Sep 24 21:16:31.570836 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2695/5376] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:31 2022] GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783 => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:31.773678 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-176ceb53-fa9e-4349-ac79-e905eb1bd0d5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:31.774598 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-176ceb53-fa9e-4349-ac79-e905eb1bd0d5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:31.781026 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-176ceb53-fa9e-4349-ac79-e905eb1bd0d5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:31.781518 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-176ceb53-fa9e-4349-ac79-e905eb1bd0d5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:31.781965 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-176ceb53-fa9e-4349-ac79-e905eb1bd0d5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:31.782739 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-176ceb53-fa9e-4349-ac79-e905eb1bd0d5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:31.783209 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-176ceb53-fa9e-4349-ac79-e905eb1bd0d5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:31.783675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-176ceb53-fa9e-4349-ac79-e905eb1bd0d5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:31.860719 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-176ceb53-fa9e-4349-ac79-e905eb1bd0d5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:31.872298 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-176ceb53-fa9e-4349-ac79-e905eb1bd0d5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:31.874178 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-176ceb53-fa9e-4349-ac79-e905eb1bd0d5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:31.875499 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-176ceb53-fa9e-4349-ac79-e905eb1bd0d5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.106407 Sep 24 21:16:31.876376 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2682/5377] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:31 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:32.310764 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-677dc578-dbb9-4cb0-822b-a15a969ad334 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:32.312134 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-677dc578-dbb9-4cb0-822b-a15a969ad334 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: 2d50dc12-3ebf-49e3-8337-b9d87e8c31a0] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:32.323593 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-677dc578-dbb9-4cb0-822b-a15a969ad334 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:32.324489 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-677dc578-dbb9-4cb0-822b-a15a969ad334 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:32.325353 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-677dc578-dbb9-4cb0-822b-a15a969ad334 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:32.326394 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-677dc578-dbb9-4cb0-822b-a15a969ad334 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:32.327052 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-677dc578-dbb9-4cb0-822b-a15a969ad334 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:32.327917 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-677dc578-dbb9-4cb0-822b-a15a969ad334 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:32.584079 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-677dc578-dbb9-4cb0-822b-a15a969ad334 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2d50dc12-3ebf-49e3-8337-b9d87e8c31a0" status: 200 len: 1463 microversion: 2.1 time: 0.277915 Sep 24 21:16:32.598557 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2696/5378] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:32 2022] GET /compute/v2.1/servers/2d50dc12-3ebf-49e3-8337-b9d87e8c31a0 => generated 1463 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:32.598978 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-991eabdc-ff51-49fa-b1f0-dda32a000d35 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:32.598978 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-991eabdc-ff51-49fa-b1f0-dda32a000d35 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] [instance: 55393c6d-70c2-43ad-abbf-fc266238e783] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:32.602194 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-991eabdc-ff51-49fa-b1f0-dda32a000d35 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:32.602983 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-991eabdc-ff51-49fa-b1f0-dda32a000d35 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:32.603751 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-991eabdc-ff51-49fa-b1f0-dda32a000d35 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:32.604587 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-991eabdc-ff51-49fa-b1f0-dda32a000d35 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:32.605362 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-991eabdc-ff51-49fa-b1f0-dda32a000d35 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:32.605719 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-991eabdc-ff51-49fa-b1f0-dda32a000d35 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:32.902362 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b554d0ff-2a61-4e55-ad09-382f37642ded tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:32.903192 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b554d0ff-2a61-4e55-ad09-382f37642ded tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:32.910272 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b554d0ff-2a61-4e55-ad09-382f37642ded tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:32.910816 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b554d0ff-2a61-4e55-ad09-382f37642ded tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:32.911356 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b554d0ff-2a61-4e55-ad09-382f37642ded tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:32.912449 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b554d0ff-2a61-4e55-ad09-382f37642ded tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:32.912917 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b554d0ff-2a61-4e55-ad09-382f37642ded tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:32.913349 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b554d0ff-2a61-4e55-ad09-382f37642ded tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:32.925302 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-991eabdc-ff51-49fa-b1f0-dda32a000d35 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b53b6cad57584720aa0ecbe097fe92c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3601e0eb4f654079810627bef64cb0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:32.935466 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-991eabdc-ff51-49fa-b1f0-dda32a000d35 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] 10.222.0.52 "GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783" status: 200 len: 1314 microversion: 2.1 time: 0.346056 Sep 24 21:16:32.938579 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2683/5379] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:32 2022] GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783 => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:33.032096 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b554d0ff-2a61-4e55-ad09-382f37642ded tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:33.043814 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b554d0ff-2a61-4e55-ad09-382f37642ded tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:33.045593 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b554d0ff-2a61-4e55-ad09-382f37642ded tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:33.046894 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b554d0ff-2a61-4e55-ad09-382f37642ded tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.148604 Sep 24 21:16:33.047456 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2697/5380] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:32 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:16:33.612158 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2231ef67-9239-4f43-b447-fd1a2f811433 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:33.612936 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2231ef67-9239-4f43-b447-fd1a2f811433 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: 2d50dc12-3ebf-49e3-8337-b9d87e8c31a0] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:33.621621 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2231ef67-9239-4f43-b447-fd1a2f811433 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:33.622140 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2231ef67-9239-4f43-b447-fd1a2f811433 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:33.622796 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2231ef67-9239-4f43-b447-fd1a2f811433 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:33.623539 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2231ef67-9239-4f43-b447-fd1a2f811433 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:33.623999 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2231ef67-9239-4f43-b447-fd1a2f811433 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:33.624429 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2231ef67-9239-4f43-b447-fd1a2f811433 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:33.711720 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-84b1e691-8b19-4f5b-9e0b-cc96f51f68cc req-f8835cd1-70f6-44ec-b5e0-37d714240203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d50dc12-3ebf-49e3-8337-b9d87e8c31a0", "tag": "66ba2140-7f53-462e-b4cd-5c0924720b4a"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:16:33.732353 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-84b1e691-8b19-4f5b-9e0b-cc96f51f68cc req-f8835cd1-70f6-44ec-b5e0-37d714240203 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:33.733204 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-84b1e691-8b19-4f5b-9e0b-cc96f51f68cc req-f8835cd1-70f6-44ec-b5e0-37d714240203 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:33.734390 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-84b1e691-8b19-4f5b-9e0b-cc96f51f68cc req-f8835cd1-70f6-44ec-b5e0-37d714240203 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:33.747549 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-84b1e691-8b19-4f5b-9e0b-cc96f51f68cc req-f8835cd1-70f6-44ec-b5e0-37d714240203 service nova] Creating event network-changed:66ba2140-7f53-462e-b4cd-5c0924720b4a for instance 2d50dc12-3ebf-49e3-8337-b9d87e8c31a0 on nch1-master-1 Sep 24 21:16:33.755757 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-84b1e691-8b19-4f5b-9e0b-cc96f51f68cc req-f8835cd1-70f6-44ec-b5e0-37d714240203 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047455 Sep 24 21:16:33.756793 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2698/5381] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:16:33.926030 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2231ef67-9239-4f43-b447-fd1a2f811433 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2d50dc12-3ebf-49e3-8337-b9d87e8c31a0" status: 200 len: 1463 microversion: 2.1 time: 0.317520 Sep 24 21:16:33.927267 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2684/5382] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:33 2022] GET /compute/v2.1/servers/2d50dc12-3ebf-49e3-8337-b9d87e8c31a0 => generated 1463 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:33.964999 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4c866bdc-8a2c-41da-a232-4ae0f890c2e6 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:33.965902 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4c866bdc-8a2c-41da-a232-4ae0f890c2e6 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] [instance: 55393c6d-70c2-43ad-abbf-fc266238e783] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:33.975371 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4c866bdc-8a2c-41da-a232-4ae0f890c2e6 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:33.975908 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4c866bdc-8a2c-41da-a232-4ae0f890c2e6 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:33.976357 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4c866bdc-8a2c-41da-a232-4ae0f890c2e6 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:33.977106 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4c866bdc-8a2c-41da-a232-4ae0f890c2e6 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:33.977747 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4c866bdc-8a2c-41da-a232-4ae0f890c2e6 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:33.978182 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4c866bdc-8a2c-41da-a232-4ae0f890c2e6 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:34.079054 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0d0290a0-5ab7-41ff-b5a6-f4154f09e241 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:34.080041 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0d0290a0-5ab7-41ff-b5a6-f4154f09e241 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:34.086953 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d0290a0-5ab7-41ff-b5a6-f4154f09e241 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:34.087695 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d0290a0-5ab7-41ff-b5a6-f4154f09e241 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:34.088171 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d0290a0-5ab7-41ff-b5a6-f4154f09e241 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:34.088859 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d0290a0-5ab7-41ff-b5a6-f4154f09e241 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:34.089326 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d0290a0-5ab7-41ff-b5a6-f4154f09e241 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:34.089764 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0d0290a0-5ab7-41ff-b5a6-f4154f09e241 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:34.183942 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0d0290a0-5ab7-41ff-b5a6-f4154f09e241 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:34.193456 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0d0290a0-5ab7-41ff-b5a6-f4154f09e241 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:34.195316 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0d0290a0-5ab7-41ff-b5a6-f4154f09e241 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:34.196679 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0d0290a0-5ab7-41ff-b5a6-f4154f09e241 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.121617 Sep 24 21:16:34.197420 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2685/5383] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:34 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:16:34.228133 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4c866bdc-8a2c-41da-a232-4ae0f890c2e6 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b53b6cad57584720aa0ecbe097fe92c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3601e0eb4f654079810627bef64cb0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:34.237829 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4c866bdc-8a2c-41da-a232-4ae0f890c2e6 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] 10.222.0.52 "GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783" status: 200 len: 1502 microversion: 2.1 time: 0.279071 Sep 24 21:16:34.238710 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2699/5384] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:33 2022] GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783 => generated 1502 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:34.261704 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9af22a1d-ab6c-4f33-9e1d-f4d44818840a tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:34.262435 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9af22a1d-ab6c-4f33-9e1d-f4d44818840a tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] [instance: 55393c6d-70c2-43ad-abbf-fc266238e783] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:34.269878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9af22a1d-ab6c-4f33-9e1d-f4d44818840a tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:34.270380 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9af22a1d-ab6c-4f33-9e1d-f4d44818840a tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:34.271072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9af22a1d-ab6c-4f33-9e1d-f4d44818840a tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:34.271958 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9af22a1d-ab6c-4f33-9e1d-f4d44818840a tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:34.272423 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9af22a1d-ab6c-4f33-9e1d-f4d44818840a tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:34.272924 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9af22a1d-ab6c-4f33-9e1d-f4d44818840a tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:34.438288 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9af22a1d-ab6c-4f33-9e1d-f4d44818840a tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b53b6cad57584720aa0ecbe097fe92c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3601e0eb4f654079810627bef64cb0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:34.446882 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9af22a1d-ab6c-4f33-9e1d-f4d44818840a tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] 10.222.0.52 "GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783" status: 200 len: 1502 microversion: 2.1 time: 0.189631 Sep 24 21:16:34.447701 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2686/5385] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:34 2022] GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783 => generated 1502 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:34.469870 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-41acfe1e-7b46-4ff2-965b-af2d1a2a3c16 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:16:34.470412 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-41acfe1e-7b46-4ff2-965b-af2d1a2a3c16 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] [instance: 55393c6d-70c2-43ad-abbf-fc266238e783] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:34.476927 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-41acfe1e-7b46-4ff2-965b-af2d1a2a3c16 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:34.477419 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-41acfe1e-7b46-4ff2-965b-af2d1a2a3c16 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:34.477865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-41acfe1e-7b46-4ff2-965b-af2d1a2a3c16 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:34.478611 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-41acfe1e-7b46-4ff2-965b-af2d1a2a3c16 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:34.479073 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-41acfe1e-7b46-4ff2-965b-af2d1a2a3c16 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:34.479504 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-41acfe1e-7b46-4ff2-965b-af2d1a2a3c16 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:34.503661 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-41acfe1e-7b46-4ff2-965b-af2d1a2a3c16 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lazy-loading 'flavor' on Instance uuid 55393c6d-70c2-43ad-abbf-fc266238e783 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:16:34.575442 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-41acfe1e-7b46-4ff2-965b-af2d1a2a3c16 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] 10.222.0.52 "POST /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783/action" status: 202 len: 0 microversion: 2.1 time: 0.109255 Sep 24 21:16:34.579194 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2700/5386] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:16:34 2022] POST /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:16:34.584858 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-20e41a72-58a5-4e84-b69a-a972ed440a51 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:34.585551 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-20e41a72-58a5-4e84-b69a-a972ed440a51 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] [instance: 55393c6d-70c2-43ad-abbf-fc266238e783] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:34.592264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-20e41a72-58a5-4e84-b69a-a972ed440a51 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:34.592809 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-20e41a72-58a5-4e84-b69a-a972ed440a51 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:34.593339 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-20e41a72-58a5-4e84-b69a-a972ed440a51 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:34.594130 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-20e41a72-58a5-4e84-b69a-a972ed440a51 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:34.594735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-20e41a72-58a5-4e84-b69a-a972ed440a51 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:34.595335 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-20e41a72-58a5-4e84-b69a-a972ed440a51 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:34.751251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-20e41a72-58a5-4e84-b69a-a972ed440a51 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b53b6cad57584720aa0ecbe097fe92c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3601e0eb4f654079810627bef64cb0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:34.763623 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-20e41a72-58a5-4e84-b69a-a972ed440a51 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] 10.222.0.52 "GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783" status: 200 len: 1510 microversion: 2.1 time: 0.183105 Sep 24 21:16:34.764403 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2687/5387] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:34 2022] GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783 => generated 1510 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:16:34.951257 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4fee8bfc-cce4-4937-bc45-e58ec7e5637c tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:34.952232 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4fee8bfc-cce4-4937-bc45-e58ec7e5637c tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: 2d50dc12-3ebf-49e3-8337-b9d87e8c31a0] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:34.959330 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4fee8bfc-cce4-4937-bc45-e58ec7e5637c tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:34.959941 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4fee8bfc-cce4-4937-bc45-e58ec7e5637c tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:34.960490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4fee8bfc-cce4-4937-bc45-e58ec7e5637c tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:34.961387 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4fee8bfc-cce4-4937-bc45-e58ec7e5637c tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:34.962026 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4fee8bfc-cce4-4937-bc45-e58ec7e5637c tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:34.962710 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4fee8bfc-cce4-4937-bc45-e58ec7e5637c tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:35.096706 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4fee8bfc-cce4-4937-bc45-e58ec7e5637c tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2d50dc12-3ebf-49e3-8337-b9d87e8c31a0" status: 200 len: 1463 microversion: 2.1 time: 0.151066 Sep 24 21:16:35.097286 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2701/5388] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:34 2022] GET /compute/v2.1/servers/2d50dc12-3ebf-49e3-8337-b9d87e8c31a0 => generated 1463 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:35.224880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-06d1a631-c5b3-435b-8877-416c5aaee0dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:35.225515 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-06d1a631-c5b3-435b-8877-416c5aaee0dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:35.232201 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06d1a631-c5b3-435b-8877-416c5aaee0dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:35.232621 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06d1a631-c5b3-435b-8877-416c5aaee0dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:35.233071 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06d1a631-c5b3-435b-8877-416c5aaee0dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:35.233788 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06d1a631-c5b3-435b-8877-416c5aaee0dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:35.234251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06d1a631-c5b3-435b-8877-416c5aaee0dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:35.234727 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06d1a631-c5b3-435b-8877-416c5aaee0dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:35.302141 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-06d1a631-c5b3-435b-8877-416c5aaee0dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:35.311166 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-06d1a631-c5b3-435b-8877-416c5aaee0dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:35.312820 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-06d1a631-c5b3-435b-8877-416c5aaee0dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:35.314057 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-06d1a631-c5b3-435b-8877-416c5aaee0dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.093414 Sep 24 21:16:35.314738 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2688/5389] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:35 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:35.790622 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9093fbdd-8d9c-4df1-a56a-d55aba5d028e tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:35.791272 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9093fbdd-8d9c-4df1-a56a-d55aba5d028e tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] [instance: 55393c6d-70c2-43ad-abbf-fc266238e783] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:35.797388 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9093fbdd-8d9c-4df1-a56a-d55aba5d028e tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:35.797877 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9093fbdd-8d9c-4df1-a56a-d55aba5d028e tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:35.798534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9093fbdd-8d9c-4df1-a56a-d55aba5d028e tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:35.799247 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9093fbdd-8d9c-4df1-a56a-d55aba5d028e tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:35.799711 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9093fbdd-8d9c-4df1-a56a-d55aba5d028e tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:35.800652 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9093fbdd-8d9c-4df1-a56a-d55aba5d028e tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:35.940241 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9093fbdd-8d9c-4df1-a56a-d55aba5d028e tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b53b6cad57584720aa0ecbe097fe92c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3601e0eb4f654079810627bef64cb0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:35.950223 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9093fbdd-8d9c-4df1-a56a-d55aba5d028e tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] 10.222.0.52 "GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783" status: 200 len: 1510 microversion: 2.1 time: 0.163938 Sep 24 21:16:35.953744 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2702/5390] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:35 2022] GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783 => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:36.119987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3d53f451-a5f2-481a-8ede-d31be01b12c1 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:36.120617 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3d53f451-a5f2-481a-8ede-d31be01b12c1 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: 2d50dc12-3ebf-49e3-8337-b9d87e8c31a0] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:36.127405 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d53f451-a5f2-481a-8ede-d31be01b12c1 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:36.127897 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d53f451-a5f2-481a-8ede-d31be01b12c1 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:36.132099 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d53f451-a5f2-481a-8ede-d31be01b12c1 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:36.132853 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d53f451-a5f2-481a-8ede-d31be01b12c1 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:36.133333 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d53f451-a5f2-481a-8ede-d31be01b12c1 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:36.133774 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d53f451-a5f2-481a-8ede-d31be01b12c1 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:36.276386 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3d53f451-a5f2-481a-8ede-d31be01b12c1 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2d50dc12-3ebf-49e3-8337-b9d87e8c31a0" status: 200 len: 1463 microversion: 2.1 time: 0.159965 Sep 24 21:16:36.276970 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2689/5391] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:36 2022] GET /compute/v2.1/servers/2d50dc12-3ebf-49e3-8337-b9d87e8c31a0 => generated 1463 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:36.340052 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-210914cf-f0a1-4745-97dc-0faccf4d8e78 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:36.340797 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-210914cf-f0a1-4745-97dc-0faccf4d8e78 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:36.347533 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-210914cf-f0a1-4745-97dc-0faccf4d8e78 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:36.348023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-210914cf-f0a1-4745-97dc-0faccf4d8e78 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:36.348461 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-210914cf-f0a1-4745-97dc-0faccf4d8e78 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:36.349188 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-210914cf-f0a1-4745-97dc-0faccf4d8e78 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:36.349654 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-210914cf-f0a1-4745-97dc-0faccf4d8e78 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:36.350109 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-210914cf-f0a1-4745-97dc-0faccf4d8e78 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:36.416926 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-210914cf-f0a1-4745-97dc-0faccf4d8e78 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:36.426848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-210914cf-f0a1-4745-97dc-0faccf4d8e78 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:36.429053 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-210914cf-f0a1-4745-97dc-0faccf4d8e78 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:36.430294 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-210914cf-f0a1-4745-97dc-0faccf4d8e78 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.094226 Sep 24 21:16:36.431151 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2703/5392] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:36 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:36.978095 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-11fb07e3-c0bc-4346-a110-2bd12ab32bc0 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:36.978835 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-11fb07e3-c0bc-4346-a110-2bd12ab32bc0 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] [instance: 55393c6d-70c2-43ad-abbf-fc266238e783] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:36.985996 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-11fb07e3-c0bc-4346-a110-2bd12ab32bc0 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:36.986845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-11fb07e3-c0bc-4346-a110-2bd12ab32bc0 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:36.987502 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-11fb07e3-c0bc-4346-a110-2bd12ab32bc0 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:36.988576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-11fb07e3-c0bc-4346-a110-2bd12ab32bc0 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:36.989272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-11fb07e3-c0bc-4346-a110-2bd12ab32bc0 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:36.990291 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-11fb07e3-c0bc-4346-a110-2bd12ab32bc0 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:37.221359 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-11fb07e3-c0bc-4346-a110-2bd12ab32bc0 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b53b6cad57584720aa0ecbe097fe92c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3601e0eb4f654079810627bef64cb0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:37.231078 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-11fb07e3-c0bc-4346-a110-2bd12ab32bc0 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] 10.222.0.52 "GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783" status: 200 len: 1510 microversion: 2.1 time: 0.258018 Sep 24 21:16:37.244634 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2690/5393] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:36 2022] GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783 => generated 1510 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:37.299042 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c04248b5-6876-47ea-aaa8-ffab189f31fe tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:37.300491 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c04248b5-6876-47ea-aaa8-ffab189f31fe tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: 2d50dc12-3ebf-49e3-8337-b9d87e8c31a0] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:37.308058 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c04248b5-6876-47ea-aaa8-ffab189f31fe tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:37.308792 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c04248b5-6876-47ea-aaa8-ffab189f31fe tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:37.309446 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c04248b5-6876-47ea-aaa8-ffab189f31fe tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:37.310306 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c04248b5-6876-47ea-aaa8-ffab189f31fe tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:37.310936 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c04248b5-6876-47ea-aaa8-ffab189f31fe tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:37.311512 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c04248b5-6876-47ea-aaa8-ffab189f31fe tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:37.455874 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-784773cd-2bfa-462e-a2ae-1b6da694c2de tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:37.456910 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-784773cd-2bfa-462e-a2ae-1b6da694c2de tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:37.465307 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-784773cd-2bfa-462e-a2ae-1b6da694c2de tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:37.466254 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-784773cd-2bfa-462e-a2ae-1b6da694c2de tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:37.466962 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-784773cd-2bfa-462e-a2ae-1b6da694c2de tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:37.467975 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-784773cd-2bfa-462e-a2ae-1b6da694c2de tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:37.468689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-784773cd-2bfa-462e-a2ae-1b6da694c2de tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:37.469359 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-784773cd-2bfa-462e-a2ae-1b6da694c2de tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:37.551399 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-784773cd-2bfa-462e-a2ae-1b6da694c2de tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:37.560965 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-784773cd-2bfa-462e-a2ae-1b6da694c2de tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:37.562432 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-784773cd-2bfa-462e-a2ae-1b6da694c2de tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:37.563647 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-784773cd-2bfa-462e-a2ae-1b6da694c2de tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.111747 Sep 24 21:16:37.564762 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2691/5394] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:37 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:16:37.788053 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c04248b5-6876-47ea-aaa8-ffab189f31fe tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2d50dc12-3ebf-49e3-8337-b9d87e8c31a0" status: 200 len: 1463 microversion: 2.1 time: 0.492116 Sep 24 21:16:37.790105 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2704/5395] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:37 2022] GET /compute/v2.1/servers/2d50dc12-3ebf-49e3-8337-b9d87e8c31a0 => generated 1463 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:16:38.254164 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8c8d2dc9-9516-4738-af78-8050a2cc7856 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:38.254809 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8c8d2dc9-9516-4738-af78-8050a2cc7856 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] [instance: 55393c6d-70c2-43ad-abbf-fc266238e783] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:38.262836 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c8d2dc9-9516-4738-af78-8050a2cc7856 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:38.263536 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c8d2dc9-9516-4738-af78-8050a2cc7856 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:38.263977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c8d2dc9-9516-4738-af78-8050a2cc7856 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:38.264682 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c8d2dc9-9516-4738-af78-8050a2cc7856 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:38.265137 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c8d2dc9-9516-4738-af78-8050a2cc7856 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:38.265566 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c8d2dc9-9516-4738-af78-8050a2cc7856 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:38.403470 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8c8d2dc9-9516-4738-af78-8050a2cc7856 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b53b6cad57584720aa0ecbe097fe92c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3601e0eb4f654079810627bef64cb0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:38.412833 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8c8d2dc9-9516-4738-af78-8050a2cc7856 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] 10.222.0.52 "GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783" status: 200 len: 1493 microversion: 2.1 time: 0.162205 Sep 24 21:16:38.413509 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2692/5396] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:38 2022] GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783 => generated 1493 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:38.435616 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-61f56e21-067e-48b4-9776-8982b5bbecf4 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:16:38.436437 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-61f56e21-067e-48b4-9776-8982b5bbecf4 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] [instance: 55393c6d-70c2-43ad-abbf-fc266238e783] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:38.443469 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-61f56e21-067e-48b4-9776-8982b5bbecf4 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:38.443985 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-61f56e21-067e-48b4-9776-8982b5bbecf4 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:38.444432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-61f56e21-067e-48b4-9776-8982b5bbecf4 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:38.445323 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-61f56e21-067e-48b4-9776-8982b5bbecf4 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:38.445787 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-61f56e21-067e-48b4-9776-8982b5bbecf4 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:38.446223 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-61f56e21-067e-48b4-9776-8982b5bbecf4 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:38.517580 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-61f56e21-067e-48b4-9776-8982b5bbecf4 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] 10.222.0.52 "POST /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783/action" status: 202 len: 0 microversion: 2.1 time: 0.084586 Sep 24 21:16:38.517580 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2705/5397] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:16:38 2022] POST /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:16:38.526806 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cddf01f7-aa87-4e80-9f12-868042e16aaa tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:38.527552 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cddf01f7-aa87-4e80-9f12-868042e16aaa tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] [instance: 55393c6d-70c2-43ad-abbf-fc266238e783] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:38.534794 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cddf01f7-aa87-4e80-9f12-868042e16aaa tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:38.535374 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cddf01f7-aa87-4e80-9f12-868042e16aaa tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:38.536200 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cddf01f7-aa87-4e80-9f12-868042e16aaa tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:38.537962 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cddf01f7-aa87-4e80-9f12-868042e16aaa tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:38.538440 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cddf01f7-aa87-4e80-9f12-868042e16aaa tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:38.539704 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cddf01f7-aa87-4e80-9f12-868042e16aaa tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:38.594120 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dea20eb8-ee47-4892-ae0f-38424ee992b5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:38.595259 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dea20eb8-ee47-4892-ae0f-38424ee992b5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:38.604529 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dea20eb8-ee47-4892-ae0f-38424ee992b5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:38.604997 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dea20eb8-ee47-4892-ae0f-38424ee992b5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:38.605786 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dea20eb8-ee47-4892-ae0f-38424ee992b5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:38.607732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dea20eb8-ee47-4892-ae0f-38424ee992b5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:38.608645 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dea20eb8-ee47-4892-ae0f-38424ee992b5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:38.609573 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dea20eb8-ee47-4892-ae0f-38424ee992b5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:38.709980 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dea20eb8-ee47-4892-ae0f-38424ee992b5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:38.729374 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dea20eb8-ee47-4892-ae0f-38424ee992b5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:38.731441 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dea20eb8-ee47-4892-ae0f-38424ee992b5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:38.733290 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dea20eb8-ee47-4892-ae0f-38424ee992b5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.143529 Sep 24 21:16:38.734385 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2706/5398] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:38 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:38.820022 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a9db7389-0e67-4bff-9c5f-23550250a4c8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:38.820650 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a9db7389-0e67-4bff-9c5f-23550250a4c8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: 2d50dc12-3ebf-49e3-8337-b9d87e8c31a0] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:38.828534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9db7389-0e67-4bff-9c5f-23550250a4c8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:38.829087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9db7389-0e67-4bff-9c5f-23550250a4c8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:38.829640 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9db7389-0e67-4bff-9c5f-23550250a4c8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:38.830365 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9db7389-0e67-4bff-9c5f-23550250a4c8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:38.831095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9db7389-0e67-4bff-9c5f-23550250a4c8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:38.831639 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9db7389-0e67-4bff-9c5f-23550250a4c8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:38.833517 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cddf01f7-aa87-4e80-9f12-868042e16aaa tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b53b6cad57584720aa0ecbe097fe92c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3601e0eb4f654079810627bef64cb0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:38.844217 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cddf01f7-aa87-4e80-9f12-868042e16aaa tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] 10.222.0.52 "GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783" status: 200 len: 1499 microversion: 2.1 time: 0.321570 Sep 24 21:16:38.845671 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2693/5399] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:38 2022] GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783 => generated 1499 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:39.086519 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a9db7389-0e67-4bff-9c5f-23550250a4c8 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2d50dc12-3ebf-49e3-8337-b9d87e8c31a0" status: 200 len: 1463 microversion: 2.1 time: 0.270736 Sep 24 21:16:39.103670 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2707/5400] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:38 2022] GET /compute/v2.1/servers/2d50dc12-3ebf-49e3-8337-b9d87e8c31a0 => generated 1463 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:16:39.257765 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-7ccd7ce6-fc33-44c7-9df0-817b63dac562 req-cc347e4a-6ca7-4570-b2ea-f23c410f2bcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d50dc12-3ebf-49e3-8337-b9d87e8c31a0", "name": "network-vif-plugged", "status": "completed", "tag": "66ba2140-7f53-462e-b4cd-5c0924720b4a"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:16:39.287562 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-7ccd7ce6-fc33-44c7-9df0-817b63dac562 req-cc347e4a-6ca7-4570-b2ea-f23c410f2bcb service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:39.290019 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-7ccd7ce6-fc33-44c7-9df0-817b63dac562 req-cc347e4a-6ca7-4570-b2ea-f23c410f2bcb service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:39.290681 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-7ccd7ce6-fc33-44c7-9df0-817b63dac562 req-cc347e4a-6ca7-4570-b2ea-f23c410f2bcb service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:39.303387 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-7ccd7ce6-fc33-44c7-9df0-817b63dac562 req-cc347e4a-6ca7-4570-b2ea-f23c410f2bcb service nova] Creating event network-vif-plugged:66ba2140-7f53-462e-b4cd-5c0924720b4a for instance 2d50dc12-3ebf-49e3-8337-b9d87e8c31a0 on nch1-master-1 Sep 24 21:16:39.309926 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-7ccd7ce6-fc33-44c7-9df0-817b63dac562 req-cc347e4a-6ca7-4570-b2ea-f23c410f2bcb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060615 Sep 24 21:16:39.312973 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2694/5401] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:16:39.758804 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5ca1fed1-d666-46d4-afd8-33ada69811ea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:39.759429 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5ca1fed1-d666-46d4-afd8-33ada69811ea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:39.766143 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ca1fed1-d666-46d4-afd8-33ada69811ea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:39.766678 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ca1fed1-d666-46d4-afd8-33ada69811ea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:39.767121 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ca1fed1-d666-46d4-afd8-33ada69811ea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:39.767823 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ca1fed1-d666-46d4-afd8-33ada69811ea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:39.768274 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ca1fed1-d666-46d4-afd8-33ada69811ea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:39.768705 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ca1fed1-d666-46d4-afd8-33ada69811ea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:39.784240 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:16:39.839821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5ca1fed1-d666-46d4-afd8-33ada69811ea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:39.849251 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5ca1fed1-d666-46d4-afd8-33ada69811ea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:39.850955 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5ca1fed1-d666-46d4-afd8-33ada69811ea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:39.852126 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5ca1fed1-d666-46d4-afd8-33ada69811ea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.097559 Sep 24 21:16:39.852700 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2708/5402] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:39 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:39.871929 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5832c11b-762b-4bdc-8b80-2425afa03837 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:39.872730 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5832c11b-762b-4bdc-8b80-2425afa03837 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] [instance: 55393c6d-70c2-43ad-abbf-fc266238e783] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:39.879250 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5832c11b-762b-4bdc-8b80-2425afa03837 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:39.879779 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5832c11b-762b-4bdc-8b80-2425afa03837 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:39.880397 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5832c11b-762b-4bdc-8b80-2425afa03837 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:39.881275 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5832c11b-762b-4bdc-8b80-2425afa03837 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:39.881752 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5832c11b-762b-4bdc-8b80-2425afa03837 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:39.882197 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5832c11b-762b-4bdc-8b80-2425afa03837 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:39.898119 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:16:40.020301 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5832c11b-762b-4bdc-8b80-2425afa03837 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b53b6cad57584720aa0ecbe097fe92c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3601e0eb4f654079810627bef64cb0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:40.029682 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5832c11b-762b-4bdc-8b80-2425afa03837 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] 10.222.0.52 "GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783" status: 200 len: 1499 microversion: 2.1 time: 0.161914 Sep 24 21:16:40.030391 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2695/5403] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:39 2022] GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783 => generated 1499 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:40.111235 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-db118231-b738-44a2-8f49-fe51e05b769b tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:40.111235 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-db118231-b738-44a2-8f49-fe51e05b769b tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: 2d50dc12-3ebf-49e3-8337-b9d87e8c31a0] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:40.113065 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:16:40.118803 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db118231-b738-44a2-8f49-fe51e05b769b tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:40.119304 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db118231-b738-44a2-8f49-fe51e05b769b tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:40.119933 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db118231-b738-44a2-8f49-fe51e05b769b tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:40.120968 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db118231-b738-44a2-8f49-fe51e05b769b tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:40.121442 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db118231-b738-44a2-8f49-fe51e05b769b tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:40.121883 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db118231-b738-44a2-8f49-fe51e05b769b tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:40.163464 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=8 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:16:40.264043 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-db118231-b738-44a2-8f49-fe51e05b769b tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2d50dc12-3ebf-49e3-8337-b9d87e8c31a0" status: 200 len: 1463 microversion: 2.1 time: 0.157337 Sep 24 21:16:40.264619 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2709/5404] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:40 2022] GET /compute/v2.1/servers/2d50dc12-3ebf-49e3-8337-b9d87e8c31a0 => generated 1463 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:40.879497 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f8063350-c21f-4a3c-993e-5687c030f083 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:40.881007 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f8063350-c21f-4a3c-993e-5687c030f083 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:40.888361 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8063350-c21f-4a3c-993e-5687c030f083 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:40.888934 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8063350-c21f-4a3c-993e-5687c030f083 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:40.889463 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8063350-c21f-4a3c-993e-5687c030f083 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:40.890315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8063350-c21f-4a3c-993e-5687c030f083 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:40.890811 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8063350-c21f-4a3c-993e-5687c030f083 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:40.891249 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8063350-c21f-4a3c-993e-5687c030f083 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:40.962098 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f8063350-c21f-4a3c-993e-5687c030f083 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:40.975329 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f8063350-c21f-4a3c-993e-5687c030f083 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:40.976818 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f8063350-c21f-4a3c-993e-5687c030f083 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:40.978096 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f8063350-c21f-4a3c-993e-5687c030f083 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.102861 Sep 24 21:16:40.978685 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2696/5405] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:40 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:41.056445 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cf223409-a926-405a-97ad-2c5bae25654e tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:41.057078 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cf223409-a926-405a-97ad-2c5bae25654e tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] [instance: 55393c6d-70c2-43ad-abbf-fc266238e783] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:41.064084 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf223409-a926-405a-97ad-2c5bae25654e tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:41.064583 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf223409-a926-405a-97ad-2c5bae25654e tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:41.065029 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf223409-a926-405a-97ad-2c5bae25654e tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:41.065740 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf223409-a926-405a-97ad-2c5bae25654e tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:41.066208 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf223409-a926-405a-97ad-2c5bae25654e tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:41.066674 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf223409-a926-405a-97ad-2c5bae25654e tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:41.207009 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cf223409-a926-405a-97ad-2c5bae25654e tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b53b6cad57584720aa0ecbe097fe92c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3601e0eb4f654079810627bef64cb0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:41.214981 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cf223409-a926-405a-97ad-2c5bae25654e tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] 10.222.0.52 "GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783" status: 200 len: 1502 microversion: 2.1 time: 0.163009 Sep 24 21:16:41.215558 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2710/5406] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:41 2022] GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783 => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:41.237946 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-226c644d-aff8-4ebc-b4d4-583b1dc8a7f2 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:16:41.238490 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-226c644d-aff8-4ebc-b4d4-583b1dc8a7f2 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] [instance: 55393c6d-70c2-43ad-abbf-fc266238e783] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:41.245053 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-226c644d-aff8-4ebc-b4d4-583b1dc8a7f2 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:41.245540 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-226c644d-aff8-4ebc-b4d4-583b1dc8a7f2 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:41.245979 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-226c644d-aff8-4ebc-b4d4-583b1dc8a7f2 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:41.246705 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-226c644d-aff8-4ebc-b4d4-583b1dc8a7f2 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:41.247191 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-226c644d-aff8-4ebc-b4d4-583b1dc8a7f2 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:41.247621 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-226c644d-aff8-4ebc-b4d4-583b1dc8a7f2 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:41.273988 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-226c644d-aff8-4ebc-b4d4-583b1dc8a7f2 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lazy-loading 'flavor' on Instance uuid 55393c6d-70c2-43ad-abbf-fc266238e783 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:16:41.289104 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a6de43db-3dc0-4dce-bd3b-2a3d8b9d6169 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:41.289895 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a6de43db-3dc0-4dce-bd3b-2a3d8b9d6169 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: 2d50dc12-3ebf-49e3-8337-b9d87e8c31a0] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:41.296379 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a6de43db-3dc0-4dce-bd3b-2a3d8b9d6169 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:41.296959 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a6de43db-3dc0-4dce-bd3b-2a3d8b9d6169 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:41.297946 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a6de43db-3dc0-4dce-bd3b-2a3d8b9d6169 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:41.298711 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a6de43db-3dc0-4dce-bd3b-2a3d8b9d6169 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:41.299252 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a6de43db-3dc0-4dce-bd3b-2a3d8b9d6169 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:41.299822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a6de43db-3dc0-4dce-bd3b-2a3d8b9d6169 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:41.344367 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-226c644d-aff8-4ebc-b4d4-583b1dc8a7f2 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] 10.222.0.52 "POST /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783/action" status: 202 len: 0 microversion: 2.1 time: 0.110101 Sep 24 21:16:41.345510 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2697/5407] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:16:41 2022] POST /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:16:41.356676 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1f54de4b-1013-46bf-bdea-1457642ab726 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:41.357525 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1f54de4b-1013-46bf-bdea-1457642ab726 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] [instance: 55393c6d-70c2-43ad-abbf-fc266238e783] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:41.365798 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f54de4b-1013-46bf-bdea-1457642ab726 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:41.366449 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f54de4b-1013-46bf-bdea-1457642ab726 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:41.366990 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f54de4b-1013-46bf-bdea-1457642ab726 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:41.367839 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f54de4b-1013-46bf-bdea-1457642ab726 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:41.368988 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f54de4b-1013-46bf-bdea-1457642ab726 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:41.369492 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f54de4b-1013-46bf-bdea-1457642ab726 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:41.500969 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a6de43db-3dc0-4dce-bd3b-2a3d8b9d6169 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2d50dc12-3ebf-49e3-8337-b9d87e8c31a0" status: 200 len: 1648 microversion: 2.1 time: 0.216316 Sep 24 21:16:41.502180 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2711/5408] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:41 2022] GET /compute/v2.1/servers/2d50dc12-3ebf-49e3-8337-b9d87e8c31a0 => generated 1648 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:16:41.527423 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3b8790e6-a936-497c-b218-9c5bbafac5b5 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:41.528064 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3b8790e6-a936-497c-b218-9c5bbafac5b5 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: 2d50dc12-3ebf-49e3-8337-b9d87e8c31a0] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:41.534390 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3b8790e6-a936-497c-b218-9c5bbafac5b5 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:41.534926 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3b8790e6-a936-497c-b218-9c5bbafac5b5 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:41.535373 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3b8790e6-a936-497c-b218-9c5bbafac5b5 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:41.536185 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3b8790e6-a936-497c-b218-9c5bbafac5b5 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:41.537400 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3b8790e6-a936-497c-b218-9c5bbafac5b5 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:41.538051 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3b8790e6-a936-497c-b218-9c5bbafac5b5 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:41.542849 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1f54de4b-1013-46bf-bdea-1457642ab726 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b53b6cad57584720aa0ecbe097fe92c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3601e0eb4f654079810627bef64cb0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:41.554004 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1f54de4b-1013-46bf-bdea-1457642ab726 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] 10.222.0.52 "GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783" status: 200 len: 1510 microversion: 2.1 time: 0.202132 Sep 24 21:16:41.563250 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2698/5409] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:41 2022] GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783 => generated 1510 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:16:41.684316 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3b8790e6-a936-497c-b218-9c5bbafac5b5 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2d50dc12-3ebf-49e3-8337-b9d87e8c31a0" status: 200 len: 1648 microversion: 2.1 time: 0.162002 Sep 24 21:16:41.684888 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2712/5410] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:41 2022] GET /compute/v2.1/servers/2d50dc12-3ebf-49e3-8337-b9d87e8c31a0 => generated 1648 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:41.706370 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1c6769ea-3b9b-4f0b-83ca-fc5dee6a9e7c tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:41.707094 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1c6769ea-3b9b-4f0b-83ca-fc5dee6a9e7c tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: 2d50dc12-3ebf-49e3-8337-b9d87e8c31a0] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:41.715370 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c6769ea-3b9b-4f0b-83ca-fc5dee6a9e7c tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:41.715866 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c6769ea-3b9b-4f0b-83ca-fc5dee6a9e7c tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:41.716306 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c6769ea-3b9b-4f0b-83ca-fc5dee6a9e7c tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:41.717008 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c6769ea-3b9b-4f0b-83ca-fc5dee6a9e7c tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:41.717462 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c6769ea-3b9b-4f0b-83ca-fc5dee6a9e7c tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:41.717889 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c6769ea-3b9b-4f0b-83ca-fc5dee6a9e7c tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:41.852977 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1c6769ea-3b9b-4f0b-83ca-fc5dee6a9e7c tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2d50dc12-3ebf-49e3-8337-b9d87e8c31a0" status: 200 len: 1648 microversion: 2.1 time: 0.150426 Sep 24 21:16:41.853564 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2699/5411] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:41 2022] GET /compute/v2.1/servers/2d50dc12-3ebf-49e3-8337-b9d87e8c31a0 => generated 1648 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:41.875423 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0147b566-4d83-491a-a493-747f74985c3a tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:41.875939 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0147b566-4d83-491a-a493-747f74985c3a tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: 2d50dc12-3ebf-49e3-8337-b9d87e8c31a0] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:41.882875 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0147b566-4d83-491a-a493-747f74985c3a tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:41.883496 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0147b566-4d83-491a-a493-747f74985c3a tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:41.883941 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0147b566-4d83-491a-a493-747f74985c3a tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:41.884644 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0147b566-4d83-491a-a493-747f74985c3a tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:41.885131 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0147b566-4d83-491a-a493-747f74985c3a tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:41.885566 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0147b566-4d83-491a-a493-747f74985c3a tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:41.913244 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0147b566-4d83-491a-a493-747f74985c3a tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: 2d50dc12-3ebf-49e3-8337-b9d87e8c31a0] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:16:41.994466 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0147b566-4d83-491a-a493-747f74985c3a tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "DELETE /compute/v2.1/servers/2d50dc12-3ebf-49e3-8337-b9d87e8c31a0" status: 204 len: 0 microversion: 2.1 time: 0.122454 Sep 24 21:16:41.995551 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2713/5412] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:16:41 2022] DELETE /compute/v2.1/servers/2d50dc12-3ebf-49e3-8337-b9d87e8c31a0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:16:42.004128 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-eca57255-eb4b-47d6-aa21-fced56d70574 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:42.004787 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-eca57255-eb4b-47d6-aa21-fced56d70574 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: 2d50dc12-3ebf-49e3-8337-b9d87e8c31a0] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:42.009218 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e7704b36-a827-4b9d-bd33-c1a3a82eee62 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:42.010096 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e7704b36-a827-4b9d-bd33-c1a3a82eee62 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:42.011866 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eca57255-eb4b-47d6-aa21-fced56d70574 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:42.012352 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eca57255-eb4b-47d6-aa21-fced56d70574 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:42.012957 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eca57255-eb4b-47d6-aa21-fced56d70574 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:42.013664 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eca57255-eb4b-47d6-aa21-fced56d70574 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:42.014290 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eca57255-eb4b-47d6-aa21-fced56d70574 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:42.014756 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eca57255-eb4b-47d6-aa21-fced56d70574 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:42.017261 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7704b36-a827-4b9d-bd33-c1a3a82eee62 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:42.017858 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7704b36-a827-4b9d-bd33-c1a3a82eee62 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:42.018375 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7704b36-a827-4b9d-bd33-c1a3a82eee62 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:42.019301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7704b36-a827-4b9d-bd33-c1a3a82eee62 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:42.021112 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7704b36-a827-4b9d-bd33-c1a3a82eee62 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:42.021847 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7704b36-a827-4b9d-bd33-c1a3a82eee62 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:42.105858 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e7704b36-a827-4b9d-bd33-c1a3a82eee62 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:42.116049 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e7704b36-a827-4b9d-bd33-c1a3a82eee62 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:42.117735 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e7704b36-a827-4b9d-bd33-c1a3a82eee62 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:42.120652 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e7704b36-a827-4b9d-bd33-c1a3a82eee62 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.115554 Sep 24 21:16:42.120652 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2714/5413] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:42 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:42.177255 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-eca57255-eb4b-47d6-aa21-fced56d70574 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2d50dc12-3ebf-49e3-8337-b9d87e8c31a0" status: 200 len: 1654 microversion: 2.1 time: 0.176916 Sep 24 21:16:42.177942 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2700/5414] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:41 2022] GET /compute/v2.1/servers/2d50dc12-3ebf-49e3-8337-b9d87e8c31a0 => generated 1654 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:42.576751 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3eea4170-67cd-4433-b312-3108d31d527c tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:42.577376 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3eea4170-67cd-4433-b312-3108d31d527c tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] [instance: 55393c6d-70c2-43ad-abbf-fc266238e783] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:42.584238 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3eea4170-67cd-4433-b312-3108d31d527c tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:42.584729 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3eea4170-67cd-4433-b312-3108d31d527c tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:42.585197 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3eea4170-67cd-4433-b312-3108d31d527c tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:42.585900 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3eea4170-67cd-4433-b312-3108d31d527c tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:42.586361 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3eea4170-67cd-4433-b312-3108d31d527c tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:42.586837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3eea4170-67cd-4433-b312-3108d31d527c tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:42.734303 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3eea4170-67cd-4433-b312-3108d31d527c tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b53b6cad57584720aa0ecbe097fe92c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3601e0eb4f654079810627bef64cb0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:42.743537 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3eea4170-67cd-4433-b312-3108d31d527c tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] 10.222.0.52 "GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783" status: 200 len: 1510 microversion: 2.1 time: 0.170481 Sep 24 21:16:42.744147 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2715/5415] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:42 2022] GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783 => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:43.144573 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-28b4e4be-034e-4995-9192-b875c1a9a0a6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:43.146419 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-28b4e4be-034e-4995-9192-b875c1a9a0a6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:43.154458 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28b4e4be-034e-4995-9192-b875c1a9a0a6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:43.155073 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28b4e4be-034e-4995-9192-b875c1a9a0a6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:43.155526 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28b4e4be-034e-4995-9192-b875c1a9a0a6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:43.156490 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28b4e4be-034e-4995-9192-b875c1a9a0a6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:43.156962 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28b4e4be-034e-4995-9192-b875c1a9a0a6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:43.157646 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28b4e4be-034e-4995-9192-b875c1a9a0a6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:43.200989 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2bad487e-c542-4ae4-8301-861f9b8f5025 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:43.201895 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2bad487e-c542-4ae4-8301-861f9b8f5025 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: 2d50dc12-3ebf-49e3-8337-b9d87e8c31a0] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:43.210042 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2bad487e-c542-4ae4-8301-861f9b8f5025 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:43.210820 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2bad487e-c542-4ae4-8301-861f9b8f5025 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:43.211642 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2bad487e-c542-4ae4-8301-861f9b8f5025 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:43.212702 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2bad487e-c542-4ae4-8301-861f9b8f5025 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:43.213176 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2bad487e-c542-4ae4-8301-861f9b8f5025 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:43.214108 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2bad487e-c542-4ae4-8301-861f9b8f5025 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:43.241026 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-28b4e4be-034e-4995-9192-b875c1a9a0a6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:43.251652 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-28b4e4be-034e-4995-9192-b875c1a9a0a6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:43.253297 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-28b4e4be-034e-4995-9192-b875c1a9a0a6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:43.254555 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-28b4e4be-034e-4995-9192-b875c1a9a0a6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.114136 Sep 24 21:16:43.256007 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2701/5416] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:43 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:43.350183 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2bad487e-c542-4ae4-8301-861f9b8f5025 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2d50dc12-3ebf-49e3-8337-b9d87e8c31a0" status: 200 len: 1654 microversion: 2.1 time: 0.152821 Sep 24 21:16:43.350822 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2716/5417] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:43 2022] GET /compute/v2.1/servers/2d50dc12-3ebf-49e3-8337-b9d87e8c31a0 => generated 1654 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:16:43.767715 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dc6f5aad-3f28-40b6-bc86-2d0b81998248 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:43.768663 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-dc6f5aad-3f28-40b6-bc86-2d0b81998248 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] [instance: 55393c6d-70c2-43ad-abbf-fc266238e783] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:43.776435 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc6f5aad-3f28-40b6-bc86-2d0b81998248 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:43.776916 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc6f5aad-3f28-40b6-bc86-2d0b81998248 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:43.777556 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc6f5aad-3f28-40b6-bc86-2d0b81998248 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:43.778379 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc6f5aad-3f28-40b6-bc86-2d0b81998248 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:43.778893 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc6f5aad-3f28-40b6-bc86-2d0b81998248 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:43.779343 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc6f5aad-3f28-40b6-bc86-2d0b81998248 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:43.963242 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-1134f86a-53ad-4b79-8c58-e416362f7316 req-58482179-4df1-4494-9fa3-eb3758c53e94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d50dc12-3ebf-49e3-8337-b9d87e8c31a0", "name": "network-vif-deleted", "tag": "66ba2140-7f53-462e-b4cd-5c0924720b4a"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:16:43.974845 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-1134f86a-53ad-4b79-8c58-e416362f7316 req-58482179-4df1-4494-9fa3-eb3758c53e94 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:43.988571 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-1134f86a-53ad-4b79-8c58-e416362f7316 req-58482179-4df1-4494-9fa3-eb3758c53e94 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:43.990739 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-1134f86a-53ad-4b79-8c58-e416362f7316 req-58482179-4df1-4494-9fa3-eb3758c53e94 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:44.002363 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-dc6f5aad-3f28-40b6-bc86-2d0b81998248 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b53b6cad57584720aa0ecbe097fe92c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3601e0eb4f654079810627bef64cb0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:44.010961 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-1134f86a-53ad-4b79-8c58-e416362f7316 req-58482179-4df1-4494-9fa3-eb3758c53e94 service nova] Creating event network-vif-deleted:66ba2140-7f53-462e-b4cd-5c0924720b4a for instance 2d50dc12-3ebf-49e3-8337-b9d87e8c31a0 on nch1-master-1 Sep 24 21:16:44.013362 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-dc6f5aad-3f28-40b6-bc86-2d0b81998248 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] 10.222.0.52 "GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783" status: 200 len: 1493 microversion: 2.1 time: 0.250229 Sep 24 21:16:44.030532 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2702/5418] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:43 2022] GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783 => generated 1493 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:44.034954 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-1134f86a-53ad-4b79-8c58-e416362f7316 req-58482179-4df1-4494-9fa3-eb3758c53e94 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075231 Sep 24 21:16:44.035751 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2717/5419] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:16:44.042202 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-89332868-0c05-4f26-bce5-446a69e64eff tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:16:44.042787 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-89332868-0c05-4f26-bce5-446a69e64eff tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] [instance: 55393c6d-70c2-43ad-abbf-fc266238e783] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:44.049132 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89332868-0c05-4f26-bce5-446a69e64eff tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:44.049645 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89332868-0c05-4f26-bce5-446a69e64eff tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:44.050096 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89332868-0c05-4f26-bce5-446a69e64eff tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:44.050877 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89332868-0c05-4f26-bce5-446a69e64eff tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:44.051364 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89332868-0c05-4f26-bce5-446a69e64eff tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:44.052428 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89332868-0c05-4f26-bce5-446a69e64eff tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:44.147027 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-89332868-0c05-4f26-bce5-446a69e64eff tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] 10.222.0.52 "POST /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783/action" status: 202 len: 0 microversion: 2.1 time: 0.106151 Sep 24 21:16:44.148702 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2703/5420] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:16:44 2022] POST /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:16:44.160181 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-798de23d-7296-48d9-bc3e-68fe1bbbf4b5 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:44.161723 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-798de23d-7296-48d9-bc3e-68fe1bbbf4b5 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] [instance: 55393c6d-70c2-43ad-abbf-fc266238e783] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:44.171091 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-798de23d-7296-48d9-bc3e-68fe1bbbf4b5 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:44.171091 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-798de23d-7296-48d9-bc3e-68fe1bbbf4b5 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:44.171091 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-798de23d-7296-48d9-bc3e-68fe1bbbf4b5 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:44.171768 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-798de23d-7296-48d9-bc3e-68fe1bbbf4b5 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:44.172240 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-798de23d-7296-48d9-bc3e-68fe1bbbf4b5 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:44.172756 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-798de23d-7296-48d9-bc3e-68fe1bbbf4b5 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:44.284146 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-edb88fa9-3a67-4496-a68f-ffdbeeb2823d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:44.284953 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-edb88fa9-3a67-4496-a68f-ffdbeeb2823d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:44.292360 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-edb88fa9-3a67-4496-a68f-ffdbeeb2823d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:44.293074 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-edb88fa9-3a67-4496-a68f-ffdbeeb2823d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:44.293637 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-edb88fa9-3a67-4496-a68f-ffdbeeb2823d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:44.294480 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-edb88fa9-3a67-4496-a68f-ffdbeeb2823d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:44.295065 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-edb88fa9-3a67-4496-a68f-ffdbeeb2823d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:44.295602 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-edb88fa9-3a67-4496-a68f-ffdbeeb2823d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:44.379946 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-edb88fa9-3a67-4496-a68f-ffdbeeb2823d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:44.387851 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-798de23d-7296-48d9-bc3e-68fe1bbbf4b5 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b53b6cad57584720aa0ecbe097fe92c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3601e0eb4f654079810627bef64cb0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:44.397437 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-edb88fa9-3a67-4496-a68f-ffdbeeb2823d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:44.399022 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-798de23d-7296-48d9-bc3e-68fe1bbbf4b5 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] 10.222.0.52 "GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783" status: 200 len: 1499 microversion: 2.1 time: 0.244991 Sep 24 21:16:44.399137 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-edb88fa9-3a67-4496-a68f-ffdbeeb2823d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:44.402613 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2718/5421] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:44 2022] GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783 => generated 1499 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:16:44.402754 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-edb88fa9-3a67-4496-a68f-ffdbeeb2823d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.122569 Sep 24 21:16:44.402754 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2704/5422] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:44 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:16:44.405970 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-09073d5a-e46b-4a21-a34a-332d37dca674 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:44.406628 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-09073d5a-e46b-4a21-a34a-332d37dca674 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: 2d50dc12-3ebf-49e3-8337-b9d87e8c31a0] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:44.413086 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09073d5a-e46b-4a21-a34a-332d37dca674 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:44.413647 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09073d5a-e46b-4a21-a34a-332d37dca674 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:44.414102 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09073d5a-e46b-4a21-a34a-332d37dca674 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:44.414840 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09073d5a-e46b-4a21-a34a-332d37dca674 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:44.415312 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09073d5a-e46b-4a21-a34a-332d37dca674 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:44.415751 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09073d5a-e46b-4a21-a34a-332d37dca674 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:44.450085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09073d5a-e46b-4a21-a34a-332d37dca674 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:44.450621 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09073d5a-e46b-4a21-a34a-332d37dca674 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:44.451104 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09073d5a-e46b-4a21-a34a-332d37dca674 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:44.451571 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-09073d5a-e46b-4a21-a34a-332d37dca674 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lazy-loading 'fault' on Instance uuid 2d50dc12-3ebf-49e3-8337-b9d87e8c31a0 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:16:44.501317 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-09073d5a-e46b-4a21-a34a-332d37dca674 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2d50dc12-3ebf-49e3-8337-b9d87e8c31a0" status: 200 len: 1453 microversion: 2.1 time: 0.098932 Sep 24 21:16:44.501890 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2719/5423] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:44 2022] GET /compute/v2.1/servers/2d50dc12-3ebf-49e3-8337-b9d87e8c31a0 => generated 1453 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:45.423103 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1697fc6b-1d81-4a31-8d66-252a4fa38b6b tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:45.423943 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1697fc6b-1d81-4a31-8d66-252a4fa38b6b tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] [instance: 55393c6d-70c2-43ad-abbf-fc266238e783] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:45.426022 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-96bedb28-6672-48bb-8fae-b5cc37afc081 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:45.426812 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-96bedb28-6672-48bb-8fae-b5cc37afc081 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:45.432099 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1697fc6b-1d81-4a31-8d66-252a4fa38b6b tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:45.432699 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1697fc6b-1d81-4a31-8d66-252a4fa38b6b tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:45.433347 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1697fc6b-1d81-4a31-8d66-252a4fa38b6b tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:45.433939 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96bedb28-6672-48bb-8fae-b5cc37afc081 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:45.434115 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1697fc6b-1d81-4a31-8d66-252a4fa38b6b tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:45.434439 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96bedb28-6672-48bb-8fae-b5cc37afc081 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:45.434605 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1697fc6b-1d81-4a31-8d66-252a4fa38b6b tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:45.434911 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96bedb28-6672-48bb-8fae-b5cc37afc081 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:45.435031 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1697fc6b-1d81-4a31-8d66-252a4fa38b6b tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:45.435624 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96bedb28-6672-48bb-8fae-b5cc37afc081 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:45.436092 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96bedb28-6672-48bb-8fae-b5cc37afc081 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:45.436527 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96bedb28-6672-48bb-8fae-b5cc37afc081 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:45.543512 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-96bedb28-6672-48bb-8fae-b5cc37afc081 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:45.553988 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-96bedb28-6672-48bb-8fae-b5cc37afc081 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:45.555528 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-96bedb28-6672-48bb-8fae-b5cc37afc081 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:45.556828 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-96bedb28-6672-48bb-8fae-b5cc37afc081 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.135491 Sep 24 21:16:45.557902 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2720/5424] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:45 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:45.562452 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-57f2d1fe-b711-41ae-a92f-2e461c7a88c1 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:45.562986 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-57f2d1fe-b711-41ae-a92f-2e461c7a88c1 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: 2d50dc12-3ebf-49e3-8337-b9d87e8c31a0] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:45.569820 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57f2d1fe-b711-41ae-a92f-2e461c7a88c1 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:45.570406 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57f2d1fe-b711-41ae-a92f-2e461c7a88c1 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:45.570992 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57f2d1fe-b711-41ae-a92f-2e461c7a88c1 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:45.571765 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57f2d1fe-b711-41ae-a92f-2e461c7a88c1 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:45.572234 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57f2d1fe-b711-41ae-a92f-2e461c7a88c1 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:45.572665 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-57f2d1fe-b711-41ae-a92f-2e461c7a88c1 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:45.587531 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-57f2d1fe-b711-41ae-a92f-2e461c7a88c1 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] HTTP exception thrown: Instance 2d50dc12-3ebf-49e3-8337-b9d87e8c31a0 could not be found. Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-57f2d1fe-b711-41ae-a92f-2e461c7a88c1 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Request method failure captured: Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/2d50dc12-3ebf-49e3-8337-b9d87e8c31a0 HTTP/1.1 Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3OZPtoVInN9d1_y3dk1QvAsJLkeq8LxmstsHwhtvEBTaHTNe-Dgv0_wuLU1xDOlhUY0sfKtj_iTMdjIfpAaBEo3XskPoa778P5xi5jZOw_LKWJjaocC0dzcGDXzQlbhtEkJ_ScGWo2Wi4-ABXC7ZJsZhCv2hb2edHKQvCXxKowRLBk Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 0c0033b625ca4995bff138c485673fd8 Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-TestServerMultinode-1551803490 Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: X-Role: admin,reader,member Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: admin,reader,member Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0c0033b625ca4995bff138c485673fd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0c0033b625ca4995bff138c485673fd8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0c0033b625ca4995bff138c485673fd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0c0033b625ca4995bff138c485673fd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-TestServerMultinode-1551803490 Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 0c0033b625ca4995bff138c485673fd8 Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-TestServerMultinode-1551803490 Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-TestServerMultinode-1551803490-project-admin Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: fc712fcf0f814a59bb52e16685ab1c9b Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-TestServerMultinode-1551803490-project-admin Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 2d50dc12-3ebf-49e3-8337-b9d87e8c31a0 could not be found. Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '2d50dc12-3ebf-49e3-8337-b9d87e8c31a0'} Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d50dc12-3ebf-49e3-8337-b9d87e8c31a0 could not be found. Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d50dc12-3ebf-49e3-8337-b9d87e8c31a0 could not be found. Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:16:45.589207 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:16:45.593207 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:16:45.593207 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:16:45.593207 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:16:45.593207 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:16:45.593207 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:16:45.593207 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d50dc12-3ebf-49e3-8337-b9d87e8c31a0 could not be found. Sep 24 21:16:45.593207 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:16:45.593207 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-57f2d1fe-b711-41ae-a92f-2e461c7a88c1 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Returning 404 to user: Instance 2d50dc12-3ebf-49e3-8337-b9d87e8c31a0 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:16:45.593207 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-57f2d1fe-b711-41ae-a92f-2e461c7a88c1 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2d50dc12-3ebf-49e3-8337-b9d87e8c31a0" status: 404 len: 111 microversion: 2.1 time: 0.031766 Sep 24 21:16:45.593207 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2721/5425] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:45 2022] GET /compute/v2.1/servers/2d50dc12-3ebf-49e3-8337-b9d87e8c31a0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:16:45.604959 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-45a39c60-558b-4365-afa0-95807b131b88 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:45.605986 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-45a39c60-558b-4365-afa0-95807b131b88 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: d2a62532-3ddd-4eb5-b0c0-3877ff6be556] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:45.616416 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45a39c60-558b-4365-afa0-95807b131b88 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:45.617372 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45a39c60-558b-4365-afa0-95807b131b88 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:45.618215 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45a39c60-558b-4365-afa0-95807b131b88 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:45.619068 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45a39c60-558b-4365-afa0-95807b131b88 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:45.619883 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45a39c60-558b-4365-afa0-95807b131b88 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:45.620542 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45a39c60-558b-4365-afa0-95807b131b88 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:45.627436 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1697fc6b-1d81-4a31-8d66-252a4fa38b6b tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b53b6cad57584720aa0ecbe097fe92c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3601e0eb4f654079810627bef64cb0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:45.635641 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1697fc6b-1d81-4a31-8d66-252a4fa38b6b tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] 10.222.0.52 "GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783" status: 200 len: 1499 microversion: 2.1 time: 0.217491 Sep 24 21:16:45.636510 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2705/5426] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:45 2022] GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783 => generated 1499 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:45.653080 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-45a39c60-558b-4365-afa0-95807b131b88 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: d2a62532-3ddd-4eb5-b0c0-3877ff6be556] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:16:45.706445 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:16:45.737348 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-45a39c60-558b-4365-afa0-95807b131b88 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "DELETE /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556" status: 204 len: 0 microversion: 2.1 time: 0.140705 Sep 24 21:16:45.737861 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2722/5427] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:16:45 2022] DELETE /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:16:45.748448 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2002dd9e-c642-4d47-ad30-5f4fe25e4d82 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:45.748857 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2002dd9e-c642-4d47-ad30-5f4fe25e4d82 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: d2a62532-3ddd-4eb5-b0c0-3877ff6be556] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:45.755258 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2002dd9e-c642-4d47-ad30-5f4fe25e4d82 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:45.755781 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2002dd9e-c642-4d47-ad30-5f4fe25e4d82 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:45.756230 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2002dd9e-c642-4d47-ad30-5f4fe25e4d82 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:45.756948 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2002dd9e-c642-4d47-ad30-5f4fe25e4d82 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:45.757442 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2002dd9e-c642-4d47-ad30-5f4fe25e4d82 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:45.757882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2002dd9e-c642-4d47-ad30-5f4fe25e4d82 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:45.909305 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2002dd9e-c642-4d47-ad30-5f4fe25e4d82 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556" status: 200 len: 1652 microversion: 2.1 time: 0.165420 Sep 24 21:16:45.910378 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2706/5428] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:45 2022] GET /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556 => generated 1652 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:46.584944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7a20ec80-9bfb-405b-8856-1b68701389f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:46.585932 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7a20ec80-9bfb-405b-8856-1b68701389f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:46.592973 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7a20ec80-9bfb-405b-8856-1b68701389f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:46.593471 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7a20ec80-9bfb-405b-8856-1b68701389f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:46.593923 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7a20ec80-9bfb-405b-8856-1b68701389f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:46.594683 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7a20ec80-9bfb-405b-8856-1b68701389f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:46.595154 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7a20ec80-9bfb-405b-8856-1b68701389f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:46.595598 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7a20ec80-9bfb-405b-8856-1b68701389f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:46.661532 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e6731d3f-60a2-4192-8f53-7b694dcfc318 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:46.663257 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e6731d3f-60a2-4192-8f53-7b694dcfc318 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] [instance: 55393c6d-70c2-43ad-abbf-fc266238e783] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:46.670388 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6731d3f-60a2-4192-8f53-7b694dcfc318 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:46.671315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6731d3f-60a2-4192-8f53-7b694dcfc318 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:46.671913 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6731d3f-60a2-4192-8f53-7b694dcfc318 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:46.672806 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6731d3f-60a2-4192-8f53-7b694dcfc318 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:46.673265 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6731d3f-60a2-4192-8f53-7b694dcfc318 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:46.673693 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6731d3f-60a2-4192-8f53-7b694dcfc318 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:46.714579 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7a20ec80-9bfb-405b-8856-1b68701389f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:46.724366 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7a20ec80-9bfb-405b-8856-1b68701389f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:46.726011 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7a20ec80-9bfb-405b-8856-1b68701389f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:46.727419 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7a20ec80-9bfb-405b-8856-1b68701389f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.147429 Sep 24 21:16:46.727986 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2723/5429] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:46 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:46.886225 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e6731d3f-60a2-4192-8f53-7b694dcfc318 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b53b6cad57584720aa0ecbe097fe92c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3601e0eb4f654079810627bef64cb0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:46.898646 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e6731d3f-60a2-4192-8f53-7b694dcfc318 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] 10.222.0.52 "GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783" status: 200 len: 1502 microversion: 2.1 time: 0.241648 Sep 24 21:16:46.899243 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2707/5430] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:46 2022] GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783 => generated 1502 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:16:46.922012 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-67f1de4d-5f5c-4683-9e64-ec542110e40b tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:46.922825 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-67f1de4d-5f5c-4683-9e64-ec542110e40b tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] [instance: 55393c6d-70c2-43ad-abbf-fc266238e783] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:46.926048 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:16:46.929969 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-67f1de4d-5f5c-4683-9e64-ec542110e40b tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:46.930723 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-67f1de4d-5f5c-4683-9e64-ec542110e40b tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:46.931331 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-67f1de4d-5f5c-4683-9e64-ec542110e40b tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:46.932215 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-67f1de4d-5f5c-4683-9e64-ec542110e40b tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:46.932853 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-67f1de4d-5f5c-4683-9e64-ec542110e40b tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:46.933445 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-67f1de4d-5f5c-4683-9e64-ec542110e40b tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:46.935001 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6b4cfaa9-5207-4521-9e35-9d5ceb41f4dd tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:46.935748 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6b4cfaa9-5207-4521-9e35-9d5ceb41f4dd tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: d2a62532-3ddd-4eb5-b0c0-3877ff6be556] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:46.942775 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b4cfaa9-5207-4521-9e35-9d5ceb41f4dd tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:46.943485 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b4cfaa9-5207-4521-9e35-9d5ceb41f4dd tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:46.944038 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b4cfaa9-5207-4521-9e35-9d5ceb41f4dd tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:46.945319 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b4cfaa9-5207-4521-9e35-9d5ceb41f4dd tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:46.945895 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b4cfaa9-5207-4521-9e35-9d5ceb41f4dd tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:46.946491 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b4cfaa9-5207-4521-9e35-9d5ceb41f4dd tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:46.966077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-67f1de4d-5f5c-4683-9e64-ec542110e40b tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] [instance: 55393c6d-70c2-43ad-abbf-fc266238e783] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:16:47.055883 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-67f1de4d-5f5c-4683-9e64-ec542110e40b tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] 10.222.0.52 "DELETE /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783" status: 204 len: 0 microversion: 2.1 time: 0.137249 Sep 24 21:16:47.056507 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2724/5431] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:16:46 2022] DELETE /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:16:47.066212 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3d6037dd-000b-4837-9df5-b39776d263c9 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:47.067728 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3d6037dd-000b-4837-9df5-b39776d263c9 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] [instance: 55393c6d-70c2-43ad-abbf-fc266238e783] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:47.073910 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d6037dd-000b-4837-9df5-b39776d263c9 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:47.074402 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d6037dd-000b-4837-9df5-b39776d263c9 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:47.075094 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d6037dd-000b-4837-9df5-b39776d263c9 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:47.075860 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d6037dd-000b-4837-9df5-b39776d263c9 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:47.076311 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d6037dd-000b-4837-9df5-b39776d263c9 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:47.076975 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d6037dd-000b-4837-9df5-b39776d263c9 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:47.269710 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6b4cfaa9-5207-4521-9e35-9d5ceb41f4dd tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556" status: 200 len: 1652 microversion: 2.1 time: 0.339470 Sep 24 21:16:47.271144 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2708/5432] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:46 2022] GET /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556 => generated 1652 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:47.293231 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3d6037dd-000b-4837-9df5-b39776d263c9 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b53b6cad57584720aa0ecbe097fe92c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3601e0eb4f654079810627bef64cb0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:47.301103 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3d6037dd-000b-4837-9df5-b39776d263c9 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] 10.222.0.52 "GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783" status: 200 len: 1508 microversion: 2.1 time: 0.239590 Sep 24 21:16:47.301709 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2725/5433] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:47 2022] GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783 => generated 1508 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:47.753472 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f275aa48-e9fb-4d01-8ff2-ee493b5628c5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:47.754153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f275aa48-e9fb-4d01-8ff2-ee493b5628c5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:47.764678 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f275aa48-e9fb-4d01-8ff2-ee493b5628c5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:47.765227 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f275aa48-e9fb-4d01-8ff2-ee493b5628c5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:47.766116 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f275aa48-e9fb-4d01-8ff2-ee493b5628c5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:47.776733 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f275aa48-e9fb-4d01-8ff2-ee493b5628c5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:47.777241 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f275aa48-e9fb-4d01-8ff2-ee493b5628c5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:47.777699 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f275aa48-e9fb-4d01-8ff2-ee493b5628c5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:47.789370 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-33efed40-ca26-4338-924f-f71b6952da60 req-19f26e6e-c907-4469-b010-5bb90e03ac12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2a62532-3ddd-4eb5-b0c0-3877ff6be556", "name": "network-vif-deleted", "tag": "80b60318-7e7e-4426-9677-d4bdda71e38c"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:16:47.803553 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-33efed40-ca26-4338-924f-f71b6952da60 req-19f26e6e-c907-4469-b010-5bb90e03ac12 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:47.804449 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-33efed40-ca26-4338-924f-f71b6952da60 req-19f26e6e-c907-4469-b010-5bb90e03ac12 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:47.805175 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-33efed40-ca26-4338-924f-f71b6952da60 req-19f26e6e-c907-4469-b010-5bb90e03ac12 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:47.822321 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-33efed40-ca26-4338-924f-f71b6952da60 req-19f26e6e-c907-4469-b010-5bb90e03ac12 service nova] Creating event network-vif-deleted:80b60318-7e7e-4426-9677-d4bdda71e38c for instance d2a62532-3ddd-4eb5-b0c0-3877ff6be556 on nch2-master-1 Sep 24 21:16:47.825651 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:16:47.838159 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-33efed40-ca26-4338-924f-f71b6952da60 req-19f26e6e-c907-4469-b010-5bb90e03ac12 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055147 Sep 24 21:16:47.839413 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2726/5434] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:16:47.901755 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f275aa48-e9fb-4d01-8ff2-ee493b5628c5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:47.912855 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f275aa48-e9fb-4d01-8ff2-ee493b5628c5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:47.914349 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f275aa48-e9fb-4d01-8ff2-ee493b5628c5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:47.915744 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f275aa48-e9fb-4d01-8ff2-ee493b5628c5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.166439 Sep 24 21:16:47.916668 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2709/5435] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:47 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:48.295366 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d38c89f2-fa1d-4ba0-854c-19b856340546 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:48.296085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d38c89f2-fa1d-4ba0-854c-19b856340546 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: d2a62532-3ddd-4eb5-b0c0-3877ff6be556] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:48.303420 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d38c89f2-fa1d-4ba0-854c-19b856340546 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:48.304127 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d38c89f2-fa1d-4ba0-854c-19b856340546 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:48.304610 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d38c89f2-fa1d-4ba0-854c-19b856340546 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:48.306296 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d38c89f2-fa1d-4ba0-854c-19b856340546 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:48.307676 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d38c89f2-fa1d-4ba0-854c-19b856340546 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:48.308112 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d38c89f2-fa1d-4ba0-854c-19b856340546 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:48.325383 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-555c229f-49fc-4033-81ea-368b511c3f92 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:48.326471 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-555c229f-49fc-4033-81ea-368b511c3f92 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] [instance: 55393c6d-70c2-43ad-abbf-fc266238e783] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:48.333561 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-555c229f-49fc-4033-81ea-368b511c3f92 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:48.334149 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-555c229f-49fc-4033-81ea-368b511c3f92 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:48.334700 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-555c229f-49fc-4033-81ea-368b511c3f92 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:48.335662 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-555c229f-49fc-4033-81ea-368b511c3f92 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:48.336253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-555c229f-49fc-4033-81ea-368b511c3f92 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:48.336894 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-555c229f-49fc-4033-81ea-368b511c3f92 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:48.343322 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d38c89f2-fa1d-4ba0-854c-19b856340546 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:48.343909 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d38c89f2-fa1d-4ba0-854c-19b856340546 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:48.344425 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d38c89f2-fa1d-4ba0-854c-19b856340546 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:48.344983 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-d38c89f2-fa1d-4ba0-854c-19b856340546 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lazy-loading 'fault' on Instance uuid d2a62532-3ddd-4eb5-b0c0-3877ff6be556 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:16:48.407704 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d38c89f2-fa1d-4ba0-854c-19b856340546 tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556" status: 200 len: 1452 microversion: 2.1 time: 0.117208 Sep 24 21:16:48.408379 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2727/5436] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:48 2022] GET /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556 => generated 1452 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:48.508185 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-555c229f-49fc-4033-81ea-368b511c3f92 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b53b6cad57584720aa0ecbe097fe92c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3601e0eb4f654079810627bef64cb0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:48.516604 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-555c229f-49fc-4033-81ea-368b511c3f92 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] 10.222.0.52 "GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783" status: 200 len: 1508 microversion: 2.1 time: 0.195520 Sep 24 21:16:48.517295 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2710/5437] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:48 2022] GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783 => generated 1508 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:16:48.942459 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-36d9e8a3-d410-4c92-8639-763193d951f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:48.943627 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-36d9e8a3-d410-4c92-8639-763193d951f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:48.951525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-36d9e8a3-d410-4c92-8639-763193d951f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:48.952009 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-36d9e8a3-d410-4c92-8639-763193d951f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:48.952446 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-36d9e8a3-d410-4c92-8639-763193d951f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:48.953144 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-36d9e8a3-d410-4c92-8639-763193d951f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:48.953600 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-36d9e8a3-d410-4c92-8639-763193d951f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:48.954146 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-36d9e8a3-d410-4c92-8639-763193d951f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:49.017143 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-36d9e8a3-d410-4c92-8639-763193d951f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:49.026757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-36d9e8a3-d410-4c92-8639-763193d951f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:49.030272 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-36d9e8a3-d410-4c92-8639-763193d951f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:49.030272 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-36d9e8a3-d410-4c92-8639-763193d951f3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.091365 Sep 24 21:16:49.030272 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2728/5438] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:48 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:49.435347 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b0cacb67-1618-40d9-b98e-5e648c51befc tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:49.435970 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b0cacb67-1618-40d9-b98e-5e648c51befc tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] [instance: d2a62532-3ddd-4eb5-b0c0-3877ff6be556] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:49.444458 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0cacb67-1618-40d9-b98e-5e648c51befc tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:49.445096 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0cacb67-1618-40d9-b98e-5e648c51befc tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:49.445668 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0cacb67-1618-40d9-b98e-5e648c51befc tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:49.446560 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0cacb67-1618-40d9-b98e-5e648c51befc tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:49.447154 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0cacb67-1618-40d9-b98e-5e648c51befc tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:49.447682 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0cacb67-1618-40d9-b98e-5e648c51befc tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:49.468816 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-b0cacb67-1618-40d9-b98e-5e648c51befc tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] HTTP exception thrown: Instance d2a62532-3ddd-4eb5-b0c0-3877ff6be556 could not be found. Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b0cacb67-1618-40d9-b98e-5e648c51befc tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Request method failure captured: Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556 HTTP/1.1 Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3OZPtoVInN9d1_y3dk1QvAsJLkeq8LxmstsHwhtvEBTaHTNe-Dgv0_wuLU1xDOlhUY0sfKtj_iTMdjIfpAaBEo3XskPoa778P5xi5jZOw_LKWJjaocC0dzcGDXzQlbhtEkJ_ScGWo2Wi4-ABXC7ZJsZhCv2hb2edHKQvCXxKowRLBk Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 0c0033b625ca4995bff138c485673fd8 Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-TestServerMultinode-1551803490 Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: X-Role: admin,reader,member Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: admin,reader,member Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0c0033b625ca4995bff138c485673fd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0c0033b625ca4995bff138c485673fd8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0c0033b625ca4995bff138c485673fd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0c0033b625ca4995bff138c485673fd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-TestServerMultinode-1551803490 Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 0c0033b625ca4995bff138c485673fd8 Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-TestServerMultinode-1551803490 Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-TestServerMultinode-1551803490-project-admin Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: fc712fcf0f814a59bb52e16685ab1c9b Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-TestServerMultinode-1551803490-project-admin Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance d2a62532-3ddd-4eb5-b0c0-3877ff6be556 could not be found. Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'd2a62532-3ddd-4eb5-b0c0-3877ff6be556'} Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2a62532-3ddd-4eb5-b0c0-3877ff6be556 could not be found. Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2a62532-3ddd-4eb5-b0c0-3877ff6be556 could not be found. Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:16:49.471148 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:16:49.476878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:16:49.476878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:16:49.476878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:16:49.476878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:16:49.476878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:16:49.476878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2a62532-3ddd-4eb5-b0c0-3877ff6be556 could not be found. Sep 24 21:16:49.476878 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:16:49.476878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b0cacb67-1618-40d9-b98e-5e648c51befc tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] Returning 404 to user: Instance d2a62532-3ddd-4eb5-b0c0-3877ff6be556 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:16:49.476878 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b0cacb67-1618-40d9-b98e-5e648c51befc tempest-TestServerMultinode-1551803490 tempest-TestServerMultinode-1551803490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556" status: 404 len: 111 microversion: 2.1 time: 0.042109 Sep 24 21:16:49.476878 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2711/5439] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:49 2022] GET /compute/v2.1/servers/d2a62532-3ddd-4eb5-b0c0-3877ff6be556 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:16:49.544681 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-da9593c3-a295-4edb-a994-6b8b3b24d21e tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:49.546107 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-da9593c3-a295-4edb-a994-6b8b3b24d21e tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] [instance: 55393c6d-70c2-43ad-abbf-fc266238e783] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:49.555319 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-da9593c3-a295-4edb-a994-6b8b3b24d21e tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:49.556442 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-da9593c3-a295-4edb-a994-6b8b3b24d21e tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:49.556929 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-da9593c3-a295-4edb-a994-6b8b3b24d21e tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:49.557841 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-da9593c3-a295-4edb-a994-6b8b3b24d21e tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:49.558466 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-da9593c3-a295-4edb-a994-6b8b3b24d21e tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:49.559072 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-da9593c3-a295-4edb-a994-6b8b3b24d21e tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:49.805859 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-da9593c3-a295-4edb-a994-6b8b3b24d21e tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b53b6cad57584720aa0ecbe097fe92c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3601e0eb4f654079810627bef64cb0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:49.828166 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-da9593c3-a295-4edb-a994-6b8b3b24d21e tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] 10.222.0.52 "GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783" status: 200 len: 1508 microversion: 2.1 time: 0.288559 Sep 24 21:16:49.828772 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2729/5440] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:49 2022] GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783 => generated 1508 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:16:50.056030 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e862e809-eedb-4ca6-bf1f-5f04d70385cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:50.056926 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e862e809-eedb-4ca6-bf1f-5f04d70385cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:50.063596 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e862e809-eedb-4ca6-bf1f-5f04d70385cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:50.064314 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e862e809-eedb-4ca6-bf1f-5f04d70385cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:50.065051 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e862e809-eedb-4ca6-bf1f-5f04d70385cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:50.065942 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e862e809-eedb-4ca6-bf1f-5f04d70385cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:50.066633 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e862e809-eedb-4ca6-bf1f-5f04d70385cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:50.068278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e862e809-eedb-4ca6-bf1f-5f04d70385cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:50.169186 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e862e809-eedb-4ca6-bf1f-5f04d70385cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:50.184638 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e862e809-eedb-4ca6-bf1f-5f04d70385cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:50.188051 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e862e809-eedb-4ca6-bf1f-5f04d70385cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:50.189390 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e862e809-eedb-4ca6-bf1f-5f04d70385cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.138671 Sep 24 21:16:50.194582 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2712/5441] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:50 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:50.305383 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-92b6848c-0302-4327-b2bf-bbe8215673cf req-757c8b21-cf99-4b5c-9ddc-d70d35a97d9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55393c6d-70c2-43ad-abbf-fc266238e783", "name": "network-vif-deleted", "tag": "5b8ec8aa-e282-40e1-b730-150ee9dac87d"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:16:50.323197 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-92b6848c-0302-4327-b2bf-bbe8215673cf req-757c8b21-cf99-4b5c-9ddc-d70d35a97d9c service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:50.325668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-92b6848c-0302-4327-b2bf-bbe8215673cf req-757c8b21-cf99-4b5c-9ddc-d70d35a97d9c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:50.326124 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-92b6848c-0302-4327-b2bf-bbe8215673cf req-757c8b21-cf99-4b5c-9ddc-d70d35a97d9c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:50.339417 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-92b6848c-0302-4327-b2bf-bbe8215673cf req-757c8b21-cf99-4b5c-9ddc-d70d35a97d9c service nova] Creating event network-vif-deleted:5b8ec8aa-e282-40e1-b730-150ee9dac87d for instance 55393c6d-70c2-43ad-abbf-fc266238e783 on nch1-master-1 Sep 24 21:16:50.344864 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-92b6848c-0302-4327-b2bf-bbe8215673cf req-757c8b21-cf99-4b5c-9ddc-d70d35a97d9c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.250573 Sep 24 21:16:50.345545 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2730/5442] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:16:50.853652 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-77e9fea8-eb9e-4336-b0a5-7a09d1a65312 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:50.855160 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-77e9fea8-eb9e-4336-b0a5-7a09d1a65312 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] [instance: 55393c6d-70c2-43ad-abbf-fc266238e783] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:50.862605 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-77e9fea8-eb9e-4336-b0a5-7a09d1a65312 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:50.866633 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-77e9fea8-eb9e-4336-b0a5-7a09d1a65312 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:50.867101 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-77e9fea8-eb9e-4336-b0a5-7a09d1a65312 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:50.867855 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-77e9fea8-eb9e-4336-b0a5-7a09d1a65312 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:50.868335 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-77e9fea8-eb9e-4336-b0a5-7a09d1a65312 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:50.868774 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-77e9fea8-eb9e-4336-b0a5-7a09d1a65312 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:50.886289 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-77e9fea8-eb9e-4336-b0a5-7a09d1a65312 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] HTTP exception thrown: Instance 55393c6d-70c2-43ad-abbf-fc266238e783 could not be found. Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-77e9fea8-eb9e-4336-b0a5-7a09d1a65312 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Request method failure captured: Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783 HTTP/1.1 Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3Of9ksitmIsux5y2QmueqFtEx74e-P5UlD69ANyRdNWVPI0ap_IXUg_IYBZrB34yLS80-9LS9tA-Teo5sdHke8z_gqWNwLTu9VpcIwYopJtBTwNd0czzzVG8dP6OwyvVTFHfxkPg_eSXTt_KMnCs7c74OX648In3LUQvg9FuD8bgEA Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 3601e0eb4f654079810627bef64cb0da Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-TestServerAdvancedOps-248279626 Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3601e0eb4f654079810627bef64cb0da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3601e0eb4f654079810627bef64cb0da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3601e0eb4f654079810627bef64cb0da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3601e0eb4f654079810627bef64cb0da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-TestServerAdvancedOps-248279626 Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 3601e0eb4f654079810627bef64cb0da Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-TestServerAdvancedOps-248279626 Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-TestServerAdvancedOps-248279626-project Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: b53b6cad57584720aa0ecbe097fe92c9 Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-TestServerAdvancedOps-248279626-project Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 55393c6d-70c2-43ad-abbf-fc266238e783 could not be found. Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '55393c6d-70c2-43ad-abbf-fc266238e783'} Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55393c6d-70c2-43ad-abbf-fc266238e783 could not be found. Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55393c6d-70c2-43ad-abbf-fc266238e783 could not be found. Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:16:50.888129 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:16:50.892539 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:16:50.892539 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:16:50.892539 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:16:50.892539 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:16:50.892539 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:16:50.892539 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55393c6d-70c2-43ad-abbf-fc266238e783 could not be found. Sep 24 21:16:50.892539 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:16:50.893740 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-77e9fea8-eb9e-4336-b0a5-7a09d1a65312 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] Returning 404 to user: Instance 55393c6d-70c2-43ad-abbf-fc266238e783 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:16:50.894802 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-77e9fea8-eb9e-4336-b0a5-7a09d1a65312 tempest-TestServerAdvancedOps-248279626 tempest-TestServerAdvancedOps-248279626-project] 10.222.0.52 "GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783" status: 404 len: 111 microversion: 2.1 time: 0.046389 Sep 24 21:16:50.900287 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2713/5443] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:16:50 2022] GET /compute/v2.1/servers/55393c6d-70c2-43ad-abbf-fc266238e783 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:16:51.221321 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9c2463fa-f835-4817-9845-59d9d8525348 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:51.222293 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9c2463fa-f835-4817-9845-59d9d8525348 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:51.231057 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c2463fa-f835-4817-9845-59d9d8525348 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:51.231809 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c2463fa-f835-4817-9845-59d9d8525348 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:51.232429 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c2463fa-f835-4817-9845-59d9d8525348 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:51.233321 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c2463fa-f835-4817-9845-59d9d8525348 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:51.233948 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c2463fa-f835-4817-9845-59d9d8525348 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:51.234583 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c2463fa-f835-4817-9845-59d9d8525348 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:51.329645 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9c2463fa-f835-4817-9845-59d9d8525348 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:51.345507 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9c2463fa-f835-4817-9845-59d9d8525348 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:51.347042 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9c2463fa-f835-4817-9845-59d9d8525348 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:51.348775 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9c2463fa-f835-4817-9845-59d9d8525348 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.132557 Sep 24 21:16:51.349930 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2731/5444] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:51 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:51.526643 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-76f4cdb5-1f6b-44fc-84b8-b15487bbdf77 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:16:51.533276 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-76f4cdb5-1f6b-44fc-84b8-b15487bbdf77 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:51.549515 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76f4cdb5-1f6b-44fc-84b8-b15487bbdf77 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:51.555548 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76f4cdb5-1f6b-44fc-84b8-b15487bbdf77 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:51.557869 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76f4cdb5-1f6b-44fc-84b8-b15487bbdf77 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:51.559797 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76f4cdb5-1f6b-44fc-84b8-b15487bbdf77 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:51.560383 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76f4cdb5-1f6b-44fc-84b8-b15487bbdf77 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:51.562340 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-76f4cdb5-1f6b-44fc-84b8-b15487bbdf77 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:51.714227 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-76f4cdb5-1f6b-44fc-84b8-b15487bbdf77 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "POST /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037/action" status: 200 len: 24571 microversion: 2.1 time: 0.194641 Sep 24 21:16:51.722298 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2714/5445] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:16:51 2022] POST /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037/action => generated 24571 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:16:52.375159 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f096d798-8a25-4e0a-aef1-6d01ecbd4e5f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:52.375781 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f096d798-8a25-4e0a-aef1-6d01ecbd4e5f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:52.392496 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f096d798-8a25-4e0a-aef1-6d01ecbd4e5f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:52.393435 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f096d798-8a25-4e0a-aef1-6d01ecbd4e5f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:52.394347 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f096d798-8a25-4e0a-aef1-6d01ecbd4e5f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:52.395560 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f096d798-8a25-4e0a-aef1-6d01ecbd4e5f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:52.396316 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f096d798-8a25-4e0a-aef1-6d01ecbd4e5f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:52.398809 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f096d798-8a25-4e0a-aef1-6d01ecbd4e5f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:52.522019 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f096d798-8a25-4e0a-aef1-6d01ecbd4e5f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:52.536255 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f096d798-8a25-4e0a-aef1-6d01ecbd4e5f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:52.539062 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f096d798-8a25-4e0a-aef1-6d01ecbd4e5f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:52.541013 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f096d798-8a25-4e0a-aef1-6d01ecbd4e5f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.169471 Sep 24 21:16:52.550360 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2732/5446] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:52 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:53.570627 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b1676269-14f4-4498-8f7f-3d23a5ad868d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:53.571431 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b1676269-14f4-4498-8f7f-3d23a5ad868d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:53.581266 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1676269-14f4-4498-8f7f-3d23a5ad868d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:53.581859 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1676269-14f4-4498-8f7f-3d23a5ad868d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:53.582975 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1676269-14f4-4498-8f7f-3d23a5ad868d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:53.583849 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1676269-14f4-4498-8f7f-3d23a5ad868d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:53.585044 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1676269-14f4-4498-8f7f-3d23a5ad868d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:53.585557 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1676269-14f4-4498-8f7f-3d23a5ad868d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:53.704312 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b1676269-14f4-4498-8f7f-3d23a5ad868d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:53.725319 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b1676269-14f4-4498-8f7f-3d23a5ad868d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:53.735963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b1676269-14f4-4498-8f7f-3d23a5ad868d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:53.737538 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b1676269-14f4-4498-8f7f-3d23a5ad868d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.172507 Sep 24 21:16:53.738760 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2715/5447] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:53 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:54.766847 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f5416f2f-1c89-4e02-bc53-ebbb71d1e331 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:54.767765 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f5416f2f-1c89-4e02-bc53-ebbb71d1e331 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:54.780974 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5416f2f-1c89-4e02-bc53-ebbb71d1e331 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:54.781916 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5416f2f-1c89-4e02-bc53-ebbb71d1e331 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:54.783034 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5416f2f-1c89-4e02-bc53-ebbb71d1e331 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:54.784793 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5416f2f-1c89-4e02-bc53-ebbb71d1e331 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:54.786460 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5416f2f-1c89-4e02-bc53-ebbb71d1e331 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:54.787365 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5416f2f-1c89-4e02-bc53-ebbb71d1e331 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:54.871524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f5416f2f-1c89-4e02-bc53-ebbb71d1e331 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:54.885421 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f5416f2f-1c89-4e02-bc53-ebbb71d1e331 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:54.886931 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f5416f2f-1c89-4e02-bc53-ebbb71d1e331 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:54.888804 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f5416f2f-1c89-4e02-bc53-ebbb71d1e331 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.127397 Sep 24 21:16:54.890292 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2733/5448] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:54 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:55.568917 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7b628190-b32b-4bbe-91ad-6d8c06b3dfe8 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:16:55.571248 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7b628190-b32b-4bbe-91ad-6d8c06b3dfe8 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 15287602-2fd6-4d60-9d26-662b52d6c547] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:55.578212 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b628190-b32b-4bbe-91ad-6d8c06b3dfe8 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:55.578984 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b628190-b32b-4bbe-91ad-6d8c06b3dfe8 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:55.579586 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b628190-b32b-4bbe-91ad-6d8c06b3dfe8 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:55.580479 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b628190-b32b-4bbe-91ad-6d8c06b3dfe8 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:55.581110 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b628190-b32b-4bbe-91ad-6d8c06b3dfe8 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:55.581691 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b628190-b32b-4bbe-91ad-6d8c06b3dfe8 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:55.644633 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7b628190-b32b-4bbe-91ad-6d8c06b3dfe8 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "POST /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547/action" status: 200 len: 24533 microversion: 2.1 time: 0.080054 Sep 24 21:16:55.652046 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2716/5449] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:16:55 2022] POST /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547/action => generated 24533 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:16:55.917575 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7d2b2a38-69e5-4b32-ad11-b86f36bc47ec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:55.918077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7d2b2a38-69e5-4b32-ad11-b86f36bc47ec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:55.926549 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d2b2a38-69e5-4b32-ad11-b86f36bc47ec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:55.927388 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d2b2a38-69e5-4b32-ad11-b86f36bc47ec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:55.928073 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d2b2a38-69e5-4b32-ad11-b86f36bc47ec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:55.929045 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d2b2a38-69e5-4b32-ad11-b86f36bc47ec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:55.929569 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d2b2a38-69e5-4b32-ad11-b86f36bc47ec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:55.930205 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d2b2a38-69e5-4b32-ad11-b86f36bc47ec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:56.028482 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7d2b2a38-69e5-4b32-ad11-b86f36bc47ec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:56.037829 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7d2b2a38-69e5-4b32-ad11-b86f36bc47ec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:56.039320 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7d2b2a38-69e5-4b32-ad11-b86f36bc47ec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:56.040478 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7d2b2a38-69e5-4b32-ad11-b86f36bc47ec tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.127338 Sep 24 21:16:56.041048 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2734/5450] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:55 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:57.070463 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-df84fc2e-6c2d-4f63-9b68-e3a4846f627c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:57.072481 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-df84fc2e-6c2d-4f63-9b68-e3a4846f627c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:57.085279 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-df84fc2e-6c2d-4f63-9b68-e3a4846f627c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:57.085992 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-df84fc2e-6c2d-4f63-9b68-e3a4846f627c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:57.086991 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-df84fc2e-6c2d-4f63-9b68-e3a4846f627c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:57.088285 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-df84fc2e-6c2d-4f63-9b68-e3a4846f627c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:57.089578 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-df84fc2e-6c2d-4f63-9b68-e3a4846f627c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:57.090295 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-df84fc2e-6c2d-4f63-9b68-e3a4846f627c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:57.181088 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-df84fc2e-6c2d-4f63-9b68-e3a4846f627c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:57.201352 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-df84fc2e-6c2d-4f63-9b68-e3a4846f627c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:57.204221 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-df84fc2e-6c2d-4f63-9b68-e3a4846f627c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:57.205991 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-df84fc2e-6c2d-4f63-9b68-e3a4846f627c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.141679 Sep 24 21:16:57.207230 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2717/5451] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:57 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:58.235839 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b218e3ac-5803-4602-b106-2531a0a629c0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:58.237393 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b218e3ac-5803-4602-b106-2531a0a629c0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:58.245507 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b218e3ac-5803-4602-b106-2531a0a629c0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:58.246644 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b218e3ac-5803-4602-b106-2531a0a629c0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:58.247290 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b218e3ac-5803-4602-b106-2531a0a629c0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:58.248179 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b218e3ac-5803-4602-b106-2531a0a629c0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:58.249146 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b218e3ac-5803-4602-b106-2531a0a629c0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:58.249728 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b218e3ac-5803-4602-b106-2531a0a629c0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:58.328870 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b218e3ac-5803-4602-b106-2531a0a629c0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:58.344196 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b218e3ac-5803-4602-b106-2531a0a629c0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:58.346185 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b218e3ac-5803-4602-b106-2531a0a629c0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:58.350863 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b218e3ac-5803-4602-b106-2531a0a629c0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.120092 Sep 24 21:16:58.358620 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2735/5452] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:58 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:16:59.378119 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-715f14c3-c8ea-437e-b401-e10799ad72c5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:16:59.378934 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-715f14c3-c8ea-437e-b401-e10799ad72c5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:16:59.387813 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-715f14c3-c8ea-437e-b401-e10799ad72c5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:59.388454 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-715f14c3-c8ea-437e-b401-e10799ad72c5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:59.388960 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-715f14c3-c8ea-437e-b401-e10799ad72c5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:59.389908 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-715f14c3-c8ea-437e-b401-e10799ad72c5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:16:59.393549 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-715f14c3-c8ea-437e-b401-e10799ad72c5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:16:59.394209 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-715f14c3-c8ea-437e-b401-e10799ad72c5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:16:59.480064 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-715f14c3-c8ea-437e-b401-e10799ad72c5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:59.490348 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-715f14c3-c8ea-437e-b401-e10799ad72c5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:59.492127 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-715f14c3-c8ea-437e-b401-e10799ad72c5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:16:59.493300 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-715f14c3-c8ea-437e-b401-e10799ad72c5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.119937 Sep 24 21:16:59.494233 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2718/5453] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:16:59 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:00.517966 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-588bb9b1-5881-455d-8eb8-9ec7827e8567 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:00.518722 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-588bb9b1-5881-455d-8eb8-9ec7827e8567 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:00.526710 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-588bb9b1-5881-455d-8eb8-9ec7827e8567 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:00.528292 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-588bb9b1-5881-455d-8eb8-9ec7827e8567 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:00.530132 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-588bb9b1-5881-455d-8eb8-9ec7827e8567 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:00.531202 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-588bb9b1-5881-455d-8eb8-9ec7827e8567 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:00.531616 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-588bb9b1-5881-455d-8eb8-9ec7827e8567 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:00.532114 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-588bb9b1-5881-455d-8eb8-9ec7827e8567 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:00.621107 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-588bb9b1-5881-455d-8eb8-9ec7827e8567 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:00.632060 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-588bb9b1-5881-455d-8eb8-9ec7827e8567 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:00.632060 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-588bb9b1-5881-455d-8eb8-9ec7827e8567 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:00.633461 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-588bb9b1-5881-455d-8eb8-9ec7827e8567 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.119358 Sep 24 21:17:00.634212 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2736/5454] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:00 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:01.660157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ac4c8500-d80b-4623-b483-8c1b15d1e0f7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:01.661221 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ac4c8500-d80b-4623-b483-8c1b15d1e0f7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:01.673313 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=82 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:17:01.677354 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac4c8500-d80b-4623-b483-8c1b15d1e0f7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:01.679422 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac4c8500-d80b-4623-b483-8c1b15d1e0f7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:01.680334 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac4c8500-d80b-4623-b483-8c1b15d1e0f7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:01.695452 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac4c8500-d80b-4623-b483-8c1b15d1e0f7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:01.695939 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac4c8500-d80b-4623-b483-8c1b15d1e0f7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:01.696382 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac4c8500-d80b-4623-b483-8c1b15d1e0f7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:01.794255 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ac4c8500-d80b-4623-b483-8c1b15d1e0f7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:01.808603 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ac4c8500-d80b-4623-b483-8c1b15d1e0f7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:01.810731 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ac4c8500-d80b-4623-b483-8c1b15d1e0f7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:01.812288 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ac4c8500-d80b-4623-b483-8c1b15d1e0f7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.156526 Sep 24 21:17:01.812980 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2719/5455] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:01 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:02.805645 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-638af53f-32e2-44c5-b442-90c3dae6fca5 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:02.806865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-638af53f-32e2-44c5-b442-90c3dae6fca5 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:02.819812 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-638af53f-32e2-44c5-b442-90c3dae6fca5 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:02.823081 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-638af53f-32e2-44c5-b442-90c3dae6fca5 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:02.823628 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-638af53f-32e2-44c5-b442-90c3dae6fca5 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:02.824456 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-638af53f-32e2-44c5-b442-90c3dae6fca5 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:02.824997 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-638af53f-32e2-44c5-b442-90c3dae6fca5 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:02.825673 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-638af53f-32e2-44c5-b442-90c3dae6fca5 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:02.845443 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3eae78fd-1a10-44c0-9339-b502e01c7775 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:02.846684 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3eae78fd-1a10-44c0-9339-b502e01c7775 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:02.861954 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3eae78fd-1a10-44c0-9339-b502e01c7775 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:02.862721 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3eae78fd-1a10-44c0-9339-b502e01c7775 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:02.864095 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3eae78fd-1a10-44c0-9339-b502e01c7775 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:02.869427 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3eae78fd-1a10-44c0-9339-b502e01c7775 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:02.870251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3eae78fd-1a10-44c0-9339-b502e01c7775 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:02.870881 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3eae78fd-1a10-44c0-9339-b502e01c7775 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:02.980065 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3eae78fd-1a10-44c0-9339-b502e01c7775 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:02.998326 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3eae78fd-1a10-44c0-9339-b502e01c7775 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:03.001059 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3eae78fd-1a10-44c0-9339-b502e01c7775 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:03.002268 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3eae78fd-1a10-44c0-9339-b502e01c7775 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.160785 Sep 24 21:17:03.003372 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2720/5456] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:02 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:03.292525 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-638af53f-32e2-44c5-b442-90c3dae6fca5 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1835 microversion: 2.1 time: 0.490434 Sep 24 21:17:03.293525 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2737/5457] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:17:02 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1835 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:17:03.319944 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a2f7799c-022b-4c46-8b91-caf909a16816 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:03.323340 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a2f7799c-022b-4c46-8b91-caf909a16816 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:03.332728 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2f7799c-022b-4c46-8b91-caf909a16816 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:03.333336 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2f7799c-022b-4c46-8b91-caf909a16816 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:03.333799 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2f7799c-022b-4c46-8b91-caf909a16816 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:03.334592 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2f7799c-022b-4c46-8b91-caf909a16816 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:03.335032 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2f7799c-022b-4c46-8b91-caf909a16816 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:03.335476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2f7799c-022b-4c46-8b91-caf909a16816 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:03.575735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a2f7799c-022b-4c46-8b91-caf909a16816 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:03.595096 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a2f7799c-022b-4c46-8b91-caf909a16816 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1684 microversion: 2.1 time: 0.282767 Sep 24 21:17:03.596155 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2721/5458] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:17:03 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1684 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:17:03.714664 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8712117b-be64-494c-bf9b-79d7baf50c1e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:17:03.717647 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8712117b-be64-494c-bf9b-79d7baf50c1e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:03.732791 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8712117b-be64-494c-bf9b-79d7baf50c1e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:03.736989 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8712117b-be64-494c-bf9b-79d7baf50c1e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:03.737526 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8712117b-be64-494c-bf9b-79d7baf50c1e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:03.739095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8712117b-be64-494c-bf9b-79d7baf50c1e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:03.741639 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8712117b-be64-494c-bf9b-79d7baf50c1e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:03.742106 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8712117b-be64-494c-bf9b-79d7baf50c1e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:03.842420 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8712117b-be64-494c-bf9b-79d7baf50c1e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "POST /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037/action" status: 200 len: 32641 microversion: 2.1 time: 0.129867 Sep 24 21:17:03.844838 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2738/5459] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:17:03 2022] POST /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037/action => generated 32641 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:17:03.979073 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2f50983e-13ab-4900-8a26-bb60e2f92773 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:17:03.981646 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2f50983e-13ab-4900-8a26-bb60e2f92773 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:03.991467 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f50983e-13ab-4900-8a26-bb60e2f92773 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:03.992201 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f50983e-13ab-4900-8a26-bb60e2f92773 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:03.992929 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f50983e-13ab-4900-8a26-bb60e2f92773 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:03.993869 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f50983e-13ab-4900-8a26-bb60e2f92773 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:03.994517 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f50983e-13ab-4900-8a26-bb60e2f92773 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:03.995850 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f50983e-13ab-4900-8a26-bb60e2f92773 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:04.034876 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-77bbd2c6-6752-4e5d-88ae-4cee5cf6fc44 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:04.036878 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-77bbd2c6-6752-4e5d-88ae-4cee5cf6fc44 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:04.060612 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77bbd2c6-6752-4e5d-88ae-4cee5cf6fc44 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:04.062184 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77bbd2c6-6752-4e5d-88ae-4cee5cf6fc44 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:04.064472 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77bbd2c6-6752-4e5d-88ae-4cee5cf6fc44 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:04.065945 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77bbd2c6-6752-4e5d-88ae-4cee5cf6fc44 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:04.068184 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77bbd2c6-6752-4e5d-88ae-4cee5cf6fc44 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:04.069778 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77bbd2c6-6752-4e5d-88ae-4cee5cf6fc44 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:04.087468 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:17:04.213107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2f50983e-13ab-4900-8a26-bb60e2f92773 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3246fd815aa74d33b8eaeffcd719e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f4287f4d0b4f2281d6c40edcba11fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:04.214042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2f50983e-13ab-4900-8a26-bb60e2f92773 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] [instance: 97863e58-47a8-44be-a268-26807a10f037] flavor_id is None. Assuming migration. {{(pid=140516) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 24 21:17:04.215028 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2f50983e-13ab-4900-8a26-bb60e2f92773 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] [instance: 97863e58-47a8-44be-a268-26807a10f037] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=140516) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 24 21:17:04.279747 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-77bbd2c6-6752-4e5d-88ae-4cee5cf6fc44 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:04.289217 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-77bbd2c6-6752-4e5d-88ae-4cee5cf6fc44 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:04.290607 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-77bbd2c6-6752-4e5d-88ae-4cee5cf6fc44 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:04.293937 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-77bbd2c6-6752-4e5d-88ae-4cee5cf6fc44 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.268310 Sep 24 21:17:04.295068 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2739/5460] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:04 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:17:04.384996 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2f50983e-13ab-4900-8a26-bb60e2f92773 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037/action" status: 202 len: 0 microversion: 2.1 time: 0.411497 Sep 24 21:17:04.386319 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2722/5461] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:17:03 2022] POST /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037/action => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:17:04.396269 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c3fc5fd3-2406-4128-9d1a-9708dc855386 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:04.397037 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c3fc5fd3-2406-4128-9d1a-9708dc855386 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:04.418612 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c3fc5fd3-2406-4128-9d1a-9708dc855386 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:04.420632 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c3fc5fd3-2406-4128-9d1a-9708dc855386 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:04.422346 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c3fc5fd3-2406-4128-9d1a-9708dc855386 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:04.423483 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c3fc5fd3-2406-4128-9d1a-9708dc855386 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:04.425306 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c3fc5fd3-2406-4128-9d1a-9708dc855386 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:04.427219 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c3fc5fd3-2406-4128-9d1a-9708dc855386 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:04.819721 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c3fc5fd3-2406-4128-9d1a-9708dc855386 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:04.830280 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c3fc5fd3-2406-4128-9d1a-9708dc855386 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1693 microversion: 2.1 time: 0.439511 Sep 24 21:17:04.839171 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2740/5462] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:17:04 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1693 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:17:05.330846 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0065fec0-6e05-45e9-b5dd-e8125056d68b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:05.334171 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0065fec0-6e05-45e9-b5dd-e8125056d68b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:05.353180 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0065fec0-6e05-45e9-b5dd-e8125056d68b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:05.353679 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0065fec0-6e05-45e9-b5dd-e8125056d68b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:05.358308 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0065fec0-6e05-45e9-b5dd-e8125056d68b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:05.359135 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0065fec0-6e05-45e9-b5dd-e8125056d68b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:05.359627 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0065fec0-6e05-45e9-b5dd-e8125056d68b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:05.360069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0065fec0-6e05-45e9-b5dd-e8125056d68b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:05.465747 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0065fec0-6e05-45e9-b5dd-e8125056d68b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:05.485125 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0065fec0-6e05-45e9-b5dd-e8125056d68b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:05.486804 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0065fec0-6e05-45e9-b5dd-e8125056d68b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:05.489546 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0065fec0-6e05-45e9-b5dd-e8125056d68b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.173277 Sep 24 21:17:05.490638 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2723/5463] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:05 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:05.861987 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b619e9e7-1bff-43ce-a99a-88b8c7c98dc1 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:05.863900 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b619e9e7-1bff-43ce-a99a-88b8c7c98dc1 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:05.883416 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b619e9e7-1bff-43ce-a99a-88b8c7c98dc1 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:05.884459 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b619e9e7-1bff-43ce-a99a-88b8c7c98dc1 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:05.885372 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b619e9e7-1bff-43ce-a99a-88b8c7c98dc1 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:05.887861 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b619e9e7-1bff-43ce-a99a-88b8c7c98dc1 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:05.890113 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b619e9e7-1bff-43ce-a99a-88b8c7c98dc1 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:05.896416 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b619e9e7-1bff-43ce-a99a-88b8c7c98dc1 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:06.147716 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b619e9e7-1bff-43ce-a99a-88b8c7c98dc1 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:06.159509 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b619e9e7-1bff-43ce-a99a-88b8c7c98dc1 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1693 microversion: 2.1 time: 0.305685 Sep 24 21:17:06.160211 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2741/5464] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:17:05 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1693 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:17:06.515220 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9843b9ce-5734-49f1-8ad0-2e01503a2cb4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:06.515977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9843b9ce-5734-49f1-8ad0-2e01503a2cb4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:06.529526 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9843b9ce-5734-49f1-8ad0-2e01503a2cb4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:06.530030 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9843b9ce-5734-49f1-8ad0-2e01503a2cb4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:06.530476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9843b9ce-5734-49f1-8ad0-2e01503a2cb4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:06.531266 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9843b9ce-5734-49f1-8ad0-2e01503a2cb4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:06.531725 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9843b9ce-5734-49f1-8ad0-2e01503a2cb4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:06.532156 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9843b9ce-5734-49f1-8ad0-2e01503a2cb4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:06.630045 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9843b9ce-5734-49f1-8ad0-2e01503a2cb4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:06.646536 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9843b9ce-5734-49f1-8ad0-2e01503a2cb4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:06.649250 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9843b9ce-5734-49f1-8ad0-2e01503a2cb4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:06.651957 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9843b9ce-5734-49f1-8ad0-2e01503a2cb4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.140963 Sep 24 21:17:06.653208 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2724/5465] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:06 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:07.185217 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-38ee5d91-b936-41c9-9937-46073a8219a3 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:07.185741 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-38ee5d91-b936-41c9-9937-46073a8219a3 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:07.194352 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38ee5d91-b936-41c9-9937-46073a8219a3 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:07.194886 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38ee5d91-b936-41c9-9937-46073a8219a3 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:07.195385 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38ee5d91-b936-41c9-9937-46073a8219a3 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:07.196104 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38ee5d91-b936-41c9-9937-46073a8219a3 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:07.196565 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38ee5d91-b936-41c9-9937-46073a8219a3 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:07.203689 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38ee5d91-b936-41c9-9937-46073a8219a3 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:07.535796 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-38ee5d91-b936-41c9-9937-46073a8219a3 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:07.545227 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-38ee5d91-b936-41c9-9937-46073a8219a3 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1693 microversion: 2.1 time: 0.364334 Sep 24 21:17:07.546984 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2742/5466] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:17:07 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1693 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:17:07.681810 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0288f91e-d776-42e4-93c1-cfafb6b859f8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:07.685651 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0288f91e-d776-42e4-93c1-cfafb6b859f8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:07.704854 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0288f91e-d776-42e4-93c1-cfafb6b859f8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:07.705366 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0288f91e-d776-42e4-93c1-cfafb6b859f8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:07.705816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0288f91e-d776-42e4-93c1-cfafb6b859f8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:07.707115 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0288f91e-d776-42e4-93c1-cfafb6b859f8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:07.707597 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0288f91e-d776-42e4-93c1-cfafb6b859f8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:07.708149 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0288f91e-d776-42e4-93c1-cfafb6b859f8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:07.841675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0288f91e-d776-42e4-93c1-cfafb6b859f8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:07.851523 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0288f91e-d776-42e4-93c1-cfafb6b859f8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:07.853017 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0288f91e-d776-42e4-93c1-cfafb6b859f8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:07.854245 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0288f91e-d776-42e4-93c1-cfafb6b859f8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.176545 Sep 24 21:17:07.854858 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2725/5467] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:07 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:08.569707 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c359a366-529f-44c8-930c-37839da0ed5d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:08.570457 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c359a366-529f-44c8-930c-37839da0ed5d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:08.588835 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c359a366-529f-44c8-930c-37839da0ed5d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:08.590534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c359a366-529f-44c8-930c-37839da0ed5d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:08.591188 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c359a366-529f-44c8-930c-37839da0ed5d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:08.592610 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c359a366-529f-44c8-930c-37839da0ed5d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:08.594569 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c359a366-529f-44c8-930c-37839da0ed5d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:08.595441 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c359a366-529f-44c8-930c-37839da0ed5d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:08.861174 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c359a366-529f-44c8-930c-37839da0ed5d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:08.871809 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c359a366-529f-44c8-930c-37839da0ed5d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1698 microversion: 2.1 time: 0.306257 Sep 24 21:17:08.873295 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2743/5468] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:17:08 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1698 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:17:08.892147 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1f83bf12-06dd-44e8-8aab-d564db87c858 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:08.893365 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1f83bf12-06dd-44e8-8aab-d564db87c858 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:08.901499 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f83bf12-06dd-44e8-8aab-d564db87c858 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:08.901994 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f83bf12-06dd-44e8-8aab-d564db87c858 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:08.902438 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f83bf12-06dd-44e8-8aab-d564db87c858 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:08.903201 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f83bf12-06dd-44e8-8aab-d564db87c858 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:08.903669 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f83bf12-06dd-44e8-8aab-d564db87c858 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:08.904104 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f83bf12-06dd-44e8-8aab-d564db87c858 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:08.921178 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:17:09.018237 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1f83bf12-06dd-44e8-8aab-d564db87c858 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:09.028327 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1f83bf12-06dd-44e8-8aab-d564db87c858 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:09.029860 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1f83bf12-06dd-44e8-8aab-d564db87c858 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:09.031098 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1f83bf12-06dd-44e8-8aab-d564db87c858 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.143089 Sep 24 21:17:09.031670 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2726/5469] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:08 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:09.900808 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0449d631-140c-4d21-9e37-a0e5a862dc15 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:09.902072 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0449d631-140c-4d21-9e37-a0e5a862dc15 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:09.909493 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0449d631-140c-4d21-9e37-a0e5a862dc15 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:09.911508 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0449d631-140c-4d21-9e37-a0e5a862dc15 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:09.911953 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0449d631-140c-4d21-9e37-a0e5a862dc15 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:09.912870 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0449d631-140c-4d21-9e37-a0e5a862dc15 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:09.913362 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0449d631-140c-4d21-9e37-a0e5a862dc15 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:09.913955 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0449d631-140c-4d21-9e37-a0e5a862dc15 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:10.057668 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4137b837-af02-4338-95cc-54cccded06d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:10.058288 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4137b837-af02-4338-95cc-54cccded06d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:10.076939 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4137b837-af02-4338-95cc-54cccded06d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:10.078005 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4137b837-af02-4338-95cc-54cccded06d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:10.078735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4137b837-af02-4338-95cc-54cccded06d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:10.079507 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4137b837-af02-4338-95cc-54cccded06d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:10.080315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4137b837-af02-4338-95cc-54cccded06d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:10.082483 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4137b837-af02-4338-95cc-54cccded06d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:10.233837 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4137b837-af02-4338-95cc-54cccded06d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:10.244024 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4137b837-af02-4338-95cc-54cccded06d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:10.245562 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4137b837-af02-4338-95cc-54cccded06d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:10.247137 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4137b837-af02-4338-95cc-54cccded06d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.193387 Sep 24 21:17:10.248154 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2727/5470] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:10 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:17:10.279801 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0449d631-140c-4d21-9e37-a0e5a862dc15 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:10.287964 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0449d631-140c-4d21-9e37-a0e5a862dc15 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1698 microversion: 2.1 time: 0.391617 Sep 24 21:17:10.289218 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2744/5471] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:17:09 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1698 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:17:11.274201 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fba5681f-1504-48ed-8d5e-b3997c8d4dcb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:11.287914 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fba5681f-1504-48ed-8d5e-b3997c8d4dcb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:11.305419 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fba5681f-1504-48ed-8d5e-b3997c8d4dcb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:11.311947 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c7d3d6f9-9e69-4b24-907f-9cee5c6cb1a3 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:11.313220 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c7d3d6f9-9e69-4b24-907f-9cee5c6cb1a3 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:11.313348 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fba5681f-1504-48ed-8d5e-b3997c8d4dcb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:11.315304 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fba5681f-1504-48ed-8d5e-b3997c8d4dcb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:11.318825 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fba5681f-1504-48ed-8d5e-b3997c8d4dcb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:11.322248 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fba5681f-1504-48ed-8d5e-b3997c8d4dcb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:11.324400 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fba5681f-1504-48ed-8d5e-b3997c8d4dcb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:11.329893 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c7d3d6f9-9e69-4b24-907f-9cee5c6cb1a3 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:11.330686 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c7d3d6f9-9e69-4b24-907f-9cee5c6cb1a3 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:11.333264 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c7d3d6f9-9e69-4b24-907f-9cee5c6cb1a3 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:11.334281 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c7d3d6f9-9e69-4b24-907f-9cee5c6cb1a3 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:11.335609 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c7d3d6f9-9e69-4b24-907f-9cee5c6cb1a3 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:11.337587 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c7d3d6f9-9e69-4b24-907f-9cee5c6cb1a3 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:11.527848 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fba5681f-1504-48ed-8d5e-b3997c8d4dcb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:11.538968 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fba5681f-1504-48ed-8d5e-b3997c8d4dcb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:11.541448 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fba5681f-1504-48ed-8d5e-b3997c8d4dcb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:11.543091 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fba5681f-1504-48ed-8d5e-b3997c8d4dcb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.273670 Sep 24 21:17:11.548751 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2728/5472] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:11 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:11.640417 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c7d3d6f9-9e69-4b24-907f-9cee5c6cb1a3 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:11.650928 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c7d3d6f9-9e69-4b24-907f-9cee5c6cb1a3 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1698 microversion: 2.1 time: 0.342393 Sep 24 21:17:11.652015 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2745/5473] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:17:11 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1698 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:17:12.579360 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ec8ac111-15b3-4cb8-87a2-2ec0b592542d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:12.580740 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ec8ac111-15b3-4cb8-87a2-2ec0b592542d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:12.593482 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ec8ac111-15b3-4cb8-87a2-2ec0b592542d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:12.593482 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ec8ac111-15b3-4cb8-87a2-2ec0b592542d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:12.593482 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ec8ac111-15b3-4cb8-87a2-2ec0b592542d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:12.593482 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ec8ac111-15b3-4cb8-87a2-2ec0b592542d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:12.593482 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ec8ac111-15b3-4cb8-87a2-2ec0b592542d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:12.594015 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ec8ac111-15b3-4cb8-87a2-2ec0b592542d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:12.674268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-754040d6-c572-4eb0-93c9-35c5d59bb323 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:12.674921 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-754040d6-c572-4eb0-93c9-35c5d59bb323 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:12.683678 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-754040d6-c572-4eb0-93c9-35c5d59bb323 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:12.684326 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-754040d6-c572-4eb0-93c9-35c5d59bb323 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:12.685149 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-754040d6-c572-4eb0-93c9-35c5d59bb323 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:12.686992 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-754040d6-c572-4eb0-93c9-35c5d59bb323 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:12.688008 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-754040d6-c572-4eb0-93c9-35c5d59bb323 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:12.688554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-754040d6-c572-4eb0-93c9-35c5d59bb323 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:12.952257 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-754040d6-c572-4eb0-93c9-35c5d59bb323 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:12.960993 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-754040d6-c572-4eb0-93c9-35c5d59bb323 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1698 microversion: 2.1 time: 0.290364 Sep 24 21:17:12.961831 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2746/5474] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:17:12 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1698 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:17:12.978062 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ec8ac111-15b3-4cb8-87a2-2ec0b592542d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:12.978062 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ec8ac111-15b3-4cb8-87a2-2ec0b592542d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:12.978062 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ec8ac111-15b3-4cb8-87a2-2ec0b592542d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:12.978062 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ec8ac111-15b3-4cb8-87a2-2ec0b592542d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.407255 Sep 24 21:17:12.979342 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2729/5475] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:12 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:13.985406 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-15d8a4d8-a74c-4a11-a333-3edaa0f1bdf2 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:13.986030 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-15d8a4d8-a74c-4a11-a333-3edaa0f1bdf2 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:13.993666 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15d8a4d8-a74c-4a11-a333-3edaa0f1bdf2 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:13.994169 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15d8a4d8-a74c-4a11-a333-3edaa0f1bdf2 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:13.994715 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15d8a4d8-a74c-4a11-a333-3edaa0f1bdf2 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:13.995477 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15d8a4d8-a74c-4a11-a333-3edaa0f1bdf2 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:13.995922 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15d8a4d8-a74c-4a11-a333-3edaa0f1bdf2 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:13.996354 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15d8a4d8-a74c-4a11-a333-3edaa0f1bdf2 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:14.005413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b69adbe5-8b5b-4196-bb68-0acdea313e8b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:14.006038 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b69adbe5-8b5b-4196-bb68-0acdea313e8b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:14.013681 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b69adbe5-8b5b-4196-bb68-0acdea313e8b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:14.014354 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b69adbe5-8b5b-4196-bb68-0acdea313e8b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:14.015191 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b69adbe5-8b5b-4196-bb68-0acdea313e8b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:14.016095 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b69adbe5-8b5b-4196-bb68-0acdea313e8b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:14.016855 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b69adbe5-8b5b-4196-bb68-0acdea313e8b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:14.017450 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b69adbe5-8b5b-4196-bb68-0acdea313e8b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:14.109825 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b69adbe5-8b5b-4196-bb68-0acdea313e8b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:14.121956 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b69adbe5-8b5b-4196-bb68-0acdea313e8b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:14.123467 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b69adbe5-8b5b-4196-bb68-0acdea313e8b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:14.124706 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b69adbe5-8b5b-4196-bb68-0acdea313e8b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.123448 Sep 24 21:17:14.135398 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2730/5476] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:14 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:17:14.173048 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-15d8a4d8-a74c-4a11-a333-3edaa0f1bdf2 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:14.181928 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-15d8a4d8-a74c-4a11-a333-3edaa0f1bdf2 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1698 microversion: 2.1 time: 0.200562 Sep 24 21:17:14.182564 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2747/5477] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:17:13 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1698 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:17:15.151310 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f186ef94-94a6-48cf-b78d-e075393b58f8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:15.151964 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f186ef94-94a6-48cf-b78d-e075393b58f8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:15.158944 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f186ef94-94a6-48cf-b78d-e075393b58f8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:15.160053 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f186ef94-94a6-48cf-b78d-e075393b58f8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:15.160685 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f186ef94-94a6-48cf-b78d-e075393b58f8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:15.161396 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f186ef94-94a6-48cf-b78d-e075393b58f8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:15.161856 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f186ef94-94a6-48cf-b78d-e075393b58f8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:15.162291 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f186ef94-94a6-48cf-b78d-e075393b58f8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:15.205983 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-14847fec-146b-4a28-a703-6011714ff9d4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:15.207305 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-14847fec-146b-4a28-a703-6011714ff9d4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:15.214737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-14847fec-146b-4a28-a703-6011714ff9d4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:15.215378 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-14847fec-146b-4a28-a703-6011714ff9d4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:15.215945 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-14847fec-146b-4a28-a703-6011714ff9d4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:15.216771 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-14847fec-146b-4a28-a703-6011714ff9d4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:15.217428 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-14847fec-146b-4a28-a703-6011714ff9d4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:15.217946 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-14847fec-146b-4a28-a703-6011714ff9d4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:15.234971 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f186ef94-94a6-48cf-b78d-e075393b58f8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:15.244989 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f186ef94-94a6-48cf-b78d-e075393b58f8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:15.246807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f186ef94-94a6-48cf-b78d-e075393b58f8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:15.248001 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f186ef94-94a6-48cf-b78d-e075393b58f8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.101286 Sep 24 21:17:15.250534 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2731/5478] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:15 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:15.370931 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-14847fec-146b-4a28-a703-6011714ff9d4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:15.379132 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-14847fec-146b-4a28-a703-6011714ff9d4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1698 microversion: 2.1 time: 0.176853 Sep 24 21:17:15.379720 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2748/5479] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:17:15 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1698 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:17:16.273943 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-31c7bb39-8c4f-4947-9e96-539baac05642 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:16.274478 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-31c7bb39-8c4f-4947-9e96-539baac05642 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:16.281898 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-31c7bb39-8c4f-4947-9e96-539baac05642 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:16.282394 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-31c7bb39-8c4f-4947-9e96-539baac05642 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:16.282862 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-31c7bb39-8c4f-4947-9e96-539baac05642 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:16.283572 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-31c7bb39-8c4f-4947-9e96-539baac05642 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:16.284043 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-31c7bb39-8c4f-4947-9e96-539baac05642 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:16.284509 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-31c7bb39-8c4f-4947-9e96-539baac05642 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:16.349544 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-31c7bb39-8c4f-4947-9e96-539baac05642 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:16.358288 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-31c7bb39-8c4f-4947-9e96-539baac05642 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:16.359801 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-31c7bb39-8c4f-4947-9e96-539baac05642 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:16.360963 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-31c7bb39-8c4f-4947-9e96-539baac05642 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.091207 Sep 24 21:17:16.361537 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2732/5480] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:16 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:17:16.403750 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1353d5b7-db92-4310-a132-ee9b477862c7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:16.404379 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1353d5b7-db92-4310-a132-ee9b477862c7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:16.411388 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1353d5b7-db92-4310-a132-ee9b477862c7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:16.411886 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1353d5b7-db92-4310-a132-ee9b477862c7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:16.412338 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1353d5b7-db92-4310-a132-ee9b477862c7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:16.413054 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1353d5b7-db92-4310-a132-ee9b477862c7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:16.413525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1353d5b7-db92-4310-a132-ee9b477862c7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:16.413965 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1353d5b7-db92-4310-a132-ee9b477862c7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:16.559089 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1353d5b7-db92-4310-a132-ee9b477862c7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:16.567629 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1353d5b7-db92-4310-a132-ee9b477862c7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1698 microversion: 2.1 time: 0.168102 Sep 24 21:17:16.568213 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2749/5481] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:17:16 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1698 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:17:17.386368 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c767515f-e6f0-43a6-81ab-6cf4b10b7d7d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:17.387029 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c767515f-e6f0-43a6-81ab-6cf4b10b7d7d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:17.394219 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c767515f-e6f0-43a6-81ab-6cf4b10b7d7d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:17.394765 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c767515f-e6f0-43a6-81ab-6cf4b10b7d7d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:17.395212 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c767515f-e6f0-43a6-81ab-6cf4b10b7d7d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:17.395917 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c767515f-e6f0-43a6-81ab-6cf4b10b7d7d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:17.396379 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c767515f-e6f0-43a6-81ab-6cf4b10b7d7d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:17.396808 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c767515f-e6f0-43a6-81ab-6cf4b10b7d7d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:17.464406 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c767515f-e6f0-43a6-81ab-6cf4b10b7d7d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:17.473804 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c767515f-e6f0-43a6-81ab-6cf4b10b7d7d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:17.475383 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c767515f-e6f0-43a6-81ab-6cf4b10b7d7d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:17.476619 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c767515f-e6f0-43a6-81ab-6cf4b10b7d7d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.094200 Sep 24 21:17:17.477300 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2733/5482] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:17 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:17.591955 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-23cedeb2-3681-41db-b60b-890f4e90b7fa tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:17.592573 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-23cedeb2-3681-41db-b60b-890f4e90b7fa tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:17.595287 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:17:17.602672 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23cedeb2-3681-41db-b60b-890f4e90b7fa tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:17.603897 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23cedeb2-3681-41db-b60b-890f4e90b7fa tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:17.604439 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23cedeb2-3681-41db-b60b-890f4e90b7fa tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:17.605668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23cedeb2-3681-41db-b60b-890f4e90b7fa tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:17.606399 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23cedeb2-3681-41db-b60b-890f4e90b7fa tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:17.607137 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-23cedeb2-3681-41db-b60b-890f4e90b7fa tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:17.763356 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-23cedeb2-3681-41db-b60b-890f4e90b7fa tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:17.771804 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-23cedeb2-3681-41db-b60b-890f4e90b7fa tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1698 microversion: 2.1 time: 0.183693 Sep 24 21:17:17.772391 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2750/5483] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:17:17 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1698 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:17:18.504558 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1f58eac3-c24f-453e-9e12-da85864376dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:18.505180 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1f58eac3-c24f-453e-9e12-da85864376dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:18.513049 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f58eac3-c24f-453e-9e12-da85864376dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:18.513533 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f58eac3-c24f-453e-9e12-da85864376dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:18.513980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f58eac3-c24f-453e-9e12-da85864376dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:18.514708 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f58eac3-c24f-453e-9e12-da85864376dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:18.515291 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f58eac3-c24f-453e-9e12-da85864376dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:18.515583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f58eac3-c24f-453e-9e12-da85864376dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:18.586638 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1f58eac3-c24f-453e-9e12-da85864376dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:18.595577 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1f58eac3-c24f-453e-9e12-da85864376dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:18.597236 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1f58eac3-c24f-453e-9e12-da85864376dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:18.598433 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1f58eac3-c24f-453e-9e12-da85864376dc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.098695 Sep 24 21:17:18.599054 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2734/5484] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:18 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:18.796712 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b5e72c93-bd59-4e37-a028-5564620d5fbd tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:18.797434 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b5e72c93-bd59-4e37-a028-5564620d5fbd tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:18.805880 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b5e72c93-bd59-4e37-a028-5564620d5fbd tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:18.806455 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b5e72c93-bd59-4e37-a028-5564620d5fbd tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:18.807084 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b5e72c93-bd59-4e37-a028-5564620d5fbd tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:18.807854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b5e72c93-bd59-4e37-a028-5564620d5fbd tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:18.808317 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b5e72c93-bd59-4e37-a028-5564620d5fbd tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:18.808749 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b5e72c93-bd59-4e37-a028-5564620d5fbd tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:18.951520 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b5e72c93-bd59-4e37-a028-5564620d5fbd tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:18.960852 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b5e72c93-bd59-4e37-a028-5564620d5fbd tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1698 microversion: 2.1 time: 0.168296 Sep 24 21:17:18.961444 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2751/5485] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:17:18 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1698 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:17:19.624193 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-81924ad4-c5e5-4987-93cc-aa2fc34d4295 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:19.624818 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-81924ad4-c5e5-4987-93cc-aa2fc34d4295 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:19.642264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81924ad4-c5e5-4987-93cc-aa2fc34d4295 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:19.642799 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81924ad4-c5e5-4987-93cc-aa2fc34d4295 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:19.643252 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81924ad4-c5e5-4987-93cc-aa2fc34d4295 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:19.644407 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81924ad4-c5e5-4987-93cc-aa2fc34d4295 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:19.644890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81924ad4-c5e5-4987-93cc-aa2fc34d4295 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:19.645330 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81924ad4-c5e5-4987-93cc-aa2fc34d4295 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:19.725242 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-81924ad4-c5e5-4987-93cc-aa2fc34d4295 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:19.734192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-81924ad4-c5e5-4987-93cc-aa2fc34d4295 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:19.735814 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-81924ad4-c5e5-4987-93cc-aa2fc34d4295 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:19.737063 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-81924ad4-c5e5-4987-93cc-aa2fc34d4295 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.116809 Sep 24 21:17:19.738742 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2735/5486] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:19 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:19.988504 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e3a886b7-41f5-4c67-9a92-20b4863680b8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:19.990521 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e3a886b7-41f5-4c67-9a92-20b4863680b8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:19.998869 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3a886b7-41f5-4c67-9a92-20b4863680b8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:19.999362 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3a886b7-41f5-4c67-9a92-20b4863680b8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:19.999813 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3a886b7-41f5-4c67-9a92-20b4863680b8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:20.000733 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3a886b7-41f5-4c67-9a92-20b4863680b8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:20.001235 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3a886b7-41f5-4c67-9a92-20b4863680b8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:20.002670 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3a886b7-41f5-4c67-9a92-20b4863680b8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:20.268072 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e3a886b7-41f5-4c67-9a92-20b4863680b8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:20.277006 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e3a886b7-41f5-4c67-9a92-20b4863680b8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1697 microversion: 2.1 time: 0.293135 Sep 24 21:17:20.277833 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2752/5487] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:17:19 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1697 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:17:20.435080 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-8dfa798e-783f-4556-bbaf-c4136371817b req-6f3124f6-6fad-4c71-bcaa-88bcf104da08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97863e58-47a8-44be-a268-26807a10f037", "name": "network-vif-unplugged", "status": "completed", "tag": "72dd520b-415e-4703-95f2-fa48dc8a2c00"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:17:20.447595 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-8dfa798e-783f-4556-bbaf-c4136371817b req-6f3124f6-6fad-4c71-bcaa-88bcf104da08 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:20.448084 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-8dfa798e-783f-4556-bbaf-c4136371817b req-6f3124f6-6fad-4c71-bcaa-88bcf104da08 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:20.448520 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-8dfa798e-783f-4556-bbaf-c4136371817b req-6f3124f6-6fad-4c71-bcaa-88bcf104da08 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:20.464387 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-8dfa798e-783f-4556-bbaf-c4136371817b req-6f3124f6-6fad-4c71-bcaa-88bcf104da08 service nova] Creating event network-vif-unplugged:72dd520b-415e-4703-95f2-fa48dc8a2c00 for instance 97863e58-47a8-44be-a268-26807a10f037 on nch1-master-1 Sep 24 21:17:20.472285 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [req-8dfa798e-783f-4556-bbaf-c4136371817b req-6f3124f6-6fad-4c71-bcaa-88bcf104da08 service nova] Instance 97863e58-47a8-44be-a268-26807a10f037 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 21:17:20.485699 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-8dfa798e-783f-4556-bbaf-c4136371817b req-6f3124f6-6fad-4c71-bcaa-88bcf104da08 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056216 Sep 24 21:17:20.486775 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2736/5488] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:17:20.765180 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5f930dbe-94a0-48fe-9c5e-a227164c1271 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:20.765823 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5f930dbe-94a0-48fe-9c5e-a227164c1271 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:20.772370 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f930dbe-94a0-48fe-9c5e-a227164c1271 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:20.772873 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f930dbe-94a0-48fe-9c5e-a227164c1271 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:20.773379 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f930dbe-94a0-48fe-9c5e-a227164c1271 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:20.774105 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f930dbe-94a0-48fe-9c5e-a227164c1271 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:20.774625 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f930dbe-94a0-48fe-9c5e-a227164c1271 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:20.775058 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f930dbe-94a0-48fe-9c5e-a227164c1271 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:20.865515 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5f930dbe-94a0-48fe-9c5e-a227164c1271 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:20.878051 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5f930dbe-94a0-48fe-9c5e-a227164c1271 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:20.879756 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5f930dbe-94a0-48fe-9c5e-a227164c1271 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:20.881057 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5f930dbe-94a0-48fe-9c5e-a227164c1271 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.120531 Sep 24 21:17:20.891471 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2753/5489] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:20 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:21.303491 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f6a05940-cd57-4f3e-9365-2160b2da8a37 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:21.304324 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f6a05940-cd57-4f3e-9365-2160b2da8a37 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:21.312224 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6a05940-cd57-4f3e-9365-2160b2da8a37 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:21.312807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6a05940-cd57-4f3e-9365-2160b2da8a37 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:21.313281 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6a05940-cd57-4f3e-9365-2160b2da8a37 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:21.313996 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6a05940-cd57-4f3e-9365-2160b2da8a37 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:21.314462 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6a05940-cd57-4f3e-9365-2160b2da8a37 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:21.314921 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6a05940-cd57-4f3e-9365-2160b2da8a37 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:21.626233 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f6a05940-cd57-4f3e-9365-2160b2da8a37 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:21.637213 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f6a05940-cd57-4f3e-9365-2160b2da8a37 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1697 microversion: 2.1 time: 0.339428 Sep 24 21:17:21.638089 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2737/5490] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:17:21 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1697 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:17:21.907108 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a021a176-ab32-4ab8-ba30-8bd75118115e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:21.907993 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a021a176-ab32-4ab8-ba30-8bd75118115e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:21.918934 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a021a176-ab32-4ab8-ba30-8bd75118115e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:21.919752 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a021a176-ab32-4ab8-ba30-8bd75118115e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:21.920296 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a021a176-ab32-4ab8-ba30-8bd75118115e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:21.921275 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a021a176-ab32-4ab8-ba30-8bd75118115e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:21.921970 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a021a176-ab32-4ab8-ba30-8bd75118115e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:21.922682 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a021a176-ab32-4ab8-ba30-8bd75118115e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:22.005679 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a021a176-ab32-4ab8-ba30-8bd75118115e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:22.015154 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a021a176-ab32-4ab8-ba30-8bd75118115e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:22.017241 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a021a176-ab32-4ab8-ba30-8bd75118115e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:22.019036 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a021a176-ab32-4ab8-ba30-8bd75118115e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.115364 Sep 24 21:17:22.019628 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2754/5491] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:21 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:22.519674 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-6557844b-5fa6-41e3-a174-76b0765d9bb4 req-8a04036a-3d9a-4b27-8332-116720313819 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97863e58-47a8-44be-a268-26807a10f037", "tag": "72dd520b-415e-4703-95f2-fa48dc8a2c00"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:17:22.530524 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-6557844b-5fa6-41e3-a174-76b0765d9bb4 req-8a04036a-3d9a-4b27-8332-116720313819 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:22.531148 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-6557844b-5fa6-41e3-a174-76b0765d9bb4 req-8a04036a-3d9a-4b27-8332-116720313819 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:22.531446 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-6557844b-5fa6-41e3-a174-76b0765d9bb4 req-8a04036a-3d9a-4b27-8332-116720313819 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:22.549429 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-6557844b-5fa6-41e3-a174-76b0765d9bb4 req-8a04036a-3d9a-4b27-8332-116720313819 service nova] Creating event network-changed:72dd520b-415e-4703-95f2-fa48dc8a2c00 for instance 97863e58-47a8-44be-a268-26807a10f037 on nch1-master-1 Sep 24 21:17:22.556796 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [req-6557844b-5fa6-41e3-a174-76b0765d9bb4 req-8a04036a-3d9a-4b27-8332-116720313819 service nova] Instance 97863e58-47a8-44be-a268-26807a10f037 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 21:17:22.569589 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-6557844b-5fa6-41e3-a174-76b0765d9bb4 req-8a04036a-3d9a-4b27-8332-116720313819 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054461 Sep 24 21:17:22.570221 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2738/5492] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:17:22.664802 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d8c671e5-5184-4d04-b02c-a7fad2821446 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:22.665531 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d8c671e5-5184-4d04-b02c-a7fad2821446 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:22.671944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d8c671e5-5184-4d04-b02c-a7fad2821446 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:22.672557 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d8c671e5-5184-4d04-b02c-a7fad2821446 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:22.673226 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d8c671e5-5184-4d04-b02c-a7fad2821446 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:22.674226 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d8c671e5-5184-4d04-b02c-a7fad2821446 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:22.675005 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d8c671e5-5184-4d04-b02c-a7fad2821446 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:22.675525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d8c671e5-5184-4d04-b02c-a7fad2821446 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:22.921205 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d8c671e5-5184-4d04-b02c-a7fad2821446 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:22.933916 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:17:22.936920 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d8c671e5-5184-4d04-b02c-a7fad2821446 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1695 microversion: 2.1 time: 0.276586 Sep 24 21:17:22.938544 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2755/5493] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:17:22 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1695 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:17:23.045633 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e41660c5-0ecd-4a5d-9515-3d456c6c90c1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:23.046650 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e41660c5-0ecd-4a5d-9515-3d456c6c90c1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:23.054207 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e41660c5-0ecd-4a5d-9515-3d456c6c90c1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:23.055049 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e41660c5-0ecd-4a5d-9515-3d456c6c90c1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:23.055659 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e41660c5-0ecd-4a5d-9515-3d456c6c90c1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:23.056723 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e41660c5-0ecd-4a5d-9515-3d456c6c90c1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:23.057337 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e41660c5-0ecd-4a5d-9515-3d456c6c90c1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:23.057938 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e41660c5-0ecd-4a5d-9515-3d456c6c90c1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:23.185842 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e41660c5-0ecd-4a5d-9515-3d456c6c90c1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:23.195726 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e41660c5-0ecd-4a5d-9515-3d456c6c90c1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:23.209337 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e41660c5-0ecd-4a5d-9515-3d456c6c90c1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:23.211022 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e41660c5-0ecd-4a5d-9515-3d456c6c90c1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.169729 Sep 24 21:17:23.216196 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2739/5494] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:23 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:23.962438 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-09955f9c-e8c2-468d-8aa3-6b758cf2b603 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:23.962996 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-09955f9c-e8c2-468d-8aa3-6b758cf2b603 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:23.977872 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09955f9c-e8c2-468d-8aa3-6b758cf2b603 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:23.978364 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09955f9c-e8c2-468d-8aa3-6b758cf2b603 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:23.979046 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09955f9c-e8c2-468d-8aa3-6b758cf2b603 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:23.980013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09955f9c-e8c2-468d-8aa3-6b758cf2b603 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:23.980631 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09955f9c-e8c2-468d-8aa3-6b758cf2b603 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:23.981306 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09955f9c-e8c2-468d-8aa3-6b758cf2b603 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:24.190382 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-09955f9c-e8c2-468d-8aa3-6b758cf2b603 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:24.198981 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-09955f9c-e8c2-468d-8aa3-6b758cf2b603 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1695 microversion: 2.1 time: 0.240812 Sep 24 21:17:24.199898 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2756/5495] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:17:23 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1695 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:17:24.239875 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-10fde530-c419-4128-89fd-c44f479d1b71 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:24.240498 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-10fde530-c419-4128-89fd-c44f479d1b71 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:24.248911 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10fde530-c419-4128-89fd-c44f479d1b71 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:24.249637 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10fde530-c419-4128-89fd-c44f479d1b71 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:24.250242 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10fde530-c419-4128-89fd-c44f479d1b71 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:24.251073 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10fde530-c419-4128-89fd-c44f479d1b71 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:24.251819 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10fde530-c419-4128-89fd-c44f479d1b71 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:24.252435 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10fde530-c419-4128-89fd-c44f479d1b71 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:24.326606 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-10fde530-c419-4128-89fd-c44f479d1b71 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:24.337168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-10fde530-c419-4128-89fd-c44f479d1b71 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:24.339013 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-10fde530-c419-4128-89fd-c44f479d1b71 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:24.340257 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-10fde530-c419-4128-89fd-c44f479d1b71 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.105184 Sep 24 21:17:24.341398 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2740/5496] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:24 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:25.226435 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a17744c0-6990-4bb4-8291-c55f31dbdab7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:25.227237 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a17744c0-6990-4bb4-8291-c55f31dbdab7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:25.234797 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a17744c0-6990-4bb4-8291-c55f31dbdab7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:25.235441 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a17744c0-6990-4bb4-8291-c55f31dbdab7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:25.236130 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a17744c0-6990-4bb4-8291-c55f31dbdab7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:25.237678 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a17744c0-6990-4bb4-8291-c55f31dbdab7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:25.238349 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a17744c0-6990-4bb4-8291-c55f31dbdab7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:25.239022 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a17744c0-6990-4bb4-8291-c55f31dbdab7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:25.368764 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e3f95a43-70c0-401c-bcc1-66cb621fa86a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:25.369454 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e3f95a43-70c0-401c-bcc1-66cb621fa86a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:25.383998 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e3f95a43-70c0-401c-bcc1-66cb621fa86a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:25.384740 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e3f95a43-70c0-401c-bcc1-66cb621fa86a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:25.385363 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e3f95a43-70c0-401c-bcc1-66cb621fa86a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:25.386879 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e3f95a43-70c0-401c-bcc1-66cb621fa86a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:25.387517 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e3f95a43-70c0-401c-bcc1-66cb621fa86a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:25.388314 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e3f95a43-70c0-401c-bcc1-66cb621fa86a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:25.524402 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e3f95a43-70c0-401c-bcc1-66cb621fa86a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:25.536332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e3f95a43-70c0-401c-bcc1-66cb621fa86a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:25.538153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e3f95a43-70c0-401c-bcc1-66cb621fa86a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:25.539310 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e3f95a43-70c0-401c-bcc1-66cb621fa86a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.175931 Sep 24 21:17:25.540059 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2741/5497] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:25 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:17:25.617135 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a17744c0-6990-4bb4-8291-c55f31dbdab7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:25.626305 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a17744c0-6990-4bb4-8291-c55f31dbdab7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1692 microversion: 2.1 time: 0.404964 Sep 24 21:17:25.627274 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2757/5498] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:17:25 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1692 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:17:25.651446 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e9ae3eff-d06e-44c5-82ac-af32a41a181c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:17:25.651988 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e9ae3eff-d06e-44c5-82ac-af32a41a181c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:25.658199 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e9ae3eff-d06e-44c5-82ac-af32a41a181c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:25.658753 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e9ae3eff-d06e-44c5-82ac-af32a41a181c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:25.660111 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e9ae3eff-d06e-44c5-82ac-af32a41a181c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:25.660939 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e9ae3eff-d06e-44c5-82ac-af32a41a181c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:25.661441 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e9ae3eff-d06e-44c5-82ac-af32a41a181c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:25.661885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e9ae3eff-d06e-44c5-82ac-af32a41a181c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:25.711693 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:17:25.734885 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e9ae3eff-d06e-44c5-82ac-af32a41a181c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "POST /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037/action" status: 204 len: 0 microversion: 2.1 time: 0.087924 Sep 24 21:17:25.740277 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2742/5499] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:17:25 2022] POST /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037/action => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:17:25.747588 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-33e55109-c8c7-4f46-ad53-95c8f13b3e8b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:25.750913 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-33e55109-c8c7-4f46-ad53-95c8f13b3e8b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:25.761865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33e55109-c8c7-4f46-ad53-95c8f13b3e8b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:25.762352 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33e55109-c8c7-4f46-ad53-95c8f13b3e8b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:25.763295 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33e55109-c8c7-4f46-ad53-95c8f13b3e8b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:25.764017 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33e55109-c8c7-4f46-ad53-95c8f13b3e8b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:25.764526 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33e55109-c8c7-4f46-ad53-95c8f13b3e8b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:25.765116 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33e55109-c8c7-4f46-ad53-95c8f13b3e8b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:25.926538 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-33e55109-c8c7-4f46-ad53-95c8f13b3e8b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:25.934877 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-33e55109-c8c7-4f46-ad53-95c8f13b3e8b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1692 microversion: 2.1 time: 0.191241 Sep 24 21:17:25.935463 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2758/5500] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:17:25 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1692 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:17:26.135204 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-df5d7e4f-188d-428a-bf96-964ee9db7f7b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:17:26.138722 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-df5d7e4f-188d-428a-bf96-964ee9db7f7b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 15287602-2fd6-4d60-9d26-662b52d6c547] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:26.147218 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-df5d7e4f-188d-428a-bf96-964ee9db7f7b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:26.147941 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-df5d7e4f-188d-428a-bf96-964ee9db7f7b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:26.148598 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-df5d7e4f-188d-428a-bf96-964ee9db7f7b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:26.149387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-df5d7e4f-188d-428a-bf96-964ee9db7f7b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:26.149915 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-df5d7e4f-188d-428a-bf96-964ee9db7f7b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:26.150731 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-df5d7e4f-188d-428a-bf96-964ee9db7f7b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:26.250316 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-df5d7e4f-188d-428a-bf96-964ee9db7f7b tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "POST /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547/action" status: 200 len: 32604 microversion: 2.1 time: 0.120531 Sep 24 21:17:26.253058 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2743/5501] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:17:26 2022] POST /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547/action => generated 32604 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:17:26.566962 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e1f21a5c-9a76-4630-9ef4-bc3f70e5df66 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:26.568340 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e1f21a5c-9a76-4630-9ef4-bc3f70e5df66 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:26.576297 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1f21a5c-9a76-4630-9ef4-bc3f70e5df66 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:26.577224 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1f21a5c-9a76-4630-9ef4-bc3f70e5df66 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:26.577966 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1f21a5c-9a76-4630-9ef4-bc3f70e5df66 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:26.578963 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1f21a5c-9a76-4630-9ef4-bc3f70e5df66 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:26.579659 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1f21a5c-9a76-4630-9ef4-bc3f70e5df66 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:26.580322 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1f21a5c-9a76-4630-9ef4-bc3f70e5df66 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:26.669533 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e1f21a5c-9a76-4630-9ef4-bc3f70e5df66 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:26.688618 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e1f21a5c-9a76-4630-9ef4-bc3f70e5df66 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:26.692144 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e1f21a5c-9a76-4630-9ef4-bc3f70e5df66 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:26.693623 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e1f21a5c-9a76-4630-9ef4-bc3f70e5df66 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.130720 Sep 24 21:17:26.715509 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2759/5502] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:26 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:17:26.962034 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9e01f280-0598-4ff2-92ac-ed84431c0828 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:26.963503 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9e01f280-0598-4ff2-92ac-ed84431c0828 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:26.973255 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e01f280-0598-4ff2-92ac-ed84431c0828 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:26.974001 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e01f280-0598-4ff2-92ac-ed84431c0828 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:26.974703 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e01f280-0598-4ff2-92ac-ed84431c0828 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:26.975617 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e01f280-0598-4ff2-92ac-ed84431c0828 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:26.976951 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e01f280-0598-4ff2-92ac-ed84431c0828 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:26.977606 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e01f280-0598-4ff2-92ac-ed84431c0828 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:27.235068 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9e01f280-0598-4ff2-92ac-ed84431c0828 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:27.244977 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9e01f280-0598-4ff2-92ac-ed84431c0828 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1692 microversion: 2.1 time: 0.288969 Sep 24 21:17:27.246086 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2744/5503] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:17:26 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1692 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:17:27.723080 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6ae1b848-c188-4fdd-9dde-571217741cc4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:27.723762 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6ae1b848-c188-4fdd-9dde-571217741cc4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:27.731847 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ae1b848-c188-4fdd-9dde-571217741cc4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:27.732712 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ae1b848-c188-4fdd-9dde-571217741cc4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:27.733399 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ae1b848-c188-4fdd-9dde-571217741cc4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:27.733659 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-8876632d-aa82-41dd-9436-e9fb62f9c215 req-ed6c3961-c6ec-451a-af6b-5203c26d8014 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97863e58-47a8-44be-a268-26807a10f037", "name": "network-vif-plugged", "status": "completed", "tag": "72dd520b-415e-4703-95f2-fa48dc8a2c00"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:17:27.734636 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ae1b848-c188-4fdd-9dde-571217741cc4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:27.735311 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ae1b848-c188-4fdd-9dde-571217741cc4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:27.735971 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ae1b848-c188-4fdd-9dde-571217741cc4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:27.749874 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-8876632d-aa82-41dd-9436-e9fb62f9c215 req-ed6c3961-c6ec-451a-af6b-5203c26d8014 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:27.750675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-8876632d-aa82-41dd-9436-e9fb62f9c215 req-ed6c3961-c6ec-451a-af6b-5203c26d8014 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:27.751608 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-8876632d-aa82-41dd-9436-e9fb62f9c215 req-ed6c3961-c6ec-451a-af6b-5203c26d8014 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:27.770273 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-8876632d-aa82-41dd-9436-e9fb62f9c215 req-ed6c3961-c6ec-451a-af6b-5203c26d8014 service nova] Creating event network-vif-plugged:72dd520b-415e-4703-95f2-fa48dc8a2c00 for instance 97863e58-47a8-44be-a268-26807a10f037 on nch1-master-1 Sep 24 21:17:27.778654 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [req-8876632d-aa82-41dd-9436-e9fb62f9c215 req-ed6c3961-c6ec-451a-af6b-5203c26d8014 service nova] Instance 97863e58-47a8-44be-a268-26807a10f037 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 21:17:27.804780 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-8876632d-aa82-41dd-9436-e9fb62f9c215 req-ed6c3961-c6ec-451a-af6b-5203c26d8014 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075303 Sep 24 21:17:27.806100 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2745/5504] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:17:27.879744 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6ae1b848-c188-4fdd-9dde-571217741cc4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:27.904641 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6ae1b848-c188-4fdd-9dde-571217741cc4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:27.906808 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6ae1b848-c188-4fdd-9dde-571217741cc4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:27.923974 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6ae1b848-c188-4fdd-9dde-571217741cc4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.191312 Sep 24 21:17:27.942613 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2760/5505] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:27 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:28.155865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-f6857ad0-c00e-409f-a01d-bed4f882e0b9 req-cd93d3fd-4efd-41e3-94d5-74564c8be3ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15287602-2fd6-4d60-9d26-662b52d6c547", "tag": "38f2cbc5-9847-4764-9680-1c6ba97c79cf"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:17:28.160805 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4a71f90f-3412-4c40-9288-5928934d2996 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:28.161542 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4a71f90f-3412-4c40-9288-5928934d2996 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 15287602-2fd6-4d60-9d26-662b52d6c547] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:28.171749 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a71f90f-3412-4c40-9288-5928934d2996 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:28.172500 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a71f90f-3412-4c40-9288-5928934d2996 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:28.172993 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a71f90f-3412-4c40-9288-5928934d2996 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:28.173966 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a71f90f-3412-4c40-9288-5928934d2996 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:28.175278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a71f90f-3412-4c40-9288-5928934d2996 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:28.176081 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a71f90f-3412-4c40-9288-5928934d2996 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:28.176200 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-f6857ad0-c00e-409f-a01d-bed4f882e0b9 req-cd93d3fd-4efd-41e3-94d5-74564c8be3ff service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:28.176807 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-f6857ad0-c00e-409f-a01d-bed4f882e0b9 req-cd93d3fd-4efd-41e3-94d5-74564c8be3ff service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:28.177262 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-f6857ad0-c00e-409f-a01d-bed4f882e0b9 req-cd93d3fd-4efd-41e3-94d5-74564c8be3ff service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:28.202966 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-f6857ad0-c00e-409f-a01d-bed4f882e0b9 req-cd93d3fd-4efd-41e3-94d5-74564c8be3ff service nova] Creating event network-changed:38f2cbc5-9847-4764-9680-1c6ba97c79cf for instance 15287602-2fd6-4d60-9d26-662b52d6c547 on nch1-master-1 Sep 24 21:17:28.216996 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-f6857ad0-c00e-409f-a01d-bed4f882e0b9 req-cd93d3fd-4efd-41e3-94d5-74564c8be3ff service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064751 Sep 24 21:17:28.223342 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2761/5506] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:17:28.231118 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4a71f90f-3412-4c40-9288-5928934d2996 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 15287602-2fd6-4d60-9d26-662b52d6c547] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:17:28.274389 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-91f734ef-1428-4e31-a9a8-8696d2c39432 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:28.276400 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-91f734ef-1428-4e31-a9a8-8696d2c39432 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:28.286250 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-91f734ef-1428-4e31-a9a8-8696d2c39432 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:28.286791 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-91f734ef-1428-4e31-a9a8-8696d2c39432 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:28.287239 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-91f734ef-1428-4e31-a9a8-8696d2c39432 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:28.287970 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-91f734ef-1428-4e31-a9a8-8696d2c39432 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:28.297808 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-91f734ef-1428-4e31-a9a8-8696d2c39432 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:28.298790 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-91f734ef-1428-4e31-a9a8-8696d2c39432 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:28.355564 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4a71f90f-3412-4c40-9288-5928934d2996 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "DELETE /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547" status: 204 len: 0 microversion: 2.1 time: 0.207519 Sep 24 21:17:28.357543 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2746/5507] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:17:28 2022] DELETE /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:17:28.376932 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b1a97515-931d-4a43-837b-aa6938088ddb tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:28.377980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b1a97515-931d-4a43-837b-aa6938088ddb tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 15287602-2fd6-4d60-9d26-662b52d6c547] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:28.394398 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1a97515-931d-4a43-837b-aa6938088ddb tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:28.397576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1a97515-931d-4a43-837b-aa6938088ddb tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:28.397576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1a97515-931d-4a43-837b-aa6938088ddb tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:28.399431 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1a97515-931d-4a43-837b-aa6938088ddb tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:28.405035 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1a97515-931d-4a43-837b-aa6938088ddb tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:28.414869 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1a97515-931d-4a43-837b-aa6938088ddb tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:28.599446 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-91f734ef-1428-4e31-a9a8-8696d2c39432 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:28.618787 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-91f734ef-1428-4e31-a9a8-8696d2c39432 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1684 microversion: 2.1 time: 0.345012 Sep 24 21:17:28.619830 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2762/5508] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:17:28 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1684 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:17:28.654975 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b1a97515-931d-4a43-837b-aa6938088ddb tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:28.667293 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b1a97515-931d-4a43-837b-aa6938088ddb tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547" status: 200 len: 1671 microversion: 2.1 time: 0.302804 Sep 24 21:17:28.668230 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2747/5509] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:17:28 2022] GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547 => generated 1671 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:17:28.960387 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1633ead0-c10d-4abf-8e88-ef3e902c3227 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:28.961871 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1633ead0-c10d-4abf-8e88-ef3e902c3227 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:28.975437 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1633ead0-c10d-4abf-8e88-ef3e902c3227 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:28.976214 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1633ead0-c10d-4abf-8e88-ef3e902c3227 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:28.976658 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1633ead0-c10d-4abf-8e88-ef3e902c3227 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:28.977395 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1633ead0-c10d-4abf-8e88-ef3e902c3227 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:28.977869 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1633ead0-c10d-4abf-8e88-ef3e902c3227 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:28.978337 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1633ead0-c10d-4abf-8e88-ef3e902c3227 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:29.071403 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1633ead0-c10d-4abf-8e88-ef3e902c3227 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:29.081629 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1633ead0-c10d-4abf-8e88-ef3e902c3227 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:29.083247 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1633ead0-c10d-4abf-8e88-ef3e902c3227 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:29.084531 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1633ead0-c10d-4abf-8e88-ef3e902c3227 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.129463 Sep 24 21:17:29.085204 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2763/5510] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:28 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:29.698312 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-28ed646f-e534-47e1-9727-3e453ddcefa3 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:29.699865 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-28ed646f-e534-47e1-9727-3e453ddcefa3 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 15287602-2fd6-4d60-9d26-662b52d6c547] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:29.709977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28ed646f-e534-47e1-9727-3e453ddcefa3 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:29.711073 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28ed646f-e534-47e1-9727-3e453ddcefa3 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:29.711885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28ed646f-e534-47e1-9727-3e453ddcefa3 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:29.712728 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28ed646f-e534-47e1-9727-3e453ddcefa3 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:29.713376 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28ed646f-e534-47e1-9727-3e453ddcefa3 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:29.714160 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28ed646f-e534-47e1-9727-3e453ddcefa3 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:29.980214 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-28ed646f-e534-47e1-9727-3e453ddcefa3 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:30.012203 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-28ed646f-e534-47e1-9727-3e453ddcefa3 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547" status: 200 len: 1671 microversion: 2.1 time: 0.319418 Sep 24 21:17:30.014029 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2748/5511] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:17:29 2022] GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547 => generated 1671 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:17:30.111199 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d1ee650b-5f1a-4759-9a8c-2d116187f066 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:30.113064 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d1ee650b-5f1a-4759-9a8c-2d116187f066 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:30.129634 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1ee650b-5f1a-4759-9a8c-2d116187f066 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:30.131870 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1ee650b-5f1a-4759-9a8c-2d116187f066 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:30.132907 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1ee650b-5f1a-4759-9a8c-2d116187f066 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:30.134417 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1ee650b-5f1a-4759-9a8c-2d116187f066 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:30.135684 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1ee650b-5f1a-4759-9a8c-2d116187f066 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:30.136731 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1ee650b-5f1a-4759-9a8c-2d116187f066 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:30.522880 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d1ee650b-5f1a-4759-9a8c-2d116187f066 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:30.532918 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d1ee650b-5f1a-4759-9a8c-2d116187f066 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:30.535115 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d1ee650b-5f1a-4759-9a8c-2d116187f066 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:30.536590 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d1ee650b-5f1a-4759-9a8c-2d116187f066 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.429327 Sep 24 21:17:30.537529 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2764/5512] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:30 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:30.994036 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-32722f4d-9c93-4f59-80ae-8d8c8529303c req-49e8cc52-17f2-401e-bcbd-307f009e8bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15287602-2fd6-4d60-9d26-662b52d6c547", "name": "network-vif-deleted", "tag": "38f2cbc5-9847-4764-9680-1c6ba97c79cf"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:17:31.015231 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-32722f4d-9c93-4f59-80ae-8d8c8529303c req-49e8cc52-17f2-401e-bcbd-307f009e8bd1 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:31.015944 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-32722f4d-9c93-4f59-80ae-8d8c8529303c req-49e8cc52-17f2-401e-bcbd-307f009e8bd1 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:31.016725 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-32722f4d-9c93-4f59-80ae-8d8c8529303c req-49e8cc52-17f2-401e-bcbd-307f009e8bd1 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:31.034249 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-32722f4d-9c93-4f59-80ae-8d8c8529303c req-49e8cc52-17f2-401e-bcbd-307f009e8bd1 service nova] Creating event network-vif-deleted:38f2cbc5-9847-4764-9680-1c6ba97c79cf for instance 15287602-2fd6-4d60-9d26-662b52d6c547 on nch1-master-1 Sep 24 21:17:31.039785 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-32722f4d-9c93-4f59-80ae-8d8c8529303c req-49e8cc52-17f2-401e-bcbd-307f009e8bd1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052562 Sep 24 21:17:31.040988 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2749/5513] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:17:31.045978 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7706d646-aa63-4fbf-8135-6a777428fa70 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:31.046742 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7706d646-aa63-4fbf-8135-6a777428fa70 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 15287602-2fd6-4d60-9d26-662b52d6c547] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:31.055325 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7706d646-aa63-4fbf-8135-6a777428fa70 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:31.055821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7706d646-aa63-4fbf-8135-6a777428fa70 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:31.056431 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7706d646-aa63-4fbf-8135-6a777428fa70 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:31.057329 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7706d646-aa63-4fbf-8135-6a777428fa70 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:31.057953 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7706d646-aa63-4fbf-8135-6a777428fa70 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:31.058565 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7706d646-aa63-4fbf-8135-6a777428fa70 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:31.173106 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7706d646-aa63-4fbf-8135-6a777428fa70 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1acf8d4b1384c8c8d7014bd8baf897e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026ea39b3679444a9c3541e58d2e9f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:31.185502 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7706d646-aa63-4fbf-8135-6a777428fa70 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547" status: 200 len: 1333 microversion: 2.1 time: 0.143396 Sep 24 21:17:31.187132 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2765/5514] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:17:31 2022] GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547 => generated 1333 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:17:31.563696 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-988de8c1-ef93-4c8d-804f-282e3315450e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:31.564550 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-988de8c1-ef93-4c8d-804f-282e3315450e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:31.571976 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-988de8c1-ef93-4c8d-804f-282e3315450e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:31.572472 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-988de8c1-ef93-4c8d-804f-282e3315450e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:31.572956 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-988de8c1-ef93-4c8d-804f-282e3315450e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:31.573681 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-988de8c1-ef93-4c8d-804f-282e3315450e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:31.574198 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-988de8c1-ef93-4c8d-804f-282e3315450e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:31.576272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-988de8c1-ef93-4c8d-804f-282e3315450e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:31.671311 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-988de8c1-ef93-4c8d-804f-282e3315450e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:31.691533 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-988de8c1-ef93-4c8d-804f-282e3315450e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:31.693515 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-988de8c1-ef93-4c8d-804f-282e3315450e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:31.695231 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-988de8c1-ef93-4c8d-804f-282e3315450e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.136046 Sep 24 21:17:31.696545 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2750/5515] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:31 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:32.212143 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e21a9e80-1889-43fc-9b64-802579e57ba1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:32.213522 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e21a9e80-1889-43fc-9b64-802579e57ba1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] [instance: 15287602-2fd6-4d60-9d26-662b52d6c547] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:32.221524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e21a9e80-1889-43fc-9b64-802579e57ba1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:32.222441 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e21a9e80-1889-43fc-9b64-802579e57ba1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:32.223216 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e21a9e80-1889-43fc-9b64-802579e57ba1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:32.224170 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e21a9e80-1889-43fc-9b64-802579e57ba1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:32.224856 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e21a9e80-1889-43fc-9b64-802579e57ba1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:32.225819 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e21a9e80-1889-43fc-9b64-802579e57ba1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:32.247082 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-e21a9e80-1889-43fc-9b64-802579e57ba1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] HTTP exception thrown: Instance 15287602-2fd6-4d60-9d26-662b52d6c547 could not be found. Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e21a9e80-1889-43fc-9b64-802579e57ba1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Request method failure captured: Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547 HTTP/1.1 Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3LbnV8mCWJ6FgxfH9q4EKgvMb1JSjzpbYve959NeESy_sQhJToq9h52C_P8gtbUmCMXx1tBjKlrx99QZ3XLUF4T7dqGj481OcwRYKAcnr9kOqXeY-e2Y0SYM8N511519IaicdeEMvMkvR3KcQ5N1ysWl7OyfTs3FEtNQJiRJG5uuIE Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 026ea39b3679444a9c3541e58d2e9f7b Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-TestNetworkBasicOps-911154638 Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/026ea39b3679444a9c3541e58d2e9f7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_026ea39b3679444a9c3541e58d2e9f7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/026ea39b3679444a9c3541e58d2e9f7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/026ea39b3679444a9c3541e58d2e9f7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-TestNetworkBasicOps-911154638 Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 026ea39b3679444a9c3541e58d2e9f7b Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-TestNetworkBasicOps-911154638 Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-TestNetworkBasicOps-911154638-project Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: c1acf8d4b1384c8c8d7014bd8baf897e Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-TestNetworkBasicOps-911154638-project Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 15287602-2fd6-4d60-9d26-662b52d6c547 could not be found. Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '15287602-2fd6-4d60-9d26-662b52d6c547'} Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15287602-2fd6-4d60-9d26-662b52d6c547 could not be found. Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15287602-2fd6-4d60-9d26-662b52d6c547 could not be found. Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:17:32.249933 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:17:32.256837 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:17:32.256837 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:17:32.256837 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:17:32.256837 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:17:32.256837 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:17:32.256837 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15287602-2fd6-4d60-9d26-662b52d6c547 could not be found. Sep 24 21:17:32.256837 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:17:32.259202 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e21a9e80-1889-43fc-9b64-802579e57ba1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Returning 404 to user: Instance 15287602-2fd6-4d60-9d26-662b52d6c547 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:17:32.260826 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e21a9e80-1889-43fc-9b64-802579e57ba1 tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547" status: 404 len: 111 microversion: 2.1 time: 0.052598 Sep 24 21:17:32.261993 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2766/5516] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:17:32 2022] GET /compute/v2.1/servers/15287602-2fd6-4d60-9d26-662b52d6c547 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:17:32.468434 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ac1c7d71-8991-4d18-a364-83ab0f3ce49c tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] Calling method '.version_select at 0x7f4b0c100af0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:32.483533 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:17:32.497791 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ac1c7d71-8991-4d18-a364-83ab0f3ce49c tempest-TestNetworkBasicOps-911154638 tempest-TestNetworkBasicOps-911154638-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2099500262" status: 202 len: 0 microversion: 2.1 time: 0.033412 Sep 24 21:17:32.499146 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2751/5517] 10.222.0.52 () {58 vars in 1257 bytes} [Sat Sep 24 21:17:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2099500262 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:17:32.730394 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3873339b-5b61-43d3-84bb-01224b3718a5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:32.731554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3873339b-5b61-43d3-84bb-01224b3718a5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:32.739993 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3873339b-5b61-43d3-84bb-01224b3718a5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:32.741038 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3873339b-5b61-43d3-84bb-01224b3718a5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:32.741779 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3873339b-5b61-43d3-84bb-01224b3718a5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:32.742783 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3873339b-5b61-43d3-84bb-01224b3718a5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:32.743880 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3873339b-5b61-43d3-84bb-01224b3718a5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:32.744560 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3873339b-5b61-43d3-84bb-01224b3718a5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:32.847506 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3873339b-5b61-43d3-84bb-01224b3718a5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:32.858062 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3873339b-5b61-43d3-84bb-01224b3718a5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:32.859517 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3873339b-5b61-43d3-84bb-01224b3718a5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:32.860699 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3873339b-5b61-43d3-84bb-01224b3718a5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.134962 Sep 24 21:17:32.861258 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2767/5518] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:32 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:33.895292 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d69464d2-c8f9-4586-8387-bb190b2ad4e7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:33.898301 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d69464d2-c8f9-4586-8387-bb190b2ad4e7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:33.921324 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d69464d2-c8f9-4586-8387-bb190b2ad4e7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:33.922247 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d69464d2-c8f9-4586-8387-bb190b2ad4e7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:33.923311 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d69464d2-c8f9-4586-8387-bb190b2ad4e7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:33.924318 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d69464d2-c8f9-4586-8387-bb190b2ad4e7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:33.925531 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d69464d2-c8f9-4586-8387-bb190b2ad4e7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:33.926172 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d69464d2-c8f9-4586-8387-bb190b2ad4e7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:34.032562 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d69464d2-c8f9-4586-8387-bb190b2ad4e7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:34.050416 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d69464d2-c8f9-4586-8387-bb190b2ad4e7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:34.052029 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d69464d2-c8f9-4586-8387-bb190b2ad4e7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:34.061933 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d69464d2-c8f9-4586-8387-bb190b2ad4e7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.175878 Sep 24 21:17:34.066930 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2752/5519] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:33 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:35.090799 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1ee7d86b-e249-4351-941c-1b8e15a4d0ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:35.092042 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1ee7d86b-e249-4351-941c-1b8e15a4d0ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:35.100139 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1ee7d86b-e249-4351-941c-1b8e15a4d0ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:35.107517 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1ee7d86b-e249-4351-941c-1b8e15a4d0ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:35.108253 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1ee7d86b-e249-4351-941c-1b8e15a4d0ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:35.109813 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1ee7d86b-e249-4351-941c-1b8e15a4d0ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:35.111637 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1ee7d86b-e249-4351-941c-1b8e15a4d0ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:35.112331 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1ee7d86b-e249-4351-941c-1b8e15a4d0ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:35.218912 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1ee7d86b-e249-4351-941c-1b8e15a4d0ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:35.235308 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1ee7d86b-e249-4351-941c-1b8e15a4d0ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:35.239515 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1ee7d86b-e249-4351-941c-1b8e15a4d0ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:35.242142 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1ee7d86b-e249-4351-941c-1b8e15a4d0ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.159769 Sep 24 21:17:35.243076 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2768/5520] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:35 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:36.272868 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-81d7738a-3419-4667-9027-8c5913c890ea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:36.273493 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-81d7738a-3419-4667-9027-8c5913c890ea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:36.288110 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81d7738a-3419-4667-9027-8c5913c890ea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:36.288617 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81d7738a-3419-4667-9027-8c5913c890ea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:36.289064 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81d7738a-3419-4667-9027-8c5913c890ea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:36.289779 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81d7738a-3419-4667-9027-8c5913c890ea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:36.290422 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81d7738a-3419-4667-9027-8c5913c890ea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:36.291036 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-81d7738a-3419-4667-9027-8c5913c890ea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:36.418255 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-81d7738a-3419-4667-9027-8c5913c890ea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:36.427794 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-81d7738a-3419-4667-9027-8c5913c890ea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:36.434446 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-81d7738a-3419-4667-9027-8c5913c890ea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:36.435742 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-81d7738a-3419-4667-9027-8c5913c890ea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.166866 Sep 24 21:17:36.443318 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2753/5521] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:36 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:37.472554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-de9d9f72-dc08-49bb-8bc4-637be4ff9151 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:37.473194 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-de9d9f72-dc08-49bb-8bc4-637be4ff9151 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:37.484575 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de9d9f72-dc08-49bb-8bc4-637be4ff9151 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:37.485276 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de9d9f72-dc08-49bb-8bc4-637be4ff9151 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:37.485751 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de9d9f72-dc08-49bb-8bc4-637be4ff9151 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:37.488024 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de9d9f72-dc08-49bb-8bc4-637be4ff9151 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:37.488501 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de9d9f72-dc08-49bb-8bc4-637be4ff9151 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:37.488957 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de9d9f72-dc08-49bb-8bc4-637be4ff9151 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:37.581724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-de9d9f72-dc08-49bb-8bc4-637be4ff9151 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:37.603694 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-de9d9f72-dc08-49bb-8bc4-637be4ff9151 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:37.605478 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-de9d9f72-dc08-49bb-8bc4-637be4ff9151 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:37.607054 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-de9d9f72-dc08-49bb-8bc4-637be4ff9151 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.141286 Sep 24 21:17:37.620867 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2769/5522] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:37 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:38.657264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b65ab009-89f1-47a6-9e11-d86c385c47d7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:38.660048 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b65ab009-89f1-47a6-9e11-d86c385c47d7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:38.669396 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b65ab009-89f1-47a6-9e11-d86c385c47d7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:38.670156 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b65ab009-89f1-47a6-9e11-d86c385c47d7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:38.670818 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b65ab009-89f1-47a6-9e11-d86c385c47d7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:38.672444 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b65ab009-89f1-47a6-9e11-d86c385c47d7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:38.673178 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b65ab009-89f1-47a6-9e11-d86c385c47d7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:38.673996 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b65ab009-89f1-47a6-9e11-d86c385c47d7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:38.757453 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b65ab009-89f1-47a6-9e11-d86c385c47d7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:38.767216 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b65ab009-89f1-47a6-9e11-d86c385c47d7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:38.769516 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b65ab009-89f1-47a6-9e11-d86c385c47d7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:38.770734 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b65ab009-89f1-47a6-9e11-d86c385c47d7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.121034 Sep 24 21:17:38.771344 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2754/5523] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:38 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:39.796582 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-14b1565f-0be8-43e8-a95f-c1d10b95fe88 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:39.797261 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-14b1565f-0be8-43e8-a95f-c1d10b95fe88 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:39.805221 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-14b1565f-0be8-43e8-a95f-c1d10b95fe88 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:39.805730 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-14b1565f-0be8-43e8-a95f-c1d10b95fe88 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:39.806179 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-14b1565f-0be8-43e8-a95f-c1d10b95fe88 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:39.806924 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-14b1565f-0be8-43e8-a95f-c1d10b95fe88 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:39.807388 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-14b1565f-0be8-43e8-a95f-c1d10b95fe88 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:39.807899 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-14b1565f-0be8-43e8-a95f-c1d10b95fe88 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:39.874883 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-14b1565f-0be8-43e8-a95f-c1d10b95fe88 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:39.885767 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-14b1565f-0be8-43e8-a95f-c1d10b95fe88 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:39.887562 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-14b1565f-0be8-43e8-a95f-c1d10b95fe88 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:39.888914 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-14b1565f-0be8-43e8-a95f-c1d10b95fe88 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.096341 Sep 24 21:17:39.891773 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2770/5524] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:39 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:40.916204 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4aa9796c-6654-43cf-9884-ef0dac1df1d7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:40.918437 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4aa9796c-6654-43cf-9884-ef0dac1df1d7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:40.929499 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4aa9796c-6654-43cf-9884-ef0dac1df1d7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:40.930813 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4aa9796c-6654-43cf-9884-ef0dac1df1d7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:40.931460 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4aa9796c-6654-43cf-9884-ef0dac1df1d7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:40.932432 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4aa9796c-6654-43cf-9884-ef0dac1df1d7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:40.933813 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4aa9796c-6654-43cf-9884-ef0dac1df1d7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:40.934416 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4aa9796c-6654-43cf-9884-ef0dac1df1d7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:41.011388 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4aa9796c-6654-43cf-9884-ef0dac1df1d7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:41.021392 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4aa9796c-6654-43cf-9884-ef0dac1df1d7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:41.023075 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4aa9796c-6654-43cf-9884-ef0dac1df1d7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:41.024267 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4aa9796c-6654-43cf-9884-ef0dac1df1d7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.112861 Sep 24 21:17:41.039024 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2755/5525] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:40 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:42.058083 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fd338c4c-3118-4ce3-a782-3d21f20e0bf3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:42.059172 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fd338c4c-3118-4ce3-a782-3d21f20e0bf3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:42.067746 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd338c4c-3118-4ce3-a782-3d21f20e0bf3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:42.068251 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd338c4c-3118-4ce3-a782-3d21f20e0bf3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:42.068705 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd338c4c-3118-4ce3-a782-3d21f20e0bf3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:42.069628 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd338c4c-3118-4ce3-a782-3d21f20e0bf3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:42.070093 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd338c4c-3118-4ce3-a782-3d21f20e0bf3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:42.070571 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd338c4c-3118-4ce3-a782-3d21f20e0bf3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:42.149099 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fd338c4c-3118-4ce3-a782-3d21f20e0bf3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:42.158308 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fd338c4c-3118-4ce3-a782-3d21f20e0bf3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:42.159989 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fd338c4c-3118-4ce3-a782-3d21f20e0bf3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:42.161383 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fd338c4c-3118-4ce3-a782-3d21f20e0bf3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.114491 Sep 24 21:17:42.161965 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2771/5526] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:42 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:43.187637 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3d534dfc-f7ed-4bf4-a650-0c6767561101 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:43.188253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3d534dfc-f7ed-4bf4-a650-0c6767561101 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:43.196315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d534dfc-f7ed-4bf4-a650-0c6767561101 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:43.196821 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d534dfc-f7ed-4bf4-a650-0c6767561101 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:43.197273 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d534dfc-f7ed-4bf4-a650-0c6767561101 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:43.198008 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d534dfc-f7ed-4bf4-a650-0c6767561101 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:43.198691 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d534dfc-f7ed-4bf4-a650-0c6767561101 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:43.199529 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d534dfc-f7ed-4bf4-a650-0c6767561101 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:43.565194 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3d534dfc-f7ed-4bf4-a650-0c6767561101 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:43.574743 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3d534dfc-f7ed-4bf4-a650-0c6767561101 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:43.576460 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3d534dfc-f7ed-4bf4-a650-0c6767561101 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:43.577629 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3d534dfc-f7ed-4bf4-a650-0c6767561101 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.394162 Sep 24 21:17:43.578198 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2756/5527] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:43 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:44.606561 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ab8f3e86-9c34-420b-af89-04128f45f42f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:44.607944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ab8f3e86-9c34-420b-af89-04128f45f42f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:44.615966 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ab8f3e86-9c34-420b-af89-04128f45f42f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:44.617101 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ab8f3e86-9c34-420b-af89-04128f45f42f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:44.617570 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ab8f3e86-9c34-420b-af89-04128f45f42f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:44.618318 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ab8f3e86-9c34-420b-af89-04128f45f42f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:44.618827 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ab8f3e86-9c34-420b-af89-04128f45f42f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:44.619271 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ab8f3e86-9c34-420b-af89-04128f45f42f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:44.722755 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ab8f3e86-9c34-420b-af89-04128f45f42f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:44.732170 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ab8f3e86-9c34-420b-af89-04128f45f42f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:44.733626 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ab8f3e86-9c34-420b-af89-04128f45f42f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:44.734856 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ab8f3e86-9c34-420b-af89-04128f45f42f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.134037 Sep 24 21:17:44.735424 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2772/5528] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:44 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:45.760956 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-95c55709-2c9a-4490-9f1f-68694192008d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:45.761583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-95c55709-2c9a-4490-9f1f-68694192008d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:45.768753 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-95c55709-2c9a-4490-9f1f-68694192008d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:45.769249 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-95c55709-2c9a-4490-9f1f-68694192008d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:45.769705 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-95c55709-2c9a-4490-9f1f-68694192008d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:45.770588 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-95c55709-2c9a-4490-9f1f-68694192008d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:45.770998 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-95c55709-2c9a-4490-9f1f-68694192008d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:45.771437 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-95c55709-2c9a-4490-9f1f-68694192008d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:45.857761 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-95c55709-2c9a-4490-9f1f-68694192008d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:45.868075 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-95c55709-2c9a-4490-9f1f-68694192008d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:45.869571 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-95c55709-2c9a-4490-9f1f-68694192008d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:45.870985 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-95c55709-2c9a-4490-9f1f-68694192008d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.114145 Sep 24 21:17:45.871779 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2757/5529] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:45 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:46.897525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-99f1890e-8548-4d8b-a288-dee8f43caaf5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:46.898791 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-99f1890e-8548-4d8b-a288-dee8f43caaf5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:46.912406 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-99f1890e-8548-4d8b-a288-dee8f43caaf5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:46.912938 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-99f1890e-8548-4d8b-a288-dee8f43caaf5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:46.913389 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-99f1890e-8548-4d8b-a288-dee8f43caaf5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:46.914735 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-99f1890e-8548-4d8b-a288-dee8f43caaf5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:46.915204 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-99f1890e-8548-4d8b-a288-dee8f43caaf5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:46.915645 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-99f1890e-8548-4d8b-a288-dee8f43caaf5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:46.991573 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-99f1890e-8548-4d8b-a288-dee8f43caaf5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:46.993995 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:17:47.003040 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-99f1890e-8548-4d8b-a288-dee8f43caaf5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:47.004527 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-99f1890e-8548-4d8b-a288-dee8f43caaf5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:47.005729 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-99f1890e-8548-4d8b-a288-dee8f43caaf5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.112611 Sep 24 21:17:47.006328 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2773/5530] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:46 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:48.033781 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b6912d6c-7c5b-47bb-a189-220e0d3f5a22 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:48.034666 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b6912d6c-7c5b-47bb-a189-220e0d3f5a22 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:48.042054 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6912d6c-7c5b-47bb-a189-220e0d3f5a22 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:48.042567 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6912d6c-7c5b-47bb-a189-220e0d3f5a22 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:48.043065 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6912d6c-7c5b-47bb-a189-220e0d3f5a22 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:48.043780 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6912d6c-7c5b-47bb-a189-220e0d3f5a22 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:48.044240 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6912d6c-7c5b-47bb-a189-220e0d3f5a22 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:48.044698 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6912d6c-7c5b-47bb-a189-220e0d3f5a22 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:48.122537 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b6912d6c-7c5b-47bb-a189-220e0d3f5a22 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:48.136607 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b6912d6c-7c5b-47bb-a189-220e0d3f5a22 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:48.138391 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b6912d6c-7c5b-47bb-a189-220e0d3f5a22 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:48.140359 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b6912d6c-7c5b-47bb-a189-220e0d3f5a22 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.110816 Sep 24 21:17:48.141150 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2758/5531] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:48 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:49.168375 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-42472d81-b69b-4350-81ca-1bcbe3621451 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:49.169105 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-42472d81-b69b-4350-81ca-1bcbe3621451 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:49.172168 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=48 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:17:49.178784 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-42472d81-b69b-4350-81ca-1bcbe3621451 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:49.179309 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-42472d81-b69b-4350-81ca-1bcbe3621451 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:49.179760 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-42472d81-b69b-4350-81ca-1bcbe3621451 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:49.180481 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-42472d81-b69b-4350-81ca-1bcbe3621451 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:49.180945 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-42472d81-b69b-4350-81ca-1bcbe3621451 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:49.181375 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-42472d81-b69b-4350-81ca-1bcbe3621451 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:49.312946 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-42472d81-b69b-4350-81ca-1bcbe3621451 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:49.324316 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-42472d81-b69b-4350-81ca-1bcbe3621451 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:49.325783 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-42472d81-b69b-4350-81ca-1bcbe3621451 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:49.327313 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-42472d81-b69b-4350-81ca-1bcbe3621451 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.163306 Sep 24 21:17:49.327971 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2774/5532] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:49 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:50.353673 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b0597ca0-ae61-4d9e-9999-ed64ddde0204 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:50.354123 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b0597ca0-ae61-4d9e-9999-ed64ddde0204 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:50.362112 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0597ca0-ae61-4d9e-9999-ed64ddde0204 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:50.362641 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0597ca0-ae61-4d9e-9999-ed64ddde0204 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:50.363079 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0597ca0-ae61-4d9e-9999-ed64ddde0204 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:50.363977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0597ca0-ae61-4d9e-9999-ed64ddde0204 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:50.364601 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0597ca0-ae61-4d9e-9999-ed64ddde0204 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:50.365035 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0597ca0-ae61-4d9e-9999-ed64ddde0204 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:50.446871 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b0597ca0-ae61-4d9e-9999-ed64ddde0204 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:50.450826 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:17:50.460798 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b0597ca0-ae61-4d9e-9999-ed64ddde0204 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:50.462661 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b0597ca0-ae61-4d9e-9999-ed64ddde0204 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:50.464207 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b0597ca0-ae61-4d9e-9999-ed64ddde0204 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.114648 Sep 24 21:17:50.479866 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2759/5533] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:50 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:51.498743 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-748b3860-6033-491a-a71d-f1a31c82a3bc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:51.499490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-748b3860-6033-491a-a71d-f1a31c82a3bc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:51.508043 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-748b3860-6033-491a-a71d-f1a31c82a3bc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:51.508601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-748b3860-6033-491a-a71d-f1a31c82a3bc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:51.509145 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-748b3860-6033-491a-a71d-f1a31c82a3bc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:51.509964 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-748b3860-6033-491a-a71d-f1a31c82a3bc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:51.510487 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-748b3860-6033-491a-a71d-f1a31c82a3bc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:51.511448 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-748b3860-6033-491a-a71d-f1a31c82a3bc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:51.583839 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-748b3860-6033-491a-a71d-f1a31c82a3bc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:51.595438 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-748b3860-6033-491a-a71d-f1a31c82a3bc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:51.596928 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-748b3860-6033-491a-a71d-f1a31c82a3bc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:51.598359 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-748b3860-6033-491a-a71d-f1a31c82a3bc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.103698 Sep 24 21:17:51.599011 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2775/5534] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:51 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:52.635127 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1aa6796f-08bd-47de-ab17-f178dbdfb005 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:52.637331 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1aa6796f-08bd-47de-ab17-f178dbdfb005 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:52.655722 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1aa6796f-08bd-47de-ab17-f178dbdfb005 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:52.658222 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1aa6796f-08bd-47de-ab17-f178dbdfb005 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:52.659170 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1aa6796f-08bd-47de-ab17-f178dbdfb005 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:52.662217 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1aa6796f-08bd-47de-ab17-f178dbdfb005 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:52.664845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1aa6796f-08bd-47de-ab17-f178dbdfb005 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:52.665484 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1aa6796f-08bd-47de-ab17-f178dbdfb005 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:52.761796 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1aa6796f-08bd-47de-ab17-f178dbdfb005 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:52.774629 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1aa6796f-08bd-47de-ab17-f178dbdfb005 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:52.777182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1aa6796f-08bd-47de-ab17-f178dbdfb005 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:52.778478 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1aa6796f-08bd-47de-ab17-f178dbdfb005 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.152845 Sep 24 21:17:52.779183 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2760/5535] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:52 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:53.805456 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dfad2845-5f23-470a-89b5-18ac66c0e0b5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:53.805946 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dfad2845-5f23-470a-89b5-18ac66c0e0b5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:53.812936 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dfad2845-5f23-470a-89b5-18ac66c0e0b5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:53.813446 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dfad2845-5f23-470a-89b5-18ac66c0e0b5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:53.814734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dfad2845-5f23-470a-89b5-18ac66c0e0b5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:53.815746 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dfad2845-5f23-470a-89b5-18ac66c0e0b5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:53.816223 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dfad2845-5f23-470a-89b5-18ac66c0e0b5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:53.816719 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dfad2845-5f23-470a-89b5-18ac66c0e0b5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:53.887545 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dfad2845-5f23-470a-89b5-18ac66c0e0b5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:53.897962 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dfad2845-5f23-470a-89b5-18ac66c0e0b5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:53.899600 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dfad2845-5f23-470a-89b5-18ac66c0e0b5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:53.902274 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dfad2845-5f23-470a-89b5-18ac66c0e0b5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.100437 Sep 24 21:17:53.906538 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2776/5536] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:53 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:54.932952 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-73be1422-a216-4b4d-90da-e904904e01ac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:54.934426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-73be1422-a216-4b4d-90da-e904904e01ac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:54.941765 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-73be1422-a216-4b4d-90da-e904904e01ac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:54.942387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-73be1422-a216-4b4d-90da-e904904e01ac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:54.942994 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-73be1422-a216-4b4d-90da-e904904e01ac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:54.944344 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-73be1422-a216-4b4d-90da-e904904e01ac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:54.944919 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-73be1422-a216-4b4d-90da-e904904e01ac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:54.945425 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-73be1422-a216-4b4d-90da-e904904e01ac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:55.016317 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-73be1422-a216-4b4d-90da-e904904e01ac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:55.027173 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-73be1422-a216-4b4d-90da-e904904e01ac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:55.028800 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-73be1422-a216-4b4d-90da-e904904e01ac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:55.029982 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-73be1422-a216-4b4d-90da-e904904e01ac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.101674 Sep 24 21:17:55.030582 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2761/5537] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:54 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:56.060922 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a29aef1c-69f2-47f0-8330-65ca2513760c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:56.061602 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a29aef1c-69f2-47f0-8330-65ca2513760c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:56.074045 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a29aef1c-69f2-47f0-8330-65ca2513760c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:56.078033 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a29aef1c-69f2-47f0-8330-65ca2513760c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:56.080507 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a29aef1c-69f2-47f0-8330-65ca2513760c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:56.081646 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a29aef1c-69f2-47f0-8330-65ca2513760c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:56.082303 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a29aef1c-69f2-47f0-8330-65ca2513760c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:56.082962 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a29aef1c-69f2-47f0-8330-65ca2513760c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:56.196784 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a29aef1c-69f2-47f0-8330-65ca2513760c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:56.215295 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a29aef1c-69f2-47f0-8330-65ca2513760c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:56.217021 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a29aef1c-69f2-47f0-8330-65ca2513760c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:56.218453 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a29aef1c-69f2-47f0-8330-65ca2513760c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.164319 Sep 24 21:17:56.231816 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2777/5538] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:56 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:57.246355 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-287a3258-f8f1-4340-b4d3-85a4ed3c4242 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:57.247370 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-287a3258-f8f1-4340-b4d3-85a4ed3c4242 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:57.255991 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-287a3258-f8f1-4340-b4d3-85a4ed3c4242 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:57.256618 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-287a3258-f8f1-4340-b4d3-85a4ed3c4242 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:57.257183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-287a3258-f8f1-4340-b4d3-85a4ed3c4242 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:57.257974 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-287a3258-f8f1-4340-b4d3-85a4ed3c4242 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:57.258659 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-287a3258-f8f1-4340-b4d3-85a4ed3c4242 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:57.259311 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-287a3258-f8f1-4340-b4d3-85a4ed3c4242 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:57.343892 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-287a3258-f8f1-4340-b4d3-85a4ed3c4242 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:57.353006 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-287a3258-f8f1-4340-b4d3-85a4ed3c4242 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:57.354542 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-287a3258-f8f1-4340-b4d3-85a4ed3c4242 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:57.355994 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-287a3258-f8f1-4340-b4d3-85a4ed3c4242 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.114694 Sep 24 21:17:57.356570 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2762/5539] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:57 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:17:58.384588 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-00f49220-8495-46da-b8fe-46860714c166 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:58.385987 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-00f49220-8495-46da-b8fe-46860714c166 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:58.394087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00f49220-8495-46da-b8fe-46860714c166 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:58.394851 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00f49220-8495-46da-b8fe-46860714c166 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:58.395308 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00f49220-8495-46da-b8fe-46860714c166 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:58.396029 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00f49220-8495-46da-b8fe-46860714c166 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:58.396650 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00f49220-8495-46da-b8fe-46860714c166 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:58.397237 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00f49220-8495-46da-b8fe-46860714c166 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:58.471077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-00f49220-8495-46da-b8fe-46860714c166 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:58.482789 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-00f49220-8495-46da-b8fe-46860714c166 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:58.484296 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-00f49220-8495-46da-b8fe-46860714c166 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:58.485604 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-00f49220-8495-46da-b8fe-46860714c166 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.105479 Sep 24 21:17:58.486382 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2778/5540] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:58 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:17:58.945393 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6157823c-34d9-4c46-94a4-d61879a876c7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:17:58.948470 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6157823c-34d9-4c46-94a4-d61879a876c7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:58.956925 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6157823c-34d9-4c46-94a4-d61879a876c7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:58.957434 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6157823c-34d9-4c46-94a4-d61879a876c7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:58.957878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6157823c-34d9-4c46-94a4-d61879a876c7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:58.958628 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6157823c-34d9-4c46-94a4-d61879a876c7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:58.959299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6157823c-34d9-4c46-94a4-d61879a876c7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:58.959808 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6157823c-34d9-4c46-94a4-d61879a876c7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:59.013177 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6157823c-34d9-4c46-94a4-d61879a876c7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "POST /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037/action" status: 200 len: 24577 microversion: 2.1 time: 0.071422 Sep 24 21:17:59.013875 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2763/5541] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:17:58 2022] POST /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037/action => generated 24577 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:17:59.511978 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ca69c568-171f-4fea-88cf-0bc97ee2c257 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:17:59.513380 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ca69c568-171f-4fea-88cf-0bc97ee2c257 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:17:59.520740 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ca69c568-171f-4fea-88cf-0bc97ee2c257 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:59.521494 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ca69c568-171f-4fea-88cf-0bc97ee2c257 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:59.521939 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ca69c568-171f-4fea-88cf-0bc97ee2c257 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:59.522720 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ca69c568-171f-4fea-88cf-0bc97ee2c257 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:17:59.523181 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ca69c568-171f-4fea-88cf-0bc97ee2c257 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:17:59.523610 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ca69c568-171f-4fea-88cf-0bc97ee2c257 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:17:59.595716 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ca69c568-171f-4fea-88cf-0bc97ee2c257 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:59.604121 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ca69c568-171f-4fea-88cf-0bc97ee2c257 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:59.605819 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ca69c568-171f-4fea-88cf-0bc97ee2c257 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:17:59.607094 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ca69c568-171f-4fea-88cf-0bc97ee2c257 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.099916 Sep 24 21:17:59.608054 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2779/5542] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:17:59 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:00.632992 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f9d22a3b-5ec5-4778-9054-20ff40cbeda2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:00.633709 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f9d22a3b-5ec5-4778-9054-20ff40cbeda2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:00.647084 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9d22a3b-5ec5-4778-9054-20ff40cbeda2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:00.656431 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9d22a3b-5ec5-4778-9054-20ff40cbeda2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:00.657191 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9d22a3b-5ec5-4778-9054-20ff40cbeda2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:00.658425 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9d22a3b-5ec5-4778-9054-20ff40cbeda2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:00.659073 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9d22a3b-5ec5-4778-9054-20ff40cbeda2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:00.659879 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f9d22a3b-5ec5-4778-9054-20ff40cbeda2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:00.751975 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f9d22a3b-5ec5-4778-9054-20ff40cbeda2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:00.762763 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f9d22a3b-5ec5-4778-9054-20ff40cbeda2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:00.770854 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f9d22a3b-5ec5-4778-9054-20ff40cbeda2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:00.772490 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f9d22a3b-5ec5-4778-9054-20ff40cbeda2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.143799 Sep 24 21:18:00.774099 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2764/5543] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:00 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:01.799810 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f48620f2-5ca9-4bc3-aa45-69031e5d5f5b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:01.800436 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f48620f2-5ca9-4bc3-aa45-69031e5d5f5b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:01.811069 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f48620f2-5ca9-4bc3-aa45-69031e5d5f5b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:01.811659 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f48620f2-5ca9-4bc3-aa45-69031e5d5f5b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:01.812112 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f48620f2-5ca9-4bc3-aa45-69031e5d5f5b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:01.812854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f48620f2-5ca9-4bc3-aa45-69031e5d5f5b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:01.814040 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f48620f2-5ca9-4bc3-aa45-69031e5d5f5b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:01.814478 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f48620f2-5ca9-4bc3-aa45-69031e5d5f5b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:01.883640 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f48620f2-5ca9-4bc3-aa45-69031e5d5f5b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:01.900178 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f48620f2-5ca9-4bc3-aa45-69031e5d5f5b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:01.901925 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f48620f2-5ca9-4bc3-aa45-69031e5d5f5b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:01.903149 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f48620f2-5ca9-4bc3-aa45-69031e5d5f5b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.108600 Sep 24 21:18:01.903975 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2780/5544] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:01 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:02.929757 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1843c5dd-c722-4f68-b4b6-f97597cfee79 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:02.931201 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1843c5dd-c722-4f68-b4b6-f97597cfee79 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:02.937767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:18:02.940618 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1843c5dd-c722-4f68-b4b6-f97597cfee79 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:02.941373 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1843c5dd-c722-4f68-b4b6-f97597cfee79 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:02.942260 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1843c5dd-c722-4f68-b4b6-f97597cfee79 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:02.943277 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1843c5dd-c722-4f68-b4b6-f97597cfee79 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:02.943919 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1843c5dd-c722-4f68-b4b6-f97597cfee79 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:02.944366 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1843c5dd-c722-4f68-b4b6-f97597cfee79 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:03.033316 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1843c5dd-c722-4f68-b4b6-f97597cfee79 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:03.043239 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1843c5dd-c722-4f68-b4b6-f97597cfee79 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:03.044876 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1843c5dd-c722-4f68-b4b6-f97597cfee79 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:03.046169 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1843c5dd-c722-4f68-b4b6-f97597cfee79 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.120700 Sep 24 21:18:03.046880 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2765/5545] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:02 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:04.073292 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ec8cdc1f-4704-45b0-bed5-f667970789bf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:04.074014 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ec8cdc1f-4704-45b0-bed5-f667970789bf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:04.081332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ec8cdc1f-4704-45b0-bed5-f667970789bf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:04.081885 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ec8cdc1f-4704-45b0-bed5-f667970789bf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:04.082333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ec8cdc1f-4704-45b0-bed5-f667970789bf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:04.083079 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ec8cdc1f-4704-45b0-bed5-f667970789bf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:04.083547 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ec8cdc1f-4704-45b0-bed5-f667970789bf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:04.083981 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ec8cdc1f-4704-45b0-bed5-f667970789bf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:04.160087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ec8cdc1f-4704-45b0-bed5-f667970789bf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:04.169596 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ec8cdc1f-4704-45b0-bed5-f667970789bf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:04.171112 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ec8cdc1f-4704-45b0-bed5-f667970789bf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:04.172827 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ec8cdc1f-4704-45b0-bed5-f667970789bf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.102980 Sep 24 21:18:04.173588 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2781/5546] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:04 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:05.199768 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ba483bc3-5f1d-40d4-a3f5-169149e9273b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:05.200621 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ba483bc3-5f1d-40d4-a3f5-169149e9273b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:05.208332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba483bc3-5f1d-40d4-a3f5-169149e9273b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:05.208827 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba483bc3-5f1d-40d4-a3f5-169149e9273b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:05.209282 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba483bc3-5f1d-40d4-a3f5-169149e9273b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:05.210002 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba483bc3-5f1d-40d4-a3f5-169149e9273b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:05.210535 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba483bc3-5f1d-40d4-a3f5-169149e9273b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:05.210963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba483bc3-5f1d-40d4-a3f5-169149e9273b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:05.280433 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ba483bc3-5f1d-40d4-a3f5-169149e9273b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:05.290391 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ba483bc3-5f1d-40d4-a3f5-169149e9273b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:05.292109 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ba483bc3-5f1d-40d4-a3f5-169149e9273b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:05.293398 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ba483bc3-5f1d-40d4-a3f5-169149e9273b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.097638 Sep 24 21:18:05.294278 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2766/5547] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:05 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:06.320929 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f7a9ae7a-c399-4aad-a465-af693f3226f2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:06.321554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f7a9ae7a-c399-4aad-a465-af693f3226f2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:06.330421 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7a9ae7a-c399-4aad-a465-af693f3226f2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:06.331225 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7a9ae7a-c399-4aad-a465-af693f3226f2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:06.332020 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7a9ae7a-c399-4aad-a465-af693f3226f2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:06.333092 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7a9ae7a-c399-4aad-a465-af693f3226f2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:06.333737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7a9ae7a-c399-4aad-a465-af693f3226f2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:06.334252 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7a9ae7a-c399-4aad-a465-af693f3226f2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:06.440898 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f7a9ae7a-c399-4aad-a465-af693f3226f2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:06.450461 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f7a9ae7a-c399-4aad-a465-af693f3226f2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:06.451974 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f7a9ae7a-c399-4aad-a465-af693f3226f2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:06.453158 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f7a9ae7a-c399-4aad-a465-af693f3226f2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.136903 Sep 24 21:18:06.466688 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2782/5548] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:06 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:07.479379 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2470e27c-d09b-416a-9b8a-0e237f46fb17 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:07.480010 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2470e27c-d09b-416a-9b8a-0e237f46fb17 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:07.486967 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2470e27c-d09b-416a-9b8a-0e237f46fb17 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:07.487461 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2470e27c-d09b-416a-9b8a-0e237f46fb17 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:07.487937 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2470e27c-d09b-416a-9b8a-0e237f46fb17 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:07.488899 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2470e27c-d09b-416a-9b8a-0e237f46fb17 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:07.489537 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2470e27c-d09b-416a-9b8a-0e237f46fb17 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:07.489980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2470e27c-d09b-416a-9b8a-0e237f46fb17 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:07.579568 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2470e27c-d09b-416a-9b8a-0e237f46fb17 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:07.588457 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2470e27c-d09b-416a-9b8a-0e237f46fb17 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:07.590014 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2470e27c-d09b-416a-9b8a-0e237f46fb17 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:07.591527 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2470e27c-d09b-416a-9b8a-0e237f46fb17 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.116307 Sep 24 21:18:07.592142 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2767/5549] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:07 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:08.619182 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-30776451-d738-41d3-a9f6-c627e1c4bd57 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:08.620497 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-30776451-d738-41d3-a9f6-c627e1c4bd57 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:08.628495 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30776451-d738-41d3-a9f6-c627e1c4bd57 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:08.630260 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30776451-d738-41d3-a9f6-c627e1c4bd57 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:08.630949 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30776451-d738-41d3-a9f6-c627e1c4bd57 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:08.631923 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30776451-d738-41d3-a9f6-c627e1c4bd57 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:08.632550 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30776451-d738-41d3-a9f6-c627e1c4bd57 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:08.633204 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30776451-d738-41d3-a9f6-c627e1c4bd57 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:08.944383 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-30776451-d738-41d3-a9f6-c627e1c4bd57 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:08.958755 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-30776451-d738-41d3-a9f6-c627e1c4bd57 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:08.960392 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-30776451-d738-41d3-a9f6-c627e1c4bd57 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:08.961575 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-30776451-d738-41d3-a9f6-c627e1c4bd57 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.347713 Sep 24 21:18:08.962330 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2783/5550] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:08 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:18:09.987519 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5e402591-d253-461d-a2d5-741513e3dcac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:09.988962 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5e402591-d253-461d-a2d5-741513e3dcac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:09.996676 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e402591-d253-461d-a2d5-741513e3dcac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:09.997600 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e402591-d253-461d-a2d5-741513e3dcac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:09.998230 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e402591-d253-461d-a2d5-741513e3dcac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:09.999179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e402591-d253-461d-a2d5-741513e3dcac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:09.999733 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e402591-d253-461d-a2d5-741513e3dcac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:10.000251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5e402591-d253-461d-a2d5-741513e3dcac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:10.069578 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5e402591-d253-461d-a2d5-741513e3dcac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:10.082297 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5e402591-d253-461d-a2d5-741513e3dcac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:10.084189 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5e402591-d253-461d-a2d5-741513e3dcac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:10.085976 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5e402591-d253-461d-a2d5-741513e3dcac tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.103154 Sep 24 21:18:10.099110 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2768/5551] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:09 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:11.113173 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cee256fe-d78f-4dcb-83fe-04def5af89a4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:11.113978 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cee256fe-d78f-4dcb-83fe-04def5af89a4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:11.121085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cee256fe-d78f-4dcb-83fe-04def5af89a4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:11.121672 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cee256fe-d78f-4dcb-83fe-04def5af89a4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:11.122195 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cee256fe-d78f-4dcb-83fe-04def5af89a4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:11.123024 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cee256fe-d78f-4dcb-83fe-04def5af89a4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:11.123557 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cee256fe-d78f-4dcb-83fe-04def5af89a4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:11.124098 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cee256fe-d78f-4dcb-83fe-04def5af89a4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:11.197174 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cee256fe-d78f-4dcb-83fe-04def5af89a4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:11.205897 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cee256fe-d78f-4dcb-83fe-04def5af89a4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:11.207709 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cee256fe-d78f-4dcb-83fe-04def5af89a4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:11.209324 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cee256fe-d78f-4dcb-83fe-04def5af89a4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.100402 Sep 24 21:18:11.210070 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2784/5552] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:11 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:12.235173 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-25fb1249-9366-4b99-aba4-153ec511a628 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:12.235782 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-25fb1249-9366-4b99-aba4-153ec511a628 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:12.243211 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-25fb1249-9366-4b99-aba4-153ec511a628 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:12.243714 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-25fb1249-9366-4b99-aba4-153ec511a628 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:12.244161 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-25fb1249-9366-4b99-aba4-153ec511a628 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:12.244878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-25fb1249-9366-4b99-aba4-153ec511a628 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:12.245341 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-25fb1249-9366-4b99-aba4-153ec511a628 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:12.245778 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-25fb1249-9366-4b99-aba4-153ec511a628 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:12.334348 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-25fb1249-9366-4b99-aba4-153ec511a628 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:12.356712 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-25fb1249-9366-4b99-aba4-153ec511a628 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:12.358389 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-25fb1249-9366-4b99-aba4-153ec511a628 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:12.362154 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-25fb1249-9366-4b99-aba4-153ec511a628 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.129322 Sep 24 21:18:12.367082 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2769/5553] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:12 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:13.392693 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-40abcd21-6e5d-4bf2-86ff-b2438e12f0a8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:13.393275 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-40abcd21-6e5d-4bf2-86ff-b2438e12f0a8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:13.400203 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-40abcd21-6e5d-4bf2-86ff-b2438e12f0a8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:13.400692 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-40abcd21-6e5d-4bf2-86ff-b2438e12f0a8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:13.401137 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-40abcd21-6e5d-4bf2-86ff-b2438e12f0a8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:13.401835 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-40abcd21-6e5d-4bf2-86ff-b2438e12f0a8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:13.402453 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-40abcd21-6e5d-4bf2-86ff-b2438e12f0a8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:13.403063 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-40abcd21-6e5d-4bf2-86ff-b2438e12f0a8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:13.470851 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-40abcd21-6e5d-4bf2-86ff-b2438e12f0a8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:13.479682 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-40abcd21-6e5d-4bf2-86ff-b2438e12f0a8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:13.481150 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-40abcd21-6e5d-4bf2-86ff-b2438e12f0a8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:13.482311 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-40abcd21-6e5d-4bf2-86ff-b2438e12f0a8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.093798 Sep 24 21:18:13.482922 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2785/5554] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:13 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:14.508846 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-93348c0c-76e6-4ab5-9fcc-0db5079a578e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:14.509465 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-93348c0c-76e6-4ab5-9fcc-0db5079a578e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:14.516942 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93348c0c-76e6-4ab5-9fcc-0db5079a578e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:14.517520 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93348c0c-76e6-4ab5-9fcc-0db5079a578e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:14.518031 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93348c0c-76e6-4ab5-9fcc-0db5079a578e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:14.519089 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93348c0c-76e6-4ab5-9fcc-0db5079a578e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:14.519661 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93348c0c-76e6-4ab5-9fcc-0db5079a578e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:14.520308 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93348c0c-76e6-4ab5-9fcc-0db5079a578e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:14.615118 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-93348c0c-76e6-4ab5-9fcc-0db5079a578e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:14.626130 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-93348c0c-76e6-4ab5-9fcc-0db5079a578e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:14.628020 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-93348c0c-76e6-4ab5-9fcc-0db5079a578e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:14.629664 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-93348c0c-76e6-4ab5-9fcc-0db5079a578e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.124899 Sep 24 21:18:14.630405 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2770/5555] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:14 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:15.659835 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e7787a34-0d64-4d7e-a1b2-dd18a03b5c89 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:15.660373 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e7787a34-0d64-4d7e-a1b2-dd18a03b5c89 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:15.667402 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7787a34-0d64-4d7e-a1b2-dd18a03b5c89 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:15.668115 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7787a34-0d64-4d7e-a1b2-dd18a03b5c89 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:15.668812 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7787a34-0d64-4d7e-a1b2-dd18a03b5c89 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:15.669731 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7787a34-0d64-4d7e-a1b2-dd18a03b5c89 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:15.670371 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7787a34-0d64-4d7e-a1b2-dd18a03b5c89 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:15.670855 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7787a34-0d64-4d7e-a1b2-dd18a03b5c89 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:15.770598 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e7787a34-0d64-4d7e-a1b2-dd18a03b5c89 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:15.780498 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e7787a34-0d64-4d7e-a1b2-dd18a03b5c89 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:15.782710 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e7787a34-0d64-4d7e-a1b2-dd18a03b5c89 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:15.783902 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e7787a34-0d64-4d7e-a1b2-dd18a03b5c89 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.128900 Sep 24 21:18:15.784473 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2786/5556] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:15 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:16.809512 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dcd98731-499d-42a7-85f1-87c10580727d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:16.810140 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-dcd98731-499d-42a7-85f1-87c10580727d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:16.817706 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dcd98731-499d-42a7-85f1-87c10580727d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:16.818204 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dcd98731-499d-42a7-85f1-87c10580727d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:16.818680 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dcd98731-499d-42a7-85f1-87c10580727d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:16.819406 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dcd98731-499d-42a7-85f1-87c10580727d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:16.819866 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dcd98731-499d-42a7-85f1-87c10580727d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:16.820298 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dcd98731-499d-42a7-85f1-87c10580727d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:16.888272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-dcd98731-499d-42a7-85f1-87c10580727d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:16.899315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-dcd98731-499d-42a7-85f1-87c10580727d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:16.901362 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-dcd98731-499d-42a7-85f1-87c10580727d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:16.902823 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-dcd98731-499d-42a7-85f1-87c10580727d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.097392 Sep 24 21:18:16.903583 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2771/5557] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:16 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:17.929172 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e078f556-d5c1-4fbc-b174-45873f728326 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:17.930450 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e078f556-d5c1-4fbc-b174-45873f728326 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:17.940253 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e078f556-d5c1-4fbc-b174-45873f728326 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:17.940762 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e078f556-d5c1-4fbc-b174-45873f728326 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:17.941203 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e078f556-d5c1-4fbc-b174-45873f728326 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:17.942155 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e078f556-d5c1-4fbc-b174-45873f728326 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:17.942652 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e078f556-d5c1-4fbc-b174-45873f728326 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:17.943092 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e078f556-d5c1-4fbc-b174-45873f728326 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:18.039288 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e078f556-d5c1-4fbc-b174-45873f728326 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:18.056439 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e078f556-d5c1-4fbc-b174-45873f728326 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:18.058136 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e078f556-d5c1-4fbc-b174-45873f728326 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:18.060886 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e078f556-d5c1-4fbc-b174-45873f728326 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.135639 Sep 24 21:18:18.074710 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2787/5558] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:17 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:19.093331 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a4fa5404-f7cb-4bd7-92eb-1589749719d5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:19.094418 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a4fa5404-f7cb-4bd7-92eb-1589749719d5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:19.101474 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a4fa5404-f7cb-4bd7-92eb-1589749719d5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:19.102063 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a4fa5404-f7cb-4bd7-92eb-1589749719d5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:19.102526 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a4fa5404-f7cb-4bd7-92eb-1589749719d5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:19.103261 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a4fa5404-f7cb-4bd7-92eb-1589749719d5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:19.103721 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a4fa5404-f7cb-4bd7-92eb-1589749719d5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:19.104150 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a4fa5404-f7cb-4bd7-92eb-1589749719d5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:19.172168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a4fa5404-f7cb-4bd7-92eb-1589749719d5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:19.182610 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a4fa5404-f7cb-4bd7-92eb-1589749719d5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:19.184161 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a4fa5404-f7cb-4bd7-92eb-1589749719d5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:19.185392 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a4fa5404-f7cb-4bd7-92eb-1589749719d5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.096162 Sep 24 21:18:19.186015 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2772/5559] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:19 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:20.212028 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-50e0775c-c700-4db1-af08-02ecb806c23a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:20.212644 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-50e0775c-c700-4db1-af08-02ecb806c23a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:20.215458 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=28 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:18:20.221302 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-50e0775c-c700-4db1-af08-02ecb806c23a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:20.221797 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-50e0775c-c700-4db1-af08-02ecb806c23a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:20.222250 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-50e0775c-c700-4db1-af08-02ecb806c23a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:20.222992 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-50e0775c-c700-4db1-af08-02ecb806c23a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:20.223452 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-50e0775c-c700-4db1-af08-02ecb806c23a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:20.223884 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-50e0775c-c700-4db1-af08-02ecb806c23a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:20.226644 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=86 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:18:20.288773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-50e0775c-c700-4db1-af08-02ecb806c23a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:20.297997 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-50e0775c-c700-4db1-af08-02ecb806c23a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:20.300006 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-50e0775c-c700-4db1-af08-02ecb806c23a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:20.301409 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-50e0775c-c700-4db1-af08-02ecb806c23a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.093375 Sep 24 21:18:20.315125 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2788/5560] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:20 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:21.333171 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a409e012-b770-4ab6-bb80-4d15f0af8ff6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:21.333795 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a409e012-b770-4ab6-bb80-4d15f0af8ff6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:21.341419 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a409e012-b770-4ab6-bb80-4d15f0af8ff6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:21.341933 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a409e012-b770-4ab6-bb80-4d15f0af8ff6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:21.342375 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a409e012-b770-4ab6-bb80-4d15f0af8ff6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:21.343131 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a409e012-b770-4ab6-bb80-4d15f0af8ff6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:21.343640 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a409e012-b770-4ab6-bb80-4d15f0af8ff6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:21.344167 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a409e012-b770-4ab6-bb80-4d15f0af8ff6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:21.436007 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a409e012-b770-4ab6-bb80-4d15f0af8ff6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:21.446867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a409e012-b770-4ab6-bb80-4d15f0af8ff6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:21.448757 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a409e012-b770-4ab6-bb80-4d15f0af8ff6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:21.450169 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a409e012-b770-4ab6-bb80-4d15f0af8ff6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.121057 Sep 24 21:18:21.450851 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2773/5561] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:21 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:21.978341 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-03c36f37-3f22-42d5-895c-bd9e46f74edf tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:21.978995 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-03c36f37-3f22-42d5-895c-bd9e46f74edf tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:21.986281 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-03c36f37-3f22-42d5-895c-bd9e46f74edf tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:21.986914 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-03c36f37-3f22-42d5-895c-bd9e46f74edf tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:21.987368 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-03c36f37-3f22-42d5-895c-bd9e46f74edf tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:21.988106 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-03c36f37-3f22-42d5-895c-bd9e46f74edf tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:21.988578 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-03c36f37-3f22-42d5-895c-bd9e46f74edf tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:21.989015 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-03c36f37-3f22-42d5-895c-bd9e46f74edf tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:22.251176 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-03c36f37-3f22-42d5-895c-bd9e46f74edf tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1835 microversion: 2.1 time: 0.275511 Sep 24 21:18:22.266814 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2789/5562] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:18:21 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1835 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:18:22.475374 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-66b2d29a-3dfb-4656-95b9-ed570e8290da tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:22.476044 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-66b2d29a-3dfb-4656-95b9-ed570e8290da tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:22.483172 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66b2d29a-3dfb-4656-95b9-ed570e8290da tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:22.483980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66b2d29a-3dfb-4656-95b9-ed570e8290da tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:22.484765 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66b2d29a-3dfb-4656-95b9-ed570e8290da tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:22.485503 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66b2d29a-3dfb-4656-95b9-ed570e8290da tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:22.486296 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66b2d29a-3dfb-4656-95b9-ed570e8290da tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:22.486995 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66b2d29a-3dfb-4656-95b9-ed570e8290da tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:22.703357 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-66b2d29a-3dfb-4656-95b9-ed570e8290da tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:22.721115 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-66b2d29a-3dfb-4656-95b9-ed570e8290da tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:22.722553 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-66b2d29a-3dfb-4656-95b9-ed570e8290da tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:22.723711 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-66b2d29a-3dfb-4656-95b9-ed570e8290da tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.252597 Sep 24 21:18:22.735132 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2774/5563] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:22 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:23.276553 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4619d57f-488a-44c5-a79b-b60f681838bf tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:23.278138 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-576e0ded-0373-4efa-bb28-4e9f92afb4c5 req-cd6b1289-8a81-4245-ad7a-5ba016eb3165 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97863e58-47a8-44be-a268-26807a10f037", "tag": "72dd520b-415e-4703-95f2-fa48dc8a2c00"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:18:23.282180 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4619d57f-488a-44c5-a79b-b60f681838bf tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:23.302675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-576e0ded-0373-4efa-bb28-4e9f92afb4c5 req-cd6b1289-8a81-4245-ad7a-5ba016eb3165 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:23.306073 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4619d57f-488a-44c5-a79b-b60f681838bf tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:23.307886 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4619d57f-488a-44c5-a79b-b60f681838bf tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:23.310158 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4619d57f-488a-44c5-a79b-b60f681838bf tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:23.311401 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4619d57f-488a-44c5-a79b-b60f681838bf tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:23.311580 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-576e0ded-0373-4efa-bb28-4e9f92afb4c5 req-cd6b1289-8a81-4245-ad7a-5ba016eb3165 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:23.312725 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-576e0ded-0373-4efa-bb28-4e9f92afb4c5 req-cd6b1289-8a81-4245-ad7a-5ba016eb3165 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:23.313436 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4619d57f-488a-44c5-a79b-b60f681838bf tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:23.314969 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4619d57f-488a-44c5-a79b-b60f681838bf tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:23.335551 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=89 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:18:23.338074 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-576e0ded-0373-4efa-bb28-4e9f92afb4c5 req-cd6b1289-8a81-4245-ad7a-5ba016eb3165 service nova] Creating event network-changed:72dd520b-415e-4703-95f2-fa48dc8a2c00 for instance 97863e58-47a8-44be-a268-26807a10f037 on nch1-master-1 Sep 24 21:18:23.357129 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-576e0ded-0373-4efa-bb28-4e9f92afb4c5 req-cd6b1289-8a81-4245-ad7a-5ba016eb3165 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090669 Sep 24 21:18:23.360770 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2775/5564] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:18:23.370655 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4619d57f-488a-44c5-a79b-b60f681838bf tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:18:23.484486 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4619d57f-488a-44c5-a79b-b60f681838bf tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "DELETE /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 204 len: 0 microversion: 2.1 time: 0.223064 Sep 24 21:18:23.485512 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2790/5565] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:18:23 2022] DELETE /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:18:23.496724 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-19e2bb45-fe78-4545-b606-3e702062fc78 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:23.498091 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-19e2bb45-fe78-4545-b606-3e702062fc78 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:23.507731 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-19e2bb45-fe78-4545-b606-3e702062fc78 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:23.508798 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-19e2bb45-fe78-4545-b606-3e702062fc78 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:23.509401 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-19e2bb45-fe78-4545-b606-3e702062fc78 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:23.510279 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-19e2bb45-fe78-4545-b606-3e702062fc78 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:23.510978 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-19e2bb45-fe78-4545-b606-3e702062fc78 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:23.511506 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-19e2bb45-fe78-4545-b606-3e702062fc78 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:23.742959 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-19e2bb45-fe78-4545-b606-3e702062fc78 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:23.757101 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6a13d040-cae4-45ee-894e-d9d8f1ec8f48 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:23.758277 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6a13d040-cae4-45ee-894e-d9d8f1ec8f48 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:23.770373 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-19e2bb45-fe78-4545-b606-3e702062fc78 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1690 microversion: 2.1 time: 0.279870 Sep 24 21:18:23.772373 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2776/5566] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:18:23 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1690 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:18:23.776146 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6a13d040-cae4-45ee-894e-d9d8f1ec8f48 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:23.776651 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6a13d040-cae4-45ee-894e-d9d8f1ec8f48 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:23.777101 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6a13d040-cae4-45ee-894e-d9d8f1ec8f48 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:23.777831 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6a13d040-cae4-45ee-894e-d9d8f1ec8f48 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:23.778297 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6a13d040-cae4-45ee-894e-d9d8f1ec8f48 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:23.778764 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6a13d040-cae4-45ee-894e-d9d8f1ec8f48 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:23.897222 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6a13d040-cae4-45ee-894e-d9d8f1ec8f48 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:23.910381 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6a13d040-cae4-45ee-894e-d9d8f1ec8f48 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:23.915426 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6a13d040-cae4-45ee-894e-d9d8f1ec8f48 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:23.917232 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6a13d040-cae4-45ee-894e-d9d8f1ec8f48 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.168417 Sep 24 21:18:23.918401 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2791/5567] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:23 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:24.796912 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1a887d51-ff07-4300-b979-0522726850bf tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:24.798202 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1a887d51-ff07-4300-b979-0522726850bf tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:24.806286 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a887d51-ff07-4300-b979-0522726850bf tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:24.807107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a887d51-ff07-4300-b979-0522726850bf tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:24.807794 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a887d51-ff07-4300-b979-0522726850bf tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:24.835945 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a887d51-ff07-4300-b979-0522726850bf tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:24.836821 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a887d51-ff07-4300-b979-0522726850bf tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:24.838713 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a887d51-ff07-4300-b979-0522726850bf tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:24.943960 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-104f9e18-9f19-49a0-8285-e5981e8dee7d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:24.944685 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-104f9e18-9f19-49a0-8285-e5981e8dee7d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:24.956022 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-104f9e18-9f19-49a0-8285-e5981e8dee7d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:24.956022 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-104f9e18-9f19-49a0-8285-e5981e8dee7d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:24.956428 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-104f9e18-9f19-49a0-8285-e5981e8dee7d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:24.957396 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-104f9e18-9f19-49a0-8285-e5981e8dee7d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:24.958091 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-104f9e18-9f19-49a0-8285-e5981e8dee7d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:24.958784 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-104f9e18-9f19-49a0-8285-e5981e8dee7d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:25.072676 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-104f9e18-9f19-49a0-8285-e5981e8dee7d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:25.089462 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-104f9e18-9f19-49a0-8285-e5981e8dee7d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:25.091478 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-104f9e18-9f19-49a0-8285-e5981e8dee7d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:25.094111 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-104f9e18-9f19-49a0-8285-e5981e8dee7d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.153668 Sep 24 21:18:25.094942 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2792/5568] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:24 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:18:25.098023 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1a887d51-ff07-4300-b979-0522726850bf tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:25.115925 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1a887d51-ff07-4300-b979-0522726850bf tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1690 microversion: 2.1 time: 0.322961 Sep 24 21:18:25.117118 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2777/5569] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:18:24 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1690 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:18:25.667977 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-382a7566-c657-46e5-9d2c-12444eabc6c2 req-b4408135-5ebd-4930-b910-0c87390ea5d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97863e58-47a8-44be-a268-26807a10f037", "name": "network-vif-deleted", "tag": "72dd520b-415e-4703-95f2-fa48dc8a2c00"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:18:25.679172 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-382a7566-c657-46e5-9d2c-12444eabc6c2 req-b4408135-5ebd-4930-b910-0c87390ea5d7 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:25.679717 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-382a7566-c657-46e5-9d2c-12444eabc6c2 req-b4408135-5ebd-4930-b910-0c87390ea5d7 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:25.680339 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-382a7566-c657-46e5-9d2c-12444eabc6c2 req-b4408135-5ebd-4930-b910-0c87390ea5d7 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:25.697462 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-382a7566-c657-46e5-9d2c-12444eabc6c2 req-b4408135-5ebd-4930-b910-0c87390ea5d7 service nova] Creating event network-vif-deleted:72dd520b-415e-4703-95f2-fa48dc8a2c00 for instance 97863e58-47a8-44be-a268-26807a10f037 on nch1-master-1 Sep 24 21:18:25.703721 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-382a7566-c657-46e5-9d2c-12444eabc6c2 req-b4408135-5ebd-4930-b910-0c87390ea5d7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039305 Sep 24 21:18:25.704566 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2793/5570] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:18:26.120892 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b1b71b26-a33a-4f2f-8697-84dcd740106e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:26.121519 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b1b71b26-a33a-4f2f-8697-84dcd740106e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:26.130405 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1b71b26-a33a-4f2f-8697-84dcd740106e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:26.131205 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1b71b26-a33a-4f2f-8697-84dcd740106e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:26.131890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1b71b26-a33a-4f2f-8697-84dcd740106e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:26.132784 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1b71b26-a33a-4f2f-8697-84dcd740106e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:26.135248 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1b71b26-a33a-4f2f-8697-84dcd740106e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:26.135940 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1b71b26-a33a-4f2f-8697-84dcd740106e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:26.141562 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-96730833-5561-4d26-8308-77aa62ad9c9a tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:26.144110 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-96730833-5561-4d26-8308-77aa62ad9c9a tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:26.160413 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96730833-5561-4d26-8308-77aa62ad9c9a tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:26.161029 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96730833-5561-4d26-8308-77aa62ad9c9a tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:26.161578 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96730833-5561-4d26-8308-77aa62ad9c9a tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:26.162611 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96730833-5561-4d26-8308-77aa62ad9c9a tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:26.164189 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96730833-5561-4d26-8308-77aa62ad9c9a tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:26.164522 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96730833-5561-4d26-8308-77aa62ad9c9a tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:26.230982 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96730833-5561-4d26-8308-77aa62ad9c9a tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:26.231486 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96730833-5561-4d26-8308-77aa62ad9c9a tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:26.231936 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96730833-5561-4d26-8308-77aa62ad9c9a tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:26.232783 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-96730833-5561-4d26-8308-77aa62ad9c9a tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lazy-loading 'fault' on Instance uuid 97863e58-47a8-44be-a268-26807a10f037 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:18:26.251603 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b1b71b26-a33a-4f2f-8697-84dcd740106e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:26.278834 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b1b71b26-a33a-4f2f-8697-84dcd740106e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:26.284853 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b1b71b26-a33a-4f2f-8697-84dcd740106e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:26.288264 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b1b71b26-a33a-4f2f-8697-84dcd740106e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.172284 Sep 24 21:18:26.291618 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2778/5571] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:26 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:26.295565 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-96730833-5561-4d26-8308-77aa62ad9c9a tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:26.308924 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-96730833-5561-4d26-8308-77aa62ad9c9a tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 200 len: 1357 microversion: 2.1 time: 0.172487 Sep 24 21:18:26.312606 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2794/5572] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:18:26 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:18:27.319337 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6593cc6b-fb12-4d0a-9fe9-98edefb63091 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:27.320127 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6593cc6b-fb12-4d0a-9fe9-98edefb63091 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:27.332577 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6593cc6b-fb12-4d0a-9fe9-98edefb63091 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:27.333188 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6593cc6b-fb12-4d0a-9fe9-98edefb63091 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:27.333745 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6593cc6b-fb12-4d0a-9fe9-98edefb63091 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:27.334732 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6593cc6b-fb12-4d0a-9fe9-98edefb63091 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:27.335557 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6593cc6b-fb12-4d0a-9fe9-98edefb63091 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:27.336656 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6593cc6b-fb12-4d0a-9fe9-98edefb63091 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:27.341670 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-984588da-0214-424c-97d7-bd05338d36a7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:27.344250 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-984588da-0214-424c-97d7-bd05338d36a7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 97863e58-47a8-44be-a268-26807a10f037] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:27.352480 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-984588da-0214-424c-97d7-bd05338d36a7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:27.353382 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-984588da-0214-424c-97d7-bd05338d36a7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:27.354004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-984588da-0214-424c-97d7-bd05338d36a7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:27.354920 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-984588da-0214-424c-97d7-bd05338d36a7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:27.355701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-984588da-0214-424c-97d7-bd05338d36a7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:27.356933 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-984588da-0214-424c-97d7-bd05338d36a7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:27.377101 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-984588da-0214-424c-97d7-bd05338d36a7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] HTTP exception thrown: Instance 97863e58-47a8-44be-a268-26807a10f037 could not be found. Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-984588da-0214-424c-97d7-bd05338d36a7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Request method failure captured: Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 HTTP/1.1 Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3OCLEGvCgXQkF150J8WxaJ6Egfirp5WYU549-Kd58eqlMFmsTZ5EPhwnMOzai9maVUW5D3Dnd0VpB4KutZpZm5Xvo1jNqQCDPx_Xyeb8QSTxhIJvz1mFjCjXsZ8t-QiX5KDB4ZcWr8p8qona_16KbypzpGW3AGYhC3XCYDXOZAEBUo Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: a5c4c9ce4cb946a9a381271ab15aee09 Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1280777913 Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5c4c9ce4cb946a9a381271ab15aee09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a5c4c9ce4cb946a9a381271ab15aee09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a5c4c9ce4cb946a9a381271ab15aee09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5c4c9ce4cb946a9a381271ab15aee09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1280777913 Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: a5c4c9ce4cb946a9a381271ab15aee09 Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1280777913 Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-TestNetworkAdvancedServerOps-1280777913-project Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 82c2160fcae947138ddd7b1b4df1e361 Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1280777913-project Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 97863e58-47a8-44be-a268-26807a10f037 could not be found. Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '97863e58-47a8-44be-a268-26807a10f037'} Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97863e58-47a8-44be-a268-26807a10f037 could not be found. Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97863e58-47a8-44be-a268-26807a10f037 could not be found. Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:18:27.379084 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:18:27.383933 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:18:27.383933 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:18:27.383933 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:18:27.383933 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:18:27.383933 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:18:27.383933 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:18:27.383933 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97863e58-47a8-44be-a268-26807a10f037 could not be found. Sep 24 21:18:27.383933 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:18:27.386041 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-984588da-0214-424c-97d7-bd05338d36a7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Returning 404 to user: Instance 97863e58-47a8-44be-a268-26807a10f037 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:18:27.386980 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-984588da-0214-424c-97d7-bd05338d36a7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037" status: 404 len: 111 microversion: 2.1 time: 0.055433 Sep 24 21:18:27.387684 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2795/5573] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:18:27 2022] GET /compute/v2.1/servers/97863e58-47a8-44be-a268-26807a10f037 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 21:18:27.435737 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6593cc6b-fb12-4d0a-9fe9-98edefb63091 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:27.446422 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6593cc6b-fb12-4d0a-9fe9-98edefb63091 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:27.447904 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6593cc6b-fb12-4d0a-9fe9-98edefb63091 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:27.449071 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6593cc6b-fb12-4d0a-9fe9-98edefb63091 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.135919 Sep 24 21:18:27.449821 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2779/5574] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:27 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:28.475684 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e5eee9b3-7fc4-4e2a-b546-1adce5404afe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:28.476259 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e5eee9b3-7fc4-4e2a-b546-1adce5404afe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:28.487528 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5eee9b3-7fc4-4e2a-b546-1adce5404afe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:28.488268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5eee9b3-7fc4-4e2a-b546-1adce5404afe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:28.490816 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5eee9b3-7fc4-4e2a-b546-1adce5404afe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:28.491750 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5eee9b3-7fc4-4e2a-b546-1adce5404afe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:28.493033 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5eee9b3-7fc4-4e2a-b546-1adce5404afe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:28.495050 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5eee9b3-7fc4-4e2a-b546-1adce5404afe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:28.623013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e5eee9b3-7fc4-4e2a-b546-1adce5404afe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:28.646718 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e5eee9b3-7fc4-4e2a-b546-1adce5404afe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:28.648837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e5eee9b3-7fc4-4e2a-b546-1adce5404afe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:28.650832 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e5eee9b3-7fc4-4e2a-b546-1adce5404afe tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.178893 Sep 24 21:18:28.652039 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2796/5575] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:28 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:29.678702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0e62a86a-1ff8-488c-b094-35b2bb03f04d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:29.680030 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0e62a86a-1ff8-488c-b094-35b2bb03f04d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:29.688645 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e62a86a-1ff8-488c-b094-35b2bb03f04d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:29.689384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e62a86a-1ff8-488c-b094-35b2bb03f04d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:29.689968 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e62a86a-1ff8-488c-b094-35b2bb03f04d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:29.691455 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e62a86a-1ff8-488c-b094-35b2bb03f04d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:29.692088 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e62a86a-1ff8-488c-b094-35b2bb03f04d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:29.692737 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e62a86a-1ff8-488c-b094-35b2bb03f04d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:29.764907 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0e62a86a-1ff8-488c-b094-35b2bb03f04d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:29.775675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0e62a86a-1ff8-488c-b094-35b2bb03f04d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:29.777386 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0e62a86a-1ff8-488c-b094-35b2bb03f04d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:29.778864 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0e62a86a-1ff8-488c-b094-35b2bb03f04d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.104597 Sep 24 21:18:29.798708 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2780/5576] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:29 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:30.806999 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f636f806-4e69-41b8-bcf6-04e2d81d71fa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:30.808073 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f636f806-4e69-41b8-bcf6-04e2d81d71fa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:30.821042 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f636f806-4e69-41b8-bcf6-04e2d81d71fa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:30.821548 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f636f806-4e69-41b8-bcf6-04e2d81d71fa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:30.822207 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f636f806-4e69-41b8-bcf6-04e2d81d71fa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:30.822964 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f636f806-4e69-41b8-bcf6-04e2d81d71fa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:30.825055 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f636f806-4e69-41b8-bcf6-04e2d81d71fa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:30.825732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f636f806-4e69-41b8-bcf6-04e2d81d71fa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:30.937114 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f636f806-4e69-41b8-bcf6-04e2d81d71fa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:30.947501 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f636f806-4e69-41b8-bcf6-04e2d81d71fa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:30.949600 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f636f806-4e69-41b8-bcf6-04e2d81d71fa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:30.951363 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f636f806-4e69-41b8-bcf6-04e2d81d71fa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.148640 Sep 24 21:18:30.952064 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2797/5577] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:30 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:18:31.979528 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c80beec1-92a1-462b-90b4-f3c9b711e570 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:31.980790 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c80beec1-92a1-462b-90b4-f3c9b711e570 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:32.009291 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c80beec1-92a1-462b-90b4-f3c9b711e570 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:32.010118 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c80beec1-92a1-462b-90b4-f3c9b711e570 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:32.010809 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c80beec1-92a1-462b-90b4-f3c9b711e570 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:32.011736 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c80beec1-92a1-462b-90b4-f3c9b711e570 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:32.012586 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c80beec1-92a1-462b-90b4-f3c9b711e570 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:32.013220 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c80beec1-92a1-462b-90b4-f3c9b711e570 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:32.102655 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c80beec1-92a1-462b-90b4-f3c9b711e570 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:32.121547 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c80beec1-92a1-462b-90b4-f3c9b711e570 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:32.124519 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c80beec1-92a1-462b-90b4-f3c9b711e570 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:32.126379 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c80beec1-92a1-462b-90b4-f3c9b711e570 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.152910 Sep 24 21:18:32.131321 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2781/5578] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:31 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:32.502855 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d04fe319-e4de-4600-8b5f-b3efa45845e4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '.version_select at 0x7f4b07d03160>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:32.555860 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d04fe319-e4de-4600-8b5f-b3efa45845e4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1248371900" status: 202 len: 0 microversion: 2.1 time: 0.063503 Sep 24 21:18:32.560517 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2798/5579] 10.222.0.52 () {58 vars in 1284 bytes} [Sat Sep 24 21:18:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1248371900 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:18:32.590146 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a975993d-d296-47b4-9119-ac121c980068 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Action: 'create', calling method: .version_select at 0x7f4b0c0c6550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1636737121", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7cB3bYti96y11WiO7XI7NbTCymURtUg95mKCVLD44MBjcAXfs4gW6ZjJF697D+gvoEfm9KLhSi2XaYxGV9XR4pHo/v+qtfrPurIMxgAwpMg+0qMJDxkv4Ler7RxlT7PA=="}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:18:32.607974 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-a975993d-d296-47b4-9119-ac121c980068 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Getting quotas for project a5c4c9ce4cb946a9a381271ab15aee09. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:18:32.613923 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-a975993d-d296-47b4-9119-ac121c980068 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Getting quotas for user 82c2160fcae947138ddd7b1b4df1e361 and project a5c4c9ce4cb946a9a381271ab15aee09. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:18:32.648749 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a975993d-d296-47b4-9119-ac121c980068 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.062320 Sep 24 21:18:32.650026 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2782/5580] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 21:18:32 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:18:33.158648 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7d668164-1398-4def-9f67-64414694cea9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:33.159279 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7d668164-1398-4def-9f67-64414694cea9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:33.166079 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d668164-1398-4def-9f67-64414694cea9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:33.166873 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d668164-1398-4def-9f67-64414694cea9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:33.167322 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d668164-1398-4def-9f67-64414694cea9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:33.168026 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d668164-1398-4def-9f67-64414694cea9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:33.168656 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d668164-1398-4def-9f67-64414694cea9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:33.169091 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d668164-1398-4def-9f67-64414694cea9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:33.248011 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7d668164-1398-4def-9f67-64414694cea9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:33.258006 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7d668164-1398-4def-9f67-64414694cea9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:33.259744 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7d668164-1398-4def-9f67-64414694cea9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:33.260962 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7d668164-1398-4def-9f67-64414694cea9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.106419 Sep 24 21:18:33.261857 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2799/5581] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:33 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:34.288532 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-10bc714f-957d-4442-b8d3-eec6f3f53251 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:34.289768 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-10bc714f-957d-4442-b8d3-eec6f3f53251 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:34.299825 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:18:34.301656 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10bc714f-957d-4442-b8d3-eec6f3f53251 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:34.302315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10bc714f-957d-4442-b8d3-eec6f3f53251 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:34.303190 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10bc714f-957d-4442-b8d3-eec6f3f53251 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:34.304209 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10bc714f-957d-4442-b8d3-eec6f3f53251 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:34.304837 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10bc714f-957d-4442-b8d3-eec6f3f53251 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:34.305658 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10bc714f-957d-4442-b8d3-eec6f3f53251 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:34.539893 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-10bc714f-957d-4442-b8d3-eec6f3f53251 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:34.554248 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-10bc714f-957d-4442-b8d3-eec6f3f53251 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:34.563652 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-10bc714f-957d-4442-b8d3-eec6f3f53251 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:34.564894 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-10bc714f-957d-4442-b8d3-eec6f3f53251 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.281072 Sep 24 21:18:34.565500 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2783/5582] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:34 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:35.593391 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fa125620-2655-4272-b03c-d2dca7c001d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:35.595183 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fa125620-2655-4272-b03c-d2dca7c001d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:35.602761 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa125620-2655-4272-b03c-d2dca7c001d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:35.603628 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa125620-2655-4272-b03c-d2dca7c001d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:35.604433 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa125620-2655-4272-b03c-d2dca7c001d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:35.605383 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa125620-2655-4272-b03c-d2dca7c001d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:35.605911 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa125620-2655-4272-b03c-d2dca7c001d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:35.606453 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa125620-2655-4272-b03c-d2dca7c001d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:35.723731 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fa125620-2655-4272-b03c-d2dca7c001d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:35.733710 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fa125620-2655-4272-b03c-d2dca7c001d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:35.735715 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fa125620-2655-4272-b03c-d2dca7c001d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:35.737131 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fa125620-2655-4272-b03c-d2dca7c001d3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.148382 Sep 24 21:18:35.737702 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2800/5583] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:35 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:36.763107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7b1822b0-5c05-4186-9f4e-e4c1f7c03565 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:36.764910 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7b1822b0-5c05-4186-9f4e-e4c1f7c03565 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:36.776095 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b1822b0-5c05-4186-9f4e-e4c1f7c03565 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:36.776921 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b1822b0-5c05-4186-9f4e-e4c1f7c03565 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:36.777555 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b1822b0-5c05-4186-9f4e-e4c1f7c03565 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:36.785543 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b1822b0-5c05-4186-9f4e-e4c1f7c03565 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:36.786143 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b1822b0-5c05-4186-9f4e-e4c1f7c03565 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:36.787071 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b1822b0-5c05-4186-9f4e-e4c1f7c03565 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:36.877132 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7b1822b0-5c05-4186-9f4e-e4c1f7c03565 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:36.893822 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7b1822b0-5c05-4186-9f4e-e4c1f7c03565 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:36.896295 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7b1822b0-5c05-4186-9f4e-e4c1f7c03565 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:36.897856 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7b1822b0-5c05-4186-9f4e-e4c1f7c03565 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.139442 Sep 24 21:18:36.898520 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2784/5584] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:36 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:37.928337 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3c6359bd-2771-48fd-ba66-61fab8796350 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:37.929015 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3c6359bd-2771-48fd-ba66-61fab8796350 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:37.937620 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c6359bd-2771-48fd-ba66-61fab8796350 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:37.938985 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c6359bd-2771-48fd-ba66-61fab8796350 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:37.939771 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c6359bd-2771-48fd-ba66-61fab8796350 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:37.940759 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c6359bd-2771-48fd-ba66-61fab8796350 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:37.941443 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c6359bd-2771-48fd-ba66-61fab8796350 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:37.942131 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c6359bd-2771-48fd-ba66-61fab8796350 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:38.177004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3c6359bd-2771-48fd-ba66-61fab8796350 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:38.191769 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3c6359bd-2771-48fd-ba66-61fab8796350 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:38.193265 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3c6359bd-2771-48fd-ba66-61fab8796350 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:38.194483 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3c6359bd-2771-48fd-ba66-61fab8796350 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.272269 Sep 24 21:18:38.206933 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2801/5585] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:37 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:18:39.224834 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b8ecdd7e-70d3-4771-bd02-37a244d279a2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:39.226863 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b8ecdd7e-70d3-4771-bd02-37a244d279a2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:39.238696 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b8ecdd7e-70d3-4771-bd02-37a244d279a2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:39.239474 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b8ecdd7e-70d3-4771-bd02-37a244d279a2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:39.240089 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b8ecdd7e-70d3-4771-bd02-37a244d279a2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:39.241338 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b8ecdd7e-70d3-4771-bd02-37a244d279a2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:39.244574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b8ecdd7e-70d3-4771-bd02-37a244d279a2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:39.246251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b8ecdd7e-70d3-4771-bd02-37a244d279a2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:39.367702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b8ecdd7e-70d3-4771-bd02-37a244d279a2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:39.394599 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b8ecdd7e-70d3-4771-bd02-37a244d279a2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:39.397801 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b8ecdd7e-70d3-4771-bd02-37a244d279a2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:39.399646 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b8ecdd7e-70d3-4771-bd02-37a244d279a2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.180399 Sep 24 21:18:39.401520 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2785/5586] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:39 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:40.427443 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b93a8875-ece8-4751-943c-51389849932a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:40.428075 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b93a8875-ece8-4751-943c-51389849932a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:40.449219 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b93a8875-ece8-4751-943c-51389849932a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:40.450199 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b93a8875-ece8-4751-943c-51389849932a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:40.451157 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b93a8875-ece8-4751-943c-51389849932a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:40.452746 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b93a8875-ece8-4751-943c-51389849932a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:40.453390 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b93a8875-ece8-4751-943c-51389849932a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:40.453999 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b93a8875-ece8-4751-943c-51389849932a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:40.593249 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b93a8875-ece8-4751-943c-51389849932a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:40.603906 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b93a8875-ece8-4751-943c-51389849932a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:40.606628 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b93a8875-ece8-4751-943c-51389849932a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:40.609096 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b93a8875-ece8-4751-943c-51389849932a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.187603 Sep 24 21:18:40.610399 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2802/5587] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:40 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:40.777564 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7083b531-078f-4542-a0e2-5efe229d7682 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-812363366", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "4082356a-c64d-46ce-b703-65066fdc6ebf"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1636737121", "security_groups": [{"name": "tempest-secgroup-smoke-1770754378"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:18:40.921749 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-7083b531-078f-4542-a0e2-5efe229d7682 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] validate_networks() for [('4082356a-c64d-46ce-b703-65066fdc6ebf', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:18:41.515589 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-7083b531-078f-4542-a0e2-5efe229d7682 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:18:41.516051 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-7083b531-078f-4542-a0e2-5efe229d7682 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:18:41.516550 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-7083b531-078f-4542-a0e2-5efe229d7682 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:18:41.516968 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-7083b531-078f-4542-a0e2-5efe229d7682 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:18:41.517395 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-7083b531-078f-4542-a0e2-5efe229d7682 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:18:41.527215 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7083b531-078f-4542-a0e2-5efe229d7682 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:41.527707 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7083b531-078f-4542-a0e2-5efe229d7682 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:41.528147 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7083b531-078f-4542-a0e2-5efe229d7682 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:41.528881 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7083b531-078f-4542-a0e2-5efe229d7682 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:41.529340 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7083b531-078f-4542-a0e2-5efe229d7682 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:41.530359 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7083b531-078f-4542-a0e2-5efe229d7682 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:41.548960 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-7083b531-078f-4542-a0e2-5efe229d7682 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Getting quotas for project a5c4c9ce4cb946a9a381271ab15aee09. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:18:41.555417 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-7083b531-078f-4542-a0e2-5efe229d7682 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Getting quotas for user 82c2160fcae947138ddd7b1b4df1e361 and project a5c4c9ce4cb946a9a381271ab15aee09. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:18:41.569559 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7083b531-078f-4542-a0e2-5efe229d7682 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:18:41.571959 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7083b531-078f-4542-a0e2-5efe229d7682 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:18:41.625158 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7083b531-078f-4542-a0e2-5efe229d7682 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.851891 Sep 24 21:18:41.626429 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2786/5588] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:18:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 24 21:18:41.636347 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4ce1702d-b77e-4dca-aa89-9f2bc5515287 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:41.637575 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4ce1702d-b77e-4dca-aa89-9f2bc5515287 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:41.637797 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e7f7f281-69c7-487e-b6d7-dcea87231764 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:41.642564 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e7f7f281-69c7-487e-b6d7-dcea87231764 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:41.660270 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ce1702d-b77e-4dca-aa89-9f2bc5515287 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:41.661428 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ce1702d-b77e-4dca-aa89-9f2bc5515287 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:41.662711 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ce1702d-b77e-4dca-aa89-9f2bc5515287 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:41.663758 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ce1702d-b77e-4dca-aa89-9f2bc5515287 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:41.664479 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ce1702d-b77e-4dca-aa89-9f2bc5515287 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:41.665106 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ce1702d-b77e-4dca-aa89-9f2bc5515287 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:41.781422 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e7f7f281-69c7-487e-b6d7-dcea87231764 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:41.805148 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e7f7f281-69c7-487e-b6d7-dcea87231764 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1266 microversion: 2.1 time: 0.171518 Sep 24 21:18:41.805771 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2787/5589] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:18:41 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:18:41.826802 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4ce1702d-b77e-4dca-aa89-9f2bc5515287 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:41.835938 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4ce1702d-b77e-4dca-aa89-9f2bc5515287 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:41.837615 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4ce1702d-b77e-4dca-aa89-9f2bc5515287 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:41.843023 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4ce1702d-b77e-4dca-aa89-9f2bc5515287 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.206584 Sep 24 21:18:41.855102 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2803/5590] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:41 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:42.833961 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-89af0083-7f64-4641-aaaa-b63f852c6c2b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:42.835245 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-89af0083-7f64-4641-aaaa-b63f852c6c2b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:42.844164 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89af0083-7f64-4641-aaaa-b63f852c6c2b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:42.844941 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89af0083-7f64-4641-aaaa-b63f852c6c2b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:42.845692 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89af0083-7f64-4641-aaaa-b63f852c6c2b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:42.846742 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89af0083-7f64-4641-aaaa-b63f852c6c2b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:42.847454 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89af0083-7f64-4641-aaaa-b63f852c6c2b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:42.847913 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89af0083-7f64-4641-aaaa-b63f852c6c2b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:42.882177 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c2a29faf-f504-4984-a165-68ddd53375da tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:42.883998 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c2a29faf-f504-4984-a165-68ddd53375da tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:42.895088 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c2a29faf-f504-4984-a165-68ddd53375da tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:42.896044 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c2a29faf-f504-4984-a165-68ddd53375da tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:42.896927 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c2a29faf-f504-4984-a165-68ddd53375da tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:42.898604 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c2a29faf-f504-4984-a165-68ddd53375da tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:42.899628 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c2a29faf-f504-4984-a165-68ddd53375da tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:42.900298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c2a29faf-f504-4984-a165-68ddd53375da tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:43.011859 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-89af0083-7f64-4641-aaaa-b63f852c6c2b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:43.035227 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-89af0083-7f64-4641-aaaa-b63f852c6c2b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1326 microversion: 2.1 time: 0.204995 Sep 24 21:18:43.050523 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2788/5591] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:18:42 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1326 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:18:43.091447 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c2a29faf-f504-4984-a165-68ddd53375da tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:43.106762 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c2a29faf-f504-4984-a165-68ddd53375da tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:43.110238 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c2a29faf-f504-4984-a165-68ddd53375da tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:43.111668 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c2a29faf-f504-4984-a165-68ddd53375da tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.243377 Sep 24 21:18:43.112808 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2804/5592] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:42 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:18:44.061373 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d651365b-1afd-45c7-a871-b2f73933686b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:44.062347 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d651365b-1afd-45c7-a871-b2f73933686b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:44.075514 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d651365b-1afd-45c7-a871-b2f73933686b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:44.076021 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d651365b-1afd-45c7-a871-b2f73933686b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:44.077232 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d651365b-1afd-45c7-a871-b2f73933686b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:44.078101 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d651365b-1afd-45c7-a871-b2f73933686b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:44.078599 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d651365b-1afd-45c7-a871-b2f73933686b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:44.079410 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d651365b-1afd-45c7-a871-b2f73933686b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:44.140696 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2ff83929-12f8-4086-aa80-685ac7217945 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:44.141332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2ff83929-12f8-4086-aa80-685ac7217945 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:44.160436 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ff83929-12f8-4086-aa80-685ac7217945 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:44.162634 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ff83929-12f8-4086-aa80-685ac7217945 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:44.164032 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ff83929-12f8-4086-aa80-685ac7217945 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:44.166022 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ff83929-12f8-4086-aa80-685ac7217945 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:44.167917 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ff83929-12f8-4086-aa80-685ac7217945 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:44.170003 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ff83929-12f8-4086-aa80-685ac7217945 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:44.179561 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:18:44.308850 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2ff83929-12f8-4086-aa80-685ac7217945 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:44.331485 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2ff83929-12f8-4086-aa80-685ac7217945 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:44.333433 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2ff83929-12f8-4086-aa80-685ac7217945 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:44.334673 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2ff83929-12f8-4086-aa80-685ac7217945 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.199089 Sep 24 21:18:44.335276 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2805/5593] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:44 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:44.479182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d651365b-1afd-45c7-a871-b2f73933686b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:44.489453 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d651365b-1afd-45c7-a871-b2f73933686b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1392 microversion: 2.1 time: 0.432528 Sep 24 21:18:44.503915 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2789/5594] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:18:44 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1392 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:18:44.991107 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-eb436e21-e1ec-4d7c-8134-2eff5836db08 req-4480ceaf-810c-4fcd-ac50-881e5bc1b527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73bcce00-d4a3-47fe-8c0b-7eafc582116b", "tag": "bb0c5eb0-6828-4897-8444-cf9e7648a777"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:18:45.011785 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-eb436e21-e1ec-4d7c-8134-2eff5836db08 req-4480ceaf-810c-4fcd-ac50-881e5bc1b527 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:45.012293 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-eb436e21-e1ec-4d7c-8134-2eff5836db08 req-4480ceaf-810c-4fcd-ac50-881e5bc1b527 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:45.012744 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-eb436e21-e1ec-4d7c-8134-2eff5836db08 req-4480ceaf-810c-4fcd-ac50-881e5bc1b527 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:45.027323 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-eb436e21-e1ec-4d7c-8134-2eff5836db08 req-4480ceaf-810c-4fcd-ac50-881e5bc1b527 service nova] Creating event network-changed:bb0c5eb0-6828-4897-8444-cf9e7648a777 for instance 73bcce00-d4a3-47fe-8c0b-7eafc582116b on nch1-master-1 Sep 24 21:18:45.034430 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-eb436e21-e1ec-4d7c-8134-2eff5836db08 req-4480ceaf-810c-4fcd-ac50-881e5bc1b527 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046614 Sep 24 21:18:45.035435 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2806/5595] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:18:45.365266 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ea7e763f-c9db-4ac3-9097-fcb338eb824c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:45.366757 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ea7e763f-c9db-4ac3-9097-fcb338eb824c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:45.376253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea7e763f-c9db-4ac3-9097-fcb338eb824c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:45.377113 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea7e763f-c9db-4ac3-9097-fcb338eb824c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:45.377797 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea7e763f-c9db-4ac3-9097-fcb338eb824c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:45.378811 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea7e763f-c9db-4ac3-9097-fcb338eb824c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:45.379498 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea7e763f-c9db-4ac3-9097-fcb338eb824c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:45.380158 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea7e763f-c9db-4ac3-9097-fcb338eb824c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:45.505689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ea7e763f-c9db-4ac3-9097-fcb338eb824c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:45.515467 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-878ed975-d585-416c-9182-27e31648c2a9 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:45.516823 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-878ed975-d585-416c-9182-27e31648c2a9 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:45.521881 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ea7e763f-c9db-4ac3-9097-fcb338eb824c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:45.523490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-878ed975-d585-416c-9182-27e31648c2a9 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:45.524245 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-878ed975-d585-416c-9182-27e31648c2a9 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:45.524689 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-878ed975-d585-416c-9182-27e31648c2a9 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:45.524810 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ea7e763f-c9db-4ac3-9097-fcb338eb824c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:45.525462 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-878ed975-d585-416c-9182-27e31648c2a9 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:45.525863 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-878ed975-d585-416c-9182-27e31648c2a9 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:45.526008 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ea7e763f-c9db-4ac3-9097-fcb338eb824c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.165477 Sep 24 21:18:45.526289 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-878ed975-d585-416c-9182-27e31648c2a9 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:45.544067 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2790/5596] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:45 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:45.765938 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-878ed975-d585-416c-9182-27e31648c2a9 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:45.773788 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-878ed975-d585-416c-9182-27e31648c2a9 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1392 microversion: 2.1 time: 0.264234 Sep 24 21:18:45.775114 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2807/5597] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:18:45 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1392 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:18:46.551197 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c97e7099-0b87-4e58-9a76-13d8c452840a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:46.551851 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c97e7099-0b87-4e58-9a76-13d8c452840a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:46.558859 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c97e7099-0b87-4e58-9a76-13d8c452840a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:46.559354 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c97e7099-0b87-4e58-9a76-13d8c452840a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:46.559806 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c97e7099-0b87-4e58-9a76-13d8c452840a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:46.560506 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c97e7099-0b87-4e58-9a76-13d8c452840a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:46.561485 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c97e7099-0b87-4e58-9a76-13d8c452840a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:46.561917 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c97e7099-0b87-4e58-9a76-13d8c452840a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:46.637466 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c97e7099-0b87-4e58-9a76-13d8c452840a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:46.647146 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c97e7099-0b87-4e58-9a76-13d8c452840a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:46.648616 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c97e7099-0b87-4e58-9a76-13d8c452840a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:46.650040 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c97e7099-0b87-4e58-9a76-13d8c452840a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.102834 Sep 24 21:18:46.650630 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2791/5598] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:46 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:18:46.798091 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bb9a255b-23e5-41ca-8558-fa2bad14e603 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:46.798738 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bb9a255b-23e5-41ca-8558-fa2bad14e603 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:46.805537 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb9a255b-23e5-41ca-8558-fa2bad14e603 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:46.806018 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb9a255b-23e5-41ca-8558-fa2bad14e603 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:46.806455 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb9a255b-23e5-41ca-8558-fa2bad14e603 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:46.807181 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb9a255b-23e5-41ca-8558-fa2bad14e603 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:46.807635 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb9a255b-23e5-41ca-8558-fa2bad14e603 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:46.808066 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb9a255b-23e5-41ca-8558-fa2bad14e603 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:47.033503 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bb9a255b-23e5-41ca-8558-fa2bad14e603 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:47.041300 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bb9a255b-23e5-41ca-8558-fa2bad14e603 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1392 microversion: 2.1 time: 0.248009 Sep 24 21:18:47.041881 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2808/5599] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:18:46 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1392 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:18:47.674949 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b6a94a76-0bb4-40db-870f-cbe7743b536f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:47.675712 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b6a94a76-0bb4-40db-870f-cbe7743b536f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:47.683389 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6a94a76-0bb4-40db-870f-cbe7743b536f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:47.683881 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6a94a76-0bb4-40db-870f-cbe7743b536f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:47.684540 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6a94a76-0bb4-40db-870f-cbe7743b536f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:47.685434 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6a94a76-0bb4-40db-870f-cbe7743b536f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:47.685946 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6a94a76-0bb4-40db-870f-cbe7743b536f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:47.686753 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6a94a76-0bb4-40db-870f-cbe7743b536f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:47.777965 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b6a94a76-0bb4-40db-870f-cbe7743b536f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:47.789383 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b6a94a76-0bb4-40db-870f-cbe7743b536f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:47.791182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b6a94a76-0bb4-40db-870f-cbe7743b536f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:47.792907 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b6a94a76-0bb4-40db-870f-cbe7743b536f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.122602 Sep 24 21:18:47.811812 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2792/5600] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:47 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:48.066325 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-40b798cb-6624-4999-9e3b-80085c2a92ae tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:48.066918 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-40b798cb-6624-4999-9e3b-80085c2a92ae tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:48.075236 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-40b798cb-6624-4999-9e3b-80085c2a92ae tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:48.075867 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-40b798cb-6624-4999-9e3b-80085c2a92ae tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:48.077119 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-40b798cb-6624-4999-9e3b-80085c2a92ae tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:48.077856 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-40b798cb-6624-4999-9e3b-80085c2a92ae tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:48.087423 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-40b798cb-6624-4999-9e3b-80085c2a92ae tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:48.089297 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-40b798cb-6624-4999-9e3b-80085c2a92ae tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:48.339245 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-40b798cb-6624-4999-9e3b-80085c2a92ae tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:48.347703 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-40b798cb-6624-4999-9e3b-80085c2a92ae tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1392 microversion: 2.1 time: 0.285679 Sep 24 21:18:48.348300 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2809/5601] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:18:48 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1392 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:18:48.817683 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-aa80f36a-a4c0-49d7-8659-6733e637abe3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:48.818303 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-aa80f36a-a4c0-49d7-8659-6733e637abe3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:48.825207 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa80f36a-a4c0-49d7-8659-6733e637abe3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:48.825705 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa80f36a-a4c0-49d7-8659-6733e637abe3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:48.826152 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa80f36a-a4c0-49d7-8659-6733e637abe3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:48.827080 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa80f36a-a4c0-49d7-8659-6733e637abe3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:48.827692 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa80f36a-a4c0-49d7-8659-6733e637abe3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:48.828152 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa80f36a-a4c0-49d7-8659-6733e637abe3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:48.897408 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-aa80f36a-a4c0-49d7-8659-6733e637abe3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:48.907751 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-aa80f36a-a4c0-49d7-8659-6733e637abe3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:48.909208 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-aa80f36a-a4c0-49d7-8659-6733e637abe3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:48.910355 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-aa80f36a-a4c0-49d7-8659-6733e637abe3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.096675 Sep 24 21:18:48.910948 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2793/5602] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:48 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:49.371363 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-15e6c38b-c06c-4bac-80aa-4adb1a0fddd7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:49.372019 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-15e6c38b-c06c-4bac-80aa-4adb1a0fddd7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:49.379751 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15e6c38b-c06c-4bac-80aa-4adb1a0fddd7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:49.380381 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15e6c38b-c06c-4bac-80aa-4adb1a0fddd7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:49.380835 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15e6c38b-c06c-4bac-80aa-4adb1a0fddd7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:49.381578 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15e6c38b-c06c-4bac-80aa-4adb1a0fddd7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:49.382040 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15e6c38b-c06c-4bac-80aa-4adb1a0fddd7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:49.382473 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15e6c38b-c06c-4bac-80aa-4adb1a0fddd7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:49.516335 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-15e6c38b-c06c-4bac-80aa-4adb1a0fddd7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:49.524889 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-15e6c38b-c06c-4bac-80aa-4adb1a0fddd7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1392 microversion: 2.1 time: 0.157697 Sep 24 21:18:49.525664 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2810/5603] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:18:49 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:18:49.893183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-cc07088b-77d3-463b-9c5f-b0a2de2d24ac req-d8d8a0df-d244-43f8-bdeb-7475a254e9b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73bcce00-d4a3-47fe-8c0b-7eafc582116b", "name": "network-vif-plugged", "status": "completed", "tag": "bb0c5eb0-6828-4897-8444-cf9e7648a777"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:18:49.905825 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-cc07088b-77d3-463b-9c5f-b0a2de2d24ac req-d8d8a0df-d244-43f8-bdeb-7475a254e9b1 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:49.906491 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-cc07088b-77d3-463b-9c5f-b0a2de2d24ac req-d8d8a0df-d244-43f8-bdeb-7475a254e9b1 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:49.907133 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-cc07088b-77d3-463b-9c5f-b0a2de2d24ac req-d8d8a0df-d244-43f8-bdeb-7475a254e9b1 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:49.928566 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-cc07088b-77d3-463b-9c5f-b0a2de2d24ac req-d8d8a0df-d244-43f8-bdeb-7475a254e9b1 service nova] Creating event network-vif-plugged:bb0c5eb0-6828-4897-8444-cf9e7648a777 for instance 73bcce00-d4a3-47fe-8c0b-7eafc582116b on nch1-master-1 Sep 24 21:18:49.934188 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-cc07088b-77d3-463b-9c5f-b0a2de2d24ac req-d8d8a0df-d244-43f8-bdeb-7475a254e9b1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045638 Sep 24 21:18:49.935488 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2794/5604] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:18:49.938117 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-12f6635f-3ce0-4b1c-92ac-1bf2acd90e4a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:49.938934 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-12f6635f-3ce0-4b1c-92ac-1bf2acd90e4a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:49.950668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12f6635f-3ce0-4b1c-92ac-1bf2acd90e4a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:49.953221 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12f6635f-3ce0-4b1c-92ac-1bf2acd90e4a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:49.953937 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12f6635f-3ce0-4b1c-92ac-1bf2acd90e4a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:49.954920 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12f6635f-3ce0-4b1c-92ac-1bf2acd90e4a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:49.955921 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12f6635f-3ce0-4b1c-92ac-1bf2acd90e4a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:49.956608 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-12f6635f-3ce0-4b1c-92ac-1bf2acd90e4a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:50.038983 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-12f6635f-3ce0-4b1c-92ac-1bf2acd90e4a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:50.058863 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-12f6635f-3ce0-4b1c-92ac-1bf2acd90e4a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:50.061232 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-12f6635f-3ce0-4b1c-92ac-1bf2acd90e4a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:50.063844 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-12f6635f-3ce0-4b1c-92ac-1bf2acd90e4a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.130984 Sep 24 21:18:50.073122 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2811/5605] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:49 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:50.549635 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1987bc28-5094-4230-98db-bd50cfc54ae1 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:50.550466 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1987bc28-5094-4230-98db-bd50cfc54ae1 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:50.556954 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1987bc28-5094-4230-98db-bd50cfc54ae1 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:50.557445 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1987bc28-5094-4230-98db-bd50cfc54ae1 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:50.557892 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1987bc28-5094-4230-98db-bd50cfc54ae1 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:50.558619 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1987bc28-5094-4230-98db-bd50cfc54ae1 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:50.559078 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1987bc28-5094-4230-98db-bd50cfc54ae1 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:50.559511 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1987bc28-5094-4230-98db-bd50cfc54ae1 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:50.706877 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1987bc28-5094-4230-98db-bd50cfc54ae1 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:50.709168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:18:50.716309 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1987bc28-5094-4230-98db-bd50cfc54ae1 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1392 microversion: 2.1 time: 0.172178 Sep 24 21:18:50.717830 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2795/5606] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:18:50 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:18:51.104051 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-413f5d51-46f4-4f2d-8a63-02467c28c8ff tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:51.104703 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-413f5d51-46f4-4f2d-8a63-02467c28c8ff tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:51.108466 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:18:51.114163 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-413f5d51-46f4-4f2d-8a63-02467c28c8ff tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:51.114697 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-413f5d51-46f4-4f2d-8a63-02467c28c8ff tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:51.115140 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-413f5d51-46f4-4f2d-8a63-02467c28c8ff tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:51.115889 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-413f5d51-46f4-4f2d-8a63-02467c28c8ff tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:51.116353 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-413f5d51-46f4-4f2d-8a63-02467c28c8ff tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:51.116785 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-413f5d51-46f4-4f2d-8a63-02467c28c8ff tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:51.184017 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-413f5d51-46f4-4f2d-8a63-02467c28c8ff tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:51.193591 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-413f5d51-46f4-4f2d-8a63-02467c28c8ff tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:51.195073 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-413f5d51-46f4-4f2d-8a63-02467c28c8ff tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:51.196331 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-413f5d51-46f4-4f2d-8a63-02467c28c8ff tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.096346 Sep 24 21:18:51.196902 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2812/5607] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:51 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:51.740863 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8d0c2259-9efa-411a-88d3-a3cf6487f37c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:51.741610 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8d0c2259-9efa-411a-88d3-a3cf6487f37c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:51.745556 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:18:51.750604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d0c2259-9efa-411a-88d3-a3cf6487f37c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:51.751182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d0c2259-9efa-411a-88d3-a3cf6487f37c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:51.751631 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d0c2259-9efa-411a-88d3-a3cf6487f37c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:51.752337 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d0c2259-9efa-411a-88d3-a3cf6487f37c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:51.752797 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d0c2259-9efa-411a-88d3-a3cf6487f37c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:51.753228 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d0c2259-9efa-411a-88d3-a3cf6487f37c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:51.786187 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=12 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:18:51.897997 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8d0c2259-9efa-411a-88d3-a3cf6487f37c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:51.907214 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8d0c2259-9efa-411a-88d3-a3cf6487f37c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1565 microversion: 2.1 time: 0.170204 Sep 24 21:18:51.907806 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2796/5608] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:18:51 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:18:51.930114 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-47d7e26b-2281-49a5-b0b5-140a68775e83 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:51.930784 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-47d7e26b-2281-49a5-b0b5-140a68775e83 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:51.936855 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-47d7e26b-2281-49a5-b0b5-140a68775e83 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:51.937355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-47d7e26b-2281-49a5-b0b5-140a68775e83 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:51.937802 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-47d7e26b-2281-49a5-b0b5-140a68775e83 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:51.938523 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-47d7e26b-2281-49a5-b0b5-140a68775e83 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:51.939056 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-47d7e26b-2281-49a5-b0b5-140a68775e83 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:51.939491 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-47d7e26b-2281-49a5-b0b5-140a68775e83 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:52.075536 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-47d7e26b-2281-49a5-b0b5-140a68775e83 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:52.084514 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-47d7e26b-2281-49a5-b0b5-140a68775e83 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1565 microversion: 2.1 time: 0.158326 Sep 24 21:18:52.085102 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2813/5609] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:18:51 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:18:52.222174 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1369300d-3385-4cbd-abfa-38c12d54fd30 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:52.223085 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1369300d-3385-4cbd-abfa-38c12d54fd30 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:52.230270 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1369300d-3385-4cbd-abfa-38c12d54fd30 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:52.231197 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1369300d-3385-4cbd-abfa-38c12d54fd30 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:52.231889 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1369300d-3385-4cbd-abfa-38c12d54fd30 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:52.232930 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1369300d-3385-4cbd-abfa-38c12d54fd30 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:52.233463 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1369300d-3385-4cbd-abfa-38c12d54fd30 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:52.234102 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1369300d-3385-4cbd-abfa-38c12d54fd30 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:52.308132 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1369300d-3385-4cbd-abfa-38c12d54fd30 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:52.319133 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1369300d-3385-4cbd-abfa-38c12d54fd30 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:52.320722 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1369300d-3385-4cbd-abfa-38c12d54fd30 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:52.322248 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1369300d-3385-4cbd-abfa-38c12d54fd30 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.104058 Sep 24 21:18:52.323067 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2797/5610] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:52 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:53.350260 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-aeb5e665-35ce-40ad-b775-bd61e6e695d9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:53.350924 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-aeb5e665-35ce-40ad-b775-bd61e6e695d9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:53.362227 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aeb5e665-35ce-40ad-b775-bd61e6e695d9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:53.363040 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aeb5e665-35ce-40ad-b775-bd61e6e695d9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:53.363492 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aeb5e665-35ce-40ad-b775-bd61e6e695d9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:53.364215 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aeb5e665-35ce-40ad-b775-bd61e6e695d9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:53.364674 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aeb5e665-35ce-40ad-b775-bd61e6e695d9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:53.365106 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aeb5e665-35ce-40ad-b775-bd61e6e695d9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:53.445311 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-aeb5e665-35ce-40ad-b775-bd61e6e695d9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:53.454986 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-aeb5e665-35ce-40ad-b775-bd61e6e695d9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:53.456451 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-aeb5e665-35ce-40ad-b775-bd61e6e695d9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:53.457798 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-aeb5e665-35ce-40ad-b775-bd61e6e695d9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.112218 Sep 24 21:18:53.458383 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2814/5611] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:53 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:54.353029 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4497c526-70e5-453f-9067-6892657aa6ae tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:54.354327 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4497c526-70e5-453f-9067-6892657aa6ae tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:54.360535 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-e08d67f1-91ab-42fa-a88a-a72c6105ab56 req-10cac809-e92e-4324-8e46-bae0921903af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73bcce00-d4a3-47fe-8c0b-7eafc582116b", "tag": "bb0c5eb0-6828-4897-8444-cf9e7648a777"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:18:54.375845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4497c526-70e5-453f-9067-6892657aa6ae tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:54.376355 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4497c526-70e5-453f-9067-6892657aa6ae tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:54.376806 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4497c526-70e5-453f-9067-6892657aa6ae tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:54.379975 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e08d67f1-91ab-42fa-a88a-a72c6105ab56 req-10cac809-e92e-4324-8e46-bae0921903af service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:54.380926 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4497c526-70e5-453f-9067-6892657aa6ae tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:54.381588 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4497c526-70e5-453f-9067-6892657aa6ae tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:54.382219 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4497c526-70e5-453f-9067-6892657aa6ae tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:54.382899 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e08d67f1-91ab-42fa-a88a-a72c6105ab56 req-10cac809-e92e-4324-8e46-bae0921903af service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:54.387875 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e08d67f1-91ab-42fa-a88a-a72c6105ab56 req-10cac809-e92e-4324-8e46-bae0921903af service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:54.413401 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-e08d67f1-91ab-42fa-a88a-a72c6105ab56 req-10cac809-e92e-4324-8e46-bae0921903af service nova] Creating event network-changed:bb0c5eb0-6828-4897-8444-cf9e7648a777 for instance 73bcce00-d4a3-47fe-8c0b-7eafc582116b on nch1-master-1 Sep 24 21:18:54.418793 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-e08d67f1-91ab-42fa-a88a-a72c6105ab56 req-10cac809-e92e-4324-8e46-bae0921903af service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062031 Sep 24 21:18:54.426687 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2815/5612] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:18:54.486432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-65fb71db-b6bb-45cd-8cb7-31bde9ee9daa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:54.488223 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-65fb71db-b6bb-45cd-8cb7-31bde9ee9daa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:54.498242 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65fb71db-b6bb-45cd-8cb7-31bde9ee9daa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:54.499362 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65fb71db-b6bb-45cd-8cb7-31bde9ee9daa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:54.500112 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65fb71db-b6bb-45cd-8cb7-31bde9ee9daa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:54.501455 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65fb71db-b6bb-45cd-8cb7-31bde9ee9daa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:54.502274 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65fb71db-b6bb-45cd-8cb7-31bde9ee9daa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:54.503552 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65fb71db-b6bb-45cd-8cb7-31bde9ee9daa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:54.671535 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-65fb71db-b6bb-45cd-8cb7-31bde9ee9daa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:54.687349 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-65fb71db-b6bb-45cd-8cb7-31bde9ee9daa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:54.689712 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-65fb71db-b6bb-45cd-8cb7-31bde9ee9daa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:54.691826 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-65fb71db-b6bb-45cd-8cb7-31bde9ee9daa tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.212823 Sep 24 21:18:54.702135 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2816/5613] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:54 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:54.715750 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4497c526-70e5-453f-9067-6892657aa6ae tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:54.725747 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4497c526-70e5-453f-9067-6892657aa6ae tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1565 microversion: 2.1 time: 0.376612 Sep 24 21:18:54.739388 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2798/5614] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:18:54 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1565 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:18:55.717867 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9feb2f83-c8e6-447f-b424-bd02c7fdbb25 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:55.718539 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9feb2f83-c8e6-447f-b424-bd02c7fdbb25 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:55.725431 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9feb2f83-c8e6-447f-b424-bd02c7fdbb25 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:55.725923 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9feb2f83-c8e6-447f-b424-bd02c7fdbb25 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:55.726366 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9feb2f83-c8e6-447f-b424-bd02c7fdbb25 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:55.727104 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9feb2f83-c8e6-447f-b424-bd02c7fdbb25 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:55.727567 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9feb2f83-c8e6-447f-b424-bd02c7fdbb25 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:55.727999 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9feb2f83-c8e6-447f-b424-bd02c7fdbb25 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:55.800407 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9feb2f83-c8e6-447f-b424-bd02c7fdbb25 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:55.809771 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9feb2f83-c8e6-447f-b424-bd02c7fdbb25 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:55.812201 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9feb2f83-c8e6-447f-b424-bd02c7fdbb25 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:55.813400 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9feb2f83-c8e6-447f-b424-bd02c7fdbb25 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.099485 Sep 24 21:18:55.826518 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2817/5615] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:55 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:56.839730 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9c90a0e9-d829-4e7d-a8b8-71a8e003cc3c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:56.840496 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9c90a0e9-d829-4e7d-a8b8-71a8e003cc3c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:56.848903 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c90a0e9-d829-4e7d-a8b8-71a8e003cc3c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:56.849398 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c90a0e9-d829-4e7d-a8b8-71a8e003cc3c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:56.849836 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c90a0e9-d829-4e7d-a8b8-71a8e003cc3c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:56.850569 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c90a0e9-d829-4e7d-a8b8-71a8e003cc3c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:56.851025 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c90a0e9-d829-4e7d-a8b8-71a8e003cc3c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:56.851457 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c90a0e9-d829-4e7d-a8b8-71a8e003cc3c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:56.929733 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9c90a0e9-d829-4e7d-a8b8-71a8e003cc3c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:56.939175 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9c90a0e9-d829-4e7d-a8b8-71a8e003cc3c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:56.940640 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9c90a0e9-d829-4e7d-a8b8-71a8e003cc3c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:56.941806 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9c90a0e9-d829-4e7d-a8b8-71a8e003cc3c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.106092 Sep 24 21:18:56.942375 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2799/5616] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:56 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:18:57.969565 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-36bf3237-6f9d-4df1-a5a9-5e297b38b862 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:57.970180 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-36bf3237-6f9d-4df1-a5a9-5e297b38b862 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:57.977090 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-36bf3237-6f9d-4df1-a5a9-5e297b38b862 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:57.977598 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-36bf3237-6f9d-4df1-a5a9-5e297b38b862 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:57.978038 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-36bf3237-6f9d-4df1-a5a9-5e297b38b862 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:57.979050 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-36bf3237-6f9d-4df1-a5a9-5e297b38b862 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:57.979517 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-36bf3237-6f9d-4df1-a5a9-5e297b38b862 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:57.979946 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-36bf3237-6f9d-4df1-a5a9-5e297b38b862 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:58.063556 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-36bf3237-6f9d-4df1-a5a9-5e297b38b862 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:58.073545 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-36bf3237-6f9d-4df1-a5a9-5e297b38b862 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:58.075179 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-36bf3237-6f9d-4df1-a5a9-5e297b38b862 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:58.077276 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-36bf3237-6f9d-4df1-a5a9-5e297b38b862 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.112683 Sep 24 21:18:58.078229 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2818/5617] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:57 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:18:59.103040 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c6f00260-3c91-4962-a105-e54eca8660e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:18:59.103792 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c6f00260-3c91-4962-a105-e54eca8660e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:18:59.111713 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6f00260-3c91-4962-a105-e54eca8660e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:59.112288 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6f00260-3c91-4962-a105-e54eca8660e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:59.112740 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6f00260-3c91-4962-a105-e54eca8660e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:59.113450 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6f00260-3c91-4962-a105-e54eca8660e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:18:59.113915 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6f00260-3c91-4962-a105-e54eca8660e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:18:59.114470 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6f00260-3c91-4962-a105-e54eca8660e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:18:59.191057 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c6f00260-3c91-4962-a105-e54eca8660e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:59.199788 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c6f00260-3c91-4962-a105-e54eca8660e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:59.201221 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c6f00260-3c91-4962-a105-e54eca8660e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:18:59.202387 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c6f00260-3c91-4962-a105-e54eca8660e0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.103295 Sep 24 21:18:59.202990 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2800/5618] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:18:59 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:00.229266 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-51cb2173-0c3a-472c-a276-eae2ffaacb48 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:00.230081 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-51cb2173-0c3a-472c-a276-eae2ffaacb48 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:00.237873 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-51cb2173-0c3a-472c-a276-eae2ffaacb48 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:00.238365 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-51cb2173-0c3a-472c-a276-eae2ffaacb48 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:00.238848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-51cb2173-0c3a-472c-a276-eae2ffaacb48 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:00.239561 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-51cb2173-0c3a-472c-a276-eae2ffaacb48 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:00.240022 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-51cb2173-0c3a-472c-a276-eae2ffaacb48 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:00.240456 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-51cb2173-0c3a-472c-a276-eae2ffaacb48 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:00.346327 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-51cb2173-0c3a-472c-a276-eae2ffaacb48 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:00.355105 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-51cb2173-0c3a-472c-a276-eae2ffaacb48 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:00.356574 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-51cb2173-0c3a-472c-a276-eae2ffaacb48 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:00.358524 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-51cb2173-0c3a-472c-a276-eae2ffaacb48 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.134147 Sep 24 21:19:00.359120 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2819/5619] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:00 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:01.386776 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b15b60eb-485b-4608-b168-bdf3e0e0e005 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:01.387420 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b15b60eb-485b-4608-b168-bdf3e0e0e005 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:01.396701 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b15b60eb-485b-4608-b168-bdf3e0e0e005 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:01.397214 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b15b60eb-485b-4608-b168-bdf3e0e0e005 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:01.397839 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b15b60eb-485b-4608-b168-bdf3e0e0e005 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:01.398601 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b15b60eb-485b-4608-b168-bdf3e0e0e005 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:01.399617 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b15b60eb-485b-4608-b168-bdf3e0e0e005 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:01.400240 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b15b60eb-485b-4608-b168-bdf3e0e0e005 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:01.505761 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b15b60eb-485b-4608-b168-bdf3e0e0e005 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:01.515743 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b15b60eb-485b-4608-b168-bdf3e0e0e005 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:01.517346 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b15b60eb-485b-4608-b168-bdf3e0e0e005 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:01.519026 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b15b60eb-485b-4608-b168-bdf3e0e0e005 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.138806 Sep 24 21:19:01.519480 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2801/5620] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:01 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:02.543948 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-af566a6b-6068-48bd-9452-e2edf63644ed tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:02.544724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-af566a6b-6068-48bd-9452-e2edf63644ed tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:02.552209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af566a6b-6068-48bd-9452-e2edf63644ed tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:02.552708 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af566a6b-6068-48bd-9452-e2edf63644ed tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:02.553156 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af566a6b-6068-48bd-9452-e2edf63644ed tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:02.553877 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af566a6b-6068-48bd-9452-e2edf63644ed tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:02.554428 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af566a6b-6068-48bd-9452-e2edf63644ed tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:02.554799 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-af566a6b-6068-48bd-9452-e2edf63644ed tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:02.749773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-af566a6b-6068-48bd-9452-e2edf63644ed tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:02.759102 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-af566a6b-6068-48bd-9452-e2edf63644ed tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:02.760604 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-af566a6b-6068-48bd-9452-e2edf63644ed tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:02.761800 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-af566a6b-6068-48bd-9452-e2edf63644ed tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.221892 Sep 24 21:19:02.762381 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2820/5621] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:02 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:03.790532 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9780d3d2-2cf2-4435-a825-193e88bda83b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:03.790532 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9780d3d2-2cf2-4435-a825-193e88bda83b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:03.798314 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9780d3d2-2cf2-4435-a825-193e88bda83b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:03.799070 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9780d3d2-2cf2-4435-a825-193e88bda83b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:03.799583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9780d3d2-2cf2-4435-a825-193e88bda83b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:03.800376 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9780d3d2-2cf2-4435-a825-193e88bda83b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:03.800917 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9780d3d2-2cf2-4435-a825-193e88bda83b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:03.801429 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9780d3d2-2cf2-4435-a825-193e88bda83b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:03.866847 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9780d3d2-2cf2-4435-a825-193e88bda83b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:03.876113 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9780d3d2-2cf2-4435-a825-193e88bda83b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:03.877586 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9780d3d2-2cf2-4435-a825-193e88bda83b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:03.878799 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9780d3d2-2cf2-4435-a825-193e88bda83b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.094470 Sep 24 21:19:03.879371 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2802/5622] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:03 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:04.905126 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f73c5955-5691-43c5-b236-3692bf0c6a96 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:04.905748 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f73c5955-5691-43c5-b236-3692bf0c6a96 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:04.912821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f73c5955-5691-43c5-b236-3692bf0c6a96 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:04.913318 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f73c5955-5691-43c5-b236-3692bf0c6a96 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:04.913793 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f73c5955-5691-43c5-b236-3692bf0c6a96 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:04.914537 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f73c5955-5691-43c5-b236-3692bf0c6a96 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:04.914989 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f73c5955-5691-43c5-b236-3692bf0c6a96 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:04.915428 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f73c5955-5691-43c5-b236-3692bf0c6a96 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:05.017032 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f73c5955-5691-43c5-b236-3692bf0c6a96 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:05.025956 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f73c5955-5691-43c5-b236-3692bf0c6a96 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:05.027427 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f73c5955-5691-43c5-b236-3692bf0c6a96 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:05.029079 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f73c5955-5691-43c5-b236-3692bf0c6a96 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.127586 Sep 24 21:19:05.029666 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2821/5623] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:04 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:06.054871 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7a2eb3b8-9cee-4a94-92b4-f8e69bf3b1d9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:06.056345 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7a2eb3b8-9cee-4a94-92b4-f8e69bf3b1d9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:06.060241 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:19:06.066110 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a2eb3b8-9cee-4a94-92b4-f8e69bf3b1d9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:06.066724 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a2eb3b8-9cee-4a94-92b4-f8e69bf3b1d9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:06.067228 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a2eb3b8-9cee-4a94-92b4-f8e69bf3b1d9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:06.067958 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a2eb3b8-9cee-4a94-92b4-f8e69bf3b1d9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:06.068426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a2eb3b8-9cee-4a94-92b4-f8e69bf3b1d9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:06.068867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a2eb3b8-9cee-4a94-92b4-f8e69bf3b1d9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:06.142516 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7a2eb3b8-9cee-4a94-92b4-f8e69bf3b1d9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:06.151471 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7a2eb3b8-9cee-4a94-92b4-f8e69bf3b1d9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:06.152926 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7a2eb3b8-9cee-4a94-92b4-f8e69bf3b1d9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:06.154264 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7a2eb3b8-9cee-4a94-92b4-f8e69bf3b1d9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.103418 Sep 24 21:19:06.154970 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2803/5624] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:06 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:07.180880 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ed426525-7626-4317-8c63-4cace9ba0273 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:07.181496 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ed426525-7626-4317-8c63-4cace9ba0273 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:07.189398 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed426525-7626-4317-8c63-4cace9ba0273 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:07.190092 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed426525-7626-4317-8c63-4cace9ba0273 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:07.190716 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed426525-7626-4317-8c63-4cace9ba0273 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:07.191525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed426525-7626-4317-8c63-4cace9ba0273 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:07.192134 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed426525-7626-4317-8c63-4cace9ba0273 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:07.192731 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ed426525-7626-4317-8c63-4cace9ba0273 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:07.292752 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ed426525-7626-4317-8c63-4cace9ba0273 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:07.302176 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ed426525-7626-4317-8c63-4cace9ba0273 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:07.303666 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ed426525-7626-4317-8c63-4cace9ba0273 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:07.304826 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ed426525-7626-4317-8c63-4cace9ba0273 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.128081 Sep 24 21:19:07.305391 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2822/5625] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:07 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:19:08.332335 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-871f2b5d-4186-4fa8-877c-37f5a591730a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:08.332961 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-871f2b5d-4186-4fa8-877c-37f5a591730a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:08.339977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-871f2b5d-4186-4fa8-877c-37f5a591730a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:08.340463 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-871f2b5d-4186-4fa8-877c-37f5a591730a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:08.341171 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-871f2b5d-4186-4fa8-877c-37f5a591730a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:08.341978 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-871f2b5d-4186-4fa8-877c-37f5a591730a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:08.342633 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-871f2b5d-4186-4fa8-877c-37f5a591730a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:08.343070 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-871f2b5d-4186-4fa8-877c-37f5a591730a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:08.408536 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-871f2b5d-4186-4fa8-877c-37f5a591730a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:08.417452 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-871f2b5d-4186-4fa8-877c-37f5a591730a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:08.419608 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-871f2b5d-4186-4fa8-877c-37f5a591730a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:08.420975 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-871f2b5d-4186-4fa8-877c-37f5a591730a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.093197 Sep 24 21:19:08.421565 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2804/5626] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:08 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:09.446468 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4787a071-1a0f-41a6-b0ee-2fc7fc4e84c8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:09.447264 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4787a071-1a0f-41a6-b0ee-2fc7fc4e84c8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:09.454299 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4787a071-1a0f-41a6-b0ee-2fc7fc4e84c8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:09.454840 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4787a071-1a0f-41a6-b0ee-2fc7fc4e84c8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:09.455294 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4787a071-1a0f-41a6-b0ee-2fc7fc4e84c8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:09.456078 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4787a071-1a0f-41a6-b0ee-2fc7fc4e84c8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:09.456544 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4787a071-1a0f-41a6-b0ee-2fc7fc4e84c8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:09.456976 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4787a071-1a0f-41a6-b0ee-2fc7fc4e84c8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:09.461342 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:19:09.519924 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4787a071-1a0f-41a6-b0ee-2fc7fc4e84c8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:09.530096 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4787a071-1a0f-41a6-b0ee-2fc7fc4e84c8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:09.531604 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4787a071-1a0f-41a6-b0ee-2fc7fc4e84c8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:09.532773 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4787a071-1a0f-41a6-b0ee-2fc7fc4e84c8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.090390 Sep 24 21:19:09.533385 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2823/5627] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:09 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:10.560785 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c5b259db-b0b6-4c54-9094-6426dde1cd72 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:10.562126 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c5b259db-b0b6-4c54-9094-6426dde1cd72 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:10.569553 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5b259db-b0b6-4c54-9094-6426dde1cd72 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:10.570278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5b259db-b0b6-4c54-9094-6426dde1cd72 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:10.570989 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5b259db-b0b6-4c54-9094-6426dde1cd72 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:10.572018 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5b259db-b0b6-4c54-9094-6426dde1cd72 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:10.572666 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5b259db-b0b6-4c54-9094-6426dde1cd72 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:10.573146 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5b259db-b0b6-4c54-9094-6426dde1cd72 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:10.655757 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c5b259db-b0b6-4c54-9094-6426dde1cd72 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:10.666067 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c5b259db-b0b6-4c54-9094-6426dde1cd72 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:10.667886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c5b259db-b0b6-4c54-9094-6426dde1cd72 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:10.669913 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c5b259db-b0b6-4c54-9094-6426dde1cd72 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.114848 Sep 24 21:19:10.670921 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2805/5628] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:10 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:11.695450 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d80b6532-fae4-48ae-9b04-7e8cfd9a05c2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:11.695988 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d80b6532-fae4-48ae-9b04-7e8cfd9a05c2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:11.703663 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d80b6532-fae4-48ae-9b04-7e8cfd9a05c2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:11.704158 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d80b6532-fae4-48ae-9b04-7e8cfd9a05c2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:11.704608 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d80b6532-fae4-48ae-9b04-7e8cfd9a05c2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:11.705317 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d80b6532-fae4-48ae-9b04-7e8cfd9a05c2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:11.705777 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d80b6532-fae4-48ae-9b04-7e8cfd9a05c2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:11.706213 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d80b6532-fae4-48ae-9b04-7e8cfd9a05c2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:11.771067 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d80b6532-fae4-48ae-9b04-7e8cfd9a05c2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:11.780609 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d80b6532-fae4-48ae-9b04-7e8cfd9a05c2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:11.782085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d80b6532-fae4-48ae-9b04-7e8cfd9a05c2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:11.783294 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d80b6532-fae4-48ae-9b04-7e8cfd9a05c2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.091941 Sep 24 21:19:11.783862 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2824/5629] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:11 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:12.808841 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dedaff01-a20c-4def-a879-2d20996e1413 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:12.810078 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-dedaff01-a20c-4def-a879-2d20996e1413 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:12.816689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dedaff01-a20c-4def-a879-2d20996e1413 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:12.817184 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dedaff01-a20c-4def-a879-2d20996e1413 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:12.817629 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dedaff01-a20c-4def-a879-2d20996e1413 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:12.818336 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dedaff01-a20c-4def-a879-2d20996e1413 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:12.818822 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dedaff01-a20c-4def-a879-2d20996e1413 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:12.819259 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dedaff01-a20c-4def-a879-2d20996e1413 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:12.883205 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-dedaff01-a20c-4def-a879-2d20996e1413 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:12.892212 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-dedaff01-a20c-4def-a879-2d20996e1413 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:12.893679 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-dedaff01-a20c-4def-a879-2d20996e1413 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:12.894871 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-dedaff01-a20c-4def-a879-2d20996e1413 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.090238 Sep 24 21:19:12.895464 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2806/5630] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:12 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:13.921031 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-43061b52-ec16-4ffe-aa4e-7834b5f30995 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:13.921743 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-43061b52-ec16-4ffe-aa4e-7834b5f30995 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:13.929216 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-43061b52-ec16-4ffe-aa4e-7834b5f30995 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:13.929813 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-43061b52-ec16-4ffe-aa4e-7834b5f30995 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:13.930462 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-43061b52-ec16-4ffe-aa4e-7834b5f30995 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:13.931322 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-43061b52-ec16-4ffe-aa4e-7834b5f30995 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:13.932046 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-43061b52-ec16-4ffe-aa4e-7834b5f30995 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:13.932545 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-43061b52-ec16-4ffe-aa4e-7834b5f30995 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:14.001831 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-43061b52-ec16-4ffe-aa4e-7834b5f30995 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:14.011319 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-43061b52-ec16-4ffe-aa4e-7834b5f30995 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:14.013468 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-43061b52-ec16-4ffe-aa4e-7834b5f30995 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:14.014699 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-43061b52-ec16-4ffe-aa4e-7834b5f30995 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.098289 Sep 24 21:19:14.015285 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2825/5631] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:13 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:15.042081 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c2fb3fc4-091f-4a6f-84e2-b155f05700c8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:15.042660 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c2fb3fc4-091f-4a6f-84e2-b155f05700c8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:15.050287 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2fb3fc4-091f-4a6f-84e2-b155f05700c8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:15.050891 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2fb3fc4-091f-4a6f-84e2-b155f05700c8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:15.051338 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2fb3fc4-091f-4a6f-84e2-b155f05700c8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:15.052051 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2fb3fc4-091f-4a6f-84e2-b155f05700c8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:15.052515 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2fb3fc4-091f-4a6f-84e2-b155f05700c8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:15.052949 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c2fb3fc4-091f-4a6f-84e2-b155f05700c8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:15.127325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c2fb3fc4-091f-4a6f-84e2-b155f05700c8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:15.136345 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c2fb3fc4-091f-4a6f-84e2-b155f05700c8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:15.137859 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c2fb3fc4-091f-4a6f-84e2-b155f05700c8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:15.139070 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c2fb3fc4-091f-4a6f-84e2-b155f05700c8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.101627 Sep 24 21:19:15.139648 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2807/5632] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:15 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:16.164236 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-38167ce9-14e9-4f02-9a7d-0a6788c55327 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:16.164956 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-38167ce9-14e9-4f02-9a7d-0a6788c55327 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:16.172771 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38167ce9-14e9-4f02-9a7d-0a6788c55327 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:16.173346 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38167ce9-14e9-4f02-9a7d-0a6788c55327 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:16.173791 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38167ce9-14e9-4f02-9a7d-0a6788c55327 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:16.174643 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38167ce9-14e9-4f02-9a7d-0a6788c55327 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:16.175006 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38167ce9-14e9-4f02-9a7d-0a6788c55327 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:16.175434 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-38167ce9-14e9-4f02-9a7d-0a6788c55327 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:16.242765 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-38167ce9-14e9-4f02-9a7d-0a6788c55327 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:16.252547 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-38167ce9-14e9-4f02-9a7d-0a6788c55327 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:16.254213 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-38167ce9-14e9-4f02-9a7d-0a6788c55327 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:16.255423 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-38167ce9-14e9-4f02-9a7d-0a6788c55327 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.095301 Sep 24 21:19:16.256010 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2826/5633] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:16 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:17.281030 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e35e6ab8-6751-4bc4-b234-3713e4e88d02 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:17.281662 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e35e6ab8-6751-4bc4-b234-3713e4e88d02 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:17.289229 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e35e6ab8-6751-4bc4-b234-3713e4e88d02 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:17.289737 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e35e6ab8-6751-4bc4-b234-3713e4e88d02 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:17.290184 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e35e6ab8-6751-4bc4-b234-3713e4e88d02 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:17.290998 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e35e6ab8-6751-4bc4-b234-3713e4e88d02 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:17.291466 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e35e6ab8-6751-4bc4-b234-3713e4e88d02 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:17.291903 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e35e6ab8-6751-4bc4-b234-3713e4e88d02 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:17.357507 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e35e6ab8-6751-4bc4-b234-3713e4e88d02 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:17.366411 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e35e6ab8-6751-4bc4-b234-3713e4e88d02 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:17.367922 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e35e6ab8-6751-4bc4-b234-3713e4e88d02 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:17.369087 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e35e6ab8-6751-4bc4-b234-3713e4e88d02 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.092698 Sep 24 21:19:17.369661 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2808/5634] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:17 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:18.395010 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dc0906cc-eb92-47af-bc25-46d751f89580 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:18.395691 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dc0906cc-eb92-47af-bc25-46d751f89580 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:18.403593 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc0906cc-eb92-47af-bc25-46d751f89580 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:18.404185 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc0906cc-eb92-47af-bc25-46d751f89580 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:18.404708 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc0906cc-eb92-47af-bc25-46d751f89580 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:18.405503 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc0906cc-eb92-47af-bc25-46d751f89580 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:18.405968 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc0906cc-eb92-47af-bc25-46d751f89580 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:18.406405 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc0906cc-eb92-47af-bc25-46d751f89580 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:18.469789 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dc0906cc-eb92-47af-bc25-46d751f89580 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:18.478810 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dc0906cc-eb92-47af-bc25-46d751f89580 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:18.480284 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dc0906cc-eb92-47af-bc25-46d751f89580 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:18.482059 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dc0906cc-eb92-47af-bc25-46d751f89580 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.091182 Sep 24 21:19:18.482661 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2827/5635] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:18 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:19.507640 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-969c3aae-d76d-4622-9c6d-a785ee759dde tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:19.508379 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-969c3aae-d76d-4622-9c6d-a785ee759dde tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:19.516438 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-969c3aae-d76d-4622-9c6d-a785ee759dde tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:19.516924 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-969c3aae-d76d-4622-9c6d-a785ee759dde tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:19.517472 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-969c3aae-d76d-4622-9c6d-a785ee759dde tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:19.518145 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-969c3aae-d76d-4622-9c6d-a785ee759dde tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:19.518741 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-969c3aae-d76d-4622-9c6d-a785ee759dde tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:19.519325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-969c3aae-d76d-4622-9c6d-a785ee759dde tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:19.586573 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-969c3aae-d76d-4622-9c6d-a785ee759dde tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:19.596430 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-969c3aae-d76d-4622-9c6d-a785ee759dde tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:19.597879 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-969c3aae-d76d-4622-9c6d-a785ee759dde tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:19.599094 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-969c3aae-d76d-4622-9c6d-a785ee759dde tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.095534 Sep 24 21:19:19.600009 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2809/5636] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:19 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:20.628372 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4ab1f5b6-74ba-465f-9b63-354933fed96f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:20.629531 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4ab1f5b6-74ba-465f-9b63-354933fed96f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:20.636613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ab1f5b6-74ba-465f-9b63-354933fed96f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:20.637123 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ab1f5b6-74ba-465f-9b63-354933fed96f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:20.637573 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ab1f5b6-74ba-465f-9b63-354933fed96f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:20.638293 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ab1f5b6-74ba-465f-9b63-354933fed96f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:20.638985 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ab1f5b6-74ba-465f-9b63-354933fed96f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:20.639225 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ab1f5b6-74ba-465f-9b63-354933fed96f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:20.711058 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4ab1f5b6-74ba-465f-9b63-354933fed96f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:20.720599 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4ab1f5b6-74ba-465f-9b63-354933fed96f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:20.722077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4ab1f5b6-74ba-465f-9b63-354933fed96f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:20.723283 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4ab1f5b6-74ba-465f-9b63-354933fed96f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.098989 Sep 24 21:19:20.724110 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2828/5637] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:20 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:21.749332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8a088874-9304-4c66-9695-ca5608b385d0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:21.749955 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8a088874-9304-4c66-9695-ca5608b385d0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:21.756889 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8a088874-9304-4c66-9695-ca5608b385d0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:21.757382 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8a088874-9304-4c66-9695-ca5608b385d0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:21.757827 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8a088874-9304-4c66-9695-ca5608b385d0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:21.758567 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8a088874-9304-4c66-9695-ca5608b385d0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:21.759034 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8a088874-9304-4c66-9695-ca5608b385d0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:21.759473 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8a088874-9304-4c66-9695-ca5608b385d0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:21.765166 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=86 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:19:21.829714 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8a088874-9304-4c66-9695-ca5608b385d0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:21.840763 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8a088874-9304-4c66-9695-ca5608b385d0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:21.842282 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8a088874-9304-4c66-9695-ca5608b385d0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:21.843778 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8a088874-9304-4c66-9695-ca5608b385d0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.098966 Sep 24 21:19:21.844359 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2810/5638] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:21 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:22.869832 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6603c4a1-af9d-4bab-a3e7-e9abed8337e4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:22.872299 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6603c4a1-af9d-4bab-a3e7-e9abed8337e4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:22.875170 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=34 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:19:22.881429 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6603c4a1-af9d-4bab-a3e7-e9abed8337e4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:22.881946 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6603c4a1-af9d-4bab-a3e7-e9abed8337e4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:22.882431 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6603c4a1-af9d-4bab-a3e7-e9abed8337e4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:22.883322 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6603c4a1-af9d-4bab-a3e7-e9abed8337e4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:22.883869 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6603c4a1-af9d-4bab-a3e7-e9abed8337e4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:22.885362 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6603c4a1-af9d-4bab-a3e7-e9abed8337e4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:22.958234 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6603c4a1-af9d-4bab-a3e7-e9abed8337e4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:22.968941 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6603c4a1-af9d-4bab-a3e7-e9abed8337e4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:22.970415 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6603c4a1-af9d-4bab-a3e7-e9abed8337e4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:22.971617 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6603c4a1-af9d-4bab-a3e7-e9abed8337e4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.106897 Sep 24 21:19:22.972194 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2829/5639] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:22 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:23.997754 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-302ceef7-1be0-4c7f-ba4d-51299f7931c6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:23.998517 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-302ceef7-1be0-4c7f-ba4d-51299f7931c6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:24.005583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-302ceef7-1be0-4c7f-ba4d-51299f7931c6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:24.006070 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-302ceef7-1be0-4c7f-ba4d-51299f7931c6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:24.006524 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-302ceef7-1be0-4c7f-ba4d-51299f7931c6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:24.007245 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-302ceef7-1be0-4c7f-ba4d-51299f7931c6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:24.007702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-302ceef7-1be0-4c7f-ba4d-51299f7931c6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:24.008133 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-302ceef7-1be0-4c7f-ba4d-51299f7931c6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:24.099424 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-302ceef7-1be0-4c7f-ba4d-51299f7931c6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:24.109161 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-302ceef7-1be0-4c7f-ba4d-51299f7931c6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:24.110670 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-302ceef7-1be0-4c7f-ba4d-51299f7931c6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:24.111862 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-302ceef7-1be0-4c7f-ba4d-51299f7931c6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.118987 Sep 24 21:19:24.112411 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2811/5640] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:23 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:25.137696 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0ff0267a-75be-4b7d-a739-1ac6dc8353a6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:25.138280 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0ff0267a-75be-4b7d-a739-1ac6dc8353a6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:25.145612 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0ff0267a-75be-4b7d-a739-1ac6dc8353a6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:25.146134 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0ff0267a-75be-4b7d-a739-1ac6dc8353a6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:25.146694 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0ff0267a-75be-4b7d-a739-1ac6dc8353a6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:25.147455 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0ff0267a-75be-4b7d-a739-1ac6dc8353a6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:25.147969 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0ff0267a-75be-4b7d-a739-1ac6dc8353a6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:25.148674 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0ff0267a-75be-4b7d-a739-1ac6dc8353a6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:25.222339 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0ff0267a-75be-4b7d-a739-1ac6dc8353a6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:25.231939 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0ff0267a-75be-4b7d-a739-1ac6dc8353a6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:25.233622 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0ff0267a-75be-4b7d-a739-1ac6dc8353a6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:25.235343 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0ff0267a-75be-4b7d-a739-1ac6dc8353a6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.101713 Sep 24 21:19:25.235955 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2830/5641] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:25 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:26.153738 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-92915103-26c8-43f1-8dbe-77cef6fb09a6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:19:26.156035 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-92915103-26c8-43f1-8dbe-77cef6fb09a6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:26.163258 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-92915103-26c8-43f1-8dbe-77cef6fb09a6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:26.163754 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-92915103-26c8-43f1-8dbe-77cef6fb09a6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:26.164203 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-92915103-26c8-43f1-8dbe-77cef6fb09a6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:26.164923 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-92915103-26c8-43f1-8dbe-77cef6fb09a6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:26.165389 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-92915103-26c8-43f1-8dbe-77cef6fb09a6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:26.165822 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-92915103-26c8-43f1-8dbe-77cef6fb09a6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:26.220095 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-92915103-26c8-43f1-8dbe-77cef6fb09a6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "POST /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b/action" status: 200 len: 24572 microversion: 2.1 time: 0.070579 Sep 24 21:19:26.220644 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2812/5642] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:19:26 2022] POST /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b/action => generated 24572 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:19:26.260716 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1bf0476c-2f00-4708-bd7b-9d96d2398211 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:26.261701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1bf0476c-2f00-4708-bd7b-9d96d2398211 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:26.268813 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1bf0476c-2f00-4708-bd7b-9d96d2398211 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:26.269307 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1bf0476c-2f00-4708-bd7b-9d96d2398211 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:26.269933 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1bf0476c-2f00-4708-bd7b-9d96d2398211 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:26.270705 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1bf0476c-2f00-4708-bd7b-9d96d2398211 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:26.271203 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1bf0476c-2f00-4708-bd7b-9d96d2398211 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:26.271640 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1bf0476c-2f00-4708-bd7b-9d96d2398211 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:26.337326 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1bf0476c-2f00-4708-bd7b-9d96d2398211 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:26.347228 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1bf0476c-2f00-4708-bd7b-9d96d2398211 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:26.348698 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1bf0476c-2f00-4708-bd7b-9d96d2398211 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:26.349865 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1bf0476c-2f00-4708-bd7b-9d96d2398211 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.093282 Sep 24 21:19:26.350441 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2831/5643] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:26 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:27.378592 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8486863e-ea3c-40ea-8184-bedb6c2a602b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:27.379298 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8486863e-ea3c-40ea-8184-bedb6c2a602b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:27.387678 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8486863e-ea3c-40ea-8184-bedb6c2a602b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:27.388084 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8486863e-ea3c-40ea-8184-bedb6c2a602b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:27.388525 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8486863e-ea3c-40ea-8184-bedb6c2a602b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:27.389226 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8486863e-ea3c-40ea-8184-bedb6c2a602b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:27.389684 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8486863e-ea3c-40ea-8184-bedb6c2a602b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:27.390116 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8486863e-ea3c-40ea-8184-bedb6c2a602b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:27.457631 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8486863e-ea3c-40ea-8184-bedb6c2a602b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:27.468060 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8486863e-ea3c-40ea-8184-bedb6c2a602b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:27.469518 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8486863e-ea3c-40ea-8184-bedb6c2a602b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:27.470738 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8486863e-ea3c-40ea-8184-bedb6c2a602b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.096614 Sep 24 21:19:27.471312 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2813/5644] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:27 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:28.495617 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-65db1522-bc90-4931-8fdd-b82f3021074d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:28.496724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-65db1522-bc90-4931-8fdd-b82f3021074d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:28.503639 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65db1522-bc90-4931-8fdd-b82f3021074d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:28.504130 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65db1522-bc90-4931-8fdd-b82f3021074d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:28.504572 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65db1522-bc90-4931-8fdd-b82f3021074d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:28.505280 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65db1522-bc90-4931-8fdd-b82f3021074d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:28.505738 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65db1522-bc90-4931-8fdd-b82f3021074d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:28.506173 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65db1522-bc90-4931-8fdd-b82f3021074d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:28.571665 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-65db1522-bc90-4931-8fdd-b82f3021074d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:28.581501 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-65db1522-bc90-4931-8fdd-b82f3021074d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:28.582974 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-65db1522-bc90-4931-8fdd-b82f3021074d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:28.584119 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-65db1522-bc90-4931-8fdd-b82f3021074d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.092629 Sep 24 21:19:28.584702 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2832/5645] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:28 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:29.610538 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3314a243-e8b6-4c57-89c1-bbe022c9037e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:29.611201 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3314a243-e8b6-4c57-89c1-bbe022c9037e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:29.618040 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3314a243-e8b6-4c57-89c1-bbe022c9037e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:29.618546 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3314a243-e8b6-4c57-89c1-bbe022c9037e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:29.618993 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3314a243-e8b6-4c57-89c1-bbe022c9037e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:29.619807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3314a243-e8b6-4c57-89c1-bbe022c9037e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:29.620303 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3314a243-e8b6-4c57-89c1-bbe022c9037e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:29.620760 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3314a243-e8b6-4c57-89c1-bbe022c9037e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:29.686786 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3314a243-e8b6-4c57-89c1-bbe022c9037e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:29.695590 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3314a243-e8b6-4c57-89c1-bbe022c9037e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:29.697042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3314a243-e8b6-4c57-89c1-bbe022c9037e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:29.698532 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3314a243-e8b6-4c57-89c1-bbe022c9037e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.093026 Sep 24 21:19:29.708026 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2814/5646] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:29 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:30.724743 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d9f61c82-867b-4d6a-a62f-ebedd02c126d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:30.725602 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d9f61c82-867b-4d6a-a62f-ebedd02c126d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:30.733702 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d9f61c82-867b-4d6a-a62f-ebedd02c126d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:30.734275 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d9f61c82-867b-4d6a-a62f-ebedd02c126d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:30.734993 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d9f61c82-867b-4d6a-a62f-ebedd02c126d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:30.735931 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d9f61c82-867b-4d6a-a62f-ebedd02c126d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:30.736349 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d9f61c82-867b-4d6a-a62f-ebedd02c126d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:30.736961 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d9f61c82-867b-4d6a-a62f-ebedd02c126d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:30.822641 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d9f61c82-867b-4d6a-a62f-ebedd02c126d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:30.834175 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d9f61c82-867b-4d6a-a62f-ebedd02c126d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:30.836088 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d9f61c82-867b-4d6a-a62f-ebedd02c126d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:30.838289 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d9f61c82-867b-4d6a-a62f-ebedd02c126d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.116971 Sep 24 21:19:30.851732 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2833/5647] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:30 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:31.865754 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-32805f05-5b9e-47b5-95fc-e7d39aebc4e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:31.866532 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-32805f05-5b9e-47b5-95fc-e7d39aebc4e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:31.874893 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-32805f05-5b9e-47b5-95fc-e7d39aebc4e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:31.875554 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-32805f05-5b9e-47b5-95fc-e7d39aebc4e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:31.876104 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-32805f05-5b9e-47b5-95fc-e7d39aebc4e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:31.876935 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-32805f05-5b9e-47b5-95fc-e7d39aebc4e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:31.877648 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-32805f05-5b9e-47b5-95fc-e7d39aebc4e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:31.878313 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-32805f05-5b9e-47b5-95fc-e7d39aebc4e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:31.980008 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-32805f05-5b9e-47b5-95fc-e7d39aebc4e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:31.991644 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-32805f05-5b9e-47b5-95fc-e7d39aebc4e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:31.996319 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-32805f05-5b9e-47b5-95fc-e7d39aebc4e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:32.000795 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-32805f05-5b9e-47b5-95fc-e7d39aebc4e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.138301 Sep 24 21:19:32.003755 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2815/5648] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:31 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:33.031419 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fb310fd5-d0cd-4cda-b2d0-2a24598bdeea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:33.032210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fb310fd5-d0cd-4cda-b2d0-2a24598bdeea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:33.040471 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb310fd5-d0cd-4cda-b2d0-2a24598bdeea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:33.041380 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb310fd5-d0cd-4cda-b2d0-2a24598bdeea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:33.042148 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb310fd5-d0cd-4cda-b2d0-2a24598bdeea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:33.043771 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb310fd5-d0cd-4cda-b2d0-2a24598bdeea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:33.044509 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb310fd5-d0cd-4cda-b2d0-2a24598bdeea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:33.045017 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb310fd5-d0cd-4cda-b2d0-2a24598bdeea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:33.125718 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fb310fd5-d0cd-4cda-b2d0-2a24598bdeea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:33.158256 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fb310fd5-d0cd-4cda-b2d0-2a24598bdeea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:33.160283 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fb310fd5-d0cd-4cda-b2d0-2a24598bdeea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:33.161793 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fb310fd5-d0cd-4cda-b2d0-2a24598bdeea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.136237 Sep 24 21:19:33.163062 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2834/5649] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:33 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:19:34.188065 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dd67f1ec-c834-4612-af14-8bff2874c480 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:34.188860 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-dd67f1ec-c834-4612-af14-8bff2874c480 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:34.196131 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd67f1ec-c834-4612-af14-8bff2874c480 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:34.196705 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd67f1ec-c834-4612-af14-8bff2874c480 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:34.197092 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd67f1ec-c834-4612-af14-8bff2874c480 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:34.197814 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd67f1ec-c834-4612-af14-8bff2874c480 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:34.198276 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd67f1ec-c834-4612-af14-8bff2874c480 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:34.203223 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd67f1ec-c834-4612-af14-8bff2874c480 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:34.323690 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-dd67f1ec-c834-4612-af14-8bff2874c480 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:34.334727 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-dd67f1ec-c834-4612-af14-8bff2874c480 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:34.341294 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-dd67f1ec-c834-4612-af14-8bff2874c480 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:34.342586 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-dd67f1ec-c834-4612-af14-8bff2874c480 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.159216 Sep 24 21:19:34.344938 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2816/5650] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:34 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:35.369185 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-66507dcf-722e-4155-a35c-8651d60b7739 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:35.371420 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-66507dcf-722e-4155-a35c-8651d60b7739 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:35.379380 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66507dcf-722e-4155-a35c-8651d60b7739 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:35.379913 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66507dcf-722e-4155-a35c-8651d60b7739 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:35.380364 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66507dcf-722e-4155-a35c-8651d60b7739 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:35.381130 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66507dcf-722e-4155-a35c-8651d60b7739 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:35.382099 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66507dcf-722e-4155-a35c-8651d60b7739 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:35.382597 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66507dcf-722e-4155-a35c-8651d60b7739 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:35.487149 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-66507dcf-722e-4155-a35c-8651d60b7739 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:35.501412 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-66507dcf-722e-4155-a35c-8651d60b7739 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:35.503302 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-66507dcf-722e-4155-a35c-8651d60b7739 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:35.504695 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-66507dcf-722e-4155-a35c-8651d60b7739 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.139472 Sep 24 21:19:35.519473 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2835/5651] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:35 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:36.533852 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a44221f6-f5bb-4f44-a0c4-4786178fc739 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:36.534461 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a44221f6-f5bb-4f44-a0c4-4786178fc739 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:36.538709 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=28 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:19:36.543634 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a44221f6-f5bb-4f44-a0c4-4786178fc739 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:36.544129 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a44221f6-f5bb-4f44-a0c4-4786178fc739 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:36.544579 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a44221f6-f5bb-4f44-a0c4-4786178fc739 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:36.545299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a44221f6-f5bb-4f44-a0c4-4786178fc739 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:36.545772 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a44221f6-f5bb-4f44-a0c4-4786178fc739 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:36.546204 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a44221f6-f5bb-4f44-a0c4-4786178fc739 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:36.615428 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a44221f6-f5bb-4f44-a0c4-4786178fc739 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:36.626554 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a44221f6-f5bb-4f44-a0c4-4786178fc739 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:36.628426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a44221f6-f5bb-4f44-a0c4-4786178fc739 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:36.629839 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a44221f6-f5bb-4f44-a0c4-4786178fc739 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.100526 Sep 24 21:19:36.630763 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2817/5652] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:36 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:37.658912 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-396803eb-0e34-4b42-80e9-47fe38e38373 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:37.659721 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-396803eb-0e34-4b42-80e9-47fe38e38373 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:37.669056 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-396803eb-0e34-4b42-80e9-47fe38e38373 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:37.669753 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-396803eb-0e34-4b42-80e9-47fe38e38373 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:37.670148 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-396803eb-0e34-4b42-80e9-47fe38e38373 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:37.670884 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-396803eb-0e34-4b42-80e9-47fe38e38373 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:37.671350 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-396803eb-0e34-4b42-80e9-47fe38e38373 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:37.671781 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-396803eb-0e34-4b42-80e9-47fe38e38373 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:37.734489 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-396803eb-0e34-4b42-80e9-47fe38e38373 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:37.743383 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-396803eb-0e34-4b42-80e9-47fe38e38373 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:37.744949 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-396803eb-0e34-4b42-80e9-47fe38e38373 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:37.746946 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-396803eb-0e34-4b42-80e9-47fe38e38373 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.092076 Sep 24 21:19:37.747606 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2836/5653] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:37 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:38.772575 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a4bd0fef-e7c6-4914-98f8-d2fe203092f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:38.773414 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a4bd0fef-e7c6-4914-98f8-d2fe203092f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:38.781109 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a4bd0fef-e7c6-4914-98f8-d2fe203092f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:38.781600 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a4bd0fef-e7c6-4914-98f8-d2fe203092f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:38.782042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a4bd0fef-e7c6-4914-98f8-d2fe203092f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:38.782783 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a4bd0fef-e7c6-4914-98f8-d2fe203092f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:38.783253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a4bd0fef-e7c6-4914-98f8-d2fe203092f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:38.783687 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a4bd0fef-e7c6-4914-98f8-d2fe203092f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:38.865162 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a4bd0fef-e7c6-4914-98f8-d2fe203092f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:38.874283 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a4bd0fef-e7c6-4914-98f8-d2fe203092f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:38.875805 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a4bd0fef-e7c6-4914-98f8-d2fe203092f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:38.876967 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a4bd0fef-e7c6-4914-98f8-d2fe203092f0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.108726 Sep 24 21:19:38.877566 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2818/5654] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:38 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:39.903494 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-311cbe9a-cbcf-404e-ab0e-8a8ebbad4fc7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:39.904144 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-311cbe9a-cbcf-404e-ab0e-8a8ebbad4fc7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:39.911033 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-311cbe9a-cbcf-404e-ab0e-8a8ebbad4fc7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:39.911518 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-311cbe9a-cbcf-404e-ab0e-8a8ebbad4fc7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:39.911959 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-311cbe9a-cbcf-404e-ab0e-8a8ebbad4fc7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:39.912660 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-311cbe9a-cbcf-404e-ab0e-8a8ebbad4fc7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:39.913124 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-311cbe9a-cbcf-404e-ab0e-8a8ebbad4fc7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:39.913551 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-311cbe9a-cbcf-404e-ab0e-8a8ebbad4fc7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:39.917676 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=84 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:19:39.981394 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-311cbe9a-cbcf-404e-ab0e-8a8ebbad4fc7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:39.990184 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-311cbe9a-cbcf-404e-ab0e-8a8ebbad4fc7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:39.991678 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-311cbe9a-cbcf-404e-ab0e-8a8ebbad4fc7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:39.992834 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-311cbe9a-cbcf-404e-ab0e-8a8ebbad4fc7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.094124 Sep 24 21:19:39.993406 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2837/5655] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:39 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:41.018574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-85a6fdde-7c79-4364-b5ce-be4a0e57cadd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:41.019796 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-85a6fdde-7c79-4364-b5ce-be4a0e57cadd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:41.027543 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-85a6fdde-7c79-4364-b5ce-be4a0e57cadd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:41.028033 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-85a6fdde-7c79-4364-b5ce-be4a0e57cadd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:41.028485 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-85a6fdde-7c79-4364-b5ce-be4a0e57cadd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:41.029225 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-85a6fdde-7c79-4364-b5ce-be4a0e57cadd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:41.029685 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-85a6fdde-7c79-4364-b5ce-be4a0e57cadd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:41.030123 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-85a6fdde-7c79-4364-b5ce-be4a0e57cadd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:41.093799 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-85a6fdde-7c79-4364-b5ce-be4a0e57cadd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:41.102904 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-85a6fdde-7c79-4364-b5ce-be4a0e57cadd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:41.104387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-85a6fdde-7c79-4364-b5ce-be4a0e57cadd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:41.106338 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-85a6fdde-7c79-4364-b5ce-be4a0e57cadd tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.091953 Sep 24 21:19:41.106946 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2819/5656] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:41 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:42.130451 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-78f8db69-0245-42d9-9f12-717fc826f102 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:42.131104 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-78f8db69-0245-42d9-9f12-717fc826f102 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:42.137932 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78f8db69-0245-42d9-9f12-717fc826f102 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:42.138421 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78f8db69-0245-42d9-9f12-717fc826f102 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:42.138933 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78f8db69-0245-42d9-9f12-717fc826f102 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:42.139629 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78f8db69-0245-42d9-9f12-717fc826f102 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:42.140281 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78f8db69-0245-42d9-9f12-717fc826f102 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:42.140713 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78f8db69-0245-42d9-9f12-717fc826f102 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:42.228340 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-78f8db69-0245-42d9-9f12-717fc826f102 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:42.238411 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-78f8db69-0245-42d9-9f12-717fc826f102 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:42.239906 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-78f8db69-0245-42d9-9f12-717fc826f102 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:42.241058 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-78f8db69-0245-42d9-9f12-717fc826f102 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.114727 Sep 24 21:19:42.241810 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2838/5657] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:42 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:43.267125 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1e1d8c7e-87bb-4d6e-aef0-65b9ce3cdfde tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:43.267755 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1e1d8c7e-87bb-4d6e-aef0-65b9ce3cdfde tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:43.275035 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e1d8c7e-87bb-4d6e-aef0-65b9ce3cdfde tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:43.275533 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e1d8c7e-87bb-4d6e-aef0-65b9ce3cdfde tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:43.275990 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e1d8c7e-87bb-4d6e-aef0-65b9ce3cdfde tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:43.276707 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e1d8c7e-87bb-4d6e-aef0-65b9ce3cdfde tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:43.277174 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e1d8c7e-87bb-4d6e-aef0-65b9ce3cdfde tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:43.277610 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e1d8c7e-87bb-4d6e-aef0-65b9ce3cdfde tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:43.344227 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1e1d8c7e-87bb-4d6e-aef0-65b9ce3cdfde tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:43.349736 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1e1d8c7e-87bb-4d6e-aef0-65b9ce3cdfde tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:43.351264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1e1d8c7e-87bb-4d6e-aef0-65b9ce3cdfde tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:43.352574 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1e1d8c7e-87bb-4d6e-aef0-65b9ce3cdfde tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.089362 Sep 24 21:19:43.353300 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2820/5658] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:43 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:44.377410 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-de195900-ff90-4f43-8257-c5e7eb94218b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:44.378999 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-de195900-ff90-4f43-8257-c5e7eb94218b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:44.386786 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de195900-ff90-4f43-8257-c5e7eb94218b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:44.387381 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de195900-ff90-4f43-8257-c5e7eb94218b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:44.387893 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de195900-ff90-4f43-8257-c5e7eb94218b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:44.388680 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de195900-ff90-4f43-8257-c5e7eb94218b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:44.389371 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de195900-ff90-4f43-8257-c5e7eb94218b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:44.389885 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de195900-ff90-4f43-8257-c5e7eb94218b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:44.458880 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-de195900-ff90-4f43-8257-c5e7eb94218b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:44.469167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-de195900-ff90-4f43-8257-c5e7eb94218b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:44.470667 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-de195900-ff90-4f43-8257-c5e7eb94218b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:44.471839 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-de195900-ff90-4f43-8257-c5e7eb94218b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.098543 Sep 24 21:19:44.472409 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2839/5659] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:44 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:19:45.496516 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-45ce76c8-4253-4100-8d46-c82499eff2e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:45.497546 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-45ce76c8-4253-4100-8d46-c82499eff2e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:45.511767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45ce76c8-4253-4100-8d46-c82499eff2e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:45.512239 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45ce76c8-4253-4100-8d46-c82499eff2e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:45.512712 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45ce76c8-4253-4100-8d46-c82499eff2e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:45.513349 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45ce76c8-4253-4100-8d46-c82499eff2e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:45.513815 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45ce76c8-4253-4100-8d46-c82499eff2e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:45.514244 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45ce76c8-4253-4100-8d46-c82499eff2e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:45.582097 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-45ce76c8-4253-4100-8d46-c82499eff2e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:45.592005 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-45ce76c8-4253-4100-8d46-c82499eff2e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:45.593457 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-45ce76c8-4253-4100-8d46-c82499eff2e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:45.594660 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-45ce76c8-4253-4100-8d46-c82499eff2e5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.102408 Sep 24 21:19:45.595430 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2821/5660] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:45 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:46.621315 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f43be642-185e-4044-9f08-8f6f94c54a1d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:46.622092 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f43be642-185e-4044-9f08-8f6f94c54a1d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:46.631162 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f43be642-185e-4044-9f08-8f6f94c54a1d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:46.631707 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f43be642-185e-4044-9f08-8f6f94c54a1d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:46.632196 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f43be642-185e-4044-9f08-8f6f94c54a1d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:46.632973 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f43be642-185e-4044-9f08-8f6f94c54a1d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:46.633444 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f43be642-185e-4044-9f08-8f6f94c54a1d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:46.634115 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f43be642-185e-4044-9f08-8f6f94c54a1d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:46.704226 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f43be642-185e-4044-9f08-8f6f94c54a1d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:46.713605 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f43be642-185e-4044-9f08-8f6f94c54a1d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:46.715518 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f43be642-185e-4044-9f08-8f6f94c54a1d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:46.716699 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f43be642-185e-4044-9f08-8f6f94c54a1d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.100233 Sep 24 21:19:46.717272 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2840/5661] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:46 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:47.742534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-997cd015-5c6b-4fd1-8c79-6faa9a865a3f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:47.743183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-997cd015-5c6b-4fd1-8c79-6faa9a865a3f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:47.750419 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-997cd015-5c6b-4fd1-8c79-6faa9a865a3f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:47.750947 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-997cd015-5c6b-4fd1-8c79-6faa9a865a3f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:47.751389 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-997cd015-5c6b-4fd1-8c79-6faa9a865a3f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:47.752102 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-997cd015-5c6b-4fd1-8c79-6faa9a865a3f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:47.752563 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-997cd015-5c6b-4fd1-8c79-6faa9a865a3f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:47.752993 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-997cd015-5c6b-4fd1-8c79-6faa9a865a3f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:48.166630 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-997cd015-5c6b-4fd1-8c79-6faa9a865a3f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:48.176688 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-997cd015-5c6b-4fd1-8c79-6faa9a865a3f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:48.178200 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-997cd015-5c6b-4fd1-8c79-6faa9a865a3f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:48.179392 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-997cd015-5c6b-4fd1-8c79-6faa9a865a3f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.441091 Sep 24 21:19:48.179961 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2822/5662] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:47 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:49.206759 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0e9b3192-fe6c-474f-b228-81b06f2e2e1b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:49.207497 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0e9b3192-fe6c-474f-b228-81b06f2e2e1b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:49.215314 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e9b3192-fe6c-474f-b228-81b06f2e2e1b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:49.215912 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e9b3192-fe6c-474f-b228-81b06f2e2e1b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:49.216495 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e9b3192-fe6c-474f-b228-81b06f2e2e1b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:49.217211 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e9b3192-fe6c-474f-b228-81b06f2e2e1b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:49.217671 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e9b3192-fe6c-474f-b228-81b06f2e2e1b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:49.218234 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e9b3192-fe6c-474f-b228-81b06f2e2e1b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:49.441268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0e9b3192-fe6c-474f-b228-81b06f2e2e1b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:49.451122 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0e9b3192-fe6c-474f-b228-81b06f2e2e1b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:49.452585 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0e9b3192-fe6c-474f-b228-81b06f2e2e1b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:49.453791 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0e9b3192-fe6c-474f-b228-81b06f2e2e1b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.251468 Sep 24 21:19:49.454375 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2841/5663] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:49 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:50.478940 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3411be68-099a-4bce-b63b-707d737999ef tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:50.479702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3411be68-099a-4bce-b63b-707d737999ef tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:50.486715 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3411be68-099a-4bce-b63b-707d737999ef tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:50.487209 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3411be68-099a-4bce-b63b-707d737999ef tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:50.487683 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3411be68-099a-4bce-b63b-707d737999ef tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:50.488394 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3411be68-099a-4bce-b63b-707d737999ef tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:50.488856 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3411be68-099a-4bce-b63b-707d737999ef tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:50.489291 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3411be68-099a-4bce-b63b-707d737999ef tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:50.558885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3411be68-099a-4bce-b63b-707d737999ef tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:50.567614 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3411be68-099a-4bce-b63b-707d737999ef tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:50.569095 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3411be68-099a-4bce-b63b-707d737999ef tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:50.570291 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3411be68-099a-4bce-b63b-707d737999ef tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.095373 Sep 24 21:19:50.574683 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2823/5664] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:50 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:51.595201 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-76f90158-23d7-4a39-82e7-ec6f7727ec92 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:51.595822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-76f90158-23d7-4a39-82e7-ec6f7727ec92 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:51.604491 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76f90158-23d7-4a39-82e7-ec6f7727ec92 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:51.605070 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76f90158-23d7-4a39-82e7-ec6f7727ec92 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:51.605514 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76f90158-23d7-4a39-82e7-ec6f7727ec92 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:51.606334 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76f90158-23d7-4a39-82e7-ec6f7727ec92 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:51.606829 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76f90158-23d7-4a39-82e7-ec6f7727ec92 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:51.607265 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76f90158-23d7-4a39-82e7-ec6f7727ec92 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:51.681238 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-76f90158-23d7-4a39-82e7-ec6f7727ec92 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:51.690799 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-76f90158-23d7-4a39-82e7-ec6f7727ec92 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:51.692449 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-76f90158-23d7-4a39-82e7-ec6f7727ec92 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:51.693640 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-76f90158-23d7-4a39-82e7-ec6f7727ec92 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.102449 Sep 24 21:19:51.694239 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2842/5665] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:51 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:52.720454 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5dd8f2c0-4309-43af-87b7-bb67fc31a02f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:52.721072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5dd8f2c0-4309-43af-87b7-bb67fc31a02f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:52.727942 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5dd8f2c0-4309-43af-87b7-bb67fc31a02f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:52.728421 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5dd8f2c0-4309-43af-87b7-bb67fc31a02f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:52.728880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5dd8f2c0-4309-43af-87b7-bb67fc31a02f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:52.730008 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5dd8f2c0-4309-43af-87b7-bb67fc31a02f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:52.730470 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5dd8f2c0-4309-43af-87b7-bb67fc31a02f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:52.730926 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5dd8f2c0-4309-43af-87b7-bb67fc31a02f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:52.733473 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=82 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:19:52.794724 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5dd8f2c0-4309-43af-87b7-bb67fc31a02f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:52.803601 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5dd8f2c0-4309-43af-87b7-bb67fc31a02f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:52.805056 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5dd8f2c0-4309-43af-87b7-bb67fc31a02f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:52.806201 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5dd8f2c0-4309-43af-87b7-bb67fc31a02f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.089735 Sep 24 21:19:52.806800 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2824/5666] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:52 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:53.832656 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9bb696b3-b26e-4c7d-9dc1-110474828c07 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:53.833273 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9bb696b3-b26e-4c7d-9dc1-110474828c07 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:53.836005 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=28 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:19:53.842702 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9bb696b3-b26e-4c7d-9dc1-110474828c07 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:53.843191 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9bb696b3-b26e-4c7d-9dc1-110474828c07 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:53.843634 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9bb696b3-b26e-4c7d-9dc1-110474828c07 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:53.844341 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9bb696b3-b26e-4c7d-9dc1-110474828c07 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:53.844799 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9bb696b3-b26e-4c7d-9dc1-110474828c07 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:53.845228 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9bb696b3-b26e-4c7d-9dc1-110474828c07 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:53.914110 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9bb696b3-b26e-4c7d-9dc1-110474828c07 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:53.924112 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9bb696b3-b26e-4c7d-9dc1-110474828c07 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:53.925586 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9bb696b3-b26e-4c7d-9dc1-110474828c07 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:53.926779 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9bb696b3-b26e-4c7d-9dc1-110474828c07 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.098323 Sep 24 21:19:53.927357 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2843/5667] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:53 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:54.952084 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fb8746d7-35c6-4b4f-9064-25ccb0dabfe2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:54.952704 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fb8746d7-35c6-4b4f-9064-25ccb0dabfe2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:54.959798 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb8746d7-35c6-4b4f-9064-25ccb0dabfe2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:54.960292 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb8746d7-35c6-4b4f-9064-25ccb0dabfe2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:54.960731 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb8746d7-35c6-4b4f-9064-25ccb0dabfe2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:54.961620 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb8746d7-35c6-4b4f-9064-25ccb0dabfe2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:54.962077 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb8746d7-35c6-4b4f-9064-25ccb0dabfe2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:54.962537 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb8746d7-35c6-4b4f-9064-25ccb0dabfe2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:55.027821 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fb8746d7-35c6-4b4f-9064-25ccb0dabfe2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:55.036561 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fb8746d7-35c6-4b4f-9064-25ccb0dabfe2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:55.038039 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fb8746d7-35c6-4b4f-9064-25ccb0dabfe2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:55.039230 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fb8746d7-35c6-4b4f-9064-25ccb0dabfe2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.091678 Sep 24 21:19:55.039784 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2825/5668] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:54 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:56.064784 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e8f2bb07-80b1-49ae-aaed-4cf18af1461f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:56.065306 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e8f2bb07-80b1-49ae-aaed-4cf18af1461f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:56.072247 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e8f2bb07-80b1-49ae-aaed-4cf18af1461f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:56.073558 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e8f2bb07-80b1-49ae-aaed-4cf18af1461f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:56.074013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e8f2bb07-80b1-49ae-aaed-4cf18af1461f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:56.074854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e8f2bb07-80b1-49ae-aaed-4cf18af1461f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:56.075310 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e8f2bb07-80b1-49ae-aaed-4cf18af1461f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:56.075737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e8f2bb07-80b1-49ae-aaed-4cf18af1461f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:56.140156 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e8f2bb07-80b1-49ae-aaed-4cf18af1461f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:56.149163 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e8f2bb07-80b1-49ae-aaed-4cf18af1461f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:56.150649 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e8f2bb07-80b1-49ae-aaed-4cf18af1461f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:56.152519 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e8f2bb07-80b1-49ae-aaed-4cf18af1461f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.091779 Sep 24 21:19:56.153228 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2844/5669] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:56 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:56.620570 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5edebe05-36d9-4c3a-acab-7c906543bbb3 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:56.621476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5edebe05-36d9-4c3a-acab-7c906543bbb3 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:56.629283 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5edebe05-36d9-4c3a-acab-7c906543bbb3 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:56.629779 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5edebe05-36d9-4c3a-acab-7c906543bbb3 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:56.630229 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5edebe05-36d9-4c3a-acab-7c906543bbb3 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:56.630970 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5edebe05-36d9-4c3a-acab-7c906543bbb3 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:56.631465 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5edebe05-36d9-4c3a-acab-7c906543bbb3 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:56.631900 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5edebe05-36d9-4c3a-acab-7c906543bbb3 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:56.767950 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5edebe05-36d9-4c3a-acab-7c906543bbb3 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1834 microversion: 2.1 time: 0.151712 Sep 24 21:19:56.768535 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2826/5670] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:19:56 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1834 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:19:56.791293 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8ca716d2-64c9-4bd6-a0c5-ce93678ed4fa tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:56.791907 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8ca716d2-64c9-4bd6-a0c5-ce93678ed4fa tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:56.799027 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8ca716d2-64c9-4bd6-a0c5-ce93678ed4fa tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:56.799513 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8ca716d2-64c9-4bd6-a0c5-ce93678ed4fa tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:56.799963 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8ca716d2-64c9-4bd6-a0c5-ce93678ed4fa tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:56.800658 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8ca716d2-64c9-4bd6-a0c5-ce93678ed4fa tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:56.801118 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8ca716d2-64c9-4bd6-a0c5-ce93678ed4fa tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:56.801546 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8ca716d2-64c9-4bd6-a0c5-ce93678ed4fa tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:56.930829 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8ca716d2-64c9-4bd6-a0c5-ce93678ed4fa tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:56.939255 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8ca716d2-64c9-4bd6-a0c5-ce93678ed4fa tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1683 microversion: 2.1 time: 0.151870 Sep 24 21:19:56.939828 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2845/5671] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:19:56 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:19:57.038737 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c6c90487-7bba-4c98-8ab3-5cf18038a32c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:19:57.040979 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c6c90487-7bba-4c98-8ab3-5cf18038a32c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:57.047384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6c90487-7bba-4c98-8ab3-5cf18038a32c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:57.047909 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6c90487-7bba-4c98-8ab3-5cf18038a32c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:57.048362 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6c90487-7bba-4c98-8ab3-5cf18038a32c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:57.049130 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6c90487-7bba-4c98-8ab3-5cf18038a32c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:57.049603 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6c90487-7bba-4c98-8ab3-5cf18038a32c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:57.050045 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c6c90487-7bba-4c98-8ab3-5cf18038a32c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:57.104117 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c6c90487-7bba-4c98-8ab3-5cf18038a32c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "POST /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b/action" status: 200 len: 32640 microversion: 2.1 time: 0.069212 Sep 24 21:19:57.111803 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2827/5672] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:19:57 2022] POST /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b/action => generated 32640 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:19:57.178346 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4b4101dd-1306-4434-881e-141ff7690080 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:57.179063 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4b4101dd-1306-4434-881e-141ff7690080 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:57.187920 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4b4101dd-1306-4434-881e-141ff7690080 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:57.188410 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4b4101dd-1306-4434-881e-141ff7690080 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:57.188856 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4b4101dd-1306-4434-881e-141ff7690080 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:57.189566 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4b4101dd-1306-4434-881e-141ff7690080 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:57.190028 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4b4101dd-1306-4434-881e-141ff7690080 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:57.190462 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4b4101dd-1306-4434-881e-141ff7690080 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:57.257602 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4b4101dd-1306-4434-881e-141ff7690080 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:57.275401 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4b4101dd-1306-4434-881e-141ff7690080 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:57.276975 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4b4101dd-1306-4434-881e-141ff7690080 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:57.278167 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4b4101dd-1306-4434-881e-141ff7690080 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.104293 Sep 24 21:19:57.278745 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2846/5673] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:57 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:57.302343 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0840d6ff-c24b-42bb-a328-e69e08704d72 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:19:57.303126 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0840d6ff-c24b-42bb-a328-e69e08704d72 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:57.311923 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0840d6ff-c24b-42bb-a328-e69e08704d72 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:57.312412 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0840d6ff-c24b-42bb-a328-e69e08704d72 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:57.313116 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0840d6ff-c24b-42bb-a328-e69e08704d72 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:57.313734 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0840d6ff-c24b-42bb-a328-e69e08704d72 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:57.314188 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0840d6ff-c24b-42bb-a328-e69e08704d72 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:57.314838 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0840d6ff-c24b-42bb-a328-e69e08704d72 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:57.346430 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0840d6ff-c24b-42bb-a328-e69e08704d72 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3246fd815aa74d33b8eaeffcd719e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f4287f4d0b4f2281d6c40edcba11fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:57.347092 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0840d6ff-c24b-42bb-a328-e69e08704d72 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] flavor_id is None. Assuming migration. {{(pid=140516) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 24 21:19:57.347637 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0840d6ff-c24b-42bb-a328-e69e08704d72 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=140516) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 24 21:19:57.468857 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0840d6ff-c24b-42bb-a328-e69e08704d72 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b/action" status: 202 len: 0 microversion: 2.1 time: 0.171133 Sep 24 21:19:57.472686 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2828/5674] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:19:57 2022] POST /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:19:57.477742 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-10ca34dd-0d3c-4e9f-8a94-ead29e889970 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:57.478469 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-10ca34dd-0d3c-4e9f-8a94-ead29e889970 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:57.485344 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-10ca34dd-0d3c-4e9f-8a94-ead29e889970 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:57.485836 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-10ca34dd-0d3c-4e9f-8a94-ead29e889970 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:57.486522 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-10ca34dd-0d3c-4e9f-8a94-ead29e889970 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:57.487228 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-10ca34dd-0d3c-4e9f-8a94-ead29e889970 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:57.487687 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-10ca34dd-0d3c-4e9f-8a94-ead29e889970 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:57.488296 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-10ca34dd-0d3c-4e9f-8a94-ead29e889970 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:57.650526 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-10ca34dd-0d3c-4e9f-8a94-ead29e889970 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:57.659164 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-10ca34dd-0d3c-4e9f-8a94-ead29e889970 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1692 microversion: 2.1 time: 0.185275 Sep 24 21:19:57.659755 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2847/5675] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:19:57 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1692 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:19:58.305370 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-694d706c-8e00-4882-87ee-e2ff3a8c70d1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:58.306126 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-694d706c-8e00-4882-87ee-e2ff3a8c70d1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:58.312988 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-694d706c-8e00-4882-87ee-e2ff3a8c70d1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:58.313486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-694d706c-8e00-4882-87ee-e2ff3a8c70d1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:58.313934 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-694d706c-8e00-4882-87ee-e2ff3a8c70d1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:58.314691 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-694d706c-8e00-4882-87ee-e2ff3a8c70d1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:58.315160 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-694d706c-8e00-4882-87ee-e2ff3a8c70d1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:58.315598 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-694d706c-8e00-4882-87ee-e2ff3a8c70d1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:58.395227 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-694d706c-8e00-4882-87ee-e2ff3a8c70d1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:58.399291 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-694d706c-8e00-4882-87ee-e2ff3a8c70d1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:58.401051 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-694d706c-8e00-4882-87ee-e2ff3a8c70d1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:58.402635 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-694d706c-8e00-4882-87ee-e2ff3a8c70d1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.102017 Sep 24 21:19:58.406894 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2829/5676] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:58 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:58.683604 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e1f4cf4e-8a3d-4076-9551-feec5566c97d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:58.684233 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e1f4cf4e-8a3d-4076-9551-feec5566c97d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:58.691383 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1f4cf4e-8a3d-4076-9551-feec5566c97d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:58.691871 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1f4cf4e-8a3d-4076-9551-feec5566c97d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:58.692311 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1f4cf4e-8a3d-4076-9551-feec5566c97d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:58.693013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1f4cf4e-8a3d-4076-9551-feec5566c97d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:58.693472 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1f4cf4e-8a3d-4076-9551-feec5566c97d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:58.693903 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1f4cf4e-8a3d-4076-9551-feec5566c97d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:58.892595 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e1f4cf4e-8a3d-4076-9551-feec5566c97d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:58.901595 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e1f4cf4e-8a3d-4076-9551-feec5566c97d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1692 microversion: 2.1 time: 0.222502 Sep 24 21:19:58.902281 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2848/5677] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:19:58 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1692 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:19:59.431423 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d6ef21cb-9094-4739-8e8d-9ed0d6af4a54 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:59.432051 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d6ef21cb-9094-4739-8e8d-9ed0d6af4a54 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:59.443635 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d6ef21cb-9094-4739-8e8d-9ed0d6af4a54 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:59.444511 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d6ef21cb-9094-4739-8e8d-9ed0d6af4a54 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:59.445033 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d6ef21cb-9094-4739-8e8d-9ed0d6af4a54 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:59.445711 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d6ef21cb-9094-4739-8e8d-9ed0d6af4a54 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:59.446241 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d6ef21cb-9094-4739-8e8d-9ed0d6af4a54 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:59.446804 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d6ef21cb-9094-4739-8e8d-9ed0d6af4a54 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:59.530386 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d6ef21cb-9094-4739-8e8d-9ed0d6af4a54 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:59.540923 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d6ef21cb-9094-4739-8e8d-9ed0d6af4a54 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:59.543867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d6ef21cb-9094-4739-8e8d-9ed0d6af4a54 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:19:59.546014 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d6ef21cb-9094-4739-8e8d-9ed0d6af4a54 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.119038 Sep 24 21:19:59.546852 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2830/5678] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:19:59 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:19:59.926072 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f23d5928-61de-4a30-8049-1889697af075 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:19:59.926869 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f23d5928-61de-4a30-8049-1889697af075 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:19:59.936682 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f23d5928-61de-4a30-8049-1889697af075 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:59.937683 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f23d5928-61de-4a30-8049-1889697af075 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:59.938478 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f23d5928-61de-4a30-8049-1889697af075 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:19:59.939742 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f23d5928-61de-4a30-8049-1889697af075 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:19:59.940601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f23d5928-61de-4a30-8049-1889697af075 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:19:59.941404 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f23d5928-61de-4a30-8049-1889697af075 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:00.112061 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f23d5928-61de-4a30-8049-1889697af075 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:00.121321 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f23d5928-61de-4a30-8049-1889697af075 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1697 microversion: 2.1 time: 0.198127 Sep 24 21:20:00.122051 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2849/5679] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:19:59 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1697 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:20:00.574606 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-96a4c413-06b7-4053-950a-a7e47d5bdcc3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:00.575109 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-96a4c413-06b7-4053-950a-a7e47d5bdcc3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:00.582074 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96a4c413-06b7-4053-950a-a7e47d5bdcc3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:00.582597 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96a4c413-06b7-4053-950a-a7e47d5bdcc3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:00.583047 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96a4c413-06b7-4053-950a-a7e47d5bdcc3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:00.583760 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96a4c413-06b7-4053-950a-a7e47d5bdcc3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:00.584229 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96a4c413-06b7-4053-950a-a7e47d5bdcc3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:00.584667 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-96a4c413-06b7-4053-950a-a7e47d5bdcc3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:00.658708 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-96a4c413-06b7-4053-950a-a7e47d5bdcc3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:00.668453 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-96a4c413-06b7-4053-950a-a7e47d5bdcc3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:00.670074 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-96a4c413-06b7-4053-950a-a7e47d5bdcc3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:00.671260 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-96a4c413-06b7-4053-950a-a7e47d5bdcc3 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.101011 Sep 24 21:20:00.671830 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2831/5680] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:00 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:01.146295 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fb999c14-089c-4196-96c0-c01994dc9fe0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:01.147107 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fb999c14-089c-4196-96c0-c01994dc9fe0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:01.154646 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb999c14-089c-4196-96c0-c01994dc9fe0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:01.155139 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb999c14-089c-4196-96c0-c01994dc9fe0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:01.155621 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb999c14-089c-4196-96c0-c01994dc9fe0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:01.156359 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb999c14-089c-4196-96c0-c01994dc9fe0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:01.156945 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb999c14-089c-4196-96c0-c01994dc9fe0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:01.157405 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb999c14-089c-4196-96c0-c01994dc9fe0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:01.301214 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fb999c14-089c-4196-96c0-c01994dc9fe0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:01.309904 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fb999c14-089c-4196-96c0-c01994dc9fe0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1697 microversion: 2.1 time: 0.167689 Sep 24 21:20:01.310529 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2850/5681] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:20:01 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1697 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:20:01.696087 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a4040437-b166-4926-816b-e060760a5b70 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:01.696765 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a4040437-b166-4926-816b-e060760a5b70 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:01.705225 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a4040437-b166-4926-816b-e060760a5b70 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:01.705739 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a4040437-b166-4926-816b-e060760a5b70 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:01.706185 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a4040437-b166-4926-816b-e060760a5b70 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:01.706939 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a4040437-b166-4926-816b-e060760a5b70 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:01.707405 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a4040437-b166-4926-816b-e060760a5b70 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:01.707839 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a4040437-b166-4926-816b-e060760a5b70 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:01.966638 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a4040437-b166-4926-816b-e060760a5b70 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:01.976980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a4040437-b166-4926-816b-e060760a5b70 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:01.978463 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a4040437-b166-4926-816b-e060760a5b70 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:01.980326 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a4040437-b166-4926-816b-e060760a5b70 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.287789 Sep 24 21:20:01.980915 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2832/5682] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:01 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:02.333371 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fbd45045-3534-4d56-8ac8-f4dff095a4e0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:02.334001 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fbd45045-3534-4d56-8ac8-f4dff095a4e0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:02.340996 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fbd45045-3534-4d56-8ac8-f4dff095a4e0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:02.341490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fbd45045-3534-4d56-8ac8-f4dff095a4e0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:02.341941 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fbd45045-3534-4d56-8ac8-f4dff095a4e0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:02.342677 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fbd45045-3534-4d56-8ac8-f4dff095a4e0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:02.343148 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fbd45045-3534-4d56-8ac8-f4dff095a4e0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:02.343586 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fbd45045-3534-4d56-8ac8-f4dff095a4e0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:02.484423 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fbd45045-3534-4d56-8ac8-f4dff095a4e0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:02.492321 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fbd45045-3534-4d56-8ac8-f4dff095a4e0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1697 microversion: 2.1 time: 0.162885 Sep 24 21:20:02.492932 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2851/5683] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:20:02 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:20:03.007593 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-25d2de2c-59b8-4b98-95f7-8c37f3005888 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:03.008177 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-25d2de2c-59b8-4b98-95f7-8c37f3005888 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:03.015365 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-25d2de2c-59b8-4b98-95f7-8c37f3005888 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:03.015852 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-25d2de2c-59b8-4b98-95f7-8c37f3005888 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:03.016290 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-25d2de2c-59b8-4b98-95f7-8c37f3005888 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:03.016986 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-25d2de2c-59b8-4b98-95f7-8c37f3005888 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:03.017444 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-25d2de2c-59b8-4b98-95f7-8c37f3005888 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:03.017889 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-25d2de2c-59b8-4b98-95f7-8c37f3005888 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:03.082232 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-25d2de2c-59b8-4b98-95f7-8c37f3005888 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:03.091939 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-25d2de2c-59b8-4b98-95f7-8c37f3005888 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:03.093392 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-25d2de2c-59b8-4b98-95f7-8c37f3005888 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:03.094958 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-25d2de2c-59b8-4b98-95f7-8c37f3005888 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.091362 Sep 24 21:20:03.095522 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2833/5684] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:03 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:03.516883 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2444ee36-6354-4e53-8cc1-0b6a62b22cdb tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:03.517617 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2444ee36-6354-4e53-8cc1-0b6a62b22cdb tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:03.525561 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2444ee36-6354-4e53-8cc1-0b6a62b22cdb tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:03.526073 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2444ee36-6354-4e53-8cc1-0b6a62b22cdb tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:03.526556 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2444ee36-6354-4e53-8cc1-0b6a62b22cdb tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:03.527276 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2444ee36-6354-4e53-8cc1-0b6a62b22cdb tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:03.527744 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2444ee36-6354-4e53-8cc1-0b6a62b22cdb tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:03.528217 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2444ee36-6354-4e53-8cc1-0b6a62b22cdb tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:03.663231 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2444ee36-6354-4e53-8cc1-0b6a62b22cdb tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:03.671352 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2444ee36-6354-4e53-8cc1-0b6a62b22cdb tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1697 microversion: 2.1 time: 0.158388 Sep 24 21:20:03.671871 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2852/5685] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:20:03 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:20:04.121411 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5c98938e-810d-4bb0-9124-f2a48964c745 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:04.122032 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5c98938e-810d-4bb0-9124-f2a48964c745 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:04.129123 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c98938e-810d-4bb0-9124-f2a48964c745 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:04.129617 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c98938e-810d-4bb0-9124-f2a48964c745 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:04.130057 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c98938e-810d-4bb0-9124-f2a48964c745 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:04.130833 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c98938e-810d-4bb0-9124-f2a48964c745 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:04.131296 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c98938e-810d-4bb0-9124-f2a48964c745 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:04.131732 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5c98938e-810d-4bb0-9124-f2a48964c745 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:04.196766 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5c98938e-810d-4bb0-9124-f2a48964c745 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:04.205828 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5c98938e-810d-4bb0-9124-f2a48964c745 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:04.207333 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5c98938e-810d-4bb0-9124-f2a48964c745 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:04.208521 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5c98938e-810d-4bb0-9124-f2a48964c745 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.091820 Sep 24 21:20:04.209093 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2834/5686] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:04 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:04.696289 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0a1ad5f3-c245-434c-9693-262dec82e59c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:04.696910 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0a1ad5f3-c245-434c-9693-262dec82e59c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:04.704742 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0a1ad5f3-c245-434c-9693-262dec82e59c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:04.705233 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0a1ad5f3-c245-434c-9693-262dec82e59c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:04.705681 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0a1ad5f3-c245-434c-9693-262dec82e59c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:04.706381 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0a1ad5f3-c245-434c-9693-262dec82e59c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:04.706883 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0a1ad5f3-c245-434c-9693-262dec82e59c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:04.707321 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0a1ad5f3-c245-434c-9693-262dec82e59c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:04.844996 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0a1ad5f3-c245-434c-9693-262dec82e59c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:04.847240 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:20:04.853977 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0a1ad5f3-c245-434c-9693-262dec82e59c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1697 microversion: 2.1 time: 0.161640 Sep 24 21:20:04.854697 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2853/5687] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:20:04 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:20:05.233669 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9ec874bd-99a0-4d88-989e-5531de0d39ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:05.234214 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9ec874bd-99a0-4d88-989e-5531de0d39ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:05.241651 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9ec874bd-99a0-4d88-989e-5531de0d39ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:05.242144 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9ec874bd-99a0-4d88-989e-5531de0d39ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:05.242630 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9ec874bd-99a0-4d88-989e-5531de0d39ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:05.243344 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9ec874bd-99a0-4d88-989e-5531de0d39ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:05.243812 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9ec874bd-99a0-4d88-989e-5531de0d39ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:05.244251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9ec874bd-99a0-4d88-989e-5531de0d39ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:05.306571 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9ec874bd-99a0-4d88-989e-5531de0d39ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:05.315888 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9ec874bd-99a0-4d88-989e-5531de0d39ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:05.317360 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9ec874bd-99a0-4d88-989e-5531de0d39ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:05.318583 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9ec874bd-99a0-4d88-989e-5531de0d39ba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.089297 Sep 24 21:20:05.319150 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2835/5688] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:05 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:05.877563 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-afaf904e-624e-4999-922c-fe39e6539f71 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:05.878220 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-afaf904e-624e-4999-922c-fe39e6539f71 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:05.885392 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-afaf904e-624e-4999-922c-fe39e6539f71 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:05.886124 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-afaf904e-624e-4999-922c-fe39e6539f71 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:05.886461 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-afaf904e-624e-4999-922c-fe39e6539f71 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:05.887222 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-afaf904e-624e-4999-922c-fe39e6539f71 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:05.887687 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-afaf904e-624e-4999-922c-fe39e6539f71 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:05.888128 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-afaf904e-624e-4999-922c-fe39e6539f71 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:06.032110 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-afaf904e-624e-4999-922c-fe39e6539f71 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:06.040066 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-afaf904e-624e-4999-922c-fe39e6539f71 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1697 microversion: 2.1 time: 0.166781 Sep 24 21:20:06.040659 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2854/5689] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:20:05 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1697 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:20:06.344007 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-858bb395-8d91-46fe-bdae-d0bdc17b12c8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:06.344798 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-858bb395-8d91-46fe-bdae-d0bdc17b12c8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:06.351869 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-858bb395-8d91-46fe-bdae-d0bdc17b12c8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:06.352360 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-858bb395-8d91-46fe-bdae-d0bdc17b12c8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:06.352807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-858bb395-8d91-46fe-bdae-d0bdc17b12c8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:06.353516 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-858bb395-8d91-46fe-bdae-d0bdc17b12c8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:06.354570 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-858bb395-8d91-46fe-bdae-d0bdc17b12c8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:06.354988 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-858bb395-8d91-46fe-bdae-d0bdc17b12c8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:06.418751 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-858bb395-8d91-46fe-bdae-d0bdc17b12c8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:06.427664 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-858bb395-8d91-46fe-bdae-d0bdc17b12c8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:06.429166 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-858bb395-8d91-46fe-bdae-d0bdc17b12c8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:06.430588 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-858bb395-8d91-46fe-bdae-d0bdc17b12c8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.090549 Sep 24 21:20:06.431163 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2836/5690] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:06 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:20:07.063296 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-29ce98ea-04cd-4c19-b9d4-3d6bac439f33 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:07.063925 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-29ce98ea-04cd-4c19-b9d4-3d6bac439f33 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:07.071030 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-29ce98ea-04cd-4c19-b9d4-3d6bac439f33 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:07.071522 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-29ce98ea-04cd-4c19-b9d4-3d6bac439f33 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:07.071967 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-29ce98ea-04cd-4c19-b9d4-3d6bac439f33 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:07.072672 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-29ce98ea-04cd-4c19-b9d4-3d6bac439f33 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:07.073718 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-29ce98ea-04cd-4c19-b9d4-3d6bac439f33 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:07.074151 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-29ce98ea-04cd-4c19-b9d4-3d6bac439f33 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:07.206417 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-29ce98ea-04cd-4c19-b9d4-3d6bac439f33 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:07.215422 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-29ce98ea-04cd-4c19-b9d4-3d6bac439f33 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1697 microversion: 2.1 time: 0.155997 Sep 24 21:20:07.216001 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2855/5691] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:20:07 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:20:07.457022 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dd6dbd33-fc2d-49d7-a020-de35d7989ad9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:07.457670 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-dd6dbd33-fc2d-49d7-a020-de35d7989ad9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:07.460235 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=42 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:20:07.466630 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd6dbd33-fc2d-49d7-a020-de35d7989ad9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:07.467130 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd6dbd33-fc2d-49d7-a020-de35d7989ad9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:07.467576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd6dbd33-fc2d-49d7-a020-de35d7989ad9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:07.468303 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd6dbd33-fc2d-49d7-a020-de35d7989ad9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:07.468759 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd6dbd33-fc2d-49d7-a020-de35d7989ad9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:07.469206 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd6dbd33-fc2d-49d7-a020-de35d7989ad9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:07.531941 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-dd6dbd33-fc2d-49d7-a020-de35d7989ad9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:07.540653 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-dd6dbd33-fc2d-49d7-a020-de35d7989ad9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:07.542577 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-dd6dbd33-fc2d-49d7-a020-de35d7989ad9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:07.543830 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-dd6dbd33-fc2d-49d7-a020-de35d7989ad9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.090986 Sep 24 21:20:07.544445 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2837/5692] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:07 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:08.242769 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0eae9852-e83c-43b6-979c-88d01b741018 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:08.243394 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0eae9852-e83c-43b6-979c-88d01b741018 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:08.250362 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0eae9852-e83c-43b6-979c-88d01b741018 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:08.250887 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0eae9852-e83c-43b6-979c-88d01b741018 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:08.251337 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0eae9852-e83c-43b6-979c-88d01b741018 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:08.252070 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0eae9852-e83c-43b6-979c-88d01b741018 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:08.252530 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0eae9852-e83c-43b6-979c-88d01b741018 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:08.252966 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0eae9852-e83c-43b6-979c-88d01b741018 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:08.389212 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0eae9852-e83c-43b6-979c-88d01b741018 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:08.396952 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0eae9852-e83c-43b6-979c-88d01b741018 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1697 microversion: 2.1 time: 0.158139 Sep 24 21:20:08.397787 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2856/5693] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:20:08 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:20:08.569086 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-827258c0-36c8-419f-9eec-152b905f247a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:08.569742 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-827258c0-36c8-419f-9eec-152b905f247a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:08.577547 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-827258c0-36c8-419f-9eec-152b905f247a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:08.578037 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-827258c0-36c8-419f-9eec-152b905f247a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:08.578484 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-827258c0-36c8-419f-9eec-152b905f247a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:08.579213 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-827258c0-36c8-419f-9eec-152b905f247a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:08.579681 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-827258c0-36c8-419f-9eec-152b905f247a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:08.580118 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-827258c0-36c8-419f-9eec-152b905f247a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:08.644727 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-827258c0-36c8-419f-9eec-152b905f247a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:08.654599 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-827258c0-36c8-419f-9eec-152b905f247a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:08.656080 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-827258c0-36c8-419f-9eec-152b905f247a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:08.657244 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-827258c0-36c8-419f-9eec-152b905f247a tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.092182 Sep 24 21:20:08.657830 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2838/5694] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:08 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:09.422025 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-63f0e5fc-2a9c-449d-a499-04942d2de8b0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:09.422681 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-63f0e5fc-2a9c-449d-a499-04942d2de8b0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:09.429613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-63f0e5fc-2a9c-449d-a499-04942d2de8b0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:09.430130 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-63f0e5fc-2a9c-449d-a499-04942d2de8b0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:09.430611 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-63f0e5fc-2a9c-449d-a499-04942d2de8b0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:09.431318 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-63f0e5fc-2a9c-449d-a499-04942d2de8b0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:09.431781 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-63f0e5fc-2a9c-449d-a499-04942d2de8b0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:09.432939 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-63f0e5fc-2a9c-449d-a499-04942d2de8b0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:09.574906 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-63f0e5fc-2a9c-449d-a499-04942d2de8b0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:09.582935 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-63f0e5fc-2a9c-449d-a499-04942d2de8b0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1697 microversion: 2.1 time: 0.164930 Sep 24 21:20:09.583514 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2857/5695] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:20:09 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1697 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:20:09.682402 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e22b0d48-3e91-48fa-bd8a-8496bae88b66 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:09.683097 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e22b0d48-3e91-48fa-bd8a-8496bae88b66 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:09.689983 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e22b0d48-3e91-48fa-bd8a-8496bae88b66 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:09.690470 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e22b0d48-3e91-48fa-bd8a-8496bae88b66 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:09.690942 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e22b0d48-3e91-48fa-bd8a-8496bae88b66 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:09.691648 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e22b0d48-3e91-48fa-bd8a-8496bae88b66 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:09.692109 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e22b0d48-3e91-48fa-bd8a-8496bae88b66 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:09.692539 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e22b0d48-3e91-48fa-bd8a-8496bae88b66 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:09.707602 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:20:09.756586 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e22b0d48-3e91-48fa-bd8a-8496bae88b66 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:09.765484 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e22b0d48-3e91-48fa-bd8a-8496bae88b66 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:09.766982 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e22b0d48-3e91-48fa-bd8a-8496bae88b66 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:09.768141 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e22b0d48-3e91-48fa-bd8a-8496bae88b66 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.089922 Sep 24 21:20:09.768710 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2839/5696] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:09 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:10.607243 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e9a368d0-1091-4ac2-b574-860c0f7c2910 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:10.607892 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e9a368d0-1091-4ac2-b574-860c0f7c2910 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:10.614830 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9a368d0-1091-4ac2-b574-860c0f7c2910 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:10.615325 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9a368d0-1091-4ac2-b574-860c0f7c2910 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:10.615772 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9a368d0-1091-4ac2-b574-860c0f7c2910 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:10.616473 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9a368d0-1091-4ac2-b574-860c0f7c2910 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:10.616936 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9a368d0-1091-4ac2-b574-860c0f7c2910 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:10.617368 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9a368d0-1091-4ac2-b574-860c0f7c2910 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:10.752117 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e9a368d0-1091-4ac2-b574-860c0f7c2910 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:10.759885 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e9a368d0-1091-4ac2-b574-860c0f7c2910 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1697 microversion: 2.1 time: 0.157245 Sep 24 21:20:10.760530 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2858/5697] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:20:10 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:20:10.794053 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-00c64c23-1668-43e1-8a47-c2cffa181365 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:10.794795 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-00c64c23-1668-43e1-8a47-c2cffa181365 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:10.801553 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00c64c23-1668-43e1-8a47-c2cffa181365 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:10.802035 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00c64c23-1668-43e1-8a47-c2cffa181365 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:10.802470 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00c64c23-1668-43e1-8a47-c2cffa181365 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:10.803187 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00c64c23-1668-43e1-8a47-c2cffa181365 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:10.803641 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00c64c23-1668-43e1-8a47-c2cffa181365 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:10.804070 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00c64c23-1668-43e1-8a47-c2cffa181365 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:10.868910 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-00c64c23-1668-43e1-8a47-c2cffa181365 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:10.878413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-00c64c23-1668-43e1-8a47-c2cffa181365 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:10.879887 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-00c64c23-1668-43e1-8a47-c2cffa181365 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:10.881029 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-00c64c23-1668-43e1-8a47-c2cffa181365 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.091616 Sep 24 21:20:10.881601 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2840/5698] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:10 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:11.782893 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e497fd23-0098-442e-811b-a65020b49ee0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:11.783554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e497fd23-0098-442e-811b-a65020b49ee0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:11.790414 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e497fd23-0098-442e-811b-a65020b49ee0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:11.790987 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e497fd23-0098-442e-811b-a65020b49ee0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:11.791439 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e497fd23-0098-442e-811b-a65020b49ee0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:11.792312 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e497fd23-0098-442e-811b-a65020b49ee0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:11.792782 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e497fd23-0098-442e-811b-a65020b49ee0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:11.793270 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e497fd23-0098-442e-811b-a65020b49ee0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:11.906935 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5cfa4077-48ce-482f-aa91-b918c9a60179 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:11.907664 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5cfa4077-48ce-482f-aa91-b918c9a60179 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:11.914839 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5cfa4077-48ce-482f-aa91-b918c9a60179 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:11.915614 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5cfa4077-48ce-482f-aa91-b918c9a60179 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:11.916268 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5cfa4077-48ce-482f-aa91-b918c9a60179 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:11.918095 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5cfa4077-48ce-482f-aa91-b918c9a60179 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:11.918866 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5cfa4077-48ce-482f-aa91-b918c9a60179 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:11.919299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5cfa4077-48ce-482f-aa91-b918c9a60179 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:11.939429 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e497fd23-0098-442e-811b-a65020b49ee0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:11.948191 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e497fd23-0098-442e-811b-a65020b49ee0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1696 microversion: 2.1 time: 0.169274 Sep 24 21:20:11.950128 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2859/5699] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:20:11 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1696 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:20:11.986484 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5cfa4077-48ce-482f-aa91-b918c9a60179 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:11.996026 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5cfa4077-48ce-482f-aa91-b918c9a60179 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:11.997494 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5cfa4077-48ce-482f-aa91-b918c9a60179 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:11.998688 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5cfa4077-48ce-482f-aa91-b918c9a60179 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.095868 Sep 24 21:20:11.999251 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2841/5700] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:11 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:20:12.220944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-3df8d667-4402-42a8-b623-a78c4c749a9d req-7cedccdf-3e35-4dcf-8668-dfd1f425bace service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73bcce00-d4a3-47fe-8c0b-7eafc582116b", "name": "network-vif-unplugged", "status": "completed", "tag": "bb0c5eb0-6828-4897-8444-cf9e7648a777"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:20:12.231752 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-3df8d667-4402-42a8-b623-a78c4c749a9d req-7cedccdf-3e35-4dcf-8668-dfd1f425bace service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:12.232049 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-3df8d667-4402-42a8-b623-a78c4c749a9d req-7cedccdf-3e35-4dcf-8668-dfd1f425bace service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:12.232515 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-3df8d667-4402-42a8-b623-a78c4c749a9d req-7cedccdf-3e35-4dcf-8668-dfd1f425bace service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:12.248680 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-3df8d667-4402-42a8-b623-a78c4c749a9d req-7cedccdf-3e35-4dcf-8668-dfd1f425bace service nova] Creating event network-vif-unplugged:bb0c5eb0-6828-4897-8444-cf9e7648a777 for instance 73bcce00-d4a3-47fe-8c0b-7eafc582116b on nch2-master-1 Sep 24 21:20:12.254665 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [req-3df8d667-4402-42a8-b623-a78c4c749a9d req-7cedccdf-3e35-4dcf-8668-dfd1f425bace service nova] Instance 73bcce00-d4a3-47fe-8c0b-7eafc582116b is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 21:20:12.266064 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-3df8d667-4402-42a8-b623-a78c4c749a9d req-7cedccdf-3e35-4dcf-8668-dfd1f425bace service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049051 Sep 24 21:20:12.267006 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2860/5701] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:20:12.973319 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1fdadc60-055e-4bc6-a8db-ecf4c95f5b09 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:12.974031 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1fdadc60-055e-4bc6-a8db-ecf4c95f5b09 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:12.981270 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1fdadc60-055e-4bc6-a8db-ecf4c95f5b09 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:12.981763 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1fdadc60-055e-4bc6-a8db-ecf4c95f5b09 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:12.982238 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1fdadc60-055e-4bc6-a8db-ecf4c95f5b09 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:12.982992 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1fdadc60-055e-4bc6-a8db-ecf4c95f5b09 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:12.983458 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1fdadc60-055e-4bc6-a8db-ecf4c95f5b09 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:12.983894 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1fdadc60-055e-4bc6-a8db-ecf4c95f5b09 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:13.027203 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-739eda87-798a-444a-9dda-8c26f954aecf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:13.028571 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-739eda87-798a-444a-9dda-8c26f954aecf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:13.034990 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-739eda87-798a-444a-9dda-8c26f954aecf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:13.035486 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-739eda87-798a-444a-9dda-8c26f954aecf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:13.035928 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-739eda87-798a-444a-9dda-8c26f954aecf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:13.036641 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-739eda87-798a-444a-9dda-8c26f954aecf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:13.037339 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-739eda87-798a-444a-9dda-8c26f954aecf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:13.037973 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-739eda87-798a-444a-9dda-8c26f954aecf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:13.113413 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-739eda87-798a-444a-9dda-8c26f954aecf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:13.123521 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-739eda87-798a-444a-9dda-8c26f954aecf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:13.124659 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-739eda87-798a-444a-9dda-8c26f954aecf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:13.125966 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-739eda87-798a-444a-9dda-8c26f954aecf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.104972 Sep 24 21:20:13.126819 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2861/5702] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:13 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:20:13.154452 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1fdadc60-055e-4bc6-a8db-ecf4c95f5b09 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:13.163455 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1fdadc60-055e-4bc6-a8db-ecf4c95f5b09 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1696 microversion: 2.1 time: 0.194108 Sep 24 21:20:13.164041 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2842/5703] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:20:12 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1696 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:20:14.152769 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-220d151f-68bf-493b-83fb-47f5b7f4693c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:14.153424 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-220d151f-68bf-493b-83fb-47f5b7f4693c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:14.160311 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-220d151f-68bf-493b-83fb-47f5b7f4693c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:14.160798 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-220d151f-68bf-493b-83fb-47f5b7f4693c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:14.161246 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-220d151f-68bf-493b-83fb-47f5b7f4693c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:14.161954 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-220d151f-68bf-493b-83fb-47f5b7f4693c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:14.162418 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-220d151f-68bf-493b-83fb-47f5b7f4693c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:14.162879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-220d151f-68bf-493b-83fb-47f5b7f4693c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:14.186261 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5764f2b1-d859-4390-bbd4-324067ba9b36 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:14.186908 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5764f2b1-d859-4390-bbd4-324067ba9b36 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:14.193718 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5764f2b1-d859-4390-bbd4-324067ba9b36 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:14.194209 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5764f2b1-d859-4390-bbd4-324067ba9b36 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:14.194681 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5764f2b1-d859-4390-bbd4-324067ba9b36 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:14.195387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5764f2b1-d859-4390-bbd4-324067ba9b36 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:14.195849 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5764f2b1-d859-4390-bbd4-324067ba9b36 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:14.196285 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5764f2b1-d859-4390-bbd4-324067ba9b36 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:14.225337 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-220d151f-68bf-493b-83fb-47f5b7f4693c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:14.234999 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-220d151f-68bf-493b-83fb-47f5b7f4693c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:14.236471 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-220d151f-68bf-493b-83fb-47f5b7f4693c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:14.237660 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-220d151f-68bf-493b-83fb-47f5b7f4693c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.089844 Sep 24 21:20:14.238241 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2862/5704] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:14 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:14.298765 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-ade44186-dfaf-47d4-9c35-cf1e83652147 req-59a7ff5a-6166-4224-8ea0-0ac6f553c8ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73bcce00-d4a3-47fe-8c0b-7eafc582116b", "tag": "bb0c5eb0-6828-4897-8444-cf9e7648a777"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:20:14.308172 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-ade44186-dfaf-47d4-9c35-cf1e83652147 req-59a7ff5a-6166-4224-8ea0-0ac6f553c8ee service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:14.308652 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-ade44186-dfaf-47d4-9c35-cf1e83652147 req-59a7ff5a-6166-4224-8ea0-0ac6f553c8ee service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:14.309088 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-ade44186-dfaf-47d4-9c35-cf1e83652147 req-59a7ff5a-6166-4224-8ea0-0ac6f553c8ee service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:14.320668 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-ade44186-dfaf-47d4-9c35-cf1e83652147 req-59a7ff5a-6166-4224-8ea0-0ac6f553c8ee service nova] Creating event network-changed:bb0c5eb0-6828-4897-8444-cf9e7648a777 for instance 73bcce00-d4a3-47fe-8c0b-7eafc582116b on nch2-master-1 Sep 24 21:20:14.326548 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [req-ade44186-dfaf-47d4-9c35-cf1e83652147 req-59a7ff5a-6166-4224-8ea0-0ac6f553c8ee service nova] Instance 73bcce00-d4a3-47fe-8c0b-7eafc582116b is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 21:20:14.331332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5764f2b1-d859-4390-bbd4-324067ba9b36 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:14.337185 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-ade44186-dfaf-47d4-9c35-cf1e83652147 req-59a7ff5a-6166-4224-8ea0-0ac6f553c8ee service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042071 Sep 24 21:20:14.337797 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2863/5705] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:20:14.340859 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5764f2b1-d859-4390-bbd4-324067ba9b36 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1694 microversion: 2.1 time: 0.158373 Sep 24 21:20:14.341474 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2843/5706] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:20:14 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1694 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:20:15.264440 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1ddb0426-9dd2-491e-b517-cb8e65265c3b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:15.265159 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1ddb0426-9dd2-491e-b517-cb8e65265c3b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:15.273069 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1ddb0426-9dd2-491e-b517-cb8e65265c3b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:15.273571 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1ddb0426-9dd2-491e-b517-cb8e65265c3b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:15.274025 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1ddb0426-9dd2-491e-b517-cb8e65265c3b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:15.274771 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1ddb0426-9dd2-491e-b517-cb8e65265c3b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:15.275343 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1ddb0426-9dd2-491e-b517-cb8e65265c3b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:15.275668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1ddb0426-9dd2-491e-b517-cb8e65265c3b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:15.343123 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1ddb0426-9dd2-491e-b517-cb8e65265c3b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:15.351989 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1ddb0426-9dd2-491e-b517-cb8e65265c3b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:15.353462 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1ddb0426-9dd2-491e-b517-cb8e65265c3b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:15.355287 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1ddb0426-9dd2-491e-b517-cb8e65265c3b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.096066 Sep 24 21:20:15.355858 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2864/5707] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:15 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:15.365710 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-eaac1288-8f45-4678-aea2-a97ef18c8a04 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:15.366570 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-eaac1288-8f45-4678-aea2-a97ef18c8a04 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:15.375531 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eaac1288-8f45-4678-aea2-a97ef18c8a04 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:15.376256 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eaac1288-8f45-4678-aea2-a97ef18c8a04 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:15.376852 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eaac1288-8f45-4678-aea2-a97ef18c8a04 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:15.377563 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eaac1288-8f45-4678-aea2-a97ef18c8a04 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:15.378057 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eaac1288-8f45-4678-aea2-a97ef18c8a04 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:15.378491 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eaac1288-8f45-4678-aea2-a97ef18c8a04 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:15.514811 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-eaac1288-8f45-4678-aea2-a97ef18c8a04 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:15.523140 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-eaac1288-8f45-4678-aea2-a97ef18c8a04 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1691 microversion: 2.1 time: 0.162142 Sep 24 21:20:15.523725 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2844/5708] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:20:15 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:20:15.547482 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-de8db71d-ea10-4bc2-a28f-bb6223b46595 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:20:15.548041 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-de8db71d-ea10-4bc2-a28f-bb6223b46595 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:15.554175 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de8db71d-ea10-4bc2-a28f-bb6223b46595 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:15.554739 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de8db71d-ea10-4bc2-a28f-bb6223b46595 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:15.555175 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de8db71d-ea10-4bc2-a28f-bb6223b46595 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:15.555888 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de8db71d-ea10-4bc2-a28f-bb6223b46595 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:15.556355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de8db71d-ea10-4bc2-a28f-bb6223b46595 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:15.556825 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de8db71d-ea10-4bc2-a28f-bb6223b46595 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:15.667118 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-de8db71d-ea10-4bc2-a28f-bb6223b46595 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "POST /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b/action" status: 202 len: 0 microversion: 2.1 time: 0.123165 Sep 24 21:20:15.667963 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2865/5709] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:20:15 2022] POST /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 21:20:15.676594 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f242c364-6864-42a7-9cb3-fbb0d9ae31e6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:15.677090 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f242c364-6864-42a7-9cb3-fbb0d9ae31e6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:15.684661 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f242c364-6864-42a7-9cb3-fbb0d9ae31e6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:15.685306 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f242c364-6864-42a7-9cb3-fbb0d9ae31e6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:15.685861 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f242c364-6864-42a7-9cb3-fbb0d9ae31e6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:15.686703 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f242c364-6864-42a7-9cb3-fbb0d9ae31e6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:15.687172 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f242c364-6864-42a7-9cb3-fbb0d9ae31e6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:15.687664 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f242c364-6864-42a7-9cb3-fbb0d9ae31e6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:15.832987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f242c364-6864-42a7-9cb3-fbb0d9ae31e6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:15.841625 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f242c364-6864-42a7-9cb3-fbb0d9ae31e6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1690 microversion: 2.1 time: 0.169209 Sep 24 21:20:15.842212 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2845/5710] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:20:15 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:20:16.383982 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f45b4802-ccbe-4523-acd5-abfdb2e5f586 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:16.384712 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f45b4802-ccbe-4523-acd5-abfdb2e5f586 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:16.393321 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f45b4802-ccbe-4523-acd5-abfdb2e5f586 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:16.393862 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f45b4802-ccbe-4523-acd5-abfdb2e5f586 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:16.394276 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f45b4802-ccbe-4523-acd5-abfdb2e5f586 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:16.395029 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f45b4802-ccbe-4523-acd5-abfdb2e5f586 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:16.395494 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f45b4802-ccbe-4523-acd5-abfdb2e5f586 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:16.395930 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f45b4802-ccbe-4523-acd5-abfdb2e5f586 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:16.459632 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f45b4802-ccbe-4523-acd5-abfdb2e5f586 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:16.468648 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f45b4802-ccbe-4523-acd5-abfdb2e5f586 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:16.470109 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f45b4802-ccbe-4523-acd5-abfdb2e5f586 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:16.471305 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f45b4802-ccbe-4523-acd5-abfdb2e5f586 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.091788 Sep 24 21:20:16.471880 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2866/5711] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:16 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:16.873344 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-38b75350-22f2-444c-b0a4-a6fb777fb931 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:16.873972 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-38b75350-22f2-444c-b0a4-a6fb777fb931 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:16.881102 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-38b75350-22f2-444c-b0a4-a6fb777fb931 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:16.881594 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-38b75350-22f2-444c-b0a4-a6fb777fb931 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:16.882042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-38b75350-22f2-444c-b0a4-a6fb777fb931 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:16.882773 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-38b75350-22f2-444c-b0a4-a6fb777fb931 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:16.883242 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-38b75350-22f2-444c-b0a4-a6fb777fb931 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:16.883680 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-38b75350-22f2-444c-b0a4-a6fb777fb931 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:17.021599 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-38b75350-22f2-444c-b0a4-a6fb777fb931 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:17.029715 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-38b75350-22f2-444c-b0a4-a6fb777fb931 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1690 microversion: 2.1 time: 0.160877 Sep 24 21:20:17.030300 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2846/5712] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:20:16 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:20:17.354925 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-4faf786b-8916-43ec-bf3f-bf96d760dc91 req-d8fe1c6f-7430-4b7f-a940-273089c7ae80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73bcce00-d4a3-47fe-8c0b-7eafc582116b", "name": "network-vif-plugged", "status": "completed", "tag": "bb0c5eb0-6828-4897-8444-cf9e7648a777"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:20:17.364993 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-4faf786b-8916-43ec-bf3f-bf96d760dc91 req-d8fe1c6f-7430-4b7f-a940-273089c7ae80 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:17.365486 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-4faf786b-8916-43ec-bf3f-bf96d760dc91 req-d8fe1c6f-7430-4b7f-a940-273089c7ae80 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:17.366172 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-4faf786b-8916-43ec-bf3f-bf96d760dc91 req-d8fe1c6f-7430-4b7f-a940-273089c7ae80 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:17.380498 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-4faf786b-8916-43ec-bf3f-bf96d760dc91 req-d8fe1c6f-7430-4b7f-a940-273089c7ae80 service nova] Creating event network-vif-plugged:bb0c5eb0-6828-4897-8444-cf9e7648a777 for instance 73bcce00-d4a3-47fe-8c0b-7eafc582116b on nch2-master-1 Sep 24 21:20:17.387455 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [req-4faf786b-8916-43ec-bf3f-bf96d760dc91 req-d8fe1c6f-7430-4b7f-a940-273089c7ae80 service nova] Instance 73bcce00-d4a3-47fe-8c0b-7eafc582116b is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 21:20:17.399314 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-4faf786b-8916-43ec-bf3f-bf96d760dc91 req-d8fe1c6f-7430-4b7f-a940-273089c7ae80 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048924 Sep 24 21:20:17.399914 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2867/5713] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:20:17.497339 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e0197344-fd0b-4771-a850-2048d5845c53 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:17.497908 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e0197344-fd0b-4771-a850-2048d5845c53 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:17.504024 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e0197344-fd0b-4771-a850-2048d5845c53 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:17.504515 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e0197344-fd0b-4771-a850-2048d5845c53 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:17.504965 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e0197344-fd0b-4771-a850-2048d5845c53 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:17.505672 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e0197344-fd0b-4771-a850-2048d5845c53 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:17.506131 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e0197344-fd0b-4771-a850-2048d5845c53 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:17.506589 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e0197344-fd0b-4771-a850-2048d5845c53 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:17.569432 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e0197344-fd0b-4771-a850-2048d5845c53 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:17.578179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e0197344-fd0b-4771-a850-2048d5845c53 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:17.579694 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e0197344-fd0b-4771-a850-2048d5845c53 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:17.580846 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e0197344-fd0b-4771-a850-2048d5845c53 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.088431 Sep 24 21:20:17.581413 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2847/5714] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:17 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:18.054009 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-321a50b4-54d0-4e83-aaaa-7eddf41d4bda tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:18.054917 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-321a50b4-54d0-4e83-aaaa-7eddf41d4bda tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:18.062196 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-321a50b4-54d0-4e83-aaaa-7eddf41d4bda tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:18.062723 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-321a50b4-54d0-4e83-aaaa-7eddf41d4bda tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:18.063166 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-321a50b4-54d0-4e83-aaaa-7eddf41d4bda tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:18.063858 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-321a50b4-54d0-4e83-aaaa-7eddf41d4bda tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:18.064314 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-321a50b4-54d0-4e83-aaaa-7eddf41d4bda tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:18.064741 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-321a50b4-54d0-4e83-aaaa-7eddf41d4bda tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:18.208894 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-321a50b4-54d0-4e83-aaaa-7eddf41d4bda tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:18.217626 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-321a50b4-54d0-4e83-aaaa-7eddf41d4bda tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1690 microversion: 2.1 time: 0.168106 Sep 24 21:20:18.218215 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2868/5715] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:20:18 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:20:18.606334 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-783ed914-f5d7-4732-9f22-731f123a504b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:18.606990 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-783ed914-f5d7-4732-9f22-731f123a504b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:18.613788 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-783ed914-f5d7-4732-9f22-731f123a504b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:18.614276 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-783ed914-f5d7-4732-9f22-731f123a504b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:18.614746 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-783ed914-f5d7-4732-9f22-731f123a504b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:18.615453 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-783ed914-f5d7-4732-9f22-731f123a504b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:18.615913 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-783ed914-f5d7-4732-9f22-731f123a504b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:18.616514 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-783ed914-f5d7-4732-9f22-731f123a504b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:18.727299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-783ed914-f5d7-4732-9f22-731f123a504b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:18.737323 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-783ed914-f5d7-4732-9f22-731f123a504b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:18.738829 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-783ed914-f5d7-4732-9f22-731f123a504b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:18.740005 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-783ed914-f5d7-4732-9f22-731f123a504b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.138611 Sep 24 21:20:18.740588 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2848/5716] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:18 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:18.906821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-32f081f6-08f7-445a-8a9a-c0ded148e63c req-476e3cdb-c2ef-48ba-80d9-1ba6c5410f01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73bcce00-d4a3-47fe-8c0b-7eafc582116b", "name": "network-vif-unplugged", "status": "completed", "tag": "bb0c5eb0-6828-4897-8444-cf9e7648a777"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:20:18.917883 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-32f081f6-08f7-445a-8a9a-c0ded148e63c req-476e3cdb-c2ef-48ba-80d9-1ba6c5410f01 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:18.918449 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-32f081f6-08f7-445a-8a9a-c0ded148e63c req-476e3cdb-c2ef-48ba-80d9-1ba6c5410f01 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:18.918910 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-32f081f6-08f7-445a-8a9a-c0ded148e63c req-476e3cdb-c2ef-48ba-80d9-1ba6c5410f01 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:18.931421 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-32f081f6-08f7-445a-8a9a-c0ded148e63c req-476e3cdb-c2ef-48ba-80d9-1ba6c5410f01 service nova] Creating event network-vif-unplugged:bb0c5eb0-6828-4897-8444-cf9e7648a777 for instance 73bcce00-d4a3-47fe-8c0b-7eafc582116b on nch1-master-1 Sep 24 21:20:18.934670 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:20:18.938765 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [req-32f081f6-08f7-445a-8a9a-c0ded148e63c req-476e3cdb-c2ef-48ba-80d9-1ba6c5410f01 service nova] Instance 73bcce00-d4a3-47fe-8c0b-7eafc582116b is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 21:20:18.951472 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-32f081f6-08f7-445a-8a9a-c0ded148e63c req-476e3cdb-c2ef-48ba-80d9-1ba6c5410f01 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048887 Sep 24 21:20:18.952085 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2869/5717] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:20:19.241350 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-36b97e41-cd10-42d0-890c-2792e6ed870b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:19.241900 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-36b97e41-cd10-42d0-890c-2792e6ed870b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:19.248041 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36b97e41-cd10-42d0-890c-2792e6ed870b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:19.248539 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36b97e41-cd10-42d0-890c-2792e6ed870b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:19.248987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36b97e41-cd10-42d0-890c-2792e6ed870b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:19.249700 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36b97e41-cd10-42d0-890c-2792e6ed870b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:19.250167 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36b97e41-cd10-42d0-890c-2792e6ed870b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:19.250635 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36b97e41-cd10-42d0-890c-2792e6ed870b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:19.479500 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-36b97e41-cd10-42d0-890c-2792e6ed870b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:19.487862 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-36b97e41-cd10-42d0-890c-2792e6ed870b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1690 microversion: 2.1 time: 0.250528 Sep 24 21:20:19.488530 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2849/5718] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:20:19 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1690 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:20:19.768039 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bb4a81b6-bd28-4902-8143-d67011fa083e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:19.768673 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bb4a81b6-bd28-4902-8143-d67011fa083e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:19.777721 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb4a81b6-bd28-4902-8143-d67011fa083e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:19.778223 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb4a81b6-bd28-4902-8143-d67011fa083e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:19.778692 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb4a81b6-bd28-4902-8143-d67011fa083e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:19.779404 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb4a81b6-bd28-4902-8143-d67011fa083e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:19.779862 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb4a81b6-bd28-4902-8143-d67011fa083e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:19.780288 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb4a81b6-bd28-4902-8143-d67011fa083e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:19.852769 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bb4a81b6-bd28-4902-8143-d67011fa083e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:19.861772 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bb4a81b6-bd28-4902-8143-d67011fa083e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:19.863254 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bb4a81b6-bd28-4902-8143-d67011fa083e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:19.864416 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bb4a81b6-bd28-4902-8143-d67011fa083e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.102235 Sep 24 21:20:19.864982 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2870/5719] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:19 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:20.511299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6deef2c0-d32a-4a1f-931f-57fef5f79c3f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:20.511921 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6deef2c0-d32a-4a1f-931f-57fef5f79c3f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:20.518859 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6deef2c0-d32a-4a1f-931f-57fef5f79c3f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:20.519346 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6deef2c0-d32a-4a1f-931f-57fef5f79c3f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:20.519793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6deef2c0-d32a-4a1f-931f-57fef5f79c3f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:20.520496 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6deef2c0-d32a-4a1f-931f-57fef5f79c3f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:20.520956 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6deef2c0-d32a-4a1f-931f-57fef5f79c3f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:20.521390 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6deef2c0-d32a-4a1f-931f-57fef5f79c3f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:20.889507 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5d94ec1a-b91e-471a-bbce-635c33e43c3e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:20.890262 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5d94ec1a-b91e-471a-bbce-635c33e43c3e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:20.898239 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d94ec1a-b91e-471a-bbce-635c33e43c3e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:20.898780 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d94ec1a-b91e-471a-bbce-635c33e43c3e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:20.899231 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d94ec1a-b91e-471a-bbce-635c33e43c3e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:20.899955 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d94ec1a-b91e-471a-bbce-635c33e43c3e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:20.900428 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d94ec1a-b91e-471a-bbce-635c33e43c3e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:20.901569 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5d94ec1a-b91e-471a-bbce-635c33e43c3e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:20.976296 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5d94ec1a-b91e-471a-bbce-635c33e43c3e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:20.985262 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5d94ec1a-b91e-471a-bbce-635c33e43c3e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:20.986757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5d94ec1a-b91e-471a-bbce-635c33e43c3e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:20.987920 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5d94ec1a-b91e-471a-bbce-635c33e43c3e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.102532 Sep 24 21:20:20.988531 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2871/5720] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:20 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:20:20.992913 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-280d8a65-7bd4-460f-bcd7-7f19e92b4e45 req-9ea025f0-2c47-4308-8697-8c977e367bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73bcce00-d4a3-47fe-8c0b-7eafc582116b", "tag": "bb0c5eb0-6828-4897-8444-cf9e7648a777"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:20:21.003550 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-280d8a65-7bd4-460f-bcd7-7f19e92b4e45 req-9ea025f0-2c47-4308-8697-8c977e367bb6 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:21.004038 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-280d8a65-7bd4-460f-bcd7-7f19e92b4e45 req-9ea025f0-2c47-4308-8697-8c977e367bb6 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:21.004481 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-280d8a65-7bd4-460f-bcd7-7f19e92b4e45 req-9ea025f0-2c47-4308-8697-8c977e367bb6 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:21.015869 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6deef2c0-d32a-4a1f-931f-57fef5f79c3f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:21.017319 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-280d8a65-7bd4-460f-bcd7-7f19e92b4e45 req-9ea025f0-2c47-4308-8697-8c977e367bb6 service nova] Creating event network-changed:bb0c5eb0-6828-4897-8444-cf9e7648a777 for instance 73bcce00-d4a3-47fe-8c0b-7eafc582116b on nch1-master-1 Sep 24 21:20:21.023173 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [req-280d8a65-7bd4-460f-bcd7-7f19e92b4e45 req-9ea025f0-2c47-4308-8697-8c977e367bb6 service nova] Instance 73bcce00-d4a3-47fe-8c0b-7eafc582116b is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 21:20:21.024496 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6deef2c0-d32a-4a1f-931f-57fef5f79c3f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1690 microversion: 2.1 time: 0.517072 Sep 24 21:20:21.025086 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2850/5721] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:20:20 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1690 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:20:21.035115 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-280d8a65-7bd4-460f-bcd7-7f19e92b4e45 req-9ea025f0-2c47-4308-8697-8c977e367bb6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045362 Sep 24 21:20:21.035718 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2872/5722] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:20:22.013274 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5a593c29-57e7-4228-84b0-5ee30c578393 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:22.013877 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5a593c29-57e7-4228-84b0-5ee30c578393 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:22.020829 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5a593c29-57e7-4228-84b0-5ee30c578393 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:22.021319 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5a593c29-57e7-4228-84b0-5ee30c578393 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:22.021763 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5a593c29-57e7-4228-84b0-5ee30c578393 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:22.022819 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5a593c29-57e7-4228-84b0-5ee30c578393 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:22.023285 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5a593c29-57e7-4228-84b0-5ee30c578393 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:22.023719 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5a593c29-57e7-4228-84b0-5ee30c578393 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:22.048921 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-46f353bf-c6b4-46d0-b512-466afc49fcf9 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:22.049634 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-46f353bf-c6b4-46d0-b512-466afc49fcf9 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:22.058389 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46f353bf-c6b4-46d0-b512-466afc49fcf9 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:22.058389 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46f353bf-c6b4-46d0-b512-466afc49fcf9 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:22.058810 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46f353bf-c6b4-46d0-b512-466afc49fcf9 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:22.059218 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46f353bf-c6b4-46d0-b512-466afc49fcf9 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:22.059683 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46f353bf-c6b4-46d0-b512-466afc49fcf9 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:22.060126 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46f353bf-c6b4-46d0-b512-466afc49fcf9 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:22.091576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5a593c29-57e7-4228-84b0-5ee30c578393 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:22.100662 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5a593c29-57e7-4228-84b0-5ee30c578393 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:22.102170 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5a593c29-57e7-4228-84b0-5ee30c578393 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:22.103377 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5a593c29-57e7-4228-84b0-5ee30c578393 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.094116 Sep 24 21:20:22.104596 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2851/5723] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:22 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:22.202293 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-46f353bf-c6b4-46d0-b512-466afc49fcf9 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:22.210128 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-46f353bf-c6b4-46d0-b512-466afc49fcf9 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1690 microversion: 2.1 time: 0.165424 Sep 24 21:20:22.210739 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2873/5724] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:20:22 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:20:23.128470 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-74f3e31f-48ea-43ab-a167-6638c9f463ab tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:23.129082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-74f3e31f-48ea-43ab-a167-6638c9f463ab tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:23.136650 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-74f3e31f-48ea-43ab-a167-6638c9f463ab tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:23.137189 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-74f3e31f-48ea-43ab-a167-6638c9f463ab tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:23.137977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-74f3e31f-48ea-43ab-a167-6638c9f463ab tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:23.139045 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-74f3e31f-48ea-43ab-a167-6638c9f463ab tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:23.139538 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-74f3e31f-48ea-43ab-a167-6638c9f463ab tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:23.139970 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-74f3e31f-48ea-43ab-a167-6638c9f463ab tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:23.203865 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-74f3e31f-48ea-43ab-a167-6638c9f463ab tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:23.212504 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-74f3e31f-48ea-43ab-a167-6638c9f463ab tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:23.215049 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-74f3e31f-48ea-43ab-a167-6638c9f463ab tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:23.216224 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-74f3e31f-48ea-43ab-a167-6638c9f463ab tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.091879 Sep 24 21:20:23.216784 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2852/5725] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:23 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:23.236002 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8a4b5f79-7e22-4290-add4-b88c41103b50 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:23.236916 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8a4b5f79-7e22-4290-add4-b88c41103b50 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:23.243819 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8a4b5f79-7e22-4290-add4-b88c41103b50 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:23.244472 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8a4b5f79-7e22-4290-add4-b88c41103b50 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:23.244941 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8a4b5f79-7e22-4290-add4-b88c41103b50 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:23.245662 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8a4b5f79-7e22-4290-add4-b88c41103b50 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:23.246131 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8a4b5f79-7e22-4290-add4-b88c41103b50 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:23.246738 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8a4b5f79-7e22-4290-add4-b88c41103b50 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:23.389238 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8a4b5f79-7e22-4290-add4-b88c41103b50 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:23.397037 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8a4b5f79-7e22-4290-add4-b88c41103b50 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1683 microversion: 2.1 time: 0.165735 Sep 24 21:20:23.397887 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2874/5726] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:20:23 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:20:24.242290 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5ef67e84-e42c-4ca8-a031-f0fc16a7b952 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:24.242934 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5ef67e84-e42c-4ca8-a031-f0fc16a7b952 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:24.250718 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ef67e84-e42c-4ca8-a031-f0fc16a7b952 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:24.251204 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ef67e84-e42c-4ca8-a031-f0fc16a7b952 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:24.251646 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ef67e84-e42c-4ca8-a031-f0fc16a7b952 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:24.252341 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ef67e84-e42c-4ca8-a031-f0fc16a7b952 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:24.252799 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ef67e84-e42c-4ca8-a031-f0fc16a7b952 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:24.253226 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ef67e84-e42c-4ca8-a031-f0fc16a7b952 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:24.317551 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5ef67e84-e42c-4ca8-a031-f0fc16a7b952 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:24.326705 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5ef67e84-e42c-4ca8-a031-f0fc16a7b952 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:24.328159 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5ef67e84-e42c-4ca8-a031-f0fc16a7b952 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:24.329300 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5ef67e84-e42c-4ca8-a031-f0fc16a7b952 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.090957 Sep 24 21:20:24.329863 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2853/5727] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:24 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:24.618664 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-f20d56fd-11a6-4114-8a45-f1f82c4c2ddb req-4bc78ffc-7627-4136-86c5-1619552411d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73bcce00-d4a3-47fe-8c0b-7eafc582116b", "name": "network-vif-plugged", "status": "completed", "tag": "bb0c5eb0-6828-4897-8444-cf9e7648a777"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:20:24.627657 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=68 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:20:24.636616 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-f20d56fd-11a6-4114-8a45-f1f82c4c2ddb req-4bc78ffc-7627-4136-86c5-1619552411d6 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:24.637107 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-f20d56fd-11a6-4114-8a45-f1f82c4c2ddb req-4bc78ffc-7627-4136-86c5-1619552411d6 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:24.637539 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-f20d56fd-11a6-4114-8a45-f1f82c4c2ddb req-4bc78ffc-7627-4136-86c5-1619552411d6 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:24.649612 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-f20d56fd-11a6-4114-8a45-f1f82c4c2ddb req-4bc78ffc-7627-4136-86c5-1619552411d6 service nova] Creating event network-vif-plugged:bb0c5eb0-6828-4897-8444-cf9e7648a777 for instance 73bcce00-d4a3-47fe-8c0b-7eafc582116b on nch1-master-1 Sep 24 21:20:24.656232 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-f20d56fd-11a6-4114-8a45-f1f82c4c2ddb req-4bc78ffc-7627-4136-86c5-1619552411d6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040989 Sep 24 21:20:24.656838 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2875/5728] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:20:25.353271 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-34592d8a-031e-4938-9f98-e850536246cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:25.354558 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-34592d8a-031e-4938-9f98-e850536246cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:25.361809 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34592d8a-031e-4938-9f98-e850536246cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:25.362299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34592d8a-031e-4938-9f98-e850536246cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:25.362774 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34592d8a-031e-4938-9f98-e850536246cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:25.363520 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34592d8a-031e-4938-9f98-e850536246cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:25.363984 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34592d8a-031e-4938-9f98-e850536246cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:25.364421 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34592d8a-031e-4938-9f98-e850536246cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:25.430845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-34592d8a-031e-4938-9f98-e850536246cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:25.439778 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-34592d8a-031e-4938-9f98-e850536246cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:25.441248 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-34592d8a-031e-4938-9f98-e850536246cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:25.442408 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-34592d8a-031e-4938-9f98-e850536246cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.093199 Sep 24 21:20:25.443025 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2854/5729] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:25 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:26.468190 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d4b1960f-3657-4a5e-85e2-e481cbe19128 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:26.468816 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d4b1960f-3657-4a5e-85e2-e481cbe19128 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:26.476285 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d4b1960f-3657-4a5e-85e2-e481cbe19128 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:26.476773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d4b1960f-3657-4a5e-85e2-e481cbe19128 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:26.477209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d4b1960f-3657-4a5e-85e2-e481cbe19128 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:26.477901 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d4b1960f-3657-4a5e-85e2-e481cbe19128 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:26.478996 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d4b1960f-3657-4a5e-85e2-e481cbe19128 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:26.479448 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d4b1960f-3657-4a5e-85e2-e481cbe19128 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:26.542724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d4b1960f-3657-4a5e-85e2-e481cbe19128 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:26.551489 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d4b1960f-3657-4a5e-85e2-e481cbe19128 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:26.552937 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d4b1960f-3657-4a5e-85e2-e481cbe19128 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:26.554075 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d4b1960f-3657-4a5e-85e2-e481cbe19128 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.090297 Sep 24 21:20:26.554667 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2876/5730] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:26 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:27.578987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3d78204d-fafb-4122-8655-4afac4992729 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:27.579613 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3d78204d-fafb-4122-8655-4afac4992729 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:27.586711 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d78204d-fafb-4122-8655-4afac4992729 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:27.587202 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d78204d-fafb-4122-8655-4afac4992729 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:27.588199 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d78204d-fafb-4122-8655-4afac4992729 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:27.589174 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d78204d-fafb-4122-8655-4afac4992729 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:27.589563 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d78204d-fafb-4122-8655-4afac4992729 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:27.590035 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d78204d-fafb-4122-8655-4afac4992729 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:27.656249 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3d78204d-fafb-4122-8655-4afac4992729 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:27.665107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3d78204d-fafb-4122-8655-4afac4992729 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:27.667381 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3d78204d-fafb-4122-8655-4afac4992729 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:27.668559 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3d78204d-fafb-4122-8655-4afac4992729 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.093567 Sep 24 21:20:27.669112 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2855/5731] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:27 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:28.693207 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2ec6fbc2-f878-4810-9d63-c34315114696 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:28.693825 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2ec6fbc2-f878-4810-9d63-c34315114696 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:28.701420 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ec6fbc2-f878-4810-9d63-c34315114696 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:28.701903 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ec6fbc2-f878-4810-9d63-c34315114696 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:28.702349 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ec6fbc2-f878-4810-9d63-c34315114696 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:28.703149 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ec6fbc2-f878-4810-9d63-c34315114696 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:28.703555 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ec6fbc2-f878-4810-9d63-c34315114696 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:28.703982 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ec6fbc2-f878-4810-9d63-c34315114696 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:28.768531 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2ec6fbc2-f878-4810-9d63-c34315114696 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:28.778127 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2ec6fbc2-f878-4810-9d63-c34315114696 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:28.779648 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2ec6fbc2-f878-4810-9d63-c34315114696 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:28.780787 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2ec6fbc2-f878-4810-9d63-c34315114696 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.091539 Sep 24 21:20:28.781366 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2877/5732] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:28 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:29.812209 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-37deb877-dbc2-4dd1-8d47-c03368c958f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:29.812833 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-37deb877-dbc2-4dd1-8d47-c03368c958f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:29.819908 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-37deb877-dbc2-4dd1-8d47-c03368c958f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:29.820396 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-37deb877-dbc2-4dd1-8d47-c03368c958f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:29.820839 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-37deb877-dbc2-4dd1-8d47-c03368c958f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:29.821542 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-37deb877-dbc2-4dd1-8d47-c03368c958f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:29.822696 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-37deb877-dbc2-4dd1-8d47-c03368c958f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:29.823106 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-37deb877-dbc2-4dd1-8d47-c03368c958f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:29.827091 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=100 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:20:29.888492 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-37deb877-dbc2-4dd1-8d47-c03368c958f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:29.897536 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-37deb877-dbc2-4dd1-8d47-c03368c958f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:29.899035 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-37deb877-dbc2-4dd1-8d47-c03368c958f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:29.900290 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-37deb877-dbc2-4dd1-8d47-c03368c958f4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.091943 Sep 24 21:20:29.900960 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2856/5733] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:29 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:30.925600 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c4f5ab1c-632c-4b48-b5ee-36cc4b2da49d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:30.926222 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c4f5ab1c-632c-4b48-b5ee-36cc4b2da49d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:30.933176 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c4f5ab1c-632c-4b48-b5ee-36cc4b2da49d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:30.933657 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c4f5ab1c-632c-4b48-b5ee-36cc4b2da49d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:30.934095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c4f5ab1c-632c-4b48-b5ee-36cc4b2da49d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:30.934816 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c4f5ab1c-632c-4b48-b5ee-36cc4b2da49d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:30.935275 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c4f5ab1c-632c-4b48-b5ee-36cc4b2da49d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:30.935704 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c4f5ab1c-632c-4b48-b5ee-36cc4b2da49d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:30.997527 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c4f5ab1c-632c-4b48-b5ee-36cc4b2da49d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:31.006247 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c4f5ab1c-632c-4b48-b5ee-36cc4b2da49d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:31.007739 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c4f5ab1c-632c-4b48-b5ee-36cc4b2da49d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:31.008891 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c4f5ab1c-632c-4b48-b5ee-36cc4b2da49d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.087559 Sep 24 21:20:31.010049 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2878/5734] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:30 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:32.035662 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e90fa974-fc68-49e7-8c2d-b57d770b5ff2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:32.036277 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e90fa974-fc68-49e7-8c2d-b57d770b5ff2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:32.043987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e90fa974-fc68-49e7-8c2d-b57d770b5ff2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:32.044472 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e90fa974-fc68-49e7-8c2d-b57d770b5ff2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:32.044910 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e90fa974-fc68-49e7-8c2d-b57d770b5ff2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:32.045602 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e90fa974-fc68-49e7-8c2d-b57d770b5ff2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:32.046059 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e90fa974-fc68-49e7-8c2d-b57d770b5ff2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:32.046487 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e90fa974-fc68-49e7-8c2d-b57d770b5ff2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:32.111890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e90fa974-fc68-49e7-8c2d-b57d770b5ff2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:32.124116 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e90fa974-fc68-49e7-8c2d-b57d770b5ff2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:32.125626 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e90fa974-fc68-49e7-8c2d-b57d770b5ff2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:32.126828 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e90fa974-fc68-49e7-8c2d-b57d770b5ff2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.095109 Sep 24 21:20:32.127392 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2857/5735] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:32 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:20:33.151514 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-28ada7e9-3b2f-4aa6-98d5-3486ef50fc09 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:33.152140 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-28ada7e9-3b2f-4aa6-98d5-3486ef50fc09 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:33.159718 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-28ada7e9-3b2f-4aa6-98d5-3486ef50fc09 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:33.160200 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-28ada7e9-3b2f-4aa6-98d5-3486ef50fc09 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:33.160643 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-28ada7e9-3b2f-4aa6-98d5-3486ef50fc09 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:33.161611 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-28ada7e9-3b2f-4aa6-98d5-3486ef50fc09 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:33.162075 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-28ada7e9-3b2f-4aa6-98d5-3486ef50fc09 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:33.162520 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-28ada7e9-3b2f-4aa6-98d5-3486ef50fc09 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:33.224750 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-28ada7e9-3b2f-4aa6-98d5-3486ef50fc09 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:33.234074 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-28ada7e9-3b2f-4aa6-98d5-3486ef50fc09 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:33.235561 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-28ada7e9-3b2f-4aa6-98d5-3486ef50fc09 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:33.236706 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-28ada7e9-3b2f-4aa6-98d5-3486ef50fc09 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.089824 Sep 24 21:20:33.237264 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2879/5736] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:33 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:34.263053 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9ef6b1ed-8848-4f07-acbb-40bcfbb53ff5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:34.263684 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9ef6b1ed-8848-4f07-acbb-40bcfbb53ff5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:34.270703 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9ef6b1ed-8848-4f07-acbb-40bcfbb53ff5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:34.271199 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9ef6b1ed-8848-4f07-acbb-40bcfbb53ff5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:34.271676 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9ef6b1ed-8848-4f07-acbb-40bcfbb53ff5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:34.272668 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9ef6b1ed-8848-4f07-acbb-40bcfbb53ff5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:34.273132 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9ef6b1ed-8848-4f07-acbb-40bcfbb53ff5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:34.273573 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9ef6b1ed-8848-4f07-acbb-40bcfbb53ff5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:34.339290 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9ef6b1ed-8848-4f07-acbb-40bcfbb53ff5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:34.348023 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9ef6b1ed-8848-4f07-acbb-40bcfbb53ff5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:34.349495 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9ef6b1ed-8848-4f07-acbb-40bcfbb53ff5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:34.350694 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9ef6b1ed-8848-4f07-acbb-40bcfbb53ff5 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.092582 Sep 24 21:20:34.351266 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2858/5737] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:34 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:35.376244 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9ef9f8eb-8b40-4b10-a136-6bf4e75b18a7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:35.376865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9ef9f8eb-8b40-4b10-a136-6bf4e75b18a7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:35.383828 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ef9f8eb-8b40-4b10-a136-6bf4e75b18a7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:35.384374 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ef9f8eb-8b40-4b10-a136-6bf4e75b18a7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:35.384772 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ef9f8eb-8b40-4b10-a136-6bf4e75b18a7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:35.385484 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ef9f8eb-8b40-4b10-a136-6bf4e75b18a7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:35.385953 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ef9f8eb-8b40-4b10-a136-6bf4e75b18a7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:35.386393 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9ef9f8eb-8b40-4b10-a136-6bf4e75b18a7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:35.450824 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9ef9f8eb-8b40-4b10-a136-6bf4e75b18a7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:35.459553 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9ef9f8eb-8b40-4b10-a136-6bf4e75b18a7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:35.461023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9ef9f8eb-8b40-4b10-a136-6bf4e75b18a7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:35.462219 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9ef9f8eb-8b40-4b10-a136-6bf4e75b18a7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.089923 Sep 24 21:20:35.462866 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2880/5738] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:35 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:36.487864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0a609d0e-a0c9-4718-8dd8-ac7d1bdfc8e6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:36.488429 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0a609d0e-a0c9-4718-8dd8-ac7d1bdfc8e6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:36.495475 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0a609d0e-a0c9-4718-8dd8-ac7d1bdfc8e6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:36.495962 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0a609d0e-a0c9-4718-8dd8-ac7d1bdfc8e6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:36.496406 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0a609d0e-a0c9-4718-8dd8-ac7d1bdfc8e6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:36.497104 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0a609d0e-a0c9-4718-8dd8-ac7d1bdfc8e6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:36.497574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0a609d0e-a0c9-4718-8dd8-ac7d1bdfc8e6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:36.498008 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0a609d0e-a0c9-4718-8dd8-ac7d1bdfc8e6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:36.562371 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0a609d0e-a0c9-4718-8dd8-ac7d1bdfc8e6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:36.571153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0a609d0e-a0c9-4718-8dd8-ac7d1bdfc8e6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:36.572900 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0a609d0e-a0c9-4718-8dd8-ac7d1bdfc8e6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:36.574048 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0a609d0e-a0c9-4718-8dd8-ac7d1bdfc8e6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.090248 Sep 24 21:20:36.574646 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2859/5739] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:36 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:37.600797 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7b37638e-9775-4e43-8b30-07d571638330 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:37.601416 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7b37638e-9775-4e43-8b30-07d571638330 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:37.608980 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b37638e-9775-4e43-8b30-07d571638330 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:37.609493 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b37638e-9775-4e43-8b30-07d571638330 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:37.609921 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b37638e-9775-4e43-8b30-07d571638330 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:37.610747 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b37638e-9775-4e43-8b30-07d571638330 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:37.611195 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b37638e-9775-4e43-8b30-07d571638330 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:37.611628 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b37638e-9775-4e43-8b30-07d571638330 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:37.676216 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7b37638e-9775-4e43-8b30-07d571638330 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:37.685917 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7b37638e-9775-4e43-8b30-07d571638330 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:37.687413 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7b37638e-9775-4e43-8b30-07d571638330 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:37.688559 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7b37638e-9775-4e43-8b30-07d571638330 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.091738 Sep 24 21:20:37.689123 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2881/5740] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:37 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:38.714032 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e9b7f162-38b9-4197-875a-73d0d92ffdba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:38.714678 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e9b7f162-38b9-4197-875a-73d0d92ffdba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:38.717045 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=46 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:20:38.722548 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e9b7f162-38b9-4197-875a-73d0d92ffdba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:38.723046 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e9b7f162-38b9-4197-875a-73d0d92ffdba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:38.723492 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e9b7f162-38b9-4197-875a-73d0d92ffdba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:38.724201 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e9b7f162-38b9-4197-875a-73d0d92ffdba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:38.724661 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e9b7f162-38b9-4197-875a-73d0d92ffdba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:38.725093 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e9b7f162-38b9-4197-875a-73d0d92ffdba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:38.791153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e9b7f162-38b9-4197-875a-73d0d92ffdba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:38.799837 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e9b7f162-38b9-4197-875a-73d0d92ffdba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:38.801295 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e9b7f162-38b9-4197-875a-73d0d92ffdba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:38.802446 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e9b7f162-38b9-4197-875a-73d0d92ffdba tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.093174 Sep 24 21:20:38.803055 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2860/5741] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:38 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:39.827508 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9882ea44-042a-4464-8574-d9d18d684458 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:39.828135 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9882ea44-042a-4464-8574-d9d18d684458 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:39.835213 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9882ea44-042a-4464-8574-d9d18d684458 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:39.835708 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9882ea44-042a-4464-8574-d9d18d684458 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:39.836156 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9882ea44-042a-4464-8574-d9d18d684458 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:39.836860 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9882ea44-042a-4464-8574-d9d18d684458 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:39.838119 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9882ea44-042a-4464-8574-d9d18d684458 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:39.838591 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9882ea44-042a-4464-8574-d9d18d684458 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:39.900423 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9882ea44-042a-4464-8574-d9d18d684458 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:39.909366 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9882ea44-042a-4464-8574-d9d18d684458 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:39.910861 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9882ea44-042a-4464-8574-d9d18d684458 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:39.912026 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9882ea44-042a-4464-8574-d9d18d684458 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.088556 Sep 24 21:20:39.912598 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2882/5742] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:39 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:40.937588 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0e7a9ce4-c47a-431d-b935-34c433b068c6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:40.938111 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0e7a9ce4-c47a-431d-b935-34c433b068c6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:40.945088 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e7a9ce4-c47a-431d-b935-34c433b068c6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:40.945575 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e7a9ce4-c47a-431d-b935-34c433b068c6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:40.946019 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e7a9ce4-c47a-431d-b935-34c433b068c6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:40.946796 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e7a9ce4-c47a-431d-b935-34c433b068c6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:40.947290 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e7a9ce4-c47a-431d-b935-34c433b068c6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:40.947724 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e7a9ce4-c47a-431d-b935-34c433b068c6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:41.009602 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0e7a9ce4-c47a-431d-b935-34c433b068c6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:41.018292 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0e7a9ce4-c47a-431d-b935-34c433b068c6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:41.019778 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0e7a9ce4-c47a-431d-b935-34c433b068c6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:41.020926 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0e7a9ce4-c47a-431d-b935-34c433b068c6 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.087398 Sep 24 21:20:41.021495 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2861/5743] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:40 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:42.046068 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e9f2e6f2-c651-43aa-8636-c44f35ed5b2b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:42.046647 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e9f2e6f2-c651-43aa-8636-c44f35ed5b2b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:42.053282 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9f2e6f2-c651-43aa-8636-c44f35ed5b2b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:42.053767 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9f2e6f2-c651-43aa-8636-c44f35ed5b2b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:42.054208 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9f2e6f2-c651-43aa-8636-c44f35ed5b2b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:42.054933 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9f2e6f2-c651-43aa-8636-c44f35ed5b2b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:42.055422 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9f2e6f2-c651-43aa-8636-c44f35ed5b2b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:42.056473 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9f2e6f2-c651-43aa-8636-c44f35ed5b2b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:42.118695 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e9f2e6f2-c651-43aa-8636-c44f35ed5b2b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:42.128535 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e9f2e6f2-c651-43aa-8636-c44f35ed5b2b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:42.130023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e9f2e6f2-c651-43aa-8636-c44f35ed5b2b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:42.131188 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e9f2e6f2-c651-43aa-8636-c44f35ed5b2b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.089190 Sep 24 21:20:42.131772 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2883/5744] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:42 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:43.160521 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ed8922af-6c6a-48ca-b2c7-3b99868a1374 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:43.161130 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ed8922af-6c6a-48ca-b2c7-3b99868a1374 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:43.168211 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed8922af-6c6a-48ca-b2c7-3b99868a1374 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:43.168692 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed8922af-6c6a-48ca-b2c7-3b99868a1374 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:43.169138 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed8922af-6c6a-48ca-b2c7-3b99868a1374 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:43.169838 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed8922af-6c6a-48ca-b2c7-3b99868a1374 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:43.170372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed8922af-6c6a-48ca-b2c7-3b99868a1374 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:43.171119 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed8922af-6c6a-48ca-b2c7-3b99868a1374 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:43.237258 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ed8922af-6c6a-48ca-b2c7-3b99868a1374 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:43.247593 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ed8922af-6c6a-48ca-b2c7-3b99868a1374 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:43.249076 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ed8922af-6c6a-48ca-b2c7-3b99868a1374 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:43.250216 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ed8922af-6c6a-48ca-b2c7-3b99868a1374 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.097563 Sep 24 21:20:43.250823 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2862/5745] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:43 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:44.275954 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d1375053-bfcc-479a-a2c4-f9b8ba092c29 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:44.276572 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d1375053-bfcc-479a-a2c4-f9b8ba092c29 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:44.283546 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1375053-bfcc-479a-a2c4-f9b8ba092c29 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:44.284035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1375053-bfcc-479a-a2c4-f9b8ba092c29 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:44.284481 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1375053-bfcc-479a-a2c4-f9b8ba092c29 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:44.285184 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1375053-bfcc-479a-a2c4-f9b8ba092c29 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:44.285646 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1375053-bfcc-479a-a2c4-f9b8ba092c29 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:44.286078 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1375053-bfcc-479a-a2c4-f9b8ba092c29 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:44.349359 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d1375053-bfcc-479a-a2c4-f9b8ba092c29 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:44.358113 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d1375053-bfcc-479a-a2c4-f9b8ba092c29 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:44.359640 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d1375053-bfcc-479a-a2c4-f9b8ba092c29 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:44.360794 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d1375053-bfcc-479a-a2c4-f9b8ba092c29 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.089680 Sep 24 21:20:44.361368 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2884/5746] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:44 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:45.386604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d18dfbb7-6757-409c-8cfb-69c15b005c25 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:45.387218 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d18dfbb7-6757-409c-8cfb-69c15b005c25 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:45.395108 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d18dfbb7-6757-409c-8cfb-69c15b005c25 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:45.395586 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d18dfbb7-6757-409c-8cfb-69c15b005c25 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:45.396024 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d18dfbb7-6757-409c-8cfb-69c15b005c25 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:45.396746 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d18dfbb7-6757-409c-8cfb-69c15b005c25 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:45.397456 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d18dfbb7-6757-409c-8cfb-69c15b005c25 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:45.397885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d18dfbb7-6757-409c-8cfb-69c15b005c25 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:45.464320 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d18dfbb7-6757-409c-8cfb-69c15b005c25 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:45.473977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d18dfbb7-6757-409c-8cfb-69c15b005c25 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:45.475497 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d18dfbb7-6757-409c-8cfb-69c15b005c25 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:45.476665 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d18dfbb7-6757-409c-8cfb-69c15b005c25 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.094143 Sep 24 21:20:45.477479 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2863/5747] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:45 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:46.502139 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f7658e1f-789a-4afe-b5ca-63deabed4600 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:46.502703 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f7658e1f-789a-4afe-b5ca-63deabed4600 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:46.509687 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7658e1f-789a-4afe-b5ca-63deabed4600 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:46.510171 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7658e1f-789a-4afe-b5ca-63deabed4600 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:46.510637 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7658e1f-789a-4afe-b5ca-63deabed4600 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:46.511337 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7658e1f-789a-4afe-b5ca-63deabed4600 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:46.511791 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7658e1f-789a-4afe-b5ca-63deabed4600 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:46.512218 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7658e1f-789a-4afe-b5ca-63deabed4600 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:46.575838 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f7658e1f-789a-4afe-b5ca-63deabed4600 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:46.584696 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f7658e1f-789a-4afe-b5ca-63deabed4600 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:46.586147 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f7658e1f-789a-4afe-b5ca-63deabed4600 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:46.587325 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f7658e1f-789a-4afe-b5ca-63deabed4600 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.089424 Sep 24 21:20:46.587915 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2885/5748] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:46 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:47.612831 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cc03aaaf-bc68-4ebf-a973-545dbb1469cf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:47.613429 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cc03aaaf-bc68-4ebf-a973-545dbb1469cf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:47.620622 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cc03aaaf-bc68-4ebf-a973-545dbb1469cf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:47.621106 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cc03aaaf-bc68-4ebf-a973-545dbb1469cf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:47.621549 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cc03aaaf-bc68-4ebf-a973-545dbb1469cf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:47.622932 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cc03aaaf-bc68-4ebf-a973-545dbb1469cf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:47.623385 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cc03aaaf-bc68-4ebf-a973-545dbb1469cf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:47.623816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cc03aaaf-bc68-4ebf-a973-545dbb1469cf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:47.690767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cc03aaaf-bc68-4ebf-a973-545dbb1469cf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:47.699486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cc03aaaf-bc68-4ebf-a973-545dbb1469cf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:47.700967 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cc03aaaf-bc68-4ebf-a973-545dbb1469cf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:47.702107 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cc03aaaf-bc68-4ebf-a973-545dbb1469cf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.093308 Sep 24 21:20:47.702707 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2864/5749] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:47 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:48.727340 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-34f15f63-8ab9-40c4-93f3-e29ebb089f65 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:48.727970 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-34f15f63-8ab9-40c4-93f3-e29ebb089f65 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:48.735513 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-34f15f63-8ab9-40c4-93f3-e29ebb089f65 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:48.736013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-34f15f63-8ab9-40c4-93f3-e29ebb089f65 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:48.736465 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-34f15f63-8ab9-40c4-93f3-e29ebb089f65 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:48.737216 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-34f15f63-8ab9-40c4-93f3-e29ebb089f65 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:48.737683 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-34f15f63-8ab9-40c4-93f3-e29ebb089f65 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:48.738121 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-34f15f63-8ab9-40c4-93f3-e29ebb089f65 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:48.810879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-34f15f63-8ab9-40c4-93f3-e29ebb089f65 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:48.819603 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-34f15f63-8ab9-40c4-93f3-e29ebb089f65 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:48.821066 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-34f15f63-8ab9-40c4-93f3-e29ebb089f65 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:48.822234 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-34f15f63-8ab9-40c4-93f3-e29ebb089f65 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.098944 Sep 24 21:20:48.822839 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2886/5750] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:48 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:49.847187 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e6d54a97-975f-485f-8634-41529d19e422 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:49.847801 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e6d54a97-975f-485f-8634-41529d19e422 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:49.854730 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6d54a97-975f-485f-8634-41529d19e422 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:49.855217 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6d54a97-975f-485f-8634-41529d19e422 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:49.855658 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6d54a97-975f-485f-8634-41529d19e422 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:49.857411 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6d54a97-975f-485f-8634-41529d19e422 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:49.858092 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6d54a97-975f-485f-8634-41529d19e422 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:49.858555 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6d54a97-975f-485f-8634-41529d19e422 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:49.924824 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e6d54a97-975f-485f-8634-41529d19e422 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:49.933545 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e6d54a97-975f-485f-8634-41529d19e422 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:49.936097 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e6d54a97-975f-485f-8634-41529d19e422 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:49.937258 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e6d54a97-975f-485f-8634-41529d19e422 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.094002 Sep 24 21:20:49.937830 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2865/5751] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:49 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:50.962030 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-230d527f-85f4-493a-832c-680feaa05a4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:50.962722 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-230d527f-85f4-493a-832c-680feaa05a4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:50.970870 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-230d527f-85f4-493a-832c-680feaa05a4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:50.971364 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-230d527f-85f4-493a-832c-680feaa05a4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:50.971808 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-230d527f-85f4-493a-832c-680feaa05a4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:50.972518 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-230d527f-85f4-493a-832c-680feaa05a4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:50.972981 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-230d527f-85f4-493a-832c-680feaa05a4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:50.973415 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-230d527f-85f4-493a-832c-680feaa05a4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:50.977471 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=97 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:20:51.040038 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-230d527f-85f4-493a-832c-680feaa05a4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:51.048927 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-230d527f-85f4-493a-832c-680feaa05a4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:51.050382 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-230d527f-85f4-493a-832c-680feaa05a4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:51.051630 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-230d527f-85f4-493a-832c-680feaa05a4c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.093521 Sep 24 21:20:51.052205 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2887/5752] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:50 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:52.077758 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8131364b-1ae6-4188-a887-f1e183fa6dae tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:52.078414 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8131364b-1ae6-4188-a887-f1e183fa6dae tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:52.085641 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8131364b-1ae6-4188-a887-f1e183fa6dae tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:52.086151 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8131364b-1ae6-4188-a887-f1e183fa6dae tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:52.086625 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8131364b-1ae6-4188-a887-f1e183fa6dae tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:52.087321 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8131364b-1ae6-4188-a887-f1e183fa6dae tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:52.087774 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8131364b-1ae6-4188-a887-f1e183fa6dae tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:52.088199 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8131364b-1ae6-4188-a887-f1e183fa6dae tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:52.151236 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8131364b-1ae6-4188-a887-f1e183fa6dae tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:52.161905 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8131364b-1ae6-4188-a887-f1e183fa6dae tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:52.163835 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8131364b-1ae6-4188-a887-f1e183fa6dae tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:52.164992 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8131364b-1ae6-4188-a887-f1e183fa6dae tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.091730 Sep 24 21:20:52.165562 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2866/5753] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:52 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:53.190423 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-16b409f4-9ae0-4277-b4c7-4234e54cd09e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:53.191082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-16b409f4-9ae0-4277-b4c7-4234e54cd09e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:53.198179 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-16b409f4-9ae0-4277-b4c7-4234e54cd09e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:53.198694 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-16b409f4-9ae0-4277-b4c7-4234e54cd09e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:53.199157 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-16b409f4-9ae0-4277-b4c7-4234e54cd09e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:53.200385 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-16b409f4-9ae0-4277-b4c7-4234e54cd09e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:53.200854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-16b409f4-9ae0-4277-b4c7-4234e54cd09e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:53.201293 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-16b409f4-9ae0-4277-b4c7-4234e54cd09e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:53.263618 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-16b409f4-9ae0-4277-b4c7-4234e54cd09e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:53.272528 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-16b409f4-9ae0-4277-b4c7-4234e54cd09e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:53.273995 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-16b409f4-9ae0-4277-b4c7-4234e54cd09e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:53.275181 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-16b409f4-9ae0-4277-b4c7-4234e54cd09e tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.088786 Sep 24 21:20:53.275754 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2888/5754] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:53 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:54.300545 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ecd49545-4083-45aa-99a6-95f1b6d5c6c1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:54.301160 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ecd49545-4083-45aa-99a6-95f1b6d5c6c1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:54.308205 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ecd49545-4083-45aa-99a6-95f1b6d5c6c1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:54.308690 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ecd49545-4083-45aa-99a6-95f1b6d5c6c1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:54.309302 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ecd49545-4083-45aa-99a6-95f1b6d5c6c1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:54.310040 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ecd49545-4083-45aa-99a6-95f1b6d5c6c1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:54.310516 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ecd49545-4083-45aa-99a6-95f1b6d5c6c1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:54.310956 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ecd49545-4083-45aa-99a6-95f1b6d5c6c1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:54.372837 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ecd49545-4083-45aa-99a6-95f1b6d5c6c1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:54.381507 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ecd49545-4083-45aa-99a6-95f1b6d5c6c1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:54.382984 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ecd49545-4083-45aa-99a6-95f1b6d5c6c1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:54.384125 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ecd49545-4083-45aa-99a6-95f1b6d5c6c1 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.087650 Sep 24 21:20:54.384694 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2867/5755] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:54 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:55.411009 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1c4f4b7c-b58a-4797-b863-b81e47715262 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:55.411627 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1c4f4b7c-b58a-4797-b863-b81e47715262 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:55.414452 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=28 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:20:55.419854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1c4f4b7c-b58a-4797-b863-b81e47715262 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:55.420343 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1c4f4b7c-b58a-4797-b863-b81e47715262 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:55.420788 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1c4f4b7c-b58a-4797-b863-b81e47715262 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:55.421492 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1c4f4b7c-b58a-4797-b863-b81e47715262 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:55.421954 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1c4f4b7c-b58a-4797-b863-b81e47715262 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:55.422411 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1c4f4b7c-b58a-4797-b863-b81e47715262 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:55.490251 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1c4f4b7c-b58a-4797-b863-b81e47715262 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:55.500596 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1c4f4b7c-b58a-4797-b863-b81e47715262 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:55.502056 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1c4f4b7c-b58a-4797-b863-b81e47715262 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:55.503264 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1c4f4b7c-b58a-4797-b863-b81e47715262 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.096185 Sep 24 21:20:55.503837 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2889/5756] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:55 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:55.733542 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8f3978f7-6f40-4229-97dd-b204596b51e6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:20:55.735864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8f3978f7-6f40-4229-97dd-b204596b51e6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:55.742004 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8f3978f7-6f40-4229-97dd-b204596b51e6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:55.742487 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8f3978f7-6f40-4229-97dd-b204596b51e6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:55.742957 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8f3978f7-6f40-4229-97dd-b204596b51e6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:55.743649 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8f3978f7-6f40-4229-97dd-b204596b51e6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:55.744105 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8f3978f7-6f40-4229-97dd-b204596b51e6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:55.744531 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8f3978f7-6f40-4229-97dd-b204596b51e6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:55.803523 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8f3978f7-6f40-4229-97dd-b204596b51e6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "POST /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b/action" status: 200 len: 63013 microversion: 2.1 time: 0.179038 Sep 24 21:20:55.804489 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2868/5757] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:20:55 2022] POST /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b/action => generated 63013 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:20:56.529338 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4c26aee2-f5e6-4c3c-9169-65b090a92362 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:56.529872 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4c26aee2-f5e6-4c3c-9169-65b090a92362 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:56.536842 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4c26aee2-f5e6-4c3c-9169-65b090a92362 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:56.537328 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4c26aee2-f5e6-4c3c-9169-65b090a92362 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:56.537771 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4c26aee2-f5e6-4c3c-9169-65b090a92362 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:56.538535 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4c26aee2-f5e6-4c3c-9169-65b090a92362 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:56.539002 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4c26aee2-f5e6-4c3c-9169-65b090a92362 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:56.539436 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4c26aee2-f5e6-4c3c-9169-65b090a92362 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:56.604245 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4c26aee2-f5e6-4c3c-9169-65b090a92362 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:56.613813 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4c26aee2-f5e6-4c3c-9169-65b090a92362 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:56.615318 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4c26aee2-f5e6-4c3c-9169-65b090a92362 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:56.616466 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4c26aee2-f5e6-4c3c-9169-65b090a92362 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.091894 Sep 24 21:20:56.617043 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2890/5758] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:56 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:57.641992 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a5f0534a-4f2a-43a1-8594-8c10c591079d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:57.642739 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a5f0534a-4f2a-43a1-8594-8c10c591079d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:57.650613 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5f0534a-4f2a-43a1-8594-8c10c591079d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:57.651112 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5f0534a-4f2a-43a1-8594-8c10c591079d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:57.651560 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5f0534a-4f2a-43a1-8594-8c10c591079d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:57.652271 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5f0534a-4f2a-43a1-8594-8c10c591079d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:57.652741 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5f0534a-4f2a-43a1-8594-8c10c591079d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:57.653180 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5f0534a-4f2a-43a1-8594-8c10c591079d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:57.717779 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a5f0534a-4f2a-43a1-8594-8c10c591079d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:57.727655 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a5f0534a-4f2a-43a1-8594-8c10c591079d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:57.729125 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a5f0534a-4f2a-43a1-8594-8c10c591079d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:57.730437 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a5f0534a-4f2a-43a1-8594-8c10c591079d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.092789 Sep 24 21:20:57.731691 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2869/5759] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:57 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:58.756967 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-498f2f41-f700-4e5a-8a76-0795de07c892 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:58.757487 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-498f2f41-f700-4e5a-8a76-0795de07c892 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:58.765003 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-498f2f41-f700-4e5a-8a76-0795de07c892 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:58.765486 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-498f2f41-f700-4e5a-8a76-0795de07c892 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:58.765930 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-498f2f41-f700-4e5a-8a76-0795de07c892 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:58.766689 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-498f2f41-f700-4e5a-8a76-0795de07c892 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:58.767104 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-498f2f41-f700-4e5a-8a76-0795de07c892 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:58.767533 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-498f2f41-f700-4e5a-8a76-0795de07c892 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:58.830110 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-498f2f41-f700-4e5a-8a76-0795de07c892 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:58.838764 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-498f2f41-f700-4e5a-8a76-0795de07c892 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:58.840941 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-498f2f41-f700-4e5a-8a76-0795de07c892 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:58.842158 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-498f2f41-f700-4e5a-8a76-0795de07c892 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.089260 Sep 24 21:20:58.842753 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2891/5760] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:58 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:20:59.869195 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-483952b1-85f6-43fa-bd01-1608cf51c6ae tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:20:59.869825 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-483952b1-85f6-43fa-bd01-1608cf51c6ae tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:20:59.877495 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-483952b1-85f6-43fa-bd01-1608cf51c6ae tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:59.877988 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-483952b1-85f6-43fa-bd01-1608cf51c6ae tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:59.878433 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-483952b1-85f6-43fa-bd01-1608cf51c6ae tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:59.879199 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-483952b1-85f6-43fa-bd01-1608cf51c6ae tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:20:59.879668 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-483952b1-85f6-43fa-bd01-1608cf51c6ae tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:20:59.880134 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-483952b1-85f6-43fa-bd01-1608cf51c6ae tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:20:59.885097 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=82 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:20:59.946429 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-483952b1-85f6-43fa-bd01-1608cf51c6ae tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:59.955300 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-483952b1-85f6-43fa-bd01-1608cf51c6ae tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:59.956773 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-483952b1-85f6-43fa-bd01-1608cf51c6ae tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:20:59.957927 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-483952b1-85f6-43fa-bd01-1608cf51c6ae tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.092710 Sep 24 21:20:59.958531 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2870/5761] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:20:59 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:00.984336 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4d272a51-a0c3-4d4b-b31c-43fd6e9e5d6d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:00.984933 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4d272a51-a0c3-4d4b-b31c-43fd6e9e5d6d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:00.991833 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4d272a51-a0c3-4d4b-b31c-43fd6e9e5d6d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:00.992330 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4d272a51-a0c3-4d4b-b31c-43fd6e9e5d6d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:00.992776 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4d272a51-a0c3-4d4b-b31c-43fd6e9e5d6d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:00.993492 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4d272a51-a0c3-4d4b-b31c-43fd6e9e5d6d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:00.993955 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4d272a51-a0c3-4d4b-b31c-43fd6e9e5d6d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:00.994387 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4d272a51-a0c3-4d4b-b31c-43fd6e9e5d6d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:01.067813 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4d272a51-a0c3-4d4b-b31c-43fd6e9e5d6d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:01.079287 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4d272a51-a0c3-4d4b-b31c-43fd6e9e5d6d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:01.081356 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4d272a51-a0c3-4d4b-b31c-43fd6e9e5d6d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:01.083067 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4d272a51-a0c3-4d4b-b31c-43fd6e9e5d6d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.102891 Sep 24 21:21:01.084117 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2892/5762] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:00 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:02.115697 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cb57ec2a-fce7-439c-b486-f89a558270be tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:02.116327 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cb57ec2a-fce7-439c-b486-f89a558270be tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:02.124107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb57ec2a-fce7-439c-b486-f89a558270be tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:02.124591 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb57ec2a-fce7-439c-b486-f89a558270be tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:02.125035 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb57ec2a-fce7-439c-b486-f89a558270be tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:02.125735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb57ec2a-fce7-439c-b486-f89a558270be tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:02.126197 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb57ec2a-fce7-439c-b486-f89a558270be tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:02.126661 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb57ec2a-fce7-439c-b486-f89a558270be tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:02.191606 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cb57ec2a-fce7-439c-b486-f89a558270be tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:02.200502 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cb57ec2a-fce7-439c-b486-f89a558270be tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:02.201953 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cb57ec2a-fce7-439c-b486-f89a558270be tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:02.203130 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cb57ec2a-fce7-439c-b486-f89a558270be tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.091449 Sep 24 21:21:02.203700 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2871/5763] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:02 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:03.228322 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f6d5768e-b236-4102-94cc-f11e8a005367 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:03.228998 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f6d5768e-b236-4102-94cc-f11e8a005367 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:03.235886 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6d5768e-b236-4102-94cc-f11e8a005367 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:03.236374 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6d5768e-b236-4102-94cc-f11e8a005367 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:03.236817 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6d5768e-b236-4102-94cc-f11e8a005367 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:03.237521 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6d5768e-b236-4102-94cc-f11e8a005367 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:03.237979 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6d5768e-b236-4102-94cc-f11e8a005367 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:03.238413 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6d5768e-b236-4102-94cc-f11e8a005367 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:03.300937 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f6d5768e-b236-4102-94cc-f11e8a005367 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:03.310605 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f6d5768e-b236-4102-94cc-f11e8a005367 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:03.312077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f6d5768e-b236-4102-94cc-f11e8a005367 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:03.313261 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f6d5768e-b236-4102-94cc-f11e8a005367 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.088956 Sep 24 21:21:03.313864 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2893/5764] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:03 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:04.338704 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b00e2332-55e1-4d87-a09e-139b8d1326b0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:04.339323 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b00e2332-55e1-4d87-a09e-139b8d1326b0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:04.346950 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b00e2332-55e1-4d87-a09e-139b8d1326b0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:04.347433 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b00e2332-55e1-4d87-a09e-139b8d1326b0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:04.347870 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b00e2332-55e1-4d87-a09e-139b8d1326b0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:04.348567 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b00e2332-55e1-4d87-a09e-139b8d1326b0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:04.349026 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b00e2332-55e1-4d87-a09e-139b8d1326b0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:04.349452 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b00e2332-55e1-4d87-a09e-139b8d1326b0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:04.415271 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b00e2332-55e1-4d87-a09e-139b8d1326b0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:04.424288 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b00e2332-55e1-4d87-a09e-139b8d1326b0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:04.425738 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b00e2332-55e1-4d87-a09e-139b8d1326b0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:04.426910 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b00e2332-55e1-4d87-a09e-139b8d1326b0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.092198 Sep 24 21:21:04.427478 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2872/5765] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:04 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:05.451273 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d3c19045-6874-4e09-8d89-e921900e5ca2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:05.452083 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d3c19045-6874-4e09-8d89-e921900e5ca2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:05.459490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3c19045-6874-4e09-8d89-e921900e5ca2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:05.459989 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3c19045-6874-4e09-8d89-e921900e5ca2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:05.460466 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3c19045-6874-4e09-8d89-e921900e5ca2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:05.461145 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3c19045-6874-4e09-8d89-e921900e5ca2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:05.461636 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3c19045-6874-4e09-8d89-e921900e5ca2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:05.462038 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3c19045-6874-4e09-8d89-e921900e5ca2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:05.530844 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d3c19045-6874-4e09-8d89-e921900e5ca2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:05.539680 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d3c19045-6874-4e09-8d89-e921900e5ca2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:05.541150 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d3c19045-6874-4e09-8d89-e921900e5ca2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:05.542334 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d3c19045-6874-4e09-8d89-e921900e5ca2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.095167 Sep 24 21:21:05.543598 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2894/5766] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:05 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:06.568403 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5f1cd035-9072-4167-992e-2c921221ea09 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:06.568938 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5f1cd035-9072-4167-992e-2c921221ea09 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:06.576398 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f1cd035-9072-4167-992e-2c921221ea09 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:06.576881 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f1cd035-9072-4167-992e-2c921221ea09 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:06.577322 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f1cd035-9072-4167-992e-2c921221ea09 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:06.578017 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f1cd035-9072-4167-992e-2c921221ea09 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:06.578473 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f1cd035-9072-4167-992e-2c921221ea09 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:06.578921 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f1cd035-9072-4167-992e-2c921221ea09 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:06.644060 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5f1cd035-9072-4167-992e-2c921221ea09 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:06.653588 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5f1cd035-9072-4167-992e-2c921221ea09 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:06.655104 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5f1cd035-9072-4167-992e-2c921221ea09 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:06.656250 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5f1cd035-9072-4167-992e-2c921221ea09 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.091949 Sep 24 21:21:06.656814 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2873/5767] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:06 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:07.681250 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e05d6382-d6b5-494e-aca2-60fc40b4888d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:07.681882 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e05d6382-d6b5-494e-aca2-60fc40b4888d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:07.688810 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e05d6382-d6b5-494e-aca2-60fc40b4888d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:07.689302 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e05d6382-d6b5-494e-aca2-60fc40b4888d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:07.689750 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e05d6382-d6b5-494e-aca2-60fc40b4888d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:07.690487 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e05d6382-d6b5-494e-aca2-60fc40b4888d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:07.690974 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e05d6382-d6b5-494e-aca2-60fc40b4888d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:07.691413 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e05d6382-d6b5-494e-aca2-60fc40b4888d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:07.752852 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e05d6382-d6b5-494e-aca2-60fc40b4888d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:07.761581 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e05d6382-d6b5-494e-aca2-60fc40b4888d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:07.763170 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e05d6382-d6b5-494e-aca2-60fc40b4888d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:07.764538 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e05d6382-d6b5-494e-aca2-60fc40b4888d tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.087253 Sep 24 21:21:07.765118 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2895/5768] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:07 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:08.790984 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-644fafbd-66a5-4012-964f-c6dc3110e372 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:08.791586 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-644fafbd-66a5-4012-964f-c6dc3110e372 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:08.793977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=28 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:21:08.800079 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-644fafbd-66a5-4012-964f-c6dc3110e372 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:08.800576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-644fafbd-66a5-4012-964f-c6dc3110e372 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:08.801053 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-644fafbd-66a5-4012-964f-c6dc3110e372 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:08.801763 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-644fafbd-66a5-4012-964f-c6dc3110e372 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:08.802264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-644fafbd-66a5-4012-964f-c6dc3110e372 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:08.802742 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-644fafbd-66a5-4012-964f-c6dc3110e372 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:08.873173 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-644fafbd-66a5-4012-964f-c6dc3110e372 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:08.882208 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-644fafbd-66a5-4012-964f-c6dc3110e372 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:08.883711 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-644fafbd-66a5-4012-964f-c6dc3110e372 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:08.884933 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-644fafbd-66a5-4012-964f-c6dc3110e372 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.097997 Sep 24 21:21:08.885439 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2874/5769] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:08 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:09.912051 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3de9b8c6-69b9-4f82-adb8-28026fabe8b2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:09.912675 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3de9b8c6-69b9-4f82-adb8-28026fabe8b2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:09.920326 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3de9b8c6-69b9-4f82-adb8-28026fabe8b2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:09.920814 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3de9b8c6-69b9-4f82-adb8-28026fabe8b2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:09.921255 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3de9b8c6-69b9-4f82-adb8-28026fabe8b2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:09.921956 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3de9b8c6-69b9-4f82-adb8-28026fabe8b2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:09.922418 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3de9b8c6-69b9-4f82-adb8-28026fabe8b2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:09.922879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3de9b8c6-69b9-4f82-adb8-28026fabe8b2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:09.987120 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3de9b8c6-69b9-4f82-adb8-28026fabe8b2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:09.995837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3de9b8c6-69b9-4f82-adb8-28026fabe8b2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:09.997331 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3de9b8c6-69b9-4f82-adb8-28026fabe8b2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:09.998486 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3de9b8c6-69b9-4f82-adb8-28026fabe8b2 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.090450 Sep 24 21:21:09.999083 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2896/5770] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:09 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:11.024702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f27038b8-59f1-4219-93d0-cbe06900d559 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:11.025233 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f27038b8-59f1-4219-93d0-cbe06900d559 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:11.032175 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f27038b8-59f1-4219-93d0-cbe06900d559 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:11.032669 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f27038b8-59f1-4219-93d0-cbe06900d559 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:11.033126 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f27038b8-59f1-4219-93d0-cbe06900d559 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:11.033831 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f27038b8-59f1-4219-93d0-cbe06900d559 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:11.034295 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f27038b8-59f1-4219-93d0-cbe06900d559 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:11.034756 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f27038b8-59f1-4219-93d0-cbe06900d559 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:11.096054 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f27038b8-59f1-4219-93d0-cbe06900d559 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:11.104756 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f27038b8-59f1-4219-93d0-cbe06900d559 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:11.106765 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f27038b8-59f1-4219-93d0-cbe06900d559 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:11.108150 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f27038b8-59f1-4219-93d0-cbe06900d559 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.087805 Sep 24 21:21:11.108718 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2875/5771] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:11 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:12.133805 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e69dfd95-268f-491b-9dbb-e6a8de982771 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:12.134429 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e69dfd95-268f-491b-9dbb-e6a8de982771 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:12.141308 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e69dfd95-268f-491b-9dbb-e6a8de982771 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:12.141790 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e69dfd95-268f-491b-9dbb-e6a8de982771 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:12.142230 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e69dfd95-268f-491b-9dbb-e6a8de982771 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:12.142954 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e69dfd95-268f-491b-9dbb-e6a8de982771 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:12.143409 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e69dfd95-268f-491b-9dbb-e6a8de982771 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:12.143838 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e69dfd95-268f-491b-9dbb-e6a8de982771 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:12.205652 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e69dfd95-268f-491b-9dbb-e6a8de982771 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:12.214303 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e69dfd95-268f-491b-9dbb-e6a8de982771 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:12.216483 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e69dfd95-268f-491b-9dbb-e6a8de982771 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:12.217933 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e69dfd95-268f-491b-9dbb-e6a8de982771 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.088238 Sep 24 21:21:12.218520 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2897/5772] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:12 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:13.243212 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4fe2fedf-9b85-458a-b006-a5aa2aad7623 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:13.243845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4fe2fedf-9b85-458a-b006-a5aa2aad7623 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:13.251211 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4fe2fedf-9b85-458a-b006-a5aa2aad7623 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:13.251700 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4fe2fedf-9b85-458a-b006-a5aa2aad7623 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:13.252146 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4fe2fedf-9b85-458a-b006-a5aa2aad7623 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:13.252856 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4fe2fedf-9b85-458a-b006-a5aa2aad7623 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:13.253325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4fe2fedf-9b85-458a-b006-a5aa2aad7623 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:13.253765 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4fe2fedf-9b85-458a-b006-a5aa2aad7623 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:13.318438 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4fe2fedf-9b85-458a-b006-a5aa2aad7623 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:13.327926 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4fe2fedf-9b85-458a-b006-a5aa2aad7623 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:13.329402 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4fe2fedf-9b85-458a-b006-a5aa2aad7623 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:13.330584 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4fe2fedf-9b85-458a-b006-a5aa2aad7623 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.091340 Sep 24 21:21:13.331183 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2876/5773] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:13 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:14.357107 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-30c613b0-6352-4211-b7d2-ff7d9ae5b3bb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:14.357894 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-30c613b0-6352-4211-b7d2-ff7d9ae5b3bb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:14.364764 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30c613b0-6352-4211-b7d2-ff7d9ae5b3bb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:14.365247 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30c613b0-6352-4211-b7d2-ff7d9ae5b3bb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:14.365686 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30c613b0-6352-4211-b7d2-ff7d9ae5b3bb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:14.366379 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30c613b0-6352-4211-b7d2-ff7d9ae5b3bb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:14.366865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30c613b0-6352-4211-b7d2-ff7d9ae5b3bb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:14.367289 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30c613b0-6352-4211-b7d2-ff7d9ae5b3bb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:14.429264 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-30c613b0-6352-4211-b7d2-ff7d9ae5b3bb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:14.438356 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-30c613b0-6352-4211-b7d2-ff7d9ae5b3bb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:14.439829 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-30c613b0-6352-4211-b7d2-ff7d9ae5b3bb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:14.440966 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-30c613b0-6352-4211-b7d2-ff7d9ae5b3bb tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.088650 Sep 24 21:21:14.441529 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2898/5774] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:14 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:15.466543 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-971a988b-c2a5-4536-9460-54f6351493ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:15.467195 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-971a988b-c2a5-4536-9460-54f6351493ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:15.474168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-971a988b-c2a5-4536-9460-54f6351493ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:15.474690 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-971a988b-c2a5-4536-9460-54f6351493ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:15.475138 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-971a988b-c2a5-4536-9460-54f6351493ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:15.475848 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-971a988b-c2a5-4536-9460-54f6351493ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:15.476348 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-971a988b-c2a5-4536-9460-54f6351493ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:15.476752 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-971a988b-c2a5-4536-9460-54f6351493ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:15.542221 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-971a988b-c2a5-4536-9460-54f6351493ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:15.551405 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-971a988b-c2a5-4536-9460-54f6351493ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:15.552944 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-971a988b-c2a5-4536-9460-54f6351493ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:15.554106 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-971a988b-c2a5-4536-9460-54f6351493ee tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.092215 Sep 24 21:21:15.554704 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2877/5775] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:15 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:16.579690 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-06fda04a-45af-4b5c-be30-04c50b6c43b0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:16.580222 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-06fda04a-45af-4b5c-be30-04c50b6c43b0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:16.587136 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-06fda04a-45af-4b5c-be30-04c50b6c43b0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:16.587627 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-06fda04a-45af-4b5c-be30-04c50b6c43b0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:16.588068 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-06fda04a-45af-4b5c-be30-04c50b6c43b0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:16.588772 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-06fda04a-45af-4b5c-be30-04c50b6c43b0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:16.589229 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-06fda04a-45af-4b5c-be30-04c50b6c43b0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:16.589662 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-06fda04a-45af-4b5c-be30-04c50b6c43b0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:16.652944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-06fda04a-45af-4b5c-be30-04c50b6c43b0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:16.662688 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-06fda04a-45af-4b5c-be30-04c50b6c43b0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:16.664140 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-06fda04a-45af-4b5c-be30-04c50b6c43b0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:16.665292 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-06fda04a-45af-4b5c-be30-04c50b6c43b0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.090253 Sep 24 21:21:16.665860 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2899/5776] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:16 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:17.689770 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9bfc774f-25bf-45ac-b6ac-1935593f4dd8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:17.690387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9bfc774f-25bf-45ac-b6ac-1935593f4dd8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:17.697342 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9bfc774f-25bf-45ac-b6ac-1935593f4dd8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:17.697822 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9bfc774f-25bf-45ac-b6ac-1935593f4dd8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:17.698258 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9bfc774f-25bf-45ac-b6ac-1935593f4dd8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:17.698991 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9bfc774f-25bf-45ac-b6ac-1935593f4dd8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:17.699449 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9bfc774f-25bf-45ac-b6ac-1935593f4dd8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:17.699875 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9bfc774f-25bf-45ac-b6ac-1935593f4dd8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:17.765459 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9bfc774f-25bf-45ac-b6ac-1935593f4dd8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:17.774427 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9bfc774f-25bf-45ac-b6ac-1935593f4dd8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:17.775899 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9bfc774f-25bf-45ac-b6ac-1935593f4dd8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:17.777043 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9bfc774f-25bf-45ac-b6ac-1935593f4dd8 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.091778 Sep 24 21:21:17.777616 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2878/5777] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:17 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:18.636102 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7b5151a3-4d72-496f-84de-8c117a7043a1 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:18.636734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7b5151a3-4d72-496f-84de-8c117a7043a1 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:18.644105 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b5151a3-4d72-496f-84de-8c117a7043a1 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:18.644636 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b5151a3-4d72-496f-84de-8c117a7043a1 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:18.645084 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b5151a3-4d72-496f-84de-8c117a7043a1 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:18.645804 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b5151a3-4d72-496f-84de-8c117a7043a1 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:18.646560 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b5151a3-4d72-496f-84de-8c117a7043a1 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:18.647022 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b5151a3-4d72-496f-84de-8c117a7043a1 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:18.774191 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7b5151a3-4d72-496f-84de-8c117a7043a1 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1834 microversion: 2.1 time: 0.257039 Sep 24 21:21:18.774742 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2900/5778] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:21:18 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1834 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:21:18.802701 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-db21cd24-dff5-4a01-a48f-35de8eb5d4cf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:18.803272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-db21cd24-dff5-4a01-a48f-35de8eb5d4cf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:18.811459 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-db21cd24-dff5-4a01-a48f-35de8eb5d4cf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:18.811940 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-db21cd24-dff5-4a01-a48f-35de8eb5d4cf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:18.812390 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-db21cd24-dff5-4a01-a48f-35de8eb5d4cf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:18.813109 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-db21cd24-dff5-4a01-a48f-35de8eb5d4cf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:18.813571 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-db21cd24-dff5-4a01-a48f-35de8eb5d4cf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:18.814004 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-db21cd24-dff5-4a01-a48f-35de8eb5d4cf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:18.908104 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-db21cd24-dff5-4a01-a48f-35de8eb5d4cf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:18.917313 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-db21cd24-dff5-4a01-a48f-35de8eb5d4cf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:18.918981 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-db21cd24-dff5-4a01-a48f-35de8eb5d4cf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:18.920996 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-db21cd24-dff5-4a01-a48f-35de8eb5d4cf tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.122375 Sep 24 21:21:18.921576 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2879/5779] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:18 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:19.647634 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-802f7d58-b8d8-4732-8b79-37290b69a494 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:19.648124 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-802f7d58-b8d8-4732-8b79-37290b69a494 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:19.649320 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-08440bf6-34c1-4dd9-b4b6-4b03d6dca6d6 req-4509c7b3-fd8e-497e-b50e-8f3fb3316e22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73bcce00-d4a3-47fe-8c0b-7eafc582116b", "tag": "bb0c5eb0-6828-4897-8444-cf9e7648a777"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:21:19.656322 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-802f7d58-b8d8-4732-8b79-37290b69a494 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:19.656821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-802f7d58-b8d8-4732-8b79-37290b69a494 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:19.657468 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-802f7d58-b8d8-4732-8b79-37290b69a494 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:19.658186 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-802f7d58-b8d8-4732-8b79-37290b69a494 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:19.658696 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-802f7d58-b8d8-4732-8b79-37290b69a494 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:19.659133 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-802f7d58-b8d8-4732-8b79-37290b69a494 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:19.660463 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-08440bf6-34c1-4dd9-b4b6-4b03d6dca6d6 req-4509c7b3-fd8e-497e-b50e-8f3fb3316e22 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:19.661035 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-08440bf6-34c1-4dd9-b4b6-4b03d6dca6d6 req-4509c7b3-fd8e-497e-b50e-8f3fb3316e22 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:19.661538 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-08440bf6-34c1-4dd9-b4b6-4b03d6dca6d6 req-4509c7b3-fd8e-497e-b50e-8f3fb3316e22 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:19.674535 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-08440bf6-34c1-4dd9-b4b6-4b03d6dca6d6 req-4509c7b3-fd8e-497e-b50e-8f3fb3316e22 service nova] Creating event network-changed:bb0c5eb0-6828-4897-8444-cf9e7648a777 for instance 73bcce00-d4a3-47fe-8c0b-7eafc582116b on nch1-master-1 Sep 24 21:21:19.679799 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-08440bf6-34c1-4dd9-b4b6-4b03d6dca6d6 req-4509c7b3-fd8e-497e-b50e-8f3fb3316e22 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034384 Sep 24 21:21:19.680611 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2880/5780] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:21:19.686412 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-802f7d58-b8d8-4732-8b79-37290b69a494 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:21:19.775863 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-802f7d58-b8d8-4732-8b79-37290b69a494 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "DELETE /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 204 len: 0 microversion: 2.1 time: 0.131519 Sep 24 21:21:19.776380 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2901/5781] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:21:19 2022] DELETE /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:21:19.786250 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f8ac3c62-0ca4-4703-9660-b3a5302ed4ea tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:19.787075 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f8ac3c62-0ca4-4703-9660-b3a5302ed4ea tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:19.796498 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8ac3c62-0ca4-4703-9660-b3a5302ed4ea tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:19.797080 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8ac3c62-0ca4-4703-9660-b3a5302ed4ea tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:19.797530 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8ac3c62-0ca4-4703-9660-b3a5302ed4ea tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:19.798524 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8ac3c62-0ca4-4703-9660-b3a5302ed4ea tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:19.799012 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8ac3c62-0ca4-4703-9660-b3a5302ed4ea tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:19.799643 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8ac3c62-0ca4-4703-9660-b3a5302ed4ea tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:19.947254 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a1dfa503-9c8e-4a38-b868-55dca472ce52 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:19.948239 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a1dfa503-9c8e-4a38-b868-55dca472ce52 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:19.955651 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1dfa503-9c8e-4a38-b868-55dca472ce52 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:19.956150 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1dfa503-9c8e-4a38-b868-55dca472ce52 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:19.956737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1dfa503-9c8e-4a38-b868-55dca472ce52 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:19.957306 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1dfa503-9c8e-4a38-b868-55dca472ce52 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:19.957770 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1dfa503-9c8e-4a38-b868-55dca472ce52 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:19.958206 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1dfa503-9c8e-4a38-b868-55dca472ce52 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:19.960765 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f8ac3c62-0ca4-4703-9660-b3a5302ed4ea tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:19.961546 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:21:19.970663 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f8ac3c62-0ca4-4703-9660-b3a5302ed4ea tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1689 microversion: 2.1 time: 0.188656 Sep 24 21:21:19.971660 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2881/5782] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:21:19 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1689 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:21:20.032964 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a1dfa503-9c8e-4a38-b868-55dca472ce52 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:20.041746 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a1dfa503-9c8e-4a38-b868-55dca472ce52 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:20.043253 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a1dfa503-9c8e-4a38-b868-55dca472ce52 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:20.044423 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a1dfa503-9c8e-4a38-b868-55dca472ce52 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.101714 Sep 24 21:21:20.045070 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2902/5783] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:19 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:20.994575 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0495b544-2dbc-47a8-b10f-58016f3718de tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:20.995194 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0495b544-2dbc-47a8-b10f-58016f3718de tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:21.002198 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0495b544-2dbc-47a8-b10f-58016f3718de tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:21.002701 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0495b544-2dbc-47a8-b10f-58016f3718de tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:21.003347 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0495b544-2dbc-47a8-b10f-58016f3718de tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:21.004446 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0495b544-2dbc-47a8-b10f-58016f3718de tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:21.004576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0495b544-2dbc-47a8-b10f-58016f3718de tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:21.004915 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0495b544-2dbc-47a8-b10f-58016f3718de tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:21.071235 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fb3672d8-8b92-448e-997d-90efab6c0dea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:21.071897 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fb3672d8-8b92-448e-997d-90efab6c0dea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:21.079684 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb3672d8-8b92-448e-997d-90efab6c0dea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:21.080103 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb3672d8-8b92-448e-997d-90efab6c0dea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:21.080544 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb3672d8-8b92-448e-997d-90efab6c0dea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:21.081257 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb3672d8-8b92-448e-997d-90efab6c0dea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:21.081713 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb3672d8-8b92-448e-997d-90efab6c0dea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:21.082159 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb3672d8-8b92-448e-997d-90efab6c0dea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:21.178258 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fb3672d8-8b92-448e-997d-90efab6c0dea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:21.187333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fb3672d8-8b92-448e-997d-90efab6c0dea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:21.188786 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fb3672d8-8b92-448e-997d-90efab6c0dea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:21.189939 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fb3672d8-8b92-448e-997d-90efab6c0dea tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.123833 Sep 24 21:21:21.190524 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2903/5784] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:21 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:21:21.234879 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0495b544-2dbc-47a8-b10f-58016f3718de tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:21.242650 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0495b544-2dbc-47a8-b10f-58016f3718de tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1689 microversion: 2.1 time: 0.252064 Sep 24 21:21:21.243229 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2882/5785] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:21:20 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1689 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:21:21.797258 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-6511c44d-bb24-480d-867a-543eaebfeeb2 req-0d5f80fc-f96f-443a-a281-eb8288b8b177 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73bcce00-d4a3-47fe-8c0b-7eafc582116b", "name": "network-vif-deleted", "tag": "bb0c5eb0-6828-4897-8444-cf9e7648a777"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:21:21.809590 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6511c44d-bb24-480d-867a-543eaebfeeb2 req-0d5f80fc-f96f-443a-a281-eb8288b8b177 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:21.810990 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6511c44d-bb24-480d-867a-543eaebfeeb2 req-0d5f80fc-f96f-443a-a281-eb8288b8b177 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:21.811908 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6511c44d-bb24-480d-867a-543eaebfeeb2 req-0d5f80fc-f96f-443a-a281-eb8288b8b177 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:21.825416 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-6511c44d-bb24-480d-867a-543eaebfeeb2 req-0d5f80fc-f96f-443a-a281-eb8288b8b177 service nova] Creating event network-vif-deleted:bb0c5eb0-6828-4897-8444-cf9e7648a777 for instance 73bcce00-d4a3-47fe-8c0b-7eafc582116b on nch1-master-1 Sep 24 21:21:21.831820 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-6511c44d-bb24-480d-867a-543eaebfeeb2 req-0d5f80fc-f96f-443a-a281-eb8288b8b177 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038949 Sep 24 21:21:21.832433 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2904/5786] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:21:22.216731 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-206bd69f-a96d-40a2-9624-562741539626 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:22.217527 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-206bd69f-a96d-40a2-9624-562741539626 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:22.225044 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-206bd69f-a96d-40a2-9624-562741539626 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:22.225567 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-206bd69f-a96d-40a2-9624-562741539626 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:22.225919 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-206bd69f-a96d-40a2-9624-562741539626 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:22.226659 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-206bd69f-a96d-40a2-9624-562741539626 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:22.227299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-206bd69f-a96d-40a2-9624-562741539626 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:22.227824 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-206bd69f-a96d-40a2-9624-562741539626 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:22.267030 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-87c3dddd-371f-4a9f-b0fb-6a7ce16c1393 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:22.268496 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-87c3dddd-371f-4a9f-b0fb-6a7ce16c1393 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:22.275947 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-87c3dddd-371f-4a9f-b0fb-6a7ce16c1393 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:22.276530 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-87c3dddd-371f-4a9f-b0fb-6a7ce16c1393 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:22.277158 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-87c3dddd-371f-4a9f-b0fb-6a7ce16c1393 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:22.278082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-87c3dddd-371f-4a9f-b0fb-6a7ce16c1393 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:22.278606 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-87c3dddd-371f-4a9f-b0fb-6a7ce16c1393 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:22.279883 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-87c3dddd-371f-4a9f-b0fb-6a7ce16c1393 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:22.300591 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-206bd69f-a96d-40a2-9624-562741539626 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:22.311122 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-206bd69f-a96d-40a2-9624-562741539626 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:22.312751 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-206bd69f-a96d-40a2-9624-562741539626 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:22.314303 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-206bd69f-a96d-40a2-9624-562741539626 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.102019 Sep 24 21:21:22.315101 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2883/5787] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:22 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:22.315891 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-87c3dddd-371f-4a9f-b0fb-6a7ce16c1393 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:22.316401 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-87c3dddd-371f-4a9f-b0fb-6a7ce16c1393 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:22.316850 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-87c3dddd-371f-4a9f-b0fb-6a7ce16c1393 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:22.317318 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-87c3dddd-371f-4a9f-b0fb-6a7ce16c1393 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lazy-loading 'fault' on Instance uuid 73bcce00-d4a3-47fe-8c0b-7eafc582116b {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:21:22.362421 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-87c3dddd-371f-4a9f-b0fb-6a7ce16c1393 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:22.369587 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-87c3dddd-371f-4a9f-b0fb-6a7ce16c1393 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 200 len: 1356 microversion: 2.1 time: 0.107177 Sep 24 21:21:22.370299 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2905/5788] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:21:22 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 1356 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:21:23.340052 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-845c8e6a-e28d-4c72-add8-d0081f475af0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:23.340664 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-845c8e6a-e28d-4c72-add8-d0081f475af0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:23.347902 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-845c8e6a-e28d-4c72-add8-d0081f475af0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:23.348389 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-845c8e6a-e28d-4c72-add8-d0081f475af0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:23.348827 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-845c8e6a-e28d-4c72-add8-d0081f475af0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:23.349517 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-845c8e6a-e28d-4c72-add8-d0081f475af0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:23.349973 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-845c8e6a-e28d-4c72-add8-d0081f475af0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:23.350403 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-845c8e6a-e28d-4c72-add8-d0081f475af0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:23.392866 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-051c4e50-2eed-45a2-98d9-3b766d9488f7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:23.393513 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-051c4e50-2eed-45a2-98d9-3b766d9488f7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 73bcce00-d4a3-47fe-8c0b-7eafc582116b] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:23.400653 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-051c4e50-2eed-45a2-98d9-3b766d9488f7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:23.401151 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-051c4e50-2eed-45a2-98d9-3b766d9488f7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:23.401589 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-051c4e50-2eed-45a2-98d9-3b766d9488f7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:23.402292 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-051c4e50-2eed-45a2-98d9-3b766d9488f7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:23.402922 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-051c4e50-2eed-45a2-98d9-3b766d9488f7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:23.403357 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-051c4e50-2eed-45a2-98d9-3b766d9488f7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:23.415827 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-845c8e6a-e28d-4c72-add8-d0081f475af0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:23.417529 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-051c4e50-2eed-45a2-98d9-3b766d9488f7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] HTTP exception thrown: Instance 73bcce00-d4a3-47fe-8c0b-7eafc582116b could not be found. Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-051c4e50-2eed-45a2-98d9-3b766d9488f7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Request method failure captured: Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b HTTP/1.1 Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3OCLEGvCgXQkF150J8WxaJ6Egfirp5WYU549-Kd58eqlMFmsTZ5EPhwnMOzai9maVUW5D3Dnd0VpB4KutZpZm5Xvo1jNqQCDPx_Xyeb8QSTxhIJvz1mFjCjXsZ8t-QiX5KDB4ZcWr8p8qona_16KbypzpGW3AGYhC3XCYDXOZAEBUo Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: a5c4c9ce4cb946a9a381271ab15aee09 Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1280777913 Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5c4c9ce4cb946a9a381271ab15aee09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a5c4c9ce4cb946a9a381271ab15aee09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a5c4c9ce4cb946a9a381271ab15aee09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5c4c9ce4cb946a9a381271ab15aee09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1280777913 Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: a5c4c9ce4cb946a9a381271ab15aee09 Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1280777913 Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-TestNetworkAdvancedServerOps-1280777913-project Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 82c2160fcae947138ddd7b1b4df1e361 Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1280777913-project Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 73bcce00-d4a3-47fe-8c0b-7eafc582116b could not be found. Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '73bcce00-d4a3-47fe-8c0b-7eafc582116b'} Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73bcce00-d4a3-47fe-8c0b-7eafc582116b could not be found. Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73bcce00-d4a3-47fe-8c0b-7eafc582116b could not be found. Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:21:23.419883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:21:23.424257 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:21:23.424257 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:21:23.424257 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:21:23.424257 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:21:23.424257 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:21:23.424257 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:21:23.424257 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73bcce00-d4a3-47fe-8c0b-7eafc582116b could not be found. Sep 24 21:21:23.424257 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:21:23.424257 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-051c4e50-2eed-45a2-98d9-3b766d9488f7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Returning 404 to user: Instance 73bcce00-d4a3-47fe-8c0b-7eafc582116b could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:21:23.424257 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-051c4e50-2eed-45a2-98d9-3b766d9488f7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b" status: 404 len: 111 microversion: 2.1 time: 0.032281 Sep 24 21:21:23.424257 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2906/5789] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:21:23 2022] GET /compute/v2.1/servers/73bcce00-d4a3-47fe-8c0b-7eafc582116b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 21:21:23.426974 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-845c8e6a-e28d-4c72-add8-d0081f475af0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:23.428513 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-845c8e6a-e28d-4c72-add8-d0081f475af0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:23.429776 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-845c8e6a-e28d-4c72-add8-d0081f475af0 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.093637 Sep 24 21:21:23.430454 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2884/5790] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:23 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:24.455592 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d6e6c39a-2df1-4b38-81c6-41e87cb07e3f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:24.456216 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d6e6c39a-2df1-4b38-81c6-41e87cb07e3f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:24.464274 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6e6c39a-2df1-4b38-81c6-41e87cb07e3f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:24.464773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6e6c39a-2df1-4b38-81c6-41e87cb07e3f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:24.465278 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6e6c39a-2df1-4b38-81c6-41e87cb07e3f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:24.465992 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6e6c39a-2df1-4b38-81c6-41e87cb07e3f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:24.467142 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6e6c39a-2df1-4b38-81c6-41e87cb07e3f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:24.467588 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6e6c39a-2df1-4b38-81c6-41e87cb07e3f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:24.532789 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d6e6c39a-2df1-4b38-81c6-41e87cb07e3f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:24.541568 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d6e6c39a-2df1-4b38-81c6-41e87cb07e3f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:24.543067 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d6e6c39a-2df1-4b38-81c6-41e87cb07e3f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:24.544228 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d6e6c39a-2df1-4b38-81c6-41e87cb07e3f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.092579 Sep 24 21:21:24.544827 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2907/5791] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:24 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:21:25.569442 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b6d2e64a-3e71-40be-85d0-532428b62522 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:25.570288 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b6d2e64a-3e71-40be-85d0-532428b62522 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:25.578830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6d2e64a-3e71-40be-85d0-532428b62522 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:25.579336 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6d2e64a-3e71-40be-85d0-532428b62522 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:25.579784 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6d2e64a-3e71-40be-85d0-532428b62522 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:25.580513 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6d2e64a-3e71-40be-85d0-532428b62522 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:25.580969 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6d2e64a-3e71-40be-85d0-532428b62522 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:25.581407 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6d2e64a-3e71-40be-85d0-532428b62522 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:25.841994 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b6d2e64a-3e71-40be-85d0-532428b62522 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:25.857656 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b6d2e64a-3e71-40be-85d0-532428b62522 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:25.859328 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b6d2e64a-3e71-40be-85d0-532428b62522 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:25.860611 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b6d2e64a-3e71-40be-85d0-532428b62522 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.295224 Sep 24 21:21:25.861295 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2885/5792] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:25 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:26.886283 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d79f1062-b33b-45b8-bcfe-d7904807ef75 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:26.886973 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d79f1062-b33b-45b8-bcfe-d7904807ef75 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:26.890352 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:21:26.897086 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d79f1062-b33b-45b8-bcfe-d7904807ef75 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:26.897580 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d79f1062-b33b-45b8-bcfe-d7904807ef75 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:26.898024 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d79f1062-b33b-45b8-bcfe-d7904807ef75 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:26.898786 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d79f1062-b33b-45b8-bcfe-d7904807ef75 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:26.899245 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d79f1062-b33b-45b8-bcfe-d7904807ef75 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:26.899807 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d79f1062-b33b-45b8-bcfe-d7904807ef75 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:26.980947 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d79f1062-b33b-45b8-bcfe-d7904807ef75 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:26.990037 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d79f1062-b33b-45b8-bcfe-d7904807ef75 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:26.991611 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d79f1062-b33b-45b8-bcfe-d7904807ef75 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:26.992852 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d79f1062-b33b-45b8-bcfe-d7904807ef75 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.110543 Sep 24 21:21:26.998552 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2908/5793] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:26 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:27.122099 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3a1675a5-c14c-4258-afad-92c84b8219fd tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '.version_select at 0x7f4b1112c310>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:27.127742 ncdv-master-1 devstack@n-api.service[140516]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3a1675a5-c14c-4258-afad-92c84b8219fd tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [ab28656a-b422-4364-8e4b-d6e83536e59f] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 24 21:21:28.018039 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6aa50662-dd11-473c-9d3b-99c2f6b15db7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:28.018687 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6aa50662-dd11-473c-9d3b-99c2f6b15db7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:28.025826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6aa50662-dd11-473c-9d3b-99c2f6b15db7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:28.026316 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6aa50662-dd11-473c-9d3b-99c2f6b15db7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:28.026789 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6aa50662-dd11-473c-9d3b-99c2f6b15db7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:28.027496 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6aa50662-dd11-473c-9d3b-99c2f6b15db7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:28.027959 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6aa50662-dd11-473c-9d3b-99c2f6b15db7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:28.028393 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6aa50662-dd11-473c-9d3b-99c2f6b15db7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:28.089916 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6aa50662-dd11-473c-9d3b-99c2f6b15db7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:28.099272 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6aa50662-dd11-473c-9d3b-99c2f6b15db7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:28.100730 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6aa50662-dd11-473c-9d3b-99c2f6b15db7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:28.101880 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6aa50662-dd11-473c-9d3b-99c2f6b15db7 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.087830 Sep 24 21:21:28.102448 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2909/5794] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:28 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:28.137308 ncdv-master-1 devstack@n-api.service[140516]: INFO oslo.messaging._drivers.impl_rabbit [None req-3a1675a5-c14c-4258-afad-92c84b8219fd tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [ab28656a-b422-4364-8e4b-d6e83536e59f] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 50508. Sep 24 21:21:28.157819 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3a1675a5-c14c-4258-afad-92c84b8219fd tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1636737121" status: 202 len: 0 microversion: 2.1 time: 1.039680 Sep 24 21:21:28.158399 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2886/5795] 10.222.0.52 () {58 vars in 1284 bytes} [Sat Sep 24 21:21:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1636737121 => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:21:28.199639 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c8054a06-5472-458c-95b0-c8a5dcd82859 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Action: 'create', calling method: .version_select at 0x7f4b0cdcad30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1209747293", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQo+dJ/8PsbplDr69KgnMORZxDSVvecbDQoQGSgn+ZWJKN7R18DceXXVkFZoedjR2zYqjnMPo4KKBMe2qzC7LyVmf+PwoLpYKPELSwE6qGW2yLZwpFyMqtqSRVfWs9yKA=="}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:21:28.215698 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-c8054a06-5472-458c-95b0-c8a5dcd82859 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Getting quotas for project a5c4c9ce4cb946a9a381271ab15aee09. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:21:28.221835 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-c8054a06-5472-458c-95b0-c8a5dcd82859 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Getting quotas for user 82c2160fcae947138ddd7b1b4df1e361 and project a5c4c9ce4cb946a9a381271ab15aee09. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:21:28.237252 ncdv-master-1 devstack@n-api.service[140517]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c8054a06-5472-458c-95b0-c8a5dcd82859 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [de7b8b7b-54d6-4e53-b1ab-4e8ebdfe9f8a] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 24 21:21:29.127894 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d30cd1d5-7a9d-4b06-aa2c-9d31f2667e3b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:29.128516 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d30cd1d5-7a9d-4b06-aa2c-9d31f2667e3b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:29.135203 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d30cd1d5-7a9d-4b06-aa2c-9d31f2667e3b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:29.135688 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d30cd1d5-7a9d-4b06-aa2c-9d31f2667e3b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:29.136133 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d30cd1d5-7a9d-4b06-aa2c-9d31f2667e3b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:29.136834 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d30cd1d5-7a9d-4b06-aa2c-9d31f2667e3b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:29.137298 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d30cd1d5-7a9d-4b06-aa2c-9d31f2667e3b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:29.138405 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d30cd1d5-7a9d-4b06-aa2c-9d31f2667e3b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:29.199478 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d30cd1d5-7a9d-4b06-aa2c-9d31f2667e3b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:29.208895 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d30cd1d5-7a9d-4b06-aa2c-9d31f2667e3b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:29.210358 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d30cd1d5-7a9d-4b06-aa2c-9d31f2667e3b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:29.211537 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d30cd1d5-7a9d-4b06-aa2c-9d31f2667e3b tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.087814 Sep 24 21:21:29.212121 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2887/5796] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:29 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:21:29.244428 ncdv-master-1 devstack@n-api.service[140517]: INFO oslo.messaging._drivers.impl_rabbit [None req-c8054a06-5472-458c-95b0-c8a5dcd82859 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [de7b8b7b-54d6-4e53-b1ab-4e8ebdfe9f8a] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 50514. Sep 24 21:21:29.260069 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c8054a06-5472-458c-95b0-c8a5dcd82859 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.064296 Sep 24 21:21:29.260773 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2910/5797] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 21:21:28 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:21:30.235505 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-28981ff2-26f5-4846-919e-d2a1b486cd07 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:30.236137 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-28981ff2-26f5-4846-919e-d2a1b486cd07 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:30.243394 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28981ff2-26f5-4846-919e-d2a1b486cd07 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:30.243891 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28981ff2-26f5-4846-919e-d2a1b486cd07 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:30.244345 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28981ff2-26f5-4846-919e-d2a1b486cd07 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:30.245055 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28981ff2-26f5-4846-919e-d2a1b486cd07 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:30.245521 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28981ff2-26f5-4846-919e-d2a1b486cd07 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:30.245956 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28981ff2-26f5-4846-919e-d2a1b486cd07 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:30.250463 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=98 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:21:30.323095 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-28981ff2-26f5-4846-919e-d2a1b486cd07 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:30.332868 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-28981ff2-26f5-4846-919e-d2a1b486cd07 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:30.334356 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-28981ff2-26f5-4846-919e-d2a1b486cd07 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:30.335560 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-28981ff2-26f5-4846-919e-d2a1b486cd07 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.104073 Sep 24 21:21:30.336117 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2888/5798] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:30 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:31.363199 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-96002d96-b5e7-4e10-91d9-9e1a3fc44089 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:31.363828 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-96002d96-b5e7-4e10-91d9-9e1a3fc44089 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:31.370721 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96002d96-b5e7-4e10-91d9-9e1a3fc44089 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:31.371219 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96002d96-b5e7-4e10-91d9-9e1a3fc44089 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:31.371663 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96002d96-b5e7-4e10-91d9-9e1a3fc44089 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:31.372418 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96002d96-b5e7-4e10-91d9-9e1a3fc44089 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:31.372858 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96002d96-b5e7-4e10-91d9-9e1a3fc44089 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:31.373290 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96002d96-b5e7-4e10-91d9-9e1a3fc44089 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:31.455150 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-96002d96-b5e7-4e10-91d9-9e1a3fc44089 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:31.463876 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-96002d96-b5e7-4e10-91d9-9e1a3fc44089 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:31.465334 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-96002d96-b5e7-4e10-91d9-9e1a3fc44089 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:31.467210 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-96002d96-b5e7-4e10-91d9-9e1a3fc44089 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.109195 Sep 24 21:21:31.467782 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2911/5799] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:31 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:21:32.496202 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3bb139ad-fc28-40c8-9849-d9d3e09249bc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:32.498739 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3bb139ad-fc28-40c8-9849-d9d3e09249bc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:32.509447 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3bb139ad-fc28-40c8-9849-d9d3e09249bc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:32.510600 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3bb139ad-fc28-40c8-9849-d9d3e09249bc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:32.511224 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3bb139ad-fc28-40c8-9849-d9d3e09249bc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:32.512182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3bb139ad-fc28-40c8-9849-d9d3e09249bc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:32.512813 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3bb139ad-fc28-40c8-9849-d9d3e09249bc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:32.513498 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3bb139ad-fc28-40c8-9849-d9d3e09249bc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:32.666099 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3bb139ad-fc28-40c8-9849-d9d3e09249bc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:32.684565 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3bb139ad-fc28-40c8-9849-d9d3e09249bc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:32.686673 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3bb139ad-fc28-40c8-9849-d9d3e09249bc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:32.688859 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3bb139ad-fc28-40c8-9849-d9d3e09249bc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.200386 Sep 24 21:21:32.690158 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2889/5800] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:32 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:33.719212 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fb995f45-e463-40b7-a4bd-0c25838ee97f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:33.720544 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fb995f45-e463-40b7-a4bd-0c25838ee97f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:33.728878 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb995f45-e463-40b7-a4bd-0c25838ee97f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:33.729541 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb995f45-e463-40b7-a4bd-0c25838ee97f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:33.730001 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb995f45-e463-40b7-a4bd-0c25838ee97f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:33.730769 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb995f45-e463-40b7-a4bd-0c25838ee97f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:33.731239 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb995f45-e463-40b7-a4bd-0c25838ee97f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:33.731679 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb995f45-e463-40b7-a4bd-0c25838ee97f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:34.040275 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fb995f45-e463-40b7-a4bd-0c25838ee97f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:34.050786 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fb995f45-e463-40b7-a4bd-0c25838ee97f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:34.052302 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fb995f45-e463-40b7-a4bd-0c25838ee97f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:34.053505 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fb995f45-e463-40b7-a4bd-0c25838ee97f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.338900 Sep 24 21:21:34.058348 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2912/5801] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:33 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:34.971562 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-225810e7-4df7-4bc1-8935-5572aace8d7d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1677900510", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "709ccca3-72a3-4691-b2fe-20ce6b24d104"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1209747293", "security_groups": [{"name": "tempest-secgroup-smoke-1109821234"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:21:35.083300 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0f738497-2bcc-44d2-97f6-0ea862c4e40f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:35.083917 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0f738497-2bcc-44d2-97f6-0ea862c4e40f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:35.090031 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-225810e7-4df7-4bc1-8935-5572aace8d7d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] validate_networks() for [('709ccca3-72a3-4691-b2fe-20ce6b24d104', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:21:35.101112 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f738497-2bcc-44d2-97f6-0ea862c4e40f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:35.103009 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f738497-2bcc-44d2-97f6-0ea862c4e40f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:35.103667 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f738497-2bcc-44d2-97f6-0ea862c4e40f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:35.104618 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f738497-2bcc-44d2-97f6-0ea862c4e40f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:35.105279 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f738497-2bcc-44d2-97f6-0ea862c4e40f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:35.105942 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f738497-2bcc-44d2-97f6-0ea862c4e40f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:35.199842 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0f738497-2bcc-44d2-97f6-0ea862c4e40f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:35.214372 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0f738497-2bcc-44d2-97f6-0ea862c4e40f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:35.217105 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0f738497-2bcc-44d2-97f6-0ea862c4e40f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:35.218686 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0f738497-2bcc-44d2-97f6-0ea862c4e40f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.139518 Sep 24 21:21:35.219809 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2913/5802] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:35 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:21:35.539060 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-225810e7-4df7-4bc1-8935-5572aace8d7d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:21:35.539569 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-225810e7-4df7-4bc1-8935-5572aace8d7d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:21:35.540059 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-225810e7-4df7-4bc1-8935-5572aace8d7d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:21:35.540492 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-225810e7-4df7-4bc1-8935-5572aace8d7d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:21:35.540904 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-225810e7-4df7-4bc1-8935-5572aace8d7d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:21:35.551181 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-225810e7-4df7-4bc1-8935-5572aace8d7d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:35.551431 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-225810e7-4df7-4bc1-8935-5572aace8d7d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:35.551883 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-225810e7-4df7-4bc1-8935-5572aace8d7d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:35.552631 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-225810e7-4df7-4bc1-8935-5572aace8d7d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:35.553103 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-225810e7-4df7-4bc1-8935-5572aace8d7d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:35.553544 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-225810e7-4df7-4bc1-8935-5572aace8d7d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:35.571705 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-225810e7-4df7-4bc1-8935-5572aace8d7d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Getting quotas for project a5c4c9ce4cb946a9a381271ab15aee09. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:21:35.577133 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-225810e7-4df7-4bc1-8935-5572aace8d7d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Getting quotas for user 82c2160fcae947138ddd7b1b4df1e361 and project a5c4c9ce4cb946a9a381271ab15aee09. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:21:35.590727 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-225810e7-4df7-4bc1-8935-5572aace8d7d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:21:35.594085 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-225810e7-4df7-4bc1-8935-5572aace8d7d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 40731703-a782-4d3a-9557-4d896f056053] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:21:35.641237 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-225810e7-4df7-4bc1-8935-5572aace8d7d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.673682 Sep 24 21:21:35.642197 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2890/5803] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:21:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:21:35.653588 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-08fae55b-66ed-45bc-bb7f-5d908a8145d0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:35.655346 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-08fae55b-66ed-45bc-bb7f-5d908a8145d0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 40731703-a782-4d3a-9557-4d896f056053] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:35.731404 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-08fae55b-66ed-45bc-bb7f-5d908a8145d0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:35.742098 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-08fae55b-66ed-45bc-bb7f-5d908a8145d0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053" status: 200 len: 1267 microversion: 2.1 time: 0.092482 Sep 24 21:21:35.747504 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2914/5804] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:21:35 2022] GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053 => generated 1267 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:21:36.245354 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-26903053-c2d1-4e6d-8c48-e40bd5bfb86f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:36.246082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-26903053-c2d1-4e6d-8c48-e40bd5bfb86f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:36.254693 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26903053-c2d1-4e6d-8c48-e40bd5bfb86f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:36.255511 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26903053-c2d1-4e6d-8c48-e40bd5bfb86f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:36.255979 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26903053-c2d1-4e6d-8c48-e40bd5bfb86f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:36.261506 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26903053-c2d1-4e6d-8c48-e40bd5bfb86f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:36.262111 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26903053-c2d1-4e6d-8c48-e40bd5bfb86f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:36.262681 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26903053-c2d1-4e6d-8c48-e40bd5bfb86f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:36.330426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-26903053-c2d1-4e6d-8c48-e40bd5bfb86f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:36.340220 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-26903053-c2d1-4e6d-8c48-e40bd5bfb86f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:36.342334 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-26903053-c2d1-4e6d-8c48-e40bd5bfb86f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:36.343625 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-26903053-c2d1-4e6d-8c48-e40bd5bfb86f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.102424 Sep 24 21:21:36.344286 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2891/5805] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:36 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:36.765987 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-db557a39-5463-4a9b-88c8-0609abdabfce tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:36.766675 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-db557a39-5463-4a9b-88c8-0609abdabfce tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 40731703-a782-4d3a-9557-4d896f056053] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:36.820321 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-db557a39-5463-4a9b-88c8-0609abdabfce tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:36.828113 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-db557a39-5463-4a9b-88c8-0609abdabfce tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053" status: 200 len: 1267 microversion: 2.1 time: 0.066577 Sep 24 21:21:36.828695 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2915/5806] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:21:36 2022] GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053 => generated 1267 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:21:37.369362 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-23d3ce4b-d26b-44aa-bdb7-cc1304b65bae tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:37.371013 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-23d3ce4b-d26b-44aa-bdb7-cc1304b65bae tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:37.380009 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-23d3ce4b-d26b-44aa-bdb7-cc1304b65bae tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:37.380708 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-23d3ce4b-d26b-44aa-bdb7-cc1304b65bae tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:37.381148 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-23d3ce4b-d26b-44aa-bdb7-cc1304b65bae tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:37.381865 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-23d3ce4b-d26b-44aa-bdb7-cc1304b65bae tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:37.382327 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-23d3ce4b-d26b-44aa-bdb7-cc1304b65bae tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:37.382782 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-23d3ce4b-d26b-44aa-bdb7-cc1304b65bae tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:37.455760 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-23d3ce4b-d26b-44aa-bdb7-cc1304b65bae tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:37.465509 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-23d3ce4b-d26b-44aa-bdb7-cc1304b65bae tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:37.467974 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-23d3ce4b-d26b-44aa-bdb7-cc1304b65bae tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:37.469291 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-23d3ce4b-d26b-44aa-bdb7-cc1304b65bae tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.103936 Sep 24 21:21:37.469998 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2892/5807] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:37 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:37.851974 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a70f71a7-de09-4017-b4f3-bdd763b01d2c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:37.852613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a70f71a7-de09-4017-b4f3-bdd763b01d2c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 40731703-a782-4d3a-9557-4d896f056053] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:37.859893 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a70f71a7-de09-4017-b4f3-bdd763b01d2c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:37.860398 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a70f71a7-de09-4017-b4f3-bdd763b01d2c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:37.860851 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a70f71a7-de09-4017-b4f3-bdd763b01d2c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:37.861576 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a70f71a7-de09-4017-b4f3-bdd763b01d2c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:37.862045 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a70f71a7-de09-4017-b4f3-bdd763b01d2c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:37.862486 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a70f71a7-de09-4017-b4f3-bdd763b01d2c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:37.933138 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a70f71a7-de09-4017-b4f3-bdd763b01d2c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:37.942224 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a70f71a7-de09-4017-b4f3-bdd763b01d2c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053" status: 200 len: 1319 microversion: 2.1 time: 0.093912 Sep 24 21:21:37.943186 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2916/5808] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:21:37 2022] GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053 => generated 1319 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:21:38.494985 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-44098dc6-8030-4ed3-93fd-00097ac582cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:38.495514 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-44098dc6-8030-4ed3-93fd-00097ac582cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:38.503104 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-44098dc6-8030-4ed3-93fd-00097ac582cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:38.503598 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-44098dc6-8030-4ed3-93fd-00097ac582cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:38.504046 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-44098dc6-8030-4ed3-93fd-00097ac582cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:38.504775 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-44098dc6-8030-4ed3-93fd-00097ac582cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:38.505223 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-44098dc6-8030-4ed3-93fd-00097ac582cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:38.505661 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-44098dc6-8030-4ed3-93fd-00097ac582cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:38.580592 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-44098dc6-8030-4ed3-93fd-00097ac582cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:38.589371 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-44098dc6-8030-4ed3-93fd-00097ac582cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:38.590921 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-44098dc6-8030-4ed3-93fd-00097ac582cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:38.592658 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-44098dc6-8030-4ed3-93fd-00097ac582cc tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.101832 Sep 24 21:21:38.596047 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2893/5809] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:38 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:38.967990 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f6b28709-1a27-4e42-bef9-1aeda1cb0b3d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:38.968772 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f6b28709-1a27-4e42-bef9-1aeda1cb0b3d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 40731703-a782-4d3a-9557-4d896f056053] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:38.975704 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6b28709-1a27-4e42-bef9-1aeda1cb0b3d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:38.976201 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6b28709-1a27-4e42-bef9-1aeda1cb0b3d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:38.976648 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6b28709-1a27-4e42-bef9-1aeda1cb0b3d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:38.977366 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6b28709-1a27-4e42-bef9-1aeda1cb0b3d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:38.977826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6b28709-1a27-4e42-bef9-1aeda1cb0b3d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:38.978372 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f6b28709-1a27-4e42-bef9-1aeda1cb0b3d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:39.184537 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f6b28709-1a27-4e42-bef9-1aeda1cb0b3d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:39.192784 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f6b28709-1a27-4e42-bef9-1aeda1cb0b3d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053" status: 200 len: 1393 microversion: 2.1 time: 0.229357 Sep 24 21:21:39.193384 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2917/5810] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:21:38 2022] GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053 => generated 1393 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:21:39.511550 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-03a32286-fa04-4a9a-b592-2bf91c26a97c req-fbf93779-ef76-4683-a1d1-8788d9b1688f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40731703-a782-4d3a-9557-4d896f056053", "tag": "114e0634-5f58-457c-9b5d-f7ebe4eb9b30"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:21:39.518850 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:21:39.525517 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-03a32286-fa04-4a9a-b592-2bf91c26a97c req-fbf93779-ef76-4683-a1d1-8788d9b1688f service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:39.526328 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-03a32286-fa04-4a9a-b592-2bf91c26a97c req-fbf93779-ef76-4683-a1d1-8788d9b1688f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:39.526980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-03a32286-fa04-4a9a-b592-2bf91c26a97c req-fbf93779-ef76-4683-a1d1-8788d9b1688f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:39.542149 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-03a32286-fa04-4a9a-b592-2bf91c26a97c req-fbf93779-ef76-4683-a1d1-8788d9b1688f service nova] Creating event network-changed:114e0634-5f58-457c-9b5d-f7ebe4eb9b30 for instance 40731703-a782-4d3a-9557-4d896f056053 on nch1-master-1 Sep 24 21:21:39.548422 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-03a32286-fa04-4a9a-b592-2bf91c26a97c req-fbf93779-ef76-4683-a1d1-8788d9b1688f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042323 Sep 24 21:21:39.549533 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2894/5811] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:21:39.618791 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e79de1cc-dceb-4f03-8fd2-53453795592f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:39.619447 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e79de1cc-dceb-4f03-8fd2-53453795592f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:39.626247 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e79de1cc-dceb-4f03-8fd2-53453795592f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:39.626911 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e79de1cc-dceb-4f03-8fd2-53453795592f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:39.627351 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e79de1cc-dceb-4f03-8fd2-53453795592f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:39.628054 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e79de1cc-dceb-4f03-8fd2-53453795592f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:39.628509 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e79de1cc-dceb-4f03-8fd2-53453795592f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:39.629020 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e79de1cc-dceb-4f03-8fd2-53453795592f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:39.719720 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e79de1cc-dceb-4f03-8fd2-53453795592f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:39.728445 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e79de1cc-dceb-4f03-8fd2-53453795592f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:39.729893 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e79de1cc-dceb-4f03-8fd2-53453795592f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:39.731081 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e79de1cc-dceb-4f03-8fd2-53453795592f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.116339 Sep 24 21:21:39.732191 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2918/5812] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:39 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:40.218756 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2a5fc2ba-443d-409f-9d3d-efaad1a5ff37 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:40.219489 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2a5fc2ba-443d-409f-9d3d-efaad1a5ff37 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 40731703-a782-4d3a-9557-4d896f056053] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:40.225815 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2a5fc2ba-443d-409f-9d3d-efaad1a5ff37 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:40.226306 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2a5fc2ba-443d-409f-9d3d-efaad1a5ff37 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:40.226787 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2a5fc2ba-443d-409f-9d3d-efaad1a5ff37 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:40.227485 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2a5fc2ba-443d-409f-9d3d-efaad1a5ff37 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:40.227948 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2a5fc2ba-443d-409f-9d3d-efaad1a5ff37 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:40.228379 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2a5fc2ba-443d-409f-9d3d-efaad1a5ff37 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:40.361710 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2a5fc2ba-443d-409f-9d3d-efaad1a5ff37 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:40.369517 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2a5fc2ba-443d-409f-9d3d-efaad1a5ff37 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053" status: 200 len: 1393 microversion: 2.1 time: 0.155997 Sep 24 21:21:40.370099 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2895/5813] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:21:40 2022] GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053 => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:21:40.757131 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fffd27c8-4ce9-4d99-924b-96dac5022000 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:40.757750 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fffd27c8-4ce9-4d99-924b-96dac5022000 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:40.765380 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fffd27c8-4ce9-4d99-924b-96dac5022000 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:40.765920 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fffd27c8-4ce9-4d99-924b-96dac5022000 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:40.766349 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fffd27c8-4ce9-4d99-924b-96dac5022000 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:40.767087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fffd27c8-4ce9-4d99-924b-96dac5022000 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:40.767547 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fffd27c8-4ce9-4d99-924b-96dac5022000 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:40.767979 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fffd27c8-4ce9-4d99-924b-96dac5022000 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:40.834271 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fffd27c8-4ce9-4d99-924b-96dac5022000 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:40.842949 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fffd27c8-4ce9-4d99-924b-96dac5022000 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:40.844405 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fffd27c8-4ce9-4d99-924b-96dac5022000 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:40.845560 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fffd27c8-4ce9-4d99-924b-96dac5022000 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.092441 Sep 24 21:21:40.846294 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2919/5814] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:40 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:41.392220 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f40b1270-6734-4214-bec9-6394f89dce71 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:41.392839 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f40b1270-6734-4214-bec9-6394f89dce71 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 40731703-a782-4d3a-9557-4d896f056053] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:41.400062 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f40b1270-6734-4214-bec9-6394f89dce71 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:41.400549 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f40b1270-6734-4214-bec9-6394f89dce71 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:41.400990 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f40b1270-6734-4214-bec9-6394f89dce71 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:41.401722 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f40b1270-6734-4214-bec9-6394f89dce71 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:41.402186 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f40b1270-6734-4214-bec9-6394f89dce71 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:41.402642 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f40b1270-6734-4214-bec9-6394f89dce71 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:41.534692 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f40b1270-6734-4214-bec9-6394f89dce71 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:41.542373 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f40b1270-6734-4214-bec9-6394f89dce71 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053" status: 200 len: 1393 microversion: 2.1 time: 0.154220 Sep 24 21:21:41.542982 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2896/5815] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:21:41 2022] GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053 => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:21:41.870470 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6ff0f2e6-188e-4145-a457-eb3cf1d7c618 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:41.871144 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6ff0f2e6-188e-4145-a457-eb3cf1d7c618 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:41.877912 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ff0f2e6-188e-4145-a457-eb3cf1d7c618 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:41.878430 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ff0f2e6-188e-4145-a457-eb3cf1d7c618 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:41.878907 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ff0f2e6-188e-4145-a457-eb3cf1d7c618 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:41.879610 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ff0f2e6-188e-4145-a457-eb3cf1d7c618 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:41.880075 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ff0f2e6-188e-4145-a457-eb3cf1d7c618 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:41.880512 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ff0f2e6-188e-4145-a457-eb3cf1d7c618 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:41.943544 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6ff0f2e6-188e-4145-a457-eb3cf1d7c618 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:41.953115 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6ff0f2e6-188e-4145-a457-eb3cf1d7c618 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:41.954603 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6ff0f2e6-188e-4145-a457-eb3cf1d7c618 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:41.955753 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6ff0f2e6-188e-4145-a457-eb3cf1d7c618 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.089468 Sep 24 21:21:41.956316 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2920/5816] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:41 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:42.565921 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-067c8f8e-00fe-407a-8c37-c4e30b1df3d4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:42.566577 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-067c8f8e-00fe-407a-8c37-c4e30b1df3d4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 40731703-a782-4d3a-9557-4d896f056053] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:42.573480 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-067c8f8e-00fe-407a-8c37-c4e30b1df3d4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:42.573970 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-067c8f8e-00fe-407a-8c37-c4e30b1df3d4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:42.574416 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-067c8f8e-00fe-407a-8c37-c4e30b1df3d4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:42.575147 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-067c8f8e-00fe-407a-8c37-c4e30b1df3d4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:42.576164 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-067c8f8e-00fe-407a-8c37-c4e30b1df3d4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:42.576595 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-067c8f8e-00fe-407a-8c37-c4e30b1df3d4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:42.718746 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-067c8f8e-00fe-407a-8c37-c4e30b1df3d4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:42.726635 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-067c8f8e-00fe-407a-8c37-c4e30b1df3d4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053" status: 200 len: 1393 microversion: 2.1 time: 0.164633 Sep 24 21:21:42.727211 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2897/5817] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:21:42 2022] GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053 => generated 1393 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:21:42.981317 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-30536bd0-400f-4967-a9e1-7c1c6863051f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:42.982887 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-30536bd0-400f-4967-a9e1-7c1c6863051f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:42.989216 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30536bd0-400f-4967-a9e1-7c1c6863051f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:42.989705 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30536bd0-400f-4967-a9e1-7c1c6863051f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:42.990148 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30536bd0-400f-4967-a9e1-7c1c6863051f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:42.990878 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30536bd0-400f-4967-a9e1-7c1c6863051f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:42.991338 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30536bd0-400f-4967-a9e1-7c1c6863051f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:42.991769 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30536bd0-400f-4967-a9e1-7c1c6863051f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:43.053577 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-30536bd0-400f-4967-a9e1-7c1c6863051f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:43.063474 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-30536bd0-400f-4967-a9e1-7c1c6863051f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:43.064934 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-30536bd0-400f-4967-a9e1-7c1c6863051f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:43.066190 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-30536bd0-400f-4967-a9e1-7c1c6863051f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.088822 Sep 24 21:21:43.066799 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2921/5818] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:42 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:43.750599 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b04d30d7-ec0a-4f89-91de-518d2b3cf2c8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:43.751222 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b04d30d7-ec0a-4f89-91de-518d2b3cf2c8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 40731703-a782-4d3a-9557-4d896f056053] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:43.758222 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b04d30d7-ec0a-4f89-91de-518d2b3cf2c8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:43.758761 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b04d30d7-ec0a-4f89-91de-518d2b3cf2c8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:43.759210 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b04d30d7-ec0a-4f89-91de-518d2b3cf2c8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:43.759918 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b04d30d7-ec0a-4f89-91de-518d2b3cf2c8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:43.760387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b04d30d7-ec0a-4f89-91de-518d2b3cf2c8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:43.760826 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b04d30d7-ec0a-4f89-91de-518d2b3cf2c8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:43.890622 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b04d30d7-ec0a-4f89-91de-518d2b3cf2c8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:43.898729 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b04d30d7-ec0a-4f89-91de-518d2b3cf2c8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053" status: 200 len: 1393 microversion: 2.1 time: 0.152076 Sep 24 21:21:43.899305 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2898/5819] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:21:43 2022] GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053 => generated 1393 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:21:44.096853 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-26f0214c-e118-4609-a86b-74fa9a4d3383 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:44.097481 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-26f0214c-e118-4609-a86b-74fa9a4d3383 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:44.099977 ncdv-master-1 devstack@n-api.service[140517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 21:21:44.100128 ncdv-master-1 devstack@n-api.service[140517]: Sat Sep 24 21:21:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 (ip 10.222.0.52) !!! Sep 24 21:21:44.107953 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26f0214c-e118-4609-a86b-74fa9a4d3383 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:44.108450 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26f0214c-e118-4609-a86b-74fa9a4d3383 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:44.108899 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26f0214c-e118-4609-a86b-74fa9a4d3383 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:44.109611 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26f0214c-e118-4609-a86b-74fa9a4d3383 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:44.110080 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26f0214c-e118-4609-a86b-74fa9a4d3383 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:44.110540 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26f0214c-e118-4609-a86b-74fa9a4d3383 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:44.172326 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-26f0214c-e118-4609-a86b-74fa9a4d3383 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:44.174554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:21:44.182563 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-26f0214c-e118-4609-a86b-74fa9a4d3383 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:44.184034 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-26f0214c-e118-4609-a86b-74fa9a4d3383 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:44.185781 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-26f0214c-e118-4609-a86b-74fa9a4d3383 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.092914 Sep 24 21:21:44.186352 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2922/5820] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:44 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:44.922872 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-35c866ea-50ea-4f87-8062-62c974c2d412 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:44.923961 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-35c866ea-50ea-4f87-8062-62c974c2d412 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 40731703-a782-4d3a-9557-4d896f056053] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:44.930110 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-35c866ea-50ea-4f87-8062-62c974c2d412 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:44.930736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-35c866ea-50ea-4f87-8062-62c974c2d412 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:44.931184 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-35c866ea-50ea-4f87-8062-62c974c2d412 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:44.931900 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-35c866ea-50ea-4f87-8062-62c974c2d412 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:44.932812 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-35c866ea-50ea-4f87-8062-62c974c2d412 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:44.933015 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-35c866ea-50ea-4f87-8062-62c974c2d412 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:44.947963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-4bf23674-4419-42c7-849d-a5df86f1ff79 req-c781eccb-7697-4728-963f-ac854077c1f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40731703-a782-4d3a-9557-4d896f056053", "name": "network-vif-plugged", "status": "completed", "tag": "114e0634-5f58-457c-9b5d-f7ebe4eb9b30"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:21:44.958592 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-4bf23674-4419-42c7-849d-a5df86f1ff79 req-c781eccb-7697-4728-963f-ac854077c1f7 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:44.959075 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-4bf23674-4419-42c7-849d-a5df86f1ff79 req-c781eccb-7697-4728-963f-ac854077c1f7 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:44.959509 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-4bf23674-4419-42c7-849d-a5df86f1ff79 req-c781eccb-7697-4728-963f-ac854077c1f7 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:44.972289 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-4bf23674-4419-42c7-849d-a5df86f1ff79 req-c781eccb-7697-4728-963f-ac854077c1f7 service nova] Creating event network-vif-plugged:114e0634-5f58-457c-9b5d-f7ebe4eb9b30 for instance 40731703-a782-4d3a-9557-4d896f056053 on nch1-master-1 Sep 24 21:21:44.977338 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-4bf23674-4419-42c7-849d-a5df86f1ff79 req-c781eccb-7697-4728-963f-ac854077c1f7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101607 Sep 24 21:21:44.977942 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2899/5821] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:21:45.123950 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-35c866ea-50ea-4f87-8062-62c974c2d412 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:45.131792 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-35c866ea-50ea-4f87-8062-62c974c2d412 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053" status: 200 len: 1393 microversion: 2.1 time: 0.214360 Sep 24 21:21:45.132558 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2923/5822] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:21:44 2022] GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053 => generated 1393 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:21:45.212054 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-de0b2425-7b46-452e-a6d1-f29ae899d472 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:45.212790 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-de0b2425-7b46-452e-a6d1-f29ae899d472 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:45.219880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-de0b2425-7b46-452e-a6d1-f29ae899d472 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:45.220372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-de0b2425-7b46-452e-a6d1-f29ae899d472 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:45.220816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-de0b2425-7b46-452e-a6d1-f29ae899d472 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:45.221522 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-de0b2425-7b46-452e-a6d1-f29ae899d472 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:45.221981 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-de0b2425-7b46-452e-a6d1-f29ae899d472 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:45.222415 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-de0b2425-7b46-452e-a6d1-f29ae899d472 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:45.288993 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-de0b2425-7b46-452e-a6d1-f29ae899d472 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:45.297739 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-de0b2425-7b46-452e-a6d1-f29ae899d472 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:45.299236 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-de0b2425-7b46-452e-a6d1-f29ae899d472 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:45.300387 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-de0b2425-7b46-452e-a6d1-f29ae899d472 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.092680 Sep 24 21:21:45.300951 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2900/5823] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:45 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:46.156816 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ef977fad-7f62-4f8c-b9c9-db8261a29d84 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:46.157442 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ef977fad-7f62-4f8c-b9c9-db8261a29d84 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 40731703-a782-4d3a-9557-4d896f056053] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:46.164383 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef977fad-7f62-4f8c-b9c9-db8261a29d84 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:46.164879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef977fad-7f62-4f8c-b9c9-db8261a29d84 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:46.165324 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef977fad-7f62-4f8c-b9c9-db8261a29d84 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:46.166040 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef977fad-7f62-4f8c-b9c9-db8261a29d84 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:46.166529 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef977fad-7f62-4f8c-b9c9-db8261a29d84 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:46.166969 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef977fad-7f62-4f8c-b9c9-db8261a29d84 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:46.303010 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ef977fad-7f62-4f8c-b9c9-db8261a29d84 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:46.311103 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ef977fad-7f62-4f8c-b9c9-db8261a29d84 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053" status: 200 len: 1393 microversion: 2.1 time: 0.158866 Sep 24 21:21:46.311696 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2924/5824] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:21:46 2022] GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:21:46.325188 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-65017e57-5f79-4628-8200-f5647dc8bce9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:46.325896 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-65017e57-5f79-4628-8200-f5647dc8bce9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 54ec06be-cb4b-4b5f-9ed8-904a328cc118] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:46.327864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:21:46.328554 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:21:46.335325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65017e57-5f79-4628-8200-f5647dc8bce9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:46.335817 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65017e57-5f79-4628-8200-f5647dc8bce9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:46.336262 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65017e57-5f79-4628-8200-f5647dc8bce9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:46.336970 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65017e57-5f79-4628-8200-f5647dc8bce9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:46.337443 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65017e57-5f79-4628-8200-f5647dc8bce9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:46.337881 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65017e57-5f79-4628-8200-f5647dc8bce9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:46.400931 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-65017e57-5f79-4628-8200-f5647dc8bce9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:46.410511 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-65017e57-5f79-4628-8200-f5647dc8bce9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:46.411918 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-65017e57-5f79-4628-8200-f5647dc8bce9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:46.413083 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-65017e57-5f79-4628-8200-f5647dc8bce9 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118" status: 200 len: 1446 microversion: 2.25 time: 0.091837 Sep 24 21:21:46.413662 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2901/5825] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:46 2022] GET /compute/v2.1/servers/54ec06be-cb4b-4b5f-9ed8-904a328cc118 => generated 1446 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:21:46.437710 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6268c3bb-4e0c-4ad3-9194-b45a38f81913 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '.version_select at 0x7f4b11035040>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:46.457525 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6268c3bb-4e0c-4ad3-9194-b45a38f81913 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-687707201" status: 204 len: 0 microversion: 2.25 time: 0.023929 Sep 24 21:21:46.458096 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2925/5826] 10.222.0.52 () {60 vars in 1259 bytes} [Sat Sep 24 21:21:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-687707201 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 24 21:21:47.073705 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5d097277-c37b-48a5-9e17-f81004fa94a4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:47.074215 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5d097277-c37b-48a5-9e17-f81004fa94a4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:47.081155 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d097277-c37b-48a5-9e17-f81004fa94a4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:47.081779 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d097277-c37b-48a5-9e17-f81004fa94a4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:47.082476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d097277-c37b-48a5-9e17-f81004fa94a4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:47.083218 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d097277-c37b-48a5-9e17-f81004fa94a4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:47.083685 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d097277-c37b-48a5-9e17-f81004fa94a4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:47.084122 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5d097277-c37b-48a5-9e17-f81004fa94a4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:47.109515 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5d097277-c37b-48a5-9e17-f81004fa94a4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:21:47.184905 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5d097277-c37b-48a5-9e17-f81004fa94a4 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "DELETE /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 204 len: 0 microversion: 2.25 time: 0.114327 Sep 24 21:21:47.185779 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2902/5827] 10.222.0.52 () {60 vars in 1280 bytes} [Sat Sep 24 21:21:47 2022] DELETE /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 24 21:21:47.190970 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=8 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:21:47.195915 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6d49ff46-8853-4b98-a33c-386d0ccbac87 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:47.196540 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6d49ff46-8853-4b98-a33c-386d0ccbac87 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:47.204173 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6d49ff46-8853-4b98-a33c-386d0ccbac87 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:47.204671 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6d49ff46-8853-4b98-a33c-386d0ccbac87 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:47.205121 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6d49ff46-8853-4b98-a33c-386d0ccbac87 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:47.205829 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6d49ff46-8853-4b98-a33c-386d0ccbac87 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:47.206298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6d49ff46-8853-4b98-a33c-386d0ccbac87 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:47.206767 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6d49ff46-8853-4b98-a33c-386d0ccbac87 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:47.333941 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ca9c89f0-0180-412f-b69b-58198090aa81 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:47.334682 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ca9c89f0-0180-412f-b69b-58198090aa81 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 40731703-a782-4d3a-9557-4d896f056053] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:47.341959 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ca9c89f0-0180-412f-b69b-58198090aa81 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:47.342449 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ca9c89f0-0180-412f-b69b-58198090aa81 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:47.342925 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ca9c89f0-0180-412f-b69b-58198090aa81 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:47.343645 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ca9c89f0-0180-412f-b69b-58198090aa81 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:47.344391 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ca9c89f0-0180-412f-b69b-58198090aa81 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:47.345287 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ca9c89f0-0180-412f-b69b-58198090aa81 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:47.354122 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6d49ff46-8853-4b98-a33c-386d0ccbac87 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:47.363861 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6d49ff46-8853-4b98-a33c-386d0ccbac87 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:47.365711 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6d49ff46-8853-4b98-a33c-386d0ccbac87 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:47.367115 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6d49ff46-8853-4b98-a33c-386d0ccbac87 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1550 microversion: 2.25 time: 0.177009 Sep 24 21:21:47.382859 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2926/5828] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:47 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1550 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:47.500189 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ca9c89f0-0180-412f-b69b-58198090aa81 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:47.508117 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ca9c89f0-0180-412f-b69b-58198090aa81 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053" status: 200 len: 1564 microversion: 2.1 time: 0.178564 Sep 24 21:21:47.508694 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2903/5829] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:21:47 2022] GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053 => generated 1564 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:21:47.530527 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-33554f5a-b2a6-47f3-bf1c-271ac8dac68b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:47.531080 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-33554f5a-b2a6-47f3-bf1c-271ac8dac68b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 40731703-a782-4d3a-9557-4d896f056053] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:47.537491 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33554f5a-b2a6-47f3-bf1c-271ac8dac68b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:47.537988 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33554f5a-b2a6-47f3-bf1c-271ac8dac68b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:47.538430 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33554f5a-b2a6-47f3-bf1c-271ac8dac68b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:47.539161 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33554f5a-b2a6-47f3-bf1c-271ac8dac68b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:47.539628 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33554f5a-b2a6-47f3-bf1c-271ac8dac68b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:47.540062 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33554f5a-b2a6-47f3-bf1c-271ac8dac68b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:47.675931 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-33554f5a-b2a6-47f3-bf1c-271ac8dac68b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:47.684010 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-33554f5a-b2a6-47f3-bf1c-271ac8dac68b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053" status: 200 len: 1564 microversion: 2.1 time: 0.157412 Sep 24 21:21:47.684656 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2927/5830] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:21:47 2022] GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053 => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:21:48.290300 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-1274270b-7b3e-4d54-881b-a57989fe95b6 req-8259f10e-bd69-4fac-b5aa-54aec07bd387 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03612730-8fd5-4006-aa0a-0c90feb1ea64", "name": "network-vif-deleted", "tag": "f19f1969-880f-461a-a794-33b5a54fa613"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:21:48.301811 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1274270b-7b3e-4d54-881b-a57989fe95b6 req-8259f10e-bd69-4fac-b5aa-54aec07bd387 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:48.302634 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1274270b-7b3e-4d54-881b-a57989fe95b6 req-8259f10e-bd69-4fac-b5aa-54aec07bd387 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:48.303463 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1274270b-7b3e-4d54-881b-a57989fe95b6 req-8259f10e-bd69-4fac-b5aa-54aec07bd387 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:48.316099 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-1274270b-7b3e-4d54-881b-a57989fe95b6 req-8259f10e-bd69-4fac-b5aa-54aec07bd387 service nova] Creating event network-vif-deleted:f19f1969-880f-461a-a794-33b5a54fa613 for instance 03612730-8fd5-4006-aa0a-0c90feb1ea64 on nch2-master-1 Sep 24 21:21:48.325720 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-1274270b-7b3e-4d54-881b-a57989fe95b6 req-8259f10e-bd69-4fac-b5aa-54aec07bd387 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151139 Sep 24 21:21:48.329717 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2904/5831] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:21:48.394117 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c4dee2bc-7ca4-41c1-be20-35e70073ec69 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:48.394903 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c4dee2bc-7ca4-41c1-be20-35e70073ec69 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:48.402127 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c4dee2bc-7ca4-41c1-be20-35e70073ec69 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:48.402655 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c4dee2bc-7ca4-41c1-be20-35e70073ec69 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:48.403608 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c4dee2bc-7ca4-41c1-be20-35e70073ec69 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:48.404626 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c4dee2bc-7ca4-41c1-be20-35e70073ec69 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:48.405093 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c4dee2bc-7ca4-41c1-be20-35e70073ec69 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:48.405583 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c4dee2bc-7ca4-41c1-be20-35e70073ec69 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:48.443198 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c4dee2bc-7ca4-41c1-be20-35e70073ec69 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:48.443793 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c4dee2bc-7ca4-41c1-be20-35e70073ec69 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:48.444529 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c4dee2bc-7ca4-41c1-be20-35e70073ec69 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:48.445093 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-c4dee2bc-7ca4-41c1-be20-35e70073ec69 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lazy-loading 'fault' on Instance uuid 03612730-8fd5-4006-aa0a-0c90feb1ea64 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:21:48.534895 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c4dee2bc-7ca4-41c1-be20-35e70073ec69 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:48.543215 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c4dee2bc-7ca4-41c1-be20-35e70073ec69 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:48.544686 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c4dee2bc-7ca4-41c1-be20-35e70073ec69 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:48.545856 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c4dee2bc-7ca4-41c1-be20-35e70073ec69 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 200 len: 1352 microversion: 2.25 time: 0.155943 Sep 24 21:21:48.546436 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2928/5832] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:48 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 1352 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:49.573118 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cf8d9455-0981-4521-a601-d304ad79314c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:49.573832 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cf8d9455-0981-4521-a601-d304ad79314c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: 03612730-8fd5-4006-aa0a-0c90feb1ea64] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:49.580828 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cf8d9455-0981-4521-a601-d304ad79314c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:49.581284 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cf8d9455-0981-4521-a601-d304ad79314c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:49.581729 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cf8d9455-0981-4521-a601-d304ad79314c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:49.582438 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cf8d9455-0981-4521-a601-d304ad79314c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:49.582926 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cf8d9455-0981-4521-a601-d304ad79314c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:49.583361 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cf8d9455-0981-4521-a601-d304ad79314c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:49.597793 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-cf8d9455-0981-4521-a601-d304ad79314c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] HTTP exception thrown: Instance 03612730-8fd5-4006-aa0a-0c90feb1ea64 could not be found. Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cf8d9455-0981-4521-a601-d304ad79314c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Request method failure captured: Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 HTTP/1.1 Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL23nmHoADbr88E-bIhCdGNsOHqzYpgzOo8wwEUtkJtFfwkzGGfaiqbcbCO7QxI-DX-3g7I0foPa-aDSrqEq7TZi32vKDkpN63-SjMCkzvmfZO0izpJZBThQPWWv1nUGWlNoMLSYt1SxuyWsZ7KRPdJdOFsT8i5IeGZlwrDyrfR-7UhE Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: X-Openstack-Nova-Api-Version: 2.25 Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: f3c583f2016e4edd94aeec7dd64f9673 Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1717881295 Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3c583f2016e4edd94aeec7dd64f9673"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f3c583f2016e4edd94aeec7dd64f9673"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f3c583f2016e4edd94aeec7dd64f9673"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3c583f2016e4edd94aeec7dd64f9673"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1717881295 Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: f3c583f2016e4edd94aeec7dd64f9673 Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1717881295 Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-LiveAutoBlockMigrationV225Test-1717881295-project Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: ca78cf6d34e84f2cb5cb254c5d8af1da Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1717881295-project Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 03612730-8fd5-4006-aa0a-0c90feb1ea64 could not be found. Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '03612730-8fd5-4006-aa0a-0c90feb1ea64'} Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03612730-8fd5-4006-aa0a-0c90feb1ea64 could not be found. Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03612730-8fd5-4006-aa0a-0c90feb1ea64 could not be found. Sep 24 21:21:49.599515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:21:49.607359 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:21:49.607359 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:21:49.607359 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:21:49.607359 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:21:49.607359 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:21:49.607359 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:21:49.607359 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:21:49.607359 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03612730-8fd5-4006-aa0a-0c90feb1ea64 could not be found. Sep 24 21:21:49.607359 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:21:49.607359 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cf8d9455-0981-4521-a601-d304ad79314c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Returning 404 to user: Instance 03612730-8fd5-4006-aa0a-0c90feb1ea64 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:21:49.607359 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cf8d9455-0981-4521-a601-d304ad79314c tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64" status: 404 len: 111 microversion: 2.25 time: 0.033077 Sep 24 21:21:49.607359 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2905/5833] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:49 2022] GET /compute/v2.1/servers/03612730-8fd5-4006-aa0a-0c90feb1ea64 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:21:49.613475 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0a04d6f3-dd5b-4410-af65-ffae97b10615 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:49.613973 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0a04d6f3-dd5b-4410-af65-ffae97b10615 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:49.620888 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0a04d6f3-dd5b-4410-af65-ffae97b10615 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:49.621377 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0a04d6f3-dd5b-4410-af65-ffae97b10615 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:49.621925 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0a04d6f3-dd5b-4410-af65-ffae97b10615 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:49.622830 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0a04d6f3-dd5b-4410-af65-ffae97b10615 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:49.623296 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0a04d6f3-dd5b-4410-af65-ffae97b10615 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:49.623736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0a04d6f3-dd5b-4410-af65-ffae97b10615 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:49.655593 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0a04d6f3-dd5b-4410-af65-ffae97b10615 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:21:49.740039 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0a04d6f3-dd5b-4410-af65-ffae97b10615 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e" status: 204 len: 0 microversion: 2.25 time: 0.129492 Sep 24 21:21:49.742704 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2929/5834] 10.222.0.52 () {60 vars in 1280 bytes} [Sat Sep 24 21:21:49 2022] DELETE /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 24 21:21:49.749613 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fcaa7d93-0e34-4207-b831-23b4caabb982 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:49.750472 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fcaa7d93-0e34-4207-b831-23b4caabb982 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:49.763827 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fcaa7d93-0e34-4207-b831-23b4caabb982 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:49.764449 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fcaa7d93-0e34-4207-b831-23b4caabb982 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:49.764963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fcaa7d93-0e34-4207-b831-23b4caabb982 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:49.765745 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fcaa7d93-0e34-4207-b831-23b4caabb982 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:49.766404 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fcaa7d93-0e34-4207-b831-23b4caabb982 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:49.766862 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fcaa7d93-0e34-4207-b831-23b4caabb982 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:49.783909 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:21:50.017262 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fcaa7d93-0e34-4207-b831-23b4caabb982 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:50.025757 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fcaa7d93-0e34-4207-b831-23b4caabb982 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:50.027253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fcaa7d93-0e34-4207-b831-23b4caabb982 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:50.028588 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fcaa7d93-0e34-4207-b831-23b4caabb982 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e" status: 200 len: 1563 microversion: 2.25 time: 0.283287 Sep 24 21:21:50.029167 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2906/5835] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:49 2022] GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e => generated 1563 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:50.257587 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b0674215-2991-482c-90c4-3b7d68223ad7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:50.258555 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b0674215-2991-482c-90c4-3b7d68223ad7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 40731703-a782-4d3a-9557-4d896f056053] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:50.265063 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b0674215-2991-482c-90c4-3b7d68223ad7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:50.265567 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b0674215-2991-482c-90c4-3b7d68223ad7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:50.266017 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b0674215-2991-482c-90c4-3b7d68223ad7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:50.266760 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b0674215-2991-482c-90c4-3b7d68223ad7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:50.267399 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b0674215-2991-482c-90c4-3b7d68223ad7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:50.268015 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b0674215-2991-482c-90c4-3b7d68223ad7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:50.336942 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-eff7b1bc-c2f5-4c07-91f6-11fd81f56cb4 req-45d911ae-2b45-439f-9158-8ef7aa4d066e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40731703-a782-4d3a-9557-4d896f056053", "tag": "114e0634-5f58-457c-9b5d-f7ebe4eb9b30"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:21:50.347342 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-eff7b1bc-c2f5-4c07-91f6-11fd81f56cb4 req-45d911ae-2b45-439f-9158-8ef7aa4d066e service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:50.347829 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-eff7b1bc-c2f5-4c07-91f6-11fd81f56cb4 req-45d911ae-2b45-439f-9158-8ef7aa4d066e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:50.348267 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-eff7b1bc-c2f5-4c07-91f6-11fd81f56cb4 req-45d911ae-2b45-439f-9158-8ef7aa4d066e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:50.360685 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-eff7b1bc-c2f5-4c07-91f6-11fd81f56cb4 req-45d911ae-2b45-439f-9158-8ef7aa4d066e service nova] Creating event network-changed:114e0634-5f58-457c-9b5d-f7ebe4eb9b30 for instance 40731703-a782-4d3a-9557-4d896f056053 on nch1-master-1 Sep 24 21:21:50.365863 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-eff7b1bc-c2f5-4c07-91f6-11fd81f56cb4 req-45d911ae-2b45-439f-9158-8ef7aa4d066e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110184 Sep 24 21:21:50.366536 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2907/5836] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:21:50.447611 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b0674215-2991-482c-90c4-3b7d68223ad7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:50.456585 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b0674215-2991-482c-90c4-3b7d68223ad7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053" status: 200 len: 1564 microversion: 2.1 time: 0.203442 Sep 24 21:21:50.457565 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2930/5837] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:21:50 2022] GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053 => generated 1564 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:21:51.054951 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-28b89a91-5638-467a-9445-8ff7bb939794 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:51.056556 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-28b89a91-5638-467a-9445-8ff7bb939794 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:51.064292 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28b89a91-5638-467a-9445-8ff7bb939794 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:51.064796 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28b89a91-5638-467a-9445-8ff7bb939794 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:51.065247 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28b89a91-5638-467a-9445-8ff7bb939794 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:51.065983 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28b89a91-5638-467a-9445-8ff7bb939794 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:51.066485 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28b89a91-5638-467a-9445-8ff7bb939794 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:51.066991 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28b89a91-5638-467a-9445-8ff7bb939794 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:51.104379 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28b89a91-5638-467a-9445-8ff7bb939794 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:51.104877 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28b89a91-5638-467a-9445-8ff7bb939794 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:51.105327 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28b89a91-5638-467a-9445-8ff7bb939794 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:51.105789 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-28b89a91-5638-467a-9445-8ff7bb939794 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lazy-loading 'fault' on Instance uuid ca2ec54c-f6d0-43a4-abf4-c35d1cad952e {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:21:51.150962 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-28b89a91-5638-467a-9445-8ff7bb939794 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:51.160721 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-28b89a91-5638-467a-9445-8ff7bb939794 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:51.162322 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-28b89a91-5638-467a-9445-8ff7bb939794 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca78cf6d34e84f2cb5cb254c5d8af1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c583f2016e4edd94aeec7dd64f9673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:21:51.163801 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-28b89a91-5638-467a-9445-8ff7bb939794 tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e" status: 200 len: 1351 microversion: 2.25 time: 0.114176 Sep 24 21:21:51.164573 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2908/5838] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:51 2022] GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e => generated 1351 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:21:52.190702 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a7b624a4-1599-4983-bf2e-817a2c406d6f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:21:52.191357 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a7b624a4-1599-4983-bf2e-817a2c406d6f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] [instance: ca2ec54c-f6d0-43a4-abf4-c35d1cad952e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:21:52.198301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a7b624a4-1599-4983-bf2e-817a2c406d6f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:52.198832 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a7b624a4-1599-4983-bf2e-817a2c406d6f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:52.199280 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a7b624a4-1599-4983-bf2e-817a2c406d6f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:52.200007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a7b624a4-1599-4983-bf2e-817a2c406d6f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:52.200523 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a7b624a4-1599-4983-bf2e-817a2c406d6f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:52.200956 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a7b624a4-1599-4983-bf2e-817a2c406d6f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:52.214532 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-a7b624a4-1599-4983-bf2e-817a2c406d6f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] HTTP exception thrown: Instance ca2ec54c-f6d0-43a4-abf4-c35d1cad952e could not be found. Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a7b624a4-1599-4983-bf2e-817a2c406d6f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Request method failure captured: Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e HTTP/1.1 Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL23nmHoADbr88E-bIhCdGNsOHqzYpgzOo8wwEUtkJtFfwkzGGfaiqbcbCO7QxI-DX-3g7I0foPa-aDSrqEq7TZi32vKDkpN63-SjMCkzvmfZO0izpJZBThQPWWv1nUGWlNoMLSYt1SxuyWsZ7KRPdJdOFsT8i5IeGZlwrDyrfR-7UhE Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: X-Openstack-Nova-Api-Version: 2.25 Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: f3c583f2016e4edd94aeec7dd64f9673 Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1717881295 Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3c583f2016e4edd94aeec7dd64f9673"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f3c583f2016e4edd94aeec7dd64f9673"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f3c583f2016e4edd94aeec7dd64f9673"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3c583f2016e4edd94aeec7dd64f9673"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1717881295 Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: f3c583f2016e4edd94aeec7dd64f9673 Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1717881295 Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-LiveAutoBlockMigrationV225Test-1717881295-project Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: ca78cf6d34e84f2cb5cb254c5d8af1da Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1717881295-project Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance ca2ec54c-f6d0-43a4-abf4-c35d1cad952e could not be found. Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'ca2ec54c-f6d0-43a4-abf4-c35d1cad952e'} Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca2ec54c-f6d0-43a4-abf4-c35d1cad952e could not be found. Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca2ec54c-f6d0-43a4-abf4-c35d1cad952e could not be found. Sep 24 21:21:52.216700 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:21:52.221493 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:21:52.221493 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:21:52.221493 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:21:52.221493 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:21:52.221493 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:21:52.221493 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:21:52.221493 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:21:52.221493 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca2ec54c-f6d0-43a4-abf4-c35d1cad952e could not be found. Sep 24 21:21:52.221493 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:21:52.221493 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a7b624a4-1599-4983-bf2e-817a2c406d6f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] Returning 404 to user: Instance ca2ec54c-f6d0-43a4-abf4-c35d1cad952e could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:21:52.221493 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a7b624a4-1599-4983-bf2e-817a2c406d6f tempest-LiveAutoBlockMigrationV225Test-1717881295 tempest-LiveAutoBlockMigrationV225Test-1717881295-project] 10.222.0.52 "GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e" status: 404 len: 111 microversion: 2.25 time: 0.031630 Sep 24 21:21:52.221493 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2931/5839] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:21:52 2022] GET /compute/v2.1/servers/ca2ec54c-f6d0-43a4-abf4-c35d1cad952e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:21:52.394243 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-0ba9c05b-36de-40ff-9879-eedca03e8822 req-1e651b37-5b28-4a21-b0dd-3fe3e33b0177 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca2ec54c-f6d0-43a4-abf4-c35d1cad952e", "name": "network-vif-deleted", "tag": "6259f434-7655-415c-a21b-246b0076fb23"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:21:52.405176 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-0ba9c05b-36de-40ff-9879-eedca03e8822 req-1e651b37-5b28-4a21-b0dd-3fe3e33b0177 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:21:52.405661 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-0ba9c05b-36de-40ff-9879-eedca03e8822 req-1e651b37-5b28-4a21-b0dd-3fe3e33b0177 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:21:52.406099 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-0ba9c05b-36de-40ff-9879-eedca03e8822 req-1e651b37-5b28-4a21-b0dd-3fe3e33b0177 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:21:52.417257 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-0ba9c05b-36de-40ff-9879-eedca03e8822 req-1e651b37-5b28-4a21-b0dd-3fe3e33b0177 service nova] Creating event network-vif-deleted:6259f434-7655-415c-a21b-246b0076fb23 for instance ca2ec54c-f6d0-43a4-abf4-c35d1cad952e on nch1-master-1 Sep 24 21:21:52.422945 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-0ba9c05b-36de-40ff-9879-eedca03e8822 req-1e651b37-5b28-4a21-b0dd-3fe3e33b0177 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032463 Sep 24 21:21:52.423566 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2909/5840] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:22:00.974516 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-335b863c-506e-4fe6-b6e7-fe1f7fc3b5ee tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Calling method '.version_select at 0x7f4b11081670>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:22:01.030253 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:22:01.045633 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-335b863c-506e-4fe6-b6e7-fe1f7fc3b5ee tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/93f2ef7a78c348bdb36ed16846868cca" status: 200 len: 371 microversion: 2.1 time: 0.187741 Sep 24 21:22:01.046210 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2932/5841] 10.222.0.52 () {58 vars in 1242 bytes} [Sat Sep 24 21:22:00 2022] GET /compute/v2.1/os-quota-sets/93f2ef7a78c348bdb36ed16846868cca => generated 371 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:22:01.060649 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8db2299d-1ed6-4975-8ff3-7f34e75c4bdd tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Action: 'update', calling method: .version_select at 0x7f4b0c53eee0>, body: {"quota_set": {"ram": "5120"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:22:01.129823 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8db2299d-1ed6-4975-8ff3-7f34e75c4bdd tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:01.130317 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8db2299d-1ed6-4975-8ff3-7f34e75c4bdd tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:01.130820 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8db2299d-1ed6-4975-8ff3-7f34e75c4bdd tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:01.131555 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8db2299d-1ed6-4975-8ff3-7f34e75c4bdd tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:01.132020 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8db2299d-1ed6-4975-8ff3-7f34e75c4bdd tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:01.132454 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8db2299d-1ed6-4975-8ff3-7f34e75c4bdd tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:01.184158 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8db2299d-1ed6-4975-8ff3-7f34e75c4bdd tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/93f2ef7a78c348bdb36ed16846868cca" status: 200 len: 328 microversion: 2.1 time: 0.129493 Sep 24 21:22:01.184934 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2910/5842] 10.222.0.52 () {60 vars in 1262 bytes} [Sat Sep 24 21:22:01 2022] PUT /compute/v2.1/os-quota-sets/93f2ef7a78c348bdb36ed16846868cca => generated 328 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:22:01.195908 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f66c0c90-d857-42d1-a407-a06f122178c6 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:22:01.208042 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f66c0c90-d857-42d1-a407-a06f122178c6 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-quota-sets/93f2ef7a78c348bdb36ed16846868cca" status: 202 len: 0 microversion: 2.1 time: 0.015817 Sep 24 21:22:01.208585 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2933/5843] 10.222.0.52 () {58 vars in 1245 bytes} [Sat Sep 24 21:22:01 2022] DELETE /compute/v2.1/os-quota-sets/93f2ef7a78c348bdb36ed16846868cca => generated 0 bytes in 17 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:22:01.216858 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-21a9ab64-583d-4c6d-846d-a0209aebdd38 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Calling method '.version_select at 0x7f4b077358b0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:22:01.285109 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-21a9ab64-583d-4c6d-846d-a0209aebdd38 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/93f2ef7a78c348bdb36ed16846868cca" status: 200 len: 371 microversion: 2.1 time: 0.072523 Sep 24 21:22:01.285689 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2911/5844] 10.222.0.52 () {58 vars in 1242 bytes} [Sat Sep 24 21:22:01 2022] GET /compute/v2.1/os-quota-sets/93f2ef7a78c348bdb36ed16846868cca => generated 371 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:22:01.400479 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2a408e97-674d-4ea4-baa8-b536853cbc82 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Calling method '.version_select at 0x7f4b110c73a0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:22:01.579579 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2a408e97-674d-4ea4-baa8-b536853cbc82 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/6c066e5af8554d298fe7e8c72b349f26/defaults" status: 200 len: 371 microversion: 2.1 time: 0.182803 Sep 24 21:22:01.580182 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2934/5845] 10.222.0.52 () {58 vars in 1269 bytes} [Sat Sep 24 21:22:01 2022] GET /compute/v2.1/os-quota-sets/6c066e5af8554d298fe7e8c72b349f26/defaults => generated 371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:22:01.771615 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9e0f8e23-140b-4e28-8e2d-61a9088dfb59 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Action: 'update', calling method: .version_select at 0x7f4b079e7790>, body: {"quota_set": {"ram": "5120"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:22:01.897002 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e0f8e23-140b-4e28-8e2d-61a9088dfb59 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:01.897481 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e0f8e23-140b-4e28-8e2d-61a9088dfb59 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:01.897920 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e0f8e23-140b-4e28-8e2d-61a9088dfb59 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:01.898682 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e0f8e23-140b-4e28-8e2d-61a9088dfb59 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:01.899141 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e0f8e23-140b-4e28-8e2d-61a9088dfb59 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:01.899566 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e0f8e23-140b-4e28-8e2d-61a9088dfb59 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:01.948284 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9e0f8e23-140b-4e28-8e2d-61a9088dfb59 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/7742ae37c4424c67a9b1b59d962e8f05" status: 200 len: 328 microversion: 2.1 time: 0.180693 Sep 24 21:22:01.948913 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2912/5846] 10.222.0.52 () {60 vars in 1262 bytes} [Sat Sep 24 21:22:01 2022] PUT /compute/v2.1/os-quota-sets/7742ae37c4424c67a9b1b59d962e8f05 => generated 328 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:22:01.961938 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2a2d1f3d-4366-4ef3-964a-230738193a1f tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Calling method '.version_select at 0x7f4b0c7b1d30>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:22:02.025727 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a2d1f3d-4366-4ef3-964a-230738193a1f tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:02.026301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a2d1f3d-4366-4ef3-964a-230738193a1f tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:02.026692 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a2d1f3d-4366-4ef3-964a-230738193a1f tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:02.027474 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a2d1f3d-4366-4ef3-964a-230738193a1f tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:02.028233 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a2d1f3d-4366-4ef3-964a-230738193a1f tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:02.028670 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a2d1f3d-4366-4ef3-964a-230738193a1f tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:02.047658 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2a2d1f3d-4366-4ef3-964a-230738193a1f tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/7742ae37c4424c67a9b1b59d962e8f05/detail" status: 200 len: 916 microversion: 2.1 time: 0.089429 Sep 24 21:22:02.048259 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2935/5847] 10.222.0.52 () {58 vars in 1263 bytes} [Sat Sep 24 21:22:01 2022] GET /compute/v2.1/os-quota-sets/7742ae37c4424c67a9b1b59d962e8f05/detail => generated 916 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:22:02.184819 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ed7e2bf5-facc-41ba-a703-dc78ad6baba7 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Action: 'update', calling method: .version_select at 0x7f4b0788eee0>, body: {"quota_set": {"ram": "2048"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:22:02.249563 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed7e2bf5-facc-41ba-a703-dc78ad6baba7 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:02.250052 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed7e2bf5-facc-41ba-a703-dc78ad6baba7 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:02.250507 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed7e2bf5-facc-41ba-a703-dc78ad6baba7 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:02.251256 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed7e2bf5-facc-41ba-a703-dc78ad6baba7 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:02.251744 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed7e2bf5-facc-41ba-a703-dc78ad6baba7 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:02.252179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed7e2bf5-facc-41ba-a703-dc78ad6baba7 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:02.285156 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed7e2bf5-facc-41ba-a703-dc78ad6baba7 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:02.285567 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed7e2bf5-facc-41ba-a703-dc78ad6baba7 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:02.286007 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed7e2bf5-facc-41ba-a703-dc78ad6baba7 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:02.286768 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed7e2bf5-facc-41ba-a703-dc78ad6baba7 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:02.287233 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed7e2bf5-facc-41ba-a703-dc78ad6baba7 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:02.287665 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed7e2bf5-facc-41ba-a703-dc78ad6baba7 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:02.341037 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ed7e2bf5-facc-41ba-a703-dc78ad6baba7 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/7742ae37c4424c67a9b1b59d962e8f05?user_id=b58197dcdf644ab7b9bd5702f56b9718" status: 200 len: 328 microversion: 2.1 time: 0.160753 Sep 24 21:22:02.341812 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2913/5848] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 21:22:02 2022] PUT /compute/v2.1/os-quota-sets/7742ae37c4424c67a9b1b59d962e8f05?user_id=b58197dcdf644ab7b9bd5702f56b9718 => generated 328 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:22:02.354890 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-557ae9b9-e341-4b5d-b2d7-07f275a60af3 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Calling method '.version_select at 0x7f4b07d03160>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:22:02.430750 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-557ae9b9-e341-4b5d-b2d7-07f275a60af3 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/7742ae37c4424c67a9b1b59d962e8f05?user_id=b58197dcdf644ab7b9bd5702f56b9718" status: 200 len: 370 microversion: 2.1 time: 0.079442 Sep 24 21:22:02.431331 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2936/5849] 10.222.0.52 () {58 vars in 1323 bytes} [Sat Sep 24 21:22:02 2022] GET /compute/v2.1/os-quota-sets/7742ae37c4424c67a9b1b59d962e8f05?user_id=b58197dcdf644ab7b9bd5702f56b9718 => generated 370 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:22:02.722231 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-233ad810-d5a1-4160-90da-b10fbac6eef0 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Calling method '.version_select at 0x7f4b07735820>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:22:02.896644 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-233ad810-d5a1-4160-90da-b10fbac6eef0 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/6c066e5af8554d298fe7e8c72b349f26/defaults" status: 200 len: 371 microversion: 2.1 time: 0.178111 Sep 24 21:22:02.897215 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2914/5850] 10.222.0.52 () {58 vars in 1269 bytes} [Sat Sep 24 21:22:02 2022] GET /compute/v2.1/os-quota-sets/6c066e5af8554d298fe7e8c72b349f26/defaults => generated 371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:22:02.910805 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a84f6b49-d90b-4d2a-a043-64415dba1ba7 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Action: 'update', calling method: .version_select at 0x7f4b0c7b1040>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:22:02.995394 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a84f6b49-d90b-4d2a-a043-64415dba1ba7 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:02.995888 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a84f6b49-d90b-4d2a-a043-64415dba1ba7 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:02.996392 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a84f6b49-d90b-4d2a-a043-64415dba1ba7 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:02.997132 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a84f6b49-d90b-4d2a-a043-64415dba1ba7 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:02.997595 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a84f6b49-d90b-4d2a-a043-64415dba1ba7 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:02.998030 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a84f6b49-d90b-4d2a-a043-64415dba1ba7 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:03.199942 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a84f6b49-d90b-4d2a-a043-64415dba1ba7 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/6c066e5af8554d298fe7e8c72b349f26" status: 200 len: 329 microversion: 2.1 time: 0.292137 Sep 24 21:22:03.201131 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2937/5851] 10.222.0.52 () {60 vars in 1263 bytes} [Sat Sep 24 21:22:02 2022] PUT /compute/v2.1/os-quota-sets/6c066e5af8554d298fe7e8c72b349f26 => generated 329 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:22:03.212944 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-59e97696-6180-4928-aa0c-50a1b96aeba2 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Action: 'update', calling method: .version_select at 0x7f4b079e7c10>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:22:03.285158 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-59e97696-6180-4928-aa0c-50a1b96aeba2 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:03.285650 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-59e97696-6180-4928-aa0c-50a1b96aeba2 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:03.286097 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-59e97696-6180-4928-aa0c-50a1b96aeba2 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:03.286870 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-59e97696-6180-4928-aa0c-50a1b96aeba2 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:03.287335 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-59e97696-6180-4928-aa0c-50a1b96aeba2 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:03.287769 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-59e97696-6180-4928-aa0c-50a1b96aeba2 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:03.301400 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:22:03.599589 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-59e97696-6180-4928-aa0c-50a1b96aeba2 tempest-QuotasAdminTestJSON-113582718 tempest-QuotasAdminTestJSON-113582718-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/6c066e5af8554d298fe7e8c72b349f26" status: 200 len: 329 microversion: 2.1 time: 0.390719 Sep 24 21:22:03.600182 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2915/5852] 10.222.0.52 () {60 vars in 1263 bytes} [Sat Sep 24 21:22:03 2022] PUT /compute/v2.1/os-quota-sets/6c066e5af8554d298fe7e8c72b349f26 => generated 329 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:22:21.822291 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6275fe6e-741e-4584-baaa-64c2f0424246 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:22:21.824701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6275fe6e-741e-4584-baaa-64c2f0424246 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 40731703-a782-4d3a-9557-4d896f056053] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:22:21.827538 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=4 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:22:21.828209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:22:21.828964 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=42 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:22:21.829570 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=2,nova_api:INSERT=14 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:22:21.836696 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6275fe6e-741e-4584-baaa-64c2f0424246 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:21.837202 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6275fe6e-741e-4584-baaa-64c2f0424246 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:21.837644 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6275fe6e-741e-4584-baaa-64c2f0424246 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:21.838363 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6275fe6e-741e-4584-baaa-64c2f0424246 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:21.838887 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6275fe6e-741e-4584-baaa-64c2f0424246 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:21.839325 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6275fe6e-741e-4584-baaa-64c2f0424246 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:21.900289 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6275fe6e-741e-4584-baaa-64c2f0424246 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "POST /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053/action" status: 200 len: 24560 microversion: 2.1 time: 0.081852 Sep 24 21:22:21.901193 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2938/5853] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:22:21 2022] POST /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053/action => generated 24560 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:22:35.181418 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=11 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:22:35.182435 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=26 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:22:35.183277 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=64 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:22:35.185010 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=14,nova_api:UPDATE=14 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:22:35.344158 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-64c4cbcd-b1b1-4939-81d1-0ffb36d0290b tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Action: 'create', calling method: .version_select at 0x7f4b07735af0>, body: {"keypair": {"name": "tempest-keypair-1232964235", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPe+rsB8MyTTr9AcAjd52ZbPUOi1xGBPxQI/5Z/XPGWaBnNl0T6zbx7eiXrehg9hExW94o8qMjz4W57zf1JwzHBPWFTtPRcaaqLg9LRWtzOKOFQV9erKn0nWAFWwElhk3w=="}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:22:35.359978 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-64c4cbcd-b1b1-4939-81d1-0ffb36d0290b tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Getting quotas for project 3481b55b9dfd4a25909a3fe6a03f06e3. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:22:35.364941 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-64c4cbcd-b1b1-4939-81d1-0ffb36d0290b tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Getting quotas for user 0ea6653831a54a869daaba5e51fd04b8 and project 3481b55b9dfd4a25909a3fe6a03f06e3. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:22:35.388738 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-64c4cbcd-b1b1-4939-81d1-0ffb36d0290b tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.212539 Sep 24 21:22:35.389346 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2916/5854] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 21:22:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:22:36.640263 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-da7ec8d5-2049-4453-9762-6b70fda63fc9 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1430560649", "imageRef": "21242e2d-53b5-4e24-b821-a92392e6da98", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "0fabbbf9-45d2-4c50-bad3-44e2e2cea702"}], "security_groups": [{"name": "tempest-securitygroup--639490564"}], "key_name": "tempest-keypair-1232964235", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:22:36.652068 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:22:36.652884 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=4 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:22:36.749761 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-da7ec8d5-2049-4453-9762-6b70fda63fc9 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] validate_networks() for [('0fabbbf9-45d2-4c50-bad3-44e2e2cea702', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:22:37.214297 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-da7ec8d5-2049-4453-9762-6b70fda63fc9 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:22:37.215452 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-da7ec8d5-2049-4453-9762-6b70fda63fc9 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:22:37.215883 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-da7ec8d5-2049-4453-9762-6b70fda63fc9 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:22:37.216333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-da7ec8d5-2049-4453-9762-6b70fda63fc9 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:22:37.216755 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-da7ec8d5-2049-4453-9762-6b70fda63fc9 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:22:37.225813 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-da7ec8d5-2049-4453-9762-6b70fda63fc9 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:37.226297 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-da7ec8d5-2049-4453-9762-6b70fda63fc9 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:37.226880 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-da7ec8d5-2049-4453-9762-6b70fda63fc9 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:37.227646 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-da7ec8d5-2049-4453-9762-6b70fda63fc9 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:37.228100 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-da7ec8d5-2049-4453-9762-6b70fda63fc9 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:37.228555 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-da7ec8d5-2049-4453-9762-6b70fda63fc9 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:37.245585 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-da7ec8d5-2049-4453-9762-6b70fda63fc9 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Getting quotas for project 3481b55b9dfd4a25909a3fe6a03f06e3. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:22:37.251337 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-da7ec8d5-2049-4453-9762-6b70fda63fc9 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Getting quotas for user 0ea6653831a54a869daaba5e51fd04b8 and project 3481b55b9dfd4a25909a3fe6a03f06e3. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:22:37.263827 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-da7ec8d5-2049-4453-9762-6b70fda63fc9 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:22:37.266167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-da7ec8d5-2049-4453-9762-6b70fda63fc9 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] [instance: 50a8c390-9d7e-4ad1-a399-03090abee415] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='21242e2d-53b5-4e24-b821-a92392e6da98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:22:37.315550 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-da7ec8d5-2049-4453-9762-6b70fda63fc9 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.680101 Sep 24 21:22:37.316474 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2939/5855] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:22:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:22:37.329033 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ba2f1171-761c-4ccd-aa7d-3cb05edf6854 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:22:37.329774 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ba2f1171-761c-4ccd-aa7d-3cb05edf6854 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] [instance: 50a8c390-9d7e-4ad1-a399-03090abee415] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:22:37.385101 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ba2f1171-761c-4ccd-aa7d-3cb05edf6854 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea6653831a54a869daaba5e51fd04b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3481b55b9dfd4a25909a3fe6a03f06e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:22:37.393820 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ba2f1171-761c-4ccd-aa7d-3cb05edf6854 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] 10.222.0.52 "GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415" status: 200 len: 1246 microversion: 2.1 time: 0.070453 Sep 24 21:22:37.394394 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2917/5856] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:22:37 2022] GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415 => generated 1246 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:22:38.417494 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-72757a7b-12ed-4fc5-bbec-50ce153ada00 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:22:38.418294 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-72757a7b-12ed-4fc5-bbec-50ce153ada00 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] [instance: 50a8c390-9d7e-4ad1-a399-03090abee415] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:22:38.427162 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-72757a7b-12ed-4fc5-bbec-50ce153ada00 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:38.427776 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-72757a7b-12ed-4fc5-bbec-50ce153ada00 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:38.428295 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-72757a7b-12ed-4fc5-bbec-50ce153ada00 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:38.429077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-72757a7b-12ed-4fc5-bbec-50ce153ada00 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:38.429621 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-72757a7b-12ed-4fc5-bbec-50ce153ada00 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:38.430251 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-72757a7b-12ed-4fc5-bbec-50ce153ada00 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:38.521568 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-72757a7b-12ed-4fc5-bbec-50ce153ada00 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea6653831a54a869daaba5e51fd04b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3481b55b9dfd4a25909a3fe6a03f06e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:22:38.530969 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-72757a7b-12ed-4fc5-bbec-50ce153ada00 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] 10.222.0.52 "GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415" status: 200 len: 1306 microversion: 2.1 time: 0.117341 Sep 24 21:22:38.531558 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2940/5857] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:22:38 2022] GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415 => generated 1306 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:22:39.556607 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4cb8db60-66e9-41a8-8c91-dd26a1aa2c02 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:22:39.557993 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4cb8db60-66e9-41a8-8c91-dd26a1aa2c02 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] [instance: 50a8c390-9d7e-4ad1-a399-03090abee415] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:22:39.566473 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4cb8db60-66e9-41a8-8c91-dd26a1aa2c02 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:39.567366 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4cb8db60-66e9-41a8-8c91-dd26a1aa2c02 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:39.568089 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4cb8db60-66e9-41a8-8c91-dd26a1aa2c02 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:39.568936 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4cb8db60-66e9-41a8-8c91-dd26a1aa2c02 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:39.569473 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4cb8db60-66e9-41a8-8c91-dd26a1aa2c02 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:39.569980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4cb8db60-66e9-41a8-8c91-dd26a1aa2c02 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:39.768387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4cb8db60-66e9-41a8-8c91-dd26a1aa2c02 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea6653831a54a869daaba5e51fd04b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3481b55b9dfd4a25909a3fe6a03f06e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:22:39.777303 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4cb8db60-66e9-41a8-8c91-dd26a1aa2c02 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] 10.222.0.52 "GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415" status: 200 len: 1371 microversion: 2.1 time: 0.224651 Sep 24 21:22:39.777966 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2918/5858] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:22:39 2022] GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415 => generated 1371 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:22:40.801916 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bf7bbb41-d082-4f2b-a61b-0f977c8a6c0e tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:22:40.802564 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bf7bbb41-d082-4f2b-a61b-0f977c8a6c0e tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] [instance: 50a8c390-9d7e-4ad1-a399-03090abee415] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:22:40.810431 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf7bbb41-d082-4f2b-a61b-0f977c8a6c0e tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:40.810906 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf7bbb41-d082-4f2b-a61b-0f977c8a6c0e tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:40.811509 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf7bbb41-d082-4f2b-a61b-0f977c8a6c0e tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:40.812457 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf7bbb41-d082-4f2b-a61b-0f977c8a6c0e tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:40.813408 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf7bbb41-d082-4f2b-a61b-0f977c8a6c0e tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:40.814014 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf7bbb41-d082-4f2b-a61b-0f977c8a6c0e tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:40.967616 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bf7bbb41-d082-4f2b-a61b-0f977c8a6c0e tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea6653831a54a869daaba5e51fd04b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3481b55b9dfd4a25909a3fe6a03f06e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:22:40.976055 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bf7bbb41-d082-4f2b-a61b-0f977c8a6c0e tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] 10.222.0.52 "GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415" status: 200 len: 1371 microversion: 2.1 time: 0.178118 Sep 24 21:22:40.976836 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2941/5859] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:22:40 2022] GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415 => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:22:42.000732 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-031fd315-764e-488d-88d5-6002a951576e tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:22:42.001753 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-031fd315-764e-488d-88d5-6002a951576e tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] [instance: 50a8c390-9d7e-4ad1-a399-03090abee415] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:22:42.009577 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-031fd315-764e-488d-88d5-6002a951576e tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:42.010178 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-031fd315-764e-488d-88d5-6002a951576e tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:42.010667 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-031fd315-764e-488d-88d5-6002a951576e tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:42.011458 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-031fd315-764e-488d-88d5-6002a951576e tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:42.011922 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-031fd315-764e-488d-88d5-6002a951576e tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:42.012962 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-031fd315-764e-488d-88d5-6002a951576e tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:42.160823 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-031fd315-764e-488d-88d5-6002a951576e tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea6653831a54a869daaba5e51fd04b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3481b55b9dfd4a25909a3fe6a03f06e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:22:42.170426 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-031fd315-764e-488d-88d5-6002a951576e tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] 10.222.0.52 "GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415" status: 200 len: 1371 microversion: 2.1 time: 0.174421 Sep 24 21:22:42.171087 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2919/5860] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:22:41 2022] GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415 => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:22:43.197195 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3a276e21-c794-44bf-aaa7-654e4d62b6cd tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:22:43.200626 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3a276e21-c794-44bf-aaa7-654e4d62b6cd tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] [instance: 50a8c390-9d7e-4ad1-a399-03090abee415] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:22:43.221480 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a276e21-c794-44bf-aaa7-654e4d62b6cd tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:43.222071 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a276e21-c794-44bf-aaa7-654e4d62b6cd tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:43.222618 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a276e21-c794-44bf-aaa7-654e4d62b6cd tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:43.224748 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a276e21-c794-44bf-aaa7-654e4d62b6cd tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:43.225297 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a276e21-c794-44bf-aaa7-654e4d62b6cd tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:43.230359 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a276e21-c794-44bf-aaa7-654e4d62b6cd tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:43.390878 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3a276e21-c794-44bf-aaa7-654e4d62b6cd tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea6653831a54a869daaba5e51fd04b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3481b55b9dfd4a25909a3fe6a03f06e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:22:43.399097 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3a276e21-c794-44bf-aaa7-654e4d62b6cd tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] 10.222.0.52 "GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415" status: 200 len: 1371 microversion: 2.1 time: 0.208797 Sep 24 21:22:43.399889 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2942/5861] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:22:43 2022] GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415 => generated 1371 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:22:44.422523 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6ea2d087-bf31-45cc-8c33-d33cb48c02a8 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:22:44.423317 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6ea2d087-bf31-45cc-8c33-d33cb48c02a8 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] [instance: 50a8c390-9d7e-4ad1-a399-03090abee415] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:22:44.430879 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ea2d087-bf31-45cc-8c33-d33cb48c02a8 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:44.431380 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ea2d087-bf31-45cc-8c33-d33cb48c02a8 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:44.431838 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ea2d087-bf31-45cc-8c33-d33cb48c02a8 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:44.432728 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ea2d087-bf31-45cc-8c33-d33cb48c02a8 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:44.433189 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ea2d087-bf31-45cc-8c33-d33cb48c02a8 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:44.433618 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ea2d087-bf31-45cc-8c33-d33cb48c02a8 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:44.584981 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6ea2d087-bf31-45cc-8c33-d33cb48c02a8 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea6653831a54a869daaba5e51fd04b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3481b55b9dfd4a25909a3fe6a03f06e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:22:44.593611 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6ea2d087-bf31-45cc-8c33-d33cb48c02a8 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] 10.222.0.52 "GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415" status: 200 len: 1371 microversion: 2.1 time: 0.175462 Sep 24 21:22:44.607046 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2920/5862] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:22:44 2022] GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415 => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:22:45.617332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d6f282f8-1024-4b15-a011-88a2bd01d715 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:22:45.618193 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d6f282f8-1024-4b15-a011-88a2bd01d715 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] [instance: 50a8c390-9d7e-4ad1-a399-03090abee415] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:22:45.626304 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6f282f8-1024-4b15-a011-88a2bd01d715 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:45.626840 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6f282f8-1024-4b15-a011-88a2bd01d715 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:45.627296 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6f282f8-1024-4b15-a011-88a2bd01d715 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:45.628048 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6f282f8-1024-4b15-a011-88a2bd01d715 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:45.628508 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6f282f8-1024-4b15-a011-88a2bd01d715 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:45.629989 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6f282f8-1024-4b15-a011-88a2bd01d715 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:45.773967 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d6f282f8-1024-4b15-a011-88a2bd01d715 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea6653831a54a869daaba5e51fd04b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3481b55b9dfd4a25909a3fe6a03f06e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:22:45.782309 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d6f282f8-1024-4b15-a011-88a2bd01d715 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] 10.222.0.52 "GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415" status: 200 len: 1371 microversion: 2.1 time: 0.168922 Sep 24 21:22:45.782923 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2943/5863] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:22:45 2022] GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:22:46.806588 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6189f38f-a172-45df-b349-d6292070f3e3 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:22:46.807244 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6189f38f-a172-45df-b349-d6292070f3e3 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] [instance: 50a8c390-9d7e-4ad1-a399-03090abee415] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:22:46.814839 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6189f38f-a172-45df-b349-d6292070f3e3 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:46.815338 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6189f38f-a172-45df-b349-d6292070f3e3 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:46.815787 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6189f38f-a172-45df-b349-d6292070f3e3 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:46.816499 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6189f38f-a172-45df-b349-d6292070f3e3 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:46.816965 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6189f38f-a172-45df-b349-d6292070f3e3 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:46.817408 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6189f38f-a172-45df-b349-d6292070f3e3 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:46.957312 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6189f38f-a172-45df-b349-d6292070f3e3 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea6653831a54a869daaba5e51fd04b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3481b55b9dfd4a25909a3fe6a03f06e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:22:46.965370 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6189f38f-a172-45df-b349-d6292070f3e3 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] 10.222.0.52 "GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415" status: 200 len: 1371 microversion: 2.1 time: 0.162737 Sep 24 21:22:46.971907 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2921/5864] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:22:46 2022] GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:22:47.133399 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-4d899f5f-41e4-420c-a28d-9d9f735559d5 req-2151a9c8-cbc6-463e-ab98-b6c3a4dd765e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a8c390-9d7e-4ad1-a399-03090abee415", "tag": "df9b4b3d-c42e-4fcf-a91e-21a8f7f72dfd"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:22:47.146367 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-4d899f5f-41e4-420c-a28d-9d9f735559d5 req-2151a9c8-cbc6-463e-ab98-b6c3a4dd765e service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:47.146874 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-4d899f5f-41e4-420c-a28d-9d9f735559d5 req-2151a9c8-cbc6-463e-ab98-b6c3a4dd765e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:47.147311 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-4d899f5f-41e4-420c-a28d-9d9f735559d5 req-2151a9c8-cbc6-463e-ab98-b6c3a4dd765e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:47.158943 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-4d899f5f-41e4-420c-a28d-9d9f735559d5 req-2151a9c8-cbc6-463e-ab98-b6c3a4dd765e service nova] Creating event network-changed:df9b4b3d-c42e-4fcf-a91e-21a8f7f72dfd for instance 50a8c390-9d7e-4ad1-a399-03090abee415 on nch2-master-1 Sep 24 21:22:47.164189 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-4d899f5f-41e4-420c-a28d-9d9f735559d5 req-2151a9c8-cbc6-463e-ab98-b6c3a4dd765e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034869 Sep 24 21:22:47.164966 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2944/5865] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:22:47.987940 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6cd14f75-68f3-4e45-a19a-63a30852bb51 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:22:47.988534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6cd14f75-68f3-4e45-a19a-63a30852bb51 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] [instance: 50a8c390-9d7e-4ad1-a399-03090abee415] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:22:47.990384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:22:47.996654 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6cd14f75-68f3-4e45-a19a-63a30852bb51 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:47.997142 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6cd14f75-68f3-4e45-a19a-63a30852bb51 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:47.997593 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6cd14f75-68f3-4e45-a19a-63a30852bb51 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:47.998297 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6cd14f75-68f3-4e45-a19a-63a30852bb51 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:47.998786 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6cd14f75-68f3-4e45-a19a-63a30852bb51 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:47.999224 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6cd14f75-68f3-4e45-a19a-63a30852bb51 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:48.132059 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6cd14f75-68f3-4e45-a19a-63a30852bb51 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea6653831a54a869daaba5e51fd04b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3481b55b9dfd4a25909a3fe6a03f06e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:22:48.141002 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6cd14f75-68f3-4e45-a19a-63a30852bb51 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] 10.222.0.52 "GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415" status: 200 len: 1371 microversion: 2.1 time: 0.157095 Sep 24 21:22:48.141573 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2922/5866] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:22:47 2022] GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:22:49.161449 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:22:49.162249 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=6 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:22:49.167181 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-02af22bc-9bd3-4274-b0d7-3ec698c6b896 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:22:49.167888 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-02af22bc-9bd3-4274-b0d7-3ec698c6b896 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] [instance: 50a8c390-9d7e-4ad1-a399-03090abee415] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:22:49.175935 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-02af22bc-9bd3-4274-b0d7-3ec698c6b896 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:49.176417 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-02af22bc-9bd3-4274-b0d7-3ec698c6b896 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:49.176853 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-02af22bc-9bd3-4274-b0d7-3ec698c6b896 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:49.177543 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-02af22bc-9bd3-4274-b0d7-3ec698c6b896 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:49.177996 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-02af22bc-9bd3-4274-b0d7-3ec698c6b896 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:49.178422 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-02af22bc-9bd3-4274-b0d7-3ec698c6b896 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:49.306950 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-02af22bc-9bd3-4274-b0d7-3ec698c6b896 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea6653831a54a869daaba5e51fd04b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3481b55b9dfd4a25909a3fe6a03f06e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:22:49.314790 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-02af22bc-9bd3-4274-b0d7-3ec698c6b896 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] 10.222.0.52 "GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415" status: 200 len: 1371 microversion: 2.1 time: 0.154256 Sep 24 21:22:49.315368 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2945/5867] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:22:49 2022] GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:22:50.337256 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4a1f2d07-ab31-4ad3-9fee-32dfab132681 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:22:50.337879 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4a1f2d07-ab31-4ad3-9fee-32dfab132681 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] [instance: 50a8c390-9d7e-4ad1-a399-03090abee415] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:22:50.345526 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a1f2d07-ab31-4ad3-9fee-32dfab132681 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:50.346024 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a1f2d07-ab31-4ad3-9fee-32dfab132681 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:50.346525 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a1f2d07-ab31-4ad3-9fee-32dfab132681 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:50.347224 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a1f2d07-ab31-4ad3-9fee-32dfab132681 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:50.347686 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a1f2d07-ab31-4ad3-9fee-32dfab132681 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:50.348118 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4a1f2d07-ab31-4ad3-9fee-32dfab132681 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:50.489469 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4a1f2d07-ab31-4ad3-9fee-32dfab132681 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea6653831a54a869daaba5e51fd04b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3481b55b9dfd4a25909a3fe6a03f06e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:22:50.498076 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4a1f2d07-ab31-4ad3-9fee-32dfab132681 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] 10.222.0.52 "GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415" status: 200 len: 1371 microversion: 2.1 time: 0.164620 Sep 24 21:22:50.498692 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2923/5868] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:22:50 2022] GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:22:51.521434 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-81b7d520-56aa-4b74-a8d3-7d9cfca9b559 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:22:51.522053 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-81b7d520-56aa-4b74-a8d3-7d9cfca9b559 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] [instance: 50a8c390-9d7e-4ad1-a399-03090abee415] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:22:51.529808 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-81b7d520-56aa-4b74-a8d3-7d9cfca9b559 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:51.530296 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-81b7d520-56aa-4b74-a8d3-7d9cfca9b559 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:51.530788 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-81b7d520-56aa-4b74-a8d3-7d9cfca9b559 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:51.531497 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-81b7d520-56aa-4b74-a8d3-7d9cfca9b559 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:51.531958 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-81b7d520-56aa-4b74-a8d3-7d9cfca9b559 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:51.532391 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-81b7d520-56aa-4b74-a8d3-7d9cfca9b559 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:51.667320 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-81b7d520-56aa-4b74-a8d3-7d9cfca9b559 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea6653831a54a869daaba5e51fd04b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3481b55b9dfd4a25909a3fe6a03f06e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:22:51.675271 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-81b7d520-56aa-4b74-a8d3-7d9cfca9b559 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] 10.222.0.52 "GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415" status: 200 len: 1371 microversion: 2.1 time: 0.157971 Sep 24 21:22:51.675845 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2946/5869] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:22:51 2022] GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:22:52.071314 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-9dd5dbf2-5130-484b-9bd1-ee4ed6678fd1 req-72611e08-cd35-4ccb-821f-47b1b5905d49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a8c390-9d7e-4ad1-a399-03090abee415", "name": "network-vif-plugged", "status": "completed", "tag": "df9b4b3d-c42e-4fcf-a91e-21a8f7f72dfd"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:22:52.088120 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-9dd5dbf2-5130-484b-9bd1-ee4ed6678fd1 req-72611e08-cd35-4ccb-821f-47b1b5905d49 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:52.088614 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-9dd5dbf2-5130-484b-9bd1-ee4ed6678fd1 req-72611e08-cd35-4ccb-821f-47b1b5905d49 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:52.089059 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-9dd5dbf2-5130-484b-9bd1-ee4ed6678fd1 req-72611e08-cd35-4ccb-821f-47b1b5905d49 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:52.100826 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-9dd5dbf2-5130-484b-9bd1-ee4ed6678fd1 req-72611e08-cd35-4ccb-821f-47b1b5905d49 service nova] Creating event network-vif-plugged:df9b4b3d-c42e-4fcf-a91e-21a8f7f72dfd for instance 50a8c390-9d7e-4ad1-a399-03090abee415 on nch2-master-1 Sep 24 21:22:52.106529 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-9dd5dbf2-5130-484b-9bd1-ee4ed6678fd1 req-72611e08-cd35-4ccb-821f-47b1b5905d49 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039068 Sep 24 21:22:52.107704 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2924/5870] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:22:52.299501 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0aa9beea-bfee-412e-8cdd-b3a2a23f5aab tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:22:52.300116 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0aa9beea-bfee-412e-8cdd-b3a2a23f5aab tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 40731703-a782-4d3a-9557-4d896f056053] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:22:52.306075 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0aa9beea-bfee-412e-8cdd-b3a2a23f5aab tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:52.306601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0aa9beea-bfee-412e-8cdd-b3a2a23f5aab tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:52.307045 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0aa9beea-bfee-412e-8cdd-b3a2a23f5aab tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:52.307741 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0aa9beea-bfee-412e-8cdd-b3a2a23f5aab tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:52.308203 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0aa9beea-bfee-412e-8cdd-b3a2a23f5aab tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:52.309323 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0aa9beea-bfee-412e-8cdd-b3a2a23f5aab tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:52.445341 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0aa9beea-bfee-412e-8cdd-b3a2a23f5aab tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:22:52.453668 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0aa9beea-bfee-412e-8cdd-b3a2a23f5aab tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053" status: 200 len: 1682 microversion: 2.1 time: 0.158053 Sep 24 21:22:52.454246 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2947/5871] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:22:52 2022] GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:22:52.560841 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cb418c22-29a9-4bfd-8e27-21207b14f08b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:22:52.563179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cb418c22-29a9-4bfd-8e27-21207b14f08b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 40731703-a782-4d3a-9557-4d896f056053] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:22:52.569711 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb418c22-29a9-4bfd-8e27-21207b14f08b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:52.570182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb418c22-29a9-4bfd-8e27-21207b14f08b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:52.570668 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb418c22-29a9-4bfd-8e27-21207b14f08b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:52.571370 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb418c22-29a9-4bfd-8e27-21207b14f08b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:52.571823 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb418c22-29a9-4bfd-8e27-21207b14f08b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:52.572252 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb418c22-29a9-4bfd-8e27-21207b14f08b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:52.624631 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cb418c22-29a9-4bfd-8e27-21207b14f08b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "POST /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053/action" status: 200 len: 32633 microversion: 2.1 time: 0.068187 Sep 24 21:22:52.625284 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2925/5872] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:22:52 2022] POST /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053/action => generated 32633 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:22:52.697137 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-39f4aa01-a28b-4bb8-bb71-ad95c29a067c tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:22:52.697759 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-39f4aa01-a28b-4bb8-bb71-ad95c29a067c tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] [instance: 50a8c390-9d7e-4ad1-a399-03090abee415] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:22:52.704710 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-39f4aa01-a28b-4bb8-bb71-ad95c29a067c tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:52.705201 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-39f4aa01-a28b-4bb8-bb71-ad95c29a067c tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:52.705650 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-39f4aa01-a28b-4bb8-bb71-ad95c29a067c tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:52.706352 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-39f4aa01-a28b-4bb8-bb71-ad95c29a067c tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:52.706854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-39f4aa01-a28b-4bb8-bb71-ad95c29a067c tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:52.707297 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-39f4aa01-a28b-4bb8-bb71-ad95c29a067c tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:52.825825 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-00c72158-46ab-4e8a-8afd-ec0ad36a9428 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:22:52.826532 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-00c72158-46ab-4e8a-8afd-ec0ad36a9428 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] [instance: 40731703-a782-4d3a-9557-4d896f056053] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:22:52.834179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00c72158-46ab-4e8a-8afd-ec0ad36a9428 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:52.834727 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00c72158-46ab-4e8a-8afd-ec0ad36a9428 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:52.835178 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00c72158-46ab-4e8a-8afd-ec0ad36a9428 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:52.835915 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00c72158-46ab-4e8a-8afd-ec0ad36a9428 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:52.836379 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00c72158-46ab-4e8a-8afd-ec0ad36a9428 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:52.836810 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00c72158-46ab-4e8a-8afd-ec0ad36a9428 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:52.843192 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-39f4aa01-a28b-4bb8-bb71-ad95c29a067c tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea6653831a54a869daaba5e51fd04b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3481b55b9dfd4a25909a3fe6a03f06e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:22:52.851104 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-39f4aa01-a28b-4bb8-bb71-ad95c29a067c tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] 10.222.0.52 "GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415" status: 200 len: 1371 microversion: 2.1 time: 0.157863 Sep 24 21:22:52.851682 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2948/5873] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:22:52 2022] GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:22:52.969170 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-00c72158-46ab-4e8a-8afd-ec0ad36a9428 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053" status: 200 len: 1833 microversion: 2.1 time: 0.147614 Sep 24 21:22:52.969761 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2926/5874] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:22:52 2022] GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053 => generated 1833 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:22:52.998758 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0d9b70be-188a-4b10-9928-410f6ba0881e tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:22:53.001375 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0d9b70be-188a-4b10-9928-410f6ba0881e tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] [instance: 40731703-a782-4d3a-9557-4d896f056053] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:22:53.007514 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d9b70be-188a-4b10-9928-410f6ba0881e tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:53.008007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d9b70be-188a-4b10-9928-410f6ba0881e tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:53.008453 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d9b70be-188a-4b10-9928-410f6ba0881e tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:53.009154 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d9b70be-188a-4b10-9928-410f6ba0881e tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:53.009618 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d9b70be-188a-4b10-9928-410f6ba0881e tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:53.010058 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d9b70be-188a-4b10-9928-410f6ba0881e tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:53.046984 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-0d9b70be-188a-4b10-9928-410f6ba0881e tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Lazy-loading 'flavor' on Instance uuid 40731703-a782-4d3a-9557-4d896f056053 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:22:53.059492 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0d9b70be-188a-4b10-9928-410f6ba0881e tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] [instance: 40731703-a782-4d3a-9557-4d896f056053] Going to try to live migrate instance to another host {{(pid=140517) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 24 21:22:53.875789 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-28118507-ba9c-44ba-ba16-72ce4bfa4ba2 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:22:53.876523 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-28118507-ba9c-44ba-ba16-72ce4bfa4ba2 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] [instance: 50a8c390-9d7e-4ad1-a399-03090abee415] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:22:53.883618 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28118507-ba9c-44ba-ba16-72ce4bfa4ba2 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:53.884182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28118507-ba9c-44ba-ba16-72ce4bfa4ba2 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:53.884699 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28118507-ba9c-44ba-ba16-72ce4bfa4ba2 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:53.885482 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28118507-ba9c-44ba-ba16-72ce4bfa4ba2 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:53.886018 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28118507-ba9c-44ba-ba16-72ce4bfa4ba2 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:53.887182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-28118507-ba9c-44ba-ba16-72ce4bfa4ba2 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:54.032264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-28118507-ba9c-44ba-ba16-72ce4bfa4ba2 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea6653831a54a869daaba5e51fd04b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3481b55b9dfd4a25909a3fe6a03f06e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:22:54.040492 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-28118507-ba9c-44ba-ba16-72ce4bfa4ba2 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] 10.222.0.52 "GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415" status: 200 len: 1557 microversion: 2.1 time: 0.169573 Sep 24 21:22:54.041087 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2927/5875] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:22:53 2022] GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415 => generated 1557 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:22:54.063980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-001bd2b2-3a2e-4f13-a8ec-55ad2bd9ba1b tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:22:54.064483 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-001bd2b2-3a2e-4f13-a8ec-55ad2bd9ba1b tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] [instance: 50a8c390-9d7e-4ad1-a399-03090abee415] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:22:54.070419 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-001bd2b2-3a2e-4f13-a8ec-55ad2bd9ba1b tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:54.070949 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-001bd2b2-3a2e-4f13-a8ec-55ad2bd9ba1b tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:54.071398 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-001bd2b2-3a2e-4f13-a8ec-55ad2bd9ba1b tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:54.072103 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-001bd2b2-3a2e-4f13-a8ec-55ad2bd9ba1b tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:54.072564 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-001bd2b2-3a2e-4f13-a8ec-55ad2bd9ba1b tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:54.072999 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-001bd2b2-3a2e-4f13-a8ec-55ad2bd9ba1b tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:54.164949 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-001bd2b2-3a2e-4f13-a8ec-55ad2bd9ba1b tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] 10.222.0.52 "GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104626 Sep 24 21:22:54.165550 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2928/5876] 10.222.0.52 () {58 vars in 1275 bytes} [Sat Sep 24 21:22:54 2022] GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:22:54.606404 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0d9b70be-188a-4b10-9928-410f6ba0881e tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053/action" status: 202 len: 0 microversion: 2.1 time: 1.610500 Sep 24 21:22:54.611130 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2949/5877] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:22:52 2022] POST /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053/action => generated 0 bytes in 1617 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:22:54.617097 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d62eb644-e680-4afc-a760-2380acf41932 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:22:54.617708 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d62eb644-e680-4afc-a760-2380acf41932 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 40731703-a782-4d3a-9557-4d896f056053] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:22:54.633700 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d62eb644-e680-4afc-a760-2380acf41932 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:54.634838 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d62eb644-e680-4afc-a760-2380acf41932 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:54.635644 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d62eb644-e680-4afc-a760-2380acf41932 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:54.637833 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d62eb644-e680-4afc-a760-2380acf41932 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:54.638323 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d62eb644-e680-4afc-a760-2380acf41932 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:54.638790 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d62eb644-e680-4afc-a760-2380acf41932 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:54.905176 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d62eb644-e680-4afc-a760-2380acf41932 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:22:54.914258 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d62eb644-e680-4afc-a760-2380acf41932 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053" status: 200 len: 1692 microversion: 2.1 time: 0.301671 Sep 24 21:22:54.914876 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2929/5878] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:22:54 2022] GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053 => generated 1692 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:22:55.232487 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-951c8f41-8498-4a0c-b5e3-fbe65da18244 req-534b24dc-00b2-45ec-85d8-37aa1175584e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a8c390-9d7e-4ad1-a399-03090abee415", "tag": "df9b4b3d-c42e-4fcf-a91e-21a8f7f72dfd"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:22:55.244340 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-951c8f41-8498-4a0c-b5e3-fbe65da18244 req-534b24dc-00b2-45ec-85d8-37aa1175584e service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:55.245132 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-951c8f41-8498-4a0c-b5e3-fbe65da18244 req-534b24dc-00b2-45ec-85d8-37aa1175584e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:55.245650 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-951c8f41-8498-4a0c-b5e3-fbe65da18244 req-534b24dc-00b2-45ec-85d8-37aa1175584e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:55.257699 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-951c8f41-8498-4a0c-b5e3-fbe65da18244 req-534b24dc-00b2-45ec-85d8-37aa1175584e service nova] Creating event network-changed:df9b4b3d-c42e-4fcf-a91e-21a8f7f72dfd for instance 50a8c390-9d7e-4ad1-a399-03090abee415 on nch2-master-1 Sep 24 21:22:55.264058 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-951c8f41-8498-4a0c-b5e3-fbe65da18244 req-534b24dc-00b2-45ec-85d8-37aa1175584e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036078 Sep 24 21:22:55.264939 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2950/5879] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:22:55.940667 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b6cd8252-aeb8-4dc0-8162-e22adfd3ed0c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:22:55.942008 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b6cd8252-aeb8-4dc0-8162-e22adfd3ed0c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 40731703-a782-4d3a-9557-4d896f056053] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:22:55.949709 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6cd8252-aeb8-4dc0-8162-e22adfd3ed0c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:55.950599 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6cd8252-aeb8-4dc0-8162-e22adfd3ed0c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:55.951118 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6cd8252-aeb8-4dc0-8162-e22adfd3ed0c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:55.951927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6cd8252-aeb8-4dc0-8162-e22adfd3ed0c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:55.952609 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6cd8252-aeb8-4dc0-8162-e22adfd3ed0c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:55.953114 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6cd8252-aeb8-4dc0-8162-e22adfd3ed0c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:56.070128 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-9ef5fbd1-6c0c-4ed3-95f9-c1afd693ecb9 req-9b6f3382-32bf-430a-8aba-25ead6010ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40731703-a782-4d3a-9557-4d896f056053", "name": "network-vif-unplugged", "status": "completed", "tag": "114e0634-5f58-457c-9b5d-f7ebe4eb9b30"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:22:56.087941 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-9ef5fbd1-6c0c-4ed3-95f9-c1afd693ecb9 req-9b6f3382-32bf-430a-8aba-25ead6010ed3 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:56.088440 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-9ef5fbd1-6c0c-4ed3-95f9-c1afd693ecb9 req-9b6f3382-32bf-430a-8aba-25ead6010ed3 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:56.089462 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-9ef5fbd1-6c0c-4ed3-95f9-c1afd693ecb9 req-9b6f3382-32bf-430a-8aba-25ead6010ed3 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:56.101743 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-9ef5fbd1-6c0c-4ed3-95f9-c1afd693ecb9 req-9b6f3382-32bf-430a-8aba-25ead6010ed3 service nova] Creating event network-vif-unplugged:114e0634-5f58-457c-9b5d-f7ebe4eb9b30 for instance 40731703-a782-4d3a-9557-4d896f056053 on nch1-master-1 Sep 24 21:22:56.107267 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-9ef5fbd1-6c0c-4ed3-95f9-c1afd693ecb9 req-9b6f3382-32bf-430a-8aba-25ead6010ed3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049206 Sep 24 21:22:56.108200 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2951/5880] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:22:56.122532 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b6cd8252-aeb8-4dc0-8162-e22adfd3ed0c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:22:56.130732 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b6cd8252-aeb8-4dc0-8162-e22adfd3ed0c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053" status: 200 len: 1692 microversion: 2.1 time: 0.195310 Sep 24 21:22:56.131309 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2930/5881] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:22:55 2022] GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053 => generated 1692 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:22:57.157943 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-be4e98b1-0f30-4cfc-88e1-78ca2f2ddbcb tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:22:57.158694 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-be4e98b1-0f30-4cfc-88e1-78ca2f2ddbcb tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 40731703-a782-4d3a-9557-4d896f056053] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:22:57.164880 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-be4e98b1-0f30-4cfc-88e1-78ca2f2ddbcb tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:57.165370 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-be4e98b1-0f30-4cfc-88e1-78ca2f2ddbcb tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:57.165815 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-be4e98b1-0f30-4cfc-88e1-78ca2f2ddbcb tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:57.166534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-be4e98b1-0f30-4cfc-88e1-78ca2f2ddbcb tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:57.167006 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-be4e98b1-0f30-4cfc-88e1-78ca2f2ddbcb tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:57.167441 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-be4e98b1-0f30-4cfc-88e1-78ca2f2ddbcb tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:57.303965 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-be4e98b1-0f30-4cfc-88e1-78ca2f2ddbcb tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:22:57.312490 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-be4e98b1-0f30-4cfc-88e1-78ca2f2ddbcb tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053" status: 200 len: 1692 microversion: 2.1 time: 0.160292 Sep 24 21:22:57.313078 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2952/5882] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:22:57 2022] GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:22:58.123246 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-7e2f37cd-8299-419c-bfab-eb07684ace48 req-882eac6c-e5ed-4a10-9ba6-2820aacd7613 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40731703-a782-4d3a-9557-4d896f056053", "tag": "114e0634-5f58-457c-9b5d-f7ebe4eb9b30"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:22:58.133690 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-7e2f37cd-8299-419c-bfab-eb07684ace48 req-882eac6c-e5ed-4a10-9ba6-2820aacd7613 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:58.134184 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-7e2f37cd-8299-419c-bfab-eb07684ace48 req-882eac6c-e5ed-4a10-9ba6-2820aacd7613 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:58.134636 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-7e2f37cd-8299-419c-bfab-eb07684ace48 req-882eac6c-e5ed-4a10-9ba6-2820aacd7613 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:58.146373 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-7e2f37cd-8299-419c-bfab-eb07684ace48 req-882eac6c-e5ed-4a10-9ba6-2820aacd7613 service nova] Creating event network-changed:114e0634-5f58-457c-9b5d-f7ebe4eb9b30 for instance 40731703-a782-4d3a-9557-4d896f056053 on nch1-master-1 Sep 24 21:22:58.151345 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-7e2f37cd-8299-419c-bfab-eb07684ace48 req-882eac6c-e5ed-4a10-9ba6-2820aacd7613 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032767 Sep 24 21:22:58.151959 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2931/5883] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:22:58.336455 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-32437ad3-02d2-4f2b-8afc-610e3128e79c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:22:58.338011 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-32437ad3-02d2-4f2b-8afc-610e3128e79c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 40731703-a782-4d3a-9557-4d896f056053] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:22:58.345586 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-32437ad3-02d2-4f2b-8afc-610e3128e79c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:58.346095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-32437ad3-02d2-4f2b-8afc-610e3128e79c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:58.346572 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-32437ad3-02d2-4f2b-8afc-610e3128e79c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:58.347340 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-32437ad3-02d2-4f2b-8afc-610e3128e79c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:58.347806 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-32437ad3-02d2-4f2b-8afc-610e3128e79c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:58.348243 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-32437ad3-02d2-4f2b-8afc-610e3128e79c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:58.486058 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-32437ad3-02d2-4f2b-8afc-610e3128e79c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:22:58.494294 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-32437ad3-02d2-4f2b-8afc-610e3128e79c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053" status: 200 len: 1692 microversion: 2.1 time: 0.161885 Sep 24 21:22:58.494917 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2953/5884] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:22:58 2022] GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053 => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:22:59.521077 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-616bc995-003f-4078-b2d7-13de4adc6bc6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:22:59.522464 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-616bc995-003f-4078-b2d7-13de4adc6bc6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 40731703-a782-4d3a-9557-4d896f056053] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:22:59.529175 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-616bc995-003f-4078-b2d7-13de4adc6bc6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:59.529680 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-616bc995-003f-4078-b2d7-13de4adc6bc6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:59.530130 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-616bc995-003f-4078-b2d7-13de4adc6bc6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:59.530890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-616bc995-003f-4078-b2d7-13de4adc6bc6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:22:59.531353 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-616bc995-003f-4078-b2d7-13de4adc6bc6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:22:59.531789 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-616bc995-003f-4078-b2d7-13de4adc6bc6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:22:59.672498 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-616bc995-003f-4078-b2d7-13de4adc6bc6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:22:59.680431 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-616bc995-003f-4078-b2d7-13de4adc6bc6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053" status: 200 len: 1692 microversion: 2.1 time: 0.164802 Sep 24 21:22:59.680991 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2932/5885] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:22:59 2022] GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053 => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:23:00.704836 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2d603441-1c7a-49b6-a3d7-1001a98df01c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:23:00.705463 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2d603441-1c7a-49b6-a3d7-1001a98df01c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 40731703-a782-4d3a-9557-4d896f056053] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:23:00.712132 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d603441-1c7a-49b6-a3d7-1001a98df01c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:00.712624 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d603441-1c7a-49b6-a3d7-1001a98df01c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:00.713073 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d603441-1c7a-49b6-a3d7-1001a98df01c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:00.713774 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d603441-1c7a-49b6-a3d7-1001a98df01c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:00.714358 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d603441-1c7a-49b6-a3d7-1001a98df01c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:00.714886 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d603441-1c7a-49b6-a3d7-1001a98df01c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:00.844780 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2d603441-1c7a-49b6-a3d7-1001a98df01c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:23:00.852692 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2d603441-1c7a-49b6-a3d7-1001a98df01c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053" status: 200 len: 1692 microversion: 2.1 time: 0.151940 Sep 24 21:23:00.853273 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2954/5886] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:23:00 2022] GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053 => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:23:01.876915 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-82fa3a2a-3172-4127-a8f9-18cdf87f2dd7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:23:01.877535 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-82fa3a2a-3172-4127-a8f9-18cdf87f2dd7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 40731703-a782-4d3a-9557-4d896f056053] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:23:01.884475 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-82fa3a2a-3172-4127-a8f9-18cdf87f2dd7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:01.884959 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-82fa3a2a-3172-4127-a8f9-18cdf87f2dd7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:01.885398 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-82fa3a2a-3172-4127-a8f9-18cdf87f2dd7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:01.886165 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-82fa3a2a-3172-4127-a8f9-18cdf87f2dd7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:01.887152 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-82fa3a2a-3172-4127-a8f9-18cdf87f2dd7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:01.887583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-82fa3a2a-3172-4127-a8f9-18cdf87f2dd7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:02.018103 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-82fa3a2a-3172-4127-a8f9-18cdf87f2dd7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:23:02.026289 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-82fa3a2a-3172-4127-a8f9-18cdf87f2dd7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053" status: 200 len: 1692 microversion: 2.1 time: 0.153309 Sep 24 21:23:02.027136 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2933/5887] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:23:01 2022] GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053 => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:23:03.049671 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8298da05-cdca-4ed8-ad95-a8d5389453ff tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:23:03.050319 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8298da05-cdca-4ed8-ad95-a8d5389453ff tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 40731703-a782-4d3a-9557-4d896f056053] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:23:03.057724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8298da05-cdca-4ed8-ad95-a8d5389453ff tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:03.058278 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8298da05-cdca-4ed8-ad95-a8d5389453ff tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:03.059121 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8298da05-cdca-4ed8-ad95-a8d5389453ff tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:03.059601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8298da05-cdca-4ed8-ad95-a8d5389453ff tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:03.060072 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8298da05-cdca-4ed8-ad95-a8d5389453ff tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:03.060500 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8298da05-cdca-4ed8-ad95-a8d5389453ff tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:03.205355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8298da05-cdca-4ed8-ad95-a8d5389453ff tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:23:03.213170 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8298da05-cdca-4ed8-ad95-a8d5389453ff tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053" status: 200 len: 1692 microversion: 2.1 time: 0.167495 Sep 24 21:23:03.213751 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2955/5888] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:23:03 2022] GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053 => generated 1692 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:23:04.238001 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-25df7e21-f302-420d-9bdd-405d7967388d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:23:04.238826 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-25df7e21-f302-420d-9bdd-405d7967388d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 40731703-a782-4d3a-9557-4d896f056053] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:23:04.245999 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-25df7e21-f302-420d-9bdd-405d7967388d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:04.246486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-25df7e21-f302-420d-9bdd-405d7967388d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:04.246965 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-25df7e21-f302-420d-9bdd-405d7967388d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:04.247678 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-25df7e21-f302-420d-9bdd-405d7967388d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:04.248138 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-25df7e21-f302-420d-9bdd-405d7967388d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:04.248643 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-25df7e21-f302-420d-9bdd-405d7967388d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:04.414811 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-25df7e21-f302-420d-9bdd-405d7967388d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:23:04.425648 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-25df7e21-f302-420d-9bdd-405d7967388d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053" status: 200 len: 1682 microversion: 2.1 time: 0.192171 Sep 24 21:23:04.426253 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2934/5889] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:23:04 2022] GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053 => generated 1682 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:23:04.451299 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e5ab5e47-8d41-4751-b7e4-bdf236e8e418 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:23:04.452527 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e5ab5e47-8d41-4751-b7e4-bdf236e8e418 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] [instance: 40731703-a782-4d3a-9557-4d896f056053] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:23:04.460226 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5ab5e47-8d41-4751-b7e4-bdf236e8e418 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:04.461067 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5ab5e47-8d41-4751-b7e4-bdf236e8e418 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:04.461570 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5ab5e47-8d41-4751-b7e4-bdf236e8e418 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:04.462350 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5ab5e47-8d41-4751-b7e4-bdf236e8e418 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:04.463324 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5ab5e47-8d41-4751-b7e4-bdf236e8e418 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:04.463831 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e5ab5e47-8d41-4751-b7e4-bdf236e8e418 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:04.485102 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:23:04.632862 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e5ab5e47-8d41-4751-b7e4-bdf236e8e418 tempest-TestNetworkAdvancedServerOps-1550036802 tempest-TestNetworkAdvancedServerOps-1550036802-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053" status: 200 len: 1833 microversion: 2.1 time: 0.186435 Sep 24 21:23:04.633447 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2956/5890] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:23:04 2022] GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053 => generated 1833 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:23:04.662001 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3a16ef61-642d-400f-b409-a585e9801c30 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:23:04.662658 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3a16ef61-642d-400f-b409-a585e9801c30 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 40731703-a782-4d3a-9557-4d896f056053] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:23:04.669863 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3a16ef61-642d-400f-b409-a585e9801c30 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:04.670388 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3a16ef61-642d-400f-b409-a585e9801c30 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:04.670988 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3a16ef61-642d-400f-b409-a585e9801c30 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:04.672255 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3a16ef61-642d-400f-b409-a585e9801c30 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:04.673097 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3a16ef61-642d-400f-b409-a585e9801c30 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:04.673907 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3a16ef61-642d-400f-b409-a585e9801c30 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:04.814348 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3a16ef61-642d-400f-b409-a585e9801c30 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:23:04.822564 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3a16ef61-642d-400f-b409-a585e9801c30 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053" status: 200 len: 1682 microversion: 2.1 time: 0.167081 Sep 24 21:23:04.823161 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2935/5891] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:23:04 2022] GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:23:04.922291 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-84d22814-eef4-43e3-a43a-c12cc33350fa tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:23:04.924576 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-84d22814-eef4-43e3-a43a-c12cc33350fa tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 40731703-a782-4d3a-9557-4d896f056053] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:23:04.930776 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84d22814-eef4-43e3-a43a-c12cc33350fa tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:04.931268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84d22814-eef4-43e3-a43a-c12cc33350fa tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:04.931733 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84d22814-eef4-43e3-a43a-c12cc33350fa tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:04.932448 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84d22814-eef4-43e3-a43a-c12cc33350fa tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:04.933539 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84d22814-eef4-43e3-a43a-c12cc33350fa tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:04.933987 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84d22814-eef4-43e3-a43a-c12cc33350fa tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:05.007758 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-84d22814-eef4-43e3-a43a-c12cc33350fa tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "POST /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053/action" status: 200 len: 38451 microversion: 2.1 time: 0.089180 Sep 24 21:23:05.008569 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2957/5892] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:23:04 2022] POST /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053/action => generated 38451 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 21:23:06.031145 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a3ced97a-c7f9-4296-ad52-f9b214bcf1a4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:23:06.031854 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a3ced97a-c7f9-4296-ad52-f9b214bcf1a4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 40731703-a782-4d3a-9557-4d896f056053] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:23:06.033619 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-15aebdf5-29f5-4ee0-9853-d19e720a9480 req-b9d02ecc-dd55-4686-a9a1-77cdc8d2f83a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40731703-a782-4d3a-9557-4d896f056053", "tag": "114e0634-5f58-457c-9b5d-f7ebe4eb9b30"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:23:06.036209 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:23:06.040227 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3ced97a-c7f9-4296-ad52-f9b214bcf1a4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:06.040817 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3ced97a-c7f9-4296-ad52-f9b214bcf1a4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:06.041360 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3ced97a-c7f9-4296-ad52-f9b214bcf1a4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:06.042230 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3ced97a-c7f9-4296-ad52-f9b214bcf1a4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:06.042788 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3ced97a-c7f9-4296-ad52-f9b214bcf1a4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:06.043288 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3ced97a-c7f9-4296-ad52-f9b214bcf1a4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:06.046233 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-15aebdf5-29f5-4ee0-9853-d19e720a9480 req-b9d02ecc-dd55-4686-a9a1-77cdc8d2f83a service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:06.046756 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-15aebdf5-29f5-4ee0-9853-d19e720a9480 req-b9d02ecc-dd55-4686-a9a1-77cdc8d2f83a service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:06.047194 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-15aebdf5-29f5-4ee0-9853-d19e720a9480 req-b9d02ecc-dd55-4686-a9a1-77cdc8d2f83a service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:06.048933 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=97 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:23:06.060670 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-15aebdf5-29f5-4ee0-9853-d19e720a9480 req-b9d02ecc-dd55-4686-a9a1-77cdc8d2f83a service nova] Creating event network-changed:114e0634-5f58-457c-9b5d-f7ebe4eb9b30 for instance 40731703-a782-4d3a-9557-4d896f056053 on nch2-master-1 Sep 24 21:23:06.065849 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-15aebdf5-29f5-4ee0-9853-d19e720a9480 req-b9d02ecc-dd55-4686-a9a1-77cdc8d2f83a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036140 Sep 24 21:23:06.066813 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2958/5893] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:23:06.074894 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a3ced97a-c7f9-4296-ad52-f9b214bcf1a4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 40731703-a782-4d3a-9557-4d896f056053] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:23:06.159419 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a3ced97a-c7f9-4296-ad52-f9b214bcf1a4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "DELETE /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053" status: 204 len: 0 microversion: 2.1 time: 0.132332 Sep 24 21:23:06.160444 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2936/5894] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:23:06 2022] DELETE /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:23:06.170238 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cba39238-7a36-4e60-b573-2a01867c0ce3 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:23:06.170985 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cba39238-7a36-4e60-b573-2a01867c0ce3 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 40731703-a782-4d3a-9557-4d896f056053] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:23:06.178052 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cba39238-7a36-4e60-b573-2a01867c0ce3 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:06.178671 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cba39238-7a36-4e60-b573-2a01867c0ce3 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:06.179122 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cba39238-7a36-4e60-b573-2a01867c0ce3 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:06.179838 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cba39238-7a36-4e60-b573-2a01867c0ce3 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:06.180305 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cba39238-7a36-4e60-b573-2a01867c0ce3 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:06.180735 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cba39238-7a36-4e60-b573-2a01867c0ce3 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:06.655382 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cba39238-7a36-4e60-b573-2a01867c0ce3 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:23:06.663164 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cba39238-7a36-4e60-b573-2a01867c0ce3 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053" status: 200 len: 1688 microversion: 2.1 time: 0.498081 Sep 24 21:23:06.663746 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2959/5895] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:23:06 2022] GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053 => generated 1688 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:23:07.688553 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-37952597-95a1-4752-9aa0-722cd550c21a tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:23:07.689199 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-37952597-95a1-4752-9aa0-722cd550c21a tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 40731703-a782-4d3a-9557-4d896f056053] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:23:07.696004 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-37952597-95a1-4752-9aa0-722cd550c21a tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:07.696496 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-37952597-95a1-4752-9aa0-722cd550c21a tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:07.696941 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-37952597-95a1-4752-9aa0-722cd550c21a tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:07.697648 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-37952597-95a1-4752-9aa0-722cd550c21a tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:07.698108 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-37952597-95a1-4752-9aa0-722cd550c21a tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:07.699193 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-37952597-95a1-4752-9aa0-722cd550c21a tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:07.732390 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-37952597-95a1-4752-9aa0-722cd550c21a tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:07.732877 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-37952597-95a1-4752-9aa0-722cd550c21a tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:07.733319 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-37952597-95a1-4752-9aa0-722cd550c21a tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:07.733852 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-37952597-95a1-4752-9aa0-722cd550c21a tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lazy-loading 'fault' on Instance uuid 40731703-a782-4d3a-9557-4d896f056053 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:23:07.793635 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-37952597-95a1-4752-9aa0-722cd550c21a tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:23:07.801540 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-37952597-95a1-4752-9aa0-722cd550c21a tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053" status: 200 len: 1357 microversion: 2.1 time: 0.117374 Sep 24 21:23:07.802206 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2937/5896] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:23:07 2022] GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053 => generated 1357 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:23:08.080544 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-f2cb1c8c-8cff-4c7d-a2ef-4bc52f27064e req-19cbcaac-4c28-4627-9d03-e40ab21ac62f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40731703-a782-4d3a-9557-4d896f056053", "name": "network-vif-deleted", "tag": "114e0634-5f58-457c-9b5d-f7ebe4eb9b30"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:23:08.086255 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:23:08.093477 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-f2cb1c8c-8cff-4c7d-a2ef-4bc52f27064e req-19cbcaac-4c28-4627-9d03-e40ab21ac62f service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:08.093964 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-f2cb1c8c-8cff-4c7d-a2ef-4bc52f27064e req-19cbcaac-4c28-4627-9d03-e40ab21ac62f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:08.094404 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-f2cb1c8c-8cff-4c7d-a2ef-4bc52f27064e req-19cbcaac-4c28-4627-9d03-e40ab21ac62f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:08.106122 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-f2cb1c8c-8cff-4c7d-a2ef-4bc52f27064e req-19cbcaac-4c28-4627-9d03-e40ab21ac62f service nova] Creating event network-vif-deleted:114e0634-5f58-457c-9b5d-f7ebe4eb9b30 for instance 40731703-a782-4d3a-9557-4d896f056053 on nch2-master-1 Sep 24 21:23:08.111034 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-f2cb1c8c-8cff-4c7d-a2ef-4bc52f27064e req-19cbcaac-4c28-4627-9d03-e40ab21ac62f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034368 Sep 24 21:23:08.111620 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2960/5897] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:23:08.826237 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-485d16b7-3a63-4ff2-a10b-3bd4d167833e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:23:08.826882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-485d16b7-3a63-4ff2-a10b-3bd4d167833e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 40731703-a782-4d3a-9557-4d896f056053] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:23:08.833851 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-485d16b7-3a63-4ff2-a10b-3bd4d167833e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:08.834342 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-485d16b7-3a63-4ff2-a10b-3bd4d167833e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:08.834837 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-485d16b7-3a63-4ff2-a10b-3bd4d167833e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:08.835539 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-485d16b7-3a63-4ff2-a10b-3bd4d167833e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:08.836004 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-485d16b7-3a63-4ff2-a10b-3bd4d167833e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:08.836439 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-485d16b7-3a63-4ff2-a10b-3bd4d167833e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:08.849771 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-485d16b7-3a63-4ff2-a10b-3bd4d167833e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] HTTP exception thrown: Instance 40731703-a782-4d3a-9557-4d896f056053 could not be found. Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-485d16b7-3a63-4ff2-a10b-3bd4d167833e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Request method failure captured: Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053 HTTP/1.1 Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3OCLEGvCgXQkF150J8WxaJ6Egfirp5WYU549-Kd58eqlMFmsTZ5EPhwnMOzai9maVUW5D3Dnd0VpB4KutZpZm5Xvo1jNqQCDPx_Xyeb8QSTxhIJvz1mFjCjXsZ8t-QiX5KDB4ZcWr8p8qona_16KbypzpGW3AGYhC3XCYDXOZAEBUo Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: a5c4c9ce4cb946a9a381271ab15aee09 Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1280777913 Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5c4c9ce4cb946a9a381271ab15aee09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a5c4c9ce4cb946a9a381271ab15aee09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a5c4c9ce4cb946a9a381271ab15aee09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5c4c9ce4cb946a9a381271ab15aee09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1280777913 Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: a5c4c9ce4cb946a9a381271ab15aee09 Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1280777913 Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-TestNetworkAdvancedServerOps-1280777913-project Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 82c2160fcae947138ddd7b1b4df1e361 Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1280777913-project Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 40731703-a782-4d3a-9557-4d896f056053 could not be found. Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '40731703-a782-4d3a-9557-4d896f056053'} Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40731703-a782-4d3a-9557-4d896f056053 could not be found. Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40731703-a782-4d3a-9557-4d896f056053 could not be found. Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:23:08.851467 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:23:08.856840 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:23:08.856840 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:23:08.856840 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:23:08.856840 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:23:08.856840 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:23:08.856840 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:23:08.856840 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40731703-a782-4d3a-9557-4d896f056053 could not be found. Sep 24 21:23:08.856840 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:23:08.856840 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-485d16b7-3a63-4ff2-a10b-3bd4d167833e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Returning 404 to user: Instance 40731703-a782-4d3a-9557-4d896f056053 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:23:08.856840 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-485d16b7-3a63-4ff2-a10b-3bd4d167833e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053" status: 404 len: 111 microversion: 2.1 time: 0.031176 Sep 24 21:23:08.856840 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2938/5898] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:23:08 2022] GET /compute/v2.1/servers/40731703-a782-4d3a-9557-4d896f056053 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:23:11.836330 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3f5d244a-3f4c-47f4-a5f3-882b203bb641 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '.version_select at 0x7f4b0ce9a310>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:23:11.858758 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3f5d244a-3f4c-47f4-a5f3-882b203bb641 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1209747293" status: 202 len: 0 microversion: 2.1 time: 0.026551 Sep 24 21:23:11.863071 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2961/5899] 10.222.0.52 () {58 vars in 1284 bytes} [Sat Sep 24 21:23:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1209747293 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:23:11.890299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fd32f21c-e0cd-487c-9cd2-7ec93ab33419 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Action: 'create', calling method: .version_select at 0x7f4b0ca4eb80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-644791497", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqcJT49iaeT7rh0vwgONq19IqtUVgBcTE9oEjqcRFizHd86HxetqKxIUMY4LwdnZs41QaEIo1NOn30iDbr0/n+9vCXLQ/hAcV8cN0gv18x3KwlXDEt4HT3aEbtixsr/Dw=="}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:23:11.907310 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-fd32f21c-e0cd-487c-9cd2-7ec93ab33419 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Getting quotas for project a5c4c9ce4cb946a9a381271ab15aee09. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:23:11.913313 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-fd32f21c-e0cd-487c-9cd2-7ec93ab33419 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Getting quotas for user 82c2160fcae947138ddd7b1b4df1e361 and project a5c4c9ce4cb946a9a381271ab15aee09. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:23:11.938478 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fd32f21c-e0cd-487c-9cd2-7ec93ab33419 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.052857 Sep 24 21:23:11.939110 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2939/5900] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 21:23:11 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:23:17.596089 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6604c848-b746-4135-bf02-48eda09dcf8e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1869721818", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "6c0e9ae8-0025-4bc8-91c9-6e465f30939d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-644791497", "security_groups": [{"name": "tempest-secgroup-smoke-1111130610"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:23:17.717092 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-6604c848-b746-4135-bf02-48eda09dcf8e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] validate_networks() for [('6c0e9ae8-0025-4bc8-91c9-6e465f30939d', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:23:18.100346 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=16 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:23:18.143074 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-6604c848-b746-4135-bf02-48eda09dcf8e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:23:18.143507 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-6604c848-b746-4135-bf02-48eda09dcf8e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:23:18.143995 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-6604c848-b746-4135-bf02-48eda09dcf8e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:23:18.144731 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-6604c848-b746-4135-bf02-48eda09dcf8e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:23:18.145156 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-6604c848-b746-4135-bf02-48eda09dcf8e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:23:18.155737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6604c848-b746-4135-bf02-48eda09dcf8e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:18.156236 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6604c848-b746-4135-bf02-48eda09dcf8e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:18.156684 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6604c848-b746-4135-bf02-48eda09dcf8e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:18.157430 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6604c848-b746-4135-bf02-48eda09dcf8e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:18.157901 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6604c848-b746-4135-bf02-48eda09dcf8e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:18.158335 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6604c848-b746-4135-bf02-48eda09dcf8e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:18.177669 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-6604c848-b746-4135-bf02-48eda09dcf8e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Getting quotas for project a5c4c9ce4cb946a9a381271ab15aee09. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:23:18.183318 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-6604c848-b746-4135-bf02-48eda09dcf8e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Getting quotas for user 82c2160fcae947138ddd7b1b4df1e361 and project a5c4c9ce4cb946a9a381271ab15aee09. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:23:18.204317 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6604c848-b746-4135-bf02-48eda09dcf8e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:23:18.206815 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6604c848-b746-4135-bf02-48eda09dcf8e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 96ebebed-0f53-4f0c-b21a-0b09b0665bc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:23:18.279024 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6604c848-b746-4135-bf02-48eda09dcf8e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.687669 Sep 24 21:23:18.280582 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2962/5901] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:23:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:23:18.297257 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1e07f0fc-533c-4acc-b019-18c97554930e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:23:18.298691 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1e07f0fc-533c-4acc-b019-18c97554930e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 96ebebed-0f53-4f0c-b21a-0b09b0665bc6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:23:18.373882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1e07f0fc-533c-4acc-b019-18c97554930e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:23:18.386932 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1e07f0fc-533c-4acc-b019-18c97554930e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6" status: 200 len: 1266 microversion: 2.1 time: 0.098274 Sep 24 21:23:18.388133 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2940/5902] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:23:18 2022] GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6 => generated 1266 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:23:19.414158 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4faf35f1-975a-4b00-ba27-8a58f046cdf0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:23:19.414877 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4faf35f1-975a-4b00-ba27-8a58f046cdf0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 96ebebed-0f53-4f0c-b21a-0b09b0665bc6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:23:19.426333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4faf35f1-975a-4b00-ba27-8a58f046cdf0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:19.427158 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4faf35f1-975a-4b00-ba27-8a58f046cdf0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:19.427795 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4faf35f1-975a-4b00-ba27-8a58f046cdf0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:19.428707 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4faf35f1-975a-4b00-ba27-8a58f046cdf0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:19.429340 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4faf35f1-975a-4b00-ba27-8a58f046cdf0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:19.429942 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4faf35f1-975a-4b00-ba27-8a58f046cdf0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:19.512332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4faf35f1-975a-4b00-ba27-8a58f046cdf0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:23:19.522857 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4faf35f1-975a-4b00-ba27-8a58f046cdf0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6" status: 200 len: 1326 microversion: 2.1 time: 0.113369 Sep 24 21:23:19.523685 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2963/5903] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:23:19 2022] GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6 => generated 1326 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:23:20.547672 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bf6025d5-1fd5-4783-931f-58066a9aaf22 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:23:20.549007 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-bf6025d5-1fd5-4783-931f-58066a9aaf22 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 96ebebed-0f53-4f0c-b21a-0b09b0665bc6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:23:20.552556 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:23:20.559880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bf6025d5-1fd5-4783-931f-58066a9aaf22 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:20.560525 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bf6025d5-1fd5-4783-931f-58066a9aaf22 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:20.561217 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bf6025d5-1fd5-4783-931f-58066a9aaf22 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:20.561936 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bf6025d5-1fd5-4783-931f-58066a9aaf22 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:20.562396 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bf6025d5-1fd5-4783-931f-58066a9aaf22 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:20.562856 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bf6025d5-1fd5-4783-931f-58066a9aaf22 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:20.721976 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-bf6025d5-1fd5-4783-931f-58066a9aaf22 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:23:20.732357 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bf6025d5-1fd5-4783-931f-58066a9aaf22 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6" status: 200 len: 1392 microversion: 2.1 time: 0.188475 Sep 24 21:23:20.733063 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2941/5904] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:23:20 2022] GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6 => generated 1392 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:23:21.272079 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-dfa7a38f-a1e9-4244-a884-5d214145cf45 req-f6088906-0215-400d-b92d-195b3962c52f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96ebebed-0f53-4f0c-b21a-0b09b0665bc6", "tag": "b49bf1e2-3e0a-4360-84dc-c9e4304449a9"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:23:21.284898 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-dfa7a38f-a1e9-4244-a884-5d214145cf45 req-f6088906-0215-400d-b92d-195b3962c52f service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:21.285382 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-dfa7a38f-a1e9-4244-a884-5d214145cf45 req-f6088906-0215-400d-b92d-195b3962c52f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:21.285817 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-dfa7a38f-a1e9-4244-a884-5d214145cf45 req-f6088906-0215-400d-b92d-195b3962c52f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:21.298696 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-dfa7a38f-a1e9-4244-a884-5d214145cf45 req-f6088906-0215-400d-b92d-195b3962c52f service nova] Creating event network-changed:b49bf1e2-3e0a-4360-84dc-c9e4304449a9 for instance 96ebebed-0f53-4f0c-b21a-0b09b0665bc6 on nch1-master-1 Sep 24 21:23:21.304759 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-dfa7a38f-a1e9-4244-a884-5d214145cf45 req-f6088906-0215-400d-b92d-195b3962c52f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036921 Sep 24 21:23:21.305369 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2964/5905] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:23:21.756251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-89fe49ad-b317-469f-8e3f-d1a9ca77c426 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:23:21.756854 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-89fe49ad-b317-469f-8e3f-d1a9ca77c426 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 96ebebed-0f53-4f0c-b21a-0b09b0665bc6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:23:21.764482 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89fe49ad-b317-469f-8e3f-d1a9ca77c426 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:21.764965 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89fe49ad-b317-469f-8e3f-d1a9ca77c426 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:21.765411 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89fe49ad-b317-469f-8e3f-d1a9ca77c426 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:21.766114 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89fe49ad-b317-469f-8e3f-d1a9ca77c426 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:21.766600 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89fe49ad-b317-469f-8e3f-d1a9ca77c426 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:21.767058 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89fe49ad-b317-469f-8e3f-d1a9ca77c426 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:21.903002 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-89fe49ad-b317-469f-8e3f-d1a9ca77c426 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:23:21.910746 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-89fe49ad-b317-469f-8e3f-d1a9ca77c426 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6" status: 200 len: 1392 microversion: 2.1 time: 0.158549 Sep 24 21:23:21.911323 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2942/5906] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:23:21 2022] GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:23:22.935411 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-48232b6f-2e7c-42b9-8009-a87289639bd5 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:23:22.936042 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-48232b6f-2e7c-42b9-8009-a87289639bd5 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 96ebebed-0f53-4f0c-b21a-0b09b0665bc6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:23:22.942304 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-48232b6f-2e7c-42b9-8009-a87289639bd5 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:22.942843 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-48232b6f-2e7c-42b9-8009-a87289639bd5 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:22.943291 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-48232b6f-2e7c-42b9-8009-a87289639bd5 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:22.944021 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-48232b6f-2e7c-42b9-8009-a87289639bd5 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:22.944487 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-48232b6f-2e7c-42b9-8009-a87289639bd5 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:22.944921 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-48232b6f-2e7c-42b9-8009-a87289639bd5 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:23.082185 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-48232b6f-2e7c-42b9-8009-a87289639bd5 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:23:23.092043 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-48232b6f-2e7c-42b9-8009-a87289639bd5 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6" status: 200 len: 1392 microversion: 2.1 time: 0.161365 Sep 24 21:23:23.092662 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2965/5907] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:23:22 2022] GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:23:24.116115 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2526ea88-185c-4d77-8e24-fde380927996 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:23:24.116739 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2526ea88-185c-4d77-8e24-fde380927996 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 96ebebed-0f53-4f0c-b21a-0b09b0665bc6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:23:24.124539 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2526ea88-185c-4d77-8e24-fde380927996 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:24.125315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2526ea88-185c-4d77-8e24-fde380927996 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:24.125765 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2526ea88-185c-4d77-8e24-fde380927996 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:24.126490 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2526ea88-185c-4d77-8e24-fde380927996 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:24.126978 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2526ea88-185c-4d77-8e24-fde380927996 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:24.127433 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2526ea88-185c-4d77-8e24-fde380927996 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:24.262149 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2526ea88-185c-4d77-8e24-fde380927996 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:23:24.270183 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2526ea88-185c-4d77-8e24-fde380927996 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6" status: 200 len: 1392 microversion: 2.1 time: 0.157953 Sep 24 21:23:24.270852 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2943/5908] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:23:24 2022] GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:23:25.293891 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f1dd7fcd-f5af-4ad3-b863-380583ee128c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:23:25.294524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f1dd7fcd-f5af-4ad3-b863-380583ee128c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 96ebebed-0f53-4f0c-b21a-0b09b0665bc6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:23:25.301948 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f1dd7fcd-f5af-4ad3-b863-380583ee128c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:25.302431 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f1dd7fcd-f5af-4ad3-b863-380583ee128c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:25.302934 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f1dd7fcd-f5af-4ad3-b863-380583ee128c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:25.303631 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f1dd7fcd-f5af-4ad3-b863-380583ee128c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:25.304083 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f1dd7fcd-f5af-4ad3-b863-380583ee128c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:25.304509 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f1dd7fcd-f5af-4ad3-b863-380583ee128c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:25.442898 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f1dd7fcd-f5af-4ad3-b863-380583ee128c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:23:25.450954 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f1dd7fcd-f5af-4ad3-b863-380583ee128c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6" status: 200 len: 1392 microversion: 2.1 time: 0.160994 Sep 24 21:23:25.451524 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2966/5909] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:23:25 2022] GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:23:26.473801 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ebeab961-7f57-4607-add1-2e63f26b73c4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:23:26.474356 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ebeab961-7f57-4607-add1-2e63f26b73c4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 96ebebed-0f53-4f0c-b21a-0b09b0665bc6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:23:26.481919 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ebeab961-7f57-4607-add1-2e63f26b73c4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:26.482412 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ebeab961-7f57-4607-add1-2e63f26b73c4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:26.482891 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ebeab961-7f57-4607-add1-2e63f26b73c4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:26.483601 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ebeab961-7f57-4607-add1-2e63f26b73c4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:26.484064 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ebeab961-7f57-4607-add1-2e63f26b73c4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:26.484502 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ebeab961-7f57-4607-add1-2e63f26b73c4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:26.620863 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ebeab961-7f57-4607-add1-2e63f26b73c4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:23:26.628719 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ebeab961-7f57-4607-add1-2e63f26b73c4 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6" status: 200 len: 1392 microversion: 2.1 time: 0.159194 Sep 24 21:23:26.629305 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2944/5910] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:23:26 2022] GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:23:27.336117 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-305db812-20d1-43b7-83bf-797f4e722b3b req-5d13fb48-98b7-4918-b4cc-5f9d2ac51dfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96ebebed-0f53-4f0c-b21a-0b09b0665bc6", "name": "network-vif-plugged", "status": "completed", "tag": "b49bf1e2-3e0a-4360-84dc-c9e4304449a9"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:23:27.347367 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-305db812-20d1-43b7-83bf-797f4e722b3b req-5d13fb48-98b7-4918-b4cc-5f9d2ac51dfe service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:27.348465 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-305db812-20d1-43b7-83bf-797f4e722b3b req-5d13fb48-98b7-4918-b4cc-5f9d2ac51dfe service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:27.348918 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-305db812-20d1-43b7-83bf-797f4e722b3b req-5d13fb48-98b7-4918-b4cc-5f9d2ac51dfe service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:27.361292 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-305db812-20d1-43b7-83bf-797f4e722b3b req-5d13fb48-98b7-4918-b4cc-5f9d2ac51dfe service nova] Creating event network-vif-plugged:b49bf1e2-3e0a-4360-84dc-c9e4304449a9 for instance 96ebebed-0f53-4f0c-b21a-0b09b0665bc6 on nch1-master-1 Sep 24 21:23:27.366344 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-305db812-20d1-43b7-83bf-797f4e722b3b req-5d13fb48-98b7-4918-b4cc-5f9d2ac51dfe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033966 Sep 24 21:23:27.366979 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2967/5911] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:23:27.654081 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3db290b1-e6ff-4103-8270-4d648935decd tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:23:27.654735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3db290b1-e6ff-4103-8270-4d648935decd tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 96ebebed-0f53-4f0c-b21a-0b09b0665bc6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:23:27.661625 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3db290b1-e6ff-4103-8270-4d648935decd tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:27.662109 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3db290b1-e6ff-4103-8270-4d648935decd tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:27.662578 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3db290b1-e6ff-4103-8270-4d648935decd tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:27.663278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3db290b1-e6ff-4103-8270-4d648935decd tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:27.663736 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3db290b1-e6ff-4103-8270-4d648935decd tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:27.664165 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3db290b1-e6ff-4103-8270-4d648935decd tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:27.802766 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3db290b1-e6ff-4103-8270-4d648935decd tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:23:27.811003 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3db290b1-e6ff-4103-8270-4d648935decd tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6" status: 200 len: 1392 microversion: 2.1 time: 0.161955 Sep 24 21:23:27.811575 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2945/5912] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:23:27 2022] GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:23:28.836237 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-30f5b047-05a1-4c0f-a422-5f5b134509b8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:23:28.836958 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-30f5b047-05a1-4c0f-a422-5f5b134509b8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 96ebebed-0f53-4f0c-b21a-0b09b0665bc6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:23:28.839401 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:23:28.840691 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=6 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:23:28.849708 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30f5b047-05a1-4c0f-a422-5f5b134509b8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:28.850542 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30f5b047-05a1-4c0f-a422-5f5b134509b8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:28.850995 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30f5b047-05a1-4c0f-a422-5f5b134509b8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:28.851908 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30f5b047-05a1-4c0f-a422-5f5b134509b8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:28.852568 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30f5b047-05a1-4c0f-a422-5f5b134509b8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:28.853010 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-30f5b047-05a1-4c0f-a422-5f5b134509b8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:28.992442 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-30f5b047-05a1-4c0f-a422-5f5b134509b8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:23:29.000374 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-30f5b047-05a1-4c0f-a422-5f5b134509b8 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6" status: 200 len: 1565 microversion: 2.1 time: 0.168686 Sep 24 21:23:29.001115 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2968/5913] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:23:28 2022] GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6 => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:23:29.023099 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-79586f87-a243-4fef-af23-ebf38a303349 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:23:29.023729 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-79586f87-a243-4fef-af23-ebf38a303349 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 96ebebed-0f53-4f0c-b21a-0b09b0665bc6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:23:29.025580 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:23:29.032618 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-79586f87-a243-4fef-af23-ebf38a303349 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:29.033107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-79586f87-a243-4fef-af23-ebf38a303349 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:29.033560 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-79586f87-a243-4fef-af23-ebf38a303349 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:29.034257 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-79586f87-a243-4fef-af23-ebf38a303349 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:29.034818 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-79586f87-a243-4fef-af23-ebf38a303349 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:29.035253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-79586f87-a243-4fef-af23-ebf38a303349 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:29.170724 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-79586f87-a243-4fef-af23-ebf38a303349 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:23:29.178663 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-79586f87-a243-4fef-af23-ebf38a303349 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6" status: 200 len: 1565 microversion: 2.1 time: 0.159783 Sep 24 21:23:29.179239 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2946/5914] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:23:29 2022] GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6 => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:23:31.144804 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-0f2bce49-b3e3-4347-bb47-34df023dcee8 req-a5214cb7-6ee1-4392-8b42-fe44d24db64e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96ebebed-0f53-4f0c-b21a-0b09b0665bc6", "tag": "b49bf1e2-3e0a-4360-84dc-c9e4304449a9"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:23:31.153354 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9daadd69-5fdb-4cc9-aa6b-70bc4295af26 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:23:31.153911 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9daadd69-5fdb-4cc9-aa6b-70bc4295af26 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 96ebebed-0f53-4f0c-b21a-0b09b0665bc6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:23:31.161652 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9daadd69-5fdb-4cc9-aa6b-70bc4295af26 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:31.162174 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9daadd69-5fdb-4cc9-aa6b-70bc4295af26 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:31.162650 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9daadd69-5fdb-4cc9-aa6b-70bc4295af26 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:31.163367 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9daadd69-5fdb-4cc9-aa6b-70bc4295af26 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:31.163827 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9daadd69-5fdb-4cc9-aa6b-70bc4295af26 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:31.164262 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9daadd69-5fdb-4cc9-aa6b-70bc4295af26 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:31.172017 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-0f2bce49-b3e3-4347-bb47-34df023dcee8 req-a5214cb7-6ee1-4392-8b42-fe44d24db64e service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:31.172612 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-0f2bce49-b3e3-4347-bb47-34df023dcee8 req-a5214cb7-6ee1-4392-8b42-fe44d24db64e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:31.173120 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-0f2bce49-b3e3-4347-bb47-34df023dcee8 req-a5214cb7-6ee1-4392-8b42-fe44d24db64e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:31.185443 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-0f2bce49-b3e3-4347-bb47-34df023dcee8 req-a5214cb7-6ee1-4392-8b42-fe44d24db64e service nova] Creating event network-changed:b49bf1e2-3e0a-4360-84dc-c9e4304449a9 for instance 96ebebed-0f53-4f0c-b21a-0b09b0665bc6 on nch1-master-1 Sep 24 21:23:31.191732 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-0f2bce49-b3e3-4347-bb47-34df023dcee8 req-a5214cb7-6ee1-4392-8b42-fe44d24db64e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050869 Sep 24 21:23:31.192538 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2947/5915] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:23:31.302409 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9daadd69-5fdb-4cc9-aa6b-70bc4295af26 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:23:31.311998 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9daadd69-5fdb-4cc9-aa6b-70bc4295af26 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6" status: 200 len: 1565 microversion: 2.1 time: 0.174936 Sep 24 21:23:31.313073 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2969/5916] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:23:31 2022] GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6 => generated 1565 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:23:32.048774 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e08f0e38-77df-426b-8a84-0911345856d7 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:23:32.049407 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e08f0e38-77df-426b-8a84-0911345856d7 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] [instance: 50a8c390-9d7e-4ad1-a399-03090abee415] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:23:32.056312 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e08f0e38-77df-426b-8a84-0911345856d7 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:32.056811 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e08f0e38-77df-426b-8a84-0911345856d7 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:32.057577 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e08f0e38-77df-426b-8a84-0911345856d7 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:32.057973 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e08f0e38-77df-426b-8a84-0911345856d7 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:32.058434 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e08f0e38-77df-426b-8a84-0911345856d7 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:32.059686 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e08f0e38-77df-426b-8a84-0911345856d7 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:32.091153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e08f0e38-77df-426b-8a84-0911345856d7 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] [instance: 50a8c390-9d7e-4ad1-a399-03090abee415] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:23:32.177029 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e08f0e38-77df-426b-8a84-0911345856d7 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] 10.222.0.52 "DELETE /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415" status: 204 len: 0 microversion: 2.1 time: 0.132388 Sep 24 21:23:32.177881 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2948/5917] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:23:32 2022] DELETE /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:23:32.187788 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-382ec736-1e17-4452-aac2-82256f838a5a tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:23:32.188639 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-382ec736-1e17-4452-aac2-82256f838a5a tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] [instance: 50a8c390-9d7e-4ad1-a399-03090abee415] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:23:32.196612 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-382ec736-1e17-4452-aac2-82256f838a5a tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:32.197404 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-382ec736-1e17-4452-aac2-82256f838a5a tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:32.197948 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-382ec736-1e17-4452-aac2-82256f838a5a tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:32.198825 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-382ec736-1e17-4452-aac2-82256f838a5a tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:32.199441 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-382ec736-1e17-4452-aac2-82256f838a5a tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:32.199982 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-382ec736-1e17-4452-aac2-82256f838a5a tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:32.347160 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-382ec736-1e17-4452-aac2-82256f838a5a tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea6653831a54a869daaba5e51fd04b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3481b55b9dfd4a25909a3fe6a03f06e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:23:32.355011 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-382ec736-1e17-4452-aac2-82256f838a5a tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] 10.222.0.52 "GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415" status: 200 len: 1682 microversion: 2.1 time: 0.172567 Sep 24 21:23:32.356225 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2970/5918] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:23:32 2022] GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:23:33.378807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-89c47dca-6731-41f7-b0fe-2660018c2042 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:23:33.379437 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-89c47dca-6731-41f7-b0fe-2660018c2042 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] [instance: 50a8c390-9d7e-4ad1-a399-03090abee415] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:23:33.387314 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89c47dca-6731-41f7-b0fe-2660018c2042 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:33.387955 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89c47dca-6731-41f7-b0fe-2660018c2042 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:33.388399 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89c47dca-6731-41f7-b0fe-2660018c2042 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:33.389113 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89c47dca-6731-41f7-b0fe-2660018c2042 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:33.389577 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89c47dca-6731-41f7-b0fe-2660018c2042 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:33.390013 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-89c47dca-6731-41f7-b0fe-2660018c2042 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:33.520339 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-89c47dca-6731-41f7-b0fe-2660018c2042 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea6653831a54a869daaba5e51fd04b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3481b55b9dfd4a25909a3fe6a03f06e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:23:33.528660 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-89c47dca-6731-41f7-b0fe-2660018c2042 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] 10.222.0.52 "GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415" status: 200 len: 1682 microversion: 2.1 time: 0.153836 Sep 24 21:23:33.529241 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2949/5919] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:23:33 2022] GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:23:34.440365 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-4d863458-be58-4143-98a4-b36e6e6fa0bf req-7f9a3355-33b6-43b9-a538-03764d5ccad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a8c390-9d7e-4ad1-a399-03090abee415", "name": "network-vif-deleted", "tag": "df9b4b3d-c42e-4fcf-a91e-21a8f7f72dfd"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:23:34.453282 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-4d863458-be58-4143-98a4-b36e6e6fa0bf req-7f9a3355-33b6-43b9-a538-03764d5ccad4 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:34.453876 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-4d863458-be58-4143-98a4-b36e6e6fa0bf req-7f9a3355-33b6-43b9-a538-03764d5ccad4 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:34.454340 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-4d863458-be58-4143-98a4-b36e6e6fa0bf req-7f9a3355-33b6-43b9-a538-03764d5ccad4 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:34.467465 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-4d863458-be58-4143-98a4-b36e6e6fa0bf req-7f9a3355-33b6-43b9-a538-03764d5ccad4 service nova] Creating event network-vif-deleted:df9b4b3d-c42e-4fcf-a91e-21a8f7f72dfd for instance 50a8c390-9d7e-4ad1-a399-03090abee415 on nch2-master-1 Sep 24 21:23:34.473454 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-4d863458-be58-4143-98a4-b36e6e6fa0bf req-7f9a3355-33b6-43b9-a538-03764d5ccad4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037051 Sep 24 21:23:34.474636 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2971/5920] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:23:34.553820 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a2f555ef-890b-479f-b6b9-ffd475ffb72c tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:23:34.555100 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a2f555ef-890b-479f-b6b9-ffd475ffb72c tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] [instance: 50a8c390-9d7e-4ad1-a399-03090abee415] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:23:34.562329 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2f555ef-890b-479f-b6b9-ffd475ffb72c tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:34.563105 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2f555ef-890b-479f-b6b9-ffd475ffb72c tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:34.563545 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2f555ef-890b-479f-b6b9-ffd475ffb72c tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:34.564262 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2f555ef-890b-479f-b6b9-ffd475ffb72c tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:34.565282 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2f555ef-890b-479f-b6b9-ffd475ffb72c tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:34.570146 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2f555ef-890b-479f-b6b9-ffd475ffb72c tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:34.609986 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2f555ef-890b-479f-b6b9-ffd475ffb72c tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:34.610488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2f555ef-890b-479f-b6b9-ffd475ffb72c tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:34.611036 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2f555ef-890b-479f-b6b9-ffd475ffb72c tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:34.611784 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-a2f555ef-890b-479f-b6b9-ffd475ffb72c tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lazy-loading 'fault' on Instance uuid 50a8c390-9d7e-4ad1-a399-03090abee415 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:23:34.661384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a2f555ef-890b-479f-b6b9-ffd475ffb72c tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea6653831a54a869daaba5e51fd04b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3481b55b9dfd4a25909a3fe6a03f06e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:23:34.674635 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a2f555ef-890b-479f-b6b9-ffd475ffb72c tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] 10.222.0.52 "GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415" status: 200 len: 1332 microversion: 2.1 time: 0.122031 Sep 24 21:23:34.675593 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2950/5921] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:23:34 2022] GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415 => generated 1332 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:23:35.701855 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cbd3a105-72e0-4e0e-b123-123f13fd1527 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:23:35.702595 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cbd3a105-72e0-4e0e-b123-123f13fd1527 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] [instance: 50a8c390-9d7e-4ad1-a399-03090abee415] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:23:35.709015 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cbd3a105-72e0-4e0e-b123-123f13fd1527 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:35.709506 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cbd3a105-72e0-4e0e-b123-123f13fd1527 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:35.709956 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cbd3a105-72e0-4e0e-b123-123f13fd1527 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:35.710696 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cbd3a105-72e0-4e0e-b123-123f13fd1527 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:35.711159 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cbd3a105-72e0-4e0e-b123-123f13fd1527 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:35.711598 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cbd3a105-72e0-4e0e-b123-123f13fd1527 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:35.725030 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-cbd3a105-72e0-4e0e-b123-123f13fd1527 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] HTTP exception thrown: Instance 50a8c390-9d7e-4ad1-a399-03090abee415 could not be found. Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cbd3a105-72e0-4e0e-b123-123f13fd1527 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Request method failure captured: Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415 HTTP/1.1 Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3UC8NOl6oyfGooRXgR-EdDoSzXK5f6NKx6Bx5e7aHyBhVXEYAowCwoDr3mwsD9P8NcAVdU5X34yWqy5ySndd_IISfxFIYADQv1m9Lqjyyp7c8j6Ec_GimWtCfGDvzCpsi2s4g-Q3Z4o1XDCVL_hMeFZx-uUpHCk1Zg4baydQpli_R8 Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 3481b55b9dfd4a25909a3fe6a03f06e3 Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-46121229 Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3481b55b9dfd4a25909a3fe6a03f06e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3481b55b9dfd4a25909a3fe6a03f06e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3481b55b9dfd4a25909a3fe6a03f06e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3481b55b9dfd4a25909a3fe6a03f06e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-46121229 Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 3481b55b9dfd4a25909a3fe6a03f06e3 Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-46121229 Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-AttachSCSIVolumeTestJSON-46121229-project Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 0ea6653831a54a869daaba5e51fd04b8 Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-46121229-project Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 50a8c390-9d7e-4ad1-a399-03090abee415 could not be found. Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '50a8c390-9d7e-4ad1-a399-03090abee415'} Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50a8c390-9d7e-4ad1-a399-03090abee415 could not be found. Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50a8c390-9d7e-4ad1-a399-03090abee415 could not be found. Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:23:35.726694 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:23:35.731661 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:23:35.731661 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:23:35.731661 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:23:35.731661 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:23:35.731661 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:23:35.731661 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50a8c390-9d7e-4ad1-a399-03090abee415 could not be found. Sep 24 21:23:35.731661 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:23:35.731661 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cbd3a105-72e0-4e0e-b123-123f13fd1527 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Returning 404 to user: Instance 50a8c390-9d7e-4ad1-a399-03090abee415 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:23:35.731661 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cbd3a105-72e0-4e0e-b123-123f13fd1527 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] 10.222.0.52 "GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415" status: 404 len: 111 microversion: 2.1 time: 0.032009 Sep 24 21:23:35.731661 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2972/5922] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:23:35 2022] GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:23:35.741479 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ad46fcb2-a73f-46cd-8a14-b1524f9fd5d2 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Calling method '.version_select at 0x7f4b10ff7ca0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:23:35.761568 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ad46fcb2-a73f-46cd-8a14-b1524f9fd5d2 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1232964235" status: 202 len: 0 microversion: 2.1 time: 0.023921 Sep 24 21:23:35.762133 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2951/5923] 10.222.0.52 () {58 vars in 1221 bytes} [Sat Sep 24 21:23:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1232964235 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:23:37.016035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6751d446-8e9a-4135-9565-0a813b6637f5 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:23:37.016552 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6751d446-8e9a-4135-9565-0a813b6637f5 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] [instance: 50a8c390-9d7e-4ad1-a399-03090abee415] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:23:37.023586 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6751d446-8e9a-4135-9565-0a813b6637f5 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:37.024083 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6751d446-8e9a-4135-9565-0a813b6637f5 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:37.024533 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6751d446-8e9a-4135-9565-0a813b6637f5 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:37.025242 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6751d446-8e9a-4135-9565-0a813b6637f5 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:37.025709 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6751d446-8e9a-4135-9565-0a813b6637f5 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:37.026146 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6751d446-8e9a-4135-9565-0a813b6637f5 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:37.039674 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-6751d446-8e9a-4135-9565-0a813b6637f5 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] HTTP exception thrown: Instance 50a8c390-9d7e-4ad1-a399-03090abee415 could not be found. Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6751d446-8e9a-4135-9565-0a813b6637f5 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Request method failure captured: Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415 HTTP/1.1 Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3UC8NOl6oyfGooRXgR-EdDoSzXK5f6NKx6Bx5e7aHyBhVXEYAowCwoDr3mwsD9P8NcAVdU5X34yWqy5ySndd_IISfxFIYADQv1m9Lqjyyp7c8j6Ec_GimWtCfGDvzCpsi2s4g-Q3Z4o1XDCVL_hMeFZx-uUpHCk1Zg4baydQpli_R8 Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 3481b55b9dfd4a25909a3fe6a03f06e3 Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-46121229 Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3481b55b9dfd4a25909a3fe6a03f06e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3481b55b9dfd4a25909a3fe6a03f06e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3481b55b9dfd4a25909a3fe6a03f06e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3481b55b9dfd4a25909a3fe6a03f06e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-46121229 Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 3481b55b9dfd4a25909a3fe6a03f06e3 Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-46121229 Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-AttachSCSIVolumeTestJSON-46121229-project Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 0ea6653831a54a869daaba5e51fd04b8 Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-46121229-project Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 50a8c390-9d7e-4ad1-a399-03090abee415 could not be found. Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '50a8c390-9d7e-4ad1-a399-03090abee415'} Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50a8c390-9d7e-4ad1-a399-03090abee415 could not be found. Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:23:37.041228 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:23:37.046540 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50a8c390-9d7e-4ad1-a399-03090abee415 could not be found. Sep 24 21:23:37.046540 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:23:37.046540 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:23:37.046540 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:23:37.046540 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:23:37.046540 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:23:37.046540 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:23:37.046540 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:23:37.046540 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:23:37.046540 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50a8c390-9d7e-4ad1-a399-03090abee415 could not be found. Sep 24 21:23:37.046540 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:23:37.046540 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6751d446-8e9a-4135-9565-0a813b6637f5 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Returning 404 to user: Instance 50a8c390-9d7e-4ad1-a399-03090abee415 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:23:37.046540 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6751d446-8e9a-4135-9565-0a813b6637f5 tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] 10.222.0.52 "DELETE /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415" status: 404 len: 111 microversion: 2.1 time: 0.031377 Sep 24 21:23:37.046540 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2973/5924] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:23:37 2022] DELETE /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:23:37.052228 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ddd25784-a6ef-43b7-95ae-d268dfcd381b tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:23:37.052884 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ddd25784-a6ef-43b7-95ae-d268dfcd381b tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] [instance: 50a8c390-9d7e-4ad1-a399-03090abee415] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:23:37.055618 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:23:37.062171 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ddd25784-a6ef-43b7-95ae-d268dfcd381b tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:37.062688 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ddd25784-a6ef-43b7-95ae-d268dfcd381b tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:37.063134 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ddd25784-a6ef-43b7-95ae-d268dfcd381b tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:37.063838 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ddd25784-a6ef-43b7-95ae-d268dfcd381b tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:23:37.064301 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ddd25784-a6ef-43b7-95ae-d268dfcd381b tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:23:37.065001 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ddd25784-a6ef-43b7-95ae-d268dfcd381b tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:23:37.080570 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-ddd25784-a6ef-43b7-95ae-d268dfcd381b tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] HTTP exception thrown: Instance 50a8c390-9d7e-4ad1-a399-03090abee415 could not be found. Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ddd25784-a6ef-43b7-95ae-d268dfcd381b tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Request method failure captured: Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415 HTTP/1.1 Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3UC8NOl6oyfGooRXgR-EdDoSzXK5f6NKx6Bx5e7aHyBhVXEYAowCwoDr3mwsD9P8NcAVdU5X34yWqy5ySndd_IISfxFIYADQv1m9Lqjyyp7c8j6Ec_GimWtCfGDvzCpsi2s4g-Q3Z4o1XDCVL_hMeFZx-uUpHCk1Zg4baydQpli_R8 Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 3481b55b9dfd4a25909a3fe6a03f06e3 Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-46121229 Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3481b55b9dfd4a25909a3fe6a03f06e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3481b55b9dfd4a25909a3fe6a03f06e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3481b55b9dfd4a25909a3fe6a03f06e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3481b55b9dfd4a25909a3fe6a03f06e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-46121229 Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 3481b55b9dfd4a25909a3fe6a03f06e3 Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-46121229 Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-AttachSCSIVolumeTestJSON-46121229-project Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 0ea6653831a54a869daaba5e51fd04b8 Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-46121229-project Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 50a8c390-9d7e-4ad1-a399-03090abee415 could not be found. Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '50a8c390-9d7e-4ad1-a399-03090abee415'} Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50a8c390-9d7e-4ad1-a399-03090abee415 could not be found. Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50a8c390-9d7e-4ad1-a399-03090abee415 could not be found. Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:23:37.082189 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:23:37.087151 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:23:37.087151 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:23:37.087151 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:23:37.087151 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:23:37.087151 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:23:37.087151 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50a8c390-9d7e-4ad1-a399-03090abee415 could not be found. Sep 24 21:23:37.087151 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:23:37.087151 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ddd25784-a6ef-43b7-95ae-d268dfcd381b tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] Returning 404 to user: Instance 50a8c390-9d7e-4ad1-a399-03090abee415 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:23:37.087151 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ddd25784-a6ef-43b7-95ae-d268dfcd381b tempest-AttachSCSIVolumeTestJSON-46121229 tempest-AttachSCSIVolumeTestJSON-46121229-project] 10.222.0.52 "GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415" status: 404 len: 111 microversion: 2.1 time: 0.036265 Sep 24 21:23:37.087151 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2952/5925] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:23:37 2022] GET /compute/v2.1/servers/50a8c390-9d7e-4ad1-a399-03090abee415 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:23:49.186128 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:23:49.187953 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=48 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:23:49.339952 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3913e91e-3958-4d5b-bdef-5739dcee91af tempest-FloatingIPsNegativeTestJSON-77578271 tempest-FloatingIPsNegativeTestJSON-77578271-project] Calling method '.version_select at 0x7f4b0c0e6af0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:23:49.412721 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3913e91e-3958-4d5b-bdef-5739dcee91af tempest-FloatingIPsNegativeTestJSON-77578271 tempest-FloatingIPsNegativeTestJSON-77578271-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.232918 Sep 24 21:23:49.413691 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2974/5926] 10.222.0.52 () {58 vars in 1149 bytes} [Sat Sep 24 21:23:49 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 21:23:49.429729 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0cd0fb69-3008-450b-bdc7-54bc3f6d5b2d tempest-FloatingIPsNegativeTestJSON-77578271 tempest-FloatingIPsNegativeTestJSON-77578271-project] Action: 'create', calling method: .version_select at 0x7f4b10f7c3a0>, body: {"pool": "non_exist_pool"} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:23:49.438576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:23:49.478170 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-0cd0fb69-3008-450b-bdc7-54bc3f6d5b2d tempest-FloatingIPsNegativeTestJSON-77578271 tempest-FloatingIPsNegativeTestJSON-77578271-project] HTTP exception thrown: Floating IP pool not found. Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0cd0fb69-3008-450b-bdc7-54bc3f6d5b2d tempest-FloatingIPsNegativeTestJSON-77578271 tempest-FloatingIPsNegativeTestJSON-77578271-project] Request method failure captured: Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 26 Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3VlzNJphrTlNAx-Ac0Tkb5PvjdpavwolcZd8_eeVO2jv1bWkRG3JECdPO6J9R6OCPE0R0HzOspBLgXInM0XCj_qYzxbjyVzYeu4RSGy29QLfL9WHbeLvhnZyFOWdlMZ3t1Nce5Yyj6WwIjI_9THWC2sCTfi_2TgrWa8lThJPnJEuHg Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 78ab797f6e43434e8560af61d4311d96 Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-77578271 Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/78ab797f6e43434e8560af61d4311d96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_78ab797f6e43434e8560af61d4311d96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/78ab797f6e43434e8560af61d4311d96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/78ab797f6e43434e8560af61d4311d96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-77578271 Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 78ab797f6e43434e8560af61d4311d96 Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-77578271 Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-FloatingIPsNegativeTestJSON-77578271-project Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: c48d18d96d0f4345b72d044f7bf49ef9 Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-77578271-project Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: {"pool": "non_exist_pool"} Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: exception: Floating IP pool not found. Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'body': {'pool': 'non_exist_pool'}} Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:23:49.479876 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:23:49.487131 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Sep 24 21:23:49.487131 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:23:49.487131 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0cd0fb69-3008-450b-bdc7-54bc3f6d5b2d tempest-FloatingIPsNegativeTestJSON-77578271 tempest-FloatingIPsNegativeTestJSON-77578271-project] Returning 404 to user: Floating IP pool not found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:23:49.487131 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0cd0fb69-3008-450b-bdc7-54bc3f6d5b2d tempest-FloatingIPsNegativeTestJSON-77578271 tempest-FloatingIPsNegativeTestJSON-77578271-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.057995 Sep 24 21:23:49.487131 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2953/5927] 10.222.0.52 () {60 vars in 1170 bytes} [Sat Sep 24 21:23:49 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 21:23:49.491631 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-01a62c45-66e6-4897-813f-b3f565d2aa37 tempest-FloatingIPsNegativeTestJSON-77578271 tempest-FloatingIPsNegativeTestJSON-77578271-project] Calling method '.version_select at 0x7f4b073b28b0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:23:49.538613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG neutronclient.v2_0.client [None req-01a62c45-66e6-4897-813f-b3f565d2aa37 tempest-FloatingIPsNegativeTestJSON-77578271 tempest-FloatingIPsNegativeTestJSON-77578271-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 1cc50094-fa99-4ca4-adc8-043654cf11c1 could not be found", "detail": ""}} {{(pid=140517) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 24 21:23:49.539386 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-01a62c45-66e6-4897-813f-b3f565d2aa37 tempest-FloatingIPsNegativeTestJSON-77578271 tempest-FloatingIPsNegativeTestJSON-77578271-project] HTTP exception thrown: Floating IP not found for ID 1cc50094-fa99-4ca4-adc8-043654cf11c1 Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-01a62c45-66e6-4897-813f-b3f565d2aa37 tempest-FloatingIPsNegativeTestJSON-77578271 tempest-FloatingIPsNegativeTestJSON-77578271-project] Request method failure captured: Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/os-floating-ips/1cc50094-fa99-4ca4-adc8-043654cf11c1 HTTP/1.1 Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3VlzNJphrTlNAx-Ac0Tkb5PvjdpavwolcZd8_eeVO2jv1bWkRG3JECdPO6J9R6OCPE0R0HzOspBLgXInM0XCj_qYzxbjyVzYeu4RSGy29QLfL9WHbeLvhnZyFOWdlMZ3t1Nce5Yyj6WwIjI_9THWC2sCTfi_2TgrWa8lThJPnJEuHg Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 78ab797f6e43434e8560af61d4311d96 Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-77578271 Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/78ab797f6e43434e8560af61d4311d96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_78ab797f6e43434e8560af61d4311d96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/78ab797f6e43434e8560af61d4311d96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/78ab797f6e43434e8560af61d4311d96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-77578271 Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 78ab797f6e43434e8560af61d4311d96 Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-77578271 Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-FloatingIPsNegativeTestJSON-77578271-project Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: c48d18d96d0f4345b72d044f7bf49ef9 Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-77578271-project Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: exception: Floating IP not found for ID 1cc50094-fa99-4ca4-adc8-043654cf11c1 Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '1cc50094-fa99-4ca4-adc8-043654cf11c1'} Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 1cc50094-fa99-4ca4-adc8-043654cf11c1 could not be found Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a08cb8b9-a1b4-4998-95a5-8a2a87525296'] Sep 24 21:23:49.541323 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:23:49.546827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:23:49.546827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:23:49.546827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:23:49.546827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 24 21:23:49.546827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 24 21:23:49.546827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 24 21:23:49.546827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 24 21:23:49.546827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 1cc50094-fa99-4ca4-adc8-043654cf11c1. Sep 24 21:23:49.546827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:23:49.546827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:23:49.546827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:23:49.546827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:23:49.546827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:23:49.546827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:23:49.546827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:23:49.546827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:23:49.546827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:23:49.546827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:23:49.546827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:23:49.546827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:23:49.546827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 24 21:23:49.546827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 24 21:23:49.546827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 1cc50094-fa99-4ca4-adc8-043654cf11c1 Sep 24 21:23:49.546827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:23:49.546827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:23:49.546827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:23:49.546827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:23:49.546827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:23:49.546827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:23:49.546827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:23:49.546827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:23:49.546827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 1cc50094-fa99-4ca4-adc8-043654cf11c1 Sep 24 21:23:49.546827 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:23:49.546827 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-01a62c45-66e6-4897-813f-b3f565d2aa37 tempest-FloatingIPsNegativeTestJSON-77578271 tempest-FloatingIPsNegativeTestJSON-77578271-project] Returning 404 to user: Floating IP not found for ID 1cc50094-fa99-4ca4-adc8-043654cf11c1 {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:23:49.546827 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-01a62c45-66e6-4897-813f-b3f565d2aa37 tempest-FloatingIPsNegativeTestJSON-77578271 tempest-FloatingIPsNegativeTestJSON-77578271-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/1cc50094-fa99-4ca4-adc8-043654cf11c1" status: 404 len: 111 microversion: 2.1 time: 0.057720 Sep 24 21:23:49.546827 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2975/5928] 10.222.0.52 () {58 vars in 1263 bytes} [Sat Sep 24 21:23:49 2022] DELETE /compute/v2.1/os-floating-ips/1cc50094-fa99-4ca4-adc8-043654cf11c1 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 21:23:58.486729 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-879e2bad-b5e1-4329-b892-b9fbb893c6fd tempest-FloatingIPDetailsNegativeTestJSON-1180783981 tempest-FloatingIPDetailsNegativeTestJSON-1180783981-project] Calling method '.version_select at 0x7f4b078db160>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:23:58.535993 ncdv-master-1 devstack@n-api.service[140516]: DEBUG neutronclient.v2_0.client [None req-879e2bad-b5e1-4329-b892-b9fbb893c6fd tempest-FloatingIPDetailsNegativeTestJSON-1180783981 tempest-FloatingIPDetailsNegativeTestJSON-1180783981-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 53d6eb77-6bb8-451f-bcd2-90d4ecf54d3c could not be found", "detail": ""}} {{(pid=140516) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 24 21:23:58.536697 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-879e2bad-b5e1-4329-b892-b9fbb893c6fd tempest-FloatingIPDetailsNegativeTestJSON-1180783981 tempest-FloatingIPDetailsNegativeTestJSON-1180783981-project] HTTP exception thrown: Floating IP not found for ID 53d6eb77-6bb8-451f-bcd2-90d4ecf54d3c Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-879e2bad-b5e1-4329-b892-b9fbb893c6fd tempest-FloatingIPDetailsNegativeTestJSON-1180783981 tempest-FloatingIPDetailsNegativeTestJSON-1180783981-project] Request method failure captured: Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/os-floating-ips/53d6eb77-6bb8-451f-bcd2-90d4ecf54d3c HTTP/1.1 Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3VuxE_9t1kGRXU1usZzuM2QZHaYJiNoUV2C7U26Kz8Dote7Q_cSyjMKZy-90vyCF8QiA-EE0nTQKpMy77XFLbgepWS-InqjCRV5qgWxzSvgDOiaM6yHtvmDDtRz1-bwc_fYSKIEHDM8BpIsPUIvkheSNb-Fshzxb-nRMTGeoaymP2g Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: ca4a40ad2f664bd9bea4b640d6ab8fa1 Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1180783981 Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ca4a40ad2f664bd9bea4b640d6ab8fa1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ca4a40ad2f664bd9bea4b640d6ab8fa1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ca4a40ad2f664bd9bea4b640d6ab8fa1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ca4a40ad2f664bd9bea4b640d6ab8fa1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1180783981 Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: ca4a40ad2f664bd9bea4b640d6ab8fa1 Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1180783981 Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1180783981-project Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 1001f73ddb3c459c88073d9342b96ec3 Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1180783981-project Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: exception: Floating IP not found for ID 53d6eb77-6bb8-451f-bcd2-90d4ecf54d3c Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '53d6eb77-6bb8-451f-bcd2-90d4ecf54d3c'} Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 24 21:23:58.538592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 53d6eb77-6bb8-451f-bcd2-90d4ecf54d3c could not be found Sep 24 21:23:58.543515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f60c440b-8b95-4963-bd6c-1be0ba618753'] Sep 24 21:23:58.543515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:23:58.543515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:23:58.543515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:23:58.543515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:23:58.543515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 24 21:23:58.543515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 24 21:23:58.543515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 24 21:23:58.543515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 24 21:23:58.543515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 53d6eb77-6bb8-451f-bcd2-90d4ecf54d3c. Sep 24 21:23:58.543515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:23:58.543515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:23:58.543515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:23:58.543515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:23:58.543515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:23:58.543515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:23:58.543515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:23:58.543515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:23:58.543515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:23:58.543515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:23:58.543515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:23:58.543515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:23:58.543515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 24 21:23:58.543515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 24 21:23:58.543515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 53d6eb77-6bb8-451f-bcd2-90d4ecf54d3c Sep 24 21:23:58.543515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:23:58.543515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:23:58.543515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:23:58.543515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:23:58.543515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:23:58.543515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:23:58.543515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:23:58.543515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:23:58.543515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 53d6eb77-6bb8-451f-bcd2-90d4ecf54d3c Sep 24 21:23:58.543515 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:23:58.547715 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-879e2bad-b5e1-4329-b892-b9fbb893c6fd tempest-FloatingIPDetailsNegativeTestJSON-1180783981 tempest-FloatingIPDetailsNegativeTestJSON-1180783981-project] Returning 404 to user: Floating IP not found for ID 53d6eb77-6bb8-451f-bcd2-90d4ecf54d3c {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:23:58.548772 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-879e2bad-b5e1-4329-b892-b9fbb893c6fd tempest-FloatingIPDetailsNegativeTestJSON-1180783981 tempest-FloatingIPDetailsNegativeTestJSON-1180783981-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips/53d6eb77-6bb8-451f-bcd2-90d4ecf54d3c" status: 404 len: 111 microversion: 2.1 time: 0.216731 Sep 24 21:23:58.549510 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2954/5929] 10.222.0.52 () {58 vars in 1260 bytes} [Sat Sep 24 21:23:58 2022] GET /compute/v2.1/os-floating-ips/53d6eb77-6bb8-451f-bcd2-90d4ecf54d3c => generated 111 bytes in 218 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:24:04.625696 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a8562c3b-af8b-4339-a321-3be4891f36ba tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:24:04.627904 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a8562c3b-af8b-4339-a321-3be4891f36ba tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 96ebebed-0f53-4f0c-b21a-0b09b0665bc6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:04.634660 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a8562c3b-af8b-4339-a321-3be4891f36ba tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:04.634660 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a8562c3b-af8b-4339-a321-3be4891f36ba tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:04.635117 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a8562c3b-af8b-4339-a321-3be4891f36ba tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:04.635837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a8562c3b-af8b-4339-a321-3be4891f36ba tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:04.636669 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a8562c3b-af8b-4339-a321-3be4891f36ba tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:04.637324 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a8562c3b-af8b-4339-a321-3be4891f36ba tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:04.691932 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a8562c3b-af8b-4339-a321-3be4891f36ba tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "POST /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6/action" status: 200 len: 24575 microversion: 2.1 time: 0.073047 Sep 24 21:24:04.696162 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2976/5930] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:24:04 2022] POST /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6/action => generated 24575 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:24:07.355104 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:24:07.474844 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-37cc67f0-8f94-44b9-98d4-4e1cd31b66af tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1389276707", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "1e70cdf0-658e-45a6-8dcd-a635db1c9a02"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:24:07.529098 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-37cc67f0-8f94-44b9-98d4-4e1cd31b66af tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] validate_networks() for [('1e70cdf0-658e-45a6-8dcd-a635db1c9a02', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:24:07.980191 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-37cc67f0-8f94-44b9-98d4-4e1cd31b66af tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:24:07.980628 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-37cc67f0-8f94-44b9-98d4-4e1cd31b66af tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:24:07.981109 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-37cc67f0-8f94-44b9-98d4-4e1cd31b66af tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:24:07.981524 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-37cc67f0-8f94-44b9-98d4-4e1cd31b66af tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:24:07.981944 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-37cc67f0-8f94-44b9-98d4-4e1cd31b66af tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:24:07.991606 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-37cc67f0-8f94-44b9-98d4-4e1cd31b66af tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:07.992214 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-37cc67f0-8f94-44b9-98d4-4e1cd31b66af tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:07.992743 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-37cc67f0-8f94-44b9-98d4-4e1cd31b66af tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:07.993555 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-37cc67f0-8f94-44b9-98d4-4e1cd31b66af tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:07.994475 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-37cc67f0-8f94-44b9-98d4-4e1cd31b66af tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:07.995721 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-37cc67f0-8f94-44b9-98d4-4e1cd31b66af tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:08.014663 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-37cc67f0-8f94-44b9-98d4-4e1cd31b66af tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Getting quotas for project eb957f17053b49419fbbc09b8633628b. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:24:08.020273 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-37cc67f0-8f94-44b9-98d4-4e1cd31b66af tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Getting quotas for user d7432bc67cac447391173eedccefbf9e and project eb957f17053b49419fbbc09b8633628b. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:24:08.033608 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-37cc67f0-8f94-44b9-98d4-4e1cd31b66af tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:24:08.035914 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-37cc67f0-8f94-44b9-98d4-4e1cd31b66af tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 8dd17104-d645-4cb0-84f0-31ae22127726] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:24:08.084169 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-37cc67f0-8f94-44b9-98d4-4e1cd31b66af tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.730742 Sep 24 21:24:08.084814 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2955/5931] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:24:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:24:08.096648 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d33e38f2-c7e8-45f9-a016-cab71db19847 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:08.097360 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d33e38f2-c7e8-45f9-a016-cab71db19847 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 8dd17104-d645-4cb0-84f0-31ae22127726] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:08.160733 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d33e38f2-c7e8-45f9-a016-cab71db19847 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:08.168526 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d33e38f2-c7e8-45f9-a016-cab71db19847 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/8dd17104-d645-4cb0-84f0-31ae22127726" status: 200 len: 1208 microversion: 2.1 time: 0.075987 Sep 24 21:24:08.180265 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2977/5932] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:08 2022] GET /compute/v2.1/servers/8dd17104-d645-4cb0-84f0-31ae22127726 => generated 1208 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:09.192018 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ef6fbd00-c81f-481d-a37a-4db46c061649 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:09.192701 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ef6fbd00-c81f-481d-a37a-4db46c061649 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 8dd17104-d645-4cb0-84f0-31ae22127726] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:09.200824 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef6fbd00-c81f-481d-a37a-4db46c061649 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:09.201320 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef6fbd00-c81f-481d-a37a-4db46c061649 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:09.201769 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef6fbd00-c81f-481d-a37a-4db46c061649 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:09.202490 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef6fbd00-c81f-481d-a37a-4db46c061649 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:09.202980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef6fbd00-c81f-481d-a37a-4db46c061649 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:09.203561 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ef6fbd00-c81f-481d-a37a-4db46c061649 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:09.303937 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ef6fbd00-c81f-481d-a37a-4db46c061649 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:09.318388 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ef6fbd00-c81f-481d-a37a-4db46c061649 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/8dd17104-d645-4cb0-84f0-31ae22127726" status: 200 len: 1268 microversion: 2.1 time: 0.129906 Sep 24 21:24:09.320528 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2956/5933] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:09 2022] GET /compute/v2.1/servers/8dd17104-d645-4cb0-84f0-31ae22127726 => generated 1268 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:10.353200 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0cfc53fc-ecd9-4c24-87b3-f03cfdcbb76a tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:10.355348 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0cfc53fc-ecd9-4c24-87b3-f03cfdcbb76a tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 8dd17104-d645-4cb0-84f0-31ae22127726] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:10.364422 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0cfc53fc-ecd9-4c24-87b3-f03cfdcbb76a tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:10.365310 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0cfc53fc-ecd9-4c24-87b3-f03cfdcbb76a tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:10.366052 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0cfc53fc-ecd9-4c24-87b3-f03cfdcbb76a tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:10.367049 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0cfc53fc-ecd9-4c24-87b3-f03cfdcbb76a tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:10.367746 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0cfc53fc-ecd9-4c24-87b3-f03cfdcbb76a tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:10.368408 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0cfc53fc-ecd9-4c24-87b3-f03cfdcbb76a tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:10.592800 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0cfc53fc-ecd9-4c24-87b3-f03cfdcbb76a tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:10.601380 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0cfc53fc-ecd9-4c24-87b3-f03cfdcbb76a tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/8dd17104-d645-4cb0-84f0-31ae22127726" status: 200 len: 1308 microversion: 2.1 time: 0.255591 Sep 24 21:24:10.602684 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2978/5934] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:10 2022] GET /compute/v2.1/servers/8dd17104-d645-4cb0-84f0-31ae22127726 => generated 1308 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:10.931886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-a35d72cb-ceab-4f18-9a55-c45e9d78ab53 req-4c407c54-1b74-4fbc-bfeb-4e433fca3d90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dd17104-d645-4cb0-84f0-31ae22127726", "tag": "6bac468f-ecc2-4239-a047-5cb90631c67c"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:24:10.947924 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a35d72cb-ceab-4f18-9a55-c45e9d78ab53 req-4c407c54-1b74-4fbc-bfeb-4e433fca3d90 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:10.948831 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a35d72cb-ceab-4f18-9a55-c45e9d78ab53 req-4c407c54-1b74-4fbc-bfeb-4e433fca3d90 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:10.949192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a35d72cb-ceab-4f18-9a55-c45e9d78ab53 req-4c407c54-1b74-4fbc-bfeb-4e433fca3d90 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:10.961668 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-a35d72cb-ceab-4f18-9a55-c45e9d78ab53 req-4c407c54-1b74-4fbc-bfeb-4e433fca3d90 service nova] Creating event network-changed:6bac468f-ecc2-4239-a047-5cb90631c67c for instance 8dd17104-d645-4cb0-84f0-31ae22127726 on nch2-master-1 Sep 24 21:24:10.971598 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-a35d72cb-ceab-4f18-9a55-c45e9d78ab53 req-4c407c54-1b74-4fbc-bfeb-4e433fca3d90 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050277 Sep 24 21:24:10.975178 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2957/5935] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:24:11.625951 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-857c457b-dcbb-4d89-ba95-e748a48c624b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:11.626604 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-857c457b-dcbb-4d89-ba95-e748a48c624b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 8dd17104-d645-4cb0-84f0-31ae22127726] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:11.633551 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-857c457b-dcbb-4d89-ba95-e748a48c624b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:11.634040 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-857c457b-dcbb-4d89-ba95-e748a48c624b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:11.634483 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-857c457b-dcbb-4d89-ba95-e748a48c624b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:11.635824 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-857c457b-dcbb-4d89-ba95-e748a48c624b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:11.636631 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-857c457b-dcbb-4d89-ba95-e748a48c624b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:11.637072 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-857c457b-dcbb-4d89-ba95-e748a48c624b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:11.766809 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-857c457b-dcbb-4d89-ba95-e748a48c624b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:11.774788 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-857c457b-dcbb-4d89-ba95-e748a48c624b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/8dd17104-d645-4cb0-84f0-31ae22127726" status: 200 len: 1308 microversion: 2.1 time: 0.152649 Sep 24 21:24:11.775361 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2979/5936] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:11 2022] GET /compute/v2.1/servers/8dd17104-d645-4cb0-84f0-31ae22127726 => generated 1308 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:12.798652 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c8b84625-6645-44ff-9f57-3f81a26f81e8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:12.799364 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c8b84625-6645-44ff-9f57-3f81a26f81e8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 8dd17104-d645-4cb0-84f0-31ae22127726] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:12.805614 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8b84625-6645-44ff-9f57-3f81a26f81e8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:12.806100 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8b84625-6645-44ff-9f57-3f81a26f81e8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:12.806567 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8b84625-6645-44ff-9f57-3f81a26f81e8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:12.807276 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8b84625-6645-44ff-9f57-3f81a26f81e8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:12.807736 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8b84625-6645-44ff-9f57-3f81a26f81e8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:12.808170 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8b84625-6645-44ff-9f57-3f81a26f81e8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:12.938070 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c8b84625-6645-44ff-9f57-3f81a26f81e8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:12.945915 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c8b84625-6645-44ff-9f57-3f81a26f81e8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/8dd17104-d645-4cb0-84f0-31ae22127726" status: 200 len: 1308 microversion: 2.1 time: 0.152441 Sep 24 21:24:12.946517 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2958/5937] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:12 2022] GET /compute/v2.1/servers/8dd17104-d645-4cb0-84f0-31ae22127726 => generated 1308 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:13.970124 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bd08eb1f-063f-409b-a1b9-1dd85d75c41f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:13.970815 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bd08eb1f-063f-409b-a1b9-1dd85d75c41f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 8dd17104-d645-4cb0-84f0-31ae22127726] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:13.977672 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bd08eb1f-063f-409b-a1b9-1dd85d75c41f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:13.978182 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bd08eb1f-063f-409b-a1b9-1dd85d75c41f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:13.978657 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bd08eb1f-063f-409b-a1b9-1dd85d75c41f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:13.979364 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bd08eb1f-063f-409b-a1b9-1dd85d75c41f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:13.979831 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bd08eb1f-063f-409b-a1b9-1dd85d75c41f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:13.980271 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bd08eb1f-063f-409b-a1b9-1dd85d75c41f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:14.117379 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bd08eb1f-063f-409b-a1b9-1dd85d75c41f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:14.125313 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bd08eb1f-063f-409b-a1b9-1dd85d75c41f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/8dd17104-d645-4cb0-84f0-31ae22127726" status: 200 len: 1308 microversion: 2.1 time: 0.159930 Sep 24 21:24:14.125904 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2980/5938] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:13 2022] GET /compute/v2.1/servers/8dd17104-d645-4cb0-84f0-31ae22127726 => generated 1308 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:15.148746 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ab64f70c-dc0a-42c6-8733-731e685e0add tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:15.149333 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ab64f70c-dc0a-42c6-8733-731e685e0add tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 8dd17104-d645-4cb0-84f0-31ae22127726] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:15.156795 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab64f70c-dc0a-42c6-8733-731e685e0add tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:15.157281 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab64f70c-dc0a-42c6-8733-731e685e0add tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:15.157721 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab64f70c-dc0a-42c6-8733-731e685e0add tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:15.158422 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab64f70c-dc0a-42c6-8733-731e685e0add tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:15.158920 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab64f70c-dc0a-42c6-8733-731e685e0add tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:15.159353 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab64f70c-dc0a-42c6-8733-731e685e0add tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:15.289498 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ab64f70c-dc0a-42c6-8733-731e685e0add tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:15.298263 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ab64f70c-dc0a-42c6-8733-731e685e0add tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/8dd17104-d645-4cb0-84f0-31ae22127726" status: 200 len: 1308 microversion: 2.1 time: 0.153478 Sep 24 21:24:15.298867 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2959/5939] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:15 2022] GET /compute/v2.1/servers/8dd17104-d645-4cb0-84f0-31ae22127726 => generated 1308 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:16.322769 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3a146d52-d228-4866-a032-c58083c6b56c tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:16.323413 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3a146d52-d228-4866-a032-c58083c6b56c tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 8dd17104-d645-4cb0-84f0-31ae22127726] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:16.330236 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a146d52-d228-4866-a032-c58083c6b56c tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:16.330749 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a146d52-d228-4866-a032-c58083c6b56c tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:16.331203 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a146d52-d228-4866-a032-c58083c6b56c tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:16.331905 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a146d52-d228-4866-a032-c58083c6b56c tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:16.332360 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a146d52-d228-4866-a032-c58083c6b56c tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:16.332790 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a146d52-d228-4866-a032-c58083c6b56c tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:16.473238 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3a146d52-d228-4866-a032-c58083c6b56c tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:16.476778 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-26621f3d-549f-46d1-be90-e4089cb001b2 req-e9660976-3cd5-46db-a36f-5cca8d166409 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dd17104-d645-4cb0-84f0-31ae22127726", "name": "network-vif-plugged", "status": "completed", "tag": "6bac468f-ecc2-4239-a047-5cb90631c67c"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:24:16.481846 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3a146d52-d228-4866-a032-c58083c6b56c tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/8dd17104-d645-4cb0-84f0-31ae22127726" status: 200 len: 1308 microversion: 2.1 time: 0.162447 Sep 24 21:24:16.483136 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2981/5940] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:16 2022] GET /compute/v2.1/servers/8dd17104-d645-4cb0-84f0-31ae22127726 => generated 1308 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:16.488140 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-26621f3d-549f-46d1-be90-e4089cb001b2 req-e9660976-3cd5-46db-a36f-5cca8d166409 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:16.488638 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-26621f3d-549f-46d1-be90-e4089cb001b2 req-e9660976-3cd5-46db-a36f-5cca8d166409 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:16.489072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-26621f3d-549f-46d1-be90-e4089cb001b2 req-e9660976-3cd5-46db-a36f-5cca8d166409 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:16.506933 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-26621f3d-549f-46d1-be90-e4089cb001b2 req-e9660976-3cd5-46db-a36f-5cca8d166409 service nova] Creating event network-vif-plugged:6bac468f-ecc2-4239-a047-5cb90631c67c for instance 8dd17104-d645-4cb0-84f0-31ae22127726 on nch2-master-1 Sep 24 21:24:16.513788 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-26621f3d-549f-46d1-be90-e4089cb001b2 req-e9660976-3cd5-46db-a36f-5cca8d166409 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040642 Sep 24 21:24:16.514616 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2960/5941] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:24:17.505656 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7111c623-89bf-4318-8e1f-318f23e6a4a3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:17.506274 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7111c623-89bf-4318-8e1f-318f23e6a4a3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 8dd17104-d645-4cb0-84f0-31ae22127726] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:17.514224 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7111c623-89bf-4318-8e1f-318f23e6a4a3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:17.514768 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7111c623-89bf-4318-8e1f-318f23e6a4a3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:17.515215 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7111c623-89bf-4318-8e1f-318f23e6a4a3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:17.515922 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7111c623-89bf-4318-8e1f-318f23e6a4a3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:17.516386 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7111c623-89bf-4318-8e1f-318f23e6a4a3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:17.516824 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7111c623-89bf-4318-8e1f-318f23e6a4a3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:17.648919 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7111c623-89bf-4318-8e1f-318f23e6a4a3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:17.657560 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7111c623-89bf-4318-8e1f-318f23e6a4a3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/8dd17104-d645-4cb0-84f0-31ae22127726" status: 200 len: 1308 microversion: 2.1 time: 0.155746 Sep 24 21:24:17.658166 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2982/5942] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:17 2022] GET /compute/v2.1/servers/8dd17104-d645-4cb0-84f0-31ae22127726 => generated 1308 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:18.678764 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:24:18.679612 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:24:18.683684 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c529c993-1943-4120-9242-c166339468a5 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:18.684528 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c529c993-1943-4120-9242-c166339468a5 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 8dd17104-d645-4cb0-84f0-31ae22127726] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:18.691663 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c529c993-1943-4120-9242-c166339468a5 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:18.692155 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c529c993-1943-4120-9242-c166339468a5 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:18.692598 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c529c993-1943-4120-9242-c166339468a5 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:18.693297 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c529c993-1943-4120-9242-c166339468a5 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:18.693758 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c529c993-1943-4120-9242-c166339468a5 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:18.694193 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c529c993-1943-4120-9242-c166339468a5 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:18.827637 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c529c993-1943-4120-9242-c166339468a5 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:18.835494 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c529c993-1943-4120-9242-c166339468a5 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/8dd17104-d645-4cb0-84f0-31ae22127726" status: 200 len: 1486 microversion: 2.1 time: 0.158580 Sep 24 21:24:18.836071 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2961/5943] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:18 2022] GET /compute/v2.1/servers/8dd17104-d645-4cb0-84f0-31ae22127726 => generated 1486 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:18.858205 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-221df595-0962-40ca-9979-c9f4ee6f6d00 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:24:18.858777 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-221df595-0962-40ca-9979-c9f4ee6f6d00 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 8dd17104-d645-4cb0-84f0-31ae22127726] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:18.860758 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:24:18.866899 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-221df595-0962-40ca-9979-c9f4ee6f6d00 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:18.867385 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-221df595-0962-40ca-9979-c9f4ee6f6d00 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:18.867824 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-221df595-0962-40ca-9979-c9f4ee6f6d00 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:18.868518 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-221df595-0962-40ca-9979-c9f4ee6f6d00 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:18.868972 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-221df595-0962-40ca-9979-c9f4ee6f6d00 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:18.869399 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-221df595-0962-40ca-9979-c9f4ee6f6d00 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:18.937147 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-221df595-0962-40ca-9979-c9f4ee6f6d00 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "POST /compute/v2.1/servers/8dd17104-d645-4cb0-84f0-31ae22127726/action" status: 202 len: 0 microversion: 2.1 time: 0.082616 Sep 24 21:24:18.940689 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2983/5944] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:24:18 2022] POST /compute/v2.1/servers/8dd17104-d645-4cb0-84f0-31ae22127726/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:24:18.945964 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fa96806d-5992-4c61-bb75-5cb1e4eaf39d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:18.946642 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fa96806d-5992-4c61-bb75-5cb1e4eaf39d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 8dd17104-d645-4cb0-84f0-31ae22127726] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:18.953513 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fa96806d-5992-4c61-bb75-5cb1e4eaf39d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:18.953895 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fa96806d-5992-4c61-bb75-5cb1e4eaf39d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:18.954343 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fa96806d-5992-4c61-bb75-5cb1e4eaf39d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:18.955109 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fa96806d-5992-4c61-bb75-5cb1e4eaf39d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:18.955552 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fa96806d-5992-4c61-bb75-5cb1e4eaf39d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:18.955981 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fa96806d-5992-4c61-bb75-5cb1e4eaf39d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:19.086044 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fa96806d-5992-4c61-bb75-5cb1e4eaf39d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:19.093890 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fa96806d-5992-4c61-bb75-5cb1e4eaf39d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/8dd17104-d645-4cb0-84f0-31ae22127726" status: 200 len: 1491 microversion: 2.1 time: 0.151873 Sep 24 21:24:19.094461 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2962/5945] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:18 2022] GET /compute/v2.1/servers/8dd17104-d645-4cb0-84f0-31ae22127726 => generated 1491 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:20.118525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ae31afd1-6378-4815-bcfe-8c51d9dc0b21 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:20.119234 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ae31afd1-6378-4815-bcfe-8c51d9dc0b21 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 8dd17104-d645-4cb0-84f0-31ae22127726] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:20.125859 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ae31afd1-6378-4815-bcfe-8c51d9dc0b21 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:20.126346 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ae31afd1-6378-4815-bcfe-8c51d9dc0b21 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:20.126814 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ae31afd1-6378-4815-bcfe-8c51d9dc0b21 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:20.127510 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ae31afd1-6378-4815-bcfe-8c51d9dc0b21 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:20.127962 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ae31afd1-6378-4815-bcfe-8c51d9dc0b21 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:20.128388 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ae31afd1-6378-4815-bcfe-8c51d9dc0b21 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:20.264549 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ae31afd1-6378-4815-bcfe-8c51d9dc0b21 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:20.272677 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ae31afd1-6378-4815-bcfe-8c51d9dc0b21 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/8dd17104-d645-4cb0-84f0-31ae22127726" status: 200 len: 1471 microversion: 2.1 time: 0.159259 Sep 24 21:24:20.273247 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2984/5946] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:20 2022] GET /compute/v2.1/servers/8dd17104-d645-4cb0-84f0-31ae22127726 => generated 1471 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:20.295754 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-30d43a16-be8c-4685-9133-9abe30c2c8bc tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-848912216"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:24:20.298075 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-30d43a16-be8c-4685-9133-9abe30c2c8bc tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 8dd17104-d645-4cb0-84f0-31ae22127726] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:20.304952 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-30d43a16-be8c-4685-9133-9abe30c2c8bc tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:20.305435 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-30d43a16-be8c-4685-9133-9abe30c2c8bc tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:20.305878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-30d43a16-be8c-4685-9133-9abe30c2c8bc tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:20.306601 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-30d43a16-be8c-4685-9133-9abe30c2c8bc tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:20.307063 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-30d43a16-be8c-4685-9133-9abe30c2c8bc tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:20.307519 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-30d43a16-be8c-4685-9133-9abe30c2c8bc tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:20.510793 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-30d43a16-be8c-4685-9133-9abe30c2c8bc tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "POST /compute/v2.1/servers/8dd17104-d645-4cb0-84f0-31ae22127726/action" status: 202 len: 0 microversion: 2.1 time: 0.218829 Sep 24 21:24:20.512657 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2963/5947] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:24:20 2022] POST /compute/v2.1/servers/8dd17104-d645-4cb0-84f0-31ae22127726/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 24 21:24:20.523599 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b335a50f-1fc9-406c-8248-44adcbfd8756 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b0d17b4c0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:20.570336 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b335a50f-1fc9-406c-8248-44adcbfd8756 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/e2aa6bf4-3ac9-4636-afb5-681bd7aa1368" status: 200 len: 1411 microversion: 2.1 time: 0.050598 Sep 24 21:24:20.571292 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2985/5948] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:24:20 2022] GET /compute/v2.1/images/e2aa6bf4-3ac9-4636-afb5-681bd7aa1368 => generated 1411 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:21.587137 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5b7d30a8-29ce-4870-a9b7-7ec9829a1554 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b10fbaf70>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:21.632373 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5b7d30a8-29ce-4870-a9b7-7ec9829a1554 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/e2aa6bf4-3ac9-4636-afb5-681bd7aa1368" status: 200 len: 1411 microversion: 2.1 time: 0.049476 Sep 24 21:24:21.632973 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2964/5949] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:24:21 2022] GET /compute/v2.1/images/e2aa6bf4-3ac9-4636-afb5-681bd7aa1368 => generated 1411 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:22.650556 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cdd0d5a7-8f68-4bf5-8c35-84dbe93c07fd tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b0c95af70>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:22.694468 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cdd0d5a7-8f68-4bf5-8c35-84dbe93c07fd tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/e2aa6bf4-3ac9-4636-afb5-681bd7aa1368" status: 200 len: 1411 microversion: 2.1 time: 0.048742 Sep 24 21:24:22.695075 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2986/5950] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:24:22 2022] GET /compute/v2.1/images/e2aa6bf4-3ac9-4636-afb5-681bd7aa1368 => generated 1411 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:23.711613 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-71e37365-cb8f-464d-8acb-e80066b2f53b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b079dc040>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:23.756194 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-71e37365-cb8f-464d-8acb-e80066b2f53b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/e2aa6bf4-3ac9-4636-afb5-681bd7aa1368" status: 200 len: 1411 microversion: 2.1 time: 0.049293 Sep 24 21:24:23.756934 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2965/5951] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:24:23 2022] GET /compute/v2.1/images/e2aa6bf4-3ac9-4636-afb5-681bd7aa1368 => generated 1411 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:24.548735 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-74f16110-7d0a-49e1-a25b-6f0f73642b9a req-58b728ab-086c-42b0-b321-4e8e96a5e926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dd17104-d645-4cb0-84f0-31ae22127726", "name": "network-vif-plugged", "status": "completed", "tag": "6bac468f-ecc2-4239-a047-5cb90631c67c"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:24:24.566291 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-74f16110-7d0a-49e1-a25b-6f0f73642b9a req-58b728ab-086c-42b0-b321-4e8e96a5e926 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:24.566965 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-74f16110-7d0a-49e1-a25b-6f0f73642b9a req-58b728ab-086c-42b0-b321-4e8e96a5e926 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:24.567413 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-74f16110-7d0a-49e1-a25b-6f0f73642b9a req-58b728ab-086c-42b0-b321-4e8e96a5e926 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:24.580256 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-74f16110-7d0a-49e1-a25b-6f0f73642b9a req-58b728ab-086c-42b0-b321-4e8e96a5e926 service nova] Creating event network-vif-plugged:6bac468f-ecc2-4239-a047-5cb90631c67c for instance 8dd17104-d645-4cb0-84f0-31ae22127726 on nch2-master-1 Sep 24 21:24:24.586967 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-74f16110-7d0a-49e1-a25b-6f0f73642b9a req-58b728ab-086c-42b0-b321-4e8e96a5e926 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042355 Sep 24 21:24:24.588025 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2987/5952] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:24:24.773931 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cd7aebec-ec1d-4a71-8da4-178719373be6 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b0c954280>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:24.824714 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cd7aebec-ec1d-4a71-8da4-178719373be6 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/e2aa6bf4-3ac9-4636-afb5-681bd7aa1368" status: 200 len: 1411 microversion: 2.1 time: 0.055586 Sep 24 21:24:24.825301 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2966/5953] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:24:24 2022] GET /compute/v2.1/images/e2aa6bf4-3ac9-4636-afb5-681bd7aa1368 => generated 1411 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:25.841949 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ad2ac28f-d4e8-4b74-bf87-d30bffc370ef tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b07d78ca0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:25.896662 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ad2ac28f-d4e8-4b74-bf87-d30bffc370ef tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/e2aa6bf4-3ac9-4636-afb5-681bd7aa1368" status: 200 len: 1411 microversion: 2.1 time: 0.058728 Sep 24 21:24:25.897093 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2988/5954] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:24:25 2022] GET /compute/v2.1/images/e2aa6bf4-3ac9-4636-afb5-681bd7aa1368 => generated 1411 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:26.913027 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7665281b-650e-4170-84a3-23ecb9b6ea21 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b078db160>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:26.961714 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7665281b-650e-4170-84a3-23ecb9b6ea21 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/e2aa6bf4-3ac9-4636-afb5-681bd7aa1368" status: 200 len: 1411 microversion: 2.1 time: 0.052363 Sep 24 21:24:26.962301 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2967/5955] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:24:26 2022] GET /compute/v2.1/images/e2aa6bf4-3ac9-4636-afb5-681bd7aa1368 => generated 1411 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:27.978698 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3ffd1efb-6ad5-430e-ab82-db78029cc925 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b0c0b01f0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:28.023940 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3ffd1efb-6ad5-430e-ab82-db78029cc925 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/e2aa6bf4-3ac9-4636-afb5-681bd7aa1368" status: 200 len: 1411 microversion: 2.1 time: 0.050367 Sep 24 21:24:28.024509 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2989/5956] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:24:27 2022] GET /compute/v2.1/images/e2aa6bf4-3ac9-4636-afb5-681bd7aa1368 => generated 1411 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:29.042544 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e7f38f16-618a-4977-991a-4c962ce43c94 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b10fba8b0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:29.090768 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e7f38f16-618a-4977-991a-4c962ce43c94 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/e2aa6bf4-3ac9-4636-afb5-681bd7aa1368" status: 200 len: 1411 microversion: 2.1 time: 0.053870 Sep 24 21:24:29.091350 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2968/5957] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:24:29 2022] GET /compute/v2.1/images/e2aa6bf4-3ac9-4636-afb5-681bd7aa1368 => generated 1411 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:30.109206 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9d687b1a-70bf-4c54-bbbb-1f490f259abb tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b07bbaf70>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:30.163779 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9d687b1a-70bf-4c54-bbbb-1f490f259abb tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/e2aa6bf4-3ac9-4636-afb5-681bd7aa1368" status: 200 len: 1411 microversion: 2.1 time: 0.060029 Sep 24 21:24:30.164488 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2990/5958] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:24:30 2022] GET /compute/v2.1/images/e2aa6bf4-3ac9-4636-afb5-681bd7aa1368 => generated 1411 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:31.178428 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:24:31.180065 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:24:31.185236 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-de10487d-d925-4f8e-b37b-18a6f32d957b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b079dc040>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:31.243299 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-de10487d-d925-4f8e-b37b-18a6f32d957b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/e2aa6bf4-3ac9-4636-afb5-681bd7aa1368" status: 200 len: 1411 microversion: 2.1 time: 0.066482 Sep 24 21:24:31.254287 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2969/5959] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:24:31 2022] GET /compute/v2.1/images/e2aa6bf4-3ac9-4636-afb5-681bd7aa1368 => generated 1411 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:32.262444 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1a6aa7b1-917b-443c-9a6f-d66302115427 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b07dacf70>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:32.328185 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1a6aa7b1-917b-443c-9a6f-d66302115427 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/e2aa6bf4-3ac9-4636-afb5-681bd7aa1368" status: 200 len: 1411 microversion: 2.1 time: 0.070619 Sep 24 21:24:32.328771 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2991/5960] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:24:32 2022] GET /compute/v2.1/images/e2aa6bf4-3ac9-4636-afb5-681bd7aa1368 => generated 1411 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:33.345015 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9d567eb2-ee91-42b7-ba16-dbcfcfafc052 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b10f7c3a0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:33.391256 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9d567eb2-ee91-42b7-ba16-dbcfcfafc052 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/e2aa6bf4-3ac9-4636-afb5-681bd7aa1368" status: 200 len: 1420 microversion: 2.1 time: 0.051018 Sep 24 21:24:33.391835 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2970/5961] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:24:33 2022] GET /compute/v2.1/images/e2aa6bf4-3ac9-4636-afb5-681bd7aa1368 => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:33.406593 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-79125960-3ee9-448e-9393-4ecbdfc3d69e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b0cf3eee0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:33.449503 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-79125960-3ee9-448e-9393-4ecbdfc3d69e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/e2aa6bf4-3ac9-4636-afb5-681bd7aa1368" status: 200 len: 1420 microversion: 2.1 time: 0.047657 Sep 24 21:24:33.450066 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2992/5962] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:24:33 2022] GET /compute/v2.1/images/e2aa6bf4-3ac9-4636-afb5-681bd7aa1368 => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:33.464505 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ec87541f-e750-4aa6-a024-483525f7829e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b078db160>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:33.860853 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ec87541f-e750-4aa6-a024-483525f7829e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "DELETE /compute/v2.1/images/e2aa6bf4-3ac9-4636-afb5-681bd7aa1368" status: 204 len: 0 microversion: 2.1 time: 0.400148 Sep 24 21:24:33.861432 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2971/5963] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:33 2022] DELETE /compute/v2.1/images/e2aa6bf4-3ac9-4636-afb5-681bd7aa1368 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:24:33.869483 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-45c0d369-c76f-46fb-82d7-c8a3fe1df436 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:33.870118 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-45c0d369-c76f-46fb-82d7-c8a3fe1df436 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 8dd17104-d645-4cb0-84f0-31ae22127726] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:33.877190 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45c0d369-c76f-46fb-82d7-c8a3fe1df436 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:33.877680 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45c0d369-c76f-46fb-82d7-c8a3fe1df436 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:33.878123 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45c0d369-c76f-46fb-82d7-c8a3fe1df436 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:33.878853 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45c0d369-c76f-46fb-82d7-c8a3fe1df436 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:33.879316 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45c0d369-c76f-46fb-82d7-c8a3fe1df436 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:33.879751 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45c0d369-c76f-46fb-82d7-c8a3fe1df436 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:33.905106 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-45c0d369-c76f-46fb-82d7-c8a3fe1df436 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 8dd17104-d645-4cb0-84f0-31ae22127726] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:24:33.981361 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-45c0d369-c76f-46fb-82d7-c8a3fe1df436 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8dd17104-d645-4cb0-84f0-31ae22127726" status: 204 len: 0 microversion: 2.1 time: 0.115404 Sep 24 21:24:33.981994 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2993/5964] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:24:33 2022] DELETE /compute/v2.1/servers/8dd17104-d645-4cb0-84f0-31ae22127726 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:24:34.033660 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-410ae301-fdb6-41d5-9f84-0e853d1f34f0 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-231415496", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "1e70cdf0-658e-45a6-8dcd-a635db1c9a02"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:24:34.086414 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-410ae301-fdb6-41d5-9f84-0e853d1f34f0 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] validate_networks() for [('1e70cdf0-658e-45a6-8dcd-a635db1c9a02', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:24:34.458470 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-410ae301-fdb6-41d5-9f84-0e853d1f34f0 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:24:34.459117 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-410ae301-fdb6-41d5-9f84-0e853d1f34f0 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:24:34.459460 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-410ae301-fdb6-41d5-9f84-0e853d1f34f0 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:24:34.459886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-410ae301-fdb6-41d5-9f84-0e853d1f34f0 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:24:34.460312 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-410ae301-fdb6-41d5-9f84-0e853d1f34f0 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:24:34.469713 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-410ae301-fdb6-41d5-9f84-0e853d1f34f0 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:34.470200 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-410ae301-fdb6-41d5-9f84-0e853d1f34f0 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:34.470695 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-410ae301-fdb6-41d5-9f84-0e853d1f34f0 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:34.471439 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-410ae301-fdb6-41d5-9f84-0e853d1f34f0 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:34.471901 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-410ae301-fdb6-41d5-9f84-0e853d1f34f0 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:34.472366 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-410ae301-fdb6-41d5-9f84-0e853d1f34f0 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:34.489644 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-410ae301-fdb6-41d5-9f84-0e853d1f34f0 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Getting quotas for project eb957f17053b49419fbbc09b8633628b. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:24:34.494955 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-410ae301-fdb6-41d5-9f84-0e853d1f34f0 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Getting quotas for user d7432bc67cac447391173eedccefbf9e and project eb957f17053b49419fbbc09b8633628b. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:24:34.507975 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-410ae301-fdb6-41d5-9f84-0e853d1f34f0 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:24:34.510396 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-410ae301-fdb6-41d5-9f84-0e853d1f34f0 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:24:34.556358 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-410ae301-fdb6-41d5-9f84-0e853d1f34f0 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.526325 Sep 24 21:24:34.556950 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2972/5965] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:24:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:24:34.569627 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e175b45f-4273-47c7-bae3-d23eba2cec38 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:34.570377 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e175b45f-4273-47c7-bae3-d23eba2cec38 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:34.625732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e175b45f-4273-47c7-bae3-d23eba2cec38 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:34.635257 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e175b45f-4273-47c7-bae3-d23eba2cec38 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 200 len: 1207 microversion: 2.1 time: 0.069742 Sep 24 21:24:34.635934 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2994/5966] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:34 2022] GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 1207 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:24:35.164150 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-69f34e29-a864-4167-89cb-489f1ee9915f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:24:35.167194 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-69f34e29-a864-4167-89cb-489f1ee9915f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 96ebebed-0f53-4f0c-b21a-0b09b0665bc6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:35.175410 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-69f34e29-a864-4167-89cb-489f1ee9915f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:35.175896 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-69f34e29-a864-4167-89cb-489f1ee9915f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:35.177453 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-69f34e29-a864-4167-89cb-489f1ee9915f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:35.178392 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-69f34e29-a864-4167-89cb-489f1ee9915f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:35.178886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-69f34e29-a864-4167-89cb-489f1ee9915f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:35.179322 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-69f34e29-a864-4167-89cb-489f1ee9915f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:35.266290 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-69f34e29-a864-4167-89cb-489f1ee9915f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:24:35.266747 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-69f34e29-a864-4167-89cb-489f1ee9915f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:24:35.267228 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-69f34e29-a864-4167-89cb-489f1ee9915f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:24:35.267667 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-69f34e29-a864-4167-89cb-489f1ee9915f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:24:35.268341 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-69f34e29-a864-4167-89cb-489f1ee9915f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:24:35.327856 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-69f34e29-a864-4167-89cb-489f1ee9915f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 96ebebed-0f53-4f0c-b21a-0b09b0665bc6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:35.333757 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-69f34e29-a864-4167-89cb-489f1ee9915f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:35.334253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-69f34e29-a864-4167-89cb-489f1ee9915f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:35.334748 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-69f34e29-a864-4167-89cb-489f1ee9915f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:35.335490 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-69f34e29-a864-4167-89cb-489f1ee9915f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:35.335951 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-69f34e29-a864-4167-89cb-489f1ee9915f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:35.336387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-69f34e29-a864-4167-89cb-489f1ee9915f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:35.365495 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-69f34e29-a864-4167-89cb-489f1ee9915f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "POST /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6/action" status: 202 len: 1139 microversion: 2.1 time: 0.205296 Sep 24 21:24:35.366153 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2973/5967] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:24:35 2022] POST /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6/action => generated 1139 bytes in 207 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 24 21:24:35.385630 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0cac309f-60c9-4487-90ac-477059731524 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:35.386256 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0cac309f-60c9-4487-90ac-477059731524 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 96ebebed-0f53-4f0c-b21a-0b09b0665bc6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:35.389200 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:24:35.394974 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0cac309f-60c9-4487-90ac-477059731524 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:35.395473 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0cac309f-60c9-4487-90ac-477059731524 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:35.395926 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0cac309f-60c9-4487-90ac-477059731524 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:35.396643 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0cac309f-60c9-4487-90ac-477059731524 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:35.397110 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0cac309f-60c9-4487-90ac-477059731524 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:35.397545 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0cac309f-60c9-4487-90ac-477059731524 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:35.400940 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:24:35.545656 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0cac309f-60c9-4487-90ac-477059731524 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:35.554157 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0cac309f-60c9-4487-90ac-477059731524 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6" status: 200 len: 1693 microversion: 2.1 time: 0.172078 Sep 24 21:24:35.555105 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2995/5968] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:35 2022] GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6 => generated 1693 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:35.658643 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e2ab95a5-b3ab-46d3-b3cf-80ee62bdaddc tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:35.659272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e2ab95a5-b3ab-46d3-b3cf-80ee62bdaddc tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:35.671223 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e2ab95a5-b3ab-46d3-b3cf-80ee62bdaddc tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:35.671733 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e2ab95a5-b3ab-46d3-b3cf-80ee62bdaddc tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:35.672183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e2ab95a5-b3ab-46d3-b3cf-80ee62bdaddc tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:35.672913 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e2ab95a5-b3ab-46d3-b3cf-80ee62bdaddc tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:35.673372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e2ab95a5-b3ab-46d3-b3cf-80ee62bdaddc tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:35.673802 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e2ab95a5-b3ab-46d3-b3cf-80ee62bdaddc tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:35.800223 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e2ab95a5-b3ab-46d3-b3cf-80ee62bdaddc tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:35.813289 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e2ab95a5-b3ab-46d3-b3cf-80ee62bdaddc tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 200 len: 1267 microversion: 2.1 time: 0.158896 Sep 24 21:24:35.814766 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2974/5969] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:35 2022] GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:36.306714 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-990ba945-3a59-4091-b29a-35aabe4906f6 req-f555be96-d926-4051-9386-93aaab6c8067 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dd17104-d645-4cb0-84f0-31ae22127726", "name": "network-vif-deleted", "tag": "6bac468f-ecc2-4239-a047-5cb90631c67c"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:24:36.319461 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-990ba945-3a59-4091-b29a-35aabe4906f6 req-f555be96-d926-4051-9386-93aaab6c8067 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:36.319963 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-990ba945-3a59-4091-b29a-35aabe4906f6 req-f555be96-d926-4051-9386-93aaab6c8067 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:36.320405 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-990ba945-3a59-4091-b29a-35aabe4906f6 req-f555be96-d926-4051-9386-93aaab6c8067 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:36.333445 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-990ba945-3a59-4091-b29a-35aabe4906f6 req-f555be96-d926-4051-9386-93aaab6c8067 service nova] Creating event network-vif-deleted:6bac468f-ecc2-4239-a047-5cb90631c67c for instance 8dd17104-d645-4cb0-84f0-31ae22127726 on nch2-master-1 Sep 24 21:24:36.338444 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-990ba945-3a59-4091-b29a-35aabe4906f6 req-f555be96-d926-4051-9386-93aaab6c8067 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035738 Sep 24 21:24:36.339126 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2996/5970] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:24:36.582022 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-27aecb78-3f89-4b5f-93ed-356835aa240e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:36.582675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-27aecb78-3f89-4b5f-93ed-356835aa240e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 96ebebed-0f53-4f0c-b21a-0b09b0665bc6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:36.595634 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27aecb78-3f89-4b5f-93ed-356835aa240e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:36.596137 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27aecb78-3f89-4b5f-93ed-356835aa240e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:36.596613 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27aecb78-3f89-4b5f-93ed-356835aa240e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:36.597558 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27aecb78-3f89-4b5f-93ed-356835aa240e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:36.598023 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27aecb78-3f89-4b5f-93ed-356835aa240e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:36.598459 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27aecb78-3f89-4b5f-93ed-356835aa240e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:36.743306 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-27aecb78-3f89-4b5f-93ed-356835aa240e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:36.751834 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-27aecb78-3f89-4b5f-93ed-356835aa240e tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6" status: 200 len: 1693 microversion: 2.1 time: 0.173704 Sep 24 21:24:36.752431 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2975/5971] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:36 2022] GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6 => generated 1693 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:36.837775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-07578417-6498-4f6c-8bd2-c0688c6da611 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:36.838484 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-07578417-6498-4f6c-8bd2-c0688c6da611 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:36.850572 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-07578417-6498-4f6c-8bd2-c0688c6da611 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:36.851069 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-07578417-6498-4f6c-8bd2-c0688c6da611 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:36.851499 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-07578417-6498-4f6c-8bd2-c0688c6da611 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:36.852200 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-07578417-6498-4f6c-8bd2-c0688c6da611 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:36.853395 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-07578417-6498-4f6c-8bd2-c0688c6da611 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:36.853763 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-07578417-6498-4f6c-8bd2-c0688c6da611 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:37.004997 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-07578417-6498-4f6c-8bd2-c0688c6da611 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:37.013028 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-07578417-6498-4f6c-8bd2-c0688c6da611 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 200 len: 1307 microversion: 2.1 time: 0.179516 Sep 24 21:24:37.013675 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2997/5972] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:36 2022] GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 1307 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:37.067379 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-58b25996-e78a-4209-9827-468b529c44b4 req-fd40f391-a597-4833-8bdd-1a64a80b3a26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bbaa1bb-c15e-4858-871d-5adf18509357", "tag": "7a753620-2a0f-47dd-8f2a-eabde4128d75"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:24:37.077835 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-58b25996-e78a-4209-9827-468b529c44b4 req-fd40f391-a597-4833-8bdd-1a64a80b3a26 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:37.078327 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-58b25996-e78a-4209-9827-468b529c44b4 req-fd40f391-a597-4833-8bdd-1a64a80b3a26 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:37.079008 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-58b25996-e78a-4209-9827-468b529c44b4 req-fd40f391-a597-4833-8bdd-1a64a80b3a26 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:37.090528 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-58b25996-e78a-4209-9827-468b529c44b4 req-fd40f391-a597-4833-8bdd-1a64a80b3a26 service nova] Creating event network-changed:7a753620-2a0f-47dd-8f2a-eabde4128d75 for instance 0bbaa1bb-c15e-4858-871d-5adf18509357 on nch1-master-1 Sep 24 21:24:37.096562 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-58b25996-e78a-4209-9827-468b529c44b4 req-fd40f391-a597-4833-8bdd-1a64a80b3a26 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033385 Sep 24 21:24:37.097169 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2976/5973] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:24:37.776894 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3d373c2a-dd67-44d1-a94e-cf98180c0abe tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:37.777514 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3d373c2a-dd67-44d1-a94e-cf98180c0abe tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 96ebebed-0f53-4f0c-b21a-0b09b0665bc6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:37.785700 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d373c2a-dd67-44d1-a94e-cf98180c0abe tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:37.786213 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d373c2a-dd67-44d1-a94e-cf98180c0abe tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:37.787034 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d373c2a-dd67-44d1-a94e-cf98180c0abe tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:37.787745 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d373c2a-dd67-44d1-a94e-cf98180c0abe tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:37.788411 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d373c2a-dd67-44d1-a94e-cf98180c0abe tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:37.788939 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d373c2a-dd67-44d1-a94e-cf98180c0abe tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:37.924079 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3d373c2a-dd67-44d1-a94e-cf98180c0abe tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:37.931962 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3d373c2a-dd67-44d1-a94e-cf98180c0abe tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6" status: 200 len: 1693 microversion: 2.1 time: 0.159353 Sep 24 21:24:37.932540 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2998/5974] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:37 2022] GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6 => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:38.037509 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-936bc040-6f9c-4c2a-b368-ad8d1bab1fb5 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:38.038253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-936bc040-6f9c-4c2a-b368-ad8d1bab1fb5 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:38.045362 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-936bc040-6f9c-4c2a-b368-ad8d1bab1fb5 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:38.045863 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-936bc040-6f9c-4c2a-b368-ad8d1bab1fb5 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:38.046310 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-936bc040-6f9c-4c2a-b368-ad8d1bab1fb5 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:38.047317 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-936bc040-6f9c-4c2a-b368-ad8d1bab1fb5 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:38.047790 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-936bc040-6f9c-4c2a-b368-ad8d1bab1fb5 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:38.048229 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-936bc040-6f9c-4c2a-b368-ad8d1bab1fb5 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:38.181897 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-936bc040-6f9c-4c2a-b368-ad8d1bab1fb5 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:38.190475 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-936bc040-6f9c-4c2a-b368-ad8d1bab1fb5 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 200 len: 1307 microversion: 2.1 time: 0.157772 Sep 24 21:24:38.191073 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2977/5975] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:38 2022] GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 1307 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:38.956516 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-eef07fa8-bf4a-4c9b-b188-63507d53a826 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:38.957137 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-eef07fa8-bf4a-4c9b-b188-63507d53a826 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 96ebebed-0f53-4f0c-b21a-0b09b0665bc6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:38.964063 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eef07fa8-bf4a-4c9b-b188-63507d53a826 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:38.964586 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eef07fa8-bf4a-4c9b-b188-63507d53a826 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:38.965035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eef07fa8-bf4a-4c9b-b188-63507d53a826 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:38.965765 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eef07fa8-bf4a-4c9b-b188-63507d53a826 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:38.966799 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eef07fa8-bf4a-4c9b-b188-63507d53a826 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:38.967226 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eef07fa8-bf4a-4c9b-b188-63507d53a826 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:39.099681 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-eef07fa8-bf4a-4c9b-b188-63507d53a826 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:39.107452 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-eef07fa8-bf4a-4c9b-b188-63507d53a826 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6" status: 200 len: 1693 microversion: 2.1 time: 0.154836 Sep 24 21:24:39.108034 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 2999/5976] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:38 2022] GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6 => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:39.213130 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e5e82466-2dd4-4127-b9c0-c38008b81c67 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:39.213686 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e5e82466-2dd4-4127-b9c0-c38008b81c67 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:39.220858 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e5e82466-2dd4-4127-b9c0-c38008b81c67 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:39.221348 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e5e82466-2dd4-4127-b9c0-c38008b81c67 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:39.221794 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e5e82466-2dd4-4127-b9c0-c38008b81c67 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:39.222525 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e5e82466-2dd4-4127-b9c0-c38008b81c67 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:39.222990 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e5e82466-2dd4-4127-b9c0-c38008b81c67 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:39.223427 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e5e82466-2dd4-4127-b9c0-c38008b81c67 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:39.356483 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e5e82466-2dd4-4127-b9c0-c38008b81c67 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:39.364386 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e5e82466-2dd4-4127-b9c0-c38008b81c67 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 200 len: 1307 microversion: 2.1 time: 0.155270 Sep 24 21:24:39.364965 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2978/5977] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:39 2022] GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 1307 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:40.131234 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dcff0f2d-d80a-48fc-9848-172047e1409b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:40.131859 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dcff0f2d-d80a-48fc-9848-172047e1409b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 96ebebed-0f53-4f0c-b21a-0b09b0665bc6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:40.138890 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dcff0f2d-d80a-48fc-9848-172047e1409b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:40.139385 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dcff0f2d-d80a-48fc-9848-172047e1409b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:40.139833 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dcff0f2d-d80a-48fc-9848-172047e1409b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:40.140547 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dcff0f2d-d80a-48fc-9848-172047e1409b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:40.141011 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dcff0f2d-d80a-48fc-9848-172047e1409b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:40.141447 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dcff0f2d-d80a-48fc-9848-172047e1409b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:40.276248 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dcff0f2d-d80a-48fc-9848-172047e1409b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:40.284952 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dcff0f2d-d80a-48fc-9848-172047e1409b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6" status: 200 len: 1693 microversion: 2.1 time: 0.157605 Sep 24 21:24:40.285530 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3000/5978] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:40 2022] GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:40.387341 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b8c4ceca-9eef-4bca-8b85-887c1b3ab631 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:40.388019 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b8c4ceca-9eef-4bca-8b85-887c1b3ab631 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:40.395267 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b8c4ceca-9eef-4bca-8b85-887c1b3ab631 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:40.395759 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b8c4ceca-9eef-4bca-8b85-887c1b3ab631 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:40.396200 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b8c4ceca-9eef-4bca-8b85-887c1b3ab631 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:40.396899 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b8c4ceca-9eef-4bca-8b85-887c1b3ab631 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:40.397362 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b8c4ceca-9eef-4bca-8b85-887c1b3ab631 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:40.397824 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b8c4ceca-9eef-4bca-8b85-887c1b3ab631 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:40.525525 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b8c4ceca-9eef-4bca-8b85-887c1b3ab631 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:40.533363 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b8c4ceca-9eef-4bca-8b85-887c1b3ab631 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 200 len: 1307 microversion: 2.1 time: 0.149958 Sep 24 21:24:40.533937 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2979/5979] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:40 2022] GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 1307 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:41.309685 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cb23df6d-ac4d-4633-bab9-fd939401017a tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:41.310553 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cb23df6d-ac4d-4633-bab9-fd939401017a tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 96ebebed-0f53-4f0c-b21a-0b09b0665bc6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:41.317430 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cb23df6d-ac4d-4633-bab9-fd939401017a tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:41.317915 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cb23df6d-ac4d-4633-bab9-fd939401017a tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:41.318356 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cb23df6d-ac4d-4633-bab9-fd939401017a tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:41.319080 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cb23df6d-ac4d-4633-bab9-fd939401017a tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:41.319539 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cb23df6d-ac4d-4633-bab9-fd939401017a tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:41.319969 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cb23df6d-ac4d-4633-bab9-fd939401017a tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:41.458396 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cb23df6d-ac4d-4633-bab9-fd939401017a tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:41.466336 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cb23df6d-ac4d-4633-bab9-fd939401017a tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6" status: 200 len: 1693 microversion: 2.1 time: 0.160737 Sep 24 21:24:41.467150 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3001/5980] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:41 2022] GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6 => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:41.558543 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ba8bb622-63a5-4d7b-8dcd-66d4714236a3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:41.558543 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ba8bb622-63a5-4d7b-8dcd-66d4714236a3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:41.565981 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba8bb622-63a5-4d7b-8dcd-66d4714236a3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:41.566408 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba8bb622-63a5-4d7b-8dcd-66d4714236a3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:41.566891 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba8bb622-63a5-4d7b-8dcd-66d4714236a3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:41.567589 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba8bb622-63a5-4d7b-8dcd-66d4714236a3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:41.568042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba8bb622-63a5-4d7b-8dcd-66d4714236a3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:41.568466 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba8bb622-63a5-4d7b-8dcd-66d4714236a3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:41.708094 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ba8bb622-63a5-4d7b-8dcd-66d4714236a3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:41.716292 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ba8bb622-63a5-4d7b-8dcd-66d4714236a3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 200 len: 1307 microversion: 2.1 time: 0.163382 Sep 24 21:24:41.716885 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2980/5981] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:41 2022] GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 1307 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:42.489209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-93eaeda1-c424-43c9-9f40-42a84a61726b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:42.489831 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-93eaeda1-c424-43c9-9f40-42a84a61726b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 96ebebed-0f53-4f0c-b21a-0b09b0665bc6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:42.496584 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93eaeda1-c424-43c9-9f40-42a84a61726b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:42.497332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93eaeda1-c424-43c9-9f40-42a84a61726b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:42.497779 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93eaeda1-c424-43c9-9f40-42a84a61726b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:42.498491 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93eaeda1-c424-43c9-9f40-42a84a61726b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:42.498980 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93eaeda1-c424-43c9-9f40-42a84a61726b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:42.499417 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93eaeda1-c424-43c9-9f40-42a84a61726b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:42.632603 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-93eaeda1-c424-43c9-9f40-42a84a61726b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:42.641460 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-93eaeda1-c424-43c9-9f40-42a84a61726b tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6" status: 200 len: 1693 microversion: 2.1 time: 0.156170 Sep 24 21:24:42.642050 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3002/5982] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:42 2022] GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:42.739113 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7b809b53-b275-4ec8-b9e7-794372c29581 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:42.739742 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7b809b53-b275-4ec8-b9e7-794372c29581 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:42.746671 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b809b53-b275-4ec8-b9e7-794372c29581 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:42.747167 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b809b53-b275-4ec8-b9e7-794372c29581 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:42.747621 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b809b53-b275-4ec8-b9e7-794372c29581 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:42.748322 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b809b53-b275-4ec8-b9e7-794372c29581 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:42.748788 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b809b53-b275-4ec8-b9e7-794372c29581 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:42.749225 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b809b53-b275-4ec8-b9e7-794372c29581 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:42.882288 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7b809b53-b275-4ec8-b9e7-794372c29581 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:42.890885 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7b809b53-b275-4ec8-b9e7-794372c29581 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 200 len: 1307 microversion: 2.1 time: 0.155527 Sep 24 21:24:42.891459 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2981/5983] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:42 2022] GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 1307 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:43.602976 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-5e887178-a8a7-44d1-91e7-b4fecc077dae req-49b6ff6a-dacf-4bf3-9c7b-e888b0d2a874 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bbaa1bb-c15e-4858-871d-5adf18509357", "name": "network-vif-plugged", "status": "completed", "tag": "7a753620-2a0f-47dd-8f2a-eabde4128d75"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:24:43.617730 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-5e887178-a8a7-44d1-91e7-b4fecc077dae req-49b6ff6a-dacf-4bf3-9c7b-e888b0d2a874 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:43.618223 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-5e887178-a8a7-44d1-91e7-b4fecc077dae req-49b6ff6a-dacf-4bf3-9c7b-e888b0d2a874 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:43.618692 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-5e887178-a8a7-44d1-91e7-b4fecc077dae req-49b6ff6a-dacf-4bf3-9c7b-e888b0d2a874 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:43.635017 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-5e887178-a8a7-44d1-91e7-b4fecc077dae req-49b6ff6a-dacf-4bf3-9c7b-e888b0d2a874 service nova] Creating event network-vif-plugged:7a753620-2a0f-47dd-8f2a-eabde4128d75 for instance 0bbaa1bb-c15e-4858-871d-5adf18509357 on nch1-master-1 Sep 24 21:24:43.642428 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-5e887178-a8a7-44d1-91e7-b4fecc077dae req-49b6ff6a-dacf-4bf3-9c7b-e888b0d2a874 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044268 Sep 24 21:24:43.643349 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3003/5984] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:24:43.668158 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d491671e-6e7f-4285-8536-c7311ae7a56d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:43.669852 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d491671e-6e7f-4285-8536-c7311ae7a56d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 96ebebed-0f53-4f0c-b21a-0b09b0665bc6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:43.676556 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d491671e-6e7f-4285-8536-c7311ae7a56d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:43.677110 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d491671e-6e7f-4285-8536-c7311ae7a56d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:43.678281 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d491671e-6e7f-4285-8536-c7311ae7a56d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:43.679505 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d491671e-6e7f-4285-8536-c7311ae7a56d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:43.680055 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d491671e-6e7f-4285-8536-c7311ae7a56d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:43.680563 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d491671e-6e7f-4285-8536-c7311ae7a56d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:43.819380 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d491671e-6e7f-4285-8536-c7311ae7a56d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:43.827669 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d491671e-6e7f-4285-8536-c7311ae7a56d tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6" status: 200 len: 1693 microversion: 2.1 time: 0.165437 Sep 24 21:24:43.828269 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2982/5985] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:43 2022] GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6 => generated 1693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:43.913809 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2a076363-87de-4317-abdd-16cb404e1868 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:43.914585 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2a076363-87de-4317-abdd-16cb404e1868 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:43.921360 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a076363-87de-4317-abdd-16cb404e1868 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:43.921835 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a076363-87de-4317-abdd-16cb404e1868 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:43.922277 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a076363-87de-4317-abdd-16cb404e1868 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:43.923015 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a076363-87de-4317-abdd-16cb404e1868 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:43.923469 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a076363-87de-4317-abdd-16cb404e1868 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:43.923896 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a076363-87de-4317-abdd-16cb404e1868 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:44.051819 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2a076363-87de-4317-abdd-16cb404e1868 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:44.060493 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2a076363-87de-4317-abdd-16cb404e1868 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 200 len: 1307 microversion: 2.1 time: 0.150055 Sep 24 21:24:44.061076 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3004/5986] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:43 2022] GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 1307 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:44.862907 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-15516ccb-07e1-4cbf-935d-734120120888 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:44.863534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-15516ccb-07e1-4cbf-935d-734120120888 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 96ebebed-0f53-4f0c-b21a-0b09b0665bc6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:44.865539 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:24:44.866220 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:24:44.872951 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-15516ccb-07e1-4cbf-935d-734120120888 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:44.873478 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-15516ccb-07e1-4cbf-935d-734120120888 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:44.873933 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-15516ccb-07e1-4cbf-935d-734120120888 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:44.874739 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-15516ccb-07e1-4cbf-935d-734120120888 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:44.875212 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-15516ccb-07e1-4cbf-935d-734120120888 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:44.875650 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-15516ccb-07e1-4cbf-935d-734120120888 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:45.012235 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-15516ccb-07e1-4cbf-935d-734120120888 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:45.020645 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-15516ccb-07e1-4cbf-935d-734120120888 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6" status: 200 len: 1693 microversion: 2.1 time: 0.161585 Sep 24 21:24:45.021265 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2983/5987] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:44 2022] GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6 => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:45.083090 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d880a46c-31f1-4f65-8b1c-5798eb209c5e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:45.083707 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d880a46c-31f1-4f65-8b1c-5798eb209c5e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:45.086599 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:24:45.093013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d880a46c-31f1-4f65-8b1c-5798eb209c5e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:45.093628 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d880a46c-31f1-4f65-8b1c-5798eb209c5e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:45.094186 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d880a46c-31f1-4f65-8b1c-5798eb209c5e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:45.095189 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d880a46c-31f1-4f65-8b1c-5798eb209c5e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:45.095654 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d880a46c-31f1-4f65-8b1c-5798eb209c5e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:45.096089 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d880a46c-31f1-4f65-8b1c-5798eb209c5e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:45.235336 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d880a46c-31f1-4f65-8b1c-5798eb209c5e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:45.243085 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d880a46c-31f1-4f65-8b1c-5798eb209c5e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 200 len: 1307 microversion: 2.1 time: 0.163875 Sep 24 21:24:45.243881 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3005/5988] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:45 2022] GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 1307 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:46.044749 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b3236afa-a687-4b11-9e4d-473ac7121976 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:46.045369 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b3236afa-a687-4b11-9e4d-473ac7121976 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 96ebebed-0f53-4f0c-b21a-0b09b0665bc6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:46.052381 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b3236afa-a687-4b11-9e4d-473ac7121976 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:46.052862 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b3236afa-a687-4b11-9e4d-473ac7121976 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:46.053298 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b3236afa-a687-4b11-9e4d-473ac7121976 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:46.054321 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b3236afa-a687-4b11-9e4d-473ac7121976 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:46.054814 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b3236afa-a687-4b11-9e4d-473ac7121976 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:46.055261 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b3236afa-a687-4b11-9e4d-473ac7121976 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:46.186374 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b3236afa-a687-4b11-9e4d-473ac7121976 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:46.194290 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b3236afa-a687-4b11-9e4d-473ac7121976 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6" status: 200 len: 1693 microversion: 2.1 time: 0.153937 Sep 24 21:24:46.194882 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2984/5989] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:46 2022] GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6 => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:46.266164 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a51eaa12-5544-43c0-8afb-1bdcca11d7d8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:46.266805 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a51eaa12-5544-43c0-8afb-1bdcca11d7d8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:46.274098 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a51eaa12-5544-43c0-8afb-1bdcca11d7d8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:46.274335 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a51eaa12-5544-43c0-8afb-1bdcca11d7d8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:46.274806 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a51eaa12-5544-43c0-8afb-1bdcca11d7d8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:46.275512 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a51eaa12-5544-43c0-8afb-1bdcca11d7d8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:46.276058 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a51eaa12-5544-43c0-8afb-1bdcca11d7d8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:46.276493 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a51eaa12-5544-43c0-8afb-1bdcca11d7d8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:46.410301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a51eaa12-5544-43c0-8afb-1bdcca11d7d8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:46.418227 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a51eaa12-5544-43c0-8afb-1bdcca11d7d8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 200 len: 1485 microversion: 2.1 time: 0.156278 Sep 24 21:24:46.419346 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3006/5990] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:46 2022] GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 1485 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:46.441732 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0b3d169d-8329-4fb7-9943-12473d501588 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:24:46.447764 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b3d169d-8329-4fb7-9943-12473d501588 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:46.448254 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b3d169d-8329-4fb7-9943-12473d501588 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:46.448699 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0b3d169d-8329-4fb7-9943-12473d501588 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:46.471579 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0b3d169d-8329-4fb7-9943-12473d501588 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Going to try to stop instance {{(pid=140516) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 24 21:24:46.516780 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0b3d169d-8329-4fb7-9943-12473d501588 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "POST /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357/action" status: 202 len: 0 microversion: 2.1 time: 0.078981 Sep 24 21:24:46.517385 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2985/5991] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:24:46 2022] POST /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:24:46.525675 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b7df6dda-e185-44ae-b7b6-93248d1059b3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:46.526321 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b7df6dda-e185-44ae-b7b6-93248d1059b3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:46.532428 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b7df6dda-e185-44ae-b7b6-93248d1059b3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:46.532921 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b7df6dda-e185-44ae-b7b6-93248d1059b3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:46.533371 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b7df6dda-e185-44ae-b7b6-93248d1059b3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:46.534076 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b7df6dda-e185-44ae-b7b6-93248d1059b3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:46.534566 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b7df6dda-e185-44ae-b7b6-93248d1059b3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:46.535004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b7df6dda-e185-44ae-b7b6-93248d1059b3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:46.671029 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b7df6dda-e185-44ae-b7b6-93248d1059b3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:46.679007 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b7df6dda-e185-44ae-b7b6-93248d1059b3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 200 len: 1495 microversion: 2.1 time: 0.157238 Sep 24 21:24:46.679594 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3007/5992] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:46 2022] GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 1495 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:47.220170 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0db676da-4991-4d53-a116-6397ed6cf49f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:47.220964 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0db676da-4991-4d53-a116-6397ed6cf49f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 96ebebed-0f53-4f0c-b21a-0b09b0665bc6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:47.228069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0db676da-4991-4d53-a116-6397ed6cf49f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:47.228611 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0db676da-4991-4d53-a116-6397ed6cf49f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:47.229067 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0db676da-4991-4d53-a116-6397ed6cf49f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:47.229795 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0db676da-4991-4d53-a116-6397ed6cf49f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:47.230255 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0db676da-4991-4d53-a116-6397ed6cf49f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:47.230716 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0db676da-4991-4d53-a116-6397ed6cf49f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:47.365662 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0db676da-4991-4d53-a116-6397ed6cf49f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:47.369243 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:24:47.375480 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0db676da-4991-4d53-a116-6397ed6cf49f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6" status: 200 len: 1711 microversion: 2.1 time: 0.160932 Sep 24 21:24:47.376060 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2986/5993] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:47 2022] GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6 => generated 1711 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:47.702103 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1eff78e7-8abe-4212-888e-b69abc2fb802 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:47.702756 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1eff78e7-8abe-4212-888e-b69abc2fb802 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:47.709673 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1eff78e7-8abe-4212-888e-b69abc2fb802 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:47.710166 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1eff78e7-8abe-4212-888e-b69abc2fb802 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:47.710650 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1eff78e7-8abe-4212-888e-b69abc2fb802 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:47.711366 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1eff78e7-8abe-4212-888e-b69abc2fb802 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:47.711942 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1eff78e7-8abe-4212-888e-b69abc2fb802 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:47.712423 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1eff78e7-8abe-4212-888e-b69abc2fb802 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:47.845474 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1eff78e7-8abe-4212-888e-b69abc2fb802 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:47.853217 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1eff78e7-8abe-4212-888e-b69abc2fb802 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 200 len: 1495 microversion: 2.1 time: 0.155819 Sep 24 21:24:47.853796 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3008/5994] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:47 2022] GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 1495 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:48.400270 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-03af91ae-a06b-4103-b797-483615f1ef53 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:48.400883 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-03af91ae-a06b-4103-b797-483615f1ef53 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 96ebebed-0f53-4f0c-b21a-0b09b0665bc6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:48.409423 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-03af91ae-a06b-4103-b797-483615f1ef53 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:48.409917 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-03af91ae-a06b-4103-b797-483615f1ef53 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:48.410357 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-03af91ae-a06b-4103-b797-483615f1ef53 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:48.411101 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-03af91ae-a06b-4103-b797-483615f1ef53 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:48.411560 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-03af91ae-a06b-4103-b797-483615f1ef53 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:48.411987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-03af91ae-a06b-4103-b797-483615f1ef53 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:48.545040 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-03af91ae-a06b-4103-b797-483615f1ef53 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:48.552797 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-03af91ae-a06b-4103-b797-483615f1ef53 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6" status: 200 len: 1699 microversion: 2.1 time: 0.157105 Sep 24 21:24:48.553366 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2987/5995] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:48 2022] GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6 => generated 1699 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:48.879157 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bddb7915-107b-476a-8c20-31549c39ee18 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:48.880087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bddb7915-107b-476a-8c20-31549c39ee18 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:48.892038 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bddb7915-107b-476a-8c20-31549c39ee18 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:48.892776 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bddb7915-107b-476a-8c20-31549c39ee18 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:48.893234 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bddb7915-107b-476a-8c20-31549c39ee18 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:48.893941 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bddb7915-107b-476a-8c20-31549c39ee18 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:48.894403 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bddb7915-107b-476a-8c20-31549c39ee18 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:48.894879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bddb7915-107b-476a-8c20-31549c39ee18 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:49.353655 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bddb7915-107b-476a-8c20-31549c39ee18 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:49.362321 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bddb7915-107b-476a-8c20-31549c39ee18 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 200 len: 1495 microversion: 2.1 time: 0.488244 Sep 24 21:24:49.362925 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3009/5996] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:48 2022] GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 1495 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:49.576331 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0e28a1ed-6cfa-4095-b3bc-0ea4ad476dbb tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:49.576948 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0e28a1ed-6cfa-4095-b3bc-0ea4ad476dbb tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 96ebebed-0f53-4f0c-b21a-0b09b0665bc6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:49.583980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e28a1ed-6cfa-4095-b3bc-0ea4ad476dbb tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:49.584467 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e28a1ed-6cfa-4095-b3bc-0ea4ad476dbb tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:49.584911 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e28a1ed-6cfa-4095-b3bc-0ea4ad476dbb tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:49.585625 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e28a1ed-6cfa-4095-b3bc-0ea4ad476dbb tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:49.586072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e28a1ed-6cfa-4095-b3bc-0ea4ad476dbb tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:49.586520 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e28a1ed-6cfa-4095-b3bc-0ea4ad476dbb tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:49.718141 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0e28a1ed-6cfa-4095-b3bc-0ea4ad476dbb tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:49.728590 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0e28a1ed-6cfa-4095-b3bc-0ea4ad476dbb tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6" status: 200 len: 1699 microversion: 2.1 time: 0.155983 Sep 24 21:24:49.729305 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2988/5997] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:49 2022] GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6 => generated 1699 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:50.385087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2d610f58-fea7-4e21-b50d-c37663a5af21 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:50.385709 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2d610f58-fea7-4e21-b50d-c37663a5af21 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:50.393704 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d610f58-fea7-4e21-b50d-c37663a5af21 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:50.394190 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d610f58-fea7-4e21-b50d-c37663a5af21 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:50.394696 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d610f58-fea7-4e21-b50d-c37663a5af21 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:50.395390 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d610f58-fea7-4e21-b50d-c37663a5af21 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:50.395848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d610f58-fea7-4e21-b50d-c37663a5af21 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:50.396286 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d610f58-fea7-4e21-b50d-c37663a5af21 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:50.584925 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2d610f58-fea7-4e21-b50d-c37663a5af21 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:50.592722 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2d610f58-fea7-4e21-b50d-c37663a5af21 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 200 len: 1495 microversion: 2.1 time: 0.211489 Sep 24 21:24:50.593275 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3010/5998] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:50 2022] GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 1495 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:50.753662 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3dc3c4a6-7cc8-4d42-b6c3-8f84fd8e0921 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:50.754291 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3dc3c4a6-7cc8-4d42-b6c3-8f84fd8e0921 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 96ebebed-0f53-4f0c-b21a-0b09b0665bc6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:50.761330 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3dc3c4a6-7cc8-4d42-b6c3-8f84fd8e0921 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:50.761845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3dc3c4a6-7cc8-4d42-b6c3-8f84fd8e0921 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:50.762877 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3dc3c4a6-7cc8-4d42-b6c3-8f84fd8e0921 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:50.763693 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3dc3c4a6-7cc8-4d42-b6c3-8f84fd8e0921 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:50.764163 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3dc3c4a6-7cc8-4d42-b6c3-8f84fd8e0921 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:50.764602 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3dc3c4a6-7cc8-4d42-b6c3-8f84fd8e0921 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:50.895147 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3dc3c4a6-7cc8-4d42-b6c3-8f84fd8e0921 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:50.903900 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3dc3c4a6-7cc8-4d42-b6c3-8f84fd8e0921 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6" status: 200 len: 1699 microversion: 2.1 time: 0.153261 Sep 24 21:24:50.904484 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2989/5999] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:50 2022] GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6 => generated 1699 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:51.615633 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a9d75ec4-b5f8-4e98-9e0f-9662fa03b5ca tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:51.616250 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a9d75ec4-b5f8-4e98-9e0f-9662fa03b5ca tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:51.624844 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9d75ec4-b5f8-4e98-9e0f-9662fa03b5ca tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:51.625346 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9d75ec4-b5f8-4e98-9e0f-9662fa03b5ca tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:51.625792 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9d75ec4-b5f8-4e98-9e0f-9662fa03b5ca tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:51.626536 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9d75ec4-b5f8-4e98-9e0f-9662fa03b5ca tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:51.627009 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9d75ec4-b5f8-4e98-9e0f-9662fa03b5ca tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:51.627447 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9d75ec4-b5f8-4e98-9e0f-9662fa03b5ca tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:51.690455 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-f1fd0a1d-a956-45bd-ac0f-170a198d8e0b req-226982a0-b455-47cd-81e4-79167f4d8bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96ebebed-0f53-4f0c-b21a-0b09b0665bc6", "name": "network-vif-unplugged", "status": "completed", "tag": "b49bf1e2-3e0a-4360-84dc-c9e4304449a9"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:24:51.703984 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-f1fd0a1d-a956-45bd-ac0f-170a198d8e0b req-226982a0-b455-47cd-81e4-79167f4d8bb6 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:51.704518 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-f1fd0a1d-a956-45bd-ac0f-170a198d8e0b req-226982a0-b455-47cd-81e4-79167f4d8bb6 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:51.705384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-f1fd0a1d-a956-45bd-ac0f-170a198d8e0b req-226982a0-b455-47cd-81e4-79167f4d8bb6 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:51.717842 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-f1fd0a1d-a956-45bd-ac0f-170a198d8e0b req-226982a0-b455-47cd-81e4-79167f4d8bb6 service nova] Creating event network-vif-unplugged:b49bf1e2-3e0a-4360-84dc-c9e4304449a9 for instance 96ebebed-0f53-4f0c-b21a-0b09b0665bc6 on nch1-master-1 Sep 24 21:24:51.723181 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-f1fd0a1d-a956-45bd-ac0f-170a198d8e0b req-226982a0-b455-47cd-81e4-79167f4d8bb6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036955 Sep 24 21:24:51.723845 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2990/6000] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:24:51.770957 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a9d75ec4-b5f8-4e98-9e0f-9662fa03b5ca tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:51.779630 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a9d75ec4-b5f8-4e98-9e0f-9662fa03b5ca tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 200 len: 1495 microversion: 2.1 time: 0.167644 Sep 24 21:24:51.780190 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3011/6001] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:51 2022] GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 1495 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:51.928778 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d801763b-37dd-425f-8759-de30a417bea7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:51.929492 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d801763b-37dd-425f-8759-de30a417bea7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 96ebebed-0f53-4f0c-b21a-0b09b0665bc6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:51.935962 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d801763b-37dd-425f-8759-de30a417bea7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:51.936449 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d801763b-37dd-425f-8759-de30a417bea7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:51.936893 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d801763b-37dd-425f-8759-de30a417bea7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:51.937595 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d801763b-37dd-425f-8759-de30a417bea7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:51.938055 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d801763b-37dd-425f-8759-de30a417bea7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:51.938486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d801763b-37dd-425f-8759-de30a417bea7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:52.072420 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d801763b-37dd-425f-8759-de30a417bea7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:52.080277 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d801763b-37dd-425f-8759-de30a417bea7 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6" status: 200 len: 1684 microversion: 2.1 time: 0.156665 Sep 24 21:24:52.080850 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2991/6002] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:51 2022] GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:52.803525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d1fb9914-282f-4822-b155-6fdcc046e681 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:52.804154 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d1fb9914-282f-4822-b155-6fdcc046e681 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:52.811683 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1fb9914-282f-4822-b155-6fdcc046e681 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:52.812181 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1fb9914-282f-4822-b155-6fdcc046e681 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:52.812636 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1fb9914-282f-4822-b155-6fdcc046e681 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:52.813345 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1fb9914-282f-4822-b155-6fdcc046e681 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:52.813817 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1fb9914-282f-4822-b155-6fdcc046e681 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:52.814257 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d1fb9914-282f-4822-b155-6fdcc046e681 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:52.952601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d1fb9914-282f-4822-b155-6fdcc046e681 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:52.960711 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d1fb9914-282f-4822-b155-6fdcc046e681 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 200 len: 1495 microversion: 2.1 time: 0.161085 Sep 24 21:24:52.961410 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3012/6003] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:52 2022] GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 1495 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:53.741673 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-6ec985bb-290a-4ca2-9a51-fd46de1789a3 req-7dfde09f-95b5-4e73-98c2-2578b7ffe48d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96ebebed-0f53-4f0c-b21a-0b09b0665bc6", "name": "network-vif-plugged", "status": "completed", "tag": "b49bf1e2-3e0a-4360-84dc-c9e4304449a9"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:24:53.753681 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-6ec985bb-290a-4ca2-9a51-fd46de1789a3 req-7dfde09f-95b5-4e73-98c2-2578b7ffe48d service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:53.754169 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-6ec985bb-290a-4ca2-9a51-fd46de1789a3 req-7dfde09f-95b5-4e73-98c2-2578b7ffe48d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:53.754654 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-6ec985bb-290a-4ca2-9a51-fd46de1789a3 req-7dfde09f-95b5-4e73-98c2-2578b7ffe48d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:53.767188 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-6ec985bb-290a-4ca2-9a51-fd46de1789a3 req-7dfde09f-95b5-4e73-98c2-2578b7ffe48d service nova] Creating event network-vif-plugged:b49bf1e2-3e0a-4360-84dc-c9e4304449a9 for instance 96ebebed-0f53-4f0c-b21a-0b09b0665bc6 on nch1-master-1 Sep 24 21:24:53.772188 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-6ec985bb-290a-4ca2-9a51-fd46de1789a3 req-7dfde09f-95b5-4e73-98c2-2578b7ffe48d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034696 Sep 24 21:24:53.772838 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2992/6004] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:24:53.985490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b84497c5-f1c9-4f77-9b86-85a80222efdf tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:53.986379 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b84497c5-f1c9-4f77-9b86-85a80222efdf tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:53.993330 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b84497c5-f1c9-4f77-9b86-85a80222efdf tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:53.993821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b84497c5-f1c9-4f77-9b86-85a80222efdf tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:53.994298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b84497c5-f1c9-4f77-9b86-85a80222efdf tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:53.995156 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b84497c5-f1c9-4f77-9b86-85a80222efdf tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:53.995619 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b84497c5-f1c9-4f77-9b86-85a80222efdf tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:53.996053 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b84497c5-f1c9-4f77-9b86-85a80222efdf tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:53.999227 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:24:54.125172 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b84497c5-f1c9-4f77-9b86-85a80222efdf tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:54.132970 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b84497c5-f1c9-4f77-9b86-85a80222efdf tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 200 len: 1495 microversion: 2.1 time: 0.152175 Sep 24 21:24:54.133548 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3013/6005] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:53 2022] GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 1495 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:24:55.158597 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3f24c9f3-9c95-434d-9c05-b58b9365f0e1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:55.159336 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3f24c9f3-9c95-434d-9c05-b58b9365f0e1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:55.165590 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3f24c9f3-9c95-434d-9c05-b58b9365f0e1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:55.166109 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3f24c9f3-9c95-434d-9c05-b58b9365f0e1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:55.166588 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3f24c9f3-9c95-434d-9c05-b58b9365f0e1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:55.167312 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3f24c9f3-9c95-434d-9c05-b58b9365f0e1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:55.167845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3f24c9f3-9c95-434d-9c05-b58b9365f0e1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:55.168315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3f24c9f3-9c95-434d-9c05-b58b9365f0e1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:55.302841 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3f24c9f3-9c95-434d-9c05-b58b9365f0e1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:55.311613 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3f24c9f3-9c95-434d-9c05-b58b9365f0e1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 200 len: 1495 microversion: 2.1 time: 0.158281 Sep 24 21:24:55.312203 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2993/6006] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:55 2022] GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 1495 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:56.334914 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0470919f-ea63-4216-962b-54262c8c002d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:56.335531 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0470919f-ea63-4216-962b-54262c8c002d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:56.343702 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0470919f-ea63-4216-962b-54262c8c002d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:56.344187 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0470919f-ea63-4216-962b-54262c8c002d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:56.344627 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0470919f-ea63-4216-962b-54262c8c002d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:56.345326 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0470919f-ea63-4216-962b-54262c8c002d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:56.345782 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0470919f-ea63-4216-962b-54262c8c002d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:56.346212 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0470919f-ea63-4216-962b-54262c8c002d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:56.473620 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0470919f-ea63-4216-962b-54262c8c002d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:56.482041 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0470919f-ea63-4216-962b-54262c8c002d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 200 len: 1495 microversion: 2.1 time: 0.151005 Sep 24 21:24:56.482801 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3014/6007] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:56 2022] GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 1495 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:24:57.505902 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dc20b34b-b6da-461e-83b0-47e7764a8404 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:57.506537 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-dc20b34b-b6da-461e-83b0-47e7764a8404 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:57.513491 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc20b34b-b6da-461e-83b0-47e7764a8404 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:57.513969 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc20b34b-b6da-461e-83b0-47e7764a8404 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:57.514407 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc20b34b-b6da-461e-83b0-47e7764a8404 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:57.515143 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc20b34b-b6da-461e-83b0-47e7764a8404 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:57.515602 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc20b34b-b6da-461e-83b0-47e7764a8404 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:57.516038 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc20b34b-b6da-461e-83b0-47e7764a8404 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:57.648443 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-dc20b34b-b6da-461e-83b0-47e7764a8404 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:57.657452 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-dc20b34b-b6da-461e-83b0-47e7764a8404 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 200 len: 1495 microversion: 2.1 time: 0.155434 Sep 24 21:24:57.658057 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2994/6008] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:57 2022] GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 1495 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:58.681821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0f2b4bb0-ddba-480b-8cbb-6c12fbbc3ecf tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:58.682442 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0f2b4bb0-ddba-480b-8cbb-6c12fbbc3ecf tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:58.690211 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f2b4bb0-ddba-480b-8cbb-6c12fbbc3ecf tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:58.690736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f2b4bb0-ddba-480b-8cbb-6c12fbbc3ecf tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:58.691178 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f2b4bb0-ddba-480b-8cbb-6c12fbbc3ecf tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:58.691882 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f2b4bb0-ddba-480b-8cbb-6c12fbbc3ecf tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:58.692339 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f2b4bb0-ddba-480b-8cbb-6c12fbbc3ecf tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:58.692767 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f2b4bb0-ddba-480b-8cbb-6c12fbbc3ecf tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:58.825422 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0f2b4bb0-ddba-480b-8cbb-6c12fbbc3ecf tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:24:58.833555 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0f2b4bb0-ddba-480b-8cbb-6c12fbbc3ecf tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 200 len: 1495 microversion: 2.1 time: 0.155950 Sep 24 21:24:58.834130 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3015/6009] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:58 2022] GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 1495 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:24:59.857014 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7f3f6ead-516d-4c55-97bc-9e9a2bc28fa5 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:24:59.857633 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7f3f6ead-516d-4c55-97bc-9e9a2bc28fa5 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:24:59.864725 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f3f6ead-516d-4c55-97bc-9e9a2bc28fa5 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:59.865203 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f3f6ead-516d-4c55-97bc-9e9a2bc28fa5 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:59.865652 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f3f6ead-516d-4c55-97bc-9e9a2bc28fa5 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:59.866350 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f3f6ead-516d-4c55-97bc-9e9a2bc28fa5 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:24:59.866840 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f3f6ead-516d-4c55-97bc-9e9a2bc28fa5 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:24:59.867280 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f3f6ead-516d-4c55-97bc-9e9a2bc28fa5 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:24:59.997961 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7f3f6ead-516d-4c55-97bc-9e9a2bc28fa5 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:25:00.005923 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7f3f6ead-516d-4c55-97bc-9e9a2bc28fa5 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 200 len: 1495 microversion: 2.1 time: 0.152926 Sep 24 21:25:00.006514 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2995/6010] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:24:59 2022] GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 1495 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:01.030186 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ccf2be75-969f-4470-a3d3-0f179d95aaff tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:01.030768 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ccf2be75-969f-4470-a3d3-0f179d95aaff tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:25:01.037567 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ccf2be75-969f-4470-a3d3-0f179d95aaff tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:01.038059 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ccf2be75-969f-4470-a3d3-0f179d95aaff tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:01.038523 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ccf2be75-969f-4470-a3d3-0f179d95aaff tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:01.039223 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ccf2be75-969f-4470-a3d3-0f179d95aaff tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:01.039692 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ccf2be75-969f-4470-a3d3-0f179d95aaff tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:01.040128 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ccf2be75-969f-4470-a3d3-0f179d95aaff tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:01.173389 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ccf2be75-969f-4470-a3d3-0f179d95aaff tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:25:01.181168 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ccf2be75-969f-4470-a3d3-0f179d95aaff tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 200 len: 1495 microversion: 2.1 time: 0.155340 Sep 24 21:25:01.181742 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3016/6011] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:25:01 2022] GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 1495 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:02.204720 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f4ac1902-4834-4a2e-8605-a21cd86911d6 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:02.205380 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f4ac1902-4834-4a2e-8605-a21cd86911d6 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:25:02.208314 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:25:02.213819 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4ac1902-4834-4a2e-8605-a21cd86911d6 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:02.214311 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4ac1902-4834-4a2e-8605-a21cd86911d6 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:02.214789 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4ac1902-4834-4a2e-8605-a21cd86911d6 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:02.215529 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4ac1902-4834-4a2e-8605-a21cd86911d6 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:02.215963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4ac1902-4834-4a2e-8605-a21cd86911d6 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:02.216395 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4ac1902-4834-4a2e-8605-a21cd86911d6 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:02.405202 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f4ac1902-4834-4a2e-8605-a21cd86911d6 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:25:02.413211 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f4ac1902-4834-4a2e-8605-a21cd86911d6 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 200 len: 1495 microversion: 2.1 time: 0.213107 Sep 24 21:25:02.413791 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2996/6012] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:25:02 2022] GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 1495 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:03.436351 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d92f3261-6668-4a19-ab85-f5680fcbe8be tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:03.436967 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d92f3261-6668-4a19-ab85-f5680fcbe8be tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:25:03.443867 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d92f3261-6668-4a19-ab85-f5680fcbe8be tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:03.444351 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d92f3261-6668-4a19-ab85-f5680fcbe8be tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:03.444794 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d92f3261-6668-4a19-ab85-f5680fcbe8be tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:03.445486 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d92f3261-6668-4a19-ab85-f5680fcbe8be tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:03.445941 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d92f3261-6668-4a19-ab85-f5680fcbe8be tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:03.446370 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d92f3261-6668-4a19-ab85-f5680fcbe8be tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:03.579828 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d92f3261-6668-4a19-ab85-f5680fcbe8be tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:25:03.587615 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d92f3261-6668-4a19-ab85-f5680fcbe8be tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 200 len: 1495 microversion: 2.1 time: 0.155360 Sep 24 21:25:03.588186 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3017/6013] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:25:03 2022] GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 1495 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:04.610987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e44d06a8-79d8-42ff-901a-19c37e15b9c4 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:04.611616 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e44d06a8-79d8-42ff-901a-19c37e15b9c4 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:25:04.618581 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e44d06a8-79d8-42ff-901a-19c37e15b9c4 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:04.619078 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e44d06a8-79d8-42ff-901a-19c37e15b9c4 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:04.619522 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e44d06a8-79d8-42ff-901a-19c37e15b9c4 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:04.620227 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e44d06a8-79d8-42ff-901a-19c37e15b9c4 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:04.620689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e44d06a8-79d8-42ff-901a-19c37e15b9c4 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:04.621125 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e44d06a8-79d8-42ff-901a-19c37e15b9c4 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:04.754999 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e44d06a8-79d8-42ff-901a-19c37e15b9c4 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:25:04.763497 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e44d06a8-79d8-42ff-901a-19c37e15b9c4 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 200 len: 1495 microversion: 2.1 time: 0.156435 Sep 24 21:25:04.764054 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2997/6014] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:25:04 2022] GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 1495 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:05.788155 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9dd3c433-f7f3-4a22-b0b5-e848d4c4d77d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:05.788771 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9dd3c433-f7f3-4a22-b0b5-e848d4c4d77d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:25:05.792345 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=46 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:25:05.799940 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9dd3c433-f7f3-4a22-b0b5-e848d4c4d77d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:05.800430 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9dd3c433-f7f3-4a22-b0b5-e848d4c4d77d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:05.800871 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9dd3c433-f7f3-4a22-b0b5-e848d4c4d77d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:05.801577 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9dd3c433-f7f3-4a22-b0b5-e848d4c4d77d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:05.802035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9dd3c433-f7f3-4a22-b0b5-e848d4c4d77d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:05.802468 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9dd3c433-f7f3-4a22-b0b5-e848d4c4d77d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:05.934599 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9dd3c433-f7f3-4a22-b0b5-e848d4c4d77d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:25:05.942753 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9dd3c433-f7f3-4a22-b0b5-e848d4c4d77d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 200 len: 1495 microversion: 2.1 time: 0.158452 Sep 24 21:25:05.943344 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3018/6015] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:25:05 2022] GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 1495 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:06.967417 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a6ecf451-ad56-4c05-8144-c91243482193 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:06.967985 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a6ecf451-ad56-4c05-8144-c91243482193 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:25:06.976278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a6ecf451-ad56-4c05-8144-c91243482193 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:06.976772 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a6ecf451-ad56-4c05-8144-c91243482193 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:06.977219 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a6ecf451-ad56-4c05-8144-c91243482193 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:06.977934 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a6ecf451-ad56-4c05-8144-c91243482193 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:06.978399 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a6ecf451-ad56-4c05-8144-c91243482193 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:06.978861 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a6ecf451-ad56-4c05-8144-c91243482193 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:07.131165 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a6ecf451-ad56-4c05-8144-c91243482193 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:25:07.140727 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a6ecf451-ad56-4c05-8144-c91243482193 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 200 len: 1495 microversion: 2.1 time: 0.178047 Sep 24 21:25:07.141584 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2998/6016] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:25:06 2022] GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 1495 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:08.169734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-369d669c-f565-452c-8fed-605d02e27c68 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:08.170333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-369d669c-f565-452c-8fed-605d02e27c68 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:25:08.177541 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-369d669c-f565-452c-8fed-605d02e27c68 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:08.178031 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-369d669c-f565-452c-8fed-605d02e27c68 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:08.178475 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-369d669c-f565-452c-8fed-605d02e27c68 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:08.179200 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-369d669c-f565-452c-8fed-605d02e27c68 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:08.179658 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-369d669c-f565-452c-8fed-605d02e27c68 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:08.180090 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-369d669c-f565-452c-8fed-605d02e27c68 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:08.309763 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-369d669c-f565-452c-8fed-605d02e27c68 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:25:08.317609 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-369d669c-f565-452c-8fed-605d02e27c68 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 200 len: 1495 microversion: 2.1 time: 0.152500 Sep 24 21:25:08.318190 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3019/6017] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:25:08 2022] GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 1495 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:09.341212 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dd36f11f-5c82-4935-9581-cf49f7de6ce2 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:09.341834 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-dd36f11f-5c82-4935-9581-cf49f7de6ce2 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:25:09.348928 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd36f11f-5c82-4935-9581-cf49f7de6ce2 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:09.349413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd36f11f-5c82-4935-9581-cf49f7de6ce2 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:09.349883 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd36f11f-5c82-4935-9581-cf49f7de6ce2 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:09.350611 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd36f11f-5c82-4935-9581-cf49f7de6ce2 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:09.351075 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd36f11f-5c82-4935-9581-cf49f7de6ce2 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:09.351508 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd36f11f-5c82-4935-9581-cf49f7de6ce2 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:09.485680 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-dd36f11f-5c82-4935-9581-cf49f7de6ce2 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:25:09.493664 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-dd36f11f-5c82-4935-9581-cf49f7de6ce2 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 200 len: 1495 microversion: 2.1 time: 0.156476 Sep 24 21:25:09.494242 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 2999/6018] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:25:09 2022] GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 1495 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:10.518325 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-13c76c28-060d-40ab-8be7-38562d034bea tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:10.518912 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-13c76c28-060d-40ab-8be7-38562d034bea tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:25:10.525782 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-13c76c28-060d-40ab-8be7-38562d034bea tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:10.526274 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-13c76c28-060d-40ab-8be7-38562d034bea tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:10.526756 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-13c76c28-060d-40ab-8be7-38562d034bea tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:10.527460 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-13c76c28-060d-40ab-8be7-38562d034bea tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:10.527960 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-13c76c28-060d-40ab-8be7-38562d034bea tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:10.528406 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-13c76c28-060d-40ab-8be7-38562d034bea tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:10.657330 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-13c76c28-060d-40ab-8be7-38562d034bea tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:25:10.665190 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-13c76c28-060d-40ab-8be7-38562d034bea tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 200 len: 1495 microversion: 2.1 time: 0.151236 Sep 24 21:25:10.665783 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3020/6019] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:25:10 2022] GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 1495 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:25:11.689742 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fd883d5a-01a1-4d53-bccd-9a6c24cdd639 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:11.690388 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fd883d5a-01a1-4d53-bccd-9a6c24cdd639 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:25:11.696988 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fd883d5a-01a1-4d53-bccd-9a6c24cdd639 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:11.697475 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fd883d5a-01a1-4d53-bccd-9a6c24cdd639 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:11.697915 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fd883d5a-01a1-4d53-bccd-9a6c24cdd639 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:11.698644 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fd883d5a-01a1-4d53-bccd-9a6c24cdd639 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:11.699107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fd883d5a-01a1-4d53-bccd-9a6c24cdd639 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:11.699766 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fd883d5a-01a1-4d53-bccd-9a6c24cdd639 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:11.830268 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fd883d5a-01a1-4d53-bccd-9a6c24cdd639 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:25:11.838128 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fd883d5a-01a1-4d53-bccd-9a6c24cdd639 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 200 len: 1495 microversion: 2.1 time: 0.152472 Sep 24 21:25:11.838744 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3000/6020] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:25:11 2022] GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 1495 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:12.862563 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e89af405-8e72-43b4-a11e-c3dc7d29462e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:12.863190 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e89af405-8e72-43b4-a11e-c3dc7d29462e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:25:12.870041 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e89af405-8e72-43b4-a11e-c3dc7d29462e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:12.870564 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e89af405-8e72-43b4-a11e-c3dc7d29462e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:12.871014 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e89af405-8e72-43b4-a11e-c3dc7d29462e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:12.872423 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e89af405-8e72-43b4-a11e-c3dc7d29462e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:12.872886 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e89af405-8e72-43b4-a11e-c3dc7d29462e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:12.873320 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e89af405-8e72-43b4-a11e-c3dc7d29462e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:13.008520 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e89af405-8e72-43b4-a11e-c3dc7d29462e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:25:13.016792 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e89af405-8e72-43b4-a11e-c3dc7d29462e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 200 len: 1495 microversion: 2.1 time: 0.158567 Sep 24 21:25:13.017647 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3021/6021] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:25:12 2022] GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 1495 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:14.040495 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-18f3d6c6-fc59-47ca-826a-d17831c92de6 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:14.041024 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-18f3d6c6-fc59-47ca-826a-d17831c92de6 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:25:14.048038 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-18f3d6c6-fc59-47ca-826a-d17831c92de6 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:14.048526 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-18f3d6c6-fc59-47ca-826a-d17831c92de6 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:14.048971 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-18f3d6c6-fc59-47ca-826a-d17831c92de6 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:14.049669 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-18f3d6c6-fc59-47ca-826a-d17831c92de6 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:14.050129 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-18f3d6c6-fc59-47ca-826a-d17831c92de6 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:14.050586 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-18f3d6c6-fc59-47ca-826a-d17831c92de6 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:14.178012 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-18f3d6c6-fc59-47ca-826a-d17831c92de6 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:25:14.186536 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-18f3d6c6-fc59-47ca-826a-d17831c92de6 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 200 len: 1495 microversion: 2.1 time: 0.150074 Sep 24 21:25:14.187114 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3001/6022] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:25:14 2022] GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 1495 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:15.210113 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-46377f60-8ee0-4655-a730-dc2e11f1bbbf tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:15.210735 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-46377f60-8ee0-4655-a730-dc2e11f1bbbf tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:25:15.218235 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46377f60-8ee0-4655-a730-dc2e11f1bbbf tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:15.218743 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46377f60-8ee0-4655-a730-dc2e11f1bbbf tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:15.219218 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46377f60-8ee0-4655-a730-dc2e11f1bbbf tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:15.219913 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46377f60-8ee0-4655-a730-dc2e11f1bbbf tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:15.220368 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46377f60-8ee0-4655-a730-dc2e11f1bbbf tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:15.220797 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46377f60-8ee0-4655-a730-dc2e11f1bbbf tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:15.352509 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-46377f60-8ee0-4655-a730-dc2e11f1bbbf tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:25:15.360542 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-46377f60-8ee0-4655-a730-dc2e11f1bbbf tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 200 len: 1495 microversion: 2.1 time: 0.154371 Sep 24 21:25:15.361118 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3022/6023] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:25:15 2022] GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 1495 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:16.383973 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-19729175-dc41-45e9-bc27-69f3bcebfeca tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:16.384595 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-19729175-dc41-45e9-bc27-69f3bcebfeca tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:25:16.391751 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-19729175-dc41-45e9-bc27-69f3bcebfeca tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:16.392503 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-19729175-dc41-45e9-bc27-69f3bcebfeca tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:16.392946 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-19729175-dc41-45e9-bc27-69f3bcebfeca tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:16.393650 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-19729175-dc41-45e9-bc27-69f3bcebfeca tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:16.394111 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-19729175-dc41-45e9-bc27-69f3bcebfeca tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:16.394640 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-19729175-dc41-45e9-bc27-69f3bcebfeca tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:16.525614 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-19729175-dc41-45e9-bc27-69f3bcebfeca tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:25:16.534117 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-19729175-dc41-45e9-bc27-69f3bcebfeca tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 200 len: 1495 microversion: 2.1 time: 0.154109 Sep 24 21:25:16.534720 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3002/6024] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:25:16 2022] GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 1495 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:17.557889 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d95de49c-5a4b-4718-855e-2f4f5b6911f1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:17.558525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d95de49c-5a4b-4718-855e-2f4f5b6911f1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:25:17.566211 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d95de49c-5a4b-4718-855e-2f4f5b6911f1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:17.566751 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d95de49c-5a4b-4718-855e-2f4f5b6911f1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:17.567196 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d95de49c-5a4b-4718-855e-2f4f5b6911f1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:17.567899 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d95de49c-5a4b-4718-855e-2f4f5b6911f1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:17.568367 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d95de49c-5a4b-4718-855e-2f4f5b6911f1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:17.568802 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d95de49c-5a4b-4718-855e-2f4f5b6911f1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:17.703158 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d95de49c-5a4b-4718-855e-2f4f5b6911f1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:25:17.710961 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d95de49c-5a4b-4718-855e-2f4f5b6911f1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 200 len: 1472 microversion: 2.1 time: 0.156909 Sep 24 21:25:17.711547 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3023/6025] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:25:17 2022] GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 1472 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:17.734679 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6f2b9697-4d5c-48bf-89e9-f4e98fa2b3f0 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1020083957"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:25:17.737137 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6f2b9697-4d5c-48bf-89e9-f4e98fa2b3f0 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:25:17.744179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f2b9697-4d5c-48bf-89e9-f4e98fa2b3f0 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:17.744663 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f2b9697-4d5c-48bf-89e9-f4e98fa2b3f0 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:17.745106 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f2b9697-4d5c-48bf-89e9-f4e98fa2b3f0 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:17.745802 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f2b9697-4d5c-48bf-89e9-f4e98fa2b3f0 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:17.746259 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f2b9697-4d5c-48bf-89e9-f4e98fa2b3f0 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:17.746725 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f2b9697-4d5c-48bf-89e9-f4e98fa2b3f0 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:17.922290 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:25:17.946212 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6f2b9697-4d5c-48bf-89e9-f4e98fa2b3f0 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "POST /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357/action" status: 202 len: 0 microversion: 2.1 time: 0.215991 Sep 24 21:25:17.946908 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3003/6026] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:25:17 2022] POST /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 24 21:25:17.957998 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e8c0da27-600a-4d13-bf97-dd6718a6e105 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b0d1eadc0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:18.004985 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e8c0da27-600a-4d13-bf97-dd6718a6e105 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137" status: 200 len: 1412 microversion: 2.1 time: 0.051278 Sep 24 21:25:18.006996 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3024/6027] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:25:17 2022] GET /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137 => generated 1412 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:19.022933 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-32388b61-2b8d-4b42-9f49-c693573d001d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b10fba310>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:19.066542 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-32388b61-2b8d-4b42-9f49-c693573d001d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137" status: 200 len: 1412 microversion: 2.1 time: 0.048741 Sep 24 21:25:19.067116 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3004/6028] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:25:19 2022] GET /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137 => generated 1412 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:20.083559 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1b9104c1-67ce-458e-8d42-95709f780ed3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b0c947790>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:20.130240 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1b9104c1-67ce-458e-8d42-95709f780ed3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137" status: 200 len: 1412 microversion: 2.1 time: 0.051417 Sep 24 21:25:20.130844 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3025/6029] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:25:20 2022] GET /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137 => generated 1412 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:21.147914 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-05ca4416-68d4-471d-9017-260fa7e67bff tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b0746a820>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:21.190247 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-05ca4416-68d4-471d-9017-260fa7e67bff tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137" status: 200 len: 1412 microversion: 2.1 time: 0.047084 Sep 24 21:25:21.190852 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3005/6030] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:25:21 2022] GET /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137 => generated 1412 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:22.206841 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fdc5f1bd-9e88-41bf-adf0-13bf2f8ba379 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b07e960d0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:22.249451 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fdc5f1bd-9e88-41bf-adf0-13bf2f8ba379 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137" status: 200 len: 1412 microversion: 2.1 time: 0.047330 Sep 24 21:25:22.250024 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3026/6031] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:25:22 2022] GET /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137 => generated 1412 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:23.267144 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6a5f0f51-cbb6-425f-8a40-c8be2bcdcbf9 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b07593ca0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:23.311409 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6a5f0f51-cbb6-425f-8a40-c8be2bcdcbf9 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137" status: 200 len: 1412 microversion: 2.1 time: 0.049977 Sep 24 21:25:23.311980 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3006/6032] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:25:23 2022] GET /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137 => generated 1412 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:23.702802 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-312298d3-9dcc-45de-8c65-87615e7f375d req-41a9909a-4ce5-4d81-b197-842cd1d351dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bbaa1bb-c15e-4858-871d-5adf18509357", "name": "network-vif-plugged", "status": "completed", "tag": "7a753620-2a0f-47dd-8f2a-eabde4128d75"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:25:23.713555 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-312298d3-9dcc-45de-8c65-87615e7f375d req-41a9909a-4ce5-4d81-b197-842cd1d351dc service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:23.714053 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-312298d3-9dcc-45de-8c65-87615e7f375d req-41a9909a-4ce5-4d81-b197-842cd1d351dc service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:23.714490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-312298d3-9dcc-45de-8c65-87615e7f375d req-41a9909a-4ce5-4d81-b197-842cd1d351dc service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:23.725831 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-312298d3-9dcc-45de-8c65-87615e7f375d req-41a9909a-4ce5-4d81-b197-842cd1d351dc service nova] Creating event network-vif-plugged:7a753620-2a0f-47dd-8f2a-eabde4128d75 for instance 0bbaa1bb-c15e-4858-871d-5adf18509357 on nch1-master-1 Sep 24 21:25:23.730895 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-312298d3-9dcc-45de-8c65-87615e7f375d req-41a9909a-4ce5-4d81-b197-842cd1d351dc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032819 Sep 24 21:25:23.731506 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3027/6033] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:25:24.328654 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-00db6448-2ca4-4796-8a47-c220212dc288 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b077ca790>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:24.370244 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-00db6448-2ca4-4796-8a47-c220212dc288 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137" status: 200 len: 1412 microversion: 2.1 time: 0.046616 Sep 24 21:25:24.370845 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3007/6034] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:25:24 2022] GET /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137 => generated 1412 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:25.387563 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6f7998c0-63c5-4bc5-abf1-7bd0d3065c94 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b11081a60>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:25.440045 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6f7998c0-63c5-4bc5-abf1-7bd0d3065c94 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137" status: 200 len: 1412 microversion: 2.1 time: 0.057144 Sep 24 21:25:25.440898 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3028/6035] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:25:25 2022] GET /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137 => generated 1412 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:26.458307 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8cc7b72c-0d3b-4661-adef-7c6955168b3a tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b0744d940>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:26.522529 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8cc7b72c-0d3b-4661-adef-7c6955168b3a tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137" status: 200 len: 1412 microversion: 2.1 time: 0.070077 Sep 24 21:25:26.523119 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3008/6036] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:25:26 2022] GET /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137 => generated 1412 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:25:27.539657 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1ebe449a-0583-4f52-8aa5-b0e0b561ba6f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b07d21040>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:27.594091 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1ebe449a-0583-4f52-8aa5-b0e0b561ba6f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137" status: 200 len: 1412 microversion: 2.1 time: 0.058410 Sep 24 21:25:27.594701 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3029/6037] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:25:27 2022] GET /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137 => generated 1412 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:28.322904 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=15 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:25:28.324575 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:25:28.330036 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-42a62074-21ee-41a0-a27f-294d92b67da6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:25:28.332813 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-42a62074-21ee-41a0-a27f-294d92b67da6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 96ebebed-0f53-4f0c-b21a-0b09b0665bc6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:25:28.340232 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-42a62074-21ee-41a0-a27f-294d92b67da6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:28.340916 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-42a62074-21ee-41a0-a27f-294d92b67da6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:28.341411 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-42a62074-21ee-41a0-a27f-294d92b67da6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:28.342315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-42a62074-21ee-41a0-a27f-294d92b67da6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:28.343246 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-42a62074-21ee-41a0-a27f-294d92b67da6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:28.343931 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-42a62074-21ee-41a0-a27f-294d92b67da6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:28.403955 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-42a62074-21ee-41a0-a27f-294d92b67da6 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "POST /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6/action" status: 200 len: 24567 microversion: 2.1 time: 0.082475 Sep 24 21:25:28.404608 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3009/6038] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:25:28 2022] POST /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6/action => generated 24567 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:25:28.611729 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c85ddfae-7078-4444-88d8-3e08d4be49cb tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b11018040>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:28.677492 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c85ddfae-7078-4444-88d8-3e08d4be49cb tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137" status: 200 len: 1412 microversion: 2.1 time: 0.071734 Sep 24 21:25:28.678329 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3030/6039] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:25:28 2022] GET /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137 => generated 1412 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:29.694516 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e9e19aaa-ad17-439d-9458-6d21fa456cf5 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b0747edc0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:29.749628 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e9e19aaa-ad17-439d-9458-6d21fa456cf5 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137" status: 200 len: 1412 microversion: 2.1 time: 0.059286 Sep 24 21:25:29.754904 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3010/6040] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:25:29 2022] GET /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137 => generated 1412 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:30.765624 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c66c3eb3-64da-4afe-a8c0-25bff74e62ce tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b07d78ca0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:30.816683 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c66c3eb3-64da-4afe-a8c0-25bff74e62ce tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137" status: 200 len: 1412 microversion: 2.1 time: 0.055115 Sep 24 21:25:30.817833 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3031/6041] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:25:30 2022] GET /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137 => generated 1412 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:25:31.834444 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-52e1e4e2-b581-4834-b783-ad136a864f40 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b0744d790>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:31.883540 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-52e1e4e2-b581-4834-b783-ad136a864f40 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137" status: 200 len: 1412 microversion: 2.1 time: 0.054081 Sep 24 21:25:31.885183 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3011/6042] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:25:31 2022] GET /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137 => generated 1412 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:32.901167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1d3bc520-3493-4ead-85fc-f11fc5782c90 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b0c895790>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:32.948123 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1d3bc520-3493-4ead-85fc-f11fc5782c90 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137" status: 200 len: 1412 microversion: 2.1 time: 0.050820 Sep 24 21:25:32.956928 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3032/6043] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:25:32 2022] GET /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137 => generated 1412 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:33.965383 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e4b9dd65-7925-483b-b979-fa908d83fe50 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b077ca4c0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:34.011886 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e4b9dd65-7925-483b-b979-fa908d83fe50 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137" status: 200 len: 1412 microversion: 2.1 time: 0.051448 Sep 24 21:25:34.013531 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3012/6044] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:25:33 2022] GET /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137 => generated 1412 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:35.025743 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=13 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:25:35.026540 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=67 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:25:35.031489 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b095544c-259f-4580-aec9-f7875a62fb9c tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b0c95a040>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:35.076329 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b095544c-259f-4580-aec9-f7875a62fb9c tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137" status: 200 len: 1421 microversion: 2.1 time: 0.051148 Sep 24 21:25:35.076910 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3033/6045] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:25:35 2022] GET /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137 => generated 1421 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:35.091617 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8cb97e61-56b3-43b4-a586-44395213a0ae tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b0744da60>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:35.134328 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8cb97e61-56b3-43b4-a586-44395213a0ae tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137" status: 200 len: 1421 microversion: 2.1 time: 0.047422 Sep 24 21:25:35.134930 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3013/6046] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:25:35 2022] GET /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137 => generated 1421 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:35.149617 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d1786851-6051-4b6f-82d2-6f779717f75c tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b07eb9a60>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:35.548142 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d1786851-6051-4b6f-82d2-6f779717f75c tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "DELETE /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137" status: 204 len: 0 microversion: 2.1 time: 0.402324 Sep 24 21:25:35.548812 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3034/6047] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:25:35 2022] DELETE /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:25:35.557454 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b22c10ca-026a-4808-9699-234278f53bb1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:35.558084 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b22c10ca-026a-4808-9699-234278f53bb1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:25:35.565822 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b22c10ca-026a-4808-9699-234278f53bb1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:35.566312 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b22c10ca-026a-4808-9699-234278f53bb1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:35.566786 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b22c10ca-026a-4808-9699-234278f53bb1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:35.567491 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b22c10ca-026a-4808-9699-234278f53bb1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:35.567949 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b22c10ca-026a-4808-9699-234278f53bb1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:35.568386 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b22c10ca-026a-4808-9699-234278f53bb1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:35.593606 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b22c10ca-026a-4808-9699-234278f53bb1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:25:35.677788 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b22c10ca-026a-4808-9699-234278f53bb1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 204 len: 0 microversion: 2.1 time: 0.124438 Sep 24 21:25:35.678391 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3014/6048] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:25:35 2022] DELETE /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 24 21:25:35.739020 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3e6acfeb-168b-4699-a628-6761c0a8b01f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-589865021", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "1e70cdf0-658e-45a6-8dcd-a635db1c9a02"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:25:35.791794 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-3e6acfeb-168b-4699-a628-6761c0a8b01f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] validate_networks() for [('1e70cdf0-658e-45a6-8dcd-a635db1c9a02', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:25:36.179049 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-3e6acfeb-168b-4699-a628-6761c0a8b01f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:25:36.179626 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-3e6acfeb-168b-4699-a628-6761c0a8b01f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:25:36.179943 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-3e6acfeb-168b-4699-a628-6761c0a8b01f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:25:36.180353 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-3e6acfeb-168b-4699-a628-6761c0a8b01f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:25:36.180770 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-3e6acfeb-168b-4699-a628-6761c0a8b01f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:25:36.189596 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e6acfeb-168b-4699-a628-6761c0a8b01f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:36.190079 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e6acfeb-168b-4699-a628-6761c0a8b01f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:36.190536 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e6acfeb-168b-4699-a628-6761c0a8b01f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:36.191271 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e6acfeb-168b-4699-a628-6761c0a8b01f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:36.191728 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e6acfeb-168b-4699-a628-6761c0a8b01f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:36.192157 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e6acfeb-168b-4699-a628-6761c0a8b01f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:36.209062 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-3e6acfeb-168b-4699-a628-6761c0a8b01f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Getting quotas for project eb957f17053b49419fbbc09b8633628b. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:25:36.214228 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-3e6acfeb-168b-4699-a628-6761c0a8b01f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Getting quotas for user d7432bc67cac447391173eedccefbf9e and project eb957f17053b49419fbbc09b8633628b. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:25:36.227416 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3e6acfeb-168b-4699-a628-6761c0a8b01f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:25:36.229813 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3e6acfeb-168b-4699-a628-6761c0a8b01f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 4345d3cd-c6ec-4d42-89a4-207f2b2c36c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:25:36.275180 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3e6acfeb-168b-4699-a628-6761c0a8b01f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.540038 Sep 24 21:25:36.275842 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3035/6049] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:25:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:25:36.288287 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0680e67c-7d3e-483f-ac07-26a833919526 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:36.289000 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0680e67c-7d3e-483f-ac07-26a833919526 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 4345d3cd-c6ec-4d42-89a4-207f2b2c36c2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:25:36.347607 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0680e67c-7d3e-483f-ac07-26a833919526 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:25:36.355573 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0680e67c-7d3e-483f-ac07-26a833919526 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/4345d3cd-c6ec-4d42-89a4-207f2b2c36c2" status: 200 len: 1207 microversion: 2.1 time: 0.071456 Sep 24 21:25:36.356373 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3015/6050] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:25:36 2022] GET /compute/v2.1/servers/4345d3cd-c6ec-4d42-89a4-207f2b2c36c2 => generated 1207 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:37.380240 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-157a689a-2fdb-4064-b2c9-403e74781827 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:37.381593 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-157a689a-2fdb-4064-b2c9-403e74781827 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 4345d3cd-c6ec-4d42-89a4-207f2b2c36c2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:25:37.394654 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-157a689a-2fdb-4064-b2c9-403e74781827 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:37.395567 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-157a689a-2fdb-4064-b2c9-403e74781827 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:37.396425 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-157a689a-2fdb-4064-b2c9-403e74781827 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:37.397456 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-157a689a-2fdb-4064-b2c9-403e74781827 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:37.398411 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-157a689a-2fdb-4064-b2c9-403e74781827 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:37.399086 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-157a689a-2fdb-4064-b2c9-403e74781827 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:37.474912 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-157a689a-2fdb-4064-b2c9-403e74781827 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:25:37.483500 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-157a689a-2fdb-4064-b2c9-403e74781827 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/4345d3cd-c6ec-4d42-89a4-207f2b2c36c2" status: 200 len: 1277 microversion: 2.1 time: 0.108020 Sep 24 21:25:37.484071 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3036/6051] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:25:37 2022] GET /compute/v2.1/servers/4345d3cd-c6ec-4d42-89a4-207f2b2c36c2 => generated 1277 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:25:37.768311 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-a905af0b-89bb-4506-930a-ac0cb786d574 req-363e6adb-67cd-4ae1-a0d8-2a9bc529b4f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bbaa1bb-c15e-4858-871d-5adf18509357", "name": "network-vif-deleted", "tag": "7a753620-2a0f-47dd-8f2a-eabde4128d75"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:25:37.783472 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a905af0b-89bb-4506-930a-ac0cb786d574 req-363e6adb-67cd-4ae1-a0d8-2a9bc529b4f8 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:37.784056 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a905af0b-89bb-4506-930a-ac0cb786d574 req-363e6adb-67cd-4ae1-a0d8-2a9bc529b4f8 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:37.784732 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a905af0b-89bb-4506-930a-ac0cb786d574 req-363e6adb-67cd-4ae1-a0d8-2a9bc529b4f8 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:37.804522 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-a905af0b-89bb-4506-930a-ac0cb786d574 req-363e6adb-67cd-4ae1-a0d8-2a9bc529b4f8 service nova] Creating event network-vif-deleted:7a753620-2a0f-47dd-8f2a-eabde4128d75 for instance 0bbaa1bb-c15e-4858-871d-5adf18509357 on nch1-master-1 Sep 24 21:25:37.811298 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-a905af0b-89bb-4506-930a-ac0cb786d574 req-363e6adb-67cd-4ae1-a0d8-2a9bc529b4f8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046852 Sep 24 21:25:37.812011 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3016/6052] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:25:38.506843 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1da4c199-1a98-40dc-ae8b-6314c4b4b604 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:38.507385 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1da4c199-1a98-40dc-ae8b-6314c4b4b604 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 4345d3cd-c6ec-4d42-89a4-207f2b2c36c2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:25:38.514210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1da4c199-1a98-40dc-ae8b-6314c4b4b604 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:38.514737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1da4c199-1a98-40dc-ae8b-6314c4b4b604 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:38.515185 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1da4c199-1a98-40dc-ae8b-6314c4b4b604 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:38.515892 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1da4c199-1a98-40dc-ae8b-6314c4b4b604 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:38.516360 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1da4c199-1a98-40dc-ae8b-6314c4b4b604 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:38.517064 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1da4c199-1a98-40dc-ae8b-6314c4b4b604 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:38.737851 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1da4c199-1a98-40dc-ae8b-6314c4b4b604 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:25:38.745779 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1da4c199-1a98-40dc-ae8b-6314c4b4b604 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/4345d3cd-c6ec-4d42-89a4-207f2b2c36c2" status: 200 len: 1307 microversion: 2.1 time: 0.242960 Sep 24 21:25:38.746386 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3037/6053] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:25:38 2022] GET /compute/v2.1/servers/4345d3cd-c6ec-4d42-89a4-207f2b2c36c2 => generated 1307 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:38.914401 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-ab3fb53f-bef3-44df-b2e0-cc8f9a085706 req-7196eef2-eb59-4349-9a7c-b00610fcf2b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4345d3cd-c6ec-4d42-89a4-207f2b2c36c2", "tag": "38a2a14e-21f9-437e-9cce-e8cc36712ef8"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:25:38.929132 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-ab3fb53f-bef3-44df-b2e0-cc8f9a085706 req-7196eef2-eb59-4349-9a7c-b00610fcf2b8 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:38.929607 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-ab3fb53f-bef3-44df-b2e0-cc8f9a085706 req-7196eef2-eb59-4349-9a7c-b00610fcf2b8 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:38.930046 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-ab3fb53f-bef3-44df-b2e0-cc8f9a085706 req-7196eef2-eb59-4349-9a7c-b00610fcf2b8 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:38.941872 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-ab3fb53f-bef3-44df-b2e0-cc8f9a085706 req-7196eef2-eb59-4349-9a7c-b00610fcf2b8 service nova] Creating event network-changed:38a2a14e-21f9-437e-9cce-e8cc36712ef8 for instance 4345d3cd-c6ec-4d42-89a4-207f2b2c36c2 on nch2-master-1 Sep 24 21:25:38.946920 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-ab3fb53f-bef3-44df-b2e0-cc8f9a085706 req-7196eef2-eb59-4349-9a7c-b00610fcf2b8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036760 Sep 24 21:25:38.947672 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3017/6054] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:25:39.769954 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-53bc6f29-9cf0-4b11-a030-3ad6f453c745 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:39.770607 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-53bc6f29-9cf0-4b11-a030-3ad6f453c745 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 4345d3cd-c6ec-4d42-89a4-207f2b2c36c2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:25:39.778013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53bc6f29-9cf0-4b11-a030-3ad6f453c745 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:39.778546 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53bc6f29-9cf0-4b11-a030-3ad6f453c745 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:39.779001 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53bc6f29-9cf0-4b11-a030-3ad6f453c745 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:39.779717 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53bc6f29-9cf0-4b11-a030-3ad6f453c745 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:39.780185 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53bc6f29-9cf0-4b11-a030-3ad6f453c745 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:39.780625 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-53bc6f29-9cf0-4b11-a030-3ad6f453c745 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:39.914980 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-53bc6f29-9cf0-4b11-a030-3ad6f453c745 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:25:39.923436 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-53bc6f29-9cf0-4b11-a030-3ad6f453c745 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/4345d3cd-c6ec-4d42-89a4-207f2b2c36c2" status: 200 len: 1307 microversion: 2.1 time: 0.158156 Sep 24 21:25:39.924009 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3038/6055] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:25:39 2022] GET /compute/v2.1/servers/4345d3cd-c6ec-4d42-89a4-207f2b2c36c2 => generated 1307 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:40.947971 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b881a723-da55-4660-b41f-dcddffadfa3f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:40.948690 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b881a723-da55-4660-b41f-dcddffadfa3f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 4345d3cd-c6ec-4d42-89a4-207f2b2c36c2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:25:40.955622 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b881a723-da55-4660-b41f-dcddffadfa3f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:40.956115 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b881a723-da55-4660-b41f-dcddffadfa3f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:40.956560 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b881a723-da55-4660-b41f-dcddffadfa3f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:40.957264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b881a723-da55-4660-b41f-dcddffadfa3f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:40.957729 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b881a723-da55-4660-b41f-dcddffadfa3f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:40.958164 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b881a723-da55-4660-b41f-dcddffadfa3f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:41.091183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b881a723-da55-4660-b41f-dcddffadfa3f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:25:41.098978 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b881a723-da55-4660-b41f-dcddffadfa3f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/4345d3cd-c6ec-4d42-89a4-207f2b2c36c2" status: 200 len: 1307 microversion: 2.1 time: 0.156100 Sep 24 21:25:41.099548 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3018/6056] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:25:40 2022] GET /compute/v2.1/servers/4345d3cd-c6ec-4d42-89a4-207f2b2c36c2 => generated 1307 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:42.121428 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-15f4a9b6-7a29-4d25-9a40-9737d4ceae0b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:42.122058 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-15f4a9b6-7a29-4d25-9a40-9737d4ceae0b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 4345d3cd-c6ec-4d42-89a4-207f2b2c36c2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:25:42.128752 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15f4a9b6-7a29-4d25-9a40-9737d4ceae0b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:42.129243 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15f4a9b6-7a29-4d25-9a40-9737d4ceae0b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:42.129693 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15f4a9b6-7a29-4d25-9a40-9737d4ceae0b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:42.130398 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15f4a9b6-7a29-4d25-9a40-9737d4ceae0b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:42.130890 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15f4a9b6-7a29-4d25-9a40-9737d4ceae0b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:42.131331 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-15f4a9b6-7a29-4d25-9a40-9737d4ceae0b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:42.263470 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-15f4a9b6-7a29-4d25-9a40-9737d4ceae0b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:25:42.271428 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-15f4a9b6-7a29-4d25-9a40-9737d4ceae0b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/4345d3cd-c6ec-4d42-89a4-207f2b2c36c2" status: 200 len: 1307 microversion: 2.1 time: 0.154096 Sep 24 21:25:42.272023 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3039/6057] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:25:42 2022] GET /compute/v2.1/servers/4345d3cd-c6ec-4d42-89a4-207f2b2c36c2 => generated 1307 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:42.927818 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-c79c3087-63ac-4c31-9121-66f2caa31b89 req-d78db952-7adf-4892-8a16-345b5d178f32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4345d3cd-c6ec-4d42-89a4-207f2b2c36c2", "name": "network-vif-plugged", "status": "completed", "tag": "38a2a14e-21f9-437e-9cce-e8cc36712ef8"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:25:42.939116 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c79c3087-63ac-4c31-9121-66f2caa31b89 req-d78db952-7adf-4892-8a16-345b5d178f32 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:42.939608 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c79c3087-63ac-4c31-9121-66f2caa31b89 req-d78db952-7adf-4892-8a16-345b5d178f32 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:42.940047 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c79c3087-63ac-4c31-9121-66f2caa31b89 req-d78db952-7adf-4892-8a16-345b5d178f32 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:42.952208 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-c79c3087-63ac-4c31-9121-66f2caa31b89 req-d78db952-7adf-4892-8a16-345b5d178f32 service nova] Creating event network-vif-plugged:38a2a14e-21f9-437e-9cce-e8cc36712ef8 for instance 4345d3cd-c6ec-4d42-89a4-207f2b2c36c2 on nch2-master-1 Sep 24 21:25:42.957219 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-c79c3087-63ac-4c31-9121-66f2caa31b89 req-d78db952-7adf-4892-8a16-345b5d178f32 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033175 Sep 24 21:25:42.957984 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3019/6058] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:25:43.295161 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d6098e2a-e166-448d-8560-6ec53cc87a84 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:43.295731 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d6098e2a-e166-448d-8560-6ec53cc87a84 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 4345d3cd-c6ec-4d42-89a4-207f2b2c36c2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:25:43.302650 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6098e2a-e166-448d-8560-6ec53cc87a84 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:43.303138 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6098e2a-e166-448d-8560-6ec53cc87a84 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:43.303581 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6098e2a-e166-448d-8560-6ec53cc87a84 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:43.304278 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6098e2a-e166-448d-8560-6ec53cc87a84 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:43.304733 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6098e2a-e166-448d-8560-6ec53cc87a84 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:43.305190 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d6098e2a-e166-448d-8560-6ec53cc87a84 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:43.432886 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d6098e2a-e166-448d-8560-6ec53cc87a84 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:25:43.440831 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d6098e2a-e166-448d-8560-6ec53cc87a84 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/4345d3cd-c6ec-4d42-89a4-207f2b2c36c2" status: 200 len: 1307 microversion: 2.1 time: 0.150262 Sep 24 21:25:43.441416 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3040/6059] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:25:43 2022] GET /compute/v2.1/servers/4345d3cd-c6ec-4d42-89a4-207f2b2c36c2 => generated 1307 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:44.465116 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-775bebe0-67ef-44b5-9896-1d6eb80c6724 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:44.465826 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-775bebe0-67ef-44b5-9896-1d6eb80c6724 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 4345d3cd-c6ec-4d42-89a4-207f2b2c36c2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:25:44.472120 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-775bebe0-67ef-44b5-9896-1d6eb80c6724 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:44.472604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-775bebe0-67ef-44b5-9896-1d6eb80c6724 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:44.473047 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-775bebe0-67ef-44b5-9896-1d6eb80c6724 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:44.473742 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-775bebe0-67ef-44b5-9896-1d6eb80c6724 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:44.474200 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-775bebe0-67ef-44b5-9896-1d6eb80c6724 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:44.474684 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-775bebe0-67ef-44b5-9896-1d6eb80c6724 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:44.609393 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-775bebe0-67ef-44b5-9896-1d6eb80c6724 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:25:44.617162 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-775bebe0-67ef-44b5-9896-1d6eb80c6724 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/4345d3cd-c6ec-4d42-89a4-207f2b2c36c2" status: 200 len: 1486 microversion: 2.1 time: 0.157218 Sep 24 21:25:44.617749 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3020/6060] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:25:44 2022] GET /compute/v2.1/servers/4345d3cd-c6ec-4d42-89a4-207f2b2c36c2 => generated 1486 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:44.640780 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b64b2101-5b93-45d1-a96f-36ea050fe921 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:25:44.641317 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b64b2101-5b93-45d1-a96f-36ea050fe921 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 4345d3cd-c6ec-4d42-89a4-207f2b2c36c2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:25:44.648448 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b64b2101-5b93-45d1-a96f-36ea050fe921 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:44.648927 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b64b2101-5b93-45d1-a96f-36ea050fe921 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:44.649393 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b64b2101-5b93-45d1-a96f-36ea050fe921 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:44.650080 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b64b2101-5b93-45d1-a96f-36ea050fe921 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:44.650710 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b64b2101-5b93-45d1-a96f-36ea050fe921 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:44.651137 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b64b2101-5b93-45d1-a96f-36ea050fe921 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:44.676793 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-b64b2101-5b93-45d1-a96f-36ea050fe921 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lazy-loading 'flavor' on Instance uuid 4345d3cd-c6ec-4d42-89a4-207f2b2c36c2 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:25:44.745837 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b64b2101-5b93-45d1-a96f-36ea050fe921 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "POST /compute/v2.1/servers/4345d3cd-c6ec-4d42-89a4-207f2b2c36c2/action" status: 202 len: 0 microversion: 2.1 time: 0.108961 Sep 24 21:25:44.746453 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3041/6061] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:25:44 2022] POST /compute/v2.1/servers/4345d3cd-c6ec-4d42-89a4-207f2b2c36c2/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:25:44.754630 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-aad42e36-c1a3-4fe0-ad95-9895745afa66 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:44.755253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-aad42e36-c1a3-4fe0-ad95-9895745afa66 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 4345d3cd-c6ec-4d42-89a4-207f2b2c36c2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:25:44.761820 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aad42e36-c1a3-4fe0-ad95-9895745afa66 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:44.762607 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aad42e36-c1a3-4fe0-ad95-9895745afa66 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:44.763063 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aad42e36-c1a3-4fe0-ad95-9895745afa66 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:44.763866 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aad42e36-c1a3-4fe0-ad95-9895745afa66 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:44.764409 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aad42e36-c1a3-4fe0-ad95-9895745afa66 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:44.764850 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aad42e36-c1a3-4fe0-ad95-9895745afa66 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:44.892596 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-aad42e36-c1a3-4fe0-ad95-9895745afa66 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:25:44.900841 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-aad42e36-c1a3-4fe0-ad95-9895745afa66 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/4345d3cd-c6ec-4d42-89a4-207f2b2c36c2" status: 200 len: 1494 microversion: 2.1 time: 0.150199 Sep 24 21:25:44.901424 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3021/6062] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:25:44 2022] GET /compute/v2.1/servers/4345d3cd-c6ec-4d42-89a4-207f2b2c36c2 => generated 1494 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:45.926281 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-68c9057b-20cb-4777-8a49-7e928f8ef07a tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:45.927022 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-68c9057b-20cb-4777-8a49-7e928f8ef07a tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 4345d3cd-c6ec-4d42-89a4-207f2b2c36c2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:25:45.933202 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68c9057b-20cb-4777-8a49-7e928f8ef07a tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:45.933789 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68c9057b-20cb-4777-8a49-7e928f8ef07a tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:45.934244 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68c9057b-20cb-4777-8a49-7e928f8ef07a tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:45.934980 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68c9057b-20cb-4777-8a49-7e928f8ef07a tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:45.935447 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68c9057b-20cb-4777-8a49-7e928f8ef07a tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:45.935882 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-68c9057b-20cb-4777-8a49-7e928f8ef07a tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:46.067645 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-68c9057b-20cb-4777-8a49-7e928f8ef07a tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:25:46.076482 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-68c9057b-20cb-4777-8a49-7e928f8ef07a tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/4345d3cd-c6ec-4d42-89a4-207f2b2c36c2" status: 200 len: 1477 microversion: 2.1 time: 0.155291 Sep 24 21:25:46.077082 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3042/6063] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:25:45 2022] GET /compute/v2.1/servers/4345d3cd-c6ec-4d42-89a4-207f2b2c36c2 => generated 1477 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:46.099516 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f806968e-3cf4-4094-9a40-3f0dc469cd0e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1441616182"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:25:46.101802 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f806968e-3cf4-4094-9a40-3f0dc469cd0e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 4345d3cd-c6ec-4d42-89a4-207f2b2c36c2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:25:46.108821 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f806968e-3cf4-4094-9a40-3f0dc469cd0e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:46.109304 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f806968e-3cf4-4094-9a40-3f0dc469cd0e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:46.109746 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f806968e-3cf4-4094-9a40-3f0dc469cd0e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:46.110436 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f806968e-3cf4-4094-9a40-3f0dc469cd0e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:46.110913 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f806968e-3cf4-4094-9a40-3f0dc469cd0e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:46.111338 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f806968e-3cf4-4094-9a40-3f0dc469cd0e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:46.313596 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f806968e-3cf4-4094-9a40-3f0dc469cd0e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "POST /compute/v2.1/servers/4345d3cd-c6ec-4d42-89a4-207f2b2c36c2/action" status: 202 len: 0 microversion: 2.1 time: 0.217758 Sep 24 21:25:46.314248 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3022/6064] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:25:46 2022] POST /compute/v2.1/servers/4345d3cd-c6ec-4d42-89a4-207f2b2c36c2/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 24 21:25:46.325823 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fbadc3df-de20-4d99-8a41-4b16cad5912e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b073b65e0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:46.332291 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:25:46.333061 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=6 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:25:46.375295 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fbadc3df-de20-4d99-8a41-4b16cad5912e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/f6c4fa2f-7c62-4cf4-a2b5-3bde9a816abb" status: 200 len: 1438 microversion: 2.1 time: 0.054061 Sep 24 21:25:46.375876 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3043/6065] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:25:46 2022] GET /compute/v2.1/images/f6c4fa2f-7c62-4cf4-a2b5-3bde9a816abb => generated 1438 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:47.388690 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:25:47.394203 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-63c5f5e8-fb74-4fc0-8a87-58201d1b0451 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b07434550>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:47.438740 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-63c5f5e8-fb74-4fc0-8a87-58201d1b0451 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/f6c4fa2f-7c62-4cf4-a2b5-3bde9a816abb" status: 200 len: 1438 microversion: 2.1 time: 0.051440 Sep 24 21:25:47.439320 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3023/6066] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:25:47 2022] GET /compute/v2.1/images/f6c4fa2f-7c62-4cf4-a2b5-3bde9a816abb => generated 1438 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:48.455182 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e64272ff-a8b1-475e-b7a3-70c58f98d7ed tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b110244c0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:48.500497 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e64272ff-a8b1-475e-b7a3-70c58f98d7ed tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/f6c4fa2f-7c62-4cf4-a2b5-3bde9a816abb" status: 200 len: 1438 microversion: 2.1 time: 0.050252 Sep 24 21:25:48.501061 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3044/6067] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:25:48 2022] GET /compute/v2.1/images/f6c4fa2f-7c62-4cf4-a2b5-3bde9a816abb => generated 1438 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:49.517549 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-107900fc-3776-4204-b186-6f9f36bf2791 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b078db9d0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:49.568539 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-107900fc-3776-4204-b186-6f9f36bf2791 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/f6c4fa2f-7c62-4cf4-a2b5-3bde9a816abb" status: 200 len: 1438 microversion: 2.1 time: 0.056176 Sep 24 21:25:49.576627 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3024/6068] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:25:49 2022] GET /compute/v2.1/images/f6c4fa2f-7c62-4cf4-a2b5-3bde9a816abb => generated 1438 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:50.587399 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-eec588b4-e32c-4bd4-a44e-34c1beb62f4f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b11024dc0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:50.637472 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-eec588b4-e32c-4bd4-a44e-34c1beb62f4f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/f6c4fa2f-7c62-4cf4-a2b5-3bde9a816abb" status: 200 len: 1438 microversion: 2.1 time: 0.056858 Sep 24 21:25:50.638050 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3045/6069] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:25:50 2022] GET /compute/v2.1/images/f6c4fa2f-7c62-4cf4-a2b5-3bde9a816abb => generated 1438 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:50.871063 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-479cbb0e-1d9c-4837-8f07-076416144674 req-6a779274-fd13-494e-ba8c-f2bc2e53243f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4345d3cd-c6ec-4d42-89a4-207f2b2c36c2", "name": "network-vif-plugged", "status": "completed", "tag": "38a2a14e-21f9-437e-9cce-e8cc36712ef8"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:25:50.884740 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-479cbb0e-1d9c-4837-8f07-076416144674 req-6a779274-fd13-494e-ba8c-f2bc2e53243f service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:50.885493 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-479cbb0e-1d9c-4837-8f07-076416144674 req-6a779274-fd13-494e-ba8c-f2bc2e53243f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:50.886183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-479cbb0e-1d9c-4837-8f07-076416144674 req-6a779274-fd13-494e-ba8c-f2bc2e53243f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:50.898167 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-479cbb0e-1d9c-4837-8f07-076416144674 req-6a779274-fd13-494e-ba8c-f2bc2e53243f service nova] Creating event network-vif-plugged:38a2a14e-21f9-437e-9cce-e8cc36712ef8 for instance 4345d3cd-c6ec-4d42-89a4-207f2b2c36c2 on nch2-master-1 Sep 24 21:25:50.903811 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-479cbb0e-1d9c-4837-8f07-076416144674 req-6a779274-fd13-494e-ba8c-f2bc2e53243f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037466 Sep 24 21:25:50.904756 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3025/6070] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:25:51.657383 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1b1f8bca-89fd-4f6f-a670-f4b47ea5350c tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b07d78f70>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:51.709237 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1b1f8bca-89fd-4f6f-a670-f4b47ea5350c tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/f6c4fa2f-7c62-4cf4-a2b5-3bde9a816abb" status: 200 len: 1438 microversion: 2.1 time: 0.057784 Sep 24 21:25:51.710373 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3046/6071] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:25:51 2022] GET /compute/v2.1/images/f6c4fa2f-7c62-4cf4-a2b5-3bde9a816abb => generated 1438 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:52.728791 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dd155fd9-b296-4a90-85e5-ded04018ddb8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b075d8af0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:52.784870 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-dd155fd9-b296-4a90-85e5-ded04018ddb8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/f6c4fa2f-7c62-4cf4-a2b5-3bde9a816abb" status: 200 len: 1438 microversion: 2.1 time: 0.060787 Sep 24 21:25:52.785764 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3026/6072] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:25:52 2022] GET /compute/v2.1/images/f6c4fa2f-7c62-4cf4-a2b5-3bde9a816abb => generated 1438 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:53.802193 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b54763eb-ffa0-49e3-a0a4-c14851a51cb9 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b073b60d0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:53.858336 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b54763eb-ffa0-49e3-a0a4-c14851a51cb9 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/f6c4fa2f-7c62-4cf4-a2b5-3bde9a816abb" status: 200 len: 1438 microversion: 2.1 time: 0.060867 Sep 24 21:25:53.866665 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3047/6073] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:25:53 2022] GET /compute/v2.1/images/f6c4fa2f-7c62-4cf4-a2b5-3bde9a816abb => generated 1438 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:54.874998 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-51b4c854-0716-4d4a-ba7b-c3340a3b2456 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b0747eee0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:54.933914 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-51b4c854-0716-4d4a-ba7b-c3340a3b2456 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/f6c4fa2f-7c62-4cf4-a2b5-3bde9a816abb" status: 200 len: 1438 microversion: 2.1 time: 0.064414 Sep 24 21:25:54.940284 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3027/6074] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:25:54 2022] GET /compute/v2.1/images/f6c4fa2f-7c62-4cf4-a2b5-3bde9a816abb => generated 1438 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:55.946861 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:25:55.951379 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d0fd3881-8724-4f8c-8d6e-71e93fb50f64 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b0c895e50>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:56.008266 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d0fd3881-8724-4f8c-8d6e-71e93fb50f64 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/f6c4fa2f-7c62-4cf4-a2b5-3bde9a816abb" status: 200 len: 1438 microversion: 2.1 time: 0.062958 Sep 24 21:25:56.008864 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3048/6075] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:25:55 2022] GET /compute/v2.1/images/f6c4fa2f-7c62-4cf4-a2b5-3bde9a816abb => generated 1438 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:57.026890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1578392a-863c-4fe6-9fbd-3fcb99595e6f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b07772d30>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:57.073249 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1578392a-863c-4fe6-9fbd-3fcb99595e6f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/f6c4fa2f-7c62-4cf4-a2b5-3bde9a816abb" status: 200 len: 1438 microversion: 2.1 time: 0.053834 Sep 24 21:25:57.073894 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3028/6076] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:25:57 2022] GET /compute/v2.1/images/f6c4fa2f-7c62-4cf4-a2b5-3bde9a816abb => generated 1438 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:58.086602 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:25:58.091952 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9b77db03-00d4-490a-9a6f-17df0cbadf0e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b1109e310>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:58.136430 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9b77db03-00d4-490a-9a6f-17df0cbadf0e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/f6c4fa2f-7c62-4cf4-a2b5-3bde9a816abb" status: 200 len: 1447 microversion: 2.1 time: 0.050540 Sep 24 21:25:58.137008 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3049/6077] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:25:58 2022] GET /compute/v2.1/images/f6c4fa2f-7c62-4cf4-a2b5-3bde9a816abb => generated 1447 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:58.153069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-af703926-6936-4706-9c68-005e9b7a47ec tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b0744d8b0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:58.203669 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-af703926-6936-4706-9c68-005e9b7a47ec tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/f6c4fa2f-7c62-4cf4-a2b5-3bde9a816abb" status: 200 len: 1447 microversion: 2.1 time: 0.055358 Sep 24 21:25:58.204276 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3029/6078] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:25:58 2022] GET /compute/v2.1/images/f6c4fa2f-7c62-4cf4-a2b5-3bde9a816abb => generated 1447 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:58.218705 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4f476659-4073-4362-9a60-21ee460b9b55 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b07d78ca0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:58.617882 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4f476659-4073-4362-9a60-21ee460b9b55 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "DELETE /compute/v2.1/images/f6c4fa2f-7c62-4cf4-a2b5-3bde9a816abb" status: 204 len: 0 microversion: 2.1 time: 0.403479 Sep 24 21:25:58.618460 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3050/6079] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:25:58 2022] DELETE /compute/v2.1/images/f6c4fa2f-7c62-4cf4-a2b5-3bde9a816abb => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:25:58.627149 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1f3275cf-1e4b-4fa4-97ba-f0016e3918e8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:58.627783 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1f3275cf-1e4b-4fa4-97ba-f0016e3918e8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 4345d3cd-c6ec-4d42-89a4-207f2b2c36c2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:25:58.629793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:25:58.639222 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f3275cf-1e4b-4fa4-97ba-f0016e3918e8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:58.639222 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f3275cf-1e4b-4fa4-97ba-f0016e3918e8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:58.639222 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f3275cf-1e4b-4fa4-97ba-f0016e3918e8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:58.639222 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f3275cf-1e4b-4fa4-97ba-f0016e3918e8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:58.639222 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f3275cf-1e4b-4fa4-97ba-f0016e3918e8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:58.639222 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1f3275cf-1e4b-4fa4-97ba-f0016e3918e8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:58.642194 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:25:58.668798 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1f3275cf-1e4b-4fa4-97ba-f0016e3918e8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 4345d3cd-c6ec-4d42-89a4-207f2b2c36c2] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:25:58.744755 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1f3275cf-1e4b-4fa4-97ba-f0016e3918e8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4345d3cd-c6ec-4d42-89a4-207f2b2c36c2" status: 204 len: 0 microversion: 2.1 time: 0.121600 Sep 24 21:25:58.745821 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3030/6080] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:25:58 2022] DELETE /compute/v2.1/servers/4345d3cd-c6ec-4d42-89a4-207f2b2c36c2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:25:58.796729 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-988e5421-a0c8-49b7-8bf2-2f37adfdec0e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-862513016", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "1e70cdf0-658e-45a6-8dcd-a635db1c9a02"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:25:58.849604 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-988e5421-a0c8-49b7-8bf2-2f37adfdec0e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] validate_networks() for [('1e70cdf0-658e-45a6-8dcd-a635db1c9a02', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:25:59.225060 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-988e5421-a0c8-49b7-8bf2-2f37adfdec0e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:25:59.225652 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-988e5421-a0c8-49b7-8bf2-2f37adfdec0e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:25:59.225962 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-988e5421-a0c8-49b7-8bf2-2f37adfdec0e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:25:59.226388 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-988e5421-a0c8-49b7-8bf2-2f37adfdec0e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:25:59.226844 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-988e5421-a0c8-49b7-8bf2-2f37adfdec0e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:25:59.236513 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-988e5421-a0c8-49b7-8bf2-2f37adfdec0e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:59.237008 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-988e5421-a0c8-49b7-8bf2-2f37adfdec0e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:59.237447 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-988e5421-a0c8-49b7-8bf2-2f37adfdec0e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:59.238216 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-988e5421-a0c8-49b7-8bf2-2f37adfdec0e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:59.238718 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-988e5421-a0c8-49b7-8bf2-2f37adfdec0e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:59.239152 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-988e5421-a0c8-49b7-8bf2-2f37adfdec0e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:59.260060 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-988e5421-a0c8-49b7-8bf2-2f37adfdec0e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Getting quotas for project eb957f17053b49419fbbc09b8633628b. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:25:59.266073 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-988e5421-a0c8-49b7-8bf2-2f37adfdec0e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Getting quotas for user d7432bc67cac447391173eedccefbf9e and project eb957f17053b49419fbbc09b8633628b. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:25:59.278885 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-988e5421-a0c8-49b7-8bf2-2f37adfdec0e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:25:59.282241 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-988e5421-a0c8-49b7-8bf2-2f37adfdec0e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 2c433c63-eaea-41b6-9746-08ff083af4de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:25:59.356634 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-988e5421-a0c8-49b7-8bf2-2f37adfdec0e tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564265 Sep 24 21:25:59.357476 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3051/6081] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:25:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 24 21:25:59.369121 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8bd4d9d6-71f4-4136-a0c2-1447270a9e28 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:59.371264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8bd4d9d6-71f4-4136-a0c2-1447270a9e28 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 2c433c63-eaea-41b6-9746-08ff083af4de] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:25:59.432657 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8bd4d9d6-71f4-4136-a0c2-1447270a9e28 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:25:59.443634 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8bd4d9d6-71f4-4136-a0c2-1447270a9e28 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de" status: 200 len: 1207 microversion: 2.1 time: 0.078543 Sep 24 21:25:59.444589 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3031/6082] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:25:59 2022] GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de => generated 1207 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:25:59.920350 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0d73efdc-fe4c-4329-9ac4-363198059e3f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:25:59.921640 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0d73efdc-fe4c-4329-9ac4-363198059e3f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 96ebebed-0f53-4f0c-b21a-0b09b0665bc6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:25:59.928613 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-8d1a9a7d-bfac-467f-bd9c-152d36a5452b req-33ab46a3-b4ea-4c13-82a9-d71b0602279d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96ebebed-0f53-4f0c-b21a-0b09b0665bc6", "tag": "b49bf1e2-3e0a-4360-84dc-c9e4304449a9"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:25:59.929116 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d73efdc-fe4c-4329-9ac4-363198059e3f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:59.930211 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d73efdc-fe4c-4329-9ac4-363198059e3f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:59.930943 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d73efdc-fe4c-4329-9ac4-363198059e3f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:59.932068 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d73efdc-fe4c-4329-9ac4-363198059e3f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:59.932773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d73efdc-fe4c-4329-9ac4-363198059e3f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:59.934041 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d73efdc-fe4c-4329-9ac4-363198059e3f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:59.939345 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-8d1a9a7d-bfac-467f-bd9c-152d36a5452b req-33ab46a3-b4ea-4c13-82a9-d71b0602279d service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:25:59.939895 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-8d1a9a7d-bfac-467f-bd9c-152d36a5452b req-33ab46a3-b4ea-4c13-82a9-d71b0602279d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:25:59.940343 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-8d1a9a7d-bfac-467f-bd9c-152d36a5452b req-33ab46a3-b4ea-4c13-82a9-d71b0602279d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:25:59.955461 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-8d1a9a7d-bfac-467f-bd9c-152d36a5452b req-33ab46a3-b4ea-4c13-82a9-d71b0602279d service nova] Creating event network-changed:b49bf1e2-3e0a-4360-84dc-c9e4304449a9 for instance 96ebebed-0f53-4f0c-b21a-0b09b0665bc6 on nch1-master-1 Sep 24 21:25:59.960957 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-8d1a9a7d-bfac-467f-bd9c-152d36a5452b req-33ab46a3-b4ea-4c13-82a9-d71b0602279d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036228 Sep 24 21:25:59.964780 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3032/6083] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:25:59.972911 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0d73efdc-fe4c-4329-9ac4-363198059e3f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 96ebebed-0f53-4f0c-b21a-0b09b0665bc6] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:26:00.085574 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0d73efdc-fe4c-4329-9ac4-363198059e3f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "DELETE /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6" status: 204 len: 0 microversion: 2.1 time: 0.169425 Sep 24 21:26:00.086872 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3052/6084] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:25:59 2022] DELETE /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:26:00.097398 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-544f6649-4dea-4a45-b5e9-1ee66c27e6ce tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:00.098630 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-544f6649-4dea-4a45-b5e9-1ee66c27e6ce tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 96ebebed-0f53-4f0c-b21a-0b09b0665bc6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:26:00.106402 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-544f6649-4dea-4a45-b5e9-1ee66c27e6ce tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:00.107260 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-544f6649-4dea-4a45-b5e9-1ee66c27e6ce tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:00.108547 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-544f6649-4dea-4a45-b5e9-1ee66c27e6ce tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:00.109657 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-544f6649-4dea-4a45-b5e9-1ee66c27e6ce tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:00.110292 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-544f6649-4dea-4a45-b5e9-1ee66c27e6ce tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:00.110911 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-544f6649-4dea-4a45-b5e9-1ee66c27e6ce tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:00.259442 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-544f6649-4dea-4a45-b5e9-1ee66c27e6ce tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:26:00.268089 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-544f6649-4dea-4a45-b5e9-1ee66c27e6ce tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6" status: 200 len: 1690 microversion: 2.1 time: 0.176920 Sep 24 21:26:00.268764 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3033/6085] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:26:00 2022] GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6 => generated 1690 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:26:00.469261 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-17e87a5d-e933-402f-ab56-c872925d7dda tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:00.470169 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-17e87a5d-e933-402f-ab56-c872925d7dda tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 2c433c63-eaea-41b6-9746-08ff083af4de] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:26:00.476524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-17e87a5d-e933-402f-ab56-c872925d7dda tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:00.477014 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-17e87a5d-e933-402f-ab56-c872925d7dda tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:00.477462 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-17e87a5d-e933-402f-ab56-c872925d7dda tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:00.478161 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-17e87a5d-e933-402f-ab56-c872925d7dda tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:00.478651 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-17e87a5d-e933-402f-ab56-c872925d7dda tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:00.479083 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-17e87a5d-e933-402f-ab56-c872925d7dda tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:00.549441 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-17e87a5d-e933-402f-ab56-c872925d7dda tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:26:00.558092 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-17e87a5d-e933-402f-ab56-c872925d7dda tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de" status: 200 len: 1259 microversion: 2.1 time: 0.093659 Sep 24 21:26:00.559053 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3053/6086] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:26:00 2022] GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de => generated 1259 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:26:00.995061 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-d1b3a916-d966-4c93-9ebe-1b3ab4943dba req-dbeedba2-0dd3-42e9-8ce8-b6653f3b7fcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4345d3cd-c6ec-4d42-89a4-207f2b2c36c2", "name": "network-vif-deleted", "tag": "38a2a14e-21f9-437e-9cce-e8cc36712ef8"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:26:01.006264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d1b3a916-d966-4c93-9ebe-1b3ab4943dba req-dbeedba2-0dd3-42e9-8ce8-b6653f3b7fcd service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:01.006850 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d1b3a916-d966-4c93-9ebe-1b3ab4943dba req-dbeedba2-0dd3-42e9-8ce8-b6653f3b7fcd service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:01.007288 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d1b3a916-d966-4c93-9ebe-1b3ab4943dba req-dbeedba2-0dd3-42e9-8ce8-b6653f3b7fcd service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:01.020058 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-d1b3a916-d966-4c93-9ebe-1b3ab4943dba req-dbeedba2-0dd3-42e9-8ce8-b6653f3b7fcd service nova] Creating event network-vif-deleted:38a2a14e-21f9-437e-9cce-e8cc36712ef8 for instance 4345d3cd-c6ec-4d42-89a4-207f2b2c36c2 on nch2-master-1 Sep 24 21:26:01.025428 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-d1b3a916-d966-4c93-9ebe-1b3ab4943dba req-dbeedba2-0dd3-42e9-8ce8-b6653f3b7fcd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033833 Sep 24 21:26:01.026069 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3034/6087] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:26:01.291839 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0e46634c-68b7-4382-9245-8291ab197877 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:01.292452 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0e46634c-68b7-4382-9245-8291ab197877 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 96ebebed-0f53-4f0c-b21a-0b09b0665bc6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:26:01.298814 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e46634c-68b7-4382-9245-8291ab197877 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:01.299300 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e46634c-68b7-4382-9245-8291ab197877 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:01.299741 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e46634c-68b7-4382-9245-8291ab197877 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:01.300436 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e46634c-68b7-4382-9245-8291ab197877 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:01.300896 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e46634c-68b7-4382-9245-8291ab197877 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:01.301338 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e46634c-68b7-4382-9245-8291ab197877 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:01.441797 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0e46634c-68b7-4382-9245-8291ab197877 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:26:01.449822 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0e46634c-68b7-4382-9245-8291ab197877 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6" status: 200 len: 1690 microversion: 2.1 time: 0.161879 Sep 24 21:26:01.450396 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3054/6088] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:26:01 2022] GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:26:01.581903 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e6b56d00-bd85-4d0d-abb6-dad339e953f7 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:01.582708 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e6b56d00-bd85-4d0d-abb6-dad339e953f7 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 2c433c63-eaea-41b6-9746-08ff083af4de] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:26:01.589428 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6b56d00-bd85-4d0d-abb6-dad339e953f7 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:01.589978 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6b56d00-bd85-4d0d-abb6-dad339e953f7 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:01.590377 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6b56d00-bd85-4d0d-abb6-dad339e953f7 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:01.591120 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6b56d00-bd85-4d0d-abb6-dad339e953f7 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:01.591647 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6b56d00-bd85-4d0d-abb6-dad339e953f7 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:01.592126 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6b56d00-bd85-4d0d-abb6-dad339e953f7 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:01.656620 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e6b56d00-bd85-4d0d-abb6-dad339e953f7 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:26:01.664701 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e6b56d00-bd85-4d0d-abb6-dad339e953f7 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de" status: 200 len: 1267 microversion: 2.1 time: 0.087171 Sep 24 21:26:01.665297 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3035/6089] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:26:01 2022] GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de => generated 1267 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:26:02.473599 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d339bbd5-5241-4b2a-b38e-f82ec191ea8c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:02.474220 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d339bbd5-5241-4b2a-b38e-f82ec191ea8c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 96ebebed-0f53-4f0c-b21a-0b09b0665bc6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:26:02.483195 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d339bbd5-5241-4b2a-b38e-f82ec191ea8c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:02.483826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d339bbd5-5241-4b2a-b38e-f82ec191ea8c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:02.484277 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d339bbd5-5241-4b2a-b38e-f82ec191ea8c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:02.485261 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d339bbd5-5241-4b2a-b38e-f82ec191ea8c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:02.485820 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d339bbd5-5241-4b2a-b38e-f82ec191ea8c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:02.486359 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d339bbd5-5241-4b2a-b38e-f82ec191ea8c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:02.690331 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3904c588-5644-4571-8b73-682b3b2617cd tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:02.691140 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3904c588-5644-4571-8b73-682b3b2617cd tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 2c433c63-eaea-41b6-9746-08ff083af4de] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:26:02.698992 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3904c588-5644-4571-8b73-682b3b2617cd tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:02.699660 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3904c588-5644-4571-8b73-682b3b2617cd tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:02.700089 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3904c588-5644-4571-8b73-682b3b2617cd tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:02.702858 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3904c588-5644-4571-8b73-682b3b2617cd tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:02.703553 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3904c588-5644-4571-8b73-682b3b2617cd tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:02.704155 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3904c588-5644-4571-8b73-682b3b2617cd tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:02.950868 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d339bbd5-5241-4b2a-b38e-f82ec191ea8c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c2160fcae947138ddd7b1b4df1e361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c4c9ce4cb946a9a381271ab15aee09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:26:02.959661 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d339bbd5-5241-4b2a-b38e-f82ec191ea8c tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6" status: 200 len: 1503 microversion: 2.1 time: 0.489980 Sep 24 21:26:02.960258 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3055/6090] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:26:02 2022] GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6 => generated 1503 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:26:02.989925 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3904c588-5644-4571-8b73-682b3b2617cd tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:26:02.999313 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3904c588-5644-4571-8b73-682b3b2617cd tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de" status: 200 len: 1265 microversion: 2.1 time: 0.313641 Sep 24 21:26:03.000001 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3036/6091] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:26:02 2022] GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de => generated 1265 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:26:03.044446 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-5575e259-2789-40df-be48-fca0b7d1e9d8 req-47509164-1713-4db0-af42-e1b4ad67290c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96ebebed-0f53-4f0c-b21a-0b09b0665bc6", "name": "network-vif-deleted", "tag": "b49bf1e2-3e0a-4360-84dc-c9e4304449a9"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:26:03.058515 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-5575e259-2789-40df-be48-fca0b7d1e9d8 req-47509164-1713-4db0-af42-e1b4ad67290c service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:03.059563 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-5575e259-2789-40df-be48-fca0b7d1e9d8 req-47509164-1713-4db0-af42-e1b4ad67290c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:03.060318 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-5575e259-2789-40df-be48-fca0b7d1e9d8 req-47509164-1713-4db0-af42-e1b4ad67290c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:03.075385 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-5575e259-2789-40df-be48-fca0b7d1e9d8 req-47509164-1713-4db0-af42-e1b4ad67290c service nova] Creating event network-vif-deleted:b49bf1e2-3e0a-4360-84dc-c9e4304449a9 for instance 96ebebed-0f53-4f0c-b21a-0b09b0665bc6 on nch1-master-1 Sep 24 21:26:03.081379 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-5575e259-2789-40df-be48-fca0b7d1e9d8 req-47509164-1713-4db0-af42-e1b4ad67290c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041594 Sep 24 21:26:03.082106 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3056/6092] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:26:03.985946 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1577814f-1638-4de8-8c98-adba52e75ea0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:03.986609 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1577814f-1638-4de8-8c98-adba52e75ea0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] [instance: 96ebebed-0f53-4f0c-b21a-0b09b0665bc6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:26:03.993527 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1577814f-1638-4de8-8c98-adba52e75ea0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:03.994108 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1577814f-1638-4de8-8c98-adba52e75ea0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:03.994576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1577814f-1638-4de8-8c98-adba52e75ea0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:03.995280 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1577814f-1638-4de8-8c98-adba52e75ea0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:03.995735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1577814f-1638-4de8-8c98-adba52e75ea0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:03.996162 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1577814f-1638-4de8-8c98-adba52e75ea0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:04.010908 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-1577814f-1638-4de8-8c98-adba52e75ea0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] HTTP exception thrown: Instance 96ebebed-0f53-4f0c-b21a-0b09b0665bc6 could not be found. Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1577814f-1638-4de8-8c98-adba52e75ea0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Request method failure captured: Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6 HTTP/1.1 Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3OCLEGvCgXQkF150J8WxaJ6Egfirp5WYU549-Kd58eqlMFmsTZ5EPhwnMOzai9maVUW5D3Dnd0VpB4KutZpZm5Xvo1jNqQCDPx_Xyeb8QSTxhIJvz1mFjCjXsZ8t-QiX5KDB4ZcWr8p8qona_16KbypzpGW3AGYhC3XCYDXOZAEBUo Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: a5c4c9ce4cb946a9a381271ab15aee09 Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1280777913 Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5c4c9ce4cb946a9a381271ab15aee09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a5c4c9ce4cb946a9a381271ab15aee09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a5c4c9ce4cb946a9a381271ab15aee09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5c4c9ce4cb946a9a381271ab15aee09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1280777913 Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: a5c4c9ce4cb946a9a381271ab15aee09 Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1280777913 Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-TestNetworkAdvancedServerOps-1280777913-project Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 82c2160fcae947138ddd7b1b4df1e361 Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1280777913-project Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 96ebebed-0f53-4f0c-b21a-0b09b0665bc6 could not be found. Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '96ebebed-0f53-4f0c-b21a-0b09b0665bc6'} Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96ebebed-0f53-4f0c-b21a-0b09b0665bc6 could not be found. Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96ebebed-0f53-4f0c-b21a-0b09b0665bc6 could not be found. Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:04.012682 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:04.021261 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:04.021261 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:04.021261 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:04.021261 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:04.021261 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:26:04.021261 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:26:04.021261 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96ebebed-0f53-4f0c-b21a-0b09b0665bc6 could not be found. Sep 24 21:26:04.021261 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:04.021261 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1577814f-1638-4de8-8c98-adba52e75ea0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Returning 404 to user: Instance 96ebebed-0f53-4f0c-b21a-0b09b0665bc6 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:26:04.021261 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1577814f-1638-4de8-8c98-adba52e75ea0 tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6" status: 404 len: 111 microversion: 2.1 time: 0.032805 Sep 24 21:26:04.021261 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3037/6093] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:26:03 2022] GET /compute/v2.1/servers/96ebebed-0f53-4f0c-b21a-0b09b0665bc6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:26:04.025770 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-52106b1e-25cf-4158-b36f-0f10b7b20a09 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:04.026484 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-52106b1e-25cf-4158-b36f-0f10b7b20a09 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 2c433c63-eaea-41b6-9746-08ff083af4de] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:26:04.039857 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52106b1e-25cf-4158-b36f-0f10b7b20a09 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:04.040428 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52106b1e-25cf-4158-b36f-0f10b7b20a09 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:04.040872 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52106b1e-25cf-4158-b36f-0f10b7b20a09 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:04.041656 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52106b1e-25cf-4158-b36f-0f10b7b20a09 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:04.042380 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52106b1e-25cf-4158-b36f-0f10b7b20a09 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:04.043096 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52106b1e-25cf-4158-b36f-0f10b7b20a09 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:04.305614 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-52106b1e-25cf-4158-b36f-0f10b7b20a09 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:26:04.316781 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-52106b1e-25cf-4158-b36f-0f10b7b20a09 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de" status: 200 len: 1307 microversion: 2.1 time: 0.295581 Sep 24 21:26:04.317335 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3057/6094] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:26:04 2022] GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de => generated 1307 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:26:05.100925 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-14e73ea9-9c19-4eaf-8d57-b78e5d7d91a8 req-eb723c66-f9b7-4a0b-8797-eda2269ca6c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c433c63-eaea-41b6-9746-08ff083af4de", "tag": "d1e2cbee-4d01-4494-b8b1-74aaeecda02d"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:26:05.112131 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-14e73ea9-9c19-4eaf-8d57-b78e5d7d91a8 req-eb723c66-f9b7-4a0b-8797-eda2269ca6c5 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:05.112636 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-14e73ea9-9c19-4eaf-8d57-b78e5d7d91a8 req-eb723c66-f9b7-4a0b-8797-eda2269ca6c5 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:05.113078 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-14e73ea9-9c19-4eaf-8d57-b78e5d7d91a8 req-eb723c66-f9b7-4a0b-8797-eda2269ca6c5 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:05.127532 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-14e73ea9-9c19-4eaf-8d57-b78e5d7d91a8 req-eb723c66-f9b7-4a0b-8797-eda2269ca6c5 service nova] Creating event network-changed:d1e2cbee-4d01-4494-b8b1-74aaeecda02d for instance 2c433c63-eaea-41b6-9746-08ff083af4de on nch1-master-1 Sep 24 21:26:05.132400 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-14e73ea9-9c19-4eaf-8d57-b78e5d7d91a8 req-eb723c66-f9b7-4a0b-8797-eda2269ca6c5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035523 Sep 24 21:26:05.133010 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3038/6095] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:26:05.340149 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-62c6a605-69c3-4345-8545-cc6dc027b4a2 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:05.340767 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-62c6a605-69c3-4345-8545-cc6dc027b4a2 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 2c433c63-eaea-41b6-9746-08ff083af4de] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:26:05.348622 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62c6a605-69c3-4345-8545-cc6dc027b4a2 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:05.349120 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62c6a605-69c3-4345-8545-cc6dc027b4a2 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:05.349596 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62c6a605-69c3-4345-8545-cc6dc027b4a2 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:05.350318 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62c6a605-69c3-4345-8545-cc6dc027b4a2 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:05.350804 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62c6a605-69c3-4345-8545-cc6dc027b4a2 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:05.351236 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62c6a605-69c3-4345-8545-cc6dc027b4a2 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:05.497738 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-62c6a605-69c3-4345-8545-cc6dc027b4a2 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:26:05.506601 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-62c6a605-69c3-4345-8545-cc6dc027b4a2 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de" status: 200 len: 1307 microversion: 2.1 time: 0.170377 Sep 24 21:26:05.507547 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3058/6096] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:26:05 2022] GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de => generated 1307 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:26:06.551289 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-62d93374-1757-4d98-8d38-c659606a91fe tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:06.555834 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-62d93374-1757-4d98-8d38-c659606a91fe tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 2c433c63-eaea-41b6-9746-08ff083af4de] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:26:06.566806 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62d93374-1757-4d98-8d38-c659606a91fe tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:06.567311 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62d93374-1757-4d98-8d38-c659606a91fe tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:06.567767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62d93374-1757-4d98-8d38-c659606a91fe tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:06.568793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62d93374-1757-4d98-8d38-c659606a91fe tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:06.569269 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62d93374-1757-4d98-8d38-c659606a91fe tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:06.569710 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62d93374-1757-4d98-8d38-c659606a91fe tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:06.895824 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-62d93374-1757-4d98-8d38-c659606a91fe tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:26:06.903614 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-62d93374-1757-4d98-8d38-c659606a91fe tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de" status: 200 len: 1307 microversion: 2.1 time: 0.377462 Sep 24 21:26:06.904274 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3039/6097] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:26:06 2022] GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de => generated 1307 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:26:07.608391 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c47dcf01-e609-4b3a-9ece-c3c365454f4f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] Calling method '.version_select at 0x7f4b0738b700>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:07.644924 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c47dcf01-e609-4b3a-9ece-c3c365454f4f tempest-TestNetworkAdvancedServerOps-1280777913 tempest-TestNetworkAdvancedServerOps-1280777913-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-644791497" status: 202 len: 0 microversion: 2.1 time: 0.040449 Sep 24 21:26:07.645524 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3059/6098] 10.222.0.52 () {58 vars in 1281 bytes} [Sat Sep 24 21:26:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-644791497 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:26:07.926949 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-92d7b494-03aa-4c5f-8eda-f035095275e1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:07.927706 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-92d7b494-03aa-4c5f-8eda-f035095275e1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 2c433c63-eaea-41b6-9746-08ff083af4de] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:26:07.934467 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-92d7b494-03aa-4c5f-8eda-f035095275e1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:07.935114 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-92d7b494-03aa-4c5f-8eda-f035095275e1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:07.936210 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-92d7b494-03aa-4c5f-8eda-f035095275e1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:07.937025 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-92d7b494-03aa-4c5f-8eda-f035095275e1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:07.937550 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-92d7b494-03aa-4c5f-8eda-f035095275e1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:07.938049 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-92d7b494-03aa-4c5f-8eda-f035095275e1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:08.132020 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-92d7b494-03aa-4c5f-8eda-f035095275e1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:26:08.140633 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-92d7b494-03aa-4c5f-8eda-f035095275e1 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de" status: 200 len: 1307 microversion: 2.1 time: 0.217686 Sep 24 21:26:08.141482 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3040/6099] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:26:07 2022] GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de => generated 1307 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:26:09.165371 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-92a23683-bb04-4cf7-95fb-64d3a3b15f5b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:09.166012 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-92a23683-bb04-4cf7-95fb-64d3a3b15f5b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 2c433c63-eaea-41b6-9746-08ff083af4de] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:26:09.178010 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-92a23683-bb04-4cf7-95fb-64d3a3b15f5b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:09.178535 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-92a23683-bb04-4cf7-95fb-64d3a3b15f5b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:09.178983 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-92a23683-bb04-4cf7-95fb-64d3a3b15f5b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:09.179711 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-92a23683-bb04-4cf7-95fb-64d3a3b15f5b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:09.180180 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-92a23683-bb04-4cf7-95fb-64d3a3b15f5b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:09.180630 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-92a23683-bb04-4cf7-95fb-64d3a3b15f5b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:09.247166 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:26:09.273074 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=6 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:26:09.357840 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-92a23683-bb04-4cf7-95fb-64d3a3b15f5b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:26:09.366583 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-92a23683-bb04-4cf7-95fb-64d3a3b15f5b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de" status: 200 len: 1307 microversion: 2.1 time: 0.206311 Sep 24 21:26:09.367203 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3060/6100] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:26:09 2022] GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de => generated 1307 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:26:10.394607 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6f88fbac-78ee-4a55-84a1-92395e4af6d3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:10.395365 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6f88fbac-78ee-4a55-84a1-92395e4af6d3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 2c433c63-eaea-41b6-9746-08ff083af4de] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:26:10.398297 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:26:10.404440 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f88fbac-78ee-4a55-84a1-92395e4af6d3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:10.405013 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f88fbac-78ee-4a55-84a1-92395e4af6d3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:10.405661 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f88fbac-78ee-4a55-84a1-92395e4af6d3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:10.406446 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f88fbac-78ee-4a55-84a1-92395e4af6d3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:10.406936 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f88fbac-78ee-4a55-84a1-92395e4af6d3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:10.407367 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f88fbac-78ee-4a55-84a1-92395e4af6d3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:10.545732 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6f88fbac-78ee-4a55-84a1-92395e4af6d3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:26:10.553330 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6f88fbac-78ee-4a55-84a1-92395e4af6d3 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de" status: 200 len: 1307 microversion: 2.1 time: 0.163750 Sep 24 21:26:10.553900 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3041/6101] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:26:10 2022] GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de => generated 1307 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:26:11.575973 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-48da700d-0055-47b1-88d1-b8197f5f913b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:11.576735 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-48da700d-0055-47b1-88d1-b8197f5f913b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 2c433c63-eaea-41b6-9746-08ff083af4de] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:26:11.583759 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-48da700d-0055-47b1-88d1-b8197f5f913b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:11.584237 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-48da700d-0055-47b1-88d1-b8197f5f913b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:11.584671 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-48da700d-0055-47b1-88d1-b8197f5f913b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:11.585362 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-48da700d-0055-47b1-88d1-b8197f5f913b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:11.585816 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-48da700d-0055-47b1-88d1-b8197f5f913b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:11.586242 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-48da700d-0055-47b1-88d1-b8197f5f913b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:11.715394 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-48da700d-0055-47b1-88d1-b8197f5f913b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:26:11.723731 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-48da700d-0055-47b1-88d1-b8197f5f913b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de" status: 200 len: 1307 microversion: 2.1 time: 0.151619 Sep 24 21:26:11.724318 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3061/6102] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:26:11 2022] GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de => generated 1307 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:26:11.996836 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-a07026cb-59a2-4ddf-8345-a0177f4d614e req-a29871a8-7037-496b-b586-eca8d0bceaab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c433c63-eaea-41b6-9746-08ff083af4de", "name": "network-vif-plugged", "status": "completed", "tag": "d1e2cbee-4d01-4494-b8b1-74aaeecda02d"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:26:12.008549 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a07026cb-59a2-4ddf-8345-a0177f4d614e req-a29871a8-7037-496b-b586-eca8d0bceaab service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:12.009069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a07026cb-59a2-4ddf-8345-a0177f4d614e req-a29871a8-7037-496b-b586-eca8d0bceaab service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:12.009784 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a07026cb-59a2-4ddf-8345-a0177f4d614e req-a29871a8-7037-496b-b586-eca8d0bceaab service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:12.022304 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-a07026cb-59a2-4ddf-8345-a0177f4d614e req-a29871a8-7037-496b-b586-eca8d0bceaab service nova] Creating event network-vif-plugged:d1e2cbee-4d01-4494-b8b1-74aaeecda02d for instance 2c433c63-eaea-41b6-9746-08ff083af4de on nch1-master-1 Sep 24 21:26:12.027440 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-a07026cb-59a2-4ddf-8345-a0177f4d614e req-a29871a8-7037-496b-b586-eca8d0bceaab service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034512 Sep 24 21:26:12.028036 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3042/6103] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:26:12.749908 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f057d940-8b43-4e76-a885-1cce46e4336b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:12.750562 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f057d940-8b43-4e76-a885-1cce46e4336b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 2c433c63-eaea-41b6-9746-08ff083af4de] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:26:12.757274 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f057d940-8b43-4e76-a885-1cce46e4336b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:12.757767 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f057d940-8b43-4e76-a885-1cce46e4336b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:12.758252 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f057d940-8b43-4e76-a885-1cce46e4336b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:12.758975 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f057d940-8b43-4e76-a885-1cce46e4336b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:12.759444 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f057d940-8b43-4e76-a885-1cce46e4336b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:12.759884 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f057d940-8b43-4e76-a885-1cce46e4336b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:12.890390 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f057d940-8b43-4e76-a885-1cce46e4336b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:26:12.899028 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f057d940-8b43-4e76-a885-1cce46e4336b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de" status: 200 len: 1307 microversion: 2.1 time: 0.155228 Sep 24 21:26:12.899604 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3062/6104] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:26:12 2022] GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de => generated 1307 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:26:13.921796 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-73fe6d59-f7f1-438a-bfc7-5edf40616d1f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:13.922430 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-73fe6d59-f7f1-438a-bfc7-5edf40616d1f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 2c433c63-eaea-41b6-9746-08ff083af4de] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:26:13.929543 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-73fe6d59-f7f1-438a-bfc7-5edf40616d1f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:13.930026 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-73fe6d59-f7f1-438a-bfc7-5edf40616d1f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:13.930471 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-73fe6d59-f7f1-438a-bfc7-5edf40616d1f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:13.931193 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-73fe6d59-f7f1-438a-bfc7-5edf40616d1f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:13.931655 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-73fe6d59-f7f1-438a-bfc7-5edf40616d1f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:13.932090 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-73fe6d59-f7f1-438a-bfc7-5edf40616d1f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:14.066412 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-73fe6d59-f7f1-438a-bfc7-5edf40616d1f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:26:14.074280 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-73fe6d59-f7f1-438a-bfc7-5edf40616d1f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de" status: 200 len: 1486 microversion: 2.1 time: 0.156815 Sep 24 21:26:14.074891 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3043/6105] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:26:13 2022] GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de => generated 1486 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:26:14.097763 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e1e21f13-32fb-41d3-b908-5a8d21f0ba47 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1481767341"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:26:14.100193 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e1e21f13-32fb-41d3-b908-5a8d21f0ba47 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 2c433c63-eaea-41b6-9746-08ff083af4de] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:26:14.107236 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1e21f13-32fb-41d3-b908-5a8d21f0ba47 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:14.107734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1e21f13-32fb-41d3-b908-5a8d21f0ba47 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:14.108174 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1e21f13-32fb-41d3-b908-5a8d21f0ba47 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:14.108874 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1e21f13-32fb-41d3-b908-5a8d21f0ba47 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:14.109335 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1e21f13-32fb-41d3-b908-5a8d21f0ba47 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:14.109767 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e1e21f13-32fb-41d3-b908-5a8d21f0ba47 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:14.306440 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e1e21f13-32fb-41d3-b908-5a8d21f0ba47 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "POST /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de/action" status: 202 len: 0 microversion: 2.1 time: 0.212369 Sep 24 21:26:14.307119 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3063/6106] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:26:14 2022] POST /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 24 21:26:14.318657 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cc6763f0-3076-4d70-9070-60522bb108ae tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b10fba670>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:14.363967 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cc6763f0-3076-4d70-9070-60522bb108ae tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/ae1acd06-e6ea-4345-ad3f-ad39d4885b90" status: 200 len: 1412 microversion: 2.1 time: 0.049187 Sep 24 21:26:14.364554 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3044/6107] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:26:14 2022] GET /compute/v2.1/images/ae1acd06-e6ea-4345-ad3f-ad39d4885b90 => generated 1412 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:26:14.380965 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4cb6e7bf-7dbe-4db2-9209-e73939c50e62 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b07eb9820>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:14.424444 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4cb6e7bf-7dbe-4db2-9209-e73939c50e62 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/ae1acd06-e6ea-4345-ad3f-ad39d4885b90" status: 200 len: 1412 microversion: 2.1 time: 0.048339 Sep 24 21:26:14.425029 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3064/6108] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:26:14 2022] GET /compute/v2.1/images/ae1acd06-e6ea-4345-ad3f-ad39d4885b90 => generated 1412 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:26:14.439781 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fbb75584-f1b3-420a-a484-46d158b178af tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b0762a820>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:14.555442 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fbb75584-f1b3-420a-a484-46d158b178af tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "DELETE /compute/v2.1/images/ae1acd06-e6ea-4345-ad3f-ad39d4885b90" status: 204 len: 0 microversion: 2.1 time: 0.120237 Sep 24 21:26:14.556014 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3045/6109] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:26:14 2022] DELETE /compute/v2.1/images/ae1acd06-e6ea-4345-ad3f-ad39d4885b90 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:26:14.564832 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dad0ee8a-bf73-4c00-93a0-154d7be84918 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b0738baf0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:14.584454 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-dad0ee8a-bf73-4c00-93a0-154d7be84918 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] HTTP exception thrown: Image not found. Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dad0ee8a-bf73-4c00-93a0-154d7be84918 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Request method failure captured: Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/images/ae1acd06-e6ea-4345-ad3f-ad39d4885b90 HTTP/1.1 Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3V3umR_ryUmmmQ8NzFN2ct_MQ2sF7KpTo4BNUQch9X-r0mPTQJ699XpvgU_8jd31Cogq9pnUFNF_QS24-TtcdxtEqlKCgmHT2D5p0U1ruwhJ0mKsKVSqu11ze2hnALVV0nAg5BHHZmCPBscIwzTdyDYTrlzQl_wItjUyRbyQLIlsog Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: eb957f17053b49419fbbc09b8633628b Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ImagesTestJSON-452895032 Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb957f17053b49419fbbc09b8633628b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eb957f17053b49419fbbc09b8633628b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eb957f17053b49419fbbc09b8633628b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb957f17053b49419fbbc09b8633628b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ImagesTestJSON-452895032 Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: eb957f17053b49419fbbc09b8633628b Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ImagesTestJSON-452895032 Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ImagesTestJSON-452895032-project Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: d7432bc67cac447391173eedccefbf9e Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ImagesTestJSON-452895032-project Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: exception: Image not found. Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'ae1acd06-e6ea-4345-ad3f-ad39d4885b90'} Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ae1acd06-e6ea-4345-ad3f-ad39d4885b90 Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 24 21:26:14.600259 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ae1acd06-e6ea-4345-ad3f-ad39d4885b90 could not be found. Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dad0ee8a-bf73-4c00-93a0-154d7be84918 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Returning 404 to user: Image not found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dad0ee8a-bf73-4c00-93a0-154d7be84918 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/images/ae1acd06-e6ea-4345-ad3f-ad39d4885b90" status: 404 len: 62 microversion: 2.1 time: 0.041530 Sep 24 21:26:14.606237 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3065/6110] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:26:14 2022] GET /compute/v2.1/images/ae1acd06-e6ea-4345-ad3f-ad39d4885b90 => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 21:26:14.611156 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-269410f6-9c9f-4ec2-90d3-00a0906d77da tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:14.611776 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-269410f6-9c9f-4ec2-90d3-00a0906d77da tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 2c433c63-eaea-41b6-9746-08ff083af4de] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:26:14.617942 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-269410f6-9c9f-4ec2-90d3-00a0906d77da tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:14.618428 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-269410f6-9c9f-4ec2-90d3-00a0906d77da tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:14.618905 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-269410f6-9c9f-4ec2-90d3-00a0906d77da tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:14.619599 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-269410f6-9c9f-4ec2-90d3-00a0906d77da tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:14.620059 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-269410f6-9c9f-4ec2-90d3-00a0906d77da tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:14.620491 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-269410f6-9c9f-4ec2-90d3-00a0906d77da tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:14.753405 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-269410f6-9c9f-4ec2-90d3-00a0906d77da tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:26:14.761218 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-269410f6-9c9f-4ec2-90d3-00a0906d77da tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de" status: 200 len: 1498 microversion: 2.1 time: 0.154716 Sep 24 21:26:14.761817 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3046/6111] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:26:14 2022] GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de => generated 1498 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:26:15.786019 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-343afe6b-75b2-4eb1-a8b3-89ff1a76bf29 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:15.786779 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-343afe6b-75b2-4eb1-a8b3-89ff1a76bf29 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 2c433c63-eaea-41b6-9746-08ff083af4de] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:26:15.793097 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-343afe6b-75b2-4eb1-a8b3-89ff1a76bf29 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:15.793585 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-343afe6b-75b2-4eb1-a8b3-89ff1a76bf29 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:15.794031 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-343afe6b-75b2-4eb1-a8b3-89ff1a76bf29 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:15.795264 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-343afe6b-75b2-4eb1-a8b3-89ff1a76bf29 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:15.795707 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-343afe6b-75b2-4eb1-a8b3-89ff1a76bf29 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:15.796141 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-343afe6b-75b2-4eb1-a8b3-89ff1a76bf29 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:15.927184 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-343afe6b-75b2-4eb1-a8b3-89ff1a76bf29 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:26:15.935886 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-343afe6b-75b2-4eb1-a8b3-89ff1a76bf29 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de" status: 200 len: 1498 microversion: 2.1 time: 0.154762 Sep 24 21:26:15.936467 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3066/6112] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:26:15 2022] GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de => generated 1498 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:26:16.959066 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-260fb57c-00cf-41d6-85bd-c45c723a46bb tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:16.959636 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-260fb57c-00cf-41d6-85bd-c45c723a46bb tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 2c433c63-eaea-41b6-9746-08ff083af4de] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:26:16.966796 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-260fb57c-00cf-41d6-85bd-c45c723a46bb tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:16.967284 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-260fb57c-00cf-41d6-85bd-c45c723a46bb tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:16.967730 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-260fb57c-00cf-41d6-85bd-c45c723a46bb tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:16.968425 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-260fb57c-00cf-41d6-85bd-c45c723a46bb tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:16.968881 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-260fb57c-00cf-41d6-85bd-c45c723a46bb tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:16.969317 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-260fb57c-00cf-41d6-85bd-c45c723a46bb tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:17.102834 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-260fb57c-00cf-41d6-85bd-c45c723a46bb tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:26:17.111269 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-260fb57c-00cf-41d6-85bd-c45c723a46bb tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de" status: 200 len: 1504 microversion: 2.1 time: 0.156214 Sep 24 21:26:17.111842 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3047/6113] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:26:16 2022] GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:26:18.134967 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2c912a78-efe9-4a42-9d4a-5fe1a45c2b64 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:18.135540 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2c912a78-efe9-4a42-9d4a-5fe1a45c2b64 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 2c433c63-eaea-41b6-9746-08ff083af4de] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:26:18.143580 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c912a78-efe9-4a42-9d4a-5fe1a45c2b64 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:18.144104 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c912a78-efe9-4a42-9d4a-5fe1a45c2b64 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:18.144552 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c912a78-efe9-4a42-9d4a-5fe1a45c2b64 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:18.145410 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c912a78-efe9-4a42-9d4a-5fe1a45c2b64 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:18.145884 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c912a78-efe9-4a42-9d4a-5fe1a45c2b64 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:18.146319 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c912a78-efe9-4a42-9d4a-5fe1a45c2b64 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:18.279743 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2c912a78-efe9-4a42-9d4a-5fe1a45c2b64 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:26:18.287802 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2c912a78-efe9-4a42-9d4a-5fe1a45c2b64 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de" status: 200 len: 1504 microversion: 2.1 time: 0.156911 Sep 24 21:26:18.288375 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3067/6114] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:26:18 2022] GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:26:19.313703 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-49754d0f-c096-4389-895d-b6c4134056a9 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:19.314270 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-49754d0f-c096-4389-895d-b6c4134056a9 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 2c433c63-eaea-41b6-9746-08ff083af4de] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:26:19.321248 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-49754d0f-c096-4389-895d-b6c4134056a9 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:19.321734 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-49754d0f-c096-4389-895d-b6c4134056a9 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:19.322179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-49754d0f-c096-4389-895d-b6c4134056a9 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:19.322904 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-49754d0f-c096-4389-895d-b6c4134056a9 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:19.323367 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-49754d0f-c096-4389-895d-b6c4134056a9 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:19.323795 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-49754d0f-c096-4389-895d-b6c4134056a9 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:19.459020 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-49754d0f-c096-4389-895d-b6c4134056a9 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:26:19.466828 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-49754d0f-c096-4389-895d-b6c4134056a9 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de" status: 200 len: 1504 microversion: 2.1 time: 0.157423 Sep 24 21:26:19.467406 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3048/6115] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:26:19 2022] GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:26:20.044721 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-5f8e6f2d-19e7-46d0-b874-958512dd3cc2 req-7a01d14f-f625-4f9f-9d92-e030c1eaba8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c433c63-eaea-41b6-9746-08ff083af4de", "name": "network-vif-plugged", "status": "completed", "tag": "d1e2cbee-4d01-4494-b8b1-74aaeecda02d"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:26:20.056905 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-5f8e6f2d-19e7-46d0-b874-958512dd3cc2 req-7a01d14f-f625-4f9f-9d92-e030c1eaba8f service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:20.057394 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-5f8e6f2d-19e7-46d0-b874-958512dd3cc2 req-7a01d14f-f625-4f9f-9d92-e030c1eaba8f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:20.057831 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-5f8e6f2d-19e7-46d0-b874-958512dd3cc2 req-7a01d14f-f625-4f9f-9d92-e030c1eaba8f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:20.070174 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-5f8e6f2d-19e7-46d0-b874-958512dd3cc2 req-7a01d14f-f625-4f9f-9d92-e030c1eaba8f service nova] Creating event network-vif-plugged:d1e2cbee-4d01-4494-b8b1-74aaeecda02d for instance 2c433c63-eaea-41b6-9746-08ff083af4de on nch1-master-1 Sep 24 21:26:20.075258 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-5f8e6f2d-19e7-46d0-b874-958512dd3cc2 req-7a01d14f-f625-4f9f-9d92-e030c1eaba8f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034301 Sep 24 21:26:20.075944 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3068/6116] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:26:20.489845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9e24dcdd-5ca4-40d9-bd65-e4b4c3d66a56 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:20.490461 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9e24dcdd-5ca4-40d9-bd65-e4b4c3d66a56 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 2c433c63-eaea-41b6-9746-08ff083af4de] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:26:20.497440 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e24dcdd-5ca4-40d9-bd65-e4b4c3d66a56 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:20.497926 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e24dcdd-5ca4-40d9-bd65-e4b4c3d66a56 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:20.498361 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e24dcdd-5ca4-40d9-bd65-e4b4c3d66a56 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:20.499254 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e24dcdd-5ca4-40d9-bd65-e4b4c3d66a56 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:20.499715 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e24dcdd-5ca4-40d9-bd65-e4b4c3d66a56 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:20.500146 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e24dcdd-5ca4-40d9-bd65-e4b4c3d66a56 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:20.629773 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9e24dcdd-5ca4-40d9-bd65-e4b4c3d66a56 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:26:20.642440 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9e24dcdd-5ca4-40d9-bd65-e4b4c3d66a56 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de" status: 200 len: 1504 microversion: 2.1 time: 0.156463 Sep 24 21:26:20.643305 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3049/6117] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:26:20 2022] GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:26:21.668109 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bb705e3f-65ab-43ba-8f55-bf3fb2132daa tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:21.668832 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bb705e3f-65ab-43ba-8f55-bf3fb2132daa tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 2c433c63-eaea-41b6-9746-08ff083af4de] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:26:21.675936 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb705e3f-65ab-43ba-8f55-bf3fb2132daa tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:21.676426 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb705e3f-65ab-43ba-8f55-bf3fb2132daa tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:21.676867 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb705e3f-65ab-43ba-8f55-bf3fb2132daa tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:21.677568 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb705e3f-65ab-43ba-8f55-bf3fb2132daa tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:21.678031 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb705e3f-65ab-43ba-8f55-bf3fb2132daa tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:21.678459 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb705e3f-65ab-43ba-8f55-bf3fb2132daa tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:21.697596 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:26:21.811452 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bb705e3f-65ab-43ba-8f55-bf3fb2132daa tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:26:21.819357 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bb705e3f-65ab-43ba-8f55-bf3fb2132daa tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de" status: 200 len: 1486 microversion: 2.1 time: 0.156585 Sep 24 21:26:21.819928 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3069/6118] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:26:21 2022] GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de => generated 1486 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:26:21.841762 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-aa137aa4-ed7f-41d3-8f6c-0ca132acf36a tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:21.842305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-aa137aa4-ed7f-41d3-8f6c-0ca132acf36a tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 2c433c63-eaea-41b6-9746-08ff083af4de] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:26:21.849695 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa137aa4-ed7f-41d3-8f6c-0ca132acf36a tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:21.850186 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa137aa4-ed7f-41d3-8f6c-0ca132acf36a tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:21.850669 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa137aa4-ed7f-41d3-8f6c-0ca132acf36a tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:21.851379 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa137aa4-ed7f-41d3-8f6c-0ca132acf36a tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:21.851842 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa137aa4-ed7f-41d3-8f6c-0ca132acf36a tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:21.852279 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa137aa4-ed7f-41d3-8f6c-0ca132acf36a tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:21.878067 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-aa137aa4-ed7f-41d3-8f6c-0ca132acf36a tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 2c433c63-eaea-41b6-9746-08ff083af4de] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:26:21.902794 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:26:21.956500 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-aa137aa4-ed7f-41d3-8f6c-0ca132acf36a tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de" status: 204 len: 0 microversion: 2.1 time: 0.118257 Sep 24 21:26:21.957174 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3050/6119] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:26:21 2022] DELETE /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:26:21.968188 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bccdc4df-d44a-49f3-aa5e-1be380245a49 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b07d50430>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:21.990772 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-bccdc4df-d44a-49f3-aa5e-1be380245a49 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] HTTP exception thrown: Image not found. Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bccdc4df-d44a-49f3-aa5e-1be380245a49 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Request method failure captured: Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/images/ae1acd06-e6ea-4345-ad3f-ad39d4885b90 HTTP/1.1 Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3V3umR_ryUmmmQ8NzFN2ct_MQ2sF7KpTo4BNUQch9X-r0mPTQJ699XpvgU_8jd31Cogq9pnUFNF_QS24-TtcdxtEqlKCgmHT2D5p0U1ruwhJ0mKsKVSqu11ze2hnALVV0nAg5BHHZmCPBscIwzTdyDYTrlzQl_wItjUyRbyQLIlsog Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: eb957f17053b49419fbbc09b8633628b Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ImagesTestJSON-452895032 Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb957f17053b49419fbbc09b8633628b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eb957f17053b49419fbbc09b8633628b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eb957f17053b49419fbbc09b8633628b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb957f17053b49419fbbc09b8633628b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ImagesTestJSON-452895032 Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: eb957f17053b49419fbbc09b8633628b Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ImagesTestJSON-452895032 Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ImagesTestJSON-452895032-project Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: d7432bc67cac447391173eedccefbf9e Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ImagesTestJSON-452895032-project Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: exception: Image not found. Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'ae1acd06-e6ea-4345-ad3f-ad39d4885b90'} Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ae1acd06-e6ea-4345-ad3f-ad39d4885b90 to delete Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ae1acd06-e6ea-4345-ad3f-ad39d4885b90 could not be found. Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:21.992736 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:21.998533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:21.998533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:21.998533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:26:21.998533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:26:21.998533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:26:21.998533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:26:21.998533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:26:21.998533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:26:21.998533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 24 21:26:21.998533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 24 21:26:21.998533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 24 21:26:21.998533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:21.998533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:21.998533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:21.998533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:21.998533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:21.998533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:21.998533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:26:21.998533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:26:21.998533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 24 21:26:21.998533 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:21.998533 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bccdc4df-d44a-49f3-aa5e-1be380245a49 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Returning 404 to user: Image not found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:26:21.998533 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bccdc4df-d44a-49f3-aa5e-1be380245a49 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "DELETE /compute/v2.1/images/ae1acd06-e6ea-4345-ad3f-ad39d4885b90" status: 404 len: 62 microversion: 2.1 time: 0.030716 Sep 24 21:26:21.998533 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3070/6120] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:26:21 2022] DELETE /compute/v2.1/images/ae1acd06-e6ea-4345-ad3f-ad39d4885b90 => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 21:26:22.003387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2ffcdff1-9198-499b-88e1-e657639b7a3b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:22.003984 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2ffcdff1-9198-499b-88e1-e657639b7a3b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 2c433c63-eaea-41b6-9746-08ff083af4de] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:26:22.009960 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2ffcdff1-9198-499b-88e1-e657639b7a3b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:22.010473 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2ffcdff1-9198-499b-88e1-e657639b7a3b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:22.010945 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2ffcdff1-9198-499b-88e1-e657639b7a3b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:22.011644 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2ffcdff1-9198-499b-88e1-e657639b7a3b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:22.012104 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2ffcdff1-9198-499b-88e1-e657639b7a3b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:22.012536 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2ffcdff1-9198-499b-88e1-e657639b7a3b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:22.038515 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2ffcdff1-9198-499b-88e1-e657639b7a3b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 2c433c63-eaea-41b6-9746-08ff083af4de] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:26:22.082703 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.compute.api [None req-2ffcdff1-9198-499b-88e1-e657639b7a3b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 2c433c63-eaea-41b6-9746-08ff083af4de] Instance is already in deleting state, ignoring this request Sep 24 21:26:22.083529 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2ffcdff1-9198-499b-88e1-e657639b7a3b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de" status: 204 len: 0 microversion: 2.1 time: 0.084551 Sep 24 21:26:22.084090 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3051/6121] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:26:21 2022] DELETE /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:26:22.091992 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-691d1ce9-0a77-417c-b82c-0d43587d0f62 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:22.093468 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-691d1ce9-0a77-417c-b82c-0d43587d0f62 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 2c433c63-eaea-41b6-9746-08ff083af4de] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:26:22.100488 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-691d1ce9-0a77-417c-b82c-0d43587d0f62 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:22.100984 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-691d1ce9-0a77-417c-b82c-0d43587d0f62 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:22.101436 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-691d1ce9-0a77-417c-b82c-0d43587d0f62 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:22.102138 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-691d1ce9-0a77-417c-b82c-0d43587d0f62 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:22.102641 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-691d1ce9-0a77-417c-b82c-0d43587d0f62 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:22.103083 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-691d1ce9-0a77-417c-b82c-0d43587d0f62 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:22.235154 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-691d1ce9-0a77-417c-b82c-0d43587d0f62 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:26:22.243015 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-691d1ce9-0a77-417c-b82c-0d43587d0f62 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de" status: 200 len: 1492 microversion: 2.1 time: 0.154858 Sep 24 21:26:22.243594 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3071/6122] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:26:22 2022] GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de => generated 1492 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:26:23.265506 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-622800a8-c90b-4c6a-95e1-0d050bd4c2e9 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:23.266412 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-622800a8-c90b-4c6a-95e1-0d050bd4c2e9 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 2c433c63-eaea-41b6-9746-08ff083af4de] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:26:23.273344 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-622800a8-c90b-4c6a-95e1-0d050bd4c2e9 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:23.273823 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-622800a8-c90b-4c6a-95e1-0d050bd4c2e9 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:23.274259 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-622800a8-c90b-4c6a-95e1-0d050bd4c2e9 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:23.275051 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-622800a8-c90b-4c6a-95e1-0d050bd4c2e9 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:23.275521 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-622800a8-c90b-4c6a-95e1-0d050bd4c2e9 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:23.275933 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-622800a8-c90b-4c6a-95e1-0d050bd4c2e9 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:23.407209 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-622800a8-c90b-4c6a-95e1-0d050bd4c2e9 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:26:23.414917 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-622800a8-c90b-4c6a-95e1-0d050bd4c2e9 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de" status: 200 len: 1492 microversion: 2.1 time: 0.153631 Sep 24 21:26:23.415498 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3052/6123] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:26:23 2022] GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de => generated 1492 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:26:24.220511 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-a62bf041-55ce-4ad6-a40d-6f0bcc7ce411 req-e9fcb6ea-48a4-46b3-94d0-de516eec2907 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c433c63-eaea-41b6-9746-08ff083af4de", "name": "network-vif-deleted", "tag": "d1e2cbee-4d01-4494-b8b1-74aaeecda02d"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:26:24.231556 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-a62bf041-55ce-4ad6-a40d-6f0bcc7ce411 req-e9fcb6ea-48a4-46b3-94d0-de516eec2907 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:24.232234 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-a62bf041-55ce-4ad6-a40d-6f0bcc7ce411 req-e9fcb6ea-48a4-46b3-94d0-de516eec2907 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:24.232718 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-a62bf041-55ce-4ad6-a40d-6f0bcc7ce411 req-e9fcb6ea-48a4-46b3-94d0-de516eec2907 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:24.245408 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-a62bf041-55ce-4ad6-a40d-6f0bcc7ce411 req-e9fcb6ea-48a4-46b3-94d0-de516eec2907 service nova] Creating event network-vif-deleted:d1e2cbee-4d01-4494-b8b1-74aaeecda02d for instance 2c433c63-eaea-41b6-9746-08ff083af4de on nch1-master-1 Sep 24 21:26:24.251532 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-a62bf041-55ce-4ad6-a40d-6f0bcc7ce411 req-e9fcb6ea-48a4-46b3-94d0-de516eec2907 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034705 Sep 24 21:26:24.252146 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3072/6124] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:26:24.439514 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-04e21786-4182-4012-8085-427becced9a8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:24.440081 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-04e21786-4182-4012-8085-427becced9a8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 2c433c63-eaea-41b6-9746-08ff083af4de] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:26:24.447011 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-04e21786-4182-4012-8085-427becced9a8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:24.447530 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-04e21786-4182-4012-8085-427becced9a8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:24.447970 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-04e21786-4182-4012-8085-427becced9a8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:24.448669 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-04e21786-4182-4012-8085-427becced9a8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:24.449161 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-04e21786-4182-4012-8085-427becced9a8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:24.449595 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-04e21786-4182-4012-8085-427becced9a8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:24.480221 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-04e21786-4182-4012-8085-427becced9a8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:24.480687 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-04e21786-4182-4012-8085-427becced9a8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:24.481127 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-04e21786-4182-4012-8085-427becced9a8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:24.481574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-04e21786-4182-4012-8085-427becced9a8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lazy-loading 'fault' on Instance uuid 2c433c63-eaea-41b6-9746-08ff083af4de {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:26:24.523284 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-04e21786-4182-4012-8085-427becced9a8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7432bc67cac447391173eedccefbf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb957f17053b49419fbbc09b8633628b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:26:24.531018 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-04e21786-4182-4012-8085-427becced9a8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de" status: 200 len: 1297 microversion: 2.1 time: 0.096228 Sep 24 21:26:24.531593 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3053/6125] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:26:24 2022] GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de => generated 1297 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:26:25.555724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0fc61b83-b9f6-4d81-a1e1-3b03d1dd58c4 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:25.556423 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0fc61b83-b9f6-4d81-a1e1-3b03d1dd58c4 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 2c433c63-eaea-41b6-9746-08ff083af4de] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:26:25.563204 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0fc61b83-b9f6-4d81-a1e1-3b03d1dd58c4 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:25.563683 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0fc61b83-b9f6-4d81-a1e1-3b03d1dd58c4 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:25.564117 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0fc61b83-b9f6-4d81-a1e1-3b03d1dd58c4 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:25.564803 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0fc61b83-b9f6-4d81-a1e1-3b03d1dd58c4 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:25.565255 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0fc61b83-b9f6-4d81-a1e1-3b03d1dd58c4 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:25.565682 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0fc61b83-b9f6-4d81-a1e1-3b03d1dd58c4 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:25.579870 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-0fc61b83-b9f6-4d81-a1e1-3b03d1dd58c4 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] HTTP exception thrown: Instance 2c433c63-eaea-41b6-9746-08ff083af4de could not be found. Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0fc61b83-b9f6-4d81-a1e1-3b03d1dd58c4 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Request method failure captured: Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de HTTP/1.1 Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3V3umR_ryUmmmQ8NzFN2ct_MQ2sF7KpTo4BNUQch9X-r0mPTQJ699XpvgU_8jd31Cogq9pnUFNF_QS24-TtcdxtEqlKCgmHT2D5p0U1ruwhJ0mKsKVSqu11ze2hnALVV0nAg5BHHZmCPBscIwzTdyDYTrlzQl_wItjUyRbyQLIlsog Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: eb957f17053b49419fbbc09b8633628b Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ImagesTestJSON-452895032 Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb957f17053b49419fbbc09b8633628b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eb957f17053b49419fbbc09b8633628b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eb957f17053b49419fbbc09b8633628b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb957f17053b49419fbbc09b8633628b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ImagesTestJSON-452895032 Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: eb957f17053b49419fbbc09b8633628b Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ImagesTestJSON-452895032 Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ImagesTestJSON-452895032-project Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: d7432bc67cac447391173eedccefbf9e Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ImagesTestJSON-452895032-project Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 2c433c63-eaea-41b6-9746-08ff083af4de could not be found. Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '2c433c63-eaea-41b6-9746-08ff083af4de'} Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c433c63-eaea-41b6-9746-08ff083af4de could not be found. Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c433c63-eaea-41b6-9746-08ff083af4de could not be found. Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.581504 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:25.587211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:25.587211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:25.587211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:26:25.587211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:26:25.587211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c433c63-eaea-41b6-9746-08ff083af4de could not be found. Sep 24 21:26:25.587211 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.587211 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0fc61b83-b9f6-4d81-a1e1-3b03d1dd58c4 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Returning 404 to user: Instance 2c433c63-eaea-41b6-9746-08ff083af4de could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:26:25.587211 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0fc61b83-b9f6-4d81-a1e1-3b03d1dd58c4 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de" status: 404 len: 111 microversion: 2.1 time: 0.032341 Sep 24 21:26:25.587211 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3073/6126] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:26:25 2022] GET /compute/v2.1/servers/2c433c63-eaea-41b6-9746-08ff083af4de => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:26:25.591951 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-752b3f9f-eedf-4186-b8f3-b4e35ec3eac8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b07434700>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:25.614734 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-752b3f9f-eedf-4186-b8f3-b4e35ec3eac8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] HTTP exception thrown: Image not found. Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-752b3f9f-eedf-4186-b8f3-b4e35ec3eac8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Request method failure captured: Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/images/f6c4fa2f-7c62-4cf4-a2b5-3bde9a816abb HTTP/1.1 Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3V3umR_ryUmmmQ8NzFN2ct_MQ2sF7KpTo4BNUQch9X-r0mPTQJ699XpvgU_8jd31Cogq9pnUFNF_QS24-TtcdxtEqlKCgmHT2D5p0U1ruwhJ0mKsKVSqu11ze2hnALVV0nAg5BHHZmCPBscIwzTdyDYTrlzQl_wItjUyRbyQLIlsog Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: eb957f17053b49419fbbc09b8633628b Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ImagesTestJSON-452895032 Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb957f17053b49419fbbc09b8633628b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eb957f17053b49419fbbc09b8633628b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eb957f17053b49419fbbc09b8633628b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb957f17053b49419fbbc09b8633628b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ImagesTestJSON-452895032 Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: eb957f17053b49419fbbc09b8633628b Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ImagesTestJSON-452895032 Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ImagesTestJSON-452895032-project Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: d7432bc67cac447391173eedccefbf9e Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ImagesTestJSON-452895032-project Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: exception: Image not found. Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'f6c4fa2f-7c62-4cf4-a2b5-3bde9a816abb'} Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f6c4fa2f-7c62-4cf4-a2b5-3bde9a816abb to delete Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f6c4fa2f-7c62-4cf4-a2b5-3bde9a816abb could not be found. Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.616623 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:25.622087 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:25.622087 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:25.622087 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:26:25.622087 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:26:25.622087 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:26:25.622087 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:26:25.622087 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:26:25.622087 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:26:25.622087 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 24 21:26:25.622087 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 24 21:26:25.622087 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 24 21:26:25.622087 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.622087 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:25.622087 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.622087 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:25.622087 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:25.622087 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:25.622087 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:26:25.622087 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:26:25.622087 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 24 21:26:25.622087 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.622087 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-752b3f9f-eedf-4186-b8f3-b4e35ec3eac8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Returning 404 to user: Image not found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:26:25.622087 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-752b3f9f-eedf-4186-b8f3-b4e35ec3eac8 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "DELETE /compute/v2.1/images/f6c4fa2f-7c62-4cf4-a2b5-3bde9a816abb" status: 404 len: 62 microversion: 2.1 time: 0.029892 Sep 24 21:26:25.622087 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3054/6127] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:26:25 2022] DELETE /compute/v2.1/images/f6c4fa2f-7c62-4cf4-a2b5-3bde9a816abb => generated 62 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 21:26:25.626952 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-572f74a0-5ec1-4157-8426-46903ae29ed2 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:25.627465 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-572f74a0-5ec1-4157-8426-46903ae29ed2 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 4345d3cd-c6ec-4d42-89a4-207f2b2c36c2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:26:25.633631 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-572f74a0-5ec1-4157-8426-46903ae29ed2 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:25.634125 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-572f74a0-5ec1-4157-8426-46903ae29ed2 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:25.634597 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-572f74a0-5ec1-4157-8426-46903ae29ed2 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:25.635312 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-572f74a0-5ec1-4157-8426-46903ae29ed2 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:25.635775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-572f74a0-5ec1-4157-8426-46903ae29ed2 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:25.636210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-572f74a0-5ec1-4157-8426-46903ae29ed2 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:25.650992 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-572f74a0-5ec1-4157-8426-46903ae29ed2 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] HTTP exception thrown: Instance 4345d3cd-c6ec-4d42-89a4-207f2b2c36c2 could not be found. Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-572f74a0-5ec1-4157-8426-46903ae29ed2 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Request method failure captured: Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/servers/4345d3cd-c6ec-4d42-89a4-207f2b2c36c2 HTTP/1.1 Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3V3umR_ryUmmmQ8NzFN2ct_MQ2sF7KpTo4BNUQch9X-r0mPTQJ699XpvgU_8jd31Cogq9pnUFNF_QS24-TtcdxtEqlKCgmHT2D5p0U1ruwhJ0mKsKVSqu11ze2hnALVV0nAg5BHHZmCPBscIwzTdyDYTrlzQl_wItjUyRbyQLIlsog Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: eb957f17053b49419fbbc09b8633628b Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ImagesTestJSON-452895032 Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb957f17053b49419fbbc09b8633628b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eb957f17053b49419fbbc09b8633628b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eb957f17053b49419fbbc09b8633628b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb957f17053b49419fbbc09b8633628b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ImagesTestJSON-452895032 Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: eb957f17053b49419fbbc09b8633628b Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ImagesTestJSON-452895032 Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ImagesTestJSON-452895032-project Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: d7432bc67cac447391173eedccefbf9e Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ImagesTestJSON-452895032-project Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 4345d3cd-c6ec-4d42-89a4-207f2b2c36c2 could not be found. Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '4345d3cd-c6ec-4d42-89a4-207f2b2c36c2'} Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4345d3cd-c6ec-4d42-89a4-207f2b2c36c2 could not be found. Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:26:25.652611 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4345d3cd-c6ec-4d42-89a4-207f2b2c36c2 could not be found. Sep 24 21:26:25.658130 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.658130 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:25.658130 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.658130 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:25.658130 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:25.658130 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:25.658130 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:26:25.658130 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:26:25.658130 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4345d3cd-c6ec-4d42-89a4-207f2b2c36c2 could not be found. Sep 24 21:26:25.658130 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.658130 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-572f74a0-5ec1-4157-8426-46903ae29ed2 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Returning 404 to user: Instance 4345d3cd-c6ec-4d42-89a4-207f2b2c36c2 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:26:25.658130 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-572f74a0-5ec1-4157-8426-46903ae29ed2 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4345d3cd-c6ec-4d42-89a4-207f2b2c36c2" status: 404 len: 111 microversion: 2.1 time: 0.031482 Sep 24 21:26:25.658130 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3074/6128] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:26:25 2022] DELETE /compute/v2.1/servers/4345d3cd-c6ec-4d42-89a4-207f2b2c36c2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:26:25.663764 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-222b2cd8-7057-47c4-a890-06a70c31d03f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:25.668281 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-222b2cd8-7057-47c4-a890-06a70c31d03f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 4345d3cd-c6ec-4d42-89a4-207f2b2c36c2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:26:25.674417 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-222b2cd8-7057-47c4-a890-06a70c31d03f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:25.675007 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-222b2cd8-7057-47c4-a890-06a70c31d03f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:25.675452 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-222b2cd8-7057-47c4-a890-06a70c31d03f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:25.676156 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-222b2cd8-7057-47c4-a890-06a70c31d03f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:25.676619 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-222b2cd8-7057-47c4-a890-06a70c31d03f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:25.677049 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-222b2cd8-7057-47c4-a890-06a70c31d03f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:25.690900 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-222b2cd8-7057-47c4-a890-06a70c31d03f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] HTTP exception thrown: Instance 4345d3cd-c6ec-4d42-89a4-207f2b2c36c2 could not be found. Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-222b2cd8-7057-47c4-a890-06a70c31d03f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Request method failure captured: Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/4345d3cd-c6ec-4d42-89a4-207f2b2c36c2 HTTP/1.1 Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3V3umR_ryUmmmQ8NzFN2ct_MQ2sF7KpTo4BNUQch9X-r0mPTQJ699XpvgU_8jd31Cogq9pnUFNF_QS24-TtcdxtEqlKCgmHT2D5p0U1ruwhJ0mKsKVSqu11ze2hnALVV0nAg5BHHZmCPBscIwzTdyDYTrlzQl_wItjUyRbyQLIlsog Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: eb957f17053b49419fbbc09b8633628b Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ImagesTestJSON-452895032 Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb957f17053b49419fbbc09b8633628b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eb957f17053b49419fbbc09b8633628b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eb957f17053b49419fbbc09b8633628b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb957f17053b49419fbbc09b8633628b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ImagesTestJSON-452895032 Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: eb957f17053b49419fbbc09b8633628b Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ImagesTestJSON-452895032 Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ImagesTestJSON-452895032-project Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: d7432bc67cac447391173eedccefbf9e Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ImagesTestJSON-452895032-project Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 4345d3cd-c6ec-4d42-89a4-207f2b2c36c2 could not be found. Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '4345d3cd-c6ec-4d42-89a4-207f2b2c36c2'} Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4345d3cd-c6ec-4d42-89a4-207f2b2c36c2 could not be found. Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4345d3cd-c6ec-4d42-89a4-207f2b2c36c2 could not be found. Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.692485 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:25.697784 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:25.697784 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:25.697784 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:26:25.697784 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:26:25.697784 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4345d3cd-c6ec-4d42-89a4-207f2b2c36c2 could not be found. Sep 24 21:26:25.697784 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.697784 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-222b2cd8-7057-47c4-a890-06a70c31d03f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Returning 404 to user: Instance 4345d3cd-c6ec-4d42-89a4-207f2b2c36c2 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:26:25.697784 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-222b2cd8-7057-47c4-a890-06a70c31d03f tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/4345d3cd-c6ec-4d42-89a4-207f2b2c36c2" status: 404 len: 111 microversion: 2.1 time: 0.034855 Sep 24 21:26:25.697784 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3055/6129] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:26:25 2022] GET /compute/v2.1/servers/4345d3cd-c6ec-4d42-89a4-207f2b2c36c2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:26:25.702999 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cd8b90e3-e83a-4b1b-a962-9816db2d7e93 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b0738bb80>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:25.724449 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-cd8b90e3-e83a-4b1b-a962-9816db2d7e93 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] HTTP exception thrown: Image not found. Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cd8b90e3-e83a-4b1b-a962-9816db2d7e93 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Request method failure captured: Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137 HTTP/1.1 Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3V3umR_ryUmmmQ8NzFN2ct_MQ2sF7KpTo4BNUQch9X-r0mPTQJ699XpvgU_8jd31Cogq9pnUFNF_QS24-TtcdxtEqlKCgmHT2D5p0U1ruwhJ0mKsKVSqu11ze2hnALVV0nAg5BHHZmCPBscIwzTdyDYTrlzQl_wItjUyRbyQLIlsog Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: eb957f17053b49419fbbc09b8633628b Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ImagesTestJSON-452895032 Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb957f17053b49419fbbc09b8633628b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eb957f17053b49419fbbc09b8633628b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eb957f17053b49419fbbc09b8633628b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb957f17053b49419fbbc09b8633628b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ImagesTestJSON-452895032 Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: eb957f17053b49419fbbc09b8633628b Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ImagesTestJSON-452895032 Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ImagesTestJSON-452895032-project Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: d7432bc67cac447391173eedccefbf9e Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ImagesTestJSON-452895032-project Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: exception: Image not found. Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '8f52c4cd-3bdf-4f30-b475-b018a8bfe137'} Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8f52c4cd-3bdf-4f30-b475-b018a8bfe137 to delete Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8f52c4cd-3bdf-4f30-b475-b018a8bfe137 could not be found. Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.726198 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:25.731672 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:25.731672 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:25.731672 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:26:25.731672 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:26:25.731672 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:26:25.731672 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:26:25.731672 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:26:25.731672 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:26:25.731672 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 24 21:26:25.731672 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 24 21:26:25.731672 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 24 21:26:25.731672 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.731672 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:25.731672 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.731672 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:25.731672 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:25.731672 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:25.731672 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:26:25.731672 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:26:25.731672 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 24 21:26:25.731672 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.731672 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cd8b90e3-e83a-4b1b-a962-9816db2d7e93 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Returning 404 to user: Image not found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:26:25.731672 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cd8b90e3-e83a-4b1b-a962-9816db2d7e93 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "DELETE /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137" status: 404 len: 62 microversion: 2.1 time: 0.029173 Sep 24 21:26:25.731672 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3075/6130] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:26:25 2022] DELETE /compute/v2.1/images/8f52c4cd-3bdf-4f30-b475-b018a8bfe137 => generated 62 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 21:26:25.736757 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-65d44c55-c503-473b-b891-e9f79deb333b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:25.737253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-65d44c55-c503-473b-b891-e9f79deb333b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:26:25.743360 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65d44c55-c503-473b-b891-e9f79deb333b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:25.743840 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65d44c55-c503-473b-b891-e9f79deb333b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:25.744276 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65d44c55-c503-473b-b891-e9f79deb333b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:25.744960 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65d44c55-c503-473b-b891-e9f79deb333b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:25.745411 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65d44c55-c503-473b-b891-e9f79deb333b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:25.745836 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65d44c55-c503-473b-b891-e9f79deb333b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:25.760833 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-65d44c55-c503-473b-b891-e9f79deb333b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] HTTP exception thrown: Instance 0bbaa1bb-c15e-4858-871d-5adf18509357 could not be found. Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-65d44c55-c503-473b-b891-e9f79deb333b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Request method failure captured: Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 HTTP/1.1 Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3V3umR_ryUmmmQ8NzFN2ct_MQ2sF7KpTo4BNUQch9X-r0mPTQJ699XpvgU_8jd31Cogq9pnUFNF_QS24-TtcdxtEqlKCgmHT2D5p0U1ruwhJ0mKsKVSqu11ze2hnALVV0nAg5BHHZmCPBscIwzTdyDYTrlzQl_wItjUyRbyQLIlsog Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: eb957f17053b49419fbbc09b8633628b Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ImagesTestJSON-452895032 Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb957f17053b49419fbbc09b8633628b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eb957f17053b49419fbbc09b8633628b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eb957f17053b49419fbbc09b8633628b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb957f17053b49419fbbc09b8633628b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ImagesTestJSON-452895032 Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: eb957f17053b49419fbbc09b8633628b Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ImagesTestJSON-452895032 Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ImagesTestJSON-452895032-project Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: d7432bc67cac447391173eedccefbf9e Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ImagesTestJSON-452895032-project Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 0bbaa1bb-c15e-4858-871d-5adf18509357 could not be found. Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '0bbaa1bb-c15e-4858-871d-5adf18509357'} Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bbaa1bb-c15e-4858-871d-5adf18509357 could not be found. Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:26:25.762383 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bbaa1bb-c15e-4858-871d-5adf18509357 could not be found. Sep 24 21:26:25.768937 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.768937 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:25.768937 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.768937 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:25.768937 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:25.768937 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:25.768937 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:26:25.768937 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:26:25.768937 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bbaa1bb-c15e-4858-871d-5adf18509357 could not be found. Sep 24 21:26:25.768937 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.768937 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-65d44c55-c503-473b-b891-e9f79deb333b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Returning 404 to user: Instance 0bbaa1bb-c15e-4858-871d-5adf18509357 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:26:25.768937 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-65d44c55-c503-473b-b891-e9f79deb333b tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 404 len: 111 microversion: 2.1 time: 0.031210 Sep 24 21:26:25.768937 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3056/6131] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:26:25 2022] DELETE /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:26:25.773283 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-24d4d2d6-45bc-4675-8dc9-16530ab80d0d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:25.773912 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-24d4d2d6-45bc-4675-8dc9-16530ab80d0d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 0bbaa1bb-c15e-4858-871d-5adf18509357] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:26:25.781734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24d4d2d6-45bc-4675-8dc9-16530ab80d0d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:25.782226 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24d4d2d6-45bc-4675-8dc9-16530ab80d0d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:25.782711 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24d4d2d6-45bc-4675-8dc9-16530ab80d0d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:25.783419 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24d4d2d6-45bc-4675-8dc9-16530ab80d0d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:25.783909 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24d4d2d6-45bc-4675-8dc9-16530ab80d0d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:25.784347 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24d4d2d6-45bc-4675-8dc9-16530ab80d0d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:25.799781 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-24d4d2d6-45bc-4675-8dc9-16530ab80d0d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] HTTP exception thrown: Instance 0bbaa1bb-c15e-4858-871d-5adf18509357 could not be found. Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-24d4d2d6-45bc-4675-8dc9-16530ab80d0d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Request method failure captured: Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 HTTP/1.1 Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3V3umR_ryUmmmQ8NzFN2ct_MQ2sF7KpTo4BNUQch9X-r0mPTQJ699XpvgU_8jd31Cogq9pnUFNF_QS24-TtcdxtEqlKCgmHT2D5p0U1ruwhJ0mKsKVSqu11ze2hnALVV0nAg5BHHZmCPBscIwzTdyDYTrlzQl_wItjUyRbyQLIlsog Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: eb957f17053b49419fbbc09b8633628b Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ImagesTestJSON-452895032 Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb957f17053b49419fbbc09b8633628b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eb957f17053b49419fbbc09b8633628b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eb957f17053b49419fbbc09b8633628b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb957f17053b49419fbbc09b8633628b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ImagesTestJSON-452895032 Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: eb957f17053b49419fbbc09b8633628b Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ImagesTestJSON-452895032 Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ImagesTestJSON-452895032-project Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: d7432bc67cac447391173eedccefbf9e Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ImagesTestJSON-452895032-project Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 0bbaa1bb-c15e-4858-871d-5adf18509357 could not be found. Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '0bbaa1bb-c15e-4858-871d-5adf18509357'} Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bbaa1bb-c15e-4858-871d-5adf18509357 could not be found. Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bbaa1bb-c15e-4858-871d-5adf18509357 could not be found. Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.801341 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:25.806962 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:25.806962 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:25.806962 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:26:25.806962 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:26:25.806962 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bbaa1bb-c15e-4858-871d-5adf18509357 could not be found. Sep 24 21:26:25.806962 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.806962 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-24d4d2d6-45bc-4675-8dc9-16530ab80d0d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Returning 404 to user: Instance 0bbaa1bb-c15e-4858-871d-5adf18509357 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:26:25.806962 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-24d4d2d6-45bc-4675-8dc9-16530ab80d0d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357" status: 404 len: 111 microversion: 2.1 time: 0.033377 Sep 24 21:26:25.806962 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3076/6132] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:26:25 2022] GET /compute/v2.1/servers/0bbaa1bb-c15e-4858-871d-5adf18509357 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:26:25.812671 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7a2e21d7-22fc-4bc2-886d-d8a0cb5da21d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '.version_select at 0x7f4b0762a310>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:25.833558 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-7a2e21d7-22fc-4bc2-886d-d8a0cb5da21d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] HTTP exception thrown: Image not found. Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7a2e21d7-22fc-4bc2-886d-d8a0cb5da21d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Request method failure captured: Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/images/e2aa6bf4-3ac9-4636-afb5-681bd7aa1368 HTTP/1.1 Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3V3umR_ryUmmmQ8NzFN2ct_MQ2sF7KpTo4BNUQch9X-r0mPTQJ699XpvgU_8jd31Cogq9pnUFNF_QS24-TtcdxtEqlKCgmHT2D5p0U1ruwhJ0mKsKVSqu11ze2hnALVV0nAg5BHHZmCPBscIwzTdyDYTrlzQl_wItjUyRbyQLIlsog Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: eb957f17053b49419fbbc09b8633628b Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ImagesTestJSON-452895032 Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb957f17053b49419fbbc09b8633628b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eb957f17053b49419fbbc09b8633628b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eb957f17053b49419fbbc09b8633628b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb957f17053b49419fbbc09b8633628b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ImagesTestJSON-452895032 Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: eb957f17053b49419fbbc09b8633628b Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ImagesTestJSON-452895032 Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ImagesTestJSON-452895032-project Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: d7432bc67cac447391173eedccefbf9e Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ImagesTestJSON-452895032-project Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: exception: Image not found. Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'e2aa6bf4-3ac9-4636-afb5-681bd7aa1368'} Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e2aa6bf4-3ac9-4636-afb5-681bd7aa1368 to delete Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e2aa6bf4-3ac9-4636-afb5-681bd7aa1368 could not be found. Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.835320 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:25.840739 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:25.840739 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:25.840739 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:26:25.840739 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:26:25.840739 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:26:25.840739 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:26:25.840739 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:26:25.840739 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:26:25.840739 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 24 21:26:25.840739 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 24 21:26:25.840739 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 24 21:26:25.840739 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.840739 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:25.840739 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.840739 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:25.840739 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:25.840739 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:25.840739 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:26:25.840739 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:26:25.840739 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 24 21:26:25.840739 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.840739 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7a2e21d7-22fc-4bc2-886d-d8a0cb5da21d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Returning 404 to user: Image not found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:26:25.840739 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7a2e21d7-22fc-4bc2-886d-d8a0cb5da21d tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "DELETE /compute/v2.1/images/e2aa6bf4-3ac9-4636-afb5-681bd7aa1368" status: 404 len: 62 microversion: 2.1 time: 0.028806 Sep 24 21:26:25.840739 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3057/6133] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:26:25 2022] DELETE /compute/v2.1/images/e2aa6bf4-3ac9-4636-afb5-681bd7aa1368 => generated 62 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 21:26:25.845270 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e11e9f3e-2336-4205-81f8-e1fd5a54f88c tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:25.845779 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e11e9f3e-2336-4205-81f8-e1fd5a54f88c tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 8dd17104-d645-4cb0-84f0-31ae22127726] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:26:25.851876 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e11e9f3e-2336-4205-81f8-e1fd5a54f88c tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:25.852446 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e11e9f3e-2336-4205-81f8-e1fd5a54f88c tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:25.852897 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e11e9f3e-2336-4205-81f8-e1fd5a54f88c tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:25.853599 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e11e9f3e-2336-4205-81f8-e1fd5a54f88c tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:25.854063 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e11e9f3e-2336-4205-81f8-e1fd5a54f88c tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:25.854523 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e11e9f3e-2336-4205-81f8-e1fd5a54f88c tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:25.868653 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-e11e9f3e-2336-4205-81f8-e1fd5a54f88c tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] HTTP exception thrown: Instance 8dd17104-d645-4cb0-84f0-31ae22127726 could not be found. Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e11e9f3e-2336-4205-81f8-e1fd5a54f88c tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Request method failure captured: Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/servers/8dd17104-d645-4cb0-84f0-31ae22127726 HTTP/1.1 Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3V3umR_ryUmmmQ8NzFN2ct_MQ2sF7KpTo4BNUQch9X-r0mPTQJ699XpvgU_8jd31Cogq9pnUFNF_QS24-TtcdxtEqlKCgmHT2D5p0U1ruwhJ0mKsKVSqu11ze2hnALVV0nAg5BHHZmCPBscIwzTdyDYTrlzQl_wItjUyRbyQLIlsog Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: eb957f17053b49419fbbc09b8633628b Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ImagesTestJSON-452895032 Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb957f17053b49419fbbc09b8633628b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eb957f17053b49419fbbc09b8633628b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eb957f17053b49419fbbc09b8633628b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb957f17053b49419fbbc09b8633628b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ImagesTestJSON-452895032 Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: eb957f17053b49419fbbc09b8633628b Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ImagesTestJSON-452895032 Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ImagesTestJSON-452895032-project Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: d7432bc67cac447391173eedccefbf9e Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ImagesTestJSON-452895032-project Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 8dd17104-d645-4cb0-84f0-31ae22127726 could not be found. Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '8dd17104-d645-4cb0-84f0-31ae22127726'} Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dd17104-d645-4cb0-84f0-31ae22127726 could not be found. Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:26:25.870265 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dd17104-d645-4cb0-84f0-31ae22127726 could not be found. Sep 24 21:26:25.876581 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.876581 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:25.876581 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.876581 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:25.876581 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:25.876581 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:25.876581 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:26:25.876581 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:26:25.876581 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dd17104-d645-4cb0-84f0-31ae22127726 could not be found. Sep 24 21:26:25.876581 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.876581 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e11e9f3e-2336-4205-81f8-e1fd5a54f88c tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Returning 404 to user: Instance 8dd17104-d645-4cb0-84f0-31ae22127726 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:26:25.876581 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e11e9f3e-2336-4205-81f8-e1fd5a54f88c tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8dd17104-d645-4cb0-84f0-31ae22127726" status: 404 len: 111 microversion: 2.1 time: 0.030415 Sep 24 21:26:25.876581 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3077/6134] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:26:25 2022] DELETE /compute/v2.1/servers/8dd17104-d645-4cb0-84f0-31ae22127726 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:26:25.880865 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-217365ad-d4ee-41b9-b7a7-a7d1981e81c0 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:25.881486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-217365ad-d4ee-41b9-b7a7-a7d1981e81c0 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] [instance: 8dd17104-d645-4cb0-84f0-31ae22127726] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:26:25.888572 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-217365ad-d4ee-41b9-b7a7-a7d1981e81c0 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:25.889155 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-217365ad-d4ee-41b9-b7a7-a7d1981e81c0 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:25.889676 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-217365ad-d4ee-41b9-b7a7-a7d1981e81c0 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:25.890415 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-217365ad-d4ee-41b9-b7a7-a7d1981e81c0 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:25.891181 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-217365ad-d4ee-41b9-b7a7-a7d1981e81c0 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:25.891622 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-217365ad-d4ee-41b9-b7a7-a7d1981e81c0 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:25.904927 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-217365ad-d4ee-41b9-b7a7-a7d1981e81c0 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] HTTP exception thrown: Instance 8dd17104-d645-4cb0-84f0-31ae22127726 could not be found. Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-217365ad-d4ee-41b9-b7a7-a7d1981e81c0 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Request method failure captured: Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/8dd17104-d645-4cb0-84f0-31ae22127726 HTTP/1.1 Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3V3umR_ryUmmmQ8NzFN2ct_MQ2sF7KpTo4BNUQch9X-r0mPTQJ699XpvgU_8jd31Cogq9pnUFNF_QS24-TtcdxtEqlKCgmHT2D5p0U1ruwhJ0mKsKVSqu11ze2hnALVV0nAg5BHHZmCPBscIwzTdyDYTrlzQl_wItjUyRbyQLIlsog Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: eb957f17053b49419fbbc09b8633628b Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ImagesTestJSON-452895032 Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb957f17053b49419fbbc09b8633628b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eb957f17053b49419fbbc09b8633628b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eb957f17053b49419fbbc09b8633628b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb957f17053b49419fbbc09b8633628b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ImagesTestJSON-452895032 Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: eb957f17053b49419fbbc09b8633628b Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ImagesTestJSON-452895032 Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ImagesTestJSON-452895032-project Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: d7432bc67cac447391173eedccefbf9e Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ImagesTestJSON-452895032-project Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 8dd17104-d645-4cb0-84f0-31ae22127726 could not be found. Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '8dd17104-d645-4cb0-84f0-31ae22127726'} Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dd17104-d645-4cb0-84f0-31ae22127726 could not be found. Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dd17104-d645-4cb0-84f0-31ae22127726 could not be found. Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.906462 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:25.912785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:25.912785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:25.912785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:26:25.912785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:26:25.912785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dd17104-d645-4cb0-84f0-31ae22127726 could not be found. Sep 24 21:26:25.912785 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:25.912785 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-217365ad-d4ee-41b9-b7a7-a7d1981e81c0 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] Returning 404 to user: Instance 8dd17104-d645-4cb0-84f0-31ae22127726 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:26:25.912785 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-217365ad-d4ee-41b9-b7a7-a7d1981e81c0 tempest-ImagesTestJSON-452895032 tempest-ImagesTestJSON-452895032-project] 10.222.0.52 "GET /compute/v2.1/servers/8dd17104-d645-4cb0-84f0-31ae22127726" status: 404 len: 111 microversion: 2.1 time: 0.030873 Sep 24 21:26:25.912785 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3058/6135] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:26:25 2022] GET /compute/v2.1/servers/8dd17104-d645-4cb0-84f0-31ae22127726 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 21:26:30.055382 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cc18816c-a8a8-4f44-8117-45bef0c0add0 tempest-ImagesDeleteNegativeTestJSON-205863395 tempest-ImagesDeleteNegativeTestJSON-205863395-project] 10.222.0.52 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.117934 Sep 24 21:26:30.055924 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3078/6136] 10.222.0.52 () {58 vars in 1128 bytes} [Sat Sep 24 21:26:29 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 120 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 24 21:26:30.065471 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-68ec2615-ee0a-42b8-9f74-ef2659112030 tempest-ImagesDeleteNegativeTestJSON-205863395 tempest-ImagesDeleteNegativeTestJSON-205863395-project] Calling method '.version_select at 0x7f4b0c4e0f70>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:30.088519 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-68ec2615-ee0a-42b8-9f74-ef2659112030 tempest-ImagesDeleteNegativeTestJSON-205863395 tempest-ImagesDeleteNegativeTestJSON-205863395-project] HTTP exception thrown: Image not found. Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-68ec2615-ee0a-42b8-9f74-ef2659112030 tempest-ImagesDeleteNegativeTestJSON-205863395 tempest-ImagesDeleteNegativeTestJSON-205863395-project] Request method failure captured: Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3YF3gdW4_WDFlphRms9FTWU_ghMXiH6qeGA7ESju9fyW_gkcreZ0zIFq57XFecO17jdO0EIoH91L3cdARanlhXnIfVvv7pwhdqX6IcO0yW1-DHg8Ich2W8bjzkwRAfv3UBNrCNR_pwZYqX5u0Y76-1zRMdlJqjpasjVrw_ZDxa-sHw Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 4a738f6c7d7943ed89991f262ebf8faf Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-205863395 Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4a738f6c7d7943ed89991f262ebf8faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4a738f6c7d7943ed89991f262ebf8faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4a738f6c7d7943ed89991f262ebf8faf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4a738f6c7d7943ed89991f262ebf8faf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-205863395 Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 4a738f6c7d7943ed89991f262ebf8faf Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-205863395 Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ImagesDeleteNegativeTestJSON-205863395-project Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: b9541e94f4a142a6bf275d6d4b5c34b6 Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-205863395-project Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: exception: Image not found. Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '-1'} Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:30.090252 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:30.096248 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:30.096248 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:30.096248 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:26:30.096248 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:26:30.096248 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:26:30.096248 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:26:30.096248 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:26:30.096248 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:26:30.096248 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 24 21:26:30.096248 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 24 21:26:30.096248 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 24 21:26:30.096248 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:30.096248 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:30.096248 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:30.096248 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:30.096248 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:30.096248 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:30.096248 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:26:30.096248 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:26:30.096248 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 24 21:26:30.096248 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:30.096248 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-68ec2615-ee0a-42b8-9f74-ef2659112030 tempest-ImagesDeleteNegativeTestJSON-205863395 tempest-ImagesDeleteNegativeTestJSON-205863395-project] Returning 404 to user: Image not found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:26:30.096248 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-68ec2615-ee0a-42b8-9f74-ef2659112030 tempest-ImagesDeleteNegativeTestJSON-205863395 tempest-ImagesDeleteNegativeTestJSON-205863395-project] 10.222.0.52 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.030682 Sep 24 21:26:30.096248 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3059/6137] 10.222.0.52 () {58 vars in 1134 bytes} [Sat Sep 24 21:26:30 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 24 21:26:30.105543 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2008016a-06b3-4f90-abb5-e035ceb6e82e tempest-ImagesDeleteNegativeTestJSON-205863395 tempest-ImagesDeleteNegativeTestJSON-205863395-project] Calling method '.version_select at 0x7f4b11018790>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:30.127828 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-2008016a-06b3-4f90-abb5-e035ceb6e82e tempest-ImagesDeleteNegativeTestJSON-205863395 tempest-ImagesDeleteNegativeTestJSON-205863395-project] HTTP exception thrown: Image not found. Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2008016a-06b3-4f90-abb5-e035ceb6e82e tempest-ImagesDeleteNegativeTestJSON-205863395 tempest-ImagesDeleteNegativeTestJSON-205863395-project] Request method failure captured: Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/images/63c211fa-00e8-427c-b48d-99d7872d1d0j HTTP/1.1 Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3YF3gdW4_WDFlphRms9FTWU_ghMXiH6qeGA7ESju9fyW_gkcreZ0zIFq57XFecO17jdO0EIoH91L3cdARanlhXnIfVvv7pwhdqX6IcO0yW1-DHg8Ich2W8bjzkwRAfv3UBNrCNR_pwZYqX5u0Y76-1zRMdlJqjpasjVrw_ZDxa-sHw Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 4a738f6c7d7943ed89991f262ebf8faf Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-205863395 Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4a738f6c7d7943ed89991f262ebf8faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4a738f6c7d7943ed89991f262ebf8faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4a738f6c7d7943ed89991f262ebf8faf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4a738f6c7d7943ed89991f262ebf8faf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-205863395 Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 4a738f6c7d7943ed89991f262ebf8faf Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-205863395 Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ImagesDeleteNegativeTestJSON-205863395-project Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: b9541e94f4a142a6bf275d6d4b5c34b6 Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-205863395-project Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: exception: Image not found. Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '63c211fa-00e8-427c-b48d-99d7872d1d0j'} Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 63c211fa-00e8-427c-b48d-99d7872d1d0j to delete Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 63c211fa-00e8-427c-b48d-99d7872d1d0j could not be found. Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:30.129579 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:30.134963 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:30.134963 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:30.134963 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:30.134963 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:26:30.134963 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:26:30.134963 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:26:30.134963 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:26:30.134963 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:26:30.134963 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:26:30.134963 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 24 21:26:30.134963 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 24 21:26:30.134963 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 24 21:26:30.134963 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:30.134963 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:30.134963 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:30.134963 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:30.134963 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:30.134963 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:30.134963 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:26:30.134963 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:26:30.134963 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 24 21:26:30.134963 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:30.134963 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2008016a-06b3-4f90-abb5-e035ceb6e82e tempest-ImagesDeleteNegativeTestJSON-205863395 tempest-ImagesDeleteNegativeTestJSON-205863395-project] Returning 404 to user: Image not found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:26:30.134963 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2008016a-06b3-4f90-abb5-e035ceb6e82e tempest-ImagesDeleteNegativeTestJSON-205863395 tempest-ImagesDeleteNegativeTestJSON-205863395-project] 10.222.0.52 "DELETE /compute/v2.1/images/63c211fa-00e8-427c-b48d-99d7872d1d0j" status: 404 len: 62 microversion: 2.1 time: 0.029501 Sep 24 21:26:30.134963 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3079/6138] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:26:30 2022] DELETE /compute/v2.1/images/63c211fa-00e8-427c-b48d-99d7872d1d0j => generated 62 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 21:26:30.143008 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a1be714c-90d7-498b-9eba-c07befc3feb8 tempest-ImagesDeleteNegativeTestJSON-205863395 tempest-ImagesDeleteNegativeTestJSON-205863395-project] Calling method '.version_select at 0x7f4b074345e0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:30.158288 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-a1be714c-90d7-498b-9eba-c07befc3feb8 tempest-ImagesDeleteNegativeTestJSON-205863395 tempest-ImagesDeleteNegativeTestJSON-205863395-project] HTTP exception thrown: Image not found. Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a1be714c-90d7-498b-9eba-c07befc3feb8 tempest-ImagesDeleteNegativeTestJSON-205863395 tempest-ImagesDeleteNegativeTestJSON-205863395-project] Request method failure captured: Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/images/42ad4b84-9b4d-46b9-a67d-7d4dd419c0001 HTTP/1.1 Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3YF3gdW4_WDFlphRms9FTWU_ghMXiH6qeGA7ESju9fyW_gkcreZ0zIFq57XFecO17jdO0EIoH91L3cdARanlhXnIfVvv7pwhdqX6IcO0yW1-DHg8Ich2W8bjzkwRAfv3UBNrCNR_pwZYqX5u0Y76-1zRMdlJqjpasjVrw_ZDxa-sHw Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 4a738f6c7d7943ed89991f262ebf8faf Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-205863395 Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4a738f6c7d7943ed89991f262ebf8faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4a738f6c7d7943ed89991f262ebf8faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4a738f6c7d7943ed89991f262ebf8faf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4a738f6c7d7943ed89991f262ebf8faf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-205863395 Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 4a738f6c7d7943ed89991f262ebf8faf Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-205863395 Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ImagesDeleteNegativeTestJSON-205863395-project Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: b9541e94f4a142a6bf275d6d4b5c34b6 Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-205863395-project Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: exception: Image not found. Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '42ad4b84-9b4d-46b9-a67d-7d4dd419c0001'} Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 42ad4b84-9b4d-46b9-a67d-7d4dd419c0001 to delete Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 42ad4b84-9b4d-46b9-a67d-7d4dd419c0001 could not be found. Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:30.160133 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:30.165592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:30.165592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:30.165592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:30.165592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:26:30.165592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:26:30.165592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:26:30.165592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:26:30.165592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:26:30.165592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:26:30.165592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 24 21:26:30.165592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 24 21:26:30.165592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 24 21:26:30.165592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:30.165592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:30.165592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:30.165592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:30.165592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:30.165592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:30.165592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:26:30.165592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:26:30.165592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 24 21:26:30.165592 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:30.165592 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a1be714c-90d7-498b-9eba-c07befc3feb8 tempest-ImagesDeleteNegativeTestJSON-205863395 tempest-ImagesDeleteNegativeTestJSON-205863395-project] Returning 404 to user: Image not found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:26:30.165592 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a1be714c-90d7-498b-9eba-c07befc3feb8 tempest-ImagesDeleteNegativeTestJSON-205863395 tempest-ImagesDeleteNegativeTestJSON-205863395-project] 10.222.0.52 "DELETE /compute/v2.1/images/42ad4b84-9b4d-46b9-a67d-7d4dd419c0001" status: 404 len: 62 microversion: 2.1 time: 0.023385 Sep 24 21:26:30.165592 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3060/6139] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:26:30 2022] DELETE /compute/v2.1/images/42ad4b84-9b4d-46b9-a67d-7d4dd419c0001 => generated 62 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 21:26:30.172306 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7fd2a350-57f5-4195-bb8a-b2ff247f0023 tempest-ImagesDeleteNegativeTestJSON-205863395 tempest-ImagesDeleteNegativeTestJSON-205863395-project] Calling method '.version_select at 0x7f4b0738b310>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:30.193757 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-7fd2a350-57f5-4195-bb8a-b2ff247f0023 tempest-ImagesDeleteNegativeTestJSON-205863395 tempest-ImagesDeleteNegativeTestJSON-205863395-project] HTTP exception thrown: Image not found. Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7fd2a350-57f5-4195-bb8a-b2ff247f0023 tempest-ImagesDeleteNegativeTestJSON-205863395 tempest-ImagesDeleteNegativeTestJSON-205863395-project] Request method failure captured: Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/images/tempest-invalid-569763659 HTTP/1.1 Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3YF3gdW4_WDFlphRms9FTWU_ghMXiH6qeGA7ESju9fyW_gkcreZ0zIFq57XFecO17jdO0EIoH91L3cdARanlhXnIfVvv7pwhdqX6IcO0yW1-DHg8Ich2W8bjzkwRAfv3UBNrCNR_pwZYqX5u0Y76-1zRMdlJqjpasjVrw_ZDxa-sHw Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 4a738f6c7d7943ed89991f262ebf8faf Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-205863395 Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4a738f6c7d7943ed89991f262ebf8faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4a738f6c7d7943ed89991f262ebf8faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4a738f6c7d7943ed89991f262ebf8faf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4a738f6c7d7943ed89991f262ebf8faf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-205863395 Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 4a738f6c7d7943ed89991f262ebf8faf Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-205863395 Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ImagesDeleteNegativeTestJSON-205863395-project Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: b9541e94f4a142a6bf275d6d4b5c34b6 Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-205863395-project Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: exception: Image not found. Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'tempest-invalid-569763659'} Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-569763659 to delete Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-569763659 could not be found. Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:30.195529 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:30.201074 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:30.201074 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:30.201074 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:26:30.201074 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:26:30.201074 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:26:30.201074 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:26:30.201074 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:26:30.201074 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:26:30.201074 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 24 21:26:30.201074 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 24 21:26:30.201074 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 24 21:26:30.201074 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:30.201074 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:30.201074 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:30.201074 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:30.201074 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:30.201074 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:30.201074 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:26:30.201074 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:26:30.201074 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 24 21:26:30.201074 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:30.201074 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7fd2a350-57f5-4195-bb8a-b2ff247f0023 tempest-ImagesDeleteNegativeTestJSON-205863395 tempest-ImagesDeleteNegativeTestJSON-205863395-project] Returning 404 to user: Image not found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:26:30.201074 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7fd2a350-57f5-4195-bb8a-b2ff247f0023 tempest-ImagesDeleteNegativeTestJSON-205863395 tempest-ImagesDeleteNegativeTestJSON-205863395-project] 10.222.0.52 "DELETE /compute/v2.1/images/tempest-invalid-569763659" status: 404 len: 62 microversion: 2.1 time: 0.030003 Sep 24 21:26:30.201074 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3080/6140] 10.222.0.52 () {58 vars in 1203 bytes} [Sat Sep 24 21:26:30 2022] DELETE /compute/v2.1/images/tempest-invalid-569763659 => generated 62 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 21:26:30.207431 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7f8371b0-72f1-43de-ad9c-af43f1c64b93 tempest-ImagesDeleteNegativeTestJSON-205863395 tempest-ImagesDeleteNegativeTestJSON-205863395-project] Calling method '.version_select at 0x7f4b077caa60>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:30.227719 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-7f8371b0-72f1-43de-ad9c-af43f1c64b93 tempest-ImagesDeleteNegativeTestJSON-205863395 tempest-ImagesDeleteNegativeTestJSON-205863395-project] HTTP exception thrown: Image not found. Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7f8371b0-72f1-43de-ad9c-af43f1c64b93 tempest-ImagesDeleteNegativeTestJSON-205863395 tempest-ImagesDeleteNegativeTestJSON-205863395-project] Request method failure captured: Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/images/558b4ab5-562b-4363-93a4-82e1677bf46f HTTP/1.1 Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3YF3gdW4_WDFlphRms9FTWU_ghMXiH6qeGA7ESju9fyW_gkcreZ0zIFq57XFecO17jdO0EIoH91L3cdARanlhXnIfVvv7pwhdqX6IcO0yW1-DHg8Ich2W8bjzkwRAfv3UBNrCNR_pwZYqX5u0Y76-1zRMdlJqjpasjVrw_ZDxa-sHw Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 4a738f6c7d7943ed89991f262ebf8faf Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-205863395 Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4a738f6c7d7943ed89991f262ebf8faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4a738f6c7d7943ed89991f262ebf8faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4a738f6c7d7943ed89991f262ebf8faf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4a738f6c7d7943ed89991f262ebf8faf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-205863395 Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 4a738f6c7d7943ed89991f262ebf8faf Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-205863395 Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ImagesDeleteNegativeTestJSON-205863395-project Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: b9541e94f4a142a6bf275d6d4b5c34b6 Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-205863395-project Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: exception: Image not found. Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '558b4ab5-562b-4363-93a4-82e1677bf46f'} Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 558b4ab5-562b-4363-93a4-82e1677bf46f to delete Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 558b4ab5-562b-4363-93a4-82e1677bf46f could not be found. Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:30.229509 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:30.235137 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:30.235137 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:30.235137 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:30.235137 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:26:30.235137 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:26:30.235137 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:26:30.235137 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:26:30.235137 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:26:30.235137 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:26:30.235137 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 24 21:26:30.235137 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 24 21:26:30.235137 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 24 21:26:30.235137 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:30.235137 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:30.235137 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:30.235137 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:30.235137 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:30.235137 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:30.235137 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:26:30.235137 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:26:30.235137 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 24 21:26:30.235137 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:30.235137 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7f8371b0-72f1-43de-ad9c-af43f1c64b93 tempest-ImagesDeleteNegativeTestJSON-205863395 tempest-ImagesDeleteNegativeTestJSON-205863395-project] Returning 404 to user: Image not found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:26:30.235137 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7f8371b0-72f1-43de-ad9c-af43f1c64b93 tempest-ImagesDeleteNegativeTestJSON-205863395 tempest-ImagesDeleteNegativeTestJSON-205863395-project] 10.222.0.52 "DELETE /compute/v2.1/images/558b4ab5-562b-4363-93a4-82e1677bf46f" status: 404 len: 62 microversion: 2.1 time: 0.027238 Sep 24 21:26:30.235137 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3061/6141] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:26:30 2022] DELETE /compute/v2.1/images/558b4ab5-562b-4363-93a4-82e1677bf46f => generated 62 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 21:26:31.601331 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e5539df3-42a9-4f8f-b412-d8e5d1c77590 tempest-ListImagesTestJSON-1315254588 tempest-ListImagesTestJSON-1315254588-project] Calling method '.version_select at 0x7f4b0c0b01f0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:31.645687 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e5539df3-42a9-4f8f-b412-d8e5d1c77590 tempest-ListImagesTestJSON-1315254588 tempest-ListImagesTestJSON-1315254588-project] 10.222.0.52 "GET /compute/v2.1/images/4c30e8e9-8fb2-4377-83f1-98322cb17799" status: 200 len: 784 microversion: 2.1 time: 0.161136 Sep 24 21:26:31.646257 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3081/6142] 10.222.0.52 () {58 vars in 1233 bytes} [Sat Sep 24 21:26:31 2022] GET /compute/v2.1/images/4c30e8e9-8fb2-4377-83f1-98322cb17799 => generated 784 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:26:31.662741 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e0e45248-d229-4309-b406-66ae7e7185ab tempest-ListImagesTestJSON-1315254588 tempest-ListImagesTestJSON-1315254588-project] Calling method '.version_select at 0x7f4b077ca4c0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:31.708793 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e0e45248-d229-4309-b406-66ae7e7185ab tempest-ListImagesTestJSON-1315254588 tempest-ListImagesTestJSON-1315254588-project] 10.222.0.52 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.051802 Sep 24 21:26:31.709357 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3062/6143] 10.222.0.52 () {58 vars in 1122 bytes} [Sat Sep 24 21:26:31 2022] GET /compute/v2.1/images => generated 445 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:26:31.721638 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-57327f22-9ef3-4037-b342-67a1cf0f961b tempest-ListImagesTestJSON-1315254588 tempest-ListImagesTestJSON-1315254588-project] Calling method '.version_select at 0x7f4b0c95a0d0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:31.767613 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-57327f22-9ef3-4037-b342-67a1cf0f961b tempest-ListImagesTestJSON-1315254588 tempest-ListImagesTestJSON-1315254588-project] 10.222.0.52 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.049723 Sep 24 21:26:31.768188 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3082/6144] 10.222.0.52 () {58 vars in 1143 bytes} [Sat Sep 24 21:26:31 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:26:37.643224 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:26:37.644029 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:26:37.770850 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a6e7ee1e-730a-4ebb-ad68-2a6a63973afd tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Action: 'create', calling method: .version_select at 0x7f4b07593820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1678509090", "description": "tempest-description-755822334"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:26:37.911211 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a6e7ee1e-730a-4ebb-ad68-2a6a63973afd tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.269770 Sep 24 21:26:37.912864 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3063/6145] 10.222.0.52 () {60 vars in 1180 bytes} [Sat Sep 24 21:26:37 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:26:37.925741 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:26:37.926518 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=18 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:26:37.930926 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b9743dd5-3521-4e7c-a986-dab0efe5b318 tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Action: 'create', calling method: .version_select at 0x7f4b07dacf70>, body: {"security_group_rule": {"parent_group_id": "3aee08e7-fd18-469b-9742-2a1666d8f18a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:26:38.114190 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b9743dd5-3521-4e7c-a986-dab0efe5b318 tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.189917 Sep 24 21:26:38.114959 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3083/6146] 10.222.0.52 () {60 vars in 1195 bytes} [Sat Sep 24 21:26:37 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:26:38.127463 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ddc17427-2737-46d4-b289-650d04af138f tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Action: 'create', calling method: .version_select at 0x7f4b075935e0>, body: {"security_group_rule": {"parent_group_id": "3aee08e7-fd18-469b-9742-2a1666d8f18a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:26:38.183307 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-ddc17427-2737-46d4-b289-650d04af138f tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] HTTP exception thrown: This rule already exists in group 3aee08e7-fd18-469b-9742-2a1666d8f18a Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ddc17427-2737-46d4-b289-650d04af138f tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Request method failure captured: Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 138 Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3YNMZVNuj9EN8zcUOi2uN2ehZPn9HznCXxuzGeq5pCRIc1NajGvPtBE8s3EA9cc5E_XuR-PA36Eb3hIcVtom8w_x-JiCGU_jAUccxrdX1Vz9rq-VZFkbIF4b31xSqgKAJBg_7Q2shompwLTUBPKjkew5ajsL9_AAyefKe7Xint6olo Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 2ec88f37776f490794836a3796812fb6 Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-741307051 Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ec88f37776f490794836a3796812fb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2ec88f37776f490794836a3796812fb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2ec88f37776f490794836a3796812fb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ec88f37776f490794836a3796812fb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-741307051 Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 2ec88f37776f490794836a3796812fb6 Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-741307051 Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-741307051-project Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 7a34302354c7485da79fac333dbe361e Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-741307051-project Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: {"security_group_rule": {"parent_group_id": "3aee08e7-fd18-469b-9742-2a1666d8f18a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: exception: This rule already exists in group 3aee08e7-fd18-469b-9742-2a1666d8f18a Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3aee08e7-fd18-469b-9742-2a1666d8f18a', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 3aee08e7-fd18-469b-9742-2a1666d8f18a Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 3aee08e7-fd18-469b-9742-2a1666d8f18a Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:38.184884 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:38.191293 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:26:38.191293 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:26:38.191293 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 3aee08e7-fd18-469b-9742-2a1666d8f18a Sep 24 21:26:38.191293 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:38.191293 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ddc17427-2737-46d4-b289-650d04af138f tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Returning 400 to user: This rule already exists in group 3aee08e7-fd18-469b-9742-2a1666d8f18a {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:26:38.191293 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ddc17427-2737-46d4-b289-650d04af138f tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.064547 Sep 24 21:26:38.191293 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3064/6147] 10.222.0.52 () {60 vars in 1195 bytes} [Sat Sep 24 21:26:38 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:26:38.196598 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-70534c84-f48e-4bb7-98dc-ef510b6d930c tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Calling method '.version_select at 0x7f4b0c7b1ee0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:38.360263 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-70534c84-f48e-4bb7-98dc-ef510b6d930c tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-group-rules/6ffbb5e9-d9df-4808-aa6f-0860fd7df512" status: 202 len: 0 microversion: 2.1 time: 0.167365 Sep 24 21:26:38.369510 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3084/6148] 10.222.0.52 () {58 vars in 1287 bytes} [Sat Sep 24 21:26:38 2022] DELETE /compute/v2.1/os-security-group-rules/6ffbb5e9-d9df-4808-aa6f-0860fd7df512 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:26:38.370838 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5f80e3dc-1643-4b82-93d5-b6d0e531a008 tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Action: 'create', calling method: .version_select at 0x7f4b0745a550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-110242005", "description": "tempest-description-1180074835"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:26:38.539441 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5f80e3dc-1643-4b82-93d5-b6d0e531a008 tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.172500 Sep 24 21:26:38.540203 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3065/6149] 10.222.0.52 () {60 vars in 1180 bytes} [Sat Sep 24 21:26:38 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:26:38.555734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8097f443-29a1-4a83-a187-95511aa27e01 tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Action: 'create', calling method: .version_select at 0x7f4b0c9470d0>, body: {"security_group_rule": {"parent_group_id": "cb20ede3-e563-4a85-aca1-857988ce0427", "ip_protocol": "tcp", "from_port": 741432428, "to_port": 22}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:26:38.604847 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-8097f443-29a1-4a83-a187-95511aa27e01 tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] HTTP exception thrown: Invalid port range 741432428:22. Former value cannot be greater than the later Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8097f443-29a1-4a83-a187-95511aa27e01 tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Request method failure captured: Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 145 Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3YNMZVNuj9EN8zcUOi2uN2ehZPn9HznCXxuzGeq5pCRIc1NajGvPtBE8s3EA9cc5E_XuR-PA36Eb3hIcVtom8w_x-JiCGU_jAUccxrdX1Vz9rq-VZFkbIF4b31xSqgKAJBg_7Q2shompwLTUBPKjkew5ajsL9_AAyefKe7Xint6olo Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 2ec88f37776f490794836a3796812fb6 Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-741307051 Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ec88f37776f490794836a3796812fb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2ec88f37776f490794836a3796812fb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2ec88f37776f490794836a3796812fb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ec88f37776f490794836a3796812fb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-741307051 Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 2ec88f37776f490794836a3796812fb6 Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-741307051 Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-741307051-project Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 7a34302354c7485da79fac333dbe361e Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-741307051-project Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: {"security_group_rule": {"parent_group_id": "cb20ede3-e563-4a85-aca1-857988ce0427", "ip_protocol": "tcp", "from_port": 741432428, "to_port": 22}} Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: exception: Invalid port range 741432428:22. Former value cannot be greater than the later Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'cb20ede3-e563-4a85-aca1-857988ce0427', 'ip_protocol': 'tcp', 'from_port': 741432428, 'to_port': 22}}} Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 741432428:22. Former value cannot be greater than the later Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 741432428:22. Former value cannot be greater than the later Sep 24 21:26:38.606404 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:38.615894 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:38.615894 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:38.615894 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:38.615894 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:38.615894 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:38.615894 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:26:38.615894 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:26:38.615894 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 741432428:22. Former value cannot be greater than the later Sep 24 21:26:38.615894 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:38.615894 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8097f443-29a1-4a83-a187-95511aa27e01 tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Returning 400 to user: Invalid port range 741432428:22. Former value cannot be greater than the later {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:26:38.615894 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8097f443-29a1-4a83-a187-95511aa27e01 tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.056097 Sep 24 21:26:38.615894 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3085/6150] 10.222.0.52 () {60 vars in 1195 bytes} [Sat Sep 24 21:26:38 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:26:38.619533 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-134e31ec-7493-4df3-99e2-70a9a88c1af3 tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Action: 'create', calling method: .version_select at 0x7f4b0761d3a0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-538195638", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:26:38.621644 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-134e31ec-7493-4df3-99e2-70a9a88c1af3 tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] HTTP exception thrown: Security group id should be uuid Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-134e31ec-7493-4df3-99e2-70a9a88c1af3 tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Request method failure captured: Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 130 Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3YNMZVNuj9EN8zcUOi2uN2ehZPn9HznCXxuzGeq5pCRIc1NajGvPtBE8s3EA9cc5E_XuR-PA36Eb3hIcVtom8w_x-JiCGU_jAUccxrdX1Vz9rq-VZFkbIF4b31xSqgKAJBg_7Q2shompwLTUBPKjkew5ajsL9_AAyefKe7Xint6olo Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 2ec88f37776f490794836a3796812fb6 Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-741307051 Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ec88f37776f490794836a3796812fb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2ec88f37776f490794836a3796812fb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2ec88f37776f490794836a3796812fb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ec88f37776f490794836a3796812fb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-741307051 Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 2ec88f37776f490794836a3796812fb6 Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-741307051 Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-741307051-project Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 7a34302354c7485da79fac333dbe361e Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-741307051-project Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-538195638", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: exception: Security group id should be uuid Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-538195638', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:26:38.623183 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:26:38.628123 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Sep 24 21:26:38.628123 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:38.628123 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-134e31ec-7493-4df3-99e2-70a9a88c1af3 tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Returning 400 to user: Security group id should be uuid {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:26:38.628123 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-134e31ec-7493-4df3-99e2-70a9a88c1af3 tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.010351 Sep 24 21:26:38.628123 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3066/6151] 10.222.0.52 () {60 vars in 1195 bytes} [Sat Sep 24 21:26:38 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 24 21:26:38.639134 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-09788c87-3cbc-465d-badc-e0eb630aa796 tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Action: 'create', calling method: .version_select at 0x7f4b0c947d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-862959410", "description": "tempest-description-567942199"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:26:38.792260 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-09788c87-3cbc-465d-badc-e0eb630aa796 tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.161581 Sep 24 21:26:38.793029 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3086/6152] 10.222.0.52 () {60 vars in 1180 bytes} [Sat Sep 24 21:26:38 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:26:38.807965 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a90a9acf-8d9a-4b92-8b76-fa1dd752703e tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Action: 'create', calling method: .version_select at 0x7f4b0c50c4c0>, body: {"security_group_rule": {"parent_group_id": "996f8633-e5d2-4083-8e9e-5d489a792486", "ip_protocol": "tempest-999-370007535", "from_port": 22, "to_port": 22}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:26:38.861397 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-a90a9acf-8d9a-4b92-8b76-fa1dd752703e tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] HTTP exception thrown: Invalid IP protocol tempest-999-370007535. Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a90a9acf-8d9a-4b92-8b76-fa1dd752703e tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Request method failure captured: Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 156 Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3YNMZVNuj9EN8zcUOi2uN2ehZPn9HznCXxuzGeq5pCRIc1NajGvPtBE8s3EA9cc5E_XuR-PA36Eb3hIcVtom8w_x-JiCGU_jAUccxrdX1Vz9rq-VZFkbIF4b31xSqgKAJBg_7Q2shompwLTUBPKjkew5ajsL9_AAyefKe7Xint6olo Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 2ec88f37776f490794836a3796812fb6 Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-741307051 Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ec88f37776f490794836a3796812fb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2ec88f37776f490794836a3796812fb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2ec88f37776f490794836a3796812fb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ec88f37776f490794836a3796812fb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-741307051 Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 2ec88f37776f490794836a3796812fb6 Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-741307051 Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-741307051-project Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 7a34302354c7485da79fac333dbe361e Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-741307051-project Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: {"security_group_rule": {"parent_group_id": "996f8633-e5d2-4083-8e9e-5d489a792486", "ip_protocol": "tempest-999-370007535", "from_port": 22, "to_port": 22}} Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: exception: Invalid IP protocol tempest-999-370007535. Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'body': {'security_group_rule': {'parent_group_id': '996f8633-e5d2-4083-8e9e-5d489a792486', 'ip_protocol': 'tempest-999-370007535', 'from_port': 22, 'to_port': 22}}} Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-370007535. Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-370007535. Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:38.863072 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:38.869527 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:38.869527 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:38.869527 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:38.869527 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:38.869527 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:26:38.869527 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:26:38.869527 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-370007535. Sep 24 21:26:38.869527 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:38.869527 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a90a9acf-8d9a-4b92-8b76-fa1dd752703e tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Returning 400 to user: Invalid IP protocol tempest-999-370007535. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:26:38.869527 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a90a9acf-8d9a-4b92-8b76-fa1dd752703e tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.061345 Sep 24 21:26:38.869527 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3067/6153] 10.222.0.52 () {60 vars in 1195 bytes} [Sat Sep 24 21:26:38 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 24 21:26:38.875129 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8f88acd0-b1a6-45ff-912e-080edc536337 tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Action: 'create', calling method: .version_select at 0x7f4b0cae38b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1905134389", "description": "tempest-description-1885313916"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:26:39.027297 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8f88acd0-b1a6-45ff-912e-080edc536337 tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.156344 Sep 24 21:26:39.035586 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3087/6154] 10.222.0.52 () {60 vars in 1180 bytes} [Sat Sep 24 21:26:38 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:26:39.040394 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c5bc5c80-520a-45cb-bd36-33376c7a5c7f tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Action: 'create', calling method: .version_select at 0x7f4b07593b80>, body: {"security_group_rule": {"parent_group_id": "af1055aa-0dba-47b6-bda9-821937b16f34", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:26:39.090903 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-c5bc5c80-520a-45cb-bd36-33376c7a5c7f tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c5bc5c80-520a-45cb-bd36-33376c7a5c7f tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Request method failure captured: Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 138 Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3YNMZVNuj9EN8zcUOi2uN2ehZPn9HznCXxuzGeq5pCRIc1NajGvPtBE8s3EA9cc5E_XuR-PA36Eb3hIcVtom8w_x-JiCGU_jAUccxrdX1Vz9rq-VZFkbIF4b31xSqgKAJBg_7Q2shompwLTUBPKjkew5ajsL9_AAyefKe7Xint6olo Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 2ec88f37776f490794836a3796812fb6 Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-741307051 Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ec88f37776f490794836a3796812fb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2ec88f37776f490794836a3796812fb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2ec88f37776f490794836a3796812fb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ec88f37776f490794836a3796812fb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-741307051 Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 2ec88f37776f490794836a3796812fb6 Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-741307051 Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-741307051-project Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 7a34302354c7485da79fac333dbe361e Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-741307051-project Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: {"security_group_rule": {"parent_group_id": "af1055aa-0dba-47b6-bda9-821937b16f34", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: exception: Invalid port range 22:21. Former value cannot be greater than the later Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'af1055aa-0dba-47b6-bda9-821937b16f34', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Sep 24 21:26:39.092618 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:39.101952 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:39.101952 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:39.101952 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:39.101952 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:39.101952 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:39.101952 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:26:39.101952 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:26:39.101952 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Sep 24 21:26:39.101952 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:39.101952 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c5bc5c80-520a-45cb-bd36-33376c7a5c7f tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:26:39.101952 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c5bc5c80-520a-45cb-bd36-33376c7a5c7f tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.057519 Sep 24 21:26:39.101952 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3068/6155] 10.222.0.52 () {60 vars in 1195 bytes} [Sat Sep 24 21:26:39 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:26:39.104629 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4b5babc9-3f9c-40e0-8455-58573637503b tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Action: 'create', calling method: .version_select at 0x7f4b073b64c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1411325578", "description": "tempest-description-503623913"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:26:39.245780 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4b5babc9-3f9c-40e0-8455-58573637503b tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.145934 Sep 24 21:26:39.246423 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3088/6156] 10.222.0.52 () {60 vars in 1180 bytes} [Sat Sep 24 21:26:39 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:26:39.261490 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d5d5b07a-51c6-4ba4-a6b3-515b0d8f74c3 tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Action: 'create', calling method: .version_select at 0x7f4b07593ee0>, body: {"security_group_rule": {"parent_group_id": "29149eb9-8261-4f5b-96c5-3e85ebaf6e40", "ip_protocol": "tcp", "from_port": 22, "to_port": 16846066}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:26:39.313844 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-d5d5b07a-51c6-4ba4-a6b3-515b0d8f74c3 tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] HTTP exception thrown: Invalid port range 22:16846066. Valid TCP ports should be between 1-65535 Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d5d5b07a-51c6-4ba4-a6b3-515b0d8f74c3 tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Request method failure captured: Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 144 Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3YNMZVNuj9EN8zcUOi2uN2ehZPn9HznCXxuzGeq5pCRIc1NajGvPtBE8s3EA9cc5E_XuR-PA36Eb3hIcVtom8w_x-JiCGU_jAUccxrdX1Vz9rq-VZFkbIF4b31xSqgKAJBg_7Q2shompwLTUBPKjkew5ajsL9_AAyefKe7Xint6olo Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 2ec88f37776f490794836a3796812fb6 Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-741307051 Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ec88f37776f490794836a3796812fb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2ec88f37776f490794836a3796812fb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2ec88f37776f490794836a3796812fb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ec88f37776f490794836a3796812fb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-741307051 Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 2ec88f37776f490794836a3796812fb6 Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-741307051 Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-741307051-project Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 7a34302354c7485da79fac333dbe361e Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-741307051-project Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: {"security_group_rule": {"parent_group_id": "29149eb9-8261-4f5b-96c5-3e85ebaf6e40", "ip_protocol": "tcp", "from_port": 22, "to_port": 16846066}} Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: exception: Invalid port range 22:16846066. Valid TCP ports should be between 1-65535 Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'body': {'security_group_rule': {'parent_group_id': '29149eb9-8261-4f5b-96c5-3e85ebaf6e40', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 16846066}}} Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:16846066. Valid TCP ports should be between 1-65535 Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:16846066. Valid TCP ports should be between 1-65535 Sep 24 21:26:39.315492 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:39.321438 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:39.321438 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:39.321438 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:39.321438 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:39.321438 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:39.321438 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:26:39.321438 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:26:39.321438 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:16846066. Valid TCP ports should be between 1-65535 Sep 24 21:26:39.321438 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:39.321438 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d5d5b07a-51c6-4ba4-a6b3-515b0d8f74c3 tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Returning 400 to user: Invalid port range 22:16846066. Valid TCP ports should be between 1-65535 {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:26:39.321438 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d5d5b07a-51c6-4ba4-a6b3-515b0d8f74c3 tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 117 microversion: 2.1 time: 0.060073 Sep 24 21:26:39.321438 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3069/6157] 10.222.0.52 () {60 vars in 1195 bytes} [Sat Sep 24 21:26:39 2022] POST /compute/v2.1/os-security-group-rules => generated 117 bytes in 62 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 24 21:26:39.327911 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-aafd8be8-6788-4c93-87cf-e4a7cee4a66e tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Action: 'create', calling method: .version_select at 0x7f4b07372ee0>, body: {"security_group_rule": {"parent_group_id": "23f08f3f-c5fb-4992-a9a4-6c2aa4573dd5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:26:39.351186 ncdv-master-1 devstack@n-api.service[140517]: DEBUG neutronclient.v2_0.client [None req-aafd8be8-6788-4c93-87cf-e4a7cee4a66e tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 23f08f3f-c5fb-4992-a9a4-6c2aa4573dd5 does not exist", "detail": ""}} {{(pid=140517) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 24 21:26:39.351782 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.security_group_api [None req-aafd8be8-6788-4c93-87cf-e4a7cee4a66e tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Neutron security group 23f08f3f-c5fb-4992-a9a4-6c2aa4573dd5 not found {{(pid=140517) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 24 21:26:39.352306 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-aafd8be8-6788-4c93-87cf-e4a7cee4a66e tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] HTTP exception thrown: Security group 23f08f3f-c5fb-4992-a9a4-6c2aa4573dd5 does not exist Sep 24 21:26:39.352306 ncdv-master-1 devstack@n-api.service[140517]: Neutron server returns request_ids: ['req-662c080c-8c11-4703-ba50-269719129c42'] Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-aafd8be8-6788-4c93-87cf-e4a7cee4a66e tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Request method failure captured: Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 138 Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3YNMZVNuj9EN8zcUOi2uN2ehZPn9HznCXxuzGeq5pCRIc1NajGvPtBE8s3EA9cc5E_XuR-PA36Eb3hIcVtom8w_x-JiCGU_jAUccxrdX1Vz9rq-VZFkbIF4b31xSqgKAJBg_7Q2shompwLTUBPKjkew5ajsL9_AAyefKe7Xint6olo Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 2ec88f37776f490794836a3796812fb6 Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-741307051 Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ec88f37776f490794836a3796812fb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2ec88f37776f490794836a3796812fb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2ec88f37776f490794836a3796812fb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ec88f37776f490794836a3796812fb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-741307051 Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 2ec88f37776f490794836a3796812fb6 Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-741307051 Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-741307051-project Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 7a34302354c7485da79fac333dbe361e Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-741307051-project Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: {"security_group_rule": {"parent_group_id": "23f08f3f-c5fb-4992-a9a4-6c2aa4573dd5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: method: Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: exception: Security group 23f08f3f-c5fb-4992-a9a4-6c2aa4573dd5 does not exist Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: Neutron server returns request_ids: ['req-662c080c-8c11-4703-ba50-269719129c42'] Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'body': {'security_group_rule': {'parent_group_id': '23f08f3f-c5fb-4992-a9a4-6c2aa4573dd5', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 24 21:26:39.354187 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 23f08f3f-c5fb-4992-a9a4-6c2aa4573dd5 does not exist Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-662c080c-8c11-4703-ba50-269719129c42'] Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 23f08f3f-c5fb-4992-a9a4-6c2aa4573dd5 does not exist Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-662c080c-8c11-4703-ba50-269719129c42'] Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 23f08f3f-c5fb-4992-a9a4-6c2aa4573dd5 does not exist Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-662c080c-8c11-4703-ba50-269719129c42'] Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 23f08f3f-c5fb-4992-a9a4-6c2aa4573dd5 does not exist Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-662c080c-8c11-4703-ba50-269719129c42'] Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-aafd8be8-6788-4c93-87cf-e4a7cee4a66e tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Returning 404 to user: Security group 23f08f3f-c5fb-4992-a9a4-6c2aa4573dd5 does not exist Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: Neutron server returns request_ids: ['req-662c080c-8c11-4703-ba50-269719129c42'] {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-aafd8be8-6788-4c93-87cf-e4a7cee4a66e tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.032396 Sep 24 21:26:39.361418 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3089/6158] 10.222.0.52 () {60 vars in 1195 bytes} [Sat Sep 24 21:26:39 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 21:26:39.366225 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-44986f31-f2d4-4e63-8c02-a7f58f330894 tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Calling method '.version_select at 0x7f4b0761df70>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:39.388027 ncdv-master-1 devstack@n-api.service[140516]: DEBUG neutronclient.v2_0.client [None req-44986f31-f2d4-4e63-8c02-a7f58f330894 tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 0ae3f335-6f8d-4ae7-905e-3a9b41840b54 does not exist", "detail": ""}} {{(pid=140516) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 24 21:26:39.388805 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.security_group_api [None req-44986f31-f2d4-4e63-8c02-a7f58f330894 tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Neutron security group rule 0ae3f335-6f8d-4ae7-905e-3a9b41840b54 not found {{(pid=140516) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Sep 24 21:26:39.389329 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-44986f31-f2d4-4e63-8c02-a7f58f330894 tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] HTTP exception thrown: Security group rule 0ae3f335-6f8d-4ae7-905e-3a9b41840b54 does not exist Sep 24 21:26:39.389329 ncdv-master-1 devstack@n-api.service[140516]: Neutron server returns request_ids: ['req-576e488f-59e3-40e6-9544-d4bbffc3f758'] Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-44986f31-f2d4-4e63-8c02-a7f58f330894 tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Request method failure captured: Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/os-security-group-rules/0ae3f335-6f8d-4ae7-905e-3a9b41840b54 HTTP/1.1 Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3YNMZVNuj9EN8zcUOi2uN2ehZPn9HznCXxuzGeq5pCRIc1NajGvPtBE8s3EA9cc5E_XuR-PA36Eb3hIcVtom8w_x-JiCGU_jAUccxrdX1Vz9rq-VZFkbIF4b31xSqgKAJBg_7Q2shompwLTUBPKjkew5ajsL9_AAyefKe7Xint6olo Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 2ec88f37776f490794836a3796812fb6 Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-741307051 Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ec88f37776f490794836a3796812fb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2ec88f37776f490794836a3796812fb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2ec88f37776f490794836a3796812fb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ec88f37776f490794836a3796812fb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-741307051 Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 2ec88f37776f490794836a3796812fb6 Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-741307051 Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-741307051-project Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 7a34302354c7485da79fac333dbe361e Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-741307051-project Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: method: Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: exception: Security group rule 0ae3f335-6f8d-4ae7-905e-3a9b41840b54 does not exist Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: Neutron server returns request_ids: ['req-576e488f-59e3-40e6-9544-d4bbffc3f758'] Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '0ae3f335-6f8d-4ae7-905e-3a9b41840b54'} Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 24 21:26:39.391497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 0ae3f335-6f8d-4ae7-905e-3a9b41840b54 does not exist Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-576e488f-59e3-40e6-9544-d4bbffc3f758'] Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 0ae3f335-6f8d-4ae7-905e-3a9b41840b54 does not exist Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-576e488f-59e3-40e6-9544-d4bbffc3f758'] Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 0ae3f335-6f8d-4ae7-905e-3a9b41840b54 does not exist Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-576e488f-59e3-40e6-9544-d4bbffc3f758'] Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 0ae3f335-6f8d-4ae7-905e-3a9b41840b54 does not exist Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-576e488f-59e3-40e6-9544-d4bbffc3f758'] Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-44986f31-f2d4-4e63-8c02-a7f58f330894 tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Returning 404 to user: Security group rule 0ae3f335-6f8d-4ae7-905e-3a9b41840b54 does not exist Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: Neutron server returns request_ids: ['req-576e488f-59e3-40e6-9544-d4bbffc3f758'] {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-44986f31-f2d4-4e63-8c02-a7f58f330894 tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-group-rules/0ae3f335-6f8d-4ae7-905e-3a9b41840b54" status: 404 len: 199 microversion: 2.1 time: 0.030535 Sep 24 21:26:39.397718 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3070/6159] 10.222.0.52 () {58 vars in 1287 bytes} [Sat Sep 24 21:26:39 2022] DELETE /compute/v2.1/os-security-group-rules/0ae3f335-6f8d-4ae7-905e-3a9b41840b54 => generated 199 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:26:39.405568 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9b62966e-855f-417c-b392-1729f2360537 tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Calling method '.version_select at 0x7f4b07372e50>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:39.586074 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9b62966e-855f-417c-b392-1729f2360537 tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/29149eb9-8261-4f5b-96c5-3e85ebaf6e40" status: 202 len: 0 microversion: 2.1 time: 0.186491 Sep 24 21:26:39.587247 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3090/6160] 10.222.0.52 () {58 vars in 1272 bytes} [Sat Sep 24 21:26:39 2022] DELETE /compute/v2.1/os-security-groups/29149eb9-8261-4f5b-96c5-3e85ebaf6e40 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:26:39.596111 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0a594984-9fb6-4397-aea8-38b3fa55e3f9 tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Calling method '.version_select at 0x7f4b0c50cf70>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:39.793251 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0a594984-9fb6-4397-aea8-38b3fa55e3f9 tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/af1055aa-0dba-47b6-bda9-821937b16f34" status: 202 len: 0 microversion: 2.1 time: 0.201556 Sep 24 21:26:39.793834 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3071/6161] 10.222.0.52 () {58 vars in 1272 bytes} [Sat Sep 24 21:26:39 2022] DELETE /compute/v2.1/os-security-groups/af1055aa-0dba-47b6-bda9-821937b16f34 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 21:26:39.805690 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-930833e5-c242-4878-b755-4670123ca6b0 tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Calling method '.version_select at 0x7f4b07335790>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:39.998260 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-930833e5-c242-4878-b755-4670123ca6b0 tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/996f8633-e5d2-4083-8e9e-5d489a792486" status: 202 len: 0 microversion: 2.1 time: 0.198861 Sep 24 21:26:39.998964 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3091/6162] 10.222.0.52 () {58 vars in 1272 bytes} [Sat Sep 24 21:26:39 2022] DELETE /compute/v2.1/os-security-groups/996f8633-e5d2-4083-8e9e-5d489a792486 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 21:26:40.007983 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ac8777f9-8481-419e-96aa-8e006d8d26a0 tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Calling method '.version_select at 0x7f4b07593550>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:40.190963 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ac8777f9-8481-419e-96aa-8e006d8d26a0 tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/cb20ede3-e563-4a85-aca1-857988ce0427" status: 202 len: 0 microversion: 2.1 time: 0.187648 Sep 24 21:26:40.191633 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3072/6163] 10.222.0.52 () {58 vars in 1272 bytes} [Sat Sep 24 21:26:40 2022] DELETE /compute/v2.1/os-security-groups/cb20ede3-e563-4a85-aca1-857988ce0427 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 21:26:40.200062 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ca94e0b1-b265-4665-b96f-2daf7c7369fa tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] Calling method '.version_select at 0x7f4b0cfe3f70>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:40.467114 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ca94e0b1-b265-4665-b96f-2daf7c7369fa tempest-SecurityGroupRulesNegativeTestJSON-741307051 tempest-SecurityGroupRulesNegativeTestJSON-741307051-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/3aee08e7-fd18-469b-9742-2a1666d8f18a" status: 202 len: 0 microversion: 2.1 time: 0.271026 Sep 24 21:26:40.472045 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3092/6164] 10.222.0.52 () {58 vars in 1272 bytes} [Sat Sep 24 21:26:40 2022] DELETE /compute/v2.1/os-security-groups/3aee08e7-fd18-469b-9742-2a1666d8f18a => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:26:44.683647 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-794c12c6-d1db-47dc-989b-a0d6da235dc4 tempest-AZV2TestJSON-970246136 tempest-AZV2TestJSON-970246136-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:26:44.685371 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-794c12c6-d1db-47dc-989b-a0d6da235dc4 tempest-AZV2TestJSON-970246136 tempest-AZV2TestJSON-970246136-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:44.685972 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-794c12c6-d1db-47dc-989b-a0d6da235dc4 tempest-AZV2TestJSON-970246136 tempest-AZV2TestJSON-970246136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:44.686411 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-794c12c6-d1db-47dc-989b-a0d6da235dc4 tempest-AZV2TestJSON-970246136 tempest-AZV2TestJSON-970246136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:44.687156 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-794c12c6-d1db-47dc-989b-a0d6da235dc4 tempest-AZV2TestJSON-970246136 tempest-AZV2TestJSON-970246136-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:26:44.687610 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-794c12c6-d1db-47dc-989b-a0d6da235dc4 tempest-AZV2TestJSON-970246136 tempest-AZV2TestJSON-970246136-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:26:44.688035 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-794c12c6-d1db-47dc-989b-a0d6da235dc4 tempest-AZV2TestJSON-970246136 tempest-AZV2TestJSON-970246136-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:26:44.713938 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-794c12c6-d1db-47dc-989b-a0d6da235dc4 tempest-AZV2TestJSON-970246136 tempest-AZV2TestJSON-970246136-project] 10.222.0.52 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.149291 Sep 24 21:26:44.714590 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3073/6165] 10.222.0.52 () {58 vars in 1164 bytes} [Sat Sep 24 21:26:44 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 21:27:05.441259 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b1951b87-a978-4381-b3f8-1c9c05d21a87 tempest-MultipleCreateNegativeTestJSON-858999606 tempest-MultipleCreateNegativeTestJSON-858999606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2015618320", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:27:05.445354 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-b1951b87-a978-4381-b3f8-1c9c05d21a87 tempest-MultipleCreateNegativeTestJSON-858999606 tempest-MultipleCreateNegativeTestJSON-858999606-project] HTTP exception thrown: min_count must be <= max_count Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b1951b87-a978-4381-b3f8-1c9c05d21a87 tempest-MultipleCreateNegativeTestJSON-858999606 tempest-MultipleCreateNegativeTestJSON-858999606-project] Request method failure captured: Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 184 Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3Yp6-hzVXiTdpQWYb9REmsb2VApUXayNkYW0PSkb2mYNzT4fyUtZcAKbSmIoclra8EjHOmFRJ2-t3jURdwGGLTptHuX19f1Aa_sQKwOYX9iPMYgnDchkCVvw2-lnn3w6mG22UZb_BOgPNwO3AzPGbN21D9MdlO2Kx4w06BQMvzvxOw Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: d6b8f825fc1a4dfdb47f5b07c729153b Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-858999606 Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d6b8f825fc1a4dfdb47f5b07c729153b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d6b8f825fc1a4dfdb47f5b07c729153b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d6b8f825fc1a4dfdb47f5b07c729153b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d6b8f825fc1a4dfdb47f5b07c729153b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-858999606 Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: d6b8f825fc1a4dfdb47f5b07c729153b Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-858999606 Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-MultipleCreateNegativeTestJSON-858999606-project Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 4fbe0c5b4e694811b63f0fcad2099add Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-858999606-project Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2015618320", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "min_count": 3, "max_count": 2}} Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: exception: min_count must be <= max_count Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2015618320', 'imageRef': '4c30e8e9-8fb2-4377-83f1-98322cb17799', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Sep 24 21:27:05.446844 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:27:05.452547 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b1951b87-a978-4381-b3f8-1c9c05d21a87 tempest-MultipleCreateNegativeTestJSON-858999606 tempest-MultipleCreateNegativeTestJSON-858999606-project] Returning 400 to user: min_count must be <= max_count {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:27:05.452547 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b1951b87-a978-4381-b3f8-1c9c05d21a87 tempest-MultipleCreateNegativeTestJSON-858999606 tempest-MultipleCreateNegativeTestJSON-858999606-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.130943 Sep 24 21:27:05.452547 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3093/6166] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:27:05 2022] POST /compute/v2.1/servers => generated 74 bytes in 132 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 24 21:27:05.497712 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-05031f23-c144-4389-8e90-b8bf1d5f1eb9 tempest-MultipleCreateNegativeTestJSON-858999606 tempest-MultipleCreateNegativeTestJSON-858999606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-777774620", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "max_count": 0}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-05031f23-c144-4389-8e90-b8bf1d5f1eb9 tempest-MultipleCreateNegativeTestJSON-858999606 tempest-MultipleCreateNegativeTestJSON-858999606-project] Request method failure captured: Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 167 Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3Yp6-hzVXiTdpQWYb9REmsb2VApUXayNkYW0PSkb2mYNzT4fyUtZcAKbSmIoclra8EjHOmFRJ2-t3jURdwGGLTptHuX19f1Aa_sQKwOYX9iPMYgnDchkCVvw2-lnn3w6mG22UZb_BOgPNwO3AzPGbN21D9MdlO2Kx4w06BQMvzvxOw Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: d6b8f825fc1a4dfdb47f5b07c729153b Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-858999606 Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d6b8f825fc1a4dfdb47f5b07c729153b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d6b8f825fc1a4dfdb47f5b07c729153b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d6b8f825fc1a4dfdb47f5b07c729153b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d6b8f825fc1a4dfdb47f5b07c729153b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-858999606 Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: d6b8f825fc1a4dfdb47f5b07c729153b Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-858999606 Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-MultipleCreateNegativeTestJSON-858999606-project Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 4fbe0c5b4e694811b63f0fcad2099add Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-858999606-project Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-777774620", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "max_count": 0}} Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-777774620', 'imageRef': '4c30e8e9-8fb2-4377-83f1-98322cb17799', 'flavorRef': '452', 'max_count': 0}}} Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise error Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 0 Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 21:27:05.501817 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 21:27:05.508285 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 21:27:05.508285 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 21:27:05.508285 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 21:27:05.508285 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 21:27:05.508285 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 24 21:27:05.508285 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:27:05.508285 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:27:05.508285 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:27:05.508285 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:27:05.508285 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:27:05.508285 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:27:05.508285 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 21:27:05.508285 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 21:27:05.508285 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 24 21:27:05.508285 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:27:05.508285 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-05031f23-c144-4389-8e90-b8bf1d5f1eb9 tempest-MultipleCreateNegativeTestJSON-858999606 tempest-MultipleCreateNegativeTestJSON-858999606-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:27:05.508285 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-05031f23-c144-4389-8e90-b8bf1d5f1eb9 tempest-MultipleCreateNegativeTestJSON-858999606 tempest-MultipleCreateNegativeTestJSON-858999606-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.009941 Sep 24 21:27:05.508285 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3074/6167] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:27:05 2022] POST /compute/v2.1/servers => generated 130 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:27:05.551484 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3548d224-a864-4895-b7b8-113d9de75734 tempest-MultipleCreateNegativeTestJSON-858999606 tempest-MultipleCreateNegativeTestJSON-858999606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1891142755", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "max_count": 2.5}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3548d224-a864-4895-b7b8-113d9de75734 tempest-MultipleCreateNegativeTestJSON-858999606 tempest-MultipleCreateNegativeTestJSON-858999606-project] Request method failure captured: Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 170 Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3Yp6-hzVXiTdpQWYb9REmsb2VApUXayNkYW0PSkb2mYNzT4fyUtZcAKbSmIoclra8EjHOmFRJ2-t3jURdwGGLTptHuX19f1Aa_sQKwOYX9iPMYgnDchkCVvw2-lnn3w6mG22UZb_BOgPNwO3AzPGbN21D9MdlO2Kx4w06BQMvzvxOw Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: d6b8f825fc1a4dfdb47f5b07c729153b Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-858999606 Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d6b8f825fc1a4dfdb47f5b07c729153b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d6b8f825fc1a4dfdb47f5b07c729153b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d6b8f825fc1a4dfdb47f5b07c729153b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d6b8f825fc1a4dfdb47f5b07c729153b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-858999606 Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: d6b8f825fc1a4dfdb47f5b07c729153b Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-858999606 Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-MultipleCreateNegativeTestJSON-858999606-project Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 4fbe0c5b4e694811b63f0fcad2099add Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-858999606-project Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1891142755", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "max_count": 2.5}} Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1891142755', 'imageRef': '4c30e8e9-8fb2-4377-83f1-98322cb17799', 'flavorRef': '452', 'max_count': 2.5}}} Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise error Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi 2.5 Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 21:27:05.555497 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 21:27:05.562081 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 21:27:05.562081 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 21:27:05.562081 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 21:27:05.562081 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 21:27:05.562081 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 24 21:27:05.562081 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:27:05.562081 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:27:05.562081 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:27:05.562081 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:27:05.562081 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:27:05.562081 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:27:05.562081 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 21:27:05.562081 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 21:27:05.562081 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 24 21:27:05.562081 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:27:05.562081 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3548d224-a864-4895-b7b8-113d9de75734 tempest-MultipleCreateNegativeTestJSON-858999606 tempest-MultipleCreateNegativeTestJSON-858999606-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:27:05.562081 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3548d224-a864-4895-b7b8-113d9de75734 tempest-MultipleCreateNegativeTestJSON-858999606 tempest-MultipleCreateNegativeTestJSON-858999606-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.009356 Sep 24 21:27:05.562081 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3094/6168] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:27:05 2022] POST /compute/v2.1/servers => generated 139 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:27:05.603810 ncdv-master-1 devstack@n-api.service[140516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 21:27:05.604005 ncdv-master-1 devstack@n-api.service[140516]: Sat Sep 24 21:27:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Sep 24 21:27:05.606220 ncdv-master-1 devstack@n-api.service[140516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 21:27:05.606389 ncdv-master-1 devstack@n-api.service[140516]: Sat Sep 24 21:27:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Sep 24 21:27:05.607395 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:27:05.608163 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:27:05.608792 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=4 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:27:05.613056 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ce9fba31-e216-4eaf-9546-f9ad4b16f75f tempest-MultipleCreateNegativeTestJSON-858999606 tempest-MultipleCreateNegativeTestJSON-858999606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2130402524", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "min_count": 0}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ce9fba31-e216-4eaf-9546-f9ad4b16f75f tempest-MultipleCreateNegativeTestJSON-858999606 tempest-MultipleCreateNegativeTestJSON-858999606-project] Request method failure captured: Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 168 Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3Yp6-hzVXiTdpQWYb9REmsb2VApUXayNkYW0PSkb2mYNzT4fyUtZcAKbSmIoclra8EjHOmFRJ2-t3jURdwGGLTptHuX19f1Aa_sQKwOYX9iPMYgnDchkCVvw2-lnn3w6mG22UZb_BOgPNwO3AzPGbN21D9MdlO2Kx4w06BQMvzvxOw Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: d6b8f825fc1a4dfdb47f5b07c729153b Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-858999606 Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d6b8f825fc1a4dfdb47f5b07c729153b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d6b8f825fc1a4dfdb47f5b07c729153b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d6b8f825fc1a4dfdb47f5b07c729153b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d6b8f825fc1a4dfdb47f5b07c729153b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-858999606 Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: d6b8f825fc1a4dfdb47f5b07c729153b Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-858999606 Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-MultipleCreateNegativeTestJSON-858999606-project Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 4fbe0c5b4e694811b63f0fcad2099add Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-858999606-project Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2130402524", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "min_count": 0}} Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2130402524', 'imageRef': '4c30e8e9-8fb2-4377-83f1-98322cb17799', 'flavorRef': '452', 'min_count': 0}}} Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise error Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi 0 Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 21:27:05.617016 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 21:27:05.622725 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 21:27:05.622725 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 21:27:05.622725 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 21:27:05.622725 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 21:27:05.622725 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 24 21:27:05.622725 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:27:05.622725 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:27:05.622725 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:27:05.622725 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:27:05.622725 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:27:05.622725 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:27:05.622725 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 21:27:05.622725 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 21:27:05.622725 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 24 21:27:05.622725 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:27:05.622725 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ce9fba31-e216-4eaf-9546-f9ad4b16f75f tempest-MultipleCreateNegativeTestJSON-858999606 tempest-MultipleCreateNegativeTestJSON-858999606-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:27:05.622725 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ce9fba31-e216-4eaf-9546-f9ad4b16f75f tempest-MultipleCreateNegativeTestJSON-858999606 tempest-MultipleCreateNegativeTestJSON-858999606-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.016674 Sep 24 21:27:05.622725 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3075/6169] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:27:05 2022] POST /compute/v2.1/servers => generated 130 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:27:05.669760 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2e73d2ad-a4ea-42df-9752-a78b26a7d76f tempest-MultipleCreateNegativeTestJSON-858999606 tempest-MultipleCreateNegativeTestJSON-858999606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-823432986", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "min_count": 2.5}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2e73d2ad-a4ea-42df-9752-a78b26a7d76f tempest-MultipleCreateNegativeTestJSON-858999606 tempest-MultipleCreateNegativeTestJSON-858999606-project] Request method failure captured: Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 169 Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3Yp6-hzVXiTdpQWYb9REmsb2VApUXayNkYW0PSkb2mYNzT4fyUtZcAKbSmIoclra8EjHOmFRJ2-t3jURdwGGLTptHuX19f1Aa_sQKwOYX9iPMYgnDchkCVvw2-lnn3w6mG22UZb_BOgPNwO3AzPGbN21D9MdlO2Kx4w06BQMvzvxOw Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: d6b8f825fc1a4dfdb47f5b07c729153b Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-858999606 Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d6b8f825fc1a4dfdb47f5b07c729153b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d6b8f825fc1a4dfdb47f5b07c729153b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d6b8f825fc1a4dfdb47f5b07c729153b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d6b8f825fc1a4dfdb47f5b07c729153b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-858999606 Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: d6b8f825fc1a4dfdb47f5b07c729153b Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-858999606 Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-MultipleCreateNegativeTestJSON-858999606-project Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 4fbe0c5b4e694811b63f0fcad2099add Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-858999606-project Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-823432986", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "min_count": 2.5}} Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-823432986', 'imageRef': '4c30e8e9-8fb2-4377-83f1-98322cb17799', 'flavorRef': '452', 'min_count': 2.5}}} Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise error Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi 2.5 Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 21:27:05.674671 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 21:27:05.680056 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 21:27:05.680056 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 21:27:05.680056 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 21:27:05.680056 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 21:27:05.680056 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 24 21:27:05.680056 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:27:05.680056 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:27:05.680056 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:27:05.680056 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:27:05.680056 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:27:05.680056 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:27:05.680056 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 21:27:05.680056 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 21:27:05.680056 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 24 21:27:05.680056 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:27:05.680056 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2e73d2ad-a4ea-42df-9752-a78b26a7d76f tempest-MultipleCreateNegativeTestJSON-858999606 tempest-MultipleCreateNegativeTestJSON-858999606-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:27:05.680056 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2e73d2ad-a4ea-42df-9752-a78b26a7d76f tempest-MultipleCreateNegativeTestJSON-858999606 tempest-MultipleCreateNegativeTestJSON-858999606-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.010901 Sep 24 21:27:05.680056 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3095/6170] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:27:05 2022] POST /compute/v2.1/servers => generated 139 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:27:11.063232 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ca8134a8-9e9e-4743-940c-eeaaafdc1a57 tempest-ServerGroup264TestJSON-699984079 tempest-ServerGroup264TestJSON-699984079-project] Action: 'create', calling method: .version_select at 0x7f4b078dbb80>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:27:11.082684 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-ca8134a8-9e9e-4743-940c-eeaaafdc1a57 tempest-ServerGroup264TestJSON-699984079 tempest-ServerGroup264TestJSON-699984079-project] Getting quotas for project 15cc590a447d444f86c525d5e2afd105. Resources: {'server_groups'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:27:11.088640 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-ca8134a8-9e9e-4743-940c-eeaaafdc1a57 tempest-ServerGroup264TestJSON-699984079 tempest-ServerGroup264TestJSON-699984079-project] Getting quotas for user e5a885ff1fc840fb8e585ea914585338 and project 15cc590a447d444f86c525d5e2afd105. Resources: {'server_groups'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:27:11.147818 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-ca8134a8-9e9e-4743-940c-eeaaafdc1a57 tempest-ServerGroup264TestJSON-699984079 tempest-ServerGroup264TestJSON-699984079-project] Getting quotas for project 15cc590a447d444f86c525d5e2afd105. Resources: {'server_groups'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:27:11.154305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-ca8134a8-9e9e-4743-940c-eeaaafdc1a57 tempest-ServerGroup264TestJSON-699984079 tempest-ServerGroup264TestJSON-699984079-project] Getting quotas for user e5a885ff1fc840fb8e585ea914585338 and project 15cc590a447d444f86c525d5e2afd105. Resources: {'server_groups'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:27:11.169889 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ca8134a8-9e9e-4743-940c-eeaaafdc1a57 tempest-ServerGroup264TestJSON-699984079 tempest-ServerGroup264TestJSON-699984079-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.255428 Sep 24 21:27:11.170570 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3076/6171] 10.222.0.52 () {62 vars in 1214 bytes} [Sat Sep 24 21:27:10 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 21:27:11.186850 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a9be43c3-e423-4345-96dd-19791fbce1c2 tempest-ServerGroup264TestJSON-699984079 tempest-ServerGroup264TestJSON-699984079-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:11.198466 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a9be43c3-e423-4345-96dd-19791fbce1c2 tempest-ServerGroup264TestJSON-699984079 tempest-ServerGroup264TestJSON-699984079-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.020597 Sep 24 21:27:11.205679 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3096/6172] 10.222.0.52 () {60 vars in 1193 bytes} [Sat Sep 24 21:27:11 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:27:11.213579 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ddc5b8ab-af90-443c-bace-e3c0a19064af tempest-ServerGroup264TestJSON-699984079 tempest-ServerGroup264TestJSON-699984079-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:11.241310 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ddc5b8ab-af90-443c-bace-e3c0a19064af tempest-ServerGroup264TestJSON-699984079 tempest-ServerGroup264TestJSON-699984079-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups/afada164-5b36-41ce-9809-7e6963cb986f" status: 200 len: 235 microversion: 2.64 time: 0.033417 Sep 24 21:27:11.241310 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3077/6173] 10.222.0.52 () {60 vars in 1304 bytes} [Sat Sep 24 21:27:11 2022] GET /compute/v2.1/os-server-groups/afada164-5b36-41ce-9809-7e6963cb986f => generated 235 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:27:11.252215 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-699766b4-8e2d-4265-bea9-54b769e792aa tempest-ServerGroup264TestJSON-699984079 tempest-ServerGroup264TestJSON-699984079-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:11.288585 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-699766b4-8e2d-4265-bea9-54b769e792aa tempest-ServerGroup264TestJSON-699984079 tempest-ServerGroup264TestJSON-699984079-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/afada164-5b36-41ce-9809-7e6963cb986f" status: 204 len: 0 microversion: 2.64 time: 0.040152 Sep 24 21:27:11.289398 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3097/6174] 10.222.0.52 () {60 vars in 1307 bytes} [Sat Sep 24 21:27:11 2022] DELETE /compute/v2.1/os-server-groups/afada164-5b36-41ce-9809-7e6963cb986f => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 24 21:27:11.300159 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4f2a8673-e79e-4ad5-b6d0-e4116ff6e1c9 tempest-ServerGroup264TestJSON-699984079 tempest-ServerGroup264TestJSON-699984079-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:11.308195 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-4f2a8673-e79e-4ad5-b6d0-e4116ff6e1c9 tempest-ServerGroup264TestJSON-699984079 tempest-ServerGroup264TestJSON-699984079-project] HTTP exception thrown: Instance group afada164-5b36-41ce-9809-7e6963cb986f could not be found. Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4f2a8673-e79e-4ad5-b6d0-e4116ff6e1c9 tempest-ServerGroup264TestJSON-699984079 tempest-ServerGroup264TestJSON-699984079-project] Request method failure captured: Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: request: DELETE /compute/v2.1/os-server-groups/afada164-5b36-41ce-9809-7e6963cb986f HTTP/1.1 Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3YulJqWxG95stQXOL2oXlEsZPpRZh46rl6ZUn51PRXt66FnhXSHK7UN5YjHnMdtndKnHmnRR-znY4v2fa8sId1gus9-8bjkKv5KlCKX5g-lmLXRRTHuqWa8FSGUTcJHw1nuxhu4rXQmWtrOP7Pf0BjD7cLA-wNzuipdesIU5v7AG5k Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: X-Openstack-Nova-Api-Version: 2.64 Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 15cc590a447d444f86c525d5e2afd105 Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServerGroup264TestJSON-699984079 Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/15cc590a447d444f86c525d5e2afd105"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_15cc590a447d444f86c525d5e2afd105"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/15cc590a447d444f86c525d5e2afd105"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/15cc590a447d444f86c525d5e2afd105"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServerGroup264TestJSON-699984079 Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 15cc590a447d444f86c525d5e2afd105 Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServerGroup264TestJSON-699984079 Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServerGroup264TestJSON-699984079-project Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: e5a885ff1fc840fb8e585ea914585338 Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServerGroup264TestJSON-699984079-project Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance group afada164-5b36-41ce-9809-7e6963cb986f could not be found. Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'afada164-5b36-41ce-9809-7e6963cb986f'} Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group afada164-5b36-41ce-9809-7e6963cb986f could not be found. Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group afada164-5b36-41ce-9809-7e6963cb986f could not be found. Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:27:11.310004 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:27:11.315391 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:27:11.315391 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:27:11.315391 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:27:11.315391 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:27:11.315391 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group afada164-5b36-41ce-9809-7e6963cb986f could not be found. Sep 24 21:27:11.315391 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:27:11.315391 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4f2a8673-e79e-4ad5-b6d0-e4116ff6e1c9 tempest-ServerGroup264TestJSON-699984079 tempest-ServerGroup264TestJSON-699984079-project] Returning 404 to user: Instance group afada164-5b36-41ce-9809-7e6963cb986f could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:27:11.315391 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4f2a8673-e79e-4ad5-b6d0-e4116ff6e1c9 tempest-ServerGroup264TestJSON-699984079 tempest-ServerGroup264TestJSON-699984079-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/afada164-5b36-41ce-9809-7e6963cb986f" status: 404 len: 117 microversion: 2.64 time: 0.015797 Sep 24 21:27:11.315391 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3078/6175] 10.222.0.52 () {60 vars in 1307 bytes} [Sat Sep 24 21:27:11 2022] DELETE /compute/v2.1/os-server-groups/afada164-5b36-41ce-9809-7e6963cb986f => generated 117 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:27:15.944325 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-59adef5e-abc4-4db0-9708-df926e60bab9 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-573402022", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": "none"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:27:15.997635 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-59adef5e-abc4-4db0-9708-df926e60bab9 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:27:15.998068 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-59adef5e-abc4-4db0-9708-df926e60bab9 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:27:15.998580 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-59adef5e-abc4-4db0-9708-df926e60bab9 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:27:15.999001 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-59adef5e-abc4-4db0-9708-df926e60bab9 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:27:15.999424 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-59adef5e-abc4-4db0-9708-df926e60bab9 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:27:16.008126 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-59adef5e-abc4-4db0-9708-df926e60bab9 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:16.008613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-59adef5e-abc4-4db0-9708-df926e60bab9 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:16.009054 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-59adef5e-abc4-4db0-9708-df926e60bab9 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:16.009788 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-59adef5e-abc4-4db0-9708-df926e60bab9 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:16.010248 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-59adef5e-abc4-4db0-9708-df926e60bab9 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:16.010711 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-59adef5e-abc4-4db0-9708-df926e60bab9 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:16.028785 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-59adef5e-abc4-4db0-9708-df926e60bab9 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Getting quotas for project 434f7c63a1b34202b60a826e930d7d9d. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:27:16.034015 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-59adef5e-abc4-4db0-9708-df926e60bab9 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Getting quotas for user 7309e1efde7d4f72a36d8213766e67e4 and project 434f7c63a1b34202b60a826e930d7d9d. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:27:16.047162 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-59adef5e-abc4-4db0-9708-df926e60bab9 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:27:16.049468 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-59adef5e-abc4-4db0-9708-df926e60bab9 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:27:16.095761 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-59adef5e-abc4-4db0-9708-df926e60bab9 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.268546 Sep 24 21:27:16.096420 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3098/6176] 10.222.0.52 () {62 vars in 1188 bytes} [Sat Sep 24 21:27:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 270 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 24 21:27:16.107899 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ef82250a-45bc-4c38-8d8e-52261edd6d2b tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:16.108527 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ef82250a-45bc-4c38-8d8e-52261edd6d2b tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:16.165256 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ef82250a-45bc-4c38-8d8e-52261edd6d2b tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:16.172900 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ef82250a-45bc-4c38-8d8e-52261edd6d2b tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:16.174365 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ef82250a-45bc-4c38-8d8e-52261edd6d2b tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:16.175538 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ef82250a-45bc-4c38-8d8e-52261edd6d2b tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927" status: 200 len: 1277 microversion: 2.54 time: 0.071934 Sep 24 21:27:16.176098 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3079/6177] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:27:16 2022] GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 => generated 1277 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:27:17.201795 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c3e798c2-7321-4926-ad5d-73c15ce99020 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:17.202619 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c3e798c2-7321-4926-ad5d-73c15ce99020 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:17.209578 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c3e798c2-7321-4926-ad5d-73c15ce99020 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:17.210062 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c3e798c2-7321-4926-ad5d-73c15ce99020 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:17.210548 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c3e798c2-7321-4926-ad5d-73c15ce99020 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:17.211249 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c3e798c2-7321-4926-ad5d-73c15ce99020 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:17.211702 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c3e798c2-7321-4926-ad5d-73c15ce99020 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:17.212134 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c3e798c2-7321-4926-ad5d-73c15ce99020 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:17.280055 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c3e798c2-7321-4926-ad5d-73c15ce99020 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:17.288370 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c3e798c2-7321-4926-ad5d-73c15ce99020 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:17.289821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c3e798c2-7321-4926-ad5d-73c15ce99020 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:17.291070 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c3e798c2-7321-4926-ad5d-73c15ce99020 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927" status: 200 len: 1337 microversion: 2.54 time: 0.093656 Sep 24 21:27:17.291646 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3099/6178] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:27:17 2022] GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 => generated 1337 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:27:18.318516 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6b3bd8e4-f841-4ba5-9b27-d752b34c4b5f tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:18.319176 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6b3bd8e4-f841-4ba5-9b27-d752b34c4b5f tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:18.327565 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b3bd8e4-f841-4ba5-9b27-d752b34c4b5f tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:18.328054 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b3bd8e4-f841-4ba5-9b27-d752b34c4b5f tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:18.328495 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b3bd8e4-f841-4ba5-9b27-d752b34c4b5f tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:18.329201 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b3bd8e4-f841-4ba5-9b27-d752b34c4b5f tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:18.329665 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b3bd8e4-f841-4ba5-9b27-d752b34c4b5f tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:18.330100 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b3bd8e4-f841-4ba5-9b27-d752b34c4b5f tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:18.397498 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6b3bd8e4-f841-4ba5-9b27-d752b34c4b5f tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:18.406219 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6b3bd8e4-f841-4ba5-9b27-d752b34c4b5f tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:18.407714 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6b3bd8e4-f841-4ba5-9b27-d752b34c4b5f tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:18.408844 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6b3bd8e4-f841-4ba5-9b27-d752b34c4b5f tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927" status: 200 len: 1335 microversion: 2.54 time: 0.094398 Sep 24 21:27:18.409403 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3080/6179] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:27:18 2022] GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 => generated 1335 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:27:19.436361 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-116c3e4d-cd69-46d1-b47d-24d4f6acf424 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:19.436996 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-116c3e4d-cd69-46d1-b47d-24d4f6acf424 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:19.444028 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-116c3e4d-cd69-46d1-b47d-24d4f6acf424 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:19.444518 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-116c3e4d-cd69-46d1-b47d-24d4f6acf424 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:19.444964 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-116c3e4d-cd69-46d1-b47d-24d4f6acf424 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:19.445672 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-116c3e4d-cd69-46d1-b47d-24d4f6acf424 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:19.446136 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-116c3e4d-cd69-46d1-b47d-24d4f6acf424 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:19.446597 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-116c3e4d-cd69-46d1-b47d-24d4f6acf424 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:19.514147 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-116c3e4d-cd69-46d1-b47d-24d4f6acf424 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:19.522758 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-116c3e4d-cd69-46d1-b47d-24d4f6acf424 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:19.524239 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-116c3e4d-cd69-46d1-b47d-24d4f6acf424 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:19.525395 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-116c3e4d-cd69-46d1-b47d-24d4f6acf424 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927" status: 200 len: 1335 microversion: 2.54 time: 0.093718 Sep 24 21:27:19.525970 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3100/6180] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:27:19 2022] GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 => generated 1335 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:27:20.552827 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fd8091d9-c291-4fa1-a1ee-14261b1c6ea7 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:20.553455 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fd8091d9-c291-4fa1-a1ee-14261b1c6ea7 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:20.560495 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fd8091d9-c291-4fa1-a1ee-14261b1c6ea7 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:20.560977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fd8091d9-c291-4fa1-a1ee-14261b1c6ea7 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:20.561419 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fd8091d9-c291-4fa1-a1ee-14261b1c6ea7 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:20.562115 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fd8091d9-c291-4fa1-a1ee-14261b1c6ea7 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:20.562606 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fd8091d9-c291-4fa1-a1ee-14261b1c6ea7 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:20.563041 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fd8091d9-c291-4fa1-a1ee-14261b1c6ea7 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:20.626248 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fd8091d9-c291-4fa1-a1ee-14261b1c6ea7 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:20.634603 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fd8091d9-c291-4fa1-a1ee-14261b1c6ea7 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:20.637092 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fd8091d9-c291-4fa1-a1ee-14261b1c6ea7 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:20.637742 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fd8091d9-c291-4fa1-a1ee-14261b1c6ea7 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927" status: 200 len: 1335 microversion: 2.54 time: 0.088837 Sep 24 21:27:20.638308 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3081/6181] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:27:20 2022] GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 => generated 1335 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:27:21.665232 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e081b370-1964-4347-a8f8-dcccad8bffbf tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:21.665845 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e081b370-1964-4347-a8f8-dcccad8bffbf tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:21.673339 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e081b370-1964-4347-a8f8-dcccad8bffbf tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:21.673827 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e081b370-1964-4347-a8f8-dcccad8bffbf tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:21.674267 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e081b370-1964-4347-a8f8-dcccad8bffbf tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:21.675007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e081b370-1964-4347-a8f8-dcccad8bffbf tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:21.675451 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e081b370-1964-4347-a8f8-dcccad8bffbf tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:21.675879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e081b370-1964-4347-a8f8-dcccad8bffbf tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:21.740090 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e081b370-1964-4347-a8f8-dcccad8bffbf tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:21.748525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e081b370-1964-4347-a8f8-dcccad8bffbf tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:21.749995 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e081b370-1964-4347-a8f8-dcccad8bffbf tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:21.751211 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e081b370-1964-4347-a8f8-dcccad8bffbf tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927" status: 200 len: 1356 microversion: 2.54 time: 0.089928 Sep 24 21:27:21.751778 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3101/6182] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:27:21 2022] GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 => generated 1356 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:27:21.781017 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d638bf08-535e-4185-9ff7-586209a91c8b tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Action: 'create', calling method: .version_select at 0x7f4b0761ddc0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1106318946", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMMpcYKQjlrQpyezOgL4uS6zlw4CrYP4fxBzotYjhSPCZYzQj2qsCbV2trRp3QbEsjuueLgi2X6fexyA7VXYIKGSF7TG8RK1JOTtogIZaqc1xFvejYPJDvnMTluBanZUw=="}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:27:21.798073 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-d638bf08-535e-4185-9ff7-586209a91c8b tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Getting quotas for project 434f7c63a1b34202b60a826e930d7d9d. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:27:21.803183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-d638bf08-535e-4185-9ff7-586209a91c8b tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Getting quotas for user 7309e1efde7d4f72a36d8213766e67e4 and project 434f7c63a1b34202b60a826e930d7d9d. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:27:21.826723 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d638bf08-535e-4185-9ff7-586209a91c8b tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.049967 Sep 24 21:27:21.827321 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3082/6183] 10.222.0.52 () {62 vars in 1200 bytes} [Sat Sep 24 21:27:21 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 24 21:27:21.838594 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-246e9a3d-926b-4b7c-9ead-736f07c77259 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1106318946", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:27:21.841922 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-246e9a3d-926b-4b7c-9ead-736f07c77259 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:21.847983 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-246e9a3d-926b-4b7c-9ead-736f07c77259 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:21.848473 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-246e9a3d-926b-4b7c-9ead-736f07c77259 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:21.848914 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-246e9a3d-926b-4b7c-9ead-736f07c77259 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:21.849616 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-246e9a3d-926b-4b7c-9ead-736f07c77259 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:21.850076 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-246e9a3d-926b-4b7c-9ead-736f07c77259 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:21.850525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-246e9a3d-926b-4b7c-9ead-736f07c77259 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:21.932933 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-246e9a3d-926b-4b7c-9ead-736f07c77259 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:27:21.933478 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-246e9a3d-926b-4b7c-9ead-736f07c77259 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:27:21.933967 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-246e9a3d-926b-4b7c-9ead-736f07c77259 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:27:21.934407 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-246e9a3d-926b-4b7c-9ead-736f07c77259 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:27:21.934843 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-246e9a3d-926b-4b7c-9ead-736f07c77259 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:27:22.007735 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-246e9a3d-926b-4b7c-9ead-736f07c77259 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:22.014914 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-246e9a3d-926b-4b7c-9ead-736f07c77259 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:22.015537 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-246e9a3d-926b-4b7c-9ead-736f07c77259 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:22.015987 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-246e9a3d-926b-4b7c-9ead-736f07c77259 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:22.016844 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-246e9a3d-926b-4b7c-9ead-736f07c77259 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:22.017300 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-246e9a3d-926b-4b7c-9ead-736f07c77259 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:22.017730 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-246e9a3d-926b-4b7c-9ead-736f07c77259 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:22.046312 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-246e9a3d-926b-4b7c-9ead-736f07c77259 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "POST /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927/action" status: 202 len: 1139 microversion: 2.54 time: 0.211834 Sep 24 21:27:22.046970 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3102/6184] 10.222.0.52 () {62 vars in 1320 bytes} [Sat Sep 24 21:27:21 2022] POST /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927/action => generated 1139 bytes in 213 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Sep 24 21:27:22.067244 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5f252da8-aaae-4832-a135-ec6596480513 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:22.067864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5f252da8-aaae-4832-a135-ec6596480513 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:22.074325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f252da8-aaae-4832-a135-ec6596480513 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:22.074847 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f252da8-aaae-4832-a135-ec6596480513 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:22.075287 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f252da8-aaae-4832-a135-ec6596480513 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:22.075982 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f252da8-aaae-4832-a135-ec6596480513 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:22.076439 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f252da8-aaae-4832-a135-ec6596480513 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:22.076864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f252da8-aaae-4832-a135-ec6596480513 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:22.143681 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5f252da8-aaae-4832-a135-ec6596480513 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:22.152757 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5f252da8-aaae-4832-a135-ec6596480513 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:22.154220 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5f252da8-aaae-4832-a135-ec6596480513 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:22.155408 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5f252da8-aaae-4832-a135-ec6596480513 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927" status: 200 len: 1408 microversion: 2.54 time: 0.092098 Sep 24 21:27:22.155973 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3083/6185] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:27:22 2022] GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 => generated 1408 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:27:23.180757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9604b124-fbfb-42e7-9bf5-ed0f694de73d tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:23.181377 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9604b124-fbfb-42e7-9bf5-ed0f694de73d tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:23.188961 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9604b124-fbfb-42e7-9bf5-ed0f694de73d tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:23.189453 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9604b124-fbfb-42e7-9bf5-ed0f694de73d tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:23.189905 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9604b124-fbfb-42e7-9bf5-ed0f694de73d tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:23.190646 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9604b124-fbfb-42e7-9bf5-ed0f694de73d tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:23.191112 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9604b124-fbfb-42e7-9bf5-ed0f694de73d tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:23.191545 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9604b124-fbfb-42e7-9bf5-ed0f694de73d tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:23.257653 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9604b124-fbfb-42e7-9bf5-ed0f694de73d tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:23.268169 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9604b124-fbfb-42e7-9bf5-ed0f694de73d tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:23.269838 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9604b124-fbfb-42e7-9bf5-ed0f694de73d tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:23.271074 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9604b124-fbfb-42e7-9bf5-ed0f694de73d tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927" status: 200 len: 1408 microversion: 2.54 time: 0.094217 Sep 24 21:27:23.271991 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3103/6186] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:27:23 2022] GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 => generated 1408 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:27:24.298601 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-62f9d111-8c79-4a7f-b539-d0014983cfd5 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:24.299213 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-62f9d111-8c79-4a7f-b539-d0014983cfd5 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:24.306126 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62f9d111-8c79-4a7f-b539-d0014983cfd5 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:24.306649 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62f9d111-8c79-4a7f-b539-d0014983cfd5 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:24.307103 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62f9d111-8c79-4a7f-b539-d0014983cfd5 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:24.308307 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62f9d111-8c79-4a7f-b539-d0014983cfd5 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:24.308977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62f9d111-8c79-4a7f-b539-d0014983cfd5 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:24.309418 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62f9d111-8c79-4a7f-b539-d0014983cfd5 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:24.373369 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-62f9d111-8c79-4a7f-b539-d0014983cfd5 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:24.381626 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-62f9d111-8c79-4a7f-b539-d0014983cfd5 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:24.383130 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-62f9d111-8c79-4a7f-b539-d0014983cfd5 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:24.384320 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-62f9d111-8c79-4a7f-b539-d0014983cfd5 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927" status: 200 len: 1408 microversion: 2.54 time: 0.089815 Sep 24 21:27:24.384882 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3084/6187] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:27:24 2022] GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 => generated 1408 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:27:25.410329 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fd401796-1b0e-4b1a-aef5-8b1bc67b3e46 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:25.410971 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fd401796-1b0e-4b1a-aef5-8b1bc67b3e46 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:25.417798 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd401796-1b0e-4b1a-aef5-8b1bc67b3e46 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:25.418281 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd401796-1b0e-4b1a-aef5-8b1bc67b3e46 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:25.418754 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd401796-1b0e-4b1a-aef5-8b1bc67b3e46 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:25.419445 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd401796-1b0e-4b1a-aef5-8b1bc67b3e46 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:25.419895 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd401796-1b0e-4b1a-aef5-8b1bc67b3e46 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:25.420331 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fd401796-1b0e-4b1a-aef5-8b1bc67b3e46 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:25.486345 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fd401796-1b0e-4b1a-aef5-8b1bc67b3e46 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:25.494561 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fd401796-1b0e-4b1a-aef5-8b1bc67b3e46 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:25.496696 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fd401796-1b0e-4b1a-aef5-8b1bc67b3e46 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:25.497859 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fd401796-1b0e-4b1a-aef5-8b1bc67b3e46 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927" status: 200 len: 1408 microversion: 2.54 time: 0.091421 Sep 24 21:27:25.498418 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3104/6188] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:27:25 2022] GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 => generated 1408 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:27:26.525531 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-914f0b68-7eb4-4c34-b617-84643acc65e6 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:26.526091 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-914f0b68-7eb4-4c34-b617-84643acc65e6 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:26.533188 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-914f0b68-7eb4-4c34-b617-84643acc65e6 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:26.533673 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-914f0b68-7eb4-4c34-b617-84643acc65e6 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:26.534136 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-914f0b68-7eb4-4c34-b617-84643acc65e6 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:26.534849 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-914f0b68-7eb4-4c34-b617-84643acc65e6 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:26.535315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-914f0b68-7eb4-4c34-b617-84643acc65e6 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:26.535748 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-914f0b68-7eb4-4c34-b617-84643acc65e6 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:26.602943 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-914f0b68-7eb4-4c34-b617-84643acc65e6 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:26.612368 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-914f0b68-7eb4-4c34-b617-84643acc65e6 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:26.614009 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-914f0b68-7eb4-4c34-b617-84643acc65e6 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:26.615218 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-914f0b68-7eb4-4c34-b617-84643acc65e6 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927" status: 200 len: 1408 microversion: 2.54 time: 0.094422 Sep 24 21:27:26.615812 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3085/6189] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:27:26 2022] GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 => generated 1408 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:27:27.642062 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-948d253a-03d1-488e-90c2-4f5d8629d6a9 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:27.643570 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-948d253a-03d1-488e-90c2-4f5d8629d6a9 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:27.645694 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:27:27.646597 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=6 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:27:27.655082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-948d253a-03d1-488e-90c2-4f5d8629d6a9 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:27.655573 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-948d253a-03d1-488e-90c2-4f5d8629d6a9 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:27.656095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-948d253a-03d1-488e-90c2-4f5d8629d6a9 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:27.656906 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-948d253a-03d1-488e-90c2-4f5d8629d6a9 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:27.657669 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-948d253a-03d1-488e-90c2-4f5d8629d6a9 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:27.658261 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-948d253a-03d1-488e-90c2-4f5d8629d6a9 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:27.725575 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-948d253a-03d1-488e-90c2-4f5d8629d6a9 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:27.734456 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-948d253a-03d1-488e-90c2-4f5d8629d6a9 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:27.735928 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-948d253a-03d1-488e-90c2-4f5d8629d6a9 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:27.737089 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-948d253a-03d1-488e-90c2-4f5d8629d6a9 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927" status: 200 len: 1408 microversion: 2.54 time: 0.099238 Sep 24 21:27:27.737653 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3105/6190] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:27:27 2022] GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 => generated 1408 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:27:28.764918 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6ae709ea-0d1f-40c5-b528-5fd7a9567b96 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:28.765541 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6ae709ea-0d1f-40c5-b528-5fd7a9567b96 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:28.772550 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ae709ea-0d1f-40c5-b528-5fd7a9567b96 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:28.773037 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ae709ea-0d1f-40c5-b528-5fd7a9567b96 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:28.773478 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ae709ea-0d1f-40c5-b528-5fd7a9567b96 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:28.774177 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ae709ea-0d1f-40c5-b528-5fd7a9567b96 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:28.774665 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ae709ea-0d1f-40c5-b528-5fd7a9567b96 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:28.775098 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6ae709ea-0d1f-40c5-b528-5fd7a9567b96 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:28.841054 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6ae709ea-0d1f-40c5-b528-5fd7a9567b96 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:28.849495 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6ae709ea-0d1f-40c5-b528-5fd7a9567b96 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:28.850983 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6ae709ea-0d1f-40c5-b528-5fd7a9567b96 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:28.852163 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6ae709ea-0d1f-40c5-b528-5fd7a9567b96 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927" status: 200 len: 1408 microversion: 2.54 time: 0.092142 Sep 24 21:27:28.852744 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3086/6191] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:27:28 2022] GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 => generated 1408 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:27:29.879624 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8256f83e-36ba-40bc-9a73-d84c34d61147 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:29.880254 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8256f83e-36ba-40bc-9a73-d84c34d61147 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:29.887879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8256f83e-36ba-40bc-9a73-d84c34d61147 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:29.888311 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8256f83e-36ba-40bc-9a73-d84c34d61147 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:29.888753 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8256f83e-36ba-40bc-9a73-d84c34d61147 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:29.889986 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8256f83e-36ba-40bc-9a73-d84c34d61147 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:29.890159 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8256f83e-36ba-40bc-9a73-d84c34d61147 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:29.890635 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8256f83e-36ba-40bc-9a73-d84c34d61147 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:29.955355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8256f83e-36ba-40bc-9a73-d84c34d61147 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:29.963497 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8256f83e-36ba-40bc-9a73-d84c34d61147 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:29.964958 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8256f83e-36ba-40bc-9a73-d84c34d61147 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:29.966306 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8256f83e-36ba-40bc-9a73-d84c34d61147 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927" status: 200 len: 1408 microversion: 2.54 time: 0.090602 Sep 24 21:27:29.966916 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3106/6192] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:27:29 2022] GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 => generated 1408 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:27:30.992256 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4821b673-8c95-4822-8704-973bc0aa8c09 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:30.992804 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4821b673-8c95-4822-8704-973bc0aa8c09 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:31.000175 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4821b673-8c95-4822-8704-973bc0aa8c09 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:31.000670 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4821b673-8c95-4822-8704-973bc0aa8c09 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:31.001117 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4821b673-8c95-4822-8704-973bc0aa8c09 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:31.001849 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4821b673-8c95-4822-8704-973bc0aa8c09 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:31.002311 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4821b673-8c95-4822-8704-973bc0aa8c09 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:31.002770 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4821b673-8c95-4822-8704-973bc0aa8c09 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:31.071198 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4821b673-8c95-4822-8704-973bc0aa8c09 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:31.080063 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4821b673-8c95-4822-8704-973bc0aa8c09 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:31.081530 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4821b673-8c95-4822-8704-973bc0aa8c09 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:31.082732 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4821b673-8c95-4822-8704-973bc0aa8c09 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927" status: 200 len: 1408 microversion: 2.54 time: 0.094530 Sep 24 21:27:31.083296 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3087/6193] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:27:30 2022] GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 => generated 1408 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:27:32.109191 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4cd9e2bc-b857-41eb-a7d1-4115c1ca838d tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:32.109809 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4cd9e2bc-b857-41eb-a7d1-4115c1ca838d tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:32.116601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cd9e2bc-b857-41eb-a7d1-4115c1ca838d tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:32.117088 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cd9e2bc-b857-41eb-a7d1-4115c1ca838d tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:32.117533 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cd9e2bc-b857-41eb-a7d1-4115c1ca838d tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:32.118231 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cd9e2bc-b857-41eb-a7d1-4115c1ca838d tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:32.118750 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cd9e2bc-b857-41eb-a7d1-4115c1ca838d tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:32.119184 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cd9e2bc-b857-41eb-a7d1-4115c1ca838d tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:32.182602 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4cd9e2bc-b857-41eb-a7d1-4115c1ca838d tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:32.191367 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4cd9e2bc-b857-41eb-a7d1-4115c1ca838d tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:32.192829 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4cd9e2bc-b857-41eb-a7d1-4115c1ca838d tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:32.193999 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4cd9e2bc-b857-41eb-a7d1-4115c1ca838d tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927" status: 200 len: 1408 microversion: 2.54 time: 0.089348 Sep 24 21:27:32.194585 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3107/6194] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:27:32 2022] GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 => generated 1408 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:27:33.219590 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-560abb57-2bae-4127-9a7b-614f2cde8860 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:33.220208 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-560abb57-2bae-4127-9a7b-614f2cde8860 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:33.222186 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=14 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:27:33.229176 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-560abb57-2bae-4127-9a7b-614f2cde8860 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:33.229668 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-560abb57-2bae-4127-9a7b-614f2cde8860 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:33.230117 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-560abb57-2bae-4127-9a7b-614f2cde8860 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:33.230966 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-560abb57-2bae-4127-9a7b-614f2cde8860 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:33.231588 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-560abb57-2bae-4127-9a7b-614f2cde8860 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:33.232034 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-560abb57-2bae-4127-9a7b-614f2cde8860 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:33.297203 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-560abb57-2bae-4127-9a7b-614f2cde8860 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:33.306118 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-560abb57-2bae-4127-9a7b-614f2cde8860 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:33.307584 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-560abb57-2bae-4127-9a7b-614f2cde8860 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:33.308768 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-560abb57-2bae-4127-9a7b-614f2cde8860 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927" status: 200 len: 1408 microversion: 2.54 time: 0.093102 Sep 24 21:27:33.310249 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3088/6195] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:27:33 2022] GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 => generated 1408 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:27:34.335629 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ffe3b551-d0ad-4b74-b12c-5cf7046d14d7 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:34.336273 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ffe3b551-d0ad-4b74-b12c-5cf7046d14d7 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:34.343434 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ffe3b551-d0ad-4b74-b12c-5cf7046d14d7 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:34.343921 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ffe3b551-d0ad-4b74-b12c-5cf7046d14d7 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:34.344359 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ffe3b551-d0ad-4b74-b12c-5cf7046d14d7 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:34.345054 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ffe3b551-d0ad-4b74-b12c-5cf7046d14d7 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:34.345510 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ffe3b551-d0ad-4b74-b12c-5cf7046d14d7 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:34.345937 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ffe3b551-d0ad-4b74-b12c-5cf7046d14d7 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:34.410352 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ffe3b551-d0ad-4b74-b12c-5cf7046d14d7 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:34.418523 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ffe3b551-d0ad-4b74-b12c-5cf7046d14d7 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:34.420944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ffe3b551-d0ad-4b74-b12c-5cf7046d14d7 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:34.422115 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ffe3b551-d0ad-4b74-b12c-5cf7046d14d7 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927" status: 200 len: 1408 microversion: 2.54 time: 0.090503 Sep 24 21:27:34.422719 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3108/6196] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:27:34 2022] GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 => generated 1408 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:27:35.448024 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e6a3c145-d80f-4e19-b5f7-dcfcf63a9dc1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:35.448643 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e6a3c145-d80f-4e19-b5f7-dcfcf63a9dc1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:35.456477 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6a3c145-d80f-4e19-b5f7-dcfcf63a9dc1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:35.456959 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6a3c145-d80f-4e19-b5f7-dcfcf63a9dc1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:35.457396 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6a3c145-d80f-4e19-b5f7-dcfcf63a9dc1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:35.458084 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6a3c145-d80f-4e19-b5f7-dcfcf63a9dc1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:35.458561 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6a3c145-d80f-4e19-b5f7-dcfcf63a9dc1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:35.458989 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6a3c145-d80f-4e19-b5f7-dcfcf63a9dc1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:35.526301 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e6a3c145-d80f-4e19-b5f7-dcfcf63a9dc1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:35.534660 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e6a3c145-d80f-4e19-b5f7-dcfcf63a9dc1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:35.536105 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e6a3c145-d80f-4e19-b5f7-dcfcf63a9dc1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:35.537260 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e6a3c145-d80f-4e19-b5f7-dcfcf63a9dc1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927" status: 200 len: 1408 microversion: 2.54 time: 0.093258 Sep 24 21:27:35.537818 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3089/6197] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:27:35 2022] GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 => generated 1408 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:27:36.564168 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3c9db2c7-cbaf-4e18-a693-09575dd2c11d tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:36.564748 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3c9db2c7-cbaf-4e18-a693-09575dd2c11d tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:36.567480 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:27:36.573408 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c9db2c7-cbaf-4e18-a693-09575dd2c11d tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:36.573894 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c9db2c7-cbaf-4e18-a693-09575dd2c11d tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:36.574335 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c9db2c7-cbaf-4e18-a693-09575dd2c11d tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:36.575064 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c9db2c7-cbaf-4e18-a693-09575dd2c11d tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:36.576089 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c9db2c7-cbaf-4e18-a693-09575dd2c11d tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:36.576848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3c9db2c7-cbaf-4e18-a693-09575dd2c11d tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:36.646050 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3c9db2c7-cbaf-4e18-a693-09575dd2c11d tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:36.654932 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3c9db2c7-cbaf-4e18-a693-09575dd2c11d tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:36.656431 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3c9db2c7-cbaf-4e18-a693-09575dd2c11d tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:36.657603 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3c9db2c7-cbaf-4e18-a693-09575dd2c11d tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927" status: 200 len: 1408 microversion: 2.54 time: 0.097669 Sep 24 21:27:36.658163 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3109/6198] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:27:36 2022] GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 => generated 1408 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:27:37.684010 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b93bc75e-bc64-4410-9e28-2e1e27c6c18c tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:37.684635 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b93bc75e-bc64-4410-9e28-2e1e27c6c18c tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:37.691730 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b93bc75e-bc64-4410-9e28-2e1e27c6c18c tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:37.692220 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b93bc75e-bc64-4410-9e28-2e1e27c6c18c tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:37.692665 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b93bc75e-bc64-4410-9e28-2e1e27c6c18c tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:37.693369 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b93bc75e-bc64-4410-9e28-2e1e27c6c18c tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:37.693839 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b93bc75e-bc64-4410-9e28-2e1e27c6c18c tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:37.694274 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b93bc75e-bc64-4410-9e28-2e1e27c6c18c tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:37.757982 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b93bc75e-bc64-4410-9e28-2e1e27c6c18c tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:37.767026 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b93bc75e-bc64-4410-9e28-2e1e27c6c18c tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:37.768502 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b93bc75e-bc64-4410-9e28-2e1e27c6c18c tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:37.769679 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b93bc75e-bc64-4410-9e28-2e1e27c6c18c tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927" status: 200 len: 1408 microversion: 2.54 time: 0.089630 Sep 24 21:27:37.770248 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3090/6199] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:27:37 2022] GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 => generated 1408 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:27:38.799799 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fe2ce1f2-96d9-4d53-a8be-94417b50705b tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:38.800467 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fe2ce1f2-96d9-4d53-a8be-94417b50705b tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:38.808090 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fe2ce1f2-96d9-4d53-a8be-94417b50705b tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:38.808578 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fe2ce1f2-96d9-4d53-a8be-94417b50705b tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:38.809015 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fe2ce1f2-96d9-4d53-a8be-94417b50705b tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:38.809710 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fe2ce1f2-96d9-4d53-a8be-94417b50705b tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:38.810785 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fe2ce1f2-96d9-4d53-a8be-94417b50705b tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:38.811219 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fe2ce1f2-96d9-4d53-a8be-94417b50705b tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:38.882775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fe2ce1f2-96d9-4d53-a8be-94417b50705b tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:38.891620 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fe2ce1f2-96d9-4d53-a8be-94417b50705b tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:38.893383 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fe2ce1f2-96d9-4d53-a8be-94417b50705b tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:38.894586 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fe2ce1f2-96d9-4d53-a8be-94417b50705b tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927" status: 200 len: 1408 microversion: 2.54 time: 0.102066 Sep 24 21:27:38.895144 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3110/6200] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:27:38 2022] GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 => generated 1408 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:27:39.921370 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3b793f94-431f-4b27-ad23-c37b656723b4 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:39.921973 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3b793f94-431f-4b27-ad23-c37b656723b4 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:39.929033 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3b793f94-431f-4b27-ad23-c37b656723b4 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:39.929529 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3b793f94-431f-4b27-ad23-c37b656723b4 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:39.929974 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3b793f94-431f-4b27-ad23-c37b656723b4 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:39.930716 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3b793f94-431f-4b27-ad23-c37b656723b4 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:39.931179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3b793f94-431f-4b27-ad23-c37b656723b4 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:39.931616 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3b793f94-431f-4b27-ad23-c37b656723b4 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:40.000948 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3b793f94-431f-4b27-ad23-c37b656723b4 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:40.009337 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3b793f94-431f-4b27-ad23-c37b656723b4 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:40.010902 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3b793f94-431f-4b27-ad23-c37b656723b4 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:40.012527 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3b793f94-431f-4b27-ad23-c37b656723b4 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927" status: 200 len: 1408 microversion: 2.54 time: 0.095533 Sep 24 21:27:40.013858 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3091/6201] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:27:39 2022] GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 => generated 1408 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:27:41.045876 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-89504162-6310-4461-9695-6f5123be6627 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:41.046708 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-89504162-6310-4461-9695-6f5123be6627 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:41.053654 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-89504162-6310-4461-9695-6f5123be6627 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:41.054138 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-89504162-6310-4461-9695-6f5123be6627 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:41.054607 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-89504162-6310-4461-9695-6f5123be6627 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:41.055305 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-89504162-6310-4461-9695-6f5123be6627 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:41.055762 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-89504162-6310-4461-9695-6f5123be6627 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:41.056189 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-89504162-6310-4461-9695-6f5123be6627 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:41.119467 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-89504162-6310-4461-9695-6f5123be6627 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:41.128670 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-89504162-6310-4461-9695-6f5123be6627 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:41.130126 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-89504162-6310-4461-9695-6f5123be6627 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:41.131315 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-89504162-6310-4461-9695-6f5123be6627 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927" status: 200 len: 1408 microversion: 2.54 time: 0.090109 Sep 24 21:27:41.131867 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3111/6202] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:27:41 2022] GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 => generated 1408 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:27:42.157868 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-421292ab-b66b-4771-8c38-5f553064fe53 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:42.158485 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-421292ab-b66b-4771-8c38-5f553064fe53 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:42.161006 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:27:42.166359 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-421292ab-b66b-4771-8c38-5f553064fe53 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:42.166897 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-421292ab-b66b-4771-8c38-5f553064fe53 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:42.167364 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-421292ab-b66b-4771-8c38-5f553064fe53 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:42.168058 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-421292ab-b66b-4771-8c38-5f553064fe53 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:42.168512 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-421292ab-b66b-4771-8c38-5f553064fe53 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:42.168936 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-421292ab-b66b-4771-8c38-5f553064fe53 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:42.172730 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=67 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:27:42.238217 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-421292ab-b66b-4771-8c38-5f553064fe53 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:42.246350 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-421292ab-b66b-4771-8c38-5f553064fe53 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:42.247841 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-421292ab-b66b-4771-8c38-5f553064fe53 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:42.249627 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-421292ab-b66b-4771-8c38-5f553064fe53 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927" status: 200 len: 1408 microversion: 2.54 time: 0.096041 Sep 24 21:27:42.250190 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3092/6203] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:27:42 2022] GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 => generated 1408 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:27:43.275523 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5f81105b-ad73-4884-8002-21bd43b16fe2 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:43.276146 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5f81105b-ad73-4884-8002-21bd43b16fe2 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:43.283402 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f81105b-ad73-4884-8002-21bd43b16fe2 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:43.283890 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f81105b-ad73-4884-8002-21bd43b16fe2 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:43.284334 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f81105b-ad73-4884-8002-21bd43b16fe2 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:43.285037 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f81105b-ad73-4884-8002-21bd43b16fe2 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:43.285500 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f81105b-ad73-4884-8002-21bd43b16fe2 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:43.285931 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5f81105b-ad73-4884-8002-21bd43b16fe2 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:43.348977 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5f81105b-ad73-4884-8002-21bd43b16fe2 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:43.352410 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:27:43.357935 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5f81105b-ad73-4884-8002-21bd43b16fe2 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:43.359418 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5f81105b-ad73-4884-8002-21bd43b16fe2 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:43.360589 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5f81105b-ad73-4884-8002-21bd43b16fe2 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927" status: 200 len: 1408 microversion: 2.54 time: 0.089082 Sep 24 21:27:43.361149 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3112/6204] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:27:43 2022] GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 => generated 1408 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:27:44.386873 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-35d400fb-f863-4a9d-ae3b-adccbcd7f1d1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:44.387528 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-35d400fb-f863-4a9d-ae3b-adccbcd7f1d1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:44.395164 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35d400fb-f863-4a9d-ae3b-adccbcd7f1d1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:44.395657 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35d400fb-f863-4a9d-ae3b-adccbcd7f1d1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:44.396106 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35d400fb-f863-4a9d-ae3b-adccbcd7f1d1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:44.396810 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35d400fb-f863-4a9d-ae3b-adccbcd7f1d1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:44.397276 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35d400fb-f863-4a9d-ae3b-adccbcd7f1d1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:44.397714 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35d400fb-f863-4a9d-ae3b-adccbcd7f1d1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:44.464278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-35d400fb-f863-4a9d-ae3b-adccbcd7f1d1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:44.473181 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-35d400fb-f863-4a9d-ae3b-adccbcd7f1d1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:44.474689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-35d400fb-f863-4a9d-ae3b-adccbcd7f1d1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:44.475875 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-35d400fb-f863-4a9d-ae3b-adccbcd7f1d1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927" status: 200 len: 1408 microversion: 2.54 time: 0.093085 Sep 24 21:27:44.476438 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3093/6205] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:27:44 2022] GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 => generated 1408 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:27:45.503391 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5ea89026-a26c-4e36-9788-03b8d40ca247 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:45.504016 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5ea89026-a26c-4e36-9788-03b8d40ca247 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:45.511743 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ea89026-a26c-4e36-9788-03b8d40ca247 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:45.512236 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ea89026-a26c-4e36-9788-03b8d40ca247 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:45.512685 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ea89026-a26c-4e36-9788-03b8d40ca247 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:45.513383 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ea89026-a26c-4e36-9788-03b8d40ca247 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:45.513852 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ea89026-a26c-4e36-9788-03b8d40ca247 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:45.514914 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5ea89026-a26c-4e36-9788-03b8d40ca247 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:45.581163 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5ea89026-a26c-4e36-9788-03b8d40ca247 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:45.589358 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5ea89026-a26c-4e36-9788-03b8d40ca247 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:45.590861 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5ea89026-a26c-4e36-9788-03b8d40ca247 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:45.593003 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5ea89026-a26c-4e36-9788-03b8d40ca247 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927" status: 200 len: 1408 microversion: 2.54 time: 0.093602 Sep 24 21:27:45.593887 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3113/6206] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:27:45 2022] GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 => generated 1408 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:27:46.619605 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b91bd599-851f-4716-91c0-5b91ff7eb7d1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:46.620256 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b91bd599-851f-4716-91c0-5b91ff7eb7d1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:46.628594 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b91bd599-851f-4716-91c0-5b91ff7eb7d1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:46.629449 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b91bd599-851f-4716-91c0-5b91ff7eb7d1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:46.629908 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b91bd599-851f-4716-91c0-5b91ff7eb7d1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:46.630658 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b91bd599-851f-4716-91c0-5b91ff7eb7d1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:46.631128 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b91bd599-851f-4716-91c0-5b91ff7eb7d1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:46.631564 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b91bd599-851f-4716-91c0-5b91ff7eb7d1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:46.697890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b91bd599-851f-4716-91c0-5b91ff7eb7d1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:46.706162 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b91bd599-851f-4716-91c0-5b91ff7eb7d1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:46.707716 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b91bd599-851f-4716-91c0-5b91ff7eb7d1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:46.709100 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b91bd599-851f-4716-91c0-5b91ff7eb7d1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927" status: 200 len: 1408 microversion: 2.54 time: 0.093460 Sep 24 21:27:46.709754 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3094/6207] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:27:46 2022] GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 => generated 1408 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:27:47.736049 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-051095c6-8344-4415-add5-b6e91d30c2b1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:47.736652 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-051095c6-8344-4415-add5-b6e91d30c2b1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:47.743478 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-051095c6-8344-4415-add5-b6e91d30c2b1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:47.743965 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-051095c6-8344-4415-add5-b6e91d30c2b1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:47.744405 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-051095c6-8344-4415-add5-b6e91d30c2b1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:47.745097 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-051095c6-8344-4415-add5-b6e91d30c2b1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:47.745551 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-051095c6-8344-4415-add5-b6e91d30c2b1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:47.745977 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-051095c6-8344-4415-add5-b6e91d30c2b1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:47.809388 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-051095c6-8344-4415-add5-b6e91d30c2b1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:47.818688 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-051095c6-8344-4415-add5-b6e91d30c2b1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:47.820116 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-051095c6-8344-4415-add5-b6e91d30c2b1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:47.821268 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-051095c6-8344-4415-add5-b6e91d30c2b1 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927" status: 200 len: 1408 microversion: 2.54 time: 0.090052 Sep 24 21:27:47.821825 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3114/6208] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:27:47 2022] GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 => generated 1408 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:27:48.849404 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-64595b06-3165-4109-b6c6-55144df36695 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:48.850020 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-64595b06-3165-4109-b6c6-55144df36695 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:48.856919 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-64595b06-3165-4109-b6c6-55144df36695 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:48.857396 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-64595b06-3165-4109-b6c6-55144df36695 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:48.857834 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-64595b06-3165-4109-b6c6-55144df36695 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:48.859628 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-64595b06-3165-4109-b6c6-55144df36695 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:48.860093 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-64595b06-3165-4109-b6c6-55144df36695 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:48.860523 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-64595b06-3165-4109-b6c6-55144df36695 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:48.927856 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-64595b06-3165-4109-b6c6-55144df36695 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:48.936305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-64595b06-3165-4109-b6c6-55144df36695 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:48.937774 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-64595b06-3165-4109-b6c6-55144df36695 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:48.938972 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-64595b06-3165-4109-b6c6-55144df36695 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927" status: 200 len: 1408 microversion: 2.54 time: 0.093554 Sep 24 21:27:48.939548 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3095/6209] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:27:48 2022] GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 => generated 1408 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:27:49.965210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-abdf1db5-ff22-4655-9733-878f41361ccc tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:49.965837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-abdf1db5-ff22-4655-9733-878f41361ccc tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:49.973091 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-abdf1db5-ff22-4655-9733-878f41361ccc tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:49.973586 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-abdf1db5-ff22-4655-9733-878f41361ccc tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:49.974034 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-abdf1db5-ff22-4655-9733-878f41361ccc tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:49.974766 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-abdf1db5-ff22-4655-9733-878f41361ccc tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:49.975237 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-abdf1db5-ff22-4655-9733-878f41361ccc tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:49.975676 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-abdf1db5-ff22-4655-9733-878f41361ccc tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:50.042240 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-abdf1db5-ff22-4655-9733-878f41361ccc tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:50.051016 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-abdf1db5-ff22-4655-9733-878f41361ccc tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:50.052468 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-abdf1db5-ff22-4655-9733-878f41361ccc tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:50.053629 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-abdf1db5-ff22-4655-9733-878f41361ccc tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927" status: 200 len: 1414 microversion: 2.54 time: 0.092389 Sep 24 21:27:50.054581 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3115/6210] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:27:49 2022] GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 => generated 1414 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:27:51.081157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fa87de89-bf04-4f00-9b43-4e19bc605a97 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:51.081712 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fa87de89-bf04-4f00-9b43-4e19bc605a97 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:51.088749 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fa87de89-bf04-4f00-9b43-4e19bc605a97 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:51.089240 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fa87de89-bf04-4f00-9b43-4e19bc605a97 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:51.089687 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fa87de89-bf04-4f00-9b43-4e19bc605a97 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:51.090394 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fa87de89-bf04-4f00-9b43-4e19bc605a97 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:51.090886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fa87de89-bf04-4f00-9b43-4e19bc605a97 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:51.091325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fa87de89-bf04-4f00-9b43-4e19bc605a97 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:51.154371 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fa87de89-bf04-4f00-9b43-4e19bc605a97 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:51.162649 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fa87de89-bf04-4f00-9b43-4e19bc605a97 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:51.164122 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fa87de89-bf04-4f00-9b43-4e19bc605a97 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:51.165323 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fa87de89-bf04-4f00-9b43-4e19bc605a97 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927" status: 200 len: 1414 microversion: 2.54 time: 0.088782 Sep 24 21:27:51.165899 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3096/6211] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:27:51 2022] GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 => generated 1414 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:27:52.191727 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-aea54884-b164-4324-a339-db2372177d0b tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:52.192262 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-aea54884-b164-4324-a339-db2372177d0b tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:52.199246 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aea54884-b164-4324-a339-db2372177d0b tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:52.199733 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aea54884-b164-4324-a339-db2372177d0b tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:52.200176 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aea54884-b164-4324-a339-db2372177d0b tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:52.200877 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aea54884-b164-4324-a339-db2372177d0b tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:52.201337 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aea54884-b164-4324-a339-db2372177d0b tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:52.201772 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aea54884-b164-4324-a339-db2372177d0b tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:52.272367 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-aea54884-b164-4324-a339-db2372177d0b tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:52.281455 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-aea54884-b164-4324-a339-db2372177d0b tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:52.282938 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-aea54884-b164-4324-a339-db2372177d0b tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:52.284109 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-aea54884-b164-4324-a339-db2372177d0b tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927" status: 200 len: 1414 microversion: 2.54 time: 0.096433 Sep 24 21:27:52.284671 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3116/6212] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:27:52 2022] GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 => generated 1414 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 21:27:53.310615 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cb0c0d92-8a61-4fe9-8351-e2ebdb008101 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:53.311312 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cb0c0d92-8a61-4fe9-8351-e2ebdb008101 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:53.318066 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb0c0d92-8a61-4fe9-8351-e2ebdb008101 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:53.318571 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb0c0d92-8a61-4fe9-8351-e2ebdb008101 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:53.319009 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb0c0d92-8a61-4fe9-8351-e2ebdb008101 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:53.319737 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb0c0d92-8a61-4fe9-8351-e2ebdb008101 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:53.320190 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb0c0d92-8a61-4fe9-8351-e2ebdb008101 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:53.320646 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb0c0d92-8a61-4fe9-8351-e2ebdb008101 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:53.386890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cb0c0d92-8a61-4fe9-8351-e2ebdb008101 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:53.395689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cb0c0d92-8a61-4fe9-8351-e2ebdb008101 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:53.397152 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cb0c0d92-8a61-4fe9-8351-e2ebdb008101 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:53.398323 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cb0c0d92-8a61-4fe9-8351-e2ebdb008101 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927" status: 200 len: 1399 microversion: 2.54 time: 0.091901 Sep 24 21:27:53.398932 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3097/6213] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:27:53 2022] GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 => generated 1399 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:27:53.424864 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4fe5b338-acf9-417b-bd34-4a967ed81c2b tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '.version_select at 0x7f4b074c1c10>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:53.444562 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4fe5b338-acf9-417b-bd34-4a967ed81c2b tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1106318946" status: 204 len: 0 microversion: 2.54 time: 0.024154 Sep 24 21:27:53.445145 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3117/6214] 10.222.0.52 () {60 vars in 1319 bytes} [Sat Sep 24 21:27:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1106318946 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 24 21:27:53.461512 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3deab508-62e5-49f1-97ca-72897fb3c827 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:53.462017 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3deab508-62e5-49f1-97ca-72897fb3c827 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:53.469021 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3deab508-62e5-49f1-97ca-72897fb3c827 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:53.469512 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3deab508-62e5-49f1-97ca-72897fb3c827 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:53.469971 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3deab508-62e5-49f1-97ca-72897fb3c827 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:53.470696 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3deab508-62e5-49f1-97ca-72897fb3c827 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:53.471157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3deab508-62e5-49f1-97ca-72897fb3c827 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:53.471590 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3deab508-62e5-49f1-97ca-72897fb3c827 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:53.500019 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3deab508-62e5-49f1-97ca-72897fb3c827 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:27:53.574390 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3deab508-62e5-49f1-97ca-72897fb3c827 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "DELETE /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927" status: 204 len: 0 microversion: 2.54 time: 0.116519 Sep 24 21:27:53.578915 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3098/6215] 10.222.0.52 () {60 vars in 1280 bytes} [Sat Sep 24 21:27:53 2022] DELETE /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 24 21:27:53.585428 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cf9a9c3c-ffa8-4288-a087-b32c188ac2ff tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:53.586045 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cf9a9c3c-ffa8-4288-a087-b32c188ac2ff tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:53.594516 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf9a9c3c-ffa8-4288-a087-b32c188ac2ff tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:53.595411 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf9a9c3c-ffa8-4288-a087-b32c188ac2ff tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:53.595858 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf9a9c3c-ffa8-4288-a087-b32c188ac2ff tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:53.596562 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf9a9c3c-ffa8-4288-a087-b32c188ac2ff tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:53.597025 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf9a9c3c-ffa8-4288-a087-b32c188ac2ff tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:53.597451 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf9a9c3c-ffa8-4288-a087-b32c188ac2ff tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:53.688617 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cf9a9c3c-ffa8-4288-a087-b32c188ac2ff tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:53.696888 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cf9a9c3c-ffa8-4288-a087-b32c188ac2ff tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:53.698366 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cf9a9c3c-ffa8-4288-a087-b32c188ac2ff tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:53.699609 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cf9a9c3c-ffa8-4288-a087-b32c188ac2ff tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927" status: 200 len: 1405 microversion: 2.54 time: 0.119516 Sep 24 21:27:53.700176 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3118/6216] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:27:53 2022] GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 => generated 1405 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:27:54.727174 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4191da9e-ed3b-41b2-aac7-63dca0a9dd95 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:54.727892 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4191da9e-ed3b-41b2-aac7-63dca0a9dd95 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:54.735625 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4191da9e-ed3b-41b2-aac7-63dca0a9dd95 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:54.736117 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4191da9e-ed3b-41b2-aac7-63dca0a9dd95 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:54.736559 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4191da9e-ed3b-41b2-aac7-63dca0a9dd95 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:54.737262 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4191da9e-ed3b-41b2-aac7-63dca0a9dd95 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:54.737719 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4191da9e-ed3b-41b2-aac7-63dca0a9dd95 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:54.738149 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4191da9e-ed3b-41b2-aac7-63dca0a9dd95 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:54.805379 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4191da9e-ed3b-41b2-aac7-63dca0a9dd95 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:54.813641 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4191da9e-ed3b-41b2-aac7-63dca0a9dd95 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:54.815139 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4191da9e-ed3b-41b2-aac7-63dca0a9dd95 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7309e1efde7d4f72a36d8213766e67e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434f7c63a1b34202b60a826e930d7d9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:27:54.816305 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4191da9e-ed3b-41b2-aac7-63dca0a9dd95 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927" status: 200 len: 1405 microversion: 2.54 time: 0.093553 Sep 24 21:27:54.816873 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3099/6217] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:27:54 2022] GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 => generated 1405 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 21:27:55.841437 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-acf17646-1ec7-4c2f-8213-6204a99c73e6 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:27:55.842068 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-acf17646-1ec7-4c2f-8213-6204a99c73e6 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] [instance: 32a0ee60-fcdf-4079-8e4b-a5d607119927] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:27:55.849177 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-acf17646-1ec7-4c2f-8213-6204a99c73e6 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:55.849672 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-acf17646-1ec7-4c2f-8213-6204a99c73e6 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:55.850123 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-acf17646-1ec7-4c2f-8213-6204a99c73e6 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:55.850936 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-acf17646-1ec7-4c2f-8213-6204a99c73e6 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:27:55.851403 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-acf17646-1ec7-4c2f-8213-6204a99c73e6 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:27:55.851842 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-acf17646-1ec7-4c2f-8213-6204a99c73e6 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:27:55.866225 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-acf17646-1ec7-4c2f-8213-6204a99c73e6 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] HTTP exception thrown: Instance 32a0ee60-fcdf-4079-8e4b-a5d607119927 could not be found. Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-acf17646-1ec7-4c2f-8213-6204a99c73e6 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Request method failure captured: Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 HTTP/1.1 Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3YzPmwQCaN-NZSazcWmZS--YMYwE1yAmR0TE9QS07DY4IbpsZLAwuLcUsTyZHkoBYB3wrYW7RhmAB_ixsYj1Y7uTjhHAc-psgCJpenopbM0GTgX8ctWxqFy_NWnjCYpMlNSiZYwRvTpILCIK5pLSddL93Tu860YXNmrck0VUNBXvck Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: X-Openstack-Nova-Api-Version: 2.54 Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 434f7c63a1b34202b60a826e930d7d9d Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServerShowV254Test-1312408538 Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/434f7c63a1b34202b60a826e930d7d9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_434f7c63a1b34202b60a826e930d7d9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/434f7c63a1b34202b60a826e930d7d9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/434f7c63a1b34202b60a826e930d7d9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServerShowV254Test-1312408538 Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 434f7c63a1b34202b60a826e930d7d9d Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServerShowV254Test-1312408538 Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServerShowV254Test-1312408538-project Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 7309e1efde7d4f72a36d8213766e67e4 Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServerShowV254Test-1312408538-project Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 32a0ee60-fcdf-4079-8e4b-a5d607119927 could not be found. Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '32a0ee60-fcdf-4079-8e4b-a5d607119927'} Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32a0ee60-fcdf-4079-8e4b-a5d607119927 could not be found. Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32a0ee60-fcdf-4079-8e4b-a5d607119927 could not be found. Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:27:55.867801 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:27:55.873843 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:27:55.873843 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:27:55.873843 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:27:55.873843 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:27:55.873843 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:27:55.873843 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32a0ee60-fcdf-4079-8e4b-a5d607119927 could not be found. Sep 24 21:27:55.873843 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:27:55.873843 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-acf17646-1ec7-4c2f-8213-6204a99c73e6 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] Returning 404 to user: Instance 32a0ee60-fcdf-4079-8e4b-a5d607119927 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:27:55.873843 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-acf17646-1ec7-4c2f-8213-6204a99c73e6 tempest-ServerShowV254Test-1312408538 tempest-ServerShowV254Test-1312408538-project] 10.222.0.52 "GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927" status: 404 len: 111 microversion: 2.54 time: 0.031872 Sep 24 21:27:55.873843 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3119/6218] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 21:27:55 2022] GET /compute/v2.1/servers/32a0ee60-fcdf-4079-8e4b-a5d607119927 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:30:15.829722 ncdv-master-1 devstack@n-api.service[140516]: ERROR oslo.messaging._drivers.impl_rabbit [-] [75d0407e-7b02-4bce-a3f1-1c13562673e6] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 24 21:30:15.830653 ncdv-master-1 devstack@n-api.service[140516]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ec046047-61d1-42c1-9e5b-9695ac0fd1f9] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 24 21:30:15.831498 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:30:15.832353 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:30:15.833519 ncdv-master-1 devstack@n-api.service[140516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 24 21:30:15.833685 ncdv-master-1 devstack@n-api.service[140516]: Sat Sep 24 21:30:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.52) !!! Sep 24 21:30:15.835455 ncdv-master-1 devstack@n-api.service[140516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 24 21:30:15.835573 ncdv-master-1 devstack@n-api.service[140516]: Sat Sep 24 21:30:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.52) !!! Sep 24 21:30:15.836620 ncdv-master-1 devstack@n-api.service[140516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 24 21:30:15.836721 ncdv-master-1 devstack@n-api.service[140516]: Sat Sep 24 21:30:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.52) !!! Sep 24 21:30:16.042868 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bf0d9b58-5dc1-4b73-ac1d-4fb957e615c7 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Action: 'create', calling method: .version_select at 0x7f4b07617ee0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-417999275", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0HIiVahapt9Hrm6FCWz68+K3n4wnghdCsOHJIpUtdCUtOjW7xGdCFkDdb9Zj+JjkLSPDwJad1L5j1QxtoBVvh1G/ozxrRlMy7glyCaOhpTGU4V2PrCUrimHUzhsdzA3g=="}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:30:16.061451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-bf0d9b58-5dc1-4b73-ac1d-4fb957e615c7 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Getting quotas for project a99294b9428b4abc991cc9957afe73a0. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:30:16.066590 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-bf0d9b58-5dc1-4b73-ac1d-4fb957e615c7 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Getting quotas for user fefd5257355844e590c72435f4c45024 and project a99294b9428b4abc991cc9957afe73a0. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:30:16.098728 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bf0d9b58-5dc1-4b73-ac1d-4fb957e615c7 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.270804 Sep 24 21:30:16.099337 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3100/6219] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 21:30:15 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:30:21.914938 ncdv-master-1 devstack@n-api.service[140517]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e1087534-8c05-43ce-a203-528e6b6bc7c7] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 24 21:30:21.918866 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-74299395-6598-4b61-bfe9-4f217269a1bd tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-766962720-access_point-1595691372", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "86f1fee2-8634-47f2-965b-db7a83cde519"}], "key_name": "tempest-TestSecurityGroupsBasicOps-417999275", "security_groups": [{"name": "tempest-secgroup_access--1093716059"}, {"name": "tempest-secgroup_general--2058618247"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:30:21.932169 ncdv-master-1 devstack@n-api.service[140517]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aa974483-35f8-468d-af64-c307bf04d159] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 24 21:30:21.933180 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:30:21.934442 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=32 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:30:21.937450 ncdv-master-1 devstack@n-api.service[140517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 24 21:30:21.937600 ncdv-master-1 devstack@n-api.service[140517]: Sat Sep 24 21:30:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Sep 24 21:30:21.939360 ncdv-master-1 devstack@n-api.service[140517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 21:30:21.939683 ncdv-master-1 devstack@n-api.service[140517]: Sat Sep 24 21:30:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Sep 24 21:30:22.276698 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-74299395-6598-4b61-bfe9-4f217269a1bd tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] validate_networks() for [('86f1fee2-8634-47f2-965b-db7a83cde519', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:30:22.821245 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-74299395-6598-4b61-bfe9-4f217269a1bd tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:30:22.821940 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-74299395-6598-4b61-bfe9-4f217269a1bd tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:30:22.822763 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-74299395-6598-4b61-bfe9-4f217269a1bd tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:30:22.823269 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-74299395-6598-4b61-bfe9-4f217269a1bd tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:30:22.823788 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-74299395-6598-4b61-bfe9-4f217269a1bd tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:30:22.833091 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-74299395-6598-4b61-bfe9-4f217269a1bd tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:30:22.833713 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-74299395-6598-4b61-bfe9-4f217269a1bd tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:30:22.835087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-74299395-6598-4b61-bfe9-4f217269a1bd tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:30:22.835940 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-74299395-6598-4b61-bfe9-4f217269a1bd tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:30:22.836509 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-74299395-6598-4b61-bfe9-4f217269a1bd tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:30:22.837043 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-74299395-6598-4b61-bfe9-4f217269a1bd tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:30:22.858198 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-74299395-6598-4b61-bfe9-4f217269a1bd tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Getting quotas for project a99294b9428b4abc991cc9957afe73a0. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:30:22.863705 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-74299395-6598-4b61-bfe9-4f217269a1bd tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Getting quotas for user fefd5257355844e590c72435f4c45024 and project a99294b9428b4abc991cc9957afe73a0. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:30:22.876968 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-74299395-6598-4b61-bfe9-4f217269a1bd tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:30:22.878892 ncdv-master-1 devstack@n-api.service[140517]: WARNING nova.utils [None req-74299395-6598-4b61-bfe9-4f217269a1bd tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-766962720-access_point-1595691372 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-766962720-acc Sep 24 21:30:22.879680 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-74299395-6598-4b61-bfe9-4f217269a1bd tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] [instance: 58350d4b-9d77-4cd6-ae1b-221e729c20be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:30:22.924684 ncdv-master-1 devstack@n-api.service[140517]: INFO oslo.messaging._drivers.impl_rabbit [-] [e1087534-8c05-43ce-a203-528e6b6bc7c7] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 55606. Sep 24 21:30:22.947597 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-74299395-6598-4b61-bfe9-4f217269a1bd tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 1.034895 Sep 24 21:30:22.948564 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3120/6220] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:30:21 2022] POST /compute/v2.1/servers => generated 458 bytes in 1036 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:30:22.968611 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2e9625fc-e6fb-428c-98f7-7dfed5871a0f tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:30:22.969285 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2e9625fc-e6fb-428c-98f7-7dfed5871a0f tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] [instance: 58350d4b-9d77-4cd6-ae1b-221e729c20be] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:30:22.988140 ncdv-master-1 devstack@n-api.service[140516]: INFO oslo.messaging._drivers.impl_rabbit [-] [75d0407e-7b02-4bce-a3f1-1c13562673e6] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 55612. Sep 24 21:30:23.003196 ncdv-master-1 devstack@n-api.service[140516]: INFO oslo.messaging._drivers.impl_rabbit [-] [ec046047-61d1-42c1-9e5b-9695ac0fd1f9] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 55614. Sep 24 21:30:23.109215 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2e9625fc-e6fb-428c-98f7-7dfed5871a0f tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefd5257355844e590c72435f4c45024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99294b9428b4abc991cc9957afe73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:30:23.117463 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2e9625fc-e6fb-428c-98f7-7dfed5871a0f tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] 10.222.0.52 "GET /compute/v2.1/servers/58350d4b-9d77-4cd6-ae1b-221e729c20be" status: 200 len: 1293 microversion: 2.1 time: 0.158488 Sep 24 21:30:23.118330 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3101/6221] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:30:22 2022] GET /compute/v2.1/servers/58350d4b-9d77-4cd6-ae1b-221e729c20be => generated 1293 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:30:24.148424 ncdv-master-1 devstack@n-api.service[140517]: INFO oslo.messaging._drivers.impl_rabbit [-] [aa974483-35f8-468d-af64-c307bf04d159] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 55608. Sep 24 21:30:24.156558 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-84fa60a1-0d4d-429e-8f4c-aa7367c92756 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:30:24.157205 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-84fa60a1-0d4d-429e-8f4c-aa7367c92756 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] [instance: 58350d4b-9d77-4cd6-ae1b-221e729c20be] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:30:24.166262 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84fa60a1-0d4d-429e-8f4c-aa7367c92756 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:30:24.167524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84fa60a1-0d4d-429e-8f4c-aa7367c92756 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:30:24.168001 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84fa60a1-0d4d-429e-8f4c-aa7367c92756 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:30:24.168735 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84fa60a1-0d4d-429e-8f4c-aa7367c92756 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:30:24.169461 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84fa60a1-0d4d-429e-8f4c-aa7367c92756 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:30:24.170267 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84fa60a1-0d4d-429e-8f4c-aa7367c92756 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:30:24.249433 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-84fa60a1-0d4d-429e-8f4c-aa7367c92756 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefd5257355844e590c72435f4c45024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99294b9428b4abc991cc9957afe73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:30:24.258560 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-84fa60a1-0d4d-429e-8f4c-aa7367c92756 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] 10.222.0.52 "GET /compute/v2.1/servers/58350d4b-9d77-4cd6-ae1b-221e729c20be" status: 200 len: 1363 microversion: 2.1 time: 0.120050 Sep 24 21:30:24.259413 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3121/6222] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:30:24 2022] GET /compute/v2.1/servers/58350d4b-9d77-4cd6-ae1b-221e729c20be => generated 1363 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:30:25.288846 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0bc856cd-78e3-425c-a776-7ebad5c89321 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:30:25.289458 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0bc856cd-78e3-425c-a776-7ebad5c89321 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] [instance: 58350d4b-9d77-4cd6-ae1b-221e729c20be] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:30:25.297135 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0bc856cd-78e3-425c-a776-7ebad5c89321 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:30:25.297625 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0bc856cd-78e3-425c-a776-7ebad5c89321 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:30:25.298065 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0bc856cd-78e3-425c-a776-7ebad5c89321 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:30:25.298813 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0bc856cd-78e3-425c-a776-7ebad5c89321 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:30:25.299263 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0bc856cd-78e3-425c-a776-7ebad5c89321 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:30:25.299693 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0bc856cd-78e3-425c-a776-7ebad5c89321 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:30:25.539466 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0bc856cd-78e3-425c-a776-7ebad5c89321 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefd5257355844e590c72435f4c45024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99294b9428b4abc991cc9957afe73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:30:25.547317 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0bc856cd-78e3-425c-a776-7ebad5c89321 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] 10.222.0.52 "GET /compute/v2.1/servers/58350d4b-9d77-4cd6-ae1b-221e729c20be" status: 200 len: 1471 microversion: 2.1 time: 0.263357 Sep 24 21:30:25.547895 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3102/6223] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:30:25 2022] GET /compute/v2.1/servers/58350d4b-9d77-4cd6-ae1b-221e729c20be => generated 1471 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:30:25.756922 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-bd3c2835-85ce-4c1c-b523-d3336493156a req-5b5d2932-ff46-4a1c-858e-d780c8fbade2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58350d4b-9d77-4cd6-ae1b-221e729c20be", "tag": "b1e353fa-b422-46aa-b671-be7460af1450"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:30:25.767341 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-bd3c2835-85ce-4c1c-b523-d3336493156a req-5b5d2932-ff46-4a1c-858e-d780c8fbade2 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:30:25.767897 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-bd3c2835-85ce-4c1c-b523-d3336493156a req-5b5d2932-ff46-4a1c-858e-d780c8fbade2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:30:25.768412 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-bd3c2835-85ce-4c1c-b523-d3336493156a req-5b5d2932-ff46-4a1c-858e-d780c8fbade2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:30:25.780709 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-bd3c2835-85ce-4c1c-b523-d3336493156a req-5b5d2932-ff46-4a1c-858e-d780c8fbade2 service nova] Creating event network-changed:b1e353fa-b422-46aa-b671-be7460af1450 for instance 58350d4b-9d77-4cd6-ae1b-221e729c20be on nch1-master-1 Sep 24 21:30:25.786887 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-bd3c2835-85ce-4c1c-b523-d3336493156a req-5b5d2932-ff46-4a1c-858e-d780c8fbade2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110885 Sep 24 21:30:25.787927 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3122/6224] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:30:26.571848 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9284c7ce-e1b6-4121-a328-0d230856edb6 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:30:26.572470 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9284c7ce-e1b6-4121-a328-0d230856edb6 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] [instance: 58350d4b-9d77-4cd6-ae1b-221e729c20be] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:30:26.580676 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9284c7ce-e1b6-4121-a328-0d230856edb6 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:30:26.581439 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9284c7ce-e1b6-4121-a328-0d230856edb6 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:30:26.581890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9284c7ce-e1b6-4121-a328-0d230856edb6 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:30:26.582635 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9284c7ce-e1b6-4121-a328-0d230856edb6 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:30:26.583098 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9284c7ce-e1b6-4121-a328-0d230856edb6 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:30:26.583543 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9284c7ce-e1b6-4121-a328-0d230856edb6 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:30:26.728100 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9284c7ce-e1b6-4121-a328-0d230856edb6 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefd5257355844e590c72435f4c45024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99294b9428b4abc991cc9957afe73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:30:26.736412 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9284c7ce-e1b6-4121-a328-0d230856edb6 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] 10.222.0.52 "GET /compute/v2.1/servers/58350d4b-9d77-4cd6-ae1b-221e729c20be" status: 200 len: 1471 microversion: 2.1 time: 0.168683 Sep 24 21:30:26.736990 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3103/6225] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:30:26 2022] GET /compute/v2.1/servers/58350d4b-9d77-4cd6-ae1b-221e729c20be => generated 1471 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:30:27.761598 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9a6f3dbb-660c-4fd5-8bd1-3372ae6fca29 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:30:27.762943 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9a6f3dbb-660c-4fd5-8bd1-3372ae6fca29 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] [instance: 58350d4b-9d77-4cd6-ae1b-221e729c20be] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:30:27.769162 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a6f3dbb-660c-4fd5-8bd1-3372ae6fca29 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:30:27.769651 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a6f3dbb-660c-4fd5-8bd1-3372ae6fca29 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:30:27.770164 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a6f3dbb-660c-4fd5-8bd1-3372ae6fca29 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:30:27.771087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a6f3dbb-660c-4fd5-8bd1-3372ae6fca29 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:30:27.771964 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a6f3dbb-660c-4fd5-8bd1-3372ae6fca29 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:30:27.772435 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a6f3dbb-660c-4fd5-8bd1-3372ae6fca29 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:30:27.920891 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9a6f3dbb-660c-4fd5-8bd1-3372ae6fca29 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefd5257355844e590c72435f4c45024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99294b9428b4abc991cc9957afe73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:30:27.928871 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9a6f3dbb-660c-4fd5-8bd1-3372ae6fca29 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] 10.222.0.52 "GET /compute/v2.1/servers/58350d4b-9d77-4cd6-ae1b-221e729c20be" status: 200 len: 1471 microversion: 2.1 time: 0.173153 Sep 24 21:30:27.930069 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3123/6226] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:30:27 2022] GET /compute/v2.1/servers/58350d4b-9d77-4cd6-ae1b-221e729c20be => generated 1471 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:30:28.953593 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a033911e-b3d1-4275-a556-91abaec8805c tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:30:28.954324 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a033911e-b3d1-4275-a556-91abaec8805c tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] [instance: 58350d4b-9d77-4cd6-ae1b-221e729c20be] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:30:28.962417 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a033911e-b3d1-4275-a556-91abaec8805c tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:30:28.962943 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a033911e-b3d1-4275-a556-91abaec8805c tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:30:28.963381 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a033911e-b3d1-4275-a556-91abaec8805c tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:30:28.964081 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a033911e-b3d1-4275-a556-91abaec8805c tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:30:28.964566 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a033911e-b3d1-4275-a556-91abaec8805c tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:30:28.964992 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a033911e-b3d1-4275-a556-91abaec8805c tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:30:29.108264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a033911e-b3d1-4275-a556-91abaec8805c tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefd5257355844e590c72435f4c45024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99294b9428b4abc991cc9957afe73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:30:29.115936 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a033911e-b3d1-4275-a556-91abaec8805c tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] 10.222.0.52 "GET /compute/v2.1/servers/58350d4b-9d77-4cd6-ae1b-221e729c20be" status: 200 len: 1471 microversion: 2.1 time: 0.166309 Sep 24 21:30:29.116506 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3104/6227] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:30:28 2022] GET /compute/v2.1/servers/58350d4b-9d77-4cd6-ae1b-221e729c20be => generated 1471 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:30:30.140668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b6575dbf-83dc-47ee-bcdd-583ad8fc20d9 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:30:30.141665 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b6575dbf-83dc-47ee-bcdd-583ad8fc20d9 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] [instance: 58350d4b-9d77-4cd6-ae1b-221e729c20be] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:30:30.149879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b6575dbf-83dc-47ee-bcdd-583ad8fc20d9 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:30:30.150454 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b6575dbf-83dc-47ee-bcdd-583ad8fc20d9 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:30:30.151025 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b6575dbf-83dc-47ee-bcdd-583ad8fc20d9 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:30:30.151812 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b6575dbf-83dc-47ee-bcdd-583ad8fc20d9 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:30:30.152412 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b6575dbf-83dc-47ee-bcdd-583ad8fc20d9 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:30:30.153179 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b6575dbf-83dc-47ee-bcdd-583ad8fc20d9 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:30:30.296657 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b6575dbf-83dc-47ee-bcdd-583ad8fc20d9 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefd5257355844e590c72435f4c45024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99294b9428b4abc991cc9957afe73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:30:30.304348 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b6575dbf-83dc-47ee-bcdd-583ad8fc20d9 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] 10.222.0.52 "GET /compute/v2.1/servers/58350d4b-9d77-4cd6-ae1b-221e729c20be" status: 200 len: 1471 microversion: 2.1 time: 0.168955 Sep 24 21:30:30.304920 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3124/6228] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:30:30 2022] GET /compute/v2.1/servers/58350d4b-9d77-4cd6-ae1b-221e729c20be => generated 1471 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:30:31.327463 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dc290c25-f7eb-426c-afe6-9b2f35b05c29 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:30:31.328077 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-dc290c25-f7eb-426c-afe6-9b2f35b05c29 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] [instance: 58350d4b-9d77-4cd6-ae1b-221e729c20be] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:30:31.335199 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc290c25-f7eb-426c-afe6-9b2f35b05c29 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:30:31.336337 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc290c25-f7eb-426c-afe6-9b2f35b05c29 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:30:31.336783 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc290c25-f7eb-426c-afe6-9b2f35b05c29 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:30:31.337491 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc290c25-f7eb-426c-afe6-9b2f35b05c29 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:30:31.337952 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc290c25-f7eb-426c-afe6-9b2f35b05c29 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:30:31.338382 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc290c25-f7eb-426c-afe6-9b2f35b05c29 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:30:31.487929 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-dc290c25-f7eb-426c-afe6-9b2f35b05c29 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefd5257355844e590c72435f4c45024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99294b9428b4abc991cc9957afe73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:30:31.496302 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-dc290c25-f7eb-426c-afe6-9b2f35b05c29 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] 10.222.0.52 "GET /compute/v2.1/servers/58350d4b-9d77-4cd6-ae1b-221e729c20be" status: 200 len: 1471 microversion: 2.1 time: 0.172757 Sep 24 21:30:31.496882 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3105/6229] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:30:31 2022] GET /compute/v2.1/servers/58350d4b-9d77-4cd6-ae1b-221e729c20be => generated 1471 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:30:32.518969 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0d489c65-42c5-418c-b208-9d79b2890dcc tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:30:32.519593 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0d489c65-42c5-418c-b208-9d79b2890dcc tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] [instance: 58350d4b-9d77-4cd6-ae1b-221e729c20be] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:30:32.527077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d489c65-42c5-418c-b208-9d79b2890dcc tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:30:32.527578 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d489c65-42c5-418c-b208-9d79b2890dcc tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:30:32.528026 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d489c65-42c5-418c-b208-9d79b2890dcc tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:30:32.528992 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d489c65-42c5-418c-b208-9d79b2890dcc tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:30:32.529459 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d489c65-42c5-418c-b208-9d79b2890dcc tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:30:32.529899 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d489c65-42c5-418c-b208-9d79b2890dcc tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:30:32.671914 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0d489c65-42c5-418c-b208-9d79b2890dcc tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefd5257355844e590c72435f4c45024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99294b9428b4abc991cc9957afe73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:30:32.679908 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0d489c65-42c5-418c-b208-9d79b2890dcc tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] 10.222.0.52 "GET /compute/v2.1/servers/58350d4b-9d77-4cd6-ae1b-221e729c20be" status: 200 len: 1471 microversion: 2.1 time: 0.164976 Sep 24 21:30:32.680512 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3125/6230] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:30:32 2022] GET /compute/v2.1/servers/58350d4b-9d77-4cd6-ae1b-221e729c20be => generated 1471 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:30:33.180825 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:30:33.242816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-8c5bfa1c-4be0-498a-925c-55453ba3e6a1 req-1ebc7f70-95f8-4e8f-b3e9-05d98fa99e7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58350d4b-9d77-4cd6-ae1b-221e729c20be", "name": "network-vif-plugged", "status": "completed", "tag": "b1e353fa-b422-46aa-b671-be7460af1450"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:30:33.252170 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-8c5bfa1c-4be0-498a-925c-55453ba3e6a1 req-1ebc7f70-95f8-4e8f-b3e9-05d98fa99e7c service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:30:33.252646 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-8c5bfa1c-4be0-498a-925c-55453ba3e6a1 req-1ebc7f70-95f8-4e8f-b3e9-05d98fa99e7c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:30:33.253071 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-8c5bfa1c-4be0-498a-925c-55453ba3e6a1 req-1ebc7f70-95f8-4e8f-b3e9-05d98fa99e7c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:30:33.264229 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-8c5bfa1c-4be0-498a-925c-55453ba3e6a1 req-1ebc7f70-95f8-4e8f-b3e9-05d98fa99e7c service nova] Creating event network-vif-plugged:b1e353fa-b422-46aa-b671-be7460af1450 for instance 58350d4b-9d77-4cd6-ae1b-221e729c20be on nch1-master-1 Sep 24 21:30:33.270441 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-8c5bfa1c-4be0-498a-925c-55453ba3e6a1 req-1ebc7f70-95f8-4e8f-b3e9-05d98fa99e7c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096074 Sep 24 21:30:33.271077 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3106/6231] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:30:33.703683 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b10a4879-fe8e-4a26-a8f8-46f5ec12e2a3 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:30:33.704340 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b10a4879-fe8e-4a26-a8f8-46f5ec12e2a3 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] [instance: 58350d4b-9d77-4cd6-ae1b-221e729c20be] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:30:33.706306 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:30:33.707024 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=6 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:30:33.714378 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b10a4879-fe8e-4a26-a8f8-46f5ec12e2a3 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:30:33.714896 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b10a4879-fe8e-4a26-a8f8-46f5ec12e2a3 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:30:33.715347 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b10a4879-fe8e-4a26-a8f8-46f5ec12e2a3 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:30:33.716055 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b10a4879-fe8e-4a26-a8f8-46f5ec12e2a3 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:30:33.716522 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b10a4879-fe8e-4a26-a8f8-46f5ec12e2a3 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:30:33.716960 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b10a4879-fe8e-4a26-a8f8-46f5ec12e2a3 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:30:33.860457 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b10a4879-fe8e-4a26-a8f8-46f5ec12e2a3 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefd5257355844e590c72435f4c45024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99294b9428b4abc991cc9957afe73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:30:33.868723 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b10a4879-fe8e-4a26-a8f8-46f5ec12e2a3 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] 10.222.0.52 "GET /compute/v2.1/servers/58350d4b-9d77-4cd6-ae1b-221e729c20be" status: 200 len: 1471 microversion: 2.1 time: 0.168940 Sep 24 21:30:33.869298 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3126/6232] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:30:33 2022] GET /compute/v2.1/servers/58350d4b-9d77-4cd6-ae1b-221e729c20be => generated 1471 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:30:34.893310 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a3cbc5ea-6f7b-45b0-bb28-d8d7db24d40b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:30:34.894062 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a3cbc5ea-6f7b-45b0-bb28-d8d7db24d40b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] [instance: 58350d4b-9d77-4cd6-ae1b-221e729c20be] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:30:34.901285 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3cbc5ea-6f7b-45b0-bb28-d8d7db24d40b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:30:34.901766 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3cbc5ea-6f7b-45b0-bb28-d8d7db24d40b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:30:34.902203 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3cbc5ea-6f7b-45b0-bb28-d8d7db24d40b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:30:34.902920 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3cbc5ea-6f7b-45b0-bb28-d8d7db24d40b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:30:34.903637 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3cbc5ea-6f7b-45b0-bb28-d8d7db24d40b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:30:34.904060 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a3cbc5ea-6f7b-45b0-bb28-d8d7db24d40b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:30:35.047119 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a3cbc5ea-6f7b-45b0-bb28-d8d7db24d40b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefd5257355844e590c72435f4c45024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99294b9428b4abc991cc9957afe73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:30:35.055727 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a3cbc5ea-6f7b-45b0-bb28-d8d7db24d40b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] 10.222.0.52 "GET /compute/v2.1/servers/58350d4b-9d77-4cd6-ae1b-221e729c20be" status: 200 len: 1642 microversion: 2.1 time: 0.167420 Sep 24 21:30:35.056302 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3107/6233] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:30:34 2022] GET /compute/v2.1/servers/58350d4b-9d77-4cd6-ae1b-221e729c20be => generated 1642 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:30:35.078087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cf9ab0fb-b1d9-4f86-a026-4017c2c5ab0b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:30:35.078739 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cf9ab0fb-b1d9-4f86-a026-4017c2c5ab0b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] [instance: 58350d4b-9d77-4cd6-ae1b-221e729c20be] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:30:35.085819 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf9ab0fb-b1d9-4f86-a026-4017c2c5ab0b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:30:35.086299 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf9ab0fb-b1d9-4f86-a026-4017c2c5ab0b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:30:35.086779 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf9ab0fb-b1d9-4f86-a026-4017c2c5ab0b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:30:35.087490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf9ab0fb-b1d9-4f86-a026-4017c2c5ab0b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:30:35.087959 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf9ab0fb-b1d9-4f86-a026-4017c2c5ab0b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:30:35.088398 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf9ab0fb-b1d9-4f86-a026-4017c2c5ab0b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:30:35.229592 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cf9ab0fb-b1d9-4f86-a026-4017c2c5ab0b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefd5257355844e590c72435f4c45024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99294b9428b4abc991cc9957afe73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:30:35.237305 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cf9ab0fb-b1d9-4f86-a026-4017c2c5ab0b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] 10.222.0.52 "GET /compute/v2.1/servers/58350d4b-9d77-4cd6-ae1b-221e729c20be" status: 200 len: 1642 microversion: 2.1 time: 0.163129 Sep 24 21:30:35.237870 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3127/6234] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:30:35 2022] GET /compute/v2.1/servers/58350d4b-9d77-4cd6-ae1b-221e729c20be => generated 1642 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:30:35.259448 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1d5fd986-c32c-4bcd-b498-ab39a98fc22a tempest-TestSecurityGroupsBasicOps-948693257 tempest-TestSecurityGroupsBasicOps-948693257-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:30:35.260191 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1d5fd986-c32c-4bcd-b498-ab39a98fc22a tempest-TestSecurityGroupsBasicOps-948693257 tempest-TestSecurityGroupsBasicOps-948693257-project-admin] [instance: 58350d4b-9d77-4cd6-ae1b-221e729c20be] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:30:35.266287 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d5fd986-c32c-4bcd-b498-ab39a98fc22a tempest-TestSecurityGroupsBasicOps-948693257 tempest-TestSecurityGroupsBasicOps-948693257-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:30:35.266810 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d5fd986-c32c-4bcd-b498-ab39a98fc22a tempest-TestSecurityGroupsBasicOps-948693257 tempest-TestSecurityGroupsBasicOps-948693257-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:30:35.267255 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d5fd986-c32c-4bcd-b498-ab39a98fc22a tempest-TestSecurityGroupsBasicOps-948693257 tempest-TestSecurityGroupsBasicOps-948693257-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:30:35.267954 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d5fd986-c32c-4bcd-b498-ab39a98fc22a tempest-TestSecurityGroupsBasicOps-948693257 tempest-TestSecurityGroupsBasicOps-948693257-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:30:35.268413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d5fd986-c32c-4bcd-b498-ab39a98fc22a tempest-TestSecurityGroupsBasicOps-948693257 tempest-TestSecurityGroupsBasicOps-948693257-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:30:35.268844 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d5fd986-c32c-4bcd-b498-ab39a98fc22a tempest-TestSecurityGroupsBasicOps-948693257 tempest-TestSecurityGroupsBasicOps-948693257-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:30:35.503583 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1d5fd986-c32c-4bcd-b498-ab39a98fc22a tempest-TestSecurityGroupsBasicOps-948693257 tempest-TestSecurityGroupsBasicOps-948693257-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/58350d4b-9d77-4cd6-ae1b-221e729c20be" status: 200 len: 1793 microversion: 2.1 time: 0.247871 Sep 24 21:30:35.504155 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3108/6235] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:30:35 2022] GET /compute/v2.1/servers/58350d4b-9d77-4cd6-ae1b-221e729c20be => generated 1793 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:30:37.506317 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-e18134cf-cf37-4aa1-976b-54eda0e31c22 req-31ac5ae3-4287-40ad-8c36-e47ecadc316b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58350d4b-9d77-4cd6-ae1b-221e729c20be", "tag": "b1e353fa-b422-46aa-b671-be7460af1450"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:30:37.517527 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e18134cf-cf37-4aa1-976b-54eda0e31c22 req-31ac5ae3-4287-40ad-8c36-e47ecadc316b service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:30:37.517746 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e18134cf-cf37-4aa1-976b-54eda0e31c22 req-31ac5ae3-4287-40ad-8c36-e47ecadc316b service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:30:37.518138 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e18134cf-cf37-4aa1-976b-54eda0e31c22 req-31ac5ae3-4287-40ad-8c36-e47ecadc316b service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:30:37.530721 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-e18134cf-cf37-4aa1-976b-54eda0e31c22 req-31ac5ae3-4287-40ad-8c36-e47ecadc316b service nova] Creating event network-changed:b1e353fa-b422-46aa-b671-be7460af1450 for instance 58350d4b-9d77-4cd6-ae1b-221e729c20be on nch1-master-1 Sep 24 21:30:37.535872 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-e18134cf-cf37-4aa1-976b-54eda0e31c22 req-31ac5ae3-4287-40ad-8c36-e47ecadc316b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033208 Sep 24 21:30:37.536535 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3128/6236] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:31:48.816268 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:31:48.817053 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=38 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:31:48.823994 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7fd43c4e-7da3-4c1b-8b32-483710002388 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-402157865", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "e528a9dd-5ee4-4137-a8f0-af7887b98038"}], "key_name": "tempest-TestSecurityGroupsBasicOps-417999275", "security_groups": []}, "os:scheduler_hints": {"different_host": ["58350d4b-9d77-4cd6-ae1b-221e729c20be"]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:31:48.895367 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-7fd43c4e-7da3-4c1b-8b32-483710002388 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] validate_networks() for [('e528a9dd-5ee4-4137-a8f0-af7887b98038', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:31:49.426863 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-7fd43c4e-7da3-4c1b-8b32-483710002388 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:31:49.427254 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-7fd43c4e-7da3-4c1b-8b32-483710002388 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:31:49.427744 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-7fd43c4e-7da3-4c1b-8b32-483710002388 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:31:49.428164 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-7fd43c4e-7da3-4c1b-8b32-483710002388 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:31:49.428588 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-7fd43c4e-7da3-4c1b-8b32-483710002388 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:31:49.439823 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7fd43c4e-7da3-4c1b-8b32-483710002388 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:31:49.440318 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7fd43c4e-7da3-4c1b-8b32-483710002388 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:31:49.440772 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7fd43c4e-7da3-4c1b-8b32-483710002388 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:31:49.441565 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7fd43c4e-7da3-4c1b-8b32-483710002388 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:31:49.442014 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7fd43c4e-7da3-4c1b-8b32-483710002388 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:31:49.442524 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7fd43c4e-7da3-4c1b-8b32-483710002388 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:31:49.460842 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-7fd43c4e-7da3-4c1b-8b32-483710002388 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Getting quotas for project a99294b9428b4abc991cc9957afe73a0. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:31:49.467560 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-7fd43c4e-7da3-4c1b-8b32-483710002388 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Getting quotas for user fefd5257355844e590c72435f4c45024 and project a99294b9428b4abc991cc9957afe73a0. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:31:49.479585 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7fd43c4e-7da3-4c1b-8b32-483710002388 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:31:49.482172 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7fd43c4e-7da3-4c1b-8b32-483710002388 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] [instance: 4d9af823-60b4-4164-970f-953830099919] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:31:49.532416 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7fd43c4e-7da3-4c1b-8b32-483710002388 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.719231 Sep 24 21:31:49.533627 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3109/6237] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:31:48 2022] POST /compute/v2.1/servers => generated 361 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:31:49.543913 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:31:49.544902 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=42 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:31:49.550085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-27bf3351-9152-4f47-85c4-1aff9ff396a8 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:31:49.550924 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-27bf3351-9152-4f47-85c4-1aff9ff396a8 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] [instance: 4d9af823-60b4-4164-970f-953830099919] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:31:49.612553 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-27bf3351-9152-4f47-85c4-1aff9ff396a8 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefd5257355844e590c72435f4c45024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99294b9428b4abc991cc9957afe73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:31:49.620149 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-27bf3351-9152-4f47-85c4-1aff9ff396a8 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] 10.222.0.52 "GET /compute/v2.1/servers/4d9af823-60b4-4164-970f-953830099919" status: 200 len: 1240 microversion: 2.1 time: 0.079205 Sep 24 21:31:49.620958 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3129/6238] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:31:49 2022] GET /compute/v2.1/servers/4d9af823-60b4-4164-970f-953830099919 => generated 1240 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:31:50.647115 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8d9568d5-5fe8-4256-8755-55836a72e568 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:31:50.651967 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8d9568d5-5fe8-4256-8755-55836a72e568 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] [instance: 4d9af823-60b4-4164-970f-953830099919] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:31:50.663502 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d9568d5-5fe8-4256-8755-55836a72e568 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:31:50.664529 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d9568d5-5fe8-4256-8755-55836a72e568 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:31:50.665040 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d9568d5-5fe8-4256-8755-55836a72e568 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:31:50.694447 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d9568d5-5fe8-4256-8755-55836a72e568 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:31:50.696358 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d9568d5-5fe8-4256-8755-55836a72e568 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:31:50.697198 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d9568d5-5fe8-4256-8755-55836a72e568 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:31:50.810122 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8d9568d5-5fe8-4256-8755-55836a72e568 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefd5257355844e590c72435f4c45024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99294b9428b4abc991cc9957afe73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:31:50.818888 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8d9568d5-5fe8-4256-8755-55836a72e568 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] 10.222.0.52 "GET /compute/v2.1/servers/4d9af823-60b4-4164-970f-953830099919" status: 200 len: 1300 microversion: 2.1 time: 0.176192 Sep 24 21:31:50.823870 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3110/6239] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:31:50 2022] GET /compute/v2.1/servers/4d9af823-60b4-4164-970f-953830099919 => generated 1300 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:31:51.847424 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4cae4c76-8e9a-470f-872c-6e76fc6e68ef tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:31:51.848047 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4cae4c76-8e9a-470f-872c-6e76fc6e68ef tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] [instance: 4d9af823-60b4-4164-970f-953830099919] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:31:51.856087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cae4c76-8e9a-470f-872c-6e76fc6e68ef tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:31:51.856593 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cae4c76-8e9a-470f-872c-6e76fc6e68ef tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:31:51.857040 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cae4c76-8e9a-470f-872c-6e76fc6e68ef tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:31:51.857757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cae4c76-8e9a-470f-872c-6e76fc6e68ef tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:31:51.858228 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cae4c76-8e9a-470f-872c-6e76fc6e68ef tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:31:51.858744 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cae4c76-8e9a-470f-872c-6e76fc6e68ef tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:31:51.965082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4cae4c76-8e9a-470f-872c-6e76fc6e68ef tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefd5257355844e590c72435f4c45024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99294b9428b4abc991cc9957afe73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:31:51.973724 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4cae4c76-8e9a-470f-872c-6e76fc6e68ef tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] 10.222.0.52 "GET /compute/v2.1/servers/4d9af823-60b4-4164-970f-953830099919" status: 200 len: 1298 microversion: 2.1 time: 0.130310 Sep 24 21:31:51.974288 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3130/6240] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:31:51 2022] GET /compute/v2.1/servers/4d9af823-60b4-4164-970f-953830099919 => generated 1298 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:31:52.270973 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-5dac6e26-cad5-43b3-9627-0568a96cfe1f req-486fdc8a-66da-40bb-843a-d9593693ffb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d9af823-60b4-4164-970f-953830099919", "tag": "5670d823-5021-4ae9-8af6-d92503e2949a"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:31:52.286180 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-5dac6e26-cad5-43b3-9627-0568a96cfe1f req-486fdc8a-66da-40bb-843a-d9593693ffb0 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:31:52.287088 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-5dac6e26-cad5-43b3-9627-0568a96cfe1f req-486fdc8a-66da-40bb-843a-d9593693ffb0 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:31:52.287725 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-5dac6e26-cad5-43b3-9627-0568a96cfe1f req-486fdc8a-66da-40bb-843a-d9593693ffb0 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:31:52.300545 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-5dac6e26-cad5-43b3-9627-0568a96cfe1f req-486fdc8a-66da-40bb-843a-d9593693ffb0 service nova] Creating event network-changed:5670d823-5021-4ae9-8af6-d92503e2949a for instance 4d9af823-60b4-4164-970f-953830099919 on nch2-master-1 Sep 24 21:31:52.308143 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-5dac6e26-cad5-43b3-9627-0568a96cfe1f req-486fdc8a-66da-40bb-843a-d9593693ffb0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041724 Sep 24 21:31:52.309066 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3111/6241] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:31:52.997497 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-26d0a4d5-3af1-4641-9e92-b946ea2ae36b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:31:52.998023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-26d0a4d5-3af1-4641-9e92-b946ea2ae36b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] [instance: 4d9af823-60b4-4164-970f-953830099919] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:31:53.005580 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26d0a4d5-3af1-4641-9e92-b946ea2ae36b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:31:53.006061 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26d0a4d5-3af1-4641-9e92-b946ea2ae36b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:31:53.006522 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26d0a4d5-3af1-4641-9e92-b946ea2ae36b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:31:53.007225 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26d0a4d5-3af1-4641-9e92-b946ea2ae36b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:31:53.007679 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26d0a4d5-3af1-4641-9e92-b946ea2ae36b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:31:53.008108 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-26d0a4d5-3af1-4641-9e92-b946ea2ae36b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:31:53.092306 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-26d0a4d5-3af1-4641-9e92-b946ea2ae36b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefd5257355844e590c72435f4c45024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99294b9428b4abc991cc9957afe73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:31:53.100143 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-26d0a4d5-3af1-4641-9e92-b946ea2ae36b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] 10.222.0.52 "GET /compute/v2.1/servers/4d9af823-60b4-4164-970f-953830099919" status: 200 len: 1298 microversion: 2.1 time: 0.106844 Sep 24 21:31:53.100723 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3131/6242] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:31:52 2022] GET /compute/v2.1/servers/4d9af823-60b4-4164-970f-953830099919 => generated 1298 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:31:54.126088 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7a7096b1-3238-4479-b229-c81f1d5f5e57 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:31:54.126832 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7a7096b1-3238-4479-b229-c81f1d5f5e57 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] [instance: 4d9af823-60b4-4164-970f-953830099919] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:31:54.133107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a7096b1-3238-4479-b229-c81f1d5f5e57 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:31:54.133595 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a7096b1-3238-4479-b229-c81f1d5f5e57 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:31:54.134042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a7096b1-3238-4479-b229-c81f1d5f5e57 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:31:54.134776 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a7096b1-3238-4479-b229-c81f1d5f5e57 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:31:54.135242 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a7096b1-3238-4479-b229-c81f1d5f5e57 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:31:54.135678 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a7096b1-3238-4479-b229-c81f1d5f5e57 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:31:54.227356 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7a7096b1-3238-4479-b229-c81f1d5f5e57 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefd5257355844e590c72435f4c45024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99294b9428b4abc991cc9957afe73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:31:54.235203 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7a7096b1-3238-4479-b229-c81f1d5f5e57 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] 10.222.0.52 "GET /compute/v2.1/servers/4d9af823-60b4-4164-970f-953830099919" status: 200 len: 1298 microversion: 2.1 time: 0.114894 Sep 24 21:31:54.235778 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3112/6243] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:31:54 2022] GET /compute/v2.1/servers/4d9af823-60b4-4164-970f-953830099919 => generated 1298 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:31:55.258130 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1993c330-c7be-4283-a315-d1e322787079 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:31:55.258776 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1993c330-c7be-4283-a315-d1e322787079 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] [instance: 4d9af823-60b4-4164-970f-953830099919] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:31:55.265937 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1993c330-c7be-4283-a315-d1e322787079 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:31:55.266459 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1993c330-c7be-4283-a315-d1e322787079 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:31:55.266933 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1993c330-c7be-4283-a315-d1e322787079 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:31:55.267668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1993c330-c7be-4283-a315-d1e322787079 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:31:55.268134 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1993c330-c7be-4283-a315-d1e322787079 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:31:55.268569 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1993c330-c7be-4283-a315-d1e322787079 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:31:55.349461 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1993c330-c7be-4283-a315-d1e322787079 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefd5257355844e590c72435f4c45024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99294b9428b4abc991cc9957afe73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:31:55.357188 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1993c330-c7be-4283-a315-d1e322787079 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] 10.222.0.52 "GET /compute/v2.1/servers/4d9af823-60b4-4164-970f-953830099919" status: 200 len: 1298 microversion: 2.1 time: 0.103101 Sep 24 21:31:55.357755 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3132/6244] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:31:55 2022] GET /compute/v2.1/servers/4d9af823-60b4-4164-970f-953830099919 => generated 1298 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:31:56.380150 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d1cfe383-e5ce-48f2-b73b-d65ec498a6a7 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:31:56.380845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d1cfe383-e5ce-48f2-b73b-d65ec498a6a7 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] [instance: 4d9af823-60b4-4164-970f-953830099919] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:31:56.388209 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d1cfe383-e5ce-48f2-b73b-d65ec498a6a7 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:31:56.388689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d1cfe383-e5ce-48f2-b73b-d65ec498a6a7 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:31:56.389123 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d1cfe383-e5ce-48f2-b73b-d65ec498a6a7 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:31:56.389829 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d1cfe383-e5ce-48f2-b73b-d65ec498a6a7 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:31:56.390285 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d1cfe383-e5ce-48f2-b73b-d65ec498a6a7 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:31:56.390740 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d1cfe383-e5ce-48f2-b73b-d65ec498a6a7 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:31:56.475966 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d1cfe383-e5ce-48f2-b73b-d65ec498a6a7 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefd5257355844e590c72435f4c45024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99294b9428b4abc991cc9957afe73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:31:56.483781 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d1cfe383-e5ce-48f2-b73b-d65ec498a6a7 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] 10.222.0.52 "GET /compute/v2.1/servers/4d9af823-60b4-4164-970f-953830099919" status: 200 len: 1298 microversion: 2.1 time: 0.107481 Sep 24 21:31:56.484373 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3113/6245] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:31:56 2022] GET /compute/v2.1/servers/4d9af823-60b4-4164-970f-953830099919 => generated 1298 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:31:57.506837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c16260a5-19f9-425d-ba65-78486c09cb91 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:31:57.507396 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c16260a5-19f9-425d-ba65-78486c09cb91 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] [instance: 4d9af823-60b4-4164-970f-953830099919] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:31:57.514195 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c16260a5-19f9-425d-ba65-78486c09cb91 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:31:57.514716 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c16260a5-19f9-425d-ba65-78486c09cb91 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:31:57.515885 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c16260a5-19f9-425d-ba65-78486c09cb91 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:31:57.516626 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c16260a5-19f9-425d-ba65-78486c09cb91 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:31:57.517087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c16260a5-19f9-425d-ba65-78486c09cb91 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:31:57.517518 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c16260a5-19f9-425d-ba65-78486c09cb91 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:31:57.599233 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c16260a5-19f9-425d-ba65-78486c09cb91 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefd5257355844e590c72435f4c45024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99294b9428b4abc991cc9957afe73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:31:57.607338 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c16260a5-19f9-425d-ba65-78486c09cb91 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] 10.222.0.52 "GET /compute/v2.1/servers/4d9af823-60b4-4164-970f-953830099919" status: 200 len: 1298 microversion: 2.1 time: 0.104542 Sep 24 21:31:57.607917 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3133/6246] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:31:57 2022] GET /compute/v2.1/servers/4d9af823-60b4-4164-970f-953830099919 => generated 1298 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:31:58.582037 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-43677b82-f857-4055-b853-44b7e9051d6a req-d052aab6-a3a2-4267-87a4-1d6ac342a846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d9af823-60b4-4164-970f-953830099919", "name": "network-vif-plugged", "status": "completed", "tag": "5670d823-5021-4ae9-8af6-d92503e2949a"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:31:58.592685 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-43677b82-f857-4055-b853-44b7e9051d6a req-d052aab6-a3a2-4267-87a4-1d6ac342a846 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:31:58.593226 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-43677b82-f857-4055-b853-44b7e9051d6a req-d052aab6-a3a2-4267-87a4-1d6ac342a846 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:31:58.593784 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-43677b82-f857-4055-b853-44b7e9051d6a req-d052aab6-a3a2-4267-87a4-1d6ac342a846 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:31:58.605583 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-43677b82-f857-4055-b853-44b7e9051d6a req-d052aab6-a3a2-4267-87a4-1d6ac342a846 service nova] Creating event network-vif-plugged:5670d823-5021-4ae9-8af6-d92503e2949a for instance 4d9af823-60b4-4164-970f-953830099919 on nch2-master-1 Sep 24 21:31:58.610686 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-43677b82-f857-4055-b853-44b7e9051d6a req-d052aab6-a3a2-4267-87a4-1d6ac342a846 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033067 Sep 24 21:31:58.611292 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3114/6247] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:31:58.631183 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2c350e88-479d-4fa0-9a5d-d77429cd91fd tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:31:58.631836 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2c350e88-479d-4fa0-9a5d-d77429cd91fd tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] [instance: 4d9af823-60b4-4164-970f-953830099919] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:31:58.638576 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c350e88-479d-4fa0-9a5d-d77429cd91fd tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:31:58.639076 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c350e88-479d-4fa0-9a5d-d77429cd91fd tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:31:58.640738 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c350e88-479d-4fa0-9a5d-d77429cd91fd tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:31:58.641120 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c350e88-479d-4fa0-9a5d-d77429cd91fd tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:31:58.641597 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c350e88-479d-4fa0-9a5d-d77429cd91fd tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:31:58.642047 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c350e88-479d-4fa0-9a5d-d77429cd91fd tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:31:58.759684 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2c350e88-479d-4fa0-9a5d-d77429cd91fd tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefd5257355844e590c72435f4c45024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99294b9428b4abc991cc9957afe73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:31:58.768122 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2c350e88-479d-4fa0-9a5d-d77429cd91fd tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] 10.222.0.52 "GET /compute/v2.1/servers/4d9af823-60b4-4164-970f-953830099919" status: 200 len: 1298 microversion: 2.1 time: 0.140970 Sep 24 21:31:58.768714 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3134/6248] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:31:58 2022] GET /compute/v2.1/servers/4d9af823-60b4-4164-970f-953830099919 => generated 1298 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:31:59.794346 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:31:59.795219 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:31:59.800925 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-36709655-0269-4c06-a563-095c523251af tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:31:59.801670 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-36709655-0269-4c06-a563-095c523251af tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] [instance: 4d9af823-60b4-4164-970f-953830099919] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:31:59.808795 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36709655-0269-4c06-a563-095c523251af tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:31:59.809280 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36709655-0269-4c06-a563-095c523251af tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:31:59.809718 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36709655-0269-4c06-a563-095c523251af tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:31:59.810415 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36709655-0269-4c06-a563-095c523251af tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:31:59.810897 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36709655-0269-4c06-a563-095c523251af tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:31:59.811328 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-36709655-0269-4c06-a563-095c523251af tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:31:59.944057 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-36709655-0269-4c06-a563-095c523251af tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefd5257355844e590c72435f4c45024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99294b9428b4abc991cc9957afe73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:31:59.952161 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-36709655-0269-4c06-a563-095c523251af tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] 10.222.0.52 "GET /compute/v2.1/servers/4d9af823-60b4-4164-970f-953830099919" status: 200 len: 1469 microversion: 2.1 time: 0.158757 Sep 24 21:31:59.966677 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3115/6249] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:31:59 2022] GET /compute/v2.1/servers/4d9af823-60b4-4164-970f-953830099919 => generated 1469 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:31:59.975549 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f66228c5-577f-48ee-9b1e-469dadfa4de0 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:31:59.976179 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f66228c5-577f-48ee-9b1e-469dadfa4de0 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] [instance: 4d9af823-60b4-4164-970f-953830099919] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:31:59.978100 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:31:59.984297 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f66228c5-577f-48ee-9b1e-469dadfa4de0 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:31:59.984797 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f66228c5-577f-48ee-9b1e-469dadfa4de0 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:31:59.985248 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f66228c5-577f-48ee-9b1e-469dadfa4de0 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:31:59.985967 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f66228c5-577f-48ee-9b1e-469dadfa4de0 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:31:59.986433 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f66228c5-577f-48ee-9b1e-469dadfa4de0 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:31:59.986899 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f66228c5-577f-48ee-9b1e-469dadfa4de0 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:00.098379 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f66228c5-577f-48ee-9b1e-469dadfa4de0 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefd5257355844e590c72435f4c45024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99294b9428b4abc991cc9957afe73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:32:00.106266 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f66228c5-577f-48ee-9b1e-469dadfa4de0 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] 10.222.0.52 "GET /compute/v2.1/servers/4d9af823-60b4-4164-970f-953830099919" status: 200 len: 1469 microversion: 2.1 time: 0.134560 Sep 24 21:32:00.106891 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3135/6250] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:31:59 2022] GET /compute/v2.1/servers/4d9af823-60b4-4164-970f-953830099919 => generated 1469 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:32:00.128725 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7e74343a-cc0d-4c10-9d8e-46197b072895 tempest-TestSecurityGroupsBasicOps-948693257 tempest-TestSecurityGroupsBasicOps-948693257-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:32:00.129365 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7e74343a-cc0d-4c10-9d8e-46197b072895 tempest-TestSecurityGroupsBasicOps-948693257 tempest-TestSecurityGroupsBasicOps-948693257-project-admin] [instance: 4d9af823-60b4-4164-970f-953830099919] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:32:00.135394 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7e74343a-cc0d-4c10-9d8e-46197b072895 tempest-TestSecurityGroupsBasicOps-948693257 tempest-TestSecurityGroupsBasicOps-948693257-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:00.135880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7e74343a-cc0d-4c10-9d8e-46197b072895 tempest-TestSecurityGroupsBasicOps-948693257 tempest-TestSecurityGroupsBasicOps-948693257-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:00.136393 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7e74343a-cc0d-4c10-9d8e-46197b072895 tempest-TestSecurityGroupsBasicOps-948693257 tempest-TestSecurityGroupsBasicOps-948693257-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:00.137109 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7e74343a-cc0d-4c10-9d8e-46197b072895 tempest-TestSecurityGroupsBasicOps-948693257 tempest-TestSecurityGroupsBasicOps-948693257-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:00.137570 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7e74343a-cc0d-4c10-9d8e-46197b072895 tempest-TestSecurityGroupsBasicOps-948693257 tempest-TestSecurityGroupsBasicOps-948693257-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:00.138000 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7e74343a-cc0d-4c10-9d8e-46197b072895 tempest-TestSecurityGroupsBasicOps-948693257 tempest-TestSecurityGroupsBasicOps-948693257-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:00.224133 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7e74343a-cc0d-4c10-9d8e-46197b072895 tempest-TestSecurityGroupsBasicOps-948693257 tempest-TestSecurityGroupsBasicOps-948693257-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/4d9af823-60b4-4164-970f-953830099919" status: 200 len: 1620 microversion: 2.1 time: 0.099861 Sep 24 21:32:00.224719 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3116/6251] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:32:00 2022] GET /compute/v2.1/servers/4d9af823-60b4-4164-970f-953830099919 => generated 1620 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:32:00.246447 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-653a6b81-ef26-4bc7-b05d-ead11146951b tempest-TestSecurityGroupsBasicOps-948693257 tempest-TestSecurityGroupsBasicOps-948693257-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:32:00.247124 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-653a6b81-ef26-4bc7-b05d-ead11146951b tempest-TestSecurityGroupsBasicOps-948693257 tempest-TestSecurityGroupsBasicOps-948693257-project-admin] [instance: 58350d4b-9d77-4cd6-ae1b-221e729c20be] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:32:00.253340 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-653a6b81-ef26-4bc7-b05d-ead11146951b tempest-TestSecurityGroupsBasicOps-948693257 tempest-TestSecurityGroupsBasicOps-948693257-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:00.253894 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-653a6b81-ef26-4bc7-b05d-ead11146951b tempest-TestSecurityGroupsBasicOps-948693257 tempest-TestSecurityGroupsBasicOps-948693257-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:00.254343 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-653a6b81-ef26-4bc7-b05d-ead11146951b tempest-TestSecurityGroupsBasicOps-948693257 tempest-TestSecurityGroupsBasicOps-948693257-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:00.255085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-653a6b81-ef26-4bc7-b05d-ead11146951b tempest-TestSecurityGroupsBasicOps-948693257 tempest-TestSecurityGroupsBasicOps-948693257-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:00.255542 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-653a6b81-ef26-4bc7-b05d-ead11146951b tempest-TestSecurityGroupsBasicOps-948693257 tempest-TestSecurityGroupsBasicOps-948693257-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:00.255974 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-653a6b81-ef26-4bc7-b05d-ead11146951b tempest-TestSecurityGroupsBasicOps-948693257 tempest-TestSecurityGroupsBasicOps-948693257-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:00.393910 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-653a6b81-ef26-4bc7-b05d-ead11146951b tempest-TestSecurityGroupsBasicOps-948693257 tempest-TestSecurityGroupsBasicOps-948693257-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/58350d4b-9d77-4cd6-ae1b-221e729c20be" status: 200 len: 1912 microversion: 2.1 time: 0.151166 Sep 24 21:32:00.394489 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3136/6252] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:32:00 2022] GET /compute/v2.1/servers/58350d4b-9d77-4cd6-ae1b-221e729c20be => generated 1912 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:32:00.460576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cfd0b95b-c7a1-42ff-9605-ec036e0a6e49 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:32:00.461076 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cfd0b95b-c7a1-42ff-9605-ec036e0a6e49 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] [instance: 4d9af823-60b4-4164-970f-953830099919] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:32:00.467062 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cfd0b95b-c7a1-42ff-9605-ec036e0a6e49 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:00.467550 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cfd0b95b-c7a1-42ff-9605-ec036e0a6e49 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:00.468604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cfd0b95b-c7a1-42ff-9605-ec036e0a6e49 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:00.469706 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cfd0b95b-c7a1-42ff-9605-ec036e0a6e49 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:00.470203 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cfd0b95b-c7a1-42ff-9605-ec036e0a6e49 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:00.470678 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cfd0b95b-c7a1-42ff-9605-ec036e0a6e49 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:00.496234 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cfd0b95b-c7a1-42ff-9605-ec036e0a6e49 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] [instance: 4d9af823-60b4-4164-970f-953830099919] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:32:00.572347 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cfd0b95b-c7a1-42ff-9605-ec036e0a6e49 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4d9af823-60b4-4164-970f-953830099919" status: 204 len: 0 microversion: 2.1 time: 0.115487 Sep 24 21:32:00.573020 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3117/6253] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:32:00 2022] DELETE /compute/v2.1/servers/4d9af823-60b4-4164-970f-953830099919 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:32:00.583545 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-243ca4f3-215f-4f76-bbf0-105b38328665 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:32:00.584167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-243ca4f3-215f-4f76-bbf0-105b38328665 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] [instance: 4d9af823-60b4-4164-970f-953830099919] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:32:00.590079 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-243ca4f3-215f-4f76-bbf0-105b38328665 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:00.590602 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-243ca4f3-215f-4f76-bbf0-105b38328665 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:00.591041 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-243ca4f3-215f-4f76-bbf0-105b38328665 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:00.591726 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-243ca4f3-215f-4f76-bbf0-105b38328665 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:00.592180 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-243ca4f3-215f-4f76-bbf0-105b38328665 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:00.592608 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-243ca4f3-215f-4f76-bbf0-105b38328665 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:00.674070 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-243ca4f3-215f-4f76-bbf0-105b38328665 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefd5257355844e590c72435f4c45024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99294b9428b4abc991cc9957afe73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:32:00.681885 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-243ca4f3-215f-4f76-bbf0-105b38328665 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] 10.222.0.52 "GET /compute/v2.1/servers/4d9af823-60b4-4164-970f-953830099919" status: 200 len: 1475 microversion: 2.1 time: 0.104323 Sep 24 21:32:00.682448 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3137/6254] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:32:00 2022] GET /compute/v2.1/servers/4d9af823-60b4-4164-970f-953830099919 => generated 1475 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:32:01.707405 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-01578e0f-423b-4abc-abef-53347ddb2be2 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:32:01.708128 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-01578e0f-423b-4abc-abef-53347ddb2be2 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] [instance: 4d9af823-60b4-4164-970f-953830099919] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:32:01.715062 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-01578e0f-423b-4abc-abef-53347ddb2be2 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:01.715549 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-01578e0f-423b-4abc-abef-53347ddb2be2 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:01.715994 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-01578e0f-423b-4abc-abef-53347ddb2be2 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:01.716694 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-01578e0f-423b-4abc-abef-53347ddb2be2 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:01.717181 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-01578e0f-423b-4abc-abef-53347ddb2be2 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:01.717610 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-01578e0f-423b-4abc-abef-53347ddb2be2 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:01.802617 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-01578e0f-423b-4abc-abef-53347ddb2be2 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefd5257355844e590c72435f4c45024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99294b9428b4abc991cc9957afe73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:32:01.811068 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-01578e0f-423b-4abc-abef-53347ddb2be2 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] 10.222.0.52 "GET /compute/v2.1/servers/4d9af823-60b4-4164-970f-953830099919" status: 200 len: 1475 microversion: 2.1 time: 0.107731 Sep 24 21:32:01.811844 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3118/6255] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:32:01 2022] GET /compute/v2.1/servers/4d9af823-60b4-4164-970f-953830099919 => generated 1475 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:32:02.461699 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-dea58c83-0c80-457c-b625-3d2491855585 req-4cf0cabe-8832-43cb-bb0d-9910a58b0605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d9af823-60b4-4164-970f-953830099919", "name": "network-vif-deleted", "tag": "5670d823-5021-4ae9-8af6-d92503e2949a"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:32:02.469571 ncdv-master-1 devstack@n-api.service[140517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 21:32:02.469730 ncdv-master-1 devstack@n-api.service[140517]: Sat Sep 24 21:32:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.52) !!! Sep 24 21:32:02.476578 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-dea58c83-0c80-457c-b625-3d2491855585 req-4cf0cabe-8832-43cb-bb0d-9910a58b0605 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:02.477358 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-dea58c83-0c80-457c-b625-3d2491855585 req-4cf0cabe-8832-43cb-bb0d-9910a58b0605 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:02.478018 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-dea58c83-0c80-457c-b625-3d2491855585 req-4cf0cabe-8832-43cb-bb0d-9910a58b0605 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:02.490606 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-dea58c83-0c80-457c-b625-3d2491855585 req-4cf0cabe-8832-43cb-bb0d-9910a58b0605 service nova] Creating event network-vif-deleted:5670d823-5021-4ae9-8af6-d92503e2949a for instance 4d9af823-60b4-4164-970f-953830099919 on nch2-master-1 Sep 24 21:32:02.496334 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-dea58c83-0c80-457c-b625-3d2491855585 req-4cf0cabe-8832-43cb-bb0d-9910a58b0605 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038549 Sep 24 21:32:02.496966 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3138/6256] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:32:02.836814 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f196bec0-9b1a-4260-af3b-bab45ce27b2b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:32:02.837428 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f196bec0-9b1a-4260-af3b-bab45ce27b2b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] [instance: 4d9af823-60b4-4164-970f-953830099919] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:32:02.844985 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f196bec0-9b1a-4260-af3b-bab45ce27b2b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:02.845467 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f196bec0-9b1a-4260-af3b-bab45ce27b2b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:02.845930 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f196bec0-9b1a-4260-af3b-bab45ce27b2b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:02.846665 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f196bec0-9b1a-4260-af3b-bab45ce27b2b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:02.847120 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f196bec0-9b1a-4260-af3b-bab45ce27b2b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:02.847543 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f196bec0-9b1a-4260-af3b-bab45ce27b2b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:02.879739 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f196bec0-9b1a-4260-af3b-bab45ce27b2b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:02.880216 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f196bec0-9b1a-4260-af3b-bab45ce27b2b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:02.880649 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f196bec0-9b1a-4260-af3b-bab45ce27b2b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:02.881094 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-f196bec0-9b1a-4260-af3b-bab45ce27b2b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lazy-loading 'fault' on Instance uuid 4d9af823-60b4-4164-970f-953830099919 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:32:02.923801 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f196bec0-9b1a-4260-af3b-bab45ce27b2b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefd5257355844e590c72435f4c45024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99294b9428b4abc991cc9957afe73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:32:02.931808 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f196bec0-9b1a-4260-af3b-bab45ce27b2b tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] 10.222.0.52 "GET /compute/v2.1/servers/4d9af823-60b4-4164-970f-953830099919" status: 200 len: 1330 microversion: 2.1 time: 0.098819 Sep 24 21:32:02.932507 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3119/6257] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:32:02 2022] GET /compute/v2.1/servers/4d9af823-60b4-4164-970f-953830099919 => generated 1330 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:32:03.957548 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d80fdace-bbb1-4d66-aa8b-65b82a7884be tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:32:03.958166 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d80fdace-bbb1-4d66-aa8b-65b82a7884be tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] [instance: 4d9af823-60b4-4164-970f-953830099919] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:32:03.964634 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d80fdace-bbb1-4d66-aa8b-65b82a7884be tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:03.965118 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d80fdace-bbb1-4d66-aa8b-65b82a7884be tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:03.965553 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d80fdace-bbb1-4d66-aa8b-65b82a7884be tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:03.966248 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d80fdace-bbb1-4d66-aa8b-65b82a7884be tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:03.966733 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d80fdace-bbb1-4d66-aa8b-65b82a7884be tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:03.967160 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d80fdace-bbb1-4d66-aa8b-65b82a7884be tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:03.981817 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-d80fdace-bbb1-4d66-aa8b-65b82a7884be tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] HTTP exception thrown: Instance 4d9af823-60b4-4164-970f-953830099919 could not be found. Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d80fdace-bbb1-4d66-aa8b-65b82a7884be tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Request method failure captured: Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/4d9af823-60b4-4164-970f-953830099919 HTTP/1.1 Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3bmO06tkwYyt__-ZhN0po0pML47qM3kwM91owCm-ygb5W0MjiXE6WqnSfuPV-8-JoX9qu5Gsn3ZISZh57IXAk1Z5hecKpZgNrUW56Xl2DHHRPP28b96eSTRqLH9UdUAleJHH2hAoRnF4Nhqw_YtclV85YfBLD2pOI_9k-u_CLCb9Uo Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: a99294b9428b4abc991cc9957afe73a0 Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-766962720 Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a99294b9428b4abc991cc9957afe73a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a99294b9428b4abc991cc9957afe73a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a99294b9428b4abc991cc9957afe73a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a99294b9428b4abc991cc9957afe73a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-TestSecurityGroupsBasicOps-766962720 Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: a99294b9428b4abc991cc9957afe73a0 Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-766962720 Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-TestSecurityGroupsBasicOps-766962720-project Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: fefd5257355844e590c72435f4c45024 Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-TestSecurityGroupsBasicOps-766962720-project Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 4d9af823-60b4-4164-970f-953830099919 could not be found. Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '4d9af823-60b4-4164-970f-953830099919'} Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d9af823-60b4-4164-970f-953830099919 could not be found. Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d9af823-60b4-4164-970f-953830099919 could not be found. Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:32:03.983590 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:32:03.988647 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:32:03.988647 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:32:03.988647 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:32:03.988647 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:32:03.988647 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:32:03.988647 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d9af823-60b4-4164-970f-953830099919 could not be found. Sep 24 21:32:03.988647 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:32:03.988647 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d80fdace-bbb1-4d66-aa8b-65b82a7884be tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Returning 404 to user: Instance 4d9af823-60b4-4164-970f-953830099919 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:32:03.988647 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d80fdace-bbb1-4d66-aa8b-65b82a7884be tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] 10.222.0.52 "GET /compute/v2.1/servers/4d9af823-60b4-4164-970f-953830099919" status: 404 len: 111 microversion: 2.1 time: 0.032783 Sep 24 21:32:03.988647 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3139/6258] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:32:03 2022] GET /compute/v2.1/servers/4d9af823-60b4-4164-970f-953830099919 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:32:08.399114 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-abf25096-4720-46f8-9af3-22edb661080e tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:32:08.399631 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-abf25096-4720-46f8-9af3-22edb661080e tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] [instance: 58350d4b-9d77-4cd6-ae1b-221e729c20be] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:32:08.407678 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-abf25096-4720-46f8-9af3-22edb661080e tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:08.408322 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-abf25096-4720-46f8-9af3-22edb661080e tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:08.409027 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-abf25096-4720-46f8-9af3-22edb661080e tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:08.409746 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-abf25096-4720-46f8-9af3-22edb661080e tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:08.410218 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-abf25096-4720-46f8-9af3-22edb661080e tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:08.410951 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-abf25096-4720-46f8-9af3-22edb661080e tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:08.441082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-abf25096-4720-46f8-9af3-22edb661080e tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] [instance: 58350d4b-9d77-4cd6-ae1b-221e729c20be] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:32:08.481070 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-b39beea9-22ca-4031-81da-c5d7b22169eb req-31f1885d-fe30-4cbc-93e5-5d77ff9264d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58350d4b-9d77-4cd6-ae1b-221e729c20be", "tag": "b1e353fa-b422-46aa-b671-be7460af1450"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:32:08.495841 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-b39beea9-22ca-4031-81da-c5d7b22169eb req-31f1885d-fe30-4cbc-93e5-5d77ff9264d7 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:08.496334 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-b39beea9-22ca-4031-81da-c5d7b22169eb req-31f1885d-fe30-4cbc-93e5-5d77ff9264d7 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:08.496962 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-b39beea9-22ca-4031-81da-c5d7b22169eb req-31f1885d-fe30-4cbc-93e5-5d77ff9264d7 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:08.510079 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-b39beea9-22ca-4031-81da-c5d7b22169eb req-31f1885d-fe30-4cbc-93e5-5d77ff9264d7 service nova] Creating event network-changed:b1e353fa-b422-46aa-b671-be7460af1450 for instance 58350d4b-9d77-4cd6-ae1b-221e729c20be on nch1-master-1 Sep 24 21:32:08.515614 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-b39beea9-22ca-4031-81da-c5d7b22169eb req-31f1885d-fe30-4cbc-93e5-5d77ff9264d7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117486 Sep 24 21:32:08.519564 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3140/6259] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:32:08.527296 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-abf25096-4720-46f8-9af3-22edb661080e tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] 10.222.0.52 "DELETE /compute/v2.1/servers/58350d4b-9d77-4cd6-ae1b-221e729c20be" status: 204 len: 0 microversion: 2.1 time: 0.131722 Sep 24 21:32:08.527951 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3120/6260] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:32:08 2022] DELETE /compute/v2.1/servers/58350d4b-9d77-4cd6-ae1b-221e729c20be => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:32:08.540055 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d3329ae7-c2a9-459f-9c27-21573577e640 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:32:08.540949 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d3329ae7-c2a9-459f-9c27-21573577e640 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] [instance: 58350d4b-9d77-4cd6-ae1b-221e729c20be] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:32:08.548170 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3329ae7-c2a9-459f-9c27-21573577e640 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:08.548813 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3329ae7-c2a9-459f-9c27-21573577e640 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:08.549355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3329ae7-c2a9-459f-9c27-21573577e640 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:08.550215 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3329ae7-c2a9-459f-9c27-21573577e640 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:08.550806 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3329ae7-c2a9-459f-9c27-21573577e640 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:08.551350 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3329ae7-c2a9-459f-9c27-21573577e640 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:08.770314 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d3329ae7-c2a9-459f-9c27-21573577e640 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefd5257355844e590c72435f4c45024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99294b9428b4abc991cc9957afe73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:32:08.778320 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d3329ae7-c2a9-459f-9c27-21573577e640 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] 10.222.0.52 "GET /compute/v2.1/servers/58350d4b-9d77-4cd6-ae1b-221e729c20be" status: 200 len: 1767 microversion: 2.1 time: 0.245538 Sep 24 21:32:08.779121 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3141/6261] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:32:08 2022] GET /compute/v2.1/servers/58350d4b-9d77-4cd6-ae1b-221e729c20be => generated 1767 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:32:09.806278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b472601d-9dfc-4105-8dd4-f79c511e7cf3 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:32:09.807004 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b472601d-9dfc-4105-8dd4-f79c511e7cf3 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] [instance: 58350d4b-9d77-4cd6-ae1b-221e729c20be] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:32:09.814566 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b472601d-9dfc-4105-8dd4-f79c511e7cf3 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:09.815471 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b472601d-9dfc-4105-8dd4-f79c511e7cf3 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:09.816007 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b472601d-9dfc-4105-8dd4-f79c511e7cf3 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:09.816705 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b472601d-9dfc-4105-8dd4-f79c511e7cf3 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:09.817162 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b472601d-9dfc-4105-8dd4-f79c511e7cf3 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:09.817586 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b472601d-9dfc-4105-8dd4-f79c511e7cf3 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:09.960957 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b472601d-9dfc-4105-8dd4-f79c511e7cf3 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefd5257355844e590c72435f4c45024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99294b9428b4abc991cc9957afe73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:32:09.968813 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b472601d-9dfc-4105-8dd4-f79c511e7cf3 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] 10.222.0.52 "GET /compute/v2.1/servers/58350d4b-9d77-4cd6-ae1b-221e729c20be" status: 200 len: 1767 microversion: 2.1 time: 0.169377 Sep 24 21:32:09.969443 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3121/6262] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:32:09 2022] GET /compute/v2.1/servers/58350d4b-9d77-4cd6-ae1b-221e729c20be => generated 1767 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:32:10.814102 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-29e843d2-3796-4031-8513-debb56678a99 req-4a49a05c-f028-46f8-89bb-d31c6113f35e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58350d4b-9d77-4cd6-ae1b-221e729c20be", "name": "network-vif-deleted", "tag": "b1e353fa-b422-46aa-b671-be7460af1450"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:32:10.826688 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-29e843d2-3796-4031-8513-debb56678a99 req-4a49a05c-f028-46f8-89bb-d31c6113f35e service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:10.827203 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-29e843d2-3796-4031-8513-debb56678a99 req-4a49a05c-f028-46f8-89bb-d31c6113f35e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:10.827648 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-29e843d2-3796-4031-8513-debb56678a99 req-4a49a05c-f028-46f8-89bb-d31c6113f35e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:10.840566 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-29e843d2-3796-4031-8513-debb56678a99 req-4a49a05c-f028-46f8-89bb-d31c6113f35e service nova] Creating event network-vif-deleted:b1e353fa-b422-46aa-b671-be7460af1450 for instance 58350d4b-9d77-4cd6-ae1b-221e729c20be on nch1-master-1 Sep 24 21:32:10.845830 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-29e843d2-3796-4031-8513-debb56678a99 req-4a49a05c-f028-46f8-89bb-d31c6113f35e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035873 Sep 24 21:32:10.846444 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3142/6263] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:32:10.993087 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-00d31786-df33-49a2-933e-0bed56928f07 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:32:10.993838 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-00d31786-df33-49a2-933e-0bed56928f07 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] [instance: 58350d4b-9d77-4cd6-ae1b-221e729c20be] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:32:11.001468 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00d31786-df33-49a2-933e-0bed56928f07 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:11.002221 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00d31786-df33-49a2-933e-0bed56928f07 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:11.002701 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00d31786-df33-49a2-933e-0bed56928f07 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:11.003411 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00d31786-df33-49a2-933e-0bed56928f07 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:11.003902 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00d31786-df33-49a2-933e-0bed56928f07 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:11.004332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00d31786-df33-49a2-933e-0bed56928f07 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:11.036552 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00d31786-df33-49a2-933e-0bed56928f07 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:11.036969 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00d31786-df33-49a2-933e-0bed56928f07 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:11.037412 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-00d31786-df33-49a2-933e-0bed56928f07 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:11.037862 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-00d31786-df33-49a2-933e-0bed56928f07 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lazy-loading 'fault' on Instance uuid 58350d4b-9d77-4cd6-ae1b-221e729c20be {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:32:11.079969 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-00d31786-df33-49a2-933e-0bed56928f07 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefd5257355844e590c72435f4c45024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99294b9428b4abc991cc9957afe73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:32:11.088542 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-00d31786-df33-49a2-933e-0bed56928f07 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] 10.222.0.52 "GET /compute/v2.1/servers/58350d4b-9d77-4cd6-ae1b-221e729c20be" status: 200 len: 1383 microversion: 2.1 time: 0.099254 Sep 24 21:32:11.089252 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3122/6264] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:32:10 2022] GET /compute/v2.1/servers/58350d4b-9d77-4cd6-ae1b-221e729c20be => generated 1383 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:32:12.114477 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1e7fc8ac-2d26-4e4c-a41a-086022232bb6 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:32:12.115200 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1e7fc8ac-2d26-4e4c-a41a-086022232bb6 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] [instance: 58350d4b-9d77-4cd6-ae1b-221e729c20be] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:32:12.121427 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e7fc8ac-2d26-4e4c-a41a-086022232bb6 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:12.121911 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e7fc8ac-2d26-4e4c-a41a-086022232bb6 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:12.122348 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e7fc8ac-2d26-4e4c-a41a-086022232bb6 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:12.123071 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e7fc8ac-2d26-4e4c-a41a-086022232bb6 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:12.123524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e7fc8ac-2d26-4e4c-a41a-086022232bb6 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:12.123951 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e7fc8ac-2d26-4e4c-a41a-086022232bb6 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:12.137381 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-1e7fc8ac-2d26-4e4c-a41a-086022232bb6 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] HTTP exception thrown: Instance 58350d4b-9d77-4cd6-ae1b-221e729c20be could not be found. Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1e7fc8ac-2d26-4e4c-a41a-086022232bb6 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Request method failure captured: Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/58350d4b-9d77-4cd6-ae1b-221e729c20be HTTP/1.1 Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3bmO06tkwYyt__-ZhN0po0pML47qM3kwM91owCm-ygb5W0MjiXE6WqnSfuPV-8-JoX9qu5Gsn3ZISZh57IXAk1Z5hecKpZgNrUW56Xl2DHHRPP28b96eSTRqLH9UdUAleJHH2hAoRnF4Nhqw_YtclV85YfBLD2pOI_9k-u_CLCb9Uo Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: a99294b9428b4abc991cc9957afe73a0 Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-766962720 Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a99294b9428b4abc991cc9957afe73a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a99294b9428b4abc991cc9957afe73a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a99294b9428b4abc991cc9957afe73a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a99294b9428b4abc991cc9957afe73a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-TestSecurityGroupsBasicOps-766962720 Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: a99294b9428b4abc991cc9957afe73a0 Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-766962720 Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-TestSecurityGroupsBasicOps-766962720-project Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: fefd5257355844e590c72435f4c45024 Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-TestSecurityGroupsBasicOps-766962720-project Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 58350d4b-9d77-4cd6-ae1b-221e729c20be could not be found. Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '58350d4b-9d77-4cd6-ae1b-221e729c20be'} Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58350d4b-9d77-4cd6-ae1b-221e729c20be could not be found. Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58350d4b-9d77-4cd6-ae1b-221e729c20be could not be found. Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:32:12.139002 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:32:12.143701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:32:12.143701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:32:12.143701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:32:12.143701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:32:12.143701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:32:12.143701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58350d4b-9d77-4cd6-ae1b-221e729c20be could not be found. Sep 24 21:32:12.143701 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:32:12.143701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1e7fc8ac-2d26-4e4c-a41a-086022232bb6 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Returning 404 to user: Instance 58350d4b-9d77-4cd6-ae1b-221e729c20be could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:32:12.143701 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1e7fc8ac-2d26-4e4c-a41a-086022232bb6 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] 10.222.0.52 "GET /compute/v2.1/servers/58350d4b-9d77-4cd6-ae1b-221e729c20be" status: 404 len: 111 microversion: 2.1 time: 0.031418 Sep 24 21:32:12.143701 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3143/6265] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:32:12 2022] GET /compute/v2.1/servers/58350d4b-9d77-4cd6-ae1b-221e729c20be => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:32:15.550068 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-348766c7-c845-424b-bdfa-c8034b946191 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] Calling method '.version_select at 0x7f4b0742ec10>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:32:15.570067 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-348766c7-c845-424b-bdfa-c8034b946191 tempest-TestSecurityGroupsBasicOps-766962720 tempest-TestSecurityGroupsBasicOps-766962720-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-417999275" status: 202 len: 0 microversion: 2.1 time: 0.024449 Sep 24 21:32:15.570694 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3123/6266] 10.222.0.52 () {58 vars in 1275 bytes} [Sat Sep 24 21:32:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-417999275 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:32:27.304222 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=32 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:32:27.304995 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=64 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:32:27.479938 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-377f095a-ac25-46f5-8128-23830e2fab09 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Action: 'create', calling method: .version_select at 0x7f4b07372dc0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1509447138", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCjAmC6g/qIGCnYMXlte64HRyho1XOjxWco9urETKbbspjqsl3/OXe8k9cQWkSGCKg3rLT6fecfbxxbyW0JgaE2VbpcksrK0RPSpM6sW79m+KQ6AENmmk4Kkm5kMy6viQ=="}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:32:27.496071 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-377f095a-ac25-46f5-8128-23830e2fab09 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Getting quotas for project b690f172fad842e1a0f8d70a5ef27f5b. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:32:27.501715 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-377f095a-ac25-46f5-8128-23830e2fab09 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Getting quotas for user e8e099c4b8e74ce390c1893e70bcf600 and project b690f172fad842e1a0f8d70a5ef27f5b. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:32:27.531167 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-377f095a-ac25-46f5-8128-23830e2fab09 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.232002 Sep 24 21:32:27.531906 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3144/6267] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 21:32:27 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:32:28.742207 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:32:28.742994 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:32:28.747533 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c981e812-2631-46d4-b351-2de3fcb1362f tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1249818507", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1509447138", "security_groups": [{"name": "tempest-secgroup-smoke-1340720333"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "4002611e-89c7-4215-b274-2d2e236a4ce2"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:32:28.862464 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-c981e812-2631-46d4-b351-2de3fcb1362f tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] validate_networks() for [('4002611e-89c7-4215-b274-2d2e236a4ce2', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:32:29.270650 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-c981e812-2631-46d4-b351-2de3fcb1362f tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Getting quotas for project b690f172fad842e1a0f8d70a5ef27f5b. Resources: dict_keys(['metadata_items']) {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:32:29.276395 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-c981e812-2631-46d4-b351-2de3fcb1362f tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Getting quotas for user e8e099c4b8e74ce390c1893e70bcf600 and project b690f172fad842e1a0f8d70a5ef27f5b. Resources: dict_keys(['metadata_items']) {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:32:29.290354 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-c981e812-2631-46d4-b351-2de3fcb1362f tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:32:29.290948 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-c981e812-2631-46d4-b351-2de3fcb1362f tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:32:29.291517 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-c981e812-2631-46d4-b351-2de3fcb1362f tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:32:29.292037 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-c981e812-2631-46d4-b351-2de3fcb1362f tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:32:29.292562 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-c981e812-2631-46d4-b351-2de3fcb1362f tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:32:29.302601 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c981e812-2631-46d4-b351-2de3fcb1362f tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:29.303248 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c981e812-2631-46d4-b351-2de3fcb1362f tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:29.303784 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c981e812-2631-46d4-b351-2de3fcb1362f tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:29.304595 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c981e812-2631-46d4-b351-2de3fcb1362f tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:29.305131 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c981e812-2631-46d4-b351-2de3fcb1362f tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:29.305696 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c981e812-2631-46d4-b351-2de3fcb1362f tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:29.325444 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-c981e812-2631-46d4-b351-2de3fcb1362f tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Getting quotas for project b690f172fad842e1a0f8d70a5ef27f5b. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:32:29.331479 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-c981e812-2631-46d4-b351-2de3fcb1362f tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Getting quotas for user e8e099c4b8e74ce390c1893e70bcf600 and project b690f172fad842e1a0f8d70a5ef27f5b. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:32:29.344545 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c981e812-2631-46d4-b351-2de3fcb1362f tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:32:29.347226 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c981e812-2631-46d4-b351-2de3fcb1362f tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] [instance: e9ba238f-7257-4a72-a02d-85696c9689d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:32:29.398192 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c981e812-2631-46d4-b351-2de3fcb1362f tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.657724 Sep 24 21:32:29.399084 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3124/6268] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:32:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:32:29.411048 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dacedbc9-12fa-4d64-90fe-c26d4e40f625 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:32:29.411989 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dacedbc9-12fa-4d64-90fe-c26d4e40f625 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] [instance: e9ba238f-7257-4a72-a02d-85696c9689d2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:32:29.478703 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dacedbc9-12fa-4d64-90fe-c26d4e40f625 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e099c4b8e74ce390c1893e70bcf600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b690f172fad842e1a0f8d70a5ef27f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:32:29.486784 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dacedbc9-12fa-4d64-90fe-c26d4e40f625 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] 10.222.0.52 "GET /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2" status: 200 len: 1303 microversion: 2.1 time: 0.080396 Sep 24 21:32:29.487486 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3145/6269] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:32:29 2022] GET /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2 => generated 1303 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:32:30.511260 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-acf893cb-c0ae-4a6a-ba31-0cb50e4c97ae tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:32:30.511885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-acf893cb-c0ae-4a6a-ba31-0cb50e4c97ae tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] [instance: e9ba238f-7257-4a72-a02d-85696c9689d2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:32:30.519140 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-acf893cb-c0ae-4a6a-ba31-0cb50e4c97ae tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:30.519631 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-acf893cb-c0ae-4a6a-ba31-0cb50e4c97ae tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:30.520072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-acf893cb-c0ae-4a6a-ba31-0cb50e4c97ae tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:30.520767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-acf893cb-c0ae-4a6a-ba31-0cb50e4c97ae tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:30.521223 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-acf893cb-c0ae-4a6a-ba31-0cb50e4c97ae tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:30.521647 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-acf893cb-c0ae-4a6a-ba31-0cb50e4c97ae tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:30.586418 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-acf893cb-c0ae-4a6a-ba31-0cb50e4c97ae tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e099c4b8e74ce390c1893e70bcf600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b690f172fad842e1a0f8d70a5ef27f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:32:30.597056 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-acf893cb-c0ae-4a6a-ba31-0cb50e4c97ae tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] 10.222.0.52 "GET /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2" status: 200 len: 1355 microversion: 2.1 time: 0.090488 Sep 24 21:32:30.597972 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3125/6270] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:32:30 2022] GET /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2 => generated 1355 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:32:31.621732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fb1e15ec-5225-4458-bd3c-95c6727854ab tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:32:31.622354 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fb1e15ec-5225-4458-bd3c-95c6727854ab tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] [instance: e9ba238f-7257-4a72-a02d-85696c9689d2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:32:31.629897 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb1e15ec-5225-4458-bd3c-95c6727854ab tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:31.630921 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb1e15ec-5225-4458-bd3c-95c6727854ab tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:31.631522 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb1e15ec-5225-4458-bd3c-95c6727854ab tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:31.632399 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb1e15ec-5225-4458-bd3c-95c6727854ab tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:31.632994 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb1e15ec-5225-4458-bd3c-95c6727854ab tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:31.633558 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb1e15ec-5225-4458-bd3c-95c6727854ab tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:31.955020 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fb1e15ec-5225-4458-bd3c-95c6727854ab tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e099c4b8e74ce390c1893e70bcf600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b690f172fad842e1a0f8d70a5ef27f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:32:31.966001 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fb1e15ec-5225-4458-bd3c-95c6727854ab tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] 10.222.0.52 "GET /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2" status: 200 len: 1429 microversion: 2.1 time: 0.347852 Sep 24 21:32:31.966861 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3146/6271] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:32:31 2022] GET /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2 => generated 1429 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:32:32.579522 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-3e932819-98c4-4ed8-9a91-0a70d4b49973 req-3d75ef14-03a6-4d36-b232-53d826e79bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9ba238f-7257-4a72-a02d-85696c9689d2", "tag": "7e50e7df-bda7-42ce-afaf-3b597f834fb1"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:32:32.591458 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-3e932819-98c4-4ed8-9a91-0a70d4b49973 req-3d75ef14-03a6-4d36-b232-53d826e79bd4 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:32.592033 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-3e932819-98c4-4ed8-9a91-0a70d4b49973 req-3d75ef14-03a6-4d36-b232-53d826e79bd4 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:32.592546 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-3e932819-98c4-4ed8-9a91-0a70d4b49973 req-3d75ef14-03a6-4d36-b232-53d826e79bd4 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:32.604950 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-3e932819-98c4-4ed8-9a91-0a70d4b49973 req-3d75ef14-03a6-4d36-b232-53d826e79bd4 service nova] Creating event network-changed:7e50e7df-bda7-42ce-afaf-3b597f834fb1 for instance e9ba238f-7257-4a72-a02d-85696c9689d2 on nch2-master-1 Sep 24 21:32:32.609839 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-3e932819-98c4-4ed8-9a91-0a70d4b49973 req-3d75ef14-03a6-4d36-b232-53d826e79bd4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034297 Sep 24 21:32:32.611190 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3126/6272] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:32:32.992409 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8ad1fa78-2e18-4661-8718-f9249dcef6ec tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:32:32.993225 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8ad1fa78-2e18-4661-8718-f9249dcef6ec tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] [instance: e9ba238f-7257-4a72-a02d-85696c9689d2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:32:33.000878 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8ad1fa78-2e18-4661-8718-f9249dcef6ec tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:33.001368 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8ad1fa78-2e18-4661-8718-f9249dcef6ec tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:33.001980 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8ad1fa78-2e18-4661-8718-f9249dcef6ec tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:33.002935 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8ad1fa78-2e18-4661-8718-f9249dcef6ec tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:33.003550 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8ad1fa78-2e18-4661-8718-f9249dcef6ec tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:33.003984 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8ad1fa78-2e18-4661-8718-f9249dcef6ec tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:33.151092 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8ad1fa78-2e18-4661-8718-f9249dcef6ec tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e099c4b8e74ce390c1893e70bcf600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b690f172fad842e1a0f8d70a5ef27f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:32:33.159841 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8ad1fa78-2e18-4661-8718-f9249dcef6ec tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] 10.222.0.52 "GET /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2" status: 200 len: 1429 microversion: 2.1 time: 0.171407 Sep 24 21:32:33.160719 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3147/6273] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:32:32 2022] GET /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2 => generated 1429 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:32:34.185071 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-052abf38-5e99-496b-8693-32685a0db4f1 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:32:34.185716 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-052abf38-5e99-496b-8693-32685a0db4f1 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] [instance: e9ba238f-7257-4a72-a02d-85696c9689d2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:32:34.192338 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-052abf38-5e99-496b-8693-32685a0db4f1 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:34.192839 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-052abf38-5e99-496b-8693-32685a0db4f1 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:34.193286 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-052abf38-5e99-496b-8693-32685a0db4f1 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:34.194003 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-052abf38-5e99-496b-8693-32685a0db4f1 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:34.194470 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-052abf38-5e99-496b-8693-32685a0db4f1 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:34.194928 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-052abf38-5e99-496b-8693-32685a0db4f1 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:34.406295 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-052abf38-5e99-496b-8693-32685a0db4f1 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e099c4b8e74ce390c1893e70bcf600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b690f172fad842e1a0f8d70a5ef27f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:32:34.416182 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-052abf38-5e99-496b-8693-32685a0db4f1 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] 10.222.0.52 "GET /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2" status: 200 len: 1429 microversion: 2.1 time: 0.236315 Sep 24 21:32:34.416777 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3127/6274] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:32:34 2022] GET /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2 => generated 1429 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:32:35.439346 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3d28f5bc-34e9-4a8b-a530-0edd492cb0b7 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:32:35.439974 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3d28f5bc-34e9-4a8b-a530-0edd492cb0b7 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] [instance: e9ba238f-7257-4a72-a02d-85696c9689d2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:32:35.447099 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d28f5bc-34e9-4a8b-a530-0edd492cb0b7 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:35.447591 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d28f5bc-34e9-4a8b-a530-0edd492cb0b7 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:35.448030 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d28f5bc-34e9-4a8b-a530-0edd492cb0b7 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:35.448731 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d28f5bc-34e9-4a8b-a530-0edd492cb0b7 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:35.449196 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d28f5bc-34e9-4a8b-a530-0edd492cb0b7 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:35.449622 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d28f5bc-34e9-4a8b-a530-0edd492cb0b7 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:35.582047 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3d28f5bc-34e9-4a8b-a530-0edd492cb0b7 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e099c4b8e74ce390c1893e70bcf600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b690f172fad842e1a0f8d70a5ef27f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:32:35.590152 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3d28f5bc-34e9-4a8b-a530-0edd492cb0b7 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] 10.222.0.52 "GET /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2" status: 200 len: 1429 microversion: 2.1 time: 0.154751 Sep 24 21:32:35.590759 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3148/6275] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:32:35 2022] GET /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2 => generated 1429 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:32:36.614598 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b24f098b-8b00-410e-852d-e8a375055838 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:32:36.615222 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b24f098b-8b00-410e-852d-e8a375055838 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] [instance: e9ba238f-7257-4a72-a02d-85696c9689d2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:32:36.622122 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b24f098b-8b00-410e-852d-e8a375055838 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:36.622651 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b24f098b-8b00-410e-852d-e8a375055838 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:36.623101 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b24f098b-8b00-410e-852d-e8a375055838 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:36.623800 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b24f098b-8b00-410e-852d-e8a375055838 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:36.624266 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b24f098b-8b00-410e-852d-e8a375055838 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:36.624697 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b24f098b-8b00-410e-852d-e8a375055838 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:36.776781 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b24f098b-8b00-410e-852d-e8a375055838 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e099c4b8e74ce390c1893e70bcf600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b690f172fad842e1a0f8d70a5ef27f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:32:36.785727 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b24f098b-8b00-410e-852d-e8a375055838 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] 10.222.0.52 "GET /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2" status: 200 len: 1429 microversion: 2.1 time: 0.175265 Sep 24 21:32:36.786324 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3128/6276] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:32:36 2022] GET /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2 => generated 1429 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:32:37.809682 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1065afec-e5df-431c-8243-95e58c78c9d3 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:32:37.810303 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1065afec-e5df-431c-8243-95e58c78c9d3 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] [instance: e9ba238f-7257-4a72-a02d-85696c9689d2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:32:37.817405 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1065afec-e5df-431c-8243-95e58c78c9d3 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:37.817891 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1065afec-e5df-431c-8243-95e58c78c9d3 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:37.818335 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1065afec-e5df-431c-8243-95e58c78c9d3 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:37.819069 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1065afec-e5df-431c-8243-95e58c78c9d3 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:37.819551 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1065afec-e5df-431c-8243-95e58c78c9d3 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:37.819967 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1065afec-e5df-431c-8243-95e58c78c9d3 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:37.955159 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1065afec-e5df-431c-8243-95e58c78c9d3 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e099c4b8e74ce390c1893e70bcf600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b690f172fad842e1a0f8d70a5ef27f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:32:37.962878 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1065afec-e5df-431c-8243-95e58c78c9d3 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] 10.222.0.52 "GET /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2" status: 200 len: 1429 microversion: 2.1 time: 0.157133 Sep 24 21:32:37.963458 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3149/6277] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:32:37 2022] GET /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2 => generated 1429 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:32:38.717573 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-5a7f2f25-a90b-4602-9263-ce33dd512ccf req-19818fda-6e7f-40ff-8b67-f51f0cf362c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9ba238f-7257-4a72-a02d-85696c9689d2", "name": "network-vif-plugged", "status": "completed", "tag": "7e50e7df-bda7-42ce-afaf-3b597f834fb1"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:32:38.731455 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-5a7f2f25-a90b-4602-9263-ce33dd512ccf req-19818fda-6e7f-40ff-8b67-f51f0cf362c2 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:38.731949 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-5a7f2f25-a90b-4602-9263-ce33dd512ccf req-19818fda-6e7f-40ff-8b67-f51f0cf362c2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:38.732384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-5a7f2f25-a90b-4602-9263-ce33dd512ccf req-19818fda-6e7f-40ff-8b67-f51f0cf362c2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:38.744353 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-5a7f2f25-a90b-4602-9263-ce33dd512ccf req-19818fda-6e7f-40ff-8b67-f51f0cf362c2 service nova] Creating event network-vif-plugged:7e50e7df-bda7-42ce-afaf-3b597f834fb1 for instance e9ba238f-7257-4a72-a02d-85696c9689d2 on nch2-master-1 Sep 24 21:32:38.749541 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-5a7f2f25-a90b-4602-9263-ce33dd512ccf req-19818fda-6e7f-40ff-8b67-f51f0cf362c2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036110 Sep 24 21:32:38.750248 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3129/6278] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:32:38.986007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-593918fe-1232-4cd3-816f-93c6b141df45 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:32:38.986799 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-593918fe-1232-4cd3-816f-93c6b141df45 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] [instance: e9ba238f-7257-4a72-a02d-85696c9689d2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:32:38.994839 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-593918fe-1232-4cd3-816f-93c6b141df45 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:38.995737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-593918fe-1232-4cd3-816f-93c6b141df45 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:38.996558 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-593918fe-1232-4cd3-816f-93c6b141df45 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:38.997848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-593918fe-1232-4cd3-816f-93c6b141df45 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:38.998762 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-593918fe-1232-4cd3-816f-93c6b141df45 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:38.999583 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-593918fe-1232-4cd3-816f-93c6b141df45 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:39.135112 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-593918fe-1232-4cd3-816f-93c6b141df45 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e099c4b8e74ce390c1893e70bcf600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b690f172fad842e1a0f8d70a5ef27f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:32:39.143796 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-593918fe-1232-4cd3-816f-93c6b141df45 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] 10.222.0.52 "GET /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2" status: 200 len: 1429 microversion: 2.1 time: 0.161690 Sep 24 21:32:39.144377 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3150/6279] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:32:38 2022] GET /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2 => generated 1429 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:32:40.164728 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:32:40.165432 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=10 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:32:40.171001 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c8e3927a-da93-41d3-8940-9ce3a3b4a57c tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:32:40.171701 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c8e3927a-da93-41d3-8940-9ce3a3b4a57c tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] [instance: e9ba238f-7257-4a72-a02d-85696c9689d2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:32:40.179315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8e3927a-da93-41d3-8940-9ce3a3b4a57c tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:40.179799 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8e3927a-da93-41d3-8940-9ce3a3b4a57c tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:40.180239 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8e3927a-da93-41d3-8940-9ce3a3b4a57c tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:40.180926 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8e3927a-da93-41d3-8940-9ce3a3b4a57c tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:40.181379 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8e3927a-da93-41d3-8940-9ce3a3b4a57c tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:40.181808 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8e3927a-da93-41d3-8940-9ce3a3b4a57c tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:40.313785 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c8e3927a-da93-41d3-8940-9ce3a3b4a57c tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e099c4b8e74ce390c1893e70bcf600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b690f172fad842e1a0f8d70a5ef27f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:32:40.321632 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c8e3927a-da93-41d3-8940-9ce3a3b4a57c tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] 10.222.0.52 "GET /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2" status: 200 len: 1609 microversion: 2.1 time: 0.157979 Sep 24 21:32:40.322204 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3130/6280] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:32:40 2022] GET /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2 => generated 1609 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:32:40.344187 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-35519e83-9cd0-477d-a81a-621ccb013863 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:32:40.345361 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-35519e83-9cd0-477d-a81a-621ccb013863 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] [instance: e9ba238f-7257-4a72-a02d-85696c9689d2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:32:40.347372 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=6 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:32:40.353477 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-35519e83-9cd0-477d-a81a-621ccb013863 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:40.353968 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-35519e83-9cd0-477d-a81a-621ccb013863 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:40.354410 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-35519e83-9cd0-477d-a81a-621ccb013863 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:40.355140 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-35519e83-9cd0-477d-a81a-621ccb013863 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:40.355631 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-35519e83-9cd0-477d-a81a-621ccb013863 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:40.356049 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-35519e83-9cd0-477d-a81a-621ccb013863 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:40.490669 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-35519e83-9cd0-477d-a81a-621ccb013863 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e099c4b8e74ce390c1893e70bcf600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b690f172fad842e1a0f8d70a5ef27f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:32:40.498330 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-35519e83-9cd0-477d-a81a-621ccb013863 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] 10.222.0.52 "GET /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2" status: 200 len: 1609 microversion: 2.1 time: 0.157992 Sep 24 21:32:40.498935 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3151/6281] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:32:40 2022] GET /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2 => generated 1609 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:32:40.521300 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d3a7f017-e2a0-4d22-8a2b-566a87c8e824 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:32:40.521921 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d3a7f017-e2a0-4d22-8a2b-566a87c8e824 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] [instance: e9ba238f-7257-4a72-a02d-85696c9689d2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:32:40.527997 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d3a7f017-e2a0-4d22-8a2b-566a87c8e824 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:40.528488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d3a7f017-e2a0-4d22-8a2b-566a87c8e824 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:40.528984 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d3a7f017-e2a0-4d22-8a2b-566a87c8e824 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:40.529687 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d3a7f017-e2a0-4d22-8a2b-566a87c8e824 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:40.530149 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d3a7f017-e2a0-4d22-8a2b-566a87c8e824 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:40.530613 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d3a7f017-e2a0-4d22-8a2b-566a87c8e824 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:40.662292 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d3a7f017-e2a0-4d22-8a2b-566a87c8e824 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e099c4b8e74ce390c1893e70bcf600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b690f172fad842e1a0f8d70a5ef27f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:32:40.670086 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d3a7f017-e2a0-4d22-8a2b-566a87c8e824 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] 10.222.0.52 "GET /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2" status: 200 len: 1609 microversion: 2.1 time: 0.153353 Sep 24 21:32:40.670682 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3131/6282] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:32:40 2022] GET /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2 => generated 1609 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:32:42.332992 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-e8b60bf2-d6e8-40c7-bc6e-f6b035e3003e req-71c503d6-914b-44dd-9576-7d8fb0913d09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9ba238f-7257-4a72-a02d-85696c9689d2", "tag": "7e50e7df-bda7-42ce-afaf-3b597f834fb1"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:32:42.343484 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e8b60bf2-d6e8-40c7-bc6e-f6b035e3003e req-71c503d6-914b-44dd-9576-7d8fb0913d09 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:32:42.343976 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e8b60bf2-d6e8-40c7-bc6e-f6b035e3003e req-71c503d6-914b-44dd-9576-7d8fb0913d09 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:32:42.344417 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e8b60bf2-d6e8-40c7-bc6e-f6b035e3003e req-71c503d6-914b-44dd-9576-7d8fb0913d09 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:32:42.356563 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-e8b60bf2-d6e8-40c7-bc6e-f6b035e3003e req-71c503d6-914b-44dd-9576-7d8fb0913d09 service nova] Creating event network-changed:7e50e7df-bda7-42ce-afaf-3b597f834fb1 for instance e9ba238f-7257-4a72-a02d-85696c9689d2 on nch2-master-1 Sep 24 21:32:42.362434 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-e8b60bf2-d6e8-40c7-bc6e-f6b035e3003e req-71c503d6-914b-44dd-9576-7d8fb0913d09 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033165 Sep 24 21:32:42.363080 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3152/6283] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:33:18.537551 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9e38942e-b751-45b3-afb2-42161443e314 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:33:18.538150 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9e38942e-b751-45b3-afb2-42161443e314 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] [instance: e9ba238f-7257-4a72-a02d-85696c9689d2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:33:18.540218 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:33:18.540943 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=36 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:33:18.546572 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e38942e-b751-45b3-afb2-42161443e314 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:33:18.547073 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e38942e-b751-45b3-afb2-42161443e314 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:33:18.547521 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e38942e-b751-45b3-afb2-42161443e314 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:33:18.548231 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e38942e-b751-45b3-afb2-42161443e314 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:33:18.548753 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e38942e-b751-45b3-afb2-42161443e314 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:33:18.549417 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e38942e-b751-45b3-afb2-42161443e314 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:33:18.575793 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9e38942e-b751-45b3-afb2-42161443e314 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] 10.222.0.52 "GET /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.042942 Sep 24 21:33:18.576366 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3132/6284] 10.222.0.52 () {58 vars in 1293 bytes} [Sat Sep 24 21:33:18 2022] GET /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2/os-server-password => generated 116 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:37:22.015753 ncdv-master-1 devstack@n-api.service[140517]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e1087534-8c05-43ce-a203-528e6b6bc7c7] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 24 21:37:22.016605 ncdv-master-1 devstack@n-api.service[140517]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aa974483-35f8-468d-af64-c307bf04d159] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 24 21:37:22.017213 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:37:22.018146 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=38 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:37:22.019501 ncdv-master-1 devstack@n-api.service[140517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 24 21:37:22.019638 ncdv-master-1 devstack@n-api.service[140517]: Sat Sep 24 21:37:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2 (ip 10.222.0.52) !!! Sep 24 21:37:22.020858 ncdv-master-1 devstack@n-api.service[140517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 21:37:22.020976 ncdv-master-1 devstack@n-api.service[140517]: Sat Sep 24 21:37:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2 (ip 10.222.0.52) !!! Sep 24 21:37:22.022099 ncdv-master-1 devstack@n-api.service[140517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 24 21:37:22.022204 ncdv-master-1 devstack@n-api.service[140517]: Sat Sep 24 21:37:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2 (ip 10.222.0.52) !!! Sep 24 21:37:22.029161 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-96c67b64-46c1-416c-9bfd-2cb55cfc9225 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:37:22.029762 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-96c67b64-46c1-416c-9bfd-2cb55cfc9225 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] [instance: e9ba238f-7257-4a72-a02d-85696c9689d2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:37:22.042099 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96c67b64-46c1-416c-9bfd-2cb55cfc9225 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:22.042623 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96c67b64-46c1-416c-9bfd-2cb55cfc9225 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:22.043071 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96c67b64-46c1-416c-9bfd-2cb55cfc9225 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:22.043775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96c67b64-46c1-416c-9bfd-2cb55cfc9225 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:22.044237 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96c67b64-46c1-416c-9bfd-2cb55cfc9225 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:22.044679 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96c67b64-46c1-416c-9bfd-2cb55cfc9225 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:22.072180 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-96c67b64-46c1-416c-9bfd-2cb55cfc9225 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] [instance: e9ba238f-7257-4a72-a02d-85696c9689d2] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:37:22.148001 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-96c67b64-46c1-416c-9bfd-2cb55cfc9225 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2" status: 204 len: 0 microversion: 2.1 time: 0.133835 Sep 24 21:37:22.148770 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3153/6285] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:37:22 2022] DELETE /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:37:22.155983 ncdv-master-1 devstack@n-api.service[140516]: ERROR oslo.messaging._drivers.impl_rabbit [-] [75d0407e-7b02-4bce-a3f1-1c13562673e6] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 24 21:37:22.156924 ncdv-master-1 devstack@n-api.service[140516]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ec046047-61d1-42c1-9e5b-9695ac0fd1f9] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 24 21:37:22.157405 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:37:22.158146 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=4 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:37:22.159693 ncdv-master-1 devstack@n-api.service[140516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 24 21:37:22.159804 ncdv-master-1 devstack@n-api.service[140516]: Sat Sep 24 21:37:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2 (ip 10.222.0.52) !!! Sep 24 21:37:22.161745 ncdv-master-1 devstack@n-api.service[140516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 24 21:37:22.161878 ncdv-master-1 devstack@n-api.service[140516]: Sat Sep 24 21:37:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2 (ip 10.222.0.52) !!! Sep 24 21:37:22.164414 ncdv-master-1 devstack@n-api.service[140516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 24 21:37:22.164522 ncdv-master-1 devstack@n-api.service[140516]: Sat Sep 24 21:37:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2 (ip 10.222.0.52) !!! Sep 24 21:37:22.182378 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c22f9999-7c07-40d3-9971-97c8f4888cd5 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:37:22.183048 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c22f9999-7c07-40d3-9971-97c8f4888cd5 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] [instance: e9ba238f-7257-4a72-a02d-85696c9689d2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:37:22.193434 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c22f9999-7c07-40d3-9971-97c8f4888cd5 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:22.193926 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c22f9999-7c07-40d3-9971-97c8f4888cd5 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:22.194372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c22f9999-7c07-40d3-9971-97c8f4888cd5 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:22.195121 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c22f9999-7c07-40d3-9971-97c8f4888cd5 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:22.195590 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c22f9999-7c07-40d3-9971-97c8f4888cd5 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:22.196026 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c22f9999-7c07-40d3-9971-97c8f4888cd5 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:22.400873 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c22f9999-7c07-40d3-9971-97c8f4888cd5 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e099c4b8e74ce390c1893e70bcf600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b690f172fad842e1a0f8d70a5ef27f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:37:22.408675 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c22f9999-7c07-40d3-9971-97c8f4888cd5 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] 10.222.0.52 "GET /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2" status: 200 len: 1733 microversion: 2.1 time: 0.255861 Sep 24 21:37:22.409248 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3133/6286] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:37:22 2022] GET /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2 => generated 1733 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:37:23.435351 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-22f1c790-30ba-4843-a2e7-32dfb998d88d tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:37:23.436129 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-22f1c790-30ba-4843-a2e7-32dfb998d88d tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] [instance: e9ba238f-7257-4a72-a02d-85696c9689d2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:37:23.450158 ncdv-master-1 devstack@n-api.service[140517]: INFO oslo.messaging._drivers.impl_rabbit [-] [aa974483-35f8-468d-af64-c307bf04d159] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 56142. Sep 24 21:37:23.452383 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22f1c790-30ba-4843-a2e7-32dfb998d88d tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:23.452908 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22f1c790-30ba-4843-a2e7-32dfb998d88d tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:23.453375 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22f1c790-30ba-4843-a2e7-32dfb998d88d tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:23.454086 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22f1c790-30ba-4843-a2e7-32dfb998d88d tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:23.454578 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22f1c790-30ba-4843-a2e7-32dfb998d88d tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:23.455067 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-22f1c790-30ba-4843-a2e7-32dfb998d88d tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:23.462816 ncdv-master-1 devstack@n-api.service[140517]: INFO oslo.messaging._drivers.impl_rabbit [-] [e1087534-8c05-43ce-a203-528e6b6bc7c7] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 56140. Sep 24 21:37:23.653089 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-22f1c790-30ba-4843-a2e7-32dfb998d88d tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e099c4b8e74ce390c1893e70bcf600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b690f172fad842e1a0f8d70a5ef27f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:37:23.661718 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-22f1c790-30ba-4843-a2e7-32dfb998d88d tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] 10.222.0.52 "GET /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2" status: 200 len: 1733 microversion: 2.1 time: 0.232269 Sep 24 21:37:23.662296 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3154/6287] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:37:23 2022] GET /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2 => generated 1733 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:37:24.686598 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0716b6d0-18d8-4314-b545-56d9cdf79e16 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:37:24.687256 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0716b6d0-18d8-4314-b545-56d9cdf79e16 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] [instance: e9ba238f-7257-4a72-a02d-85696c9689d2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:37:24.703078 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0716b6d0-18d8-4314-b545-56d9cdf79e16 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:24.703578 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0716b6d0-18d8-4314-b545-56d9cdf79e16 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:24.704032 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0716b6d0-18d8-4314-b545-56d9cdf79e16 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:24.704754 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0716b6d0-18d8-4314-b545-56d9cdf79e16 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:24.705220 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0716b6d0-18d8-4314-b545-56d9cdf79e16 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:24.705653 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0716b6d0-18d8-4314-b545-56d9cdf79e16 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:24.709672 ncdv-master-1 devstack@n-api.service[140516]: INFO oslo.messaging._drivers.impl_rabbit [-] [75d0407e-7b02-4bce-a3f1-1c13562673e6] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 56148. Sep 24 21:37:24.714130 ncdv-master-1 devstack@n-api.service[140516]: INFO oslo.messaging._drivers.impl_rabbit [-] [ec046047-61d1-42c1-9e5b-9695ac0fd1f9] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 56150. Sep 24 21:37:24.785868 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0716b6d0-18d8-4314-b545-56d9cdf79e16 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e099c4b8e74ce390c1893e70bcf600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b690f172fad842e1a0f8d70a5ef27f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:37:24.794358 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0716b6d0-18d8-4314-b545-56d9cdf79e16 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] 10.222.0.52 "GET /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2" status: 200 len: 1665 microversion: 2.1 time: 0.111805 Sep 24 21:37:24.794978 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3134/6288] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:37:24 2022] GET /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2 => generated 1665 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:37:25.044392 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-d6927bd0-c923-4be3-92e6-5fb5a4f2319f req-a2992f9e-385c-4768-95f3-7514a683b1a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9ba238f-7257-4a72-a02d-85696c9689d2", "name": "network-vif-deleted", "tag": "7e50e7df-bda7-42ce-afaf-3b597f834fb1"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:37:25.059524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-d6927bd0-c923-4be3-92e6-5fb5a4f2319f req-a2992f9e-385c-4768-95f3-7514a683b1a6 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:25.060515 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-d6927bd0-c923-4be3-92e6-5fb5a4f2319f req-a2992f9e-385c-4768-95f3-7514a683b1a6 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:25.061378 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-d6927bd0-c923-4be3-92e6-5fb5a4f2319f req-a2992f9e-385c-4768-95f3-7514a683b1a6 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:25.084369 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-d6927bd0-c923-4be3-92e6-5fb5a4f2319f req-a2992f9e-385c-4768-95f3-7514a683b1a6 service nova] Creating event network-vif-deleted:7e50e7df-bda7-42ce-afaf-3b597f834fb1 for instance e9ba238f-7257-4a72-a02d-85696c9689d2 on nch2-master-1 Sep 24 21:37:25.091838 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-d6927bd0-c923-4be3-92e6-5fb5a4f2319f req-a2992f9e-385c-4768-95f3-7514a683b1a6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133257 Sep 24 21:37:25.092496 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3155/6289] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:37:25.818086 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6f27257d-6ecf-4fc2-970e-a18b5bc4da3c tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:37:25.818652 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6f27257d-6ecf-4fc2-970e-a18b5bc4da3c tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] [instance: e9ba238f-7257-4a72-a02d-85696c9689d2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:37:25.826075 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f27257d-6ecf-4fc2-970e-a18b5bc4da3c tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:25.826598 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f27257d-6ecf-4fc2-970e-a18b5bc4da3c tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:25.827045 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f27257d-6ecf-4fc2-970e-a18b5bc4da3c tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:25.827754 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f27257d-6ecf-4fc2-970e-a18b5bc4da3c tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:25.828247 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f27257d-6ecf-4fc2-970e-a18b5bc4da3c tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:25.828709 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6f27257d-6ecf-4fc2-970e-a18b5bc4da3c tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:25.843087 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-6f27257d-6ecf-4fc2-970e-a18b5bc4da3c tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] HTTP exception thrown: Instance e9ba238f-7257-4a72-a02d-85696c9689d2 could not be found. Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6f27257d-6ecf-4fc2-970e-a18b5bc4da3c tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Request method failure captured: Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2 HTTP/1.1 Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3dmdXsADriXwNv4kIBcr0MxUVrUN2eo8YQQaIZefIYxUiwx5u8n1eH62f5wkDkghwHNKLX2I-lFIdKaOMlQvApx4aJ-iD83tJxqDFTDWYYpo2BCMFlIZShieJTiOl5idQ0puKxrCJa4eQ8p7McFolXl-TKg-9OEUpgG3-o2h5ivhXI Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: b690f172fad842e1a0f8d70a5ef27f5b Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-TestServerBasicOps-1697899963 Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b690f172fad842e1a0f8d70a5ef27f5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b690f172fad842e1a0f8d70a5ef27f5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b690f172fad842e1a0f8d70a5ef27f5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b690f172fad842e1a0f8d70a5ef27f5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-TestServerBasicOps-1697899963 Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: b690f172fad842e1a0f8d70a5ef27f5b Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-TestServerBasicOps-1697899963 Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-TestServerBasicOps-1697899963-project Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: e8e099c4b8e74ce390c1893e70bcf600 Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-TestServerBasicOps-1697899963-project Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance e9ba238f-7257-4a72-a02d-85696c9689d2 could not be found. Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'e9ba238f-7257-4a72-a02d-85696c9689d2'} Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9ba238f-7257-4a72-a02d-85696c9689d2 could not be found. Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9ba238f-7257-4a72-a02d-85696c9689d2 could not be found. Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:37:25.844759 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:37:25.850281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:37:25.850281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:37:25.850281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:37:25.850281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:37:25.850281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:37:25.850281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9ba238f-7257-4a72-a02d-85696c9689d2 could not be found. Sep 24 21:37:25.850281 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:37:25.850281 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6f27257d-6ecf-4fc2-970e-a18b5bc4da3c tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Returning 404 to user: Instance e9ba238f-7257-4a72-a02d-85696c9689d2 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:37:25.850281 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6f27257d-6ecf-4fc2-970e-a18b5bc4da3c tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] 10.222.0.52 "GET /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2" status: 404 len: 111 microversion: 2.1 time: 0.032215 Sep 24 21:37:25.874682 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3135/6290] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:37:25 2022] GET /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:37:26.344554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-258a74be-9de3-4e54-b7e4-fb0737f2f4be tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:37:26.345153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-258a74be-9de3-4e54-b7e4-fb0737f2f4be tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] [instance: e9ba238f-7257-4a72-a02d-85696c9689d2] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:37:26.352582 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-258a74be-9de3-4e54-b7e4-fb0737f2f4be tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:26.353080 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-258a74be-9de3-4e54-b7e4-fb0737f2f4be tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:26.353527 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-258a74be-9de3-4e54-b7e4-fb0737f2f4be tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:26.354237 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-258a74be-9de3-4e54-b7e4-fb0737f2f4be tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:26.354739 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-258a74be-9de3-4e54-b7e4-fb0737f2f4be tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:26.355179 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-258a74be-9de3-4e54-b7e4-fb0737f2f4be tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:26.369042 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-258a74be-9de3-4e54-b7e4-fb0737f2f4be tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] HTTP exception thrown: Instance e9ba238f-7257-4a72-a02d-85696c9689d2 could not be found. Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-258a74be-9de3-4e54-b7e4-fb0737f2f4be tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Request method failure captured: Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2 HTTP/1.1 Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3dmdXsADriXwNv4kIBcr0MxUVrUN2eo8YQQaIZefIYxUiwx5u8n1eH62f5wkDkghwHNKLX2I-lFIdKaOMlQvApx4aJ-iD83tJxqDFTDWYYpo2BCMFlIZShieJTiOl5idQ0puKxrCJa4eQ8p7McFolXl-TKg-9OEUpgG3-o2h5ivhXI Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: b690f172fad842e1a0f8d70a5ef27f5b Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-TestServerBasicOps-1697899963 Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b690f172fad842e1a0f8d70a5ef27f5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b690f172fad842e1a0f8d70a5ef27f5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b690f172fad842e1a0f8d70a5ef27f5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b690f172fad842e1a0f8d70a5ef27f5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-TestServerBasicOps-1697899963 Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: b690f172fad842e1a0f8d70a5ef27f5b Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-TestServerBasicOps-1697899963 Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-TestServerBasicOps-1697899963-project Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: e8e099c4b8e74ce390c1893e70bcf600 Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-TestServerBasicOps-1697899963-project Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance e9ba238f-7257-4a72-a02d-85696c9689d2 could not be found. Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'e9ba238f-7257-4a72-a02d-85696c9689d2'} Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9ba238f-7257-4a72-a02d-85696c9689d2 could not be found. Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:37:26.370803 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:37:26.375022 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9ba238f-7257-4a72-a02d-85696c9689d2 could not be found. Sep 24 21:37:26.375022 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:37:26.375022 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:37:26.375022 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:37:26.375022 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:37:26.375022 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:37:26.375022 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:37:26.375022 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:37:26.375022 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:37:26.375022 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9ba238f-7257-4a72-a02d-85696c9689d2 could not be found. Sep 24 21:37:26.375022 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:37:26.375022 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-258a74be-9de3-4e54-b7e4-fb0737f2f4be tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Returning 404 to user: Instance e9ba238f-7257-4a72-a02d-85696c9689d2 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:37:26.375022 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-258a74be-9de3-4e54-b7e4-fb0737f2f4be tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2" status: 404 len: 111 microversion: 2.1 time: 0.031940 Sep 24 21:37:26.375915 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3156/6291] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:37:26 2022] DELETE /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:37:26.381131 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d0ba8e51-2d19-4428-8bbf-b7486ed93363 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:37:26.381765 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d0ba8e51-2d19-4428-8bbf-b7486ed93363 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] [instance: e9ba238f-7257-4a72-a02d-85696c9689d2] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:37:26.388375 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0ba8e51-2d19-4428-8bbf-b7486ed93363 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:26.388865 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0ba8e51-2d19-4428-8bbf-b7486ed93363 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:26.389313 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0ba8e51-2d19-4428-8bbf-b7486ed93363 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:26.390021 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0ba8e51-2d19-4428-8bbf-b7486ed93363 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:26.390485 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0ba8e51-2d19-4428-8bbf-b7486ed93363 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:26.390958 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d0ba8e51-2d19-4428-8bbf-b7486ed93363 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:26.405145 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-d0ba8e51-2d19-4428-8bbf-b7486ed93363 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] HTTP exception thrown: Instance e9ba238f-7257-4a72-a02d-85696c9689d2 could not be found. Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d0ba8e51-2d19-4428-8bbf-b7486ed93363 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Request method failure captured: Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2 HTTP/1.1 Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3dmdXsADriXwNv4kIBcr0MxUVrUN2eo8YQQaIZefIYxUiwx5u8n1eH62f5wkDkghwHNKLX2I-lFIdKaOMlQvApx4aJ-iD83tJxqDFTDWYYpo2BCMFlIZShieJTiOl5idQ0puKxrCJa4eQ8p7McFolXl-TKg-9OEUpgG3-o2h5ivhXI Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: b690f172fad842e1a0f8d70a5ef27f5b Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-TestServerBasicOps-1697899963 Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b690f172fad842e1a0f8d70a5ef27f5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b690f172fad842e1a0f8d70a5ef27f5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b690f172fad842e1a0f8d70a5ef27f5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b690f172fad842e1a0f8d70a5ef27f5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-TestServerBasicOps-1697899963 Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: b690f172fad842e1a0f8d70a5ef27f5b Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-TestServerBasicOps-1697899963 Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-TestServerBasicOps-1697899963-project Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: e8e099c4b8e74ce390c1893e70bcf600 Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-TestServerBasicOps-1697899963-project Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance e9ba238f-7257-4a72-a02d-85696c9689d2 could not be found. Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'e9ba238f-7257-4a72-a02d-85696c9689d2'} Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9ba238f-7257-4a72-a02d-85696c9689d2 could not be found. Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9ba238f-7257-4a72-a02d-85696c9689d2 could not be found. Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:37:26.406703 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:37:26.410304 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:37:26.410304 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:37:26.410304 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:37:26.410304 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:37:26.410304 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:37:26.410304 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9ba238f-7257-4a72-a02d-85696c9689d2 could not be found. Sep 24 21:37:26.410304 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:37:26.410304 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d0ba8e51-2d19-4428-8bbf-b7486ed93363 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Returning 404 to user: Instance e9ba238f-7257-4a72-a02d-85696c9689d2 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:37:26.410304 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d0ba8e51-2d19-4428-8bbf-b7486ed93363 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] 10.222.0.52 "GET /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2" status: 404 len: 111 microversion: 2.1 time: 0.031018 Sep 24 21:37:26.410304 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3136/6292] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:37:26 2022] GET /compute/v2.1/servers/e9ba238f-7257-4a72-a02d-85696c9689d2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:37:26.571448 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4da9e416-64ed-4362-a137-4a049fa36af5 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] Calling method '.version_select at 0x7f4b07400e50>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:37:26.594744 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4da9e416-64ed-4362-a137-4a049fa36af5 tempest-TestServerBasicOps-1697899963 tempest-TestServerBasicOps-1697899963-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1509447138" status: 202 len: 0 microversion: 2.1 time: 0.027776 Sep 24 21:37:26.595253 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3157/6293] 10.222.0.52 () {58 vars in 1254 bytes} [Sat Sep 24 21:37:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1509447138 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:37:45.861623 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=8 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:37:45.862360 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=16 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:37:45.973732 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c0921112-58c5-48bd-8a99-28a69087b419 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-938924004", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:37:46.025231 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-c0921112-58c5-48bd-8a99-28a69087b419 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] validate_networks() for None {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:37:46.300029 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-c0921112-58c5-48bd-8a99-28a69087b419 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:37:46.300485 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-c0921112-58c5-48bd-8a99-28a69087b419 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:37:46.300971 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-c0921112-58c5-48bd-8a99-28a69087b419 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:37:46.301389 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-c0921112-58c5-48bd-8a99-28a69087b419 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:37:46.301810 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-c0921112-58c5-48bd-8a99-28a69087b419 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:37:46.310834 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c0921112-58c5-48bd-8a99-28a69087b419 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:46.311323 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c0921112-58c5-48bd-8a99-28a69087b419 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:46.311767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c0921112-58c5-48bd-8a99-28a69087b419 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:46.312501 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c0921112-58c5-48bd-8a99-28a69087b419 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:46.312961 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c0921112-58c5-48bd-8a99-28a69087b419 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:46.313396 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c0921112-58c5-48bd-8a99-28a69087b419 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:46.330770 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-c0921112-58c5-48bd-8a99-28a69087b419 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Getting quotas for project 81e0a49f48ed4f399bc339fbf37e75de. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:37:46.335976 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-c0921112-58c5-48bd-8a99-28a69087b419 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Getting quotas for user 712476b96d7c4066a460868988d23109 and project 81e0a49f48ed4f399bc339fbf37e75de. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:37:46.348976 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c0921112-58c5-48bd-8a99-28a69087b419 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:37:46.351289 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c0921112-58c5-48bd-8a99-28a69087b419 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] [instance: 6fb41998-8bcc-485d-a1ff-2dde5fa1e978] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:37:46.395311 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c0921112-58c5-48bd-8a99-28a69087b419 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.539062 Sep 24 21:37:46.395954 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3137/6294] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:37:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:37:46.409197 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-818c40db-d1f0-4bb9-bf14-bce0dbb42107 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:37:46.409819 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-818c40db-d1f0-4bb9-bf14-bce0dbb42107 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] [instance: 6fb41998-8bcc-485d-a1ff-2dde5fa1e978] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:37:46.412850 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:37:46.413694 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:37:46.475898 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-818c40db-d1f0-4bb9-bf14-bce0dbb42107 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712476b96d7c4066a460868988d23109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e0a49f48ed4f399bc339fbf37e75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:37:46.483251 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-818c40db-d1f0-4bb9-bf14-bce0dbb42107 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] 10.222.0.52 "GET /compute/v2.1/servers/6fb41998-8bcc-485d-a1ff-2dde5fa1e978" status: 200 len: 1221 microversion: 2.1 time: 0.077996 Sep 24 21:37:46.483831 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3158/6295] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:37:46 2022] GET /compute/v2.1/servers/6fb41998-8bcc-485d-a1ff-2dde5fa1e978 => generated 1221 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:37:47.508962 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7b2a50bb-426f-4a26-825b-b8ff88db728f tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:37:47.510207 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7b2a50bb-426f-4a26-825b-b8ff88db728f tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] [instance: 6fb41998-8bcc-485d-a1ff-2dde5fa1e978] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:37:47.518212 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b2a50bb-426f-4a26-825b-b8ff88db728f tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:47.518743 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b2a50bb-426f-4a26-825b-b8ff88db728f tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:47.519393 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b2a50bb-426f-4a26-825b-b8ff88db728f tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:47.520163 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b2a50bb-426f-4a26-825b-b8ff88db728f tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:47.521110 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b2a50bb-426f-4a26-825b-b8ff88db728f tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:47.521777 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b2a50bb-426f-4a26-825b-b8ff88db728f tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:47.616320 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7b2a50bb-426f-4a26-825b-b8ff88db728f tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712476b96d7c4066a460868988d23109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e0a49f48ed4f399bc339fbf37e75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:37:47.625219 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7b2a50bb-426f-4a26-825b-b8ff88db728f tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] 10.222.0.52 "GET /compute/v2.1/servers/6fb41998-8bcc-485d-a1ff-2dde5fa1e978" status: 200 len: 1281 microversion: 2.1 time: 0.122656 Sep 24 21:37:47.625809 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3138/6296] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:37:47 2022] GET /compute/v2.1/servers/6fb41998-8bcc-485d-a1ff-2dde5fa1e978 => generated 1281 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:37:48.650259 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9a07941e-f9f4-4dd1-b20a-c3dd0ff75d4a tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:37:48.650948 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9a07941e-f9f4-4dd1-b20a-c3dd0ff75d4a tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] [instance: 6fb41998-8bcc-485d-a1ff-2dde5fa1e978] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:37:48.657776 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a07941e-f9f4-4dd1-b20a-c3dd0ff75d4a tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:48.658273 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a07941e-f9f4-4dd1-b20a-c3dd0ff75d4a tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:48.658740 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a07941e-f9f4-4dd1-b20a-c3dd0ff75d4a tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:48.659436 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a07941e-f9f4-4dd1-b20a-c3dd0ff75d4a tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:48.659896 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a07941e-f9f4-4dd1-b20a-c3dd0ff75d4a tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:48.660348 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a07941e-f9f4-4dd1-b20a-c3dd0ff75d4a tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:48.877434 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9a07941e-f9f4-4dd1-b20a-c3dd0ff75d4a tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712476b96d7c4066a460868988d23109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e0a49f48ed4f399bc339fbf37e75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:37:48.886200 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9a07941e-f9f4-4dd1-b20a-c3dd0ff75d4a tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] 10.222.0.52 "GET /compute/v2.1/servers/6fb41998-8bcc-485d-a1ff-2dde5fa1e978" status: 200 len: 1321 microversion: 2.1 time: 0.240402 Sep 24 21:37:48.886819 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3159/6297] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:37:48 2022] GET /compute/v2.1/servers/6fb41998-8bcc-485d-a1ff-2dde5fa1e978 => generated 1321 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:37:49.197636 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-1946ecad-b3d1-42fb-a817-d0b2294a4998 req-e7b83d46-03c8-4e8b-9c0f-ad03fa7781fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fb41998-8bcc-485d-a1ff-2dde5fa1e978", "tag": "a829776d-698b-48f9-a9c3-4c639defe761"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:37:49.211161 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1946ecad-b3d1-42fb-a817-d0b2294a4998 req-e7b83d46-03c8-4e8b-9c0f-ad03fa7781fa service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:49.211654 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1946ecad-b3d1-42fb-a817-d0b2294a4998 req-e7b83d46-03c8-4e8b-9c0f-ad03fa7781fa service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:49.212300 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1946ecad-b3d1-42fb-a817-d0b2294a4998 req-e7b83d46-03c8-4e8b-9c0f-ad03fa7781fa service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:49.225117 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-1946ecad-b3d1-42fb-a817-d0b2294a4998 req-e7b83d46-03c8-4e8b-9c0f-ad03fa7781fa service nova] Creating event network-changed:a829776d-698b-48f9-a9c3-4c639defe761 for instance 6fb41998-8bcc-485d-a1ff-2dde5fa1e978 on nch1-master-1 Sep 24 21:37:49.231287 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-1946ecad-b3d1-42fb-a817-d0b2294a4998 req-e7b83d46-03c8-4e8b-9c0f-ad03fa7781fa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038182 Sep 24 21:37:49.231891 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3139/6298] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:37:49.908411 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-542500a3-23cc-4c90-8f05-efd339fdf33f tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:37:49.908973 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-542500a3-23cc-4c90-8f05-efd339fdf33f tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] [instance: 6fb41998-8bcc-485d-a1ff-2dde5fa1e978] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:37:49.916801 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-542500a3-23cc-4c90-8f05-efd339fdf33f tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:49.917293 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-542500a3-23cc-4c90-8f05-efd339fdf33f tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:49.917734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-542500a3-23cc-4c90-8f05-efd339fdf33f tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:49.918428 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-542500a3-23cc-4c90-8f05-efd339fdf33f tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:49.918918 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-542500a3-23cc-4c90-8f05-efd339fdf33f tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:49.919352 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-542500a3-23cc-4c90-8f05-efd339fdf33f tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:50.050836 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-542500a3-23cc-4c90-8f05-efd339fdf33f tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712476b96d7c4066a460868988d23109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e0a49f48ed4f399bc339fbf37e75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:37:50.058794 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-542500a3-23cc-4c90-8f05-efd339fdf33f tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] 10.222.0.52 "GET /compute/v2.1/servers/6fb41998-8bcc-485d-a1ff-2dde5fa1e978" status: 200 len: 1321 microversion: 2.1 time: 0.154313 Sep 24 21:37:50.059419 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3160/6299] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:37:49 2022] GET /compute/v2.1/servers/6fb41998-8bcc-485d-a1ff-2dde5fa1e978 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:37:51.081835 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5b6b7a17-7527-4d5a-bcf4-8c30c1547e43 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:37:51.082725 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5b6b7a17-7527-4d5a-bcf4-8c30c1547e43 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] [instance: 6fb41998-8bcc-485d-a1ff-2dde5fa1e978] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:37:51.090460 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b6b7a17-7527-4d5a-bcf4-8c30c1547e43 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:51.090977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b6b7a17-7527-4d5a-bcf4-8c30c1547e43 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:51.091422 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b6b7a17-7527-4d5a-bcf4-8c30c1547e43 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:51.092125 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b6b7a17-7527-4d5a-bcf4-8c30c1547e43 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:51.092587 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b6b7a17-7527-4d5a-bcf4-8c30c1547e43 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:51.093021 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b6b7a17-7527-4d5a-bcf4-8c30c1547e43 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:51.227719 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5b6b7a17-7527-4d5a-bcf4-8c30c1547e43 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712476b96d7c4066a460868988d23109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e0a49f48ed4f399bc339fbf37e75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:37:51.235440 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5b6b7a17-7527-4d5a-bcf4-8c30c1547e43 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] 10.222.0.52 "GET /compute/v2.1/servers/6fb41998-8bcc-485d-a1ff-2dde5fa1e978" status: 200 len: 1321 microversion: 2.1 time: 0.157945 Sep 24 21:37:51.236017 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3140/6300] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:37:51 2022] GET /compute/v2.1/servers/6fb41998-8bcc-485d-a1ff-2dde5fa1e978 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:37:52.258097 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-686eaacd-437d-4ed9-92f0-594cf27c1ccc tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:37:52.258670 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-686eaacd-437d-4ed9-92f0-594cf27c1ccc tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] [instance: 6fb41998-8bcc-485d-a1ff-2dde5fa1e978] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:37:52.266358 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-686eaacd-437d-4ed9-92f0-594cf27c1ccc tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:52.266874 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-686eaacd-437d-4ed9-92f0-594cf27c1ccc tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:52.267313 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-686eaacd-437d-4ed9-92f0-594cf27c1ccc tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:52.268004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-686eaacd-437d-4ed9-92f0-594cf27c1ccc tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:52.268457 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-686eaacd-437d-4ed9-92f0-594cf27c1ccc tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:52.268882 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-686eaacd-437d-4ed9-92f0-594cf27c1ccc tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:52.401959 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-686eaacd-437d-4ed9-92f0-594cf27c1ccc tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712476b96d7c4066a460868988d23109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e0a49f48ed4f399bc339fbf37e75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:37:52.409619 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-686eaacd-437d-4ed9-92f0-594cf27c1ccc tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] 10.222.0.52 "GET /compute/v2.1/servers/6fb41998-8bcc-485d-a1ff-2dde5fa1e978" status: 200 len: 1321 microversion: 2.1 time: 0.155538 Sep 24 21:37:52.410183 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3161/6301] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:37:52 2022] GET /compute/v2.1/servers/6fb41998-8bcc-485d-a1ff-2dde5fa1e978 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:37:53.432651 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-66307267-164d-4490-aee0-10e47d98959c tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:37:53.433274 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-66307267-164d-4490-aee0-10e47d98959c tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] [instance: 6fb41998-8bcc-485d-a1ff-2dde5fa1e978] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:37:53.440359 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66307267-164d-4490-aee0-10e47d98959c tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:53.440783 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66307267-164d-4490-aee0-10e47d98959c tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:53.441230 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66307267-164d-4490-aee0-10e47d98959c tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:53.441938 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66307267-164d-4490-aee0-10e47d98959c tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:53.442405 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66307267-164d-4490-aee0-10e47d98959c tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:53.442876 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-66307267-164d-4490-aee0-10e47d98959c tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:53.580878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-66307267-164d-4490-aee0-10e47d98959c tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712476b96d7c4066a460868988d23109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e0a49f48ed4f399bc339fbf37e75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:37:53.590217 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-66307267-164d-4490-aee0-10e47d98959c tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] 10.222.0.52 "GET /compute/v2.1/servers/6fb41998-8bcc-485d-a1ff-2dde5fa1e978" status: 200 len: 1321 microversion: 2.1 time: 0.161272 Sep 24 21:37:53.590885 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3141/6302] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:37:53 2022] GET /compute/v2.1/servers/6fb41998-8bcc-485d-a1ff-2dde5fa1e978 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:37:54.614144 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-81c02833-a13d-4d81-be4b-c8539e917875 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:37:54.614798 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-81c02833-a13d-4d81-be4b-c8539e917875 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] [instance: 6fb41998-8bcc-485d-a1ff-2dde5fa1e978] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:37:54.620959 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-81c02833-a13d-4d81-be4b-c8539e917875 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:54.621445 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-81c02833-a13d-4d81-be4b-c8539e917875 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:54.621888 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-81c02833-a13d-4d81-be4b-c8539e917875 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:54.622617 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-81c02833-a13d-4d81-be4b-c8539e917875 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:54.623076 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-81c02833-a13d-4d81-be4b-c8539e917875 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:54.623509 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-81c02833-a13d-4d81-be4b-c8539e917875 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:54.751236 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-81c02833-a13d-4d81-be4b-c8539e917875 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712476b96d7c4066a460868988d23109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e0a49f48ed4f399bc339fbf37e75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:37:54.759481 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-81c02833-a13d-4d81-be4b-c8539e917875 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] 10.222.0.52 "GET /compute/v2.1/servers/6fb41998-8bcc-485d-a1ff-2dde5fa1e978" status: 200 len: 1321 microversion: 2.1 time: 0.148818 Sep 24 21:37:54.760065 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3162/6303] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:37:54 2022] GET /compute/v2.1/servers/6fb41998-8bcc-485d-a1ff-2dde5fa1e978 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:37:55.575694 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-4214e398-d8ee-4439-b7a7-61a4004e0436 req-1194f5c7-e3e6-43d3-854c-538319e430f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fb41998-8bcc-485d-a1ff-2dde5fa1e978", "name": "network-vif-plugged", "status": "completed", "tag": "a829776d-698b-48f9-a9c3-4c639defe761"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:37:55.585251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-4214e398-d8ee-4439-b7a7-61a4004e0436 req-1194f5c7-e3e6-43d3-854c-538319e430f2 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:55.585727 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-4214e398-d8ee-4439-b7a7-61a4004e0436 req-1194f5c7-e3e6-43d3-854c-538319e430f2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:55.586157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-4214e398-d8ee-4439-b7a7-61a4004e0436 req-1194f5c7-e3e6-43d3-854c-538319e430f2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:55.598004 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-4214e398-d8ee-4439-b7a7-61a4004e0436 req-1194f5c7-e3e6-43d3-854c-538319e430f2 service nova] Creating event network-vif-plugged:a829776d-698b-48f9-a9c3-4c639defe761 for instance 6fb41998-8bcc-485d-a1ff-2dde5fa1e978 on nch1-master-1 Sep 24 21:37:55.603567 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-4214e398-d8ee-4439-b7a7-61a4004e0436 req-1194f5c7-e3e6-43d3-854c-538319e430f2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099169 Sep 24 21:37:55.604354 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3142/6304] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:37:55.781338 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e972d790-b87e-44c7-976e-0fe21ed722f0 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:37:55.781964 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e972d790-b87e-44c7-976e-0fe21ed722f0 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] [instance: 6fb41998-8bcc-485d-a1ff-2dde5fa1e978] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:37:55.789035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e972d790-b87e-44c7-976e-0fe21ed722f0 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:55.789530 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e972d790-b87e-44c7-976e-0fe21ed722f0 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:55.789977 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e972d790-b87e-44c7-976e-0fe21ed722f0 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:55.790879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e972d790-b87e-44c7-976e-0fe21ed722f0 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:55.791346 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e972d790-b87e-44c7-976e-0fe21ed722f0 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:55.791807 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e972d790-b87e-44c7-976e-0fe21ed722f0 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:55.921826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e972d790-b87e-44c7-976e-0fe21ed722f0 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712476b96d7c4066a460868988d23109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e0a49f48ed4f399bc339fbf37e75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:37:55.929763 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e972d790-b87e-44c7-976e-0fe21ed722f0 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] 10.222.0.52 "GET /compute/v2.1/servers/6fb41998-8bcc-485d-a1ff-2dde5fa1e978" status: 200 len: 1321 microversion: 2.1 time: 0.152329 Sep 24 21:37:55.930367 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3163/6305] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:37:55 2022] GET /compute/v2.1/servers/6fb41998-8bcc-485d-a1ff-2dde5fa1e978 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:37:56.953977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2d139001-3890-49e2-8958-c7f88b30a0fb tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:37:56.954717 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2d139001-3890-49e2-8958-c7f88b30a0fb tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] [instance: 6fb41998-8bcc-485d-a1ff-2dde5fa1e978] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:37:56.956680 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:37:56.957377 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:37:56.964823 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2d139001-3890-49e2-8958-c7f88b30a0fb tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:56.965305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2d139001-3890-49e2-8958-c7f88b30a0fb tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:56.965747 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2d139001-3890-49e2-8958-c7f88b30a0fb tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:56.966460 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2d139001-3890-49e2-8958-c7f88b30a0fb tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:56.966959 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2d139001-3890-49e2-8958-c7f88b30a0fb tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:56.967409 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2d139001-3890-49e2-8958-c7f88b30a0fb tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:57.106276 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2d139001-3890-49e2-8958-c7f88b30a0fb tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712476b96d7c4066a460868988d23109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e0a49f48ed4f399bc339fbf37e75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:37:57.115039 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2d139001-3890-49e2-8958-c7f88b30a0fb tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] 10.222.0.52 "GET /compute/v2.1/servers/6fb41998-8bcc-485d-a1ff-2dde5fa1e978" status: 200 len: 1321 microversion: 2.1 time: 0.165252 Sep 24 21:37:57.115633 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3143/6306] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:37:56 2022] GET /compute/v2.1/servers/6fb41998-8bcc-485d-a1ff-2dde5fa1e978 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:37:58.140942 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-45c4e261-d509-404b-89db-9e3ae3ded688 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:37:58.141562 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-45c4e261-d509-404b-89db-9e3ae3ded688 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] [instance: 6fb41998-8bcc-485d-a1ff-2dde5fa1e978] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:37:58.143531 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:37:58.150433 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45c4e261-d509-404b-89db-9e3ae3ded688 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:58.151076 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45c4e261-d509-404b-89db-9e3ae3ded688 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:58.151517 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45c4e261-d509-404b-89db-9e3ae3ded688 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:58.152215 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45c4e261-d509-404b-89db-9e3ae3ded688 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:58.152674 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45c4e261-d509-404b-89db-9e3ae3ded688 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:58.153104 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-45c4e261-d509-404b-89db-9e3ae3ded688 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:58.284351 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-45c4e261-d509-404b-89db-9e3ae3ded688 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712476b96d7c4066a460868988d23109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e0a49f48ed4f399bc339fbf37e75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:37:58.292164 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-45c4e261-d509-404b-89db-9e3ae3ded688 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] 10.222.0.52 "GET /compute/v2.1/servers/6fb41998-8bcc-485d-a1ff-2dde5fa1e978" status: 200 len: 1471 microversion: 2.1 time: 0.155069 Sep 24 21:37:58.292753 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3164/6307] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:37:58 2022] GET /compute/v2.1/servers/6fb41998-8bcc-485d-a1ff-2dde5fa1e978 => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:37:58.368967 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3d86f739-edb2-43c8-b35b-e9498a405077 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Calling method '.version_select at 0x7f4b073a20d0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:37:58.436676 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3d86f739-edb2-43c8-b35b-e9498a405077 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/4abb60b8f1a4468e86a4b37b33dd287d" status: 200 len: 371 microversion: 2.1 time: 0.123434 Sep 24 21:37:58.437394 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3144/6308] 10.222.0.52 () {58 vars in 1242 bytes} [Sat Sep 24 21:37:58 2022] GET /compute/v2.1/os-quota-sets/4abb60b8f1a4468e86a4b37b33dd287d => generated 371 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:37:58.450027 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2a62dd0b-ad2e-4eaa-93ec-4e75fccf4e9b tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-362644677", "id": 64190933, "os-flavor-access:is_public": "True"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:37:58.469123 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2a62dd0b-ad2e-4eaa-93ec-4e75fccf4e9b tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.023425 Sep 24 21:37:58.469974 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3165/6309] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:37:58 2022] POST /compute/v2.1/flavors => generated 431 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:37:58.482428 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-eba53959-54de-4cba-9d4a-5707ea127690 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "64190933"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:37:58.484710 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-eba53959-54de-4cba-9d4a-5707ea127690 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] [instance: 6fb41998-8bcc-485d-a1ff-2dde5fa1e978] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:37:58.491189 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eba53959-54de-4cba-9d4a-5707ea127690 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:58.491730 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eba53959-54de-4cba-9d4a-5707ea127690 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:58.492184 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eba53959-54de-4cba-9d4a-5707ea127690 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:58.492901 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eba53959-54de-4cba-9d4a-5707ea127690 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:58.493372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eba53959-54de-4cba-9d4a-5707ea127690 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:58.493812 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eba53959-54de-4cba-9d4a-5707ea127690 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:58.628599 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-eba53959-54de-4cba-9d4a-5707ea127690 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1fa85cce135249b1acfa5a0d22d7bdbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4abb60b8f1a4468e86a4b37b33dd287d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:37:58.634917 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-eba53959-54de-4cba-9d4a-5707ea127690 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] [instance: 6fb41998-8bcc-485d-a1ff-2dde5fa1e978] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-362644677 {{(pid=140516) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 24 21:37:58.642440 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eba53959-54de-4cba-9d4a-5707ea127690 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:58.642952 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eba53959-54de-4cba-9d4a-5707ea127690 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:58.643394 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eba53959-54de-4cba-9d4a-5707ea127690 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:58.644124 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eba53959-54de-4cba-9d4a-5707ea127690 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:58.644584 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eba53959-54de-4cba-9d4a-5707ea127690 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:58.645010 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eba53959-54de-4cba-9d4a-5707ea127690 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:58.665024 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-eba53959-54de-4cba-9d4a-5707ea127690 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Getting quotas for project 81e0a49f48ed4f399bc339fbf37e75de. Resources: {'ram', 'cores'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:37:58.670040 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-eba53959-54de-4cba-9d4a-5707ea127690 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Getting quotas for user 712476b96d7c4066a460868988d23109 and project 81e0a49f48ed4f399bc339fbf37e75de. Resources: {'ram', 'cores'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:37:58.682268 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.compute.api [None req-eba53959-54de-4cba-9d4a-5707ea127690 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] ram quota exceeded for 4abb60b8f1a4468e86a4b37b33dd287d, tried to resize instance. Sep 24 21:37:58.683616 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-eba53959-54de-4cba-9d4a-5707ea127690 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-eba53959-54de-4cba-9d4a-5707ea127690 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Request method failure captured: Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/servers/6fb41998-8bcc-485d-a1ff-2dde5fa1e978/action HTTP/1.1 Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 37 Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3ipfKbBoT22iBV5gpRxN_tuAIUCsqgKDLBSbDZH-97n51tz4jB6aWckS98KvooY2cdI7iGySGfht05Htw19puU8qFtRLmtPAU-SFrob7-9VrocBlvj36niPtWMyIzZlRMOZpuiiBA12ukvGFtTqjdTJ3zJZwbOPiW0QhlqiuBxwdbM Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 4abb60b8f1a4468e86a4b37b33dd287d Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1935027202 Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: X-Role: admin,reader,member Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: admin,reader,member Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4abb60b8f1a4468e86a4b37b33dd287d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4abb60b8f1a4468e86a4b37b33dd287d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4abb60b8f1a4468e86a4b37b33dd287d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4abb60b8f1a4468e86a4b37b33dd287d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1935027202 Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 4abb60b8f1a4468e86a4b37b33dd287d Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1935027202 Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersAdminNegativeTestJSON-1935027202-project-admin Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 1fa85cce135249b1acfa5a0d22d7bdbc Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1935027202-project-admin Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: {"resize": {"flavorRef": "64190933"}} Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '6fb41998-8bcc-485d-a1ff-2dde5fa1e978', 'body': {'resize': {'flavorRef': '64190933'}}} Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 21:37:58.700122 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-eba53959-54de-4cba-9d4a-5707ea127690 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-eba53959-54de-4cba-9d4a-5707ea127690 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/6fb41998-8bcc-485d-a1ff-2dde5fa1e978/action" status: 403 len: 118 microversion: 2.1 time: 0.223223 Sep 24 21:37:58.704497 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3145/6310] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:37:58 2022] POST /compute/v2.1/servers/6fb41998-8bcc-485d-a1ff-2dde5fa1e978/action => generated 118 bytes in 224 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:37:58.710525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-802cc13d-58ff-4666-80fe-5eda5c95e8f4 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:37:58.727423 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-802cc13d-58ff-4666-80fe-5eda5c95e8f4 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/64190933" status: 202 len: 0 microversion: 2.1 time: 0.020661 Sep 24 21:37:58.727972 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3166/6311] 10.222.0.52 () {58 vars in 1155 bytes} [Sat Sep 24 21:37:58 2022] DELETE /compute/v2.1/flavors/64190933 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:37:58.736078 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-aec7ccd3-53d6-4c5b-862f-ac709075274e tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:37:58.756929 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-aec7ccd3-53d6-4c5b-862f-ac709075274e tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024465 Sep 24 21:37:58.757479 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3146/6312] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 21:37:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:37:58.777992 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c0522d9f-a731-4bd8-a6e8-b5bddc270601 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Calling method '.version_select at 0x7f4b075e8af0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:37:58.852325 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c0522d9f-a731-4bd8-a6e8-b5bddc270601 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/4abb60b8f1a4468e86a4b37b33dd287d" status: 200 len: 371 microversion: 2.1 time: 0.077963 Sep 24 21:37:58.852899 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3167/6313] 10.222.0.52 () {58 vars in 1242 bytes} [Sat Sep 24 21:37:58 2022] GET /compute/v2.1/os-quota-sets/4abb60b8f1a4468e86a4b37b33dd287d => generated 371 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:37:58.864649 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d88de9cb-9715-4c0c-82a9-37b218792293 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-471146798", "id": 929687769, "os-flavor-access:is_public": "True"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:37:58.882955 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d88de9cb-9715-4c0c-82a9-37b218792293 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.022082 Sep 24 21:37:58.883521 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3147/6314] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:37:58 2022] POST /compute/v2.1/flavors => generated 433 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:37:58.896449 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3273e187-fe7c-4bef-a717-8a82d00ddff6 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "929687769"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:37:58.899051 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3273e187-fe7c-4bef-a717-8a82d00ddff6 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] [instance: 6fb41998-8bcc-485d-a1ff-2dde5fa1e978] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:37:58.905609 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3273e187-fe7c-4bef-a717-8a82d00ddff6 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:58.906095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3273e187-fe7c-4bef-a717-8a82d00ddff6 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:58.906558 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3273e187-fe7c-4bef-a717-8a82d00ddff6 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:58.907253 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3273e187-fe7c-4bef-a717-8a82d00ddff6 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:58.907707 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3273e187-fe7c-4bef-a717-8a82d00ddff6 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:58.908138 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3273e187-fe7c-4bef-a717-8a82d00ddff6 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:59.043853 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3273e187-fe7c-4bef-a717-8a82d00ddff6 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1fa85cce135249b1acfa5a0d22d7bdbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4abb60b8f1a4468e86a4b37b33dd287d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:37:59.050331 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3273e187-fe7c-4bef-a717-8a82d00ddff6 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] [instance: 6fb41998-8bcc-485d-a1ff-2dde5fa1e978] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-471146798 {{(pid=140517) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 24 21:37:59.057088 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3273e187-fe7c-4bef-a717-8a82d00ddff6 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:59.057576 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3273e187-fe7c-4bef-a717-8a82d00ddff6 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:59.058861 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3273e187-fe7c-4bef-a717-8a82d00ddff6 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:59.059598 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3273e187-fe7c-4bef-a717-8a82d00ddff6 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:59.060058 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3273e187-fe7c-4bef-a717-8a82d00ddff6 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:59.060489 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3273e187-fe7c-4bef-a717-8a82d00ddff6 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:59.085288 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-3273e187-fe7c-4bef-a717-8a82d00ddff6 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Getting quotas for project 81e0a49f48ed4f399bc339fbf37e75de. Resources: {'ram', 'cores'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:37:59.090370 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-3273e187-fe7c-4bef-a717-8a82d00ddff6 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Getting quotas for user 712476b96d7c4066a460868988d23109 and project 81e0a49f48ed4f399bc339fbf37e75de. Resources: {'ram', 'cores'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:37:59.102239 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.compute.api [None req-3273e187-fe7c-4bef-a717-8a82d00ddff6 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] cores quota exceeded for 4abb60b8f1a4468e86a4b37b33dd287d, tried to resize instance. Sep 24 21:37:59.102825 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-3273e187-fe7c-4bef-a717-8a82d00ddff6 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3273e187-fe7c-4bef-a717-8a82d00ddff6 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Request method failure captured: Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers/6fb41998-8bcc-485d-a1ff-2dde5fa1e978/action HTTP/1.1 Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 38 Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3ipfKbBoT22iBV5gpRxN_tuAIUCsqgKDLBSbDZH-97n51tz4jB6aWckS98KvooY2cdI7iGySGfht05Htw19puU8qFtRLmtPAU-SFrob7-9VrocBlvj36niPtWMyIzZlRMOZpuiiBA12ukvGFtTqjdTJ3zJZwbOPiW0QhlqiuBxwdbM Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 4abb60b8f1a4468e86a4b37b33dd287d Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1935027202 Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: X-Role: admin,reader,member Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: admin,reader,member Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4abb60b8f1a4468e86a4b37b33dd287d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4abb60b8f1a4468e86a4b37b33dd287d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4abb60b8f1a4468e86a4b37b33dd287d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4abb60b8f1a4468e86a4b37b33dd287d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1935027202 Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 4abb60b8f1a4468e86a4b37b33dd287d Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1935027202 Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersAdminNegativeTestJSON-1935027202-project-admin Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 1fa85cce135249b1acfa5a0d22d7bdbc Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1935027202-project-admin Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: {"resize": {"flavorRef": "929687769"}} Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '6fb41998-8bcc-485d-a1ff-2dde5fa1e978', 'body': {'resize': {'flavorRef': '929687769'}}} Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 21:37:59.105438 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3273e187-fe7c-4bef-a717-8a82d00ddff6 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3273e187-fe7c-4bef-a717-8a82d00ddff6 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/6fb41998-8bcc-485d-a1ff-2dde5fa1e978/action" status: 403 len: 113 microversion: 2.1 time: 0.214454 Sep 24 21:37:59.110038 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3168/6315] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:37:58 2022] POST /compute/v2.1/servers/6fb41998-8bcc-485d-a1ff-2dde5fa1e978/action => generated 113 bytes in 216 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:37:59.115486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a96ba26e-021a-48a8-8acc-b6a135652907 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:37:59.133392 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a96ba26e-021a-48a8-8acc-b6a135652907 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/929687769" status: 202 len: 0 microversion: 2.1 time: 0.021459 Sep 24 21:37:59.134060 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3148/6316] 10.222.0.52 () {58 vars in 1158 bytes} [Sat Sep 24 21:37:59 2022] DELETE /compute/v2.1/flavors/929687769 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:37:59.142283 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c98444ac-a748-4086-a004-615e8a4c6f65 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:37:59.163063 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c98444ac-a748-4086-a004-615e8a4c6f65 tempest-ServersAdminNegativeTestJSON-1935027202 tempest-ServersAdminNegativeTestJSON-1935027202-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024453 Sep 24 21:37:59.163618 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3169/6317] 10.222.0.52 () {58 vars in 1146 bytes} [Sat Sep 24 21:37:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:37:59.185685 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7f6a1aa9-55c1-42b1-a5f4-903d527431fe tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:37:59.186123 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7f6a1aa9-55c1-42b1-a5f4-903d527431fe tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] [instance: 6fb41998-8bcc-485d-a1ff-2dde5fa1e978] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:37:59.192219 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f6a1aa9-55c1-42b1-a5f4-903d527431fe tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:59.192704 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f6a1aa9-55c1-42b1-a5f4-903d527431fe tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:59.193139 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f6a1aa9-55c1-42b1-a5f4-903d527431fe tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:59.193838 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f6a1aa9-55c1-42b1-a5f4-903d527431fe tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:59.194290 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f6a1aa9-55c1-42b1-a5f4-903d527431fe tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:59.194746 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f6a1aa9-55c1-42b1-a5f4-903d527431fe tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:59.219641 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7f6a1aa9-55c1-42b1-a5f4-903d527431fe tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] [instance: 6fb41998-8bcc-485d-a1ff-2dde5fa1e978] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:37:59.295986 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7f6a1aa9-55c1-42b1-a5f4-903d527431fe tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6fb41998-8bcc-485d-a1ff-2dde5fa1e978" status: 204 len: 0 microversion: 2.1 time: 0.114853 Sep 24 21:37:59.296841 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3149/6318] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:37:59 2022] DELETE /compute/v2.1/servers/6fb41998-8bcc-485d-a1ff-2dde5fa1e978 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:37:59.305310 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-086b91a8-15d4-4f88-b937-21a78fcd383d tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:37:59.305933 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-086b91a8-15d4-4f88-b937-21a78fcd383d tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] [instance: 6fb41998-8bcc-485d-a1ff-2dde5fa1e978] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:37:59.312668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-086b91a8-15d4-4f88-b937-21a78fcd383d tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:59.313167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-086b91a8-15d4-4f88-b937-21a78fcd383d tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:59.313613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-086b91a8-15d4-4f88-b937-21a78fcd383d tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:59.314315 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-086b91a8-15d4-4f88-b937-21a78fcd383d tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:37:59.314810 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-086b91a8-15d4-4f88-b937-21a78fcd383d tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:37:59.315243 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-086b91a8-15d4-4f88-b937-21a78fcd383d tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:37:59.444041 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-086b91a8-15d4-4f88-b937-21a78fcd383d tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712476b96d7c4066a460868988d23109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e0a49f48ed4f399bc339fbf37e75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:37:59.452036 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-086b91a8-15d4-4f88-b937-21a78fcd383d tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] 10.222.0.52 "GET /compute/v2.1/servers/6fb41998-8bcc-485d-a1ff-2dde5fa1e978" status: 200 len: 1477 microversion: 2.1 time: 0.150651 Sep 24 21:37:59.452610 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3170/6319] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:37:59 2022] GET /compute/v2.1/servers/6fb41998-8bcc-485d-a1ff-2dde5fa1e978 => generated 1477 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:38:00.476269 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2b53bd7d-1cea-4921-9bb8-684445c71d36 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:00.477008 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2b53bd7d-1cea-4921-9bb8-684445c71d36 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] [instance: 6fb41998-8bcc-485d-a1ff-2dde5fa1e978] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:00.484722 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2b53bd7d-1cea-4921-9bb8-684445c71d36 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:00.485220 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2b53bd7d-1cea-4921-9bb8-684445c71d36 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:00.485664 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2b53bd7d-1cea-4921-9bb8-684445c71d36 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:00.486372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2b53bd7d-1cea-4921-9bb8-684445c71d36 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:00.486864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2b53bd7d-1cea-4921-9bb8-684445c71d36 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:00.487298 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2b53bd7d-1cea-4921-9bb8-684445c71d36 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:00.627413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2b53bd7d-1cea-4921-9bb8-684445c71d36 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712476b96d7c4066a460868988d23109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e0a49f48ed4f399bc339fbf37e75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:00.635393 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2b53bd7d-1cea-4921-9bb8-684445c71d36 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] 10.222.0.52 "GET /compute/v2.1/servers/6fb41998-8bcc-485d-a1ff-2dde5fa1e978" status: 200 len: 1477 microversion: 2.1 time: 0.163390 Sep 24 21:38:00.635974 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3150/6320] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:00 2022] GET /compute/v2.1/servers/6fb41998-8bcc-485d-a1ff-2dde5fa1e978 => generated 1477 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:01.463843 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-46c4dae9-c3c6-447b-a722-6172d64ed1cd req-a8e83259-6e2b-4b7d-b566-16b6b4478c36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fb41998-8bcc-485d-a1ff-2dde5fa1e978", "name": "network-vif-deleted", "tag": "a829776d-698b-48f9-a9c3-4c639defe761"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:38:01.475547 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-46c4dae9-c3c6-447b-a722-6172d64ed1cd req-a8e83259-6e2b-4b7d-b566-16b6b4478c36 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:01.476037 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-46c4dae9-c3c6-447b-a722-6172d64ed1cd req-a8e83259-6e2b-4b7d-b566-16b6b4478c36 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:01.476574 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-46c4dae9-c3c6-447b-a722-6172d64ed1cd req-a8e83259-6e2b-4b7d-b566-16b6b4478c36 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:01.489026 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-46c4dae9-c3c6-447b-a722-6172d64ed1cd req-a8e83259-6e2b-4b7d-b566-16b6b4478c36 service nova] Creating event network-vif-deleted:a829776d-698b-48f9-a9c3-4c639defe761 for instance 6fb41998-8bcc-485d-a1ff-2dde5fa1e978 on nch1-master-1 Sep 24 21:38:01.494582 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-46c4dae9-c3c6-447b-a722-6172d64ed1cd req-a8e83259-6e2b-4b7d-b566-16b6b4478c36 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034340 Sep 24 21:38:01.495228 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3171/6321] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:38:01.657290 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d26f543a-10bf-43fd-97b9-88b544cf232b tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:01.657908 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d26f543a-10bf-43fd-97b9-88b544cf232b tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] [instance: 6fb41998-8bcc-485d-a1ff-2dde5fa1e978] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:01.664825 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d26f543a-10bf-43fd-97b9-88b544cf232b tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:01.665313 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d26f543a-10bf-43fd-97b9-88b544cf232b tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:01.665758 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d26f543a-10bf-43fd-97b9-88b544cf232b tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:01.666464 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d26f543a-10bf-43fd-97b9-88b544cf232b tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:01.666955 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d26f543a-10bf-43fd-97b9-88b544cf232b tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:01.667423 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d26f543a-10bf-43fd-97b9-88b544cf232b tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:01.975656 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d26f543a-10bf-43fd-97b9-88b544cf232b tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:01.976111 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d26f543a-10bf-43fd-97b9-88b544cf232b tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:01.976561 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d26f543a-10bf-43fd-97b9-88b544cf232b tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:01.977024 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-d26f543a-10bf-43fd-97b9-88b544cf232b tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lazy-loading 'fault' on Instance uuid 6fb41998-8bcc-485d-a1ff-2dde5fa1e978 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:38:02.034575 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d26f543a-10bf-43fd-97b9-88b544cf232b tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712476b96d7c4066a460868988d23109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e0a49f48ed4f399bc339fbf37e75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:02.042970 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d26f543a-10bf-43fd-97b9-88b544cf232b tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] 10.222.0.52 "GET /compute/v2.1/servers/6fb41998-8bcc-485d-a1ff-2dde5fa1e978" status: 200 len: 1311 microversion: 2.1 time: 0.388826 Sep 24 21:38:02.043567 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3151/6322] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:01 2022] GET /compute/v2.1/servers/6fb41998-8bcc-485d-a1ff-2dde5fa1e978 => generated 1311 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:03.067762 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-787e680d-592d-4b93-a66b-f7b056423900 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:03.068467 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-787e680d-592d-4b93-a66b-f7b056423900 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] [instance: 6fb41998-8bcc-485d-a1ff-2dde5fa1e978] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:03.075472 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-787e680d-592d-4b93-a66b-f7b056423900 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:03.075957 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-787e680d-592d-4b93-a66b-f7b056423900 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:03.076399 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-787e680d-592d-4b93-a66b-f7b056423900 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:03.077097 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-787e680d-592d-4b93-a66b-f7b056423900 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:03.077567 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-787e680d-592d-4b93-a66b-f7b056423900 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:03.078008 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-787e680d-592d-4b93-a66b-f7b056423900 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:03.095482 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-787e680d-592d-4b93-a66b-f7b056423900 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] HTTP exception thrown: Instance 6fb41998-8bcc-485d-a1ff-2dde5fa1e978 could not be found. Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-787e680d-592d-4b93-a66b-f7b056423900 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Request method failure captured: Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/6fb41998-8bcc-485d-a1ff-2dde5fa1e978 HTTP/1.1 Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3ip9UN5Sb0Fnk683gxne0rvOB2k297zk1RxiyUAFGcgLfxmqnXFJ153wbIUKbhxH-Rf1eU0GJN57dZni15YRd3zBLHQ2DioePBhjFuSkJxWUk2fvIjBJj40meLP2v13tv_Nm8s3_q_WDsDLMKJX4g1pZTIfFnclYimN3QNhOTJZd8c Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 81e0a49f48ed4f399bc339fbf37e75de Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1084078095 Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/81e0a49f48ed4f399bc339fbf37e75de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_81e0a49f48ed4f399bc339fbf37e75de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/81e0a49f48ed4f399bc339fbf37e75de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/81e0a49f48ed4f399bc339fbf37e75de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1084078095 Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 81e0a49f48ed4f399bc339fbf37e75de Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1084078095 Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersAdminNegativeTestJSON-1084078095-project Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 712476b96d7c4066a460868988d23109 Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1084078095-project Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 6fb41998-8bcc-485d-a1ff-2dde5fa1e978 could not be found. Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '6fb41998-8bcc-485d-a1ff-2dde5fa1e978'} Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fb41998-8bcc-485d-a1ff-2dde5fa1e978 could not be found. Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fb41998-8bcc-485d-a1ff-2dde5fa1e978 could not be found. Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:38:03.097113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:38:03.101075 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:38:03.101075 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:38:03.101075 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:38:03.101075 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:38:03.101075 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:38:03.101075 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:38:03.101075 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fb41998-8bcc-485d-a1ff-2dde5fa1e978 could not be found. Sep 24 21:38:03.101075 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:38:03.101075 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-787e680d-592d-4b93-a66b-f7b056423900 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] Returning 404 to user: Instance 6fb41998-8bcc-485d-a1ff-2dde5fa1e978 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:38:03.101075 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-787e680d-592d-4b93-a66b-f7b056423900 tempest-ServersAdminNegativeTestJSON-1084078095 tempest-ServersAdminNegativeTestJSON-1084078095-project] 10.222.0.52 "GET /compute/v2.1/servers/6fb41998-8bcc-485d-a1ff-2dde5fa1e978" status: 404 len: 111 microversion: 2.1 time: 0.035871 Sep 24 21:38:03.101075 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3172/6323] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:03 2022] GET /compute/v2.1/servers/6fb41998-8bcc-485d-a1ff-2dde5fa1e978 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:38:09.091905 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:38:09.093956 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:38:09.237667 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3d69df43-eaf6-4ba3-b839-6cbb0c67c18a tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-693296238", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "1bef9208-b816-438b-8780-07d9464ea875"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:38:09.293509 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-3d69df43-eaf6-4ba3-b839-6cbb0c67c18a tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] validate_networks() for [('1bef9208-b816-438b-8780-07d9464ea875', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:38:09.709611 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-3d69df43-eaf6-4ba3-b839-6cbb0c67c18a tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:38:09.710153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-3d69df43-eaf6-4ba3-b839-6cbb0c67c18a tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:38:09.710765 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-3d69df43-eaf6-4ba3-b839-6cbb0c67c18a tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:38:09.711413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-3d69df43-eaf6-4ba3-b839-6cbb0c67c18a tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:38:09.711902 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-3d69df43-eaf6-4ba3-b839-6cbb0c67c18a tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:38:09.723073 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d69df43-eaf6-4ba3-b839-6cbb0c67c18a tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:09.723657 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d69df43-eaf6-4ba3-b839-6cbb0c67c18a tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:09.724164 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d69df43-eaf6-4ba3-b839-6cbb0c67c18a tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:09.724959 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d69df43-eaf6-4ba3-b839-6cbb0c67c18a tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:09.725490 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d69df43-eaf6-4ba3-b839-6cbb0c67c18a tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:09.725982 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3d69df43-eaf6-4ba3-b839-6cbb0c67c18a tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:09.743644 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-3d69df43-eaf6-4ba3-b839-6cbb0c67c18a tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Getting quotas for project d1128ece39524084b4e4229ad0375bf4. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:38:09.749702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-3d69df43-eaf6-4ba3-b839-6cbb0c67c18a tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Getting quotas for user 0bff3127ccc748e49e7d6d5d34df43ad and project d1128ece39524084b4e4229ad0375bf4. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:38:09.763420 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3d69df43-eaf6-4ba3-b839-6cbb0c67c18a tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:38:09.765751 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3d69df43-eaf6-4ba3-b839-6cbb0c67c18a tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:38:09.815271 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3d69df43-eaf6-4ba3-b839-6cbb0c67c18a tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.742884 Sep 24 21:38:09.815887 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3152/6324] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:38:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:38:09.828267 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-21138af7-2f84-406d-8c89-ecdc51eff406 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:09.829110 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-21138af7-2f84-406d-8c89-ecdc51eff406 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:09.832471 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:38:09.833178 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:38:09.889498 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-21138af7-2f84-406d-8c89-ecdc51eff406 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:09.896592 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-21138af7-2f84-406d-8c89-ecdc51eff406 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1214 microversion: 2.1 time: 0.073224 Sep 24 21:38:09.897173 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3173/6325] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:09 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:10.919506 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-649ba17d-aa04-4f83-a261-0925a00d3f96 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:10.920665 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-649ba17d-aa04-4f83-a261-0925a00d3f96 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:10.993626 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-649ba17d-aa04-4f83-a261-0925a00d3f96 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:11.006144 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-649ba17d-aa04-4f83-a261-0925a00d3f96 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1214 microversion: 2.1 time: 0.091251 Sep 24 21:38:11.007905 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3153/6326] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:10 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:12.035320 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8218a31f-5928-43e9-aa4e-22347724743d tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:12.035949 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8218a31f-5928-43e9-aa4e-22347724743d tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:12.091937 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8218a31f-5928-43e9-aa4e-22347724743d tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:12.099003 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8218a31f-5928-43e9-aa4e-22347724743d tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1214 microversion: 2.1 time: 0.067558 Sep 24 21:38:12.099580 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3174/6327] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:12 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:13.122388 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-06f1cc38-a22d-4f1c-9fd9-0abb57eeb81c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:13.122969 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-06f1cc38-a22d-4f1c-9fd9-0abb57eeb81c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:13.131175 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06f1cc38-a22d-4f1c-9fd9-0abb57eeb81c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:13.131175 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06f1cc38-a22d-4f1c-9fd9-0abb57eeb81c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:13.131414 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06f1cc38-a22d-4f1c-9fd9-0abb57eeb81c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:13.131933 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06f1cc38-a22d-4f1c-9fd9-0abb57eeb81c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:13.132404 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06f1cc38-a22d-4f1c-9fd9-0abb57eeb81c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:13.132818 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-06f1cc38-a22d-4f1c-9fd9-0abb57eeb81c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:13.193880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-06f1cc38-a22d-4f1c-9fd9-0abb57eeb81c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:13.202235 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-06f1cc38-a22d-4f1c-9fd9-0abb57eeb81c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1218 microversion: 2.1 time: 0.083986 Sep 24 21:38:13.202830 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3154/6328] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:13 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:14.225563 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ab88cd08-c011-4aa7-869c-02255f1c9163 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:14.226163 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ab88cd08-c011-4aa7-869c-02255f1c9163 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:14.228889 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=59 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:38:14.235070 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ab88cd08-c011-4aa7-869c-02255f1c9163 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:14.235566 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ab88cd08-c011-4aa7-869c-02255f1c9163 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:14.236012 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ab88cd08-c011-4aa7-869c-02255f1c9163 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:14.236740 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ab88cd08-c011-4aa7-869c-02255f1c9163 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:14.237203 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ab88cd08-c011-4aa7-869c-02255f1c9163 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:14.237635 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ab88cd08-c011-4aa7-869c-02255f1c9163 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:14.310697 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ab88cd08-c011-4aa7-869c-02255f1c9163 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:14.319377 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ab88cd08-c011-4aa7-869c-02255f1c9163 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1266 microversion: 2.1 time: 0.097714 Sep 24 21:38:14.320570 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3175/6329] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:14 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:15.343121 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e36d38bd-1d54-4784-adc1-2f0f9aa69a19 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:15.343760 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e36d38bd-1d54-4784-adc1-2f0f9aa69a19 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:15.350793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e36d38bd-1d54-4784-adc1-2f0f9aa69a19 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:15.351288 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e36d38bd-1d54-4784-adc1-2f0f9aa69a19 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:15.351731 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e36d38bd-1d54-4784-adc1-2f0f9aa69a19 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:15.352447 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e36d38bd-1d54-4784-adc1-2f0f9aa69a19 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:15.352914 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e36d38bd-1d54-4784-adc1-2f0f9aa69a19 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:15.353351 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e36d38bd-1d54-4784-adc1-2f0f9aa69a19 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:15.592521 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e36d38bd-1d54-4784-adc1-2f0f9aa69a19 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:15.600358 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e36d38bd-1d54-4784-adc1-2f0f9aa69a19 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1314 microversion: 2.1 time: 0.261674 Sep 24 21:38:15.600948 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3155/6330] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:15 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:15.746646 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-31a24e2d-e521-4b2a-8e57-506a45df84c4 req-d5624eee-4f40-4397-8e0e-195094d10454 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d817bbd-8a92-45b4-8383-f72e422655d6", "tag": "deeed8af-c852-4ee6-9980-308631ce54db"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:38:15.757277 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-31a24e2d-e521-4b2a-8e57-506a45df84c4 req-d5624eee-4f40-4397-8e0e-195094d10454 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:15.757867 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-31a24e2d-e521-4b2a-8e57-506a45df84c4 req-d5624eee-4f40-4397-8e0e-195094d10454 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:15.758383 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-31a24e2d-e521-4b2a-8e57-506a45df84c4 req-d5624eee-4f40-4397-8e0e-195094d10454 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:15.770710 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-31a24e2d-e521-4b2a-8e57-506a45df84c4 req-d5624eee-4f40-4397-8e0e-195094d10454 service nova] Creating event network-changed:deeed8af-c852-4ee6-9980-308631ce54db for instance 4d817bbd-8a92-45b4-8383-f72e422655d6 on nch1-master-1 Sep 24 21:38:15.775716 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-31a24e2d-e521-4b2a-8e57-506a45df84c4 req-d5624eee-4f40-4397-8e0e-195094d10454 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033072 Sep 24 21:38:15.777258 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3176/6331] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:38:16.623916 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-27e74b8e-b247-42fa-94e7-f12811bd3b7b tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:16.624629 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-27e74b8e-b247-42fa-94e7-f12811bd3b7b tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:16.627411 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:38:16.633093 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27e74b8e-b247-42fa-94e7-f12811bd3b7b tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:16.633716 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27e74b8e-b247-42fa-94e7-f12811bd3b7b tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:16.634173 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27e74b8e-b247-42fa-94e7-f12811bd3b7b tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:16.634922 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27e74b8e-b247-42fa-94e7-f12811bd3b7b tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:16.635412 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27e74b8e-b247-42fa-94e7-f12811bd3b7b tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:16.636088 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27e74b8e-b247-42fa-94e7-f12811bd3b7b tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:16.642057 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:38:16.778077 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-27e74b8e-b247-42fa-94e7-f12811bd3b7b tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:16.785795 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-27e74b8e-b247-42fa-94e7-f12811bd3b7b tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1314 microversion: 2.1 time: 0.165888 Sep 24 21:38:16.786390 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3156/6332] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:16 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:17.811286 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6f73cac2-713e-476e-b385-25c97d523202 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:17.812001 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6f73cac2-713e-476e-b385-25c97d523202 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:17.813979 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:38:17.820120 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f73cac2-713e-476e-b385-25c97d523202 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:17.820611 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f73cac2-713e-476e-b385-25c97d523202 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:17.821054 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f73cac2-713e-476e-b385-25c97d523202 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:17.821758 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f73cac2-713e-476e-b385-25c97d523202 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:17.822218 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f73cac2-713e-476e-b385-25c97d523202 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:17.822680 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f73cac2-713e-476e-b385-25c97d523202 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:17.959715 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6f73cac2-713e-476e-b385-25c97d523202 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:17.967619 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6f73cac2-713e-476e-b385-25c97d523202 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1314 microversion: 2.1 time: 0.162080 Sep 24 21:38:17.968203 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3177/6333] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:17 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:18.990697 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-896a661d-ccda-471b-9a23-27f4411ac8d9 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:18.991422 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-896a661d-ccda-471b-9a23-27f4411ac8d9 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:18.998989 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-896a661d-ccda-471b-9a23-27f4411ac8d9 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:18.999565 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-896a661d-ccda-471b-9a23-27f4411ac8d9 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:19.000082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-896a661d-ccda-471b-9a23-27f4411ac8d9 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:19.000804 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-896a661d-ccda-471b-9a23-27f4411ac8d9 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:19.001428 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-896a661d-ccda-471b-9a23-27f4411ac8d9 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:19.001699 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-896a661d-ccda-471b-9a23-27f4411ac8d9 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:19.136944 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-896a661d-ccda-471b-9a23-27f4411ac8d9 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:19.144871 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-896a661d-ccda-471b-9a23-27f4411ac8d9 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1314 microversion: 2.1 time: 0.158050 Sep 24 21:38:19.145382 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3157/6334] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:18 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:20.168042 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-55d39258-0df9-4ca6-b039-a55ba7a55570 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:20.168669 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-55d39258-0df9-4ca6-b039-a55ba7a55570 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:20.177364 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-55d39258-0df9-4ca6-b039-a55ba7a55570 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:20.177929 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-55d39258-0df9-4ca6-b039-a55ba7a55570 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:20.178622 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-55d39258-0df9-4ca6-b039-a55ba7a55570 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:20.179355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-55d39258-0df9-4ca6-b039-a55ba7a55570 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:20.179822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-55d39258-0df9-4ca6-b039-a55ba7a55570 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:20.180265 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-55d39258-0df9-4ca6-b039-a55ba7a55570 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:20.307131 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-55d39258-0df9-4ca6-b039-a55ba7a55570 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:20.314928 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-55d39258-0df9-4ca6-b039-a55ba7a55570 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1314 microversion: 2.1 time: 0.150895 Sep 24 21:38:20.315509 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3178/6335] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:20 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:21.337882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d688b739-c035-4dbf-bb9b-1b3341900399 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:21.338526 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d688b739-c035-4dbf-bb9b-1b3341900399 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:21.341069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:38:21.342887 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=8 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:38:21.348752 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d688b739-c035-4dbf-bb9b-1b3341900399 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:21.349241 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d688b739-c035-4dbf-bb9b-1b3341900399 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:21.349713 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d688b739-c035-4dbf-bb9b-1b3341900399 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:21.350416 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d688b739-c035-4dbf-bb9b-1b3341900399 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:21.350900 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d688b739-c035-4dbf-bb9b-1b3341900399 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:21.351331 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d688b739-c035-4dbf-bb9b-1b3341900399 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:21.490460 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-54f15908-6351-42e1-afb8-561e89e8c4e8 req-e2639589-bfc5-4a6a-abaf-f915bd5fb8f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d817bbd-8a92-45b4-8383-f72e422655d6", "name": "network-vif-plugged", "status": "completed", "tag": "deeed8af-c852-4ee6-9980-308631ce54db"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:38:21.495896 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d688b739-c035-4dbf-bb9b-1b3341900399 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:21.502696 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-54f15908-6351-42e1-afb8-561e89e8c4e8 req-e2639589-bfc5-4a6a-abaf-f915bd5fb8f5 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:21.503187 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-54f15908-6351-42e1-afb8-561e89e8c4e8 req-e2639589-bfc5-4a6a-abaf-f915bd5fb8f5 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:21.503630 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-54f15908-6351-42e1-afb8-561e89e8c4e8 req-e2639589-bfc5-4a6a-abaf-f915bd5fb8f5 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:21.506827 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d688b739-c035-4dbf-bb9b-1b3341900399 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1314 microversion: 2.1 time: 0.172777 Sep 24 21:38:21.507808 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3158/6336] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:21 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:21.515583 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-54f15908-6351-42e1-afb8-561e89e8c4e8 req-e2639589-bfc5-4a6a-abaf-f915bd5fb8f5 service nova] Creating event network-vif-plugged:deeed8af-c852-4ee6-9980-308631ce54db for instance 4d817bbd-8a92-45b4-8383-f72e422655d6 on nch1-master-1 Sep 24 21:38:21.521623 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-54f15908-6351-42e1-afb8-561e89e8c4e8 req-e2639589-bfc5-4a6a-abaf-f915bd5fb8f5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034925 Sep 24 21:38:21.522985 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3179/6337] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:38:22.529816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d8633d83-dee3-4d0a-a8bc-28d59c545597 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:22.530421 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d8633d83-dee3-4d0a-a8bc-28d59c545597 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:22.537598 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d8633d83-dee3-4d0a-a8bc-28d59c545597 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:22.538089 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d8633d83-dee3-4d0a-a8bc-28d59c545597 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:22.538564 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d8633d83-dee3-4d0a-a8bc-28d59c545597 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:22.539793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d8633d83-dee3-4d0a-a8bc-28d59c545597 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:22.540347 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d8633d83-dee3-4d0a-a8bc-28d59c545597 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:22.540790 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d8633d83-dee3-4d0a-a8bc-28d59c545597 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:23.019259 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d8633d83-dee3-4d0a-a8bc-28d59c545597 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:23.027446 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d8633d83-dee3-4d0a-a8bc-28d59c545597 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1314 microversion: 2.1 time: 0.501563 Sep 24 21:38:23.028043 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3159/6338] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:22 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1314 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:24.054215 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a2b9fddb-c3d9-42cd-881a-80ad0d1f1f4c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:24.054870 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a2b9fddb-c3d9-42cd-881a-80ad0d1f1f4c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:24.057002 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=4 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:38:24.063209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a2b9fddb-c3d9-42cd-881a-80ad0d1f1f4c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:24.063705 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a2b9fddb-c3d9-42cd-881a-80ad0d1f1f4c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:24.064151 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a2b9fddb-c3d9-42cd-881a-80ad0d1f1f4c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:24.064855 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a2b9fddb-c3d9-42cd-881a-80ad0d1f1f4c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:24.065315 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a2b9fddb-c3d9-42cd-881a-80ad0d1f1f4c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:24.065775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a2b9fddb-c3d9-42cd-881a-80ad0d1f1f4c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:24.192831 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a2b9fddb-c3d9-42cd-881a-80ad0d1f1f4c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:24.200942 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a2b9fddb-c3d9-42cd-881a-80ad0d1f1f4c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1502 microversion: 2.1 time: 0.151239 Sep 24 21:38:24.201512 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3180/6339] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:24 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:24.223592 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a2056030-300c-4f8d-ae48-f55c250c5104 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:38:24.225954 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a2056030-300c-4f8d-ae48-f55c250c5104 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:24.233578 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2056030-300c-4f8d-ae48-f55c250c5104 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:24.234057 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2056030-300c-4f8d-ae48-f55c250c5104 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:24.234579 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2056030-300c-4f8d-ae48-f55c250c5104 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:24.235208 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2056030-300c-4f8d-ae48-f55c250c5104 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:24.235662 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2056030-300c-4f8d-ae48-f55c250c5104 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:24.236086 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2056030-300c-4f8d-ae48-f55c250c5104 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:24.263729 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a2056030-300c-4f8d-ae48-f55c250c5104 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:24.269230 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a2056030-300c-4f8d-ae48-f55c250c5104 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Old instance type m1.heat2, new instance type m1.heat {{(pid=140516) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 24 21:38:24.278111 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-a2056030-300c-4f8d-ae48-f55c250c5104 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:38:24.278565 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-a2056030-300c-4f8d-ae48-f55c250c5104 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:38:24.279062 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-a2056030-300c-4f8d-ae48-f55c250c5104 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:38:24.279488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-a2056030-300c-4f8d-ae48-f55c250c5104 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:38:24.279917 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-a2056030-300c-4f8d-ae48-f55c250c5104 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:38:24.343990 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a2056030-300c-4f8d-ae48-f55c250c5104 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "POST /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6/action" status: 202 len: 0 microversion: 2.1 time: 0.124315 Sep 24 21:38:24.344608 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3160/6340] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:38:24 2022] POST /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:38:24.352628 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a199402d-d00e-40ed-9584-f1fd0ef926cb tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:24.353250 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a199402d-d00e-40ed-9584-f1fd0ef926cb tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:24.359871 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a199402d-d00e-40ed-9584-f1fd0ef926cb tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:24.360370 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a199402d-d00e-40ed-9584-f1fd0ef926cb tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:24.360826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a199402d-d00e-40ed-9584-f1fd0ef926cb tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:24.361533 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a199402d-d00e-40ed-9584-f1fd0ef926cb tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:24.361998 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a199402d-d00e-40ed-9584-f1fd0ef926cb tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:24.362430 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a199402d-d00e-40ed-9584-f1fd0ef926cb tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:24.538486 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a199402d-d00e-40ed-9584-f1fd0ef926cb tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:24.547144 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a199402d-d00e-40ed-9584-f1fd0ef926cb tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1511 microversion: 2.1 time: 0.197796 Sep 24 21:38:24.547646 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3181/6341] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:24 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1511 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:25.570756 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b94bb241-744d-4588-a44f-37ffaec85daf tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:25.571387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b94bb241-744d-4588-a44f-37ffaec85daf tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:25.579384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b94bb241-744d-4588-a44f-37ffaec85daf tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:25.579889 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b94bb241-744d-4588-a44f-37ffaec85daf tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:25.580355 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b94bb241-744d-4588-a44f-37ffaec85daf tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:25.581141 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b94bb241-744d-4588-a44f-37ffaec85daf tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:25.581504 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b94bb241-744d-4588-a44f-37ffaec85daf tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:25.581943 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b94bb241-744d-4588-a44f-37ffaec85daf tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:25.714765 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b94bb241-744d-4588-a44f-37ffaec85daf tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:25.723563 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b94bb241-744d-4588-a44f-37ffaec85daf tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1511 microversion: 2.1 time: 0.158183 Sep 24 21:38:25.724138 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3161/6342] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:25 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:38:26.746707 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4ad4c6fe-d2fa-4602-8c0c-309d419307b9 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:26.747326 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4ad4c6fe-d2fa-4602-8c0c-309d419307b9 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:26.754586 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ad4c6fe-d2fa-4602-8c0c-309d419307b9 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:26.755083 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ad4c6fe-d2fa-4602-8c0c-309d419307b9 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:26.755518 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ad4c6fe-d2fa-4602-8c0c-309d419307b9 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:26.756214 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ad4c6fe-d2fa-4602-8c0c-309d419307b9 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:26.756689 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ad4c6fe-d2fa-4602-8c0c-309d419307b9 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:26.757118 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4ad4c6fe-d2fa-4602-8c0c-309d419307b9 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:26.894860 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4ad4c6fe-d2fa-4602-8c0c-309d419307b9 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:26.904633 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4ad4c6fe-d2fa-4602-8c0c-309d419307b9 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1516 microversion: 2.1 time: 0.161745 Sep 24 21:38:26.905224 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3182/6343] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:26 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:27.928913 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6516ead5-5403-4c29-99c2-48a97e26f12c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:27.929457 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6516ead5-5403-4c29-99c2-48a97e26f12c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:27.936652 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6516ead5-5403-4c29-99c2-48a97e26f12c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:27.937137 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6516ead5-5403-4c29-99c2-48a97e26f12c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:27.937583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6516ead5-5403-4c29-99c2-48a97e26f12c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:27.938284 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6516ead5-5403-4c29-99c2-48a97e26f12c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:27.938769 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6516ead5-5403-4c29-99c2-48a97e26f12c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:27.939203 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6516ead5-5403-4c29-99c2-48a97e26f12c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:28.069250 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6516ead5-5403-4c29-99c2-48a97e26f12c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:28.077325 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6516ead5-5403-4c29-99c2-48a97e26f12c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1516 microversion: 2.1 time: 0.152450 Sep 24 21:38:28.077894 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3162/6344] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:27 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:29.101068 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2c954bb6-bc1d-4c57-99d9-7401a8adf518 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:29.101686 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2c954bb6-bc1d-4c57-99d9-7401a8adf518 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:29.109076 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c954bb6-bc1d-4c57-99d9-7401a8adf518 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:29.109562 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c954bb6-bc1d-4c57-99d9-7401a8adf518 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:29.109999 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c954bb6-bc1d-4c57-99d9-7401a8adf518 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:29.110722 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c954bb6-bc1d-4c57-99d9-7401a8adf518 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:29.111178 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c954bb6-bc1d-4c57-99d9-7401a8adf518 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:29.111601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2c954bb6-bc1d-4c57-99d9-7401a8adf518 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:29.243105 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2c954bb6-bc1d-4c57-99d9-7401a8adf518 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:29.251595 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2c954bb6-bc1d-4c57-99d9-7401a8adf518 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1516 microversion: 2.1 time: 0.154470 Sep 24 21:38:29.252180 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3183/6345] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:29 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:30.275604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a300de57-f8ed-43d7-971f-673785bdab5f tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:30.276224 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a300de57-f8ed-43d7-971f-673785bdab5f tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:30.283463 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a300de57-f8ed-43d7-971f-673785bdab5f tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:30.283947 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a300de57-f8ed-43d7-971f-673785bdab5f tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:30.284381 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a300de57-f8ed-43d7-971f-673785bdab5f tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:30.285072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a300de57-f8ed-43d7-971f-673785bdab5f tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:30.285527 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a300de57-f8ed-43d7-971f-673785bdab5f tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:30.285951 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a300de57-f8ed-43d7-971f-673785bdab5f tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:30.417754 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a300de57-f8ed-43d7-971f-673785bdab5f tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:30.426482 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a300de57-f8ed-43d7-971f-673785bdab5f tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1516 microversion: 2.1 time: 0.154840 Sep 24 21:38:30.427090 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3163/6346] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:30 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:31.450769 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3a25d020-9500-4504-9a45-9c0bb360bb2f tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:31.451454 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3a25d020-9500-4504-9a45-9c0bb360bb2f tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:31.458636 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a25d020-9500-4504-9a45-9c0bb360bb2f tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:31.459156 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a25d020-9500-4504-9a45-9c0bb360bb2f tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:31.459600 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a25d020-9500-4504-9a45-9c0bb360bb2f tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:31.460305 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a25d020-9500-4504-9a45-9c0bb360bb2f tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:31.460766 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a25d020-9500-4504-9a45-9c0bb360bb2f tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:31.461200 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a25d020-9500-4504-9a45-9c0bb360bb2f tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:31.593359 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3a25d020-9500-4504-9a45-9c0bb360bb2f tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:31.601222 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3a25d020-9500-4504-9a45-9c0bb360bb2f tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1516 microversion: 2.1 time: 0.155137 Sep 24 21:38:31.601792 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3184/6347] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:31 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:32.625608 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9fc7282b-8763-48ca-94ce-e1eb60717f1c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:32.626237 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9fc7282b-8763-48ca-94ce-e1eb60717f1c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:32.633493 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9fc7282b-8763-48ca-94ce-e1eb60717f1c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:32.633872 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9fc7282b-8763-48ca-94ce-e1eb60717f1c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:32.634316 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9fc7282b-8763-48ca-94ce-e1eb60717f1c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:32.635071 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9fc7282b-8763-48ca-94ce-e1eb60717f1c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:32.635528 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9fc7282b-8763-48ca-94ce-e1eb60717f1c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:32.635960 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9fc7282b-8763-48ca-94ce-e1eb60717f1c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:32.770683 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9fc7282b-8763-48ca-94ce-e1eb60717f1c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:32.779387 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9fc7282b-8763-48ca-94ce-e1eb60717f1c tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1516 microversion: 2.1 time: 0.158101 Sep 24 21:38:32.779958 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3164/6348] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:32 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:38:33.801859 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bd116bf9-0787-4f96-b1fa-f48227a9ff5a tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:33.802476 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bd116bf9-0787-4f96-b1fa-f48227a9ff5a tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:33.810287 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bd116bf9-0787-4f96-b1fa-f48227a9ff5a tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:33.810805 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bd116bf9-0787-4f96-b1fa-f48227a9ff5a tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:33.811242 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bd116bf9-0787-4f96-b1fa-f48227a9ff5a tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:33.811934 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bd116bf9-0787-4f96-b1fa-f48227a9ff5a tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:33.812387 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bd116bf9-0787-4f96-b1fa-f48227a9ff5a tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:33.812813 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bd116bf9-0787-4f96-b1fa-f48227a9ff5a tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:33.942901 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bd116bf9-0787-4f96-b1fa-f48227a9ff5a tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:33.951660 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bd116bf9-0787-4f96-b1fa-f48227a9ff5a tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1516 microversion: 2.1 time: 0.153618 Sep 24 21:38:33.952231 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3185/6349] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:33 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:34.974088 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-150c3863-2552-4d81-83eb-4905d5369eaa tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:34.974742 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-150c3863-2552-4d81-83eb-4905d5369eaa tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:34.981914 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-150c3863-2552-4d81-83eb-4905d5369eaa tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:34.982645 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-150c3863-2552-4d81-83eb-4905d5369eaa tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:34.983248 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-150c3863-2552-4d81-83eb-4905d5369eaa tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:34.984103 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-150c3863-2552-4d81-83eb-4905d5369eaa tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:34.984560 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-150c3863-2552-4d81-83eb-4905d5369eaa tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:34.984987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-150c3863-2552-4d81-83eb-4905d5369eaa tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:35.121551 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-150c3863-2552-4d81-83eb-4905d5369eaa tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:35.129368 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-150c3863-2552-4d81-83eb-4905d5369eaa tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1516 microversion: 2.1 time: 0.159198 Sep 24 21:38:35.129945 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3165/6350] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:34 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:36.153361 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7bc0a5c7-d94a-47ab-9d40-5a27292eccb2 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:36.153978 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7bc0a5c7-d94a-47ab-9d40-5a27292eccb2 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:36.160836 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7bc0a5c7-d94a-47ab-9d40-5a27292eccb2 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:36.161337 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7bc0a5c7-d94a-47ab-9d40-5a27292eccb2 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:36.161781 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7bc0a5c7-d94a-47ab-9d40-5a27292eccb2 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:36.162487 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7bc0a5c7-d94a-47ab-9d40-5a27292eccb2 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:36.162980 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7bc0a5c7-d94a-47ab-9d40-5a27292eccb2 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:36.163420 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7bc0a5c7-d94a-47ab-9d40-5a27292eccb2 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:36.290833 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7bc0a5c7-d94a-47ab-9d40-5a27292eccb2 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:36.299448 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7bc0a5c7-d94a-47ab-9d40-5a27292eccb2 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1516 microversion: 2.1 time: 0.150575 Sep 24 21:38:36.300033 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3186/6351] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:36 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:37.323951 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8898e981-c27f-4496-9bc6-f3849e3ee0dd tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:37.325043 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8898e981-c27f-4496-9bc6-f3849e3ee0dd tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:37.332253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8898e981-c27f-4496-9bc6-f3849e3ee0dd tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:37.332738 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8898e981-c27f-4496-9bc6-f3849e3ee0dd tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:37.333175 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8898e981-c27f-4496-9bc6-f3849e3ee0dd tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:37.333872 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8898e981-c27f-4496-9bc6-f3849e3ee0dd tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:37.334330 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8898e981-c27f-4496-9bc6-f3849e3ee0dd tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:37.334790 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8898e981-c27f-4496-9bc6-f3849e3ee0dd tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:37.469926 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8898e981-c27f-4496-9bc6-f3849e3ee0dd tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:37.477772 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8898e981-c27f-4496-9bc6-f3849e3ee0dd tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1516 microversion: 2.1 time: 0.157836 Sep 24 21:38:37.478344 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3166/6352] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:37 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:38.501137 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1720b9f9-f178-4911-9729-364e68049153 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:38.501688 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1720b9f9-f178-4911-9729-364e68049153 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:38.508636 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1720b9f9-f178-4911-9729-364e68049153 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:38.509125 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1720b9f9-f178-4911-9729-364e68049153 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:38.509576 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1720b9f9-f178-4911-9729-364e68049153 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:38.510281 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1720b9f9-f178-4911-9729-364e68049153 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:38.510775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1720b9f9-f178-4911-9729-364e68049153 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:38.511211 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1720b9f9-f178-4911-9729-364e68049153 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:38.643553 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1720b9f9-f178-4911-9729-364e68049153 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:38.651320 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1720b9f9-f178-4911-9729-364e68049153 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1516 microversion: 2.1 time: 0.154167 Sep 24 21:38:38.651909 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3187/6353] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:38 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:39.675584 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-39aa21de-d4cc-4dab-9e78-088249e6e701 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:39.676210 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-39aa21de-d4cc-4dab-9e78-088249e6e701 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:39.683185 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-39aa21de-d4cc-4dab-9e78-088249e6e701 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:39.683715 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-39aa21de-d4cc-4dab-9e78-088249e6e701 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:39.684924 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-39aa21de-d4cc-4dab-9e78-088249e6e701 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:39.685628 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-39aa21de-d4cc-4dab-9e78-088249e6e701 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:39.686097 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-39aa21de-d4cc-4dab-9e78-088249e6e701 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:39.686556 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-39aa21de-d4cc-4dab-9e78-088249e6e701 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:39.815356 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-39aa21de-d4cc-4dab-9e78-088249e6e701 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:39.823170 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-39aa21de-d4cc-4dab-9e78-088249e6e701 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1516 microversion: 2.1 time: 0.151847 Sep 24 21:38:39.823745 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3167/6354] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:39 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:40.846642 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ea40740f-0c0b-443e-af31-078f9456f1bf tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:40.847264 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ea40740f-0c0b-443e-af31-078f9456f1bf tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:40.854092 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ea40740f-0c0b-443e-af31-078f9456f1bf tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:40.854626 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ea40740f-0c0b-443e-af31-078f9456f1bf tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:40.855074 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ea40740f-0c0b-443e-af31-078f9456f1bf tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:40.855810 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ea40740f-0c0b-443e-af31-078f9456f1bf tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:40.856243 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ea40740f-0c0b-443e-af31-078f9456f1bf tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:40.856669 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ea40740f-0c0b-443e-af31-078f9456f1bf tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:40.991310 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ea40740f-0c0b-443e-af31-078f9456f1bf tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:40.999831 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ea40740f-0c0b-443e-af31-078f9456f1bf tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1516 microversion: 2.1 time: 0.157371 Sep 24 21:38:41.000406 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3188/6355] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:40 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:42.022958 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-65a4ae7c-0f8e-4dd1-a2ba-82b7cceb66fd tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:42.023493 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-65a4ae7c-0f8e-4dd1-a2ba-82b7cceb66fd tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:42.031168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65a4ae7c-0f8e-4dd1-a2ba-82b7cceb66fd tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:42.031666 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65a4ae7c-0f8e-4dd1-a2ba-82b7cceb66fd tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:42.032114 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65a4ae7c-0f8e-4dd1-a2ba-82b7cceb66fd tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:42.032830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65a4ae7c-0f8e-4dd1-a2ba-82b7cceb66fd tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:42.033297 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65a4ae7c-0f8e-4dd1-a2ba-82b7cceb66fd tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:42.033737 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-65a4ae7c-0f8e-4dd1-a2ba-82b7cceb66fd tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:42.165001 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-65a4ae7c-0f8e-4dd1-a2ba-82b7cceb66fd tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:42.173984 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-65a4ae7c-0f8e-4dd1-a2ba-82b7cceb66fd tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1516 microversion: 2.1 time: 0.155083 Sep 24 21:38:42.174587 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3168/6356] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:42 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:43.196920 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-db395de0-86f9-4644-a6f1-aae100dcaff0 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:43.197469 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-db395de0-86f9-4644-a6f1-aae100dcaff0 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:43.204606 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db395de0-86f9-4644-a6f1-aae100dcaff0 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:43.205099 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db395de0-86f9-4644-a6f1-aae100dcaff0 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:43.205548 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db395de0-86f9-4644-a6f1-aae100dcaff0 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:43.206257 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db395de0-86f9-4644-a6f1-aae100dcaff0 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:43.206757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db395de0-86f9-4644-a6f1-aae100dcaff0 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:43.207196 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db395de0-86f9-4644-a6f1-aae100dcaff0 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:43.341668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-db395de0-86f9-4644-a6f1-aae100dcaff0 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:43.349567 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-db395de0-86f9-4644-a6f1-aae100dcaff0 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1516 microversion: 2.1 time: 0.156673 Sep 24 21:38:43.350148 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3189/6357] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:43 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:44.373762 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-92af1846-8fe6-43c1-b41b-56faa33c717d tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:44.374390 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-92af1846-8fe6-43c1-b41b-56faa33c717d tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:44.381468 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-92af1846-8fe6-43c1-b41b-56faa33c717d tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:44.381966 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-92af1846-8fe6-43c1-b41b-56faa33c717d tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:44.382417 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-92af1846-8fe6-43c1-b41b-56faa33c717d tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:44.383157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-92af1846-8fe6-43c1-b41b-56faa33c717d tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:44.383655 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-92af1846-8fe6-43c1-b41b-56faa33c717d tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:44.384097 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-92af1846-8fe6-43c1-b41b-56faa33c717d tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:44.516976 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-92af1846-8fe6-43c1-b41b-56faa33c717d tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:44.524792 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-92af1846-8fe6-43c1-b41b-56faa33c717d tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1516 microversion: 2.1 time: 0.155778 Sep 24 21:38:44.525381 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3169/6358] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:44 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:45.548548 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c009fa72-193a-4a47-9e50-70fcd44a2329 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:45.549167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c009fa72-193a-4a47-9e50-70fcd44a2329 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:45.556100 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c009fa72-193a-4a47-9e50-70fcd44a2329 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:45.556591 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c009fa72-193a-4a47-9e50-70fcd44a2329 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:45.557033 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c009fa72-193a-4a47-9e50-70fcd44a2329 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:45.557736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c009fa72-193a-4a47-9e50-70fcd44a2329 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:45.558198 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c009fa72-193a-4a47-9e50-70fcd44a2329 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:45.558704 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c009fa72-193a-4a47-9e50-70fcd44a2329 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:45.561245 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=83 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:38:45.693830 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c009fa72-193a-4a47-9e50-70fcd44a2329 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:45.702210 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c009fa72-193a-4a47-9e50-70fcd44a2329 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1516 microversion: 2.1 time: 0.157853 Sep 24 21:38:45.702825 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3190/6359] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:45 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:46.726849 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e59d40df-2d06-4cfd-9c5c-9d1755bf76ed tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:46.727468 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e59d40df-2d06-4cfd-9c5c-9d1755bf76ed tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:46.730149 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=32 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:38:46.737322 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e59d40df-2d06-4cfd-9c5c-9d1755bf76ed tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:46.737808 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e59d40df-2d06-4cfd-9c5c-9d1755bf76ed tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:46.738249 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e59d40df-2d06-4cfd-9c5c-9d1755bf76ed tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:46.738978 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e59d40df-2d06-4cfd-9c5c-9d1755bf76ed tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:46.739437 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e59d40df-2d06-4cfd-9c5c-9d1755bf76ed tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:46.739870 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e59d40df-2d06-4cfd-9c5c-9d1755bf76ed tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:46.744019 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:38:46.874971 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e59d40df-2d06-4cfd-9c5c-9d1755bf76ed tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:46.882821 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e59d40df-2d06-4cfd-9c5c-9d1755bf76ed tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1516 microversion: 2.1 time: 0.159920 Sep 24 21:38:46.883402 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3170/6360] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:46 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:47.905294 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8a344348-9f9a-4334-a9c5-b1523361e088 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:47.905885 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8a344348-9f9a-4334-a9c5-b1523361e088 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:47.908666 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=28 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:38:47.914070 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8a344348-9f9a-4334-a9c5-b1523361e088 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:47.914595 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8a344348-9f9a-4334-a9c5-b1523361e088 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:47.915046 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8a344348-9f9a-4334-a9c5-b1523361e088 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:47.915772 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8a344348-9f9a-4334-a9c5-b1523361e088 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:47.916224 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8a344348-9f9a-4334-a9c5-b1523361e088 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:47.916663 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8a344348-9f9a-4334-a9c5-b1523361e088 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:48.046556 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8a344348-9f9a-4334-a9c5-b1523361e088 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:48.055853 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8a344348-9f9a-4334-a9c5-b1523361e088 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1516 microversion: 2.1 time: 0.154559 Sep 24 21:38:48.056433 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3191/6361] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:47 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:49.079920 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4eb525a8-2fde-46b6-9e45-fd92a0968fd7 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:49.080549 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4eb525a8-2fde-46b6-9e45-fd92a0968fd7 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:49.087499 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4eb525a8-2fde-46b6-9e45-fd92a0968fd7 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:49.087992 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4eb525a8-2fde-46b6-9e45-fd92a0968fd7 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:49.088440 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4eb525a8-2fde-46b6-9e45-fd92a0968fd7 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:49.089146 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4eb525a8-2fde-46b6-9e45-fd92a0968fd7 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:49.089630 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4eb525a8-2fde-46b6-9e45-fd92a0968fd7 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:49.090074 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4eb525a8-2fde-46b6-9e45-fd92a0968fd7 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:49.223432 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4eb525a8-2fde-46b6-9e45-fd92a0968fd7 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:49.231735 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4eb525a8-2fde-46b6-9e45-fd92a0968fd7 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1516 microversion: 2.1 time: 0.155704 Sep 24 21:38:49.232313 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3171/6362] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:49 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:50.254481 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ea8935fd-070b-41f0-8a8f-bb8a4110f6f2 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:50.255144 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ea8935fd-070b-41f0-8a8f-bb8a4110f6f2 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:50.262657 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ea8935fd-070b-41f0-8a8f-bb8a4110f6f2 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:50.263167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ea8935fd-070b-41f0-8a8f-bb8a4110f6f2 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:50.263609 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ea8935fd-070b-41f0-8a8f-bb8a4110f6f2 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:50.264299 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ea8935fd-070b-41f0-8a8f-bb8a4110f6f2 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:50.264757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ea8935fd-070b-41f0-8a8f-bb8a4110f6f2 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:50.265182 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ea8935fd-070b-41f0-8a8f-bb8a4110f6f2 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:50.394245 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ea8935fd-070b-41f0-8a8f-bb8a4110f6f2 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:50.401923 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ea8935fd-070b-41f0-8a8f-bb8a4110f6f2 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1516 microversion: 2.1 time: 0.151303 Sep 24 21:38:50.403040 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3192/6363] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:50 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:51.425536 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-78a37db3-f917-4f2c-a970-80107ca94e49 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:51.426195 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-78a37db3-f917-4f2c-a970-80107ca94e49 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:51.433191 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-78a37db3-f917-4f2c-a970-80107ca94e49 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:51.433684 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-78a37db3-f917-4f2c-a970-80107ca94e49 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:51.434177 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-78a37db3-f917-4f2c-a970-80107ca94e49 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:51.435029 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-78a37db3-f917-4f2c-a970-80107ca94e49 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:51.435499 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-78a37db3-f917-4f2c-a970-80107ca94e49 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:51.435938 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-78a37db3-f917-4f2c-a970-80107ca94e49 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:51.571479 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-78a37db3-f917-4f2c-a970-80107ca94e49 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:51.579895 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-78a37db3-f917-4f2c-a970-80107ca94e49 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1516 microversion: 2.1 time: 0.158562 Sep 24 21:38:51.580471 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3172/6364] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:51 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:52.603868 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-de3c78fc-08fc-414f-a5a3-e8ab857f3ea4 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:52.604480 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-de3c78fc-08fc-414f-a5a3-e8ab857f3ea4 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:52.612057 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de3c78fc-08fc-414f-a5a3-e8ab857f3ea4 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:52.612535 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de3c78fc-08fc-414f-a5a3-e8ab857f3ea4 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:52.612977 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de3c78fc-08fc-414f-a5a3-e8ab857f3ea4 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:52.613667 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de3c78fc-08fc-414f-a5a3-e8ab857f3ea4 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:52.614122 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de3c78fc-08fc-414f-a5a3-e8ab857f3ea4 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:52.614574 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-de3c78fc-08fc-414f-a5a3-e8ab857f3ea4 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:52.748233 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-de3c78fc-08fc-414f-a5a3-e8ab857f3ea4 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:52.755936 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-de3c78fc-08fc-414f-a5a3-e8ab857f3ea4 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1516 microversion: 2.1 time: 0.156008 Sep 24 21:38:52.756515 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3193/6365] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:52 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:53.781375 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4e254c33-19be-460b-8388-1962ff5dd214 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:53.782396 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4e254c33-19be-460b-8388-1962ff5dd214 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:53.789560 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e254c33-19be-460b-8388-1962ff5dd214 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:53.790274 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e254c33-19be-460b-8388-1962ff5dd214 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:53.790489 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e254c33-19be-460b-8388-1962ff5dd214 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:53.791220 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e254c33-19be-460b-8388-1962ff5dd214 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:53.791681 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e254c33-19be-460b-8388-1962ff5dd214 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:53.792111 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e254c33-19be-460b-8388-1962ff5dd214 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:54.024707 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4e254c33-19be-460b-8388-1962ff5dd214 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:54.033107 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4e254c33-19be-460b-8388-1962ff5dd214 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1515 microversion: 2.1 time: 0.257679 Sep 24 21:38:54.033706 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3173/6366] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:53 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1515 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:54.118664 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-286fda16-ee9f-477e-bc82-beeaa72c4405 req-baff58e3-3e90-4b82-b9ad-cdad5886a509 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d817bbd-8a92-45b4-8383-f72e422655d6", "name": "network-vif-unplugged", "status": "completed", "tag": "deeed8af-c852-4ee6-9980-308631ce54db"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:38:54.128778 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-286fda16-ee9f-477e-bc82-beeaa72c4405 req-baff58e3-3e90-4b82-b9ad-cdad5886a509 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:54.129259 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-286fda16-ee9f-477e-bc82-beeaa72c4405 req-baff58e3-3e90-4b82-b9ad-cdad5886a509 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:54.129900 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-286fda16-ee9f-477e-bc82-beeaa72c4405 req-baff58e3-3e90-4b82-b9ad-cdad5886a509 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:54.142590 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-286fda16-ee9f-477e-bc82-beeaa72c4405 req-baff58e3-3e90-4b82-b9ad-cdad5886a509 service nova] Creating event network-vif-unplugged:deeed8af-c852-4ee6-9980-308631ce54db for instance 4d817bbd-8a92-45b4-8383-f72e422655d6 on nch2-master-1 Sep 24 21:38:54.148174 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [req-286fda16-ee9f-477e-bc82-beeaa72c4405 req-baff58e3-3e90-4b82-b9ad-cdad5886a509 service nova] Instance 4d817bbd-8a92-45b4-8383-f72e422655d6 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 21:38:54.159640 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-286fda16-ee9f-477e-bc82-beeaa72c4405 req-baff58e3-3e90-4b82-b9ad-cdad5886a509 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044886 Sep 24 21:38:54.160782 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3194/6367] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:38:55.058322 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2ef54fbb-5e22-4f94-9e2b-46f4ce86ca1b tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:55.059127 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2ef54fbb-5e22-4f94-9e2b-46f4ce86ca1b tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:55.066079 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2ef54fbb-5e22-4f94-9e2b-46f4ce86ca1b tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:55.066609 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2ef54fbb-5e22-4f94-9e2b-46f4ce86ca1b tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:55.067070 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2ef54fbb-5e22-4f94-9e2b-46f4ce86ca1b tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:55.067790 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2ef54fbb-5e22-4f94-9e2b-46f4ce86ca1b tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:55.068258 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2ef54fbb-5e22-4f94-9e2b-46f4ce86ca1b tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:55.068728 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2ef54fbb-5e22-4f94-9e2b-46f4ce86ca1b tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:55.197215 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2ef54fbb-5e22-4f94-9e2b-46f4ce86ca1b tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:55.205209 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2ef54fbb-5e22-4f94-9e2b-46f4ce86ca1b tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1513 microversion: 2.1 time: 0.151359 Sep 24 21:38:55.205721 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3174/6368] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:55 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:38:56.177426 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-00b0e89f-45d5-4a72-8080-be6c7ef54e47 req-5911d069-22b1-405a-a6ac-75fc0d19b701 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d817bbd-8a92-45b4-8383-f72e422655d6", "tag": "deeed8af-c852-4ee6-9980-308631ce54db"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:38:56.186874 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-00b0e89f-45d5-4a72-8080-be6c7ef54e47 req-5911d069-22b1-405a-a6ac-75fc0d19b701 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:56.187355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-00b0e89f-45d5-4a72-8080-be6c7ef54e47 req-5911d069-22b1-405a-a6ac-75fc0d19b701 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:56.187789 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-00b0e89f-45d5-4a72-8080-be6c7ef54e47 req-5911d069-22b1-405a-a6ac-75fc0d19b701 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:56.198957 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-00b0e89f-45d5-4a72-8080-be6c7ef54e47 req-5911d069-22b1-405a-a6ac-75fc0d19b701 service nova] Creating event network-changed:deeed8af-c852-4ee6-9980-308631ce54db for instance 4d817bbd-8a92-45b4-8383-f72e422655d6 on nch2-master-1 Sep 24 21:38:56.204688 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [req-00b0e89f-45d5-4a72-8080-be6c7ef54e47 req-5911d069-22b1-405a-a6ac-75fc0d19b701 service nova] Instance 4d817bbd-8a92-45b4-8383-f72e422655d6 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 21:38:56.215177 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-00b0e89f-45d5-4a72-8080-be6c7ef54e47 req-5911d069-22b1-405a-a6ac-75fc0d19b701 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042888 Sep 24 21:38:56.216366 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3195/6369] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:38:56.229626 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e1a7c782-c119-4c5c-a373-8ce83ac9deac tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:56.230466 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e1a7c782-c119-4c5c-a373-8ce83ac9deac tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:56.238269 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e1a7c782-c119-4c5c-a373-8ce83ac9deac tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:56.238806 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e1a7c782-c119-4c5c-a373-8ce83ac9deac tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:56.239332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e1a7c782-c119-4c5c-a373-8ce83ac9deac tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:56.240085 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e1a7c782-c119-4c5c-a373-8ce83ac9deac tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:56.240718 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e1a7c782-c119-4c5c-a373-8ce83ac9deac tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:56.241192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e1a7c782-c119-4c5c-a373-8ce83ac9deac tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:56.491784 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e1a7c782-c119-4c5c-a373-8ce83ac9deac tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:56.500693 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e1a7c782-c119-4c5c-a373-8ce83ac9deac tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1513 microversion: 2.1 time: 0.275325 Sep 24 21:38:56.501391 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3175/6370] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:56 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1513 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:57.525940 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dc88708f-9e74-419f-ad6a-caf95e5bfc55 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:57.526677 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dc88708f-9e74-419f-ad6a-caf95e5bfc55 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:57.533048 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc88708f-9e74-419f-ad6a-caf95e5bfc55 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:57.533527 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc88708f-9e74-419f-ad6a-caf95e5bfc55 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:57.533966 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc88708f-9e74-419f-ad6a-caf95e5bfc55 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:57.534687 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc88708f-9e74-419f-ad6a-caf95e5bfc55 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:57.535146 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc88708f-9e74-419f-ad6a-caf95e5bfc55 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:57.535574 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc88708f-9e74-419f-ad6a-caf95e5bfc55 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:57.666038 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dc88708f-9e74-419f-ad6a-caf95e5bfc55 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:57.674893 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dc88708f-9e74-419f-ad6a-caf95e5bfc55 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1510 microversion: 2.1 time: 0.153908 Sep 24 21:38:57.675461 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3196/6371] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:57 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:38:57.697568 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-af11dcff-0705-4b25-ac37-9d1bba39b5a5 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:57.698082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-af11dcff-0705-4b25-ac37-9d1bba39b5a5 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:57.705299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af11dcff-0705-4b25-ac37-9d1bba39b5a5 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:57.705728 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af11dcff-0705-4b25-ac37-9d1bba39b5a5 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:57.706171 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af11dcff-0705-4b25-ac37-9d1bba39b5a5 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:57.706905 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af11dcff-0705-4b25-ac37-9d1bba39b5a5 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:57.707370 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af11dcff-0705-4b25-ac37-9d1bba39b5a5 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:57.707804 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af11dcff-0705-4b25-ac37-9d1bba39b5a5 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:57.736438 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-af11dcff-0705-4b25-ac37-9d1bba39b5a5 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:38:57.785797 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.compute.api [None req-af11dcff-0705-4b25-ac37-9d1bba39b5a5 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Found an unconfirmed migration during delete, id: 15, status: finished Sep 24 21:38:59.489907 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-af11dcff-0705-4b25-ac37-9d1bba39b5a5 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 204 len: 0 microversion: 2.1 time: 1.795859 Sep 24 21:38:59.490638 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3176/6372] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:38:57 2022] DELETE /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 0 bytes in 1797 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:38:59.498882 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e7097a98-95bd-48ad-829a-de8beb220447 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:38:59.499540 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e7097a98-95bd-48ad-829a-de8beb220447 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:38:59.506825 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7097a98-95bd-48ad-829a-de8beb220447 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:59.507330 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7097a98-95bd-48ad-829a-de8beb220447 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:59.507771 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7097a98-95bd-48ad-829a-de8beb220447 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:59.508507 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7097a98-95bd-48ad-829a-de8beb220447 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:38:59.508972 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7097a98-95bd-48ad-829a-de8beb220447 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:38:59.509402 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7097a98-95bd-48ad-829a-de8beb220447 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:38:59.640868 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e7097a98-95bd-48ad-829a-de8beb220447 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:38:59.648814 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e7097a98-95bd-48ad-829a-de8beb220447 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1502 microversion: 2.1 time: 0.153924 Sep 24 21:38:59.649380 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3197/6373] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:38:59 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1502 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:39:00.675952 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dd36d30b-d2a2-407b-850f-1da7def8dffe tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:00.677233 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-dd36d30b-d2a2-407b-850f-1da7def8dffe tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:00.683763 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd36d30b-d2a2-407b-850f-1da7def8dffe tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:00.684278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd36d30b-d2a2-407b-850f-1da7def8dffe tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:00.685705 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd36d30b-d2a2-407b-850f-1da7def8dffe tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:00.686641 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd36d30b-d2a2-407b-850f-1da7def8dffe tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:00.687113 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd36d30b-d2a2-407b-850f-1da7def8dffe tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:00.687560 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd36d30b-d2a2-407b-850f-1da7def8dffe tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:00.709542 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-e57531de-ca66-4400-a24e-7b0a452ee9e7 req-9d166c4b-ba6c-48b1-aab9-eff91f36683e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d817bbd-8a92-45b4-8383-f72e422655d6", "name": "network-vif-plugged", "status": "completed", "tag": "deeed8af-c852-4ee6-9980-308631ce54db"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:39:00.721476 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e57531de-ca66-4400-a24e-7b0a452ee9e7 req-9d166c4b-ba6c-48b1-aab9-eff91f36683e service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:00.721958 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e57531de-ca66-4400-a24e-7b0a452ee9e7 req-9d166c4b-ba6c-48b1-aab9-eff91f36683e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:00.722560 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-e57531de-ca66-4400-a24e-7b0a452ee9e7 req-9d166c4b-ba6c-48b1-aab9-eff91f36683e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:00.735231 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-e57531de-ca66-4400-a24e-7b0a452ee9e7 req-9d166c4b-ba6c-48b1-aab9-eff91f36683e service nova] Creating event network-vif-plugged:deeed8af-c852-4ee6-9980-308631ce54db for instance 4d817bbd-8a92-45b4-8383-f72e422655d6 on nch2-master-1 Sep 24 21:39:00.741018 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-e57531de-ca66-4400-a24e-7b0a452ee9e7 req-9d166c4b-ba6c-48b1-aab9-eff91f36683e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035683 Sep 24 21:39:00.741823 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3198/6374] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:39:00.838276 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-dd36d30b-d2a2-407b-850f-1da7def8dffe tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bff3127ccc748e49e7d6d5d34df43ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1128ece39524084b4e4229ad0375bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:00.848372 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-dd36d30b-d2a2-407b-850f-1da7def8dffe tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 200 len: 1502 microversion: 2.1 time: 0.177970 Sep 24 21:39:00.849002 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3177/6375] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:00 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 1502 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:01.398133 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-bac478d6-cda4-42c3-89f2-f683bdccb1f3 req-fa6c6002-1814-4c25-86cb-a78c6424992d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d817bbd-8a92-45b4-8383-f72e422655d6", "name": "network-vif-deleted", "tag": "deeed8af-c852-4ee6-9980-308631ce54db"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:39:01.409231 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-bac478d6-cda4-42c3-89f2-f683bdccb1f3 req-fa6c6002-1814-4c25-86cb-a78c6424992d service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:01.409628 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-bac478d6-cda4-42c3-89f2-f683bdccb1f3 req-fa6c6002-1814-4c25-86cb-a78c6424992d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:01.410057 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-bac478d6-cda4-42c3-89f2-f683bdccb1f3 req-fa6c6002-1814-4c25-86cb-a78c6424992d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:01.421762 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-bac478d6-cda4-42c3-89f2-f683bdccb1f3 req-fa6c6002-1814-4c25-86cb-a78c6424992d service nova] Creating event network-vif-deleted:deeed8af-c852-4ee6-9980-308631ce54db for instance 4d817bbd-8a92-45b4-8383-f72e422655d6 on nch2-master-1 Sep 24 21:39:01.427257 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-bac478d6-cda4-42c3-89f2-f683bdccb1f3 req-fa6c6002-1814-4c25-86cb-a78c6424992d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033028 Sep 24 21:39:01.427891 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3199/6376] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:39:01.870969 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3aa110ea-e44c-4b7c-bf1f-e94de38c734e tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:01.871697 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3aa110ea-e44c-4b7c-bf1f-e94de38c734e tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:01.879407 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3aa110ea-e44c-4b7c-bf1f-e94de38c734e tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:01.879897 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3aa110ea-e44c-4b7c-bf1f-e94de38c734e tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:01.880337 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3aa110ea-e44c-4b7c-bf1f-e94de38c734e tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:01.881040 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3aa110ea-e44c-4b7c-bf1f-e94de38c734e tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:01.881497 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3aa110ea-e44c-4b7c-bf1f-e94de38c734e tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:01.881927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3aa110ea-e44c-4b7c-bf1f-e94de38c734e tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:01.896154 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-3aa110ea-e44c-4b7c-bf1f-e94de38c734e tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] HTTP exception thrown: Instance 4d817bbd-8a92-45b4-8383-f72e422655d6 could not be found. Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3aa110ea-e44c-4b7c-bf1f-e94de38c734e tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Request method failure captured: Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 HTTP/1.1 Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3jAaG4ZDK-t0qqfCA8I-qwhMic9i5DMtg17r-tb_OeatMFkFsS0OvWBTJJGk-BI4JMVSF-nrX5-as4lJgOoIb1I8gztCBvFD2CyM6a2NV5CzqrokQO1I-DqEOVCYfeeS3tTGhz-hkZPJOIZKk4_pK5bQyjE0lVmTPzT5RmzQ4Xbz7U Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: d1128ece39524084b4e4229ad0375bf4 Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-DeleteServersTestJSON-1155268373 Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1128ece39524084b4e4229ad0375bf4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d1128ece39524084b4e4229ad0375bf4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d1128ece39524084b4e4229ad0375bf4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1128ece39524084b4e4229ad0375bf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-DeleteServersTestJSON-1155268373 Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: d1128ece39524084b4e4229ad0375bf4 Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-DeleteServersTestJSON-1155268373 Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-DeleteServersTestJSON-1155268373-project Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 0bff3127ccc748e49e7d6d5d34df43ad Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-DeleteServersTestJSON-1155268373-project Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 4d817bbd-8a92-45b4-8383-f72e422655d6 could not be found. Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '4d817bbd-8a92-45b4-8383-f72e422655d6'} Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d817bbd-8a92-45b4-8383-f72e422655d6 could not be found. Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d817bbd-8a92-45b4-8383-f72e422655d6 could not be found. Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:39:01.897802 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:39:01.901896 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:39:01.901896 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:39:01.901896 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:39:01.901896 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:39:01.901896 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:39:01.901896 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d817bbd-8a92-45b4-8383-f72e422655d6 could not be found. Sep 24 21:39:01.901896 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:39:01.901896 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3aa110ea-e44c-4b7c-bf1f-e94de38c734e tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Returning 404 to user: Instance 4d817bbd-8a92-45b4-8383-f72e422655d6 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:39:01.901896 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3aa110ea-e44c-4b7c-bf1f-e94de38c734e tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 404 len: 111 microversion: 2.1 time: 0.032400 Sep 24 21:39:01.901896 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3178/6377] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:01 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:39:01.916420 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3cb0b75f-f1af-4f8b-ad61-b4b3646fba18 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:01.917015 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3cb0b75f-f1af-4f8b-ad61-b4b3646fba18 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:01.924310 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3cb0b75f-f1af-4f8b-ad61-b4b3646fba18 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:01.924800 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3cb0b75f-f1af-4f8b-ad61-b4b3646fba18 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:01.925238 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3cb0b75f-f1af-4f8b-ad61-b4b3646fba18 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:01.925981 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3cb0b75f-f1af-4f8b-ad61-b4b3646fba18 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:01.926393 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3cb0b75f-f1af-4f8b-ad61-b4b3646fba18 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:01.926862 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3cb0b75f-f1af-4f8b-ad61-b4b3646fba18 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:01.940659 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-3cb0b75f-f1af-4f8b-ad61-b4b3646fba18 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] HTTP exception thrown: Instance 4d817bbd-8a92-45b4-8383-f72e422655d6 could not be found. Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3cb0b75f-f1af-4f8b-ad61-b4b3646fba18 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Request method failure captured: Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 HTTP/1.1 Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3jAaG4ZDK-t0qqfCA8I-qwhMic9i5DMtg17r-tb_OeatMFkFsS0OvWBTJJGk-BI4JMVSF-nrX5-as4lJgOoIb1I8gztCBvFD2CyM6a2NV5CzqrokQO1I-DqEOVCYfeeS3tTGhz-hkZPJOIZKk4_pK5bQyjE0lVmTPzT5RmzQ4Xbz7U Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: d1128ece39524084b4e4229ad0375bf4 Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-DeleteServersTestJSON-1155268373 Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1128ece39524084b4e4229ad0375bf4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d1128ece39524084b4e4229ad0375bf4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d1128ece39524084b4e4229ad0375bf4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1128ece39524084b4e4229ad0375bf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-DeleteServersTestJSON-1155268373 Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: d1128ece39524084b4e4229ad0375bf4 Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-DeleteServersTestJSON-1155268373 Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-DeleteServersTestJSON-1155268373-project Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 0bff3127ccc748e49e7d6d5d34df43ad Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-DeleteServersTestJSON-1155268373-project Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 4d817bbd-8a92-45b4-8383-f72e422655d6 could not be found. Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '4d817bbd-8a92-45b4-8383-f72e422655d6'} Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d817bbd-8a92-45b4-8383-f72e422655d6 could not be found. Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:39:01.942332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:39:01.946360 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d817bbd-8a92-45b4-8383-f72e422655d6 could not be found. Sep 24 21:39:01.946360 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:39:01.946360 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:39:01.946360 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:39:01.946360 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:39:01.946360 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:39:01.946360 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:39:01.946360 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:39:01.946360 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:39:01.946360 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d817bbd-8a92-45b4-8383-f72e422655d6 could not be found. Sep 24 21:39:01.946360 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:39:01.946360 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3cb0b75f-f1af-4f8b-ad61-b4b3646fba18 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Returning 404 to user: Instance 4d817bbd-8a92-45b4-8383-f72e422655d6 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:39:01.946360 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3cb0b75f-f1af-4f8b-ad61-b4b3646fba18 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 404 len: 111 microversion: 2.1 time: 0.032483 Sep 24 21:39:01.946360 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3200/6378] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:39:01 2022] DELETE /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:39:01.952571 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5b1bdf1b-2c03-45c2-a416-9d5d49391102 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:01.953217 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5b1bdf1b-2c03-45c2-a416-9d5d49391102 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] [instance: 4d817bbd-8a92-45b4-8383-f72e422655d6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:01.959926 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b1bdf1b-2c03-45c2-a416-9d5d49391102 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:01.960416 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b1bdf1b-2c03-45c2-a416-9d5d49391102 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:01.960866 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b1bdf1b-2c03-45c2-a416-9d5d49391102 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:01.961570 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b1bdf1b-2c03-45c2-a416-9d5d49391102 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:01.962032 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b1bdf1b-2c03-45c2-a416-9d5d49391102 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:01.962468 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b1bdf1b-2c03-45c2-a416-9d5d49391102 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:01.975964 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-5b1bdf1b-2c03-45c2-a416-9d5d49391102 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] HTTP exception thrown: Instance 4d817bbd-8a92-45b4-8383-f72e422655d6 could not be found. Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5b1bdf1b-2c03-45c2-a416-9d5d49391102 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Request method failure captured: Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 HTTP/1.1 Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3jAaG4ZDK-t0qqfCA8I-qwhMic9i5DMtg17r-tb_OeatMFkFsS0OvWBTJJGk-BI4JMVSF-nrX5-as4lJgOoIb1I8gztCBvFD2CyM6a2NV5CzqrokQO1I-DqEOVCYfeeS3tTGhz-hkZPJOIZKk4_pK5bQyjE0lVmTPzT5RmzQ4Xbz7U Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: d1128ece39524084b4e4229ad0375bf4 Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-DeleteServersTestJSON-1155268373 Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1128ece39524084b4e4229ad0375bf4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d1128ece39524084b4e4229ad0375bf4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d1128ece39524084b4e4229ad0375bf4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1128ece39524084b4e4229ad0375bf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-DeleteServersTestJSON-1155268373 Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: d1128ece39524084b4e4229ad0375bf4 Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-DeleteServersTestJSON-1155268373 Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-DeleteServersTestJSON-1155268373-project Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 0bff3127ccc748e49e7d6d5d34df43ad Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-DeleteServersTestJSON-1155268373-project Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 4d817bbd-8a92-45b4-8383-f72e422655d6 could not be found. Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '4d817bbd-8a92-45b4-8383-f72e422655d6'} Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d817bbd-8a92-45b4-8383-f72e422655d6 could not be found. Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d817bbd-8a92-45b4-8383-f72e422655d6 could not be found. Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:39:01.977533 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:39:01.982465 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:39:01.982465 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:39:01.982465 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:39:01.982465 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:39:01.982465 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:39:01.982465 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d817bbd-8a92-45b4-8383-f72e422655d6 could not be found. Sep 24 21:39:01.982465 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:39:01.982465 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5b1bdf1b-2c03-45c2-a416-9d5d49391102 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] Returning 404 to user: Instance 4d817bbd-8a92-45b4-8383-f72e422655d6 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:39:01.982465 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5b1bdf1b-2c03-45c2-a416-9d5d49391102 tempest-DeleteServersTestJSON-1155268373 tempest-DeleteServersTestJSON-1155268373-project] 10.222.0.52 "GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6" status: 404 len: 111 microversion: 2.1 time: 0.030463 Sep 24 21:39:01.982465 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3179/6379] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:01 2022] GET /compute/v2.1/servers/4d817bbd-8a92-45b4-8383-f72e422655d6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:39:10.147118 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c89be1ce-3575-418b-9a97-bddcf587a045 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-332815646", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "b11e5102-13d2-49d2-9a34-d225f643b39e"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:39:10.206325 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-c89be1ce-3575-418b-9a97-bddcf587a045 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] validate_networks() for [('b11e5102-13d2-49d2-9a34-d225f643b39e', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:39:10.595398 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-c89be1ce-3575-418b-9a97-bddcf587a045 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:39:10.595835 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-c89be1ce-3575-418b-9a97-bddcf587a045 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:39:10.596328 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-c89be1ce-3575-418b-9a97-bddcf587a045 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:39:10.596753 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-c89be1ce-3575-418b-9a97-bddcf587a045 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:39:10.597182 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-c89be1ce-3575-418b-9a97-bddcf587a045 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:39:10.606123 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c89be1ce-3575-418b-9a97-bddcf587a045 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:10.606742 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c89be1ce-3575-418b-9a97-bddcf587a045 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:10.607104 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c89be1ce-3575-418b-9a97-bddcf587a045 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:10.607851 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c89be1ce-3575-418b-9a97-bddcf587a045 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:10.608318 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c89be1ce-3575-418b-9a97-bddcf587a045 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:10.608761 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c89be1ce-3575-418b-9a97-bddcf587a045 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:10.626790 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-c89be1ce-3575-418b-9a97-bddcf587a045 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Getting quotas for project 6a5a6205a2c74f07bda8d3bf7b5a5e6d. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:39:10.632209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-c89be1ce-3575-418b-9a97-bddcf587a045 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Getting quotas for user 45c51ff8103f42fa9d68a5492904b315 and project 6a5a6205a2c74f07bda8d3bf7b5a5e6d. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:39:10.645717 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c89be1ce-3575-418b-9a97-bddcf587a045 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:39:10.648077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c89be1ce-3575-418b-9a97-bddcf587a045 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:39:10.694625 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c89be1ce-3575-418b-9a97-bddcf587a045 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.674911 Sep 24 21:39:10.695311 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3201/6380] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:39:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:39:10.707320 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ea7105aa-0f7b-4e4c-bed5-b1697f5fb471 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:10.707945 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ea7105aa-0f7b-4e4c-bed5-b1697f5fb471 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:10.764158 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ea7105aa-0f7b-4e4c-bed5-b1697f5fb471 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:10.772561 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ea7105aa-0f7b-4e4c-bed5-b1697f5fb471 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1217 microversion: 2.1 time: 0.069104 Sep 24 21:39:10.773144 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3180/6381] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:10 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:11.795549 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3ea30452-516a-46cd-ab46-dee40c82792d tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:11.796173 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3ea30452-516a-46cd-ab46-dee40c82792d tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:11.820397 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ea30452-516a-46cd-ab46-dee40c82792d tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:11.822755 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ea30452-516a-46cd-ab46-dee40c82792d tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:11.823905 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ea30452-516a-46cd-ab46-dee40c82792d tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:11.825137 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ea30452-516a-46cd-ab46-dee40c82792d tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:11.825824 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ea30452-516a-46cd-ab46-dee40c82792d tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:11.827024 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ea30452-516a-46cd-ab46-dee40c82792d tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:12.280880 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3ea30452-516a-46cd-ab46-dee40c82792d tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:12.288690 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3ea30452-516a-46cd-ab46-dee40c82792d tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1277 microversion: 2.1 time: 0.497961 Sep 24 21:39:12.295292 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3202/6382] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:11 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1277 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:13.314152 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4178fed1-424e-4f59-9fd7-e44d737b4427 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:13.315412 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4178fed1-424e-4f59-9fd7-e44d737b4427 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:13.322081 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:39:13.323920 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4178fed1-424e-4f59-9fd7-e44d737b4427 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:13.324530 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4178fed1-424e-4f59-9fd7-e44d737b4427 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:13.324974 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4178fed1-424e-4f59-9fd7-e44d737b4427 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:13.326220 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4178fed1-424e-4f59-9fd7-e44d737b4427 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:13.326903 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4178fed1-424e-4f59-9fd7-e44d737b4427 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:13.327334 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4178fed1-424e-4f59-9fd7-e44d737b4427 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:13.652154 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4178fed1-424e-4f59-9fd7-e44d737b4427 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:13.666674 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4178fed1-424e-4f59-9fd7-e44d737b4427 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1317 microversion: 2.1 time: 0.356752 Sep 24 21:39:13.667286 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3181/6383] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:13 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1317 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:13.931912 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-ce277c3f-c84f-4ee4-b4ba-b23108a391bd req-2a5cff79-7d3b-417d-bdc3-a0101aec8c68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d0c40cc-05ef-4838-9111-3e659de26d69", "tag": "4c34b0b4-5069-49ca-8242-5b3a4fa715d0"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:39:13.946236 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-ce277c3f-c84f-4ee4-b4ba-b23108a391bd req-2a5cff79-7d3b-417d-bdc3-a0101aec8c68 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:13.946822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-ce277c3f-c84f-4ee4-b4ba-b23108a391bd req-2a5cff79-7d3b-417d-bdc3-a0101aec8c68 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:13.947268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-ce277c3f-c84f-4ee4-b4ba-b23108a391bd req-2a5cff79-7d3b-417d-bdc3-a0101aec8c68 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:13.959926 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-ce277c3f-c84f-4ee4-b4ba-b23108a391bd req-2a5cff79-7d3b-417d-bdc3-a0101aec8c68 service nova] Creating event network-changed:4c34b0b4-5069-49ca-8242-5b3a4fa715d0 for instance 7d0c40cc-05ef-4838-9111-3e659de26d69 on nch2-master-1 Sep 24 21:39:13.968760 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-ce277c3f-c84f-4ee4-b4ba-b23108a391bd req-2a5cff79-7d3b-417d-bdc3-a0101aec8c68 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040397 Sep 24 21:39:13.970396 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3203/6384] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:39:14.693504 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-594e0774-3398-48a5-90fe-32a88d42f23c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:14.694128 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-594e0774-3398-48a5-90fe-32a88d42f23c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:14.701886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-594e0774-3398-48a5-90fe-32a88d42f23c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:14.702381 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-594e0774-3398-48a5-90fe-32a88d42f23c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:14.702866 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-594e0774-3398-48a5-90fe-32a88d42f23c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:14.703574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-594e0774-3398-48a5-90fe-32a88d42f23c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:14.704039 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-594e0774-3398-48a5-90fe-32a88d42f23c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:14.704497 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-594e0774-3398-48a5-90fe-32a88d42f23c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:14.840230 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-594e0774-3398-48a5-90fe-32a88d42f23c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:14.849040 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-594e0774-3398-48a5-90fe-32a88d42f23c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1317 microversion: 2.1 time: 0.159593 Sep 24 21:39:14.849634 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3182/6385] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:14 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:15.872292 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-331ad3cc-c254-45ff-84ad-1ff1c50ca735 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:15.873499 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-331ad3cc-c254-45ff-84ad-1ff1c50ca735 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:15.880873 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-331ad3cc-c254-45ff-84ad-1ff1c50ca735 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:15.881300 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-331ad3cc-c254-45ff-84ad-1ff1c50ca735 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:15.881734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-331ad3cc-c254-45ff-84ad-1ff1c50ca735 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:15.882435 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-331ad3cc-c254-45ff-84ad-1ff1c50ca735 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:15.882916 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-331ad3cc-c254-45ff-84ad-1ff1c50ca735 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:15.883345 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-331ad3cc-c254-45ff-84ad-1ff1c50ca735 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:15.887287 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=60 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:39:16.015538 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-331ad3cc-c254-45ff-84ad-1ff1c50ca735 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:16.023268 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-331ad3cc-c254-45ff-84ad-1ff1c50ca735 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1317 microversion: 2.1 time: 0.155216 Sep 24 21:39:16.023846 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3204/6386] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:15 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:17.046743 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d03369d6-d931-43a4-8215-ace94a36a4c1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:17.047370 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d03369d6-d931-43a4-8215-ace94a36a4c1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:17.050318 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:39:17.056246 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d03369d6-d931-43a4-8215-ace94a36a4c1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:17.056746 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d03369d6-d931-43a4-8215-ace94a36a4c1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:17.057192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d03369d6-d931-43a4-8215-ace94a36a4c1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:17.057911 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d03369d6-d931-43a4-8215-ace94a36a4c1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:17.058383 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d03369d6-d931-43a4-8215-ace94a36a4c1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:17.058855 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d03369d6-d931-43a4-8215-ace94a36a4c1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:17.195014 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d03369d6-d931-43a4-8215-ace94a36a4c1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:17.203476 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d03369d6-d931-43a4-8215-ace94a36a4c1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1317 microversion: 2.1 time: 0.161029 Sep 24 21:39:17.204057 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3183/6387] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:17 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:18.227052 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6c799557-55f2-4462-b10c-587d1e38d7e2 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:18.227676 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6c799557-55f2-4462-b10c-587d1e38d7e2 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:18.230316 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:39:18.237736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c799557-55f2-4462-b10c-587d1e38d7e2 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:18.238261 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c799557-55f2-4462-b10c-587d1e38d7e2 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:18.238745 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c799557-55f2-4462-b10c-587d1e38d7e2 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:18.239460 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c799557-55f2-4462-b10c-587d1e38d7e2 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:18.239920 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c799557-55f2-4462-b10c-587d1e38d7e2 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:18.240380 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6c799557-55f2-4462-b10c-587d1e38d7e2 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:18.371377 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6c799557-55f2-4462-b10c-587d1e38d7e2 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:18.379233 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6c799557-55f2-4462-b10c-587d1e38d7e2 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1317 microversion: 2.1 time: 0.156162 Sep 24 21:39:18.379816 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3205/6388] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:18 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:18.750800 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-1d8d970f-88e7-4d79-9594-cb432a6a890f req-8b37321a-73e6-4b68-b698-1fcbee23a6ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d0c40cc-05ef-4838-9111-3e659de26d69", "name": "network-vif-plugged", "status": "completed", "tag": "4c34b0b4-5069-49ca-8242-5b3a4fa715d0"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:39:18.761788 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1d8d970f-88e7-4d79-9594-cb432a6a890f req-8b37321a-73e6-4b68-b698-1fcbee23a6ab service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:18.762300 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1d8d970f-88e7-4d79-9594-cb432a6a890f req-8b37321a-73e6-4b68-b698-1fcbee23a6ab service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:18.762809 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1d8d970f-88e7-4d79-9594-cb432a6a890f req-8b37321a-73e6-4b68-b698-1fcbee23a6ab service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:18.774727 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-1d8d970f-88e7-4d79-9594-cb432a6a890f req-8b37321a-73e6-4b68-b698-1fcbee23a6ab service nova] Creating event network-vif-plugged:4c34b0b4-5069-49ca-8242-5b3a4fa715d0 for instance 7d0c40cc-05ef-4838-9111-3e659de26d69 on nch2-master-1 Sep 24 21:39:18.780449 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-1d8d970f-88e7-4d79-9594-cb432a6a890f req-8b37321a-73e6-4b68-b698-1fcbee23a6ab service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032728 Sep 24 21:39:18.781215 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3184/6389] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:39:19.402597 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-670cfeeb-f784-4f2e-b429-c033f873c602 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:19.403834 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-670cfeeb-f784-4f2e-b429-c033f873c602 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:19.412062 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-670cfeeb-f784-4f2e-b429-c033f873c602 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:19.412577 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-670cfeeb-f784-4f2e-b429-c033f873c602 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:19.413034 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-670cfeeb-f784-4f2e-b429-c033f873c602 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:19.413718 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-670cfeeb-f784-4f2e-b429-c033f873c602 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:19.414172 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-670cfeeb-f784-4f2e-b429-c033f873c602 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:19.414629 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-670cfeeb-f784-4f2e-b429-c033f873c602 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:19.546241 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-670cfeeb-f784-4f2e-b429-c033f873c602 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:19.554253 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-670cfeeb-f784-4f2e-b429-c033f873c602 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1317 microversion: 2.1 time: 0.155635 Sep 24 21:39:19.554883 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3206/6390] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:19 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:20.579889 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d515b6cf-b3c4-409b-bb39-1488a89ac6c7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:20.580603 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d515b6cf-b3c4-409b-bb39-1488a89ac6c7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:20.586979 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d515b6cf-b3c4-409b-bb39-1488a89ac6c7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:20.587467 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d515b6cf-b3c4-409b-bb39-1488a89ac6c7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:20.587903 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d515b6cf-b3c4-409b-bb39-1488a89ac6c7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:20.588608 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d515b6cf-b3c4-409b-bb39-1488a89ac6c7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:20.589063 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d515b6cf-b3c4-409b-bb39-1488a89ac6c7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:20.589492 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d515b6cf-b3c4-409b-bb39-1488a89ac6c7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:20.732107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d515b6cf-b3c4-409b-bb39-1488a89ac6c7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:20.740173 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d515b6cf-b3c4-409b-bb39-1488a89ac6c7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1507 microversion: 2.1 time: 0.166323 Sep 24 21:39:20.740751 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3185/6391] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:20 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:20.761863 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1e5ff092-57a1-476a-946e-5f93d03a8e41 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:20.762490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1e5ff092-57a1-476a-946e-5f93d03a8e41 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:20.765767 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:39:20.766473 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=6 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:39:20.772105 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e5ff092-57a1-476a-946e-5f93d03a8e41 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:20.772599 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e5ff092-57a1-476a-946e-5f93d03a8e41 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:20.773047 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e5ff092-57a1-476a-946e-5f93d03a8e41 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:20.773757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e5ff092-57a1-476a-946e-5f93d03a8e41 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:20.774222 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e5ff092-57a1-476a-946e-5f93d03a8e41 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:20.774703 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e5ff092-57a1-476a-946e-5f93d03a8e41 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:20.914905 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1e5ff092-57a1-476a-946e-5f93d03a8e41 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:20.923162 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1e5ff092-57a1-476a-946e-5f93d03a8e41 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1507 microversion: 2.1 time: 0.164915 Sep 24 21:39:20.923744 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3207/6392] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:20 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:20.945241 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-20a049df-b653-4d21-9bbe-11e3fe4b850c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:39:20.947715 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-20a049df-b653-4d21-9bbe-11e3fe4b850c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:20.949784 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:39:20.956080 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-20a049df-b653-4d21-9bbe-11e3fe4b850c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:20.956574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-20a049df-b653-4d21-9bbe-11e3fe4b850c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:20.957025 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-20a049df-b653-4d21-9bbe-11e3fe4b850c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:20.957739 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-20a049df-b653-4d21-9bbe-11e3fe4b850c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:20.958204 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-20a049df-b653-4d21-9bbe-11e3fe4b850c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:20.958673 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-20a049df-b653-4d21-9bbe-11e3fe4b850c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:21.022138 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-20a049df-b653-4d21-9bbe-11e3fe4b850c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "PUT /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1079 microversion: 2.1 time: 0.080802 Sep 24 21:39:21.023527 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3186/6393] 10.222.0.52 () {60 vars in 1256 bytes} [Sat Sep 24 21:39:20 2022] PUT /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1079 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:21.041710 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-535f6b41-549e-4b74-a831-d53e64c3fe9b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:21.042333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-535f6b41-549e-4b74-a831-d53e64c3fe9b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:21.048816 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-535f6b41-549e-4b74-a831-d53e64c3fe9b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:21.049308 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-535f6b41-549e-4b74-a831-d53e64c3fe9b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:21.049753 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-535f6b41-549e-4b74-a831-d53e64c3fe9b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:21.050465 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-535f6b41-549e-4b74-a831-d53e64c3fe9b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:21.050949 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-535f6b41-549e-4b74-a831-d53e64c3fe9b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:21.051406 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-535f6b41-549e-4b74-a831-d53e64c3fe9b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:21.227055 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-535f6b41-549e-4b74-a831-d53e64c3fe9b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:21.236101 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-535f6b41-549e-4b74-a831-d53e64c3fe9b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1505 microversion: 2.1 time: 0.198240 Sep 24 21:39:21.236686 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3208/6394] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:21 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1505 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:21.258029 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-08ad6f9e-f98a-4515-8aec-8b666c6ff0f1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:21.258687 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-08ad6f9e-f98a-4515-8aec-8b666c6ff0f1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:21.264724 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-08ad6f9e-f98a-4515-8aec-8b666c6ff0f1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:21.265218 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-08ad6f9e-f98a-4515-8aec-8b666c6ff0f1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:21.265705 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-08ad6f9e-f98a-4515-8aec-8b666c6ff0f1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:21.266410 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-08ad6f9e-f98a-4515-8aec-8b666c6ff0f1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:21.266908 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-08ad6f9e-f98a-4515-8aec-8b666c6ff0f1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:21.267361 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-08ad6f9e-f98a-4515-8aec-8b666c6ff0f1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:21.473647 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-08ad6f9e-f98a-4515-8aec-8b666c6ff0f1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:21.483199 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-08ad6f9e-f98a-4515-8aec-8b666c6ff0f1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1505 microversion: 2.1 time: 0.229033 Sep 24 21:39:21.484182 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3187/6395] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:21 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1505 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:21.505136 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d61d2965-2d79-42db-89c3-5576930b8f87 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:39:21.507696 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d61d2965-2d79-42db-89c3-5576930b8f87 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:21.514415 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d61d2965-2d79-42db-89c3-5576930b8f87 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:21.515059 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d61d2965-2d79-42db-89c3-5576930b8f87 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:21.515509 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d61d2965-2d79-42db-89c3-5576930b8f87 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:21.516246 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d61d2965-2d79-42db-89c3-5576930b8f87 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:21.516707 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d61d2965-2d79-42db-89c3-5576930b8f87 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:21.517145 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d61d2965-2d79-42db-89c3-5576930b8f87 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:21.546530 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d61d2965-2d79-42db-89c3-5576930b8f87 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:21.552514 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d61d2965-2d79-42db-89c3-5576930b8f87 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Old instance type m1.heat2, new instance type m1.heat {{(pid=140517) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 24 21:39:21.559180 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-d61d2965-2d79-42db-89c3-5576930b8f87 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:39:21.559641 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-d61d2965-2d79-42db-89c3-5576930b8f87 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:39:21.560127 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-d61d2965-2d79-42db-89c3-5576930b8f87 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:39:21.560722 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-d61d2965-2d79-42db-89c3-5576930b8f87 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:39:21.561151 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-d61d2965-2d79-42db-89c3-5576930b8f87 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:39:21.633373 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d61d2965-2d79-42db-89c3-5576930b8f87 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "POST /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69/action" status: 202 len: 0 microversion: 2.1 time: 0.128148 Sep 24 21:39:21.633373 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3209/6396] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:39:21 2022] POST /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 21:39:21.640238 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4769f550-815f-45ec-9d02-88f23154717e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:21.641599 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4769f550-815f-45ec-9d02-88f23154717e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:21.649798 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4769f550-815f-45ec-9d02-88f23154717e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:21.650306 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4769f550-815f-45ec-9d02-88f23154717e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:21.650795 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4769f550-815f-45ec-9d02-88f23154717e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:21.651519 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4769f550-815f-45ec-9d02-88f23154717e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:21.651990 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4769f550-815f-45ec-9d02-88f23154717e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:21.652558 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4769f550-815f-45ec-9d02-88f23154717e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:21.851576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4769f550-815f-45ec-9d02-88f23154717e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:21.860896 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4769f550-815f-45ec-9d02-88f23154717e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1516 microversion: 2.1 time: 0.226023 Sep 24 21:39:21.861493 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3188/6397] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:21 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1516 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:22.884807 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cacfeca4-4793-4be7-a73d-01ff25140fa4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:22.885423 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cacfeca4-4793-4be7-a73d-01ff25140fa4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:22.892681 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cacfeca4-4793-4be7-a73d-01ff25140fa4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:22.893095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cacfeca4-4793-4be7-a73d-01ff25140fa4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:22.893534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cacfeca4-4793-4be7-a73d-01ff25140fa4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:22.894238 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cacfeca4-4793-4be7-a73d-01ff25140fa4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:22.894730 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cacfeca4-4793-4be7-a73d-01ff25140fa4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:22.895160 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cacfeca4-4793-4be7-a73d-01ff25140fa4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:23.101513 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cacfeca4-4793-4be7-a73d-01ff25140fa4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:23.110080 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cacfeca4-4793-4be7-a73d-01ff25140fa4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1516 microversion: 2.1 time: 0.230033 Sep 24 21:39:23.110717 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3210/6398] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:22 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1516 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:24.133744 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5f17e65c-96e7-48bf-8a87-696dee4bd71f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:24.134400 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5f17e65c-96e7-48bf-8a87-696dee4bd71f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:24.142009 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f17e65c-96e7-48bf-8a87-696dee4bd71f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:24.142516 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f17e65c-96e7-48bf-8a87-696dee4bd71f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:24.142977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f17e65c-96e7-48bf-8a87-696dee4bd71f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:24.143682 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f17e65c-96e7-48bf-8a87-696dee4bd71f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:24.144144 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f17e65c-96e7-48bf-8a87-696dee4bd71f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:24.144578 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f17e65c-96e7-48bf-8a87-696dee4bd71f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:24.276157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5f17e65c-96e7-48bf-8a87-696dee4bd71f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:24.284355 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5f17e65c-96e7-48bf-8a87-696dee4bd71f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1521 microversion: 2.1 time: 0.154635 Sep 24 21:39:24.284925 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3189/6399] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:24 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:25.307143 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4cab227a-5348-47c6-af3e-f0b12437d7e8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:25.307708 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4cab227a-5348-47c6-af3e-f0b12437d7e8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:25.314023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cab227a-5348-47c6-af3e-f0b12437d7e8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:25.314531 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cab227a-5348-47c6-af3e-f0b12437d7e8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:25.314983 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cab227a-5348-47c6-af3e-f0b12437d7e8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:25.315672 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cab227a-5348-47c6-af3e-f0b12437d7e8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:25.316139 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cab227a-5348-47c6-af3e-f0b12437d7e8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:25.316569 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4cab227a-5348-47c6-af3e-f0b12437d7e8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:25.451733 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4cab227a-5348-47c6-af3e-f0b12437d7e8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:25.459690 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4cab227a-5348-47c6-af3e-f0b12437d7e8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1521 microversion: 2.1 time: 0.156700 Sep 24 21:39:25.460296 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3211/6400] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:25 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:26.483548 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3c204df2-5e35-4dfe-8cff-fb02d81fa0a8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:26.484180 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3c204df2-5e35-4dfe-8cff-fb02d81fa0a8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:26.491144 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c204df2-5e35-4dfe-8cff-fb02d81fa0a8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:26.491638 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c204df2-5e35-4dfe-8cff-fb02d81fa0a8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:26.492081 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c204df2-5e35-4dfe-8cff-fb02d81fa0a8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:26.492786 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c204df2-5e35-4dfe-8cff-fb02d81fa0a8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:26.493245 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c204df2-5e35-4dfe-8cff-fb02d81fa0a8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:26.493676 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3c204df2-5e35-4dfe-8cff-fb02d81fa0a8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:26.624171 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3c204df2-5e35-4dfe-8cff-fb02d81fa0a8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:26.632327 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3c204df2-5e35-4dfe-8cff-fb02d81fa0a8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1521 microversion: 2.1 time: 0.153518 Sep 24 21:39:26.632910 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3190/6401] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:26 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:27.655583 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f703d50c-37c4-4972-a8e2-1beb7ecba810 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:27.656202 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f703d50c-37c4-4972-a8e2-1beb7ecba810 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:27.663093 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f703d50c-37c4-4972-a8e2-1beb7ecba810 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:27.663524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f703d50c-37c4-4972-a8e2-1beb7ecba810 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:27.663961 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f703d50c-37c4-4972-a8e2-1beb7ecba810 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:27.664655 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f703d50c-37c4-4972-a8e2-1beb7ecba810 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:27.665111 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f703d50c-37c4-4972-a8e2-1beb7ecba810 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:27.665538 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f703d50c-37c4-4972-a8e2-1beb7ecba810 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:27.802022 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f703d50c-37c4-4972-a8e2-1beb7ecba810 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:27.813876 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f703d50c-37c4-4972-a8e2-1beb7ecba810 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1521 microversion: 2.1 time: 0.162070 Sep 24 21:39:27.814963 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3212/6402] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:27 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:28.839891 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ff2a5994-528b-4548-a69d-f103bca810df tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:28.840514 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ff2a5994-528b-4548-a69d-f103bca810df tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:28.848346 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff2a5994-528b-4548-a69d-f103bca810df tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:28.848836 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff2a5994-528b-4548-a69d-f103bca810df tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:28.849280 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff2a5994-528b-4548-a69d-f103bca810df tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:28.849985 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff2a5994-528b-4548-a69d-f103bca810df tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:28.850446 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff2a5994-528b-4548-a69d-f103bca810df tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:28.850903 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff2a5994-528b-4548-a69d-f103bca810df tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:28.982810 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ff2a5994-528b-4548-a69d-f103bca810df tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:28.990664 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ff2a5994-528b-4548-a69d-f103bca810df tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1521 microversion: 2.1 time: 0.154748 Sep 24 21:39:28.991239 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3191/6403] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:28 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:30.014643 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d3661321-f727-46d5-ba71-cd5d3346dc39 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:30.015316 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d3661321-f727-46d5-ba71-cd5d3346dc39 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:30.022837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3661321-f727-46d5-ba71-cd5d3346dc39 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:30.023404 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3661321-f727-46d5-ba71-cd5d3346dc39 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:30.023913 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3661321-f727-46d5-ba71-cd5d3346dc39 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:30.024687 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3661321-f727-46d5-ba71-cd5d3346dc39 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:30.025250 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3661321-f727-46d5-ba71-cd5d3346dc39 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:30.025764 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d3661321-f727-46d5-ba71-cd5d3346dc39 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:30.168121 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d3661321-f727-46d5-ba71-cd5d3346dc39 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:30.177402 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d3661321-f727-46d5-ba71-cd5d3346dc39 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1521 microversion: 2.1 time: 0.165828 Sep 24 21:39:30.187819 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3213/6404] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:30 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:31.203913 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a6027cb7-cbcc-43a6-a41a-ca6e48fdea9e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:31.204539 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a6027cb7-cbcc-43a6-a41a-ca6e48fdea9e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:31.211669 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a6027cb7-cbcc-43a6-a41a-ca6e48fdea9e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:31.212153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a6027cb7-cbcc-43a6-a41a-ca6e48fdea9e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:31.212591 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a6027cb7-cbcc-43a6-a41a-ca6e48fdea9e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:31.213297 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a6027cb7-cbcc-43a6-a41a-ca6e48fdea9e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:31.213750 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a6027cb7-cbcc-43a6-a41a-ca6e48fdea9e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:31.214179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a6027cb7-cbcc-43a6-a41a-ca6e48fdea9e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:31.342805 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a6027cb7-cbcc-43a6-a41a-ca6e48fdea9e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:31.350634 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a6027cb7-cbcc-43a6-a41a-ca6e48fdea9e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1521 microversion: 2.1 time: 0.151200 Sep 24 21:39:31.351208 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3192/6405] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:31 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:32.373146 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ff7ee6c3-f56e-4fac-be58-1d6d7a1b414e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:32.374380 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ff7ee6c3-f56e-4fac-be58-1d6d7a1b414e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:32.381466 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff7ee6c3-f56e-4fac-be58-1d6d7a1b414e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:32.381954 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff7ee6c3-f56e-4fac-be58-1d6d7a1b414e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:32.382400 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff7ee6c3-f56e-4fac-be58-1d6d7a1b414e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:32.383121 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff7ee6c3-f56e-4fac-be58-1d6d7a1b414e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:32.383584 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff7ee6c3-f56e-4fac-be58-1d6d7a1b414e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:32.384015 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ff7ee6c3-f56e-4fac-be58-1d6d7a1b414e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:32.517837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ff7ee6c3-f56e-4fac-be58-1d6d7a1b414e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:32.525657 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ff7ee6c3-f56e-4fac-be58-1d6d7a1b414e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1521 microversion: 2.1 time: 0.156437 Sep 24 21:39:32.526237 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3214/6406] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:32 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:33.548842 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9296bf29-d79d-46b8-8647-2bc54009d8ad tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:33.549467 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9296bf29-d79d-46b8-8647-2bc54009d8ad tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:33.556430 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9296bf29-d79d-46b8-8647-2bc54009d8ad tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:33.557081 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9296bf29-d79d-46b8-8647-2bc54009d8ad tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:33.557363 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9296bf29-d79d-46b8-8647-2bc54009d8ad tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:33.558063 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9296bf29-d79d-46b8-8647-2bc54009d8ad tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:33.558541 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9296bf29-d79d-46b8-8647-2bc54009d8ad tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:33.558981 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9296bf29-d79d-46b8-8647-2bc54009d8ad tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:33.693332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9296bf29-d79d-46b8-8647-2bc54009d8ad tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:33.701184 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9296bf29-d79d-46b8-8647-2bc54009d8ad tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1521 microversion: 2.1 time: 0.156681 Sep 24 21:39:33.702269 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3193/6407] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:33 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:34.725027 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-67579799-0d2b-4640-96fa-27775802d06f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:34.725651 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-67579799-0d2b-4640-96fa-27775802d06f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:34.732621 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-67579799-0d2b-4640-96fa-27775802d06f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:34.733671 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-67579799-0d2b-4640-96fa-27775802d06f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:34.734180 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-67579799-0d2b-4640-96fa-27775802d06f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:34.734915 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-67579799-0d2b-4640-96fa-27775802d06f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:34.735382 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-67579799-0d2b-4640-96fa-27775802d06f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:34.735817 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-67579799-0d2b-4640-96fa-27775802d06f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:34.864852 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-67579799-0d2b-4640-96fa-27775802d06f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:34.872575 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-67579799-0d2b-4640-96fa-27775802d06f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1521 microversion: 2.1 time: 0.151585 Sep 24 21:39:34.873149 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3215/6408] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:34 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:35.895787 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ad23fdb2-8261-4744-a64a-aa4f94817ea1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:35.896328 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ad23fdb2-8261-4744-a64a-aa4f94817ea1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:35.903277 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad23fdb2-8261-4744-a64a-aa4f94817ea1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:35.903767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad23fdb2-8261-4744-a64a-aa4f94817ea1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:35.904214 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad23fdb2-8261-4744-a64a-aa4f94817ea1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:35.904982 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad23fdb2-8261-4744-a64a-aa4f94817ea1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:35.905424 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad23fdb2-8261-4744-a64a-aa4f94817ea1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:35.905860 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad23fdb2-8261-4744-a64a-aa4f94817ea1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:36.042068 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ad23fdb2-8261-4744-a64a-aa4f94817ea1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:36.051114 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ad23fdb2-8261-4744-a64a-aa4f94817ea1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1521 microversion: 2.1 time: 0.159307 Sep 24 21:39:36.051700 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3194/6409] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:35 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:37.073774 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ef739f10-dc09-461f-8656-b502f11043c8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:37.074398 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ef739f10-dc09-461f-8656-b502f11043c8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:37.081953 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef739f10-dc09-461f-8656-b502f11043c8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:37.082448 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef739f10-dc09-461f-8656-b502f11043c8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:37.082930 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef739f10-dc09-461f-8656-b502f11043c8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:37.083634 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef739f10-dc09-461f-8656-b502f11043c8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:37.084128 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef739f10-dc09-461f-8656-b502f11043c8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:37.084563 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef739f10-dc09-461f-8656-b502f11043c8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:37.212995 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ef739f10-dc09-461f-8656-b502f11043c8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:37.220785 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ef739f10-dc09-461f-8656-b502f11043c8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1521 microversion: 2.1 time: 0.150925 Sep 24 21:39:37.221396 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3216/6410] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:37 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:38.244401 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-557dd32a-6ef9-44c8-bb8b-6029874fd46b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:38.245022 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-557dd32a-6ef9-44c8-bb8b-6029874fd46b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:38.252521 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-557dd32a-6ef9-44c8-bb8b-6029874fd46b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:38.253034 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-557dd32a-6ef9-44c8-bb8b-6029874fd46b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:38.253481 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-557dd32a-6ef9-44c8-bb8b-6029874fd46b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:38.254182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-557dd32a-6ef9-44c8-bb8b-6029874fd46b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:38.254680 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-557dd32a-6ef9-44c8-bb8b-6029874fd46b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:38.255114 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-557dd32a-6ef9-44c8-bb8b-6029874fd46b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:38.386309 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-557dd32a-6ef9-44c8-bb8b-6029874fd46b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:38.394892 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-557dd32a-6ef9-44c8-bb8b-6029874fd46b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1521 microversion: 2.1 time: 0.154466 Sep 24 21:39:38.395476 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3195/6411] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:38 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:39.417232 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d042701a-65c4-48a6-be67-e429d126cf7b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:39.417856 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d042701a-65c4-48a6-be67-e429d126cf7b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:39.425338 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d042701a-65c4-48a6-be67-e429d126cf7b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:39.425821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d042701a-65c4-48a6-be67-e429d126cf7b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:39.426258 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d042701a-65c4-48a6-be67-e429d126cf7b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:39.426982 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d042701a-65c4-48a6-be67-e429d126cf7b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:39.427440 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d042701a-65c4-48a6-be67-e429d126cf7b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:39.427871 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d042701a-65c4-48a6-be67-e429d126cf7b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:39.564030 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d042701a-65c4-48a6-be67-e429d126cf7b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:39.571790 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d042701a-65c4-48a6-be67-e429d126cf7b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1521 microversion: 2.1 time: 0.158458 Sep 24 21:39:39.572355 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3217/6412] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:39 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:40.596549 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cbb0ea1f-b505-4721-a782-1e9bf4217b48 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:40.597209 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cbb0ea1f-b505-4721-a782-1e9bf4217b48 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:40.604154 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cbb0ea1f-b505-4721-a782-1e9bf4217b48 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:40.604653 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cbb0ea1f-b505-4721-a782-1e9bf4217b48 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:40.605098 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cbb0ea1f-b505-4721-a782-1e9bf4217b48 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:40.605808 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cbb0ea1f-b505-4721-a782-1e9bf4217b48 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:40.606270 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cbb0ea1f-b505-4721-a782-1e9bf4217b48 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:40.606749 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cbb0ea1f-b505-4721-a782-1e9bf4217b48 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:40.734663 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cbb0ea1f-b505-4721-a782-1e9bf4217b48 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:40.742469 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cbb0ea1f-b505-4721-a782-1e9bf4217b48 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1521 microversion: 2.1 time: 0.150454 Sep 24 21:39:40.743066 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3196/6413] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:40 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:41.765421 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-71167ad1-9a0f-4e40-8d57-5fb36b9615bb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:41.766266 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-71167ad1-9a0f-4e40-8d57-5fb36b9615bb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:41.773323 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71167ad1-9a0f-4e40-8d57-5fb36b9615bb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:41.773808 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71167ad1-9a0f-4e40-8d57-5fb36b9615bb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:41.774326 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71167ad1-9a0f-4e40-8d57-5fb36b9615bb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:41.775046 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71167ad1-9a0f-4e40-8d57-5fb36b9615bb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:41.775502 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71167ad1-9a0f-4e40-8d57-5fb36b9615bb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:41.775929 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71167ad1-9a0f-4e40-8d57-5fb36b9615bb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:41.909582 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-71167ad1-9a0f-4e40-8d57-5fb36b9615bb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:41.917319 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-71167ad1-9a0f-4e40-8d57-5fb36b9615bb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1521 microversion: 2.1 time: 0.155992 Sep 24 21:39:41.917886 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3218/6414] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:41 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:42.941834 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-77c4751a-94f3-4c28-8f9f-d97cec9f02d4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:42.942363 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-77c4751a-94f3-4c28-8f9f-d97cec9f02d4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:42.949374 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-77c4751a-94f3-4c28-8f9f-d97cec9f02d4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:42.949859 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-77c4751a-94f3-4c28-8f9f-d97cec9f02d4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:42.950301 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-77c4751a-94f3-4c28-8f9f-d97cec9f02d4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:42.951025 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-77c4751a-94f3-4c28-8f9f-d97cec9f02d4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:42.951483 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-77c4751a-94f3-4c28-8f9f-d97cec9f02d4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:42.951910 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-77c4751a-94f3-4c28-8f9f-d97cec9f02d4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:42.971065 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:39:43.084565 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-77c4751a-94f3-4c28-8f9f-d97cec9f02d4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:43.092506 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-77c4751a-94f3-4c28-8f9f-d97cec9f02d4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1521 microversion: 2.1 time: 0.154832 Sep 24 21:39:43.093704 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3197/6415] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:42 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:44.116100 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-445a3a75-c83f-4366-ba15-e9b42b3cb956 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:44.116724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-445a3a75-c83f-4366-ba15-e9b42b3cb956 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:44.123725 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-445a3a75-c83f-4366-ba15-e9b42b3cb956 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:44.124215 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-445a3a75-c83f-4366-ba15-e9b42b3cb956 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:44.124662 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-445a3a75-c83f-4366-ba15-e9b42b3cb956 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:44.125361 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-445a3a75-c83f-4366-ba15-e9b42b3cb956 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:44.125819 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-445a3a75-c83f-4366-ba15-e9b42b3cb956 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:44.126254 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-445a3a75-c83f-4366-ba15-e9b42b3cb956 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:44.141316 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:39:44.259491 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-445a3a75-c83f-4366-ba15-e9b42b3cb956 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:44.267778 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-445a3a75-c83f-4366-ba15-e9b42b3cb956 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1521 microversion: 2.1 time: 0.155592 Sep 24 21:39:44.268354 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3219/6416] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:44 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:45.291099 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b9a27cba-6ed9-4e6b-8841-b241bd5a5a97 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:45.291629 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b9a27cba-6ed9-4e6b-8841-b241bd5a5a97 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:45.299764 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b9a27cba-6ed9-4e6b-8841-b241bd5a5a97 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:45.300257 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b9a27cba-6ed9-4e6b-8841-b241bd5a5a97 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:45.300702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b9a27cba-6ed9-4e6b-8841-b241bd5a5a97 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:45.301410 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b9a27cba-6ed9-4e6b-8841-b241bd5a5a97 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:45.301872 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b9a27cba-6ed9-4e6b-8841-b241bd5a5a97 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:45.302307 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b9a27cba-6ed9-4e6b-8841-b241bd5a5a97 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:45.430686 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b9a27cba-6ed9-4e6b-8841-b241bd5a5a97 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:45.438576 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b9a27cba-6ed9-4e6b-8841-b241bd5a5a97 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1521 microversion: 2.1 time: 0.151696 Sep 24 21:39:45.439163 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3198/6417] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:45 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:46.461991 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-00459ddd-42ca-49f0-aa55-6d1edeaec0d8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:46.462642 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-00459ddd-42ca-49f0-aa55-6d1edeaec0d8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:46.471416 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00459ddd-42ca-49f0-aa55-6d1edeaec0d8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:46.471908 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00459ddd-42ca-49f0-aa55-6d1edeaec0d8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:46.472349 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00459ddd-42ca-49f0-aa55-6d1edeaec0d8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:46.473085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00459ddd-42ca-49f0-aa55-6d1edeaec0d8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:46.473545 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00459ddd-42ca-49f0-aa55-6d1edeaec0d8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:46.473969 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-00459ddd-42ca-49f0-aa55-6d1edeaec0d8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:46.604783 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-00459ddd-42ca-49f0-aa55-6d1edeaec0d8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:46.612789 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-00459ddd-42ca-49f0-aa55-6d1edeaec0d8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1521 microversion: 2.1 time: 0.154728 Sep 24 21:39:46.613375 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3220/6418] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:46 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:47.636451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3fd5d3d6-a656-431d-a14d-0a5a5b4eaf85 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:47.637082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3fd5d3d6-a656-431d-a14d-0a5a5b4eaf85 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:47.640461 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=32 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:39:47.646173 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3fd5d3d6-a656-431d-a14d-0a5a5b4eaf85 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:47.646701 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3fd5d3d6-a656-431d-a14d-0a5a5b4eaf85 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:47.647156 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3fd5d3d6-a656-431d-a14d-0a5a5b4eaf85 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:47.647867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3fd5d3d6-a656-431d-a14d-0a5a5b4eaf85 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:47.648335 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3fd5d3d6-a656-431d-a14d-0a5a5b4eaf85 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:47.648802 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3fd5d3d6-a656-431d-a14d-0a5a5b4eaf85 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:47.782653 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3fd5d3d6-a656-431d-a14d-0a5a5b4eaf85 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:47.790609 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3fd5d3d6-a656-431d-a14d-0a5a5b4eaf85 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1521 microversion: 2.1 time: 0.158120 Sep 24 21:39:47.791187 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3199/6419] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:47 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:48.814090 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f3e14572-214c-46fd-a4d6-f7d8c8514df1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:48.814668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f3e14572-214c-46fd-a4d6-f7d8c8514df1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:48.817314 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=36 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:39:48.822744 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3e14572-214c-46fd-a4d6-f7d8c8514df1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:48.823359 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3e14572-214c-46fd-a4d6-f7d8c8514df1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:48.823732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3e14572-214c-46fd-a4d6-f7d8c8514df1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:48.828461 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3e14572-214c-46fd-a4d6-f7d8c8514df1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:48.828939 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3e14572-214c-46fd-a4d6-f7d8c8514df1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:48.829383 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f3e14572-214c-46fd-a4d6-f7d8c8514df1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:49.240731 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f3e14572-214c-46fd-a4d6-f7d8c8514df1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:49.248530 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f3e14572-214c-46fd-a4d6-f7d8c8514df1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1521 microversion: 2.1 time: 0.438394 Sep 24 21:39:49.249113 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3221/6420] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:48 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1521 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:39:50.272167 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3238baa7-a052-4fa6-81b5-4e9ae87bf740 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:50.272779 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3238baa7-a052-4fa6-81b5-4e9ae87bf740 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:50.279628 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3238baa7-a052-4fa6-81b5-4e9ae87bf740 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:50.280125 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3238baa7-a052-4fa6-81b5-4e9ae87bf740 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:50.281083 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3238baa7-a052-4fa6-81b5-4e9ae87bf740 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:50.281792 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3238baa7-a052-4fa6-81b5-4e9ae87bf740 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:50.282261 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3238baa7-a052-4fa6-81b5-4e9ae87bf740 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:50.282728 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3238baa7-a052-4fa6-81b5-4e9ae87bf740 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:50.418865 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3238baa7-a052-4fa6-81b5-4e9ae87bf740 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:50.427678 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3238baa7-a052-4fa6-81b5-4e9ae87bf740 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1521 microversion: 2.1 time: 0.159520 Sep 24 21:39:50.428272 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3200/6421] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:50 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:51.450820 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-55ab9351-348f-4622-bfad-1d08c72e233d tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:51.451430 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-55ab9351-348f-4622-bfad-1d08c72e233d tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:51.458327 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-55ab9351-348f-4622-bfad-1d08c72e233d tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:51.458859 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-55ab9351-348f-4622-bfad-1d08c72e233d tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:51.459310 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-55ab9351-348f-4622-bfad-1d08c72e233d tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:51.460016 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-55ab9351-348f-4622-bfad-1d08c72e233d tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:51.460481 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-55ab9351-348f-4622-bfad-1d08c72e233d tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:51.460915 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-55ab9351-348f-4622-bfad-1d08c72e233d tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:51.589274 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-55ab9351-348f-4622-bfad-1d08c72e233d tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:51.597307 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-55ab9351-348f-4622-bfad-1d08c72e233d tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1521 microversion: 2.1 time: 0.150458 Sep 24 21:39:51.597876 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3222/6422] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:51 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:52.621352 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e5c162e2-ea64-4e41-810b-3482aebb8a9d tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:52.621970 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e5c162e2-ea64-4e41-810b-3482aebb8a9d tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:52.630477 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e5c162e2-ea64-4e41-810b-3482aebb8a9d tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:52.631000 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e5c162e2-ea64-4e41-810b-3482aebb8a9d tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:52.631449 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e5c162e2-ea64-4e41-810b-3482aebb8a9d tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:52.632164 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e5c162e2-ea64-4e41-810b-3482aebb8a9d tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:52.632627 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e5c162e2-ea64-4e41-810b-3482aebb8a9d tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:52.633071 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e5c162e2-ea64-4e41-810b-3482aebb8a9d tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:52.767526 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e5c162e2-ea64-4e41-810b-3482aebb8a9d tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:52.775336 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e5c162e2-ea64-4e41-810b-3482aebb8a9d tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1521 microversion: 2.1 time: 0.158008 Sep 24 21:39:52.775919 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3201/6423] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:52 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:53.799650 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bf33af7f-8184-4ff5-9285-effb02e0d3bd tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:53.800268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bf33af7f-8184-4ff5-9285-effb02e0d3bd tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:53.807372 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf33af7f-8184-4ff5-9285-effb02e0d3bd tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:53.809182 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf33af7f-8184-4ff5-9285-effb02e0d3bd tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:53.809648 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf33af7f-8184-4ff5-9285-effb02e0d3bd tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:53.810359 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf33af7f-8184-4ff5-9285-effb02e0d3bd tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:53.810847 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf33af7f-8184-4ff5-9285-effb02e0d3bd tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:53.811282 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bf33af7f-8184-4ff5-9285-effb02e0d3bd tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:53.943282 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bf33af7f-8184-4ff5-9285-effb02e0d3bd tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:53.951075 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bf33af7f-8184-4ff5-9285-effb02e0d3bd tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1521 microversion: 2.1 time: 0.156400 Sep 24 21:39:53.951640 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3223/6424] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:53 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:54.975544 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fc0420f8-4105-451d-ab58-cf87b5a259bb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:54.976081 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fc0420f8-4105-451d-ab58-cf87b5a259bb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:54.982465 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fc0420f8-4105-451d-ab58-cf87b5a259bb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:54.982977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fc0420f8-4105-451d-ab58-cf87b5a259bb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:54.984060 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fc0420f8-4105-451d-ab58-cf87b5a259bb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:54.985057 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fc0420f8-4105-451d-ab58-cf87b5a259bb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:54.985498 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fc0420f8-4105-451d-ab58-cf87b5a259bb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:54.985930 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fc0420f8-4105-451d-ab58-cf87b5a259bb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:55.115704 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fc0420f8-4105-451d-ab58-cf87b5a259bb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:55.123672 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fc0420f8-4105-451d-ab58-cf87b5a259bb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1521 microversion: 2.1 time: 0.152528 Sep 24 21:39:55.124468 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3202/6425] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:54 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:56.146686 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-78ab9b02-e0c2-4cca-97ca-d2276812a118 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:56.147249 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-78ab9b02-e0c2-4cca-97ca-d2276812a118 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:56.154356 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78ab9b02-e0c2-4cca-97ca-d2276812a118 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:56.154881 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78ab9b02-e0c2-4cca-97ca-d2276812a118 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:56.155511 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78ab9b02-e0c2-4cca-97ca-d2276812a118 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:56.156414 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78ab9b02-e0c2-4cca-97ca-d2276812a118 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:56.156879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78ab9b02-e0c2-4cca-97ca-d2276812a118 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:56.157432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-78ab9b02-e0c2-4cca-97ca-d2276812a118 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:56.354396 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-78ab9b02-e0c2-4cca-97ca-d2276812a118 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:56.364476 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-78ab9b02-e0c2-4cca-97ca-d2276812a118 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1520 microversion: 2.1 time: 0.221515 Sep 24 21:39:56.378522 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3224/6426] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:56 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:56.583885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-4c090928-4d7d-4764-bd99-f7f2fad7ca23 req-01dce8ae-1441-4eb7-a777-9245b79b4dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d0c40cc-05ef-4838-9111-3e659de26d69", "name": "network-vif-unplugged", "status": "completed", "tag": "4c34b0b4-5069-49ca-8242-5b3a4fa715d0"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:39:56.595638 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-4c090928-4d7d-4764-bd99-f7f2fad7ca23 req-01dce8ae-1441-4eb7-a777-9245b79b4dd9 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:56.596125 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-4c090928-4d7d-4764-bd99-f7f2fad7ca23 req-01dce8ae-1441-4eb7-a777-9245b79b4dd9 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:56.596559 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-4c090928-4d7d-4764-bd99-f7f2fad7ca23 req-01dce8ae-1441-4eb7-a777-9245b79b4dd9 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:56.609255 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-4c090928-4d7d-4764-bd99-f7f2fad7ca23 req-01dce8ae-1441-4eb7-a777-9245b79b4dd9 service nova] Creating event network-vif-unplugged:4c34b0b4-5069-49ca-8242-5b3a4fa715d0 for instance 7d0c40cc-05ef-4838-9111-3e659de26d69 on nch1-master-1 Sep 24 21:39:56.614921 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [req-4c090928-4d7d-4764-bd99-f7f2fad7ca23 req-01dce8ae-1441-4eb7-a777-9245b79b4dd9 service nova] Instance 7d0c40cc-05ef-4838-9111-3e659de26d69 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 21:39:56.626206 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-4c090928-4d7d-4764-bd99-f7f2fad7ca23 req-01dce8ae-1441-4eb7-a777-9245b79b4dd9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046177 Sep 24 21:39:56.626858 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3203/6427] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:39:57.389474 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8ea6e2b1-0f66-4674-bad4-766d1ec116d7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:57.390145 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8ea6e2b1-0f66-4674-bad4-766d1ec116d7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:57.397346 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8ea6e2b1-0f66-4674-bad4-766d1ec116d7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:57.397847 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8ea6e2b1-0f66-4674-bad4-766d1ec116d7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:57.398298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8ea6e2b1-0f66-4674-bad4-766d1ec116d7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:57.399056 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8ea6e2b1-0f66-4674-bad4-766d1ec116d7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:57.399532 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8ea6e2b1-0f66-4674-bad4-766d1ec116d7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:57.399970 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8ea6e2b1-0f66-4674-bad4-766d1ec116d7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:57.795787 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8ea6e2b1-0f66-4674-bad4-766d1ec116d7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:57.804793 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8ea6e2b1-0f66-4674-bad4-766d1ec116d7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1520 microversion: 2.1 time: 0.419338 Sep 24 21:39:57.805361 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3225/6428] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:57 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1520 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:39:58.645204 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-c7637afb-b94f-43f3-acc7-e99faf774ca5 req-1751ce12-9b2f-4175-ae3b-dd57995138cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d0c40cc-05ef-4838-9111-3e659de26d69", "tag": "4c34b0b4-5069-49ca-8242-5b3a4fa715d0"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:39:58.654797 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c7637afb-b94f-43f3-acc7-e99faf774ca5 req-1751ce12-9b2f-4175-ae3b-dd57995138cb service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:58.655279 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c7637afb-b94f-43f3-acc7-e99faf774ca5 req-1751ce12-9b2f-4175-ae3b-dd57995138cb service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:58.655715 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c7637afb-b94f-43f3-acc7-e99faf774ca5 req-1751ce12-9b2f-4175-ae3b-dd57995138cb service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:58.667228 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-c7637afb-b94f-43f3-acc7-e99faf774ca5 req-1751ce12-9b2f-4175-ae3b-dd57995138cb service nova] Creating event network-changed:4c34b0b4-5069-49ca-8242-5b3a4fa715d0 for instance 7d0c40cc-05ef-4838-9111-3e659de26d69 on nch1-master-1 Sep 24 21:39:58.672571 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [req-c7637afb-b94f-43f3-acc7-e99faf774ca5 req-1751ce12-9b2f-4175-ae3b-dd57995138cb service nova] Instance 7d0c40cc-05ef-4838-9111-3e659de26d69 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 21:39:58.683476 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-c7637afb-b94f-43f3-acc7-e99faf774ca5 req-1751ce12-9b2f-4175-ae3b-dd57995138cb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044032 Sep 24 21:39:58.684067 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3204/6429] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:39:58.828445 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-65335f4e-2dad-41d2-ab78-566b40ef61b7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:39:58.829003 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-65335f4e-2dad-41d2-ab78-566b40ef61b7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:39:58.836282 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65335f4e-2dad-41d2-ab78-566b40ef61b7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:58.836809 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65335f4e-2dad-41d2-ab78-566b40ef61b7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:58.837254 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65335f4e-2dad-41d2-ab78-566b40ef61b7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:58.837965 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65335f4e-2dad-41d2-ab78-566b40ef61b7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:39:58.838428 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65335f4e-2dad-41d2-ab78-566b40ef61b7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:39:58.838885 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65335f4e-2dad-41d2-ab78-566b40ef61b7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:39:59.044652 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-65335f4e-2dad-41d2-ab78-566b40ef61b7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:39:59.053282 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-65335f4e-2dad-41d2-ab78-566b40ef61b7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1518 microversion: 2.1 time: 0.229013 Sep 24 21:39:59.054126 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3226/6430] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:39:58 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1518 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:00.078814 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8a6dd701-a47b-481b-a5ea-0420dd7dd633 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:00.079444 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8a6dd701-a47b-481b-a5ea-0420dd7dd633 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:00.085725 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8a6dd701-a47b-481b-a5ea-0420dd7dd633 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:00.086221 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8a6dd701-a47b-481b-a5ea-0420dd7dd633 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:00.086700 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8a6dd701-a47b-481b-a5ea-0420dd7dd633 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:00.087416 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8a6dd701-a47b-481b-a5ea-0420dd7dd633 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:00.087882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8a6dd701-a47b-481b-a5ea-0420dd7dd633 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:00.088317 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8a6dd701-a47b-481b-a5ea-0420dd7dd633 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:00.219634 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8a6dd701-a47b-481b-a5ea-0420dd7dd633 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:00.227524 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8a6dd701-a47b-481b-a5ea-0420dd7dd633 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1518 microversion: 2.1 time: 0.154807 Sep 24 21:40:00.228130 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3205/6431] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:00 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:01.251050 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-69f589cf-b921-466b-adbc-90ee61063757 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:01.251625 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-69f589cf-b921-466b-adbc-90ee61063757 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:01.258436 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69f589cf-b921-466b-adbc-90ee61063757 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:01.258963 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69f589cf-b921-466b-adbc-90ee61063757 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:01.259411 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69f589cf-b921-466b-adbc-90ee61063757 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:01.260115 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69f589cf-b921-466b-adbc-90ee61063757 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:01.260574 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69f589cf-b921-466b-adbc-90ee61063757 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:01.261005 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69f589cf-b921-466b-adbc-90ee61063757 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:01.391646 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-69f589cf-b921-466b-adbc-90ee61063757 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:01.399381 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-69f589cf-b921-466b-adbc-90ee61063757 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1515 microversion: 2.1 time: 0.152652 Sep 24 21:40:01.399957 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3227/6432] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:01 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:01.422626 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-383ec7b8-3be9-452a-97d2-516d29b24241 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:40:01.423402 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-383ec7b8-3be9-452a-97d2-516d29b24241 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:01.430628 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-383ec7b8-3be9-452a-97d2-516d29b24241 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:01.431114 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-383ec7b8-3be9-452a-97d2-516d29b24241 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:01.431553 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-383ec7b8-3be9-452a-97d2-516d29b24241 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:01.432249 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-383ec7b8-3be9-452a-97d2-516d29b24241 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:01.432729 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-383ec7b8-3be9-452a-97d2-516d29b24241 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:01.433194 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-383ec7b8-3be9-452a-97d2-516d29b24241 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:01.491667 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-383ec7b8-3be9-452a-97d2-516d29b24241 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "POST /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69/action" status: 204 len: 0 microversion: 2.1 time: 0.073298 Sep 24 21:40:01.492339 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3206/6433] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:40:01 2022] POST /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:40:01.504660 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-61a8f520-870d-4045-9228-9d2bbdca9de1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:01.505198 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-61a8f520-870d-4045-9228-9d2bbdca9de1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:01.511716 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-61a8f520-870d-4045-9228-9d2bbdca9de1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:01.512866 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-61a8f520-870d-4045-9228-9d2bbdca9de1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:01.513325 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-61a8f520-870d-4045-9228-9d2bbdca9de1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:01.514413 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-61a8f520-870d-4045-9228-9d2bbdca9de1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:01.515600 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-61a8f520-870d-4045-9228-9d2bbdca9de1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:01.516034 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-61a8f520-870d-4045-9228-9d2bbdca9de1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:01.728476 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-61a8f520-870d-4045-9228-9d2bbdca9de1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:01.736589 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-61a8f520-870d-4045-9228-9d2bbdca9de1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1515 microversion: 2.1 time: 0.236109 Sep 24 21:40:01.737185 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3228/6434] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:01 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1515 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:02.761844 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e343efc7-fb5e-438f-b7a5-dbd60c712f03 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:02.762570 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e343efc7-fb5e-438f-b7a5-dbd60c712f03 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:02.770053 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e343efc7-fb5e-438f-b7a5-dbd60c712f03 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:02.770579 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e343efc7-fb5e-438f-b7a5-dbd60c712f03 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:02.771020 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e343efc7-fb5e-438f-b7a5-dbd60c712f03 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:02.771957 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e343efc7-fb5e-438f-b7a5-dbd60c712f03 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:02.772417 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e343efc7-fb5e-438f-b7a5-dbd60c712f03 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:02.772845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e343efc7-fb5e-438f-b7a5-dbd60c712f03 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:02.918358 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e343efc7-fb5e-438f-b7a5-dbd60c712f03 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:02.927766 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e343efc7-fb5e-438f-b7a5-dbd60c712f03 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1507 microversion: 2.1 time: 0.171085 Sep 24 21:40:02.928373 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3207/6435] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:02 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1507 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:02.950835 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-250eb519-4aa5-486b-bf81-2a6e8013099c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:02.951779 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-250eb519-4aa5-486b-bf81-2a6e8013099c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:02.959239 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-250eb519-4aa5-486b-bf81-2a6e8013099c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:02.959734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-250eb519-4aa5-486b-bf81-2a6e8013099c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:02.960182 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-250eb519-4aa5-486b-bf81-2a6e8013099c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:02.960897 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-250eb519-4aa5-486b-bf81-2a6e8013099c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:02.961360 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-250eb519-4aa5-486b-bf81-2a6e8013099c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:02.961789 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-250eb519-4aa5-486b-bf81-2a6e8013099c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:03.091157 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-250eb519-4aa5-486b-bf81-2a6e8013099c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:03.098985 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-250eb519-4aa5-486b-bf81-2a6e8013099c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1507 microversion: 2.1 time: 0.152143 Sep 24 21:40:03.099558 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3229/6436] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:02 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:03.124520 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-35bfe29d-e957-41e6-849c-577caa20fa07 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Action: 'create', calling method: .version_select at 0x7f4b078b31f0>, body: {"keypair": {"name": "tempest-keypair-429737360", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFJ7rFEjYIyZ78yGTa/UWih5Qge1SPxtx2RMyOx4RARmRXIUqVPmM5bW2dEuSyl1rle7QH6ZanBxCa/+HEaIk00nb9ACKIfURyZ97TssfuTZXE/d95bY+dRqoafXn+sww=="}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:40:03.140461 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-35bfe29d-e957-41e6-849c-577caa20fa07 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Getting quotas for project 6a5a6205a2c74f07bda8d3bf7b5a5e6d. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:40:03.145509 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-35bfe29d-e957-41e6-849c-577caa20fa07 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Getting quotas for user 45c51ff8103f42fa9d68a5492904b315 and project 6a5a6205a2c74f07bda8d3bf7b5a5e6d. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:40:03.172949 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-35bfe29d-e957-41e6-849c-577caa20fa07 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052922 Sep 24 21:40:03.174105 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3208/6437] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 21:40:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:40:03.995009 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-62eff2b6-1370-4df3-8a03-56759946cd88 req-d04a680d-ca8e-4a03-9f57-63a7ee53aed5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d0c40cc-05ef-4838-9111-3e659de26d69", "name": "network-vif-plugged", "status": "completed", "tag": "4c34b0b4-5069-49ca-8242-5b3a4fa715d0"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:40:04.006719 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-62eff2b6-1370-4df3-8a03-56759946cd88 req-d04a680d-ca8e-4a03-9f57-63a7ee53aed5 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:04.007734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-62eff2b6-1370-4df3-8a03-56759946cd88 req-d04a680d-ca8e-4a03-9f57-63a7ee53aed5 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:04.008432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-62eff2b6-1370-4df3-8a03-56759946cd88 req-d04a680d-ca8e-4a03-9f57-63a7ee53aed5 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:04.025426 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-62eff2b6-1370-4df3-8a03-56759946cd88 req-d04a680d-ca8e-4a03-9f57-63a7ee53aed5 service nova] Creating event network-vif-plugged:4c34b0b4-5069-49ca-8242-5b3a4fa715d0 for instance 7d0c40cc-05ef-4838-9111-3e659de26d69 on nch1-master-1 Sep 24 21:40:04.031731 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-62eff2b6-1370-4df3-8a03-56759946cd88 req-d04a680d-ca8e-4a03-9f57-63a7ee53aed5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040597 Sep 24 21:40:04.032913 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3230/6438] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:40:04.388381 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3666e90e-132a-4d9f-a541-ef1672e49974 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:04.389011 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3666e90e-132a-4d9f-a541-ef1672e49974 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:04.396675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3666e90e-132a-4d9f-a541-ef1672e49974 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:04.397173 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3666e90e-132a-4d9f-a541-ef1672e49974 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:04.397623 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3666e90e-132a-4d9f-a541-ef1672e49974 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:04.398341 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3666e90e-132a-4d9f-a541-ef1672e49974 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:04.398847 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3666e90e-132a-4d9f-a541-ef1672e49974 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:04.399288 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3666e90e-132a-4d9f-a541-ef1672e49974 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:04.530035 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3666e90e-132a-4d9f-a541-ef1672e49974 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:04.538520 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3666e90e-132a-4d9f-a541-ef1672e49974 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 200 len: 1507 microversion: 2.1 time: 0.155015 Sep 24 21:40:04.539077 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3209/6439] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:04 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:04.561189 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4412f442-dcba-472b-84dd-4af75a80fb5b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:04.562460 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4412f442-dcba-472b-84dd-4af75a80fb5b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:04.568724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4412f442-dcba-472b-84dd-4af75a80fb5b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:04.569210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4412f442-dcba-472b-84dd-4af75a80fb5b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:04.569655 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4412f442-dcba-472b-84dd-4af75a80fb5b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:04.570357 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4412f442-dcba-472b-84dd-4af75a80fb5b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:04.570846 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4412f442-dcba-472b-84dd-4af75a80fb5b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:04.571279 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4412f442-dcba-472b-84dd-4af75a80fb5b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:04.596665 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4412f442-dcba-472b-84dd-4af75a80fb5b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:40:04.672414 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4412f442-dcba-472b-84dd-4af75a80fb5b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 204 len: 0 microversion: 2.1 time: 0.115130 Sep 24 21:40:04.673027 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3231/6440] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:40:04 2022] DELETE /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:40:04.734798 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b93c4263-c98e-4777-8c3b-c5a3f5092b53 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-746597081", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "b11e5102-13d2-49d2-9a34-d225f643b39e"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:40:04.789456 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-b93c4263-c98e-4777-8c3b-c5a3f5092b53 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] validate_networks() for [('b11e5102-13d2-49d2-9a34-d225f643b39e', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:40:05.158566 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-b93c4263-c98e-4777-8c3b-c5a3f5092b53 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:40:05.159000 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-b93c4263-c98e-4777-8c3b-c5a3f5092b53 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:40:05.159484 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-b93c4263-c98e-4777-8c3b-c5a3f5092b53 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:40:05.159902 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-b93c4263-c98e-4777-8c3b-c5a3f5092b53 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:40:05.160350 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-b93c4263-c98e-4777-8c3b-c5a3f5092b53 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:40:05.169373 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b93c4263-c98e-4777-8c3b-c5a3f5092b53 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:05.169860 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b93c4263-c98e-4777-8c3b-c5a3f5092b53 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:05.170307 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b93c4263-c98e-4777-8c3b-c5a3f5092b53 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:05.171949 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b93c4263-c98e-4777-8c3b-c5a3f5092b53 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:05.172422 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b93c4263-c98e-4777-8c3b-c5a3f5092b53 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:05.172859 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b93c4263-c98e-4777-8c3b-c5a3f5092b53 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:05.193518 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-b93c4263-c98e-4777-8c3b-c5a3f5092b53 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Getting quotas for project 6a5a6205a2c74f07bda8d3bf7b5a5e6d. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:40:05.198873 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-b93c4263-c98e-4777-8c3b-c5a3f5092b53 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Getting quotas for user 45c51ff8103f42fa9d68a5492904b315 and project 6a5a6205a2c74f07bda8d3bf7b5a5e6d. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:40:05.211313 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b93c4263-c98e-4777-8c3b-c5a3f5092b53 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:40:05.213642 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b93c4263-c98e-4777-8c3b-c5a3f5092b53 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:40:05.259224 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b93c4263-c98e-4777-8c3b-c5a3f5092b53 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.528505 Sep 24 21:40:05.259876 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3210/6441] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:40:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 24 21:40:05.271489 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b623a00c-2e38-4145-ab27-d2b086a40e56 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:05.272219 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b623a00c-2e38-4145-ab27-d2b086a40e56 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:05.329282 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b623a00c-2e38-4145-ab27-d2b086a40e56 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:05.337040 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b623a00c-2e38-4145-ab27-d2b086a40e56 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1217 microversion: 2.1 time: 0.069744 Sep 24 21:40:05.337611 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3232/6442] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:05 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:06.364050 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9693c803-c840-4765-8fdc-b2c2720b6ed6 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:06.364885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9693c803-c840-4765-8fdc-b2c2720b6ed6 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:06.372816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9693c803-c840-4765-8fdc-b2c2720b6ed6 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:06.373581 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9693c803-c840-4765-8fdc-b2c2720b6ed6 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:06.375948 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9693c803-c840-4765-8fdc-b2c2720b6ed6 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:06.376808 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9693c803-c840-4765-8fdc-b2c2720b6ed6 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:06.377890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9693c803-c840-4765-8fdc-b2c2720b6ed6 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:06.378308 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9693c803-c840-4765-8fdc-b2c2720b6ed6 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:06.503394 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9693c803-c840-4765-8fdc-b2c2720b6ed6 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:06.512635 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9693c803-c840-4765-8fdc-b2c2720b6ed6 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1277 microversion: 2.1 time: 0.156320 Sep 24 21:40:06.513530 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3211/6443] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:06 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1277 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:07.063449 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-69870818-4d45-4572-8896-acded274fceb req-c0771182-4d5e-4130-9b40-4d827c49466d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d0c40cc-05ef-4838-9111-3e659de26d69", "name": "network-vif-deleted", "tag": "4c34b0b4-5069-49ca-8242-5b3a4fa715d0"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:40:07.076212 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-69870818-4d45-4572-8896-acded274fceb req-c0771182-4d5e-4130-9b40-4d827c49466d service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:07.077685 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-69870818-4d45-4572-8896-acded274fceb req-c0771182-4d5e-4130-9b40-4d827c49466d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:07.078127 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-69870818-4d45-4572-8896-acded274fceb req-c0771182-4d5e-4130-9b40-4d827c49466d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:07.090559 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-69870818-4d45-4572-8896-acded274fceb req-c0771182-4d5e-4130-9b40-4d827c49466d service nova] Creating event network-vif-deleted:4c34b0b4-5069-49ca-8242-5b3a4fa715d0 for instance 7d0c40cc-05ef-4838-9111-3e659de26d69 on nch1-master-1 Sep 24 21:40:07.096855 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-69870818-4d45-4572-8896-acded274fceb req-c0771182-4d5e-4130-9b40-4d827c49466d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040060 Sep 24 21:40:07.098106 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3233/6444] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:40:07.537183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-313a810b-2d52-4298-9e6b-3d5df6e8dd6e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:07.538182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-313a810b-2d52-4298-9e6b-3d5df6e8dd6e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:07.545651 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-313a810b-2d52-4298-9e6b-3d5df6e8dd6e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:07.546311 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-313a810b-2d52-4298-9e6b-3d5df6e8dd6e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:07.546877 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-313a810b-2d52-4298-9e6b-3d5df6e8dd6e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:07.547758 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-313a810b-2d52-4298-9e6b-3d5df6e8dd6e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:07.548228 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-313a810b-2d52-4298-9e6b-3d5df6e8dd6e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:07.549173 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-313a810b-2d52-4298-9e6b-3d5df6e8dd6e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:07.757006 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-313a810b-2d52-4298-9e6b-3d5df6e8dd6e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:07.765821 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-313a810b-2d52-4298-9e6b-3d5df6e8dd6e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1317 microversion: 2.1 time: 0.232833 Sep 24 21:40:07.766405 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3212/6445] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:07 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:08.790516 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1e63b529-8c64-49fe-969a-800118dcc65f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:08.791357 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1e63b529-8c64-49fe-969a-800118dcc65f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:08.797814 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e63b529-8c64-49fe-969a-800118dcc65f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:08.798300 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e63b529-8c64-49fe-969a-800118dcc65f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:08.799035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e63b529-8c64-49fe-969a-800118dcc65f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:08.799738 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e63b529-8c64-49fe-969a-800118dcc65f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:08.800198 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e63b529-8c64-49fe-969a-800118dcc65f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:08.800628 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1e63b529-8c64-49fe-969a-800118dcc65f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:08.965931 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1e63b529-8c64-49fe-969a-800118dcc65f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:08.974006 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1e63b529-8c64-49fe-969a-800118dcc65f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1317 microversion: 2.1 time: 0.188639 Sep 24 21:40:08.974618 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3234/6446] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:08 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:09.111854 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-cd00864d-ac3c-47d9-964b-5ff9f8c9cf19 req-bd39e755-7ae9-40ba-ba4a-8a498a6f2d92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a21ad1c-8158-4cc5-b006-b4b848a65283", "tag": "599f2b0a-3a8e-4d35-8346-288e583d1943"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:40:09.122235 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-cd00864d-ac3c-47d9-964b-5ff9f8c9cf19 req-bd39e755-7ae9-40ba-ba4a-8a498a6f2d92 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:09.122748 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-cd00864d-ac3c-47d9-964b-5ff9f8c9cf19 req-bd39e755-7ae9-40ba-ba4a-8a498a6f2d92 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:09.123183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-cd00864d-ac3c-47d9-964b-5ff9f8c9cf19 req-bd39e755-7ae9-40ba-ba4a-8a498a6f2d92 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:09.135076 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-cd00864d-ac3c-47d9-964b-5ff9f8c9cf19 req-bd39e755-7ae9-40ba-ba4a-8a498a6f2d92 service nova] Creating event network-changed:599f2b0a-3a8e-4d35-8346-288e583d1943 for instance 5a21ad1c-8158-4cc5-b006-b4b848a65283 on nch1-master-1 Sep 24 21:40:09.140912 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-cd00864d-ac3c-47d9-964b-5ff9f8c9cf19 req-bd39e755-7ae9-40ba-ba4a-8a498a6f2d92 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032830 Sep 24 21:40:09.141505 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3213/6447] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:40:09.996413 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a03b1c8f-5575-497c-9b79-dec3a53dcea0 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:09.996969 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a03b1c8f-5575-497c-9b79-dec3a53dcea0 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:10.003931 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a03b1c8f-5575-497c-9b79-dec3a53dcea0 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:10.004422 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a03b1c8f-5575-497c-9b79-dec3a53dcea0 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:10.004871 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a03b1c8f-5575-497c-9b79-dec3a53dcea0 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:10.005584 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a03b1c8f-5575-497c-9b79-dec3a53dcea0 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:10.006055 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a03b1c8f-5575-497c-9b79-dec3a53dcea0 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:10.006516 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a03b1c8f-5575-497c-9b79-dec3a53dcea0 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:10.135477 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a03b1c8f-5575-497c-9b79-dec3a53dcea0 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:10.143856 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a03b1c8f-5575-497c-9b79-dec3a53dcea0 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1317 microversion: 2.1 time: 0.151389 Sep 24 21:40:10.144500 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3235/6448] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:09 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:11.168706 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f4ff8b48-74f8-4644-9871-544bdf707861 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:11.169531 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f4ff8b48-74f8-4644-9871-544bdf707861 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:11.176594 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4ff8b48-74f8-4644-9871-544bdf707861 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:11.177089 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4ff8b48-74f8-4644-9871-544bdf707861 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:11.177530 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4ff8b48-74f8-4644-9871-544bdf707861 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:11.178226 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4ff8b48-74f8-4644-9871-544bdf707861 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:11.178721 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4ff8b48-74f8-4644-9871-544bdf707861 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:11.179150 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4ff8b48-74f8-4644-9871-544bdf707861 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:11.376486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f4ff8b48-74f8-4644-9871-544bdf707861 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:11.384568 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f4ff8b48-74f8-4644-9871-544bdf707861 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1317 microversion: 2.1 time: 0.220997 Sep 24 21:40:11.385145 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3214/6449] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:11 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:12.407995 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e6802fdc-3708-47cc-a33b-9dd63eca0a55 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:12.408619 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e6802fdc-3708-47cc-a33b-9dd63eca0a55 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:12.415476 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6802fdc-3708-47cc-a33b-9dd63eca0a55 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:12.415970 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6802fdc-3708-47cc-a33b-9dd63eca0a55 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:12.416409 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6802fdc-3708-47cc-a33b-9dd63eca0a55 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:12.417113 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6802fdc-3708-47cc-a33b-9dd63eca0a55 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:12.417572 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6802fdc-3708-47cc-a33b-9dd63eca0a55 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:12.417998 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6802fdc-3708-47cc-a33b-9dd63eca0a55 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:12.558399 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e6802fdc-3708-47cc-a33b-9dd63eca0a55 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:12.560746 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:40:12.569075 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e6802fdc-3708-47cc-a33b-9dd63eca0a55 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1317 microversion: 2.1 time: 0.165528 Sep 24 21:40:12.569664 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3236/6450] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:12 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:13.592169 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-60888a1b-33b9-454a-a11d-37ddd486415c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:13.592793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-60888a1b-33b9-454a-a11d-37ddd486415c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:13.600190 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-60888a1b-33b9-454a-a11d-37ddd486415c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:13.600678 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-60888a1b-33b9-454a-a11d-37ddd486415c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:13.601117 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-60888a1b-33b9-454a-a11d-37ddd486415c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:13.601821 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-60888a1b-33b9-454a-a11d-37ddd486415c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:13.602280 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-60888a1b-33b9-454a-a11d-37ddd486415c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:13.602743 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-60888a1b-33b9-454a-a11d-37ddd486415c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:13.605409 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:40:13.734172 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-60888a1b-33b9-454a-a11d-37ddd486415c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:13.742136 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-60888a1b-33b9-454a-a11d-37ddd486415c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1317 microversion: 2.1 time: 0.153845 Sep 24 21:40:13.742671 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3215/6451] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:13 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:14.045634 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-f4817e71-c8d8-43ca-a3f2-e672ab073f90 req-1439cd7e-158b-4377-83e1-950450221271 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a21ad1c-8158-4cc5-b006-b4b848a65283", "name": "network-vif-plugged", "status": "completed", "tag": "599f2b0a-3a8e-4d35-8346-288e583d1943"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:40:14.057482 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-f4817e71-c8d8-43ca-a3f2-e672ab073f90 req-1439cd7e-158b-4377-83e1-950450221271 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:14.057975 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-f4817e71-c8d8-43ca-a3f2-e672ab073f90 req-1439cd7e-158b-4377-83e1-950450221271 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:14.058412 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-f4817e71-c8d8-43ca-a3f2-e672ab073f90 req-1439cd7e-158b-4377-83e1-950450221271 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:14.070993 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-f4817e71-c8d8-43ca-a3f2-e672ab073f90 req-1439cd7e-158b-4377-83e1-950450221271 service nova] Creating event network-vif-plugged:599f2b0a-3a8e-4d35-8346-288e583d1943 for instance 5a21ad1c-8158-4cc5-b006-b4b848a65283 on nch1-master-1 Sep 24 21:40:14.076058 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-f4817e71-c8d8-43ca-a3f2-e672ab073f90 req-1439cd7e-158b-4377-83e1-950450221271 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034487 Sep 24 21:40:14.076982 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3237/6452] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:40:14.765332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8fdef3b7-20c1-4eb7-8d7e-219a6482d92b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:14.765948 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8fdef3b7-20c1-4eb7-8d7e-219a6482d92b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:14.773991 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8fdef3b7-20c1-4eb7-8d7e-219a6482d92b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:14.774482 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8fdef3b7-20c1-4eb7-8d7e-219a6482d92b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:14.774947 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8fdef3b7-20c1-4eb7-8d7e-219a6482d92b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:14.775652 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8fdef3b7-20c1-4eb7-8d7e-219a6482d92b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:14.776116 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8fdef3b7-20c1-4eb7-8d7e-219a6482d92b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:14.776549 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8fdef3b7-20c1-4eb7-8d7e-219a6482d92b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:14.906841 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8fdef3b7-20c1-4eb7-8d7e-219a6482d92b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:14.914853 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8fdef3b7-20c1-4eb7-8d7e-219a6482d92b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1317 microversion: 2.1 time: 0.153379 Sep 24 21:40:14.915433 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3216/6453] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:14 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:15.935718 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:40:15.940367 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2e8a76f3-4008-4b60-a11b-87e7c1317d94 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:15.941166 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2e8a76f3-4008-4b60-a11b-87e7c1317d94 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:15.947671 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2e8a76f3-4008-4b60-a11b-87e7c1317d94 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:15.948153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2e8a76f3-4008-4b60-a11b-87e7c1317d94 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:15.948605 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2e8a76f3-4008-4b60-a11b-87e7c1317d94 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:15.949282 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2e8a76f3-4008-4b60-a11b-87e7c1317d94 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:15.949736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2e8a76f3-4008-4b60-a11b-87e7c1317d94 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:15.950162 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2e8a76f3-4008-4b60-a11b-87e7c1317d94 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:16.078297 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2e8a76f3-4008-4b60-a11b-87e7c1317d94 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:16.086840 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2e8a76f3-4008-4b60-a11b-87e7c1317d94 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1507 microversion: 2.1 time: 0.153020 Sep 24 21:40:16.087415 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3238/6454] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:15 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:16.109765 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-58a81584-624e-4b88-9d57-54bb6cd07840 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:16.110395 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-58a81584-624e-4b88-9d57-54bb6cd07840 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:16.112575 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:40:16.113250 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=10 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:40:16.119833 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-58a81584-624e-4b88-9d57-54bb6cd07840 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:16.120317 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-58a81584-624e-4b88-9d57-54bb6cd07840 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:16.120759 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-58a81584-624e-4b88-9d57-54bb6cd07840 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:16.121454 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-58a81584-624e-4b88-9d57-54bb6cd07840 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:16.121908 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-58a81584-624e-4b88-9d57-54bb6cd07840 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:16.122334 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-58a81584-624e-4b88-9d57-54bb6cd07840 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:16.254930 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-58a81584-624e-4b88-9d57-54bb6cd07840 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:16.262610 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-58a81584-624e-4b88-9d57-54bb6cd07840 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1507 microversion: 2.1 time: 0.156653 Sep 24 21:40:16.263185 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3217/6455] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:16 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:16.285729 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f5fbb318-862b-4011-9218-e174dbb520a1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:40:16.288097 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f5fbb318-862b-4011-9218-e174dbb520a1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:16.293960 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5fbb318-862b-4011-9218-e174dbb520a1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:16.294443 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5fbb318-862b-4011-9218-e174dbb520a1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:16.294910 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5fbb318-862b-4011-9218-e174dbb520a1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:16.295603 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5fbb318-862b-4011-9218-e174dbb520a1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:16.296059 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5fbb318-862b-4011-9218-e174dbb520a1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:16.296487 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5fbb318-862b-4011-9218-e174dbb520a1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:16.324758 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f5fbb318-862b-4011-9218-e174dbb520a1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:16.331182 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f5fbb318-862b-4011-9218-e174dbb520a1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Old instance type m1.heat2, new instance type m1.heat {{(pid=140517) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 24 21:40:16.337897 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-f5fbb318-862b-4011-9218-e174dbb520a1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:40:16.338355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-f5fbb318-862b-4011-9218-e174dbb520a1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:40:16.338877 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-f5fbb318-862b-4011-9218-e174dbb520a1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:40:16.339294 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-f5fbb318-862b-4011-9218-e174dbb520a1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:40:16.339711 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-f5fbb318-862b-4011-9218-e174dbb520a1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:40:16.402831 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f5fbb318-862b-4011-9218-e174dbb520a1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "POST /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283/action" status: 202 len: 0 microversion: 2.1 time: 0.121800 Sep 24 21:40:16.403511 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3239/6456] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:40:16 2022] POST /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:40:16.411767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e6f56299-6def-42ea-9009-79d25333aefd tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:16.412393 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e6f56299-6def-42ea-9009-79d25333aefd tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:16.418522 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6f56299-6def-42ea-9009-79d25333aefd tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:16.419023 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6f56299-6def-42ea-9009-79d25333aefd tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:16.419509 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6f56299-6def-42ea-9009-79d25333aefd tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:16.420254 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6f56299-6def-42ea-9009-79d25333aefd tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:16.420725 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6f56299-6def-42ea-9009-79d25333aefd tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:16.421161 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e6f56299-6def-42ea-9009-79d25333aefd tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:16.584415 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e6f56299-6def-42ea-9009-79d25333aefd tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:16.592444 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e6f56299-6def-42ea-9009-79d25333aefd tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1514 microversion: 2.1 time: 0.184670 Sep 24 21:40:16.593172 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3218/6457] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:16 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1514 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:17.616847 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-caa03939-e046-4d0f-9aeb-5e5ab6764154 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:17.617451 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-caa03939-e046-4d0f-9aeb-5e5ab6764154 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:17.627553 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-caa03939-e046-4d0f-9aeb-5e5ab6764154 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:17.628053 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-caa03939-e046-4d0f-9aeb-5e5ab6764154 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:17.629132 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-caa03939-e046-4d0f-9aeb-5e5ab6764154 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:17.629247 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-caa03939-e046-4d0f-9aeb-5e5ab6764154 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:17.629692 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-caa03939-e046-4d0f-9aeb-5e5ab6764154 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:17.630125 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-caa03939-e046-4d0f-9aeb-5e5ab6764154 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:17.854434 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-caa03939-e046-4d0f-9aeb-5e5ab6764154 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:17.862750 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-caa03939-e046-4d0f-9aeb-5e5ab6764154 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1514 microversion: 2.1 time: 0.250711 Sep 24 21:40:17.863333 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3240/6458] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:17 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1514 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:40:18.885530 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b5c60716-14bd-4b6a-a43e-71c23b369c7f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:18.886062 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b5c60716-14bd-4b6a-a43e-71c23b369c7f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:18.888837 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:40:18.895744 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5c60716-14bd-4b6a-a43e-71c23b369c7f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:18.896240 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5c60716-14bd-4b6a-a43e-71c23b369c7f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:18.896688 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5c60716-14bd-4b6a-a43e-71c23b369c7f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:18.897401 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5c60716-14bd-4b6a-a43e-71c23b369c7f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:18.897867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5c60716-14bd-4b6a-a43e-71c23b369c7f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:18.898304 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b5c60716-14bd-4b6a-a43e-71c23b369c7f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:19.032765 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b5c60716-14bd-4b6a-a43e-71c23b369c7f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:19.040657 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b5c60716-14bd-4b6a-a43e-71c23b369c7f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1519 microversion: 2.1 time: 0.159207 Sep 24 21:40:19.041231 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3219/6459] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:18 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:20.064979 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f7dc4c24-7e7e-4fc2-bb02-2244600c82e0 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:20.065597 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f7dc4c24-7e7e-4fc2-bb02-2244600c82e0 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:20.068367 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:40:20.073969 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7dc4c24-7e7e-4fc2-bb02-2244600c82e0 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:20.074460 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7dc4c24-7e7e-4fc2-bb02-2244600c82e0 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:20.074928 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7dc4c24-7e7e-4fc2-bb02-2244600c82e0 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:20.075663 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7dc4c24-7e7e-4fc2-bb02-2244600c82e0 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:20.076107 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7dc4c24-7e7e-4fc2-bb02-2244600c82e0 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:20.076540 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7dc4c24-7e7e-4fc2-bb02-2244600c82e0 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:20.209871 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f7dc4c24-7e7e-4fc2-bb02-2244600c82e0 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:20.217687 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f7dc4c24-7e7e-4fc2-bb02-2244600c82e0 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1519 microversion: 2.1 time: 0.156995 Sep 24 21:40:20.218259 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3241/6460] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:20 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:21.240628 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-104c3b0d-6af6-481e-975a-f7dddf674a0b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:21.241253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-104c3b0d-6af6-481e-975a-f7dddf674a0b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:21.248289 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-104c3b0d-6af6-481e-975a-f7dddf674a0b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:21.248779 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-104c3b0d-6af6-481e-975a-f7dddf674a0b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:21.249224 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-104c3b0d-6af6-481e-975a-f7dddf674a0b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:21.249929 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-104c3b0d-6af6-481e-975a-f7dddf674a0b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:21.250435 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-104c3b0d-6af6-481e-975a-f7dddf674a0b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:21.250848 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-104c3b0d-6af6-481e-975a-f7dddf674a0b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:21.381203 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-104c3b0d-6af6-481e-975a-f7dddf674a0b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:21.388999 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-104c3b0d-6af6-481e-975a-f7dddf674a0b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1519 microversion: 2.1 time: 0.152305 Sep 24 21:40:21.389571 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3220/6461] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:21 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:22.411841 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-24ec861e-b77d-4d70-95f0-d571721d48ae tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:22.412505 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-24ec861e-b77d-4d70-95f0-d571721d48ae tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:22.419384 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24ec861e-b77d-4d70-95f0-d571721d48ae tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:22.419867 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24ec861e-b77d-4d70-95f0-d571721d48ae tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:22.420307 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24ec861e-b77d-4d70-95f0-d571721d48ae tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:22.421002 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24ec861e-b77d-4d70-95f0-d571721d48ae tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:22.421458 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24ec861e-b77d-4d70-95f0-d571721d48ae tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:22.421882 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-24ec861e-b77d-4d70-95f0-d571721d48ae tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:22.557933 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-24ec861e-b77d-4d70-95f0-d571721d48ae tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:22.566309 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-24ec861e-b77d-4d70-95f0-d571721d48ae tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1519 microversion: 2.1 time: 0.158455 Sep 24 21:40:22.566891 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3242/6462] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:22 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:23.589231 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e1482979-4791-4717-a37b-627dca6ac762 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:23.589849 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e1482979-4791-4717-a37b-627dca6ac762 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:23.597697 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e1482979-4791-4717-a37b-627dca6ac762 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:23.598178 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e1482979-4791-4717-a37b-627dca6ac762 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:23.598658 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e1482979-4791-4717-a37b-627dca6ac762 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:23.599354 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e1482979-4791-4717-a37b-627dca6ac762 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:23.599821 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e1482979-4791-4717-a37b-627dca6ac762 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:23.600273 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e1482979-4791-4717-a37b-627dca6ac762 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:23.731798 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e1482979-4791-4717-a37b-627dca6ac762 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:23.739816 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e1482979-4791-4717-a37b-627dca6ac762 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1519 microversion: 2.1 time: 0.154542 Sep 24 21:40:23.740387 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3221/6463] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:23 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:24.762002 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bba46b99-5b16-4028-b148-c05be5346b93 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:24.762647 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bba46b99-5b16-4028-b148-c05be5346b93 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:24.770435 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bba46b99-5b16-4028-b148-c05be5346b93 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:24.770954 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bba46b99-5b16-4028-b148-c05be5346b93 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:24.771393 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bba46b99-5b16-4028-b148-c05be5346b93 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:24.772111 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bba46b99-5b16-4028-b148-c05be5346b93 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:24.772596 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bba46b99-5b16-4028-b148-c05be5346b93 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:24.773047 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bba46b99-5b16-4028-b148-c05be5346b93 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:24.906086 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bba46b99-5b16-4028-b148-c05be5346b93 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:24.914065 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bba46b99-5b16-4028-b148-c05be5346b93 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1519 microversion: 2.1 time: 0.155994 Sep 24 21:40:24.914673 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3243/6464] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:24 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:25.941567 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-514892b7-a272-4252-a45b-8fb59662835a tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:25.942199 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-514892b7-a272-4252-a45b-8fb59662835a tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:25.949364 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-514892b7-a272-4252-a45b-8fb59662835a tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:25.949864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-514892b7-a272-4252-a45b-8fb59662835a tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:25.950312 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-514892b7-a272-4252-a45b-8fb59662835a tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:25.951083 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-514892b7-a272-4252-a45b-8fb59662835a tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:25.951538 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-514892b7-a272-4252-a45b-8fb59662835a tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:25.951984 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-514892b7-a272-4252-a45b-8fb59662835a tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:26.083386 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-514892b7-a272-4252-a45b-8fb59662835a tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:26.091252 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-514892b7-a272-4252-a45b-8fb59662835a tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1519 microversion: 2.1 time: 0.154531 Sep 24 21:40:26.091827 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3222/6465] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:25 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:27.115338 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-07e2ffa8-6b9b-40dd-903d-00fa8ca5d0ea tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:27.115965 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-07e2ffa8-6b9b-40dd-903d-00fa8ca5d0ea tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:27.123026 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-07e2ffa8-6b9b-40dd-903d-00fa8ca5d0ea tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:27.123515 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-07e2ffa8-6b9b-40dd-903d-00fa8ca5d0ea tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:27.123960 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-07e2ffa8-6b9b-40dd-903d-00fa8ca5d0ea tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:27.124658 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-07e2ffa8-6b9b-40dd-903d-00fa8ca5d0ea tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:27.125122 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-07e2ffa8-6b9b-40dd-903d-00fa8ca5d0ea tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:27.125553 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-07e2ffa8-6b9b-40dd-903d-00fa8ca5d0ea tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:27.257734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-07e2ffa8-6b9b-40dd-903d-00fa8ca5d0ea tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:27.265648 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-07e2ffa8-6b9b-40dd-903d-00fa8ca5d0ea tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1519 microversion: 2.1 time: 0.154785 Sep 24 21:40:27.266222 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3244/6466] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:27 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:28.289480 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b6d45929-4b52-40ce-951b-5b7094348e7b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:28.290107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b6d45929-4b52-40ce-951b-5b7094348e7b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:28.297224 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6d45929-4b52-40ce-951b-5b7094348e7b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:28.297712 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6d45929-4b52-40ce-951b-5b7094348e7b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:28.299220 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6d45929-4b52-40ce-951b-5b7094348e7b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:28.300083 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6d45929-4b52-40ce-951b-5b7094348e7b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:28.300551 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6d45929-4b52-40ce-951b-5b7094348e7b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:28.300987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b6d45929-4b52-40ce-951b-5b7094348e7b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:28.432739 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b6d45929-4b52-40ce-951b-5b7094348e7b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:28.440944 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b6d45929-4b52-40ce-951b-5b7094348e7b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1519 microversion: 2.1 time: 0.155384 Sep 24 21:40:28.441547 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3223/6467] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:28 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:29.465374 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bdf55eba-797d-4514-964f-56fccd74d8f7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:29.465994 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bdf55eba-797d-4514-964f-56fccd74d8f7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:29.473625 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bdf55eba-797d-4514-964f-56fccd74d8f7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:29.474110 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bdf55eba-797d-4514-964f-56fccd74d8f7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:29.474574 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bdf55eba-797d-4514-964f-56fccd74d8f7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:29.475302 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bdf55eba-797d-4514-964f-56fccd74d8f7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:29.475758 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bdf55eba-797d-4514-964f-56fccd74d8f7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:29.476184 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bdf55eba-797d-4514-964f-56fccd74d8f7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:29.607744 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bdf55eba-797d-4514-964f-56fccd74d8f7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:29.615608 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bdf55eba-797d-4514-964f-56fccd74d8f7 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1519 microversion: 2.1 time: 0.154165 Sep 24 21:40:29.616185 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3245/6468] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:29 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:30.638811 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9bb53870-9772-4948-b987-5cec3b36c1f5 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:30.639448 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9bb53870-9772-4948-b987-5cec3b36c1f5 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:30.646982 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9bb53870-9772-4948-b987-5cec3b36c1f5 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:30.647474 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9bb53870-9772-4948-b987-5cec3b36c1f5 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:30.647921 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9bb53870-9772-4948-b987-5cec3b36c1f5 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:30.648637 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9bb53870-9772-4948-b987-5cec3b36c1f5 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:30.649101 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9bb53870-9772-4948-b987-5cec3b36c1f5 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:30.649533 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9bb53870-9772-4948-b987-5cec3b36c1f5 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:30.785448 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9bb53870-9772-4948-b987-5cec3b36c1f5 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:30.799784 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9bb53870-9772-4948-b987-5cec3b36c1f5 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1519 microversion: 2.1 time: 0.165181 Sep 24 21:40:30.800372 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3224/6469] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:30 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:40:31.823544 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0327bc61-2e3e-4135-a16c-597282e482cb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:31.824191 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0327bc61-2e3e-4135-a16c-597282e482cb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:31.831402 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0327bc61-2e3e-4135-a16c-597282e482cb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:31.831886 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0327bc61-2e3e-4135-a16c-597282e482cb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:31.832325 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0327bc61-2e3e-4135-a16c-597282e482cb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:31.833021 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0327bc61-2e3e-4135-a16c-597282e482cb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:31.833480 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0327bc61-2e3e-4135-a16c-597282e482cb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:31.833906 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0327bc61-2e3e-4135-a16c-597282e482cb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:31.967438 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0327bc61-2e3e-4135-a16c-597282e482cb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:31.975573 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0327bc61-2e3e-4135-a16c-597282e482cb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1519 microversion: 2.1 time: 0.155961 Sep 24 21:40:31.976148 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3246/6470] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:31 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:32.999240 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b838e4e3-8221-4702-a131-1cd4bcccb10b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:32.999776 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b838e4e3-8221-4702-a131-1cd4bcccb10b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:33.007530 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b838e4e3-8221-4702-a131-1cd4bcccb10b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:33.008037 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b838e4e3-8221-4702-a131-1cd4bcccb10b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:33.008472 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b838e4e3-8221-4702-a131-1cd4bcccb10b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:33.009187 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b838e4e3-8221-4702-a131-1cd4bcccb10b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:33.009656 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b838e4e3-8221-4702-a131-1cd4bcccb10b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:33.010099 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b838e4e3-8221-4702-a131-1cd4bcccb10b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:33.143115 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b838e4e3-8221-4702-a131-1cd4bcccb10b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:33.150919 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b838e4e3-8221-4702-a131-1cd4bcccb10b tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1519 microversion: 2.1 time: 0.155672 Sep 24 21:40:33.151495 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3225/6471] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:32 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:34.173490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4fcf80cb-dae8-43b7-bde0-4ae73fcdd8cb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:34.174407 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4fcf80cb-dae8-43b7-bde0-4ae73fcdd8cb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:34.181473 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4fcf80cb-dae8-43b7-bde0-4ae73fcdd8cb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:34.181958 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4fcf80cb-dae8-43b7-bde0-4ae73fcdd8cb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:34.182400 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4fcf80cb-dae8-43b7-bde0-4ae73fcdd8cb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:34.183120 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4fcf80cb-dae8-43b7-bde0-4ae73fcdd8cb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:34.183576 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4fcf80cb-dae8-43b7-bde0-4ae73fcdd8cb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:34.184005 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4fcf80cb-dae8-43b7-bde0-4ae73fcdd8cb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:34.313902 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4fcf80cb-dae8-43b7-bde0-4ae73fcdd8cb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:34.321766 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4fcf80cb-dae8-43b7-bde0-4ae73fcdd8cb tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1519 microversion: 2.1 time: 0.152492 Sep 24 21:40:34.322349 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3247/6472] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:34 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:35.345256 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b7ce4b80-984c-4b38-9d8d-8fa5d5e7e782 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:35.345987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b7ce4b80-984c-4b38-9d8d-8fa5d5e7e782 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:35.353057 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7ce4b80-984c-4b38-9d8d-8fa5d5e7e782 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:35.353549 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7ce4b80-984c-4b38-9d8d-8fa5d5e7e782 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:35.353996 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7ce4b80-984c-4b38-9d8d-8fa5d5e7e782 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:35.354746 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7ce4b80-984c-4b38-9d8d-8fa5d5e7e782 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:35.355212 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7ce4b80-984c-4b38-9d8d-8fa5d5e7e782 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:35.355647 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7ce4b80-984c-4b38-9d8d-8fa5d5e7e782 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:35.488015 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b7ce4b80-984c-4b38-9d8d-8fa5d5e7e782 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:35.495974 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b7ce4b80-984c-4b38-9d8d-8fa5d5e7e782 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1519 microversion: 2.1 time: 0.155191 Sep 24 21:40:35.496556 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3226/6473] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:35 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:36.518689 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-96406598-580c-47d7-870d-979c7189875c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:36.519321 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-96406598-580c-47d7-870d-979c7189875c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:36.526332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96406598-580c-47d7-870d-979c7189875c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:36.526868 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96406598-580c-47d7-870d-979c7189875c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:36.527318 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96406598-580c-47d7-870d-979c7189875c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:36.528028 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96406598-580c-47d7-870d-979c7189875c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:36.528493 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96406598-580c-47d7-870d-979c7189875c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:36.528932 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-96406598-580c-47d7-870d-979c7189875c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:36.664581 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-96406598-580c-47d7-870d-979c7189875c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:36.672388 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-96406598-580c-47d7-870d-979c7189875c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1519 microversion: 2.1 time: 0.157870 Sep 24 21:40:36.673654 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3248/6474] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:36 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:37.697057 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-39b538ea-4120-465e-babf-12aec77d7554 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:37.697678 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-39b538ea-4120-465e-babf-12aec77d7554 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:37.704726 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-39b538ea-4120-465e-babf-12aec77d7554 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:37.705208 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-39b538ea-4120-465e-babf-12aec77d7554 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:37.705643 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-39b538ea-4120-465e-babf-12aec77d7554 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:37.706337 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-39b538ea-4120-465e-babf-12aec77d7554 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:37.706821 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-39b538ea-4120-465e-babf-12aec77d7554 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:37.707250 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-39b538ea-4120-465e-babf-12aec77d7554 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:37.838270 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-39b538ea-4120-465e-babf-12aec77d7554 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:37.847014 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-39b538ea-4120-465e-babf-12aec77d7554 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1519 microversion: 2.1 time: 0.153966 Sep 24 21:40:37.847591 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3227/6475] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:37 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:38.870523 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bec37bd2-88fa-4eea-8c40-b41cab4143e4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:38.871166 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bec37bd2-88fa-4eea-8c40-b41cab4143e4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:38.878711 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bec37bd2-88fa-4eea-8c40-b41cab4143e4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:38.879198 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bec37bd2-88fa-4eea-8c40-b41cab4143e4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:38.879639 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bec37bd2-88fa-4eea-8c40-b41cab4143e4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:38.880350 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bec37bd2-88fa-4eea-8c40-b41cab4143e4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:38.880799 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bec37bd2-88fa-4eea-8c40-b41cab4143e4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:38.881231 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bec37bd2-88fa-4eea-8c40-b41cab4143e4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:39.013307 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bec37bd2-88fa-4eea-8c40-b41cab4143e4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:39.021868 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bec37bd2-88fa-4eea-8c40-b41cab4143e4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1519 microversion: 2.1 time: 0.155292 Sep 24 21:40:39.022443 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3249/6476] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:38 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:40.045032 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f0691c3e-e639-4ac4-90fc-f6e87b43c9c2 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:40.045592 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f0691c3e-e639-4ac4-90fc-f6e87b43c9c2 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:40.053523 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f0691c3e-e639-4ac4-90fc-f6e87b43c9c2 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:40.054178 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f0691c3e-e639-4ac4-90fc-f6e87b43c9c2 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:40.054662 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f0691c3e-e639-4ac4-90fc-f6e87b43c9c2 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:40.055374 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f0691c3e-e639-4ac4-90fc-f6e87b43c9c2 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:40.055837 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f0691c3e-e639-4ac4-90fc-f6e87b43c9c2 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:40.056273 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f0691c3e-e639-4ac4-90fc-f6e87b43c9c2 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:40.188544 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f0691c3e-e639-4ac4-90fc-f6e87b43c9c2 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:40.197362 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f0691c3e-e639-4ac4-90fc-f6e87b43c9c2 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1519 microversion: 2.1 time: 0.156296 Sep 24 21:40:40.198132 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3228/6477] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:40 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:41.220500 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-073f2a15-e211-45f2-828d-9d04fc191b5c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:41.221409 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-073f2a15-e211-45f2-828d-9d04fc191b5c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:41.228517 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-073f2a15-e211-45f2-828d-9d04fc191b5c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:41.229007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-073f2a15-e211-45f2-828d-9d04fc191b5c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:41.229460 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-073f2a15-e211-45f2-828d-9d04fc191b5c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:41.230166 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-073f2a15-e211-45f2-828d-9d04fc191b5c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:41.230681 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-073f2a15-e211-45f2-828d-9d04fc191b5c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:41.231113 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-073f2a15-e211-45f2-828d-9d04fc191b5c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:41.367753 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-073f2a15-e211-45f2-828d-9d04fc191b5c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:41.376051 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-073f2a15-e211-45f2-828d-9d04fc191b5c tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1519 microversion: 2.1 time: 0.159408 Sep 24 21:40:41.376653 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3250/6478] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:41 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:42.400158 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-825c3900-7eb9-4615-b6ad-8ec967b16251 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:42.400784 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-825c3900-7eb9-4615-b6ad-8ec967b16251 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:42.407714 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-825c3900-7eb9-4615-b6ad-8ec967b16251 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:42.408917 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-825c3900-7eb9-4615-b6ad-8ec967b16251 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:42.409623 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-825c3900-7eb9-4615-b6ad-8ec967b16251 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:42.410336 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-825c3900-7eb9-4615-b6ad-8ec967b16251 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:42.410821 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-825c3900-7eb9-4615-b6ad-8ec967b16251 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:42.411252 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-825c3900-7eb9-4615-b6ad-8ec967b16251 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:42.541698 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-825c3900-7eb9-4615-b6ad-8ec967b16251 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:42.549897 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-825c3900-7eb9-4615-b6ad-8ec967b16251 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1519 microversion: 2.1 time: 0.153753 Sep 24 21:40:42.550469 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3229/6479] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:42 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:40:43.574362 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3a3a969c-53b0-497f-bb9c-a16056b58d44 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:43.575288 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3a3a969c-53b0-497f-bb9c-a16056b58d44 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:43.583059 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a3a969c-53b0-497f-bb9c-a16056b58d44 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:43.584195 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a3a969c-53b0-497f-bb9c-a16056b58d44 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:43.584670 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a3a969c-53b0-497f-bb9c-a16056b58d44 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:43.585454 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a3a969c-53b0-497f-bb9c-a16056b58d44 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:43.585933 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a3a969c-53b0-497f-bb9c-a16056b58d44 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:43.586383 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a3a969c-53b0-497f-bb9c-a16056b58d44 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:43.722030 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3a3a969c-53b0-497f-bb9c-a16056b58d44 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:43.730108 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3a3a969c-53b0-497f-bb9c-a16056b58d44 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1519 microversion: 2.1 time: 0.161112 Sep 24 21:40:43.730716 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3251/6480] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:43 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:44.753266 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-242854d6-a7f9-4b04-8e0f-df1a8e1ea958 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:44.753890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-242854d6-a7f9-4b04-8e0f-df1a8e1ea958 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:44.760908 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-242854d6-a7f9-4b04-8e0f-df1a8e1ea958 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:44.761399 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-242854d6-a7f9-4b04-8e0f-df1a8e1ea958 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:44.761838 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-242854d6-a7f9-4b04-8e0f-df1a8e1ea958 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:44.762555 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-242854d6-a7f9-4b04-8e0f-df1a8e1ea958 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:44.763022 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-242854d6-a7f9-4b04-8e0f-df1a8e1ea958 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:44.763453 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-242854d6-a7f9-4b04-8e0f-df1a8e1ea958 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:44.767909 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=90 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:40:44.945555 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-242854d6-a7f9-4b04-8e0f-df1a8e1ea958 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:44.953552 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-242854d6-a7f9-4b04-8e0f-df1a8e1ea958 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1519 microversion: 2.1 time: 0.204468 Sep 24 21:40:44.954278 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3230/6481] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:44 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1519 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:45.503109 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-f2b76c4c-5fed-47c1-bdd6-4dec6ac6afd2 req-92c6926a-52ca-46b1-ab4a-be32c041a268 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a21ad1c-8158-4cc5-b006-b4b848a65283", "name": "network-vif-unplugged", "status": "completed", "tag": "599f2b0a-3a8e-4d35-8346-288e583d1943"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:40:45.514189 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-f2b76c4c-5fed-47c1-bdd6-4dec6ac6afd2 req-92c6926a-52ca-46b1-ab4a-be32c041a268 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:45.514804 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-f2b76c4c-5fed-47c1-bdd6-4dec6ac6afd2 req-92c6926a-52ca-46b1-ab4a-be32c041a268 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:45.515283 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-f2b76c4c-5fed-47c1-bdd6-4dec6ac6afd2 req-92c6926a-52ca-46b1-ab4a-be32c041a268 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:45.518100 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:40:45.529506 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-f2b76c4c-5fed-47c1-bdd6-4dec6ac6afd2 req-92c6926a-52ca-46b1-ab4a-be32c041a268 service nova] Creating event network-vif-unplugged:599f2b0a-3a8e-4d35-8346-288e583d1943 for instance 5a21ad1c-8158-4cc5-b006-b4b848a65283 on nch2-master-1 Sep 24 21:40:45.536477 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [req-f2b76c4c-5fed-47c1-bdd6-4dec6ac6afd2 req-92c6926a-52ca-46b1-ab4a-be32c041a268 service nova] Instance 5a21ad1c-8158-4cc5-b006-b4b848a65283 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 21:40:45.547908 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-f2b76c4c-5fed-47c1-bdd6-4dec6ac6afd2 req-92c6926a-52ca-46b1-ab4a-be32c041a268 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049376 Sep 24 21:40:45.549693 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3252/6482] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:40:45.977108 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8db6ed8d-2118-4c3d-9f3a-3e2002d35c30 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:45.977765 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8db6ed8d-2118-4c3d-9f3a-3e2002d35c30 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:45.984691 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8db6ed8d-2118-4c3d-9f3a-3e2002d35c30 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:45.985179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8db6ed8d-2118-4c3d-9f3a-3e2002d35c30 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:45.985621 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8db6ed8d-2118-4c3d-9f3a-3e2002d35c30 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:45.986916 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8db6ed8d-2118-4c3d-9f3a-3e2002d35c30 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:45.987378 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8db6ed8d-2118-4c3d-9f3a-3e2002d35c30 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:45.987805 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8db6ed8d-2118-4c3d-9f3a-3e2002d35c30 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:46.197387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8db6ed8d-2118-4c3d-9f3a-3e2002d35c30 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:46.205473 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8db6ed8d-2118-4c3d-9f3a-3e2002d35c30 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1518 microversion: 2.1 time: 0.232237 Sep 24 21:40:46.206156 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3231/6483] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:45 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1518 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:47.229516 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a33bf0c1-e6d0-454b-b355-d58609e43ccd tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:47.230222 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a33bf0c1-e6d0-454b-b355-d58609e43ccd tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:47.237765 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a33bf0c1-e6d0-454b-b355-d58609e43ccd tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:47.238249 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a33bf0c1-e6d0-454b-b355-d58609e43ccd tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:47.238732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a33bf0c1-e6d0-454b-b355-d58609e43ccd tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:47.239434 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a33bf0c1-e6d0-454b-b355-d58609e43ccd tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:47.239895 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a33bf0c1-e6d0-454b-b355-d58609e43ccd tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:47.240332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a33bf0c1-e6d0-454b-b355-d58609e43ccd tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:47.380505 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a33bf0c1-e6d0-454b-b355-d58609e43ccd tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:47.388322 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a33bf0c1-e6d0-454b-b355-d58609e43ccd tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1516 microversion: 2.1 time: 0.163339 Sep 24 21:40:47.388909 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3253/6484] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:47 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:47.578578 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-6f1724bb-5a19-4966-a18a-e1110d2b5c20 req-1701a87c-5268-4c5c-a286-408982ec6679 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a21ad1c-8158-4cc5-b006-b4b848a65283", "tag": "599f2b0a-3a8e-4d35-8346-288e583d1943"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:40:47.589586 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-6f1724bb-5a19-4966-a18a-e1110d2b5c20 req-1701a87c-5268-4c5c-a286-408982ec6679 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:47.590062 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-6f1724bb-5a19-4966-a18a-e1110d2b5c20 req-1701a87c-5268-4c5c-a286-408982ec6679 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:47.590513 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-6f1724bb-5a19-4966-a18a-e1110d2b5c20 req-1701a87c-5268-4c5c-a286-408982ec6679 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:47.603298 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-6f1724bb-5a19-4966-a18a-e1110d2b5c20 req-1701a87c-5268-4c5c-a286-408982ec6679 service nova] Creating event network-changed:599f2b0a-3a8e-4d35-8346-288e583d1943 for instance 5a21ad1c-8158-4cc5-b006-b4b848a65283 on nch2-master-1 Sep 24 21:40:47.608921 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [req-6f1724bb-5a19-4966-a18a-e1110d2b5c20 req-1701a87c-5268-4c5c-a286-408982ec6679 service nova] Instance 5a21ad1c-8158-4cc5-b006-b4b848a65283 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 21:40:47.621160 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-6f1724bb-5a19-4966-a18a-e1110d2b5c20 req-1701a87c-5268-4c5c-a286-408982ec6679 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046409 Sep 24 21:40:47.621775 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3232/6485] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:40:48.412704 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2fd1f8c4-db58-4faa-be3e-5278b3806057 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:48.413358 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2fd1f8c4-db58-4faa-be3e-5278b3806057 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:48.419864 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2fd1f8c4-db58-4faa-be3e-5278b3806057 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:48.420344 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2fd1f8c4-db58-4faa-be3e-5278b3806057 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:48.420782 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2fd1f8c4-db58-4faa-be3e-5278b3806057 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:48.421535 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2fd1f8c4-db58-4faa-be3e-5278b3806057 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:48.421936 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2fd1f8c4-db58-4faa-be3e-5278b3806057 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:48.422361 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2fd1f8c4-db58-4faa-be3e-5278b3806057 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:48.566231 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2fd1f8c4-db58-4faa-be3e-5278b3806057 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:48.574111 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2fd1f8c4-db58-4faa-be3e-5278b3806057 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1513 microversion: 2.1 time: 0.166116 Sep 24 21:40:48.574710 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3254/6486] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:48 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:48.598660 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5500eadb-2296-4d42-b545-b31b7cec05d3 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:40:48.599295 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5500eadb-2296-4d42-b545-b31b7cec05d3 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:48.605518 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5500eadb-2296-4d42-b545-b31b7cec05d3 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:48.606007 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5500eadb-2296-4d42-b545-b31b7cec05d3 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:48.606446 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5500eadb-2296-4d42-b545-b31b7cec05d3 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:48.607185 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5500eadb-2296-4d42-b545-b31b7cec05d3 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:48.607643 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5500eadb-2296-4d42-b545-b31b7cec05d3 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:48.608075 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5500eadb-2296-4d42-b545-b31b7cec05d3 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:48.665562 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5500eadb-2296-4d42-b545-b31b7cec05d3 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "POST /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283/action" status: 204 len: 0 microversion: 2.1 time: 0.072349 Sep 24 21:40:48.666196 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3233/6487] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:40:48 2022] POST /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:40:48.675468 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ddf0df86-9ab3-411f-a6e9-4f4c701160f8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:48.676105 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ddf0df86-9ab3-411f-a6e9-4f4c701160f8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:48.682438 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ddf0df86-9ab3-411f-a6e9-4f4c701160f8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:48.683190 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ddf0df86-9ab3-411f-a6e9-4f4c701160f8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:48.683757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ddf0df86-9ab3-411f-a6e9-4f4c701160f8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:48.684572 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ddf0df86-9ab3-411f-a6e9-4f4c701160f8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:48.685041 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ddf0df86-9ab3-411f-a6e9-4f4c701160f8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:48.685621 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ddf0df86-9ab3-411f-a6e9-4f4c701160f8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:48.904810 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ddf0df86-9ab3-411f-a6e9-4f4c701160f8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:48.913259 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ddf0df86-9ab3-411f-a6e9-4f4c701160f8 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1513 microversion: 2.1 time: 0.242636 Sep 24 21:40:48.914286 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3255/6488] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:48 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1513 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:49.940064 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7f86d33c-f157-4e50-b13d-38caed7c5389 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:49.940880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7f86d33c-f157-4e50-b13d-38caed7c5389 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:49.942817 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=30 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:40:49.948349 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f86d33c-f157-4e50-b13d-38caed7c5389 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:49.948832 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f86d33c-f157-4e50-b13d-38caed7c5389 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:49.949272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f86d33c-f157-4e50-b13d-38caed7c5389 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:49.949967 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f86d33c-f157-4e50-b13d-38caed7c5389 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:49.950447 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f86d33c-f157-4e50-b13d-38caed7c5389 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:49.950901 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7f86d33c-f157-4e50-b13d-38caed7c5389 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:50.084084 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7f86d33c-f157-4e50-b13d-38caed7c5389 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:50.092038 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7f86d33c-f157-4e50-b13d-38caed7c5389 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1513 microversion: 2.1 time: 0.157273 Sep 24 21:40:50.092610 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3234/6489] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:49 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:51.114955 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-685c4c01-224a-4e71-9ce5-8c3b4c7a9b4a tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:51.115572 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-685c4c01-224a-4e71-9ce5-8c3b4c7a9b4a tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:51.118803 ncdv-master-1 devstack@n-api.service[140517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 21:40:51.119016 ncdv-master-1 devstack@n-api.service[140517]: Sat Sep 24 21:40:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 (ip 10.222.0.52) !!! Sep 24 21:40:51.120544 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=30 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:40:51.130158 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-685c4c01-224a-4e71-9ce5-8c3b4c7a9b4a tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:51.130695 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-685c4c01-224a-4e71-9ce5-8c3b4c7a9b4a tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:51.131152 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-685c4c01-224a-4e71-9ce5-8c3b4c7a9b4a tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:51.131884 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-685c4c01-224a-4e71-9ce5-8c3b4c7a9b4a tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:51.132351 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-685c4c01-224a-4e71-9ce5-8c3b4c7a9b4a tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:51.132792 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-685c4c01-224a-4e71-9ce5-8c3b4c7a9b4a tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:51.233465 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-faa4fa2f-1bc6-4742-b7f1-03287448ad13 req-4b234366-f4b8-4e3e-b1e0-f85fa6c96549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a21ad1c-8158-4cc5-b006-b4b848a65283", "name": "network-vif-plugged", "status": "completed", "tag": "599f2b0a-3a8e-4d35-8346-288e583d1943"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:40:51.249398 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-faa4fa2f-1bc6-4742-b7f1-03287448ad13 req-4b234366-f4b8-4e3e-b1e0-f85fa6c96549 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:51.249898 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-faa4fa2f-1bc6-4742-b7f1-03287448ad13 req-4b234366-f4b8-4e3e-b1e0-f85fa6c96549 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:51.250337 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-faa4fa2f-1bc6-4742-b7f1-03287448ad13 req-4b234366-f4b8-4e3e-b1e0-f85fa6c96549 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:51.262374 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-faa4fa2f-1bc6-4742-b7f1-03287448ad13 req-4b234366-f4b8-4e3e-b1e0-f85fa6c96549 service nova] Creating event network-vif-plugged:599f2b0a-3a8e-4d35-8346-288e583d1943 for instance 5a21ad1c-8158-4cc5-b006-b4b848a65283 on nch2-master-1 Sep 24 21:40:51.267315 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-685c4c01-224a-4e71-9ce5-8c3b4c7a9b4a tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:51.267579 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-faa4fa2f-1bc6-4742-b7f1-03287448ad13 req-4b234366-f4b8-4e3e-b1e0-f85fa6c96549 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037898 Sep 24 21:40:51.268420 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3235/6490] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:40:51.276539 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-685c4c01-224a-4e71-9ce5-8c3b4c7a9b4a tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1505 microversion: 2.1 time: 0.165693 Sep 24 21:40:51.277117 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3256/6491] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:51 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:51.300801 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9c595ccd-a21b-4ce1-b82e-f34b5d178b01 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:51.301679 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9c595ccd-a21b-4ce1-b82e-f34b5d178b01 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:51.308072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c595ccd-a21b-4ce1-b82e-f34b5d178b01 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:51.308559 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c595ccd-a21b-4ce1-b82e-f34b5d178b01 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:51.308998 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c595ccd-a21b-4ce1-b82e-f34b5d178b01 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:51.309701 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c595ccd-a21b-4ce1-b82e-f34b5d178b01 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:51.310156 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c595ccd-a21b-4ce1-b82e-f34b5d178b01 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:51.310619 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c595ccd-a21b-4ce1-b82e-f34b5d178b01 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:51.450202 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9c595ccd-a21b-4ce1-b82e-f34b5d178b01 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:51.458292 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9c595ccd-a21b-4ce1-b82e-f34b5d178b01 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1505 microversion: 2.1 time: 0.163073 Sep 24 21:40:51.458890 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3236/6492] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:51 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:51.479826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2d8c06b2-1d34-4fc3-a109-7ddc0ec3bf5a tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:51.480449 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2d8c06b2-1d34-4fc3-a109-7ddc0ec3bf5a tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:51.487454 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d8c06b2-1d34-4fc3-a109-7ddc0ec3bf5a tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:51.488014 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d8c06b2-1d34-4fc3-a109-7ddc0ec3bf5a tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:51.488485 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d8c06b2-1d34-4fc3-a109-7ddc0ec3bf5a tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:51.489183 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d8c06b2-1d34-4fc3-a109-7ddc0ec3bf5a tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:51.489653 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d8c06b2-1d34-4fc3-a109-7ddc0ec3bf5a tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:51.490092 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d8c06b2-1d34-4fc3-a109-7ddc0ec3bf5a tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:51.619843 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2d8c06b2-1d34-4fc3-a109-7ddc0ec3bf5a tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:51.627780 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2d8c06b2-1d34-4fc3-a109-7ddc0ec3bf5a tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1505 microversion: 2.1 time: 0.151789 Sep 24 21:40:51.628355 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3257/6493] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:51 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:40:51.649428 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f1b958eb-4e9b-4b65-98ac-2273e3e959d9 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:51.649934 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f1b958eb-4e9b-4b65-98ac-2273e3e959d9 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:51.655963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1b958eb-4e9b-4b65-98ac-2273e3e959d9 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:51.656452 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1b958eb-4e9b-4b65-98ac-2273e3e959d9 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:51.656893 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1b958eb-4e9b-4b65-98ac-2273e3e959d9 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:51.657620 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1b958eb-4e9b-4b65-98ac-2273e3e959d9 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:51.658788 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1b958eb-4e9b-4b65-98ac-2273e3e959d9 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:51.659272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1b958eb-4e9b-4b65-98ac-2273e3e959d9 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:51.685662 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f1b958eb-4e9b-4b65-98ac-2273e3e959d9 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:40:51.762339 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f1b958eb-4e9b-4b65-98ac-2273e3e959d9 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 204 len: 0 microversion: 2.1 time: 0.116286 Sep 24 21:40:51.763086 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3237/6494] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:40:51 2022] DELETE /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:40:51.779513 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-248f85af-59b8-4083-8b7a-a99a16f04515 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:51.780027 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-248f85af-59b8-4083-8b7a-a99a16f04515 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:51.786654 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-248f85af-59b8-4083-8b7a-a99a16f04515 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:51.787151 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-248f85af-59b8-4083-8b7a-a99a16f04515 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:51.787603 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-248f85af-59b8-4083-8b7a-a99a16f04515 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:51.788312 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-248f85af-59b8-4083-8b7a-a99a16f04515 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:51.788780 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-248f85af-59b8-4083-8b7a-a99a16f04515 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:51.789217 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-248f85af-59b8-4083-8b7a-a99a16f04515 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:51.815234 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-248f85af-59b8-4083-8b7a-a99a16f04515 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:40:51.859697 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.compute.api [None req-248f85af-59b8-4083-8b7a-a99a16f04515 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Instance is already in deleting state, ignoring this request Sep 24 21:40:51.860530 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-248f85af-59b8-4083-8b7a-a99a16f04515 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 204 len: 0 microversion: 2.1 time: 0.085077 Sep 24 21:40:51.861749 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3258/6495] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:40:51 2022] DELETE /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:40:51.870597 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0aed24ff-91f9-4bfa-9d51-66df0f32a4d4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:51.871441 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0aed24ff-91f9-4bfa-9d51-66df0f32a4d4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:51.878028 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0aed24ff-91f9-4bfa-9d51-66df0f32a4d4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:51.878538 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0aed24ff-91f9-4bfa-9d51-66df0f32a4d4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:51.878993 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0aed24ff-91f9-4bfa-9d51-66df0f32a4d4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:51.879689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0aed24ff-91f9-4bfa-9d51-66df0f32a4d4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:51.880151 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0aed24ff-91f9-4bfa-9d51-66df0f32a4d4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:51.880583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0aed24ff-91f9-4bfa-9d51-66df0f32a4d4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:52.014295 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0aed24ff-91f9-4bfa-9d51-66df0f32a4d4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:52.022352 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0aed24ff-91f9-4bfa-9d51-66df0f32a4d4 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1511 microversion: 2.1 time: 0.156051 Sep 24 21:40:52.022958 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3238/6496] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:51 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:53.045226 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0f1d4b75-f6b7-4818-ba95-33d4d5eaad68 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:53.045889 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0f1d4b75-f6b7-4818-ba95-33d4d5eaad68 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:53.053205 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f1d4b75-f6b7-4818-ba95-33d4d5eaad68 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:53.053700 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f1d4b75-f6b7-4818-ba95-33d4d5eaad68 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:53.054145 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f1d4b75-f6b7-4818-ba95-33d4d5eaad68 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:53.054899 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f1d4b75-f6b7-4818-ba95-33d4d5eaad68 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:53.055367 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f1d4b75-f6b7-4818-ba95-33d4d5eaad68 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:53.055810 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f1d4b75-f6b7-4818-ba95-33d4d5eaad68 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:53.194575 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0f1d4b75-f6b7-4818-ba95-33d4d5eaad68 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51ff8103f42fa9d68a5492904b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a6205a2c74f07bda8d3bf7b5a5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:40:53.202385 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0f1d4b75-f6b7-4818-ba95-33d4d5eaad68 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 200 len: 1511 microversion: 2.1 time: 0.161150 Sep 24 21:40:53.202991 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3259/6497] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:53 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:40:53.699477 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-777642ff-46bf-4a80-bd3d-da70a13b835a req-b1c7bee8-49cf-45af-a81a-8897ec95d8ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a21ad1c-8158-4cc5-b006-b4b848a65283", "name": "network-vif-deleted", "tag": "599f2b0a-3a8e-4d35-8346-288e583d1943"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:40:53.711268 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-777642ff-46bf-4a80-bd3d-da70a13b835a req-b1c7bee8-49cf-45af-a81a-8897ec95d8ad service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:53.711760 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-777642ff-46bf-4a80-bd3d-da70a13b835a req-b1c7bee8-49cf-45af-a81a-8897ec95d8ad service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:53.712210 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-777642ff-46bf-4a80-bd3d-da70a13b835a req-b1c7bee8-49cf-45af-a81a-8897ec95d8ad service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:53.727387 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-777642ff-46bf-4a80-bd3d-da70a13b835a req-b1c7bee8-49cf-45af-a81a-8897ec95d8ad service nova] Creating event network-vif-deleted:599f2b0a-3a8e-4d35-8346-288e583d1943 for instance 5a21ad1c-8158-4cc5-b006-b4b848a65283 on nch2-master-1 Sep 24 21:40:53.732779 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-777642ff-46bf-4a80-bd3d-da70a13b835a req-b1c7bee8-49cf-45af-a81a-8897ec95d8ad service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038480 Sep 24 21:40:53.733391 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3239/6498] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:40:54.226892 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e0c8af78-b858-4a9a-9bfc-ca63032ffe3e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:54.227416 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e0c8af78-b858-4a9a-9bfc-ca63032ffe3e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 5a21ad1c-8158-4cc5-b006-b4b848a65283] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:54.233642 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e0c8af78-b858-4a9a-9bfc-ca63032ffe3e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:54.234141 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e0c8af78-b858-4a9a-9bfc-ca63032ffe3e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:54.234625 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e0c8af78-b858-4a9a-9bfc-ca63032ffe3e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:54.235363 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e0c8af78-b858-4a9a-9bfc-ca63032ffe3e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:54.235834 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e0c8af78-b858-4a9a-9bfc-ca63032ffe3e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:54.236278 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e0c8af78-b858-4a9a-9bfc-ca63032ffe3e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:54.249493 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-e0c8af78-b858-4a9a-9bfc-ca63032ffe3e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] HTTP exception thrown: Instance 5a21ad1c-8158-4cc5-b006-b4b848a65283 could not be found. Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e0c8af78-b858-4a9a-9bfc-ca63032ffe3e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Request method failure captured: Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 HTTP/1.1 Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3j9AV-5dpvdZV42Ra4BBnRHhz4ucAP3nUETTsL_XbtaGW03fx7PdSHOJqsIhhWaYp5Wckq8nM0McD5aYHm4feLog65VUR-ledxRnB_GbNA7DdzXb9Oe28EQ3bAvVNZv5KtzFkO1-SvBSf0Dk_SPkwg245V5yDFG8-r89M72zG8d1gQ Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 6a5a6205a2c74f07bda8d3bf7b5a5e6d Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1086898002 Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6a5a6205a2c74f07bda8d3bf7b5a5e6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6a5a6205a2c74f07bda8d3bf7b5a5e6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6a5a6205a2c74f07bda8d3bf7b5a5e6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6a5a6205a2c74f07bda8d3bf7b5a5e6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServerDiskConfigTestJSON-1086898002 Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 6a5a6205a2c74f07bda8d3bf7b5a5e6d Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1086898002 Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServerDiskConfigTestJSON-1086898002-project Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 45c51ff8103f42fa9d68a5492904b315 Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServerDiskConfigTestJSON-1086898002-project Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 5a21ad1c-8158-4cc5-b006-b4b848a65283 could not be found. Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '5a21ad1c-8158-4cc5-b006-b4b848a65283'} Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a21ad1c-8158-4cc5-b006-b4b848a65283 could not be found. Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a21ad1c-8158-4cc5-b006-b4b848a65283 could not be found. Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:40:54.251254 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:40:54.255847 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:40:54.255847 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:40:54.255847 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:40:54.255847 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:40:54.255847 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:40:54.255847 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a21ad1c-8158-4cc5-b006-b4b848a65283 could not be found. Sep 24 21:40:54.255847 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:40:54.255847 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e0c8af78-b858-4a9a-9bfc-ca63032ffe3e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Returning 404 to user: Instance 5a21ad1c-8158-4cc5-b006-b4b848a65283 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:40:54.255847 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e0c8af78-b858-4a9a-9bfc-ca63032ffe3e tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283" status: 404 len: 111 microversion: 2.1 time: 0.030031 Sep 24 21:40:54.255847 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3260/6499] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:54 2022] GET /compute/v2.1/servers/5a21ad1c-8158-4cc5-b006-b4b848a65283 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:40:54.262182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fe43a5f3-08bb-4101-b4a3-bf4b8562c21f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '.version_select at 0x7f4b0747e4c0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:54.282334 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fe43a5f3-08bb-4101-b4a3-bf4b8562c21f tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-429737360" status: 202 len: 0 microversion: 2.1 time: 0.024386 Sep 24 21:40:54.283570 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3240/6500] 10.222.0.52 () {58 vars in 1218 bytes} [Sat Sep 24 21:40:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-429737360 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:40:54.897127 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fb785023-3edd-42a6-ae30-e7fc726a8283 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:54.897644 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fb785023-3edd-42a6-ae30-e7fc726a8283 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:54.903697 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb785023-3edd-42a6-ae30-e7fc726a8283 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:54.904189 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb785023-3edd-42a6-ae30-e7fc726a8283 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:54.904634 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb785023-3edd-42a6-ae30-e7fc726a8283 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:54.905337 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb785023-3edd-42a6-ae30-e7fc726a8283 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:54.905800 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb785023-3edd-42a6-ae30-e7fc726a8283 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:54.906233 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fb785023-3edd-42a6-ae30-e7fc726a8283 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:54.919767 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-fb785023-3edd-42a6-ae30-e7fc726a8283 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] HTTP exception thrown: Instance 7d0c40cc-05ef-4838-9111-3e659de26d69 could not be found. Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fb785023-3edd-42a6-ae30-e7fc726a8283 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Request method failure captured: Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 HTTP/1.1 Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3j9AV-5dpvdZV42Ra4BBnRHhz4ucAP3nUETTsL_XbtaGW03fx7PdSHOJqsIhhWaYp5Wckq8nM0McD5aYHm4feLog65VUR-ledxRnB_GbNA7DdzXb9Oe28EQ3bAvVNZv5KtzFkO1-SvBSf0Dk_SPkwg245V5yDFG8-r89M72zG8d1gQ Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 6a5a6205a2c74f07bda8d3bf7b5a5e6d Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1086898002 Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6a5a6205a2c74f07bda8d3bf7b5a5e6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6a5a6205a2c74f07bda8d3bf7b5a5e6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6a5a6205a2c74f07bda8d3bf7b5a5e6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6a5a6205a2c74f07bda8d3bf7b5a5e6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServerDiskConfigTestJSON-1086898002 Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 6a5a6205a2c74f07bda8d3bf7b5a5e6d Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1086898002 Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServerDiskConfigTestJSON-1086898002-project Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 45c51ff8103f42fa9d68a5492904b315 Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServerDiskConfigTestJSON-1086898002-project Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 7d0c40cc-05ef-4838-9111-3e659de26d69 could not be found. Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '7d0c40cc-05ef-4838-9111-3e659de26d69'} Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d0c40cc-05ef-4838-9111-3e659de26d69 could not be found. Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:40:54.921319 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:40:54.925946 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d0c40cc-05ef-4838-9111-3e659de26d69 could not be found. Sep 24 21:40:54.925946 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:40:54.925946 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:40:54.925946 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:40:54.925946 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:40:54.925946 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:40:54.925946 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:40:54.925946 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:40:54.925946 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:40:54.925946 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d0c40cc-05ef-4838-9111-3e659de26d69 could not be found. Sep 24 21:40:54.925946 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:40:54.925946 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fb785023-3edd-42a6-ae30-e7fc726a8283 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Returning 404 to user: Instance 7d0c40cc-05ef-4838-9111-3e659de26d69 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:40:54.925946 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fb785023-3edd-42a6-ae30-e7fc726a8283 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 404 len: 111 microversion: 2.1 time: 0.030016 Sep 24 21:40:54.925946 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3261/6501] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:40:54 2022] DELETE /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:40:54.933110 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-73bbce30-842c-47a1-9d6c-4c09430027f1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:40:54.933854 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-73bbce30-842c-47a1-9d6c-4c09430027f1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] [instance: 7d0c40cc-05ef-4838-9111-3e659de26d69] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:40:54.941190 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-73bbce30-842c-47a1-9d6c-4c09430027f1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:54.941678 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-73bbce30-842c-47a1-9d6c-4c09430027f1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:54.942125 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-73bbce30-842c-47a1-9d6c-4c09430027f1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:54.942856 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-73bbce30-842c-47a1-9d6c-4c09430027f1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:40:54.943317 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-73bbce30-842c-47a1-9d6c-4c09430027f1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:40:54.943750 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-73bbce30-842c-47a1-9d6c-4c09430027f1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:40:54.957718 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-73bbce30-842c-47a1-9d6c-4c09430027f1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] HTTP exception thrown: Instance 7d0c40cc-05ef-4838-9111-3e659de26d69 could not be found. Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-73bbce30-842c-47a1-9d6c-4c09430027f1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Request method failure captured: Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 HTTP/1.1 Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3j9AV-5dpvdZV42Ra4BBnRHhz4ucAP3nUETTsL_XbtaGW03fx7PdSHOJqsIhhWaYp5Wckq8nM0McD5aYHm4feLog65VUR-ledxRnB_GbNA7DdzXb9Oe28EQ3bAvVNZv5KtzFkO1-SvBSf0Dk_SPkwg245V5yDFG8-r89M72zG8d1gQ Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 6a5a6205a2c74f07bda8d3bf7b5a5e6d Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1086898002 Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6a5a6205a2c74f07bda8d3bf7b5a5e6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6a5a6205a2c74f07bda8d3bf7b5a5e6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6a5a6205a2c74f07bda8d3bf7b5a5e6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6a5a6205a2c74f07bda8d3bf7b5a5e6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServerDiskConfigTestJSON-1086898002 Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 6a5a6205a2c74f07bda8d3bf7b5a5e6d Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1086898002 Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServerDiskConfigTestJSON-1086898002-project Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 45c51ff8103f42fa9d68a5492904b315 Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServerDiskConfigTestJSON-1086898002-project Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 7d0c40cc-05ef-4838-9111-3e659de26d69 could not be found. Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '7d0c40cc-05ef-4838-9111-3e659de26d69'} Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d0c40cc-05ef-4838-9111-3e659de26d69 could not be found. Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d0c40cc-05ef-4838-9111-3e659de26d69 could not be found. Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:40:54.959431 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:40:54.963862 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:40:54.963862 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:40:54.963862 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:40:54.963862 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:40:54.963862 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:40:54.963862 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d0c40cc-05ef-4838-9111-3e659de26d69 could not be found. Sep 24 21:40:54.963862 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:40:54.963862 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-73bbce30-842c-47a1-9d6c-4c09430027f1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] Returning 404 to user: Instance 7d0c40cc-05ef-4838-9111-3e659de26d69 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:40:54.963862 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-73bbce30-842c-47a1-9d6c-4c09430027f1 tempest-ServerDiskConfigTestJSON-1086898002 tempest-ServerDiskConfigTestJSON-1086898002-project] 10.222.0.52 "GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69" status: 404 len: 111 microversion: 2.1 time: 0.033420 Sep 24 21:40:54.963862 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3241/6502] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:40:54 2022] GET /compute/v2.1/servers/7d0c40cc-05ef-4838-9111-3e659de26d69 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:41:03.303686 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2ae79bf3-c9f5-4b6f-9a98-f90f2c44bc7a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Action: 'create', calling method: .version_select at 0x7f4b07bbaf70>, body: {"keypair": {"name": "tempest-keypair-743030895", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmPYVZt0quB+rEpiAo9FvyS+su5C6nC+PyVsHg/WWCjKMy/dJevwyGlUrhOrz8fTh6BPrbMsqVkdDoKGImoEKAVACZu5A3re3OW6A8XU84HLrviUIOMbNijWTgFGcf39A=="}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:41:03.325997 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-2ae79bf3-c9f5-4b6f-9a98-f90f2c44bc7a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Getting quotas for project f1f293bffcad4e568dccab47bfc498aa. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:41:03.338395 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-2ae79bf3-c9f5-4b6f-9a98-f90f2c44bc7a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Getting quotas for user f9bf67f92b7142298f15e941a80a07d6 and project f1f293bffcad4e568dccab47bfc498aa. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:41:03.374489 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2ae79bf3-c9f5-4b6f-9a98-f90f2c44bc7a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.228667 Sep 24 21:41:03.375158 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3262/6503] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 21:41:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:41:04.991844 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c4d212e7-8c8e-4b28-ad44-28ed3245e121 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1452738357", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "18903e01-4fbf-4876-9b99-27bd5d437a06"}], "security_groups": [{"name": "tempest-securitygroup--1672057739"}], "key_name": "tempest-keypair-743030895", "user_data": "}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:41:05.001988 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:41:05.002752 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:41:05.119784 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-c4d212e7-8c8e-4b28-ad44-28ed3245e121 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] validate_networks() for [('18903e01-4fbf-4876-9b99-27bd5d437a06', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:41:05.520531 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-c4d212e7-8c8e-4b28-ad44-28ed3245e121 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:41:05.521001 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-c4d212e7-8c8e-4b28-ad44-28ed3245e121 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:41:05.521486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-c4d212e7-8c8e-4b28-ad44-28ed3245e121 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:41:05.521897 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-c4d212e7-8c8e-4b28-ad44-28ed3245e121 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:41:05.522347 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-c4d212e7-8c8e-4b28-ad44-28ed3245e121 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:41:05.531392 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4d212e7-8c8e-4b28-ad44-28ed3245e121 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:05.531876 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4d212e7-8c8e-4b28-ad44-28ed3245e121 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:05.532316 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4d212e7-8c8e-4b28-ad44-28ed3245e121 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:05.533662 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4d212e7-8c8e-4b28-ad44-28ed3245e121 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:05.534220 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4d212e7-8c8e-4b28-ad44-28ed3245e121 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:05.534685 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c4d212e7-8c8e-4b28-ad44-28ed3245e121 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:05.552830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-c4d212e7-8c8e-4b28-ad44-28ed3245e121 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Getting quotas for project f1f293bffcad4e568dccab47bfc498aa. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:41:05.558361 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-c4d212e7-8c8e-4b28-ad44-28ed3245e121 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Getting quotas for user f9bf67f92b7142298f15e941a80a07d6 and project f1f293bffcad4e568dccab47bfc498aa. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:41:05.572359 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c4d212e7-8c8e-4b28-ad44-28ed3245e121 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:41:05.574710 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c4d212e7-8c8e-4b28-ad44-28ed3245e121 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:41:05.622570 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c4d212e7-8c8e-4b28-ad44-28ed3245e121 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.634699 Sep 24 21:41:05.623730 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3242/6504] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:41:04 2022] POST /compute/v2.1/servers => generated 409 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:41:05.635372 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c4a86a59-7f7b-4887-8776-e7c487040b27 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:41:05.636955 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c4a86a59-7f7b-4887-8776-e7c487040b27 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:41:05.640229 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:41:05.711836 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c4a86a59-7f7b-4887-8776-e7c487040b27 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:41:05.718994 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c4a86a59-7f7b-4887-8776-e7c487040b27 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1238 microversion: 2.1 time: 0.087773 Sep 24 21:41:05.719443 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3263/6505] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:41:05 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1238 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:41:06.749198 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9c0c25c0-a06d-47da-a101-54f8b6260fb8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:41:06.750914 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9c0c25c0-a06d-47da-a101-54f8b6260fb8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:41:06.760795 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c0c25c0-a06d-47da-a101-54f8b6260fb8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:06.761295 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c0c25c0-a06d-47da-a101-54f8b6260fb8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:06.761737 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c0c25c0-a06d-47da-a101-54f8b6260fb8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:06.763393 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c0c25c0-a06d-47da-a101-54f8b6260fb8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:06.764219 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c0c25c0-a06d-47da-a101-54f8b6260fb8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:06.764655 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9c0c25c0-a06d-47da-a101-54f8b6260fb8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:06.906719 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9c0c25c0-a06d-47da-a101-54f8b6260fb8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:41:06.927522 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9c0c25c0-a06d-47da-a101-54f8b6260fb8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1298 microversion: 2.1 time: 0.187628 Sep 24 21:41:06.943057 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3243/6506] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:41:06 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1298 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:41:07.951963 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ad14fb77-d9b5-453a-adc2-6195bf9c2cce tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:41:07.952600 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ad14fb77-d9b5-453a-adc2-6195bf9c2cce tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:41:07.960186 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ad14fb77-d9b5-453a-adc2-6195bf9c2cce tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:07.960694 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ad14fb77-d9b5-453a-adc2-6195bf9c2cce tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:07.961148 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ad14fb77-d9b5-453a-adc2-6195bf9c2cce tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:07.961876 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ad14fb77-d9b5-453a-adc2-6195bf9c2cce tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:07.962348 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ad14fb77-d9b5-453a-adc2-6195bf9c2cce tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:07.962817 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ad14fb77-d9b5-453a-adc2-6195bf9c2cce tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:08.239906 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ad14fb77-d9b5-453a-adc2-6195bf9c2cce tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:41:08.248157 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ad14fb77-d9b5-453a-adc2-6195bf9c2cce tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1364 microversion: 2.1 time: 0.300226 Sep 24 21:41:08.248734 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3264/6507] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:41:07 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1364 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:41:08.758345 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-9ddf2f96-0503-443d-9acd-8e56ce28de96 req-77e3f650-c3e7-4e15-a99c-5776d1e5ffab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe51dbd9-3aed-4d75-8aa8-77906a07cefe", "tag": "90688d0c-b0f2-4899-beb0-9c213174b394"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:41:08.770246 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-9ddf2f96-0503-443d-9acd-8e56ce28de96 req-77e3f650-c3e7-4e15-a99c-5776d1e5ffab service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:08.770862 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-9ddf2f96-0503-443d-9acd-8e56ce28de96 req-77e3f650-c3e7-4e15-a99c-5776d1e5ffab service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:08.771397 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-9ddf2f96-0503-443d-9acd-8e56ce28de96 req-77e3f650-c3e7-4e15-a99c-5776d1e5ffab service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:08.786438 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-9ddf2f96-0503-443d-9acd-8e56ce28de96 req-77e3f650-c3e7-4e15-a99c-5776d1e5ffab service nova] Creating event network-changed:90688d0c-b0f2-4899-beb0-9c213174b394 for instance fe51dbd9-3aed-4d75-8aa8-77906a07cefe on nch2-master-1 Sep 24 21:41:08.792151 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-9ddf2f96-0503-443d-9acd-8e56ce28de96 req-77e3f650-c3e7-4e15-a99c-5776d1e5ffab service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037638 Sep 24 21:41:08.793170 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3244/6508] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:41:09.272731 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-007ed86e-41e6-471e-9056-cfd41aec1ffb tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:41:09.273361 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-007ed86e-41e6-471e-9056-cfd41aec1ffb tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:41:09.280349 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-007ed86e-41e6-471e-9056-cfd41aec1ffb tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:09.280845 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-007ed86e-41e6-471e-9056-cfd41aec1ffb tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:09.281298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-007ed86e-41e6-471e-9056-cfd41aec1ffb tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:09.282011 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-007ed86e-41e6-471e-9056-cfd41aec1ffb tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:09.282566 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-007ed86e-41e6-471e-9056-cfd41aec1ffb tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:09.283027 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-007ed86e-41e6-471e-9056-cfd41aec1ffb tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:09.419257 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-007ed86e-41e6-471e-9056-cfd41aec1ffb tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:41:09.427874 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-007ed86e-41e6-471e-9056-cfd41aec1ffb tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1364 microversion: 2.1 time: 0.159367 Sep 24 21:41:09.428455 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3265/6509] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:41:09 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:41:10.452986 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cb4c2431-bdd2-43b4-aed7-4708da2cb4dd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:41:10.453769 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cb4c2431-bdd2-43b4-aed7-4708da2cb4dd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:41:10.460829 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb4c2431-bdd2-43b4-aed7-4708da2cb4dd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:10.461327 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb4c2431-bdd2-43b4-aed7-4708da2cb4dd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:10.461796 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb4c2431-bdd2-43b4-aed7-4708da2cb4dd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:10.462520 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb4c2431-bdd2-43b4-aed7-4708da2cb4dd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:10.462990 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb4c2431-bdd2-43b4-aed7-4708da2cb4dd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:10.463449 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb4c2431-bdd2-43b4-aed7-4708da2cb4dd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:10.599603 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cb4c2431-bdd2-43b4-aed7-4708da2cb4dd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:41:10.607378 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cb4c2431-bdd2-43b4-aed7-4708da2cb4dd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1364 microversion: 2.1 time: 0.159679 Sep 24 21:41:10.607950 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3245/6510] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:41:10 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:41:11.631722 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-107c1e15-077d-4063-a865-9f94a29a0e15 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:41:11.632499 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-107c1e15-077d-4063-a865-9f94a29a0e15 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:41:11.639503 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-107c1e15-077d-4063-a865-9f94a29a0e15 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:11.640000 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-107c1e15-077d-4063-a865-9f94a29a0e15 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:11.640448 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-107c1e15-077d-4063-a865-9f94a29a0e15 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:11.641161 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-107c1e15-077d-4063-a865-9f94a29a0e15 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:11.641628 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-107c1e15-077d-4063-a865-9f94a29a0e15 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:11.643065 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-107c1e15-077d-4063-a865-9f94a29a0e15 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:11.775284 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-107c1e15-077d-4063-a865-9f94a29a0e15 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:41:11.783890 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-107c1e15-077d-4063-a865-9f94a29a0e15 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1364 microversion: 2.1 time: 0.156415 Sep 24 21:41:11.784472 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3266/6511] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:41:11 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:41:12.806624 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-27e7f005-4237-459d-abaa-16338fd7e0be tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:41:12.807244 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-27e7f005-4237-459d-abaa-16338fd7e0be tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:41:12.814385 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27e7f005-4237-459d-abaa-16338fd7e0be tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:12.814938 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27e7f005-4237-459d-abaa-16338fd7e0be tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:12.815389 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27e7f005-4237-459d-abaa-16338fd7e0be tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:12.816093 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27e7f005-4237-459d-abaa-16338fd7e0be tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:12.816555 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27e7f005-4237-459d-abaa-16338fd7e0be tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:12.816990 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27e7f005-4237-459d-abaa-16338fd7e0be tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:12.953759 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-27e7f005-4237-459d-abaa-16338fd7e0be tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:41:12.962341 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-27e7f005-4237-459d-abaa-16338fd7e0be tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1364 microversion: 2.1 time: 0.159702 Sep 24 21:41:12.962944 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3246/6512] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:41:12 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:41:13.286813 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-6d4d4602-ab6a-46e8-9faa-06ea2c554e11 req-ee5fba5a-eb15-461e-a812-8f6893e3984c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe51dbd9-3aed-4d75-8aa8-77906a07cefe", "name": "network-vif-plugged", "status": "completed", "tag": "90688d0c-b0f2-4899-beb0-9c213174b394"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:41:13.299135 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6d4d4602-ab6a-46e8-9faa-06ea2c554e11 req-ee5fba5a-eb15-461e-a812-8f6893e3984c service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:13.300246 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6d4d4602-ab6a-46e8-9faa-06ea2c554e11 req-ee5fba5a-eb15-461e-a812-8f6893e3984c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:13.300701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6d4d4602-ab6a-46e8-9faa-06ea2c554e11 req-ee5fba5a-eb15-461e-a812-8f6893e3984c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:13.312343 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-6d4d4602-ab6a-46e8-9faa-06ea2c554e11 req-ee5fba5a-eb15-461e-a812-8f6893e3984c service nova] Creating event network-vif-plugged:90688d0c-b0f2-4899-beb0-9c213174b394 for instance fe51dbd9-3aed-4d75-8aa8-77906a07cefe on nch2-master-1 Sep 24 21:41:13.318422 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-6d4d4602-ab6a-46e8-9faa-06ea2c554e11 req-ee5fba5a-eb15-461e-a812-8f6893e3984c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035622 Sep 24 21:41:13.319083 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3267/6513] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:41:13.985252 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e22f1d1d-5e7a-48c2-9dfe-d0ded8d78c8c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:41:13.986681 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e22f1d1d-5e7a-48c2-9dfe-d0ded8d78c8c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:41:13.993522 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e22f1d1d-5e7a-48c2-9dfe-d0ded8d78c8c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:13.994005 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e22f1d1d-5e7a-48c2-9dfe-d0ded8d78c8c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:13.994447 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e22f1d1d-5e7a-48c2-9dfe-d0ded8d78c8c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:13.995165 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e22f1d1d-5e7a-48c2-9dfe-d0ded8d78c8c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:13.995624 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e22f1d1d-5e7a-48c2-9dfe-d0ded8d78c8c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:13.996052 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e22f1d1d-5e7a-48c2-9dfe-d0ded8d78c8c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:14.130791 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e22f1d1d-5e7a-48c2-9dfe-d0ded8d78c8c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:41:14.138552 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e22f1d1d-5e7a-48c2-9dfe-d0ded8d78c8c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1364 microversion: 2.1 time: 0.157260 Sep 24 21:41:14.139126 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3247/6514] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:41:13 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:41:15.162630 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-71079145-4776-4c57-884c-e4030058fde0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:41:15.163355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-71079145-4776-4c57-884c-e4030058fde0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:41:15.170572 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71079145-4776-4c57-884c-e4030058fde0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:15.171076 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71079145-4776-4c57-884c-e4030058fde0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:15.171527 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71079145-4776-4c57-884c-e4030058fde0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:15.172239 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71079145-4776-4c57-884c-e4030058fde0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:15.172726 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71079145-4776-4c57-884c-e4030058fde0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:15.173893 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71079145-4776-4c57-884c-e4030058fde0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:15.304792 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-71079145-4776-4c57-884c-e4030058fde0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:41:15.312649 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-71079145-4776-4c57-884c-e4030058fde0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1551 microversion: 2.1 time: 0.155090 Sep 24 21:41:15.313245 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3268/6515] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:41:15 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1551 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:41:15.336555 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1519a610-ab50-4f66-aa93-6bb7416bb385 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:41:15.337069 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1519a610-ab50-4f66-aa93-6bb7416bb385 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:41:15.344027 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1519a610-ab50-4f66-aa93-6bb7416bb385 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:15.344519 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1519a610-ab50-4f66-aa93-6bb7416bb385 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:15.345607 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1519a610-ab50-4f66-aa93-6bb7416bb385 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:15.346392 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1519a610-ab50-4f66-aa93-6bb7416bb385 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:15.346883 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1519a610-ab50-4f66-aa93-6bb7416bb385 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:15.347322 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1519a610-ab50-4f66-aa93-6bb7416bb385 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:15.426396 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1519a610-ab50-4f66-aa93-6bb7416bb385 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093701 Sep 24 21:41:15.427050 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3248/6516] 10.222.0.52 () {58 vars in 1275 bytes} [Sat Sep 24 21:41:15 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:41:16.359541 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-758b20bf-a542-4b20-9e37-6fd34ef5aa66 req-a086d1a7-448d-4cdb-9d68-7a832d1a8625 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe51dbd9-3aed-4d75-8aa8-77906a07cefe", "tag": "90688d0c-b0f2-4899-beb0-9c213174b394"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:41:16.365355 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=6 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:41:16.372178 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-758b20bf-a542-4b20-9e37-6fd34ef5aa66 req-a086d1a7-448d-4cdb-9d68-7a832d1a8625 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:16.373023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-758b20bf-a542-4b20-9e37-6fd34ef5aa66 req-a086d1a7-448d-4cdb-9d68-7a832d1a8625 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:16.373562 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-758b20bf-a542-4b20-9e37-6fd34ef5aa66 req-a086d1a7-448d-4cdb-9d68-7a832d1a8625 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:16.386270 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-758b20bf-a542-4b20-9e37-6fd34ef5aa66 req-a086d1a7-448d-4cdb-9d68-7a832d1a8625 service nova] Creating event network-changed:90688d0c-b0f2-4899-beb0-9c213174b394 for instance fe51dbd9-3aed-4d75-8aa8-77906a07cefe on nch2-master-1 Sep 24 21:41:16.392014 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-758b20bf-a542-4b20-9e37-6fd34ef5aa66 req-a086d1a7-448d-4cdb-9d68-7a832d1a8625 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036116 Sep 24 21:41:16.392808 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3269/6517] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:41:51.220203 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:41:51.221014 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:41:51.223571 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:41:51.224831 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=32 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:41:51.229477 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-45fd1e2e-cce9-4015-9343-3052aa14276d tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:41:51.230098 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-45fd1e2e-cce9-4015-9343-3052aa14276d tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:41:51.238401 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45fd1e2e-cce9-4015-9343-3052aa14276d tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:51.238924 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45fd1e2e-cce9-4015-9343-3052aa14276d tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:51.239395 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45fd1e2e-cce9-4015-9343-3052aa14276d tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:51.240410 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45fd1e2e-cce9-4015-9343-3052aa14276d tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:51.240878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45fd1e2e-cce9-4015-9343-3052aa14276d tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:51.241319 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-45fd1e2e-cce9-4015-9343-3052aa14276d tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:51.371721 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-45fd1e2e-cce9-4015-9343-3052aa14276d tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:41:51.379568 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-45fd1e2e-cce9-4015-9343-3052aa14276d tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1670 microversion: 2.1 time: 0.160276 Sep 24 21:41:51.380174 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3249/6518] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:41:51 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:41:51.401537 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:41:51.402339 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=28 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:41:51.407096 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-88cf63be-f9e9-4b1e-8166-b1d5036a31ec tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:41:51.407806 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-88cf63be-f9e9-4b1e-8166-b1d5036a31ec tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:41:51.416401 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-88cf63be-f9e9-4b1e-8166-b1d5036a31ec tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:51.416889 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-88cf63be-f9e9-4b1e-8166-b1d5036a31ec tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:51.417334 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-88cf63be-f9e9-4b1e-8166-b1d5036a31ec tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:51.418040 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-88cf63be-f9e9-4b1e-8166-b1d5036a31ec tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:51.418531 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-88cf63be-f9e9-4b1e-8166-b1d5036a31ec tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:51.418957 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-88cf63be-f9e9-4b1e-8166-b1d5036a31ec tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:51.555327 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-88cf63be-f9e9-4b1e-8166-b1d5036a31ec tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:41:51.563074 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-88cf63be-f9e9-4b1e-8166-b1d5036a31ec tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1670 microversion: 2.1 time: 0.164042 Sep 24 21:41:51.563650 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3270/6519] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:41:51 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1670 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:41:51.588189 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-75afcb8a-e317-4274-920d-3681ac8184c1 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:41:51.588816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-75afcb8a-e317-4274-920d-3681ac8184c1 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:41:51.594834 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-75afcb8a-e317-4274-920d-3681ac8184c1 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:51.595329 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-75afcb8a-e317-4274-920d-3681ac8184c1 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:51.595776 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-75afcb8a-e317-4274-920d-3681ac8184c1 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:51.596485 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-75afcb8a-e317-4274-920d-3681ac8184c1 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:51.596948 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-75afcb8a-e317-4274-920d-3681ac8184c1 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:51.597383 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-75afcb8a-e317-4274-920d-3681ac8184c1 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:51.729547 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-75afcb8a-e317-4274-920d-3681ac8184c1 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:41:51.737668 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-75afcb8a-e317-4274-920d-3681ac8184c1 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1670 microversion: 2.1 time: 0.153443 Sep 24 21:41:51.738247 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3250/6520] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:41:51 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:41:51.760441 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-489e8b58-cdf0-4458-90d6-3bf32c74cbde tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:41:51.762790 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-489e8b58-cdf0-4458-90d6-3bf32c74cbde tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:41:51.768819 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-489e8b58-cdf0-4458-90d6-3bf32c74cbde tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:51.769308 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-489e8b58-cdf0-4458-90d6-3bf32c74cbde tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:51.769753 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-489e8b58-cdf0-4458-90d6-3bf32c74cbde tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:51.770485 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-489e8b58-cdf0-4458-90d6-3bf32c74cbde tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:51.771643 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-489e8b58-cdf0-4458-90d6-3bf32c74cbde tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:51.772080 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-489e8b58-cdf0-4458-90d6-3bf32c74cbde tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:51.800218 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-489e8b58-cdf0-4458-90d6-3bf32c74cbde tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:41:51.805514 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-489e8b58-cdf0-4458-90d6-3bf32c74cbde tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Old instance type m1.heat2, new instance type m1.heat {{(pid=140517) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 24 21:41:51.812318 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-489e8b58-cdf0-4458-90d6-3bf32c74cbde tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:41:51.812746 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-489e8b58-cdf0-4458-90d6-3bf32c74cbde tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:41:51.813231 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-489e8b58-cdf0-4458-90d6-3bf32c74cbde tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:41:51.813650 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-489e8b58-cdf0-4458-90d6-3bf32c74cbde tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:41:51.814075 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-489e8b58-cdf0-4458-90d6-3bf32c74cbde tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:41:51.878814 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-489e8b58-cdf0-4458-90d6-3bf32c74cbde tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "POST /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe/action" status: 202 len: 0 microversion: 2.1 time: 0.121915 Sep 24 21:41:51.879343 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3271/6521] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:41:51 2022] POST /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:41:51.888209 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9684635e-8da6-4c1d-9455-971bbd7dad98 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:41:51.888837 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9684635e-8da6-4c1d-9455-971bbd7dad98 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:41:51.895147 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9684635e-8da6-4c1d-9455-971bbd7dad98 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:51.895690 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9684635e-8da6-4c1d-9455-971bbd7dad98 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:51.896137 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9684635e-8da6-4c1d-9455-971bbd7dad98 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:51.896851 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9684635e-8da6-4c1d-9455-971bbd7dad98 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:51.897316 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9684635e-8da6-4c1d-9455-971bbd7dad98 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:51.897753 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9684635e-8da6-4c1d-9455-971bbd7dad98 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:52.060440 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9684635e-8da6-4c1d-9455-971bbd7dad98 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:41:52.069451 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9684635e-8da6-4c1d-9455-971bbd7dad98 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1679 microversion: 2.1 time: 0.185270 Sep 24 21:41:52.070056 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3251/6522] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:41:51 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1679 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:41:53.092557 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c319dd27-00ea-4824-bc04-fdf234cb5ab8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:41:53.093168 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c319dd27-00ea-4824-bc04-fdf234cb5ab8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:41:53.101163 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c319dd27-00ea-4824-bc04-fdf234cb5ab8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:53.101653 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c319dd27-00ea-4824-bc04-fdf234cb5ab8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:53.102099 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c319dd27-00ea-4824-bc04-fdf234cb5ab8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:53.102830 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c319dd27-00ea-4824-bc04-fdf234cb5ab8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:53.103312 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c319dd27-00ea-4824-bc04-fdf234cb5ab8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:53.103732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c319dd27-00ea-4824-bc04-fdf234cb5ab8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:53.336278 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c319dd27-00ea-4824-bc04-fdf234cb5ab8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:41:53.343985 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c319dd27-00ea-4824-bc04-fdf234cb5ab8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1679 microversion: 2.1 time: 0.255392 Sep 24 21:41:53.344556 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3272/6523] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:41:53 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1679 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:41:54.368024 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cb7bc699-f1e8-46eb-987c-abd2d4190551 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:41:54.368683 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cb7bc699-f1e8-46eb-987c-abd2d4190551 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:41:54.375607 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb7bc699-f1e8-46eb-987c-abd2d4190551 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:54.376102 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb7bc699-f1e8-46eb-987c-abd2d4190551 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:54.376550 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb7bc699-f1e8-46eb-987c-abd2d4190551 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:54.377255 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb7bc699-f1e8-46eb-987c-abd2d4190551 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:54.377722 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb7bc699-f1e8-46eb-987c-abd2d4190551 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:54.378159 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cb7bc699-f1e8-46eb-987c-abd2d4190551 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:54.512208 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cb7bc699-f1e8-46eb-987c-abd2d4190551 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:41:54.520064 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cb7bc699-f1e8-46eb-987c-abd2d4190551 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1684 microversion: 2.1 time: 0.156673 Sep 24 21:41:54.521250 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3252/6524] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:41:54 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:41:55.545041 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-366fb6e0-059f-4465-9889-11ba70836a39 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:41:55.545657 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-366fb6e0-059f-4465-9889-11ba70836a39 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:41:55.552582 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-366fb6e0-059f-4465-9889-11ba70836a39 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:55.553070 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-366fb6e0-059f-4465-9889-11ba70836a39 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:55.553515 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-366fb6e0-059f-4465-9889-11ba70836a39 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:55.554212 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-366fb6e0-059f-4465-9889-11ba70836a39 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:55.554710 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-366fb6e0-059f-4465-9889-11ba70836a39 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:55.555140 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-366fb6e0-059f-4465-9889-11ba70836a39 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:55.686536 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-366fb6e0-059f-4465-9889-11ba70836a39 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:41:55.694583 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-366fb6e0-059f-4465-9889-11ba70836a39 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1684 microversion: 2.1 time: 0.153606 Sep 24 21:41:55.695167 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3273/6525] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:41:55 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:41:56.717855 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6b8ac6b5-ba8b-4081-a5b3-3090616f09cb tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:41:56.718470 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6b8ac6b5-ba8b-4081-a5b3-3090616f09cb tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:41:56.725100 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b8ac6b5-ba8b-4081-a5b3-3090616f09cb tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:56.725583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b8ac6b5-ba8b-4081-a5b3-3090616f09cb tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:56.726023 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b8ac6b5-ba8b-4081-a5b3-3090616f09cb tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:56.726750 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b8ac6b5-ba8b-4081-a5b3-3090616f09cb tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:56.727209 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b8ac6b5-ba8b-4081-a5b3-3090616f09cb tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:56.727634 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b8ac6b5-ba8b-4081-a5b3-3090616f09cb tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:56.861387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6b8ac6b5-ba8b-4081-a5b3-3090616f09cb tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:41:56.869783 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6b8ac6b5-ba8b-4081-a5b3-3090616f09cb tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1684 microversion: 2.1 time: 0.155978 Sep 24 21:41:56.870358 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3253/6526] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:41:56 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:41:57.894378 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b58c458c-fe71-46a0-814a-c600ffb04589 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:41:57.894959 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b58c458c-fe71-46a0-814a-c600ffb04589 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:41:57.902467 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b58c458c-fe71-46a0-814a-c600ffb04589 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:57.903000 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b58c458c-fe71-46a0-814a-c600ffb04589 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:57.903456 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b58c458c-fe71-46a0-814a-c600ffb04589 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:57.904174 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b58c458c-fe71-46a0-814a-c600ffb04589 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:57.904647 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b58c458c-fe71-46a0-814a-c600ffb04589 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:57.905087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b58c458c-fe71-46a0-814a-c600ffb04589 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:58.037725 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b58c458c-fe71-46a0-814a-c600ffb04589 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:41:58.045641 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b58c458c-fe71-46a0-814a-c600ffb04589 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1684 microversion: 2.1 time: 0.155283 Sep 24 21:41:58.046223 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3274/6527] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:41:57 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:41:59.069180 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c1da2626-0f1e-4a95-a298-5298f75e20b2 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:41:59.069796 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c1da2626-0f1e-4a95-a298-5298f75e20b2 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:41:59.076763 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c1da2626-0f1e-4a95-a298-5298f75e20b2 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:59.077249 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c1da2626-0f1e-4a95-a298-5298f75e20b2 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:59.077687 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c1da2626-0f1e-4a95-a298-5298f75e20b2 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:59.078383 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c1da2626-0f1e-4a95-a298-5298f75e20b2 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:41:59.078869 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c1da2626-0f1e-4a95-a298-5298f75e20b2 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:41:59.079300 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c1da2626-0f1e-4a95-a298-5298f75e20b2 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:41:59.212182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c1da2626-0f1e-4a95-a298-5298f75e20b2 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:41:59.219975 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c1da2626-0f1e-4a95-a298-5298f75e20b2 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1684 microversion: 2.1 time: 0.154867 Sep 24 21:41:59.220538 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3254/6528] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:41:59 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:42:00.243583 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0d95e206-5121-4f15-a349-9ee89e7eca05 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:42:00.244207 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0d95e206-5121-4f15-a349-9ee89e7eca05 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:42:00.251038 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d95e206-5121-4f15-a349-9ee89e7eca05 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:00.251534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d95e206-5121-4f15-a349-9ee89e7eca05 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:00.251981 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d95e206-5121-4f15-a349-9ee89e7eca05 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:00.252692 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d95e206-5121-4f15-a349-9ee89e7eca05 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:00.253156 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d95e206-5121-4f15-a349-9ee89e7eca05 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:00.253593 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d95e206-5121-4f15-a349-9ee89e7eca05 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:00.383084 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0d95e206-5121-4f15-a349-9ee89e7eca05 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:42:00.390904 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0d95e206-5121-4f15-a349-9ee89e7eca05 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1684 microversion: 2.1 time: 0.151416 Sep 24 21:42:00.391499 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3275/6529] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:42:00 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:42:01.415855 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4d1c7f62-e281-4955-9394-71963bb56ec6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:42:01.416477 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4d1c7f62-e281-4955-9394-71963bb56ec6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:42:01.423612 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4d1c7f62-e281-4955-9394-71963bb56ec6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:01.424108 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4d1c7f62-e281-4955-9394-71963bb56ec6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:01.424555 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4d1c7f62-e281-4955-9394-71963bb56ec6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:01.425525 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4d1c7f62-e281-4955-9394-71963bb56ec6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:01.425991 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4d1c7f62-e281-4955-9394-71963bb56ec6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:01.426422 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4d1c7f62-e281-4955-9394-71963bb56ec6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:01.554949 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4d1c7f62-e281-4955-9394-71963bb56ec6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:42:01.562783 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4d1c7f62-e281-4955-9394-71963bb56ec6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1684 microversion: 2.1 time: 0.151827 Sep 24 21:42:01.563352 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3255/6530] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:42:01 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:42:02.585215 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-85893ca0-a5ad-45e9-9ec1-4a014f9c1585 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:42:02.585848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-85893ca0-a5ad-45e9-9ec1-4a014f9c1585 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:42:02.592932 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85893ca0-a5ad-45e9-9ec1-4a014f9c1585 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:02.593432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85893ca0-a5ad-45e9-9ec1-4a014f9c1585 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:02.593888 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85893ca0-a5ad-45e9-9ec1-4a014f9c1585 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:02.594623 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85893ca0-a5ad-45e9-9ec1-4a014f9c1585 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:02.595099 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85893ca0-a5ad-45e9-9ec1-4a014f9c1585 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:02.595543 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-85893ca0-a5ad-45e9-9ec1-4a014f9c1585 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:02.729359 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-85893ca0-a5ad-45e9-9ec1-4a014f9c1585 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:42:02.737253 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-85893ca0-a5ad-45e9-9ec1-4a014f9c1585 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1684 microversion: 2.1 time: 0.155962 Sep 24 21:42:02.737840 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3276/6531] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:42:02 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:42:03.761684 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7cd1615d-24ab-42f3-966b-66223cadbf9f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:42:03.762300 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7cd1615d-24ab-42f3-966b-66223cadbf9f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:42:03.769193 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7cd1615d-24ab-42f3-966b-66223cadbf9f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:03.769680 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7cd1615d-24ab-42f3-966b-66223cadbf9f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:03.770119 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7cd1615d-24ab-42f3-966b-66223cadbf9f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:03.770849 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7cd1615d-24ab-42f3-966b-66223cadbf9f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:03.771312 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7cd1615d-24ab-42f3-966b-66223cadbf9f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:03.771789 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7cd1615d-24ab-42f3-966b-66223cadbf9f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:03.900707 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7cd1615d-24ab-42f3-966b-66223cadbf9f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:42:03.908643 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7cd1615d-24ab-42f3-966b-66223cadbf9f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1684 microversion: 2.1 time: 0.151125 Sep 24 21:42:03.909235 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3256/6532] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:42:03 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:42:04.932254 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-786bf5cc-4eee-443a-ba24-d4d424c7fd33 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:42:04.932802 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-786bf5cc-4eee-443a-ba24-d4d424c7fd33 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:42:04.939849 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-786bf5cc-4eee-443a-ba24-d4d424c7fd33 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:04.940343 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-786bf5cc-4eee-443a-ba24-d4d424c7fd33 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:04.940791 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-786bf5cc-4eee-443a-ba24-d4d424c7fd33 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:04.941500 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-786bf5cc-4eee-443a-ba24-d4d424c7fd33 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:04.941966 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-786bf5cc-4eee-443a-ba24-d4d424c7fd33 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:04.942407 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-786bf5cc-4eee-443a-ba24-d4d424c7fd33 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:05.077471 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-786bf5cc-4eee-443a-ba24-d4d424c7fd33 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:42:05.085571 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-786bf5cc-4eee-443a-ba24-d4d424c7fd33 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1684 microversion: 2.1 time: 0.157362 Sep 24 21:42:05.086138 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3277/6533] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:42:04 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:42:06.109283 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1799513b-decb-45f9-b710-c1fde2b851c2 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:42:06.109911 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1799513b-decb-45f9-b710-c1fde2b851c2 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:42:06.117159 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1799513b-decb-45f9-b710-c1fde2b851c2 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:06.117653 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1799513b-decb-45f9-b710-c1fde2b851c2 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:06.118101 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1799513b-decb-45f9-b710-c1fde2b851c2 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:06.118842 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1799513b-decb-45f9-b710-c1fde2b851c2 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:06.119306 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1799513b-decb-45f9-b710-c1fde2b851c2 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:06.119743 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1799513b-decb-45f9-b710-c1fde2b851c2 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:06.250907 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1799513b-decb-45f9-b710-c1fde2b851c2 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:42:06.259584 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1799513b-decb-45f9-b710-c1fde2b851c2 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1684 microversion: 2.1 time: 0.154222 Sep 24 21:42:06.260160 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3257/6534] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:42:06 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:42:07.283332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2a8d8481-be3a-4dcf-898d-b74d96dfc96a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:42:07.283963 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2a8d8481-be3a-4dcf-898d-b74d96dfc96a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:42:07.291722 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a8d8481-be3a-4dcf-898d-b74d96dfc96a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:07.292225 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a8d8481-be3a-4dcf-898d-b74d96dfc96a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:07.292727 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a8d8481-be3a-4dcf-898d-b74d96dfc96a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:07.293425 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a8d8481-be3a-4dcf-898d-b74d96dfc96a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:07.293894 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a8d8481-be3a-4dcf-898d-b74d96dfc96a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:07.294364 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2a8d8481-be3a-4dcf-898d-b74d96dfc96a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:07.422435 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2a8d8481-be3a-4dcf-898d-b74d96dfc96a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:42:07.430826 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2a8d8481-be3a-4dcf-898d-b74d96dfc96a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1684 microversion: 2.1 time: 0.151503 Sep 24 21:42:07.431399 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3278/6535] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:42:07 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:42:08.454396 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fb99597f-79c8-4a6a-809d-a755f2e6ea20 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:42:08.455066 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fb99597f-79c8-4a6a-809d-a755f2e6ea20 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:42:08.462771 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb99597f-79c8-4a6a-809d-a755f2e6ea20 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:08.463271 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb99597f-79c8-4a6a-809d-a755f2e6ea20 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:08.463715 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb99597f-79c8-4a6a-809d-a755f2e6ea20 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:08.464426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb99597f-79c8-4a6a-809d-a755f2e6ea20 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:08.464890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb99597f-79c8-4a6a-809d-a755f2e6ea20 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:08.465327 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb99597f-79c8-4a6a-809d-a755f2e6ea20 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:08.932500 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fb99597f-79c8-4a6a-809d-a755f2e6ea20 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:42:08.940299 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fb99597f-79c8-4a6a-809d-a755f2e6ea20 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1684 microversion: 2.1 time: 0.489866 Sep 24 21:42:08.940878 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3258/6536] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:42:08 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1684 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:42:09.964780 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a2bd4109-fd64-4c15-93a7-64996d984d87 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:42:09.965346 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a2bd4109-fd64-4c15-93a7-64996d984d87 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:42:09.972241 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a2bd4109-fd64-4c15-93a7-64996d984d87 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:09.972740 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a2bd4109-fd64-4c15-93a7-64996d984d87 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:09.973189 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a2bd4109-fd64-4c15-93a7-64996d984d87 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:09.973901 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a2bd4109-fd64-4c15-93a7-64996d984d87 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:09.974375 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a2bd4109-fd64-4c15-93a7-64996d984d87 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:09.974850 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a2bd4109-fd64-4c15-93a7-64996d984d87 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:10.104748 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a2bd4109-fd64-4c15-93a7-64996d984d87 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:42:10.112661 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a2bd4109-fd64-4c15-93a7-64996d984d87 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1684 microversion: 2.1 time: 0.152005 Sep 24 21:42:10.113237 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3279/6537] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:42:09 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:42:11.135821 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b7dedc75-3df7-4474-b3cf-127a1456c463 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:42:11.136467 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b7dedc75-3df7-4474-b3cf-127a1456c463 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:42:11.143428 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7dedc75-3df7-4474-b3cf-127a1456c463 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:11.143860 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7dedc75-3df7-4474-b3cf-127a1456c463 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:11.144307 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7dedc75-3df7-4474-b3cf-127a1456c463 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:11.145021 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7dedc75-3df7-4474-b3cf-127a1456c463 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:11.145487 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7dedc75-3df7-4474-b3cf-127a1456c463 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:11.145921 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7dedc75-3df7-4474-b3cf-127a1456c463 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:11.301123 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-a285f9b5-3bab-4f09-9e12-1360035411ab req-f96f3b0a-0ddd-4985-a800-63537c05a7f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe51dbd9-3aed-4d75-8aa8-77906a07cefe", "name": "network-vif-unplugged", "status": "completed", "tag": "90688d0c-b0f2-4899-beb0-9c213174b394"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:42:11.311547 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-a285f9b5-3bab-4f09-9e12-1360035411ab req-f96f3b0a-0ddd-4985-a800-63537c05a7f2 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:11.312035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-a285f9b5-3bab-4f09-9e12-1360035411ab req-f96f3b0a-0ddd-4985-a800-63537c05a7f2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:11.312478 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-a285f9b5-3bab-4f09-9e12-1360035411ab req-f96f3b0a-0ddd-4985-a800-63537c05a7f2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:11.325783 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-a285f9b5-3bab-4f09-9e12-1360035411ab req-f96f3b0a-0ddd-4985-a800-63537c05a7f2 service nova] Creating event network-vif-unplugged:90688d0c-b0f2-4899-beb0-9c213174b394 for instance fe51dbd9-3aed-4d75-8aa8-77906a07cefe on nch1-master-1 Sep 24 21:42:11.331527 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [req-a285f9b5-3bab-4f09-9e12-1360035411ab req-f96f3b0a-0ddd-4985-a800-63537c05a7f2 service nova] Instance fe51dbd9-3aed-4d75-8aa8-77906a07cefe is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 21:42:11.344147 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b7dedc75-3df7-4474-b3cf-127a1456c463 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:42:11.344700 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-a285f9b5-3bab-4f09-9e12-1360035411ab req-f96f3b0a-0ddd-4985-a800-63537c05a7f2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047902 Sep 24 21:42:11.345514 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3280/6538] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:42:11.353591 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b7dedc75-3df7-4474-b3cf-127a1456c463 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1683 microversion: 2.1 time: 0.221662 Sep 24 21:42:11.354269 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3259/6539] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:42:11 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1683 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:42:12.378809 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-69e4fc24-106a-4bd5-9129-3e1b8ce6484c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:42:12.379689 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-69e4fc24-106a-4bd5-9129-3e1b8ce6484c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:42:12.387095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69e4fc24-106a-4bd5-9129-3e1b8ce6484c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:12.387587 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69e4fc24-106a-4bd5-9129-3e1b8ce6484c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:12.388026 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69e4fc24-106a-4bd5-9129-3e1b8ce6484c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:12.388813 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69e4fc24-106a-4bd5-9129-3e1b8ce6484c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:12.389397 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69e4fc24-106a-4bd5-9129-3e1b8ce6484c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:12.389840 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69e4fc24-106a-4bd5-9129-3e1b8ce6484c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:12.537586 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-69e4fc24-106a-4bd5-9129-3e1b8ce6484c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:42:12.546442 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-69e4fc24-106a-4bd5-9129-3e1b8ce6484c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1683 microversion: 2.1 time: 0.172780 Sep 24 21:42:12.547139 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3281/6540] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:42:12 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:42:13.374461 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-22f0c9a0-517f-42be-9dfd-f8ec592afadb req-d6fc3861-4919-4173-93d1-4e938d42401e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe51dbd9-3aed-4d75-8aa8-77906a07cefe", "tag": "90688d0c-b0f2-4899-beb0-9c213174b394"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:42:13.385637 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-22f0c9a0-517f-42be-9dfd-f8ec592afadb req-d6fc3861-4919-4173-93d1-4e938d42401e service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:13.386116 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-22f0c9a0-517f-42be-9dfd-f8ec592afadb req-d6fc3861-4919-4173-93d1-4e938d42401e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:13.386648 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-22f0c9a0-517f-42be-9dfd-f8ec592afadb req-d6fc3861-4919-4173-93d1-4e938d42401e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:13.398954 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-22f0c9a0-517f-42be-9dfd-f8ec592afadb req-d6fc3861-4919-4173-93d1-4e938d42401e service nova] Creating event network-changed:90688d0c-b0f2-4899-beb0-9c213174b394 for instance fe51dbd9-3aed-4d75-8aa8-77906a07cefe on nch1-master-1 Sep 24 21:42:13.405895 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [req-22f0c9a0-517f-42be-9dfd-f8ec592afadb req-d6fc3861-4919-4173-93d1-4e938d42401e service nova] Instance fe51dbd9-3aed-4d75-8aa8-77906a07cefe is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 21:42:13.418059 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-22f0c9a0-517f-42be-9dfd-f8ec592afadb req-d6fc3861-4919-4173-93d1-4e938d42401e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047215 Sep 24 21:42:13.418710 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3260/6541] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:42:13.572000 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c15a9059-c757-4aee-9e10-e4bf1c533027 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:42:13.572635 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c15a9059-c757-4aee-9e10-e4bf1c533027 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:42:13.579706 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c15a9059-c757-4aee-9e10-e4bf1c533027 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:13.580442 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c15a9059-c757-4aee-9e10-e4bf1c533027 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:13.580896 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c15a9059-c757-4aee-9e10-e4bf1c533027 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:13.581654 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c15a9059-c757-4aee-9e10-e4bf1c533027 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:13.582125 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c15a9059-c757-4aee-9e10-e4bf1c533027 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:13.582599 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c15a9059-c757-4aee-9e10-e4bf1c533027 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:13.796168 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c15a9059-c757-4aee-9e10-e4bf1c533027 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:42:13.804472 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c15a9059-c757-4aee-9e10-e4bf1c533027 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1681 microversion: 2.1 time: 0.237055 Sep 24 21:42:13.805072 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3282/6542] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:42:13 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1681 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:42:14.829489 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-42df4b17-7190-4435-bb37-e3b798f23946 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:42:14.830210 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-42df4b17-7190-4435-bb37-e3b798f23946 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:42:14.838011 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-42df4b17-7190-4435-bb37-e3b798f23946 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:14.838532 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-42df4b17-7190-4435-bb37-e3b798f23946 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:14.838978 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-42df4b17-7190-4435-bb37-e3b798f23946 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:14.839686 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-42df4b17-7190-4435-bb37-e3b798f23946 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:14.840154 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-42df4b17-7190-4435-bb37-e3b798f23946 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:14.840592 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-42df4b17-7190-4435-bb37-e3b798f23946 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:14.986407 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-42df4b17-7190-4435-bb37-e3b798f23946 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:42:14.995133 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-42df4b17-7190-4435-bb37-e3b798f23946 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1681 microversion: 2.1 time: 0.169995 Sep 24 21:42:14.995735 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3261/6543] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:42:14 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:42:16.018956 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1c93973d-8364-4760-9d55-931eeba12336 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:42:16.019578 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1c93973d-8364-4760-9d55-931eeba12336 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:42:16.026475 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1c93973d-8364-4760-9d55-931eeba12336 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:16.027000 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1c93973d-8364-4760-9d55-931eeba12336 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:16.027453 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1c93973d-8364-4760-9d55-931eeba12336 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:16.028169 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1c93973d-8364-4760-9d55-931eeba12336 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:16.028641 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1c93973d-8364-4760-9d55-931eeba12336 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:16.029085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1c93973d-8364-4760-9d55-931eeba12336 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:16.158424 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1c93973d-8364-4760-9d55-931eeba12336 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:42:16.166807 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1c93973d-8364-4760-9d55-931eeba12336 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1678 microversion: 2.1 time: 0.151837 Sep 24 21:42:16.167384 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3283/6544] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:42:16 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:42:16.190323 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d9c542dd-0728-4740-bdb7-edc62d2a1657 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:42:16.190918 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d9c542dd-0728-4740-bdb7-edc62d2a1657 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:42:16.197731 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d9c542dd-0728-4740-bdb7-edc62d2a1657 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:16.198220 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d9c542dd-0728-4740-bdb7-edc62d2a1657 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:16.198695 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d9c542dd-0728-4740-bdb7-edc62d2a1657 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:16.199426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d9c542dd-0728-4740-bdb7-edc62d2a1657 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:16.199888 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d9c542dd-0728-4740-bdb7-edc62d2a1657 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:16.200325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d9c542dd-0728-4740-bdb7-edc62d2a1657 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:16.258520 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d9c542dd-0728-4740-bdb7-edc62d2a1657 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "POST /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe/action" status: 204 len: 0 microversion: 2.1 time: 0.071880 Sep 24 21:42:16.259178 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3262/6545] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:42:16 2022] POST /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:42:16.268407 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-09aec654-3ee9-4597-ae29-60fc02ecf725 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:42:16.269081 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-09aec654-3ee9-4597-ae29-60fc02ecf725 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:42:16.275633 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09aec654-3ee9-4597-ae29-60fc02ecf725 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:16.276192 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09aec654-3ee9-4597-ae29-60fc02ecf725 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:16.276794 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09aec654-3ee9-4597-ae29-60fc02ecf725 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:16.277763 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09aec654-3ee9-4597-ae29-60fc02ecf725 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:16.278244 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09aec654-3ee9-4597-ae29-60fc02ecf725 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:16.278764 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-09aec654-3ee9-4597-ae29-60fc02ecf725 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:16.514465 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-09aec654-3ee9-4597-ae29-60fc02ecf725 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:42:16.523368 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-09aec654-3ee9-4597-ae29-60fc02ecf725 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1678 microversion: 2.1 time: 0.259804 Sep 24 21:42:16.523888 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3284/6546] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:42:16 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1678 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:42:17.548652 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-aa862d07-3d4f-4665-ba57-68d162155ac9 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:42:17.549358 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-aa862d07-3d4f-4665-ba57-68d162155ac9 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:42:17.556204 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa862d07-3d4f-4665-ba57-68d162155ac9 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:17.556698 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa862d07-3d4f-4665-ba57-68d162155ac9 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:17.557138 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa862d07-3d4f-4665-ba57-68d162155ac9 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:17.557841 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa862d07-3d4f-4665-ba57-68d162155ac9 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:17.558307 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa862d07-3d4f-4665-ba57-68d162155ac9 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:17.558793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-aa862d07-3d4f-4665-ba57-68d162155ac9 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:17.708764 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-aa862d07-3d4f-4665-ba57-68d162155ac9 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:42:17.718381 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-aa862d07-3d4f-4665-ba57-68d162155ac9 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1678 microversion: 2.1 time: 0.174979 Sep 24 21:42:17.718994 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3263/6547] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:42:17 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:42:18.589975 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-fd14d35e-9c0b-4fd2-acf6-a065fb443210 req-ee364e29-a4ae-4a4c-bad3-17f945d1f109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe51dbd9-3aed-4d75-8aa8-77906a07cefe", "name": "network-vif-plugged", "status": "completed", "tag": "90688d0c-b0f2-4899-beb0-9c213174b394"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:42:18.601605 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-fd14d35e-9c0b-4fd2-acf6-a065fb443210 req-ee364e29-a4ae-4a4c-bad3-17f945d1f109 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:18.602102 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-fd14d35e-9c0b-4fd2-acf6-a065fb443210 req-ee364e29-a4ae-4a4c-bad3-17f945d1f109 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:18.602638 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-fd14d35e-9c0b-4fd2-acf6-a065fb443210 req-ee364e29-a4ae-4a4c-bad3-17f945d1f109 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:18.614669 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-fd14d35e-9c0b-4fd2-acf6-a065fb443210 req-ee364e29-a4ae-4a4c-bad3-17f945d1f109 service nova] Creating event network-vif-plugged:90688d0c-b0f2-4899-beb0-9c213174b394 for instance fe51dbd9-3aed-4d75-8aa8-77906a07cefe on nch1-master-1 Sep 24 21:42:18.619874 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-fd14d35e-9c0b-4fd2-acf6-a065fb443210 req-ee364e29-a4ae-4a4c-bad3-17f945d1f109 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033606 Sep 24 21:42:18.620700 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3285/6548] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:42:18.742107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-56f426dc-ee1a-4be0-9f59-628277f6ec4b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:42:18.742721 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-56f426dc-ee1a-4be0-9f59-628277f6ec4b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:42:18.749622 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56f426dc-ee1a-4be0-9f59-628277f6ec4b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:18.750120 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56f426dc-ee1a-4be0-9f59-628277f6ec4b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:18.750602 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56f426dc-ee1a-4be0-9f59-628277f6ec4b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:18.751319 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56f426dc-ee1a-4be0-9f59-628277f6ec4b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:18.751788 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56f426dc-ee1a-4be0-9f59-628277f6ec4b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:18.752227 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56f426dc-ee1a-4be0-9f59-628277f6ec4b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:18.885982 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-56f426dc-ee1a-4be0-9f59-628277f6ec4b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:42:18.888378 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:42:18.895273 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-56f426dc-ee1a-4be0-9f59-628277f6ec4b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1670 microversion: 2.1 time: 0.157255 Sep 24 21:42:18.895863 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3264/6549] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:42:18 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1670 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:42:18.919671 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-97206dcb-3e83-4979-89e7-65cca8e2dad7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:42:18.920380 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-97206dcb-3e83-4979-89e7-65cca8e2dad7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:42:18.926936 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97206dcb-3e83-4979-89e7-65cca8e2dad7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:18.927422 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97206dcb-3e83-4979-89e7-65cca8e2dad7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:18.927898 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97206dcb-3e83-4979-89e7-65cca8e2dad7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:18.928602 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97206dcb-3e83-4979-89e7-65cca8e2dad7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:18.929061 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97206dcb-3e83-4979-89e7-65cca8e2dad7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:18.929492 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97206dcb-3e83-4979-89e7-65cca8e2dad7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:18.933649 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:42:19.069746 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-97206dcb-3e83-4979-89e7-65cca8e2dad7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:42:19.077597 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-97206dcb-3e83-4979-89e7-65cca8e2dad7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1670 microversion: 2.1 time: 0.162655 Sep 24 21:42:19.078172 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3286/6550] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:42:18 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1670 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:42:19.100630 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-52a0be5e-add6-4d6a-9205-88d7829a762e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:42:19.101285 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-52a0be5e-add6-4d6a-9205-88d7829a762e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:42:19.108263 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-52a0be5e-add6-4d6a-9205-88d7829a762e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:19.108757 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-52a0be5e-add6-4d6a-9205-88d7829a762e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:19.109237 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-52a0be5e-add6-4d6a-9205-88d7829a762e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:19.109950 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-52a0be5e-add6-4d6a-9205-88d7829a762e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:19.110419 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-52a0be5e-add6-4d6a-9205-88d7829a762e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:19.110881 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-52a0be5e-add6-4d6a-9205-88d7829a762e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:19.238789 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-52a0be5e-add6-4d6a-9205-88d7829a762e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:42:19.247496 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-52a0be5e-add6-4d6a-9205-88d7829a762e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1670 microversion: 2.1 time: 0.151277 Sep 24 21:42:19.248068 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3265/6551] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:42:19 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1670 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:42:19.271602 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-788ad669-c817-400a-8312-42961d7fe8f2 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:42:19.272147 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-788ad669-c817-400a-8312-42961d7fe8f2 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:42:19.278154 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-788ad669-c817-400a-8312-42961d7fe8f2 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:19.278692 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-788ad669-c817-400a-8312-42961d7fe8f2 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:19.279187 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-788ad669-c817-400a-8312-42961d7fe8f2 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:19.279873 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-788ad669-c817-400a-8312-42961d7fe8f2 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:19.280341 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-788ad669-c817-400a-8312-42961d7fe8f2 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:19.280777 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-788ad669-c817-400a-8312-42961d7fe8f2 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:19.308910 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-788ad669-c817-400a-8312-42961d7fe8f2 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:42:19.384110 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-788ad669-c817-400a-8312-42961d7fe8f2 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 204 len: 0 microversion: 2.1 time: 0.116125 Sep 24 21:42:19.384850 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3287/6552] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:42:19 2022] DELETE /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:42:19.394901 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4e50119a-4d74-4c01-b0f1-6b3a3e327984 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:42:19.395517 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4e50119a-4d74-4c01-b0f1-6b3a3e327984 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:42:19.401900 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e50119a-4d74-4c01-b0f1-6b3a3e327984 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:19.402385 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e50119a-4d74-4c01-b0f1-6b3a3e327984 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:19.402928 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e50119a-4d74-4c01-b0f1-6b3a3e327984 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:19.403623 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e50119a-4d74-4c01-b0f1-6b3a3e327984 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:19.404082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e50119a-4d74-4c01-b0f1-6b3a3e327984 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:19.404512 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4e50119a-4d74-4c01-b0f1-6b3a3e327984 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:19.544871 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4e50119a-4d74-4c01-b0f1-6b3a3e327984 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:42:19.554188 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4e50119a-4d74-4c01-b0f1-6b3a3e327984 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1676 microversion: 2.1 time: 0.164557 Sep 24 21:42:19.554813 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3266/6553] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:42:19 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:42:20.578220 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5e6122b9-f4e2-4200-bf3b-bde96c2a989a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:42:20.578903 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5e6122b9-f4e2-4200-bf3b-bde96c2a989a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:42:20.586425 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5e6122b9-f4e2-4200-bf3b-bde96c2a989a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:20.586945 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5e6122b9-f4e2-4200-bf3b-bde96c2a989a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:20.587400 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5e6122b9-f4e2-4200-bf3b-bde96c2a989a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:20.588109 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5e6122b9-f4e2-4200-bf3b-bde96c2a989a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:20.588572 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5e6122b9-f4e2-4200-bf3b-bde96c2a989a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:20.589006 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5e6122b9-f4e2-4200-bf3b-bde96c2a989a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:20.720657 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5e6122b9-f4e2-4200-bf3b-bde96c2a989a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:42:20.728780 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5e6122b9-f4e2-4200-bf3b-bde96c2a989a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1676 microversion: 2.1 time: 0.155008 Sep 24 21:42:20.729359 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3288/6554] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:42:20 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:42:21.752652 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0187b07f-6375-40a2-a805-283410ff2864 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:42:21.753288 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0187b07f-6375-40a2-a805-283410ff2864 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:42:21.767631 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=37 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:42:21.772307 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0187b07f-6375-40a2-a805-283410ff2864 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:21.772890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0187b07f-6375-40a2-a805-283410ff2864 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:21.773258 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0187b07f-6375-40a2-a805-283410ff2864 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:21.773992 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0187b07f-6375-40a2-a805-283410ff2864 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:21.774446 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0187b07f-6375-40a2-a805-283410ff2864 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:21.774908 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0187b07f-6375-40a2-a805-283410ff2864 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:21.822579 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-6843963a-c166-498a-87a4-34b98ed1622c req-eafb3e4b-c2d2-412d-b833-820ed2438253 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe51dbd9-3aed-4d75-8aa8-77906a07cefe", "name": "network-vif-deleted", "tag": "90688d0c-b0f2-4899-beb0-9c213174b394"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:42:21.834715 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:42:21.853130 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6843963a-c166-498a-87a4-34b98ed1622c req-eafb3e4b-c2d2-412d-b833-820ed2438253 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:21.853867 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6843963a-c166-498a-87a4-34b98ed1622c req-eafb3e4b-c2d2-412d-b833-820ed2438253 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:21.856523 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6843963a-c166-498a-87a4-34b98ed1622c req-eafb3e4b-c2d2-412d-b833-820ed2438253 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:21.878105 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-6843963a-c166-498a-87a4-34b98ed1622c req-eafb3e4b-c2d2-412d-b833-820ed2438253 service nova] Creating event network-vif-deleted:90688d0c-b0f2-4899-beb0-9c213174b394 for instance fe51dbd9-3aed-4d75-8aa8-77906a07cefe on nch1-master-1 Sep 24 21:42:21.878288 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0187b07f-6375-40a2-a805-283410ff2864 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:42:21.885662 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-6843963a-c166-498a-87a4-34b98ed1622c req-eafb3e4b-c2d2-412d-b833-820ed2438253 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067414 Sep 24 21:42:21.887160 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3289/6555] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:42:21.887292 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0187b07f-6375-40a2-a805-283410ff2864 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 200 len: 1608 microversion: 2.1 time: 0.138702 Sep 24 21:42:21.887905 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3267/6556] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:42:21 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 1608 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:42:22.914768 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2fc95c5c-d210-41d3-ab1a-cc815e3bea43 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:42:22.915601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2fc95c5c-d210-41d3-ab1a-cc815e3bea43 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:42:22.921980 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2fc95c5c-d210-41d3-ab1a-cc815e3bea43 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:22.922647 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2fc95c5c-d210-41d3-ab1a-cc815e3bea43 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:22.923138 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2fc95c5c-d210-41d3-ab1a-cc815e3bea43 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:22.923861 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2fc95c5c-d210-41d3-ab1a-cc815e3bea43 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:22.924323 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2fc95c5c-d210-41d3-ab1a-cc815e3bea43 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:22.924759 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2fc95c5c-d210-41d3-ab1a-cc815e3bea43 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:22.940573 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-2fc95c5c-d210-41d3-ab1a-cc815e3bea43 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] HTTP exception thrown: Instance fe51dbd9-3aed-4d75-8aa8-77906a07cefe could not be found. Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2fc95c5c-d210-41d3-ab1a-cc815e3bea43 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Request method failure captured: Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe HTTP/1.1 Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3lvhF9Iaegf4sS1JzWlIljTYJrj148E-WwNQL6GxTFy9-EmD0lRYe82SHkK4BRJE7wdwpjVOyKp1beDMSXHCNh6a-Ag9bLdpFKeIG-_D7kSYRpA-A1xeWw2wQCLxdHVbwoFCBczUP4JOpY6xj8yaLXGpDztCPUBSYPLKmuHSh-kBkY Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: f1f293bffcad4e568dccab47bfc498aa Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServerActionsTestJSON-409908010 Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServerActionsTestJSON-409908010 Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: f1f293bffcad4e568dccab47bfc498aa Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServerActionsTestJSON-409908010 Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServerActionsTestJSON-409908010-project Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: f9bf67f92b7142298f15e941a80a07d6 Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServerActionsTestJSON-409908010-project Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance fe51dbd9-3aed-4d75-8aa8-77906a07cefe could not be found. Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'fe51dbd9-3aed-4d75-8aa8-77906a07cefe'} Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe51dbd9-3aed-4d75-8aa8-77906a07cefe could not be found. Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe51dbd9-3aed-4d75-8aa8-77906a07cefe could not be found. Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:42:22.942311 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:42:22.948082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:42:22.948082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:42:22.948082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:42:22.948082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:42:22.948082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:42:22.948082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe51dbd9-3aed-4d75-8aa8-77906a07cefe could not be found. Sep 24 21:42:22.948082 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:42:22.948082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2fc95c5c-d210-41d3-ab1a-cc815e3bea43 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Returning 404 to user: Instance fe51dbd9-3aed-4d75-8aa8-77906a07cefe could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:42:22.948082 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2fc95c5c-d210-41d3-ab1a-cc815e3bea43 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 404 len: 111 microversion: 2.1 time: 0.036127 Sep 24 21:42:22.948082 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3290/6557] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:42:22 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:42:22.959514 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e9da804c-30d0-4847-b051-03e982e2bd13 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:42:22.960422 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e9da804c-30d0-4847-b051-03e982e2bd13 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:42:22.967289 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e9da804c-30d0-4847-b051-03e982e2bd13 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:22.967795 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e9da804c-30d0-4847-b051-03e982e2bd13 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:22.968245 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e9da804c-30d0-4847-b051-03e982e2bd13 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:22.968967 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e9da804c-30d0-4847-b051-03e982e2bd13 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:22.969437 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e9da804c-30d0-4847-b051-03e982e2bd13 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:22.973503 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e9da804c-30d0-4847-b051-03e982e2bd13 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:22.988605 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-e9da804c-30d0-4847-b051-03e982e2bd13 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] HTTP exception thrown: Instance fe51dbd9-3aed-4d75-8aa8-77906a07cefe could not be found. Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e9da804c-30d0-4847-b051-03e982e2bd13 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Request method failure captured: Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe HTTP/1.1 Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3lvhF9Iaegf4sS1JzWlIljTYJrj148E-WwNQL6GxTFy9-EmD0lRYe82SHkK4BRJE7wdwpjVOyKp1beDMSXHCNh6a-Ag9bLdpFKeIG-_D7kSYRpA-A1xeWw2wQCLxdHVbwoFCBczUP4JOpY6xj8yaLXGpDztCPUBSYPLKmuHSh-kBkY Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: f1f293bffcad4e568dccab47bfc498aa Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServerActionsTestJSON-409908010 Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServerActionsTestJSON-409908010 Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: f1f293bffcad4e568dccab47bfc498aa Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServerActionsTestJSON-409908010 Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServerActionsTestJSON-409908010-project Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: f9bf67f92b7142298f15e941a80a07d6 Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServerActionsTestJSON-409908010-project Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance fe51dbd9-3aed-4d75-8aa8-77906a07cefe could not be found. Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'fe51dbd9-3aed-4d75-8aa8-77906a07cefe'} Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe51dbd9-3aed-4d75-8aa8-77906a07cefe could not be found. Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe51dbd9-3aed-4d75-8aa8-77906a07cefe could not be found. Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:42:22.991153 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:42:22.995092 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:42:22.995092 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:42:22.995092 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:42:22.995092 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:42:22.995092 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:42:22.995092 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe51dbd9-3aed-4d75-8aa8-77906a07cefe could not be found. Sep 24 21:42:22.995092 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:42:22.995092 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e9da804c-30d0-4847-b051-03e982e2bd13 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Returning 404 to user: Instance fe51dbd9-3aed-4d75-8aa8-77906a07cefe could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:42:22.995092 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e9da804c-30d0-4847-b051-03e982e2bd13 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 404 len: 111 microversion: 2.1 time: 0.037723 Sep 24 21:42:22.995092 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3268/6558] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:42:22 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:42:23.041518 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f53a22d5-6491-446d-9357-70f39cf2e7f4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1837605635", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "18903e01-4fbf-4876-9b99-27bd5d437a06"}], "security_groups": [{"name": "tempest-securitygroup--1672057739"}], "key_name": "tempest-keypair-743030895", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:42:23.148536 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-f53a22d5-6491-446d-9357-70f39cf2e7f4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] validate_networks() for [('18903e01-4fbf-4876-9b99-27bd5d437a06', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:42:23.924548 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-f53a22d5-6491-446d-9357-70f39cf2e7f4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:42:23.925159 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-f53a22d5-6491-446d-9357-70f39cf2e7f4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:42:23.925758 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-f53a22d5-6491-446d-9357-70f39cf2e7f4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:42:23.926181 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-f53a22d5-6491-446d-9357-70f39cf2e7f4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:42:23.926645 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-f53a22d5-6491-446d-9357-70f39cf2e7f4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:42:23.935587 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f53a22d5-6491-446d-9357-70f39cf2e7f4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:23.936077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f53a22d5-6491-446d-9357-70f39cf2e7f4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:23.936524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f53a22d5-6491-446d-9357-70f39cf2e7f4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:23.937266 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f53a22d5-6491-446d-9357-70f39cf2e7f4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:23.937729 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f53a22d5-6491-446d-9357-70f39cf2e7f4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:23.938166 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f53a22d5-6491-446d-9357-70f39cf2e7f4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:23.954858 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-f53a22d5-6491-446d-9357-70f39cf2e7f4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Getting quotas for project f1f293bffcad4e568dccab47bfc498aa. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:42:23.960882 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-f53a22d5-6491-446d-9357-70f39cf2e7f4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Getting quotas for user f9bf67f92b7142298f15e941a80a07d6 and project f1f293bffcad4e568dccab47bfc498aa. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:42:23.973083 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f53a22d5-6491-446d-9357-70f39cf2e7f4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:42:23.976180 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f53a22d5-6491-446d-9357-70f39cf2e7f4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:42:24.023018 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f53a22d5-6491-446d-9357-70f39cf2e7f4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.985400 Sep 24 21:42:24.023677 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3291/6559] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:42:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:42:24.034987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6cbd58b8-7d75-4e8e-bf91-850f6de1faf0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:42:24.035626 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6cbd58b8-7d75-4e8e-bf91-850f6de1faf0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:42:24.156835 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6cbd58b8-7d75-4e8e-bf91-850f6de1faf0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:42:24.165050 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6cbd58b8-7d75-4e8e-bf91-850f6de1faf0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 200 len: 1238 microversion: 2.1 time: 0.133922 Sep 24 21:42:24.165528 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3269/6560] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:42:24 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 1238 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:42:25.189128 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1d18541d-db5a-401a-b252-045a61f85ae7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:42:25.189757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1d18541d-db5a-401a-b252-045a61f85ae7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:42:25.196691 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1d18541d-db5a-401a-b252-045a61f85ae7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:25.197186 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1d18541d-db5a-401a-b252-045a61f85ae7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:25.197642 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1d18541d-db5a-401a-b252-045a61f85ae7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:25.198353 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1d18541d-db5a-401a-b252-045a61f85ae7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:25.198852 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1d18541d-db5a-401a-b252-045a61f85ae7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:25.199300 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1d18541d-db5a-401a-b252-045a61f85ae7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:25.295739 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1d18541d-db5a-401a-b252-045a61f85ae7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:42:25.304770 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1d18541d-db5a-401a-b252-045a61f85ae7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 200 len: 1296 microversion: 2.1 time: 0.120386 Sep 24 21:42:25.306008 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3292/6561] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:42:25 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 1296 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:42:26.329335 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7b1882e8-5f0e-45ee-8e91-88e5dd064b13 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:42:26.329986 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7b1882e8-5f0e-45ee-8e91-88e5dd064b13 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:42:26.336436 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b1882e8-5f0e-45ee-8e91-88e5dd064b13 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:26.336934 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b1882e8-5f0e-45ee-8e91-88e5dd064b13 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:26.337386 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b1882e8-5f0e-45ee-8e91-88e5dd064b13 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:26.338099 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b1882e8-5f0e-45ee-8e91-88e5dd064b13 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:26.338597 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b1882e8-5f0e-45ee-8e91-88e5dd064b13 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:26.339039 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b1882e8-5f0e-45ee-8e91-88e5dd064b13 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:26.525386 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7b1882e8-5f0e-45ee-8e91-88e5dd064b13 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:42:26.535638 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7b1882e8-5f0e-45ee-8e91-88e5dd064b13 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 200 len: 1364 microversion: 2.1 time: 0.210609 Sep 24 21:42:26.536236 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3270/6562] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:42:26 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 1364 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:42:26.618087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-631476f4-7536-4536-ad60-7e966217d06b req-4820bf8a-9a29-45b9-9733-ae87923dda5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02f5af29-3aff-4591-9bf0-41df8217399a", "tag": "b4dc44fc-99b3-4fed-a8cd-0db29c347830"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:42:26.628632 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-631476f4-7536-4536-ad60-7e966217d06b req-4820bf8a-9a29-45b9-9733-ae87923dda5a service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:26.629133 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-631476f4-7536-4536-ad60-7e966217d06b req-4820bf8a-9a29-45b9-9733-ae87923dda5a service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:26.629646 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-631476f4-7536-4536-ad60-7e966217d06b req-4820bf8a-9a29-45b9-9733-ae87923dda5a service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:26.646291 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-631476f4-7536-4536-ad60-7e966217d06b req-4820bf8a-9a29-45b9-9733-ae87923dda5a service nova] Creating event network-changed:b4dc44fc-99b3-4fed-a8cd-0db29c347830 for instance 02f5af29-3aff-4591-9bf0-41df8217399a on nch1-master-1 Sep 24 21:42:26.651421 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-631476f4-7536-4536-ad60-7e966217d06b req-4820bf8a-9a29-45b9-9733-ae87923dda5a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108002 Sep 24 21:42:26.652034 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3293/6563] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:42:27.561372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d22bc665-4378-40a0-9af9-7ba0ef2e8c08 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:42:27.561919 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d22bc665-4378-40a0-9af9-7ba0ef2e8c08 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:42:27.569235 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d22bc665-4378-40a0-9af9-7ba0ef2e8c08 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:27.570479 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d22bc665-4378-40a0-9af9-7ba0ef2e8c08 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:27.570955 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d22bc665-4378-40a0-9af9-7ba0ef2e8c08 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:27.571687 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d22bc665-4378-40a0-9af9-7ba0ef2e8c08 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:27.572153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d22bc665-4378-40a0-9af9-7ba0ef2e8c08 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:27.572592 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d22bc665-4378-40a0-9af9-7ba0ef2e8c08 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:27.714412 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d22bc665-4378-40a0-9af9-7ba0ef2e8c08 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:42:27.722409 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d22bc665-4378-40a0-9af9-7ba0ef2e8c08 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 200 len: 1364 microversion: 2.1 time: 0.165146 Sep 24 21:42:27.723095 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3271/6564] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:42:27 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:42:28.747586 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-aa8dcef8-5fc6-4136-9091-7b244dcb5300 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:42:28.748232 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-aa8dcef8-5fc6-4136-9091-7b244dcb5300 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:42:28.754485 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aa8dcef8-5fc6-4136-9091-7b244dcb5300 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:28.755009 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aa8dcef8-5fc6-4136-9091-7b244dcb5300 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:28.755459 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aa8dcef8-5fc6-4136-9091-7b244dcb5300 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:28.756163 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aa8dcef8-5fc6-4136-9091-7b244dcb5300 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:28.756626 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aa8dcef8-5fc6-4136-9091-7b244dcb5300 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:28.757553 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-aa8dcef8-5fc6-4136-9091-7b244dcb5300 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:28.886879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-aa8dcef8-5fc6-4136-9091-7b244dcb5300 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:42:28.894732 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-aa8dcef8-5fc6-4136-9091-7b244dcb5300 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 200 len: 1364 microversion: 2.1 time: 0.152353 Sep 24 21:42:28.895315 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3294/6565] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:42:28 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:42:29.918948 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8c88124b-23b5-4df8-bf2a-a0530c7c4ae8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:42:29.919499 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8c88124b-23b5-4df8-bf2a-a0530c7c4ae8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:42:29.926800 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c88124b-23b5-4df8-bf2a-a0530c7c4ae8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:29.927297 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c88124b-23b5-4df8-bf2a-a0530c7c4ae8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:29.927748 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c88124b-23b5-4df8-bf2a-a0530c7c4ae8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:29.928456 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c88124b-23b5-4df8-bf2a-a0530c7c4ae8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:29.929615 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c88124b-23b5-4df8-bf2a-a0530c7c4ae8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:29.930055 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8c88124b-23b5-4df8-bf2a-a0530c7c4ae8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:30.063296 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8c88124b-23b5-4df8-bf2a-a0530c7c4ae8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:42:30.071953 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8c88124b-23b5-4df8-bf2a-a0530c7c4ae8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 200 len: 1364 microversion: 2.1 time: 0.157144 Sep 24 21:42:30.072519 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3272/6566] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:42:29 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:42:31.094664 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0d51108c-daec-4de4-a542-ca0c76d1a7d1 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:42:31.095314 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0d51108c-daec-4de4-a542-ca0c76d1a7d1 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:42:31.103388 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d51108c-daec-4de4-a542-ca0c76d1a7d1 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:31.103986 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d51108c-daec-4de4-a542-ca0c76d1a7d1 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:31.104435 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d51108c-daec-4de4-a542-ca0c76d1a7d1 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:31.105161 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d51108c-daec-4de4-a542-ca0c76d1a7d1 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:31.105629 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d51108c-daec-4de4-a542-ca0c76d1a7d1 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:31.107166 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d51108c-daec-4de4-a542-ca0c76d1a7d1 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:31.273535 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0d51108c-daec-4de4-a542-ca0c76d1a7d1 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:42:31.281556 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0d51108c-daec-4de4-a542-ca0c76d1a7d1 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 200 len: 1364 microversion: 2.1 time: 0.190873 Sep 24 21:42:31.282154 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3295/6567] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:42:31 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:42:32.306293 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5ffc3309-9aa8-4bbc-8e25-e514a4418f1b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:42:32.306938 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5ffc3309-9aa8-4bbc-8e25-e514a4418f1b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:42:32.314414 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ffc3309-9aa8-4bbc-8e25-e514a4418f1b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:32.314947 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ffc3309-9aa8-4bbc-8e25-e514a4418f1b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:32.315391 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ffc3309-9aa8-4bbc-8e25-e514a4418f1b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:32.316079 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ffc3309-9aa8-4bbc-8e25-e514a4418f1b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:32.316533 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ffc3309-9aa8-4bbc-8e25-e514a4418f1b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:32.316959 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5ffc3309-9aa8-4bbc-8e25-e514a4418f1b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:32.446137 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5ffc3309-9aa8-4bbc-8e25-e514a4418f1b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:42:32.453946 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5ffc3309-9aa8-4bbc-8e25-e514a4418f1b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 200 len: 1364 microversion: 2.1 time: 0.152343 Sep 24 21:42:32.454545 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3273/6568] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:42:32 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:42:32.682616 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-79656a58-9350-40ca-9c9d-8b6424aacd9c req-2493dd84-d062-4856-936e-90710bc119a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02f5af29-3aff-4591-9bf0-41df8217399a", "name": "network-vif-plugged", "status": "completed", "tag": "b4dc44fc-99b3-4fed-a8cd-0db29c347830"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:42:32.693707 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-79656a58-9350-40ca-9c9d-8b6424aacd9c req-2493dd84-d062-4856-936e-90710bc119a9 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:32.694260 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-79656a58-9350-40ca-9c9d-8b6424aacd9c req-2493dd84-d062-4856-936e-90710bc119a9 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:32.694732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-79656a58-9350-40ca-9c9d-8b6424aacd9c req-2493dd84-d062-4856-936e-90710bc119a9 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:32.706387 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-79656a58-9350-40ca-9c9d-8b6424aacd9c req-2493dd84-d062-4856-936e-90710bc119a9 service nova] Creating event network-vif-plugged:b4dc44fc-99b3-4fed-a8cd-0db29c347830 for instance 02f5af29-3aff-4591-9bf0-41df8217399a on nch1-master-1 Sep 24 21:42:32.712250 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-79656a58-9350-40ca-9c9d-8b6424aacd9c req-2493dd84-d062-4856-936e-90710bc119a9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033308 Sep 24 21:42:32.712891 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3296/6569] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:42:33.476217 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dc360d15-4532-4b7a-98a7-5f41e361deb0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:42:33.477783 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-dc360d15-4532-4b7a-98a7-5f41e361deb0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:42:33.484685 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc360d15-4532-4b7a-98a7-5f41e361deb0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:33.485173 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc360d15-4532-4b7a-98a7-5f41e361deb0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:33.485616 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc360d15-4532-4b7a-98a7-5f41e361deb0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:33.486321 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc360d15-4532-4b7a-98a7-5f41e361deb0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:33.486820 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc360d15-4532-4b7a-98a7-5f41e361deb0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:33.487254 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dc360d15-4532-4b7a-98a7-5f41e361deb0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:33.618356 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-dc360d15-4532-4b7a-98a7-5f41e361deb0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:42:33.626238 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-dc360d15-4532-4b7a-98a7-5f41e361deb0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 200 len: 1364 microversion: 2.1 time: 0.153925 Sep 24 21:42:33.626847 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3274/6570] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:42:33 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:42:34.647905 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:42:34.649370 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=6 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:42:34.653997 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-79686423-fcca-46c8-9b14-878f1d444c42 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:42:34.654730 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-79686423-fcca-46c8-9b14-878f1d444c42 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:42:34.662554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79686423-fcca-46c8-9b14-878f1d444c42 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:34.663289 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79686423-fcca-46c8-9b14-878f1d444c42 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:34.663940 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79686423-fcca-46c8-9b14-878f1d444c42 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:34.664936 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79686423-fcca-46c8-9b14-878f1d444c42 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:34.665634 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79686423-fcca-46c8-9b14-878f1d444c42 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:34.666272 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-79686423-fcca-46c8-9b14-878f1d444c42 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:34.805210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-79686423-fcca-46c8-9b14-878f1d444c42 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:42:34.813090 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-79686423-fcca-46c8-9b14-878f1d444c42 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 200 len: 1551 microversion: 2.1 time: 0.167104 Sep 24 21:42:34.813667 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3297/6571] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:42:34 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 1551 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:42:34.836808 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-621f9b7b-cad0-41eb-88eb-5009d0b43e13 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:42:34.837341 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-621f9b7b-cad0-41eb-88eb-5009d0b43e13 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:42:34.839294 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:42:34.845340 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-621f9b7b-cad0-41eb-88eb-5009d0b43e13 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:34.845826 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-621f9b7b-cad0-41eb-88eb-5009d0b43e13 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:34.846269 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-621f9b7b-cad0-41eb-88eb-5009d0b43e13 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:34.847025 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-621f9b7b-cad0-41eb-88eb-5009d0b43e13 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:34.847490 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-621f9b7b-cad0-41eb-88eb-5009d0b43e13 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:34.847926 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-621f9b7b-cad0-41eb-88eb-5009d0b43e13 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:34.925175 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-621f9b7b-cad0-41eb-88eb-5009d0b43e13 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093002 Sep 24 21:42:34.926075 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3275/6572] 10.222.0.52 () {58 vars in 1275 bytes} [Sat Sep 24 21:42:34 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:42:36.098170 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-6d4ca6b7-bfdc-4267-a624-d8e6f5d364d3 req-4b3134bf-f3a8-4f0e-941e-a79d44305652 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02f5af29-3aff-4591-9bf0-41df8217399a", "tag": "b4dc44fc-99b3-4fed-a8cd-0db29c347830"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:42:36.108719 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6d4ca6b7-bfdc-4267-a624-d8e6f5d364d3 req-4b3134bf-f3a8-4f0e-941e-a79d44305652 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:42:36.109205 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6d4ca6b7-bfdc-4267-a624-d8e6f5d364d3 req-4b3134bf-f3a8-4f0e-941e-a79d44305652 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:42:36.109647 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6d4ca6b7-bfdc-4267-a624-d8e6f5d364d3 req-4b3134bf-f3a8-4f0e-941e-a79d44305652 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:42:36.120991 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-6d4ca6b7-bfdc-4267-a624-d8e6f5d364d3 req-4b3134bf-f3a8-4f0e-941e-a79d44305652 service nova] Creating event network-changed:b4dc44fc-99b3-4fed-a8cd-0db29c347830 for instance 02f5af29-3aff-4591-9bf0-41df8217399a on nch1-master-1 Sep 24 21:42:36.126162 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-6d4ca6b7-bfdc-4267-a624-d8e6f5d364d3 req-4b3134bf-f3a8-4f0e-941e-a79d44305652 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031750 Sep 24 21:42:36.127200 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3298/6573] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:43:48.463553 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=19 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:43:48.464959 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=55 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:43:48.470132 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b9c1a909-2eec-46bc-87fd-c2ca7bf27bb0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:43:48.477084 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b9c1a909-2eec-46bc-87fd-c2ca7bf27bb0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:43:48.477576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b9c1a909-2eec-46bc-87fd-c2ca7bf27bb0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:43:48.478049 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b9c1a909-2eec-46bc-87fd-c2ca7bf27bb0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:43:48.501208 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b9c1a909-2eec-46bc-87fd-c2ca7bf27bb0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Going to try to stop instance {{(pid=140516) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 24 21:43:48.542871 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b9c1a909-2eec-46bc-87fd-c2ca7bf27bb0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "POST /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a/action" status: 202 len: 0 microversion: 2.1 time: 0.080968 Sep 24 21:43:48.543482 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3276/6574] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:43:48 2022] POST /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:43:48.550191 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:43:48.551377 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:43:48.555602 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-47cdac42-8ae3-46e6-9442-68f9f1a3db8f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:43:48.556313 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-47cdac42-8ae3-46e6-9442-68f9f1a3db8f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:43:48.564888 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-47cdac42-8ae3-46e6-9442-68f9f1a3db8f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:43:48.565377 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-47cdac42-8ae3-46e6-9442-68f9f1a3db8f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:43:48.565818 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-47cdac42-8ae3-46e6-9442-68f9f1a3db8f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:43:48.566544 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-47cdac42-8ae3-46e6-9442-68f9f1a3db8f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:43:48.567008 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-47cdac42-8ae3-46e6-9442-68f9f1a3db8f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:43:48.567438 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-47cdac42-8ae3-46e6-9442-68f9f1a3db8f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:43:48.704289 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-47cdac42-8ae3-46e6-9442-68f9f1a3db8f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:43:48.712020 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-47cdac42-8ae3-46e6-9442-68f9f1a3db8f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 200 len: 1680 microversion: 2.1 time: 0.164101 Sep 24 21:43:48.712610 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3299/6575] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:43:48 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:43:49.738978 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ea40217e-bf0d-4ede-b789-a9210a0d1485 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:43:49.739848 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ea40217e-bf0d-4ede-b789-a9210a0d1485 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:43:49.746283 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea40217e-bf0d-4ede-b789-a9210a0d1485 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:43:49.746806 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea40217e-bf0d-4ede-b789-a9210a0d1485 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:43:49.747255 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea40217e-bf0d-4ede-b789-a9210a0d1485 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:43:49.747957 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea40217e-bf0d-4ede-b789-a9210a0d1485 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:43:49.748452 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea40217e-bf0d-4ede-b789-a9210a0d1485 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:43:49.748886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea40217e-bf0d-4ede-b789-a9210a0d1485 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:43:49.883982 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ea40217e-bf0d-4ede-b789-a9210a0d1485 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:43:49.895324 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ea40217e-bf0d-4ede-b789-a9210a0d1485 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 200 len: 1680 microversion: 2.1 time: 0.161736 Sep 24 21:43:49.895885 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3277/6576] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:43:49 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:43:50.918964 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c0656f3c-8663-4ee5-9f6b-4f151dcda670 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:43:50.919553 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c0656f3c-8663-4ee5-9f6b-4f151dcda670 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:43:50.927316 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0656f3c-8663-4ee5-9f6b-4f151dcda670 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:43:50.927805 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0656f3c-8663-4ee5-9f6b-4f151dcda670 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:43:50.928252 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0656f3c-8663-4ee5-9f6b-4f151dcda670 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:43:50.928959 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0656f3c-8663-4ee5-9f6b-4f151dcda670 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:43:50.929418 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0656f3c-8663-4ee5-9f6b-4f151dcda670 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:43:50.929922 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0656f3c-8663-4ee5-9f6b-4f151dcda670 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:43:51.061982 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c0656f3c-8663-4ee5-9f6b-4f151dcda670 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:43:51.069858 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c0656f3c-8663-4ee5-9f6b-4f151dcda670 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 200 len: 1680 microversion: 2.1 time: 0.155840 Sep 24 21:43:51.070442 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3300/6577] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:43:50 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:43:52.094557 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-eb9ddd29-7efc-4ae6-976c-4610a73e5a07 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:43:52.095103 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-eb9ddd29-7efc-4ae6-976c-4610a73e5a07 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:43:52.101996 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eb9ddd29-7efc-4ae6-976c-4610a73e5a07 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:43:52.102479 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eb9ddd29-7efc-4ae6-976c-4610a73e5a07 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:43:52.102950 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eb9ddd29-7efc-4ae6-976c-4610a73e5a07 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:43:52.103649 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eb9ddd29-7efc-4ae6-976c-4610a73e5a07 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:43:52.104106 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eb9ddd29-7efc-4ae6-976c-4610a73e5a07 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:43:52.105234 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-eb9ddd29-7efc-4ae6-976c-4610a73e5a07 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:43:52.242995 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-eb9ddd29-7efc-4ae6-976c-4610a73e5a07 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:43:52.251166 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-eb9ddd29-7efc-4ae6-976c-4610a73e5a07 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 200 len: 1680 microversion: 2.1 time: 0.161611 Sep 24 21:43:52.251744 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3278/6578] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:43:52 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:43:53.274407 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8850ec24-1887-49be-8deb-08f2bd6947d3 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:43:53.275061 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8850ec24-1887-49be-8deb-08f2bd6947d3 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:43:53.281915 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8850ec24-1887-49be-8deb-08f2bd6947d3 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:43:53.282415 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8850ec24-1887-49be-8deb-08f2bd6947d3 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:43:53.282901 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8850ec24-1887-49be-8deb-08f2bd6947d3 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:43:53.283610 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8850ec24-1887-49be-8deb-08f2bd6947d3 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:43:53.284076 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8850ec24-1887-49be-8deb-08f2bd6947d3 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:43:53.284509 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8850ec24-1887-49be-8deb-08f2bd6947d3 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:43:53.413123 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8850ec24-1887-49be-8deb-08f2bd6947d3 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:43:53.421669 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8850ec24-1887-49be-8deb-08f2bd6947d3 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 200 len: 1680 microversion: 2.1 time: 0.151229 Sep 24 21:43:53.422246 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3301/6579] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:43:53 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:43:54.445440 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ba2a1433-5b1f-40f8-bb0c-5b156a4ccbba tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:43:54.446067 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ba2a1433-5b1f-40f8-bb0c-5b156a4ccbba tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:43:54.453661 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba2a1433-5b1f-40f8-bb0c-5b156a4ccbba tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:43:54.454153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba2a1433-5b1f-40f8-bb0c-5b156a4ccbba tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:43:54.454625 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba2a1433-5b1f-40f8-bb0c-5b156a4ccbba tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:43:54.455331 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba2a1433-5b1f-40f8-bb0c-5b156a4ccbba tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:43:54.455793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba2a1433-5b1f-40f8-bb0c-5b156a4ccbba tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:43:54.456226 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba2a1433-5b1f-40f8-bb0c-5b156a4ccbba tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:43:54.592897 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ba2a1433-5b1f-40f8-bb0c-5b156a4ccbba tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:43:54.600591 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ba2a1433-5b1f-40f8-bb0c-5b156a4ccbba tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 200 len: 1680 microversion: 2.1 time: 0.159184 Sep 24 21:43:54.601180 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3279/6580] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:43:54 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:43:55.624846 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3a37bcad-df0c-4c69-bace-7f1f7485d27a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:43:55.625575 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3a37bcad-df0c-4c69-bace-7f1f7485d27a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:43:55.632118 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a37bcad-df0c-4c69-bace-7f1f7485d27a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:43:55.632622 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a37bcad-df0c-4c69-bace-7f1f7485d27a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:43:55.633072 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a37bcad-df0c-4c69-bace-7f1f7485d27a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:43:55.633848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a37bcad-df0c-4c69-bace-7f1f7485d27a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:43:55.634321 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a37bcad-df0c-4c69-bace-7f1f7485d27a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:43:55.634813 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a37bcad-df0c-4c69-bace-7f1f7485d27a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:43:55.767427 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3a37bcad-df0c-4c69-bace-7f1f7485d27a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:43:55.775280 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3a37bcad-df0c-4c69-bace-7f1f7485d27a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 200 len: 1680 microversion: 2.1 time: 0.155285 Sep 24 21:43:55.775862 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3302/6581] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:43:55 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:43:56.799614 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-daf7516a-6388-4baa-9b47-b993c029e893 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:43:56.800232 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-daf7516a-6388-4baa-9b47-b993c029e893 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:43:56.806583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-daf7516a-6388-4baa-9b47-b993c029e893 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:43:56.807068 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-daf7516a-6388-4baa-9b47-b993c029e893 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:43:56.808107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-daf7516a-6388-4baa-9b47-b993c029e893 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:43:56.808878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-daf7516a-6388-4baa-9b47-b993c029e893 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:43:56.809336 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-daf7516a-6388-4baa-9b47-b993c029e893 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:43:56.809766 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-daf7516a-6388-4baa-9b47-b993c029e893 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:43:56.938761 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-daf7516a-6388-4baa-9b47-b993c029e893 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:43:56.946796 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-daf7516a-6388-4baa-9b47-b993c029e893 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 200 len: 1680 microversion: 2.1 time: 0.151442 Sep 24 21:43:56.947370 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3280/6582] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:43:56 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:43:57.970471 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-747ac84f-d4cb-4262-abe4-fcee098cdf39 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:43:57.971034 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-747ac84f-d4cb-4262-abe4-fcee098cdf39 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:43:57.978133 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-747ac84f-d4cb-4262-abe4-fcee098cdf39 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:43:57.978679 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-747ac84f-d4cb-4262-abe4-fcee098cdf39 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:43:57.979122 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-747ac84f-d4cb-4262-abe4-fcee098cdf39 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:43:57.980407 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-747ac84f-d4cb-4262-abe4-fcee098cdf39 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:43:57.980955 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-747ac84f-d4cb-4262-abe4-fcee098cdf39 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:43:57.981391 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-747ac84f-d4cb-4262-abe4-fcee098cdf39 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:43:58.118216 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-747ac84f-d4cb-4262-abe4-fcee098cdf39 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:43:58.126285 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-747ac84f-d4cb-4262-abe4-fcee098cdf39 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 200 len: 1680 microversion: 2.1 time: 0.159829 Sep 24 21:43:58.126897 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3303/6583] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:43:57 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:43:59.150360 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-02b8ca35-56b4-4b25-8869-69631b5236b5 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:43:59.150951 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-02b8ca35-56b4-4b25-8869-69631b5236b5 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:43:59.158251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-02b8ca35-56b4-4b25-8869-69631b5236b5 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:43:59.158773 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-02b8ca35-56b4-4b25-8869-69631b5236b5 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:43:59.159217 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-02b8ca35-56b4-4b25-8869-69631b5236b5 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:43:59.159918 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-02b8ca35-56b4-4b25-8869-69631b5236b5 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:43:59.160407 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-02b8ca35-56b4-4b25-8869-69631b5236b5 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:43:59.160818 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-02b8ca35-56b4-4b25-8869-69631b5236b5 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:43:59.291457 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-02b8ca35-56b4-4b25-8869-69631b5236b5 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:43:59.299849 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-02b8ca35-56b4-4b25-8869-69631b5236b5 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 200 len: 1657 microversion: 2.1 time: 0.153449 Sep 24 21:43:59.300426 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3281/6584] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:43:59 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 1657 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:43:59.323013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dc6189d9-0ec2-42de-95b9-d13ec7e7073b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:43:59.325510 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dc6189d9-0ec2-42de-95b9-d13ec7e7073b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:43:59.332476 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc6189d9-0ec2-42de-95b9-d13ec7e7073b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:43:59.332969 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc6189d9-0ec2-42de-95b9-d13ec7e7073b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:43:59.333415 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc6189d9-0ec2-42de-95b9-d13ec7e7073b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:43:59.334131 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc6189d9-0ec2-42de-95b9-d13ec7e7073b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:43:59.334623 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc6189d9-0ec2-42de-95b9-d13ec7e7073b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:43:59.335066 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dc6189d9-0ec2-42de-95b9-d13ec7e7073b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:43:59.363448 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dc6189d9-0ec2-42de-95b9-d13ec7e7073b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:43:59.368843 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dc6189d9-0ec2-42de-95b9-d13ec7e7073b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Old instance type m1.heat2, new instance type m1.heat {{(pid=140517) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 24 21:43:59.376110 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-dc6189d9-0ec2-42de-95b9-d13ec7e7073b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:43:59.376545 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-dc6189d9-0ec2-42de-95b9-d13ec7e7073b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:43:59.377033 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-dc6189d9-0ec2-42de-95b9-d13ec7e7073b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:43:59.377456 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-dc6189d9-0ec2-42de-95b9-d13ec7e7073b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:43:59.377877 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-dc6189d9-0ec2-42de-95b9-d13ec7e7073b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:43:59.442700 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dc6189d9-0ec2-42de-95b9-d13ec7e7073b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "POST /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a/action" status: 202 len: 0 microversion: 2.1 time: 0.123277 Sep 24 21:43:59.443252 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3304/6585] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:43:59 2022] POST /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:43:59.451518 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1a740ef3-d1f5-44a4-9cd3-67791b56baa8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:43:59.452150 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1a740ef3-d1f5-44a4-9cd3-67791b56baa8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:43:59.458160 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a740ef3-d1f5-44a4-9cd3-67791b56baa8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:43:59.458702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a740ef3-d1f5-44a4-9cd3-67791b56baa8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:43:59.459151 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a740ef3-d1f5-44a4-9cd3-67791b56baa8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:43:59.459868 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a740ef3-d1f5-44a4-9cd3-67791b56baa8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:43:59.460333 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a740ef3-d1f5-44a4-9cd3-67791b56baa8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:43:59.460777 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a740ef3-d1f5-44a4-9cd3-67791b56baa8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:43:59.632627 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1a740ef3-d1f5-44a4-9cd3-67791b56baa8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:43:59.641233 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1a740ef3-d1f5-44a4-9cd3-67791b56baa8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 200 len: 1680 microversion: 2.1 time: 0.193597 Sep 24 21:43:59.642076 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3282/6586] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:43:59 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 1680 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:44:00.665952 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6f37921a-78a2-4d25-b2c5-061af1df6c70 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:44:00.666612 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6f37921a-78a2-4d25-b2c5-061af1df6c70 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:44:00.674646 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f37921a-78a2-4d25-b2c5-061af1df6c70 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:00.675149 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f37921a-78a2-4d25-b2c5-061af1df6c70 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:00.675599 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f37921a-78a2-4d25-b2c5-061af1df6c70 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:00.676576 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f37921a-78a2-4d25-b2c5-061af1df6c70 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:00.677049 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f37921a-78a2-4d25-b2c5-061af1df6c70 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:00.677490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6f37921a-78a2-4d25-b2c5-061af1df6c70 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:00.810453 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6f37921a-78a2-4d25-b2c5-061af1df6c70 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:44:00.818282 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6f37921a-78a2-4d25-b2c5-061af1df6c70 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 200 len: 1680 microversion: 2.1 time: 0.157145 Sep 24 21:44:00.818898 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3305/6587] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:44:00 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:44:01.841760 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4621cb08-0ee3-4956-a8e4-50b849cc81c6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:44:01.842379 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4621cb08-0ee3-4956-a8e4-50b849cc81c6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:44:01.849354 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4621cb08-0ee3-4956-a8e4-50b849cc81c6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:01.849848 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4621cb08-0ee3-4956-a8e4-50b849cc81c6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:01.850295 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4621cb08-0ee3-4956-a8e4-50b849cc81c6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:01.851060 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4621cb08-0ee3-4956-a8e4-50b849cc81c6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:01.851524 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4621cb08-0ee3-4956-a8e4-50b849cc81c6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:01.851960 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4621cb08-0ee3-4956-a8e4-50b849cc81c6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:01.985465 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4621cb08-0ee3-4956-a8e4-50b849cc81c6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:44:01.993232 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4621cb08-0ee3-4956-a8e4-50b849cc81c6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 200 len: 1680 microversion: 2.1 time: 0.155944 Sep 24 21:44:01.993814 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3283/6588] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:44:01 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:44:03.017037 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-19a1ab2a-712b-4194-a266-00247c6d4255 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:44:03.017657 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-19a1ab2a-712b-4194-a266-00247c6d4255 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:44:03.024528 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-19a1ab2a-712b-4194-a266-00247c6d4255 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:03.025026 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-19a1ab2a-712b-4194-a266-00247c6d4255 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:03.025478 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-19a1ab2a-712b-4194-a266-00247c6d4255 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:03.026193 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-19a1ab2a-712b-4194-a266-00247c6d4255 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:03.026699 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-19a1ab2a-712b-4194-a266-00247c6d4255 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:03.027138 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-19a1ab2a-712b-4194-a266-00247c6d4255 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:03.244829 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-19a1ab2a-712b-4194-a266-00247c6d4255 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:44:03.253278 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-19a1ab2a-712b-4194-a266-00247c6d4255 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 200 len: 1680 microversion: 2.1 time: 0.240447 Sep 24 21:44:03.253854 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3306/6589] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:44:03 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 1680 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:44:04.276625 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-16768e11-5117-4fa6-a1c8-3e3589b22332 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:44:04.277249 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-16768e11-5117-4fa6-a1c8-3e3589b22332 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:44:04.284556 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-16768e11-5117-4fa6-a1c8-3e3589b22332 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:04.285032 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-16768e11-5117-4fa6-a1c8-3e3589b22332 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:04.285472 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-16768e11-5117-4fa6-a1c8-3e3589b22332 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:04.286169 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-16768e11-5117-4fa6-a1c8-3e3589b22332 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:04.286657 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-16768e11-5117-4fa6-a1c8-3e3589b22332 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:04.287100 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-16768e11-5117-4fa6-a1c8-3e3589b22332 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:04.422613 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-16768e11-5117-4fa6-a1c8-3e3589b22332 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:44:04.430635 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-16768e11-5117-4fa6-a1c8-3e3589b22332 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 200 len: 1685 microversion: 2.1 time: 0.157949 Sep 24 21:44:04.431221 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3284/6590] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:44:04 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:44:05.453827 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cf50bf86-3561-4306-be49-0cfe79ca0e43 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:44:05.454390 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cf50bf86-3561-4306-be49-0cfe79ca0e43 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:44:05.462140 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf50bf86-3561-4306-be49-0cfe79ca0e43 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:05.462684 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf50bf86-3561-4306-be49-0cfe79ca0e43 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:05.463152 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf50bf86-3561-4306-be49-0cfe79ca0e43 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:05.463975 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf50bf86-3561-4306-be49-0cfe79ca0e43 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:05.464564 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf50bf86-3561-4306-be49-0cfe79ca0e43 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:05.465096 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf50bf86-3561-4306-be49-0cfe79ca0e43 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:05.663848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cf50bf86-3561-4306-be49-0cfe79ca0e43 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:44:05.672574 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cf50bf86-3561-4306-be49-0cfe79ca0e43 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 200 len: 1684 microversion: 2.1 time: 0.222937 Sep 24 21:44:05.673170 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3307/6591] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:44:05 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 1684 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:44:05.982867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-1caa92b8-a88e-4632-b680-d4ac9cd849f7 req-dcfdd3a2-eec1-42d8-94ec-1061735204b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02f5af29-3aff-4591-9bf0-41df8217399a", "name": "network-vif-unplugged", "status": "completed", "tag": "b4dc44fc-99b3-4fed-a8cd-0db29c347830"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:44:05.993645 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1caa92b8-a88e-4632-b680-d4ac9cd849f7 req-dcfdd3a2-eec1-42d8-94ec-1061735204b6 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:05.994120 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1caa92b8-a88e-4632-b680-d4ac9cd849f7 req-dcfdd3a2-eec1-42d8-94ec-1061735204b6 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:05.994661 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-1caa92b8-a88e-4632-b680-d4ac9cd849f7 req-dcfdd3a2-eec1-42d8-94ec-1061735204b6 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:06.007566 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-1caa92b8-a88e-4632-b680-d4ac9cd849f7 req-dcfdd3a2-eec1-42d8-94ec-1061735204b6 service nova] Creating event network-vif-unplugged:b4dc44fc-99b3-4fed-a8cd-0db29c347830 for instance 02f5af29-3aff-4591-9bf0-41df8217399a on nch2-master-1 Sep 24 21:44:06.013480 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [req-1caa92b8-a88e-4632-b680-d4ac9cd849f7 req-dcfdd3a2-eec1-42d8-94ec-1061735204b6 service nova] Instance 02f5af29-3aff-4591-9bf0-41df8217399a is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 21:44:06.024542 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-1caa92b8-a88e-4632-b680-d4ac9cd849f7 req-dcfdd3a2-eec1-42d8-94ec-1061735204b6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045627 Sep 24 21:44:06.025325 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3285/6592] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:44:06.696652 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dab35539-3a12-4403-8689-75c7ee0ccbbd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:44:06.697498 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dab35539-3a12-4403-8689-75c7ee0ccbbd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:44:06.706535 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dab35539-3a12-4403-8689-75c7ee0ccbbd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:06.707054 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dab35539-3a12-4403-8689-75c7ee0ccbbd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:06.707525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dab35539-3a12-4403-8689-75c7ee0ccbbd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:06.708237 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dab35539-3a12-4403-8689-75c7ee0ccbbd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:06.708707 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dab35539-3a12-4403-8689-75c7ee0ccbbd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:06.709147 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dab35539-3a12-4403-8689-75c7ee0ccbbd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:06.962136 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dab35539-3a12-4403-8689-75c7ee0ccbbd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:44:06.971040 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dab35539-3a12-4403-8689-75c7ee0ccbbd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 200 len: 1684 microversion: 2.1 time: 0.278278 Sep 24 21:44:06.971633 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3308/6593] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:44:06 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 1684 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:44:07.996565 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-64e07e51-fd7e-42e4-b71d-86cba92bd370 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:44:07.997734 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-64e07e51-fd7e-42e4-b71d-86cba92bd370 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:44:08.004180 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-64e07e51-fd7e-42e4-b71d-86cba92bd370 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:08.004674 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-64e07e51-fd7e-42e4-b71d-86cba92bd370 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:08.005118 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-64e07e51-fd7e-42e4-b71d-86cba92bd370 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:08.005827 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-64e07e51-fd7e-42e4-b71d-86cba92bd370 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:08.006291 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-64e07e51-fd7e-42e4-b71d-86cba92bd370 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:08.006752 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-64e07e51-fd7e-42e4-b71d-86cba92bd370 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:08.065142 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-96d86cd4-bd9a-4468-bab9-ffb99d5ae894 req-81880903-fa8c-4082-949d-a824e243f9d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02f5af29-3aff-4591-9bf0-41df8217399a", "tag": "b4dc44fc-99b3-4fed-a8cd-0db29c347830"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:44:08.075418 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-96d86cd4-bd9a-4468-bab9-ffb99d5ae894 req-81880903-fa8c-4082-949d-a824e243f9d4 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:08.076613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-96d86cd4-bd9a-4468-bab9-ffb99d5ae894 req-81880903-fa8c-4082-949d-a824e243f9d4 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:08.077219 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-96d86cd4-bd9a-4468-bab9-ffb99d5ae894 req-81880903-fa8c-4082-949d-a824e243f9d4 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:08.089735 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-96d86cd4-bd9a-4468-bab9-ffb99d5ae894 req-81880903-fa8c-4082-949d-a824e243f9d4 service nova] Creating event network-changed:b4dc44fc-99b3-4fed-a8cd-0db29c347830 for instance 02f5af29-3aff-4591-9bf0-41df8217399a on nch2-master-1 Sep 24 21:44:08.095575 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [req-96d86cd4-bd9a-4468-bab9-ffb99d5ae894 req-81880903-fa8c-4082-949d-a824e243f9d4 service nova] Instance 02f5af29-3aff-4591-9bf0-41df8217399a is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 21:44:08.107137 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-96d86cd4-bd9a-4468-bab9-ffb99d5ae894 req-81880903-fa8c-4082-949d-a824e243f9d4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046409 Sep 24 21:44:08.108123 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3309/6594] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:44:08.189608 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-64e07e51-fd7e-42e4-b71d-86cba92bd370 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:44:08.197564 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-64e07e51-fd7e-42e4-b71d-86cba92bd370 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 200 len: 1682 microversion: 2.1 time: 0.206299 Sep 24 21:44:08.198150 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3286/6595] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:44:07 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 1682 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:44:09.223128 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dbf268a9-0450-4a8d-92e2-532a7c231244 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:44:09.223839 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dbf268a9-0450-4a8d-92e2-532a7c231244 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:44:09.230134 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dbf268a9-0450-4a8d-92e2-532a7c231244 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:09.230668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dbf268a9-0450-4a8d-92e2-532a7c231244 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:09.231119 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dbf268a9-0450-4a8d-92e2-532a7c231244 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:09.231849 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dbf268a9-0450-4a8d-92e2-532a7c231244 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:09.232319 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dbf268a9-0450-4a8d-92e2-532a7c231244 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:09.232748 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dbf268a9-0450-4a8d-92e2-532a7c231244 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:09.362632 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dbf268a9-0450-4a8d-92e2-532a7c231244 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:44:09.370512 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dbf268a9-0450-4a8d-92e2-532a7c231244 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 200 len: 1678 microversion: 2.1 time: 0.152465 Sep 24 21:44:09.371096 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3310/6596] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:44:09 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:44:09.394002 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f8224311-993e-4664-8a33-974b838c9717 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:44:09.394554 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f8224311-993e-4664-8a33-974b838c9717 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:44:09.401476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8224311-993e-4664-8a33-974b838c9717 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:09.401969 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8224311-993e-4664-8a33-974b838c9717 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:09.402414 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8224311-993e-4664-8a33-974b838c9717 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:09.403169 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8224311-993e-4664-8a33-974b838c9717 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:09.403759 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8224311-993e-4664-8a33-974b838c9717 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:09.404243 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8224311-993e-4664-8a33-974b838c9717 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:09.462708 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f8224311-993e-4664-8a33-974b838c9717 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "POST /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a/action" status: 204 len: 0 microversion: 2.1 time: 0.072393 Sep 24 21:44:09.463358 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3287/6597] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:44:09 2022] POST /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:44:09.473129 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d218518f-00fe-457d-a7ae-28c75faf1d82 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:44:09.473762 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d218518f-00fe-457d-a7ae-28c75faf1d82 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:44:09.481011 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d218518f-00fe-457d-a7ae-28c75faf1d82 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:09.481554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d218518f-00fe-457d-a7ae-28c75faf1d82 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:09.482042 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d218518f-00fe-457d-a7ae-28c75faf1d82 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:09.482854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d218518f-00fe-457d-a7ae-28c75faf1d82 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:09.483329 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d218518f-00fe-457d-a7ae-28c75faf1d82 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:09.483774 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d218518f-00fe-457d-a7ae-28c75faf1d82 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:09.703063 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d218518f-00fe-457d-a7ae-28c75faf1d82 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:44:09.710789 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d218518f-00fe-457d-a7ae-28c75faf1d82 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 200 len: 1678 microversion: 2.1 time: 0.242905 Sep 24 21:44:09.711469 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3311/6598] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:44:09 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 1678 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:44:10.736382 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1e6be2cf-50a0-4f3e-9eee-86e84df9760f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:44:10.737104 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1e6be2cf-50a0-4f3e-9eee-86e84df9760f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:44:10.744470 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e6be2cf-50a0-4f3e-9eee-86e84df9760f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:10.744968 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e6be2cf-50a0-4f3e-9eee-86e84df9760f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:10.745423 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e6be2cf-50a0-4f3e-9eee-86e84df9760f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:10.746245 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e6be2cf-50a0-4f3e-9eee-86e84df9760f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:10.746771 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e6be2cf-50a0-4f3e-9eee-86e84df9760f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:10.747251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e6be2cf-50a0-4f3e-9eee-86e84df9760f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:10.892280 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1e6be2cf-50a0-4f3e-9eee-86e84df9760f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:44:10.900072 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1e6be2cf-50a0-4f3e-9eee-86e84df9760f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 200 len: 1657 microversion: 2.1 time: 0.169244 Sep 24 21:44:10.900653 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3288/6599] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:44:10 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 1657 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:44:10.923182 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e9994161-0cb8-4881-84d2-bf87624a2232 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:44:10.923801 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e9994161-0cb8-4881-84d2-bf87624a2232 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:44:10.931085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9994161-0cb8-4881-84d2-bf87624a2232 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:10.931571 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9994161-0cb8-4881-84d2-bf87624a2232 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:10.932012 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9994161-0cb8-4881-84d2-bf87624a2232 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:10.932706 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9994161-0cb8-4881-84d2-bf87624a2232 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:10.933165 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9994161-0cb8-4881-84d2-bf87624a2232 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:10.933592 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9994161-0cb8-4881-84d2-bf87624a2232 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:11.068147 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e9994161-0cb8-4881-84d2-bf87624a2232 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:44:11.076888 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e9994161-0cb8-4881-84d2-bf87624a2232 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 200 len: 1657 microversion: 2.1 time: 0.156977 Sep 24 21:44:11.077539 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3312/6600] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:44:10 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 1657 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:44:11.099798 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d9629713-beaa-4a59-ad36-70c094d47e9b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:44:11.105974 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d9629713-beaa-4a59-ad36-70c094d47e9b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:11.106465 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d9629713-beaa-4a59-ad36-70c094d47e9b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:11.107507 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d9629713-beaa-4a59-ad36-70c094d47e9b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:11.130679 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d9629713-beaa-4a59-ad36-70c094d47e9b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Going to try to start instance {{(pid=140516) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 24 21:44:11.163705 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:44:11.172813 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d9629713-beaa-4a59-ad36-70c094d47e9b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "POST /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a/action" status: 202 len: 0 microversion: 2.1 time: 0.076863 Sep 24 21:44:11.173419 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3289/6601] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:44:11 2022] POST /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:44:11.182441 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ad5ad223-9942-42ee-ab02-2b06562db03a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:44:11.183144 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ad5ad223-9942-42ee-ab02-2b06562db03a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:44:11.186482 ncdv-master-1 devstack@n-api.service[140517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 21:44:11.186683 ncdv-master-1 devstack@n-api.service[140517]: Sat Sep 24 21:44:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a (ip 10.222.0.52) !!! Sep 24 21:44:11.200465 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ad5ad223-9942-42ee-ab02-2b06562db03a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:11.201158 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ad5ad223-9942-42ee-ab02-2b06562db03a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:11.201674 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ad5ad223-9942-42ee-ab02-2b06562db03a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:11.202405 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ad5ad223-9942-42ee-ab02-2b06562db03a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:11.202881 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ad5ad223-9942-42ee-ab02-2b06562db03a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:11.204077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ad5ad223-9942-42ee-ab02-2b06562db03a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:11.396232 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ad5ad223-9942-42ee-ab02-2b06562db03a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:44:11.404313 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ad5ad223-9942-42ee-ab02-2b06562db03a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 200 len: 1666 microversion: 2.1 time: 0.225700 Sep 24 21:44:11.404996 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3313/6602] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:44:11 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 1666 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:44:12.255416 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-a5b43bbd-2274-4767-8fe2-6c8259794610 req-66c12d07-1f66-4ecb-9e24-0a7a5228fde4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02f5af29-3aff-4591-9bf0-41df8217399a", "name": "network-vif-plugged", "status": "completed", "tag": "b4dc44fc-99b3-4fed-a8cd-0db29c347830"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:44:12.265714 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a5b43bbd-2274-4767-8fe2-6c8259794610 req-66c12d07-1f66-4ecb-9e24-0a7a5228fde4 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:12.266195 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a5b43bbd-2274-4767-8fe2-6c8259794610 req-66c12d07-1f66-4ecb-9e24-0a7a5228fde4 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:12.266817 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a5b43bbd-2274-4767-8fe2-6c8259794610 req-66c12d07-1f66-4ecb-9e24-0a7a5228fde4 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:12.279282 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-a5b43bbd-2274-4767-8fe2-6c8259794610 req-66c12d07-1f66-4ecb-9e24-0a7a5228fde4 service nova] Creating event network-vif-plugged:b4dc44fc-99b3-4fed-a8cd-0db29c347830 for instance 02f5af29-3aff-4591-9bf0-41df8217399a on nch2-master-1 Sep 24 21:44:12.284512 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-a5b43bbd-2274-4767-8fe2-6c8259794610 req-66c12d07-1f66-4ecb-9e24-0a7a5228fde4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111861 Sep 24 21:44:12.285171 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3290/6603] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:44:12.428090 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e6a879e4-c5c0-4ecc-8273-fd2069efbae4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:44:12.428729 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e6a879e4-c5c0-4ecc-8273-fd2069efbae4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:44:12.435796 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6a879e4-c5c0-4ecc-8273-fd2069efbae4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:12.436317 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6a879e4-c5c0-4ecc-8273-fd2069efbae4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:12.436770 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6a879e4-c5c0-4ecc-8273-fd2069efbae4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:12.437484 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6a879e4-c5c0-4ecc-8273-fd2069efbae4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:12.437954 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6a879e4-c5c0-4ecc-8273-fd2069efbae4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:12.438394 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e6a879e4-c5c0-4ecc-8273-fd2069efbae4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:12.456542 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:44:12.573342 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e6a879e4-c5c0-4ecc-8273-fd2069efbae4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:44:12.582043 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e6a879e4-c5c0-4ecc-8273-fd2069efbae4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 200 len: 1670 microversion: 2.1 time: 0.158206 Sep 24 21:44:12.582648 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3314/6604] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:44:12 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 1670 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:44:12.601688 ncdv-master-1 devstack@n-api.service[140516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 21:44:12.601835 ncdv-master-1 devstack@n-api.service[140516]: Sat Sep 24 21:44:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a (ip 10.222.0.52) !!! Sep 24 21:44:12.602913 ncdv-master-1 devstack@n-api.service[140516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 21:44:12.603040 ncdv-master-1 devstack@n-api.service[140516]: Sat Sep 24 21:44:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a (ip 10.222.0.52) !!! Sep 24 21:44:12.608487 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-828de784-298c-4b50-8f26-23991cee1156 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:44:12.609109 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-828de784-298c-4b50-8f26-23991cee1156 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:44:12.617587 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-828de784-298c-4b50-8f26-23991cee1156 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:12.618080 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-828de784-298c-4b50-8f26-23991cee1156 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:12.618540 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-828de784-298c-4b50-8f26-23991cee1156 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:12.619245 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-828de784-298c-4b50-8f26-23991cee1156 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:12.619707 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-828de784-298c-4b50-8f26-23991cee1156 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:12.620139 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-828de784-298c-4b50-8f26-23991cee1156 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:12.647695 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-828de784-298c-4b50-8f26-23991cee1156 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:44:12.722073 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-828de784-298c-4b50-8f26-23991cee1156 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "DELETE /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 204 len: 0 microversion: 2.1 time: 0.121113 Sep 24 21:44:12.722689 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3291/6605] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:44:12 2022] DELETE /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:44:12.731053 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-69eb5faf-42c5-416a-8d90-6f8507b0a36e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:44:12.731676 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-69eb5faf-42c5-416a-8d90-6f8507b0a36e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:44:12.737650 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69eb5faf-42c5-416a-8d90-6f8507b0a36e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:12.738137 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69eb5faf-42c5-416a-8d90-6f8507b0a36e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:12.738609 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69eb5faf-42c5-416a-8d90-6f8507b0a36e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:12.739313 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69eb5faf-42c5-416a-8d90-6f8507b0a36e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:12.739774 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69eb5faf-42c5-416a-8d90-6f8507b0a36e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:12.740490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-69eb5faf-42c5-416a-8d90-6f8507b0a36e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:12.872134 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-69eb5faf-42c5-416a-8d90-6f8507b0a36e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:44:12.880115 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-69eb5faf-42c5-416a-8d90-6f8507b0a36e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 200 len: 1676 microversion: 2.1 time: 0.153022 Sep 24 21:44:12.880694 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3315/6606] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:44:12 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:44:13.904976 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-910220b3-df8a-428a-916e-33497fda63ae tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:44:13.905608 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-910220b3-df8a-428a-916e-33497fda63ae tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:44:13.912416 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-910220b3-df8a-428a-916e-33497fda63ae tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:13.912927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-910220b3-df8a-428a-916e-33497fda63ae tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:13.913366 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-910220b3-df8a-428a-916e-33497fda63ae tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:13.914088 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-910220b3-df8a-428a-916e-33497fda63ae tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:13.914569 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-910220b3-df8a-428a-916e-33497fda63ae tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:13.914999 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-910220b3-df8a-428a-916e-33497fda63ae tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:14.052723 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-910220b3-df8a-428a-916e-33497fda63ae tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:44:14.061079 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-910220b3-df8a-428a-916e-33497fda63ae tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 200 len: 1676 microversion: 2.1 time: 0.160817 Sep 24 21:44:14.061662 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3292/6607] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:44:13 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:44:15.085001 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-93cc6ede-88a3-4f3d-b25b-c5e0916be82a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:44:15.085785 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-93cc6ede-88a3-4f3d-b25b-c5e0916be82a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:44:15.093717 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93cc6ede-88a3-4f3d-b25b-c5e0916be82a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:15.094230 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93cc6ede-88a3-4f3d-b25b-c5e0916be82a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:15.094721 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93cc6ede-88a3-4f3d-b25b-c5e0916be82a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:15.095466 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93cc6ede-88a3-4f3d-b25b-c5e0916be82a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:15.096095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93cc6ede-88a3-4f3d-b25b-c5e0916be82a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:15.096548 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93cc6ede-88a3-4f3d-b25b-c5e0916be82a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:15.193152 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-93cc6ede-88a3-4f3d-b25b-c5e0916be82a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:44:15.201538 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-93cc6ede-88a3-4f3d-b25b-c5e0916be82a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 200 len: 1608 microversion: 2.1 time: 0.120636 Sep 24 21:44:15.202308 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3316/6608] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:44:15 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 1608 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:44:15.266450 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-3eb392cd-36f9-4ae3-8c0c-ea254210d8e5 req-38ef5397-77e5-422a-b2e1-9b98dca62ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02f5af29-3aff-4591-9bf0-41df8217399a", "name": "network-vif-deleted", "tag": "b4dc44fc-99b3-4fed-a8cd-0db29c347830"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:44:15.278322 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-3eb392cd-36f9-4ae3-8c0c-ea254210d8e5 req-38ef5397-77e5-422a-b2e1-9b98dca62ec1 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:15.279178 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-3eb392cd-36f9-4ae3-8c0c-ea254210d8e5 req-38ef5397-77e5-422a-b2e1-9b98dca62ec1 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:15.280015 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-3eb392cd-36f9-4ae3-8c0c-ea254210d8e5 req-38ef5397-77e5-422a-b2e1-9b98dca62ec1 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:15.291892 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-3eb392cd-36f9-4ae3-8c0c-ea254210d8e5 req-38ef5397-77e5-422a-b2e1-9b98dca62ec1 service nova] Creating event network-vif-deleted:b4dc44fc-99b3-4fed-a8cd-0db29c347830 for instance 02f5af29-3aff-4591-9bf0-41df8217399a on nch2-master-1 Sep 24 21:44:15.297811 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-3eb392cd-36f9-4ae3-8c0c-ea254210d8e5 req-38ef5397-77e5-422a-b2e1-9b98dca62ec1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036132 Sep 24 21:44:15.298648 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3293/6609] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:44:16.226765 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-17d94b5d-4d1b-4bac-9e91-2a26a28daa72 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:44:16.227401 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-17d94b5d-4d1b-4bac-9e91-2a26a28daa72 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:44:16.235651 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-17d94b5d-4d1b-4bac-9e91-2a26a28daa72 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:16.236153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-17d94b5d-4d1b-4bac-9e91-2a26a28daa72 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:16.236596 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-17d94b5d-4d1b-4bac-9e91-2a26a28daa72 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:16.237334 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-17d94b5d-4d1b-4bac-9e91-2a26a28daa72 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:16.237799 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-17d94b5d-4d1b-4bac-9e91-2a26a28daa72 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:16.238237 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-17d94b5d-4d1b-4bac-9e91-2a26a28daa72 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:16.252989 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-17d94b5d-4d1b-4bac-9e91-2a26a28daa72 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] HTTP exception thrown: Instance 02f5af29-3aff-4591-9bf0-41df8217399a could not be found. Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-17d94b5d-4d1b-4bac-9e91-2a26a28daa72 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Request method failure captured: Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a HTTP/1.1 Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3lvhF9Iaegf4sS1JzWlIljTYJrj148E-WwNQL6GxTFy9-EmD0lRYe82SHkK4BRJE7wdwpjVOyKp1beDMSXHCNh6a-Ag9bLdpFKeIG-_D7kSYRpA-A1xeWw2wQCLxdHVbwoFCBczUP4JOpY6xj8yaLXGpDztCPUBSYPLKmuHSh-kBkY Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: f1f293bffcad4e568dccab47bfc498aa Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServerActionsTestJSON-409908010 Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServerActionsTestJSON-409908010 Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: f1f293bffcad4e568dccab47bfc498aa Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServerActionsTestJSON-409908010 Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServerActionsTestJSON-409908010-project Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: f9bf67f92b7142298f15e941a80a07d6 Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServerActionsTestJSON-409908010-project Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 02f5af29-3aff-4591-9bf0-41df8217399a could not be found. Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '02f5af29-3aff-4591-9bf0-41df8217399a'} Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02f5af29-3aff-4591-9bf0-41df8217399a could not be found. Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02f5af29-3aff-4591-9bf0-41df8217399a could not be found. Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:44:16.254760 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:44:16.259501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:44:16.259501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:44:16.259501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:44:16.259501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:44:16.259501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:44:16.259501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02f5af29-3aff-4591-9bf0-41df8217399a could not be found. Sep 24 21:44:16.259501 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:44:16.259501 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-17d94b5d-4d1b-4bac-9e91-2a26a28daa72 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Returning 404 to user: Instance 02f5af29-3aff-4591-9bf0-41df8217399a could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:44:16.259501 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-17d94b5d-4d1b-4bac-9e91-2a26a28daa72 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 404 len: 111 microversion: 2.1 time: 0.033693 Sep 24 21:44:16.259501 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3317/6610] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:44:16 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:44:16.274104 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1d42b3ca-718e-4f82-bb2c-3bc3af358ba1 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:44:16.274876 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1d42b3ca-718e-4f82-bb2c-3bc3af358ba1 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:44:16.282471 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d42b3ca-718e-4f82-bb2c-3bc3af358ba1 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:16.283065 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d42b3ca-718e-4f82-bb2c-3bc3af358ba1 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:16.283513 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d42b3ca-718e-4f82-bb2c-3bc3af358ba1 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:16.284214 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d42b3ca-718e-4f82-bb2c-3bc3af358ba1 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:16.284678 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d42b3ca-718e-4f82-bb2c-3bc3af358ba1 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:16.285117 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d42b3ca-718e-4f82-bb2c-3bc3af358ba1 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:16.299311 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-1d42b3ca-718e-4f82-bb2c-3bc3af358ba1 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] HTTP exception thrown: Instance 02f5af29-3aff-4591-9bf0-41df8217399a could not be found. Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1d42b3ca-718e-4f82-bb2c-3bc3af358ba1 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Request method failure captured: Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a HTTP/1.1 Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3lvhF9Iaegf4sS1JzWlIljTYJrj148E-WwNQL6GxTFy9-EmD0lRYe82SHkK4BRJE7wdwpjVOyKp1beDMSXHCNh6a-Ag9bLdpFKeIG-_D7kSYRpA-A1xeWw2wQCLxdHVbwoFCBczUP4JOpY6xj8yaLXGpDztCPUBSYPLKmuHSh-kBkY Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: f1f293bffcad4e568dccab47bfc498aa Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServerActionsTestJSON-409908010 Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServerActionsTestJSON-409908010 Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: f1f293bffcad4e568dccab47bfc498aa Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServerActionsTestJSON-409908010 Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServerActionsTestJSON-409908010-project Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: f9bf67f92b7142298f15e941a80a07d6 Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServerActionsTestJSON-409908010-project Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 02f5af29-3aff-4591-9bf0-41df8217399a could not be found. Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '02f5af29-3aff-4591-9bf0-41df8217399a'} Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02f5af29-3aff-4591-9bf0-41df8217399a could not be found. Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02f5af29-3aff-4591-9bf0-41df8217399a could not be found. Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:44:16.300935 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:44:16.305762 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:44:16.305762 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:44:16.305762 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:44:16.305762 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:44:16.305762 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:44:16.305762 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02f5af29-3aff-4591-9bf0-41df8217399a could not be found. Sep 24 21:44:16.305762 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:44:16.305762 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1d42b3ca-718e-4f82-bb2c-3bc3af358ba1 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Returning 404 to user: Instance 02f5af29-3aff-4591-9bf0-41df8217399a could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:44:16.305762 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1d42b3ca-718e-4f82-bb2c-3bc3af358ba1 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 404 len: 111 microversion: 2.1 time: 0.032798 Sep 24 21:44:16.305762 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3294/6611] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:44:16 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:44:16.351485 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1c1b432e-c8df-4f99-af9d-a11ff40fca99 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1469064550", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "18903e01-4fbf-4876-9b99-27bd5d437a06"}], "security_groups": [{"name": "tempest-securitygroup--1672057739"}], "key_name": "tempest-keypair-743030895", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:44:16.461687 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-1c1b432e-c8df-4f99-af9d-a11ff40fca99 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] validate_networks() for [('18903e01-4fbf-4876-9b99-27bd5d437a06', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:44:16.885670 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-1c1b432e-c8df-4f99-af9d-a11ff40fca99 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:44:16.886161 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-1c1b432e-c8df-4f99-af9d-a11ff40fca99 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:44:16.886675 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-1c1b432e-c8df-4f99-af9d-a11ff40fca99 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:44:16.887097 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-1c1b432e-c8df-4f99-af9d-a11ff40fca99 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:44:16.887520 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-1c1b432e-c8df-4f99-af9d-a11ff40fca99 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:44:16.896944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1c1b432e-c8df-4f99-af9d-a11ff40fca99 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:16.897433 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1c1b432e-c8df-4f99-af9d-a11ff40fca99 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:16.897881 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1c1b432e-c8df-4f99-af9d-a11ff40fca99 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:16.898672 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1c1b432e-c8df-4f99-af9d-a11ff40fca99 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:16.899139 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1c1b432e-c8df-4f99-af9d-a11ff40fca99 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:16.899593 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1c1b432e-c8df-4f99-af9d-a11ff40fca99 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:16.916294 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-1c1b432e-c8df-4f99-af9d-a11ff40fca99 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Getting quotas for project f1f293bffcad4e568dccab47bfc498aa. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:44:16.921516 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-1c1b432e-c8df-4f99-af9d-a11ff40fca99 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Getting quotas for user f9bf67f92b7142298f15e941a80a07d6 and project f1f293bffcad4e568dccab47bfc498aa. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:44:16.933963 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1c1b432e-c8df-4f99-af9d-a11ff40fca99 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:44:16.936847 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1c1b432e-c8df-4f99-af9d-a11ff40fca99 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:44:16.985474 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1c1b432e-c8df-4f99-af9d-a11ff40fca99 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.637785 Sep 24 21:44:16.986130 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3318/6612] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:44:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 24 21:44:16.997294 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-43d14bfc-7c46-413c-ab5d-89e1c4be0f06 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:44:16.997914 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-43d14bfc-7c46-413c-ab5d-89e1c4be0f06 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:44:17.053288 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-43d14bfc-7c46-413c-ab5d-89e1c4be0f06 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:44:17.060330 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-43d14bfc-7c46-413c-ab5d-89e1c4be0f06 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 200 len: 1238 microversion: 2.1 time: 0.066833 Sep 24 21:44:17.061062 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3295/6613] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:44:16 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:44:18.084755 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-885d5a7b-2177-4edc-9475-0e8e5766cbbd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:44:18.086467 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-885d5a7b-2177-4edc-9475-0e8e5766cbbd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:44:18.094102 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-885d5a7b-2177-4edc-9475-0e8e5766cbbd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:18.094658 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-885d5a7b-2177-4edc-9475-0e8e5766cbbd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:18.095108 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-885d5a7b-2177-4edc-9475-0e8e5766cbbd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:18.096007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-885d5a7b-2177-4edc-9475-0e8e5766cbbd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:18.096492 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-885d5a7b-2177-4edc-9475-0e8e5766cbbd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:18.097434 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-885d5a7b-2177-4edc-9475-0e8e5766cbbd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:18.182206 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-885d5a7b-2177-4edc-9475-0e8e5766cbbd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:44:18.191507 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-885d5a7b-2177-4edc-9475-0e8e5766cbbd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 200 len: 1308 microversion: 2.1 time: 0.111633 Sep 24 21:44:18.192182 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3319/6614] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:44:18 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 1308 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:44:19.216092 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-358b66de-ceb2-429b-8807-0b5f9f027544 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:44:19.217320 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-358b66de-ceb2-429b-8807-0b5f9f027544 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:44:19.221606 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:44:19.227824 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-358b66de-ceb2-429b-8807-0b5f9f027544 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:19.228323 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-358b66de-ceb2-429b-8807-0b5f9f027544 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:19.228766 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-358b66de-ceb2-429b-8807-0b5f9f027544 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:19.229481 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-358b66de-ceb2-429b-8807-0b5f9f027544 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:19.229941 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-358b66de-ceb2-429b-8807-0b5f9f027544 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:19.230437 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-358b66de-ceb2-429b-8807-0b5f9f027544 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:19.416778 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-358b66de-ceb2-429b-8807-0b5f9f027544 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:44:19.425219 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-358b66de-ceb2-429b-8807-0b5f9f027544 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 200 len: 1364 microversion: 2.1 time: 0.213067 Sep 24 21:44:19.425928 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3296/6615] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:44:19 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 1364 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:44:19.512880 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-1f377733-d408-4fe8-bcb4-c3787b5c0386 req-98b679ef-805a-4ab4-b250-a53b28837c6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc4919bf-26da-4a87-957c-52938e8f5082", "tag": "7d8eb291-9610-4794-a20e-0a7eb3e4809a"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:44:19.528374 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:44:19.536803 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-1f377733-d408-4fe8-bcb4-c3787b5c0386 req-98b679ef-805a-4ab4-b250-a53b28837c6a service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:19.537320 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-1f377733-d408-4fe8-bcb4-c3787b5c0386 req-98b679ef-805a-4ab4-b250-a53b28837c6a service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:19.537759 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-1f377733-d408-4fe8-bcb4-c3787b5c0386 req-98b679ef-805a-4ab4-b250-a53b28837c6a service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:19.553234 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-1f377733-d408-4fe8-bcb4-c3787b5c0386 req-98b679ef-805a-4ab4-b250-a53b28837c6a service nova] Creating event network-changed:7d8eb291-9610-4794-a20e-0a7eb3e4809a for instance cc4919bf-26da-4a87-957c-52938e8f5082 on nch1-master-1 Sep 24 21:44:19.567338 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-1f377733-d408-4fe8-bcb4-c3787b5c0386 req-98b679ef-805a-4ab4-b250-a53b28837c6a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058479 Sep 24 21:44:19.567954 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3320/6616] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:44:20.449993 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-02d7fea8-0e38-401c-92ad-853c7745798b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:44:20.450546 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-02d7fea8-0e38-401c-92ad-853c7745798b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:44:20.458126 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-02d7fea8-0e38-401c-92ad-853c7745798b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:20.458659 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-02d7fea8-0e38-401c-92ad-853c7745798b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:20.459104 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-02d7fea8-0e38-401c-92ad-853c7745798b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:20.459806 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-02d7fea8-0e38-401c-92ad-853c7745798b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:20.460267 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-02d7fea8-0e38-401c-92ad-853c7745798b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:20.460702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-02d7fea8-0e38-401c-92ad-853c7745798b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:20.590305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-02d7fea8-0e38-401c-92ad-853c7745798b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:44:20.598404 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-02d7fea8-0e38-401c-92ad-853c7745798b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 200 len: 1364 microversion: 2.1 time: 0.152474 Sep 24 21:44:20.599012 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3297/6617] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:44:20 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:44:21.622866 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-597ed192-df92-4e54-bbb8-8398bf7bfdde tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:44:21.624610 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-597ed192-df92-4e54-bbb8-8398bf7bfdde tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:44:21.630908 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-597ed192-df92-4e54-bbb8-8398bf7bfdde tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:21.631396 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-597ed192-df92-4e54-bbb8-8398bf7bfdde tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:21.631841 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-597ed192-df92-4e54-bbb8-8398bf7bfdde tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:21.632546 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-597ed192-df92-4e54-bbb8-8398bf7bfdde tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:21.634035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-597ed192-df92-4e54-bbb8-8398bf7bfdde tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:21.634527 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-597ed192-df92-4e54-bbb8-8398bf7bfdde tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:21.771045 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-597ed192-df92-4e54-bbb8-8398bf7bfdde tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:44:21.778712 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-597ed192-df92-4e54-bbb8-8398bf7bfdde tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 200 len: 1364 microversion: 2.1 time: 0.161278 Sep 24 21:44:21.779295 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3321/6618] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:44:21 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:44:22.802393 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fb323137-5936-4099-8758-fdb6e610adff tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:44:22.803036 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fb323137-5936-4099-8758-fdb6e610adff tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:44:22.810145 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb323137-5936-4099-8758-fdb6e610adff tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:22.810749 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb323137-5936-4099-8758-fdb6e610adff tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:22.811411 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb323137-5936-4099-8758-fdb6e610adff tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:22.812129 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb323137-5936-4099-8758-fdb6e610adff tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:22.812571 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb323137-5936-4099-8758-fdb6e610adff tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:22.813000 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb323137-5936-4099-8758-fdb6e610adff tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:22.943222 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fb323137-5936-4099-8758-fdb6e610adff tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:44:22.950996 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fb323137-5936-4099-8758-fdb6e610adff tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 200 len: 1364 microversion: 2.1 time: 0.152766 Sep 24 21:44:22.951839 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3298/6619] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:44:22 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:44:23.974213 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-31319c06-a79f-4590-87a5-d0bd716340e5 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:44:23.974803 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-31319c06-a79f-4590-87a5-d0bd716340e5 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:44:23.981166 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-31319c06-a79f-4590-87a5-d0bd716340e5 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:23.981652 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-31319c06-a79f-4590-87a5-d0bd716340e5 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:23.982097 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-31319c06-a79f-4590-87a5-d0bd716340e5 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:23.982962 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-31319c06-a79f-4590-87a5-d0bd716340e5 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:23.983331 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-31319c06-a79f-4590-87a5-d0bd716340e5 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:23.983761 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-31319c06-a79f-4590-87a5-d0bd716340e5 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:24.112578 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-31319c06-a79f-4590-87a5-d0bd716340e5 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:44:24.120255 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-31319c06-a79f-4590-87a5-d0bd716340e5 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 200 len: 1364 microversion: 2.1 time: 0.150071 Sep 24 21:44:24.120826 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3322/6620] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:44:23 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:44:25.143912 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b3d57ff5-176e-411d-b256-905f7ead0b65 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:44:25.144540 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b3d57ff5-176e-411d-b256-905f7ead0b65 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:44:25.150776 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b3d57ff5-176e-411d-b256-905f7ead0b65 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:25.151268 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b3d57ff5-176e-411d-b256-905f7ead0b65 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:25.151716 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b3d57ff5-176e-411d-b256-905f7ead0b65 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:25.152422 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b3d57ff5-176e-411d-b256-905f7ead0b65 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:25.153018 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b3d57ff5-176e-411d-b256-905f7ead0b65 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:25.153498 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b3d57ff5-176e-411d-b256-905f7ead0b65 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:25.287700 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b3d57ff5-176e-411d-b256-905f7ead0b65 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:44:25.295771 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b3d57ff5-176e-411d-b256-905f7ead0b65 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 200 len: 1364 microversion: 2.1 time: 0.156547 Sep 24 21:44:25.296358 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3299/6621] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:44:25 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:44:25.343155 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-681a6471-7f62-4f8d-8d1a-ac868faad09b req-354f7fc7-e89a-4624-8df6-f894c2185e32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc4919bf-26da-4a87-957c-52938e8f5082", "name": "network-vif-plugged", "status": "completed", "tag": "7d8eb291-9610-4794-a20e-0a7eb3e4809a"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:44:25.356221 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-681a6471-7f62-4f8d-8d1a-ac868faad09b req-354f7fc7-e89a-4624-8df6-f894c2185e32 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:25.356802 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-681a6471-7f62-4f8d-8d1a-ac868faad09b req-354f7fc7-e89a-4624-8df6-f894c2185e32 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:25.358160 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-681a6471-7f62-4f8d-8d1a-ac868faad09b req-354f7fc7-e89a-4624-8df6-f894c2185e32 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:25.371686 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-681a6471-7f62-4f8d-8d1a-ac868faad09b req-354f7fc7-e89a-4624-8df6-f894c2185e32 service nova] Creating event network-vif-plugged:7d8eb291-9610-4794-a20e-0a7eb3e4809a for instance cc4919bf-26da-4a87-957c-52938e8f5082 on nch1-master-1 Sep 24 21:44:25.377981 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-681a6471-7f62-4f8d-8d1a-ac868faad09b req-354f7fc7-e89a-4624-8df6-f894c2185e32 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038702 Sep 24 21:44:25.378857 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3323/6622] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:44:26.320008 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2ab6564f-9426-404b-a9cb-3101abade2ff tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:44:26.320556 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2ab6564f-9426-404b-a9cb-3101abade2ff tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:44:26.327854 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2ab6564f-9426-404b-a9cb-3101abade2ff tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:26.328339 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2ab6564f-9426-404b-a9cb-3101abade2ff tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:26.328783 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2ab6564f-9426-404b-a9cb-3101abade2ff tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:26.329484 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2ab6564f-9426-404b-a9cb-3101abade2ff tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:26.329944 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2ab6564f-9426-404b-a9cb-3101abade2ff tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:26.330401 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2ab6564f-9426-404b-a9cb-3101abade2ff tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:26.466030 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2ab6564f-9426-404b-a9cb-3101abade2ff tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:44:26.474883 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2ab6564f-9426-404b-a9cb-3101abade2ff tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 200 len: 1364 microversion: 2.1 time: 0.158885 Sep 24 21:44:26.475470 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3300/6623] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:44:26 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:44:27.503738 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ef599d8b-549a-4424-8ef5-fda360f81481 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:44:27.504445 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ef599d8b-549a-4424-8ef5-fda360f81481 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:44:27.507235 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:44:27.508049 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=6 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:44:27.514559 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef599d8b-549a-4424-8ef5-fda360f81481 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:27.515264 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef599d8b-549a-4424-8ef5-fda360f81481 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:27.515818 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef599d8b-549a-4424-8ef5-fda360f81481 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:27.516535 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef599d8b-549a-4424-8ef5-fda360f81481 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:27.517039 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef599d8b-549a-4424-8ef5-fda360f81481 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:27.517511 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef599d8b-549a-4424-8ef5-fda360f81481 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:27.652286 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ef599d8b-549a-4424-8ef5-fda360f81481 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:44:27.660808 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ef599d8b-549a-4424-8ef5-fda360f81481 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 200 len: 1552 microversion: 2.1 time: 0.161333 Sep 24 21:44:27.661390 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3324/6624] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:44:27 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 1552 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:44:27.683611 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2875df12-63da-4a05-a3a2-03486da1fc2e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:44:27.684132 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2875df12-63da-4a05-a3a2-03486da1fc2e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:44:27.685962 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:44:27.692395 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2875df12-63da-4a05-a3a2-03486da1fc2e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:27.692887 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2875df12-63da-4a05-a3a2-03486da1fc2e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:27.693329 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2875df12-63da-4a05-a3a2-03486da1fc2e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:27.694034 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2875df12-63da-4a05-a3a2-03486da1fc2e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:27.694519 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2875df12-63da-4a05-a3a2-03486da1fc2e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:27.694954 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2875df12-63da-4a05-a3a2-03486da1fc2e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:27.777148 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2875df12-63da-4a05-a3a2-03486da1fc2e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097446 Sep 24 21:44:27.777794 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3301/6625] 10.222.0.52 () {58 vars in 1275 bytes} [Sat Sep 24 21:44:27 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:44:28.964294 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-421f385a-07e5-4be4-9978-3c652b5fa4ca req-37f2a948-2e31-403b-9634-75dd2f816dcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc4919bf-26da-4a87-957c-52938e8f5082", "tag": "7d8eb291-9610-4794-a20e-0a7eb3e4809a"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:44:28.975208 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-421f385a-07e5-4be4-9978-3c652b5fa4ca req-37f2a948-2e31-403b-9634-75dd2f816dcb service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:44:28.975704 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-421f385a-07e5-4be4-9978-3c652b5fa4ca req-37f2a948-2e31-403b-9634-75dd2f816dcb service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:44:28.976153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-421f385a-07e5-4be4-9978-3c652b5fa4ca req-37f2a948-2e31-403b-9634-75dd2f816dcb service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:44:28.988699 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-421f385a-07e5-4be4-9978-3c652b5fa4ca req-37f2a948-2e31-403b-9634-75dd2f816dcb service nova] Creating event network-changed:7d8eb291-9610-4794-a20e-0a7eb3e4809a for instance cc4919bf-26da-4a87-957c-52938e8f5082 on nch1-master-1 Sep 24 21:44:28.993829 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-421f385a-07e5-4be4-9978-3c652b5fa4ca req-37f2a948-2e31-403b-9634-75dd2f816dcb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033298 Sep 24 21:44:28.994684 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3325/6626] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:45:32.679474 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=11 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:45:32.680294 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=60,nova_cell1:UPDATE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:45:32.684630 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-20a15581-c608-4333-a02e-800220cbca9e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:45:32.687018 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-20a15581-c608-4333-a02e-800220cbca9e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:45:32.694720 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-20a15581-c608-4333-a02e-800220cbca9e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:32.695208 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-20a15581-c608-4333-a02e-800220cbca9e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:32.695648 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-20a15581-c608-4333-a02e-800220cbca9e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:32.696351 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-20a15581-c608-4333-a02e-800220cbca9e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:32.696808 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-20a15581-c608-4333-a02e-800220cbca9e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:32.697238 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-20a15581-c608-4333-a02e-800220cbca9e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:32.727986 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-20a15581-c608-4333-a02e-800220cbca9e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:45:32.733410 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-20a15581-c608-4333-a02e-800220cbca9e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Old instance type m1.heat2, new instance type m1.heat {{(pid=140516) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 24 21:45:32.740325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-20a15581-c608-4333-a02e-800220cbca9e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:45:32.740752 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-20a15581-c608-4333-a02e-800220cbca9e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:45:32.741232 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-20a15581-c608-4333-a02e-800220cbca9e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:45:32.741643 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-20a15581-c608-4333-a02e-800220cbca9e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:45:32.742055 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-20a15581-c608-4333-a02e-800220cbca9e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:45:32.809009 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-20a15581-c608-4333-a02e-800220cbca9e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "POST /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082/action" status: 202 len: 0 microversion: 2.1 time: 0.132156 Sep 24 21:45:32.809659 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3302/6627] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:45:32 2022] POST /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:45:32.817548 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=11 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:45:32.818560 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=48 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:45:32.823334 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6dc7a24f-cc82-4a27-bd9a-7dde3c3aef9d tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:45:32.824046 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6dc7a24f-cc82-4a27-bd9a-7dde3c3aef9d tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:45:32.832037 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6dc7a24f-cc82-4a27-bd9a-7dde3c3aef9d tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:32.832533 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6dc7a24f-cc82-4a27-bd9a-7dde3c3aef9d tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:32.832977 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6dc7a24f-cc82-4a27-bd9a-7dde3c3aef9d tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:32.833762 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6dc7a24f-cc82-4a27-bd9a-7dde3c3aef9d tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:32.834226 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6dc7a24f-cc82-4a27-bd9a-7dde3c3aef9d tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:32.834757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6dc7a24f-cc82-4a27-bd9a-7dde3c3aef9d tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:32.991064 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6dc7a24f-cc82-4a27-bd9a-7dde3c3aef9d tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:45:32.999448 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6dc7a24f-cc82-4a27-bd9a-7dde3c3aef9d tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 200 len: 1680 microversion: 2.1 time: 0.184672 Sep 24 21:45:33.000306 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3326/6628] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:45:32 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 1680 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:45:34.023559 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8b952101-8b26-410b-9ddf-230143ba2502 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:45:34.024207 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8b952101-8b26-410b-9ddf-230143ba2502 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:45:34.033908 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8b952101-8b26-410b-9ddf-230143ba2502 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:34.034399 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8b952101-8b26-410b-9ddf-230143ba2502 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:34.034861 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8b952101-8b26-410b-9ddf-230143ba2502 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:34.036073 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8b952101-8b26-410b-9ddf-230143ba2502 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:34.036744 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8b952101-8b26-410b-9ddf-230143ba2502 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:34.037179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8b952101-8b26-410b-9ddf-230143ba2502 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:34.282360 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8b952101-8b26-410b-9ddf-230143ba2502 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:45:34.290737 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8b952101-8b26-410b-9ddf-230143ba2502 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 200 len: 1680 microversion: 2.1 time: 0.271881 Sep 24 21:45:34.291329 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3303/6629] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:45:34 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 1680 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:45:35.314487 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3e89d167-7e73-41e0-8cde-9ffd0c6445d7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:45:35.315139 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3e89d167-7e73-41e0-8cde-9ffd0c6445d7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:45:35.322526 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e89d167-7e73-41e0-8cde-9ffd0c6445d7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:35.323047 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e89d167-7e73-41e0-8cde-9ffd0c6445d7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:35.323500 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e89d167-7e73-41e0-8cde-9ffd0c6445d7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:35.324220 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e89d167-7e73-41e0-8cde-9ffd0c6445d7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:35.324693 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e89d167-7e73-41e0-8cde-9ffd0c6445d7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:35.325134 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e89d167-7e73-41e0-8cde-9ffd0c6445d7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:35.456163 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3e89d167-7e73-41e0-8cde-9ffd0c6445d7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:45:35.463987 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3e89d167-7e73-41e0-8cde-9ffd0c6445d7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 200 len: 1685 microversion: 2.1 time: 0.154102 Sep 24 21:45:35.464563 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3327/6630] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:45:35 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:45:36.487901 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d5145f72-1367-4cd0-9ea0-76c5c27104af tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:45:36.488516 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d5145f72-1367-4cd0-9ea0-76c5c27104af tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:45:36.495397 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d5145f72-1367-4cd0-9ea0-76c5c27104af tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:36.495880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d5145f72-1367-4cd0-9ea0-76c5c27104af tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:36.496321 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d5145f72-1367-4cd0-9ea0-76c5c27104af tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:36.497014 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d5145f72-1367-4cd0-9ea0-76c5c27104af tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:36.497472 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d5145f72-1367-4cd0-9ea0-76c5c27104af tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:36.497919 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d5145f72-1367-4cd0-9ea0-76c5c27104af tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:36.625750 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d5145f72-1367-4cd0-9ea0-76c5c27104af tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:45:36.633789 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d5145f72-1367-4cd0-9ea0-76c5c27104af tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 200 len: 1685 microversion: 2.1 time: 0.149909 Sep 24 21:45:36.638564 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3304/6631] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:45:36 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 1685 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:45:37.658152 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c6f6ae88-fceb-4a9b-a9e5-e576f0ff1680 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:45:37.658906 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c6f6ae88-fceb-4a9b-a9e5-e576f0ff1680 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:45:37.666222 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c6f6ae88-fceb-4a9b-a9e5-e576f0ff1680 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:37.666753 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c6f6ae88-fceb-4a9b-a9e5-e576f0ff1680 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:37.667210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c6f6ae88-fceb-4a9b-a9e5-e576f0ff1680 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:37.667924 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c6f6ae88-fceb-4a9b-a9e5-e576f0ff1680 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:37.668392 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c6f6ae88-fceb-4a9b-a9e5-e576f0ff1680 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:37.668830 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c6f6ae88-fceb-4a9b-a9e5-e576f0ff1680 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:37.803713 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c6f6ae88-fceb-4a9b-a9e5-e576f0ff1680 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:45:37.811575 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c6f6ae88-fceb-4a9b-a9e5-e576f0ff1680 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 200 len: 1685 microversion: 2.1 time: 0.158306 Sep 24 21:45:37.812161 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3328/6632] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:45:37 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:45:38.835412 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9cf6a811-92f3-4726-93af-70d38a548e64 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:45:38.836036 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9cf6a811-92f3-4726-93af-70d38a548e64 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:45:38.843030 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9cf6a811-92f3-4726-93af-70d38a548e64 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:38.843518 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9cf6a811-92f3-4726-93af-70d38a548e64 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:38.843963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9cf6a811-92f3-4726-93af-70d38a548e64 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:38.844655 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9cf6a811-92f3-4726-93af-70d38a548e64 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:38.845118 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9cf6a811-92f3-4726-93af-70d38a548e64 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:38.845768 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9cf6a811-92f3-4726-93af-70d38a548e64 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:38.975604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9cf6a811-92f3-4726-93af-70d38a548e64 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:45:38.983397 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9cf6a811-92f3-4726-93af-70d38a548e64 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 200 len: 1685 microversion: 2.1 time: 0.151940 Sep 24 21:45:38.983980 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3305/6633] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:45:38 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 1685 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:45:40.006732 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f7ac3e5a-9edd-4cf0-a143-20c125db4928 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:45:40.008195 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f7ac3e5a-9edd-4cf0-a143-20c125db4928 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:45:40.016835 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7ac3e5a-9edd-4cf0-a143-20c125db4928 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:40.017984 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7ac3e5a-9edd-4cf0-a143-20c125db4928 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:40.018432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7ac3e5a-9edd-4cf0-a143-20c125db4928 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:40.019172 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7ac3e5a-9edd-4cf0-a143-20c125db4928 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:40.019631 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7ac3e5a-9edd-4cf0-a143-20c125db4928 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:40.020062 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7ac3e5a-9edd-4cf0-a143-20c125db4928 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:40.152416 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f7ac3e5a-9edd-4cf0-a143-20c125db4928 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:45:40.160556 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f7ac3e5a-9edd-4cf0-a143-20c125db4928 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 200 len: 1685 microversion: 2.1 time: 0.157792 Sep 24 21:45:40.161162 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3329/6634] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:45:40 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:45:41.184315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d658613c-bfc9-40b9-92ed-0a1726800856 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:45:41.184940 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d658613c-bfc9-40b9-92ed-0a1726800856 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:45:41.191980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d658613c-bfc9-40b9-92ed-0a1726800856 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:41.192472 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d658613c-bfc9-40b9-92ed-0a1726800856 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:41.192915 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d658613c-bfc9-40b9-92ed-0a1726800856 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:41.193619 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d658613c-bfc9-40b9-92ed-0a1726800856 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:41.194078 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d658613c-bfc9-40b9-92ed-0a1726800856 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:41.194530 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d658613c-bfc9-40b9-92ed-0a1726800856 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:41.327408 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d658613c-bfc9-40b9-92ed-0a1726800856 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:45:41.335876 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d658613c-bfc9-40b9-92ed-0a1726800856 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 200 len: 1685 microversion: 2.1 time: 0.155489 Sep 24 21:45:41.336464 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3306/6635] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:45:41 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:45:42.359289 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9c873b82-3a17-4fcc-8c12-a6b1a49de4b8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:45:42.359914 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9c873b82-3a17-4fcc-8c12-a6b1a49de4b8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:45:42.367698 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c873b82-3a17-4fcc-8c12-a6b1a49de4b8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:42.368191 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c873b82-3a17-4fcc-8c12-a6b1a49de4b8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:42.368642 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c873b82-3a17-4fcc-8c12-a6b1a49de4b8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:42.369347 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c873b82-3a17-4fcc-8c12-a6b1a49de4b8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:42.369812 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c873b82-3a17-4fcc-8c12-a6b1a49de4b8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:42.370243 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9c873b82-3a17-4fcc-8c12-a6b1a49de4b8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:42.505509 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9c873b82-3a17-4fcc-8c12-a6b1a49de4b8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:45:42.513441 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9c873b82-3a17-4fcc-8c12-a6b1a49de4b8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 200 len: 1685 microversion: 2.1 time: 0.158092 Sep 24 21:45:42.514012 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3330/6636] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:45:42 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:45:43.537722 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e57bd2ff-2101-4a14-a31f-ffc77baa92cc tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:45:43.538398 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e57bd2ff-2101-4a14-a31f-ffc77baa92cc tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:45:43.545371 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e57bd2ff-2101-4a14-a31f-ffc77baa92cc tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:43.545854 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e57bd2ff-2101-4a14-a31f-ffc77baa92cc tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:43.546289 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e57bd2ff-2101-4a14-a31f-ffc77baa92cc tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:43.547016 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e57bd2ff-2101-4a14-a31f-ffc77baa92cc tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:43.547474 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e57bd2ff-2101-4a14-a31f-ffc77baa92cc tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:43.547903 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e57bd2ff-2101-4a14-a31f-ffc77baa92cc tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:43.679847 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e57bd2ff-2101-4a14-a31f-ffc77baa92cc tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:45:43.688369 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e57bd2ff-2101-4a14-a31f-ffc77baa92cc tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 200 len: 1685 microversion: 2.1 time: 0.154542 Sep 24 21:45:43.689561 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3307/6637] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:45:43 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:45:44.712185 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-212315b0-0b87-4905-a90b-424556c85241 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:45:44.712832 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-212315b0-0b87-4905-a90b-424556c85241 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:45:44.721600 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-212315b0-0b87-4905-a90b-424556c85241 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:44.722095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-212315b0-0b87-4905-a90b-424556c85241 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:44.722565 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-212315b0-0b87-4905-a90b-424556c85241 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:44.723366 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-212315b0-0b87-4905-a90b-424556c85241 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:44.723905 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-212315b0-0b87-4905-a90b-424556c85241 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:44.724340 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-212315b0-0b87-4905-a90b-424556c85241 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:44.860666 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-212315b0-0b87-4905-a90b-424556c85241 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:45:44.868492 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-212315b0-0b87-4905-a90b-424556c85241 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 200 len: 1685 microversion: 2.1 time: 0.160251 Sep 24 21:45:44.869076 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3331/6638] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:45:44 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:45:45.892923 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-15226e23-ea2b-46b3-94d3-e19924e15a54 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:45:45.893492 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-15226e23-ea2b-46b3-94d3-e19924e15a54 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:45:45.900441 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-15226e23-ea2b-46b3-94d3-e19924e15a54 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:45.900933 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-15226e23-ea2b-46b3-94d3-e19924e15a54 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:45.901375 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-15226e23-ea2b-46b3-94d3-e19924e15a54 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:45.902074 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-15226e23-ea2b-46b3-94d3-e19924e15a54 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:45.902561 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-15226e23-ea2b-46b3-94d3-e19924e15a54 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:45.902992 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-15226e23-ea2b-46b3-94d3-e19924e15a54 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:46.035730 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-15226e23-ea2b-46b3-94d3-e19924e15a54 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:45:46.043635 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-15226e23-ea2b-46b3-94d3-e19924e15a54 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 200 len: 1685 microversion: 2.1 time: 0.155448 Sep 24 21:45:46.044217 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3308/6639] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:45:45 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:45:47.069021 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-84cd9756-1aeb-4462-b021-3a6a1b431838 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:45:47.069644 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-84cd9756-1aeb-4462-b021-3a6a1b431838 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:45:47.076482 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84cd9756-1aeb-4462-b021-3a6a1b431838 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:47.076974 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84cd9756-1aeb-4462-b021-3a6a1b431838 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:47.077426 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84cd9756-1aeb-4462-b021-3a6a1b431838 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:47.078136 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84cd9756-1aeb-4462-b021-3a6a1b431838 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:47.078632 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84cd9756-1aeb-4462-b021-3a6a1b431838 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:47.079073 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-84cd9756-1aeb-4462-b021-3a6a1b431838 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:47.407159 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-13669243-c79c-43bc-84d1-ecf2e3d85d9a req-69fbb9fd-d755-4f06-81b9-a9e08ae6cfda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc4919bf-26da-4a87-957c-52938e8f5082", "name": "network-vif-unplugged", "status": "completed", "tag": "7d8eb291-9610-4794-a20e-0a7eb3e4809a"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:45:47.418259 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-13669243-c79c-43bc-84d1-ecf2e3d85d9a req-69fbb9fd-d755-4f06-81b9-a9e08ae6cfda service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:47.418747 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-13669243-c79c-43bc-84d1-ecf2e3d85d9a req-69fbb9fd-d755-4f06-81b9-a9e08ae6cfda service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:47.419131 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-13669243-c79c-43bc-84d1-ecf2e3d85d9a req-69fbb9fd-d755-4f06-81b9-a9e08ae6cfda service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:47.432592 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-13669243-c79c-43bc-84d1-ecf2e3d85d9a req-69fbb9fd-d755-4f06-81b9-a9e08ae6cfda service nova] Creating event network-vif-unplugged:7d8eb291-9610-4794-a20e-0a7eb3e4809a for instance cc4919bf-26da-4a87-957c-52938e8f5082 on nch2-master-1 Sep 24 21:45:47.440897 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [req-13669243-c79c-43bc-84d1-ecf2e3d85d9a req-69fbb9fd-d755-4f06-81b9-a9e08ae6cfda service nova] Instance cc4919bf-26da-4a87-957c-52938e8f5082 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 21:45:47.452275 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-13669243-c79c-43bc-84d1-ecf2e3d85d9a req-69fbb9fd-d755-4f06-81b9-a9e08ae6cfda service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048853 Sep 24 21:45:47.454027 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3309/6640] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:45:47.566077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-84cd9756-1aeb-4462-b021-3a6a1b431838 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:45:47.574037 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-84cd9756-1aeb-4462-b021-3a6a1b431838 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 200 len: 1684 microversion: 2.1 time: 0.509005 Sep 24 21:45:47.574628 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3332/6641] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:45:47 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 1684 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:45:48.599735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c405d0d1-8302-40eb-9e32-4dbac5f889fc tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:45:48.600446 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c405d0d1-8302-40eb-9e32-4dbac5f889fc tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:45:48.606693 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c405d0d1-8302-40eb-9e32-4dbac5f889fc tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:48.607193 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c405d0d1-8302-40eb-9e32-4dbac5f889fc tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:48.607635 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c405d0d1-8302-40eb-9e32-4dbac5f889fc tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:48.608343 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c405d0d1-8302-40eb-9e32-4dbac5f889fc tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:48.608804 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c405d0d1-8302-40eb-9e32-4dbac5f889fc tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:48.609243 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c405d0d1-8302-40eb-9e32-4dbac5f889fc tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:48.745739 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c405d0d1-8302-40eb-9e32-4dbac5f889fc tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:45:48.755174 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c405d0d1-8302-40eb-9e32-4dbac5f889fc tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 200 len: 1682 microversion: 2.1 time: 0.160501 Sep 24 21:45:48.755902 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3310/6642] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:45:48 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:45:49.483866 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-cfd7e710-f244-4be6-8949-34eeb07caa04 req-1ed9dcc9-7882-44a5-a133-da66d26a0d31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc4919bf-26da-4a87-957c-52938e8f5082", "tag": "7d8eb291-9610-4794-a20e-0a7eb3e4809a"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:45:49.494557 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-cfd7e710-f244-4be6-8949-34eeb07caa04 req-1ed9dcc9-7882-44a5-a133-da66d26a0d31 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:49.495056 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-cfd7e710-f244-4be6-8949-34eeb07caa04 req-1ed9dcc9-7882-44a5-a133-da66d26a0d31 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:49.495501 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-cfd7e710-f244-4be6-8949-34eeb07caa04 req-1ed9dcc9-7882-44a5-a133-da66d26a0d31 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:49.508205 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-cfd7e710-f244-4be6-8949-34eeb07caa04 req-1ed9dcc9-7882-44a5-a133-da66d26a0d31 service nova] Creating event network-changed:7d8eb291-9610-4794-a20e-0a7eb3e4809a for instance cc4919bf-26da-4a87-957c-52938e8f5082 on nch2-master-1 Sep 24 21:45:49.514071 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [req-cfd7e710-f244-4be6-8949-34eeb07caa04 req-1ed9dcc9-7882-44a5-a133-da66d26a0d31 service nova] Instance cc4919bf-26da-4a87-957c-52938e8f5082 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 21:45:49.525910 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-cfd7e710-f244-4be6-8949-34eeb07caa04 req-1ed9dcc9-7882-44a5-a133-da66d26a0d31 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045831 Sep 24 21:45:49.527072 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3333/6643] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:45:49.779115 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-caa98927-2840-494b-95d2-6b4d4a1907ec tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:45:49.779731 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-caa98927-2840-494b-95d2-6b4d4a1907ec tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:45:49.786868 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-caa98927-2840-494b-95d2-6b4d4a1907ec tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:49.787362 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-caa98927-2840-494b-95d2-6b4d4a1907ec tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:49.787803 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-caa98927-2840-494b-95d2-6b4d4a1907ec tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:49.788511 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-caa98927-2840-494b-95d2-6b4d4a1907ec tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:49.788969 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-caa98927-2840-494b-95d2-6b4d4a1907ec tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:49.789398 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-caa98927-2840-494b-95d2-6b4d4a1907ec tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:50.104506 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-caa98927-2840-494b-95d2-6b4d4a1907ec tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:45:50.115190 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-caa98927-2840-494b-95d2-6b4d4a1907ec tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 200 len: 1682 microversion: 2.1 time: 0.339989 Sep 24 21:45:50.115785 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3311/6644] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:45:49 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 1682 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:45:51.139990 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8741e79a-f768-4f75-a6eb-d6d1e110f909 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:45:51.140738 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8741e79a-f768-4f75-a6eb-d6d1e110f909 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:45:51.148500 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8741e79a-f768-4f75-a6eb-d6d1e110f909 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:51.148997 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8741e79a-f768-4f75-a6eb-d6d1e110f909 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:51.149447 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8741e79a-f768-4f75-a6eb-d6d1e110f909 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:51.150158 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8741e79a-f768-4f75-a6eb-d6d1e110f909 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:51.150661 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8741e79a-f768-4f75-a6eb-d6d1e110f909 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:51.151102 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8741e79a-f768-4f75-a6eb-d6d1e110f909 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:51.288239 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8741e79a-f768-4f75-a6eb-d6d1e110f909 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:45:51.296033 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8741e79a-f768-4f75-a6eb-d6d1e110f909 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 200 len: 1679 microversion: 2.1 time: 0.160343 Sep 24 21:45:51.296603 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3334/6645] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:45:51 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:45:51.319558 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-abce041b-2ad5-4f1e-94d5-08bf8c10c3c7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:45:51.320116 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-abce041b-2ad5-4f1e-94d5-08bf8c10c3c7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:45:51.327074 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-abce041b-2ad5-4f1e-94d5-08bf8c10c3c7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:51.327566 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-abce041b-2ad5-4f1e-94d5-08bf8c10c3c7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:51.328012 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-abce041b-2ad5-4f1e-94d5-08bf8c10c3c7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:51.328723 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-abce041b-2ad5-4f1e-94d5-08bf8c10c3c7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:51.329187 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-abce041b-2ad5-4f1e-94d5-08bf8c10c3c7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:51.329625 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-abce041b-2ad5-4f1e-94d5-08bf8c10c3c7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:51.368316 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-abce041b-2ad5-4f1e-94d5-08bf8c10c3c7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:51.368799 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-abce041b-2ad5-4f1e-94d5-08bf8c10c3c7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:51.369269 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-abce041b-2ad5-4f1e-94d5-08bf8c10c3c7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:51.370008 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-abce041b-2ad5-4f1e-94d5-08bf8c10c3c7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:51.370474 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-abce041b-2ad5-4f1e-94d5-08bf8c10c3c7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:51.370937 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-abce041b-2ad5-4f1e-94d5-08bf8c10c3c7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:51.391254 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-abce041b-2ad5-4f1e-94d5-08bf8c10c3c7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Getting quotas for project f1f293bffcad4e568dccab47bfc498aa. Resources: {'ram', 'cores'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:45:51.397183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-abce041b-2ad5-4f1e-94d5-08bf8c10c3c7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Getting quotas for user f9bf67f92b7142298f15e941a80a07d6 and project f1f293bffcad4e568dccab47bfc498aa. Resources: {'ram', 'cores'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:45:51.501920 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-abce041b-2ad5-4f1e-94d5-08bf8c10c3c7 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "POST /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082/action" status: 202 len: 0 microversion: 2.1 time: 0.185947 Sep 24 21:45:51.503005 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3312/6646] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:45:51 2022] POST /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:45:51.511293 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b7563dc3-ad72-4e9e-9f54-10d65ead5790 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:45:51.511921 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b7563dc3-ad72-4e9e-9f54-10d65ead5790 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:45:51.519007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b7563dc3-ad72-4e9e-9f54-10d65ead5790 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:51.519552 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b7563dc3-ad72-4e9e-9f54-10d65ead5790 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:51.519957 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b7563dc3-ad72-4e9e-9f54-10d65ead5790 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:51.520682 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b7563dc3-ad72-4e9e-9f54-10d65ead5790 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:51.521147 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b7563dc3-ad72-4e9e-9f54-10d65ead5790 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:51.521583 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b7563dc3-ad72-4e9e-9f54-10d65ead5790 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:51.721921 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b7563dc3-ad72-4e9e-9f54-10d65ead5790 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:45:51.729809 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b7563dc3-ad72-4e9e-9f54-10d65ead5790 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 200 len: 1678 microversion: 2.1 time: 0.222583 Sep 24 21:45:51.730373 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3335/6647] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:45:51 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 1678 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:45:52.720312 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-8b5608da-3aeb-4070-a303-b31a3b669b1e req-731719ea-1dea-4150-8b4c-71c999a2f184 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc4919bf-26da-4a87-957c-52938e8f5082", "name": "network-vif-plugged", "status": "completed", "tag": "7d8eb291-9610-4794-a20e-0a7eb3e4809a"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:45:52.731316 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-8b5608da-3aeb-4070-a303-b31a3b669b1e req-731719ea-1dea-4150-8b4c-71c999a2f184 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:52.731807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-8b5608da-3aeb-4070-a303-b31a3b669b1e req-731719ea-1dea-4150-8b4c-71c999a2f184 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:52.732246 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-8b5608da-3aeb-4070-a303-b31a3b669b1e req-731719ea-1dea-4150-8b4c-71c999a2f184 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:52.744811 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-8b5608da-3aeb-4070-a303-b31a3b669b1e req-731719ea-1dea-4150-8b4c-71c999a2f184 service nova] Creating event network-vif-plugged:7d8eb291-9610-4794-a20e-0a7eb3e4809a for instance cc4919bf-26da-4a87-957c-52938e8f5082 on nch2-master-1 Sep 24 21:45:52.750799 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [req-8b5608da-3aeb-4070-a303-b31a3b669b1e req-731719ea-1dea-4150-8b4c-71c999a2f184 service nova] Instance cc4919bf-26da-4a87-957c-52938e8f5082 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 21:45:52.755287 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1cd34bc4-ad97-41b3-9dc6-eccce9524e7d tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:45:52.756560 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1cd34bc4-ad97-41b3-9dc6-eccce9524e7d tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:45:52.762706 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-8b5608da-3aeb-4070-a303-b31a3b669b1e req-731719ea-1dea-4150-8b4c-71c999a2f184 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048146 Sep 24 21:45:52.763329 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3313/6648] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:45:52.765335 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1cd34bc4-ad97-41b3-9dc6-eccce9524e7d tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:52.765892 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1cd34bc4-ad97-41b3-9dc6-eccce9524e7d tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:52.766489 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1cd34bc4-ad97-41b3-9dc6-eccce9524e7d tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:52.767158 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1cd34bc4-ad97-41b3-9dc6-eccce9524e7d tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:52.768280 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1cd34bc4-ad97-41b3-9dc6-eccce9524e7d tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:52.769004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1cd34bc4-ad97-41b3-9dc6-eccce9524e7d tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:52.906462 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1cd34bc4-ad97-41b3-9dc6-eccce9524e7d tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:45:52.914653 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1cd34bc4-ad97-41b3-9dc6-eccce9524e7d tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 200 len: 1678 microversion: 2.1 time: 0.164743 Sep 24 21:45:52.915239 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3336/6649] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:45:52 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:45:53.940691 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ea99bce2-2fd0-4af4-b9af-8c9de6a6cf5f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:45:53.941351 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ea99bce2-2fd0-4af4-b9af-8c9de6a6cf5f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:45:53.948418 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea99bce2-2fd0-4af4-b9af-8c9de6a6cf5f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:53.948905 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea99bce2-2fd0-4af4-b9af-8c9de6a6cf5f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:53.949346 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea99bce2-2fd0-4af4-b9af-8c9de6a6cf5f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:53.950048 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea99bce2-2fd0-4af4-b9af-8c9de6a6cf5f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:53.950526 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea99bce2-2fd0-4af4-b9af-8c9de6a6cf5f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:53.950959 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea99bce2-2fd0-4af4-b9af-8c9de6a6cf5f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:54.090666 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ea99bce2-2fd0-4af4-b9af-8c9de6a6cf5f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:45:54.094541 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:45:54.100378 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ea99bce2-2fd0-4af4-b9af-8c9de6a6cf5f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 200 len: 1678 microversion: 2.1 time: 0.165468 Sep 24 21:45:54.100959 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3314/6650] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:45:53 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:45:54.708534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-b69c5a2b-6007-4b12-9e83-3458a0643782 req-ae307fbd-6c0d-4c30-8c16-dc2ce01f1bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc4919bf-26da-4a87-957c-52938e8f5082", "name": "network-vif-unplugged", "status": "completed", "tag": "7d8eb291-9610-4794-a20e-0a7eb3e4809a"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:45:54.719676 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-b69c5a2b-6007-4b12-9e83-3458a0643782 req-ae307fbd-6c0d-4c30-8c16-dc2ce01f1bf1 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:54.720012 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-b69c5a2b-6007-4b12-9e83-3458a0643782 req-ae307fbd-6c0d-4c30-8c16-dc2ce01f1bf1 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:54.720695 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-b69c5a2b-6007-4b12-9e83-3458a0643782 req-ae307fbd-6c0d-4c30-8c16-dc2ce01f1bf1 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:54.733645 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-b69c5a2b-6007-4b12-9e83-3458a0643782 req-ae307fbd-6c0d-4c30-8c16-dc2ce01f1bf1 service nova] Creating event network-vif-unplugged:7d8eb291-9610-4794-a20e-0a7eb3e4809a for instance cc4919bf-26da-4a87-957c-52938e8f5082 on nch1-master-1 Sep 24 21:45:54.739911 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [req-b69c5a2b-6007-4b12-9e83-3458a0643782 req-ae307fbd-6c0d-4c30-8c16-dc2ce01f1bf1 service nova] Instance cc4919bf-26da-4a87-957c-52938e8f5082 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 21:45:54.752668 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-b69c5a2b-6007-4b12-9e83-3458a0643782 req-ae307fbd-6c0d-4c30-8c16-dc2ce01f1bf1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049445 Sep 24 21:45:54.754256 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3337/6651] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:45:55.124289 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e85075fb-eb1e-463b-a3e1-181f3bfb1f4f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:45:55.125033 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e85075fb-eb1e-463b-a3e1-181f3bfb1f4f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:45:55.132604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e85075fb-eb1e-463b-a3e1-181f3bfb1f4f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:55.133120 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e85075fb-eb1e-463b-a3e1-181f3bfb1f4f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:55.133571 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e85075fb-eb1e-463b-a3e1-181f3bfb1f4f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:55.134294 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e85075fb-eb1e-463b-a3e1-181f3bfb1f4f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:55.134796 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e85075fb-eb1e-463b-a3e1-181f3bfb1f4f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:55.135233 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e85075fb-eb1e-463b-a3e1-181f3bfb1f4f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:55.388315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e85075fb-eb1e-463b-a3e1-181f3bfb1f4f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:45:55.397063 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e85075fb-eb1e-463b-a3e1-181f3bfb1f4f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 200 len: 1678 microversion: 2.1 time: 0.276869 Sep 24 21:45:55.397747 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3315/6652] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:45:55 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 1678 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:45:56.422821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ef88d810-8ae9-42b1-8619-469b1b8bfa3c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:45:56.423541 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ef88d810-8ae9-42b1-8619-469b1b8bfa3c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:45:56.430154 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef88d810-8ae9-42b1-8619-469b1b8bfa3c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:56.430688 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef88d810-8ae9-42b1-8619-469b1b8bfa3c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:56.431145 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef88d810-8ae9-42b1-8619-469b1b8bfa3c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:56.431855 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef88d810-8ae9-42b1-8619-469b1b8bfa3c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:56.432326 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef88d810-8ae9-42b1-8619-469b1b8bfa3c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:56.432789 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef88d810-8ae9-42b1-8619-469b1b8bfa3c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:56.570046 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ef88d810-8ae9-42b1-8619-469b1b8bfa3c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:45:56.577956 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ef88d810-8ae9-42b1-8619-469b1b8bfa3c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 200 len: 1678 microversion: 2.1 time: 0.160364 Sep 24 21:45:56.578552 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3338/6653] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:45:56 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:45:56.772077 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-c2ff0a39-496e-420a-b645-f57ecb5d372e req-a3ee43d1-0789-44b7-85c1-0b4b9e9b920d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc4919bf-26da-4a87-957c-52938e8f5082", "tag": "7d8eb291-9610-4794-a20e-0a7eb3e4809a"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:45:56.782253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c2ff0a39-496e-420a-b645-f57ecb5d372e req-a3ee43d1-0789-44b7-85c1-0b4b9e9b920d service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:56.782782 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c2ff0a39-496e-420a-b645-f57ecb5d372e req-a3ee43d1-0789-44b7-85c1-0b4b9e9b920d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:56.783222 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c2ff0a39-496e-420a-b645-f57ecb5d372e req-a3ee43d1-0789-44b7-85c1-0b4b9e9b920d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:56.796000 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-c2ff0a39-496e-420a-b645-f57ecb5d372e req-a3ee43d1-0789-44b7-85c1-0b4b9e9b920d service nova] Creating event network-changed:7d8eb291-9610-4794-a20e-0a7eb3e4809a for instance cc4919bf-26da-4a87-957c-52938e8f5082 on nch1-master-1 Sep 24 21:45:56.802312 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [req-c2ff0a39-496e-420a-b645-f57ecb5d372e req-a3ee43d1-0789-44b7-85c1-0b4b9e9b920d service nova] Instance cc4919bf-26da-4a87-957c-52938e8f5082 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 21:45:56.812740 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-c2ff0a39-496e-420a-b645-f57ecb5d372e req-a3ee43d1-0789-44b7-85c1-0b4b9e9b920d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044714 Sep 24 21:45:56.813327 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3316/6654] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:45:57.602267 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7559b42d-a9d7-4d1d-998c-416587b31ce6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:45:57.602836 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7559b42d-a9d7-4d1d-998c-416587b31ce6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:45:57.609729 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7559b42d-a9d7-4d1d-998c-416587b31ce6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:57.610220 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7559b42d-a9d7-4d1d-998c-416587b31ce6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:57.610722 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7559b42d-a9d7-4d1d-998c-416587b31ce6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:57.611435 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7559b42d-a9d7-4d1d-998c-416587b31ce6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:57.611904 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7559b42d-a9d7-4d1d-998c-416587b31ce6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:57.612343 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7559b42d-a9d7-4d1d-998c-416587b31ce6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:57.741586 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7559b42d-a9d7-4d1d-998c-416587b31ce6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:45:57.750173 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7559b42d-a9d7-4d1d-998c-416587b31ce6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 200 len: 1678 microversion: 2.1 time: 0.151841 Sep 24 21:45:57.751177 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3339/6655] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:45:57 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:45:58.775882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8993428b-45d4-41a3-8ab4-a35608f2f837 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:45:58.776698 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8993428b-45d4-41a3-8ab4-a35608f2f837 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:45:58.783740 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8993428b-45d4-41a3-8ab4-a35608f2f837 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:58.785163 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8993428b-45d4-41a3-8ab4-a35608f2f837 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:58.785743 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8993428b-45d4-41a3-8ab4-a35608f2f837 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:58.786740 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8993428b-45d4-41a3-8ab4-a35608f2f837 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:45:58.787433 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8993428b-45d4-41a3-8ab4-a35608f2f837 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:45:58.788066 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8993428b-45d4-41a3-8ab4-a35608f2f837 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:45:59.013291 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8993428b-45d4-41a3-8ab4-a35608f2f837 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:45:59.021607 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8993428b-45d4-41a3-8ab4-a35608f2f837 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 200 len: 1678 microversion: 2.1 time: 0.249901 Sep 24 21:45:59.022222 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3317/6656] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:45:58 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 1678 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:46:00.044999 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f9fac6d0-0a8d-4064-9453-a4bc1f3ec398 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:46:00.045647 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f9fac6d0-0a8d-4064-9453-a4bc1f3ec398 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:46:00.055645 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f9fac6d0-0a8d-4064-9453-a4bc1f3ec398 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:00.056087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f9fac6d0-0a8d-4064-9453-a4bc1f3ec398 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:00.056535 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f9fac6d0-0a8d-4064-9453-a4bc1f3ec398 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:00.057250 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f9fac6d0-0a8d-4064-9453-a4bc1f3ec398 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:00.057716 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f9fac6d0-0a8d-4064-9453-a4bc1f3ec398 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:00.058150 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f9fac6d0-0a8d-4064-9453-a4bc1f3ec398 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:00.192737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f9fac6d0-0a8d-4064-9453-a4bc1f3ec398 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:46:00.201794 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f9fac6d0-0a8d-4064-9453-a4bc1f3ec398 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 200 len: 1671 microversion: 2.1 time: 0.160555 Sep 24 21:46:00.202460 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3340/6657] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:46:00 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:46:00.225279 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7163e9a9-2056-41a4-b4f8-220b876fc561 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:46:00.225906 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7163e9a9-2056-41a4-b4f8-220b876fc561 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:46:00.232904 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7163e9a9-2056-41a4-b4f8-220b876fc561 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:00.233397 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7163e9a9-2056-41a4-b4f8-220b876fc561 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:00.233848 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7163e9a9-2056-41a4-b4f8-220b876fc561 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:00.234579 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7163e9a9-2056-41a4-b4f8-220b876fc561 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:00.235050 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7163e9a9-2056-41a4-b4f8-220b876fc561 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:00.235488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7163e9a9-2056-41a4-b4f8-220b876fc561 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:00.367581 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7163e9a9-2056-41a4-b4f8-220b876fc561 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:46:00.375399 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7163e9a9-2056-41a4-b4f8-220b876fc561 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 200 len: 1671 microversion: 2.1 time: 0.154761 Sep 24 21:46:00.375982 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3318/6658] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:46:00 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:46:00.398173 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-774dee2b-13d2-406c-955b-ab8d8b005cbd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:46:00.398750 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-774dee2b-13d2-406c-955b-ab8d8b005cbd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:46:00.404939 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-774dee2b-13d2-406c-955b-ab8d8b005cbd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:00.405432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-774dee2b-13d2-406c-955b-ab8d8b005cbd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:00.405874 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-774dee2b-13d2-406c-955b-ab8d8b005cbd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:00.406614 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-774dee2b-13d2-406c-955b-ab8d8b005cbd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:00.407080 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-774dee2b-13d2-406c-955b-ab8d8b005cbd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:00.407511 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-774dee2b-13d2-406c-955b-ab8d8b005cbd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:00.535701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-774dee2b-13d2-406c-955b-ab8d8b005cbd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:46:00.543470 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-774dee2b-13d2-406c-955b-ab8d8b005cbd tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 200 len: 1671 microversion: 2.1 time: 0.150083 Sep 24 21:46:00.544046 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3341/6659] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:46:00 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 1671 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:46:00.565650 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5f1c09d3-75b4-48fd-b379-3e006b0814c6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:46:00.566251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5f1c09d3-75b4-48fd-b379-3e006b0814c6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:46:00.572416 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f1c09d3-75b4-48fd-b379-3e006b0814c6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:00.572911 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f1c09d3-75b4-48fd-b379-3e006b0814c6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:00.573366 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f1c09d3-75b4-48fd-b379-3e006b0814c6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:00.574078 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f1c09d3-75b4-48fd-b379-3e006b0814c6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:00.574569 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f1c09d3-75b4-48fd-b379-3e006b0814c6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:00.575011 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5f1c09d3-75b4-48fd-b379-3e006b0814c6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:00.601416 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5f1c09d3-75b4-48fd-b379-3e006b0814c6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:46:00.682412 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5f1c09d3-75b4-48fd-b379-3e006b0814c6 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 204 len: 0 microversion: 2.1 time: 0.120368 Sep 24 21:46:00.683014 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3319/6660] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:46:00 2022] DELETE /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:46:00.691943 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2d8c3a48-2156-4e97-bf27-12abcb3ac081 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:46:00.692785 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2d8c3a48-2156-4e97-bf27-12abcb3ac081 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:46:00.698852 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d8c3a48-2156-4e97-bf27-12abcb3ac081 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:00.699342 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d8c3a48-2156-4e97-bf27-12abcb3ac081 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:00.699784 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d8c3a48-2156-4e97-bf27-12abcb3ac081 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:00.700486 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d8c3a48-2156-4e97-bf27-12abcb3ac081 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:00.700944 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d8c3a48-2156-4e97-bf27-12abcb3ac081 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:00.701381 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d8c3a48-2156-4e97-bf27-12abcb3ac081 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:00.833294 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2d8c3a48-2156-4e97-bf27-12abcb3ac081 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:46:00.841197 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2d8c3a48-2156-4e97-bf27-12abcb3ac081 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 200 len: 1677 microversion: 2.1 time: 0.153591 Sep 24 21:46:00.841775 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3342/6661] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:46:00 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:46:01.699475 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-f5aad94e-c7f7-427f-8ef1-4322dcff8555 req-6388ebb5-d07b-487e-8f4b-47256633bcce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc4919bf-26da-4a87-957c-52938e8f5082", "name": "network-vif-plugged", "status": "completed", "tag": "7d8eb291-9610-4794-a20e-0a7eb3e4809a"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:46:01.705518 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:46:01.712636 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-f5aad94e-c7f7-427f-8ef1-4322dcff8555 req-6388ebb5-d07b-487e-8f4b-47256633bcce service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:01.713255 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-f5aad94e-c7f7-427f-8ef1-4322dcff8555 req-6388ebb5-d07b-487e-8f4b-47256633bcce service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:01.713690 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-f5aad94e-c7f7-427f-8ef1-4322dcff8555 req-6388ebb5-d07b-487e-8f4b-47256633bcce service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:01.725644 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-f5aad94e-c7f7-427f-8ef1-4322dcff8555 req-6388ebb5-d07b-487e-8f4b-47256633bcce service nova] Creating event network-vif-plugged:7d8eb291-9610-4794-a20e-0a7eb3e4809a for instance cc4919bf-26da-4a87-957c-52938e8f5082 on nch1-master-1 Sep 24 21:46:01.730580 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-f5aad94e-c7f7-427f-8ef1-4322dcff8555 req-6388ebb5-d07b-487e-8f4b-47256633bcce service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035166 Sep 24 21:46:01.731290 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3320/6662] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:46:01.866790 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6ed9c411-4ea2-47eb-9e01-fdfdef1bd046 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:46:01.867425 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6ed9c411-4ea2-47eb-9e01-fdfdef1bd046 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:46:01.874442 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ed9c411-4ea2-47eb-9e01-fdfdef1bd046 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:01.875005 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ed9c411-4ea2-47eb-9e01-fdfdef1bd046 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:01.875451 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ed9c411-4ea2-47eb-9e01-fdfdef1bd046 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:01.876165 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ed9c411-4ea2-47eb-9e01-fdfdef1bd046 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:01.876632 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ed9c411-4ea2-47eb-9e01-fdfdef1bd046 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:01.877067 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6ed9c411-4ea2-47eb-9e01-fdfdef1bd046 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:01.882139 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=100 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:46:02.011168 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6ed9c411-4ea2-47eb-9e01-fdfdef1bd046 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:46:02.019702 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6ed9c411-4ea2-47eb-9e01-fdfdef1bd046 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 200 len: 1677 microversion: 2.1 time: 0.157560 Sep 24 21:46:02.020281 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3343/6663] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:46:01 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:46:02.971302 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-6fe232d4-a212-4c3f-80fe-1749d7e1cc36 req-b4bf56c0-1591-44f9-9b21-f1a9e0a3aeea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc4919bf-26da-4a87-957c-52938e8f5082", "name": "network-vif-deleted", "tag": "7d8eb291-9610-4794-a20e-0a7eb3e4809a"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:46:02.979769 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:46:02.982553 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-6fe232d4-a212-4c3f-80fe-1749d7e1cc36 req-b4bf56c0-1591-44f9-9b21-f1a9e0a3aeea service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:02.983019 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-6fe232d4-a212-4c3f-80fe-1749d7e1cc36 req-b4bf56c0-1591-44f9-9b21-f1a9e0a3aeea service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:02.983826 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-6fe232d4-a212-4c3f-80fe-1749d7e1cc36 req-b4bf56c0-1591-44f9-9b21-f1a9e0a3aeea service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:02.997494 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-6fe232d4-a212-4c3f-80fe-1749d7e1cc36 req-b4bf56c0-1591-44f9-9b21-f1a9e0a3aeea service nova] Creating event network-vif-deleted:7d8eb291-9610-4794-a20e-0a7eb3e4809a for instance cc4919bf-26da-4a87-957c-52938e8f5082 on nch1-master-1 Sep 24 21:46:03.002338 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-6fe232d4-a212-4c3f-80fe-1749d7e1cc36 req-b4bf56c0-1591-44f9-9b21-f1a9e0a3aeea service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035962 Sep 24 21:46:03.006562 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3321/6664] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:46:03.043560 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-82ef87a6-25fb-4413-b06b-0726252a22be tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:46:03.044022 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-82ef87a6-25fb-4413-b06b-0726252a22be tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:46:03.046949 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=37 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:46:03.053607 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82ef87a6-25fb-4413-b06b-0726252a22be tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:03.054163 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82ef87a6-25fb-4413-b06b-0726252a22be tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:03.054713 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82ef87a6-25fb-4413-b06b-0726252a22be tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:03.055951 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82ef87a6-25fb-4413-b06b-0726252a22be tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:03.056522 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82ef87a6-25fb-4413-b06b-0726252a22be tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:03.057113 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82ef87a6-25fb-4413-b06b-0726252a22be tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:03.091929 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82ef87a6-25fb-4413-b06b-0726252a22be tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:03.092513 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82ef87a6-25fb-4413-b06b-0726252a22be tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:03.092976 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-82ef87a6-25fb-4413-b06b-0726252a22be tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:03.093429 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-82ef87a6-25fb-4413-b06b-0726252a22be tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lazy-loading 'fault' on Instance uuid cc4919bf-26da-4a87-957c-52938e8f5082 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:46:03.140832 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-82ef87a6-25fb-4413-b06b-0726252a22be tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:46:03.150340 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-82ef87a6-25fb-4413-b06b-0726252a22be tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 200 len: 1328 microversion: 2.1 time: 0.110877 Sep 24 21:46:03.150954 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3344/6665] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:46:03 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 1328 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:46:04.225733 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2d3d30d2-562e-4cb8-b1b4-15c825b033e8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:46:04.226382 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2d3d30d2-562e-4cb8-b1b4-15c825b033e8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:46:04.232659 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2d3d30d2-562e-4cb8-b1b4-15c825b033e8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:04.233141 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2d3d30d2-562e-4cb8-b1b4-15c825b033e8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:04.233581 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2d3d30d2-562e-4cb8-b1b4-15c825b033e8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:04.234276 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2d3d30d2-562e-4cb8-b1b4-15c825b033e8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:04.234761 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2d3d30d2-562e-4cb8-b1b4-15c825b033e8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:04.235192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2d3d30d2-562e-4cb8-b1b4-15c825b033e8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:04.249769 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-2d3d30d2-562e-4cb8-b1b4-15c825b033e8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] HTTP exception thrown: Instance cc4919bf-26da-4a87-957c-52938e8f5082 could not be found. Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2d3d30d2-562e-4cb8-b1b4-15c825b033e8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Request method failure captured: Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 HTTP/1.1 Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3lvhF9Iaegf4sS1JzWlIljTYJrj148E-WwNQL6GxTFy9-EmD0lRYe82SHkK4BRJE7wdwpjVOyKp1beDMSXHCNh6a-Ag9bLdpFKeIG-_D7kSYRpA-A1xeWw2wQCLxdHVbwoFCBczUP4JOpY6xj8yaLXGpDztCPUBSYPLKmuHSh-kBkY Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: f1f293bffcad4e568dccab47bfc498aa Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServerActionsTestJSON-409908010 Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServerActionsTestJSON-409908010 Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: f1f293bffcad4e568dccab47bfc498aa Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServerActionsTestJSON-409908010 Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServerActionsTestJSON-409908010-project Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: f9bf67f92b7142298f15e941a80a07d6 Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServerActionsTestJSON-409908010-project Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance cc4919bf-26da-4a87-957c-52938e8f5082 could not be found. Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'cc4919bf-26da-4a87-957c-52938e8f5082'} Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc4919bf-26da-4a87-957c-52938e8f5082 could not be found. Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc4919bf-26da-4a87-957c-52938e8f5082 could not be found. Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:46:04.251463 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:46:04.256689 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:46:04.256689 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:46:04.256689 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:46:04.256689 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:46:04.256689 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:46:04.256689 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc4919bf-26da-4a87-957c-52938e8f5082 could not be found. Sep 24 21:46:04.256689 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:46:04.256689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2d3d30d2-562e-4cb8-b1b4-15c825b033e8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Returning 404 to user: Instance cc4919bf-26da-4a87-957c-52938e8f5082 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:46:04.256689 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2d3d30d2-562e-4cb8-b1b4-15c825b033e8 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 404 len: 111 microversion: 2.1 time: 0.083366 Sep 24 21:46:04.256689 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3322/6666] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:46:04 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:46:04.267206 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-937fbb72-0fb1-4465-81db-1fdada591412 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:46:04.267920 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-937fbb72-0fb1-4465-81db-1fdada591412 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:46:04.275590 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-937fbb72-0fb1-4465-81db-1fdada591412 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:04.276533 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-937fbb72-0fb1-4465-81db-1fdada591412 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:04.276977 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-937fbb72-0fb1-4465-81db-1fdada591412 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:04.277673 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-937fbb72-0fb1-4465-81db-1fdada591412 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:04.278130 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-937fbb72-0fb1-4465-81db-1fdada591412 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:04.278594 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-937fbb72-0fb1-4465-81db-1fdada591412 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:04.294314 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-937fbb72-0fb1-4465-81db-1fdada591412 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] HTTP exception thrown: Instance cc4919bf-26da-4a87-957c-52938e8f5082 could not be found. Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-937fbb72-0fb1-4465-81db-1fdada591412 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Request method failure captured: Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 HTTP/1.1 Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3lvhF9Iaegf4sS1JzWlIljTYJrj148E-WwNQL6GxTFy9-EmD0lRYe82SHkK4BRJE7wdwpjVOyKp1beDMSXHCNh6a-Ag9bLdpFKeIG-_D7kSYRpA-A1xeWw2wQCLxdHVbwoFCBczUP4JOpY6xj8yaLXGpDztCPUBSYPLKmuHSh-kBkY Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: f1f293bffcad4e568dccab47bfc498aa Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServerActionsTestJSON-409908010 Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServerActionsTestJSON-409908010 Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: f1f293bffcad4e568dccab47bfc498aa Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServerActionsTestJSON-409908010 Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServerActionsTestJSON-409908010-project Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: f9bf67f92b7142298f15e941a80a07d6 Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServerActionsTestJSON-409908010-project Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance cc4919bf-26da-4a87-957c-52938e8f5082 could not be found. Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'cc4919bf-26da-4a87-957c-52938e8f5082'} Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc4919bf-26da-4a87-957c-52938e8f5082 could not be found. Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc4919bf-26da-4a87-957c-52938e8f5082 could not be found. Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:46:04.295993 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:46:04.301460 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:46:04.301460 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:46:04.301460 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:46:04.301460 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:46:04.301460 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:46:04.301460 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc4919bf-26da-4a87-957c-52938e8f5082 could not be found. Sep 24 21:46:04.301460 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:46:04.301460 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-937fbb72-0fb1-4465-81db-1fdada591412 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Returning 404 to user: Instance cc4919bf-26da-4a87-957c-52938e8f5082 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:46:04.301460 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-937fbb72-0fb1-4465-81db-1fdada591412 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 404 len: 111 microversion: 2.1 time: 0.034101 Sep 24 21:46:04.301460 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3345/6667] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:46:04 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:46:04.345605 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7b0865bd-ddf0-4159-af1b-6069f08908c0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-241483031", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "18903e01-4fbf-4876-9b99-27bd5d437a06"}], "security_groups": [{"name": "tempest-securitygroup--1672057739"}], "key_name": "tempest-keypair-743030895", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:46:04.451267 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-7b0865bd-ddf0-4159-af1b-6069f08908c0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] validate_networks() for [('18903e01-4fbf-4876-9b99-27bd5d437a06', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:46:04.871009 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-7b0865bd-ddf0-4159-af1b-6069f08908c0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:46:04.871437 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-7b0865bd-ddf0-4159-af1b-6069f08908c0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:46:04.871913 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-7b0865bd-ddf0-4159-af1b-6069f08908c0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:46:04.872323 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-7b0865bd-ddf0-4159-af1b-6069f08908c0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:46:04.872736 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-7b0865bd-ddf0-4159-af1b-6069f08908c0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:46:04.882286 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b0865bd-ddf0-4159-af1b-6069f08908c0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:04.882798 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b0865bd-ddf0-4159-af1b-6069f08908c0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:04.883236 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b0865bd-ddf0-4159-af1b-6069f08908c0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:04.883961 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b0865bd-ddf0-4159-af1b-6069f08908c0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:04.884417 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b0865bd-ddf0-4159-af1b-6069f08908c0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:04.884843 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b0865bd-ddf0-4159-af1b-6069f08908c0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:04.902005 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-7b0865bd-ddf0-4159-af1b-6069f08908c0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Getting quotas for project f1f293bffcad4e568dccab47bfc498aa. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:46:04.907241 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-7b0865bd-ddf0-4159-af1b-6069f08908c0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Getting quotas for user f9bf67f92b7142298f15e941a80a07d6 and project f1f293bffcad4e568dccab47bfc498aa. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:46:04.919690 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7b0865bd-ddf0-4159-af1b-6069f08908c0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:46:04.921974 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7b0865bd-ddf0-4159-af1b-6069f08908c0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 88f2b989-da6a-4bfc-b5d9-f06c7c4850da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:46:04.969604 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7b0865bd-ddf0-4159-af1b-6069f08908c0 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.627796 Sep 24 21:46:04.970320 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3323/6668] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:46:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:46:04.982060 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4913bcfc-5514-4a72-8c62-ce719e611f1e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:46:04.982815 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4913bcfc-5514-4a72-8c62-ce719e611f1e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 88f2b989-da6a-4bfc-b5d9-f06c7c4850da] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:46:05.039533 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4913bcfc-5514-4a72-8c62-ce719e611f1e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:46:05.046308 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4913bcfc-5514-4a72-8c62-ce719e611f1e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/88f2b989-da6a-4bfc-b5d9-f06c7c4850da" status: 200 len: 1237 microversion: 2.1 time: 0.068212 Sep 24 21:46:05.046931 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3346/6669] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:46:04 2022] GET /compute/v2.1/servers/88f2b989-da6a-4bfc-b5d9-f06c7c4850da => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:46:06.071781 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-07a9b581-f869-4cc3-9968-7c08c647191f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:46:06.072391 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-07a9b581-f869-4cc3-9968-7c08c647191f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 88f2b989-da6a-4bfc-b5d9-f06c7c4850da] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:46:06.080822 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07a9b581-f869-4cc3-9968-7c08c647191f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:06.081342 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07a9b581-f869-4cc3-9968-7c08c647191f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:06.081788 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07a9b581-f869-4cc3-9968-7c08c647191f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:06.082516 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07a9b581-f869-4cc3-9968-7c08c647191f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:06.082984 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07a9b581-f869-4cc3-9968-7c08c647191f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:06.083417 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07a9b581-f869-4cc3-9968-7c08c647191f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:06.178597 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-07a9b581-f869-4cc3-9968-7c08c647191f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:46:06.189812 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-07a9b581-f869-4cc3-9968-7c08c647191f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/88f2b989-da6a-4bfc-b5d9-f06c7c4850da" status: 200 len: 1297 microversion: 2.1 time: 0.122303 Sep 24 21:46:06.190685 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3324/6670] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:46:06 2022] GET /compute/v2.1/servers/88f2b989-da6a-4bfc-b5d9-f06c7c4850da => generated 1297 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:46:07.213858 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8c865c10-326c-445e-890a-bb622fa0b52b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:46:07.214487 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8c865c10-326c-445e-890a-bb622fa0b52b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 88f2b989-da6a-4bfc-b5d9-f06c7c4850da] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:46:07.223718 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8c865c10-326c-445e-890a-bb622fa0b52b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:07.224225 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8c865c10-326c-445e-890a-bb622fa0b52b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:07.224677 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8c865c10-326c-445e-890a-bb622fa0b52b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:07.225416 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8c865c10-326c-445e-890a-bb622fa0b52b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:07.225879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8c865c10-326c-445e-890a-bb622fa0b52b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:07.226316 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8c865c10-326c-445e-890a-bb622fa0b52b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:07.484626 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8c865c10-326c-445e-890a-bb622fa0b52b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:46:07.492929 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8c865c10-326c-445e-890a-bb622fa0b52b tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/88f2b989-da6a-4bfc-b5d9-f06c7c4850da" status: 200 len: 1363 microversion: 2.1 time: 0.283014 Sep 24 21:46:07.493514 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3347/6671] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:46:07 2022] GET /compute/v2.1/servers/88f2b989-da6a-4bfc-b5d9-f06c7c4850da => generated 1363 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:46:07.872024 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-9542cff8-748d-4c36-8ff6-485b12e0d2d7 req-de6ff041-f39e-4ccc-9036-069919b69cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88f2b989-da6a-4bfc-b5d9-f06c7c4850da", "tag": "8bcf183d-e79c-460d-87c4-7a49b299c7ed"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:46:07.884422 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-9542cff8-748d-4c36-8ff6-485b12e0d2d7 req-de6ff041-f39e-4ccc-9036-069919b69cb6 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:07.884908 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-9542cff8-748d-4c36-8ff6-485b12e0d2d7 req-de6ff041-f39e-4ccc-9036-069919b69cb6 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:07.885340 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-9542cff8-748d-4c36-8ff6-485b12e0d2d7 req-de6ff041-f39e-4ccc-9036-069919b69cb6 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:07.897998 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-9542cff8-748d-4c36-8ff6-485b12e0d2d7 req-de6ff041-f39e-4ccc-9036-069919b69cb6 service nova] Creating event network-changed:8bcf183d-e79c-460d-87c4-7a49b299c7ed for instance 88f2b989-da6a-4bfc-b5d9-f06c7c4850da on nch2-master-1 Sep 24 21:46:07.903731 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-9542cff8-748d-4c36-8ff6-485b12e0d2d7 req-de6ff041-f39e-4ccc-9036-069919b69cb6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042201 Sep 24 21:46:07.904569 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3325/6672] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:46:08.517697 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ddf7563a-5cd8-486c-9abd-262c264e9992 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:46:08.518351 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ddf7563a-5cd8-486c-9abd-262c264e9992 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 88f2b989-da6a-4bfc-b5d9-f06c7c4850da] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:46:08.526168 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ddf7563a-5cd8-486c-9abd-262c264e9992 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:08.526713 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ddf7563a-5cd8-486c-9abd-262c264e9992 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:08.527169 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ddf7563a-5cd8-486c-9abd-262c264e9992 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:08.527883 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ddf7563a-5cd8-486c-9abd-262c264e9992 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:08.528354 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ddf7563a-5cd8-486c-9abd-262c264e9992 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:08.528793 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ddf7563a-5cd8-486c-9abd-262c264e9992 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:08.665333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ddf7563a-5cd8-486c-9abd-262c264e9992 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:46:08.673060 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ddf7563a-5cd8-486c-9abd-262c264e9992 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/88f2b989-da6a-4bfc-b5d9-f06c7c4850da" status: 200 len: 1363 microversion: 2.1 time: 0.159322 Sep 24 21:46:08.673635 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3348/6673] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:46:08 2022] GET /compute/v2.1/servers/88f2b989-da6a-4bfc-b5d9-f06c7c4850da => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:46:09.698744 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1e88d3ff-2463-4de1-9f29-1cfda38ec777 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:46:09.699475 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1e88d3ff-2463-4de1-9f29-1cfda38ec777 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 88f2b989-da6a-4bfc-b5d9-f06c7c4850da] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:46:09.705750 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e88d3ff-2463-4de1-9f29-1cfda38ec777 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:09.706692 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e88d3ff-2463-4de1-9f29-1cfda38ec777 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:09.707146 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e88d3ff-2463-4de1-9f29-1cfda38ec777 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:09.707859 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e88d3ff-2463-4de1-9f29-1cfda38ec777 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:09.708323 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e88d3ff-2463-4de1-9f29-1cfda38ec777 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:09.708788 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1e88d3ff-2463-4de1-9f29-1cfda38ec777 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:09.847633 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1e88d3ff-2463-4de1-9f29-1cfda38ec777 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:46:09.855510 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1e88d3ff-2463-4de1-9f29-1cfda38ec777 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/88f2b989-da6a-4bfc-b5d9-f06c7c4850da" status: 200 len: 1363 microversion: 2.1 time: 0.162024 Sep 24 21:46:09.856092 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3326/6674] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:46:09 2022] GET /compute/v2.1/servers/88f2b989-da6a-4bfc-b5d9-f06c7c4850da => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:46:10.880322 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-25ca826d-57bf-4b59-91d4-dfe70aae2805 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:46:10.880955 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-25ca826d-57bf-4b59-91d4-dfe70aae2805 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 88f2b989-da6a-4bfc-b5d9-f06c7c4850da] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:46:10.888315 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-25ca826d-57bf-4b59-91d4-dfe70aae2805 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:10.888758 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-25ca826d-57bf-4b59-91d4-dfe70aae2805 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:10.889214 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-25ca826d-57bf-4b59-91d4-dfe70aae2805 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:10.889937 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-25ca826d-57bf-4b59-91d4-dfe70aae2805 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:10.890410 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-25ca826d-57bf-4b59-91d4-dfe70aae2805 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:10.890879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-25ca826d-57bf-4b59-91d4-dfe70aae2805 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:11.022377 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-25ca826d-57bf-4b59-91d4-dfe70aae2805 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:46:11.030270 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-25ca826d-57bf-4b59-91d4-dfe70aae2805 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/88f2b989-da6a-4bfc-b5d9-f06c7c4850da" status: 200 len: 1363 microversion: 2.1 time: 0.154778 Sep 24 21:46:11.030877 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3349/6675] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:46:10 2022] GET /compute/v2.1/servers/88f2b989-da6a-4bfc-b5d9-f06c7c4850da => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:46:12.054770 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-93ada1bf-f238-4e8b-9b78-495201a40807 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:46:12.055332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-93ada1bf-f238-4e8b-9b78-495201a40807 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 88f2b989-da6a-4bfc-b5d9-f06c7c4850da] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:46:12.062246 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93ada1bf-f238-4e8b-9b78-495201a40807 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:12.062770 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93ada1bf-f238-4e8b-9b78-495201a40807 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:12.063212 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93ada1bf-f238-4e8b-9b78-495201a40807 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:12.063911 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93ada1bf-f238-4e8b-9b78-495201a40807 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:12.064370 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93ada1bf-f238-4e8b-9b78-495201a40807 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:12.064803 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-93ada1bf-f238-4e8b-9b78-495201a40807 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:12.197936 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-93ada1bf-f238-4e8b-9b78-495201a40807 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:46:12.206532 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-93ada1bf-f238-4e8b-9b78-495201a40807 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/88f2b989-da6a-4bfc-b5d9-f06c7c4850da" status: 200 len: 1363 microversion: 2.1 time: 0.155464 Sep 24 21:46:12.207114 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3327/6676] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:46:12 2022] GET /compute/v2.1/servers/88f2b989-da6a-4bfc-b5d9-f06c7c4850da => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:46:12.826307 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-6fe5a073-63fe-4a11-9e87-9d2ce05e0ae0 req-7b4dc667-af9f-4cb4-a04b-93fbb137db89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88f2b989-da6a-4bfc-b5d9-f06c7c4850da", "name": "network-vif-plugged", "status": "completed", "tag": "8bcf183d-e79c-460d-87c4-7a49b299c7ed"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:46:12.836881 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6fe5a073-63fe-4a11-9e87-9d2ce05e0ae0 req-7b4dc667-af9f-4cb4-a04b-93fbb137db89 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:12.837535 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6fe5a073-63fe-4a11-9e87-9d2ce05e0ae0 req-7b4dc667-af9f-4cb4-a04b-93fbb137db89 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:12.838085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6fe5a073-63fe-4a11-9e87-9d2ce05e0ae0 req-7b4dc667-af9f-4cb4-a04b-93fbb137db89 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:12.849898 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-6fe5a073-63fe-4a11-9e87-9d2ce05e0ae0 req-7b4dc667-af9f-4cb4-a04b-93fbb137db89 service nova] Creating event network-vif-plugged:8bcf183d-e79c-460d-87c4-7a49b299c7ed for instance 88f2b989-da6a-4bfc-b5d9-f06c7c4850da on nch2-master-1 Sep 24 21:46:12.854994 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-6fe5a073-63fe-4a11-9e87-9d2ce05e0ae0 req-7b4dc667-af9f-4cb4-a04b-93fbb137db89 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033483 Sep 24 21:46:12.855616 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3350/6677] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:46:13.229658 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0e728d8e-43d6-4cf2-88bd-27f6de2e3f54 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:46:13.230278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0e728d8e-43d6-4cf2-88bd-27f6de2e3f54 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 88f2b989-da6a-4bfc-b5d9-f06c7c4850da] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:46:13.237499 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e728d8e-43d6-4cf2-88bd-27f6de2e3f54 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:13.237988 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e728d8e-43d6-4cf2-88bd-27f6de2e3f54 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:13.238433 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e728d8e-43d6-4cf2-88bd-27f6de2e3f54 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:13.239438 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e728d8e-43d6-4cf2-88bd-27f6de2e3f54 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:13.239909 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e728d8e-43d6-4cf2-88bd-27f6de2e3f54 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:13.240343 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0e728d8e-43d6-4cf2-88bd-27f6de2e3f54 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:13.376457 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0e728d8e-43d6-4cf2-88bd-27f6de2e3f54 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:46:13.385089 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0e728d8e-43d6-4cf2-88bd-27f6de2e3f54 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/88f2b989-da6a-4bfc-b5d9-f06c7c4850da" status: 200 len: 1363 microversion: 2.1 time: 0.159366 Sep 24 21:46:13.385670 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3328/6678] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:46:13 2022] GET /compute/v2.1/servers/88f2b989-da6a-4bfc-b5d9-f06c7c4850da => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:46:14.409488 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-298bdf09-04bc-4111-88b4-857e2e8fc14e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:46:14.410209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-298bdf09-04bc-4111-88b4-857e2e8fc14e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 88f2b989-da6a-4bfc-b5d9-f06c7c4850da] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:46:14.416530 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-298bdf09-04bc-4111-88b4-857e2e8fc14e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:14.417028 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-298bdf09-04bc-4111-88b4-857e2e8fc14e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:14.417478 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-298bdf09-04bc-4111-88b4-857e2e8fc14e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:14.418187 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-298bdf09-04bc-4111-88b4-857e2e8fc14e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:14.418683 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-298bdf09-04bc-4111-88b4-857e2e8fc14e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:14.419122 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-298bdf09-04bc-4111-88b4-857e2e8fc14e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:14.553155 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-298bdf09-04bc-4111-88b4-857e2e8fc14e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:46:14.560985 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-298bdf09-04bc-4111-88b4-857e2e8fc14e tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/88f2b989-da6a-4bfc-b5d9-f06c7c4850da" status: 200 len: 1551 microversion: 2.1 time: 0.156774 Sep 24 21:46:14.561565 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3351/6679] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:46:14 2022] GET /compute/v2.1/servers/88f2b989-da6a-4bfc-b5d9-f06c7c4850da => generated 1551 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:46:14.584083 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0818ab75-78e9-4652-9c23-4809fe1627f9 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:46:14.584616 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0818ab75-78e9-4652-9c23-4809fe1627f9 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 88f2b989-da6a-4bfc-b5d9-f06c7c4850da] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:46:14.591500 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0818ab75-78e9-4652-9c23-4809fe1627f9 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:14.591989 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0818ab75-78e9-4652-9c23-4809fe1627f9 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:14.592434 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0818ab75-78e9-4652-9c23-4809fe1627f9 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:14.593137 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0818ab75-78e9-4652-9c23-4809fe1627f9 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:14.593600 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0818ab75-78e9-4652-9c23-4809fe1627f9 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:14.594034 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0818ab75-78e9-4652-9c23-4809fe1627f9 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:14.674234 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0818ab75-78e9-4652-9c23-4809fe1627f9 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/88f2b989-da6a-4bfc-b5d9-f06c7c4850da/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094010 Sep 24 21:46:14.674982 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3329/6680] 10.222.0.52 () {58 vars in 1275 bytes} [Sat Sep 24 21:46:14 2022] GET /compute/v2.1/servers/88f2b989-da6a-4bfc-b5d9-f06c7c4850da/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:46:15.602814 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-3bd2cc37-2d9c-45ce-a001-5da05ea792f2 req-bb55e9b1-8410-4e60-abed-96ea41b0e6d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88f2b989-da6a-4bfc-b5d9-f06c7c4850da", "tag": "8bcf183d-e79c-460d-87c4-7a49b299c7ed"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:46:15.607984 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:46:15.616039 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-3bd2cc37-2d9c-45ce-a001-5da05ea792f2 req-bb55e9b1-8410-4e60-abed-96ea41b0e6d2 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:15.616546 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-3bd2cc37-2d9c-45ce-a001-5da05ea792f2 req-bb55e9b1-8410-4e60-abed-96ea41b0e6d2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:15.617069 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-3bd2cc37-2d9c-45ce-a001-5da05ea792f2 req-bb55e9b1-8410-4e60-abed-96ea41b0e6d2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:15.628838 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-3bd2cc37-2d9c-45ce-a001-5da05ea792f2 req-bb55e9b1-8410-4e60-abed-96ea41b0e6d2 service nova] Creating event network-changed:8bcf183d-e79c-460d-87c4-7a49b299c7ed for instance 88f2b989-da6a-4bfc-b5d9-f06c7c4850da on nch2-master-1 Sep 24 21:46:15.634478 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-3bd2cc37-2d9c-45ce-a001-5da05ea792f2 req-bb55e9b1-8410-4e60-abed-96ea41b0e6d2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035387 Sep 24 21:46:15.636303 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3352/6681] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:46:52.961807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:46:52.962624 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:46:52.964937 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:46:52.965729 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:46:52.970634 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-636f9e8b-a758-480f-a236-78a540be1ef3 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:46:52.971259 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-636f9e8b-a758-480f-a236-78a540be1ef3 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 88f2b989-da6a-4bfc-b5d9-f06c7c4850da] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:46:52.980064 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-636f9e8b-a758-480f-a236-78a540be1ef3 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:52.980557 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-636f9e8b-a758-480f-a236-78a540be1ef3 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:52.981015 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-636f9e8b-a758-480f-a236-78a540be1ef3 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:52.981708 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-636f9e8b-a758-480f-a236-78a540be1ef3 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:52.982172 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-636f9e8b-a758-480f-a236-78a540be1ef3 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:52.982635 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-636f9e8b-a758-480f-a236-78a540be1ef3 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:53.111896 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-636f9e8b-a758-480f-a236-78a540be1ef3 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:46:53.119921 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-636f9e8b-a758-480f-a236-78a540be1ef3 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/88f2b989-da6a-4bfc-b5d9-f06c7c4850da" status: 200 len: 1670 microversion: 2.1 time: 0.158950 Sep 24 21:46:53.120508 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3330/6682] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:46:52 2022] GET /compute/v2.1/servers/88f2b989-da6a-4bfc-b5d9-f06c7c4850da => generated 1670 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:46:53.276104 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a7ee739e-b762-4e18-918a-066743822fed tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:46:53.276744 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a7ee739e-b762-4e18-918a-066743822fed tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 88f2b989-da6a-4bfc-b5d9-f06c7c4850da] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:46:53.279028 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=21 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:46:53.279835 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=42 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:46:53.286245 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a7ee739e-b762-4e18-918a-066743822fed tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:53.286769 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a7ee739e-b762-4e18-918a-066743822fed tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:53.287221 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a7ee739e-b762-4e18-918a-066743822fed tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:53.287941 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a7ee739e-b762-4e18-918a-066743822fed tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:53.288445 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a7ee739e-b762-4e18-918a-066743822fed tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:53.288888 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a7ee739e-b762-4e18-918a-066743822fed tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:53.318124 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a7ee739e-b762-4e18-918a-066743822fed tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 88f2b989-da6a-4bfc-b5d9-f06c7c4850da] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:46:53.393275 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a7ee739e-b762-4e18-918a-066743822fed tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "DELETE /compute/v2.1/servers/88f2b989-da6a-4bfc-b5d9-f06c7c4850da" status: 204 len: 0 microversion: 2.1 time: 0.121243 Sep 24 21:46:53.394784 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3353/6683] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:46:53 2022] DELETE /compute/v2.1/servers/88f2b989-da6a-4bfc-b5d9-f06c7c4850da => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:46:53.403324 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-82255eb4-a475-46a8-b2ae-af65e0b3d04f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:46:53.403980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-82255eb4-a475-46a8-b2ae-af65e0b3d04f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 88f2b989-da6a-4bfc-b5d9-f06c7c4850da] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:46:53.410748 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-82255eb4-a475-46a8-b2ae-af65e0b3d04f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:53.411265 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-82255eb4-a475-46a8-b2ae-af65e0b3d04f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:53.411709 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-82255eb4-a475-46a8-b2ae-af65e0b3d04f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:53.412462 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-82255eb4-a475-46a8-b2ae-af65e0b3d04f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:53.412876 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-82255eb4-a475-46a8-b2ae-af65e0b3d04f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:53.413314 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-82255eb4-a475-46a8-b2ae-af65e0b3d04f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:53.545590 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-82255eb4-a475-46a8-b2ae-af65e0b3d04f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:46:53.554671 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-82255eb4-a475-46a8-b2ae-af65e0b3d04f tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/88f2b989-da6a-4bfc-b5d9-f06c7c4850da" status: 200 len: 1676 microversion: 2.1 time: 0.155400 Sep 24 21:46:53.555241 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3331/6684] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:46:53 2022] GET /compute/v2.1/servers/88f2b989-da6a-4bfc-b5d9-f06c7c4850da => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:46:54.578035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2767066f-d197-4be4-abaf-008e00120a59 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:46:54.578778 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2767066f-d197-4be4-abaf-008e00120a59 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 88f2b989-da6a-4bfc-b5d9-f06c7c4850da] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:46:54.585322 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2767066f-d197-4be4-abaf-008e00120a59 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:54.585837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2767066f-d197-4be4-abaf-008e00120a59 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:54.586281 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2767066f-d197-4be4-abaf-008e00120a59 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:54.587012 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2767066f-d197-4be4-abaf-008e00120a59 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:54.587477 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2767066f-d197-4be4-abaf-008e00120a59 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:54.587905 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2767066f-d197-4be4-abaf-008e00120a59 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:54.718341 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2767066f-d197-4be4-abaf-008e00120a59 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:46:54.727023 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2767066f-d197-4be4-abaf-008e00120a59 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/88f2b989-da6a-4bfc-b5d9-f06c7c4850da" status: 200 len: 1676 microversion: 2.1 time: 0.153574 Sep 24 21:46:54.727612 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3354/6685] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:46:54 2022] GET /compute/v2.1/servers/88f2b989-da6a-4bfc-b5d9-f06c7c4850da => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:46:55.723374 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-48669180-8662-4709-9d8e-f8a5941257e1 req-f14649b4-c9d6-444b-bde9-e0207caef0cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88f2b989-da6a-4bfc-b5d9-f06c7c4850da", "name": "network-vif-deleted", "tag": "8bcf183d-e79c-460d-87c4-7a49b299c7ed"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:46:55.733753 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-48669180-8662-4709-9d8e-f8a5941257e1 req-f14649b4-c9d6-444b-bde9-e0207caef0cb service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:55.734235 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-48669180-8662-4709-9d8e-f8a5941257e1 req-f14649b4-c9d6-444b-bde9-e0207caef0cb service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:55.734704 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-48669180-8662-4709-9d8e-f8a5941257e1 req-f14649b4-c9d6-444b-bde9-e0207caef0cb service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:55.749413 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-48669180-8662-4709-9d8e-f8a5941257e1 req-f14649b4-c9d6-444b-bde9-e0207caef0cb service nova] Creating event network-vif-deleted:8bcf183d-e79c-460d-87c4-7a49b299c7ed for instance 88f2b989-da6a-4bfc-b5d9-f06c7c4850da on nch2-master-1 Sep 24 21:46:55.754934 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0a97cd2a-ac13-4ed8-b4d9-741f8ab752ab tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:46:55.756197 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-48669180-8662-4709-9d8e-f8a5941257e1 req-f14649b4-c9d6-444b-bde9-e0207caef0cb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036921 Sep 24 21:46:55.757059 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3332/6686] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:46:55.757321 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0a97cd2a-ac13-4ed8-b4d9-741f8ab752ab tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 88f2b989-da6a-4bfc-b5d9-f06c7c4850da] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:46:55.768275 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0a97cd2a-ac13-4ed8-b4d9-741f8ab752ab tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:55.768909 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0a97cd2a-ac13-4ed8-b4d9-741f8ab752ab tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:55.770172 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0a97cd2a-ac13-4ed8-b4d9-741f8ab752ab tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:55.771238 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0a97cd2a-ac13-4ed8-b4d9-741f8ab752ab tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:55.771999 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0a97cd2a-ac13-4ed8-b4d9-741f8ab752ab tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:55.772650 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0a97cd2a-ac13-4ed8-b4d9-741f8ab752ab tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:55.862744 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0a97cd2a-ac13-4ed8-b4d9-741f8ab752ab tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9bf67f92b7142298f15e941a80a07d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f293bffcad4e568dccab47bfc498aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:46:55.875269 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0a97cd2a-ac13-4ed8-b4d9-741f8ab752ab tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/88f2b989-da6a-4bfc-b5d9-f06c7c4850da" status: 200 len: 1322 microversion: 2.1 time: 0.126791 Sep 24 21:46:55.887302 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3355/6687] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:46:55 2022] GET /compute/v2.1/servers/88f2b989-da6a-4bfc-b5d9-f06c7c4850da => generated 1322 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:46:56.901936 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ac1e4b3f-0cc9-43b0-bed9-26b5db2c1ed4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:46:56.902696 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ac1e4b3f-0cc9-43b0-bed9-26b5db2c1ed4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 88f2b989-da6a-4bfc-b5d9-f06c7c4850da] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:46:56.909289 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac1e4b3f-0cc9-43b0-bed9-26b5db2c1ed4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:56.909795 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac1e4b3f-0cc9-43b0-bed9-26b5db2c1ed4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:56.910865 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac1e4b3f-0cc9-43b0-bed9-26b5db2c1ed4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:56.911628 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac1e4b3f-0cc9-43b0-bed9-26b5db2c1ed4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:56.912093 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac1e4b3f-0cc9-43b0-bed9-26b5db2c1ed4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:56.912532 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac1e4b3f-0cc9-43b0-bed9-26b5db2c1ed4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:56.926939 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-ac1e4b3f-0cc9-43b0-bed9-26b5db2c1ed4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] HTTP exception thrown: Instance 88f2b989-da6a-4bfc-b5d9-f06c7c4850da could not be found. Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ac1e4b3f-0cc9-43b0-bed9-26b5db2c1ed4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Request method failure captured: Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/88f2b989-da6a-4bfc-b5d9-f06c7c4850da HTTP/1.1 Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3lvhF9Iaegf4sS1JzWlIljTYJrj148E-WwNQL6GxTFy9-EmD0lRYe82SHkK4BRJE7wdwpjVOyKp1beDMSXHCNh6a-Ag9bLdpFKeIG-_D7kSYRpA-A1xeWw2wQCLxdHVbwoFCBczUP4JOpY6xj8yaLXGpDztCPUBSYPLKmuHSh-kBkY Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: f1f293bffcad4e568dccab47bfc498aa Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServerActionsTestJSON-409908010 Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServerActionsTestJSON-409908010 Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: f1f293bffcad4e568dccab47bfc498aa Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServerActionsTestJSON-409908010 Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServerActionsTestJSON-409908010-project Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: f9bf67f92b7142298f15e941a80a07d6 Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServerActionsTestJSON-409908010-project Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 88f2b989-da6a-4bfc-b5d9-f06c7c4850da could not be found. Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '88f2b989-da6a-4bfc-b5d9-f06c7c4850da'} Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88f2b989-da6a-4bfc-b5d9-f06c7c4850da could not be found. Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88f2b989-da6a-4bfc-b5d9-f06c7c4850da could not be found. Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:46:56.928861 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:46:56.933649 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:46:56.933649 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:46:56.933649 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:46:56.933649 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:46:56.933649 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:46:56.933649 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88f2b989-da6a-4bfc-b5d9-f06c7c4850da could not be found. Sep 24 21:46:56.933649 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:46:56.933649 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ac1e4b3f-0cc9-43b0-bed9-26b5db2c1ed4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Returning 404 to user: Instance 88f2b989-da6a-4bfc-b5d9-f06c7c4850da could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:46:56.933649 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ac1e4b3f-0cc9-43b0-bed9-26b5db2c1ed4 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/88f2b989-da6a-4bfc-b5d9-f06c7c4850da" status: 404 len: 111 microversion: 2.1 time: 0.034289 Sep 24 21:46:56.933649 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3333/6688] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:46:56 2022] GET /compute/v2.1/servers/88f2b989-da6a-4bfc-b5d9-f06c7c4850da => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:46:56.939585 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a4a26a59-9c5b-4155-9025-804c1356d833 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:46:56.940103 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a4a26a59-9c5b-4155-9025-804c1356d833 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:46:56.947841 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4a26a59-9c5b-4155-9025-804c1356d833 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:56.948337 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4a26a59-9c5b-4155-9025-804c1356d833 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:56.948790 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4a26a59-9c5b-4155-9025-804c1356d833 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:56.949504 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4a26a59-9c5b-4155-9025-804c1356d833 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:56.949975 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4a26a59-9c5b-4155-9025-804c1356d833 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:56.950430 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a4a26a59-9c5b-4155-9025-804c1356d833 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:56.964333 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-a4a26a59-9c5b-4155-9025-804c1356d833 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] HTTP exception thrown: Instance cc4919bf-26da-4a87-957c-52938e8f5082 could not be found. Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a4a26a59-9c5b-4155-9025-804c1356d833 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Request method failure captured: Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 HTTP/1.1 Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3lvhF9Iaegf4sS1JzWlIljTYJrj148E-WwNQL6GxTFy9-EmD0lRYe82SHkK4BRJE7wdwpjVOyKp1beDMSXHCNh6a-Ag9bLdpFKeIG-_D7kSYRpA-A1xeWw2wQCLxdHVbwoFCBczUP4JOpY6xj8yaLXGpDztCPUBSYPLKmuHSh-kBkY Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: f1f293bffcad4e568dccab47bfc498aa Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServerActionsTestJSON-409908010 Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServerActionsTestJSON-409908010 Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: f1f293bffcad4e568dccab47bfc498aa Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServerActionsTestJSON-409908010 Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServerActionsTestJSON-409908010-project Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: f9bf67f92b7142298f15e941a80a07d6 Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServerActionsTestJSON-409908010-project Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance cc4919bf-26da-4a87-957c-52938e8f5082 could not be found. Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'cc4919bf-26da-4a87-957c-52938e8f5082'} Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc4919bf-26da-4a87-957c-52938e8f5082 could not be found. Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:46:56.966019 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:46:56.970422 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc4919bf-26da-4a87-957c-52938e8f5082 could not be found. Sep 24 21:46:56.970422 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:46:56.970422 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:46:56.970422 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:46:56.970422 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:46:56.970422 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:46:56.970422 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:46:56.970422 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:46:56.970422 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:46:56.970422 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc4919bf-26da-4a87-957c-52938e8f5082 could not be found. Sep 24 21:46:56.970422 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:46:56.970422 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a4a26a59-9c5b-4155-9025-804c1356d833 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Returning 404 to user: Instance cc4919bf-26da-4a87-957c-52938e8f5082 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:46:56.970422 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a4a26a59-9c5b-4155-9025-804c1356d833 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 404 len: 111 microversion: 2.1 time: 0.031774 Sep 24 21:46:56.970422 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3356/6689] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:46:56 2022] DELETE /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:46:56.976518 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b4de2f4e-8e19-49a4-91e6-296560d97f6a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:46:56.977143 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b4de2f4e-8e19-49a4-91e6-296560d97f6a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: cc4919bf-26da-4a87-957c-52938e8f5082] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:46:56.983470 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b4de2f4e-8e19-49a4-91e6-296560d97f6a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:56.983982 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b4de2f4e-8e19-49a4-91e6-296560d97f6a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:56.984420 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b4de2f4e-8e19-49a4-91e6-296560d97f6a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:56.985143 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b4de2f4e-8e19-49a4-91e6-296560d97f6a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:56.985604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b4de2f4e-8e19-49a4-91e6-296560d97f6a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:56.986038 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b4de2f4e-8e19-49a4-91e6-296560d97f6a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:57.000352 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-b4de2f4e-8e19-49a4-91e6-296560d97f6a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] HTTP exception thrown: Instance cc4919bf-26da-4a87-957c-52938e8f5082 could not be found. Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b4de2f4e-8e19-49a4-91e6-296560d97f6a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Request method failure captured: Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 HTTP/1.1 Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3lvhF9Iaegf4sS1JzWlIljTYJrj148E-WwNQL6GxTFy9-EmD0lRYe82SHkK4BRJE7wdwpjVOyKp1beDMSXHCNh6a-Ag9bLdpFKeIG-_D7kSYRpA-A1xeWw2wQCLxdHVbwoFCBczUP4JOpY6xj8yaLXGpDztCPUBSYPLKmuHSh-kBkY Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: f1f293bffcad4e568dccab47bfc498aa Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServerActionsTestJSON-409908010 Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServerActionsTestJSON-409908010 Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: f1f293bffcad4e568dccab47bfc498aa Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServerActionsTestJSON-409908010 Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServerActionsTestJSON-409908010-project Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: f9bf67f92b7142298f15e941a80a07d6 Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServerActionsTestJSON-409908010-project Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance cc4919bf-26da-4a87-957c-52938e8f5082 could not be found. Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'cc4919bf-26da-4a87-957c-52938e8f5082'} Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc4919bf-26da-4a87-957c-52938e8f5082 could not be found. Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc4919bf-26da-4a87-957c-52938e8f5082 could not be found. Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:46:57.002161 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:46:57.007177 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:46:57.007177 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:46:57.007177 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:46:57.007177 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:46:57.007177 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:46:57.007177 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc4919bf-26da-4a87-957c-52938e8f5082 could not be found. Sep 24 21:46:57.007177 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:46:57.007177 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b4de2f4e-8e19-49a4-91e6-296560d97f6a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Returning 404 to user: Instance cc4919bf-26da-4a87-957c-52938e8f5082 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:46:57.007177 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b4de2f4e-8e19-49a4-91e6-296560d97f6a tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082" status: 404 len: 111 microversion: 2.1 time: 0.031013 Sep 24 21:46:57.007177 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3334/6690] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:46:56 2022] GET /compute/v2.1/servers/cc4919bf-26da-4a87-957c-52938e8f5082 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:46:57.013192 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a9cd7894-0512-4990-a161-0971691f1527 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:46:57.013739 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a9cd7894-0512-4990-a161-0971691f1527 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:46:57.020534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9cd7894-0512-4990-a161-0971691f1527 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:57.020972 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9cd7894-0512-4990-a161-0971691f1527 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:57.021424 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9cd7894-0512-4990-a161-0971691f1527 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:57.022136 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9cd7894-0512-4990-a161-0971691f1527 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:57.022637 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9cd7894-0512-4990-a161-0971691f1527 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:57.023082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a9cd7894-0512-4990-a161-0971691f1527 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:57.036776 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-a9cd7894-0512-4990-a161-0971691f1527 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] HTTP exception thrown: Instance 02f5af29-3aff-4591-9bf0-41df8217399a could not be found. Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a9cd7894-0512-4990-a161-0971691f1527 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Request method failure captured: Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a HTTP/1.1 Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3lvhF9Iaegf4sS1JzWlIljTYJrj148E-WwNQL6GxTFy9-EmD0lRYe82SHkK4BRJE7wdwpjVOyKp1beDMSXHCNh6a-Ag9bLdpFKeIG-_D7kSYRpA-A1xeWw2wQCLxdHVbwoFCBczUP4JOpY6xj8yaLXGpDztCPUBSYPLKmuHSh-kBkY Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: f1f293bffcad4e568dccab47bfc498aa Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServerActionsTestJSON-409908010 Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServerActionsTestJSON-409908010 Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: f1f293bffcad4e568dccab47bfc498aa Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServerActionsTestJSON-409908010 Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServerActionsTestJSON-409908010-project Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: f9bf67f92b7142298f15e941a80a07d6 Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServerActionsTestJSON-409908010-project Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance 02f5af29-3aff-4591-9bf0-41df8217399a could not be found. Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '02f5af29-3aff-4591-9bf0-41df8217399a'} Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02f5af29-3aff-4591-9bf0-41df8217399a could not be found. Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:46:57.038332 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:46:57.042708 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02f5af29-3aff-4591-9bf0-41df8217399a could not be found. Sep 24 21:46:57.042708 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:46:57.042708 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:46:57.042708 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:46:57.042708 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:46:57.042708 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:46:57.042708 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:46:57.042708 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:46:57.042708 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:46:57.042708 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02f5af29-3aff-4591-9bf0-41df8217399a could not be found. Sep 24 21:46:57.042708 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:46:57.042708 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a9cd7894-0512-4990-a161-0971691f1527 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Returning 404 to user: Instance 02f5af29-3aff-4591-9bf0-41df8217399a could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:46:57.042708 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a9cd7894-0512-4990-a161-0971691f1527 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "DELETE /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 404 len: 111 microversion: 2.1 time: 0.030531 Sep 24 21:46:57.042708 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3357/6691] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:46:57 2022] DELETE /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:46:57.048272 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-338063ea-25b4-4735-84dd-e6e88c104b9c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:46:57.048956 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-338063ea-25b4-4735-84dd-e6e88c104b9c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: 02f5af29-3aff-4591-9bf0-41df8217399a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:46:57.055622 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-338063ea-25b4-4735-84dd-e6e88c104b9c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:57.056140 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-338063ea-25b4-4735-84dd-e6e88c104b9c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:57.056583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-338063ea-25b4-4735-84dd-e6e88c104b9c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:57.057282 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-338063ea-25b4-4735-84dd-e6e88c104b9c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:57.057743 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-338063ea-25b4-4735-84dd-e6e88c104b9c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:57.058176 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-338063ea-25b4-4735-84dd-e6e88c104b9c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:57.072465 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-338063ea-25b4-4735-84dd-e6e88c104b9c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] HTTP exception thrown: Instance 02f5af29-3aff-4591-9bf0-41df8217399a could not be found. Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-338063ea-25b4-4735-84dd-e6e88c104b9c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Request method failure captured: Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a HTTP/1.1 Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3lvhF9Iaegf4sS1JzWlIljTYJrj148E-WwNQL6GxTFy9-EmD0lRYe82SHkK4BRJE7wdwpjVOyKp1beDMSXHCNh6a-Ag9bLdpFKeIG-_D7kSYRpA-A1xeWw2wQCLxdHVbwoFCBczUP4JOpY6xj8yaLXGpDztCPUBSYPLKmuHSh-kBkY Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: f1f293bffcad4e568dccab47bfc498aa Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServerActionsTestJSON-409908010 Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServerActionsTestJSON-409908010 Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: f1f293bffcad4e568dccab47bfc498aa Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServerActionsTestJSON-409908010 Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServerActionsTestJSON-409908010-project Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: f9bf67f92b7142298f15e941a80a07d6 Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServerActionsTestJSON-409908010-project Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 02f5af29-3aff-4591-9bf0-41df8217399a could not be found. Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '02f5af29-3aff-4591-9bf0-41df8217399a'} Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02f5af29-3aff-4591-9bf0-41df8217399a could not be found. Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02f5af29-3aff-4591-9bf0-41df8217399a could not be found. Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:46:57.073991 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:46:57.077946 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:46:57.077946 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:46:57.077946 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:46:57.077946 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:46:57.077946 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:46:57.077946 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02f5af29-3aff-4591-9bf0-41df8217399a could not be found. Sep 24 21:46:57.077946 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:46:57.077946 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-338063ea-25b4-4735-84dd-e6e88c104b9c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Returning 404 to user: Instance 02f5af29-3aff-4591-9bf0-41df8217399a could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:46:57.077946 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-338063ea-25b4-4735-84dd-e6e88c104b9c tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a" status: 404 len: 111 microversion: 2.1 time: 0.031005 Sep 24 21:46:57.077946 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3335/6692] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:46:57 2022] GET /compute/v2.1/servers/02f5af29-3aff-4591-9bf0-41df8217399a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:46:57.084653 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2dffe817-374b-4444-bff2-0d20414141ae tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:46:57.085194 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2dffe817-374b-4444-bff2-0d20414141ae tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:46:57.091188 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2dffe817-374b-4444-bff2-0d20414141ae tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:57.091690 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2dffe817-374b-4444-bff2-0d20414141ae tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:57.092136 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2dffe817-374b-4444-bff2-0d20414141ae tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:57.092847 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2dffe817-374b-4444-bff2-0d20414141ae tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:57.093315 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2dffe817-374b-4444-bff2-0d20414141ae tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:57.093754 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2dffe817-374b-4444-bff2-0d20414141ae tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:57.107244 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-2dffe817-374b-4444-bff2-0d20414141ae tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] HTTP exception thrown: Instance fe51dbd9-3aed-4d75-8aa8-77906a07cefe could not be found. Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2dffe817-374b-4444-bff2-0d20414141ae tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Request method failure captured: Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe HTTP/1.1 Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3lvhF9Iaegf4sS1JzWlIljTYJrj148E-WwNQL6GxTFy9-EmD0lRYe82SHkK4BRJE7wdwpjVOyKp1beDMSXHCNh6a-Ag9bLdpFKeIG-_D7kSYRpA-A1xeWw2wQCLxdHVbwoFCBczUP4JOpY6xj8yaLXGpDztCPUBSYPLKmuHSh-kBkY Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: f1f293bffcad4e568dccab47bfc498aa Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServerActionsTestJSON-409908010 Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServerActionsTestJSON-409908010 Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: f1f293bffcad4e568dccab47bfc498aa Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServerActionsTestJSON-409908010 Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServerActionsTestJSON-409908010-project Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: f9bf67f92b7142298f15e941a80a07d6 Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServerActionsTestJSON-409908010-project Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance fe51dbd9-3aed-4d75-8aa8-77906a07cefe could not be found. Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'fe51dbd9-3aed-4d75-8aa8-77906a07cefe'} Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe51dbd9-3aed-4d75-8aa8-77906a07cefe could not be found. Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:46:57.108819 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:46:57.113080 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe51dbd9-3aed-4d75-8aa8-77906a07cefe could not be found. Sep 24 21:46:57.113080 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:46:57.113080 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:46:57.113080 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:46:57.113080 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:46:57.113080 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:46:57.113080 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:46:57.113080 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:46:57.113080 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:46:57.113080 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe51dbd9-3aed-4d75-8aa8-77906a07cefe could not be found. Sep 24 21:46:57.113080 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:46:57.113080 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2dffe817-374b-4444-bff2-0d20414141ae tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Returning 404 to user: Instance fe51dbd9-3aed-4d75-8aa8-77906a07cefe could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:46:57.113080 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2dffe817-374b-4444-bff2-0d20414141ae tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 404 len: 111 microversion: 2.1 time: 0.030179 Sep 24 21:46:57.113080 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3358/6693] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:46:57 2022] DELETE /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:46:57.118562 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9a91be40-04f4-49f8-8b67-f7dab61e77ca tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:46:57.119196 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9a91be40-04f4-49f8-8b67-f7dab61e77ca tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] [instance: fe51dbd9-3aed-4d75-8aa8-77906a07cefe] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:46:57.125183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9a91be40-04f4-49f8-8b67-f7dab61e77ca tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:57.125675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9a91be40-04f4-49f8-8b67-f7dab61e77ca tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:57.126124 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9a91be40-04f4-49f8-8b67-f7dab61e77ca tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:57.126864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9a91be40-04f4-49f8-8b67-f7dab61e77ca tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:46:57.127337 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9a91be40-04f4-49f8-8b67-f7dab61e77ca tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:46:57.127781 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9a91be40-04f4-49f8-8b67-f7dab61e77ca tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:46:57.142185 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-9a91be40-04f4-49f8-8b67-f7dab61e77ca tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] HTTP exception thrown: Instance fe51dbd9-3aed-4d75-8aa8-77906a07cefe could not be found. Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9a91be40-04f4-49f8-8b67-f7dab61e77ca tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Request method failure captured: Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe HTTP/1.1 Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3lvhF9Iaegf4sS1JzWlIljTYJrj148E-WwNQL6GxTFy9-EmD0lRYe82SHkK4BRJE7wdwpjVOyKp1beDMSXHCNh6a-Ag9bLdpFKeIG-_D7kSYRpA-A1xeWw2wQCLxdHVbwoFCBczUP4JOpY6xj8yaLXGpDztCPUBSYPLKmuHSh-kBkY Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: f1f293bffcad4e568dccab47bfc498aa Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServerActionsTestJSON-409908010 Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f1f293bffcad4e568dccab47bfc498aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServerActionsTestJSON-409908010 Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: f1f293bffcad4e568dccab47bfc498aa Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServerActionsTestJSON-409908010 Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServerActionsTestJSON-409908010-project Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: f9bf67f92b7142298f15e941a80a07d6 Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServerActionsTestJSON-409908010-project Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance fe51dbd9-3aed-4d75-8aa8-77906a07cefe could not be found. Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'fe51dbd9-3aed-4d75-8aa8-77906a07cefe'} Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe51dbd9-3aed-4d75-8aa8-77906a07cefe could not be found. Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe51dbd9-3aed-4d75-8aa8-77906a07cefe could not be found. Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:46:57.143758 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:46:57.148786 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:46:57.148786 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:46:57.148786 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:46:57.148786 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:46:57.148786 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:46:57.148786 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe51dbd9-3aed-4d75-8aa8-77906a07cefe could not be found. Sep 24 21:46:57.148786 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:46:57.148786 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9a91be40-04f4-49f8-8b67-f7dab61e77ca tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Returning 404 to user: Instance fe51dbd9-3aed-4d75-8aa8-77906a07cefe could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:46:57.148786 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9a91be40-04f4-49f8-8b67-f7dab61e77ca tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe" status: 404 len: 111 microversion: 2.1 time: 0.031126 Sep 24 21:46:57.148786 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3336/6694] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:46:57 2022] GET /compute/v2.1/servers/fe51dbd9-3aed-4d75-8aa8-77906a07cefe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:46:57.154310 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3cf011d3-4576-4b4c-a788-ae11bf61ea10 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] Calling method '.version_select at 0x7f4b1100faf0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:46:57.179120 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3cf011d3-4576-4b4c-a788-ae11bf61ea10 tempest-ServerActionsTestJSON-409908010 tempest-ServerActionsTestJSON-409908010-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-743030895" status: 202 len: 0 microversion: 2.1 time: 0.028560 Sep 24 21:46:57.179702 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3359/6695] 10.222.0.52 () {58 vars in 1218 bytes} [Sat Sep 24 21:46:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-743030895 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:47:06.355731 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dd6325e1-b480-42ed-8d79-b86c291e84d0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1465897459", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "17c40415-b60e-4a12-8cd0-bfb26419abeb"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:47:06.413804 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-dd6325e1-b480-42ed-8d79-b86c291e84d0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] validate_networks() for [('17c40415-b60e-4a12-8cd0-bfb26419abeb', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:47:06.803958 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-dd6325e1-b480-42ed-8d79-b86c291e84d0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:47:06.804386 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-dd6325e1-b480-42ed-8d79-b86c291e84d0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:47:06.804868 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-dd6325e1-b480-42ed-8d79-b86c291e84d0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:47:06.805282 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-dd6325e1-b480-42ed-8d79-b86c291e84d0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:47:06.805702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-dd6325e1-b480-42ed-8d79-b86c291e84d0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:47:06.814819 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd6325e1-b480-42ed-8d79-b86c291e84d0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:06.815309 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd6325e1-b480-42ed-8d79-b86c291e84d0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:06.815779 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd6325e1-b480-42ed-8d79-b86c291e84d0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:06.817154 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd6325e1-b480-42ed-8d79-b86c291e84d0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:06.817700 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd6325e1-b480-42ed-8d79-b86c291e84d0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:06.818131 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dd6325e1-b480-42ed-8d79-b86c291e84d0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:06.836153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-dd6325e1-b480-42ed-8d79-b86c291e84d0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Getting quotas for project cd01f24cc14c4cde8e764fc6a76c4944. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:47:06.841388 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-dd6325e1-b480-42ed-8d79-b86c291e84d0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Getting quotas for user 11b872b8266f49e2b46706ef647ef4df and project cd01f24cc14c4cde8e764fc6a76c4944. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:47:06.855210 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-dd6325e1-b480-42ed-8d79-b86c291e84d0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:47:06.857554 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-dd6325e1-b480-42ed-8d79-b86c291e84d0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: 44d9e06d-cb29-421c-9416-3cfd9cb6f3b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:47:06.903268 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-dd6325e1-b480-42ed-8d79-b86c291e84d0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.671874 Sep 24 21:47:06.903926 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3337/6696] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:47:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:47:06.916820 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5b42a10c-49ab-4f37-8b6c-df8c956cbccc tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:47:06.917457 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5b42a10c-49ab-4f37-8b6c-df8c956cbccc tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: 44d9e06d-cb29-421c-9416-3cfd9cb6f3b8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:47:06.972098 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5b42a10c-49ab-4f37-8b6c-df8c956cbccc tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b872b8266f49e2b46706ef647ef4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd01f24cc14c4cde8e764fc6a76c4944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:47:06.980191 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5b42a10c-49ab-4f37-8b6c-df8c956cbccc tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "GET /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8" status: 200 len: 1217 microversion: 2.1 time: 0.068279 Sep 24 21:47:06.981053 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3360/6697] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:47:06 2022] GET /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8 => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:47:08.010588 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-dcabd74b-c097-48aa-aacc-d84943ccd961 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:47:08.012091 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-dcabd74b-c097-48aa-aacc-d84943ccd961 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: 44d9e06d-cb29-421c-9416-3cfd9cb6f3b8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:47:08.020948 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dcabd74b-c097-48aa-aacc-d84943ccd961 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:08.021952 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dcabd74b-c097-48aa-aacc-d84943ccd961 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:08.022644 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dcabd74b-c097-48aa-aacc-d84943ccd961 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:08.023713 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dcabd74b-c097-48aa-aacc-d84943ccd961 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:08.024426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dcabd74b-c097-48aa-aacc-d84943ccd961 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:08.025091 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-dcabd74b-c097-48aa-aacc-d84943ccd961 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:08.121824 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-dcabd74b-c097-48aa-aacc-d84943ccd961 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b872b8266f49e2b46706ef647ef4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd01f24cc14c4cde8e764fc6a76c4944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:47:08.131609 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-dcabd74b-c097-48aa-aacc-d84943ccd961 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "GET /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8" status: 200 len: 1287 microversion: 2.1 time: 0.131584 Sep 24 21:47:08.132533 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3338/6698] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:47:07 2022] GET /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8 => generated 1287 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:47:09.156102 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b90939e2-7a87-4098-b88d-e184d1720ca2 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:47:09.156792 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b90939e2-7a87-4098-b88d-e184d1720ca2 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: 44d9e06d-cb29-421c-9416-3cfd9cb6f3b8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:47:09.160768 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:47:09.174183 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b90939e2-7a87-4098-b88d-e184d1720ca2 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:09.174650 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b90939e2-7a87-4098-b88d-e184d1720ca2 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:09.175995 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b90939e2-7a87-4098-b88d-e184d1720ca2 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:09.177294 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b90939e2-7a87-4098-b88d-e184d1720ca2 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:09.177945 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b90939e2-7a87-4098-b88d-e184d1720ca2 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:09.178398 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b90939e2-7a87-4098-b88d-e184d1720ca2 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:09.411310 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b90939e2-7a87-4098-b88d-e184d1720ca2 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b872b8266f49e2b46706ef647ef4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd01f24cc14c4cde8e764fc6a76c4944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:47:09.422916 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b90939e2-7a87-4098-b88d-e184d1720ca2 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "GET /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8" status: 200 len: 1317 microversion: 2.1 time: 0.271864 Sep 24 21:47:09.424246 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3361/6699] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:47:09 2022] GET /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8 => generated 1317 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:47:09.593624 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-53eee9df-0a2f-4c39-b990-e8e3ddfa1124 req-ab1aa363-c324-4cf6-870a-60494bbc1c9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44d9e06d-cb29-421c-9416-3cfd9cb6f3b8", "tag": "6754558b-290d-46b6-a11b-9e971a1b71de"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:47:09.606296 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-53eee9df-0a2f-4c39-b990-e8e3ddfa1124 req-ab1aa363-c324-4cf6-870a-60494bbc1c9b service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:09.606819 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-53eee9df-0a2f-4c39-b990-e8e3ddfa1124 req-ab1aa363-c324-4cf6-870a-60494bbc1c9b service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:09.607261 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-53eee9df-0a2f-4c39-b990-e8e3ddfa1124 req-ab1aa363-c324-4cf6-870a-60494bbc1c9b service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:09.620647 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-53eee9df-0a2f-4c39-b990-e8e3ddfa1124 req-ab1aa363-c324-4cf6-870a-60494bbc1c9b service nova] Creating event network-changed:6754558b-290d-46b6-a11b-9e971a1b71de for instance 44d9e06d-cb29-421c-9416-3cfd9cb6f3b8 on nch1-master-1 Sep 24 21:47:09.627447 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-53eee9df-0a2f-4c39-b990-e8e3ddfa1124 req-ab1aa363-c324-4cf6-870a-60494bbc1c9b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037322 Sep 24 21:47:09.628799 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3339/6700] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:47:10.446689 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3f9dab24-6e0c-4c11-866e-6b826890a23e tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:47:10.447318 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3f9dab24-6e0c-4c11-866e-6b826890a23e tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: 44d9e06d-cb29-421c-9416-3cfd9cb6f3b8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:47:10.454273 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3f9dab24-6e0c-4c11-866e-6b826890a23e tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:10.454801 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3f9dab24-6e0c-4c11-866e-6b826890a23e tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:10.455251 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3f9dab24-6e0c-4c11-866e-6b826890a23e tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:10.455988 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3f9dab24-6e0c-4c11-866e-6b826890a23e tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:10.456494 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3f9dab24-6e0c-4c11-866e-6b826890a23e tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:10.457484 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3f9dab24-6e0c-4c11-866e-6b826890a23e tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:10.593411 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3f9dab24-6e0c-4c11-866e-6b826890a23e tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b872b8266f49e2b46706ef647ef4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd01f24cc14c4cde8e764fc6a76c4944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:47:10.601231 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3f9dab24-6e0c-4c11-866e-6b826890a23e tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "GET /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8" status: 200 len: 1317 microversion: 2.1 time: 0.158535 Sep 24 21:47:10.601818 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3362/6701] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:47:10 2022] GET /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:47:11.625964 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f03a5e34-65d2-4585-93c8-008db7b0669f tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:47:11.626790 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f03a5e34-65d2-4585-93c8-008db7b0669f tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: 44d9e06d-cb29-421c-9416-3cfd9cb6f3b8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:47:11.633379 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f03a5e34-65d2-4585-93c8-008db7b0669f tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:11.633880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f03a5e34-65d2-4585-93c8-008db7b0669f tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:11.634352 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f03a5e34-65d2-4585-93c8-008db7b0669f tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:11.635077 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f03a5e34-65d2-4585-93c8-008db7b0669f tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:11.635700 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f03a5e34-65d2-4585-93c8-008db7b0669f tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:11.635966 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f03a5e34-65d2-4585-93c8-008db7b0669f tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:11.768027 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f03a5e34-65d2-4585-93c8-008db7b0669f tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b872b8266f49e2b46706ef647ef4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd01f24cc14c4cde8e764fc6a76c4944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:47:11.776667 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f03a5e34-65d2-4585-93c8-008db7b0669f tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "GET /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8" status: 200 len: 1317 microversion: 2.1 time: 0.155808 Sep 24 21:47:11.777255 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3340/6702] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:47:11 2022] GET /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:47:12.800436 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cc86afaf-56be-4e57-bf45-5d62a6db09d1 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:47:12.800995 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cc86afaf-56be-4e57-bf45-5d62a6db09d1 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: 44d9e06d-cb29-421c-9416-3cfd9cb6f3b8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:47:12.808869 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cc86afaf-56be-4e57-bf45-5d62a6db09d1 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:12.809359 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cc86afaf-56be-4e57-bf45-5d62a6db09d1 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:12.809807 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cc86afaf-56be-4e57-bf45-5d62a6db09d1 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:12.810535 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cc86afaf-56be-4e57-bf45-5d62a6db09d1 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:12.811031 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cc86afaf-56be-4e57-bf45-5d62a6db09d1 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:12.811466 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cc86afaf-56be-4e57-bf45-5d62a6db09d1 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:12.943076 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cc86afaf-56be-4e57-bf45-5d62a6db09d1 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b872b8266f49e2b46706ef647ef4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd01f24cc14c4cde8e764fc6a76c4944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:47:12.950832 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cc86afaf-56be-4e57-bf45-5d62a6db09d1 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "GET /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8" status: 200 len: 1317 microversion: 2.1 time: 0.154455 Sep 24 21:47:12.951431 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3363/6703] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:47:12 2022] GET /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:47:13.973342 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ad701243-8ef7-4b3c-b7b3-e2bf8b3525ca tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:47:13.974068 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ad701243-8ef7-4b3c-b7b3-e2bf8b3525ca tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: 44d9e06d-cb29-421c-9416-3cfd9cb6f3b8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:47:13.980786 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad701243-8ef7-4b3c-b7b3-e2bf8b3525ca tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:13.981285 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad701243-8ef7-4b3c-b7b3-e2bf8b3525ca tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:13.981729 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad701243-8ef7-4b3c-b7b3-e2bf8b3525ca tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:13.982443 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad701243-8ef7-4b3c-b7b3-e2bf8b3525ca tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:13.982940 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad701243-8ef7-4b3c-b7b3-e2bf8b3525ca tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:13.983397 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad701243-8ef7-4b3c-b7b3-e2bf8b3525ca tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:13.999333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-4157314e-c818-479b-a6f3-cbf3deaffbf6 req-726426f6-4281-425d-9c4a-9fcaa55ed8d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44d9e06d-cb29-421c-9416-3cfd9cb6f3b8", "name": "network-vif-plugged", "status": "completed", "tag": "6754558b-290d-46b6-a11b-9e971a1b71de"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:47:14.014198 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-4157314e-c818-479b-a6f3-cbf3deaffbf6 req-726426f6-4281-425d-9c4a-9fcaa55ed8d4 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:14.014739 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-4157314e-c818-479b-a6f3-cbf3deaffbf6 req-726426f6-4281-425d-9c4a-9fcaa55ed8d4 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:14.015184 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-4157314e-c818-479b-a6f3-cbf3deaffbf6 req-726426f6-4281-425d-9c4a-9fcaa55ed8d4 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:14.027116 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-4157314e-c818-479b-a6f3-cbf3deaffbf6 req-726426f6-4281-425d-9c4a-9fcaa55ed8d4 service nova] Creating event network-vif-plugged:6754558b-290d-46b6-a11b-9e971a1b71de for instance 44d9e06d-cb29-421c-9416-3cfd9cb6f3b8 on nch1-master-1 Sep 24 21:47:14.032734 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-4157314e-c818-479b-a6f3-cbf3deaffbf6 req-726426f6-4281-425d-9c4a-9fcaa55ed8d4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037921 Sep 24 21:47:14.033997 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3364/6704] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:47:14.162376 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ad701243-8ef7-4b3c-b7b3-e2bf8b3525ca tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b872b8266f49e2b46706ef647ef4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd01f24cc14c4cde8e764fc6a76c4944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:47:14.170323 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ad701243-8ef7-4b3c-b7b3-e2bf8b3525ca tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "GET /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8" status: 200 len: 1317 microversion: 2.1 time: 0.200967 Sep 24 21:47:14.170951 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3341/6705] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:47:13 2022] GET /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8 => generated 1317 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:47:15.194647 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2e597aac-69c1-42d5-aa8a-a5c48b8efbe8 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:47:15.195388 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2e597aac-69c1-42d5-aa8a-a5c48b8efbe8 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: 44d9e06d-cb29-421c-9416-3cfd9cb6f3b8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:47:15.202345 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2e597aac-69c1-42d5-aa8a-a5c48b8efbe8 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:15.202865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2e597aac-69c1-42d5-aa8a-a5c48b8efbe8 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:15.203327 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2e597aac-69c1-42d5-aa8a-a5c48b8efbe8 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:15.204005 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2e597aac-69c1-42d5-aa8a-a5c48b8efbe8 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:15.204466 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2e597aac-69c1-42d5-aa8a-a5c48b8efbe8 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:15.204897 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2e597aac-69c1-42d5-aa8a-a5c48b8efbe8 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:15.341100 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2e597aac-69c1-42d5-aa8a-a5c48b8efbe8 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b872b8266f49e2b46706ef647ef4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd01f24cc14c4cde8e764fc6a76c4944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:47:15.349016 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2e597aac-69c1-42d5-aa8a-a5c48b8efbe8 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "GET /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8" status: 200 len: 1317 microversion: 2.1 time: 0.159397 Sep 24 21:47:15.349596 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3365/6706] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:47:15 2022] GET /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:47:16.371901 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-10559462-317b-43fa-bd71-fb4b4a30fb2c tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:47:16.372551 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-10559462-317b-43fa-bd71-fb4b4a30fb2c tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: 44d9e06d-cb29-421c-9416-3cfd9cb6f3b8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:47:16.379579 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10559462-317b-43fa-bd71-fb4b4a30fb2c tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:16.380100 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10559462-317b-43fa-bd71-fb4b4a30fb2c tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:16.380546 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10559462-317b-43fa-bd71-fb4b4a30fb2c tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:16.381251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10559462-317b-43fa-bd71-fb4b4a30fb2c tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:16.381713 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10559462-317b-43fa-bd71-fb4b4a30fb2c tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:16.382176 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-10559462-317b-43fa-bd71-fb4b4a30fb2c tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:16.512649 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-10559462-317b-43fa-bd71-fb4b4a30fb2c tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b872b8266f49e2b46706ef647ef4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd01f24cc14c4cde8e764fc6a76c4944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:47:16.520628 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-10559462-317b-43fa-bd71-fb4b4a30fb2c tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "GET /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8" status: 200 len: 1505 microversion: 2.1 time: 0.152625 Sep 24 21:47:16.521214 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3342/6707] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:47:16 2022] GET /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:47:16.581385 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-65176517-4946-43ec-a0d8-894e60f79d02 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-722552466", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "17c40415-b60e-4a12-8cd0-bfb26419abeb"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:47:16.636208 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-65176517-4946-43ec-a0d8-894e60f79d02 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] validate_networks() for [('17c40415-b60e-4a12-8cd0-bfb26419abeb', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:47:16.977228 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:47:17.003901 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-65176517-4946-43ec-a0d8-894e60f79d02 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:47:17.005082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-65176517-4946-43ec-a0d8-894e60f79d02 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:47:17.005745 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-65176517-4946-43ec-a0d8-894e60f79d02 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:47:17.006174 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-65176517-4946-43ec-a0d8-894e60f79d02 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:47:17.006631 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-65176517-4946-43ec-a0d8-894e60f79d02 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:47:17.015489 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65176517-4946-43ec-a0d8-894e60f79d02 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:17.015985 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65176517-4946-43ec-a0d8-894e60f79d02 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:17.016434 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65176517-4946-43ec-a0d8-894e60f79d02 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:17.017187 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65176517-4946-43ec-a0d8-894e60f79d02 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:17.017654 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65176517-4946-43ec-a0d8-894e60f79d02 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:17.018091 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65176517-4946-43ec-a0d8-894e60f79d02 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:17.035102 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-65176517-4946-43ec-a0d8-894e60f79d02 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Getting quotas for project cd01f24cc14c4cde8e764fc6a76c4944. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:47:17.040386 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-65176517-4946-43ec-a0d8-894e60f79d02 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Getting quotas for user 11b872b8266f49e2b46706ef647ef4df and project cd01f24cc14c4cde8e764fc6a76c4944. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:47:17.054082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-65176517-4946-43ec-a0d8-894e60f79d02 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:47:17.056430 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-65176517-4946-43ec-a0d8-894e60f79d02 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: af9ea867-8246-47ad-b323-76dbc2e707e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:47:17.100111 ncdv-master-1 devstack@n-api.service[140517]: ERROR oslo.messaging._drivers.impl_rabbit [None req-65176517-4946-43ec-a0d8-894e60f79d02 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [b2927123-9c53-40f7-b59d-6217e3ed0022] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 24 21:47:18.108287 ncdv-master-1 devstack@n-api.service[140517]: INFO oslo.messaging._drivers.impl_rabbit [None req-65176517-4946-43ec-a0d8-894e60f79d02 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [b2927123-9c53-40f7-b59d-6217e3ed0022] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 57870. Sep 24 21:47:18.112311 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-65176517-4946-43ec-a0d8-894e60f79d02 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.534800 Sep 24 21:47:18.113341 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3366/6708] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:47:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:47:18.124672 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-361fc334-e6a4-4229-beae-be38c59b0456 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:47:18.125365 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-361fc334-e6a4-4229-beae-be38c59b0456 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: af9ea867-8246-47ad-b323-76dbc2e707e6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:47:18.127494 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:47:18.129868 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:47:18.185584 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-361fc334-e6a4-4229-beae-be38c59b0456 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b872b8266f49e2b46706ef647ef4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd01f24cc14c4cde8e764fc6a76c4944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:47:18.193590 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-361fc334-e6a4-4229-beae-be38c59b0456 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "GET /compute/v2.1/servers/af9ea867-8246-47ad-b323-76dbc2e707e6" status: 200 len: 1216 microversion: 2.1 time: 0.072868 Sep 24 21:47:18.194179 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3343/6709] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:47:18 2022] GET /compute/v2.1/servers/af9ea867-8246-47ad-b323-76dbc2e707e6 => generated 1216 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:47:19.218280 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1a4af49f-877d-45fa-9945-d8cbf59cf3ae tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:47:19.219532 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1a4af49f-877d-45fa-9945-d8cbf59cf3ae tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: af9ea867-8246-47ad-b323-76dbc2e707e6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:47:19.227779 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a4af49f-877d-45fa-9945-d8cbf59cf3ae tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:19.228418 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a4af49f-877d-45fa-9945-d8cbf59cf3ae tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:19.228874 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a4af49f-877d-45fa-9945-d8cbf59cf3ae tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:19.229592 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a4af49f-877d-45fa-9945-d8cbf59cf3ae tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:19.230605 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a4af49f-877d-45fa-9945-d8cbf59cf3ae tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:19.231207 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a4af49f-877d-45fa-9945-d8cbf59cf3ae tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:19.299854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1a4af49f-877d-45fa-9945-d8cbf59cf3ae tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b872b8266f49e2b46706ef647ef4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd01f24cc14c4cde8e764fc6a76c4944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:47:19.308084 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1a4af49f-877d-45fa-9945-d8cbf59cf3ae tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "GET /compute/v2.1/servers/af9ea867-8246-47ad-b323-76dbc2e707e6" status: 200 len: 1286 microversion: 2.1 time: 0.094995 Sep 24 21:47:19.308677 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3367/6710] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:47:19 2022] GET /compute/v2.1/servers/af9ea867-8246-47ad-b323-76dbc2e707e6 => generated 1286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:47:20.330742 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-86391858-d16a-4851-81aa-374ae4d8663c tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:47:20.331307 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-86391858-d16a-4851-81aa-374ae4d8663c tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: af9ea867-8246-47ad-b323-76dbc2e707e6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:47:20.339935 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86391858-d16a-4851-81aa-374ae4d8663c tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:20.340434 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86391858-d16a-4851-81aa-374ae4d8663c tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:20.340883 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86391858-d16a-4851-81aa-374ae4d8663c tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:20.341646 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86391858-d16a-4851-81aa-374ae4d8663c tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:20.342110 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86391858-d16a-4851-81aa-374ae4d8663c tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:20.342567 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-86391858-d16a-4851-81aa-374ae4d8663c tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:20.691718 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-86391858-d16a-4851-81aa-374ae4d8663c tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b872b8266f49e2b46706ef647ef4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd01f24cc14c4cde8e764fc6a76c4944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:47:20.700603 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-86391858-d16a-4851-81aa-374ae4d8663c tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "GET /compute/v2.1/servers/af9ea867-8246-47ad-b323-76dbc2e707e6" status: 200 len: 1316 microversion: 2.1 time: 0.373925 Sep 24 21:47:20.701196 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3344/6711] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:47:20 2022] GET /compute/v2.1/servers/af9ea867-8246-47ad-b323-76dbc2e707e6 => generated 1316 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:47:20.916865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-43acb1dc-cfb4-49a8-a4ce-939dc9a4e01d req-85cdd5f7-b186-4665-b097-ff1c9d78f288 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af9ea867-8246-47ad-b323-76dbc2e707e6", "tag": "32f787ce-6789-42b7-a9d5-2c46e0ed9b79"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:47:20.929132 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-43acb1dc-cfb4-49a8-a4ce-939dc9a4e01d req-85cdd5f7-b186-4665-b097-ff1c9d78f288 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:20.929664 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-43acb1dc-cfb4-49a8-a4ce-939dc9a4e01d req-85cdd5f7-b186-4665-b097-ff1c9d78f288 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:20.930670 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-43acb1dc-cfb4-49a8-a4ce-939dc9a4e01d req-85cdd5f7-b186-4665-b097-ff1c9d78f288 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:20.944136 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-43acb1dc-cfb4-49a8-a4ce-939dc9a4e01d req-85cdd5f7-b186-4665-b097-ff1c9d78f288 service nova] Creating event network-changed:32f787ce-6789-42b7-a9d5-2c46e0ed9b79 for instance af9ea867-8246-47ad-b323-76dbc2e707e6 on nch2-master-1 Sep 24 21:47:20.949313 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-43acb1dc-cfb4-49a8-a4ce-939dc9a4e01d req-85cdd5f7-b186-4665-b097-ff1c9d78f288 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036739 Sep 24 21:47:20.949923 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3368/6712] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:47:21.726288 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ea8784e1-5a51-4974-83ef-bd3eda7fcd7d tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:47:21.726943 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ea8784e1-5a51-4974-83ef-bd3eda7fcd7d tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: af9ea867-8246-47ad-b323-76dbc2e707e6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:47:21.733876 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea8784e1-5a51-4974-83ef-bd3eda7fcd7d tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:21.734357 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea8784e1-5a51-4974-83ef-bd3eda7fcd7d tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:21.734834 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea8784e1-5a51-4974-83ef-bd3eda7fcd7d tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:21.735533 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea8784e1-5a51-4974-83ef-bd3eda7fcd7d tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:21.735990 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea8784e1-5a51-4974-83ef-bd3eda7fcd7d tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:21.736421 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ea8784e1-5a51-4974-83ef-bd3eda7fcd7d tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:21.870164 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ea8784e1-5a51-4974-83ef-bd3eda7fcd7d tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b872b8266f49e2b46706ef647ef4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd01f24cc14c4cde8e764fc6a76c4944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:47:21.878095 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ea8784e1-5a51-4974-83ef-bd3eda7fcd7d tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "GET /compute/v2.1/servers/af9ea867-8246-47ad-b323-76dbc2e707e6" status: 200 len: 1316 microversion: 2.1 time: 0.156781 Sep 24 21:47:21.878698 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3345/6713] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:47:21 2022] GET /compute/v2.1/servers/af9ea867-8246-47ad-b323-76dbc2e707e6 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:47:22.901594 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-76ff57ef-2d21-4461-b966-d18dfc6a11e0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:47:22.902310 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-76ff57ef-2d21-4461-b966-d18dfc6a11e0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: af9ea867-8246-47ad-b323-76dbc2e707e6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:47:22.908644 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76ff57ef-2d21-4461-b966-d18dfc6a11e0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:22.909139 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76ff57ef-2d21-4461-b966-d18dfc6a11e0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:22.909590 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76ff57ef-2d21-4461-b966-d18dfc6a11e0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:22.910293 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76ff57ef-2d21-4461-b966-d18dfc6a11e0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:22.910782 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76ff57ef-2d21-4461-b966-d18dfc6a11e0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:22.911219 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76ff57ef-2d21-4461-b966-d18dfc6a11e0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:23.047316 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-76ff57ef-2d21-4461-b966-d18dfc6a11e0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b872b8266f49e2b46706ef647ef4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd01f24cc14c4cde8e764fc6a76c4944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:47:23.056081 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-76ff57ef-2d21-4461-b966-d18dfc6a11e0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "GET /compute/v2.1/servers/af9ea867-8246-47ad-b323-76dbc2e707e6" status: 200 len: 1316 microversion: 2.1 time: 0.159663 Sep 24 21:47:23.056681 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3369/6714] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:47:22 2022] GET /compute/v2.1/servers/af9ea867-8246-47ad-b323-76dbc2e707e6 => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:47:24.079479 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-29c1b816-8f0c-488a-8cbe-a57a9e4dbb49 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:47:24.080001 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-29c1b816-8f0c-488a-8cbe-a57a9e4dbb49 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: af9ea867-8246-47ad-b323-76dbc2e707e6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:47:24.082720 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:47:24.088213 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-29c1b816-8f0c-488a-8cbe-a57a9e4dbb49 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:24.088698 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-29c1b816-8f0c-488a-8cbe-a57a9e4dbb49 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:24.089137 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-29c1b816-8f0c-488a-8cbe-a57a9e4dbb49 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:24.089835 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-29c1b816-8f0c-488a-8cbe-a57a9e4dbb49 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:24.090292 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-29c1b816-8f0c-488a-8cbe-a57a9e4dbb49 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:24.090785 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-29c1b816-8f0c-488a-8cbe-a57a9e4dbb49 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:24.094031 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=63 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:47:24.330142 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-29c1b816-8f0c-488a-8cbe-a57a9e4dbb49 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b872b8266f49e2b46706ef647ef4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd01f24cc14c4cde8e764fc6a76c4944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:47:24.338475 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-29c1b816-8f0c-488a-8cbe-a57a9e4dbb49 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "GET /compute/v2.1/servers/af9ea867-8246-47ad-b323-76dbc2e707e6" status: 200 len: 1316 microversion: 2.1 time: 0.263047 Sep 24 21:47:24.339179 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3346/6715] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:47:24 2022] GET /compute/v2.1/servers/af9ea867-8246-47ad-b323-76dbc2e707e6 => generated 1316 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:47:25.076237 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-2f411c9f-539b-4bf4-b7f1-be19ea451aac req-8fc3c3d2-67b1-4833-9349-31b38322b1d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af9ea867-8246-47ad-b323-76dbc2e707e6", "name": "network-vif-plugged", "status": "completed", "tag": "32f787ce-6789-42b7-a9d5-2c46e0ed9b79"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:47:25.082693 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:47:25.091026 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-2f411c9f-539b-4bf4-b7f1-be19ea451aac req-8fc3c3d2-67b1-4833-9349-31b38322b1d1 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:25.091532 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-2f411c9f-539b-4bf4-b7f1-be19ea451aac req-8fc3c3d2-67b1-4833-9349-31b38322b1d1 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:25.092000 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-2f411c9f-539b-4bf4-b7f1-be19ea451aac req-8fc3c3d2-67b1-4833-9349-31b38322b1d1 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:25.104134 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-2f411c9f-539b-4bf4-b7f1-be19ea451aac req-8fc3c3d2-67b1-4833-9349-31b38322b1d1 service nova] Creating event network-vif-plugged:32f787ce-6789-42b7-a9d5-2c46e0ed9b79 for instance af9ea867-8246-47ad-b323-76dbc2e707e6 on nch2-master-1 Sep 24 21:47:25.109522 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-2f411c9f-539b-4bf4-b7f1-be19ea451aac req-8fc3c3d2-67b1-4833-9349-31b38322b1d1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037052 Sep 24 21:47:25.110291 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3370/6716] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:47:25.361756 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-07dbe43b-0df2-4627-b787-b628c5172a81 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:47:25.362373 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-07dbe43b-0df2-4627-b787-b628c5172a81 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: af9ea867-8246-47ad-b323-76dbc2e707e6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:47:25.369684 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07dbe43b-0df2-4627-b787-b628c5172a81 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:25.370203 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07dbe43b-0df2-4627-b787-b628c5172a81 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:25.370683 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07dbe43b-0df2-4627-b787-b628c5172a81 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:25.371408 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07dbe43b-0df2-4627-b787-b628c5172a81 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:25.371899 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07dbe43b-0df2-4627-b787-b628c5172a81 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:25.372329 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-07dbe43b-0df2-4627-b787-b628c5172a81 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:25.502093 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-07dbe43b-0df2-4627-b787-b628c5172a81 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b872b8266f49e2b46706ef647ef4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd01f24cc14c4cde8e764fc6a76c4944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:47:25.510013 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-07dbe43b-0df2-4627-b787-b628c5172a81 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "GET /compute/v2.1/servers/af9ea867-8246-47ad-b323-76dbc2e707e6" status: 200 len: 1316 microversion: 2.1 time: 0.152184 Sep 24 21:47:25.510544 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3347/6717] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:47:25 2022] GET /compute/v2.1/servers/af9ea867-8246-47ad-b323-76dbc2e707e6 => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:47:26.532927 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7b1475e5-fdd2-470f-b109-364a3354b048 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:47:26.533643 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7b1475e5-fdd2-470f-b109-364a3354b048 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: af9ea867-8246-47ad-b323-76dbc2e707e6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:47:26.541709 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b1475e5-fdd2-470f-b109-364a3354b048 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:26.542198 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b1475e5-fdd2-470f-b109-364a3354b048 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:26.542680 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b1475e5-fdd2-470f-b109-364a3354b048 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:26.543390 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b1475e5-fdd2-470f-b109-364a3354b048 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:26.543851 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b1475e5-fdd2-470f-b109-364a3354b048 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:26.544289 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b1475e5-fdd2-470f-b109-364a3354b048 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:26.736300 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7b1475e5-fdd2-470f-b109-364a3354b048 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b872b8266f49e2b46706ef647ef4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd01f24cc14c4cde8e764fc6a76c4944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:47:26.744680 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7b1475e5-fdd2-470f-b109-364a3354b048 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "GET /compute/v2.1/servers/af9ea867-8246-47ad-b323-76dbc2e707e6" status: 200 len: 1504 microversion: 2.1 time: 0.216089 Sep 24 21:47:26.745267 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3371/6718] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:47:26 2022] GET /compute/v2.1/servers/af9ea867-8246-47ad-b323-76dbc2e707e6 => generated 1504 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:47:26.769198 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-56249665-45b5-4411-a4a6-1f2e5bdcc543 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:47:26.769731 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-56249665-45b5-4411-a4a6-1f2e5bdcc543 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: af9ea867-8246-47ad-b323-76dbc2e707e6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:47:26.776828 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56249665-45b5-4411-a4a6-1f2e5bdcc543 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:26.777306 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56249665-45b5-4411-a4a6-1f2e5bdcc543 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:26.777744 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56249665-45b5-4411-a4a6-1f2e5bdcc543 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:26.778440 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56249665-45b5-4411-a4a6-1f2e5bdcc543 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:26.778920 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56249665-45b5-4411-a4a6-1f2e5bdcc543 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:26.779348 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56249665-45b5-4411-a4a6-1f2e5bdcc543 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:26.805609 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-56249665-45b5-4411-a4a6-1f2e5bdcc543 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: af9ea867-8246-47ad-b323-76dbc2e707e6] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:47:26.884017 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-56249665-45b5-4411-a4a6-1f2e5bdcc543 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "DELETE /compute/v2.1/servers/af9ea867-8246-47ad-b323-76dbc2e707e6" status: 204 len: 0 microversion: 2.1 time: 0.118368 Sep 24 21:47:26.884628 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3348/6719] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:47:26 2022] DELETE /compute/v2.1/servers/af9ea867-8246-47ad-b323-76dbc2e707e6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:47:26.892867 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e9756ff8-d270-487f-8ebc-135843a8b5b6 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:47:26.893500 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e9756ff8-d270-487f-8ebc-135843a8b5b6 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: af9ea867-8246-47ad-b323-76dbc2e707e6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:47:26.899637 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9756ff8-d270-487f-8ebc-135843a8b5b6 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:26.900136 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9756ff8-d270-487f-8ebc-135843a8b5b6 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:26.900589 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9756ff8-d270-487f-8ebc-135843a8b5b6 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:26.901300 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9756ff8-d270-487f-8ebc-135843a8b5b6 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:26.901770 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9756ff8-d270-487f-8ebc-135843a8b5b6 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:26.902207 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9756ff8-d270-487f-8ebc-135843a8b5b6 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:27.026073 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:47:27.031861 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e9756ff8-d270-487f-8ebc-135843a8b5b6 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b872b8266f49e2b46706ef647ef4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd01f24cc14c4cde8e764fc6a76c4944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:47:27.040532 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e9756ff8-d270-487f-8ebc-135843a8b5b6 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "GET /compute/v2.1/servers/af9ea867-8246-47ad-b323-76dbc2e707e6" status: 200 len: 1510 microversion: 2.1 time: 0.151615 Sep 24 21:47:27.041116 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3372/6720] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:47:26 2022] GET /compute/v2.1/servers/af9ea867-8246-47ad-b323-76dbc2e707e6 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:47:28.064761 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d7eadbd1-13c4-423b-b31d-5ba3d51c93ce tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:47:28.065410 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d7eadbd1-13c4-423b-b31d-5ba3d51c93ce tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: af9ea867-8246-47ad-b323-76dbc2e707e6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:47:28.072641 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7eadbd1-13c4-423b-b31d-5ba3d51c93ce tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:28.073126 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7eadbd1-13c4-423b-b31d-5ba3d51c93ce tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:28.073567 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7eadbd1-13c4-423b-b31d-5ba3d51c93ce tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:28.074264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7eadbd1-13c4-423b-b31d-5ba3d51c93ce tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:28.074849 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7eadbd1-13c4-423b-b31d-5ba3d51c93ce tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:28.075279 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d7eadbd1-13c4-423b-b31d-5ba3d51c93ce tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:28.190613 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:47:28.209584 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d7eadbd1-13c4-423b-b31d-5ba3d51c93ce tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b872b8266f49e2b46706ef647ef4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd01f24cc14c4cde8e764fc6a76c4944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:47:28.217325 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d7eadbd1-13c4-423b-b31d-5ba3d51c93ce tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "GET /compute/v2.1/servers/af9ea867-8246-47ad-b323-76dbc2e707e6" status: 200 len: 1510 microversion: 2.1 time: 0.156958 Sep 24 21:47:28.217906 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3349/6721] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:47:28 2022] GET /compute/v2.1/servers/af9ea867-8246-47ad-b323-76dbc2e707e6 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:47:28.743040 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=6 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:47:28.828075 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-84a04625-3501-4ddc-bdf8-0607281b9553 req-4cf4a534-3412-486c-a865-a8e89a72d4ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af9ea867-8246-47ad-b323-76dbc2e707e6", "name": "network-vif-deleted", "tag": "32f787ce-6789-42b7-a9d5-2c46e0ed9b79"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:47:28.842227 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-84a04625-3501-4ddc-bdf8-0607281b9553 req-4cf4a534-3412-486c-a865-a8e89a72d4ff service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:28.843097 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-84a04625-3501-4ddc-bdf8-0607281b9553 req-4cf4a534-3412-486c-a865-a8e89a72d4ff service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:28.843871 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-84a04625-3501-4ddc-bdf8-0607281b9553 req-4cf4a534-3412-486c-a865-a8e89a72d4ff service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:28.857827 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-84a04625-3501-4ddc-bdf8-0607281b9553 req-4cf4a534-3412-486c-a865-a8e89a72d4ff service nova] Creating event network-vif-deleted:32f787ce-6789-42b7-a9d5-2c46e0ed9b79 for instance af9ea867-8246-47ad-b323-76dbc2e707e6 on nch2-master-1 Sep 24 21:47:28.863750 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-84a04625-3501-4ddc-bdf8-0607281b9553 req-4cf4a534-3412-486c-a865-a8e89a72d4ff service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125891 Sep 24 21:47:28.869045 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3373/6722] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:47:29.241874 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-044cd2b8-de04-41c7-878e-cb8869fced18 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:47:29.242544 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-044cd2b8-de04-41c7-878e-cb8869fced18 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: af9ea867-8246-47ad-b323-76dbc2e707e6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:47:29.249705 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-044cd2b8-de04-41c7-878e-cb8869fced18 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:29.250199 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-044cd2b8-de04-41c7-878e-cb8869fced18 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:29.250818 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-044cd2b8-de04-41c7-878e-cb8869fced18 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:29.251521 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-044cd2b8-de04-41c7-878e-cb8869fced18 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:29.251991 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-044cd2b8-de04-41c7-878e-cb8869fced18 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:29.252427 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-044cd2b8-de04-41c7-878e-cb8869fced18 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:29.286208 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-044cd2b8-de04-41c7-878e-cb8869fced18 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:29.286738 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-044cd2b8-de04-41c7-878e-cb8869fced18 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:29.287252 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-044cd2b8-de04-41c7-878e-cb8869fced18 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:29.287803 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-044cd2b8-de04-41c7-878e-cb8869fced18 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lazy-loading 'fault' on Instance uuid af9ea867-8246-47ad-b323-76dbc2e707e6 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:47:29.330285 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-044cd2b8-de04-41c7-878e-cb8869fced18 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b872b8266f49e2b46706ef647ef4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd01f24cc14c4cde8e764fc6a76c4944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:47:29.340164 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-044cd2b8-de04-41c7-878e-cb8869fced18 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "GET /compute/v2.1/servers/af9ea867-8246-47ad-b323-76dbc2e707e6" status: 200 len: 1306 microversion: 2.1 time: 0.102736 Sep 24 21:47:29.340849 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3350/6723] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:47:29 2022] GET /compute/v2.1/servers/af9ea867-8246-47ad-b323-76dbc2e707e6 => generated 1306 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:47:30.367523 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a975cf9d-cbdb-4fb3-b0e4-0410e4cd6d73 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:47:30.368238 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a975cf9d-cbdb-4fb3-b0e4-0410e4cd6d73 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: af9ea867-8246-47ad-b323-76dbc2e707e6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:47:30.374642 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a975cf9d-cbdb-4fb3-b0e4-0410e4cd6d73 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:30.375137 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a975cf9d-cbdb-4fb3-b0e4-0410e4cd6d73 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:30.375585 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a975cf9d-cbdb-4fb3-b0e4-0410e4cd6d73 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:30.376291 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a975cf9d-cbdb-4fb3-b0e4-0410e4cd6d73 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:30.376757 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a975cf9d-cbdb-4fb3-b0e4-0410e4cd6d73 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:30.377202 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a975cf9d-cbdb-4fb3-b0e4-0410e4cd6d73 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:30.391031 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-a975cf9d-cbdb-4fb3-b0e4-0410e4cd6d73 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] HTTP exception thrown: Instance af9ea867-8246-47ad-b323-76dbc2e707e6 could not be found. Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a975cf9d-cbdb-4fb3-b0e4-0410e4cd6d73 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Request method failure captured: Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/af9ea867-8246-47ad-b323-76dbc2e707e6 HTTP/1.1 Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3raS5OYOwjZrhIfG5x0WNCmgLnn_RSbIcIXayCkSfhEJ0BB1FRP9vRCLRyFhJzyjzXNE0RNDt9Nioy6ema5lWNjIV_IanPSAGsr40_zooDMY3835E3CF5wXTA1h31sJRUQ10Vst32kKwJUU2JAIBB0EfhvjdLYHlKbVXWIEW2angUo Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: cd01f24cc14c4cde8e764fc6a76c4944 Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersNegativeTestJSON-532094980 Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd01f24cc14c4cde8e764fc6a76c4944"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cd01f24cc14c4cde8e764fc6a76c4944"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cd01f24cc14c4cde8e764fc6a76c4944"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd01f24cc14c4cde8e764fc6a76c4944"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersNegativeTestJSON-532094980 Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: cd01f24cc14c4cde8e764fc6a76c4944 Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-532094980 Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersNegativeTestJSON-532094980-project Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 11b872b8266f49e2b46706ef647ef4df Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersNegativeTestJSON-532094980-project Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance af9ea867-8246-47ad-b323-76dbc2e707e6 could not be found. Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'af9ea867-8246-47ad-b323-76dbc2e707e6'} Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af9ea867-8246-47ad-b323-76dbc2e707e6 could not be found. Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af9ea867-8246-47ad-b323-76dbc2e707e6 could not be found. Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:47:30.392664 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:47:30.397703 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:47:30.397703 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:47:30.397703 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:47:30.397703 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:47:30.397703 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:47:30.397703 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af9ea867-8246-47ad-b323-76dbc2e707e6 could not be found. Sep 24 21:47:30.397703 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:47:30.397703 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a975cf9d-cbdb-4fb3-b0e4-0410e4cd6d73 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Returning 404 to user: Instance af9ea867-8246-47ad-b323-76dbc2e707e6 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:47:30.397703 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a975cf9d-cbdb-4fb3-b0e4-0410e4cd6d73 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "GET /compute/v2.1/servers/af9ea867-8246-47ad-b323-76dbc2e707e6" status: 404 len: 111 microversion: 2.1 time: 0.032797 Sep 24 21:47:30.397703 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3374/6724] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:47:30 2022] GET /compute/v2.1/servers/af9ea867-8246-47ad-b323-76dbc2e707e6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:47:30.403284 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3f1d691b-39a7-4f68-a399-19cb879770fb tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:47:30.403935 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3f1d691b-39a7-4f68-a399-19cb879770fb tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: 44d9e06d-cb29-421c-9416-3cfd9cb6f3b8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:47:30.410899 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3f1d691b-39a7-4f68-a399-19cb879770fb tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:30.411391 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3f1d691b-39a7-4f68-a399-19cb879770fb tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:30.411824 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3f1d691b-39a7-4f68-a399-19cb879770fb tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:30.412514 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3f1d691b-39a7-4f68-a399-19cb879770fb tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:30.412971 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3f1d691b-39a7-4f68-a399-19cb879770fb tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:30.413407 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3f1d691b-39a7-4f68-a399-19cb879770fb tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:30.545394 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3f1d691b-39a7-4f68-a399-19cb879770fb tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b872b8266f49e2b46706ef647ef4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd01f24cc14c4cde8e764fc6a76c4944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:47:30.554024 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3f1d691b-39a7-4f68-a399-19cb879770fb tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "GET /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8" status: 200 len: 1505 microversion: 2.1 time: 0.154594 Sep 24 21:47:30.554774 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3351/6725] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:47:30 2022] GET /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:47:30.576887 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9ebe011d-9fa6-47ac-ac42-37279b24bf4b tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:47:30.579148 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9ebe011d-9fa6-47ac-ac42-37279b24bf4b tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: deca2c41-ad0c-4792-a92f-98208de203e8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:47:30.584722 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-9ebe011d-9fa6-47ac-ac42-37279b24bf4b tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] HTTP exception thrown: Instance deca2c41-ad0c-4792-a92f-98208de203e8 could not be found. Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9ebe011d-9fa6-47ac-ac42-37279b24bf4b tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Request method failure captured: Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers/deca2c41-ad0c-4792-a92f-98208de203e8/action HTTP/1.1 Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 32 Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3raS5OYOwjZrhIfG5x0WNCmgLnn_RSbIcIXayCkSfhEJ0BB1FRP9vRCLRyFhJzyjzXNE0RNDt9Nioy6ema5lWNjIV_IanPSAGsr40_zooDMY3835E3CF5wXTA1h31sJRUQ10Vst32kKwJUU2JAIBB0EfhvjdLYHlKbVXWIEW2angUo Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: cd01f24cc14c4cde8e764fc6a76c4944 Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersNegativeTestJSON-532094980 Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd01f24cc14c4cde8e764fc6a76c4944"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cd01f24cc14c4cde8e764fc6a76c4944"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cd01f24cc14c4cde8e764fc6a76c4944"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd01f24cc14c4cde8e764fc6a76c4944"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersNegativeTestJSON-532094980 Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: cd01f24cc14c4cde8e764fc6a76c4944 Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-532094980 Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersNegativeTestJSON-532094980-project Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 11b872b8266f49e2b46706ef647ef4df Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersNegativeTestJSON-532094980-project Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: {"resize": {"flavorRef": "452"}} Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance deca2c41-ad0c-4792-a92f-98208de203e8 could not be found. Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'deca2c41-ad0c-4792-a92f-98208de203e8', 'body': {'resize': {'flavorRef': '452'}}} Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance deca2c41-ad0c-4792-a92f-98208de203e8 could not be found. Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:47:30.586261 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:47:30.590739 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance deca2c41-ad0c-4792-a92f-98208de203e8 could not be found. Sep 24 21:47:30.590739 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:47:30.590739 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:47:30.590739 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:47:30.590739 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:47:30.590739 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:47:30.590739 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:47:30.590739 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:47:30.590739 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:47:30.590739 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance deca2c41-ad0c-4792-a92f-98208de203e8 could not be found. Sep 24 21:47:30.590739 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:47:30.590739 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9ebe011d-9fa6-47ac-ac42-37279b24bf4b tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Returning 404 to user: Instance deca2c41-ad0c-4792-a92f-98208de203e8 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:47:30.590739 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9ebe011d-9fa6-47ac-ac42-37279b24bf4b tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "POST /compute/v2.1/servers/deca2c41-ad0c-4792-a92f-98208de203e8/action" status: 404 len: 111 microversion: 2.1 time: 0.014772 Sep 24 21:47:30.590739 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3375/6726] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:47:30 2022] POST /compute/v2.1/servers/deca2c41-ad0c-4792-a92f-98208de203e8/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:47:30.596015 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4bd09f0f-1149-49c7-af5a-67e1028e87d2 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:47:30.596630 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4bd09f0f-1149-49c7-af5a-67e1028e87d2 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: 44d9e06d-cb29-421c-9416-3cfd9cb6f3b8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:47:30.602750 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4bd09f0f-1149-49c7-af5a-67e1028e87d2 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:30.603237 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4bd09f0f-1149-49c7-af5a-67e1028e87d2 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:30.603676 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4bd09f0f-1149-49c7-af5a-67e1028e87d2 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:30.604370 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4bd09f0f-1149-49c7-af5a-67e1028e87d2 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:30.604825 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4bd09f0f-1149-49c7-af5a-67e1028e87d2 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:30.605250 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4bd09f0f-1149-49c7-af5a-67e1028e87d2 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:30.737957 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4bd09f0f-1149-49c7-af5a-67e1028e87d2 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b872b8266f49e2b46706ef647ef4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd01f24cc14c4cde8e764fc6a76c4944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:47:30.746146 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4bd09f0f-1149-49c7-af5a-67e1028e87d2 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "GET /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8" status: 200 len: 1505 microversion: 2.1 time: 0.153875 Sep 24 21:47:30.746780 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3352/6727] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:47:30 2022] GET /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:47:30.770192 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b51c4460-c0e0-4f21-bd4b-83c0b1f07ccd tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:47:30.772258 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b51c4460-c0e0-4f21-bd4b-83c0b1f07ccd tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: 44d9e06d-cb29-421c-9416-3cfd9cb6f3b8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:47:30.779160 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b51c4460-c0e0-4f21-bd4b-83c0b1f07ccd tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:30.779645 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b51c4460-c0e0-4f21-bd4b-83c0b1f07ccd tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:30.780085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b51c4460-c0e0-4f21-bd4b-83c0b1f07ccd tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:30.780782 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b51c4460-c0e0-4f21-bd4b-83c0b1f07ccd tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:30.781241 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b51c4460-c0e0-4f21-bd4b-83c0b1f07ccd tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:30.781675 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b51c4460-c0e0-4f21-bd4b-83c0b1f07ccd tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:30.921412 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b51c4460-c0e0-4f21-bd4b-83c0b1f07ccd tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b872b8266f49e2b46706ef647ef4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd01f24cc14c4cde8e764fc6a76c4944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:47:30.929852 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b51c4460-c0e0-4f21-bd4b-83c0b1f07ccd tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "GET /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8" status: 200 len: 1505 microversion: 2.1 time: 0.163514 Sep 24 21:47:30.930418 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3376/6728] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:47:30 2022] GET /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8 => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:47:30.953004 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e7335493-0fad-47df-af79-fd2b3197d34a tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "4fd0faaf-7b46-432a-bacf-fbaac6da299e"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:47:30.955285 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e7335493-0fad-47df-af79-fd2b3197d34a tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: 44d9e06d-cb29-421c-9416-3cfd9cb6f3b8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:47:30.961835 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e7335493-0fad-47df-af79-fd2b3197d34a tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:30.962317 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e7335493-0fad-47df-af79-fd2b3197d34a tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:30.962785 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e7335493-0fad-47df-af79-fd2b3197d34a tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:30.963476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e7335493-0fad-47df-af79-fd2b3197d34a tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:30.963928 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e7335493-0fad-47df-af79-fd2b3197d34a tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:30.964353 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e7335493-0fad-47df-af79-fd2b3197d34a tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:30.993185 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e7335493-0fad-47df-af79-fd2b3197d34a tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '11b872b8266f49e2b46706ef647ef4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd01f24cc14c4cde8e764fc6a76c4944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:47:30.997893 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-e7335493-0fad-47df-af79-fd2b3197d34a tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] HTTP exception thrown: Flavor 4fd0faaf-7b46-432a-bacf-fbaac6da299e could not be found. Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e7335493-0fad-47df-af79-fd2b3197d34a tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Request method failure captured: Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: request: POST /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8/action HTTP/1.1 Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 65 Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3raS5OYOwjZrhIfG5x0WNCmgLnn_RSbIcIXayCkSfhEJ0BB1FRP9vRCLRyFhJzyjzXNE0RNDt9Nioy6ema5lWNjIV_IanPSAGsr40_zooDMY3835E3CF5wXTA1h31sJRUQ10Vst32kKwJUU2JAIBB0EfhvjdLYHlKbVXWIEW2angUo Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: cd01f24cc14c4cde8e764fc6a76c4944 Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersNegativeTestJSON-532094980 Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd01f24cc14c4cde8e764fc6a76c4944"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cd01f24cc14c4cde8e764fc6a76c4944"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cd01f24cc14c4cde8e764fc6a76c4944"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd01f24cc14c4cde8e764fc6a76c4944"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersNegativeTestJSON-532094980 Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: cd01f24cc14c4cde8e764fc6a76c4944 Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-532094980 Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersNegativeTestJSON-532094980-project Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 11b872b8266f49e2b46706ef647ef4df Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersNegativeTestJSON-532094980-project Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: {"resize": {"flavorRef": "4fd0faaf-7b46-432a-bacf-fbaac6da299e"}} Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: exception: Flavor 4fd0faaf-7b46-432a-bacf-fbaac6da299e could not be found. Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '44d9e06d-cb29-421c-9416-3cfd9cb6f3b8', 'body': {'resize': {'flavorRef': '4fd0faaf-7b46-432a-bacf-fbaac6da299e'}}} Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:47:30.999801 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 24 21:47:31.004214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 24 21:47:31.004214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 4fd0faaf-7b46-432a-bacf-fbaac6da299e could not be found. Sep 24 21:47:31.004214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:47:31.004214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:47:31.004214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:47:31.004214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:47:31.004214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:47:31.004214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:47:31.004214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:47:31.004214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:47:31.004214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:47:31.004214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:47:31.004214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 21:47:31.004214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 21:47:31.004214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 24 21:47:31.004214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 24 21:47:31.004214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Sep 24 21:47:31.004214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 24 21:47:31.004214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 4fd0faaf-7b46-432a-bacf-fbaac6da299e could not be found. Sep 24 21:47:31.004214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:47:31.004214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:47:31.004214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:47:31.004214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:47:31.004214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:47:31.004214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:47:31.004214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:47:31.004214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:47:31.004214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 4fd0faaf-7b46-432a-bacf-fbaac6da299e could not be found. Sep 24 21:47:31.004214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:47:31.004214 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e7335493-0fad-47df-af79-fd2b3197d34a tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Returning 400 to user: Flavor 4fd0faaf-7b46-432a-bacf-fbaac6da299e could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:47:31.004214 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e7335493-0fad-47df-af79-fd2b3197d34a tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "POST /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8/action" status: 400 len: 107 microversion: 2.1 time: 0.052287 Sep 24 21:47:31.004214 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3353/6729] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:47:30 2022] POST /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8/action => generated 107 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:47:31.010917 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-db67d334-88bd-494d-8efb-c6177ef16c2f tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:47:31.011546 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-db67d334-88bd-494d-8efb-c6177ef16c2f tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: 44d9e06d-cb29-421c-9416-3cfd9cb6f3b8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:47:31.017552 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db67d334-88bd-494d-8efb-c6177ef16c2f tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:31.018043 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db67d334-88bd-494d-8efb-c6177ef16c2f tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:31.018511 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db67d334-88bd-494d-8efb-c6177ef16c2f tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:31.019216 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db67d334-88bd-494d-8efb-c6177ef16c2f tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:31.019686 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db67d334-88bd-494d-8efb-c6177ef16c2f tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:31.020153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-db67d334-88bd-494d-8efb-c6177ef16c2f tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:31.151612 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-db67d334-88bd-494d-8efb-c6177ef16c2f tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b872b8266f49e2b46706ef647ef4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd01f24cc14c4cde8e764fc6a76c4944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:47:31.159402 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-db67d334-88bd-494d-8efb-c6177ef16c2f tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "GET /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8" status: 200 len: 1505 microversion: 2.1 time: 0.152356 Sep 24 21:47:31.159987 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3377/6730] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:47:31 2022] GET /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:47:31.183686 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fdbef39c-0ab0-49ba-b60e-f27d12cb1eed tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:47:31.184238 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fdbef39c-0ab0-49ba-b60e-f27d12cb1eed tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: 44d9e06d-cb29-421c-9416-3cfd9cb6f3b8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:47:31.190288 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fdbef39c-0ab0-49ba-b60e-f27d12cb1eed tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:31.190818 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fdbef39c-0ab0-49ba-b60e-f27d12cb1eed tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:31.191260 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fdbef39c-0ab0-49ba-b60e-f27d12cb1eed tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:31.191961 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fdbef39c-0ab0-49ba-b60e-f27d12cb1eed tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:31.192457 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fdbef39c-0ab0-49ba-b60e-f27d12cb1eed tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:31.192891 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fdbef39c-0ab0-49ba-b60e-f27d12cb1eed tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:31.322947 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fdbef39c-0ab0-49ba-b60e-f27d12cb1eed tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b872b8266f49e2b46706ef647ef4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd01f24cc14c4cde8e764fc6a76c4944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:47:31.330708 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fdbef39c-0ab0-49ba-b60e-f27d12cb1eed tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "GET /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8" status: 200 len: 1505 microversion: 2.1 time: 0.151077 Sep 24 21:47:31.331279 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3354/6731] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:47:31 2022] GET /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:47:31.353803 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-18469075-42ed-44cf-a027-c4721946910e tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-18469075-42ed-44cf-a027-c4721946910e tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Request method failure captured: Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: request: POST /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8/action HTTP/1.1 Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 29 Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3raS5OYOwjZrhIfG5x0WNCmgLnn_RSbIcIXayCkSfhEJ0BB1FRP9vRCLRyFhJzyjzXNE0RNDt9Nioy6ema5lWNjIV_IanPSAGsr40_zooDMY3835E3CF5wXTA1h31sJRUQ10Vst32kKwJUU2JAIBB0EfhvjdLYHlKbVXWIEW2angUo Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: cd01f24cc14c4cde8e764fc6a76c4944 Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersNegativeTestJSON-532094980 Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd01f24cc14c4cde8e764fc6a76c4944"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cd01f24cc14c4cde8e764fc6a76c4944"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cd01f24cc14c4cde8e764fc6a76c4944"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd01f24cc14c4cde8e764fc6a76c4944"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersNegativeTestJSON-532094980 Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: cd01f24cc14c4cde8e764fc6a76c4944 Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-532094980 Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersNegativeTestJSON-532094980-project Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 11b872b8266f49e2b46706ef647ef4df Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersNegativeTestJSON-532094980-project Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: {"resize": {"flavorRef": ""}} Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': '44d9e06d-cb29-421c-9416-3cfd9cb6f3b8', 'body': {'resize': {'flavorRef': ''}}} Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise error Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi On instance['resize']: Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi '' Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:47:31.357510 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:47:31.362568 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:47:31.362568 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:47:31.362568 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:47:31.362568 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:47:31.362568 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 21:47:31.362568 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 21:47:31.362568 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 24 21:47:31.362568 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:47:31.362568 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-18469075-42ed-44cf-a027-c4721946910e tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:47:31.362568 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-18469075-42ed-44cf-a027-c4721946910e tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "POST /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8/action" status: 400 len: 113 microversion: 2.1 time: 0.009246 Sep 24 21:47:31.362568 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3378/6732] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:47:31 2022] POST /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 21:47:31.367967 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-17a3e583-757d-4ee0-ac42-20cc25612356 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:47:31.368593 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-17a3e583-757d-4ee0-ac42-20cc25612356 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: 44d9e06d-cb29-421c-9416-3cfd9cb6f3b8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:47:31.374784 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17a3e583-757d-4ee0-ac42-20cc25612356 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:31.375273 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17a3e583-757d-4ee0-ac42-20cc25612356 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:31.375715 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17a3e583-757d-4ee0-ac42-20cc25612356 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:31.376418 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17a3e583-757d-4ee0-ac42-20cc25612356 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:31.376880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17a3e583-757d-4ee0-ac42-20cc25612356 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:31.377309 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-17a3e583-757d-4ee0-ac42-20cc25612356 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:31.512082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-17a3e583-757d-4ee0-ac42-20cc25612356 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b872b8266f49e2b46706ef647ef4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd01f24cc14c4cde8e764fc6a76c4944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:47:31.520030 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-17a3e583-757d-4ee0-ac42-20cc25612356 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "GET /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8" status: 200 len: 1505 microversion: 2.1 time: 0.156152 Sep 24 21:47:31.520849 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3355/6733] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:47:31 2022] GET /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:47:31.547436 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b0696590-3f04-4b7c-a66d-77545e2dd4d6 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:47:31.547938 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b0696590-3f04-4b7c-a66d-77545e2dd4d6 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: af9ea867-8246-47ad-b323-76dbc2e707e6] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:47:31.556019 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b0696590-3f04-4b7c-a66d-77545e2dd4d6 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:31.556551 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b0696590-3f04-4b7c-a66d-77545e2dd4d6 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:31.556997 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b0696590-3f04-4b7c-a66d-77545e2dd4d6 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:31.557703 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b0696590-3f04-4b7c-a66d-77545e2dd4d6 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:31.558167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b0696590-3f04-4b7c-a66d-77545e2dd4d6 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:31.558650 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b0696590-3f04-4b7c-a66d-77545e2dd4d6 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:31.572616 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-b0696590-3f04-4b7c-a66d-77545e2dd4d6 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] HTTP exception thrown: Instance af9ea867-8246-47ad-b323-76dbc2e707e6 could not be found. Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b0696590-3f04-4b7c-a66d-77545e2dd4d6 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Request method failure captured: Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: request: DELETE /compute/v2.1/servers/af9ea867-8246-47ad-b323-76dbc2e707e6 HTTP/1.1 Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3raS5OYOwjZrhIfG5x0WNCmgLnn_RSbIcIXayCkSfhEJ0BB1FRP9vRCLRyFhJzyjzXNE0RNDt9Nioy6ema5lWNjIV_IanPSAGsr40_zooDMY3835E3CF5wXTA1h31sJRUQ10Vst32kKwJUU2JAIBB0EfhvjdLYHlKbVXWIEW2angUo Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: cd01f24cc14c4cde8e764fc6a76c4944 Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-ServersNegativeTestJSON-532094980 Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd01f24cc14c4cde8e764fc6a76c4944"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cd01f24cc14c4cde8e764fc6a76c4944"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cd01f24cc14c4cde8e764fc6a76c4944"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd01f24cc14c4cde8e764fc6a76c4944"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-ServersNegativeTestJSON-532094980 Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: cd01f24cc14c4cde8e764fc6a76c4944 Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-532094980 Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-ServersNegativeTestJSON-532094980-project Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: 11b872b8266f49e2b46706ef647ef4df Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-ServersNegativeTestJSON-532094980-project Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance af9ea867-8246-47ad-b323-76dbc2e707e6 could not be found. Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'af9ea867-8246-47ad-b323-76dbc2e707e6'} Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af9ea867-8246-47ad-b323-76dbc2e707e6 could not be found. Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:47:31.574458 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:47:31.579113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af9ea867-8246-47ad-b323-76dbc2e707e6 could not be found. Sep 24 21:47:31.579113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:47:31.579113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:47:31.579113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:47:31.579113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:47:31.579113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:47:31.579113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:47:31.579113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:47:31.579113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:47:31.579113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af9ea867-8246-47ad-b323-76dbc2e707e6 could not be found. Sep 24 21:47:31.579113 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:47:31.579113 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b0696590-3f04-4b7c-a66d-77545e2dd4d6 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Returning 404 to user: Instance af9ea867-8246-47ad-b323-76dbc2e707e6 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:47:31.579113 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b0696590-3f04-4b7c-a66d-77545e2dd4d6 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "DELETE /compute/v2.1/servers/af9ea867-8246-47ad-b323-76dbc2e707e6" status: 404 len: 111 microversion: 2.1 time: 0.033670 Sep 24 21:47:31.579113 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3379/6734] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:47:31 2022] DELETE /compute/v2.1/servers/af9ea867-8246-47ad-b323-76dbc2e707e6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:47:31.584528 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9d5eb6b7-68bb-448d-bbf2-1d3b977c46b1 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:47:31.585183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9d5eb6b7-68bb-448d-bbf2-1d3b977c46b1 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: af9ea867-8246-47ad-b323-76dbc2e707e6] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:47:31.591536 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d5eb6b7-68bb-448d-bbf2-1d3b977c46b1 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:31.592033 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d5eb6b7-68bb-448d-bbf2-1d3b977c46b1 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:31.592486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d5eb6b7-68bb-448d-bbf2-1d3b977c46b1 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:31.593198 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d5eb6b7-68bb-448d-bbf2-1d3b977c46b1 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:31.593670 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d5eb6b7-68bb-448d-bbf2-1d3b977c46b1 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:31.594109 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9d5eb6b7-68bb-448d-bbf2-1d3b977c46b1 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:31.608808 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-9d5eb6b7-68bb-448d-bbf2-1d3b977c46b1 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] HTTP exception thrown: Instance af9ea867-8246-47ad-b323-76dbc2e707e6 could not be found. Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9d5eb6b7-68bb-448d-bbf2-1d3b977c46b1 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Request method failure captured: Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/af9ea867-8246-47ad-b323-76dbc2e707e6 HTTP/1.1 Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3raS5OYOwjZrhIfG5x0WNCmgLnn_RSbIcIXayCkSfhEJ0BB1FRP9vRCLRyFhJzyjzXNE0RNDt9Nioy6ema5lWNjIV_IanPSAGsr40_zooDMY3835E3CF5wXTA1h31sJRUQ10Vst32kKwJUU2JAIBB0EfhvjdLYHlKbVXWIEW2angUo Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: cd01f24cc14c4cde8e764fc6a76c4944 Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersNegativeTestJSON-532094980 Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd01f24cc14c4cde8e764fc6a76c4944"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cd01f24cc14c4cde8e764fc6a76c4944"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cd01f24cc14c4cde8e764fc6a76c4944"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd01f24cc14c4cde8e764fc6a76c4944"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersNegativeTestJSON-532094980 Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: cd01f24cc14c4cde8e764fc6a76c4944 Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-532094980 Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersNegativeTestJSON-532094980-project Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 11b872b8266f49e2b46706ef647ef4df Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersNegativeTestJSON-532094980-project Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance af9ea867-8246-47ad-b323-76dbc2e707e6 could not be found. Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'af9ea867-8246-47ad-b323-76dbc2e707e6'} Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af9ea867-8246-47ad-b323-76dbc2e707e6 could not be found. Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af9ea867-8246-47ad-b323-76dbc2e707e6 could not be found. Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:47:31.610412 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:47:31.615855 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:47:31.615855 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:47:31.615855 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:47:31.615855 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:47:31.615855 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:47:31.615855 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af9ea867-8246-47ad-b323-76dbc2e707e6 could not be found. Sep 24 21:47:31.615855 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:47:31.615855 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9d5eb6b7-68bb-448d-bbf2-1d3b977c46b1 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Returning 404 to user: Instance af9ea867-8246-47ad-b323-76dbc2e707e6 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:47:31.615855 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9d5eb6b7-68bb-448d-bbf2-1d3b977c46b1 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "GET /compute/v2.1/servers/af9ea867-8246-47ad-b323-76dbc2e707e6" status: 404 len: 111 microversion: 2.1 time: 0.031201 Sep 24 21:47:31.615855 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3356/6735] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:47:31 2022] GET /compute/v2.1/servers/af9ea867-8246-47ad-b323-76dbc2e707e6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:47:31.621553 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dcb56248-c595-4728-92df-b7322e79ab60 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:47:31.622100 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dcb56248-c595-4728-92df-b7322e79ab60 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: 44d9e06d-cb29-421c-9416-3cfd9cb6f3b8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:47:31.628254 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dcb56248-c595-4728-92df-b7322e79ab60 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:31.628837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dcb56248-c595-4728-92df-b7322e79ab60 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:31.629743 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dcb56248-c595-4728-92df-b7322e79ab60 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:31.629984 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dcb56248-c595-4728-92df-b7322e79ab60 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:31.630455 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dcb56248-c595-4728-92df-b7322e79ab60 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:31.630920 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dcb56248-c595-4728-92df-b7322e79ab60 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:31.656792 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dcb56248-c595-4728-92df-b7322e79ab60 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: 44d9e06d-cb29-421c-9416-3cfd9cb6f3b8] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:47:31.733089 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dcb56248-c595-4728-92df-b7322e79ab60 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "DELETE /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8" status: 204 len: 0 microversion: 2.1 time: 0.115197 Sep 24 21:47:31.733950 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3380/6736] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:47:31 2022] DELETE /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:47:31.743085 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9a4a7a35-ad12-482b-9639-1bd650e90995 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:47:31.743782 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9a4a7a35-ad12-482b-9639-1bd650e90995 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: 44d9e06d-cb29-421c-9416-3cfd9cb6f3b8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:47:31.749805 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9a4a7a35-ad12-482b-9639-1bd650e90995 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:31.750293 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9a4a7a35-ad12-482b-9639-1bd650e90995 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:31.750783 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9a4a7a35-ad12-482b-9639-1bd650e90995 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:31.751487 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9a4a7a35-ad12-482b-9639-1bd650e90995 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:31.751942 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9a4a7a35-ad12-482b-9639-1bd650e90995 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:31.752372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9a4a7a35-ad12-482b-9639-1bd650e90995 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:31.883984 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9a4a7a35-ad12-482b-9639-1bd650e90995 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b872b8266f49e2b46706ef647ef4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd01f24cc14c4cde8e764fc6a76c4944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:47:31.892555 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9a4a7a35-ad12-482b-9639-1bd650e90995 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "GET /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8" status: 200 len: 1511 microversion: 2.1 time: 0.154337 Sep 24 21:47:31.893266 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3357/6737] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:47:31 2022] GET /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:47:32.917575 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8e1418db-2cc9-4a23-91f3-ab63305b58af tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:47:32.918215 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8e1418db-2cc9-4a23-91f3-ab63305b58af tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: 44d9e06d-cb29-421c-9416-3cfd9cb6f3b8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:47:32.925177 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8e1418db-2cc9-4a23-91f3-ab63305b58af tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:32.925675 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8e1418db-2cc9-4a23-91f3-ab63305b58af tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:32.926127 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8e1418db-2cc9-4a23-91f3-ab63305b58af tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:32.926918 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8e1418db-2cc9-4a23-91f3-ab63305b58af tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:32.927653 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8e1418db-2cc9-4a23-91f3-ab63305b58af tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:32.928092 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8e1418db-2cc9-4a23-91f3-ab63305b58af tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:33.065280 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8e1418db-2cc9-4a23-91f3-ab63305b58af tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b872b8266f49e2b46706ef647ef4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd01f24cc14c4cde8e764fc6a76c4944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:47:33.073829 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8e1418db-2cc9-4a23-91f3-ab63305b58af tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "GET /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8" status: 200 len: 1511 microversion: 2.1 time: 0.160679 Sep 24 21:47:33.074410 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3381/6738] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:47:32 2022] GET /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8 => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:47:33.696095 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-252841af-3b3c-4fe9-85fb-a9d82463dc4f req-dee03ddf-d072-4c9f-8526-74cb4ca03727 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44d9e06d-cb29-421c-9416-3cfd9cb6f3b8", "name": "network-vif-deleted", "tag": "6754558b-290d-46b6-a11b-9e971a1b71de"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:47:33.703210 ncdv-master-1 devstack@n-api.service[140516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 21:47:33.703378 ncdv-master-1 devstack@n-api.service[140516]: Sat Sep 24 21:47:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.52) !!! Sep 24 21:47:33.714720 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-252841af-3b3c-4fe9-85fb-a9d82463dc4f req-dee03ddf-d072-4c9f-8526-74cb4ca03727 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:33.715220 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-252841af-3b3c-4fe9-85fb-a9d82463dc4f req-dee03ddf-d072-4c9f-8526-74cb4ca03727 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:33.715774 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-252841af-3b3c-4fe9-85fb-a9d82463dc4f req-dee03ddf-d072-4c9f-8526-74cb4ca03727 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:33.729921 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-252841af-3b3c-4fe9-85fb-a9d82463dc4f req-dee03ddf-d072-4c9f-8526-74cb4ca03727 service nova] Creating event network-vif-deleted:6754558b-290d-46b6-a11b-9e971a1b71de for instance 44d9e06d-cb29-421c-9416-3cfd9cb6f3b8 on nch1-master-1 Sep 24 21:47:33.734902 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-252841af-3b3c-4fe9-85fb-a9d82463dc4f req-dee03ddf-d072-4c9f-8526-74cb4ca03727 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043105 Sep 24 21:47:33.735517 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3358/6739] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:47:34.097624 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-10aa8a02-294e-4d73-b809-fd52ef50a5a0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:47:34.098254 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-10aa8a02-294e-4d73-b809-fd52ef50a5a0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: 44d9e06d-cb29-421c-9416-3cfd9cb6f3b8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:47:34.106701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-10aa8a02-294e-4d73-b809-fd52ef50a5a0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:34.107259 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-10aa8a02-294e-4d73-b809-fd52ef50a5a0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:34.107811 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-10aa8a02-294e-4d73-b809-fd52ef50a5a0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:34.108599 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-10aa8a02-294e-4d73-b809-fd52ef50a5a0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:34.109057 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-10aa8a02-294e-4d73-b809-fd52ef50a5a0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:34.109494 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-10aa8a02-294e-4d73-b809-fd52ef50a5a0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:34.129395 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:47:34.145895 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-10aa8a02-294e-4d73-b809-fd52ef50a5a0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:34.146399 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-10aa8a02-294e-4d73-b809-fd52ef50a5a0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:34.146881 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-10aa8a02-294e-4d73-b809-fd52ef50a5a0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:34.147349 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-10aa8a02-294e-4d73-b809-fd52ef50a5a0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lazy-loading 'fault' on Instance uuid 44d9e06d-cb29-421c-9416-3cfd9cb6f3b8 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:47:34.194396 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-10aa8a02-294e-4d73-b809-fd52ef50a5a0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b872b8266f49e2b46706ef647ef4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd01f24cc14c4cde8e764fc6a76c4944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:47:34.201672 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-10aa8a02-294e-4d73-b809-fd52ef50a5a0 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "GET /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8" status: 200 len: 1307 microversion: 2.1 time: 0.108135 Sep 24 21:47:34.202260 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3382/6740] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:47:34 2022] GET /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8 => generated 1307 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:47:35.227391 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-14300a13-7608-4839-9d67-53b59e529f20 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:47:35.228165 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-14300a13-7608-4839-9d67-53b59e529f20 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] [instance: 44d9e06d-cb29-421c-9416-3cfd9cb6f3b8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:47:35.234521 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-14300a13-7608-4839-9d67-53b59e529f20 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:35.235021 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-14300a13-7608-4839-9d67-53b59e529f20 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:35.235466 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-14300a13-7608-4839-9d67-53b59e529f20 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:35.236165 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-14300a13-7608-4839-9d67-53b59e529f20 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:47:35.236626 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-14300a13-7608-4839-9d67-53b59e529f20 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:47:35.237062 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-14300a13-7608-4839-9d67-53b59e529f20 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:47:35.251583 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-14300a13-7608-4839-9d67-53b59e529f20 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] HTTP exception thrown: Instance 44d9e06d-cb29-421c-9416-3cfd9cb6f3b8 could not be found. Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-14300a13-7608-4839-9d67-53b59e529f20 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Request method failure captured: Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8 HTTP/1.1 Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3raS5OYOwjZrhIfG5x0WNCmgLnn_RSbIcIXayCkSfhEJ0BB1FRP9vRCLRyFhJzyjzXNE0RNDt9Nioy6ema5lWNjIV_IanPSAGsr40_zooDMY3835E3CF5wXTA1h31sJRUQ10Vst32kKwJUU2JAIBB0EfhvjdLYHlKbVXWIEW2angUo Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: cd01f24cc14c4cde8e764fc6a76c4944 Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-ServersNegativeTestJSON-532094980 Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd01f24cc14c4cde8e764fc6a76c4944"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cd01f24cc14c4cde8e764fc6a76c4944"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cd01f24cc14c4cde8e764fc6a76c4944"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd01f24cc14c4cde8e764fc6a76c4944"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-ServersNegativeTestJSON-532094980 Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: cd01f24cc14c4cde8e764fc6a76c4944 Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-532094980 Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-ServersNegativeTestJSON-532094980-project Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 11b872b8266f49e2b46706ef647ef4df Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-ServersNegativeTestJSON-532094980-project Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 44d9e06d-cb29-421c-9416-3cfd9cb6f3b8 could not be found. Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '44d9e06d-cb29-421c-9416-3cfd9cb6f3b8'} Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44d9e06d-cb29-421c-9416-3cfd9cb6f3b8 could not be found. Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44d9e06d-cb29-421c-9416-3cfd9cb6f3b8 could not be found. Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:47:35.253214 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:47:35.258314 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:47:35.258314 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:47:35.258314 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:47:35.258314 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:47:35.258314 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:47:35.258314 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44d9e06d-cb29-421c-9416-3cfd9cb6f3b8 could not be found. Sep 24 21:47:35.258314 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:47:35.258314 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-14300a13-7608-4839-9d67-53b59e529f20 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] Returning 404 to user: Instance 44d9e06d-cb29-421c-9416-3cfd9cb6f3b8 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:47:35.258314 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-14300a13-7608-4839-9d67-53b59e529f20 tempest-ServersNegativeTestJSON-532094980 tempest-ServersNegativeTestJSON-532094980-project] 10.222.0.52 "GET /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8" status: 404 len: 111 microversion: 2.1 time: 0.032994 Sep 24 21:47:35.258314 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3359/6741] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:47:35 2022] GET /compute/v2.1/servers/44d9e06d-cb29-421c-9416-3cfd9cb6f3b8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:48:16.549870 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-38a13659-8ea2-4d6f-8e03-ea1a1879f678 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Action: 'create', calling method: .version_select at 0x7f4b07dac0d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-463962347", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcwtFGKH9pat5W3dZ+XNgNiTOdenBDnXCrH92wv+9le4MO9MTRk1tM9LigA+vdPayKrAl3J8bGt7Mcm5tvyiEX33wH7Hr40wsAxLYL4geaHKT2WkBXLX5LkuKJIjj6aEQ=="}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:48:16.556166 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:48:16.557063 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=4 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:48:16.571189 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-38a13659-8ea2-4d6f-8e03-ea1a1879f678 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Getting quotas for project ef4f79cc25ee473bb029c30cbf0da4a2. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:48:16.576465 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-38a13659-8ea2-4d6f-8e03-ea1a1879f678 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Getting quotas for user d6fb8f277c5047c7860690a102ef7c41 and project ef4f79cc25ee473bb029c30cbf0da4a2. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:48:16.601352 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-38a13659-8ea2-4d6f-8e03-ea1a1879f678 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.055738 Sep 24 21:48:16.601975 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3383/6742] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 21:48:16 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:48:16.653986 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f54dfed8-ba5f-4963-87b1-8a56120063a7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1563390152", "imageRef": "d18250ae-87ee-4870-9eb8-22821619ed51", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-463962347", "networks": [{"uuid": "8b3c5a78-0857-4fc7-82a1-b73684aefeb3"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:48:16.662900 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:48:16.663565 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:48:16.905068 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-f54dfed8-ba5f-4963-87b1-8a56120063a7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] validate_networks() for [('8b3c5a78-0857-4fc7-82a1-b73684aefeb3', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:48:17.445236 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-f54dfed8-ba5f-4963-87b1-8a56120063a7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:48:17.445702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-f54dfed8-ba5f-4963-87b1-8a56120063a7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:48:17.446186 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-f54dfed8-ba5f-4963-87b1-8a56120063a7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:48:17.446631 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-f54dfed8-ba5f-4963-87b1-8a56120063a7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:48:17.447051 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-f54dfed8-ba5f-4963-87b1-8a56120063a7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:48:17.455934 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f54dfed8-ba5f-4963-87b1-8a56120063a7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:17.456654 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f54dfed8-ba5f-4963-87b1-8a56120063a7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:17.457203 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f54dfed8-ba5f-4963-87b1-8a56120063a7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:17.457941 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f54dfed8-ba5f-4963-87b1-8a56120063a7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:17.458401 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f54dfed8-ba5f-4963-87b1-8a56120063a7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:17.458864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f54dfed8-ba5f-4963-87b1-8a56120063a7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:17.476475 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-f54dfed8-ba5f-4963-87b1-8a56120063a7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Getting quotas for project ef4f79cc25ee473bb029c30cbf0da4a2. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:48:17.481651 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-f54dfed8-ba5f-4963-87b1-8a56120063a7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Getting quotas for user d6fb8f277c5047c7860690a102ef7c41 and project ef4f79cc25ee473bb029c30cbf0da4a2. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:48:17.494827 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f54dfed8-ba5f-4963-87b1-8a56120063a7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:48:17.497056 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f54dfed8-ba5f-4963-87b1-8a56120063a7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: bbf83ddb-7807-4dd2-a0fe-00c317265af0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d18250ae-87ee-4870-9eb8-22821619ed51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:48:17.544314 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f54dfed8-ba5f-4963-87b1-8a56120063a7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.894371 Sep 24 21:48:17.545120 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3360/6743] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:48:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:48:17.557689 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-397c8cca-ed7f-44b8-9ccc-99c020201111 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:48:17.559010 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-397c8cca-ed7f-44b8-9ccc-99c020201111 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: bbf83ddb-7807-4dd2-a0fe-00c317265af0] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:48:17.740085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-397c8cca-ed7f-44b8-9ccc-99c020201111 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:48:17.747980 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-397c8cca-ed7f-44b8-9ccc-99c020201111 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0" status: 200 len: 1258 microversion: 2.1 time: 0.195735 Sep 24 21:48:17.748551 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3384/6744] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:48:17 2022] GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0 => generated 1258 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:48:18.773284 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4b7671ab-6c85-4f3d-874c-45b0973c13c6 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:48:18.773890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4b7671ab-6c85-4f3d-874c-45b0973c13c6 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: bbf83ddb-7807-4dd2-a0fe-00c317265af0] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:48:18.782906 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4b7671ab-6c85-4f3d-874c-45b0973c13c6 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:18.783393 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4b7671ab-6c85-4f3d-874c-45b0973c13c6 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:18.783834 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4b7671ab-6c85-4f3d-874c-45b0973c13c6 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:18.784860 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4b7671ab-6c85-4f3d-874c-45b0973c13c6 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:18.785490 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4b7671ab-6c85-4f3d-874c-45b0973c13c6 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:18.785924 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4b7671ab-6c85-4f3d-874c-45b0973c13c6 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:18.863345 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4b7671ab-6c85-4f3d-874c-45b0973c13c6 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:48:18.872197 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4b7671ab-6c85-4f3d-874c-45b0973c13c6 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0" status: 200 len: 1316 microversion: 2.1 time: 0.104772 Sep 24 21:48:18.872871 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3361/6745] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:48:18 2022] GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0 => generated 1316 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:48:19.896135 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f1a4649a-c8eb-4886-8b09-e8b1c1f416d7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:48:19.896720 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f1a4649a-c8eb-4886-8b09-e8b1c1f416d7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: bbf83ddb-7807-4dd2-a0fe-00c317265af0] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:48:19.903823 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f1a4649a-c8eb-4886-8b09-e8b1c1f416d7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:19.904452 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f1a4649a-c8eb-4886-8b09-e8b1c1f416d7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:19.905032 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f1a4649a-c8eb-4886-8b09-e8b1c1f416d7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:19.906002 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f1a4649a-c8eb-4886-8b09-e8b1c1f416d7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:19.906628 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f1a4649a-c8eb-4886-8b09-e8b1c1f416d7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:19.907153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f1a4649a-c8eb-4886-8b09-e8b1c1f416d7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:20.059045 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f1a4649a-c8eb-4886-8b09-e8b1c1f416d7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:48:20.067841 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f1a4649a-c8eb-4886-8b09-e8b1c1f416d7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0" status: 200 len: 1358 microversion: 2.1 time: 0.175833 Sep 24 21:48:20.068437 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3385/6746] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:48:19 2022] GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:48:21.092267 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8493f8e9-c68d-4597-bc08-cb117f659415 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:48:21.093669 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8493f8e9-c68d-4597-bc08-cb117f659415 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: bbf83ddb-7807-4dd2-a0fe-00c317265af0] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:48:21.101948 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8493f8e9-c68d-4597-bc08-cb117f659415 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:21.102438 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8493f8e9-c68d-4597-bc08-cb117f659415 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:21.102917 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8493f8e9-c68d-4597-bc08-cb117f659415 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:21.103632 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8493f8e9-c68d-4597-bc08-cb117f659415 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:21.104089 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8493f8e9-c68d-4597-bc08-cb117f659415 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:21.104524 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8493f8e9-c68d-4597-bc08-cb117f659415 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:21.262321 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8493f8e9-c68d-4597-bc08-cb117f659415 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:48:21.271823 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8493f8e9-c68d-4597-bc08-cb117f659415 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0" status: 200 len: 1358 microversion: 2.1 time: 0.183741 Sep 24 21:48:21.272792 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3362/6747] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:48:21 2022] GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:48:22.295676 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c58174b2-6797-47a4-93e5-17a884bca1c2 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:48:22.296322 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c58174b2-6797-47a4-93e5-17a884bca1c2 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: bbf83ddb-7807-4dd2-a0fe-00c317265af0] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:48:22.304460 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c58174b2-6797-47a4-93e5-17a884bca1c2 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:22.304965 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c58174b2-6797-47a4-93e5-17a884bca1c2 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:22.305422 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c58174b2-6797-47a4-93e5-17a884bca1c2 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:22.306140 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c58174b2-6797-47a4-93e5-17a884bca1c2 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:22.306635 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c58174b2-6797-47a4-93e5-17a884bca1c2 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:22.307259 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c58174b2-6797-47a4-93e5-17a884bca1c2 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:22.449039 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c58174b2-6797-47a4-93e5-17a884bca1c2 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:48:22.457518 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c58174b2-6797-47a4-93e5-17a884bca1c2 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0" status: 200 len: 1358 microversion: 2.1 time: 0.166156 Sep 24 21:48:22.458113 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3386/6748] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:48:22 2022] GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:48:23.482983 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fb8d85d1-7b7c-4aaa-a3b3-f1e8473379ba tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:48:23.484706 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fb8d85d1-7b7c-4aaa-a3b3-f1e8473379ba tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: bbf83ddb-7807-4dd2-a0fe-00c317265af0] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:48:23.492892 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb8d85d1-7b7c-4aaa-a3b3-f1e8473379ba tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:23.493485 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb8d85d1-7b7c-4aaa-a3b3-f1e8473379ba tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:23.494011 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb8d85d1-7b7c-4aaa-a3b3-f1e8473379ba tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:23.494779 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb8d85d1-7b7c-4aaa-a3b3-f1e8473379ba tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:23.495246 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb8d85d1-7b7c-4aaa-a3b3-f1e8473379ba tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:23.495684 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb8d85d1-7b7c-4aaa-a3b3-f1e8473379ba tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:23.648165 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fb8d85d1-7b7c-4aaa-a3b3-f1e8473379ba tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:48:23.656438 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fb8d85d1-7b7c-4aaa-a3b3-f1e8473379ba tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0" status: 200 len: 1358 microversion: 2.1 time: 0.177336 Sep 24 21:48:23.657261 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3363/6749] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:48:23 2022] GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:48:24.680958 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f5b1dfba-8b47-4f2f-80d0-49402e75032d tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:48:24.681596 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f5b1dfba-8b47-4f2f-80d0-49402e75032d tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: bbf83ddb-7807-4dd2-a0fe-00c317265af0] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:48:24.700596 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5b1dfba-8b47-4f2f-80d0-49402e75032d tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:24.701096 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5b1dfba-8b47-4f2f-80d0-49402e75032d tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:24.701546 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5b1dfba-8b47-4f2f-80d0-49402e75032d tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:24.702275 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5b1dfba-8b47-4f2f-80d0-49402e75032d tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:24.702772 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5b1dfba-8b47-4f2f-80d0-49402e75032d tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:24.703214 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5b1dfba-8b47-4f2f-80d0-49402e75032d tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:24.848524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f5b1dfba-8b47-4f2f-80d0-49402e75032d tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:48:24.856554 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f5b1dfba-8b47-4f2f-80d0-49402e75032d tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0" status: 200 len: 1358 microversion: 2.1 time: 0.179938 Sep 24 21:48:24.857139 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3387/6750] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:48:24 2022] GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:48:25.880974 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ba7e9aa7-293c-41c5-ba34-abf35bdb8ca1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:48:25.881583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ba7e9aa7-293c-41c5-ba34-abf35bdb8ca1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: bbf83ddb-7807-4dd2-a0fe-00c317265af0] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:48:25.888864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba7e9aa7-293c-41c5-ba34-abf35bdb8ca1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:25.889654 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba7e9aa7-293c-41c5-ba34-abf35bdb8ca1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:25.890468 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba7e9aa7-293c-41c5-ba34-abf35bdb8ca1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:25.891439 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba7e9aa7-293c-41c5-ba34-abf35bdb8ca1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:25.892094 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba7e9aa7-293c-41c5-ba34-abf35bdb8ca1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:25.892715 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba7e9aa7-293c-41c5-ba34-abf35bdb8ca1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:26.041872 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ba7e9aa7-293c-41c5-ba34-abf35bdb8ca1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:48:26.050842 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ba7e9aa7-293c-41c5-ba34-abf35bdb8ca1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0" status: 200 len: 1358 microversion: 2.1 time: 0.174796 Sep 24 21:48:26.051524 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3364/6751] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:48:25 2022] GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:48:27.076039 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f02ea200-98a4-4d5e-b2c8-a6850c28fbf5 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:48:27.076799 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f02ea200-98a4-4d5e-b2c8-a6850c28fbf5 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: bbf83ddb-7807-4dd2-a0fe-00c317265af0] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:48:27.084229 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f02ea200-98a4-4d5e-b2c8-a6850c28fbf5 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:27.084729 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f02ea200-98a4-4d5e-b2c8-a6850c28fbf5 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:27.085183 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f02ea200-98a4-4d5e-b2c8-a6850c28fbf5 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:27.085904 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f02ea200-98a4-4d5e-b2c8-a6850c28fbf5 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:27.086370 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f02ea200-98a4-4d5e-b2c8-a6850c28fbf5 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:27.086841 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f02ea200-98a4-4d5e-b2c8-a6850c28fbf5 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:27.295362 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f02ea200-98a4-4d5e-b2c8-a6850c28fbf5 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:48:27.304031 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f02ea200-98a4-4d5e-b2c8-a6850c28fbf5 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0" status: 200 len: 1358 microversion: 2.1 time: 0.232013 Sep 24 21:48:27.304623 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3388/6752] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:48:27 2022] GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0 => generated 1358 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:48:27.481829 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:48:27.488675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:48:27.535890 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-4251caf3-31cf-47bc-b638-fd1b63bffbff req-76513c85-8bfe-4b59-9277-6109ad2ac006 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbf83ddb-7807-4dd2-a0fe-00c317265af0", "tag": "5decbd9b-64bc-456a-8901-2b416bf4c7d0"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:48:27.546066 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-4251caf3-31cf-47bc-b638-fd1b63bffbff req-76513c85-8bfe-4b59-9277-6109ad2ac006 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:27.546669 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-4251caf3-31cf-47bc-b638-fd1b63bffbff req-76513c85-8bfe-4b59-9277-6109ad2ac006 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:27.547182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-4251caf3-31cf-47bc-b638-fd1b63bffbff req-76513c85-8bfe-4b59-9277-6109ad2ac006 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:27.559104 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-4251caf3-31cf-47bc-b638-fd1b63bffbff req-76513c85-8bfe-4b59-9277-6109ad2ac006 service nova] Creating event network-changed:5decbd9b-64bc-456a-8901-2b416bf4c7d0 for instance bbf83ddb-7807-4dd2-a0fe-00c317265af0 on nch2-master-1 Sep 24 21:48:27.564194 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-4251caf3-31cf-47bc-b638-fd1b63bffbff req-76513c85-8bfe-4b59-9277-6109ad2ac006 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087764 Sep 24 21:48:27.564895 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3365/6753] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:48:28.327644 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-63480424-c898-4dc8-b331-e0931858366a tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:48:28.328275 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-63480424-c898-4dc8-b331-e0931858366a tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: bbf83ddb-7807-4dd2-a0fe-00c317265af0] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:48:28.330132 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=6 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:48:28.336570 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-63480424-c898-4dc8-b331-e0931858366a tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:28.337063 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-63480424-c898-4dc8-b331-e0931858366a tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:28.337508 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-63480424-c898-4dc8-b331-e0931858366a tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:28.338214 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-63480424-c898-4dc8-b331-e0931858366a tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:28.338711 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-63480424-c898-4dc8-b331-e0931858366a tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:28.339143 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-63480424-c898-4dc8-b331-e0931858366a tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:28.474903 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-63480424-c898-4dc8-b331-e0931858366a tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:48:28.483263 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-63480424-c898-4dc8-b331-e0931858366a tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0" status: 200 len: 1358 microversion: 2.1 time: 0.159474 Sep 24 21:48:28.483863 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3389/6754] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:48:28 2022] GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:48:29.508964 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7650d4cd-9807-484b-a075-b6e6a22d4080 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:48:29.509760 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7650d4cd-9807-484b-a075-b6e6a22d4080 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: bbf83ddb-7807-4dd2-a0fe-00c317265af0] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:48:29.516345 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7650d4cd-9807-484b-a075-b6e6a22d4080 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:29.516847 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7650d4cd-9807-484b-a075-b6e6a22d4080 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:29.517292 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7650d4cd-9807-484b-a075-b6e6a22d4080 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:29.518002 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7650d4cd-9807-484b-a075-b6e6a22d4080 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:29.518574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7650d4cd-9807-484b-a075-b6e6a22d4080 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:29.519018 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7650d4cd-9807-484b-a075-b6e6a22d4080 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:29.650956 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7650d4cd-9807-484b-a075-b6e6a22d4080 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:48:29.658719 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7650d4cd-9807-484b-a075-b6e6a22d4080 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0" status: 200 len: 1358 microversion: 2.1 time: 0.154846 Sep 24 21:48:29.659538 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3366/6755] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:48:29 2022] GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:48:30.681926 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d9a00083-f483-4650-8108-717871d0b3c1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:48:30.682574 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d9a00083-f483-4650-8108-717871d0b3c1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: bbf83ddb-7807-4dd2-a0fe-00c317265af0] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:48:30.689877 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d9a00083-f483-4650-8108-717871d0b3c1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:30.690604 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d9a00083-f483-4650-8108-717871d0b3c1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:30.691089 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d9a00083-f483-4650-8108-717871d0b3c1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:30.691805 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d9a00083-f483-4650-8108-717871d0b3c1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:30.692268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d9a00083-f483-4650-8108-717871d0b3c1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:30.692705 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d9a00083-f483-4650-8108-717871d0b3c1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:30.857408 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d9a00083-f483-4650-8108-717871d0b3c1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:48:30.866084 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d9a00083-f483-4650-8108-717871d0b3c1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0" status: 200 len: 1358 microversion: 2.1 time: 0.188122 Sep 24 21:48:30.866691 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3390/6756] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:48:30 2022] GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:48:31.464100 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-01adc553-380e-4b08-bc59-9f7ed03e1fd9 req-bffda197-0510-40e9-a0a1-733595ae6afb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbf83ddb-7807-4dd2-a0fe-00c317265af0", "name": "network-vif-plugged", "status": "completed", "tag": "5decbd9b-64bc-456a-8901-2b416bf4c7d0"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:48:31.473785 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-01adc553-380e-4b08-bc59-9f7ed03e1fd9 req-bffda197-0510-40e9-a0a1-733595ae6afb service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:31.474271 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-01adc553-380e-4b08-bc59-9f7ed03e1fd9 req-bffda197-0510-40e9-a0a1-733595ae6afb service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:31.474750 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-01adc553-380e-4b08-bc59-9f7ed03e1fd9 req-bffda197-0510-40e9-a0a1-733595ae6afb service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:31.485758 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-01adc553-380e-4b08-bc59-9f7ed03e1fd9 req-bffda197-0510-40e9-a0a1-733595ae6afb service nova] Creating event network-vif-plugged:5decbd9b-64bc-456a-8901-2b416bf4c7d0 for instance bbf83ddb-7807-4dd2-a0fe-00c317265af0 on nch2-master-1 Sep 24 21:48:31.491144 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-01adc553-380e-4b08-bc59-9f7ed03e1fd9 req-bffda197-0510-40e9-a0a1-733595ae6afb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080142 Sep 24 21:48:31.491747 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3367/6757] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:48:31.889275 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0625050f-4342-4b04-8ac3-a718953ee4cc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:48:31.889907 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0625050f-4342-4b04-8ac3-a718953ee4cc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: bbf83ddb-7807-4dd2-a0fe-00c317265af0] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:48:31.896958 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0625050f-4342-4b04-8ac3-a718953ee4cc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:31.897459 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0625050f-4342-4b04-8ac3-a718953ee4cc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:31.897911 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0625050f-4342-4b04-8ac3-a718953ee4cc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:31.898653 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0625050f-4342-4b04-8ac3-a718953ee4cc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:31.899138 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0625050f-4342-4b04-8ac3-a718953ee4cc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:31.899567 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0625050f-4342-4b04-8ac3-a718953ee4cc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:32.030456 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0625050f-4342-4b04-8ac3-a718953ee4cc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:48:32.038367 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0625050f-4342-4b04-8ac3-a718953ee4cc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0" status: 200 len: 1358 microversion: 2.1 time: 0.153044 Sep 24 21:48:32.038977 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3391/6758] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:48:31 2022] GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:48:33.064592 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c8e91425-0d20-4381-b0e6-71e9281c39bb tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:48:33.065729 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c8e91425-0d20-4381-b0e6-71e9281c39bb tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: bbf83ddb-7807-4dd2-a0fe-00c317265af0] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:48:33.072139 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8e91425-0d20-4381-b0e6-71e9281c39bb tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:33.072622 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8e91425-0d20-4381-b0e6-71e9281c39bb tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:33.073079 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8e91425-0d20-4381-b0e6-71e9281c39bb tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:33.073785 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8e91425-0d20-4381-b0e6-71e9281c39bb tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:33.074250 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8e91425-0d20-4381-b0e6-71e9281c39bb tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:33.074717 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c8e91425-0d20-4381-b0e6-71e9281c39bb tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:33.211427 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c8e91425-0d20-4381-b0e6-71e9281c39bb tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:48:33.219336 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c8e91425-0d20-4381-b0e6-71e9281c39bb tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0" status: 200 len: 1547 microversion: 2.1 time: 0.160027 Sep 24 21:48:33.219925 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3368/6759] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:48:33 2022] GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0 => generated 1547 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:48:33.241892 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a1df4cf8-2ee1-4029-98ba-21d9d1e6b41b tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:48:33.242548 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a1df4cf8-2ee1-4029-98ba-21d9d1e6b41b tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: bbf83ddb-7807-4dd2-a0fe-00c317265af0] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:48:33.249437 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1df4cf8-2ee1-4029-98ba-21d9d1e6b41b tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:33.249929 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1df4cf8-2ee1-4029-98ba-21d9d1e6b41b tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:33.250379 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1df4cf8-2ee1-4029-98ba-21d9d1e6b41b tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:33.251129 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1df4cf8-2ee1-4029-98ba-21d9d1e6b41b tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:33.251598 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1df4cf8-2ee1-4029-98ba-21d9d1e6b41b tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:33.252037 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1df4cf8-2ee1-4029-98ba-21d9d1e6b41b tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:33.385682 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a1df4cf8-2ee1-4029-98ba-21d9d1e6b41b tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:48:33.394534 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a1df4cf8-2ee1-4029-98ba-21d9d1e6b41b tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0" status: 200 len: 1547 microversion: 2.1 time: 0.156612 Sep 24 21:48:33.395123 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3392/6760] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:48:33 2022] GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0 => generated 1547 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:48:33.416686 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7b343e84-9638-4370-8a79-efc23ea1dfa7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:48:33.421664 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7b343e84-9638-4370-8a79-efc23ea1dfa7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:48:33.422427 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7b343e84-9638-4370-8a79-efc23ea1dfa7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Searching by: {'deleted': False, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2'} {{(pid=140516) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 21:48:33.428656 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b343e84-9638-4370-8a79-efc23ea1dfa7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:33.429134 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b343e84-9638-4370-8a79-efc23ea1dfa7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:33.429578 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b343e84-9638-4370-8a79-efc23ea1dfa7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:33.430380 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b343e84-9638-4370-8a79-efc23ea1dfa7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:33.430868 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b343e84-9638-4370-8a79-efc23ea1dfa7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:33.431295 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b343e84-9638-4370-8a79-efc23ea1dfa7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:33.455438 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.multi_cell_list [None req-7b343e84-9638-4370-8a79-efc23ea1dfa7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 21:48:33.481935 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7b343e84-9638-4370-8a79-efc23ea1dfa7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.069183 Sep 24 21:48:33.482529 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3369/6761] 10.222.0.52 () {58 vars in 1125 bytes} [Sat Sep 24 21:48:33 2022] GET /compute/v2.1/servers => generated 343 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:48:33.494857 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8c98ecef-a90b-43c4-a292-96d847eea1fd tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:48:33.495491 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8c98ecef-a90b-43c4-a292-96d847eea1fd tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: bbf83ddb-7807-4dd2-a0fe-00c317265af0] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:48:33.501573 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8c98ecef-a90b-43c4-a292-96d847eea1fd tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:33.502065 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8c98ecef-a90b-43c4-a292-96d847eea1fd tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:33.502719 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8c98ecef-a90b-43c4-a292-96d847eea1fd tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:33.503443 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8c98ecef-a90b-43c4-a292-96d847eea1fd tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:33.503915 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8c98ecef-a90b-43c4-a292-96d847eea1fd tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:33.504358 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8c98ecef-a90b-43c4-a292-96d847eea1fd tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:33.632845 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8c98ecef-a90b-43c4-a292-96d847eea1fd tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:48:33.642528 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8c98ecef-a90b-43c4-a292-96d847eea1fd tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0" status: 200 len: 1547 microversion: 2.1 time: 0.151535 Sep 24 21:48:33.644034 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3393/6762] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:48:33 2022] GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0 => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:48:35.163320 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-12559f6a-2b02-4230-9212-58ed4f9cdfbc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:48:35.163831 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-12559f6a-2b02-4230-9212-58ed4f9cdfbc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: bbf83ddb-7807-4dd2-a0fe-00c317265af0] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:48:35.170779 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-12559f6a-2b02-4230-9212-58ed4f9cdfbc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:35.171267 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-12559f6a-2b02-4230-9212-58ed4f9cdfbc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:35.171712 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-12559f6a-2b02-4230-9212-58ed4f9cdfbc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:35.172414 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-12559f6a-2b02-4230-9212-58ed4f9cdfbc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:35.172873 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-12559f6a-2b02-4230-9212-58ed4f9cdfbc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:35.173307 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-12559f6a-2b02-4230-9212-58ed4f9cdfbc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:35.199259 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-12559f6a-2b02-4230-9212-58ed4f9cdfbc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: bbf83ddb-7807-4dd2-a0fe-00c317265af0] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:48:35.273189 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-12559f6a-2b02-4230-9212-58ed4f9cdfbc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0" status: 204 len: 0 microversion: 2.1 time: 0.113955 Sep 24 21:48:35.273734 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3370/6763] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:48:35 2022] DELETE /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:48:35.282719 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2d05482b-1ae4-4609-9563-a8a6f3582d20 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:48:35.283344 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2d05482b-1ae4-4609-9563-a8a6f3582d20 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: bbf83ddb-7807-4dd2-a0fe-00c317265af0] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:48:35.290922 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d05482b-1ae4-4609-9563-a8a6f3582d20 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:35.291403 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d05482b-1ae4-4609-9563-a8a6f3582d20 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:35.291856 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d05482b-1ae4-4609-9563-a8a6f3582d20 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:35.292569 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d05482b-1ae4-4609-9563-a8a6f3582d20 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:35.293026 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d05482b-1ae4-4609-9563-a8a6f3582d20 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:35.293458 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d05482b-1ae4-4609-9563-a8a6f3582d20 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:35.433287 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2d05482b-1ae4-4609-9563-a8a6f3582d20 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:48:35.441334 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2d05482b-1ae4-4609-9563-a8a6f3582d20 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0" status: 200 len: 1553 microversion: 2.1 time: 0.162459 Sep 24 21:48:35.441926 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3394/6764] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:48:35 2022] GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:48:36.464722 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b3029892-a8c5-4613-87ca-cacd0eb6c87f tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:48:36.465433 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b3029892-a8c5-4613-87ca-cacd0eb6c87f tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: bbf83ddb-7807-4dd2-a0fe-00c317265af0] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:48:36.473125 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b3029892-a8c5-4613-87ca-cacd0eb6c87f tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:36.473636 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b3029892-a8c5-4613-87ca-cacd0eb6c87f tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:36.474056 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b3029892-a8c5-4613-87ca-cacd0eb6c87f tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:36.474789 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b3029892-a8c5-4613-87ca-cacd0eb6c87f tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:36.475250 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b3029892-a8c5-4613-87ca-cacd0eb6c87f tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:36.475682 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b3029892-a8c5-4613-87ca-cacd0eb6c87f tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:36.605188 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b3029892-a8c5-4613-87ca-cacd0eb6c87f tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:48:36.613278 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b3029892-a8c5-4613-87ca-cacd0eb6c87f tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0" status: 200 len: 1553 microversion: 2.1 time: 0.152690 Sep 24 21:48:36.613851 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3371/6765] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:48:36 2022] GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:48:37.136614 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-9258810e-b1f2-46c7-9ebc-05c302c28e4e req-1d3e05a6-0dd9-43b4-b219-12b977323522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbf83ddb-7807-4dd2-a0fe-00c317265af0", "name": "network-vif-deleted", "tag": "5decbd9b-64bc-456a-8901-2b416bf4c7d0"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:48:37.147832 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-9258810e-b1f2-46c7-9ebc-05c302c28e4e req-1d3e05a6-0dd9-43b4-b219-12b977323522 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:37.148331 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-9258810e-b1f2-46c7-9ebc-05c302c28e4e req-1d3e05a6-0dd9-43b4-b219-12b977323522 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:37.148774 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-9258810e-b1f2-46c7-9ebc-05c302c28e4e req-1d3e05a6-0dd9-43b4-b219-12b977323522 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:37.160885 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-9258810e-b1f2-46c7-9ebc-05c302c28e4e req-1d3e05a6-0dd9-43b4-b219-12b977323522 service nova] Creating event network-vif-deleted:5decbd9b-64bc-456a-8901-2b416bf4c7d0 for instance bbf83ddb-7807-4dd2-a0fe-00c317265af0 on nch2-master-1 Sep 24 21:48:37.166393 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-9258810e-b1f2-46c7-9ebc-05c302c28e4e req-1d3e05a6-0dd9-43b4-b219-12b977323522 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033492 Sep 24 21:48:37.167050 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3395/6766] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:48:37.640883 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-09b0b3b1-52b7-4d38-8b9e-81087b111d11 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:48:37.641506 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-09b0b3b1-52b7-4d38-8b9e-81087b111d11 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: bbf83ddb-7807-4dd2-a0fe-00c317265af0] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:48:37.649979 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-09b0b3b1-52b7-4d38-8b9e-81087b111d11 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:37.650467 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-09b0b3b1-52b7-4d38-8b9e-81087b111d11 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:37.650930 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-09b0b3b1-52b7-4d38-8b9e-81087b111d11 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:37.651637 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-09b0b3b1-52b7-4d38-8b9e-81087b111d11 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:37.652090 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-09b0b3b1-52b7-4d38-8b9e-81087b111d11 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:37.652515 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-09b0b3b1-52b7-4d38-8b9e-81087b111d11 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:37.687304 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-09b0b3b1-52b7-4d38-8b9e-81087b111d11 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:37.687801 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-09b0b3b1-52b7-4d38-8b9e-81087b111d11 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:37.688312 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-09b0b3b1-52b7-4d38-8b9e-81087b111d11 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:37.688957 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-09b0b3b1-52b7-4d38-8b9e-81087b111d11 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lazy-loading 'fault' on Instance uuid bbf83ddb-7807-4dd2-a0fe-00c317265af0 {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:48:37.731305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-09b0b3b1-52b7-4d38-8b9e-81087b111d11 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:48:37.740168 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-09b0b3b1-52b7-4d38-8b9e-81087b111d11 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0" status: 200 len: 1348 microversion: 2.1 time: 0.104473 Sep 24 21:48:37.740754 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3372/6767] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:48:37 2022] GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0 => generated 1348 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:48:38.764770 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c87db3cf-253d-415c-92c8-9c0b1e129bdd tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:48:38.765505 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c87db3cf-253d-415c-92c8-9c0b1e129bdd tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: bbf83ddb-7807-4dd2-a0fe-00c317265af0] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:48:38.771850 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c87db3cf-253d-415c-92c8-9c0b1e129bdd tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:38.772344 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c87db3cf-253d-415c-92c8-9c0b1e129bdd tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:38.772792 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c87db3cf-253d-415c-92c8-9c0b1e129bdd tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:38.773506 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c87db3cf-253d-415c-92c8-9c0b1e129bdd tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:38.773974 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c87db3cf-253d-415c-92c8-9c0b1e129bdd tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:38.774416 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c87db3cf-253d-415c-92c8-9c0b1e129bdd tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:38.788182 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-c87db3cf-253d-415c-92c8-9c0b1e129bdd tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] HTTP exception thrown: Instance bbf83ddb-7807-4dd2-a0fe-00c317265af0 could not be found. Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c87db3cf-253d-415c-92c8-9c0b1e129bdd tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Request method failure captured: Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0 HTTP/1.1 Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3sR3ikkV2FpxJxq2nxyH110yOQTbjg0O8MQojxQF0LPiP2Lzc_lcA_K3YxQ188ZB4-L1Yms40bNkFevO0lCTqYRjaKTrFntxL2xfR6xXodPdPhUdHEOnQOmw8T0sS1mUW5FRLxN2r2G-hcTv6WKadoC_8HS-5-ubwiTVCk6cgQ4Ebw Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: ef4f79cc25ee473bb029c30cbf0da4a2 Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-TestMinimumBasicScenario-1066335558 Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ef4f79cc25ee473bb029c30cbf0da4a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ef4f79cc25ee473bb029c30cbf0da4a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ef4f79cc25ee473bb029c30cbf0da4a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ef4f79cc25ee473bb029c30cbf0da4a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-TestMinimumBasicScenario-1066335558 Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: ef4f79cc25ee473bb029c30cbf0da4a2 Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1066335558 Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-TestMinimumBasicScenario-1066335558-project Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: d6fb8f277c5047c7860690a102ef7c41 Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-TestMinimumBasicScenario-1066335558-project Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance bbf83ddb-7807-4dd2-a0fe-00c317265af0 could not be found. Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'bbf83ddb-7807-4dd2-a0fe-00c317265af0'} Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbf83ddb-7807-4dd2-a0fe-00c317265af0 could not be found. Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbf83ddb-7807-4dd2-a0fe-00c317265af0 could not be found. Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:48:38.789840 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:48:38.794963 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:48:38.794963 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:48:38.794963 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:48:38.794963 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:48:38.794963 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:48:38.794963 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbf83ddb-7807-4dd2-a0fe-00c317265af0 could not be found. Sep 24 21:48:38.794963 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:48:38.794963 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c87db3cf-253d-415c-92c8-9c0b1e129bdd tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Returning 404 to user: Instance bbf83ddb-7807-4dd2-a0fe-00c317265af0 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:48:38.794963 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c87db3cf-253d-415c-92c8-9c0b1e129bdd tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0" status: 404 len: 111 microversion: 2.1 time: 0.031788 Sep 24 21:48:38.794963 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3396/6768] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:48:38 2022] GET /compute/v2.1/servers/bbf83ddb-7807-4dd2-a0fe-00c317265af0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 21:48:38.801371 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-eec74b4d-71f5-4261-bd9d-3ba823edf3ec tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '.version_select at 0x7f4b0c4135e0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:48:38.825886 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-eec74b4d-71f5-4261-bd9d-3ba823edf3ec tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-463962347" status: 202 len: 0 microversion: 2.1 time: 0.029495 Sep 24 21:48:38.826466 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3373/6769] 10.222.0.52 () {58 vars in 1269 bytes} [Sat Sep 24 21:48:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-463962347 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:48:47.909859 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-eef23146-bf0a-4b82-aaf3-8cf37b67c046 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Action: 'create', calling method: .version_select at 0x7f4b0c126790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-245168698", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBg32iXDGTK4ARlH9nJjb91/hL6srHZf4pC5+V2R+dLlO5P3EteZyQdeVc+zd0onVmV3PWD8FJrVDYUYkFIbrVT5vKkhbCHJSpLoUVe3w8+YF12FzlhFM4b18D0Pw6mybw=="}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:48:47.916384 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:48:47.929809 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-eef23146-bf0a-4b82-aaf3-8cf37b67c046 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Getting quotas for project ef4f79cc25ee473bb029c30cbf0da4a2. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:48:47.935788 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-eef23146-bf0a-4b82-aaf3-8cf37b67c046 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Getting quotas for user d6fb8f277c5047c7860690a102ef7c41 and project ef4f79cc25ee473bb029c30cbf0da4a2. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:48:47.959425 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-eef23146-bf0a-4b82-aaf3-8cf37b67c046 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.053994 Sep 24 21:48:47.960039 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3397/6770] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 21:48:47 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:48:48.008523 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:48:48.009445 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:48:48.013768 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-77adafed-95a8-4ad4-b35e-893c5ddf7d5c tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-166636006", "imageRef": "58221788-129e-4758-b3a7-0df7487d0c24", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-245168698", "networks": [{"uuid": "8b3c5a78-0857-4fc7-82a1-b73684aefeb3"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:48:48.023166 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:48:48.071906 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-77adafed-95a8-4ad4-b35e-893c5ddf7d5c tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] validate_networks() for [('8b3c5a78-0857-4fc7-82a1-b73684aefeb3', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:48:48.443434 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-77adafed-95a8-4ad4-b35e-893c5ddf7d5c tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:48:48.443860 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-77adafed-95a8-4ad4-b35e-893c5ddf7d5c tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:48:48.444335 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-77adafed-95a8-4ad4-b35e-893c5ddf7d5c tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:48:48.444747 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-77adafed-95a8-4ad4-b35e-893c5ddf7d5c tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:48:48.445160 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-77adafed-95a8-4ad4-b35e-893c5ddf7d5c tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:48:48.453932 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-77adafed-95a8-4ad4-b35e-893c5ddf7d5c tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:48.454408 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-77adafed-95a8-4ad4-b35e-893c5ddf7d5c tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:48.455322 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-77adafed-95a8-4ad4-b35e-893c5ddf7d5c tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:48.456619 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-77adafed-95a8-4ad4-b35e-893c5ddf7d5c tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:48.457073 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-77adafed-95a8-4ad4-b35e-893c5ddf7d5c tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:48.457504 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-77adafed-95a8-4ad4-b35e-893c5ddf7d5c tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:48.476243 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-77adafed-95a8-4ad4-b35e-893c5ddf7d5c tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Getting quotas for project ef4f79cc25ee473bb029c30cbf0da4a2. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:48:48.481453 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-77adafed-95a8-4ad4-b35e-893c5ddf7d5c tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Getting quotas for user d6fb8f277c5047c7860690a102ef7c41 and project ef4f79cc25ee473bb029c30cbf0da4a2. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:48:48.493952 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-77adafed-95a8-4ad4-b35e-893c5ddf7d5c tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:48:48.496564 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-77adafed-95a8-4ad4-b35e-893c5ddf7d5c tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58221788-129e-4758-b3a7-0df7487d0c24',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:48:48.544147 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-77adafed-95a8-4ad4-b35e-893c5ddf7d5c tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.537195 Sep 24 21:48:48.545057 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3374/6771] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:48:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:48:48.556361 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b38401e3-3d49-4ebc-b4bd-eb8d2ff3e39d tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:48:48.556984 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b38401e3-3d49-4ebc-b4bd-eb8d2ff3e39d tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:48:48.611376 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b38401e3-3d49-4ebc-b4bd-eb8d2ff3e39d tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:48:48.618769 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b38401e3-3d49-4ebc-b4bd-eb8d2ff3e39d tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd" status: 200 len: 1257 microversion: 2.1 time: 0.066545 Sep 24 21:48:48.619450 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3398/6772] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:48:48 2022] GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd => generated 1257 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:48:49.643521 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2f5d31e1-9771-4745-b176-2d4da9c8c26b tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:48:49.644645 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2f5d31e1-9771-4745-b176-2d4da9c8c26b tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:48:49.655088 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f5d31e1-9771-4745-b176-2d4da9c8c26b tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:49.655937 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f5d31e1-9771-4745-b176-2d4da9c8c26b tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:49.656589 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f5d31e1-9771-4745-b176-2d4da9c8c26b tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:49.657547 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f5d31e1-9771-4745-b176-2d4da9c8c26b tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:49.658216 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f5d31e1-9771-4745-b176-2d4da9c8c26b tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:49.658888 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2f5d31e1-9771-4745-b176-2d4da9c8c26b tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:49.740159 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2f5d31e1-9771-4745-b176-2d4da9c8c26b tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:48:49.748628 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2f5d31e1-9771-4745-b176-2d4da9c8c26b tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd" status: 200 len: 1317 microversion: 2.1 time: 0.110540 Sep 24 21:48:49.749218 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3375/6773] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:48:49 2022] GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd => generated 1317 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:48:50.773296 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7ea1fab3-e7cb-48e3-86bc-527eeabd8b36 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:48:50.773933 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7ea1fab3-e7cb-48e3-86bc-527eeabd8b36 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:48:50.775946 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=64 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:48:50.783169 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7ea1fab3-e7cb-48e3-86bc-527eeabd8b36 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:50.783674 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7ea1fab3-e7cb-48e3-86bc-527eeabd8b36 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:50.784144 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7ea1fab3-e7cb-48e3-86bc-527eeabd8b36 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:50.785165 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7ea1fab3-e7cb-48e3-86bc-527eeabd8b36 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:50.785815 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7ea1fab3-e7cb-48e3-86bc-527eeabd8b36 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:50.786245 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7ea1fab3-e7cb-48e3-86bc-527eeabd8b36 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:50.926650 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7ea1fab3-e7cb-48e3-86bc-527eeabd8b36 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:48:50.934935 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7ea1fab3-e7cb-48e3-86bc-527eeabd8b36 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd" status: 200 len: 1357 microversion: 2.1 time: 0.166115 Sep 24 21:48:50.935530 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3399/6774] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:48:50 2022] GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:48:51.960275 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-adc65936-55af-468e-9ca4-1ca3c79a1211 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:48:51.960970 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-adc65936-55af-468e-9ca4-1ca3c79a1211 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:48:51.968337 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-adc65936-55af-468e-9ca4-1ca3c79a1211 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:51.968918 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-adc65936-55af-468e-9ca4-1ca3c79a1211 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:51.969695 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-adc65936-55af-468e-9ca4-1ca3c79a1211 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:51.971294 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-adc65936-55af-468e-9ca4-1ca3c79a1211 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:51.971294 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-adc65936-55af-468e-9ca4-1ca3c79a1211 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:51.972841 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-adc65936-55af-468e-9ca4-1ca3c79a1211 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:52.123563 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-adc65936-55af-468e-9ca4-1ca3c79a1211 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:48:52.131981 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-adc65936-55af-468e-9ca4-1ca3c79a1211 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd" status: 200 len: 1357 microversion: 2.1 time: 0.176495 Sep 24 21:48:52.132665 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3376/6775] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:48:51 2022] GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:48:53.155428 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-77361724-5242-447e-84af-c20c1e541c80 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:48:53.156071 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-77361724-5242-447e-84af-c20c1e541c80 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:48:53.163886 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77361724-5242-447e-84af-c20c1e541c80 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:53.164388 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77361724-5242-447e-84af-c20c1e541c80 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:53.164832 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77361724-5242-447e-84af-c20c1e541c80 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:53.165551 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77361724-5242-447e-84af-c20c1e541c80 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:53.166011 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77361724-5242-447e-84af-c20c1e541c80 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:53.166442 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77361724-5242-447e-84af-c20c1e541c80 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:53.312487 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-77361724-5242-447e-84af-c20c1e541c80 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:48:53.320846 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-77361724-5242-447e-84af-c20c1e541c80 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd" status: 200 len: 1357 microversion: 2.1 time: 0.169252 Sep 24 21:48:53.321615 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3400/6776] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:48:53 2022] GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:48:54.344814 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-27cce0c6-e0c0-4f64-ba67-1df62e2f2035 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:48:54.345484 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-27cce0c6-e0c0-4f64-ba67-1df62e2f2035 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:48:54.356524 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27cce0c6-e0c0-4f64-ba67-1df62e2f2035 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:54.357043 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27cce0c6-e0c0-4f64-ba67-1df62e2f2035 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:54.357534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27cce0c6-e0c0-4f64-ba67-1df62e2f2035 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:54.358226 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27cce0c6-e0c0-4f64-ba67-1df62e2f2035 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:54.358731 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27cce0c6-e0c0-4f64-ba67-1df62e2f2035 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:54.359177 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27cce0c6-e0c0-4f64-ba67-1df62e2f2035 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:54.514949 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-27cce0c6-e0c0-4f64-ba67-1df62e2f2035 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:48:54.523176 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-27cce0c6-e0c0-4f64-ba67-1df62e2f2035 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd" status: 200 len: 1357 microversion: 2.1 time: 0.182288 Sep 24 21:48:54.523774 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3377/6777] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:48:54 2022] GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:48:55.546770 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3b9141a4-88e7-4351-9203-84e460b61e2f tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:48:55.548107 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3b9141a4-88e7-4351-9203-84e460b61e2f tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:48:55.556086 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3b9141a4-88e7-4351-9203-84e460b61e2f tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:55.556600 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3b9141a4-88e7-4351-9203-84e460b61e2f tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:55.557057 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3b9141a4-88e7-4351-9203-84e460b61e2f tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:55.557786 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3b9141a4-88e7-4351-9203-84e460b61e2f tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:55.558263 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3b9141a4-88e7-4351-9203-84e460b61e2f tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:55.558734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3b9141a4-88e7-4351-9203-84e460b61e2f tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:55.716605 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3b9141a4-88e7-4351-9203-84e460b61e2f tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:48:55.724070 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3b9141a4-88e7-4351-9203-84e460b61e2f tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd" status: 200 len: 1357 microversion: 2.1 time: 0.181272 Sep 24 21:48:55.724676 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3401/6778] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:48:55 2022] GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:48:56.747756 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b96a0a69-d378-41df-9fa1-20e7990d5f45 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:48:56.748481 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b96a0a69-d378-41df-9fa1-20e7990d5f45 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:48:56.759071 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b96a0a69-d378-41df-9fa1-20e7990d5f45 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:56.759592 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b96a0a69-d378-41df-9fa1-20e7990d5f45 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:56.760045 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b96a0a69-d378-41df-9fa1-20e7990d5f45 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:56.760980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b96a0a69-d378-41df-9fa1-20e7990d5f45 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:56.761604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b96a0a69-d378-41df-9fa1-20e7990d5f45 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:56.762211 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b96a0a69-d378-41df-9fa1-20e7990d5f45 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:56.946572 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b96a0a69-d378-41df-9fa1-20e7990d5f45 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:48:56.954812 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b96a0a69-d378-41df-9fa1-20e7990d5f45 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd" status: 200 len: 1357 microversion: 2.1 time: 0.211096 Sep 24 21:48:56.955408 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3378/6779] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:48:56 2022] GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd => generated 1357 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:48:57.978877 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c977ad5b-74b9-440a-94a8-0b49ea15d660 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:48:57.979444 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c977ad5b-74b9-440a-94a8-0b49ea15d660 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:48:57.986524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c977ad5b-74b9-440a-94a8-0b49ea15d660 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:57.987685 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c977ad5b-74b9-440a-94a8-0b49ea15d660 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:57.988135 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c977ad5b-74b9-440a-94a8-0b49ea15d660 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:57.988839 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c977ad5b-74b9-440a-94a8-0b49ea15d660 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:57.989304 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c977ad5b-74b9-440a-94a8-0b49ea15d660 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:57.989740 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c977ad5b-74b9-440a-94a8-0b49ea15d660 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:58.120349 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c977ad5b-74b9-440a-94a8-0b49ea15d660 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:48:58.128120 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c977ad5b-74b9-440a-94a8-0b49ea15d660 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd" status: 200 len: 1357 microversion: 2.1 time: 0.153357 Sep 24 21:48:58.128700 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3402/6780] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:48:57 2022] GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:48:59.151035 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-40a9c695-adf7-46e2-94a4-c59465567bef tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:48:59.151664 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-40a9c695-adf7-46e2-94a4-c59465567bef tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:48:59.154398 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:48:59.155098 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:48:59.160859 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40a9c695-adf7-46e2-94a4-c59465567bef tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:59.161347 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40a9c695-adf7-46e2-94a4-c59465567bef tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:59.161794 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40a9c695-adf7-46e2-94a4-c59465567bef tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:59.162513 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40a9c695-adf7-46e2-94a4-c59465567bef tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:48:59.162979 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40a9c695-adf7-46e2-94a4-c59465567bef tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:48:59.163413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-40a9c695-adf7-46e2-94a4-c59465567bef tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:48:59.292117 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-40a9c695-adf7-46e2-94a4-c59465567bef tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:48:59.300285 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-40a9c695-adf7-46e2-94a4-c59465567bef tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd" status: 200 len: 1357 microversion: 2.1 time: 0.152921 Sep 24 21:48:59.301062 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3379/6781] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:48:59 2022] GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:49:00.323913 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d373448b-fce4-490a-a188-e22c1cfb3dfc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:49:00.324539 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d373448b-fce4-490a-a188-e22c1cfb3dfc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:49:00.326417 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=6 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:49:00.335767 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d373448b-fce4-490a-a188-e22c1cfb3dfc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:00.336257 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d373448b-fce4-490a-a188-e22c1cfb3dfc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:00.336700 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d373448b-fce4-490a-a188-e22c1cfb3dfc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:00.337401 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d373448b-fce4-490a-a188-e22c1cfb3dfc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:00.337860 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d373448b-fce4-490a-a188-e22c1cfb3dfc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:00.338322 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d373448b-fce4-490a-a188-e22c1cfb3dfc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:00.478717 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d373448b-fce4-490a-a188-e22c1cfb3dfc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:49:00.486507 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d373448b-fce4-490a-a188-e22c1cfb3dfc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd" status: 200 len: 1357 microversion: 2.1 time: 0.166546 Sep 24 21:49:00.487175 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3403/6782] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:49:00 2022] GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:49:01.325442 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-57c2431c-a1b6-4eb2-ac7e-ca94229e7f2a req-f277e869-998e-4cc0-bc3d-3f3b3f73c11e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd", "tag": "f62af75f-cd16-4b01-a133-09156ef50b62"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:49:01.337871 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-57c2431c-a1b6-4eb2-ac7e-ca94229e7f2a req-f277e869-998e-4cc0-bc3d-3f3b3f73c11e service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:01.338365 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-57c2431c-a1b6-4eb2-ac7e-ca94229e7f2a req-f277e869-998e-4cc0-bc3d-3f3b3f73c11e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:01.338858 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-57c2431c-a1b6-4eb2-ac7e-ca94229e7f2a req-f277e869-998e-4cc0-bc3d-3f3b3f73c11e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:01.353085 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-57c2431c-a1b6-4eb2-ac7e-ca94229e7f2a req-f277e869-998e-4cc0-bc3d-3f3b3f73c11e service nova] Creating event network-changed:f62af75f-cd16-4b01-a133-09156ef50b62 for instance d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd on nch1-master-1 Sep 24 21:49:01.358792 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-57c2431c-a1b6-4eb2-ac7e-ca94229e7f2a req-f277e869-998e-4cc0-bc3d-3f3b3f73c11e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037137 Sep 24 21:49:01.359726 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3380/6783] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:49:01.509998 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-90979083-bc01-466f-96f1-12d2113d8a3f tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:49:01.510679 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-90979083-bc01-466f-96f1-12d2113d8a3f tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:49:01.517627 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-90979083-bc01-466f-96f1-12d2113d8a3f tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:01.518756 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-90979083-bc01-466f-96f1-12d2113d8a3f tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:01.519186 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-90979083-bc01-466f-96f1-12d2113d8a3f tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:01.519923 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-90979083-bc01-466f-96f1-12d2113d8a3f tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:01.520393 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-90979083-bc01-466f-96f1-12d2113d8a3f tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:01.520831 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-90979083-bc01-466f-96f1-12d2113d8a3f tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:01.724511 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-90979083-bc01-466f-96f1-12d2113d8a3f tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:49:01.732279 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-90979083-bc01-466f-96f1-12d2113d8a3f tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd" status: 200 len: 1357 microversion: 2.1 time: 0.226250 Sep 24 21:49:01.732861 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3404/6784] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:49:01 2022] GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd => generated 1357 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:49:02.757892 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7fc69f01-566e-4175-93ad-ae2e7d44621c tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:49:02.758634 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7fc69f01-566e-4175-93ad-ae2e7d44621c tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:49:02.764891 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7fc69f01-566e-4175-93ad-ae2e7d44621c tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:02.765379 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7fc69f01-566e-4175-93ad-ae2e7d44621c tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:02.765822 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7fc69f01-566e-4175-93ad-ae2e7d44621c tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:02.766542 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7fc69f01-566e-4175-93ad-ae2e7d44621c tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:02.767008 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7fc69f01-566e-4175-93ad-ae2e7d44621c tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:02.767441 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7fc69f01-566e-4175-93ad-ae2e7d44621c tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:02.903320 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7fc69f01-566e-4175-93ad-ae2e7d44621c tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:49:02.912057 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7fc69f01-566e-4175-93ad-ae2e7d44621c tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd" status: 200 len: 1357 microversion: 2.1 time: 0.160303 Sep 24 21:49:02.912642 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3381/6785] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:49:02 2022] GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:49:03.935762 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f5f10a2f-461d-43ec-ad60-948a4474fd25 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:49:03.936384 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f5f10a2f-461d-43ec-ad60-948a4474fd25 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:49:03.944077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5f10a2f-461d-43ec-ad60-948a4474fd25 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:03.944520 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5f10a2f-461d-43ec-ad60-948a4474fd25 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:03.944961 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5f10a2f-461d-43ec-ad60-948a4474fd25 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:03.945670 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5f10a2f-461d-43ec-ad60-948a4474fd25 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:03.946127 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5f10a2f-461d-43ec-ad60-948a4474fd25 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:03.946587 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f5f10a2f-461d-43ec-ad60-948a4474fd25 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:04.144994 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f5f10a2f-461d-43ec-ad60-948a4474fd25 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:49:04.152851 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f5f10a2f-461d-43ec-ad60-948a4474fd25 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd" status: 200 len: 1357 microversion: 2.1 time: 0.220943 Sep 24 21:49:04.153441 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3405/6786] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:49:03 2022] GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd => generated 1357 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:49:05.176547 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2c534682-1687-44e4-9eb6-5fbece1cc3cc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:49:05.177168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2c534682-1687-44e4-9eb6-5fbece1cc3cc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:49:05.184359 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c534682-1687-44e4-9eb6-5fbece1cc3cc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:05.184853 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c534682-1687-44e4-9eb6-5fbece1cc3cc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:05.185296 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c534682-1687-44e4-9eb6-5fbece1cc3cc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:05.185998 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c534682-1687-44e4-9eb6-5fbece1cc3cc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:05.186461 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c534682-1687-44e4-9eb6-5fbece1cc3cc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:05.186918 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2c534682-1687-44e4-9eb6-5fbece1cc3cc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:05.323096 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2c534682-1687-44e4-9eb6-5fbece1cc3cc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:49:05.331418 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2c534682-1687-44e4-9eb6-5fbece1cc3cc tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd" status: 200 len: 1357 microversion: 2.1 time: 0.159473 Sep 24 21:49:05.332017 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3382/6787] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:49:05 2022] GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:49:06.354048 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-771c6c2f-905a-408b-a19f-0b2b6749cca7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:49:06.354698 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-771c6c2f-905a-408b-a19f-0b2b6749cca7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:49:06.362638 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-771c6c2f-905a-408b-a19f-0b2b6749cca7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:06.363227 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-771c6c2f-905a-408b-a19f-0b2b6749cca7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:06.363673 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-771c6c2f-905a-408b-a19f-0b2b6749cca7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:06.364384 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-771c6c2f-905a-408b-a19f-0b2b6749cca7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:06.364841 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-771c6c2f-905a-408b-a19f-0b2b6749cca7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:06.365275 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-771c6c2f-905a-408b-a19f-0b2b6749cca7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:06.502918 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-771c6c2f-905a-408b-a19f-0b2b6749cca7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:49:06.510848 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-771c6c2f-905a-408b-a19f-0b2b6749cca7 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd" status: 200 len: 1357 microversion: 2.1 time: 0.160645 Sep 24 21:49:06.511435 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3406/6788] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:49:06 2022] GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:49:07.533279 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1c7b8f10-597d-40e7-8078-df2d2b6ca1a4 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:49:07.533932 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1c7b8f10-597d-40e7-8078-df2d2b6ca1a4 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:49:07.540866 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c7b8f10-597d-40e7-8078-df2d2b6ca1a4 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:07.541360 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c7b8f10-597d-40e7-8078-df2d2b6ca1a4 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:07.541804 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c7b8f10-597d-40e7-8078-df2d2b6ca1a4 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:07.542519 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c7b8f10-597d-40e7-8078-df2d2b6ca1a4 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:07.542986 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c7b8f10-597d-40e7-8078-df2d2b6ca1a4 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:07.543421 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1c7b8f10-597d-40e7-8078-df2d2b6ca1a4 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:07.678479 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1c7b8f10-597d-40e7-8078-df2d2b6ca1a4 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:49:07.686227 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1c7b8f10-597d-40e7-8078-df2d2b6ca1a4 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd" status: 200 len: 1357 microversion: 2.1 time: 0.156934 Sep 24 21:49:07.686862 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3383/6789] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:49:07 2022] GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:49:08.395068 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-fd4f9716-9f50-44f3-b3ba-2c84f3ad77a0 req-554e49ac-3e55-43e9-a5af-9cae16fd4123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd", "name": "network-vif-plugged", "status": "completed", "tag": "f62af75f-cd16-4b01-a133-09156ef50b62"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:49:08.405566 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-fd4f9716-9f50-44f3-b3ba-2c84f3ad77a0 req-554e49ac-3e55-43e9-a5af-9cae16fd4123 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:08.406063 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-fd4f9716-9f50-44f3-b3ba-2c84f3ad77a0 req-554e49ac-3e55-43e9-a5af-9cae16fd4123 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:08.406518 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-fd4f9716-9f50-44f3-b3ba-2c84f3ad77a0 req-554e49ac-3e55-43e9-a5af-9cae16fd4123 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:08.418393 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-fd4f9716-9f50-44f3-b3ba-2c84f3ad77a0 req-554e49ac-3e55-43e9-a5af-9cae16fd4123 service nova] Creating event network-vif-plugged:f62af75f-cd16-4b01-a133-09156ef50b62 for instance d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd on nch1-master-1 Sep 24 21:49:08.423442 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-fd4f9716-9f50-44f3-b3ba-2c84f3ad77a0 req-554e49ac-3e55-43e9-a5af-9cae16fd4123 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032402 Sep 24 21:49:08.424912 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3407/6790] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:49:08.710118 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b773d311-c642-49c7-9226-a935ae2026cd tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:49:08.710800 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b773d311-c642-49c7-9226-a935ae2026cd tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:49:08.717884 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b773d311-c642-49c7-9226-a935ae2026cd tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:08.718375 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b773d311-c642-49c7-9226-a935ae2026cd tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:08.718845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b773d311-c642-49c7-9226-a935ae2026cd tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:08.719551 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b773d311-c642-49c7-9226-a935ae2026cd tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:08.720012 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b773d311-c642-49c7-9226-a935ae2026cd tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:08.720442 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b773d311-c642-49c7-9226-a935ae2026cd tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:08.925333 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b773d311-c642-49c7-9226-a935ae2026cd tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:49:08.933452 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b773d311-c642-49c7-9226-a935ae2026cd tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd" status: 200 len: 1357 microversion: 2.1 time: 0.228178 Sep 24 21:49:08.934034 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3384/6791] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:49:08 2022] GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd => generated 1357 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:49:09.959330 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ab8be62d-e0ee-4054-9985-cbbc9cd087b5 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:49:09.960054 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ab8be62d-e0ee-4054-9985-cbbc9cd087b5 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:49:09.966330 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ab8be62d-e0ee-4054-9985-cbbc9cd087b5 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:09.966861 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ab8be62d-e0ee-4054-9985-cbbc9cd087b5 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:09.967306 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ab8be62d-e0ee-4054-9985-cbbc9cd087b5 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:09.968010 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ab8be62d-e0ee-4054-9985-cbbc9cd087b5 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:09.968469 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ab8be62d-e0ee-4054-9985-cbbc9cd087b5 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:09.968896 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ab8be62d-e0ee-4054-9985-cbbc9cd087b5 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:10.102100 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ab8be62d-e0ee-4054-9985-cbbc9cd087b5 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:49:10.109899 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ab8be62d-e0ee-4054-9985-cbbc9cd087b5 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd" status: 200 len: 1357 microversion: 2.1 time: 0.156545 Sep 24 21:49:10.110527 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3408/6792] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:49:09 2022] GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:49:11.134312 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f12d8c99-419c-4144-866d-fd3eaf6642d1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:49:11.134957 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f12d8c99-419c-4144-866d-fd3eaf6642d1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:49:11.141925 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f12d8c99-419c-4144-866d-fd3eaf6642d1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:11.142410 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f12d8c99-419c-4144-866d-fd3eaf6642d1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:11.143857 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f12d8c99-419c-4144-866d-fd3eaf6642d1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:11.144600 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f12d8c99-419c-4144-866d-fd3eaf6642d1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:11.145059 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f12d8c99-419c-4144-866d-fd3eaf6642d1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:11.145487 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f12d8c99-419c-4144-866d-fd3eaf6642d1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:11.273511 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f12d8c99-419c-4144-866d-fd3eaf6642d1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:49:11.281881 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f12d8c99-419c-4144-866d-fd3eaf6642d1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd" status: 200 len: 1547 microversion: 2.1 time: 0.151451 Sep 24 21:49:11.282516 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3385/6793] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:49:11 2022] GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:49:11.305474 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4427510a-8de7-44dc-88a5-323b7316ba77 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:49:11.306128 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4427510a-8de7-44dc-88a5-323b7316ba77 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:49:11.313006 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4427510a-8de7-44dc-88a5-323b7316ba77 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:11.313497 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4427510a-8de7-44dc-88a5-323b7316ba77 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:11.313941 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4427510a-8de7-44dc-88a5-323b7316ba77 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:11.314701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4427510a-8de7-44dc-88a5-323b7316ba77 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:11.315172 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4427510a-8de7-44dc-88a5-323b7316ba77 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:11.315605 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4427510a-8de7-44dc-88a5-323b7316ba77 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:11.448758 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4427510a-8de7-44dc-88a5-323b7316ba77 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:49:11.456888 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4427510a-8de7-44dc-88a5-323b7316ba77 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd" status: 200 len: 1547 microversion: 2.1 time: 0.155628 Sep 24 21:49:11.457475 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3409/6794] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:49:11 2022] GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:49:11.479762 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c5d7ff5d-e470-48d0-972e-9037f7214e1b tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:49:11.484856 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c5d7ff5d-e470-48d0-972e-9037f7214e1b tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:49:11.485634 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c5d7ff5d-e470-48d0-972e-9037f7214e1b tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Searching by: {'deleted': False, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2'} {{(pid=140516) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 21:49:11.491764 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5d7ff5d-e470-48d0-972e-9037f7214e1b tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:11.492253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5d7ff5d-e470-48d0-972e-9037f7214e1b tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:11.492702 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5d7ff5d-e470-48d0-972e-9037f7214e1b tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:11.493440 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5d7ff5d-e470-48d0-972e-9037f7214e1b tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:11.493904 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5d7ff5d-e470-48d0-972e-9037f7214e1b tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:11.494341 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5d7ff5d-e470-48d0-972e-9037f7214e1b tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:11.521223 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.multi_cell_list [None req-c5d7ff5d-e470-48d0-972e-9037f7214e1b tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 21:49:11.548854 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c5d7ff5d-e470-48d0-972e-9037f7214e1b tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.073376 Sep 24 21:49:11.549438 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3386/6795] 10.222.0.52 () {58 vars in 1125 bytes} [Sat Sep 24 21:49:11 2022] GET /compute/v2.1/servers => generated 342 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:49:11.561343 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-60d8e39a-5a2a-44e9-98d9-766ffcd262a1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:49:11.561974 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-60d8e39a-5a2a-44e9-98d9-766ffcd262a1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:49:11.568838 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-60d8e39a-5a2a-44e9-98d9-766ffcd262a1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:11.569330 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-60d8e39a-5a2a-44e9-98d9-766ffcd262a1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:11.569778 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-60d8e39a-5a2a-44e9-98d9-766ffcd262a1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:11.570486 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-60d8e39a-5a2a-44e9-98d9-766ffcd262a1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:11.570983 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-60d8e39a-5a2a-44e9-98d9-766ffcd262a1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:11.571422 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-60d8e39a-5a2a-44e9-98d9-766ffcd262a1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:11.703558 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-60d8e39a-5a2a-44e9-98d9-766ffcd262a1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:49:11.712116 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-60d8e39a-5a2a-44e9-98d9-766ffcd262a1 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd" status: 200 len: 1547 microversion: 2.1 time: 0.154637 Sep 24 21:49:11.712696 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3410/6796] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:49:11 2022] GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:49:13.186045 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-09252109-3e97-402c-b69a-073f534f5383 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:49:13.186657 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-09252109-3e97-402c-b69a-073f534f5383 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:49:13.193598 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-09252109-3e97-402c-b69a-073f534f5383 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:13.194082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-09252109-3e97-402c-b69a-073f534f5383 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:13.194538 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-09252109-3e97-402c-b69a-073f534f5383 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:13.195239 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-09252109-3e97-402c-b69a-073f534f5383 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:13.195694 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-09252109-3e97-402c-b69a-073f534f5383 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:13.196121 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-09252109-3e97-402c-b69a-073f534f5383 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:13.222169 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-09252109-3e97-402c-b69a-073f534f5383 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:49:13.303635 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-09252109-3e97-402c-b69a-073f534f5383 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd" status: 204 len: 0 microversion: 2.1 time: 0.121047 Sep 24 21:49:13.304506 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3387/6797] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:49:13 2022] DELETE /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:49:13.312804 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b0ece156-316f-4fdc-9d55-d8ef65c02c87 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:49:13.313465 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b0ece156-316f-4fdc-9d55-d8ef65c02c87 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:49:13.321032 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b0ece156-316f-4fdc-9d55-d8ef65c02c87 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:13.321527 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b0ece156-316f-4fdc-9d55-d8ef65c02c87 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:13.321977 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b0ece156-316f-4fdc-9d55-d8ef65c02c87 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:13.322720 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b0ece156-316f-4fdc-9d55-d8ef65c02c87 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:13.323186 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b0ece156-316f-4fdc-9d55-d8ef65c02c87 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:13.323650 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b0ece156-316f-4fdc-9d55-d8ef65c02c87 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:13.457294 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b0ece156-316f-4fdc-9d55-d8ef65c02c87 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:49:13.465378 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b0ece156-316f-4fdc-9d55-d8ef65c02c87 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd" status: 200 len: 1553 microversion: 2.1 time: 0.156507 Sep 24 21:49:13.465969 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3411/6798] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:49:13 2022] GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:49:14.490536 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bcd44375-8bec-4001-945e-21908de42252 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:49:14.491250 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-bcd44375-8bec-4001-945e-21908de42252 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:49:14.498602 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bcd44375-8bec-4001-945e-21908de42252 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:14.499093 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bcd44375-8bec-4001-945e-21908de42252 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:14.499539 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bcd44375-8bec-4001-945e-21908de42252 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:14.500251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bcd44375-8bec-4001-945e-21908de42252 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:14.500712 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bcd44375-8bec-4001-945e-21908de42252 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:14.501155 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bcd44375-8bec-4001-945e-21908de42252 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:14.632461 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-bcd44375-8bec-4001-945e-21908de42252 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:49:14.640505 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bcd44375-8bec-4001-945e-21908de42252 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd" status: 200 len: 1553 microversion: 2.1 time: 0.154944 Sep 24 21:49:14.641085 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3388/6799] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:49:14 2022] GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:49:15.182598 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-b24a5312-9cbd-4b6a-b8e4-0bee84ea15c2 req-a92660af-1e03-4b17-a438-0eb6b5dcbf35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd", "name": "network-vif-deleted", "tag": "f62af75f-cd16-4b01-a133-09156ef50b62"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:49:15.193479 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-b24a5312-9cbd-4b6a-b8e4-0bee84ea15c2 req-a92660af-1e03-4b17-a438-0eb6b5dcbf35 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:15.193971 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-b24a5312-9cbd-4b6a-b8e4-0bee84ea15c2 req-a92660af-1e03-4b17-a438-0eb6b5dcbf35 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:15.194424 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-b24a5312-9cbd-4b6a-b8e4-0bee84ea15c2 req-a92660af-1e03-4b17-a438-0eb6b5dcbf35 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:15.206951 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-b24a5312-9cbd-4b6a-b8e4-0bee84ea15c2 req-a92660af-1e03-4b17-a438-0eb6b5dcbf35 service nova] Creating event network-vif-deleted:f62af75f-cd16-4b01-a133-09156ef50b62 for instance d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd on nch1-master-1 Sep 24 21:49:15.212562 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-b24a5312-9cbd-4b6a-b8e4-0bee84ea15c2 req-a92660af-1e03-4b17-a438-0eb6b5dcbf35 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033595 Sep 24 21:49:15.213405 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3412/6800] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:49:15.665135 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-979cd588-1a7e-4bd6-8ace-e29a17b3cb31 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:49:15.665818 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-979cd588-1a7e-4bd6-8ace-e29a17b3cb31 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:49:15.672856 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-979cd588-1a7e-4bd6-8ace-e29a17b3cb31 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:15.673380 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-979cd588-1a7e-4bd6-8ace-e29a17b3cb31 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:15.674521 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-979cd588-1a7e-4bd6-8ace-e29a17b3cb31 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:15.675507 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-979cd588-1a7e-4bd6-8ace-e29a17b3cb31 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:15.676019 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-979cd588-1a7e-4bd6-8ace-e29a17b3cb31 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:15.676431 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-979cd588-1a7e-4bd6-8ace-e29a17b3cb31 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:15.710099 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-979cd588-1a7e-4bd6-8ace-e29a17b3cb31 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:15.710633 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-979cd588-1a7e-4bd6-8ace-e29a17b3cb31 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:15.711155 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-979cd588-1a7e-4bd6-8ace-e29a17b3cb31 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:15.711637 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-979cd588-1a7e-4bd6-8ace-e29a17b3cb31 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lazy-loading 'fault' on Instance uuid d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:49:15.714582 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:49:15.755275 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-979cd588-1a7e-4bd6-8ace-e29a17b3cb31 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fb8f277c5047c7860690a102ef7c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4f79cc25ee473bb029c30cbf0da4a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:49:15.762396 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-979cd588-1a7e-4bd6-8ace-e29a17b3cb31 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd" status: 200 len: 1347 microversion: 2.1 time: 0.101326 Sep 24 21:49:15.763008 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3389/6801] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:49:15 2022] GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd => generated 1347 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:49:16.787842 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4057c703-e239-46ea-ae7f-93b62b74dde6 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:49:16.788554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4057c703-e239-46ea-ae7f-93b62b74dde6 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] [instance: d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:49:16.794747 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4057c703-e239-46ea-ae7f-93b62b74dde6 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:16.795233 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4057c703-e239-46ea-ae7f-93b62b74dde6 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:16.795705 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4057c703-e239-46ea-ae7f-93b62b74dde6 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:16.796403 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4057c703-e239-46ea-ae7f-93b62b74dde6 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:16.796960 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4057c703-e239-46ea-ae7f-93b62b74dde6 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:16.797397 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4057c703-e239-46ea-ae7f-93b62b74dde6 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:16.812077 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-4057c703-e239-46ea-ae7f-93b62b74dde6 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] HTTP exception thrown: Instance d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd could not be found. Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4057c703-e239-46ea-ae7f-93b62b74dde6 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Request method failure captured: Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd HTTP/1.1 Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3sR3ikkV2FpxJxq2nxyH110yOQTbjg0O8MQojxQF0LPiP2Lzc_lcA_K3YxQ188ZB4-L1Yms40bNkFevO0lCTqYRjaKTrFntxL2xfR6xXodPdPhUdHEOnQOmw8T0sS1mUW5FRLxN2r2G-hcTv6WKadoC_8HS-5-ubwiTVCk6cgQ4Ebw Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: ef4f79cc25ee473bb029c30cbf0da4a2 Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-TestMinimumBasicScenario-1066335558 Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ef4f79cc25ee473bb029c30cbf0da4a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ef4f79cc25ee473bb029c30cbf0da4a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ef4f79cc25ee473bb029c30cbf0da4a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ef4f79cc25ee473bb029c30cbf0da4a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-TestMinimumBasicScenario-1066335558 Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: ef4f79cc25ee473bb029c30cbf0da4a2 Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1066335558 Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-TestMinimumBasicScenario-1066335558-project Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: d6fb8f277c5047c7860690a102ef7c41 Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-TestMinimumBasicScenario-1066335558-project Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd could not be found. Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'd1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd'} Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd could not be found. Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd could not be found. Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:49:16.813883 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:49:16.819536 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:49:16.819536 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:49:16.819536 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:49:16.819536 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:49:16.819536 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:49:16.819536 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd could not be found. Sep 24 21:49:16.819536 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:49:16.819536 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4057c703-e239-46ea-ae7f-93b62b74dde6 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Returning 404 to user: Instance d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:49:16.819536 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4057c703-e239-46ea-ae7f-93b62b74dde6 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd" status: 404 len: 111 microversion: 2.1 time: 0.033976 Sep 24 21:49:16.819536 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3413/6802] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:49:16 2022] GET /compute/v2.1/servers/d1d387ac-72bb-4a8f-8a0d-e9eab2d4b0fd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:49:16.825007 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-150061e9-7ea5-4896-9d68-f9caac66c626 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] Calling method '.version_select at 0x7f4b0c58cd30>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:49:16.845300 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-150061e9-7ea5-4896-9d68-f9caac66c626 tempest-TestMinimumBasicScenario-1066335558 tempest-TestMinimumBasicScenario-1066335558-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-245168698" status: 202 len: 0 microversion: 2.1 time: 0.024105 Sep 24 21:49:16.845897 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3390/6803] 10.222.0.52 () {58 vars in 1269 bytes} [Sat Sep 24 21:49:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-245168698 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:49:25.767619 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2449c2ec-a570-4837-9812-f530d0af131c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Action: 'create', calling method: .version_select at 0x7f4b0cf3eee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-241590354", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTjn/nkDToWPF59F04rD+d1cYWVdzy4ytQgd6mO9xoUihxUSI6iRbgNWMUbvu6k6hJIk984xrr6zVmJG7SztkUbLkN1lOWZx1/BnT3IuUKY9ulzEebK4Fl8F+LeVC3dzw=="}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:49:25.773121 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:49:25.789514 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-2449c2ec-a570-4837-9812-f530d0af131c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Getting quotas for project 22a8ea7438b641139afc6ea3c2dcba4c. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:49:25.794643 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-2449c2ec-a570-4837-9812-f530d0af131c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Getting quotas for user ce56b96d91fa42029081bd0e6eccb5e4 and project 22a8ea7438b641139afc6ea3c2dcba4c. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:49:25.818351 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2449c2ec-a570-4837-9812-f530d0af131c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.223931 Sep 24 21:49:25.819001 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3414/6804] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 21:49:25 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:49:31.529137 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:49:31.530181 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:49:31.530900 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:49:31.535008 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ee734f84-38ef-41b6-a33f-3bbd91c2430c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-947293870", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "2b55bcca-c921-4e19-9d9a-80777dc5475f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-241590354", "security_groups": [{"name": "tempest-secgroup-smoke-526470185"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:49:31.671289 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-ee734f84-38ef-41b6-a33f-3bbd91c2430c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] validate_networks() for [('2b55bcca-c921-4e19-9d9a-80777dc5475f', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:49:32.121382 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-ee734f84-38ef-41b6-a33f-3bbd91c2430c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:49:32.122235 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-ee734f84-38ef-41b6-a33f-3bbd91c2430c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:49:32.122882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-ee734f84-38ef-41b6-a33f-3bbd91c2430c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:49:32.124108 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-ee734f84-38ef-41b6-a33f-3bbd91c2430c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:49:32.124644 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-ee734f84-38ef-41b6-a33f-3bbd91c2430c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:49:32.142974 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee734f84-38ef-41b6-a33f-3bbd91c2430c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:32.144265 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee734f84-38ef-41b6-a33f-3bbd91c2430c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:32.144982 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee734f84-38ef-41b6-a33f-3bbd91c2430c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:32.145979 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee734f84-38ef-41b6-a33f-3bbd91c2430c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:32.146605 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee734f84-38ef-41b6-a33f-3bbd91c2430c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:32.147162 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee734f84-38ef-41b6-a33f-3bbd91c2430c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:32.167014 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-ee734f84-38ef-41b6-a33f-3bbd91c2430c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Getting quotas for project 22a8ea7438b641139afc6ea3c2dcba4c. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:49:32.172864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-ee734f84-38ef-41b6-a33f-3bbd91c2430c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Getting quotas for user ce56b96d91fa42029081bd0e6eccb5e4 and project 22a8ea7438b641139afc6ea3c2dcba4c. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:49:32.187401 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ee734f84-38ef-41b6-a33f-3bbd91c2430c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:49:32.190600 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ee734f84-38ef-41b6-a33f-3bbd91c2430c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: df5a1a98-7829-4a2c-82ca-8e424857547a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:49:32.252904 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ee734f84-38ef-41b6-a33f-3bbd91c2430c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.724945 Sep 24 21:49:32.253583 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3391/6805] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:49:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:49:32.263118 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=78 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:49:32.269287 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d4806e00-f887-4cee-afd3-9fe19ac177e7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:49:32.270919 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d4806e00-f887-4cee-afd3-9fe19ac177e7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: df5a1a98-7829-4a2c-82ca-8e424857547a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:49:32.354680 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d4806e00-f887-4cee-afd3-9fe19ac177e7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:49:32.365415 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d4806e00-f887-4cee-afd3-9fe19ac177e7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a" status: 200 len: 1265 microversion: 2.1 time: 0.104202 Sep 24 21:49:32.367240 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3415/6806] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:49:32 2022] GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a => generated 1265 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:49:33.390720 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ee2243b2-5957-46ea-a183-b0a523e86a53 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:49:33.391344 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ee2243b2-5957-46ea-a183-b0a523e86a53 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: df5a1a98-7829-4a2c-82ca-8e424857547a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:49:33.398952 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee2243b2-5957-46ea-a183-b0a523e86a53 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:33.399743 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee2243b2-5957-46ea-a183-b0a523e86a53 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:33.400418 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee2243b2-5957-46ea-a183-b0a523e86a53 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:33.401398 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee2243b2-5957-46ea-a183-b0a523e86a53 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:33.402320 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee2243b2-5957-46ea-a183-b0a523e86a53 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:33.403008 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ee2243b2-5957-46ea-a183-b0a523e86a53 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:33.848252 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ee2243b2-5957-46ea-a183-b0a523e86a53 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:49:33.859024 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ee2243b2-5957-46ea-a183-b0a523e86a53 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a" status: 200 len: 1317 microversion: 2.1 time: 0.473030 Sep 24 21:49:33.875983 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3392/6807] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:49:33 2022] GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a => generated 1317 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:49:34.885992 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-33d77e5c-0802-4988-80e4-9cc8ba59f278 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:49:34.886655 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-33d77e5c-0802-4988-80e4-9cc8ba59f278 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: df5a1a98-7829-4a2c-82ca-8e424857547a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:49:34.894550 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33d77e5c-0802-4988-80e4-9cc8ba59f278 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:34.895056 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33d77e5c-0802-4988-80e4-9cc8ba59f278 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:34.895974 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33d77e5c-0802-4988-80e4-9cc8ba59f278 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:34.896207 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33d77e5c-0802-4988-80e4-9cc8ba59f278 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:34.896671 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33d77e5c-0802-4988-80e4-9cc8ba59f278 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:34.897114 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-33d77e5c-0802-4988-80e4-9cc8ba59f278 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:35.112531 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-33d77e5c-0802-4988-80e4-9cc8ba59f278 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:49:35.120492 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-33d77e5c-0802-4988-80e4-9cc8ba59f278 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a" status: 200 len: 1390 microversion: 2.1 time: 0.239173 Sep 24 21:49:35.121169 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3416/6808] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:49:34 2022] GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a => generated 1390 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:49:35.431873 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-adab8cbf-0174-4804-b9cf-4cd23562d4cb req-8f55be85-6593-4cc2-99b3-bbc8a1d1311f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df5a1a98-7829-4a2c-82ca-8e424857547a", "tag": "c4357ed9-f06a-45ce-a9c3-10edd9aa2b58"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:49:35.448014 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-adab8cbf-0174-4804-b9cf-4cd23562d4cb req-8f55be85-6593-4cc2-99b3-bbc8a1d1311f service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:35.451552 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-adab8cbf-0174-4804-b9cf-4cd23562d4cb req-8f55be85-6593-4cc2-99b3-bbc8a1d1311f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:35.453873 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-adab8cbf-0174-4804-b9cf-4cd23562d4cb req-8f55be85-6593-4cc2-99b3-bbc8a1d1311f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:35.470979 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-adab8cbf-0174-4804-b9cf-4cd23562d4cb req-8f55be85-6593-4cc2-99b3-bbc8a1d1311f service nova] Creating event network-changed:c4357ed9-f06a-45ce-a9c3-10edd9aa2b58 for instance df5a1a98-7829-4a2c-82ca-8e424857547a on nch1-master-1 Sep 24 21:49:35.479125 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-adab8cbf-0174-4804-b9cf-4cd23562d4cb req-8f55be85-6593-4cc2-99b3-bbc8a1d1311f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063516 Sep 24 21:49:35.479763 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3393/6809] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:49:36.145319 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9b97147a-72e1-475e-91ff-d378b9c23239 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:49:36.145967 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9b97147a-72e1-475e-91ff-d378b9c23239 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: df5a1a98-7829-4a2c-82ca-8e424857547a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:49:36.153041 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9b97147a-72e1-475e-91ff-d378b9c23239 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:36.153531 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9b97147a-72e1-475e-91ff-d378b9c23239 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:36.153977 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9b97147a-72e1-475e-91ff-d378b9c23239 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:36.154722 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9b97147a-72e1-475e-91ff-d378b9c23239 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:36.155188 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9b97147a-72e1-475e-91ff-d378b9c23239 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:36.155628 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9b97147a-72e1-475e-91ff-d378b9c23239 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:36.288559 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9b97147a-72e1-475e-91ff-d378b9c23239 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:49:36.296281 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9b97147a-72e1-475e-91ff-d378b9c23239 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a" status: 200 len: 1390 microversion: 2.1 time: 0.154957 Sep 24 21:49:36.296852 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3417/6810] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:49:36 2022] GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:49:37.321420 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fc1f9679-ef58-4416-a690-e57882914ddf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:49:37.322070 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fc1f9679-ef58-4416-a690-e57882914ddf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: df5a1a98-7829-4a2c-82ca-8e424857547a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:49:37.328386 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fc1f9679-ef58-4416-a690-e57882914ddf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:37.328880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fc1f9679-ef58-4416-a690-e57882914ddf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:37.329453 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fc1f9679-ef58-4416-a690-e57882914ddf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:37.330162 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fc1f9679-ef58-4416-a690-e57882914ddf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:37.330668 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fc1f9679-ef58-4416-a690-e57882914ddf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:37.331107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fc1f9679-ef58-4416-a690-e57882914ddf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:37.462132 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-fc1f9679-ef58-4416-a690-e57882914ddf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:49:37.470482 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fc1f9679-ef58-4416-a690-e57882914ddf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a" status: 200 len: 1390 microversion: 2.1 time: 0.153797 Sep 24 21:49:37.471084 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3394/6811] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:49:37 2022] GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:49:38.493729 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3ffa77e1-ac02-4fc5-9b0f-8a96f6984b21 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:49:38.494357 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3ffa77e1-ac02-4fc5-9b0f-8a96f6984b21 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: df5a1a98-7829-4a2c-82ca-8e424857547a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:49:38.501510 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ffa77e1-ac02-4fc5-9b0f-8a96f6984b21 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:38.502009 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ffa77e1-ac02-4fc5-9b0f-8a96f6984b21 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:38.502468 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ffa77e1-ac02-4fc5-9b0f-8a96f6984b21 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:38.503203 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ffa77e1-ac02-4fc5-9b0f-8a96f6984b21 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:38.503677 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ffa77e1-ac02-4fc5-9b0f-8a96f6984b21 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:38.504115 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3ffa77e1-ac02-4fc5-9b0f-8a96f6984b21 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:38.639976 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3ffa77e1-ac02-4fc5-9b0f-8a96f6984b21 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:49:38.648883 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3ffa77e1-ac02-4fc5-9b0f-8a96f6984b21 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a" status: 200 len: 1390 microversion: 2.1 time: 0.159129 Sep 24 21:49:38.649459 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3418/6812] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:49:38 2022] GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:49:39.672247 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e3ff29d8-9f5f-46a7-8aa3-4ce882e08b29 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:49:39.673449 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e3ff29d8-9f5f-46a7-8aa3-4ce882e08b29 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: df5a1a98-7829-4a2c-82ca-8e424857547a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:49:39.680918 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e3ff29d8-9f5f-46a7-8aa3-4ce882e08b29 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:39.681409 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e3ff29d8-9f5f-46a7-8aa3-4ce882e08b29 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:39.681856 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e3ff29d8-9f5f-46a7-8aa3-4ce882e08b29 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:39.682584 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e3ff29d8-9f5f-46a7-8aa3-4ce882e08b29 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:39.683051 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e3ff29d8-9f5f-46a7-8aa3-4ce882e08b29 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:39.683485 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e3ff29d8-9f5f-46a7-8aa3-4ce882e08b29 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:39.819642 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e3ff29d8-9f5f-46a7-8aa3-4ce882e08b29 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:49:39.832974 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e3ff29d8-9f5f-46a7-8aa3-4ce882e08b29 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a" status: 200 len: 1390 microversion: 2.1 time: 0.164243 Sep 24 21:49:39.834144 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3395/6813] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:49:39 2022] GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:49:40.857353 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d73bac5b-756f-4c4c-9a9b-ab004b3a5a82 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:49:40.858341 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d73bac5b-756f-4c4c-9a9b-ab004b3a5a82 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: df5a1a98-7829-4a2c-82ca-8e424857547a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:49:40.866210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d73bac5b-756f-4c4c-9a9b-ab004b3a5a82 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:40.866868 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d73bac5b-756f-4c4c-9a9b-ab004b3a5a82 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:40.867344 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d73bac5b-756f-4c4c-9a9b-ab004b3a5a82 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:40.868062 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d73bac5b-756f-4c4c-9a9b-ab004b3a5a82 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:40.868527 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d73bac5b-756f-4c4c-9a9b-ab004b3a5a82 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:40.868964 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d73bac5b-756f-4c4c-9a9b-ab004b3a5a82 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:41.007765 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d73bac5b-756f-4c4c-9a9b-ab004b3a5a82 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:49:41.015557 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d73bac5b-756f-4c4c-9a9b-ab004b3a5a82 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a" status: 200 len: 1390 microversion: 2.1 time: 0.162145 Sep 24 21:49:41.016169 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3419/6814] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:49:40 2022] GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:49:42.041251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c3e2fe64-8c8f-4835-b27e-437ed9d0f176 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:49:42.042012 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c3e2fe64-8c8f-4835-b27e-437ed9d0f176 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: df5a1a98-7829-4a2c-82ca-8e424857547a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:49:42.051376 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3e2fe64-8c8f-4835-b27e-437ed9d0f176 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:42.051900 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3e2fe64-8c8f-4835-b27e-437ed9d0f176 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:42.052612 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3e2fe64-8c8f-4835-b27e-437ed9d0f176 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:42.053322 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3e2fe64-8c8f-4835-b27e-437ed9d0f176 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:42.053792 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3e2fe64-8c8f-4835-b27e-437ed9d0f176 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:42.054230 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c3e2fe64-8c8f-4835-b27e-437ed9d0f176 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:42.153342 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:49:42.181252 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:49:42.186655 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c3e2fe64-8c8f-4835-b27e-437ed9d0f176 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:49:42.194926 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c3e2fe64-8c8f-4835-b27e-437ed9d0f176 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a" status: 200 len: 1390 microversion: 2.1 time: 0.157570 Sep 24 21:49:42.195508 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3396/6815] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:49:42 2022] GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:49:42.525398 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-62440066-bd08-49e8-956e-ea6f348fb44f req-c0aa5f06-1d87-4638-83e9-5e6bf81a6570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df5a1a98-7829-4a2c-82ca-8e424857547a", "name": "network-vif-plugged", "status": "completed", "tag": "c4357ed9-f06a-45ce-a9c3-10edd9aa2b58"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:49:42.531800 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=6 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:49:42.538648 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-62440066-bd08-49e8-956e-ea6f348fb44f req-c0aa5f06-1d87-4638-83e9-5e6bf81a6570 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:42.539144 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-62440066-bd08-49e8-956e-ea6f348fb44f req-c0aa5f06-1d87-4638-83e9-5e6bf81a6570 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:42.539582 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-62440066-bd08-49e8-956e-ea6f348fb44f req-c0aa5f06-1d87-4638-83e9-5e6bf81a6570 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:42.551478 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-62440066-bd08-49e8-956e-ea6f348fb44f req-c0aa5f06-1d87-4638-83e9-5e6bf81a6570 service nova] Creating event network-vif-plugged:c4357ed9-f06a-45ce-a9c3-10edd9aa2b58 for instance df5a1a98-7829-4a2c-82ca-8e424857547a on nch1-master-1 Sep 24 21:49:42.557059 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-62440066-bd08-49e8-956e-ea6f348fb44f req-c0aa5f06-1d87-4638-83e9-5e6bf81a6570 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036108 Sep 24 21:49:42.557667 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3420/6816] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:49:43.217264 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b0b9d37b-d6b2-4179-a43b-85756e7bb658 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:49:43.217885 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b0b9d37b-d6b2-4179-a43b-85756e7bb658 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: df5a1a98-7829-4a2c-82ca-8e424857547a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:49:43.224584 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0b9d37b-d6b2-4179-a43b-85756e7bb658 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:43.225073 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0b9d37b-d6b2-4179-a43b-85756e7bb658 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:43.225534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0b9d37b-d6b2-4179-a43b-85756e7bb658 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:43.226222 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0b9d37b-d6b2-4179-a43b-85756e7bb658 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:43.226713 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0b9d37b-d6b2-4179-a43b-85756e7bb658 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:43.227150 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b0b9d37b-d6b2-4179-a43b-85756e7bb658 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:43.363080 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b0b9d37b-d6b2-4179-a43b-85756e7bb658 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:49:43.370839 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b0b9d37b-d6b2-4179-a43b-85756e7bb658 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a" status: 200 len: 1390 microversion: 2.1 time: 0.157496 Sep 24 21:49:43.371419 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3397/6817] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:49:43 2022] GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:49:44.403892 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3373f6a0-fd14-4eaa-abc9-7f736533c3ab tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:49:44.404601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3373f6a0-fd14-4eaa-abc9-7f736533c3ab tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: df5a1a98-7829-4a2c-82ca-8e424857547a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:49:44.412193 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3373f6a0-fd14-4eaa-abc9-7f736533c3ab tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:44.412821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3373f6a0-fd14-4eaa-abc9-7f736533c3ab tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:44.413326 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3373f6a0-fd14-4eaa-abc9-7f736533c3ab tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:44.414294 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3373f6a0-fd14-4eaa-abc9-7f736533c3ab tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:44.415008 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3373f6a0-fd14-4eaa-abc9-7f736533c3ab tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:44.415605 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3373f6a0-fd14-4eaa-abc9-7f736533c3ab tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:44.552596 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3373f6a0-fd14-4eaa-abc9-7f736533c3ab tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:49:44.560319 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3373f6a0-fd14-4eaa-abc9-7f736533c3ab tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a" status: 200 len: 1562 microversion: 2.1 time: 0.161538 Sep 24 21:49:44.560898 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3421/6818] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:49:44 2022] GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a => generated 1562 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:49:44.583468 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e081320d-788f-4832-9aeb-f6e081f33da9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:49:44.584094 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e081320d-788f-4832-9aeb-f6e081f33da9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: df5a1a98-7829-4a2c-82ca-8e424857547a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:49:44.593157 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e081320d-788f-4832-9aeb-f6e081f33da9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:44.593639 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e081320d-788f-4832-9aeb-f6e081f33da9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:44.594079 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e081320d-788f-4832-9aeb-f6e081f33da9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:44.595011 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e081320d-788f-4832-9aeb-f6e081f33da9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:44.595516 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e081320d-788f-4832-9aeb-f6e081f33da9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:44.595941 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e081320d-788f-4832-9aeb-f6e081f33da9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:44.732118 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e081320d-788f-4832-9aeb-f6e081f33da9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:49:44.740017 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e081320d-788f-4832-9aeb-f6e081f33da9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a" status: 200 len: 1562 microversion: 2.1 time: 0.160670 Sep 24 21:49:44.740590 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3398/6819] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:49:44 2022] GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a => generated 1562 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:49:46.599839 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-21062193-37a2-4873-bad3-098e542d9cbf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:49:46.601035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-21062193-37a2-4873-bad3-098e542d9cbf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: df5a1a98-7829-4a2c-82ca-8e424857547a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:49:46.606245 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-78b8083d-38f0-4b38-a945-3a560b77d138 req-714d8e8c-ed37-49b3-99e7-044e4af094e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df5a1a98-7829-4a2c-82ca-8e424857547a", "tag": "c4357ed9-f06a-45ce-a9c3-10edd9aa2b58"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:49:46.617178 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-78b8083d-38f0-4b38-a945-3a560b77d138 req-714d8e8c-ed37-49b3-99e7-044e4af094e1 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:46.617713 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-78b8083d-38f0-4b38-a945-3a560b77d138 req-714d8e8c-ed37-49b3-99e7-044e4af094e1 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:46.618162 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-78b8083d-38f0-4b38-a945-3a560b77d138 req-714d8e8c-ed37-49b3-99e7-044e4af094e1 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:46.623220 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-21062193-37a2-4873-bad3-098e542d9cbf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:46.623817 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-21062193-37a2-4873-bad3-098e542d9cbf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:46.624325 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-21062193-37a2-4873-bad3-098e542d9cbf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:46.625132 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-21062193-37a2-4873-bad3-098e542d9cbf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:49:46.626196 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-21062193-37a2-4873-bad3-098e542d9cbf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:49:46.626705 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-21062193-37a2-4873-bad3-098e542d9cbf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:49:46.638254 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-78b8083d-38f0-4b38-a945-3a560b77d138 req-714d8e8c-ed37-49b3-99e7-044e4af094e1 service nova] Creating event network-changed:c4357ed9-f06a-45ce-a9c3-10edd9aa2b58 for instance df5a1a98-7829-4a2c-82ca-8e424857547a on nch1-master-1 Sep 24 21:49:46.646774 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-78b8083d-38f0-4b38-a945-3a560b77d138 req-714d8e8c-ed37-49b3-99e7-044e4af094e1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042557 Sep 24 21:49:46.651722 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3399/6820] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:49:46.858816 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-21062193-37a2-4873-bad3-098e542d9cbf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:49:46.867481 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-21062193-37a2-4873-bad3-098e542d9cbf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a" status: 200 len: 1562 microversion: 2.1 time: 0.271905 Sep 24 21:49:46.868331 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3422/6821] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:49:46 2022] GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a => generated 1562 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:50:18.198866 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-08c69ef4-1d85-473e-949e-a31297b17f30 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:50:18.201182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-08c69ef4-1d85-473e-949e-a31297b17f30 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: df5a1a98-7829-4a2c-82ca-8e424857547a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:50:18.203577 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:50:18.204250 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=42 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:50:18.210406 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-08c69ef4-1d85-473e-949e-a31297b17f30 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:50:18.210927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-08c69ef4-1d85-473e-949e-a31297b17f30 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:50:18.211379 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-08c69ef4-1d85-473e-949e-a31297b17f30 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:50:18.212093 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-08c69ef4-1d85-473e-949e-a31297b17f30 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:50:18.212562 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-08c69ef4-1d85-473e-949e-a31297b17f30 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:50:18.213002 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-08c69ef4-1d85-473e-949e-a31297b17f30 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:50:18.266418 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-08c69ef4-1d85-473e-949e-a31297b17f30 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "POST /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a/action" status: 200 len: 24572 microversion: 2.1 time: 0.071950 Sep 24 21:50:18.267099 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3400/6822] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:50:18 2022] POST /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a/action => generated 24572 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:50:48.682832 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:50:48.683737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=38 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:50:48.688580 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7b924254-405e-4546-b2c3-49c763a977f7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:50:48.689130 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7b924254-405e-4546-b2c3-49c763a977f7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: df5a1a98-7829-4a2c-82ca-8e424857547a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:50:48.699268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b924254-405e-4546-b2c3-49c763a977f7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:50:48.699764 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b924254-405e-4546-b2c3-49c763a977f7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:50:48.700209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b924254-405e-4546-b2c3-49c763a977f7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:50:48.700918 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b924254-405e-4546-b2c3-49c763a977f7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:50:48.701382 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b924254-405e-4546-b2c3-49c763a977f7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:50:48.701816 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7b924254-405e-4546-b2c3-49c763a977f7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:50:48.772366 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7b924254-405e-4546-b2c3-49c763a977f7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "POST /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a/action" status: 202 len: 0 microversion: 2.1 time: 0.091370 Sep 24 21:50:48.773027 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3423/6823] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:50:48 2022] POST /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:50:48.783383 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ac93d0e3-6121-4e24-9e29-e091d196c38b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:50:48.784233 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ac93d0e3-6121-4e24-9e29-e091d196c38b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: df5a1a98-7829-4a2c-82ca-8e424857547a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:50:48.787648 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:50:48.788316 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=4 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:50:48.794410 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac93d0e3-6121-4e24-9e29-e091d196c38b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:50:48.794923 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac93d0e3-6121-4e24-9e29-e091d196c38b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:50:48.795361 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac93d0e3-6121-4e24-9e29-e091d196c38b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:50:48.796065 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac93d0e3-6121-4e24-9e29-e091d196c38b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:50:48.796565 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac93d0e3-6121-4e24-9e29-e091d196c38b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:50:48.797055 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ac93d0e3-6121-4e24-9e29-e091d196c38b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:50:48.941352 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ac93d0e3-6121-4e24-9e29-e091d196c38b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:50:48.950239 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ac93d0e3-6121-4e24-9e29-e091d196c38b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a" status: 200 len: 1685 microversion: 2.1 time: 0.171103 Sep 24 21:50:48.951129 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3401/6824] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:50:48 2022] GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a => generated 1685 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:50:49.978973 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3a05431e-9b35-4b54-9491-abf3de3624fa tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:50:49.979681 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3a05431e-9b35-4b54-9491-abf3de3624fa tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: df5a1a98-7829-4a2c-82ca-8e424857547a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:50:49.985863 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a05431e-9b35-4b54-9491-abf3de3624fa tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:50:49.986354 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a05431e-9b35-4b54-9491-abf3de3624fa tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:50:49.986826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a05431e-9b35-4b54-9491-abf3de3624fa tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:50:49.987527 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a05431e-9b35-4b54-9491-abf3de3624fa tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:50:49.987984 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a05431e-9b35-4b54-9491-abf3de3624fa tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:50:49.988413 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3a05431e-9b35-4b54-9491-abf3de3624fa tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:50:50.121148 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3a05431e-9b35-4b54-9491-abf3de3624fa tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:50:50.129324 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3a05431e-9b35-4b54-9491-abf3de3624fa tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a" status: 200 len: 1665 microversion: 2.1 time: 0.156137 Sep 24 21:50:50.129913 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3424/6825] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:50:49 2022] GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a => generated 1665 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:50:51.227345 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b7603750-11e9-4d23-982a-cd4ae99d4b0f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:50:51.229475 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b7603750-11e9-4d23-982a-cd4ae99d4b0f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: df5a1a98-7829-4a2c-82ca-8e424857547a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:50:51.240512 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7603750-11e9-4d23-982a-cd4ae99d4b0f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:50:51.240991 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7603750-11e9-4d23-982a-cd4ae99d4b0f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:50:51.241429 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7603750-11e9-4d23-982a-cd4ae99d4b0f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:50:51.242132 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7603750-11e9-4d23-982a-cd4ae99d4b0f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:50:51.242617 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7603750-11e9-4d23-982a-cd4ae99d4b0f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:50:51.243052 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7603750-11e9-4d23-982a-cd4ae99d4b0f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:50:51.292717 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b7603750-11e9-4d23-982a-cd4ae99d4b0f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "POST /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a/action" status: 200 len: 32648 microversion: 2.1 time: 0.069752 Sep 24 21:50:51.293411 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3402/6826] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:50:51 2022] POST /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a/action => generated 32648 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:50:51.306103 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9a4f3bb0-2520-45e1-9056-e7023d23daec tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:50:51.306702 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9a4f3bb0-2520-45e1-9056-e7023d23daec tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: df5a1a98-7829-4a2c-82ca-8e424857547a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:50:51.313632 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a4f3bb0-2520-45e1-9056-e7023d23daec tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:50:51.314130 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a4f3bb0-2520-45e1-9056-e7023d23daec tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:50:51.314622 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a4f3bb0-2520-45e1-9056-e7023d23daec tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:50:51.315333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a4f3bb0-2520-45e1-9056-e7023d23daec tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:50:51.315808 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a4f3bb0-2520-45e1-9056-e7023d23daec tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:50:51.316250 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a4f3bb0-2520-45e1-9056-e7023d23daec tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:50:51.381443 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9a4f3bb0-2520-45e1-9056-e7023d23daec tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "POST /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a/action" status: 202 len: 0 microversion: 2.1 time: 0.079960 Sep 24 21:50:51.382090 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3425/6827] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:50:51 2022] POST /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 21:50:51.391090 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-553ab8af-65ee-4591-b302-58badef1c794 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:50:51.391806 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-553ab8af-65ee-4591-b302-58badef1c794 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: df5a1a98-7829-4a2c-82ca-8e424857547a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:50:51.399043 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-553ab8af-65ee-4591-b302-58badef1c794 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:50:51.399543 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-553ab8af-65ee-4591-b302-58badef1c794 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:50:51.399975 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-553ab8af-65ee-4591-b302-58badef1c794 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:50:51.400680 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-553ab8af-65ee-4591-b302-58badef1c794 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:50:51.401210 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-553ab8af-65ee-4591-b302-58badef1c794 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:50:51.401671 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-553ab8af-65ee-4591-b302-58badef1c794 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:50:51.540126 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-553ab8af-65ee-4591-b302-58badef1c794 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:50:51.549625 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-553ab8af-65ee-4591-b302-58badef1c794 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a" status: 200 len: 1672 microversion: 2.1 time: 0.162749 Sep 24 21:50:51.550418 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3403/6828] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:50:51 2022] GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a => generated 1672 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:50:52.577557 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8341ae63-bbd7-42c8-8649-34d6dfe1651b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:50:52.578299 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8341ae63-bbd7-42c8-8649-34d6dfe1651b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: df5a1a98-7829-4a2c-82ca-8e424857547a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:50:52.585011 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8341ae63-bbd7-42c8-8649-34d6dfe1651b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:50:52.585508 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8341ae63-bbd7-42c8-8649-34d6dfe1651b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:50:52.585957 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8341ae63-bbd7-42c8-8649-34d6dfe1651b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:50:52.586773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8341ae63-bbd7-42c8-8649-34d6dfe1651b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:50:52.587251 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8341ae63-bbd7-42c8-8649-34d6dfe1651b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:50:52.587692 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8341ae63-bbd7-42c8-8649-34d6dfe1651b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:50:52.724914 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8341ae63-bbd7-42c8-8649-34d6dfe1651b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:50:52.732748 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8341ae63-bbd7-42c8-8649-34d6dfe1651b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a" status: 200 len: 1680 microversion: 2.1 time: 0.161172 Sep 24 21:50:52.733329 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3426/6829] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:50:52 2022] GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:50:52.831485 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-14994506-9388-4da4-a928-d19f3b4d265c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:50:52.833633 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-14994506-9388-4da4-a928-d19f3b4d265c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: df5a1a98-7829-4a2c-82ca-8e424857547a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:50:52.841462 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-14994506-9388-4da4-a928-d19f3b4d265c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:50:52.841949 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-14994506-9388-4da4-a928-d19f3b4d265c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:50:52.842387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-14994506-9388-4da4-a928-d19f3b4d265c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:50:52.843124 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-14994506-9388-4da4-a928-d19f3b4d265c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:50:52.843580 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-14994506-9388-4da4-a928-d19f3b4d265c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:50:52.844011 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-14994506-9388-4da4-a928-d19f3b4d265c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:50:52.894645 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-14994506-9388-4da4-a928-d19f3b4d265c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "POST /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a/action" status: 200 len: 37215 microversion: 2.1 time: 0.066972 Sep 24 21:50:52.895610 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3404/6830] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:50:52 2022] POST /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a/action => generated 37215 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:50:53.910448 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-66daff87-5fb0-49b3-87c9-1aba0cbc2299 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:50:53.912284 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-66daff87-5fb0-49b3-87c9-1aba0cbc2299 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: df5a1a98-7829-4a2c-82ca-8e424857547a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:50:53.920322 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66daff87-5fb0-49b3-87c9-1aba0cbc2299 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:50:53.921152 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66daff87-5fb0-49b3-87c9-1aba0cbc2299 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:50:53.921862 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66daff87-5fb0-49b3-87c9-1aba0cbc2299 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:50:53.922725 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66daff87-5fb0-49b3-87c9-1aba0cbc2299 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:50:53.923385 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66daff87-5fb0-49b3-87c9-1aba0cbc2299 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:50:53.924067 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-66daff87-5fb0-49b3-87c9-1aba0cbc2299 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:50:53.953911 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-66daff87-5fb0-49b3-87c9-1aba0cbc2299 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: df5a1a98-7829-4a2c-82ca-8e424857547a] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:50:54.013277 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-8ac4c652-12c2-476c-99fc-3424bd9cab23 req-cb22c950-db13-48e6-a6c0-ea9f658f5c20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df5a1a98-7829-4a2c-82ca-8e424857547a", "tag": "c4357ed9-f06a-45ce-a9c3-10edd9aa2b58"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:50:54.027132 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-8ac4c652-12c2-476c-99fc-3424bd9cab23 req-cb22c950-db13-48e6-a6c0-ea9f658f5c20 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:50:54.027630 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-8ac4c652-12c2-476c-99fc-3424bd9cab23 req-cb22c950-db13-48e6-a6c0-ea9f658f5c20 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:50:54.028079 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-8ac4c652-12c2-476c-99fc-3424bd9cab23 req-cb22c950-db13-48e6-a6c0-ea9f658f5c20 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:50:54.041649 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-8ac4c652-12c2-476c-99fc-3424bd9cab23 req-cb22c950-db13-48e6-a6c0-ea9f658f5c20 service nova] Creating event network-changed:c4357ed9-f06a-45ce-a9c3-10edd9aa2b58 for instance df5a1a98-7829-4a2c-82ca-8e424857547a on nch1-master-1 Sep 24 21:50:54.046165 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-66daff87-5fb0-49b3-87c9-1aba0cbc2299 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "DELETE /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a" status: 204 len: 0 microversion: 2.1 time: 0.140533 Sep 24 21:50:54.047393 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3427/6831] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:50:53 2022] DELETE /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:50:54.047550 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-8ac4c652-12c2-476c-99fc-3424bd9cab23 req-cb22c950-db13-48e6-a6c0-ea9f658f5c20 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096254 Sep 24 21:50:54.048141 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3405/6832] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:50:54.058292 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-eaf973b5-79a0-40c8-9dcf-601130c2aa4a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:50:54.059081 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-eaf973b5-79a0-40c8-9dcf-601130c2aa4a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: df5a1a98-7829-4a2c-82ca-8e424857547a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:50:54.065672 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eaf973b5-79a0-40c8-9dcf-601130c2aa4a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:50:54.066170 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eaf973b5-79a0-40c8-9dcf-601130c2aa4a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:50:54.066675 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eaf973b5-79a0-40c8-9dcf-601130c2aa4a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:50:54.068164 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eaf973b5-79a0-40c8-9dcf-601130c2aa4a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:50:54.068651 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eaf973b5-79a0-40c8-9dcf-601130c2aa4a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:50:54.069094 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eaf973b5-79a0-40c8-9dcf-601130c2aa4a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:50:54.206264 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-eaf973b5-79a0-40c8-9dcf-601130c2aa4a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:50:54.214612 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-eaf973b5-79a0-40c8-9dcf-601130c2aa4a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a" status: 200 len: 1686 microversion: 2.1 time: 0.161436 Sep 24 21:50:54.215222 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3428/6833] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:50:54 2022] GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a => generated 1686 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:50:55.240551 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5a7e4a2f-9334-408a-91ef-de44245c3f83 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:50:55.241162 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5a7e4a2f-9334-408a-91ef-de44245c3f83 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: df5a1a98-7829-4a2c-82ca-8e424857547a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:50:55.248452 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5a7e4a2f-9334-408a-91ef-de44245c3f83 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:50:55.248943 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5a7e4a2f-9334-408a-91ef-de44245c3f83 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:50:55.249378 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5a7e4a2f-9334-408a-91ef-de44245c3f83 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:50:55.250077 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5a7e4a2f-9334-408a-91ef-de44245c3f83 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:50:55.250554 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5a7e4a2f-9334-408a-91ef-de44245c3f83 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:50:55.250987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5a7e4a2f-9334-408a-91ef-de44245c3f83 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:50:55.480466 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5a7e4a2f-9334-408a-91ef-de44245c3f83 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:50:55.488356 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5a7e4a2f-9334-408a-91ef-de44245c3f83 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a" status: 200 len: 1686 microversion: 2.1 time: 0.252435 Sep 24 21:50:55.489455 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3406/6834] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:50:55 2022] GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a => generated 1686 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:50:56.423915 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-dfd21710-818e-40c2-968a-d2a3e1c310ad req-a32b37c1-0b1a-40f0-87f0-40697d8c94ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df5a1a98-7829-4a2c-82ca-8e424857547a", "name": "network-vif-deleted", "tag": "c4357ed9-f06a-45ce-a9c3-10edd9aa2b58"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:50:56.435466 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-dfd21710-818e-40c2-968a-d2a3e1c310ad req-a32b37c1-0b1a-40f0-87f0-40697d8c94ec service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:50:56.436004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-dfd21710-818e-40c2-968a-d2a3e1c310ad req-a32b37c1-0b1a-40f0-87f0-40697d8c94ec service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:50:56.436398 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-dfd21710-818e-40c2-968a-d2a3e1c310ad req-a32b37c1-0b1a-40f0-87f0-40697d8c94ec service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:50:56.448733 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-dfd21710-818e-40c2-968a-d2a3e1c310ad req-a32b37c1-0b1a-40f0-87f0-40697d8c94ec service nova] Creating event network-vif-deleted:c4357ed9-f06a-45ce-a9c3-10edd9aa2b58 for instance df5a1a98-7829-4a2c-82ca-8e424857547a on nch1-master-1 Sep 24 21:50:56.453714 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-dfd21710-818e-40c2-968a-d2a3e1c310ad req-a32b37c1-0b1a-40f0-87f0-40697d8c94ec service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033395 Sep 24 21:50:56.454336 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3429/6835] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:50:56.512303 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1bff24a6-ff43-4531-92ff-0b6d78506ce3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:50:56.512919 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1bff24a6-ff43-4531-92ff-0b6d78506ce3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: df5a1a98-7829-4a2c-82ca-8e424857547a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:50:56.519882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1bff24a6-ff43-4531-92ff-0b6d78506ce3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:50:56.521060 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1bff24a6-ff43-4531-92ff-0b6d78506ce3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:50:56.521841 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1bff24a6-ff43-4531-92ff-0b6d78506ce3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:50:56.522585 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1bff24a6-ff43-4531-92ff-0b6d78506ce3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:50:56.523050 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1bff24a6-ff43-4531-92ff-0b6d78506ce3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:50:56.525060 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1bff24a6-ff43-4531-92ff-0b6d78506ce3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:50:56.558132 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1bff24a6-ff43-4531-92ff-0b6d78506ce3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:50:56.558655 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1bff24a6-ff43-4531-92ff-0b6d78506ce3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:50:56.559100 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1bff24a6-ff43-4531-92ff-0b6d78506ce3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:50:56.559556 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-1bff24a6-ff43-4531-92ff-0b6d78506ce3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lazy-loading 'fault' on Instance uuid df5a1a98-7829-4a2c-82ca-8e424857547a {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:50:56.607174 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1bff24a6-ff43-4531-92ff-0b6d78506ce3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:50:56.615391 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1bff24a6-ff43-4531-92ff-0b6d78506ce3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a" status: 200 len: 1355 microversion: 2.1 time: 0.107139 Sep 24 21:50:56.615957 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3407/6836] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:50:56 2022] GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a => generated 1355 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:50:57.640359 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a5f2ce5d-d967-4909-af2b-c5eeda3819ee tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:50:57.641079 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a5f2ce5d-d967-4909-af2b-c5eeda3819ee tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: df5a1a98-7829-4a2c-82ca-8e424857547a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:50:57.648041 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5f2ce5d-d967-4909-af2b-c5eeda3819ee tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:50:57.648538 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5f2ce5d-d967-4909-af2b-c5eeda3819ee tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:50:57.648990 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5f2ce5d-d967-4909-af2b-c5eeda3819ee tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:50:57.649701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5f2ce5d-d967-4909-af2b-c5eeda3819ee tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:50:57.650171 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5f2ce5d-d967-4909-af2b-c5eeda3819ee tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:50:57.650634 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a5f2ce5d-d967-4909-af2b-c5eeda3819ee tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:50:57.664679 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-a5f2ce5d-d967-4909-af2b-c5eeda3819ee tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] HTTP exception thrown: Instance df5a1a98-7829-4a2c-82ca-8e424857547a could not be found. Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a5f2ce5d-d967-4909-af2b-c5eeda3819ee tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Request method failure captured: Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a HTTP/1.1 Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL3tlY6TxOcKA9sot6kAGfifiAT7Y-vlZYlV4mDyOhDhn0ty7VdV5tSo8UlXtPCa-WwNM_dIQLhLmZ-frXjrk-rwgBb_zUbuuXPjO6n3Y8yIkG02m1UafCrWL7DDdBlhrGINN8GSujPX_7p_Mvu6-XCMNk6noAMPUuRqhchaAZc_WaoM Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 22a8ea7438b641139afc6ea3c2dcba4c Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1351374344 Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/22a8ea7438b641139afc6ea3c2dcba4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_22a8ea7438b641139afc6ea3c2dcba4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/22a8ea7438b641139afc6ea3c2dcba4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/22a8ea7438b641139afc6ea3c2dcba4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1351374344 Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 22a8ea7438b641139afc6ea3c2dcba4c Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1351374344 Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-TestNetworkAdvancedServerOps-1351374344-project Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: ce56b96d91fa42029081bd0e6eccb5e4 Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1351374344-project Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance df5a1a98-7829-4a2c-82ca-8e424857547a could not be found. Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'df5a1a98-7829-4a2c-82ca-8e424857547a'} Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df5a1a98-7829-4a2c-82ca-8e424857547a could not be found. Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df5a1a98-7829-4a2c-82ca-8e424857547a could not be found. Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:50:57.666308 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:50:57.671253 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:50:57.671253 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:50:57.671253 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:50:57.671253 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:50:57.671253 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:50:57.671253 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:50:57.671253 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df5a1a98-7829-4a2c-82ca-8e424857547a could not be found. Sep 24 21:50:57.671253 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 21:50:57.671253 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a5f2ce5d-d967-4909-af2b-c5eeda3819ee tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Returning 404 to user: Instance df5a1a98-7829-4a2c-82ca-8e424857547a could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:50:57.671253 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a5f2ce5d-d967-4909-af2b-c5eeda3819ee tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a" status: 404 len: 111 microversion: 2.1 time: 0.032501 Sep 24 21:50:57.671253 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3430/6837] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:50:57 2022] GET /compute/v2.1/servers/df5a1a98-7829-4a2c-82ca-8e424857547a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:51:00.920716 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ae573c61-2abe-44d3-ba88-95680e95a4f9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '.version_select at 0x7f4b075e8af0>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:51:00.955978 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ae573c61-2abe-44d3-ba88-95680e95a4f9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-241590354" status: 202 len: 0 microversion: 2.1 time: 0.039076 Sep 24 21:51:00.956591 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3408/6838] 10.222.0.52 () {58 vars in 1281 bytes} [Sat Sep 24 21:51:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-241590354 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:51:00.982350 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3d437735-9ab3-49a4-9a24-279691a21da3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Action: 'create', calling method: .version_select at 0x7f4b07cc19d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1613356688", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ4mEeIhemFsx7gU4T/qBUqVa8To+WGkQ8SycLNO+wcmn95kRdAABfp4+jldA40I+Hix3Bwz/vA+VKdW5za7B+Ik3yE0SUXclFQoPY1iuxb9K1auvg9hPJVOIz9lWB1grQ=="}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:51:01.000271 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-3d437735-9ab3-49a4-9a24-279691a21da3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Getting quotas for project 22a8ea7438b641139afc6ea3c2dcba4c. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:51:01.006469 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-3d437735-9ab3-49a4-9a24-279691a21da3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Getting quotas for user ce56b96d91fa42029081bd0e6eccb5e4 and project 22a8ea7438b641139afc6ea3c2dcba4c. Resources: {'key_pairs'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:51:01.030996 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3d437735-9ab3-49a4-9a24-279691a21da3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.052501 Sep 24 21:51:01.031600 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3431/6839] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 21:51:00 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:51:06.741357 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=36 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:51:06.752519 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-74a2a11c-b598-4e48-82b0-4d84a1c216bb tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-70631964", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "c14ceea5-c30e-40df-bcae-91d0725139d6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1613356688", "security_groups": [{"name": "tempest-secgroup-smoke-1966250309"}]}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:51:06.881413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.network.neutron [None req-74a2a11c-b598-4e48-82b0-4d84a1c216bb tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] validate_networks() for [('c14ceea5-c30e-40df-bcae-91d0725139d6', None, None, None, None, None)] {{(pid=140516) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:51:07.603973 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-74a2a11c-b598-4e48-82b0-4d84a1c216bb tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Flavor limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:51:07.604403 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-74a2a11c-b598-4e48-82b0-4d84a1c216bb tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Image limits 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:51:07.604883 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-74a2a11c-b598-4e48-82b0-4d84a1c216bb tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Flavor pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:51:07.605295 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-74a2a11c-b598-4e48-82b0-4d84a1c216bb tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Image pref 0:0:0 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:51:07.605710 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.virt.hardware [None req-74a2a11c-b598-4e48-82b0-4d84a1c216bb tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:51:07.616689 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-74a2a11c-b598-4e48-82b0-4d84a1c216bb tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:07.617152 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-74a2a11c-b598-4e48-82b0-4d84a1c216bb tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:07.617711 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-74a2a11c-b598-4e48-82b0-4d84a1c216bb tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:07.618443 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-74a2a11c-b598-4e48-82b0-4d84a1c216bb tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:07.618939 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-74a2a11c-b598-4e48-82b0-4d84a1c216bb tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:07.619364 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-74a2a11c-b598-4e48-82b0-4d84a1c216bb tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:07.641612 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-74a2a11c-b598-4e48-82b0-4d84a1c216bb tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Getting quotas for project 22a8ea7438b641139afc6ea3c2dcba4c. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:51:07.647259 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-74a2a11c-b598-4e48-82b0-4d84a1c216bb tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Getting quotas for user ce56b96d91fa42029081bd0e6eccb5e4 and project 22a8ea7438b641139afc6ea3c2dcba4c. Resources: {'ram', 'cores', 'instances'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:51:07.660146 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-74a2a11c-b598-4e48-82b0-4d84a1c216bb tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Going to run 1 instances... {{(pid=140516) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:51:07.663340 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-74a2a11c-b598-4e48-82b0-4d84a1c216bb tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 47180f3a-c657-4494-92b0-1b24a7903145] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:51:07.713841 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-74a2a11c-b598-4e48-82b0-4d84a1c216bb tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.974117 Sep 24 21:51:07.715748 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3409/6840] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:51:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:51:07.728382 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-645f3a46-a5ce-4e74-a356-167872dd71a7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:51:07.729055 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-645f3a46-a5ce-4e74-a356-167872dd71a7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 47180f3a-c657-4494-92b0-1b24a7903145] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:51:07.733397 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:51:07.796608 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-645f3a46-a5ce-4e74-a356-167872dd71a7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:51:07.805290 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-645f3a46-a5ce-4e74-a356-167872dd71a7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145" status: 200 len: 1265 microversion: 2.1 time: 0.081127 Sep 24 21:51:07.806115 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3432/6841] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:51:07 2022] GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145 => generated 1265 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:51:08.831746 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cba4d9ad-bde4-4a1a-9194-696ae67f87bf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:51:08.832486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cba4d9ad-bde4-4a1a-9194-696ae67f87bf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 47180f3a-c657-4494-92b0-1b24a7903145] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:51:08.841786 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cba4d9ad-bde4-4a1a-9194-696ae67f87bf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:08.842582 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cba4d9ad-bde4-4a1a-9194-696ae67f87bf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:08.843284 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cba4d9ad-bde4-4a1a-9194-696ae67f87bf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:08.844367 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cba4d9ad-bde4-4a1a-9194-696ae67f87bf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:08.845454 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cba4d9ad-bde4-4a1a-9194-696ae67f87bf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:08.846109 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cba4d9ad-bde4-4a1a-9194-696ae67f87bf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:08.955595 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cba4d9ad-bde4-4a1a-9194-696ae67f87bf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:51:08.965296 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cba4d9ad-bde4-4a1a-9194-696ae67f87bf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145" status: 200 len: 1317 microversion: 2.1 time: 0.138377 Sep 24 21:51:08.966460 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3410/6842] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:51:08 2022] GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145 => generated 1317 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:51:09.990908 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-846a3452-984b-4b70-92c8-e6ff6e4e27ea tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:51:09.992196 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-846a3452-984b-4b70-92c8-e6ff6e4e27ea tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 47180f3a-c657-4494-92b0-1b24a7903145] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:51:10.003758 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-846a3452-984b-4b70-92c8-e6ff6e4e27ea tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:10.005226 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-846a3452-984b-4b70-92c8-e6ff6e4e27ea tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:10.005682 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-846a3452-984b-4b70-92c8-e6ff6e4e27ea tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:10.006659 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-846a3452-984b-4b70-92c8-e6ff6e4e27ea tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:10.007740 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-846a3452-984b-4b70-92c8-e6ff6e4e27ea tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:10.008378 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-846a3452-984b-4b70-92c8-e6ff6e4e27ea tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:10.250277 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-846a3452-984b-4b70-92c8-e6ff6e4e27ea tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:51:10.259488 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-846a3452-984b-4b70-92c8-e6ff6e4e27ea tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145" status: 200 len: 1391 microversion: 2.1 time: 0.273742 Sep 24 21:51:10.260177 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3433/6843] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:51:09 2022] GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145 => generated 1391 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:51:10.630961 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-de49168a-daa0-4d9d-bdc4-96fe47731a3b req-79ad1114-a08b-45a8-8170-c44c0c5f48b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47180f3a-c657-4494-92b0-1b24a7903145", "tag": "b16f68e2-ac01-4026-ac8d-e765d8864576"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:51:10.649897 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-de49168a-daa0-4d9d-bdc4-96fe47731a3b req-79ad1114-a08b-45a8-8170-c44c0c5f48b5 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:10.650396 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-de49168a-daa0-4d9d-bdc4-96fe47731a3b req-79ad1114-a08b-45a8-8170-c44c0c5f48b5 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:10.650864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-de49168a-daa0-4d9d-bdc4-96fe47731a3b req-79ad1114-a08b-45a8-8170-c44c0c5f48b5 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:10.663313 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-de49168a-daa0-4d9d-bdc4-96fe47731a3b req-79ad1114-a08b-45a8-8170-c44c0c5f48b5 service nova] Creating event network-changed:b16f68e2-ac01-4026-ac8d-e765d8864576 for instance 47180f3a-c657-4494-92b0-1b24a7903145 on nch2-master-1 Sep 24 21:51:10.668832 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-de49168a-daa0-4d9d-bdc4-96fe47731a3b req-79ad1114-a08b-45a8-8170-c44c0c5f48b5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043383 Sep 24 21:51:10.670044 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3411/6844] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:51:11.283861 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c52d7f15-1a92-44ec-996c-6ad33875fa66 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:51:11.284476 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c52d7f15-1a92-44ec-996c-6ad33875fa66 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 47180f3a-c657-4494-92b0-1b24a7903145] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:51:11.291848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c52d7f15-1a92-44ec-996c-6ad33875fa66 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:11.292331 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c52d7f15-1a92-44ec-996c-6ad33875fa66 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:11.292771 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c52d7f15-1a92-44ec-996c-6ad33875fa66 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:11.293469 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c52d7f15-1a92-44ec-996c-6ad33875fa66 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:11.293930 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c52d7f15-1a92-44ec-996c-6ad33875fa66 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:11.294363 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c52d7f15-1a92-44ec-996c-6ad33875fa66 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:11.428419 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c52d7f15-1a92-44ec-996c-6ad33875fa66 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:51:11.436175 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c52d7f15-1a92-44ec-996c-6ad33875fa66 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145" status: 200 len: 1391 microversion: 2.1 time: 0.156408 Sep 24 21:51:11.436785 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3434/6845] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:51:11 2022] GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:51:12.461466 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ed547e57-c15f-4653-a075-96fa1924013e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:51:12.462173 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ed547e57-c15f-4653-a075-96fa1924013e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 47180f3a-c657-4494-92b0-1b24a7903145] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:51:12.468507 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed547e57-c15f-4653-a075-96fa1924013e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:12.469029 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed547e57-c15f-4653-a075-96fa1924013e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:12.469476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed547e57-c15f-4653-a075-96fa1924013e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:12.470187 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed547e57-c15f-4653-a075-96fa1924013e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:12.470681 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed547e57-c15f-4653-a075-96fa1924013e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:12.471119 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ed547e57-c15f-4653-a075-96fa1924013e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:12.609866 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ed547e57-c15f-4653-a075-96fa1924013e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:51:12.618390 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ed547e57-c15f-4653-a075-96fa1924013e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145" status: 200 len: 1391 microversion: 2.1 time: 0.162544 Sep 24 21:51:12.619077 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3412/6846] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:51:12 2022] GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:51:13.641284 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0bd95eee-062f-4a3d-b4a2-dee404c7446f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:51:13.641916 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0bd95eee-062f-4a3d-b4a2-dee404c7446f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 47180f3a-c657-4494-92b0-1b24a7903145] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:51:13.649034 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0bd95eee-062f-4a3d-b4a2-dee404c7446f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:13.649531 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0bd95eee-062f-4a3d-b4a2-dee404c7446f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:13.649983 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0bd95eee-062f-4a3d-b4a2-dee404c7446f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:13.650737 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0bd95eee-062f-4a3d-b4a2-dee404c7446f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:13.651212 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0bd95eee-062f-4a3d-b4a2-dee404c7446f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:13.651649 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0bd95eee-062f-4a3d-b4a2-dee404c7446f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:13.780831 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0bd95eee-062f-4a3d-b4a2-dee404c7446f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:51:13.789683 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0bd95eee-062f-4a3d-b4a2-dee404c7446f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145" status: 200 len: 1391 microversion: 2.1 time: 0.152266 Sep 24 21:51:13.790280 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3435/6847] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:51:13 2022] GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145 => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:51:14.218986 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-09ff5c5b-eba8-4310-92c9-2d7a2873b23e req-829abb47-b529-48dc-b1c8-a81c364bb38c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47180f3a-c657-4494-92b0-1b24a7903145", "name": "network-vif-plugged", "status": "completed", "tag": "b16f68e2-ac01-4026-ac8d-e765d8864576"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:51:14.231064 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-09ff5c5b-eba8-4310-92c9-2d7a2873b23e req-829abb47-b529-48dc-b1c8-a81c364bb38c service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:14.231591 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-09ff5c5b-eba8-4310-92c9-2d7a2873b23e req-829abb47-b529-48dc-b1c8-a81c364bb38c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:14.232421 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-09ff5c5b-eba8-4310-92c9-2d7a2873b23e req-829abb47-b529-48dc-b1c8-a81c364bb38c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:14.244658 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-09ff5c5b-eba8-4310-92c9-2d7a2873b23e req-829abb47-b529-48dc-b1c8-a81c364bb38c service nova] Creating event network-vif-plugged:b16f68e2-ac01-4026-ac8d-e765d8864576 for instance 47180f3a-c657-4494-92b0-1b24a7903145 on nch2-master-1 Sep 24 21:51:14.249848 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-09ff5c5b-eba8-4310-92c9-2d7a2873b23e req-829abb47-b529-48dc-b1c8-a81c364bb38c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034919 Sep 24 21:51:14.250863 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3413/6848] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:51:14.813300 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-715b35bf-5aef-4679-b23c-46d37a11f72d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:51:14.813921 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-715b35bf-5aef-4679-b23c-46d37a11f72d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 47180f3a-c657-4494-92b0-1b24a7903145] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:51:14.821790 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-715b35bf-5aef-4679-b23c-46d37a11f72d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:14.822281 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-715b35bf-5aef-4679-b23c-46d37a11f72d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:14.822756 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-715b35bf-5aef-4679-b23c-46d37a11f72d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:14.823458 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-715b35bf-5aef-4679-b23c-46d37a11f72d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:14.823919 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-715b35bf-5aef-4679-b23c-46d37a11f72d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:14.824353 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-715b35bf-5aef-4679-b23c-46d37a11f72d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:14.956387 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-715b35bf-5aef-4679-b23c-46d37a11f72d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:51:14.964490 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-715b35bf-5aef-4679-b23c-46d37a11f72d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145" status: 200 len: 1391 microversion: 2.1 time: 0.155081 Sep 24 21:51:14.965081 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3436/6849] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:51:14 2022] GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:51:15.988286 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-577e2bc3-3203-49a3-8dbc-085843ce0a35 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:51:15.988972 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-577e2bc3-3203-49a3-8dbc-085843ce0a35 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 47180f3a-c657-4494-92b0-1b24a7903145] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:51:15.996072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-577e2bc3-3203-49a3-8dbc-085843ce0a35 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:15.996557 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-577e2bc3-3203-49a3-8dbc-085843ce0a35 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:15.996997 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-577e2bc3-3203-49a3-8dbc-085843ce0a35 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:15.997694 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-577e2bc3-3203-49a3-8dbc-085843ce0a35 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:15.998150 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-577e2bc3-3203-49a3-8dbc-085843ce0a35 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:15.998609 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-577e2bc3-3203-49a3-8dbc-085843ce0a35 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:16.131301 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-577e2bc3-3203-49a3-8dbc-085843ce0a35 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:51:16.139320 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-577e2bc3-3203-49a3-8dbc-085843ce0a35 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145" status: 200 len: 1563 microversion: 2.1 time: 0.155244 Sep 24 21:51:16.139899 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3414/6850] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:51:15 2022] GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:51:16.161623 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f89ba70b-adbb-4c78-b890-2999dbf69bd0 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:51:16.162246 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f89ba70b-adbb-4c78-b890-2999dbf69bd0 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 47180f3a-c657-4494-92b0-1b24a7903145] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:51:16.169187 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f89ba70b-adbb-4c78-b890-2999dbf69bd0 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:16.169694 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f89ba70b-adbb-4c78-b890-2999dbf69bd0 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:16.170127 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f89ba70b-adbb-4c78-b890-2999dbf69bd0 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:16.170858 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f89ba70b-adbb-4c78-b890-2999dbf69bd0 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:16.171324 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f89ba70b-adbb-4c78-b890-2999dbf69bd0 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:16.171760 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f89ba70b-adbb-4c78-b890-2999dbf69bd0 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:16.312955 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f89ba70b-adbb-4c78-b890-2999dbf69bd0 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:51:16.321602 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f89ba70b-adbb-4c78-b890-2999dbf69bd0 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145" status: 200 len: 1563 microversion: 2.1 time: 0.163835 Sep 24 21:51:16.322196 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3437/6851] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:51:16 2022] GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145 => generated 1563 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:51:18.181844 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ab74484d-f3f0-4986-adbe-47f2bba3214e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:51:18.182566 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ab74484d-f3f0-4986-adbe-47f2bba3214e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 47180f3a-c657-4494-92b0-1b24a7903145] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:51:18.184594 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-0b69073c-c6f7-4001-9d91-acdbea0adba3 req-34930e1c-3f92-417e-bcc2-09e90e70ad3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47180f3a-c657-4494-92b0-1b24a7903145", "tag": "b16f68e2-ac01-4026-ac8d-e765d8864576"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:51:18.185790 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:51:18.186703 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:51:18.195905 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab74484d-f3f0-4986-adbe-47f2bba3214e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:18.196102 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=6 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:51:18.196987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab74484d-f3f0-4986-adbe-47f2bba3214e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:18.197750 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab74484d-f3f0-4986-adbe-47f2bba3214e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:18.197904 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-0b69073c-c6f7-4001-9d91-acdbea0adba3 req-34930e1c-3f92-417e-bcc2-09e90e70ad3e service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:18.198554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-0b69073c-c6f7-4001-9d91-acdbea0adba3 req-34930e1c-3f92-417e-bcc2-09e90e70ad3e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:18.198671 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab74484d-f3f0-4986-adbe-47f2bba3214e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:18.199001 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-0b69073c-c6f7-4001-9d91-acdbea0adba3 req-34930e1c-3f92-417e-bcc2-09e90e70ad3e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:18.199144 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab74484d-f3f0-4986-adbe-47f2bba3214e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:18.199539 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab74484d-f3f0-4986-adbe-47f2bba3214e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:18.211976 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-0b69073c-c6f7-4001-9d91-acdbea0adba3 req-34930e1c-3f92-417e-bcc2-09e90e70ad3e service nova] Creating event network-changed:b16f68e2-ac01-4026-ac8d-e765d8864576 for instance 47180f3a-c657-4494-92b0-1b24a7903145 on nch2-master-1 Sep 24 21:51:18.217309 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-0b69073c-c6f7-4001-9d91-acdbea0adba3 req-34930e1c-3f92-417e-bcc2-09e90e70ad3e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036733 Sep 24 21:51:18.218189 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3438/6852] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:51:18.401598 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ab74484d-f3f0-4986-adbe-47f2bba3214e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:51:18.409782 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ab74484d-f3f0-4986-adbe-47f2bba3214e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145" status: 200 len: 1563 microversion: 2.1 time: 0.232488 Sep 24 21:51:18.423110 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3415/6853] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:51:18 2022] GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145 => generated 1563 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:51:39.648609 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:51:39.649491 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=32 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:51:39.653711 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f2a41891-a6c3-4d27-b436-3c74d115c76d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:51:39.656007 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f2a41891-a6c3-4d27-b436-3c74d115c76d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 47180f3a-c657-4494-92b0-1b24a7903145] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:51:39.664392 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f2a41891-a6c3-4d27-b436-3c74d115c76d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:39.664883 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f2a41891-a6c3-4d27-b436-3c74d115c76d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:39.665334 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f2a41891-a6c3-4d27-b436-3c74d115c76d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:39.666039 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f2a41891-a6c3-4d27-b436-3c74d115c76d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:39.666525 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f2a41891-a6c3-4d27-b436-3c74d115c76d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:39.666958 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f2a41891-a6c3-4d27-b436-3c74d115c76d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:39.744312 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f2a41891-a6c3-4d27-b436-3c74d115c76d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "POST /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145/action" status: 200 len: 24568 microversion: 2.1 time: 0.097528 Sep 24 21:51:39.744963 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3439/6854] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:51:39 2022] POST /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145/action => generated 24568 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:51:50.789254 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6817e6e4-dc3c-4d8e-9a42-3be28abf3741 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:51:50.791549 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6817e6e4-dc3c-4d8e-9a42-3be28abf3741 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 47180f3a-c657-4494-92b0-1b24a7903145] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:51:50.793773 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:51:50.794576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=30 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:51:50.800267 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6817e6e4-dc3c-4d8e-9a42-3be28abf3741 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:50.800749 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6817e6e4-dc3c-4d8e-9a42-3be28abf3741 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:50.801185 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6817e6e4-dc3c-4d8e-9a42-3be28abf3741 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:50.801882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6817e6e4-dc3c-4d8e-9a42-3be28abf3741 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:50.802631 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6817e6e4-dc3c-4d8e-9a42-3be28abf3741 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:50.803061 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6817e6e4-dc3c-4d8e-9a42-3be28abf3741 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:50.879044 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6817e6e4-dc3c-4d8e-9a42-3be28abf3741 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "POST /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145/action" status: 202 len: 0 microversion: 2.1 time: 0.094344 Sep 24 21:51:50.882636 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3416/6855] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:51:50 2022] POST /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:51:50.889127 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-05cf0cde-8f22-4a5a-947f-79e219756aa9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:51:50.889756 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-05cf0cde-8f22-4a5a-947f-79e219756aa9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 47180f3a-c657-4494-92b0-1b24a7903145] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:51:50.892682 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:51:50.893573 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=4 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:51:50.900569 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05cf0cde-8f22-4a5a-947f-79e219756aa9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:50.901068 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05cf0cde-8f22-4a5a-947f-79e219756aa9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:50.901515 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05cf0cde-8f22-4a5a-947f-79e219756aa9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:50.902247 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05cf0cde-8f22-4a5a-947f-79e219756aa9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:50.902734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05cf0cde-8f22-4a5a-947f-79e219756aa9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:50.903174 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05cf0cde-8f22-4a5a-947f-79e219756aa9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:51.127978 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-05cf0cde-8f22-4a5a-947f-79e219756aa9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:51:51.136665 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-05cf0cde-8f22-4a5a-947f-79e219756aa9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145" status: 200 len: 1674 microversion: 2.1 time: 0.251978 Sep 24 21:51:51.137259 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3440/6856] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:51:50 2022] GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145 => generated 1674 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:51:52.163914 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2714a568-c068-4577-84c1-715200ec6df2 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:51:52.164928 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2714a568-c068-4577-84c1-715200ec6df2 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 47180f3a-c657-4494-92b0-1b24a7903145] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:51:52.171227 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2714a568-c068-4577-84c1-715200ec6df2 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:52.171710 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2714a568-c068-4577-84c1-715200ec6df2 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:52.172149 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2714a568-c068-4577-84c1-715200ec6df2 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:52.172847 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2714a568-c068-4577-84c1-715200ec6df2 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:52.173300 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2714a568-c068-4577-84c1-715200ec6df2 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:52.173725 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2714a568-c068-4577-84c1-715200ec6df2 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:52.306183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2714a568-c068-4577-84c1-715200ec6df2 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:51:52.314096 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2714a568-c068-4577-84c1-715200ec6df2 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145" status: 200 len: 1679 microversion: 2.1 time: 0.156129 Sep 24 21:51:52.314720 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3417/6857] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:51:52 2022] GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:51:53.337301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4fd1afc2-9573-4073-8e94-0a9eb9327f5f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:51:53.337923 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4fd1afc2-9573-4073-8e94-0a9eb9327f5f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 47180f3a-c657-4494-92b0-1b24a7903145] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:51:53.345728 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4fd1afc2-9573-4073-8e94-0a9eb9327f5f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:53.346222 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4fd1afc2-9573-4073-8e94-0a9eb9327f5f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:53.346700 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4fd1afc2-9573-4073-8e94-0a9eb9327f5f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:53.347406 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4fd1afc2-9573-4073-8e94-0a9eb9327f5f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:53.347869 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4fd1afc2-9573-4073-8e94-0a9eb9327f5f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:53.348305 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4fd1afc2-9573-4073-8e94-0a9eb9327f5f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:53.482955 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4fd1afc2-9573-4073-8e94-0a9eb9327f5f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:51:53.491683 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4fd1afc2-9573-4073-8e94-0a9eb9327f5f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145" status: 200 len: 1679 microversion: 2.1 time: 0.157723 Sep 24 21:51:53.492323 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3441/6858] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:51:53 2022] GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:51:54.514787 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0cf0b30b-2a68-4a49-9f06-a31aa5860a82 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:51:54.515408 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0cf0b30b-2a68-4a49-9f06-a31aa5860a82 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 47180f3a-c657-4494-92b0-1b24a7903145] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:51:54.523012 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0cf0b30b-2a68-4a49-9f06-a31aa5860a82 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:54.523493 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0cf0b30b-2a68-4a49-9f06-a31aa5860a82 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:54.523931 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0cf0b30b-2a68-4a49-9f06-a31aa5860a82 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:54.524637 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0cf0b30b-2a68-4a49-9f06-a31aa5860a82 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:54.525093 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0cf0b30b-2a68-4a49-9f06-a31aa5860a82 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:54.525523 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0cf0b30b-2a68-4a49-9f06-a31aa5860a82 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:54.659550 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0cf0b30b-2a68-4a49-9f06-a31aa5860a82 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:51:54.668143 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0cf0b30b-2a68-4a49-9f06-a31aa5860a82 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145" status: 200 len: 1679 microversion: 2.1 time: 0.157258 Sep 24 21:51:54.668723 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3418/6859] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:51:54 2022] GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:51:55.692230 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-394dd24a-e6d2-45b2-9133-2f767d0dfdc4 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:51:55.692863 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-394dd24a-e6d2-45b2-9133-2f767d0dfdc4 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 47180f3a-c657-4494-92b0-1b24a7903145] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:51:55.700554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-394dd24a-e6d2-45b2-9133-2f767d0dfdc4 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:55.701066 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-394dd24a-e6d2-45b2-9133-2f767d0dfdc4 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:55.701515 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-394dd24a-e6d2-45b2-9133-2f767d0dfdc4 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:55.702327 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-394dd24a-e6d2-45b2-9133-2f767d0dfdc4 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:55.702753 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-394dd24a-e6d2-45b2-9133-2f767d0dfdc4 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:55.703198 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-394dd24a-e6d2-45b2-9133-2f767d0dfdc4 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:55.839715 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-394dd24a-e6d2-45b2-9133-2f767d0dfdc4 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:51:55.847491 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-394dd24a-e6d2-45b2-9133-2f767d0dfdc4 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145" status: 200 len: 1679 microversion: 2.1 time: 0.159302 Sep 24 21:51:55.848070 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3442/6860] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:51:55 2022] GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:51:56.871044 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-11469568-5330-4542-89b5-726d051e524e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:51:56.871667 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-11469568-5330-4542-89b5-726d051e524e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 47180f3a-c657-4494-92b0-1b24a7903145] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:51:56.877714 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-11469568-5330-4542-89b5-726d051e524e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:56.878203 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-11469568-5330-4542-89b5-726d051e524e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:56.878677 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-11469568-5330-4542-89b5-726d051e524e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:56.879381 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-11469568-5330-4542-89b5-726d051e524e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:56.879842 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-11469568-5330-4542-89b5-726d051e524e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:56.880275 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-11469568-5330-4542-89b5-726d051e524e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:57.013826 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-11469568-5330-4542-89b5-726d051e524e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:51:57.021828 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-11469568-5330-4542-89b5-726d051e524e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145" status: 200 len: 1679 microversion: 2.1 time: 0.155051 Sep 24 21:51:57.023043 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3419/6861] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:51:56 2022] GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:51:58.046138 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c1fdd453-d079-4e8c-9638-1e40c8b30652 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:51:58.046822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c1fdd453-d079-4e8c-9638-1e40c8b30652 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 47180f3a-c657-4494-92b0-1b24a7903145] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:51:58.054103 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1fdd453-d079-4e8c-9638-1e40c8b30652 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:58.054629 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1fdd453-d079-4e8c-9638-1e40c8b30652 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:58.055146 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1fdd453-d079-4e8c-9638-1e40c8b30652 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:58.055849 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1fdd453-d079-4e8c-9638-1e40c8b30652 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:58.056311 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1fdd453-d079-4e8c-9638-1e40c8b30652 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:58.056792 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c1fdd453-d079-4e8c-9638-1e40c8b30652 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:58.190221 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c1fdd453-d079-4e8c-9638-1e40c8b30652 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:51:58.198717 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c1fdd453-d079-4e8c-9638-1e40c8b30652 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145" status: 200 len: 1679 microversion: 2.1 time: 0.156512 Sep 24 21:51:58.199330 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3443/6862] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:51:58 2022] GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:51:59.223270 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7c5710ba-3ecf-4ee4-b76f-7c70fba93e68 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:51:59.223916 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7c5710ba-3ecf-4ee4-b76f-7c70fba93e68 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 47180f3a-c657-4494-92b0-1b24a7903145] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:51:59.231138 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7c5710ba-3ecf-4ee4-b76f-7c70fba93e68 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:59.231625 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7c5710ba-3ecf-4ee4-b76f-7c70fba93e68 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:59.232070 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7c5710ba-3ecf-4ee4-b76f-7c70fba93e68 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:59.232767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7c5710ba-3ecf-4ee4-b76f-7c70fba93e68 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:51:59.233224 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7c5710ba-3ecf-4ee4-b76f-7c70fba93e68 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:51:59.233652 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7c5710ba-3ecf-4ee4-b76f-7c70fba93e68 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:51:59.369818 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7c5710ba-3ecf-4ee4-b76f-7c70fba93e68 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:51:59.377618 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7c5710ba-3ecf-4ee4-b76f-7c70fba93e68 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145" status: 200 len: 1679 microversion: 2.1 time: 0.158556 Sep 24 21:51:59.378192 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3420/6863] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:51:59 2022] GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:52:00.401590 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-71148f9d-6183-47e2-842d-d309a5d708a2 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:52:00.402196 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-71148f9d-6183-47e2-842d-d309a5d708a2 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 47180f3a-c657-4494-92b0-1b24a7903145] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:52:00.409086 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71148f9d-6183-47e2-842d-d309a5d708a2 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:00.409576 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71148f9d-6183-47e2-842d-d309a5d708a2 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:00.410060 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71148f9d-6183-47e2-842d-d309a5d708a2 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:00.410786 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71148f9d-6183-47e2-842d-d309a5d708a2 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:00.411248 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71148f9d-6183-47e2-842d-d309a5d708a2 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:00.411679 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-71148f9d-6183-47e2-842d-d309a5d708a2 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:00.543394 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-71148f9d-6183-47e2-842d-d309a5d708a2 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:52:00.551220 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-71148f9d-6183-47e2-842d-d309a5d708a2 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145" status: 200 len: 1679 microversion: 2.1 time: 0.154529 Sep 24 21:52:00.551787 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3444/6864] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:52:00 2022] GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:52:01.575677 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-31f5651f-18c5-4fcf-9be7-4ffb22f9a329 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:52:01.576304 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-31f5651f-18c5-4fcf-9be7-4ffb22f9a329 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 47180f3a-c657-4494-92b0-1b24a7903145] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:52:01.584114 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-31f5651f-18c5-4fcf-9be7-4ffb22f9a329 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:01.585230 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-31f5651f-18c5-4fcf-9be7-4ffb22f9a329 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:01.585684 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-31f5651f-18c5-4fcf-9be7-4ffb22f9a329 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:01.586398 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-31f5651f-18c5-4fcf-9be7-4ffb22f9a329 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:01.586888 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-31f5651f-18c5-4fcf-9be7-4ffb22f9a329 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:01.587325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-31f5651f-18c5-4fcf-9be7-4ffb22f9a329 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:01.722803 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-31f5651f-18c5-4fcf-9be7-4ffb22f9a329 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:52:01.730686 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-31f5651f-18c5-4fcf-9be7-4ffb22f9a329 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145" status: 200 len: 1679 microversion: 2.1 time: 0.158984 Sep 24 21:52:01.731202 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3421/6865] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:52:01 2022] GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:52:02.754024 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2ddadc7b-6937-4eb2-bd99-65933f563d79 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:52:02.754685 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2ddadc7b-6937-4eb2-bd99-65933f563d79 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 47180f3a-c657-4494-92b0-1b24a7903145] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:52:02.761871 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ddadc7b-6937-4eb2-bd99-65933f563d79 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:02.762367 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ddadc7b-6937-4eb2-bd99-65933f563d79 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:02.763082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ddadc7b-6937-4eb2-bd99-65933f563d79 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:02.763644 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ddadc7b-6937-4eb2-bd99-65933f563d79 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:02.764107 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ddadc7b-6937-4eb2-bd99-65933f563d79 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:02.764544 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ddadc7b-6937-4eb2-bd99-65933f563d79 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:02.899107 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2ddadc7b-6937-4eb2-bd99-65933f563d79 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:52:02.907025 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2ddadc7b-6937-4eb2-bd99-65933f563d79 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145" status: 200 len: 1679 microversion: 2.1 time: 0.156927 Sep 24 21:52:02.907600 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3445/6866] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:52:02 2022] GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:52:03.931079 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-12d13714-898b-4735-b524-1146991ad2d5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:52:03.931707 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-12d13714-898b-4735-b524-1146991ad2d5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 47180f3a-c657-4494-92b0-1b24a7903145] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:52:03.938695 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-12d13714-898b-4735-b524-1146991ad2d5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:03.939189 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-12d13714-898b-4735-b524-1146991ad2d5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:03.939632 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-12d13714-898b-4735-b524-1146991ad2d5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:03.940373 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-12d13714-898b-4735-b524-1146991ad2d5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:03.940841 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-12d13714-898b-4735-b524-1146991ad2d5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:03.941278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-12d13714-898b-4735-b524-1146991ad2d5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:04.074629 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-12d13714-898b-4735-b524-1146991ad2d5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:52:04.082582 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-12d13714-898b-4735-b524-1146991ad2d5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145" status: 200 len: 1679 microversion: 2.1 time: 0.156280 Sep 24 21:52:04.083166 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3422/6867] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:52:03 2022] GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:52:05.105928 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e3db45bf-3a37-4c4b-baa2-71b8d07387ac tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:52:05.106605 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e3db45bf-3a37-4c4b-baa2-71b8d07387ac tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 47180f3a-c657-4494-92b0-1b24a7903145] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:52:05.113484 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3db45bf-3a37-4c4b-baa2-71b8d07387ac tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:05.113980 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3db45bf-3a37-4c4b-baa2-71b8d07387ac tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:05.114428 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3db45bf-3a37-4c4b-baa2-71b8d07387ac tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:05.115157 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3db45bf-3a37-4c4b-baa2-71b8d07387ac tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:05.116201 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3db45bf-3a37-4c4b-baa2-71b8d07387ac tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:05.116716 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e3db45bf-3a37-4c4b-baa2-71b8d07387ac tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:05.251924 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e3db45bf-3a37-4c4b-baa2-71b8d07387ac tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:52:05.260391 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e3db45bf-3a37-4c4b-baa2-71b8d07387ac tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145" status: 200 len: 1679 microversion: 2.1 time: 0.158413 Sep 24 21:52:05.260968 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3446/6868] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:52:05 2022] GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:52:06.283728 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-0914a65b-5e67-4d4f-b4d1-ac0e3bfd0a08 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:52:06.284350 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-0914a65b-5e67-4d4f-b4d1-ac0e3bfd0a08 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 47180f3a-c657-4494-92b0-1b24a7903145] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:52:06.291236 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0914a65b-5e67-4d4f-b4d1-ac0e3bfd0a08 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:06.291726 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0914a65b-5e67-4d4f-b4d1-ac0e3bfd0a08 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:06.292173 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0914a65b-5e67-4d4f-b4d1-ac0e3bfd0a08 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:06.292874 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0914a65b-5e67-4d4f-b4d1-ac0e3bfd0a08 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:06.293329 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0914a65b-5e67-4d4f-b4d1-ac0e3bfd0a08 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:06.293765 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-0914a65b-5e67-4d4f-b4d1-ac0e3bfd0a08 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:06.424356 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-0914a65b-5e67-4d4f-b4d1-ac0e3bfd0a08 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:52:06.433098 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-0914a65b-5e67-4d4f-b4d1-ac0e3bfd0a08 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145" status: 200 len: 1679 microversion: 2.1 time: 0.153328 Sep 24 21:52:06.433662 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3423/6869] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:52:06 2022] GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:52:07.457426 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-32bd23d9-af10-4fc7-a4bd-9de8339578df tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:52:07.458088 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-32bd23d9-af10-4fc7-a4bd-9de8339578df tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 47180f3a-c657-4494-92b0-1b24a7903145] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:52:07.465553 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-32bd23d9-af10-4fc7-a4bd-9de8339578df tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:07.466090 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-32bd23d9-af10-4fc7-a4bd-9de8339578df tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:07.466566 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-32bd23d9-af10-4fc7-a4bd-9de8339578df tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:07.467284 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-32bd23d9-af10-4fc7-a4bd-9de8339578df tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:07.467786 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-32bd23d9-af10-4fc7-a4bd-9de8339578df tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:07.468195 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-32bd23d9-af10-4fc7-a4bd-9de8339578df tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:07.604838 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-32bd23d9-af10-4fc7-a4bd-9de8339578df tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:52:07.612816 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-32bd23d9-af10-4fc7-a4bd-9de8339578df tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145" status: 200 len: 1682 microversion: 2.1 time: 0.159346 Sep 24 21:52:07.613402 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3447/6870] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:52:07 2022] GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:52:31.800415 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e3c2729e-4131-4227-97d6-62ad9cbbcc98 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:52:31.803605 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e3c2729e-4131-4227-97d6-62ad9cbbcc98 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 47180f3a-c657-4494-92b0-1b24a7903145] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:52:31.805833 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=16 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:52:31.806526 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:52:31.812767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e3c2729e-4131-4227-97d6-62ad9cbbcc98 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:31.813256 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e3c2729e-4131-4227-97d6-62ad9cbbcc98 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:31.813704 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e3c2729e-4131-4227-97d6-62ad9cbbcc98 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:31.814407 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e3c2729e-4131-4227-97d6-62ad9cbbcc98 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:31.814897 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e3c2729e-4131-4227-97d6-62ad9cbbcc98 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:31.815331 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e3c2729e-4131-4227-97d6-62ad9cbbcc98 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:31.887277 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e3c2729e-4131-4227-97d6-62ad9cbbcc98 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "POST /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145/action" status: 200 len: 69064 microversion: 2.1 time: 0.091286 Sep 24 21:52:31.887949 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3424/6871] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:52:31 2022] POST /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145/action => generated 69064 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:52:39.021608 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-05834645-6196-49c6-a03d-6083ff9d9800 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:52:39.022978 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-05834645-6196-49c6-a03d-6083ff9d9800 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 47180f3a-c657-4494-92b0-1b24a7903145] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:52:39.023876 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-8cc945d3-610a-41c5-8f39-5378bbe719cf req-2e8b55e2-1436-479d-803c-0a1b740bfb7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47180f3a-c657-4494-92b0-1b24a7903145", "tag": "b16f68e2-ac01-4026-ac8d-e765d8864576"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:52:39.026550 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=16 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:52:39.027604 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=48 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:52:39.029010 ncdv-master-1 devstack@n-api.service[140517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 21:52:39.029485 ncdv-master-1 devstack@n-api.service[140517]: Sat Sep 24 21:52:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145 (ip 10.222.0.52) !!! Sep 24 21:52:39.040168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-8cc945d3-610a-41c5-8f39-5378bbe719cf req-2e8b55e2-1436-479d-803c-0a1b740bfb7f service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:39.040658 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-8cc945d3-610a-41c5-8f39-5378bbe719cf req-2e8b55e2-1436-479d-803c-0a1b740bfb7f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:39.041101 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-8cc945d3-610a-41c5-8f39-5378bbe719cf req-2e8b55e2-1436-479d-803c-0a1b740bfb7f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:39.043977 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05834645-6196-49c6-a03d-6083ff9d9800 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:39.044482 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05834645-6196-49c6-a03d-6083ff9d9800 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:39.044935 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05834645-6196-49c6-a03d-6083ff9d9800 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:39.045811 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05834645-6196-49c6-a03d-6083ff9d9800 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:39.046132 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05834645-6196-49c6-a03d-6083ff9d9800 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:39.046600 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-05834645-6196-49c6-a03d-6083ff9d9800 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:39.053969 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-8cc945d3-610a-41c5-8f39-5378bbe719cf req-2e8b55e2-1436-479d-803c-0a1b740bfb7f service nova] Creating event network-changed:b16f68e2-ac01-4026-ac8d-e765d8864576 for instance 47180f3a-c657-4494-92b0-1b24a7903145 on nch2-master-1 Sep 24 21:52:39.059906 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-8cc945d3-610a-41c5-8f39-5378bbe719cf req-2e8b55e2-1436-479d-803c-0a1b740bfb7f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040892 Sep 24 21:52:39.060517 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3425/6872] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:52:39.076607 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-05834645-6196-49c6-a03d-6083ff9d9800 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 47180f3a-c657-4494-92b0-1b24a7903145] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:52:39.158908 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-05834645-6196-49c6-a03d-6083ff9d9800 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "DELETE /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145" status: 204 len: 0 microversion: 2.1 time: 0.141521 Sep 24 21:52:39.163032 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3448/6873] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:52:39 2022] DELETE /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:52:39.169161 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-567e85bb-a4e4-47ae-8133-c884eab173bf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:52:39.169902 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-567e85bb-a4e4-47ae-8133-c884eab173bf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 47180f3a-c657-4494-92b0-1b24a7903145] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:52:39.176721 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-567e85bb-a4e4-47ae-8133-c884eab173bf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:39.177466 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-567e85bb-a4e4-47ae-8133-c884eab173bf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:39.177932 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-567e85bb-a4e4-47ae-8133-c884eab173bf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:39.179122 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-567e85bb-a4e4-47ae-8133-c884eab173bf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:39.179965 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-567e85bb-a4e4-47ae-8133-c884eab173bf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:39.180779 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-567e85bb-a4e4-47ae-8133-c884eab173bf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:39.315643 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-567e85bb-a4e4-47ae-8133-c884eab173bf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:52:39.324070 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-567e85bb-a4e4-47ae-8133-c884eab173bf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145" status: 200 len: 1688 microversion: 2.1 time: 0.159299 Sep 24 21:52:39.324842 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3426/6874] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:52:39 2022] GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145 => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:52:40.350909 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-58ae1a2d-5764-4386-81c1-64f6b142efc9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:52:40.351623 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-58ae1a2d-5764-4386-81c1-64f6b142efc9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 47180f3a-c657-4494-92b0-1b24a7903145] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:52:40.358568 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58ae1a2d-5764-4386-81c1-64f6b142efc9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:40.359067 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58ae1a2d-5764-4386-81c1-64f6b142efc9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:40.359510 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58ae1a2d-5764-4386-81c1-64f6b142efc9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:40.360221 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58ae1a2d-5764-4386-81c1-64f6b142efc9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:40.360681 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58ae1a2d-5764-4386-81c1-64f6b142efc9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:40.361115 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58ae1a2d-5764-4386-81c1-64f6b142efc9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:40.570769 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-58ae1a2d-5764-4386-81c1-64f6b142efc9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:52:40.578646 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-58ae1a2d-5764-4386-81c1-64f6b142efc9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145" status: 200 len: 1688 microversion: 2.1 time: 0.232660 Sep 24 21:52:40.579227 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3449/6875] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:52:40 2022] GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145 => generated 1688 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:52:41.406315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-9e0ca0f0-3444-4044-81ed-0a1ae877fdb2 req-d9db04b5-0dce-48c7-b9f3-e52502952d3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47180f3a-c657-4494-92b0-1b24a7903145", "name": "network-vif-deleted", "tag": "b16f68e2-ac01-4026-ac8d-e765d8864576"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:52:41.418934 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-9e0ca0f0-3444-4044-81ed-0a1ae877fdb2 req-d9db04b5-0dce-48c7-b9f3-e52502952d3a service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:41.419370 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-9e0ca0f0-3444-4044-81ed-0a1ae877fdb2 req-d9db04b5-0dce-48c7-b9f3-e52502952d3a service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:41.420402 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-9e0ca0f0-3444-4044-81ed-0a1ae877fdb2 req-d9db04b5-0dce-48c7-b9f3-e52502952d3a service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:41.436009 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-9e0ca0f0-3444-4044-81ed-0a1ae877fdb2 req-d9db04b5-0dce-48c7-b9f3-e52502952d3a service nova] Creating event network-vif-deleted:b16f68e2-ac01-4026-ac8d-e765d8864576 for instance 47180f3a-c657-4494-92b0-1b24a7903145 on nch2-master-1 Sep 24 21:52:41.441606 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-9e0ca0f0-3444-4044-81ed-0a1ae877fdb2 req-d9db04b5-0dce-48c7-b9f3-e52502952d3a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039159 Sep 24 21:52:41.442215 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3427/6876] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:52:41.602523 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a93e7372-fcef-4be0-ae2a-e8f700fcb6ae tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:52:41.603163 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a93e7372-fcef-4be0-ae2a-e8f700fcb6ae tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 47180f3a-c657-4494-92b0-1b24a7903145] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:52:41.610117 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a93e7372-fcef-4be0-ae2a-e8f700fcb6ae tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:41.610648 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a93e7372-fcef-4be0-ae2a-e8f700fcb6ae tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:41.611094 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a93e7372-fcef-4be0-ae2a-e8f700fcb6ae tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:41.611801 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a93e7372-fcef-4be0-ae2a-e8f700fcb6ae tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:41.612265 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a93e7372-fcef-4be0-ae2a-e8f700fcb6ae tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:41.612743 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a93e7372-fcef-4be0-ae2a-e8f700fcb6ae tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:41.645306 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a93e7372-fcef-4be0-ae2a-e8f700fcb6ae tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:41.645791 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a93e7372-fcef-4be0-ae2a-e8f700fcb6ae tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:41.646225 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a93e7372-fcef-4be0-ae2a-e8f700fcb6ae tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:41.647250 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-a93e7372-fcef-4be0-ae2a-e8f700fcb6ae tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lazy-loading 'fault' on Instance uuid 47180f3a-c657-4494-92b0-1b24a7903145 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:52:41.693808 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a93e7372-fcef-4be0-ae2a-e8f700fcb6ae tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:52:41.702653 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a93e7372-fcef-4be0-ae2a-e8f700fcb6ae tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145" status: 200 len: 1506 microversion: 2.1 time: 0.104541 Sep 24 21:52:41.703247 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3450/6877] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:52:41 2022] GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145 => generated 1506 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:52:42.728305 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7b42dce6-676e-43a7-b3be-1a9aefe1e32d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:52:42.729005 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7b42dce6-676e-43a7-b3be-1a9aefe1e32d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 47180f3a-c657-4494-92b0-1b24a7903145] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:52:42.736175 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b42dce6-676e-43a7-b3be-1a9aefe1e32d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:42.736657 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b42dce6-676e-43a7-b3be-1a9aefe1e32d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:42.737096 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b42dce6-676e-43a7-b3be-1a9aefe1e32d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:42.737790 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b42dce6-676e-43a7-b3be-1a9aefe1e32d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:42.738250 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b42dce6-676e-43a7-b3be-1a9aefe1e32d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:42.738709 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7b42dce6-676e-43a7-b3be-1a9aefe1e32d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:42.752586 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-7b42dce6-676e-43a7-b3be-1a9aefe1e32d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] HTTP exception thrown: Instance 47180f3a-c657-4494-92b0-1b24a7903145 could not be found. Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7b42dce6-676e-43a7-b3be-1a9aefe1e32d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Request method failure captured: Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145 HTTP/1.1 Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3tlY6TxOcKA9sot6kAGfifiAT7Y-vlZYlV4mDyOhDhn0ty7VdV5tSo8UlXtPCa-WwNM_dIQLhLmZ-frXjrk-rwgBb_zUbuuXPjO6n3Y8yIkG02m1UafCrWL7DDdBlhrGINN8GSujPX_7p_Mvu6-XCMNk6noAMPUuRqhchaAZc_WaoM Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 22a8ea7438b641139afc6ea3c2dcba4c Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1351374344 Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/22a8ea7438b641139afc6ea3c2dcba4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_22a8ea7438b641139afc6ea3c2dcba4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/22a8ea7438b641139afc6ea3c2dcba4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/22a8ea7438b641139afc6ea3c2dcba4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1351374344 Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 22a8ea7438b641139afc6ea3c2dcba4c Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1351374344 Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-TestNetworkAdvancedServerOps-1351374344-project Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: ce56b96d91fa42029081bd0e6eccb5e4 Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1351374344-project Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 47180f3a-c657-4494-92b0-1b24a7903145 could not be found. Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '47180f3a-c657-4494-92b0-1b24a7903145'} Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47180f3a-c657-4494-92b0-1b24a7903145 could not be found. Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47180f3a-c657-4494-92b0-1b24a7903145 could not be found. Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:52:42.754195 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:52:42.759996 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:52:42.759996 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:52:42.759996 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:52:42.759996 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:52:42.759996 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:52:42.759996 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:52:42.759996 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47180f3a-c657-4494-92b0-1b24a7903145 could not be found. Sep 24 21:52:42.759996 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:52:42.759996 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7b42dce6-676e-43a7-b3be-1a9aefe1e32d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Returning 404 to user: Instance 47180f3a-c657-4494-92b0-1b24a7903145 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:52:42.759996 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7b42dce6-676e-43a7-b3be-1a9aefe1e32d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145" status: 404 len: 111 microversion: 2.1 time: 0.031811 Sep 24 21:52:42.759996 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3428/6878] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:52:42 2022] GET /compute/v2.1/servers/47180f3a-c657-4494-92b0-1b24a7903145 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:52:46.026804 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-97a5de8e-9ba3-4bf6-8160-c95bea835b84 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '.version_select at 0x7f4b0c715940>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:52:46.048611 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-97a5de8e-9ba3-4bf6-8160-c95bea835b84 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1613356688" status: 202 len: 0 microversion: 2.1 time: 0.025870 Sep 24 21:52:46.049207 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3451/6879] 10.222.0.52 () {58 vars in 1284 bytes} [Sat Sep 24 21:52:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1613356688 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:52:46.079271 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6b1b759d-4c64-451a-83c8-4ce39c9867c3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Action: 'create', calling method: .version_select at 0x7f4b0c572040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1755799080", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFESb4QTvJ+O2gO/rDKLEc/hhNnvCGi7F2MkwstVKiYFhqMakmkgmojo+Ap5R4RcBdk43ybKRbQoYvyUcMYEbLK8/+FrwNmIPwD3XRDQBfSCgaPvlr1uGcpnlIKywudFNA=="}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:52:46.097255 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-6b1b759d-4c64-451a-83c8-4ce39c9867c3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Getting quotas for project 22a8ea7438b641139afc6ea3c2dcba4c. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:52:46.102891 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-6b1b759d-4c64-451a-83c8-4ce39c9867c3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Getting quotas for user ce56b96d91fa42029081bd0e6eccb5e4 and project 22a8ea7438b641139afc6ea3c2dcba4c. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:52:46.125561 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6b1b759d-4c64-451a-83c8-4ce39c9867c3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050227 Sep 24 21:52:46.126146 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3429/6880] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 21:52:46 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:52:51.608996 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d72b0214-fa73-4f12-ac58-729192f01aca tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1974743681", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "33f45864-59f1-4318-973e-59b67c110b35"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1755799080", "security_groups": [{"name": "tempest-secgroup-smoke-716602398"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:52:51.699061 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:52:51.752571 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-d72b0214-fa73-4f12-ac58-729192f01aca tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] validate_networks() for [('33f45864-59f1-4318-973e-59b67c110b35', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:52:52.284329 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-d72b0214-fa73-4f12-ac58-729192f01aca tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:52:52.285149 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-d72b0214-fa73-4f12-ac58-729192f01aca tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:52:52.286004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-d72b0214-fa73-4f12-ac58-729192f01aca tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:52:52.286677 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-d72b0214-fa73-4f12-ac58-729192f01aca tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:52:52.287990 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-d72b0214-fa73-4f12-ac58-729192f01aca tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:52:52.308131 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d72b0214-fa73-4f12-ac58-729192f01aca tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:52.308800 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d72b0214-fa73-4f12-ac58-729192f01aca tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:52.309912 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d72b0214-fa73-4f12-ac58-729192f01aca tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:52.310820 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d72b0214-fa73-4f12-ac58-729192f01aca tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:52.311539 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d72b0214-fa73-4f12-ac58-729192f01aca tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:52.312213 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d72b0214-fa73-4f12-ac58-729192f01aca tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:52.337717 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-d72b0214-fa73-4f12-ac58-729192f01aca tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Getting quotas for project 22a8ea7438b641139afc6ea3c2dcba4c. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:52:52.343893 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-d72b0214-fa73-4f12-ac58-729192f01aca tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Getting quotas for user ce56b96d91fa42029081bd0e6eccb5e4 and project 22a8ea7438b641139afc6ea3c2dcba4c. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:52:52.366281 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d72b0214-fa73-4f12-ac58-729192f01aca tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:52:52.369832 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d72b0214-fa73-4f12-ac58-729192f01aca tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:52:52.424377 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d72b0214-fa73-4f12-ac58-729192f01aca tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.820352 Sep 24 21:52:52.430682 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3452/6881] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:52:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:52:52.438642 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-51602dba-fb62-422e-b5b4-2f6b4fed62d5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:52:52.439795 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-51602dba-fb62-422e-b5b4-2f6b4fed62d5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:52:52.511540 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-51602dba-fb62-422e-b5b4-2f6b4fed62d5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:52:52.519918 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-51602dba-fb62-422e-b5b4-2f6b4fed62d5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 200 len: 1267 microversion: 2.1 time: 0.086185 Sep 24 21:52:52.520516 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3430/6882] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:52:52 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 1267 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:52:53.544891 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e7eda724-56cf-4931-b14e-44f73f415f23 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:52:53.545528 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e7eda724-56cf-4931-b14e-44f73f415f23 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:52:53.556299 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7eda724-56cf-4931-b14e-44f73f415f23 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:53.556848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7eda724-56cf-4931-b14e-44f73f415f23 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:53.557304 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7eda724-56cf-4931-b14e-44f73f415f23 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:53.558547 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7eda724-56cf-4931-b14e-44f73f415f23 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:53.559259 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7eda724-56cf-4931-b14e-44f73f415f23 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:53.559696 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e7eda724-56cf-4931-b14e-44f73f415f23 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:53.689714 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e7eda724-56cf-4931-b14e-44f73f415f23 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:52:53.715000 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e7eda724-56cf-4931-b14e-44f73f415f23 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 200 len: 1327 microversion: 2.1 time: 0.174414 Sep 24 21:52:53.716754 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3453/6883] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:52:53 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 1327 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:52:54.743038 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-552a55b3-da9f-4946-9dc7-982cc0088fbf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:52:54.743771 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-552a55b3-da9f-4946-9dc7-982cc0088fbf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:52:54.749298 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=16 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:52:54.752031 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-552a55b3-da9f-4946-9dc7-982cc0088fbf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:54.753011 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-552a55b3-da9f-4946-9dc7-982cc0088fbf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:54.753533 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-552a55b3-da9f-4946-9dc7-982cc0088fbf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:54.754338 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-552a55b3-da9f-4946-9dc7-982cc0088fbf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:54.754909 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-552a55b3-da9f-4946-9dc7-982cc0088fbf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:54.755419 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-552a55b3-da9f-4946-9dc7-982cc0088fbf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:55.005365 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-552a55b3-da9f-4946-9dc7-982cc0088fbf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:52:55.017184 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-552a55b3-da9f-4946-9dc7-982cc0088fbf tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 200 len: 1392 microversion: 2.1 time: 0.278593 Sep 24 21:52:55.017780 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3431/6884] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:52:54 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 1392 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:52:55.228897 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-2e59e49a-d023-4a30-93f2-fe69abeee3c0 req-54b54576-fe70-4175-b233-46762b3be04b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f049bd6-6ece-409d-91d9-c7a5a587c9f5", "tag": "92127e40-8a0a-4548-9b6a-8b8682c721fc"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:52:55.241590 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-2e59e49a-d023-4a30-93f2-fe69abeee3c0 req-54b54576-fe70-4175-b233-46762b3be04b service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:55.242246 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-2e59e49a-d023-4a30-93f2-fe69abeee3c0 req-54b54576-fe70-4175-b233-46762b3be04b service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:55.242967 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-2e59e49a-d023-4a30-93f2-fe69abeee3c0 req-54b54576-fe70-4175-b233-46762b3be04b service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:55.254817 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-2e59e49a-d023-4a30-93f2-fe69abeee3c0 req-54b54576-fe70-4175-b233-46762b3be04b service nova] Creating event network-changed:92127e40-8a0a-4548-9b6a-8b8682c721fc for instance 8f049bd6-6ece-409d-91d9-c7a5a587c9f5 on nch1-master-1 Sep 24 21:52:55.260565 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-2e59e49a-d023-4a30-93f2-fe69abeee3c0 req-54b54576-fe70-4175-b233-46762b3be04b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035513 Sep 24 21:52:55.261231 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3454/6885] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:52:56.041076 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4365b622-d866-46fc-8bb5-6fa2b0587258 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:52:56.041695 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4365b622-d866-46fc-8bb5-6fa2b0587258 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:52:56.049016 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4365b622-d866-46fc-8bb5-6fa2b0587258 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:56.049508 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4365b622-d866-46fc-8bb5-6fa2b0587258 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:56.049945 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4365b622-d866-46fc-8bb5-6fa2b0587258 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:56.050668 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4365b622-d866-46fc-8bb5-6fa2b0587258 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:56.051121 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4365b622-d866-46fc-8bb5-6fa2b0587258 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:56.051546 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4365b622-d866-46fc-8bb5-6fa2b0587258 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:56.191704 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4365b622-d866-46fc-8bb5-6fa2b0587258 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:52:56.200388 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4365b622-d866-46fc-8bb5-6fa2b0587258 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 200 len: 1392 microversion: 2.1 time: 0.163261 Sep 24 21:52:56.200979 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3432/6886] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:52:56 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:52:57.224645 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-691a75ac-a8cc-4e76-b6e6-84c88b46ffec tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:52:57.225347 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-691a75ac-a8cc-4e76-b6e6-84c88b46ffec tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:52:57.231598 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-691a75ac-a8cc-4e76-b6e6-84c88b46ffec tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:57.232087 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-691a75ac-a8cc-4e76-b6e6-84c88b46ffec tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:57.232560 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-691a75ac-a8cc-4e76-b6e6-84c88b46ffec tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:57.233260 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-691a75ac-a8cc-4e76-b6e6-84c88b46ffec tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:57.233723 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-691a75ac-a8cc-4e76-b6e6-84c88b46ffec tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:57.234157 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-691a75ac-a8cc-4e76-b6e6-84c88b46ffec tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:57.364363 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-691a75ac-a8cc-4e76-b6e6-84c88b46ffec tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:52:57.372416 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-691a75ac-a8cc-4e76-b6e6-84c88b46ffec tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 200 len: 1392 microversion: 2.1 time: 0.152997 Sep 24 21:52:57.372939 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3455/6887] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:52:57 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:52:58.395147 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c7ead6c0-034a-4d16-8d7a-bf0daa318821 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:52:58.395790 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c7ead6c0-034a-4d16-8d7a-bf0daa318821 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:52:58.402849 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c7ead6c0-034a-4d16-8d7a-bf0daa318821 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:58.403332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c7ead6c0-034a-4d16-8d7a-bf0daa318821 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:58.403770 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c7ead6c0-034a-4d16-8d7a-bf0daa318821 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:58.404459 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c7ead6c0-034a-4d16-8d7a-bf0daa318821 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:58.404916 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c7ead6c0-034a-4d16-8d7a-bf0daa318821 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:58.405340 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c7ead6c0-034a-4d16-8d7a-bf0daa318821 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:58.540172 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c7ead6c0-034a-4d16-8d7a-bf0daa318821 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:52:58.548162 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c7ead6c0-034a-4d16-8d7a-bf0daa318821 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 200 len: 1392 microversion: 2.1 time: 0.156925 Sep 24 21:52:58.548752 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3433/6888] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:52:58 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:52:59.572758 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ef3ec67c-a355-495d-a385-1e7ed7296af4 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:52:59.573385 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ef3ec67c-a355-495d-a385-1e7ed7296af4 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:52:59.580561 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef3ec67c-a355-495d-a385-1e7ed7296af4 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:59.581065 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef3ec67c-a355-495d-a385-1e7ed7296af4 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:59.581668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef3ec67c-a355-495d-a385-1e7ed7296af4 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:59.582388 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef3ec67c-a355-495d-a385-1e7ed7296af4 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:52:59.582895 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef3ec67c-a355-495d-a385-1e7ed7296af4 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:52:59.583364 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ef3ec67c-a355-495d-a385-1e7ed7296af4 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:52:59.734090 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ef3ec67c-a355-495d-a385-1e7ed7296af4 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:52:59.742557 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ef3ec67c-a355-495d-a385-1e7ed7296af4 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 200 len: 1392 microversion: 2.1 time: 0.174529 Sep 24 21:52:59.743150 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3456/6889] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:52:59 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:53:00.766021 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f60eb41b-3bb7-47ce-9be5-f0129cd8a2ef tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:53:00.766674 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f60eb41b-3bb7-47ce-9be5-f0129cd8a2ef tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:53:00.774724 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f60eb41b-3bb7-47ce-9be5-f0129cd8a2ef tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:53:00.775217 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f60eb41b-3bb7-47ce-9be5-f0129cd8a2ef tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:53:00.775660 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f60eb41b-3bb7-47ce-9be5-f0129cd8a2ef tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:53:00.776370 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f60eb41b-3bb7-47ce-9be5-f0129cd8a2ef tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:53:00.776831 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f60eb41b-3bb7-47ce-9be5-f0129cd8a2ef tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:53:00.777263 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f60eb41b-3bb7-47ce-9be5-f0129cd8a2ef tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:53:00.911914 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f60eb41b-3bb7-47ce-9be5-f0129cd8a2ef tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:53:00.919745 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f60eb41b-3bb7-47ce-9be5-f0129cd8a2ef tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 200 len: 1392 microversion: 2.1 time: 0.157716 Sep 24 21:53:00.920324 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3434/6890] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:53:00 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:53:01.400238 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-d54dbbcc-7f63-4c0e-bcd8-0e468ae0b615 req-bef55433-7a0b-4705-938d-f997a4b6b8cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f049bd6-6ece-409d-91d9-c7a5a587c9f5", "name": "network-vif-plugged", "status": "completed", "tag": "92127e40-8a0a-4548-9b6a-8b8682c721fc"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:53:01.412786 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-d54dbbcc-7f63-4c0e-bcd8-0e468ae0b615 req-bef55433-7a0b-4705-938d-f997a4b6b8cb service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:53:01.413291 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-d54dbbcc-7f63-4c0e-bcd8-0e468ae0b615 req-bef55433-7a0b-4705-938d-f997a4b6b8cb service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:53:01.414057 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-d54dbbcc-7f63-4c0e-bcd8-0e468ae0b615 req-bef55433-7a0b-4705-938d-f997a4b6b8cb service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:53:01.425908 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-d54dbbcc-7f63-4c0e-bcd8-0e468ae0b615 req-bef55433-7a0b-4705-938d-f997a4b6b8cb service nova] Creating event network-vif-plugged:92127e40-8a0a-4548-9b6a-8b8682c721fc for instance 8f049bd6-6ece-409d-91d9-c7a5a587c9f5 on nch1-master-1 Sep 24 21:53:01.432026 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-d54dbbcc-7f63-4c0e-bcd8-0e468ae0b615 req-bef55433-7a0b-4705-938d-f997a4b6b8cb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035634 Sep 24 21:53:01.433105 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3457/6891] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:53:01.941865 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8211cd38-8f09-4482-9afd-f2026a074302 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:53:01.942490 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8211cd38-8f09-4482-9afd-f2026a074302 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:53:01.945334 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:53:01.950693 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8211cd38-8f09-4482-9afd-f2026a074302 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:53:01.951182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8211cd38-8f09-4482-9afd-f2026a074302 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:53:01.951628 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8211cd38-8f09-4482-9afd-f2026a074302 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:53:01.952333 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8211cd38-8f09-4482-9afd-f2026a074302 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:53:01.952797 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8211cd38-8f09-4482-9afd-f2026a074302 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:53:01.953230 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8211cd38-8f09-4482-9afd-f2026a074302 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:53:02.088367 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8211cd38-8f09-4482-9afd-f2026a074302 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:53:02.096164 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8211cd38-8f09-4482-9afd-f2026a074302 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 200 len: 1392 microversion: 2.1 time: 0.158191 Sep 24 21:53:02.096737 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3435/6892] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:53:01 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:53:03.121490 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-65cb180a-039b-48cd-9ce9-bd9941eb3d88 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:53:03.122127 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-65cb180a-039b-48cd-9ce9-bd9941eb3d88 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:53:03.124197 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:53:03.124878 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=6 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:53:03.133633 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65cb180a-039b-48cd-9ce9-bd9941eb3d88 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:53:03.134140 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65cb180a-039b-48cd-9ce9-bd9941eb3d88 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:53:03.134619 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65cb180a-039b-48cd-9ce9-bd9941eb3d88 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:53:03.135330 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65cb180a-039b-48cd-9ce9-bd9941eb3d88 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:53:03.135796 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65cb180a-039b-48cd-9ce9-bd9941eb3d88 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:53:03.136251 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-65cb180a-039b-48cd-9ce9-bd9941eb3d88 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:53:03.271712 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-65cb180a-039b-48cd-9ce9-bd9941eb3d88 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:53:03.279590 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-65cb180a-039b-48cd-9ce9-bd9941eb3d88 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 200 len: 1565 microversion: 2.1 time: 0.163120 Sep 24 21:53:03.280175 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3458/6893] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:53:03 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:53:03.303399 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ad38ee14-954d-4770-80e8-2795847abe8d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:53:03.304024 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ad38ee14-954d-4770-80e8-2795847abe8d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:53:03.305959 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:53:03.312251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad38ee14-954d-4770-80e8-2795847abe8d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:53:03.312746 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad38ee14-954d-4770-80e8-2795847abe8d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:53:03.313201 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad38ee14-954d-4770-80e8-2795847abe8d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:53:03.313915 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad38ee14-954d-4770-80e8-2795847abe8d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:53:03.314382 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad38ee14-954d-4770-80e8-2795847abe8d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:53:03.314852 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ad38ee14-954d-4770-80e8-2795847abe8d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:53:03.453059 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ad38ee14-954d-4770-80e8-2795847abe8d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:53:03.461686 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ad38ee14-954d-4770-80e8-2795847abe8d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 200 len: 1565 microversion: 2.1 time: 0.163229 Sep 24 21:53:03.462272 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3436/6894] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:53:03 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:53:05.344940 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cf8e9b82-c965-4150-9a43-9b9f007f8682 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:53:05.345578 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cf8e9b82-c965-4150-9a43-9b9f007f8682 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:53:05.354145 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf8e9b82-c965-4150-9a43-9b9f007f8682 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:53:05.354773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf8e9b82-c965-4150-9a43-9b9f007f8682 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:53:05.355092 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-89a828b2-191c-4bb5-913a-f68bca83f0d8 req-6ea8ff34-8198-4132-96ed-4baf3282177f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f049bd6-6ece-409d-91d9-c7a5a587c9f5", "tag": "92127e40-8a0a-4548-9b6a-8b8682c721fc"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:53:05.355560 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf8e9b82-c965-4150-9a43-9b9f007f8682 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:53:05.356088 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf8e9b82-c965-4150-9a43-9b9f007f8682 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:53:05.356643 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf8e9b82-c965-4150-9a43-9b9f007f8682 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:53:05.357146 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cf8e9b82-c965-4150-9a43-9b9f007f8682 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:53:05.367242 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-89a828b2-191c-4bb5-913a-f68bca83f0d8 req-6ea8ff34-8198-4132-96ed-4baf3282177f service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:53:05.367738 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-89a828b2-191c-4bb5-913a-f68bca83f0d8 req-6ea8ff34-8198-4132-96ed-4baf3282177f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:53:05.368184 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-89a828b2-191c-4bb5-913a-f68bca83f0d8 req-6ea8ff34-8198-4132-96ed-4baf3282177f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:53:05.380704 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-89a828b2-191c-4bb5-913a-f68bca83f0d8 req-6ea8ff34-8198-4132-96ed-4baf3282177f service nova] Creating event network-changed:92127e40-8a0a-4548-9b6a-8b8682c721fc for instance 8f049bd6-6ece-409d-91d9-c7a5a587c9f5 on nch1-master-1 Sep 24 21:53:05.386172 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-89a828b2-191c-4bb5-913a-f68bca83f0d8 req-6ea8ff34-8198-4132-96ed-4baf3282177f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034688 Sep 24 21:53:05.386972 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3437/6895] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:53:05.607643 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cf8e9b82-c965-4150-9a43-9b9f007f8682 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:53:05.616655 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cf8e9b82-c965-4150-9a43-9b9f007f8682 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 200 len: 1565 microversion: 2.1 time: 0.275657 Sep 24 21:53:05.617260 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3459/6896] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:53:05 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 1565 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:53:38.918901 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=5 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:53:38.919582 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=38 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:53:38.924257 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-061b72fd-0109-452e-8152-89cd3eb7f7d7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:53:38.927314 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-061b72fd-0109-452e-8152-89cd3eb7f7d7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:53:38.934295 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-061b72fd-0109-452e-8152-89cd3eb7f7d7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:53:38.935225 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-061b72fd-0109-452e-8152-89cd3eb7f7d7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:53:38.935225 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-061b72fd-0109-452e-8152-89cd3eb7f7d7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:53:38.935925 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-061b72fd-0109-452e-8152-89cd3eb7f7d7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:53:38.936388 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-061b72fd-0109-452e-8152-89cd3eb7f7d7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:53:38.936817 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-061b72fd-0109-452e-8152-89cd3eb7f7d7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:53:38.995577 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-061b72fd-0109-452e-8152-89cd3eb7f7d7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "POST /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5/action" status: 200 len: 24561 microversion: 2.1 time: 0.078834 Sep 24 21:53:38.996263 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3438/6897] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:53:38 2022] POST /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5/action => generated 24561 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:54:18.057821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:54:18.058645 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=36 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:54:18.062736 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b43011e5-5ed7-4611-9c8b-3a828bd01b2d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:54:18.065012 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b43011e5-5ed7-4611-9c8b-3a828bd01b2d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:54:18.072137 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b43011e5-5ed7-4611-9c8b-3a828bd01b2d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:18.072633 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b43011e5-5ed7-4611-9c8b-3a828bd01b2d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:18.073085 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b43011e5-5ed7-4611-9c8b-3a828bd01b2d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:18.073796 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b43011e5-5ed7-4611-9c8b-3a828bd01b2d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:18.074262 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b43011e5-5ed7-4611-9c8b-3a828bd01b2d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:18.074742 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b43011e5-5ed7-4611-9c8b-3a828bd01b2d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:18.117187 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b43011e5-5ed7-4611-9c8b-3a828bd01b2d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:54:18.123386 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b43011e5-5ed7-4611-9c8b-3a828bd01b2d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Old instance type m1.heat2, new instance type m1.heat {{(pid=140517) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 24 21:54:18.130046 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-b43011e5-5ed7-4611-9c8b-3a828bd01b2d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:54:18.130464 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-b43011e5-5ed7-4611-9c8b-3a828bd01b2d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:54:18.130979 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-b43011e5-5ed7-4611-9c8b-3a828bd01b2d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:54:18.131403 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-b43011e5-5ed7-4611-9c8b-3a828bd01b2d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:54:18.131831 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-b43011e5-5ed7-4611-9c8b-3a828bd01b2d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:54:18.196326 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b43011e5-5ed7-4611-9c8b-3a828bd01b2d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "POST /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5/action" status: 202 len: 0 microversion: 2.1 time: 0.140422 Sep 24 21:54:18.196944 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3460/6898] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:54:18 2022] POST /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:54:18.205665 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6cb65910-4e73-4043-8a54-15a576aa9408 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:54:18.206609 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6cb65910-4e73-4043-8a54-15a576aa9408 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:54:18.209175 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:54:18.209822 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=4 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:54:18.216184 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6cb65910-4e73-4043-8a54-15a576aa9408 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:18.216680 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6cb65910-4e73-4043-8a54-15a576aa9408 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:18.217125 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6cb65910-4e73-4043-8a54-15a576aa9408 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:18.217862 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6cb65910-4e73-4043-8a54-15a576aa9408 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:18.218301 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6cb65910-4e73-4043-8a54-15a576aa9408 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:18.218760 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6cb65910-4e73-4043-8a54-15a576aa9408 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:18.460576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6cb65910-4e73-4043-8a54-15a576aa9408 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:54:18.469626 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6cb65910-4e73-4043-8a54-15a576aa9408 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 200 len: 1692 microversion: 2.1 time: 0.267657 Sep 24 21:54:18.469767 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3439/6899] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:54:18 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 1692 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:54:19.496605 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a85d3243-f49a-497f-9556-f1642d0c062b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:54:19.497232 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a85d3243-f49a-497f-9556-f1642d0c062b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:54:19.505147 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a85d3243-f49a-497f-9556-f1642d0c062b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:19.505635 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a85d3243-f49a-497f-9556-f1642d0c062b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:19.506077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a85d3243-f49a-497f-9556-f1642d0c062b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:19.506807 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a85d3243-f49a-497f-9556-f1642d0c062b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:19.507276 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a85d3243-f49a-497f-9556-f1642d0c062b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:19.507708 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a85d3243-f49a-497f-9556-f1642d0c062b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:19.698806 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a85d3243-f49a-497f-9556-f1642d0c062b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:54:19.709072 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a85d3243-f49a-497f-9556-f1642d0c062b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 200 len: 1692 microversion: 2.1 time: 0.218311 Sep 24 21:54:19.709670 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3461/6900] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:54:19 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 1692 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:54:20.732496 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9e3d2bc7-620c-4ba0-b3d0-8b8d92a267e5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:54:20.733124 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9e3d2bc7-620c-4ba0-b3d0-8b8d92a267e5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:54:20.735932 ncdv-master-1 devstack@n-api.service[140516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 21:54:20.736094 ncdv-master-1 devstack@n-api.service[140516]: Sat Sep 24 21:54:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 (ip 10.222.0.52) !!! Sep 24 21:54:20.744535 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e3d2bc7-620c-4ba0-b3d0-8b8d92a267e5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:20.745047 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e3d2bc7-620c-4ba0-b3d0-8b8d92a267e5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:20.745504 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e3d2bc7-620c-4ba0-b3d0-8b8d92a267e5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:20.746231 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e3d2bc7-620c-4ba0-b3d0-8b8d92a267e5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:20.746771 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e3d2bc7-620c-4ba0-b3d0-8b8d92a267e5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:20.747214 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9e3d2bc7-620c-4ba0-b3d0-8b8d92a267e5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:20.886229 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9e3d2bc7-620c-4ba0-b3d0-8b8d92a267e5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:54:20.894063 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9e3d2bc7-620c-4ba0-b3d0-8b8d92a267e5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 200 len: 1697 microversion: 2.1 time: 0.165507 Sep 24 21:54:20.894692 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3440/6901] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:54:20 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 1697 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:54:21.918205 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8070cab2-85b4-45a1-a117-a164c2cc8b5a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:54:21.918871 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8070cab2-85b4-45a1-a117-a164c2cc8b5a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:54:21.925692 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8070cab2-85b4-45a1-a117-a164c2cc8b5a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:21.926214 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8070cab2-85b4-45a1-a117-a164c2cc8b5a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:21.926686 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8070cab2-85b4-45a1-a117-a164c2cc8b5a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:21.927645 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8070cab2-85b4-45a1-a117-a164c2cc8b5a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:21.928133 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8070cab2-85b4-45a1-a117-a164c2cc8b5a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:21.928626 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8070cab2-85b4-45a1-a117-a164c2cc8b5a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:22.062515 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8070cab2-85b4-45a1-a117-a164c2cc8b5a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:54:22.070879 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8070cab2-85b4-45a1-a117-a164c2cc8b5a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 200 len: 1697 microversion: 2.1 time: 0.157456 Sep 24 21:54:22.071456 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3462/6902] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:54:21 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:54:23.095055 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-11334cce-0228-47d5-b4a0-ce4870e5e528 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:54:23.095673 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-11334cce-0228-47d5-b4a0-ce4870e5e528 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:54:23.102780 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-11334cce-0228-47d5-b4a0-ce4870e5e528 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:23.103268 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-11334cce-0228-47d5-b4a0-ce4870e5e528 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:23.103709 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-11334cce-0228-47d5-b4a0-ce4870e5e528 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:23.104406 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-11334cce-0228-47d5-b4a0-ce4870e5e528 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:23.104895 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-11334cce-0228-47d5-b4a0-ce4870e5e528 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:23.105324 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-11334cce-0228-47d5-b4a0-ce4870e5e528 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:23.243379 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-11334cce-0228-47d5-b4a0-ce4870e5e528 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:54:23.251218 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-11334cce-0228-47d5-b4a0-ce4870e5e528 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 200 len: 1697 microversion: 2.1 time: 0.160122 Sep 24 21:54:23.251796 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3441/6903] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:54:23 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:54:24.274999 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-93d7505c-3c34-4111-ab6d-664080005da9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:54:24.275570 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-93d7505c-3c34-4111-ab6d-664080005da9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:54:24.281795 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93d7505c-3c34-4111-ab6d-664080005da9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:24.282285 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93d7505c-3c34-4111-ab6d-664080005da9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:24.282758 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93d7505c-3c34-4111-ab6d-664080005da9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:24.283460 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93d7505c-3c34-4111-ab6d-664080005da9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:24.283921 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93d7505c-3c34-4111-ab6d-664080005da9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:24.284357 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-93d7505c-3c34-4111-ab6d-664080005da9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:24.414679 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-93d7505c-3c34-4111-ab6d-664080005da9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:54:24.422513 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-93d7505c-3c34-4111-ab6d-664080005da9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 200 len: 1697 microversion: 2.1 time: 0.151672 Sep 24 21:54:24.423090 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3463/6904] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:54:24 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 1697 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:54:25.491053 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-af49925a-e679-43a4-b609-64c6c317a84d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:54:25.491680 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-af49925a-e679-43a4-b609-64c6c317a84d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:54:25.497777 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af49925a-e679-43a4-b609-64c6c317a84d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:25.498263 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af49925a-e679-43a4-b609-64c6c317a84d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:25.498729 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af49925a-e679-43a4-b609-64c6c317a84d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:25.499424 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af49925a-e679-43a4-b609-64c6c317a84d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:25.499882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af49925a-e679-43a4-b609-64c6c317a84d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:25.500343 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-af49925a-e679-43a4-b609-64c6c317a84d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:25.631658 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-af49925a-e679-43a4-b609-64c6c317a84d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:54:25.639679 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-af49925a-e679-43a4-b609-64c6c317a84d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 200 len: 1697 microversion: 2.1 time: 0.197050 Sep 24 21:54:25.640256 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3442/6905] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:54:25 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 1697 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:54:26.664415 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e9f8e8b2-a6d4-4354-8e7b-9373408bdfd6 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:54:26.665035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e9f8e8b2-a6d4-4354-8e7b-9373408bdfd6 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:54:26.671843 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9f8e8b2-a6d4-4354-8e7b-9373408bdfd6 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:26.672331 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9f8e8b2-a6d4-4354-8e7b-9373408bdfd6 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:26.672771 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9f8e8b2-a6d4-4354-8e7b-9373408bdfd6 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:26.673469 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9f8e8b2-a6d4-4354-8e7b-9373408bdfd6 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:26.673927 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9f8e8b2-a6d4-4354-8e7b-9373408bdfd6 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:26.674357 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e9f8e8b2-a6d4-4354-8e7b-9373408bdfd6 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:26.809964 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e9f8e8b2-a6d4-4354-8e7b-9373408bdfd6 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:54:26.817834 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e9f8e8b2-a6d4-4354-8e7b-9373408bdfd6 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 200 len: 1697 microversion: 2.1 time: 0.158120 Sep 24 21:54:26.818532 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3464/6906] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:54:26 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:54:27.840987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e5a36841-b1cb-452f-9935-de3177bcf76e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:54:27.841614 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e5a36841-b1cb-452f-9935-de3177bcf76e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:54:27.848456 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e5a36841-b1cb-452f-9935-de3177bcf76e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:27.849520 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e5a36841-b1cb-452f-9935-de3177bcf76e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:27.849993 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e5a36841-b1cb-452f-9935-de3177bcf76e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:27.850720 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e5a36841-b1cb-452f-9935-de3177bcf76e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:27.851181 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e5a36841-b1cb-452f-9935-de3177bcf76e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:27.851614 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e5a36841-b1cb-452f-9935-de3177bcf76e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:27.983494 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e5a36841-b1cb-452f-9935-de3177bcf76e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:54:27.991644 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e5a36841-b1cb-452f-9935-de3177bcf76e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 200 len: 1697 microversion: 2.1 time: 0.154542 Sep 24 21:54:27.992220 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3443/6907] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:54:27 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:54:29.015835 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-75df0895-c287-4ab0-b476-f9bb60931737 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:54:29.016468 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-75df0895-c287-4ab0-b476-f9bb60931737 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:54:29.024143 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75df0895-c287-4ab0-b476-f9bb60931737 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:29.024637 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75df0895-c287-4ab0-b476-f9bb60931737 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:29.025083 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75df0895-c287-4ab0-b476-f9bb60931737 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:29.025793 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75df0895-c287-4ab0-b476-f9bb60931737 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:29.026260 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75df0895-c287-4ab0-b476-f9bb60931737 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:29.026729 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75df0895-c287-4ab0-b476-f9bb60931737 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:29.164269 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-75df0895-c287-4ab0-b476-f9bb60931737 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:54:29.172098 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-75df0895-c287-4ab0-b476-f9bb60931737 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 200 len: 1697 microversion: 2.1 time: 0.160193 Sep 24 21:54:29.172676 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3465/6908] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:54:29 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:54:30.196191 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7a7775bd-3325-4c23-9f66-6204af8110cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:54:30.196795 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7a7775bd-3325-4c23-9f66-6204af8110cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:54:30.203821 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a7775bd-3325-4c23-9f66-6204af8110cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:30.204308 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a7775bd-3325-4c23-9f66-6204af8110cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:30.204743 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a7775bd-3325-4c23-9f66-6204af8110cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:30.205435 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a7775bd-3325-4c23-9f66-6204af8110cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:30.205889 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a7775bd-3325-4c23-9f66-6204af8110cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:30.206314 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7a7775bd-3325-4c23-9f66-6204af8110cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:30.343922 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7a7775bd-3325-4c23-9f66-6204af8110cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:54:30.352403 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7a7775bd-3325-4c23-9f66-6204af8110cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 200 len: 1697 microversion: 2.1 time: 0.160272 Sep 24 21:54:30.352981 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3444/6909] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:54:30 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:54:31.375909 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-efee79e9-889d-4259-ba0e-096cf78a68c7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:54:31.376547 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-efee79e9-889d-4259-ba0e-096cf78a68c7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:54:31.384297 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-efee79e9-889d-4259-ba0e-096cf78a68c7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:31.384786 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-efee79e9-889d-4259-ba0e-096cf78a68c7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:31.385227 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-efee79e9-889d-4259-ba0e-096cf78a68c7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:31.385923 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-efee79e9-889d-4259-ba0e-096cf78a68c7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:31.386380 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-efee79e9-889d-4259-ba0e-096cf78a68c7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:31.386835 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-efee79e9-889d-4259-ba0e-096cf78a68c7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:31.518950 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-efee79e9-889d-4259-ba0e-096cf78a68c7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:54:31.527030 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-efee79e9-889d-4259-ba0e-096cf78a68c7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 200 len: 1697 microversion: 2.1 time: 0.155042 Sep 24 21:54:31.527607 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3466/6910] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:54:31 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:54:32.550990 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4ab10307-225e-4014-8d30-430d52dfbcdd tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:54:32.551624 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4ab10307-225e-4014-8d30-430d52dfbcdd tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:54:32.559482 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ab10307-225e-4014-8d30-430d52dfbcdd tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:32.559978 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ab10307-225e-4014-8d30-430d52dfbcdd tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:32.560428 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ab10307-225e-4014-8d30-430d52dfbcdd tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:32.561136 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ab10307-225e-4014-8d30-430d52dfbcdd tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:32.561603 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ab10307-225e-4014-8d30-430d52dfbcdd tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:32.562044 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ab10307-225e-4014-8d30-430d52dfbcdd tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:32.698368 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4ab10307-225e-4014-8d30-430d52dfbcdd tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:54:32.706140 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4ab10307-225e-4014-8d30-430d52dfbcdd tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 200 len: 1697 microversion: 2.1 time: 0.159205 Sep 24 21:54:32.706766 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3445/6911] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:54:32 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:54:33.729496 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3e50091b-0ef8-4f1a-a027-c35c9fd05e8c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:54:33.730126 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3e50091b-0ef8-4f1a-a027-c35c9fd05e8c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:54:33.737339 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e50091b-0ef8-4f1a-a027-c35c9fd05e8c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:33.737867 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e50091b-0ef8-4f1a-a027-c35c9fd05e8c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:33.738323 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e50091b-0ef8-4f1a-a027-c35c9fd05e8c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:33.739082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e50091b-0ef8-4f1a-a027-c35c9fd05e8c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:33.739697 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e50091b-0ef8-4f1a-a027-c35c9fd05e8c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:33.740143 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3e50091b-0ef8-4f1a-a027-c35c9fd05e8c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:33.881178 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3e50091b-0ef8-4f1a-a027-c35c9fd05e8c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:54:33.888982 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3e50091b-0ef8-4f1a-a027-c35c9fd05e8c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 200 len: 1697 microversion: 2.1 time: 0.163506 Sep 24 21:54:33.889571 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3467/6912] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:54:33 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:54:34.911162 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-67201ed6-310f-4c8a-be75-1287a839e85c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:54:34.911776 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-67201ed6-310f-4c8a-be75-1287a839e85c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:54:34.918762 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67201ed6-310f-4c8a-be75-1287a839e85c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:34.919253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67201ed6-310f-4c8a-be75-1287a839e85c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:34.919700 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67201ed6-310f-4c8a-be75-1287a839e85c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:34.920400 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67201ed6-310f-4c8a-be75-1287a839e85c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:34.920865 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67201ed6-310f-4c8a-be75-1287a839e85c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:34.921301 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-67201ed6-310f-4c8a-be75-1287a839e85c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:35.057094 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-67201ed6-310f-4c8a-be75-1287a839e85c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:54:35.064891 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-67201ed6-310f-4c8a-be75-1287a839e85c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 200 len: 1697 microversion: 2.1 time: 0.157761 Sep 24 21:54:35.065463 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3446/6913] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:54:34 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:54:36.089541 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-58da3984-90e3-4eae-bed8-678cac64f9ee tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:54:36.090202 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-58da3984-90e3-4eae-bed8-678cac64f9ee tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:54:36.097092 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58da3984-90e3-4eae-bed8-678cac64f9ee tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:36.097584 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58da3984-90e3-4eae-bed8-678cac64f9ee tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:36.098032 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58da3984-90e3-4eae-bed8-678cac64f9ee tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:36.098762 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58da3984-90e3-4eae-bed8-678cac64f9ee tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:36.099225 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58da3984-90e3-4eae-bed8-678cac64f9ee tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:36.099656 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-58da3984-90e3-4eae-bed8-678cac64f9ee tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:36.230420 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-58da3984-90e3-4eae-bed8-678cac64f9ee tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:54:36.238142 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-58da3984-90e3-4eae-bed8-678cac64f9ee tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 200 len: 1697 microversion: 2.1 time: 0.152486 Sep 24 21:54:36.238736 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3468/6914] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:54:36 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 1697 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:54:37.267980 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3035da61-a4a4-4bcd-95d4-07c7f7345257 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:54:37.268390 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3035da61-a4a4-4bcd-95d4-07c7f7345257 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:54:37.277142 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3035da61-a4a4-4bcd-95d4-07c7f7345257 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:37.277645 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3035da61-a4a4-4bcd-95d4-07c7f7345257 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:37.278096 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3035da61-a4a4-4bcd-95d4-07c7f7345257 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:37.278841 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3035da61-a4a4-4bcd-95d4-07c7f7345257 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:37.280138 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3035da61-a4a4-4bcd-95d4-07c7f7345257 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:37.280138 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3035da61-a4a4-4bcd-95d4-07c7f7345257 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:37.428329 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3035da61-a4a4-4bcd-95d4-07c7f7345257 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:54:37.436463 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3035da61-a4a4-4bcd-95d4-07c7f7345257 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 200 len: 1697 microversion: 2.1 time: 0.174423 Sep 24 21:54:37.437213 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3447/6915] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:54:37 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 1697 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:54:38.266064 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-798852af-3228-4fbc-bd33-c9b578a3e391 req-fc4811aa-ac0d-40bb-9d67-98f61918de71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f049bd6-6ece-409d-91d9-c7a5a587c9f5", "name": "network-vif-unplugged", "status": "completed", "tag": "92127e40-8a0a-4548-9b6a-8b8682c721fc"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:54:38.276666 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-798852af-3228-4fbc-bd33-c9b578a3e391 req-fc4811aa-ac0d-40bb-9d67-98f61918de71 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:38.277159 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-798852af-3228-4fbc-bd33-c9b578a3e391 req-fc4811aa-ac0d-40bb-9d67-98f61918de71 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:38.277620 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-798852af-3228-4fbc-bd33-c9b578a3e391 req-fc4811aa-ac0d-40bb-9d67-98f61918de71 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:38.294228 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-798852af-3228-4fbc-bd33-c9b578a3e391 req-fc4811aa-ac0d-40bb-9d67-98f61918de71 service nova] Creating event network-vif-unplugged:92127e40-8a0a-4548-9b6a-8b8682c721fc for instance 8f049bd6-6ece-409d-91d9-c7a5a587c9f5 on nch2-master-1 Sep 24 21:54:38.299762 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [req-798852af-3228-4fbc-bd33-c9b578a3e391 req-fc4811aa-ac0d-40bb-9d67-98f61918de71 service nova] Instance 8f049bd6-6ece-409d-91d9-c7a5a587c9f5 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 21:54:38.311422 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-798852af-3228-4fbc-bd33-c9b578a3e391 req-fc4811aa-ac0d-40bb-9d67-98f61918de71 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103615 Sep 24 21:54:38.312057 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3469/6916] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:54:38.461658 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4ff251ea-9e92-4733-855f-7359e7c8d273 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:54:38.462214 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4ff251ea-9e92-4733-855f-7359e7c8d273 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:54:38.469073 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ff251ea-9e92-4733-855f-7359e7c8d273 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:38.469554 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ff251ea-9e92-4733-855f-7359e7c8d273 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:38.469996 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ff251ea-9e92-4733-855f-7359e7c8d273 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:38.470726 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ff251ea-9e92-4733-855f-7359e7c8d273 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:38.471187 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ff251ea-9e92-4733-855f-7359e7c8d273 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:38.471617 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4ff251ea-9e92-4733-855f-7359e7c8d273 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:38.665771 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4ff251ea-9e92-4733-855f-7359e7c8d273 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:54:38.673576 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4ff251ea-9e92-4733-855f-7359e7c8d273 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 200 len: 1696 microversion: 2.1 time: 0.216227 Sep 24 21:54:38.674273 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3448/6917] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:54:38 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 1696 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:54:39.699709 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2e8a25ee-9dc8-4461-ab96-f604067035f4 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:54:39.700450 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2e8a25ee-9dc8-4461-ab96-f604067035f4 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:54:39.706807 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2e8a25ee-9dc8-4461-ab96-f604067035f4 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:39.707299 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2e8a25ee-9dc8-4461-ab96-f604067035f4 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:39.707748 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2e8a25ee-9dc8-4461-ab96-f604067035f4 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:39.709116 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2e8a25ee-9dc8-4461-ab96-f604067035f4 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:39.709585 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2e8a25ee-9dc8-4461-ab96-f604067035f4 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:39.710023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2e8a25ee-9dc8-4461-ab96-f604067035f4 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:39.844794 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2e8a25ee-9dc8-4461-ab96-f604067035f4 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:54:39.852692 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2e8a25ee-9dc8-4461-ab96-f604067035f4 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 200 len: 1694 microversion: 2.1 time: 0.158227 Sep 24 21:54:39.853273 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3470/6918] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:54:39 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 1694 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:54:40.330315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-967f560b-b584-46d5-8061-2d72b7d4eabb req-886160e4-41ca-41d3-ae6c-92d2edf64c23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f049bd6-6ece-409d-91d9-c7a5a587c9f5", "tag": "92127e40-8a0a-4548-9b6a-8b8682c721fc"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:54:40.341167 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-967f560b-b584-46d5-8061-2d72b7d4eabb req-886160e4-41ca-41d3-ae6c-92d2edf64c23 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:40.341641 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-967f560b-b584-46d5-8061-2d72b7d4eabb req-886160e4-41ca-41d3-ae6c-92d2edf64c23 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:40.342074 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-967f560b-b584-46d5-8061-2d72b7d4eabb req-886160e4-41ca-41d3-ae6c-92d2edf64c23 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:40.353567 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-967f560b-b584-46d5-8061-2d72b7d4eabb req-886160e4-41ca-41d3-ae6c-92d2edf64c23 service nova] Creating event network-changed:92127e40-8a0a-4548-9b6a-8b8682c721fc for instance 8f049bd6-6ece-409d-91d9-c7a5a587c9f5 on nch2-master-1 Sep 24 21:54:40.358835 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [req-967f560b-b584-46d5-8061-2d72b7d4eabb req-886160e4-41ca-41d3-ae6c-92d2edf64c23 service nova] Instance 8f049bd6-6ece-409d-91d9-c7a5a587c9f5 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 21:54:40.370367 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-967f560b-b584-46d5-8061-2d72b7d4eabb req-886160e4-41ca-41d3-ae6c-92d2edf64c23 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043810 Sep 24 21:54:40.370987 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3449/6919] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:54:40.877550 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3d3af8f5-c8b5-473c-8d54-950ca3978a21 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:54:40.878122 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3d3af8f5-c8b5-473c-8d54-950ca3978a21 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:54:40.886869 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d3af8f5-c8b5-473c-8d54-950ca3978a21 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:40.887462 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d3af8f5-c8b5-473c-8d54-950ca3978a21 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:40.888005 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d3af8f5-c8b5-473c-8d54-950ca3978a21 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:40.888825 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d3af8f5-c8b5-473c-8d54-950ca3978a21 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:40.889390 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d3af8f5-c8b5-473c-8d54-950ca3978a21 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:40.889893 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d3af8f5-c8b5-473c-8d54-950ca3978a21 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:41.186278 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3d3af8f5-c8b5-473c-8d54-950ca3978a21 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:54:41.195349 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3d3af8f5-c8b5-473c-8d54-950ca3978a21 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 200 len: 1694 microversion: 2.1 time: 0.322381 Sep 24 21:54:41.195954 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3471/6920] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:54:40 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 1694 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:54:42.220882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7637e12f-aee1-496c-9aa6-513bc5bda134 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:54:42.221620 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7637e12f-aee1-496c-9aa6-513bc5bda134 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:54:42.229467 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7637e12f-aee1-496c-9aa6-513bc5bda134 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:42.229948 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7637e12f-aee1-496c-9aa6-513bc5bda134 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:42.230389 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7637e12f-aee1-496c-9aa6-513bc5bda134 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:42.231112 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7637e12f-aee1-496c-9aa6-513bc5bda134 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:42.231574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7637e12f-aee1-496c-9aa6-513bc5bda134 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:42.232002 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7637e12f-aee1-496c-9aa6-513bc5bda134 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:42.367761 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7637e12f-aee1-496c-9aa6-513bc5bda134 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:54:42.375623 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7637e12f-aee1-496c-9aa6-513bc5bda134 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 200 len: 1691 microversion: 2.1 time: 0.159120 Sep 24 21:54:42.376202 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3450/6921] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:54:42 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:54:42.398579 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dcff7011-0653-4f8a-953e-96e16c2241eb tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:54:42.399111 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dcff7011-0653-4f8a-953e-96e16c2241eb tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:54:42.405984 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dcff7011-0653-4f8a-953e-96e16c2241eb tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:42.406476 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dcff7011-0653-4f8a-953e-96e16c2241eb tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:42.406962 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dcff7011-0653-4f8a-953e-96e16c2241eb tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:42.407663 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dcff7011-0653-4f8a-953e-96e16c2241eb tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:42.408125 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dcff7011-0653-4f8a-953e-96e16c2241eb tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:42.408555 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dcff7011-0653-4f8a-953e-96e16c2241eb tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:42.470024 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dcff7011-0653-4f8a-953e-96e16c2241eb tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "POST /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5/action" status: 204 len: 0 microversion: 2.1 time: 0.075821 Sep 24 21:54:42.470748 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3472/6922] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:54:42 2022] POST /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 24 21:54:42.479824 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-885dd115-8c57-4b50-8226-3c5b32b572bc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:54:42.480383 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-885dd115-8c57-4b50-8226-3c5b32b572bc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:54:42.486416 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-885dd115-8c57-4b50-8226-3c5b32b572bc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:42.486963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-885dd115-8c57-4b50-8226-3c5b32b572bc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:42.487413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-885dd115-8c57-4b50-8226-3c5b32b572bc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:42.488128 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-885dd115-8c57-4b50-8226-3c5b32b572bc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:42.488591 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-885dd115-8c57-4b50-8226-3c5b32b572bc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:42.489168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-885dd115-8c57-4b50-8226-3c5b32b572bc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:42.703787 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-885dd115-8c57-4b50-8226-3c5b32b572bc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:54:42.712554 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-885dd115-8c57-4b50-8226-3c5b32b572bc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 200 len: 1691 microversion: 2.1 time: 0.236764 Sep 24 21:54:42.713158 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3451/6923] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:54:42 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 1691 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:54:42.736259 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-97843bea-0b4e-4853-b134-9daeb49efc84 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:54:42.736900 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-97843bea-0b4e-4853-b134-9daeb49efc84 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:54:42.744020 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97843bea-0b4e-4853-b134-9daeb49efc84 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:42.744520 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97843bea-0b4e-4853-b134-9daeb49efc84 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:42.744973 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97843bea-0b4e-4853-b134-9daeb49efc84 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:42.745686 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97843bea-0b4e-4853-b134-9daeb49efc84 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:42.746153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97843bea-0b4e-4853-b134-9daeb49efc84 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:42.746626 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97843bea-0b4e-4853-b134-9daeb49efc84 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:42.966305 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-97843bea-0b4e-4853-b134-9daeb49efc84 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:54:42.975357 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-97843bea-0b4e-4853-b134-9daeb49efc84 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 200 len: 1691 microversion: 2.1 time: 0.243346 Sep 24 21:54:42.975957 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3473/6924] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:54:42 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 1691 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:54:43.442736 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-b3723460-46dc-4fab-a5a8-117a63ae2a25 req-1d0de7d8-a262-479f-a1d5-491e0fd9b760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f049bd6-6ece-409d-91d9-c7a5a587c9f5", "name": "network-vif-plugged", "status": "completed", "tag": "92127e40-8a0a-4548-9b6a-8b8682c721fc"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:54:43.462567 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-b3723460-46dc-4fab-a5a8-117a63ae2a25 req-1d0de7d8-a262-479f-a1d5-491e0fd9b760 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:43.463477 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-b3723460-46dc-4fab-a5a8-117a63ae2a25 req-1d0de7d8-a262-479f-a1d5-491e0fd9b760 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:43.464195 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-b3723460-46dc-4fab-a5a8-117a63ae2a25 req-1d0de7d8-a262-479f-a1d5-491e0fd9b760 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:43.481870 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-b3723460-46dc-4fab-a5a8-117a63ae2a25 req-1d0de7d8-a262-479f-a1d5-491e0fd9b760 service nova] Creating event network-vif-plugged:92127e40-8a0a-4548-9b6a-8b8682c721fc for instance 8f049bd6-6ece-409d-91d9-c7a5a587c9f5 on nch2-master-1 Sep 24 21:54:43.490844 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [req-b3723460-46dc-4fab-a5a8-117a63ae2a25 req-1d0de7d8-a262-479f-a1d5-491e0fd9b760 service nova] Instance 8f049bd6-6ece-409d-91d9-c7a5a587c9f5 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 24 21:54:43.503795 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-b3723460-46dc-4fab-a5a8-117a63ae2a25 req-1d0de7d8-a262-479f-a1d5-491e0fd9b760 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138218 Sep 24 21:54:43.505107 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3452/6925] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:54:43.999465 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7e64c972-d133-4bae-af84-3b5ec35439d3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:54:44.000575 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7e64c972-d133-4bae-af84-3b5ec35439d3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:54:44.008642 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7e64c972-d133-4bae-af84-3b5ec35439d3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:44.009148 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7e64c972-d133-4bae-af84-3b5ec35439d3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:44.010254 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7e64c972-d133-4bae-af84-3b5ec35439d3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:44.011188 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7e64c972-d133-4bae-af84-3b5ec35439d3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:54:44.012219 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7e64c972-d133-4bae-af84-3b5ec35439d3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:54:44.012928 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7e64c972-d133-4bae-af84-3b5ec35439d3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:54:44.029980 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:54:44.150265 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7e64c972-d133-4bae-af84-3b5ec35439d3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:54:44.158211 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7e64c972-d133-4bae-af84-3b5ec35439d3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 200 len: 1683 microversion: 2.1 time: 0.163086 Sep 24 21:54:44.158814 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3474/6926] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:54:43 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:55:06.337627 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=28 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:55:06.338516 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=80 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:55:06.342792 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ab879768-be80-4a7c-a11f-b7ffacf8be99 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:55:06.345137 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ab879768-be80-4a7c-a11f-b7ffacf8be99 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:55:06.352334 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab879768-be80-4a7c-a11f-b7ffacf8be99 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:06.352820 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab879768-be80-4a7c-a11f-b7ffacf8be99 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:06.353268 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab879768-be80-4a7c-a11f-b7ffacf8be99 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:06.353977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab879768-be80-4a7c-a11f-b7ffacf8be99 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:06.354440 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab879768-be80-4a7c-a11f-b7ffacf8be99 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:06.354905 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ab879768-be80-4a7c-a11f-b7ffacf8be99 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:06.424469 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ab879768-be80-4a7c-a11f-b7ffacf8be99 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "POST /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5/action" status: 200 len: 24574 microversion: 2.1 time: 0.088654 Sep 24 21:55:06.425117 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3453/6927] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:55:06 2022] POST /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5/action => generated 24574 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:55:13.721770 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-abe8d6b6-e073-48e6-b0dc-114e64217357 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:55:13.722274 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-abe8d6b6-e073-48e6-b0dc-114e64217357 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:55:13.729081 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-2d00dd33-8610-4b49-939e-ee1d6e68bbaa req-8f0a49e6-1d88-485e-9371-c40850cb56f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f049bd6-6ece-409d-91d9-c7a5a587c9f5", "tag": "92127e40-8a0a-4548-9b6a-8b8682c721fc"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:55:13.732660 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=34 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:55:13.733339 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:55:13.742894 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-abe8d6b6-e073-48e6-b0dc-114e64217357 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:13.743385 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-abe8d6b6-e073-48e6-b0dc-114e64217357 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:13.743823 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-abe8d6b6-e073-48e6-b0dc-114e64217357 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:13.744532 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-abe8d6b6-e073-48e6-b0dc-114e64217357 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:13.744990 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-abe8d6b6-e073-48e6-b0dc-114e64217357 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:13.745420 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-abe8d6b6-e073-48e6-b0dc-114e64217357 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:13.757149 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-2d00dd33-8610-4b49-939e-ee1d6e68bbaa req-8f0a49e6-1d88-485e-9371-c40850cb56f6 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:13.758140 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-2d00dd33-8610-4b49-939e-ee1d6e68bbaa req-8f0a49e6-1d88-485e-9371-c40850cb56f6 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:13.758884 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-2d00dd33-8610-4b49-939e-ee1d6e68bbaa req-8f0a49e6-1d88-485e-9371-c40850cb56f6 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:13.773037 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-2d00dd33-8610-4b49-939e-ee1d6e68bbaa req-8f0a49e6-1d88-485e-9371-c40850cb56f6 service nova] Creating event network-changed:92127e40-8a0a-4548-9b6a-8b8682c721fc for instance 8f049bd6-6ece-409d-91d9-c7a5a587c9f5 on nch2-master-1 Sep 24 21:55:13.777891 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-abe8d6b6-e073-48e6-b0dc-114e64217357 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:55:13.778472 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-2d00dd33-8610-4b49-939e-ee1d6e68bbaa req-8f0a49e6-1d88-485e-9371-c40850cb56f6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054204 Sep 24 21:55:13.780370 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3454/6928] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:55:13.871473 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-abe8d6b6-e073-48e6-b0dc-114e64217357 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 204 len: 0 microversion: 2.1 time: 0.153791 Sep 24 21:55:13.872798 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3475/6929] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:55:13 2022] DELETE /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:55:13.884034 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-54646e00-2061-4f27-88a3-5f31986af927 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:55:13.884855 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-54646e00-2061-4f27-88a3-5f31986af927 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:55:13.891735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-54646e00-2061-4f27-88a3-5f31986af927 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:13.892315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-54646e00-2061-4f27-88a3-5f31986af927 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:13.892825 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-54646e00-2061-4f27-88a3-5f31986af927 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:13.893505 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-54646e00-2061-4f27-88a3-5f31986af927 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:13.893973 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-54646e00-2061-4f27-88a3-5f31986af927 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:13.894414 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-54646e00-2061-4f27-88a3-5f31986af927 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:14.028676 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-54646e00-2061-4f27-88a3-5f31986af927 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:55:14.036622 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-54646e00-2061-4f27-88a3-5f31986af927 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 200 len: 1689 microversion: 2.1 time: 0.159078 Sep 24 21:55:14.037198 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3455/6930] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:55:13 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:55:15.061961 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-fa16a269-3d8a-4c85-a6ac-80c64e7b7292 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:55:15.062708 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-fa16a269-3d8a-4c85-a6ac-80c64e7b7292 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:55:15.069561 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa16a269-3d8a-4c85-a6ac-80c64e7b7292 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:15.070173 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa16a269-3d8a-4c85-a6ac-80c64e7b7292 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:15.070640 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa16a269-3d8a-4c85-a6ac-80c64e7b7292 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:15.071354 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa16a269-3d8a-4c85-a6ac-80c64e7b7292 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:15.071826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa16a269-3d8a-4c85-a6ac-80c64e7b7292 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:15.072264 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-fa16a269-3d8a-4c85-a6ac-80c64e7b7292 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:15.266214 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-fa16a269-3d8a-4c85-a6ac-80c64e7b7292 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:55:15.274852 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-fa16a269-3d8a-4c85-a6ac-80c64e7b7292 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 200 len: 1689 microversion: 2.1 time: 0.217090 Sep 24 21:55:15.275437 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3476/6931] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:55:15 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 1689 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:55:15.832833 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-c0e6b72b-538a-4538-87ae-29b1b4716dfd req-e81db2f7-bc06-4669-9c1c-286c51f8193f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f049bd6-6ece-409d-91d9-c7a5a587c9f5", "name": "network-vif-deleted", "tag": "92127e40-8a0a-4548-9b6a-8b8682c721fc"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:55:15.847462 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c0e6b72b-538a-4538-87ae-29b1b4716dfd req-e81db2f7-bc06-4669-9c1c-286c51f8193f service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:15.847938 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c0e6b72b-538a-4538-87ae-29b1b4716dfd req-e81db2f7-bc06-4669-9c1c-286c51f8193f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:15.848372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c0e6b72b-538a-4538-87ae-29b1b4716dfd req-e81db2f7-bc06-4669-9c1c-286c51f8193f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:15.861041 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-c0e6b72b-538a-4538-87ae-29b1b4716dfd req-e81db2f7-bc06-4669-9c1c-286c51f8193f service nova] Creating event network-vif-deleted:92127e40-8a0a-4548-9b6a-8b8682c721fc for instance 8f049bd6-6ece-409d-91d9-c7a5a587c9f5 on nch2-master-1 Sep 24 21:55:15.867606 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-c0e6b72b-538a-4538-87ae-29b1b4716dfd req-e81db2f7-bc06-4669-9c1c-286c51f8193f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038216 Sep 24 21:55:15.868539 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3456/6932] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:55:16.299000 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-673798cd-3b72-477b-a4f8-5734306fdc30 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:55:16.299634 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-673798cd-3b72-477b-a4f8-5734306fdc30 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:55:16.307324 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-673798cd-3b72-477b-a4f8-5734306fdc30 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:16.307824 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-673798cd-3b72-477b-a4f8-5734306fdc30 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:16.308272 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-673798cd-3b72-477b-a4f8-5734306fdc30 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:16.309014 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-673798cd-3b72-477b-a4f8-5734306fdc30 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:16.309470 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-673798cd-3b72-477b-a4f8-5734306fdc30 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:16.309978 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-673798cd-3b72-477b-a4f8-5734306fdc30 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:16.344012 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-673798cd-3b72-477b-a4f8-5734306fdc30 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:16.344438 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-673798cd-3b72-477b-a4f8-5734306fdc30 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:16.344890 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-673798cd-3b72-477b-a4f8-5734306fdc30 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:16.345358 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-673798cd-3b72-477b-a4f8-5734306fdc30 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lazy-loading 'fault' on Instance uuid 8f049bd6-6ece-409d-91d9-c7a5a587c9f5 {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:55:16.395171 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-673798cd-3b72-477b-a4f8-5734306fdc30 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:55:16.402978 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-673798cd-3b72-477b-a4f8-5734306fdc30 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 200 len: 1357 microversion: 2.1 time: 0.107810 Sep 24 21:55:16.403769 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3477/6933] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:55:16 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 1357 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:55:17.427784 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7273f4bb-ff0b-44cc-a268-47485c9dfcad tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:55:17.428505 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7273f4bb-ff0b-44cc-a268-47485c9dfcad tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 8f049bd6-6ece-409d-91d9-c7a5a587c9f5] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:55:17.436514 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7273f4bb-ff0b-44cc-a268-47485c9dfcad tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:17.437006 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7273f4bb-ff0b-44cc-a268-47485c9dfcad tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:17.437470 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7273f4bb-ff0b-44cc-a268-47485c9dfcad tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:17.438183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7273f4bb-ff0b-44cc-a268-47485c9dfcad tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:17.438696 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7273f4bb-ff0b-44cc-a268-47485c9dfcad tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:17.439134 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7273f4bb-ff0b-44cc-a268-47485c9dfcad tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:17.452856 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-7273f4bb-ff0b-44cc-a268-47485c9dfcad tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] HTTP exception thrown: Instance 8f049bd6-6ece-409d-91d9-c7a5a587c9f5 could not be found. Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7273f4bb-ff0b-44cc-a268-47485c9dfcad tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Request method failure captured: Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 HTTP/1.1 Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3tlY6TxOcKA9sot6kAGfifiAT7Y-vlZYlV4mDyOhDhn0ty7VdV5tSo8UlXtPCa-WwNM_dIQLhLmZ-frXjrk-rwgBb_zUbuuXPjO6n3Y8yIkG02m1UafCrWL7DDdBlhrGINN8GSujPX_7p_Mvu6-XCMNk6noAMPUuRqhchaAZc_WaoM Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 22a8ea7438b641139afc6ea3c2dcba4c Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1351374344 Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/22a8ea7438b641139afc6ea3c2dcba4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_22a8ea7438b641139afc6ea3c2dcba4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/22a8ea7438b641139afc6ea3c2dcba4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/22a8ea7438b641139afc6ea3c2dcba4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1351374344 Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 22a8ea7438b641139afc6ea3c2dcba4c Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1351374344 Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-TestNetworkAdvancedServerOps-1351374344-project Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: ce56b96d91fa42029081bd0e6eccb5e4 Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1351374344-project Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 8f049bd6-6ece-409d-91d9-c7a5a587c9f5 could not be found. Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '8f049bd6-6ece-409d-91d9-c7a5a587c9f5'} Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f049bd6-6ece-409d-91d9-c7a5a587c9f5 could not be found. Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f049bd6-6ece-409d-91d9-c7a5a587c9f5 could not be found. Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:55:17.454489 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:55:17.459340 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:55:17.459340 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:55:17.459340 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:55:17.459340 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:55:17.459340 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:55:17.459340 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:55:17.459340 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f049bd6-6ece-409d-91d9-c7a5a587c9f5 could not be found. Sep 24 21:55:17.459340 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:55:17.459340 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7273f4bb-ff0b-44cc-a268-47485c9dfcad tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Returning 404 to user: Instance 8f049bd6-6ece-409d-91d9-c7a5a587c9f5 could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:55:17.459340 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7273f4bb-ff0b-44cc-a268-47485c9dfcad tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5" status: 404 len: 111 microversion: 2.1 time: 0.032662 Sep 24 21:55:17.459340 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3457/6934] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:55:17 2022] GET /compute/v2.1/servers/8f049bd6-6ece-409d-91d9-c7a5a587c9f5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:55:20.817321 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b2f6eb0b-1693-4ff3-8532-2b591e912722 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '.version_select at 0x7f4b07c39c10>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:55:20.823697 ncdv-master-1 devstack@n-api.service[140517]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b2f6eb0b-1693-4ff3-8532-2b591e912722 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [de7b8b7b-54d6-4e53-b1ab-4e8ebdfe9f8a] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 24 21:55:21.832431 ncdv-master-1 devstack@n-api.service[140517]: INFO oslo.messaging._drivers.impl_rabbit [None req-b2f6eb0b-1693-4ff3-8532-2b591e912722 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [de7b8b7b-54d6-4e53-b1ab-4e8ebdfe9f8a] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 59430. Sep 24 21:55:21.853543 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b2f6eb0b-1693-4ff3-8532-2b591e912722 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1755799080" status: 202 len: 0 microversion: 2.1 time: 1.040402 Sep 24 21:55:21.854159 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3478/6935] 10.222.0.52 () {58 vars in 1284 bytes} [Sat Sep 24 21:55:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1755799080 => generated 0 bytes in 1042 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:55:21.883089 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-05adc2f0-674b-44f5-972b-2bbb5fd0142e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Action: 'create', calling method: .version_select at 0x7f4b0caffd30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1431068195", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFm+P9syoKA7pwnDA+AkgYxzgPmWzBglAPqrgXt80Qy5Xj6c6CNOMn4AxUqX+QOiCmJn03IFWQrh7LH06J9ANpet3PhjguCME5qBS4ZYxqqu1rYEqRYPac8UN9453DSQaQ=="}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:55:21.900116 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-05adc2f0-674b-44f5-972b-2bbb5fd0142e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Getting quotas for project 22a8ea7438b641139afc6ea3c2dcba4c. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:55:21.905275 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-05adc2f0-674b-44f5-972b-2bbb5fd0142e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Getting quotas for user ce56b96d91fa42029081bd0e6eccb5e4 and project 22a8ea7438b641139afc6ea3c2dcba4c. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:55:21.930165 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-05adc2f0-674b-44f5-972b-2bbb5fd0142e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050704 Sep 24 21:55:21.930943 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3458/6936] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 21:55:21 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:55:27.414690 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:55:27.418857 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c933de46-534c-4aa5-9829-78a40f373ee9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-160525916", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "d3b33097-10a7-45a3-8c1b-72454a0ff13f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1431068195", "security_groups": [{"name": "tempest-secgroup-smoke-263666792"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:55:27.542927 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-c933de46-534c-4aa5-9829-78a40f373ee9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] validate_networks() for [('d3b33097-10a7-45a3-8c1b-72454a0ff13f', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:55:27.997024 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-c933de46-534c-4aa5-9829-78a40f373ee9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:55:27.997629 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-c933de46-534c-4aa5-9829-78a40f373ee9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:55:27.998124 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-c933de46-534c-4aa5-9829-78a40f373ee9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:55:27.998574 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-c933de46-534c-4aa5-9829-78a40f373ee9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:55:27.999017 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-c933de46-534c-4aa5-9829-78a40f373ee9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:55:28.008833 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c933de46-534c-4aa5-9829-78a40f373ee9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:28.011018 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c933de46-534c-4aa5-9829-78a40f373ee9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:28.011549 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c933de46-534c-4aa5-9829-78a40f373ee9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:28.012406 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c933de46-534c-4aa5-9829-78a40f373ee9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:28.012950 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c933de46-534c-4aa5-9829-78a40f373ee9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:28.013461 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c933de46-534c-4aa5-9829-78a40f373ee9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:28.033560 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-c933de46-534c-4aa5-9829-78a40f373ee9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Getting quotas for project 22a8ea7438b641139afc6ea3c2dcba4c. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:55:28.039967 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-c933de46-534c-4aa5-9829-78a40f373ee9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Getting quotas for user ce56b96d91fa42029081bd0e6eccb5e4 and project 22a8ea7438b641139afc6ea3c2dcba4c. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:55:28.054658 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c933de46-534c-4aa5-9829-78a40f373ee9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:55:28.057022 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c933de46-534c-4aa5-9829-78a40f373ee9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:55:28.108752 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c933de46-534c-4aa5-9829-78a40f373ee9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.696429 Sep 24 21:55:28.114672 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3479/6937] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:55:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:55:28.124372 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-15730319-f8da-454f-aaf2-156a7e258bc6 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:55:28.125009 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-15730319-f8da-454f-aaf2-156a7e258bc6 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:55:28.128915 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=16 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:55:28.190462 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-15730319-f8da-454f-aaf2-156a7e258bc6 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:55:28.200980 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-15730319-f8da-454f-aaf2-156a7e258bc6 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e" status: 200 len: 1266 microversion: 2.1 time: 0.082283 Sep 24 21:55:28.201627 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3459/6938] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:55:28 2022] GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:55:29.225139 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4025d6bc-b4db-4943-b0d6-b90ba4d81a1e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:55:29.225850 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4025d6bc-b4db-4943-b0d6-b90ba4d81a1e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:55:29.233409 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4025d6bc-b4db-4943-b0d6-b90ba4d81a1e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:29.234170 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4025d6bc-b4db-4943-b0d6-b90ba4d81a1e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:29.234833 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4025d6bc-b4db-4943-b0d6-b90ba4d81a1e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:29.235739 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4025d6bc-b4db-4943-b0d6-b90ba4d81a1e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:29.236376 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4025d6bc-b4db-4943-b0d6-b90ba4d81a1e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:29.237022 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4025d6bc-b4db-4943-b0d6-b90ba4d81a1e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:29.304623 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4025d6bc-b4db-4943-b0d6-b90ba4d81a1e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:55:29.313034 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4025d6bc-b4db-4943-b0d6-b90ba4d81a1e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e" status: 200 len: 1326 microversion: 2.1 time: 0.092655 Sep 24 21:55:29.320681 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3480/6939] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:55:29 2022] GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e => generated 1326 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:55:30.347848 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f6a16c8d-b455-4dbb-8e0f-833eefff52f8 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:55:30.349168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f6a16c8d-b455-4dbb-8e0f-833eefff52f8 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:55:30.359677 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6a16c8d-b455-4dbb-8e0f-833eefff52f8 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:30.360419 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6a16c8d-b455-4dbb-8e0f-833eefff52f8 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:30.361115 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6a16c8d-b455-4dbb-8e0f-833eefff52f8 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:30.366388 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6a16c8d-b455-4dbb-8e0f-833eefff52f8 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:30.368955 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6a16c8d-b455-4dbb-8e0f-833eefff52f8 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:30.369511 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f6a16c8d-b455-4dbb-8e0f-833eefff52f8 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:30.520936 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f6a16c8d-b455-4dbb-8e0f-833eefff52f8 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:55:30.529752 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f6a16c8d-b455-4dbb-8e0f-833eefff52f8 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e" status: 200 len: 1391 microversion: 2.1 time: 0.186166 Sep 24 21:55:30.530348 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3460/6940] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:55:30 2022] GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e => generated 1391 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:55:31.283107 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-6a1b157c-003b-4f11-8328-e3ec9e6d6321 req-14d5f5ab-c44a-4421-9136-6bf4edd24bfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66322de4-784b-404d-b79f-74ce9e64210e", "tag": "be54fce5-7cd3-44ed-9383-a3b5cbbe60d1"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:55:31.296948 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6a1b157c-003b-4f11-8328-e3ec9e6d6321 req-14d5f5ab-c44a-4421-9136-6bf4edd24bfd service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:31.297870 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6a1b157c-003b-4f11-8328-e3ec9e6d6321 req-14d5f5ab-c44a-4421-9136-6bf4edd24bfd service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:31.298291 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-6a1b157c-003b-4f11-8328-e3ec9e6d6321 req-14d5f5ab-c44a-4421-9136-6bf4edd24bfd service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:31.312764 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-6a1b157c-003b-4f11-8328-e3ec9e6d6321 req-14d5f5ab-c44a-4421-9136-6bf4edd24bfd service nova] Creating event network-changed:be54fce5-7cd3-44ed-9383-a3b5cbbe60d1 for instance 66322de4-784b-404d-b79f-74ce9e64210e on nch2-master-1 Sep 24 21:55:31.317797 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-6a1b157c-003b-4f11-8328-e3ec9e6d6321 req-14d5f5ab-c44a-4421-9136-6bf4edd24bfd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038546 Sep 24 21:55:31.318739 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3481/6941] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:55:31.553664 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-61c04541-1656-4669-99c5-d3bdab31ddbd tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:55:31.555133 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-61c04541-1656-4669-99c5-d3bdab31ddbd tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:55:31.561963 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-61c04541-1656-4669-99c5-d3bdab31ddbd tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:31.562459 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-61c04541-1656-4669-99c5-d3bdab31ddbd tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:31.563031 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-61c04541-1656-4669-99c5-d3bdab31ddbd tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:31.563737 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-61c04541-1656-4669-99c5-d3bdab31ddbd tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:31.564200 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-61c04541-1656-4669-99c5-d3bdab31ddbd tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:31.564633 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-61c04541-1656-4669-99c5-d3bdab31ddbd tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:31.715687 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-61c04541-1656-4669-99c5-d3bdab31ddbd tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:55:31.723684 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-61c04541-1656-4669-99c5-d3bdab31ddbd tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e" status: 200 len: 1391 microversion: 2.1 time: 0.174280 Sep 24 21:55:31.726585 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3461/6942] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:55:31 2022] GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e => generated 1391 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:55:32.749038 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cbd0cbc5-1c63-4220-9a90-40bee65ccfe0 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:55:32.749867 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cbd0cbc5-1c63-4220-9a90-40bee65ccfe0 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:55:32.756210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cbd0cbc5-1c63-4220-9a90-40bee65ccfe0 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:32.756740 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cbd0cbc5-1c63-4220-9a90-40bee65ccfe0 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:32.757777 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cbd0cbc5-1c63-4220-9a90-40bee65ccfe0 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:32.758514 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cbd0cbc5-1c63-4220-9a90-40bee65ccfe0 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:32.758989 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cbd0cbc5-1c63-4220-9a90-40bee65ccfe0 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:32.759435 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cbd0cbc5-1c63-4220-9a90-40bee65ccfe0 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:32.899815 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cbd0cbc5-1c63-4220-9a90-40bee65ccfe0 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:55:32.907733 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cbd0cbc5-1c63-4220-9a90-40bee65ccfe0 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e" status: 200 len: 1391 microversion: 2.1 time: 0.163811 Sep 24 21:55:32.908317 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3482/6943] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:55:32 2022] GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:55:33.932265 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9ad8c758-7234-40af-94a5-8c348b1a1160 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:55:33.932793 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9ad8c758-7234-40af-94a5-8c348b1a1160 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:55:33.939661 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9ad8c758-7234-40af-94a5-8c348b1a1160 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:33.940156 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9ad8c758-7234-40af-94a5-8c348b1a1160 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:33.940604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9ad8c758-7234-40af-94a5-8c348b1a1160 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:33.941315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9ad8c758-7234-40af-94a5-8c348b1a1160 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:33.941775 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9ad8c758-7234-40af-94a5-8c348b1a1160 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:33.942210 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9ad8c758-7234-40af-94a5-8c348b1a1160 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:34.085927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9ad8c758-7234-40af-94a5-8c348b1a1160 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:55:34.094908 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9ad8c758-7234-40af-94a5-8c348b1a1160 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e" status: 200 len: 1391 microversion: 2.1 time: 0.167099 Sep 24 21:55:34.095502 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3462/6944] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:55:33 2022] GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:55:35.119682 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2d62f47a-bd88-4c0b-ae12-95cedd6dfc7e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:55:35.120312 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2d62f47a-bd88-4c0b-ae12-95cedd6dfc7e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:55:35.127808 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d62f47a-bd88-4c0b-ae12-95cedd6dfc7e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:35.128292 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d62f47a-bd88-4c0b-ae12-95cedd6dfc7e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:35.128728 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d62f47a-bd88-4c0b-ae12-95cedd6dfc7e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:35.129424 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d62f47a-bd88-4c0b-ae12-95cedd6dfc7e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:35.129878 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d62f47a-bd88-4c0b-ae12-95cedd6dfc7e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:35.130306 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2d62f47a-bd88-4c0b-ae12-95cedd6dfc7e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:35.263728 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2d62f47a-bd88-4c0b-ae12-95cedd6dfc7e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:55:35.271578 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2d62f47a-bd88-4c0b-ae12-95cedd6dfc7e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e" status: 200 len: 1391 microversion: 2.1 time: 0.156915 Sep 24 21:55:35.272246 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3483/6945] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:55:35 2022] GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:55:35.540141 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-9e2877c0-4dc6-42d9-b4dd-71e2791f169c req-be5f0c95-0b34-4f73-bcd5-60d127cd60f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66322de4-784b-404d-b79f-74ce9e64210e", "name": "network-vif-plugged", "status": "completed", "tag": "be54fce5-7cd3-44ed-9383-a3b5cbbe60d1"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:55:35.550955 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-9e2877c0-4dc6-42d9-b4dd-71e2791f169c req-be5f0c95-0b34-4f73-bcd5-60d127cd60f8 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:35.551444 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-9e2877c0-4dc6-42d9-b4dd-71e2791f169c req-be5f0c95-0b34-4f73-bcd5-60d127cd60f8 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:35.552147 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-9e2877c0-4dc6-42d9-b4dd-71e2791f169c req-be5f0c95-0b34-4f73-bcd5-60d127cd60f8 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:35.563532 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-9e2877c0-4dc6-42d9-b4dd-71e2791f169c req-be5f0c95-0b34-4f73-bcd5-60d127cd60f8 service nova] Creating event network-vif-plugged:be54fce5-7cd3-44ed-9383-a3b5cbbe60d1 for instance 66322de4-784b-404d-b79f-74ce9e64210e on nch2-master-1 Sep 24 21:55:35.568460 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-9e2877c0-4dc6-42d9-b4dd-71e2791f169c req-be5f0c95-0b34-4f73-bcd5-60d127cd60f8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032659 Sep 24 21:55:35.569051 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3463/6946] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:55:36.294277 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2f7f8b09-c89f-465e-bb7d-34b385f65080 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:55:36.294939 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2f7f8b09-c89f-465e-bb7d-34b385f65080 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:55:36.301934 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2f7f8b09-c89f-465e-bb7d-34b385f65080 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:36.302418 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2f7f8b09-c89f-465e-bb7d-34b385f65080 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:36.302885 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2f7f8b09-c89f-465e-bb7d-34b385f65080 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:36.304225 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2f7f8b09-c89f-465e-bb7d-34b385f65080 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:36.304686 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2f7f8b09-c89f-465e-bb7d-34b385f65080 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:36.305113 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2f7f8b09-c89f-465e-bb7d-34b385f65080 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:36.448655 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2f7f8b09-c89f-465e-bb7d-34b385f65080 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:55:36.456519 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2f7f8b09-c89f-465e-bb7d-34b385f65080 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e" status: 200 len: 1391 microversion: 2.1 time: 0.166296 Sep 24 21:55:36.457104 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3484/6947] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:55:36 2022] GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:55:37.481451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9ae88c68-01c6-413e-8025-bf7d0ed5310b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:55:37.482165 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9ae88c68-01c6-413e-8025-bf7d0ed5310b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:55:37.484656 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:55:37.490086 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9ae88c68-01c6-413e-8025-bf7d0ed5310b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:37.490609 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9ae88c68-01c6-413e-8025-bf7d0ed5310b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:37.491144 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9ae88c68-01c6-413e-8025-bf7d0ed5310b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:37.491886 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9ae88c68-01c6-413e-8025-bf7d0ed5310b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:37.492345 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9ae88c68-01c6-413e-8025-bf7d0ed5310b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:37.492782 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9ae88c68-01c6-413e-8025-bf7d0ed5310b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:37.634640 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9ae88c68-01c6-413e-8025-bf7d0ed5310b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:55:37.645241 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9ae88c68-01c6-413e-8025-bf7d0ed5310b tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e" status: 200 len: 1562 microversion: 2.1 time: 0.168934 Sep 24 21:55:37.645859 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3464/6948] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:55:37 2022] GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e => generated 1562 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:55:37.668841 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1ef57707-ec4a-48f6-ac7b-1c031d45fe30 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:55:37.669366 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1ef57707-ec4a-48f6-ac7b-1c031d45fe30 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:55:37.676202 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1ef57707-ec4a-48f6-ac7b-1c031d45fe30 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:37.676955 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1ef57707-ec4a-48f6-ac7b-1c031d45fe30 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:37.677395 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1ef57707-ec4a-48f6-ac7b-1c031d45fe30 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:37.678096 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1ef57707-ec4a-48f6-ac7b-1c031d45fe30 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:37.679337 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1ef57707-ec4a-48f6-ac7b-1c031d45fe30 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:37.680055 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1ef57707-ec4a-48f6-ac7b-1c031d45fe30 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:37.815002 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1ef57707-ec4a-48f6-ac7b-1c031d45fe30 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:55:37.823463 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1ef57707-ec4a-48f6-ac7b-1c031d45fe30 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e" status: 200 len: 1562 microversion: 2.1 time: 0.158589 Sep 24 21:55:37.824082 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3485/6949] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:55:37 2022] GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:55:39.716254 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-802d7aa1-fac2-4ae7-9127-9f268d6ddd1f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:55:39.717092 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-802d7aa1-fac2-4ae7-9127-9f268d6ddd1f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:55:39.718233 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-abfe3378-4750-41d2-b8a5-9ab2edb1c2d7 req-59b6f33a-dca8-480b-b397-ac2e3c823c59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66322de4-784b-404d-b79f-74ce9e64210e", "tag": "be54fce5-7cd3-44ed-9383-a3b5cbbe60d1"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:55:39.720325 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:55:39.726489 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-802d7aa1-fac2-4ae7-9127-9f268d6ddd1f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:39.726718 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:55:39.727260 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=6 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:55:39.727422 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-802d7aa1-fac2-4ae7-9127-9f268d6ddd1f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:39.727864 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-802d7aa1-fac2-4ae7-9127-9f268d6ddd1f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:39.728775 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-802d7aa1-fac2-4ae7-9127-9f268d6ddd1f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:39.729240 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-802d7aa1-fac2-4ae7-9127-9f268d6ddd1f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:39.730173 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-802d7aa1-fac2-4ae7-9127-9f268d6ddd1f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:39.734484 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-abfe3378-4750-41d2-b8a5-9ab2edb1c2d7 req-59b6f33a-dca8-480b-b397-ac2e3c823c59 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:55:39.734998 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-abfe3378-4750-41d2-b8a5-9ab2edb1c2d7 req-59b6f33a-dca8-480b-b397-ac2e3c823c59 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:55:39.735668 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-abfe3378-4750-41d2-b8a5-9ab2edb1c2d7 req-59b6f33a-dca8-480b-b397-ac2e3c823c59 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:55:39.749095 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-abfe3378-4750-41d2-b8a5-9ab2edb1c2d7 req-59b6f33a-dca8-480b-b397-ac2e3c823c59 service nova] Creating event network-changed:be54fce5-7cd3-44ed-9383-a3b5cbbe60d1 for instance 66322de4-784b-404d-b79f-74ce9e64210e on nch2-master-1 Sep 24 21:55:39.754774 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-abfe3378-4750-41d2-b8a5-9ab2edb1c2d7 req-59b6f33a-dca8-480b-b397-ac2e3c823c59 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039968 Sep 24 21:55:39.755717 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3486/6950] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:55:39.882781 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-802d7aa1-fac2-4ae7-9127-9f268d6ddd1f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:55:39.890793 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-802d7aa1-fac2-4ae7-9127-9f268d6ddd1f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e" status: 200 len: 1562 microversion: 2.1 time: 0.178964 Sep 24 21:55:39.892028 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3465/6951] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:55:39 2022] GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e => generated 1562 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:56:01.131617 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d022ad40-eb29-4e22-b6a6-3cc3f4a07f3f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:56:01.133954 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d022ad40-eb29-4e22-b6a6-3cc3f4a07f3f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:56:01.136046 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:56:01.136821 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=36 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:56:01.144179 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d022ad40-eb29-4e22-b6a6-3cc3f4a07f3f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:01.144710 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d022ad40-eb29-4e22-b6a6-3cc3f4a07f3f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:01.145158 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d022ad40-eb29-4e22-b6a6-3cc3f4a07f3f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:01.145870 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d022ad40-eb29-4e22-b6a6-3cc3f4a07f3f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:01.146338 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d022ad40-eb29-4e22-b6a6-3cc3f4a07f3f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:01.146807 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d022ad40-eb29-4e22-b6a6-3cc3f4a07f3f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:01.217023 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d022ad40-eb29-4e22-b6a6-3cc3f4a07f3f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "POST /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e/action" status: 200 len: 24570 microversion: 2.1 time: 0.090027 Sep 24 21:56:01.217705 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3487/6952] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:56:01 2022] POST /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e/action => generated 24570 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:56:12.191759 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a93f4deb-9a88-470d-9202-7f5c49cc6f02 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:56:12.194598 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:56:12.195468 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=32 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:56:12.202140 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a93f4deb-9a88-470d-9202-7f5c49cc6f02 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:12.202671 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a93f4deb-9a88-470d-9202-7f5c49cc6f02 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:12.203127 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a93f4deb-9a88-470d-9202-7f5c49cc6f02 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:12.225765 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a93f4deb-9a88-470d-9202-7f5c49cc6f02 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] Going to try to stop instance {{(pid=140516) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 24 21:56:12.267248 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a93f4deb-9a88-470d-9202-7f5c49cc6f02 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "POST /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e/action" status: 202 len: 0 microversion: 2.1 time: 0.079419 Sep 24 21:56:12.267851 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3466/6953] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:56:12 2022] POST /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:56:12.276835 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4d773871-7fd8-47f6-b053-ab08fe22f1c9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:56:12.278006 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4d773871-7fd8-47f6-b053-ab08fe22f1c9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:56:12.280713 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=4 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:56:12.281689 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:56:12.287004 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4d773871-7fd8-47f6-b053-ab08fe22f1c9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:12.287674 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4d773871-7fd8-47f6-b053-ab08fe22f1c9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:12.288158 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4d773871-7fd8-47f6-b053-ab08fe22f1c9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:12.289054 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4d773871-7fd8-47f6-b053-ab08fe22f1c9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:12.289520 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4d773871-7fd8-47f6-b053-ab08fe22f1c9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:12.289980 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4d773871-7fd8-47f6-b053-ab08fe22f1c9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:12.429550 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4d773871-7fd8-47f6-b053-ab08fe22f1c9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:56:12.437572 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4d773871-7fd8-47f6-b053-ab08fe22f1c9 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e" status: 200 len: 1690 microversion: 2.1 time: 0.165156 Sep 24 21:56:12.438231 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3488/6954] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:56:12 2022] GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:56:13.464119 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-db28f083-e2e3-4cdd-be32-5053075362ec tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:56:13.464830 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-db28f083-e2e3-4cdd-be32-5053075362ec tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:56:13.471140 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-db28f083-e2e3-4cdd-be32-5053075362ec tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:13.471632 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-db28f083-e2e3-4cdd-be32-5053075362ec tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:13.472079 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-db28f083-e2e3-4cdd-be32-5053075362ec tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:13.472777 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-db28f083-e2e3-4cdd-be32-5053075362ec tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:13.473237 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-db28f083-e2e3-4cdd-be32-5053075362ec tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:13.473668 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-db28f083-e2e3-4cdd-be32-5053075362ec tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:13.607537 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-db28f083-e2e3-4cdd-be32-5053075362ec tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:56:13.615406 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-db28f083-e2e3-4cdd-be32-5053075362ec tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e" status: 200 len: 1690 microversion: 2.1 time: 0.156604 Sep 24 21:56:13.616643 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3467/6955] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:56:13 2022] GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:56:14.639512 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-62853295-e5ab-4e92-8db1-0c0514fe3d12 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:56:14.640146 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-62853295-e5ab-4e92-8db1-0c0514fe3d12 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:56:14.648354 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62853295-e5ab-4e92-8db1-0c0514fe3d12 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:14.648858 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62853295-e5ab-4e92-8db1-0c0514fe3d12 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:14.649310 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62853295-e5ab-4e92-8db1-0c0514fe3d12 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:14.650050 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62853295-e5ab-4e92-8db1-0c0514fe3d12 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:14.650581 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62853295-e5ab-4e92-8db1-0c0514fe3d12 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:14.651040 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-62853295-e5ab-4e92-8db1-0c0514fe3d12 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:14.784222 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-62853295-e5ab-4e92-8db1-0c0514fe3d12 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:56:14.792680 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-62853295-e5ab-4e92-8db1-0c0514fe3d12 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e" status: 200 len: 1690 microversion: 2.1 time: 0.157079 Sep 24 21:56:14.793253 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3489/6956] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:56:14 2022] GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:56:15.817094 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-56ea67bf-e1f1-4777-9138-df7a355aa5cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:56:15.817720 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-56ea67bf-e1f1-4777-9138-df7a355aa5cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:56:15.824720 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56ea67bf-e1f1-4777-9138-df7a355aa5cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:15.825208 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56ea67bf-e1f1-4777-9138-df7a355aa5cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:15.825653 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56ea67bf-e1f1-4777-9138-df7a355aa5cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:15.826355 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56ea67bf-e1f1-4777-9138-df7a355aa5cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:15.826850 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56ea67bf-e1f1-4777-9138-df7a355aa5cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:15.827285 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-56ea67bf-e1f1-4777-9138-df7a355aa5cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:15.963120 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-56ea67bf-e1f1-4777-9138-df7a355aa5cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:56:15.970991 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-56ea67bf-e1f1-4777-9138-df7a355aa5cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e" status: 200 len: 1690 microversion: 2.1 time: 0.157933 Sep 24 21:56:15.971575 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3468/6957] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:56:15 2022] GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:56:16.995212 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0462ed02-7761-47fa-b58a-db6d8ff1ec6d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:56:16.995759 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0462ed02-7761-47fa-b58a-db6d8ff1ec6d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:56:17.002662 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0462ed02-7761-47fa-b58a-db6d8ff1ec6d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:17.003153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0462ed02-7761-47fa-b58a-db6d8ff1ec6d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:17.003595 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0462ed02-7761-47fa-b58a-db6d8ff1ec6d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:17.004297 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0462ed02-7761-47fa-b58a-db6d8ff1ec6d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:17.004753 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0462ed02-7761-47fa-b58a-db6d8ff1ec6d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:17.005184 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0462ed02-7761-47fa-b58a-db6d8ff1ec6d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:17.145750 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0462ed02-7761-47fa-b58a-db6d8ff1ec6d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:56:17.154128 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0462ed02-7761-47fa-b58a-db6d8ff1ec6d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e" status: 200 len: 1690 microversion: 2.1 time: 0.163587 Sep 24 21:56:17.154760 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3490/6958] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:56:16 2022] GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:56:18.177813 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-21c6a639-79c4-40e6-919a-317fda5395da tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:56:18.179052 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-21c6a639-79c4-40e6-919a-317fda5395da tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:56:18.185895 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-21c6a639-79c4-40e6-919a-317fda5395da tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:18.186380 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-21c6a639-79c4-40e6-919a-317fda5395da tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:18.186859 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-21c6a639-79c4-40e6-919a-317fda5395da tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:18.187559 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-21c6a639-79c4-40e6-919a-317fda5395da tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:18.188021 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-21c6a639-79c4-40e6-919a-317fda5395da tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:18.188450 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-21c6a639-79c4-40e6-919a-317fda5395da tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:18.323810 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-21c6a639-79c4-40e6-919a-317fda5395da tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:56:18.332053 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-21c6a639-79c4-40e6-919a-317fda5395da tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e" status: 200 len: 1690 microversion: 2.1 time: 0.158454 Sep 24 21:56:18.332648 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3469/6959] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:56:18 2022] GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:56:19.355329 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b8568cea-9df8-4c81-9ce7-cf1c8d901045 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:56:19.356001 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b8568cea-9df8-4c81-9ce7-cf1c8d901045 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:56:19.362959 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b8568cea-9df8-4c81-9ce7-cf1c8d901045 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:19.363449 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b8568cea-9df8-4c81-9ce7-cf1c8d901045 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:19.363895 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b8568cea-9df8-4c81-9ce7-cf1c8d901045 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:19.364601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b8568cea-9df8-4c81-9ce7-cf1c8d901045 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:19.365067 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b8568cea-9df8-4c81-9ce7-cf1c8d901045 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:19.365576 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b8568cea-9df8-4c81-9ce7-cf1c8d901045 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:19.500037 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b8568cea-9df8-4c81-9ce7-cf1c8d901045 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:56:19.508743 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b8568cea-9df8-4c81-9ce7-cf1c8d901045 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e" status: 200 len: 1690 microversion: 2.1 time: 0.157320 Sep 24 21:56:19.509317 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3491/6960] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:56:19 2022] GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:56:20.533119 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c836ced2-7eba-407a-9ade-bc8aaada86cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:56:20.533739 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c836ced2-7eba-407a-9ade-bc8aaada86cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:56:20.541298 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c836ced2-7eba-407a-9ade-bc8aaada86cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:20.541786 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c836ced2-7eba-407a-9ade-bc8aaada86cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:20.542230 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c836ced2-7eba-407a-9ade-bc8aaada86cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:20.542960 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c836ced2-7eba-407a-9ade-bc8aaada86cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:20.543423 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c836ced2-7eba-407a-9ade-bc8aaada86cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:20.543854 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c836ced2-7eba-407a-9ade-bc8aaada86cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:20.677750 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c836ced2-7eba-407a-9ade-bc8aaada86cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:56:20.685695 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c836ced2-7eba-407a-9ade-bc8aaada86cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e" status: 200 len: 1690 microversion: 2.1 time: 0.156460 Sep 24 21:56:20.686280 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3470/6961] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:56:20 2022] GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:56:21.709106 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-75f654b7-b85a-4cac-a10f-b598f54d376a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:56:21.709733 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-75f654b7-b85a-4cac-a10f-b598f54d376a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:56:21.716806 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75f654b7-b85a-4cac-a10f-b598f54d376a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:21.717306 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75f654b7-b85a-4cac-a10f-b598f54d376a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:21.717756 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75f654b7-b85a-4cac-a10f-b598f54d376a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:21.718514 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75f654b7-b85a-4cac-a10f-b598f54d376a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:21.718993 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75f654b7-b85a-4cac-a10f-b598f54d376a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:21.719435 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-75f654b7-b85a-4cac-a10f-b598f54d376a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:21.854336 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-75f654b7-b85a-4cac-a10f-b598f54d376a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:56:21.862158 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-75f654b7-b85a-4cac-a10f-b598f54d376a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e" status: 200 len: 1690 microversion: 2.1 time: 0.157019 Sep 24 21:56:21.862692 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3492/6962] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:56:21 2022] GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:56:22.886951 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-131defaa-4194-4c19-afe6-9c44a9be34b6 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:56:22.887497 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-131defaa-4194-4c19-afe6-9c44a9be34b6 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:56:22.894630 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-131defaa-4194-4c19-afe6-9c44a9be34b6 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:22.895125 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-131defaa-4194-4c19-afe6-9c44a9be34b6 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:22.895579 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-131defaa-4194-4c19-afe6-9c44a9be34b6 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:22.896282 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-131defaa-4194-4c19-afe6-9c44a9be34b6 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:22.896745 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-131defaa-4194-4c19-afe6-9c44a9be34b6 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:22.897183 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-131defaa-4194-4c19-afe6-9c44a9be34b6 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:23.032113 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-131defaa-4194-4c19-afe6-9c44a9be34b6 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:56:23.040403 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-131defaa-4194-4c19-afe6-9c44a9be34b6 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e" status: 200 len: 1690 microversion: 2.1 time: 0.158182 Sep 24 21:56:23.040982 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3471/6963] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:56:22 2022] GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:56:24.064239 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-64d4e4f5-6526-42f9-8a1c-dd60d0d0cefc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:56:24.064839 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-64d4e4f5-6526-42f9-8a1c-dd60d0d0cefc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:56:24.072272 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-64d4e4f5-6526-42f9-8a1c-dd60d0d0cefc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:24.072771 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-64d4e4f5-6526-42f9-8a1c-dd60d0d0cefc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:24.073218 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-64d4e4f5-6526-42f9-8a1c-dd60d0d0cefc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:24.073922 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-64d4e4f5-6526-42f9-8a1c-dd60d0d0cefc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:24.074382 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-64d4e4f5-6526-42f9-8a1c-dd60d0d0cefc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:24.074842 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-64d4e4f5-6526-42f9-8a1c-dd60d0d0cefc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:24.206362 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-64d4e4f5-6526-42f9-8a1c-dd60d0d0cefc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:56:24.214310 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-64d4e4f5-6526-42f9-8a1c-dd60d0d0cefc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e" status: 200 len: 1690 microversion: 2.1 time: 0.154210 Sep 24 21:56:24.214908 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3493/6964] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:56:24 2022] GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:56:25.237354 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f8b5e670-c43d-4e3e-af95-d89a7c5a4552 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:56:25.237974 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f8b5e670-c43d-4e3e-af95-d89a7c5a4552 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:56:25.244471 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8b5e670-c43d-4e3e-af95-d89a7c5a4552 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:25.244957 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8b5e670-c43d-4e3e-af95-d89a7c5a4552 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:25.245397 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8b5e670-c43d-4e3e-af95-d89a7c5a4552 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:25.246097 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8b5e670-c43d-4e3e-af95-d89a7c5a4552 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:25.246581 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8b5e670-c43d-4e3e-af95-d89a7c5a4552 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:25.247019 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f8b5e670-c43d-4e3e-af95-d89a7c5a4552 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:25.384493 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f8b5e670-c43d-4e3e-af95-d89a7c5a4552 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:56:25.392400 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f8b5e670-c43d-4e3e-af95-d89a7c5a4552 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e" status: 200 len: 1690 microversion: 2.1 time: 0.159137 Sep 24 21:56:25.392974 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3472/6965] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:56:25 2022] GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:56:26.416653 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-abe6dca6-44bd-4957-b81f-bb86d8641d8e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:56:26.417269 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-abe6dca6-44bd-4957-b81f-bb86d8641d8e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:56:26.424242 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-abe6dca6-44bd-4957-b81f-bb86d8641d8e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:26.424734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-abe6dca6-44bd-4957-b81f-bb86d8641d8e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:26.425179 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-abe6dca6-44bd-4957-b81f-bb86d8641d8e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:26.425878 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-abe6dca6-44bd-4957-b81f-bb86d8641d8e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:26.426637 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-abe6dca6-44bd-4957-b81f-bb86d8641d8e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:26.427075 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-abe6dca6-44bd-4957-b81f-bb86d8641d8e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:26.559206 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-abe6dca6-44bd-4957-b81f-bb86d8641d8e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:56:26.567502 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-abe6dca6-44bd-4957-b81f-bb86d8641d8e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e" status: 200 len: 1690 microversion: 2.1 time: 0.154881 Sep 24 21:56:26.568208 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3494/6966] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:56:26 2022] GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:56:27.592927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7240de50-5e38-46f3-a87c-e62714b6ca93 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:56:27.594620 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7240de50-5e38-46f3-a87c-e62714b6ca93 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:56:27.600740 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7240de50-5e38-46f3-a87c-e62714b6ca93 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:27.601253 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7240de50-5e38-46f3-a87c-e62714b6ca93 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:27.601696 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7240de50-5e38-46f3-a87c-e62714b6ca93 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:27.602413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7240de50-5e38-46f3-a87c-e62714b6ca93 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:27.602916 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7240de50-5e38-46f3-a87c-e62714b6ca93 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:27.603353 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7240de50-5e38-46f3-a87c-e62714b6ca93 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:27.739313 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7240de50-5e38-46f3-a87c-e62714b6ca93 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:56:27.747269 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7240de50-5e38-46f3-a87c-e62714b6ca93 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e" status: 200 len: 1690 microversion: 2.1 time: 0.158782 Sep 24 21:56:27.747853 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3473/6967] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:56:27 2022] GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:56:28.770746 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a572502c-ae52-4ed2-a7a0-efe343b587b5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:56:28.771360 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a572502c-ae52-4ed2-a7a0-efe343b587b5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:56:28.778437 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a572502c-ae52-4ed2-a7a0-efe343b587b5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:28.779032 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a572502c-ae52-4ed2-a7a0-efe343b587b5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:28.779480 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a572502c-ae52-4ed2-a7a0-efe343b587b5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:28.780192 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a572502c-ae52-4ed2-a7a0-efe343b587b5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:28.780655 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a572502c-ae52-4ed2-a7a0-efe343b587b5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:28.781093 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a572502c-ae52-4ed2-a7a0-efe343b587b5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:28.916138 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a572502c-ae52-4ed2-a7a0-efe343b587b5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:56:28.924013 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a572502c-ae52-4ed2-a7a0-efe343b587b5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e" status: 200 len: 1667 microversion: 2.1 time: 0.157189 Sep 24 21:56:28.924594 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3495/6968] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:56:28 2022] GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e => generated 1667 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:56:30.018832 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d942ed2a-f38d-46ed-98dc-485894246be1 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:56:30.020976 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d942ed2a-f38d-46ed-98dc-485894246be1 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:56:30.028550 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d942ed2a-f38d-46ed-98dc-485894246be1 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:30.029041 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d942ed2a-f38d-46ed-98dc-485894246be1 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:30.029488 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d942ed2a-f38d-46ed-98dc-485894246be1 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:30.030192 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d942ed2a-f38d-46ed-98dc-485894246be1 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:30.030690 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d942ed2a-f38d-46ed-98dc-485894246be1 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:30.031129 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d942ed2a-f38d-46ed-98dc-485894246be1 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:30.093791 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d942ed2a-f38d-46ed-98dc-485894246be1 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "POST /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e/action" status: 200 len: 38440 microversion: 2.1 time: 0.078800 Sep 24 21:56:30.094438 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3474/6969] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:56:30 2022] POST /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e/action => generated 38440 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:56:30.106377 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a6ba4db9-b967-4efa-b421-fb3efb4bdffc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:56:30.113540 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a6ba4db9-b967-4efa-b421-fb3efb4bdffc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:30.114031 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a6ba4db9-b967-4efa-b421-fb3efb4bdffc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:30.114478 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a6ba4db9-b967-4efa-b421-fb3efb4bdffc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:30.140707 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a6ba4db9-b967-4efa-b421-fb3efb4bdffc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] Going to try to start instance {{(pid=140517) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 24 21:56:30.183557 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a6ba4db9-b967-4efa-b421-fb3efb4bdffc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "POST /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e/action" status: 202 len: 0 microversion: 2.1 time: 0.080918 Sep 24 21:56:30.184181 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3496/6970] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:56:30 2022] POST /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 21:56:30.193354 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3003d271-e5ef-407a-b45c-b75f9a3e3d1e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:56:30.194186 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3003d271-e5ef-407a-b45c-b75f9a3e3d1e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:56:30.202962 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3003d271-e5ef-407a-b45c-b75f9a3e3d1e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:30.203476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3003d271-e5ef-407a-b45c-b75f9a3e3d1e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:30.203938 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3003d271-e5ef-407a-b45c-b75f9a3e3d1e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:30.204665 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3003d271-e5ef-407a-b45c-b75f9a3e3d1e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:30.205420 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3003d271-e5ef-407a-b45c-b75f9a3e3d1e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:30.205995 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3003d271-e5ef-407a-b45c-b75f9a3e3d1e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:30.361342 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3003d271-e5ef-407a-b45c-b75f9a3e3d1e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:56:30.370077 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3003d271-e5ef-407a-b45c-b75f9a3e3d1e tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e" status: 200 len: 1676 microversion: 2.1 time: 0.180966 Sep 24 21:56:30.370687 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3475/6971] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:56:30 2022] GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e => generated 1676 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:56:31.396023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b39cedbd-d792-4d37-8ae8-4944c088c32f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:56:31.396729 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b39cedbd-d792-4d37-8ae8-4944c088c32f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:56:31.403892 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b39cedbd-d792-4d37-8ae8-4944c088c32f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:31.404378 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b39cedbd-d792-4d37-8ae8-4944c088c32f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:31.404818 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b39cedbd-d792-4d37-8ae8-4944c088c32f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:31.405511 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b39cedbd-d792-4d37-8ae8-4944c088c32f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:31.405970 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b39cedbd-d792-4d37-8ae8-4944c088c32f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:31.406399 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b39cedbd-d792-4d37-8ae8-4944c088c32f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:31.538153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b39cedbd-d792-4d37-8ae8-4944c088c32f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:56:31.546117 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b39cedbd-d792-4d37-8ae8-4944c088c32f tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e" status: 200 len: 1680 microversion: 2.1 time: 0.155228 Sep 24 21:56:31.546723 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3497/6972] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:56:31 2022] GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:56:55.737401 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-02b33609-eb1d-4c4d-a96e-0ade1378b08c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:56:55.739606 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-02b33609-eb1d-4c4d-a96e-0ade1378b08c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:56:55.742516 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=20 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:56:55.743268 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:56:55.748782 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-02b33609-eb1d-4c4d-a96e-0ade1378b08c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:55.749275 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-02b33609-eb1d-4c4d-a96e-0ade1378b08c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:55.749719 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-02b33609-eb1d-4c4d-a96e-0ade1378b08c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:55.750429 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-02b33609-eb1d-4c4d-a96e-0ade1378b08c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:56:55.750918 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-02b33609-eb1d-4c4d-a96e-0ade1378b08c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:56:55.751350 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-02b33609-eb1d-4c4d-a96e-0ade1378b08c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:56:55.824676 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-02b33609-eb1d-4c4d-a96e-0ade1378b08c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "POST /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e/action" status: 200 len: 63000 microversion: 2.1 time: 0.091238 Sep 24 21:56:55.825390 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3476/6973] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:56:55 2022] POST /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e/action => generated 63000 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:57:02.897715 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-59308f54-8422-48e9-8490-a01b5819f28d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:57:02.898229 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-59308f54-8422-48e9-8490-a01b5819f28d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:57:02.900833 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=20 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:57:02.901514 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:57:02.907629 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-7c784301-bdc4-4de4-885c-395bb97c5561 req-f8833cf1-076b-4fcb-9104-877f22665c21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66322de4-784b-404d-b79f-74ce9e64210e", "tag": "be54fce5-7cd3-44ed-9383-a3b5cbbe60d1"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:57:02.921123 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-59308f54-8422-48e9-8490-a01b5819f28d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:57:02.921629 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-59308f54-8422-48e9-8490-a01b5819f28d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:57:02.922074 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-59308f54-8422-48e9-8490-a01b5819f28d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:57:02.922826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-59308f54-8422-48e9-8490-a01b5819f28d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:57:02.923282 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-59308f54-8422-48e9-8490-a01b5819f28d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:57:02.923716 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-59308f54-8422-48e9-8490-a01b5819f28d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:57:02.931646 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-7c784301-bdc4-4de4-885c-395bb97c5561 req-f8833cf1-076b-4fcb-9104-877f22665c21 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:57:02.932168 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-7c784301-bdc4-4de4-885c-395bb97c5561 req-f8833cf1-076b-4fcb-9104-877f22665c21 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:57:02.932583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-7c784301-bdc4-4de4-885c-395bb97c5561 req-f8833cf1-076b-4fcb-9104-877f22665c21 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:57:02.944732 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-7c784301-bdc4-4de4-885c-395bb97c5561 req-f8833cf1-076b-4fcb-9104-877f22665c21 service nova] Creating event network-changed:be54fce5-7cd3-44ed-9383-a3b5cbbe60d1 for instance 66322de4-784b-404d-b79f-74ce9e64210e on nch2-master-1 Sep 24 21:57:02.950972 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-7c784301-bdc4-4de4-885c-395bb97c5561 req-f8833cf1-076b-4fcb-9104-877f22665c21 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047637 Sep 24 21:57:02.952334 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3477/6974] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:57:02.959979 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-59308f54-8422-48e9-8490-a01b5819f28d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:57:03.039573 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-59308f54-8422-48e9-8490-a01b5819f28d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "DELETE /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e" status: 204 len: 0 microversion: 2.1 time: 0.145435 Sep 24 21:57:03.040868 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3498/6975] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:57:02 2022] DELETE /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:57:03.051927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a2ee9480-cf4a-485f-9ecc-88780ad1145d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:57:03.052739 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a2ee9480-cf4a-485f-9ecc-88780ad1145d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:57:03.066024 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2ee9480-cf4a-485f-9ecc-88780ad1145d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:57:03.067091 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2ee9480-cf4a-485f-9ecc-88780ad1145d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:57:03.067546 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2ee9480-cf4a-485f-9ecc-88780ad1145d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:57:03.068458 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2ee9480-cf4a-485f-9ecc-88780ad1145d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:57:03.068927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2ee9480-cf4a-485f-9ecc-88780ad1145d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:57:03.069534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a2ee9480-cf4a-485f-9ecc-88780ad1145d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:57:03.218449 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a2ee9480-cf4a-485f-9ecc-88780ad1145d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:57:03.226387 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a2ee9480-cf4a-485f-9ecc-88780ad1145d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e" status: 200 len: 1686 microversion: 2.1 time: 0.180763 Sep 24 21:57:03.227540 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3478/6976] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:57:03 2022] GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e => generated 1686 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:57:04.251701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d9c1a827-df5d-4e86-bd3a-c1a9e6d1b70d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:57:04.252411 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d9c1a827-df5d-4e86-bd3a-c1a9e6d1b70d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:57:04.259336 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d9c1a827-df5d-4e86-bd3a-c1a9e6d1b70d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:57:04.259818 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d9c1a827-df5d-4e86-bd3a-c1a9e6d1b70d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:57:04.260298 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d9c1a827-df5d-4e86-bd3a-c1a9e6d1b70d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:57:04.261083 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d9c1a827-df5d-4e86-bd3a-c1a9e6d1b70d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:57:04.261582 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d9c1a827-df5d-4e86-bd3a-c1a9e6d1b70d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:57:04.262017 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d9c1a827-df5d-4e86-bd3a-c1a9e6d1b70d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:57:04.395142 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d9c1a827-df5d-4e86-bd3a-c1a9e6d1b70d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:57:04.403686 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d9c1a827-df5d-4e86-bd3a-c1a9e6d1b70d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e" status: 200 len: 1686 microversion: 2.1 time: 0.156191 Sep 24 21:57:04.404948 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3499/6977] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:57:04 2022] GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:57:05.215931 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-c0fd0f79-78a2-4972-a495-588348a86b99 req-53e5999b-5c73-4568-8083-25a79dd09af7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66322de4-784b-404d-b79f-74ce9e64210e", "name": "network-vif-deleted", "tag": "be54fce5-7cd3-44ed-9383-a3b5cbbe60d1"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:57:05.229054 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c0fd0f79-78a2-4972-a495-588348a86b99 req-53e5999b-5c73-4568-8083-25a79dd09af7 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:57:05.229534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c0fd0f79-78a2-4972-a495-588348a86b99 req-53e5999b-5c73-4568-8083-25a79dd09af7 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:57:05.230652 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-c0fd0f79-78a2-4972-a495-588348a86b99 req-53e5999b-5c73-4568-8083-25a79dd09af7 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:57:05.242409 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-c0fd0f79-78a2-4972-a495-588348a86b99 req-53e5999b-5c73-4568-8083-25a79dd09af7 service nova] Creating event network-vif-deleted:be54fce5-7cd3-44ed-9383-a3b5cbbe60d1 for instance 66322de4-784b-404d-b79f-74ce9e64210e on nch2-master-1 Sep 24 21:57:05.247828 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-c0fd0f79-78a2-4972-a495-588348a86b99 req-53e5999b-5c73-4568-8083-25a79dd09af7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035953 Sep 24 21:57:05.248428 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3479/6978] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:57:05.428513 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-80ac7025-6a6e-4d01-81bf-3ba1fd72cd95 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:57:05.429080 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-80ac7025-6a6e-4d01-81bf-3ba1fd72cd95 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:57:05.436920 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-80ac7025-6a6e-4d01-81bf-3ba1fd72cd95 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:57:05.437412 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-80ac7025-6a6e-4d01-81bf-3ba1fd72cd95 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:57:05.437857 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-80ac7025-6a6e-4d01-81bf-3ba1fd72cd95 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:57:05.438618 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-80ac7025-6a6e-4d01-81bf-3ba1fd72cd95 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:57:05.439082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-80ac7025-6a6e-4d01-81bf-3ba1fd72cd95 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:57:05.439513 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-80ac7025-6a6e-4d01-81bf-3ba1fd72cd95 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:57:05.471698 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-80ac7025-6a6e-4d01-81bf-3ba1fd72cd95 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:57:05.472187 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-80ac7025-6a6e-4d01-81bf-3ba1fd72cd95 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:57:05.472635 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-80ac7025-6a6e-4d01-81bf-3ba1fd72cd95 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:57:05.473090 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.objects.instance [None req-80ac7025-6a6e-4d01-81bf-3ba1fd72cd95 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lazy-loading 'fault' on Instance uuid 66322de4-784b-404d-b79f-74ce9e64210e {{(pid=140517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:57:05.515577 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-80ac7025-6a6e-4d01-81bf-3ba1fd72cd95 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:57:05.524473 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-80ac7025-6a6e-4d01-81bf-3ba1fd72cd95 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e" status: 200 len: 1356 microversion: 2.1 time: 0.100041 Sep 24 21:57:05.525254 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3500/6979] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:57:05 2022] GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e => generated 1356 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:57:06.549767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f86dd0c9-d7b4-4c3c-a810-88a3fcc2e4b5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:57:06.550476 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f86dd0c9-d7b4-4c3c-a810-88a3fcc2e4b5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 66322de4-784b-404d-b79f-74ce9e64210e] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:57:06.557712 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f86dd0c9-d7b4-4c3c-a810-88a3fcc2e4b5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:57:06.558197 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f86dd0c9-d7b4-4c3c-a810-88a3fcc2e4b5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:57:06.558668 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f86dd0c9-d7b4-4c3c-a810-88a3fcc2e4b5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:57:06.559362 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f86dd0c9-d7b4-4c3c-a810-88a3fcc2e4b5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:57:06.559818 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f86dd0c9-d7b4-4c3c-a810-88a3fcc2e4b5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:57:06.560245 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f86dd0c9-d7b4-4c3c-a810-88a3fcc2e4b5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:57:06.574546 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-f86dd0c9-d7b4-4c3c-a810-88a3fcc2e4b5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] HTTP exception thrown: Instance 66322de4-784b-404d-b79f-74ce9e64210e could not be found. Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f86dd0c9-d7b4-4c3c-a810-88a3fcc2e4b5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Request method failure captured: Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e HTTP/1.1 Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3tlY6TxOcKA9sot6kAGfifiAT7Y-vlZYlV4mDyOhDhn0ty7VdV5tSo8UlXtPCa-WwNM_dIQLhLmZ-frXjrk-rwgBb_zUbuuXPjO6n3Y8yIkG02m1UafCrWL7DDdBlhrGINN8GSujPX_7p_Mvu6-XCMNk6noAMPUuRqhchaAZc_WaoM Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 22a8ea7438b641139afc6ea3c2dcba4c Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1351374344 Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/22a8ea7438b641139afc6ea3c2dcba4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_22a8ea7438b641139afc6ea3c2dcba4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/22a8ea7438b641139afc6ea3c2dcba4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/22a8ea7438b641139afc6ea3c2dcba4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1351374344 Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 22a8ea7438b641139afc6ea3c2dcba4c Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1351374344 Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-TestNetworkAdvancedServerOps-1351374344-project Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: ce56b96d91fa42029081bd0e6eccb5e4 Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1351374344-project Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 66322de4-784b-404d-b79f-74ce9e64210e could not be found. Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '66322de4-784b-404d-b79f-74ce9e64210e'} Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66322de4-784b-404d-b79f-74ce9e64210e could not be found. Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66322de4-784b-404d-b79f-74ce9e64210e could not be found. Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:57:06.576162 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:57:06.581442 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:57:06.581442 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:57:06.581442 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:57:06.581442 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:57:06.581442 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:57:06.581442 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:57:06.581442 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66322de4-784b-404d-b79f-74ce9e64210e could not be found. Sep 24 21:57:06.581442 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:57:06.581442 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f86dd0c9-d7b4-4c3c-a810-88a3fcc2e4b5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Returning 404 to user: Instance 66322de4-784b-404d-b79f-74ce9e64210e could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:57:06.581442 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f86dd0c9-d7b4-4c3c-a810-88a3fcc2e4b5 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e" status: 404 len: 111 microversion: 2.1 time: 0.033003 Sep 24 21:57:06.581442 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3480/6980] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:57:06 2022] GET /compute/v2.1/servers/66322de4-784b-404d-b79f-74ce9e64210e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:57:09.824894 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dec3ffc5-680e-4aed-a3f7-77adac380db3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '.version_select at 0x7f4b0c8d4e50>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:57:09.846587 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dec3ffc5-680e-4aed-a3f7-77adac380db3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1431068195" status: 202 len: 0 microversion: 2.1 time: 0.026028 Sep 24 21:57:09.847493 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3501/6981] 10.222.0.52 () {58 vars in 1284 bytes} [Sat Sep 24 21:57:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1431068195 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:57:09.880927 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a03b4d7e-59ef-433d-8c6b-8f6fb44e6c69 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Action: 'create', calling method: .version_select at 0x7f4b0c413040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-38771863", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBHlaF0S/UI571Im0XI1xNlFlpKYZI8lvJgIJf4935NciIUU0Ha0IDs5OG4VPPSoXuACUU68irqITiyZ4vrRZrQSnlHPFhKPbrkvH81vEbXNQKKPCTFFmYIVSyODK71uw=="}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:57:09.899634 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-a03b4d7e-59ef-433d-8c6b-8f6fb44e6c69 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Getting quotas for project 22a8ea7438b641139afc6ea3c2dcba4c. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:57:09.904724 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-a03b4d7e-59ef-433d-8c6b-8f6fb44e6c69 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Getting quotas for user ce56b96d91fa42029081bd0e6eccb5e4 and project 22a8ea7438b641139afc6ea3c2dcba4c. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:57:09.927313 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a03b4d7e-59ef-433d-8c6b-8f6fb44e6c69 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.050866 Sep 24 21:57:09.927933 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3481/6982] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 21:57:09 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:57:15.815422 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:57:15.822557 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-945908bf-661a-4c5b-a59c-596546e0a6ae tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1291690557", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "networks": [{"uuid": "a12c4ee7-4a49-4f6e-b805-c28001bca886"}], "key_name": "tempest-TestNetworkAdvancedServerOps-38771863", "security_groups": [{"name": "tempest-secgroup-smoke-347254544"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:57:15.950482 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-945908bf-661a-4c5b-a59c-596546e0a6ae tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] validate_networks() for [('a12c4ee7-4a49-4f6e-b805-c28001bca886', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:57:16.368989 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-945908bf-661a-4c5b-a59c-596546e0a6ae tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:57:16.369538 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-945908bf-661a-4c5b-a59c-596546e0a6ae tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:57:16.370103 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-945908bf-661a-4c5b-a59c-596546e0a6ae tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:57:16.370755 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-945908bf-661a-4c5b-a59c-596546e0a6ae tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:57:16.371425 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-945908bf-661a-4c5b-a59c-596546e0a6ae tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:57:16.381394 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-945908bf-661a-4c5b-a59c-596546e0a6ae tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:57:16.381977 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-945908bf-661a-4c5b-a59c-596546e0a6ae tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:57:16.383106 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-945908bf-661a-4c5b-a59c-596546e0a6ae tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:57:16.384140 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-945908bf-661a-4c5b-a59c-596546e0a6ae tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:57:16.385754 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-945908bf-661a-4c5b-a59c-596546e0a6ae tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:57:16.391509 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-945908bf-661a-4c5b-a59c-596546e0a6ae tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:57:16.422151 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-945908bf-661a-4c5b-a59c-596546e0a6ae tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Getting quotas for project 22a8ea7438b641139afc6ea3c2dcba4c. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:57:16.428327 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-945908bf-661a-4c5b-a59c-596546e0a6ae tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Getting quotas for user ce56b96d91fa42029081bd0e6eccb5e4 and project 22a8ea7438b641139afc6ea3c2dcba4c. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:57:16.452385 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-945908bf-661a-4c5b-a59c-596546e0a6ae tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:57:16.455702 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-945908bf-661a-4c5b-a59c-596546e0a6ae tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 197764b2-3f25-43b2-9c82-071955c8052f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:57:16.537295 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-945908bf-661a-4c5b-a59c-596546e0a6ae tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.723890 Sep 24 21:57:16.544987 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3502/6983] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:57:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:57:16.550855 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6e763d7b-1cac-481d-a261-49d9f4b8fa72 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:57:16.551758 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6e763d7b-1cac-481d-a261-49d9f4b8fa72 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 197764b2-3f25-43b2-9c82-071955c8052f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:57:16.572824 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=16 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:57:16.648352 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6e763d7b-1cac-481d-a261-49d9f4b8fa72 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:57:16.657541 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6e763d7b-1cac-481d-a261-49d9f4b8fa72 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f" status: 200 len: 1265 microversion: 2.1 time: 0.111008 Sep 24 21:57:16.659569 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3482/6984] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:57:16 2022] GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f => generated 1265 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:57:17.683143 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-595a87e8-7e72-4ffe-b936-8f00651c9649 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:57:17.684688 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-595a87e8-7e72-4ffe-b936-8f00651c9649 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 197764b2-3f25-43b2-9c82-071955c8052f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:57:17.696605 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-595a87e8-7e72-4ffe-b936-8f00651c9649 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:57:17.697208 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-595a87e8-7e72-4ffe-b936-8f00651c9649 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:57:17.697928 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-595a87e8-7e72-4ffe-b936-8f00651c9649 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:57:17.699076 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-595a87e8-7e72-4ffe-b936-8f00651c9649 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:57:17.699765 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-595a87e8-7e72-4ffe-b936-8f00651c9649 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:57:17.700425 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-595a87e8-7e72-4ffe-b936-8f00651c9649 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:57:17.806567 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-595a87e8-7e72-4ffe-b936-8f00651c9649 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:57:17.818754 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-595a87e8-7e72-4ffe-b936-8f00651c9649 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f" status: 200 len: 1317 microversion: 2.1 time: 0.140573 Sep 24 21:57:17.820165 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3503/6985] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:57:17 2022] GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f => generated 1317 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:57:18.851115 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1a0e8c95-00af-4ae6-aa11-be51e60b25cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:57:18.852540 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1a0e8c95-00af-4ae6-aa11-be51e60b25cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 197764b2-3f25-43b2-9c82-071955c8052f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:57:18.862754 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a0e8c95-00af-4ae6-aa11-be51e60b25cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:57:18.863558 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a0e8c95-00af-4ae6-aa11-be51e60b25cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:57:18.864214 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a0e8c95-00af-4ae6-aa11-be51e60b25cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:57:18.865120 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a0e8c95-00af-4ae6-aa11-be51e60b25cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:57:18.865840 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a0e8c95-00af-4ae6-aa11-be51e60b25cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:57:18.866536 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1a0e8c95-00af-4ae6-aa11-be51e60b25cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:57:19.382165 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1a0e8c95-00af-4ae6-aa11-be51e60b25cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:57:19.390640 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1a0e8c95-00af-4ae6-aa11-be51e60b25cc tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f" status: 200 len: 1390 microversion: 2.1 time: 0.548532 Sep 24 21:57:19.391419 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3483/6986] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:57:18 2022] GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f => generated 1390 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:57:19.709234 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-118724b6-b59a-423a-a3bb-3573b8eebef4 req-374899cf-37bb-42f1-8dab-a37f5178a27e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "197764b2-3f25-43b2-9c82-071955c8052f", "tag": "0f9bd2e8-a22f-438c-a8ab-f9a00d92767e"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:57:19.727848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-118724b6-b59a-423a-a3bb-3573b8eebef4 req-374899cf-37bb-42f1-8dab-a37f5178a27e service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:57:19.728557 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-118724b6-b59a-423a-a3bb-3573b8eebef4 req-374899cf-37bb-42f1-8dab-a37f5178a27e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:57:19.729023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-118724b6-b59a-423a-a3bb-3573b8eebef4 req-374899cf-37bb-42f1-8dab-a37f5178a27e service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:57:19.741336 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-118724b6-b59a-423a-a3bb-3573b8eebef4 req-374899cf-37bb-42f1-8dab-a37f5178a27e service nova] Creating event network-changed:0f9bd2e8-a22f-438c-a8ab-f9a00d92767e for instance 197764b2-3f25-43b2-9c82-071955c8052f on nch1-master-1 Sep 24 21:57:19.746778 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-118724b6-b59a-423a-a3bb-3573b8eebef4 req-374899cf-37bb-42f1-8dab-a37f5178a27e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041776 Sep 24 21:57:19.747912 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3504/6987] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:57:20.415326 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-41402e26-4d05-4f50-8bd2-06140d7f03a8 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:57:20.415977 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-41402e26-4d05-4f50-8bd2-06140d7f03a8 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 197764b2-3f25-43b2-9c82-071955c8052f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:57:20.422882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41402e26-4d05-4f50-8bd2-06140d7f03a8 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:57:20.423367 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41402e26-4d05-4f50-8bd2-06140d7f03a8 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:57:20.423804 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41402e26-4d05-4f50-8bd2-06140d7f03a8 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:57:20.424509 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41402e26-4d05-4f50-8bd2-06140d7f03a8 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:57:20.424974 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41402e26-4d05-4f50-8bd2-06140d7f03a8 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:57:20.425390 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-41402e26-4d05-4f50-8bd2-06140d7f03a8 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:57:20.564983 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-41402e26-4d05-4f50-8bd2-06140d7f03a8 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:57:20.572981 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-41402e26-4d05-4f50-8bd2-06140d7f03a8 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f" status: 200 len: 1390 microversion: 2.1 time: 0.162441 Sep 24 21:57:20.573586 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3484/6988] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:57:20 2022] GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:57:21.596906 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-46040350-a465-41bd-be59-863366a20934 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:57:21.597547 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-46040350-a465-41bd-be59-863366a20934 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 197764b2-3f25-43b2-9c82-071955c8052f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:57:21.604479 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46040350-a465-41bd-be59-863366a20934 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:57:21.604972 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46040350-a465-41bd-be59-863366a20934 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:57:21.605417 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46040350-a465-41bd-be59-863366a20934 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:57:21.606121 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46040350-a465-41bd-be59-863366a20934 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:57:21.606613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46040350-a465-41bd-be59-863366a20934 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:57:21.607056 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-46040350-a465-41bd-be59-863366a20934 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:57:21.738913 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-46040350-a465-41bd-be59-863366a20934 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:57:21.747191 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-46040350-a465-41bd-be59-863366a20934 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f" status: 200 len: 1390 microversion: 2.1 time: 0.155429 Sep 24 21:57:21.747779 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3505/6989] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:57:21 2022] GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:57:22.769564 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e72cba1a-a648-47b4-bf3d-dbb3badd0f62 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:57:22.770115 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e72cba1a-a648-47b4-bf3d-dbb3badd0f62 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 197764b2-3f25-43b2-9c82-071955c8052f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:57:22.777410 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e72cba1a-a648-47b4-bf3d-dbb3badd0f62 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:57:22.777909 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e72cba1a-a648-47b4-bf3d-dbb3badd0f62 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:57:22.778357 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e72cba1a-a648-47b4-bf3d-dbb3badd0f62 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:57:22.779105 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e72cba1a-a648-47b4-bf3d-dbb3badd0f62 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:57:22.779573 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e72cba1a-a648-47b4-bf3d-dbb3badd0f62 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:57:22.780013 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e72cba1a-a648-47b4-bf3d-dbb3badd0f62 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:57:22.921589 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e72cba1a-a648-47b4-bf3d-dbb3badd0f62 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:57:22.929970 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e72cba1a-a648-47b4-bf3d-dbb3badd0f62 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f" status: 200 len: 1390 microversion: 2.1 time: 0.164598 Sep 24 21:57:22.930582 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3485/6990] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:57:22 2022] GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:57:23.953417 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7f746acb-8b8a-423b-a08d-64ee0665be7d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:57:23.953972 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7f746acb-8b8a-423b-a08d-64ee0665be7d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 197764b2-3f25-43b2-9c82-071955c8052f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:57:23.960400 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f746acb-8b8a-423b-a08d-64ee0665be7d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:57:23.961537 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f746acb-8b8a-423b-a08d-64ee0665be7d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:57:23.961973 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f746acb-8b8a-423b-a08d-64ee0665be7d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:57:23.962707 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f746acb-8b8a-423b-a08d-64ee0665be7d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:57:23.963167 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f746acb-8b8a-423b-a08d-64ee0665be7d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:57:23.963601 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7f746acb-8b8a-423b-a08d-64ee0665be7d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:57:24.098682 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7f746acb-8b8a-423b-a08d-64ee0665be7d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:57:24.106892 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7f746acb-8b8a-423b-a08d-64ee0665be7d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f" status: 200 len: 1390 microversion: 2.1 time: 0.158014 Sep 24 21:57:24.108166 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3506/6991] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:57:23 2022] GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:57:24.866218 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-3776b8e0-a878-450c-b3cb-94107a35f76d req-b96a6c2d-4ff3-425d-a551-e3294698f4c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "197764b2-3f25-43b2-9c82-071955c8052f", "name": "network-vif-plugged", "status": "completed", "tag": "0f9bd2e8-a22f-438c-a8ab-f9a00d92767e"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:57:24.879576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-3776b8e0-a878-450c-b3cb-94107a35f76d req-b96a6c2d-4ff3-425d-a551-e3294698f4c2 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:57:24.880067 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-3776b8e0-a878-450c-b3cb-94107a35f76d req-b96a6c2d-4ff3-425d-a551-e3294698f4c2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:57:24.880502 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-3776b8e0-a878-450c-b3cb-94107a35f76d req-b96a6c2d-4ff3-425d-a551-e3294698f4c2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:57:24.894552 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-3776b8e0-a878-450c-b3cb-94107a35f76d req-b96a6c2d-4ff3-425d-a551-e3294698f4c2 service nova] Creating event network-vif-plugged:0f9bd2e8-a22f-438c-a8ab-f9a00d92767e for instance 197764b2-3f25-43b2-9c82-071955c8052f on nch1-master-1 Sep 24 21:57:24.900445 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-3776b8e0-a878-450c-b3cb-94107a35f76d req-b96a6c2d-4ff3-425d-a551-e3294698f4c2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037937 Sep 24 21:57:24.901217 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3486/6992] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:57:25.129831 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-bb504213-918c-4867-a117-955604a4b793 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:57:25.130458 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-bb504213-918c-4867-a117-955604a4b793 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 197764b2-3f25-43b2-9c82-071955c8052f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:57:25.137420 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb504213-918c-4867-a117-955604a4b793 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:57:25.137911 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb504213-918c-4867-a117-955604a4b793 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:57:25.138359 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb504213-918c-4867-a117-955604a4b793 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:57:25.139103 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb504213-918c-4867-a117-955604a4b793 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:57:25.139567 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb504213-918c-4867-a117-955604a4b793 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:57:25.140001 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-bb504213-918c-4867-a117-955604a4b793 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:57:25.273780 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-bb504213-918c-4867-a117-955604a4b793 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:57:25.281885 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-bb504213-918c-4867-a117-955604a4b793 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f" status: 200 len: 1390 microversion: 2.1 time: 0.155997 Sep 24 21:57:25.282501 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3507/6993] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:57:25 2022] GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:57:26.307559 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-1d20de6a-7ea3-41fe-b347-6d8df87e82a6 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:57:26.308227 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-1d20de6a-7ea3-41fe-b347-6d8df87e82a6 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 197764b2-3f25-43b2-9c82-071955c8052f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:57:26.310176 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:57:26.316454 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d20de6a-7ea3-41fe-b347-6d8df87e82a6 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:57:26.316945 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d20de6a-7ea3-41fe-b347-6d8df87e82a6 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:57:26.317390 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d20de6a-7ea3-41fe-b347-6d8df87e82a6 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:57:26.318101 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d20de6a-7ea3-41fe-b347-6d8df87e82a6 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:57:26.318622 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d20de6a-7ea3-41fe-b347-6d8df87e82a6 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:57:26.319057 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-1d20de6a-7ea3-41fe-b347-6d8df87e82a6 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:57:26.461239 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-1d20de6a-7ea3-41fe-b347-6d8df87e82a6 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:57:26.470221 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-1d20de6a-7ea3-41fe-b347-6d8df87e82a6 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f" status: 200 len: 1560 microversion: 2.1 time: 0.168410 Sep 24 21:57:26.470835 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3487/6994] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:57:26 2022] GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:57:26.494387 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0d7ca39e-4c3f-4852-8b36-952e0da22c67 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:57:26.495033 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0d7ca39e-4c3f-4852-8b36-952e0da22c67 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 197764b2-3f25-43b2-9c82-071955c8052f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:57:26.497860 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:57:26.498708 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=6 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:57:26.504824 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d7ca39e-4c3f-4852-8b36-952e0da22c67 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:57:26.505308 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d7ca39e-4c3f-4852-8b36-952e0da22c67 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:57:26.505747 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d7ca39e-4c3f-4852-8b36-952e0da22c67 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:57:26.506446 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d7ca39e-4c3f-4852-8b36-952e0da22c67 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:57:26.506934 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d7ca39e-4c3f-4852-8b36-952e0da22c67 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:57:26.507421 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d7ca39e-4c3f-4852-8b36-952e0da22c67 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:57:26.642175 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0d7ca39e-4c3f-4852-8b36-952e0da22c67 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:57:26.650347 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0d7ca39e-4c3f-4852-8b36-952e0da22c67 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f" status: 200 len: 1560 microversion: 2.1 time: 0.160467 Sep 24 21:57:26.650969 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3508/6995] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:57:26 2022] GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:57:28.244898 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-26acd3c8-6a0a-4436-a6cb-7201f27c037c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:57:28.245811 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-26acd3c8-6a0a-4436-a6cb-7201f27c037c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 197764b2-3f25-43b2-9c82-071955c8052f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:57:28.248035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-f173318c-b240-41e2-8835-4d23ffc6e6f3 req-a5de98a2-f442-4dec-8f58-ab9fb6640fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "197764b2-3f25-43b2-9c82-071955c8052f", "tag": "0f9bd2e8-a22f-438c-a8ab-f9a00d92767e"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:57:28.251485 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:57:28.254542 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26acd3c8-6a0a-4436-a6cb-7201f27c037c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:57:28.255209 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26acd3c8-6a0a-4436-a6cb-7201f27c037c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:57:28.256119 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26acd3c8-6a0a-4436-a6cb-7201f27c037c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:57:28.257065 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26acd3c8-6a0a-4436-a6cb-7201f27c037c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:57:28.257783 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26acd3c8-6a0a-4436-a6cb-7201f27c037c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:57:28.258579 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-26acd3c8-6a0a-4436-a6cb-7201f27c037c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:57:28.260258 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-f173318c-b240-41e2-8835-4d23ffc6e6f3 req-a5de98a2-f442-4dec-8f58-ab9fb6640fb8 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:57:28.260813 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-f173318c-b240-41e2-8835-4d23ffc6e6f3 req-a5de98a2-f442-4dec-8f58-ab9fb6640fb8 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:57:28.261333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-f173318c-b240-41e2-8835-4d23ffc6e6f3 req-a5de98a2-f442-4dec-8f58-ab9fb6640fb8 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:57:28.274668 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-f173318c-b240-41e2-8835-4d23ffc6e6f3 req-a5de98a2-f442-4dec-8f58-ab9fb6640fb8 service nova] Creating event network-changed:0f9bd2e8-a22f-438c-a8ab-f9a00d92767e for instance 197764b2-3f25-43b2-9c82-071955c8052f on nch1-master-1 Sep 24 21:57:28.280060 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-f173318c-b240-41e2-8835-4d23ffc6e6f3 req-a5de98a2-f442-4dec-8f58-ab9fb6640fb8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036554 Sep 24 21:57:28.281224 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3509/6996] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:57:28.490040 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-26acd3c8-6a0a-4436-a6cb-7201f27c037c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:57:28.498294 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-26acd3c8-6a0a-4436-a6cb-7201f27c037c tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f" status: 200 len: 1560 microversion: 2.1 time: 0.257620 Sep 24 21:57:28.499184 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3488/6997] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:57:28 2022] GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f => generated 1560 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:58:02.123372 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:58:02.124131 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=36 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:58:02.128798 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5af195b1-e606-439e-8b2f-27d300809269 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:58:02.131170 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5af195b1-e606-439e-8b2f-27d300809269 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 197764b2-3f25-43b2-9c82-071955c8052f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:58:02.140103 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5af195b1-e606-439e-8b2f-27d300809269 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:58:02.140599 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5af195b1-e606-439e-8b2f-27d300809269 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:58:02.141039 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5af195b1-e606-439e-8b2f-27d300809269 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:58:02.141744 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5af195b1-e606-439e-8b2f-27d300809269 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:58:02.142209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5af195b1-e606-439e-8b2f-27d300809269 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:58:02.142735 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5af195b1-e606-439e-8b2f-27d300809269 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:58:02.203873 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5af195b1-e606-439e-8b2f-27d300809269 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "POST /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f/action" status: 200 len: 24565 microversion: 2.1 time: 0.082423 Sep 24 21:58:02.204555 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3510/6998] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:58:02 2022] POST /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f/action => generated 24565 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:58:32.669801 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=3 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:58:32.670926 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=32 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:58:32.672461 ncdv-master-1 devstack@n-api.service[140516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 21:58:32.672699 ncdv-master-1 devstack@n-api.service[140516]: Sat Sep 24 21:58:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f/action (ip 10.222.0.52) !!! Sep 24 21:58:32.679837 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b84de07a-aa96-42d7-b0a9-2e3a556d2b1d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:58:32.680383 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b84de07a-aa96-42d7-b0a9-2e3a556d2b1d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 197764b2-3f25-43b2-9c82-071955c8052f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:58:32.691041 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b84de07a-aa96-42d7-b0a9-2e3a556d2b1d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:58:32.691526 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b84de07a-aa96-42d7-b0a9-2e3a556d2b1d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:58:32.691966 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b84de07a-aa96-42d7-b0a9-2e3a556d2b1d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:58:32.692668 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b84de07a-aa96-42d7-b0a9-2e3a556d2b1d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:58:32.693121 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b84de07a-aa96-42d7-b0a9-2e3a556d2b1d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:58:32.693545 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b84de07a-aa96-42d7-b0a9-2e3a556d2b1d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:58:32.717278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-b84de07a-aa96-42d7-b0a9-2e3a556d2b1d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lazy-loading 'flavor' on Instance uuid 197764b2-3f25-43b2-9c82-071955c8052f {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 21:58:32.783430 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b84de07a-aa96-42d7-b0a9-2e3a556d2b1d tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "POST /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f/action" status: 202 len: 0 microversion: 2.1 time: 0.115001 Sep 24 21:58:32.784167 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3489/6999] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:58:32 2022] POST /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:58:32.790995 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:58:32.791749 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=4 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:58:32.796141 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3d881abf-9903-44d3-953f-80079ec42ec3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:58:32.796862 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3d881abf-9903-44d3-953f-80079ec42ec3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 197764b2-3f25-43b2-9c82-071955c8052f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:58:32.805724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d881abf-9903-44d3-953f-80079ec42ec3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:58:32.806220 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d881abf-9903-44d3-953f-80079ec42ec3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:58:32.806722 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d881abf-9903-44d3-953f-80079ec42ec3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:58:32.807447 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d881abf-9903-44d3-953f-80079ec42ec3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:58:32.807910 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d881abf-9903-44d3-953f-80079ec42ec3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:58:32.808350 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3d881abf-9903-44d3-953f-80079ec42ec3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:58:32.943523 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3d881abf-9903-44d3-953f-80079ec42ec3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:58:32.951581 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3d881abf-9903-44d3-953f-80079ec42ec3 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f" status: 200 len: 1687 microversion: 2.1 time: 0.162942 Sep 24 21:58:32.952155 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3511/7000] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:58:32 2022] GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:58:33.976619 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-39341e8e-69ff-400d-90c1-6fc5e6599430 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:58:33.977249 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-39341e8e-69ff-400d-90c1-6fc5e6599430 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 197764b2-3f25-43b2-9c82-071955c8052f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:58:33.984669 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-39341e8e-69ff-400d-90c1-6fc5e6599430 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:58:33.985162 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-39341e8e-69ff-400d-90c1-6fc5e6599430 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:58:33.985609 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-39341e8e-69ff-400d-90c1-6fc5e6599430 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:58:33.986319 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-39341e8e-69ff-400d-90c1-6fc5e6599430 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:58:33.986816 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-39341e8e-69ff-400d-90c1-6fc5e6599430 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:58:33.987255 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-39341e8e-69ff-400d-90c1-6fc5e6599430 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:58:34.127513 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-39341e8e-69ff-400d-90c1-6fc5e6599430 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:58:34.135597 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-39341e8e-69ff-400d-90c1-6fc5e6599430 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f" status: 200 len: 1687 microversion: 2.1 time: 0.164010 Sep 24 21:58:34.136168 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3490/7001] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:58:33 2022] GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:58:35.160671 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c69e9033-8c99-4484-a904-44d3cfaec136 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:58:35.161297 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c69e9033-8c99-4484-a904-44d3cfaec136 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 197764b2-3f25-43b2-9c82-071955c8052f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:58:35.168362 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c69e9033-8c99-4484-a904-44d3cfaec136 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:58:35.168854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c69e9033-8c99-4484-a904-44d3cfaec136 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:58:35.169305 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c69e9033-8c99-4484-a904-44d3cfaec136 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:58:35.170043 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c69e9033-8c99-4484-a904-44d3cfaec136 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:58:35.170518 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c69e9033-8c99-4484-a904-44d3cfaec136 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:58:35.170968 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c69e9033-8c99-4484-a904-44d3cfaec136 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:58:35.302996 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c69e9033-8c99-4484-a904-44d3cfaec136 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:58:35.311969 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c69e9033-8c99-4484-a904-44d3cfaec136 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f" status: 200 len: 1670 microversion: 2.1 time: 0.155280 Sep 24 21:58:35.312551 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3512/7002] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:58:35 2022] GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f => generated 1670 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:58:36.409118 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e45ad52e-d57f-4686-8453-e80e43f1d159 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:58:36.411366 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e45ad52e-d57f-4686-8453-e80e43f1d159 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 197764b2-3f25-43b2-9c82-071955c8052f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:58:36.419085 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e45ad52e-d57f-4686-8453-e80e43f1d159 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:58:36.419576 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e45ad52e-d57f-4686-8453-e80e43f1d159 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:58:36.420027 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e45ad52e-d57f-4686-8453-e80e43f1d159 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:58:36.420731 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e45ad52e-d57f-4686-8453-e80e43f1d159 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:58:36.421231 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e45ad52e-d57f-4686-8453-e80e43f1d159 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:58:36.421666 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e45ad52e-d57f-4686-8453-e80e43f1d159 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:58:36.475799 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e45ad52e-d57f-4686-8453-e80e43f1d159 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "POST /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f/action" status: 200 len: 36474 microversion: 2.1 time: 0.070337 Sep 24 21:58:36.477004 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3491/7003] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:58:36 2022] POST /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f/action => generated 36474 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:58:36.488607 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2446e447-a85d-408c-9558-c162fa009cf4 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:58:36.489158 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2446e447-a85d-408c-9558-c162fa009cf4 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 197764b2-3f25-43b2-9c82-071955c8052f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:58:36.496865 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2446e447-a85d-408c-9558-c162fa009cf4 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:58:36.497356 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2446e447-a85d-408c-9558-c162fa009cf4 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:58:36.497796 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2446e447-a85d-408c-9558-c162fa009cf4 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:58:36.498530 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2446e447-a85d-408c-9558-c162fa009cf4 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:58:36.498993 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2446e447-a85d-408c-9558-c162fa009cf4 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:58:36.499425 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2446e447-a85d-408c-9558-c162fa009cf4 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:58:36.567189 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2446e447-a85d-408c-9558-c162fa009cf4 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "POST /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f/action" status: 202 len: 0 microversion: 2.1 time: 0.082328 Sep 24 21:58:36.569698 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3513/7004] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:58:36 2022] POST /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:58:36.577295 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bbec1e9d-ca6e-422f-91b6-2b0f24b91332 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:58:36.578071 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-bbec1e9d-ca6e-422f-91b6-2b0f24b91332 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 197764b2-3f25-43b2-9c82-071955c8052f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:58:36.587077 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bbec1e9d-ca6e-422f-91b6-2b0f24b91332 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:58:36.587561 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bbec1e9d-ca6e-422f-91b6-2b0f24b91332 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:58:36.588004 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bbec1e9d-ca6e-422f-91b6-2b0f24b91332 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:58:36.588813 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bbec1e9d-ca6e-422f-91b6-2b0f24b91332 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:58:36.589266 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bbec1e9d-ca6e-422f-91b6-2b0f24b91332 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:58:36.589709 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-bbec1e9d-ca6e-422f-91b6-2b0f24b91332 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:58:36.819363 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-bbec1e9d-ca6e-422f-91b6-2b0f24b91332 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:58:36.828595 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bbec1e9d-ca6e-422f-91b6-2b0f24b91332 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f" status: 200 len: 1676 microversion: 2.1 time: 0.255541 Sep 24 21:58:36.829187 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3492/7005] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:58:36 2022] GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f => generated 1676 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:58:37.853700 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-d8f559e0-b5c9-4002-be5d-e98299545193 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:58:37.854437 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-d8f559e0-b5c9-4002-be5d-e98299545193 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 197764b2-3f25-43b2-9c82-071955c8052f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:58:37.861476 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d8f559e0-b5c9-4002-be5d-e98299545193 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:58:37.861960 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d8f559e0-b5c9-4002-be5d-e98299545193 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:58:37.862401 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d8f559e0-b5c9-4002-be5d-e98299545193 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:58:37.863122 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d8f559e0-b5c9-4002-be5d-e98299545193 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:58:37.863581 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d8f559e0-b5c9-4002-be5d-e98299545193 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:58:37.864011 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-d8f559e0-b5c9-4002-be5d-e98299545193 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:58:38.003388 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-d8f559e0-b5c9-4002-be5d-e98299545193 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:58:38.011197 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-d8f559e0-b5c9-4002-be5d-e98299545193 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f" status: 200 len: 1676 microversion: 2.1 time: 0.162547 Sep 24 21:58:38.011765 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3514/7006] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:58:37 2022] GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:58:39.034410 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8d340a32-9f76-4f09-a8bf-f691ff4486a7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:58:39.035038 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8d340a32-9f76-4f09-a8bf-f691ff4486a7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 197764b2-3f25-43b2-9c82-071955c8052f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:58:39.042679 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d340a32-9f76-4f09-a8bf-f691ff4486a7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:58:39.043162 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d340a32-9f76-4f09-a8bf-f691ff4486a7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:58:39.043602 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d340a32-9f76-4f09-a8bf-f691ff4486a7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:58:39.044296 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d340a32-9f76-4f09-a8bf-f691ff4486a7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:58:39.044752 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d340a32-9f76-4f09-a8bf-f691ff4486a7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:58:39.045182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8d340a32-9f76-4f09-a8bf-f691ff4486a7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:58:39.177435 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8d340a32-9f76-4f09-a8bf-f691ff4486a7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:58:39.186032 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8d340a32-9f76-4f09-a8bf-f691ff4486a7 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f" status: 200 len: 1679 microversion: 2.1 time: 0.155549 Sep 24 21:58:39.186617 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3493/7007] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:58:39 2022] GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:58:39.287825 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0e94df22-e038-4d0a-adea-917f4ec692f8 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:58:39.290760 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0e94df22-e038-4d0a-adea-917f4ec692f8 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 197764b2-3f25-43b2-9c82-071955c8052f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:58:39.297588 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e94df22-e038-4d0a-adea-917f4ec692f8 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:58:39.298082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e94df22-e038-4d0a-adea-917f4ec692f8 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:58:39.298542 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e94df22-e038-4d0a-adea-917f4ec692f8 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:58:39.299252 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e94df22-e038-4d0a-adea-917f4ec692f8 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:58:39.299711 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e94df22-e038-4d0a-adea-917f4ec692f8 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:58:39.300142 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0e94df22-e038-4d0a-adea-917f4ec692f8 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:58:39.344048 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0e94df22-e038-4d0a-adea-917f4ec692f8 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "POST /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f/action" status: 200 len: 36474 microversion: 2.1 time: 0.060052 Sep 24 21:58:39.345989 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3515/7008] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 21:58:39 2022] POST /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f/action => generated 36474 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 21:58:40.418735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ba1262bc-2677-46ea-b062-e76c6baf30ac tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:58:40.419267 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ba1262bc-2677-46ea-b062-e76c6baf30ac tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 197764b2-3f25-43b2-9c82-071955c8052f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:58:40.426946 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba1262bc-2677-46ea-b062-e76c6baf30ac tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:58:40.427437 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba1262bc-2677-46ea-b062-e76c6baf30ac tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:58:40.427878 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba1262bc-2677-46ea-b062-e76c6baf30ac tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:58:40.429376 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba1262bc-2677-46ea-b062-e76c6baf30ac tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:58:40.430278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba1262bc-2677-46ea-b062-e76c6baf30ac tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:58:40.430987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ba1262bc-2677-46ea-b062-e76c6baf30ac tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:58:40.460101 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ba1262bc-2677-46ea-b062-e76c6baf30ac tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 197764b2-3f25-43b2-9c82-071955c8052f] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 21:58:40.522134 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-93652c46-37cd-49c6-b96f-7e49cb55cbb2 req-f44c7e25-c85a-436f-a7e2-90e84868a1f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "197764b2-3f25-43b2-9c82-071955c8052f", "tag": "0f9bd2e8-a22f-438c-a8ab-f9a00d92767e"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:58:40.533504 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-93652c46-37cd-49c6-b96f-7e49cb55cbb2 req-f44c7e25-c85a-436f-a7e2-90e84868a1f0 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:58:40.533994 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-93652c46-37cd-49c6-b96f-7e49cb55cbb2 req-f44c7e25-c85a-436f-a7e2-90e84868a1f0 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:58:40.534454 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-93652c46-37cd-49c6-b96f-7e49cb55cbb2 req-f44c7e25-c85a-436f-a7e2-90e84868a1f0 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:58:40.547713 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-93652c46-37cd-49c6-b96f-7e49cb55cbb2 req-f44c7e25-c85a-436f-a7e2-90e84868a1f0 service nova] Creating event network-changed:0f9bd2e8-a22f-438c-a8ab-f9a00d92767e for instance 197764b2-3f25-43b2-9c82-071955c8052f on nch1-master-1 Sep 24 21:58:40.551605 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ba1262bc-2677-46ea-b062-e76c6baf30ac tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "DELETE /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f" status: 204 len: 0 microversion: 2.1 time: 0.136276 Sep 24 21:58:40.552760 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3494/7009] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 21:58:40 2022] DELETE /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 21:58:40.554480 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-93652c46-37cd-49c6-b96f-7e49cb55cbb2 req-f44c7e25-c85a-436f-a7e2-90e84868a1f0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136362 Sep 24 21:58:40.555648 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3516/7010] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:58:40.563019 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6a6b6b78-850b-459b-8b06-b373ce9e5795 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:58:40.563856 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6a6b6b78-850b-459b-8b06-b373ce9e5795 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 197764b2-3f25-43b2-9c82-071955c8052f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:58:40.570300 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6a6b6b78-850b-459b-8b06-b373ce9e5795 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:58:40.571035 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6a6b6b78-850b-459b-8b06-b373ce9e5795 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:58:40.571604 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6a6b6b78-850b-459b-8b06-b373ce9e5795 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:58:40.572894 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6a6b6b78-850b-459b-8b06-b373ce9e5795 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:58:40.572894 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6a6b6b78-850b-459b-8b06-b373ce9e5795 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:58:40.573483 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6a6b6b78-850b-459b-8b06-b373ce9e5795 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:58:40.710665 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6a6b6b78-850b-459b-8b06-b373ce9e5795 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:58:40.718737 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6a6b6b78-850b-459b-8b06-b373ce9e5795 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f" status: 200 len: 1685 microversion: 2.1 time: 0.160506 Sep 24 21:58:40.719320 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3495/7011] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:58:40 2022] GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:58:41.746976 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-cd8b3ca4-9063-4256-b817-0b34a9be84ce tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:58:41.747694 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-cd8b3ca4-9063-4256-b817-0b34a9be84ce tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 197764b2-3f25-43b2-9c82-071955c8052f] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:58:41.753958 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd8b3ca4-9063-4256-b817-0b34a9be84ce tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:58:41.754448 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd8b3ca4-9063-4256-b817-0b34a9be84ce tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:58:41.754920 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd8b3ca4-9063-4256-b817-0b34a9be84ce tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:58:41.755627 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd8b3ca4-9063-4256-b817-0b34a9be84ce tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:58:41.756095 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd8b3ca4-9063-4256-b817-0b34a9be84ce tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:58:41.756538 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-cd8b3ca4-9063-4256-b817-0b34a9be84ce tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:58:41.894921 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-cd8b3ca4-9063-4256-b817-0b34a9be84ce tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:58:41.903276 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-cd8b3ca4-9063-4256-b817-0b34a9be84ce tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f" status: 200 len: 1685 microversion: 2.1 time: 0.161887 Sep 24 21:58:41.903861 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3517/7012] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:58:41 2022] GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f => generated 1685 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:58:42.929480 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e8b42c17-10eb-4cf4-a08f-69d252564cc2 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:58:42.930134 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e8b42c17-10eb-4cf4-a08f-69d252564cc2 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 197764b2-3f25-43b2-9c82-071955c8052f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:58:42.937391 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e8b42c17-10eb-4cf4-a08f-69d252564cc2 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:58:42.938388 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e8b42c17-10eb-4cf4-a08f-69d252564cc2 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:58:42.938880 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e8b42c17-10eb-4cf4-a08f-69d252564cc2 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:58:42.940062 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e8b42c17-10eb-4cf4-a08f-69d252564cc2 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:58:42.940228 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e8b42c17-10eb-4cf4-a08f-69d252564cc2 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:58:42.940732 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e8b42c17-10eb-4cf4-a08f-69d252564cc2 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:58:42.988840 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-8a33e21b-c1a1-4925-84ba-c3c2658557a6 req-3ba5a377-c5f6-453e-9519-6b8e9b75a0f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "197764b2-3f25-43b2-9c82-071955c8052f", "name": "network-vif-deleted", "tag": "0f9bd2e8-a22f-438c-a8ab-f9a00d92767e"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:58:43.005527 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-8a33e21b-c1a1-4925-84ba-c3c2658557a6 req-3ba5a377-c5f6-453e-9519-6b8e9b75a0f2 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:58:43.005926 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-8a33e21b-c1a1-4925-84ba-c3c2658557a6 req-3ba5a377-c5f6-453e-9519-6b8e9b75a0f2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:58:43.006357 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-8a33e21b-c1a1-4925-84ba-c3c2658557a6 req-3ba5a377-c5f6-453e-9519-6b8e9b75a0f2 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:58:43.020664 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e8b42c17-10eb-4cf4-a08f-69d252564cc2 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce56b96d91fa42029081bd0e6eccb5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a8ea7438b641139afc6ea3c2dcba4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:58:43.022724 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-8a33e21b-c1a1-4925-84ba-c3c2658557a6 req-3ba5a377-c5f6-453e-9519-6b8e9b75a0f2 service nova] Creating event network-vif-deleted:0f9bd2e8-a22f-438c-a8ab-f9a00d92767e for instance 197764b2-3f25-43b2-9c82-071955c8052f on nch1-master-1 Sep 24 21:58:43.029024 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e8b42c17-10eb-4cf4-a08f-69d252564cc2 tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f" status: 200 len: 1499 microversion: 2.1 time: 0.105541 Sep 24 21:58:43.029388 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-8a33e21b-c1a1-4925-84ba-c3c2658557a6 req-3ba5a377-c5f6-453e-9519-6b8e9b75a0f2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045146 Sep 24 21:58:43.042521 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3496/7013] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:58:42 2022] GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f => generated 1499 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:58:43.043151 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3518/7014] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:58:44.054694 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e8694fed-f55b-4876-bb7a-1ab8d992617a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:58:44.055248 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e8694fed-f55b-4876-bb7a-1ab8d992617a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] [instance: 197764b2-3f25-43b2-9c82-071955c8052f] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:58:44.062121 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e8694fed-f55b-4876-bb7a-1ab8d992617a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:58:44.062643 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e8694fed-f55b-4876-bb7a-1ab8d992617a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:58:44.063085 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e8694fed-f55b-4876-bb7a-1ab8d992617a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:58:44.063780 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e8694fed-f55b-4876-bb7a-1ab8d992617a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:58:44.064240 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e8694fed-f55b-4876-bb7a-1ab8d992617a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:58:44.064669 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e8694fed-f55b-4876-bb7a-1ab8d992617a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:58:44.079247 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-e8694fed-f55b-4876-bb7a-1ab8d992617a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] HTTP exception thrown: Instance 197764b2-3f25-43b2-9c82-071955c8052f could not be found. Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e8694fed-f55b-4876-bb7a-1ab8d992617a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Request method failure captured: Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f HTTP/1.1 Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL3tlY6TxOcKA9sot6kAGfifiAT7Y-vlZYlV4mDyOhDhn0ty7VdV5tSo8UlXtPCa-WwNM_dIQLhLmZ-frXjrk-rwgBb_zUbuuXPjO6n3Y8yIkG02m1UafCrWL7DDdBlhrGINN8GSujPX_7p_Mvu6-XCMNk6noAMPUuRqhchaAZc_WaoM Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 22a8ea7438b641139afc6ea3c2dcba4c Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1351374344 Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/22a8ea7438b641139afc6ea3c2dcba4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_22a8ea7438b641139afc6ea3c2dcba4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/22a8ea7438b641139afc6ea3c2dcba4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/22a8ea7438b641139afc6ea3c2dcba4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1351374344 Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 22a8ea7438b641139afc6ea3c2dcba4c Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1351374344 Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-TestNetworkAdvancedServerOps-1351374344-project Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: ce56b96d91fa42029081bd0e6eccb5e4 Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1351374344-project Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 197764b2-3f25-43b2-9c82-071955c8052f could not be found. Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '197764b2-3f25-43b2-9c82-071955c8052f'} Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 197764b2-3f25-43b2-9c82-071955c8052f could not be found. Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 197764b2-3f25-43b2-9c82-071955c8052f could not be found. Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:58:44.080931 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 21:58:44.086118 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:58:44.086118 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 21:58:44.086118 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 21:58:44.086118 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 21:58:44.086118 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 21:58:44.086118 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 21:58:44.086118 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 197764b2-3f25-43b2-9c82-071955c8052f could not be found. Sep 24 21:58:44.086118 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 21:58:44.086118 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e8694fed-f55b-4876-bb7a-1ab8d992617a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Returning 404 to user: Instance 197764b2-3f25-43b2-9c82-071955c8052f could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 21:58:44.086118 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e8694fed-f55b-4876-bb7a-1ab8d992617a tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f" status: 404 len: 111 microversion: 2.1 time: 0.032696 Sep 24 21:58:44.086118 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3497/7015] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:58:44 2022] GET /compute/v2.1/servers/197764b2-3f25-43b2-9c82-071955c8052f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 21:58:47.452187 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6c2e5943-ce46-4394-8160-2733b02e21ac tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] Calling method '.version_select at 0x7f4b07c29ee0>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:58:47.483170 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6c2e5943-ce46-4394-8160-2733b02e21ac tempest-TestNetworkAdvancedServerOps-1351374344 tempest-TestNetworkAdvancedServerOps-1351374344-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-38771863" status: 202 len: 0 microversion: 2.1 time: 0.035083 Sep 24 21:58:47.487232 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3519/7016] 10.222.0.52 () {58 vars in 1278 bytes} [Sat Sep 24 21:58:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-38771863 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 21:58:58.572527 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:58:58.574754 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:58:58.842369 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-bb03c9e6-eed4-49b9-a586-dd540933a5f0 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Action: 'create', calling method: .version_select at 0x7f4b0c983ee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1921974915", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEGtpthq9izP59hJ7+32xUZocF7eehpoJIF2CFrHOx8EF2fMBRDap63smBYovoY7pJWtbhFiY4BCpa0VT6lctgmvIdgnQSQ2LO3Mvpr0yklMYRgPSAwNOphfnMZzWNDKQ=="}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:58:58.865625 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-bb03c9e6-eed4-49b9-a586-dd540933a5f0 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Getting quotas for project 8a9daa5e226649d08e09774215b0b7d0. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:58:58.871459 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-bb03c9e6-eed4-49b9-a586-dd540933a5f0 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Getting quotas for user 0aaf38856de9425ab9909937c85b151c and project 8a9daa5e226649d08e09774215b0b7d0. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:58:58.906728 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-bb03c9e6-eed4-49b9-a586-dd540933a5f0 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.341118 Sep 24 21:58:58.907356 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3498/7017] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 21:58:58 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:58:59.973618 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-eb5e529d-20d3-4461-9011-9ec22c6ee7c1 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-809621440", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1921974915", "security_groups": [{"name": "tempest-secgroup-smoke-892765223"}], "networks": [{"uuid": "2c4d176c-1ef9-41a4-95fe-f33d8ce6f922"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:58:59.983762 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:58:59.984428 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:59:00.091186 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-eb5e529d-20d3-4461-9011-9ec22c6ee7c1 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] validate_networks() for [('2c4d176c-1ef9-41a4-95fe-f33d8ce6f922', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 21:59:00.581775 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-eb5e529d-20d3-4461-9011-9ec22c6ee7c1 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 21:59:00.582210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-eb5e529d-20d3-4461-9011-9ec22c6ee7c1 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 21:59:00.582727 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-eb5e529d-20d3-4461-9011-9ec22c6ee7c1 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 21:59:00.583176 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-eb5e529d-20d3-4461-9011-9ec22c6ee7c1 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 21:59:00.583597 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-eb5e529d-20d3-4461-9011-9ec22c6ee7c1 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 21:59:00.593194 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb5e529d-20d3-4461-9011-9ec22c6ee7c1 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:59:00.593681 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb5e529d-20d3-4461-9011-9ec22c6ee7c1 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:59:00.594122 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb5e529d-20d3-4461-9011-9ec22c6ee7c1 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:59:00.594899 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb5e529d-20d3-4461-9011-9ec22c6ee7c1 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:59:00.595361 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb5e529d-20d3-4461-9011-9ec22c6ee7c1 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:59:00.595792 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-eb5e529d-20d3-4461-9011-9ec22c6ee7c1 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:59:00.613715 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-eb5e529d-20d3-4461-9011-9ec22c6ee7c1 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Getting quotas for project 8a9daa5e226649d08e09774215b0b7d0. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 21:59:00.619548 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-eb5e529d-20d3-4461-9011-9ec22c6ee7c1 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Getting quotas for user 0aaf38856de9425ab9909937c85b151c and project 8a9daa5e226649d08e09774215b0b7d0. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 21:59:00.632505 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-eb5e529d-20d3-4461-9011-9ec22c6ee7c1 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 21:59:00.634988 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-eb5e529d-20d3-4461-9011-9ec22c6ee7c1 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 21:59:00.683708 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-eb5e529d-20d3-4461-9011-9ec22c6ee7c1 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.714186 Sep 24 21:59:00.689658 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3520/7018] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 21:58:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 21:59:00.697202 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7ea276c3-af6a-4ed4-b040-b7fdbeb466a6 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:59:00.697832 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7ea276c3-af6a-4ed4-b040-b7fdbeb466a6 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:59:00.757769 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7ea276c3-af6a-4ed4-b040-b7fdbeb466a6 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:59:00.765019 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7ea276c3-af6a-4ed4-b040-b7fdbeb466a6 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1246 microversion: 2.1 time: 0.072908 Sep 24 21:59:00.765822 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3499/7019] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:59:00 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1246 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:59:01.791054 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-dd88fde0-c3d0-4164-a564-80c457b1f116 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:59:01.792350 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-dd88fde0-c3d0-4164-a564-80c457b1f116 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:59:01.799678 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dd88fde0-c3d0-4164-a564-80c457b1f116 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:59:01.800175 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dd88fde0-c3d0-4164-a564-80c457b1f116 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:59:01.800891 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dd88fde0-c3d0-4164-a564-80c457b1f116 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:59:01.801613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dd88fde0-c3d0-4164-a564-80c457b1f116 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:59:01.802089 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dd88fde0-c3d0-4164-a564-80c457b1f116 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:59:01.802774 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-dd88fde0-c3d0-4164-a564-80c457b1f116 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:59:01.915318 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-dd88fde0-c3d0-4164-a564-80c457b1f116 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:59:01.934363 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-dd88fde0-c3d0-4164-a564-80c457b1f116 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1306 microversion: 2.1 time: 0.148388 Sep 24 21:59:01.940668 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3521/7020] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:59:01 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1306 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:59:02.959633 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-23c384f3-6a06-4927-b87a-7edf5e0dace4 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:59:02.960332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-23c384f3-6a06-4927-b87a-7edf5e0dace4 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:59:02.967384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-23c384f3-6a06-4927-b87a-7edf5e0dace4 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:59:02.968138 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-23c384f3-6a06-4927-b87a-7edf5e0dace4 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:59:02.968590 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-23c384f3-6a06-4927-b87a-7edf5e0dace4 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:59:02.969318 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-23c384f3-6a06-4927-b87a-7edf5e0dace4 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:59:02.969787 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-23c384f3-6a06-4927-b87a-7edf5e0dace4 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:59:02.970223 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-23c384f3-6a06-4927-b87a-7edf5e0dace4 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:59:03.220315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-23c384f3-6a06-4927-b87a-7edf5e0dace4 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:59:03.228278 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-23c384f3-6a06-4927-b87a-7edf5e0dace4 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1371 microversion: 2.1 time: 0.273122 Sep 24 21:59:03.228958 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3500/7021] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:59:02 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1371 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:59:03.564257 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-a9c00311-b1d9-4042-a916-fcfd7242204c req-ab20a5f8-72c2-42c5-880f-afda79627f30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3aab284-c9c1-41b6-9a4c-0000e9327c1a", "tag": "6ab34b67-122f-4945-b7c6-02e6e67d6e5c"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:59:03.577064 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-a9c00311-b1d9-4042-a916-fcfd7242204c req-ab20a5f8-72c2-42c5-880f-afda79627f30 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:59:03.577650 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-a9c00311-b1d9-4042-a916-fcfd7242204c req-ab20a5f8-72c2-42c5-880f-afda79627f30 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:59:03.578202 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-a9c00311-b1d9-4042-a916-fcfd7242204c req-ab20a5f8-72c2-42c5-880f-afda79627f30 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:59:03.590583 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-a9c00311-b1d9-4042-a916-fcfd7242204c req-ab20a5f8-72c2-42c5-880f-afda79627f30 service nova] Creating event network-changed:6ab34b67-122f-4945-b7c6-02e6e67d6e5c for instance f3aab284-c9c1-41b6-9a4c-0000e9327c1a on nch2-master-1 Sep 24 21:59:03.595823 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-a9c00311-b1d9-4042-a916-fcfd7242204c req-ab20a5f8-72c2-42c5-880f-afda79627f30 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037104 Sep 24 21:59:03.596909 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3522/7022] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 21:59:04.251124 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-51e0b6af-45c9-42c6-807d-a723f301cd0b tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:59:04.251759 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-51e0b6af-45c9-42c6-807d-a723f301cd0b tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:59:04.259026 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51e0b6af-45c9-42c6-807d-a723f301cd0b tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:59:04.259522 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51e0b6af-45c9-42c6-807d-a723f301cd0b tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:59:04.259971 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51e0b6af-45c9-42c6-807d-a723f301cd0b tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:59:04.260687 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51e0b6af-45c9-42c6-807d-a723f301cd0b tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:59:04.261151 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51e0b6af-45c9-42c6-807d-a723f301cd0b tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:59:04.261586 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-51e0b6af-45c9-42c6-807d-a723f301cd0b tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:59:04.407395 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-51e0b6af-45c9-42c6-807d-a723f301cd0b tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:59:04.416313 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-51e0b6af-45c9-42c6-807d-a723f301cd0b tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1371 microversion: 2.1 time: 0.169091 Sep 24 21:59:04.416908 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3501/7023] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:59:04 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:59:05.440447 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9700cf13-3ec7-41d7-a88a-ff8906670498 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:59:05.441192 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9700cf13-3ec7-41d7-a88a-ff8906670498 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:59:05.447587 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9700cf13-3ec7-41d7-a88a-ff8906670498 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:59:05.448075 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9700cf13-3ec7-41d7-a88a-ff8906670498 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:59:05.448515 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9700cf13-3ec7-41d7-a88a-ff8906670498 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:59:05.449214 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9700cf13-3ec7-41d7-a88a-ff8906670498 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:59:05.449675 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9700cf13-3ec7-41d7-a88a-ff8906670498 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:59:05.450104 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9700cf13-3ec7-41d7-a88a-ff8906670498 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:59:05.874404 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-9700cf13-3ec7-41d7-a88a-ff8906670498 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:59:05.882201 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9700cf13-3ec7-41d7-a88a-ff8906670498 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1371 microversion: 2.1 time: 0.446800 Sep 24 21:59:05.882812 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3523/7024] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:59:05 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1371 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:59:06.905718 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2aaf74a7-b9ab-4675-9b8e-03cd05d915e2 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:59:06.906263 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2aaf74a7-b9ab-4675-9b8e-03cd05d915e2 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:59:06.913596 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2aaf74a7-b9ab-4675-9b8e-03cd05d915e2 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:59:06.914079 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2aaf74a7-b9ab-4675-9b8e-03cd05d915e2 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:59:06.914535 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2aaf74a7-b9ab-4675-9b8e-03cd05d915e2 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:59:06.915239 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2aaf74a7-b9ab-4675-9b8e-03cd05d915e2 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:59:06.915697 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2aaf74a7-b9ab-4675-9b8e-03cd05d915e2 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:59:06.916127 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2aaf74a7-b9ab-4675-9b8e-03cd05d915e2 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:59:07.048941 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2aaf74a7-b9ab-4675-9b8e-03cd05d915e2 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:59:07.057501 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2aaf74a7-b9ab-4675-9b8e-03cd05d915e2 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1371 microversion: 2.1 time: 0.155815 Sep 24 21:59:07.058084 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3502/7025] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:59:06 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:59:08.081368 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3de8328e-5da1-456c-91c0-2c46ccc95d6c tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:59:08.081900 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3de8328e-5da1-456c-91c0-2c46ccc95d6c tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:59:08.089362 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3de8328e-5da1-456c-91c0-2c46ccc95d6c tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:59:08.089850 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3de8328e-5da1-456c-91c0-2c46ccc95d6c tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:59:08.090291 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3de8328e-5da1-456c-91c0-2c46ccc95d6c tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:59:08.091023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3de8328e-5da1-456c-91c0-2c46ccc95d6c tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:59:08.091485 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3de8328e-5da1-456c-91c0-2c46ccc95d6c tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:59:08.091916 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3de8328e-5da1-456c-91c0-2c46ccc95d6c tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:59:08.228018 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3de8328e-5da1-456c-91c0-2c46ccc95d6c tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:59:08.235732 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3de8328e-5da1-456c-91c0-2c46ccc95d6c tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1371 microversion: 2.1 time: 0.158334 Sep 24 21:59:08.236297 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3524/7026] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:59:08 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:59:09.259699 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b1c8cc53-91e3-4087-93a1-68c1899130d4 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:59:09.261319 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b1c8cc53-91e3-4087-93a1-68c1899130d4 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:59:09.268884 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1c8cc53-91e3-4087-93a1-68c1899130d4 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:59:09.269455 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1c8cc53-91e3-4087-93a1-68c1899130d4 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:59:09.269965 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1c8cc53-91e3-4087-93a1-68c1899130d4 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:59:09.270789 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1c8cc53-91e3-4087-93a1-68c1899130d4 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:59:09.271360 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1c8cc53-91e3-4087-93a1-68c1899130d4 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:59:09.271857 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b1c8cc53-91e3-4087-93a1-68c1899130d4 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:59:09.404038 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b1c8cc53-91e3-4087-93a1-68c1899130d4 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:59:09.411793 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b1c8cc53-91e3-4087-93a1-68c1899130d4 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1371 microversion: 2.1 time: 0.157106 Sep 24 21:59:09.413429 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3503/7027] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:59:09 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:59:10.436712 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e37f6aa6-54a5-4302-8b77-133bee11cb14 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:59:10.437337 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e37f6aa6-54a5-4302-8b77-133bee11cb14 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:59:10.445584 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e37f6aa6-54a5-4302-8b77-133bee11cb14 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:59:10.446088 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e37f6aa6-54a5-4302-8b77-133bee11cb14 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:59:10.446570 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e37f6aa6-54a5-4302-8b77-133bee11cb14 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:59:10.447297 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e37f6aa6-54a5-4302-8b77-133bee11cb14 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:59:10.447765 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e37f6aa6-54a5-4302-8b77-133bee11cb14 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:59:10.448198 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e37f6aa6-54a5-4302-8b77-133bee11cb14 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:59:10.535603 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-7f76bf9f-a833-467c-b31f-fc6d261112f7 req-49f7caf0-f4bb-4f99-99e1-6484ad32652d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3aab284-c9c1-41b6-9a4c-0000e9327c1a", "name": "network-vif-plugged", "status": "completed", "tag": "6ab34b67-122f-4945-b7c6-02e6e67d6e5c"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:59:10.548995 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-7f76bf9f-a833-467c-b31f-fc6d261112f7 req-49f7caf0-f4bb-4f99-99e1-6484ad32652d service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:59:10.549558 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-7f76bf9f-a833-467c-b31f-fc6d261112f7 req-49f7caf0-f4bb-4f99-99e1-6484ad32652d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:59:10.550216 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-7f76bf9f-a833-467c-b31f-fc6d261112f7 req-49f7caf0-f4bb-4f99-99e1-6484ad32652d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:59:10.563255 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-7f76bf9f-a833-467c-b31f-fc6d261112f7 req-49f7caf0-f4bb-4f99-99e1-6484ad32652d service nova] Creating event network-vif-plugged:6ab34b67-122f-4945-b7c6-02e6e67d6e5c for instance f3aab284-c9c1-41b6-9a4c-0000e9327c1a on nch2-master-1 Sep 24 21:59:10.568845 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-7f76bf9f-a833-467c-b31f-fc6d261112f7 req-49f7caf0-f4bb-4f99-99e1-6484ad32652d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037619 Sep 24 21:59:10.569455 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3504/7028] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 21:59:10.591972 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e37f6aa6-54a5-4302-8b77-133bee11cb14 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:59:10.600534 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e37f6aa6-54a5-4302-8b77-133bee11cb14 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1371 microversion: 2.1 time: 0.167854 Sep 24 21:59:10.601320 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3525/7029] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:59:10 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 21:59:11.621950 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:59:11.627132 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c5672585-ed95-45ee-b9d2-61df6007a361 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:59:11.627849 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c5672585-ed95-45ee-b9d2-61df6007a361 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:59:11.635339 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5672585-ed95-45ee-b9d2-61df6007a361 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:59:11.635786 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5672585-ed95-45ee-b9d2-61df6007a361 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:59:11.636235 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5672585-ed95-45ee-b9d2-61df6007a361 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:59:11.636950 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5672585-ed95-45ee-b9d2-61df6007a361 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:59:11.637417 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5672585-ed95-45ee-b9d2-61df6007a361 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:59:11.637860 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c5672585-ed95-45ee-b9d2-61df6007a361 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:59:11.780586 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c5672585-ed95-45ee-b9d2-61df6007a361 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:59:11.790268 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c5672585-ed95-45ee-b9d2-61df6007a361 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1371 microversion: 2.1 time: 0.169243 Sep 24 21:59:11.790891 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3505/7030] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:59:11 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:59:12.813832 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-1a706332-38f5-4fdb-9fe4-eefbb59217ed tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:59:12.814437 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-1a706332-38f5-4fdb-9fe4-eefbb59217ed tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:59:12.816427 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:59:12.817246 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=6 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:59:12.825462 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a706332-38f5-4fdb-9fe4-eefbb59217ed tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:59:12.825946 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a706332-38f5-4fdb-9fe4-eefbb59217ed tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:59:12.826382 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a706332-38f5-4fdb-9fe4-eefbb59217ed tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:59:12.827219 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a706332-38f5-4fdb-9fe4-eefbb59217ed tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:59:12.827684 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a706332-38f5-4fdb-9fe4-eefbb59217ed tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:59:12.828115 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-1a706332-38f5-4fdb-9fe4-eefbb59217ed tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:59:12.962596 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-1a706332-38f5-4fdb-9fe4-eefbb59217ed tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:59:12.970304 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-1a706332-38f5-4fdb-9fe4-eefbb59217ed tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1556 microversion: 2.1 time: 0.160360 Sep 24 21:59:12.970998 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3526/7031] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:59:12 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:59:12.992857 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8e429e28-82b3-4119-b829-fbfc6c4c0d69 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 21:59:12.993490 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8e429e28-82b3-4119-b829-fbfc6c4c0d69 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 21:59:13.000473 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8e429e28-82b3-4119-b829-fbfc6c4c0d69 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:59:13.000967 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8e429e28-82b3-4119-b829-fbfc6c4c0d69 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:59:13.001415 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8e429e28-82b3-4119-b829-fbfc6c4c0d69 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:59:13.002121 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8e429e28-82b3-4119-b829-fbfc6c4c0d69 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:59:13.002735 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8e429e28-82b3-4119-b829-fbfc6c4c0d69 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:59:13.003179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8e429e28-82b3-4119-b829-fbfc6c4c0d69 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:59:13.133126 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8e429e28-82b3-4119-b829-fbfc6c4c0d69 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 21:59:13.140942 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8e429e28-82b3-4119-b829-fbfc6c4c0d69 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1556 microversion: 2.1 time: 0.152016 Sep 24 21:59:13.141517 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3506/7032] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 21:59:12 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 21:59:14.773906 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-8d4b9f61-0e23-401a-aae5-75e2e44e5fc1 req-004975a1-632b-4530-b199-ab54b10dd953 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3aab284-c9c1-41b6-9a4c-0000e9327c1a", "tag": "6ab34b67-122f-4945-b7c6-02e6e67d6e5c"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 21:59:14.784354 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-8d4b9f61-0e23-401a-aae5-75e2e44e5fc1 req-004975a1-632b-4530-b199-ab54b10dd953 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 21:59:14.784833 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-8d4b9f61-0e23-401a-aae5-75e2e44e5fc1 req-004975a1-632b-4530-b199-ab54b10dd953 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 21:59:14.785265 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-8d4b9f61-0e23-401a-aae5-75e2e44e5fc1 req-004975a1-632b-4530-b199-ab54b10dd953 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 21:59:14.796306 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-8d4b9f61-0e23-401a-aae5-75e2e44e5fc1 req-004975a1-632b-4530-b199-ab54b10dd953 service nova] Creating event network-changed:6ab34b67-122f-4945-b7c6-02e6e67d6e5c for instance f3aab284-c9c1-41b6-9a4c-0000e9327c1a on nch2-master-1 Sep 24 21:59:14.802800 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-8d4b9f61-0e23-401a-aae5-75e2e44e5fc1 req-004975a1-632b-4530-b199-ab54b10dd953 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031684 Sep 24 21:59:14.803524 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3527/7033] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 21:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 22:01:10.217406 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:01:10.218196 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=38 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:01:10.223628 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d8a8a023-4811-4f64-bbfd-401bdfaa9c27 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 22:01:10.224164 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d8a8a023-4811-4f64-bbfd-401bdfaa9c27 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:10.232318 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d8a8a023-4811-4f64-bbfd-401bdfaa9c27 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:10.232847 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d8a8a023-4811-4f64-bbfd-401bdfaa9c27 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:10.233363 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d8a8a023-4811-4f64-bbfd-401bdfaa9c27 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:10.234166 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d8a8a023-4811-4f64-bbfd-401bdfaa9c27 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:10.234761 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d8a8a023-4811-4f64-bbfd-401bdfaa9c27 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:10.235261 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d8a8a023-4811-4f64-bbfd-401bdfaa9c27 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:10.260122 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.objects.instance [None req-d8a8a023-4811-4f64-bbfd-401bdfaa9c27 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lazy-loading 'flavor' on Instance uuid f3aab284-c9c1-41b6-9a4c-0000e9327c1a {{(pid=140516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 22:01:10.571146 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d8a8a023-4811-4f64-bbfd-401bdfaa9c27 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "POST /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a/action" status: 202 len: 0 microversion: 2.1 time: 0.355522 Sep 24 22:01:10.571756 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3507/7034] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 22:01:10 2022] POST /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 22:01:10.578989 ncdv-master-1 devstack@n-api.service[140517]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e1087534-8c05-43ce-a203-528e6b6bc7c7] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 24 22:01:10.581264 ncdv-master-1 devstack@n-api.service[140517]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aa974483-35f8-468d-af64-c307bf04d159] AMQP server on 10.222.0.52:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 24 22:01:10.581867 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:01:10.582814 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=36 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:01:10.589679 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b5d3bc7d-b926-41ec-b9f7-eccd5c117a11 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:10.590432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b5d3bc7d-b926-41ec-b9f7-eccd5c117a11 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:10.599429 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b5d3bc7d-b926-41ec-b9f7-eccd5c117a11 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:10.599927 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b5d3bc7d-b926-41ec-b9f7-eccd5c117a11 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:10.600379 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b5d3bc7d-b926-41ec-b9f7-eccd5c117a11 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:10.601921 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b5d3bc7d-b926-41ec-b9f7-eccd5c117a11 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:10.602382 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b5d3bc7d-b926-41ec-b9f7-eccd5c117a11 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:10.602850 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b5d3bc7d-b926-41ec-b9f7-eccd5c117a11 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:10.791896 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b5d3bc7d-b926-41ec-b9f7-eccd5c117a11 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:10.799780 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b5d3bc7d-b926-41ec-b9f7-eccd5c117a11 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1680 microversion: 2.1 time: 0.223334 Sep 24 22:01:10.800624 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3528/7035] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:10 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1680 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:01:11.825852 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f4fe4101-6734-4861-962e-c3b6d29c09cb tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:11.826603 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f4fe4101-6734-4861-962e-c3b6d29c09cb tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:11.833822 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4fe4101-6734-4861-962e-c3b6d29c09cb tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:11.834309 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4fe4101-6734-4861-962e-c3b6d29c09cb tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:11.834782 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4fe4101-6734-4861-962e-c3b6d29c09cb tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:11.836097 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4fe4101-6734-4861-962e-c3b6d29c09cb tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:11.836563 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4fe4101-6734-4861-962e-c3b6d29c09cb tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:11.836995 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f4fe4101-6734-4861-962e-c3b6d29c09cb tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:11.968932 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f4fe4101-6734-4861-962e-c3b6d29c09cb tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:11.977416 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f4fe4101-6734-4861-962e-c3b6d29c09cb tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1680 microversion: 2.1 time: 0.156909 Sep 24 22:01:11.977994 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3508/7036] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:11 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:01:13.000499 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0f4a6452-2aa7-4499-ae4d-027f77f5d966 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:13.001128 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0f4a6452-2aa7-4499-ae4d-027f77f5d966 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:13.014018 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f4a6452-2aa7-4499-ae4d-027f77f5d966 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:13.014538 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f4a6452-2aa7-4499-ae4d-027f77f5d966 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:13.015018 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f4a6452-2aa7-4499-ae4d-027f77f5d966 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:13.015724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f4a6452-2aa7-4499-ae4d-027f77f5d966 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:13.016186 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f4a6452-2aa7-4499-ae4d-027f77f5d966 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:13.016623 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0f4a6452-2aa7-4499-ae4d-027f77f5d966 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:13.020438 ncdv-master-1 devstack@n-api.service[140517]: INFO oslo.messaging._drivers.impl_rabbit [-] [e1087534-8c05-43ce-a203-528e6b6bc7c7] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 60030. Sep 24 22:01:13.023675 ncdv-master-1 devstack@n-api.service[140517]: INFO oslo.messaging._drivers.impl_rabbit [-] [aa974483-35f8-468d-af64-c307bf04d159] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 60032. Sep 24 22:01:13.149084 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0f4a6452-2aa7-4499-ae4d-027f77f5d966 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:13.157200 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0f4a6452-2aa7-4499-ae4d-027f77f5d966 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1680 microversion: 2.1 time: 0.160616 Sep 24 22:01:13.157773 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3529/7037] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:12 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:01:14.181641 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-faf6f888-2c9c-4215-ab66-12b145e2b810 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:14.182290 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-faf6f888-2c9c-4215-ab66-12b145e2b810 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:14.189217 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-faf6f888-2c9c-4215-ab66-12b145e2b810 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:14.189704 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-faf6f888-2c9c-4215-ab66-12b145e2b810 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:14.190146 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-faf6f888-2c9c-4215-ab66-12b145e2b810 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:14.190875 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-faf6f888-2c9c-4215-ab66-12b145e2b810 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:14.191340 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-faf6f888-2c9c-4215-ab66-12b145e2b810 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:14.191767 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-faf6f888-2c9c-4215-ab66-12b145e2b810 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:14.327947 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-faf6f888-2c9c-4215-ab66-12b145e2b810 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:14.335709 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-faf6f888-2c9c-4215-ab66-12b145e2b810 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1680 microversion: 2.1 time: 0.158624 Sep 24 22:01:14.336284 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3509/7038] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:14 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:01:15.359081 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-e8ae07dc-1f0e-46f1-b961-709a48dd7777 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:15.359700 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-e8ae07dc-1f0e-46f1-b961-709a48dd7777 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:15.366864 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e8ae07dc-1f0e-46f1-b961-709a48dd7777 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:15.367357 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e8ae07dc-1f0e-46f1-b961-709a48dd7777 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:15.367804 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e8ae07dc-1f0e-46f1-b961-709a48dd7777 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:15.368498 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e8ae07dc-1f0e-46f1-b961-709a48dd7777 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:15.368961 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e8ae07dc-1f0e-46f1-b961-709a48dd7777 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:15.369389 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-e8ae07dc-1f0e-46f1-b961-709a48dd7777 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:15.500562 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-e8ae07dc-1f0e-46f1-b961-709a48dd7777 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:15.508838 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-e8ae07dc-1f0e-46f1-b961-709a48dd7777 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1680 microversion: 2.1 time: 0.153700 Sep 24 22:01:15.509414 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3530/7039] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:15 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:01:16.532508 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6906025a-51b9-4acc-9817-4bf75e221d8a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:16.533135 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6906025a-51b9-4acc-9817-4bf75e221d8a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:16.540210 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6906025a-51b9-4acc-9817-4bf75e221d8a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:16.540701 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6906025a-51b9-4acc-9817-4bf75e221d8a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:16.541139 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6906025a-51b9-4acc-9817-4bf75e221d8a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:16.541847 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6906025a-51b9-4acc-9817-4bf75e221d8a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:16.542307 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6906025a-51b9-4acc-9817-4bf75e221d8a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:16.542781 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6906025a-51b9-4acc-9817-4bf75e221d8a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:16.680835 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6906025a-51b9-4acc-9817-4bf75e221d8a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:16.688708 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6906025a-51b9-4acc-9817-4bf75e221d8a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1680 microversion: 2.1 time: 0.160200 Sep 24 22:01:16.689293 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3510/7040] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:16 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:01:17.713480 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-35536510-c8ba-4ea3-b404-3158db2d2ef7 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:17.714105 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-35536510-c8ba-4ea3-b404-3158db2d2ef7 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:17.720987 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-35536510-c8ba-4ea3-b404-3158db2d2ef7 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:17.721474 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-35536510-c8ba-4ea3-b404-3158db2d2ef7 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:17.721914 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-35536510-c8ba-4ea3-b404-3158db2d2ef7 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:17.722637 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-35536510-c8ba-4ea3-b404-3158db2d2ef7 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:17.723102 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-35536510-c8ba-4ea3-b404-3158db2d2ef7 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:17.723528 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-35536510-c8ba-4ea3-b404-3158db2d2ef7 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:17.858067 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-35536510-c8ba-4ea3-b404-3158db2d2ef7 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:17.865742 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-35536510-c8ba-4ea3-b404-3158db2d2ef7 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1680 microversion: 2.1 time: 0.157364 Sep 24 22:01:17.867039 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3531/7041] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:17 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:01:18.889291 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-938422b0-8cfb-4999-aacf-78fd1759b84f tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:18.889833 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-938422b0-8cfb-4999-aacf-78fd1759b84f tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:18.896747 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-938422b0-8cfb-4999-aacf-78fd1759b84f tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:18.897899 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-938422b0-8cfb-4999-aacf-78fd1759b84f tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:18.898597 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-938422b0-8cfb-4999-aacf-78fd1759b84f tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:18.899309 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-938422b0-8cfb-4999-aacf-78fd1759b84f tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:18.899769 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-938422b0-8cfb-4999-aacf-78fd1759b84f tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:18.900201 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-938422b0-8cfb-4999-aacf-78fd1759b84f tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:19.039128 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-938422b0-8cfb-4999-aacf-78fd1759b84f tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:19.046994 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-938422b0-8cfb-4999-aacf-78fd1759b84f tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1680 microversion: 2.1 time: 0.161685 Sep 24 22:01:19.047586 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3511/7042] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:18 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:01:20.071246 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-7d0c6920-43ae-4377-8cbf-5422d96d2a16 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:20.071804 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-7d0c6920-43ae-4377-8cbf-5422d96d2a16 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:20.078662 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d0c6920-43ae-4377-8cbf-5422d96d2a16 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:20.079150 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d0c6920-43ae-4377-8cbf-5422d96d2a16 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:20.079588 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d0c6920-43ae-4377-8cbf-5422d96d2a16 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:20.080280 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d0c6920-43ae-4377-8cbf-5422d96d2a16 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:20.080734 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d0c6920-43ae-4377-8cbf-5422d96d2a16 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:20.081163 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-7d0c6920-43ae-4377-8cbf-5422d96d2a16 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:20.212720 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-7d0c6920-43ae-4377-8cbf-5422d96d2a16 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:20.220493 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-7d0c6920-43ae-4377-8cbf-5422d96d2a16 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1680 microversion: 2.1 time: 0.153799 Sep 24 22:01:20.221063 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3532/7043] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:20 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:01:21.244182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-f1f2bc96-c3be-4414-8d01-97339e4d61cc tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:21.244820 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-f1f2bc96-c3be-4414-8d01-97339e4d61cc tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:21.251811 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1f2bc96-c3be-4414-8d01-97339e4d61cc tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:21.252299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1f2bc96-c3be-4414-8d01-97339e4d61cc tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:21.252743 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1f2bc96-c3be-4414-8d01-97339e4d61cc tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:21.253450 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1f2bc96-c3be-4414-8d01-97339e4d61cc tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:21.253907 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1f2bc96-c3be-4414-8d01-97339e4d61cc tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:21.254340 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-f1f2bc96-c3be-4414-8d01-97339e4d61cc tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:21.386929 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-f1f2bc96-c3be-4414-8d01-97339e4d61cc tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:21.394758 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-f1f2bc96-c3be-4414-8d01-97339e4d61cc tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1701 microversion: 2.1 time: 0.155187 Sep 24 22:01:21.395341 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3512/7044] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:21 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1701 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:01:22.418576 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c0d93bae-0535-4481-9c92-9845e8c847cc tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:22.419208 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c0d93bae-0535-4481-9c92-9845e8c847cc tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:22.426891 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0d93bae-0535-4481-9c92-9845e8c847cc tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:22.427400 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0d93bae-0535-4481-9c92-9845e8c847cc tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:22.427934 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0d93bae-0535-4481-9c92-9845e8c847cc tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:22.429234 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0d93bae-0535-4481-9c92-9845e8c847cc tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:22.429774 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0d93bae-0535-4481-9c92-9845e8c847cc tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:22.430259 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c0d93bae-0535-4481-9c92-9845e8c847cc tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:22.567291 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c0d93bae-0535-4481-9c92-9845e8c847cc tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:22.576116 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c0d93bae-0535-4481-9c92-9845e8c847cc tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1701 microversion: 2.1 time: 0.161745 Sep 24 22:01:22.576706 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3533/7045] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:22 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1701 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 22:01:23.600799 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5b635045-ef41-4c21-8c9e-471507ace92a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:23.602135 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5b635045-ef41-4c21-8c9e-471507ace92a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:23.609574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b635045-ef41-4c21-8c9e-471507ace92a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:23.610586 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b635045-ef41-4c21-8c9e-471507ace92a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:23.610586 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b635045-ef41-4c21-8c9e-471507ace92a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:23.611274 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b635045-ef41-4c21-8c9e-471507ace92a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:23.611741 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b635045-ef41-4c21-8c9e-471507ace92a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:23.612438 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5b635045-ef41-4c21-8c9e-471507ace92a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:23.769597 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5b635045-ef41-4c21-8c9e-471507ace92a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:23.778167 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5b635045-ef41-4c21-8c9e-471507ace92a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1696 microversion: 2.1 time: 0.181788 Sep 24 22:01:23.778885 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3513/7046] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:23 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1696 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:01:24.802991 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f15b70bb-6e27-4197-8f84-837833719214 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:24.805165 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f15b70bb-6e27-4197-8f84-837833719214 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:24.812758 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f15b70bb-6e27-4197-8f84-837833719214 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:24.813461 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f15b70bb-6e27-4197-8f84-837833719214 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:24.814076 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f15b70bb-6e27-4197-8f84-837833719214 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:24.814843 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f15b70bb-6e27-4197-8f84-837833719214 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:24.816089 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f15b70bb-6e27-4197-8f84-837833719214 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:24.816089 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f15b70bb-6e27-4197-8f84-837833719214 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:24.978158 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-f15b70bb-6e27-4197-8f84-837833719214 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:24.986511 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f15b70bb-6e27-4197-8f84-837833719214 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1696 microversion: 2.1 time: 0.187871 Sep 24 22:01:24.999162 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3534/7047] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:24 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1696 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:01:25.427120 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-8ab4c664-12f3-4543-95a8-7a8a49a574bc req-333d1d2e-7245-4bf8-b3e7-b75e6d21b4ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3aab284-c9c1-41b6-9a4c-0000e9327c1a", "name": "network-vif-plugged", "status": "completed", "tag": "6ab34b67-122f-4945-b7c6-02e6e67d6e5c"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 22:01:25.438670 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-8ab4c664-12f3-4543-95a8-7a8a49a574bc req-333d1d2e-7245-4bf8-b3e7-b75e6d21b4ef service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:25.439297 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-8ab4c664-12f3-4543-95a8-7a8a49a574bc req-333d1d2e-7245-4bf8-b3e7-b75e6d21b4ef service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:25.439837 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-8ab4c664-12f3-4543-95a8-7a8a49a574bc req-333d1d2e-7245-4bf8-b3e7-b75e6d21b4ef service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:25.453528 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-8ab4c664-12f3-4543-95a8-7a8a49a574bc req-333d1d2e-7245-4bf8-b3e7-b75e6d21b4ef service nova] Creating event network-vif-plugged:6ab34b67-122f-4945-b7c6-02e6e67d6e5c for instance f3aab284-c9c1-41b6-9a4c-0000e9327c1a on nch2-master-1 Sep 24 22:01:25.460624 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-8ab4c664-12f3-4543-95a8-7a8a49a574bc req-333d1d2e-7245-4bf8-b3e7-b75e6d21b4ef service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117830 Sep 24 22:01:25.461378 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3514/7048] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 22:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 22:01:26.014466 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ca76c2d9-c299-412a-b09c-6e7efd345ada tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:26.015370 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ca76c2d9-c299-412a-b09c-6e7efd345ada tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:26.022753 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ca76c2d9-c299-412a-b09c-6e7efd345ada tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:26.023577 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ca76c2d9-c299-412a-b09c-6e7efd345ada tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:26.024153 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ca76c2d9-c299-412a-b09c-6e7efd345ada tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:26.025507 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ca76c2d9-c299-412a-b09c-6e7efd345ada tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:26.026155 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ca76c2d9-c299-412a-b09c-6e7efd345ada tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:26.026720 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ca76c2d9-c299-412a-b09c-6e7efd345ada tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:26.187023 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ca76c2d9-c299-412a-b09c-6e7efd345ada tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:26.199545 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ca76c2d9-c299-412a-b09c-6e7efd345ada tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1696 microversion: 2.1 time: 0.190943 Sep 24 22:01:26.217253 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3535/7049] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:26 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1696 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:01:27.226486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-8dff70bd-7ad5-43eb-a26e-99eeb93ce933 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:27.228034 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-8dff70bd-7ad5-43eb-a26e-99eeb93ce933 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:27.236490 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8dff70bd-7ad5-43eb-a26e-99eeb93ce933 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:27.237302 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8dff70bd-7ad5-43eb-a26e-99eeb93ce933 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:27.237926 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8dff70bd-7ad5-43eb-a26e-99eeb93ce933 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:27.238672 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8dff70bd-7ad5-43eb-a26e-99eeb93ce933 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:27.239128 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8dff70bd-7ad5-43eb-a26e-99eeb93ce933 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:27.239729 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-8dff70bd-7ad5-43eb-a26e-99eeb93ce933 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:27.399797 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-8dff70bd-7ad5-43eb-a26e-99eeb93ce933 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:27.410063 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-8dff70bd-7ad5-43eb-a26e-99eeb93ce933 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1696 microversion: 2.1 time: 0.189223 Sep 24 22:01:27.427451 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3515/7050] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:27 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1696 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:01:28.436532 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5cfeca96-0482-4a8a-986f-d6a8b66679ae tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:28.437187 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5cfeca96-0482-4a8a-986f-d6a8b66679ae tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:28.450760 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5cfeca96-0482-4a8a-986f-d6a8b66679ae tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:28.451260 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5cfeca96-0482-4a8a-986f-d6a8b66679ae tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:28.454715 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5cfeca96-0482-4a8a-986f-d6a8b66679ae tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:28.455545 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5cfeca96-0482-4a8a-986f-d6a8b66679ae tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:28.456034 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5cfeca96-0482-4a8a-986f-d6a8b66679ae tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:28.458235 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5cfeca96-0482-4a8a-986f-d6a8b66679ae tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:28.625866 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5cfeca96-0482-4a8a-986f-d6a8b66679ae tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:28.636155 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5cfeca96-0482-4a8a-986f-d6a8b66679ae tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1696 microversion: 2.1 time: 0.203507 Sep 24 22:01:28.651042 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3536/7051] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:28 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1696 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:01:29.660796 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b29d9832-0a4e-4887-b7fa-538d7745dbe7 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:29.661451 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b29d9832-0a4e-4887-b7fa-538d7745dbe7 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:29.669036 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b29d9832-0a4e-4887-b7fa-538d7745dbe7 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:29.669534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b29d9832-0a4e-4887-b7fa-538d7745dbe7 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:29.670487 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b29d9832-0a4e-4887-b7fa-538d7745dbe7 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:29.673486 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b29d9832-0a4e-4887-b7fa-538d7745dbe7 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:29.674669 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b29d9832-0a4e-4887-b7fa-538d7745dbe7 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:29.675448 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b29d9832-0a4e-4887-b7fa-538d7745dbe7 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:29.829179 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b29d9832-0a4e-4887-b7fa-538d7745dbe7 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:29.839489 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b29d9832-0a4e-4887-b7fa-538d7745dbe7 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1696 microversion: 2.1 time: 0.181610 Sep 24 22:01:29.841736 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3516/7052] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:29 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1696 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:01:30.863802 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-904e257c-9071-4a11-8e9a-dc88e4d40c86 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:30.864499 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-904e257c-9071-4a11-8e9a-dc88e4d40c86 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:30.874054 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-904e257c-9071-4a11-8e9a-dc88e4d40c86 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:30.874054 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-904e257c-9071-4a11-8e9a-dc88e4d40c86 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:30.874054 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-904e257c-9071-4a11-8e9a-dc88e4d40c86 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:30.874054 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-904e257c-9071-4a11-8e9a-dc88e4d40c86 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:30.875523 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-904e257c-9071-4a11-8e9a-dc88e4d40c86 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:30.875523 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-904e257c-9071-4a11-8e9a-dc88e4d40c86 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:31.029867 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-904e257c-9071-4a11-8e9a-dc88e4d40c86 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:31.038702 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-904e257c-9071-4a11-8e9a-dc88e4d40c86 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1696 microversion: 2.1 time: 0.178883 Sep 24 22:01:31.048563 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3537/7053] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:30 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1696 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:01:32.062873 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-57e55b56-769e-43d2-93ea-5245f597e2e9 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:32.063787 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-57e55b56-769e-43d2-93ea-5245f597e2e9 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:32.071915 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-57e55b56-769e-43d2-93ea-5245f597e2e9 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:32.072832 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-57e55b56-769e-43d2-93ea-5245f597e2e9 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:32.073527 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-57e55b56-769e-43d2-93ea-5245f597e2e9 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:32.074515 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-57e55b56-769e-43d2-93ea-5245f597e2e9 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:32.075203 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-57e55b56-769e-43d2-93ea-5245f597e2e9 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:32.075854 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-57e55b56-769e-43d2-93ea-5245f597e2e9 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:32.243547 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-57e55b56-769e-43d2-93ea-5245f597e2e9 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:32.252491 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-57e55b56-769e-43d2-93ea-5245f597e2e9 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1696 microversion: 2.1 time: 0.193979 Sep 24 22:01:32.253177 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3517/7054] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:32 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1696 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:01:33.277210 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2ea8817a-1c73-45f5-8727-0aa74e1b8a38 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:33.277764 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2ea8817a-1c73-45f5-8727-0aa74e1b8a38 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:33.284656 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ea8817a-1c73-45f5-8727-0aa74e1b8a38 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:33.285140 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ea8817a-1c73-45f5-8727-0aa74e1b8a38 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:33.285577 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ea8817a-1c73-45f5-8727-0aa74e1b8a38 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:33.286268 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ea8817a-1c73-45f5-8727-0aa74e1b8a38 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:33.286754 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ea8817a-1c73-45f5-8727-0aa74e1b8a38 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:33.287731 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ea8817a-1c73-45f5-8727-0aa74e1b8a38 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:33.472855 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2ea8817a-1c73-45f5-8727-0aa74e1b8a38 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:33.481321 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2ea8817a-1c73-45f5-8727-0aa74e1b8a38 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1678 microversion: 2.1 time: 0.208062 Sep 24 22:01:33.481912 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3538/7055] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:33 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1678 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 22:01:34.505249 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a5bfd09b-4d8a-4ca9-a683-adf661bea37d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:34.506006 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-a5bfd09b-4d8a-4ca9-a683-adf661bea37d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:34.512906 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5bfd09b-4d8a-4ca9-a683-adf661bea37d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:34.513397 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5bfd09b-4d8a-4ca9-a683-adf661bea37d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:34.513842 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5bfd09b-4d8a-4ca9-a683-adf661bea37d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:34.514565 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5bfd09b-4d8a-4ca9-a683-adf661bea37d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:34.515032 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5bfd09b-4d8a-4ca9-a683-adf661bea37d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:34.515466 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-a5bfd09b-4d8a-4ca9-a683-adf661bea37d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:34.929574 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-a5bfd09b-4d8a-4ca9-a683-adf661bea37d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:34.937419 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a5bfd09b-4d8a-4ca9-a683-adf661bea37d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1678 microversion: 2.1 time: 0.436106 Sep 24 22:01:34.937993 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3518/7056] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:34 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1678 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:01:35.961878 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3bee097d-2da9-45f2-96fa-2039dfa49f4c tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:35.962456 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3bee097d-2da9-45f2-96fa-2039dfa49f4c tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:35.969269 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3bee097d-2da9-45f2-96fa-2039dfa49f4c tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:35.969767 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3bee097d-2da9-45f2-96fa-2039dfa49f4c tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:35.970205 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3bee097d-2da9-45f2-96fa-2039dfa49f4c tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:35.971009 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3bee097d-2da9-45f2-96fa-2039dfa49f4c tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:35.971747 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3bee097d-2da9-45f2-96fa-2039dfa49f4c tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:35.972201 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3bee097d-2da9-45f2-96fa-2039dfa49f4c tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:36.102962 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3bee097d-2da9-45f2-96fa-2039dfa49f4c tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:36.110793 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3bee097d-2da9-45f2-96fa-2039dfa49f4c tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1621 microversion: 2.1 time: 0.153740 Sep 24 22:01:36.111368 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3539/7057] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:35 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1621 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:01:36.133992 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-fb2478c5-41a5-429b-9b3b-0fb4fd93df42 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 22:01:36.134636 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fb2478c5-41a5-429b-9b3b-0fb4fd93df42 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:36.141487 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb2478c5-41a5-429b-9b3b-0fb4fd93df42 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:36.141974 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb2478c5-41a5-429b-9b3b-0fb4fd93df42 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:36.142426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb2478c5-41a5-429b-9b3b-0fb4fd93df42 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:36.143156 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb2478c5-41a5-429b-9b3b-0fb4fd93df42 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:36.143616 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb2478c5-41a5-429b-9b3b-0fb4fd93df42 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:36.144060 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-fb2478c5-41a5-429b-9b3b-0fb4fd93df42 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:36.227858 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-fb2478c5-41a5-429b-9b3b-0fb4fd93df42 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=140516) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 24 22:01:36.292255 ncdv-master-1 devstack@n-api.service[140516]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fb2478c5-41a5-429b-9b3b-0fb4fd93df42 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [17da7c4b-7220-44fe-949d-de08d5c24fc1] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 24 22:01:37.301574 ncdv-master-1 devstack@n-api.service[140516]: INFO oslo.messaging._drivers.impl_rabbit [None req-fb2478c5-41a5-429b-9b3b-0fb4fd93df42 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [17da7c4b-7220-44fe-949d-de08d5c24fc1] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 60138. Sep 24 22:01:37.306561 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-fb2478c5-41a5-429b-9b3b-0fb4fd93df42 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "POST /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a/action" status: 202 len: 0 microversion: 2.1 time: 1.176735 Sep 24 22:01:37.307202 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3519/7058] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 22:01:36 2022] POST /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a/action => generated 0 bytes in 1178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 22:01:37.316181 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-527bdffa-0b02-4dfb-8bcd-9a1dcd201526 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:37.317429 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-527bdffa-0b02-4dfb-8bcd-9a1dcd201526 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:37.324968 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-527bdffa-0b02-4dfb-8bcd-9a1dcd201526 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:37.325478 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-527bdffa-0b02-4dfb-8bcd-9a1dcd201526 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:37.325948 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-527bdffa-0b02-4dfb-8bcd-9a1dcd201526 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:37.326773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-527bdffa-0b02-4dfb-8bcd-9a1dcd201526 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:37.327242 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-527bdffa-0b02-4dfb-8bcd-9a1dcd201526 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:37.327816 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-527bdffa-0b02-4dfb-8bcd-9a1dcd201526 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:37.329426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-79c03d68-64ff-4e42-814d-2697a43ca3d3 req-0dbdeafd-f91e-4db8-864d-a0820b8ab53a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3aab284-c9c1-41b6-9a4c-0000e9327c1a", "name": "network-vif-unplugged", "status": "completed", "tag": "6ab34b67-122f-4945-b7c6-02e6e67d6e5c"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 22:01:37.351400 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-79c03d68-64ff-4e42-814d-2697a43ca3d3 req-0dbdeafd-f91e-4db8-864d-a0820b8ab53a service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:37.351887 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-79c03d68-64ff-4e42-814d-2697a43ca3d3 req-0dbdeafd-f91e-4db8-864d-a0820b8ab53a service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:37.352322 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-79c03d68-64ff-4e42-814d-2697a43ca3d3 req-0dbdeafd-f91e-4db8-864d-a0820b8ab53a service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:37.364350 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.compute.server_external_events [req-79c03d68-64ff-4e42-814d-2697a43ca3d3 req-0dbdeafd-f91e-4db8-864d-a0820b8ab53a service nova] Unable to find a host for instance f3aab284-c9c1-41b6-9a4c-0000e9327c1a. Dropping event network-vif-unplugged {{(pid=140516) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 24 22:01:37.365852 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-79c03d68-64ff-4e42-814d-2697a43ca3d3 req-0dbdeafd-f91e-4db8-864d-a0820b8ab53a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.042175 Sep 24 22:01:37.367352 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3520/7059] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 22:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 44 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 24 22:01:37.475487 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-527bdffa-0b02-4dfb-8bcd-9a1dcd201526 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:37.483525 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-527bdffa-0b02-4dfb-8bcd-9a1dcd201526 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1629 microversion: 2.1 time: 0.172040 Sep 24 22:01:37.484106 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3540/7060] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:37 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1629 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:01:38.507952 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e560b5b0-64a3-480e-ac70-2dd51c5a75a5 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:38.508569 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e560b5b0-64a3-480e-ac70-2dd51c5a75a5 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:38.515528 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e560b5b0-64a3-480e-ac70-2dd51c5a75a5 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:38.516011 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e560b5b0-64a3-480e-ac70-2dd51c5a75a5 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:38.516449 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e560b5b0-64a3-480e-ac70-2dd51c5a75a5 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:38.517140 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e560b5b0-64a3-480e-ac70-2dd51c5a75a5 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:38.517595 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e560b5b0-64a3-480e-ac70-2dd51c5a75a5 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:38.518023 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e560b5b0-64a3-480e-ac70-2dd51c5a75a5 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:38.689009 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e560b5b0-64a3-480e-ac70-2dd51c5a75a5 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:38.692700 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:01:38.699214 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e560b5b0-64a3-480e-ac70-2dd51c5a75a5 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1687 microversion: 2.1 time: 0.195763 Sep 24 22:01:38.699805 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3521/7061] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:38 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1687 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:01:39.551920 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-28a116d5-9c16-4312-a9b7-91ceb9177e6b req-6f968b72-432f-48f8-bd79-485bff95932a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3aab284-c9c1-41b6-9a4c-0000e9327c1a", "tag": "6ab34b67-122f-4945-b7c6-02e6e67d6e5c"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 22:01:39.563597 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-28a116d5-9c16-4312-a9b7-91ceb9177e6b req-6f968b72-432f-48f8-bd79-485bff95932a service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:39.564305 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-28a116d5-9c16-4312-a9b7-91ceb9177e6b req-6f968b72-432f-48f8-bd79-485bff95932a service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:39.564826 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-28a116d5-9c16-4312-a9b7-91ceb9177e6b req-6f968b72-432f-48f8-bd79-485bff95932a service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:39.577779 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-28a116d5-9c16-4312-a9b7-91ceb9177e6b req-6f968b72-432f-48f8-bd79-485bff95932a service nova] Creating event network-changed:6ab34b67-122f-4945-b7c6-02e6e67d6e5c for instance f3aab284-c9c1-41b6-9a4c-0000e9327c1a on nch1-master-1 Sep 24 22:01:39.581370 ncdv-master-1 devstack@n-api.service[140517]: ERROR oslo.messaging._drivers.impl_rabbit [req-28a116d5-9c16-4312-a9b7-91ceb9177e6b req-6f968b72-432f-48f8-bd79-485bff95932a service nova] [cd6d1afd-97dc-4263-a405-17b502734cd2] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 24 22:01:39.725413 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-29f47980-48ff-4960-a99e-948689bb8a08 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:39.726528 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-29f47980-48ff-4960-a99e-948689bb8a08 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:39.734406 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-29f47980-48ff-4960-a99e-948689bb8a08 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:39.734933 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-29f47980-48ff-4960-a99e-948689bb8a08 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:39.735387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-29f47980-48ff-4960-a99e-948689bb8a08 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:39.736107 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-29f47980-48ff-4960-a99e-948689bb8a08 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:39.736573 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-29f47980-48ff-4960-a99e-948689bb8a08 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:39.737008 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-29f47980-48ff-4960-a99e-948689bb8a08 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:39.941251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-29f47980-48ff-4960-a99e-948689bb8a08 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:39.950039 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-29f47980-48ff-4960-a99e-948689bb8a08 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1687 microversion: 2.1 time: 0.230449 Sep 24 22:01:39.950638 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3522/7062] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:39 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1687 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 22:01:40.590999 ncdv-master-1 devstack@n-api.service[140517]: INFO oslo.messaging._drivers.impl_rabbit [req-28a116d5-9c16-4312-a9b7-91ceb9177e6b req-6f968b72-432f-48f8-bd79-485bff95932a service nova] [cd6d1afd-97dc-4263-a405-17b502734cd2] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 60192. Sep 24 22:01:40.595735 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-28a116d5-9c16-4312-a9b7-91ceb9177e6b req-6f968b72-432f-48f8-bd79-485bff95932a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.113678 Sep 24 22:01:40.596356 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3541/7063] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 22:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 22:01:40.973656 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-3640aafb-f23e-4a42-8933-68d978c867d1 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:40.975785 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-3640aafb-f23e-4a42-8933-68d978c867d1 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:40.982391 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:01:40.984656 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3640aafb-f23e-4a42-8933-68d978c867d1 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:40.985352 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3640aafb-f23e-4a42-8933-68d978c867d1 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:40.985991 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3640aafb-f23e-4a42-8933-68d978c867d1 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:40.986983 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3640aafb-f23e-4a42-8933-68d978c867d1 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:40.987610 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3640aafb-f23e-4a42-8933-68d978c867d1 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:40.988147 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-3640aafb-f23e-4a42-8933-68d978c867d1 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:41.134320 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-3640aafb-f23e-4a42-8933-68d978c867d1 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:41.142797 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-3640aafb-f23e-4a42-8933-68d978c867d1 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1687 microversion: 2.1 time: 0.173388 Sep 24 22:01:41.156295 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3523/7064] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:40 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1687 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:01:42.169164 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-97b1b914-b704-4b06-80a9-83208ca561b7 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:42.170061 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-97b1b914-b704-4b06-80a9-83208ca561b7 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:42.172142 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=29 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:01:42.179145 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97b1b914-b704-4b06-80a9-83208ca561b7 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:42.179637 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97b1b914-b704-4b06-80a9-83208ca561b7 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:42.180074 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97b1b914-b704-4b06-80a9-83208ca561b7 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:42.180785 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97b1b914-b704-4b06-80a9-83208ca561b7 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:42.181245 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97b1b914-b704-4b06-80a9-83208ca561b7 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:42.181672 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-97b1b914-b704-4b06-80a9-83208ca561b7 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:42.184631 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=81 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:01:42.331717 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-97b1b914-b704-4b06-80a9-83208ca561b7 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:42.340896 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-97b1b914-b704-4b06-80a9-83208ca561b7 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1687 microversion: 2.1 time: 0.178173 Sep 24 22:01:42.341495 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3542/7065] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:42 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1687 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:01:43.367459 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-daa0e83b-9158-4026-a600-b9c34d546bc4 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:43.368234 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-daa0e83b-9158-4026-a600-b9c34d546bc4 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:43.375511 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-daa0e83b-9158-4026-a600-b9c34d546bc4 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:43.376002 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-daa0e83b-9158-4026-a600-b9c34d546bc4 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:43.376441 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-daa0e83b-9158-4026-a600-b9c34d546bc4 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:43.377150 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-daa0e83b-9158-4026-a600-b9c34d546bc4 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:43.377608 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-daa0e83b-9158-4026-a600-b9c34d546bc4 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:43.378037 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-daa0e83b-9158-4026-a600-b9c34d546bc4 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:43.534422 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-daa0e83b-9158-4026-a600-b9c34d546bc4 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:43.544253 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-daa0e83b-9158-4026-a600-b9c34d546bc4 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1687 microversion: 2.1 time: 0.181380 Sep 24 22:01:43.545202 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3524/7066] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:43 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1687 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:01:44.569377 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0cdc23f3-c2f1-4abc-b251-bbc23f14e69a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:44.570123 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0cdc23f3-c2f1-4abc-b251-bbc23f14e69a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:44.576538 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0cdc23f3-c2f1-4abc-b251-bbc23f14e69a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:44.577048 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0cdc23f3-c2f1-4abc-b251-bbc23f14e69a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:44.577486 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0cdc23f3-c2f1-4abc-b251-bbc23f14e69a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:44.578178 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0cdc23f3-c2f1-4abc-b251-bbc23f14e69a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:44.578665 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0cdc23f3-c2f1-4abc-b251-bbc23f14e69a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:44.579094 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0cdc23f3-c2f1-4abc-b251-bbc23f14e69a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:44.738819 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0cdc23f3-c2f1-4abc-b251-bbc23f14e69a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:44.748483 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0cdc23f3-c2f1-4abc-b251-bbc23f14e69a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1687 microversion: 2.1 time: 0.183465 Sep 24 22:01:44.758647 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3543/7067] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:44 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1687 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:01:45.773218 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-9519a143-f268-4da0-887c-b365b18f6a57 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:45.773845 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-9519a143-f268-4da0-887c-b365b18f6a57 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:45.782653 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9519a143-f268-4da0-887c-b365b18f6a57 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:45.783115 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9519a143-f268-4da0-887c-b365b18f6a57 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:45.783567 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9519a143-f268-4da0-887c-b365b18f6a57 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:45.784557 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9519a143-f268-4da0-887c-b365b18f6a57 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:45.785218 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9519a143-f268-4da0-887c-b365b18f6a57 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:45.785806 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-9519a143-f268-4da0-887c-b365b18f6a57 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:45.949569 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-9519a143-f268-4da0-887c-b365b18f6a57 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:45.976171 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-9519a143-f268-4da0-887c-b365b18f6a57 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1687 microversion: 2.1 time: 0.204926 Sep 24 22:01:45.976171 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3525/7068] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:45 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1687 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:01:47.009122 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8445e6ba-be79-4d2c-a472-6b78d166a454 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:47.009710 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8445e6ba-be79-4d2c-a472-6b78d166a454 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:47.017129 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8445e6ba-be79-4d2c-a472-6b78d166a454 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:47.017780 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8445e6ba-be79-4d2c-a472-6b78d166a454 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:47.018227 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8445e6ba-be79-4d2c-a472-6b78d166a454 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:47.019002 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8445e6ba-be79-4d2c-a472-6b78d166a454 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:47.019468 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8445e6ba-be79-4d2c-a472-6b78d166a454 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:47.019901 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8445e6ba-be79-4d2c-a472-6b78d166a454 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:47.185176 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8445e6ba-be79-4d2c-a472-6b78d166a454 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:47.194554 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8445e6ba-be79-4d2c-a472-6b78d166a454 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1687 microversion: 2.1 time: 0.190540 Sep 24 22:01:47.211174 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3544/7069] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:47 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1687 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 22:01:48.219510 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-97d2d121-a52d-430f-8982-4438127d5d40 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:48.220094 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-97d2d121-a52d-430f-8982-4438127d5d40 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:48.227686 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-97d2d121-a52d-430f-8982-4438127d5d40 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:48.228254 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-97d2d121-a52d-430f-8982-4438127d5d40 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:48.228703 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-97d2d121-a52d-430f-8982-4438127d5d40 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:48.229465 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-97d2d121-a52d-430f-8982-4438127d5d40 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:48.229940 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-97d2d121-a52d-430f-8982-4438127d5d40 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:48.230377 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-97d2d121-a52d-430f-8982-4438127d5d40 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:48.376850 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-97d2d121-a52d-430f-8982-4438127d5d40 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:48.384842 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-97d2d121-a52d-430f-8982-4438127d5d40 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1687 microversion: 2.1 time: 0.169346 Sep 24 22:01:48.385416 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3526/7070] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:48 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1687 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:01:49.407785 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0af5e529-d32c-4af9-930e-602a907d6738 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:49.408405 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0af5e529-d32c-4af9-930e-602a907d6738 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:49.416197 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0af5e529-d32c-4af9-930e-602a907d6738 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:49.416685 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0af5e529-d32c-4af9-930e-602a907d6738 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:49.417124 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0af5e529-d32c-4af9-930e-602a907d6738 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:49.417823 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0af5e529-d32c-4af9-930e-602a907d6738 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:49.418281 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0af5e529-d32c-4af9-930e-602a907d6738 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:49.418742 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0af5e529-d32c-4af9-930e-602a907d6738 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:49.548036 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0af5e529-d32c-4af9-930e-602a907d6738 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:49.556211 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0af5e529-d32c-4af9-930e-602a907d6738 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1687 microversion: 2.1 time: 0.152339 Sep 24 22:01:49.556794 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3545/7071] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:49 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1687 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:01:50.579349 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-62477606-3f92-4096-9697-6d422c2bf263 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:50.579971 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-62477606-3f92-4096-9697-6d422c2bf263 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:50.587937 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62477606-3f92-4096-9697-6d422c2bf263 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:50.588426 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62477606-3f92-4096-9697-6d422c2bf263 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:50.588863 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62477606-3f92-4096-9697-6d422c2bf263 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:50.589559 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62477606-3f92-4096-9697-6d422c2bf263 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:50.590015 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62477606-3f92-4096-9697-6d422c2bf263 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:50.590443 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-62477606-3f92-4096-9697-6d422c2bf263 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:50.723846 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-62477606-3f92-4096-9697-6d422c2bf263 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:50.732337 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-62477606-3f92-4096-9697-6d422c2bf263 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1687 microversion: 2.1 time: 0.156969 Sep 24 22:01:50.732917 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3527/7072] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:50 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:01:51.756676 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-3eeb18d3-4582-427a-8f38-3f0b2a9d3c7d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:51.757312 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-3eeb18d3-4582-427a-8f38-3f0b2a9d3c7d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:51.764240 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3eeb18d3-4582-427a-8f38-3f0b2a9d3c7d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:51.764761 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3eeb18d3-4582-427a-8f38-3f0b2a9d3c7d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:51.765196 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3eeb18d3-4582-427a-8f38-3f0b2a9d3c7d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:51.766037 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3eeb18d3-4582-427a-8f38-3f0b2a9d3c7d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:51.766576 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3eeb18d3-4582-427a-8f38-3f0b2a9d3c7d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:51.766962 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-3eeb18d3-4582-427a-8f38-3f0b2a9d3c7d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:51.903676 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-3eeb18d3-4582-427a-8f38-3f0b2a9d3c7d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:51.911634 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-3eeb18d3-4582-427a-8f38-3f0b2a9d3c7d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1687 microversion: 2.1 time: 0.159568 Sep 24 22:01:51.912464 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3546/7073] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:51 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:01:52.936355 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-5cb5ba47-a2b1-4255-b66a-ca6e25a26639 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:52.937002 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-5cb5ba47-a2b1-4255-b66a-ca6e25a26639 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:52.944490 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5cb5ba47-a2b1-4255-b66a-ca6e25a26639 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:52.944914 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5cb5ba47-a2b1-4255-b66a-ca6e25a26639 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:52.945349 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5cb5ba47-a2b1-4255-b66a-ca6e25a26639 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:52.946072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5cb5ba47-a2b1-4255-b66a-ca6e25a26639 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:52.946553 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5cb5ba47-a2b1-4255-b66a-ca6e25a26639 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:52.947005 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-5cb5ba47-a2b1-4255-b66a-ca6e25a26639 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:53.079138 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-5cb5ba47-a2b1-4255-b66a-ca6e25a26639 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:53.087641 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-5cb5ba47-a2b1-4255-b66a-ca6e25a26639 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1687 microversion: 2.1 time: 0.155319 Sep 24 22:01:53.088219 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3528/7074] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:52 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1687 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:01:54.111420 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5c98e8f0-5450-46e0-bd0d-2a9b1892e64a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:54.112203 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5c98e8f0-5450-46e0-bd0d-2a9b1892e64a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:54.119205 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c98e8f0-5450-46e0-bd0d-2a9b1892e64a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:54.119703 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c98e8f0-5450-46e0-bd0d-2a9b1892e64a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:54.120148 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c98e8f0-5450-46e0-bd0d-2a9b1892e64a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:54.120858 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c98e8f0-5450-46e0-bd0d-2a9b1892e64a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:54.121322 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c98e8f0-5450-46e0-bd0d-2a9b1892e64a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:54.121753 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5c98e8f0-5450-46e0-bd0d-2a9b1892e64a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:54.258729 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-5c98e8f0-5450-46e0-bd0d-2a9b1892e64a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:54.266491 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5c98e8f0-5450-46e0-bd0d-2a9b1892e64a tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1687 microversion: 2.1 time: 0.159679 Sep 24 22:01:54.267092 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3547/7075] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:54 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:01:55.290992 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-92277d0a-3365-484a-a06a-2895a0bbb049 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:55.291675 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-92277d0a-3365-484a-a06a-2895a0bbb049 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:55.298315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-92277d0a-3365-484a-a06a-2895a0bbb049 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:55.298844 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-92277d0a-3365-484a-a06a-2895a0bbb049 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:55.299284 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-92277d0a-3365-484a-a06a-2895a0bbb049 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:55.299979 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-92277d0a-3365-484a-a06a-2895a0bbb049 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:55.300720 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-92277d0a-3365-484a-a06a-2895a0bbb049 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:55.301153 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-92277d0a-3365-484a-a06a-2895a0bbb049 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:55.434987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-92277d0a-3365-484a-a06a-2895a0bbb049 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:55.442741 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-92277d0a-3365-484a-a06a-2895a0bbb049 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1687 microversion: 2.1 time: 0.156481 Sep 24 22:01:55.443380 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3529/7076] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:55 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:01:56.103245 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-a96515a8-6a2a-4dfa-af23-4797f8ba5f28 req-59d6fc51-cff4-4441-9257-2903fa9e4dac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3aab284-c9c1-41b6-9a4c-0000e9327c1a", "name": "network-vif-plugged", "status": "completed", "tag": "6ab34b67-122f-4945-b7c6-02e6e67d6e5c"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 22:01:56.113959 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-a96515a8-6a2a-4dfa-af23-4797f8ba5f28 req-59d6fc51-cff4-4441-9257-2903fa9e4dac service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:56.114461 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-a96515a8-6a2a-4dfa-af23-4797f8ba5f28 req-59d6fc51-cff4-4441-9257-2903fa9e4dac service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:56.115574 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-a96515a8-6a2a-4dfa-af23-4797f8ba5f28 req-59d6fc51-cff4-4441-9257-2903fa9e4dac service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:56.126997 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-a96515a8-6a2a-4dfa-af23-4797f8ba5f28 req-59d6fc51-cff4-4441-9257-2903fa9e4dac service nova] Creating event network-vif-plugged:6ab34b67-122f-4945-b7c6-02e6e67d6e5c for instance f3aab284-c9c1-41b6-9a4c-0000e9327c1a on nch1-master-1 Sep 24 22:01:56.132120 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-a96515a8-6a2a-4dfa-af23-4797f8ba5f28 req-59d6fc51-cff4-4441-9257-2903fa9e4dac service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033606 Sep 24 22:01:56.132729 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3548/7077] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 22:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 22:01:56.466147 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-34791ddd-9e3a-4507-aa5a-d09d07cda97e tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:56.466798 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-34791ddd-9e3a-4507-aa5a-d09d07cda97e tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:56.473795 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34791ddd-9e3a-4507-aa5a-d09d07cda97e tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:56.474292 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34791ddd-9e3a-4507-aa5a-d09d07cda97e tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:56.475369 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34791ddd-9e3a-4507-aa5a-d09d07cda97e tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:56.476071 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34791ddd-9e3a-4507-aa5a-d09d07cda97e tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:56.476807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34791ddd-9e3a-4507-aa5a-d09d07cda97e tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:56.476969 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-34791ddd-9e3a-4507-aa5a-d09d07cda97e tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:56.617923 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-34791ddd-9e3a-4507-aa5a-d09d07cda97e tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:56.625760 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-34791ddd-9e3a-4507-aa5a-d09d07cda97e tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1687 microversion: 2.1 time: 0.163609 Sep 24 22:01:56.626336 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3530/7078] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:56 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:01:57.651370 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-b1b08142-e66c-4891-b79c-d1c3a95805c5 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:57.652265 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-b1b08142-e66c-4891-b79c-d1c3a95805c5 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:57.658742 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b1b08142-e66c-4891-b79c-d1c3a95805c5 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:57.659209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b1b08142-e66c-4891-b79c-d1c3a95805c5 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:57.659658 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b1b08142-e66c-4891-b79c-d1c3a95805c5 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:57.660369 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b1b08142-e66c-4891-b79c-d1c3a95805c5 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:57.660838 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b1b08142-e66c-4891-b79c-d1c3a95805c5 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:57.661278 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-b1b08142-e66c-4891-b79c-d1c3a95805c5 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:57.802062 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-b1b08142-e66c-4891-b79c-d1c3a95805c5 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:57.812978 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-b1b08142-e66c-4891-b79c-d1c3a95805c5 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1687 microversion: 2.1 time: 0.167391 Sep 24 22:01:57.813732 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3549/7079] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:57 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:01:58.837170 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-e5104dfd-fd9b-46f4-b97e-cd8929f09e2e tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:01:58.837797 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-e5104dfd-fd9b-46f4-b97e-cd8929f09e2e tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:01:58.845343 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e5104dfd-fd9b-46f4-b97e-cd8929f09e2e tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:58.846071 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e5104dfd-fd9b-46f4-b97e-cd8929f09e2e tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:58.846775 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e5104dfd-fd9b-46f4-b97e-cd8929f09e2e tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:58.847854 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e5104dfd-fd9b-46f4-b97e-cd8929f09e2e tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:01:58.848321 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e5104dfd-fd9b-46f4-b97e-cd8929f09e2e tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:01:58.848760 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-e5104dfd-fd9b-46f4-b97e-cd8929f09e2e tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:01:58.986558 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-e5104dfd-fd9b-46f4-b97e-cd8929f09e2e tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:01:58.995362 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-e5104dfd-fd9b-46f4-b97e-cd8929f09e2e tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1674 microversion: 2.1 time: 0.162211 Sep 24 22:01:58.995942 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3531/7080] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:01:58 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:03:44.405336 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=15 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:03:44.406862 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=43 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:03:44.407931 ncdv-master-1 devstack@n-api.service[140517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 22:03:44.408066 ncdv-master-1 devstack@n-api.service[140517]: Sat Sep 24 22:03:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a (ip 10.222.0.52) !!! Sep 24 22:03:44.408159 ncdv-master-1 devstack@n-api.service[140516]: ERROR oslo.messaging._drivers.impl_rabbit [-] [75d0407e-7b02-4bce-a3f1-1c13562673e6] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 24 22:03:44.409272 ncdv-master-1 devstack@n-api.service[140516]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ec046047-61d1-42c1-9e5b-9695ac0fd1f9] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 24 22:03:44.409896 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=17 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:03:44.410839 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=60 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:03:44.411546 ncdv-master-1 devstack@n-api.service[140517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 22:03:44.411680 ncdv-master-1 devstack@n-api.service[140517]: Sat Sep 24 22:03:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a (ip 10.222.0.52) !!! Sep 24 22:03:44.412030 ncdv-master-1 devstack@n-api.service[140516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 22:03:44.412584 ncdv-master-1 devstack@n-api.service[140516]: Sat Sep 24 22:03:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.52) !!! Sep 24 22:03:44.419751 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-2f09e03f-3c13-4e5c-859f-38775013fdf2 req-75c9dceb-327e-49b8-8cf6-78dfaa3c6b49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3aab284-c9c1-41b6-9a4c-0000e9327c1a", "tag": "6ab34b67-122f-4945-b7c6-02e6e67d6e5c"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 22:03:44.420255 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9a04fea3-0aac-4dd5-b45f-a0e83d8bd23d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:03:44.420778 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9a04fea3-0aac-4dd5-b45f-a0e83d8bd23d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:03:44.439583 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-2f09e03f-3c13-4e5c-859f-38775013fdf2 req-75c9dceb-327e-49b8-8cf6-78dfaa3c6b49 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:03:44.440077 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-2f09e03f-3c13-4e5c-859f-38775013fdf2 req-75c9dceb-327e-49b8-8cf6-78dfaa3c6b49 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:03:44.440496 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-2f09e03f-3c13-4e5c-859f-38775013fdf2 req-75c9dceb-327e-49b8-8cf6-78dfaa3c6b49 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:03:44.441637 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a04fea3-0aac-4dd5-b45f-a0e83d8bd23d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:03:44.442137 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a04fea3-0aac-4dd5-b45f-a0e83d8bd23d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:03:44.442613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a04fea3-0aac-4dd5-b45f-a0e83d8bd23d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:03:44.443335 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a04fea3-0aac-4dd5-b45f-a0e83d8bd23d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:03:44.443795 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a04fea3-0aac-4dd5-b45f-a0e83d8bd23d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:03:44.444233 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9a04fea3-0aac-4dd5-b45f-a0e83d8bd23d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:03:44.453395 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-2f09e03f-3c13-4e5c-859f-38775013fdf2 req-75c9dceb-327e-49b8-8cf6-78dfaa3c6b49 service nova] Creating event network-changed:6ab34b67-122f-4945-b7c6-02e6e67d6e5c for instance f3aab284-c9c1-41b6-9a4c-0000e9327c1a on nch1-master-1 Sep 24 22:03:44.458841 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-2f09e03f-3c13-4e5c-859f-38775013fdf2 req-75c9dceb-327e-49b8-8cf6-78dfaa3c6b49 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052889 Sep 24 22:03:44.459450 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3532/7081] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 22:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 22:03:44.477720 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9a04fea3-0aac-4dd5-b45f-a0e83d8bd23d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 22:03:44.557348 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9a04fea3-0aac-4dd5-b45f-a0e83d8bd23d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 204 len: 0 microversion: 2.1 time: 0.154696 Sep 24 22:03:44.557857 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3550/7082] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 22:03:44 2022] DELETE /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 22:03:44.567159 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b9bb1da1-c074-42cf-a49d-181885c6db0d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:03:44.567860 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b9bb1da1-c074-42cf-a49d-181885c6db0d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:03:44.574035 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b9bb1da1-c074-42cf-a49d-181885c6db0d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:03:44.575235 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b9bb1da1-c074-42cf-a49d-181885c6db0d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:03:44.575910 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b9bb1da1-c074-42cf-a49d-181885c6db0d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:03:44.576621 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b9bb1da1-c074-42cf-a49d-181885c6db0d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:03:44.577082 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b9bb1da1-c074-42cf-a49d-181885c6db0d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:03:44.577510 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b9bb1da1-c074-42cf-a49d-181885c6db0d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:03:44.770797 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b9bb1da1-c074-42cf-a49d-181885c6db0d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:03:44.779746 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b9bb1da1-c074-42cf-a49d-181885c6db0d tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1680 microversion: 2.1 time: 0.216832 Sep 24 22:03:44.780336 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3533/7083] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:03:44 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1680 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:03:45.804522 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-4722ede3-4004-46df-8e9e-40b1bf23a09f tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:03:45.805605 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-4722ede3-4004-46df-8e9e-40b1bf23a09f tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:03:45.813981 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4722ede3-4004-46df-8e9e-40b1bf23a09f tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:03:45.814850 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4722ede3-4004-46df-8e9e-40b1bf23a09f tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:03:45.816108 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4722ede3-4004-46df-8e9e-40b1bf23a09f tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:03:45.816108 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4722ede3-4004-46df-8e9e-40b1bf23a09f tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:03:45.816630 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4722ede3-4004-46df-8e9e-40b1bf23a09f tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:03:45.817306 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-4722ede3-4004-46df-8e9e-40b1bf23a09f tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:03:45.996873 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-4722ede3-4004-46df-8e9e-40b1bf23a09f tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:03:46.005615 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-4722ede3-4004-46df-8e9e-40b1bf23a09f tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1680 microversion: 2.1 time: 0.205864 Sep 24 22:03:46.006213 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3551/7084] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:03:45 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1680 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:03:47.002956 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-56ba992d-fb0b-47a3-9e26-24e884befbb5 req-53de7767-9c80-4bde-8a9b-a04ee4cbc98d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3aab284-c9c1-41b6-9a4c-0000e9327c1a", "name": "network-vif-deleted", "tag": "6ab34b67-122f-4945-b7c6-02e6e67d6e5c"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 22:03:47.020150 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-56ba992d-fb0b-47a3-9e26-24e884befbb5 req-53de7767-9c80-4bde-8a9b-a04ee4cbc98d service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:03:47.020643 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-56ba992d-fb0b-47a3-9e26-24e884befbb5 req-53de7767-9c80-4bde-8a9b-a04ee4cbc98d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:03:47.021089 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-56ba992d-fb0b-47a3-9e26-24e884befbb5 req-53de7767-9c80-4bde-8a9b-a04ee4cbc98d service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:03:47.027937 ncdv-master-1 devstack@n-api.service[140516]: INFO oslo.messaging._drivers.impl_rabbit [-] [ec046047-61d1-42c1-9e5b-9695ac0fd1f9] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 60322. Sep 24 22:03:47.030805 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-441824cd-2419-4eab-b038-ac3cb31c8adb tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:03:47.031714 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-441824cd-2419-4eab-b038-ac3cb31c8adb tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:03:47.033640 ncdv-master-1 devstack@n-api.service[140516]: INFO oslo.messaging._drivers.impl_rabbit [-] [75d0407e-7b02-4bce-a3f1-1c13562673e6] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 60320. Sep 24 22:03:47.036380 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-56ba992d-fb0b-47a3-9e26-24e884befbb5 req-53de7767-9c80-4bde-8a9b-a04ee4cbc98d service nova] Creating event network-vif-deleted:6ab34b67-122f-4945-b7c6-02e6e67d6e5c for instance f3aab284-c9c1-41b6-9a4c-0000e9327c1a on nch1-master-1 Sep 24 22:03:47.039241 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-441824cd-2419-4eab-b038-ac3cb31c8adb tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:03:47.039751 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-441824cd-2419-4eab-b038-ac3cb31c8adb tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:03:47.040209 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-441824cd-2419-4eab-b038-ac3cb31c8adb tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:03:47.040930 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-441824cd-2419-4eab-b038-ac3cb31c8adb tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:03:47.041538 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-56ba992d-fb0b-47a3-9e26-24e884befbb5 req-53de7767-9c80-4bde-8a9b-a04ee4cbc98d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042609 Sep 24 22:03:47.041665 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-441824cd-2419-4eab-b038-ac3cb31c8adb tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:03:47.041985 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-441824cd-2419-4eab-b038-ac3cb31c8adb tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:03:47.042322 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3534/7085] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 22:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 22:03:47.107544 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-441824cd-2419-4eab-b038-ac3cb31c8adb tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaf38856de9425ab9909937c85b151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9daa5e226649d08e09774215b0b7d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:03:47.115960 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-441824cd-2419-4eab-b038-ac3cb31c8adb tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 200 len: 1331 microversion: 2.1 time: 0.090240 Sep 24 22:03:47.116544 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3552/7086] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:03:47 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 1331 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:03:48.143998 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-75ce8fe0-0e34-45d9-a20c-da7d60147455 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:03:48.144633 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-75ce8fe0-0e34-45d9-a20c-da7d60147455 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] [instance: f3aab284-c9c1-41b6-9a4c-0000e9327c1a] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:03:48.150966 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-75ce8fe0-0e34-45d9-a20c-da7d60147455 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:03:48.151460 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-75ce8fe0-0e34-45d9-a20c-da7d60147455 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:03:48.151904 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-75ce8fe0-0e34-45d9-a20c-da7d60147455 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:03:48.153410 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-75ce8fe0-0e34-45d9-a20c-da7d60147455 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:03:48.153882 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-75ce8fe0-0e34-45d9-a20c-da7d60147455 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:03:48.154322 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-75ce8fe0-0e34-45d9-a20c-da7d60147455 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:03:48.167797 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-75ce8fe0-0e34-45d9-a20c-da7d60147455 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] HTTP exception thrown: Instance f3aab284-c9c1-41b6-9a4c-0000e9327c1a could not be found. Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-75ce8fe0-0e34-45d9-a20c-da7d60147455 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Request method failure captured: Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a HTTP/1.1 Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL32dzoFT0_tzCUEc9TZIV6sfdwhRrAQ6_jTrfTmRc7PmiMAbm4nMQgXHPbV5oKPNXnJw59Pis7_KrD5TexUoOJJLMTe4Av7BcnSSBQ-4-BTH1n85K2_zW1rx-YbwCzHsebtaWg0O3NicEpb5iqfMAhO-wSkWC5KmpPlMNDrRekUHOII Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 8a9daa5e226649d08e09774215b0b7d0 Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-TestShelveInstance-654352874 Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8a9daa5e226649d08e09774215b0b7d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8a9daa5e226649d08e09774215b0b7d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8a9daa5e226649d08e09774215b0b7d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8a9daa5e226649d08e09774215b0b7d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-TestShelveInstance-654352874 Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 8a9daa5e226649d08e09774215b0b7d0 Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-TestShelveInstance-654352874 Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-TestShelveInstance-654352874-project Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: 0aaf38856de9425ab9909937c85b151c Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-TestShelveInstance-654352874-project Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance f3aab284-c9c1-41b6-9a4c-0000e9327c1a could not be found. Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': 'f3aab284-c9c1-41b6-9a4c-0000e9327c1a'} Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3aab284-c9c1-41b6-9a4c-0000e9327c1a could not be found. Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3aab284-c9c1-41b6-9a4c-0000e9327c1a could not be found. Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 22:03:48.169563 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 22:03:48.174282 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 22:03:48.174282 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 22:03:48.174282 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 22:03:48.174282 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 22:03:48.174282 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 22:03:48.174282 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3aab284-c9c1-41b6-9a4c-0000e9327c1a could not be found. Sep 24 22:03:48.174282 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 22:03:48.174282 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-75ce8fe0-0e34-45d9-a20c-da7d60147455 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Returning 404 to user: Instance f3aab284-c9c1-41b6-9a4c-0000e9327c1a could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 22:03:48.174282 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-75ce8fe0-0e34-45d9-a20c-da7d60147455 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a" status: 404 len: 111 microversion: 2.1 time: 0.032524 Sep 24 22:03:48.174282 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3535/7087] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:03:48 2022] GET /compute/v2.1/servers/f3aab284-c9c1-41b6-9a4c-0000e9327c1a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 22:03:48.329439 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-716fe1b4-f3fb-4bd3-9f93-2ee2bdc4c6d3 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '.version_select at 0x7f4b07d4ad30>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:03:48.353696 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-716fe1b4-f3fb-4bd3-9f93-2ee2bdc4c6d3 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1921974915" status: 202 len: 0 microversion: 2.1 time: 0.028871 Sep 24 22:03:48.354294 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3553/7088] 10.222.0.52 () {58 vars in 1254 bytes} [Sat Sep 24 22:03:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1921974915 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 22:03:48.377283 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-a13c87d1-52bd-4ef5-8c90-45a26e416110 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Action: 'create', calling method: .version_select at 0x7f4b0c7f6ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-240186505", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIALlhajtB0y4XQskNYqjsIzSInE3z4nelqo0z8g5NDKnznN9/wV26bupvvYtinkXm1uld/AoxecWy7ZyEuNSC+HP7YUw9RuDI+5aUVA/Ome1QvrL2m89/yvFEipwQknKA=="}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 22:03:48.393717 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-a13c87d1-52bd-4ef5-8c90-45a26e416110 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Getting quotas for project 8a9daa5e226649d08e09774215b0b7d0. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 22:03:48.398945 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-a13c87d1-52bd-4ef5-8c90-45a26e416110 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Getting quotas for user 0aaf38856de9425ab9909937c85b151c and project 8a9daa5e226649d08e09774215b0b7d0. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 22:03:48.425070 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-a13c87d1-52bd-4ef5-8c90-45a26e416110 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.051807 Sep 24 22:03:48.425682 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3536/7089] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 22:03:48 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 22:03:51.174127 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ee99a4d1-f847-4064-93d1-453df1aa98b5 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] Calling method '.version_select at 0x7f4b07372280>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:03:51.203118 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ee99a4d1-f847-4064-93d1-453df1aa98b5 tempest-TestShelveInstance-654352874 tempest-TestShelveInstance-654352874-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-240186505" status: 202 len: 0 microversion: 2.1 time: 0.033628 Sep 24 22:03:51.203708 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3554/7090] 10.222.0.52 () {58 vars in 1251 bytes} [Sat Sep 24 22:03:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-240186505 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 22:04:08.344723 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=12 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:04:08.348340 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=4 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:04:08.349251 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:04:08.626840 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-84d8f92d-db16-4e95-9597-7639b673c70d tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Action: 'create', calling method: .version_select at 0x7f4b07650310>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-374495828", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvVDoqiVqGFIdxHOfWGNkKKexIie0t8EwsDJyIyty7LE5nI8Yb1QGNaGdvttRIKtnHyO4k9hca0gpgMZsxAs9cwFrkxYzjNFG28koaDJYYf2X1TobkIU2BynHw2PiTP0w=="}} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 22:04:08.646670 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-84d8f92d-db16-4e95-9597-7639b673c70d tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Getting quotas for project 55b9491baa5346a3a32a3d7d221b88e9. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 22:04:08.652991 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.quota [None req-84d8f92d-db16-4e95-9597-7639b673c70d tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Getting quotas for user ace8f69828e64b3b826cc57835dfd04c and project 55b9491baa5346a3a32a3d7d221b88e9. Resources: {'key_pairs'} {{(pid=140516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 22:04:08.680812 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-84d8f92d-db16-4e95-9597-7639b673c70d tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.346278 Sep 24 22:04:08.681688 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3537/7091] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 22:04:08 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 22:04:09.724038 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-9412a6b2-9119-4b3c-b3b9-3b5a60179974 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-740032180", "imageRef": "4c30e8e9-8fb2-4377-83f1-98322cb17799", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-374495828", "security_groups": [{"name": "tempest-secgroup-smoke-1790398330"}], "networks": [{"uuid": "28845b3a-b02a-4d82-af0a-d9297badf3dd"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 22:04:09.734313 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:04:09.735048 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:04:09.837350 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-9412a6b2-9119-4b3c-b3b9-3b5a60179974 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] validate_networks() for [('28845b3a-b02a-4d82-af0a-d9297badf3dd', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 22:04:10.424149 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-9412a6b2-9119-4b3c-b3b9-3b5a60179974 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 22:04:10.424621 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-9412a6b2-9119-4b3c-b3b9-3b5a60179974 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 22:04:10.425114 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-9412a6b2-9119-4b3c-b3b9-3b5a60179974 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 22:04:10.425543 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-9412a6b2-9119-4b3c-b3b9-3b5a60179974 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 22:04:10.425972 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-9412a6b2-9119-4b3c-b3b9-3b5a60179974 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 22:04:10.436129 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9412a6b2-9119-4b3c-b3b9-3b5a60179974 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:04:10.436658 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9412a6b2-9119-4b3c-b3b9-3b5a60179974 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:04:10.437107 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9412a6b2-9119-4b3c-b3b9-3b5a60179974 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:04:10.437856 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9412a6b2-9119-4b3c-b3b9-3b5a60179974 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:04:10.438324 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9412a6b2-9119-4b3c-b3b9-3b5a60179974 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:04:10.438816 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-9412a6b2-9119-4b3c-b3b9-3b5a60179974 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:04:10.456196 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-9412a6b2-9119-4b3c-b3b9-3b5a60179974 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Getting quotas for project 55b9491baa5346a3a32a3d7d221b88e9. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 22:04:10.461556 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-9412a6b2-9119-4b3c-b3b9-3b5a60179974 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Getting quotas for user ace8f69828e64b3b826cc57835dfd04c and project 55b9491baa5346a3a32a3d7d221b88e9. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 22:04:10.474376 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9412a6b2-9119-4b3c-b3b9-3b5a60179974 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 22:04:10.476896 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-9412a6b2-9119-4b3c-b3b9-3b5a60179974 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: 7e2527d7-1944-4d5d-8b49-d81cd3e1677d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c30e8e9-8fb2-4377-83f1-98322cb17799',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 22:04:10.530562 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-9412a6b2-9119-4b3c-b3b9-3b5a60179974 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.810623 Sep 24 22:04:10.531220 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3555/7092] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 22:04:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 22:04:10.544278 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-90c63121-d744-4225-869e-e488c87a8eab tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:04:10.545084 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-90c63121-d744-4225-869e-e488c87a8eab tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: 7e2527d7-1944-4d5d-8b49-d81cd3e1677d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:04:10.603654 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-90c63121-d744-4225-869e-e488c87a8eab tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace8f69828e64b3b826cc57835dfd04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b9491baa5346a3a32a3d7d221b88e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:04:10.611229 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-90c63121-d744-4225-869e-e488c87a8eab tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "GET /compute/v2.1/servers/7e2527d7-1944-4d5d-8b49-d81cd3e1677d" status: 200 len: 1247 microversion: 2.1 time: 0.072803 Sep 24 22:04:10.612027 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3538/7093] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:04:10 2022] GET /compute/v2.1/servers/7e2527d7-1944-4d5d-8b49-d81cd3e1677d => generated 1247 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:04:11.635359 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2ce48c3a-1b4c-4486-bfbe-8086d83e7caa tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:04:11.637923 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2ce48c3a-1b4c-4486-bfbe-8086d83e7caa tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: 7e2527d7-1944-4d5d-8b49-d81cd3e1677d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:04:11.646296 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ce48c3a-1b4c-4486-bfbe-8086d83e7caa tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:04:11.646930 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ce48c3a-1b4c-4486-bfbe-8086d83e7caa tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:04:11.647570 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ce48c3a-1b4c-4486-bfbe-8086d83e7caa tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:04:11.648319 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ce48c3a-1b4c-4486-bfbe-8086d83e7caa tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:04:11.648782 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ce48c3a-1b4c-4486-bfbe-8086d83e7caa tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:04:11.649217 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2ce48c3a-1b4c-4486-bfbe-8086d83e7caa tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:04:11.719927 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2ce48c3a-1b4c-4486-bfbe-8086d83e7caa tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace8f69828e64b3b826cc57835dfd04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b9491baa5346a3a32a3d7d221b88e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:04:11.729478 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2ce48c3a-1b4c-4486-bfbe-8086d83e7caa tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "GET /compute/v2.1/servers/7e2527d7-1944-4d5d-8b49-d81cd3e1677d" status: 200 len: 1299 microversion: 2.1 time: 0.097746 Sep 24 22:04:11.730223 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3556/7094] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:04:11 2022] GET /compute/v2.1/servers/7e2527d7-1944-4d5d-8b49-d81cd3e1677d => generated 1299 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 22:04:12.753605 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c53ea0e0-82fa-4574-ab0d-a83294a70d77 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:04:12.754227 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c53ea0e0-82fa-4574-ab0d-a83294a70d77 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: 7e2527d7-1944-4d5d-8b49-d81cd3e1677d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:04:12.765042 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c53ea0e0-82fa-4574-ab0d-a83294a70d77 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:04:12.765638 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c53ea0e0-82fa-4574-ab0d-a83294a70d77 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:04:12.766165 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c53ea0e0-82fa-4574-ab0d-a83294a70d77 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:04:12.767017 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c53ea0e0-82fa-4574-ab0d-a83294a70d77 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:04:12.767681 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c53ea0e0-82fa-4574-ab0d-a83294a70d77 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:04:12.768182 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c53ea0e0-82fa-4574-ab0d-a83294a70d77 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:04:13.009098 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c53ea0e0-82fa-4574-ab0d-a83294a70d77 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace8f69828e64b3b826cc57835dfd04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b9491baa5346a3a32a3d7d221b88e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:04:13.019036 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c53ea0e0-82fa-4574-ab0d-a83294a70d77 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "GET /compute/v2.1/servers/7e2527d7-1944-4d5d-8b49-d81cd3e1677d" status: 200 len: 1373 microversion: 2.1 time: 0.269600 Sep 24 22:04:13.021516 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3539/7095] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:04:12 2022] GET /compute/v2.1/servers/7e2527d7-1944-4d5d-8b49-d81cd3e1677d => generated 1373 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:04:13.401932 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-921adc31-d1d5-44cd-9fd6-97c41e26681f req-26c2ed49-a6a3-490d-a2c7-8d7c6d80141c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e2527d7-1944-4d5d-8b49-d81cd3e1677d", "tag": "0cc61a91-2a54-4c32-98d3-7f4ef262032a"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 22:04:13.412576 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-921adc31-d1d5-44cd-9fd6-97c41e26681f req-26c2ed49-a6a3-490d-a2c7-8d7c6d80141c service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:04:13.413196 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-921adc31-d1d5-44cd-9fd6-97c41e26681f req-26c2ed49-a6a3-490d-a2c7-8d7c6d80141c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:04:13.413723 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-921adc31-d1d5-44cd-9fd6-97c41e26681f req-26c2ed49-a6a3-490d-a2c7-8d7c6d80141c service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:04:13.427377 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-921adc31-d1d5-44cd-9fd6-97c41e26681f req-26c2ed49-a6a3-490d-a2c7-8d7c6d80141c service nova] Creating event network-changed:0cc61a91-2a54-4c32-98d3-7f4ef262032a for instance 7e2527d7-1944-4d5d-8b49-d81cd3e1677d on nch2-master-1 Sep 24 22:04:13.434465 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-921adc31-d1d5-44cd-9fd6-97c41e26681f req-26c2ed49-a6a3-490d-a2c7-8d7c6d80141c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035245 Sep 24 22:04:13.437053 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3557/7096] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 22:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 22:04:14.041807 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-b7827cdb-86c7-4b8a-a54e-3cd0dbcfd51b tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:04:14.043047 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-b7827cdb-86c7-4b8a-a54e-3cd0dbcfd51b tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: 7e2527d7-1944-4d5d-8b49-d81cd3e1677d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:04:14.051602 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7827cdb-86c7-4b8a-a54e-3cd0dbcfd51b tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:04:14.052102 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7827cdb-86c7-4b8a-a54e-3cd0dbcfd51b tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:04:14.052551 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7827cdb-86c7-4b8a-a54e-3cd0dbcfd51b tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:04:14.053503 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7827cdb-86c7-4b8a-a54e-3cd0dbcfd51b tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:04:14.054478 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7827cdb-86c7-4b8a-a54e-3cd0dbcfd51b tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:04:14.055096 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-b7827cdb-86c7-4b8a-a54e-3cd0dbcfd51b tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:04:14.300899 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-b7827cdb-86c7-4b8a-a54e-3cd0dbcfd51b tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace8f69828e64b3b826cc57835dfd04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b9491baa5346a3a32a3d7d221b88e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:04:14.309556 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-b7827cdb-86c7-4b8a-a54e-3cd0dbcfd51b tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "GET /compute/v2.1/servers/7e2527d7-1944-4d5d-8b49-d81cd3e1677d" status: 200 len: 1373 microversion: 2.1 time: 0.271004 Sep 24 22:04:14.310126 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3540/7097] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:04:14 2022] GET /compute/v2.1/servers/7e2527d7-1944-4d5d-8b49-d81cd3e1677d => generated 1373 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:04:15.334267 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-77beb352-6747-4990-bdcb-ec839d51f202 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:04:15.335005 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-77beb352-6747-4990-bdcb-ec839d51f202 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: 7e2527d7-1944-4d5d-8b49-d81cd3e1677d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:04:15.341434 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77beb352-6747-4990-bdcb-ec839d51f202 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:04:15.341921 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77beb352-6747-4990-bdcb-ec839d51f202 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:04:15.342368 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77beb352-6747-4990-bdcb-ec839d51f202 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:04:15.343098 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77beb352-6747-4990-bdcb-ec839d51f202 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:04:15.343579 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77beb352-6747-4990-bdcb-ec839d51f202 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:04:15.344001 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-77beb352-6747-4990-bdcb-ec839d51f202 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:04:15.480333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-77beb352-6747-4990-bdcb-ec839d51f202 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace8f69828e64b3b826cc57835dfd04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b9491baa5346a3a32a3d7d221b88e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:04:15.488387 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-77beb352-6747-4990-bdcb-ec839d51f202 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "GET /compute/v2.1/servers/7e2527d7-1944-4d5d-8b49-d81cd3e1677d" status: 200 len: 1373 microversion: 2.1 time: 0.159230 Sep 24 22:04:15.488973 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3558/7098] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:04:15 2022] GET /compute/v2.1/servers/7e2527d7-1944-4d5d-8b49-d81cd3e1677d => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:04:16.512654 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-4824787f-83c3-44ef-9019-633f17a91212 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:04:16.513434 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-4824787f-83c3-44ef-9019-633f17a91212 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: 7e2527d7-1944-4d5d-8b49-d81cd3e1677d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:04:16.520645 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4824787f-83c3-44ef-9019-633f17a91212 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:04:16.521127 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4824787f-83c3-44ef-9019-633f17a91212 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:04:16.521567 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4824787f-83c3-44ef-9019-633f17a91212 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:04:16.522258 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4824787f-83c3-44ef-9019-633f17a91212 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:04:16.522810 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4824787f-83c3-44ef-9019-633f17a91212 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:04:16.523240 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-4824787f-83c3-44ef-9019-633f17a91212 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:04:16.667498 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-4824787f-83c3-44ef-9019-633f17a91212 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace8f69828e64b3b826cc57835dfd04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b9491baa5346a3a32a3d7d221b88e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:04:16.675390 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-4824787f-83c3-44ef-9019-633f17a91212 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "GET /compute/v2.1/servers/7e2527d7-1944-4d5d-8b49-d81cd3e1677d" status: 200 len: 1373 microversion: 2.1 time: 0.167420 Sep 24 22:04:16.676147 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3541/7099] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:04:16 2022] GET /compute/v2.1/servers/7e2527d7-1944-4d5d-8b49-d81cd3e1677d => generated 1373 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:04:17.698960 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-882def87-f6e0-40f9-8b8c-a59ec954bac5 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:04:17.699835 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-882def87-f6e0-40f9-8b8c-a59ec954bac5 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: 7e2527d7-1944-4d5d-8b49-d81cd3e1677d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:04:17.707058 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-882def87-f6e0-40f9-8b8c-a59ec954bac5 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:04:17.707626 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-882def87-f6e0-40f9-8b8c-a59ec954bac5 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:04:17.708077 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-882def87-f6e0-40f9-8b8c-a59ec954bac5 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:04:17.708780 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-882def87-f6e0-40f9-8b8c-a59ec954bac5 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:04:17.709249 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-882def87-f6e0-40f9-8b8c-a59ec954bac5 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:04:17.709684 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-882def87-f6e0-40f9-8b8c-a59ec954bac5 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:04:17.842220 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-882def87-f6e0-40f9-8b8c-a59ec954bac5 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace8f69828e64b3b826cc57835dfd04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b9491baa5346a3a32a3d7d221b88e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:04:17.850019 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-882def87-f6e0-40f9-8b8c-a59ec954bac5 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "GET /compute/v2.1/servers/7e2527d7-1944-4d5d-8b49-d81cd3e1677d" status: 200 len: 1373 microversion: 2.1 time: 0.155099 Sep 24 22:04:17.850618 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3559/7100] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:04:17 2022] GET /compute/v2.1/servers/7e2527d7-1944-4d5d-8b49-d81cd3e1677d => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:04:18.875841 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-27a7336c-d27c-456c-8bf0-5363baa6942e tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:04:18.877074 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-27a7336c-d27c-456c-8bf0-5363baa6942e tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: 7e2527d7-1944-4d5d-8b49-d81cd3e1677d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:04:18.883271 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27a7336c-d27c-456c-8bf0-5363baa6942e tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:04:18.883758 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27a7336c-d27c-456c-8bf0-5363baa6942e tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:04:18.884196 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27a7336c-d27c-456c-8bf0-5363baa6942e tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:04:18.884899 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27a7336c-d27c-456c-8bf0-5363baa6942e tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:04:18.885355 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27a7336c-d27c-456c-8bf0-5363baa6942e tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:04:18.885783 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-27a7336c-d27c-456c-8bf0-5363baa6942e tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:04:19.027005 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-27a7336c-d27c-456c-8bf0-5363baa6942e tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace8f69828e64b3b826cc57835dfd04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b9491baa5346a3a32a3d7d221b88e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:04:19.035442 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-27a7336c-d27c-456c-8bf0-5363baa6942e tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "GET /compute/v2.1/servers/7e2527d7-1944-4d5d-8b49-d81cd3e1677d" status: 200 len: 1373 microversion: 2.1 time: 0.164850 Sep 24 22:04:19.036014 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3542/7101] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:04:18 2022] GET /compute/v2.1/servers/7e2527d7-1944-4d5d-8b49-d81cd3e1677d => generated 1373 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 22:04:20.134965 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-94b8ad46-08bd-4daf-bceb-2804d6f77f4c tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:04:20.135534 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-94b8ad46-08bd-4daf-bceb-2804d6f77f4c tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: 7e2527d7-1944-4d5d-8b49-d81cd3e1677d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:04:20.142764 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-94b8ad46-08bd-4daf-bceb-2804d6f77f4c tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:04:20.143262 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-94b8ad46-08bd-4daf-bceb-2804d6f77f4c tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:04:20.143705 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-94b8ad46-08bd-4daf-bceb-2804d6f77f4c tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:04:20.144414 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-94b8ad46-08bd-4daf-bceb-2804d6f77f4c tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:04:20.144877 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-94b8ad46-08bd-4daf-bceb-2804d6f77f4c tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:04:20.145313 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-94b8ad46-08bd-4daf-bceb-2804d6f77f4c tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:04:20.282984 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-da88ab88-bebc-4288-9f1c-f195766680e8 req-879736cf-9aff-405c-8d68-89be0d861755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e2527d7-1944-4d5d-8b49-d81cd3e1677d", "name": "network-vif-plugged", "status": "completed", "tag": "0cc61a91-2a54-4c32-98d3-7f4ef262032a"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 22:04:20.284495 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-94b8ad46-08bd-4daf-bceb-2804d6f77f4c tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace8f69828e64b3b826cc57835dfd04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b9491baa5346a3a32a3d7d221b88e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:04:20.293896 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-94b8ad46-08bd-4daf-bceb-2804d6f77f4c tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "GET /compute/v2.1/servers/7e2527d7-1944-4d5d-8b49-d81cd3e1677d" status: 200 len: 1373 microversion: 2.1 time: 0.162334 Sep 24 22:04:20.294174 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-da88ab88-bebc-4288-9f1c-f195766680e8 req-879736cf-9aff-405c-8d68-89be0d861755 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:04:20.294973 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-da88ab88-bebc-4288-9f1c-f195766680e8 req-879736cf-9aff-405c-8d68-89be0d861755 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:04:20.295751 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-da88ab88-bebc-4288-9f1c-f195766680e8 req-879736cf-9aff-405c-8d68-89be0d861755 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:04:20.307352 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3560/7102] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:04:20 2022] GET /compute/v2.1/servers/7e2527d7-1944-4d5d-8b49-d81cd3e1677d => generated 1373 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:04:20.308540 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-da88ab88-bebc-4288-9f1c-f195766680e8 req-879736cf-9aff-405c-8d68-89be0d861755 service nova] Creating event network-vif-plugged:0cc61a91-2a54-4c32-98d3-7f4ef262032a for instance 7e2527d7-1944-4d5d-8b49-d81cd3e1677d on nch2-master-1 Sep 24 22:04:20.314928 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-da88ab88-bebc-4288-9f1c-f195766680e8 req-879736cf-9aff-405c-8d68-89be0d861755 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035828 Sep 24 22:04:20.315635 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3543/7103] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 22:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 22:04:21.318054 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-0d36753b-100e-4710-a6d0-a1cf2de15490 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:04:21.318634 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-0d36753b-100e-4710-a6d0-a1cf2de15490 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: 7e2527d7-1944-4d5d-8b49-d81cd3e1677d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:04:21.320603 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:04:21.321313 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=6 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:04:21.329180 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d36753b-100e-4710-a6d0-a1cf2de15490 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:04:21.329671 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d36753b-100e-4710-a6d0-a1cf2de15490 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:04:21.330114 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d36753b-100e-4710-a6d0-a1cf2de15490 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:04:21.330848 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d36753b-100e-4710-a6d0-a1cf2de15490 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:04:21.331321 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d36753b-100e-4710-a6d0-a1cf2de15490 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:04:21.331751 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-0d36753b-100e-4710-a6d0-a1cf2de15490 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:04:21.469790 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-0d36753b-100e-4710-a6d0-a1cf2de15490 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace8f69828e64b3b826cc57835dfd04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b9491baa5346a3a32a3d7d221b88e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:04:21.478057 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-0d36753b-100e-4710-a6d0-a1cf2de15490 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "GET /compute/v2.1/servers/7e2527d7-1944-4d5d-8b49-d81cd3e1677d" status: 200 len: 1373 microversion: 2.1 time: 0.163934 Sep 24 22:04:21.478674 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3561/7104] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:04:21 2022] GET /compute/v2.1/servers/7e2527d7-1944-4d5d-8b49-d81cd3e1677d => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:04:22.498304 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=6 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:04:22.503358 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7ae77aa6-cc7b-4b26-97c2-db13bb987ff4 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:04:22.504068 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7ae77aa6-cc7b-4b26-97c2-db13bb987ff4 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: 7e2527d7-1944-4d5d-8b49-d81cd3e1677d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:04:22.510672 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ae77aa6-cc7b-4b26-97c2-db13bb987ff4 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:04:22.511159 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ae77aa6-cc7b-4b26-97c2-db13bb987ff4 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:04:22.511602 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ae77aa6-cc7b-4b26-97c2-db13bb987ff4 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:04:22.512829 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ae77aa6-cc7b-4b26-97c2-db13bb987ff4 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:04:22.513292 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ae77aa6-cc7b-4b26-97c2-db13bb987ff4 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:04:22.513725 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7ae77aa6-cc7b-4b26-97c2-db13bb987ff4 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:04:22.646663 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7ae77aa6-cc7b-4b26-97c2-db13bb987ff4 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace8f69828e64b3b826cc57835dfd04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b9491baa5346a3a32a3d7d221b88e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:04:22.655405 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7ae77aa6-cc7b-4b26-97c2-db13bb987ff4 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "GET /compute/v2.1/servers/7e2527d7-1944-4d5d-8b49-d81cd3e1677d" status: 200 len: 1558 microversion: 2.1 time: 0.158079 Sep 24 22:04:22.655995 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3544/7105] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:04:22 2022] GET /compute/v2.1/servers/7e2527d7-1944-4d5d-8b49-d81cd3e1677d => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:04:22.678188 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-76d1d7bc-380d-465e-b018-3731b009f3cd tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:04:22.678837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-76d1d7bc-380d-465e-b018-3731b009f3cd tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: 7e2527d7-1944-4d5d-8b49-d81cd3e1677d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:04:22.686920 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76d1d7bc-380d-465e-b018-3731b009f3cd tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:04:22.687454 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76d1d7bc-380d-465e-b018-3731b009f3cd tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:04:22.687888 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76d1d7bc-380d-465e-b018-3731b009f3cd tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:04:22.688600 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76d1d7bc-380d-465e-b018-3731b009f3cd tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:04:22.689065 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76d1d7bc-380d-465e-b018-3731b009f3cd tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:04:22.689502 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-76d1d7bc-380d-465e-b018-3731b009f3cd tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:04:22.822896 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-76d1d7bc-380d-465e-b018-3731b009f3cd tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace8f69828e64b3b826cc57835dfd04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b9491baa5346a3a32a3d7d221b88e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:04:22.831420 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-76d1d7bc-380d-465e-b018-3731b009f3cd tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "GET /compute/v2.1/servers/7e2527d7-1944-4d5d-8b49-d81cd3e1677d" status: 200 len: 1558 microversion: 2.1 time: 0.157176 Sep 24 22:04:22.832006 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3562/7106] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:04:22 2022] GET /compute/v2.1/servers/7e2527d7-1944-4d5d-8b49-d81cd3e1677d => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:04:24.460836 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-ee8d625c-9ac8-4916-8beb-c6827cb0ed81 req-ffbe645a-b4d8-4a85-91f0-5687676b00b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e2527d7-1944-4d5d-8b49-d81cd3e1677d", "tag": "0cc61a91-2a54-4c32-98d3-7f4ef262032a"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 22:04:24.472139 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-ee8d625c-9ac8-4916-8beb-c6827cb0ed81 req-ffbe645a-b4d8-4a85-91f0-5687676b00b6 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:04:24.472641 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-ee8d625c-9ac8-4916-8beb-c6827cb0ed81 req-ffbe645a-b4d8-4a85-91f0-5687676b00b6 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:04:24.473078 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-ee8d625c-9ac8-4916-8beb-c6827cb0ed81 req-ffbe645a-b4d8-4a85-91f0-5687676b00b6 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:04:24.486178 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-ee8d625c-9ac8-4916-8beb-c6827cb0ed81 req-ffbe645a-b4d8-4a85-91f0-5687676b00b6 service nova] Creating event network-changed:0cc61a91-2a54-4c32-98d3-7f4ef262032a for instance 7e2527d7-1944-4d5d-8b49-d81cd3e1677d on nch2-master-1 Sep 24 22:04:24.491424 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-ee8d625c-9ac8-4916-8beb-c6827cb0ed81 req-ffbe645a-b4d8-4a85-91f0-5687676b00b6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034323 Sep 24 22:04:24.492032 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3545/7107] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 22:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 22:06:19.849100 ncdv-master-1 devstack@n-api.service[140517]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e1087534-8c05-43ce-a203-528e6b6bc7c7] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 24 22:06:19.850043 ncdv-master-1 devstack@n-api.service[140517]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aa974483-35f8-468d-af64-c307bf04d159] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 24 22:06:19.850822 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:06:19.851595 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=40 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:06:19.856667 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6311c968-7f29-4128-be4d-6ac01a628ca9 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1624642445"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 22:06:19.859035 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6311c968-7f29-4128-be4d-6ac01a628ca9 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: 7e2527d7-1944-4d5d-8b49-d81cd3e1677d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:06:19.867760 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6311c968-7f29-4128-be4d-6ac01a628ca9 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:19.868255 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6311c968-7f29-4128-be4d-6ac01a628ca9 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:19.868701 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6311c968-7f29-4128-be4d-6ac01a628ca9 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:19.869413 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6311c968-7f29-4128-be4d-6ac01a628ca9 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:19.869880 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6311c968-7f29-4128-be4d-6ac01a628ca9 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:19.870315 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6311c968-7f29-4128-be4d-6ac01a628ca9 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:20.245873 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6311c968-7f29-4128-be4d-6ac01a628ca9 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "POST /compute/v2.1/servers/7e2527d7-1944-4d5d-8b49-d81cd3e1677d/action" status: 202 len: 0 microversion: 2.1 time: 0.398702 Sep 24 22:06:20.246602 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3563/7108] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 22:06:19 2022] POST /compute/v2.1/servers/7e2527d7-1944-4d5d-8b49-d81cd3e1677d/action => generated 0 bytes in 400 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 24 22:06:26.983368 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:06:26.985912 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=34 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:06:26.987457 ncdv-master-1 devstack@n-api.service[140516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 22:06:26.987973 ncdv-master-1 devstack@n-api.service[140516]: Sat Sep 24 22:06:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.52) !!! Sep 24 22:06:27.083254 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-0341884d-d45d-431e-ab0c-875863e38fea req-67b01fb3-ff6b-4c75-8237-965fead7816f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e2527d7-1944-4d5d-8b49-d81cd3e1677d", "name": "network-vif-plugged", "status": "completed", "tag": "0cc61a91-2a54-4c32-98d3-7f4ef262032a"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 22:06:27.083254 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-0341884d-d45d-431e-ab0c-875863e38fea req-67b01fb3-ff6b-4c75-8237-965fead7816f service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:27.083254 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-0341884d-d45d-431e-ab0c-875863e38fea req-67b01fb3-ff6b-4c75-8237-965fead7816f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:27.083254 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-0341884d-d45d-431e-ab0c-875863e38fea req-67b01fb3-ff6b-4c75-8237-965fead7816f service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:27.085807 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-0341884d-d45d-431e-ab0c-875863e38fea req-67b01fb3-ff6b-4c75-8237-965fead7816f service nova] Creating event network-vif-plugged:0cc61a91-2a54-4c32-98d3-7f4ef262032a for instance 7e2527d7-1944-4d5d-8b49-d81cd3e1677d on nch2-master-1 Sep 24 22:06:27.091174 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-0341884d-d45d-431e-ab0c-875863e38fea req-67b01fb3-ff6b-4c75-8237-965fead7816f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112652 Sep 24 22:06:27.091865 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3546/7109] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 22:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 22:06:33.809631 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:06:33.810433 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:06:33.817015 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-5304dfda-f738-4f9c-b27d-53040dbf68bc tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-531807182", "imageRef": "ce32839c-0816-437e-80fe-2bccd434d6e7", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-374495828", "security_groups": [{"name": "tempest-secgroup-smoke-1790398330"}], "networks": [{"uuid": "28845b3a-b02a-4d82-af0a-d9297badf3dd"}]}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 22:06:33.846671 ncdv-master-1 devstack@n-api.service[140517]: INFO oslo.messaging._drivers.impl_rabbit [-] [e1087534-8c05-43ce-a203-528e6b6bc7c7] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 60766. Sep 24 22:06:33.849087 ncdv-master-1 devstack@n-api.service[140517]: INFO oslo.messaging._drivers.impl_rabbit [-] [aa974483-35f8-468d-af64-c307bf04d159] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 60768. Sep 24 22:06:33.929722 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.network.neutron [None req-5304dfda-f738-4f9c-b27d-53040dbf68bc tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] validate_networks() for [('28845b3a-b02a-4d82-af0a-d9297badf3dd', None, None, None, None, None)] {{(pid=140517) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 22:06:34.301227 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-5304dfda-f738-4f9c-b27d-53040dbf68bc tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Flavor limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 22:06:34.301660 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-5304dfda-f738-4f9c-b27d-53040dbf68bc tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Image limits 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 22:06:34.302147 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-5304dfda-f738-4f9c-b27d-53040dbf68bc tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Flavor pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 22:06:34.302606 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-5304dfda-f738-4f9c-b27d-53040dbf68bc tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Image pref 0:0:0 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 22:06:34.303030 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.virt.hardware [None req-5304dfda-f738-4f9c-b27d-53040dbf68bc tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 22:06:34.312180 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5304dfda-f738-4f9c-b27d-53040dbf68bc tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:34.312665 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5304dfda-f738-4f9c-b27d-53040dbf68bc tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:34.313105 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5304dfda-f738-4f9c-b27d-53040dbf68bc tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:34.313844 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5304dfda-f738-4f9c-b27d-53040dbf68bc tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:34.314305 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5304dfda-f738-4f9c-b27d-53040dbf68bc tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:34.314837 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-5304dfda-f738-4f9c-b27d-53040dbf68bc tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:34.332081 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-5304dfda-f738-4f9c-b27d-53040dbf68bc tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Getting quotas for project 55b9491baa5346a3a32a3d7d221b88e9. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 22:06:34.337344 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.quota [None req-5304dfda-f738-4f9c-b27d-53040dbf68bc tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Getting quotas for user ace8f69828e64b3b826cc57835dfd04c and project 55b9491baa5346a3a32a3d7d221b88e9. Resources: {'ram', 'cores', 'instances'} {{(pid=140517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 22:06:34.349890 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5304dfda-f738-4f9c-b27d-53040dbf68bc tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Going to run 1 instances... {{(pid=140517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 22:06:34.352425 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-5304dfda-f738-4f9c-b27d-53040dbf68bc tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: efbe4dc6-71eb-41c8-95e7-02bae1fed1f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ce32839c-0816-437e-80fe-2bccd434d6e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 22:06:34.399186 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-5304dfda-f738-4f9c-b27d-53040dbf68bc tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.591538 Sep 24 22:06:34.399769 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3564/7110] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 22:06:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 22:06:34.412784 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-352c5766-9f8d-4222-9c26-9dc9eaa30399 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:06:34.413477 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-352c5766-9f8d-4222-9c26-9dc9eaa30399 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: efbe4dc6-71eb-41c8-95e7-02bae1fed1f8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:06:34.522621 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-352c5766-9f8d-4222-9c26-9dc9eaa30399 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace8f69828e64b3b826cc57835dfd04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b9491baa5346a3a32a3d7d221b88e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:06:34.529527 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-352c5766-9f8d-4222-9c26-9dc9eaa30399 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8" status: 200 len: 1247 microversion: 2.1 time: 0.122311 Sep 24 22:06:34.530089 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3547/7111] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:06:34 2022] GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8 => generated 1247 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:06:35.554115 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-01219f0d-d857-4d8e-a6f3-6e2563ab4711 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:06:35.554771 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-01219f0d-d857-4d8e-a6f3-6e2563ab4711 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: efbe4dc6-71eb-41c8-95e7-02bae1fed1f8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:06:35.562299 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01219f0d-d857-4d8e-a6f3-6e2563ab4711 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:35.562888 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01219f0d-d857-4d8e-a6f3-6e2563ab4711 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:35.563333 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01219f0d-d857-4d8e-a6f3-6e2563ab4711 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:35.564030 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01219f0d-d857-4d8e-a6f3-6e2563ab4711 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:35.564494 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01219f0d-d857-4d8e-a6f3-6e2563ab4711 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:35.564928 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-01219f0d-d857-4d8e-a6f3-6e2563ab4711 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:35.629260 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-01219f0d-d857-4d8e-a6f3-6e2563ab4711 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace8f69828e64b3b826cc57835dfd04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b9491baa5346a3a32a3d7d221b88e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:06:35.637543 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-01219f0d-d857-4d8e-a6f3-6e2563ab4711 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8" status: 200 len: 1251 microversion: 2.1 time: 0.088791 Sep 24 22:06:35.638176 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3565/7112] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:06:35 2022] GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8 => generated 1251 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:06:36.661736 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-2250f8e0-b0a5-404a-892d-3329125ebb5c tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:06:36.663228 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-2250f8e0-b0a5-404a-892d-3329125ebb5c tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: efbe4dc6-71eb-41c8-95e7-02bae1fed1f8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:06:36.672794 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2250f8e0-b0a5-404a-892d-3329125ebb5c tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:36.673513 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2250f8e0-b0a5-404a-892d-3329125ebb5c tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:36.673958 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2250f8e0-b0a5-404a-892d-3329125ebb5c tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:36.674686 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2250f8e0-b0a5-404a-892d-3329125ebb5c tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:36.675986 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2250f8e0-b0a5-404a-892d-3329125ebb5c tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:36.677005 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-2250f8e0-b0a5-404a-892d-3329125ebb5c tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:36.791937 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-2250f8e0-b0a5-404a-892d-3329125ebb5c tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace8f69828e64b3b826cc57835dfd04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b9491baa5346a3a32a3d7d221b88e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:06:36.801242 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-2250f8e0-b0a5-404a-892d-3329125ebb5c tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8" status: 200 len: 1305 microversion: 2.1 time: 0.143673 Sep 24 22:06:36.817513 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3548/7113] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:06:36 2022] GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8 => generated 1305 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:06:36.995465 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-591e885d-8fc1-4825-8053-1f2082e3e23e req-db057dab-b064-44e2-92d1-88dffbf263ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e2527d7-1944-4d5d-8b49-d81cd3e1677d", "name": "network-vif-unplugged", "status": "completed", "tag": "0cc61a91-2a54-4c32-98d3-7f4ef262032a"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 22:06:37.017541 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-591e885d-8fc1-4825-8053-1f2082e3e23e req-db057dab-b064-44e2-92d1-88dffbf263ce service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:37.018038 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-591e885d-8fc1-4825-8053-1f2082e3e23e req-db057dab-b064-44e2-92d1-88dffbf263ce service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:37.018485 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-591e885d-8fc1-4825-8053-1f2082e3e23e req-db057dab-b064-44e2-92d1-88dffbf263ce service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:37.038330 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-591e885d-8fc1-4825-8053-1f2082e3e23e req-db057dab-b064-44e2-92d1-88dffbf263ce service nova] Creating event network-vif-unplugged:0cc61a91-2a54-4c32-98d3-7f4ef262032a for instance 7e2527d7-1944-4d5d-8b49-d81cd3e1677d on nch2-master-1 Sep 24 22:06:37.046367 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-591e885d-8fc1-4825-8053-1f2082e3e23e req-db057dab-b064-44e2-92d1-88dffbf263ce service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056955 Sep 24 22:06:37.049294 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3566/7114] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 22:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 22:06:37.825213 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-ff6aa73d-5c53-45a9-8eac-bd817bea4f4f tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:06:37.826728 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-ff6aa73d-5c53-45a9-8eac-bd817bea4f4f tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: efbe4dc6-71eb-41c8-95e7-02bae1fed1f8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:06:37.835403 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff6aa73d-5c53-45a9-8eac-bd817bea4f4f tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:37.836434 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff6aa73d-5c53-45a9-8eac-bd817bea4f4f tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:37.836955 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff6aa73d-5c53-45a9-8eac-bd817bea4f4f tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:37.837978 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff6aa73d-5c53-45a9-8eac-bd817bea4f4f tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:37.838700 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff6aa73d-5c53-45a9-8eac-bd817bea4f4f tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:37.839499 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-ff6aa73d-5c53-45a9-8eac-bd817bea4f4f tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:37.996745 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-ff6aa73d-5c53-45a9-8eac-bd817bea4f4f tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace8f69828e64b3b826cc57835dfd04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b9491baa5346a3a32a3d7d221b88e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:06:38.007116 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-ff6aa73d-5c53-45a9-8eac-bd817bea4f4f tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8" status: 200 len: 1373 microversion: 2.1 time: 0.185668 Sep 24 22:06:38.018556 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3549/7115] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:06:37 2022] GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8 => generated 1373 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:06:39.032414 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-669df90c-c73e-4321-b001-5bca039de146 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:06:39.033129 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-669df90c-c73e-4321-b001-5bca039de146 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: efbe4dc6-71eb-41c8-95e7-02bae1fed1f8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:06:39.040140 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-669df90c-c73e-4321-b001-5bca039de146 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:39.040634 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-669df90c-c73e-4321-b001-5bca039de146 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:39.041074 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-669df90c-c73e-4321-b001-5bca039de146 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:39.041776 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-669df90c-c73e-4321-b001-5bca039de146 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:39.042238 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-669df90c-c73e-4321-b001-5bca039de146 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:39.042703 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-669df90c-c73e-4321-b001-5bca039de146 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:39.181997 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-669df90c-c73e-4321-b001-5bca039de146 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace8f69828e64b3b826cc57835dfd04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b9491baa5346a3a32a3d7d221b88e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:06:39.190138 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-669df90c-c73e-4321-b001-5bca039de146 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8" status: 200 len: 1373 microversion: 2.1 time: 0.162829 Sep 24 22:06:39.191282 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3567/7116] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:06:39 2022] GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8 => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:06:40.213382 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-cae7f045-bbdf-46f9-b336-ad0ba59e111a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:06:40.213984 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-cae7f045-bbdf-46f9-b336-ad0ba59e111a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: efbe4dc6-71eb-41c8-95e7-02bae1fed1f8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:06:40.221205 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cae7f045-bbdf-46f9-b336-ad0ba59e111a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:40.221754 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cae7f045-bbdf-46f9-b336-ad0ba59e111a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:40.222780 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cae7f045-bbdf-46f9-b336-ad0ba59e111a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:40.223508 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cae7f045-bbdf-46f9-b336-ad0ba59e111a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:40.223967 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cae7f045-bbdf-46f9-b336-ad0ba59e111a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:40.224392 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-cae7f045-bbdf-46f9-b336-ad0ba59e111a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:40.366935 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-cae7f045-bbdf-46f9-b336-ad0ba59e111a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace8f69828e64b3b826cc57835dfd04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b9491baa5346a3a32a3d7d221b88e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:06:40.375647 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-cae7f045-bbdf-46f9-b336-ad0ba59e111a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8" status: 200 len: 1373 microversion: 2.1 time: 0.166073 Sep 24 22:06:40.376426 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3550/7117] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:06:40 2022] GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8 => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:06:41.400708 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-155670c8-6483-45e7-8a8b-746647c3cea1 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:06:41.402141 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-155670c8-6483-45e7-8a8b-746647c3cea1 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: efbe4dc6-71eb-41c8-95e7-02bae1fed1f8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:06:41.409598 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-155670c8-6483-45e7-8a8b-746647c3cea1 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:41.410456 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-155670c8-6483-45e7-8a8b-746647c3cea1 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:41.411204 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-155670c8-6483-45e7-8a8b-746647c3cea1 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:41.412156 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-155670c8-6483-45e7-8a8b-746647c3cea1 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:41.412854 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-155670c8-6483-45e7-8a8b-746647c3cea1 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:41.413509 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-155670c8-6483-45e7-8a8b-746647c3cea1 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:41.562112 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-155670c8-6483-45e7-8a8b-746647c3cea1 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace8f69828e64b3b826cc57835dfd04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b9491baa5346a3a32a3d7d221b88e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:06:41.570216 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-155670c8-6483-45e7-8a8b-746647c3cea1 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8" status: 200 len: 1373 microversion: 2.1 time: 0.173293 Sep 24 22:06:41.570847 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3568/7118] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:06:41 2022] GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8 => generated 1373 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:06:42.592912 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-35fd0587-fc40-497f-9fb1-93cd1fcb9b94 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:06:42.593557 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-35fd0587-fc40-497f-9fb1-93cd1fcb9b94 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: efbe4dc6-71eb-41c8-95e7-02bae1fed1f8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:06:42.601228 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35fd0587-fc40-497f-9fb1-93cd1fcb9b94 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:42.601851 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35fd0587-fc40-497f-9fb1-93cd1fcb9b94 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:42.602387 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35fd0587-fc40-497f-9fb1-93cd1fcb9b94 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:42.603214 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35fd0587-fc40-497f-9fb1-93cd1fcb9b94 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:42.603685 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35fd0587-fc40-497f-9fb1-93cd1fcb9b94 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:42.604398 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-35fd0587-fc40-497f-9fb1-93cd1fcb9b94 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:42.756098 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-35fd0587-fc40-497f-9fb1-93cd1fcb9b94 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace8f69828e64b3b826cc57835dfd04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b9491baa5346a3a32a3d7d221b88e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:06:42.765335 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-35fd0587-fc40-497f-9fb1-93cd1fcb9b94 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8" status: 200 len: 1373 microversion: 2.1 time: 0.176247 Sep 24 22:06:42.769446 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3551/7119] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:06:42 2022] GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8 => generated 1373 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:06:43.789876 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-2fa48257-c85e-40d5-8576-f7734f032493 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:06:43.790543 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-2fa48257-c85e-40d5-8576-f7734f032493 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: efbe4dc6-71eb-41c8-95e7-02bae1fed1f8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:06:43.797819 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2fa48257-c85e-40d5-8576-f7734f032493 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:43.798307 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2fa48257-c85e-40d5-8576-f7734f032493 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:43.798792 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2fa48257-c85e-40d5-8576-f7734f032493 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:43.799509 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2fa48257-c85e-40d5-8576-f7734f032493 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:43.800661 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2fa48257-c85e-40d5-8576-f7734f032493 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:43.801239 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-2fa48257-c85e-40d5-8576-f7734f032493 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:43.959144 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-2fa48257-c85e-40d5-8576-f7734f032493 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace8f69828e64b3b826cc57835dfd04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b9491baa5346a3a32a3d7d221b88e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:06:43.967368 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-2fa48257-c85e-40d5-8576-f7734f032493 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8" status: 200 len: 1373 microversion: 2.1 time: 0.181294 Sep 24 22:06:43.968282 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3569/7120] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:06:43 2022] GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8 => generated 1373 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:06:44.992825 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-7842cd43-7175-43dd-a553-5a37e7f1f5ee tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:06:44.993454 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-7842cd43-7175-43dd-a553-5a37e7f1f5ee tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: efbe4dc6-71eb-41c8-95e7-02bae1fed1f8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:06:44.996333 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell0:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:06:45.002093 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7842cd43-7175-43dd-a553-5a37e7f1f5ee tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:45.002611 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7842cd43-7175-43dd-a553-5a37e7f1f5ee tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:45.003114 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7842cd43-7175-43dd-a553-5a37e7f1f5ee tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:45.004011 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7842cd43-7175-43dd-a553-5a37e7f1f5ee tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:45.004471 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7842cd43-7175-43dd-a553-5a37e7f1f5ee tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:45.004902 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-7842cd43-7175-43dd-a553-5a37e7f1f5ee tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:45.139299 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-7842cd43-7175-43dd-a553-5a37e7f1f5ee tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace8f69828e64b3b826cc57835dfd04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b9491baa5346a3a32a3d7d221b88e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:06:45.147509 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-7842cd43-7175-43dd-a553-5a37e7f1f5ee tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8" status: 200 len: 1373 microversion: 2.1 time: 0.158689 Sep 24 22:06:45.148100 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3552/7121] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:06:44 2022] GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8 => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:06:46.170909 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-a1559942-a9bd-4a1b-8315-12a6fde9074c tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:06:46.171524 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-a1559942-a9bd-4a1b-8315-12a6fde9074c tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: efbe4dc6-71eb-41c8-95e7-02bae1fed1f8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:06:46.173476 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:06:46.174133 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell0:SELECT=6 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:06:46.182491 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1559942-a9bd-4a1b-8315-12a6fde9074c tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:46.183109 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1559942-a9bd-4a1b-8315-12a6fde9074c tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:46.183554 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1559942-a9bd-4a1b-8315-12a6fde9074c tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:46.184311 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1559942-a9bd-4a1b-8315-12a6fde9074c tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:46.184852 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1559942-a9bd-4a1b-8315-12a6fde9074c tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:46.185388 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-a1559942-a9bd-4a1b-8315-12a6fde9074c tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:46.321169 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-a1559942-a9bd-4a1b-8315-12a6fde9074c tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace8f69828e64b3b826cc57835dfd04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b9491baa5346a3a32a3d7d221b88e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:06:46.328930 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-a1559942-a9bd-4a1b-8315-12a6fde9074c tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8" status: 200 len: 1373 microversion: 2.1 time: 0.161914 Sep 24 22:06:46.329503 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3570/7122] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:06:46 2022] GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8 => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:06:47.352676 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6b30c6fe-6aba-4a2e-8d91-df24a71084d7 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:06:47.353314 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6b30c6fe-6aba-4a2e-8d91-df24a71084d7 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: efbe4dc6-71eb-41c8-95e7-02bae1fed1f8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:06:47.359871 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b30c6fe-6aba-4a2e-8d91-df24a71084d7 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:47.360361 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b30c6fe-6aba-4a2e-8d91-df24a71084d7 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:47.360801 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b30c6fe-6aba-4a2e-8d91-df24a71084d7 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:47.361510 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b30c6fe-6aba-4a2e-8d91-df24a71084d7 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:47.361969 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b30c6fe-6aba-4a2e-8d91-df24a71084d7 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:47.362601 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6b30c6fe-6aba-4a2e-8d91-df24a71084d7 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:47.568592 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-6b30c6fe-6aba-4a2e-8d91-df24a71084d7 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace8f69828e64b3b826cc57835dfd04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b9491baa5346a3a32a3d7d221b88e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:06:47.576529 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6b30c6fe-6aba-4a2e-8d91-df24a71084d7 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8" status: 200 len: 1373 microversion: 2.1 time: 0.229358 Sep 24 22:06:47.577294 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3553/7123] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:06:47 2022] GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8 => generated 1373 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:06:47.729936 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-7e26860d-90d0-49fe-83a5-bf822c51cf82 req-df836927-1e13-4cd0-9ca6-ad4a34ce4401 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efbe4dc6-71eb-41c8-95e7-02bae1fed1f8", "tag": "2377d473-78fb-4ea9-be74-dab3037c859d"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 22:06:47.740302 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-7e26860d-90d0-49fe-83a5-bf822c51cf82 req-df836927-1e13-4cd0-9ca6-ad4a34ce4401 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:47.740796 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-7e26860d-90d0-49fe-83a5-bf822c51cf82 req-df836927-1e13-4cd0-9ca6-ad4a34ce4401 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:47.741235 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-7e26860d-90d0-49fe-83a5-bf822c51cf82 req-df836927-1e13-4cd0-9ca6-ad4a34ce4401 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:47.756894 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-7e26860d-90d0-49fe-83a5-bf822c51cf82 req-df836927-1e13-4cd0-9ca6-ad4a34ce4401 service nova] Creating event network-changed:2377d473-78fb-4ea9-be74-dab3037c859d for instance efbe4dc6-71eb-41c8-95e7-02bae1fed1f8 on nch1-master-1 Sep 24 22:06:47.761912 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-7e26860d-90d0-49fe-83a5-bf822c51cf82 req-df836927-1e13-4cd0-9ca6-ad4a34ce4401 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099885 Sep 24 22:06:47.763932 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3571/7124] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 22:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 22:06:48.601293 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-84cd1a36-2ab1-49eb-b6c0-33bff6059583 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:06:48.601896 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-84cd1a36-2ab1-49eb-b6c0-33bff6059583 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: efbe4dc6-71eb-41c8-95e7-02bae1fed1f8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:06:48.608892 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-84cd1a36-2ab1-49eb-b6c0-33bff6059583 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:48.609374 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-84cd1a36-2ab1-49eb-b6c0-33bff6059583 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:48.609818 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-84cd1a36-2ab1-49eb-b6c0-33bff6059583 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:48.610533 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-84cd1a36-2ab1-49eb-b6c0-33bff6059583 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:48.610998 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-84cd1a36-2ab1-49eb-b6c0-33bff6059583 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:48.611424 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-84cd1a36-2ab1-49eb-b6c0-33bff6059583 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:48.747039 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-84cd1a36-2ab1-49eb-b6c0-33bff6059583 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace8f69828e64b3b826cc57835dfd04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b9491baa5346a3a32a3d7d221b88e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:06:48.755765 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-84cd1a36-2ab1-49eb-b6c0-33bff6059583 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8" status: 200 len: 1373 microversion: 2.1 time: 0.158493 Sep 24 22:06:48.756341 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3554/7125] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:06:48 2022] GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8 => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:06:49.780773 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-c2b2331f-d20f-4cc3-8604-b932c9afafcf tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:06:49.781487 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-c2b2331f-d20f-4cc3-8604-b932c9afafcf tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: efbe4dc6-71eb-41c8-95e7-02bae1fed1f8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:06:49.790486 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c2b2331f-d20f-4cc3-8604-b932c9afafcf tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:49.791003 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c2b2331f-d20f-4cc3-8604-b932c9afafcf tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:49.791475 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c2b2331f-d20f-4cc3-8604-b932c9afafcf tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:49.792183 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c2b2331f-d20f-4cc3-8604-b932c9afafcf tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:49.792650 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c2b2331f-d20f-4cc3-8604-b932c9afafcf tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:49.793094 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-c2b2331f-d20f-4cc3-8604-b932c9afafcf tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:49.934142 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-c2b2331f-d20f-4cc3-8604-b932c9afafcf tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace8f69828e64b3b826cc57835dfd04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b9491baa5346a3a32a3d7d221b88e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:06:49.942972 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-c2b2331f-d20f-4cc3-8604-b932c9afafcf tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8" status: 200 len: 1373 microversion: 2.1 time: 0.167238 Sep 24 22:06:49.943562 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3572/7126] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:06:49 2022] GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8 => generated 1373 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:06:50.969072 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-254977a5-0b9f-4580-a48d-c7793f54081e tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:06:50.970123 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-254977a5-0b9f-4580-a48d-c7793f54081e tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: efbe4dc6-71eb-41c8-95e7-02bae1fed1f8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:06:50.978676 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-254977a5-0b9f-4580-a48d-c7793f54081e tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:50.979173 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-254977a5-0b9f-4580-a48d-c7793f54081e tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:50.979621 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-254977a5-0b9f-4580-a48d-c7793f54081e tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:50.980415 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-254977a5-0b9f-4580-a48d-c7793f54081e tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:50.980867 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-254977a5-0b9f-4580-a48d-c7793f54081e tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:50.981306 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-254977a5-0b9f-4580-a48d-c7793f54081e tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:51.148896 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-254977a5-0b9f-4580-a48d-c7793f54081e tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace8f69828e64b3b826cc57835dfd04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b9491baa5346a3a32a3d7d221b88e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:06:51.156912 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-254977a5-0b9f-4580-a48d-c7793f54081e tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8" status: 200 len: 1373 microversion: 2.1 time: 0.192755 Sep 24 22:06:51.157500 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3555/7127] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:06:50 2022] GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8 => generated 1373 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:06:52.181970 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-8a1db658-1c49-4823-8531-edbbc673267a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:06:52.182613 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-8a1db658-1c49-4823-8531-edbbc673267a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: efbe4dc6-71eb-41c8-95e7-02bae1fed1f8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:06:52.189946 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8a1db658-1c49-4823-8531-edbbc673267a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:52.191198 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8a1db658-1c49-4823-8531-edbbc673267a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:52.191915 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8a1db658-1c49-4823-8531-edbbc673267a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:52.192621 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8a1db658-1c49-4823-8531-edbbc673267a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:52.193082 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8a1db658-1c49-4823-8531-edbbc673267a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:52.193507 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-8a1db658-1c49-4823-8531-edbbc673267a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:52.323466 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-8a1db658-1c49-4823-8531-edbbc673267a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace8f69828e64b3b826cc57835dfd04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b9491baa5346a3a32a3d7d221b88e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:06:52.331245 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-8a1db658-1c49-4823-8531-edbbc673267a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8" status: 200 len: 1373 microversion: 2.1 time: 0.153190 Sep 24 22:06:52.331827 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3573/7128] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:06:52 2022] GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8 => generated 1373 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:06:53.353708 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-c35409e1-ef5b-421d-bf7e-f139125a3b11 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:06:53.354534 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-c35409e1-ef5b-421d-bf7e-f139125a3b11 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: efbe4dc6-71eb-41c8-95e7-02bae1fed1f8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:06:53.361754 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c35409e1-ef5b-421d-bf7e-f139125a3b11 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:53.362404 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c35409e1-ef5b-421d-bf7e-f139125a3b11 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:53.362943 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c35409e1-ef5b-421d-bf7e-f139125a3b11 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:53.363677 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c35409e1-ef5b-421d-bf7e-f139125a3b11 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:53.364135 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c35409e1-ef5b-421d-bf7e-f139125a3b11 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:53.364570 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-c35409e1-ef5b-421d-bf7e-f139125a3b11 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:53.395301 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-dd709651-945f-44e8-920b-ac670846a83b req-e9dd10b8-6d6c-4913-b6e6-f5660f475b49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efbe4dc6-71eb-41c8-95e7-02bae1fed1f8", "name": "network-vif-plugged", "status": "completed", "tag": "2377d473-78fb-4ea9-be74-dab3037c859d"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 22:06:53.410131 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-dd709651-945f-44e8-920b-ac670846a83b req-e9dd10b8-6d6c-4913-b6e6-f5660f475b49 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:53.410131 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-dd709651-945f-44e8-920b-ac670846a83b req-e9dd10b8-6d6c-4913-b6e6-f5660f475b49 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:53.410131 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-dd709651-945f-44e8-920b-ac670846a83b req-e9dd10b8-6d6c-4913-b6e6-f5660f475b49 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:53.421438 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-dd709651-945f-44e8-920b-ac670846a83b req-e9dd10b8-6d6c-4913-b6e6-f5660f475b49 service nova] Creating event network-vif-plugged:2377d473-78fb-4ea9-be74-dab3037c859d for instance efbe4dc6-71eb-41c8-95e7-02bae1fed1f8 on nch1-master-1 Sep 24 22:06:53.427551 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-dd709651-945f-44e8-920b-ac670846a83b req-e9dd10b8-6d6c-4913-b6e6-f5660f475b49 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038016 Sep 24 22:06:53.428338 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3574/7129] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 22:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 22:06:53.540889 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-c35409e1-ef5b-421d-bf7e-f139125a3b11 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace8f69828e64b3b826cc57835dfd04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b9491baa5346a3a32a3d7d221b88e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:06:53.549016 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-c35409e1-ef5b-421d-bf7e-f139125a3b11 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8" status: 200 len: 1373 microversion: 2.1 time: 0.199344 Sep 24 22:06:53.549599 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3556/7130] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:06:53 2022] GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8 => generated 1373 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:06:54.573197 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-6540546d-e9cb-41a3-8572-86618afb3356 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:06:54.573896 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-6540546d-e9cb-41a3-8572-86618afb3356 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: efbe4dc6-71eb-41c8-95e7-02bae1fed1f8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:06:54.581627 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6540546d-e9cb-41a3-8572-86618afb3356 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:54.582127 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6540546d-e9cb-41a3-8572-86618afb3356 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:54.582603 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6540546d-e9cb-41a3-8572-86618afb3356 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:54.583307 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6540546d-e9cb-41a3-8572-86618afb3356 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:54.583804 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6540546d-e9cb-41a3-8572-86618afb3356 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:54.584241 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-6540546d-e9cb-41a3-8572-86618afb3356 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:54.722879 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-6540546d-e9cb-41a3-8572-86618afb3356 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace8f69828e64b3b826cc57835dfd04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b9491baa5346a3a32a3d7d221b88e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:06:54.731500 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-6540546d-e9cb-41a3-8572-86618afb3356 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8" status: 200 len: 1373 microversion: 2.1 time: 0.162591 Sep 24 22:06:54.732086 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3575/7131] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:06:54 2022] GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8 => generated 1373 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:06:55.756080 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-60d4687f-93e5-42e4-ae9d-bd0139d3a541 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:06:55.756703 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-60d4687f-93e5-42e4-ae9d-bd0139d3a541 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: efbe4dc6-71eb-41c8-95e7-02bae1fed1f8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:06:55.763745 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-60d4687f-93e5-42e4-ae9d-bd0139d3a541 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:55.764230 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-60d4687f-93e5-42e4-ae9d-bd0139d3a541 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:55.764673 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-60d4687f-93e5-42e4-ae9d-bd0139d3a541 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:55.765371 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-60d4687f-93e5-42e4-ae9d-bd0139d3a541 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:55.765834 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-60d4687f-93e5-42e4-ae9d-bd0139d3a541 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:55.766266 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-60d4687f-93e5-42e4-ae9d-bd0139d3a541 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:55.899715 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-60d4687f-93e5-42e4-ae9d-bd0139d3a541 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace8f69828e64b3b826cc57835dfd04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b9491baa5346a3a32a3d7d221b88e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:06:55.907552 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-60d4687f-93e5-42e4-ae9d-bd0139d3a541 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8" status: 200 len: 1557 microversion: 2.1 time: 0.155929 Sep 24 22:06:55.908154 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3557/7132] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:06:55 2022] GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8 => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:06:55.930665 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-064ba626-e57b-42d4-a754-3d7cee08695a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:06:55.931289 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-064ba626-e57b-42d4-a754-3d7cee08695a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: efbe4dc6-71eb-41c8-95e7-02bae1fed1f8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:06:55.938609 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-064ba626-e57b-42d4-a754-3d7cee08695a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:55.939097 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-064ba626-e57b-42d4-a754-3d7cee08695a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:55.939540 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-064ba626-e57b-42d4-a754-3d7cee08695a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:55.942582 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-064ba626-e57b-42d4-a754-3d7cee08695a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:55.943071 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-064ba626-e57b-42d4-a754-3d7cee08695a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:55.943512 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-064ba626-e57b-42d4-a754-3d7cee08695a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:56.081388 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-064ba626-e57b-42d4-a754-3d7cee08695a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace8f69828e64b3b826cc57835dfd04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b9491baa5346a3a32a3d7d221b88e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:06:56.089305 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-064ba626-e57b-42d4-a754-3d7cee08695a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8" status: 200 len: 1557 microversion: 2.1 time: 0.162508 Sep 24 22:06:56.089873 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3576/7133] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:06:55 2022] GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8 => generated 1557 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:06:58.002393 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-b6492043-002a-433e-a97f-950348f364d2 req-4b141c1a-8fa2-49c0-89ac-f667dfb8dd42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efbe4dc6-71eb-41c8-95e7-02bae1fed1f8", "tag": "2377d473-78fb-4ea9-be74-dab3037c859d"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 22:06:58.008803 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=27 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:06:58.014247 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-b6492043-002a-433e-a97f-950348f364d2 req-4b141c1a-8fa2-49c0-89ac-f667dfb8dd42 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:06:58.014763 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-b6492043-002a-433e-a97f-950348f364d2 req-4b141c1a-8fa2-49c0-89ac-f667dfb8dd42 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:06:58.015421 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-b6492043-002a-433e-a97f-950348f364d2 req-4b141c1a-8fa2-49c0-89ac-f667dfb8dd42 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:06:58.020167 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=63 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:06:58.028557 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-b6492043-002a-433e-a97f-950348f364d2 req-4b141c1a-8fa2-49c0-89ac-f667dfb8dd42 service nova] Creating event network-changed:2377d473-78fb-4ea9-be74-dab3037c859d for instance efbe4dc6-71eb-41c8-95e7-02bae1fed1f8 on nch1-master-1 Sep 24 22:06:58.033704 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-b6492043-002a-433e-a97f-950348f364d2 req-4b141c1a-8fa2-49c0-89ac-f667dfb8dd42 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035010 Sep 24 22:06:58.034407 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3558/7134] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 22:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 22:09:11.595261 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:09:11.596033 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=62 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:09:11.597287 ncdv-master-1 devstack@n-api.service[140517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 22:09:11.597433 ncdv-master-1 devstack@n-api.service[140517]: Sat Sep 24 22:09:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8/action (ip 10.222.0.52) !!! Sep 24 22:09:11.600063 ncdv-master-1 devstack@n-api.service[140517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 24 22:09:11.600212 ncdv-master-1 devstack@n-api.service[140517]: Sat Sep 24 22:09:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8/action (ip 10.222.0.52) !!! Sep 24 22:09:11.690071 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-f7975bde-aaad-468d-afe1-6076cd82f175 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1140908304"}} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 22:09:11.692855 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-f7975bde-aaad-468d-afe1-6076cd82f175 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: efbe4dc6-71eb-41c8-95e7-02bae1fed1f8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:09:11.699144 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7975bde-aaad-468d-afe1-6076cd82f175 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:09:11.699636 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7975bde-aaad-468d-afe1-6076cd82f175 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:09:11.700109 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7975bde-aaad-468d-afe1-6076cd82f175 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:09:11.700809 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7975bde-aaad-468d-afe1-6076cd82f175 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:09:11.701286 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7975bde-aaad-468d-afe1-6076cd82f175 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:09:11.701724 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-f7975bde-aaad-468d-afe1-6076cd82f175 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:09:11.906285 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-f7975bde-aaad-468d-afe1-6076cd82f175 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "POST /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8/action" status: 202 len: 0 microversion: 2.1 time: 0.313068 Sep 24 22:09:11.906984 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3577/7135] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 22:09:11 2022] POST /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 24 22:09:18.301858 ncdv-master-1 devstack@n-api.service[140516]: ERROR oslo.messaging._drivers.impl_rabbit [-] [75d0407e-7b02-4bce-a3f1-1c13562673e6] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 24 22:09:18.302734 ncdv-master-1 devstack@n-api.service[140516]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ec046047-61d1-42c1-9e5b-9695ac0fd1f9] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 24 22:09:18.303243 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:09:18.304514 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=1 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:09:18.305862 ncdv-master-1 devstack@n-api.service[140516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 22:09:18.305992 ncdv-master-1 devstack@n-api.service[140516]: Sat Sep 24 22:09:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.52) !!! Sep 24 22:09:18.313384 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-588170e7-d178-4f7a-97f9-8d7db8d00789 req-0fa69a9e-859f-4df1-afcb-09908108f1ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efbe4dc6-71eb-41c8-95e7-02bae1fed1f8", "name": "network-vif-plugged", "status": "completed", "tag": "2377d473-78fb-4ea9-be74-dab3037c859d"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 22:09:18.329315 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-588170e7-d178-4f7a-97f9-8d7db8d00789 req-0fa69a9e-859f-4df1-afcb-09908108f1ae service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:09:18.329798 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-588170e7-d178-4f7a-97f9-8d7db8d00789 req-0fa69a9e-859f-4df1-afcb-09908108f1ae service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:09:18.330247 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-588170e7-d178-4f7a-97f9-8d7db8d00789 req-0fa69a9e-859f-4df1-afcb-09908108f1ae service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:09:18.341411 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-588170e7-d178-4f7a-97f9-8d7db8d00789 req-0fa69a9e-859f-4df1-afcb-09908108f1ae service nova] Creating event network-vif-plugged:2377d473-78fb-4ea9-be74-dab3037c859d for instance efbe4dc6-71eb-41c8-95e7-02bae1fed1f8 on nch1-master-1 Sep 24 22:09:18.346516 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-588170e7-d178-4f7a-97f9-8d7db8d00789 req-0fa69a9e-859f-4df1-afcb-09908108f1ae service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046578 Sep 24 22:09:18.347305 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3559/7136] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 22:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 22:09:30.646912 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-36bcf3c0-9831-48da-b694-5b6f35fe8d91 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:09:30.648159 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-36bcf3c0-9831-48da-b694-5b6f35fe8d91 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: efbe4dc6-71eb-41c8-95e7-02bae1fed1f8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:09:30.652427 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_api:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:09:30.653184 ncdv-master-1 devstack@n-api.service[140516]: DEBUG dbcounter [-] [140516] Writing DB stats nova_cell1:SELECT=2 {{(pid=140516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:09:30.657271 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_api:SELECT=2 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:09:30.658578 ncdv-master-1 devstack@n-api.service[140517]: DEBUG dbcounter [-] [140517] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:09:30.661221 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-36bcf3c0-9831-48da-b694-5b6f35fe8d91 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:09:30.662261 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-36bcf3c0-9831-48da-b694-5b6f35fe8d91 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:09:30.662951 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-36bcf3c0-9831-48da-b694-5b6f35fe8d91 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:09:30.663998 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-36bcf3c0-9831-48da-b694-5b6f35fe8d91 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:09:30.664572 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-36bcf3c0-9831-48da-b694-5b6f35fe8d91 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:09:30.665883 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-36bcf3c0-9831-48da-b694-5b6f35fe8d91 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:09:30.674311 ncdv-master-1 devstack@n-api.service[140516]: INFO oslo.messaging._drivers.impl_rabbit [-] [ec046047-61d1-42c1-9e5b-9695ac0fd1f9] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 32874. Sep 24 22:09:30.675112 ncdv-master-1 devstack@n-api.service[140516]: INFO oslo.messaging._drivers.impl_rabbit [-] [75d0407e-7b02-4bce-a3f1-1c13562673e6] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 32872. Sep 24 22:09:30.700683 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-36bcf3c0-9831-48da-b694-5b6f35fe8d91 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: efbe4dc6-71eb-41c8-95e7-02bae1fed1f8] Going to try to terminate instance {{(pid=140517) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 22:09:30.735362 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-d67bc708-055d-4e01-a4cf-2cedde0706d5 req-a0f47bc9-39d6-4191-993a-06e99b4c5b79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efbe4dc6-71eb-41c8-95e7-02bae1fed1f8", "tag": "2377d473-78fb-4ea9-be74-dab3037c859d"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 22:09:30.748658 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d67bc708-055d-4e01-a4cf-2cedde0706d5 req-a0f47bc9-39d6-4191-993a-06e99b4c5b79 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:09:30.749561 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d67bc708-055d-4e01-a4cf-2cedde0706d5 req-a0f47bc9-39d6-4191-993a-06e99b4c5b79 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:09:30.750090 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-d67bc708-055d-4e01-a4cf-2cedde0706d5 req-a0f47bc9-39d6-4191-993a-06e99b4c5b79 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:09:30.763361 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-d67bc708-055d-4e01-a4cf-2cedde0706d5 req-a0f47bc9-39d6-4191-993a-06e99b4c5b79 service nova] Creating event network-changed:2377d473-78fb-4ea9-be74-dab3037c859d for instance efbe4dc6-71eb-41c8-95e7-02bae1fed1f8 on nch1-master-1 Sep 24 22:09:30.768896 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-d67bc708-055d-4e01-a4cf-2cedde0706d5 req-a0f47bc9-39d6-4191-993a-06e99b4c5b79 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118646 Sep 24 22:09:30.770433 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3560/7137] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 22:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 22:09:30.804558 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-36bcf3c0-9831-48da-b694-5b6f35fe8d91 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "DELETE /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8" status: 204 len: 0 microversion: 2.1 time: 0.158730 Sep 24 22:09:30.805965 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3578/7138] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 22:09:30 2022] DELETE /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 22:09:30.816373 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d89773cb-32c2-438b-b1e4-b95dac993d26 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:09:30.817252 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d89773cb-32c2-438b-b1e4-b95dac993d26 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: efbe4dc6-71eb-41c8-95e7-02bae1fed1f8] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:09:30.824176 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d89773cb-32c2-438b-b1e4-b95dac993d26 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:09:30.824682 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d89773cb-32c2-438b-b1e4-b95dac993d26 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:09:30.825135 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d89773cb-32c2-438b-b1e4-b95dac993d26 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:09:30.825945 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d89773cb-32c2-438b-b1e4-b95dac993d26 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:09:30.826774 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d89773cb-32c2-438b-b1e4-b95dac993d26 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:09:30.827203 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d89773cb-32c2-438b-b1e4-b95dac993d26 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:09:30.982334 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-d89773cb-32c2-438b-b1e4-b95dac993d26 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace8f69828e64b3b826cc57835dfd04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b9491baa5346a3a32a3d7d221b88e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:09:30.990275 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d89773cb-32c2-438b-b1e4-b95dac993d26 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8" status: 200 len: 1681 microversion: 2.1 time: 0.179326 Sep 24 22:09:30.990893 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3561/7139] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:09:30 2022] GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8 => generated 1681 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:09:32.014891 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-39e8891f-6136-4732-943b-eac05773110d tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:09:32.015543 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-39e8891f-6136-4732-943b-eac05773110d tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: efbe4dc6-71eb-41c8-95e7-02bae1fed1f8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:09:32.022231 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-39e8891f-6136-4732-943b-eac05773110d tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:09:32.022764 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-39e8891f-6136-4732-943b-eac05773110d tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:09:32.023208 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-39e8891f-6136-4732-943b-eac05773110d tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:09:32.023917 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-39e8891f-6136-4732-943b-eac05773110d tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:09:32.024378 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-39e8891f-6136-4732-943b-eac05773110d tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:09:32.024842 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-39e8891f-6136-4732-943b-eac05773110d tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:09:32.177266 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-39e8891f-6136-4732-943b-eac05773110d tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace8f69828e64b3b826cc57835dfd04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b9491baa5346a3a32a3d7d221b88e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:09:32.186738 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-39e8891f-6136-4732-943b-eac05773110d tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8" status: 200 len: 1681 microversion: 2.1 time: 0.176250 Sep 24 22:09:32.187347 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3579/7140] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:09:32 2022] GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8 => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:09:32.388408 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-a4a275af-90b2-49e4-94c2-74bc2b85e36a req-11ae827f-32ef-4939-b541-59c18b043bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efbe4dc6-71eb-41c8-95e7-02bae1fed1f8", "name": "network-vif-unplugged", "status": "completed", "tag": "2377d473-78fb-4ea9-be74-dab3037c859d"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 22:09:32.401410 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a4a275af-90b2-49e4-94c2-74bc2b85e36a req-11ae827f-32ef-4939-b541-59c18b043bf6 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:09:32.401898 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a4a275af-90b2-49e4-94c2-74bc2b85e36a req-11ae827f-32ef-4939-b541-59c18b043bf6 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:09:32.402332 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a4a275af-90b2-49e4-94c2-74bc2b85e36a req-11ae827f-32ef-4939-b541-59c18b043bf6 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:09:32.413952 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-a4a275af-90b2-49e4-94c2-74bc2b85e36a req-11ae827f-32ef-4939-b541-59c18b043bf6 service nova] Creating event network-vif-unplugged:2377d473-78fb-4ea9-be74-dab3037c859d for instance efbe4dc6-71eb-41c8-95e7-02bae1fed1f8 on nch1-master-1 Sep 24 22:09:32.420290 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-a4a275af-90b2-49e4-94c2-74bc2b85e36a req-11ae827f-32ef-4939-b541-59c18b043bf6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036823 Sep 24 22:09:32.420907 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3562/7141] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 22:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 22:09:33.211015 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-ba7ce4c1-8d3e-4831-8a08-0bad3fb41a2a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:09:33.211645 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-ba7ce4c1-8d3e-4831-8a08-0bad3fb41a2a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: efbe4dc6-71eb-41c8-95e7-02bae1fed1f8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:09:33.218793 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ba7ce4c1-8d3e-4831-8a08-0bad3fb41a2a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:09:33.219294 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ba7ce4c1-8d3e-4831-8a08-0bad3fb41a2a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:09:33.219742 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ba7ce4c1-8d3e-4831-8a08-0bad3fb41a2a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:09:33.220460 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ba7ce4c1-8d3e-4831-8a08-0bad3fb41a2a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:09:33.220926 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ba7ce4c1-8d3e-4831-8a08-0bad3fb41a2a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:09:33.221362 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-ba7ce4c1-8d3e-4831-8a08-0bad3fb41a2a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:09:33.417717 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-ba7ce4c1-8d3e-4831-8a08-0bad3fb41a2a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace8f69828e64b3b826cc57835dfd04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b9491baa5346a3a32a3d7d221b88e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:09:33.425618 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-ba7ce4c1-8d3e-4831-8a08-0bad3fb41a2a tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8" status: 200 len: 1563 microversion: 2.1 time: 0.218667 Sep 24 22:09:33.426215 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3580/7142] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:09:33 2022] GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8 => generated 1563 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:09:33.544677 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [req-a8e44ef6-065e-4700-9965-7363125b6a51 req-8aaf89c1-6dd6-4b95-8a4e-c6e3dce2c4e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efbe4dc6-71eb-41c8-95e7-02bae1fed1f8", "name": "network-vif-deleted", "tag": "2377d473-78fb-4ea9-be74-dab3037c859d"}]} {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 22:09:33.554419 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a8e44ef6-065e-4700-9965-7363125b6a51 req-8aaf89c1-6dd6-4b95-8a4e-c6e3dce2c4e5 service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:09:33.554939 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a8e44ef6-065e-4700-9965-7363125b6a51 req-8aaf89c1-6dd6-4b95-8a4e-c6e3dce2c4e5 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:09:33.555408 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [req-a8e44ef6-065e-4700-9965-7363125b6a51 req-8aaf89c1-6dd6-4b95-8a4e-c6e3dce2c4e5 service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:09:33.570956 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.compute.server_external_events [req-a8e44ef6-065e-4700-9965-7363125b6a51 req-8aaf89c1-6dd6-4b95-8a4e-c6e3dce2c4e5 service nova] Creating event network-vif-deleted:2377d473-78fb-4ea9-be74-dab3037c859d for instance efbe4dc6-71eb-41c8-95e7-02bae1fed1f8 on nch1-master-1 Sep 24 22:09:33.576710 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [req-a8e44ef6-065e-4700-9965-7363125b6a51 req-8aaf89c1-6dd6-4b95-8a4e-c6e3dce2c4e5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037849 Sep 24 22:09:33.577532 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3563/7143] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 22:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 22:09:34.451700 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-03e3257c-e3cb-4066-90c5-e8cf8ff08043 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:09:34.452316 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-03e3257c-e3cb-4066-90c5-e8cf8ff08043 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: efbe4dc6-71eb-41c8-95e7-02bae1fed1f8] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:09:34.458479 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-03e3257c-e3cb-4066-90c5-e8cf8ff08043 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:09:34.458993 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-03e3257c-e3cb-4066-90c5-e8cf8ff08043 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:09:34.459432 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-03e3257c-e3cb-4066-90c5-e8cf8ff08043 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:09:34.460124 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-03e3257c-e3cb-4066-90c5-e8cf8ff08043 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:09:34.460581 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-03e3257c-e3cb-4066-90c5-e8cf8ff08043 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:09:34.461013 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-03e3257c-e3cb-4066-90c5-e8cf8ff08043 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:09:34.475300 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.wsgi [None req-03e3257c-e3cb-4066-90c5-e8cf8ff08043 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] HTTP exception thrown: Instance efbe4dc6-71eb-41c8-95e7-02bae1fed1f8 could not be found. Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-03e3257c-e3cb-4066-90c5-e8cf8ff08043 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Request method failure captured: Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: request: GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8 HTTP/1.1 Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: Accept: application/json Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: Accept-Encoding: identity Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: Connection: close Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: Content-Length: 0 Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: Content-Type: application/json Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: Host: 10.222.0.52 Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: Openstack-System-Scope: None Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: User-Agent: python-urllib3/1.26.12 Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: X-Auth-Token: gAAAAABjL37Trgt8bqabOXqLpRQmW7kiP3sbzP49oodt-yoUd3F5zBkfCgZKkA2gE8bOqCZVE8sGkWkd5_sY7B9DnvPkGkx9__szGp1k3HVJ7qNhVG2mXUTynquv37CRBTnEsoddx4dnkXy4J73zwjED9Reqnx1bbLVKZwDoWAOLiUelo87o6ZI Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Id: None Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: X-Domain-Name: None Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: X-Identity-Status: Confirmed Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: X-Is-Admin-Project: True Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Id: default Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Domain-Name: Default Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Id: 55b9491baa5346a3a32a3d7d221b88e9 Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: X-Project-Name: tempest-TestSnapshotPattern-1685179355 Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: X-Role: reader,member Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: X-Roles: reader,member Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/55b9491baa5346a3a32a3d7d221b88e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_55b9491baa5346a3a32a3d7d221b88e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/55b9491baa5346a3a32a3d7d221b88e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/55b9491baa5346a3a32a3d7d221b88e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant: tempest-TestSnapshotPattern-1685179355 Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Id: 55b9491baa5346a3a32a3d7d221b88e9 Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: X-Tenant-Name: tempest-TestSnapshotPattern-1685179355 Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: X-User: tempest-TestSnapshotPattern-1685179355-project Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Id: default Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: X-User-Domain-Name: Default Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: X-User-Id: ace8f69828e64b3b826cc57835dfd04c Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: X-User-Name: tempest-TestSnapshotPattern-1685179355-project Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: method: > Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: exception: Instance efbe4dc6-71eb-41c8-95e7-02bae1fed1f8 could not be found. Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: action_args: {'id': 'efbe4dc6-71eb-41c8-95e7-02bae1fed1f8'} Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efbe4dc6-71eb-41c8-95e7-02bae1fed1f8 could not be found. Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efbe4dc6-71eb-41c8-95e7-02bae1fed1f8 could not be found. Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 22:09:34.476961 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 22:09:34.481916 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 22:09:34.481916 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 22:09:34.481916 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 22:09:34.481916 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 22:09:34.481916 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 22:09:34.481916 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efbe4dc6-71eb-41c8-95e7-02bae1fed1f8 could not be found. Sep 24 22:09:34.481916 ncdv-master-1 devstack@n-api.service[140517]: ERROR nova.api.openstack.wsgi Sep 24 22:09:34.481916 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-03e3257c-e3cb-4066-90c5-e8cf8ff08043 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Returning 404 to user: Instance efbe4dc6-71eb-41c8-95e7-02bae1fed1f8 could not be found. {{(pid=140517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 22:09:34.481916 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-03e3257c-e3cb-4066-90c5-e8cf8ff08043 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8" status: 404 len: 111 microversion: 2.1 time: 0.031718 Sep 24 22:09:34.481916 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3581/7144] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:09:34 2022] GET /compute/v2.1/servers/efbe4dc6-71eb-41c8-95e7-02bae1fed1f8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 22:09:36.150835 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-2736ba7e-8f71-4e2f-86a6-689805ede835 req-d72d8e0c-7723-4a44-8b28-35961057facc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e2527d7-1944-4d5d-8b49-d81cd3e1677d", "tag": "0cc61a91-2a54-4c32-98d3-7f4ef262032a"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 22:09:36.151466 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-6e76fcf0-4835-47ba-b730-582fcc462daf tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:09:36.151466 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6e76fcf0-4835-47ba-b730-582fcc462daf tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: 7e2527d7-1944-4d5d-8b49-d81cd3e1677d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:09:36.157852 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6e76fcf0-4835-47ba-b730-582fcc462daf tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:09:36.158432 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6e76fcf0-4835-47ba-b730-582fcc462daf tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:09:36.158987 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6e76fcf0-4835-47ba-b730-582fcc462daf tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:09:36.159781 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6e76fcf0-4835-47ba-b730-582fcc462daf tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:09:36.160317 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6e76fcf0-4835-47ba-b730-582fcc462daf tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:09:36.160948 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-6e76fcf0-4835-47ba-b730-582fcc462daf tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:09:36.164265 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-2736ba7e-8f71-4e2f-86a6-689805ede835 req-d72d8e0c-7723-4a44-8b28-35961057facc service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:09:36.164834 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-2736ba7e-8f71-4e2f-86a6-689805ede835 req-d72d8e0c-7723-4a44-8b28-35961057facc service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:09:36.165460 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-2736ba7e-8f71-4e2f-86a6-689805ede835 req-d72d8e0c-7723-4a44-8b28-35961057facc service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:09:36.176821 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-2736ba7e-8f71-4e2f-86a6-689805ede835 req-d72d8e0c-7723-4a44-8b28-35961057facc service nova] Creating event network-changed:0cc61a91-2a54-4c32-98d3-7f4ef262032a for instance 7e2527d7-1944-4d5d-8b49-d81cd3e1677d on nch2-master-1 Sep 24 22:09:36.182735 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-2736ba7e-8f71-4e2f-86a6-689805ede835 req-d72d8e0c-7723-4a44-8b28-35961057facc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036147 Sep 24 22:09:36.183565 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3582/7145] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 22:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 22:09:36.190951 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-6e76fcf0-4835-47ba-b730-582fcc462daf tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: 7e2527d7-1944-4d5d-8b49-d81cd3e1677d] Going to try to terminate instance {{(pid=140516) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 22:09:36.283745 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-6e76fcf0-4835-47ba-b730-582fcc462daf tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7e2527d7-1944-4d5d-8b49-d81cd3e1677d" status: 204 len: 0 microversion: 2.1 time: 0.138241 Sep 24 22:09:36.284534 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3564/7146] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 22:09:36 2022] DELETE /compute/v2.1/servers/7e2527d7-1944-4d5d-8b49-d81cd3e1677d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 22:09:36.293844 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-52ce9c20-c4ba-4f59-a7ea-9f0aad162ec8 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:09:36.294592 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.compute.api [None req-52ce9c20-c4ba-4f59-a7ea-9f0aad162ec8 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: 7e2527d7-1944-4d5d-8b49-d81cd3e1677d] Fetching instance by UUID {{(pid=140517) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:09:36.301024 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52ce9c20-c4ba-4f59-a7ea-9f0aad162ec8 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:09:36.301526 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52ce9c20-c4ba-4f59-a7ea-9f0aad162ec8 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:09:36.303034 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52ce9c20-c4ba-4f59-a7ea-9f0aad162ec8 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:09:36.303929 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52ce9c20-c4ba-4f59-a7ea-9f0aad162ec8 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:09:36.304513 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52ce9c20-c4ba-4f59-a7ea-9f0aad162ec8 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:09:36.305051 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [None req-52ce9c20-c4ba-4f59-a7ea-9f0aad162ec8 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:09:36.463039 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.policy [None req-52ce9c20-c4ba-4f59-a7ea-9f0aad162ec8 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace8f69828e64b3b826cc57835dfd04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b9491baa5346a3a32a3d7d221b88e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140517) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:09:36.471039 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-52ce9c20-c4ba-4f59-a7ea-9f0aad162ec8 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "GET /compute/v2.1/servers/7e2527d7-1944-4d5d-8b49-d81cd3e1677d" status: 200 len: 1682 microversion: 2.1 time: 0.181793 Sep 24 22:09:36.471631 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3583/7147] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:09:36 2022] GET /compute/v2.1/servers/7e2527d7-1944-4d5d-8b49-d81cd3e1677d => generated 1682 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:09:37.496460 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-21be47a8-22a9-407b-82dd-a1029e5ce0fb tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:09:37.498462 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-21be47a8-22a9-407b-82dd-a1029e5ce0fb tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: 7e2527d7-1944-4d5d-8b49-d81cd3e1677d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:09:37.506392 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-21be47a8-22a9-407b-82dd-a1029e5ce0fb tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:09:37.508099 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-21be47a8-22a9-407b-82dd-a1029e5ce0fb tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:09:37.508734 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-21be47a8-22a9-407b-82dd-a1029e5ce0fb tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:09:37.510195 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-21be47a8-22a9-407b-82dd-a1029e5ce0fb tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:09:37.510892 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-21be47a8-22a9-407b-82dd-a1029e5ce0fb tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:09:37.511967 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-21be47a8-22a9-407b-82dd-a1029e5ce0fb tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:09:37.597164 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.policy [None req-21be47a8-22a9-407b-82dd-a1029e5ce0fb tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace8f69828e64b3b826cc57835dfd04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b9491baa5346a3a32a3d7d221b88e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140516) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 22:09:37.606477 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-21be47a8-22a9-407b-82dd-a1029e5ce0fb tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "GET /compute/v2.1/servers/7e2527d7-1944-4d5d-8b49-d81cd3e1677d" status: 200 len: 1496 microversion: 2.1 time: 0.115886 Sep 24 22:09:37.607483 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3565/7148] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:09:37 2022] GET /compute/v2.1/servers/7e2527d7-1944-4d5d-8b49-d81cd3e1677d => generated 1496 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 22:09:38.197714 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [req-9fe4aa04-0bc9-4eb5-9cb4-e3a67637f949 req-53f3a3e7-9a98-41ac-9c08-aafaac1e204a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e2527d7-1944-4d5d-8b49-d81cd3e1677d", "name": "network-vif-deleted", "tag": "0cc61a91-2a54-4c32-98d3-7f4ef262032a"}]} {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 22:09:38.207823 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-9fe4aa04-0bc9-4eb5-9cb4-e3a67637f949 req-53f3a3e7-9a98-41ac-9c08-aafaac1e204a service nova] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:09:38.208304 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-9fe4aa04-0bc9-4eb5-9cb4-e3a67637f949 req-53f3a3e7-9a98-41ac-9c08-aafaac1e204a service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:09:38.208739 ncdv-master-1 devstack@n-api.service[140517]: DEBUG oslo_concurrency.lockutils [req-9fe4aa04-0bc9-4eb5-9cb4-e3a67637f949 req-53f3a3e7-9a98-41ac-9c08-aafaac1e204a service nova] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:09:38.222175 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.compute.server_external_events [req-9fe4aa04-0bc9-4eb5-9cb4-e3a67637f949 req-53f3a3e7-9a98-41ac-9c08-aafaac1e204a service nova] Creating event network-vif-deleted:0cc61a91-2a54-4c32-98d3-7f4ef262032a for instance 7e2527d7-1944-4d5d-8b49-d81cd3e1677d on nch2-master-1 Sep 24 22:09:38.227200 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [req-9fe4aa04-0bc9-4eb5-9cb4-e3a67637f949 req-53f3a3e7-9a98-41ac-9c08-aafaac1e204a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033098 Sep 24 22:09:38.228370 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3584/7149] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 22:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 22:09:38.631041 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d3ddc6aa-7538-4202-b387-78bc5b296584 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '>' {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:09:38.631658 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.compute.api [None req-d3ddc6aa-7538-4202-b387-78bc5b296584 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] [instance: 7e2527d7-1944-4d5d-8b49-d81cd3e1677d] Fetching instance by UUID {{(pid=140516) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 22:09:38.639188 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d3ddc6aa-7538-4202-b387-78bc5b296584 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:09:38.639790 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d3ddc6aa-7538-4202-b387-78bc5b296584 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:09:38.640246 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d3ddc6aa-7538-4202-b387-78bc5b296584 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:09:38.640957 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d3ddc6aa-7538-4202-b387-78bc5b296584 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Acquiring lock "788aecb6-32dc-4b71-909a-be050455aded" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 22:09:38.641424 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d3ddc6aa-7538-4202-b387-78bc5b296584 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 22:09:38.641861 ncdv-master-1 devstack@n-api.service[140516]: DEBUG oslo_concurrency.lockutils [None req-d3ddc6aa-7538-4202-b387-78bc5b296584 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Lock "788aecb6-32dc-4b71-909a-be050455aded" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 22:09:38.656186 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.wsgi [None req-d3ddc6aa-7538-4202-b387-78bc5b296584 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] HTTP exception thrown: Instance 7e2527d7-1944-4d5d-8b49-d81cd3e1677d could not be found. Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d3ddc6aa-7538-4202-b387-78bc5b296584 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Request method failure captured: Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: request: GET /compute/v2.1/servers/7e2527d7-1944-4d5d-8b49-d81cd3e1677d HTTP/1.1 Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: Accept: application/json Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: Accept-Encoding: identity Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: Connection: close Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: Content-Length: 0 Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: Content-Type: application/json Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: Host: 10.222.0.52 Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: Openstack-System-Scope: None Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: User-Agent: python-urllib3/1.26.12 Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: X-Auth-Token: gAAAAABjL37Trgt8bqabOXqLpRQmW7kiP3sbzP49oodt-yoUd3F5zBkfCgZKkA2gE8bOqCZVE8sGkWkd5_sY7B9DnvPkGkx9__szGp1k3HVJ7qNhVG2mXUTynquv37CRBTnEsoddx4dnkXy4J73zwjED9Reqnx1bbLVKZwDoWAOLiUelo87o6ZI Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Id: None Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: X-Domain-Name: None Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: X-Identity-Status: Confirmed Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: X-Is-Admin-Project: True Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Id: default Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Domain-Name: Default Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Id: 55b9491baa5346a3a32a3d7d221b88e9 Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: X-Project-Name: tempest-TestSnapshotPattern-1685179355 Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: X-Role: reader,member Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: X-Roles: reader,member Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/55b9491baa5346a3a32a3d7d221b88e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_55b9491baa5346a3a32a3d7d221b88e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/55b9491baa5346a3a32a3d7d221b88e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/55b9491baa5346a3a32a3d7d221b88e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant: tempest-TestSnapshotPattern-1685179355 Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Id: 55b9491baa5346a3a32a3d7d221b88e9 Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: X-Tenant-Name: tempest-TestSnapshotPattern-1685179355 Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: X-User: tempest-TestSnapshotPattern-1685179355-project Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Id: default Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: X-User-Domain-Name: Default Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: X-User-Id: ace8f69828e64b3b826cc57835dfd04c Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: X-User-Name: tempest-TestSnapshotPattern-1685179355-project Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: method: > Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: exception: Instance 7e2527d7-1944-4d5d-8b49-d81cd3e1677d could not be found. Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: action_args: {'id': '7e2527d7-1944-4d5d-8b49-d81cd3e1677d'} Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: {{(pid=140516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e2527d7-1944-4d5d-8b49-d81cd3e1677d could not be found. Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e2527d7-1944-4d5d-8b49-d81cd3e1677d could not be found. Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 22:09:38.657843 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 22:09:38.663008 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 22:09:38.663008 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 22:09:38.663008 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 22:09:38.663008 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 22:09:38.663008 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 22:09:38.663008 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e2527d7-1944-4d5d-8b49-d81cd3e1677d could not be found. Sep 24 22:09:38.663008 ncdv-master-1 devstack@n-api.service[140516]: ERROR nova.api.openstack.wsgi Sep 24 22:09:38.663008 ncdv-master-1 devstack@n-api.service[140516]: DEBUG nova.api.openstack.wsgi [None req-d3ddc6aa-7538-4202-b387-78bc5b296584 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Returning 404 to user: Instance 7e2527d7-1944-4d5d-8b49-d81cd3e1677d could not be found. {{(pid=140516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 22:09:38.663008 ncdv-master-1 devstack@n-api.service[140516]: INFO nova.api.openstack.requestlog [None req-d3ddc6aa-7538-4202-b387-78bc5b296584 tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "GET /compute/v2.1/servers/7e2527d7-1944-4d5d-8b49-d81cd3e1677d" status: 404 len: 111 microversion: 2.1 time: 0.032237 Sep 24 22:09:38.663008 ncdv-master-1 devstack@n-api.service[140516]: [pid: 140516|app: 0|req: 3566/7150] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 22:09:38 2022] GET /compute/v2.1/servers/7e2527d7-1944-4d5d-8b49-d81cd3e1677d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 22:09:38.820257 ncdv-master-1 devstack@n-api.service[140517]: DEBUG nova.api.openstack.wsgi [None req-94e7c088-0e01-4634-8b95-c8c54ceadccf tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] Calling method '.version_select at 0x7f4b0c895820>' {{(pid=140517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 22:09:38.844562 ncdv-master-1 devstack@n-api.service[140517]: INFO nova.api.openstack.requestlog [None req-94e7c088-0e01-4634-8b95-c8c54ceadccf tempest-TestSnapshotPattern-1685179355 tempest-TestSnapshotPattern-1685179355-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-374495828" status: 202 len: 0 microversion: 2.1 time: 0.028759 Sep 24 22:09:38.845470 ncdv-master-1 devstack@n-api.service[140517]: [pid: 140517|app: 0|req: 3585/7151] 10.222.0.52 () {58 vars in 1254 bytes} [Sat Sep 24 22:09:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-374495828 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)